2024-08-31T04:03:10.742 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-08-31T04:03:10.768 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-08-31T04:03:10.860 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/mchangir-2024-08-30_08:30:37-fs-wip-mchangir-testing-20240828.085847-main-debug-distro-default-smithi/7881274 branch: wip-mchangir-testing-20240828.085847-main-debug description: fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/legacy wsync/yes} objectstore-ec/bluestore-comp omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/automatic export-check n/5 replication/always} standby-replay tasks/{0-subvolume/{with-namespace-isolated} 1-check-counter 2-scrub/no 3-snaps/no 4-flush/yes 5-quiesce/with-quiesce 6-workunit/suites/blogbench}} email: mchangir@redhat.com first_in_suite: false job_id: '7881274' kernel: client: branch: testing kdb: 1 sha1: distro ktype: upstream last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: mchangir-2024-08-30_08:30:37-fs-wip-mchangir-testing-20240828.085847-main-debug-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-mchangir-testing-20240828.085847-main-debug ceph: cephfs: max_mds: 5 session_timeout: 300 standby_replay: true cluster-conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 2 mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mon: mon op complaint time: 120 mon warn on pool no app: false osd: osd op complaint time: 180 conf: global: ms die on skipped message: false mds: mds_bal_replicate_threshold: 1 mgr: cephsqlite lock renewal timeout: 900000 debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 osd: bluestore block size: 96636764160 bluestore compression mode: aggressive bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd shutdown pgref assert: true osd_max_omap_entries_per_request: 10 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - fs.*is degraded - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - insufficient standby MDS daemons available - MDS_UP_LESS_THAN_MAX - online, but wants - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - Degraded data redundancy sha1: d19e6118f7015f0047264006cb0c873528eb3ae6 subvols: create: 2 subvol_options: --namespace-isolated ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} ceph-fuse: client.0: mount_subvol_num: 0 check-counter: counters: mds: - mds.exported - mds.imported - min: 3 name: mds_cache.dir_update - min: 3 name: mds_cache.dir_update_receipt - mds.dir_split install: ceph: flavor: default sha1: d19e6118f7015f0047264006cb0c873528eb3ae6 kclient: client.0: mount_subvol_num: 1 mntopts: - ms_mode=legacy - wsync syntax: v2 selinux: allowlist: - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-mchangir-testing-20240828.085847-main-debug sha1: d19e6118f7015f0047264006cb0c873528eb3ae6 owner: scheduled_mchangir@teuthology priority: 150 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.x - mds.a - mds.d - mds.g - mds.j - osd.0 - osd.3 - osd.6 - osd.9 - client.0 - - mon.b - mgr.y - mds.b - mds.e - mds.h - mds.k - osd.1 - osd.4 - osd.7 - osd.10 - - mon.c - mgr.z - mds.c - mds.f - mds.i - mds.l - osd.2 - osd.5 - osd.8 - osd.11 seed: 5413 sha1: d19e6118f7015f0047264006cb0c873528eb3ae6 sleep_before_teardown: 0 subset: 347/512 suite: fs suite_branch: wip-mchangir-testing-20240828.085847-main-debug suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_d19e6118f7015f0047264006cb0c873528eb3ae6/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: d19e6118f7015f0047264006cb0c873528eb3ae6 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi050.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFXncOcpSwHK/PJkI4bhWvR6R52w//J0UJMpKPaTUUPOp6vljReYgrwTzPjG4qTmmvZnp2thFPxVwMzWNk88clE= smithi133.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGSfu4nzz8fJ1+8wotbmsiWhkVJ/SDwu9ZRit1ltjXApNrpkUsIraAMx2NZagaHxphBXm00Q++w/UNbsAbduZtA= smithi177.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBM9a2uBsOZf/R7/+ltS8C8Bsii9PRb2H3bz4DDqpIZdhSpM1V0ULuzVVkbj5y/1eUtArZpKelC5Fq4bJCJ/wcac= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - cephadm: roleless: false - cephadm.shell: mon.a: - ceph orch status - ceph orch ps - ceph orch ls - ceph orch host ls - ceph orch device ls - cephadm.shell: mon.a: - ceph fs dump - ceph osd dump - fs.ready: timeout: 300 - kclient: null - exec: mon.a: - ceph fs set cephfs balance_automate true - check-counter: {} - background_exec: mon.a: - while sleep 13; do ceph tell mds.cephfs:0 flush journal; done - quiescer: null - workunit: clients: all: - suites/blogbench.sh teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-08-30_08:30:37 tube: smithi user: mchangir verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-08-31T04:03:10.860 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_d19e6118f7015f0047264006cb0c873528eb3ae6/qa; will attempt to use it 2024-08-31T04:03:10.861 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_d19e6118f7015f0047264006cb0c873528eb3ae6/qa/tasks 2024-08-31T04:03:10.861 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-08-31T04:03:10.862 INFO:teuthology.task.internal:Checking packages... 2024-08-31T04:03:10.884 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash 'd19e6118f7015f0047264006cb0c873528eb3ae6' 2024-08-31T04:03:10.884 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-08-31T04:03:10.884 INFO:teuthology.packaging:ref: None 2024-08-31T04:03:10.885 INFO:teuthology.packaging:tag: None 2024-08-31T04:03:10.885 INFO:teuthology.packaging:branch: wip-mchangir-testing-20240828.085847-main-debug 2024-08-31T04:03:10.885 INFO:teuthology.packaging:sha1: d19e6118f7015f0047264006cb0c873528eb3ae6 2024-08-31T04:03:10.885 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-mchangir-testing-20240828.085847-main-debug 2024-08-31T04:03:11.024 INFO:teuthology.task.internal:Found packages for ceph version 19.3.0-4560.gd19e6118 2024-08-31T04:03:11.026 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-08-31T04:03:11.032 INFO:teuthology.task.internal:no buildpackages task found 2024-08-31T04:03:11.032 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-08-31T04:03:11.038 INFO:teuthology.task.internal:Saving configuration 2024-08-31T04:03:11.057 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-08-31T04:03:11.064 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-08-31T04:03:11.089 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi050.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/mchangir-2024-08-30_08:30:37-fs-wip-mchangir-testing-20240828.085847-main-debug-distro-default-smithi/7881274', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-08-31 03:58:12.793314', 'locked_by': 'scheduled_mchangir@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFXncOcpSwHK/PJkI4bhWvR6R52w//J0UJMpKPaTUUPOp6vljReYgrwTzPjG4qTmmvZnp2thFPxVwMzWNk88clE='} 2024-08-31T04:03:11.112 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi133.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/mchangir-2024-08-30_08:30:37-fs-wip-mchangir-testing-20240828.085847-main-debug-distro-default-smithi/7881274', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-08-31 03:58:12.794368', 'locked_by': 'scheduled_mchangir@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGSfu4nzz8fJ1+8wotbmsiWhkVJ/SDwu9ZRit1ltjXApNrpkUsIraAMx2NZagaHxphBXm00Q++w/UNbsAbduZtA='} 2024-08-31T04:03:11.135 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi177.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/mchangir-2024-08-30_08:30:37-fs-wip-mchangir-testing-20240828.085847-main-debug-distro-default-smithi/7881274', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-08-31 03:58:12.792153', 'locked_by': 'scheduled_mchangir@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBM9a2uBsOZf/R7/+ltS8C8Bsii9PRb2H3bz4DDqpIZdhSpM1V0ULuzVVkbj5y/1eUtArZpKelC5Fq4bJCJ/wcac='} 2024-08-31T04:03:11.136 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-08-31T04:03:11.142 INFO:teuthology.task.internal:roles: ubuntu@smithi050.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'mds.a', 'mds.d', 'mds.g', 'mds.j', 'osd.0', 'osd.3', 'osd.6', 'osd.9', 'client.0'] 2024-08-31T04:03:11.142 INFO:teuthology.task.internal:roles: ubuntu@smithi133.front.sepia.ceph.com - ['mon.b', 'mgr.y', 'mds.b', 'mds.e', 'mds.h', 'mds.k', 'osd.1', 'osd.4', 'osd.7', 'osd.10'] 2024-08-31T04:03:11.142 INFO:teuthology.task.internal:roles: ubuntu@smithi177.front.sepia.ceph.com - ['mon.c', 'mgr.z', 'mds.c', 'mds.f', 'mds.i', 'mds.l', 'osd.2', 'osd.5', 'osd.8', 'osd.11'] 2024-08-31T04:03:11.142 INFO:teuthology.run_tasks:Running task console_log... 2024-08-31T04:03:11.225 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f306be5fac0>, signals=[15]) 2024-08-31T04:03:11.225 INFO:teuthology.run_tasks:Running task internal.connect... 2024-08-31T04:03:11.232 INFO:teuthology.task.internal:Opening connections... 2024-08-31T04:03:11.232 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi050.front.sepia.ceph.com 2024-08-31T04:03:11.233 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi050.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-31T04:03:11.313 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi133.front.sepia.ceph.com 2024-08-31T04:03:11.313 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-31T04:03:11.389 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi177.front.sepia.ceph.com 2024-08-31T04:03:11.390 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi177.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-31T04:03:11.466 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-08-31T04:03:11.474 DEBUG:teuthology.orchestra.run.smithi050:> uname -m 2024-08-31T04:03:11.492 INFO:teuthology.orchestra.run.smithi050.stdout:x86_64 2024-08-31T04:03:11.493 DEBUG:teuthology.orchestra.run.smithi050:> cat /etc/os-release 2024-08-31T04:03:11.550 INFO:teuthology.orchestra.run.smithi050.stdout:NAME="CentOS Stream" 2024-08-31T04:03:11.550 INFO:teuthology.orchestra.run.smithi050.stdout:VERSION="9" 2024-08-31T04:03:11.550 INFO:teuthology.orchestra.run.smithi050.stdout:ID="centos" 2024-08-31T04:03:11.550 INFO:teuthology.orchestra.run.smithi050.stdout:ID_LIKE="rhel fedora" 2024-08-31T04:03:11.550 INFO:teuthology.orchestra.run.smithi050.stdout:VERSION_ID="9" 2024-08-31T04:03:11.550 INFO:teuthology.orchestra.run.smithi050.stdout:PLATFORM_ID="platform:el9" 2024-08-31T04:03:11.551 INFO:teuthology.orchestra.run.smithi050.stdout:PRETTY_NAME="CentOS Stream 9" 2024-08-31T04:03:11.551 INFO:teuthology.orchestra.run.smithi050.stdout:ANSI_COLOR="0;31" 2024-08-31T04:03:11.551 INFO:teuthology.orchestra.run.smithi050.stdout:LOGO="fedora-logo-icon" 2024-08-31T04:03:11.551 INFO:teuthology.orchestra.run.smithi050.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-08-31T04:03:11.551 INFO:teuthology.orchestra.run.smithi050.stdout:HOME_URL="https://centos.org/" 2024-08-31T04:03:11.551 INFO:teuthology.orchestra.run.smithi050.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-08-31T04:03:11.551 INFO:teuthology.orchestra.run.smithi050.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-08-31T04:03:11.551 INFO:teuthology.orchestra.run.smithi050.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-08-31T04:03:11.552 INFO:teuthology.lock.ops:Updating smithi050.front.sepia.ceph.com on lock server 2024-08-31T04:03:11.569 DEBUG:teuthology.orchestra.run.smithi133:> uname -m 2024-08-31T04:03:11.588 INFO:teuthology.orchestra.run.smithi133.stdout:x86_64 2024-08-31T04:03:11.588 DEBUG:teuthology.orchestra.run.smithi133:> cat /etc/os-release 2024-08-31T04:03:11.646 INFO:teuthology.orchestra.run.smithi133.stdout:NAME="CentOS Stream" 2024-08-31T04:03:11.646 INFO:teuthology.orchestra.run.smithi133.stdout:VERSION="9" 2024-08-31T04:03:11.646 INFO:teuthology.orchestra.run.smithi133.stdout:ID="centos" 2024-08-31T04:03:11.647 INFO:teuthology.orchestra.run.smithi133.stdout:ID_LIKE="rhel fedora" 2024-08-31T04:03:11.647 INFO:teuthology.orchestra.run.smithi133.stdout:VERSION_ID="9" 2024-08-31T04:03:11.647 INFO:teuthology.orchestra.run.smithi133.stdout:PLATFORM_ID="platform:el9" 2024-08-31T04:03:11.647 INFO:teuthology.orchestra.run.smithi133.stdout:PRETTY_NAME="CentOS Stream 9" 2024-08-31T04:03:11.647 INFO:teuthology.orchestra.run.smithi133.stdout:ANSI_COLOR="0;31" 2024-08-31T04:03:11.647 INFO:teuthology.orchestra.run.smithi133.stdout:LOGO="fedora-logo-icon" 2024-08-31T04:03:11.647 INFO:teuthology.orchestra.run.smithi133.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-08-31T04:03:11.647 INFO:teuthology.orchestra.run.smithi133.stdout:HOME_URL="https://centos.org/" 2024-08-31T04:03:11.647 INFO:teuthology.orchestra.run.smithi133.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-08-31T04:03:11.647 INFO:teuthology.orchestra.run.smithi133.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-08-31T04:03:11.647 INFO:teuthology.orchestra.run.smithi133.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-08-31T04:03:11.648 INFO:teuthology.lock.ops:Updating smithi133.front.sepia.ceph.com on lock server 2024-08-31T04:03:11.669 DEBUG:teuthology.orchestra.run.smithi177:> uname -m 2024-08-31T04:03:11.688 INFO:teuthology.orchestra.run.smithi177.stdout:x86_64 2024-08-31T04:03:11.688 DEBUG:teuthology.orchestra.run.smithi177:> cat /etc/os-release 2024-08-31T04:03:11.747 INFO:teuthology.orchestra.run.smithi177.stdout:NAME="CentOS Stream" 2024-08-31T04:03:11.748 INFO:teuthology.orchestra.run.smithi177.stdout:VERSION="9" 2024-08-31T04:03:11.748 INFO:teuthology.orchestra.run.smithi177.stdout:ID="centos" 2024-08-31T04:03:11.748 INFO:teuthology.orchestra.run.smithi177.stdout:ID_LIKE="rhel fedora" 2024-08-31T04:03:11.748 INFO:teuthology.orchestra.run.smithi177.stdout:VERSION_ID="9" 2024-08-31T04:03:11.748 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM_ID="platform:el9" 2024-08-31T04:03:11.748 INFO:teuthology.orchestra.run.smithi177.stdout:PRETTY_NAME="CentOS Stream 9" 2024-08-31T04:03:11.748 INFO:teuthology.orchestra.run.smithi177.stdout:ANSI_COLOR="0;31" 2024-08-31T04:03:11.748 INFO:teuthology.orchestra.run.smithi177.stdout:LOGO="fedora-logo-icon" 2024-08-31T04:03:11.748 INFO:teuthology.orchestra.run.smithi177.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-08-31T04:03:11.748 INFO:teuthology.orchestra.run.smithi177.stdout:HOME_URL="https://centos.org/" 2024-08-31T04:03:11.748 INFO:teuthology.orchestra.run.smithi177.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-08-31T04:03:11.748 INFO:teuthology.orchestra.run.smithi177.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-08-31T04:03:11.749 INFO:teuthology.orchestra.run.smithi177.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-08-31T04:03:11.749 INFO:teuthology.lock.ops:Updating smithi177.front.sepia.ceph.com on lock server 2024-08-31T04:03:11.770 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-08-31T04:03:11.780 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-08-31T04:03:11.787 INFO:teuthology.task.internal:Checking for old test directory... 2024-08-31T04:03:11.787 DEBUG:teuthology.orchestra.run.smithi050:> test '!' -e /home/ubuntu/cephtest 2024-08-31T04:03:11.789 DEBUG:teuthology.orchestra.run.smithi133:> test '!' -e /home/ubuntu/cephtest 2024-08-31T04:03:11.791 DEBUG:teuthology.orchestra.run.smithi177:> test '!' -e /home/ubuntu/cephtest 2024-08-31T04:03:11.808 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-08-31T04:03:11.814 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-08-31T04:03:11.815 DEBUG:teuthology.orchestra.run.smithi050:> test -z $(ls -A /var/lib/ceph) 2024-08-31T04:03:11.847 DEBUG:teuthology.orchestra.run.smithi133:> test -z $(ls -A /var/lib/ceph) 2024-08-31T04:03:11.849 DEBUG:teuthology.orchestra.run.smithi177:> test -z $(ls -A /var/lib/ceph) 2024-08-31T04:03:11.880 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-08-31T04:03:11.965 INFO:teuthology.run_tasks:Running task kernel... 2024-08-31T04:03:11.980 INFO:teuthology.task.kernel:normalize config orig: {'client': {'branch': 'testing'}, 'kdb': 1, 'sha1': 'distro'} 2024-08-31T04:03:11.980 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'branch': 'testing'}} 2024-08-31T04:03:11.980 INFO:teuthology.task.kernel:config {'client.0': {'branch': 'testing'}}, timeout 300 2024-08-31T04:03:11.980 DEBUG:teuthology.orchestra.run.smithi050:> test -f /run/.containerenv -o -f /.dockerenv 2024-08-31T04:03:11.997 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-31T04:03:11.998 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&ref=testing 2024-08-31T04:03:12.171 DEBUG:teuthology.task.kernel:sha1 for client.0 is 8ad8b8b160987a14eb199bb67cc00e23a08d43f6 2024-08-31T04:03:12.171 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "8ad8b8b160987a14eb199bb67cc00e23a08d43f6"... 2024-08-31T04:03:12.172 DEBUG:teuthology.orchestra.run.smithi050:> uname -r 2024-08-31T04:03:12.189 INFO:teuthology.orchestra.run.smithi050.stdout:5.14.0-503.el9.x86_64 2024-08-31T04:03:12.189 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-503.el9.x86_64 vs 8ad8b8b160987a14eb199bb67cc00e23a08d43f6 2024-08-31T04:03:12.190 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-08-31T04:03:12.190 DEBUG:teuthology.orchestra.run.smithi050:> sudo yum upgrade -y linux-firmware 2024-08-31T04:03:15.725 INFO:teuthology.orchestra.run.smithi050.stdout:CentOS Stream 9 - BaseOS 4.5 MB/s | 8.2 MB 00:01 2024-08-31T04:03:19.126 INFO:teuthology.orchestra.run.smithi050.stdout:CentOS Stream 9 - AppStream 9.2 MB/s | 20 MB 00:02 2024-08-31T04:03:24.018 INFO:teuthology.orchestra.run.smithi050.stdout:CentOS Stream 9 - CRB 7.0 MB/s | 6.6 MB 00:00 2024-08-31T04:03:25.752 INFO:teuthology.orchestra.run.smithi050.stdout:CentOS Stream 9 - Extras packages 38 kB/s | 18 kB 00:00 2024-08-31T04:03:26.664 INFO:teuthology.orchestra.run.smithi050.stdout:Extra Packages for Enterprise Linux 29 MB/s | 22 MB 00:00 2024-08-31T04:03:32.345 INFO:teuthology.orchestra.run.smithi050.stdout:lab-extras 42 kB/s | 1.7 kB 00:00 2024-08-31T04:03:34.519 INFO:teuthology.orchestra.run.smithi050.stdout:Dependencies resolved. 2024-08-31T04:03:34.520 INFO:teuthology.orchestra.run.smithi050.stdout:Nothing to do. 2024-08-31T04:03:34.520 INFO:teuthology.orchestra.run.smithi050.stdout:Complete! 2024-08-31T04:03:34.634 INFO:teuthology.task.kernel:Downloading kernel 8ad8b8b160987a14eb199bb67cc00e23a08d43f6 on client.0... 2024-08-31T04:03:34.635 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=8ad8b8b160987a14eb199bb67cc00e23a08d43f6 2024-08-31T04:03:34.781 INFO:teuthology.task.kernel:fetching, builder baseurl is https://1.chacra.ceph.com/r/kernel/testing/8ad8b8b160987a14eb199bb67cc00e23a08d43f6/centos/9/flavors/default/x86_64/ 2024-08-31T04:03:34.782 DEBUG:teuthology.orchestra.run.smithi050:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.11.0_rc5_g8ad8b8b16098-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://1.chacra.ceph.com/r/kernel/testing/8ad8b8b160987a14eb199bb67cc00e23a08d43f6/centos/9/flavors/default/x86_64/ --input-file=- 2024-08-31T04:03:34.784 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi050.front.sepia.ceph.com to complete... 2024-08-31T04:03:41.130 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31 04:03:41 URL:https://1.chacra.ceph.com/r/kernel/testing/8ad8b8b160987a14eb199bb67cc00e23a08d43f6/centos/9/flavors/default/x86_64/kernel-6.11.0_rc5_g8ad8b8b16098-1.x86_64.rpm [359646365/359646365] -> "/tmp/kernel.x86_64.rpm" [1] 2024-08-31T04:03:41.130 INFO:teuthology.orchestra.run.smithi050.stderr:FINISHED --2024-08-31 04:03:41-- 2024-08-31T04:03:41.130 INFO:teuthology.orchestra.run.smithi050.stderr:Total wall clock time: 6.3s 2024-08-31T04:03:41.130 INFO:teuthology.orchestra.run.smithi050.stderr:Downloaded: 1 files, 343M in 6.0s (56.9 MB/s) 2024-08-31T04:03:41.132 INFO:teuthology.task.kernel:Installing kernel 8ad8b8b160987a14eb199bb67cc00e23a08d43f6 on client.0... 2024-08-31T04:03:41.132 DEBUG:teuthology.orchestra.run.smithi050:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2024-08-31T04:03:43.348 INFO:teuthology.orchestra.run.smithi050.stdout:Verifying... ######################################## 2024-08-31T04:03:43.554 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing... ######################################## 2024-08-31T04:03:43.661 INFO:teuthology.orchestra.run.smithi050.stdout:Updating / installing... 2024-08-31T04:03:52.015 INFO:teuthology.orchestra.run.smithi050.stdout:kernel-6.11.0_rc5_g8ad8b8b16098-1 ######################################## 2024-08-31T04:04:32.164 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi050.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2024-08-31T04:04:32.164 DEBUG:teuthology.orchestra.run.smithi050:> rpm -qlp /tmp/kernel.x86_64.rpm 2024-08-31T04:04:32.256 INFO:teuthology.orchestra.run.smithi050.stdout:/boot/System.map-6.11.0-rc5-g8ad8b8b16098 2024-08-31T04:04:32.256 INFO:teuthology.orchestra.run.smithi050.stdout:/boot/config-6.11.0-rc5-g8ad8b8b16098 2024-08-31T04:04:32.256 INFO:teuthology.orchestra.run.smithi050.stdout:/boot/vmlinuz-6.11.0-rc5-g8ad8b8b16098 2024-08-31T04:04:32.256 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098 2024-08-31T04:04:32.257 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/System.map 2024-08-31T04:04:32.257 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/config 2024-08-31T04:04:32.257 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel 2024-08-31T04:04:32.257 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/arch 2024-08-31T04:04:32.257 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/arch/x86 2024-08-31T04:04:32.257 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/arch/x86/crypto 2024-08-31T04:04:32.257 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-08-31T04:04:32.257 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-08-31T04:04:32.257 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-08-31T04:04:32.257 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-08-31T04:04:32.257 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-08-31T04:04:32.257 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-08-31T04:04:32.257 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-08-31T04:04:32.258 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/arch/x86/crypto/crc32c-intel.ko 2024-08-31T04:04:32.258 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-08-31T04:04:32.258 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-08-31T04:04:32.258 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-08-31T04:04:32.258 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-08-31T04:04:32.258 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/arch/x86/crypto/serpent-avx2.ko 2024-08-31T04:04:32.258 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-08-31T04:04:32.258 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-08-31T04:04:32.258 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-08-31T04:04:32.258 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-08-31T04:04:32.258 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-08-31T04:04:32.258 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-08-31T04:04:32.258 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-08-31T04:04:32.259 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/arch/x86/kernel 2024-08-31T04:04:32.259 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/arch/x86/kernel/cpu 2024-08-31T04:04:32.259 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/arch/x86/kernel/cpu/mce 2024-08-31T04:04:32.259 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-08-31T04:04:32.259 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/arch/x86/kvm 2024-08-31T04:04:32.259 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/arch/x86/kvm/kvm-amd.ko 2024-08-31T04:04:32.259 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/arch/x86/kvm/kvm-intel.ko 2024-08-31T04:04:32.259 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/arch/x86/kvm/kvm.ko 2024-08-31T04:04:32.259 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/crypto 2024-08-31T04:04:32.259 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/crypto/ansi_cprng.ko 2024-08-31T04:04:32.259 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/crypto/anubis.ko 2024-08-31T04:04:32.259 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/crypto/arc4.ko 2024-08-31T04:04:32.259 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/crypto/async_tx 2024-08-31T04:04:32.259 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/crypto/async_tx/async_memcpy.ko 2024-08-31T04:04:32.260 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/crypto/async_tx/async_pq.ko 2024-08-31T04:04:32.260 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/crypto/async_tx/async_raid6_recov.ko 2024-08-31T04:04:32.260 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/crypto/async_tx/async_tx.ko 2024-08-31T04:04:32.260 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/crypto/async_tx/async_xor.ko 2024-08-31T04:04:32.260 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/crypto/async_tx/raid6test.ko 2024-08-31T04:04:32.260 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/crypto/authenc.ko 2024-08-31T04:04:32.260 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/crypto/authencesn.ko 2024-08-31T04:04:32.260 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/crypto/blake2b_generic.ko 2024-08-31T04:04:32.260 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/crypto/blowfish_common.ko 2024-08-31T04:04:32.260 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/crypto/blowfish_generic.ko 2024-08-31T04:04:32.260 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/crypto/camellia_generic.ko 2024-08-31T04:04:32.260 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/crypto/cast5_generic.ko 2024-08-31T04:04:32.260 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/crypto/cast6_generic.ko 2024-08-31T04:04:32.261 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/crypto/cast_common.ko 2024-08-31T04:04:32.261 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/crypto/ccm.ko 2024-08-31T04:04:32.261 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/crypto/cmac.ko 2024-08-31T04:04:32.261 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/crypto/crc32_generic.ko 2024-08-31T04:04:32.261 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/crypto/crypto_engine.ko 2024-08-31T04:04:32.261 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/crypto/crypto_user.ko 2024-08-31T04:04:32.261 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/crypto/cts.ko 2024-08-31T04:04:32.261 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/crypto/des_generic.ko 2024-08-31T04:04:32.261 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/crypto/dh_generic.ko 2024-08-31T04:04:32.261 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/crypto/ecc.ko 2024-08-31T04:04:32.261 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/crypto/ecdh_generic.ko 2024-08-31T04:04:32.261 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/crypto/echainiv.ko 2024-08-31T04:04:32.261 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/crypto/essiv.ko 2024-08-31T04:04:32.262 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/crypto/fcrypt.ko 2024-08-31T04:04:32.262 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/crypto/khazad.ko 2024-08-31T04:04:32.262 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/crypto/lz4.ko 2024-08-31T04:04:32.262 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/crypto/lz4hc.ko 2024-08-31T04:04:32.262 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/crypto/md4.ko 2024-08-31T04:04:32.262 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/crypto/michael_mic.ko 2024-08-31T04:04:32.262 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/crypto/pcbc.ko 2024-08-31T04:04:32.262 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/crypto/pcrypt.ko 2024-08-31T04:04:32.262 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/crypto/rmd160.ko 2024-08-31T04:04:32.262 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/crypto/seed.ko 2024-08-31T04:04:32.262 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/crypto/serpent_generic.ko 2024-08-31T04:04:32.262 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/crypto/tcrypt.ko 2024-08-31T04:04:32.263 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/crypto/tea.ko 2024-08-31T04:04:32.263 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/crypto/twofish_common.ko 2024-08-31T04:04:32.263 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/crypto/twofish_generic.ko 2024-08-31T04:04:32.263 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/crypto/vmac.ko 2024-08-31T04:04:32.263 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/crypto/wp512.ko 2024-08-31T04:04:32.263 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/crypto/xcbc.ko 2024-08-31T04:04:32.263 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/crypto/xor.ko 2024-08-31T04:04:32.263 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/crypto/xxhash_generic.ko 2024-08-31T04:04:32.263 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers 2024-08-31T04:04:32.263 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/acpi 2024-08-31T04:04:32.263 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/acpi/acpi_ipmi.ko 2024-08-31T04:04:32.263 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/acpi/acpi_pad.ko 2024-08-31T04:04:32.264 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/acpi/ec_sys.ko 2024-08-31T04:04:32.264 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/acpi/platform_profile.ko 2024-08-31T04:04:32.264 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/acpi/sbs.ko 2024-08-31T04:04:32.264 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/acpi/sbshc.ko 2024-08-31T04:04:32.264 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/acpi/video.ko 2024-08-31T04:04:32.264 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ata 2024-08-31T04:04:32.264 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ata/acard-ahci.ko 2024-08-31T04:04:32.264 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ata/ahci_platform.ko 2024-08-31T04:04:32.264 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ata/ata_generic.ko 2024-08-31T04:04:32.264 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ata/libahci_platform.ko 2024-08-31T04:04:32.264 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ata/pata_acpi.ko 2024-08-31T04:04:32.264 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ata/pata_ali.ko 2024-08-31T04:04:32.265 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ata/pata_amd.ko 2024-08-31T04:04:32.265 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ata/pata_artop.ko 2024-08-31T04:04:32.265 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ata/pata_atiixp.ko 2024-08-31T04:04:32.265 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ata/pata_atp867x.ko 2024-08-31T04:04:32.265 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ata/pata_cmd640.ko 2024-08-31T04:04:32.265 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ata/pata_cmd64x.ko 2024-08-31T04:04:32.265 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ata/pata_cypress.ko 2024-08-31T04:04:32.265 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ata/pata_efar.ko 2024-08-31T04:04:32.265 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ata/pata_hpt366.ko 2024-08-31T04:04:32.265 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ata/pata_hpt37x.ko 2024-08-31T04:04:32.265 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ata/pata_hpt3x2n.ko 2024-08-31T04:04:32.265 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ata/pata_hpt3x3.ko 2024-08-31T04:04:32.265 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ata/pata_it8213.ko 2024-08-31T04:04:32.265 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ata/pata_it821x.ko 2024-08-31T04:04:32.266 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ata/pata_jmicron.ko 2024-08-31T04:04:32.266 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ata/pata_marvell.ko 2024-08-31T04:04:32.266 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ata/pata_mpiix.ko 2024-08-31T04:04:32.266 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ata/pata_netcell.ko 2024-08-31T04:04:32.266 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ata/pata_ninja32.ko 2024-08-31T04:04:32.266 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ata/pata_ns87410.ko 2024-08-31T04:04:32.266 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ata/pata_ns87415.ko 2024-08-31T04:04:32.266 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ata/pata_oldpiix.ko 2024-08-31T04:04:32.266 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ata/pata_opti.ko 2024-08-31T04:04:32.266 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ata/pata_optidma.ko 2024-08-31T04:04:32.266 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ata/pata_pcmcia.ko 2024-08-31T04:04:32.266 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ata/pata_pdc2027x.ko 2024-08-31T04:04:32.267 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-08-31T04:04:32.267 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ata/pata_piccolo.ko 2024-08-31T04:04:32.267 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ata/pata_rdc.ko 2024-08-31T04:04:32.267 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ata/pata_sch.ko 2024-08-31T04:04:32.267 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ata/pata_serverworks.ko 2024-08-31T04:04:32.267 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ata/pata_sil680.ko 2024-08-31T04:04:32.267 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ata/pata_sis.ko 2024-08-31T04:04:32.267 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ata/pata_sl82c105.ko 2024-08-31T04:04:32.267 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ata/pata_triflex.ko 2024-08-31T04:04:32.267 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ata/pata_via.ko 2024-08-31T04:04:32.267 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ata/pdc_adma.ko 2024-08-31T04:04:32.267 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ata/sata_inic162x.ko 2024-08-31T04:04:32.267 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ata/sata_mv.ko 2024-08-31T04:04:32.268 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ata/sata_nv.ko 2024-08-31T04:04:32.268 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ata/sata_promise.ko 2024-08-31T04:04:32.268 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ata/sata_qstor.ko 2024-08-31T04:04:32.268 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ata/sata_sil.ko 2024-08-31T04:04:32.268 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ata/sata_sil24.ko 2024-08-31T04:04:32.268 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ata/sata_sis.ko 2024-08-31T04:04:32.268 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ata/sata_svw.ko 2024-08-31T04:04:32.268 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ata/sata_sx4.ko 2024-08-31T04:04:32.268 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ata/sata_uli.ko 2024-08-31T04:04:32.268 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ata/sata_via.ko 2024-08-31T04:04:32.268 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ata/sata_vsc.ko 2024-08-31T04:04:32.268 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/auxdisplay 2024-08-31T04:04:32.269 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/auxdisplay/ks0108.ko 2024-08-31T04:04:32.269 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/base 2024-08-31T04:04:32.269 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/base/regmap 2024-08-31T04:04:32.269 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/base/regmap/regmap-i2c.ko 2024-08-31T04:04:32.269 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/base/regmap/regmap-mmio.ko 2024-08-31T04:04:32.269 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/bcma 2024-08-31T04:04:32.269 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/bcma/bcma.ko 2024-08-31T04:04:32.269 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/block 2024-08-31T04:04:32.269 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/block/aoe 2024-08-31T04:04:32.269 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/block/aoe/aoe.ko 2024-08-31T04:04:32.269 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/block/brd.ko 2024-08-31T04:04:32.269 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/block/drbd 2024-08-31T04:04:32.269 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/block/drbd/drbd.ko 2024-08-31T04:04:32.270 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/block/floppy.ko 2024-08-31T04:04:32.270 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/block/loop.ko 2024-08-31T04:04:32.270 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/block/mtip32xx 2024-08-31T04:04:32.270 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-08-31T04:04:32.270 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/block/nbd.ko 2024-08-31T04:04:32.270 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/block/null_blk 2024-08-31T04:04:32.270 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/block/null_blk/null_blk.ko 2024-08-31T04:04:32.270 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/block/pktcdvd.ko 2024-08-31T04:04:32.270 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/block/rbd.ko 2024-08-31T04:04:32.270 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/block/virtio_blk.ko 2024-08-31T04:04:32.270 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/block/xen-blkback 2024-08-31T04:04:32.270 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-08-31T04:04:32.270 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/block/xen-blkfront.ko 2024-08-31T04:04:32.271 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/block/zram 2024-08-31T04:04:32.271 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/block/zram/zram.ko 2024-08-31T04:04:32.271 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/char 2024-08-31T04:04:32.271 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/char/hangcheck-timer.ko 2024-08-31T04:04:32.271 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/char/hw_random 2024-08-31T04:04:32.271 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/char/hw_random/amd-rng.ko 2024-08-31T04:04:32.271 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/char/hw_random/intel-rng.ko 2024-08-31T04:04:32.271 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-08-31T04:04:32.271 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/char/hw_random/via-rng.ko 2024-08-31T04:04:32.271 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/char/hw_random/virtio-rng.ko 2024-08-31T04:04:32.271 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/char/ipmi 2024-08-31T04:04:32.271 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-08-31T04:04:32.272 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-08-31T04:04:32.272 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-08-31T04:04:32.272 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/char/ipmi/ipmi_si.ko 2024-08-31T04:04:32.272 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-08-31T04:04:32.272 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-08-31T04:04:32.272 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/char/lp.ko 2024-08-31T04:04:32.272 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/char/mwave 2024-08-31T04:04:32.272 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/char/mwave/mwave.ko 2024-08-31T04:04:32.272 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/char/ppdev.ko 2024-08-31T04:04:32.272 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/char/tlclk.ko 2024-08-31T04:04:32.272 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/char/tpm 2024-08-31T04:04:32.272 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/char/tpm/tpm.ko 2024-08-31T04:04:32.272 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/char/tpm/tpm_atmel.ko 2024-08-31T04:04:32.273 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/char/tpm/tpm_infineon.ko 2024-08-31T04:04:32.273 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/char/tpm/tpm_nsc.ko 2024-08-31T04:04:32.273 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/char/tpm/tpm_tis.ko 2024-08-31T04:04:32.273 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/char/tpm/tpm_tis_core.ko 2024-08-31T04:04:32.273 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/char/uv_mmtimer.ko 2024-08-31T04:04:32.273 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/char/virtio_console.ko 2024-08-31T04:04:32.273 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/cpufreq 2024-08-31T04:04:32.273 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/cpufreq/acpi-cpufreq.ko 2024-08-31T04:04:32.273 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-08-31T04:04:32.273 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/cpufreq/p4-clockmod.ko 2024-08-31T04:04:32.273 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/cpufreq/pcc-cpufreq.ko 2024-08-31T04:04:32.273 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/cpufreq/powernow-k8.ko 2024-08-31T04:04:32.274 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/cpufreq/speedstep-lib.ko 2024-08-31T04:04:32.274 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/crypto 2024-08-31T04:04:32.274 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/crypto/ccp 2024-08-31T04:04:32.274 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-08-31T04:04:32.274 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/crypto/ccp/ccp.ko 2024-08-31T04:04:32.274 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/crypto/intel 2024-08-31T04:04:32.274 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/crypto/intel/qat 2024-08-31T04:04:32.274 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/crypto/intel/qat/qat_common 2024-08-31T04:04:32.274 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-08-31T04:04:32.274 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2024-08-31T04:04:32.274 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-08-31T04:04:32.274 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/crypto/padlock-aes.ko 2024-08-31T04:04:32.274 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/crypto/padlock-sha.ko 2024-08-31T04:04:32.275 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/crypto/virtio 2024-08-31T04:04:32.275 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-08-31T04:04:32.275 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/dca 2024-08-31T04:04:32.275 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/dca/dca.ko 2024-08-31T04:04:32.275 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/devfreq 2024-08-31T04:04:32.275 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/devfreq/governor_simpleondemand.ko 2024-08-31T04:04:32.275 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/dma 2024-08-31T04:04:32.275 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/dma/dw 2024-08-31T04:04:32.275 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/dma/dw/dw_dmac.ko 2024-08-31T04:04:32.275 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/dma/ioat 2024-08-31T04:04:32.275 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/dma/ioat/ioatdma.ko 2024-08-31T04:04:32.276 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/edac 2024-08-31T04:04:32.276 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/edac/amd64_edac.ko 2024-08-31T04:04:32.276 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/edac/e752x_edac.ko 2024-08-31T04:04:32.276 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/edac/edac_mce_amd.ko 2024-08-31T04:04:32.276 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/edac/i3000_edac.ko 2024-08-31T04:04:32.276 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/edac/i3200_edac.ko 2024-08-31T04:04:32.276 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/edac/i5100_edac.ko 2024-08-31T04:04:32.276 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/edac/i5400_edac.ko 2024-08-31T04:04:32.276 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/edac/i7300_edac.ko 2024-08-31T04:04:32.276 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/edac/i7core_edac.ko 2024-08-31T04:04:32.276 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/edac/i82975x_edac.ko 2024-08-31T04:04:32.276 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/edac/ie31200_edac.ko 2024-08-31T04:04:32.276 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/edac/sb_edac.ko 2024-08-31T04:04:32.276 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/edac/x38_edac.ko 2024-08-31T04:04:32.277 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/firmware 2024-08-31T04:04:32.277 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/firmware/edd.ko 2024-08-31T04:04:32.277 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/firmware/iscsi_ibft.ko 2024-08-31T04:04:32.277 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/gpio 2024-08-31T04:04:32.277 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/gpio/gpio-ich.ko 2024-08-31T04:04:32.277 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/gpio/gpio-viperboard.ko 2024-08-31T04:04:32.277 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid 2024-08-31T04:04:32.277 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-appleir.ko 2024-08-31T04:04:32.277 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-aureal.ko 2024-08-31T04:04:32.277 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-axff.ko 2024-08-31T04:04:32.277 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-dr.ko 2024-08-31T04:04:32.277 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-elecom.ko 2024-08-31T04:04:32.277 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-elo.ko 2024-08-31T04:04:32.278 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-emsff.ko 2024-08-31T04:04:32.278 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-gaff.ko 2024-08-31T04:04:32.278 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-gt683r.ko 2024-08-31T04:04:32.278 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-gyration.ko 2024-08-31T04:04:32.278 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-holtek-kbd.ko 2024-08-31T04:04:32.278 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-holtek-mouse.ko 2024-08-31T04:04:32.278 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-holtekff.ko 2024-08-31T04:04:32.278 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-hyperv.ko 2024-08-31T04:04:32.278 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-icade.ko 2024-08-31T04:04:32.278 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-keytouch.ko 2024-08-31T04:04:32.278 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-kye.ko 2024-08-31T04:04:32.278 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-lcpower.ko 2024-08-31T04:04:32.279 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-led.ko 2024-08-31T04:04:32.279 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-lenovo.ko 2024-08-31T04:04:32.279 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-logitech-dj.ko 2024-08-31T04:04:32.279 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-08-31T04:04:32.279 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-multitouch.ko 2024-08-31T04:04:32.279 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-ortek.ko 2024-08-31T04:04:32.279 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-penmount.ko 2024-08-31T04:04:32.279 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-petalynx.ko 2024-08-31T04:04:32.279 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-picolcd.ko 2024-08-31T04:04:32.279 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-pl.ko 2024-08-31T04:04:32.279 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-plantronics.ko 2024-08-31T04:04:32.279 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-primax.ko 2024-08-31T04:04:32.279 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-rmi.ko 2024-08-31T04:04:32.279 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-roccat-arvo.ko 2024-08-31T04:04:32.280 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-roccat-common.ko 2024-08-31T04:04:32.280 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-roccat-isku.ko 2024-08-31T04:04:32.280 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-roccat-kone.ko 2024-08-31T04:04:32.280 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-08-31T04:04:32.280 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-roccat-konepure.ko 2024-08-31T04:04:32.280 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-08-31T04:04:32.280 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-roccat-lua.ko 2024-08-31T04:04:32.280 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-roccat-pyra.ko 2024-08-31T04:04:32.280 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-roccat-ryos.ko 2024-08-31T04:04:32.280 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-roccat-savu.ko 2024-08-31T04:04:32.280 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-roccat.ko 2024-08-31T04:04:32.280 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-saitek.ko 2024-08-31T04:04:32.281 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-samsung.ko 2024-08-31T04:04:32.281 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-sensor-hub.ko 2024-08-31T04:04:32.281 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-sjoy.ko 2024-08-31T04:04:32.281 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-sony.ko 2024-08-31T04:04:32.281 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-speedlink.ko 2024-08-31T04:04:32.281 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-steelseries.ko 2024-08-31T04:04:32.281 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-sunplus.ko 2024-08-31T04:04:32.281 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-thrustmaster.ko 2024-08-31T04:04:32.281 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-tivo.ko 2024-08-31T04:04:32.281 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-tmff.ko 2024-08-31T04:04:32.281 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-topseed.ko 2024-08-31T04:04:32.281 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-twinhan.ko 2024-08-31T04:04:32.281 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-uclogic.ko 2024-08-31T04:04:32.281 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-waltop.ko 2024-08-31T04:04:32.282 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-wiimote.ko 2024-08-31T04:04:32.282 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-xinmo.ko 2024-08-31T04:04:32.282 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-zpff.ko 2024-08-31T04:04:32.282 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-zydacron.ko 2024-08-31T04:04:32.282 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/uhid.ko 2024-08-31T04:04:32.282 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/wacom.ko 2024-08-31T04:04:32.282 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hv 2024-08-31T04:04:32.282 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hv/hv_balloon.ko 2024-08-31T04:04:32.282 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hv/hv_utils.ko 2024-08-31T04:04:32.282 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hv/hv_vmbus.ko 2024-08-31T04:04:32.282 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon 2024-08-31T04:04:32.282 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/abituguru.ko 2024-08-31T04:04:32.282 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/abituguru3.ko 2024-08-31T04:04:32.282 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/acpi_power_meter.ko 2024-08-31T04:04:32.283 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/ad7414.ko 2024-08-31T04:04:32.283 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/ad7418.ko 2024-08-31T04:04:32.283 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/adc128d818.ko 2024-08-31T04:04:32.283 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/adm1025.ko 2024-08-31T04:04:32.283 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/adm1026.ko 2024-08-31T04:04:32.283 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/adm1029.ko 2024-08-31T04:04:32.283 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/adm1031.ko 2024-08-31T04:04:32.283 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/adm9240.ko 2024-08-31T04:04:32.283 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/ads7828.ko 2024-08-31T04:04:32.283 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/adt7410.ko 2024-08-31T04:04:32.283 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/adt7411.ko 2024-08-31T04:04:32.283 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/adt7462.ko 2024-08-31T04:04:32.283 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/adt7470.ko 2024-08-31T04:04:32.284 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/adt7475.ko 2024-08-31T04:04:32.284 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/adt7x10.ko 2024-08-31T04:04:32.284 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/amc6821.ko 2024-08-31T04:04:32.284 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/applesmc.ko 2024-08-31T04:04:32.284 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/asb100.ko 2024-08-31T04:04:32.284 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/asc7621.ko 2024-08-31T04:04:32.284 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/asus_atk0110.ko 2024-08-31T04:04:32.284 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/atxp1.ko 2024-08-31T04:04:32.284 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/coretemp.ko 2024-08-31T04:04:32.284 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-08-31T04:04:32.284 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/dme1737.ko 2024-08-31T04:04:32.284 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/ds1621.ko 2024-08-31T04:04:32.285 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/ds620.ko 2024-08-31T04:04:32.285 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/emc1403.ko 2024-08-31T04:04:32.285 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/emc6w201.ko 2024-08-31T04:04:32.285 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/f71805f.ko 2024-08-31T04:04:32.285 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/f71882fg.ko 2024-08-31T04:04:32.285 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/f75375s.ko 2024-08-31T04:04:32.285 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/fam15h_power.ko 2024-08-31T04:04:32.285 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/fschmd.ko 2024-08-31T04:04:32.285 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/g760a.ko 2024-08-31T04:04:32.285 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/g762.ko 2024-08-31T04:04:32.285 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/gl518sm.ko 2024-08-31T04:04:32.285 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/gl520sm.ko 2024-08-31T04:04:32.285 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/hwmon-vid.ko 2024-08-31T04:04:32.286 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/i5500_temp.ko 2024-08-31T04:04:32.286 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/i5k_amb.ko 2024-08-31T04:04:32.286 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/ibmaem.ko 2024-08-31T04:04:32.286 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/ibmpex.ko 2024-08-31T04:04:32.286 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/ina209.ko 2024-08-31T04:04:32.286 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/ina2xx.ko 2024-08-31T04:04:32.286 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/it87.ko 2024-08-31T04:04:32.286 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/k10temp.ko 2024-08-31T04:04:32.286 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/k8temp.ko 2024-08-31T04:04:32.286 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/lineage-pem.ko 2024-08-31T04:04:32.286 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/lm63.ko 2024-08-31T04:04:32.286 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/lm73.ko 2024-08-31T04:04:32.287 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/lm75.ko 2024-08-31T04:04:32.287 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/lm77.ko 2024-08-31T04:04:32.287 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/lm78.ko 2024-08-31T04:04:32.287 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/lm80.ko 2024-08-31T04:04:32.287 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/lm83.ko 2024-08-31T04:04:32.287 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/lm85.ko 2024-08-31T04:04:32.287 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/lm87.ko 2024-08-31T04:04:32.287 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/lm90.ko 2024-08-31T04:04:32.287 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/lm92.ko 2024-08-31T04:04:32.287 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/lm93.ko 2024-08-31T04:04:32.287 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/lm95234.ko 2024-08-31T04:04:32.287 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/lm95241.ko 2024-08-31T04:04:32.288 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/lm95245.ko 2024-08-31T04:04:32.288 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/ltc2945.ko 2024-08-31T04:04:32.288 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/ltc4151.ko 2024-08-31T04:04:32.288 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/ltc4215.ko 2024-08-31T04:04:32.288 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/ltc4222.ko 2024-08-31T04:04:32.288 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/ltc4245.ko 2024-08-31T04:04:32.288 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/ltc4260.ko 2024-08-31T04:04:32.288 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/ltc4261.ko 2024-08-31T04:04:32.288 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/max16065.ko 2024-08-31T04:04:32.288 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/max1619.ko 2024-08-31T04:04:32.288 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/max1668.ko 2024-08-31T04:04:32.288 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/max197.ko 2024-08-31T04:04:32.288 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/max6639.ko 2024-08-31T04:04:32.289 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/max6650.ko 2024-08-31T04:04:32.289 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/max6697.ko 2024-08-31T04:04:32.289 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/mcp3021.ko 2024-08-31T04:04:32.289 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/nct6683.ko 2024-08-31T04:04:32.289 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/nct6775-core.ko 2024-08-31T04:04:32.289 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/nct6775.ko 2024-08-31T04:04:32.289 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/nct7802.ko 2024-08-31T04:04:32.289 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/pc87360.ko 2024-08-31T04:04:32.289 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/pc87427.ko 2024-08-31T04:04:32.289 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/pcf8591.ko 2024-08-31T04:04:32.289 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/pmbus 2024-08-31T04:04:32.289 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-08-31T04:04:32.290 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-08-31T04:04:32.290 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-08-31T04:04:32.290 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/pmbus/max16064.ko 2024-08-31T04:04:32.290 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/pmbus/max34440.ko 2024-08-31T04:04:32.290 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/pmbus/max8688.ko 2024-08-31T04:04:32.290 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-08-31T04:04:32.290 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-08-31T04:04:32.290 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-08-31T04:04:32.290 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-08-31T04:04:32.290 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-08-31T04:04:32.290 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-08-31T04:04:32.290 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/powr1220.ko 2024-08-31T04:04:32.290 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/sch5627.ko 2024-08-31T04:04:32.290 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/sch5636.ko 2024-08-31T04:04:32.291 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/sch56xx-common.ko 2024-08-31T04:04:32.291 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/sht15.ko 2024-08-31T04:04:32.291 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/sht21.ko 2024-08-31T04:04:32.291 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/shtc1.ko 2024-08-31T04:04:32.291 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/sis5595.ko 2024-08-31T04:04:32.291 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/smsc47b397.ko 2024-08-31T04:04:32.291 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/smsc47m1.ko 2024-08-31T04:04:32.291 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/smsc47m192.ko 2024-08-31T04:04:32.291 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/thmc50.ko 2024-08-31T04:04:32.291 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/tmp102.ko 2024-08-31T04:04:32.291 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/tmp103.ko 2024-08-31T04:04:32.291 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/tmp401.ko 2024-08-31T04:04:32.291 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/tmp421.ko 2024-08-31T04:04:32.292 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/via-cputemp.ko 2024-08-31T04:04:32.292 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/via686a.ko 2024-08-31T04:04:32.292 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/vt1211.ko 2024-08-31T04:04:32.292 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/vt8231.ko 2024-08-31T04:04:32.292 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/w83627ehf.ko 2024-08-31T04:04:32.292 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/w83627hf.ko 2024-08-31T04:04:32.292 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/w83781d.ko 2024-08-31T04:04:32.292 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/w83791d.ko 2024-08-31T04:04:32.292 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/w83792d.ko 2024-08-31T04:04:32.292 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/w83793.ko 2024-08-31T04:04:32.292 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/w83795.ko 2024-08-31T04:04:32.292 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/w83l785ts.ko 2024-08-31T04:04:32.292 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/w83l786ng.ko 2024-08-31T04:04:32.292 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/i2c 2024-08-31T04:04:32.293 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/i2c/algos 2024-08-31T04:04:32.293 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-08-31T04:04:32.293 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-08-31T04:04:32.293 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/i2c/busses 2024-08-31T04:04:32.293 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-08-31T04:04:32.293 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-08-31T04:04:32.293 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-08-31T04:04:32.293 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-08-31T04:04:32.293 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-08-31T04:04:32.293 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-08-31T04:04:32.293 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-08-31T04:04:32.293 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-08-31T04:04:32.293 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/i2c/busses/i2c-i801.ko 2024-08-31T04:04:32.294 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/i2c/busses/i2c-isch.ko 2024-08-31T04:04:32.294 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-08-31T04:04:32.294 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-08-31T04:04:32.294 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-08-31T04:04:32.294 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/i2c/busses/i2c-parport.ko 2024-08-31T04:04:32.294 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-08-31T04:04:32.294 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-08-31T04:04:32.294 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-08-31T04:04:32.294 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-08-31T04:04:32.294 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-08-31T04:04:32.294 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-08-31T04:04:32.294 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/i2c/busses/i2c-via.ko 2024-08-31T04:04:32.294 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-08-31T04:04:32.295 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-08-31T04:04:32.295 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/i2c/i2c-dev.ko 2024-08-31T04:04:32.295 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/i2c/i2c-mux.ko 2024-08-31T04:04:32.295 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/i2c/i2c-slave-eeprom.ko 2024-08-31T04:04:32.295 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/i2c/i2c-smbus.ko 2024-08-31T04:04:32.295 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/i2c/i2c-stub.ko 2024-08-31T04:04:32.295 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/infiniband 2024-08-31T04:04:32.295 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/infiniband/core 2024-08-31T04:04:32.295 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/infiniband/core/ib_cm.ko 2024-08-31T04:04:32.295 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/infiniband/core/ib_core.ko 2024-08-31T04:04:32.295 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/infiniband/core/ib_umad.ko 2024-08-31T04:04:32.296 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-08-31T04:04:32.296 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/infiniband/core/iw_cm.ko 2024-08-31T04:04:32.296 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/infiniband/core/rdma_cm.ko 2024-08-31T04:04:32.296 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-08-31T04:04:32.296 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/infiniband/hw 2024-08-31T04:04:32.296 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/infiniband/hw/cxgb4 2024-08-31T04:04:32.296 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-08-31T04:04:32.296 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/infiniband/hw/mlx4 2024-08-31T04:04:32.296 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-08-31T04:04:32.296 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/infiniband/hw/mlx5 2024-08-31T04:04:32.296 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-08-31T04:04:32.296 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/infiniband/hw/mthca 2024-08-31T04:04:32.296 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-08-31T04:04:32.297 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/infiniband/ulp 2024-08-31T04:04:32.297 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/infiniband/ulp/ipoib 2024-08-31T04:04:32.297 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-08-31T04:04:32.297 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/infiniband/ulp/iser 2024-08-31T04:04:32.297 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-08-31T04:04:32.297 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/infiniband/ulp/isert 2024-08-31T04:04:32.297 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-08-31T04:04:32.297 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/infiniband/ulp/srp 2024-08-31T04:04:32.297 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-08-31T04:04:32.297 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/infiniband/ulp/srpt 2024-08-31T04:04:32.297 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-08-31T04:04:32.297 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/input 2024-08-31T04:04:32.297 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/input/gameport 2024-08-31T04:04:32.298 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-08-31T04:04:32.298 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/input/gameport/fm801-gp.ko 2024-08-31T04:04:32.298 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/input/gameport/gameport.ko 2024-08-31T04:04:32.298 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/input/joydev.ko 2024-08-31T04:04:32.298 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/input/keyboard 2024-08-31T04:04:32.298 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/input/keyboard/gpio_keys.ko 2024-08-31T04:04:32.298 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/input/mouse 2024-08-31T04:04:32.298 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/input/mouse/appletouch.ko 2024-08-31T04:04:32.298 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/input/mouse/bcm5974.ko 2024-08-31T04:04:32.298 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/input/mouse/cyapatp.ko 2024-08-31T04:04:32.298 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/input/mouse/elan_i2c.ko 2024-08-31T04:04:32.298 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/input/mouse/sermouse.ko 2024-08-31T04:04:32.298 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-08-31T04:04:32.299 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/input/mouse/synaptics_usb.ko 2024-08-31T04:04:32.299 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/input/mouse/vsxxxaa.ko 2024-08-31T04:04:32.299 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/input/rmi4 2024-08-31T04:04:32.299 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/input/rmi4/rmi_core.ko 2024-08-31T04:04:32.299 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/input/serio 2024-08-31T04:04:32.299 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/input/serio/altera_ps2.ko 2024-08-31T04:04:32.299 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/input/serio/arc_ps2.ko 2024-08-31T04:04:32.299 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-08-31T04:04:32.299 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/input/serio/serio_raw.ko 2024-08-31T04:04:32.299 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/input/sparse-keymap.ko 2024-08-31T04:04:32.299 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/leds 2024-08-31T04:04:32.299 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/leds/leds-blinkm.ko 2024-08-31T04:04:32.299 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/leds/leds-lm3530.ko 2024-08-31T04:04:32.300 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/leds/leds-lp3944.ko 2024-08-31T04:04:32.300 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/leds/leds-ss4200.ko 2024-08-31T04:04:32.300 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/leds/trigger 2024-08-31T04:04:32.300 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-08-31T04:04:32.300 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-08-31T04:04:32.300 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-08-31T04:04:32.300 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-08-31T04:04:32.300 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-08-31T04:04:32.300 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-08-31T04:04:32.300 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-08-31T04:04:32.300 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-08-31T04:04:32.300 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/md 2024-08-31T04:04:32.301 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/md/bcache 2024-08-31T04:04:32.301 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/md/bcache/bcache.ko 2024-08-31T04:04:32.301 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/md/dm-bio-prison.ko 2024-08-31T04:04:32.301 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/md/dm-cache-smq.ko 2024-08-31T04:04:32.301 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/md/dm-cache.ko 2024-08-31T04:04:32.301 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/md/dm-crypt.ko 2024-08-31T04:04:32.301 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/md/dm-delay.ko 2024-08-31T04:04:32.301 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/md/dm-flakey.ko 2024-08-31T04:04:32.301 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/md/dm-log-userspace.ko 2024-08-31T04:04:32.301 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/md/dm-multipath.ko 2024-08-31T04:04:32.301 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/md/dm-queue-length.ko 2024-08-31T04:04:32.301 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/md/dm-raid.ko 2024-08-31T04:04:32.301 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/md/dm-round-robin.ko 2024-08-31T04:04:32.302 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/md/dm-service-time.ko 2024-08-31T04:04:32.302 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/md/dm-switch.ko 2024-08-31T04:04:32.302 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/md/dm-thin-pool.ko 2024-08-31T04:04:32.302 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/md/dm-verity.ko 2024-08-31T04:04:32.302 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/md/persistent-data 2024-08-31T04:04:32.302 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-08-31T04:04:32.302 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/md/raid0.ko 2024-08-31T04:04:32.302 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/md/raid1.ko 2024-08-31T04:04:32.302 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/md/raid10.ko 2024-08-31T04:04:32.302 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/md/raid456.ko 2024-08-31T04:04:32.302 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/message 2024-08-31T04:04:32.302 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/message/fusion 2024-08-31T04:04:32.302 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/message/fusion/mptbase.ko 2024-08-31T04:04:32.302 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/message/fusion/mptctl.ko 2024-08-31T04:04:32.303 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/message/fusion/mptfc.ko 2024-08-31T04:04:32.303 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/message/fusion/mptlan.ko 2024-08-31T04:04:32.303 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/message/fusion/mptsas.ko 2024-08-31T04:04:32.303 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/message/fusion/mptscsih.ko 2024-08-31T04:04:32.303 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/message/fusion/mptspi.ko 2024-08-31T04:04:32.303 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/mfd 2024-08-31T04:04:32.303 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/mfd/lpc_ich.ko 2024-08-31T04:04:32.303 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/mfd/lpc_sch.ko 2024-08-31T04:04:32.303 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/mfd/mfd-core.ko 2024-08-31T04:04:32.303 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/mfd/sm501.ko 2024-08-31T04:04:32.303 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/mfd/viperboard.ko 2024-08-31T04:04:32.303 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/mfd/vx855.ko 2024-08-31T04:04:32.303 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/mfd/wl1273-core.ko 2024-08-31T04:04:32.304 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/misc 2024-08-31T04:04:32.304 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/misc/altera-stapl 2024-08-31T04:04:32.304 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-08-31T04:04:32.304 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/misc/apds9802als.ko 2024-08-31T04:04:32.304 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/misc/apds990x.ko 2024-08-31T04:04:32.304 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/misc/bh1770glc.ko 2024-08-31T04:04:32.304 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/misc/cb710 2024-08-31T04:04:32.304 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/misc/cb710/cb710.ko 2024-08-31T04:04:32.304 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/misc/eeprom 2024-08-31T04:04:32.304 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/misc/eeprom/at24.ko 2024-08-31T04:04:32.304 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-08-31T04:04:32.304 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/misc/eeprom/max6875.ko 2024-08-31T04:04:32.304 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/misc/enclosure.ko 2024-08-31T04:04:32.305 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/misc/hpilo.ko 2024-08-31T04:04:32.305 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/misc/isl29003.ko 2024-08-31T04:04:32.305 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/misc/isl29020.ko 2024-08-31T04:04:32.305 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/misc/lis3lv02d 2024-08-31T04:04:32.305 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-08-31T04:04:32.305 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-08-31T04:04:32.305 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/misc/mei 2024-08-31T04:04:32.305 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/misc/mei/mei-me.ko 2024-08-31T04:04:32.305 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/misc/mei/mei-txe.ko 2024-08-31T04:04:32.305 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/misc/mei/mei.ko 2024-08-31T04:04:32.305 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/misc/sgi-gru 2024-08-31T04:04:32.305 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/misc/sgi-gru/gru.ko 2024-08-31T04:04:32.305 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/misc/sgi-xp 2024-08-31T04:04:32.305 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/misc/sgi-xp/xp.ko 2024-08-31T04:04:32.306 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/misc/sgi-xp/xpc.ko 2024-08-31T04:04:32.306 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/misc/sgi-xp/xpnet.ko 2024-08-31T04:04:32.306 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/misc/tifm_7xx1.ko 2024-08-31T04:04:32.306 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/misc/tifm_core.ko 2024-08-31T04:04:32.306 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/misc/tsl2550.ko 2024-08-31T04:04:32.306 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/misc/vmw_balloon.ko 2024-08-31T04:04:32.306 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/misc/vmw_vmci 2024-08-31T04:04:32.306 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-08-31T04:04:32.306 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net 2024-08-31T04:04:32.306 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/bonding 2024-08-31T04:04:32.306 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/bonding/bonding.ko 2024-08-31T04:04:32.306 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/dsa 2024-08-31T04:04:32.306 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/dsa/b53 2024-08-31T04:04:32.307 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/dsa/b53/b53_common.ko 2024-08-31T04:04:32.307 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/dsa/bcm-sf2.ko 2024-08-31T04:04:32.307 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/dsa/mv88e6060.ko 2024-08-31T04:04:32.307 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/dsa/mv88e6xxx 2024-08-31T04:04:32.307 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-08-31T04:04:32.307 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/dummy.ko 2024-08-31T04:04:32.307 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/eql.ko 2024-08-31T04:04:32.307 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet 2024-08-31T04:04:32.307 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/3com 2024-08-31T04:04:32.307 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-08-31T04:04:32.307 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-08-31T04:04:32.307 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-08-31T04:04:32.307 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-08-31T04:04:32.307 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/8390 2024-08-31T04:04:32.308 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/8390/8390.ko 2024-08-31T04:04:32.308 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-08-31T04:04:32.308 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-08-31T04:04:32.308 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-08-31T04:04:32.308 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/adaptec 2024-08-31T04:04:32.308 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-08-31T04:04:32.308 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/agere 2024-08-31T04:04:32.308 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/agere/et131x.ko 2024-08-31T04:04:32.308 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/alteon 2024-08-31T04:04:32.308 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-08-31T04:04:32.308 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/altera 2024-08-31T04:04:32.308 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-08-31T04:04:32.308 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/amd 2024-08-31T04:04:32.309 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-08-31T04:04:32.309 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-08-31T04:04:32.309 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-08-31T04:04:32.309 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/atheros 2024-08-31T04:04:32.309 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/atheros/alx 2024-08-31T04:04:32.309 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-08-31T04:04:32.309 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/atheros/atl1c 2024-08-31T04:04:32.309 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-08-31T04:04:32.309 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/atheros/atl1e 2024-08-31T04:04:32.309 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-08-31T04:04:32.309 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/atheros/atlx 2024-08-31T04:04:32.309 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-08-31T04:04:32.309 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-08-31T04:04:32.310 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/broadcom 2024-08-31T04:04:32.310 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-08-31T04:04:32.310 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-08-31T04:04:32.310 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/broadcom/bnx2x 2024-08-31T04:04:32.310 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-08-31T04:04:32.310 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-08-31T04:04:32.310 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/broadcom/genet 2024-08-31T04:04:32.310 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-08-31T04:04:32.310 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-08-31T04:04:32.310 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/brocade 2024-08-31T04:04:32.310 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/brocade/bna 2024-08-31T04:04:32.311 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-08-31T04:04:32.311 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/chelsio 2024-08-31T04:04:32.311 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/chelsio/cxgb 2024-08-31T04:04:32.311 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-08-31T04:04:32.311 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/chelsio/cxgb3 2024-08-31T04:04:32.311 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-08-31T04:04:32.311 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/chelsio/cxgb4 2024-08-31T04:04:32.311 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-08-31T04:04:32.311 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2024-08-31T04:04:32.311 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-08-31T04:04:32.311 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/chelsio/libcxgb 2024-08-31T04:04:32.311 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-08-31T04:04:32.311 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/cisco 2024-08-31T04:04:32.312 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/cisco/enic 2024-08-31T04:04:32.312 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-08-31T04:04:32.312 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/dec 2024-08-31T04:04:32.312 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/dec/tulip 2024-08-31T04:04:32.312 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-08-31T04:04:32.312 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-08-31T04:04:32.312 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-08-31T04:04:32.312 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-08-31T04:04:32.312 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-08-31T04:04:32.312 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-08-31T04:04:32.312 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/dlink 2024-08-31T04:04:32.312 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-08-31T04:04:32.312 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-08-31T04:04:32.312 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/dnet.ko 2024-08-31T04:04:32.313 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/emulex 2024-08-31T04:04:32.313 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/emulex/benet 2024-08-31T04:04:32.313 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-08-31T04:04:32.313 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/ethoc.ko 2024-08-31T04:04:32.313 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/fealnx.ko 2024-08-31T04:04:32.313 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/intel 2024-08-31T04:04:32.313 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/intel/e100.ko 2024-08-31T04:04:32.313 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/intel/e1000 2024-08-31T04:04:32.313 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-08-31T04:04:32.313 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/intel/e1000e 2024-08-31T04:04:32.313 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-08-31T04:04:32.313 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/intel/fm10k 2024-08-31T04:04:32.313 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-08-31T04:04:32.314 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/intel/i40e 2024-08-31T04:04:32.314 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-08-31T04:04:32.314 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/intel/iavf 2024-08-31T04:04:32.314 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-08-31T04:04:32.314 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/intel/igb 2024-08-31T04:04:32.314 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-08-31T04:04:32.314 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/intel/igbvf 2024-08-31T04:04:32.314 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-08-31T04:04:32.314 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/intel/ixgbe 2024-08-31T04:04:32.314 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-08-31T04:04:32.314 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/intel/ixgbevf 2024-08-31T04:04:32.314 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-08-31T04:04:32.314 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/intel/libeth 2024-08-31T04:04:32.314 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/intel/libeth/libeth.ko 2024-08-31T04:04:32.315 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/intel/libie 2024-08-31T04:04:32.315 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/intel/libie/libie.ko 2024-08-31T04:04:32.315 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/jme.ko 2024-08-31T04:04:32.315 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/marvell 2024-08-31T04:04:32.315 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-08-31T04:04:32.315 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/marvell/skge.ko 2024-08-31T04:04:32.315 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-08-31T04:04:32.315 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/mellanox 2024-08-31T04:04:32.315 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/mellanox/mlx4 2024-08-31T04:04:32.315 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-08-31T04:04:32.315 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-08-31T04:04:32.315 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/mellanox/mlx5 2024-08-31T04:04:32.316 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/mellanox/mlx5/core 2024-08-31T04:04:32.316 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-08-31T04:04:32.316 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/micrel 2024-08-31T04:04:32.316 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-08-31T04:04:32.316 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/myricom 2024-08-31T04:04:32.316 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/myricom/myri10ge 2024-08-31T04:04:32.316 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-08-31T04:04:32.316 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/natsemi 2024-08-31T04:04:32.316 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-08-31T04:04:32.316 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-08-31T04:04:32.316 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/neterion 2024-08-31T04:04:32.316 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-08-31T04:04:32.317 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/nvidia 2024-08-31T04:04:32.317 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-08-31T04:04:32.317 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/packetengines 2024-08-31T04:04:32.317 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-08-31T04:04:32.317 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-08-31T04:04:32.317 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/qlogic 2024-08-31T04:04:32.317 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/qlogic/netxen 2024-08-31T04:04:32.317 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-08-31T04:04:32.317 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-08-31T04:04:32.317 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/qlogic/qlcnic 2024-08-31T04:04:32.317 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-08-31T04:04:32.317 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/rdc 2024-08-31T04:04:32.317 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-08-31T04:04:32.318 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/realtek 2024-08-31T04:04:32.318 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-08-31T04:04:32.318 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-08-31T04:04:32.318 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/realtek/atp.ko 2024-08-31T04:04:32.318 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-08-31T04:04:32.318 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/rocker 2024-08-31T04:04:32.318 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/rocker/rocker.ko 2024-08-31T04:04:32.318 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/sfc 2024-08-31T04:04:32.318 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-08-31T04:04:32.318 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/silan 2024-08-31T04:04:32.318 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-08-31T04:04:32.320 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/sis 2024-08-31T04:04:32.320 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/sis/sis190.ko 2024-08-31T04:04:32.320 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/sis/sis900.ko 2024-08-31T04:04:32.320 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/smsc 2024-08-31T04:04:32.320 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-08-31T04:04:32.320 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-08-31T04:04:32.320 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-08-31T04:04:32.320 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-08-31T04:04:32.320 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/stmicro 2024-08-31T04:04:32.321 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/stmicro/stmmac 2024-08-31T04:04:32.321 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-08-31T04:04:32.321 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-08-31T04:04:32.321 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/sun 2024-08-31T04:04:32.321 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/sun/cassini.ko 2024-08-31T04:04:32.321 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/sun/niu.ko 2024-08-31T04:04:32.321 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/sun/sungem.ko 2024-08-31T04:04:32.321 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-08-31T04:04:32.321 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/tehuti 2024-08-31T04:04:32.321 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-08-31T04:04:32.321 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/ti 2024-08-31T04:04:32.321 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/ti/tlan.ko 2024-08-31T04:04:32.321 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/via 2024-08-31T04:04:32.321 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-08-31T04:04:32.322 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-08-31T04:04:32.322 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/wiznet 2024-08-31T04:04:32.322 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-08-31T04:04:32.322 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-08-31T04:04:32.322 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/xircom 2024-08-31T04:04:32.322 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-08-31T04:04:32.322 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/geneve.ko 2024-08-31T04:04:32.322 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/hyperv 2024-08-31T04:04:32.322 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-08-31T04:04:32.322 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ieee802154 2024-08-31T04:04:32.322 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ieee802154/fakelb.ko 2024-08-31T04:04:32.322 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ifb.ko 2024-08-31T04:04:32.322 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ipvlan 2024-08-31T04:04:32.323 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ipvlan/ipvlan.ko 2024-08-31T04:04:32.323 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/macvlan.ko 2024-08-31T04:04:32.323 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/macvtap.ko 2024-08-31T04:04:32.323 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/mdio 2024-08-31T04:04:32.323 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/mdio.ko 2024-08-31T04:04:32.323 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-08-31T04:04:32.323 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-08-31T04:04:32.323 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/mdio/mdio-regmap.ko 2024-08-31T04:04:32.323 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/mii.ko 2024-08-31T04:04:32.323 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/net_failover.ko 2024-08-31T04:04:32.323 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/netconsole.ko 2024-08-31T04:04:32.323 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/nlmon.ko 2024-08-31T04:04:32.323 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/pcs 2024-08-31T04:04:32.323 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/pcs/pcs-lynx.ko 2024-08-31T04:04:32.324 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-08-31T04:04:32.324 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/phy 2024-08-31T04:04:32.324 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/phy/amd.ko 2024-08-31T04:04:32.324 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-08-31T04:04:32.324 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/phy/bcm-phy-ptp.ko 2024-08-31T04:04:32.324 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/phy/bcm7xxx.ko 2024-08-31T04:04:32.324 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/phy/bcm87xx.ko 2024-08-31T04:04:32.324 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/phy/broadcom.ko 2024-08-31T04:04:32.324 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/phy/cicada.ko 2024-08-31T04:04:32.324 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/phy/davicom.ko 2024-08-31T04:04:32.324 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/phy/dp83640.ko 2024-08-31T04:04:32.324 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/phy/et1011c.ko 2024-08-31T04:04:32.324 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/phy/icplus.ko 2024-08-31T04:04:32.325 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/phy/lxt.ko 2024-08-31T04:04:32.325 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/phy/marvell.ko 2024-08-31T04:04:32.325 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/phy/micrel.ko 2024-08-31T04:04:32.325 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/phy/national.ko 2024-08-31T04:04:32.325 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/phy/phylink.ko 2024-08-31T04:04:32.325 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/phy/qsemi.ko 2024-08-31T04:04:32.325 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/phy/realtek.ko 2024-08-31T04:04:32.325 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/phy/smsc.ko 2024-08-31T04:04:32.325 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/phy/ste10Xp.ko 2024-08-31T04:04:32.325 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/phy/vitesse.ko 2024-08-31T04:04:32.325 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ppp 2024-08-31T04:04:32.325 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ppp/bsd_comp.ko 2024-08-31T04:04:32.325 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ppp/ppp_async.ko 2024-08-31T04:04:32.325 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ppp/ppp_deflate.ko 2024-08-31T04:04:32.326 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ppp/ppp_generic.ko 2024-08-31T04:04:32.326 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ppp/ppp_mppe.ko 2024-08-31T04:04:32.326 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ppp/ppp_synctty.ko 2024-08-31T04:04:32.326 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ppp/pppoe.ko 2024-08-31T04:04:32.326 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ppp/pppox.ko 2024-08-31T04:04:32.326 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ppp/pptp.ko 2024-08-31T04:04:32.326 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/slip 2024-08-31T04:04:32.326 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/slip/slhc.ko 2024-08-31T04:04:32.326 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/slip/slip.ko 2024-08-31T04:04:32.326 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/sungem_phy.ko 2024-08-31T04:04:32.326 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/tap.ko 2024-08-31T04:04:32.326 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/team 2024-08-31T04:04:32.326 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/team/team.ko 2024-08-31T04:04:32.327 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/team/team_mode_activebackup.ko 2024-08-31T04:04:32.327 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/team/team_mode_broadcast.ko 2024-08-31T04:04:32.327 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-08-31T04:04:32.327 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/team/team_mode_random.ko 2024-08-31T04:04:32.327 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-08-31T04:04:32.327 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/tun.ko 2024-08-31T04:04:32.327 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/veth.ko 2024-08-31T04:04:32.327 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/virtio_net.ko 2024-08-31T04:04:32.327 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/vmxnet3 2024-08-31T04:04:32.327 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-08-31T04:04:32.328 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/vxlan 2024-08-31T04:04:32.328 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/vxlan/vxlan.ko 2024-08-31T04:04:32.328 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/xen-netback 2024-08-31T04:04:32.328 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/xen-netback/xen-netback.ko 2024-08-31T04:04:32.328 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/xen-netfront.ko 2024-08-31T04:04:32.328 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ntb 2024-08-31T04:04:32.328 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ntb/ntb.ko 2024-08-31T04:04:32.328 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/nvme 2024-08-31T04:04:32.328 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/nvme/host 2024-08-31T04:04:32.328 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/nvme/host/nvme-core.ko 2024-08-31T04:04:32.328 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/nvme/host/nvme.ko 2024-08-31T04:04:32.328 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/parport 2024-08-31T04:04:32.329 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/parport/parport.ko 2024-08-31T04:04:32.329 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/parport/parport_cs.ko 2024-08-31T04:04:32.329 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/parport/parport_pc.ko 2024-08-31T04:04:32.329 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/parport/parport_serial.ko 2024-08-31T04:04:32.329 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/pci 2024-08-31T04:04:32.329 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/pci/hotplug 2024-08-31T04:04:32.329 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-08-31T04:04:32.329 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/pci/pcie 2024-08-31T04:04:32.329 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/pci/pcie/aer_inject.ko 2024-08-31T04:04:32.329 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/pci/xen-pcifront.ko 2024-08-31T04:04:32.329 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/pcmcia 2024-08-31T04:04:32.329 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/pcmcia/i82092.ko 2024-08-31T04:04:32.329 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/pcmcia/pd6729.ko 2024-08-31T04:04:32.330 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/pcmcia/yenta_socket.ko 2024-08-31T04:04:32.330 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/pinctrl 2024-08-31T04:04:32.330 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/pinctrl/intel 2024-08-31T04:04:32.330 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-08-31T04:04:32.330 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/platform 2024-08-31T04:04:32.330 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/platform/x86 2024-08-31T04:04:32.331 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/platform/x86/acer-wmi.ko 2024-08-31T04:04:32.331 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/platform/x86/acerhdf.ko 2024-08-31T04:04:32.331 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/platform/x86/apple-gmux.ko 2024-08-31T04:04:32.331 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/platform/x86/asus-laptop.ko 2024-08-31T04:04:32.331 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-08-31T04:04:32.331 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/platform/x86/asus-wmi.ko 2024-08-31T04:04:32.332 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/platform/x86/classmate-laptop.ko 2024-08-31T04:04:32.332 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-08-31T04:04:32.332 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-08-31T04:04:32.332 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-08-31T04:04:32.332 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-08-31T04:04:32.332 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/platform/x86/hdaps.ko 2024-08-31T04:04:32.332 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/platform/x86/intel 2024-08-31T04:04:32.332 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-08-31T04:04:32.332 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/platform/x86/intel_ips.ko 2024-08-31T04:04:32.332 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/platform/x86/msi-wmi.ko 2024-08-31T04:04:32.332 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/platform/x86/mxm-wmi.ko 2024-08-31T04:04:32.332 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-08-31T04:04:32.333 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/platform/x86/samsung-laptop.ko 2024-08-31T04:04:32.333 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/platform/x86/samsung-q10.ko 2024-08-31T04:04:32.333 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/platform/x86/topstar-laptop.ko 2024-08-31T04:04:32.333 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-08-31T04:04:32.333 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/platform/x86/toshiba_haps.ko 2024-08-31T04:04:32.333 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/platform/x86/wmi-bmof.ko 2024-08-31T04:04:32.333 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/platform/x86/wmi.ko 2024-08-31T04:04:32.333 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/powercap 2024-08-31T04:04:32.333 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/powercap/intel_rapl_common.ko 2024-08-31T04:04:32.333 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/powercap/intel_rapl_msr.ko 2024-08-31T04:04:32.333 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/pps 2024-08-31T04:04:32.333 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/pps/clients 2024-08-31T04:04:32.333 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/pps/clients/pps-gpio.ko 2024-08-31T04:04:32.333 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/pps/clients/pps-ldisc.ko 2024-08-31T04:04:32.334 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/pps/clients/pps_parport.ko 2024-08-31T04:04:32.334 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/pps/pps_core.ko 2024-08-31T04:04:32.334 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ptp 2024-08-31T04:04:32.334 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ptp/ptp.ko 2024-08-31T04:04:32.334 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ptp/ptp_kvm.ko 2024-08-31T04:04:32.334 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ras 2024-08-31T04:04:32.334 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ras/amd 2024-08-31T04:04:32.334 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ras/amd/atl 2024-08-31T04:04:32.334 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ras/amd/atl/amd_atl.ko 2024-08-31T04:04:32.334 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ras/amd/fmpm.ko 2024-08-31T04:04:32.334 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/rtc 2024-08-31T04:04:32.334 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/rtc/rtc-bq32k.ko 2024-08-31T04:04:32.334 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/rtc/rtc-ds1286.ko 2024-08-31T04:04:32.335 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/rtc/rtc-ds1307.ko 2024-08-31T04:04:32.335 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/rtc/rtc-ds1374.ko 2024-08-31T04:04:32.335 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/rtc/rtc-ds1511.ko 2024-08-31T04:04:32.335 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/rtc/rtc-ds1553.ko 2024-08-31T04:04:32.335 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/rtc/rtc-ds1672.ko 2024-08-31T04:04:32.335 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/rtc/rtc-ds1742.ko 2024-08-31T04:04:32.335 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/rtc/rtc-ds2404.ko 2024-08-31T04:04:32.335 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/rtc/rtc-ds3232.ko 2024-08-31T04:04:32.335 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/rtc/rtc-em3027.ko 2024-08-31T04:04:32.335 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/rtc/rtc-fm3130.ko 2024-08-31T04:04:32.335 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/rtc/rtc-isl12022.ko 2024-08-31T04:04:32.335 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/rtc/rtc-isl1208.ko 2024-08-31T04:04:32.335 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/rtc/rtc-m41t80.ko 2024-08-31T04:04:32.335 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/rtc/rtc-m48t35.ko 2024-08-31T04:04:32.335 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/rtc/rtc-m48t59.ko 2024-08-31T04:04:32.336 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/rtc/rtc-max6900.ko 2024-08-31T04:04:32.336 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/rtc/rtc-msm6242.ko 2024-08-31T04:04:32.336 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/rtc/rtc-pcf2127.ko 2024-08-31T04:04:32.336 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/rtc/rtc-pcf85063.ko 2024-08-31T04:04:32.336 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/rtc/rtc-pcf8523.ko 2024-08-31T04:04:32.336 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/rtc/rtc-pcf8563.ko 2024-08-31T04:04:32.336 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/rtc/rtc-pcf8583.ko 2024-08-31T04:04:32.336 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/rtc/rtc-rp5c01.ko 2024-08-31T04:04:32.336 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/rtc/rtc-rs5c372.ko 2024-08-31T04:04:32.336 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-08-31T04:04:32.336 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/rtc/rtc-rx8025.ko 2024-08-31T04:04:32.336 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/rtc/rtc-rx8581.ko 2024-08-31T04:04:32.337 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-08-31T04:04:32.337 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/rtc/rtc-x1205.ko 2024-08-31T04:04:32.337 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi 2024-08-31T04:04:32.337 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/3w-9xxx.ko 2024-08-31T04:04:32.337 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/3w-sas.ko 2024-08-31T04:04:32.337 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/3w-xxxx.ko 2024-08-31T04:04:32.337 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/BusLogic.ko 2024-08-31T04:04:32.337 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/a100u2w.ko 2024-08-31T04:04:32.337 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/aacraid 2024-08-31T04:04:32.337 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/aacraid/aacraid.ko 2024-08-31T04:04:32.337 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/advansys.ko 2024-08-31T04:04:32.337 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/aic7xxx 2024-08-31T04:04:32.337 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-08-31T04:04:32.338 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-08-31T04:04:32.338 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/am53c974.ko 2024-08-31T04:04:32.338 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/arcmsr 2024-08-31T04:04:32.338 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-08-31T04:04:32.338 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/atp870u.ko 2024-08-31T04:04:32.338 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/be2iscsi 2024-08-31T04:04:32.338 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-08-31T04:04:32.338 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/bfa 2024-08-31T04:04:32.338 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/bfa/bfa.ko 2024-08-31T04:04:32.338 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/bnx2fc 2024-08-31T04:04:32.338 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-08-31T04:04:32.338 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/bnx2i 2024-08-31T04:04:32.338 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-08-31T04:04:32.338 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/ch.ko 2024-08-31T04:04:32.339 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/csiostor 2024-08-31T04:04:32.339 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/csiostor/csiostor.ko 2024-08-31T04:04:32.339 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/cxgbi 2024-08-31T04:04:32.339 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/cxgbi/cxgb3i 2024-08-31T04:04:32.339 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-08-31T04:04:32.339 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/cxgbi/cxgb4i 2024-08-31T04:04:32.339 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-08-31T04:04:32.339 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-08-31T04:04:32.339 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/dc395x.ko 2024-08-31T04:04:32.339 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/device_handler 2024-08-31T04:04:32.339 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2024-08-31T04:04:32.340 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2024-08-31T04:04:32.340 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2024-08-31T04:04:32.340 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2024-08-31T04:04:32.340 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/dmx3191d.ko 2024-08-31T04:04:32.340 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/esas2r 2024-08-31T04:04:32.340 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/esas2r/esas2r.ko 2024-08-31T04:04:32.340 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/esp_scsi.ko 2024-08-31T04:04:32.340 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/fcoe 2024-08-31T04:04:32.340 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/fcoe/fcoe.ko 2024-08-31T04:04:32.340 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-08-31T04:04:32.341 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/fnic 2024-08-31T04:04:32.341 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/fnic/fnic.ko 2024-08-31T04:04:32.341 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/hpsa.ko 2024-08-31T04:04:32.341 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/hptiop.ko 2024-08-31T04:04:32.341 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/hv_storvsc.ko 2024-08-31T04:04:32.341 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/initio.ko 2024-08-31T04:04:32.341 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/ipr.ko 2024-08-31T04:04:32.341 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/ips.ko 2024-08-31T04:04:32.341 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/isci 2024-08-31T04:04:32.341 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/isci/isci.ko 2024-08-31T04:04:32.341 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-08-31T04:04:32.341 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/iscsi_tcp.ko 2024-08-31T04:04:32.341 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/libfc 2024-08-31T04:04:32.341 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/libfc/libfc.ko 2024-08-31T04:04:32.342 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/libiscsi.ko 2024-08-31T04:04:32.342 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/libiscsi_tcp.ko 2024-08-31T04:04:32.342 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/libsas 2024-08-31T04:04:32.342 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/libsas/libsas.ko 2024-08-31T04:04:32.342 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/lpfc 2024-08-31T04:04:32.342 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/lpfc/lpfc.ko 2024-08-31T04:04:32.342 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/megaraid 2024-08-31T04:04:32.342 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/megaraid.ko 2024-08-31T04:04:32.342 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-08-31T04:04:32.342 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-08-31T04:04:32.342 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-08-31T04:04:32.342 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/mpt3sas 2024-08-31T04:04:32.342 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-08-31T04:04:32.343 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/mvsas 2024-08-31T04:04:32.343 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/mvsas/mvsas.ko 2024-08-31T04:04:32.343 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/mvumi.ko 2024-08-31T04:04:32.343 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/pm8001 2024-08-31T04:04:32.343 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-08-31T04:04:32.343 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/pmcraid.ko 2024-08-31T04:04:32.343 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/qla1280.ko 2024-08-31T04:04:32.343 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/qla2xxx 2024-08-31T04:04:32.343 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-08-31T04:04:32.343 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-08-31T04:04:32.343 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/qla4xxx 2024-08-31T04:04:32.343 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-08-31T04:04:32.343 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/raid_class.ko 2024-08-31T04:04:32.343 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/scsi_debug.ko 2024-08-31T04:04:32.344 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/scsi_transport_fc.ko 2024-08-31T04:04:32.344 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-08-31T04:04:32.344 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/scsi_transport_sas.ko 2024-08-31T04:04:32.344 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/scsi_transport_spi.ko 2024-08-31T04:04:32.344 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/scsi_transport_srp.ko 2024-08-31T04:04:32.344 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/ses.ko 2024-08-31T04:04:32.344 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/st.ko 2024-08-31T04:04:32.344 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/stex.ko 2024-08-31T04:04:32.344 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/sym53c8xx_2 2024-08-31T04:04:32.344 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-08-31T04:04:32.344 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/virtio_scsi.ko 2024-08-31T04:04:32.345 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/vmw_pvscsi.ko 2024-08-31T04:04:32.345 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/wd719x.ko 2024-08-31T04:04:32.345 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ssb 2024-08-31T04:04:32.345 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ssb/ssb.ko 2024-08-31T04:04:32.345 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/target 2024-08-31T04:04:32.345 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/target/iscsi 2024-08-31T04:04:32.345 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-08-31T04:04:32.345 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/target/loopback 2024-08-31T04:04:32.345 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/target/loopback/tcm_loop.ko 2024-08-31T04:04:32.345 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/target/target_core_file.ko 2024-08-31T04:04:32.345 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/target/target_core_iblock.ko 2024-08-31T04:04:32.345 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/target/target_core_mod.ko 2024-08-31T04:04:32.346 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/target/target_core_pscsi.ko 2024-08-31T04:04:32.346 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/target/target_core_user.ko 2024-08-31T04:04:32.346 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/target/tcm_fc 2024-08-31T04:04:32.346 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-08-31T04:04:32.346 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/thermal 2024-08-31T04:04:32.346 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/thermal/intel 2024-08-31T04:04:32.346 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/thermal/intel/int340x_thermal 2024-08-31T04:04:32.346 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-08-31T04:04:32.346 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-08-31T04:04:32.346 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-08-31T04:04:32.346 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-08-31T04:04:32.347 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-08-31T04:04:32.347 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-08-31T04:04:32.347 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-08-31T04:04:32.347 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-08-31T04:04:32.347 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-08-31T04:04:32.347 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-08-31T04:04:32.347 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-08-31T04:04:32.347 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-08-31T04:04:32.347 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-08-31T04:04:32.347 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-08-31T04:04:32.347 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-08-31T04:04:32.347 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-08-31T04:04:32.347 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-08-31T04:04:32.347 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-08-31T04:04:32.348 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/tty 2024-08-31T04:04:32.348 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/tty/ipwireless 2024-08-31T04:04:32.348 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-08-31T04:04:32.348 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/tty/n_gsm.ko 2024-08-31T04:04:32.348 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/tty/n_hdlc.ko 2024-08-31T04:04:32.348 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/tty/nozomi.ko 2024-08-31T04:04:32.348 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/tty/serial 2024-08-31T04:04:32.348 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/tty/serial/8250 2024-08-31T04:04:32.348 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-08-31T04:04:32.348 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/tty/serial/arc_uart.ko 2024-08-31T04:04:32.349 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/tty/serial/jsm 2024-08-31T04:04:32.349 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/tty/serial/jsm/jsm.ko 2024-08-31T04:04:32.349 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ufs 2024-08-31T04:04:32.349 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ufs/core 2024-08-31T04:04:32.349 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ufs/core/ufshcd-core.ko 2024-08-31T04:04:32.349 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ufs/host 2024-08-31T04:04:32.349 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-08-31T04:04:32.349 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/uio 2024-08-31T04:04:32.349 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/uio/uio.ko 2024-08-31T04:04:32.349 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/uio/uio_aec.ko 2024-08-31T04:04:32.349 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/uio/uio_cif.ko 2024-08-31T04:04:32.349 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/uio/uio_pci_generic.ko 2024-08-31T04:04:32.349 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/uio/uio_sercos3.ko 2024-08-31T04:04:32.349 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb 2024-08-31T04:04:32.350 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/class 2024-08-31T04:04:32.350 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/class/cdc-acm.ko 2024-08-31T04:04:32.350 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/class/cdc-wdm.ko 2024-08-31T04:04:32.350 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/class/usblp.ko 2024-08-31T04:04:32.350 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/class/usbtmc.ko 2024-08-31T04:04:32.350 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/host 2024-08-31T04:04:32.350 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/host/sl811-hcd.ko 2024-08-31T04:04:32.350 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/image 2024-08-31T04:04:32.350 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/image/mdc800.ko 2024-08-31T04:04:32.350 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/image/microtek.ko 2024-08-31T04:04:32.350 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/misc 2024-08-31T04:04:32.350 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/misc/adutux.ko 2024-08-31T04:04:32.350 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/misc/appledisplay.ko 2024-08-31T04:04:32.350 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/misc/emi26.ko 2024-08-31T04:04:32.351 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/misc/emi62.ko 2024-08-31T04:04:32.351 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/misc/ezusb.ko 2024-08-31T04:04:32.351 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/misc/idmouse.ko 2024-08-31T04:04:32.351 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/misc/iowarrior.ko 2024-08-31T04:04:32.351 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/misc/isight_firmware.ko 2024-08-31T04:04:32.351 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/misc/ldusb.ko 2024-08-31T04:04:32.351 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/misc/legousbtower.ko 2024-08-31T04:04:32.351 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/misc/sisusbvga 2024-08-31T04:04:32.351 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-08-31T04:04:32.351 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/misc/trancevibrator.ko 2024-08-31T04:04:32.351 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/misc/usb3503.ko 2024-08-31T04:04:32.351 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/misc/usblcd.ko 2024-08-31T04:04:32.351 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/misc/usbsevseg.ko 2024-08-31T04:04:32.352 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/misc/uss720.ko 2024-08-31T04:04:32.352 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/misc/yurex.ko 2024-08-31T04:04:32.352 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/phy 2024-08-31T04:04:32.352 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/phy/phy-generic.ko 2024-08-31T04:04:32.352 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/serial 2024-08-31T04:04:32.352 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/serial/aircable.ko 2024-08-31T04:04:32.352 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/serial/ark3116.ko 2024-08-31T04:04:32.352 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/serial/belkin_sa.ko 2024-08-31T04:04:32.352 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/serial/ch341.ko 2024-08-31T04:04:32.352 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/serial/cp210x.ko 2024-08-31T04:04:32.352 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/serial/cyberjack.ko 2024-08-31T04:04:32.352 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/serial/cypress_m8.ko 2024-08-31T04:04:32.353 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/serial/digi_acceleport.ko 2024-08-31T04:04:32.353 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/serial/empeg.ko 2024-08-31T04:04:32.353 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/serial/ftdi_sio.ko 2024-08-31T04:04:32.353 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/serial/garmin_gps.ko 2024-08-31T04:04:32.353 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/serial/io_edgeport.ko 2024-08-31T04:04:32.353 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/serial/io_ti.ko 2024-08-31T04:04:32.353 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/serial/ipaq.ko 2024-08-31T04:04:32.353 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/serial/ipw.ko 2024-08-31T04:04:32.353 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/serial/ir-usb.ko 2024-08-31T04:04:32.353 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-08-31T04:04:32.353 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/serial/keyspan.ko 2024-08-31T04:04:32.354 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/serial/keyspan_pda.ko 2024-08-31T04:04:32.354 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/serial/kl5kusb105.ko 2024-08-31T04:04:32.354 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/serial/kobil_sct.ko 2024-08-31T04:04:32.354 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/serial/mct_u232.ko 2024-08-31T04:04:32.354 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/serial/mos7720.ko 2024-08-31T04:04:32.354 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/serial/mos7840.ko 2024-08-31T04:04:32.355 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/serial/navman.ko 2024-08-31T04:04:32.355 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/serial/omninet.ko 2024-08-31T04:04:32.355 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/serial/opticon.ko 2024-08-31T04:04:32.355 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/serial/option.ko 2024-08-31T04:04:32.355 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/serial/oti6858.ko 2024-08-31T04:04:32.355 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/serial/pl2303.ko 2024-08-31T04:04:32.356 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/serial/qcaux.ko 2024-08-31T04:04:32.356 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/serial/qcserial.ko 2024-08-31T04:04:32.356 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/serial/quatech2.ko 2024-08-31T04:04:32.356 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/serial/safe_serial.ko 2024-08-31T04:04:32.356 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/serial/sierra.ko 2024-08-31T04:04:32.356 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/serial/spcp8x5.ko 2024-08-31T04:04:32.357 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/serial/ssu100.ko 2024-08-31T04:04:32.357 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/serial/symbolserial.ko 2024-08-31T04:04:32.357 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-08-31T04:04:32.357 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-08-31T04:04:32.357 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/serial/usb_debug.ko 2024-08-31T04:04:32.358 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/serial/usb_wwan.ko 2024-08-31T04:04:32.358 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/serial/visor.ko 2024-08-31T04:04:32.358 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/serial/whiteheat.ko 2024-08-31T04:04:32.358 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/serial/xsens_mt.ko 2024-08-31T04:04:32.358 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/storage 2024-08-31T04:04:32.358 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/storage/uas.ko 2024-08-31T04:04:32.359 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/storage/ums-alauda.ko 2024-08-31T04:04:32.359 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/storage/ums-cypress.ko 2024-08-31T04:04:32.359 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/storage/ums-datafab.ko 2024-08-31T04:04:32.359 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-08-31T04:04:32.359 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/storage/ums-freecom.ko 2024-08-31T04:04:32.359 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/storage/ums-isd200.ko 2024-08-31T04:04:32.360 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-08-31T04:04:32.360 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/storage/ums-karma.ko 2024-08-31T04:04:32.360 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/storage/ums-onetouch.ko 2024-08-31T04:04:32.360 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/storage/ums-realtek.ko 2024-08-31T04:04:32.360 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/storage/ums-sddr09.ko 2024-08-31T04:04:32.360 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/storage/ums-sddr55.ko 2024-08-31T04:04:32.361 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/storage/ums-usbat.ko 2024-08-31T04:04:32.361 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/storage/usb-storage.ko 2024-08-31T04:04:32.361 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/usbip 2024-08-31T04:04:32.361 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/usbip/usbip-core.ko 2024-08-31T04:04:32.361 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/usbip/usbip-host.ko 2024-08-31T04:04:32.362 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-08-31T04:04:32.362 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/vfio 2024-08-31T04:04:32.362 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/vfio/pci 2024-08-31T04:04:32.362 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-08-31T04:04:32.362 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/vfio/pci/vfio-pci.ko 2024-08-31T04:04:32.362 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/vfio/vfio.ko 2024-08-31T04:04:32.363 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-08-31T04:04:32.363 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/vhost 2024-08-31T04:04:32.363 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/vhost/vhost.ko 2024-08-31T04:04:32.363 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/vhost/vhost_iotlb.ko 2024-08-31T04:04:32.363 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/vhost/vhost_net.ko 2024-08-31T04:04:32.364 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/vhost/vhost_scsi.ko 2024-08-31T04:04:32.364 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/video 2024-08-31T04:04:32.364 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/video/backlight 2024-08-31T04:04:32.364 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/video/backlight/apple_bl.ko 2024-08-31T04:04:32.364 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/video/backlight/lcd.ko 2024-08-31T04:04:32.364 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/video/backlight/platform_lcd.ko 2024-08-31T04:04:32.365 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/virtio 2024-08-31T04:04:32.365 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/virtio/virtio.ko 2024-08-31T04:04:32.365 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/virtio/virtio_balloon.ko 2024-08-31T04:04:32.365 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/virtio/virtio_mmio.ko 2024-08-31T04:04:32.365 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/virtio/virtio_pci.ko 2024-08-31T04:04:32.365 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2024-08-31T04:04:32.366 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2024-08-31T04:04:32.366 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/virtio/virtio_ring.ko 2024-08-31T04:04:32.366 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/w1 2024-08-31T04:04:32.366 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/w1/masters 2024-08-31T04:04:32.366 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/w1/masters/ds2482.ko 2024-08-31T04:04:32.366 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/w1/masters/ds2490.ko 2024-08-31T04:04:32.367 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/w1/slaves 2024-08-31T04:04:32.367 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-08-31T04:04:32.367 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-08-31T04:04:32.367 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-08-31T04:04:32.367 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-08-31T04:04:32.367 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-08-31T04:04:32.368 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-08-31T04:04:32.368 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-08-31T04:04:32.368 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-08-31T04:04:32.368 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-08-31T04:04:32.368 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/w1/slaves/w1_smem.ko 2024-08-31T04:04:32.368 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/w1/slaves/w1_therm.ko 2024-08-31T04:04:32.369 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/w1/wire.ko 2024-08-31T04:04:32.369 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/watchdog 2024-08-31T04:04:32.369 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/watchdog/alim1535_wdt.ko 2024-08-31T04:04:32.369 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/watchdog/alim7101_wdt.ko 2024-08-31T04:04:32.369 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/watchdog/f71808e_wdt.ko 2024-08-31T04:04:32.369 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/watchdog/hpwdt.ko 2024-08-31T04:04:32.370 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/watchdog/i6300esb.ko 2024-08-31T04:04:32.370 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-08-31T04:04:32.370 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/watchdog/iTCO_wdt.ko 2024-08-31T04:04:32.370 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/watchdog/ib700wdt.ko 2024-08-31T04:04:32.370 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/watchdog/ibmasr.ko 2024-08-31T04:04:32.370 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-08-31T04:04:32.371 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/watchdog/it8712f_wdt.ko 2024-08-31T04:04:32.371 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/watchdog/it87_wdt.ko 2024-08-31T04:04:32.371 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/watchdog/machzwd.ko 2024-08-31T04:04:32.371 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/watchdog/nv_tco.ko 2024-08-31T04:04:32.371 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/watchdog/pcwd_pci.ko 2024-08-31T04:04:32.372 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/watchdog/pcwd_usb.ko 2024-08-31T04:04:32.372 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-08-31T04:04:32.372 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/watchdog/sch311x_wdt.ko 2024-08-31T04:04:32.372 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/watchdog/softdog.ko 2024-08-31T04:04:32.372 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/watchdog/sp5100_tco.ko 2024-08-31T04:04:32.372 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/watchdog/via_wdt.ko 2024-08-31T04:04:32.373 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-08-31T04:04:32.373 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/watchdog/w83877f_wdt.ko 2024-08-31T04:04:32.373 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/watchdog/w83977f_wdt.ko 2024-08-31T04:04:32.373 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/watchdog/wdt_pci.ko 2024-08-31T04:04:32.373 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/watchdog/xen_wdt.ko 2024-08-31T04:04:32.373 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/xen 2024-08-31T04:04:32.374 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/xen/xen-acpi-processor.ko 2024-08-31T04:04:32.374 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/xen/xen-evtchn.ko 2024-08-31T04:04:32.374 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/xen/xen-gntalloc.ko 2024-08-31T04:04:32.374 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/xen/xen-gntdev.ko 2024-08-31T04:04:32.374 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/xen/xen-pciback 2024-08-31T04:04:32.374 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-08-31T04:04:32.374 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/xen/xen-privcmd.ko 2024-08-31T04:04:32.375 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/xen/xenfs 2024-08-31T04:04:32.375 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/xen/xenfs/xenfs.ko 2024-08-31T04:04:32.375 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs 2024-08-31T04:04:32.375 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/9p 2024-08-31T04:04:32.375 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/9p/9p.ko 2024-08-31T04:04:32.376 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/affs 2024-08-31T04:04:32.376 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/affs/affs.ko 2024-08-31T04:04:32.376 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/befs 2024-08-31T04:04:32.376 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/befs/befs.ko 2024-08-31T04:04:32.376 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/binfmt_misc.ko 2024-08-31T04:04:32.376 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/btrfs 2024-08-31T04:04:32.377 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/btrfs/btrfs.ko 2024-08-31T04:04:32.377 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/cachefiles 2024-08-31T04:04:32.377 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/cachefiles/cachefiles.ko 2024-08-31T04:04:32.377 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/ceph 2024-08-31T04:04:32.377 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/ceph/ceph.ko 2024-08-31T04:04:32.377 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/coda 2024-08-31T04:04:32.378 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/coda/coda.ko 2024-08-31T04:04:32.378 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/cramfs 2024-08-31T04:04:32.378 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/cramfs/cramfs.ko 2024-08-31T04:04:32.378 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/dlm 2024-08-31T04:04:32.378 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/dlm/dlm.ko 2024-08-31T04:04:32.378 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/ecryptfs 2024-08-31T04:04:32.378 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/ecryptfs/ecryptfs.ko 2024-08-31T04:04:32.379 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/f2fs 2024-08-31T04:04:32.379 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/f2fs/f2fs.ko 2024-08-31T04:04:32.379 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/fat 2024-08-31T04:04:32.379 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/fat/fat.ko 2024-08-31T04:04:32.379 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/fat/msdos.ko 2024-08-31T04:04:32.379 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/fat/vfat.ko 2024-08-31T04:04:32.380 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/fuse 2024-08-31T04:04:32.380 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/fuse/cuse.ko 2024-08-31T04:04:32.380 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/fuse/fuse.ko 2024-08-31T04:04:32.380 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/gfs2 2024-08-31T04:04:32.380 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/gfs2/gfs2.ko 2024-08-31T04:04:32.380 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/hfs 2024-08-31T04:04:32.381 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/hfs/hfs.ko 2024-08-31T04:04:32.381 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/hfsplus 2024-08-31T04:04:32.381 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/hfsplus/hfsplus.ko 2024-08-31T04:04:32.381 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/isofs 2024-08-31T04:04:32.381 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/isofs/isofs.ko 2024-08-31T04:04:32.381 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/jfs 2024-08-31T04:04:32.381 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/jfs/jfs.ko 2024-08-31T04:04:32.382 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/lockd 2024-08-31T04:04:32.382 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/lockd/lockd.ko 2024-08-31T04:04:32.382 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/minix 2024-08-31T04:04:32.382 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/minix/minix.ko 2024-08-31T04:04:32.382 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/netfs 2024-08-31T04:04:32.383 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/netfs/netfs.ko 2024-08-31T04:04:32.383 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nfs 2024-08-31T04:04:32.383 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nfs/blocklayout 2024-08-31T04:04:32.383 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-08-31T04:04:32.383 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nfs/filelayout 2024-08-31T04:04:32.383 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-08-31T04:04:32.384 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nfs/flexfilelayout 2024-08-31T04:04:32.384 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-08-31T04:04:32.384 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nfs/nfs.ko 2024-08-31T04:04:32.384 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nfs/nfsv3.ko 2024-08-31T04:04:32.384 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nfs/nfsv4.ko 2024-08-31T04:04:32.384 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nfs_common 2024-08-31T04:04:32.385 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nfs_common/grace.ko 2024-08-31T04:04:32.385 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nfs_common/nfs_acl.ko 2024-08-31T04:04:32.385 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nfsd 2024-08-31T04:04:32.385 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nfsd/nfsd.ko 2024-08-31T04:04:32.385 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nilfs2 2024-08-31T04:04:32.385 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nilfs2/nilfs2.ko 2024-08-31T04:04:32.385 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nls 2024-08-31T04:04:32.385 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nls/mac-celtic.ko 2024-08-31T04:04:32.386 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nls/mac-centeuro.ko 2024-08-31T04:04:32.386 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nls/mac-croatian.ko 2024-08-31T04:04:32.386 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nls/mac-cyrillic.ko 2024-08-31T04:04:32.386 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nls/mac-gaelic.ko 2024-08-31T04:04:32.386 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nls/mac-greek.ko 2024-08-31T04:04:32.386 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nls/mac-iceland.ko 2024-08-31T04:04:32.386 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nls/mac-inuit.ko 2024-08-31T04:04:32.386 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nls/mac-roman.ko 2024-08-31T04:04:32.387 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nls/mac-romanian.ko 2024-08-31T04:04:32.387 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nls/mac-turkish.ko 2024-08-31T04:04:32.387 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nls/nls_cp1250.ko 2024-08-31T04:04:32.387 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nls/nls_cp1251.ko 2024-08-31T04:04:32.387 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nls/nls_cp1255.ko 2024-08-31T04:04:32.387 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nls/nls_cp737.ko 2024-08-31T04:04:32.387 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nls/nls_cp775.ko 2024-08-31T04:04:32.387 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nls/nls_cp850.ko 2024-08-31T04:04:32.388 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nls/nls_cp852.ko 2024-08-31T04:04:32.388 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nls/nls_cp855.ko 2024-08-31T04:04:32.388 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nls/nls_cp857.ko 2024-08-31T04:04:32.388 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nls/nls_cp860.ko 2024-08-31T04:04:32.388 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nls/nls_cp861.ko 2024-08-31T04:04:32.388 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nls/nls_cp862.ko 2024-08-31T04:04:32.388 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nls/nls_cp863.ko 2024-08-31T04:04:32.388 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nls/nls_cp864.ko 2024-08-31T04:04:32.388 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nls/nls_cp865.ko 2024-08-31T04:04:32.389 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nls/nls_cp866.ko 2024-08-31T04:04:32.389 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nls/nls_cp869.ko 2024-08-31T04:04:32.389 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nls/nls_cp874.ko 2024-08-31T04:04:32.389 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nls/nls_cp932.ko 2024-08-31T04:04:32.389 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nls/nls_cp936.ko 2024-08-31T04:04:32.389 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nls/nls_cp949.ko 2024-08-31T04:04:32.389 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nls/nls_cp950.ko 2024-08-31T04:04:32.389 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nls/nls_euc-jp.ko 2024-08-31T04:04:32.390 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nls/nls_iso8859-1.ko 2024-08-31T04:04:32.390 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nls/nls_iso8859-13.ko 2024-08-31T04:04:32.390 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nls/nls_iso8859-14.ko 2024-08-31T04:04:32.390 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nls/nls_iso8859-15.ko 2024-08-31T04:04:32.390 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nls/nls_iso8859-2.ko 2024-08-31T04:04:32.390 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nls/nls_iso8859-3.ko 2024-08-31T04:04:32.390 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nls/nls_iso8859-4.ko 2024-08-31T04:04:32.390 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nls/nls_iso8859-5.ko 2024-08-31T04:04:32.390 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nls/nls_iso8859-6.ko 2024-08-31T04:04:32.390 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nls/nls_iso8859-7.ko 2024-08-31T04:04:32.390 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nls/nls_iso8859-9.ko 2024-08-31T04:04:32.390 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nls/nls_koi8-r.ko 2024-08-31T04:04:32.390 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nls/nls_koi8-ru.ko 2024-08-31T04:04:32.391 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nls/nls_koi8-u.ko 2024-08-31T04:04:32.391 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nls/nls_ucs2_utils.ko 2024-08-31T04:04:32.391 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nls/nls_utf8.ko 2024-08-31T04:04:32.391 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/ocfs2 2024-08-31T04:04:32.391 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/ocfs2/cluster 2024-08-31T04:04:32.391 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-08-31T04:04:32.391 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/ocfs2/dlm 2024-08-31T04:04:32.391 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-08-31T04:04:32.391 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/ocfs2/dlmfs 2024-08-31T04:04:32.391 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-08-31T04:04:32.391 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/ocfs2/ocfs2.ko 2024-08-31T04:04:32.391 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-08-31T04:04:32.391 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-08-31T04:04:32.391 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-08-31T04:04:32.392 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/overlayfs 2024-08-31T04:04:32.392 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/overlayfs/overlay.ko 2024-08-31T04:04:32.392 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/pstore 2024-08-31T04:04:32.392 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/pstore/ramoops.ko 2024-08-31T04:04:32.392 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/reiserfs 2024-08-31T04:04:32.392 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/reiserfs/reiserfs.ko 2024-08-31T04:04:32.392 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/romfs 2024-08-31T04:04:32.392 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/romfs/romfs.ko 2024-08-31T04:04:32.392 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/smb 2024-08-31T04:04:32.392 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/smb/client 2024-08-31T04:04:32.392 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/smb/client/cifs.ko 2024-08-31T04:04:32.392 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/smb/common 2024-08-31T04:04:32.392 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/smb/common/cifs_arc4.ko 2024-08-31T04:04:32.393 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/smb/common/cifs_md4.ko 2024-08-31T04:04:32.393 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/squashfs 2024-08-31T04:04:32.393 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/squashfs/squashfs.ko 2024-08-31T04:04:32.393 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/sysv 2024-08-31T04:04:32.393 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/sysv/sysv.ko 2024-08-31T04:04:32.393 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/udf 2024-08-31T04:04:32.393 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/udf/udf.ko 2024-08-31T04:04:32.393 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/ufs 2024-08-31T04:04:32.393 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/ufs/ufs.ko 2024-08-31T04:04:32.393 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/xfs 2024-08-31T04:04:32.393 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/xfs/xfs.ko 2024-08-31T04:04:32.393 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/kernel 2024-08-31T04:04:32.393 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/kernel/rcu 2024-08-31T04:04:32.394 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/kernel/rcu/rcutorture.ko 2024-08-31T04:04:32.394 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/kernel/torture.ko 2024-08-31T04:04:32.394 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/kernel/trace 2024-08-31T04:04:32.394 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/kernel/trace/ring_buffer_benchmark.ko 2024-08-31T04:04:32.394 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/lib 2024-08-31T04:04:32.394 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/lib/asn1_encoder.ko 2024-08-31T04:04:32.394 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/lib/crc-itu-t.ko 2024-08-31T04:04:32.394 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/lib/crc8.ko 2024-08-31T04:04:32.394 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/lib/crypto 2024-08-31T04:04:32.394 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/lib/crypto/libaescfb.ko 2024-08-31T04:04:32.394 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/lib/crypto/libarc4.ko 2024-08-31T04:04:32.394 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/lib/crypto/libdes.ko 2024-08-31T04:04:32.394 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/lib/libcrc32c.ko 2024-08-31T04:04:32.394 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/lib/lru_cache.ko 2024-08-31T04:04:32.395 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/lib/lz4 2024-08-31T04:04:32.395 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/lib/lz4/lz4_compress.ko 2024-08-31T04:04:32.395 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/lib/lz4/lz4hc_compress.ko 2024-08-31T04:04:32.395 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/lib/math 2024-08-31T04:04:32.395 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/lib/math/cordic.ko 2024-08-31T04:04:32.395 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/lib/raid6 2024-08-31T04:04:32.395 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/lib/raid6/raid6_pq.ko 2024-08-31T04:04:32.395 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/lib/reed_solomon 2024-08-31T04:04:32.395 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/lib/reed_solomon/reed_solomon.ko 2024-08-31T04:04:32.395 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/lib/ts_bm.ko 2024-08-31T04:04:32.395 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/lib/ts_fsm.ko 2024-08-31T04:04:32.395 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/lib/ts_kmp.ko 2024-08-31T04:04:32.395 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/lib/zstd 2024-08-31T04:04:32.395 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/lib/zstd/zstd_compress.ko 2024-08-31T04:04:32.396 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/mm 2024-08-31T04:04:32.396 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/mm/hwpoison-inject.ko 2024-08-31T04:04:32.396 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net 2024-08-31T04:04:32.396 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/6lowpan 2024-08-31T04:04:32.396 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/6lowpan/6lowpan.ko 2024-08-31T04:04:32.396 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/6lowpan/nhc_dest.ko 2024-08-31T04:04:32.396 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/6lowpan/nhc_fragment.ko 2024-08-31T04:04:32.396 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/6lowpan/nhc_hop.ko 2024-08-31T04:04:32.396 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/6lowpan/nhc_ipv6.ko 2024-08-31T04:04:32.396 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/6lowpan/nhc_mobility.ko 2024-08-31T04:04:32.396 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/6lowpan/nhc_routing.ko 2024-08-31T04:04:32.396 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/6lowpan/nhc_udp.ko 2024-08-31T04:04:32.396 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/802 2024-08-31T04:04:32.397 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/802/garp.ko 2024-08-31T04:04:32.397 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/802/mrp.ko 2024-08-31T04:04:32.397 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/802/p8022.ko 2024-08-31T04:04:32.397 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/802/psnap.ko 2024-08-31T04:04:32.397 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/802/stp.ko 2024-08-31T04:04:32.397 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/8021q 2024-08-31T04:04:32.397 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/8021q/8021q.ko 2024-08-31T04:04:32.397 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/9p 2024-08-31T04:04:32.397 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/9p/9pnet.ko 2024-08-31T04:04:32.397 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/9p/9pnet_fd.ko 2024-08-31T04:04:32.397 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/9p/9pnet_rdma.ko 2024-08-31T04:04:32.397 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/9p/9pnet_virtio.ko 2024-08-31T04:04:32.397 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/batman-adv 2024-08-31T04:04:32.398 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/batman-adv/batman-adv.ko 2024-08-31T04:04:32.398 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/bridge 2024-08-31T04:04:32.398 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/bridge/br_netfilter.ko 2024-08-31T04:04:32.398 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/bridge/bridge.ko 2024-08-31T04:04:32.398 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/bridge/netfilter 2024-08-31T04:04:32.398 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-08-31T04:04:32.398 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/bridge/netfilter/ebt_among.ko 2024-08-31T04:04:32.398 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/bridge/netfilter/ebt_arp.ko 2024-08-31T04:04:32.398 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-08-31T04:04:32.398 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-08-31T04:04:32.398 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/bridge/netfilter/ebt_ip.ko 2024-08-31T04:04:32.398 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-08-31T04:04:32.398 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/bridge/netfilter/ebt_limit.ko 2024-08-31T04:04:32.399 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/bridge/netfilter/ebt_log.ko 2024-08-31T04:04:32.399 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/bridge/netfilter/ebt_mark.ko 2024-08-31T04:04:32.399 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-08-31T04:04:32.399 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-08-31T04:04:32.399 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-08-31T04:04:32.399 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-08-31T04:04:32.399 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/bridge/netfilter/ebt_snat.ko 2024-08-31T04:04:32.399 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/bridge/netfilter/ebt_stp.ko 2024-08-31T04:04:32.399 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-08-31T04:04:32.399 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-08-31T04:04:32.399 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-08-31T04:04:32.399 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-08-31T04:04:32.399 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/bridge/netfilter/ebtables.ko 2024-08-31T04:04:32.399 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2024-08-31T04:04:32.400 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-08-31T04:04:32.400 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-08-31T04:04:32.400 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ceph 2024-08-31T04:04:32.400 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ceph/libceph.ko 2024-08-31T04:04:32.400 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/core 2024-08-31T04:04:32.400 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/core/failover.ko 2024-08-31T04:04:32.400 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/core/pktgen.ko 2024-08-31T04:04:32.400 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/dccp 2024-08-31T04:04:32.400 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/dccp/dccp.ko 2024-08-31T04:04:32.400 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/dccp/dccp_diag.ko 2024-08-31T04:04:32.400 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/dccp/dccp_ipv4.ko 2024-08-31T04:04:32.400 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/dccp/dccp_ipv6.ko 2024-08-31T04:04:32.400 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/dns_resolver 2024-08-31T04:04:32.400 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/dns_resolver/dns_resolver.ko 2024-08-31T04:04:32.401 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/dsa 2024-08-31T04:04:32.401 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/dsa/dsa_core.ko 2024-08-31T04:04:32.401 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/dsa/tag_brcm.ko 2024-08-31T04:04:32.401 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/dsa/tag_dsa.ko 2024-08-31T04:04:32.401 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/dsa/tag_none.ko 2024-08-31T04:04:32.401 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/dsa/tag_trailer.ko 2024-08-31T04:04:32.401 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ieee802154 2024-08-31T04:04:32.401 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ieee802154/6lowpan 2024-08-31T04:04:32.401 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-08-31T04:04:32.401 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ieee802154/ieee802154.ko 2024-08-31T04:04:32.401 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ieee802154/ieee802154_socket.ko 2024-08-31T04:04:32.401 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv4 2024-08-31T04:04:32.401 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv4/ah4.ko 2024-08-31T04:04:32.401 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv4/esp4.ko 2024-08-31T04:04:32.402 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv4/fou.ko 2024-08-31T04:04:32.402 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv4/gre.ko 2024-08-31T04:04:32.402 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv4/inet_diag.ko 2024-08-31T04:04:32.402 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv4/ip_gre.ko 2024-08-31T04:04:32.402 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv4/ip_tunnel.ko 2024-08-31T04:04:32.402 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv4/ip_vti.ko 2024-08-31T04:04:32.402 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv4/ipcomp.ko 2024-08-31T04:04:32.402 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv4/ipip.ko 2024-08-31T04:04:32.402 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv4/netfilter 2024-08-31T04:04:32.402 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv4/netfilter/arp_tables.ko 2024-08-31T04:04:32.402 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-08-31T04:04:32.402 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-08-31T04:04:32.402 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-08-31T04:04:32.402 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-08-31T04:04:32.403 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-08-31T04:04:32.403 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-08-31T04:04:32.403 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-08-31T04:04:32.403 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-08-31T04:04:32.403 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-08-31T04:04:32.403 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv4/netfilter/iptable_security.ko 2024-08-31T04:04:32.403 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-08-31T04:04:32.403 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-08-31T04:04:32.403 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-08-31T04:04:32.403 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-08-31T04:04:32.403 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-08-31T04:04:32.403 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-08-31T04:04:32.403 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-08-31T04:04:32.403 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-08-31T04:04:32.404 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-08-31T04:04:32.404 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-08-31T04:04:32.404 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv4/tcp_bic.ko 2024-08-31T04:04:32.404 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv4/tcp_dctcp.ko 2024-08-31T04:04:32.404 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv4/tcp_diag.ko 2024-08-31T04:04:32.404 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv4/tcp_highspeed.ko 2024-08-31T04:04:32.404 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv4/tcp_htcp.ko 2024-08-31T04:04:32.404 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv4/tcp_hybla.ko 2024-08-31T04:04:32.404 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv4/tcp_illinois.ko 2024-08-31T04:04:32.404 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv4/tcp_lp.ko 2024-08-31T04:04:32.404 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv4/tcp_scalable.ko 2024-08-31T04:04:32.404 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv4/tcp_vegas.ko 2024-08-31T04:04:32.404 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv4/tcp_veno.ko 2024-08-31T04:04:32.404 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv4/tcp_westwood.ko 2024-08-31T04:04:32.405 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv4/tcp_yeah.ko 2024-08-31T04:04:32.405 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv4/tunnel4.ko 2024-08-31T04:04:32.405 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv4/udp_diag.ko 2024-08-31T04:04:32.405 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv4/udp_tunnel.ko 2024-08-31T04:04:32.405 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv4/xfrm4_tunnel.ko 2024-08-31T04:04:32.405 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv6 2024-08-31T04:04:32.405 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv6/ah6.ko 2024-08-31T04:04:32.405 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv6/esp6.ko 2024-08-31T04:04:32.405 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv6/fou6.ko 2024-08-31T04:04:32.405 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv6/ip6_tunnel.ko 2024-08-31T04:04:32.405 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-08-31T04:04:32.405 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv6/ip6_vti.ko 2024-08-31T04:04:32.405 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv6/ipcomp6.ko 2024-08-31T04:04:32.406 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv6/netfilter 2024-08-31T04:04:32.406 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-08-31T04:04:32.406 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-08-31T04:04:32.406 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-08-31T04:04:32.406 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-08-31T04:04:32.406 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-08-31T04:04:32.406 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-08-31T04:04:32.406 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-08-31T04:04:32.406 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-08-31T04:04:32.406 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-08-31T04:04:32.406 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-08-31T04:04:32.406 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-08-31T04:04:32.406 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-08-31T04:04:32.406 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-08-31T04:04:32.406 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-08-31T04:04:32.407 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-08-31T04:04:32.407 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-08-31T04:04:32.407 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-08-31T04:04:32.407 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-08-31T04:04:32.407 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-08-31T04:04:32.407 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-08-31T04:04:32.407 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-08-31T04:04:32.407 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-08-31T04:04:32.407 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-08-31T04:04:32.407 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-08-31T04:04:32.407 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv6/sit.ko 2024-08-31T04:04:32.407 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv6/tunnel6.ko 2024-08-31T04:04:32.407 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv6/xfrm6_tunnel.ko 2024-08-31T04:04:32.407 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/key 2024-08-31T04:04:32.408 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/key/af_key.ko 2024-08-31T04:04:32.408 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/l2tp 2024-08-31T04:04:32.408 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/l2tp/l2tp_core.ko 2024-08-31T04:04:32.408 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/l2tp/l2tp_debugfs.ko 2024-08-31T04:04:32.408 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/l2tp/l2tp_eth.ko 2024-08-31T04:04:32.408 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/l2tp/l2tp_ip.ko 2024-08-31T04:04:32.408 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/l2tp/l2tp_ip6.ko 2024-08-31T04:04:32.408 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/l2tp/l2tp_netlink.ko 2024-08-31T04:04:32.408 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/l2tp/l2tp_ppp.ko 2024-08-31T04:04:32.408 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/llc 2024-08-31T04:04:32.408 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/llc/llc.ko 2024-08-31T04:04:32.408 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/mac802154 2024-08-31T04:04:32.408 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/mac802154/mac802154.ko 2024-08-31T04:04:32.408 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/mpls 2024-08-31T04:04:32.409 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/mpls/mpls_gso.ko 2024-08-31T04:04:32.409 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter 2024-08-31T04:04:32.409 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/ipset 2024-08-31T04:04:32.409 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/ipset/ip_set.ko 2024-08-31T04:04:32.409 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-08-31T04:04:32.409 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-08-31T04:04:32.409 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-08-31T04:04:32.409 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-08-31T04:04:32.409 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-08-31T04:04:32.409 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-08-31T04:04:32.409 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-08-31T04:04:32.409 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-08-31T04:04:32.409 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-08-31T04:04:32.410 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-08-31T04:04:32.410 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-08-31T04:04:32.410 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-08-31T04:04:32.410 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-08-31T04:04:32.410 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-08-31T04:04:32.410 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-08-31T04:04:32.410 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/ipvs 2024-08-31T04:04:32.410 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/ipvs/ip_vs.ko 2024-08-31T04:04:32.410 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-08-31T04:04:32.410 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-08-31T04:04:32.410 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-08-31T04:04:32.410 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-08-31T04:04:32.410 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-08-31T04:04:32.410 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-08-31T04:04:32.411 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-08-31T04:04:32.411 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-08-31T04:04:32.411 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-08-31T04:04:32.411 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-08-31T04:04:32.411 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-08-31T04:04:32.411 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-08-31T04:04:32.411 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-08-31T04:04:32.411 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/nf_conncount.ko 2024-08-31T04:04:32.411 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/nf_conntrack.ko 2024-08-31T04:04:32.411 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-08-31T04:04:32.411 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-08-31T04:04:32.411 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-08-31T04:04:32.412 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/nf_conntrack_h323.ko 2024-08-31T04:04:32.412 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/nf_conntrack_irc.ko 2024-08-31T04:04:32.412 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-08-31T04:04:32.412 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-08-31T04:04:32.412 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-08-31T04:04:32.412 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/nf_conntrack_sane.ko 2024-08-31T04:04:32.412 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/nf_conntrack_sip.ko 2024-08-31T04:04:32.412 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-08-31T04:04:32.412 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-08-31T04:04:32.412 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/nf_dup_netdev.ko 2024-08-31T04:04:32.412 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/nf_flow_table.ko 2024-08-31T04:04:32.412 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/nf_flow_table_inet.ko 2024-08-31T04:04:32.412 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/nf_log_syslog.ko 2024-08-31T04:04:32.413 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/nf_nat.ko 2024-08-31T04:04:32.413 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/nf_nat_amanda.ko 2024-08-31T04:04:32.413 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/nf_nat_ftp.ko 2024-08-31T04:04:32.413 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/nf_nat_irc.ko 2024-08-31T04:04:32.413 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/nf_nat_sip.ko 2024-08-31T04:04:32.413 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/nf_nat_tftp.ko 2024-08-31T04:04:32.413 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/nf_synproxy_core.ko 2024-08-31T04:04:32.413 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/nf_tables.ko 2024-08-31T04:04:32.413 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/nfnetlink.ko 2024-08-31T04:04:32.413 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/nfnetlink_acct.ko 2024-08-31T04:04:32.413 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/nfnetlink_log.ko 2024-08-31T04:04:32.413 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/nfnetlink_osf.ko 2024-08-31T04:04:32.413 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/nfnetlink_queue.ko 2024-08-31T04:04:32.413 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/nft_chain_nat.ko 2024-08-31T04:04:32.414 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/nft_compat.ko 2024-08-31T04:04:32.414 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/nft_ct.ko 2024-08-31T04:04:32.414 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/nft_dup_netdev.ko 2024-08-31T04:04:32.414 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/nft_fib.ko 2024-08-31T04:04:32.414 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/nft_fwd_netdev.ko 2024-08-31T04:04:32.414 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/nft_hash.ko 2024-08-31T04:04:32.414 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/nft_limit.ko 2024-08-31T04:04:32.414 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/nft_log.ko 2024-08-31T04:04:32.414 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/nft_masq.ko 2024-08-31T04:04:32.414 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/nft_nat.ko 2024-08-31T04:04:32.414 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/nft_numgen.ko 2024-08-31T04:04:32.414 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/nft_queue.ko 2024-08-31T04:04:32.414 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/nft_quota.ko 2024-08-31T04:04:32.414 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/nft_redir.ko 2024-08-31T04:04:32.415 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/nft_reject.ko 2024-08-31T04:04:32.415 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/nft_reject_inet.ko 2024-08-31T04:04:32.415 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/nft_socket.ko 2024-08-31T04:04:32.415 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/nft_tunnel.ko 2024-08-31T04:04:32.415 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_AUDIT.ko 2024-08-31T04:04:32.415 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_CHECKSUM.ko 2024-08-31T04:04:32.415 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_CLASSIFY.ko 2024-08-31T04:04:32.415 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-08-31T04:04:32.415 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_CT.ko 2024-08-31T04:04:32.415 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_DSCP.ko 2024-08-31T04:04:32.415 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_HL.ko 2024-08-31T04:04:32.415 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_HMARK.ko 2024-08-31T04:04:32.415 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_IDLETIMER.ko 2024-08-31T04:04:32.415 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_LED.ko 2024-08-31T04:04:32.416 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_LOG.ko 2024-08-31T04:04:32.416 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_MASQUERADE.ko 2024-08-31T04:04:32.416 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_NETMAP.ko 2024-08-31T04:04:32.416 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_NFLOG.ko 2024-08-31T04:04:32.416 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_NFQUEUE.ko 2024-08-31T04:04:32.416 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_RATEEST.ko 2024-08-31T04:04:32.416 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_REDIRECT.ko 2024-08-31T04:04:32.416 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_SECMARK.ko 2024-08-31T04:04:32.416 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_TCPMSS.ko 2024-08-31T04:04:32.416 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-08-31T04:04:32.416 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_TEE.ko 2024-08-31T04:04:32.416 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_TPROXY.ko 2024-08-31T04:04:32.416 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_TRACE.ko 2024-08-31T04:04:32.416 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_addrtype.ko 2024-08-31T04:04:32.417 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_bpf.ko 2024-08-31T04:04:32.417 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_cgroup.ko 2024-08-31T04:04:32.417 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_cluster.ko 2024-08-31T04:04:32.417 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_comment.ko 2024-08-31T04:04:32.417 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_connbytes.ko 2024-08-31T04:04:32.417 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_connlabel.ko 2024-08-31T04:04:32.417 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_connlimit.ko 2024-08-31T04:04:32.417 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_connmark.ko 2024-08-31T04:04:32.417 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_conntrack.ko 2024-08-31T04:04:32.417 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_cpu.ko 2024-08-31T04:04:32.417 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_dccp.ko 2024-08-31T04:04:32.417 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_devgroup.ko 2024-08-31T04:04:32.417 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_dscp.ko 2024-08-31T04:04:32.417 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_ecn.ko 2024-08-31T04:04:32.418 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_esp.ko 2024-08-31T04:04:32.418 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_hashlimit.ko 2024-08-31T04:04:32.418 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_helper.ko 2024-08-31T04:04:32.418 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_hl.ko 2024-08-31T04:04:32.418 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_ipcomp.ko 2024-08-31T04:04:32.418 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_iprange.ko 2024-08-31T04:04:32.418 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_ipvs.ko 2024-08-31T04:04:32.418 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_l2tp.ko 2024-08-31T04:04:32.418 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_length.ko 2024-08-31T04:04:32.418 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_limit.ko 2024-08-31T04:04:32.418 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_mac.ko 2024-08-31T04:04:32.418 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_mark.ko 2024-08-31T04:04:32.418 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_multiport.ko 2024-08-31T04:04:32.418 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_nat.ko 2024-08-31T04:04:32.419 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_nfacct.ko 2024-08-31T04:04:32.419 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_osf.ko 2024-08-31T04:04:32.419 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_owner.ko 2024-08-31T04:04:32.419 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_physdev.ko 2024-08-31T04:04:32.419 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_pkttype.ko 2024-08-31T04:04:32.419 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_policy.ko 2024-08-31T04:04:32.419 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_quota.ko 2024-08-31T04:04:32.419 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_rateest.ko 2024-08-31T04:04:32.419 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_realm.ko 2024-08-31T04:04:32.419 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_recent.ko 2024-08-31T04:04:32.419 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_sctp.ko 2024-08-31T04:04:32.419 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_set.ko 2024-08-31T04:04:32.419 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_socket.ko 2024-08-31T04:04:32.419 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_state.ko 2024-08-31T04:04:32.420 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_statistic.ko 2024-08-31T04:04:32.420 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_string.ko 2024-08-31T04:04:32.420 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_tcpmss.ko 2024-08-31T04:04:32.420 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_time.ko 2024-08-31T04:04:32.420 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_u32.ko 2024-08-31T04:04:32.420 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netlink 2024-08-31T04:04:32.420 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netlink/netlink_diag.ko 2024-08-31T04:04:32.420 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/nsh 2024-08-31T04:04:32.420 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/nsh/nsh.ko 2024-08-31T04:04:32.420 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/openvswitch 2024-08-31T04:04:32.420 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/openvswitch/openvswitch.ko 2024-08-31T04:04:32.420 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/openvswitch/vport-geneve.ko 2024-08-31T04:04:32.420 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/openvswitch/vport-gre.ko 2024-08-31T04:04:32.420 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/openvswitch/vport-vxlan.ko 2024-08-31T04:04:32.421 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/packet 2024-08-31T04:04:32.421 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/packet/af_packet_diag.ko 2024-08-31T04:04:32.421 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/rds 2024-08-31T04:04:32.421 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/rds/rds.ko 2024-08-31T04:04:32.421 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/rds/rds_rdma.ko 2024-08-31T04:04:32.421 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/rds/rds_tcp.ko 2024-08-31T04:04:32.421 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/sched 2024-08-31T04:04:32.421 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/sched/act_csum.ko 2024-08-31T04:04:32.421 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/sched/act_gact.ko 2024-08-31T04:04:32.421 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/sched/act_mirred.ko 2024-08-31T04:04:32.421 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/sched/act_nat.ko 2024-08-31T04:04:32.421 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/sched/act_pedit.ko 2024-08-31T04:04:32.421 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/sched/act_police.ko 2024-08-31T04:04:32.422 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/sched/act_simple.ko 2024-08-31T04:04:32.422 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/sched/act_skbedit.ko 2024-08-31T04:04:32.422 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/sched/act_vlan.ko 2024-08-31T04:04:32.422 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/sched/cls_basic.ko 2024-08-31T04:04:32.422 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/sched/cls_bpf.ko 2024-08-31T04:04:32.422 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/sched/cls_flow.ko 2024-08-31T04:04:32.422 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/sched/cls_fw.ko 2024-08-31T04:04:32.422 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/sched/cls_route.ko 2024-08-31T04:04:32.422 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/sched/cls_u32.ko 2024-08-31T04:04:32.422 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/sched/em_cmp.ko 2024-08-31T04:04:32.422 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/sched/em_ipset.ko 2024-08-31T04:04:32.422 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/sched/em_meta.ko 2024-08-31T04:04:32.422 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/sched/em_nbyte.ko 2024-08-31T04:04:32.422 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/sched/em_text.ko 2024-08-31T04:04:32.422 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/sched/em_u32.ko 2024-08-31T04:04:32.423 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/sched/sch_choke.ko 2024-08-31T04:04:32.423 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/sched/sch_codel.ko 2024-08-31T04:04:32.423 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/sched/sch_drr.ko 2024-08-31T04:04:32.423 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/sched/sch_fq.ko 2024-08-31T04:04:32.423 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/sched/sch_gred.ko 2024-08-31T04:04:32.423 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/sched/sch_hfsc.ko 2024-08-31T04:04:32.423 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/sched/sch_hhf.ko 2024-08-31T04:04:32.423 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/sched/sch_htb.ko 2024-08-31T04:04:32.423 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/sched/sch_ingress.ko 2024-08-31T04:04:32.423 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/sched/sch_mqprio.ko 2024-08-31T04:04:32.423 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/sched/sch_mqprio_lib.ko 2024-08-31T04:04:32.423 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/sched/sch_multiq.ko 2024-08-31T04:04:32.423 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/sched/sch_netem.ko 2024-08-31T04:04:32.423 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/sched/sch_pie.ko 2024-08-31T04:04:32.424 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/sched/sch_plug.ko 2024-08-31T04:04:32.424 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/sched/sch_prio.ko 2024-08-31T04:04:32.424 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/sched/sch_qfq.ko 2024-08-31T04:04:32.424 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/sched/sch_red.ko 2024-08-31T04:04:32.424 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/sched/sch_sfb.ko 2024-08-31T04:04:32.424 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/sched/sch_sfq.ko 2024-08-31T04:04:32.424 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/sched/sch_tbf.ko 2024-08-31T04:04:32.424 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/sched/sch_teql.ko 2024-08-31T04:04:32.424 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/sctp 2024-08-31T04:04:32.424 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/sctp/sctp.ko 2024-08-31T04:04:32.424 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/sctp/sctp_diag.ko 2024-08-31T04:04:32.424 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/sunrpc 2024-08-31T04:04:32.424 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/sunrpc/auth_gss 2024-08-31T04:04:32.424 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-08-31T04:04:32.425 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-08-31T04:04:32.425 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/sunrpc/sunrpc.ko 2024-08-31T04:04:32.425 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/sunrpc/xprtrdma 2024-08-31T04:04:32.425 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-08-31T04:04:32.425 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/tipc 2024-08-31T04:04:32.425 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/tipc/tipc.ko 2024-08-31T04:04:32.425 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/tipc/tipc_diag.ko 2024-08-31T04:04:32.425 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/unix 2024-08-31T04:04:32.425 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/unix/unix_diag.ko 2024-08-31T04:04:32.425 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/vmw_vsock 2024-08-31T04:04:32.425 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-08-31T04:04:32.425 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-08-31T04:04:32.425 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/vmw_vsock/vsock.ko 2024-08-31T04:04:32.425 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/vmw_vsock/vsock_diag.ko 2024-08-31T04:04:32.426 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/vmw_vsock/vsock_loopback.ko 2024-08-31T04:04:32.426 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/xfrm 2024-08-31T04:04:32.426 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/xfrm/xfrm_ipcomp.ko 2024-08-31T04:04:32.426 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/security 2024-08-31T04:04:32.426 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/security/keys 2024-08-31T04:04:32.426 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/security/keys/encrypted-keys 2024-08-31T04:04:32.426 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2024-08-31T04:04:32.426 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/security/keys/trusted-keys 2024-08-31T04:04:32.426 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/security/keys/trusted-keys/trusted.ko 2024-08-31T04:04:32.426 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/modules.alias 2024-08-31T04:04:32.426 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/modules.alias.bin 2024-08-31T04:04:32.426 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/modules.builtin 2024-08-31T04:04:32.426 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/modules.builtin.alias.bin 2024-08-31T04:04:32.427 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/modules.builtin.bin 2024-08-31T04:04:32.427 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/modules.builtin.modinfo 2024-08-31T04:04:32.427 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/modules.dep 2024-08-31T04:04:32.427 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/modules.dep.bin 2024-08-31T04:04:32.427 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/modules.devname 2024-08-31T04:04:32.427 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/modules.order 2024-08-31T04:04:32.427 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/modules.softdep 2024-08-31T04:04:32.427 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/modules.symbols 2024-08-31T04:04:32.427 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/modules.symbols.bin 2024-08-31T04:04:32.427 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/modules.weakdep 2024-08-31T04:04:32.427 INFO:teuthology.orchestra.run.smithi050.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/vmlinuz 2024-08-31T04:04:32.431 DEBUG:teuthology.task.kernel:get_image_version: 6.11.0-rc5-g8ad8b8b16098 2024-08-31T04:04:32.432 DEBUG:teuthology.orchestra.run.smithi050:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2024-08-31T04:04:32.455 INFO:teuthology.orchestra.run.smithi050.stdout:postinstall scriptlet (using /bin/sh): 2024-08-31T04:04:32.455 INFO:teuthology.orchestra.run.smithi050.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-08-31T04:04:32.456 INFO:teuthology.orchestra.run.smithi050.stdout: /usr/bin/kernel-install add 6.11.0-rc5-g8ad8b8b16098 /lib/modules/6.11.0-rc5-g8ad8b8b16098/vmlinuz 2024-08-31T04:04:32.456 INFO:teuthology.orchestra.run.smithi050.stdout:fi 2024-08-31T04:04:32.456 INFO:teuthology.orchestra.run.smithi050.stdout:for file in vmlinuz System.map config; do 2024-08-31T04:04:32.456 INFO:teuthology.orchestra.run.smithi050.stdout: if ! cmp --silent "/lib/modules/6.11.0-rc5-g8ad8b8b16098/${file}" "/boot/${file}-6.11.0-rc5-g8ad8b8b16098"; then 2024-08-31T04:04:32.456 INFO:teuthology.orchestra.run.smithi050.stdout: cp "/lib/modules/6.11.0-rc5-g8ad8b8b16098/${file}" "/boot/${file}-6.11.0-rc5-g8ad8b8b16098" 2024-08-31T04:04:32.456 INFO:teuthology.orchestra.run.smithi050.stdout: fi 2024-08-31T04:04:32.456 INFO:teuthology.orchestra.run.smithi050.stdout:done 2024-08-31T04:04:32.456 INFO:teuthology.orchestra.run.smithi050.stdout:if [ -d "/lib/modules/6.11.0-rc5-g8ad8b8b16098/dtb" ] && \ 2024-08-31T04:04:32.456 INFO:teuthology.orchestra.run.smithi050.stdout: ! diff -rq "/lib/modules/6.11.0-rc5-g8ad8b8b16098/dtb" "/boot/dtb-6.11.0-rc5-g8ad8b8b16098" >/dev/null 2>&1; then 2024-08-31T04:04:32.456 INFO:teuthology.orchestra.run.smithi050.stdout: rm -rf "/boot/dtb-6.11.0-rc5-g8ad8b8b16098" 2024-08-31T04:04:32.456 INFO:teuthology.orchestra.run.smithi050.stdout: cp -r "/lib/modules/6.11.0-rc5-g8ad8b8b16098/dtb" "/boot/dtb-6.11.0-rc5-g8ad8b8b16098" 2024-08-31T04:04:32.456 INFO:teuthology.orchestra.run.smithi050.stdout:fi 2024-08-31T04:04:32.456 INFO:teuthology.orchestra.run.smithi050.stdout:if [ ! -e "/lib/modules/6.11.0-rc5-g8ad8b8b16098/modules.dep" ]; then 2024-08-31T04:04:32.457 INFO:teuthology.orchestra.run.smithi050.stdout: /usr/sbin/depmod 6.11.0-rc5-g8ad8b8b16098 2024-08-31T04:04:32.457 INFO:teuthology.orchestra.run.smithi050.stdout:fi 2024-08-31T04:04:32.457 INFO:teuthology.orchestra.run.smithi050.stdout:preuninstall scriptlet (using /bin/sh): 2024-08-31T04:04:32.457 INFO:teuthology.orchestra.run.smithi050.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-08-31T04:04:32.457 INFO:teuthology.orchestra.run.smithi050.stdout:kernel-install remove 6.11.0-rc5-g8ad8b8b16098 2024-08-31T04:04:32.457 INFO:teuthology.orchestra.run.smithi050.stdout:fi 2024-08-31T04:04:32.458 DEBUG:teuthology.orchestra.run.smithi050:> sudo rpm -qi grub2-tools 2024-08-31T04:04:32.532 INFO:teuthology.orchestra.run.smithi050.stdout:Name : grub2-tools 2024-08-31T04:04:32.532 INFO:teuthology.orchestra.run.smithi050.stdout:Epoch : 1 2024-08-31T04:04:32.533 INFO:teuthology.orchestra.run.smithi050.stdout:Version : 2.06 2024-08-31T04:04:32.533 INFO:teuthology.orchestra.run.smithi050.stdout:Release : 82.el9 2024-08-31T04:04:32.533 INFO:teuthology.orchestra.run.smithi050.stdout:Architecture: x86_64 2024-08-31T04:04:32.533 INFO:teuthology.orchestra.run.smithi050.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-08-31T04:04:32.533 INFO:teuthology.orchestra.run.smithi050.stdout:Group : Unspecified 2024-08-31T04:04:32.533 INFO:teuthology.orchestra.run.smithi050.stdout:Size : 8274670 2024-08-31T04:04:32.533 INFO:teuthology.orchestra.run.smithi050.stdout:License : GPLv3+ 2024-08-31T04:04:32.533 INFO:teuthology.orchestra.run.smithi050.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-08-31T04:04:32.533 INFO:teuthology.orchestra.run.smithi050.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-08-31T04:04:32.533 INFO:teuthology.orchestra.run.smithi050.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-08-31T04:04:32.533 INFO:teuthology.orchestra.run.smithi050.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-08-31T04:04:32.533 INFO:teuthology.orchestra.run.smithi050.stdout:Packager : builder@centos.org 2024-08-31T04:04:32.534 INFO:teuthology.orchestra.run.smithi050.stdout:Vendor : CentOS 2024-08-31T04:04:32.534 INFO:teuthology.orchestra.run.smithi050.stdout:URL : http://www.gnu.org/software/grub/ 2024-08-31T04:04:32.534 INFO:teuthology.orchestra.run.smithi050.stdout:Summary : Support tools for GRUB. 2024-08-31T04:04:32.534 INFO:teuthology.orchestra.run.smithi050.stdout:Description : 2024-08-31T04:04:32.534 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-08-31T04:04:32.534 INFO:teuthology.orchestra.run.smithi050.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-08-31T04:04:32.534 INFO:teuthology.orchestra.run.smithi050.stdout:customizable bootloader with modular architecture. It supports a rich 2024-08-31T04:04:32.534 INFO:teuthology.orchestra.run.smithi050.stdout:variety of kernel formats, file systems, computer architectures and 2024-08-31T04:04:32.534 INFO:teuthology.orchestra.run.smithi050.stdout:hardware devices. 2024-08-31T04:04:32.534 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-08-31T04:04:32.534 INFO:teuthology.orchestra.run.smithi050.stdout:This subpackage provides tools for support of all platforms. 2024-08-31T04:04:32.535 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-08-31T04:04:32.535 INFO:teuthology.task.kernel:Updating grub on smithi050 to boot 6.11.0-rc5-g8ad8b8b16098 2024-08-31T04:04:32.536 DEBUG:teuthology.orchestra.run.smithi050:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-08-31T04:04:33.121 INFO:teuthology.orchestra.run.smithi050.stderr:Generating grub configuration file ... 2024-08-31T04:04:34.492 INFO:teuthology.orchestra.run.smithi050.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-08-31T04:04:34.530 INFO:teuthology.orchestra.run.smithi050.stderr:done 2024-08-31T04:04:34.532 DEBUG:teuthology.orchestra.run.smithi050:> mktemp 2024-08-31T04:04:34.553 INFO:teuthology.orchestra.run.smithi050.stdout:/tmp/tmp.Kw4NnXyTeG 2024-08-31T04:04:34.553 DEBUG:teuthology.orchestra.run.smithi050:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.Kw4NnXyTeG 2024-08-31T04:04:34.620 DEBUG:teuthology.orchestra.run.smithi050:> sudo chmod 0666 /tmp/tmp.Kw4NnXyTeG 2024-08-31T04:04:34.761 DEBUG:teuthology.orchestra.remote:smithi050:/tmp/tmp.Kw4NnXyTeG is 6KB 2024-08-31T04:04:34.810 DEBUG:teuthology.orchestra.run.smithi050:> rm -fr /tmp/tmp.Kw4NnXyTeG 2024-08-31T04:04:34.824 DEBUG:teuthology.orchestra.run.smithi050:> sudo /bin/ls /boot/loader/entries || true 2024-08-31T04:04:34.886 INFO:teuthology.orchestra.run.smithi050.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-08-31T04:04:34.886 INFO:teuthology.orchestra.run.smithi050.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-08-31T04:04:34.886 INFO:teuthology.orchestra.run.smithi050.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-08-31T04:04:34.886 INFO:teuthology.orchestra.run.smithi050.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-6.11.0-rc5-g8ad8b8b16098.conf 2024-08-31T04:04:34.887 DEBUG:teuthology.orchestra.run.smithi050:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-6.11.0-rc5-g8ad8b8b16098 2024-08-31T04:04:35.055 DEBUG:teuthology.orchestra.run.smithi050:> sudo shutdown -r now 2024-08-31T04:05:05.058 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2024-08-31T04:05:05.058 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi050.front.sepia.ceph.com' 2024-08-31T04:05:05.059 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi050.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-31T04:05:23.389 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.50 2024-08-31T04:05:32.390 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi050.front.sepia.ceph.com' 2024-08-31T04:05:32.391 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi050.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-31T04:06:32.394 DEBUG:teuthology.orchestra.remote:timed out 2024-08-31T04:06:44.395 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi050.front.sepia.ceph.com' 2024-08-31T04:06:44.396 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi050.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-31T04:06:44.798 DEBUG:teuthology.orchestra.run.smithi050:> true 2024-08-31T04:06:45.263 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi050.front.sepia.ceph.com' 2024-08-31T04:06:45.264 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.11.0-rc5-g8ad8b8b16098"... 2024-08-31T04:06:45.264 DEBUG:teuthology.orchestra.run.smithi050:> uname -r 2024-08-31T04:06:45.297 INFO:teuthology.orchestra.run.smithi050.stdout:6.11.0-rc5-g8ad8b8b16098 2024-08-31T04:06:45.298 DEBUG:teuthology.task.kernel:current kernel version is 6.11.0-rc5-g8ad8b8b16098 vs 6.11.0-rc5-g8ad8b8b16098 2024-08-31T04:06:45.298 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-08-31T04:06:45.298 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-08-31T04:06:46.299 DEBUG:teuthology.parallel:result is None 2024-08-31T04:06:46.299 INFO:teuthology.run_tasks:Running task internal.base... 2024-08-31T04:06:46.308 INFO:teuthology.task.internal:Creating test directory... 2024-08-31T04:06:46.308 DEBUG:teuthology.orchestra.run.smithi050:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-08-31T04:06:46.312 DEBUG:teuthology.orchestra.run.smithi133:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-08-31T04:06:46.315 DEBUG:teuthology.orchestra.run.smithi177:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-08-31T04:06:46.347 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-08-31T04:06:46.355 INFO:teuthology.run_tasks:Running task internal.archive... 2024-08-31T04:06:46.365 INFO:teuthology.task.internal:Creating archive directory... 2024-08-31T04:06:46.365 DEBUG:teuthology.orchestra.run.smithi050:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-08-31T04:06:46.390 DEBUG:teuthology.orchestra.run.smithi133:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-08-31T04:06:46.394 DEBUG:teuthology.orchestra.run.smithi177:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-08-31T04:06:46.512 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-08-31T04:06:46.521 INFO:teuthology.task.internal:Enabling coredump saving... 2024-08-31T04:06:46.521 DEBUG:teuthology.orchestra.run.smithi133:> test -f /run/.containerenv -o -f /.dockerenv 2024-08-31T04:06:46.538 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-31T04:06:46.538 DEBUG:teuthology.orchestra.run.smithi177:> test -f /run/.containerenv -o -f /.dockerenv 2024-08-31T04:06:46.555 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-31T04:06:46.556 DEBUG:teuthology.orchestra.run.smithi050:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-08-31T04:06:46.560 DEBUG:teuthology.orchestra.run.smithi133:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-08-31T04:06:46.580 DEBUG:teuthology.orchestra.run.smithi177:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-08-31T04:06:46.635 INFO:teuthology.orchestra.run.smithi133.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-08-31T04:06:46.639 INFO:teuthology.orchestra.run.smithi177.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-08-31T04:06:46.653 INFO:teuthology.orchestra.run.smithi133.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-08-31T04:06:46.664 INFO:teuthology.orchestra.run.smithi050.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-08-31T04:06:46.679 INFO:teuthology.orchestra.run.smithi177.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-08-31T04:06:46.695 INFO:teuthology.orchestra.run.smithi050.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-08-31T04:06:46.698 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-08-31T04:06:46.709 INFO:teuthology.task.internal:Configuring sudo... 2024-08-31T04:06:46.709 DEBUG:teuthology.orchestra.run.smithi050:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-08-31T04:06:46.713 DEBUG:teuthology.orchestra.run.smithi133:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-08-31T04:06:46.715 DEBUG:teuthology.orchestra.run.smithi177:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-08-31T04:06:46.765 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-08-31T04:06:46.776 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-08-31T04:06:46.776 DEBUG:teuthology.orchestra.run.smithi050:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-08-31T04:06:46.779 DEBUG:teuthology.orchestra.run.smithi133:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-08-31T04:06:46.783 DEBUG:teuthology.orchestra.run.smithi177:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-08-31T04:06:46.810 DEBUG:teuthology.orchestra.run.smithi050:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-08-31T04:06:46.913 DEBUG:teuthology.orchestra.run.smithi050:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-08-31T04:06:46.987 DEBUG:teuthology.orchestra.run.smithi050:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-08-31T04:06:47.050 DEBUG:teuthology.orchestra.run.smithi050:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-08-31T04:06:47.120 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-08-31T04:06:47.120 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-08-31T04:06:47.175 DEBUG:teuthology.orchestra.run.smithi133:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-08-31T04:06:47.221 DEBUG:teuthology.orchestra.run.smithi133:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-08-31T04:06:47.280 DEBUG:teuthology.orchestra.run.smithi133:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-08-31T04:06:47.360 DEBUG:teuthology.orchestra.run.smithi133:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-08-31T04:06:47.408 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2024-08-31T04:06:47.408 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-08-31T04:06:47.476 DEBUG:teuthology.orchestra.run.smithi177:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-08-31T04:06:47.518 DEBUG:teuthology.orchestra.run.smithi177:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-08-31T04:06:47.580 DEBUG:teuthology.orchestra.run.smithi177:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-08-31T04:06:47.664 DEBUG:teuthology.orchestra.run.smithi177:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-08-31T04:06:47.708 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2024-08-31T04:06:47.708 DEBUG:teuthology.orchestra.run.smithi177:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-08-31T04:06:47.775 DEBUG:teuthology.orchestra.run.smithi050:> sudo service rsyslog restart 2024-08-31T04:06:47.779 DEBUG:teuthology.orchestra.run.smithi133:> sudo service rsyslog restart 2024-08-31T04:06:47.782 DEBUG:teuthology.orchestra.run.smithi177:> sudo service rsyslog restart 2024-08-31T04:06:47.817 INFO:teuthology.orchestra.run.smithi133.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-08-31T04:06:47.858 INFO:teuthology.orchestra.run.smithi050.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-08-31T04:06:47.862 INFO:teuthology.orchestra.run.smithi177.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-08-31T04:06:48.325 INFO:teuthology.run_tasks:Running task internal.timer... 2024-08-31T04:06:48.333 INFO:teuthology.task.internal:Starting timer... 2024-08-31T04:06:48.333 INFO:teuthology.run_tasks:Running task pcp... 2024-08-31T04:06:48.391 INFO:teuthology.run_tasks:Running task selinux... 2024-08-31T04:06:48.400 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:logrotate_t:s0']} 2024-08-31T04:06:48.401 DEBUG:teuthology.orchestra.run.smithi050:> sudo service auditd rotate 2024-08-31T04:06:48.479 INFO:teuthology.orchestra.run.smithi050.stdout:Rotating logs: 2024-08-31T04:06:48.483 DEBUG:teuthology.orchestra.run.smithi133:> sudo service auditd rotate 2024-08-31T04:06:48.556 INFO:teuthology.orchestra.run.smithi133.stdout:Rotating logs: 2024-08-31T04:06:48.558 DEBUG:teuthology.orchestra.run.smithi177:> sudo service auditd rotate 2024-08-31T04:06:48.640 INFO:teuthology.orchestra.run.smithi177.stdout:Rotating logs: 2024-08-31T04:06:48.642 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-08-31T04:06:48.642 DEBUG:teuthology.orchestra.run.smithi050:> /usr/sbin/getenforce 2024-08-31T04:06:48.686 INFO:teuthology.orchestra.run.smithi050.stdout:Permissive 2024-08-31T04:06:48.686 DEBUG:teuthology.orchestra.run.smithi133:> /usr/sbin/getenforce 2024-08-31T04:06:48.713 INFO:teuthology.orchestra.run.smithi133.stdout:Permissive 2024-08-31T04:06:48.713 DEBUG:teuthology.orchestra.run.smithi177:> /usr/sbin/getenforce 2024-08-31T04:06:48.740 INFO:teuthology.orchestra.run.smithi177.stdout:Permissive 2024-08-31T04:06:48.740 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi050.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi133.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi177.front.sepia.ceph.com': 'permissive'} 2024-08-31T04:06:48.740 DEBUG:teuthology.orchestra.run.smithi050:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-08-31T04:06:48.798 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-31T04:06:48.799 DEBUG:teuthology.orchestra.run.smithi133:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-08-31T04:06:48.829 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-31T04:06:48.829 DEBUG:teuthology.orchestra.run.smithi177:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-08-31T04:06:48.859 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-31T04:06:48.859 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-08-31T04:06:48.859 DEBUG:teuthology.orchestra.run.smithi050:> sudo /usr/sbin/setenforce permissive 2024-08-31T04:06:48.927 DEBUG:teuthology.orchestra.run.smithi133:> sudo /usr/sbin/setenforce permissive 2024-08-31T04:06:48.967 DEBUG:teuthology.orchestra.run.smithi177:> sudo /usr/sbin/setenforce permissive 2024-08-31T04:06:48.996 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-08-31T04:06:49.005 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-08-31T04:06:49.008 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-08-31T04:06:49.117 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-08-31T04:06:49.128 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-08-31T04:06:49.129 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi050.front.sepia.ceph.com,smithi133.front.sepia.ceph.com,smithi177.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-08-31T04:08:56.146 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi050.front.sepia.ceph.com'), Remote(name='ubuntu@smithi133.front.sepia.ceph.com'), Remote(name='ubuntu@smithi177.front.sepia.ceph.com')] 2024-08-31T04:08:56.147 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi050.front.sepia.ceph.com' 2024-08-31T04:08:56.148 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi050.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-31T04:08:56.238 DEBUG:teuthology.orchestra.run.smithi050:> true 2024-08-31T04:08:56.355 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi050.front.sepia.ceph.com' 2024-08-31T04:08:56.356 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi133.front.sepia.ceph.com' 2024-08-31T04:08:56.356 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-31T04:08:56.432 DEBUG:teuthology.orchestra.run.smithi133:> true 2024-08-31T04:08:56.509 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi133.front.sepia.ceph.com' 2024-08-31T04:08:56.510 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi177.front.sepia.ceph.com' 2024-08-31T04:08:56.510 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi177.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-31T04:08:56.587 DEBUG:teuthology.orchestra.run.smithi177:> true 2024-08-31T04:08:56.671 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi177.front.sepia.ceph.com' 2024-08-31T04:08:56.671 INFO:teuthology.run_tasks:Running task clock... 2024-08-31T04:08:56.682 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-08-31T04:08:56.682 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-08-31T04:08:56.683 DEBUG:teuthology.orchestra.run.smithi050:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-08-31T04:08:56.687 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-08-31T04:08:56.687 DEBUG:teuthology.orchestra.run.smithi133:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-08-31T04:08:56.690 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-08-31T04:08:56.690 DEBUG:teuthology.orchestra.run.smithi177:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-08-31T04:08:56.719 INFO:teuthology.orchestra.run.smithi133.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-08-31T04:08:56.734 INFO:teuthology.orchestra.run.smithi133.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-08-31T04:08:56.745 INFO:teuthology.orchestra.run.smithi177.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-08-31T04:08:56.745 INFO:teuthology.orchestra.run.smithi050.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-08-31T04:08:56.760 INFO:teuthology.orchestra.run.smithi133.stderr:sudo: ntpd: command not found 2024-08-31T04:08:56.761 INFO:teuthology.orchestra.run.smithi177.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-08-31T04:08:56.770 INFO:teuthology.orchestra.run.smithi133.stdout:506 Cannot talk to daemon 2024-08-31T04:08:56.775 INFO:teuthology.orchestra.run.smithi050.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-08-31T04:08:56.785 INFO:teuthology.orchestra.run.smithi133.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-08-31T04:08:56.787 INFO:teuthology.orchestra.run.smithi177.stderr:sudo: ntpd: command not found 2024-08-31T04:08:56.799 INFO:teuthology.orchestra.run.smithi177.stdout:506 Cannot talk to daemon 2024-08-31T04:08:56.799 INFO:teuthology.orchestra.run.smithi133.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-08-31T04:08:56.814 INFO:teuthology.orchestra.run.smithi177.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-08-31T04:08:56.826 INFO:teuthology.orchestra.run.smithi050.stderr:sudo: ntpd: command not found 2024-08-31T04:08:56.828 INFO:teuthology.orchestra.run.smithi177.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-08-31T04:08:56.851 INFO:teuthology.orchestra.run.smithi050.stdout:506 Cannot talk to daemon 2024-08-31T04:08:56.865 INFO:teuthology.orchestra.run.smithi133.stderr:bash: line 1: ntpq: command not found 2024-08-31T04:08:56.869 INFO:teuthology.orchestra.run.smithi133.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-08-31T04:08:56.869 INFO:teuthology.orchestra.run.smithi133.stdout:=============================================================================== 2024-08-31T04:08:56.869 INFO:teuthology.orchestra.run.smithi133.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-08-31T04:08:56.869 INFO:teuthology.orchestra.run.smithi133.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-08-31T04:08:56.869 INFO:teuthology.orchestra.run.smithi133.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-08-31T04:08:56.870 INFO:teuthology.orchestra.run.smithi133.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-08-31T04:08:56.881 INFO:teuthology.orchestra.run.smithi050.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-08-31T04:08:56.887 INFO:teuthology.orchestra.run.smithi177.stderr:bash: line 1: ntpq: command not found 2024-08-31T04:08:56.890 INFO:teuthology.orchestra.run.smithi177.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-08-31T04:08:56.890 INFO:teuthology.orchestra.run.smithi177.stdout:=============================================================================== 2024-08-31T04:08:56.890 INFO:teuthology.orchestra.run.smithi177.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-08-31T04:08:56.891 INFO:teuthology.orchestra.run.smithi177.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-08-31T04:08:56.891 INFO:teuthology.orchestra.run.smithi177.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-08-31T04:08:56.891 INFO:teuthology.orchestra.run.smithi177.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-08-31T04:08:56.911 INFO:teuthology.orchestra.run.smithi050.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-08-31T04:08:57.004 INFO:teuthology.orchestra.run.smithi050.stderr:bash: line 1: ntpq: command not found 2024-08-31T04:08:57.011 INFO:teuthology.orchestra.run.smithi050.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-08-31T04:08:57.011 INFO:teuthology.orchestra.run.smithi050.stdout:=============================================================================== 2024-08-31T04:08:57.011 INFO:teuthology.orchestra.run.smithi050.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-08-31T04:08:57.011 INFO:teuthology.orchestra.run.smithi050.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-08-31T04:08:57.011 INFO:teuthology.orchestra.run.smithi050.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-08-31T04:08:57.011 INFO:teuthology.orchestra.run.smithi050.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-08-31T04:08:57.012 INFO:teuthology.run_tasks:Running task install... 2024-08-31T04:08:57.022 DEBUG:teuthology.task.install:project ceph 2024-08-31T04:08:57.022 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'd19e6118f7015f0047264006cb0c873528eb3ae6'}} 2024-08-31T04:08:57.022 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'd19e6118f7015f0047264006cb0c873528eb3ae6'} 2024-08-31T04:08:57.022 INFO:teuthology.task.install:Using flavor: default 2024-08-31T04:08:57.028 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-08-31T04:08:57.028 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-08-31T04:08:57.028 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'd19e6118f7015f0047264006cb0c873528eb3ae6', 'tag': None, 'wait_for_package': False} 2024-08-31T04:08:57.029 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=d19e6118f7015f0047264006cb0c873528eb3ae6 2024-08-31T04:08:57.031 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'd19e6118f7015f0047264006cb0c873528eb3ae6', 'tag': None, 'wait_for_package': False} 2024-08-31T04:08:57.031 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=d19e6118f7015f0047264006cb0c873528eb3ae6 2024-08-31T04:08:57.032 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'd19e6118f7015f0047264006cb0c873528eb3ae6', 'tag': None, 'wait_for_package': False} 2024-08-31T04:08:57.032 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=d19e6118f7015f0047264006cb0c873528eb3ae6 2024-08-31T04:08:57.179 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-mchangir-testing-20240828.085847-main-debug/d19e6118f7015f0047264006cb0c873528eb3ae6/centos/9/flavors/default/ 2024-08-31T04:08:57.179 INFO:teuthology.task.install.rpm:Package version is 19.3.0-4560.gd19e6118 2024-08-31T04:08:57.182 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-mchangir-testing-20240828.085847-main-debug/d19e6118f7015f0047264006cb0c873528eb3ae6/centos/9/flavors/default/ 2024-08-31T04:08:57.183 INFO:teuthology.task.install.rpm:Package version is 19.3.0-4560.gd19e6118 2024-08-31T04:08:57.185 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-mchangir-testing-20240828.085847-main-debug/d19e6118f7015f0047264006cb0c873528eb3ae6/centos/9/flavors/default/ 2024-08-31T04:08:57.186 INFO:teuthology.task.install.rpm:Package version is 19.3.0-4560.gd19e6118 2024-08-31T04:08:57.289 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-mchangir-testing-20240828.085847-main-debug/d19e6118f7015f0047264006cb0c873528eb3ae6/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-mchangir-testing-20240828.085847-main-debug/d19e6118f7015f0047264006cb0c873528eb3ae6/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-mchangir-testing-20240828.085847-main-debug/d19e6118f7015f0047264006cb0c873528eb3ae6/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-08-31T04:08:57.289 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-08-31T04:08:57.289 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-08-31T04:08:57.295 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-mchangir-testing-20240828.085847-main-debug/d19e6118f7015f0047264006cb0c873528eb3ae6/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-mchangir-testing-20240828.085847-main-debug/d19e6118f7015f0047264006cb0c873528eb3ae6/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-mchangir-testing-20240828.085847-main-debug/d19e6118f7015f0047264006cb0c873528eb3ae6/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-08-31T04:08:57.295 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2024-08-31T04:08:57.295 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-08-31T04:08:57.299 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-mchangir-testing-20240828.085847-main-debug/d19e6118f7015f0047264006cb0c873528eb3ae6/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-mchangir-testing-20240828.085847-main-debug/d19e6118f7015f0047264006cb0c873528eb3ae6/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-mchangir-testing-20240828.085847-main-debug/d19e6118f7015f0047264006cb0c873528eb3ae6/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-08-31T04:08:57.300 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2024-08-31T04:08:57.300 DEBUG:teuthology.orchestra.run.smithi177:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-08-31T04:08:57.323 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-08-31T04:08:57.323 DEBUG:teuthology.orchestra.run.smithi133:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/d19e6118f7015f0047264006cb0c873528eb3ae6/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-08-31T04:08:57.326 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-08-31T04:08:57.326 DEBUG:teuthology.orchestra.run.smithi177:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/d19e6118f7015f0047264006cb0c873528eb3ae6/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-08-31T04:08:57.346 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-08-31T04:08:57.346 DEBUG:teuthology.orchestra.run.smithi050:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/d19e6118f7015f0047264006cb0c873528eb3ae6/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-08-31T04:08:57.390 DEBUG:teuthology.orchestra.run.smithi133:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-08-31T04:08:57.392 DEBUG:teuthology.orchestra.run.smithi177:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-08-31T04:08:57.444 DEBUG:teuthology.orchestra.run.smithi050:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-08-31T04:08:57.466 DEBUG:teuthology.orchestra.run.smithi133:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-08-31T04:08:57.467 DEBUG:teuthology.orchestra.run.smithi177:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-08-31T04:08:57.523 DEBUG:teuthology.orchestra.run.smithi050:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-08-31T04:08:57.531 INFO:teuthology.orchestra.run.smithi177.stdout:check_obsoletes = 1 2024-08-31T04:08:57.531 INFO:teuthology.orchestra.run.smithi133.stdout:check_obsoletes = 1 2024-08-31T04:08:57.532 DEBUG:teuthology.orchestra.run.smithi177:> sudo yum clean all 2024-08-31T04:08:57.536 DEBUG:teuthology.orchestra.run.smithi133:> sudo yum clean all 2024-08-31T04:08:57.579 INFO:teuthology.orchestra.run.smithi050.stdout:check_obsoletes = 1 2024-08-31T04:08:57.582 DEBUG:teuthology.orchestra.run.smithi050:> sudo yum clean all 2024-08-31T04:08:57.757 INFO:teuthology.orchestra.run.smithi177.stdout:45 files removed 2024-08-31T04:08:57.760 INFO:teuthology.orchestra.run.smithi133.stdout:45 files removed 2024-08-31T04:08:57.784 DEBUG:teuthology.orchestra.run.smithi177:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-08-31T04:08:57.788 DEBUG:teuthology.orchestra.run.smithi133:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-08-31T04:08:57.859 INFO:teuthology.orchestra.run.smithi050.stdout:45 files removed 2024-08-31T04:08:57.892 DEBUG:teuthology.orchestra.run.smithi050:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-08-31T04:08:58.325 INFO:teuthology.orchestra.run.smithi177.stdout:ceph packages for x86_64 317 kB/s | 84 kB 00:00 2024-08-31T04:08:58.331 INFO:teuthology.orchestra.run.smithi133.stdout:ceph packages for x86_64 315 kB/s | 84 kB 00:00 2024-08-31T04:08:58.578 INFO:teuthology.orchestra.run.smithi050.stdout:ceph packages for x86_64 302 kB/s | 84 kB 00:00 2024-08-31T04:08:58.601 INFO:teuthology.orchestra.run.smithi177.stdout:ceph noarch packages 104 kB/s | 24 kB 00:00 2024-08-31T04:08:58.623 INFO:teuthology.orchestra.run.smithi133.stdout:ceph noarch packages 97 kB/s | 24 kB 00:00 2024-08-31T04:08:58.885 INFO:teuthology.orchestra.run.smithi177.stdout:ceph source packages 7.8 kB/s | 1.9 kB 00:00 2024-08-31T04:08:58.897 INFO:teuthology.orchestra.run.smithi050.stdout:ceph noarch packages 89 kB/s | 24 kB 00:00 2024-08-31T04:08:58.899 INFO:teuthology.orchestra.run.smithi133.stdout:ceph source packages 8.1 kB/s | 1.9 kB 00:00 2024-08-31T04:08:59.188 INFO:teuthology.orchestra.run.smithi050.stdout:ceph source packages 7.9 kB/s | 1.9 kB 00:00 2024-08-31T04:08:59.369 INFO:teuthology.orchestra.run.smithi177.stdout:CentOS Stream 9 - BaseOS 18 MB/s | 8.2 MB 00:00 2024-08-31T04:09:00.266 INFO:teuthology.orchestra.run.smithi133.stdout:CentOS Stream 9 - BaseOS 6.2 MB/s | 8.2 MB 00:01 2024-08-31T04:09:00.763 INFO:teuthology.orchestra.run.smithi050.stdout:CentOS Stream 9 - BaseOS 5.4 MB/s | 8.2 MB 00:01 2024-08-31T04:09:02.192 INFO:teuthology.orchestra.run.smithi133.stdout:CentOS Stream 9 - AppStream 25 MB/s | 20 MB 00:00 2024-08-31T04:09:02.678 INFO:teuthology.orchestra.run.smithi177.stdout:CentOS Stream 9 - AppStream 9.2 MB/s | 20 MB 00:02 2024-08-31T04:09:02.789 INFO:teuthology.orchestra.run.smithi050.stdout:CentOS Stream 9 - AppStream 26 MB/s | 20 MB 00:00 2024-08-31T04:09:06.651 INFO:teuthology.orchestra.run.smithi133.stdout:CentOS Stream 9 - CRB 11 MB/s | 6.6 MB 00:00 2024-08-31T04:09:07.431 INFO:teuthology.orchestra.run.smithi177.stdout:CentOS Stream 9 - CRB 7.2 MB/s | 6.6 MB 00:00 2024-08-31T04:09:07.782 INFO:teuthology.orchestra.run.smithi050.stdout:CentOS Stream 9 - CRB 7.9 MB/s | 6.6 MB 00:00 2024-08-31T04:09:08.194 INFO:teuthology.orchestra.run.smithi133.stdout:CentOS Stream 9 - Extras packages 58 kB/s | 18 kB 00:00 2024-08-31T04:09:09.129 INFO:teuthology.orchestra.run.smithi177.stdout:CentOS Stream 9 - Extras packages 39 kB/s | 18 kB 00:00 2024-08-31T04:09:09.131 INFO:teuthology.orchestra.run.smithi133.stdout:Extra Packages for Enterprise Linux 28 MB/s | 22 MB 00:00 2024-08-31T04:09:09.416 INFO:teuthology.orchestra.run.smithi050.stdout:CentOS Stream 9 - Extras packages 58 kB/s | 18 kB 00:00 2024-08-31T04:09:09.925 INFO:teuthology.orchestra.run.smithi177.stdout:Extra Packages for Enterprise Linux 33 MB/s | 22 MB 00:00 2024-08-31T04:09:10.329 INFO:teuthology.orchestra.run.smithi050.stdout:Extra Packages for Enterprise Linux 29 MB/s | 22 MB 00:00 2024-08-31T04:09:14.587 INFO:teuthology.orchestra.run.smithi133.stdout:lab-extras 29 kB/s | 1.7 kB 00:00 2024-08-31T04:09:15.422 INFO:teuthology.orchestra.run.smithi177.stdout:lab-extras 30 kB/s | 1.7 kB 00:00 2024-08-31T04:09:16.868 INFO:teuthology.orchestra.run.smithi050.stdout:lab-extras 35 kB/s | 1.7 kB 00:00 2024-08-31T04:09:16.889 INFO:teuthology.orchestra.run.smithi133.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-08-31T04:09:16.889 INFO:teuthology.orchestra.run.smithi133.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-08-31T04:09:16.901 INFO:teuthology.orchestra.run.smithi133.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-08-31T04:09:16.902 INFO:teuthology.orchestra.run.smithi133.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-08-31T04:09:16.902 INFO:teuthology.orchestra.run.smithi133.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-08-31T04:09:16.903 INFO:teuthology.orchestra.run.smithi133.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-08-31T04:09:16.905 INFO:teuthology.orchestra.run.smithi133.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-08-31T04:09:16.907 INFO:teuthology.orchestra.run.smithi133.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-08-31T04:09:16.908 INFO:teuthology.orchestra.run.smithi133.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-08-31T04:09:16.969 INFO:teuthology.orchestra.run.smithi133.stdout:Dependencies resolved. 2024-08-31T04:09:16.991 INFO:teuthology.orchestra.run.smithi133.stdout:======================================================================================= 2024-08-31T04:09:16.991 INFO:teuthology.orchestra.run.smithi133.stdout: Package Arch Version Repository Size 2024-08-31T04:09:16.992 INFO:teuthology.orchestra.run.smithi133.stdout:======================================================================================= 2024-08-31T04:09:16.992 INFO:teuthology.orchestra.run.smithi133.stdout:Installing: 2024-08-31T04:09:16.992 INFO:teuthology.orchestra.run.smithi133.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-08-31T04:09:16.992 INFO:teuthology.orchestra.run.smithi133.stdout: ceph x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 6.6 k 2024-08-31T04:09:16.992 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-base x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 5.5 M 2024-08-31T04:09:16.992 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-fuse x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 874 k 2024-08-31T04:09:16.992 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-immutable-object-cache x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 148 k 2024-08-31T04:09:16.992 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-mgr x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 1.5 M 2024-08-31T04:09:16.992 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-mgr-cephadm noarch 2:19.3.0-4560.gd19e6118.el9 ceph-noarch 154 k 2024-08-31T04:09:16.992 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-mgr-dashboard noarch 2:19.3.0-4560.gd19e6118.el9 ceph-noarch 14 M 2024-08-31T04:09:16.992 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-mgr-diskprediction-local noarch 2:19.3.0-4560.gd19e6118.el9 ceph-noarch 7.4 M 2024-08-31T04:09:16.992 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-mgr-rook noarch 2:19.3.0-4560.gd19e6118.el9 ceph-noarch 49 k 2024-08-31T04:09:16.993 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-radosgw x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 10 M 2024-08-31T04:09:16.993 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-test x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 44 M 2024-08-31T04:09:16.993 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-volume noarch 2:19.3.0-4560.gd19e6118.el9 ceph-noarch 285 k 2024-08-31T04:09:16.993 INFO:teuthology.orchestra.run.smithi133.stdout: cephadm noarch 2:19.3.0-4560.gd19e6118.el9 ceph-noarch 781 k 2024-08-31T04:09:16.993 INFO:teuthology.orchestra.run.smithi133.stdout: cephfs-mirror x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 226 k 2024-08-31T04:09:16.993 INFO:teuthology.orchestra.run.smithi133.stdout: cephfs-shell x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 27 k 2024-08-31T04:09:16.993 INFO:teuthology.orchestra.run.smithi133.stdout: cephfs-top noarch 2:19.3.0-4560.gd19e6118.el9 ceph-noarch 18 k 2024-08-31T04:09:16.993 INFO:teuthology.orchestra.run.smithi133.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-08-31T04:09:16.993 INFO:teuthology.orchestra.run.smithi133.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-08-31T04:09:16.993 INFO:teuthology.orchestra.run.smithi133.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-08-31T04:09:16.993 INFO:teuthology.orchestra.run.smithi133.stdout: libcephfs-devel x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 32 k 2024-08-31T04:09:16.994 INFO:teuthology.orchestra.run.smithi133.stdout: libcephfs2 x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 766 k 2024-08-31T04:09:16.994 INFO:teuthology.orchestra.run.smithi133.stdout: librados-devel x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 127 k 2024-08-31T04:09:16.994 INFO:teuthology.orchestra.run.smithi133.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-08-31T04:09:16.994 INFO:teuthology.orchestra.run.smithi133.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-08-31T04:09:16.994 INFO:teuthology.orchestra.run.smithi133.stdout: openssl-devel x86_64 1:3.2.2-4.el9 appstream 4.4 M 2024-08-31T04:09:16.994 INFO:teuthology.orchestra.run.smithi133.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-08-31T04:09:16.994 INFO:teuthology.orchestra.run.smithi133.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-08-31T04:09:16.994 INFO:teuthology.orchestra.run.smithi133.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-08-31T04:09:16.994 INFO:teuthology.orchestra.run.smithi133.stdout: python3-cephfs x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 161 k 2024-08-31T04:09:16.994 INFO:teuthology.orchestra.run.smithi133.stdout: python3-rados x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 321 k 2024-08-31T04:09:16.994 INFO:teuthology.orchestra.run.smithi133.stdout: python3-rbd x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 305 k 2024-08-31T04:09:16.994 INFO:teuthology.orchestra.run.smithi133.stdout: python3-rgw x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 99 k 2024-08-31T04:09:16.995 INFO:teuthology.orchestra.run.smithi133.stdout: rbd-fuse x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 86 k 2024-08-31T04:09:16.995 INFO:teuthology.orchestra.run.smithi133.stdout: rbd-mirror x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 3.1 M 2024-08-31T04:09:16.995 INFO:teuthology.orchestra.run.smithi133.stdout: rbd-nbd x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 170 k 2024-08-31T04:09:16.995 INFO:teuthology.orchestra.run.smithi133.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-08-31T04:09:16.995 INFO:teuthology.orchestra.run.smithi133.stdout:Upgrading: 2024-08-31T04:09:16.995 INFO:teuthology.orchestra.run.smithi133.stdout: librados2 x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 3.4 M 2024-08-31T04:09:16.995 INFO:teuthology.orchestra.run.smithi133.stdout: librbd1 x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 3.1 M 2024-08-31T04:09:16.995 INFO:teuthology.orchestra.run.smithi133.stdout:Installing dependencies: 2024-08-31T04:09:16.995 INFO:teuthology.orchestra.run.smithi133.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-08-31T04:09:16.995 INFO:teuthology.orchestra.run.smithi133.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-08-31T04:09:16.995 INFO:teuthology.orchestra.run.smithi133.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-08-31T04:09:16.995 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-common x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 20 M 2024-08-31T04:09:16.995 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-grafana-dashboards noarch 2:19.3.0-4560.gd19e6118.el9 ceph-noarch 34 k 2024-08-31T04:09:16.996 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-mds x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 2.3 M 2024-08-31T04:09:16.996 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-mgr-modules-core noarch 2:19.3.0-4560.gd19e6118.el9 ceph-noarch 290 k 2024-08-31T04:09:16.996 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-mon x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 4.9 M 2024-08-31T04:09:16.996 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-osd x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 18 M 2024-08-31T04:09:16.996 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-prometheus-alerts noarch 2:19.3.0-4560.gd19e6118.el9 ceph-noarch 16 k 2024-08-31T04:09:16.996 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-selinux x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 25 k 2024-08-31T04:09:16.996 INFO:teuthology.orchestra.run.smithi133.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-08-31T04:09:16.996 INFO:teuthology.orchestra.run.smithi133.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-08-31T04:09:16.996 INFO:teuthology.orchestra.run.smithi133.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-08-31T04:09:16.996 INFO:teuthology.orchestra.run.smithi133.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-08-31T04:09:16.996 INFO:teuthology.orchestra.run.smithi133.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-08-31T04:09:16.996 INFO:teuthology.orchestra.run.smithi133.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-08-31T04:09:16.997 INFO:teuthology.orchestra.run.smithi133.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-08-31T04:09:16.997 INFO:teuthology.orchestra.run.smithi133.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-08-31T04:09:16.997 INFO:teuthology.orchestra.run.smithi133.stdout: libcephsqlite x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 159 k 2024-08-31T04:09:16.997 INFO:teuthology.orchestra.run.smithi133.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-08-31T04:09:16.997 INFO:teuthology.orchestra.run.smithi133.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-08-31T04:09:16.997 INFO:teuthology.orchestra.run.smithi133.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-08-31T04:09:16.997 INFO:teuthology.orchestra.run.smithi133.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-08-31T04:09:16.997 INFO:teuthology.orchestra.run.smithi133.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-08-31T04:09:16.997 INFO:teuthology.orchestra.run.smithi133.stdout: libradosstriper1 x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 506 k 2024-08-31T04:09:16.997 INFO:teuthology.orchestra.run.smithi133.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-08-31T04:09:16.997 INFO:teuthology.orchestra.run.smithi133.stdout: librgw2 x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 5.3 M 2024-08-31T04:09:16.997 INFO:teuthology.orchestra.run.smithi133.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-08-31T04:09:16.997 INFO:teuthology.orchestra.run.smithi133.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-08-31T04:09:16.998 INFO:teuthology.orchestra.run.smithi133.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-08-31T04:09:16.998 INFO:teuthology.orchestra.run.smithi133.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-08-31T04:09:16.998 INFO:teuthology.orchestra.run.smithi133.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-08-31T04:09:16.998 INFO:teuthology.orchestra.run.smithi133.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-08-31T04:09:16.998 INFO:teuthology.orchestra.run.smithi133.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-08-31T04:09:16.998 INFO:teuthology.orchestra.run.smithi133.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-08-31T04:09:16.998 INFO:teuthology.orchestra.run.smithi133.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-08-31T04:09:16.998 INFO:teuthology.orchestra.run.smithi133.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-08-31T04:09:16.998 INFO:teuthology.orchestra.run.smithi133.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-08-31T04:09:16.998 INFO:teuthology.orchestra.run.smithi133.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-08-31T04:09:16.998 INFO:teuthology.orchestra.run.smithi133.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-08-31T04:09:16.998 INFO:teuthology.orchestra.run.smithi133.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-08-31T04:09:16.998 INFO:teuthology.orchestra.run.smithi133.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-08-31T04:09:16.999 INFO:teuthology.orchestra.run.smithi133.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-08-31T04:09:16.999 INFO:teuthology.orchestra.run.smithi133.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-08-31T04:09:16.999 INFO:teuthology.orchestra.run.smithi133.stdout: python3-ceph-argparse x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 45 k 2024-08-31T04:09:16.999 INFO:teuthology.orchestra.run.smithi133.stdout: python3-ceph-common x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 141 k 2024-08-31T04:09:16.999 INFO:teuthology.orchestra.run.smithi133.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-08-31T04:09:16.999 INFO:teuthology.orchestra.run.smithi133.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-08-31T04:09:16.999 INFO:teuthology.orchestra.run.smithi133.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-08-31T04:09:16.999 INFO:teuthology.orchestra.run.smithi133.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-08-31T04:09:16.999 INFO:teuthology.orchestra.run.smithi133.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-08-31T04:09:16.999 INFO:teuthology.orchestra.run.smithi133.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-08-31T04:09:16.999 INFO:teuthology.orchestra.run.smithi133.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-08-31T04:09:16.999 INFO:teuthology.orchestra.run.smithi133.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-08-31T04:09:16.999 INFO:teuthology.orchestra.run.smithi133.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-08-31T04:09:16.999 INFO:teuthology.orchestra.run.smithi133.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-08-31T04:09:17.000 INFO:teuthology.orchestra.run.smithi133.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-08-31T04:09:17.000 INFO:teuthology.orchestra.run.smithi133.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-08-31T04:09:17.000 INFO:teuthology.orchestra.run.smithi133.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-08-31T04:09:17.000 INFO:teuthology.orchestra.run.smithi133.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-08-31T04:09:17.000 INFO:teuthology.orchestra.run.smithi133.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-08-31T04:09:17.000 INFO:teuthology.orchestra.run.smithi133.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-08-31T04:09:17.000 INFO:teuthology.orchestra.run.smithi133.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-08-31T04:09:17.000 INFO:teuthology.orchestra.run.smithi133.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-08-31T04:09:17.000 INFO:teuthology.orchestra.run.smithi133.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-08-31T04:09:17.000 INFO:teuthology.orchestra.run.smithi133.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-08-31T04:09:17.000 INFO:teuthology.orchestra.run.smithi133.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-08-31T04:09:17.000 INFO:teuthology.orchestra.run.smithi133.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-08-31T04:09:17.000 INFO:teuthology.orchestra.run.smithi133.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-08-31T04:09:17.001 INFO:teuthology.orchestra.run.smithi133.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-08-31T04:09:17.001 INFO:teuthology.orchestra.run.smithi133.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-08-31T04:09:17.001 INFO:teuthology.orchestra.run.smithi133.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-08-31T04:09:17.001 INFO:teuthology.orchestra.run.smithi133.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-08-31T04:09:17.001 INFO:teuthology.orchestra.run.smithi133.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-08-31T04:09:17.001 INFO:teuthology.orchestra.run.smithi133.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-08-31T04:09:17.001 INFO:teuthology.orchestra.run.smithi133.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-08-31T04:09:17.001 INFO:teuthology.orchestra.run.smithi133.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-08-31T04:09:17.001 INFO:teuthology.orchestra.run.smithi133.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-08-31T04:09:17.001 INFO:teuthology.orchestra.run.smithi133.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-08-31T04:09:17.001 INFO:teuthology.orchestra.run.smithi133.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-08-31T04:09:17.001 INFO:teuthology.orchestra.run.smithi133.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-08-31T04:09:17.001 INFO:teuthology.orchestra.run.smithi133.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-08-31T04:09:17.002 INFO:teuthology.orchestra.run.smithi133.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-08-31T04:09:17.002 INFO:teuthology.orchestra.run.smithi133.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-08-31T04:09:17.002 INFO:teuthology.orchestra.run.smithi133.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-08-31T04:09:17.002 INFO:teuthology.orchestra.run.smithi133.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-08-31T04:09:17.002 INFO:teuthology.orchestra.run.smithi133.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-08-31T04:09:17.002 INFO:teuthology.orchestra.run.smithi133.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-08-31T04:09:17.002 INFO:teuthology.orchestra.run.smithi133.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-08-31T04:09:17.002 INFO:teuthology.orchestra.run.smithi133.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-08-31T04:09:17.002 INFO:teuthology.orchestra.run.smithi133.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-08-31T04:09:17.002 INFO:teuthology.orchestra.run.smithi133.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-08-31T04:09:17.002 INFO:teuthology.orchestra.run.smithi133.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-08-31T04:09:17.002 INFO:teuthology.orchestra.run.smithi133.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-08-31T04:09:17.002 INFO:teuthology.orchestra.run.smithi133.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-08-31T04:09:17.003 INFO:teuthology.orchestra.run.smithi133.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-08-31T04:09:17.003 INFO:teuthology.orchestra.run.smithi133.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-08-31T04:09:17.003 INFO:teuthology.orchestra.run.smithi133.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-08-31T04:09:17.003 INFO:teuthology.orchestra.run.smithi133.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-08-31T04:09:17.003 INFO:teuthology.orchestra.run.smithi133.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-08-31T04:09:17.003 INFO:teuthology.orchestra.run.smithi133.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-08-31T04:09:17.003 INFO:teuthology.orchestra.run.smithi133.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-08-31T04:09:17.003 INFO:teuthology.orchestra.run.smithi133.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-08-31T04:09:17.003 INFO:teuthology.orchestra.run.smithi133.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-08-31T04:09:17.003 INFO:teuthology.orchestra.run.smithi133.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-08-31T04:09:17.003 INFO:teuthology.orchestra.run.smithi133.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-08-31T04:09:17.003 INFO:teuthology.orchestra.run.smithi133.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-08-31T04:09:17.003 INFO:teuthology.orchestra.run.smithi133.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-08-31T04:09:17.004 INFO:teuthology.orchestra.run.smithi133.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-08-31T04:09:17.004 INFO:teuthology.orchestra.run.smithi133.stdout:Installing weak dependencies: 2024-08-31T04:09:17.004 INFO:teuthology.orchestra.run.smithi133.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-08-31T04:09:17.004 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-08-31T04:09:17.004 INFO:teuthology.orchestra.run.smithi133.stdout:Transaction Summary 2024-08-31T04:09:17.004 INFO:teuthology.orchestra.run.smithi133.stdout:======================================================================================= 2024-08-31T04:09:17.004 INFO:teuthology.orchestra.run.smithi133.stdout:Install 148 Packages 2024-08-31T04:09:17.004 INFO:teuthology.orchestra.run.smithi133.stdout:Upgrade 2 Packages 2024-08-31T04:09:17.004 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-08-31T04:09:17.004 INFO:teuthology.orchestra.run.smithi133.stdout:Total download size: 224 M 2024-08-31T04:09:17.005 INFO:teuthology.orchestra.run.smithi133.stdout:Downloading Packages: 2024-08-31T04:09:17.718 INFO:teuthology.orchestra.run.smithi177.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-08-31T04:09:17.719 INFO:teuthology.orchestra.run.smithi177.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-08-31T04:09:17.731 INFO:teuthology.orchestra.run.smithi177.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-08-31T04:09:17.732 INFO:teuthology.orchestra.run.smithi177.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-08-31T04:09:17.733 INFO:teuthology.orchestra.run.smithi177.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-08-31T04:09:17.734 INFO:teuthology.orchestra.run.smithi177.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-08-31T04:09:17.736 INFO:teuthology.orchestra.run.smithi177.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-08-31T04:09:17.739 INFO:teuthology.orchestra.run.smithi177.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-08-31T04:09:17.740 INFO:teuthology.orchestra.run.smithi177.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-08-31T04:09:17.801 INFO:teuthology.orchestra.run.smithi177.stdout:Dependencies resolved. 2024-08-31T04:09:17.817 INFO:teuthology.orchestra.run.smithi177.stdout:======================================================================================= 2024-08-31T04:09:17.817 INFO:teuthology.orchestra.run.smithi177.stdout: Package Arch Version Repository Size 2024-08-31T04:09:17.817 INFO:teuthology.orchestra.run.smithi177.stdout:======================================================================================= 2024-08-31T04:09:17.817 INFO:teuthology.orchestra.run.smithi177.stdout:Installing: 2024-08-31T04:09:17.817 INFO:teuthology.orchestra.run.smithi177.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-08-31T04:09:17.817 INFO:teuthology.orchestra.run.smithi177.stdout: ceph x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 6.6 k 2024-08-31T04:09:17.817 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-base x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 5.5 M 2024-08-31T04:09:17.817 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-fuse x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 874 k 2024-08-31T04:09:17.818 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-immutable-object-cache x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 148 k 2024-08-31T04:09:17.818 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-mgr x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 1.5 M 2024-08-31T04:09:17.818 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-mgr-cephadm noarch 2:19.3.0-4560.gd19e6118.el9 ceph-noarch 154 k 2024-08-31T04:09:17.818 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-mgr-dashboard noarch 2:19.3.0-4560.gd19e6118.el9 ceph-noarch 14 M 2024-08-31T04:09:17.818 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-mgr-diskprediction-local noarch 2:19.3.0-4560.gd19e6118.el9 ceph-noarch 7.4 M 2024-08-31T04:09:17.818 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-mgr-rook noarch 2:19.3.0-4560.gd19e6118.el9 ceph-noarch 49 k 2024-08-31T04:09:17.818 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-radosgw x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 10 M 2024-08-31T04:09:17.818 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-test x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 44 M 2024-08-31T04:09:17.818 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-volume noarch 2:19.3.0-4560.gd19e6118.el9 ceph-noarch 285 k 2024-08-31T04:09:17.818 INFO:teuthology.orchestra.run.smithi177.stdout: cephadm noarch 2:19.3.0-4560.gd19e6118.el9 ceph-noarch 781 k 2024-08-31T04:09:17.818 INFO:teuthology.orchestra.run.smithi177.stdout: cephfs-mirror x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 226 k 2024-08-31T04:09:17.818 INFO:teuthology.orchestra.run.smithi177.stdout: cephfs-shell x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 27 k 2024-08-31T04:09:17.818 INFO:teuthology.orchestra.run.smithi177.stdout: cephfs-top noarch 2:19.3.0-4560.gd19e6118.el9 ceph-noarch 18 k 2024-08-31T04:09:17.819 INFO:teuthology.orchestra.run.smithi177.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-08-31T04:09:17.819 INFO:teuthology.orchestra.run.smithi177.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-08-31T04:09:17.819 INFO:teuthology.orchestra.run.smithi177.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-08-31T04:09:17.819 INFO:teuthology.orchestra.run.smithi177.stdout: libcephfs-devel x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 32 k 2024-08-31T04:09:17.819 INFO:teuthology.orchestra.run.smithi177.stdout: libcephfs2 x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 766 k 2024-08-31T04:09:17.819 INFO:teuthology.orchestra.run.smithi177.stdout: librados-devel x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 127 k 2024-08-31T04:09:17.819 INFO:teuthology.orchestra.run.smithi177.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-08-31T04:09:17.819 INFO:teuthology.orchestra.run.smithi177.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-08-31T04:09:17.819 INFO:teuthology.orchestra.run.smithi177.stdout: openssl-devel x86_64 1:3.2.2-4.el9 appstream 4.4 M 2024-08-31T04:09:17.819 INFO:teuthology.orchestra.run.smithi177.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-08-31T04:09:17.819 INFO:teuthology.orchestra.run.smithi177.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-08-31T04:09:17.819 INFO:teuthology.orchestra.run.smithi177.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-08-31T04:09:17.819 INFO:teuthology.orchestra.run.smithi177.stdout: python3-cephfs x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 161 k 2024-08-31T04:09:17.820 INFO:teuthology.orchestra.run.smithi177.stdout: python3-rados x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 321 k 2024-08-31T04:09:17.820 INFO:teuthology.orchestra.run.smithi177.stdout: python3-rbd x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 305 k 2024-08-31T04:09:17.820 INFO:teuthology.orchestra.run.smithi177.stdout: python3-rgw x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 99 k 2024-08-31T04:09:17.820 INFO:teuthology.orchestra.run.smithi177.stdout: rbd-fuse x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 86 k 2024-08-31T04:09:17.820 INFO:teuthology.orchestra.run.smithi177.stdout: rbd-mirror x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 3.1 M 2024-08-31T04:09:17.820 INFO:teuthology.orchestra.run.smithi177.stdout: rbd-nbd x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 170 k 2024-08-31T04:09:17.820 INFO:teuthology.orchestra.run.smithi177.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-08-31T04:09:17.820 INFO:teuthology.orchestra.run.smithi177.stdout:Upgrading: 2024-08-31T04:09:17.820 INFO:teuthology.orchestra.run.smithi177.stdout: librados2 x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 3.4 M 2024-08-31T04:09:17.820 INFO:teuthology.orchestra.run.smithi177.stdout: librbd1 x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 3.1 M 2024-08-31T04:09:17.820 INFO:teuthology.orchestra.run.smithi177.stdout:Installing dependencies: 2024-08-31T04:09:17.821 INFO:teuthology.orchestra.run.smithi177.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-08-31T04:09:17.821 INFO:teuthology.orchestra.run.smithi177.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-08-31T04:09:17.821 INFO:teuthology.orchestra.run.smithi177.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-08-31T04:09:17.821 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-common x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 20 M 2024-08-31T04:09:17.821 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-grafana-dashboards noarch 2:19.3.0-4560.gd19e6118.el9 ceph-noarch 34 k 2024-08-31T04:09:17.821 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-mds x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 2.3 M 2024-08-31T04:09:17.821 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-mgr-modules-core noarch 2:19.3.0-4560.gd19e6118.el9 ceph-noarch 290 k 2024-08-31T04:09:17.821 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-mon x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 4.9 M 2024-08-31T04:09:17.821 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-osd x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 18 M 2024-08-31T04:09:17.821 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-prometheus-alerts noarch 2:19.3.0-4560.gd19e6118.el9 ceph-noarch 16 k 2024-08-31T04:09:17.821 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-selinux x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 25 k 2024-08-31T04:09:17.821 INFO:teuthology.orchestra.run.smithi177.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-08-31T04:09:17.822 INFO:teuthology.orchestra.run.smithi177.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-08-31T04:09:17.822 INFO:teuthology.orchestra.run.smithi177.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-08-31T04:09:17.822 INFO:teuthology.orchestra.run.smithi177.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-08-31T04:09:17.822 INFO:teuthology.orchestra.run.smithi177.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-08-31T04:09:17.822 INFO:teuthology.orchestra.run.smithi177.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-08-31T04:09:17.822 INFO:teuthology.orchestra.run.smithi177.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-08-31T04:09:17.822 INFO:teuthology.orchestra.run.smithi177.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-08-31T04:09:17.822 INFO:teuthology.orchestra.run.smithi177.stdout: libcephsqlite x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 159 k 2024-08-31T04:09:17.822 INFO:teuthology.orchestra.run.smithi177.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-08-31T04:09:17.822 INFO:teuthology.orchestra.run.smithi177.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-08-31T04:09:17.822 INFO:teuthology.orchestra.run.smithi177.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-08-31T04:09:17.822 INFO:teuthology.orchestra.run.smithi177.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-08-31T04:09:17.823 INFO:teuthology.orchestra.run.smithi177.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-08-31T04:09:17.823 INFO:teuthology.orchestra.run.smithi177.stdout: libradosstriper1 x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 506 k 2024-08-31T04:09:17.823 INFO:teuthology.orchestra.run.smithi177.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-08-31T04:09:17.823 INFO:teuthology.orchestra.run.smithi177.stdout: librgw2 x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 5.3 M 2024-08-31T04:09:17.823 INFO:teuthology.orchestra.run.smithi177.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-08-31T04:09:17.823 INFO:teuthology.orchestra.run.smithi177.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-08-31T04:09:17.823 INFO:teuthology.orchestra.run.smithi177.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-08-31T04:09:17.823 INFO:teuthology.orchestra.run.smithi177.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-08-31T04:09:17.823 INFO:teuthology.orchestra.run.smithi177.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-08-31T04:09:17.823 INFO:teuthology.orchestra.run.smithi177.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-08-31T04:09:17.823 INFO:teuthology.orchestra.run.smithi177.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-08-31T04:09:17.823 INFO:teuthology.orchestra.run.smithi177.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-08-31T04:09:17.823 INFO:teuthology.orchestra.run.smithi177.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-08-31T04:09:17.823 INFO:teuthology.orchestra.run.smithi177.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-08-31T04:09:17.823 INFO:teuthology.orchestra.run.smithi177.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-08-31T04:09:17.824 INFO:teuthology.orchestra.run.smithi177.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-08-31T04:09:17.824 INFO:teuthology.orchestra.run.smithi177.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-08-31T04:09:17.824 INFO:teuthology.orchestra.run.smithi177.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-08-31T04:09:17.824 INFO:teuthology.orchestra.run.smithi177.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-08-31T04:09:17.824 INFO:teuthology.orchestra.run.smithi177.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-08-31T04:09:17.824 INFO:teuthology.orchestra.run.smithi177.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-08-31T04:09:17.824 INFO:teuthology.orchestra.run.smithi177.stdout: python3-ceph-argparse x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 45 k 2024-08-31T04:09:17.824 INFO:teuthology.orchestra.run.smithi177.stdout: python3-ceph-common x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 141 k 2024-08-31T04:09:17.824 INFO:teuthology.orchestra.run.smithi177.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-08-31T04:09:17.824 INFO:teuthology.orchestra.run.smithi177.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-08-31T04:09:17.824 INFO:teuthology.orchestra.run.smithi177.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-08-31T04:09:17.824 INFO:teuthology.orchestra.run.smithi177.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-08-31T04:09:17.824 INFO:teuthology.orchestra.run.smithi177.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-08-31T04:09:17.825 INFO:teuthology.orchestra.run.smithi177.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-08-31T04:09:17.825 INFO:teuthology.orchestra.run.smithi177.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-08-31T04:09:17.825 INFO:teuthology.orchestra.run.smithi177.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-08-31T04:09:17.825 INFO:teuthology.orchestra.run.smithi177.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-08-31T04:09:17.825 INFO:teuthology.orchestra.run.smithi177.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-08-31T04:09:17.825 INFO:teuthology.orchestra.run.smithi177.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-08-31T04:09:17.825 INFO:teuthology.orchestra.run.smithi177.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-08-31T04:09:17.825 INFO:teuthology.orchestra.run.smithi177.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-08-31T04:09:17.825 INFO:teuthology.orchestra.run.smithi177.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-08-31T04:09:17.825 INFO:teuthology.orchestra.run.smithi177.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-08-31T04:09:17.825 INFO:teuthology.orchestra.run.smithi177.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-08-31T04:09:17.825 INFO:teuthology.orchestra.run.smithi177.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-08-31T04:09:17.825 INFO:teuthology.orchestra.run.smithi177.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-08-31T04:09:17.825 INFO:teuthology.orchestra.run.smithi177.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-08-31T04:09:17.826 INFO:teuthology.orchestra.run.smithi177.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-08-31T04:09:17.826 INFO:teuthology.orchestra.run.smithi177.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-08-31T04:09:17.826 INFO:teuthology.orchestra.run.smithi177.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-08-31T04:09:17.826 INFO:teuthology.orchestra.run.smithi177.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-08-31T04:09:17.826 INFO:teuthology.orchestra.run.smithi177.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-08-31T04:09:17.826 INFO:teuthology.orchestra.run.smithi177.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-08-31T04:09:17.826 INFO:teuthology.orchestra.run.smithi177.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-08-31T04:09:17.826 INFO:teuthology.orchestra.run.smithi177.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-08-31T04:09:17.826 INFO:teuthology.orchestra.run.smithi177.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-08-31T04:09:17.827 INFO:teuthology.orchestra.run.smithi177.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-08-31T04:09:17.827 INFO:teuthology.orchestra.run.smithi177.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-08-31T04:09:17.827 INFO:teuthology.orchestra.run.smithi177.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-08-31T04:09:17.827 INFO:teuthology.orchestra.run.smithi177.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-08-31T04:09:17.827 INFO:teuthology.orchestra.run.smithi177.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-08-31T04:09:17.827 INFO:teuthology.orchestra.run.smithi177.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-08-31T04:09:17.827 INFO:teuthology.orchestra.run.smithi177.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-08-31T04:09:17.827 INFO:teuthology.orchestra.run.smithi177.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-08-31T04:09:17.827 INFO:teuthology.orchestra.run.smithi177.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-08-31T04:09:17.827 INFO:teuthology.orchestra.run.smithi177.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-08-31T04:09:17.828 INFO:teuthology.orchestra.run.smithi177.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-08-31T04:09:17.828 INFO:teuthology.orchestra.run.smithi177.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-08-31T04:09:17.828 INFO:teuthology.orchestra.run.smithi177.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-08-31T04:09:17.828 INFO:teuthology.orchestra.run.smithi177.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-08-31T04:09:17.829 INFO:teuthology.orchestra.run.smithi177.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-08-31T04:09:17.829 INFO:teuthology.orchestra.run.smithi177.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-08-31T04:09:17.829 INFO:teuthology.orchestra.run.smithi177.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-08-31T04:09:17.829 INFO:teuthology.orchestra.run.smithi177.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-08-31T04:09:17.829 INFO:teuthology.orchestra.run.smithi177.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-08-31T04:09:17.829 INFO:teuthology.orchestra.run.smithi177.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-08-31T04:09:17.829 INFO:teuthology.orchestra.run.smithi177.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-08-31T04:09:17.829 INFO:teuthology.orchestra.run.smithi177.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-08-31T04:09:17.829 INFO:teuthology.orchestra.run.smithi177.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-08-31T04:09:17.829 INFO:teuthology.orchestra.run.smithi177.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-08-31T04:09:17.829 INFO:teuthology.orchestra.run.smithi177.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-08-31T04:09:17.829 INFO:teuthology.orchestra.run.smithi177.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-08-31T04:09:17.830 INFO:teuthology.orchestra.run.smithi177.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-08-31T04:09:17.830 INFO:teuthology.orchestra.run.smithi177.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-08-31T04:09:17.830 INFO:teuthology.orchestra.run.smithi177.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-08-31T04:09:17.830 INFO:teuthology.orchestra.run.smithi177.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-08-31T04:09:17.830 INFO:teuthology.orchestra.run.smithi177.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-08-31T04:09:17.830 INFO:teuthology.orchestra.run.smithi177.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-08-31T04:09:17.830 INFO:teuthology.orchestra.run.smithi177.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-08-31T04:09:17.830 INFO:teuthology.orchestra.run.smithi177.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-08-31T04:09:17.830 INFO:teuthology.orchestra.run.smithi177.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-08-31T04:09:17.830 INFO:teuthology.orchestra.run.smithi177.stdout:Installing weak dependencies: 2024-08-31T04:09:17.831 INFO:teuthology.orchestra.run.smithi177.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-08-31T04:09:17.831 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-08-31T04:09:17.831 INFO:teuthology.orchestra.run.smithi177.stdout:Transaction Summary 2024-08-31T04:09:17.831 INFO:teuthology.orchestra.run.smithi177.stdout:======================================================================================= 2024-08-31T04:09:17.831 INFO:teuthology.orchestra.run.smithi177.stdout:Install 148 Packages 2024-08-31T04:09:17.831 INFO:teuthology.orchestra.run.smithi177.stdout:Upgrade 2 Packages 2024-08-31T04:09:17.831 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-08-31T04:09:17.832 INFO:teuthology.orchestra.run.smithi177.stdout:Total download size: 224 M 2024-08-31T04:09:17.832 INFO:teuthology.orchestra.run.smithi177.stdout:Downloading Packages: 2024-08-31T04:09:17.888 INFO:teuthology.orchestra.run.smithi133.stdout:(1/150): ceph-19.3.0-4560.gd19e6118.el9.x86_64. 47 kB/s | 6.6 kB 00:00 2024-08-31T04:09:18.105 INFO:teuthology.orchestra.run.smithi133.stdout:(2/150): ceph-fuse-19.3.0-4560.gd19e6118.el9.x8 3.9 MB/s | 874 kB 00:00 2024-08-31T04:09:18.180 INFO:teuthology.orchestra.run.smithi133.stdout:(3/150): ceph-immutable-object-cache-19.3.0-456 1.9 MB/s | 148 kB 00:00 2024-08-31T04:09:18.256 INFO:teuthology.orchestra.run.smithi133.stdout:(4/150): ceph-base-19.3.0-4560.gd19e6118.el9.x8 11 MB/s | 5.5 MB 00:00 2024-08-31T04:09:18.257 INFO:teuthology.orchestra.run.smithi177.stdout:(1/150): ceph-19.3.0-4560.gd19e6118.el9.x86_64. 35 kB/s | 6.6 kB 00:00 2024-08-31T04:09:18.381 INFO:teuthology.orchestra.run.smithi133.stdout:(5/150): ceph-mgr-19.3.0-4560.gd19e6118.el9.x86 12 MB/s | 1.5 MB 00:00 2024-08-31T04:09:18.481 INFO:teuthology.orchestra.run.smithi133.stdout:(6/150): ceph-mds-19.3.0-4560.gd19e6118.el9.x86 7.6 MB/s | 2.3 MB 00:00 2024-08-31T04:09:18.715 INFO:teuthology.orchestra.run.smithi133.stdout:(7/150): ceph-mon-19.3.0-4560.gd19e6118.el9.x86 15 MB/s | 4.9 MB 00:00 2024-08-31T04:09:18.807 INFO:teuthology.orchestra.run.smithi177.stdout:(2/150): ceph-fuse-19.3.0-4560.gd19e6118.el9.x8 1.6 MB/s | 874 kB 00:00 2024-08-31T04:09:18.890 INFO:teuthology.orchestra.run.smithi177.stdout:(3/150): ceph-immutable-object-cache-19.3.0-456 1.7 MB/s | 148 kB 00:00 2024-08-31T04:09:18.915 INFO:teuthology.orchestra.run.smithi133.stdout:(8/150): ceph-common-19.3.0-4560.gd19e6118.el9. 17 MB/s | 20 MB 00:01 2024-08-31T04:09:18.990 INFO:teuthology.orchestra.run.smithi133.stdout:(9/150): ceph-selinux-19.3.0-4560.gd19e6118.el9 336 kB/s | 25 kB 00:00 2024-08-31T04:09:19.357 INFO:teuthology.orchestra.run.smithi177.stdout:(4/150): ceph-base-19.3.0-4560.gd19e6118.el9.x8 4.3 MB/s | 5.5 MB 00:01 2024-08-31T04:09:19.365 INFO:teuthology.orchestra.run.smithi133.stdout:(10/150): ceph-radosgw-19.3.0-4560.gd19e6118.el 16 MB/s | 10 MB 00:00 2024-08-31T04:09:19.432 INFO:teuthology.orchestra.run.smithi133.stdout:(11/150): cephfs-mirror-19.3.0-4560.gd19e6118.e 3.3 MB/s | 226 kB 00:00 2024-08-31T04:09:19.481 INFO:teuthology.orchestra.run.smithi050.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-08-31T04:09:19.482 INFO:teuthology.orchestra.run.smithi050.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-08-31T04:09:19.494 INFO:teuthology.orchestra.run.smithi050.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-08-31T04:09:19.495 INFO:teuthology.orchestra.run.smithi050.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-08-31T04:09:19.495 INFO:teuthology.orchestra.run.smithi050.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-08-31T04:09:19.496 INFO:teuthology.orchestra.run.smithi050.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-08-31T04:09:19.498 INFO:teuthology.orchestra.run.smithi050.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-08-31T04:09:19.501 INFO:teuthology.orchestra.run.smithi050.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-08-31T04:09:19.501 INFO:teuthology.orchestra.run.smithi050.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-08-31T04:09:19.516 INFO:teuthology.orchestra.run.smithi133.stdout:(12/150): cephfs-shell-19.3.0-4560.gd19e6118.el 325 kB/s | 27 kB 00:00 2024-08-31T04:09:19.568 INFO:teuthology.orchestra.run.smithi050.stdout:Dependencies resolved. 2024-08-31T04:09:19.586 INFO:teuthology.orchestra.run.smithi050.stdout:======================================================================================= 2024-08-31T04:09:19.586 INFO:teuthology.orchestra.run.smithi050.stdout: Package Arch Version Repository Size 2024-08-31T04:09:19.586 INFO:teuthology.orchestra.run.smithi050.stdout:======================================================================================= 2024-08-31T04:09:19.587 INFO:teuthology.orchestra.run.smithi050.stdout:Installing: 2024-08-31T04:09:19.587 INFO:teuthology.orchestra.run.smithi050.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-08-31T04:09:19.587 INFO:teuthology.orchestra.run.smithi050.stdout: ceph x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 6.6 k 2024-08-31T04:09:19.587 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-base x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 5.5 M 2024-08-31T04:09:19.587 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-fuse x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 874 k 2024-08-31T04:09:19.587 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-immutable-object-cache x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 148 k 2024-08-31T04:09:19.587 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mgr x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 1.5 M 2024-08-31T04:09:19.587 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mgr-cephadm noarch 2:19.3.0-4560.gd19e6118.el9 ceph-noarch 154 k 2024-08-31T04:09:19.587 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mgr-dashboard noarch 2:19.3.0-4560.gd19e6118.el9 ceph-noarch 14 M 2024-08-31T04:09:19.587 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mgr-diskprediction-local noarch 2:19.3.0-4560.gd19e6118.el9 ceph-noarch 7.4 M 2024-08-31T04:09:19.587 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mgr-rook noarch 2:19.3.0-4560.gd19e6118.el9 ceph-noarch 49 k 2024-08-31T04:09:19.587 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-radosgw x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 10 M 2024-08-31T04:09:19.587 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-test x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 44 M 2024-08-31T04:09:19.587 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-volume noarch 2:19.3.0-4560.gd19e6118.el9 ceph-noarch 285 k 2024-08-31T04:09:19.588 INFO:teuthology.orchestra.run.smithi050.stdout: cephadm noarch 2:19.3.0-4560.gd19e6118.el9 ceph-noarch 781 k 2024-08-31T04:09:19.588 INFO:teuthology.orchestra.run.smithi050.stdout: cephfs-mirror x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 226 k 2024-08-31T04:09:19.588 INFO:teuthology.orchestra.run.smithi050.stdout: cephfs-shell x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 27 k 2024-08-31T04:09:19.588 INFO:teuthology.orchestra.run.smithi050.stdout: cephfs-top noarch 2:19.3.0-4560.gd19e6118.el9 ceph-noarch 18 k 2024-08-31T04:09:19.588 INFO:teuthology.orchestra.run.smithi050.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-08-31T04:09:19.588 INFO:teuthology.orchestra.run.smithi050.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-08-31T04:09:19.588 INFO:teuthology.orchestra.run.smithi050.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-08-31T04:09:19.588 INFO:teuthology.orchestra.run.smithi050.stdout: libcephfs-devel x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 32 k 2024-08-31T04:09:19.588 INFO:teuthology.orchestra.run.smithi050.stdout: libcephfs2 x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 766 k 2024-08-31T04:09:19.588 INFO:teuthology.orchestra.run.smithi050.stdout: librados-devel x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 127 k 2024-08-31T04:09:19.588 INFO:teuthology.orchestra.run.smithi050.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-08-31T04:09:19.588 INFO:teuthology.orchestra.run.smithi050.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-08-31T04:09:19.589 INFO:teuthology.orchestra.run.smithi050.stdout: openssl-devel x86_64 1:3.2.2-4.el9 appstream 4.4 M 2024-08-31T04:09:19.589 INFO:teuthology.orchestra.run.smithi050.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-08-31T04:09:19.589 INFO:teuthology.orchestra.run.smithi050.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-08-31T04:09:19.589 INFO:teuthology.orchestra.run.smithi050.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-08-31T04:09:19.589 INFO:teuthology.orchestra.run.smithi050.stdout: python3-cephfs x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 161 k 2024-08-31T04:09:19.589 INFO:teuthology.orchestra.run.smithi050.stdout: python3-rados x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 321 k 2024-08-31T04:09:19.589 INFO:teuthology.orchestra.run.smithi050.stdout: python3-rbd x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 305 k 2024-08-31T04:09:19.589 INFO:teuthology.orchestra.run.smithi050.stdout: python3-rgw x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 99 k 2024-08-31T04:09:19.589 INFO:teuthology.orchestra.run.smithi050.stdout: rbd-fuse x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 86 k 2024-08-31T04:09:19.589 INFO:teuthology.orchestra.run.smithi050.stdout: rbd-mirror x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 3.1 M 2024-08-31T04:09:19.589 INFO:teuthology.orchestra.run.smithi050.stdout: rbd-nbd x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 170 k 2024-08-31T04:09:19.589 INFO:teuthology.orchestra.run.smithi050.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-08-31T04:09:19.589 INFO:teuthology.orchestra.run.smithi050.stdout:Upgrading: 2024-08-31T04:09:19.590 INFO:teuthology.orchestra.run.smithi050.stdout: librados2 x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 3.4 M 2024-08-31T04:09:19.590 INFO:teuthology.orchestra.run.smithi050.stdout: librbd1 x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 3.1 M 2024-08-31T04:09:19.590 INFO:teuthology.orchestra.run.smithi050.stdout:Installing dependencies: 2024-08-31T04:09:19.590 INFO:teuthology.orchestra.run.smithi050.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-08-31T04:09:19.590 INFO:teuthology.orchestra.run.smithi050.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-08-31T04:09:19.590 INFO:teuthology.orchestra.run.smithi050.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-08-31T04:09:19.590 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-common x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 20 M 2024-08-31T04:09:19.590 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-grafana-dashboards noarch 2:19.3.0-4560.gd19e6118.el9 ceph-noarch 34 k 2024-08-31T04:09:19.590 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mds x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 2.3 M 2024-08-31T04:09:19.590 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mgr-modules-core noarch 2:19.3.0-4560.gd19e6118.el9 ceph-noarch 290 k 2024-08-31T04:09:19.590 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mon x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 4.9 M 2024-08-31T04:09:19.590 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-osd x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 18 M 2024-08-31T04:09:19.590 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-prometheus-alerts noarch 2:19.3.0-4560.gd19e6118.el9 ceph-noarch 16 k 2024-08-31T04:09:19.591 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-selinux x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 25 k 2024-08-31T04:09:19.591 INFO:teuthology.orchestra.run.smithi050.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-08-31T04:09:19.591 INFO:teuthology.orchestra.run.smithi050.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-08-31T04:09:19.591 INFO:teuthology.orchestra.run.smithi050.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-08-31T04:09:19.591 INFO:teuthology.orchestra.run.smithi050.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-08-31T04:09:19.591 INFO:teuthology.orchestra.run.smithi050.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-08-31T04:09:19.591 INFO:teuthology.orchestra.run.smithi050.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-08-31T04:09:19.591 INFO:teuthology.orchestra.run.smithi050.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-08-31T04:09:19.591 INFO:teuthology.orchestra.run.smithi050.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-08-31T04:09:19.591 INFO:teuthology.orchestra.run.smithi050.stdout: libcephsqlite x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 159 k 2024-08-31T04:09:19.591 INFO:teuthology.orchestra.run.smithi050.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-08-31T04:09:19.591 INFO:teuthology.orchestra.run.smithi050.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-08-31T04:09:19.591 INFO:teuthology.orchestra.run.smithi050.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-08-31T04:09:19.591 INFO:teuthology.orchestra.run.smithi050.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-08-31T04:09:19.592 INFO:teuthology.orchestra.run.smithi050.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-08-31T04:09:19.592 INFO:teuthology.orchestra.run.smithi050.stdout: libradosstriper1 x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 506 k 2024-08-31T04:09:19.592 INFO:teuthology.orchestra.run.smithi050.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-08-31T04:09:19.592 INFO:teuthology.orchestra.run.smithi050.stdout: librgw2 x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 5.3 M 2024-08-31T04:09:19.592 INFO:teuthology.orchestra.run.smithi050.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-08-31T04:09:19.592 INFO:teuthology.orchestra.run.smithi050.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-08-31T04:09:19.592 INFO:teuthology.orchestra.run.smithi050.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-08-31T04:09:19.592 INFO:teuthology.orchestra.run.smithi050.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-08-31T04:09:19.592 INFO:teuthology.orchestra.run.smithi050.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-08-31T04:09:19.592 INFO:teuthology.orchestra.run.smithi050.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-08-31T04:09:19.592 INFO:teuthology.orchestra.run.smithi050.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-08-31T04:09:19.592 INFO:teuthology.orchestra.run.smithi050.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-08-31T04:09:19.592 INFO:teuthology.orchestra.run.smithi050.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-08-31T04:09:19.592 INFO:teuthology.orchestra.run.smithi050.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-08-31T04:09:19.593 INFO:teuthology.orchestra.run.smithi050.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-08-31T04:09:19.593 INFO:teuthology.orchestra.run.smithi050.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-08-31T04:09:19.593 INFO:teuthology.orchestra.run.smithi050.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-08-31T04:09:19.593 INFO:teuthology.orchestra.run.smithi050.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-08-31T04:09:19.593 INFO:teuthology.orchestra.run.smithi050.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-08-31T04:09:19.593 INFO:teuthology.orchestra.run.smithi050.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-08-31T04:09:19.593 INFO:teuthology.orchestra.run.smithi050.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-08-31T04:09:19.593 INFO:teuthology.orchestra.run.smithi050.stdout: python3-ceph-argparse x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 45 k 2024-08-31T04:09:19.593 INFO:teuthology.orchestra.run.smithi050.stdout: python3-ceph-common x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 141 k 2024-08-31T04:09:19.593 INFO:teuthology.orchestra.run.smithi050.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-08-31T04:09:19.593 INFO:teuthology.orchestra.run.smithi050.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-08-31T04:09:19.593 INFO:teuthology.orchestra.run.smithi050.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-08-31T04:09:19.593 INFO:teuthology.orchestra.run.smithi050.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-08-31T04:09:19.594 INFO:teuthology.orchestra.run.smithi050.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-08-31T04:09:19.594 INFO:teuthology.orchestra.run.smithi050.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-08-31T04:09:19.594 INFO:teuthology.orchestra.run.smithi050.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-08-31T04:09:19.594 INFO:teuthology.orchestra.run.smithi050.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-08-31T04:09:19.594 INFO:teuthology.orchestra.run.smithi050.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-08-31T04:09:19.594 INFO:teuthology.orchestra.run.smithi050.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-08-31T04:09:19.594 INFO:teuthology.orchestra.run.smithi050.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-08-31T04:09:19.594 INFO:teuthology.orchestra.run.smithi050.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-08-31T04:09:19.594 INFO:teuthology.orchestra.run.smithi050.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-08-31T04:09:19.594 INFO:teuthology.orchestra.run.smithi050.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-08-31T04:09:19.594 INFO:teuthology.orchestra.run.smithi050.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-08-31T04:09:19.594 INFO:teuthology.orchestra.run.smithi050.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-08-31T04:09:19.595 INFO:teuthology.orchestra.run.smithi050.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-08-31T04:09:19.595 INFO:teuthology.orchestra.run.smithi050.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-08-31T04:09:19.595 INFO:teuthology.orchestra.run.smithi050.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-08-31T04:09:19.595 INFO:teuthology.orchestra.run.smithi050.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-08-31T04:09:19.595 INFO:teuthology.orchestra.run.smithi050.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-08-31T04:09:19.595 INFO:teuthology.orchestra.run.smithi050.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-08-31T04:09:19.595 INFO:teuthology.orchestra.run.smithi050.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-08-31T04:09:19.595 INFO:teuthology.orchestra.run.smithi050.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-08-31T04:09:19.595 INFO:teuthology.orchestra.run.smithi050.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-08-31T04:09:19.595 INFO:teuthology.orchestra.run.smithi050.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-08-31T04:09:19.595 INFO:teuthology.orchestra.run.smithi050.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-08-31T04:09:19.595 INFO:teuthology.orchestra.run.smithi050.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-08-31T04:09:19.595 INFO:teuthology.orchestra.run.smithi050.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-08-31T04:09:19.596 INFO:teuthology.orchestra.run.smithi050.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-08-31T04:09:19.596 INFO:teuthology.orchestra.run.smithi050.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-08-31T04:09:19.596 INFO:teuthology.orchestra.run.smithi050.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-08-31T04:09:19.596 INFO:teuthology.orchestra.run.smithi050.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-08-31T04:09:19.596 INFO:teuthology.orchestra.run.smithi050.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-08-31T04:09:19.596 INFO:teuthology.orchestra.run.smithi050.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-08-31T04:09:19.596 INFO:teuthology.orchestra.run.smithi050.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-08-31T04:09:19.596 INFO:teuthology.orchestra.run.smithi050.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-08-31T04:09:19.596 INFO:teuthology.orchestra.run.smithi050.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-08-31T04:09:19.596 INFO:teuthology.orchestra.run.smithi050.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-08-31T04:09:19.596 INFO:teuthology.orchestra.run.smithi050.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-08-31T04:09:19.596 INFO:teuthology.orchestra.run.smithi050.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-08-31T04:09:19.597 INFO:teuthology.orchestra.run.smithi050.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-08-31T04:09:19.597 INFO:teuthology.orchestra.run.smithi050.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-08-31T04:09:19.597 INFO:teuthology.orchestra.run.smithi050.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-08-31T04:09:19.597 INFO:teuthology.orchestra.run.smithi050.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-08-31T04:09:19.597 INFO:teuthology.orchestra.run.smithi050.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-08-31T04:09:19.597 INFO:teuthology.orchestra.run.smithi050.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-08-31T04:09:19.597 INFO:teuthology.orchestra.run.smithi050.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-08-31T04:09:19.597 INFO:teuthology.orchestra.run.smithi050.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-08-31T04:09:19.597 INFO:teuthology.orchestra.run.smithi050.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-08-31T04:09:19.597 INFO:teuthology.orchestra.run.smithi050.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-08-31T04:09:19.597 INFO:teuthology.orchestra.run.smithi050.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-08-31T04:09:19.597 INFO:teuthology.orchestra.run.smithi050.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-08-31T04:09:19.597 INFO:teuthology.orchestra.run.smithi050.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-08-31T04:09:19.598 INFO:teuthology.orchestra.run.smithi050.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-08-31T04:09:19.598 INFO:teuthology.orchestra.run.smithi050.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-08-31T04:09:19.598 INFO:teuthology.orchestra.run.smithi050.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-08-31T04:09:19.598 INFO:teuthology.orchestra.run.smithi050.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-08-31T04:09:19.598 INFO:teuthology.orchestra.run.smithi050.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-08-31T04:09:19.598 INFO:teuthology.orchestra.run.smithi050.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-08-31T04:09:19.598 INFO:teuthology.orchestra.run.smithi050.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-08-31T04:09:19.598 INFO:teuthology.orchestra.run.smithi050.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-08-31T04:09:19.598 INFO:teuthology.orchestra.run.smithi050.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-08-31T04:09:19.598 INFO:teuthology.orchestra.run.smithi050.stdout:Installing weak dependencies: 2024-08-31T04:09:19.598 INFO:teuthology.orchestra.run.smithi050.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-08-31T04:09:19.598 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-08-31T04:09:19.598 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction Summary 2024-08-31T04:09:19.599 INFO:teuthology.orchestra.run.smithi050.stdout:======================================================================================= 2024-08-31T04:09:19.599 INFO:teuthology.orchestra.run.smithi050.stdout:Install 148 Packages 2024-08-31T04:09:19.599 INFO:teuthology.orchestra.run.smithi050.stdout:Upgrade 2 Packages 2024-08-31T04:09:19.599 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-08-31T04:09:19.599 INFO:teuthology.orchestra.run.smithi177.stdout:(5/150): ceph-mgr-19.3.0-4560.gd19e6118.el9.x86 6.5 MB/s | 1.5 MB 00:00 2024-08-31T04:09:19.600 INFO:teuthology.orchestra.run.smithi050.stdout:Total download size: 224 M 2024-08-31T04:09:19.600 INFO:teuthology.orchestra.run.smithi050.stdout:Downloading Packages: 2024-08-31T04:09:19.616 INFO:teuthology.orchestra.run.smithi133.stdout:(13/150): libcephfs-devel-19.3.0-4560.gd19e6118 317 kB/s | 32 kB 00:00 2024-08-31T04:09:19.716 INFO:teuthology.orchestra.run.smithi177.stdout:(6/150): ceph-mds-19.3.0-4560.gd19e6118.el9.x86 2.8 MB/s | 2.3 MB 00:00 2024-08-31T04:09:19.808 INFO:teuthology.orchestra.run.smithi133.stdout:(14/150): ceph-osd-19.3.0-4560.gd19e6118.el9.x8 13 MB/s | 18 MB 00:01 2024-08-31T04:09:19.842 INFO:teuthology.orchestra.run.smithi133.stdout:(15/150): libcephfs2-19.3.0-4560.gd19e6118.el9. 3.3 MB/s | 766 kB 00:00 2024-08-31T04:09:19.867 INFO:teuthology.orchestra.run.smithi133.stdout:(16/150): libcephsqlite-19.3.0-4560.gd19e6118.e 2.7 MB/s | 159 kB 00:00 2024-08-31T04:09:19.909 INFO:teuthology.orchestra.run.smithi133.stdout:(17/150): librados-devel-19.3.0-4560.gd19e6118. 1.9 MB/s | 127 kB 00:00 2024-08-31T04:09:19.951 INFO:teuthology.orchestra.run.smithi133.stdout:(18/150): libradosstriper1-19.3.0-4560.gd19e611 5.9 MB/s | 506 kB 00:00 2024-08-31T04:09:20.000 INFO:teuthology.orchestra.run.smithi177.stdout:(7/150): ceph-mon-19.3.0-4560.gd19e6118.el9.x86 12 MB/s | 4.9 MB 00:00 2024-08-31T04:09:20.010 INFO:teuthology.orchestra.run.smithi133.stdout:(19/150): python3-ceph-argparse-19.3.0-4560.gd1 775 kB/s | 45 kB 00:00 2024-08-31T04:09:20.093 INFO:teuthology.orchestra.run.smithi133.stdout:(20/150): python3-ceph-common-19.3.0-4560.gd19e 1.7 MB/s | 141 kB 00:00 2024-08-31T04:09:20.177 INFO:teuthology.orchestra.run.smithi133.stdout:(21/150): python3-cephfs-19.3.0-4560.gd19e6118. 1.9 MB/s | 161 kB 00:00 2024-08-31T04:09:20.269 INFO:teuthology.orchestra.run.smithi133.stdout:(22/150): python3-rados-19.3.0-4560.gd19e6118.e 3.4 MB/s | 321 kB 00:00 2024-08-31T04:09:20.361 INFO:teuthology.orchestra.run.smithi133.stdout:(23/150): python3-rbd-19.3.0-4560.gd19e6118.el9 3.3 MB/s | 305 kB 00:00 2024-08-31T04:09:20.453 INFO:teuthology.orchestra.run.smithi133.stdout:(24/150): librgw2-19.3.0-4560.gd19e6118.el9.x86 9.8 MB/s | 5.3 MB 00:00 2024-08-31T04:09:20.478 INFO:teuthology.orchestra.run.smithi133.stdout:(25/150): python3-rgw-19.3.0-4560.gd19e6118.el9 851 kB/s | 99 kB 00:00 2024-08-31T04:09:20.528 INFO:teuthology.orchestra.run.smithi133.stdout:(26/150): rbd-fuse-19.3.0-4560.gd19e6118.el9.x8 1.1 MB/s | 86 kB 00:00 2024-08-31T04:09:20.695 INFO:teuthology.orchestra.run.smithi050.stdout:(1/150): ceph-19.3.0-4560.gd19e6118.el9.x86_64. 20 kB/s | 6.6 kB 00:00 2024-08-31T04:09:20.779 INFO:teuthology.orchestra.run.smithi133.stdout:(27/150): rbd-mirror-19.3.0-4560.gd19e6118.el9. 10 MB/s | 3.1 MB 00:00 2024-08-31T04:09:20.825 INFO:teuthology.orchestra.run.smithi177.stdout:(8/150): ceph-radosgw-19.3.0-4560.gd19e6118.el9 13 MB/s | 10 MB 00:00 2024-08-31T04:09:20.845 INFO:teuthology.orchestra.run.smithi133.stdout:(28/150): ceph-grafana-dashboards-19.3.0-4560.g 515 kB/s | 34 kB 00:00 2024-08-31T04:09:20.892 INFO:teuthology.orchestra.run.smithi177.stdout:(9/150): ceph-selinux-19.3.0-4560.gd19e6118.el9 379 kB/s | 25 kB 00:00 2024-08-31T04:09:20.929 INFO:teuthology.orchestra.run.smithi133.stdout:(29/150): ceph-mgr-cephadm-19.3.0-4560.gd19e611 1.8 MB/s | 154 kB 00:00 2024-08-31T04:09:20.954 INFO:teuthology.orchestra.run.smithi133.stdout:(30/150): rbd-nbd-19.3.0-4560.gd19e6118.el9.x86 399 kB/s | 170 kB 00:00 2024-08-31T04:09:20.987 INFO:teuthology.orchestra.run.smithi050.stdout:(2/150): ceph-fuse-19.3.0-4560.gd19e6118.el9.x8 2.9 MB/s | 874 kB 00:00 2024-08-31T04:09:21.120 INFO:teuthology.orchestra.run.smithi050.stdout:(3/150): ceph-immutable-object-cache-19.3.0-456 1.1 MB/s | 148 kB 00:00 2024-08-31T04:09:21.225 INFO:teuthology.orchestra.run.smithi177.stdout:(10/150): ceph-common-19.3.0-4560.gd19e6118.el9 6.3 MB/s | 20 MB 00:03 2024-08-31T04:09:21.334 INFO:teuthology.orchestra.run.smithi177.stdout:(11/150): cephfs-mirror-19.3.0-4560.gd19e6118.e 2.0 MB/s | 226 kB 00:00 2024-08-31T04:09:21.434 INFO:teuthology.orchestra.run.smithi177.stdout:(12/150): cephfs-shell-19.3.0-4560.gd19e6118.el 271 kB/s | 27 kB 00:00 2024-08-31T04:09:21.526 INFO:teuthology.orchestra.run.smithi177.stdout:(13/150): libcephfs-devel-19.3.0-4560.gd19e6118 346 kB/s | 32 kB 00:00 2024-08-31T04:09:21.620 INFO:teuthology.orchestra.run.smithi050.stdout:(4/150): ceph-base-19.3.0-4560.gd19e6118.el9.x8 4.4 MB/s | 5.5 MB 00:01 2024-08-31T04:09:21.701 INFO:teuthology.orchestra.run.smithi177.stdout:(14/150): libcephfs2-19.3.0-4560.gd19e6118.el9. 4.3 MB/s | 766 kB 00:00 2024-08-31T04:09:21.810 INFO:teuthology.orchestra.run.smithi177.stdout:(15/150): libcephsqlite-19.3.0-4560.gd19e6118.e 1.4 MB/s | 159 kB 00:00 2024-08-31T04:09:21.846 INFO:teuthology.orchestra.run.smithi050.stdout:(5/150): ceph-mds-19.3.0-4560.gd19e6118.el9.x86 3.1 MB/s | 2.3 MB 00:00 2024-08-31T04:09:21.893 INFO:teuthology.orchestra.run.smithi177.stdout:(16/150): librados-devel-19.3.0-4560.gd19e6118. 1.5 MB/s | 127 kB 00:00 2024-08-31T04:09:21.937 INFO:teuthology.orchestra.run.smithi050.stdout:(6/150): ceph-mgr-19.3.0-4560.gd19e6118.el9.x86 4.8 MB/s | 1.5 MB 00:00 2024-08-31T04:09:22.002 INFO:teuthology.orchestra.run.smithi177.stdout:(17/150): libradosstriper1-19.3.0-4560.gd19e611 4.6 MB/s | 506 kB 00:00 2024-08-31T04:09:22.238 INFO:teuthology.orchestra.run.smithi133.stdout:(31/150): ceph-test-19.3.0-4560.gd19e6118.el9.x 14 MB/s | 44 MB 00:03 2024-08-31T04:09:22.355 INFO:teuthology.orchestra.run.smithi133.stdout:(32/150): ceph-mgr-modules-core-19.3.0-4560.gd1 2.4 MB/s | 290 kB 00:00 2024-08-31T04:09:22.513 INFO:teuthology.orchestra.run.smithi133.stdout:(33/150): ceph-mgr-dashboard-19.3.0-4560.gd19e6 8.9 MB/s | 14 MB 00:01 2024-08-31T04:09:22.539 INFO:teuthology.orchestra.run.smithi133.stdout:(34/150): ceph-mgr-rook-19.3.0-4560.gd19e6118.e 269 kB/s | 49 kB 00:00 2024-08-31T04:09:22.564 INFO:teuthology.orchestra.run.smithi133.stdout:(35/150): ceph-prometheus-alerts-19.3.0-4560.gd 329 kB/s | 16 kB 00:00 2024-08-31T04:09:22.601 INFO:teuthology.orchestra.run.smithi050.stdout:(7/150): ceph-mon-19.3.0-4560.gd19e6118.el9.x86 6.5 MB/s | 4.9 MB 00:00 2024-08-31T04:09:22.619 INFO:teuthology.orchestra.run.smithi177.stdout:(18/150): ceph-osd-19.3.0-4560.gd19e6118.el9.x8 6.1 MB/s | 18 MB 00:02 2024-08-31T04:09:22.656 INFO:teuthology.orchestra.run.smithi133.stdout:(36/150): ceph-mgr-diskprediction-local-19.3.0- 4.3 MB/s | 7.4 MB 00:01 2024-08-31T04:09:22.681 INFO:teuthology.orchestra.run.smithi133.stdout:(37/150): ceph-volume-19.3.0-4560.gd19e6118.el9 2.0 MB/s | 285 kB 00:00 2024-08-31T04:09:22.686 INFO:teuthology.orchestra.run.smithi177.stdout:(19/150): python3-ceph-argparse-19.3.0-4560.gd1 680 kB/s | 45 kB 00:00 2024-08-31T04:09:22.715 INFO:teuthology.orchestra.run.smithi133.stdout:(38/150): cephadm-19.3.0-4560.gd19e6118.el9.noa 5.1 MB/s | 781 kB 00:00 2024-08-31T04:09:22.740 INFO:teuthology.orchestra.run.smithi133.stdout:(39/150): cephfs-top-19.3.0-4560.gd19e6118.el9. 217 kB/s | 18 kB 00:00 2024-08-31T04:09:22.770 INFO:teuthology.orchestra.run.smithi177.stdout:(20/150): python3-ceph-common-19.3.0-4560.gd19e 1.7 MB/s | 141 kB 00:00 2024-08-31T04:09:22.845 INFO:teuthology.orchestra.run.smithi177.stdout:(21/150): librgw2-19.3.0-4560.gd19e6118.el9.x86 6.3 MB/s | 5.3 MB 00:00 2024-08-31T04:09:22.870 INFO:teuthology.orchestra.run.smithi177.stdout:(22/150): python3-cephfs-19.3.0-4560.gd19e6118. 1.6 MB/s | 161 kB 00:00 2024-08-31T04:09:22.920 INFO:teuthology.orchestra.run.smithi177.stdout:(23/150): python3-rados-19.3.0-4560.gd19e6118.e 4.2 MB/s | 321 kB 00:00 2024-08-31T04:09:22.945 INFO:teuthology.orchestra.run.smithi177.stdout:(24/150): python3-rbd-19.3.0-4560.gd19e6118.el9 4.0 MB/s | 305 kB 00:00 2024-08-31T04:09:22.996 INFO:teuthology.orchestra.run.smithi177.stdout:(25/150): python3-rgw-19.3.0-4560.gd19e6118.el9 1.3 MB/s | 99 kB 00:00 2024-08-31T04:09:23.021 INFO:teuthology.orchestra.run.smithi177.stdout:(26/150): rbd-fuse-19.3.0-4560.gd19e6118.el9.x8 1.1 MB/s | 86 kB 00:00 2024-08-31T04:09:23.096 INFO:teuthology.orchestra.run.smithi177.stdout:(27/150): rbd-nbd-19.3.0-4560.gd19e6118.el9.x86 2.2 MB/s | 170 kB 00:00 2024-08-31T04:09:23.099 INFO:teuthology.orchestra.run.smithi133.stdout:(40/150): fuse-2.9.9-16.el9.x86_64.rpm 191 kB/s | 80 kB 00:00 2024-08-31T04:09:23.172 INFO:teuthology.orchestra.run.smithi177.stdout:(28/150): ceph-grafana-dashboards-19.3.0-4560.g 455 kB/s | 34 kB 00:00 2024-08-31T04:09:23.239 INFO:teuthology.orchestra.run.smithi177.stdout:(29/150): ceph-mgr-cephadm-19.3.0-4560.gd19e611 2.3 MB/s | 154 kB 00:00 2024-08-31T04:09:23.249 INFO:teuthology.orchestra.run.smithi133.stdout:(41/150): libquadmath-11.5.0-2.el9.x86_64.rpm 376 kB/s | 191 kB 00:00 2024-08-31T04:09:23.263 INFO:teuthology.orchestra.run.smithi050.stdout:(8/150): ceph-common-19.3.0-4560.gd19e6118.el9. 6.9 MB/s | 20 MB 00:02 2024-08-31T04:09:23.347 INFO:teuthology.orchestra.run.smithi177.stdout:(30/150): rbd-mirror-19.3.0-4560.gd19e6118.el9. 8.8 MB/s | 3.1 MB 00:00 2024-08-31T04:09:23.413 INFO:teuthology.orchestra.run.smithi050.stdout:(9/150): ceph-radosgw-19.3.0-4560.gd19e6118.el9 13 MB/s | 10 MB 00:00 2024-08-31T04:09:23.439 INFO:teuthology.orchestra.run.smithi050.stdout:(10/150): ceph-selinux-19.3.0-4560.gd19e6118.el 144 kB/s | 25 kB 00:00 2024-08-31T04:09:23.449 INFO:teuthology.orchestra.run.smithi133.stdout:(42/150): python3-cffi-1.14.5-5.el9.x86_64.rpm 723 kB/s | 253 kB 00:00 2024-08-31T04:09:23.483 INFO:teuthology.orchestra.run.smithi133.stdout:(43/150): libgfortran-11.5.0-2.el9.x86_64.rpm 1.0 MB/s | 801 kB 00:00 2024-08-31T04:09:23.522 INFO:teuthology.orchestra.run.smithi050.stdout:(11/150): cephfs-mirror-19.3.0-4560.gd19e6118.e 2.7 MB/s | 226 kB 00:00 2024-08-31T04:09:23.550 INFO:teuthology.orchestra.run.smithi133.stdout:(44/150): python3-ply-3.11-14.el9.noarch.rpm 1.0 MB/s | 106 kB 00:00 2024-08-31T04:09:23.600 INFO:teuthology.orchestra.run.smithi133.stdout:(45/150): python3-pycparser-2.20-6.el9.noarch.r 1.1 MB/s | 135 kB 00:00 2024-08-31T04:09:23.605 INFO:teuthology.orchestra.run.smithi050.stdout:(12/150): cephfs-shell-19.3.0-4560.gd19e6118.el 325 kB/s | 27 kB 00:00 2024-08-31T04:09:23.659 INFO:teuthology.orchestra.run.smithi133.stdout:(46/150): python3-requests-2.25.1-8.el9.noarch. 1.1 MB/s | 125 kB 00:00 2024-08-31T04:09:23.693 INFO:teuthology.orchestra.run.smithi133.stdout:(47/150): python3-cryptography-36.0.1-4.el9.x86 2.8 MB/s | 1.2 MB 00:00 2024-08-31T04:09:23.706 INFO:teuthology.orchestra.run.smithi050.stdout:(13/150): libcephfs-devel-19.3.0-4560.gd19e6118 317 kB/s | 32 kB 00:00 2024-08-31T04:09:23.726 INFO:teuthology.orchestra.run.smithi133.stdout:(48/150): python3-urllib3-1.26.5-6.el9.noarch.r 1.7 MB/s | 215 kB 00:00 2024-08-31T04:09:23.873 INFO:teuthology.orchestra.run.smithi050.stdout:(14/150): libcephfs2-19.3.0-4560.gd19e6118.el9. 4.5 MB/s | 766 kB 00:00 2024-08-31T04:09:23.876 INFO:teuthology.orchestra.run.smithi133.stdout:(49/150): boost-program-options-1.75.0-8.el9.x8 713 kB/s | 107 kB 00:00 2024-08-31T04:09:23.901 INFO:teuthology.orchestra.run.smithi133.stdout:(50/150): automake-1.16.2-8.el9.noarch.rpm 2.8 MB/s | 689 kB 00:00 2024-08-31T04:09:23.927 INFO:teuthology.orchestra.run.smithi133.stdout:(51/150): elfutils-libelf-devel-0.191-4.el9.x86 431 kB/s | 22 kB 00:00 2024-08-31T04:09:23.952 INFO:teuthology.orchestra.run.smithi133.stdout:(52/150): flex-2.6.4-9.el9.x86_64.rpm 6.1 MB/s | 313 kB 00:00 2024-08-31T04:09:23.965 INFO:teuthology.orchestra.run.smithi050.stdout:(15/150): libcephsqlite-19.3.0-4560.gd19e6118.e 1.7 MB/s | 159 kB 00:00 2024-08-31T04:09:23.977 INFO:teuthology.orchestra.run.smithi133.stdout:(53/150): flexiblas-3.0.4-8.el9.x86_64.rpm 653 kB/s | 33 kB 00:00 2024-08-31T04:09:24.011 INFO:teuthology.orchestra.run.smithi133.stdout:(54/150): bison-3.7.4-5.el9.x86_64.rpm 2.9 MB/s | 943 kB 00:00 2024-08-31T04:09:24.036 INFO:teuthology.orchestra.run.smithi133.stdout:(55/150): flexiblas-openblas-openmp-3.0.4-8.el9 311 kB/s | 18 kB 00:00 2024-08-31T04:09:24.062 INFO:teuthology.orchestra.run.smithi133.stdout:(56/150): libaio-devel-0.3.111-13.el9.x86_64.rp 222 kB/s | 11 kB 00:00 2024-08-31T04:09:24.087 INFO:teuthology.orchestra.run.smithi133.stdout:(57/150): libpmemobj-1.12.1-1.el9.x86_64.rpm 3.1 MB/s | 160 kB 00:00 2024-08-31T04:09:24.112 INFO:teuthology.orchestra.run.smithi133.stdout:(58/150): librabbitmq-0.11.0-7.el9.x86_64.rpm 905 kB/s | 45 kB 00:00 2024-08-31T04:09:24.154 INFO:teuthology.orchestra.run.smithi133.stdout:(59/150): librdkafka-1.6.1-102.el9.x86_64.rpm 9.7 MB/s | 662 kB 00:00 2024-08-31T04:09:24.182 INFO:teuthology.orchestra.run.smithi050.stdout:(16/150): ceph-osd-19.3.0-4560.gd19e6118.el9.x8 7.9 MB/s | 18 MB 00:02 2024-08-31T04:09:24.207 INFO:teuthology.orchestra.run.smithi050.stdout:(17/150): librados-devel-19.3.0-4560.gd19e6118. 523 kB/s | 127 kB 00:00 2024-08-31T04:09:24.221 INFO:teuthology.orchestra.run.smithi133.stdout:(60/150): flexiblas-netlib-3.0.4-8.el9.x86_64.r 11 MB/s | 3.0 MB 00:00 2024-08-31T04:09:24.246 INFO:teuthology.orchestra.run.smithi133.stdout:(61/150): libuuid-devel-2.37.4-20.el9.x86_64.rp 266 kB/s | 24 kB 00:00 2024-08-31T04:09:24.248 INFO:teuthology.orchestra.run.smithi177.stdout:(31/150): ceph-mgr-diskprediction-local-19.3.0- 8.2 MB/s | 7.4 MB 00:00 2024-08-31T04:09:24.249 INFO:teuthology.orchestra.run.smithi050.stdout:(18/150): libradosstriper1-19.3.0-4560.gd19e611 7.5 MB/s | 506 kB 00:00 2024-08-31T04:09:24.272 INFO:teuthology.orchestra.run.smithi133.stdout:(62/150): libzstd-devel-1.5.1-2.el9.x86_64.rpm 943 kB/s | 47 kB 00:00 2024-08-31T04:09:24.297 INFO:teuthology.orchestra.run.smithi133.stdout:(63/150): lttng-ust-2.12.0-6.el9.x86_64.rpm 5.7 MB/s | 292 kB 00:00 2024-08-31T04:09:24.314 INFO:teuthology.orchestra.run.smithi177.stdout:(32/150): ceph-mgr-modules-core-19.3.0-4560.gd1 4.3 MB/s | 290 kB 00:00 2024-08-31T04:09:24.316 INFO:teuthology.orchestra.run.smithi050.stdout:(19/150): python3-ceph-argparse-19.3.0-4560.gd1 675 kB/s | 45 kB 00:00 2024-08-31T04:09:24.330 INFO:teuthology.orchestra.run.smithi133.stdout:(64/150): libtool-2.4.6-46.el9.x86_64.rpm 2.6 MB/s | 581 kB 00:00 2024-08-31T04:09:24.347 INFO:teuthology.orchestra.run.smithi133.stdout:(65/150): openblas-0.3.26-2.el9.x86_64.rpm 768 kB/s | 38 kB 00:00 2024-08-31T04:09:24.373 INFO:teuthology.orchestra.run.smithi177.stdout:(33/150): ceph-mgr-rook-19.3.0-4560.gd19e6118.e 844 kB/s | 49 kB 00:00 2024-08-31T04:09:24.381 INFO:teuthology.orchestra.run.smithi133.stdout:(66/150): lua-5.4.4-4.el9.x86_64.rpm 1.7 MB/s | 188 kB 00:00 2024-08-31T04:09:24.417 INFO:teuthology.orchestra.run.smithi050.stdout:(20/150): python3-ceph-common-19.3.0-4560.gd19e 1.4 MB/s | 141 kB 00:00 2024-08-31T04:09:24.465 INFO:teuthology.orchestra.run.smithi177.stdout:(34/150): ceph-prometheus-alerts-19.3.0-4560.gd 179 kB/s | 16 kB 00:00 2024-08-31T04:09:24.498 INFO:teuthology.orchestra.run.smithi133.stdout:(67/150): openssl-devel-3.2.2-4.el9.x86_64.rpm 29 MB/s | 4.4 MB 00:00 2024-08-31T04:09:24.500 INFO:teuthology.orchestra.run.smithi050.stdout:(21/150): python3-cephfs-19.3.0-4560.gd19e6118. 1.9 MB/s | 161 kB 00:00 2024-08-31T04:09:24.540 INFO:teuthology.orchestra.run.smithi133.stdout:(68/150): postgresql-13.16-1.el9.x86_64.rpm 10 MB/s | 1.6 MB 00:00 2024-08-31T04:09:24.574 INFO:teuthology.orchestra.run.smithi133.stdout:(69/150): postgresql-contrib-13.16-1.el9.x86_64 12 MB/s | 910 kB 00:00 2024-08-31T04:09:24.592 INFO:teuthology.orchestra.run.smithi050.stdout:(22/150): python3-rados-19.3.0-4560.gd19e6118.e 3.4 MB/s | 321 kB 00:00 2024-08-31T04:09:24.599 INFO:teuthology.orchestra.run.smithi133.stdout:(70/150): postgresql-private-libs-13.16-1.el9.x 2.3 MB/s | 137 kB 00:00 2024-08-31T04:09:24.683 INFO:teuthology.orchestra.run.smithi133.stdout:(71/150): openblas-openmp-0.3.26-2.el9.x86_64.r 14 MB/s | 4.9 MB 00:00 2024-08-31T04:09:24.684 INFO:teuthology.orchestra.run.smithi050.stdout:(23/150): python3-rbd-19.3.0-4560.gd19e6118.el9 3.3 MB/s | 305 kB 00:00 2024-08-31T04:09:24.725 INFO:teuthology.orchestra.run.smithi133.stdout:(72/150): protobuf-3.14.0-13.el9.x86_64.rpm 8.1 MB/s | 1.0 MB 00:00 2024-08-31T04:09:24.750 INFO:teuthology.orchestra.run.smithi133.stdout:(73/150): python3-attrs-20.3.0-7.el9.noarch.rpm 1.3 MB/s | 87 kB 00:00 2024-08-31T04:09:24.776 INFO:teuthology.orchestra.run.smithi050.stdout:(24/150): python3-rgw-19.3.0-4560.gd19e6118.el9 1.1 MB/s | 99 kB 00:00 2024-08-31T04:09:24.792 INFO:teuthology.orchestra.run.smithi133.stdout:(74/150): python3-colorama-0.4.6-3.el9.noarch.r 1.4 MB/s | 61 kB 00:00 2024-08-31T04:09:24.857 INFO:teuthology.orchestra.run.smithi177.stdout:(35/150): ceph-test-19.3.0-4560.gd19e6118.el9.x 11 MB/s | 44 MB 00:03 2024-08-31T04:09:24.867 INFO:teuthology.orchestra.run.smithi133.stdout:(75/150): postgresql-server-13.16-1.el9.x86_64. 20 MB/s | 5.8 MB 00:00 2024-08-31T04:09:24.868 INFO:teuthology.orchestra.run.smithi050.stdout:(25/150): librgw2-19.3.0-4560.gd19e6118.el9.x86 8.0 MB/s | 5.3 MB 00:00 2024-08-31T04:09:24.882 INFO:teuthology.orchestra.run.smithi177.stdout:(36/150): ceph-volume-19.3.0-4560.gd19e6118.el9 684 kB/s | 285 kB 00:00 2024-08-31T04:09:24.892 INFO:teuthology.orchestra.run.smithi133.stdout:(76/150): python3-devel-3.9.19-8.el9.x86_64.rpm 2.4 MB/s | 245 kB 00:00 2024-08-31T04:09:24.893 INFO:teuthology.orchestra.run.smithi050.stdout:(26/150): rbd-fuse-19.3.0-4560.gd19e6118.el9.x8 738 kB/s | 86 kB 00:00 2024-08-31T04:09:24.926 INFO:teuthology.orchestra.run.smithi133.stdout:(77/150): python3-jinja2-2.11.3-6.el9.noarch.rp 4.1 MB/s | 248 kB 00:00 2024-08-31T04:09:24.932 INFO:teuthology.orchestra.run.smithi177.stdout:(37/150): cephadm-19.3.0-4560.gd19e6118.el9.noa 10 MB/s | 781 kB 00:00 2024-08-31T04:09:24.944 INFO:teuthology.orchestra.run.smithi050.stdout:(27/150): rbd-nbd-19.3.0-4560.gd19e6118.el9.x86 3.3 MB/s | 170 kB 00:00 2024-08-31T04:09:24.951 INFO:teuthology.orchestra.run.smithi133.stdout:(78/150): python3-jsonpatch-1.21-16.el9.noarch. 437 kB/s | 26 kB 00:00 2024-08-31T04:09:24.974 INFO:teuthology.orchestra.run.smithi177.stdout:(38/150): cephfs-top-19.3.0-4560.gd19e6118.el9. 199 kB/s | 18 kB 00:00 2024-08-31T04:09:24.976 INFO:teuthology.orchestra.run.smithi133.stdout:(79/150): python3-jsonpointer-2.0-4.el9.noarch. 382 kB/s | 19 kB 00:00 2024-08-31T04:09:25.002 INFO:teuthology.orchestra.run.smithi133.stdout:(80/150): python3-mako-1.1.4-6.el9.noarch.rpm 3.4 MB/s | 172 kB 00:00 2024-08-31T04:09:25.019 INFO:teuthology.orchestra.run.smithi050.stdout:(28/150): ceph-grafana-dashboards-19.3.0-4560.g 458 kB/s | 34 kB 00:00 2024-08-31T04:09:25.027 INFO:teuthology.orchestra.run.smithi133.stdout:(81/150): python3-markupsafe-1.1.1-12.el9.x86_6 692 kB/s | 35 kB 00:00 2024-08-31T04:09:25.077 INFO:teuthology.orchestra.run.smithi133.stdout:(82/150): python3-numpy-f2py-1.20.1-5.el9.x86_6 4.9 MB/s | 250 kB 00:00 2024-08-31T04:09:25.108 INFO:teuthology.orchestra.run.smithi177.stdout:(39/150): fuse-2.9.9-16.el9.x86_64.rpm 600 kB/s | 80 kB 00:00 2024-08-31T04:09:25.153 INFO:teuthology.orchestra.run.smithi133.stdout:(83/150): python3-babel-2.9.1-2.el9.noarch.rpm 14 MB/s | 6.0 MB 00:00 2024-08-31T04:09:25.178 INFO:teuthology.orchestra.run.smithi133.stdout:(84/150): python3-oauthlib-3.1.1-5.el9.noarch.r 2.2 MB/s | 222 kB 00:00 2024-08-31T04:09:25.192 INFO:teuthology.orchestra.run.smithi177.stdout:(40/150): libquadmath-11.5.0-2.el9.x86_64.rpm 2.2 MB/s | 191 kB 00:00 2024-08-31T04:09:25.203 INFO:teuthology.orchestra.run.smithi133.stdout:(85/150): python3-packaging-20.9-5.el9.noarch.r 1.5 MB/s | 77 kB 00:00 2024-08-31T04:09:25.225 INFO:teuthology.orchestra.run.smithi177.stdout:(41/150): libgfortran-11.5.0-2.el9.x86_64.rpm 3.1 MB/s | 801 kB 00:00 2024-08-31T04:09:25.228 INFO:teuthology.orchestra.run.smithi133.stdout:(86/150): python3-prettytable-0.7.2-27.el9.noar 841 kB/s | 42 kB 00:00 2024-08-31T04:09:25.296 INFO:teuthology.orchestra.run.smithi133.stdout:(87/150): python3-numpy-1.20.1-5.el9.x86_64.rpm 17 MB/s | 5.1 MB 00:00 2024-08-31T04:09:25.321 INFO:teuthology.orchestra.run.smithi133.stdout:(88/150): python3-protobuf-3.14.0-13.el9.noarch 2.2 MB/s | 269 kB 00:00 2024-08-31T04:09:25.346 INFO:teuthology.orchestra.run.smithi133.stdout:(89/150): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.3 MB/s | 159 kB 00:00 2024-08-31T04:09:25.367 INFO:teuthology.orchestra.run.smithi177.stdout:(42/150): ceph-mgr-dashboard-19.3.0-4560.gd19e6 6.6 MB/s | 14 MB 00:02 2024-08-31T04:09:25.371 INFO:teuthology.orchestra.run.smithi133.stdout:(90/150): python3-pytz-2021.1-5.el9.noarch.rpm 1.0 MB/s | 51 kB 00:00 2024-08-31T04:09:25.392 INFO:teuthology.orchestra.run.smithi177.stdout:(43/150): python3-cffi-1.14.5-5.el9.x86_64.rpm 1.2 MB/s | 253 kB 00:00 2024-08-31T04:09:25.396 INFO:teuthology.orchestra.run.smithi133.stdout:(91/150): python3-requests-oauthlib-1.3.0-12.el 1.0 MB/s | 54 kB 00:00 2024-08-31T04:09:25.422 INFO:teuthology.orchestra.run.smithi133.stdout:(92/150): python3-pyasn1-modules-0.4.8-6.el9.no 2.2 MB/s | 279 kB 00:00 2024-08-31T04:09:25.426 INFO:teuthology.orchestra.run.smithi177.stdout:(44/150): python3-cryptography-36.0.1-4.el9.x86 6.1 MB/s | 1.2 MB 00:00 2024-08-31T04:09:25.447 INFO:teuthology.orchestra.run.smithi133.stdout:(93/150): python3-toml-0.10.2-6.el9.noarch.rpm 830 kB/s | 42 kB 00:00 2024-08-31T04:09:25.451 INFO:teuthology.orchestra.run.smithi177.stdout:(45/150): python3-pycparser-2.20-6.el9.noarch.r 2.3 MB/s | 135 kB 00:00 2024-08-31T04:09:25.473 INFO:teuthology.orchestra.run.smithi133.stdout:(94/150): python3-wcwidth-0.2.5-8.el9.noarch.rp 883 kB/s | 44 kB 00:00 2024-08-31T04:09:25.476 INFO:teuthology.orchestra.run.smithi177.stdout:(46/150): python3-requests-2.25.1-8.el9.noarch. 2.4 MB/s | 125 kB 00:00 2024-08-31T04:09:25.498 INFO:teuthology.orchestra.run.smithi133.stdout:(95/150): qatlib-24.02.0-1.el9.x86_64.rpm 4.3 MB/s | 221 kB 00:00 2024-08-31T04:09:25.501 INFO:teuthology.orchestra.run.smithi177.stdout:(47/150): python3-urllib3-1.26.5-6.el9.noarch.r 4.2 MB/s | 215 kB 00:00 2024-08-31T04:09:25.523 INFO:teuthology.orchestra.run.smithi133.stdout:(96/150): qatlib-service-24.02.0-1.el9.x86_64.r 711 kB/s | 36 kB 00:00 2024-08-31T04:09:25.527 INFO:teuthology.orchestra.run.smithi177.stdout:(48/150): python3-ply-3.11-14.el9.noarch.rpm 669 kB/s | 106 kB 00:00 2024-08-31T04:09:25.548 INFO:teuthology.orchestra.run.smithi133.stdout:(97/150): qatzip-libs-1.2.0-1.el9.x86_64.rpm 940 kB/s | 47 kB 00:00 2024-08-31T04:09:25.574 INFO:teuthology.orchestra.run.smithi133.stdout:(98/150): socat-1.7.4.1-6.el9.x86_64.rpm 5.9 MB/s | 304 kB 00:00 2024-08-31T04:09:25.599 INFO:teuthology.orchestra.run.smithi133.stdout:(99/150): uuid-1.6.2-55.el9.x86_64.rpm 1.1 MB/s | 58 kB 00:00 2024-08-31T04:09:25.624 INFO:teuthology.orchestra.run.smithi133.stdout:(100/150): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 1.9 MB/s | 96 kB 00:00 2024-08-31T04:09:25.649 INFO:teuthology.orchestra.run.smithi133.stdout:(101/150): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.2 MB/s | 64 kB 00:00 2024-08-31T04:09:25.674 INFO:teuthology.orchestra.run.smithi133.stdout:(102/150): zlib-devel-1.2.11-41.el9.x86_64.rpm 911 kB/s | 45 kB 00:00 2024-08-31T04:09:25.677 INFO:teuthology.orchestra.run.smithi050.stdout:(29/150): ceph-test-19.3.0-4560.gd19e6118.el9.x 19 MB/s | 44 MB 00:02 2024-08-31T04:09:25.703 INFO:teuthology.orchestra.run.smithi050.stdout:(30/150): ceph-mgr-cephadm-19.3.0-4560.gd19e611 225 kB/s | 154 kB 00:00 2024-08-31T04:09:25.749 INFO:teuthology.orchestra.run.smithi133.stdout:(103/150): lua-devel-5.4.4-4.el9.x86_64.rpm 225 kB/s | 22 kB 00:00 2024-08-31T04:09:25.772 INFO:teuthology.orchestra.run.smithi050.stdout:(31/150): rbd-mirror-19.3.0-4560.gd19e6118.el9. 3.4 MB/s | 3.1 MB 00:00 2024-08-31T04:09:25.807 INFO:teuthology.orchestra.run.smithi133.stdout:(104/150): abseil-cpp-20211102.0-3.el9.x86_64.r 9.3 MB/s | 548 kB 00:00 2024-08-31T04:09:25.849 INFO:teuthology.orchestra.run.smithi133.stdout:(105/150): gperftools-libs-2.9.1-2.el9.x86_64.r 7.3 MB/s | 309 kB 00:00 2024-08-31T04:09:25.875 INFO:teuthology.orchestra.run.smithi133.stdout:(106/150): grpc-data-1.46.7-10.el9.noarch.rpm 774 kB/s | 19 kB 00:00 2024-08-31T04:09:25.887 INFO:teuthology.orchestra.run.smithi050.stdout:(32/150): ceph-mgr-modules-core-19.3.0-4560.gd1 2.4 MB/s | 290 kB 00:00 2024-08-31T04:09:25.908 INFO:teuthology.orchestra.run.smithi133.stdout:(107/150): protobuf-compiler-3.14.0-13.el9.x86_ 3.6 MB/s | 863 kB 00:00 2024-08-31T04:09:25.952 INFO:teuthology.orchestra.run.smithi133.stdout:(108/150): libarrow-doc-9.0.0-11.el9.noarch.rpm 612 kB/s | 26 kB 00:00 2024-08-31T04:09:25.954 INFO:teuthology.orchestra.run.smithi050.stdout:(33/150): ceph-mgr-rook-19.3.0-4560.gd19e6118.e 741 kB/s | 49 kB 00:00 2024-08-31T04:09:25.968 INFO:teuthology.orchestra.run.smithi133.stdout:(109/150): liboath-2.6.7-2.el9.x86_64.rpm 3.0 MB/s | 49 kB 00:00 2024-08-31T04:09:26.002 INFO:teuthology.orchestra.run.smithi133.stdout:(110/150): libunwind-1.6.2-1.el9.x86_64.rpm 2.0 MB/s | 67 kB 00:00 2024-08-31T04:09:26.012 INFO:teuthology.orchestra.run.smithi050.stdout:(34/150): ceph-prometheus-alerts-19.3.0-4560.gd 283 kB/s | 16 kB 00:00 2024-08-31T04:09:26.027 INFO:teuthology.orchestra.run.smithi177.stdout:(49/150): boost-program-options-1.75.0-8.el9.x8 214 kB/s | 107 kB 00:00 2024-08-31T04:09:26.044 INFO:teuthology.orchestra.run.smithi133.stdout:(111/150): luarocks-3.9.2-5.el9.noarch.rpm 3.5 MB/s | 151 kB 00:00 2024-08-31T04:09:26.103 INFO:teuthology.orchestra.run.smithi133.stdout:(112/150): parquet-libs-9.0.0-11.el9.x86_64.rpm 14 MB/s | 839 kB 00:00 2024-08-31T04:09:26.127 INFO:teuthology.orchestra.run.smithi177.stdout:(50/150): elfutils-libelf-devel-0.191-4.el9.x86 217 kB/s | 22 kB 00:00 2024-08-31T04:09:26.179 INFO:teuthology.orchestra.run.smithi050.stdout:(35/150): ceph-mgr-dashboard-19.3.0-4560.gd19e6 28 MB/s | 14 MB 00:00 2024-08-31T04:09:26.205 INFO:teuthology.orchestra.run.smithi050.stdout:(36/150): ceph-volume-19.3.0-4560.gd19e6118.el9 1.5 MB/s | 285 kB 00:00 2024-08-31T04:09:26.227 INFO:teuthology.orchestra.run.smithi177.stdout:(51/150): automake-1.16.2-8.el9.noarch.rpm 918 kB/s | 689 kB 00:00 2024-08-31T04:09:26.238 INFO:teuthology.orchestra.run.smithi050.stdout:(37/150): cephadm-19.3.0-4560.gd19e6118.el9.noa 13 MB/s | 781 kB 00:00 2024-08-31T04:09:26.262 INFO:teuthology.orchestra.run.smithi133.stdout:(113/150): python3-scipy-1.6.2-8.el9.x86_64.rpm 18 MB/s | 16 MB 00:00 2024-08-31T04:09:26.263 INFO:teuthology.orchestra.run.smithi050.stdout:(38/150): cephfs-top-19.3.0-4560.gd19e6118.el9. 311 kB/s | 18 kB 00:00 2024-08-31T04:09:26.303 INFO:teuthology.orchestra.run.smithi133.stdout:(114/150): python3-asyncssh-2.13.2-5.el9.noarch 2.7 MB/s | 548 kB 00:00 2024-08-31T04:09:26.329 INFO:teuthology.orchestra.run.smithi133.stdout:(115/150): python3-cachetools-4.2.4-1.el9.noarc 1.4 MB/s | 32 kB 00:00 2024-08-31T04:09:26.336 INFO:teuthology.orchestra.run.smithi177.stdout:(52/150): bison-3.7.4-5.el9.x86_64.rpm 1.1 MB/s | 943 kB 00:00 2024-08-31T04:09:26.361 INFO:teuthology.orchestra.run.smithi177.stdout:(53/150): flexiblas-3.0.4-8.el9.x86_64.rpm 245 kB/s | 33 kB 00:00 2024-08-31T04:09:26.362 INFO:teuthology.orchestra.run.smithi133.stdout:(116/150): python3-bcrypt-3.2.2-1.el9.x86_64.rp 434 kB/s | 43 kB 00:00 2024-08-31T04:09:26.387 INFO:teuthology.orchestra.run.smithi133.stdout:(117/150): python3-certifi-2023.05.07-4.el9.noa 242 kB/s | 14 kB 00:00 2024-08-31T04:09:26.406 INFO:teuthology.orchestra.run.smithi050.stdout:(39/150): ceph-mgr-diskprediction-local-19.3.0- 11 MB/s | 7.4 MB 00:00 2024-08-31T04:09:26.421 INFO:teuthology.orchestra.run.smithi133.stdout:(118/150): python3-cheroot-8.6.0-4.el9.noarch.r 2.9 MB/s | 172 kB 00:00 2024-08-31T04:09:26.446 INFO:teuthology.orchestra.run.smithi133.stdout:(119/150): python3-cherrypy-18.6.1-2.el9.noarch 6.0 MB/s | 358 kB 00:00 2024-08-31T04:09:26.455 INFO:teuthology.orchestra.run.smithi050.stdout:(40/150): fuse-2.9.9-16.el9.x86_64.rpm 368 kB/s | 80 kB 00:00 2024-08-31T04:09:26.461 INFO:teuthology.orchestra.run.smithi177.stdout:(54/150): flexiblas-openblas-openmp-3.0.4-8.el9 182 kB/s | 18 kB 00:00 2024-08-31T04:09:26.480 INFO:teuthology.orchestra.run.smithi133.stdout:(120/150): python3-google-auth-2.34.0-1.el9.noa 6.5 MB/s | 220 kB 00:00 2024-08-31T04:09:26.487 INFO:teuthology.orchestra.run.smithi177.stdout:(55/150): flex-2.6.4-9.el9.x86_64.rpm 872 kB/s | 313 kB 00:00 2024-08-31T04:09:26.505 INFO:teuthology.orchestra.run.smithi133.stdout:(121/150): python3-cmd2-2.4.2-2.el9.noarch.rpm 3.5 MB/s | 303 kB 00:00 2024-08-31T04:09:26.570 INFO:teuthology.orchestra.run.smithi177.stdout:(56/150): libaio-devel-0.3.111-13.el9.x86_64.rp 103 kB/s | 11 kB 00:00 2024-08-31T04:09:26.572 INFO:teuthology.orchestra.run.smithi133.stdout:(122/150): libarrow-9.0.0-11.el9.x86_64.rpm 6.3 MB/s | 4.4 MB 00:00 2024-08-31T04:09:26.596 INFO:teuthology.orchestra.run.smithi177.stdout:(57/150): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.4 MB/s | 160 kB 00:00 2024-08-31T04:09:26.597 INFO:teuthology.orchestra.run.smithi133.stdout:(123/150): python3-jaraco-8.2.1-3.el9.noarch.rp 429 kB/s | 11 kB 00:00 2024-08-31T04:09:26.598 INFO:teuthology.orchestra.run.smithi050.stdout:(41/150): python3-cffi-1.14.5-5.el9.x86_64.rpm 1.7 MB/s | 253 kB 00:00 2024-08-31T04:09:26.623 INFO:teuthology.orchestra.run.smithi133.stdout:(124/150): python3-grpcio-tools-1.46.7-10.el9.x 1.2 MB/s | 144 kB 00:00 2024-08-31T04:09:26.623 INFO:teuthology.orchestra.run.smithi050.stdout:(42/150): libquadmath-11.5.0-2.el9.x86_64.rpm 882 kB/s | 191 kB 00:00 2024-08-31T04:09:26.648 INFO:teuthology.orchestra.run.smithi133.stdout:(125/150): python3-jaraco-classes-3.2.1-5.el9.n 352 kB/s | 18 kB 00:00 2024-08-31T04:09:26.656 INFO:teuthology.orchestra.run.smithi050.stdout:(43/150): libgfortran-11.5.0-2.el9.x86_64.rpm 2.0 MB/s | 801 kB 00:00 2024-08-31T04:09:26.671 INFO:teuthology.orchestra.run.smithi177.stdout:(58/150): librabbitmq-0.11.0-7.el9.x86_64.rpm 451 kB/s | 45 kB 00:00 2024-08-31T04:09:26.673 INFO:teuthology.orchestra.run.smithi133.stdout:(126/150): python3-jaraco-collections-3.0.0-8.e 463 kB/s | 23 kB 00:00 2024-08-31T04:09:26.682 INFO:teuthology.orchestra.run.smithi050.stdout:(44/150): python3-ply-3.11-14.el9.noarch.rpm 1.8 MB/s | 106 kB 00:00 2024-08-31T04:09:26.698 INFO:teuthology.orchestra.run.smithi133.stdout:(127/150): python3-jaraco-functools-3.5.0-2.el9 387 kB/s | 19 kB 00:00 2024-08-31T04:09:26.716 INFO:teuthology.orchestra.run.smithi050.stdout:(45/150): python3-pycparser-2.20-6.el9.noarch.r 2.2 MB/s | 135 kB 00:00 2024-08-31T04:09:26.724 INFO:teuthology.orchestra.run.smithi133.stdout:(128/150): python3-jaraco-text-3.2.0-6.el9.noar 391 kB/s | 20 kB 00:00 2024-08-31T04:09:26.741 INFO:teuthology.orchestra.run.smithi050.stdout:(46/150): python3-requests-2.25.1-8.el9.noarch. 2.1 MB/s | 125 kB 00:00 2024-08-31T04:09:26.749 INFO:teuthology.orchestra.run.smithi133.stdout:(129/150): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-08-31T04:09:26.775 INFO:teuthology.orchestra.run.smithi050.stdout:(47/150): python3-urllib3-1.26.5-6.el9.noarch.r 3.6 MB/s | 215 kB 00:00 2024-08-31T04:09:26.783 INFO:teuthology.orchestra.run.smithi133.stdout:(130/150): python3-more-itertools-8.12.0-2.el9. 2.3 MB/s | 79 kB 00:00 2024-08-31T04:09:26.800 INFO:teuthology.orchestra.run.smithi133.stdout:(131/150): python3-natsort-7.1.1-5.el9.noarch.r 3.4 MB/s | 58 kB 00:00 2024-08-31T04:09:26.805 INFO:teuthology.orchestra.run.smithi177.stdout:(59/150): flexiblas-netlib-3.0.4-8.el9.x86_64.r 6.4 MB/s | 3.0 MB 00:00 2024-08-31T04:09:26.833 INFO:teuthology.orchestra.run.smithi133.stdout:(132/150): python3-kubernetes-26.1.0-2.el9.noar 7.6 MB/s | 1.0 MB 00:00 2024-08-31T04:09:26.850 INFO:teuthology.orchestra.run.smithi133.stdout:(133/150): python3-portend-3.1.0-2.el9.noarch.r 1.0 MB/s | 16 kB 00:00 2024-08-31T04:09:26.876 INFO:teuthology.orchestra.run.smithi133.stdout:(134/150): python3-pyOpenSSL-21.0.0-1.el9.noarc 3.5 MB/s | 90 kB 00:00 2024-08-31T04:09:26.880 INFO:teuthology.orchestra.run.smithi177.stdout:(60/150): librdkafka-1.6.1-102.el9.x86_64.rpm 2.3 MB/s | 662 kB 00:00 2024-08-31T04:09:26.892 INFO:teuthology.orchestra.run.smithi050.stdout:(48/150): python3-cryptography-36.0.1-4.el9.x86 4.2 MB/s | 1.2 MB 00:00 2024-08-31T04:09:26.905 INFO:teuthology.orchestra.run.smithi177.stdout:(61/150): libuuid-devel-2.37.4-20.el9.x86_64.rp 244 kB/s | 24 kB 00:00 2024-08-31T04:09:26.909 INFO:teuthology.orchestra.run.smithi133.stdout:(135/150): python3-pecan-1.4.2-3.el9.noarch.rpm 2.4 MB/s | 272 kB 00:00 2024-08-31T04:09:26.934 INFO:teuthology.orchestra.run.smithi133.stdout:(136/150): python3-pyperclip-1.8.2-2.el9.noarch 481 kB/s | 28 kB 00:00 2024-08-31T04:09:26.939 INFO:teuthology.orchestra.run.smithi177.stdout:(62/150): libtool-2.4.6-46.el9.x86_64.rpm 2.1 MB/s | 581 kB 00:00 2024-08-31T04:09:26.960 INFO:teuthology.orchestra.run.smithi133.stdout:(137/150): python3-repoze-lru-0.7-16.el9.noarch 611 kB/s | 31 kB 00:00 2024-08-31T04:09:26.985 INFO:teuthology.orchestra.run.smithi133.stdout:(138/150): python3-rsa-4.9-2.el9.noarch.rpm 2.3 MB/s | 59 kB 00:00 2024-08-31T04:09:26.989 INFO:teuthology.orchestra.run.smithi177.stdout:(63/150): libzstd-devel-1.5.1-2.el9.x86_64.rpm 435 kB/s | 47 kB 00:00 2024-08-31T04:09:27.010 INFO:teuthology.orchestra.run.smithi133.stdout:(139/150): python3-routes-2.5.1-5.el9.noarch.rp 2.4 MB/s | 188 kB 00:00 2024-08-31T04:09:27.014 INFO:teuthology.orchestra.run.smithi177.stdout:(64/150): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.6 MB/s | 292 kB 00:00 2024-08-31T04:09:27.036 INFO:teuthology.orchestra.run.smithi133.stdout:(140/150): python3-tempora-5.0.0-2.el9.noarch.r 710 kB/s | 36 kB 00:00 2024-08-31T04:09:27.048 INFO:teuthology.orchestra.run.smithi177.stdout:(65/150): lua-5.4.4-4.el9.x86_64.rpm 1.7 MB/s | 188 kB 00:00 2024-08-31T04:09:27.086 INFO:teuthology.orchestra.run.smithi133.stdout:(141/150): python3-grpcio-1.46.7-10.el9.x86_64. 3.4 MB/s | 2.0 MB 00:00 2024-08-31T04:09:27.090 INFO:teuthology.orchestra.run.smithi177.stdout:(66/150): openblas-0.3.26-2.el9.x86_64.rpm 383 kB/s | 38 kB 00:00 2024-08-31T04:09:27.111 INFO:teuthology.orchestra.run.smithi133.stdout:(142/150): python3-typing-extensions-4.12.2-2.e 991 kB/s | 74 kB 00:00 2024-08-31T04:09:27.137 INFO:teuthology.orchestra.run.smithi133.stdout:(143/150): python3-websocket-client-1.2.3-2.el9 1.7 MB/s | 90 kB 00:00 2024-08-31T04:09:27.162 INFO:teuthology.orchestra.run.smithi133.stdout:(144/150): python3-webob-1.8.8-2.el9.noarch.rpm 1.8 MB/s | 230 kB 00:00 2024-08-31T04:09:27.187 INFO:teuthology.orchestra.run.smithi133.stdout:(145/150): python3-zc-lockfile-2.0-10.el9.noarc 398 kB/s | 20 kB 00:00 2024-08-31T04:09:27.212 INFO:teuthology.orchestra.run.smithi133.stdout:(146/150): re2-20211101-20.el9.x86_64.rpm 3.7 MB/s | 191 kB 00:00 2024-08-31T04:09:27.238 INFO:teuthology.orchestra.run.smithi133.stdout:(147/150): python3-werkzeug-2.0.3-3.el9.1.noarc 3.3 MB/s | 427 kB 00:00 2024-08-31T04:09:27.288 INFO:teuthology.orchestra.run.smithi133.stdout:(148/150): thrift-0.15.0-2.el9.x86_64.rpm 16 MB/s | 1.6 MB 00:00 2024-08-31T04:09:27.373 INFO:teuthology.orchestra.run.smithi177.stdout:(67/150): postgresql-13.16-1.el9.x86_64.rpm 5.6 MB/s | 1.6 MB 00:00 2024-08-31T04:09:27.490 INFO:teuthology.orchestra.run.smithi177.stdout:(68/150): postgresql-contrib-13.16-1.el9.x86_64 7.6 MB/s | 910 kB 00:00 2024-08-31T04:09:27.538 INFO:teuthology.orchestra.run.smithi133.stdout:(149/150): librados2-19.3.0-4560.gd19e6118.el9. 10 MB/s | 3.4 MB 00:00 2024-08-31T04:09:27.550 INFO:teuthology.orchestra.run.smithi050.stdout:(49/150): boost-program-options-1.75.0-8.el9.x8 162 kB/s | 107 kB 00:00 2024-08-31T04:09:27.599 INFO:teuthology.orchestra.run.smithi177.stdout:(69/150): postgresql-private-libs-13.16-1.el9.x 1.2 MB/s | 137 kB 00:00 2024-08-31T04:09:27.605 INFO:teuthology.orchestra.run.smithi133.stdout:(150/150): librbd1-19.3.0-4560.gd19e6118.el9.x8 8.6 MB/s | 3.1 MB 00:00 2024-08-31T04:09:27.609 INFO:teuthology.orchestra.run.smithi050.stdout:(50/150): automake-1.16.2-8.el9.noarch.rpm 794 kB/s | 689 kB 00:00 2024-08-31T04:09:27.612 INFO:teuthology.orchestra.run.smithi133.stdout:-------------------------------------------------------------------------------- 2024-08-31T04:09:27.612 INFO:teuthology.orchestra.run.smithi133.stdout:Total 21 MB/s | 224 MB 00:10 2024-08-31T04:09:27.676 INFO:teuthology.orchestra.run.smithi050.stdout:(51/150): bison-3.7.4-5.el9.x86_64.rpm 1.0 MB/s | 943 kB 00:00 2024-08-31T04:09:28.101 INFO:teuthology.orchestra.run.smithi050.stdout:(52/150): elfutils-libelf-devel-0.191-4.el9.x86 39 kB/s | 22 kB 00:00 2024-08-31T04:09:28.324 INFO:teuthology.orchestra.run.smithi050.stdout:(53/150): flexiblas-3.0.4-8.el9.x86_64.rpm 59 kB/s | 33 kB 00:00 2024-08-31T04:09:28.418 INFO:teuthology.orchestra.run.smithi050.stdout:(54/150): flex-2.6.4-9.el9.x86_64.rpm 388 kB/s | 313 kB 00:00 2024-08-31T04:09:28.710 INFO:teuthology.orchestra.run.smithi050.stdout:(55/150): flexiblas-openblas-openmp-3.0.4-8.el9 38 kB/s | 18 kB 00:00 2024-08-31T04:09:28.720 INFO:teuthology.orchestra.run.smithi133.stdout:Running transaction check 2024-08-31T04:09:28.848 INFO:teuthology.orchestra.run.smithi133.stdout:Transaction check succeeded. 2024-08-31T04:09:28.848 INFO:teuthology.orchestra.run.smithi133.stdout:Running transaction test 2024-08-31T04:09:28.894 INFO:teuthology.orchestra.run.smithi050.stdout:(56/150): libaio-devel-0.3.111-13.el9.x86_64.rp 23 kB/s | 11 kB 00:00 2024-08-31T04:09:29.328 INFO:teuthology.orchestra.run.smithi050.stdout:(57/150): flexiblas-netlib-3.0.4-8.el9.x86_64.r 2.4 MB/s | 3.0 MB 00:01 2024-08-31T04:09:29.437 INFO:teuthology.orchestra.run.smithi050.stdout:(58/150): libpmemobj-1.12.1-1.el9.x86_64.rpm 221 kB/s | 160 kB 00:00 2024-08-31T04:09:29.545 INFO:teuthology.orchestra.run.smithi050.stdout:(59/150): librabbitmq-0.11.0-7.el9.x86_64.rpm 70 kB/s | 45 kB 00:00 2024-08-31T04:09:29.899 INFO:teuthology.orchestra.run.smithi177.stdout:(70/150): openssl-devel-3.2.2-4.el9.x86_64.rpm 1.6 MB/s | 4.4 MB 00:02 2024-08-31T04:09:30.162 INFO:teuthology.orchestra.run.smithi050.stdout:(60/150): libuuid-devel-2.37.4-20.el9.x86_64.rp 40 kB/s | 24 kB 00:00 2024-08-31T04:09:30.216 INFO:teuthology.orchestra.run.smithi050.stdout:(61/150): librdkafka-1.6.1-102.el9.x86_64.rpm 746 kB/s | 662 kB 00:00 2024-08-31T04:09:30.304 INFO:teuthology.orchestra.run.smithi050.stdout:(62/150): libtool-2.4.6-46.el9.x86_64.rpm 670 kB/s | 581 kB 00:00 2024-08-31T04:09:30.602 INFO:teuthology.orchestra.run.smithi133.stdout:Transaction test succeeded. 2024-08-31T04:09:30.602 INFO:teuthology.orchestra.run.smithi133.stdout:Running transaction 2024-08-31T04:09:30.755 INFO:teuthology.orchestra.run.smithi050.stdout:(63/150): libzstd-devel-1.5.1-2.el9.x86_64.rpm 80 kB/s | 47 kB 00:00 2024-08-31T04:09:31.039 INFO:teuthology.orchestra.run.smithi050.stdout:(64/150): lttng-ust-2.12.0-6.el9.x86_64.rpm 356 kB/s | 292 kB 00:00 2024-08-31T04:09:31.114 INFO:teuthology.orchestra.run.smithi050.stdout:(65/150): lua-5.4.4-4.el9.x86_64.rpm 233 kB/s | 188 kB 00:00 2024-08-31T04:09:31.274 INFO:teuthology.orchestra.run.smithi177.stdout:(71/150): openblas-openmp-0.3.26-2.el9.x86_64.r 1.2 MB/s | 4.9 MB 00:04 2024-08-31T04:09:31.322 INFO:teuthology.orchestra.run.smithi050.stdout:(66/150): openblas-0.3.26-2.el9.x86_64.rpm 68 kB/s | 38 kB 00:00 2024-08-31T04:09:31.374 INFO:teuthology.orchestra.run.smithi177.stdout:(72/150): protobuf-3.14.0-13.el9.x86_64.rpm 701 kB/s | 1.0 MB 00:01 2024-08-31T04:09:31.483 INFO:teuthology.orchestra.run.smithi177.stdout:(73/150): python3-attrs-20.3.0-7.el9.noarch.rpm 420 kB/s | 87 kB 00:00 2024-08-31T04:09:31.583 INFO:teuthology.orchestra.run.smithi177.stdout:(74/150): python3-colorama-0.4.6-3.el9.noarch.r 613 kB/s | 61 kB 00:00 2024-08-31T04:09:31.925 INFO:teuthology.orchestra.run.smithi177.stdout:(75/150): python3-devel-3.9.19-8.el9.x86_64.rpm 716 kB/s | 245 kB 00:00 2024-08-31T04:09:32.156 INFO:teuthology.orchestra.run.smithi050.stdout:(67/150): openblas-openmp-0.3.26-2.el9.x86_64.r 4.4 MB/s | 4.9 MB 00:01 2024-08-31T04:09:32.256 INFO:teuthology.orchestra.run.smithi050.stdout:(68/150): openssl-devel-3.2.2-4.el9.x86_64.rpm 3.9 MB/s | 4.4 MB 00:01 2024-08-31T04:09:32.275 INFO:teuthology.orchestra.run.smithi177.stdout:(76/150): python3-jinja2-2.11.3-6.el9.noarch.rp 709 kB/s | 248 kB 00:00 2024-08-31T04:09:32.367 INFO:teuthology.orchestra.run.smithi177.stdout:(77/150): python3-jsonpatch-1.21-16.el9.noarch. 280 kB/s | 26 kB 00:00 2024-08-31T04:09:32.467 INFO:teuthology.orchestra.run.smithi177.stdout:(78/150): python3-jsonpointer-2.0-4.el9.noarch. 192 kB/s | 19 kB 00:00 2024-08-31T04:09:32.481 INFO:teuthology.orchestra.run.smithi050.stdout:(69/150): postgresql-13.16-1.el9.x86_64.rpm 1.4 MB/s | 1.6 MB 00:01 2024-08-31T04:09:32.751 INFO:teuthology.orchestra.run.smithi177.stdout:(79/150): python3-mako-1.1.4-6.el9.noarch.rpm 607 kB/s | 172 kB 00:00 2024-08-31T04:09:32.859 INFO:teuthology.orchestra.run.smithi177.stdout:(80/150): python3-markupsafe-1.1.1-12.el9.x86_6 321 kB/s | 35 kB 00:00 2024-08-31T04:09:33.015 INFO:teuthology.orchestra.run.smithi050.stdout:(70/150): postgresql-private-libs-13.16-1.el9.x 181 kB/s | 137 kB 00:00 2024-08-31T04:09:33.059 INFO:teuthology.orchestra.run.smithi177.stdout:(81/150): postgresql-server-13.16-1.el9.x86_64. 1.1 MB/s | 5.8 MB 00:05 2024-08-31T04:09:33.065 INFO:teuthology.orchestra.run.smithi050.stdout:(71/150): postgresql-contrib-13.16-1.el9.x86_64 1.0 MB/s | 910 kB 00:00 2024-08-31T04:09:33.410 INFO:teuthology.orchestra.run.smithi177.stdout:(82/150): python3-numpy-f2py-1.20.1-5.el9.x86_6 716 kB/s | 250 kB 00:00 2024-08-31T04:09:33.683 INFO:teuthology.orchestra.run.smithi050.stdout:(72/150): postgresql-server-13.16-1.el9.x86_64. 4.8 MB/s | 5.8 MB 00:01 2024-08-31T04:09:33.708 INFO:teuthology.orchestra.run.smithi050.stdout:(73/150): python3-attrs-20.3.0-7.el9.noarch.rpm 136 kB/s | 87 kB 00:00 2024-08-31T04:09:33.769 INFO:teuthology.orchestra.run.smithi177.stdout:(83/150): python3-oauthlib-3.1.1-5.el9.noarch.r 620 kB/s | 222 kB 00:00 2024-08-31T04:09:33.952 INFO:teuthology.orchestra.run.smithi177.stdout:(84/150): python3-packaging-20.9-5.el9.noarch.r 421 kB/s | 77 kB 00:00 2024-08-31T04:09:34.008 INFO:teuthology.orchestra.run.smithi050.stdout:(74/150): protobuf-3.14.0-13.el9.x86_64.rpm 1.0 MB/s | 1.0 MB 00:00 2024-08-31T04:09:34.061 INFO:teuthology.orchestra.run.smithi177.stdout:(85/150): python3-prettytable-0.7.2-27.el9.noar 391 kB/s | 42 kB 00:00 2024-08-31T04:09:34.317 INFO:teuthology.orchestra.run.smithi050.stdout:(75/150): python3-colorama-0.4.6-3.el9.noarch.r 101 kB/s | 61 kB 00:00 2024-08-31T04:09:34.486 INFO:teuthology.orchestra.run.smithi177.stdout:(86/150): python3-protobuf-3.14.0-13.el9.noarch 634 kB/s | 269 kB 00:00 2024-08-31T04:09:34.744 INFO:teuthology.orchestra.run.smithi177.stdout:(87/150): python3-pyasn1-0.4.8-6.el9.noarch.rpm 615 kB/s | 159 kB 00:00 2024-08-31T04:09:34.859 INFO:teuthology.orchestra.run.smithi050.stdout:(76/150): python3-babel-2.9.1-2.el9.noarch.rpm 5.1 MB/s | 6.0 MB 00:01 2024-08-31T04:09:34.884 INFO:teuthology.orchestra.run.smithi050.stdout:(77/150): python3-devel-3.9.19-8.el9.x86_64.rpm 280 kB/s | 245 kB 00:00 2024-08-31T04:09:35.134 INFO:teuthology.orchestra.run.smithi050.stdout:(78/150): python3-jinja2-2.11.3-6.el9.noarch.rp 304 kB/s | 248 kB 00:00 2024-08-31T04:09:35.170 INFO:teuthology.orchestra.run.smithi177.stdout:(88/150): python3-pyasn1-modules-0.4.8-6.el9.no 656 kB/s | 279 kB 00:00 2024-08-31T04:09:35.270 INFO:teuthology.orchestra.run.smithi177.stdout:(89/150): python3-pytz-2021.1-5.el9.noarch.rpm 510 kB/s | 51 kB 00:00 2024-08-31T04:09:35.370 INFO:teuthology.orchestra.run.smithi177.stdout:(90/150): python3-requests-oauthlib-1.3.0-12.el 537 kB/s | 54 kB 00:00 2024-08-31T04:09:35.418 INFO:teuthology.orchestra.run.smithi050.stdout:(79/150): python3-jsonpatch-1.21-16.el9.noarch. 46 kB/s | 26 kB 00:00 2024-08-31T04:09:35.451 INFO:teuthology.orchestra.run.smithi050.stdout:(80/150): python3-jsonpointer-2.0-4.el9.noarch. 34 kB/s | 19 kB 00:00 2024-08-31T04:09:35.877 INFO:teuthology.orchestra.run.smithi050.stdout:(81/150): python3-mako-1.1.4-6.el9.noarch.rpm 236 kB/s | 172 kB 00:00 2024-08-31T04:09:35.977 INFO:teuthology.orchestra.run.smithi050.stdout:(82/150): python3-markupsafe-1.1.1-12.el9.x86_6 62 kB/s | 35 kB 00:00 2024-08-31T04:09:36.561 INFO:teuthology.orchestra.run.smithi050.stdout:(83/150): python3-numpy-1.20.1-5.el9.x86_64.rpm 4.6 MB/s | 5.1 MB 00:01 2024-08-31T04:09:36.605 INFO:teuthology.orchestra.run.smithi133.stdout: Preparing : 1/1 2024-08-31T04:09:36.682 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : thrift-0.15.0-2.el9.x86_64 1/152 2024-08-31T04:09:36.707 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 2/152 2024-08-31T04:09:36.711 INFO:teuthology.orchestra.run.smithi050.stdout:(84/150): python3-oauthlib-3.1.1-5.el9.noarch.r 303 kB/s | 222 kB 00:00 2024-08-31T04:09:36.750 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 3/152 2024-08-31T04:09:36.772 INFO:teuthology.orchestra.run.smithi050.stdout:(85/150): python3-numpy-f2py-1.20.1-5.el9.x86_6 280 kB/s | 250 kB 00:00 2024-08-31T04:09:37.091 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 4/152 2024-08-31T04:09:37.204 INFO:teuthology.orchestra.run.smithi050.stdout:(86/150): python3-packaging-20.9-5.el9.noarch.r 120 kB/s | 77 kB 00:00 2024-08-31T04:09:37.225 INFO:teuthology.orchestra.run.smithi133.stdout: Upgrading : librados2-2:19.3.0-4560.gd19e6118.el9.x86_64 5/152 2024-08-31T04:09:37.304 INFO:teuthology.orchestra.run.smithi050.stdout:(87/150): python3-prettytable-0.7.2-27.el9.noar 72 kB/s | 42 kB 00:00 2024-08-31T04:09:37.351 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: librados2-2:19.3.0-4560.gd19e6118.el9.x86_64 5/152 2024-08-31T04:09:37.384 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : libcephfs2-2:19.3.0-4560.gd19e6118.el9.x86_64 6/152 2024-08-31T04:09:37.468 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: libcephfs2-2:19.3.0-4560.gd19e6118.el9.x86_64 6/152 2024-08-31T04:09:37.509 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-rados-2:19.3.0-4560.gd19e6118.el9.x86_64 7/152 2024-08-31T04:09:37.539 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 8/152 2024-08-31T04:09:37.554 INFO:teuthology.orchestra.run.smithi050.stdout:(88/150): python3-protobuf-3.14.0-13.el9.noarch 344 kB/s | 269 kB 00:00 2024-08-31T04:09:37.564 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 9/152 2024-08-31T04:09:37.720 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 10/152 2024-08-31T04:09:37.770 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : postgresql-13.16-1.el9.x86_64 11/152 2024-08-31T04:09:37.790 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : libcephsqlite-2:19.3.0-4560.gd19e6118.el9.x86_64 12/152 2024-08-31T04:09:37.888 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: libcephsqlite-2:19.3.0-4560.gd19e6118.el9.x86_64 12/152 2024-08-31T04:09:37.962 INFO:teuthology.orchestra.run.smithi050.stdout:(89/150): python3-pyasn1-0.4.8-6.el9.noarch.rpm 209 kB/s | 159 kB 00:00 2024-08-31T04:09:38.071 INFO:teuthology.orchestra.run.smithi050.stdout:(90/150): python3-pyasn1-modules-0.4.8-6.el9.no 364 kB/s | 279 kB 00:00 2024-08-31T04:09:38.077 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : libradosstriper1-2:19.3.0-4560.gd19e6118.el9.x86 13/152 2024-08-31T04:09:38.145 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: libradosstriper1-2:19.3.0-4560.gd19e6118.el9.x86 13/152 2024-08-31T04:09:38.175 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 14/152 2024-08-31T04:09:38.199 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 14/152 2024-08-31T04:09:38.221 INFO:teuthology.orchestra.run.smithi050.stdout:(91/150): python3-pytz-2021.1-5.el9.noarch.rpm 77 kB/s | 51 kB 00:00 2024-08-31T04:09:38.496 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 15/152 2024-08-31T04:09:38.524 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 15/152 2024-08-31T04:09:38.622 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : re2-1:20211101-20.el9.x86_64 16/152 2024-08-31T04:09:38.656 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 17/152 2024-08-31T04:09:38.691 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : liboath-2.6.7-2.el9.x86_64 18/152 2024-08-31T04:09:38.705 INFO:teuthology.orchestra.run.smithi050.stdout:(92/150): python3-requests-oauthlib-1.3.0-12.el 72 kB/s | 54 kB 00:00 2024-08-31T04:09:38.765 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 19/152 2024-08-31T04:09:38.809 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 20/152 2024-08-31T04:09:38.845 INFO:teuthology.orchestra.run.smithi177.stdout:(91/150): python3-babel-2.9.1-2.el9.noarch.rpm 817 kB/s | 6.0 MB 00:07 2024-08-31T04:09:38.849 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-packaging-20.9-5.el9.noarch 21/152 2024-08-31T04:09:38.892 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 22/152 2024-08-31T04:09:38.921 INFO:teuthology.orchestra.run.smithi177.stdout:(92/150): python3-numpy-1.20.1-5.el9.x86_64.rpm 861 kB/s | 5.1 MB 00:06 2024-08-31T04:09:38.925 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 23/152 2024-08-31T04:09:38.946 INFO:teuthology.orchestra.run.smithi177.stdout:(93/150): python3-toml-0.10.2-6.el9.noarch.rpm 416 kB/s | 42 kB 00:00 2024-08-31T04:09:38.953 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : lua-5.4.4-4.el9.x86_64 24/152 2024-08-31T04:09:38.989 INFO:teuthology.orchestra.run.smithi050.stdout:(93/150): python3-toml-0.10.2-6.el9.noarch.rpm 54 kB/s | 42 kB 00:00 2024-08-31T04:09:39.021 INFO:teuthology.orchestra.run.smithi177.stdout:(94/150): python3-wcwidth-0.2.5-8.el9.noarch.rp 441 kB/s | 44 kB 00:00 2024-08-31T04:09:39.022 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 25/152 2024-08-31T04:09:39.055 INFO:teuthology.orchestra.run.smithi177.stdout:(95/150): qatlib-24.02.0-1.el9.x86_64.rpm 2.0 MB/s | 221 kB 00:00 2024-08-31T04:09:39.075 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 26/152 2024-08-31T04:09:39.105 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 27/152 2024-08-31T04:09:39.122 INFO:teuthology.orchestra.run.smithi177.stdout:(96/150): qatlib-service-24.02.0-1.el9.x86_64.r 358 kB/s | 36 kB 00:00 2024-08-31T04:09:39.140 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 28/152 2024-08-31T04:09:39.155 INFO:teuthology.orchestra.run.smithi177.stdout:(97/150): qatzip-libs-1.2.0-1.el9.x86_64.rpm 473 kB/s | 47 kB 00:00 2024-08-31T04:09:39.209 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 29/152 2024-08-31T04:09:39.230 INFO:teuthology.orchestra.run.smithi177.stdout:(98/150): socat-1.7.4.1-6.el9.x86_64.rpm 2.7 MB/s | 304 kB 00:00 2024-08-31T04:09:39.243 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-ceph-common-2:19.3.0-4560.gd19e6118.el9. 30/152 2024-08-31T04:09:39.264 INFO:teuthology.orchestra.run.smithi177.stdout:(99/150): uuid-1.6.2-55.el9.x86_64.rpm 533 kB/s | 58 kB 00:00 2024-08-31T04:09:39.287 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-ceph-argparse-2:19.3.0-4560.gd19e6118.el 31/152 2024-08-31T04:09:39.289 INFO:teuthology.orchestra.run.smithi050.stdout:(94/150): python3-wcwidth-0.2.5-8.el9.noarch.rp 76 kB/s | 44 kB 00:00 2024-08-31T04:09:39.315 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-cephfs-2:19.3.0-4560.gd19e6118.el9.x86_6 32/152 2024-08-31T04:09:39.339 INFO:teuthology.orchestra.run.smithi177.stdout:(100/150): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 882 kB/s | 96 kB 00:00 2024-08-31T04:09:39.373 INFO:teuthology.orchestra.run.smithi177.stdout:(101/150): xmlstarlet-1.6.1-20.el9.x86_64.rpm 587 kB/s | 64 kB 00:00 2024-08-31T04:09:39.387 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 33/152 2024-08-31T04:09:39.430 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : luarocks-3.9.2-5.el9.noarch 34/152 2024-08-31T04:09:39.440 INFO:teuthology.orchestra.run.smithi177.stdout:(102/150): zlib-devel-1.2.11-41.el9.x86_64.rpm 447 kB/s | 45 kB 00:00 2024-08-31T04:09:39.465 INFO:teuthology.orchestra.run.smithi177.stdout:(103/150): lua-devel-5.4.4-4.el9.x86_64.rpm 243 kB/s | 22 kB 00:00 2024-08-31T04:09:39.505 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 35/152 2024-08-31T04:09:39.557 INFO:teuthology.orchestra.run.smithi177.stdout:(104/150): abseil-cpp-20211102.0-3.el9.x86_64.r 5.8 MB/s | 548 kB 00:00 2024-08-31T04:09:39.590 INFO:teuthology.orchestra.run.smithi177.stdout:(105/150): gperftools-libs-2.9.1-2.el9.x86_64.r 9.1 MB/s | 309 kB 00:00 2024-08-31T04:09:39.614 INFO:teuthology.orchestra.run.smithi050.stdout:(95/150): python3-scipy-1.6.2-8.el9.x86_64.rpm 11 MB/s | 16 MB 00:01 2024-08-31T04:09:39.615 INFO:teuthology.orchestra.run.smithi177.stdout:(106/150): grpc-data-1.46.7-10.el9.noarch.rpm 779 kB/s | 19 kB 00:00 2024-08-31T04:09:39.644 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 36/152 2024-08-31T04:09:39.701 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 37/152 2024-08-31T04:09:39.815 INFO:teuthology.orchestra.run.smithi050.stdout:(96/150): qatlib-24.02.0-1.el9.x86_64.rpm 267 kB/s | 221 kB 00:00 2024-08-31T04:09:39.816 INFO:teuthology.orchestra.run.smithi177.stdout:(107/150): libarrow-9.0.0-11.el9.x86_64.rpm 22 MB/s | 4.4 MB 00:00 2024-08-31T04:09:39.841 INFO:teuthology.orchestra.run.smithi177.stdout:(108/150): protobuf-compiler-3.14.0-13.el9.x86_ 2.1 MB/s | 863 kB 00:00 2024-08-31T04:09:39.866 INFO:teuthology.orchestra.run.smithi177.stdout:(109/150): libarrow-doc-9.0.0-11.el9.noarch.rpm 519 kB/s | 26 kB 00:00 2024-08-31T04:09:39.900 INFO:teuthology.orchestra.run.smithi177.stdout:(110/150): libunwind-1.6.2-1.el9.x86_64.rpm 2.6 MB/s | 67 kB 00:00 2024-08-31T04:09:39.934 INFO:teuthology.orchestra.run.smithi177.stdout:(111/150): luarocks-3.9.2-5.el9.noarch.rpm 4.7 MB/s | 151 kB 00:00 2024-08-31T04:09:39.959 INFO:teuthology.orchestra.run.smithi177.stdout:(112/150): liboath-2.6.7-2.el9.x86_64.rpm 413 kB/s | 49 kB 00:00 2024-08-31T04:09:39.993 INFO:teuthology.orchestra.run.smithi177.stdout:(113/150): parquet-libs-9.0.0-11.el9.x86_64.rpm 14 MB/s | 839 kB 00:00 2024-08-31T04:09:40.018 INFO:teuthology.orchestra.run.smithi177.stdout:(114/150): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.7 MB/s | 43 kB 00:00 2024-08-31T04:09:40.040 INFO:teuthology.orchestra.run.smithi050.stdout:(97/150): qatlib-service-24.02.0-1.el9.x86_64.r 48 kB/s | 36 kB 00:00 2024-08-31T04:09:40.043 INFO:teuthology.orchestra.run.smithi177.stdout:(115/150): python3-cachetools-4.2.4-1.el9.noarc 1.3 MB/s | 32 kB 00:00 2024-08-31T04:09:40.074 INFO:teuthology.orchestra.run.smithi177.stdout:(116/150): python3-asyncssh-2.13.2-5.el9.noarch 4.7 MB/s | 548 kB 00:00 2024-08-31T04:09:40.100 INFO:teuthology.orchestra.run.smithi177.stdout:(117/150): python3-certifi-2023.05.07-4.el9.noa 251 kB/s | 14 kB 00:00 2024-08-31T04:09:40.125 INFO:teuthology.orchestra.run.smithi177.stdout:(118/150): python3-cheroot-8.6.0-4.el9.noarch.r 3.4 MB/s | 172 kB 00:00 2024-08-31T04:09:40.150 INFO:teuthology.orchestra.run.smithi177.stdout:(119/150): python3-cherrypy-18.6.1-2.el9.noarch 7.0 MB/s | 358 kB 00:00 2024-08-31T04:09:40.175 INFO:teuthology.orchestra.run.smithi177.stdout:(120/150): python3-cmd2-2.4.2-2.el9.noarch.rpm 5.9 MB/s | 303 kB 00:00 2024-08-31T04:09:40.199 INFO:teuthology.orchestra.run.smithi050.stdout:(98/150): qatzip-libs-1.2.0-1.el9.x86_64.rpm 81 kB/s | 47 kB 00:00 2024-08-31T04:09:40.200 INFO:teuthology.orchestra.run.smithi177.stdout:(121/150): python3-google-auth-2.34.0-1.el9.noa 4.3 MB/s | 220 kB 00:00 2024-08-31T04:09:40.234 INFO:teuthology.orchestra.run.smithi177.stdout:(122/150): python3-grpcio-tools-1.46.7-10.el9.x 4.2 MB/s | 144 kB 00:00 2024-08-31T04:09:40.256 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-rsa-4.9-2.el9.noarch 38/152 2024-08-31T04:09:40.268 INFO:teuthology.orchestra.run.smithi177.stdout:(123/150): python3-jaraco-8.2.1-3.el9.noarch.rp 320 kB/s | 11 kB 00:00 2024-08-31T04:09:40.293 INFO:teuthology.orchestra.run.smithi177.stdout:(124/150): python3-jaraco-classes-3.2.1-5.el9.n 715 kB/s | 18 kB 00:00 2024-08-31T04:09:40.318 INFO:teuthology.orchestra.run.smithi177.stdout:(125/150): python3-jaraco-collections-3.0.0-8.e 958 kB/s | 23 kB 00:00 2024-08-31T04:09:40.338 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 39/152 2024-08-31T04:09:40.343 INFO:teuthology.orchestra.run.smithi177.stdout:(126/150): python3-jaraco-functools-3.5.0-2.el9 783 kB/s | 19 kB 00:00 2024-08-31T04:09:40.365 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 40/152 2024-08-31T04:09:40.369 INFO:teuthology.orchestra.run.smithi177.stdout:(127/150): python3-jaraco-text-3.2.0-6.el9.noar 785 kB/s | 20 kB 00:00 2024-08-31T04:09:40.408 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 41/152 2024-08-31T04:09:40.436 INFO:teuthology.orchestra.run.smithi177.stdout:(128/150): python3-grpcio-1.46.7-10.el9.x86_64. 7.8 MB/s | 2.0 MB 00:00 2024-08-31T04:09:40.438 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : librados-devel-2:19.3.0-4560.gd19e6118.el9.x86_6 42/152 2024-08-31T04:09:40.461 INFO:teuthology.orchestra.run.smithi177.stdout:(129/150): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-08-31T04:09:40.471 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 43/152 2024-08-31T04:09:40.495 INFO:teuthology.orchestra.run.smithi177.stdout:(130/150): python3-kubernetes-26.1.0-2.el9.noar 8.1 MB/s | 1.0 MB 00:00 2024-08-31T04:09:40.520 INFO:teuthology.orchestra.run.smithi177.stdout:(131/150): python3-more-itertools-8.12.0-2.el9. 1.3 MB/s | 79 kB 00:00 2024-08-31T04:09:40.545 INFO:teuthology.orchestra.run.smithi177.stdout:(132/150): python3-natsort-7.1.1-5.el9.noarch.r 1.1 MB/s | 58 kB 00:00 2024-08-31T04:09:40.563 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 44/152 2024-08-31T04:09:40.571 INFO:teuthology.orchestra.run.smithi177.stdout:(133/150): python3-portend-3.1.0-2.el9.noarch.r 661 kB/s | 16 kB 00:00 2024-08-31T04:09:40.595 INFO:teuthology.orchestra.run.smithi177.stdout:(134/150): python3-pecan-1.4.2-3.el9.noarch.rpm 3.5 MB/s | 272 kB 00:00 2024-08-31T04:09:40.607 INFO:teuthology.orchestra.run.smithi050.stdout:(99/150): socat-1.7.4.1-6.el9.x86_64.rpm 384 kB/s | 304 kB 00:00 2024-08-31T04:09:40.621 INFO:teuthology.orchestra.run.smithi177.stdout:(135/150): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.8 MB/s | 90 kB 00:00 2024-08-31T04:09:40.627 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 45/152 2024-08-31T04:09:40.646 INFO:teuthology.orchestra.run.smithi177.stdout:(136/150): python3-pyperclip-1.8.2-2.el9.noarch 561 kB/s | 28 kB 00:00 2024-08-31T04:09:40.671 INFO:teuthology.orchestra.run.smithi177.stdout:(137/150): python3-repoze-lru-0.7-16.el9.noarch 613 kB/s | 31 kB 00:00 2024-08-31T04:09:40.697 INFO:teuthology.orchestra.run.smithi177.stdout:(138/150): python3-routes-2.5.1-5.el9.noarch.rp 3.7 MB/s | 188 kB 00:00 2024-08-31T04:09:40.699 INFO:teuthology.orchestra.run.smithi050.stdout:(100/150): uuid-1.6.2-55.el9.x86_64.rpm 89 kB/s | 58 kB 00:00 2024-08-31T04:09:40.702 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 46/152 2024-08-31T04:09:40.722 INFO:teuthology.orchestra.run.smithi177.stdout:(139/150): python3-rsa-4.9-2.el9.noarch.rpm 1.1 MB/s | 59 kB 00:00 2024-08-31T04:09:40.740 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 47/152 2024-08-31T04:09:40.747 INFO:teuthology.orchestra.run.smithi177.stdout:(140/150): python3-tempora-5.0.0-2.el9.noarch.r 713 kB/s | 36 kB 00:00 2024-08-31T04:09:40.772 INFO:teuthology.orchestra.run.smithi177.stdout:(141/150): python3-typing-extensions-4.12.2-2.e 1.5 MB/s | 74 kB 00:00 2024-08-31T04:09:40.776 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 48/152 2024-08-31T04:09:40.806 INFO:teuthology.orchestra.run.smithi177.stdout:(142/150): python3-websocket-client-1.2.3-2.el9 2.6 MB/s | 90 kB 00:00 2024-08-31T04:09:40.822 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 49/152 2024-08-31T04:09:40.831 INFO:teuthology.orchestra.run.smithi177.stdout:(143/150): python3-webob-1.8.8-2.el9.noarch.rpm 2.7 MB/s | 230 kB 00:00 2024-08-31T04:09:40.849 INFO:teuthology.orchestra.run.smithi177.stdout:(144/150): python3-zc-lockfile-2.0-10.el9.noarc 1.2 MB/s | 20 kB 00:00 2024-08-31T04:09:40.849 INFO:teuthology.orchestra.run.smithi050.stdout:(101/150): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 147 kB/s | 96 kB 00:00 2024-08-31T04:09:40.860 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 50/152 2024-08-31T04:09:40.874 INFO:teuthology.orchestra.run.smithi177.stdout:(145/150): python3-werkzeug-2.0.3-3.el9.1.noarc 6.2 MB/s | 427 kB 00:00 2024-08-31T04:09:40.899 INFO:teuthology.orchestra.run.smithi177.stdout:(146/150): re2-20211101-20.el9.x86_64.rpm 3.7 MB/s | 191 kB 00:00 2024-08-31T04:09:40.904 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 51/152 2024-08-31T04:09:40.925 INFO:teuthology.orchestra.run.smithi050.stdout:(102/150): lua-devel-5.4.4-4.el9.x86_64.rpm 299 kB/s | 22 kB 00:00 2024-08-31T04:09:40.946 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 52/152 2024-08-31T04:09:40.966 INFO:teuthology.orchestra.run.smithi177.stdout:(147/150): thrift-0.15.0-2.el9.x86_64.rpm 17 MB/s | 1.6 MB 00:00 2024-08-31T04:09:41.059 INFO:teuthology.orchestra.run.smithi050.stdout:(103/150): protobuf-compiler-3.14.0-13.el9.x86_ 6.9 MB/s | 863 kB 00:00 2024-08-31T04:09:41.084 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 53/152 2024-08-31T04:09:41.131 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 54/152 2024-08-31T04:09:41.142 INFO:teuthology.orchestra.run.smithi050.stdout:(104/150): abseil-cpp-20211102.0-3.el9.x86_64.r 6.5 MB/s | 548 kB 00:00 2024-08-31T04:09:41.172 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 55/152 2024-08-31T04:09:41.184 INFO:teuthology.orchestra.run.smithi050.stdout:(105/150): gperftools-libs-2.9.1-2.el9.x86_64.r 7.3 MB/s | 309 kB 00:00 2024-08-31T04:09:41.209 INFO:teuthology.orchestra.run.smithi050.stdout:(106/150): grpc-data-1.46.7-10.el9.noarch.rpm 790 kB/s | 19 kB 00:00 2024-08-31T04:09:41.225 INFO:teuthology.orchestra.run.smithi177.stdout:(148/150): librados2-19.3.0-4560.gd19e6118.el9. 10 MB/s | 3.4 MB 00:00 2024-08-31T04:09:41.277 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 56/152 2024-08-31T04:09:41.283 INFO:teuthology.orchestra.run.smithi177.stdout:(149/150): librbd1-19.3.0-4560.gd19e6118.el9.x8 9.9 MB/s | 3.1 MB 00:00 2024-08-31T04:09:41.301 INFO:teuthology.orchestra.run.smithi050.stdout:(107/150): zlib-devel-1.2.11-41.el9.x86_64.rpm 74 kB/s | 45 kB 00:00 2024-08-31T04:09:41.314 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 57/152 2024-08-31T04:09:41.326 INFO:teuthology.orchestra.run.smithi050.stdout:(108/150): xmlstarlet-1.6.1-20.el9.x86_64.rpm 89 kB/s | 64 kB 00:00 2024-08-31T04:09:41.353 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 58/152 2024-08-31T04:09:41.379 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 59/152 2024-08-31T04:09:41.385 INFO:teuthology.orchestra.run.smithi050.stdout:(109/150): libarrow-doc-9.0.0-11.el9.noarch.rpm 316 kB/s | 26 kB 00:00 2024-08-31T04:09:41.412 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 60/152 2024-08-31T04:09:41.419 INFO:teuthology.orchestra.run.smithi050.stdout:(110/150): liboath-2.6.7-2.el9.x86_64.rpm 597 kB/s | 49 kB 00:00 2024-08-31T04:09:41.444 INFO:teuthology.orchestra.run.smithi050.stdout:(111/150): libunwind-1.6.2-1.el9.x86_64.rpm 1.2 MB/s | 67 kB 00:00 2024-08-31T04:09:41.486 INFO:teuthology.orchestra.run.smithi050.stdout:(112/150): luarocks-3.9.2-5.el9.noarch.rpm 3.6 MB/s | 151 kB 00:00 2024-08-31T04:09:41.488 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 61/152 2024-08-31T04:09:41.578 INFO:teuthology.orchestra.run.smithi050.stdout:(113/150): libarrow-9.0.0-11.el9.x86_64.rpm 12 MB/s | 4.4 MB 00:00 2024-08-31T04:09:41.611 INFO:teuthology.orchestra.run.smithi050.stdout:(114/150): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.3 MB/s | 43 kB 00:00 2024-08-31T04:09:41.615 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 62/152 2024-08-31T04:09:41.645 INFO:teuthology.orchestra.run.smithi050.stdout:(115/150): python3-asyncssh-2.13.2-5.el9.noarch 3.4 MB/s | 548 kB 00:00 2024-08-31T04:09:41.652 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 63/152 2024-08-31T04:09:41.670 INFO:teuthology.orchestra.run.smithi050.stdout:(116/150): python3-cachetools-4.2.4-1.el9.noarc 550 kB/s | 32 kB 00:00 2024-08-31T04:09:41.680 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 64/152 2024-08-31T04:09:41.696 INFO:teuthology.orchestra.run.smithi050.stdout:(117/150): python3-certifi-2023.05.07-4.el9.noa 281 kB/s | 14 kB 00:00 2024-08-31T04:09:41.715 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 65/152 2024-08-31T04:09:41.737 INFO:teuthology.orchestra.run.smithi050.stdout:(118/150): parquet-libs-9.0.0-11.el9.x86_64.rpm 2.8 MB/s | 839 kB 00:00 2024-08-31T04:09:41.759 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : uuid-1.6.2-55.el9.x86_64 66/152 2024-08-31T04:09:41.763 INFO:teuthology.orchestra.run.smithi050.stdout:(119/150): python3-cheroot-8.6.0-4.el9.noarch.r 1.8 MB/s | 172 kB 00:00 2024-08-31T04:09:41.796 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 67/152 2024-08-31T04:09:41.797 INFO:teuthology.orchestra.run.smithi050.stdout:(120/150): python3-cherrypy-18.6.1-2.el9.noarch 3.5 MB/s | 358 kB 00:00 2024-08-31T04:09:41.822 INFO:teuthology.orchestra.run.smithi050.stdout:(121/150): python3-cmd2-2.4.2-2.el9.noarch.rpm 3.5 MB/s | 303 kB 00:00 2024-08-31T04:09:41.828 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 68/152 2024-08-31T04:09:41.848 INFO:teuthology.orchestra.run.smithi050.stdout:(122/150): python3-google-auth-2.34.0-1.el9.noa 2.6 MB/s | 220 kB 00:00 2024-08-31T04:09:41.858 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 69/152 2024-08-31T04:09:41.873 INFO:teuthology.orchestra.run.smithi050.stdout:(123/150): python3-grpcio-tools-1.46.7-10.el9.x 2.8 MB/s | 144 kB 00:00 2024-08-31T04:09:41.892 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 70/152 2024-08-31T04:09:41.898 INFO:teuthology.orchestra.run.smithi050.stdout:(124/150): python3-jaraco-8.2.1-3.el9.noarch.rp 214 kB/s | 11 kB 00:00 2024-08-31T04:09:41.923 INFO:teuthology.orchestra.run.smithi050.stdout:(125/150): python3-jaraco-classes-3.2.1-5.el9.n 706 kB/s | 18 kB 00:00 2024-08-31T04:09:41.926 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 71/152 2024-08-31T04:09:41.949 INFO:teuthology.orchestra.run.smithi050.stdout:(126/150): python3-jaraco-collections-3.0.0-8.e 461 kB/s | 23 kB 00:00 2024-08-31T04:09:41.967 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 72/152 2024-08-31T04:09:41.974 INFO:teuthology.orchestra.run.smithi050.stdout:(127/150): python3-jaraco-functools-3.5.0-2.el9 388 kB/s | 19 kB 00:00 2024-08-31T04:09:41.999 INFO:teuthology.orchestra.run.smithi050.stdout:(128/150): python3-jaraco-text-3.2.0-6.el9.noar 392 kB/s | 20 kB 00:00 2024-08-31T04:09:42.033 INFO:teuthology.orchestra.run.smithi050.stdout:(129/150): python3-logutils-0.3.5-21.el9.noarch 1.4 MB/s | 46 kB 00:00 2024-08-31T04:09:42.066 INFO:teuthology.orchestra.run.smithi050.stdout:(130/150): python3-more-itertools-8.12.0-2.el9. 2.3 MB/s | 79 kB 00:00 2024-08-31T04:09:42.108 INFO:teuthology.orchestra.run.smithi050.stdout:(131/150): python3-kubernetes-26.1.0-2.el9.noar 7.6 MB/s | 1.0 MB 00:00 2024-08-31T04:09:42.134 INFO:teuthology.orchestra.run.smithi050.stdout:(132/150): python3-natsort-7.1.1-5.el9.noarch.r 860 kB/s | 58 kB 00:00 2024-08-31T04:09:42.175 INFO:teuthology.orchestra.run.smithi050.stdout:(133/150): python3-portend-3.1.0-2.el9.noarch.r 400 kB/s | 16 kB 00:00 2024-08-31T04:09:42.201 INFO:teuthology.orchestra.run.smithi050.stdout:(134/150): python3-pecan-1.4.2-3.el9.noarch.rpm 2.9 MB/s | 272 kB 00:00 2024-08-31T04:09:42.219 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 73/152 2024-08-31T04:09:42.226 INFO:teuthology.orchestra.run.smithi050.stdout:(135/150): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.7 MB/s | 90 kB 00:00 2024-08-31T04:09:42.243 INFO:teuthology.orchestra.run.smithi050.stdout:(136/150): python3-pyperclip-1.8.2-2.el9.noarch 677 kB/s | 28 kB 00:00 2024-08-31T04:09:42.260 INFO:teuthology.orchestra.run.smithi050.stdout:(137/150): python3-repoze-lru-0.7-16.el9.noarch 912 kB/s | 31 kB 00:00 2024-08-31T04:09:42.310 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 74/152 2024-08-31T04:09:42.319 INFO:teuthology.orchestra.run.smithi050.stdout:(138/150): python3-grpcio-1.46.7-10.el9.x86_64. 3.9 MB/s | 2.0 MB 00:00 2024-08-31T04:09:42.336 INFO:teuthology.orchestra.run.smithi050.stdout:(139/150): python3-rsa-4.9-2.el9.noarch.rpm 787 kB/s | 59 kB 00:00 2024-08-31T04:09:42.358 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 75/152 2024-08-31T04:09:42.361 INFO:teuthology.orchestra.run.smithi050.stdout:(140/150): python3-routes-2.5.1-5.el9.noarch.rp 1.6 MB/s | 188 kB 00:00 2024-08-31T04:09:42.387 INFO:teuthology.orchestra.run.smithi050.stdout:(141/150): python3-tempora-5.0.0-2.el9.noarch.r 532 kB/s | 36 kB 00:00 2024-08-31T04:09:42.388 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 76/152 2024-08-31T04:09:42.412 INFO:teuthology.orchestra.run.smithi050.stdout:(142/150): python3-typing-extensions-4.12.2-2.e 983 kB/s | 74 kB 00:00 2024-08-31T04:09:42.437 INFO:teuthology.orchestra.run.smithi050.stdout:(143/150): python3-websocket-client-1.2.3-2.el9 1.8 MB/s | 90 kB 00:00 2024-08-31T04:09:42.462 INFO:teuthology.orchestra.run.smithi050.stdout:(144/150): python3-webob-1.8.8-2.el9.noarch.rpm 2.2 MB/s | 230 kB 00:00 2024-08-31T04:09:42.488 INFO:teuthology.orchestra.run.smithi050.stdout:(145/150): python3-zc-lockfile-2.0-10.el9.noarc 397 kB/s | 20 kB 00:00 2024-08-31T04:09:42.494 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 77/152 2024-08-31T04:09:42.521 INFO:teuthology.orchestra.run.smithi050.stdout:(146/150): re2-20211101-20.el9.x86_64.rpm 3.2 MB/s | 191 kB 00:00 2024-08-31T04:09:42.546 INFO:teuthology.orchestra.run.smithi050.stdout:(147/150): python3-werkzeug-2.0.3-3.el9.1.noarc 3.1 MB/s | 427 kB 00:00 2024-08-31T04:09:42.548 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 78/152 2024-08-31T04:09:42.605 INFO:teuthology.orchestra.run.smithi050.stdout:(148/150): thrift-0.15.0-2.el9.x86_64.rpm 14 MB/s | 1.6 MB 00:00 2024-08-31T04:09:42.780 INFO:teuthology.orchestra.run.smithi050.stdout:(149/150): librados2-19.3.0-4560.gd19e6118.el9. 13 MB/s | 3.4 MB 00:00 2024-08-31T04:09:42.906 INFO:teuthology.orchestra.run.smithi050.stdout:(150/150): librbd1-19.3.0-4560.gd19e6118.el9.x8 8.8 MB/s | 3.1 MB 00:00 2024-08-31T04:09:42.911 INFO:teuthology.orchestra.run.smithi050.stdout:-------------------------------------------------------------------------------- 2024-08-31T04:09:42.911 INFO:teuthology.orchestra.run.smithi050.stdout:Total 9.6 MB/s | 224 MB 00:23 2024-08-31T04:09:43.304 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 79/152 2024-08-31T04:09:43.345 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 80/152 2024-08-31T04:09:43.378 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 81/152 2024-08-31T04:09:43.480 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 82/152 2024-08-31T04:09:43.580 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 83/152 2024-08-31T04:09:43.805 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 84/152 2024-08-31T04:09:43.893 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 85/152 2024-08-31T04:09:43.930 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 86/152 2024-08-31T04:09:44.113 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : openblas-0.3.26-2.el9.x86_64 87/152 2024-08-31T04:09:44.144 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 88/152 2024-08-31T04:09:44.229 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 89/152 2024-08-31T04:09:44.366 INFO:teuthology.orchestra.run.smithi177.stdout:(150/150): python3-scipy-1.6.2-8.el9.x86_64.rpm 1.8 MB/s | 16 MB 00:08 2024-08-31T04:09:44.372 INFO:teuthology.orchestra.run.smithi177.stdout:-------------------------------------------------------------------------------- 2024-08-31T04:09:44.372 INFO:teuthology.orchestra.run.smithi177.stdout:Total 8.4 MB/s | 224 MB 00:26 2024-08-31T04:09:44.800 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction check 2024-08-31T04:09:44.883 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 90/152 2024-08-31T04:09:44.969 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction check succeeded. 2024-08-31T04:09:44.969 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction test 2024-08-31T04:09:45.003 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 91/152 2024-08-31T04:09:45.457 INFO:teuthology.orchestra.run.smithi177.stdout:Running transaction check 2024-08-31T04:09:45.582 INFO:teuthology.orchestra.run.smithi177.stdout:Transaction check succeeded. 2024-08-31T04:09:45.582 INFO:teuthology.orchestra.run.smithi177.stdout:Running transaction test 2024-08-31T04:09:46.268 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 92/152 2024-08-31T04:09:46.356 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 93/152 2024-08-31T04:09:46.375 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 94/152 2024-08-31T04:09:46.400 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 95/152 2024-08-31T04:09:46.718 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 96/152 2024-08-31T04:09:46.755 INFO:teuthology.orchestra.run.smithi133.stdout: Upgrading : librbd1-2:19.3.0-4560.gd19e6118.el9.x86_64 97/152 2024-08-31T04:09:46.845 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: librbd1-2:19.3.0-4560.gd19e6118.el9.x86_64 97/152 2024-08-31T04:09:46.876 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-rbd-2:19.3.0-4560.gd19e6118.el9.x86_64 98/152 2024-08-31T04:09:46.912 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 99/152 2024-08-31T04:09:47.324 INFO:teuthology.orchestra.run.smithi177.stdout:Transaction test succeeded. 2024-08-31T04:09:47.324 INFO:teuthology.orchestra.run.smithi177.stdout:Running transaction 2024-08-31T04:09:47.411 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 100/152 2024-08-31T04:09:47.441 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : librgw2-2:19.3.0-4560.gd19e6118.el9.x86_64 101/152 2024-08-31T04:09:47.456 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction test succeeded. 2024-08-31T04:09:47.457 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction 2024-08-31T04:09:47.512 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: librgw2-2:19.3.0-4560.gd19e6118.el9.x86_64 101/152 2024-08-31T04:09:47.542 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-rgw-2:19.3.0-4560.gd19e6118.el9.x86_64 102/152 2024-08-31T04:09:49.809 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: ceph-common-2:19.3.0-4560.gd19e6118.el9.x86_64 103/152 2024-08-31T04:09:49.847 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : ceph-common-2:19.3.0-4560.gd19e6118.el9.x86_64 103/152 2024-08-31T04:09:50.420 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: ceph-common-2:19.3.0-4560.gd19e6118.el9.x86_64 103/152 2024-08-31T04:09:50.458 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : ceph-base-2:19.3.0-4560.gd19e6118.el9.x86_64 104/152 2024-08-31T04:09:50.533 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: ceph-base-2:19.3.0-4560.gd19e6118.el9.x86_64 104/152 2024-08-31T04:09:50.533 INFO:teuthology.orchestra.run.smithi133.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-08-31T04:09:50.533 INFO:teuthology.orchestra.run.smithi133.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-08-31T04:09:50.534 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-08-31T04:09:50.567 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : ceph-selinux-2:19.3.0-4560.gd19e6118.el9.x86_64 105/152 2024-08-31T04:09:53.326 INFO:teuthology.orchestra.run.smithi177.stdout: Preparing : 1/1 2024-08-31T04:09:53.401 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : thrift-0.15.0-2.el9.x86_64 1/152 2024-08-31T04:09:53.427 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 2/152 2024-08-31T04:09:53.469 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 3/152 2024-08-31T04:09:53.877 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 4/152 2024-08-31T04:09:53.952 INFO:teuthology.orchestra.run.smithi177.stdout: Upgrading : librados2-2:19.3.0-4560.gd19e6118.el9.x86_64 5/152 2024-08-31T04:09:54.026 INFO:teuthology.orchestra.run.smithi050.stdout: Preparing : 1/1 2024-08-31T04:09:54.078 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: librados2-2:19.3.0-4560.gd19e6118.el9.x86_64 5/152 2024-08-31T04:09:54.103 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : libcephfs2-2:19.3.0-4560.gd19e6118.el9.x86_64 6/152 2024-08-31T04:09:54.112 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : thrift-0.15.0-2.el9.x86_64 1/152 2024-08-31T04:09:54.143 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 2/152 2024-08-31T04:09:54.195 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: libcephfs2-2:19.3.0-4560.gd19e6118.el9.x86_64 6/152 2024-08-31T04:09:54.234 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 3/152 2024-08-31T04:09:54.237 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-rados-2:19.3.0-4560.gd19e6118.el9.x86_64 7/152 2024-08-31T04:09:54.266 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 8/152 2024-08-31T04:09:54.292 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 9/152 2024-08-31T04:09:54.445 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 10/152 2024-08-31T04:09:54.489 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : postgresql-13.16-1.el9.x86_64 11/152 2024-08-31T04:09:54.517 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : libcephsqlite-2:19.3.0-4560.gd19e6118.el9.x86_64 12/152 2024-08-31T04:09:54.622 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: libcephsqlite-2:19.3.0-4560.gd19e6118.el9.x86_64 12/152 2024-08-31T04:09:54.651 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : libradosstriper1-2:19.3.0-4560.gd19e6118.el9.x86 13/152 2024-08-31T04:09:54.667 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 4/152 2024-08-31T04:09:54.713 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: libradosstriper1-2:19.3.0-4560.gd19e6118.el9.x86 13/152 2024-08-31T04:09:54.735 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 14/152 2024-08-31T04:09:54.760 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 14/152 2024-08-31T04:09:54.810 INFO:teuthology.orchestra.run.smithi050.stdout: Upgrading : librados2-2:19.3.0-4560.gd19e6118.el9.x86_64 5/152 2024-08-31T04:09:54.963 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: librados2-2:19.3.0-4560.gd19e6118.el9.x86_64 5/152 2024-08-31T04:09:55.003 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : libcephfs2-2:19.3.0-4560.gd19e6118.el9.x86_64 6/152 2024-08-31T04:09:55.039 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 15/152 2024-08-31T04:09:55.068 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 15/152 2024-08-31T04:09:55.117 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: libcephfs2-2:19.3.0-4560.gd19e6118.el9.x86_64 6/152 2024-08-31T04:09:55.168 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-rados-2:19.3.0-4560.gd19e6118.el9.x86_64 7/152 2024-08-31T04:09:55.175 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : re2-1:20211101-20.el9.x86_64 16/152 2024-08-31T04:09:55.200 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 8/152 2024-08-31T04:09:55.208 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 17/152 2024-08-31T04:09:55.234 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 9/152 2024-08-31T04:09:55.242 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : liboath-2.6.7-2.el9.x86_64 18/152 2024-08-31T04:09:55.309 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 19/152 2024-08-31T04:09:55.361 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 20/152 2024-08-31T04:09:55.401 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-packaging-20.9-5.el9.noarch 21/152 2024-08-31T04:09:55.445 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 22/152 2024-08-31T04:09:55.477 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 23/152 2024-08-31T04:09:55.479 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 10/152 2024-08-31T04:09:55.513 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : lua-5.4.4-4.el9.x86_64 24/152 2024-08-31T04:09:55.532 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : postgresql-13.16-1.el9.x86_64 11/152 2024-08-31T04:09:55.558 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : libcephsqlite-2:19.3.0-4560.gd19e6118.el9.x86_64 12/152 2024-08-31T04:09:55.583 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 25/152 2024-08-31T04:09:55.653 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 26/152 2024-08-31T04:09:55.681 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: libcephsqlite-2:19.3.0-4560.gd19e6118.el9.x86_64 12/152 2024-08-31T04:09:55.682 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 27/152 2024-08-31T04:09:55.709 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : libradosstriper1-2:19.3.0-4560.gd19e6118.el9.x86 13/152 2024-08-31T04:09:55.734 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 28/152 2024-08-31T04:09:55.784 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: libradosstriper1-2:19.3.0-4560.gd19e6118.el9.x86 13/152 2024-08-31T04:09:55.810 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 14/152 2024-08-31T04:09:55.811 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 29/152 2024-08-31T04:09:55.845 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-ceph-common-2:19.3.0-4560.gd19e6118.el9. 30/152 2024-08-31T04:09:55.850 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 14/152 2024-08-31T04:09:55.889 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-ceph-argparse-2:19.3.0-4560.gd19e6118.el 31/152 2024-08-31T04:09:55.918 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-cephfs-2:19.3.0-4560.gd19e6118.el9.x86_6 32/152 2024-08-31T04:09:55.988 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 33/152 2024-08-31T04:09:56.040 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : luarocks-3.9.2-5.el9.noarch 34/152 2024-08-31T04:09:56.115 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 35/152 2024-08-31T04:09:56.236 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 15/152 2024-08-31T04:09:56.253 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 36/152 2024-08-31T04:09:56.273 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 15/152 2024-08-31T04:09:56.310 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 37/152 2024-08-31T04:09:56.413 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : re2-1:20211101-20.el9.x86_64 16/152 2024-08-31T04:09:56.445 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 17/152 2024-08-31T04:09:56.491 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : liboath-2.6.7-2.el9.x86_64 18/152 2024-08-31T04:09:56.577 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 19/152 2024-08-31T04:09:56.662 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 20/152 2024-08-31T04:09:56.708 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-packaging-20.9-5.el9.noarch 21/152 2024-08-31T04:09:56.762 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 22/152 2024-08-31T04:09:56.801 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 23/152 2024-08-31T04:09:56.834 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : lua-5.4.4-4.el9.x86_64 24/152 2024-08-31T04:09:56.849 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-rsa-4.9-2.el9.noarch 38/152 2024-08-31T04:09:56.927 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 25/152 2024-08-31T04:09:56.930 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 39/152 2024-08-31T04:09:56.958 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 40/152 2024-08-31T04:09:56.988 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 26/152 2024-08-31T04:09:57.009 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 41/152 2024-08-31T04:09:57.021 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 27/152 2024-08-31T04:09:57.048 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : librados-devel-2:19.3.0-4560.gd19e6118.el9.x86_6 42/152 2024-08-31T04:09:57.068 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 28/152 2024-08-31T04:09:57.081 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 43/152 2024-08-31T04:09:57.162 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 29/152 2024-08-31T04:09:57.172 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 44/152 2024-08-31T04:09:57.200 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-ceph-common-2:19.3.0-4560.gd19e6118.el9. 30/152 2024-08-31T04:09:57.243 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 45/152 2024-08-31T04:09:57.244 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-ceph-argparse-2:19.3.0-4560.gd19e6118.el 31/152 2024-08-31T04:09:57.271 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-cephfs-2:19.3.0-4560.gd19e6118.el9.x86_6 32/152 2024-08-31T04:09:57.319 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 46/152 2024-08-31T04:09:57.349 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 47/152 2024-08-31T04:09:57.370 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 33/152 2024-08-31T04:09:57.385 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 48/152 2024-08-31T04:09:57.424 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : luarocks-3.9.2-5.el9.noarch 34/152 2024-08-31T04:09:57.433 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 49/152 2024-08-31T04:09:57.468 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 50/152 2024-08-31T04:09:57.511 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 51/152 2024-08-31T04:09:57.547 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 35/152 2024-08-31T04:09:57.553 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 52/152 2024-08-31T04:09:57.689 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 53/152 2024-08-31T04:09:57.731 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 54/152 2024-08-31T04:09:57.732 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 36/152 2024-08-31T04:09:57.773 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 55/152 2024-08-31T04:09:57.796 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 37/152 2024-08-31T04:09:57.876 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 56/152 2024-08-31T04:09:57.915 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 57/152 2024-08-31T04:09:57.955 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 58/152 2024-08-31T04:09:57.980 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 59/152 2024-08-31T04:09:58.005 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 60/152 2024-08-31T04:09:58.080 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 61/152 2024-08-31T04:09:58.207 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 62/152 2024-08-31T04:09:58.237 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 63/152 2024-08-31T04:09:58.265 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 64/152 2024-08-31T04:09:58.299 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 65/152 2024-08-31T04:09:58.351 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : uuid-1.6.2-55.el9.x86_64 66/152 2024-08-31T04:09:58.389 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 67/152 2024-08-31T04:09:58.429 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 68/152 2024-08-31T04:09:58.458 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 69/152 2024-08-31T04:09:58.485 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-rsa-4.9-2.el9.noarch 38/152 2024-08-31T04:09:58.493 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 70/152 2024-08-31T04:09:58.526 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 71/152 2024-08-31T04:09:58.568 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 72/152 2024-08-31T04:09:58.591 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 39/152 2024-08-31T04:09:58.627 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 73/152 2024-08-31T04:09:58.630 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 40/152 2024-08-31T04:09:58.674 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 41/152 2024-08-31T04:09:58.689 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 74/152 2024-08-31T04:09:58.713 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : librados-devel-2:19.3.0-4560.gd19e6118.el9.x86_6 42/152 2024-08-31T04:09:58.741 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 75/152 2024-08-31T04:09:58.754 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 43/152 2024-08-31T04:09:58.772 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 76/152 2024-08-31T04:09:58.874 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 44/152 2024-08-31T04:09:58.876 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 77/152 2024-08-31T04:09:58.923 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 78/152 2024-08-31T04:09:58.952 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 45/152 2024-08-31T04:09:59.038 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 46/152 2024-08-31T04:09:59.089 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 47/152 2024-08-31T04:09:59.128 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 48/152 2024-08-31T04:09:59.186 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 49/152 2024-08-31T04:09:59.225 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 50/152 2024-08-31T04:09:59.272 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 51/152 2024-08-31T04:09:59.321 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 52/152 2024-08-31T04:09:59.505 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 53/152 2024-08-31T04:09:59.553 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 54/152 2024-08-31T04:09:59.597 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 55/152 2024-08-31T04:09:59.658 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 79/152 2024-08-31T04:09:59.711 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 80/152 2024-08-31T04:09:59.730 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 56/152 2024-08-31T04:09:59.745 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 81/152 2024-08-31T04:09:59.770 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 57/152 2024-08-31T04:09:59.815 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 58/152 2024-08-31T04:09:59.845 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 82/152 2024-08-31T04:09:59.850 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 59/152 2024-08-31T04:09:59.875 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 60/152 2024-08-31T04:09:59.901 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 83/152 2024-08-31T04:09:59.945 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 84/152 2024-08-31T04:09:59.986 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 61/152 2024-08-31T04:10:00.033 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 85/152 2024-08-31T04:10:00.064 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 86/152 2024-08-31T04:10:00.208 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 62/152 2024-08-31T04:10:00.247 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : openblas-0.3.26-2.el9.x86_64 87/152 2024-08-31T04:10:00.295 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 88/152 2024-08-31T04:10:00.333 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 63/152 2024-08-31T04:10:00.365 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 89/152 2024-08-31T04:10:00.369 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 64/152 2024-08-31T04:10:00.406 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 65/152 2024-08-31T04:10:00.462 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : uuid-1.6.2-55.el9.x86_64 66/152 2024-08-31T04:10:00.505 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 67/152 2024-08-31T04:10:00.544 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 68/152 2024-08-31T04:10:00.581 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 69/152 2024-08-31T04:10:00.615 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 70/152 2024-08-31T04:10:00.648 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 71/152 2024-08-31T04:10:00.693 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 72/152 2024-08-31T04:10:00.756 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 73/152 2024-08-31T04:10:00.863 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 74/152 2024-08-31T04:10:00.926 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 75/152 2024-08-31T04:10:00.961 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 76/152 2024-08-31T04:10:01.020 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 90/152 2024-08-31T04:10:01.090 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 77/152 2024-08-31T04:10:01.145 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 91/152 2024-08-31T04:10:01.151 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 78/152 2024-08-31T04:10:02.114 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 79/152 2024-08-31T04:10:02.167 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 80/152 2024-08-31T04:10:02.201 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 81/152 2024-08-31T04:10:02.325 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 82/152 2024-08-31T04:10:02.385 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 83/152 2024-08-31T04:10:02.395 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 92/152 2024-08-31T04:10:02.426 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: ceph-selinux-2:19.3.0-4560.gd19e6118.el9.x86_64 105/152 2024-08-31T04:10:02.426 INFO:teuthology.orchestra.run.smithi133.stdout:skipping the directory /sys 2024-08-31T04:10:02.426 INFO:teuthology.orchestra.run.smithi133.stdout:skipping the directory /proc 2024-08-31T04:10:02.426 INFO:teuthology.orchestra.run.smithi133.stdout:skipping the directory /mnt 2024-08-31T04:10:02.426 INFO:teuthology.orchestra.run.smithi133.stdout:skipping the directory /var/tmp 2024-08-31T04:10:02.426 INFO:teuthology.orchestra.run.smithi133.stdout:skipping the directory /home 2024-08-31T04:10:02.426 INFO:teuthology.orchestra.run.smithi133.stdout:skipping the directory /root 2024-08-31T04:10:02.426 INFO:teuthology.orchestra.run.smithi133.stdout:skipping the directory /tmp 2024-08-31T04:10:02.426 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-08-31T04:10:02.440 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 84/152 2024-08-31T04:10:02.474 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 93/152 2024-08-31T04:10:02.502 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 94/152 2024-08-31T04:10:02.535 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 95/152 2024-08-31T04:10:02.550 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 85/152 2024-08-31T04:10:02.587 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 86/152 2024-08-31T04:10:02.596 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : ceph-volume-2:19.3.0-4560.gd19e6118.el9.noarch 106/152 2024-08-31T04:10:02.613 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: ceph-volume-2:19.3.0-4560.gd19e6118.el9.noarch 106/152 2024-08-31T04:10:02.613 INFO:teuthology.orchestra.run.smithi133.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-31T04:10:02.613 INFO:teuthology.orchestra.run.smithi133.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-08-31T04:10:02.613 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-08-31T04:10:02.826 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : openblas-0.3.26-2.el9.x86_64 87/152 2024-08-31T04:10:02.858 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 88/152 2024-08-31T04:10:02.864 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 96/152 2024-08-31T04:10:02.906 INFO:teuthology.orchestra.run.smithi177.stdout: Upgrading : librbd1-2:19.3.0-4560.gd19e6118.el9.x86_64 97/152 2024-08-31T04:10:02.958 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 89/152 2024-08-31T04:10:02.998 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: librbd1-2:19.3.0-4560.gd19e6118.el9.x86_64 97/152 2024-08-31T04:10:03.027 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-rbd-2:19.3.0-4560.gd19e6118.el9.x86_64 98/152 2024-08-31T04:10:03.063 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 99/152 2024-08-31T04:10:03.564 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 100/152 2024-08-31T04:10:03.584 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : librgw2-2:19.3.0-4560.gd19e6118.el9.x86_64 101/152 2024-08-31T04:10:03.656 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: librgw2-2:19.3.0-4560.gd19e6118.el9.x86_64 101/152 2024-08-31T04:10:03.686 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-rgw-2:19.3.0-4560.gd19e6118.el9.x86_64 102/152 2024-08-31T04:10:03.836 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 90/152 2024-08-31T04:10:03.987 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 91/152 2024-08-31T04:10:04.199 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : ceph-osd-2:19.3.0-4560.gd19e6118.el9.x86_64 107/152 2024-08-31T04:10:04.226 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: ceph-osd-2:19.3.0-4560.gd19e6118.el9.x86_64 107/152 2024-08-31T04:10:04.226 INFO:teuthology.orchestra.run.smithi133.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-31T04:10:04.226 INFO:teuthology.orchestra.run.smithi133.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-08-31T04:10:04.227 INFO:teuthology.orchestra.run.smithi133.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-08-31T04:10:04.227 INFO:teuthology.orchestra.run.smithi133.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-08-31T04:10:04.227 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-08-31T04:10:04.459 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : ceph-mds-2:19.3.0-4560.gd19e6118.el9.x86_64 108/152 2024-08-31T04:10:04.483 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: ceph-mds-2:19.3.0-4560.gd19e6118.el9.x86_64 108/152 2024-08-31T04:10:04.483 INFO:teuthology.orchestra.run.smithi133.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-31T04:10:04.483 INFO:teuthology.orchestra.run.smithi133.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-08-31T04:10:04.483 INFO:teuthology.orchestra.run.smithi133.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-08-31T04:10:04.483 INFO:teuthology.orchestra.run.smithi133.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-08-31T04:10:04.483 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-08-31T04:10:04.943 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : ceph-mon-2:19.3.0-4560.gd19e6118.el9.x86_64 109/152 2024-08-31T04:10:04.966 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: ceph-mon-2:19.3.0-4560.gd19e6118.el9.x86_64 109/152 2024-08-31T04:10:04.967 INFO:teuthology.orchestra.run.smithi133.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-31T04:10:04.967 INFO:teuthology.orchestra.run.smithi133.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-08-31T04:10:04.967 INFO:teuthology.orchestra.run.smithi133.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-08-31T04:10:04.967 INFO:teuthology.orchestra.run.smithi133.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-08-31T04:10:04.967 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-08-31T04:10:05.073 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : automake-1.16.2-8.el9.noarch 110/152 2024-08-31T04:10:05.130 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-ply-3.11-14.el9.noarch 111/152 2024-08-31T04:10:05.194 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 112/152 2024-08-31T04:10:05.381 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 113/152 2024-08-31T04:10:05.435 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 114/152 2024-08-31T04:10:05.513 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 115/152 2024-08-31T04:10:05.610 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 116/152 2024-08-31T04:10:05.681 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 92/152 2024-08-31T04:10:05.750 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 117/152 2024-08-31T04:10:05.780 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 93/152 2024-08-31T04:10:05.793 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 118/152 2024-08-31T04:10:05.818 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 94/152 2024-08-31T04:10:05.825 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 119/152 2024-08-31T04:10:05.849 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 95/152 2024-08-31T04:10:05.852 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : fuse-2.9.9-16.el9.x86_64 120/152 2024-08-31T04:10:05.988 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: ceph-common-2:19.3.0-4560.gd19e6118.el9.x86_64 103/152 2024-08-31T04:10:06.023 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : ceph-common-2:19.3.0-4560.gd19e6118.el9.x86_64 103/152 2024-08-31T04:10:06.228 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 96/152 2024-08-31T04:10:06.267 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: cephadm-2:19.3.0-4560.gd19e6118.el9.noarch 121/152 2024-08-31T04:10:06.268 INFO:teuthology.orchestra.run.smithi050.stdout: Upgrading : librbd1-2:19.3.0-4560.gd19e6118.el9.x86_64 97/152 2024-08-31T04:10:06.293 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : cephadm-2:19.3.0-4560.gd19e6118.el9.noarch 121/152 2024-08-31T04:10:06.326 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : ceph-prometheus-alerts-2:19.3.0-4560.gd19e6118.e 122/152 2024-08-31T04:10:06.391 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: librbd1-2:19.3.0-4560.gd19e6118.el9.x86_64 97/152 2024-08-31T04:10:06.393 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : ceph-grafana-dashboards-2:19.3.0-4560.gd19e6118. 123/152 2024-08-31T04:10:06.424 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : ceph-mgr-cephadm-2:19.3.0-4560.gd19e6118.el9.noa 124/152 2024-08-31T04:10:06.425 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-rbd-2:19.3.0-4560.gd19e6118.el9.x86_64 98/152 2024-08-31T04:10:06.475 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 99/152 2024-08-31T04:10:06.593 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: ceph-common-2:19.3.0-4560.gd19e6118.el9.x86_64 103/152 2024-08-31T04:10:06.635 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : ceph-base-2:19.3.0-4560.gd19e6118.el9.x86_64 104/152 2024-08-31T04:10:06.728 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: ceph-base-2:19.3.0-4560.gd19e6118.el9.x86_64 104/152 2024-08-31T04:10:06.728 INFO:teuthology.orchestra.run.smithi177.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-08-31T04:10:06.728 INFO:teuthology.orchestra.run.smithi177.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-08-31T04:10:06.728 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-08-31T04:10:06.753 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : ceph-selinux-2:19.3.0-4560.gd19e6118.el9.x86_64 105/152 2024-08-31T04:10:07.050 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 100/152 2024-08-31T04:10:07.088 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : librgw2-2:19.3.0-4560.gd19e6118.el9.x86_64 101/152 2024-08-31T04:10:07.180 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: librgw2-2:19.3.0-4560.gd19e6118.el9.x86_64 101/152 2024-08-31T04:10:07.206 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-rgw-2:19.3.0-4560.gd19e6118.el9.x86_64 102/152 2024-08-31T04:10:09.664 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.3.0-4560.gd19e6118.el9.noa 124/152 2024-08-31T04:10:09.732 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : ceph-mgr-dashboard-2:19.3.0-4560.gd19e6118.el9.n 125/152 2024-08-31T04:10:09.963 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: ceph-common-2:19.3.0-4560.gd19e6118.el9.x86_64 103/152 2024-08-31T04:10:09.997 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-common-2:19.3.0-4560.gd19e6118.el9.x86_64 103/152 2024-08-31T04:10:10.698 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: ceph-common-2:19.3.0-4560.gd19e6118.el9.x86_64 103/152 2024-08-31T04:10:10.704 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.3.0-4560.gd19e6118.el9.n 125/152 2024-08-31T04:10:10.738 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : ceph-mgr-diskprediction-local-2:19.3.0-4560.gd19 126/152 2024-08-31T04:10:10.742 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-base-2:19.3.0-4560.gd19e6118.el9.x86_64 104/152 2024-08-31T04:10:10.856 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.3.0-4560.gd19 126/152 2024-08-31T04:10:10.866 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: ceph-base-2:19.3.0-4560.gd19e6118.el9.x86_64 104/152 2024-08-31T04:10:10.867 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-08-31T04:10:10.867 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-08-31T04:10:10.867 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-08-31T04:10:10.910 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-selinux-2:19.3.0-4560.gd19e6118.el9.x86_64 105/152 2024-08-31T04:10:11.033 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : ceph-mgr-modules-core-2:19.3.0-4560.gd19e6118.el 127/152 2024-08-31T04:10:11.065 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : ceph-mgr-2:19.3.0-4560.gd19e6118.el9.x86_64 128/152 2024-08-31T04:10:11.090 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: ceph-mgr-2:19.3.0-4560.gd19e6118.el9.x86_64 128/152 2024-08-31T04:10:11.090 INFO:teuthology.orchestra.run.smithi133.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-31T04:10:11.090 INFO:teuthology.orchestra.run.smithi133.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-08-31T04:10:11.090 INFO:teuthology.orchestra.run.smithi133.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-08-31T04:10:11.090 INFO:teuthology.orchestra.run.smithi133.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-08-31T04:10:11.090 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-08-31T04:10:11.141 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : ceph-mgr-rook-2:19.3.0-4560.gd19e6118.el9.noarch 129/152 2024-08-31T04:10:11.153 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: ceph-mgr-rook-2:19.3.0-4560.gd19e6118.el9.noarch 129/152 2024-08-31T04:10:11.251 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : ceph-2:19.3.0-4560.gd19e6118.el9.x86_64 130/152 2024-08-31T04:10:11.306 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : ceph-fuse-2:19.3.0-4560.gd19e6118.el9.x86_64 131/152 2024-08-31T04:10:12.275 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : libtool-2.4.6-46.el9.x86_64 132/152 2024-08-31T04:10:12.302 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : ceph-radosgw-2:19.3.0-4560.gd19e6118.el9.x86_64 133/152 2024-08-31T04:10:12.326 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: ceph-radosgw-2:19.3.0-4560.gd19e6118.el9.x86_64 133/152 2024-08-31T04:10:12.326 INFO:teuthology.orchestra.run.smithi133.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-31T04:10:12.326 INFO:teuthology.orchestra.run.smithi133.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-08-31T04:10:12.326 INFO:teuthology.orchestra.run.smithi133.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-08-31T04:10:12.326 INFO:teuthology.orchestra.run.smithi133.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-08-31T04:10:12.326 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-08-31T04:10:12.369 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : ceph-immutable-object-cache-2:19.3.0-4560.gd19e6 134/152 2024-08-31T04:10:12.392 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.3.0-4560.gd19e6 134/152 2024-08-31T04:10:12.392 INFO:teuthology.orchestra.run.smithi133.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-31T04:10:12.393 INFO:teuthology.orchestra.run.smithi133.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-08-31T04:10:12.393 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-08-31T04:10:12.445 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : cephfs-mirror-2:19.3.0-4560.gd19e6118.el9.x86_64 135/152 2024-08-31T04:10:12.468 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: cephfs-mirror-2:19.3.0-4560.gd19e6118.el9.x86_64 135/152 2024-08-31T04:10:12.468 INFO:teuthology.orchestra.run.smithi133.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-31T04:10:12.468 INFO:teuthology.orchestra.run.smithi133.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-08-31T04:10:12.468 INFO:teuthology.orchestra.run.smithi133.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-08-31T04:10:12.468 INFO:teuthology.orchestra.run.smithi133.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-08-31T04:10:12.469 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-08-31T04:10:12.787 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : rbd-mirror-2:19.3.0-4560.gd19e6118.el9.x86_64 136/152 2024-08-31T04:10:12.810 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: rbd-mirror-2:19.3.0-4560.gd19e6118.el9.x86_64 136/152 2024-08-31T04:10:12.810 INFO:teuthology.orchestra.run.smithi133.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-31T04:10:12.810 INFO:teuthology.orchestra.run.smithi133.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-08-31T04:10:12.810 INFO:teuthology.orchestra.run.smithi133.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-08-31T04:10:12.811 INFO:teuthology.orchestra.run.smithi133.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-08-31T04:10:12.811 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-08-31T04:10:17.207 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : ceph-test-2:19.3.0-4560.gd19e6118.el9.x86_64 137/152 2024-08-31T04:10:17.248 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : rbd-fuse-2:19.3.0-4560.gd19e6118.el9.x86_64 138/152 2024-08-31T04:10:17.289 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : rbd-nbd-2:19.3.0-4560.gd19e6118.el9.x86_64 139/152 2024-08-31T04:10:17.321 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 140/152 2024-08-31T04:10:17.348 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 141/152 2024-08-31T04:10:17.536 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : cephfs-shell-2:19.3.0-4560.gd19e6118.el9.x86_64 142/152 2024-08-31T04:10:17.578 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 143/152 2024-08-31T04:10:17.607 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : libcephfs-devel-2:19.3.0-4560.gd19e6118.el9.x86_ 144/152 2024-08-31T04:10:18.188 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 145/152 2024-08-31T04:10:18.230 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 145/152 2024-08-31T04:10:18.251 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 145/152 2024-08-31T04:10:18.700 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: ceph-selinux-2:19.3.0-4560.gd19e6118.el9.x86_64 105/152 2024-08-31T04:10:18.700 INFO:teuthology.orchestra.run.smithi177.stdout:skipping the directory /sys 2024-08-31T04:10:18.701 INFO:teuthology.orchestra.run.smithi177.stdout:skipping the directory /proc 2024-08-31T04:10:18.701 INFO:teuthology.orchestra.run.smithi177.stdout:skipping the directory /mnt 2024-08-31T04:10:18.701 INFO:teuthology.orchestra.run.smithi177.stdout:skipping the directory /var/tmp 2024-08-31T04:10:18.701 INFO:teuthology.orchestra.run.smithi177.stdout:skipping the directory /home 2024-08-31T04:10:18.701 INFO:teuthology.orchestra.run.smithi177.stdout:skipping the directory /root 2024-08-31T04:10:18.701 INFO:teuthology.orchestra.run.smithi177.stdout:skipping the directory /tmp 2024-08-31T04:10:18.701 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-08-31T04:10:18.882 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : ceph-volume-2:19.3.0-4560.gd19e6118.el9.noarch 106/152 2024-08-31T04:10:18.898 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: ceph-volume-2:19.3.0-4560.gd19e6118.el9.noarch 106/152 2024-08-31T04:10:18.898 INFO:teuthology.orchestra.run.smithi177.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-31T04:10:18.898 INFO:teuthology.orchestra.run.smithi177.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-08-31T04:10:18.898 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-08-31T04:10:19.095 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : cephfs-top-2:19.3.0-4560.gd19e6118.el9.noarch 146/152 2024-08-31T04:10:19.318 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : openssl-devel-1:3.2.2-4.el9.x86_64 147/152 2024-08-31T04:10:19.359 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 148/152 2024-08-31T04:10:19.441 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : flex-2.6.4-9.el9.x86_64 149/152 2024-08-31T04:10:19.497 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : bison-3.7.4-5.el9.x86_64 150/152 2024-08-31T04:10:19.497 INFO:teuthology.orchestra.run.smithi133.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 151/152 2024-08-31T04:10:19.597 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 151/152 2024-08-31T04:10:19.597 INFO:teuthology.orchestra.run.smithi133.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 152/152 2024-08-31T04:10:20.494 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : ceph-osd-2:19.3.0-4560.gd19e6118.el9.x86_64 107/152 2024-08-31T04:10:20.520 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: ceph-osd-2:19.3.0-4560.gd19e6118.el9.x86_64 107/152 2024-08-31T04:10:20.521 INFO:teuthology.orchestra.run.smithi177.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-31T04:10:20.521 INFO:teuthology.orchestra.run.smithi177.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-08-31T04:10:20.521 INFO:teuthology.orchestra.run.smithi177.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-08-31T04:10:20.521 INFO:teuthology.orchestra.run.smithi177.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-08-31T04:10:20.521 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-08-31T04:10:20.763 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : ceph-mds-2:19.3.0-4560.gd19e6118.el9.x86_64 108/152 2024-08-31T04:10:20.786 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: ceph-mds-2:19.3.0-4560.gd19e6118.el9.x86_64 108/152 2024-08-31T04:10:20.786 INFO:teuthology.orchestra.run.smithi177.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-31T04:10:20.786 INFO:teuthology.orchestra.run.smithi177.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-08-31T04:10:20.786 INFO:teuthology.orchestra.run.smithi177.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-08-31T04:10:20.786 INFO:teuthology.orchestra.run.smithi177.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-08-31T04:10:20.787 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-08-31T04:10:21.254 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : ceph-mon-2:19.3.0-4560.gd19e6118.el9.x86_64 109/152 2024-08-31T04:10:21.278 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: ceph-mon-2:19.3.0-4560.gd19e6118.el9.x86_64 109/152 2024-08-31T04:10:21.278 INFO:teuthology.orchestra.run.smithi177.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-31T04:10:21.278 INFO:teuthology.orchestra.run.smithi177.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-08-31T04:10:21.278 INFO:teuthology.orchestra.run.smithi177.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-08-31T04:10:21.279 INFO:teuthology.orchestra.run.smithi177.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-08-31T04:10:21.279 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-08-31T04:10:21.385 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : automake-1.16.2-8.el9.noarch 110/152 2024-08-31T04:10:21.441 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-ply-3.11-14.el9.noarch 111/152 2024-08-31T04:10:21.496 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 112/152 2024-08-31T04:10:21.688 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 113/152 2024-08-31T04:10:21.738 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 114/152 2024-08-31T04:10:21.816 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 115/152 2024-08-31T04:10:21.905 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 116/152 2024-08-31T04:10:22.043 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 117/152 2024-08-31T04:10:22.080 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 118/152 2024-08-31T04:10:22.112 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 119/152 2024-08-31T04:10:22.140 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : fuse-2.9.9-16.el9.x86_64 120/152 2024-08-31T04:10:22.611 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: cephadm-2:19.3.0-4560.gd19e6118.el9.noarch 121/152 2024-08-31T04:10:22.638 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : cephadm-2:19.3.0-4560.gd19e6118.el9.noarch 121/152 2024-08-31T04:10:22.670 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : ceph-prometheus-alerts-2:19.3.0-4560.gd19e6118.e 122/152 2024-08-31T04:10:22.736 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : ceph-grafana-dashboards-2:19.3.0-4560.gd19e6118. 123/152 2024-08-31T04:10:22.770 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : ceph-mgr-cephadm-2:19.3.0-4560.gd19e6118.el9.noa 124/152 2024-08-31T04:10:24.317 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: ceph-selinux-2:19.3.0-4560.gd19e6118.el9.x86_64 105/152 2024-08-31T04:10:24.317 INFO:teuthology.orchestra.run.smithi050.stdout:skipping the directory /sys 2024-08-31T04:10:24.317 INFO:teuthology.orchestra.run.smithi050.stdout:skipping the directory /proc 2024-08-31T04:10:24.317 INFO:teuthology.orchestra.run.smithi050.stdout:skipping the directory /mnt 2024-08-31T04:10:24.317 INFO:teuthology.orchestra.run.smithi050.stdout:skipping the directory /var/tmp 2024-08-31T04:10:24.317 INFO:teuthology.orchestra.run.smithi050.stdout:skipping the directory /home 2024-08-31T04:10:24.317 INFO:teuthology.orchestra.run.smithi050.stdout:skipping the directory /root 2024-08-31T04:10:24.317 INFO:teuthology.orchestra.run.smithi050.stdout:skipping the directory /tmp 2024-08-31T04:10:24.317 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-08-31T04:10:24.529 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-volume-2:19.3.0-4560.gd19e6118.el9.noarch 106/152 2024-08-31T04:10:24.565 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: ceph-volume-2:19.3.0-4560.gd19e6118.el9.noarch 106/152 2024-08-31T04:10:24.566 INFO:teuthology.orchestra.run.smithi050.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-31T04:10:24.566 INFO:teuthology.orchestra.run.smithi050.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-08-31T04:10:24.566 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-08-31T04:10:25.945 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.3.0-4560.gd19e6118.el9.noa 124/152 2024-08-31T04:10:26.000 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : ceph-mgr-dashboard-2:19.3.0-4560.gd19e6118.el9.n 125/152 2024-08-31T04:10:26.311 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 152/152 2024-08-31T04:10:26.311 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : ceph-2:19.3.0-4560.gd19e6118.el9.x86_64 1/152 2024-08-31T04:10:26.311 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : ceph-base-2:19.3.0-4560.gd19e6118.el9.x86_64 2/152 2024-08-31T04:10:26.311 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : ceph-common-2:19.3.0-4560.gd19e6118.el9.x86_64 3/152 2024-08-31T04:10:26.311 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : ceph-fuse-2:19.3.0-4560.gd19e6118.el9.x86_64 4/152 2024-08-31T04:10:26.311 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : ceph-immutable-object-cache-2:19.3.0-4560.gd19e6 5/152 2024-08-31T04:10:26.311 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : ceph-mds-2:19.3.0-4560.gd19e6118.el9.x86_64 6/152 2024-08-31T04:10:26.312 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : ceph-mgr-2:19.3.0-4560.gd19e6118.el9.x86_64 7/152 2024-08-31T04:10:26.312 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : ceph-mon-2:19.3.0-4560.gd19e6118.el9.x86_64 8/152 2024-08-31T04:10:26.312 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : ceph-osd-2:19.3.0-4560.gd19e6118.el9.x86_64 9/152 2024-08-31T04:10:26.312 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : ceph-radosgw-2:19.3.0-4560.gd19e6118.el9.x86_64 10/152 2024-08-31T04:10:26.312 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : ceph-selinux-2:19.3.0-4560.gd19e6118.el9.x86_64 11/152 2024-08-31T04:10:26.312 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : ceph-test-2:19.3.0-4560.gd19e6118.el9.x86_64 12/152 2024-08-31T04:10:26.312 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : cephfs-mirror-2:19.3.0-4560.gd19e6118.el9.x86_64 13/152 2024-08-31T04:10:26.312 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : cephfs-shell-2:19.3.0-4560.gd19e6118.el9.x86_64 14/152 2024-08-31T04:10:26.312 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : libcephfs-devel-2:19.3.0-4560.gd19e6118.el9.x86_ 15/152 2024-08-31T04:10:26.312 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : libcephfs2-2:19.3.0-4560.gd19e6118.el9.x86_64 16/152 2024-08-31T04:10:26.312 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : libcephsqlite-2:19.3.0-4560.gd19e6118.el9.x86_64 17/152 2024-08-31T04:10:26.313 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : librados-devel-2:19.3.0-4560.gd19e6118.el9.x86_6 18/152 2024-08-31T04:10:26.313 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : libradosstriper1-2:19.3.0-4560.gd19e6118.el9.x86 19/152 2024-08-31T04:10:26.313 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : librgw2-2:19.3.0-4560.gd19e6118.el9.x86_64 20/152 2024-08-31T04:10:26.313 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-ceph-argparse-2:19.3.0-4560.gd19e6118.el 21/152 2024-08-31T04:10:26.313 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-ceph-common-2:19.3.0-4560.gd19e6118.el9. 22/152 2024-08-31T04:10:26.313 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-cephfs-2:19.3.0-4560.gd19e6118.el9.x86_6 23/152 2024-08-31T04:10:26.313 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-rados-2:19.3.0-4560.gd19e6118.el9.x86_64 24/152 2024-08-31T04:10:26.313 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-rbd-2:19.3.0-4560.gd19e6118.el9.x86_64 25/152 2024-08-31T04:10:26.313 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-rgw-2:19.3.0-4560.gd19e6118.el9.x86_64 26/152 2024-08-31T04:10:26.313 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : rbd-fuse-2:19.3.0-4560.gd19e6118.el9.x86_64 27/152 2024-08-31T04:10:26.324 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : rbd-mirror-2:19.3.0-4560.gd19e6118.el9.x86_64 28/152 2024-08-31T04:10:26.324 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : rbd-nbd-2:19.3.0-4560.gd19e6118.el9.x86_64 29/152 2024-08-31T04:10:26.324 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : ceph-grafana-dashboards-2:19.3.0-4560.gd19e6118. 30/152 2024-08-31T04:10:26.324 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : ceph-mgr-cephadm-2:19.3.0-4560.gd19e6118.el9.noa 31/152 2024-08-31T04:10:26.324 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : ceph-mgr-dashboard-2:19.3.0-4560.gd19e6118.el9.n 32/152 2024-08-31T04:10:26.324 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.3.0-4560.gd19 33/152 2024-08-31T04:10:26.324 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : ceph-mgr-modules-core-2:19.3.0-4560.gd19e6118.el 34/152 2024-08-31T04:10:26.325 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : ceph-mgr-rook-2:19.3.0-4560.gd19e6118.el9.noarch 35/152 2024-08-31T04:10:26.325 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : ceph-prometheus-alerts-2:19.3.0-4560.gd19e6118.e 36/152 2024-08-31T04:10:26.325 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : ceph-volume-2:19.3.0-4560.gd19e6118.el9.noarch 37/152 2024-08-31T04:10:26.325 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : cephadm-2:19.3.0-4560.gd19e6118.el9.noarch 38/152 2024-08-31T04:10:26.325 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : cephfs-top-2:19.3.0-4560.gd19e6118.el9.noarch 39/152 2024-08-31T04:10:26.325 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/152 2024-08-31T04:10:26.325 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/152 2024-08-31T04:10:26.325 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/152 2024-08-31T04:10:26.325 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/152 2024-08-31T04:10:26.325 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/152 2024-08-31T04:10:26.325 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/152 2024-08-31T04:10:26.325 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/152 2024-08-31T04:10:26.326 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/152 2024-08-31T04:10:26.326 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/152 2024-08-31T04:10:26.326 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/152 2024-08-31T04:10:26.326 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/152 2024-08-31T04:10:26.326 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/152 2024-08-31T04:10:26.326 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/152 2024-08-31T04:10:26.326 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/152 2024-08-31T04:10:26.326 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/152 2024-08-31T04:10:26.326 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/152 2024-08-31T04:10:26.326 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/152 2024-08-31T04:10:26.326 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/152 2024-08-31T04:10:26.326 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/152 2024-08-31T04:10:26.326 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/152 2024-08-31T04:10:26.327 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/152 2024-08-31T04:10:26.327 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 61/152 2024-08-31T04:10:26.327 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 62/152 2024-08-31T04:10:26.327 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/152 2024-08-31T04:10:26.327 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/152 2024-08-31T04:10:26.327 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/152 2024-08-31T04:10:26.327 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 66/152 2024-08-31T04:10:26.327 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 67/152 2024-08-31T04:10:26.327 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : openssl-devel-1:3.2.2-4.el9.x86_64 68/152 2024-08-31T04:10:26.327 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : postgresql-13.16-1.el9.x86_64 69/152 2024-08-31T04:10:26.327 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 70/152 2024-08-31T04:10:26.327 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 71/152 2024-08-31T04:10:26.327 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 72/152 2024-08-31T04:10:26.328 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/152 2024-08-31T04:10:26.328 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/152 2024-08-31T04:10:26.328 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/152 2024-08-31T04:10:26.328 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/152 2024-08-31T04:10:26.328 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 77/152 2024-08-31T04:10:26.328 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/152 2024-08-31T04:10:26.328 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/152 2024-08-31T04:10:26.328 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/152 2024-08-31T04:10:26.328 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/152 2024-08-31T04:10:26.328 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/152 2024-08-31T04:10:26.328 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/152 2024-08-31T04:10:26.328 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/152 2024-08-31T04:10:26.329 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/152 2024-08-31T04:10:26.329 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/152 2024-08-31T04:10:26.329 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/152 2024-08-31T04:10:26.329 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/152 2024-08-31T04:10:26.329 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/152 2024-08-31T04:10:26.329 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/152 2024-08-31T04:10:26.329 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/152 2024-08-31T04:10:26.329 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/152 2024-08-31T04:10:26.329 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/152 2024-08-31T04:10:26.329 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/152 2024-08-31T04:10:26.329 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/152 2024-08-31T04:10:26.329 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/152 2024-08-31T04:10:26.329 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/152 2024-08-31T04:10:26.330 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/152 2024-08-31T04:10:26.330 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 99/152 2024-08-31T04:10:26.330 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/152 2024-08-31T04:10:26.330 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 101/152 2024-08-31T04:10:26.330 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/152 2024-08-31T04:10:26.330 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/152 2024-08-31T04:10:26.330 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/152 2024-08-31T04:10:26.330 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/152 2024-08-31T04:10:26.330 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/152 2024-08-31T04:10:26.330 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 107/152 2024-08-31T04:10:26.330 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/152 2024-08-31T04:10:26.330 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/152 2024-08-31T04:10:26.330 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/152 2024-08-31T04:10:26.331 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/152 2024-08-31T04:10:26.331 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/152 2024-08-31T04:10:26.331 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/152 2024-08-31T04:10:26.331 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/152 2024-08-31T04:10:26.331 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/152 2024-08-31T04:10:26.331 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/152 2024-08-31T04:10:26.331 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/152 2024-08-31T04:10:26.331 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 118/152 2024-08-31T04:10:26.331 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/152 2024-08-31T04:10:26.331 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/152 2024-08-31T04:10:26.331 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/152 2024-08-31T04:10:26.331 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 122/152 2024-08-31T04:10:26.331 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/152 2024-08-31T04:10:26.332 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/152 2024-08-31T04:10:26.332 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/152 2024-08-31T04:10:26.332 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/152 2024-08-31T04:10:26.332 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/152 2024-08-31T04:10:26.332 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/152 2024-08-31T04:10:26.332 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/152 2024-08-31T04:10:26.332 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/152 2024-08-31T04:10:26.332 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/152 2024-08-31T04:10:26.332 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/152 2024-08-31T04:10:26.332 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/152 2024-08-31T04:10:26.332 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/152 2024-08-31T04:10:26.332 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/152 2024-08-31T04:10:26.332 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/152 2024-08-31T04:10:26.333 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/152 2024-08-31T04:10:26.333 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/152 2024-08-31T04:10:26.333 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/152 2024-08-31T04:10:26.333 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/152 2024-08-31T04:10:26.333 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/152 2024-08-31T04:10:26.333 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 142/152 2024-08-31T04:10:26.333 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 143/152 2024-08-31T04:10:26.333 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/152 2024-08-31T04:10:26.333 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/152 2024-08-31T04:10:26.333 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/152 2024-08-31T04:10:26.333 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : re2-1:20211101-20.el9.x86_64 147/152 2024-08-31T04:10:26.333 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/152 2024-08-31T04:10:26.334 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : librados2-2:19.3.0-4560.gd19e6118.el9.x86_64 149/152 2024-08-31T04:10:26.334 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/152 2024-08-31T04:10:26.334 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : librbd1-2:19.3.0-4560.gd19e6118.el9.x86_64 151/152 2024-08-31T04:10:26.357 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-osd-2:19.3.0-4560.gd19e6118.el9.x86_64 107/152 2024-08-31T04:10:26.416 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: ceph-osd-2:19.3.0-4560.gd19e6118.el9.x86_64 107/152 2024-08-31T04:10:26.416 INFO:teuthology.orchestra.run.smithi050.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-31T04:10:26.416 INFO:teuthology.orchestra.run.smithi050.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-08-31T04:10:26.416 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-08-31T04:10:26.416 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-08-31T04:10:26.416 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-08-31T04:10:26.674 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-mds-2:19.3.0-4560.gd19e6118.el9.x86_64 108/152 2024-08-31T04:10:26.725 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: ceph-mds-2:19.3.0-4560.gd19e6118.el9.x86_64 108/152 2024-08-31T04:10:26.725 INFO:teuthology.orchestra.run.smithi050.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-31T04:10:26.725 INFO:teuthology.orchestra.run.smithi050.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-08-31T04:10:26.726 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-08-31T04:10:26.726 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-08-31T04:10:26.726 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-08-31T04:10:26.966 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.3.0-4560.gd19e6118.el9.n 125/152 2024-08-31T04:10:26.993 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : ceph-mgr-diskprediction-local-2:19.3.0-4560.gd19 126/152 2024-08-31T04:10:27.108 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.3.0-4560.gd19 126/152 2024-08-31T04:10:27.266 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-mon-2:19.3.0-4560.gd19e6118.el9.x86_64 109/152 2024-08-31T04:10:27.268 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : ceph-mgr-modules-core-2:19.3.0-4560.gd19e6118.el 127/152 2024-08-31T04:10:27.294 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : ceph-mgr-2:19.3.0-4560.gd19e6118.el9.x86_64 128/152 2024-08-31T04:10:27.317 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: ceph-mgr-2:19.3.0-4560.gd19e6118.el9.x86_64 128/152 2024-08-31T04:10:27.318 INFO:teuthology.orchestra.run.smithi177.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-31T04:10:27.318 INFO:teuthology.orchestra.run.smithi177.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-08-31T04:10:27.318 INFO:teuthology.orchestra.run.smithi177.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-08-31T04:10:27.318 INFO:teuthology.orchestra.run.smithi177.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-08-31T04:10:27.318 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-08-31T04:10:27.319 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: ceph-mon-2:19.3.0-4560.gd19e6118.el9.x86_64 109/152 2024-08-31T04:10:27.319 INFO:teuthology.orchestra.run.smithi050.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-31T04:10:27.319 INFO:teuthology.orchestra.run.smithi050.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-08-31T04:10:27.319 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-08-31T04:10:27.319 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-08-31T04:10:27.319 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-08-31T04:10:27.361 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : ceph-mgr-rook-2:19.3.0-4560.gd19e6118.el9.noarch 129/152 2024-08-31T04:10:27.373 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: ceph-mgr-rook-2:19.3.0-4560.gd19e6118.el9.noarch 129/152 2024-08-31T04:10:27.467 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : automake-1.16.2-8.el9.noarch 110/152 2024-08-31T04:10:27.472 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : ceph-2:19.3.0-4560.gd19e6118.el9.x86_64 130/152 2024-08-31T04:10:27.518 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : ceph-fuse-2:19.3.0-4560.gd19e6118.el9.x86_64 131/152 2024-08-31T04:10:27.528 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-ply-3.11-14.el9.noarch 111/152 2024-08-31T04:10:27.610 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 112/152 2024-08-31T04:10:27.855 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 113/152 2024-08-31T04:10:27.921 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 114/152 2024-08-31T04:10:28.013 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 115/152 2024-08-31T04:10:28.119 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 116/152 2024-08-31T04:10:28.291 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 117/152 2024-08-31T04:10:28.354 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 118/152 2024-08-31T04:10:28.402 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 119/152 2024-08-31T04:10:28.435 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : fuse-2.9.9-16.el9.x86_64 120/152 2024-08-31T04:10:28.483 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : libtool-2.4.6-46.el9.x86_64 132/152 2024-08-31T04:10:28.514 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : ceph-radosgw-2:19.3.0-4560.gd19e6118.el9.x86_64 133/152 2024-08-31T04:10:28.538 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: ceph-radosgw-2:19.3.0-4560.gd19e6118.el9.x86_64 133/152 2024-08-31T04:10:28.538 INFO:teuthology.orchestra.run.smithi177.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-31T04:10:28.538 INFO:teuthology.orchestra.run.smithi177.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-08-31T04:10:28.538 INFO:teuthology.orchestra.run.smithi177.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-08-31T04:10:28.538 INFO:teuthology.orchestra.run.smithi177.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-08-31T04:10:28.538 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-08-31T04:10:28.581 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : ceph-immutable-object-cache-2:19.3.0-4560.gd19e6 134/152 2024-08-31T04:10:28.603 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.3.0-4560.gd19e6 134/152 2024-08-31T04:10:28.604 INFO:teuthology.orchestra.run.smithi177.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-31T04:10:28.604 INFO:teuthology.orchestra.run.smithi177.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-08-31T04:10:28.604 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-08-31T04:10:28.619 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/152 2024-08-31T04:10:28.619 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-08-31T04:10:28.619 INFO:teuthology.orchestra.run.smithi133.stdout:Upgraded: 2024-08-31T04:10:28.620 INFO:teuthology.orchestra.run.smithi133.stdout: librados2-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T04:10:28.620 INFO:teuthology.orchestra.run.smithi133.stdout: librbd1-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T04:10:28.620 INFO:teuthology.orchestra.run.smithi133.stdout:Installed: 2024-08-31T04:10:28.620 INFO:teuthology.orchestra.run.smithi133.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-08-31T04:10:28.620 INFO:teuthology.orchestra.run.smithi133.stdout: automake-1.16.2-8.el9.noarch 2024-08-31T04:10:28.620 INFO:teuthology.orchestra.run.smithi133.stdout: bison-3.7.4-5.el9.x86_64 2024-08-31T04:10:28.620 INFO:teuthology.orchestra.run.smithi133.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-08-31T04:10:28.620 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T04:10:28.620 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-base-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T04:10:28.620 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-common-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T04:10:28.620 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-fuse-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T04:10:28.620 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-grafana-dashboards-2:19.3.0-4560.gd19e6118.el9.noarch 2024-08-31T04:10:28.621 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-immutable-object-cache-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T04:10:28.621 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-mds-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T04:10:28.621 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-mgr-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T04:10:28.621 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-mgr-cephadm-2:19.3.0-4560.gd19e6118.el9.noarch 2024-08-31T04:10:28.621 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-mgr-dashboard-2:19.3.0-4560.gd19e6118.el9.noarch 2024-08-31T04:10:28.621 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-mgr-diskprediction-local-2:19.3.0-4560.gd19e6118.el9.noarch 2024-08-31T04:10:28.621 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-mgr-modules-core-2:19.3.0-4560.gd19e6118.el9.noarch 2024-08-31T04:10:28.621 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-mgr-rook-2:19.3.0-4560.gd19e6118.el9.noarch 2024-08-31T04:10:28.621 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-mon-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T04:10:28.621 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-osd-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T04:10:28.621 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-prometheus-alerts-2:19.3.0-4560.gd19e6118.el9.noarch 2024-08-31T04:10:28.621 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-radosgw-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T04:10:28.621 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-selinux-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T04:10:28.622 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-test-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T04:10:28.622 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-volume-2:19.3.0-4560.gd19e6118.el9.noarch 2024-08-31T04:10:28.622 INFO:teuthology.orchestra.run.smithi133.stdout: cephadm-2:19.3.0-4560.gd19e6118.el9.noarch 2024-08-31T04:10:28.622 INFO:teuthology.orchestra.run.smithi133.stdout: cephfs-mirror-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T04:10:28.622 INFO:teuthology.orchestra.run.smithi133.stdout: cephfs-shell-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T04:10:28.622 INFO:teuthology.orchestra.run.smithi133.stdout: cephfs-top-2:19.3.0-4560.gd19e6118.el9.noarch 2024-08-31T04:10:28.622 INFO:teuthology.orchestra.run.smithi133.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-08-31T04:10:28.622 INFO:teuthology.orchestra.run.smithi133.stdout: flex-2.6.4-9.el9.x86_64 2024-08-31T04:10:28.622 INFO:teuthology.orchestra.run.smithi133.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-08-31T04:10:28.622 INFO:teuthology.orchestra.run.smithi133.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-08-31T04:10:28.622 INFO:teuthology.orchestra.run.smithi133.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-08-31T04:10:28.623 INFO:teuthology.orchestra.run.smithi133.stdout: fuse-2.9.9-16.el9.x86_64 2024-08-31T04:10:28.623 INFO:teuthology.orchestra.run.smithi133.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-08-31T04:10:28.623 INFO:teuthology.orchestra.run.smithi133.stdout: grpc-data-1.46.7-10.el9.noarch 2024-08-31T04:10:28.623 INFO:teuthology.orchestra.run.smithi133.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-08-31T04:10:28.623 INFO:teuthology.orchestra.run.smithi133.stdout: libarrow-9.0.0-11.el9.x86_64 2024-08-31T04:10:28.623 INFO:teuthology.orchestra.run.smithi133.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-08-31T04:10:28.623 INFO:teuthology.orchestra.run.smithi133.stdout: libcephfs-devel-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T04:10:28.623 INFO:teuthology.orchestra.run.smithi133.stdout: libcephfs2-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T04:10:28.623 INFO:teuthology.orchestra.run.smithi133.stdout: libcephsqlite-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T04:10:28.623 INFO:teuthology.orchestra.run.smithi133.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-08-31T04:10:28.623 INFO:teuthology.orchestra.run.smithi133.stdout: liboath-2.6.7-2.el9.x86_64 2024-08-31T04:10:28.623 INFO:teuthology.orchestra.run.smithi133.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-08-31T04:10:28.624 INFO:teuthology.orchestra.run.smithi133.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-08-31T04:10:28.624 INFO:teuthology.orchestra.run.smithi133.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-08-31T04:10:28.624 INFO:teuthology.orchestra.run.smithi133.stdout: librados-devel-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T04:10:28.624 INFO:teuthology.orchestra.run.smithi133.stdout: libradosstriper1-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T04:10:28.624 INFO:teuthology.orchestra.run.smithi133.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-08-31T04:10:28.624 INFO:teuthology.orchestra.run.smithi133.stdout: librgw2-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T04:10:28.624 INFO:teuthology.orchestra.run.smithi133.stdout: libtool-2.4.6-46.el9.x86_64 2024-08-31T04:10:28.624 INFO:teuthology.orchestra.run.smithi133.stdout: libunwind-1.6.2-1.el9.x86_64 2024-08-31T04:10:28.624 INFO:teuthology.orchestra.run.smithi133.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-08-31T04:10:28.624 INFO:teuthology.orchestra.run.smithi133.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-08-31T04:10:28.624 INFO:teuthology.orchestra.run.smithi133.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-08-31T04:10:28.624 INFO:teuthology.orchestra.run.smithi133.stdout: lua-5.4.4-4.el9.x86_64 2024-08-31T04:10:28.624 INFO:teuthology.orchestra.run.smithi133.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-08-31T04:10:28.625 INFO:teuthology.orchestra.run.smithi133.stdout: luarocks-3.9.2-5.el9.noarch 2024-08-31T04:10:28.625 INFO:teuthology.orchestra.run.smithi133.stdout: openblas-0.3.26-2.el9.x86_64 2024-08-31T04:10:28.625 INFO:teuthology.orchestra.run.smithi133.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-08-31T04:10:28.625 INFO:teuthology.orchestra.run.smithi133.stdout: openssl-devel-1:3.2.2-4.el9.x86_64 2024-08-31T04:10:28.625 INFO:teuthology.orchestra.run.smithi133.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-08-31T04:10:28.625 INFO:teuthology.orchestra.run.smithi133.stdout: postgresql-13.16-1.el9.x86_64 2024-08-31T04:10:28.625 INFO:teuthology.orchestra.run.smithi133.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-08-31T04:10:28.625 INFO:teuthology.orchestra.run.smithi133.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-08-31T04:10:28.625 INFO:teuthology.orchestra.run.smithi133.stdout: postgresql-server-13.16-1.el9.x86_64 2024-08-31T04:10:28.625 INFO:teuthology.orchestra.run.smithi133.stdout: protobuf-3.14.0-13.el9.x86_64 2024-08-31T04:10:28.625 INFO:teuthology.orchestra.run.smithi133.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-08-31T04:10:28.625 INFO:teuthology.orchestra.run.smithi133.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-08-31T04:10:28.625 INFO:teuthology.orchestra.run.smithi133.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-08-31T04:10:28.626 INFO:teuthology.orchestra.run.smithi133.stdout: python3-babel-2.9.1-2.el9.noarch 2024-08-31T04:10:28.626 INFO:teuthology.orchestra.run.smithi133.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-08-31T04:10:28.626 INFO:teuthology.orchestra.run.smithi133.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-08-31T04:10:28.626 INFO:teuthology.orchestra.run.smithi133.stdout: python3-ceph-argparse-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T04:10:28.626 INFO:teuthology.orchestra.run.smithi133.stdout: python3-ceph-common-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T04:10:28.626 INFO:teuthology.orchestra.run.smithi133.stdout: python3-cephfs-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T04:10:28.626 INFO:teuthology.orchestra.run.smithi133.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-08-31T04:10:28.626 INFO:teuthology.orchestra.run.smithi133.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-08-31T04:10:28.626 INFO:teuthology.orchestra.run.smithi133.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-08-31T04:10:28.626 INFO:teuthology.orchestra.run.smithi133.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-08-31T04:10:28.626 INFO:teuthology.orchestra.run.smithi133.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-08-31T04:10:28.626 INFO:teuthology.orchestra.run.smithi133.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-08-31T04:10:28.627 INFO:teuthology.orchestra.run.smithi133.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-08-31T04:10:28.627 INFO:teuthology.orchestra.run.smithi133.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-08-31T04:10:28.627 INFO:teuthology.orchestra.run.smithi133.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-08-31T04:10:28.627 INFO:teuthology.orchestra.run.smithi133.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-08-31T04:10:28.627 INFO:teuthology.orchestra.run.smithi133.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-08-31T04:10:28.627 INFO:teuthology.orchestra.run.smithi133.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-08-31T04:10:28.627 INFO:teuthology.orchestra.run.smithi133.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-08-31T04:10:28.627 INFO:teuthology.orchestra.run.smithi133.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-08-31T04:10:28.627 INFO:teuthology.orchestra.run.smithi133.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-08-31T04:10:28.627 INFO:teuthology.orchestra.run.smithi133.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-08-31T04:10:28.627 INFO:teuthology.orchestra.run.smithi133.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-08-31T04:10:28.627 INFO:teuthology.orchestra.run.smithi133.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-08-31T04:10:28.627 INFO:teuthology.orchestra.run.smithi133.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-08-31T04:10:28.627 INFO:teuthology.orchestra.run.smithi133.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-08-31T04:10:28.628 INFO:teuthology.orchestra.run.smithi133.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-08-31T04:10:28.628 INFO:teuthology.orchestra.run.smithi133.stdout: python3-mako-1.1.4-6.el9.noarch 2024-08-31T04:10:28.628 INFO:teuthology.orchestra.run.smithi133.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-08-31T04:10:28.628 INFO:teuthology.orchestra.run.smithi133.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-08-31T04:10:28.628 INFO:teuthology.orchestra.run.smithi133.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-08-31T04:10:28.628 INFO:teuthology.orchestra.run.smithi133.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-08-31T04:10:28.628 INFO:teuthology.orchestra.run.smithi133.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-08-31T04:10:28.628 INFO:teuthology.orchestra.run.smithi133.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-08-31T04:10:28.628 INFO:teuthology.orchestra.run.smithi133.stdout: python3-packaging-20.9-5.el9.noarch 2024-08-31T04:10:28.628 INFO:teuthology.orchestra.run.smithi133.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-08-31T04:10:28.628 INFO:teuthology.orchestra.run.smithi133.stdout: python3-ply-3.11-14.el9.noarch 2024-08-31T04:10:28.628 INFO:teuthology.orchestra.run.smithi133.stdout: python3-portend-3.1.0-2.el9.noarch 2024-08-31T04:10:28.628 INFO:teuthology.orchestra.run.smithi133.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-08-31T04:10:28.629 INFO:teuthology.orchestra.run.smithi133.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-08-31T04:10:28.629 INFO:teuthology.orchestra.run.smithi133.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-08-31T04:10:28.629 INFO:teuthology.orchestra.run.smithi133.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-08-31T04:10:28.629 INFO:teuthology.orchestra.run.smithi133.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-08-31T04:10:28.629 INFO:teuthology.orchestra.run.smithi133.stdout: python3-pycparser-2.20-6.el9.noarch 2024-08-31T04:10:28.629 INFO:teuthology.orchestra.run.smithi133.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-08-31T04:10:28.629 INFO:teuthology.orchestra.run.smithi133.stdout: python3-pytz-2021.1-5.el9.noarch 2024-08-31T04:10:28.629 INFO:teuthology.orchestra.run.smithi133.stdout: python3-rados-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T04:10:28.629 INFO:teuthology.orchestra.run.smithi133.stdout: python3-rbd-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T04:10:28.629 INFO:teuthology.orchestra.run.smithi133.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-08-31T04:10:28.629 INFO:teuthology.orchestra.run.smithi133.stdout: python3-requests-2.25.1-8.el9.noarch 2024-08-31T04:10:28.629 INFO:teuthology.orchestra.run.smithi133.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-08-31T04:10:28.629 INFO:teuthology.orchestra.run.smithi133.stdout: python3-rgw-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T04:10:28.629 INFO:teuthology.orchestra.run.smithi133.stdout: python3-routes-2.5.1-5.el9.noarch 2024-08-31T04:10:28.630 INFO:teuthology.orchestra.run.smithi133.stdout: python3-rsa-4.9-2.el9.noarch 2024-08-31T04:10:28.630 INFO:teuthology.orchestra.run.smithi133.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-08-31T04:10:28.630 INFO:teuthology.orchestra.run.smithi133.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-08-31T04:10:28.630 INFO:teuthology.orchestra.run.smithi133.stdout: python3-toml-0.10.2-6.el9.noarch 2024-08-31T04:10:28.630 INFO:teuthology.orchestra.run.smithi133.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-08-31T04:10:28.630 INFO:teuthology.orchestra.run.smithi133.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-08-31T04:10:28.630 INFO:teuthology.orchestra.run.smithi133.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-08-31T04:10:28.630 INFO:teuthology.orchestra.run.smithi133.stdout: python3-webob-1.8.8-2.el9.noarch 2024-08-31T04:10:28.630 INFO:teuthology.orchestra.run.smithi133.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-08-31T04:10:28.630 INFO:teuthology.orchestra.run.smithi133.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-08-31T04:10:28.630 INFO:teuthology.orchestra.run.smithi133.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-08-31T04:10:28.630 INFO:teuthology.orchestra.run.smithi133.stdout: qatlib-24.02.0-1.el9.x86_64 2024-08-31T04:10:28.630 INFO:teuthology.orchestra.run.smithi133.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-08-31T04:10:28.631 INFO:teuthology.orchestra.run.smithi133.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-08-31T04:10:28.631 INFO:teuthology.orchestra.run.smithi133.stdout: rbd-fuse-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T04:10:28.631 INFO:teuthology.orchestra.run.smithi133.stdout: rbd-mirror-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T04:10:28.631 INFO:teuthology.orchestra.run.smithi133.stdout: rbd-nbd-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T04:10:28.631 INFO:teuthology.orchestra.run.smithi133.stdout: re2-1:20211101-20.el9.x86_64 2024-08-31T04:10:28.631 INFO:teuthology.orchestra.run.smithi133.stdout: socat-1.7.4.1-6.el9.x86_64 2024-08-31T04:10:28.631 INFO:teuthology.orchestra.run.smithi133.stdout: thrift-0.15.0-2.el9.x86_64 2024-08-31T04:10:28.631 INFO:teuthology.orchestra.run.smithi133.stdout: uuid-1.6.2-55.el9.x86_64 2024-08-31T04:10:28.631 INFO:teuthology.orchestra.run.smithi133.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-08-31T04:10:28.631 INFO:teuthology.orchestra.run.smithi133.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-08-31T04:10:28.632 INFO:teuthology.orchestra.run.smithi133.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-08-31T04:10:28.632 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-08-31T04:10:28.632 INFO:teuthology.orchestra.run.smithi133.stdout:Complete! 2024-08-31T04:10:28.648 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : cephfs-mirror-2:19.3.0-4560.gd19e6118.el9.x86_64 135/152 2024-08-31T04:10:28.671 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: cephfs-mirror-2:19.3.0-4560.gd19e6118.el9.x86_64 135/152 2024-08-31T04:10:28.672 INFO:teuthology.orchestra.run.smithi177.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-31T04:10:28.672 INFO:teuthology.orchestra.run.smithi177.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-08-31T04:10:28.672 INFO:teuthology.orchestra.run.smithi177.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-08-31T04:10:28.672 INFO:teuthology.orchestra.run.smithi177.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-08-31T04:10:28.672 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-08-31T04:10:28.947 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: cephadm-2:19.3.0-4560.gd19e6118.el9.noarch 121/152 2024-08-31T04:10:28.979 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : cephadm-2:19.3.0-4560.gd19e6118.el9.noarch 121/152 2024-08-31T04:10:28.991 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : rbd-mirror-2:19.3.0-4560.gd19e6118.el9.x86_64 136/152 2024-08-31T04:10:28.998 DEBUG:teuthology.parallel:result is None 2024-08-31T04:10:29.014 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: rbd-mirror-2:19.3.0-4560.gd19e6118.el9.x86_64 136/152 2024-08-31T04:10:29.014 INFO:teuthology.orchestra.run.smithi177.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-31T04:10:29.014 INFO:teuthology.orchestra.run.smithi177.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-08-31T04:10:29.014 INFO:teuthology.orchestra.run.smithi177.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-08-31T04:10:29.014 INFO:teuthology.orchestra.run.smithi177.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-08-31T04:10:29.014 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-08-31T04:10:29.022 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-prometheus-alerts-2:19.3.0-4560.gd19e6118.e 122/152 2024-08-31T04:10:29.107 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-grafana-dashboards-2:19.3.0-4560.gd19e6118. 123/152 2024-08-31T04:10:29.144 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-mgr-cephadm-2:19.3.0-4560.gd19e6118.el9.noa 124/152 2024-08-31T04:10:33.023 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.3.0-4560.gd19e6118.el9.noa 124/152 2024-08-31T04:10:33.091 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-mgr-dashboard-2:19.3.0-4560.gd19e6118.el9.n 125/152 2024-08-31T04:10:33.411 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : ceph-test-2:19.3.0-4560.gd19e6118.el9.x86_64 137/152 2024-08-31T04:10:33.452 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : rbd-fuse-2:19.3.0-4560.gd19e6118.el9.x86_64 138/152 2024-08-31T04:10:33.493 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : rbd-nbd-2:19.3.0-4560.gd19e6118.el9.x86_64 139/152 2024-08-31T04:10:33.525 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 140/152 2024-08-31T04:10:33.563 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 141/152 2024-08-31T04:10:33.740 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : cephfs-shell-2:19.3.0-4560.gd19e6118.el9.x86_64 142/152 2024-08-31T04:10:33.790 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 143/152 2024-08-31T04:10:33.820 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : libcephfs-devel-2:19.3.0-4560.gd19e6118.el9.x86_ 144/152 2024-08-31T04:10:34.244 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.3.0-4560.gd19e6118.el9.n 125/152 2024-08-31T04:10:34.274 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-mgr-diskprediction-local-2:19.3.0-4560.gd19 126/152 2024-08-31T04:10:34.434 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.3.0-4560.gd19 126/152 2024-08-31T04:10:34.491 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 145/152 2024-08-31T04:10:34.510 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 145/152 2024-08-31T04:10:34.529 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 145/152 2024-08-31T04:10:34.628 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-mgr-modules-core-2:19.3.0-4560.gd19e6118.el 127/152 2024-08-31T04:10:34.660 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-mgr-2:19.3.0-4560.gd19e6118.el9.x86_64 128/152 2024-08-31T04:10:34.712 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: ceph-mgr-2:19.3.0-4560.gd19e6118.el9.x86_64 128/152 2024-08-31T04:10:34.712 INFO:teuthology.orchestra.run.smithi050.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-31T04:10:34.713 INFO:teuthology.orchestra.run.smithi050.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-08-31T04:10:34.713 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-08-31T04:10:34.713 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-08-31T04:10:34.713 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-08-31T04:10:34.769 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-mgr-rook-2:19.3.0-4560.gd19e6118.el9.noarch 129/152 2024-08-31T04:10:34.796 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: ceph-mgr-rook-2:19.3.0-4560.gd19e6118.el9.noarch 129/152 2024-08-31T04:10:34.908 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-2:19.3.0-4560.gd19e6118.el9.x86_64 130/152 2024-08-31T04:10:34.980 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-fuse-2:19.3.0-4560.gd19e6118.el9.x86_64 131/152 2024-08-31T04:10:35.349 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : cephfs-top-2:19.3.0-4560.gd19e6118.el9.noarch 146/152 2024-08-31T04:10:35.430 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : openssl-devel-1:3.2.2-4.el9.x86_64 147/152 2024-08-31T04:10:35.471 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 148/152 2024-08-31T04:10:35.553 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : flex-2.6.4-9.el9.x86_64 149/152 2024-08-31T04:10:35.592 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : bison-3.7.4-5.el9.x86_64 150/152 2024-08-31T04:10:35.593 INFO:teuthology.orchestra.run.smithi177.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 151/152 2024-08-31T04:10:35.685 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 151/152 2024-08-31T04:10:35.685 INFO:teuthology.orchestra.run.smithi177.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 152/152 2024-08-31T04:10:36.095 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : libtool-2.4.6-46.el9.x86_64 132/152 2024-08-31T04:10:36.130 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-radosgw-2:19.3.0-4560.gd19e6118.el9.x86_64 133/152 2024-08-31T04:10:36.182 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: ceph-radosgw-2:19.3.0-4560.gd19e6118.el9.x86_64 133/152 2024-08-31T04:10:36.182 INFO:teuthology.orchestra.run.smithi050.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-31T04:10:36.182 INFO:teuthology.orchestra.run.smithi050.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-08-31T04:10:36.182 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-08-31T04:10:36.182 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-08-31T04:10:36.183 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-08-31T04:10:36.231 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-immutable-object-cache-2:19.3.0-4560.gd19e6 134/152 2024-08-31T04:10:36.282 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.3.0-4560.gd19e6 134/152 2024-08-31T04:10:36.282 INFO:teuthology.orchestra.run.smithi050.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-31T04:10:36.282 INFO:teuthology.orchestra.run.smithi050.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-08-31T04:10:36.282 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-08-31T04:10:36.340 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : cephfs-mirror-2:19.3.0-4560.gd19e6118.el9.x86_64 135/152 2024-08-31T04:10:36.391 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: cephfs-mirror-2:19.3.0-4560.gd19e6118.el9.x86_64 135/152 2024-08-31T04:10:36.391 INFO:teuthology.orchestra.run.smithi050.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-31T04:10:36.391 INFO:teuthology.orchestra.run.smithi050.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-08-31T04:10:36.391 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-08-31T04:10:36.392 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-08-31T04:10:36.392 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-08-31T04:10:36.766 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : rbd-mirror-2:19.3.0-4560.gd19e6118.el9.x86_64 136/152 2024-08-31T04:10:36.817 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: rbd-mirror-2:19.3.0-4560.gd19e6118.el9.x86_64 136/152 2024-08-31T04:10:36.817 INFO:teuthology.orchestra.run.smithi050.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-31T04:10:36.818 INFO:teuthology.orchestra.run.smithi050.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-08-31T04:10:36.818 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-08-31T04:10:36.818 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-08-31T04:10:36.818 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-08-31T04:10:41.860 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-test-2:19.3.0-4560.gd19e6118.el9.x86_64 137/152 2024-08-31T04:10:41.903 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : rbd-fuse-2:19.3.0-4560.gd19e6118.el9.x86_64 138/152 2024-08-31T04:10:41.963 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : rbd-nbd-2:19.3.0-4560.gd19e6118.el9.x86_64 139/152 2024-08-31T04:10:41.999 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 140/152 2024-08-31T04:10:42.035 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 141/152 2024-08-31T04:10:42.285 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : cephfs-shell-2:19.3.0-4560.gd19e6118.el9.x86_64 142/152 2024-08-31T04:10:42.340 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 143/152 2024-08-31T04:10:42.368 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : libcephfs-devel-2:19.3.0-4560.gd19e6118.el9.x86_ 144/152 2024-08-31T04:10:42.399 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 152/152 2024-08-31T04:10:42.399 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : ceph-2:19.3.0-4560.gd19e6118.el9.x86_64 1/152 2024-08-31T04:10:42.399 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : ceph-base-2:19.3.0-4560.gd19e6118.el9.x86_64 2/152 2024-08-31T04:10:42.400 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : ceph-common-2:19.3.0-4560.gd19e6118.el9.x86_64 3/152 2024-08-31T04:10:42.400 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : ceph-fuse-2:19.3.0-4560.gd19e6118.el9.x86_64 4/152 2024-08-31T04:10:42.400 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : ceph-immutable-object-cache-2:19.3.0-4560.gd19e6 5/152 2024-08-31T04:10:42.400 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : ceph-mds-2:19.3.0-4560.gd19e6118.el9.x86_64 6/152 2024-08-31T04:10:42.400 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : ceph-mgr-2:19.3.0-4560.gd19e6118.el9.x86_64 7/152 2024-08-31T04:10:42.400 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : ceph-mon-2:19.3.0-4560.gd19e6118.el9.x86_64 8/152 2024-08-31T04:10:42.400 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : ceph-osd-2:19.3.0-4560.gd19e6118.el9.x86_64 9/152 2024-08-31T04:10:42.400 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : ceph-radosgw-2:19.3.0-4560.gd19e6118.el9.x86_64 10/152 2024-08-31T04:10:42.400 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : ceph-selinux-2:19.3.0-4560.gd19e6118.el9.x86_64 11/152 2024-08-31T04:10:42.400 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : ceph-test-2:19.3.0-4560.gd19e6118.el9.x86_64 12/152 2024-08-31T04:10:42.400 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : cephfs-mirror-2:19.3.0-4560.gd19e6118.el9.x86_64 13/152 2024-08-31T04:10:42.400 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : cephfs-shell-2:19.3.0-4560.gd19e6118.el9.x86_64 14/152 2024-08-31T04:10:42.401 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : libcephfs-devel-2:19.3.0-4560.gd19e6118.el9.x86_ 15/152 2024-08-31T04:10:42.401 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : libcephfs2-2:19.3.0-4560.gd19e6118.el9.x86_64 16/152 2024-08-31T04:10:42.401 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : libcephsqlite-2:19.3.0-4560.gd19e6118.el9.x86_64 17/152 2024-08-31T04:10:42.401 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : librados-devel-2:19.3.0-4560.gd19e6118.el9.x86_6 18/152 2024-08-31T04:10:42.401 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : libradosstriper1-2:19.3.0-4560.gd19e6118.el9.x86 19/152 2024-08-31T04:10:42.401 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : librgw2-2:19.3.0-4560.gd19e6118.el9.x86_64 20/152 2024-08-31T04:10:42.401 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-ceph-argparse-2:19.3.0-4560.gd19e6118.el 21/152 2024-08-31T04:10:42.401 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-ceph-common-2:19.3.0-4560.gd19e6118.el9. 22/152 2024-08-31T04:10:42.401 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-cephfs-2:19.3.0-4560.gd19e6118.el9.x86_6 23/152 2024-08-31T04:10:42.401 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-rados-2:19.3.0-4560.gd19e6118.el9.x86_64 24/152 2024-08-31T04:10:42.401 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-rbd-2:19.3.0-4560.gd19e6118.el9.x86_64 25/152 2024-08-31T04:10:42.401 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-rgw-2:19.3.0-4560.gd19e6118.el9.x86_64 26/152 2024-08-31T04:10:42.402 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : rbd-fuse-2:19.3.0-4560.gd19e6118.el9.x86_64 27/152 2024-08-31T04:10:42.402 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : rbd-mirror-2:19.3.0-4560.gd19e6118.el9.x86_64 28/152 2024-08-31T04:10:42.402 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : rbd-nbd-2:19.3.0-4560.gd19e6118.el9.x86_64 29/152 2024-08-31T04:10:42.402 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : ceph-grafana-dashboards-2:19.3.0-4560.gd19e6118. 30/152 2024-08-31T04:10:42.402 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : ceph-mgr-cephadm-2:19.3.0-4560.gd19e6118.el9.noa 31/152 2024-08-31T04:10:42.402 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : ceph-mgr-dashboard-2:19.3.0-4560.gd19e6118.el9.n 32/152 2024-08-31T04:10:42.402 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.3.0-4560.gd19 33/152 2024-08-31T04:10:42.402 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : ceph-mgr-modules-core-2:19.3.0-4560.gd19e6118.el 34/152 2024-08-31T04:10:42.402 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : ceph-mgr-rook-2:19.3.0-4560.gd19e6118.el9.noarch 35/152 2024-08-31T04:10:42.402 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : ceph-prometheus-alerts-2:19.3.0-4560.gd19e6118.e 36/152 2024-08-31T04:10:42.402 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : ceph-volume-2:19.3.0-4560.gd19e6118.el9.noarch 37/152 2024-08-31T04:10:42.402 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : cephadm-2:19.3.0-4560.gd19e6118.el9.noarch 38/152 2024-08-31T04:10:42.402 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : cephfs-top-2:19.3.0-4560.gd19e6118.el9.noarch 39/152 2024-08-31T04:10:42.403 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/152 2024-08-31T04:10:42.403 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/152 2024-08-31T04:10:42.403 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/152 2024-08-31T04:10:42.403 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/152 2024-08-31T04:10:42.403 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/152 2024-08-31T04:10:42.403 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/152 2024-08-31T04:10:42.403 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/152 2024-08-31T04:10:42.403 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/152 2024-08-31T04:10:42.403 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/152 2024-08-31T04:10:42.403 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/152 2024-08-31T04:10:42.403 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/152 2024-08-31T04:10:42.403 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/152 2024-08-31T04:10:42.403 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/152 2024-08-31T04:10:42.404 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/152 2024-08-31T04:10:42.404 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/152 2024-08-31T04:10:42.404 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/152 2024-08-31T04:10:42.404 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/152 2024-08-31T04:10:42.404 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/152 2024-08-31T04:10:42.404 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/152 2024-08-31T04:10:42.404 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/152 2024-08-31T04:10:42.404 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/152 2024-08-31T04:10:42.404 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 61/152 2024-08-31T04:10:42.404 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 62/152 2024-08-31T04:10:42.404 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/152 2024-08-31T04:10:42.404 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/152 2024-08-31T04:10:42.404 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/152 2024-08-31T04:10:42.405 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 66/152 2024-08-31T04:10:42.405 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 67/152 2024-08-31T04:10:42.405 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : openssl-devel-1:3.2.2-4.el9.x86_64 68/152 2024-08-31T04:10:42.405 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : postgresql-13.16-1.el9.x86_64 69/152 2024-08-31T04:10:42.405 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 70/152 2024-08-31T04:10:42.405 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 71/152 2024-08-31T04:10:42.405 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 72/152 2024-08-31T04:10:42.405 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/152 2024-08-31T04:10:42.405 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/152 2024-08-31T04:10:42.405 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/152 2024-08-31T04:10:42.405 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/152 2024-08-31T04:10:42.405 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 77/152 2024-08-31T04:10:42.405 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/152 2024-08-31T04:10:42.406 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/152 2024-08-31T04:10:42.406 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/152 2024-08-31T04:10:42.406 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/152 2024-08-31T04:10:42.406 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/152 2024-08-31T04:10:42.406 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/152 2024-08-31T04:10:42.406 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/152 2024-08-31T04:10:42.406 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/152 2024-08-31T04:10:42.406 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/152 2024-08-31T04:10:42.406 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/152 2024-08-31T04:10:42.406 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/152 2024-08-31T04:10:42.406 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/152 2024-08-31T04:10:42.406 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/152 2024-08-31T04:10:42.406 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/152 2024-08-31T04:10:42.406 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/152 2024-08-31T04:10:42.407 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/152 2024-08-31T04:10:42.407 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/152 2024-08-31T04:10:42.407 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/152 2024-08-31T04:10:42.407 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/152 2024-08-31T04:10:42.407 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/152 2024-08-31T04:10:42.407 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/152 2024-08-31T04:10:42.407 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 99/152 2024-08-31T04:10:42.407 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/152 2024-08-31T04:10:42.407 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 101/152 2024-08-31T04:10:42.407 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/152 2024-08-31T04:10:42.407 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/152 2024-08-31T04:10:42.407 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/152 2024-08-31T04:10:42.407 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/152 2024-08-31T04:10:42.408 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/152 2024-08-31T04:10:42.408 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 107/152 2024-08-31T04:10:42.408 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/152 2024-08-31T04:10:42.408 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/152 2024-08-31T04:10:42.408 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/152 2024-08-31T04:10:42.408 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/152 2024-08-31T04:10:42.408 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/152 2024-08-31T04:10:42.408 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/152 2024-08-31T04:10:42.408 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/152 2024-08-31T04:10:42.408 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/152 2024-08-31T04:10:42.408 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/152 2024-08-31T04:10:42.408 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/152 2024-08-31T04:10:42.408 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 118/152 2024-08-31T04:10:42.409 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/152 2024-08-31T04:10:42.409 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/152 2024-08-31T04:10:42.409 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/152 2024-08-31T04:10:42.409 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 122/152 2024-08-31T04:10:42.409 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/152 2024-08-31T04:10:42.409 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/152 2024-08-31T04:10:42.409 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/152 2024-08-31T04:10:42.409 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/152 2024-08-31T04:10:42.409 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/152 2024-08-31T04:10:42.409 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/152 2024-08-31T04:10:42.410 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/152 2024-08-31T04:10:42.410 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/152 2024-08-31T04:10:42.410 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/152 2024-08-31T04:10:42.410 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/152 2024-08-31T04:10:42.410 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/152 2024-08-31T04:10:42.410 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/152 2024-08-31T04:10:42.410 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/152 2024-08-31T04:10:42.410 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/152 2024-08-31T04:10:42.410 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/152 2024-08-31T04:10:42.410 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/152 2024-08-31T04:10:42.410 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/152 2024-08-31T04:10:42.411 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/152 2024-08-31T04:10:42.411 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/152 2024-08-31T04:10:42.411 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 142/152 2024-08-31T04:10:42.411 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 143/152 2024-08-31T04:10:42.411 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/152 2024-08-31T04:10:42.411 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/152 2024-08-31T04:10:42.411 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/152 2024-08-31T04:10:42.411 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : re2-1:20211101-20.el9.x86_64 147/152 2024-08-31T04:10:42.411 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/152 2024-08-31T04:10:42.411 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : librados2-2:19.3.0-4560.gd19e6118.el9.x86_64 149/152 2024-08-31T04:10:42.411 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/152 2024-08-31T04:10:42.411 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : librbd1-2:19.3.0-4560.gd19e6118.el9.x86_64 151/152 2024-08-31T04:10:43.154 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 145/152 2024-08-31T04:10:43.199 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 145/152 2024-08-31T04:10:43.241 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 145/152 2024-08-31T04:10:44.620 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : cephfs-top-2:19.3.0-4560.gd19e6118.el9.noarch 146/152 2024-08-31T04:10:44.698 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/152 2024-08-31T04:10:44.698 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-08-31T04:10:44.698 INFO:teuthology.orchestra.run.smithi177.stdout:Upgraded: 2024-08-31T04:10:44.698 INFO:teuthology.orchestra.run.smithi177.stdout: librados2-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T04:10:44.698 INFO:teuthology.orchestra.run.smithi177.stdout: librbd1-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T04:10:44.698 INFO:teuthology.orchestra.run.smithi177.stdout:Installed: 2024-08-31T04:10:44.699 INFO:teuthology.orchestra.run.smithi177.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-08-31T04:10:44.699 INFO:teuthology.orchestra.run.smithi177.stdout: automake-1.16.2-8.el9.noarch 2024-08-31T04:10:44.699 INFO:teuthology.orchestra.run.smithi177.stdout: bison-3.7.4-5.el9.x86_64 2024-08-31T04:10:44.699 INFO:teuthology.orchestra.run.smithi177.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-08-31T04:10:44.699 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T04:10:44.699 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-base-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T04:10:44.699 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-common-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T04:10:44.699 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-fuse-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T04:10:44.699 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-grafana-dashboards-2:19.3.0-4560.gd19e6118.el9.noarch 2024-08-31T04:10:44.699 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-immutable-object-cache-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T04:10:44.699 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-mds-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T04:10:44.699 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-mgr-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T04:10:44.699 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-mgr-cephadm-2:19.3.0-4560.gd19e6118.el9.noarch 2024-08-31T04:10:44.699 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-mgr-dashboard-2:19.3.0-4560.gd19e6118.el9.noarch 2024-08-31T04:10:44.700 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-mgr-diskprediction-local-2:19.3.0-4560.gd19e6118.el9.noarch 2024-08-31T04:10:44.700 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-mgr-modules-core-2:19.3.0-4560.gd19e6118.el9.noarch 2024-08-31T04:10:44.700 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-mgr-rook-2:19.3.0-4560.gd19e6118.el9.noarch 2024-08-31T04:10:44.700 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-mon-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T04:10:44.700 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-osd-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T04:10:44.700 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-prometheus-alerts-2:19.3.0-4560.gd19e6118.el9.noarch 2024-08-31T04:10:44.700 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-radosgw-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T04:10:44.700 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-selinux-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T04:10:44.700 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-test-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T04:10:44.700 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-volume-2:19.3.0-4560.gd19e6118.el9.noarch 2024-08-31T04:10:44.700 INFO:teuthology.orchestra.run.smithi177.stdout: cephadm-2:19.3.0-4560.gd19e6118.el9.noarch 2024-08-31T04:10:44.700 INFO:teuthology.orchestra.run.smithi177.stdout: cephfs-mirror-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T04:10:44.701 INFO:teuthology.orchestra.run.smithi177.stdout: cephfs-shell-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T04:10:44.701 INFO:teuthology.orchestra.run.smithi177.stdout: cephfs-top-2:19.3.0-4560.gd19e6118.el9.noarch 2024-08-31T04:10:44.701 INFO:teuthology.orchestra.run.smithi177.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-08-31T04:10:44.701 INFO:teuthology.orchestra.run.smithi177.stdout: flex-2.6.4-9.el9.x86_64 2024-08-31T04:10:44.701 INFO:teuthology.orchestra.run.smithi177.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-08-31T04:10:44.701 INFO:teuthology.orchestra.run.smithi177.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-08-31T04:10:44.701 INFO:teuthology.orchestra.run.smithi177.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-08-31T04:10:44.701 INFO:teuthology.orchestra.run.smithi177.stdout: fuse-2.9.9-16.el9.x86_64 2024-08-31T04:10:44.701 INFO:teuthology.orchestra.run.smithi177.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-08-31T04:10:44.701 INFO:teuthology.orchestra.run.smithi177.stdout: grpc-data-1.46.7-10.el9.noarch 2024-08-31T04:10:44.701 INFO:teuthology.orchestra.run.smithi177.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-08-31T04:10:44.701 INFO:teuthology.orchestra.run.smithi177.stdout: libarrow-9.0.0-11.el9.x86_64 2024-08-31T04:10:44.701 INFO:teuthology.orchestra.run.smithi177.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-08-31T04:10:44.702 INFO:teuthology.orchestra.run.smithi177.stdout: libcephfs-devel-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T04:10:44.702 INFO:teuthology.orchestra.run.smithi177.stdout: libcephfs2-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T04:10:44.702 INFO:teuthology.orchestra.run.smithi177.stdout: libcephsqlite-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T04:10:44.702 INFO:teuthology.orchestra.run.smithi177.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-08-31T04:10:44.702 INFO:teuthology.orchestra.run.smithi177.stdout: liboath-2.6.7-2.el9.x86_64 2024-08-31T04:10:44.702 INFO:teuthology.orchestra.run.smithi177.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-08-31T04:10:44.702 INFO:teuthology.orchestra.run.smithi177.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-08-31T04:10:44.702 INFO:teuthology.orchestra.run.smithi177.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-08-31T04:10:44.702 INFO:teuthology.orchestra.run.smithi177.stdout: librados-devel-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T04:10:44.702 INFO:teuthology.orchestra.run.smithi177.stdout: libradosstriper1-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T04:10:44.702 INFO:teuthology.orchestra.run.smithi177.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-08-31T04:10:44.702 INFO:teuthology.orchestra.run.smithi177.stdout: librgw2-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T04:10:44.702 INFO:teuthology.orchestra.run.smithi177.stdout: libtool-2.4.6-46.el9.x86_64 2024-08-31T04:10:44.702 INFO:teuthology.orchestra.run.smithi177.stdout: libunwind-1.6.2-1.el9.x86_64 2024-08-31T04:10:44.703 INFO:teuthology.orchestra.run.smithi177.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-08-31T04:10:44.703 INFO:teuthology.orchestra.run.smithi177.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-08-31T04:10:44.703 INFO:teuthology.orchestra.run.smithi177.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-08-31T04:10:44.703 INFO:teuthology.orchestra.run.smithi177.stdout: lua-5.4.4-4.el9.x86_64 2024-08-31T04:10:44.703 INFO:teuthology.orchestra.run.smithi177.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-08-31T04:10:44.703 INFO:teuthology.orchestra.run.smithi177.stdout: luarocks-3.9.2-5.el9.noarch 2024-08-31T04:10:44.703 INFO:teuthology.orchestra.run.smithi177.stdout: openblas-0.3.26-2.el9.x86_64 2024-08-31T04:10:44.703 INFO:teuthology.orchestra.run.smithi177.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-08-31T04:10:44.703 INFO:teuthology.orchestra.run.smithi177.stdout: openssl-devel-1:3.2.2-4.el9.x86_64 2024-08-31T04:10:44.703 INFO:teuthology.orchestra.run.smithi177.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-08-31T04:10:44.703 INFO:teuthology.orchestra.run.smithi177.stdout: postgresql-13.16-1.el9.x86_64 2024-08-31T04:10:44.703 INFO:teuthology.orchestra.run.smithi177.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-08-31T04:10:44.703 INFO:teuthology.orchestra.run.smithi177.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-08-31T04:10:44.703 INFO:teuthology.orchestra.run.smithi177.stdout: postgresql-server-13.16-1.el9.x86_64 2024-08-31T04:10:44.704 INFO:teuthology.orchestra.run.smithi177.stdout: protobuf-3.14.0-13.el9.x86_64 2024-08-31T04:10:44.704 INFO:teuthology.orchestra.run.smithi177.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-08-31T04:10:44.704 INFO:teuthology.orchestra.run.smithi177.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-08-31T04:10:44.704 INFO:teuthology.orchestra.run.smithi177.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-08-31T04:10:44.704 INFO:teuthology.orchestra.run.smithi177.stdout: python3-babel-2.9.1-2.el9.noarch 2024-08-31T04:10:44.704 INFO:teuthology.orchestra.run.smithi177.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-08-31T04:10:44.704 INFO:teuthology.orchestra.run.smithi177.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-08-31T04:10:44.704 INFO:teuthology.orchestra.run.smithi177.stdout: python3-ceph-argparse-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T04:10:44.704 INFO:teuthology.orchestra.run.smithi177.stdout: python3-ceph-common-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T04:10:44.704 INFO:teuthology.orchestra.run.smithi177.stdout: python3-cephfs-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T04:10:44.704 INFO:teuthology.orchestra.run.smithi177.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-08-31T04:10:44.704 INFO:teuthology.orchestra.run.smithi177.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-08-31T04:10:44.704 INFO:teuthology.orchestra.run.smithi177.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-08-31T04:10:44.705 INFO:teuthology.orchestra.run.smithi177.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-08-31T04:10:44.705 INFO:teuthology.orchestra.run.smithi177.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-08-31T04:10:44.705 INFO:teuthology.orchestra.run.smithi177.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-08-31T04:10:44.705 INFO:teuthology.orchestra.run.smithi177.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-08-31T04:10:44.705 INFO:teuthology.orchestra.run.smithi177.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-08-31T04:10:44.705 INFO:teuthology.orchestra.run.smithi177.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-08-31T04:10:44.705 INFO:teuthology.orchestra.run.smithi177.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-08-31T04:10:44.705 INFO:teuthology.orchestra.run.smithi177.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-08-31T04:10:44.705 INFO:teuthology.orchestra.run.smithi177.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-08-31T04:10:44.705 INFO:teuthology.orchestra.run.smithi177.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-08-31T04:10:44.705 INFO:teuthology.orchestra.run.smithi177.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-08-31T04:10:44.705 INFO:teuthology.orchestra.run.smithi177.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-08-31T04:10:44.705 INFO:teuthology.orchestra.run.smithi177.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-08-31T04:10:44.705 INFO:teuthology.orchestra.run.smithi177.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-08-31T04:10:44.706 INFO:teuthology.orchestra.run.smithi177.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-08-31T04:10:44.706 INFO:teuthology.orchestra.run.smithi177.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-08-31T04:10:44.706 INFO:teuthology.orchestra.run.smithi177.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-08-31T04:10:44.706 INFO:teuthology.orchestra.run.smithi177.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-08-31T04:10:44.706 INFO:teuthology.orchestra.run.smithi177.stdout: python3-mako-1.1.4-6.el9.noarch 2024-08-31T04:10:44.706 INFO:teuthology.orchestra.run.smithi177.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-08-31T04:10:44.706 INFO:teuthology.orchestra.run.smithi177.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-08-31T04:10:44.706 INFO:teuthology.orchestra.run.smithi177.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-08-31T04:10:44.706 INFO:teuthology.orchestra.run.smithi177.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-08-31T04:10:44.706 INFO:teuthology.orchestra.run.smithi177.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-08-31T04:10:44.706 INFO:teuthology.orchestra.run.smithi177.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-08-31T04:10:44.706 INFO:teuthology.orchestra.run.smithi177.stdout: python3-packaging-20.9-5.el9.noarch 2024-08-31T04:10:44.706 INFO:teuthology.orchestra.run.smithi177.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-08-31T04:10:44.707 INFO:teuthology.orchestra.run.smithi177.stdout: python3-ply-3.11-14.el9.noarch 2024-08-31T04:10:44.707 INFO:teuthology.orchestra.run.smithi177.stdout: python3-portend-3.1.0-2.el9.noarch 2024-08-31T04:10:44.707 INFO:teuthology.orchestra.run.smithi177.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-08-31T04:10:44.707 INFO:teuthology.orchestra.run.smithi177.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-08-31T04:10:44.707 INFO:teuthology.orchestra.run.smithi177.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-08-31T04:10:44.707 INFO:teuthology.orchestra.run.smithi177.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-08-31T04:10:44.707 INFO:teuthology.orchestra.run.smithi177.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-08-31T04:10:44.707 INFO:teuthology.orchestra.run.smithi177.stdout: python3-pycparser-2.20-6.el9.noarch 2024-08-31T04:10:44.707 INFO:teuthology.orchestra.run.smithi177.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-08-31T04:10:44.707 INFO:teuthology.orchestra.run.smithi177.stdout: python3-pytz-2021.1-5.el9.noarch 2024-08-31T04:10:44.707 INFO:teuthology.orchestra.run.smithi177.stdout: python3-rados-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T04:10:44.707 INFO:teuthology.orchestra.run.smithi177.stdout: python3-rbd-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T04:10:44.707 INFO:teuthology.orchestra.run.smithi177.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-08-31T04:10:44.707 INFO:teuthology.orchestra.run.smithi177.stdout: python3-requests-2.25.1-8.el9.noarch 2024-08-31T04:10:44.708 INFO:teuthology.orchestra.run.smithi177.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-08-31T04:10:44.708 INFO:teuthology.orchestra.run.smithi177.stdout: python3-rgw-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T04:10:44.708 INFO:teuthology.orchestra.run.smithi177.stdout: python3-routes-2.5.1-5.el9.noarch 2024-08-31T04:10:44.708 INFO:teuthology.orchestra.run.smithi177.stdout: python3-rsa-4.9-2.el9.noarch 2024-08-31T04:10:44.708 INFO:teuthology.orchestra.run.smithi177.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-08-31T04:10:44.708 INFO:teuthology.orchestra.run.smithi177.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-08-31T04:10:44.708 INFO:teuthology.orchestra.run.smithi177.stdout: python3-toml-0.10.2-6.el9.noarch 2024-08-31T04:10:44.708 INFO:teuthology.orchestra.run.smithi177.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-08-31T04:10:44.708 INFO:teuthology.orchestra.run.smithi177.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-08-31T04:10:44.708 INFO:teuthology.orchestra.run.smithi177.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-08-31T04:10:44.708 INFO:teuthology.orchestra.run.smithi177.stdout: python3-webob-1.8.8-2.el9.noarch 2024-08-31T04:10:44.708 INFO:teuthology.orchestra.run.smithi177.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-08-31T04:10:44.708 INFO:teuthology.orchestra.run.smithi177.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-08-31T04:10:44.708 INFO:teuthology.orchestra.run.smithi177.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-08-31T04:10:44.709 INFO:teuthology.orchestra.run.smithi177.stdout: qatlib-24.02.0-1.el9.x86_64 2024-08-31T04:10:44.709 INFO:teuthology.orchestra.run.smithi177.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-08-31T04:10:44.709 INFO:teuthology.orchestra.run.smithi177.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-08-31T04:10:44.709 INFO:teuthology.orchestra.run.smithi177.stdout: rbd-fuse-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T04:10:44.709 INFO:teuthology.orchestra.run.smithi177.stdout: rbd-mirror-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T04:10:44.709 INFO:teuthology.orchestra.run.smithi177.stdout: rbd-nbd-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T04:10:44.709 INFO:teuthology.orchestra.run.smithi177.stdout: re2-1:20211101-20.el9.x86_64 2024-08-31T04:10:44.709 INFO:teuthology.orchestra.run.smithi177.stdout: socat-1.7.4.1-6.el9.x86_64 2024-08-31T04:10:44.709 INFO:teuthology.orchestra.run.smithi177.stdout: thrift-0.15.0-2.el9.x86_64 2024-08-31T04:10:44.709 INFO:teuthology.orchestra.run.smithi177.stdout: uuid-1.6.2-55.el9.x86_64 2024-08-31T04:10:44.709 INFO:teuthology.orchestra.run.smithi177.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-08-31T04:10:44.709 INFO:teuthology.orchestra.run.smithi177.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-08-31T04:10:44.710 INFO:teuthology.orchestra.run.smithi177.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-08-31T04:10:44.710 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-08-31T04:10:44.710 INFO:teuthology.orchestra.run.smithi177.stdout:Complete! 2024-08-31T04:10:44.730 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : openssl-devel-1:3.2.2-4.el9.x86_64 147/152 2024-08-31T04:10:44.785 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 148/152 2024-08-31T04:10:44.909 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : flex-2.6.4-9.el9.x86_64 149/152 2024-08-31T04:10:44.953 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : bison-3.7.4-5.el9.x86_64 150/152 2024-08-31T04:10:44.953 INFO:teuthology.orchestra.run.smithi050.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 151/152 2024-08-31T04:10:45.068 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 151/152 2024-08-31T04:10:45.068 INFO:teuthology.orchestra.run.smithi050.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 152/152 2024-08-31T04:10:45.075 DEBUG:teuthology.parallel:result is None 2024-08-31T04:10:45.451 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 152/152 2024-08-31T04:10:45.451 INFO:teuthology.orchestra.run.smithi050.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2024-08-31T04:10:45.451 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-08-31T04:10:51.696 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-2:19.3.0-4560.gd19e6118.el9.x86_64 1/152 2024-08-31T04:10:51.696 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-base-2:19.3.0-4560.gd19e6118.el9.x86_64 2/152 2024-08-31T04:10:51.697 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-common-2:19.3.0-4560.gd19e6118.el9.x86_64 3/152 2024-08-31T04:10:51.697 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-fuse-2:19.3.0-4560.gd19e6118.el9.x86_64 4/152 2024-08-31T04:10:51.697 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-immutable-object-cache-2:19.3.0-4560.gd19e6 5/152 2024-08-31T04:10:51.697 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-mds-2:19.3.0-4560.gd19e6118.el9.x86_64 6/152 2024-08-31T04:10:51.697 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-mgr-2:19.3.0-4560.gd19e6118.el9.x86_64 7/152 2024-08-31T04:10:51.697 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-mon-2:19.3.0-4560.gd19e6118.el9.x86_64 8/152 2024-08-31T04:10:51.697 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-osd-2:19.3.0-4560.gd19e6118.el9.x86_64 9/152 2024-08-31T04:10:51.697 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-radosgw-2:19.3.0-4560.gd19e6118.el9.x86_64 10/152 2024-08-31T04:10:51.697 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-selinux-2:19.3.0-4560.gd19e6118.el9.x86_64 11/152 2024-08-31T04:10:51.697 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-test-2:19.3.0-4560.gd19e6118.el9.x86_64 12/152 2024-08-31T04:10:51.697 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : cephfs-mirror-2:19.3.0-4560.gd19e6118.el9.x86_64 13/152 2024-08-31T04:10:51.697 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : cephfs-shell-2:19.3.0-4560.gd19e6118.el9.x86_64 14/152 2024-08-31T04:10:51.698 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : libcephfs-devel-2:19.3.0-4560.gd19e6118.el9.x86_ 15/152 2024-08-31T04:10:51.698 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : libcephfs2-2:19.3.0-4560.gd19e6118.el9.x86_64 16/152 2024-08-31T04:10:51.698 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : libcephsqlite-2:19.3.0-4560.gd19e6118.el9.x86_64 17/152 2024-08-31T04:10:51.698 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : librados-devel-2:19.3.0-4560.gd19e6118.el9.x86_6 18/152 2024-08-31T04:10:51.698 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : libradosstriper1-2:19.3.0-4560.gd19e6118.el9.x86 19/152 2024-08-31T04:10:51.698 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : librgw2-2:19.3.0-4560.gd19e6118.el9.x86_64 20/152 2024-08-31T04:10:51.698 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-ceph-argparse-2:19.3.0-4560.gd19e6118.el 21/152 2024-08-31T04:10:51.698 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-ceph-common-2:19.3.0-4560.gd19e6118.el9. 22/152 2024-08-31T04:10:51.698 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-cephfs-2:19.3.0-4560.gd19e6118.el9.x86_6 23/152 2024-08-31T04:10:51.698 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-rados-2:19.3.0-4560.gd19e6118.el9.x86_64 24/152 2024-08-31T04:10:51.698 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-rbd-2:19.3.0-4560.gd19e6118.el9.x86_64 25/152 2024-08-31T04:10:51.698 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-rgw-2:19.3.0-4560.gd19e6118.el9.x86_64 26/152 2024-08-31T04:10:51.699 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : rbd-fuse-2:19.3.0-4560.gd19e6118.el9.x86_64 27/152 2024-08-31T04:10:51.709 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : rbd-mirror-2:19.3.0-4560.gd19e6118.el9.x86_64 28/152 2024-08-31T04:10:51.709 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : rbd-nbd-2:19.3.0-4560.gd19e6118.el9.x86_64 29/152 2024-08-31T04:10:51.709 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-grafana-dashboards-2:19.3.0-4560.gd19e6118. 30/152 2024-08-31T04:10:51.709 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-mgr-cephadm-2:19.3.0-4560.gd19e6118.el9.noa 31/152 2024-08-31T04:10:51.709 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-mgr-dashboard-2:19.3.0-4560.gd19e6118.el9.n 32/152 2024-08-31T04:10:51.710 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.3.0-4560.gd19 33/152 2024-08-31T04:10:51.710 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-mgr-modules-core-2:19.3.0-4560.gd19e6118.el 34/152 2024-08-31T04:10:51.710 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-mgr-rook-2:19.3.0-4560.gd19e6118.el9.noarch 35/152 2024-08-31T04:10:51.710 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-prometheus-alerts-2:19.3.0-4560.gd19e6118.e 36/152 2024-08-31T04:10:51.710 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-volume-2:19.3.0-4560.gd19e6118.el9.noarch 37/152 2024-08-31T04:10:51.710 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : cephadm-2:19.3.0-4560.gd19e6118.el9.noarch 38/152 2024-08-31T04:10:51.710 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : cephfs-top-2:19.3.0-4560.gd19e6118.el9.noarch 39/152 2024-08-31T04:10:51.710 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/152 2024-08-31T04:10:51.710 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/152 2024-08-31T04:10:51.710 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/152 2024-08-31T04:10:51.710 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/152 2024-08-31T04:10:51.710 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/152 2024-08-31T04:10:51.710 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/152 2024-08-31T04:10:51.711 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/152 2024-08-31T04:10:51.711 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/152 2024-08-31T04:10:51.711 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/152 2024-08-31T04:10:51.711 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/152 2024-08-31T04:10:51.711 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/152 2024-08-31T04:10:51.711 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/152 2024-08-31T04:10:51.711 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/152 2024-08-31T04:10:51.711 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/152 2024-08-31T04:10:51.711 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/152 2024-08-31T04:10:51.711 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/152 2024-08-31T04:10:51.711 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/152 2024-08-31T04:10:51.711 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/152 2024-08-31T04:10:51.711 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/152 2024-08-31T04:10:51.712 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/152 2024-08-31T04:10:51.712 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/152 2024-08-31T04:10:51.712 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 61/152 2024-08-31T04:10:51.712 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 62/152 2024-08-31T04:10:51.712 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/152 2024-08-31T04:10:51.712 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/152 2024-08-31T04:10:51.712 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/152 2024-08-31T04:10:51.712 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 66/152 2024-08-31T04:10:51.712 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 67/152 2024-08-31T04:10:51.712 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : openssl-devel-1:3.2.2-4.el9.x86_64 68/152 2024-08-31T04:10:51.712 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : postgresql-13.16-1.el9.x86_64 69/152 2024-08-31T04:10:51.713 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 70/152 2024-08-31T04:10:51.713 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 71/152 2024-08-31T04:10:51.713 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 72/152 2024-08-31T04:10:51.713 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/152 2024-08-31T04:10:51.713 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/152 2024-08-31T04:10:51.713 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/152 2024-08-31T04:10:51.713 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/152 2024-08-31T04:10:51.713 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 77/152 2024-08-31T04:10:51.713 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/152 2024-08-31T04:10:51.713 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/152 2024-08-31T04:10:51.713 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/152 2024-08-31T04:10:51.713 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/152 2024-08-31T04:10:51.713 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/152 2024-08-31T04:10:51.714 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/152 2024-08-31T04:10:51.714 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/152 2024-08-31T04:10:51.714 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/152 2024-08-31T04:10:51.714 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/152 2024-08-31T04:10:51.714 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/152 2024-08-31T04:10:51.714 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/152 2024-08-31T04:10:51.714 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/152 2024-08-31T04:10:51.714 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/152 2024-08-31T04:10:51.714 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/152 2024-08-31T04:10:51.714 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/152 2024-08-31T04:10:51.714 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/152 2024-08-31T04:10:51.714 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/152 2024-08-31T04:10:51.714 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/152 2024-08-31T04:10:51.714 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/152 2024-08-31T04:10:51.715 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/152 2024-08-31T04:10:51.715 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/152 2024-08-31T04:10:51.715 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 99/152 2024-08-31T04:10:51.715 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/152 2024-08-31T04:10:51.715 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 101/152 2024-08-31T04:10:51.715 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/152 2024-08-31T04:10:51.715 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/152 2024-08-31T04:10:51.715 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/152 2024-08-31T04:10:51.715 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/152 2024-08-31T04:10:51.715 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/152 2024-08-31T04:10:51.715 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 107/152 2024-08-31T04:10:51.715 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/152 2024-08-31T04:10:51.716 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/152 2024-08-31T04:10:51.716 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/152 2024-08-31T04:10:51.716 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/152 2024-08-31T04:10:51.716 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/152 2024-08-31T04:10:51.716 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/152 2024-08-31T04:10:51.716 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/152 2024-08-31T04:10:51.716 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/152 2024-08-31T04:10:51.716 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/152 2024-08-31T04:10:51.716 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/152 2024-08-31T04:10:51.716 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 118/152 2024-08-31T04:10:51.716 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/152 2024-08-31T04:10:51.716 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/152 2024-08-31T04:10:51.716 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/152 2024-08-31T04:10:51.716 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 122/152 2024-08-31T04:10:51.717 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/152 2024-08-31T04:10:51.717 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/152 2024-08-31T04:10:51.717 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/152 2024-08-31T04:10:51.717 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/152 2024-08-31T04:10:51.717 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/152 2024-08-31T04:10:51.717 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/152 2024-08-31T04:10:51.717 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/152 2024-08-31T04:10:51.717 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/152 2024-08-31T04:10:51.717 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/152 2024-08-31T04:10:51.717 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/152 2024-08-31T04:10:51.717 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/152 2024-08-31T04:10:51.717 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/152 2024-08-31T04:10:51.718 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/152 2024-08-31T04:10:51.718 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/152 2024-08-31T04:10:51.718 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/152 2024-08-31T04:10:51.718 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/152 2024-08-31T04:10:51.718 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/152 2024-08-31T04:10:51.718 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/152 2024-08-31T04:10:51.718 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/152 2024-08-31T04:10:51.718 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 142/152 2024-08-31T04:10:51.718 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 143/152 2024-08-31T04:10:51.718 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/152 2024-08-31T04:10:51.718 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/152 2024-08-31T04:10:51.718 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/152 2024-08-31T04:10:51.718 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : re2-1:20211101-20.el9.x86_64 147/152 2024-08-31T04:10:51.718 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/152 2024-08-31T04:10:51.719 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : librados2-2:19.3.0-4560.gd19e6118.el9.x86_64 149/152 2024-08-31T04:10:51.719 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/152 2024-08-31T04:10:51.719 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : librbd1-2:19.3.0-4560.gd19e6118.el9.x86_64 151/152 2024-08-31T04:10:54.081 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/152 2024-08-31T04:10:54.081 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-08-31T04:10:54.081 INFO:teuthology.orchestra.run.smithi050.stdout:Upgraded: 2024-08-31T04:10:54.081 INFO:teuthology.orchestra.run.smithi050.stdout: librados2-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T04:10:54.081 INFO:teuthology.orchestra.run.smithi050.stdout: librbd1-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T04:10:54.081 INFO:teuthology.orchestra.run.smithi050.stdout:Installed: 2024-08-31T04:10:54.082 INFO:teuthology.orchestra.run.smithi050.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-08-31T04:10:54.082 INFO:teuthology.orchestra.run.smithi050.stdout: automake-1.16.2-8.el9.noarch 2024-08-31T04:10:54.082 INFO:teuthology.orchestra.run.smithi050.stdout: bison-3.7.4-5.el9.x86_64 2024-08-31T04:10:54.082 INFO:teuthology.orchestra.run.smithi050.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-08-31T04:10:54.082 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T04:10:54.082 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-base-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T04:10:54.082 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-common-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T04:10:54.082 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-fuse-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T04:10:54.082 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-grafana-dashboards-2:19.3.0-4560.gd19e6118.el9.noarch 2024-08-31T04:10:54.082 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-immutable-object-cache-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T04:10:54.082 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mds-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T04:10:54.082 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mgr-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T04:10:54.083 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mgr-cephadm-2:19.3.0-4560.gd19e6118.el9.noarch 2024-08-31T04:10:54.083 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mgr-dashboard-2:19.3.0-4560.gd19e6118.el9.noarch 2024-08-31T04:10:54.083 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mgr-diskprediction-local-2:19.3.0-4560.gd19e6118.el9.noarch 2024-08-31T04:10:54.083 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mgr-modules-core-2:19.3.0-4560.gd19e6118.el9.noarch 2024-08-31T04:10:54.083 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mgr-rook-2:19.3.0-4560.gd19e6118.el9.noarch 2024-08-31T04:10:54.083 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mon-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T04:10:54.083 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-osd-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T04:10:54.083 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-prometheus-alerts-2:19.3.0-4560.gd19e6118.el9.noarch 2024-08-31T04:10:54.083 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-radosgw-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T04:10:54.083 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-selinux-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T04:10:54.083 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-test-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T04:10:54.083 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-volume-2:19.3.0-4560.gd19e6118.el9.noarch 2024-08-31T04:10:54.083 INFO:teuthology.orchestra.run.smithi050.stdout: cephadm-2:19.3.0-4560.gd19e6118.el9.noarch 2024-08-31T04:10:54.083 INFO:teuthology.orchestra.run.smithi050.stdout: cephfs-mirror-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T04:10:54.084 INFO:teuthology.orchestra.run.smithi050.stdout: cephfs-shell-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T04:10:54.084 INFO:teuthology.orchestra.run.smithi050.stdout: cephfs-top-2:19.3.0-4560.gd19e6118.el9.noarch 2024-08-31T04:10:54.084 INFO:teuthology.orchestra.run.smithi050.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-08-31T04:10:54.084 INFO:teuthology.orchestra.run.smithi050.stdout: flex-2.6.4-9.el9.x86_64 2024-08-31T04:10:54.084 INFO:teuthology.orchestra.run.smithi050.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-08-31T04:10:54.084 INFO:teuthology.orchestra.run.smithi050.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-08-31T04:10:54.084 INFO:teuthology.orchestra.run.smithi050.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-08-31T04:10:54.084 INFO:teuthology.orchestra.run.smithi050.stdout: fuse-2.9.9-16.el9.x86_64 2024-08-31T04:10:54.084 INFO:teuthology.orchestra.run.smithi050.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-08-31T04:10:54.084 INFO:teuthology.orchestra.run.smithi050.stdout: grpc-data-1.46.7-10.el9.noarch 2024-08-31T04:10:54.084 INFO:teuthology.orchestra.run.smithi050.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-08-31T04:10:54.084 INFO:teuthology.orchestra.run.smithi050.stdout: libarrow-9.0.0-11.el9.x86_64 2024-08-31T04:10:54.084 INFO:teuthology.orchestra.run.smithi050.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-08-31T04:10:54.085 INFO:teuthology.orchestra.run.smithi050.stdout: libcephfs-devel-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T04:10:54.085 INFO:teuthology.orchestra.run.smithi050.stdout: libcephfs2-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T04:10:54.085 INFO:teuthology.orchestra.run.smithi050.stdout: libcephsqlite-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T04:10:54.085 INFO:teuthology.orchestra.run.smithi050.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-08-31T04:10:54.085 INFO:teuthology.orchestra.run.smithi050.stdout: liboath-2.6.7-2.el9.x86_64 2024-08-31T04:10:54.085 INFO:teuthology.orchestra.run.smithi050.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-08-31T04:10:54.085 INFO:teuthology.orchestra.run.smithi050.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-08-31T04:10:54.085 INFO:teuthology.orchestra.run.smithi050.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-08-31T04:10:54.085 INFO:teuthology.orchestra.run.smithi050.stdout: librados-devel-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T04:10:54.085 INFO:teuthology.orchestra.run.smithi050.stdout: libradosstriper1-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T04:10:54.086 INFO:teuthology.orchestra.run.smithi050.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-08-31T04:10:54.086 INFO:teuthology.orchestra.run.smithi050.stdout: librgw2-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T04:10:54.086 INFO:teuthology.orchestra.run.smithi050.stdout: libtool-2.4.6-46.el9.x86_64 2024-08-31T04:10:54.086 INFO:teuthology.orchestra.run.smithi050.stdout: libunwind-1.6.2-1.el9.x86_64 2024-08-31T04:10:54.086 INFO:teuthology.orchestra.run.smithi050.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-08-31T04:10:54.086 INFO:teuthology.orchestra.run.smithi050.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-08-31T04:10:54.086 INFO:teuthology.orchestra.run.smithi050.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-08-31T04:10:54.086 INFO:teuthology.orchestra.run.smithi050.stdout: lua-5.4.4-4.el9.x86_64 2024-08-31T04:10:54.086 INFO:teuthology.orchestra.run.smithi050.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-08-31T04:10:54.086 INFO:teuthology.orchestra.run.smithi050.stdout: luarocks-3.9.2-5.el9.noarch 2024-08-31T04:10:54.086 INFO:teuthology.orchestra.run.smithi050.stdout: openblas-0.3.26-2.el9.x86_64 2024-08-31T04:10:54.086 INFO:teuthology.orchestra.run.smithi050.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-08-31T04:10:54.087 INFO:teuthology.orchestra.run.smithi050.stdout: openssl-devel-1:3.2.2-4.el9.x86_64 2024-08-31T04:10:54.087 INFO:teuthology.orchestra.run.smithi050.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-08-31T04:10:54.087 INFO:teuthology.orchestra.run.smithi050.stdout: postgresql-13.16-1.el9.x86_64 2024-08-31T04:10:54.087 INFO:teuthology.orchestra.run.smithi050.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-08-31T04:10:54.087 INFO:teuthology.orchestra.run.smithi050.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-08-31T04:10:54.087 INFO:teuthology.orchestra.run.smithi050.stdout: postgresql-server-13.16-1.el9.x86_64 2024-08-31T04:10:54.087 INFO:teuthology.orchestra.run.smithi050.stdout: protobuf-3.14.0-13.el9.x86_64 2024-08-31T04:10:54.087 INFO:teuthology.orchestra.run.smithi050.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-08-31T04:10:54.087 INFO:teuthology.orchestra.run.smithi050.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-08-31T04:10:54.087 INFO:teuthology.orchestra.run.smithi050.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-08-31T04:10:54.087 INFO:teuthology.orchestra.run.smithi050.stdout: python3-babel-2.9.1-2.el9.noarch 2024-08-31T04:10:54.087 INFO:teuthology.orchestra.run.smithi050.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-08-31T04:10:54.088 INFO:teuthology.orchestra.run.smithi050.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-08-31T04:10:54.088 INFO:teuthology.orchestra.run.smithi050.stdout: python3-ceph-argparse-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T04:10:54.088 INFO:teuthology.orchestra.run.smithi050.stdout: python3-ceph-common-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T04:10:54.088 INFO:teuthology.orchestra.run.smithi050.stdout: python3-cephfs-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T04:10:54.088 INFO:teuthology.orchestra.run.smithi050.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-08-31T04:10:54.088 INFO:teuthology.orchestra.run.smithi050.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-08-31T04:10:54.088 INFO:teuthology.orchestra.run.smithi050.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-08-31T04:10:54.088 INFO:teuthology.orchestra.run.smithi050.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-08-31T04:10:54.088 INFO:teuthology.orchestra.run.smithi050.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-08-31T04:10:54.088 INFO:teuthology.orchestra.run.smithi050.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-08-31T04:10:54.088 INFO:teuthology.orchestra.run.smithi050.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-08-31T04:10:54.088 INFO:teuthology.orchestra.run.smithi050.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-08-31T04:10:54.089 INFO:teuthology.orchestra.run.smithi050.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-08-31T04:10:54.089 INFO:teuthology.orchestra.run.smithi050.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-08-31T04:10:54.089 INFO:teuthology.orchestra.run.smithi050.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-08-31T04:10:54.089 INFO:teuthology.orchestra.run.smithi050.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-08-31T04:10:54.089 INFO:teuthology.orchestra.run.smithi050.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-08-31T04:10:54.089 INFO:teuthology.orchestra.run.smithi050.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-08-31T04:10:54.089 INFO:teuthology.orchestra.run.smithi050.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-08-31T04:10:54.089 INFO:teuthology.orchestra.run.smithi050.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-08-31T04:10:54.089 INFO:teuthology.orchestra.run.smithi050.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-08-31T04:10:54.089 INFO:teuthology.orchestra.run.smithi050.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-08-31T04:10:54.089 INFO:teuthology.orchestra.run.smithi050.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-08-31T04:10:54.089 INFO:teuthology.orchestra.run.smithi050.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-08-31T04:10:54.089 INFO:teuthology.orchestra.run.smithi050.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-08-31T04:10:54.089 INFO:teuthology.orchestra.run.smithi050.stdout: python3-mako-1.1.4-6.el9.noarch 2024-08-31T04:10:54.090 INFO:teuthology.orchestra.run.smithi050.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-08-31T04:10:54.090 INFO:teuthology.orchestra.run.smithi050.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-08-31T04:10:54.090 INFO:teuthology.orchestra.run.smithi050.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-08-31T04:10:54.090 INFO:teuthology.orchestra.run.smithi050.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-08-31T04:10:54.090 INFO:teuthology.orchestra.run.smithi050.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-08-31T04:10:54.090 INFO:teuthology.orchestra.run.smithi050.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-08-31T04:10:54.090 INFO:teuthology.orchestra.run.smithi050.stdout: python3-packaging-20.9-5.el9.noarch 2024-08-31T04:10:54.090 INFO:teuthology.orchestra.run.smithi050.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-08-31T04:10:54.090 INFO:teuthology.orchestra.run.smithi050.stdout: python3-ply-3.11-14.el9.noarch 2024-08-31T04:10:54.090 INFO:teuthology.orchestra.run.smithi050.stdout: python3-portend-3.1.0-2.el9.noarch 2024-08-31T04:10:54.090 INFO:teuthology.orchestra.run.smithi050.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-08-31T04:10:54.091 INFO:teuthology.orchestra.run.smithi050.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-08-31T04:10:54.091 INFO:teuthology.orchestra.run.smithi050.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-08-31T04:10:54.091 INFO:teuthology.orchestra.run.smithi050.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-08-31T04:10:54.091 INFO:teuthology.orchestra.run.smithi050.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-08-31T04:10:54.091 INFO:teuthology.orchestra.run.smithi050.stdout: python3-pycparser-2.20-6.el9.noarch 2024-08-31T04:10:54.091 INFO:teuthology.orchestra.run.smithi050.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-08-31T04:10:54.091 INFO:teuthology.orchestra.run.smithi050.stdout: python3-pytz-2021.1-5.el9.noarch 2024-08-31T04:10:54.091 INFO:teuthology.orchestra.run.smithi050.stdout: python3-rados-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T04:10:54.091 INFO:teuthology.orchestra.run.smithi050.stdout: python3-rbd-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T04:10:54.091 INFO:teuthology.orchestra.run.smithi050.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-08-31T04:10:54.091 INFO:teuthology.orchestra.run.smithi050.stdout: python3-requests-2.25.1-8.el9.noarch 2024-08-31T04:10:54.091 INFO:teuthology.orchestra.run.smithi050.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-08-31T04:10:54.091 INFO:teuthology.orchestra.run.smithi050.stdout: python3-rgw-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T04:10:54.091 INFO:teuthology.orchestra.run.smithi050.stdout: python3-routes-2.5.1-5.el9.noarch 2024-08-31T04:10:54.091 INFO:teuthology.orchestra.run.smithi050.stdout: python3-rsa-4.9-2.el9.noarch 2024-08-31T04:10:54.092 INFO:teuthology.orchestra.run.smithi050.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-08-31T04:10:54.092 INFO:teuthology.orchestra.run.smithi050.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-08-31T04:10:54.092 INFO:teuthology.orchestra.run.smithi050.stdout: python3-toml-0.10.2-6.el9.noarch 2024-08-31T04:10:54.092 INFO:teuthology.orchestra.run.smithi050.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-08-31T04:10:54.092 INFO:teuthology.orchestra.run.smithi050.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-08-31T04:10:54.092 INFO:teuthology.orchestra.run.smithi050.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-08-31T04:10:54.092 INFO:teuthology.orchestra.run.smithi050.stdout: python3-webob-1.8.8-2.el9.noarch 2024-08-31T04:10:54.092 INFO:teuthology.orchestra.run.smithi050.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-08-31T04:10:54.092 INFO:teuthology.orchestra.run.smithi050.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-08-31T04:10:54.092 INFO:teuthology.orchestra.run.smithi050.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-08-31T04:10:54.092 INFO:teuthology.orchestra.run.smithi050.stdout: qatlib-24.02.0-1.el9.x86_64 2024-08-31T04:10:54.092 INFO:teuthology.orchestra.run.smithi050.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-08-31T04:10:54.093 INFO:teuthology.orchestra.run.smithi050.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-08-31T04:10:54.093 INFO:teuthology.orchestra.run.smithi050.stdout: rbd-fuse-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T04:10:54.093 INFO:teuthology.orchestra.run.smithi050.stdout: rbd-mirror-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T04:10:54.093 INFO:teuthology.orchestra.run.smithi050.stdout: rbd-nbd-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T04:10:54.093 INFO:teuthology.orchestra.run.smithi050.stdout: re2-1:20211101-20.el9.x86_64 2024-08-31T04:10:54.093 INFO:teuthology.orchestra.run.smithi050.stdout: socat-1.7.4.1-6.el9.x86_64 2024-08-31T04:10:54.093 INFO:teuthology.orchestra.run.smithi050.stdout: thrift-0.15.0-2.el9.x86_64 2024-08-31T04:10:54.093 INFO:teuthology.orchestra.run.smithi050.stdout: uuid-1.6.2-55.el9.x86_64 2024-08-31T04:10:54.093 INFO:teuthology.orchestra.run.smithi050.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-08-31T04:10:54.093 INFO:teuthology.orchestra.run.smithi050.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-08-31T04:10:54.093 INFO:teuthology.orchestra.run.smithi050.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-08-31T04:10:54.094 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-08-31T04:10:54.094 INFO:teuthology.orchestra.run.smithi050.stdout:Complete! 2024-08-31T04:10:54.681 DEBUG:teuthology.parallel:result is None 2024-08-31T04:10:54.682 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=d19e6118f7015f0047264006cb0c873528eb3ae6 2024-08-31T04:10:54.840 DEBUG:teuthology.orchestra.run.smithi050:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-08-31T04:10:54.884 INFO:teuthology.orchestra.run.smithi050.stdout:19.3.0-4560.gd19e6118.el9 2024-08-31T04:10:54.885 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-4560.gd19e6118.el9 2024-08-31T04:10:54.885 INFO:teuthology.task.install:The correct ceph version 19.3.0-4560.gd19e6118 is installed. 2024-08-31T04:10:54.887 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=d19e6118f7015f0047264006cb0c873528eb3ae6 2024-08-31T04:10:55.034 DEBUG:teuthology.orchestra.run.smithi133:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-08-31T04:10:55.061 INFO:teuthology.orchestra.run.smithi133.stdout:19.3.0-4560.gd19e6118.el9 2024-08-31T04:10:55.061 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-4560.gd19e6118.el9 2024-08-31T04:10:55.062 INFO:teuthology.task.install:The correct ceph version 19.3.0-4560.gd19e6118 is installed. 2024-08-31T04:10:55.064 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=d19e6118f7015f0047264006cb0c873528eb3ae6 2024-08-31T04:10:55.205 DEBUG:teuthology.orchestra.run.smithi177:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-08-31T04:10:55.232 INFO:teuthology.orchestra.run.smithi177.stdout:19.3.0-4560.gd19e6118.el9 2024-08-31T04:10:55.233 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-4560.gd19e6118.el9 2024-08-31T04:10:55.233 INFO:teuthology.task.install:The correct ceph version 19.3.0-4560.gd19e6118 is installed. 2024-08-31T04:10:55.235 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-08-31T04:10:55.235 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-08-31T04:10:55.235 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-08-31T04:10:55.295 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2024-08-31T04:10:55.295 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-08-31T04:10:55.327 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2024-08-31T04:10:55.327 DEBUG:teuthology.orchestra.run.smithi177:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-08-31T04:10:55.360 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-08-31T04:10:55.360 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-08-31T04:10:55.360 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd of=/usr/bin/daemon-helper 2024-08-31T04:10:55.417 DEBUG:teuthology.orchestra.run.smithi050:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-08-31T04:10:55.518 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2024-08-31T04:10:55.518 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd of=/usr/bin/daemon-helper 2024-08-31T04:10:55.548 DEBUG:teuthology.orchestra.run.smithi133:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-08-31T04:10:55.616 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2024-08-31T04:10:55.617 DEBUG:teuthology.orchestra.run.smithi177:> sudo dd of=/usr/bin/daemon-helper 2024-08-31T04:10:55.647 DEBUG:teuthology.orchestra.run.smithi177:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-08-31T04:10:55.716 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-08-31T04:10:55.716 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-08-31T04:10:55.716 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd of=/usr/bin/adjust-ulimits 2024-08-31T04:10:55.773 DEBUG:teuthology.orchestra.run.smithi050:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-08-31T04:10:55.872 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2024-08-31T04:10:55.872 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd of=/usr/bin/adjust-ulimits 2024-08-31T04:10:55.897 DEBUG:teuthology.orchestra.run.smithi133:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-08-31T04:10:55.962 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2024-08-31T04:10:55.963 DEBUG:teuthology.orchestra.run.smithi177:> sudo dd of=/usr/bin/adjust-ulimits 2024-08-31T04:10:55.992 DEBUG:teuthology.orchestra.run.smithi177:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-08-31T04:10:56.061 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-08-31T04:10:56.061 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-08-31T04:10:56.061 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd of=/usr/bin/stdin-killer 2024-08-31T04:10:56.118 DEBUG:teuthology.orchestra.run.smithi050:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-08-31T04:10:56.216 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2024-08-31T04:10:56.217 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd of=/usr/bin/stdin-killer 2024-08-31T04:10:56.242 DEBUG:teuthology.orchestra.run.smithi133:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-08-31T04:10:56.306 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2024-08-31T04:10:56.306 DEBUG:teuthology.orchestra.run.smithi177:> sudo dd of=/usr/bin/stdin-killer 2024-08-31T04:10:56.336 DEBUG:teuthology.orchestra.run.smithi177:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-08-31T04:10:56.406 INFO:teuthology.run_tasks:Running task cephadm... 2024-08-31T04:10:56.501 INFO:tasks.cephadm:Config: {'roleless': False, 'cephfs': {'max_mds': 5, 'session_timeout': 300, 'standby_replay': True}, 'cluster-conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 2, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon': {'mon op complaint time': 120, 'mon warn on pool no app': False}, 'osd': {'osd op complaint time': 180}}, 'conf': {'global': {'ms die on skipped message': False}, 'mds': {'mds_bal_replicate_threshold': 1}, 'mgr': {'cephsqlite lock renewal timeout': 900000, 'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True, 'osd_max_omap_entries_per_request': 10}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'fs.*is degraded', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'insufficient standby MDS daemons available', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy'], 'sha1': 'd19e6118f7015f0047264006cb0c873528eb3ae6', 'subvols': {'create': 2, 'subvol_options': '--namespace-isolated'}} 2024-08-31T04:10:56.501 INFO:tasks.cephadm:Cluster image is quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 2024-08-31T04:10:56.502 INFO:tasks.cephadm:Cluster fsid is 058d9fc6-674f-11ef-bcd4-c7b262605968 2024-08-31T04:10:56.502 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2024-08-31T04:10:56.502 INFO:tasks.cephadm:Monitor IPs: {'mon.a': '172.21.15.50', 'mon.b': '172.21.15.133', 'mon.c': '172.21.15.177'} 2024-08-31T04:10:56.502 INFO:tasks.cephadm:First mon is mon.a on smithi050 2024-08-31T04:10:56.502 INFO:tasks.cephadm:First mgr is x 2024-08-31T04:10:56.502 INFO:tasks.cephadm:Normalizing hostnames... 2024-08-31T04:10:56.502 DEBUG:teuthology.orchestra.run.smithi050:> sudo hostname $(hostname -s) 2024-08-31T04:10:56.561 DEBUG:teuthology.orchestra.run.smithi133:> sudo hostname $(hostname -s) 2024-08-31T04:10:56.586 DEBUG:teuthology.orchestra.run.smithi177:> sudo hostname $(hostname -s) 2024-08-31T04:10:56.615 INFO:tasks.cephadm:Downloading "compiled" cephadm from cachra 2024-08-31T04:10:56.616 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=d19e6118f7015f0047264006cb0c873528eb3ae6 2024-08-31T04:10:56.760 INFO:tasks.cephadm:builder_project result: [{'status': 'ready', 'sha1': 'd19e6118f7015f0047264006cb0c873528eb3ae6', 'extra': {'build_url': 'https://jenkins.ceph.com/job/ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic/82586/', 'root_build_cause': 'SCMTRIGGER', 'version': '19.3.0-4560-gd19e6118', 'node_name': '172.21.5.31+adami01', 'job_name': 'ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic', 'package_manager_version': '19.3.0-4560.gd19e6118'}, 'url': 'https://4.chacra.ceph.com/r/ceph/wip-mchangir-testing-20240828.085847-main-debug/d19e6118f7015f0047264006cb0c873528eb3ae6/centos/9/flavors/default/', 'distro_codename': None, 'modified': '2024-08-28 11:15:32.801765', 'distro_version': '9', 'project': 'ceph', 'flavor': 'default', 'ref': 'wip-mchangir-testing-20240828.085847-main-debug', 'chacra_url': 'https://4.chacra.ceph.com/repos/ceph/wip-mchangir-testing-20240828.085847-main-debug/d19e6118f7015f0047264006cb0c873528eb3ae6/centos/9/flavors/default/', 'archs': ['x86_64', 'source'], 'distro': 'centos'}] 2024-08-31T04:10:56.901 INFO:tasks.util.chacra:got chacra host 4.chacra.ceph.com, ref wip-mchangir-testing-20240828.085847-main-debug, sha1 d19e6118f7015f0047264006cb0c873528eb3ae6 from https://shaman.ceph.com/api/search/?project=ceph&distros=centos%2F9%2Fx86_64&flavor=default&sha1=d19e6118f7015f0047264006cb0c873528eb3ae6 2024-08-31T04:10:56.903 INFO:tasks.cephadm:Discovered cachra url: https://4.chacra.ceph.com/binaries/ceph/wip-mchangir-testing-20240828.085847-main-debug/d19e6118f7015f0047264006cb0c873528eb3ae6/centos/9/x86_64/flavors/default/cephadm 2024-08-31T04:10:56.903 INFO:tasks.cephadm:Downloading cephadm from url: https://4.chacra.ceph.com/binaries/ceph/wip-mchangir-testing-20240828.085847-main-debug/d19e6118f7015f0047264006cb0c873528eb3ae6/centos/9/x86_64/flavors/default/cephadm 2024-08-31T04:10:56.903 DEBUG:teuthology.orchestra.run.smithi050:> curl --silent -L https://4.chacra.ceph.com/binaries/ceph/wip-mchangir-testing-20240828.085847-main-debug/d19e6118f7015f0047264006cb0c873528eb3ae6/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-08-31T04:10:57.573 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r--. 1 ubuntu ubuntu 801010 Aug 31 04:10 /home/ubuntu/cephtest/cephadm 2024-08-31T04:10:57.574 DEBUG:teuthology.orchestra.run.smithi133:> curl --silent -L https://4.chacra.ceph.com/binaries/ceph/wip-mchangir-testing-20240828.085847-main-debug/d19e6118f7015f0047264006cb0c873528eb3ae6/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-08-31T04:10:58.127 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r--. 1 ubuntu ubuntu 801010 Aug 31 04:10 /home/ubuntu/cephtest/cephadm 2024-08-31T04:10:58.127 DEBUG:teuthology.orchestra.run.smithi177:> curl --silent -L https://4.chacra.ceph.com/binaries/ceph/wip-mchangir-testing-20240828.085847-main-debug/d19e6118f7015f0047264006cb0c873528eb3ae6/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-08-31T04:10:58.684 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r--. 1 ubuntu ubuntu 801010 Aug 31 04:10 /home/ubuntu/cephtest/cephadm 2024-08-31T04:10:58.685 DEBUG:teuthology.orchestra.run.smithi050:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-08-31T04:10:58.722 DEBUG:teuthology.orchestra.run.smithi133:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-08-31T04:10:58.742 DEBUG:teuthology.orchestra.run.smithi177:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-08-31T04:10:58.776 INFO:tasks.cephadm:Pulling image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 on all hosts... 2024-08-31T04:10:58.777 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 pull 2024-08-31T04:10:58.780 DEBUG:teuthology.orchestra.run.smithi133:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 pull 2024-08-31T04:10:58.784 DEBUG:teuthology.orchestra.run.smithi177:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 pull 2024-08-31T04:11:00.257 INFO:teuthology.orchestra.run.smithi133.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6... 2024-08-31T04:11:00.396 INFO:teuthology.orchestra.run.smithi177.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6... 2024-08-31T04:11:01.739 INFO:teuthology.orchestra.run.smithi050.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6... 2024-08-31T04:11:31.101 INFO:teuthology.orchestra.run.smithi177.stdout:{ 2024-08-31T04:11:31.101 INFO:teuthology.orchestra.run.smithi177.stdout: "ceph_version": "ceph version 19.3.0-4560-gd19e6118 (d19e6118f7015f0047264006cb0c873528eb3ae6) squid (dev)", 2024-08-31T04:11:31.101 INFO:teuthology.orchestra.run.smithi177.stdout: "image_id": "79f4cde5e36911a5dca995eeb98098c2c8aae81dd52a088ef2c867bc3363bad0", 2024-08-31T04:11:31.102 INFO:teuthology.orchestra.run.smithi177.stdout: "repo_digests": [ 2024-08-31T04:11:31.102 INFO:teuthology.orchestra.run.smithi177.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61" 2024-08-31T04:11:31.102 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-08-31T04:11:31.102 INFO:teuthology.orchestra.run.smithi177.stdout:} 2024-08-31T04:11:31.232 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2024-08-31T04:11:31.232 INFO:teuthology.orchestra.run.smithi133.stdout: "ceph_version": "ceph version 19.3.0-4560-gd19e6118 (d19e6118f7015f0047264006cb0c873528eb3ae6) squid (dev)", 2024-08-31T04:11:31.232 INFO:teuthology.orchestra.run.smithi133.stdout: "image_id": "79f4cde5e36911a5dca995eeb98098c2c8aae81dd52a088ef2c867bc3363bad0", 2024-08-31T04:11:31.232 INFO:teuthology.orchestra.run.smithi133.stdout: "repo_digests": [ 2024-08-31T04:11:31.232 INFO:teuthology.orchestra.run.smithi133.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61" 2024-08-31T04:11:31.232 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-08-31T04:11:31.232 INFO:teuthology.orchestra.run.smithi133.stdout:} 2024-08-31T04:11:37.855 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-08-31T04:11:37.855 INFO:teuthology.orchestra.run.smithi050.stdout: "ceph_version": "ceph version 19.3.0-4560-gd19e6118 (d19e6118f7015f0047264006cb0c873528eb3ae6) squid (dev)", 2024-08-31T04:11:37.855 INFO:teuthology.orchestra.run.smithi050.stdout: "image_id": "79f4cde5e36911a5dca995eeb98098c2c8aae81dd52a088ef2c867bc3363bad0", 2024-08-31T04:11:37.855 INFO:teuthology.orchestra.run.smithi050.stdout: "repo_digests": [ 2024-08-31T04:11:37.855 INFO:teuthology.orchestra.run.smithi050.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61" 2024-08-31T04:11:37.855 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-08-31T04:11:37.855 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-08-31T04:11:37.886 DEBUG:teuthology.orchestra.run.smithi050:> sudo mkdir -p /etc/ceph 2024-08-31T04:11:37.945 DEBUG:teuthology.orchestra.run.smithi133:> sudo mkdir -p /etc/ceph 2024-08-31T04:11:37.979 DEBUG:teuthology.orchestra.run.smithi177:> sudo mkdir -p /etc/ceph 2024-08-31T04:11:38.013 DEBUG:teuthology.orchestra.run.smithi050:> sudo chmod 777 /etc/ceph 2024-08-31T04:11:38.068 DEBUG:teuthology.orchestra.run.smithi133:> sudo chmod 777 /etc/ceph 2024-08-31T04:11:38.097 DEBUG:teuthology.orchestra.run.smithi177:> sudo chmod 777 /etc/ceph 2024-08-31T04:11:38.129 INFO:tasks.cephadm:Writing seed config... 2024-08-31T04:11:38.130 INFO:tasks.cephadm: override: [global] ms die on skipped message = False 2024-08-31T04:11:38.130 INFO:tasks.cephadm: override: [mds] mds_bal_replicate_threshold = 1 2024-08-31T04:11:38.130 INFO:tasks.cephadm: override: [mgr] cephsqlite lock renewal timeout = 900000 2024-08-31T04:11:38.131 INFO:tasks.cephadm: override: [mgr] debug client = 20 2024-08-31T04:11:38.131 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2024-08-31T04:11:38.131 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2024-08-31T04:11:38.131 INFO:tasks.cephadm: override: [mon] debug mon = 20 2024-08-31T04:11:38.131 INFO:tasks.cephadm: override: [mon] debug ms = 1 2024-08-31T04:11:38.131 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2024-08-31T04:11:38.131 INFO:tasks.cephadm: override: [mon] mon down mkfs grace = 300 2024-08-31T04:11:38.131 INFO:tasks.cephadm: override: [osd] bluestore block size = 96636764160 2024-08-31T04:11:38.131 INFO:tasks.cephadm: override: [osd] bluestore compression mode = aggressive 2024-08-31T04:11:38.131 INFO:tasks.cephadm: override: [osd] bluestore fsck on mount = True 2024-08-31T04:11:38.131 INFO:tasks.cephadm: override: [osd] debug bluefs = 20 2024-08-31T04:11:38.131 INFO:tasks.cephadm: override: [osd] debug bluestore = 20 2024-08-31T04:11:38.131 INFO:tasks.cephadm: override: [osd] debug ms = 1 2024-08-31T04:11:38.132 INFO:tasks.cephadm: override: [osd] debug osd = 20 2024-08-31T04:11:38.132 INFO:tasks.cephadm: override: [osd] debug rocksdb = 10 2024-08-31T04:11:38.132 INFO:tasks.cephadm: override: [osd] mon osd backfillfull_ratio = 0.85 2024-08-31T04:11:38.132 INFO:tasks.cephadm: override: [osd] mon osd full ratio = 0.9 2024-08-31T04:11:38.132 INFO:tasks.cephadm: override: [osd] mon osd nearfull ratio = 0.8 2024-08-31T04:11:38.132 INFO:tasks.cephadm: override: [osd] osd failsafe full ratio = 0.95 2024-08-31T04:11:38.132 INFO:tasks.cephadm: override: [osd] osd objectstore = bluestore 2024-08-31T04:11:38.132 INFO:tasks.cephadm: override: [osd] osd shutdown pgref assert = True 2024-08-31T04:11:38.132 INFO:tasks.cephadm: override: [osd] osd_max_omap_entries_per_request = 10 2024-08-31T04:11:38.133 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-08-31T04:11:38.133 DEBUG:teuthology.orchestra.run.smithi050:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2024-08-31T04:11:38.168 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log to file = true mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = 058d9fc6-674f-11ef-bcd4-c7b262605968 ms die on skipped message = False [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = True bdev debug aio = true osd sloppy crc = true bluestore block size = 96636764160 bluestore compression mode = aggressive bluestore fsck on mount = True debug bluefs = 20 debug bluestore = 20 debug ms = 1 debug osd = 20 debug rocksdb = 10 mon osd backfillfull_ratio = 0.85 mon osd full ratio = 0.9 mon osd nearfull ratio = 0.8 osd failsafe full ratio = 0.95 osd objectstore = bluestore osd_max_omap_entries_per_request = 10 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false cephsqlite lock renewal timeout = 900000 debug client = 20 debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 mon down mkfs grace = 300 [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true [mds] mds_bal_replicate_threshold = 1 2024-08-31T04:11:38.169 DEBUG:teuthology.orchestra.run.smithi050:mon.a> sudo journalctl -f -n 0 -u ceph-058d9fc6-674f-11ef-bcd4-c7b262605968@mon.a.service 2024-08-31T04:11:38.212 DEBUG:teuthology.orchestra.run.smithi050:mgr.x> sudo journalctl -f -n 0 -u ceph-058d9fc6-674f-11ef-bcd4-c7b262605968@mgr.x.service 2024-08-31T04:11:38.256 INFO:tasks.cephadm:Bootstrapping... 2024-08-31T04:11:38.257 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 -v bootstrap --fsid 058d9fc6-674f-11ef-bcd4-c7b262605968 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id x --orphan-initial-daemons --skip-monitoring-stack --mon-ip 172.21.15.50 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2024-08-31T04:11:38.520 INFO:teuthology.orchestra.run.smithi050.stdout:-------------------------------------------------------------------------------- 2024-08-31T04:11:38.520 INFO:teuthology.orchestra.run.smithi050.stdout:cephadm ['--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6', '-v', 'bootstrap', '--fsid', '058d9fc6-674f-11ef-bcd4-c7b262605968', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-id', 'a', '--mgr-id', 'x', '--orphan-initial-daemons', '--skip-monitoring-stack', '--mon-ip', '172.21.15.50', '--skip-admin-label'] 2024-08-31T04:11:38.521 INFO:teuthology.orchestra.run.smithi050.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2024-08-31T04:11:38.521 INFO:teuthology.orchestra.run.smithi050.stdout:Verifying podman|docker is present... 2024-08-31T04:11:38.568 INFO:teuthology.orchestra.run.smithi050.stdout:/bin/podman: stdout 5.2.2 2024-08-31T04:11:38.568 INFO:teuthology.orchestra.run.smithi050.stdout:Verifying lvm2 is present... 2024-08-31T04:11:38.568 INFO:teuthology.orchestra.run.smithi050.stdout:Verifying time synchronization is in place... 2024-08-31T04:11:38.582 INFO:teuthology.orchestra.run.smithi050.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-08-31T04:11:38.582 INFO:teuthology.orchestra.run.smithi050.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-08-31T04:11:38.594 INFO:teuthology.orchestra.run.smithi050.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-08-31T04:11:38.594 INFO:teuthology.orchestra.run.smithi050.stdout:systemctl: stdout inactive 2024-08-31T04:11:38.608 INFO:teuthology.orchestra.run.smithi050.stdout:systemctl: stdout enabled 2024-08-31T04:11:38.620 INFO:teuthology.orchestra.run.smithi050.stdout:systemctl: stdout active 2024-08-31T04:11:38.621 INFO:teuthology.orchestra.run.smithi050.stdout:Unit chronyd.service is enabled and running 2024-08-31T04:11:38.621 INFO:teuthology.orchestra.run.smithi050.stdout:Repeating the final host check... 2024-08-31T04:11:38.669 INFO:teuthology.orchestra.run.smithi050.stdout:/bin/podman: stdout 5.2.2 2024-08-31T04:11:38.669 INFO:teuthology.orchestra.run.smithi050.stdout:podman (/bin/podman) version 5.2.2 is present 2024-08-31T04:11:38.669 INFO:teuthology.orchestra.run.smithi050.stdout:systemctl is present 2024-08-31T04:11:38.669 INFO:teuthology.orchestra.run.smithi050.stdout:lvcreate is present 2024-08-31T04:11:38.682 INFO:teuthology.orchestra.run.smithi050.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-08-31T04:11:38.682 INFO:teuthology.orchestra.run.smithi050.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-08-31T04:11:38.694 INFO:teuthology.orchestra.run.smithi050.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-08-31T04:11:38.694 INFO:teuthology.orchestra.run.smithi050.stdout:systemctl: stdout inactive 2024-08-31T04:11:38.708 INFO:teuthology.orchestra.run.smithi050.stdout:systemctl: stdout enabled 2024-08-31T04:11:38.720 INFO:teuthology.orchestra.run.smithi050.stdout:systemctl: stdout active 2024-08-31T04:11:38.720 INFO:teuthology.orchestra.run.smithi050.stdout:Unit chronyd.service is enabled and running 2024-08-31T04:11:38.720 INFO:teuthology.orchestra.run.smithi050.stdout:Host looks OK 2024-08-31T04:11:38.720 INFO:teuthology.orchestra.run.smithi050.stdout:Cluster fsid: 058d9fc6-674f-11ef-bcd4-c7b262605968 2024-08-31T04:11:38.721 INFO:teuthology.orchestra.run.smithi050.stdout:Acquiring lock 140050055382064 on /run/cephadm/058d9fc6-674f-11ef-bcd4-c7b262605968.lock 2024-08-31T04:11:38.721 INFO:teuthology.orchestra.run.smithi050.stdout:Lock 140050055382064 acquired on /run/cephadm/058d9fc6-674f-11ef-bcd4-c7b262605968.lock 2024-08-31T04:11:38.721 INFO:teuthology.orchestra.run.smithi050.stdout:Verifying IP 172.21.15.50 port 3300 ... 2024-08-31T04:11:38.721 INFO:teuthology.orchestra.run.smithi050.stdout:Verifying IP 172.21.15.50 port 6789 ... 2024-08-31T04:11:38.722 INFO:teuthology.orchestra.run.smithi050.stdout:Base mon IP(s) is [172.21.15.50:3300, 172.21.15.50:6789], mon addrv is [v2:172.21.15.50:3300,v1:172.21.15.50:6789] 2024-08-31T04:11:38.728 INFO:teuthology.orchestra.run.smithi050.stdout:/sbin/ip: stdout default via 172.21.15.254 dev ens1f0 proto dhcp src 172.21.15.50 metric 100 2024-08-31T04:11:38.729 INFO:teuthology.orchestra.run.smithi050.stdout:/sbin/ip: stdout 172.21.0.0/20 dev ens1f0 proto kernel scope link src 172.21.15.50 metric 100 2024-08-31T04:11:38.735 INFO:teuthology.orchestra.run.smithi050.stdout:/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2024-08-31T04:11:38.735 INFO:teuthology.orchestra.run.smithi050.stdout:/sbin/ip: stdout fe80::/64 dev ens1f0 proto kernel metric 256 pref medium 2024-08-31T04:11:38.735 INFO:teuthology.orchestra.run.smithi050.stdout:/sbin/ip: stdout default via fe80::327c:5e00:6487:71e0 dev ens1f0 proto ra metric 1024 expires 1752sec hoplimit 64 pref medium 2024-08-31T04:11:38.740 INFO:teuthology.orchestra.run.smithi050.stdout:/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2024-08-31T04:11:38.740 INFO:teuthology.orchestra.run.smithi050.stdout:/sbin/ip: stdout inet6 ::1/128 scope host 2024-08-31T04:11:38.740 INFO:teuthology.orchestra.run.smithi050.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-08-31T04:11:38.741 INFO:teuthology.orchestra.run.smithi050.stdout:/sbin/ip: stdout 4: ens1f0: mtu 1500 state UP qlen 1000 2024-08-31T04:11:38.741 INFO:teuthology.orchestra.run.smithi050.stdout:/sbin/ip: stdout inet6 fe80::ec4:7aff:febd:1584/64 scope link 2024-08-31T04:11:38.741 INFO:teuthology.orchestra.run.smithi050.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-08-31T04:11:38.741 INFO:teuthology.orchestra.run.smithi050.stdout:Mon IP `172.21.15.50` is in CIDR network `172.21.0.0/20` 2024-08-31T04:11:38.741 INFO:teuthology.orchestra.run.smithi050.stdout:Mon IP `172.21.15.50` is in CIDR network `172.21.0.0/20` 2024-08-31T04:11:38.741 INFO:teuthology.orchestra.run.smithi050.stdout:Inferred mon public CIDR from local network configuration ['172.21.0.0/20', '172.21.0.0/20'] 2024-08-31T04:11:38.742 INFO:teuthology.orchestra.run.smithi050.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2024-08-31T04:11:38.743 INFO:teuthology.orchestra.run.smithi050.stdout:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6... 2024-08-31T04:11:39.233 INFO:teuthology.orchestra.run.smithi050.stdout:/bin/podman: stdout 79f4cde5e36911a5dca995eeb98098c2c8aae81dd52a088ef2c867bc3363bad0 2024-08-31T04:11:39.233 INFO:teuthology.orchestra.run.smithi050.stdout:/bin/podman: stderr Trying to pull quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6... 2024-08-31T04:11:39.233 INFO:teuthology.orchestra.run.smithi050.stdout:/bin/podman: stderr Getting image source signatures 2024-08-31T04:11:39.233 INFO:teuthology.orchestra.run.smithi050.stdout:/bin/podman: stderr Copying blob sha256:1c7f48e91f1eb9e77df623f13bab8a42aaf12d95954655c07fb62a1a85ca19b2 2024-08-31T04:11:39.233 INFO:teuthology.orchestra.run.smithi050.stdout:/bin/podman: stderr Copying blob sha256:e8b54c863393b7a8216a71737771b73b16a8e43ec7acf927c7faa175c255e551 2024-08-31T04:11:39.233 INFO:teuthology.orchestra.run.smithi050.stdout:/bin/podman: stderr Copying config sha256:79f4cde5e36911a5dca995eeb98098c2c8aae81dd52a088ef2c867bc3363bad0 2024-08-31T04:11:39.233 INFO:teuthology.orchestra.run.smithi050.stdout:/bin/podman: stderr Writing manifest to image destination 2024-08-31T04:11:50.046 INFO:teuthology.orchestra.run.smithi050.stdout:ceph: stdout ceph version 19.3.0-4560-gd19e6118 (d19e6118f7015f0047264006cb0c873528eb3ae6) squid (dev) 2024-08-31T04:11:50.047 INFO:teuthology.orchestra.run.smithi050.stdout:Ceph version: ceph version 19.3.0-4560-gd19e6118 (d19e6118f7015f0047264006cb0c873528eb3ae6) squid (dev) 2024-08-31T04:11:50.047 INFO:teuthology.orchestra.run.smithi050.stdout:Extracting ceph user uid/gid from container image... 2024-08-31T04:11:51.077 INFO:teuthology.orchestra.run.smithi050.stdout:stat: stdout 167 167 2024-08-31T04:11:51.078 INFO:teuthology.orchestra.run.smithi050.stdout:Creating initial keys... 2024-08-31T04:11:52.215 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph-authtool: stdout AQAHmNJm6L97KBAAXTnKdHFF6B8tccU6+eeT5w== 2024-08-31T04:11:53.716 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph-authtool: stdout AQAImNJmRliBJxAA12upHuCWszvJh4NtlxszPQ== 2024-08-31T04:11:55.100 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph-authtool: stdout AQAKmNJm2ZIhChAAxg+BvC2XIjB76uhoBYaPOw== 2024-08-31T04:11:55.101 INFO:teuthology.orchestra.run.smithi050.stdout:Creating initial monmap... 2024-08-31T04:11:56.312 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2024-08-31T04:11:56.313 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = quincy 2024-08-31T04:11:56.313 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to 058d9fc6-674f-11ef-bcd4-c7b262605968 2024-08-31T04:11:56.313 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-08-31T04:11:56.313 INFO:teuthology.orchestra.run.smithi050.stdout:monmaptool for a [v2:172.21.15.50:3300,v1:172.21.15.50:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2024-08-31T04:11:56.313 INFO:teuthology.orchestra.run.smithi050.stdout:setting min_mon_release = quincy 2024-08-31T04:11:56.313 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/monmaptool: set fsid to 058d9fc6-674f-11ef-bcd4-c7b262605968 2024-08-31T04:11:56.313 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-08-31T04:11:56.313 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-08-31T04:11:56.313 INFO:teuthology.orchestra.run.smithi050.stdout:Creating mon... 2024-08-31T04:11:57.469 INFO:teuthology.orchestra.run.smithi050.stdout:create mon.a on 2024-08-31T04:11:57.795 INFO:teuthology.orchestra.run.smithi050.stdout:systemctl: stderr Removed "/etc/systemd/system/multi-user.target.wants/ceph.target". 2024-08-31T04:11:58.018 INFO:teuthology.orchestra.run.smithi050.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2024-08-31T04:11:58.301 INFO:teuthology.orchestra.run.smithi050.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-058d9fc6-674f-11ef-bcd4-c7b262605968.target → /etc/systemd/system/ceph-058d9fc6-674f-11ef-bcd4-c7b262605968.target. 2024-08-31T04:11:58.301 INFO:teuthology.orchestra.run.smithi050.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-058d9fc6-674f-11ef-bcd4-c7b262605968.target → /etc/systemd/system/ceph-058d9fc6-674f-11ef-bcd4-c7b262605968.target. 2024-08-31T04:11:58.628 INFO:teuthology.orchestra.run.smithi050.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-058d9fc6-674f-11ef-bcd4-c7b262605968@mon.a 2024-08-31T04:11:58.628 INFO:teuthology.orchestra.run.smithi050.stdout:systemctl: stderr Failed to reset failed state of unit ceph-058d9fc6-674f-11ef-bcd4-c7b262605968@mon.a.service: Unit ceph-058d9fc6-674f-11ef-bcd4-c7b262605968@mon.a.service not loaded. 2024-08-31T04:11:58.904 INFO:teuthology.orchestra.run.smithi050.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-058d9fc6-674f-11ef-bcd4-c7b262605968.target.wants/ceph-058d9fc6-674f-11ef-bcd4-c7b262605968@mon.a.service → /etc/systemd/system/ceph-058d9fc6-674f-11ef-bcd4-c7b262605968@.service. 2024-08-31T04:11:59.526 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:11:59 smithi050 podman[16879]: 2024-08-31 04:11:59.448505778 +0000 UTC m=+0.322593341 container start ac7df908504d5c188e2d7af555b75d3eaaab84aac1d12db233b645d8b4e5a055 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6, name=ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-mon-a, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , io.buildah.version=1.37.1, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2) 2024-08-31T04:11:59.526 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:11:59 smithi050 bash[16879]: ac7df908504d5c188e2d7af555b75d3eaaab84aac1d12db233b645d8b4e5a055 2024-08-31T04:11:59.553 INFO:teuthology.orchestra.run.smithi050.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-08-31T04:11:59.553 INFO:teuthology.orchestra.run.smithi050.stdout:systemctl: stdout disabled 2024-08-31T04:11:59.567 INFO:teuthology.orchestra.run.smithi050.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-08-31T04:11:59.567 INFO:teuthology.orchestra.run.smithi050.stdout:systemctl: stdout inactive 2024-08-31T04:11:59.567 INFO:teuthology.orchestra.run.smithi050.stdout:firewalld.service is not enabled 2024-08-31T04:11:59.567 INFO:teuthology.orchestra.run.smithi050.stdout:Not possible to enable service . firewalld.service is not available 2024-08-31T04:11:59.568 INFO:teuthology.orchestra.run.smithi050.stdout:Waiting for mon to start... 2024-08-31T04:11:59.568 INFO:teuthology.orchestra.run.smithi050.stdout:Waiting for mon... 2024-08-31T04:11:59.868 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:11:59 smithi050 systemd[1]: Started Ceph mon.a for 058d9fc6-674f-11ef-bcd4-c7b262605968. 2024-08-31T04:11:59.868 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:11:59 smithi050 ceph-mon[16898]: mkfs 058d9fc6-674f-11ef-bcd4-c7b262605968 2024-08-31T04:11:59.868 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:11:59 smithi050 ceph-mon[16898]: mon.a is new leader, mons a in quorum (ranks 0) 2024-08-31T04:12:00.824 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:00 smithi050 ceph-mon[16898]: mon.a is new leader, mons a in quorum (ranks 0) 2024-08-31T04:12:00.824 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:00 smithi050 ceph-mon[16898]: monmap epoch 1 2024-08-31T04:12:00.824 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:00 smithi050 ceph-mon[16898]: fsid 058d9fc6-674f-11ef-bcd4-c7b262605968 2024-08-31T04:12:00.824 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:00 smithi050 ceph-mon[16898]: last_changed 2024-08-31T04:11:55.731580+0000 2024-08-31T04:12:00.824 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:00 smithi050 ceph-mon[16898]: created 2024-08-31T04:11:55.731580+0000 2024-08-31T04:12:00.824 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:00 smithi050 ceph-mon[16898]: min_mon_release 19 (squid) 2024-08-31T04:12:00.824 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:00 smithi050 ceph-mon[16898]: election_strategy: 1 2024-08-31T04:12:00.824 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:00 smithi050 ceph-mon[16898]: 0: [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] mon.a 2024-08-31T04:12:00.824 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:00 smithi050 ceph-mon[16898]: fsmap 2024-08-31T04:12:00.824 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:00 smithi050 ceph-mon[16898]: osdmap e1: 0 total, 0 up, 0 in 2024-08-31T04:12:00.824 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:00 smithi050 ceph-mon[16898]: mgrmap e1: no daemons active 2024-08-31T04:12:00.824 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:00 smithi050 ceph-mon[16898]: from='client.? 172.21.15.50:0/3156000242' entity='client.admin' cmd={"prefix": "status"} : dispatch 2024-08-31T04:12:00.831 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout cluster: 2024-08-31T04:12:00.831 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout id: 058d9fc6-674f-11ef-bcd4-c7b262605968 2024-08-31T04:12:00.831 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2024-08-31T04:12:00.831 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout 2024-08-31T04:12:00.831 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout services: 2024-08-31T04:12:00.831 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum a (age 0.650659s) 2024-08-31T04:12:00.831 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2024-08-31T04:12:00.831 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2024-08-31T04:12:00.831 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout 2024-08-31T04:12:00.832 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout data: 2024-08-31T04:12:00.832 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2024-08-31T04:12:00.832 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2024-08-31T04:12:00.832 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2024-08-31T04:12:00.832 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout pgs: 2024-08-31T04:12:00.832 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout 2024-08-31T04:12:00.832 INFO:teuthology.orchestra.run.smithi050.stdout:mon is available 2024-08-31T04:12:00.832 INFO:teuthology.orchestra.run.smithi050.stdout:Assimilating anything we can from ceph.conf... 2024-08-31T04:12:01.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:01 smithi050 ceph-mon[16898]: from='client.? 172.21.15.50:0/4150095725' entity='client.admin' cmd={"prefix": "config assimilate-conf"} : dispatch 2024-08-31T04:12:01.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:01 smithi050 ceph-mon[16898]: from='client.? 172.21.15.50:0/4150095725' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2024-08-31T04:12:02.020 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout 2024-08-31T04:12:02.020 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout [global] 2024-08-31T04:12:02.021 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout fsid = 058d9fc6-674f-11ef-bcd4-c7b262605968 2024-08-31T04:12:02.021 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout mon_cluster_log_file_level = debug 2024-08-31T04:12:02.021 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.50:3300,v1:172.21.15.50:6789] 2024-08-31T04:12:02.021 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-08-31T04:12:02.021 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-08-31T04:12:02.021 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-08-31T04:12:02.021 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-08-31T04:12:02.021 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout 2024-08-31T04:12:02.021 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout [mgr] 2024-08-31T04:12:02.021 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-08-31T04:12:02.021 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout 2024-08-31T04:12:02.021 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout [osd] 2024-08-31T04:12:02.022 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-08-31T04:12:02.022 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-08-31T04:12:02.022 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-08-31T04:12:02.022 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-08-31T04:12:02.022 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-08-31T04:12:02.022 INFO:teuthology.orchestra.run.smithi050.stdout:Generating new minimal ceph.conf... 2024-08-31T04:12:02.950 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:02 smithi050 ceph-mon[16898]: from='client.? 172.21.15.50:0/424850013' entity='client.admin' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:12:03.351 INFO:teuthology.orchestra.run.smithi050.stdout:Restarting the monitor... 2024-08-31T04:12:03.685 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:03 smithi050 systemd[1]: Stopping Ceph mon.a for 058d9fc6-674f-11ef-bcd4-c7b262605968... 2024-08-31T04:12:03.950 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:03 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-mon-a[16894]: 2024-08-31T04:12:03.683+0000 7f14c8e00640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-08-31T04:12:03.950 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:03 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-mon-a[16894]: 2024-08-31T04:12:03.683+0000 7f14c8e00640 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2024-08-31T04:12:03.950 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:03 smithi050 podman[17139]: 2024-08-31 04:12:03.807762538 +0000 UTC m=+0.226352378 container stop ac7df908504d5c188e2d7af555b75d3eaaab84aac1d12db233b645d8b4e5a055 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6, name=ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-mon-a, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, ceph=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, io.buildah.version=1.37.1, org.label-schema.build-date=20240731) 2024-08-31T04:12:03.950 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:03 smithi050 podman[17139]: 2024-08-31 04:12:03.84034222 +0000 UTC m=+0.258932071 container died ac7df908504d5c188e2d7af555b75d3eaaab84aac1d12db233b645d8b4e5a055 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6, name=ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-mon-a, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.1, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.schema-version=1.0, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731) 2024-08-31T04:12:04.448 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:04 smithi050 podman[17139]: 2024-08-31 04:12:04.196871966 +0000 UTC m=+0.615461810 container cleanup ac7df908504d5c188e2d7af555b75d3eaaab84aac1d12db233b645d8b4e5a055 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6, name=ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-mon-a, ceph=True, io.buildah.version=1.37.1, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_CLEAN=True, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611) 2024-08-31T04:12:04.448 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:04 smithi050 bash[17139]: ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-mon-a 2024-08-31T04:12:04.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:04 smithi050 podman[17150]: 2024-08-31 04:12:04.447880964 +0000 UTC m=+0.626885745 container remove ac7df908504d5c188e2d7af555b75d3eaaab84aac1d12db233b645d8b4e5a055 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6, name=ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-mon-a, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.1, ceph=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS) 2024-08-31T04:12:04.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:04 smithi050 systemd[1]: ceph-058d9fc6-674f-11ef-bcd4-c7b262605968@mon.a.service: Deactivated successfully. 2024-08-31T04:12:04.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:04 smithi050 systemd[1]: Stopped Ceph mon.a for 058d9fc6-674f-11ef-bcd4-c7b262605968. 2024-08-31T04:12:04.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:04 smithi050 systemd[1]: ceph-058d9fc6-674f-11ef-bcd4-c7b262605968@mon.a.service: Consumed 1.294s CPU time. 2024-08-31T04:12:04.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:04 smithi050 systemd[1]: Starting Ceph mon.a for 058d9fc6-674f-11ef-bcd4-c7b262605968... 2024-08-31T04:12:05.335 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:04 smithi050 podman[17240]: 2024-08-31 04:12:04.868833011 +0000 UTC m=+0.038723221 image pull 79f4cde5e36911a5dca995eeb98098c2c8aae81dd52a088ef2c867bc3363bad0 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 2024-08-31T04:12:05.335 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:05 smithi050 podman[17240]: 2024-08-31 04:12:05.182346181 +0000 UTC m=+0.352236381 container create 266f494c7418b6d9c3c25a4a943c65e643524930229ac5faaf53b67724b04a62 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6, name=ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-mon-a, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, ceph=True, io.buildah.version=1.37.1) 2024-08-31T04:12:05.522 INFO:teuthology.orchestra.run.smithi050.stdout:Setting public_network to 172.21.0.0/20 in mon config section 2024-08-31T04:12:05.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:05 smithi050 podman[17240]: 2024-08-31 04:12:05.428146862 +0000 UTC m=+0.598037075 container init 266f494c7418b6d9c3c25a4a943c65e643524930229ac5faaf53b67724b04a62 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6, name=ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-mon-a, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.1, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux ) 2024-08-31T04:12:05.701 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:05 smithi050 podman[17240]: 2024-08-31 04:12:05.435508226 +0000 UTC m=+0.605398427 container start 266f494c7418b6d9c3c25a4a943c65e643524930229ac5faaf53b67724b04a62 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6, name=ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-mon-a, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.1, GIT_CLEAN=True) 2024-08-31T04:12:05.701 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:05 smithi050 bash[17240]: 266f494c7418b6d9c3c25a4a943c65e643524930229ac5faaf53b67724b04a62 2024-08-31T04:12:05.701 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:05 smithi050 systemd[1]: Started Ceph mon.a for 058d9fc6-674f-11ef-bcd4-c7b262605968. 2024-08-31T04:12:05.701 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:05 smithi050 ceph-mon[17259]: set uid:gid to 167:167 (ceph:ceph) 2024-08-31T04:12:05.701 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:05 smithi050 ceph-mon[17259]: ceph version 19.3.0-4560-gd19e6118 (d19e6118f7015f0047264006cb0c873528eb3ae6) squid (dev), process ceph-mon, pid 2 2024-08-31T04:12:05.701 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:05 smithi050 ceph-mon[17259]: pidfile_write: ignore empty --pid-file 2024-08-31T04:12:05.701 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:05 smithi050 ceph-mon[17259]: load: jerasure load: lrc 2024-08-31T04:12:05.701 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:05 smithi050 ceph-mon[17259]: rocksdb: RocksDB version: 7.9.2 2024-08-31T04:12:05.701 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:05 smithi050 ceph-mon[17259]: rocksdb: Git sha 0 2024-08-31T04:12:05.701 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:05 smithi050 ceph-mon[17259]: rocksdb: Compile date 2024-08-28 10:19:06 2024-08-31T04:12:05.701 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:05 smithi050 ceph-mon[17259]: rocksdb: DB SUMMARY 2024-08-31T04:12:05.702 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:05 smithi050 ceph-mon[17259]: rocksdb: DB Session ID: 42SH1QFV991HIXNQA3W0 2024-08-31T04:12:05.702 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:05 smithi050 ceph-mon[17259]: rocksdb: CURRENT file: CURRENT 2024-08-31T04:12:05.702 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:05 smithi050 ceph-mon[17259]: rocksdb: IDENTITY file: IDENTITY 2024-08-31T04:12:05.702 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:05 smithi050 ceph-mon[17259]: rocksdb: MANIFEST file: MANIFEST-000010 size: 179 Bytes 2024-08-31T04:12:05.702 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:05 smithi050 ceph-mon[17259]: rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 1, files: 000008.sst 2024-08-31T04:12:05.702 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:05 smithi050 ceph-mon[17259]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 000009.log size: 94969 ; 2024-08-31T04:12:05.702 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:05 smithi050 ceph-mon[17259]: rocksdb: Options.error_if_exists: 0 2024-08-31T04:12:05.702 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:05 smithi050 ceph-mon[17259]: rocksdb: Options.create_if_missing: 0 2024-08-31T04:12:05.702 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:05 smithi050 ceph-mon[17259]: rocksdb: Options.paranoid_checks: 1 2024-08-31T04:12:05.702 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:05 smithi050 ceph-mon[17259]: rocksdb: Options.flush_verify_memtable_count: 1 2024-08-31T04:12:05.702 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:05 smithi050 ceph-mon[17259]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-08-31T04:12:05.702 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:05 smithi050 ceph-mon[17259]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-08-31T04:12:05.703 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:05 smithi050 ceph-mon[17259]: rocksdb: Options.env: 0x5590373de5a0 2024-08-31T04:12:05.703 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:05 smithi050 ceph-mon[17259]: rocksdb: Options.fs: PosixFileSystem 2024-08-31T04:12:05.703 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:05 smithi050 ceph-mon[17259]: rocksdb: Options.info_log: 0x5590658fb4a0 2024-08-31T04:12:05.703 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:05 smithi050 ceph-mon[17259]: rocksdb: Options.max_file_opening_threads: 16 2024-08-31T04:12:05.703 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:05 smithi050 ceph-mon[17259]: rocksdb: Options.statistics: (nil) 2024-08-31T04:12:05.703 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:05 smithi050 ceph-mon[17259]: rocksdb: Options.use_fsync: 0 2024-08-31T04:12:05.703 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:05 smithi050 ceph-mon[17259]: rocksdb: Options.max_log_file_size: 0 2024-08-31T04:12:05.703 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:05 smithi050 ceph-mon[17259]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-08-31T04:12:05.703 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:05 smithi050 ceph-mon[17259]: rocksdb: Options.log_file_time_to_roll: 0 2024-08-31T04:12:05.703 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:05 smithi050 ceph-mon[17259]: rocksdb: Options.keep_log_file_num: 1000 2024-08-31T04:12:05.703 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:05 smithi050 ceph-mon[17259]: rocksdb: Options.recycle_log_file_num: 0 2024-08-31T04:12:05.703 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:05 smithi050 ceph-mon[17259]: rocksdb: Options.allow_fallocate: 1 2024-08-31T04:12:05.703 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:05 smithi050 ceph-mon[17259]: rocksdb: Options.allow_mmap_reads: 0 2024-08-31T04:12:05.703 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:05 smithi050 ceph-mon[17259]: rocksdb: Options.allow_mmap_writes: 0 2024-08-31T04:12:05.704 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:05 smithi050 ceph-mon[17259]: rocksdb: Options.use_direct_reads: 0 2024-08-31T04:12:05.704 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:05 smithi050 ceph-mon[17259]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-08-31T04:12:05.704 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:05 smithi050 ceph-mon[17259]: rocksdb: Options.create_missing_column_families: 0 2024-08-31T04:12:05.704 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:05 smithi050 ceph-mon[17259]: rocksdb: Options.db_log_dir: 2024-08-31T04:12:05.704 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:05 smithi050 ceph-mon[17259]: rocksdb: Options.wal_dir: 2024-08-31T04:12:05.704 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:05 smithi050 ceph-mon[17259]: rocksdb: Options.table_cache_numshardbits: 6 2024-08-31T04:12:05.704 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:05 smithi050 ceph-mon[17259]: rocksdb: Options.WAL_ttl_seconds: 0 2024-08-31T04:12:05.704 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:05 smithi050 ceph-mon[17259]: rocksdb: Options.WAL_size_limit_MB: 0 2024-08-31T04:12:05.704 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:05 smithi050 ceph-mon[17259]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-08-31T04:12:05.704 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:05 smithi050 ceph-mon[17259]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-08-31T04:12:05.704 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:05 smithi050 ceph-mon[17259]: rocksdb: Options.is_fd_close_on_exec: 1 2024-08-31T04:12:05.704 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:05 smithi050 ceph-mon[17259]: rocksdb: Options.advise_random_on_open: 1 2024-08-31T04:12:05.705 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:05 smithi050 ceph-mon[17259]: rocksdb: Options.db_write_buffer_size: 0 2024-08-31T04:12:05.705 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:05 smithi050 ceph-mon[17259]: rocksdb: Options.write_buffer_manager: 0x5590658ff5e0 2024-08-31T04:12:05.705 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:05 smithi050 ceph-mon[17259]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-08-31T04:12:05.705 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:05 smithi050 ceph-mon[17259]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-08-31T04:12:05.705 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:05 smithi050 ceph-mon[17259]: rocksdb: Options.use_adaptive_mutex: 0 2024-08-31T04:12:05.705 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:05 smithi050 ceph-mon[17259]: rocksdb: Options.rate_limiter: (nil) 2024-08-31T04:12:05.705 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:05 smithi050 ceph-mon[17259]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-08-31T04:12:05.705 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:05 smithi050 ceph-mon[17259]: rocksdb: Options.wal_recovery_mode: 2 2024-08-31T04:12:05.705 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:05 smithi050 ceph-mon[17259]: rocksdb: Options.enable_thread_tracking: 0 2024-08-31T04:12:05.705 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:05 smithi050 ceph-mon[17259]: rocksdb: Options.enable_pipelined_write: 0 2024-08-31T04:12:05.705 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:05 smithi050 ceph-mon[17259]: rocksdb: Options.unordered_write: 0 2024-08-31T04:12:05.705 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:05 smithi050 ceph-mon[17259]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-08-31T04:12:05.706 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:05 smithi050 ceph-mon[17259]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-08-31T04:12:05.706 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:05 smithi050 ceph-mon[17259]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-08-31T04:12:05.706 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:05 smithi050 ceph-mon[17259]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-08-31T04:12:05.707 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:05 smithi050 ceph-mon[17259]: rocksdb: Options.row_cache: None 2024-08-31T04:12:05.707 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:05 smithi050 ceph-mon[17259]: rocksdb: Options.wal_filter: None 2024-08-31T04:12:05.707 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:05 smithi050 ceph-mon[17259]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-08-31T04:12:05.707 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:05 smithi050 ceph-mon[17259]: rocksdb: Options.allow_ingest_behind: 0 2024-08-31T04:12:05.707 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:05 smithi050 ceph-mon[17259]: rocksdb: Options.two_write_queues: 0 2024-08-31T04:12:05.707 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:05 smithi050 ceph-mon[17259]: rocksdb: Options.manual_wal_flush: 0 2024-08-31T04:12:05.707 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:05 smithi050 ceph-mon[17259]: rocksdb: Options.wal_compression: 0 2024-08-31T04:12:05.707 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:05 smithi050 ceph-mon[17259]: rocksdb: Options.atomic_flush: 0 2024-08-31T04:12:05.707 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:05 smithi050 ceph-mon[17259]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-08-31T04:12:05.708 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:05 smithi050 ceph-mon[17259]: rocksdb: Options.persist_stats_to_disk: 0 2024-08-31T04:12:05.708 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:05 smithi050 ceph-mon[17259]: rocksdb: Options.write_dbid_to_manifest: 0 2024-08-31T04:12:05.708 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:05 smithi050 ceph-mon[17259]: rocksdb: Options.log_readahead_size: 0 2024-08-31T04:12:05.708 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:05 smithi050 ceph-mon[17259]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-08-31T04:12:05.708 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:05 smithi050 ceph-mon[17259]: rocksdb: Options.best_efforts_recovery: 0 2024-08-31T04:12:05.708 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:05 smithi050 ceph-mon[17259]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-08-31T04:12:05.708 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:05 smithi050 ceph-mon[17259]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-08-31T04:12:05.708 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:05 smithi050 ceph-mon[17259]: rocksdb: Options.allow_data_in_errors: 0 2024-08-31T04:12:05.708 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:05 smithi050 ceph-mon[17259]: rocksdb: Options.db_host_id: __hostname__ 2024-08-31T04:12:05.708 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:05 smithi050 ceph-mon[17259]: rocksdb: Options.enforce_single_del_contracts: true 2024-08-31T04:12:05.708 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:05 smithi050 ceph-mon[17259]: rocksdb: Options.max_background_jobs: 2 2024-08-31T04:12:05.708 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:05 smithi050 ceph-mon[17259]: rocksdb: Options.max_background_compactions: -1 2024-08-31T04:12:05.709 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:05 smithi050 ceph-mon[17259]: rocksdb: Options.max_subcompactions: 1 2024-08-31T04:12:05.709 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:05 smithi050 ceph-mon[17259]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-08-31T04:12:05.709 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:05 smithi050 ceph-mon[17259]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-08-31T04:12:05.709 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:05 smithi050 ceph-mon[17259]: rocksdb: Options.delayed_write_rate : 16777216 2024-08-31T04:12:05.709 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:05 smithi050 ceph-mon[17259]: rocksdb: Options.max_total_wal_size: 0 2024-08-31T04:12:05.709 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:05 smithi050 ceph-mon[17259]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-08-31T04:12:05.709 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:05 smithi050 ceph-mon[17259]: rocksdb: Options.stats_dump_period_sec: 600 2024-08-31T04:12:05.709 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:05 smithi050 ceph-mon[17259]: rocksdb: Options.stats_persist_period_sec: 600 2024-08-31T04:12:05.709 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:05 smithi050 ceph-mon[17259]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-08-31T04:12:05.709 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:05 smithi050 ceph-mon[17259]: rocksdb: Options.max_open_files: -1 2024-08-31T04:12:05.709 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:05 smithi050 ceph-mon[17259]: rocksdb: Options.bytes_per_sync: 0 2024-08-31T04:12:05.709 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:05 smithi050 ceph-mon[17259]: rocksdb: Options.wal_bytes_per_sync: 0 2024-08-31T04:12:05.709 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:05 smithi050 ceph-mon[17259]: rocksdb: Options.strict_bytes_per_sync: 0 2024-08-31T04:12:05.710 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:05 smithi050 ceph-mon[17259]: rocksdb: Options.compaction_readahead_size: 0 2024-08-31T04:12:05.710 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:05 smithi050 ceph-mon[17259]: rocksdb: Options.max_background_flushes: -1 2024-08-31T04:12:05.710 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:05 smithi050 ceph-mon[17259]: rocksdb: Compression algorithms supported: 2024-08-31T04:12:05.710 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:05 smithi050 ceph-mon[17259]: rocksdb: kZSTD supported: 0 2024-08-31T04:12:05.710 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:05 smithi050 ceph-mon[17259]: rocksdb: kXpressCompression supported: 0 2024-08-31T04:12:05.710 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:05 smithi050 ceph-mon[17259]: rocksdb: kBZip2Compression supported: 0 2024-08-31T04:12:05.710 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:05 smithi050 ceph-mon[17259]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-08-31T04:12:05.710 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:05 smithi050 ceph-mon[17259]: rocksdb: kLZ4Compression supported: 1 2024-08-31T04:12:05.710 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:05 smithi050 ceph-mon[17259]: rocksdb: kZlibCompression supported: 1 2024-08-31T04:12:05.710 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:05 smithi050 ceph-mon[17259]: rocksdb: kLZ4HCCompression supported: 1 2024-08-31T04:12:05.710 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:05 smithi050 ceph-mon[17259]: rocksdb: kSnappyCompression supported: 1 2024-08-31T04:12:05.710 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:05 smithi050 ceph-mon[17259]: rocksdb: Fast CRC32 supported: Supported on x86 2024-08-31T04:12:05.710 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:05 smithi050 ceph-mon[17259]: rocksdb: DMutex implementation: pthread_mutex_t 2024-08-31T04:12:05.711 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:05 smithi050 ceph-mon[17259]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2024-08-31T04:12:05.711 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:05 smithi050 ceph-mon[17259]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-08-31T04:12:05.711 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:05 smithi050 ceph-mon[17259]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-08-31T04:12:05.711 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:05 smithi050 ceph-mon[17259]: rocksdb: Options.merge_operator: 2024-08-31T04:12:05.711 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:05 smithi050 ceph-mon[17259]: rocksdb: Options.compaction_filter: None 2024-08-31T04:12:05.711 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:05 smithi050 ceph-mon[17259]: rocksdb: Options.compaction_filter_factory: None 2024-08-31T04:12:05.711 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:05 smithi050 ceph-mon[17259]: rocksdb: Options.sst_partitioner_factory: None 2024-08-31T04:12:05.711 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:05 smithi050 ceph-mon[17259]: rocksdb: Options.memtable_factory: SkipListFactory 2024-08-31T04:12:05.711 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:05 smithi050 ceph-mon[17259]: rocksdb: Options.table_factory: BlockBasedTable 2024-08-31T04:12:05.711 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:05 smithi050 ceph-mon[17259]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x5590658fb0e0) 2024-08-31T04:12:05.711 INFO:journalctl@ceph.mon.a.smithi050.stdout: cache_index_and_filter_blocks: 1 2024-08-31T04:12:05.711 INFO:journalctl@ceph.mon.a.smithi050.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-08-31T04:12:05.711 INFO:journalctl@ceph.mon.a.smithi050.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-08-31T04:12:05.711 INFO:journalctl@ceph.mon.a.smithi050.stdout: pin_top_level_index_and_filter: 1 2024-08-31T04:12:05.711 INFO:journalctl@ceph.mon.a.smithi050.stdout: index_type: 0 2024-08-31T04:12:05.712 INFO:journalctl@ceph.mon.a.smithi050.stdout: data_block_index_type: 0 2024-08-31T04:12:05.712 INFO:journalctl@ceph.mon.a.smithi050.stdout: index_shortening: 1 2024-08-31T04:12:05.712 INFO:journalctl@ceph.mon.a.smithi050.stdout: data_block_hash_table_util_ratio: 0.750000 2024-08-31T04:12:05.712 INFO:journalctl@ceph.mon.a.smithi050.stdout: checksum: 4 2024-08-31T04:12:05.712 INFO:journalctl@ceph.mon.a.smithi050.stdout: no_block_cache: 0 2024-08-31T04:12:05.712 INFO:journalctl@ceph.mon.a.smithi050.stdout: block_cache: 0x5590618be850 2024-08-31T04:12:05.712 INFO:journalctl@ceph.mon.a.smithi050.stdout: block_cache_name: BinnedLRUCache 2024-08-31T04:12:05.712 INFO:journalctl@ceph.mon.a.smithi050.stdout: block_cache_options: 2024-08-31T04:12:05.712 INFO:journalctl@ceph.mon.a.smithi050.stdout: capacity : 536870912 2024-08-31T04:12:05.712 INFO:journalctl@ceph.mon.a.smithi050.stdout: num_shard_bits : 4 2024-08-31T04:12:05.712 INFO:journalctl@ceph.mon.a.smithi050.stdout: strict_capacity_limit : 0 2024-08-31T04:12:05.712 INFO:journalctl@ceph.mon.a.smithi050.stdout: high_pri_pool_ratio: 0.000 2024-08-31T04:12:05.712 INFO:journalctl@ceph.mon.a.smithi050.stdout: block_cache_compressed: (nil) 2024-08-31T04:12:05.712 INFO:journalctl@ceph.mon.a.smithi050.stdout: persistent_cache: (nil) 2024-08-31T04:12:05.712 INFO:journalctl@ceph.mon.a.smithi050.stdout: block_size: 4096 2024-08-31T04:12:05.713 INFO:journalctl@ceph.mon.a.smithi050.stdout: block_size_deviation: 10 2024-08-31T04:12:05.713 INFO:journalctl@ceph.mon.a.smithi050.stdout: block_restart_interval: 16 2024-08-31T04:12:05.713 INFO:journalctl@ceph.mon.a.smithi050.stdout: index_block_restart_interval: 1 2024-08-31T04:12:05.713 INFO:journalctl@ceph.mon.a.smithi050.stdout: metadata_block_size: 4096 2024-08-31T04:12:05.713 INFO:journalctl@ceph.mon.a.smithi050.stdout: partition_filters: 0 2024-08-31T04:12:05.713 INFO:journalctl@ceph.mon.a.smithi050.stdout: use_delta_encoding: 1 2024-08-31T04:12:05.713 INFO:journalctl@ceph.mon.a.smithi050.stdout: filter_policy: bloomfilter 2024-08-31T04:12:05.713 INFO:journalctl@ceph.mon.a.smithi050.stdout: whole_key_filtering: 1 2024-08-31T04:12:05.713 INFO:journalctl@ceph.mon.a.smithi050.stdout: verify_compression: 0 2024-08-31T04:12:05.713 INFO:journalctl@ceph.mon.a.smithi050.stdout: read_amp_bytes_per_bit: 0 2024-08-31T04:12:05.713 INFO:journalctl@ceph.mon.a.smithi050.stdout: format_version: 5 2024-08-31T04:12:05.713 INFO:journalctl@ceph.mon.a.smithi050.stdout: enable_index_compression: 1 2024-08-31T04:12:05.713 INFO:journalctl@ceph.mon.a.smithi050.stdout: block_align: 0 2024-08-31T04:12:05.713 INFO:journalctl@ceph.mon.a.smithi050.stdout: max_auto_readahead_size: 262144 2024-08-31T04:12:05.713 INFO:journalctl@ceph.mon.a.smithi050.stdout: prepopulate_block_cache: 0 2024-08-31T04:12:05.714 INFO:journalctl@ceph.mon.a.smithi050.stdout: initial_auto_readahead_size: 8192 2024-08-31T04:12:05.714 INFO:journalctl@ceph.mon.a.smithi050.stdout: num_file_reads_for_auto_readahead: 2 2024-08-31T04:12:05.714 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:05 smithi050 ceph-mon[17259]: rocksdb: Options.write_buffer_size: 33554432 2024-08-31T04:12:05.714 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:05 smithi050 ceph-mon[17259]: rocksdb: Options.max_write_buffer_number: 2 2024-08-31T04:12:05.714 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:05 smithi050 ceph-mon[17259]: rocksdb: Options.compression: NoCompression 2024-08-31T04:12:05.714 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:05 smithi050 ceph-mon[17259]: rocksdb: Options.bottommost_compression: Disabled 2024-08-31T04:12:05.714 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:05 smithi050 ceph-mon[17259]: rocksdb: Options.prefix_extractor: nullptr 2024-08-31T04:12:05.714 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:05 smithi050 ceph-mon[17259]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-08-31T04:12:05.714 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:05 smithi050 ceph-mon[17259]: rocksdb: Options.num_levels: 7 2024-08-31T04:12:05.714 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:05 smithi050 ceph-mon[17259]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-08-31T04:12:05.714 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:05 smithi050 ceph-mon[17259]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-08-31T04:12:05.714 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:05 smithi050 ceph-mon[17259]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-08-31T04:12:05.714 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:05 smithi050 ceph-mon[17259]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-08-31T04:12:05.715 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:05 smithi050 ceph-mon[17259]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-08-31T04:12:05.715 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:05 smithi050 ceph-mon[17259]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-08-31T04:12:05.715 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:05 smithi050 ceph-mon[17259]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-08-31T04:12:05.715 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:05 smithi050 ceph-mon[17259]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-08-31T04:12:05.715 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:05 smithi050 ceph-mon[17259]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-08-31T04:12:05.715 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:05 smithi050 ceph-mon[17259]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-08-31T04:12:05.715 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:05 smithi050 ceph-mon[17259]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-08-31T04:12:05.715 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:05 smithi050 ceph-mon[17259]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-08-31T04:12:05.715 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:05 smithi050 ceph-mon[17259]: rocksdb: Options.compression_opts.window_bits: -14 2024-08-31T04:12:05.715 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:05 smithi050 ceph-mon[17259]: rocksdb: Options.compression_opts.level: 32767 2024-08-31T04:12:05.715 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:05 smithi050 ceph-mon[17259]: rocksdb: Options.compression_opts.strategy: 0 2024-08-31T04:12:05.715 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:05 smithi050 ceph-mon[17259]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-08-31T04:12:05.715 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:05 smithi050 ceph-mon[17259]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-08-31T04:12:05.715 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:05 smithi050 ceph-mon[17259]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-08-31T04:12:05.715 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:05 smithi050 ceph-mon[17259]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-08-31T04:12:05.716 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:05 smithi050 ceph-mon[17259]: rocksdb: Options.compression_opts.enabled: false 2024-08-31T04:12:05.716 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:05 smithi050 ceph-mon[17259]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-08-31T04:12:05.716 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:05 smithi050 ceph-mon[17259]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-08-31T04:12:05.716 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:05 smithi050 ceph-mon[17259]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-08-31T04:12:05.716 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:05 smithi050 ceph-mon[17259]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-08-31T04:12:05.716 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:05 smithi050 ceph-mon[17259]: rocksdb: Options.target_file_size_base: 67108864 2024-08-31T04:12:05.716 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:05 smithi050 ceph-mon[17259]: rocksdb: Options.target_file_size_multiplier: 1 2024-08-31T04:12:05.716 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:05 smithi050 ceph-mon[17259]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-08-31T04:12:05.716 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:05 smithi050 ceph-mon[17259]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-08-31T04:12:05.716 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:05 smithi050 ceph-mon[17259]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-08-31T04:12:05.716 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:05 smithi050 ceph-mon[17259]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-08-31T04:12:05.716 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:05 smithi050 ceph-mon[17259]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-08-31T04:12:05.716 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:05 smithi050 ceph-mon[17259]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-08-31T04:12:05.717 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:05 smithi050 ceph-mon[17259]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-08-31T04:12:05.717 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:05 smithi050 ceph-mon[17259]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-08-31T04:12:05.717 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:05 smithi050 ceph-mon[17259]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-08-31T04:12:05.717 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:05 smithi050 ceph-mon[17259]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-08-31T04:12:05.717 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:05 smithi050 ceph-mon[17259]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-08-31T04:12:05.717 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:05 smithi050 ceph-mon[17259]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-08-31T04:12:05.717 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:05 smithi050 ceph-mon[17259]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-08-31T04:12:05.717 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:05 smithi050 ceph-mon[17259]: rocksdb: Options.arena_block_size: 1048576 2024-08-31T04:12:05.717 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:05 smithi050 ceph-mon[17259]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-08-31T04:12:05.717 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:05 smithi050 ceph-mon[17259]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-08-31T04:12:05.717 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:05 smithi050 ceph-mon[17259]: rocksdb: Options.disable_auto_compactions: 0 2024-08-31T04:12:05.717 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:05 smithi050 ceph-mon[17259]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-08-31T04:12:05.717 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:05 smithi050 ceph-mon[17259]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-08-31T04:12:05.717 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:05 smithi050 ceph-mon[17259]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-08-31T04:12:05.717 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:05 smithi050 ceph-mon[17259]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-08-31T04:12:05.718 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:05 smithi050 ceph-mon[17259]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-08-31T04:12:05.718 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:05 smithi050 ceph-mon[17259]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-08-31T04:12:05.718 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:05 smithi050 ceph-mon[17259]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-08-31T04:12:05.718 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:05 smithi050 ceph-mon[17259]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-08-31T04:12:05.718 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:05 smithi050 ceph-mon[17259]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-08-31T04:12:05.718 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:05 smithi050 ceph-mon[17259]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-08-31T04:12:05.718 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:05 smithi050 ceph-mon[17259]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-08-31T04:12:05.718 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:05 smithi050 ceph-mon[17259]: rocksdb: Options.inplace_update_support: 0 2024-08-31T04:12:05.718 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:05 smithi050 ceph-mon[17259]: rocksdb: Options.inplace_update_num_locks: 10000 2024-08-31T04:12:05.718 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:05 smithi050 ceph-mon[17259]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-08-31T04:12:05.718 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:05 smithi050 ceph-mon[17259]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-08-31T04:12:05.718 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:05 smithi050 ceph-mon[17259]: rocksdb: Options.memtable_huge_page_size: 0 2024-08-31T04:12:05.718 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:05 smithi050 ceph-mon[17259]: rocksdb: Options.bloom_locality: 0 2024-08-31T04:12:05.718 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:05 smithi050 ceph-mon[17259]: rocksdb: Options.max_successive_merges: 0 2024-08-31T04:12:05.718 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:05 smithi050 ceph-mon[17259]: rocksdb: Options.optimize_filters_for_hits: 0 2024-08-31T04:12:05.719 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:05 smithi050 ceph-mon[17259]: rocksdb: Options.paranoid_file_checks: 0 2024-08-31T04:12:05.719 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:05 smithi050 ceph-mon[17259]: rocksdb: Options.force_consistency_checks: 1 2024-08-31T04:12:05.719 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:05 smithi050 ceph-mon[17259]: rocksdb: Options.report_bg_io_stats: 0 2024-08-31T04:12:05.719 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:05 smithi050 ceph-mon[17259]: rocksdb: Options.ttl: 2592000 2024-08-31T04:12:05.719 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:05 smithi050 ceph-mon[17259]: rocksdb: Options.periodic_compaction_seconds: 0 2024-08-31T04:12:05.719 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:05 smithi050 ceph-mon[17259]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-08-31T04:12:05.719 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:05 smithi050 ceph-mon[17259]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-08-31T04:12:05.719 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:05 smithi050 ceph-mon[17259]: rocksdb: Options.enable_blob_files: false 2024-08-31T04:12:05.719 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:05 smithi050 ceph-mon[17259]: rocksdb: Options.min_blob_size: 0 2024-08-31T04:12:05.719 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:05 smithi050 ceph-mon[17259]: rocksdb: Options.blob_file_size: 268435456 2024-08-31T04:12:05.719 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:05 smithi050 ceph-mon[17259]: rocksdb: Options.blob_compression_type: NoCompression 2024-08-31T04:12:05.719 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:05 smithi050 ceph-mon[17259]: rocksdb: Options.enable_blob_garbage_collection: false 2024-08-31T04:12:05.719 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:05 smithi050 ceph-mon[17259]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-08-31T04:12:05.719 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:05 smithi050 ceph-mon[17259]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-08-31T04:12:05.720 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:05 smithi050 ceph-mon[17259]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-08-31T04:12:05.720 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:05 smithi050 ceph-mon[17259]: rocksdb: Options.blob_file_starting_level: 0 2024-08-31T04:12:05.720 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:05 smithi050 ceph-mon[17259]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-08-31T04:12:05.720 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:05 smithi050 ceph-mon[17259]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 12, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 5 2024-08-31T04:12:05.720 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:05 smithi050 ceph-mon[17259]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 5 2024-08-31T04:12:05.720 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:05 smithi050 ceph-mon[17259]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 2e122fe3-f8f5-4bc7-9265-a14c8ad9af8f 2024-08-31T04:12:05.720 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:05 smithi050 ceph-mon[17259]: rocksdb: EVENT_LOG_v1 {"time_micros": 1725077525552684, "job": 1, "event": "recovery_started", "wal_files": [9]} 2024-08-31T04:12:05.720 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:05 smithi050 ceph-mon[17259]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #9 mode 2 2024-08-31T04:12:05.720 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:05 smithi050 ceph-mon[17259]: rocksdb: EVENT_LOG_v1 {"time_micros": 1725077525554585, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 13, "file_size": 91120, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 8, "largest_seqno": 282, "table_properties": {"data_size": 89168, "index_size": 272, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 645, "raw_key_size": 11619, "raw_average_key_size": 48, "raw_value_size": 82642, "raw_average_value_size": 342, "num_data_blocks": 12, "num_entries": 241, "num_filter_entries": 241, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1725077525, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "2e122fe3-f8f5-4bc7-9265-a14c8ad9af8f", "db_session_id": "42SH1QFV991HIXNQA3W0", "orig_file_number": 13, "seqno_to_time_mapping": "N/A"}} 2024-08-31T04:12:05.720 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:05 smithi050 ceph-mon[17259]: rocksdb: EVENT_LOG_v1 {"time_micros": 1725077525554897, "job": 1, "event": "recovery_finished"} 2024-08-31T04:12:05.720 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:05 smithi050 ceph-mon[17259]: rocksdb: [db/version_set.cc:5047] Creating manifest 15 2024-08-31T04:12:05.720 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:05 smithi050 ceph-mon[17259]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-a/store.db/000009.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-08-31T04:12:05.720 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:05 smithi050 ceph-mon[17259]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x559065920a80 2024-08-31T04:12:05.720 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:05 smithi050 ceph-mon[17259]: rocksdb: DB pointer 0x5590666c2000 2024-08-31T04:12:05.720 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:05 smithi050 ceph-mon[17259]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-08-31T04:12:05.721 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:05 smithi050 ceph-mon[17259]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-08-31T04:12:05.721 INFO:journalctl@ceph.mon.a.smithi050.stdout: ** DB Stats ** 2024-08-31T04:12:05.721 INFO:journalctl@ceph.mon.a.smithi050.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-08-31T04:12:05.721 INFO:journalctl@ceph.mon.a.smithi050.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-08-31T04:12:05.721 INFO:journalctl@ceph.mon.a.smithi050.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-08-31T04:12:05.721 INFO:journalctl@ceph.mon.a.smithi050.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-08-31T04:12:05.721 INFO:journalctl@ceph.mon.a.smithi050.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-08-31T04:12:05.721 INFO:journalctl@ceph.mon.a.smithi050.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-08-31T04:12:05.721 INFO:journalctl@ceph.mon.a.smithi050.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-08-31T04:12:05.721 INFO:journalctl@ceph.mon.a.smithi050.stdout: 2024-08-31T04:12:05.721 INFO:journalctl@ceph.mon.a.smithi050.stdout: ** Compaction Stats [default] ** 2024-08-31T04:12:05.721 INFO:journalctl@ceph.mon.a.smithi050.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-08-31T04:12:05.721 INFO:journalctl@ceph.mon.a.smithi050.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-08-31T04:12:05.721 INFO:journalctl@ceph.mon.a.smithi050.stdout: L0 2/0 90.84 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 73.0 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-08-31T04:12:05.722 INFO:journalctl@ceph.mon.a.smithi050.stdout: Sum 2/0 90.84 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 73.0 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-08-31T04:12:05.722 INFO:journalctl@ceph.mon.a.smithi050.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 73.0 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-08-31T04:12:05.722 INFO:journalctl@ceph.mon.a.smithi050.stdout: 2024-08-31T04:12:05.722 INFO:journalctl@ceph.mon.a.smithi050.stdout: ** Compaction Stats [default] ** 2024-08-31T04:12:05.722 INFO:journalctl@ceph.mon.a.smithi050.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-08-31T04:12:05.722 INFO:journalctl@ceph.mon.a.smithi050.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-08-31T04:12:05.722 INFO:journalctl@ceph.mon.a.smithi050.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 73.0 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-08-31T04:12:05.722 INFO:journalctl@ceph.mon.a.smithi050.stdout: 2024-08-31T04:12:05.722 INFO:journalctl@ceph.mon.a.smithi050.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-08-31T04:12:05.722 INFO:journalctl@ceph.mon.a.smithi050.stdout: 2024-08-31T04:12:05.722 INFO:journalctl@ceph.mon.a.smithi050.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-08-31T04:12:05.722 INFO:journalctl@ceph.mon.a.smithi050.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-08-31T04:12:05.722 INFO:journalctl@ceph.mon.a.smithi050.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-08-31T04:12:05.722 INFO:journalctl@ceph.mon.a.smithi050.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-08-31T04:12:05.722 INFO:journalctl@ceph.mon.a.smithi050.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-08-31T04:12:05.723 INFO:journalctl@ceph.mon.a.smithi050.stdout: AddFile(Keys): cumulative 0, interval 0 2024-08-31T04:12:05.723 INFO:journalctl@ceph.mon.a.smithi050.stdout: Cumulative compaction: 0.00 GB write, 10.49 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-08-31T04:12:05.723 INFO:journalctl@ceph.mon.a.smithi050.stdout: Interval compaction: 0.00 GB write, 10.49 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-08-31T04:12:05.723 INFO:journalctl@ceph.mon.a.smithi050.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-08-31T04:12:05.723 INFO:journalctl@ceph.mon.a.smithi050.stdout: Block cache BinnedLRUCache@0x5590618be850#2 capacity: 512.00 MB usage: 1.31 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1.2e-05 secs_since: 0 2024-08-31T04:12:05.723 INFO:journalctl@ceph.mon.a.smithi050.stdout: Block cache entry stats(count,size,portion): FilterBlock(2,0.84 KB,0.000160933%) IndexBlock(2,0.47 KB,8.9407e-05%) Misc(1,0.00 KB,0%) 2024-08-31T04:12:05.723 INFO:journalctl@ceph.mon.a.smithi050.stdout: 2024-08-31T04:12:05.723 INFO:journalctl@ceph.mon.a.smithi050.stdout: ** File Read Latency Histogram By Level [default] ** 2024-08-31T04:12:05.723 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:05 smithi050 ceph-mon[17259]: starting mon.a rank 0 at public addrs [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] at bind addrs [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] mon_data /var/lib/ceph/mon/ceph-a fsid 058d9fc6-674f-11ef-bcd4-c7b262605968 2024-08-31T04:12:05.723 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:05 smithi050 ceph-mon[17259]: mon.a@-1(???) e1 preinit fsid 058d9fc6-674f-11ef-bcd4-c7b262605968 2024-08-31T04:12:05.723 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:05 smithi050 ceph-mon[17259]: mon.a@-1(???).mds e1 new map 2024-08-31T04:12:05.723 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:05 smithi050 ceph-mon[17259]: mon.a@-1(???).mds e1 print_map 2024-08-31T04:12:05.723 INFO:journalctl@ceph.mon.a.smithi050.stdout: e1 2024-08-31T04:12:05.723 INFO:journalctl@ceph.mon.a.smithi050.stdout: btime 2024-08-31T04:11:59:575880+0000 2024-08-31T04:12:05.723 INFO:journalctl@ceph.mon.a.smithi050.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-08-31T04:12:05.724 INFO:journalctl@ceph.mon.a.smithi050.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-08-31T04:12:05.724 INFO:journalctl@ceph.mon.a.smithi050.stdout: legacy client fscid: -1 2024-08-31T04:12:05.724 INFO:journalctl@ceph.mon.a.smithi050.stdout: 2024-08-31T04:12:05.724 INFO:journalctl@ceph.mon.a.smithi050.stdout: No filesystems configured 2024-08-31T04:12:05.724 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:05 smithi050 ceph-mon[17259]: mon.a@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2024-08-31T04:12:05.724 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:05 smithi050 ceph-mon[17259]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-08-31T04:12:05.724 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:05 smithi050 ceph-mon[17259]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-08-31T04:12:05.724 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:05 smithi050 ceph-mon[17259]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-08-31T04:12:05.724 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:05 smithi050 ceph-mon[17259]: mon.a@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2024-08-31T04:12:05.724 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:05 smithi050 ceph-mon[17259]: mon.a is new leader, mons a in quorum (ranks 0) 2024-08-31T04:12:05.724 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:05 smithi050 ceph-mon[17259]: monmap epoch 1 2024-08-31T04:12:05.724 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:05 smithi050 ceph-mon[17259]: fsid 058d9fc6-674f-11ef-bcd4-c7b262605968 2024-08-31T04:12:05.724 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:05 smithi050 ceph-mon[17259]: last_changed 2024-08-31T04:11:55.731580+0000 2024-08-31T04:12:05.724 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:05 smithi050 ceph-mon[17259]: created 2024-08-31T04:11:55.731580+0000 2024-08-31T04:12:05.725 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:05 smithi050 ceph-mon[17259]: min_mon_release 19 (squid) 2024-08-31T04:12:05.725 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:05 smithi050 ceph-mon[17259]: election_strategy: 1 2024-08-31T04:12:05.725 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:05 smithi050 ceph-mon[17259]: 0: [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] mon.a 2024-08-31T04:12:05.725 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:05 smithi050 ceph-mon[17259]: fsmap 2024-08-31T04:12:05.725 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:05 smithi050 ceph-mon[17259]: osdmap e1: 0 total, 0 up, 0 in 2024-08-31T04:12:05.725 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:05 smithi050 ceph-mon[17259]: mgrmap e1: no daemons active 2024-08-31T04:12:06.714 INFO:teuthology.orchestra.run.smithi050.stdout:Wrote config to /etc/ceph/ceph.conf 2024-08-31T04:12:06.741 INFO:teuthology.orchestra.run.smithi050.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2024-08-31T04:12:06.741 INFO:teuthology.orchestra.run.smithi050.stdout:Creating mgr... 2024-08-31T04:12:06.741 INFO:teuthology.orchestra.run.smithi050.stdout:Verifying port 0.0.0.0:9283 ... 2024-08-31T04:12:06.742 INFO:teuthology.orchestra.run.smithi050.stdout:Verifying port 0.0.0.0:8765 ... 2024-08-31T04:12:07.092 INFO:teuthology.orchestra.run.smithi050.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-058d9fc6-674f-11ef-bcd4-c7b262605968@mgr.x 2024-08-31T04:12:07.092 INFO:teuthology.orchestra.run.smithi050.stdout:systemctl: stderr Failed to reset failed state of unit ceph-058d9fc6-674f-11ef-bcd4-c7b262605968@mgr.x.service: Unit ceph-058d9fc6-674f-11ef-bcd4-c7b262605968@mgr.x.service not loaded. 2024-08-31T04:12:07.327 INFO:teuthology.orchestra.run.smithi050.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-058d9fc6-674f-11ef-bcd4-c7b262605968.target.wants/ceph-058d9fc6-674f-11ef-bcd4-c7b262605968@mgr.x.service → /etc/systemd/system/ceph-058d9fc6-674f-11ef-bcd4-c7b262605968@.service. 2024-08-31T04:12:07.367 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:07 smithi050 ceph-mon[17259]: from='client.? 172.21.15.50:0/3741690949' entity='client.admin' 2024-08-31T04:12:07.677 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Aug 31 04:12:07 smithi050 systemd[1]: Starting Ceph mgr.x for 058d9fc6-674f-11ef-bcd4-c7b262605968... 2024-08-31T04:12:07.929 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Aug 31 04:12:07 smithi050 podman[17467]: 2024-08-31 04:12:07.676523477 +0000 UTC m=+0.119766184 container create 01e9fffe42683e36fbf8ce8a750cc1440074e761a1455f57f8f2dd5bb547a4e8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6, name=ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-mgr-x, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, io.buildah.version=1.37.1, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731) 2024-08-31T04:12:07.930 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Aug 31 04:12:07 smithi050 podman[17467]: 2024-08-31 04:12:07.584318837 +0000 UTC m=+0.027561558 image pull 79f4cde5e36911a5dca995eeb98098c2c8aae81dd52a088ef2c867bc3363bad0 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 2024-08-31T04:12:07.930 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Aug 31 04:12:07 smithi050 podman[17467]: 2024-08-31 04:12:07.854123414 +0000 UTC m=+0.297366135 container init 01e9fffe42683e36fbf8ce8a750cc1440074e761a1455f57f8f2dd5bb547a4e8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6, name=ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-mgr-x, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.vendor=CentOS, ceph=True, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , io.buildah.version=1.37.1, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-08-31T04:12:07.930 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Aug 31 04:12:07 smithi050 podman[17467]: 2024-08-31 04:12:07.86005679 +0000 UTC m=+0.303299511 container start 01e9fffe42683e36fbf8ce8a750cc1440074e761a1455f57f8f2dd5bb547a4e8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6, name=ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-mgr-x, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, io.buildah.version=1.37.1, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611) 2024-08-31T04:12:07.930 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Aug 31 04:12:07 smithi050 bash[17467]: 01e9fffe42683e36fbf8ce8a750cc1440074e761a1455f57f8f2dd5bb547a4e8 2024-08-31T04:12:07.965 INFO:teuthology.orchestra.run.smithi050.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-08-31T04:12:07.965 INFO:teuthology.orchestra.run.smithi050.stdout:systemctl: stdout disabled 2024-08-31T04:12:07.980 INFO:teuthology.orchestra.run.smithi050.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-08-31T04:12:07.980 INFO:teuthology.orchestra.run.smithi050.stdout:systemctl: stdout inactive 2024-08-31T04:12:07.980 INFO:teuthology.orchestra.run.smithi050.stdout:firewalld.service is not enabled 2024-08-31T04:12:07.980 INFO:teuthology.orchestra.run.smithi050.stdout:Not possible to enable service . firewalld.service is not available 2024-08-31T04:12:07.997 INFO:teuthology.orchestra.run.smithi050.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-08-31T04:12:07.997 INFO:teuthology.orchestra.run.smithi050.stdout:systemctl: stdout disabled 2024-08-31T04:12:08.011 INFO:teuthology.orchestra.run.smithi050.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-08-31T04:12:08.011 INFO:teuthology.orchestra.run.smithi050.stdout:systemctl: stdout inactive 2024-08-31T04:12:08.011 INFO:teuthology.orchestra.run.smithi050.stdout:firewalld.service is not enabled 2024-08-31T04:12:08.011 INFO:teuthology.orchestra.run.smithi050.stdout:Not possible to open ports <[9283, 8765]>. firewalld.service is not available 2024-08-31T04:12:08.011 INFO:teuthology.orchestra.run.smithi050.stdout:Waiting for mgr to start... 2024-08-31T04:12:08.011 INFO:teuthology.orchestra.run.smithi050.stdout:Waiting for mgr... 2024-08-31T04:12:08.200 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Aug 31 04:12:07 smithi050 systemd[1]: Started Ceph mgr.x for 058d9fc6-674f-11ef-bcd4-c7b262605968. 2024-08-31T04:12:09.200 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:08 smithi050 ceph-mon[17259]: from='client.? 172.21.15.50:0/1686543857' entity='client.admin' cmd={"prefix": "status", "format": "json-pretty"} : dispatch 2024-08-31T04:12:09.505 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout 2024-08-31T04:12:09.505 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout { 2024-08-31T04:12:09.505 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "fsid": "058d9fc6-674f-11ef-bcd4-c7b262605968", 2024-08-31T04:12:09.505 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "health": { 2024-08-31T04:12:09.505 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-08-31T04:12:09.505 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-08-31T04:12:09.505 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-08-31T04:12:09.505 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout }, 2024-08-31T04:12:09.505 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-08-31T04:12:09.505 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-08-31T04:12:09.505 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout 0 2024-08-31T04:12:09.505 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout ], 2024-08-31T04:12:09.506 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-08-31T04:12:09.506 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "a" 2024-08-31T04:12:09.506 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout ], 2024-08-31T04:12:09.506 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "quorum_age": 3, 2024-08-31T04:12:09.506 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "monmap": { 2024-08-31T04:12:09.506 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-08-31T04:12:09.506 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-08-31T04:12:09.506 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-08-31T04:12:09.506 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout }, 2024-08-31T04:12:09.506 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-08-31T04:12:09.506 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-08-31T04:12:09.506 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-08-31T04:12:09.506 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-08-31T04:12:09.507 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-08-31T04:12:09.507 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-08-31T04:12:09.507 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-08-31T04:12:09.507 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-08-31T04:12:09.510 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout }, 2024-08-31T04:12:09.510 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-08-31T04:12:09.510 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-08-31T04:12:09.510 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-08-31T04:12:09.510 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-08-31T04:12:09.510 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-08-31T04:12:09.510 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-08-31T04:12:09.510 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-08-31T04:12:09.510 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-08-31T04:12:09.511 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-08-31T04:12:09.511 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout }, 2024-08-31T04:12:09.511 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-08-31T04:12:09.511 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-08-31T04:12:09.511 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "btime": "2024-08-31T04:11:59:575880+0000", 2024-08-31T04:12:09.511 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-08-31T04:12:09.511 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-08-31T04:12:09.511 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout }, 2024-08-31T04:12:09.511 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-08-31T04:12:09.511 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "available": false, 2024-08-31T04:12:09.511 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-08-31T04:12:09.511 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "modules": [ 2024-08-31T04:12:09.511 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "iostat", 2024-08-31T04:12:09.511 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "nfs", 2024-08-31T04:12:09.511 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "restful" 2024-08-31T04:12:09.512 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout ], 2024-08-31T04:12:09.512 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "services": {} 2024-08-31T04:12:09.512 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout }, 2024-08-31T04:12:09.512 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-08-31T04:12:09.512 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-08-31T04:12:09.512 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "modified": "2024-08-31T04:11:59.576902+0000", 2024-08-31T04:12:09.512 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "services": {} 2024-08-31T04:12:09.512 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout }, 2024-08-31T04:12:09.512 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-08-31T04:12:09.512 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout } 2024-08-31T04:12:09.512 INFO:teuthology.orchestra.run.smithi050.stdout:mgr not available, waiting (1/15)... 2024-08-31T04:12:12.450 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:12 smithi050 ceph-mon[17259]: from='client.? 172.21.15.50:0/1879682147' entity='client.admin' cmd={"prefix": "status", "format": "json-pretty"} : dispatch 2024-08-31T04:12:12.810 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout 2024-08-31T04:12:12.810 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout { 2024-08-31T04:12:12.810 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "fsid": "058d9fc6-674f-11ef-bcd4-c7b262605968", 2024-08-31T04:12:12.810 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "health": { 2024-08-31T04:12:12.810 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-08-31T04:12:12.810 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-08-31T04:12:12.810 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-08-31T04:12:12.810 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout }, 2024-08-31T04:12:12.810 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-08-31T04:12:12.811 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-08-31T04:12:12.811 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout 0 2024-08-31T04:12:12.811 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout ], 2024-08-31T04:12:12.811 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-08-31T04:12:12.811 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "a" 2024-08-31T04:12:12.811 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout ], 2024-08-31T04:12:12.811 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "quorum_age": 6, 2024-08-31T04:12:12.811 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "monmap": { 2024-08-31T04:12:12.811 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-08-31T04:12:12.811 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-08-31T04:12:12.811 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-08-31T04:12:12.811 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout }, 2024-08-31T04:12:12.811 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-08-31T04:12:12.811 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-08-31T04:12:12.811 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-08-31T04:12:12.812 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-08-31T04:12:12.812 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-08-31T04:12:12.815 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-08-31T04:12:12.816 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-08-31T04:12:12.816 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-08-31T04:12:12.816 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout }, 2024-08-31T04:12:12.816 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-08-31T04:12:12.816 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-08-31T04:12:12.816 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-08-31T04:12:12.816 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-08-31T04:12:12.816 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-08-31T04:12:12.816 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-08-31T04:12:12.816 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-08-31T04:12:12.816 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-08-31T04:12:12.816 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-08-31T04:12:12.816 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout }, 2024-08-31T04:12:12.817 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-08-31T04:12:12.817 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-08-31T04:12:12.817 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "btime": "2024-08-31T04:11:59:575880+0000", 2024-08-31T04:12:12.817 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-08-31T04:12:12.817 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-08-31T04:12:12.817 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout }, 2024-08-31T04:12:12.817 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-08-31T04:12:12.817 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "available": false, 2024-08-31T04:12:12.817 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-08-31T04:12:12.817 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "modules": [ 2024-08-31T04:12:12.817 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "iostat", 2024-08-31T04:12:12.817 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "nfs", 2024-08-31T04:12:12.817 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "restful" 2024-08-31T04:12:12.817 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout ], 2024-08-31T04:12:12.818 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "services": {} 2024-08-31T04:12:12.818 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout }, 2024-08-31T04:12:12.818 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-08-31T04:12:12.818 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-08-31T04:12:12.818 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "modified": "2024-08-31T04:11:59.576902+0000", 2024-08-31T04:12:12.818 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "services": {} 2024-08-31T04:12:12.818 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout }, 2024-08-31T04:12:12.818 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-08-31T04:12:12.818 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout } 2024-08-31T04:12:12.818 INFO:teuthology.orchestra.run.smithi050.stdout:mgr not available, waiting (2/15)... 2024-08-31T04:12:14.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:14 smithi050 ceph-mon[17259]: Activating manager daemon x 2024-08-31T04:12:14.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:14 smithi050 ceph-mon[17259]: mgrmap e2: x(active, starting, since 0.00486742s) 2024-08-31T04:12:14.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:14 smithi050 ceph-mon[17259]: from='mgr.14100 172.21.15.50:0/995503593' entity='mgr.x' cmd={"prefix": "mds metadata"} : dispatch 2024-08-31T04:12:14.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:14 smithi050 ceph-mon[17259]: from='mgr.14100 172.21.15.50:0/995503593' entity='mgr.x' cmd={"prefix": "osd metadata"} : dispatch 2024-08-31T04:12:14.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:14 smithi050 ceph-mon[17259]: from='mgr.14100 172.21.15.50:0/995503593' entity='mgr.x' cmd={"prefix": "mon metadata"} : dispatch 2024-08-31T04:12:14.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:14 smithi050 ceph-mon[17259]: from='mgr.14100 172.21.15.50:0/995503593' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-08-31T04:12:14.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:14 smithi050 ceph-mon[17259]: from='mgr.14100 172.21.15.50:0/995503593' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "x", "id": "x"} : dispatch 2024-08-31T04:12:14.701 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:14 smithi050 ceph-mon[17259]: Manager daemon x is now available 2024-08-31T04:12:14.701 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:14 smithi050 ceph-mon[17259]: from='mgr.14100 172.21.15.50:0/995503593' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"} : dispatch 2024-08-31T04:12:14.701 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:14 smithi050 ceph-mon[17259]: from='mgr.14100 172.21.15.50:0/995503593' entity='mgr.x' 2024-08-31T04:12:14.701 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:14 smithi050 ceph-mon[17259]: from='mgr.14100 172.21.15.50:0/995503593' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"} : dispatch 2024-08-31T04:12:14.701 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:14 smithi050 ceph-mon[17259]: from='mgr.14100 172.21.15.50:0/995503593' entity='mgr.x' 2024-08-31T04:12:14.701 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:14 smithi050 ceph-mon[17259]: from='mgr.14100 172.21.15.50:0/995503593' entity='mgr.x' 2024-08-31T04:12:16.675 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:16 smithi050 ceph-mon[17259]: mgrmap e3: x(active, since 1.0098s) 2024-08-31T04:12:16.675 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:16 smithi050 ceph-mon[17259]: from='client.? 172.21.15.50:0/3573214467' entity='client.admin' cmd={"prefix": "status", "format": "json-pretty"} : dispatch 2024-08-31T04:12:16.680 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout 2024-08-31T04:12:16.686 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout { 2024-08-31T04:12:16.686 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "fsid": "058d9fc6-674f-11ef-bcd4-c7b262605968", 2024-08-31T04:12:16.686 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "health": { 2024-08-31T04:12:16.686 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-08-31T04:12:16.686 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-08-31T04:12:16.686 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-08-31T04:12:16.686 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout }, 2024-08-31T04:12:16.686 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-08-31T04:12:16.686 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-08-31T04:12:16.686 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout 0 2024-08-31T04:12:16.686 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout ], 2024-08-31T04:12:16.687 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-08-31T04:12:16.687 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "a" 2024-08-31T04:12:16.687 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout ], 2024-08-31T04:12:16.687 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "quorum_age": 10, 2024-08-31T04:12:16.687 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "monmap": { 2024-08-31T04:12:16.687 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-08-31T04:12:16.687 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-08-31T04:12:16.687 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-08-31T04:12:16.687 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout }, 2024-08-31T04:12:16.687 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-08-31T04:12:16.687 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-08-31T04:12:16.687 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-08-31T04:12:16.687 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-08-31T04:12:16.687 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-08-31T04:12:16.687 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-08-31T04:12:16.688 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-08-31T04:12:16.688 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-08-31T04:12:16.688 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout }, 2024-08-31T04:12:16.688 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-08-31T04:12:16.688 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-08-31T04:12:16.688 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-08-31T04:12:16.688 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-08-31T04:12:16.688 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-08-31T04:12:16.688 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-08-31T04:12:16.688 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-08-31T04:12:16.688 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-08-31T04:12:16.688 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-08-31T04:12:16.688 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout }, 2024-08-31T04:12:16.689 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-08-31T04:12:16.689 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-08-31T04:12:16.689 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "btime": "2024-08-31T04:11:59:575880+0000", 2024-08-31T04:12:16.689 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-08-31T04:12:16.689 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-08-31T04:12:16.689 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout }, 2024-08-31T04:12:16.689 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-08-31T04:12:16.689 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "available": true, 2024-08-31T04:12:16.689 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-08-31T04:12:16.689 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "modules": [ 2024-08-31T04:12:16.689 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "iostat", 2024-08-31T04:12:16.689 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "nfs", 2024-08-31T04:12:16.689 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "restful" 2024-08-31T04:12:16.689 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout ], 2024-08-31T04:12:16.690 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "services": {} 2024-08-31T04:12:16.690 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout }, 2024-08-31T04:12:16.690 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-08-31T04:12:16.690 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-08-31T04:12:16.690 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "modified": "2024-08-31T04:11:59.576902+0000", 2024-08-31T04:12:16.690 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "services": {} 2024-08-31T04:12:16.690 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout }, 2024-08-31T04:12:16.690 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-08-31T04:12:16.690 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout } 2024-08-31T04:12:16.690 INFO:teuthology.orchestra.run.smithi050.stdout:mgr is available 2024-08-31T04:12:17.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:17 smithi050 ceph-mon[17259]: mgrmap e4: x(active, since 2s) 2024-08-31T04:12:18.005 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout 2024-08-31T04:12:18.005 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout [global] 2024-08-31T04:12:18.005 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout fsid = 058d9fc6-674f-11ef-bcd4-c7b262605968 2024-08-31T04:12:18.006 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout mon_cluster_log_file_level = debug 2024-08-31T04:12:18.006 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.50:3300,v1:172.21.15.50:6789] 2024-08-31T04:12:18.006 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-08-31T04:12:18.006 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-08-31T04:12:18.006 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-08-31T04:12:18.006 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-08-31T04:12:18.006 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout 2024-08-31T04:12:18.006 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout [mgr] 2024-08-31T04:12:18.006 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-08-31T04:12:18.006 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout 2024-08-31T04:12:18.006 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout [osd] 2024-08-31T04:12:18.006 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-08-31T04:12:18.007 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-08-31T04:12:18.007 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-08-31T04:12:18.007 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-08-31T04:12:18.007 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-08-31T04:12:18.007 INFO:teuthology.orchestra.run.smithi050.stdout:Enabling cephadm module... 2024-08-31T04:12:18.699 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:18 smithi050 ceph-mon[17259]: from='client.? 172.21.15.50:0/4127455138' entity='client.admin' cmd={"prefix": "config assimilate-conf"} : dispatch 2024-08-31T04:12:19.655 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:19 smithi050 ceph-mon[17259]: from='client.? 172.21.15.50:0/2111515114' entity='client.admin' cmd={"prefix": "mgr module enable", "module": "cephadm"} : dispatch 2024-08-31T04:12:19.656 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Aug 31 04:12:19 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-mgr-x[17482]: ignoring --setuser ceph since I am not root 2024-08-31T04:12:19.656 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Aug 31 04:12:19 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-mgr-x[17482]: ignoring --setgroup ceph since I am not root 2024-08-31T04:12:20.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:20 smithi050 ceph-mon[17259]: from='client.? 172.21.15.50:0/2111515114' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2024-08-31T04:12:20.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:20 smithi050 ceph-mon[17259]: mgrmap e5: x(active, since 5s) 2024-08-31T04:12:21.292 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout { 2024-08-31T04:12:21.293 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "epoch": 5, 2024-08-31T04:12:21.293 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "available": true, 2024-08-31T04:12:21.293 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-08-31T04:12:21.293 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-08-31T04:12:21.293 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout } 2024-08-31T04:12:21.293 INFO:teuthology.orchestra.run.smithi050.stdout:Waiting for the mgr to restart... 2024-08-31T04:12:21.293 INFO:teuthology.orchestra.run.smithi050.stdout:Waiting for mgr epoch 5... 2024-08-31T04:12:21.616 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:21 smithi050 ceph-mon[17259]: from='client.? 172.21.15.50:0/1436699471' entity='client.admin' cmd={"prefix": "mgr stat"} : dispatch 2024-08-31T04:12:26.200 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:25 smithi050 ceph-mon[17259]: Active manager daemon x restarted 2024-08-31T04:12:26.200 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:25 smithi050 ceph-mon[17259]: Activating manager daemon x 2024-08-31T04:12:26.200 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:25 smithi050 ceph-mon[17259]: osdmap e2: 0 total, 0 up, 0 in 2024-08-31T04:12:26.200 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:25 smithi050 ceph-mon[17259]: mgrmap e6: x(active, starting, since 0.00445174s) 2024-08-31T04:12:26.200 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:25 smithi050 ceph-mon[17259]: from='mgr.14118 172.21.15.50:0/1533349041' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-08-31T04:12:26.200 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:25 smithi050 ceph-mon[17259]: from='mgr.14118 172.21.15.50:0/1533349041' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "x", "id": "x"} : dispatch 2024-08-31T04:12:26.200 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:25 smithi050 ceph-mon[17259]: from='mgr.14118 172.21.15.50:0/1533349041' entity='mgr.x' cmd={"prefix": "mds metadata"} : dispatch 2024-08-31T04:12:26.200 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:25 smithi050 ceph-mon[17259]: from='mgr.14118 172.21.15.50:0/1533349041' entity='mgr.x' cmd={"prefix": "osd metadata"} : dispatch 2024-08-31T04:12:26.201 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:25 smithi050 ceph-mon[17259]: from='mgr.14118 172.21.15.50:0/1533349041' entity='mgr.x' cmd={"prefix": "mon metadata"} : dispatch 2024-08-31T04:12:26.201 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:25 smithi050 ceph-mon[17259]: Manager daemon x is now available 2024-08-31T04:12:27.515 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout { 2024-08-31T04:12:27.515 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2024-08-31T04:12:27.515 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "initialized": true 2024-08-31T04:12:27.515 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout } 2024-08-31T04:12:27.515 INFO:teuthology.orchestra.run.smithi050.stdout:mgr epoch 5 is available 2024-08-31T04:12:27.515 INFO:teuthology.orchestra.run.smithi050.stdout:Setting orchestrator backend to cephadm... 2024-08-31T04:12:27.789 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:27 smithi050 ceph-mon[17259]: from='mgr.14118 172.21.15.50:0/1533349041' entity='mgr.x' 2024-08-31T04:12:27.789 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:27 smithi050 ceph-mon[17259]: from='mgr.14118 172.21.15.50:0/1533349041' entity='mgr.x' 2024-08-31T04:12:27.790 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:27 smithi050 ceph-mon[17259]: Found migration_current of "None". Setting to last migration. 2024-08-31T04:12:27.790 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:27 smithi050 ceph-mon[17259]: from='mgr.14118 172.21.15.50:0/1533349041' entity='mgr.x' 2024-08-31T04:12:27.790 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:27 smithi050 ceph-mon[17259]: from='mgr.14118 172.21.15.50:0/1533349041' entity='mgr.x' 2024-08-31T04:12:27.790 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:27 smithi050 ceph-mon[17259]: from='mgr.14118 172.21.15.50:0/1533349041' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T04:12:27.790 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:27 smithi050 ceph-mon[17259]: from='mgr.14118 172.21.15.50:0/1533349041' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T04:12:27.790 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:27 smithi050 ceph-mon[17259]: from='mgr.14118 172.21.15.50:0/1533349041' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"} : dispatch 2024-08-31T04:12:27.790 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:27 smithi050 ceph-mon[17259]: from='mgr.14118 172.21.15.50:0/1533349041' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"} : dispatch 2024-08-31T04:12:27.790 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:27 smithi050 ceph-mon[17259]: mgrmap e7: x(active, since 1.0075s) 2024-08-31T04:12:27.790 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:27 smithi050 ceph-mon[17259]: from='client.14122 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-08-31T04:12:27.790 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:27 smithi050 ceph-mon[17259]: from='client.14122 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-08-31T04:12:28.633 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Aug 31 04:12:28 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-mgr-x[17482]: 2024-08-31T04:12:28.202+0000 7f78b8e00640 -1 log_channel(cephadm) log [ERR] : [31/Aug/2024:04:12:28] ENGINE Error in HTTPServer.serve 2024-08-31T04:12:28.633 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Aug 31 04:12:28 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-mgr-x[17482]: Traceback (most recent call last): 2024-08-31T04:12:28.633 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Aug 31 04:12:28 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-mgr-x[17482]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-08-31T04:12:28.633 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Aug 31 04:12:28 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-mgr-x[17482]: self._connections.run(self.expiration_interval) 2024-08-31T04:12:28.633 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Aug 31 04:12:28 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-mgr-x[17482]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-08-31T04:12:28.634 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Aug 31 04:12:28 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-mgr-x[17482]: self._run(expiration_interval) 2024-08-31T04:12:28.634 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Aug 31 04:12:28 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-mgr-x[17482]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-08-31T04:12:28.634 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Aug 31 04:12:28 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-mgr-x[17482]: new_conn = self._from_server_socket(self.server.socket) 2024-08-31T04:12:28.634 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Aug 31 04:12:28 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-mgr-x[17482]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-08-31T04:12:28.634 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Aug 31 04:12:28 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-mgr-x[17482]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-08-31T04:12:28.634 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Aug 31 04:12:28 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-mgr-x[17482]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-08-31T04:12:28.634 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Aug 31 04:12:28 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-mgr-x[17482]: s = self.context.wrap_socket( 2024-08-31T04:12:28.634 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Aug 31 04:12:28 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-mgr-x[17482]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-08-31T04:12:28.634 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Aug 31 04:12:28 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-mgr-x[17482]: return self.sslsocket_class._create( 2024-08-31T04:12:28.634 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Aug 31 04:12:28 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-mgr-x[17482]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-08-31T04:12:28.634 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Aug 31 04:12:28 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-mgr-x[17482]: self.do_handshake() 2024-08-31T04:12:28.634 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Aug 31 04:12:28 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-mgr-x[17482]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-08-31T04:12:28.634 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Aug 31 04:12:28 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-mgr-x[17482]: self._sslobj.do_handshake() 2024-08-31T04:12:28.635 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Aug 31 04:12:28 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-mgr-x[17482]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-08-31T04:12:28.635 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Aug 31 04:12:28 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-mgr-x[17482]: 2024-08-31T04:12:28.908 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:28 smithi050 ceph-mon[17259]: [31/Aug/2024:04:12:27] ENGINE Bus STARTING 2024-08-31T04:12:28.908 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:28 smithi050 ceph-mon[17259]: [31/Aug/2024:04:12:28] ENGINE Serving on http://172.21.15.50:8765 2024-08-31T04:12:28.908 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:28 smithi050 ceph-mon[17259]: [31/Aug/2024:04:12:28] ENGINE Serving on https://172.21.15.50:7150 2024-08-31T04:12:28.908 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:28 smithi050 ceph-mon[17259]: [31/Aug/2024:04:12:28] ENGINE Bus STARTED 2024-08-31T04:12:28.908 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:28 smithi050 ceph-mon[17259]: from='mgr.14118 172.21.15.50:0/1533349041' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T04:12:28.908 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:28 smithi050 ceph-mon[17259]: [31/Aug/2024:04:12:28] ENGINE Error in HTTPServer.serve 2024-08-31T04:12:28.908 INFO:journalctl@ceph.mon.a.smithi050.stdout: Traceback (most recent call last): 2024-08-31T04:12:28.908 INFO:journalctl@ceph.mon.a.smithi050.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-08-31T04:12:28.909 INFO:journalctl@ceph.mon.a.smithi050.stdout: self._connections.run(self.expiration_interval) 2024-08-31T04:12:28.909 INFO:journalctl@ceph.mon.a.smithi050.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-08-31T04:12:28.909 INFO:journalctl@ceph.mon.a.smithi050.stdout: self._run(expiration_interval) 2024-08-31T04:12:28.909 INFO:journalctl@ceph.mon.a.smithi050.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-08-31T04:12:28.909 INFO:journalctl@ceph.mon.a.smithi050.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-08-31T04:12:28.909 INFO:journalctl@ceph.mon.a.smithi050.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-08-31T04:12:28.909 INFO:journalctl@ceph.mon.a.smithi050.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-08-31T04:12:28.909 INFO:journalctl@ceph.mon.a.smithi050.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-08-31T04:12:28.909 INFO:journalctl@ceph.mon.a.smithi050.stdout: s = self.context.wrap_socket( 2024-08-31T04:12:28.909 INFO:journalctl@ceph.mon.a.smithi050.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-08-31T04:12:28.909 INFO:journalctl@ceph.mon.a.smithi050.stdout: return self.sslsocket_class._create( 2024-08-31T04:12:28.909 INFO:journalctl@ceph.mon.a.smithi050.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-08-31T04:12:28.909 INFO:journalctl@ceph.mon.a.smithi050.stdout: self.do_handshake() 2024-08-31T04:12:28.909 INFO:journalctl@ceph.mon.a.smithi050.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-08-31T04:12:28.910 INFO:journalctl@ceph.mon.a.smithi050.stdout: self._sslobj.do_handshake() 2024-08-31T04:12:28.910 INFO:journalctl@ceph.mon.a.smithi050.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-08-31T04:12:28.910 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:28 smithi050 ceph-mon[17259]: from='client.14130 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:12:28.910 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:28 smithi050 ceph-mon[17259]: from='mgr.14118 172.21.15.50:0/1533349041' entity='mgr.x' 2024-08-31T04:12:28.910 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:28 smithi050 ceph-mon[17259]: from='mgr.14118 172.21.15.50:0/1533349041' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T04:12:29.950 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:29 smithi050 ceph-mon[17259]: mgrmap e8: x(active, since 2s) 2024-08-31T04:12:30.286 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout value unchanged 2024-08-31T04:12:30.286 INFO:teuthology.orchestra.run.smithi050.stdout:Generating ssh key... 2024-08-31T04:12:30.949 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:30 smithi050 ceph-mon[17259]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:12:31.949 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:31 smithi050 ceph-mon[17259]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:12:31.950 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:31 smithi050 ceph-mon[17259]: Generating ssh key... 2024-08-31T04:12:32.671 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Aug 31 04:12:32 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-mgr-x[17482]: Generating public/private rsa key pair. 2024-08-31T04:12:32.671 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Aug 31 04:12:32 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-mgr-x[17482]: Your identification has been saved in /tmp/tmp5utow79e/key 2024-08-31T04:12:32.672 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Aug 31 04:12:32 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-mgr-x[17482]: Your public key has been saved in /tmp/tmp5utow79e/key.pub 2024-08-31T04:12:32.672 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Aug 31 04:12:32 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-mgr-x[17482]: The key fingerprint is: 2024-08-31T04:12:32.672 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Aug 31 04:12:32 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-mgr-x[17482]: SHA256:k+aWA7EL7J72AF5FN+x9Ca3Lqf/zgP+O1UF6epJ177w ceph-058d9fc6-674f-11ef-bcd4-c7b262605968 2024-08-31T04:12:32.672 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Aug 31 04:12:32 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-mgr-x[17482]: The key's randomart image is: 2024-08-31T04:12:32.672 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Aug 31 04:12:32 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-mgr-x[17482]: +---[RSA 3072]----+ 2024-08-31T04:12:32.672 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Aug 31 04:12:32 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-mgr-x[17482]: | ..o . | 2024-08-31T04:12:32.672 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Aug 31 04:12:32 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-mgr-x[17482]: | . .... . | 2024-08-31T04:12:32.672 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Aug 31 04:12:32 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-mgr-x[17482]: | o. . o . . | 2024-08-31T04:12:32.672 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Aug 31 04:12:32 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-mgr-x[17482]: | . . o..o o o | 2024-08-31T04:12:32.672 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Aug 31 04:12:32 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-mgr-x[17482]: | . + o S. + . +.| 2024-08-31T04:12:32.672 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Aug 31 04:12:32 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-mgr-x[17482]: | . + . = o+. =.+| 2024-08-31T04:12:32.672 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Aug 31 04:12:32 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-mgr-x[17482]: | . o . =.. .+..o| 2024-08-31T04:12:32.673 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Aug 31 04:12:32 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-mgr-x[17482]: | ..o ... ..+oo | 2024-08-31T04:12:32.673 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Aug 31 04:12:32 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-mgr-x[17482]: | .o.. ...+=+E+| 2024-08-31T04:12:32.673 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Aug 31 04:12:32 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-mgr-x[17482]: +----[SHA256]-----+ 2024-08-31T04:12:33.642 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:33 smithi050 ceph-mon[17259]: from='mgr.14118 172.21.15.50:0/1533349041' entity='mgr.x' 2024-08-31T04:12:33.643 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:33 smithi050 ceph-mon[17259]: from='mgr.14118 172.21.15.50:0/1533349041' entity='mgr.x' 2024-08-31T04:12:34.368 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCZqfTgJTc70MP3RUH+QzrAMxZUeYl2RPTuZ/Vns6XaEtcDe80eC7BhOt3f+O/2x0Xu2LXXAbt25ohRrjUguDzNwFaUxTZVas3SfKdhNGMrv9dlb1U0lYIaOZkER7+DUXy8sOLwbhkNAD+uSNZ3KbDVscJjLgI/FnqRKeTDVZfF5J3zwElJIbbq1AJwjh+XfQ9YUzXjfwZuuXtSC+pseH12TQHIjQPpoEOTUmaAC8HM7zvIsZrvXsC3QRPEAgEZWzF2zs/hI/dI7WriUjv3vtt6AxIhVRfjCXXBwTweL181T08IM7Pjn3LvDwBAUQHkIOl3ruNyrfNgDYKcET0OxQrLW+YVJ9chPkevXMcrseduIVOBhJqUe3gFW8aPakAGFVonOz19DnEJr6NsjZCjWcupcl9UuAhm5yOjmWHjta075esAYQmWuiF/Sn0eyp02yQxpYoA7r7DbPNpFoeIhUHVk6Nhwd7f87rTH/liy51k3CQHuva8QeIFrKj1/hfTVNtk= ceph-058d9fc6-674f-11ef-bcd4-c7b262605968 2024-08-31T04:12:34.368 INFO:teuthology.orchestra.run.smithi050.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2024-08-31T04:12:34.369 INFO:teuthology.orchestra.run.smithi050.stdout:Adding key to root@localhost authorized_keys... 2024-08-31T04:12:34.374 INFO:teuthology.orchestra.run.smithi050.stdout:Adding host smithi050... 2024-08-31T04:12:34.613 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:34 smithi050 ceph-mon[17259]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:12:35.938 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:35 smithi050 ceph-mon[17259]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi050", "addr": "172.21.15.50", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:12:36.949 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:36 smithi050 ceph-mon[17259]: Deploying cephadm binary to smithi050 2024-08-31T04:12:40.407 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout Added host 'smithi050' with addr '172.21.15.50' 2024-08-31T04:12:40.407 INFO:teuthology.orchestra.run.smithi050.stdout:Deploying unmanaged mon service... 2024-08-31T04:12:40.950 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:40 smithi050 ceph-mon[17259]: from='mgr.14118 172.21.15.50:0/1533349041' entity='mgr.x' 2024-08-31T04:12:40.950 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:40 smithi050 ceph-mon[17259]: Added host smithi050 2024-08-31T04:12:40.950 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:40 smithi050 ceph-mon[17259]: from='mgr.14118 172.21.15.50:0/1533349041' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T04:12:42.450 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:42 smithi050 ceph-mon[17259]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:12:42.450 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:42 smithi050 ceph-mon[17259]: Saving service mon spec with placement count:5 2024-08-31T04:12:42.450 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:42 smithi050 ceph-mon[17259]: from='mgr.14118 172.21.15.50:0/1533349041' entity='mgr.x' 2024-08-31T04:12:42.495 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2024-08-31T04:12:42.495 INFO:teuthology.orchestra.run.smithi050.stdout:Deploying unmanaged mgr service... 2024-08-31T04:12:43.946 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2024-08-31T04:12:44.450 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:44 smithi050 ceph-mon[17259]: from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:12:44.450 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:44 smithi050 ceph-mon[17259]: Saving service mgr spec with placement count:2 2024-08-31T04:12:44.450 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:44 smithi050 ceph-mon[17259]: from='mgr.14118 172.21.15.50:0/1533349041' entity='mgr.x' 2024-08-31T04:12:44.450 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:44 smithi050 ceph-mon[17259]: from='mgr.14118 172.21.15.50:0/1533349041' entity='mgr.x' 2024-08-31T04:12:45.450 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:45 smithi050 ceph-mon[17259]: from='mgr.14118 172.21.15.50:0/1533349041' entity='mgr.x' 2024-08-31T04:12:45.450 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:45 smithi050 ceph-mon[17259]: from='client.? 172.21.15.50:0/2129959741' entity='client.admin' 2024-08-31T04:12:47.323 INFO:teuthology.orchestra.run.smithi050.stdout:Enabling the dashboard module... 2024-08-31T04:12:47.561 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:47 smithi050 ceph-mon[17259]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T04:12:47.561 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:47 smithi050 ceph-mon[17259]: from='client.? 172.21.15.50:0/2581533686' entity='client.admin' 2024-08-31T04:12:47.561 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:47 smithi050 ceph-mon[17259]: from='mgr.14118 172.21.15.50:0/1533349041' entity='mgr.x' 2024-08-31T04:12:49.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:49 smithi050 ceph-mon[17259]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T04:12:49.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:49 smithi050 ceph-mon[17259]: from='client.? 172.21.15.50:0/2592006676' entity='client.admin' cmd={"prefix": "mgr module enable", "module": "dashboard"} : dispatch 2024-08-31T04:12:49.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:49 smithi050 ceph-mon[17259]: from='mgr.14118 172.21.15.50:0/1533349041' entity='mgr.x' 2024-08-31T04:12:49.700 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Aug 31 04:12:49 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-mgr-x[17482]: ignoring --setuser ceph since I am not root 2024-08-31T04:12:49.700 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Aug 31 04:12:49 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-mgr-x[17482]: ignoring --setgroup ceph since I am not root 2024-08-31T04:12:50.396 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:50 smithi050 ceph-mon[17259]: from='client.? 172.21.15.50:0/2592006676' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2024-08-31T04:12:50.396 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:50 smithi050 ceph-mon[17259]: mgrmap e9: x(active, since 23s) 2024-08-31T04:12:51.699 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:51 smithi050 ceph-mon[17259]: from='client.? 172.21.15.50:0/412486135' entity='client.admin' cmd={"prefix": "mgr stat"} : dispatch 2024-08-31T04:12:52.079 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout { 2024-08-31T04:12:52.079 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "epoch": 9, 2024-08-31T04:12:52.079 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "available": true, 2024-08-31T04:12:52.079 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-08-31T04:12:52.079 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-08-31T04:12:52.079 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout } 2024-08-31T04:12:52.079 INFO:teuthology.orchestra.run.smithi050.stdout:Waiting for the mgr to restart... 2024-08-31T04:12:52.079 INFO:teuthology.orchestra.run.smithi050.stdout:Waiting for mgr epoch 9... 2024-08-31T04:12:56.200 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:55 smithi050 ceph-mon[17259]: Active manager daemon x restarted 2024-08-31T04:12:56.200 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:55 smithi050 ceph-mon[17259]: Activating manager daemon x 2024-08-31T04:12:56.200 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:55 smithi050 ceph-mon[17259]: osdmap e3: 0 total, 0 up, 0 in 2024-08-31T04:12:56.200 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:55 smithi050 ceph-mon[17259]: mgrmap e10: x(active, starting, since 0.00441758s) 2024-08-31T04:12:56.200 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:55 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-08-31T04:12:56.200 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:55 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "x", "id": "x"} : dispatch 2024-08-31T04:12:56.200 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:55 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "mds metadata"} : dispatch 2024-08-31T04:12:56.200 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:55 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "osd metadata"} : dispatch 2024-08-31T04:12:56.200 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:55 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "mon metadata"} : dispatch 2024-08-31T04:12:56.201 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:55 smithi050 ceph-mon[17259]: Manager daemon x is now available 2024-08-31T04:12:57.112 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:56 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T04:12:57.112 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:56 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"} : dispatch 2024-08-31T04:12:57.113 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:56 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"} : dispatch 2024-08-31T04:12:57.113 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:56 smithi050 ceph-mon[17259]: mgrmap e11: x(active, since 1.00853s) 2024-08-31T04:12:57.409 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout { 2024-08-31T04:12:57.409 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 11, 2024-08-31T04:12:57.409 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout "initialized": true 2024-08-31T04:12:57.409 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout } 2024-08-31T04:12:57.409 INFO:teuthology.orchestra.run.smithi050.stdout:mgr epoch 9 is available 2024-08-31T04:12:57.409 INFO:teuthology.orchestra.run.smithi050.stdout:Using certmgr to generate dashboard self-signed certificate... 2024-08-31T04:12:57.700 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Aug 31 04:12:57 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-mgr-x[17482]: 2024-08-31T04:12:57.450+0000 7f12bb600640 -1 log_channel(cephadm) log [ERR] : [31/Aug/2024:04:12:57] ENGINE Error in HTTPServer.serve 2024-08-31T04:12:57.700 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Aug 31 04:12:57 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-mgr-x[17482]: Traceback (most recent call last): 2024-08-31T04:12:57.700 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Aug 31 04:12:57 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-mgr-x[17482]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-08-31T04:12:57.701 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Aug 31 04:12:57 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-mgr-x[17482]: self._connections.run(self.expiration_interval) 2024-08-31T04:12:57.701 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Aug 31 04:12:57 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-mgr-x[17482]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-08-31T04:12:57.701 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Aug 31 04:12:57 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-mgr-x[17482]: self._run(expiration_interval) 2024-08-31T04:12:57.701 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Aug 31 04:12:57 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-mgr-x[17482]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-08-31T04:12:57.701 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Aug 31 04:12:57 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-mgr-x[17482]: new_conn = self._from_server_socket(self.server.socket) 2024-08-31T04:12:57.701 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Aug 31 04:12:57 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-mgr-x[17482]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-08-31T04:12:57.701 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Aug 31 04:12:57 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-mgr-x[17482]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-08-31T04:12:57.701 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Aug 31 04:12:57 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-mgr-x[17482]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-08-31T04:12:57.701 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Aug 31 04:12:57 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-mgr-x[17482]: s = self.context.wrap_socket( 2024-08-31T04:12:57.701 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Aug 31 04:12:57 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-mgr-x[17482]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-08-31T04:12:57.701 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Aug 31 04:12:57 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-mgr-x[17482]: return self.sslsocket_class._create( 2024-08-31T04:12:57.701 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Aug 31 04:12:57 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-mgr-x[17482]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-08-31T04:12:57.701 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Aug 31 04:12:57 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-mgr-x[17482]: self.do_handshake() 2024-08-31T04:12:57.702 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Aug 31 04:12:57 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-mgr-x[17482]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-08-31T04:12:57.702 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Aug 31 04:12:57 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-mgr-x[17482]: self._sslobj.do_handshake() 2024-08-31T04:12:57.702 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Aug 31 04:12:57 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-mgr-x[17482]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-08-31T04:12:57.702 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Aug 31 04:12:57 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-mgr-x[17482]: 2024-08-31T04:12:58.200 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:57 smithi050 ceph-mon[17259]: [31/Aug/2024:04:12:57] ENGINE Bus STARTING 2024-08-31T04:12:58.200 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:57 smithi050 ceph-mon[17259]: [31/Aug/2024:04:12:57] ENGINE Serving on https://172.21.15.50:7150 2024-08-31T04:12:58.200 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:57 smithi050 ceph-mon[17259]: [31/Aug/2024:04:12:57] ENGINE Error in HTTPServer.serve 2024-08-31T04:12:58.200 INFO:journalctl@ceph.mon.a.smithi050.stdout: Traceback (most recent call last): 2024-08-31T04:12:58.200 INFO:journalctl@ceph.mon.a.smithi050.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-08-31T04:12:58.200 INFO:journalctl@ceph.mon.a.smithi050.stdout: self._connections.run(self.expiration_interval) 2024-08-31T04:12:58.200 INFO:journalctl@ceph.mon.a.smithi050.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-08-31T04:12:58.200 INFO:journalctl@ceph.mon.a.smithi050.stdout: self._run(expiration_interval) 2024-08-31T04:12:58.201 INFO:journalctl@ceph.mon.a.smithi050.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-08-31T04:12:58.201 INFO:journalctl@ceph.mon.a.smithi050.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-08-31T04:12:58.201 INFO:journalctl@ceph.mon.a.smithi050.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-08-31T04:12:58.201 INFO:journalctl@ceph.mon.a.smithi050.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-08-31T04:12:58.201 INFO:journalctl@ceph.mon.a.smithi050.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-08-31T04:12:58.201 INFO:journalctl@ceph.mon.a.smithi050.stdout: s = self.context.wrap_socket( 2024-08-31T04:12:58.201 INFO:journalctl@ceph.mon.a.smithi050.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-08-31T04:12:58.201 INFO:journalctl@ceph.mon.a.smithi050.stdout: return self.sslsocket_class._create( 2024-08-31T04:12:58.201 INFO:journalctl@ceph.mon.a.smithi050.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-08-31T04:12:58.201 INFO:journalctl@ceph.mon.a.smithi050.stdout: self.do_handshake() 2024-08-31T04:12:58.201 INFO:journalctl@ceph.mon.a.smithi050.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-08-31T04:12:58.201 INFO:journalctl@ceph.mon.a.smithi050.stdout: self._sslobj.do_handshake() 2024-08-31T04:12:58.201 INFO:journalctl@ceph.mon.a.smithi050.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-08-31T04:12:59.200 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:58 smithi050 ceph-mon[17259]: [31/Aug/2024:04:12:57] ENGINE Serving on http://172.21.15.50:8765 2024-08-31T04:12:59.200 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:58 smithi050 ceph-mon[17259]: [31/Aug/2024:04:12:57] ENGINE Bus STARTED 2024-08-31T04:12:59.200 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:58 smithi050 ceph-mon[17259]: mgrmap e12: x(active, since 2s) 2024-08-31T04:12:59.200 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:58 smithi050 ceph-mon[17259]: from='client.14162 -' entity='client.admin' cmd=[{"prefix": "orch certmgr generate-certificates", "module_name": "dashboard", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:12:59.201 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:12:58 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:12:59.606 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout {"cert": "-----BEGIN CERTIFICATE-----\nMIIE+zCCAuOgAwIBAgIUCM71O0B1B8qj6yl+yrCjIW3qkk8wDQYJKoZIhvcNAQEL\nBQAwFzEVMBMGA1UEAwwMY2VwaGFkbS1yb290MB4XDTI0MDgzMTA0MTI1OFoXDTM0\nMDkwMTA0MTI1OFowFzEVMBMGA1UEAwwMMTcyLjIxLjE1LjUwMIICIjANBgkqhkiG\n9w0BAQEFAAOCAg8AMIICCgKCAgEAqTf6N7lWOzhXYAoYLHvuSdB4IqKNtsogQjQ6\nON5f5uTLj1KQ9VwCIYxDyNSejEZFoRktd87KVLKB1RfMNvxXQeX3uZWkoOYqc9Ax\nrzAlMhfesCrCeOwG5bChDm5HFpL2SLu9oACZP3KxB21x18qdZARVGMFA+omJLchu\nRBsCLFINyd2vekd9iK3SooUsiAbrpKFXC0zMzBzYVvRrfc6PddAYQNE06u8ymcga\ns++YzEoMPiAgtSm4IM96T6VSPtwoLWVESpyc6UByeWvRci5ps3v5dYf53HdnR58E\nt7k0eIN+bdlAx2zhJvteY49R9LGLYfyXr1gAmma6M05wFUOWZwY+eqoPtp9Ztjhz\nUfCly3OyEDhsEM1nSXNVrv0DPkouVXROQeWQS5BfToejl8QP+Ta7NLsZXVbBenXC\nVOVnkFvvEpGhPSOVm0z79A8oiEUNJWzfaF8YOrWfEzxaO5nQo/XQ73puXO6VRugJ\n69BpVDlpRr4c62XF3cShVDdw6PLkCA8IETK3vS1odUywt8l0DdAGvy3ipN8TU26K\nXFL5Cj3SbfaYXmnEej5DsHPWAe9rly6OvhkSJmmACtHQxGqWUpK9oLjudoJyKGMt\n5zgUO+wlQw4r41JKBtPJXC8bVCRVdU5Faj2Cll//vvkoshfmtBX0wuYwjYWu8tC9\n2jfCD58CAwEAAaM/MD0wLQYDVR0RBCYwJIIJc21pdGhpMDUwghFkYXNoYm9hcmRf\nc2VydmVyc4cErBUPMjAMBgNVHRMBAf8EAjAAMA0GCSqGSIb3DQEBCwUAA4ICAQAL\nrAp4Z6Qy8bJ9BgTidhRpdj1gr+Q2D20HdM82bRw3zVYTff7hYF7slBvdYJBxRh9a\nP1VFs/jcj+fhNmd0R7Ct+hRb5MtMK0O1vKhKObzRk58p9UDuDyhJTLGCnINMaVyt\nFtJDr6qc6mN2aeq7R7a21QDA+Vfe8sPOHtgYcXdVvGCuHoVEowpbZQxXH3X3AyON\nf/zCoU5egriP9Iqu/I0EY8SglLbGc2pMQ9rIbBkcp3kHniABBA6chL23WHWqyMPo\nIM6NGVuJDgVNvTgBr65MOmRnJ/YrLumRYo4tS2Ao70WpMPenShXj763mdn2DNiV5\nYeHffPypvApxjSq8DYRChdw8i1LgxVron2o1AzQ3UqGDl7RUCsLFR5An0srBrzjG\nEKrYffSokwIM5o9U8z13B2LDW5petC4miz5R50YPMklvfefyxExv/RpeipTTzFUx\na7iPPZ71gT/DDLdgDHllX37yy1obQ4fagrXK+3YOAq6rw+/VpVygKz/z0YM1B1Lt\narL7QqS+KUxDUMBz1alUBR6P3kmD3taBO/eRsRVG3x0WmTEMPJ00TIJsoE3QXIX3\nuuKsQ2dkWVzmOz71S4ufy8nzwUbKnbtXO+teZpnpx4oMuyaIuLG3ANDTUSYt4kQW\nC9Uv3Y/zyHfRwHkmcY/4gsROwq5qVzlVxh9acrncgQ==\n-----END CERTIFICATE-----\n", "key": "-----BEGIN RSA PRIVATE KEY-----\nMIIJKAIBAAKCAgEAqTf6N7lWOzhXYAoYLHvuSdB4IqKNtsogQjQ6ON5f5uTLj1KQ\n9VwCIYxDyNSejEZFoRktd87KVLKB1RfMNvxXQeX3uZWkoOYqc9AxrzAlMhfesCrC\neOwG5bChDm5HFpL2SLu9oACZP3KxB21x18qdZARVGMFA+omJLchuRBsCLFINyd2v\nekd9iK3SooUsiAbrpKFXC0zMzBzYVvRrfc6PddAYQNE06u8ymcgas++YzEoMPiAg\ntSm4IM96T6VSPtwoLWVESpyc6UByeWvRci5ps3v5dYf53HdnR58Et7k0eIN+bdlA\nx2zhJvteY49R9LGLYfyXr1gAmma6M05wFUOWZwY+eqoPtp9ZtjhzUfCly3OyEDhs\nEM1nSXNVrv0DPkouVXROQeWQS5BfToejl8QP+Ta7NLsZXVbBenXCVOVnkFvvEpGh\nPSOVm0z79A8oiEUNJWzfaF8YOrWfEzxaO5nQo/XQ73puXO6VRugJ69BpVDlpRr4c\n62XF3cShVDdw6PLkCA8IETK3vS1odUywt8l0DdAGvy3ipN8TU26KXFL5Cj3SbfaY\nXmnEej5DsHPWAe9rly6OvhkSJmmACtHQxGqWUpK9oLjudoJyKGMt5zgUO+wlQw4r\n41JKBtPJXC8bVCRVdU5Faj2Cll//vvkoshfmtBX0wuYwjYWu8tC92jfCD58CAwEA\nAQKCAgASVYr6EqNHKKQ+4Zkbk2nj/CmoBwNiX0/+HE6FRC1mhOTmkxmQRqHBz21g\ntbi1QL/hOSsgpKUYvCaDrLURmBGUMD3A5ne/KcZGZLOdZD1YyhafRmK/sJhRYUEc\noSd5SKmqg7zYjc1iKc5dxvvjV4PqBut5Z9GJ05urUYtbka7l7RYACHwvZs4xIDQx\ngPWsNKO/Y0OyaRB0uliuQy6KTku422JlU3AaVu7yk9MLf9WG/NbgEaG5lIWV+Hor\nZaFy8hjgTO0zRaNdRQBM1jkL1/+Cf4Itu8fUnT3xbUdDk1YeCzvdhwEVGl+NVlrf\nCp457Cqf4+WYt+jeJxcxi+QU9GJie12IKnqoxlwQc1TRUFKYL3McQID9nzr3spum\nkfPbRrilGEo3h1KA4Azrh5d32w+nx0nGXcl/6Op4jPCyqP0i4/5sUaYydQHFnk/k\np+ilb8Y6BIlw1Hh4dEHB5CgPnsjCN0gksRDMvixp6F+7Ng8nUtJPmQ9ih9yPGWmp\npgeAsDBfT4YJRBIXQfiyHwFRSrKewSnEBnH1CzRyzFfYHF43AdP799lOt3b0y/81\niKytk5l6KWBv+VgRoRzRK0lama69acNQfQ0i3cr2J+9/rg4oEJ6+RTUc0kGdE6fe\nWea/UsSOyFwy9F/J9nlEF0UBoDgXDQitS375N4txnlWqPd8MkQKCAQEA28kq6+jL\n1DShXdbkiy2PcSX1cfM4vciR914K/5wz/hNYF7hrg+en6u8jo2Mv9eLOyCAYYu+L\n8VFIsOpXQMyS9+CZwN4mq7PEIKtZgdH5KZvyoLqj/cXAgmxeB5Hbf19SDH4QUnJX\nKd4pfnZ7HI47IIqgrUiEtffo1QEr12wYE7o9P4L8TER6qWslDID/qYuZDKPWGsJH\nyDE4UEOgy+p8++EPRrcd8r/pUnPWcexv4xeKApIxcHTM1C01jnLg5wNcF1JxLHpx\ngIDC78lohywEr034YfEdOibjzTMj3+glTVMg1UUFZsPGqxsM9z8xKu0nOglOiuY8\n+hpEupBvwX3hJQKCAQEAxRnTdLHFn0xZl7kgUnYHZSQ18vbz4swDjBgwonxQsyvw\n8ySpZ20SmOYsBt/gJ7OWxfE3tlzOyRMsSTu0IVsh4j4ZP55JL/v+DydTAZLvbO8a\nU3U2SWJa+deb0/hhx4HYH4Kno53JehFpn72Qpy0UpsmN+yNxpmQ3ApYGTdrM5Jrl\neDL4/cmkk85w+Tr7KJaD9hsrmMmRCS1ojjWmrmo4jj5EIlBlCveHj6LmAVoYQFOm\nxlHTeXrZJOT1IVaDk2OZCev7WtV2LiySs29facS8PrwTXouzGujgENDXgOOtmHMS\nXdSN3tes/XvVP3mcbQuOEYEWIcnFrLOenaqMAgh8cwKCAQEAqpycvwi1wYMhiLDa\nNNgnM5Rd1hkSgPCDrtzH+OiOy7rEdZVpkLlxdkQxDBJhFqT8FAomJBcEMU4B+aPQ\nG7Mym000za0lo8AmjZ22G7qdiplOXUrFJqgt6pCo5YNqOpQKIzxw+y9bTlrxJwRe\nSSp356j1Vc6nhoJtsXv5Rn7Yqee2x+isZZ/7ACz2U6CH1ltRcah0+cy64EKlDlmR\nJvpeD0EEFMbtbpVfT+wwGbuKl2Scc6Z8zmk837BAlNXElE/dWxVaWUareS97I5zb\nkaKv+E20dIMxRwUNbSs3vAZ/fmj7YdL0gHOVcxnKlNvvFP2Hp9u1pslXqGZf19tr\nhW5sKQKCAQB3ZxvYt9E2nbQw2++exO3Z8cPU+pHotRr5BbaA2LqysE35nh4aD9OS\nWO4XBAzxQDR4mZbcnQCQg1Ly0n5fLqwqOOBmz+cacJgKahI5A+CTp43VPU6zyie+\n70TxdqkVia15+VbBIddqYZ4RLW+yNvcpyzR+DYzN9iv1HxmWlJRHcSbOWGLKrBtN\nh2SdN4PrpLMwpmkU2BdK7f1HGW1uf97fHQ19lCKCME4pT8/yxbenUIXZ4rwv/aIK\nXcG6foSbB10wy4qsDmDXvBzrIu80TgCUKK+7OPo5tRX4WewTotoJXryjpx6C/zlH\nHnujRnLjBHr+U6sqsOdVpkLS1PyYRrfNAoIBAGFD5d79/imCupLJdSaRx6vnYC1E\nnbWMFM/DbjOft65910zu1kpt6XZU4kU6Pg8Rc9DJI54QwLTMGaTo8jTEQ34SsOWo\n/BZHOcNep/mY+CP0jLy2QqD8RCNIx8OwGX3pFnQBuY4PvfhQe2V1dI+do6PfPFfk\n2OxNvoOm64z+0FVdBucBEe4jFQBvjzBtaEawb6ylIMRZwDsbmzfbc449ZgKxDHks\n+00SIuXrlTGVNexqs3nsQOawOIpjhb00XH/4sM2fyTZYAi5jH4ToeB4VCLmfd0Dq\nGJiE7m4qM7wOWbhGPmtWQDeHaKXPZG9uIXUvo0PHiLkUNTBn+cs8NYEJ73g=\n-----END RSA PRIVATE KEY-----\n"} 2024-08-31T04:13:01.220 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:13:00 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:13:01.220 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:13:00 smithi050 ceph-mon[17259]: from='client.14164 -' entity='client.admin' cmd=[{"prefix": "dashboard set-ssl-certificate", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:13:01.220 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:13:00 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:13:01.226 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout SSL certificate updated 2024-08-31T04:13:03.381 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout SSL certificate key updated 2024-08-31T04:13:03.381 INFO:teuthology.orchestra.run.smithi050.stdout:Creating initial admin user... 2024-08-31T04:13:03.950 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:13:03 smithi050 ceph-mon[17259]: from='client.14166 -' entity='client.admin' cmd=[{"prefix": "dashboard set-ssl-certificate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:13:03.950 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:13:03 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:13:05.013 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$Zy3o/mbpy/fEf.W5ZHhSBeB0l4yiTGNm0faqFoGdt75VZ4aXz2XJK", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1725077584, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2024-08-31T04:13:05.013 INFO:teuthology.orchestra.run.smithi050.stdout:Fetching dashboard port number... 2024-08-31T04:13:05.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:13:05 smithi050 ceph-mon[17259]: from='client.14168 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:13:05.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:13:05 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:13:06.470 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:13:06 smithi050 ceph-mon[17259]: from='client.? 172.21.15.50:0/963644596' entity='client.admin' cmd={"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"} : dispatch 2024-08-31T04:13:06.475 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stdout 8443 2024-08-31T04:13:06.496 INFO:teuthology.orchestra.run.smithi050.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-08-31T04:13:06.497 INFO:teuthology.orchestra.run.smithi050.stdout:systemctl: stdout disabled 2024-08-31T04:13:06.511 INFO:teuthology.orchestra.run.smithi050.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-08-31T04:13:06.511 INFO:teuthology.orchestra.run.smithi050.stdout:systemctl: stdout inactive 2024-08-31T04:13:06.511 INFO:teuthology.orchestra.run.smithi050.stdout:firewalld.service is not enabled 2024-08-31T04:13:06.511 INFO:teuthology.orchestra.run.smithi050.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2024-08-31T04:13:06.513 INFO:teuthology.orchestra.run.smithi050.stdout:Ceph Dashboard is now available at: 2024-08-31T04:13:06.513 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-08-31T04:13:06.514 INFO:teuthology.orchestra.run.smithi050.stdout: URL: https://smithi050.front.sepia.ceph.com:8443/ 2024-08-31T04:13:06.514 INFO:teuthology.orchestra.run.smithi050.stdout: User: admin 2024-08-31T04:13:06.514 INFO:teuthology.orchestra.run.smithi050.stdout: Password: 0ahhhid6qo 2024-08-31T04:13:06.514 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-08-31T04:13:06.514 INFO:teuthology.orchestra.run.smithi050.stdout:Saving cluster configuration to /var/lib/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/config directory 2024-08-31T04:13:08.067 INFO:teuthology.orchestra.run.smithi050.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2024-08-31T04:13:08.067 INFO:teuthology.orchestra.run.smithi050.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2024-08-31T04:13:08.068 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-08-31T04:13:08.068 INFO:teuthology.orchestra.run.smithi050.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid 058d9fc6-674f-11ef-bcd4-c7b262605968 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2024-08-31T04:13:08.068 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-08-31T04:13:08.068 INFO:teuthology.orchestra.run.smithi050.stdout:Or, if you are only running a single cluster on this host: 2024-08-31T04:13:08.068 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-08-31T04:13:08.068 INFO:teuthology.orchestra.run.smithi050.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2024-08-31T04:13:08.068 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-08-31T04:13:08.068 INFO:teuthology.orchestra.run.smithi050.stdout:Please consider enabling telemetry to help improve Ceph: 2024-08-31T04:13:08.068 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-08-31T04:13:08.068 INFO:teuthology.orchestra.run.smithi050.stdout: ceph telemetry on 2024-08-31T04:13:08.068 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-08-31T04:13:08.068 INFO:teuthology.orchestra.run.smithi050.stdout:For more information see: 2024-08-31T04:13:08.068 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-08-31T04:13:08.068 INFO:teuthology.orchestra.run.smithi050.stdout: https://docs.ceph.com/en/latest/mgr/telemetry/ 2024-08-31T04:13:08.069 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-08-31T04:13:08.069 INFO:teuthology.orchestra.run.smithi050.stdout:Bootstrap complete. 2024-08-31T04:13:08.128 INFO:tasks.cephadm:Fetching config... 2024-08-31T04:13:08.128 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-08-31T04:13:08.128 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2024-08-31T04:13:08.167 INFO:tasks.cephadm:Fetching client.admin keyring... 2024-08-31T04:13:08.167 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-08-31T04:13:08.167 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2024-08-31T04:13:08.244 INFO:tasks.cephadm:Fetching mon keyring... 2024-08-31T04:13:08.245 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-08-31T04:13:08.245 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd if=/var/lib/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/mon.a/keyring of=/dev/stdout 2024-08-31T04:13:08.343 INFO:tasks.cephadm:Fetching pub ssh key... 2024-08-31T04:13:08.344 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-08-31T04:13:08.344 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2024-08-31T04:13:08.419 INFO:tasks.cephadm:Installing pub ssh key for root users... 2024-08-31T04:13:08.419 DEBUG:teuthology.orchestra.run.smithi050:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCZqfTgJTc70MP3RUH+QzrAMxZUeYl2RPTuZ/Vns6XaEtcDe80eC7BhOt3f+O/2x0Xu2LXXAbt25ohRrjUguDzNwFaUxTZVas3SfKdhNGMrv9dlb1U0lYIaOZkER7+DUXy8sOLwbhkNAD+uSNZ3KbDVscJjLgI/FnqRKeTDVZfF5J3zwElJIbbq1AJwjh+XfQ9YUzXjfwZuuXtSC+pseH12TQHIjQPpoEOTUmaAC8HM7zvIsZrvXsC3QRPEAgEZWzF2zs/hI/dI7WriUjv3vtt6AxIhVRfjCXXBwTweL181T08IM7Pjn3LvDwBAUQHkIOl3ruNyrfNgDYKcET0OxQrLW+YVJ9chPkevXMcrseduIVOBhJqUe3gFW8aPakAGFVonOz19DnEJr6NsjZCjWcupcl9UuAhm5yOjmWHjta075esAYQmWuiF/Sn0eyp02yQxpYoA7r7DbPNpFoeIhUHVk6Nhwd7f87rTH/liy51k3CQHuva8QeIFrKj1/hfTVNtk= ceph-058d9fc6-674f-11ef-bcd4-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-08-31T04:13:08.539 INFO:teuthology.orchestra.run.smithi050.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCZqfTgJTc70MP3RUH+QzrAMxZUeYl2RPTuZ/Vns6XaEtcDe80eC7BhOt3f+O/2x0Xu2LXXAbt25ohRrjUguDzNwFaUxTZVas3SfKdhNGMrv9dlb1U0lYIaOZkER7+DUXy8sOLwbhkNAD+uSNZ3KbDVscJjLgI/FnqRKeTDVZfF5J3zwElJIbbq1AJwjh+XfQ9YUzXjfwZuuXtSC+pseH12TQHIjQPpoEOTUmaAC8HM7zvIsZrvXsC3QRPEAgEZWzF2zs/hI/dI7WriUjv3vtt6AxIhVRfjCXXBwTweL181T08IM7Pjn3LvDwBAUQHkIOl3ruNyrfNgDYKcET0OxQrLW+YVJ9chPkevXMcrseduIVOBhJqUe3gFW8aPakAGFVonOz19DnEJr6NsjZCjWcupcl9UuAhm5yOjmWHjta075esAYQmWuiF/Sn0eyp02yQxpYoA7r7DbPNpFoeIhUHVk6Nhwd7f87rTH/liy51k3CQHuva8QeIFrKj1/hfTVNtk= ceph-058d9fc6-674f-11ef-bcd4-c7b262605968 2024-08-31T04:13:08.565 DEBUG:teuthology.orchestra.run.smithi133:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCZqfTgJTc70MP3RUH+QzrAMxZUeYl2RPTuZ/Vns6XaEtcDe80eC7BhOt3f+O/2x0Xu2LXXAbt25ohRrjUguDzNwFaUxTZVas3SfKdhNGMrv9dlb1U0lYIaOZkER7+DUXy8sOLwbhkNAD+uSNZ3KbDVscJjLgI/FnqRKeTDVZfF5J3zwElJIbbq1AJwjh+XfQ9YUzXjfwZuuXtSC+pseH12TQHIjQPpoEOTUmaAC8HM7zvIsZrvXsC3QRPEAgEZWzF2zs/hI/dI7WriUjv3vtt6AxIhVRfjCXXBwTweL181T08IM7Pjn3LvDwBAUQHkIOl3ruNyrfNgDYKcET0OxQrLW+YVJ9chPkevXMcrseduIVOBhJqUe3gFW8aPakAGFVonOz19DnEJr6NsjZCjWcupcl9UuAhm5yOjmWHjta075esAYQmWuiF/Sn0eyp02yQxpYoA7r7DbPNpFoeIhUHVk6Nhwd7f87rTH/liy51k3CQHuva8QeIFrKj1/hfTVNtk= ceph-058d9fc6-674f-11ef-bcd4-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-08-31T04:13:08.610 INFO:teuthology.orchestra.run.smithi133.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCZqfTgJTc70MP3RUH+QzrAMxZUeYl2RPTuZ/Vns6XaEtcDe80eC7BhOt3f+O/2x0Xu2LXXAbt25ohRrjUguDzNwFaUxTZVas3SfKdhNGMrv9dlb1U0lYIaOZkER7+DUXy8sOLwbhkNAD+uSNZ3KbDVscJjLgI/FnqRKeTDVZfF5J3zwElJIbbq1AJwjh+XfQ9YUzXjfwZuuXtSC+pseH12TQHIjQPpoEOTUmaAC8HM7zvIsZrvXsC3QRPEAgEZWzF2zs/hI/dI7WriUjv3vtt6AxIhVRfjCXXBwTweL181T08IM7Pjn3LvDwBAUQHkIOl3ruNyrfNgDYKcET0OxQrLW+YVJ9chPkevXMcrseduIVOBhJqUe3gFW8aPakAGFVonOz19DnEJr6NsjZCjWcupcl9UuAhm5yOjmWHjta075esAYQmWuiF/Sn0eyp02yQxpYoA7r7DbPNpFoeIhUHVk6Nhwd7f87rTH/liy51k3CQHuva8QeIFrKj1/hfTVNtk= ceph-058d9fc6-674f-11ef-bcd4-c7b262605968 2024-08-31T04:13:08.623 DEBUG:teuthology.orchestra.run.smithi177:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCZqfTgJTc70MP3RUH+QzrAMxZUeYl2RPTuZ/Vns6XaEtcDe80eC7BhOt3f+O/2x0Xu2LXXAbt25ohRrjUguDzNwFaUxTZVas3SfKdhNGMrv9dlb1U0lYIaOZkER7+DUXy8sOLwbhkNAD+uSNZ3KbDVscJjLgI/FnqRKeTDVZfF5J3zwElJIbbq1AJwjh+XfQ9YUzXjfwZuuXtSC+pseH12TQHIjQPpoEOTUmaAC8HM7zvIsZrvXsC3QRPEAgEZWzF2zs/hI/dI7WriUjv3vtt6AxIhVRfjCXXBwTweL181T08IM7Pjn3LvDwBAUQHkIOl3ruNyrfNgDYKcET0OxQrLW+YVJ9chPkevXMcrseduIVOBhJqUe3gFW8aPakAGFVonOz19DnEJr6NsjZCjWcupcl9UuAhm5yOjmWHjta075esAYQmWuiF/Sn0eyp02yQxpYoA7r7DbPNpFoeIhUHVk6Nhwd7f87rTH/liy51k3CQHuva8QeIFrKj1/hfTVNtk= ceph-058d9fc6-674f-11ef-bcd4-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-08-31T04:13:08.664 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:13:08 smithi050 ceph-mon[17259]: from='client.? 172.21.15.50:0/146324320' entity='client.admin' 2024-08-31T04:13:08.664 INFO:teuthology.orchestra.run.smithi177.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCZqfTgJTc70MP3RUH+QzrAMxZUeYl2RPTuZ/Vns6XaEtcDe80eC7BhOt3f+O/2x0Xu2LXXAbt25ohRrjUguDzNwFaUxTZVas3SfKdhNGMrv9dlb1U0lYIaOZkER7+DUXy8sOLwbhkNAD+uSNZ3KbDVscJjLgI/FnqRKeTDVZfF5J3zwElJIbbq1AJwjh+XfQ9YUzXjfwZuuXtSC+pseH12TQHIjQPpoEOTUmaAC8HM7zvIsZrvXsC3QRPEAgEZWzF2zs/hI/dI7WriUjv3vtt6AxIhVRfjCXXBwTweL181T08IM7Pjn3LvDwBAUQHkIOl3ruNyrfNgDYKcET0OxQrLW+YVJ9chPkevXMcrseduIVOBhJqUe3gFW8aPakAGFVonOz19DnEJr6NsjZCjWcupcl9UuAhm5yOjmWHjta075esAYQmWuiF/Sn0eyp02yQxpYoA7r7DbPNpFoeIhUHVk6Nhwd7f87rTH/liy51k3CQHuva8QeIFrKj1/hfTVNtk= ceph-058d9fc6-674f-11ef-bcd4-c7b262605968 2024-08-31T04:13:08.676 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 058d9fc6-674f-11ef-bcd4-c7b262605968 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2024-08-31T04:13:09.044 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:13:09.436 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:13:09 smithi050 ceph-mon[17259]: mgrmap e13: x(active, since 12s) 2024-08-31T04:13:10.882 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2024-08-31T04:13:10.882 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 058d9fc6-674f-11ef-bcd4-c7b262605968 -- ceph orch client-keyring set client.admin '*' --mode 0755 2024-08-31T04:13:11.123 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:13:10 smithi050 ceph-mon[17259]: from='client.? 172.21.15.50:0/4209613023' entity='client.admin' 2024-08-31T04:13:11.397 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:13:13.051 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi133 2024-08-31T04:13:13.051 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2024-08-31T04:13:13.052 DEBUG:teuthology.orchestra.run.smithi133:> dd of=/etc/ceph/ceph.conf 2024-08-31T04:13:13.071 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2024-08-31T04:13:13.071 DEBUG:teuthology.orchestra.run.smithi133:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-08-31T04:13:13.129 INFO:tasks.cephadm:Adding host smithi133 to orchestrator... 2024-08-31T04:13:13.129 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 058d9fc6-674f-11ef-bcd4-c7b262605968 -- ceph orch host add smithi133 2024-08-31T04:13:13.558 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:13:13.697 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:13:13 smithi050 ceph-mon[17259]: from='client.14176 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:13:13.698 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:13:13 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:13:14.950 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:13:14 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:13:14.950 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:13:14 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:13:14.950 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:13:14 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi050", "name": "osd_memory_target"} : dispatch 2024-08-31T04:13:14.950 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:13:14 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:13:14.950 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:13:14 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T04:13:14.950 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:13:14 smithi050 ceph-mon[17259]: Updating smithi050:/etc/ceph/ceph.conf 2024-08-31T04:13:14.950 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:13:14 smithi050 ceph-mon[17259]: Updating smithi050:/var/lib/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/config/ceph.conf 2024-08-31T04:13:14.950 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:13:14 smithi050 ceph-mon[17259]: from='client.14178 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi133", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:13:15.950 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:13:15 smithi050 ceph-mon[17259]: Updating smithi050:/etc/ceph/ceph.client.admin.keyring 2024-08-31T04:13:15.950 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:13:15 smithi050 ceph-mon[17259]: Updating smithi050:/var/lib/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/config/ceph.client.admin.keyring 2024-08-31T04:13:15.950 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:13:15 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:13:15.950 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:13:15 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:13:15.950 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:13:15 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:13:16.950 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:13:16 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T04:13:16.950 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:13:16 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:13:16.950 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:13:16 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T04:13:16.950 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:13:16 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:13:16.950 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:13:16 smithi050 ceph-mon[17259]: Deploying cephadm binary to smithi133 2024-08-31T04:13:16.950 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:13:16 smithi050 ceph-mon[17259]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T04:13:18.332 INFO:teuthology.orchestra.run.smithi050.stdout:Added host 'smithi133' with addr '172.21.15.133' 2024-08-31T04:13:19.038 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 058d9fc6-674f-11ef-bcd4-c7b262605968 -- ceph orch host ls --format=json 2024-08-31T04:13:19.409 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:13:19.665 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:13:19 smithi050 ceph-mon[17259]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T04:13:19.665 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:13:19 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:13:19.665 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:13:19 smithi050 ceph-mon[17259]: Added host smithi133 2024-08-31T04:13:19.665 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:13:19 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T04:13:19.665 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:13:19 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:13:19.665 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:13:19 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:13:20.183 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-08-31T04:13:20.183 INFO:teuthology.orchestra.run.smithi050.stdout:[{"addr": "172.21.15.50", "hostname": "smithi050", "labels": [], "status": ""}, {"addr": "172.21.15.133", "hostname": "smithi133", "labels": [], "status": ""}] 2024-08-31T04:13:20.946 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:13:20 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:13:20.947 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:13:20 smithi050 ceph-mon[17259]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T04:13:20.947 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:13:20 smithi050 ceph-mon[17259]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-31T04:13:20.988 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi177 2024-08-31T04:13:20.988 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2024-08-31T04:13:20.988 DEBUG:teuthology.orchestra.run.smithi177:> dd of=/etc/ceph/ceph.conf 2024-08-31T04:13:21.008 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2024-08-31T04:13:21.008 DEBUG:teuthology.orchestra.run.smithi177:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-08-31T04:13:21.065 INFO:tasks.cephadm:Adding host smithi177 to orchestrator... 2024-08-31T04:13:21.065 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 058d9fc6-674f-11ef-bcd4-c7b262605968 -- ceph orch host add smithi177 2024-08-31T04:13:21.438 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:13:23.200 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:13:22 smithi050 ceph-mon[17259]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T04:13:23.200 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:13:22 smithi050 ceph-mon[17259]: from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi177", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:13:23.200 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:13:22 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:13:23.200 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:13:22 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:13:23.200 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:13:22 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:13:23.200 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:13:22 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:13:23.200 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:13:22 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi133", "name": "osd_memory_target"} : dispatch 2024-08-31T04:13:23.200 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:13:22 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:13:23.200 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:13:22 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T04:13:24.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:13:24 smithi050 ceph-mon[17259]: Updating smithi133:/etc/ceph/ceph.conf 2024-08-31T04:13:24.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:13:24 smithi050 ceph-mon[17259]: Updating smithi133:/var/lib/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/config/ceph.conf 2024-08-31T04:13:24.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:13:24 smithi050 ceph-mon[17259]: Updating smithi133:/etc/ceph/ceph.client.admin.keyring 2024-08-31T04:13:24.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:13:24 smithi050 ceph-mon[17259]: Updating smithi133:/var/lib/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/config/ceph.client.admin.keyring 2024-08-31T04:13:24.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:13:24 smithi050 ceph-mon[17259]: Deploying cephadm binary to smithi177 2024-08-31T04:13:24.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:13:24 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:13:24.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:13:24 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:13:24.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:13:24 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:13:25.699 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:13:25 smithi050 ceph-mon[17259]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T04:13:26.050 INFO:teuthology.orchestra.run.smithi050.stdout:Added host 'smithi177' with addr '172.21.15.177' 2024-08-31T04:13:26.740 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 058d9fc6-674f-11ef-bcd4-c7b262605968 -- ceph orch host ls --format=json 2024-08-31T04:13:27.107 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:13:27.351 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:13:27 smithi050 ceph-mon[17259]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T04:13:27.351 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:13:27 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:13:27.351 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:13:27 smithi050 ceph-mon[17259]: Added host smithi177 2024-08-31T04:13:27.351 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:13:27 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T04:13:27.352 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:13:27 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:13:27.352 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:13:27 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:13:27.890 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-08-31T04:13:27.890 INFO:teuthology.orchestra.run.smithi050.stdout:[{"addr": "172.21.15.50", "hostname": "smithi050", "labels": [], "status": ""}, {"addr": "172.21.15.133", "hostname": "smithi133", "labels": [], "status": ""}, {"addr": "172.21.15.177", "hostname": "smithi177", "labels": [], "status": ""}] 2024-08-31T04:13:28.493 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:13:28 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:13:28.530 INFO:tasks.cephadm:Setting crush tunables to default 2024-08-31T04:13:28.530 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 058d9fc6-674f-11ef-bcd4-c7b262605968 -- ceph osd crush tunables default 2024-08-31T04:13:28.895 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:13:29.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:13:29 smithi050 ceph-mon[17259]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T04:13:29.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:13:29 smithi050 ceph-mon[17259]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-31T04:13:30.397 INFO:teuthology.orchestra.run.smithi050.stderr:adjusted tunables profile to default 2024-08-31T04:13:30.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:13:30 smithi050 ceph-mon[17259]: from='client.? 172.21.15.50:0/2013549459' entity='client.admin' cmd={"prefix": "osd crush tunables", "profile": "default"} : dispatch 2024-08-31T04:13:30.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:13:30 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:13:30.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:13:30 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:13:30.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:13:30 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:13:30.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:13:30 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:13:30.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:13:30 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi177", "name": "osd_memory_target"} : dispatch 2024-08-31T04:13:30.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:13:30 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:13:30.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:13:30 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T04:13:31.106 INFO:tasks.cephadm:Adding mon.a on smithi050 2024-08-31T04:13:31.106 INFO:tasks.cephadm:Adding mon.b on smithi133 2024-08-31T04:13:31.106 INFO:tasks.cephadm:Adding mon.c on smithi177 2024-08-31T04:13:31.107 DEBUG:teuthology.orchestra.run.smithi177:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 058d9fc6-674f-11ef-bcd4-c7b262605968 -- ceph orch apply mon '3;smithi050:172.21.15.50=a;smithi133:172.21.15.133=b;smithi177:172.21.15.177=c' 2024-08-31T04:13:31.341 INFO:teuthology.orchestra.run.smithi177.stderr:Inferring config /var/lib/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/config/ceph.conf 2024-08-31T04:13:31.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:13:31 smithi050 ceph-mon[17259]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T04:13:31.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:13:31 smithi050 ceph-mon[17259]: Updating smithi177:/etc/ceph/ceph.conf 2024-08-31T04:13:31.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:13:31 smithi050 ceph-mon[17259]: Updating smithi177:/var/lib/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/config/ceph.conf 2024-08-31T04:13:31.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:13:31 smithi050 ceph-mon[17259]: from='client.? 172.21.15.50:0/2013549459' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-08-31T04:13:31.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:13:31 smithi050 ceph-mon[17259]: osdmap e4: 0 total, 0 up, 0 in 2024-08-31T04:13:31.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:13:31 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:13:31.701 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:13:31 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:13:31.701 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:13:31 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:13:31.976 INFO:teuthology.orchestra.run.smithi177.stdout:Scheduled mon update... 2024-08-31T04:13:32.582 DEBUG:teuthology.orchestra.run.smithi133:mon.b> sudo journalctl -f -n 0 -u ceph-058d9fc6-674f-11ef-bcd4-c7b262605968@mon.b.service 2024-08-31T04:13:32.585 DEBUG:teuthology.orchestra.run.smithi177:mon.c> sudo journalctl -f -n 0 -u ceph-058d9fc6-674f-11ef-bcd4-c7b262605968@mon.c.service 2024-08-31T04:13:32.588 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-08-31T04:13:32.588 DEBUG:teuthology.orchestra.run.smithi177:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 058d9fc6-674f-11ef-bcd4-c7b262605968 -- ceph mon dump -f json 2024-08-31T04:13:32.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:13:32 smithi050 ceph-mon[17259]: Updating smithi177:/etc/ceph/ceph.client.admin.keyring 2024-08-31T04:13:32.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:13:32 smithi050 ceph-mon[17259]: Updating smithi177:/var/lib/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/config/ceph.client.admin.keyring 2024-08-31T04:13:32.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:13:32 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:13:32.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:13:32 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T04:13:32.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:13:32 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:13:32.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:13:32 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T04:13:32.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:13:32 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:13:32.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:13:32 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-08-31T04:13:32.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:13:32 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:13:33.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:13:33 smithi050 ceph-mon[17259]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T04:13:33.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:13:33 smithi050 ceph-mon[17259]: from='client.14188 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi050:172.21.15.50=a;smithi133:172.21.15.133=b;smithi177:172.21.15.177=c", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:13:33.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:13:33 smithi050 ceph-mon[17259]: Saving service mon spec with placement smithi050:172.21.15.50=a;smithi133:172.21.15.133=b;smithi177:172.21.15.177=c;count:3 2024-08-31T04:13:33.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:13:33 smithi050 ceph-mon[17259]: Deploying daemon mon.c on smithi177 2024-08-31T04:13:34.721 INFO:teuthology.orchestra.run.smithi177.stderr:Inferring config /var/lib/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/mon.c/config 2024-08-31T04:13:35.615 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-08-31T04:13:35.616 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":1,"fsid":"058d9fc6-674f-11ef-bcd4-c7b262605968","modified":"2024-08-31T04:11:55.731580Z","created":"2024-08-31T04:11:55.731580Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:3300","nonce":0},{"type":"v1","addr":"172.21.15.50:6789","nonce":0}]},"addr":"172.21.15.50:6789/0","public_addr":"172.21.15.50:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-08-31T04:13:35.616 INFO:teuthology.orchestra.run.smithi177.stderr:dumped monmap epoch 1 2024-08-31T04:13:35.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:13:35 smithi050 ceph-mon[17259]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T04:13:35.961 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:35 smithi177 systemd[1]: Starting Ceph mon.c for 058d9fc6-674f-11ef-bcd4-c7b262605968... 2024-08-31T04:13:36.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:36 smithi177 podman[22005]: 2024-08-31 04:13:36.337791142 +0000 UTC m=+0.016087056 image pull 79f4cde5e36911a5dca995eeb98098c2c8aae81dd52a088ef2c867bc3363bad0 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61 2024-08-31T04:13:36.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:13:36 smithi050 ceph-mon[17259]: from='client.? 172.21.15.177:0/673538866' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-08-31T04:13:36.782 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:36 smithi177 podman[22005]: 2024-08-31 04:13:36.52895452 +0000 UTC m=+0.207250436 container create 30c7409d7a61c5fc8bfff2a8575f9333017ec765756e4acab6ad62bb1721ae69 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-mon-c, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.1, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS) 2024-08-31T04:13:36.782 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:36 smithi177 podman[22005]: 2024-08-31 04:13:36.714727211 +0000 UTC m=+0.393023128 container init 30c7409d7a61c5fc8bfff2a8575f9333017ec765756e4acab6ad62bb1721ae69 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-mon-c, org.label-schema.schema-version=1.0, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, ceph=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.1) 2024-08-31T04:13:36.782 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:36 smithi177 podman[22005]: 2024-08-31 04:13:36.717767237 +0000 UTC m=+0.396063151 container start 30c7409d7a61c5fc8bfff2a8575f9333017ec765756e4acab6ad62bb1721ae69 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-mon-c, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, io.buildah.version=1.37.1, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, ceph=True, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0) 2024-08-31T04:13:36.782 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:36 smithi177 ceph-mon[22025]: set uid:gid to 167:167 (ceph:ceph) 2024-08-31T04:13:36.782 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:36 smithi177 ceph-mon[22025]: ceph version 19.3.0-4560-gd19e6118 (d19e6118f7015f0047264006cb0c873528eb3ae6) squid (dev), process ceph-mon, pid 2 2024-08-31T04:13:36.783 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:36 smithi177 ceph-mon[22025]: pidfile_write: ignore empty --pid-file 2024-08-31T04:13:36.783 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:36 smithi177 ceph-mon[22025]: load: jerasure load: lrc 2024-08-31T04:13:36.783 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:36 smithi177 ceph-mon[22025]: rocksdb: RocksDB version: 7.9.2 2024-08-31T04:13:36.783 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:36 smithi177 ceph-mon[22025]: rocksdb: Git sha 0 2024-08-31T04:13:36.783 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:36 smithi177 ceph-mon[22025]: rocksdb: Compile date 2024-08-28 10:19:06 2024-08-31T04:13:36.783 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:36 smithi177 ceph-mon[22025]: rocksdb: DB SUMMARY 2024-08-31T04:13:36.783 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:36 smithi177 ceph-mon[22025]: rocksdb: DB Session ID: NVMNCL46HSEIJ3O7532V 2024-08-31T04:13:36.783 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:36 smithi177 ceph-mon[22025]: rocksdb: CURRENT file: CURRENT 2024-08-31T04:13:36.783 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:36 smithi177 ceph-mon[22025]: rocksdb: IDENTITY file: IDENTITY 2024-08-31T04:13:36.783 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:36 smithi177 ceph-mon[22025]: rocksdb: MANIFEST file: MANIFEST-000005 size: 59 Bytes 2024-08-31T04:13:36.784 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:36 smithi177 ceph-mon[22025]: rocksdb: SST files in /var/lib/ceph/mon/ceph-c/store.db dir, Total Num: 0, files: 2024-08-31T04:13:36.784 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:36 smithi177 ceph-mon[22025]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-c/store.db: 000004.log size: 511 ; 2024-08-31T04:13:36.784 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:36 smithi177 ceph-mon[22025]: rocksdb: Options.error_if_exists: 0 2024-08-31T04:13:36.784 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:36 smithi177 ceph-mon[22025]: rocksdb: Options.create_if_missing: 0 2024-08-31T04:13:36.786 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:36 smithi177 ceph-mon[22025]: rocksdb: Options.paranoid_checks: 1 2024-08-31T04:13:36.786 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:36 smithi177 ceph-mon[22025]: rocksdb: Options.flush_verify_memtable_count: 1 2024-08-31T04:13:36.786 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:36 smithi177 ceph-mon[22025]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-08-31T04:13:36.786 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:36 smithi177 ceph-mon[22025]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-08-31T04:13:36.786 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:36 smithi177 ceph-mon[22025]: rocksdb: Options.env: 0x55bd3c2e15a0 2024-08-31T04:13:36.786 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:36 smithi177 ceph-mon[22025]: rocksdb: Options.fs: PosixFileSystem 2024-08-31T04:13:36.786 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:36 smithi177 ceph-mon[22025]: rocksdb: Options.info_log: 0x55bd424e54e0 2024-08-31T04:13:36.786 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:36 smithi177 ceph-mon[22025]: rocksdb: Options.max_file_opening_threads: 16 2024-08-31T04:13:36.786 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:36 smithi177 ceph-mon[22025]: rocksdb: Options.statistics: (nil) 2024-08-31T04:13:36.786 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:36 smithi177 ceph-mon[22025]: rocksdb: Options.use_fsync: 0 2024-08-31T04:13:36.786 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:36 smithi177 ceph-mon[22025]: rocksdb: Options.max_log_file_size: 0 2024-08-31T04:13:36.786 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:36 smithi177 ceph-mon[22025]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-08-31T04:13:36.787 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:36 smithi177 ceph-mon[22025]: rocksdb: Options.log_file_time_to_roll: 0 2024-08-31T04:13:36.787 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:36 smithi177 ceph-mon[22025]: rocksdb: Options.keep_log_file_num: 1000 2024-08-31T04:13:36.787 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:36 smithi177 ceph-mon[22025]: rocksdb: Options.recycle_log_file_num: 0 2024-08-31T04:13:36.787 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:36 smithi177 ceph-mon[22025]: rocksdb: Options.allow_fallocate: 1 2024-08-31T04:13:36.787 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:36 smithi177 ceph-mon[22025]: rocksdb: Options.allow_mmap_reads: 0 2024-08-31T04:13:36.787 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:36 smithi177 ceph-mon[22025]: rocksdb: Options.allow_mmap_writes: 0 2024-08-31T04:13:36.787 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:36 smithi177 ceph-mon[22025]: rocksdb: Options.use_direct_reads: 0 2024-08-31T04:13:36.787 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:36 smithi177 ceph-mon[22025]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-08-31T04:13:36.787 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:36 smithi177 ceph-mon[22025]: rocksdb: Options.create_missing_column_families: 0 2024-08-31T04:13:36.787 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:36 smithi177 ceph-mon[22025]: rocksdb: Options.db_log_dir: 2024-08-31T04:13:36.787 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:36 smithi177 ceph-mon[22025]: rocksdb: Options.wal_dir: 2024-08-31T04:13:36.788 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:36 smithi177 ceph-mon[22025]: rocksdb: Options.table_cache_numshardbits: 6 2024-08-31T04:13:36.788 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:36 smithi177 ceph-mon[22025]: rocksdb: Options.WAL_ttl_seconds: 0 2024-08-31T04:13:36.788 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:36 smithi177 ceph-mon[22025]: rocksdb: Options.WAL_size_limit_MB: 0 2024-08-31T04:13:36.788 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:36 smithi177 ceph-mon[22025]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-08-31T04:13:36.788 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:36 smithi177 ceph-mon[22025]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-08-31T04:13:36.788 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:36 smithi177 ceph-mon[22025]: rocksdb: Options.is_fd_close_on_exec: 1 2024-08-31T04:13:36.788 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:36 smithi177 ceph-mon[22025]: rocksdb: Options.advise_random_on_open: 1 2024-08-31T04:13:36.788 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:36 smithi177 ceph-mon[22025]: rocksdb: Options.db_write_buffer_size: 0 2024-08-31T04:13:36.788 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:36 smithi177 ceph-mon[22025]: rocksdb: Options.write_buffer_manager: 0x55bd424e95e0 2024-08-31T04:13:36.788 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:36 smithi177 ceph-mon[22025]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-08-31T04:13:36.788 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:36 smithi177 ceph-mon[22025]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-08-31T04:13:36.788 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:36 smithi177 ceph-mon[22025]: rocksdb: Options.use_adaptive_mutex: 0 2024-08-31T04:13:36.789 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:36 smithi177 ceph-mon[22025]: rocksdb: Options.rate_limiter: (nil) 2024-08-31T04:13:36.789 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:36 smithi177 ceph-mon[22025]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-08-31T04:13:36.789 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:36 smithi177 ceph-mon[22025]: rocksdb: Options.wal_recovery_mode: 2 2024-08-31T04:13:36.789 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:36 smithi177 ceph-mon[22025]: rocksdb: Options.enable_thread_tracking: 0 2024-08-31T04:13:36.789 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:36 smithi177 ceph-mon[22025]: rocksdb: Options.enable_pipelined_write: 0 2024-08-31T04:13:36.789 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:36 smithi177 ceph-mon[22025]: rocksdb: Options.unordered_write: 0 2024-08-31T04:13:36.789 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:36 smithi177 ceph-mon[22025]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-08-31T04:13:36.789 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:36 smithi177 ceph-mon[22025]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-08-31T04:13:36.789 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:36 smithi177 ceph-mon[22025]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-08-31T04:13:36.789 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:36 smithi177 ceph-mon[22025]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-08-31T04:13:36.789 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:36 smithi177 ceph-mon[22025]: rocksdb: Options.row_cache: None 2024-08-31T04:13:36.789 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:36 smithi177 ceph-mon[22025]: rocksdb: Options.wal_filter: None 2024-08-31T04:13:36.789 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:36 smithi177 ceph-mon[22025]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-08-31T04:13:36.790 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:36 smithi177 ceph-mon[22025]: rocksdb: Options.allow_ingest_behind: 0 2024-08-31T04:13:36.790 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:36 smithi177 ceph-mon[22025]: rocksdb: Options.two_write_queues: 0 2024-08-31T04:13:36.790 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:36 smithi177 ceph-mon[22025]: rocksdb: Options.manual_wal_flush: 0 2024-08-31T04:13:36.790 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:36 smithi177 ceph-mon[22025]: rocksdb: Options.wal_compression: 0 2024-08-31T04:13:36.790 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:36 smithi177 ceph-mon[22025]: rocksdb: Options.atomic_flush: 0 2024-08-31T04:13:36.790 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:36 smithi177 ceph-mon[22025]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-08-31T04:13:36.790 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:36 smithi177 ceph-mon[22025]: rocksdb: Options.persist_stats_to_disk: 0 2024-08-31T04:13:36.790 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:36 smithi177 ceph-mon[22025]: rocksdb: Options.write_dbid_to_manifest: 0 2024-08-31T04:13:36.790 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:36 smithi177 ceph-mon[22025]: rocksdb: Options.log_readahead_size: 0 2024-08-31T04:13:36.790 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:36 smithi177 ceph-mon[22025]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-08-31T04:13:36.790 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:36 smithi177 ceph-mon[22025]: rocksdb: Options.best_efforts_recovery: 0 2024-08-31T04:13:36.790 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:36 smithi177 ceph-mon[22025]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-08-31T04:13:36.791 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:36 smithi177 ceph-mon[22025]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-08-31T04:13:36.791 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:36 smithi177 ceph-mon[22025]: rocksdb: Options.allow_data_in_errors: 0 2024-08-31T04:13:36.791 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:36 smithi177 ceph-mon[22025]: rocksdb: Options.db_host_id: __hostname__ 2024-08-31T04:13:36.791 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:36 smithi177 ceph-mon[22025]: rocksdb: Options.enforce_single_del_contracts: true 2024-08-31T04:13:36.791 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:36 smithi177 ceph-mon[22025]: rocksdb: Options.max_background_jobs: 2 2024-08-31T04:13:36.791 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:36 smithi177 ceph-mon[22025]: rocksdb: Options.max_background_compactions: -1 2024-08-31T04:13:36.791 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:36 smithi177 ceph-mon[22025]: rocksdb: Options.max_subcompactions: 1 2024-08-31T04:13:36.791 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:36 smithi177 ceph-mon[22025]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-08-31T04:13:36.791 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:36 smithi177 ceph-mon[22025]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-08-31T04:13:36.791 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:36 smithi177 ceph-mon[22025]: rocksdb: Options.delayed_write_rate : 16777216 2024-08-31T04:13:36.791 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:36 smithi177 ceph-mon[22025]: rocksdb: Options.max_total_wal_size: 0 2024-08-31T04:13:36.791 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:36 smithi177 ceph-mon[22025]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-08-31T04:13:36.791 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:36 smithi177 ceph-mon[22025]: rocksdb: Options.stats_dump_period_sec: 600 2024-08-31T04:13:36.792 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:36 smithi177 ceph-mon[22025]: rocksdb: Options.stats_persist_period_sec: 600 2024-08-31T04:13:36.792 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:36 smithi177 ceph-mon[22025]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-08-31T04:13:36.792 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:36 smithi177 ceph-mon[22025]: rocksdb: Options.max_open_files: -1 2024-08-31T04:13:36.792 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:36 smithi177 ceph-mon[22025]: rocksdb: Options.bytes_per_sync: 0 2024-08-31T04:13:36.792 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:36 smithi177 ceph-mon[22025]: rocksdb: Options.wal_bytes_per_sync: 0 2024-08-31T04:13:36.792 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:36 smithi177 ceph-mon[22025]: rocksdb: Options.strict_bytes_per_sync: 0 2024-08-31T04:13:36.792 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:36 smithi177 ceph-mon[22025]: rocksdb: Options.compaction_readahead_size: 0 2024-08-31T04:13:36.792 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:36 smithi177 ceph-mon[22025]: rocksdb: Options.max_background_flushes: -1 2024-08-31T04:13:36.792 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:36 smithi177 ceph-mon[22025]: rocksdb: Compression algorithms supported: 2024-08-31T04:13:36.792 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:36 smithi177 ceph-mon[22025]: rocksdb: kZSTD supported: 0 2024-08-31T04:13:36.792 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:36 smithi177 ceph-mon[22025]: rocksdb: kXpressCompression supported: 0 2024-08-31T04:13:36.792 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:36 smithi177 ceph-mon[22025]: rocksdb: kBZip2Compression supported: 0 2024-08-31T04:13:36.792 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:36 smithi177 ceph-mon[22025]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-08-31T04:13:36.793 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:36 smithi177 ceph-mon[22025]: rocksdb: kLZ4Compression supported: 1 2024-08-31T04:13:36.793 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:36 smithi177 ceph-mon[22025]: rocksdb: kZlibCompression supported: 1 2024-08-31T04:13:36.793 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:36 smithi177 ceph-mon[22025]: rocksdb: kLZ4HCCompression supported: 1 2024-08-31T04:13:36.793 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:36 smithi177 ceph-mon[22025]: rocksdb: kSnappyCompression supported: 1 2024-08-31T04:13:36.793 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:36 smithi177 ceph-mon[22025]: rocksdb: Fast CRC32 supported: Supported on x86 2024-08-31T04:13:36.793 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:36 smithi177 ceph-mon[22025]: rocksdb: DMutex implementation: pthread_mutex_t 2024-08-31T04:13:36.793 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:36 smithi177 ceph-mon[22025]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000005 2024-08-31T04:13:36.793 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:36 smithi177 ceph-mon[22025]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-08-31T04:13:36.793 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:36 smithi177 ceph-mon[22025]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-08-31T04:13:36.793 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:36 smithi177 ceph-mon[22025]: rocksdb: Options.merge_operator: 2024-08-31T04:13:36.793 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:36 smithi177 ceph-mon[22025]: rocksdb: Options.compaction_filter: None 2024-08-31T04:13:36.793 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:36 smithi177 ceph-mon[22025]: rocksdb: Options.compaction_filter_factory: None 2024-08-31T04:13:36.793 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:36 smithi177 ceph-mon[22025]: rocksdb: Options.sst_partitioner_factory: None 2024-08-31T04:13:36.794 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:36 smithi177 ceph-mon[22025]: rocksdb: Options.memtable_factory: SkipListFactory 2024-08-31T04:13:36.794 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:36 smithi177 ceph-mon[22025]: rocksdb: Options.table_factory: BlockBasedTable 2024-08-31T04:13:36.794 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:36 smithi177 ceph-mon[22025]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55bd424e5100) 2024-08-31T04:13:36.794 INFO:journalctl@ceph.mon.c.smithi177.stdout: cache_index_and_filter_blocks: 1 2024-08-31T04:13:36.794 INFO:journalctl@ceph.mon.c.smithi177.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-08-31T04:13:36.794 INFO:journalctl@ceph.mon.c.smithi177.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-08-31T04:13:36.794 INFO:journalctl@ceph.mon.c.smithi177.stdout: pin_top_level_index_and_filter: 1 2024-08-31T04:13:36.794 INFO:journalctl@ceph.mon.c.smithi177.stdout: index_type: 0 2024-08-31T04:13:36.794 INFO:journalctl@ceph.mon.c.smithi177.stdout: data_block_index_type: 0 2024-08-31T04:13:36.794 INFO:journalctl@ceph.mon.c.smithi177.stdout: index_shortening: 1 2024-08-31T04:13:36.794 INFO:journalctl@ceph.mon.c.smithi177.stdout: data_block_hash_table_util_ratio: 0.750000 2024-08-31T04:13:36.795 INFO:journalctl@ceph.mon.c.smithi177.stdout: checksum: 4 2024-08-31T04:13:36.795 INFO:journalctl@ceph.mon.c.smithi177.stdout: no_block_cache: 0 2024-08-31T04:13:36.795 INFO:journalctl@ceph.mon.c.smithi177.stdout: block_cache: 0x55bd3e4a8850 2024-08-31T04:13:36.795 INFO:journalctl@ceph.mon.c.smithi177.stdout: block_cache_name: BinnedLRUCache 2024-08-31T04:13:36.795 INFO:journalctl@ceph.mon.c.smithi177.stdout: block_cache_options: 2024-08-31T04:13:36.795 INFO:journalctl@ceph.mon.c.smithi177.stdout: capacity : 536870912 2024-08-31T04:13:36.795 INFO:journalctl@ceph.mon.c.smithi177.stdout: num_shard_bits : 4 2024-08-31T04:13:36.795 INFO:journalctl@ceph.mon.c.smithi177.stdout: strict_capacity_limit : 0 2024-08-31T04:13:36.795 INFO:journalctl@ceph.mon.c.smithi177.stdout: high_pri_pool_ratio: 0.000 2024-08-31T04:13:36.795 INFO:journalctl@ceph.mon.c.smithi177.stdout: block_cache_compressed: (nil) 2024-08-31T04:13:36.795 INFO:journalctl@ceph.mon.c.smithi177.stdout: persistent_cache: (nil) 2024-08-31T04:13:36.795 INFO:journalctl@ceph.mon.c.smithi177.stdout: block_size: 4096 2024-08-31T04:13:36.795 INFO:journalctl@ceph.mon.c.smithi177.stdout: block_size_deviation: 10 2024-08-31T04:13:36.796 INFO:journalctl@ceph.mon.c.smithi177.stdout: block_restart_interval: 16 2024-08-31T04:13:36.796 INFO:journalctl@ceph.mon.c.smithi177.stdout: index_block_restart_interval: 1 2024-08-31T04:13:36.796 INFO:journalctl@ceph.mon.c.smithi177.stdout: metadata_block_size: 4096 2024-08-31T04:13:36.796 INFO:journalctl@ceph.mon.c.smithi177.stdout: partition_filters: 0 2024-08-31T04:13:36.796 INFO:journalctl@ceph.mon.c.smithi177.stdout: use_delta_encoding: 1 2024-08-31T04:13:36.796 INFO:journalctl@ceph.mon.c.smithi177.stdout: filter_policy: bloomfilter 2024-08-31T04:13:36.796 INFO:journalctl@ceph.mon.c.smithi177.stdout: whole_key_filtering: 1 2024-08-31T04:13:36.796 INFO:journalctl@ceph.mon.c.smithi177.stdout: verify_compression: 0 2024-08-31T04:13:36.796 INFO:journalctl@ceph.mon.c.smithi177.stdout: read_amp_bytes_per_bit: 0 2024-08-31T04:13:36.796 INFO:journalctl@ceph.mon.c.smithi177.stdout: format_version: 5 2024-08-31T04:13:36.796 INFO:journalctl@ceph.mon.c.smithi177.stdout: enable_index_compression: 1 2024-08-31T04:13:36.796 INFO:journalctl@ceph.mon.c.smithi177.stdout: block_align: 0 2024-08-31T04:13:36.797 INFO:journalctl@ceph.mon.c.smithi177.stdout: max_auto_readahead_size: 262144 2024-08-31T04:13:36.797 INFO:journalctl@ceph.mon.c.smithi177.stdout: prepopulate_block_cache: 0 2024-08-31T04:13:36.797 INFO:journalctl@ceph.mon.c.smithi177.stdout: initial_auto_readahead_size: 8192 2024-08-31T04:13:36.797 INFO:journalctl@ceph.mon.c.smithi177.stdout: num_file_reads_for_auto_readahead: 2 2024-08-31T04:13:36.797 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:36 smithi177 ceph-mon[22025]: rocksdb: Options.write_buffer_size: 33554432 2024-08-31T04:13:36.797 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:36 smithi177 ceph-mon[22025]: rocksdb: Options.max_write_buffer_number: 2 2024-08-31T04:13:36.797 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:36 smithi177 ceph-mon[22025]: rocksdb: Options.compression: NoCompression 2024-08-31T04:13:36.797 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:36 smithi177 ceph-mon[22025]: rocksdb: Options.bottommost_compression: Disabled 2024-08-31T04:13:36.797 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:36 smithi177 ceph-mon[22025]: rocksdb: Options.prefix_extractor: nullptr 2024-08-31T04:13:36.797 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:36 smithi177 ceph-mon[22025]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-08-31T04:13:36.797 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:36 smithi177 ceph-mon[22025]: rocksdb: Options.num_levels: 7 2024-08-31T04:13:36.797 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:36 smithi177 ceph-mon[22025]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-08-31T04:13:36.797 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:36 smithi177 ceph-mon[22025]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-08-31T04:13:36.797 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:36 smithi177 ceph-mon[22025]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-08-31T04:13:36.798 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:36 smithi177 ceph-mon[22025]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-08-31T04:13:36.798 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:36 smithi177 ceph-mon[22025]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-08-31T04:13:36.798 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:36 smithi177 ceph-mon[22025]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-08-31T04:13:36.798 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:36 smithi177 ceph-mon[22025]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-08-31T04:13:36.798 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:36 smithi177 ceph-mon[22025]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-08-31T04:13:36.798 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:36 smithi177 ceph-mon[22025]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-08-31T04:13:36.798 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:36 smithi177 ceph-mon[22025]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-08-31T04:13:36.798 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:36 smithi177 ceph-mon[22025]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-08-31T04:13:36.798 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:36 smithi177 ceph-mon[22025]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-08-31T04:13:36.798 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:36 smithi177 ceph-mon[22025]: rocksdb: Options.compression_opts.window_bits: -14 2024-08-31T04:13:36.798 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:36 smithi177 ceph-mon[22025]: rocksdb: Options.compression_opts.level: 32767 2024-08-31T04:13:36.798 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:36 smithi177 ceph-mon[22025]: rocksdb: Options.compression_opts.strategy: 0 2024-08-31T04:13:36.798 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:36 smithi177 ceph-mon[22025]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-08-31T04:13:36.798 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:36 smithi177 ceph-mon[22025]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-08-31T04:13:36.798 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:36 smithi177 ceph-mon[22025]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-08-31T04:13:36.799 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:36 smithi177 ceph-mon[22025]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-08-31T04:13:36.799 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:36 smithi177 ceph-mon[22025]: rocksdb: Options.compression_opts.enabled: false 2024-08-31T04:13:36.799 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:36 smithi177 ceph-mon[22025]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-08-31T04:13:36.799 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:36 smithi177 ceph-mon[22025]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-08-31T04:13:36.799 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:36 smithi177 ceph-mon[22025]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-08-31T04:13:36.799 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:36 smithi177 ceph-mon[22025]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-08-31T04:13:36.799 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:36 smithi177 ceph-mon[22025]: rocksdb: Options.target_file_size_base: 67108864 2024-08-31T04:13:36.799 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:36 smithi177 ceph-mon[22025]: rocksdb: Options.target_file_size_multiplier: 1 2024-08-31T04:13:36.799 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:36 smithi177 ceph-mon[22025]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-08-31T04:13:36.799 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:36 smithi177 ceph-mon[22025]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-08-31T04:13:36.799 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:36 smithi177 ceph-mon[22025]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-08-31T04:13:36.799 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:36 smithi177 ceph-mon[22025]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-08-31T04:13:36.799 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:36 smithi177 ceph-mon[22025]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-08-31T04:13:36.799 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:36 smithi177 ceph-mon[22025]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-08-31T04:13:36.799 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:36 smithi177 ceph-mon[22025]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-08-31T04:13:36.800 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:36 smithi177 ceph-mon[22025]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-08-31T04:13:36.800 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:36 smithi177 ceph-mon[22025]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-08-31T04:13:36.800 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:36 smithi177 ceph-mon[22025]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-08-31T04:13:36.800 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:36 smithi177 ceph-mon[22025]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-08-31T04:13:36.800 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:36 smithi177 ceph-mon[22025]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-08-31T04:13:36.800 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:36 smithi177 ceph-mon[22025]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-08-31T04:13:36.800 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:36 smithi177 ceph-mon[22025]: rocksdb: Options.arena_block_size: 1048576 2024-08-31T04:13:36.800 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:36 smithi177 ceph-mon[22025]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-08-31T04:13:36.800 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:36 smithi177 ceph-mon[22025]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-08-31T04:13:36.800 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:36 smithi177 ceph-mon[22025]: rocksdb: Options.disable_auto_compactions: 0 2024-08-31T04:13:36.800 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:36 smithi177 ceph-mon[22025]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-08-31T04:13:36.800 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:36 smithi177 ceph-mon[22025]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-08-31T04:13:36.800 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:36 smithi177 ceph-mon[22025]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-08-31T04:13:36.800 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:36 smithi177 ceph-mon[22025]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-08-31T04:13:36.800 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:36 smithi177 ceph-mon[22025]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-08-31T04:13:36.801 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:36 smithi177 ceph-mon[22025]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-08-31T04:13:36.801 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:36 smithi177 ceph-mon[22025]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-08-31T04:13:36.801 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:36 smithi177 ceph-mon[22025]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-08-31T04:13:36.801 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:36 smithi177 ceph-mon[22025]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-08-31T04:13:36.801 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:36 smithi177 ceph-mon[22025]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-08-31T04:13:36.801 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:36 smithi177 ceph-mon[22025]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-08-31T04:13:36.801 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:36 smithi177 ceph-mon[22025]: rocksdb: Options.inplace_update_support: 0 2024-08-31T04:13:36.801 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:36 smithi177 ceph-mon[22025]: rocksdb: Options.inplace_update_num_locks: 10000 2024-08-31T04:13:36.801 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:36 smithi177 ceph-mon[22025]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-08-31T04:13:36.801 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:36 smithi177 ceph-mon[22025]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-08-31T04:13:36.801 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:36 smithi177 ceph-mon[22025]: rocksdb: Options.memtable_huge_page_size: 0 2024-08-31T04:13:36.801 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:36 smithi177 ceph-mon[22025]: rocksdb: Options.bloom_locality: 0 2024-08-31T04:13:36.801 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:36 smithi177 ceph-mon[22025]: rocksdb: Options.max_successive_merges: 0 2024-08-31T04:13:36.801 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:36 smithi177 ceph-mon[22025]: rocksdb: Options.optimize_filters_for_hits: 0 2024-08-31T04:13:36.801 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:36 smithi177 ceph-mon[22025]: rocksdb: Options.paranoid_file_checks: 0 2024-08-31T04:13:36.802 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:36 smithi177 ceph-mon[22025]: rocksdb: Options.force_consistency_checks: 1 2024-08-31T04:13:36.802 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:36 smithi177 ceph-mon[22025]: rocksdb: Options.report_bg_io_stats: 0 2024-08-31T04:13:36.802 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:36 smithi177 ceph-mon[22025]: rocksdb: Options.ttl: 2592000 2024-08-31T04:13:36.802 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:36 smithi177 ceph-mon[22025]: rocksdb: Options.periodic_compaction_seconds: 0 2024-08-31T04:13:36.802 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:36 smithi177 ceph-mon[22025]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-08-31T04:13:36.802 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:36 smithi177 ceph-mon[22025]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-08-31T04:13:36.802 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:36 smithi177 ceph-mon[22025]: rocksdb: Options.enable_blob_files: false 2024-08-31T04:13:36.802 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:36 smithi177 ceph-mon[22025]: rocksdb: Options.min_blob_size: 0 2024-08-31T04:13:36.802 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:36 smithi177 ceph-mon[22025]: rocksdb: Options.blob_file_size: 268435456 2024-08-31T04:13:36.802 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:36 smithi177 ceph-mon[22025]: rocksdb: Options.blob_compression_type: NoCompression 2024-08-31T04:13:36.802 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:36 smithi177 ceph-mon[22025]: rocksdb: Options.enable_blob_garbage_collection: false 2024-08-31T04:13:36.803 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:36 smithi177 ceph-mon[22025]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-08-31T04:13:36.803 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:36 smithi177 ceph-mon[22025]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-08-31T04:13:36.803 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:36 smithi177 ceph-mon[22025]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-08-31T04:13:36.803 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:36 smithi177 ceph-mon[22025]: rocksdb: Options.blob_file_starting_level: 0 2024-08-31T04:13:36.803 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:36 smithi177 ceph-mon[22025]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-08-31T04:13:36.803 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:36 smithi177 ceph-mon[22025]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 7, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-08-31T04:13:36.803 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:36 smithi177 ceph-mon[22025]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 0 2024-08-31T04:13:36.803 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:36 smithi177 ceph-mon[22025]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 92afee92-7a82-4c40-b0e0-e6336a9fbbdb 2024-08-31T04:13:36.803 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:36 smithi177 ceph-mon[22025]: rocksdb: EVENT_LOG_v1 {"time_micros": 1725077616756858, "job": 1, "event": "recovery_started", "wal_files": [4]} 2024-08-31T04:13:36.803 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:36 smithi177 ceph-mon[22025]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #4 mode 2 2024-08-31T04:13:36.803 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:36 smithi177 ceph-mon[22025]: rocksdb: EVENT_LOG_v1 {"time_micros": 1725077616757312, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 8, "file_size": 1648, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 1, "largest_seqno": 5, "table_properties": {"data_size": 523, "index_size": 31, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 401, "raw_average_value_size": 80, "num_data_blocks": 1, "num_entries": 5, "num_filter_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1725077616, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "92afee92-7a82-4c40-b0e0-e6336a9fbbdb", "db_session_id": "NVMNCL46HSEIJ3O7532V", "orig_file_number": 8, "seqno_to_time_mapping": "N/A"}} 2024-08-31T04:13:36.803 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:36 smithi177 ceph-mon[22025]: rocksdb: EVENT_LOG_v1 {"time_micros": 1725077616757408, "job": 1, "event": "recovery_finished"} 2024-08-31T04:13:36.803 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:36 smithi177 ceph-mon[22025]: rocksdb: [db/version_set.cc:5047] Creating manifest 10 2024-08-31T04:13:36.804 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:36 smithi177 ceph-mon[22025]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-c/store.db/000004.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-08-31T04:13:36.804 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:36 smithi177 ceph-mon[22025]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x55bd42508a80 2024-08-31T04:13:36.804 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:36 smithi177 ceph-mon[22025]: rocksdb: DB pointer 0x55bd432aa000 2024-08-31T04:13:36.804 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:36 smithi177 ceph-mon[22025]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-08-31T04:13:36.804 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:36 smithi177 ceph-mon[22025]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-08-31T04:13:36.804 INFO:journalctl@ceph.mon.c.smithi177.stdout: ** DB Stats ** 2024-08-31T04:13:36.804 INFO:journalctl@ceph.mon.c.smithi177.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-08-31T04:13:36.804 INFO:journalctl@ceph.mon.c.smithi177.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-08-31T04:13:36.804 INFO:journalctl@ceph.mon.c.smithi177.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-08-31T04:13:36.804 INFO:journalctl@ceph.mon.c.smithi177.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-08-31T04:13:36.804 INFO:journalctl@ceph.mon.c.smithi177.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-08-31T04:13:36.804 INFO:journalctl@ceph.mon.c.smithi177.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-08-31T04:13:36.804 INFO:journalctl@ceph.mon.c.smithi177.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-08-31T04:13:36.805 INFO:journalctl@ceph.mon.c.smithi177.stdout: 2024-08-31T04:13:36.805 INFO:journalctl@ceph.mon.c.smithi177.stdout: ** Compaction Stats [default] ** 2024-08-31T04:13:36.805 INFO:journalctl@ceph.mon.c.smithi177.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-08-31T04:13:36.805 INFO:journalctl@ceph.mon.c.smithi177.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-08-31T04:13:36.805 INFO:journalctl@ceph.mon.c.smithi177.stdout: L0 1/0 1.61 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.6 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-08-31T04:13:36.805 INFO:journalctl@ceph.mon.c.smithi177.stdout: Sum 1/0 1.61 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.6 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-08-31T04:13:36.805 INFO:journalctl@ceph.mon.c.smithi177.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.6 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-08-31T04:13:36.805 INFO:journalctl@ceph.mon.c.smithi177.stdout: 2024-08-31T04:13:36.805 INFO:journalctl@ceph.mon.c.smithi177.stdout: ** Compaction Stats [default] ** 2024-08-31T04:13:36.805 INFO:journalctl@ceph.mon.c.smithi177.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-08-31T04:13:36.805 INFO:journalctl@ceph.mon.c.smithi177.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-08-31T04:13:36.805 INFO:journalctl@ceph.mon.c.smithi177.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 3.6 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-08-31T04:13:36.805 INFO:journalctl@ceph.mon.c.smithi177.stdout: 2024-08-31T04:13:36.805 INFO:journalctl@ceph.mon.c.smithi177.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-08-31T04:13:36.806 INFO:journalctl@ceph.mon.c.smithi177.stdout: 2024-08-31T04:13:36.806 INFO:journalctl@ceph.mon.c.smithi177.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-08-31T04:13:36.806 INFO:journalctl@ceph.mon.c.smithi177.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-08-31T04:13:36.806 INFO:journalctl@ceph.mon.c.smithi177.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-08-31T04:13:36.806 INFO:journalctl@ceph.mon.c.smithi177.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-08-31T04:13:36.806 INFO:journalctl@ceph.mon.c.smithi177.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-08-31T04:13:36.806 INFO:journalctl@ceph.mon.c.smithi177.stdout: AddFile(Keys): cumulative 0, interval 0 2024-08-31T04:13:36.806 INFO:journalctl@ceph.mon.c.smithi177.stdout: Cumulative compaction: 0.00 GB write, 0.59 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-08-31T04:13:36.806 INFO:journalctl@ceph.mon.c.smithi177.stdout: Interval compaction: 0.00 GB write, 0.59 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-08-31T04:13:36.806 INFO:journalctl@ceph.mon.c.smithi177.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-08-31T04:13:36.806 INFO:journalctl@ceph.mon.c.smithi177.stdout: Block cache BinnedLRUCache@0x55bd3e4a8850#2 capacity: 512.00 MB usage: 0.23 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1e-05 secs_since: 0 2024-08-31T04:13:36.806 INFO:journalctl@ceph.mon.c.smithi177.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,0.12 KB,2.23517e-05%) IndexBlock(1,0.11 KB,2.08616e-05%) Misc(1,0.00 KB,0%) 2024-08-31T04:13:36.806 INFO:journalctl@ceph.mon.c.smithi177.stdout: 2024-08-31T04:13:36.806 INFO:journalctl@ceph.mon.c.smithi177.stdout: ** File Read Latency Histogram By Level [default] ** 2024-08-31T04:13:36.807 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:36 smithi177 ceph-mon[22025]: mon.c does not exist in monmap, will attempt to join an existing cluster 2024-08-31T04:13:36.807 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:36 smithi177 ceph-mon[22025]: using public_addr v2:172.21.15.177:0/0 -> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] 2024-08-31T04:13:36.807 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:36 smithi177 ceph-mon[22025]: starting mon.c rank -1 at public addrs [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] at bind addrs [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] mon_data /var/lib/ceph/mon/ceph-c fsid 058d9fc6-674f-11ef-bcd4-c7b262605968 2024-08-31T04:13:36.807 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:36 smithi177 ceph-mon[22025]: mon.c@-1(???) e0 preinit fsid 058d9fc6-674f-11ef-bcd4-c7b262605968 2024-08-31T04:13:36.807 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:36 smithi177 ceph-mon[22025]: mon.c@-1(synchronizing).mds e1 new map 2024-08-31T04:13:36.807 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:36 smithi177 ceph-mon[22025]: mon.c@-1(synchronizing).mds e1 print_map 2024-08-31T04:13:36.807 INFO:journalctl@ceph.mon.c.smithi177.stdout: e1 2024-08-31T04:13:36.807 INFO:journalctl@ceph.mon.c.smithi177.stdout: btime 2024-08-31T04:11:59:575880+0000 2024-08-31T04:13:36.807 INFO:journalctl@ceph.mon.c.smithi177.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-08-31T04:13:36.807 INFO:journalctl@ceph.mon.c.smithi177.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-08-31T04:13:36.807 INFO:journalctl@ceph.mon.c.smithi177.stdout: legacy client fscid: -1 2024-08-31T04:13:36.808 INFO:journalctl@ceph.mon.c.smithi177.stdout: 2024-08-31T04:13:36.808 INFO:journalctl@ceph.mon.c.smithi177.stdout: No filesystems configured 2024-08-31T04:13:36.808 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:36 smithi177 ceph-mon[22025]: mon.c@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2024-08-31T04:13:36.808 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:36 smithi177 ceph-mon[22025]: mon.c@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2024-08-31T04:13:36.808 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:36 smithi177 ceph-mon[22025]: mon.c@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2024-08-31T04:13:36.808 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:36 smithi177 ceph-mon[22025]: mon.c@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2024-08-31T04:13:36.808 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:36 smithi177 ceph-mon[22025]: mon.c@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2024-08-31T04:13:36.808 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:36 smithi177 ceph-mon[22025]: mon.c@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2024-08-31T04:13:36.808 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:36 smithi177 ceph-mon[22025]: mon.c@-1(synchronizing).osd e4 crush map has features 3314932999778484224, adjusting msgr requires 2024-08-31T04:13:36.808 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:36 smithi177 ceph-mon[22025]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-08-31T04:13:36.808 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:36 smithi177 ceph-mon[22025]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-08-31T04:13:36.809 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:36 smithi177 ceph-mon[22025]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-08-31T04:13:36.809 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:36 smithi177 ceph-mon[22025]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T04:13:36.809 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:36 smithi177 ceph-mon[22025]: from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi177", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:13:36.809 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:36 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:13:36.809 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:36 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:13:36.809 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:36 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:13:36.809 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:36 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:13:36.809 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:36 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi133", "name": "osd_memory_target"} : dispatch 2024-08-31T04:13:36.809 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:36 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:13:36.809 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:36 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T04:13:36.809 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:36 smithi177 ceph-mon[22025]: Updating smithi133:/etc/ceph/ceph.conf 2024-08-31T04:13:36.809 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:36 smithi177 ceph-mon[22025]: Updating smithi133:/var/lib/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/config/ceph.conf 2024-08-31T04:13:36.809 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:36 smithi177 ceph-mon[22025]: Updating smithi133:/etc/ceph/ceph.client.admin.keyring 2024-08-31T04:13:36.810 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:36 smithi177 ceph-mon[22025]: Updating smithi133:/var/lib/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/config/ceph.client.admin.keyring 2024-08-31T04:13:36.810 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:36 smithi177 ceph-mon[22025]: Deploying cephadm binary to smithi177 2024-08-31T04:13:36.810 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:36 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:13:36.810 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:36 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:13:36.810 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:36 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:13:36.810 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:36 smithi177 ceph-mon[22025]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T04:13:36.810 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:36 smithi177 ceph-mon[22025]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T04:13:36.810 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:36 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:13:36.810 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:36 smithi177 ceph-mon[22025]: Added host smithi177 2024-08-31T04:13:36.810 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:36 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T04:13:36.810 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:36 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:13:36.811 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:36 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:13:36.811 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:36 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:13:36.811 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:36 smithi177 ceph-mon[22025]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T04:13:36.811 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:36 smithi177 ceph-mon[22025]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-31T04:13:36.811 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:36 smithi177 ceph-mon[22025]: from='client.? 172.21.15.50:0/2013549459' entity='client.admin' cmd={"prefix": "osd crush tunables", "profile": "default"} : dispatch 2024-08-31T04:13:36.811 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:36 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:13:36.811 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:36 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:13:36.811 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:36 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:13:36.811 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:36 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:13:36.811 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:36 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi177", "name": "osd_memory_target"} : dispatch 2024-08-31T04:13:36.811 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:36 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:13:36.811 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:36 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T04:13:36.811 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:36 smithi177 ceph-mon[22025]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T04:13:36.812 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:36 smithi177 ceph-mon[22025]: Updating smithi177:/etc/ceph/ceph.conf 2024-08-31T04:13:36.812 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:36 smithi177 ceph-mon[22025]: Updating smithi177:/var/lib/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/config/ceph.conf 2024-08-31T04:13:36.812 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:36 smithi177 ceph-mon[22025]: from='client.? 172.21.15.50:0/2013549459' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-08-31T04:13:36.812 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:36 smithi177 ceph-mon[22025]: osdmap e4: 0 total, 0 up, 0 in 2024-08-31T04:13:36.812 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:36 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:13:36.812 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:36 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:13:36.812 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:36 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:13:36.812 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:36 smithi177 ceph-mon[22025]: Updating smithi177:/etc/ceph/ceph.client.admin.keyring 2024-08-31T04:13:36.812 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:36 smithi177 ceph-mon[22025]: Updating smithi177:/var/lib/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/config/ceph.client.admin.keyring 2024-08-31T04:13:36.812 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:36 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:13:36.812 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:36 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T04:13:36.812 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:36 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:13:36.812 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:36 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T04:13:36.812 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:36 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:13:36.813 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:36 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-08-31T04:13:36.813 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:36 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:13:36.813 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:36 smithi177 ceph-mon[22025]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T04:13:36.813 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:36 smithi177 ceph-mon[22025]: from='client.14188 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi050:172.21.15.50=a;smithi133:172.21.15.133=b;smithi177:172.21.15.177=c", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:13:36.813 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:36 smithi177 ceph-mon[22025]: Saving service mon spec with placement smithi050:172.21.15.50=a;smithi133:172.21.15.133=b;smithi177:172.21.15.177=c;count:3 2024-08-31T04:13:36.813 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:36 smithi177 ceph-mon[22025]: Deploying daemon mon.c on smithi177 2024-08-31T04:13:36.813 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:36 smithi177 ceph-mon[22025]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T04:13:36.813 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:36 smithi177 ceph-mon[22025]: from='client.? 172.21.15.177:0/673538866' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-08-31T04:13:36.813 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:36 smithi177 ceph-mon[22025]: mon.c@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2024-08-31T04:13:37.246 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:36 smithi177 bash[22005]: 30c7409d7a61c5fc8bfff2a8575f9333017ec765756e4acab6ad62bb1721ae69 2024-08-31T04:13:37.246 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:36 smithi177 systemd[1]: Started Ceph mon.c for 058d9fc6-674f-11ef-bcd4-c7b262605968. 2024-08-31T04:13:37.248 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-08-31T04:13:37.248 DEBUG:teuthology.orchestra.run.smithi177:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 058d9fc6-674f-11ef-bcd4-c7b262605968 -- ceph mon dump -f json 2024-08-31T04:13:37.500 INFO:teuthology.orchestra.run.smithi177.stderr:Inferring config /var/lib/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/mon.c/config 2024-08-31T04:13:42.107 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:13:41 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-08-31T04:13:42.107 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:13:41 smithi050 ceph-mon[17259]: mon.a calling monitor election 2024-08-31T04:13:42.107 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:13:41 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-08-31T04:13:42.107 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:13:41 smithi050 ceph-mon[17259]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T04:13:42.108 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:13:41 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-08-31T04:13:42.108 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:13:41 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-08-31T04:13:42.108 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:13:41 smithi050 ceph-mon[17259]: mon.c calling monitor election 2024-08-31T04:13:42.108 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:13:41 smithi050 ceph-mon[17259]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T04:13:42.108 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:13:41 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-08-31T04:13:42.108 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:13:41 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-08-31T04:13:42.108 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:13:41 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-08-31T04:13:42.108 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:13:41 smithi050 ceph-mon[17259]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-08-31T04:13:42.108 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:13:41 smithi050 ceph-mon[17259]: monmap epoch 2 2024-08-31T04:13:42.108 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:13:41 smithi050 ceph-mon[17259]: fsid 058d9fc6-674f-11ef-bcd4-c7b262605968 2024-08-31T04:13:42.108 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:13:41 smithi050 ceph-mon[17259]: last_changed 2024-08-31T04:13:36.788830+0000 2024-08-31T04:13:42.108 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:13:41 smithi050 ceph-mon[17259]: created 2024-08-31T04:11:55.731580+0000 2024-08-31T04:13:42.108 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:13:41 smithi050 ceph-mon[17259]: min_mon_release 19 (squid) 2024-08-31T04:13:42.108 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:13:41 smithi050 ceph-mon[17259]: election_strategy: 1 2024-08-31T04:13:42.109 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:13:41 smithi050 ceph-mon[17259]: 0: [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] mon.a 2024-08-31T04:13:42.109 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:13:41 smithi050 ceph-mon[17259]: 1: [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] mon.c 2024-08-31T04:13:42.109 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:13:41 smithi050 ceph-mon[17259]: fsmap 2024-08-31T04:13:42.109 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:13:41 smithi050 ceph-mon[17259]: osdmap e4: 0 total, 0 up, 0 in 2024-08-31T04:13:42.109 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:13:41 smithi050 ceph-mon[17259]: mgrmap e13: x(active, since 46s) 2024-08-31T04:13:42.109 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:13:41 smithi050 ceph-mon[17259]: overall HEALTH_OK 2024-08-31T04:13:42.109 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:13:41 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:13:42.109 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:13:41 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:13:42.109 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:13:41 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:13:42.109 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:13:41 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-08-31T04:13:42.109 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:13:41 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:13:42.246 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:41 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-08-31T04:13:42.246 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:41 smithi177 ceph-mon[22025]: mon.a calling monitor election 2024-08-31T04:13:42.247 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:41 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-08-31T04:13:42.247 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:41 smithi177 ceph-mon[22025]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T04:13:42.247 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:41 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-08-31T04:13:42.247 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:41 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-08-31T04:13:42.247 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:41 smithi177 ceph-mon[22025]: mon.c calling monitor election 2024-08-31T04:13:42.247 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:41 smithi177 ceph-mon[22025]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T04:13:42.247 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:41 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-08-31T04:13:42.247 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:41 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-08-31T04:13:42.247 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:41 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-08-31T04:13:42.247 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:41 smithi177 ceph-mon[22025]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-08-31T04:13:42.247 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:41 smithi177 ceph-mon[22025]: monmap epoch 2 2024-08-31T04:13:42.247 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:41 smithi177 ceph-mon[22025]: fsid 058d9fc6-674f-11ef-bcd4-c7b262605968 2024-08-31T04:13:42.248 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:41 smithi177 ceph-mon[22025]: last_changed 2024-08-31T04:13:36.788830+0000 2024-08-31T04:13:42.248 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:41 smithi177 ceph-mon[22025]: created 2024-08-31T04:11:55.731580+0000 2024-08-31T04:13:42.248 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:41 smithi177 ceph-mon[22025]: min_mon_release 19 (squid) 2024-08-31T04:13:42.248 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:41 smithi177 ceph-mon[22025]: election_strategy: 1 2024-08-31T04:13:42.248 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:41 smithi177 ceph-mon[22025]: 0: [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] mon.a 2024-08-31T04:13:42.248 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:41 smithi177 ceph-mon[22025]: 1: [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] mon.c 2024-08-31T04:13:42.248 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:41 smithi177 ceph-mon[22025]: fsmap 2024-08-31T04:13:42.248 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:41 smithi177 ceph-mon[22025]: osdmap e4: 0 total, 0 up, 0 in 2024-08-31T04:13:42.248 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:41 smithi177 ceph-mon[22025]: mgrmap e13: x(active, since 46s) 2024-08-31T04:13:42.248 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:41 smithi177 ceph-mon[22025]: overall HEALTH_OK 2024-08-31T04:13:42.248 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:41 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:13:42.248 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:41 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:13:42.248 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:41 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:13:42.248 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:41 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-08-31T04:13:42.249 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:41 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:13:42.573 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-08-31T04:13:42.574 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":2,"fsid":"058d9fc6-674f-11ef-bcd4-c7b262605968","modified":"2024-08-31T04:13:36.788830Z","created":"2024-08-31T04:11:55.731580Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:3300","nonce":0},{"type":"v1","addr":"172.21.15.50:6789","nonce":0}]},"addr":"172.21.15.50:6789/0","public_addr":"172.21.15.50:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:3300","nonce":0},{"type":"v1","addr":"172.21.15.177:6789","nonce":0}]},"addr":"172.21.15.177:6789/0","public_addr":"172.21.15.177:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-08-31T04:13:42.574 INFO:teuthology.orchestra.run.smithi177.stderr:dumped monmap epoch 2 2024-08-31T04:13:43.125 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:13:42 smithi050 ceph-mon[17259]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T04:13:43.125 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:13:42 smithi050 ceph-mon[17259]: Deploying daemon mon.b on smithi133 2024-08-31T04:13:43.125 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:13:42 smithi050 ceph-mon[17259]: from='client.? 172.21.15.177:0/974722940' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-08-31T04:13:43.125 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:13:42 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-08-31T04:13:43.246 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:42 smithi177 ceph-mon[22025]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T04:13:43.246 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:42 smithi177 ceph-mon[22025]: Deploying daemon mon.b on smithi133 2024-08-31T04:13:43.246 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:42 smithi177 ceph-mon[22025]: from='client.? 172.21.15.177:0/974722940' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-08-31T04:13:43.246 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:42 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-08-31T04:13:44.065 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-08-31T04:13:44.065 DEBUG:teuthology.orchestra.run.smithi177:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 058d9fc6-674f-11ef-bcd4-c7b262605968 -- ceph mon dump -f json 2024-08-31T04:13:44.319 INFO:teuthology.orchestra.run.smithi177.stderr:Inferring config /var/lib/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/mon.c/config 2024-08-31T04:13:44.950 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:13:44 smithi050 ceph-mon[17259]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T04:13:44.994 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-08-31T04:13:44.994 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":2,"fsid":"058d9fc6-674f-11ef-bcd4-c7b262605968","modified":"2024-08-31T04:13:36.788830Z","created":"2024-08-31T04:11:55.731580Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:3300","nonce":0},{"type":"v1","addr":"172.21.15.50:6789","nonce":0}]},"addr":"172.21.15.50:6789/0","public_addr":"172.21.15.50:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:3300","nonce":0},{"type":"v1","addr":"172.21.15.177:6789","nonce":0}]},"addr":"172.21.15.177:6789/0","public_addr":"172.21.15.177:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-08-31T04:13:44.994 INFO:teuthology.orchestra.run.smithi177.stderr:dumped monmap epoch 2 2024-08-31T04:13:44.995 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:44 smithi177 ceph-mon[22025]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T04:13:46.043 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:13:45 smithi133 systemd[1]: Started Ceph mon.b for 058d9fc6-674f-11ef-bcd4-c7b262605968. 2024-08-31T04:13:46.547 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-08-31T04:13:46.547 DEBUG:teuthology.orchestra.run.smithi177:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 058d9fc6-674f-11ef-bcd4-c7b262605968 -- ceph mon dump -f json 2024-08-31T04:13:46.797 INFO:teuthology.orchestra.run.smithi177.stderr:Inferring config /var/lib/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/mon.c/config 2024-08-31T04:13:51.043 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:13:50 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-08-31T04:13:51.043 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:13:50 smithi133 ceph-mon[22177]: mon.a calling monitor election 2024-08-31T04:13:51.043 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:13:50 smithi133 ceph-mon[22177]: mon.c calling monitor election 2024-08-31T04:13:51.043 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:13:50 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-08-31T04:13:51.044 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:13:50 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-08-31T04:13:51.044 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:13:50 smithi133 ceph-mon[22177]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T04:13:51.044 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:13:50 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-08-31T04:13:51.044 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:13:50 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-08-31T04:13:51.044 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:13:50 smithi133 ceph-mon[22177]: mon.b calling monitor election 2024-08-31T04:13:51.044 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:13:50 smithi133 ceph-mon[22177]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T04:13:51.044 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:13:50 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-08-31T04:13:51.044 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:13:50 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-08-31T04:13:51.044 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:13:50 smithi133 ceph-mon[22177]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T04:13:51.044 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:13:50 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-08-31T04:13:51.044 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:13:50 smithi133 ceph-mon[22177]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-08-31T04:13:51.044 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:13:50 smithi133 ceph-mon[22177]: monmap epoch 3 2024-08-31T04:13:51.045 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:13:50 smithi133 ceph-mon[22177]: fsid 058d9fc6-674f-11ef-bcd4-c7b262605968 2024-08-31T04:13:51.045 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:13:50 smithi133 ceph-mon[22177]: last_changed 2024-08-31T04:13:45.694226+0000 2024-08-31T04:13:51.045 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:13:50 smithi133 ceph-mon[22177]: created 2024-08-31T04:11:55.731580+0000 2024-08-31T04:13:51.045 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:13:50 smithi133 ceph-mon[22177]: min_mon_release 19 (squid) 2024-08-31T04:13:51.045 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:13:50 smithi133 ceph-mon[22177]: election_strategy: 1 2024-08-31T04:13:51.045 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:13:50 smithi133 ceph-mon[22177]: 0: [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] mon.a 2024-08-31T04:13:51.045 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:13:50 smithi133 ceph-mon[22177]: 1: [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] mon.c 2024-08-31T04:13:51.045 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:13:50 smithi133 ceph-mon[22177]: 2: [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] mon.b 2024-08-31T04:13:51.045 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:13:50 smithi133 ceph-mon[22177]: fsmap 2024-08-31T04:13:51.045 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:13:50 smithi133 ceph-mon[22177]: osdmap e4: 0 total, 0 up, 0 in 2024-08-31T04:13:51.045 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:13:50 smithi133 ceph-mon[22177]: mgrmap e13: x(active, since 54s) 2024-08-31T04:13:51.045 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:13:50 smithi133 ceph-mon[22177]: overall HEALTH_OK 2024-08-31T04:13:51.045 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:13:50 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:13:51.046 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:13:50 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:13:51.046 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:13:50 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:13:51.046 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:13:50 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:13:51.068 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-08-31T04:13:51.068 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":3,"fsid":"058d9fc6-674f-11ef-bcd4-c7b262605968","modified":"2024-08-31T04:13:45.694226Z","created":"2024-08-31T04:11:55.731580Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:3300","nonce":0},{"type":"v1","addr":"172.21.15.50:6789","nonce":0}]},"addr":"172.21.15.50:6789/0","public_addr":"172.21.15.50:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:3300","nonce":0},{"type":"v1","addr":"172.21.15.177:6789","nonce":0}]},"addr":"172.21.15.177:6789/0","public_addr":"172.21.15.177:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:3300","nonce":0},{"type":"v1","addr":"172.21.15.133:6789","nonce":0}]},"addr":"172.21.15.133:6789/0","public_addr":"172.21.15.133:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1,2]} 2024-08-31T04:13:51.068 INFO:teuthology.orchestra.run.smithi177.stderr:dumped monmap epoch 3 2024-08-31T04:13:51.068 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:50 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-08-31T04:13:51.069 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:50 smithi177 ceph-mon[22025]: mon.a calling monitor election 2024-08-31T04:13:51.069 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:50 smithi177 ceph-mon[22025]: mon.c calling monitor election 2024-08-31T04:13:51.069 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:50 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-08-31T04:13:51.069 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:50 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-08-31T04:13:51.069 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:50 smithi177 ceph-mon[22025]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T04:13:51.069 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:50 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-08-31T04:13:51.069 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:50 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-08-31T04:13:51.069 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:50 smithi177 ceph-mon[22025]: mon.b calling monitor election 2024-08-31T04:13:51.069 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:50 smithi177 ceph-mon[22025]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T04:13:51.069 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:50 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-08-31T04:13:51.069 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:50 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-08-31T04:13:51.069 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:50 smithi177 ceph-mon[22025]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T04:13:51.069 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:50 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-08-31T04:13:51.069 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:50 smithi177 ceph-mon[22025]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-08-31T04:13:51.070 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:50 smithi177 ceph-mon[22025]: monmap epoch 3 2024-08-31T04:13:51.070 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:50 smithi177 ceph-mon[22025]: fsid 058d9fc6-674f-11ef-bcd4-c7b262605968 2024-08-31T04:13:51.070 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:50 smithi177 ceph-mon[22025]: last_changed 2024-08-31T04:13:45.694226+0000 2024-08-31T04:13:51.070 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:50 smithi177 ceph-mon[22025]: created 2024-08-31T04:11:55.731580+0000 2024-08-31T04:13:51.070 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:50 smithi177 ceph-mon[22025]: min_mon_release 19 (squid) 2024-08-31T04:13:51.070 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:50 smithi177 ceph-mon[22025]: election_strategy: 1 2024-08-31T04:13:51.070 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:50 smithi177 ceph-mon[22025]: 0: [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] mon.a 2024-08-31T04:13:51.070 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:50 smithi177 ceph-mon[22025]: 1: [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] mon.c 2024-08-31T04:13:51.070 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:50 smithi177 ceph-mon[22025]: 2: [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] mon.b 2024-08-31T04:13:51.070 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:50 smithi177 ceph-mon[22025]: fsmap 2024-08-31T04:13:51.070 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:50 smithi177 ceph-mon[22025]: osdmap e4: 0 total, 0 up, 0 in 2024-08-31T04:13:51.070 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:50 smithi177 ceph-mon[22025]: mgrmap e13: x(active, since 54s) 2024-08-31T04:13:51.070 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:50 smithi177 ceph-mon[22025]: overall HEALTH_OK 2024-08-31T04:13:51.070 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:50 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:13:51.070 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:50 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:13:51.071 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:50 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:13:51.071 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:50 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:13:51.200 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:13:50 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-08-31T04:13:51.200 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:13:50 smithi050 ceph-mon[17259]: mon.a calling monitor election 2024-08-31T04:13:51.200 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:13:50 smithi050 ceph-mon[17259]: mon.c calling monitor election 2024-08-31T04:13:51.200 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:13:50 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-08-31T04:13:51.200 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:13:50 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-08-31T04:13:51.200 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:13:50 smithi050 ceph-mon[17259]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T04:13:51.200 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:13:50 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-08-31T04:13:51.201 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:13:50 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-08-31T04:13:51.201 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:13:50 smithi050 ceph-mon[17259]: mon.b calling monitor election 2024-08-31T04:13:51.201 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:13:50 smithi050 ceph-mon[17259]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T04:13:51.201 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:13:50 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-08-31T04:13:51.201 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:13:50 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-08-31T04:13:51.201 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:13:50 smithi050 ceph-mon[17259]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T04:13:51.201 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:13:50 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-08-31T04:13:51.201 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:13:50 smithi050 ceph-mon[17259]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-08-31T04:13:51.201 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:13:50 smithi050 ceph-mon[17259]: monmap epoch 3 2024-08-31T04:13:51.201 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:13:50 smithi050 ceph-mon[17259]: fsid 058d9fc6-674f-11ef-bcd4-c7b262605968 2024-08-31T04:13:51.201 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:13:50 smithi050 ceph-mon[17259]: last_changed 2024-08-31T04:13:45.694226+0000 2024-08-31T04:13:51.201 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:13:50 smithi050 ceph-mon[17259]: created 2024-08-31T04:11:55.731580+0000 2024-08-31T04:13:51.201 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:13:50 smithi050 ceph-mon[17259]: min_mon_release 19 (squid) 2024-08-31T04:13:51.201 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:13:50 smithi050 ceph-mon[17259]: election_strategy: 1 2024-08-31T04:13:51.201 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:13:50 smithi050 ceph-mon[17259]: 0: [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] mon.a 2024-08-31T04:13:51.202 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:13:50 smithi050 ceph-mon[17259]: 1: [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] mon.c 2024-08-31T04:13:51.202 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:13:50 smithi050 ceph-mon[17259]: 2: [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] mon.b 2024-08-31T04:13:51.202 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:13:50 smithi050 ceph-mon[17259]: fsmap 2024-08-31T04:13:51.202 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:13:50 smithi050 ceph-mon[17259]: osdmap e4: 0 total, 0 up, 0 in 2024-08-31T04:13:51.202 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:13:50 smithi050 ceph-mon[17259]: mgrmap e13: x(active, since 54s) 2024-08-31T04:13:51.202 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:13:50 smithi050 ceph-mon[17259]: overall HEALTH_OK 2024-08-31T04:13:51.202 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:13:50 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:13:51.202 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:13:50 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:13:51.202 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:13:50 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:13:51.202 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:13:50 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:13:51.669 INFO:tasks.cephadm:Generating final ceph.conf file... 2024-08-31T04:13:51.669 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 058d9fc6-674f-11ef-bcd4-c7b262605968 -- ceph config generate-minimal-conf 2024-08-31T04:13:51.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:13:51 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T04:13:51.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:13:51 smithi133 ceph-mon[22177]: from='client.? 172.21.15.177:0/3211059543' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-08-31T04:13:51.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:13:51 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:13:51.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:13:51 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-08-31T04:13:51.992 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:51 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T04:13:51.993 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:51 smithi177 ceph-mon[22025]: from='client.? 172.21.15.177:0/3211059543' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-08-31T04:13:51.993 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:51 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:13:51.993 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:51 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-08-31T04:13:52.051 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:13:52.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:13:51 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T04:13:52.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:13:51 smithi050 ceph-mon[17259]: from='client.? 172.21.15.177:0/3211059543' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-08-31T04:13:52.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:13:51 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:13:52.190 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:13:51 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-08-31T04:13:52.711 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Aug 31 04:13:52 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-mgr-x[17482]: 2024-08-31T04:13:52.693+0000 7f12fbc00640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-08-31T04:13:53.029 INFO:teuthology.orchestra.run.smithi050.stdout:# minimal ceph.conf for 058d9fc6-674f-11ef-bcd4-c7b262605968 2024-08-31T04:13:53.030 INFO:teuthology.orchestra.run.smithi050.stdout:[global] 2024-08-31T04:13:53.030 INFO:teuthology.orchestra.run.smithi050.stdout: fsid = 058d9fc6-674f-11ef-bcd4-c7b262605968 2024-08-31T04:13:53.030 INFO:teuthology.orchestra.run.smithi050.stdout: mon_host = [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] 2024-08-31T04:13:53.030 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:13:52 smithi050 ceph-mon[17259]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T04:13:53.030 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:13:52 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:13:53.030 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:13:52 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:13:53.030 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:13:52 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:13:53.030 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:13:52 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:13:53.030 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:13:52 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:13:53.030 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:13:52 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T04:13:53.031 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:13:52 smithi050 ceph-mon[17259]: Updating smithi050:/etc/ceph/ceph.conf 2024-08-31T04:13:53.031 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:13:52 smithi050 ceph-mon[17259]: Updating smithi133:/etc/ceph/ceph.conf 2024-08-31T04:13:53.031 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:13:52 smithi050 ceph-mon[17259]: Updating smithi177:/etc/ceph/ceph.conf 2024-08-31T04:13:53.246 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:52 smithi177 ceph-mon[22025]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T04:13:53.246 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:52 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:13:53.246 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:52 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:13:53.246 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:52 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:13:53.246 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:52 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:13:53.246 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:52 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:13:53.246 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:52 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T04:13:53.246 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:52 smithi177 ceph-mon[22025]: Updating smithi050:/etc/ceph/ceph.conf 2024-08-31T04:13:53.246 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:52 smithi177 ceph-mon[22025]: Updating smithi133:/etc/ceph/ceph.conf 2024-08-31T04:13:53.246 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:52 smithi177 ceph-mon[22025]: Updating smithi177:/etc/ceph/ceph.conf 2024-08-31T04:13:53.293 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:13:52 smithi133 ceph-mon[22177]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T04:13:53.293 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:13:52 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:13:53.293 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:13:52 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:13:53.293 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:13:52 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:13:53.293 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:13:52 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:13:53.293 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:13:52 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:13:53.293 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:13:52 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T04:13:53.293 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:13:52 smithi133 ceph-mon[22177]: Updating smithi050:/etc/ceph/ceph.conf 2024-08-31T04:13:53.293 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:13:52 smithi133 ceph-mon[22177]: Updating smithi133:/etc/ceph/ceph.conf 2024-08-31T04:13:53.293 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:13:52 smithi133 ceph-mon[22177]: Updating smithi177:/etc/ceph/ceph.conf 2024-08-31T04:13:53.728 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2024-08-31T04:13:53.728 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-08-31T04:13:53.728 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd of=/etc/ceph/ceph.conf 2024-08-31T04:13:53.788 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-08-31T04:13:53.788 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-08-31T04:13:53.884 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2024-08-31T04:13:53.884 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd of=/etc/ceph/ceph.conf 2024-08-31T04:13:53.912 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2024-08-31T04:13:53.912 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-08-31T04:13:53.977 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2024-08-31T04:13:53.977 DEBUG:teuthology.orchestra.run.smithi177:> sudo dd of=/etc/ceph/ceph.conf 2024-08-31T04:13:54.008 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2024-08-31T04:13:54.008 DEBUG:teuthology.orchestra.run.smithi177:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-08-31T04:13:54.075 INFO:tasks.cephadm:Adding mgr.x on smithi050 2024-08-31T04:13:54.076 INFO:tasks.cephadm:Adding mgr.y on smithi133 2024-08-31T04:13:54.076 INFO:tasks.cephadm:Adding mgr.z on smithi177 2024-08-31T04:13:54.076 DEBUG:teuthology.orchestra.run.smithi177:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 058d9fc6-674f-11ef-bcd4-c7b262605968 -- ceph orch apply mgr '3;smithi050=x;smithi133=y;smithi177=z' 2024-08-31T04:13:54.246 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:53 smithi177 ceph-mon[22025]: Updating smithi177:/var/lib/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/config/ceph.conf 2024-08-31T04:13:54.246 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:53 smithi177 ceph-mon[22025]: Updating smithi133:/var/lib/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/config/ceph.conf 2024-08-31T04:13:54.246 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:53 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:13:54.246 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:53 smithi177 ceph-mon[22025]: Updating smithi050:/var/lib/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/config/ceph.conf 2024-08-31T04:13:54.246 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:53 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:13:54.246 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:53 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:13:54.246 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:53 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:13:54.246 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:53 smithi177 ceph-mon[22025]: from='client.? 172.21.15.50:0/2655988189' entity='client.admin' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:13:54.246 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:53 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:13:54.246 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:53 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:13:54.247 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:53 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:13:54.247 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:53 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:13:54.247 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:53 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:13:54.247 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:53 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:13:54.247 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:53 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:13:54.247 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:53 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-08-31T04:13:54.247 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:53 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-08-31T04:13:54.247 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:53 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:13:54.293 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:13:53 smithi133 ceph-mon[22177]: Updating smithi177:/var/lib/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/config/ceph.conf 2024-08-31T04:13:54.293 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:13:53 smithi133 ceph-mon[22177]: Updating smithi133:/var/lib/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/config/ceph.conf 2024-08-31T04:13:54.293 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:13:53 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:13:54.293 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:13:53 smithi133 ceph-mon[22177]: Updating smithi050:/var/lib/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/config/ceph.conf 2024-08-31T04:13:54.293 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:13:53 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:13:54.293 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:13:53 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:13:54.293 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:13:53 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:13:54.293 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:13:53 smithi133 ceph-mon[22177]: from='client.? 172.21.15.50:0/2655988189' entity='client.admin' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:13:54.293 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:13:53 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:13:54.293 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:13:53 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:13:54.293 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:13:53 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:13:54.293 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:13:53 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:13:54.294 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:13:53 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:13:54.294 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:13:53 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:13:54.294 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:13:53 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:13:54.294 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:13:53 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-08-31T04:13:54.294 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:13:53 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-08-31T04:13:54.294 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:13:53 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:13:54.295 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:13:53 smithi050 ceph-mon[17259]: Updating smithi177:/var/lib/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/config/ceph.conf 2024-08-31T04:13:54.295 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:13:53 smithi050 ceph-mon[17259]: Updating smithi133:/var/lib/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/config/ceph.conf 2024-08-31T04:13:54.296 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:13:53 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:13:54.296 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:13:53 smithi050 ceph-mon[17259]: Updating smithi050:/var/lib/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/config/ceph.conf 2024-08-31T04:13:54.296 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:13:53 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:13:54.296 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:13:53 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:13:54.296 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:13:53 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:13:54.296 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:13:53 smithi050 ceph-mon[17259]: from='client.? 172.21.15.50:0/2655988189' entity='client.admin' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:13:54.296 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:13:53 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:13:54.296 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:13:53 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:13:54.296 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:13:53 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:13:54.296 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:13:53 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:13:54.296 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:13:53 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:13:54.296 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:13:53 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:13:54.296 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:13:53 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:13:54.296 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:13:53 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-08-31T04:13:54.297 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:13:53 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-08-31T04:13:54.297 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:13:53 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:13:54.357 INFO:teuthology.orchestra.run.smithi177.stderr:Inferring config /var/lib/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/mon.c/config 2024-08-31T04:13:55.012 INFO:teuthology.orchestra.run.smithi177.stdout:Scheduled mgr update... 2024-08-31T04:13:55.131 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:13:54 smithi050 ceph-mon[17259]: Reconfiguring mon.a (unknown last config time)... 2024-08-31T04:13:55.132 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:13:54 smithi050 ceph-mon[17259]: Reconfiguring daemon mon.a on smithi050 2024-08-31T04:13:55.132 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:13:54 smithi050 ceph-mon[17259]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T04:13:55.246 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:54 smithi177 ceph-mon[22025]: Reconfiguring mon.a (unknown last config time)... 2024-08-31T04:13:55.246 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:54 smithi177 ceph-mon[22025]: Reconfiguring daemon mon.a on smithi050 2024-08-31T04:13:55.246 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:54 smithi177 ceph-mon[22025]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T04:13:55.292 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:13:54 smithi133 ceph-mon[22177]: Reconfiguring mon.a (unknown last config time)... 2024-08-31T04:13:55.293 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:13:54 smithi133 ceph-mon[22177]: Reconfiguring daemon mon.a on smithi050 2024-08-31T04:13:55.293 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:13:54 smithi133 ceph-mon[22177]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T04:13:55.586 DEBUG:teuthology.orchestra.run.smithi133:mgr.y> sudo journalctl -f -n 0 -u ceph-058d9fc6-674f-11ef-bcd4-c7b262605968@mgr.y.service 2024-08-31T04:13:55.589 DEBUG:teuthology.orchestra.run.smithi177:mgr.z> sudo journalctl -f -n 0 -u ceph-058d9fc6-674f-11ef-bcd4-c7b262605968@mgr.z.service 2024-08-31T04:13:55.592 INFO:tasks.cephadm:setting config [client] client_mount_timeout = 600 2024-08-31T04:13:55.592 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 058d9fc6-674f-11ef-bcd4-c7b262605968 -- ceph config set client client_mount_timeout 600 2024-08-31T04:13:55.597 INFO:tasks.cephadm:setting config [client] debug_client = 20 2024-08-31T04:13:55.597 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 058d9fc6-674f-11ef-bcd4-c7b262605968 -- ceph config set client debug_client 20 2024-08-31T04:13:55.643 INFO:tasks.cephadm:setting config [client] debug_ms = 1 2024-08-31T04:13:55.643 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 058d9fc6-674f-11ef-bcd4-c7b262605968 -- ceph config set client debug_ms 1 2024-08-31T04:13:55.689 INFO:tasks.cephadm:setting config [client] rados_mon_op_timeout = 900 2024-08-31T04:13:55.689 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 058d9fc6-674f-11ef-bcd4-c7b262605968 -- ceph config set client rados_mon_op_timeout 900 2024-08-31T04:13:55.737 INFO:tasks.cephadm:setting config [client] rados_osd_op_timeout = 900 2024-08-31T04:13:55.737 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 058d9fc6-674f-11ef-bcd4-c7b262605968 -- ceph config set client rados_osd_op_timeout 900 2024-08-31T04:13:55.784 INFO:tasks.cephadm:setting config [mds] debug_mds = 20 2024-08-31T04:13:55.784 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 058d9fc6-674f-11ef-bcd4-c7b262605968 -- ceph config set mds debug_mds 20 2024-08-31T04:13:55.831 INFO:tasks.cephadm:setting config [mds] debug_mds_balancer = 20 2024-08-31T04:13:55.831 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 058d9fc6-674f-11ef-bcd4-c7b262605968 -- ceph config set mds debug_mds_balancer 20 2024-08-31T04:13:55.879 INFO:tasks.cephadm:setting config [mds] debug_ms = 2 2024-08-31T04:13:55.879 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 058d9fc6-674f-11ef-bcd4-c7b262605968 -- ceph config set mds debug_ms 2 2024-08-31T04:13:55.933 INFO:tasks.cephadm:setting config [mds] mds_bal_fragment_size_max = 10000 2024-08-31T04:13:55.933 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 058d9fc6-674f-11ef-bcd4-c7b262605968 -- ceph config set mds mds_bal_fragment_size_max 10000 2024-08-31T04:13:55.985 INFO:tasks.cephadm:setting config [mds] mds_bal_merge_size = 5 2024-08-31T04:13:55.985 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 058d9fc6-674f-11ef-bcd4-c7b262605968 -- ceph config set mds mds_bal_merge_size 5 2024-08-31T04:13:56.037 INFO:tasks.cephadm:setting config [mds] mds_bal_split_bits = 3 2024-08-31T04:13:56.037 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 058d9fc6-674f-11ef-bcd4-c7b262605968 -- ceph config set mds mds_bal_split_bits 3 2024-08-31T04:13:56.089 INFO:tasks.cephadm:setting config [mds] mds_bal_split_size = 100 2024-08-31T04:13:56.089 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 058d9fc6-674f-11ef-bcd4-c7b262605968 -- ceph config set mds mds_bal_split_size 100 2024-08-31T04:13:56.102 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:13:56 smithi050 ceph-mon[17259]: from='client.24103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi050=x;smithi133=y;smithi177=z", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:13:56.102 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:13:56 smithi050 ceph-mon[17259]: Saving service mgr spec with placement smithi050=x;smithi133=y;smithi177=z;count:3 2024-08-31T04:13:56.103 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:13:56 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:13:56.103 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:13:56 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:13:56.103 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:13:56 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:13:56.103 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:13:56 smithi050 ceph-mon[17259]: Reconfiguring mgr.x (unknown last config time)... 2024-08-31T04:13:56.103 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:13:56 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-08-31T04:13:56.103 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:13:56 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-08-31T04:13:56.103 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:13:56 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:13:56.103 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:13:56 smithi050 ceph-mon[17259]: Reconfiguring daemon mgr.x on smithi050 2024-08-31T04:13:56.115 INFO:tasks.cephadm:setting config [mds] mds_debug_frag = True 2024-08-31T04:13:56.115 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 058d9fc6-674f-11ef-bcd4-c7b262605968 -- ceph config set mds mds_debug_frag True 2024-08-31T04:13:56.171 INFO:tasks.cephadm:setting config [mds] mds_debug_scatterstat = True 2024-08-31T04:13:56.171 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 058d9fc6-674f-11ef-bcd4-c7b262605968 -- ceph config set mds mds_debug_scatterstat True 2024-08-31T04:13:56.229 INFO:tasks.cephadm:setting config [mds] mds_op_complaint_time = 180 2024-08-31T04:13:56.229 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 058d9fc6-674f-11ef-bcd4-c7b262605968 -- ceph config set mds mds_op_complaint_time 180 2024-08-31T04:13:56.291 INFO:tasks.cephadm:setting config [mds] mds_verify_scatter = True 2024-08-31T04:13:56.291 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 058d9fc6-674f-11ef-bcd4-c7b262605968 -- ceph config set mds mds_verify_scatter True 2024-08-31T04:13:56.293 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:13:56 smithi133 ceph-mon[22177]: from='client.24103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi050=x;smithi133=y;smithi177=z", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:13:56.293 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:13:56 smithi133 ceph-mon[22177]: Saving service mgr spec with placement smithi050=x;smithi133=y;smithi177=z;count:3 2024-08-31T04:13:56.293 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:13:56 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:13:56.293 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:13:56 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:13:56.293 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:13:56 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:13:56.293 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:13:56 smithi133 ceph-mon[22177]: Reconfiguring mgr.x (unknown last config time)... 2024-08-31T04:13:56.293 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:13:56 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-08-31T04:13:56.293 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:13:56 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-08-31T04:13:56.293 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:13:56 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:13:56.293 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:13:56 smithi133 ceph-mon[22177]: Reconfiguring daemon mgr.x on smithi050 2024-08-31T04:13:56.342 INFO:tasks.cephadm:setting config [mds] osd_op_complaint_time = 180 2024-08-31T04:13:56.342 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 058d9fc6-674f-11ef-bcd4-c7b262605968 -- ceph config set mds osd_op_complaint_time 180 2024-08-31T04:13:56.398 INFO:tasks.cephadm:setting config [mds] rados_mon_op_timeout = 900 2024-08-31T04:13:56.398 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 058d9fc6-674f-11ef-bcd4-c7b262605968 -- ceph config set mds rados_mon_op_timeout 900 2024-08-31T04:13:56.459 INFO:tasks.cephadm:setting config [mds] rados_osd_op_timeout = 900 2024-08-31T04:13:56.459 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 058d9fc6-674f-11ef-bcd4-c7b262605968 -- ceph config set mds rados_osd_op_timeout 900 2024-08-31T04:13:56.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:56 smithi177 ceph-mon[22025]: from='client.24103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi050=x;smithi133=y;smithi177=z", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:13:56.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:56 smithi177 ceph-mon[22025]: Saving service mgr spec with placement smithi050=x;smithi133=y;smithi177=z;count:3 2024-08-31T04:13:56.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:56 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:13:56.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:56 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:13:56.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:56 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:13:56.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:56 smithi177 ceph-mon[22025]: Reconfiguring mgr.x (unknown last config time)... 2024-08-31T04:13:56.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:56 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-08-31T04:13:56.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:56 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-08-31T04:13:56.497 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:56 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:13:56.497 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:56 smithi177 ceph-mon[22025]: Reconfiguring daemon mgr.x on smithi050 2024-08-31T04:13:56.514 INFO:tasks.cephadm:setting config [mon] mon_op_complaint_time = 120 2024-08-31T04:13:56.514 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 058d9fc6-674f-11ef-bcd4-c7b262605968 -- ceph config set mon mon_op_complaint_time 120 2024-08-31T04:13:56.568 INFO:tasks.cephadm:setting config [mon] mon_warn_on_pool_no_app = False 2024-08-31T04:13:56.568 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 058d9fc6-674f-11ef-bcd4-c7b262605968 -- ceph config set mon mon_warn_on_pool_no_app False 2024-08-31T04:13:56.633 INFO:tasks.cephadm:setting config [osd] osd_op_complaint_time = 180 2024-08-31T04:13:56.633 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 058d9fc6-674f-11ef-bcd4-c7b262605968 -- ceph config set osd osd_op_complaint_time 180 2024-08-31T04:13:56.701 DEBUG:tasks.cephadm:set 22 configs 2024-08-31T04:13:56.701 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '058d9fc6-674f-11ef-bcd4-c7b262605968', '--', 'ceph', 'config', 'set', 'client', 'client_mount_timeout', '600'], check_status=True, hostname='smithi050') 2024-08-31T04:13:57.384 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:13:57.451 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:13:57.451 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:13:57 smithi050 ceph-mon[17259]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T04:13:57.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:57 smithi177 ceph-mon[22025]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T04:13:57.542 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:13:57 smithi133 ceph-mon[22177]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T04:13:58.161 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:13:58.169 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:13:58.175 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:13:58.186 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:13:58.359 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:13:58.359 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:13:58.389 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:13:58.680 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:13:58 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:13:58.680 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:13:58 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:13:58.680 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:13:58 smithi050 ceph-mon[17259]: Reconfiguring mon.b (monmap changed)... 2024-08-31T04:13:58.680 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:13:58 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-08-31T04:13:58.680 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:13:58 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-08-31T04:13:58.681 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:13:58 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:13:58.681 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:13:58 smithi050 ceph-mon[17259]: Reconfiguring daemon mon.b on smithi133 2024-08-31T04:13:58.681 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:13:58 smithi050 ceph-mon[17259]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T04:13:58.720 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:13:58.876 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:13:58 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:13:58.876 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:13:58 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:13:58.876 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:13:58 smithi133 ceph-mon[22177]: Reconfiguring mon.b (monmap changed)... 2024-08-31T04:13:58.876 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:13:58 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-08-31T04:13:58.876 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:13:58 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-08-31T04:13:58.876 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:13:58 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:13:58.876 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:13:58 smithi133 ceph-mon[22177]: Reconfiguring daemon mon.b on smithi133 2024-08-31T04:13:58.876 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:13:58 smithi133 ceph-mon[22177]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T04:13:58.976 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:13:58.973+0000 7f38ee000640 1 -- 172.21.15.50:0/3358481870 <== mon.1 v2:172.21.15.177:3300/0 8 ==== mon_command_ack([{prefix=config set, name=debug_ms}]=0 v10)=0 v10) ==== 109+0+0 (secure 0 0 0) 0x7f38e802ee90 con 0x7f38f0109210 2024-08-31T04:13:58.978 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:13:58.976+0000 7f38f8200640 1 -- 172.21.15.50:0/3358481870 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f38d803f280 msgr2=0x7f38d8041790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:13:58.978 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:13:58.976+0000 7f38f8200640 1 --2- 172.21.15.50:0/3358481870 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f38d803f280 0x7f38d8041790 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f38e40045f0 tx=0x7f38e400b390 comp rx=0 tx=0).stop 2024-08-31T04:13:58.978 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:13:58.976+0000 7f38f8200640 1 -- 172.21.15.50:0/3358481870 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f38f0109210 msgr2=0x7f38f019c4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:13:58.979 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:13:58.976+0000 7f38f8200640 1 --2- 172.21.15.50:0/3358481870 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f38f0109210 0x7f38f019c4e0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f38e8009b30 tx=0x7f38e80309f0 comp rx=0 tx=0).stop 2024-08-31T04:13:58.979 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:13:58.976+0000 7f38f8200640 1 -- 172.21.15.50:0/3358481870 shutdown_connections 2024-08-31T04:13:58.979 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:13:58.976+0000 7f38f8200640 1 --2- 172.21.15.50:0/3358481870 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f38d803f280 0x7f38d8041790 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:13:58.979 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:13:58.976+0000 7f38f8200640 1 --2- 172.21.15.50:0/3358481870 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f38f0109210 0x7f38f019c4e0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:13:58.979 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:13:58.976+0000 7f38f8200640 1 --2- 172.21.15.50:0/3358481870 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f38f0106670 0x7f38f019b9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:13:58.979 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:13:58.976+0000 7f38f8200640 1 --2- 172.21.15.50:0/3358481870 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f38f006b720 0x7f38f019b340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:13:58.980 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:13:58.976+0000 7f38f8200640 1 -- 172.21.15.50:0/3358481870 >> 172.21.15.50:0/3358481870 conn(0x7f38f00fdd50 msgr2=0x7f38f0100170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:13:58.980 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:13:58.977+0000 7f38f8200640 1 -- 172.21.15.50:0/3358481870 shutdown_connections 2024-08-31T04:13:58.980 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:13:58.977+0000 7f38f8200640 1 -- 172.21.15.50:0/3358481870 wait complete. 2024-08-31T04:13:58.996 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:58 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:13:58.996 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:58 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:13:58.996 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:58 smithi177 ceph-mon[22025]: Reconfiguring mon.b (monmap changed)... 2024-08-31T04:13:58.996 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:58 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-08-31T04:13:58.996 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:58 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-08-31T04:13:58.996 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:58 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:13:58.996 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:58 smithi177 ceph-mon[22025]: Reconfiguring daemon mon.b on smithi133 2024-08-31T04:13:58.996 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:58 smithi177 ceph-mon[22025]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T04:13:59.528 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:13:59.406+0000 7f5db8c00640 1 -- 172.21.15.50:0/3307702999 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5db4105720 msgr2=0x7f5db4105b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:13:59.528 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:13:59.406+0000 7f5db8c00640 1 --2- 172.21.15.50:0/3307702999 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5db4105720 0x7f5db4105b90 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f5da4009900 tx=0x7f5da402a480 comp rx=0 tx=0).stop 2024-08-31T04:13:59.528 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:13:59.407+0000 7f5db8c00640 1 -- 172.21.15.50:0/3307702999 shutdown_connections 2024-08-31T04:13:59.528 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:13:59.407+0000 7f5db8c00640 1 --2- 172.21.15.50:0/3307702999 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5db4107150 0x7f5db410daf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:13:59.528 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:13:59.407+0000 7f5db8c00640 1 --2- 172.21.15.50:0/3307702999 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5db41067b0 0x7f5db4106bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:13:59.529 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:13:59.407+0000 7f5db8c00640 1 --2- 172.21.15.50:0/3307702999 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5db4105720 0x7f5db4105b90 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:13:59.529 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:13:59.407+0000 7f5db8c00640 1 -- 172.21.15.50:0/3307702999 >> 172.21.15.50:0/3307702999 conn(0x7f5db4101090 msgr2=0x7f5db4103540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:13:59.529 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:13:59.407+0000 7f5db8c00640 1 -- 172.21.15.50:0/3307702999 shutdown_connections 2024-08-31T04:13:59.529 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:13:59.407+0000 7f5db8c00640 1 -- 172.21.15.50:0/3307702999 wait complete. 2024-08-31T04:13:59.529 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:13:59.408+0000 7f5db8c00640 1 Processor -- start 2024-08-31T04:13:59.529 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:13:59.408+0000 7f5db8c00640 1 -- start start 2024-08-31T04:13:59.529 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:13:59.408+0000 7f5db8c00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5db4105720 0x7f5db419b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:13:59.529 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:13:59.408+0000 7f5db8c00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5db41067b0 0x7f5db419ba80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:13:59.529 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:13:59.408+0000 7f5db8c00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5db4107150 0x7f5db419c620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:13:59.529 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:13:59.408+0000 7f5db8c00640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f5db41106b0 con 0x7f5db41067b0 2024-08-31T04:13:59.529 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:13:59.408+0000 7f5db8c00640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f5db4110530 con 0x7f5db4105720 2024-08-31T04:13:59.529 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:13:59.408+0000 7f5db8c00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f5db4110830 con 0x7f5db4107150 2024-08-31T04:13:59.530 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:13:59.408+0000 7f5db1400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5db41067b0 0x7f5db419ba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:13:59.530 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:13:59.408+0000 7f5db1400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5db41067b0 0x7f5db419ba80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:47878/0 (socket says 172.21.15.50:47878) 2024-08-31T04:13:59.530 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:13:59.408+0000 7f5db1400640 1 -- 172.21.15.50:0/1661426559 learned_addr learned my addr 172.21.15.50:0/1661426559 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:13:59.530 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:13:59.408+0000 7f5db1e00640 1 --2- 172.21.15.50:0/1661426559 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5db4105720 0x7f5db419b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:13:59.530 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:13:59.408+0000 7f5db2800640 1 --2- 172.21.15.50:0/1661426559 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5db4107150 0x7f5db419c620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:13:59.530 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:13:59.409+0000 7f5db1400640 1 -- 172.21.15.50:0/1661426559 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5db4107150 msgr2=0x7f5db419c620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:13:59.530 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:13:59.409+0000 7f5db1400640 1 --2- 172.21.15.50:0/1661426559 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5db4107150 0x7f5db419c620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:13:59.530 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:13:59.409+0000 7f5db1400640 1 -- 172.21.15.50:0/1661426559 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5db4105720 msgr2=0x7f5db419b410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:13:59.530 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:13:59.409+0000 7f5db1400640 1 --2- 172.21.15.50:0/1661426559 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5db4105720 0x7f5db419b410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:13:59.530 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:13:59.409+0000 7f5db1400640 1 -- 172.21.15.50:0/1661426559 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5db419ce40 con 0x7f5db41067b0 2024-08-31T04:13:59.530 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:13:59.409+0000 7f5db1400640 1 --2- 172.21.15.50:0/1661426559 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5db41067b0 0x7f5db419ba80 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f5da000e9f0 tx=0x7f5da000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:13:59.530 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:13:59.409+0000 7f5daaa00640 1 -- 172.21.15.50:0/1661426559 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5da000cd80 con 0x7f5db41067b0 2024-08-31T04:13:59.530 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:13:59.410+0000 7f5daaa00640 1 -- 172.21.15.50:0/1661426559 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(22 keys) ==== 983+0+0 (secure 0 0 0) 0x7f5da0010870 con 0x7f5db41067b0 2024-08-31T04:13:59.531 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:13:59.410+0000 7f5daaa00640 1 -- 172.21.15.50:0/1661426559 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5da0018680 con 0x7f5db41067b0 2024-08-31T04:13:59.531 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:13:59.410+0000 7f5db8c00640 1 -- 172.21.15.50:0/1661426559 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5db419d130 con 0x7f5db41067b0 2024-08-31T04:13:59.531 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:13:59.410+0000 7f5db8c00640 1 -- 172.21.15.50:0/1661426559 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5db41a3830 con 0x7f5db41067b0 2024-08-31T04:13:59.531 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:13:59.411+0000 7f5daaa00640 1 -- 172.21.15.50:0/1661426559 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 13) ==== 51253+0+0 (secure 0 0 0) 0x7f5da0018820 con 0x7f5db41067b0 2024-08-31T04:13:59.531 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:13:59.411+0000 7f5db8c00640 1 -- 172.21.15.50:0/1661426559 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5db4105b90 con 0x7f5db41067b0 2024-08-31T04:13:59.531 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:13:59.411+0000 7f5daaa00640 1 --2- 172.21.15.50:0/1661426559 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f5d9803f280 0x7f5d98041790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:13:59.531 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:13:59.412+0000 7f5daaa00640 1 -- 172.21.15.50:0/1661426559 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f5da0053ea0 con 0x7f5db41067b0 2024-08-31T04:13:59.531 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:13:59.412+0000 7f5db1e00640 1 --2- 172.21.15.50:0/1661426559 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f5d9803f280 0x7f5d98041790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:13:59.531 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:13:59.413+0000 7f5db1e00640 1 --2- 172.21.15.50:0/1661426559 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f5d9803f280 0x7f5d98041790 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f5da40057c0 tx=0x7f5da40058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:13:59.531 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:13:59.419+0000 7f5daaa00640 1 -- 172.21.15.50:0/1661426559 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f5da00071c0 con 0x7f5db41067b0 2024-08-31T04:13:59.620 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:13:59.618+0000 7f5db8c00640 1 -- 172.21.15.50:0/1661426559 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command([{prefix=config set, name=debug_client}] v 0) -- 0x7f5db402e6e0 con 0x7f5db41067b0 2024-08-31T04:13:59.624 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:13:59.622+0000 7f5daaa00640 1 -- 172.21.15.50:0/1661426559 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_client}]=0 v11)=0 v11) ==== 114+0+0 (secure 0 0 0) 0x7f5da0025da0 con 0x7f5db41067b0 2024-08-31T04:13:59.625 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:13:59.623+0000 7f5daaa00640 1 -- 172.21.15.50:0/1661426559 <== mon.0 v2:172.21.15.50:3300/0 8 ==== config(23 keys) ==== 1008+0+0 (secure 0 0 0) 0x7f5da0017e70 con 0x7f5db41067b0 2024-08-31T04:13:59.627 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:13:59.625+0000 7f5db8c00640 1 -- 172.21.15.50:0/1661426559 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f5d9803f280 msgr2=0x7f5d98041790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:13:59.627 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:13:59.625+0000 7f5db8c00640 1 --2- 172.21.15.50:0/1661426559 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f5d9803f280 0x7f5d98041790 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f5da40057c0 tx=0x7f5da40058d0 comp rx=0 tx=0).stop 2024-08-31T04:13:59.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:13:59.625+0000 7f5db8c00640 1 -- 172.21.15.50:0/1661426559 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5db41067b0 msgr2=0x7f5db419ba80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:13:59.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:13:59.625+0000 7f5db8c00640 1 --2- 172.21.15.50:0/1661426559 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5db41067b0 0x7f5db419ba80 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f5da000e9f0 tx=0x7f5da000eeb0 comp rx=0 tx=0).stop 2024-08-31T04:13:59.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:13:59.625+0000 7f5db8c00640 1 -- 172.21.15.50:0/1661426559 shutdown_connections 2024-08-31T04:13:59.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:13:59.625+0000 7f5db8c00640 1 --2- 172.21.15.50:0/1661426559 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f5d9803f280 0x7f5d98041790 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:13:59.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:13:59.625+0000 7f5db8c00640 1 --2- 172.21.15.50:0/1661426559 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5db4107150 0x7f5db419c620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:13:59.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:13:59.625+0000 7f5db8c00640 1 --2- 172.21.15.50:0/1661426559 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5db41067b0 0x7f5db419ba80 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:13:59.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:13:59.625+0000 7f5db8c00640 1 --2- 172.21.15.50:0/1661426559 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5db4105720 0x7f5db419b410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:13:59.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:13:59.625+0000 7f5db8c00640 1 -- 172.21.15.50:0/1661426559 >> 172.21.15.50:0/1661426559 conn(0x7f5db4101090 msgr2=0x7f5db4109ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:13:59.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:13:59.625+0000 7f5db8c00640 1 -- 172.21.15.50:0/1661426559 shutdown_connections 2024-08-31T04:13:59.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:13:59.625+0000 7f5db8c00640 1 -- 172.21.15.50:0/1661426559 wait complete. 2024-08-31T04:14:00.138 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:13:59 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:14:00.138 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:13:59 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:14:00.138 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:13:59 smithi050 ceph-mon[17259]: Reconfiguring mon.c (monmap changed)... 2024-08-31T04:14:00.138 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:13:59 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-08-31T04:14:00.138 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:13:59 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-08-31T04:14:00.138 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:13:59 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:14:00.138 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:13:59 smithi050 ceph-mon[17259]: Reconfiguring daemon mon.c on smithi177 2024-08-31T04:14:00.139 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:13:59 smithi050 ceph-mon[17259]: from='client.? ' entity='client.admin' 2024-08-31T04:14:00.139 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:13:59 smithi050 ceph-mon[17259]: from='client.? 172.21.15.50:0/1661426559' entity='client.admin' 2024-08-31T04:14:00.197 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:59 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:14:00.197 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:59 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:14:00.197 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:59 smithi177 ceph-mon[22025]: Reconfiguring mon.c (monmap changed)... 2024-08-31T04:14:00.197 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:59 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-08-31T04:14:00.197 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:59 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-08-31T04:14:00.197 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:59 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:14:00.197 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:59 smithi177 ceph-mon[22025]: Reconfiguring daemon mon.c on smithi177 2024-08-31T04:14:00.197 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:59 smithi177 ceph-mon[22025]: from='client.? ' entity='client.admin' 2024-08-31T04:14:00.197 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:13:59 smithi177 ceph-mon[22025]: from='client.? 172.21.15.50:0/1661426559' entity='client.admin' 2024-08-31T04:14:00.293 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:13:59 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:14:00.293 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:13:59 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:14:00.293 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:13:59 smithi133 ceph-mon[22177]: Reconfiguring mon.c (monmap changed)... 2024-08-31T04:14:00.293 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:13:59 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-08-31T04:14:00.293 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:13:59 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-08-31T04:14:00.293 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:13:59 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:14:00.293 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:13:59 smithi133 ceph-mon[22177]: Reconfiguring daemon mon.c on smithi177 2024-08-31T04:14:00.293 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:13:59 smithi133 ceph-mon[22177]: from='client.? ' entity='client.admin' 2024-08-31T04:14:00.293 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:13:59 smithi133 ceph-mon[22177]: from='client.? 172.21.15.50:0/1661426559' entity='client.admin' 2024-08-31T04:14:00.391 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:00.388+0000 7fb8d8800640 1 -- 172.21.15.50:0/3392326680 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb8d0103500 msgr2=0x7fb8d0103970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:14:00.391 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:00.388+0000 7fb8d8800640 1 --2- 172.21.15.50:0/3392326680 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb8d0103500 0x7fb8d0103970 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fb8c4009860 tx=0x7fb8c402a3d0 comp rx=0 tx=0).stop 2024-08-31T04:14:00.391 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:00.388+0000 7fb8d8800640 1 -- 172.21.15.50:0/3392326680 shutdown_connections 2024-08-31T04:14:00.391 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:00.388+0000 7fb8d8800640 1 --2- 172.21.15.50:0/3392326680 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb8d0104f30 0x7fb8d010b8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:14:00.391 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:00.388+0000 7fb8d8800640 1 --2- 172.21.15.50:0/3392326680 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb8d0104590 0x7fb8d01049a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:14:00.391 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:00.388+0000 7fb8d8800640 1 --2- 172.21.15.50:0/3392326680 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb8d0103500 0x7fb8d0103970 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:14:00.391 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:00.388+0000 7fb8d8800640 1 -- 172.21.15.50:0/3392326680 >> 172.21.15.50:0/3392326680 conn(0x7fb8d00fee50 msgr2=0x7fb8d0101320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:14:00.391 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:00.388+0000 7fb8d8800640 1 -- 172.21.15.50:0/3392326680 shutdown_connections 2024-08-31T04:14:00.392 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:00.389+0000 7fb8d8800640 1 -- 172.21.15.50:0/3392326680 wait complete. 2024-08-31T04:14:00.392 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:00.390+0000 7fb8d8800640 1 Processor -- start 2024-08-31T04:14:00.392 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:00.390+0000 7fb8d8800640 1 -- start start 2024-08-31T04:14:00.393 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:00.391+0000 7fb8d8800640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb8d0103500 0x7fb8d01992b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:14:00.393 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:00.391+0000 7fb8d8800640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb8d0104590 0x7fb8d0199920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:14:00.393 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:00.391+0000 7fb8d8800640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb8d0104f30 0x7fb8d019a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:14:00.393 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:00.391+0000 7fb8d8800640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fb8d010e5a0 con 0x7fb8d0103500 2024-08-31T04:14:00.393 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:00.391+0000 7fb8d8800640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7fb8d010e420 con 0x7fb8d0104f30 2024-08-31T04:14:00.393 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:00.391+0000 7fb8d8800640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fb8d010e720 con 0x7fb8d0104590 2024-08-31T04:14:00.394 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:00.391+0000 7fb8d5e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb8d0103500 0x7fb8d01992b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:14:00.394 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:00.391+0000 7fb8d5e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb8d0103500 0x7fb8d01992b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:47884/0 (socket says 172.21.15.50:47884) 2024-08-31T04:14:00.395 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:00.391+0000 7fb8d5400640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb8d0104590 0x7fb8d0199920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:14:00.395 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:00.391+0000 7fb8d5e00640 1 -- 172.21.15.50:0/3957288796 learned_addr learned my addr 172.21.15.50:0/3957288796 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:14:00.395 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:00.391+0000 7fb8d6800640 1 --2- 172.21.15.50:0/3957288796 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb8d0104f30 0x7fb8d019a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:14:00.395 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:00.391+0000 7fb8d5400640 1 -- 172.21.15.50:0/3957288796 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb8d0104f30 msgr2=0x7fb8d019a4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:14:00.395 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:00.391+0000 7fb8d5400640 1 --2- 172.21.15.50:0/3957288796 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb8d0104f30 0x7fb8d019a4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:14:00.395 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:00.391+0000 7fb8d5400640 1 -- 172.21.15.50:0/3957288796 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb8d0103500 msgr2=0x7fb8d01992b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:14:00.395 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:00.391+0000 7fb8d5400640 1 --2- 172.21.15.50:0/3957288796 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb8d0103500 0x7fb8d01992b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:14:00.395 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:00.391+0000 7fb8d5400640 1 -- 172.21.15.50:0/3957288796 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8d019ace0 con 0x7fb8d0104590 2024-08-31T04:14:00.395 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:00.392+0000 7fb8d5400640 1 --2- 172.21.15.50:0/3957288796 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb8d0104590 0x7fb8d0199920 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fb8c000e9f0 tx=0x7fb8c000eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:14:00.395 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:00.392+0000 7fb8caa00640 1 -- 172.21.15.50:0/3957288796 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8c000ccc0 con 0x7fb8d0104590 2024-08-31T04:14:00.395 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:00.392+0000 7fb8caa00640 1 -- 172.21.15.50:0/3957288796 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(23 keys) ==== 1008+0+0 (secure 0 0 0) 0x7fb8c0010880 con 0x7fb8d0104590 2024-08-31T04:14:00.395 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:00.392+0000 7fb8d8800640 1 -- 172.21.15.50:0/3957288796 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb8d019afd0 con 0x7fb8d0104590 2024-08-31T04:14:00.395 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:00.392+0000 7fb8caa00640 1 -- 172.21.15.50:0/3957288796 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8c0018640 con 0x7fb8d0104590 2024-08-31T04:14:00.396 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:00.392+0000 7fb8d8800640 1 -- 172.21.15.50:0/3957288796 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb8d01a16d0 con 0x7fb8d0104590 2024-08-31T04:14:00.396 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:00.393+0000 7fb8d8800640 1 -- 172.21.15.50:0/3957288796 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb8d0103970 con 0x7fb8d0104590 2024-08-31T04:14:00.396 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:00.394+0000 7fb8caa00640 1 -- 172.21.15.50:0/3957288796 <== mon.1 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 13) ==== 51253+0+0 (secure 0 0 0) 0x7fb8c00187e0 con 0x7fb8d0104590 2024-08-31T04:14:00.396 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:00.394+0000 7fb8caa00640 1 --2- 172.21.15.50:0/3957288796 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fb8b803f280 0x7fb8b8041790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:14:00.397 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:00.394+0000 7fb8caa00640 1 -- 172.21.15.50:0/3957288796 <== mon.1 v2:172.21.15.177:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fb8c0053d80 con 0x7fb8d0104590 2024-08-31T04:14:00.397 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:00.394+0000 7fb8d5e00640 1 --2- 172.21.15.50:0/3957288796 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fb8b803f280 0x7fb8b8041790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:14:00.397 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:00.395+0000 7fb8d5e00640 1 --2- 172.21.15.50:0/3957288796 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fb8b803f280 0x7fb8b8041790 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fb8c40095f0 tx=0x7fb8c40306f0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:14:00.401 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:00.399+0000 7fb8caa00640 1 -- 172.21.15.50:0/3957288796 <== mon.1 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fb8c00071c0 con 0x7fb8d0104590 2024-08-31T04:14:00.605 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:00.603+0000 7f8c7a600640 1 -- 172.21.15.50:0/982399030 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8c74075a90 msgr2=0x7f8c74075ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:14:00.605 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:00.603+0000 7f8c7a600640 1 --2- 172.21.15.50:0/982399030 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8c74075a90 0x7f8c74075ea0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f8c60009930 tx=0x7f8c6002a420 comp rx=0 tx=0).stop 2024-08-31T04:14:00.605 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:00.603+0000 7f8c7a600640 1 -- 172.21.15.50:0/982399030 shutdown_connections 2024-08-31T04:14:00.606 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:00.603+0000 7f8c7a600640 1 --2- 172.21.15.50:0/982399030 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8c7410faa0 0x7f8c74111ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:14:00.606 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:00.603+0000 7f8c7a600640 1 --2- 172.21.15.50:0/982399030 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8c74075a90 0x7f8c74075ea0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:14:00.606 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:00.603+0000 7f8c7a600640 1 --2- 172.21.15.50:0/982399030 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8c74076e80 0x7f8c74075550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:14:00.606 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:00.603+0000 7f8c7a600640 1 -- 172.21.15.50:0/982399030 >> 172.21.15.50:0/982399030 conn(0x7f8c740fec60 msgr2=0x7f8c74101130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:14:00.606 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:00.603+0000 7f8c7a600640 1 -- 172.21.15.50:0/982399030 shutdown_connections 2024-08-31T04:14:00.607 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:00.604+0000 7f8c7a600640 1 -- 172.21.15.50:0/982399030 wait complete. 2024-08-31T04:14:00.607 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:00.604+0000 7f8c7a600640 1 Processor -- start 2024-08-31T04:14:00.607 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:00.605+0000 7f8c7a600640 1 -- start start 2024-08-31T04:14:00.607 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:00.605+0000 7f8c7a600640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8c74075a90 0x7f8c7419f730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:14:00.607 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:00.605+0000 7f8c7a600640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8c74076e80 0x7f8c7419fda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:14:00.607 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:00.605+0000 7f8c7a600640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8c7410faa0 0x7f8c741a0940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:14:00.607 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:00.605+0000 7f8c7a600640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f8c74114980 con 0x7f8c74076e80 2024-08-31T04:14:00.608 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:00.605+0000 7f8c7a600640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f8c74114800 con 0x7f8c74075a90 2024-08-31T04:14:00.608 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:00.605+0000 7f8c7a600640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f8c74114b00 con 0x7f8c7410faa0 2024-08-31T04:14:00.609 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:00.605+0000 7f8c73e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8c74076e80 0x7f8c7419fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:14:00.609 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:00.605+0000 7f8c73e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8c74076e80 0x7f8c7419fda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:47896/0 (socket says 172.21.15.50:47896) 2024-08-31T04:14:00.609 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:00.605+0000 7f8c73e00640 1 -- 172.21.15.50:0/2166303346 learned_addr learned my addr 172.21.15.50:0/2166303346 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:14:00.609 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:00.606+0000 7f8c79200640 1 --2- 172.21.15.50:0/2166303346 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8c74075a90 0x7f8c7419f730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:14:00.609 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:00.606+0000 7f8c79c00640 1 --2- 172.21.15.50:0/2166303346 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8c7410faa0 0x7f8c741a0940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:14:00.609 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:00.606+0000 7f8c79200640 1 -- 172.21.15.50:0/2166303346 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8c7410faa0 msgr2=0x7f8c741a0940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:14:00.610 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:00.606+0000 7f8c79200640 1 --2- 172.21.15.50:0/2166303346 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8c7410faa0 0x7f8c741a0940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:14:00.610 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:00.606+0000 7f8c79200640 1 -- 172.21.15.50:0/2166303346 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8c74076e80 msgr2=0x7f8c7419fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:14:00.610 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:00.606+0000 7f8c79200640 1 --2- 172.21.15.50:0/2166303346 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8c74076e80 0x7f8c7419fda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:14:00.610 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:00.606+0000 7f8c79200640 1 -- 172.21.15.50:0/2166303346 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c741a1160 con 0x7f8c74075a90 2024-08-31T04:14:00.610 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:00.606+0000 7f8c73e00640 1 --2- 172.21.15.50:0/2166303346 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8c74076e80 0x7f8c7419fda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:14:00.610 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:00.606+0000 7f8c79200640 1 --2- 172.21.15.50:0/2166303346 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8c74075a90 0x7f8c7419f730 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f8c6800e9f0 tx=0x7f8c6800eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:14:00.610 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:00.607+0000 7f8c71600640 1 -- 172.21.15.50:0/2166303346 <== mon.2 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c6800ccc0 con 0x7f8c74075a90 2024-08-31T04:14:00.610 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:00.607+0000 7f8c7a600640 1 -- 172.21.15.50:0/2166303346 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8c741a1450 con 0x7f8c74075a90 2024-08-31T04:14:00.610 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:00.607+0000 7f8c71600640 1 -- 172.21.15.50:0/2166303346 <== mon.2 v2:172.21.15.133:3300/0 2 ==== config(23 keys) ==== 1008+0+0 (secure 0 0 0) 0x7f8c68010880 con 0x7f8c74075a90 2024-08-31T04:14:00.610 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:00.607+0000 7f8c71600640 1 -- 172.21.15.50:0/2166303346 <== mon.2 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c68018660 con 0x7f8c74075a90 2024-08-31T04:14:00.610 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:00.607+0000 7f8c7a600640 1 -- 172.21.15.50:0/2166303346 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8c741a7b50 con 0x7f8c74075a90 2024-08-31T04:14:00.611 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:00.608+0000 7f8c71600640 1 -- 172.21.15.50:0/2166303346 <== mon.2 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 13) ==== 51253+0+0 (secure 0 0 0) 0x7f8c680188c0 con 0x7f8c74075a90 2024-08-31T04:14:00.611 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:00.608+0000 7f8c7a600640 1 -- 172.21.15.50:0/2166303346 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8c74075ea0 con 0x7f8c74075a90 2024-08-31T04:14:00.611 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:00.609+0000 7f8c71600640 1 --2- 172.21.15.50:0/2166303346 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f8c5c03f280 0x7f8c5c041790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:14:00.611 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:00.609+0000 7f8c71600640 1 -- 172.21.15.50:0/2166303346 <== mon.2 v2:172.21.15.133:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f8c68054af0 con 0x7f8c74075a90 2024-08-31T04:14:00.611 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:00.609+0000 7f8c73e00640 1 --2- 172.21.15.50:0/2166303346 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f8c5c03f280 0x7f8c5c041790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:14:00.612 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:00.610+0000 7f8c73e00640 1 --2- 172.21.15.50:0/2166303346 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f8c5c03f280 0x7f8c5c041790 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f8c600096c0 tx=0x7f8c60004ef0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:14:00.617 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:00.614+0000 7f8c71600640 1 -- 172.21.15.50:0/2166303346 <== mon.2 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f8c68020360 con 0x7f8c74075a90 2024-08-31T04:14:00.715 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:00.712+0000 7fb8d8800640 1 -- 172.21.15.50:0/3957288796 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command([{prefix=config set, name=client_mount_timeout}] v 0) -- 0x7fb8d0063d60 con 0x7fb8d0104590 2024-08-31T04:14:00.720 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:00.718+0000 7fb8caa00640 1 -- 172.21.15.50:0/3957288796 <== mon.1 v2:172.21.15.177:3300/0 7 ==== config(24 keys) ==== 1039+0+0 (secure 0 0 0) 0x7fb8c001f6b0 con 0x7fb8d0104590 2024-08-31T04:14:00.720 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:00.718+0000 7fb8caa00640 1 -- 172.21.15.50:0/3957288796 <== mon.1 v2:172.21.15.177:3300/0 8 ==== mon_command_ack([{prefix=config set, name=client_mount_timeout}]=0 v12)=0 v12) ==== 123+0+0 (secure 0 0 0) 0x7fb8c0025da0 con 0x7fb8d0104590 2024-08-31T04:14:00.722 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:00.720+0000 7f8c71600640 1 -- 172.21.15.50:0/2166303346 <== mon.2 v2:172.21.15.133:3300/0 7 ==== config(24 keys) ==== 1039+0+0 (secure 0 0 0) 0x7f8c6800fe40 con 0x7f8c74075a90 2024-08-31T04:14:00.724 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:00.722+0000 7fb8d8800640 1 -- 172.21.15.50:0/3957288796 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fb8b803f280 msgr2=0x7fb8b8041790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:14:00.724 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:00.722+0000 7fb8d8800640 1 --2- 172.21.15.50:0/3957288796 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fb8b803f280 0x7fb8b8041790 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fb8c40095f0 tx=0x7fb8c40306f0 comp rx=0 tx=0).stop 2024-08-31T04:14:00.724 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:00.722+0000 7fb8d8800640 1 -- 172.21.15.50:0/3957288796 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb8d0104590 msgr2=0x7fb8d0199920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:14:00.725 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:00.722+0000 7fb8d8800640 1 --2- 172.21.15.50:0/3957288796 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb8d0104590 0x7fb8d0199920 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fb8c000e9f0 tx=0x7fb8c000eeb0 comp rx=0 tx=0).stop 2024-08-31T04:14:00.725 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:00.722+0000 7fb8d8800640 1 -- 172.21.15.50:0/3957288796 shutdown_connections 2024-08-31T04:14:00.725 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:00.722+0000 7fb8d8800640 1 --2- 172.21.15.50:0/3957288796 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fb8b803f280 0x7fb8b8041790 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:14:00.725 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:00.722+0000 7fb8d8800640 1 --2- 172.21.15.50:0/3957288796 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb8d0104590 0x7fb8d0199920 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:14:00.725 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:00.722+0000 7fb8d8800640 1 --2- 172.21.15.50:0/3957288796 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb8d0104f30 0x7fb8d019a4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:14:00.725 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:00.722+0000 7fb8d8800640 1 --2- 172.21.15.50:0/3957288796 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb8d0103500 0x7fb8d01992b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:14:00.725 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:00.722+0000 7fb8d8800640 1 -- 172.21.15.50:0/3957288796 >> 172.21.15.50:0/3957288796 conn(0x7fb8d00fee50 msgr2=0x7fb8d01078b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:14:00.725 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:00.722+0000 7fb8d8800640 1 -- 172.21.15.50:0/3957288796 shutdown_connections 2024-08-31T04:14:00.725 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:00.722+0000 7fb8d8800640 1 -- 172.21.15.50:0/3957288796 wait complete. 2024-08-31T04:14:00.832 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:00.830+0000 7f8c7a600640 1 -- 172.21.15.50:0/2166303346 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command([{prefix=config set, name=rados_mon_op_timeout}] v 0) -- 0x7f8c74063d60 con 0x7f8c74075a90 2024-08-31T04:14:00.839 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:00.837+0000 7f8c71600640 1 -- 172.21.15.50:0/2166303346 <== mon.2 v2:172.21.15.133:3300/0 8 ==== config(25 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f8c68025da0 con 0x7f8c74075a90 2024-08-31T04:14:00.839 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:00.837+0000 7f8c71600640 1 -- 172.21.15.50:0/2166303346 <== mon.2 v2:172.21.15.133:3300/0 9 ==== mon_command_ack([{prefix=config set, name=rados_mon_op_timeout}]=0 v13)=0 v13) ==== 123+0+0 (secure 0 0 0) 0x7f8c68014cf0 con 0x7f8c74075a90 2024-08-31T04:14:00.842 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:00.839+0000 7f8c7a600640 1 -- 172.21.15.50:0/2166303346 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f8c5c03f280 msgr2=0x7f8c5c041790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:14:00.842 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:00.839+0000 7f8c7a600640 1 --2- 172.21.15.50:0/2166303346 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f8c5c03f280 0x7f8c5c041790 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f8c600096c0 tx=0x7f8c60004ef0 comp rx=0 tx=0).stop 2024-08-31T04:14:00.842 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:00.839+0000 7f8c7a600640 1 -- 172.21.15.50:0/2166303346 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8c74075a90 msgr2=0x7f8c7419f730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:14:00.842 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:00.839+0000 7f8c7a600640 1 --2- 172.21.15.50:0/2166303346 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8c74075a90 0x7f8c7419f730 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f8c6800e9f0 tx=0x7f8c6800eeb0 comp rx=0 tx=0).stop 2024-08-31T04:14:00.842 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:00.840+0000 7f8c7a600640 1 -- 172.21.15.50:0/2166303346 shutdown_connections 2024-08-31T04:14:00.843 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:00.840+0000 7f8c7a600640 1 --2- 172.21.15.50:0/2166303346 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f8c5c03f280 0x7f8c5c041790 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:14:00.843 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:00.840+0000 7f8c7a600640 1 --2- 172.21.15.50:0/2166303346 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8c7410faa0 0x7f8c741a0940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:14:00.843 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:00.840+0000 7f8c7a600640 1 --2- 172.21.15.50:0/2166303346 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8c74076e80 0x7f8c7419fda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:14:00.843 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:00.840+0000 7f8c7a600640 1 --2- 172.21.15.50:0/2166303346 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8c74075a90 0x7f8c7419f730 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:14:00.843 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:00.840+0000 7f8c7a600640 1 -- 172.21.15.50:0/2166303346 >> 172.21.15.50:0/2166303346 conn(0x7f8c740fec60 msgr2=0x7f8c74101080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:14:00.843 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:00.840+0000 7f8c7a600640 1 -- 172.21.15.50:0/2166303346 shutdown_connections 2024-08-31T04:14:00.843 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:00.840+0000 7f8c7a600640 1 -- 172.21.15.50:0/2166303346 wait complete. 2024-08-31T04:14:00.882 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:00.879+0000 7f2847e00640 1 -- 172.21.15.50:0/702739657 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f284810faa0 msgr2=0x7f2848111ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:14:00.882 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:00.879+0000 7f2847e00640 1 --2- 172.21.15.50:0/702739657 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f284810faa0 0x7f2848111ec0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f2840009c10 tx=0x7f284002a6e0 comp rx=0 tx=0).stop 2024-08-31T04:14:00.882 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:00.879+0000 7f2847e00640 1 -- 172.21.15.50:0/702739657 shutdown_connections 2024-08-31T04:14:00.882 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:00.879+0000 7f2847e00640 1 --2- 172.21.15.50:0/702739657 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f284810faa0 0x7f2848111ec0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:14:00.882 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:00.879+0000 7f2847e00640 1 --2- 172.21.15.50:0/702739657 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2848075a90 0x7f2848075ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:14:00.882 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:00.879+0000 7f2847e00640 1 --2- 172.21.15.50:0/702739657 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2848076e80 0x7f2848075550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:14:00.882 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:00.879+0000 7f2847e00640 1 -- 172.21.15.50:0/702739657 >> 172.21.15.50:0/702739657 conn(0x7f28480fec60 msgr2=0x7f2848101130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:14:00.883 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:00.880+0000 7f2847e00640 1 -- 172.21.15.50:0/702739657 shutdown_connections 2024-08-31T04:14:00.883 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:00.880+0000 7f2847e00640 1 -- 172.21.15.50:0/702739657 wait complete. 2024-08-31T04:14:00.883 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:00.881+0000 7f2847e00640 1 Processor -- start 2024-08-31T04:14:00.884 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:00.881+0000 7f2847e00640 1 -- start start 2024-08-31T04:14:00.884 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:00.881+0000 7f2847e00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2848075a90 0x7f28481a0100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:14:00.884 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:00.882+0000 7f2847e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2848076e80 0x7f28481a0770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:14:00.884 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:00.882+0000 7f2847e00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f284810faa0 0x7f28481a12a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:14:00.884 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:00.882+0000 7f2847e00640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f2848115420 con 0x7f2848076e80 2024-08-31T04:14:00.884 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:00.882+0000 7f2847e00640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f28481152a0 con 0x7f2848075a90 2024-08-31T04:14:00.884 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:00.882+0000 7f2847e00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f28481155a0 con 0x7f284810faa0 2024-08-31T04:14:00.885 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:00.882+0000 7f2846000640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2848076e80 0x7f28481a0770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:14:00.885 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:00.882+0000 7f2846a00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2848075a90 0x7f28481a0100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:14:00.885 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:00.882+0000 7f2846a00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2848075a90 0x7f28481a0100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.50:41670/0 (socket says 172.21.15.50:41670) 2024-08-31T04:14:00.885 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:00.882+0000 7f2846a00640 1 -- 172.21.15.50:0/3034566641 learned_addr learned my addr 172.21.15.50:0/3034566641 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:14:00.885 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:00.882+0000 7f2847400640 1 --2- 172.21.15.50:0/3034566641 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f284810faa0 0x7f28481a12a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:14:00.885 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:00.882+0000 7f2846a00640 1 -- 172.21.15.50:0/3034566641 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f284810faa0 msgr2=0x7f28481a12a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:14:00.885 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:00.882+0000 7f2846a00640 1 --2- 172.21.15.50:0/3034566641 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f284810faa0 0x7f28481a12a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:14:00.885 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:00.883+0000 7f2846a00640 1 -- 172.21.15.50:0/3034566641 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2848076e80 msgr2=0x7f28481a0770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:14:00.885 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:00.883+0000 7f2846a00640 1 --2- 172.21.15.50:0/3034566641 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2848076e80 0x7f28481a0770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:14:00.885 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:00.883+0000 7f2846a00640 1 -- 172.21.15.50:0/3034566641 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28481a1ac0 con 0x7f2848075a90 2024-08-31T04:14:00.886 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:00.883+0000 7f2846000640 1 --2- 172.21.15.50:0/3034566641 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2848076e80 0x7f28481a0770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:14:00.886 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:00.883+0000 7f2846a00640 1 --2- 172.21.15.50:0/3034566641 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2848075a90 0x7f28481a0100 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f283800e9f0 tx=0x7f283800edf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:14:00.886 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:00.883+0000 7f283f400640 1 -- 172.21.15.50:0/3034566641 <== mon.2 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f283800ccc0 con 0x7f2848075a90 2024-08-31T04:14:00.886 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:00.883+0000 7f2847e00640 1 -- 172.21.15.50:0/3034566641 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f28481a1db0 con 0x7f2848075a90 2024-08-31T04:14:00.886 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:00.883+0000 7f283f400640 1 -- 172.21.15.50:0/3034566641 <== mon.2 v2:172.21.15.133:3300/0 2 ==== config(25 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f283800ce60 con 0x7f2848075a90 2024-08-31T04:14:00.887 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:00.883+0000 7f2847e00640 1 -- 172.21.15.50:0/3034566641 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f28481a84b0 con 0x7f2848075a90 2024-08-31T04:14:00.887 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:00.883+0000 7f283f400640 1 -- 172.21.15.50:0/3034566641 <== mon.2 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2838010430 con 0x7f2848075a90 2024-08-31T04:14:00.887 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:00.885+0000 7f2847e00640 1 -- 172.21.15.50:0/3034566641 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f28280052c0 con 0x7f2848075a90 2024-08-31T04:14:00.888 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:00.886+0000 7f283f400640 1 -- 172.21.15.50:0/3034566641 <== mon.2 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 13) ==== 51253+0+0 (secure 0 0 0) 0x7f28380105d0 con 0x7f2848075a90 2024-08-31T04:14:00.888 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:00.886+0000 7f283f400640 1 --2- 172.21.15.50:0/3034566641 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f282c03f280 0x7f282c041790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:14:00.888 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:00.886+0000 7f283f400640 1 -- 172.21.15.50:0/3034566641 <== mon.2 v2:172.21.15.133:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f2838053e70 con 0x7f2848075a90 2024-08-31T04:14:00.889 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:00.886+0000 7f2846000640 1 --2- 172.21.15.50:0/3034566641 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f282c03f280 0x7f282c041790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:14:00.889 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:00.887+0000 7f2846000640 1 --2- 172.21.15.50:0/3034566641 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f282c03f280 0x7f282c041790 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f2834005fd0 tx=0x7f2834009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:14:00.894 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:00.892+0000 7f283f400640 1 -- 172.21.15.50:0/3034566641 <== mon.2 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f2838016330 con 0x7f2848075a90 2024-08-31T04:14:01.115 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:01.113+0000 7f2847e00640 1 -- 172.21.15.50:0/3034566641 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command([{prefix=config set, name=debug_ms}] v 0) -- 0x7f28280055b0 con 0x7f2848075a90 2024-08-31T04:14:01.123 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:01.120+0000 7f283f400640 1 -- 172.21.15.50:0/3034566641 <== mon.2 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_ms}]=0 v14)=0 v14) ==== 106+0+0 (secure 0 0 0) 0x7f28380047a0 con 0x7f2848075a90 2024-08-31T04:14:01.125 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:01.123+0000 7f2847e00640 1 -- 172.21.15.50:0/3034566641 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f282c03f280 msgr2=0x7f282c041790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:14:01.125 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:01.123+0000 7f2847e00640 1 --2- 172.21.15.50:0/3034566641 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f282c03f280 0x7f282c041790 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f2834005fd0 tx=0x7f2834009260 comp rx=0 tx=0).stop 2024-08-31T04:14:01.125 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:01.123+0000 7f2847e00640 1 -- 172.21.15.50:0/3034566641 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2848075a90 msgr2=0x7f28481a0100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:14:01.126 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:01.123+0000 7f2847e00640 1 --2- 172.21.15.50:0/3034566641 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2848075a90 0x7f28481a0100 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f283800e9f0 tx=0x7f283800edf0 comp rx=0 tx=0).stop 2024-08-31T04:14:01.126 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:01.123+0000 7f2847e00640 1 -- 172.21.15.50:0/3034566641 shutdown_connections 2024-08-31T04:14:01.126 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:01.123+0000 7f2847e00640 1 --2- 172.21.15.50:0/3034566641 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f282c03f280 0x7f282c041790 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:14:01.126 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:01.123+0000 7f2847e00640 1 --2- 172.21.15.50:0/3034566641 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f284810faa0 0x7f28481a12a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:14:01.126 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:01.123+0000 7f2847e00640 1 --2- 172.21.15.50:0/3034566641 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2848076e80 0x7f28481a0770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:14:01.126 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:01.123+0000 7f2847e00640 1 --2- 172.21.15.50:0/3034566641 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2848075a90 0x7f28481a0100 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:14:01.126 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:01.123+0000 7f2847e00640 1 -- 172.21.15.50:0/3034566641 >> 172.21.15.50:0/3034566641 conn(0x7f28480fec60 msgr2=0x7f28480ff350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:14:01.127 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:01.124+0000 7f2847e00640 1 -- 172.21.15.50:0/3034566641 shutdown_connections 2024-08-31T04:14:01.127 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:01.124+0000 7f2847e00640 1 -- 172.21.15.50:0/3034566641 wait complete. 2024-08-31T04:14:01.345 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:14:01 smithi050 ceph-mon[17259]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T04:14:01.345 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:14:01 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:14:01.345 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:14:01 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:14:01.345 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:14:01 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T04:14:01.345 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:14:01 smithi050 ceph-mon[17259]: from='client.? ' entity='client.admin' 2024-08-31T04:14:01.345 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:14:01 smithi050 ceph-mon[17259]: from='client.? ' entity='client.admin' 2024-08-31T04:14:01.345 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:14:01 smithi050 ceph-mon[17259]: from='client.? ' entity='client.admin' 2024-08-31T04:14:01.345 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:14:01 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:14:01.345 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:14:01 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T04:14:01.345 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:14:01 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:14:01.346 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:14:01 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-08-31T04:14:01.346 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:14:01 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-08-31T04:14:01.346 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:14:01 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-08-31T04:14:01.346 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:14:01 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:14:01.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:14:01 smithi133 ceph-mon[22177]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T04:14:01.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:14:01 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:14:01.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:14:01 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:14:01.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:14:01 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T04:14:01.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:14:01 smithi133 ceph-mon[22177]: from='client.? ' entity='client.admin' 2024-08-31T04:14:01.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:14:01 smithi133 ceph-mon[22177]: from='client.? ' entity='client.admin' 2024-08-31T04:14:01.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:14:01 smithi133 ceph-mon[22177]: from='client.? ' entity='client.admin' 2024-08-31T04:14:01.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:14:01 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:14:01.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:14:01 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T04:14:01.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:14:01 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:14:01.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:14:01 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-08-31T04:14:01.544 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:14:01 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-08-31T04:14:01.544 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:14:01 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-08-31T04:14:01.544 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:14:01 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:14:01.556 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:14:01 smithi177 ceph-mon[22025]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T04:14:01.556 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:14:01 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:14:01.556 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:14:01 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:14:01.557 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:14:01 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T04:14:01.557 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:14:01 smithi177 ceph-mon[22025]: from='client.? ' entity='client.admin' 2024-08-31T04:14:01.557 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:14:01 smithi177 ceph-mon[22025]: from='client.? ' entity='client.admin' 2024-08-31T04:14:01.557 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:14:01 smithi177 ceph-mon[22025]: from='client.? ' entity='client.admin' 2024-08-31T04:14:01.557 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:14:01 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:14:01.557 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:14:01 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T04:14:01.557 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:14:01 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:14:01.557 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:14:01 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-08-31T04:14:01.557 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:14:01 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-08-31T04:14:01.557 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:14:01 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-08-31T04:14:01.557 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:14:01 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:14:02.373 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:14:02 smithi050 ceph-mon[17259]: Deploying daemon mgr.z on smithi177 2024-08-31T04:14:02.373 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:14:02 smithi050 ceph-mon[17259]: from='client.? 172.21.15.50:0/1913113764' entity='client.admin' 2024-08-31T04:14:02.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:14:02 smithi133 ceph-mon[22177]: Deploying daemon mgr.z on smithi177 2024-08-31T04:14:02.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:14:02 smithi133 ceph-mon[22177]: from='client.? 172.21.15.50:0/1913113764' entity='client.admin' 2024-08-31T04:14:02.572 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:14:02 smithi177 ceph-mon[22025]: Deploying daemon mgr.z on smithi177 2024-08-31T04:14:02.572 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:14:02 smithi177 ceph-mon[22025]: from='client.? 172.21.15.50:0/1913113764' entity='client.admin' 2024-08-31T04:14:02.834 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:01.655+0000 7fb71ee00640 1 -- 172.21.15.50:0/1995589089 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb71806c400 msgr2=0x7fb718106140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:14:02.834 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:01.655+0000 7fb71ee00640 1 --2- 172.21.15.50:0/1995589089 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb71806c400 0x7fb718106140 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fb708009900 tx=0x7fb70802a3f0 comp rx=0 tx=0).stop 2024-08-31T04:14:02.834 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:01.655+0000 7fb71ee00640 1 -- 172.21.15.50:0/1995589089 shutdown_connections 2024-08-31T04:14:02.834 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:01.655+0000 7fb71ee00640 1 --2- 172.21.15.50:0/1995589089 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb718109220 0x7fb71810b730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:14:02.834 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:01.655+0000 7fb71ee00640 1 --2- 172.21.15.50:0/1995589089 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb718106680 0x7fb718108ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:14:02.834 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:01.655+0000 7fb71ee00640 1 --2- 172.21.15.50:0/1995589089 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb71806c400 0x7fb718106140 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:14:02.834 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:01.655+0000 7fb71ee00640 1 -- 172.21.15.50:0/1995589089 >> 172.21.15.50:0/1995589089 conn(0x7fb7180fdd80 msgr2=0x7fb718100210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:14:02.834 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:01.655+0000 7fb71ee00640 1 -- 172.21.15.50:0/1995589089 shutdown_connections 2024-08-31T04:14:02.834 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:01.657+0000 7fb71ee00640 1 -- 172.21.15.50:0/1995589089 wait complete. 2024-08-31T04:14:02.834 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:01.658+0000 7fb71ee00640 1 Processor -- start 2024-08-31T04:14:02.835 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:01.658+0000 7fb71ee00640 1 -- start start 2024-08-31T04:14:02.835 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:01.658+0000 7fb71ee00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb71806c400 0x7fb718199d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:14:02.835 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:01.658+0000 7fb71ee00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb718106680 0x7fb71819a370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:14:02.835 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:01.658+0000 7fb71ee00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb718109220 0x7fb71819aea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:14:02.835 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:01.658+0000 7fb71ee00640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fb71810eff0 con 0x7fb718109220 2024-08-31T04:14:02.835 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:01.658+0000 7fb71ee00640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7fb71810ee70 con 0x7fb71806c400 2024-08-31T04:14:02.835 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:01.658+0000 7fb71ee00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fb71810f170 con 0x7fb718106680 2024-08-31T04:14:02.835 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:01.659+0000 7fb717400640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb718106680 0x7fb71819a370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:14:02.835 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:01.659+0000 7fb717400640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb718106680 0x7fb71819a370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.50:52500/0 (socket says 172.21.15.50:52500) 2024-08-31T04:14:02.835 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:01.659+0000 7fb717400640 1 -- 172.21.15.50:0/1913113764 learned_addr learned my addr 172.21.15.50:0/1913113764 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:14:02.835 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:01.659+0000 7fb71ce00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb718109220 0x7fb71819aea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:14:02.835 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:01.659+0000 7fb717e00640 1 --2- 172.21.15.50:0/1913113764 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb71806c400 0x7fb718199d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:14:02.835 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:01.659+0000 7fb71ce00640 1 -- 172.21.15.50:0/1913113764 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb718106680 msgr2=0x7fb71819a370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:14:02.836 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:01.659+0000 7fb71ce00640 1 --2- 172.21.15.50:0/1913113764 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb718106680 0x7fb71819a370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:14:02.836 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:01.659+0000 7fb71ce00640 1 -- 172.21.15.50:0/1913113764 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb71806c400 msgr2=0x7fb718199d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:14:02.836 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:01.659+0000 7fb71ce00640 1 --2- 172.21.15.50:0/1913113764 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb71806c400 0x7fb718199d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:14:02.836 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:01.659+0000 7fb71ce00640 1 -- 172.21.15.50:0/1913113764 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb71819b6c0 con 0x7fb718109220 2024-08-31T04:14:02.836 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:01.659+0000 7fb717400640 1 --2- 172.21.15.50:0/1913113764 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb718106680 0x7fb71819a370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:14:02.836 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:01.660+0000 7fb71ce00640 1 --2- 172.21.15.50:0/1913113764 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb718109220 0x7fb71819aea0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fb710009fd0 tx=0x7fb71000ef10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:14:02.836 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:01.660+0000 7fb714c00640 1 -- 172.21.15.50:0/1913113764 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb71000ce20 con 0x7fb718109220 2024-08-31T04:14:02.836 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:01.660+0000 7fb714c00640 1 -- 172.21.15.50:0/1913113764 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(25 keys) ==== 1070+0+0 (secure 0 0 0) 0x7fb710005020 con 0x7fb718109220 2024-08-31T04:14:02.836 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:01.660+0000 7fb71ee00640 1 -- 172.21.15.50:0/1913113764 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb71819b9b0 con 0x7fb718109220 2024-08-31T04:14:02.836 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:01.660+0000 7fb714c00640 1 -- 172.21.15.50:0/1913113764 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb710010690 con 0x7fb718109220 2024-08-31T04:14:02.836 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:01.660+0000 7fb71ee00640 1 -- 172.21.15.50:0/1913113764 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb7181a20b0 con 0x7fb718109220 2024-08-31T04:14:02.836 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:01.661+0000 7fb71ee00640 1 -- 172.21.15.50:0/1913113764 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb7180ff8a0 con 0x7fb718109220 2024-08-31T04:14:02.836 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:01.661+0000 7fb714c00640 1 -- 172.21.15.50:0/1913113764 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 13) ==== 51253+0+0 (secure 0 0 0) 0x7fb710010830 con 0x7fb718109220 2024-08-31T04:14:02.837 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:01.662+0000 7fb714c00640 1 --2- 172.21.15.50:0/1913113764 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fb6fc03f280 0x7fb6fc041790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:14:02.837 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:01.662+0000 7fb714c00640 1 -- 172.21.15.50:0/1913113764 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fb7100542b0 con 0x7fb718109220 2024-08-31T04:14:02.837 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:01.662+0000 7fb717e00640 1 --2- 172.21.15.50:0/1913113764 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fb6fc03f280 0x7fb6fc041790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:14:02.837 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:01.663+0000 7fb717e00640 1 --2- 172.21.15.50:0/1913113764 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fb6fc03f280 0x7fb6fc041790 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fb708000c00 tx=0x7fb708031400 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:14:02.837 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:01.667+0000 7fb714c00640 1 -- 172.21.15.50:0/1913113764 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fb7100203a0 con 0x7fb718109220 2024-08-31T04:14:02.837 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:01.867+0000 7fb71ee00640 1 -- 172.21.15.50:0/1913113764 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command([{prefix=config set, name=rados_osd_op_timeout}] v 0) -- 0x7fb718063d60 con 0x7fb718109220 2024-08-31T04:14:02.837 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:01.871+0000 7fb714c00640 1 -- 172.21.15.50:0/1913113764 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{prefix=config set, name=rados_osd_op_timeout}]=0 v15)=0 v15) ==== 123+0+0 (secure 0 0 0) 0x7fb710005240 con 0x7fb718109220 2024-08-31T04:14:02.837 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:01.872+0000 7fb714c00640 1 -- 172.21.15.50:0/1913113764 <== mon.0 v2:172.21.15.50:3300/0 8 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb710016df0 con 0x7fb718109220 2024-08-31T04:14:02.837 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:01.873+0000 7fb71ee00640 1 -- 172.21.15.50:0/1913113764 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fb6fc03f280 msgr2=0x7fb6fc041790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:14:02.837 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:01.873+0000 7fb71ee00640 1 --2- 172.21.15.50:0/1913113764 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fb6fc03f280 0x7fb6fc041790 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fb708000c00 tx=0x7fb708031400 comp rx=0 tx=0).stop 2024-08-31T04:14:02.837 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:01.873+0000 7fb71ee00640 1 -- 172.21.15.50:0/1913113764 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb718109220 msgr2=0x7fb71819aea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:14:02.837 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:01.873+0000 7fb71ee00640 1 --2- 172.21.15.50:0/1913113764 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb718109220 0x7fb71819aea0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fb710009fd0 tx=0x7fb71000ef10 comp rx=0 tx=0).stop 2024-08-31T04:14:02.837 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:01.873+0000 7fb71ee00640 1 -- 172.21.15.50:0/1913113764 shutdown_connections 2024-08-31T04:14:02.838 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:01.873+0000 7fb71ee00640 1 --2- 172.21.15.50:0/1913113764 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fb6fc03f280 0x7fb6fc041790 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:14:02.838 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:01.873+0000 7fb71ee00640 1 --2- 172.21.15.50:0/1913113764 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb718106680 0x7fb71819a370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:14:02.838 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:01.873+0000 7fb71ee00640 1 --2- 172.21.15.50:0/1913113764 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb718109220 0x7fb71819aea0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:14:02.838 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:01.873+0000 7fb71ee00640 1 --2- 172.21.15.50:0/1913113764 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb71806c400 0x7fb718199d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:14:02.838 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:01.873+0000 7fb71ee00640 1 -- 172.21.15.50:0/1913113764 >> 172.21.15.50:0/1913113764 conn(0x7fb7180fdd80 msgr2=0x7fb718104c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:14:02.838 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:01.873+0000 7fb71ee00640 1 -- 172.21.15.50:0/1913113764 shutdown_connections 2024-08-31T04:14:02.838 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:01.874+0000 7fb71ee00640 1 -- 172.21.15.50:0/1913113764 wait complete. 2024-08-31T04:14:02.980 INFO:journalctl@ceph.mgr.z.smithi177.stdout:Aug 31 04:14:02 smithi177 systemd[1]: Starting Ceph mgr.z for 058d9fc6-674f-11ef-bcd4-c7b262605968... 2024-08-31T04:14:03.235 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:14:03.236 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:14:03.246 INFO:journalctl@ceph.mgr.z.smithi177.stdout:Aug 31 04:14:02 smithi177 podman[23589]: 2024-08-31 04:14:02.979439635 +0000 UTC m=+0.097667832 container create c614be5564d8223444a452cfa4e3374a145147de5c22c4d785b6993bc1709d8e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-mgr-z, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, ceph=True, org.label-schema.build-date=20240731, io.buildah.version=1.37.1, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True) 2024-08-31T04:14:03.246 INFO:journalctl@ceph.mgr.z.smithi177.stdout:Aug 31 04:14:02 smithi177 podman[23589]: 2024-08-31 04:14:02.897313149 +0000 UTC m=+0.015541359 image pull 79f4cde5e36911a5dca995eeb98098c2c8aae81dd52a088ef2c867bc3363bad0 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61 2024-08-31T04:14:03.246 INFO:journalctl@ceph.mgr.z.smithi177.stdout:Aug 31 04:14:03 smithi177 podman[23589]: 2024-08-31 04:14:03.181618602 +0000 UTC m=+0.299846799 container init c614be5564d8223444a452cfa4e3374a145147de5c22c4d785b6993bc1709d8e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-mgr-z, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_CLEAN=True, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, io.buildah.version=1.37.1, org.label-schema.license=GPLv2, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731) 2024-08-31T04:14:03.246 INFO:journalctl@ceph.mgr.z.smithi177.stdout:Aug 31 04:14:03 smithi177 podman[23589]: 2024-08-31 04:14:03.184751607 +0000 UTC m=+0.302979816 container start c614be5564d8223444a452cfa4e3374a145147de5c22c4d785b6993bc1709d8e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-mgr-z, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, io.buildah.version=1.37.1, org.label-schema.license=GPLv2, GIT_CLEAN=True, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=) 2024-08-31T04:14:03.246 INFO:journalctl@ceph.mgr.z.smithi177.stdout:Aug 31 04:14:03 smithi177 ceph-mgr[23608]: -- 172.21.15.177:0/2675602988 <== mon.1 v2:172.21.15.177:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x56264f3270e0 con 0x56264f345a80 2024-08-31T04:14:03.449 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:14:03 smithi050 ceph-mon[17259]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T04:14:03.542 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:14:03 smithi133 ceph-mon[22177]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T04:14:03.594 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:14:03.595 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:14:03.597 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:14:03.597 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:14:03.598 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:14:03.600 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:14:03.603 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:14:03.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:14:03 smithi177 ceph-mon[22025]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T04:14:03.746 INFO:journalctl@ceph.mgr.z.smithi177.stdout:Aug 31 04:14:03 smithi177 bash[23589]: c614be5564d8223444a452cfa4e3374a145147de5c22c4d785b6993bc1709d8e 2024-08-31T04:14:03.746 INFO:journalctl@ceph.mgr.z.smithi177.stdout:Aug 31 04:14:03 smithi177 systemd[1]: Started Ceph mgr.z for 058d9fc6-674f-11ef-bcd4-c7b262605968. 2024-08-31T04:14:04.479 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:04.142+0000 7f2c95800640 1 -- 172.21.15.50:0/2862398009 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2c90104d80 msgr2=0x7f2c9010b720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:14:04.479 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:04.142+0000 7f2c95800640 1 --2- 172.21.15.50:0/2862398009 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2c90104d80 0x7f2c9010b720 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f2c88009ca0 tx=0x7f2c8802a950 comp rx=0 tx=0).stop 2024-08-31T04:14:04.479 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:04.143+0000 7f2c95800640 1 -- 172.21.15.50:0/2862398009 shutdown_connections 2024-08-31T04:14:04.479 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:04.143+0000 7f2c95800640 1 --2- 172.21.15.50:0/2862398009 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2c90104d80 0x7f2c9010b720 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:14:04.479 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:04.143+0000 7f2c95800640 1 --2- 172.21.15.50:0/2862398009 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2c901043e0 0x7f2c901047f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:14:04.479 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:04.143+0000 7f2c95800640 1 --2- 172.21.15.50:0/2862398009 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2c90103350 0x7f2c901037c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:14:04.479 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:04.143+0000 7f2c95800640 1 -- 172.21.15.50:0/2862398009 >> 172.21.15.50:0/2862398009 conn(0x7f2c900fecc0 msgr2=0x7f2c90101170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:14:04.479 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:04.143+0000 7f2c95800640 1 -- 172.21.15.50:0/2862398009 shutdown_connections 2024-08-31T04:14:04.479 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:04.143+0000 7f2c95800640 1 -- 172.21.15.50:0/2862398009 wait complete. 2024-08-31T04:14:04.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:04.144+0000 7f2c95800640 1 Processor -- start 2024-08-31T04:14:04.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:04.144+0000 7f2c95800640 1 -- start start 2024-08-31T04:14:04.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:04.144+0000 7f2c95800640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2c90103350 0x7f2c90076be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:14:04.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:04.144+0000 7f2c95800640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2c901043e0 0x7f2c900754b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:14:04.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:04.144+0000 7f2c95800640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2c90104d80 0x7f2c900759f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:14:04.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:04.144+0000 7f2c95800640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f2c9010f000 con 0x7f2c90103350 2024-08-31T04:14:04.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:04.144+0000 7f2c95800640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f2c9010ee80 con 0x7f2c90104d80 2024-08-31T04:14:04.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:04.144+0000 7f2c95800640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f2c9010f180 con 0x7f2c901043e0 2024-08-31T04:14:04.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:04.144+0000 7f2c8f400640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2c901043e0 0x7f2c900754b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:14:04.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:04.144+0000 7f2c8fe00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2c90103350 0x7f2c90076be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:14:04.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:04.144+0000 7f2c8f400640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2c901043e0 0x7f2c900754b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.50:40840/0 (socket says 172.21.15.50:40840) 2024-08-31T04:14:04.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:04.144+0000 7f2c8fe00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2c90103350 0x7f2c90076be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36558/0 (socket says 172.21.15.50:36558) 2024-08-31T04:14:04.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:04.144+0000 7f2c8f400640 1 -- 172.21.15.50:0/2855414478 learned_addr learned my addr 172.21.15.50:0/2855414478 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:14:04.481 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:04.144+0000 7f2c94e00640 1 --2- 172.21.15.50:0/2855414478 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2c90104d80 0x7f2c900759f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:14:04.481 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:04.145+0000 7f2c8f400640 1 -- 172.21.15.50:0/2855414478 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2c90104d80 msgr2=0x7f2c900759f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:14:04.481 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:04.145+0000 7f2c8f400640 1 --2- 172.21.15.50:0/2855414478 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2c90104d80 0x7f2c900759f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:14:04.481 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:04.145+0000 7f2c8f400640 1 -- 172.21.15.50:0/2855414478 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2c90103350 msgr2=0x7f2c90076be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:14:04.481 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:04.145+0000 7f2c8f400640 1 --2- 172.21.15.50:0/2855414478 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2c90103350 0x7f2c90076be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:14:04.481 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:04.145+0000 7f2c8f400640 1 -- 172.21.15.50:0/2855414478 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c900760f0 con 0x7f2c901043e0 2024-08-31T04:14:04.481 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:04.145+0000 7f2c8fe00640 1 --2- 172.21.15.50:0/2855414478 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2c90103350 0x7f2c90076be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:14:04.481 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:04.145+0000 7f2c8f400640 1 --2- 172.21.15.50:0/2855414478 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2c901043e0 0x7f2c900754b0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f2c7c00ea60 tx=0x7f2c7c00ef20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:14:04.481 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:04.145+0000 7f2c8cc00640 1 -- 172.21.15.50:0/2855414478 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c7c00cde0 con 0x7f2c901043e0 2024-08-31T04:14:04.481 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:04.145+0000 7f2c8cc00640 1 -- 172.21.15.50:0/2855414478 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2c7c0035f0 con 0x7f2c901043e0 2024-08-31T04:14:04.481 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:04.145+0000 7f2c8cc00640 1 -- 172.21.15.50:0/2855414478 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c7c010690 con 0x7f2c901043e0 2024-08-31T04:14:04.481 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:04.145+0000 7f2c95800640 1 -- 172.21.15.50:0/2855414478 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2c901a3bc0 con 0x7f2c901043e0 2024-08-31T04:14:04.481 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:04.146+0000 7f2c95800640 1 -- 172.21.15.50:0/2855414478 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2c901a4020 con 0x7f2c901043e0 2024-08-31T04:14:04.482 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:04.147+0000 7f2c95800640 1 -- 172.21.15.50:0/2855414478 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2c9010a510 con 0x7f2c901043e0 2024-08-31T04:14:04.482 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:04.147+0000 7f2c8cc00640 1 -- 172.21.15.50:0/2855414478 <== mon.1 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 13) ==== 51253+0+0 (secure 0 0 0) 0x7f2c7c010830 con 0x7f2c901043e0 2024-08-31T04:14:04.482 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:04.147+0000 7f2c8cc00640 1 --2- 172.21.15.50:0/2855414478 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f2c7403f280 0x7f2c74041790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:14:04.482 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:04.148+0000 7f2c8cc00640 1 -- 172.21.15.50:0/2855414478 <== mon.1 v2:172.21.15.177:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f2c7c053df0 con 0x7f2c901043e0 2024-08-31T04:14:04.482 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:04.148+0000 7f2c8fe00640 1 --2- 172.21.15.50:0/2855414478 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f2c7403f280 0x7f2c74041790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:14:04.482 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:04.148+0000 7f2c8fe00640 1 --2- 172.21.15.50:0/2855414478 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f2c7403f280 0x7f2c74041790 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f2c800095f0 tx=0x7f2c80005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:14:04.482 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:04.153+0000 7f2c8cc00640 1 -- 172.21.15.50:0/2855414478 <== mon.1 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f2c7c003ac0 con 0x7f2c901043e0 2024-08-31T04:14:04.482 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:04.358+0000 7f2c95800640 1 -- 172.21.15.50:0/2855414478 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command([{prefix=config set, name=mds_debug_frag}] v 0) -- 0x7f2c9002e430 con 0x7f2c901043e0 2024-08-31T04:14:04.482 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:04.363+0000 7f2c8cc00640 1 -- 172.21.15.50:0/2855414478 <== mon.1 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_debug_frag}]=0 v16)=0 v16) ==== 115+0+0 (secure 0 0 0) 0x7f2c7c004020 con 0x7f2c901043e0 2024-08-31T04:14:04.482 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:04.365+0000 7f2c95800640 1 -- 172.21.15.50:0/2855414478 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f2c7403f280 msgr2=0x7f2c74041790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:14:04.482 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:04.365+0000 7f2c95800640 1 --2- 172.21.15.50:0/2855414478 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f2c7403f280 0x7f2c74041790 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f2c800095f0 tx=0x7f2c80005f90 comp rx=0 tx=0).stop 2024-08-31T04:14:04.482 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:04.365+0000 7f2c95800640 1 -- 172.21.15.50:0/2855414478 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2c901043e0 msgr2=0x7f2c900754b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:14:04.482 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:04.365+0000 7f2c95800640 1 --2- 172.21.15.50:0/2855414478 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2c901043e0 0x7f2c900754b0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f2c7c00ea60 tx=0x7f2c7c00ef20 comp rx=0 tx=0).stop 2024-08-31T04:14:04.482 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:04.365+0000 7f2c95800640 1 -- 172.21.15.50:0/2855414478 shutdown_connections 2024-08-31T04:14:04.483 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:04.366+0000 7f2c95800640 1 --2- 172.21.15.50:0/2855414478 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f2c7403f280 0x7f2c74041790 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:14:04.483 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:04.366+0000 7f2c95800640 1 --2- 172.21.15.50:0/2855414478 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2c901043e0 0x7f2c900754b0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:14:04.483 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:04.366+0000 7f2c95800640 1 --2- 172.21.15.50:0/2855414478 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2c90104d80 0x7f2c900759f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:14:04.483 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:04.366+0000 7f2c95800640 1 --2- 172.21.15.50:0/2855414478 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2c90103350 0x7f2c90076be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:14:04.483 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:04.366+0000 7f2c95800640 1 -- 172.21.15.50:0/2855414478 >> 172.21.15.50:0/2855414478 conn(0x7f2c900fecc0 msgr2=0x7f2c901076e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:14:04.483 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:04.366+0000 7f2c95800640 1 -- 172.21.15.50:0/2855414478 shutdown_connections 2024-08-31T04:14:04.483 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:04.366+0000 7f2c95800640 1 -- 172.21.15.50:0/2855414478 wait complete. 2024-08-31T04:14:04.602 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:14:04 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:14:04.602 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:14:04 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:14:04.602 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:14:04 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:14:04.602 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:14:04 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-08-31T04:14:04.602 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:14:04 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-08-31T04:14:04.602 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:14:04 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-08-31T04:14:04.602 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:14:04 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:14:04.602 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:14:04 smithi177 ceph-mon[22025]: Deploying daemon mgr.y on smithi133 2024-08-31T04:14:04.672 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:14:04 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:14:04.672 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:14:04 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:14:04.673 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:14:04 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:14:04.673 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:14:04 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-08-31T04:14:04.673 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:14:04 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-08-31T04:14:04.673 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:14:04 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-08-31T04:14:04.673 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:14:04 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:14:04.673 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:14:04 smithi133 ceph-mon[22177]: Deploying daemon mgr.y on smithi133 2024-08-31T04:14:04.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:14:04 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:14:04.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:14:04 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:14:04.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:14:04 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:14:04.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:14:04 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-08-31T04:14:04.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:14:04 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-08-31T04:14:04.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:14:04 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-08-31T04:14:04.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:14:04 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:14:04.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:14:04 smithi050 ceph-mon[17259]: Deploying daemon mgr.y on smithi133 2024-08-31T04:14:05.293 INFO:journalctl@ceph.mgr.y.smithi133.stdout:Aug 31 04:14:05 smithi133 systemd[1]: Starting Ceph mgr.y for 058d9fc6-674f-11ef-bcd4-c7b262605968... 2024-08-31T04:14:05.572 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:14:05 smithi133 ceph-mon[22177]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T04:14:05.572 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:14:05 smithi133 ceph-mon[22177]: from='client.? ' entity='client.admin' 2024-08-31T04:14:05.573 INFO:journalctl@ceph.mgr.y.smithi133.stdout:Aug 31 04:14:05 smithi133 podman[23299]: 2024-08-31 04:14:05.317775783 +0000 UTC m=+0.112523175 container create 2f9584956e14ad03d24fcac0d62bba60809c4742b7c2dd4cefde39e319de68bb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-mgr-y, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, ceph=True, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.1, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image) 2024-08-31T04:14:05.573 INFO:journalctl@ceph.mgr.y.smithi133.stdout:Aug 31 04:14:05 smithi133 podman[23299]: 2024-08-31 04:14:05.220746195 +0000 UTC m=+0.015493542 image pull 79f4cde5e36911a5dca995eeb98098c2c8aae81dd52a088ef2c867bc3363bad0 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61 2024-08-31T04:14:05.573 INFO:journalctl@ceph.mgr.y.smithi133.stdout:Aug 31 04:14:05 smithi133 podman[23299]: 2024-08-31 04:14:05.534682703 +0000 UTC m=+0.329430039 container init 2f9584956e14ad03d24fcac0d62bba60809c4742b7c2dd4cefde39e319de68bb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-mgr-y, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, io.buildah.version=1.37.1, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, maintainer=Guillaume Abrioux ) 2024-08-31T04:14:05.573 INFO:journalctl@ceph.mgr.y.smithi133.stdout:Aug 31 04:14:05 smithi133 podman[23299]: 2024-08-31 04:14:05.537867903 +0000 UTC m=+0.332615242 container start 2f9584956e14ad03d24fcac0d62bba60809c4742b7c2dd4cefde39e319de68bb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-mgr-y, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.schema-version=1.0, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.1, org.label-schema.build-date=20240731) 2024-08-31T04:14:05.573 INFO:journalctl@ceph.mgr.y.smithi133.stdout:Aug 31 04:14:05 smithi133 ceph-mgr[23318]: -- 172.21.15.133:0/1629954331 <== mon.2 v2:172.21.15.133:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55ffbe7ab0e0 con 0x55ffc354a000 2024-08-31T04:14:05.606 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '058d9fc6-674f-11ef-bcd4-c7b262605968', '--', 'ceph', 'config', 'set', 'client', 'debug_client', '20'], check_status=True, hostname='smithi050') 2024-08-31T04:14:05.606 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '058d9fc6-674f-11ef-bcd4-c7b262605968', '--', 'ceph', 'config', 'set', 'client', 'debug_ms', '1'], check_status=True, hostname='smithi050') 2024-08-31T04:14:05.606 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '058d9fc6-674f-11ef-bcd4-c7b262605968', '--', 'ceph', 'config', 'set', 'client', 'rados_mon_op_timeout', '900'], check_status=True, hostname='smithi050') 2024-08-31T04:14:05.606 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '058d9fc6-674f-11ef-bcd4-c7b262605968', '--', 'ceph', 'config', 'set', 'client', 'rados_osd_op_timeout', '900'], check_status=True, hostname='smithi050') 2024-08-31T04:14:05.629 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:14:05 smithi050 ceph-mon[17259]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T04:14:05.629 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:14:05 smithi050 ceph-mon[17259]: from='client.? ' entity='client.admin' 2024-08-31T04:14:05.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:14:05 smithi177 ceph-mon[22025]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T04:14:05.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:14:05 smithi177 ceph-mon[22025]: from='client.? ' entity='client.admin' 2024-08-31T04:14:05.880 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:05.878+0000 7febaca00640 1 -- 172.21.15.50:0/2394368378 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feba8105720 msgr2=0x7feba8105b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:14:05.880 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:05.878+0000 7febaca00640 1 --2- 172.21.15.50:0/2394368378 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feba8105720 0x7feba8105b90 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7feb98009900 tx=0x7feb9802a480 comp rx=0 tx=0).stop 2024-08-31T04:14:05.880 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:05.878+0000 7febaca00640 1 -- 172.21.15.50:0/2394368378 shutdown_connections 2024-08-31T04:14:05.880 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:05.878+0000 7febaca00640 1 --2- 172.21.15.50:0/2394368378 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7feba8107150 0x7feba810daf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:14:05.880 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:05.878+0000 7febaca00640 1 --2- 172.21.15.50:0/2394368378 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feba81067b0 0x7feba8106bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:14:05.881 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:05.878+0000 7febaca00640 1 --2- 172.21.15.50:0/2394368378 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feba8105720 0x7feba8105b90 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:14:05.881 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:05.878+0000 7febaca00640 1 -- 172.21.15.50:0/2394368378 >> 172.21.15.50:0/2394368378 conn(0x7feba8101090 msgr2=0x7feba8103540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:14:05.881 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:05.878+0000 7febaca00640 1 -- 172.21.15.50:0/2394368378 shutdown_connections 2024-08-31T04:14:05.881 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:05.878+0000 7febaca00640 1 -- 172.21.15.50:0/2394368378 wait complete. 2024-08-31T04:14:05.882 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:05.879+0000 7febaca00640 1 Processor -- start 2024-08-31T04:14:05.882 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:05.880+0000 7febaca00640 1 -- start start 2024-08-31T04:14:05.882 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:05.880+0000 7febaca00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7feba8105720 0x7feba819bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:14:05.882 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:05.880+0000 7febaca00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feba81067b0 0x7feba819c5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:14:05.882 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:05.880+0000 7febaca00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feba8107150 0x7feba819d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:14:05.882 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:05.880+0000 7febaca00640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7feba8111390 con 0x7feba81067b0 2024-08-31T04:14:05.883 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:05.880+0000 7febaca00640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7feba8111210 con 0x7feba8107150 2024-08-31T04:14:05.883 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:05.880+0000 7febaca00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7feba8111510 con 0x7feba8105720 2024-08-31T04:14:05.883 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:05.880+0000 7feba5e00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7feba8105720 0x7feba819bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:14:05.883 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:05.880+0000 7feba5400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feba81067b0 0x7feba819c5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:14:05.883 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:05.880+0000 7feba5e00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7feba8105720 0x7feba819bf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.50:40902/0 (socket says 172.21.15.50:40902) 2024-08-31T04:14:05.883 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:05.880+0000 7feba5e00640 1 -- 172.21.15.50:0/3484515462 learned_addr learned my addr 172.21.15.50:0/3484515462 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:14:05.883 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:05.880+0000 7feba6800640 1 --2- 172.21.15.50:0/3484515462 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feba8107150 0x7feba819d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:14:05.883 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:05.881+0000 7feba5e00640 1 -- 172.21.15.50:0/3484515462 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feba8107150 msgr2=0x7feba819d190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:14:05.883 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:05.881+0000 7feba5e00640 1 --2- 172.21.15.50:0/3484515462 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feba8107150 0x7feba819d190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:14:05.883 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:05.881+0000 7feba5e00640 1 -- 172.21.15.50:0/3484515462 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feba81067b0 msgr2=0x7feba819c5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:14:05.883 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:05.881+0000 7feba5e00640 1 --2- 172.21.15.50:0/3484515462 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feba81067b0 0x7feba819c5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:14:05.883 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:05.881+0000 7feba5e00640 1 -- 172.21.15.50:0/3484515462 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feba819d9b0 con 0x7feba8105720 2024-08-31T04:14:05.884 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:05.881+0000 7feba5e00640 1 --2- 172.21.15.50:0/3484515462 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7feba8105720 0x7feba819bf80 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7feb98031440 tx=0x7feb98003c10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:14:05.884 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:05.881+0000 7feb9ea00640 1 -- 172.21.15.50:0/3484515462 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb9803f070 con 0x7feba8105720 2024-08-31T04:14:05.884 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:05.881+0000 7febaca00640 1 -- 172.21.15.50:0/3484515462 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feba819dc40 con 0x7feba8105720 2024-08-31T04:14:05.884 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:05.881+0000 7feb9ea00640 1 -- 172.21.15.50:0/3484515462 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7feb98031c50 con 0x7feba8105720 2024-08-31T04:14:05.885 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:05.881+0000 7feb9ea00640 1 -- 172.21.15.50:0/3484515462 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb98035030 con 0x7feba8105720 2024-08-31T04:14:05.885 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:05.882+0000 7febaca00640 1 -- 172.21.15.50:0/3484515462 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feba81a41d0 con 0x7feba8105720 2024-08-31T04:14:05.885 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:05.883+0000 7feb9ea00640 1 -- 172.21.15.50:0/3484515462 <== mon.1 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 13) ==== 51253+0+0 (secure 0 0 0) 0x7feb98042070 con 0x7feba8105720 2024-08-31T04:14:05.885 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:05.883+0000 7febaca00640 1 -- 172.21.15.50:0/3484515462 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feba810c900 con 0x7feba8105720 2024-08-31T04:14:05.885 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:05.883+0000 7feb9ea00640 1 --2- 172.21.15.50:0/3484515462 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7feb8c03f280 0x7feb8c041790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:14:05.885 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:05.883+0000 7feb9ea00640 1 -- 172.21.15.50:0/3484515462 <== mon.1 v2:172.21.15.177:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7feb980742f0 con 0x7feba8105720 2024-08-31T04:14:05.885 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:05.884+0000 7feba5400640 1 --2- 172.21.15.50:0/3484515462 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7feb8c03f280 0x7feb8c041790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:14:05.886 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:05.884+0000 7feba5400640 1 --2- 172.21.15.50:0/3484515462 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7feb8c03f280 0x7feb8c041790 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7feb94009bd0 tx=0x7feb94005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:14:05.894 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:05.893+0000 7feb9ea00640 1 -- 172.21.15.50:0/3484515462 <== mon.1 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7feb98039e10 con 0x7feba8105720 2024-08-31T04:14:06.043 INFO:journalctl@ceph.mgr.y.smithi133.stdout:Aug 31 04:14:05 smithi133 bash[23299]: 2f9584956e14ad03d24fcac0d62bba60809c4742b7c2dd4cefde39e319de68bb 2024-08-31T04:14:06.043 INFO:journalctl@ceph.mgr.y.smithi133.stdout:Aug 31 04:14:05 smithi133 systemd[1]: Started Ceph mgr.y for 058d9fc6-674f-11ef-bcd4-c7b262605968. 2024-08-31T04:14:06.095 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:06.093+0000 7febaca00640 1 -- 172.21.15.50:0/3484515462 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command([{prefix=config set, name=osd_op_complaint_time}] v 0) -- 0x7feba802e430 con 0x7feba8105720 2024-08-31T04:14:06.102 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:06.101+0000 7feb9ea00640 1 -- 172.21.15.50:0/3484515462 <== mon.1 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_op_complaint_time}]=0 v19)=0 v19) ==== 121+0+0 (secure 0 0 0) 0x7feb98036da0 con 0x7feba8105720 2024-08-31T04:14:06.105 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:06.103+0000 7febaca00640 1 -- 172.21.15.50:0/3484515462 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7feb8c03f280 msgr2=0x7feb8c041790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:14:06.105 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:06.103+0000 7febaca00640 1 --2- 172.21.15.50:0/3484515462 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7feb8c03f280 0x7feb8c041790 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7feb94009bd0 tx=0x7feb94005f90 comp rx=0 tx=0).stop 2024-08-31T04:14:06.105 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:06.103+0000 7febaca00640 1 -- 172.21.15.50:0/3484515462 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7feba8105720 msgr2=0x7feba819bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:14:06.105 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:06.103+0000 7febaca00640 1 --2- 172.21.15.50:0/3484515462 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7feba8105720 0x7feba819bf80 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7feb98031440 tx=0x7feb98003c10 comp rx=0 tx=0).stop 2024-08-31T04:14:06.106 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:06.104+0000 7febaca00640 1 -- 172.21.15.50:0/3484515462 shutdown_connections 2024-08-31T04:14:06.106 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:06.104+0000 7febaca00640 1 --2- 172.21.15.50:0/3484515462 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7feb8c03f280 0x7feb8c041790 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:14:06.106 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:06.104+0000 7febaca00640 1 --2- 172.21.15.50:0/3484515462 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feba8107150 0x7feba819d190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:14:06.106 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:06.104+0000 7febaca00640 1 --2- 172.21.15.50:0/3484515462 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feba81067b0 0x7feba819c5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:14:06.106 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:06.104+0000 7febaca00640 1 --2- 172.21.15.50:0/3484515462 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7feba8105720 0x7feba819bf80 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:14:06.106 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:06.104+0000 7febaca00640 1 -- 172.21.15.50:0/3484515462 >> 172.21.15.50:0/3484515462 conn(0x7feba8101090 msgr2=0x7feba8109ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:14:06.106 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:06.104+0000 7febaca00640 1 -- 172.21.15.50:0/3484515462 shutdown_connections 2024-08-31T04:14:06.106 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:06.104+0000 7febaca00640 1 -- 172.21.15.50:0/3484515462 wait complete. 2024-08-31T04:14:06.551 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:05.398+0000 7f9257200640 1 -- 172.21.15.50:0/2456530363 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9258103310 msgr2=0x7f9258103780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:14:06.551 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:05.398+0000 7f9257200640 1 --2- 172.21.15.50:0/2456530363 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9258103310 0x7f9258103780 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f9248009900 tx=0x7f924802a480 comp rx=0 tx=0).stop 2024-08-31T04:14:06.551 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:05.398+0000 7f9257200640 1 -- 172.21.15.50:0/2456530363 shutdown_connections 2024-08-31T04:14:06.551 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:05.398+0000 7f9257200640 1 --2- 172.21.15.50:0/2456530363 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9258104d40 0x7f925810b6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:14:06.552 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:05.398+0000 7f9257200640 1 --2- 172.21.15.50:0/2456530363 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f92581043a0 0x7f92581047b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:14:06.552 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:05.398+0000 7f9257200640 1 --2- 172.21.15.50:0/2456530363 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9258103310 0x7f9258103780 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:14:06.552 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:05.398+0000 7f9257200640 1 -- 172.21.15.50:0/2456530363 >> 172.21.15.50:0/2456530363 conn(0x7f92580fec60 msgr2=0x7f9258101130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:14:06.552 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:05.398+0000 7f9257200640 1 -- 172.21.15.50:0/2456530363 shutdown_connections 2024-08-31T04:14:06.552 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:05.398+0000 7f9257200640 1 -- 172.21.15.50:0/2456530363 wait complete. 2024-08-31T04:14:06.552 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:05.400+0000 7f9257200640 1 Processor -- start 2024-08-31T04:14:06.552 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:05.400+0000 7f9257200640 1 -- start start 2024-08-31T04:14:06.552 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:05.400+0000 7f9257200640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9258103310 0x7f9258199b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:14:06.552 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:05.401+0000 7f9257200640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f92581043a0 0x7f925819a1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:14:06.553 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:05.401+0000 7f9257200640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9258104d40 0x7f925819ad70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:14:06.553 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:05.401+0000 7f9257200640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f925810ef70 con 0x7f9258103310 2024-08-31T04:14:06.553 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:05.401+0000 7f9257200640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f925810edf0 con 0x7f92581043a0 2024-08-31T04:14:06.553 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:05.401+0000 7f9257200640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f925810f0f0 con 0x7f9258104d40 2024-08-31T04:14:06.553 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:05.401+0000 7f9255e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9258103310 0x7f9258199b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:14:06.553 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:05.401+0000 7f9255400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f92581043a0 0x7f925819a1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:14:06.553 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:05.401+0000 7f9256800640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9258104d40 0x7f925819ad70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:14:06.553 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:05.401+0000 7f9255e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9258103310 0x7f9258199b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36594/0 (socket says 172.21.15.50:36594) 2024-08-31T04:14:06.553 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:05.401+0000 7f9255e00640 1 -- 172.21.15.50:0/545855187 learned_addr learned my addr 172.21.15.50:0/545855187 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:14:06.553 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:05.401+0000 7f9255400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f92581043a0 0x7f925819a1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.50:56270/0 (socket says 172.21.15.50:56270) 2024-08-31T04:14:06.553 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:05.401+0000 7f9255400640 1 -- 172.21.15.50:0/545855187 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9258104d40 msgr2=0x7f925819ad70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:14:06.553 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:05.401+0000 7f9255400640 1 --2- 172.21.15.50:0/545855187 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9258104d40 0x7f925819ad70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:14:06.554 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:05.401+0000 7f9255400640 1 -- 172.21.15.50:0/545855187 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9258103310 msgr2=0x7f9258199b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:14:06.554 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:05.401+0000 7f9255400640 1 --2- 172.21.15.50:0/545855187 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9258103310 0x7f9258199b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:14:06.554 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:05.401+0000 7f9255400640 1 -- 172.21.15.50:0/545855187 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f925819b590 con 0x7f92581043a0 2024-08-31T04:14:06.554 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:05.401+0000 7f9255e00640 1 --2- 172.21.15.50:0/545855187 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9258103310 0x7f9258199b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:14:06.554 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:05.402+0000 7f9255400640 1 --2- 172.21.15.50:0/545855187 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f92581043a0 0x7f925819a1d0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f924400e9f0 tx=0x7f924400eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:14:06.554 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:05.402+0000 7f924ea00640 1 -- 172.21.15.50:0/545855187 <== mon.2 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f924400cd80 con 0x7f92581043a0 2024-08-31T04:14:06.554 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:05.402+0000 7f924ea00640 1 -- 172.21.15.50:0/545855187 <== mon.2 v2:172.21.15.133:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f92440035f0 con 0x7f92581043a0 2024-08-31T04:14:06.554 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:05.402+0000 7f9257200640 1 -- 172.21.15.50:0/545855187 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f925819b880 con 0x7f92581043a0 2024-08-31T04:14:06.554 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:05.402+0000 7f924ea00640 1 -- 172.21.15.50:0/545855187 <== mon.2 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9244010670 con 0x7f92581043a0 2024-08-31T04:14:06.554 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:05.402+0000 7f9257200640 1 -- 172.21.15.50:0/545855187 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f92581a1f80 con 0x7f92581043a0 2024-08-31T04:14:06.554 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:05.403+0000 7f924ea00640 1 -- 172.21.15.50:0/545855187 <== mon.2 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 13) ==== 51253+0+0 (secure 0 0 0) 0x7f92440108d0 con 0x7f92581043a0 2024-08-31T04:14:06.554 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:05.403+0000 7f9257200640 1 -- 172.21.15.50:0/545855187 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f925810a4f0 con 0x7f92581043a0 2024-08-31T04:14:06.555 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:05.404+0000 7f924ea00640 1 --2- 172.21.15.50:0/545855187 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f923c03f280 0x7f923c041790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:14:06.555 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:05.404+0000 7f924ea00640 1 -- 172.21.15.50:0/545855187 <== mon.2 v2:172.21.15.133:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f9244053ca0 con 0x7f92581043a0 2024-08-31T04:14:06.555 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:05.404+0000 7f9255e00640 1 --2- 172.21.15.50:0/545855187 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f923c03f280 0x7f923c041790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:14:06.555 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:05.405+0000 7f9255e00640 1 --2- 172.21.15.50:0/545855187 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f923c03f280 0x7f923c041790 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f9248032fd0 tx=0x7f92480314a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:14:06.555 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:05.409+0000 7f924ea00640 1 -- 172.21.15.50:0/545855187 <== mon.2 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f9244013190 con 0x7f92581043a0 2024-08-31T04:14:06.555 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:05.628+0000 7f9257200640 1 -- 172.21.15.50:0/545855187 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command([{prefix=config set, name=debug_mds}] v 0) -- 0x7f925802e430 con 0x7f92581043a0 2024-08-31T04:14:06.555 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:05.633+0000 7f924ea00640 1 -- 172.21.15.50:0/545855187 <== mon.2 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_mds}]=0 v18)=0 v18) ==== 108+0+0 (secure 0 0 0) 0x7f9244009370 con 0x7f92581043a0 2024-08-31T04:14:06.555 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:05.637+0000 7f9257200640 1 -- 172.21.15.50:0/545855187 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f923c03f280 msgr2=0x7f923c041790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:14:06.555 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:05.637+0000 7f9257200640 1 --2- 172.21.15.50:0/545855187 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f923c03f280 0x7f923c041790 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f9248032fd0 tx=0x7f92480314a0 comp rx=0 tx=0).stop 2024-08-31T04:14:06.555 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:05.637+0000 7f9257200640 1 -- 172.21.15.50:0/545855187 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f92581043a0 msgr2=0x7f925819a1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:14:06.555 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:05.637+0000 7f9257200640 1 --2- 172.21.15.50:0/545855187 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f92581043a0 0x7f925819a1d0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f924400e9f0 tx=0x7f924400eeb0 comp rx=0 tx=0).stop 2024-08-31T04:14:06.555 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:05.637+0000 7f9257200640 1 -- 172.21.15.50:0/545855187 shutdown_connections 2024-08-31T04:14:06.556 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:05.637+0000 7f9257200640 1 --2- 172.21.15.50:0/545855187 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f923c03f280 0x7f923c041790 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:14:06.556 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:05.637+0000 7f9257200640 1 --2- 172.21.15.50:0/545855187 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9258104d40 0x7f925819ad70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:14:06.556 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:05.637+0000 7f9257200640 1 --2- 172.21.15.50:0/545855187 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f92581043a0 0x7f925819a1d0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:14:06.556 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:05.637+0000 7f9257200640 1 --2- 172.21.15.50:0/545855187 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9258103310 0x7f9258199b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:14:06.556 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:05.637+0000 7f9257200640 1 -- 172.21.15.50:0/545855187 >> 172.21.15.50:0/545855187 conn(0x7f92580fec60 msgr2=0x7f92581076c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:14:06.556 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:05.637+0000 7f9257200640 1 -- 172.21.15.50:0/545855187 shutdown_connections 2024-08-31T04:14:06.556 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:05.637+0000 7f9257200640 1 -- 172.21.15.50:0/545855187 wait complete. 2024-08-31T04:14:06.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:14:06 smithi050 ceph-mon[17259]: from='client.? 172.21.15.50:0/189516205' entity='client.admin' 2024-08-31T04:14:06.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:14:06 smithi050 ceph-mon[17259]: from='client.? ' entity='client.admin' 2024-08-31T04:14:06.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:14:06 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:14:06.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:14:06 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:14:06.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:14:06 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:14:06.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:14:06 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:14:06.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:14:06 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T04:14:06.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:14:06 smithi050 ceph-mon[17259]: from='client.? ' entity='client.admin' 2024-08-31T04:14:06.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:14:06 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:14:06.718 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:14:06 smithi177 ceph-mon[22025]: from='client.? 172.21.15.50:0/189516205' entity='client.admin' 2024-08-31T04:14:06.718 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:14:06 smithi177 ceph-mon[22025]: from='client.? ' entity='client.admin' 2024-08-31T04:14:06.718 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:14:06 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:14:06.718 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:14:06 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:14:06.718 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:14:06 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:14:06.718 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:14:06 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:14:06.718 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:14:06 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T04:14:06.718 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:14:06 smithi177 ceph-mon[22025]: from='client.? ' entity='client.admin' 2024-08-31T04:14:06.718 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:14:06 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:14:06.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:14:06 smithi133 ceph-mon[22177]: from='client.? 172.21.15.50:0/189516205' entity='client.admin' 2024-08-31T04:14:06.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:14:06 smithi133 ceph-mon[22177]: from='client.? ' entity='client.admin' 2024-08-31T04:14:06.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:14:06 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:14:06.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:14:06 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:14:06.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:14:06 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:14:06.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:14:06 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:14:06.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:14:06 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T04:14:06.794 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:14:06 smithi133 ceph-mon[22177]: from='client.? ' entity='client.admin' 2024-08-31T04:14:06.794 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:14:06 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:14:06.936 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:05.198+0000 7fe8df800640 1 -- 172.21.15.50:0/3516711999 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe8d806c360 msgr2=0x7fe8d81061e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:14:06.936 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:05.198+0000 7fe8df800640 1 --2- 172.21.15.50:0/3516711999 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe8d806c360 0x7fe8d81061e0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fe8c8009ca0 tx=0x7fe8c802a8c0 comp rx=0 tx=0).stop 2024-08-31T04:14:06.937 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:05.198+0000 7fe8df800640 1 -- 172.21.15.50:0/3516711999 shutdown_connections 2024-08-31T04:14:06.937 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:05.198+0000 7fe8df800640 1 --2- 172.21.15.50:0/3516711999 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe8d8109230 0x7fe8d810b740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:14:06.937 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:05.198+0000 7fe8df800640 1 --2- 172.21.15.50:0/3516711999 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe8d8106720 0x7fe8d8108b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:14:06.937 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:05.198+0000 7fe8df800640 1 --2- 172.21.15.50:0/3516711999 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe8d806c360 0x7fe8d81061e0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:14:06.937 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:05.198+0000 7fe8df800640 1 -- 172.21.15.50:0/3516711999 >> 172.21.15.50:0/3516711999 conn(0x7fe8d80fdd80 msgr2=0x7fe8d8100210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:14:06.937 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:05.198+0000 7fe8df800640 1 -- 172.21.15.50:0/3516711999 shutdown_connections 2024-08-31T04:14:06.937 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:05.198+0000 7fe8df800640 1 -- 172.21.15.50:0/3516711999 wait complete. 2024-08-31T04:14:06.937 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:05.199+0000 7fe8df800640 1 Processor -- start 2024-08-31T04:14:06.937 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:05.199+0000 7fe8df800640 1 -- start start 2024-08-31T04:14:06.937 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:05.200+0000 7fe8df800640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe8d806c360 0x7fe8d819bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:14:06.937 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:05.200+0000 7fe8df800640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe8d8106720 0x7fe8d819c5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:14:06.937 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:05.200+0000 7fe8df800640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe8d8109230 0x7fe8d819d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:14:06.938 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:05.200+0000 7fe8df800640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fe8d810f110 con 0x7fe8d8109230 2024-08-31T04:14:06.938 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:05.200+0000 7fe8df800640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7fe8d810ef90 con 0x7fe8d8106720 2024-08-31T04:14:06.938 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:05.200+0000 7fe8df800640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fe8d810f290 con 0x7fe8d806c360 2024-08-31T04:14:06.938 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:05.200+0000 7fe8dce00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe8d806c360 0x7fe8d819bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:14:06.938 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:05.200+0000 7fe8dd800640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe8d8109230 0x7fe8d819d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:14:06.938 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:05.200+0000 7fe8dce00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe8d806c360 0x7fe8d819bf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.50:40866/0 (socket says 172.21.15.50:40866) 2024-08-31T04:14:06.938 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:05.200+0000 7fe8dce00640 1 -- 172.21.15.50:0/189516205 learned_addr learned my addr 172.21.15.50:0/189516205 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:14:06.938 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:05.200+0000 7fe8d7e00640 1 --2- 172.21.15.50:0/189516205 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe8d8106720 0x7fe8d819c5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:14:06.938 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:05.201+0000 7fe8dd800640 1 -- 172.21.15.50:0/189516205 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe8d806c360 msgr2=0x7fe8d819bf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:14:06.938 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:05.201+0000 7fe8dd800640 1 --2- 172.21.15.50:0/189516205 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe8d806c360 0x7fe8d819bf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:14:06.938 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:05.201+0000 7fe8dd800640 1 -- 172.21.15.50:0/189516205 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe8d8106720 msgr2=0x7fe8d819c5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:14:06.938 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:05.201+0000 7fe8dd800640 1 --2- 172.21.15.50:0/189516205 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe8d8106720 0x7fe8d819c5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:14:06.938 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:05.201+0000 7fe8dd800640 1 -- 172.21.15.50:0/189516205 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8d819d9b0 con 0x7fe8d8109230 2024-08-31T04:14:06.939 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:05.201+0000 7fe8dd800640 1 --2- 172.21.15.50:0/189516205 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe8d8109230 0x7fe8d819d190 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fe8d000e970 tx=0x7fe8d000ee30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:14:06.939 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:05.201+0000 7fe8d5600640 1 -- 172.21.15.50:0/189516205 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8d000ccc0 con 0x7fe8d8109230 2024-08-31T04:14:06.939 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:05.201+0000 7fe8d5600640 1 -- 172.21.15.50:0/189516205 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe8d0005020 con 0x7fe8d8109230 2024-08-31T04:14:06.939 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:05.201+0000 7fe8df800640 1 -- 172.21.15.50:0/189516205 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe8d819dca0 con 0x7fe8d8109230 2024-08-31T04:14:06.939 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:05.201+0000 7fe8d5600640 1 -- 172.21.15.50:0/189516205 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8d0004a00 con 0x7fe8d8109230 2024-08-31T04:14:06.939 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:05.201+0000 7fe8df800640 1 -- 172.21.15.50:0/189516205 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe8d81a43a0 con 0x7fe8d8109230 2024-08-31T04:14:06.939 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:05.202+0000 7fe8df800640 1 -- 172.21.15.50:0/189516205 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe8d81a4570 con 0x7fe8d8109230 2024-08-31T04:14:06.939 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:05.203+0000 7fe8d5600640 1 -- 172.21.15.50:0/189516205 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 13) ==== 51253+0+0 (secure 0 0 0) 0x7fe8d0004ba0 con 0x7fe8d8109230 2024-08-31T04:14:06.939 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:05.203+0000 7fe8d5600640 1 --2- 172.21.15.50:0/189516205 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fe8bc03f280 0x7fe8bc041790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:14:06.939 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:05.203+0000 7fe8d5600640 1 -- 172.21.15.50:0/189516205 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fe8d00539a0 con 0x7fe8d8109230 2024-08-31T04:14:06.939 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:05.203+0000 7fe8dce00640 1 --2- 172.21.15.50:0/189516205 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fe8bc03f280 0x7fe8bc041790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:14:06.939 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:05.204+0000 7fe8dce00640 1 --2- 172.21.15.50:0/189516205 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fe8bc03f280 0x7fe8bc041790 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fe8c8005e30 tx=0x7fe8c8009360 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:14:06.939 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:05.208+0000 7fe8d5600640 1 -- 172.21.15.50:0/189516205 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fe8d00054f0 con 0x7fe8d8109230 2024-08-31T04:14:06.940 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:05.415+0000 7fe8df800640 1 -- 172.21.15.50:0/189516205 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command([{prefix=config set, name=debug_mds_balancer}] v 0) -- 0x7fe8d81a4740 con 0x7fe8d8109230 2024-08-31T04:14:06.940 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:05.419+0000 7fe8d5600640 1 -- 172.21.15.50:0/189516205 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_mds_balancer}]=0 v17)=0 v17) ==== 117+0+0 (secure 0 0 0) 0x7fe8d0013dc0 con 0x7fe8d8109230 2024-08-31T04:14:06.940 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:05.421+0000 7fe8df800640 1 -- 172.21.15.50:0/189516205 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fe8bc03f280 msgr2=0x7fe8bc041790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:14:06.940 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:05.421+0000 7fe8df800640 1 --2- 172.21.15.50:0/189516205 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fe8bc03f280 0x7fe8bc041790 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fe8c8005e30 tx=0x7fe8c8009360 comp rx=0 tx=0).stop 2024-08-31T04:14:06.940 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:05.421+0000 7fe8df800640 1 -- 172.21.15.50:0/189516205 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe8d8109230 msgr2=0x7fe8d819d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:14:06.940 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:05.421+0000 7fe8df800640 1 --2- 172.21.15.50:0/189516205 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe8d8109230 0x7fe8d819d190 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fe8d000e970 tx=0x7fe8d000ee30 comp rx=0 tx=0).stop 2024-08-31T04:14:06.940 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:05.421+0000 7fe8df800640 1 -- 172.21.15.50:0/189516205 shutdown_connections 2024-08-31T04:14:06.940 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:05.421+0000 7fe8df800640 1 --2- 172.21.15.50:0/189516205 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fe8bc03f280 0x7fe8bc041790 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:14:06.940 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:05.421+0000 7fe8df800640 1 --2- 172.21.15.50:0/189516205 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe8d8109230 0x7fe8d819d190 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:14:06.940 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:05.421+0000 7fe8df800640 1 --2- 172.21.15.50:0/189516205 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe8d8106720 0x7fe8d819c5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:14:06.940 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:05.421+0000 7fe8df800640 1 --2- 172.21.15.50:0/189516205 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe8d806c360 0x7fe8d819bf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:14:06.940 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:05.421+0000 7fe8df800640 1 -- 172.21.15.50:0/189516205 >> 172.21.15.50:0/189516205 conn(0x7fe8d80fdd80 msgr2=0x7fe8d81001a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:14:06.940 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:05.422+0000 7fe8df800640 1 -- 172.21.15.50:0/189516205 shutdown_connections 2024-08-31T04:14:06.941 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:05.422+0000 7fe8df800640 1 -- 172.21.15.50:0/189516205 wait complete. 2024-08-31T04:14:07.695 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:14:07 smithi050 ceph-mon[17259]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T04:14:07.696 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:14:07 smithi050 ceph-mon[17259]: from='client.? ' entity='client.admin' 2024-08-31T04:14:07.696 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:14:07 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:14:07.696 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:14:07 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:14:07.696 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:14:07 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:14:07.696 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:14:07 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:14:07.696 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:14:07 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:14:07.696 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:14:07 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T04:14:07.696 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:14:07 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:14:07.696 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:14:07 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T04:14:07.696 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:14:07 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:14:07.697 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:14:07 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T04:14:07.697 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:14:07 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:14:07.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:14:07 smithi177 ceph-mon[22025]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T04:14:07.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:14:07 smithi177 ceph-mon[22025]: from='client.? ' entity='client.admin' 2024-08-31T04:14:07.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:14:07 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:14:07.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:14:07 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:14:07.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:14:07 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:14:07.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:14:07 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:14:07.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:14:07 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:14:07.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:14:07 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T04:14:07.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:14:07 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:14:07.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:14:07 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T04:14:07.747 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:14:07 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:14:07.747 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:14:07 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T04:14:07.747 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:14:07 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:14:07.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:14:07 smithi133 ceph-mon[22177]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T04:14:07.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:14:07 smithi133 ceph-mon[22177]: from='client.? ' entity='client.admin' 2024-08-31T04:14:07.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:14:07 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:14:07.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:14:07 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:14:07.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:14:07 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:14:07.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:14:07 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:14:07.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:14:07 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:14:07.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:14:07 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T04:14:07.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:14:07 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:14:07.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:14:07 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T04:14:07.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:14:07 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:14:07.794 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:14:07 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T04:14:07.794 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:14:07 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:14:08.279 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:08.277+0000 7f3456e00640 1 -- 172.21.15.50:0/3621336780 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f34501067b0 msgr2=0x7f3450106bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:14:08.279 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:08.277+0000 7f3456e00640 1 --2- 172.21.15.50:0/3621336780 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f34501067b0 0x7f3450106bc0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f343c009900 tx=0x7f343c02a480 comp rx=0 tx=0).stop 2024-08-31T04:14:08.279 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:08.277+0000 7f3456e00640 1 -- 172.21.15.50:0/3621336780 shutdown_connections 2024-08-31T04:14:08.279 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:08.277+0000 7f3456e00640 1 --2- 172.21.15.50:0/3621336780 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3450107150 0x7f345010daf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:14:08.279 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:08.277+0000 7f3456e00640 1 --2- 172.21.15.50:0/3621336780 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f34501067b0 0x7f3450106bc0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:14:08.279 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:08.277+0000 7f3456e00640 1 --2- 172.21.15.50:0/3621336780 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3450105720 0x7f3450105b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:14:08.279 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:08.277+0000 7f3456e00640 1 -- 172.21.15.50:0/3621336780 >> 172.21.15.50:0/3621336780 conn(0x7f3450101090 msgr2=0x7f3450103540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:14:08.280 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:08.277+0000 7f3456e00640 1 -- 172.21.15.50:0/3621336780 shutdown_connections 2024-08-31T04:14:08.280 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:08.277+0000 7f3456e00640 1 -- 172.21.15.50:0/3621336780 wait complete. 2024-08-31T04:14:08.281 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:08.278+0000 7f3456e00640 1 Processor -- start 2024-08-31T04:14:08.281 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:08.279+0000 7f3456e00640 1 -- start start 2024-08-31T04:14:08.281 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:08.279+0000 7f3456e00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3450105720 0x7f345019bf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:14:08.281 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:08.279+0000 7f3456e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f34501067b0 0x7f345019c600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:14:08.281 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:08.279+0000 7f3456e00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3450107150 0x7f345019d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:14:08.281 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:08.279+0000 7f3456e00640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f3450111370 con 0x7f34501067b0 2024-08-31T04:14:08.281 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:08.279+0000 7f3456e00640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f34501111f0 con 0x7f3450105720 2024-08-31T04:14:08.281 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:08.279+0000 7f3456e00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f34501114f0 con 0x7f3450107150 2024-08-31T04:14:08.281 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:08.279+0000 7f344fe00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3450105720 0x7f345019bf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:14:08.281 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:08.279+0000 7f344f400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f34501067b0 0x7f345019c600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:14:08.282 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:08.279+0000 7f344fe00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3450105720 0x7f345019bf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.50:56324/0 (socket says 172.21.15.50:56324) 2024-08-31T04:14:08.282 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:08.279+0000 7f344fe00640 1 -- 172.21.15.50:0/4117614175 learned_addr learned my addr 172.21.15.50:0/4117614175 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:14:08.282 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:08.279+0000 7f3454e00640 1 --2- 172.21.15.50:0/4117614175 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3450107150 0x7f345019d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:14:08.282 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:08.280+0000 7f344fe00640 1 -- 172.21.15.50:0/4117614175 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3450107150 msgr2=0x7f345019d1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:14:08.283 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:08.280+0000 7f344fe00640 1 --2- 172.21.15.50:0/4117614175 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3450107150 0x7f345019d1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:14:08.283 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:08.280+0000 7f344fe00640 1 -- 172.21.15.50:0/4117614175 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f34501067b0 msgr2=0x7f345019c600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:14:08.283 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:08.280+0000 7f344fe00640 1 --2- 172.21.15.50:0/4117614175 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f34501067b0 0x7f345019c600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:14:08.283 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:08.280+0000 7f344fe00640 1 -- 172.21.15.50:0/4117614175 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f345019d9c0 con 0x7f3450105720 2024-08-31T04:14:08.283 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:08.280+0000 7f344fe00640 1 --2- 172.21.15.50:0/4117614175 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3450105720 0x7f345019bf90 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f344000e9f0 tx=0x7f344000eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:14:08.283 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:08.280+0000 7f344cc00640 1 -- 172.21.15.50:0/4117614175 <== mon.2 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f344000cd80 con 0x7f3450105720 2024-08-31T04:14:08.283 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:08.280+0000 7f344cc00640 1 -- 172.21.15.50:0/4117614175 <== mon.2 v2:172.21.15.133:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f34400108e0 con 0x7f3450105720 2024-08-31T04:14:08.283 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:08.280+0000 7f344cc00640 1 -- 172.21.15.50:0/4117614175 <== mon.2 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3440018980 con 0x7f3450105720 2024-08-31T04:14:08.283 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:08.280+0000 7f3456e00640 1 -- 172.21.15.50:0/4117614175 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f345019dcb0 con 0x7f3450105720 2024-08-31T04:14:08.283 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:08.280+0000 7f3456e00640 1 -- 172.21.15.50:0/4117614175 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f34501a43b0 con 0x7f3450105720 2024-08-31T04:14:08.283 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:08.281+0000 7f3456e00640 1 -- 172.21.15.50:0/4117614175 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f345010c8e0 con 0x7f3450105720 2024-08-31T04:14:08.284 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:08.282+0000 7f344cc00640 1 -- 172.21.15.50:0/4117614175 <== mon.2 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 13) ==== 51253+0+0 (secure 0 0 0) 0x7f3440010430 con 0x7f3450105720 2024-08-31T04:14:08.284 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:08.282+0000 7f344cc00640 1 --2- 172.21.15.50:0/4117614175 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f343403f280 0x7f3434041790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:14:08.284 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:08.282+0000 7f344cc00640 1 -- 172.21.15.50:0/4117614175 <== mon.2 v2:172.21.15.133:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f3440053e90 con 0x7f3450105720 2024-08-31T04:14:08.284 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:08.282+0000 7f344f400640 1 --2- 172.21.15.50:0/4117614175 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f343403f280 0x7f3434041790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:14:08.285 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:08.283+0000 7f344f400640 1 --2- 172.21.15.50:0/4117614175 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f343403f280 0x7f3434041790 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f343c000c00 tx=0x7f343c031400 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:14:08.288 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:08.287+0000 7f344cc00640 1 -- 172.21.15.50:0/4117614175 <== mon.2 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f34400071c0 con 0x7f3450105720 2024-08-31T04:14:08.364 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:06.630+0000 7ffbaba00640 1 -- 172.21.15.50:0/2078381882 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ffba4105720 msgr2=0x7ffba4105b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:14:08.364 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:06.630+0000 7ffbaba00640 1 --2- 172.21.15.50:0/2078381882 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ffba4105720 0x7ffba4105b90 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7ffb94009860 tx=0x7ffb9402a3d0 comp rx=0 tx=0).stop 2024-08-31T04:14:08.364 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:06.630+0000 7ffbaba00640 1 -- 172.21.15.50:0/2078381882 shutdown_connections 2024-08-31T04:14:08.365 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:06.630+0000 7ffbaba00640 1 --2- 172.21.15.50:0/2078381882 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ffba4107150 0x7ffba410daf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:14:08.365 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:06.630+0000 7ffbaba00640 1 --2- 172.21.15.50:0/2078381882 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffba41067b0 0x7ffba4106bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:14:08.365 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:06.630+0000 7ffbaba00640 1 --2- 172.21.15.50:0/2078381882 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ffba4105720 0x7ffba4105b90 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:14:08.365 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:06.630+0000 7ffbaba00640 1 -- 172.21.15.50:0/2078381882 >> 172.21.15.50:0/2078381882 conn(0x7ffba4101090 msgr2=0x7ffba4103540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:14:08.365 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:06.630+0000 7ffbaba00640 1 -- 172.21.15.50:0/2078381882 shutdown_connections 2024-08-31T04:14:08.365 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:06.630+0000 7ffbaba00640 1 -- 172.21.15.50:0/2078381882 wait complete. 2024-08-31T04:14:08.365 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:06.631+0000 7ffbaba00640 1 Processor -- start 2024-08-31T04:14:08.365 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:06.631+0000 7ffbaba00640 1 -- start start 2024-08-31T04:14:08.365 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:06.632+0000 7ffbaba00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffba4105720 0x7ffba419bf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:14:08.365 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:06.632+0000 7ffbaba00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ffba41067b0 0x7ffba419c5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:14:08.365 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:06.632+0000 7ffbaba00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ffba4107150 0x7ffba419d180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:14:08.365 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:06.632+0000 7ffbaba00640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7ffba41113b0 con 0x7ffba4105720 2024-08-31T04:14:08.365 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:06.632+0000 7ffbaba00640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7ffba4111230 con 0x7ffba4107150 2024-08-31T04:14:08.366 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:06.632+0000 7ffbaba00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7ffba4111530 con 0x7ffba41067b0 2024-08-31T04:14:08.366 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:06.632+0000 7ffba9000640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffba4105720 0x7ffba419bf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:14:08.366 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:06.632+0000 7ffb9be00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ffba41067b0 0x7ffba419c5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:14:08.366 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:06.632+0000 7ffba9000640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffba4105720 0x7ffba419bf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36650/0 (socket says 172.21.15.50:36650) 2024-08-31T04:14:08.366 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:06.632+0000 7ffba9000640 1 -- 172.21.15.50:0/3210725579 learned_addr learned my addr 172.21.15.50:0/3210725579 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:14:08.366 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:06.632+0000 7ffba9a00640 1 --2- 172.21.15.50:0/3210725579 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ffba4107150 0x7ffba419d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:14:08.366 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:06.632+0000 7ffb9be00640 1 -- 172.21.15.50:0/3210725579 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ffba4107150 msgr2=0x7ffba419d180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:14:08.366 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:06.632+0000 7ffb9be00640 1 --2- 172.21.15.50:0/3210725579 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ffba4107150 0x7ffba419d180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:14:08.366 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:06.632+0000 7ffb9be00640 1 -- 172.21.15.50:0/3210725579 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffba4105720 msgr2=0x7ffba419bf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:14:08.366 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:06.632+0000 7ffb9be00640 1 --2- 172.21.15.50:0/3210725579 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffba4105720 0x7ffba419bf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:14:08.366 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:06.632+0000 7ffb9be00640 1 -- 172.21.15.50:0/3210725579 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffba419d9a0 con 0x7ffba41067b0 2024-08-31T04:14:08.366 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:06.633+0000 7ffb9be00640 1 --2- 172.21.15.50:0/3210725579 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ffba41067b0 0x7ffba419c5e0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7ffb8c00e790 tx=0x7ffb8c00ec50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:14:08.367 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:06.633+0000 7ffba2000640 1 -- 172.21.15.50:0/3210725579 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb8c00eea0 con 0x7ffba41067b0 2024-08-31T04:14:08.367 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:06.633+0000 7ffba2000640 1 -- 172.21.15.50:0/3210725579 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ffb8c00ccc0 con 0x7ffba41067b0 2024-08-31T04:14:08.367 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:06.633+0000 7ffbaba00640 1 -- 172.21.15.50:0/3210725579 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffba419dc90 con 0x7ffba41067b0 2024-08-31T04:14:08.367 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:06.633+0000 7ffba2000640 1 -- 172.21.15.50:0/3210725579 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb8c018680 con 0x7ffba41067b0 2024-08-31T04:14:08.367 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:06.633+0000 7ffbaba00640 1 -- 172.21.15.50:0/3210725579 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffba41a4390 con 0x7ffba41067b0 2024-08-31T04:14:08.367 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:06.634+0000 7ffbaba00640 1 -- 172.21.15.50:0/3210725579 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffba410c900 con 0x7ffba41067b0 2024-08-31T04:14:08.367 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:06.634+0000 7ffba2000640 1 -- 172.21.15.50:0/3210725579 <== mon.1 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 13) ==== 51253+0+0 (secure 0 0 0) 0x7ffb8c018820 con 0x7ffba41067b0 2024-08-31T04:14:08.367 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:06.635+0000 7ffba2000640 1 --2- 172.21.15.50:0/3210725579 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7ffb8803f280 0x7ffb88041790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:14:08.367 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:06.635+0000 7ffba2000640 1 -- 172.21.15.50:0/3210725579 <== mon.1 v2:172.21.15.177:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7ffb8c053c40 con 0x7ffba41067b0 2024-08-31T04:14:08.367 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:06.635+0000 7ffba9000640 1 --2- 172.21.15.50:0/3210725579 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7ffb8803f280 0x7ffb88041790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:14:08.367 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:06.636+0000 7ffba9000640 1 --2- 172.21.15.50:0/3210725579 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7ffb8803f280 0x7ffb88041790 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7ffb940095f0 tx=0x7ffb940309a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:14:08.367 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:06.640+0000 7ffba2000640 1 -- 172.21.15.50:0/3210725579 <== mon.1 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7ffb8c020360 con 0x7ffba41067b0 2024-08-31T04:14:08.367 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:06.842+0000 7ffbaba00640 1 -- 172.21.15.50:0/3210725579 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command([{prefix=config set, name=mds_bal_split_bits}] v 0) -- 0x7ffba402e430 con 0x7ffba41067b0 2024-08-31T04:14:08.368 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:06.847+0000 7ffba2000640 1 -- 172.21.15.50:0/3210725579 <== mon.1 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_split_bits}]=0 v20)=0 v20) ==== 116+0+0 (secure 0 0 0) 0x7ffb8c013190 con 0x7ffba41067b0 2024-08-31T04:14:08.368 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:06.849+0000 7ffbaba00640 1 -- 172.21.15.50:0/3210725579 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7ffb8803f280 msgr2=0x7ffb88041790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:14:08.368 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:06.849+0000 7ffbaba00640 1 --2- 172.21.15.50:0/3210725579 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7ffb8803f280 0x7ffb88041790 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7ffb940095f0 tx=0x7ffb940309a0 comp rx=0 tx=0).stop 2024-08-31T04:14:08.368 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:06.849+0000 7ffbaba00640 1 -- 172.21.15.50:0/3210725579 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ffba41067b0 msgr2=0x7ffba419c5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:14:08.368 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:06.849+0000 7ffbaba00640 1 --2- 172.21.15.50:0/3210725579 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ffba41067b0 0x7ffba419c5e0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7ffb8c00e790 tx=0x7ffb8c00ec50 comp rx=0 tx=0).stop 2024-08-31T04:14:08.368 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:06.850+0000 7ffbaba00640 1 -- 172.21.15.50:0/3210725579 shutdown_connections 2024-08-31T04:14:08.368 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:06.850+0000 7ffbaba00640 1 --2- 172.21.15.50:0/3210725579 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7ffb8803f280 0x7ffb88041790 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:14:08.368 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:06.850+0000 7ffbaba00640 1 --2- 172.21.15.50:0/3210725579 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ffba41067b0 0x7ffba419c5e0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:14:08.368 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:06.850+0000 7ffbaba00640 1 --2- 172.21.15.50:0/3210725579 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ffba4107150 0x7ffba419d180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:14:08.368 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:06.850+0000 7ffbaba00640 1 --2- 172.21.15.50:0/3210725579 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffba4105720 0x7ffba419bf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:14:08.368 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:06.850+0000 7ffbaba00640 1 -- 172.21.15.50:0/3210725579 >> 172.21.15.50:0/3210725579 conn(0x7ffba4101090 msgr2=0x7ffba4109ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:14:08.368 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:06.850+0000 7ffbaba00640 1 -- 172.21.15.50:0/3210725579 shutdown_connections 2024-08-31T04:14:08.368 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:06.850+0000 7ffbaba00640 1 -- 172.21.15.50:0/3210725579 wait complete. 2024-08-31T04:14:08.432 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:08.430+0000 7f344cc00640 1 -- 172.21.15.50:0/4117614175 <== mon.2 v2:172.21.15.133:3300/0 7 ==== mgrmap(e 14) ==== 101887+0+0 (secure 0 0 0) 0x7f3440018b20 con 0x7f3450105720 2024-08-31T04:14:08.490 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:08.488+0000 7f3456e00640 1 -- 172.21.15.50:0/4117614175 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command([{prefix=config set, name=mds_op_complaint_time}] v 0) -- 0x7f345002e430 con 0x7f3450105720 2024-08-31T04:14:08.495 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:08.494+0000 7f344cc00640 1 -- 172.21.15.50:0/4117614175 <== mon.2 v2:172.21.15.133:3300/0 8 ==== mon_command_ack([{prefix=config set, name=mds_op_complaint_time}]=0 v21)=0 v21) ==== 121+0+0 (secure 0 0 0) 0x7f3440071040 con 0x7f3450105720 2024-08-31T04:14:08.498 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:08.496+0000 7f3456e00640 1 -- 172.21.15.50:0/4117614175 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f343403f280 msgr2=0x7f3434041790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:14:08.498 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:08.496+0000 7f3456e00640 1 --2- 172.21.15.50:0/4117614175 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f343403f280 0x7f3434041790 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f343c000c00 tx=0x7f343c031400 comp rx=0 tx=0).stop 2024-08-31T04:14:08.498 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:08.497+0000 7f3456e00640 1 -- 172.21.15.50:0/4117614175 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3450105720 msgr2=0x7f345019bf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:14:08.498 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:08.497+0000 7f3456e00640 1 --2- 172.21.15.50:0/4117614175 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3450105720 0x7f345019bf90 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f344000e9f0 tx=0x7f344000eeb0 comp rx=0 tx=0).stop 2024-08-31T04:14:08.498 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:08.497+0000 7f3456e00640 1 -- 172.21.15.50:0/4117614175 shutdown_connections 2024-08-31T04:14:08.499 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:08.497+0000 7f3456e00640 1 --2- 172.21.15.50:0/4117614175 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f343403f280 0x7f3434041790 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:14:08.499 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:08.497+0000 7f3456e00640 1 --2- 172.21.15.50:0/4117614175 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3450107150 0x7f345019d1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:14:08.499 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:08.497+0000 7f3456e00640 1 --2- 172.21.15.50:0/4117614175 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f34501067b0 0x7f345019c600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:14:08.499 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:08.497+0000 7f3456e00640 1 --2- 172.21.15.50:0/4117614175 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3450105720 0x7f345019bf90 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:14:08.499 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:08.497+0000 7f3456e00640 1 -- 172.21.15.50:0/4117614175 >> 172.21.15.50:0/4117614175 conn(0x7f3450101090 msgr2=0x7f3450109ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:14:08.499 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:08.497+0000 7f3456e00640 1 -- 172.21.15.50:0/4117614175 shutdown_connections 2024-08-31T04:14:08.499 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:08.497+0000 7f3456e00640 1 -- 172.21.15.50:0/4117614175 wait complete. 2024-08-31T04:14:08.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:14:08 smithi050 ceph-mon[17259]: Standby manager daemon z started 2024-08-31T04:14:08.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:14:08 smithi050 ceph-mon[17259]: from='mgr.? 172.21.15.177:0/1651180949' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/z/crt"} : dispatch 2024-08-31T04:14:08.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:14:08 smithi050 ceph-mon[17259]: from='mgr.? 172.21.15.177:0/1651180949' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/crt"} : dispatch 2024-08-31T04:14:08.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:14:08 smithi050 ceph-mon[17259]: from='mgr.? 172.21.15.177:0/1651180949' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/z/key"} : dispatch 2024-08-31T04:14:08.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:14:08 smithi050 ceph-mon[17259]: from='mgr.? 172.21.15.177:0/1651180949' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/key"} : dispatch 2024-08-31T04:14:08.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:14:08 smithi177 ceph-mon[22025]: Standby manager daemon z started 2024-08-31T04:14:08.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:14:08 smithi177 ceph-mon[22025]: from='mgr.? 172.21.15.177:0/1651180949' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/z/crt"} : dispatch 2024-08-31T04:14:08.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:14:08 smithi177 ceph-mon[22025]: from='mgr.? 172.21.15.177:0/1651180949' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/crt"} : dispatch 2024-08-31T04:14:08.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:14:08 smithi177 ceph-mon[22025]: from='mgr.? 172.21.15.177:0/1651180949' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/z/key"} : dispatch 2024-08-31T04:14:08.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:14:08 smithi177 ceph-mon[22025]: from='mgr.? 172.21.15.177:0/1651180949' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/key"} : dispatch 2024-08-31T04:14:08.792 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:14:08 smithi133 ceph-mon[22177]: Standby manager daemon z started 2024-08-31T04:14:08.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:14:08 smithi133 ceph-mon[22177]: from='mgr.? 172.21.15.177:0/1651180949' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/z/crt"} : dispatch 2024-08-31T04:14:08.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:14:08 smithi133 ceph-mon[22177]: from='mgr.? 172.21.15.177:0/1651180949' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/crt"} : dispatch 2024-08-31T04:14:08.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:14:08 smithi133 ceph-mon[22177]: from='mgr.? 172.21.15.177:0/1651180949' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/z/key"} : dispatch 2024-08-31T04:14:08.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:14:08 smithi133 ceph-mon[22177]: from='mgr.? 172.21.15.177:0/1651180949' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/key"} : dispatch 2024-08-31T04:14:09.420 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:09.323+0000 7f1364c00640 1 -- 172.21.15.50:0/1514609967 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f13601067b0 msgr2=0x7f1360106bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:14:09.421 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:09.323+0000 7f1364c00640 1 --2- 172.21.15.50:0/1514609967 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f13601067b0 0x7f1360106bc0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f134c009900 tx=0x7f134c02a480 comp rx=0 tx=0).stop 2024-08-31T04:14:09.421 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:09.323+0000 7f1364c00640 1 -- 172.21.15.50:0/1514609967 shutdown_connections 2024-08-31T04:14:09.421 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:09.323+0000 7f1364c00640 1 --2- 172.21.15.50:0/1514609967 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1360107150 0x7f136010daf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:14:09.421 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:09.323+0000 7f1364c00640 1 --2- 172.21.15.50:0/1514609967 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f13601067b0 0x7f1360106bc0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:14:09.421 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:09.323+0000 7f1364c00640 1 --2- 172.21.15.50:0/1514609967 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1360105720 0x7f1360105b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:14:09.421 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:09.323+0000 7f1364c00640 1 -- 172.21.15.50:0/1514609967 >> 172.21.15.50:0/1514609967 conn(0x7f1360101090 msgr2=0x7f1360103540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:14:09.421 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:09.323+0000 7f1364c00640 1 -- 172.21.15.50:0/1514609967 shutdown_connections 2024-08-31T04:14:09.421 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:09.323+0000 7f1364c00640 1 -- 172.21.15.50:0/1514609967 wait complete. 2024-08-31T04:14:09.421 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:09.324+0000 7f1364c00640 1 Processor -- start 2024-08-31T04:14:09.421 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:09.324+0000 7f1364c00640 1 -- start start 2024-08-31T04:14:09.421 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:09.325+0000 7f1364c00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1360105720 0x7f136019bf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:14:09.421 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:09.325+0000 7f1364c00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f13601067b0 0x7f136019c600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:14:09.422 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:09.325+0000 7f1364c00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1360107150 0x7f136019d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:14:09.422 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:09.325+0000 7f1364c00640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f1360111370 con 0x7f1360105720 2024-08-31T04:14:09.422 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:09.325+0000 7f1364c00640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f13601111f0 con 0x7f1360107150 2024-08-31T04:14:09.422 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:09.325+0000 7f1364c00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f13601114f0 con 0x7f13601067b0 2024-08-31T04:14:09.422 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:09.325+0000 7f135de00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1360105720 0x7f136019bf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:14:09.422 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:09.325+0000 7f135de00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1360105720 0x7f136019bf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36680/0 (socket says 172.21.15.50:36680) 2024-08-31T04:14:09.422 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:09.325+0000 7f135de00640 1 -- 172.21.15.50:0/1296292008 learned_addr learned my addr 172.21.15.50:0/1296292008 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:14:09.422 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:09.325+0000 7f135d400640 1 --2- 172.21.15.50:0/1296292008 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f13601067b0 0x7f136019c600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:14:09.422 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:09.325+0000 7f135e800640 1 --2- 172.21.15.50:0/1296292008 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1360107150 0x7f136019d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:14:09.422 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:09.325+0000 7f135de00640 1 -- 172.21.15.50:0/1296292008 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f13601067b0 msgr2=0x7f136019c600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:14:09.422 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:09.325+0000 7f135de00640 1 --2- 172.21.15.50:0/1296292008 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f13601067b0 0x7f136019c600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:14:09.423 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:09.325+0000 7f135de00640 1 -- 172.21.15.50:0/1296292008 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1360107150 msgr2=0x7f136019d1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:14:09.423 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:09.325+0000 7f135de00640 1 --2- 172.21.15.50:0/1296292008 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1360107150 0x7f136019d1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:14:09.423 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:09.325+0000 7f135de00640 1 -- 172.21.15.50:0/1296292008 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f136019d9c0 con 0x7f1360105720 2024-08-31T04:14:09.423 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:09.325+0000 7f135d400640 1 --2- 172.21.15.50:0/1296292008 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f13601067b0 0x7f136019c600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:14:09.423 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:09.326+0000 7f135de00640 1 --2- 172.21.15.50:0/1296292008 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1360105720 0x7f136019bf90 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f135000ea60 tx=0x7f135000ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:14:09.423 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:09.326+0000 7f1356a00640 1 -- 172.21.15.50:0/1296292008 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f135000cde0 con 0x7f1360105720 2024-08-31T04:14:09.423 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:09.326+0000 7f1356a00640 1 -- 172.21.15.50:0/1296292008 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f13500035f0 con 0x7f1360105720 2024-08-31T04:14:09.423 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:09.326+0000 7f1356a00640 1 -- 172.21.15.50:0/1296292008 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1350010690 con 0x7f1360105720 2024-08-31T04:14:09.423 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:09.326+0000 7f1364c00640 1 -- 172.21.15.50:0/1296292008 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f136019dcb0 con 0x7f1360105720 2024-08-31T04:14:09.423 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:09.326+0000 7f1364c00640 1 -- 172.21.15.50:0/1296292008 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f13601a43b0 con 0x7f1360105720 2024-08-31T04:14:09.423 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:09.327+0000 7f1364c00640 1 -- 172.21.15.50:0/1296292008 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f136010c8e0 con 0x7f1360105720 2024-08-31T04:14:09.423 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:09.328+0000 7f1356a00640 1 -- 172.21.15.50:0/1296292008 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 14) ==== 101887+0+0 (secure 0 0 0) 0x7f13500037a0 con 0x7f1360105720 2024-08-31T04:14:09.423 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:09.329+0000 7f1356a00640 1 --2- 172.21.15.50:0/1296292008 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f1344079e90 0x7f134407c3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:14:09.424 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:09.330+0000 7f1356a00640 1 -- 172.21.15.50:0/1296292008 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f135009b980 con 0x7f1360105720 2024-08-31T04:14:09.424 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:09.330+0000 7f135d400640 1 --2- 172.21.15.50:0/1296292008 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f1344079e90 0x7f134407c3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:14:09.424 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:09.330+0000 7f135d400640 1 --2- 172.21.15.50:0/1296292008 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f1344079e90 0x7f134407c3a0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f134c000c00 tx=0x7f134c031400 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:14:09.424 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:09.334+0000 7f1356a00640 1 -- 172.21.15.50:0/1296292008 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f1350064230 con 0x7f1360105720 2024-08-31T04:14:09.532 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:09.531+0000 7f1364c00640 1 -- 172.21.15.50:0/1296292008 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command([{prefix=config set, name=mds_bal_fragment_size_max}] v 0) -- 0x7f1360063d60 con 0x7f1360105720 2024-08-31T04:14:09.536 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:09.535+0000 7f1356a00640 1 -- 172.21.15.50:0/1296292008 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_fragment_size_max}]=0 v22)=0 v22) ==== 127+0+0 (secure 0 0 0) 0x7f13500689f0 con 0x7f1360105720 2024-08-31T04:14:09.539 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:09.537+0000 7f1364c00640 1 -- 172.21.15.50:0/1296292008 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f1344079e90 msgr2=0x7f134407c3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:14:09.539 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:09.537+0000 7f1364c00640 1 --2- 172.21.15.50:0/1296292008 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f1344079e90 0x7f134407c3a0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f134c000c00 tx=0x7f134c031400 comp rx=0 tx=0).stop 2024-08-31T04:14:09.539 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:09.537+0000 7f1364c00640 1 -- 172.21.15.50:0/1296292008 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1360105720 msgr2=0x7f136019bf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:14:09.539 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:09.537+0000 7f1364c00640 1 --2- 172.21.15.50:0/1296292008 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1360105720 0x7f136019bf90 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f135000ea60 tx=0x7f135000ef20 comp rx=0 tx=0).stop 2024-08-31T04:14:09.539 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:09.537+0000 7f1364c00640 1 -- 172.21.15.50:0/1296292008 shutdown_connections 2024-08-31T04:14:09.539 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:09.537+0000 7f1364c00640 1 --2- 172.21.15.50:0/1296292008 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f1344079e90 0x7f134407c3a0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:14:09.539 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:09.537+0000 7f1364c00640 1 --2- 172.21.15.50:0/1296292008 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f13601067b0 0x7f136019c600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:14:09.539 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:09.537+0000 7f1364c00640 1 --2- 172.21.15.50:0/1296292008 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1360107150 0x7f136019d1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:14:09.540 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:09.537+0000 7f1364c00640 1 --2- 172.21.15.50:0/1296292008 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1360105720 0x7f136019bf90 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:14:09.540 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:09.537+0000 7f1364c00640 1 -- 172.21.15.50:0/1296292008 >> 172.21.15.50:0/1296292008 conn(0x7f1360101090 msgr2=0x7f1360109ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:14:09.540 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:09.538+0000 7f1364c00640 1 -- 172.21.15.50:0/1296292008 shutdown_connections 2024-08-31T04:14:09.540 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:09.538+0000 7f1364c00640 1 -- 172.21.15.50:0/1296292008 wait complete. 2024-08-31T04:14:09.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:14:09 smithi050 ceph-mon[17259]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T04:14:09.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:14:09 smithi050 ceph-mon[17259]: mgrmap e14: x(active, since 72s), standbys: z 2024-08-31T04:14:09.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:14:09 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "z", "id": "z"} : dispatch 2024-08-31T04:14:09.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:14:09 smithi050 ceph-mon[17259]: from='client.? ' entity='client.admin' 2024-08-31T04:14:09.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:14:09 smithi177 ceph-mon[22025]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T04:14:09.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:14:09 smithi177 ceph-mon[22025]: mgrmap e14: x(active, since 72s), standbys: z 2024-08-31T04:14:09.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:14:09 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "z", "id": "z"} : dispatch 2024-08-31T04:14:09.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:14:09 smithi177 ceph-mon[22025]: from='client.? ' entity='client.admin' 2024-08-31T04:14:09.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:14:09 smithi133 ceph-mon[22177]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T04:14:09.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:14:09 smithi133 ceph-mon[22177]: mgrmap e14: x(active, since 72s), standbys: z 2024-08-31T04:14:09.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:14:09 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "z", "id": "z"} : dispatch 2024-08-31T04:14:09.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:14:09 smithi133 ceph-mon[22177]: from='client.? ' entity='client.admin' 2024-08-31T04:14:09.993 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:14:09.993 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:14:10.037 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '058d9fc6-674f-11ef-bcd4-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'debug_mds', '20'], check_status=True, hostname='smithi050') 2024-08-31T04:14:10.037 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '058d9fc6-674f-11ef-bcd4-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'debug_mds_balancer', '20'], check_status=True, hostname='smithi050') 2024-08-31T04:14:10.771 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:14:10 smithi050 ceph-mon[17259]: from='client.? 172.21.15.50:0/1296292008' entity='client.admin' 2024-08-31T04:14:10.772 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:14:10 smithi050 ceph-mon[17259]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T04:14:10.792 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:14:10 smithi133 ceph-mon[22177]: from='client.? 172.21.15.50:0/1296292008' entity='client.admin' 2024-08-31T04:14:10.792 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:14:10 smithi133 ceph-mon[22177]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T04:14:10.996 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:14:10 smithi177 ceph-mon[22025]: from='client.? 172.21.15.50:0/1296292008' entity='client.admin' 2024-08-31T04:14:10.996 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:14:10 smithi177 ceph-mon[22025]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T04:14:11.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:14:11 smithi050 ceph-mon[17259]: Standby manager daemon y started 2024-08-31T04:14:11.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:14:11 smithi050 ceph-mon[17259]: from='mgr.? 172.21.15.133:0/4138703917' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/y/crt"} : dispatch 2024-08-31T04:14:11.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:14:11 smithi050 ceph-mon[17259]: from='mgr.? 172.21.15.133:0/4138703917' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/crt"} : dispatch 2024-08-31T04:14:11.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:14:11 smithi050 ceph-mon[17259]: from='mgr.? 172.21.15.133:0/4138703917' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/y/key"} : dispatch 2024-08-31T04:14:11.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:14:11 smithi050 ceph-mon[17259]: from='mgr.? 172.21.15.133:0/4138703917' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/key"} : dispatch 2024-08-31T04:14:11.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:14:11 smithi050 ceph-mon[17259]: from='client.? ' entity='client.admin' 2024-08-31T04:14:11.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:14:11 smithi050 ceph-mon[17259]: from='client.? ' entity='client.admin' 2024-08-31T04:14:11.701 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:14:11 smithi050 ceph-mon[17259]: from='client.? ' entity='client.admin' 2024-08-31T04:14:11.996 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:14:11 smithi177 ceph-mon[22025]: Standby manager daemon y started 2024-08-31T04:14:11.996 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:14:11 smithi177 ceph-mon[22025]: from='mgr.? 172.21.15.133:0/4138703917' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/y/crt"} : dispatch 2024-08-31T04:14:11.996 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:14:11 smithi177 ceph-mon[22025]: from='mgr.? 172.21.15.133:0/4138703917' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/crt"} : dispatch 2024-08-31T04:14:11.996 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:14:11 smithi177 ceph-mon[22025]: from='mgr.? 172.21.15.133:0/4138703917' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/y/key"} : dispatch 2024-08-31T04:14:11.996 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:14:11 smithi177 ceph-mon[22025]: from='mgr.? 172.21.15.133:0/4138703917' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/key"} : dispatch 2024-08-31T04:14:11.997 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:14:11 smithi177 ceph-mon[22025]: from='client.? ' entity='client.admin' 2024-08-31T04:14:11.997 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:14:11 smithi177 ceph-mon[22025]: from='client.? ' entity='client.admin' 2024-08-31T04:14:11.997 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:14:11 smithi177 ceph-mon[22025]: from='client.? ' entity='client.admin' 2024-08-31T04:14:12.038 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '058d9fc6-674f-11ef-bcd4-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'debug_ms', '2'], check_status=True, hostname='smithi050') 2024-08-31T04:14:12.039 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '058d9fc6-674f-11ef-bcd4-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'mds_bal_fragment_size_max', '10000'], check_status=True, hostname='smithi050') 2024-08-31T04:14:12.043 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:14:11 smithi133 ceph-mon[22177]: Standby manager daemon y started 2024-08-31T04:14:12.043 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:14:11 smithi133 ceph-mon[22177]: from='mgr.? 172.21.15.133:0/4138703917' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/y/crt"} : dispatch 2024-08-31T04:14:12.043 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:14:11 smithi133 ceph-mon[22177]: from='mgr.? 172.21.15.133:0/4138703917' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/crt"} : dispatch 2024-08-31T04:14:12.043 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:14:11 smithi133 ceph-mon[22177]: from='mgr.? 172.21.15.133:0/4138703917' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/y/key"} : dispatch 2024-08-31T04:14:12.043 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:14:11 smithi133 ceph-mon[22177]: from='mgr.? 172.21.15.133:0/4138703917' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/key"} : dispatch 2024-08-31T04:14:12.043 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:14:11 smithi133 ceph-mon[22177]: from='client.? ' entity='client.admin' 2024-08-31T04:14:12.043 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:14:11 smithi133 ceph-mon[22177]: from='client.? ' entity='client.admin' 2024-08-31T04:14:12.043 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:14:11 smithi133 ceph-mon[22177]: from='client.? ' entity='client.admin' 2024-08-31T04:14:12.329 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:10.671+0000 7f9386c00640 1 -- 172.21.15.50:0/1881541194 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f938010b2b0 msgr2=0x7f938010d750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:14:12.330 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:10.671+0000 7f9386c00640 1 --2- 172.21.15.50:0/1881541194 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f938010b2b0 0x7f938010d750 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f9378009ca0 tx=0x7f937802a8c0 comp rx=0 tx=0).stop 2024-08-31T04:14:12.330 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:10.671+0000 7f9386c00640 1 -- 172.21.15.50:0/1881541194 shutdown_connections 2024-08-31T04:14:12.330 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:10.671+0000 7f9386c00640 1 --2- 172.21.15.50:0/1881541194 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f938010b2b0 0x7f938010d750 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:14:12.330 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:10.671+0000 7f9386c00640 1 --2- 172.21.15.50:0/1881541194 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9380075a90 0x7f9380075ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:14:12.330 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:10.671+0000 7f9386c00640 1 --2- 172.21.15.50:0/1881541194 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9380076e80 0x7f9380075550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:14:12.330 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:10.671+0000 7f9386c00640 1 -- 172.21.15.50:0/1881541194 >> 172.21.15.50:0/1881541194 conn(0x7f93800fec60 msgr2=0x7f9380101130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:14:12.330 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:10.671+0000 7f9386c00640 1 -- 172.21.15.50:0/1881541194 shutdown_connections 2024-08-31T04:14:12.330 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:10.671+0000 7f9386c00640 1 -- 172.21.15.50:0/1881541194 wait complete. 2024-08-31T04:14:12.330 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:10.672+0000 7f9386c00640 1 Processor -- start 2024-08-31T04:14:12.330 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:10.672+0000 7f9386c00640 1 -- start start 2024-08-31T04:14:12.330 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:10.673+0000 7f9386c00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9380075a90 0x7f938019bdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:14:12.331 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:10.673+0000 7f9386c00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9380076e80 0x7f938019c430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:14:12.331 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:10.673+0000 7f9386c00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f938010b2b0 0x7f938019cfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:14:12.331 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:10.673+0000 7f9386c00640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f93801111a0 con 0x7f9380076e80 2024-08-31T04:14:12.331 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:10.673+0000 7f9386c00640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f9380111020 con 0x7f9380075a90 2024-08-31T04:14:12.331 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:10.673+0000 7f9386c00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f9380111320 con 0x7f938010b2b0 2024-08-31T04:14:12.331 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:10.673+0000 7f9385800640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9380075a90 0x7f938019bdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:14:12.331 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:10.673+0000 7f9385800640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9380075a90 0x7f938019bdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.50:56344/0 (socket says 172.21.15.50:56344) 2024-08-31T04:14:12.331 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:10.673+0000 7f9385800640 1 -- 172.21.15.50:0/3873929453 learned_addr learned my addr 172.21.15.50:0/3873929453 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:14:12.331 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:10.673+0000 7f9384e00640 1 --2- 172.21.15.50:0/3873929453 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9380076e80 0x7f938019c430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:14:12.331 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:10.673+0000 7f9385800640 1 -- 172.21.15.50:0/3873929453 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f938010b2b0 msgr2=0x7f938019cfd0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-08-31T04:14:12.331 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:10.673+0000 7f9385800640 1 --2- 172.21.15.50:0/3873929453 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f938010b2b0 0x7f938019cfd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:14:12.331 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:10.673+0000 7f9385800640 1 -- 172.21.15.50:0/3873929453 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9380076e80 msgr2=0x7f938019c430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:14:12.331 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:10.673+0000 7f9385800640 1 --2- 172.21.15.50:0/3873929453 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9380076e80 0x7f938019c430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:14:12.332 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:10.673+0000 7f9385800640 1 -- 172.21.15.50:0/3873929453 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f938019d7f0 con 0x7f9380075a90 2024-08-31T04:14:12.332 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:10.674+0000 7f9385800640 1 --2- 172.21.15.50:0/3873929453 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9380075a90 0x7f938019bdc0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f937400e9f0 tx=0x7f937400edf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:14:12.332 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:10.674+0000 7f937e000640 1 -- 172.21.15.50:0/3873929453 <== mon.2 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f937400cd80 con 0x7f9380075a90 2024-08-31T04:14:12.332 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:10.674+0000 7f937e000640 1 -- 172.21.15.50:0/3873929453 <== mon.2 v2:172.21.15.133:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f93740054d0 con 0x7f9380075a90 2024-08-31T04:14:12.332 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:10.674+0000 7f9386c00640 1 -- 172.21.15.50:0/3873929453 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f938019dae0 con 0x7f9380075a90 2024-08-31T04:14:12.332 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:10.674+0000 7f937e000640 1 -- 172.21.15.50:0/3873929453 <== mon.2 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9374010690 con 0x7f9380075a90 2024-08-31T04:14:12.332 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:10.674+0000 7f9386c00640 1 -- 172.21.15.50:0/3873929453 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f93801a41e0 con 0x7f9380075a90 2024-08-31T04:14:12.332 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:10.675+0000 7f9386c00640 1 -- 172.21.15.50:0/3873929453 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f938010a0c0 con 0x7f9380075a90 2024-08-31T04:14:12.332 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:10.676+0000 7f937e000640 1 -- 172.21.15.50:0/3873929453 <== mon.2 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 14) ==== 101887+0+0 (secure 0 0 0) 0x7f9374004e90 con 0x7f9380075a90 2024-08-31T04:14:12.332 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:10.677+0000 7f937e000640 1 --2- 172.21.15.50:0/3873929453 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f9368079e90 0x7f936807c3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:14:12.332 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:10.677+0000 7f937e000640 1 -- 172.21.15.50:0/3873929453 <== mon.2 v2:172.21.15.133:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f937409bbc0 con 0x7f9380075a90 2024-08-31T04:14:12.332 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:10.678+0000 7f9384e00640 1 --2- 172.21.15.50:0/3873929453 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f9368079e90 0x7f936807c3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:14:12.332 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:10.678+0000 7f9384e00640 1 --2- 172.21.15.50:0/3873929453 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f9368079e90 0x7f936807c3a0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f936c0095f0 tx=0x7f936c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:14:12.333 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:10.682+0000 7f937e000640 1 -- 172.21.15.50:0/3873929453 <== mon.2 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f9374064b00 con 0x7f9380075a90 2024-08-31T04:14:12.333 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:10.901+0000 7f9386c00640 1 -- 172.21.15.50:0/3873929453 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command([{prefix=config set, name=mds_bal_merge_size}] v 0) -- 0x7f9380063d60 con 0x7f9380075a90 2024-08-31T04:14:12.333 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:10.907+0000 7f937e000640 1 -- 172.21.15.50:0/3873929453 <== mon.2 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_merge_size}]=0 v23)=0 v23) ==== 116+0+0 (secure 0 0 0) 0x7f9374064400 con 0x7f9380075a90 2024-08-31T04:14:12.333 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:10.910+0000 7f9386c00640 1 -- 172.21.15.50:0/3873929453 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f9368079e90 msgr2=0x7f936807c3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:14:12.333 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:10.910+0000 7f9386c00640 1 --2- 172.21.15.50:0/3873929453 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f9368079e90 0x7f936807c3a0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f936c0095f0 tx=0x7f936c005f90 comp rx=0 tx=0).stop 2024-08-31T04:14:12.333 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:10.910+0000 7f9386c00640 1 -- 172.21.15.50:0/3873929453 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9380075a90 msgr2=0x7f938019bdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:14:12.333 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:10.910+0000 7f9386c00640 1 --2- 172.21.15.50:0/3873929453 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9380075a90 0x7f938019bdc0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f937400e9f0 tx=0x7f937400edf0 comp rx=0 tx=0).stop 2024-08-31T04:14:12.333 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:10.910+0000 7f9386c00640 1 -- 172.21.15.50:0/3873929453 shutdown_connections 2024-08-31T04:14:12.333 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:10.910+0000 7f9386c00640 1 --2- 172.21.15.50:0/3873929453 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f9368079e90 0x7f936807c3a0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:14:12.333 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:10.910+0000 7f9386c00640 1 --2- 172.21.15.50:0/3873929453 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f938010b2b0 0x7f938019cfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:14:12.333 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:10.910+0000 7f9386c00640 1 --2- 172.21.15.50:0/3873929453 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9380076e80 0x7f938019c430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:14:12.333 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:10.910+0000 7f9386c00640 1 --2- 172.21.15.50:0/3873929453 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9380075a90 0x7f938019bdc0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:14:12.333 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:10.910+0000 7f9386c00640 1 -- 172.21.15.50:0/3873929453 >> 172.21.15.50:0/3873929453 conn(0x7f93800fec60 msgr2=0x7f9380107290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:14:12.333 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:10.910+0000 7f9386c00640 1 -- 172.21.15.50:0/3873929453 shutdown_connections 2024-08-31T04:14:12.334 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:10.910+0000 7f9386c00640 1 -- 172.21.15.50:0/3873929453 wait complete. 2024-08-31T04:14:12.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:10.770+0000 7f461ba00640 1 -- 172.21.15.50:0/1589336830 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4614104f20 msgr2=0x7f461410b8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:14:12.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:10.770+0000 7f461ba00640 1 --2- 172.21.15.50:0/1589336830 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4614104f20 0x7f461410b8c0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f460c009be0 tx=0x7f460c02a750 comp rx=0 tx=0).stop 2024-08-31T04:14:12.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:10.770+0000 7f461ba00640 1 -- 172.21.15.50:0/1589336830 shutdown_connections 2024-08-31T04:14:12.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:10.770+0000 7f461ba00640 1 --2- 172.21.15.50:0/1589336830 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4614104580 0x7f4614104990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:14:12.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:10.770+0000 7f461ba00640 1 --2- 172.21.15.50:0/1589336830 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4614104f20 0x7f461410b8c0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:14:12.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:10.770+0000 7f461ba00640 1 --2- 172.21.15.50:0/1589336830 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f46141034f0 0x7f4614103960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:14:12.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:10.770+0000 7f461ba00640 1 -- 172.21.15.50:0/1589336830 >> 172.21.15.50:0/1589336830 conn(0x7f46140fee80 msgr2=0x7f4614101310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:14:12.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:10.770+0000 7f461ba00640 1 -- 172.21.15.50:0/1589336830 shutdown_connections 2024-08-31T04:14:12.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:10.770+0000 7f461ba00640 1 -- 172.21.15.50:0/1589336830 wait complete. 2024-08-31T04:14:12.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:10.771+0000 7f461ba00640 1 Processor -- start 2024-08-31T04:14:12.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:10.772+0000 7f461ba00640 1 -- start start 2024-08-31T04:14:12.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:10.772+0000 7f461ba00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f46141034f0 0x7f461419bf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:14:12.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:10.772+0000 7f461ba00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4614104580 0x7f461419c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:14:12.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:10.772+0000 7f461ba00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4614104f20 0x7f461419d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:14:12.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:10.772+0000 7f461ba00640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f461410f130 con 0x7f46141034f0 2024-08-31T04:14:12.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:10.772+0000 7f461ba00640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f461410efb0 con 0x7f4614104f20 2024-08-31T04:14:12.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:10.772+0000 7f461ba00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f461410f2b0 con 0x7f4614104580 2024-08-31T04:14:12.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:10.772+0000 7f4619000640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f46141034f0 0x7f461419bf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:14:12.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:10.772+0000 7f4619a00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4614104f20 0x7f461419d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:14:12.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:10.772+0000 7f4613e00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4614104580 0x7f461419c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:14:12.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:10.772+0000 7f4619a00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4614104f20 0x7f461419d110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.50:56368/0 (socket says 172.21.15.50:56368) 2024-08-31T04:14:12.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:10.772+0000 7f4619a00640 1 -- 172.21.15.50:0/4241174593 learned_addr learned my addr 172.21.15.50:0/4241174593 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:14:12.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:10.772+0000 7f4613e00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4614104580 0x7f461419c570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.50:40980/0 (socket says 172.21.15.50:40980) 2024-08-31T04:14:12.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:10.772+0000 7f4619000640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f46141034f0 0x7f461419bf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36714/0 (socket says 172.21.15.50:36714) 2024-08-31T04:14:12.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:10.773+0000 7f4619a00640 1 -- 172.21.15.50:0/4241174593 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4614104580 msgr2=0x7f461419c570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:14:12.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:10.773+0000 7f4619a00640 1 --2- 172.21.15.50:0/4241174593 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4614104580 0x7f461419c570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:14:12.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:10.773+0000 7f4619a00640 1 -- 172.21.15.50:0/4241174593 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f46141034f0 msgr2=0x7f461419bf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:14:12.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:10.773+0000 7f4619a00640 1 --2- 172.21.15.50:0/4241174593 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f46141034f0 0x7f461419bf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:14:12.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:10.773+0000 7f4619a00640 1 -- 172.21.15.50:0/4241174593 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f461419d930 con 0x7f4614104f20 2024-08-31T04:14:12.642 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:10.773+0000 7f4619a00640 1 --2- 172.21.15.50:0/4241174593 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4614104f20 0x7f461419d110 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f460c0309d0 tx=0x7f460c030c80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:14:12.642 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:10.773+0000 7f4611600640 1 -- 172.21.15.50:0/4241174593 <== mon.2 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f460c041020 con 0x7f4614104f20 2024-08-31T04:14:12.642 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:10.773+0000 7f4611600640 1 -- 172.21.15.50:0/4241174593 <== mon.2 v2:172.21.15.133:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f460c003e20 con 0x7f4614104f20 2024-08-31T04:14:12.642 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:10.773+0000 7f461ba00640 1 -- 172.21.15.50:0/4241174593 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f461419dbc0 con 0x7f4614104f20 2024-08-31T04:14:12.642 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:10.773+0000 7f4611600640 1 -- 172.21.15.50:0/4241174593 <== mon.2 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f460c036040 con 0x7f4614104f20 2024-08-31T04:14:12.642 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:10.774+0000 7f461ba00640 1 -- 172.21.15.50:0/4241174593 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f46141a4320 con 0x7f4614104f20 2024-08-31T04:14:12.642 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:10.775+0000 7f461ba00640 1 -- 172.21.15.50:0/4241174593 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4614103960 con 0x7f4614104f20 2024-08-31T04:14:12.642 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:10.776+0000 7f4611600640 1 -- 172.21.15.50:0/4241174593 <== mon.2 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 14) ==== 101887+0+0 (secure 0 0 0) 0x7f460c044020 con 0x7f4614104f20 2024-08-31T04:14:12.642 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:10.777+0000 7f4611600640 1 --2- 172.21.15.50:0/4241174593 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f45fc079e90 0x7f45fc07c3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:14:12.642 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:10.777+0000 7f4611600640 1 -- 172.21.15.50:0/4241174593 <== mon.2 v2:172.21.15.133:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f460c0bc040 con 0x7f4614104f20 2024-08-31T04:14:12.642 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:10.777+0000 7f4619000640 1 --2- 172.21.15.50:0/4241174593 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f45fc079e90 0x7f45fc07c3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:14:12.642 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:10.777+0000 7f4619000640 1 --2- 172.21.15.50:0/4241174593 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f45fc079e90 0x7f45fc07c3a0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f4608005fd0 tx=0x7f4608009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:14:12.642 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:10.781+0000 7f4611600640 1 -- 172.21.15.50:0/4241174593 <== mon.2 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f460c04b030 con 0x7f4614104f20 2024-08-31T04:14:12.643 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:10.988+0000 7f461ba00640 1 -- 172.21.15.50:0/4241174593 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command([{prefix=config set, name=rados_mon_op_timeout}] v 0) -- 0x7f46141a4610 con 0x7f4614104f20 2024-08-31T04:14:12.643 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:10.993+0000 7f4611600640 1 -- 172.21.15.50:0/4241174593 <== mon.2 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{prefix=config set, name=rados_mon_op_timeout}]=0 v24)=0 v24) ==== 120+0+0 (secure 0 0 0) 0x7f460c084f40 con 0x7f4614104f20 2024-08-31T04:14:12.643 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:10.996+0000 7f461ba00640 1 -- 172.21.15.50:0/4241174593 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f45fc079e90 msgr2=0x7f45fc07c3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:14:12.643 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:10.996+0000 7f461ba00640 1 --2- 172.21.15.50:0/4241174593 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f45fc079e90 0x7f45fc07c3a0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f4608005fd0 tx=0x7f4608009260 comp rx=0 tx=0).stop 2024-08-31T04:14:12.643 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:10.996+0000 7f461ba00640 1 -- 172.21.15.50:0/4241174593 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4614104f20 msgr2=0x7f461419d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:14:12.643 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:10.996+0000 7f461ba00640 1 --2- 172.21.15.50:0/4241174593 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4614104f20 0x7f461419d110 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f460c0309d0 tx=0x7f460c030c80 comp rx=0 tx=0).stop 2024-08-31T04:14:12.643 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:10.996+0000 7f461ba00640 1 -- 172.21.15.50:0/4241174593 shutdown_connections 2024-08-31T04:14:12.643 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:10.996+0000 7f461ba00640 1 --2- 172.21.15.50:0/4241174593 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f45fc079e90 0x7f45fc07c3a0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:14:12.643 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:10.996+0000 7f461ba00640 1 --2- 172.21.15.50:0/4241174593 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4614104580 0x7f461419c570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:14:12.643 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:10.996+0000 7f461ba00640 1 --2- 172.21.15.50:0/4241174593 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4614104f20 0x7f461419d110 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:14:12.643 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:10.996+0000 7f461ba00640 1 --2- 172.21.15.50:0/4241174593 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f46141034f0 0x7f461419bf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:14:12.643 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:10.996+0000 7f461ba00640 1 -- 172.21.15.50:0/4241174593 >> 172.21.15.50:0/4241174593 conn(0x7f46140fee80 msgr2=0x7f4614075390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:14:12.643 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:10.996+0000 7f461ba00640 1 -- 172.21.15.50:0/4241174593 shutdown_connections 2024-08-31T04:14:12.643 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:10.996+0000 7f461ba00640 1 -- 172.21.15.50:0/4241174593 wait complete. 2024-08-31T04:14:12.892 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:14:12 smithi050 ceph-mon[17259]: mgrmap e15: x(active, since 75s), standbys: z, y 2024-08-31T04:14:12.893 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:14:12 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "y", "id": "y"} : dispatch 2024-08-31T04:14:12.893 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:14:12 smithi050 ceph-mon[17259]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T04:14:12.897 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:14:12 smithi177 ceph-mon[22025]: mgrmap e15: x(active, since 75s), standbys: z, y 2024-08-31T04:14:12.897 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:14:12 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "y", "id": "y"} : dispatch 2024-08-31T04:14:12.897 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:14:12 smithi177 ceph-mon[22025]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T04:14:12.943 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:14:12 smithi133 ceph-mon[22177]: mgrmap e15: x(active, since 75s), standbys: z, y 2024-08-31T04:14:12.943 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:14:12 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "y", "id": "y"} : dispatch 2024-08-31T04:14:12.943 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:14:12 smithi133 ceph-mon[22177]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T04:14:13.151 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:11.204+0000 7f4276e00640 1 -- 172.21.15.50:0/1320335628 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4270103310 msgr2=0x7f4270103780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:14:13.151 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:11.204+0000 7f4276e00640 1 --2- 172.21.15.50:0/1320335628 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4270103310 0x7f4270103780 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f4264009900 tx=0x7f426402a480 comp rx=0 tx=0).stop 2024-08-31T04:14:13.151 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:11.204+0000 7f4276e00640 1 -- 172.21.15.50:0/1320335628 shutdown_connections 2024-08-31T04:14:13.151 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:11.204+0000 7f4276e00640 1 --2- 172.21.15.50:0/1320335628 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4270104d40 0x7f427010b6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:14:13.151 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:11.204+0000 7f4276e00640 1 --2- 172.21.15.50:0/1320335628 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f42701043a0 0x7f42701047b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:14:13.151 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:11.204+0000 7f4276e00640 1 --2- 172.21.15.50:0/1320335628 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4270103310 0x7f4270103780 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:14:13.151 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:11.204+0000 7f4276e00640 1 -- 172.21.15.50:0/1320335628 >> 172.21.15.50:0/1320335628 conn(0x7f42700fec60 msgr2=0x7f4270101130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:14:13.151 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:11.204+0000 7f4276e00640 1 -- 172.21.15.50:0/1320335628 shutdown_connections 2024-08-31T04:14:13.151 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:11.204+0000 7f4276e00640 1 -- 172.21.15.50:0/1320335628 wait complete. 2024-08-31T04:14:13.151 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:11.206+0000 7f4276e00640 1 Processor -- start 2024-08-31T04:14:13.151 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:11.206+0000 7f4276e00640 1 -- start start 2024-08-31T04:14:13.152 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:11.206+0000 7f4276e00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4270103310 0x7f427019bda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:14:13.152 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:11.206+0000 7f4276e00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f42701043a0 0x7f427019c410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:14:13.152 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:11.206+0000 7f4276e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4270104d40 0x7f427019cfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:14:13.152 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:11.206+0000 7f4276e00640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f427010efc0 con 0x7f4270104d40 2024-08-31T04:14:13.152 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:11.206+0000 7f4276e00640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f427010ee40 con 0x7f42701043a0 2024-08-31T04:14:13.152 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:11.206+0000 7f4276e00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f427010f140 con 0x7f4270103310 2024-08-31T04:14:13.152 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:11.207+0000 7f4276400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4270104d40 0x7f427019cfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:14:13.152 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:11.207+0000 7f4275a00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4270103310 0x7f427019bda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:14:13.152 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:11.207+0000 7f4275000640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f42701043a0 0x7f427019c410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:14:13.152 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:11.207+0000 7f4276400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4270104d40 0x7f427019cfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36730/0 (socket says 172.21.15.50:36730) 2024-08-31T04:14:13.152 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:11.207+0000 7f4275a00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4270103310 0x7f427019bda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.50:40994/0 (socket says 172.21.15.50:40994) 2024-08-31T04:14:13.152 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:11.207+0000 7f4276400640 1 -- 172.21.15.50:0/1814443750 learned_addr learned my addr 172.21.15.50:0/1814443750 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:14:13.153 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:11.207+0000 7f4275000640 1 -- 172.21.15.50:0/1814443750 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4270103310 msgr2=0x7f427019bda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:14:13.153 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:11.207+0000 7f4275000640 1 --2- 172.21.15.50:0/1814443750 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4270103310 0x7f427019bda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:14:13.153 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:11.207+0000 7f4275000640 1 -- 172.21.15.50:0/1814443750 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4270104d40 msgr2=0x7f427019cfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:14:13.153 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:11.207+0000 7f4275000640 1 --2- 172.21.15.50:0/1814443750 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4270104d40 0x7f427019cfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:14:13.153 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:11.207+0000 7f4275000640 1 -- 172.21.15.50:0/1814443750 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f427019d7d0 con 0x7f42701043a0 2024-08-31T04:14:13.153 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:11.207+0000 7f4275000640 1 --2- 172.21.15.50:0/1814443750 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f42701043a0 0x7f427019c410 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f425c00e9f0 tx=0x7f425c00eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:14:13.153 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:11.208+0000 7f426e000640 1 -- 172.21.15.50:0/1814443750 <== mon.2 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f425c00ccc0 con 0x7f42701043a0 2024-08-31T04:14:13.153 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:11.208+0000 7f426e000640 1 -- 172.21.15.50:0/1814443750 <== mon.2 v2:172.21.15.133:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f425c0108e0 con 0x7f42701043a0 2024-08-31T04:14:13.153 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:11.208+0000 7f4276e00640 1 -- 172.21.15.50:0/1814443750 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f427019dac0 con 0x7f42701043a0 2024-08-31T04:14:13.153 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:11.208+0000 7f426e000640 1 -- 172.21.15.50:0/1814443750 <== mon.2 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f425c018880 con 0x7f42701043a0 2024-08-31T04:14:13.153 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:11.208+0000 7f4276e00640 1 -- 172.21.15.50:0/1814443750 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42701a41c0 con 0x7f42701043a0 2024-08-31T04:14:13.153 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:11.209+0000 7f4276e00640 1 -- 172.21.15.50:0/1814443750 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4270103780 con 0x7f42701043a0 2024-08-31T04:14:13.153 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:11.210+0000 7f426e000640 1 -- 172.21.15.50:0/1814443750 <== mon.2 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 14) ==== 101887+0+0 (secure 0 0 0) 0x7f425c010430 con 0x7f42701043a0 2024-08-31T04:14:13.154 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:11.211+0000 7f426e000640 1 --2- 172.21.15.50:0/1814443750 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f4258079e90 0x7f425807c3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:14:13.154 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:11.211+0000 7f426e000640 1 -- 172.21.15.50:0/1814443750 <== mon.2 v2:172.21.15.133:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f425c09ba70 con 0x7f42701043a0 2024-08-31T04:14:13.154 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:11.212+0000 7f4275a00640 1 --2- 172.21.15.50:0/1814443750 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f4258079e90 0x7f425807c3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:14:13.154 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:11.212+0000 7f4275a00640 1 --2- 172.21.15.50:0/1814443750 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f4258079e90 0x7f425807c3a0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f4264004770 tx=0x7f42640314a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:14:13.154 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:11.215+0000 7f426e000640 1 -- 172.21.15.50:0/1814443750 <== mon.2 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f425c064320 con 0x7f42701043a0 2024-08-31T04:14:13.154 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:11.416+0000 7f4276e00640 1 -- 172.21.15.50:0/1814443750 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command([{prefix=config set, name=mon_op_complaint_time}] v 0) -- 0x7f42701a4430 con 0x7f42701043a0 2024-08-31T04:14:13.154 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:11.424+0000 7f426e000640 1 -- 172.21.15.50:0/1814443750 <== mon.2 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_op_complaint_time}]=0 v25)=0 v25) ==== 121+0+0 (secure 0 0 0) 0x7f425c068ae0 con 0x7f42701043a0 2024-08-31T04:14:13.154 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:11.426+0000 7f4276e00640 1 -- 172.21.15.50:0/1814443750 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f4258079e90 msgr2=0x7f425807c3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:14:13.154 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:11.426+0000 7f4276e00640 1 --2- 172.21.15.50:0/1814443750 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f4258079e90 0x7f425807c3a0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f4264004770 tx=0x7f42640314a0 comp rx=0 tx=0).stop 2024-08-31T04:14:13.154 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:11.426+0000 7f4276e00640 1 -- 172.21.15.50:0/1814443750 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f42701043a0 msgr2=0x7f427019c410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:14:13.154 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:11.426+0000 7f4276e00640 1 --2- 172.21.15.50:0/1814443750 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f42701043a0 0x7f427019c410 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f425c00e9f0 tx=0x7f425c00eeb0 comp rx=0 tx=0).stop 2024-08-31T04:14:13.154 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:11.427+0000 7f4276e00640 1 -- 172.21.15.50:0/1814443750 shutdown_connections 2024-08-31T04:14:13.154 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:11.427+0000 7f4276e00640 1 --2- 172.21.15.50:0/1814443750 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f4258079e90 0x7f425807c3a0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:14:13.154 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:11.427+0000 7f4276e00640 1 --2- 172.21.15.50:0/1814443750 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4270104d40 0x7f427019cfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:14:13.155 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:11.427+0000 7f4276e00640 1 --2- 172.21.15.50:0/1814443750 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f42701043a0 0x7f427019c410 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:14:13.155 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:11.427+0000 7f4276e00640 1 --2- 172.21.15.50:0/1814443750 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4270103310 0x7f427019bda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:14:13.155 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:11.427+0000 7f4276e00640 1 -- 172.21.15.50:0/1814443750 >> 172.21.15.50:0/1814443750 conn(0x7f42700fec60 msgr2=0x7f4270075390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:14:13.155 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:11.427+0000 7f4276e00640 1 -- 172.21.15.50:0/1814443750 shutdown_connections 2024-08-31T04:14:13.155 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:11.427+0000 7f4276e00640 1 -- 172.21.15.50:0/1814443750 wait complete. 2024-08-31T04:14:14.950 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:14:14 smithi050 ceph-mon[17259]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T04:14:14.989 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:14.987+0000 7ff3bb600640 1 -- 172.21.15.50:0/4112400496 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff3b41034f0 msgr2=0x7ff3b4103960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:14:14.989 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:14.987+0000 7ff3bb600640 1 --2- 172.21.15.50:0/4112400496 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff3b41034f0 0x7ff3b4103960 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7ff3a8009860 tx=0x7ff3a802a3d0 comp rx=0 tx=0).stop 2024-08-31T04:14:14.989 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:14.987+0000 7ff3bb600640 1 -- 172.21.15.50:0/4112400496 shutdown_connections 2024-08-31T04:14:14.989 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:14.987+0000 7ff3bb600640 1 --2- 172.21.15.50:0/4112400496 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff3b4104f20 0x7ff3b410b8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:14:14.989 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:14.987+0000 7ff3bb600640 1 --2- 172.21.15.50:0/4112400496 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff3b4104580 0x7ff3b4104990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:14:14.989 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:14.987+0000 7ff3bb600640 1 --2- 172.21.15.50:0/4112400496 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff3b41034f0 0x7ff3b4103960 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:14:14.989 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:14.987+0000 7ff3bb600640 1 -- 172.21.15.50:0/4112400496 >> 172.21.15.50:0/4112400496 conn(0x7ff3b40fee60 msgr2=0x7ff3b4101310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:14:14.990 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:14.988+0000 7ff3bb600640 1 -- 172.21.15.50:0/4112400496 shutdown_connections 2024-08-31T04:14:14.990 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:14.988+0000 7ff3bb600640 1 -- 172.21.15.50:0/4112400496 wait complete. 2024-08-31T04:14:14.991 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:14.988+0000 7ff3bb600640 1 Processor -- start 2024-08-31T04:14:14.991 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:14.989+0000 7ff3bb600640 1 -- start start 2024-08-31T04:14:14.991 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:14.989+0000 7ff3bb600640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff3b41034f0 0x7ff3b419bf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:14:14.991 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:14.989+0000 7ff3bb600640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff3b4104580 0x7ff3b419c600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:14:14.992 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:14.989+0000 7ff3bb600640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff3b4104f20 0x7ff3b419d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:14:14.992 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:14.989+0000 7ff3bb600640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7ff3b410f190 con 0x7ff3b4104580 2024-08-31T04:14:14.992 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:14.989+0000 7ff3bb600640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7ff3b410f010 con 0x7ff3b4104f20 2024-08-31T04:14:14.992 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:14.989+0000 7ff3bb600640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7ff3b410f310 con 0x7ff3b41034f0 2024-08-31T04:14:14.992 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:14.989+0000 7ff3b3e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff3b4104580 0x7ff3b419c600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:14:14.992 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:14.989+0000 7ff3b3e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff3b4104580 0x7ff3b419c600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:54676/0 (socket says 172.21.15.50:54676) 2024-08-31T04:14:14.992 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:14.989+0000 7ff3b3e00640 1 -- 172.21.15.50:0/1616353324 learned_addr learned my addr 172.21.15.50:0/1616353324 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:14:14.992 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:14.989+0000 7ff3b8c00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff3b41034f0 0x7ff3b419bf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:14:14.992 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:14.990+0000 7ff3b9600640 1 --2- 172.21.15.50:0/1616353324 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff3b4104f20 0x7ff3b419d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:14:14.992 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:14.990+0000 7ff3b3e00640 1 -- 172.21.15.50:0/1616353324 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff3b41034f0 msgr2=0x7ff3b419bf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:14:14.992 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:14.990+0000 7ff3b3e00640 1 --2- 172.21.15.50:0/1616353324 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff3b41034f0 0x7ff3b419bf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:14:14.992 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:14.990+0000 7ff3b3e00640 1 -- 172.21.15.50:0/1616353324 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff3b4104f20 msgr2=0x7ff3b419d1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:14:14.993 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:14.990+0000 7ff3b3e00640 1 --2- 172.21.15.50:0/1616353324 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff3b4104f20 0x7ff3b419d1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:14:14.993 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:14.990+0000 7ff3b3e00640 1 -- 172.21.15.50:0/1616353324 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3b419d9c0 con 0x7ff3b4104580 2024-08-31T04:14:14.993 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:14.990+0000 7ff3b9600640 1 --2- 172.21.15.50:0/1616353324 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff3b4104f20 0x7ff3b419d1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:14:14.993 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:14.990+0000 7ff3b8c00640 1 --2- 172.21.15.50:0/1616353324 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff3b41034f0 0x7ff3b419bf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:14:14.993 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:14.990+0000 7ff3b3e00640 1 --2- 172.21.15.50:0/1616353324 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff3b4104580 0x7ff3b419c600 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7ff3a000e9c0 tx=0x7ff3a000ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:14:14.994 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:14.990+0000 7ff3b1600640 1 -- 172.21.15.50:0/1616353324 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3a000cde0 con 0x7ff3b4104580 2024-08-31T04:14:14.994 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:14.990+0000 7ff3b1600640 1 -- 172.21.15.50:0/1616353324 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff3a00035f0 con 0x7ff3b4104580 2024-08-31T04:14:14.994 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:14.990+0000 7ff3bb600640 1 -- 172.21.15.50:0/1616353324 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff3b419dcb0 con 0x7ff3b4104580 2024-08-31T04:14:14.994 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:14.990+0000 7ff3b1600640 1 -- 172.21.15.50:0/1616353324 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3a0010690 con 0x7ff3b4104580 2024-08-31T04:14:14.994 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:14.991+0000 7ff3bb600640 1 -- 172.21.15.50:0/1616353324 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff3b41a43b0 con 0x7ff3b4104580 2024-08-31T04:14:14.994 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:14.992+0000 7ff3bb600640 1 -- 172.21.15.50:0/1616353324 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff3b41a4580 con 0x7ff3b4104580 2024-08-31T04:14:14.995 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:14.994+0000 7ff3b1600640 1 -- 172.21.15.50:0/1616353324 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 15) ==== 152521+0+0 (secure 0 0 0) 0x7ff3a0004000 con 0x7ff3b4104580 2024-08-31T04:14:14.997 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:14.996+0000 7ff3b1600640 1 --2- 172.21.15.50:0/1616353324 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7ff39c0b4b20 0x7ff39c0b7030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:14:14.997 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:14.996+0000 7ff3b1600640 1 -- 172.21.15.50:0/1616353324 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7ff3a00e38a0 con 0x7ff3b4104580 2024-08-31T04:14:14.997 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:14.996+0000 7ff3b8c00640 1 --2- 172.21.15.50:0/1616353324 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7ff39c0b4b20 0x7ff39c0b7030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:14:14.998 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:14.997+0000 7ff3b8c00640 1 --2- 172.21.15.50:0/1616353324 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7ff39c0b4b20 0x7ff39c0b7030 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7ff3a802a9c0 tx=0x7ff3a8030980 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:14:15.001 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:14.999+0000 7ff3b1600640 1 -- 172.21.15.50:0/1616353324 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7ff3a00ac600 con 0x7ff3b4104580 2024-08-31T04:14:15.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:15.200+0000 7ff3bb600640 1 -- 172.21.15.50:0/1616353324 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command([{prefix=config set, name=mds_bal_split_size}] v 0) -- 0x7ff3b41a4750 con 0x7ff3b4104580 2024-08-31T04:14:15.205 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:15.204+0000 7ff3b1600640 1 -- 172.21.15.50:0/1616353324 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_split_size}]=0 v26)=0 v26) ==== 118+0+0 (secure 0 0 0) 0x7ff3a00abf00 con 0x7ff3b4104580 2024-08-31T04:14:15.208 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:15.206+0000 7ff3bb600640 1 -- 172.21.15.50:0/1616353324 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7ff39c0b4b20 msgr2=0x7ff39c0b7030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:14:15.208 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:15.206+0000 7ff3bb600640 1 --2- 172.21.15.50:0/1616353324 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7ff39c0b4b20 0x7ff39c0b7030 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7ff3a802a9c0 tx=0x7ff3a8030980 comp rx=0 tx=0).stop 2024-08-31T04:14:15.208 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:15.206+0000 7ff3bb600640 1 -- 172.21.15.50:0/1616353324 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff3b4104580 msgr2=0x7ff3b419c600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:14:15.208 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:15.206+0000 7ff3bb600640 1 --2- 172.21.15.50:0/1616353324 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff3b4104580 0x7ff3b419c600 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7ff3a000e9c0 tx=0x7ff3a000ee80 comp rx=0 tx=0).stop 2024-08-31T04:14:15.208 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:15.206+0000 7ff3bb600640 1 -- 172.21.15.50:0/1616353324 shutdown_connections 2024-08-31T04:14:15.208 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:15.206+0000 7ff3bb600640 1 --2- 172.21.15.50:0/1616353324 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7ff39c0b4b20 0x7ff39c0b7030 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:14:15.208 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:15.206+0000 7ff3bb600640 1 --2- 172.21.15.50:0/1616353324 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff3b4104f20 0x7ff3b419d1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:14:15.208 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:15.206+0000 7ff3bb600640 1 --2- 172.21.15.50:0/1616353324 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff3b4104580 0x7ff3b419c600 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:14:15.208 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:15.206+0000 7ff3bb600640 1 --2- 172.21.15.50:0/1616353324 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff3b41034f0 0x7ff3b419bf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:14:15.208 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:15.206+0000 7ff3bb600640 1 -- 172.21.15.50:0/1616353324 >> 172.21.15.50:0/1616353324 conn(0x7ff3b40fee60 msgr2=0x7ff3b4075390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:14:15.209 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:15.206+0000 7ff3bb600640 1 -- 172.21.15.50:0/1616353324 shutdown_connections 2024-08-31T04:14:15.209 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:15.207+0000 7ff3bb600640 1 -- 172.21.15.50:0/1616353324 wait complete. 2024-08-31T04:14:15.246 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:14:14 smithi177 ceph-mon[22025]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T04:14:15.292 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:14:14 smithi133 ceph-mon[22177]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T04:14:15.448 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:15.446+0000 7f827fe00640 1 -- 172.21.15.50:0/3344003279 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8278104580 msgr2=0x7f8278104990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:14:15.448 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:15.446+0000 7f827fe00640 1 --2- 172.21.15.50:0/3344003279 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8278104580 0x7f8278104990 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f8264009900 tx=0x7f826402a480 comp rx=0 tx=0).stop 2024-08-31T04:14:15.448 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:15.447+0000 7f827fe00640 1 -- 172.21.15.50:0/3344003279 shutdown_connections 2024-08-31T04:14:15.449 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:15.447+0000 7f827fe00640 1 --2- 172.21.15.50:0/3344003279 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8278104f20 0x7f827810b8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:14:15.449 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:15.447+0000 7f827fe00640 1 --2- 172.21.15.50:0/3344003279 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8278104580 0x7f8278104990 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:14:15.449 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:15.447+0000 7f827fe00640 1 --2- 172.21.15.50:0/3344003279 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f82781034f0 0x7f8278103960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:14:15.449 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:15.447+0000 7f827fe00640 1 -- 172.21.15.50:0/3344003279 >> 172.21.15.50:0/3344003279 conn(0x7f82780fee60 msgr2=0x7f8278101310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:14:15.449 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:15.447+0000 7f827fe00640 1 -- 172.21.15.50:0/3344003279 shutdown_connections 2024-08-31T04:14:15.449 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:15.447+0000 7f827fe00640 1 -- 172.21.15.50:0/3344003279 wait complete. 2024-08-31T04:14:15.451 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:15.448+0000 7f827fe00640 1 Processor -- start 2024-08-31T04:14:15.451 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:15.448+0000 7f827fe00640 1 -- start start 2024-08-31T04:14:15.451 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:15.448+0000 7f827fe00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f82781034f0 0x7f827819bf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:14:15.451 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:15.448+0000 7f827fe00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8278104580 0x7f827819c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:14:15.451 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:15.448+0000 7f827fe00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8278104f20 0x7f827819d170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:14:15.451 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:15.448+0000 7f827fe00640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f827810f120 con 0x7f82781034f0 2024-08-31T04:14:15.451 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:15.448+0000 7f827fe00640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f827810efa0 con 0x7f8278104580 2024-08-31T04:14:15.451 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:15.448+0000 7f827fe00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f827810f2a0 con 0x7f8278104f20 2024-08-31T04:14:15.452 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:15.449+0000 7f827d400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f82781034f0 0x7f827819bf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:14:15.452 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:15.449+0000 7f827d400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f82781034f0 0x7f827819bf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:54696/0 (socket says 172.21.15.50:54696) 2024-08-31T04:14:15.452 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:15.449+0000 7f827d400640 1 -- 172.21.15.50:0/3781300672 learned_addr learned my addr 172.21.15.50:0/3781300672 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:14:15.452 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:15.449+0000 7f827ca00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8278104580 0x7f827819c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:14:15.452 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:15.449+0000 7f827de00640 1 --2- 172.21.15.50:0/3781300672 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8278104f20 0x7f827819d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:14:15.452 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:15.449+0000 7f827d400640 1 -- 172.21.15.50:0/3781300672 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8278104f20 msgr2=0x7f827819d170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:14:15.452 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:15.449+0000 7f827d400640 1 --2- 172.21.15.50:0/3781300672 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8278104f20 0x7f827819d170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:14:15.452 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:15.449+0000 7f827d400640 1 -- 172.21.15.50:0/3781300672 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8278104580 msgr2=0x7f827819c5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:14:15.452 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:15.449+0000 7f827d400640 1 --2- 172.21.15.50:0/3781300672 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8278104580 0x7f827819c5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:14:15.452 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:15.449+0000 7f827d400640 1 -- 172.21.15.50:0/3781300672 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f827819d990 con 0x7f82781034f0 2024-08-31T04:14:15.452 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:15.449+0000 7f827d400640 1 --2- 172.21.15.50:0/3781300672 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f82781034f0 0x7f827819bf60 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f826c00ea60 tx=0x7f826c00ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:14:15.452 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:15.450+0000 7f8276000640 1 -- 172.21.15.50:0/3781300672 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f826c00cde0 con 0x7f82781034f0 2024-08-31T04:14:15.452 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:15.450+0000 7f8276000640 1 -- 172.21.15.50:0/3781300672 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f826c0035f0 con 0x7f82781034f0 2024-08-31T04:14:15.453 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:15.450+0000 7f8276000640 1 -- 172.21.15.50:0/3781300672 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f826c010690 con 0x7f82781034f0 2024-08-31T04:14:15.453 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:15.450+0000 7f827fe00640 1 -- 172.21.15.50:0/3781300672 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f827819dc80 con 0x7f82781034f0 2024-08-31T04:14:15.453 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:15.450+0000 7f827fe00640 1 -- 172.21.15.50:0/3781300672 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f82781a4380 con 0x7f82781034f0 2024-08-31T04:14:15.453 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:15.451+0000 7f827fe00640 1 -- 172.21.15.50:0/3781300672 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f82781a4550 con 0x7f82781034f0 2024-08-31T04:14:15.454 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:15.453+0000 7f8276000640 1 -- 172.21.15.50:0/3781300672 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 15) ==== 152521+0+0 (secure 0 0 0) 0x7f826c0037a0 con 0x7f82781034f0 2024-08-31T04:14:15.456 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:15.455+0000 7f8276000640 1 --2- 172.21.15.50:0/3781300672 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f82600b4b20 0x7f82600b7030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:14:15.456 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:15.455+0000 7f8276000640 1 -- 172.21.15.50:0/3781300672 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f826c0e3890 con 0x7f82781034f0 2024-08-31T04:14:15.456 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:15.455+0000 7f827ca00640 1 --2- 172.21.15.50:0/3781300672 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f82600b4b20 0x7f82600b7030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:14:15.457 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:15.456+0000 7f827ca00640 1 --2- 172.21.15.50:0/3781300672 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f82600b4b20 0x7f82600b7030 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f8264000c00 tx=0x7f8264031400 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:14:15.458 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:15.457+0000 7f8276000640 1 -- 172.21.15.50:0/3781300672 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f826c056130 con 0x7f82781034f0 2024-08-31T04:14:15.668 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:15.666+0000 7f827fe00640 1 -- 172.21.15.50:0/3781300672 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command([{prefix=config set, name=rados_osd_op_timeout}] v 0) -- 0x7f82781a4720 con 0x7f82781034f0 2024-08-31T04:14:15.672 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:15.671+0000 7f8276000640 1 -- 172.21.15.50:0/3781300672 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{prefix=config set, name=rados_osd_op_timeout}]=0 v27)=0 v27) ==== 120+0+0 (secure 0 0 0) 0x7f826c0ac690 con 0x7f82781034f0 2024-08-31T04:14:15.675 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:15.673+0000 7f827fe00640 1 -- 172.21.15.50:0/3781300672 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f82600b4b20 msgr2=0x7f82600b7030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:14:15.675 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:15.673+0000 7f827fe00640 1 --2- 172.21.15.50:0/3781300672 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f82600b4b20 0x7f82600b7030 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f8264000c00 tx=0x7f8264031400 comp rx=0 tx=0).stop 2024-08-31T04:14:15.675 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:15.673+0000 7f827fe00640 1 -- 172.21.15.50:0/3781300672 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f82781034f0 msgr2=0x7f827819bf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:14:15.675 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:15.673+0000 7f827fe00640 1 --2- 172.21.15.50:0/3781300672 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f82781034f0 0x7f827819bf60 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f826c00ea60 tx=0x7f826c00ef20 comp rx=0 tx=0).stop 2024-08-31T04:14:15.675 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:15.674+0000 7f827fe00640 1 -- 172.21.15.50:0/3781300672 shutdown_connections 2024-08-31T04:14:15.676 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:15.674+0000 7f827fe00640 1 --2- 172.21.15.50:0/3781300672 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f82600b4b20 0x7f82600b7030 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:14:15.676 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:15.674+0000 7f827fe00640 1 --2- 172.21.15.50:0/3781300672 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8278104f20 0x7f827819d170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:14:15.676 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:15.674+0000 7f827fe00640 1 --2- 172.21.15.50:0/3781300672 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8278104580 0x7f827819c5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:14:15.676 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:15.674+0000 7f827fe00640 1 --2- 172.21.15.50:0/3781300672 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f82781034f0 0x7f827819bf60 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:14:15.676 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:15.674+0000 7f827fe00640 1 -- 172.21.15.50:0/3781300672 >> 172.21.15.50:0/3781300672 conn(0x7f82780fee60 msgr2=0x7f8278075390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:14:15.676 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:15.674+0000 7f827fe00640 1 -- 172.21.15.50:0/3781300672 shutdown_connections 2024-08-31T04:14:15.676 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:15.674+0000 7f827fe00640 1 -- 172.21.15.50:0/3781300672 wait complete. 2024-08-31T04:14:15.751 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:15.749+0000 7f4daf800640 1 -- 172.21.15.50:0/535068219 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4da81067a0 msgr2=0x7f4da8106bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:14:15.751 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:15.749+0000 7f4daf800640 1 --2- 172.21.15.50:0/535068219 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4da81067a0 0x7f4da8106bb0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f4d94009900 tx=0x7f4d9402a480 comp rx=0 tx=0).stop 2024-08-31T04:14:15.751 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:15.749+0000 7f4daf800640 1 -- 172.21.15.50:0/535068219 shutdown_connections 2024-08-31T04:14:15.751 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:15.749+0000 7f4daf800640 1 --2- 172.21.15.50:0/535068219 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4da8107140 0x7f4da810dae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:14:15.751 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:15.749+0000 7f4daf800640 1 --2- 172.21.15.50:0/535068219 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4da81067a0 0x7f4da8106bb0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:14:15.751 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:15.749+0000 7f4daf800640 1 --2- 172.21.15.50:0/535068219 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4da8105710 0x7f4da8105b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:14:15.751 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:15.749+0000 7f4daf800640 1 -- 172.21.15.50:0/535068219 >> 172.21.15.50:0/535068219 conn(0x7f4da8101060 msgr2=0x7f4da8103530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:14:15.751 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:15.749+0000 7f4daf800640 1 -- 172.21.15.50:0/535068219 shutdown_connections 2024-08-31T04:14:15.751 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:15.750+0000 7f4daf800640 1 -- 172.21.15.50:0/535068219 wait complete. 2024-08-31T04:14:15.752 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:15.750+0000 7f4daf800640 1 Processor -- start 2024-08-31T04:14:15.752 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:15.751+0000 7f4daf800640 1 -- start start 2024-08-31T04:14:15.752 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:15.751+0000 7f4daf800640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4da8105710 0x7f4da819bf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:14:15.752 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:15.751+0000 7f4daf800640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4da81067a0 0x7f4da819c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:14:15.752 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:15.751+0000 7f4daf800640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4da8107140 0x7f4da819d170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:14:15.753 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:15.751+0000 7f4daf800640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f4da8111340 con 0x7f4da8107140 2024-08-31T04:14:15.753 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:15.751+0000 7f4daf800640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f4da81111c0 con 0x7f4da8105710 2024-08-31T04:14:15.753 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:15.751+0000 7f4daf800640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f4da81114c0 con 0x7f4da81067a0 2024-08-31T04:14:15.754 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:15.751+0000 7f4dad800640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4da8107140 0x7f4da819d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:14:15.754 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:15.751+0000 7f4dace00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4da8105710 0x7f4da819bf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:14:15.754 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:15.751+0000 7f4dad800640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4da8107140 0x7f4da819d170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:54736/0 (socket says 172.21.15.50:54736) 2024-08-31T04:14:15.754 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:15.751+0000 7f4dad800640 1 -- 172.21.15.50:0/3226823878 learned_addr learned my addr 172.21.15.50:0/3226823878 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:14:15.754 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:15.751+0000 7f4da7e00640 1 --2- 172.21.15.50:0/3226823878 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4da81067a0 0x7f4da819c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:14:15.754 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:15.752+0000 7f4dace00640 1 -- 172.21.15.50:0/3226823878 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4da81067a0 msgr2=0x7f4da819c5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:14:15.754 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:15.752+0000 7f4dace00640 1 --2- 172.21.15.50:0/3226823878 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4da81067a0 0x7f4da819c5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:14:15.754 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:15.752+0000 7f4dace00640 1 -- 172.21.15.50:0/3226823878 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4da8107140 msgr2=0x7f4da819d170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:14:15.754 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:15.752+0000 7f4dace00640 1 --2- 172.21.15.50:0/3226823878 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4da8107140 0x7f4da819d170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:14:15.754 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:15.752+0000 7f4dace00640 1 -- 172.21.15.50:0/3226823878 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4da819d990 con 0x7f4da8105710 2024-08-31T04:14:15.754 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:15.752+0000 7f4dace00640 1 --2- 172.21.15.50:0/3226823878 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4da8105710 0x7f4da819bf60 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f4d9c00d6d0 tx=0x7f4d9c00db90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:14:15.755 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:15.753+0000 7f4da5600640 1 -- 172.21.15.50:0/3226823878 <== mon.2 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d9c017070 con 0x7f4da8105710 2024-08-31T04:14:15.755 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:15.753+0000 7f4da5600640 1 -- 172.21.15.50:0/3226823878 <== mon.2 v2:172.21.15.133:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4d9c009820 con 0x7f4da8105710 2024-08-31T04:14:15.755 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:15.753+0000 7f4da5600640 1 -- 172.21.15.50:0/3226823878 <== mon.2 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d9c004c40 con 0x7f4da8105710 2024-08-31T04:14:15.755 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:15.753+0000 7f4daf800640 1 -- 172.21.15.50:0/3226823878 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4da819dc80 con 0x7f4da8105710 2024-08-31T04:14:15.755 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:15.753+0000 7f4daf800640 1 -- 172.21.15.50:0/3226823878 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4da81a4380 con 0x7f4da8105710 2024-08-31T04:14:15.755 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:15.754+0000 7f4daf800640 1 -- 172.21.15.50:0/3226823878 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4da810c8f0 con 0x7f4da8105710 2024-08-31T04:14:15.759 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:15.758+0000 7f4da5600640 1 -- 172.21.15.50:0/3226823878 <== mon.2 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 15) ==== 152521+0+0 (secure 0 0 0) 0x7f4d9c005220 con 0x7f4da8105710 2024-08-31T04:14:15.761 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:15.760+0000 7f4da5600640 1 --2- 172.21.15.50:0/3226823878 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f4d900b4b20 0x7f4d900b7030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:14:15.761 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:15.760+0000 7f4da5600640 1 -- 172.21.15.50:0/3226823878 <== mon.2 v2:172.21.15.133:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f4d9c0e2ee0 con 0x7f4da8105710 2024-08-31T04:14:15.761 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:15.760+0000 7f4da7e00640 1 --2- 172.21.15.50:0/3226823878 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f4d900b4b20 0x7f4d900b7030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:14:15.761 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:15.760+0000 7f4da5600640 1 -- 172.21.15.50:0/3226823878 <== mon.2 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f4d9c0ab670 con 0x7f4da8105710 2024-08-31T04:14:15.762 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:15.761+0000 7f4da7e00640 1 --2- 172.21.15.50:0/3226823878 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f4d900b4b20 0x7f4d900b7030 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f4d94000c00 tx=0x7f4d94031400 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:14:15.961 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:15.959+0000 7eff08c00640 1 -- 172.21.15.50:0/669225959 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7eff041043a0 msgr2=0x7eff041047b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:14:15.961 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:15.959+0000 7eff08c00640 1 --2- 172.21.15.50:0/669225959 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7eff041043a0 0x7eff041047b0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7efef0009900 tx=0x7efef002a480 comp rx=0 tx=0).stop 2024-08-31T04:14:15.961 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:15.960+0000 7eff08c00640 1 -- 172.21.15.50:0/669225959 shutdown_connections 2024-08-31T04:14:15.962 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:15.960+0000 7eff08c00640 1 --2- 172.21.15.50:0/669225959 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7eff04104d40 0x7eff0410b6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:14:15.962 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:15.960+0000 7eff08c00640 1 --2- 172.21.15.50:0/669225959 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7eff041043a0 0x7eff041047b0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:14:15.962 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:15.960+0000 7eff08c00640 1 --2- 172.21.15.50:0/669225959 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7eff04103310 0x7eff04103780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:14:15.962 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:15.960+0000 7eff08c00640 1 -- 172.21.15.50:0/669225959 >> 172.21.15.50:0/669225959 conn(0x7eff040fec60 msgr2=0x7eff04101130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:14:15.962 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:15.960+0000 7eff08c00640 1 -- 172.21.15.50:0/669225959 shutdown_connections 2024-08-31T04:14:15.962 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:15.960+0000 7eff08c00640 1 -- 172.21.15.50:0/669225959 wait complete. 2024-08-31T04:14:15.963 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:15.961+0000 7eff08c00640 1 Processor -- start 2024-08-31T04:14:15.963 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:15.961+0000 7eff08c00640 1 -- start start 2024-08-31T04:14:15.963 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:15.961+0000 7eff08c00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7eff04103310 0x7eff04076be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:14:15.963 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:15.961+0000 7eff08c00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7eff041043a0 0x7eff040754b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:14:15.963 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:15.961+0000 7eff08c00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7eff04104d40 0x7eff040759f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:14:15.963 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:15.961+0000 7eff08c00640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7eff0410efc0 con 0x7eff041043a0 2024-08-31T04:14:15.963 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:15.961+0000 7eff08c00640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7eff0410ee40 con 0x7eff04104d40 2024-08-31T04:14:15.963 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:15.961+0000 7eff08c00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7eff0410f140 con 0x7eff04103310 2024-08-31T04:14:15.964 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:15.962+0000 7eff02a00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7eff041043a0 0x7eff040754b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:14:15.964 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:15.962+0000 7eff02a00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7eff041043a0 0x7eff040754b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:54758/0 (socket says 172.21.15.50:54758) 2024-08-31T04:14:15.964 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:15.962+0000 7eff02a00640 1 -- 172.21.15.50:0/1751105143 learned_addr learned my addr 172.21.15.50:0/1751105143 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:14:15.965 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:15.962+0000 7eff03400640 1 --2- 172.21.15.50:0/1751105143 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7eff04103310 0x7eff04076be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:14:15.965 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:15.962+0000 7eff03e00640 1 --2- 172.21.15.50:0/1751105143 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7eff04104d40 0x7eff040759f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:14:15.965 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:15.962+0000 7eff03400640 1 -- 172.21.15.50:0/1751105143 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7eff04104d40 msgr2=0x7eff040759f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:14:15.965 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:15.962+0000 7eff03400640 1 --2- 172.21.15.50:0/1751105143 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7eff04104d40 0x7eff040759f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:14:15.965 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:15.962+0000 7eff03400640 1 -- 172.21.15.50:0/1751105143 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7eff041043a0 msgr2=0x7eff040754b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:14:15.965 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:15.962+0000 7eff03400640 1 --2- 172.21.15.50:0/1751105143 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7eff041043a0 0x7eff040754b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:14:15.965 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:15.962+0000 7eff03400640 1 -- 172.21.15.50:0/1751105143 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff040760f0 con 0x7eff04103310 2024-08-31T04:14:15.965 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:15.962+0000 7eff02a00640 1 --2- 172.21.15.50:0/1751105143 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7eff041043a0 0x7eff040754b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:14:15.965 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:15.962+0000 7eff03e00640 1 --2- 172.21.15.50:0/1751105143 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7eff04104d40 0x7eff040759f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:14:15.965 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:15.963+0000 7eff03400640 1 --2- 172.21.15.50:0/1751105143 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7eff04103310 0x7eff04076be0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7efef400e9f0 tx=0x7efef400eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:14:15.965 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:15.963+0000 7efefbe00640 1 -- 172.21.15.50:0/1751105143 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efef400ccc0 con 0x7eff04103310 2024-08-31T04:14:15.965 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:15.963+0000 7eff08c00640 1 -- 172.21.15.50:0/1751105143 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7eff041a3c50 con 0x7eff04103310 2024-08-31T04:14:15.965 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:15.963+0000 7eff08c00640 1 -- 172.21.15.50:0/1751105143 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7eff041a40b0 con 0x7eff04103310 2024-08-31T04:14:15.966 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:15.963+0000 7efefbe00640 1 -- 172.21.15.50:0/1751105143 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efef4005020 con 0x7eff04103310 2024-08-31T04:14:15.966 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:15.963+0000 7efefbe00640 1 -- 172.21.15.50:0/1751105143 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efef4004a00 con 0x7eff04103310 2024-08-31T04:14:15.966 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:15.964+0000 7eff08c00640 1 -- 172.21.15.50:0/1751105143 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efee40052c0 con 0x7eff04103310 2024-08-31T04:14:15.968 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:15.967+0000 7efefbe00640 1 -- 172.21.15.50:0/1751105143 <== mon.1 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 15) ==== 152521+0+0 (secure 0 0 0) 0x7efef4004ba0 con 0x7eff04103310 2024-08-31T04:14:15.969 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:15.968+0000 7efefbe00640 1 --2- 172.21.15.50:0/1751105143 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7efee80b4b20 0x7efee80b7030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:14:15.969 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:15.968+0000 7efefbe00640 1 -- 172.21.15.50:0/1751105143 <== mon.1 v2:172.21.15.177:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7efef40e32f0 con 0x7eff04103310 2024-08-31T04:14:15.969 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:15.968+0000 7eff02a00640 1 --2- 172.21.15.50:0/1751105143 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7efee80b4b20 0x7efee80b7030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:14:15.970 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:15.969+0000 7eff02a00640 1 --2- 172.21.15.50:0/1751105143 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7efee80b4b20 0x7efee80b7030 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7efef0005f70 tx=0x7efef00314a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:14:15.973 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:15.972+0000 7efefbe00640 1 -- 172.21.15.50:0/1751105143 <== mon.1 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7efef40ac050 con 0x7eff04103310 2024-08-31T04:14:15.976 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:15.975+0000 7f4daf800640 1 -- 172.21.15.50:0/3226823878 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command([{prefix=config set, name=mds_debug_scatterstat}] v 0) -- 0x7f4da802e430 con 0x7f4da8105710 2024-08-31T04:14:15.982 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:15.981+0000 7f4da5600640 1 -- 172.21.15.50:0/3226823878 <== mon.2 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_debug_scatterstat}]=0 v29)=0 v29) ==== 122+0+0 (secure 0 0 0) 0x7f4d9c0b4030 con 0x7f4da8105710 2024-08-31T04:14:15.985 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:15.984+0000 7f4daf800640 1 -- 172.21.15.50:0/3226823878 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f4d900b4b20 msgr2=0x7f4d900b7030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:14:15.985 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:15.984+0000 7f4daf800640 1 --2- 172.21.15.50:0/3226823878 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f4d900b4b20 0x7f4d900b7030 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f4d94000c00 tx=0x7f4d94031400 comp rx=0 tx=0).stop 2024-08-31T04:14:15.985 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:15.984+0000 7f4daf800640 1 -- 172.21.15.50:0/3226823878 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4da8105710 msgr2=0x7f4da819bf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:14:15.986 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:15.984+0000 7f4daf800640 1 --2- 172.21.15.50:0/3226823878 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4da8105710 0x7f4da819bf60 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f4d9c00d6d0 tx=0x7f4d9c00db90 comp rx=0 tx=0).stop 2024-08-31T04:14:15.986 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:15.984+0000 7f4daf800640 1 -- 172.21.15.50:0/3226823878 shutdown_connections 2024-08-31T04:14:15.986 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:15.984+0000 7f4daf800640 1 --2- 172.21.15.50:0/3226823878 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f4d900b4b20 0x7f4d900b7030 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:14:15.986 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:15.984+0000 7f4daf800640 1 --2- 172.21.15.50:0/3226823878 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4da81067a0 0x7f4da819c5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:14:15.986 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:15.984+0000 7f4daf800640 1 --2- 172.21.15.50:0/3226823878 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4da8107140 0x7f4da819d170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:14:15.986 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:15.984+0000 7f4daf800640 1 --2- 172.21.15.50:0/3226823878 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4da8105710 0x7f4da819bf60 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:14:15.986 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:15.984+0000 7f4daf800640 1 -- 172.21.15.50:0/3226823878 >> 172.21.15.50:0/3226823878 conn(0x7f4da8101060 msgr2=0x7f4da8109ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:14:15.986 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:15.984+0000 7f4daf800640 1 -- 172.21.15.50:0/3226823878 shutdown_connections 2024-08-31T04:14:15.986 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:15.984+0000 7f4daf800640 1 -- 172.21.15.50:0/3226823878 wait complete. 2024-08-31T04:14:16.179 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:16.177+0000 7eff08c00640 1 -- 172.21.15.50:0/1751105143 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command([{prefix=config set, name=osd_op_complaint_time}] v 0) -- 0x7efee40055b0 con 0x7eff04103310 2024-08-31T04:14:16.184 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:16.183+0000 7efefbe00640 1 -- 172.21.15.50:0/1751105143 <== mon.1 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_op_complaint_time}]=0 v30)=0 v30) ==== 121+0+0 (secure 0 0 0) 0x7efef40ab950 con 0x7eff04103310 2024-08-31T04:14:16.187 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:16.186+0000 7eff08c00640 1 -- 172.21.15.50:0/1751105143 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7efee80b4b20 msgr2=0x7efee80b7030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:14:16.187 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:16.186+0000 7eff08c00640 1 --2- 172.21.15.50:0/1751105143 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7efee80b4b20 0x7efee80b7030 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7efef0005f70 tx=0x7efef00314a0 comp rx=0 tx=0).stop 2024-08-31T04:14:16.187 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:16.186+0000 7eff08c00640 1 -- 172.21.15.50:0/1751105143 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7eff04103310 msgr2=0x7eff04076be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:14:16.188 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:16.186+0000 7eff08c00640 1 --2- 172.21.15.50:0/1751105143 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7eff04103310 0x7eff04076be0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7efef400e9f0 tx=0x7efef400eeb0 comp rx=0 tx=0).stop 2024-08-31T04:14:16.188 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:16.186+0000 7eff08c00640 1 -- 172.21.15.50:0/1751105143 shutdown_connections 2024-08-31T04:14:16.188 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:16.186+0000 7eff08c00640 1 --2- 172.21.15.50:0/1751105143 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7efee80b4b20 0x7efee80b7030 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:14:16.188 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:16.186+0000 7eff08c00640 1 --2- 172.21.15.50:0/1751105143 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7eff04104d40 0x7eff040759f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:14:16.188 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:16.186+0000 7eff08c00640 1 --2- 172.21.15.50:0/1751105143 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7eff041043a0 0x7eff040754b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:14:16.188 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:16.186+0000 7eff08c00640 1 --2- 172.21.15.50:0/1751105143 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7eff04103310 0x7eff04076be0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:14:16.188 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:16.186+0000 7eff08c00640 1 -- 172.21.15.50:0/1751105143 >> 172.21.15.50:0/1751105143 conn(0x7eff040fec60 msgr2=0x7eff041076c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:14:16.188 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:16.186+0000 7eff08c00640 1 -- 172.21.15.50:0/1751105143 shutdown_connections 2024-08-31T04:14:16.188 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:16.186+0000 7eff08c00640 1 -- 172.21.15.50:0/1751105143 wait complete. 2024-08-31T04:14:16.450 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:14:16 smithi050 ceph-mon[17259]: from='client.? 172.21.15.50:0/1616353324' entity='client.admin' 2024-08-31T04:14:16.450 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:14:16 smithi050 ceph-mon[17259]: from='client.? 172.21.15.50:0/3781300672' entity='client.admin' 2024-08-31T04:14:16.450 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:14:16 smithi050 ceph-mon[17259]: from='client.? ' entity='client.admin' 2024-08-31T04:14:16.450 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:14:16 smithi050 ceph-mon[17259]: from='client.? ' entity='client.admin' 2024-08-31T04:14:16.450 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:14:16 smithi050 ceph-mon[17259]: from='client.? ' entity='client.admin' 2024-08-31T04:14:16.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:14:16 smithi177 ceph-mon[22025]: from='client.? 172.21.15.50:0/1616353324' entity='client.admin' 2024-08-31T04:14:16.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:14:16 smithi177 ceph-mon[22025]: from='client.? 172.21.15.50:0/3781300672' entity='client.admin' 2024-08-31T04:14:16.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:14:16 smithi177 ceph-mon[22025]: from='client.? ' entity='client.admin' 2024-08-31T04:14:16.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:14:16 smithi177 ceph-mon[22025]: from='client.? ' entity='client.admin' 2024-08-31T04:14:16.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:14:16 smithi177 ceph-mon[22025]: from='client.? ' entity='client.admin' 2024-08-31T04:14:16.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:14:16 smithi133 ceph-mon[22177]: from='client.? 172.21.15.50:0/1616353324' entity='client.admin' 2024-08-31T04:14:16.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:14:16 smithi133 ceph-mon[22177]: from='client.? 172.21.15.50:0/3781300672' entity='client.admin' 2024-08-31T04:14:16.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:14:16 smithi133 ceph-mon[22177]: from='client.? ' entity='client.admin' 2024-08-31T04:14:16.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:14:16 smithi133 ceph-mon[22177]: from='client.? ' entity='client.admin' 2024-08-31T04:14:16.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:14:16 smithi133 ceph-mon[22177]: from='client.? ' entity='client.admin' 2024-08-31T04:14:17.185 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:15.645+0000 7fa413200640 1 -- 172.21.15.50:0/1904246497 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa414075a90 msgr2=0x7fa414075ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:14:17.186 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:15.645+0000 7fa413200640 1 --2- 172.21.15.50:0/1904246497 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa414075a90 0x7fa414075ea0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fa400009900 tx=0x7fa40002a410 comp rx=0 tx=0).stop 2024-08-31T04:14:17.186 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:15.645+0000 7fa413200640 1 -- 172.21.15.50:0/1904246497 shutdown_connections 2024-08-31T04:14:17.186 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:15.645+0000 7fa413200640 1 --2- 172.21.15.50:0/1904246497 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa41410b2b0 0x7fa41410d750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:14:17.186 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:15.645+0000 7fa413200640 1 --2- 172.21.15.50:0/1904246497 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa414075a90 0x7fa414075ea0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:14:17.186 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:15.645+0000 7fa413200640 1 --2- 172.21.15.50:0/1904246497 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa414076e80 0x7fa414075550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:14:17.186 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:15.645+0000 7fa413200640 1 -- 172.21.15.50:0/1904246497 >> 172.21.15.50:0/1904246497 conn(0x7fa4140fec60 msgr2=0x7fa414101130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:14:17.186 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:15.645+0000 7fa413200640 1 -- 172.21.15.50:0/1904246497 shutdown_connections 2024-08-31T04:14:17.186 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:15.647+0000 7fa413200640 1 -- 172.21.15.50:0/1904246497 wait complete. 2024-08-31T04:14:17.186 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:15.647+0000 7fa413200640 1 Processor -- start 2024-08-31T04:14:17.186 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:15.648+0000 7fa413200640 1 -- start start 2024-08-31T04:14:17.186 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:15.648+0000 7fa413200640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa414075a90 0x7fa41419bd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:14:17.186 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:15.648+0000 7fa413200640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa414076e80 0x7fa41419c400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:14:17.187 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:15.648+0000 7fa413200640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa41410b2b0 0x7fa41419cfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:14:17.187 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:15.648+0000 7fa413200640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fa4141111a0 con 0x7fa414076e80 2024-08-31T04:14:17.187 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:15.648+0000 7fa413200640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7fa414111020 con 0x7fa41410b2b0 2024-08-31T04:14:17.187 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:15.648+0000 7fa413200640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fa414111320 con 0x7fa414075a90 2024-08-31T04:14:17.187 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:15.648+0000 7fa411e00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa414075a90 0x7fa41419bd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:14:17.187 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:15.648+0000 7fa411e00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa414075a90 0x7fa41419bd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.50:34682/0 (socket says 172.21.15.50:34682) 2024-08-31T04:14:17.187 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:15.648+0000 7fa411e00640 1 -- 172.21.15.50:0/3516788816 learned_addr learned my addr 172.21.15.50:0/3516788816 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:14:17.187 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:15.648+0000 7fa411400640 1 --2- 172.21.15.50:0/3516788816 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa414076e80 0x7fa41419c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:14:17.187 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:15.649+0000 7fa412800640 1 --2- 172.21.15.50:0/3516788816 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa41410b2b0 0x7fa41419cfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:14:17.187 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:15.649+0000 7fa411e00640 1 -- 172.21.15.50:0/3516788816 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa41410b2b0 msgr2=0x7fa41419cfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:14:17.188 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:15.649+0000 7fa411e00640 1 --2- 172.21.15.50:0/3516788816 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa41410b2b0 0x7fa41419cfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:14:17.188 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:15.649+0000 7fa411e00640 1 -- 172.21.15.50:0/3516788816 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa414076e80 msgr2=0x7fa41419c400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:14:17.188 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:15.649+0000 7fa411e00640 1 --2- 172.21.15.50:0/3516788816 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa414076e80 0x7fa41419c400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:14:17.188 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:15.649+0000 7fa411e00640 1 -- 172.21.15.50:0/3516788816 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa41419d7c0 con 0x7fa414075a90 2024-08-31T04:14:17.188 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:15.649+0000 7fa411e00640 1 --2- 172.21.15.50:0/3516788816 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa414075a90 0x7fa41419bd90 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fa40400e9f0 tx=0x7fa40400eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:14:17.188 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:15.649+0000 7fa40aa00640 1 -- 172.21.15.50:0/3516788816 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa40400cd80 con 0x7fa414075a90 2024-08-31T04:14:17.188 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:15.650+0000 7fa40aa00640 1 -- 172.21.15.50:0/3516788816 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa4040108e0 con 0x7fa414075a90 2024-08-31T04:14:17.188 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:15.650+0000 7fa40aa00640 1 -- 172.21.15.50:0/3516788816 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa404018980 con 0x7fa414075a90 2024-08-31T04:14:17.188 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:15.650+0000 7fa413200640 1 -- 172.21.15.50:0/3516788816 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa41419dab0 con 0x7fa414075a90 2024-08-31T04:14:17.188 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:15.650+0000 7fa413200640 1 -- 172.21.15.50:0/3516788816 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4141a41b0 con 0x7fa414075a90 2024-08-31T04:14:17.188 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:15.651+0000 7fa413200640 1 -- 172.21.15.50:0/3516788816 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa41410a0c0 con 0x7fa414075a90 2024-08-31T04:14:17.188 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:15.653+0000 7fa40aa00640 1 -- 172.21.15.50:0/3516788816 <== mon.1 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 15) ==== 152521+0+0 (secure 0 0 0) 0x7fa404010430 con 0x7fa414075a90 2024-08-31T04:14:17.189 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:15.655+0000 7fa40aa00640 1 --2- 172.21.15.50:0/3516788816 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fa3f80b4ba0 0x7fa3f80b70b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:14:17.189 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:15.655+0000 7fa40aa00640 1 -- 172.21.15.50:0/3516788816 <== mon.1 v2:172.21.15.177:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fa4040e3ce0 con 0x7fa414075a90 2024-08-31T04:14:17.189 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:15.655+0000 7fa411400640 1 --2- 172.21.15.50:0/3516788816 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fa3f80b4ba0 0x7fa3f80b70b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:14:17.189 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:15.656+0000 7fa411400640 1 --2- 172.21.15.50:0/3516788816 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fa3f80b4ba0 0x7fa3f80b70b0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fa400004770 tx=0x7fa4000314a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:14:17.189 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:15.657+0000 7fa40aa00640 1 -- 172.21.15.50:0/3516788816 <== mon.1 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fa4040aca40 con 0x7fa414075a90 2024-08-31T04:14:17.189 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:15.871+0000 7fa413200640 1 -- 172.21.15.50:0/3516788816 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command([{prefix=config set, name=mds_verify_scatter}] v 0) -- 0x7fa41402e430 con 0x7fa414075a90 2024-08-31T04:14:17.189 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:15.878+0000 7fa40aa00640 1 -- 172.21.15.50:0/3516788816 <== mon.1 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_verify_scatter}]=0 v28)=0 v28) ==== 119+0+0 (secure 0 0 0) 0x7fa4040ac340 con 0x7fa414075a90 2024-08-31T04:14:17.189 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:15.880+0000 7fa413200640 1 -- 172.21.15.50:0/3516788816 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fa3f80b4ba0 msgr2=0x7fa3f80b70b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:14:17.189 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:15.880+0000 7fa413200640 1 --2- 172.21.15.50:0/3516788816 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fa3f80b4ba0 0x7fa3f80b70b0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fa400004770 tx=0x7fa4000314a0 comp rx=0 tx=0).stop 2024-08-31T04:14:17.189 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:15.880+0000 7fa413200640 1 -- 172.21.15.50:0/3516788816 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa414075a90 msgr2=0x7fa41419bd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:14:17.189 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:15.880+0000 7fa413200640 1 --2- 172.21.15.50:0/3516788816 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa414075a90 0x7fa41419bd90 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fa40400e9f0 tx=0x7fa40400eeb0 comp rx=0 tx=0).stop 2024-08-31T04:14:17.190 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:15.880+0000 7fa413200640 1 -- 172.21.15.50:0/3516788816 shutdown_connections 2024-08-31T04:14:17.190 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:15.880+0000 7fa413200640 1 --2- 172.21.15.50:0/3516788816 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fa3f80b4ba0 0x7fa3f80b70b0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:14:17.190 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:15.880+0000 7fa413200640 1 --2- 172.21.15.50:0/3516788816 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa41410b2b0 0x7fa41419cfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:14:17.190 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:15.880+0000 7fa413200640 1 --2- 172.21.15.50:0/3516788816 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa414076e80 0x7fa41419c400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:14:17.190 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:15.880+0000 7fa413200640 1 --2- 172.21.15.50:0/3516788816 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa414075a90 0x7fa41419bd90 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:14:17.190 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:15.880+0000 7fa413200640 1 -- 172.21.15.50:0/3516788816 >> 172.21.15.50:0/3516788816 conn(0x7fa4140fec60 msgr2=0x7fa414107290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:14:17.190 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:15.881+0000 7fa413200640 1 -- 172.21.15.50:0/3516788816 shutdown_connections 2024-08-31T04:14:17.190 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:15.881+0000 7fa413200640 1 -- 172.21.15.50:0/3516788816 wait complete. 2024-08-31T04:14:17.440 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:14:17 smithi050 ceph-mon[17259]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T04:14:17.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:14:17 smithi177 ceph-mon[22025]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T04:14:17.542 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:14:17 smithi133 ceph-mon[22177]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T04:14:18.522 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '058d9fc6-674f-11ef-bcd4-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'mds_bal_merge_size', '5'], check_status=True, hostname='smithi050') 2024-08-31T04:14:19.450 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:14:19 smithi050 ceph-mon[17259]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T04:14:19.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:14:19 smithi177 ceph-mon[22025]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T04:14:19.542 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:14:19 smithi133 ceph-mon[22177]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T04:14:19.946 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:14:19.982 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '058d9fc6-674f-11ef-bcd4-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'mds_bal_split_bits', '3'], check_status=True, hostname='smithi050') 2024-08-31T04:14:19.982 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '058d9fc6-674f-11ef-bcd4-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'mds_bal_split_size', '100'], check_status=True, hostname='smithi050') 2024-08-31T04:14:19.982 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '058d9fc6-674f-11ef-bcd4-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'mds_debug_frag', 'True'], check_status=True, hostname='smithi050') 2024-08-31T04:14:19.983 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '058d9fc6-674f-11ef-bcd4-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'mds_debug_scatterstat', 'True'], check_status=True, hostname='smithi050') 2024-08-31T04:14:19.983 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '058d9fc6-674f-11ef-bcd4-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'mds_op_complaint_time', '180'], check_status=True, hostname='smithi050') 2024-08-31T04:14:19.983 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '058d9fc6-674f-11ef-bcd4-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'mds_verify_scatter', 'True'], check_status=True, hostname='smithi050') 2024-08-31T04:14:19.983 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '058d9fc6-674f-11ef-bcd4-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'osd_op_complaint_time', '180'], check_status=True, hostname='smithi050') 2024-08-31T04:14:19.983 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '058d9fc6-674f-11ef-bcd4-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'rados_mon_op_timeout', '900'], check_status=True, hostname='smithi050') 2024-08-31T04:14:19.983 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '058d9fc6-674f-11ef-bcd4-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'rados_osd_op_timeout', '900'], check_status=True, hostname='smithi050') 2024-08-31T04:14:20.636 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '058d9fc6-674f-11ef-bcd4-c7b262605968', '--', 'ceph', 'config', 'set', 'mon', 'mon_op_complaint_time', '120'], check_status=True, hostname='smithi050') 2024-08-31T04:14:20.636 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '058d9fc6-674f-11ef-bcd4-c7b262605968', '--', 'ceph', 'config', 'set', 'mon', 'mon_warn_on_pool_no_app', 'False'], check_status=True, hostname='smithi050') 2024-08-31T04:14:20.937 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:20.935+0000 7f4134a00640 1 -- 172.21.15.50:0/4136980160 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4130076e20 msgr2=0x7f41300754f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:14:20.937 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:20.935+0000 7f4134a00640 1 --2- 172.21.15.50:0/4136980160 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4130076e20 0x7f41300754f0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f4120009900 tx=0x7f412002a410 comp rx=0 tx=0).stop 2024-08-31T04:14:20.937 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:20.935+0000 7f4134a00640 1 -- 172.21.15.50:0/4136980160 shutdown_connections 2024-08-31T04:14:20.937 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:20.935+0000 7f4134a00640 1 --2- 172.21.15.50:0/4136980160 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f413010b330 0x7f413010d770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:14:20.938 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:20.935+0000 7f4134a00640 1 --2- 172.21.15.50:0/4136980160 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4130075a30 0x7f4130075e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:14:20.938 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:20.935+0000 7f4134a00640 1 --2- 172.21.15.50:0/4136980160 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4130076e20 0x7f41300754f0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:14:20.938 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:20.935+0000 7f4134a00640 1 -- 172.21.15.50:0/4136980160 >> 172.21.15.50:0/4136980160 conn(0x7f41300feca0 msgr2=0x7f4130101150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:14:20.938 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:20.936+0000 7f4134a00640 1 -- 172.21.15.50:0/4136980160 shutdown_connections 2024-08-31T04:14:20.938 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:20.936+0000 7f4134a00640 1 -- 172.21.15.50:0/4136980160 wait complete. 2024-08-31T04:14:20.941 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:20.937+0000 7f4134a00640 1 Processor -- start 2024-08-31T04:14:20.941 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:20.937+0000 7f4134a00640 1 -- start start 2024-08-31T04:14:20.941 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:20.937+0000 7f4134a00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4130075a30 0x7f413019bda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:14:20.941 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:20.937+0000 7f4134a00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4130076e20 0x7f413019c410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:14:20.941 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:20.937+0000 7f4134a00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f413010b330 0x7f413019cfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:14:20.941 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:20.937+0000 7f4134a00640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f41301111a0 con 0x7f4130075a30 2024-08-31T04:14:20.941 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:20.937+0000 7f4134a00640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f4130111020 con 0x7f4130076e20 2024-08-31T04:14:20.941 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:20.937+0000 7f4134a00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f4130111320 con 0x7f413010b330 2024-08-31T04:14:20.942 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:20.937+0000 7f412f400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4130075a30 0x7f413019bda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:14:20.942 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:20.937+0000 7f412f400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4130075a30 0x7f413019bda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:54782/0 (socket says 172.21.15.50:54782) 2024-08-31T04:14:20.942 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:20.937+0000 7f412f400640 1 -- 172.21.15.50:0/851805049 learned_addr learned my addr 172.21.15.50:0/851805049 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:14:20.942 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:20.938+0000 7f4126a00640 1 --2- 172.21.15.50:0/851805049 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4130076e20 0x7f413019c410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:14:20.942 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:20.938+0000 7f412fe00640 1 --2- 172.21.15.50:0/851805049 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f413010b330 0x7f413019cfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:14:20.942 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:20.938+0000 7f412f400640 1 -- 172.21.15.50:0/851805049 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f413010b330 msgr2=0x7f413019cfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:14:20.942 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:20.938+0000 7f412f400640 1 --2- 172.21.15.50:0/851805049 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f413010b330 0x7f413019cfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:14:20.942 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:20.938+0000 7f412f400640 1 -- 172.21.15.50:0/851805049 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4130076e20 msgr2=0x7f413019c410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:14:20.942 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:20.938+0000 7f412f400640 1 --2- 172.21.15.50:0/851805049 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4130076e20 0x7f413019c410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:14:20.942 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:20.938+0000 7f412f400640 1 -- 172.21.15.50:0/851805049 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f413019d7d0 con 0x7f4130075a30 2024-08-31T04:14:20.942 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:20.938+0000 7f4126a00640 1 --2- 172.21.15.50:0/851805049 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4130076e20 0x7f413019c410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:14:20.942 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:20.938+0000 7f412f400640 1 --2- 172.21.15.50:0/851805049 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4130075a30 0x7f413019bda0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f4120031440 tx=0x7f4120003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:14:20.942 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:20.939+0000 7f412cc00640 1 -- 172.21.15.50:0/851805049 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f412003f070 con 0x7f4130075a30 2024-08-31T04:14:20.943 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:20.939+0000 7f412cc00640 1 -- 172.21.15.50:0/851805049 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4120031c50 con 0x7f4130075a30 2024-08-31T04:14:20.943 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:20.939+0000 7f412cc00640 1 -- 172.21.15.50:0/851805049 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4120035030 con 0x7f4130075a30 2024-08-31T04:14:20.943 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:20.939+0000 7f4134a00640 1 -- 172.21.15.50:0/851805049 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f413019da60 con 0x7f4130075a30 2024-08-31T04:14:20.943 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:20.939+0000 7f4134a00640 1 -- 172.21.15.50:0/851805049 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f41301a41c0 con 0x7f4130075a30 2024-08-31T04:14:20.943 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:20.940+0000 7f4134a00640 1 -- 172.21.15.50:0/851805049 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4130075e40 con 0x7f4130075a30 2024-08-31T04:14:20.943 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:20.942+0000 7f412cc00640 1 -- 172.21.15.50:0/851805049 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 15) ==== 152521+0+0 (secure 0 0 0) 0x7f4120042070 con 0x7f4130075a30 2024-08-31T04:14:20.945 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:20.944+0000 7f412cc00640 1 --2- 172.21.15.50:0/851805049 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f41140b4ba0 0x7f41140b70b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:14:20.945 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:20.944+0000 7f412cc00640 1 -- 172.21.15.50:0/851805049 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f4120103c80 con 0x7f4130075a30 2024-08-31T04:14:20.945 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:20.944+0000 7f4126a00640 1 --2- 172.21.15.50:0/851805049 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f41140b4ba0 0x7f41140b70b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:14:20.946 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:20.945+0000 7f4126a00640 1 --2- 172.21.15.50:0/851805049 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f41140b4ba0 0x7f41140b70b0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f4118009fc0 tx=0x7f4118005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:14:20.950 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:20.949+0000 7f412cc00640 1 -- 172.21.15.50:0/851805049 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f41200cc390 con 0x7f4130075a30 2024-08-31T04:14:21.143 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:21.142+0000 7f4134a00640 1 -- 172.21.15.50:0/851805049 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_pool_no_app}] v 0) -- 0x7f4130063d60 con 0x7f4130075a30 2024-08-31T04:14:21.149 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:21.148+0000 7f412cc00640 1 -- 172.21.15.50:0/851805049 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_pool_no_app}]=0 v31)=0 v31) ==== 125+0+0 (secure 0 0 0) 0x7f41200d0b50 con 0x7f4130075a30 2024-08-31T04:14:21.152 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:21.150+0000 7f4134a00640 1 -- 172.21.15.50:0/851805049 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f41140b4ba0 msgr2=0x7f41140b70b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:14:21.152 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:21.150+0000 7f4134a00640 1 --2- 172.21.15.50:0/851805049 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f41140b4ba0 0x7f41140b70b0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f4118009fc0 tx=0x7f4118005f90 comp rx=0 tx=0).stop 2024-08-31T04:14:21.153 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:21.150+0000 7f4134a00640 1 -- 172.21.15.50:0/851805049 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4130075a30 msgr2=0x7f413019bda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:14:21.153 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:21.150+0000 7f4134a00640 1 --2- 172.21.15.50:0/851805049 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4130075a30 0x7f413019bda0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f4120031440 tx=0x7f4120003c10 comp rx=0 tx=0).stop 2024-08-31T04:14:21.153 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:21.151+0000 7f4134a00640 1 -- 172.21.15.50:0/851805049 shutdown_connections 2024-08-31T04:14:21.153 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:21.151+0000 7f4134a00640 1 --2- 172.21.15.50:0/851805049 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f41140b4ba0 0x7f41140b70b0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:14:21.153 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:21.151+0000 7f4134a00640 1 --2- 172.21.15.50:0/851805049 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f413010b330 0x7f413019cfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:14:21.153 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:21.151+0000 7f4134a00640 1 --2- 172.21.15.50:0/851805049 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4130076e20 0x7f413019c410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:14:21.154 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:21.151+0000 7f4134a00640 1 --2- 172.21.15.50:0/851805049 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4130075a30 0x7f413019bda0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:14:21.154 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:21.151+0000 7f4134a00640 1 -- 172.21.15.50:0/851805049 >> 172.21.15.50:0/851805049 conn(0x7f41300feca0 msgr2=0x7f4130107310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:14:21.154 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:21.151+0000 7f4134a00640 1 -- 172.21.15.50:0/851805049 shutdown_connections 2024-08-31T04:14:21.154 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:21.151+0000 7f4134a00640 1 -- 172.21.15.50:0/851805049 wait complete. 2024-08-31T04:14:21.450 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:14:21 smithi050 ceph-mon[17259]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T04:14:21.450 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:14:21 smithi050 ceph-mon[17259]: from='client.? 172.21.15.50:0/851805049' entity='client.admin' 2024-08-31T04:14:21.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:14:21 smithi177 ceph-mon[22025]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T04:14:21.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:14:21 smithi177 ceph-mon[22025]: from='client.? 172.21.15.50:0/851805049' entity='client.admin' 2024-08-31T04:14:21.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:14:21 smithi133 ceph-mon[22177]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T04:14:21.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:14:21 smithi133 ceph-mon[22177]: from='client.? 172.21.15.50:0/851805049' entity='client.admin' 2024-08-31T04:14:21.833 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '058d9fc6-674f-11ef-bcd4-c7b262605968', '--', 'ceph', 'config', 'set', 'osd', 'osd_op_complaint_time', '180'], check_status=True, hostname='smithi050') 2024-08-31T04:14:21.834 INFO:tasks.cephadm:Deploying OSDs... 2024-08-31T04:14:21.834 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-08-31T04:14:21.834 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/scratch_devs of=/dev/stdout 2024-08-31T04:14:21.870 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-08-31T04:14:21.870 DEBUG:teuthology.orchestra.run.smithi050:> stat /dev/vg_nvme/lv_1 2024-08-31T04:14:21.945 INFO:teuthology.orchestra.run.smithi050.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-08-31T04:14:21.945 INFO:teuthology.orchestra.run.smithi050.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-31T04:14:21.945 INFO:teuthology.orchestra.run.smithi050.stdout:Device: 6h/6d Inode: 641 Links: 1 2024-08-31T04:14:21.945 INFO:teuthology.orchestra.run.smithi050.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-31T04:14:21.945 INFO:teuthology.orchestra.run.smithi050.stdout:Context: system_u:object_r:device_t:s0 2024-08-31T04:14:21.945 INFO:teuthology.orchestra.run.smithi050.stdout:Access: 2024-08-31 04:13:11.960054327 +0000 2024-08-31T04:14:21.945 INFO:teuthology.orchestra.run.smithi050.stdout:Modify: 2024-08-31 04:08:31.888164211 +0000 2024-08-31T04:14:21.946 INFO:teuthology.orchestra.run.smithi050.stdout:Change: 2024-08-31 04:08:31.888164211 +0000 2024-08-31T04:14:21.946 INFO:teuthology.orchestra.run.smithi050.stdout: Birth: 2024-08-31 04:08:31.888164211 +0000 2024-08-31T04:14:21.946 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-08-31T04:14:22.039 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-08-31T04:14:22.039 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-08-31T04:14:22.039 INFO:teuthology.orchestra.run.smithi050.stderr:512 bytes copied, 0.000181426 s, 2.8 MB/s 2024-08-31T04:14:22.042 DEBUG:teuthology.orchestra.run.smithi050:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-08-31T04:14:22.078 DEBUG:teuthology.orchestra.run.smithi050:> stat /dev/vg_nvme/lv_2 2024-08-31T04:14:22.152 INFO:teuthology.orchestra.run.smithi050.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-08-31T04:14:22.153 INFO:teuthology.orchestra.run.smithi050.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-31T04:14:22.153 INFO:teuthology.orchestra.run.smithi050.stdout:Device: 6h/6d Inode: 659 Links: 1 2024-08-31T04:14:22.153 INFO:teuthology.orchestra.run.smithi050.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-31T04:14:22.153 INFO:teuthology.orchestra.run.smithi050.stdout:Context: system_u:object_r:device_t:s0 2024-08-31T04:14:22.153 INFO:teuthology.orchestra.run.smithi050.stdout:Access: 2024-08-31 04:13:12.001053295 +0000 2024-08-31T04:14:22.153 INFO:teuthology.orchestra.run.smithi050.stdout:Modify: 2024-08-31 04:08:32.396151273 +0000 2024-08-31T04:14:22.153 INFO:teuthology.orchestra.run.smithi050.stdout:Change: 2024-08-31 04:08:32.396151273 +0000 2024-08-31T04:14:22.153 INFO:teuthology.orchestra.run.smithi050.stdout: Birth: 2024-08-31 04:08:32.396151273 +0000 2024-08-31T04:14:22.153 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-08-31T04:14:22.247 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-08-31T04:14:22.247 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-08-31T04:14:22.247 INFO:teuthology.orchestra.run.smithi050.stderr:512 bytes copied, 0.000181195 s, 2.8 MB/s 2024-08-31T04:14:22.249 DEBUG:teuthology.orchestra.run.smithi050:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-08-31T04:14:22.285 DEBUG:teuthology.orchestra.run.smithi050:> stat /dev/vg_nvme/lv_3 2024-08-31T04:14:22.360 INFO:teuthology.orchestra.run.smithi050.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-08-31T04:14:22.360 INFO:teuthology.orchestra.run.smithi050.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-31T04:14:22.361 INFO:teuthology.orchestra.run.smithi050.stdout:Device: 6h/6d Inode: 680 Links: 1 2024-08-31T04:14:22.361 INFO:teuthology.orchestra.run.smithi050.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-31T04:14:22.361 INFO:teuthology.orchestra.run.smithi050.stdout:Context: system_u:object_r:device_t:s0 2024-08-31T04:14:22.361 INFO:teuthology.orchestra.run.smithi050.stdout:Access: 2024-08-31 04:13:12.041052289 +0000 2024-08-31T04:14:22.361 INFO:teuthology.orchestra.run.smithi050.stdout:Modify: 2024-08-31 04:08:32.887138769 +0000 2024-08-31T04:14:22.361 INFO:teuthology.orchestra.run.smithi050.stdout:Change: 2024-08-31 04:08:32.887138769 +0000 2024-08-31T04:14:22.361 INFO:teuthology.orchestra.run.smithi050.stdout: Birth: 2024-08-31 04:08:32.887138769 +0000 2024-08-31T04:14:22.361 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-08-31T04:14:22.453 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-08-31T04:14:22.453 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-08-31T04:14:22.453 INFO:teuthology.orchestra.run.smithi050.stderr:512 bytes copied, 0.000166431 s, 3.1 MB/s 2024-08-31T04:14:22.455 DEBUG:teuthology.orchestra.run.smithi050:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-08-31T04:14:22.491 DEBUG:teuthology.orchestra.run.smithi050:> stat /dev/vg_nvme/lv_4 2024-08-31T04:14:22.566 INFO:teuthology.orchestra.run.smithi050.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-08-31T04:14:22.566 INFO:teuthology.orchestra.run.smithi050.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-31T04:14:22.566 INFO:teuthology.orchestra.run.smithi050.stdout:Device: 6h/6d Inode: 699 Links: 1 2024-08-31T04:14:22.566 INFO:teuthology.orchestra.run.smithi050.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-31T04:14:22.566 INFO:teuthology.orchestra.run.smithi050.stdout:Context: system_u:object_r:device_t:s0 2024-08-31T04:14:22.566 INFO:teuthology.orchestra.run.smithi050.stdout:Access: 2024-08-31 04:13:12.095050930 +0000 2024-08-31T04:14:22.567 INFO:teuthology.orchestra.run.smithi050.stdout:Modify: 2024-08-31 04:08:33.388126009 +0000 2024-08-31T04:14:22.567 INFO:teuthology.orchestra.run.smithi050.stdout:Change: 2024-08-31 04:08:33.388126009 +0000 2024-08-31T04:14:22.567 INFO:teuthology.orchestra.run.smithi050.stdout: Birth: 2024-08-31 04:08:33.388126009 +0000 2024-08-31T04:14:22.567 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-08-31T04:14:22.658 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-08-31T04:14:22.658 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-08-31T04:14:22.658 INFO:teuthology.orchestra.run.smithi050.stderr:512 bytes copied, 0.000165484 s, 3.1 MB/s 2024-08-31T04:14:22.661 DEBUG:teuthology.orchestra.run.smithi050:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-08-31T04:14:22.697 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2024-08-31T04:14:22.698 DEBUG:teuthology.orchestra.run.smithi133:> dd if=/scratch_devs of=/dev/stdout 2024-08-31T04:14:22.718 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-08-31T04:14:22.718 DEBUG:teuthology.orchestra.run.smithi133:> stat /dev/vg_nvme/lv_1 2024-08-31T04:14:22.776 INFO:teuthology.orchestra.run.smithi133.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-08-31T04:14:22.776 INFO:teuthology.orchestra.run.smithi133.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-31T04:14:22.777 INFO:teuthology.orchestra.run.smithi133.stdout:Device: 5h/5d Inode: 665 Links: 1 2024-08-31T04:14:22.777 INFO:teuthology.orchestra.run.smithi133.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-31T04:14:22.777 INFO:teuthology.orchestra.run.smithi133.stdout:Context: system_u:object_r:device_t:s0 2024-08-31T04:14:22.777 INFO:teuthology.orchestra.run.smithi133.stdout:Access: 2024-08-31 04:14:05.032275640 +0000 2024-08-31T04:14:22.777 INFO:teuthology.orchestra.run.smithi133.stdout:Modify: 2024-08-31 04:08:31.767495024 +0000 2024-08-31T04:14:22.777 INFO:teuthology.orchestra.run.smithi133.stdout:Change: 2024-08-31 04:08:31.767495024 +0000 2024-08-31T04:14:22.777 INFO:teuthology.orchestra.run.smithi133.stdout: Birth: 2024-08-31 04:08:31.767495024 +0000 2024-08-31T04:14:22.777 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-08-31T04:14:22.847 INFO:teuthology.orchestra.run.smithi133.stderr:1+0 records in 2024-08-31T04:14:22.847 INFO:teuthology.orchestra.run.smithi133.stderr:1+0 records out 2024-08-31T04:14:22.847 INFO:teuthology.orchestra.run.smithi133.stderr:512 bytes copied, 0.000234168 s, 2.2 MB/s 2024-08-31T04:14:22.849 DEBUG:teuthology.orchestra.run.smithi133:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-08-31T04:14:22.908 DEBUG:teuthology.orchestra.run.smithi133:> stat /dev/vg_nvme/lv_2 2024-08-31T04:14:22.965 INFO:teuthology.orchestra.run.smithi133.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-08-31T04:14:22.965 INFO:teuthology.orchestra.run.smithi133.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-31T04:14:22.966 INFO:teuthology.orchestra.run.smithi133.stdout:Device: 5h/5d Inode: 683 Links: 1 2024-08-31T04:14:22.966 INFO:teuthology.orchestra.run.smithi133.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-31T04:14:22.966 INFO:teuthology.orchestra.run.smithi133.stdout:Context: system_u:object_r:device_t:s0 2024-08-31T04:14:22.966 INFO:teuthology.orchestra.run.smithi133.stdout:Access: 2024-08-31 04:14:05.032275640 +0000 2024-08-31T04:14:22.966 INFO:teuthology.orchestra.run.smithi133.stdout:Modify: 2024-08-31 04:08:32.090488843 +0000 2024-08-31T04:14:22.966 INFO:teuthology.orchestra.run.smithi133.stdout:Change: 2024-08-31 04:08:32.090488843 +0000 2024-08-31T04:14:22.966 INFO:teuthology.orchestra.run.smithi133.stdout: Birth: 2024-08-31 04:08:32.090488843 +0000 2024-08-31T04:14:22.967 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-08-31T04:14:23.031 INFO:teuthology.orchestra.run.smithi133.stderr:1+0 records in 2024-08-31T04:14:23.032 INFO:teuthology.orchestra.run.smithi133.stderr:1+0 records out 2024-08-31T04:14:23.032 INFO:teuthology.orchestra.run.smithi133.stderr:512 bytes copied, 0.00022978 s, 2.2 MB/s 2024-08-31T04:14:23.033 DEBUG:teuthology.orchestra.run.smithi133:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-08-31T04:14:23.091 DEBUG:teuthology.orchestra.run.smithi133:> stat /dev/vg_nvme/lv_3 2024-08-31T04:14:23.147 INFO:teuthology.orchestra.run.smithi133.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-08-31T04:14:23.148 INFO:teuthology.orchestra.run.smithi133.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-31T04:14:23.148 INFO:teuthology.orchestra.run.smithi133.stdout:Device: 5h/5d Inode: 703 Links: 1 2024-08-31T04:14:23.148 INFO:teuthology.orchestra.run.smithi133.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-31T04:14:23.148 INFO:teuthology.orchestra.run.smithi133.stdout:Context: system_u:object_r:device_t:s0 2024-08-31T04:14:23.148 INFO:teuthology.orchestra.run.smithi133.stdout:Access: 2024-08-31 04:14:05.032275640 +0000 2024-08-31T04:14:23.148 INFO:teuthology.orchestra.run.smithi133.stdout:Modify: 2024-08-31 04:08:32.419482547 +0000 2024-08-31T04:14:23.148 INFO:teuthology.orchestra.run.smithi133.stdout:Change: 2024-08-31 04:08:32.419482547 +0000 2024-08-31T04:14:23.148 INFO:teuthology.orchestra.run.smithi133.stdout: Birth: 2024-08-31 04:08:32.419482547 +0000 2024-08-31T04:14:23.148 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-08-31T04:14:23.213 INFO:teuthology.orchestra.run.smithi133.stderr:1+0 records in 2024-08-31T04:14:23.213 INFO:teuthology.orchestra.run.smithi133.stderr:1+0 records out 2024-08-31T04:14:23.213 INFO:teuthology.orchestra.run.smithi133.stderr:512 bytes copied, 0.000172698 s, 3.0 MB/s 2024-08-31T04:14:23.214 DEBUG:teuthology.orchestra.run.smithi133:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-08-31T04:14:23.271 DEBUG:teuthology.orchestra.run.smithi133:> stat /dev/vg_nvme/lv_4 2024-08-31T04:14:23.326 INFO:teuthology.orchestra.run.smithi133.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-08-31T04:14:23.327 INFO:teuthology.orchestra.run.smithi133.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-31T04:14:23.327 INFO:teuthology.orchestra.run.smithi133.stdout:Device: 5h/5d Inode: 721 Links: 1 2024-08-31T04:14:23.327 INFO:teuthology.orchestra.run.smithi133.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-31T04:14:23.327 INFO:teuthology.orchestra.run.smithi133.stdout:Context: system_u:object_r:device_t:s0 2024-08-31T04:14:23.327 INFO:teuthology.orchestra.run.smithi133.stdout:Access: 2024-08-31 04:14:05.033275621 +0000 2024-08-31T04:14:23.327 INFO:teuthology.orchestra.run.smithi133.stdout:Modify: 2024-08-31 04:08:32.734476518 +0000 2024-08-31T04:14:23.327 INFO:teuthology.orchestra.run.smithi133.stdout:Change: 2024-08-31 04:08:32.734476518 +0000 2024-08-31T04:14:23.327 INFO:teuthology.orchestra.run.smithi133.stdout: Birth: 2024-08-31 04:08:32.734476518 +0000 2024-08-31T04:14:23.327 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-08-31T04:14:23.391 INFO:teuthology.orchestra.run.smithi133.stderr:1+0 records in 2024-08-31T04:14:23.391 INFO:teuthology.orchestra.run.smithi133.stderr:1+0 records out 2024-08-31T04:14:23.391 INFO:teuthology.orchestra.run.smithi133.stderr:512 bytes copied, 0.000206798 s, 2.5 MB/s 2024-08-31T04:14:23.392 DEBUG:teuthology.orchestra.run.smithi133:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-08-31T04:14:23.450 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2024-08-31T04:14:23.450 DEBUG:teuthology.orchestra.run.smithi177:> dd if=/scratch_devs of=/dev/stdout 2024-08-31T04:14:23.469 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-08-31T04:14:23.469 DEBUG:teuthology.orchestra.run.smithi177:> stat /dev/vg_nvme/lv_1 2024-08-31T04:14:23.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:14:23 smithi177 ceph-mon[22025]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T04:14:23.513 INFO:teuthology.orchestra.run.smithi177.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-08-31T04:14:23.513 INFO:teuthology.orchestra.run.smithi177.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-31T04:14:23.513 INFO:teuthology.orchestra.run.smithi177.stdout:Device: 5h/5d Inode: 663 Links: 1 2024-08-31T04:14:23.514 INFO:teuthology.orchestra.run.smithi177.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-31T04:14:23.514 INFO:teuthology.orchestra.run.smithi177.stdout:Context: system_u:object_r:device_t:s0 2024-08-31T04:14:23.514 INFO:teuthology.orchestra.run.smithi177.stdout:Access: 2024-08-31 04:14:02.724418417 +0000 2024-08-31T04:14:23.514 INFO:teuthology.orchestra.run.smithi177.stdout:Modify: 2024-08-31 04:08:34.075140218 +0000 2024-08-31T04:14:23.514 INFO:teuthology.orchestra.run.smithi177.stdout:Change: 2024-08-31 04:08:34.075140218 +0000 2024-08-31T04:14:23.514 INFO:teuthology.orchestra.run.smithi177.stdout: Birth: 2024-08-31 04:08:34.075140218 +0000 2024-08-31T04:14:23.514 DEBUG:teuthology.orchestra.run.smithi177:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-08-31T04:14:23.542 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:14:23 smithi133 ceph-mon[22177]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T04:14:23.583 INFO:teuthology.orchestra.run.smithi177.stderr:1+0 records in 2024-08-31T04:14:23.583 INFO:teuthology.orchestra.run.smithi177.stderr:1+0 records out 2024-08-31T04:14:23.583 INFO:teuthology.orchestra.run.smithi177.stderr:512 bytes copied, 0.000271523 s, 1.9 MB/s 2024-08-31T04:14:23.585 DEBUG:teuthology.orchestra.run.smithi177:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-08-31T04:14:23.644 DEBUG:teuthology.orchestra.run.smithi177:> stat /dev/vg_nvme/lv_2 2024-08-31T04:14:23.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:14:23 smithi050 ceph-mon[17259]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T04:14:23.701 INFO:teuthology.orchestra.run.smithi177.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-08-31T04:14:23.701 INFO:teuthology.orchestra.run.smithi177.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-31T04:14:23.701 INFO:teuthology.orchestra.run.smithi177.stdout:Device: 5h/5d Inode: 684 Links: 1 2024-08-31T04:14:23.701 INFO:teuthology.orchestra.run.smithi177.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-31T04:14:23.701 INFO:teuthology.orchestra.run.smithi177.stdout:Context: system_u:object_r:device_t:s0 2024-08-31T04:14:23.701 INFO:teuthology.orchestra.run.smithi177.stdout:Access: 2024-08-31 04:14:02.724418417 +0000 2024-08-31T04:14:23.701 INFO:teuthology.orchestra.run.smithi177.stdout:Modify: 2024-08-31 04:08:34.407130651 +0000 2024-08-31T04:14:23.701 INFO:teuthology.orchestra.run.smithi177.stdout:Change: 2024-08-31 04:08:34.407130651 +0000 2024-08-31T04:14:23.702 INFO:teuthology.orchestra.run.smithi177.stdout: Birth: 2024-08-31 04:08:34.407130651 +0000 2024-08-31T04:14:23.702 DEBUG:teuthology.orchestra.run.smithi177:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-08-31T04:14:23.766 INFO:teuthology.orchestra.run.smithi177.stderr:1+0 records in 2024-08-31T04:14:23.766 INFO:teuthology.orchestra.run.smithi177.stderr:1+0 records out 2024-08-31T04:14:23.766 INFO:teuthology.orchestra.run.smithi177.stderr:512 bytes copied, 0.000224647 s, 2.3 MB/s 2024-08-31T04:14:23.768 DEBUG:teuthology.orchestra.run.smithi177:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-08-31T04:14:23.825 DEBUG:teuthology.orchestra.run.smithi177:> stat /dev/vg_nvme/lv_3 2024-08-31T04:14:23.882 INFO:teuthology.orchestra.run.smithi177.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-08-31T04:14:23.883 INFO:teuthology.orchestra.run.smithi177.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-31T04:14:23.883 INFO:teuthology.orchestra.run.smithi177.stdout:Device: 5h/5d Inode: 702 Links: 1 2024-08-31T04:14:23.883 INFO:teuthology.orchestra.run.smithi177.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-31T04:14:23.883 INFO:teuthology.orchestra.run.smithi177.stdout:Context: system_u:object_r:device_t:s0 2024-08-31T04:14:23.883 INFO:teuthology.orchestra.run.smithi177.stdout:Access: 2024-08-31 04:14:02.724418417 +0000 2024-08-31T04:14:23.883 INFO:teuthology.orchestra.run.smithi177.stdout:Modify: 2024-08-31 04:08:34.730121344 +0000 2024-08-31T04:14:23.883 INFO:teuthology.orchestra.run.smithi177.stdout:Change: 2024-08-31 04:08:34.730121344 +0000 2024-08-31T04:14:23.883 INFO:teuthology.orchestra.run.smithi177.stdout: Birth: 2024-08-31 04:08:34.730121344 +0000 2024-08-31T04:14:23.883 DEBUG:teuthology.orchestra.run.smithi177:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-08-31T04:14:23.950 INFO:teuthology.orchestra.run.smithi177.stderr:1+0 records in 2024-08-31T04:14:23.950 INFO:teuthology.orchestra.run.smithi177.stderr:1+0 records out 2024-08-31T04:14:23.950 INFO:teuthology.orchestra.run.smithi177.stderr:512 bytes copied, 0.000189986 s, 2.7 MB/s 2024-08-31T04:14:23.952 DEBUG:teuthology.orchestra.run.smithi177:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-08-31T04:14:24.009 DEBUG:teuthology.orchestra.run.smithi177:> stat /dev/vg_nvme/lv_4 2024-08-31T04:14:24.064 INFO:teuthology.orchestra.run.smithi177.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-08-31T04:14:24.065 INFO:teuthology.orchestra.run.smithi177.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-31T04:14:24.065 INFO:teuthology.orchestra.run.smithi177.stdout:Device: 5h/5d Inode: 721 Links: 1 2024-08-31T04:14:24.065 INFO:teuthology.orchestra.run.smithi177.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-31T04:14:24.065 INFO:teuthology.orchestra.run.smithi177.stdout:Context: system_u:object_r:device_t:s0 2024-08-31T04:14:24.065 INFO:teuthology.orchestra.run.smithi177.stdout:Access: 2024-08-31 04:14:02.725418388 +0000 2024-08-31T04:14:24.065 INFO:teuthology.orchestra.run.smithi177.stdout:Modify: 2024-08-31 04:08:35.046112238 +0000 2024-08-31T04:14:24.065 INFO:teuthology.orchestra.run.smithi177.stdout:Change: 2024-08-31 04:08:35.046112238 +0000 2024-08-31T04:14:24.065 INFO:teuthology.orchestra.run.smithi177.stdout: Birth: 2024-08-31 04:08:35.046112238 +0000 2024-08-31T04:14:24.066 DEBUG:teuthology.orchestra.run.smithi177:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-08-31T04:14:24.128 INFO:teuthology.orchestra.run.smithi177.stderr:1+0 records in 2024-08-31T04:14:24.129 INFO:teuthology.orchestra.run.smithi177.stderr:1+0 records out 2024-08-31T04:14:24.129 INFO:teuthology.orchestra.run.smithi177.stderr:512 bytes copied, 0.000323568 s, 1.6 MB/s 2024-08-31T04:14:24.130 DEBUG:teuthology.orchestra.run.smithi177:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-08-31T04:14:24.186 INFO:tasks.cephadm:Deploying osd.0 on smithi050 with /dev/vg_nvme/lv_4... 2024-08-31T04:14:24.186 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 058d9fc6-674f-11ef-bcd4-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-08-31T04:14:24.560 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:14:25.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:14:25 smithi177 ceph-mon[22025]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T04:14:25.542 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:14:25 smithi133 ceph-mon[22177]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T04:14:25.610 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:14:25 smithi050 ceph-mon[17259]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T04:14:27.333 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:14:27 smithi050 ceph-mon[17259]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T04:14:27.340 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-08-31T04:14:27.372 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 058d9fc6-674f-11ef-bcd4-c7b262605968 -- ceph orch daemon add osd smithi050:vg_nvme/lv_4 2024-08-31T04:14:27.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:14:27 smithi177 ceph-mon[22025]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T04:14:27.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:14:27 smithi133 ceph-mon[22177]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T04:14:27.743 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:14:28.343 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:28.341+0000 7f7bbb000640 1 -- 172.21.15.50:0/3209255166 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7bb4104d60 msgr2=0x7f7bb410b700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:14:28.344 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:28.341+0000 7f7bbb000640 1 --2- 172.21.15.50:0/3209255166 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7bb4104d60 0x7f7bb410b700 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f7bac009ca0 tx=0x7f7bac02a950 comp rx=0 tx=0).stop 2024-08-31T04:14:28.344 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:28.342+0000 7f7bbb000640 1 -- 172.21.15.50:0/3209255166 shutdown_connections 2024-08-31T04:14:28.344 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:28.342+0000 7f7bbb000640 1 --2- 172.21.15.50:0/3209255166 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7bb41043c0 0x7f7bb41047d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:14:28.344 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:28.342+0000 7f7bbb000640 1 --2- 172.21.15.50:0/3209255166 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7bb4104d60 0x7f7bb410b700 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:14:28.344 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:28.342+0000 7f7bbb000640 1 --2- 172.21.15.50:0/3209255166 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7bb4103330 0x7f7bb41037a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:14:28.344 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:28.342+0000 7f7bbb000640 1 -- 172.21.15.50:0/3209255166 >> 172.21.15.50:0/3209255166 conn(0x7f7bb40feca0 msgr2=0x7f7bb4101150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:14:28.344 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:28.342+0000 7f7bbb000640 1 -- 172.21.15.50:0/3209255166 shutdown_connections 2024-08-31T04:14:28.345 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:28.342+0000 7f7bbb000640 1 -- 172.21.15.50:0/3209255166 wait complete. 2024-08-31T04:14:28.347 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:28.343+0000 7f7bbb000640 1 Processor -- start 2024-08-31T04:14:28.347 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:28.343+0000 7f7bbb000640 1 -- start start 2024-08-31T04:14:28.347 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:28.343+0000 7f7bbb000640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7bb4103330 0x7f7bb4076be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:14:28.347 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:28.343+0000 7f7bbb000640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7bb41043c0 0x7f7bb40754b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:14:28.347 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:28.343+0000 7f7bbb000640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7bb4104d60 0x7f7bb40759f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:14:28.347 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:28.343+0000 7f7bbb000640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f7bb410ef90 con 0x7f7bb4103330 2024-08-31T04:14:28.347 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:28.343+0000 7f7bbb000640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f7bb410ee10 con 0x7f7bb4104d60 2024-08-31T04:14:28.347 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:28.343+0000 7f7bbb000640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f7bb410f110 con 0x7f7bb41043c0 2024-08-31T04:14:28.347 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:28.343+0000 7f7bb9c00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7bb4103330 0x7f7bb4076be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:14:28.347 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:28.344+0000 7f7bb9c00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7bb4103330 0x7f7bb4076be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:40590/0 (socket says 172.21.15.50:40590) 2024-08-31T04:14:28.347 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:28.344+0000 7f7bb9c00640 1 -- 172.21.15.50:0/1479795672 learned_addr learned my addr 172.21.15.50:0/1479795672 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:14:28.348 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:28.344+0000 7f7bb9200640 1 --2- 172.21.15.50:0/1479795672 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7bb41043c0 0x7f7bb40754b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:14:28.348 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:28.344+0000 7f7bba600640 1 --2- 172.21.15.50:0/1479795672 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7bb4104d60 0x7f7bb40759f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:14:28.348 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:28.344+0000 7f7bb9c00640 1 -- 172.21.15.50:0/1479795672 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7bb41043c0 msgr2=0x7f7bb40754b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:14:28.348 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:28.344+0000 7f7bb9c00640 1 --2- 172.21.15.50:0/1479795672 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7bb41043c0 0x7f7bb40754b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:14:28.348 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:28.344+0000 7f7bb9c00640 1 -- 172.21.15.50:0/1479795672 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7bb4104d60 msgr2=0x7f7bb40759f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:14:28.348 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:28.344+0000 7f7bb9c00640 1 --2- 172.21.15.50:0/1479795672 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7bb4104d60 0x7f7bb40759f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:14:28.348 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:28.344+0000 7f7bb9c00640 1 -- 172.21.15.50:0/1479795672 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7bb40760f0 con 0x7f7bb4103330 2024-08-31T04:14:28.348 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:28.344+0000 7f7bb9c00640 1 --2- 172.21.15.50:0/1479795672 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7bb4103330 0x7f7bb4076be0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f7ba800e9f0 tx=0x7f7ba800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:14:28.348 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:28.345+0000 7f7bb2000640 1 -- 172.21.15.50:0/1479795672 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ba800cd80 con 0x7f7bb4103330 2024-08-31T04:14:28.348 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:28.345+0000 7f7bb2000640 1 -- 172.21.15.50:0/1479795672 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7ba80108e0 con 0x7f7bb4103330 2024-08-31T04:14:28.349 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:28.345+0000 7f7bbb000640 1 -- 172.21.15.50:0/1479795672 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7bb41a3bf0 con 0x7f7bb4103330 2024-08-31T04:14:28.349 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:28.345+0000 7f7bb2000640 1 -- 172.21.15.50:0/1479795672 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ba8018980 con 0x7f7bb4103330 2024-08-31T04:14:28.349 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:28.345+0000 7f7bbb000640 1 -- 172.21.15.50:0/1479795672 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7bb41a4050 con 0x7f7bb4103330 2024-08-31T04:14:28.349 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:28.346+0000 7f7bbb000640 1 -- 172.21.15.50:0/1479795672 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7bb41037a0 con 0x7f7bb4103330 2024-08-31T04:14:28.351 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:28.350+0000 7f7bb2000640 1 -- 172.21.15.50:0/1479795672 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 15) ==== 152521+0+0 (secure 0 0 0) 0x7f7ba8010430 con 0x7f7bb4103330 2024-08-31T04:14:28.353 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:28.352+0000 7f7bb2000640 1 --2- 172.21.15.50:0/1479795672 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f7b9c0b4b20 0x7f7b9c0b7030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:14:28.353 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:28.352+0000 7f7bb2000640 1 -- 172.21.15.50:0/1479795672 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f7ba80e3ca0 con 0x7f7bb4103330 2024-08-31T04:14:28.353 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:28.352+0000 7f7bb9200640 1 --2- 172.21.15.50:0/1479795672 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f7b9c0b4b20 0x7f7b9c0b7030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:14:28.354 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:28.353+0000 7f7bb9200640 1 --2- 172.21.15.50:0/1479795672 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f7b9c0b4b20 0x7f7b9c0b7030 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f7ba0009bd0 tx=0x7f7ba0005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:14:28.355 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:28.354+0000 7f7bb2000640 1 -- 172.21.15.50:0/1479795672 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f7ba80ac3b0 con 0x7f7bb4103330 2024-08-31T04:14:28.561 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:28.560+0000 7f7bbb000640 1 -- 172.21.15.50:0/1479795672 --> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi050:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7f7bb40635a0 con 0x7f7b9c0b4b20 2024-08-31T04:14:29.415 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:14:29 smithi050 ceph-mon[17259]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T04:14:29.415 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:14:29 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-31T04:14:29.415 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:14:29 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-31T04:14:29.415 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:14:29 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:14:29.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:14:29 smithi177 ceph-mon[22025]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T04:14:29.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:14:29 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-31T04:14:29.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:14:29 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-31T04:14:29.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:14:29 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:14:29.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:14:29 smithi133 ceph-mon[22177]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T04:14:29.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:14:29 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-31T04:14:29.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:14:29 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-31T04:14:29.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:14:29 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:14:30.376 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:14:30 smithi050 ceph-mon[17259]: from='client.14355 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi050:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:14:30.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:14:30 smithi177 ceph-mon[22025]: from='client.14355 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi050:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:14:30.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:14:30 smithi133 ceph-mon[22177]: from='client.14355 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi050:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:14:31.269 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:14:31 smithi050 ceph-mon[17259]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T04:14:31.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:14:31 smithi177 ceph-mon[22025]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T04:14:31.542 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:14:31 smithi133 ceph-mon[22177]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T04:14:32.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:14:32 smithi177 ceph-mon[22025]: from='client.? 172.21.15.50:0/4193891866' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "416ecbde-4a7b-4bd1-b377-490925a33ce1"} : dispatch 2024-08-31T04:14:32.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:14:32 smithi177 ceph-mon[22025]: from='client.? 172.21.15.50:0/4193891866' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "416ecbde-4a7b-4bd1-b377-490925a33ce1"}]': finished 2024-08-31T04:14:32.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:14:32 smithi177 ceph-mon[22025]: osdmap e5: 1 total, 0 up, 1 in 2024-08-31T04:14:32.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:14:32 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-08-31T04:14:32.508 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:14:32 smithi050 ceph-mon[17259]: from='client.? 172.21.15.50:0/4193891866' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "416ecbde-4a7b-4bd1-b377-490925a33ce1"} : dispatch 2024-08-31T04:14:32.508 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:14:32 smithi050 ceph-mon[17259]: from='client.? 172.21.15.50:0/4193891866' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "416ecbde-4a7b-4bd1-b377-490925a33ce1"}]': finished 2024-08-31T04:14:32.508 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:14:32 smithi050 ceph-mon[17259]: osdmap e5: 1 total, 0 up, 1 in 2024-08-31T04:14:32.508 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:14:32 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-08-31T04:14:32.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:14:32 smithi133 ceph-mon[22177]: from='client.? 172.21.15.50:0/4193891866' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "416ecbde-4a7b-4bd1-b377-490925a33ce1"} : dispatch 2024-08-31T04:14:32.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:14:32 smithi133 ceph-mon[22177]: from='client.? 172.21.15.50:0/4193891866' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "416ecbde-4a7b-4bd1-b377-490925a33ce1"}]': finished 2024-08-31T04:14:32.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:14:32 smithi133 ceph-mon[22177]: osdmap e5: 1 total, 0 up, 1 in 2024-08-31T04:14:32.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:14:32 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-08-31T04:14:33.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:14:33 smithi177 ceph-mon[22025]: pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T04:14:33.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:14:33 smithi177 ceph-mon[22025]: from='client.? 172.21.15.50:0/3728401037' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-31T04:14:33.542 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:14:33 smithi133 ceph-mon[22177]: pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T04:14:33.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:14:33 smithi133 ceph-mon[22177]: from='client.? 172.21.15.50:0/3728401037' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-31T04:14:33.699 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:14:33 smithi050 ceph-mon[17259]: pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T04:14:33.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:14:33 smithi050 ceph-mon[17259]: from='client.? 172.21.15.50:0/3728401037' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-31T04:14:35.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:14:35 smithi177 ceph-mon[22025]: pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T04:14:35.542 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:14:35 smithi133 ceph-mon[22177]: pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T04:14:35.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:14:35 smithi050 ceph-mon[17259]: pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T04:14:37.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:14:37 smithi177 ceph-mon[22025]: pgmap v45: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T04:14:37.542 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:14:37 smithi133 ceph-mon[22177]: pgmap v45: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T04:14:37.576 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:14:37 smithi050 ceph-mon[17259]: pgmap v45: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T04:14:39.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:14:39 smithi177 ceph-mon[22025]: pgmap v46: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T04:14:39.542 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:14:39 smithi133 ceph-mon[22177]: pgmap v46: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T04:14:39.545 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:14:39 smithi050 ceph-mon[17259]: pgmap v46: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T04:14:41.508 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:14:41 smithi050 ceph-mon[17259]: pgmap v47: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T04:14:41.508 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:14:41 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.0"} : dispatch 2024-08-31T04:14:41.508 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:14:41 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:14:41.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:14:41 smithi133 ceph-mon[22177]: pgmap v47: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T04:14:41.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:14:41 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.0"} : dispatch 2024-08-31T04:14:41.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:14:41 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:14:41.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:14:41 smithi177 ceph-mon[22025]: pgmap v47: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T04:14:41.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:14:41 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.0"} : dispatch 2024-08-31T04:14:41.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:14:41 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:14:42.293 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:14:42 smithi050 ceph-mon[17259]: Deploying daemon osd.0 on smithi050 2024-08-31T04:14:42.542 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:14:42 smithi133 ceph-mon[22177]: Deploying daemon osd.0 on smithi050 2024-08-31T04:14:42.647 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:14:42 smithi177 ceph-mon[22025]: Deploying daemon osd.0 on smithi050 2024-08-31T04:14:43.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:14:43 smithi133 ceph-mon[22177]: pgmap v48: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T04:14:43.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:14:43 smithi050 ceph-mon[17259]: pgmap v48: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T04:14:43.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:14:43 smithi177 ceph-mon[22025]: pgmap v48: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T04:14:45.520 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:14:45 smithi050 ceph-mon[17259]: pgmap v49: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T04:14:45.542 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:14:45 smithi133 ceph-mon[22177]: pgmap v49: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T04:14:45.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:14:45 smithi177 ceph-mon[22025]: pgmap v49: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T04:14:47.479 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:14:47 smithi050 ceph-mon[17259]: pgmap v50: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T04:14:47.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:14:47 smithi133 ceph-mon[22177]: pgmap v50: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T04:14:47.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:14:47 smithi177 ceph-mon[22025]: pgmap v50: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T04:14:48.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:14:48 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T04:14:48.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:14:48 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:14:48.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:14:48 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:14:48.549 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:14:48 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T04:14:48.549 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:14:48 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:14:48.550 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:14:48 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:14:48.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:14:48 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T04:14:48.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:14:48 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:14:48.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:14:48 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:14:49.487 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:14:49 smithi050 ceph-mon[17259]: pgmap v51: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T04:14:49.542 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:14:49 smithi133 ceph-mon[22177]: pgmap v51: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T04:14:49.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:14:49 smithi177 ceph-mon[22025]: pgmap v51: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T04:14:51.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:14:51 smithi133 ceph-mon[22177]: pgmap v52: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T04:14:51.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:14:51 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:14:51.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:14:51 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:14:51.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:14:51 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:14:51.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:14:51 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T04:14:51.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:14:51 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:14:51.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:14:51 smithi050 ceph-mon[17259]: pgmap v52: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T04:14:51.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:14:51 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:14:51.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:14:51 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:14:51.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:14:51 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:14:51.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:14:51 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T04:14:51.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:14:51 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:14:51.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:14:51 smithi177 ceph-mon[22025]: pgmap v52: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T04:14:51.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:14:51 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:14:51.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:14:51 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:14:51.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:14:51 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:14:51.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:14:51 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T04:14:51.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:14:51 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:14:53.095 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:53.093+0000 7f7bb2000640 1 -- 172.21.15.50:0/1479795672 <== mgr.14150 v2:172.21.15.50:6800/2146686622 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f7bb40635a0 con 0x7f7b9c0b4b20 2024-08-31T04:14:53.095 INFO:teuthology.orchestra.run.smithi050.stdout:Created osd(s) 0 on host 'smithi050' 2024-08-31T04:14:53.098 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:53.096+0000 7f7bbb000640 1 -- 172.21.15.50:0/1479795672 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f7b9c0b4b20 msgr2=0x7f7b9c0b7030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:14:53.098 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:53.096+0000 7f7bbb000640 1 --2- 172.21.15.50:0/1479795672 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f7b9c0b4b20 0x7f7b9c0b7030 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f7ba0009bd0 tx=0x7f7ba0005f90 comp rx=0 tx=0).stop 2024-08-31T04:14:53.098 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:53.096+0000 7f7bbb000640 1 -- 172.21.15.50:0/1479795672 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7bb4103330 msgr2=0x7f7bb4076be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:14:53.098 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:53.096+0000 7f7bbb000640 1 --2- 172.21.15.50:0/1479795672 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7bb4103330 0x7f7bb4076be0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f7ba800e9f0 tx=0x7f7ba800eeb0 comp rx=0 tx=0).stop 2024-08-31T04:14:53.098 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:53.096+0000 7f7bbb000640 1 -- 172.21.15.50:0/1479795672 shutdown_connections 2024-08-31T04:14:53.098 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:53.096+0000 7f7bbb000640 1 --2- 172.21.15.50:0/1479795672 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f7b9c0b4b20 0x7f7b9c0b7030 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:14:53.098 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:53.096+0000 7f7bbb000640 1 --2- 172.21.15.50:0/1479795672 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7bb41043c0 0x7f7bb40754b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:14:53.098 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:53.096+0000 7f7bbb000640 1 --2- 172.21.15.50:0/1479795672 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7bb4104d60 0x7f7bb40759f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:14:53.098 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:53.096+0000 7f7bbb000640 1 --2- 172.21.15.50:0/1479795672 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7bb4103330 0x7f7bb4076be0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:14:53.098 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:53.096+0000 7f7bbb000640 1 -- 172.21.15.50:0/1479795672 >> 172.21.15.50:0/1479795672 conn(0x7f7bb40feca0 msgr2=0x7f7bb41076e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:14:53.098 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:53.096+0000 7f7bbb000640 1 -- 172.21.15.50:0/1479795672 shutdown_connections 2024-08-31T04:14:53.099 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:14:53.096+0000 7f7bbb000640 1 -- 172.21.15.50:0/1479795672 wait complete. 2024-08-31T04:14:53.450 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:14:53 smithi050 ceph-mon[17259]: pgmap v53: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T04:14:53.450 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:14:53 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T04:14:53.450 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:14:53 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:14:53.450 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:14:53 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:14:53.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:14:53 smithi133 ceph-mon[22177]: pgmap v53: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T04:14:53.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:14:53 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T04:14:53.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:14:53 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:14:53.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:14:53 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:14:53.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:14:53 smithi177 ceph-mon[22025]: pgmap v53: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T04:14:53.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:14:53 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T04:14:53.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:14:53 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:14:53.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:14:53 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:14:53.798 DEBUG:teuthology.orchestra.run.smithi050:osd.0> sudo journalctl -f -n 0 -u ceph-058d9fc6-674f-11ef-bcd4-c7b262605968@osd.0.service 2024-08-31T04:14:53.803 INFO:tasks.cephadm:Deploying osd.1 on smithi133 with /dev/vg_nvme/lv_4... 2024-08-31T04:14:53.803 DEBUG:teuthology.orchestra.run.smithi133:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 058d9fc6-674f-11ef-bcd4-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-08-31T04:14:54.054 INFO:teuthology.orchestra.run.smithi133.stderr:Inferring config /var/lib/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/mon.b/config 2024-08-31T04:14:54.493 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:14:54 smithi133 ceph-mon[22177]: from='osd.0 [v2:172.21.15.50:6802/3831273843,v1:172.21.15.50:6803/3831273843]' entity='osd.0' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]} : dispatch 2024-08-31T04:14:54.665 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:14:54 smithi050 ceph-mon[17259]: from='osd.0 [v2:172.21.15.50:6802/3831273843,v1:172.21.15.50:6803/3831273843]' entity='osd.0' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]} : dispatch 2024-08-31T04:14:54.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:14:54 smithi177 ceph-mon[22025]: from='osd.0 [v2:172.21.15.50:6802/3831273843,v1:172.21.15.50:6803/3831273843]' entity='osd.0' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]} : dispatch 2024-08-31T04:14:55.497 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:14:55 smithi133 ceph-mon[22177]: pgmap v54: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T04:14:55.498 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:14:55 smithi133 ceph-mon[22177]: from='osd.0 [v2:172.21.15.50:6802/3831273843,v1:172.21.15.50:6803/3831273843]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-08-31T04:14:55.498 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:14:55 smithi133 ceph-mon[22177]: osdmap e6: 1 total, 0 up, 1 in 2024-08-31T04:14:55.498 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:14:55 smithi133 ceph-mon[22177]: from='osd.0 [v2:172.21.15.50:6802/3831273843,v1:172.21.15.50:6803/3831273843]' entity='osd.0' cmd={"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi050", "root=default"]} : dispatch 2024-08-31T04:14:55.498 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:14:55 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-08-31T04:14:55.543 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:14:55 smithi050 ceph-mon[17259]: pgmap v54: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T04:14:55.544 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:14:55 smithi050 ceph-mon[17259]: from='osd.0 [v2:172.21.15.50:6802/3831273843,v1:172.21.15.50:6803/3831273843]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-08-31T04:14:55.544 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:14:55 smithi050 ceph-mon[17259]: osdmap e6: 1 total, 0 up, 1 in 2024-08-31T04:14:55.544 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:14:55 smithi050 ceph-mon[17259]: from='osd.0 [v2:172.21.15.50:6802/3831273843,v1:172.21.15.50:6803/3831273843]' entity='osd.0' cmd={"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi050", "root=default"]} : dispatch 2024-08-31T04:14:55.544 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:14:55 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-08-31T04:14:55.544 INFO:journalctl@ceph.osd.0.smithi050.stdout:Aug 31 04:14:55 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-0[33357]: 2024-08-31T04:14:55.305+0000 7fd525200640 -1 osd.0 0 waiting for initial osdmap 2024-08-31T04:14:55.544 INFO:journalctl@ceph.osd.0.smithi050.stdout:Aug 31 04:14:55 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-0[33357]: 2024-08-31T04:14:55.308+0000 7fd520200640 -1 osd.0 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-31T04:14:55.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:14:55 smithi177 ceph-mon[22025]: pgmap v54: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T04:14:55.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:14:55 smithi177 ceph-mon[22025]: from='osd.0 [v2:172.21.15.50:6802/3831273843,v1:172.21.15.50:6803/3831273843]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-08-31T04:14:55.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:14:55 smithi177 ceph-mon[22025]: osdmap e6: 1 total, 0 up, 1 in 2024-08-31T04:14:55.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:14:55 smithi177 ceph-mon[22025]: from='osd.0 [v2:172.21.15.50:6802/3831273843,v1:172.21.15.50:6803/3831273843]' entity='osd.0' cmd={"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi050", "root=default"]} : dispatch 2024-08-31T04:14:55.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:14:55 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-08-31T04:14:56.449 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-08-31T04:14:56.473 DEBUG:teuthology.orchestra.run.smithi133:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 058d9fc6-674f-11ef-bcd4-c7b262605968 -- ceph orch daemon add osd smithi133:vg_nvme/lv_4 2024-08-31T04:14:56.542 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:14:56 smithi133 ceph-mon[22177]: from='osd.0 [v2:172.21.15.50:6802/3831273843,v1:172.21.15.50:6803/3831273843]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi050", "root=default"]}]': finished 2024-08-31T04:14:56.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:14:56 smithi133 ceph-mon[22177]: osdmap e7: 1 total, 0 up, 1 in 2024-08-31T04:14:56.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:14:56 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-08-31T04:14:56.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:14:56 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-08-31T04:14:56.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:14:56 smithi050 ceph-mon[17259]: from='osd.0 [v2:172.21.15.50:6802/3831273843,v1:172.21.15.50:6803/3831273843]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi050", "root=default"]}]': finished 2024-08-31T04:14:56.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:14:56 smithi050 ceph-mon[17259]: osdmap e7: 1 total, 0 up, 1 in 2024-08-31T04:14:56.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:14:56 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-08-31T04:14:56.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:14:56 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-08-31T04:14:56.723 INFO:teuthology.orchestra.run.smithi133.stderr:Inferring config /var/lib/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/mon.b/config 2024-08-31T04:14:56.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:14:56 smithi177 ceph-mon[22025]: from='osd.0 [v2:172.21.15.50:6802/3831273843,v1:172.21.15.50:6803/3831273843]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi050", "root=default"]}]': finished 2024-08-31T04:14:56.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:14:56 smithi177 ceph-mon[22025]: osdmap e7: 1 total, 0 up, 1 in 2024-08-31T04:14:56.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:14:56 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-08-31T04:14:56.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:14:56 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-08-31T04:14:57.189 INFO:teuthology.orchestra.run.smithi133.stderr:2024-08-31T04:14:57.186+0000 7f1e0c1f4640 1 -- 172.21.15.133:0/2449372951 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1e041018a0 msgr2=0x7f1e04101cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:14:57.189 INFO:teuthology.orchestra.run.smithi133.stderr:2024-08-31T04:14:57.186+0000 7f1e0c1f4640 1 --2- 172.21.15.133:0/2449372951 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1e041018a0 0x7f1e04101cb0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f1e00009ca0 tx=0x7f1e0002a8c0 comp rx=0 tx=0).stop 2024-08-31T04:14:57.189 INFO:teuthology.orchestra.run.smithi133.stderr:2024-08-31T04:14:57.186+0000 7f1e0c1f4640 1 -- 172.21.15.133:0/2449372951 shutdown_connections 2024-08-31T04:14:57.189 INFO:teuthology.orchestra.run.smithi133.stderr:2024-08-31T04:14:57.186+0000 7f1e0c1f4640 1 --2- 172.21.15.133:0/2449372951 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1e041092a0 0x7f1e0410b720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:14:57.190 INFO:teuthology.orchestra.run.smithi133.stderr:2024-08-31T04:14:57.186+0000 7f1e0c1f4640 1 --2- 172.21.15.133:0/2449372951 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1e04106940 0x7f1e04108d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:14:57.190 INFO:teuthology.orchestra.run.smithi133.stderr:2024-08-31T04:14:57.186+0000 7f1e0c1f4640 1 --2- 172.21.15.133:0/2449372951 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1e041018a0 0x7f1e04101cb0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:14:57.190 INFO:teuthology.orchestra.run.smithi133.stderr:2024-08-31T04:14:57.186+0000 7f1e0c1f4640 1 -- 172.21.15.133:0/2449372951 >> 172.21.15.133:0/2449372951 conn(0x7f1e040fd510 msgr2=0x7f1e040ff980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:14:57.190 INFO:teuthology.orchestra.run.smithi133.stderr:2024-08-31T04:14:57.186+0000 7f1e0c1f4640 1 -- 172.21.15.133:0/2449372951 shutdown_connections 2024-08-31T04:14:57.190 INFO:teuthology.orchestra.run.smithi133.stderr:2024-08-31T04:14:57.186+0000 7f1e0c1f4640 1 -- 172.21.15.133:0/2449372951 wait complete. 2024-08-31T04:14:57.190 INFO:teuthology.orchestra.run.smithi133.stderr:2024-08-31T04:14:57.187+0000 7f1e0c1f4640 1 Processor -- start 2024-08-31T04:14:57.190 INFO:teuthology.orchestra.run.smithi133.stderr:2024-08-31T04:14:57.187+0000 7f1e0c1f4640 1 -- start start 2024-08-31T04:14:57.190 INFO:teuthology.orchestra.run.smithi133.stderr:2024-08-31T04:14:57.187+0000 7f1e0c1f4640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1e041018a0 0x7f1e04199d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:14:57.190 INFO:teuthology.orchestra.run.smithi133.stderr:2024-08-31T04:14:57.187+0000 7f1e0c1f4640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1e04106940 0x7f1e0419a380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:14:57.190 INFO:teuthology.orchestra.run.smithi133.stderr:2024-08-31T04:14:57.187+0000 7f1e0c1f4640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1e041092a0 0x7f1e0419af20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:14:57.190 INFO:teuthology.orchestra.run.smithi133.stderr:2024-08-31T04:14:57.187+0000 7f1e0c1f4640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f1e0410f0f0 con 0x7f1e041018a0 2024-08-31T04:14:57.190 INFO:teuthology.orchestra.run.smithi133.stderr:2024-08-31T04:14:57.187+0000 7f1e0c1f4640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f1e0410ef70 con 0x7f1e041092a0 2024-08-31T04:14:57.190 INFO:teuthology.orchestra.run.smithi133.stderr:2024-08-31T04:14:57.187+0000 7f1e0c1f4640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f1e0410f270 con 0x7f1e04106940 2024-08-31T04:14:57.190 INFO:teuthology.orchestra.run.smithi133.stderr:2024-08-31T04:14:57.187+0000 7f1e0a791640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1e041092a0 0x7f1e0419af20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:14:57.190 INFO:teuthology.orchestra.run.smithi133.stderr:2024-08-31T04:14:57.187+0000 7f1e0a791640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1e041092a0 0x7f1e0419af20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:53290/0 (socket says 172.21.15.133:53290) 2024-08-31T04:14:57.191 INFO:teuthology.orchestra.run.smithi133.stderr:2024-08-31T04:14:57.187+0000 7f1e0a791640 1 -- 172.21.15.133:0/2802345235 learned_addr learned my addr 172.21.15.133:0/2802345235 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-08-31T04:14:57.191 INFO:teuthology.orchestra.run.smithi133.stderr:2024-08-31T04:14:57.187+0000 7f1e09f90640 1 --2- 172.21.15.133:0/2802345235 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1e041018a0 0x7f1e04199d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:14:57.191 INFO:teuthology.orchestra.run.smithi133.stderr:2024-08-31T04:14:57.188+0000 7f1e0a791640 1 -- 172.21.15.133:0/2802345235 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1e04106940 msgr2=0x7f1e0419a380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:14:57.191 INFO:teuthology.orchestra.run.smithi133.stderr:2024-08-31T04:14:57.188+0000 7f1e0a791640 1 --2- 172.21.15.133:0/2802345235 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1e04106940 0x7f1e0419a380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:14:57.191 INFO:teuthology.orchestra.run.smithi133.stderr:2024-08-31T04:14:57.188+0000 7f1e0a791640 1 -- 172.21.15.133:0/2802345235 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1e041018a0 msgr2=0x7f1e04199d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:14:57.191 INFO:teuthology.orchestra.run.smithi133.stderr:2024-08-31T04:14:57.188+0000 7f1e0a791640 1 --2- 172.21.15.133:0/2802345235 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1e041018a0 0x7f1e04199d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:14:57.191 INFO:teuthology.orchestra.run.smithi133.stderr:2024-08-31T04:14:57.188+0000 7f1e0a791640 1 -- 172.21.15.133:0/2802345235 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e0419b740 con 0x7f1e041092a0 2024-08-31T04:14:57.191 INFO:teuthology.orchestra.run.smithi133.stderr:2024-08-31T04:14:57.188+0000 7f1e0a791640 1 --2- 172.21.15.133:0/2802345235 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1e041092a0 0x7f1e0419af20 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f1dfc00e970 tx=0x7f1dfc00ed70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:14:57.192 INFO:teuthology.orchestra.run.smithi133.stderr:2024-08-31T04:14:57.190+0000 7f1dfaffd640 1 -- 172.21.15.133:0/2802345235 <== mon.2 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1dfc00ccc0 con 0x7f1e041092a0 2024-08-31T04:14:57.192 INFO:teuthology.orchestra.run.smithi133.stderr:2024-08-31T04:14:57.190+0000 7f1dfaffd640 1 -- 172.21.15.133:0/2802345235 <== mon.2 v2:172.21.15.133:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1dfc00ce60 con 0x7f1e041092a0 2024-08-31T04:14:57.192 INFO:teuthology.orchestra.run.smithi133.stderr:2024-08-31T04:14:57.190+0000 7f1dfaffd640 1 -- 172.21.15.133:0/2802345235 <== mon.2 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1dfc010430 con 0x7f1e041092a0 2024-08-31T04:14:57.192 INFO:teuthology.orchestra.run.smithi133.stderr:2024-08-31T04:14:57.190+0000 7f1e0c1f4640 1 -- 172.21.15.133:0/2802345235 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1e0419ba30 con 0x7f1e041092a0 2024-08-31T04:14:57.192 INFO:teuthology.orchestra.run.smithi133.stderr:2024-08-31T04:14:57.190+0000 7f1e0c1f4640 1 -- 172.21.15.133:0/2802345235 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1e041a2130 con 0x7f1e041092a0 2024-08-31T04:14:57.193 INFO:teuthology.orchestra.run.smithi133.stderr:2024-08-31T04:14:57.191+0000 7f1e0c1f4640 1 -- 172.21.15.133:0/2802345235 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1e04101cb0 con 0x7f1e041092a0 2024-08-31T04:14:57.194 INFO:teuthology.orchestra.run.smithi133.stderr:2024-08-31T04:14:57.193+0000 7f1dfaffd640 1 -- 172.21.15.133:0/2802345235 <== mon.2 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 15) ==== 152521+0+0 (secure 0 0 0) 0x7f1dfc004ff0 con 0x7f1e041092a0 2024-08-31T04:14:57.195 INFO:teuthology.orchestra.run.smithi133.stderr:2024-08-31T04:14:57.193+0000 7f1dfaffd640 1 --2- 172.21.15.133:0/2802345235 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f1df00b4b20 0x7f1df00b7030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:14:57.195 INFO:teuthology.orchestra.run.smithi133.stderr:2024-08-31T04:14:57.194+0000 7f1dfaffd640 1 -- 172.21.15.133:0/2802345235 <== mon.2 v2:172.21.15.133:3300/0 5 ==== osd_map(8..8 src has 1..8) ==== 1767+0+0 (secure 0 0 0) 0x7f1dfc0e3af0 con 0x7f1e041092a0 2024-08-31T04:14:57.195 INFO:teuthology.orchestra.run.smithi133.stderr:2024-08-31T04:14:57.194+0000 7f1e09f90640 1 --2- 172.21.15.133:0/2802345235 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f1df00b4b20 0x7f1df00b7030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:14:57.195 INFO:teuthology.orchestra.run.smithi133.stderr:2024-08-31T04:14:57.194+0000 7f1e09f90640 1 --2- 172.21.15.133:0/2802345235 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f1df00b4b20 0x7f1df00b7030 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f1e000094e0 tx=0x7f1e00004a40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:14:57.203 INFO:teuthology.orchestra.run.smithi133.stderr:2024-08-31T04:14:57.202+0000 7f1dfaffd640 1 -- 172.21.15.133:0/2802345235 <== mon.2 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f1dfc0ac690 con 0x7f1e041092a0 2024-08-31T04:14:57.395 INFO:teuthology.orchestra.run.smithi133.stderr:2024-08-31T04:14:57.393+0000 7f1e0c1f4640 1 -- 172.21.15.133:0/2802345235 --> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi133:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7f1e040635a0 con 0x7f1df00b4b20 2024-08-31T04:14:57.395 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:14:57 smithi133 ceph-mon[22177]: purged_snaps scrub starts 2024-08-31T04:14:57.395 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:14:57 smithi133 ceph-mon[22177]: purged_snaps scrub ok 2024-08-31T04:14:57.395 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:14:57 smithi133 ceph-mon[22177]: pgmap v57: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T04:14:57.395 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:14:57 smithi133 ceph-mon[22177]: osd.0 [v2:172.21.15.50:6802/3831273843,v1:172.21.15.50:6803/3831273843] boot 2024-08-31T04:14:57.395 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:14:57 smithi133 ceph-mon[22177]: osdmap e8: 1 total, 1 up, 1 in 2024-08-31T04:14:57.395 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:14:57 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-08-31T04:14:57.395 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:14:57 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:14:57.396 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:14:57 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:14:57.396 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:14:57 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-08-31T04:14:57.396 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:14:57 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:14:57.396 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:14:57 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:14:57.396 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:14:57 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T04:14:57.396 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:14:57 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:14:57.450 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:14:57 smithi050 ceph-mon[17259]: purged_snaps scrub starts 2024-08-31T04:14:57.450 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:14:57 smithi050 ceph-mon[17259]: purged_snaps scrub ok 2024-08-31T04:14:57.450 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:14:57 smithi050 ceph-mon[17259]: pgmap v57: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T04:14:57.450 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:14:57 smithi050 ceph-mon[17259]: osd.0 [v2:172.21.15.50:6802/3831273843,v1:172.21.15.50:6803/3831273843] boot 2024-08-31T04:14:57.450 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:14:57 smithi050 ceph-mon[17259]: osdmap e8: 1 total, 1 up, 1 in 2024-08-31T04:14:57.450 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:14:57 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-08-31T04:14:57.450 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:14:57 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:14:57.450 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:14:57 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:14:57.450 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:14:57 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-08-31T04:14:57.450 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:14:57 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:14:57.450 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:14:57 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:14:57.450 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:14:57 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T04:14:57.451 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:14:57 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:14:57.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:14:57 smithi177 ceph-mon[22025]: purged_snaps scrub starts 2024-08-31T04:14:57.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:14:57 smithi177 ceph-mon[22025]: purged_snaps scrub ok 2024-08-31T04:14:57.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:14:57 smithi177 ceph-mon[22025]: pgmap v57: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T04:14:57.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:14:57 smithi177 ceph-mon[22025]: osd.0 [v2:172.21.15.50:6802/3831273843,v1:172.21.15.50:6803/3831273843] boot 2024-08-31T04:14:57.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:14:57 smithi177 ceph-mon[22025]: osdmap e8: 1 total, 1 up, 1 in 2024-08-31T04:14:57.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:14:57 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-08-31T04:14:57.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:14:57 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:14:57.747 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:14:57 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:14:57.747 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:14:57 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-08-31T04:14:57.747 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:14:57 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:14:57.747 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:14:57 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:14:57.747 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:14:57 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T04:14:57.747 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:14:57 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:14:58.611 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:14:58 smithi050 ceph-mon[17259]: Detected new or changed devices on smithi050 2024-08-31T04:14:58.611 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:14:58 smithi050 ceph-mon[17259]: Adjusting osd_memory_target on smithi050 to 17094M 2024-08-31T04:14:58.611 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:14:58 smithi050 ceph-mon[17259]: osdmap e9: 1 total, 1 up, 1 in 2024-08-31T04:14:58.611 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:14:58 smithi050 ceph-mon[17259]: from='client.24278 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi133:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:14:58.611 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:14:58 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-31T04:14:58.611 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:14:58 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-31T04:14:58.611 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:14:58 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:14:58.638 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:14:58 smithi133 ceph-mon[22177]: Detected new or changed devices on smithi050 2024-08-31T04:14:58.638 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:14:58 smithi133 ceph-mon[22177]: Adjusting osd_memory_target on smithi050 to 17094M 2024-08-31T04:14:58.639 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:14:58 smithi133 ceph-mon[22177]: osdmap e9: 1 total, 1 up, 1 in 2024-08-31T04:14:58.639 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:14:58 smithi133 ceph-mon[22177]: from='client.24278 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi133:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:14:58.639 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:14:58 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-31T04:14:58.639 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:14:58 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-31T04:14:58.639 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:14:58 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:14:58.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:14:58 smithi177 ceph-mon[22025]: Detected new or changed devices on smithi050 2024-08-31T04:14:58.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:14:58 smithi177 ceph-mon[22025]: Adjusting osd_memory_target on smithi050 to 17094M 2024-08-31T04:14:58.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:14:58 smithi177 ceph-mon[22025]: osdmap e9: 1 total, 1 up, 1 in 2024-08-31T04:14:58.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:14:58 smithi177 ceph-mon[22025]: from='client.24278 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi133:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:14:58.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:14:58 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-31T04:14:58.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:14:58 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-31T04:14:58.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:14:58 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:14:59.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:14:59 smithi133 ceph-mon[22177]: pgmap v60: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-08-31T04:14:59.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:14:59 smithi050 ceph-mon[17259]: pgmap v60: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-08-31T04:14:59.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:14:59 smithi177 ceph-mon[22025]: pgmap v60: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-08-31T04:15:00.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:15:00 smithi133 ceph-mon[22177]: from='client.? 172.21.15.133:0/1699441243' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "5e008006-004d-4842-9885-93a2d27be1cc"} : dispatch 2024-08-31T04:15:00.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:15:00 smithi133 ceph-mon[22177]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "5e008006-004d-4842-9885-93a2d27be1cc"} : dispatch 2024-08-31T04:15:00.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:15:00 smithi133 ceph-mon[22177]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "5e008006-004d-4842-9885-93a2d27be1cc"}]': finished 2024-08-31T04:15:00.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:15:00 smithi133 ceph-mon[22177]: osdmap e10: 2 total, 1 up, 2 in 2024-08-31T04:15:00.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:15:00 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-08-31T04:15:00.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:15:00 smithi133 ceph-mon[22177]: from='client.? 172.21.15.133:0/3785096469' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-31T04:15:00.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:15:00 smithi050 ceph-mon[17259]: from='client.? 172.21.15.133:0/1699441243' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "5e008006-004d-4842-9885-93a2d27be1cc"} : dispatch 2024-08-31T04:15:00.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:15:00 smithi050 ceph-mon[17259]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "5e008006-004d-4842-9885-93a2d27be1cc"} : dispatch 2024-08-31T04:15:00.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:15:00 smithi050 ceph-mon[17259]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "5e008006-004d-4842-9885-93a2d27be1cc"}]': finished 2024-08-31T04:15:00.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:15:00 smithi050 ceph-mon[17259]: osdmap e10: 2 total, 1 up, 2 in 2024-08-31T04:15:00.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:15:00 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-08-31T04:15:00.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:15:00 smithi050 ceph-mon[17259]: from='client.? 172.21.15.133:0/3785096469' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-31T04:15:00.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:15:00 smithi177 ceph-mon[22025]: from='client.? 172.21.15.133:0/1699441243' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "5e008006-004d-4842-9885-93a2d27be1cc"} : dispatch 2024-08-31T04:15:00.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:15:00 smithi177 ceph-mon[22025]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "5e008006-004d-4842-9885-93a2d27be1cc"} : dispatch 2024-08-31T04:15:00.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:15:00 smithi177 ceph-mon[22025]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "5e008006-004d-4842-9885-93a2d27be1cc"}]': finished 2024-08-31T04:15:00.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:15:00 smithi177 ceph-mon[22025]: osdmap e10: 2 total, 1 up, 2 in 2024-08-31T04:15:00.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:15:00 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-08-31T04:15:00.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:15:00 smithi177 ceph-mon[22025]: from='client.? 172.21.15.133:0/3785096469' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-31T04:15:01.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:15:01 smithi050 ceph-mon[17259]: pgmap v62: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-08-31T04:15:01.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:15:01 smithi177 ceph-mon[22025]: pgmap v62: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-08-31T04:15:01.792 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:15:01 smithi133 ceph-mon[22177]: pgmap v62: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-08-31T04:15:03.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:15:03 smithi050 ceph-mon[17259]: pgmap v63: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-08-31T04:15:03.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:15:03 smithi177 ceph-mon[22025]: pgmap v63: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-08-31T04:15:03.792 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:15:03 smithi133 ceph-mon[22177]: pgmap v63: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-08-31T04:15:05.413 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:15:05 smithi133 ceph-mon[22177]: pgmap v64: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-08-31T04:15:05.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:15:05 smithi050 ceph-mon[17259]: pgmap v64: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-08-31T04:15:05.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:15:05 smithi177 ceph-mon[22025]: pgmap v64: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-08-31T04:15:07.652 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:15:07 smithi133 ceph-mon[22177]: pgmap v65: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-08-31T04:15:07.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:15:07 smithi050 ceph-mon[17259]: pgmap v65: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-08-31T04:15:07.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:15:07 smithi177 ceph-mon[22025]: pgmap v65: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-08-31T04:15:08.596 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:15:08 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.1"} : dispatch 2024-08-31T04:15:08.596 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:15:08 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:15:08.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:15:08 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.1"} : dispatch 2024-08-31T04:15:08.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:15:08 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:15:08.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:15:08 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.1"} : dispatch 2024-08-31T04:15:08.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:15:08 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:15:09.618 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:15:09 smithi133 ceph-mon[22177]: pgmap v66: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-08-31T04:15:09.618 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:15:09 smithi133 ceph-mon[22177]: Deploying daemon osd.1 on smithi133 2024-08-31T04:15:09.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:15:09 smithi050 ceph-mon[17259]: pgmap v66: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-08-31T04:15:09.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:15:09 smithi050 ceph-mon[17259]: Deploying daemon osd.1 on smithi133 2024-08-31T04:15:09.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:15:09 smithi177 ceph-mon[22025]: pgmap v66: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-08-31T04:15:09.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:15:09 smithi177 ceph-mon[22025]: Deploying daemon osd.1 on smithi133 2024-08-31T04:15:11.418 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:15:11 smithi133 ceph-mon[22177]: pgmap v67: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-08-31T04:15:11.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:15:11 smithi050 ceph-mon[17259]: pgmap v67: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-08-31T04:15:11.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:15:11 smithi177 ceph-mon[22025]: pgmap v67: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-08-31T04:15:13.595 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:15:13 smithi133 ceph-mon[22177]: pgmap v68: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-08-31T04:15:13.595 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:15:13 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T04:15:13.595 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:15:13 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:15:13.595 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:15:13 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:15:13.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:15:13 smithi050 ceph-mon[17259]: pgmap v68: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-08-31T04:15:13.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:15:13 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T04:15:13.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:15:13 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:15:13.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:15:13 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:15:13.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:15:13 smithi177 ceph-mon[22025]: pgmap v68: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-08-31T04:15:13.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:15:13 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T04:15:13.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:15:13 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:15:13.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:15:13 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:15:15.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:15:15 smithi133 ceph-mon[22177]: pgmap v69: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-08-31T04:15:15.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:15:15 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:15:15.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:15:15 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:15:15.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:15:15 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:15:15.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:15:15 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T04:15:15.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:15:15 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:15:15.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:15:15 smithi050 ceph-mon[17259]: pgmap v69: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-08-31T04:15:15.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:15:15 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:15:15.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:15:15 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:15:15.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:15:15 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:15:15.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:15:15 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T04:15:15.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:15:15 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:15:15.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:15:15 smithi177 ceph-mon[22025]: pgmap v69: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-08-31T04:15:15.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:15:15 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:15:15.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:15:15 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:15:15.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:15:15 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:15:15.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:15:15 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T04:15:15.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:15:15 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:15:16.965 INFO:teuthology.orchestra.run.smithi133.stderr:2024-08-31T04:15:16.962+0000 7f1dfaffd640 1 -- 172.21.15.133:0/2802345235 <== mgr.14150 v2:172.21.15.50:6800/2146686622 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f1e040635a0 con 0x7f1df00b4b20 2024-08-31T04:15:16.965 INFO:teuthology.orchestra.run.smithi133.stdout:Created osd(s) 1 on host 'smithi133' 2024-08-31T04:15:16.967 INFO:teuthology.orchestra.run.smithi133.stderr:2024-08-31T04:15:16.966+0000 7f1e0c1f4640 1 -- 172.21.15.133:0/2802345235 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f1df00b4b20 msgr2=0x7f1df00b7030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:15:16.967 INFO:teuthology.orchestra.run.smithi133.stderr:2024-08-31T04:15:16.966+0000 7f1e0c1f4640 1 --2- 172.21.15.133:0/2802345235 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f1df00b4b20 0x7f1df00b7030 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f1e000094e0 tx=0x7f1e00004a40 comp rx=0 tx=0).stop 2024-08-31T04:15:16.967 INFO:teuthology.orchestra.run.smithi133.stderr:2024-08-31T04:15:16.966+0000 7f1e0c1f4640 1 -- 172.21.15.133:0/2802345235 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1e041092a0 msgr2=0x7f1e0419af20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:15:16.968 INFO:teuthology.orchestra.run.smithi133.stderr:2024-08-31T04:15:16.966+0000 7f1e0c1f4640 1 --2- 172.21.15.133:0/2802345235 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1e041092a0 0x7f1e0419af20 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f1dfc00e970 tx=0x7f1dfc00ed70 comp rx=0 tx=0).stop 2024-08-31T04:15:16.968 INFO:teuthology.orchestra.run.smithi133.stderr:2024-08-31T04:15:16.966+0000 7f1e0c1f4640 1 -- 172.21.15.133:0/2802345235 shutdown_connections 2024-08-31T04:15:16.968 INFO:teuthology.orchestra.run.smithi133.stderr:2024-08-31T04:15:16.966+0000 7f1e0c1f4640 1 --2- 172.21.15.133:0/2802345235 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f1df00b4b20 0x7f1df00b7030 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:15:16.968 INFO:teuthology.orchestra.run.smithi133.stderr:2024-08-31T04:15:16.966+0000 7f1e0c1f4640 1 --2- 172.21.15.133:0/2802345235 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1e04106940 0x7f1e0419a380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:15:16.968 INFO:teuthology.orchestra.run.smithi133.stderr:2024-08-31T04:15:16.966+0000 7f1e0c1f4640 1 --2- 172.21.15.133:0/2802345235 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1e041092a0 0x7f1e0419af20 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:15:16.968 INFO:teuthology.orchestra.run.smithi133.stderr:2024-08-31T04:15:16.966+0000 7f1e0c1f4640 1 --2- 172.21.15.133:0/2802345235 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1e041018a0 0x7f1e04199d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:15:16.968 INFO:teuthology.orchestra.run.smithi133.stderr:2024-08-31T04:15:16.966+0000 7f1e0c1f4640 1 -- 172.21.15.133:0/2802345235 >> 172.21.15.133:0/2802345235 conn(0x7f1e040fd510 msgr2=0x7f1e041077b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:15:16.968 INFO:teuthology.orchestra.run.smithi133.stderr:2024-08-31T04:15:16.966+0000 7f1e0c1f4640 1 -- 172.21.15.133:0/2802345235 shutdown_connections 2024-08-31T04:15:16.968 INFO:teuthology.orchestra.run.smithi133.stderr:2024-08-31T04:15:16.966+0000 7f1e0c1f4640 1 -- 172.21.15.133:0/2802345235 wait complete. 2024-08-31T04:15:17.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:15:17 smithi133 ceph-mon[22177]: pgmap v70: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-08-31T04:15:17.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:15:17 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T04:15:17.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:15:17 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:15:17.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:15:17 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:15:17.571 DEBUG:teuthology.orchestra.run.smithi133:osd.1> sudo journalctl -f -n 0 -u ceph-058d9fc6-674f-11ef-bcd4-c7b262605968@osd.1.service 2024-08-31T04:15:17.573 INFO:tasks.cephadm:Deploying osd.2 on smithi177 with /dev/vg_nvme/lv_4... 2024-08-31T04:15:17.574 DEBUG:teuthology.orchestra.run.smithi177:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 058d9fc6-674f-11ef-bcd4-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-08-31T04:15:17.601 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:15:17 smithi177 ceph-mon[22025]: pgmap v70: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-08-31T04:15:17.602 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:15:17 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T04:15:17.602 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:15:17 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:15:17.602 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:15:17 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:15:17.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:15:17 smithi050 ceph-mon[17259]: pgmap v70: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-08-31T04:15:17.701 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:15:17 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T04:15:17.701 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:15:17 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:15:17.701 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:15:17 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:15:17.824 INFO:teuthology.orchestra.run.smithi177.stderr:Inferring config /var/lib/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/mon.c/config 2024-08-31T04:15:19.293 INFO:journalctl@ceph.osd.1.smithi133.stdout:Aug 31 04:15:19 smithi133 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-1[26623]: 2024-08-31T04:15:19.049+0000 7fa208035640 -1 osd.1 0 log_to_monitors true 2024-08-31T04:15:19.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:15:19 smithi177 ceph-mon[22025]: pgmap v71: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-08-31T04:15:19.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:15:19 smithi177 ceph-mon[22025]: from='osd.1 [v2:172.21.15.133:6800/475308203,v1:172.21.15.133:6801/475308203]' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-08-31T04:15:19.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:15:19 smithi177 ceph-mon[22025]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-08-31T04:15:19.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:15:19 smithi050 ceph-mon[17259]: pgmap v71: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-08-31T04:15:19.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:15:19 smithi050 ceph-mon[17259]: from='osd.1 [v2:172.21.15.133:6800/475308203,v1:172.21.15.133:6801/475308203]' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-08-31T04:15:19.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:15:19 smithi050 ceph-mon[17259]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-08-31T04:15:19.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:15:19 smithi133 ceph-mon[22177]: pgmap v71: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-08-31T04:15:19.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:15:19 smithi133 ceph-mon[22177]: from='osd.1 [v2:172.21.15.133:6800/475308203,v1:172.21.15.133:6801/475308203]' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-08-31T04:15:19.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:15:19 smithi133 ceph-mon[22177]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-08-31T04:15:20.160 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-08-31T04:15:20.191 DEBUG:teuthology.orchestra.run.smithi177:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 058d9fc6-674f-11ef-bcd4-c7b262605968 -- ceph orch daemon add osd smithi177:vg_nvme/lv_4 2024-08-31T04:15:20.487 INFO:teuthology.orchestra.run.smithi177.stderr:Inferring config /var/lib/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/mon.c/config 2024-08-31T04:15:20.543 INFO:journalctl@ceph.osd.1.smithi133.stdout:Aug 31 04:15:20 smithi133 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-1[26623]: 2024-08-31T04:15:20.360+0000 7fa203fb7640 -1 osd.1 0 waiting for initial osdmap 2024-08-31T04:15:20.543 INFO:journalctl@ceph.osd.1.smithi133.stdout:Aug 31 04:15:20 smithi133 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-1[26623]: 2024-08-31T04:15:20.363+0000 7fa1ffdb5640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-31T04:15:20.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:15:20 smithi133 ceph-mon[22177]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-08-31T04:15:20.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:15:20 smithi133 ceph-mon[22177]: osdmap e11: 2 total, 1 up, 2 in 2024-08-31T04:15:20.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:15:20 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-08-31T04:15:20.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:15:20 smithi133 ceph-mon[22177]: from='osd.1 [v2:172.21.15.133:6800/475308203,v1:172.21.15.133:6801/475308203]' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi133", "root=default"]} : dispatch 2024-08-31T04:15:20.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:15:20 smithi133 ceph-mon[22177]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi133", "root=default"]} : dispatch 2024-08-31T04:15:20.544 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:15:20 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:15:20.544 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:15:20 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:15:20.544 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:15:20 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-08-31T04:15:20.544 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:15:20 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:15:20.544 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:15:20 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:15:20.544 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:15:20 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T04:15:20.544 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:15:20 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:15:20.608 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:15:20 smithi177 ceph-mon[22025]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-08-31T04:15:20.608 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:15:20 smithi177 ceph-mon[22025]: osdmap e11: 2 total, 1 up, 2 in 2024-08-31T04:15:20.608 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:15:20 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-08-31T04:15:20.609 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:15:20 smithi177 ceph-mon[22025]: from='osd.1 [v2:172.21.15.133:6800/475308203,v1:172.21.15.133:6801/475308203]' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi133", "root=default"]} : dispatch 2024-08-31T04:15:20.609 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:15:20 smithi177 ceph-mon[22025]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi133", "root=default"]} : dispatch 2024-08-31T04:15:20.609 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:15:20 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:15:20.609 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:15:20 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:15:20.609 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:15:20 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-08-31T04:15:20.609 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:15:20 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:15:20.609 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:15:20 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:15:20.609 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:15:20 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T04:15:20.609 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:15:20 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:15:20.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:15:20 smithi050 ceph-mon[17259]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-08-31T04:15:20.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:15:20 smithi050 ceph-mon[17259]: osdmap e11: 2 total, 1 up, 2 in 2024-08-31T04:15:20.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:15:20 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-08-31T04:15:20.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:15:20 smithi050 ceph-mon[17259]: from='osd.1 [v2:172.21.15.133:6800/475308203,v1:172.21.15.133:6801/475308203]' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi133", "root=default"]} : dispatch 2024-08-31T04:15:20.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:15:20 smithi050 ceph-mon[17259]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi133", "root=default"]} : dispatch 2024-08-31T04:15:20.701 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:15:20 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:15:20.701 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:15:20 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:15:20.701 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:15:20 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-08-31T04:15:20.701 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:15:20 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:15:20.701 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:15:20 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:15:20.701 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:15:20 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T04:15:20.701 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:15:20 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:15:20.908 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-31T04:15:20.904+0000 7f32b2684640 1 -- 172.21.15.177:0/3735839017 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f32ac06c080 msgr2=0x7f32ac1061e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:15:20.908 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-31T04:15:20.904+0000 7f32b2684640 1 --2- 172.21.15.177:0/3735839017 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f32ac06c080 0x7f32ac1061e0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f329c009900 tx=0x7f329c02a410 comp rx=0 tx=0).stop 2024-08-31T04:15:20.908 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-31T04:15:20.904+0000 7f32b2684640 1 -- 172.21.15.177:0/3735839017 shutdown_connections 2024-08-31T04:15:20.908 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-31T04:15:20.904+0000 7f32b2684640 1 --2- 172.21.15.177:0/3735839017 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f32ac109260 0x7f32ac10b770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:15:20.908 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-31T04:15:20.904+0000 7f32b2684640 1 --2- 172.21.15.177:0/3735839017 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f32ac106720 0x7f32ac108b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:15:20.908 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-31T04:15:20.904+0000 7f32b2684640 1 --2- 172.21.15.177:0/3735839017 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f32ac06c080 0x7f32ac1061e0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:15:20.908 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-31T04:15:20.904+0000 7f32b2684640 1 -- 172.21.15.177:0/3735839017 >> 172.21.15.177:0/3735839017 conn(0x7f32ac0fdda0 msgr2=0x7f32ac100250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:15:20.909 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-31T04:15:20.904+0000 7f32b2684640 1 -- 172.21.15.177:0/3735839017 shutdown_connections 2024-08-31T04:15:20.909 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-31T04:15:20.904+0000 7f32b2684640 1 -- 172.21.15.177:0/3735839017 wait complete. 2024-08-31T04:15:20.909 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-31T04:15:20.905+0000 7f32b2684640 1 Processor -- start 2024-08-31T04:15:20.909 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-31T04:15:20.905+0000 7f32b2684640 1 -- start start 2024-08-31T04:15:20.909 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-31T04:15:20.905+0000 7f32b2684640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f32ac06c080 0x7f32ac103810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:15:20.909 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-31T04:15:20.905+0000 7f32b2684640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f32ac106720 0x7f32ac1020e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:15:20.909 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-31T04:15:20.905+0000 7f32b2684640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f32ac109260 0x7f32ac102620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:15:20.909 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-31T04:15:20.905+0000 7f32b2684640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f32ac10f170 con 0x7f32ac109260 2024-08-31T04:15:20.909 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-31T04:15:20.905+0000 7f32b2684640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f32ac10eff0 con 0x7f32ac06c080 2024-08-31T04:15:20.909 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-31T04:15:20.905+0000 7f32b2684640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f32ac10f2f0 con 0x7f32ac106720 2024-08-31T04:15:20.909 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-31T04:15:20.905+0000 7f32ab7fe640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f32ac106720 0x7f32ac1020e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:15:20.909 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-31T04:15:20.906+0000 7f32ab7fe640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f32ac106720 0x7f32ac1020e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:47398/0 (socket says 172.21.15.177:47398) 2024-08-31T04:15:20.910 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-31T04:15:20.906+0000 7f32ab7fe640 1 -- 172.21.15.177:0/3811743499 learned_addr learned my addr 172.21.15.177:0/3811743499 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-08-31T04:15:20.910 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-31T04:15:20.906+0000 7f32b0c21640 1 --2- 172.21.15.177:0/3811743499 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f32ac109260 0x7f32ac102620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:15:20.910 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-31T04:15:20.906+0000 7f32abfff640 1 --2- 172.21.15.177:0/3811743499 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f32ac06c080 0x7f32ac103810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:15:20.910 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-31T04:15:20.906+0000 7f32ab7fe640 1 -- 172.21.15.177:0/3811743499 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f32ac06c080 msgr2=0x7f32ac103810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:15:20.910 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-31T04:15:20.906+0000 7f32ab7fe640 1 --2- 172.21.15.177:0/3811743499 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f32ac06c080 0x7f32ac103810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:15:20.910 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-31T04:15:20.906+0000 7f32ab7fe640 1 -- 172.21.15.177:0/3811743499 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f32ac109260 msgr2=0x7f32ac102620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:15:20.910 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-31T04:15:20.906+0000 7f32ab7fe640 1 --2- 172.21.15.177:0/3811743499 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f32ac109260 0x7f32ac102620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:15:20.910 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-31T04:15:20.906+0000 7f32ab7fe640 1 -- 172.21.15.177:0/3811743499 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32ac102d20 con 0x7f32ac106720 2024-08-31T04:15:20.910 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-31T04:15:20.906+0000 7f32b0c21640 1 --2- 172.21.15.177:0/3811743499 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f32ac109260 0x7f32ac102620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:15:20.910 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-31T04:15:20.906+0000 7f32ab7fe640 1 --2- 172.21.15.177:0/3811743499 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f32ac106720 0x7f32ac1020e0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f329400d770 tx=0x7f329400dc30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:15:20.910 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-31T04:15:20.906+0000 7f32a97fa640 1 -- 172.21.15.177:0/3811743499 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3294017070 con 0x7f32ac106720 2024-08-31T04:15:20.910 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-31T04:15:20.906+0000 7f32a97fa640 1 -- 172.21.15.177:0/3811743499 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f32940054d0 con 0x7f32ac106720 2024-08-31T04:15:20.910 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-31T04:15:20.906+0000 7f32b2684640 1 -- 172.21.15.177:0/3811743499 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f32ac1a3e50 con 0x7f32ac106720 2024-08-31T04:15:20.911 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-31T04:15:20.906+0000 7f32a97fa640 1 -- 172.21.15.177:0/3811743499 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3294004c30 con 0x7f32ac106720 2024-08-31T04:15:20.911 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-31T04:15:20.906+0000 7f32b2684640 1 -- 172.21.15.177:0/3811743499 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f32ac1a41f0 con 0x7f32ac106720 2024-08-31T04:15:20.911 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-31T04:15:20.907+0000 7f32b2684640 1 -- 172.21.15.177:0/3811743499 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f32ac106b30 con 0x7f32ac106720 2024-08-31T04:15:20.911 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-31T04:15:20.909+0000 7f32a97fa640 1 -- 172.21.15.177:0/3811743499 <== mon.1 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 15) ==== 152521+0+0 (secure 0 0 0) 0x7f3294004e10 con 0x7f32ac106720 2024-08-31T04:15:20.912 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-31T04:15:20.910+0000 7f32a97fa640 1 --2- 172.21.15.177:0/3811743499 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f32980b4b20 0x7f32980b7030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:15:20.912 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-31T04:15:20.910+0000 7f32a97fa640 1 -- 172.21.15.177:0/3811743499 <== mon.1 v2:172.21.15.177:3300/0 5 ==== osd_map(12..12 src has 1..12) ==== 2029+0+0 (secure 0 0 0) 0x7f32940e3210 con 0x7f32ac106720 2024-08-31T04:15:20.912 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-31T04:15:20.911+0000 7f32abfff640 1 --2- 172.21.15.177:0/3811743499 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f32980b4b20 0x7f32980b7030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:15:20.913 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-31T04:15:20.911+0000 7f32abfff640 1 --2- 172.21.15.177:0/3811743499 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f32980b4b20 0x7f32980b7030 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f329c000c00 tx=0x7f329c031400 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:15:20.916 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-31T04:15:20.915+0000 7f32a97fa640 1 -- 172.21.15.177:0/3811743499 <== mon.1 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f32940abcb0 con 0x7f32ac106720 2024-08-31T04:15:21.108 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-31T04:15:21.106+0000 7f32b2684640 1 -- 172.21.15.177:0/3811743499 --> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi177:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7f32ac0635a0 con 0x7f32980b4b20 2024-08-31T04:15:21.617 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:15:21 smithi177 ceph-mon[22025]: pgmap v73: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-08-31T04:15:21.618 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:15:21 smithi177 ceph-mon[22025]: Detected new or changed devices on smithi133 2024-08-31T04:15:21.618 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:15:21 smithi177 ceph-mon[22025]: Adjusting osd_memory_target on smithi133 to 17088M 2024-08-31T04:15:21.618 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:15:21 smithi177 ceph-mon[22025]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi133", "root=default"]}]': finished 2024-08-31T04:15:21.618 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:15:21 smithi177 ceph-mon[22025]: osdmap e12: 2 total, 1 up, 2 in 2024-08-31T04:15:21.618 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:15:21 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-08-31T04:15:21.618 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:15:21 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-08-31T04:15:21.618 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:15:21 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-31T04:15:21.618 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:15:21 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-31T04:15:21.618 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:15:21 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:15:21.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:15:21 smithi050 ceph-mon[17259]: pgmap v73: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-08-31T04:15:21.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:15:21 smithi050 ceph-mon[17259]: Detected new or changed devices on smithi133 2024-08-31T04:15:21.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:15:21 smithi050 ceph-mon[17259]: Adjusting osd_memory_target on smithi133 to 17088M 2024-08-31T04:15:21.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:15:21 smithi050 ceph-mon[17259]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi133", "root=default"]}]': finished 2024-08-31T04:15:21.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:15:21 smithi050 ceph-mon[17259]: osdmap e12: 2 total, 1 up, 2 in 2024-08-31T04:15:21.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:15:21 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-08-31T04:15:21.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:15:21 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-08-31T04:15:21.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:15:21 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-31T04:15:21.701 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:15:21 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-31T04:15:21.701 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:15:21 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:15:21.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:15:21 smithi133 ceph-mon[22177]: pgmap v73: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-08-31T04:15:21.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:15:21 smithi133 ceph-mon[22177]: Detected new or changed devices on smithi133 2024-08-31T04:15:21.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:15:21 smithi133 ceph-mon[22177]: Adjusting osd_memory_target on smithi133 to 17088M 2024-08-31T04:15:21.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:15:21 smithi133 ceph-mon[22177]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi133", "root=default"]}]': finished 2024-08-31T04:15:21.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:15:21 smithi133 ceph-mon[22177]: osdmap e12: 2 total, 1 up, 2 in 2024-08-31T04:15:21.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:15:21 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-08-31T04:15:21.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:15:21 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-08-31T04:15:21.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:15:21 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-31T04:15:21.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:15:21 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-31T04:15:21.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:15:21 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:15:22.638 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:15:22 smithi177 ceph-mon[22025]: purged_snaps scrub starts 2024-08-31T04:15:22.638 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:15:22 smithi177 ceph-mon[22025]: purged_snaps scrub ok 2024-08-31T04:15:22.638 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:15:22 smithi177 ceph-mon[22025]: from='client.24301 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi177:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:15:22.639 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:15:22 smithi177 ceph-mon[22025]: osd.1 [v2:172.21.15.133:6800/475308203,v1:172.21.15.133:6801/475308203] boot 2024-08-31T04:15:22.639 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:15:22 smithi177 ceph-mon[22025]: osdmap e13: 2 total, 2 up, 2 in 2024-08-31T04:15:22.639 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:15:22 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-08-31T04:15:22.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:15:22 smithi050 ceph-mon[17259]: purged_snaps scrub starts 2024-08-31T04:15:22.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:15:22 smithi050 ceph-mon[17259]: purged_snaps scrub ok 2024-08-31T04:15:22.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:15:22 smithi050 ceph-mon[17259]: from='client.24301 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi177:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:15:22.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:15:22 smithi050 ceph-mon[17259]: osd.1 [v2:172.21.15.133:6800/475308203,v1:172.21.15.133:6801/475308203] boot 2024-08-31T04:15:22.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:15:22 smithi050 ceph-mon[17259]: osdmap e13: 2 total, 2 up, 2 in 2024-08-31T04:15:22.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:15:22 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-08-31T04:15:22.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:15:22 smithi133 ceph-mon[22177]: purged_snaps scrub starts 2024-08-31T04:15:22.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:15:22 smithi133 ceph-mon[22177]: purged_snaps scrub ok 2024-08-31T04:15:22.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:15:22 smithi133 ceph-mon[22177]: from='client.24301 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi177:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:15:22.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:15:22 smithi133 ceph-mon[22177]: osd.1 [v2:172.21.15.133:6800/475308203,v1:172.21.15.133:6801/475308203] boot 2024-08-31T04:15:22.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:15:22 smithi133 ceph-mon[22177]: osdmap e13: 2 total, 2 up, 2 in 2024-08-31T04:15:22.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:15:22 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-08-31T04:15:23.641 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:15:23 smithi177 ceph-mon[22025]: pgmap v76: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-08-31T04:15:23.641 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:15:23 smithi177 ceph-mon[22025]: osdmap e14: 2 total, 2 up, 2 in 2024-08-31T04:15:23.642 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:15:23 smithi177 ceph-mon[22025]: from='client.? 172.21.15.177:0/2817387945' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "7e6f1a26-f30d-4822-af69-8a08cb89fbce"} : dispatch 2024-08-31T04:15:23.642 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:15:23 smithi177 ceph-mon[22025]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "7e6f1a26-f30d-4822-af69-8a08cb89fbce"} : dispatch 2024-08-31T04:15:23.642 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:15:23 smithi177 ceph-mon[22025]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "7e6f1a26-f30d-4822-af69-8a08cb89fbce"}]': finished 2024-08-31T04:15:23.642 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:15:23 smithi177 ceph-mon[22025]: osdmap e15: 3 total, 2 up, 3 in 2024-08-31T04:15:23.642 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:15:23 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-08-31T04:15:23.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:15:23 smithi050 ceph-mon[17259]: pgmap v76: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-08-31T04:15:23.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:15:23 smithi050 ceph-mon[17259]: osdmap e14: 2 total, 2 up, 2 in 2024-08-31T04:15:23.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:15:23 smithi050 ceph-mon[17259]: from='client.? 172.21.15.177:0/2817387945' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "7e6f1a26-f30d-4822-af69-8a08cb89fbce"} : dispatch 2024-08-31T04:15:23.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:15:23 smithi050 ceph-mon[17259]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "7e6f1a26-f30d-4822-af69-8a08cb89fbce"} : dispatch 2024-08-31T04:15:23.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:15:23 smithi050 ceph-mon[17259]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "7e6f1a26-f30d-4822-af69-8a08cb89fbce"}]': finished 2024-08-31T04:15:23.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:15:23 smithi050 ceph-mon[17259]: osdmap e15: 3 total, 2 up, 3 in 2024-08-31T04:15:23.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:15:23 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-08-31T04:15:23.778 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:15:23 smithi133 ceph-mon[22177]: pgmap v76: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-08-31T04:15:23.778 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:15:23 smithi133 ceph-mon[22177]: osdmap e14: 2 total, 2 up, 2 in 2024-08-31T04:15:23.778 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:15:23 smithi133 ceph-mon[22177]: from='client.? 172.21.15.177:0/2817387945' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "7e6f1a26-f30d-4822-af69-8a08cb89fbce"} : dispatch 2024-08-31T04:15:23.778 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:15:23 smithi133 ceph-mon[22177]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "7e6f1a26-f30d-4822-af69-8a08cb89fbce"} : dispatch 2024-08-31T04:15:23.778 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:15:23 smithi133 ceph-mon[22177]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "7e6f1a26-f30d-4822-af69-8a08cb89fbce"}]': finished 2024-08-31T04:15:23.778 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:15:23 smithi133 ceph-mon[22177]: osdmap e15: 3 total, 2 up, 3 in 2024-08-31T04:15:23.778 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:15:23 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-08-31T04:15:24.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:15:24 smithi050 ceph-mon[17259]: from='client.? 172.21.15.177:0/668123867' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-31T04:15:24.745 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:15:24 smithi177 ceph-mon[22025]: from='client.? 172.21.15.177:0/668123867' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-31T04:15:24.792 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:15:24 smithi133 ceph-mon[22177]: from='client.? 172.21.15.177:0/668123867' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-31T04:15:25.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:15:25 smithi050 ceph-mon[17259]: pgmap v79: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-08-31T04:15:25.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:15:25 smithi177 ceph-mon[22025]: pgmap v79: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-08-31T04:15:25.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:15:25 smithi133 ceph-mon[22177]: pgmap v79: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-08-31T04:15:27.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:15:27 smithi050 ceph-mon[17259]: pgmap v80: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-08-31T04:15:27.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:15:27 smithi177 ceph-mon[22025]: pgmap v80: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-08-31T04:15:27.792 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:15:27 smithi133 ceph-mon[22177]: pgmap v80: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-08-31T04:15:29.685 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:15:29 smithi177 ceph-mon[22025]: pgmap v81: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-08-31T04:15:29.699 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:15:29 smithi050 ceph-mon[17259]: pgmap v81: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-08-31T04:15:29.792 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:15:29 smithi133 ceph-mon[22177]: pgmap v81: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-08-31T04:15:31.556 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:15:31 smithi177 ceph-mon[22025]: pgmap v82: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-08-31T04:15:31.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:15:31 smithi050 ceph-mon[17259]: pgmap v82: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-08-31T04:15:31.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:15:31 smithi133 ceph-mon[22177]: pgmap v82: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-08-31T04:15:32.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:15:32 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.2"} : dispatch 2024-08-31T04:15:32.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:15:32 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:15:32.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:15:32 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.2"} : dispatch 2024-08-31T04:15:32.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:15:32 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:15:32.792 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:15:32 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.2"} : dispatch 2024-08-31T04:15:32.792 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:15:32 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:15:33.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:15:33 smithi050 ceph-mon[17259]: Deploying daemon osd.2 on smithi177 2024-08-31T04:15:33.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:15:33 smithi050 ceph-mon[17259]: pgmap v83: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-08-31T04:15:33.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:15:33 smithi177 ceph-mon[22025]: Deploying daemon osd.2 on smithi177 2024-08-31T04:15:33.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:15:33 smithi177 ceph-mon[22025]: pgmap v83: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-08-31T04:15:33.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:15:33 smithi133 ceph-mon[22177]: Deploying daemon osd.2 on smithi177 2024-08-31T04:15:33.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:15:33 smithi133 ceph-mon[22177]: pgmap v83: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-08-31T04:15:35.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:15:35 smithi050 ceph-mon[17259]: pgmap v84: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-08-31T04:15:35.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:15:35 smithi177 ceph-mon[22025]: pgmap v84: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-08-31T04:15:35.792 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:15:35 smithi133 ceph-mon[22177]: pgmap v84: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-08-31T04:15:37.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:15:37 smithi177 ceph-mon[22025]: pgmap v85: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-08-31T04:15:37.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:15:37 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T04:15:37.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:15:37 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:15:37.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:15:37 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:15:37.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:15:37 smithi050 ceph-mon[17259]: pgmap v85: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-08-31T04:15:37.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:15:37 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T04:15:37.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:15:37 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:15:37.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:15:37 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:15:37.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:15:37 smithi133 ceph-mon[22177]: pgmap v85: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-08-31T04:15:37.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:15:37 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T04:15:37.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:15:37 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:15:37.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:15:37 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:15:39.697 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:15:39 smithi177 ceph-mon[22025]: pgmap v86: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-08-31T04:15:39.697 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:15:39 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:15:39.697 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:15:39 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:15:39.697 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:15:39 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:15:39.698 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:15:39 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T04:15:39.698 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:15:39 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:15:39.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:15:39 smithi050 ceph-mon[17259]: pgmap v86: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-08-31T04:15:39.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:15:39 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:15:39.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:15:39 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:15:39.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:15:39 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:15:39.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:15:39 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T04:15:39.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:15:39 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:15:39.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:15:39 smithi133 ceph-mon[22177]: pgmap v86: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-08-31T04:15:39.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:15:39 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:15:39.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:15:39 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:15:39.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:15:39 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:15:39.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:15:39 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T04:15:39.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:15:39 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:15:40.023 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-31T04:15:40.022+0000 7f32a97fa640 1 -- 172.21.15.177:0/3811743499 <== mgr.14150 v2:172.21.15.50:6800/2146686622 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f32ac0635a0 con 0x7f32980b4b20 2024-08-31T04:15:40.023 INFO:teuthology.orchestra.run.smithi177.stdout:Created osd(s) 2 on host 'smithi177' 2024-08-31T04:15:40.026 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-31T04:15:40.024+0000 7f32b2684640 1 -- 172.21.15.177:0/3811743499 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f32980b4b20 msgr2=0x7f32980b7030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:15:40.026 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-31T04:15:40.024+0000 7f32b2684640 1 --2- 172.21.15.177:0/3811743499 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f32980b4b20 0x7f32980b7030 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f329c000c00 tx=0x7f329c031400 comp rx=0 tx=0).stop 2024-08-31T04:15:40.026 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-31T04:15:40.024+0000 7f32b2684640 1 -- 172.21.15.177:0/3811743499 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f32ac106720 msgr2=0x7f32ac1020e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:15:40.026 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-31T04:15:40.024+0000 7f32b2684640 1 --2- 172.21.15.177:0/3811743499 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f32ac106720 0x7f32ac1020e0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f329400d770 tx=0x7f329400dc30 comp rx=0 tx=0).stop 2024-08-31T04:15:40.026 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-31T04:15:40.024+0000 7f32b2684640 1 -- 172.21.15.177:0/3811743499 shutdown_connections 2024-08-31T04:15:40.026 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-31T04:15:40.024+0000 7f32b2684640 1 --2- 172.21.15.177:0/3811743499 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f32980b4b20 0x7f32980b7030 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:15:40.026 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-31T04:15:40.024+0000 7f32b2684640 1 --2- 172.21.15.177:0/3811743499 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f32ac106720 0x7f32ac1020e0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:15:40.026 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-31T04:15:40.024+0000 7f32b2684640 1 --2- 172.21.15.177:0/3811743499 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f32ac109260 0x7f32ac102620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:15:40.026 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-31T04:15:40.024+0000 7f32b2684640 1 --2- 172.21.15.177:0/3811743499 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f32ac06c080 0x7f32ac103810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:15:40.026 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-31T04:15:40.024+0000 7f32b2684640 1 -- 172.21.15.177:0/3811743499 >> 172.21.15.177:0/3811743499 conn(0x7f32ac0fdda0 msgr2=0x7f32ac104b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:15:40.026 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-31T04:15:40.024+0000 7f32b2684640 1 -- 172.21.15.177:0/3811743499 shutdown_connections 2024-08-31T04:15:40.026 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-31T04:15:40.024+0000 7f32b2684640 1 -- 172.21.15.177:0/3811743499 wait complete. 2024-08-31T04:15:40.610 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:15:40 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T04:15:40.610 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:15:40 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:15:40.610 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:15:40 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:15:40.635 DEBUG:teuthology.orchestra.run.smithi177:osd.2> sudo journalctl -f -n 0 -u ceph-058d9fc6-674f-11ef-bcd4-c7b262605968@osd.2.service 2024-08-31T04:15:40.637 INFO:tasks.cephadm:Deploying osd.3 on smithi050 with /dev/vg_nvme/lv_3... 2024-08-31T04:15:40.638 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 058d9fc6-674f-11ef-bcd4-c7b262605968 -- lvm zap /dev/vg_nvme/lv_3 2024-08-31T04:15:40.692 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:15:40 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T04:15:40.692 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:15:40 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:15:40.692 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:15:40 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:15:40.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:15:40 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T04:15:40.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:15:40 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:15:40.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:15:40 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:15:41.017 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:15:41.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:15:41 smithi050 ceph-mon[17259]: pgmap v87: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-08-31T04:15:41.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:15:41 smithi177 ceph-mon[22025]: pgmap v87: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-08-31T04:15:41.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:15:41 smithi133 ceph-mon[22177]: pgmap v87: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-08-31T04:15:42.996 INFO:journalctl@ceph.osd.2.smithi177.stdout:Aug 31 04:15:42 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-2[26964]: 2024-08-31T04:15:42.645+0000 7f001773e640 -1 osd.2 0 log_to_monitors true 2024-08-31T04:15:43.675 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:15:43 smithi050 ceph-mon[17259]: pgmap v88: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-08-31T04:15:43.676 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:15:43 smithi050 ceph-mon[17259]: from='osd.2 [v2:172.21.15.177:6800/3091173426,v1:172.21.15.177:6801/3091173426]' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-08-31T04:15:43.676 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:15:43 smithi050 ceph-mon[17259]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-08-31T04:15:43.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:15:43 smithi177 ceph-mon[22025]: pgmap v88: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-08-31T04:15:43.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:15:43 smithi177 ceph-mon[22025]: from='osd.2 [v2:172.21.15.177:6800/3091173426,v1:172.21.15.177:6801/3091173426]' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-08-31T04:15:43.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:15:43 smithi177 ceph-mon[22025]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-08-31T04:15:43.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:15:43 smithi133 ceph-mon[22177]: pgmap v88: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-08-31T04:15:43.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:15:43 smithi133 ceph-mon[22177]: from='osd.2 [v2:172.21.15.177:6800/3091173426,v1:172.21.15.177:6801/3091173426]' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-08-31T04:15:43.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:15:43 smithi133 ceph-mon[22177]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-08-31T04:15:44.076 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-08-31T04:15:44.109 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 058d9fc6-674f-11ef-bcd4-c7b262605968 -- ceph orch daemon add osd smithi050:vg_nvme/lv_3 2024-08-31T04:15:44.486 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:15:44.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:15:44 smithi050 ceph-mon[17259]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-08-31T04:15:44.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:15:44 smithi050 ceph-mon[17259]: from='osd.2 [v2:172.21.15.177:6800/3091173426,v1:172.21.15.177:6801/3091173426]' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi177", "root=default"]} : dispatch 2024-08-31T04:15:44.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:15:44 smithi050 ceph-mon[17259]: osdmap e16: 3 total, 2 up, 3 in 2024-08-31T04:15:44.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:15:44 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-08-31T04:15:44.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:15:44 smithi050 ceph-mon[17259]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi177", "root=default"]} : dispatch 2024-08-31T04:15:44.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:15:44 smithi050 ceph-mon[17259]: Detected new or changed devices on smithi177 2024-08-31T04:15:44.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:15:44 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:15:44.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:15:44 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:15:44.701 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:15:44 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-08-31T04:15:44.701 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:15:44 smithi050 ceph-mon[17259]: Adjusting osd_memory_target on smithi177 to 17087M 2024-08-31T04:15:44.701 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:15:44 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:15:44.701 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:15:44 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:15:44.701 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:15:44 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T04:15:44.701 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:15:44 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:15:44.746 INFO:journalctl@ceph.osd.2.smithi177.stdout:Aug 31 04:15:44 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-2[26964]: 2024-08-31T04:15:44.441+0000 7f00136c0640 -1 osd.2 0 waiting for initial osdmap 2024-08-31T04:15:44.746 INFO:journalctl@ceph.osd.2.smithi177.stdout:Aug 31 04:15:44 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-2[26964]: 2024-08-31T04:15:44.445+0000 7f000f4be640 -1 osd.2 17 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-31T04:15:44.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:15:44 smithi177 ceph-mon[22025]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-08-31T04:15:44.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:15:44 smithi177 ceph-mon[22025]: from='osd.2 [v2:172.21.15.177:6800/3091173426,v1:172.21.15.177:6801/3091173426]' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi177", "root=default"]} : dispatch 2024-08-31T04:15:44.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:15:44 smithi177 ceph-mon[22025]: osdmap e16: 3 total, 2 up, 3 in 2024-08-31T04:15:44.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:15:44 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-08-31T04:15:44.747 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:15:44 smithi177 ceph-mon[22025]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi177", "root=default"]} : dispatch 2024-08-31T04:15:44.747 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:15:44 smithi177 ceph-mon[22025]: Detected new or changed devices on smithi177 2024-08-31T04:15:44.747 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:15:44 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:15:44.747 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:15:44 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:15:44.747 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:15:44 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-08-31T04:15:44.747 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:15:44 smithi177 ceph-mon[22025]: Adjusting osd_memory_target on smithi177 to 17087M 2024-08-31T04:15:44.747 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:15:44 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:15:44.747 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:15:44 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:15:44.747 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:15:44 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T04:15:44.747 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:15:44 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:15:44.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:15:44 smithi133 ceph-mon[22177]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-08-31T04:15:44.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:15:44 smithi133 ceph-mon[22177]: from='osd.2 [v2:172.21.15.177:6800/3091173426,v1:172.21.15.177:6801/3091173426]' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi177", "root=default"]} : dispatch 2024-08-31T04:15:44.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:15:44 smithi133 ceph-mon[22177]: osdmap e16: 3 total, 2 up, 3 in 2024-08-31T04:15:44.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:15:44 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-08-31T04:15:44.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:15:44 smithi133 ceph-mon[22177]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi177", "root=default"]} : dispatch 2024-08-31T04:15:44.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:15:44 smithi133 ceph-mon[22177]: Detected new or changed devices on smithi177 2024-08-31T04:15:44.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:15:44 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:15:44.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:15:44 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:15:44.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:15:44 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-08-31T04:15:44.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:15:44 smithi133 ceph-mon[22177]: Adjusting osd_memory_target on smithi177 to 17087M 2024-08-31T04:15:44.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:15:44 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:15:44.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:15:44 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:15:44.794 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:15:44 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T04:15:44.794 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:15:44 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:15:45.089 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:15:45.087+0000 7fe80ca00640 1 -- 172.21.15.50:0/759174046 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe808078a40 msgr2=0x7fe808078e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:15:45.089 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:15:45.087+0000 7fe80ca00640 1 --2- 172.21.15.50:0/759174046 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe808078a40 0x7fe808078e50 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fe7f0009900 tx=0x7fe7f002a480 comp rx=0 tx=0).stop 2024-08-31T04:15:45.089 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:15:45.087+0000 7fe80ca00640 1 -- 172.21.15.50:0/759174046 shutdown_connections 2024-08-31T04:15:45.089 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:15:45.087+0000 7fe80ca00640 1 --2- 172.21.15.50:0/759174046 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe8080793e0 0x7fe808079d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:15:45.089 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:15:45.087+0000 7fe80ca00640 1 --2- 172.21.15.50:0/759174046 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe808078a40 0x7fe808078e50 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:15:45.089 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:15:45.087+0000 7fe80ca00640 1 --2- 172.21.15.50:0/759174046 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe8080779b0 0x7fe808077e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:15:45.090 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:15:45.087+0000 7fe80ca00640 1 -- 172.21.15.50:0/759174046 >> 172.21.15.50:0/759174046 conn(0x7fe808100ea0 msgr2=0x7fe808103350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:15:45.090 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:15:45.087+0000 7fe80ca00640 1 -- 172.21.15.50:0/759174046 shutdown_connections 2024-08-31T04:15:45.090 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:15:45.088+0000 7fe80ca00640 1 -- 172.21.15.50:0/759174046 wait complete. 2024-08-31T04:15:45.090 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:15:45.089+0000 7fe80ca00640 1 Processor -- start 2024-08-31T04:15:45.091 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:15:45.089+0000 7fe80ca00640 1 -- start start 2024-08-31T04:15:45.091 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:15:45.090+0000 7fe80ca00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe8080779b0 0x7fe8081a01e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:15:45.091 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:15:45.090+0000 7fe80ca00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe808078a40 0x7fe8081a0850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:15:45.092 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:15:45.090+0000 7fe80ca00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe8080793e0 0x7fe8081a13f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:15:45.092 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:15:45.090+0000 7fe80ca00640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fe8081155a0 con 0x7fe8080779b0 2024-08-31T04:15:45.092 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:15:45.090+0000 7fe80ca00640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7fe808115420 con 0x7fe808078a40 2024-08-31T04:15:45.092 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:15:45.090+0000 7fe80ca00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fe808115720 con 0x7fe8080793e0 2024-08-31T04:15:45.092 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:15:45.090+0000 7fe806800640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe8080779b0 0x7fe8081a01e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:15:45.092 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:15:45.090+0000 7fe806800640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe8080779b0 0x7fe8081a01e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:55784/0 (socket says 172.21.15.50:55784) 2024-08-31T04:15:45.092 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:15:45.090+0000 7fe806800640 1 -- 172.21.15.50:0/2257998461 learned_addr learned my addr 172.21.15.50:0/2257998461 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:15:45.092 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:15:45.090+0000 7fe807200640 1 --2- 172.21.15.50:0/2257998461 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe8080793e0 0x7fe8081a13f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:15:45.092 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:15:45.090+0000 7fe7fde00640 1 --2- 172.21.15.50:0/2257998461 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe808078a40 0x7fe8081a0850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:15:45.094 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:15:45.091+0000 7fe806800640 1 -- 172.21.15.50:0/2257998461 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe8080793e0 msgr2=0x7fe8081a13f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:15:45.094 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:15:45.091+0000 7fe806800640 1 --2- 172.21.15.50:0/2257998461 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe8080793e0 0x7fe8081a13f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:15:45.094 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:15:45.091+0000 7fe806800640 1 -- 172.21.15.50:0/2257998461 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe808078a40 msgr2=0x7fe8081a0850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:15:45.094 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:15:45.091+0000 7fe806800640 1 --2- 172.21.15.50:0/2257998461 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe808078a40 0x7fe8081a0850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:15:45.094 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:15:45.091+0000 7fe806800640 1 -- 172.21.15.50:0/2257998461 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8081a1c10 con 0x7fe8080779b0 2024-08-31T04:15:45.094 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:15:45.091+0000 7fe807200640 1 --2- 172.21.15.50:0/2257998461 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe8080793e0 0x7fe8081a13f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:15:45.094 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:15:45.091+0000 7fe806800640 1 --2- 172.21.15.50:0/2257998461 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe8080779b0 0x7fe8081a01e0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fe7f800ebc0 tx=0x7fe7f800c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:15:45.094 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:15:45.091+0000 7fe7ffe00640 1 -- 172.21.15.50:0/2257998461 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7f8010430 con 0x7fe8080779b0 2024-08-31T04:15:45.094 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:15:45.092+0000 7fe7ffe00640 1 -- 172.21.15.50:0/2257998461 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe7f8010a80 con 0x7fe8080779b0 2024-08-31T04:15:45.094 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:15:45.092+0000 7fe80ca00640 1 -- 172.21.15.50:0/2257998461 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe8081a1f00 con 0x7fe8080779b0 2024-08-31T04:15:45.094 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:15:45.092+0000 7fe7ffe00640 1 -- 172.21.15.50:0/2257998461 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7f8018a50 con 0x7fe8080779b0 2024-08-31T04:15:45.094 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:15:45.092+0000 7fe80ca00640 1 -- 172.21.15.50:0/2257998461 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe8081a8600 con 0x7fe8080779b0 2024-08-31T04:15:45.095 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:15:45.093+0000 7fe80ca00640 1 -- 172.21.15.50:0/2257998461 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe808112770 con 0x7fe8080779b0 2024-08-31T04:15:45.096 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:15:45.095+0000 7fe7ffe00640 1 -- 172.21.15.50:0/2257998461 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 15) ==== 152521+0+0 (secure 0 0 0) 0x7fe7f8010c30 con 0x7fe8080779b0 2024-08-31T04:15:45.098 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:15:45.097+0000 7fe7ffe00640 1 --2- 172.21.15.50:0/2257998461 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fe7ec0b4aa0 0x7fe7ec0b6fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:15:45.098 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:15:45.097+0000 7fe7ffe00640 1 -- 172.21.15.50:0/2257998461 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 2571+0+0 (secure 0 0 0) 0x7fe7f80e45b0 con 0x7fe8080779b0 2024-08-31T04:15:45.098 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:15:45.097+0000 7fe7fde00640 1 --2- 172.21.15.50:0/2257998461 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fe7ec0b4aa0 0x7fe7ec0b6fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:15:45.099 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:15:45.098+0000 7fe7fde00640 1 --2- 172.21.15.50:0/2257998461 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fe7ec0b4aa0 0x7fe7ec0b6fb0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fe7f0000c00 tx=0x7fe7f0031400 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:15:45.100 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:15:45.099+0000 7fe7ffe00640 1 -- 172.21.15.50:0/2257998461 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fe7f80acd90 con 0x7fe8080779b0 2024-08-31T04:15:45.310 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:15:45.309+0000 7fe80ca00640 1 -- 172.21.15.50:0/2257998461 --> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi050:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7fe8080635a0 con 0x7fe7ec0b4aa0 2024-08-31T04:15:45.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:15:45 smithi050 ceph-mon[17259]: pgmap v90: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-08-31T04:15:45.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:15:45 smithi050 ceph-mon[17259]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi177", "root=default"]}]': finished 2024-08-31T04:15:45.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:15:45 smithi050 ceph-mon[17259]: osdmap e17: 3 total, 2 up, 3 in 2024-08-31T04:15:45.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:15:45 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-08-31T04:15:45.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:15:45 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-08-31T04:15:45.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:15:45 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-31T04:15:45.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:15:45 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-31T04:15:45.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:15:45 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:15:45.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:15:45 smithi177 ceph-mon[22025]: pgmap v90: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-08-31T04:15:45.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:15:45 smithi177 ceph-mon[22025]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi177", "root=default"]}]': finished 2024-08-31T04:15:45.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:15:45 smithi177 ceph-mon[22025]: osdmap e17: 3 total, 2 up, 3 in 2024-08-31T04:15:45.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:15:45 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-08-31T04:15:45.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:15:45 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-08-31T04:15:45.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:15:45 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-31T04:15:45.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:15:45 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-31T04:15:45.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:15:45 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:15:45.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:15:45 smithi133 ceph-mon[22177]: pgmap v90: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-08-31T04:15:45.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:15:45 smithi133 ceph-mon[22177]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi177", "root=default"]}]': finished 2024-08-31T04:15:45.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:15:45 smithi133 ceph-mon[22177]: osdmap e17: 3 total, 2 up, 3 in 2024-08-31T04:15:45.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:15:45 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-08-31T04:15:45.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:15:45 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-08-31T04:15:45.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:15:45 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-31T04:15:45.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:15:45 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-31T04:15:45.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:15:45 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:15:46.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:15:46 smithi177 ceph-mon[22025]: purged_snaps scrub starts 2024-08-31T04:15:46.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:15:46 smithi177 ceph-mon[22025]: purged_snaps scrub ok 2024-08-31T04:15:46.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:15:46 smithi177 ceph-mon[22025]: from='client.14409 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi050:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:15:46.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:15:46 smithi177 ceph-mon[22025]: osd.2 [v2:172.21.15.177:6800/3091173426,v1:172.21.15.177:6801/3091173426] boot 2024-08-31T04:15:46.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:15:46 smithi177 ceph-mon[22025]: osdmap e18: 3 total, 3 up, 3 in 2024-08-31T04:15:46.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:15:46 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-08-31T04:15:46.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:15:46 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true} : dispatch 2024-08-31T04:15:46.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:15:46 smithi133 ceph-mon[22177]: purged_snaps scrub starts 2024-08-31T04:15:46.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:15:46 smithi133 ceph-mon[22177]: purged_snaps scrub ok 2024-08-31T04:15:46.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:15:46 smithi133 ceph-mon[22177]: from='client.14409 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi050:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:15:46.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:15:46 smithi133 ceph-mon[22177]: osd.2 [v2:172.21.15.177:6800/3091173426,v1:172.21.15.177:6801/3091173426] boot 2024-08-31T04:15:46.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:15:46 smithi133 ceph-mon[22177]: osdmap e18: 3 total, 3 up, 3 in 2024-08-31T04:15:46.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:15:46 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-08-31T04:15:46.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:15:46 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true} : dispatch 2024-08-31T04:15:46.911 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:15:46 smithi050 ceph-mon[17259]: purged_snaps scrub starts 2024-08-31T04:15:46.911 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:15:46 smithi050 ceph-mon[17259]: purged_snaps scrub ok 2024-08-31T04:15:46.911 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:15:46 smithi050 ceph-mon[17259]: from='client.14409 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi050:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:15:46.911 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:15:46 smithi050 ceph-mon[17259]: osd.2 [v2:172.21.15.177:6800/3091173426,v1:172.21.15.177:6801/3091173426] boot 2024-08-31T04:15:46.911 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:15:46 smithi050 ceph-mon[17259]: osdmap e18: 3 total, 3 up, 3 in 2024-08-31T04:15:46.911 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:15:46 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-08-31T04:15:46.911 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:15:46 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true} : dispatch 2024-08-31T04:15:47.538 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:15:47 smithi050 ceph-mon[17259]: pgmap v93: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-08-31T04:15:47.729 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:15:47 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-08-31T04:15:47.729 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:15:47 smithi050 ceph-mon[17259]: osdmap e19: 3 total, 3 up, 3 in 2024-08-31T04:15:47.729 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:15:47 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true} : dispatch 2024-08-31T04:15:47.730 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:15:47 smithi177 ceph-mon[22025]: pgmap v93: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-08-31T04:15:47.730 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:15:47 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-08-31T04:15:47.730 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:15:47 smithi177 ceph-mon[22025]: osdmap e19: 3 total, 3 up, 3 in 2024-08-31T04:15:47.730 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:15:47 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true} : dispatch 2024-08-31T04:15:47.792 INFO:journalctl@ceph.osd.0.smithi050.stdout:Aug 31 04:15:47 smithi050 sudo[37699]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-08-31T04:15:47.792 INFO:journalctl@ceph.osd.0.smithi050.stdout:Aug 31 04:15:47 smithi050 sudo[37699]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-08-31T04:15:47.792 INFO:journalctl@ceph.osd.0.smithi050.stdout:Aug 31 04:15:47 smithi050 sudo[37699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-08-31T04:15:47.792 INFO:journalctl@ceph.osd.0.smithi050.stdout:Aug 31 04:15:47 smithi050 sudo[37699]: pam_unix(sudo:session): session closed for user root 2024-08-31T04:15:47.792 INFO:journalctl@ceph.osd.0.smithi050.stdout:Aug 31 04:15:47 smithi050 sudo[37704]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-08-31T04:15:47.792 INFO:journalctl@ceph.osd.0.smithi050.stdout:Aug 31 04:15:47 smithi050 sudo[37704]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-08-31T04:15:47.793 INFO:journalctl@ceph.osd.0.smithi050.stdout:Aug 31 04:15:47 smithi050 sudo[37704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-08-31T04:15:47.793 INFO:journalctl@ceph.osd.0.smithi050.stdout:Aug 31 04:15:47 smithi050 sudo[37704]: pam_unix(sudo:session): session closed for user root 2024-08-31T04:15:47.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:15:47 smithi133 ceph-mon[22177]: pgmap v93: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-08-31T04:15:47.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:15:47 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-08-31T04:15:47.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:15:47 smithi133 ceph-mon[22177]: osdmap e19: 3 total, 3 up, 3 in 2024-08-31T04:15:47.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:15:47 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true} : dispatch 2024-08-31T04:15:47.794 INFO:journalctl@ceph.osd.1.smithi133.stdout:Aug 31 04:15:47 smithi133 sudo[30625]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-08-31T04:15:47.794 INFO:journalctl@ceph.osd.1.smithi133.stdout:Aug 31 04:15:47 smithi133 sudo[30625]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-08-31T04:15:47.794 INFO:journalctl@ceph.osd.1.smithi133.stdout:Aug 31 04:15:47 smithi133 sudo[30625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-08-31T04:15:47.794 INFO:journalctl@ceph.osd.1.smithi133.stdout:Aug 31 04:15:47 smithi133 sudo[30625]: pam_unix(sudo:session): session closed for user root 2024-08-31T04:15:47.794 INFO:journalctl@ceph.osd.1.smithi133.stdout:Aug 31 04:15:47 smithi133 sudo[30628]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-08-31T04:15:47.794 INFO:journalctl@ceph.osd.1.smithi133.stdout:Aug 31 04:15:47 smithi133 sudo[30628]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-08-31T04:15:47.794 INFO:journalctl@ceph.osd.1.smithi133.stdout:Aug 31 04:15:47 smithi133 sudo[30628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-08-31T04:15:47.794 INFO:journalctl@ceph.osd.1.smithi133.stdout:Aug 31 04:15:47 smithi133 sudo[30628]: pam_unix(sudo:session): session closed for user root 2024-08-31T04:15:47.996 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:15:47 smithi177 sudo[30759]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-08-31T04:15:47.996 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:15:47 smithi177 sudo[30759]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-08-31T04:15:47.996 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:15:47 smithi177 sudo[30759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-08-31T04:15:47.996 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:15:47 smithi177 sudo[30759]: pam_unix(sudo:session): session closed for user root 2024-08-31T04:15:47.996 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:15:47 smithi177 sudo[30762]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-08-31T04:15:47.996 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:15:47 smithi177 sudo[30762]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-08-31T04:15:47.997 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:15:47 smithi177 sudo[30762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-08-31T04:15:47.997 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:15:47 smithi177 sudo[30762]: pam_unix(sudo:session): session closed for user root 2024-08-31T04:15:47.997 INFO:journalctl@ceph.osd.2.smithi177.stdout:Aug 31 04:15:47 smithi177 sudo[30753]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-08-31T04:15:47.997 INFO:journalctl@ceph.osd.2.smithi177.stdout:Aug 31 04:15:47 smithi177 sudo[30753]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-08-31T04:15:47.997 INFO:journalctl@ceph.osd.2.smithi177.stdout:Aug 31 04:15:47 smithi177 sudo[30753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-08-31T04:15:47.997 INFO:journalctl@ceph.osd.2.smithi177.stdout:Aug 31 04:15:47 smithi177 sudo[30753]: pam_unix(sudo:session): session closed for user root 2024-08-31T04:15:47.997 INFO:journalctl@ceph.osd.2.smithi177.stdout:Aug 31 04:15:47 smithi177 sudo[30756]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-08-31T04:15:47.997 INFO:journalctl@ceph.osd.2.smithi177.stdout:Aug 31 04:15:47 smithi177 sudo[30756]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-08-31T04:15:47.997 INFO:journalctl@ceph.osd.2.smithi177.stdout:Aug 31 04:15:47 smithi177 sudo[30756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-08-31T04:15:47.997 INFO:journalctl@ceph.osd.2.smithi177.stdout:Aug 31 04:15:47 smithi177 sudo[30756]: pam_unix(sudo:session): session closed for user root 2024-08-31T04:15:48.080 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:15:47 smithi050 sudo[37710]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-08-31T04:15:48.080 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:15:47 smithi050 sudo[37710]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-08-31T04:15:48.080 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:15:47 smithi050 sudo[37710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-08-31T04:15:48.080 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:15:47 smithi050 sudo[37710]: pam_unix(sudo:session): session closed for user root 2024-08-31T04:15:48.080 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:15:47 smithi050 sudo[37716]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-08-31T04:15:48.080 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:15:47 smithi050 sudo[37716]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-08-31T04:15:48.080 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:15:47 smithi050 sudo[37716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-08-31T04:15:48.080 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:15:47 smithi050 sudo[37716]: pam_unix(sudo:session): session closed for user root 2024-08-31T04:15:48.293 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:15:47 smithi133 sudo[30631]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-08-31T04:15:48.293 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:15:47 smithi133 sudo[30631]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-08-31T04:15:48.293 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:15:47 smithi133 sudo[30631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-08-31T04:15:48.293 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:15:47 smithi133 sudo[30631]: pam_unix(sudo:session): session closed for user root 2024-08-31T04:15:48.293 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:15:47 smithi133 sudo[30634]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-08-31T04:15:48.293 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:15:47 smithi133 sudo[30634]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-08-31T04:15:48.293 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:15:47 smithi133 sudo[30634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-08-31T04:15:48.293 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:15:47 smithi133 sudo[30634]: pam_unix(sudo:session): session closed for user root 2024-08-31T04:15:48.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:15:48 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-08-31T04:15:48.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:15:48 smithi177 ceph-mon[22025]: osdmap e20: 3 total, 3 up, 3 in 2024-08-31T04:15:48.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:15:48 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:15:48.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:15:48 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:15:48.747 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:15:48 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:15:48.747 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:15:48 smithi177 ceph-mon[22025]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-08-31T04:15:48.747 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:15:48 smithi177 ceph-mon[22025]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-08-31T04:15:48.747 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:15:48 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-08-31T04:15:48.747 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:15:48 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-08-31T04:15:48.747 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:15:48 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-08-31T04:15:48.747 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:15:48 smithi177 ceph-mon[22025]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-08-31T04:15:48.747 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:15:48 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-08-31T04:15:48.747 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:15:48 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-08-31T04:15:48.747 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:15:48 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-08-31T04:15:48.747 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:15:48 smithi177 ceph-mon[22025]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-08-31T04:15:48.747 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:15:48 smithi177 ceph-mon[22025]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-08-31T04:15:48.747 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:15:48 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-08-31T04:15:48.748 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:15:48 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-08-31T04:15:48.748 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:15:48 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-08-31T04:15:48.748 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:15:48 smithi177 ceph-mon[22025]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-08-31T04:15:48.781 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:15:48.779+0000 7fe7ffe00640 1 -- 172.21.15.50:0/2257998461 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mgrmap(e 16) ==== 152577+0+0 (secure 0 0 0) 0x7fe7f80a8920 con 0x7fe8080779b0 2024-08-31T04:15:48.781 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:15:48 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-08-31T04:15:48.782 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:15:48 smithi050 ceph-mon[17259]: osdmap e20: 3 total, 3 up, 3 in 2024-08-31T04:15:48.782 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:15:48 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:15:48.782 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:15:48 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:15:48.782 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:15:48 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:15:48.782 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:15:48 smithi050 ceph-mon[17259]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-08-31T04:15:48.782 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:15:48 smithi050 ceph-mon[17259]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-08-31T04:15:48.782 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:15:48 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-08-31T04:15:48.782 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:15:48 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-08-31T04:15:48.782 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:15:48 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-08-31T04:15:48.782 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:15:48 smithi050 ceph-mon[17259]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-08-31T04:15:48.782 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:15:48 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-08-31T04:15:48.782 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:15:48 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-08-31T04:15:48.783 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:15:48 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-08-31T04:15:48.783 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:15:48 smithi050 ceph-mon[17259]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-08-31T04:15:48.783 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:15:48 smithi050 ceph-mon[17259]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-08-31T04:15:48.783 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:15:48 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-08-31T04:15:48.783 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:15:48 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-08-31T04:15:48.783 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:15:48 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-08-31T04:15:48.783 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:15:48 smithi050 ceph-mon[17259]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-08-31T04:15:48.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:15:48 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-08-31T04:15:48.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:15:48 smithi133 ceph-mon[22177]: osdmap e20: 3 total, 3 up, 3 in 2024-08-31T04:15:48.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:15:48 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:15:48.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:15:48 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:15:48.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:15:48 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:15:48.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:15:48 smithi133 ceph-mon[22177]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-08-31T04:15:48.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:15:48 smithi133 ceph-mon[22177]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-08-31T04:15:48.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:15:48 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-08-31T04:15:48.794 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:15:48 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-08-31T04:15:48.794 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:15:48 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-08-31T04:15:48.794 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:15:48 smithi133 ceph-mon[22177]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-08-31T04:15:48.794 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:15:48 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-08-31T04:15:48.794 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:15:48 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-08-31T04:15:48.794 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:15:48 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-08-31T04:15:48.794 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:15:48 smithi133 ceph-mon[22177]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-08-31T04:15:48.794 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:15:48 smithi133 ceph-mon[22177]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-08-31T04:15:48.794 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:15:48 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-08-31T04:15:48.794 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:15:48 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-08-31T04:15:48.794 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:15:48 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-08-31T04:15:48.794 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:15:48 smithi133 ceph-mon[22177]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-08-31T04:15:49.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:15:49 smithi050 ceph-mon[17259]: pgmap v96: 1 pgs: 1 creating+peering; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2024-08-31T04:15:49.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:15:49 smithi050 ceph-mon[17259]: osdmap e21: 3 total, 3 up, 3 in 2024-08-31T04:15:49.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:15:49 smithi050 ceph-mon[17259]: from='client.? 172.21.15.50:0/2484740301' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "8193c2a2-18a1-4684-9a16-cbeae25530ca"} : dispatch 2024-08-31T04:15:49.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:15:49 smithi050 ceph-mon[17259]: from='client.? 172.21.15.50:0/2484740301' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8193c2a2-18a1-4684-9a16-cbeae25530ca"}]': finished 2024-08-31T04:15:49.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:15:49 smithi050 ceph-mon[17259]: osdmap e22: 4 total, 3 up, 4 in 2024-08-31T04:15:49.701 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:15:49 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-08-31T04:15:49.701 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:15:49 smithi050 ceph-mon[17259]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-08-31T04:15:49.701 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:15:49 smithi050 ceph-mon[17259]: from='client.? 172.21.15.50:0/1569751798' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-31T04:15:49.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:15:49 smithi177 ceph-mon[22025]: pgmap v96: 1 pgs: 1 creating+peering; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2024-08-31T04:15:49.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:15:49 smithi177 ceph-mon[22025]: osdmap e21: 3 total, 3 up, 3 in 2024-08-31T04:15:49.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:15:49 smithi177 ceph-mon[22025]: from='client.? 172.21.15.50:0/2484740301' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "8193c2a2-18a1-4684-9a16-cbeae25530ca"} : dispatch 2024-08-31T04:15:49.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:15:49 smithi177 ceph-mon[22025]: from='client.? 172.21.15.50:0/2484740301' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8193c2a2-18a1-4684-9a16-cbeae25530ca"}]': finished 2024-08-31T04:15:49.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:15:49 smithi177 ceph-mon[22025]: osdmap e22: 4 total, 3 up, 4 in 2024-08-31T04:15:49.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:15:49 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-08-31T04:15:49.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:15:49 smithi177 ceph-mon[22025]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-08-31T04:15:49.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:15:49 smithi177 ceph-mon[22025]: from='client.? 172.21.15.50:0/1569751798' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-31T04:15:49.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:15:49 smithi133 ceph-mon[22177]: pgmap v96: 1 pgs: 1 creating+peering; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2024-08-31T04:15:49.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:15:49 smithi133 ceph-mon[22177]: osdmap e21: 3 total, 3 up, 3 in 2024-08-31T04:15:49.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:15:49 smithi133 ceph-mon[22177]: from='client.? 172.21.15.50:0/2484740301' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "8193c2a2-18a1-4684-9a16-cbeae25530ca"} : dispatch 2024-08-31T04:15:49.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:15:49 smithi133 ceph-mon[22177]: from='client.? 172.21.15.50:0/2484740301' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8193c2a2-18a1-4684-9a16-cbeae25530ca"}]': finished 2024-08-31T04:15:49.794 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:15:49 smithi133 ceph-mon[22177]: osdmap e22: 4 total, 3 up, 4 in 2024-08-31T04:15:49.794 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:15:49 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-08-31T04:15:49.794 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:15:49 smithi133 ceph-mon[22177]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-08-31T04:15:49.794 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:15:49 smithi133 ceph-mon[22177]: from='client.? 172.21.15.50:0/1569751798' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-31T04:15:51.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:15:51 smithi177 ceph-mon[22025]: pgmap v99: 1 pgs: 1 creating+peering; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2024-08-31T04:15:51.792 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:15:51 smithi133 ceph-mon[22177]: pgmap v99: 1 pgs: 1 creating+peering; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2024-08-31T04:15:51.950 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:15:51 smithi050 ceph-mon[17259]: pgmap v99: 1 pgs: 1 creating+peering; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2024-08-31T04:15:53.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:15:53 smithi050 ceph-mon[17259]: pgmap v100: 1 pgs: 1 creating+peering; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2024-08-31T04:15:53.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:15:53 smithi177 ceph-mon[22025]: pgmap v100: 1 pgs: 1 creating+peering; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2024-08-31T04:15:53.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:15:53 smithi133 ceph-mon[22177]: pgmap v100: 1 pgs: 1 creating+peering; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2024-08-31T04:15:55.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:15:55 smithi050 ceph-mon[17259]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2024-08-31T04:15:55.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:15:55 smithi177 ceph-mon[22025]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2024-08-31T04:15:55.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:15:55 smithi133 ceph-mon[22177]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2024-08-31T04:15:57.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:15:57 smithi177 ceph-mon[22025]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2024-08-31T04:15:57.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:15:57 smithi133 ceph-mon[22177]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2024-08-31T04:15:57.878 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:15:57 smithi050 ceph-mon[17259]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2024-08-31T04:15:58.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:15:58 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.3"} : dispatch 2024-08-31T04:15:58.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:15:58 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:15:58.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:15:58 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.3"} : dispatch 2024-08-31T04:15:58.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:15:58 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:15:58.806 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:15:58 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.3"} : dispatch 2024-08-31T04:15:58.806 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:15:58 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:15:59.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:15:59 smithi177 ceph-mon[22025]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2024-08-31T04:15:59.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:15:59 smithi177 ceph-mon[22025]: Deploying daemon osd.3 on smithi050 2024-08-31T04:15:59.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:15:59 smithi133 ceph-mon[22177]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2024-08-31T04:15:59.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:15:59 smithi133 ceph-mon[22177]: Deploying daemon osd.3 on smithi050 2024-08-31T04:15:59.802 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:15:59 smithi050 ceph-mon[17259]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2024-08-31T04:15:59.803 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:15:59 smithi050 ceph-mon[17259]: Deploying daemon osd.3 on smithi050 2024-08-31T04:16:01.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:16:01 smithi177 ceph-mon[22025]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2024-08-31T04:16:01.754 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:16:01 smithi050 ceph-mon[17259]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2024-08-31T04:16:01.792 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:16:01 smithi133 ceph-mon[22177]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2024-08-31T04:16:03.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:16:03 smithi050 ceph-mon[17259]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2024-08-31T04:16:03.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:16:03 smithi177 ceph-mon[22025]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2024-08-31T04:16:03.792 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:16:03 smithi133 ceph-mon[22177]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2024-08-31T04:16:05.712 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:16:05 smithi050 ceph-mon[17259]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2024-08-31T04:16:05.713 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:16:05 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T04:16:05.713 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:16:05 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:16:05.713 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:16:05 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:16:05.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:16:05 smithi133 ceph-mon[22177]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2024-08-31T04:16:05.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:16:05 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T04:16:05.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:16:05 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:16:05.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:16:05 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:16:05.996 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:16:05 smithi177 ceph-mon[22025]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2024-08-31T04:16:05.996 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:16:05 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T04:16:05.996 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:16:05 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:16:05.996 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:16:05 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:16:07.525 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:16:07 smithi050 ceph-mon[17259]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2024-08-31T04:16:07.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:16:07 smithi133 ceph-mon[22177]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2024-08-31T04:16:07.996 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:16:07 smithi177 ceph-mon[22025]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2024-08-31T04:16:09.293 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:16:09 smithi133 ceph-mon[22177]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2024-08-31T04:16:09.293 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:16:09 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:16:09.293 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:16:09 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:16:09.293 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:16:09 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:16:09.293 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:16:09 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T04:16:09.293 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:16:09 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:16:09.410 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:16:09 smithi050 ceph-mon[17259]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2024-08-31T04:16:09.410 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:16:09 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:16:09.410 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:16:09 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:16:09.410 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:16:09 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:16:09.411 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:16:09 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T04:16:09.411 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:16:09 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:16:09.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:16:09 smithi177 ceph-mon[22025]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2024-08-31T04:16:09.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:16:09 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:16:09.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:16:09 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:16:09.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:16:09 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:16:09.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:16:09 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T04:16:09.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:16:09 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:16:10.283 INFO:teuthology.orchestra.run.smithi050.stdout:Created osd(s) 3 on host 'smithi050' 2024-08-31T04:16:10.284 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:16:10.281+0000 7fe7ffe00640 1 -- 172.21.15.50:0/2257998461 <== mgr.14150 v2:172.21.15.50:6800/2146686622 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fe8080635a0 con 0x7fe7ec0b4aa0 2024-08-31T04:16:10.286 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:16:10.284+0000 7fe80ca00640 1 -- 172.21.15.50:0/2257998461 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fe7ec0b4aa0 msgr2=0x7fe7ec0b6fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:16:10.286 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:16:10.284+0000 7fe80ca00640 1 --2- 172.21.15.50:0/2257998461 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fe7ec0b4aa0 0x7fe7ec0b6fb0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fe7f0000c00 tx=0x7fe7f0031400 comp rx=0 tx=0).stop 2024-08-31T04:16:10.286 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:16:10.284+0000 7fe80ca00640 1 -- 172.21.15.50:0/2257998461 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe8080779b0 msgr2=0x7fe8081a01e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:16:10.286 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:16:10.284+0000 7fe80ca00640 1 --2- 172.21.15.50:0/2257998461 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe8080779b0 0x7fe8081a01e0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fe7f800ebc0 tx=0x7fe7f800c2d0 comp rx=0 tx=0).stop 2024-08-31T04:16:10.286 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:16:10.284+0000 7fe80ca00640 1 -- 172.21.15.50:0/2257998461 shutdown_connections 2024-08-31T04:16:10.286 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:16:10.284+0000 7fe80ca00640 1 --2- 172.21.15.50:0/2257998461 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fe7ec0b4aa0 0x7fe7ec0b6fb0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:16:10.287 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:16:10.284+0000 7fe80ca00640 1 --2- 172.21.15.50:0/2257998461 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe8080793e0 0x7fe8081a13f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:16:10.287 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:16:10.284+0000 7fe80ca00640 1 --2- 172.21.15.50:0/2257998461 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe808078a40 0x7fe8081a0850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:16:10.287 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:16:10.284+0000 7fe80ca00640 1 --2- 172.21.15.50:0/2257998461 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe8080779b0 0x7fe8081a01e0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:16:10.287 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:16:10.284+0000 7fe80ca00640 1 -- 172.21.15.50:0/2257998461 >> 172.21.15.50:0/2257998461 conn(0x7fe808100ea0 msgr2=0x7fe80810f940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:16:10.287 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:16:10.285+0000 7fe80ca00640 1 -- 172.21.15.50:0/2257998461 shutdown_connections 2024-08-31T04:16:10.287 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:16:10.285+0000 7fe80ca00640 1 -- 172.21.15.50:0/2257998461 wait complete. 2024-08-31T04:16:11.065 DEBUG:teuthology.orchestra.run.smithi050:osd.3> sudo journalctl -f -n 0 -u ceph-058d9fc6-674f-11ef-bcd4-c7b262605968@osd.3.service 2024-08-31T04:16:11.070 INFO:tasks.cephadm:Deploying osd.4 on smithi133 with /dev/vg_nvme/lv_3... 2024-08-31T04:16:11.070 DEBUG:teuthology.orchestra.run.smithi133:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 058d9fc6-674f-11ef-bcd4-c7b262605968 -- lvm zap /dev/vg_nvme/lv_3 2024-08-31T04:16:11.292 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:16:11 smithi133 ceph-mon[22177]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2024-08-31T04:16:11.293 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:16:11 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T04:16:11.293 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:16:11 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:16:11.293 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:16:11 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:16:11.301 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:16:11 smithi050 ceph-mon[17259]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2024-08-31T04:16:11.301 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:16:11 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T04:16:11.301 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:16:11 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:16:11.301 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:16:11 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:16:11.324 INFO:teuthology.orchestra.run.smithi133.stderr:Inferring config /var/lib/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/mon.b/config 2024-08-31T04:16:11.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:16:11 smithi177 ceph-mon[22025]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2024-08-31T04:16:11.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:16:11 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T04:16:11.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:16:11 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:16:11.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:16:11 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:16:11.623 INFO:journalctl@ceph.osd.3.smithi050.stdout:Aug 31 04:16:11 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-3[39768]: 2024-08-31T04:16:11.357+0000 7f451602d640 -1 osd.3 0 log_to_monitors true 2024-08-31T04:16:12.373 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:16:12 smithi133 ceph-mon[22177]: from='osd.3 [v2:172.21.15.50:6810/3792992620,v1:172.21.15.50:6811/3792992620]' entity='osd.3' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]} : dispatch 2024-08-31T04:16:12.450 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:16:12 smithi050 ceph-mon[17259]: from='osd.3 [v2:172.21.15.50:6810/3792992620,v1:172.21.15.50:6811/3792992620]' entity='osd.3' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]} : dispatch 2024-08-31T04:16:12.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:16:12 smithi177 ceph-mon[22025]: from='osd.3 [v2:172.21.15.50:6810/3792992620,v1:172.21.15.50:6811/3792992620]' entity='osd.3' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]} : dispatch 2024-08-31T04:16:13.089 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:16:13 smithi050 ceph-mon[17259]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2024-08-31T04:16:13.089 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:16:13 smithi050 ceph-mon[17259]: from='osd.3 [v2:172.21.15.50:6810/3792992620,v1:172.21.15.50:6811/3792992620]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-08-31T04:16:13.089 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:16:13 smithi050 ceph-mon[17259]: osdmap e23: 4 total, 3 up, 4 in 2024-08-31T04:16:13.089 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:16:13 smithi050 ceph-mon[17259]: from='osd.3 [v2:172.21.15.50:6810/3792992620,v1:172.21.15.50:6811/3792992620]' entity='osd.3' cmd={"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi050", "root=default"]} : dispatch 2024-08-31T04:16:13.090 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:16:13 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-08-31T04:16:13.337 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:16:13 smithi133 ceph-mon[22177]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2024-08-31T04:16:13.337 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:16:13 smithi133 ceph-mon[22177]: from='osd.3 [v2:172.21.15.50:6810/3792992620,v1:172.21.15.50:6811/3792992620]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-08-31T04:16:13.337 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:16:13 smithi133 ceph-mon[22177]: osdmap e23: 4 total, 3 up, 4 in 2024-08-31T04:16:13.337 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:16:13 smithi133 ceph-mon[22177]: from='osd.3 [v2:172.21.15.50:6810/3792992620,v1:172.21.15.50:6811/3792992620]' entity='osd.3' cmd={"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi050", "root=default"]} : dispatch 2024-08-31T04:16:13.337 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:16:13 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-08-31T04:16:13.397 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:16:13 smithi177 ceph-mon[22025]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2024-08-31T04:16:13.397 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:16:13 smithi177 ceph-mon[22025]: from='osd.3 [v2:172.21.15.50:6810/3792992620,v1:172.21.15.50:6811/3792992620]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-08-31T04:16:13.397 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:16:13 smithi177 ceph-mon[22025]: osdmap e23: 4 total, 3 up, 4 in 2024-08-31T04:16:13.397 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:16:13 smithi177 ceph-mon[22025]: from='osd.3 [v2:172.21.15.50:6810/3792992620,v1:172.21.15.50:6811/3792992620]' entity='osd.3' cmd={"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi050", "root=default"]} : dispatch 2024-08-31T04:16:13.397 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:16:13 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-08-31T04:16:13.900 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-08-31T04:16:13.926 DEBUG:teuthology.orchestra.run.smithi133:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 058d9fc6-674f-11ef-bcd4-c7b262605968 -- ceph orch daemon add osd smithi133:vg_nvme/lv_3 2024-08-31T04:16:13.945 INFO:journalctl@ceph.osd.3.smithi050.stdout:Aug 31 04:16:13 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-3[39768]: 2024-08-31T04:16:13.721+0000 7f4511200640 -1 osd.3 0 waiting for initial osdmap 2024-08-31T04:16:13.945 INFO:journalctl@ceph.osd.3.smithi050.stdout:Aug 31 04:16:13 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-3[39768]: 2024-08-31T04:16:13.753+0000 7f4506800640 -1 osd.3 24 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-31T04:16:14.173 INFO:teuthology.orchestra.run.smithi133.stderr:Inferring config /var/lib/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/mon.b/config 2024-08-31T04:16:14.200 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:16:14 smithi050 ceph-mon[17259]: from='osd.3 [v2:172.21.15.50:6810/3792992620,v1:172.21.15.50:6811/3792992620]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi050", "root=default"]}]': finished 2024-08-31T04:16:14.200 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:16:14 smithi050 ceph-mon[17259]: osdmap e24: 4 total, 3 up, 4 in 2024-08-31T04:16:14.200 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:16:14 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-08-31T04:16:14.200 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:16:14 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-08-31T04:16:14.200 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:16:14 smithi050 ceph-mon[17259]: from='osd.3 [v2:172.21.15.50:6810/3792992620,v1:172.21.15.50:6811/3792992620]' entity='osd.3' 2024-08-31T04:16:14.292 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:16:14 smithi133 ceph-mon[22177]: from='osd.3 [v2:172.21.15.50:6810/3792992620,v1:172.21.15.50:6811/3792992620]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi050", "root=default"]}]': finished 2024-08-31T04:16:14.293 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:16:14 smithi133 ceph-mon[22177]: osdmap e24: 4 total, 3 up, 4 in 2024-08-31T04:16:14.293 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:16:14 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-08-31T04:16:14.293 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:16:14 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-08-31T04:16:14.293 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:16:14 smithi133 ceph-mon[22177]: from='osd.3 [v2:172.21.15.50:6810/3792992620,v1:172.21.15.50:6811/3792992620]' entity='osd.3' 2024-08-31T04:16:14.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:16:14 smithi177 ceph-mon[22025]: from='osd.3 [v2:172.21.15.50:6810/3792992620,v1:172.21.15.50:6811/3792992620]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi050", "root=default"]}]': finished 2024-08-31T04:16:14.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:16:14 smithi177 ceph-mon[22025]: osdmap e24: 4 total, 3 up, 4 in 2024-08-31T04:16:14.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:16:14 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-08-31T04:16:14.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:16:14 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-08-31T04:16:14.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:16:14 smithi177 ceph-mon[22025]: from='osd.3 [v2:172.21.15.50:6810/3792992620,v1:172.21.15.50:6811/3792992620]' entity='osd.3' 2024-08-31T04:16:14.629 INFO:teuthology.orchestra.run.smithi133.stderr:2024-08-31T04:16:14.625+0000 7f967452e640 1 -- 172.21.15.133:0/3278723415 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f966c109240 msgr2=0x7f966c10b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:16:14.629 INFO:teuthology.orchestra.run.smithi133.stderr:2024-08-31T04:16:14.625+0000 7f967452e640 1 --2- 172.21.15.133:0/3278723415 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f966c109240 0x7f966c10b750 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f9664009ca0 tx=0x7f966402a8c0 comp rx=0 tx=0).stop 2024-08-31T04:16:14.629 INFO:teuthology.orchestra.run.smithi133.stderr:2024-08-31T04:16:14.626+0000 7f967452e640 1 -- 172.21.15.133:0/3278723415 shutdown_connections 2024-08-31T04:16:14.630 INFO:teuthology.orchestra.run.smithi133.stderr:2024-08-31T04:16:14.626+0000 7f967452e640 1 --2- 172.21.15.133:0/3278723415 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f966c109240 0x7f966c10b750 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:16:14.630 INFO:teuthology.orchestra.run.smithi133.stderr:2024-08-31T04:16:14.626+0000 7f967452e640 1 --2- 172.21.15.133:0/3278723415 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f966c106730 0x7f966c108b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:16:14.630 INFO:teuthology.orchestra.run.smithi133.stderr:2024-08-31T04:16:14.626+0000 7f967452e640 1 --2- 172.21.15.133:0/3278723415 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f966c06c3a0 0x7f966c1061f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:16:14.630 INFO:teuthology.orchestra.run.smithi133.stderr:2024-08-31T04:16:14.626+0000 7f967452e640 1 -- 172.21.15.133:0/3278723415 >> 172.21.15.133:0/3278723415 conn(0x7f966c0fdd70 msgr2=0x7f966c100220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:16:14.630 INFO:teuthology.orchestra.run.smithi133.stderr:2024-08-31T04:16:14.626+0000 7f967452e640 1 -- 172.21.15.133:0/3278723415 shutdown_connections 2024-08-31T04:16:14.630 INFO:teuthology.orchestra.run.smithi133.stderr:2024-08-31T04:16:14.626+0000 7f967452e640 1 -- 172.21.15.133:0/3278723415 wait complete. 2024-08-31T04:16:14.630 INFO:teuthology.orchestra.run.smithi133.stderr:2024-08-31T04:16:14.626+0000 7f967452e640 1 Processor -- start 2024-08-31T04:16:14.630 INFO:teuthology.orchestra.run.smithi133.stderr:2024-08-31T04:16:14.626+0000 7f967452e640 1 -- start start 2024-08-31T04:16:14.630 INFO:teuthology.orchestra.run.smithi133.stderr:2024-08-31T04:16:14.626+0000 7f967452e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f966c06c3a0 0x7f966c199d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:16:14.630 INFO:teuthology.orchestra.run.smithi133.stderr:2024-08-31T04:16:14.626+0000 7f967452e640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f966c106730 0x7f966c19a3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:16:14.630 INFO:teuthology.orchestra.run.smithi133.stderr:2024-08-31T04:16:14.626+0000 7f967452e640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f966c109240 0x7f966c19af40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:16:14.630 INFO:teuthology.orchestra.run.smithi133.stderr:2024-08-31T04:16:14.626+0000 7f967452e640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f966c10f1a0 con 0x7f966c06c3a0 2024-08-31T04:16:14.631 INFO:teuthology.orchestra.run.smithi133.stderr:2024-08-31T04:16:14.627+0000 7f967452e640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f966c10f020 con 0x7f966c106730 2024-08-31T04:16:14.631 INFO:teuthology.orchestra.run.smithi133.stderr:2024-08-31T04:16:14.627+0000 7f967452e640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f966c10f320 con 0x7f966c109240 2024-08-31T04:16:14.631 INFO:teuthology.orchestra.run.smithi133.stderr:2024-08-31T04:16:14.627+0000 7f9671ac9640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f966c106730 0x7f966c19a3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:16:14.631 INFO:teuthology.orchestra.run.smithi133.stderr:2024-08-31T04:16:14.627+0000 7f9671ac9640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f966c106730 0x7f966c19a3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:41866/0 (socket says 172.21.15.133:41866) 2024-08-31T04:16:14.631 INFO:teuthology.orchestra.run.smithi133.stderr:2024-08-31T04:16:14.627+0000 7f9671ac9640 1 -- 172.21.15.133:0/97484609 learned_addr learned my addr 172.21.15.133:0/97484609 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-08-31T04:16:14.631 INFO:teuthology.orchestra.run.smithi133.stderr:2024-08-31T04:16:14.627+0000 7f96722ca640 1 --2- 172.21.15.133:0/97484609 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f966c06c3a0 0x7f966c199d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:16:14.631 INFO:teuthology.orchestra.run.smithi133.stderr:2024-08-31T04:16:14.627+0000 7f9672acb640 1 --2- 172.21.15.133:0/97484609 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f966c109240 0x7f966c19af40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:16:14.631 INFO:teuthology.orchestra.run.smithi133.stderr:2024-08-31T04:16:14.627+0000 7f9671ac9640 1 -- 172.21.15.133:0/97484609 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f966c109240 msgr2=0x7f966c19af40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:16:14.631 INFO:teuthology.orchestra.run.smithi133.stderr:2024-08-31T04:16:14.627+0000 7f9671ac9640 1 --2- 172.21.15.133:0/97484609 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f966c109240 0x7f966c19af40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:16:14.631 INFO:teuthology.orchestra.run.smithi133.stderr:2024-08-31T04:16:14.627+0000 7f9671ac9640 1 -- 172.21.15.133:0/97484609 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f966c06c3a0 msgr2=0x7f966c199d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:16:14.631 INFO:teuthology.orchestra.run.smithi133.stderr:2024-08-31T04:16:14.627+0000 7f9671ac9640 1 --2- 172.21.15.133:0/97484609 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f966c06c3a0 0x7f966c199d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:16:14.632 INFO:teuthology.orchestra.run.smithi133.stderr:2024-08-31T04:16:14.627+0000 7f9671ac9640 1 -- 172.21.15.133:0/97484609 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f966c19b760 con 0x7f966c106730 2024-08-31T04:16:14.632 INFO:teuthology.orchestra.run.smithi133.stderr:2024-08-31T04:16:14.627+0000 7f9672acb640 1 --2- 172.21.15.133:0/97484609 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f966c109240 0x7f966c19af40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:16:14.632 INFO:teuthology.orchestra.run.smithi133.stderr:2024-08-31T04:16:14.627+0000 7f9671ac9640 1 --2- 172.21.15.133:0/97484609 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f966c106730 0x7f966c19a3a0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f966800d950 tx=0x7f966800de10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:16:14.632 INFO:teuthology.orchestra.run.smithi133.stderr:2024-08-31T04:16:14.627+0000 7f965f7fe640 1 -- 172.21.15.133:0/97484609 <== mon.2 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9668017030 con 0x7f966c106730 2024-08-31T04:16:14.632 INFO:teuthology.orchestra.run.smithi133.stderr:2024-08-31T04:16:14.627+0000 7f965f7fe640 1 -- 172.21.15.133:0/97484609 <== mon.2 v2:172.21.15.133:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9668004020 con 0x7f966c106730 2024-08-31T04:16:14.632 INFO:teuthology.orchestra.run.smithi133.stderr:2024-08-31T04:16:14.627+0000 7f967452e640 1 -- 172.21.15.133:0/97484609 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f966c19ba50 con 0x7f966c106730 2024-08-31T04:16:14.632 INFO:teuthology.orchestra.run.smithi133.stderr:2024-08-31T04:16:14.627+0000 7f965f7fe640 1 -- 172.21.15.133:0/97484609 <== mon.2 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96680047a0 con 0x7f966c106730 2024-08-31T04:16:14.632 INFO:teuthology.orchestra.run.smithi133.stderr:2024-08-31T04:16:14.627+0000 7f967452e640 1 -- 172.21.15.133:0/97484609 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f966c1a2150 con 0x7f966c106730 2024-08-31T04:16:14.633 INFO:teuthology.orchestra.run.smithi133.stderr:2024-08-31T04:16:14.628+0000 7f967452e640 1 -- 172.21.15.133:0/97484609 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f966c106b40 con 0x7f966c106730 2024-08-31T04:16:14.633 INFO:teuthology.orchestra.run.smithi133.stderr:2024-08-31T04:16:14.630+0000 7f965f7fe640 1 -- 172.21.15.133:0/97484609 <== mon.2 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 16) ==== 152577+0+0 (secure 0 0 0) 0x7f9668009a30 con 0x7f966c106730 2024-08-31T04:16:14.633 INFO:teuthology.orchestra.run.smithi133.stderr:2024-08-31T04:16:14.631+0000 7f965f7fe640 1 --2- 172.21.15.133:0/97484609 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f96580b4b30 0x7f96580b7040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:16:14.633 INFO:teuthology.orchestra.run.smithi133.stderr:2024-08-31T04:16:14.631+0000 7f965f7fe640 1 -- 172.21.15.133:0/97484609 <== mon.2 v2:172.21.15.133:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 3702+0+0 (secure 0 0 0) 0x7f96680e4000 con 0x7f966c106730 2024-08-31T04:16:14.633 INFO:teuthology.orchestra.run.smithi133.stderr:2024-08-31T04:16:14.631+0000 7f96722ca640 1 --2- 172.21.15.133:0/97484609 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f96580b4b30 0x7f96580b7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:16:14.633 INFO:teuthology.orchestra.run.smithi133.stderr:2024-08-31T04:16:14.632+0000 7f96722ca640 1 --2- 172.21.15.133:0/97484609 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f96580b4b30 0x7f96580b7040 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f9660009bd0 tx=0x7f9660005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:16:14.635 INFO:teuthology.orchestra.run.smithi133.stderr:2024-08-31T04:16:14.634+0000 7f965f7fe640 1 -- 172.21.15.133:0/97484609 <== mon.2 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f96680ac330 con 0x7f966c106730 2024-08-31T04:16:14.822 INFO:teuthology.orchestra.run.smithi133.stderr:2024-08-31T04:16:14.821+0000 7f967452e640 1 -- 172.21.15.133:0/97484609 --> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi133:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7f966c0635a0 con 0x7f96580b4b30 2024-08-31T04:16:15.200 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:16:15 smithi050 ceph-mon[17259]: purged_snaps scrub starts 2024-08-31T04:16:15.200 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:16:15 smithi050 ceph-mon[17259]: purged_snaps scrub ok 2024-08-31T04:16:15.200 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:16:15 smithi050 ceph-mon[17259]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2024-08-31T04:16:15.200 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:16:15 smithi050 ceph-mon[17259]: osd.3 [v2:172.21.15.50:6810/3792992620,v1:172.21.15.50:6811/3792992620] boot 2024-08-31T04:16:15.200 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:16:15 smithi050 ceph-mon[17259]: osdmap e25: 4 total, 4 up, 4 in 2024-08-31T04:16:15.200 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:16:15 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-08-31T04:16:15.201 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:16:15 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-31T04:16:15.201 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:16:15 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-31T04:16:15.201 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:16:15 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:16:15.201 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:16:15 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:16:15.201 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:16:15 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:16:15.201 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:16:15 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-08-31T04:16:15.201 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:16:15 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-08-31T04:16:15.201 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:16:15 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:16:15.201 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:16:15 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:16:15.201 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:16:15 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T04:16:15.201 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:16:15 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:16:15.201 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:16:15 smithi050 ceph-mon[17259]: osdmap e26: 4 total, 4 up, 4 in 2024-08-31T04:16:15.344 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:16:15 smithi133 ceph-mon[22177]: purged_snaps scrub starts 2024-08-31T04:16:15.345 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:16:15 smithi133 ceph-mon[22177]: purged_snaps scrub ok 2024-08-31T04:16:15.345 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:16:15 smithi133 ceph-mon[22177]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2024-08-31T04:16:15.345 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:16:15 smithi133 ceph-mon[22177]: osd.3 [v2:172.21.15.50:6810/3792992620,v1:172.21.15.50:6811/3792992620] boot 2024-08-31T04:16:15.345 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:16:15 smithi133 ceph-mon[22177]: osdmap e25: 4 total, 4 up, 4 in 2024-08-31T04:16:15.345 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:16:15 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-08-31T04:16:15.345 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:16:15 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-31T04:16:15.345 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:16:15 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-31T04:16:15.345 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:16:15 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:16:15.345 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:16:15 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:16:15.345 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:16:15 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:16:15.345 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:16:15 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-08-31T04:16:15.345 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:16:15 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-08-31T04:16:15.346 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:16:15 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:16:15.346 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:16:15 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:16:15.346 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:16:15 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T04:16:15.346 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:16:15 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:16:15.346 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:16:15 smithi133 ceph-mon[22177]: osdmap e26: 4 total, 4 up, 4 in 2024-08-31T04:16:15.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:16:15 smithi177 ceph-mon[22025]: purged_snaps scrub starts 2024-08-31T04:16:15.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:16:15 smithi177 ceph-mon[22025]: purged_snaps scrub ok 2024-08-31T04:16:15.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:16:15 smithi177 ceph-mon[22025]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2024-08-31T04:16:15.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:16:15 smithi177 ceph-mon[22025]: osd.3 [v2:172.21.15.50:6810/3792992620,v1:172.21.15.50:6811/3792992620] boot 2024-08-31T04:16:15.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:16:15 smithi177 ceph-mon[22025]: osdmap e25: 4 total, 4 up, 4 in 2024-08-31T04:16:15.497 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:16:15 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-08-31T04:16:15.497 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:16:15 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-31T04:16:15.497 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:16:15 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-31T04:16:15.497 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:16:15 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:16:15.497 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:16:15 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:16:15.497 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:16:15 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:16:15.497 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:16:15 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-08-31T04:16:15.497 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:16:15 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-08-31T04:16:15.497 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:16:15 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:16:15.497 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:16:15 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:16:15.497 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:16:15 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T04:16:15.497 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:16:15 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:16:15.498 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:16:15 smithi177 ceph-mon[22025]: osdmap e26: 4 total, 4 up, 4 in 2024-08-31T04:16:16.341 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:16:16 smithi133 ceph-mon[22177]: from='client.24359 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi133:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:16:16.342 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:16:16 smithi133 ceph-mon[22177]: Detected new or changed devices on smithi050 2024-08-31T04:16:16.342 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:16:16 smithi133 ceph-mon[22177]: Adjusting osd_memory_target on smithi050 to 8547M 2024-08-31T04:16:16.342 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:16:16 smithi133 ceph-mon[22177]: osdmap e27: 4 total, 4 up, 4 in 2024-08-31T04:16:16.450 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:16:16 smithi050 ceph-mon[17259]: from='client.24359 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi133:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:16:16.450 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:16:16 smithi050 ceph-mon[17259]: Detected new or changed devices on smithi050 2024-08-31T04:16:16.450 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:16:16 smithi050 ceph-mon[17259]: Adjusting osd_memory_target on smithi050 to 8547M 2024-08-31T04:16:16.450 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:16:16 smithi050 ceph-mon[17259]: osdmap e27: 4 total, 4 up, 4 in 2024-08-31T04:16:16.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:16:16 smithi177 ceph-mon[22025]: from='client.24359 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi133:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:16:16.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:16:16 smithi177 ceph-mon[22025]: Detected new or changed devices on smithi050 2024-08-31T04:16:16.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:16:16 smithi177 ceph-mon[22025]: Adjusting osd_memory_target on smithi050 to 8547M 2024-08-31T04:16:16.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:16:16 smithi177 ceph-mon[22025]: osdmap e27: 4 total, 4 up, 4 in 2024-08-31T04:16:17.404 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:16:17 smithi133 ceph-mon[22177]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 357 GiB / 358 GiB avail 2024-08-31T04:16:17.450 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:16:17 smithi050 ceph-mon[17259]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 357 GiB / 358 GiB avail 2024-08-31T04:16:17.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:16:17 smithi177 ceph-mon[22025]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 357 GiB / 358 GiB avail 2024-08-31T04:16:18.450 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:16:18 smithi050 ceph-mon[17259]: from='client.? 172.21.15.133:0/883684883' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "2a2b4e64-0f8e-40ec-926c-84dbf691aefe"} : dispatch 2024-08-31T04:16:18.450 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:16:18 smithi050 ceph-mon[17259]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "2a2b4e64-0f8e-40ec-926c-84dbf691aefe"} : dispatch 2024-08-31T04:16:18.450 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:16:18 smithi050 ceph-mon[17259]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "2a2b4e64-0f8e-40ec-926c-84dbf691aefe"}]': finished 2024-08-31T04:16:18.450 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:16:18 smithi050 ceph-mon[17259]: osdmap e28: 5 total, 4 up, 5 in 2024-08-31T04:16:18.450 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:16:18 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-08-31T04:16:18.450 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:16:18 smithi050 ceph-mon[17259]: from='client.? 172.21.15.133:0/2578872581' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-31T04:16:18.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:16:18 smithi177 ceph-mon[22025]: from='client.? 172.21.15.133:0/883684883' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "2a2b4e64-0f8e-40ec-926c-84dbf691aefe"} : dispatch 2024-08-31T04:16:18.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:16:18 smithi177 ceph-mon[22025]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "2a2b4e64-0f8e-40ec-926c-84dbf691aefe"} : dispatch 2024-08-31T04:16:18.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:16:18 smithi177 ceph-mon[22025]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "2a2b4e64-0f8e-40ec-926c-84dbf691aefe"}]': finished 2024-08-31T04:16:18.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:16:18 smithi177 ceph-mon[22025]: osdmap e28: 5 total, 4 up, 5 in 2024-08-31T04:16:18.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:16:18 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-08-31T04:16:18.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:16:18 smithi177 ceph-mon[22025]: from='client.? 172.21.15.133:0/2578872581' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-31T04:16:18.542 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:16:18 smithi133 ceph-mon[22177]: from='client.? 172.21.15.133:0/883684883' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "2a2b4e64-0f8e-40ec-926c-84dbf691aefe"} : dispatch 2024-08-31T04:16:18.542 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:16:18 smithi133 ceph-mon[22177]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "2a2b4e64-0f8e-40ec-926c-84dbf691aefe"} : dispatch 2024-08-31T04:16:18.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:16:18 smithi133 ceph-mon[22177]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "2a2b4e64-0f8e-40ec-926c-84dbf691aefe"}]': finished 2024-08-31T04:16:18.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:16:18 smithi133 ceph-mon[22177]: osdmap e28: 5 total, 4 up, 5 in 2024-08-31T04:16:18.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:16:18 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-08-31T04:16:18.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:16:18 smithi133 ceph-mon[22177]: from='client.? 172.21.15.133:0/2578872581' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-31T04:16:19.450 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:16:19 smithi050 ceph-mon[17259]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 357 GiB / 358 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-08-31T04:16:19.495 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:16:19 smithi177 ceph-mon[22025]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 357 GiB / 358 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-08-31T04:16:19.542 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:16:19 smithi133 ceph-mon[22177]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 357 GiB / 358 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-08-31T04:16:21.450 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:16:21 smithi050 ceph-mon[17259]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 101 KiB/s, 0 objects/s recovering 2024-08-31T04:16:21.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:16:21 smithi177 ceph-mon[22025]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 101 KiB/s, 0 objects/s recovering 2024-08-31T04:16:21.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:16:21 smithi133 ceph-mon[22177]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 101 KiB/s, 0 objects/s recovering 2024-08-31T04:16:23.292 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:16:23 smithi133 ceph-mon[22177]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 86 KiB/s, 0 objects/s recovering 2024-08-31T04:16:23.450 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:16:23 smithi050 ceph-mon[17259]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 86 KiB/s, 0 objects/s recovering 2024-08-31T04:16:23.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:16:23 smithi177 ceph-mon[22025]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 86 KiB/s, 0 objects/s recovering 2024-08-31T04:16:25.200 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:16:25 smithi050 ceph-mon[17259]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-08-31T04:16:25.211 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:16:25 smithi133 ceph-mon[22177]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-08-31T04:16:25.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:16:25 smithi177 ceph-mon[22025]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-08-31T04:16:26.450 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:16:26 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.4"} : dispatch 2024-08-31T04:16:26.450 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:16:26 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:16:26.450 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:16:26 smithi050 ceph-mon[17259]: Deploying daemon osd.4 on smithi133 2024-08-31T04:16:26.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:16:26 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.4"} : dispatch 2024-08-31T04:16:26.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:16:26 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:16:26.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:16:26 smithi177 ceph-mon[22025]: Deploying daemon osd.4 on smithi133 2024-08-31T04:16:26.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:16:26 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.4"} : dispatch 2024-08-31T04:16:26.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:16:26 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:16:26.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:16:26 smithi133 ceph-mon[22177]: Deploying daemon osd.4 on smithi133 2024-08-31T04:16:27.402 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:16:27 smithi133 ceph-mon[22177]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 59 KiB/s, 0 objects/s recovering 2024-08-31T04:16:27.450 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:16:27 smithi050 ceph-mon[17259]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 59 KiB/s, 0 objects/s recovering 2024-08-31T04:16:27.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:16:27 smithi177 ceph-mon[22025]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 59 KiB/s, 0 objects/s recovering 2024-08-31T04:16:29.450 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:16:29 smithi050 ceph-mon[17259]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 54 KiB/s, 0 objects/s recovering 2024-08-31T04:16:29.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:16:29 smithi177 ceph-mon[22025]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 54 KiB/s, 0 objects/s recovering 2024-08-31T04:16:29.533 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:16:29 smithi133 ceph-mon[22177]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 54 KiB/s, 0 objects/s recovering 2024-08-31T04:16:31.431 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:16:31 smithi133 ceph-mon[22177]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-08-31T04:16:31.431 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:16:31 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T04:16:31.431 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:16:31 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:16:31.431 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:16:31 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:16:31.449 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:16:31 smithi050 ceph-mon[17259]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-08-31T04:16:31.449 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:16:31 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T04:16:31.450 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:16:31 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:16:31.450 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:16:31 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:16:31.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:16:31 smithi177 ceph-mon[22025]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-08-31T04:16:31.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:16:31 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T04:16:31.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:16:31 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:16:31.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:16:31 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:16:33.441 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:16:33 smithi133 ceph-mon[22177]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-08-31T04:16:33.450 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:16:33 smithi050 ceph-mon[17259]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-08-31T04:16:33.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:16:33 smithi177 ceph-mon[22025]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-08-31T04:16:34.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:16:34 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:16:34.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:16:34 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:16:34.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:16:34 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:16:34.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:16:34 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T04:16:34.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:16:34 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:16:34.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:16:34 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:16:34.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:16:34 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:16:34.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:16:34 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:16:34.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:16:34 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T04:16:34.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:16:34 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:16:34.950 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:16:34 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:16:34.950 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:16:34 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:16:34.950 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:16:34 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:16:34.950 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:16:34 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T04:16:34.950 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:16:34 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:16:34.966 INFO:teuthology.orchestra.run.smithi133.stderr:2024-08-31T04:16:34.964+0000 7f965f7fe640 1 -- 172.21.15.133:0/97484609 <== mgr.14150 v2:172.21.15.50:6800/2146686622 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f966c0635a0 con 0x7f96580b4b30 2024-08-31T04:16:34.966 INFO:teuthology.orchestra.run.smithi133.stdout:Created osd(s) 4 on host 'smithi133' 2024-08-31T04:16:34.968 INFO:teuthology.orchestra.run.smithi133.stderr:2024-08-31T04:16:34.967+0000 7f967452e640 1 -- 172.21.15.133:0/97484609 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f96580b4b30 msgr2=0x7f96580b7040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:16:34.969 INFO:teuthology.orchestra.run.smithi133.stderr:2024-08-31T04:16:34.967+0000 7f967452e640 1 --2- 172.21.15.133:0/97484609 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f96580b4b30 0x7f96580b7040 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f9660009bd0 tx=0x7f9660005f90 comp rx=0 tx=0).stop 2024-08-31T04:16:34.969 INFO:teuthology.orchestra.run.smithi133.stderr:2024-08-31T04:16:34.967+0000 7f967452e640 1 -- 172.21.15.133:0/97484609 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f966c106730 msgr2=0x7f966c19a3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:16:34.969 INFO:teuthology.orchestra.run.smithi133.stderr:2024-08-31T04:16:34.967+0000 7f967452e640 1 --2- 172.21.15.133:0/97484609 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f966c106730 0x7f966c19a3a0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f966800d950 tx=0x7f966800de10 comp rx=0 tx=0).stop 2024-08-31T04:16:34.969 INFO:teuthology.orchestra.run.smithi133.stderr:2024-08-31T04:16:34.967+0000 7f967452e640 1 -- 172.21.15.133:0/97484609 shutdown_connections 2024-08-31T04:16:34.969 INFO:teuthology.orchestra.run.smithi133.stderr:2024-08-31T04:16:34.967+0000 7f967452e640 1 --2- 172.21.15.133:0/97484609 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f96580b4b30 0x7f96580b7040 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:16:34.969 INFO:teuthology.orchestra.run.smithi133.stderr:2024-08-31T04:16:34.967+0000 7f967452e640 1 --2- 172.21.15.133:0/97484609 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f966c109240 0x7f966c19af40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:16:34.969 INFO:teuthology.orchestra.run.smithi133.stderr:2024-08-31T04:16:34.967+0000 7f967452e640 1 --2- 172.21.15.133:0/97484609 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f966c106730 0x7f966c19a3a0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:16:34.969 INFO:teuthology.orchestra.run.smithi133.stderr:2024-08-31T04:16:34.967+0000 7f967452e640 1 --2- 172.21.15.133:0/97484609 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f966c06c3a0 0x7f966c199d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:16:34.969 INFO:teuthology.orchestra.run.smithi133.stderr:2024-08-31T04:16:34.967+0000 7f967452e640 1 -- 172.21.15.133:0/97484609 >> 172.21.15.133:0/97484609 conn(0x7f966c0fdd70 msgr2=0x7f966c104bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:16:34.969 INFO:teuthology.orchestra.run.smithi133.stderr:2024-08-31T04:16:34.967+0000 7f967452e640 1 -- 172.21.15.133:0/97484609 shutdown_connections 2024-08-31T04:16:34.969 INFO:teuthology.orchestra.run.smithi133.stderr:2024-08-31T04:16:34.967+0000 7f967452e640 1 -- 172.21.15.133:0/97484609 wait complete. 2024-08-31T04:16:35.548 DEBUG:teuthology.orchestra.run.smithi133:osd.4> sudo journalctl -f -n 0 -u ceph-058d9fc6-674f-11ef-bcd4-c7b262605968@osd.4.service 2024-08-31T04:16:35.550 INFO:tasks.cephadm:Deploying osd.5 on smithi177 with /dev/vg_nvme/lv_3... 2024-08-31T04:16:35.550 DEBUG:teuthology.orchestra.run.smithi177:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 058d9fc6-674f-11ef-bcd4-c7b262605968 -- lvm zap /dev/vg_nvme/lv_3 2024-08-31T04:16:35.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:16:35 smithi133 ceph-mon[22177]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-08-31T04:16:35.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:16:35 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T04:16:35.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:16:35 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:16:35.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:16:35 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:16:35.805 INFO:teuthology.orchestra.run.smithi177.stderr:Inferring config /var/lib/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/mon.c/config 2024-08-31T04:16:35.925 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:16:35 smithi177 ceph-mon[22025]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-08-31T04:16:35.926 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:16:35 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T04:16:35.926 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:16:35 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:16:35.926 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:16:35 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:16:35.950 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:16:35 smithi050 ceph-mon[17259]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-08-31T04:16:35.950 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:16:35 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T04:16:35.950 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:16:35 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:16:35.950 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:16:35 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:16:37.134 INFO:journalctl@ceph.osd.4.smithi133.stdout:Aug 31 04:16:37 smithi133 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-4[33352]: 2024-08-31T04:16:37.061+0000 7fa27101d640 -1 osd.4 0 log_to_monitors true 2024-08-31T04:16:37.757 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:16:37 smithi133 ceph-mon[22177]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-08-31T04:16:37.757 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:16:37 smithi133 ceph-mon[22177]: from='osd.4 [v2:172.21.15.133:6808/2855333596,v1:172.21.15.133:6809/2855333596]' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-08-31T04:16:37.757 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:16:37 smithi133 ceph-mon[22177]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-08-31T04:16:37.950 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:16:37 smithi050 ceph-mon[17259]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-08-31T04:16:37.950 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:16:37 smithi050 ceph-mon[17259]: from='osd.4 [v2:172.21.15.133:6808/2855333596,v1:172.21.15.133:6809/2855333596]' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-08-31T04:16:37.950 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:16:37 smithi050 ceph-mon[17259]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-08-31T04:16:37.990 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:16:37 smithi177 ceph-mon[22025]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-08-31T04:16:37.990 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:16:37 smithi177 ceph-mon[22025]: from='osd.4 [v2:172.21.15.133:6808/2855333596,v1:172.21.15.133:6809/2855333596]' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-08-31T04:16:37.990 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:16:37 smithi177 ceph-mon[22025]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-08-31T04:16:38.310 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-08-31T04:16:38.336 DEBUG:teuthology.orchestra.run.smithi177:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 058d9fc6-674f-11ef-bcd4-c7b262605968 -- ceph orch daemon add osd smithi177:vg_nvme/lv_3 2024-08-31T04:16:38.597 INFO:teuthology.orchestra.run.smithi177.stderr:Inferring config /var/lib/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/mon.c/config 2024-08-31T04:16:38.619 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:16:38 smithi177 ceph-mon[22025]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-08-31T04:16:38.619 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:16:38 smithi177 ceph-mon[22025]: osdmap e29: 5 total, 4 up, 5 in 2024-08-31T04:16:38.619 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:16:38 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-08-31T04:16:38.619 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:16:38 smithi177 ceph-mon[22025]: from='osd.4 [v2:172.21.15.133:6808/2855333596,v1:172.21.15.133:6809/2855333596]' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi133", "root=default"]} : dispatch 2024-08-31T04:16:38.619 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:16:38 smithi177 ceph-mon[22025]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi133", "root=default"]} : dispatch 2024-08-31T04:16:38.619 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:16:38 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:16:38.620 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:16:38 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:16:38.620 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:16:38 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-08-31T04:16:38.620 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:16:38 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-08-31T04:16:38.620 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:16:38 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:16:38.620 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:16:38 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:16:38.620 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:16:38 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T04:16:38.620 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:16:38 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:16:38.793 INFO:journalctl@ceph.osd.4.smithi133.stdout:Aug 31 04:16:38 smithi133 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-4[33352]: 2024-08-31T04:16:38.521+0000 7fa26cf9f640 -1 osd.4 0 waiting for initial osdmap 2024-08-31T04:16:38.793 INFO:journalctl@ceph.osd.4.smithi133.stdout:Aug 31 04:16:38 smithi133 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-4[33352]: 2024-08-31T04:16:38.526+0000 7fa268d9d640 -1 osd.4 30 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-31T04:16:38.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:16:38 smithi133 ceph-mon[22177]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-08-31T04:16:38.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:16:38 smithi133 ceph-mon[22177]: osdmap e29: 5 total, 4 up, 5 in 2024-08-31T04:16:38.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:16:38 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-08-31T04:16:38.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:16:38 smithi133 ceph-mon[22177]: from='osd.4 [v2:172.21.15.133:6808/2855333596,v1:172.21.15.133:6809/2855333596]' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi133", "root=default"]} : dispatch 2024-08-31T04:16:38.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:16:38 smithi133 ceph-mon[22177]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi133", "root=default"]} : dispatch 2024-08-31T04:16:38.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:16:38 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:16:38.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:16:38 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:16:38.794 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:16:38 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-08-31T04:16:38.794 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:16:38 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-08-31T04:16:38.794 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:16:38 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:16:38.794 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:16:38 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:16:38.794 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:16:38 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T04:16:38.794 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:16:38 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:16:38.950 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:16:38 smithi050 ceph-mon[17259]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-08-31T04:16:38.950 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:16:38 smithi050 ceph-mon[17259]: osdmap e29: 5 total, 4 up, 5 in 2024-08-31T04:16:38.950 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:16:38 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-08-31T04:16:38.950 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:16:38 smithi050 ceph-mon[17259]: from='osd.4 [v2:172.21.15.133:6808/2855333596,v1:172.21.15.133:6809/2855333596]' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi133", "root=default"]} : dispatch 2024-08-31T04:16:38.950 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:16:38 smithi050 ceph-mon[17259]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi133", "root=default"]} : dispatch 2024-08-31T04:16:38.951 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:16:38 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:16:38.951 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:16:38 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:16:38.951 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:16:38 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-08-31T04:16:38.951 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:16:38 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-08-31T04:16:38.951 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:16:38 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:16:38.951 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:16:38 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:16:38.951 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:16:38 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T04:16:38.951 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:16:38 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:16:39.067 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-31T04:16:39.063+0000 7f1757fff640 1 -- 172.21.15.177:0/2912741130 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1758103d00 msgr2=0x7f175810a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:16:39.067 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-31T04:16:39.063+0000 7f1757fff640 1 --2- 172.21.15.177:0/2912741130 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1758103d00 0x7f175810a7a0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f1750009ca0 tx=0x7f175002a8c0 comp rx=0 tx=0).stop 2024-08-31T04:16:39.067 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-31T04:16:39.063+0000 7f1757fff640 1 -- 172.21.15.177:0/2912741130 shutdown_connections 2024-08-31T04:16:39.067 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-31T04:16:39.063+0000 7f1757fff640 1 --2- 172.21.15.177:0/2912741130 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1758103d00 0x7f175810a7a0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:16:39.068 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-31T04:16:39.063+0000 7f1757fff640 1 --2- 172.21.15.177:0/2912741130 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f17581030f0 0x7f17581035c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:16:39.068 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-31T04:16:39.063+0000 7f1757fff640 1 --2- 172.21.15.177:0/2912741130 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1758102710 0x7f1758102b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:16:39.068 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-31T04:16:39.063+0000 7f1757fff640 1 -- 172.21.15.177:0/2912741130 >> 172.21.15.177:0/2912741130 conn(0x7f17580fd2f0 msgr2=0x7f17580ff7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:16:39.068 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-31T04:16:39.063+0000 7f1757fff640 1 -- 172.21.15.177:0/2912741130 shutdown_connections 2024-08-31T04:16:39.068 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-31T04:16:39.063+0000 7f1757fff640 1 -- 172.21.15.177:0/2912741130 wait complete. 2024-08-31T04:16:39.068 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-31T04:16:39.064+0000 7f1757fff640 1 Processor -- start 2024-08-31T04:16:39.068 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-31T04:16:39.064+0000 7f1757fff640 1 -- start start 2024-08-31T04:16:39.068 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-31T04:16:39.065+0000 7f1757fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1758102710 0x7f1758199be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:16:39.068 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-31T04:16:39.065+0000 7f1757fff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f17581030f0 0x7f175819a250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:16:39.068 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-31T04:16:39.065+0000 7f1757fff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1758103d00 0x7f175819adf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:16:39.068 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-31T04:16:39.065+0000 7f1757fff640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f175810deb0 con 0x7f1758102710 2024-08-31T04:16:39.069 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-31T04:16:39.065+0000 7f1757fff640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f175810dd30 con 0x7f17581030f0 2024-08-31T04:16:39.069 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-31T04:16:39.065+0000 7f1757fff640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f175810e030 con 0x7f1758103d00 2024-08-31T04:16:39.069 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-31T04:16:39.065+0000 7f17577fe640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1758103d00 0x7f175819adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:16:39.069 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-31T04:16:39.065+0000 7f17577fe640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1758103d00 0x7f175819adf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:51088/0 (socket says 172.21.15.177:51088) 2024-08-31T04:16:39.069 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-31T04:16:39.065+0000 7f17577fe640 1 -- 172.21.15.177:0/1487597617 learned_addr learned my addr 172.21.15.177:0/1487597617 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-08-31T04:16:39.069 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-31T04:16:39.065+0000 7f17567fc640 1 --2- 172.21.15.177:0/1487597617 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f17581030f0 0x7f175819a250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:16:39.069 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-31T04:16:39.065+0000 7f1756ffd640 1 --2- 172.21.15.177:0/1487597617 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1758102710 0x7f1758199be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:16:39.069 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-31T04:16:39.065+0000 7f17577fe640 1 -- 172.21.15.177:0/1487597617 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f17581030f0 msgr2=0x7f175819a250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:16:39.069 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-31T04:16:39.065+0000 7f17577fe640 1 --2- 172.21.15.177:0/1487597617 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f17581030f0 0x7f175819a250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:16:39.069 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-31T04:16:39.065+0000 7f17577fe640 1 -- 172.21.15.177:0/1487597617 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1758102710 msgr2=0x7f1758199be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:16:39.069 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-31T04:16:39.065+0000 7f17577fe640 1 --2- 172.21.15.177:0/1487597617 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1758102710 0x7f1758199be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:16:39.070 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-31T04:16:39.065+0000 7f17577fe640 1 -- 172.21.15.177:0/1487597617 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f175819b610 con 0x7f1758103d00 2024-08-31T04:16:39.070 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-31T04:16:39.065+0000 7f17577fe640 1 --2- 172.21.15.177:0/1487597617 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1758103d00 0x7f175819adf0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f17500097b0 tx=0x7f1750003c20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:16:39.070 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-31T04:16:39.066+0000 7f173ffff640 1 -- 172.21.15.177:0/1487597617 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1750004240 con 0x7f1758103d00 2024-08-31T04:16:39.070 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-31T04:16:39.066+0000 7f173ffff640 1 -- 172.21.15.177:0/1487597617 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f175002f380 con 0x7f1758103d00 2024-08-31T04:16:39.070 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-31T04:16:39.066+0000 7f173ffff640 1 -- 172.21.15.177:0/1487597617 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f175002fc20 con 0x7f1758103d00 2024-08-31T04:16:39.070 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-31T04:16:39.066+0000 7f1757fff640 1 -- 172.21.15.177:0/1487597617 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f175819b8a0 con 0x7f1758103d00 2024-08-31T04:16:39.070 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-31T04:16:39.066+0000 7f1757fff640 1 -- 172.21.15.177:0/1487597617 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f17581a1e30 con 0x7f1758103d00 2024-08-31T04:16:39.071 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-31T04:16:39.067+0000 7f1757fff640 1 -- 172.21.15.177:0/1487597617 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f17581a2120 con 0x7f1758103d00 2024-08-31T04:16:39.071 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-31T04:16:39.068+0000 7f173ffff640 1 -- 172.21.15.177:0/1487597617 <== mon.1 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 16) ==== 152577+0+0 (secure 0 0 0) 0x7f17500043e0 con 0x7f1758103d00 2024-08-31T04:16:39.071 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-31T04:16:39.069+0000 7f173ffff640 1 --2- 172.21.15.177:0/1487597617 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f17400b4b30 0x7f17400b7040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:16:39.071 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-31T04:16:39.069+0000 7f173ffff640 1 -- 172.21.15.177:0/1487597617 <== mon.1 v2:172.21.15.177:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 3821+0+0 (secure 0 0 0) 0x7f17501057e0 con 0x7f1758103d00 2024-08-31T04:16:39.071 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-31T04:16:39.069+0000 7f1756ffd640 1 --2- 172.21.15.177:0/1487597617 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f17400b4b30 0x7f17400b7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:16:39.072 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-31T04:16:39.070+0000 7f1756ffd640 1 --2- 172.21.15.177:0/1487597617 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f17400b4b30 0x7f17400b7040 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f1748005fd0 tx=0x7f174800b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:16:39.078 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-31T04:16:39.077+0000 7f173ffff640 1 -- 172.21.15.177:0/1487597617 <== mon.1 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f17500cdaa0 con 0x7f1758103d00 2024-08-31T04:16:39.272 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-31T04:16:39.270+0000 7f1757fff640 1 -- 172.21.15.177:0/1487597617 --> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi177:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7f1758101b40 con 0x7f17400b4b30 2024-08-31T04:16:39.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:16:39 smithi133 ceph-mon[22177]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-08-31T04:16:39.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:16:39 smithi133 ceph-mon[22177]: Detected new or changed devices on smithi133 2024-08-31T04:16:39.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:16:39 smithi133 ceph-mon[22177]: Adjusting osd_memory_target on smithi133 to 8544M 2024-08-31T04:16:39.794 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:16:39 smithi133 ceph-mon[22177]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi133", "root=default"]}]': finished 2024-08-31T04:16:39.794 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:16:39 smithi133 ceph-mon[22177]: osdmap e30: 5 total, 4 up, 5 in 2024-08-31T04:16:39.794 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:16:39 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-08-31T04:16:39.794 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:16:39 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-08-31T04:16:39.794 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:16:39 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-31T04:16:39.794 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:16:39 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-31T04:16:39.794 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:16:39 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:16:39.816 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:16:39 smithi177 ceph-mon[22025]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-08-31T04:16:39.816 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:16:39 smithi177 ceph-mon[22025]: Detected new or changed devices on smithi133 2024-08-31T04:16:39.816 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:16:39 smithi177 ceph-mon[22025]: Adjusting osd_memory_target on smithi133 to 8544M 2024-08-31T04:16:39.816 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:16:39 smithi177 ceph-mon[22025]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi133", "root=default"]}]': finished 2024-08-31T04:16:39.817 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:16:39 smithi177 ceph-mon[22025]: osdmap e30: 5 total, 4 up, 5 in 2024-08-31T04:16:39.817 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:16:39 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-08-31T04:16:39.817 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:16:39 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-08-31T04:16:39.817 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:16:39 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-31T04:16:39.817 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:16:39 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-31T04:16:39.817 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:16:39 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:16:39.950 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:16:39 smithi050 ceph-mon[17259]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-08-31T04:16:39.950 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:16:39 smithi050 ceph-mon[17259]: Detected new or changed devices on smithi133 2024-08-31T04:16:39.950 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:16:39 smithi050 ceph-mon[17259]: Adjusting osd_memory_target on smithi133 to 8544M 2024-08-31T04:16:39.950 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:16:39 smithi050 ceph-mon[17259]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi133", "root=default"]}]': finished 2024-08-31T04:16:39.950 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:16:39 smithi050 ceph-mon[17259]: osdmap e30: 5 total, 4 up, 5 in 2024-08-31T04:16:39.950 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:16:39 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-08-31T04:16:39.950 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:16:39 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-08-31T04:16:39.951 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:16:39 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-31T04:16:39.951 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:16:39 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-31T04:16:39.951 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:16:39 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:16:40.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:16:40 smithi133 ceph-mon[22177]: purged_snaps scrub starts 2024-08-31T04:16:40.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:16:40 smithi133 ceph-mon[22177]: purged_snaps scrub ok 2024-08-31T04:16:40.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:16:40 smithi133 ceph-mon[22177]: from='client.24388 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi177:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:16:40.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:16:40 smithi133 ceph-mon[22177]: osd.4 [v2:172.21.15.133:6808/2855333596,v1:172.21.15.133:6809/2855333596] boot 2024-08-31T04:16:40.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:16:40 smithi133 ceph-mon[22177]: osdmap e31: 5 total, 5 up, 5 in 2024-08-31T04:16:40.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:16:40 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-08-31T04:16:40.852 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:16:40 smithi177 ceph-mon[22025]: purged_snaps scrub starts 2024-08-31T04:16:40.852 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:16:40 smithi177 ceph-mon[22025]: purged_snaps scrub ok 2024-08-31T04:16:40.852 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:16:40 smithi177 ceph-mon[22025]: from='client.24388 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi177:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:16:40.852 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:16:40 smithi177 ceph-mon[22025]: osd.4 [v2:172.21.15.133:6808/2855333596,v1:172.21.15.133:6809/2855333596] boot 2024-08-31T04:16:40.852 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:16:40 smithi177 ceph-mon[22025]: osdmap e31: 5 total, 5 up, 5 in 2024-08-31T04:16:40.852 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:16:40 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-08-31T04:16:40.950 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:16:40 smithi050 ceph-mon[17259]: purged_snaps scrub starts 2024-08-31T04:16:40.950 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:16:40 smithi050 ceph-mon[17259]: purged_snaps scrub ok 2024-08-31T04:16:40.950 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:16:40 smithi050 ceph-mon[17259]: from='client.24388 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi177:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:16:40.950 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:16:40 smithi050 ceph-mon[17259]: osd.4 [v2:172.21.15.133:6808/2855333596,v1:172.21.15.133:6809/2855333596] boot 2024-08-31T04:16:40.950 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:16:40 smithi050 ceph-mon[17259]: osdmap e31: 5 total, 5 up, 5 in 2024-08-31T04:16:40.950 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:16:40 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-08-31T04:16:41.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:16:41 smithi177 ceph-mon[22025]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-08-31T04:16:41.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:16:41 smithi177 ceph-mon[22025]: osdmap e32: 5 total, 5 up, 5 in 2024-08-31T04:16:41.792 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:16:41 smithi133 ceph-mon[22177]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-08-31T04:16:41.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:16:41 smithi133 ceph-mon[22177]: osdmap e32: 5 total, 5 up, 5 in 2024-08-31T04:16:41.950 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:16:41 smithi050 ceph-mon[17259]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-08-31T04:16:41.950 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:16:41 smithi050 ceph-mon[17259]: osdmap e32: 5 total, 5 up, 5 in 2024-08-31T04:16:42.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:16:42 smithi133 ceph-mon[22177]: from='client.? 172.21.15.177:0/1199964028' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "83429ff0-ea7d-4fcc-9611-39d9001aa216"} : dispatch 2024-08-31T04:16:42.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:16:42 smithi133 ceph-mon[22177]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "83429ff0-ea7d-4fcc-9611-39d9001aa216"} : dispatch 2024-08-31T04:16:42.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:16:42 smithi133 ceph-mon[22177]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "83429ff0-ea7d-4fcc-9611-39d9001aa216"}]': finished 2024-08-31T04:16:42.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:16:42 smithi133 ceph-mon[22177]: osdmap e33: 6 total, 5 up, 6 in 2024-08-31T04:16:42.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:16:42 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-08-31T04:16:42.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:16:42 smithi133 ceph-mon[22177]: from='client.? 172.21.15.177:0/18501555' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-31T04:16:42.950 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:16:42 smithi050 ceph-mon[17259]: from='client.? 172.21.15.177:0/1199964028' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "83429ff0-ea7d-4fcc-9611-39d9001aa216"} : dispatch 2024-08-31T04:16:42.950 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:16:42 smithi050 ceph-mon[17259]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "83429ff0-ea7d-4fcc-9611-39d9001aa216"} : dispatch 2024-08-31T04:16:42.950 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:16:42 smithi050 ceph-mon[17259]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "83429ff0-ea7d-4fcc-9611-39d9001aa216"}]': finished 2024-08-31T04:16:42.950 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:16:42 smithi050 ceph-mon[17259]: osdmap e33: 6 total, 5 up, 6 in 2024-08-31T04:16:42.950 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:16:42 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-08-31T04:16:42.951 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:16:42 smithi050 ceph-mon[17259]: from='client.? 172.21.15.177:0/18501555' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-31T04:16:42.996 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:16:42 smithi177 ceph-mon[22025]: from='client.? 172.21.15.177:0/1199964028' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "83429ff0-ea7d-4fcc-9611-39d9001aa216"} : dispatch 2024-08-31T04:16:42.996 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:16:42 smithi177 ceph-mon[22025]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "83429ff0-ea7d-4fcc-9611-39d9001aa216"} : dispatch 2024-08-31T04:16:42.996 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:16:42 smithi177 ceph-mon[22025]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "83429ff0-ea7d-4fcc-9611-39d9001aa216"}]': finished 2024-08-31T04:16:42.996 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:16:42 smithi177 ceph-mon[22025]: osdmap e33: 6 total, 5 up, 6 in 2024-08-31T04:16:42.996 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:16:42 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-08-31T04:16:42.996 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:16:42 smithi177 ceph-mon[22025]: from='client.? 172.21.15.177:0/18501555' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-31T04:16:43.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:16:43 smithi133 ceph-mon[22177]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 141 MiB used, 447 GiB / 447 GiB avail 2024-08-31T04:16:43.851 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:16:43 smithi050 ceph-mon[17259]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 141 MiB used, 447 GiB / 447 GiB avail 2024-08-31T04:16:43.897 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:16:43 smithi177 ceph-mon[22025]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 141 MiB used, 447 GiB / 447 GiB avail 2024-08-31T04:16:45.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:16:45 smithi050 ceph-mon[17259]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-08-31T04:16:45.792 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:16:45 smithi133 ceph-mon[22177]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-08-31T04:16:45.996 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:16:45 smithi177 ceph-mon[22025]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-08-31T04:16:46.873 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:16:46 smithi177 ceph-mon[22025]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-08-31T04:16:46.950 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:16:46 smithi050 ceph-mon[17259]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-08-31T04:16:47.042 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:16:46 smithi133 ceph-mon[22177]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-08-31T04:16:48.915 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:16:48 smithi177 ceph-mon[22025]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-08-31T04:16:49.200 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:16:48 smithi050 ceph-mon[17259]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-08-31T04:16:49.293 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:16:48 smithi133 ceph-mon[22177]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-08-31T04:16:51.200 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:16:50 smithi050 ceph-mon[17259]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-08-31T04:16:51.200 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:16:50 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.5"} : dispatch 2024-08-31T04:16:51.200 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:16:50 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:16:51.200 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:16:50 smithi050 ceph-mon[17259]: Deploying daemon osd.5 on smithi177 2024-08-31T04:16:51.246 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:16:50 smithi177 ceph-mon[22025]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-08-31T04:16:51.246 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:16:50 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.5"} : dispatch 2024-08-31T04:16:51.246 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:16:50 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:16:51.246 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:16:50 smithi177 ceph-mon[22025]: Deploying daemon osd.5 on smithi177 2024-08-31T04:16:51.293 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:16:50 smithi133 ceph-mon[22177]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-08-31T04:16:51.293 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:16:50 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.5"} : dispatch 2024-08-31T04:16:51.293 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:16:50 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:16:51.293 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:16:50 smithi133 ceph-mon[22177]: Deploying daemon osd.5 on smithi177 2024-08-31T04:16:52.996 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:16:52 smithi177 ceph-mon[22025]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-08-31T04:16:53.200 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:16:52 smithi050 ceph-mon[17259]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-08-31T04:16:53.293 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:16:52 smithi133 ceph-mon[22177]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-08-31T04:16:55.102 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:16:54 smithi177 ceph-mon[22025]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-08-31T04:16:55.200 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:16:54 smithi050 ceph-mon[17259]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-08-31T04:16:55.293 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:16:54 smithi133 ceph-mon[22177]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-08-31T04:16:56.081 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:16:55 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T04:16:56.081 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:16:55 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:16:56.081 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:16:55 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:16:56.200 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:16:55 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T04:16:56.200 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:16:55 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:16:56.200 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:16:55 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:16:56.293 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:16:55 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T04:16:56.293 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:16:55 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:16:56.293 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:16:55 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:16:57.535 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:16:57 smithi177 ceph-mon[22025]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-08-31T04:16:57.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:16:57 smithi050 ceph-mon[17259]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-08-31T04:16:57.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:16:57 smithi133 ceph-mon[22177]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-08-31T04:16:59.052 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-31T04:16:59.050+0000 7f173ffff640 1 -- 172.21.15.177:0/1487597617 <== mgr.14150 v2:172.21.15.50:6800/2146686622 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f1758101b40 con 0x7f17400b4b30 2024-08-31T04:16:59.052 INFO:teuthology.orchestra.run.smithi177.stdout:Created osd(s) 5 on host 'smithi177' 2024-08-31T04:16:59.054 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-31T04:16:59.052+0000 7f1757fff640 1 -- 172.21.15.177:0/1487597617 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f17400b4b30 msgr2=0x7f17400b7040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:16:59.054 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-31T04:16:59.052+0000 7f1757fff640 1 --2- 172.21.15.177:0/1487597617 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f17400b4b30 0x7f17400b7040 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f1748005fd0 tx=0x7f174800b390 comp rx=0 tx=0).stop 2024-08-31T04:16:59.054 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-31T04:16:59.052+0000 7f1757fff640 1 -- 172.21.15.177:0/1487597617 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1758103d00 msgr2=0x7f175819adf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:16:59.054 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-31T04:16:59.052+0000 7f1757fff640 1 --2- 172.21.15.177:0/1487597617 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1758103d00 0x7f175819adf0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f17500097b0 tx=0x7f1750003c20 comp rx=0 tx=0).stop 2024-08-31T04:16:59.055 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-31T04:16:59.053+0000 7f1757fff640 1 -- 172.21.15.177:0/1487597617 shutdown_connections 2024-08-31T04:16:59.055 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-31T04:16:59.053+0000 7f1757fff640 1 --2- 172.21.15.177:0/1487597617 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f17400b4b30 0x7f17400b7040 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:16:59.055 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-31T04:16:59.053+0000 7f1757fff640 1 --2- 172.21.15.177:0/1487597617 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1758103d00 0x7f175819adf0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:16:59.055 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-31T04:16:59.053+0000 7f1757fff640 1 --2- 172.21.15.177:0/1487597617 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f17581030f0 0x7f175819a250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:16:59.055 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-31T04:16:59.053+0000 7f1757fff640 1 --2- 172.21.15.177:0/1487597617 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1758102710 0x7f1758199be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:16:59.055 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-31T04:16:59.053+0000 7f1757fff640 1 -- 172.21.15.177:0/1487597617 >> 172.21.15.177:0/1487597617 conn(0x7f17580fd2f0 msgr2=0x7f1758101430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:16:59.055 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-31T04:16:59.053+0000 7f1757fff640 1 -- 172.21.15.177:0/1487597617 shutdown_connections 2024-08-31T04:16:59.056 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-31T04:16:59.053+0000 7f1757fff640 1 -- 172.21.15.177:0/1487597617 wait complete. 2024-08-31T04:16:59.246 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:16:58 smithi177 ceph-mon[22025]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-08-31T04:16:59.246 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:16:58 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:16:59.246 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:16:58 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:16:59.246 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:16:58 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:16:59.246 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:16:58 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T04:16:59.246 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:16:58 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:16:59.293 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:16:58 smithi133 ceph-mon[22177]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-08-31T04:16:59.293 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:16:58 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:16:59.293 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:16:58 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:16:59.293 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:16:58 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:16:59.293 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:16:58 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T04:16:59.293 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:16:58 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:16:59.450 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:16:58 smithi050 ceph-mon[17259]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-08-31T04:16:59.450 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:16:58 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:16:59.450 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:16:58 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:16:59.450 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:16:58 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:16:59.450 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:16:58 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T04:16:59.450 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:16:58 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:16:59.647 DEBUG:teuthology.orchestra.run.smithi177:osd.5> sudo journalctl -f -n 0 -u ceph-058d9fc6-674f-11ef-bcd4-c7b262605968@osd.5.service 2024-08-31T04:16:59.649 INFO:tasks.cephadm:Deploying osd.6 on smithi050 with /dev/vg_nvme/lv_2... 2024-08-31T04:16:59.649 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 058d9fc6-674f-11ef-bcd4-c7b262605968 -- lvm zap /dev/vg_nvme/lv_2 2024-08-31T04:17:00.034 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:17:00.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:16:59 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T04:17:00.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:16:59 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:17:00.214 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:16:59 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:17:00.293 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:16:59 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T04:17:00.293 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:16:59 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:17:00.293 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:16:59 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:17:00.342 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:16:59 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T04:17:00.343 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:16:59 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:17:00.343 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:16:59 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:17:01.122 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:17:01 smithi177 ceph-mon[22025]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-08-31T04:17:01.418 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:17:01 smithi050 ceph-mon[17259]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-08-31T04:17:01.542 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:17:01 smithi133 ceph-mon[22177]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-08-31T04:17:01.997 INFO:journalctl@ceph.osd.5.smithi177.stdout:Aug 31 04:17:01 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-5[33549]: 2024-08-31T04:17:01.700+0000 7f7b84ba2640 -1 osd.5 0 log_to_monitors true 2024-08-31T04:17:02.200 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:17:02 smithi050 ceph-mon[17259]: from='osd.5 [v2:172.21.15.177:6808/1166415084,v1:172.21.15.177:6809/1166415084]' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-08-31T04:17:02.200 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:17:02 smithi050 ceph-mon[17259]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-08-31T04:17:02.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:17:02 smithi177 ceph-mon[22025]: from='osd.5 [v2:172.21.15.177:6808/1166415084,v1:172.21.15.177:6809/1166415084]' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-08-31T04:17:02.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:17:02 smithi177 ceph-mon[22025]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-08-31T04:17:02.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:17:02 smithi133 ceph-mon[22177]: from='osd.5 [v2:172.21.15.177:6808/1166415084,v1:172.21.15.177:6809/1166415084]' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-08-31T04:17:02.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:17:02 smithi133 ceph-mon[22177]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-08-31T04:17:03.200 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:17:03 smithi050 ceph-mon[17259]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-08-31T04:17:03.200 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:17:03 smithi050 ceph-mon[17259]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-08-31T04:17:03.200 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:17:03 smithi050 ceph-mon[17259]: osdmap e34: 6 total, 5 up, 6 in 2024-08-31T04:17:03.200 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:17:03 smithi050 ceph-mon[17259]: from='osd.5 [v2:172.21.15.177:6808/1166415084,v1:172.21.15.177:6809/1166415084]' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi177", "root=default"]} : dispatch 2024-08-31T04:17:03.200 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:17:03 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-08-31T04:17:03.201 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:17:03 smithi050 ceph-mon[17259]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi177", "root=default"]} : dispatch 2024-08-31T04:17:03.201 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:17:03 smithi050 ceph-mon[17259]: Detected new or changed devices on smithi177 2024-08-31T04:17:03.201 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:17:03 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:17:03.201 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:17:03 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:17:03.201 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:17:03 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-08-31T04:17:03.201 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:17:03 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-08-31T04:17:03.201 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:17:03 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:17:03.201 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:17:03 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:17:03.201 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:17:03 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T04:17:03.201 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:17:03 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:17:03.334 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-08-31T04:17:03.365 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 058d9fc6-674f-11ef-bcd4-c7b262605968 -- ceph orch daemon add osd smithi050:vg_nvme/lv_2 2024-08-31T04:17:03.496 INFO:journalctl@ceph.osd.5.smithi177.stdout:Aug 31 04:17:03 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-5[33549]: 2024-08-31T04:17:03.070+0000 7f7b80b24640 -1 osd.5 0 waiting for initial osdmap 2024-08-31T04:17:03.496 INFO:journalctl@ceph.osd.5.smithi177.stdout:Aug 31 04:17:03 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-5[33549]: 2024-08-31T04:17:03.078+0000 7f7b7c922640 -1 osd.5 35 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-31T04:17:03.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:17:03 smithi177 ceph-mon[22025]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-08-31T04:17:03.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:17:03 smithi177 ceph-mon[22025]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-08-31T04:17:03.497 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:17:03 smithi177 ceph-mon[22025]: osdmap e34: 6 total, 5 up, 6 in 2024-08-31T04:17:03.497 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:17:03 smithi177 ceph-mon[22025]: from='osd.5 [v2:172.21.15.177:6808/1166415084,v1:172.21.15.177:6809/1166415084]' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi177", "root=default"]} : dispatch 2024-08-31T04:17:03.497 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:17:03 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-08-31T04:17:03.497 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:17:03 smithi177 ceph-mon[22025]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi177", "root=default"]} : dispatch 2024-08-31T04:17:03.497 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:17:03 smithi177 ceph-mon[22025]: Detected new or changed devices on smithi177 2024-08-31T04:17:03.497 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:17:03 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:17:03.497 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:17:03 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:17:03.497 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:17:03 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-08-31T04:17:03.497 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:17:03 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-08-31T04:17:03.497 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:17:03 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:17:03.497 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:17:03 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:17:03.497 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:17:03 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T04:17:03.497 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:17:03 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:17:03.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:17:03 smithi133 ceph-mon[22177]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-08-31T04:17:03.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:17:03 smithi133 ceph-mon[22177]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-08-31T04:17:03.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:17:03 smithi133 ceph-mon[22177]: osdmap e34: 6 total, 5 up, 6 in 2024-08-31T04:17:03.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:17:03 smithi133 ceph-mon[22177]: from='osd.5 [v2:172.21.15.177:6808/1166415084,v1:172.21.15.177:6809/1166415084]' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi177", "root=default"]} : dispatch 2024-08-31T04:17:03.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:17:03 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-08-31T04:17:03.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:17:03 smithi133 ceph-mon[22177]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi177", "root=default"]} : dispatch 2024-08-31T04:17:03.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:17:03 smithi133 ceph-mon[22177]: Detected new or changed devices on smithi177 2024-08-31T04:17:03.544 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:17:03 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:17:03.544 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:17:03 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:17:03.544 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:17:03 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-08-31T04:17:03.544 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:17:03 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-08-31T04:17:03.544 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:17:03 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:17:03.544 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:17:03 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:17:03.544 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:17:03 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T04:17:03.544 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:17:03 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:17:03.737 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:17:04.148 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:17:04 smithi050 ceph-mon[17259]: Adjusting osd_memory_target on smithi177 to 8543M 2024-08-31T04:17:04.148 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:17:04 smithi050 ceph-mon[17259]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi177", "root=default"]}]': finished 2024-08-31T04:17:04.148 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:17:04 smithi050 ceph-mon[17259]: osdmap e35: 6 total, 5 up, 6 in 2024-08-31T04:17:04.148 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:17:04 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-08-31T04:17:04.148 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:17:04 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-08-31T04:17:04.330 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:17:04.329+0000 7fdc30000640 1 -- 172.21.15.50:0/2116562739 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdc28107150 msgr2=0x7fdc2810daf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:17:04.331 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:17:04.329+0000 7fdc30000640 1 --2- 172.21.15.50:0/2116562739 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdc28107150 0x7fdc2810daf0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fdc20009ca0 tx=0x7fdc2002a950 comp rx=0 tx=0).stop 2024-08-31T04:17:04.331 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:17:04.329+0000 7fdc30000640 1 -- 172.21.15.50:0/2116562739 shutdown_connections 2024-08-31T04:17:04.331 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:17:04.329+0000 7fdc30000640 1 --2- 172.21.15.50:0/2116562739 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdc281067b0 0x7fdc28106bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:17:04.331 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:17:04.329+0000 7fdc30000640 1 --2- 172.21.15.50:0/2116562739 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdc28107150 0x7fdc2810daf0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:17:04.331 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:17:04.329+0000 7fdc30000640 1 --2- 172.21.15.50:0/2116562739 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdc28105720 0x7fdc28105b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:17:04.331 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:17:04.329+0000 7fdc30000640 1 -- 172.21.15.50:0/2116562739 >> 172.21.15.50:0/2116562739 conn(0x7fdc28101090 msgr2=0x7fdc28103540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:17:04.331 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:17:04.329+0000 7fdc30000640 1 -- 172.21.15.50:0/2116562739 shutdown_connections 2024-08-31T04:17:04.331 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:17:04.329+0000 7fdc30000640 1 -- 172.21.15.50:0/2116562739 wait complete. 2024-08-31T04:17:04.332 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:17:04.330+0000 7fdc30000640 1 Processor -- start 2024-08-31T04:17:04.332 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:17:04.330+0000 7fdc30000640 1 -- start start 2024-08-31T04:17:04.332 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:17:04.330+0000 7fdc30000640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdc28105720 0x7fdc2819bf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:17:04.332 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:17:04.330+0000 7fdc30000640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdc281067b0 0x7fdc2819c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:17:04.332 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:17:04.330+0000 7fdc30000640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdc28107150 0x7fdc2819d170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:17:04.332 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:17:04.331+0000 7fdc30000640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fdc281113c0 con 0x7fdc28107150 2024-08-31T04:17:04.333 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:17:04.331+0000 7fdc30000640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7fdc28111240 con 0x7fdc28105720 2024-08-31T04:17:04.333 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:17:04.331+0000 7fdc30000640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fdc28111540 con 0x7fdc281067b0 2024-08-31T04:17:04.333 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:17:04.331+0000 7fdc2e000640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdc28107150 0x7fdc2819d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:17:04.333 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:17:04.331+0000 7fdc2d600640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdc28105720 0x7fdc2819bf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:17:04.333 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:17:04.331+0000 7fdc2d600640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdc28105720 0x7fdc2819bf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.50:37596/0 (socket says 172.21.15.50:37596) 2024-08-31T04:17:04.333 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:17:04.331+0000 7fdc2cc00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdc281067b0 0x7fdc2819c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:17:04.333 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:17:04.331+0000 7fdc2d600640 1 -- 172.21.15.50:0/3896534117 learned_addr learned my addr 172.21.15.50:0/3896534117 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:17:04.333 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:17:04.331+0000 7fdc2e000640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdc28107150 0x7fdc2819d170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36518/0 (socket says 172.21.15.50:36518) 2024-08-31T04:17:04.334 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:17:04.331+0000 7fdc2d600640 1 -- 172.21.15.50:0/3896534117 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdc281067b0 msgr2=0x7fdc2819c5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:17:04.334 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:17:04.331+0000 7fdc2d600640 1 --2- 172.21.15.50:0/3896534117 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdc281067b0 0x7fdc2819c5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:17:04.334 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:17:04.331+0000 7fdc2d600640 1 -- 172.21.15.50:0/3896534117 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdc28107150 msgr2=0x7fdc2819d170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:17:04.334 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:17:04.331+0000 7fdc2d600640 1 --2- 172.21.15.50:0/3896534117 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdc28107150 0x7fdc2819d170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:17:04.334 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:17:04.331+0000 7fdc2d600640 1 -- 172.21.15.50:0/3896534117 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc2819d990 con 0x7fdc28105720 2024-08-31T04:17:04.334 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:17:04.332+0000 7fdc2d600640 1 --2- 172.21.15.50:0/3896534117 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdc28105720 0x7fdc2819bf60 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fdc1c00e9f0 tx=0x7fdc1c00eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:17:04.334 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:17:04.332+0000 7fdc26000640 1 -- 172.21.15.50:0/3896534117 <== mon.2 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc1c00cd80 con 0x7fdc28105720 2024-08-31T04:17:04.334 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:17:04.332+0000 7fdc26000640 1 -- 172.21.15.50:0/3896534117 <== mon.2 v2:172.21.15.133:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdc1c0108e0 con 0x7fdc28105720 2024-08-31T04:17:04.334 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:17:04.332+0000 7fdc30000640 1 -- 172.21.15.50:0/3896534117 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdc2819dc80 con 0x7fdc28105720 2024-08-31T04:17:04.334 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:17:04.332+0000 7fdc26000640 1 -- 172.21.15.50:0/3896534117 <== mon.2 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc1c018980 con 0x7fdc28105720 2024-08-31T04:17:04.335 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:17:04.332+0000 7fdc30000640 1 -- 172.21.15.50:0/3896534117 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdc281a4380 con 0x7fdc28105720 2024-08-31T04:17:04.335 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:17:04.333+0000 7fdc30000640 1 -- 172.21.15.50:0/3896534117 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdc2810c8e0 con 0x7fdc28105720 2024-08-31T04:17:04.337 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:17:04.336+0000 7fdc26000640 1 -- 172.21.15.50:0/3896534117 <== mon.2 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 16) ==== 152577+0+0 (secure 0 0 0) 0x7fdc1c010430 con 0x7fdc28105720 2024-08-31T04:17:04.338 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:17:04.337+0000 7fdc26000640 1 --2- 172.21.15.50:0/3896534117 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fdc100b4bb0 0x7fdc100b70c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:17:04.338 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:17:04.337+0000 7fdc26000640 1 -- 172.21.15.50:0/3896534117 <== mon.2 v2:172.21.15.133:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 4566+0+0 (secure 0 0 0) 0x7fdc1c0e45c0 con 0x7fdc28105720 2024-08-31T04:17:04.338 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:17:04.337+0000 7fdc2cc00640 1 --2- 172.21.15.50:0/3896534117 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fdc100b4bb0 0x7fdc100b70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:17:04.339 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:17:04.338+0000 7fdc2cc00640 1 --2- 172.21.15.50:0/3896534117 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fdc100b4bb0 0x7fdc100b70c0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fdc14009bd0 tx=0x7fdc14005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:17:04.342 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:17:04.341+0000 7fdc26000640 1 -- 172.21.15.50:0/3896534117 <== mon.2 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fdc1c0abea0 con 0x7fdc28105720 2024-08-31T04:17:04.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:17:04 smithi177 ceph-mon[22025]: Adjusting osd_memory_target on smithi177 to 8543M 2024-08-31T04:17:04.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:17:04 smithi177 ceph-mon[22025]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi177", "root=default"]}]': finished 2024-08-31T04:17:04.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:17:04 smithi177 ceph-mon[22025]: osdmap e35: 6 total, 5 up, 6 in 2024-08-31T04:17:04.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:17:04 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-08-31T04:17:04.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:17:04 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-08-31T04:17:04.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:17:04 smithi133 ceph-mon[22177]: Adjusting osd_memory_target on smithi177 to 8543M 2024-08-31T04:17:04.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:17:04 smithi133 ceph-mon[22177]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi177", "root=default"]}]': finished 2024-08-31T04:17:04.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:17:04 smithi133 ceph-mon[22177]: osdmap e35: 6 total, 5 up, 6 in 2024-08-31T04:17:04.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:17:04 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-08-31T04:17:04.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:17:04 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-08-31T04:17:04.548 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:17:04.546+0000 7fdc30000640 1 -- 172.21.15.50:0/3896534117 --> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi050:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7fdc280635a0 con 0x7fdc100b4bb0 2024-08-31T04:17:05.426 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:17:05 smithi050 ceph-mon[17259]: purged_snaps scrub starts 2024-08-31T04:17:05.426 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:17:05 smithi050 ceph-mon[17259]: purged_snaps scrub ok 2024-08-31T04:17:05.426 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:17:05 smithi050 ceph-mon[17259]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-08-31T04:17:05.426 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:17:05 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-08-31T04:17:05.426 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:17:05 smithi050 ceph-mon[17259]: osd.5 [v2:172.21.15.177:6808/1166415084,v1:172.21.15.177:6809/1166415084] boot 2024-08-31T04:17:05.426 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:17:05 smithi050 ceph-mon[17259]: osdmap e36: 6 total, 6 up, 6 in 2024-08-31T04:17:05.426 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:17:05 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-08-31T04:17:05.426 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:17:05 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-31T04:17:05.426 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:17:05 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-31T04:17:05.426 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:17:05 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:17:05.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:17:05 smithi177 ceph-mon[22025]: purged_snaps scrub starts 2024-08-31T04:17:05.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:17:05 smithi177 ceph-mon[22025]: purged_snaps scrub ok 2024-08-31T04:17:05.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:17:05 smithi177 ceph-mon[22025]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-08-31T04:17:05.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:17:05 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-08-31T04:17:05.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:17:05 smithi177 ceph-mon[22025]: osd.5 [v2:172.21.15.177:6808/1166415084,v1:172.21.15.177:6809/1166415084] boot 2024-08-31T04:17:05.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:17:05 smithi177 ceph-mon[22025]: osdmap e36: 6 total, 6 up, 6 in 2024-08-31T04:17:05.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:17:05 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-08-31T04:17:05.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:17:05 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-31T04:17:05.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:17:05 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-31T04:17:05.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:17:05 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:17:05.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:17:05 smithi133 ceph-mon[22177]: purged_snaps scrub starts 2024-08-31T04:17:05.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:17:05 smithi133 ceph-mon[22177]: purged_snaps scrub ok 2024-08-31T04:17:05.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:17:05 smithi133 ceph-mon[22177]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-08-31T04:17:05.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:17:05 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-08-31T04:17:05.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:17:05 smithi133 ceph-mon[22177]: osd.5 [v2:172.21.15.177:6808/1166415084,v1:172.21.15.177:6809/1166415084] boot 2024-08-31T04:17:05.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:17:05 smithi133 ceph-mon[22177]: osdmap e36: 6 total, 6 up, 6 in 2024-08-31T04:17:05.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:17:05 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-08-31T04:17:05.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:17:05 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-31T04:17:05.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:17:05 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-31T04:17:05.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:17:05 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:17:06.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:17:06 smithi050 ceph-mon[17259]: from='client.24404 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi050:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:17:06.194 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:17:06 smithi050 ceph-mon[17259]: osdmap e37: 6 total, 6 up, 6 in 2024-08-31T04:17:06.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:17:06 smithi177 ceph-mon[22025]: from='client.24404 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi050:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:17:06.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:17:06 smithi177 ceph-mon[22025]: osdmap e37: 6 total, 6 up, 6 in 2024-08-31T04:17:06.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:17:06 smithi133 ceph-mon[22177]: from='client.24404 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi050:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:17:06.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:17:06 smithi133 ceph-mon[22177]: osdmap e37: 6 total, 6 up, 6 in 2024-08-31T04:17:07.200 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:17:07 smithi050 ceph-mon[17259]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 168 MiB used, 536 GiB / 536 GiB avail 2024-08-31T04:17:07.200 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:17:07 smithi050 ceph-mon[17259]: osdmap e38: 6 total, 6 up, 6 in 2024-08-31T04:17:07.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:17:07 smithi177 ceph-mon[22025]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 168 MiB used, 536 GiB / 536 GiB avail 2024-08-31T04:17:07.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:17:07 smithi177 ceph-mon[22025]: osdmap e38: 6 total, 6 up, 6 in 2024-08-31T04:17:07.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:17:07 smithi133 ceph-mon[22177]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 168 MiB used, 536 GiB / 536 GiB avail 2024-08-31T04:17:07.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:17:07 smithi133 ceph-mon[22177]: osdmap e38: 6 total, 6 up, 6 in 2024-08-31T04:17:08.450 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:17:08 smithi050 ceph-mon[17259]: from='client.? 172.21.15.50:0/312534966' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "eeb571ef-5e43-4816-95dd-d01d83aeca83"} : dispatch 2024-08-31T04:17:08.450 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:17:08 smithi050 ceph-mon[17259]: from='client.? 172.21.15.50:0/312534966' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "eeb571ef-5e43-4816-95dd-d01d83aeca83"}]': finished 2024-08-31T04:17:08.450 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:17:08 smithi050 ceph-mon[17259]: osdmap e39: 7 total, 6 up, 7 in 2024-08-31T04:17:08.450 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:17:08 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-08-31T04:17:08.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:17:08 smithi177 ceph-mon[22025]: from='client.? 172.21.15.50:0/312534966' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "eeb571ef-5e43-4816-95dd-d01d83aeca83"} : dispatch 2024-08-31T04:17:08.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:17:08 smithi177 ceph-mon[22025]: from='client.? 172.21.15.50:0/312534966' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "eeb571ef-5e43-4816-95dd-d01d83aeca83"}]': finished 2024-08-31T04:17:08.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:17:08 smithi177 ceph-mon[22025]: osdmap e39: 7 total, 6 up, 7 in 2024-08-31T04:17:08.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:17:08 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-08-31T04:17:08.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:17:08 smithi133 ceph-mon[22177]: from='client.? 172.21.15.50:0/312534966' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "eeb571ef-5e43-4816-95dd-d01d83aeca83"} : dispatch 2024-08-31T04:17:08.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:17:08 smithi133 ceph-mon[22177]: from='client.? 172.21.15.50:0/312534966' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "eeb571ef-5e43-4816-95dd-d01d83aeca83"}]': finished 2024-08-31T04:17:08.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:17:08 smithi133 ceph-mon[22177]: osdmap e39: 7 total, 6 up, 7 in 2024-08-31T04:17:08.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:17:08 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-08-31T04:17:09.450 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:17:09 smithi050 ceph-mon[17259]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail; 122 KiB/s, 0 objects/s recovering 2024-08-31T04:17:09.450 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:17:09 smithi050 ceph-mon[17259]: from='client.? 172.21.15.50:0/510532685' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-31T04:17:09.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:17:09 smithi177 ceph-mon[22025]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail; 122 KiB/s, 0 objects/s recovering 2024-08-31T04:17:09.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:17:09 smithi177 ceph-mon[22025]: from='client.? 172.21.15.50:0/510532685' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-31T04:17:09.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:17:09 smithi133 ceph-mon[22177]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail; 122 KiB/s, 0 objects/s recovering 2024-08-31T04:17:09.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:17:09 smithi133 ceph-mon[22177]: from='client.? 172.21.15.50:0/510532685' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-31T04:17:11.450 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:17:11 smithi050 ceph-mon[17259]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail; 101 KiB/s, 0 objects/s recovering 2024-08-31T04:17:11.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:17:11 smithi177 ceph-mon[22025]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail; 101 KiB/s, 0 objects/s recovering 2024-08-31T04:17:11.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:17:11 smithi133 ceph-mon[22177]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail; 101 KiB/s, 0 objects/s recovering 2024-08-31T04:17:13.373 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:17:13 smithi050 ceph-mon[17259]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail; 86 KiB/s, 0 objects/s recovering 2024-08-31T04:17:13.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:17:13 smithi177 ceph-mon[22025]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail; 86 KiB/s, 0 objects/s recovering 2024-08-31T04:17:13.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:17:13 smithi133 ceph-mon[22177]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail; 86 KiB/s, 0 objects/s recovering 2024-08-31T04:17:15.450 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:17:15 smithi050 ceph-mon[17259]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-08-31T04:17:15.495 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:17:15 smithi177 ceph-mon[22025]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-08-31T04:17:15.542 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:17:15 smithi133 ceph-mon[22177]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-08-31T04:17:17.200 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:17:17 smithi050 ceph-mon[17259]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail; 59 KiB/s, 0 objects/s recovering 2024-08-31T04:17:17.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:17:17 smithi177 ceph-mon[22025]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail; 59 KiB/s, 0 objects/s recovering 2024-08-31T04:17:17.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:17:17 smithi133 ceph-mon[22177]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail; 59 KiB/s, 0 objects/s recovering 2024-08-31T04:17:18.287 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:17:18 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.6"} : dispatch 2024-08-31T04:17:18.287 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:17:18 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:17:18.287 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:17:18 smithi050 ceph-mon[17259]: Deploying daemon osd.6 on smithi050 2024-08-31T04:17:18.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:17:18 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.6"} : dispatch 2024-08-31T04:17:18.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:17:18 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:17:18.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:17:18 smithi177 ceph-mon[22025]: Deploying daemon osd.6 on smithi050 2024-08-31T04:17:18.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:17:18 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.6"} : dispatch 2024-08-31T04:17:18.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:17:18 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:17:18.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:17:18 smithi133 ceph-mon[22177]: Deploying daemon osd.6 on smithi050 2024-08-31T04:17:19.404 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:17:19 smithi050 ceph-mon[17259]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-08-31T04:17:19.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:17:19 smithi177 ceph-mon[22025]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-08-31T04:17:19.542 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:17:19 smithi133 ceph-mon[22177]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-08-31T04:17:21.200 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:17:21 smithi050 ceph-mon[17259]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-08-31T04:17:21.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:17:21 smithi177 ceph-mon[22025]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-08-31T04:17:21.542 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:17:21 smithi133 ceph-mon[22177]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-08-31T04:17:23.450 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:17:23 smithi050 ceph-mon[17259]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-08-31T04:17:23.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:17:23 smithi177 ceph-mon[22025]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-08-31T04:17:23.542 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:17:23 smithi133 ceph-mon[22177]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-08-31T04:17:25.437 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:17:25 smithi050 ceph-mon[17259]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-08-31T04:17:25.437 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:17:25 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T04:17:25.437 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:17:25 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:17:25.438 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:17:25 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:17:25.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:17:25 smithi177 ceph-mon[22025]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-08-31T04:17:25.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:17:25 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T04:17:25.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:17:25 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:17:25.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:17:25 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:17:25.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:17:25 smithi133 ceph-mon[22177]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-08-31T04:17:25.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:17:25 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T04:17:25.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:17:25 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:17:25.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:17:25 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:17:27.401 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:17:27 smithi050 ceph-mon[17259]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-08-31T04:17:27.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:17:27 smithi177 ceph-mon[22025]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-08-31T04:17:27.542 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:17:27 smithi133 ceph-mon[22177]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-08-31T04:17:29.450 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:17:29 smithi050 ceph-mon[17259]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-08-31T04:17:29.450 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:17:29 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:17:29.450 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:17:29 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:17:29.450 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:17:29 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:17:29.451 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:17:29 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T04:17:29.451 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:17:29 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:17:29.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:17:29 smithi177 ceph-mon[22025]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-08-31T04:17:29.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:17:29 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:17:29.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:17:29 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:17:29.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:17:29 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:17:29.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:17:29 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T04:17:29.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:17:29 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:17:29.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:17:29 smithi133 ceph-mon[22177]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-08-31T04:17:29.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:17:29 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:17:29.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:17:29 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:17:29.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:17:29 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:17:29.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:17:29 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T04:17:29.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:17:29 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:17:30.040 INFO:teuthology.orchestra.run.smithi050.stdout:Created osd(s) 6 on host 'smithi050' 2024-08-31T04:17:30.041 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:17:30.038+0000 7fdc26000640 1 -- 172.21.15.50:0/3896534117 <== mgr.14150 v2:172.21.15.50:6800/2146686622 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fdc280635a0 con 0x7fdc100b4bb0 2024-08-31T04:17:30.043 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:17:30.042+0000 7fdc30000640 1 -- 172.21.15.50:0/3896534117 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fdc100b4bb0 msgr2=0x7fdc100b70c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:17:30.043 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:17:30.042+0000 7fdc30000640 1 --2- 172.21.15.50:0/3896534117 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fdc100b4bb0 0x7fdc100b70c0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fdc14009bd0 tx=0x7fdc14005f90 comp rx=0 tx=0).stop 2024-08-31T04:17:30.044 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:17:30.042+0000 7fdc30000640 1 -- 172.21.15.50:0/3896534117 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdc28105720 msgr2=0x7fdc2819bf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:17:30.044 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:17:30.042+0000 7fdc30000640 1 --2- 172.21.15.50:0/3896534117 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdc28105720 0x7fdc2819bf60 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fdc1c00e9f0 tx=0x7fdc1c00eeb0 comp rx=0 tx=0).stop 2024-08-31T04:17:30.044 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:17:30.042+0000 7fdc30000640 1 -- 172.21.15.50:0/3896534117 shutdown_connections 2024-08-31T04:17:30.044 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:17:30.042+0000 7fdc30000640 1 --2- 172.21.15.50:0/3896534117 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fdc100b4bb0 0x7fdc100b70c0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:17:30.044 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:17:30.042+0000 7fdc30000640 1 --2- 172.21.15.50:0/3896534117 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdc281067b0 0x7fdc2819c5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:17:30.044 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:17:30.042+0000 7fdc30000640 1 --2- 172.21.15.50:0/3896534117 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdc28107150 0x7fdc2819d170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:17:30.044 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:17:30.042+0000 7fdc30000640 1 --2- 172.21.15.50:0/3896534117 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdc28105720 0x7fdc2819bf60 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:17:30.044 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:17:30.042+0000 7fdc30000640 1 -- 172.21.15.50:0/3896534117 >> 172.21.15.50:0/3896534117 conn(0x7fdc28101090 msgr2=0x7fdc28109ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:17:30.044 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:17:30.042+0000 7fdc30000640 1 -- 172.21.15.50:0/3896534117 shutdown_connections 2024-08-31T04:17:30.044 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:17:30.042+0000 7fdc30000640 1 -- 172.21.15.50:0/3896534117 wait complete. 2024-08-31T04:17:30.397 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:17:30 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T04:17:30.397 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:17:30 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:17:30.397 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:17:30 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:17:30.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:17:30 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T04:17:30.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:17:30 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:17:30.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:17:30 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:17:30.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:17:30 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T04:17:30.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:17:30 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:17:30.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:17:30 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:17:30.792 DEBUG:teuthology.orchestra.run.smithi050:osd.6> sudo journalctl -f -n 0 -u ceph-058d9fc6-674f-11ef-bcd4-c7b262605968@osd.6.service 2024-08-31T04:17:30.796 INFO:tasks.cephadm:Deploying osd.7 on smithi133 with /dev/vg_nvme/lv_2... 2024-08-31T04:17:30.796 DEBUG:teuthology.orchestra.run.smithi133:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 058d9fc6-674f-11ef-bcd4-c7b262605968 -- lvm zap /dev/vg_nvme/lv_2 2024-08-31T04:17:31.052 INFO:teuthology.orchestra.run.smithi133.stderr:Inferring config /var/lib/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/mon.b/config 2024-08-31T04:17:31.283 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:17:31 smithi050 ceph-mon[17259]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-08-31T04:17:31.283 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:17:31 smithi050 ceph-mon[17259]: from='osd.6 [v2:172.21.15.50:6818/1429341184,v1:172.21.15.50:6819/1429341184]' entity='osd.6' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]} : dispatch 2024-08-31T04:17:31.487 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:17:31 smithi133 ceph-mon[22177]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-08-31T04:17:31.487 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:17:31 smithi133 ceph-mon[22177]: from='osd.6 [v2:172.21.15.50:6818/1429341184,v1:172.21.15.50:6819/1429341184]' entity='osd.6' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]} : dispatch 2024-08-31T04:17:31.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:17:31 smithi177 ceph-mon[22025]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-08-31T04:17:31.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:17:31 smithi177 ceph-mon[22025]: from='osd.6 [v2:172.21.15.50:6818/1429341184,v1:172.21.15.50:6819/1429341184]' entity='osd.6' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]} : dispatch 2024-08-31T04:17:32.245 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:17:32 smithi050 ceph-mon[17259]: from='osd.6 [v2:172.21.15.50:6818/1429341184,v1:172.21.15.50:6819/1429341184]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-08-31T04:17:32.246 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:17:32 smithi050 ceph-mon[17259]: osdmap e40: 7 total, 6 up, 7 in 2024-08-31T04:17:32.246 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:17:32 smithi050 ceph-mon[17259]: from='osd.6 [v2:172.21.15.50:6818/1429341184,v1:172.21.15.50:6819/1429341184]' entity='osd.6' cmd={"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi050", "root=default"]} : dispatch 2024-08-31T04:17:32.246 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:17:32 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-08-31T04:17:32.246 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:17:32 smithi050 ceph-mon[17259]: from='osd.6 [v2:172.21.15.50:6818/1429341184,v1:172.21.15.50:6819/1429341184]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi050", "root=default"]}]': finished 2024-08-31T04:17:32.380 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:17:32 smithi133 ceph-mon[22177]: from='osd.6 [v2:172.21.15.50:6818/1429341184,v1:172.21.15.50:6819/1429341184]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-08-31T04:17:32.380 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:17:32 smithi133 ceph-mon[22177]: osdmap e40: 7 total, 6 up, 7 in 2024-08-31T04:17:32.380 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:17:32 smithi133 ceph-mon[22177]: from='osd.6 [v2:172.21.15.50:6818/1429341184,v1:172.21.15.50:6819/1429341184]' entity='osd.6' cmd={"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi050", "root=default"]} : dispatch 2024-08-31T04:17:32.380 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:17:32 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-08-31T04:17:32.380 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:17:32 smithi133 ceph-mon[22177]: from='osd.6 [v2:172.21.15.50:6818/1429341184,v1:172.21.15.50:6819/1429341184]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi050", "root=default"]}]': finished 2024-08-31T04:17:32.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:17:32 smithi177 ceph-mon[22025]: from='osd.6 [v2:172.21.15.50:6818/1429341184,v1:172.21.15.50:6819/1429341184]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-08-31T04:17:32.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:17:32 smithi177 ceph-mon[22025]: osdmap e40: 7 total, 6 up, 7 in 2024-08-31T04:17:32.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:17:32 smithi177 ceph-mon[22025]: from='osd.6 [v2:172.21.15.50:6818/1429341184,v1:172.21.15.50:6819/1429341184]' entity='osd.6' cmd={"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi050", "root=default"]} : dispatch 2024-08-31T04:17:32.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:17:32 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-08-31T04:17:32.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:17:32 smithi177 ceph-mon[22025]: from='osd.6 [v2:172.21.15.50:6818/1429341184,v1:172.21.15.50:6819/1429341184]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi050", "root=default"]}]': finished 2024-08-31T04:17:32.951 INFO:journalctl@ceph.osd.6.smithi050.stdout:Aug 31 04:17:32 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-6[46267]: 2024-08-31T04:17:32.724+0000 7efc6fc00640 -1 osd.6 0 waiting for initial osdmap 2024-08-31T04:17:32.951 INFO:journalctl@ceph.osd.6.smithi050.stdout:Aug 31 04:17:32 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-6[46267]: 2024-08-31T04:17:32.762+0000 7efc65c00640 -1 osd.6 41 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-31T04:17:33.425 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-08-31T04:17:33.448 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:17:33 smithi133 ceph-mon[22177]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-08-31T04:17:33.448 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:17:33 smithi133 ceph-mon[22177]: osdmap e41: 7 total, 6 up, 7 in 2024-08-31T04:17:33.448 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:17:33 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-08-31T04:17:33.448 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:17:33 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-08-31T04:17:33.448 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:17:33 smithi133 ceph-mon[22177]: from='osd.6 [v2:172.21.15.50:6818/1429341184,v1:172.21.15.50:6819/1429341184]' entity='osd.6' 2024-08-31T04:17:33.450 DEBUG:teuthology.orchestra.run.smithi133:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 058d9fc6-674f-11ef-bcd4-c7b262605968 -- ceph orch daemon add osd smithi133:vg_nvme/lv_2 2024-08-31T04:17:33.450 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:17:33 smithi050 ceph-mon[17259]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-08-31T04:17:33.450 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:17:33 smithi050 ceph-mon[17259]: osdmap e41: 7 total, 6 up, 7 in 2024-08-31T04:17:33.450 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:17:33 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-08-31T04:17:33.451 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:17:33 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-08-31T04:17:33.451 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:17:33 smithi050 ceph-mon[17259]: from='osd.6 [v2:172.21.15.50:6818/1429341184,v1:172.21.15.50:6819/1429341184]' entity='osd.6' 2024-08-31T04:17:33.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:17:33 smithi177 ceph-mon[22025]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-08-31T04:17:33.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:17:33 smithi177 ceph-mon[22025]: osdmap e41: 7 total, 6 up, 7 in 2024-08-31T04:17:33.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:17:33 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-08-31T04:17:33.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:17:33 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-08-31T04:17:33.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:17:33 smithi177 ceph-mon[22025]: from='osd.6 [v2:172.21.15.50:6818/1429341184,v1:172.21.15.50:6819/1429341184]' entity='osd.6' 2024-08-31T04:17:33.710 INFO:teuthology.orchestra.run.smithi133.stderr:Inferring config /var/lib/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/mon.b/config 2024-08-31T04:17:34.191 INFO:teuthology.orchestra.run.smithi133.stderr:2024-08-31T04:17:34.188+0000 7fd43ad89640 1 -- 172.21.15.133:0/2296086381 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd434109260 msgr2=0x7fd43410b770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:17:34.192 INFO:teuthology.orchestra.run.smithi133.stderr:2024-08-31T04:17:34.188+0000 7fd43ad89640 1 --2- 172.21.15.133:0/2296086381 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd434109260 0x7fd43410b770 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fd42c009ca0 tx=0x7fd42c02a8c0 comp rx=0 tx=0).stop 2024-08-31T04:17:34.192 INFO:teuthology.orchestra.run.smithi133.stderr:2024-08-31T04:17:34.188+0000 7fd43ad89640 1 -- 172.21.15.133:0/2296086381 shutdown_connections 2024-08-31T04:17:34.192 INFO:teuthology.orchestra.run.smithi133.stderr:2024-08-31T04:17:34.188+0000 7fd43ad89640 1 --2- 172.21.15.133:0/2296086381 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd4341066c0 0x7fd434108b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:17:34.192 INFO:teuthology.orchestra.run.smithi133.stderr:2024-08-31T04:17:34.188+0000 7fd43ad89640 1 --2- 172.21.15.133:0/2296086381 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd434109260 0x7fd43410b770 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:17:34.192 INFO:teuthology.orchestra.run.smithi133.stderr:2024-08-31T04:17:34.188+0000 7fd43ad89640 1 --2- 172.21.15.133:0/2296086381 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd43406c0e0 0x7fd434106180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:17:34.192 INFO:teuthology.orchestra.run.smithi133.stderr:2024-08-31T04:17:34.188+0000 7fd43ad89640 1 -- 172.21.15.133:0/2296086381 >> 172.21.15.133:0/2296086381 conn(0x7fd4340fdda0 msgr2=0x7fd434100250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:17:34.192 INFO:teuthology.orchestra.run.smithi133.stderr:2024-08-31T04:17:34.188+0000 7fd43ad89640 1 -- 172.21.15.133:0/2296086381 shutdown_connections 2024-08-31T04:17:34.192 INFO:teuthology.orchestra.run.smithi133.stderr:2024-08-31T04:17:34.188+0000 7fd43ad89640 1 -- 172.21.15.133:0/2296086381 wait complete. 2024-08-31T04:17:34.192 INFO:teuthology.orchestra.run.smithi133.stderr:2024-08-31T04:17:34.189+0000 7fd43ad89640 1 Processor -- start 2024-08-31T04:17:34.192 INFO:teuthology.orchestra.run.smithi133.stderr:2024-08-31T04:17:34.189+0000 7fd43ad89640 1 -- start start 2024-08-31T04:17:34.192 INFO:teuthology.orchestra.run.smithi133.stderr:2024-08-31T04:17:34.189+0000 7fd43ad89640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd43406c0e0 0x7fd434199cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:17:34.193 INFO:teuthology.orchestra.run.smithi133.stderr:2024-08-31T04:17:34.189+0000 7fd43ad89640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd4341066c0 0x7fd43419a330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:17:34.193 INFO:teuthology.orchestra.run.smithi133.stderr:2024-08-31T04:17:34.189+0000 7fd43ad89640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd434109260 0x7fd43419aed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:17:34.193 INFO:teuthology.orchestra.run.smithi133.stderr:2024-08-31T04:17:34.189+0000 7fd43ad89640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fd43410f150 con 0x7fd4341066c0 2024-08-31T04:17:34.193 INFO:teuthology.orchestra.run.smithi133.stderr:2024-08-31T04:17:34.189+0000 7fd43ad89640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7fd43410efd0 con 0x7fd434109260 2024-08-31T04:17:34.193 INFO:teuthology.orchestra.run.smithi133.stderr:2024-08-31T04:17:34.189+0000 7fd43ad89640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fd43410f2d0 con 0x7fd43406c0e0 2024-08-31T04:17:34.193 INFO:teuthology.orchestra.run.smithi133.stderr:2024-08-31T04:17:34.189+0000 7fd439326640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd434109260 0x7fd43419aed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:17:34.193 INFO:teuthology.orchestra.run.smithi133.stderr:2024-08-31T04:17:34.189+0000 7fd439326640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd434109260 0x7fd43419aed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:57562/0 (socket says 172.21.15.133:57562) 2024-08-31T04:17:34.193 INFO:teuthology.orchestra.run.smithi133.stderr:2024-08-31T04:17:34.189+0000 7fd439326640 1 -- 172.21.15.133:0/840684605 learned_addr learned my addr 172.21.15.133:0/840684605 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-08-31T04:17:34.193 INFO:teuthology.orchestra.run.smithi133.stderr:2024-08-31T04:17:34.189+0000 7fd433fff640 1 --2- 172.21.15.133:0/840684605 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd4341066c0 0x7fd43419a330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:17:34.193 INFO:teuthology.orchestra.run.smithi133.stderr:2024-08-31T04:17:34.189+0000 7fd438b25640 1 --2- 172.21.15.133:0/840684605 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd43406c0e0 0x7fd434199cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:17:34.193 INFO:teuthology.orchestra.run.smithi133.stderr:2024-08-31T04:17:34.190+0000 7fd439326640 1 -- 172.21.15.133:0/840684605 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd43406c0e0 msgr2=0x7fd434199cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:17:34.193 INFO:teuthology.orchestra.run.smithi133.stderr:2024-08-31T04:17:34.190+0000 7fd439326640 1 --2- 172.21.15.133:0/840684605 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd43406c0e0 0x7fd434199cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:17:34.193 INFO:teuthology.orchestra.run.smithi133.stderr:2024-08-31T04:17:34.190+0000 7fd439326640 1 -- 172.21.15.133:0/840684605 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd4341066c0 msgr2=0x7fd43419a330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:17:34.193 INFO:teuthology.orchestra.run.smithi133.stderr:2024-08-31T04:17:34.190+0000 7fd439326640 1 --2- 172.21.15.133:0/840684605 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd4341066c0 0x7fd43419a330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:17:34.194 INFO:teuthology.orchestra.run.smithi133.stderr:2024-08-31T04:17:34.190+0000 7fd439326640 1 -- 172.21.15.133:0/840684605 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd43419b660 con 0x7fd434109260 2024-08-31T04:17:34.194 INFO:teuthology.orchestra.run.smithi133.stderr:2024-08-31T04:17:34.190+0000 7fd439326640 1 --2- 172.21.15.133:0/840684605 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd434109260 0x7fd43419aed0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fd42c0097b0 tx=0x7fd42c003c20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:17:34.194 INFO:teuthology.orchestra.run.smithi133.stderr:2024-08-31T04:17:34.190+0000 7fd431ffb640 1 -- 172.21.15.133:0/840684605 <== mon.2 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd42c004240 con 0x7fd434109260 2024-08-31T04:17:34.194 INFO:teuthology.orchestra.run.smithi133.stderr:2024-08-31T04:17:34.190+0000 7fd431ffb640 1 -- 172.21.15.133:0/840684605 <== mon.2 v2:172.21.15.133:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd42c02f380 con 0x7fd434109260 2024-08-31T04:17:34.194 INFO:teuthology.orchestra.run.smithi133.stderr:2024-08-31T04:17:34.190+0000 7fd43ad89640 1 -- 172.21.15.133:0/840684605 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd43419b8f0 con 0x7fd434109260 2024-08-31T04:17:34.194 INFO:teuthology.orchestra.run.smithi133.stderr:2024-08-31T04:17:34.190+0000 7fd431ffb640 1 -- 172.21.15.133:0/840684605 <== mon.2 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd42c02fc20 con 0x7fd434109260 2024-08-31T04:17:34.194 INFO:teuthology.orchestra.run.smithi133.stderr:2024-08-31T04:17:34.190+0000 7fd43ad89640 1 -- 172.21.15.133:0/840684605 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd4341a1f10 con 0x7fd434109260 2024-08-31T04:17:34.194 INFO:teuthology.orchestra.run.smithi133.stderr:2024-08-31T04:17:34.192+0000 7fd43ad89640 1 -- 172.21.15.133:0/840684605 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd4340ff8c0 con 0x7fd434109260 2024-08-31T04:17:34.195 INFO:teuthology.orchestra.run.smithi133.stderr:2024-08-31T04:17:34.193+0000 7fd431ffb640 1 -- 172.21.15.133:0/840684605 <== mon.2 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 16) ==== 152577+0+0 (secure 0 0 0) 0x7fd42c0043e0 con 0x7fd434109260 2024-08-31T04:17:34.195 INFO:teuthology.orchestra.run.smithi133.stderr:2024-08-31T04:17:34.194+0000 7fd431ffb640 1 --2- 172.21.15.133:0/840684605 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fd4240b4b30 0x7fd4240b7040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:17:34.195 INFO:teuthology.orchestra.run.smithi133.stderr:2024-08-31T04:17:34.194+0000 7fd438b25640 1 --2- 172.21.15.133:0/840684605 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fd4240b4b30 0x7fd4240b7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:17:34.196 INFO:teuthology.orchestra.run.smithi133.stderr:2024-08-31T04:17:34.194+0000 7fd431ffb640 1 -- 172.21.15.133:0/840684605 <== mon.2 v2:172.21.15.133:3300/0 5 ==== osd_map(42..42 src has 1..42) ==== 4965+0+0 (secure 0 0 0) 0x7fd42c105c80 con 0x7fd434109260 2024-08-31T04:17:34.196 INFO:teuthology.orchestra.run.smithi133.stderr:2024-08-31T04:17:34.195+0000 7fd438b25640 1 --2- 172.21.15.133:0/840684605 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fd4240b4b30 0x7fd4240b7040 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fd42800bbe0 tx=0x7fd42800b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:17:34.199 INFO:teuthology.orchestra.run.smithi133.stderr:2024-08-31T04:17:34.197+0000 7fd431ffb640 1 -- 172.21.15.133:0/840684605 <== mon.2 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fd42c0cdaa0 con 0x7fd434109260 2024-08-31T04:17:34.365 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:17:34 smithi050 ceph-mon[17259]: purged_snaps scrub starts 2024-08-31T04:17:34.365 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:17:34 smithi050 ceph-mon[17259]: purged_snaps scrub ok 2024-08-31T04:17:34.365 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:17:34 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-08-31T04:17:34.365 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:17:34 smithi050 ceph-mon[17259]: osd.6 [v2:172.21.15.50:6818/1429341184,v1:172.21.15.50:6819/1429341184] boot 2024-08-31T04:17:34.365 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:17:34 smithi050 ceph-mon[17259]: osdmap e42: 7 total, 7 up, 7 in 2024-08-31T04:17:34.366 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:17:34 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-08-31T04:17:34.390 INFO:teuthology.orchestra.run.smithi133.stderr:2024-08-31T04:17:34.389+0000 7fd43ad89640 1 -- 172.21.15.133:0/840684605 --> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi133:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7fd4340635a0 con 0x7fd4240b4b30 2024-08-31T04:17:34.390 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:17:34 smithi133 ceph-mon[22177]: purged_snaps scrub starts 2024-08-31T04:17:34.390 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:17:34 smithi133 ceph-mon[22177]: purged_snaps scrub ok 2024-08-31T04:17:34.390 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:17:34 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-08-31T04:17:34.391 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:17:34 smithi133 ceph-mon[22177]: osd.6 [v2:172.21.15.50:6818/1429341184,v1:172.21.15.50:6819/1429341184] boot 2024-08-31T04:17:34.391 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:17:34 smithi133 ceph-mon[22177]: osdmap e42: 7 total, 7 up, 7 in 2024-08-31T04:17:34.391 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:17:34 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-08-31T04:17:34.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:17:34 smithi177 ceph-mon[22025]: purged_snaps scrub starts 2024-08-31T04:17:34.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:17:34 smithi177 ceph-mon[22025]: purged_snaps scrub ok 2024-08-31T04:17:34.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:17:34 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-08-31T04:17:34.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:17:34 smithi177 ceph-mon[22025]: osd.6 [v2:172.21.15.50:6818/1429341184,v1:172.21.15.50:6819/1429341184] boot 2024-08-31T04:17:34.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:17:34 smithi177 ceph-mon[22025]: osdmap e42: 7 total, 7 up, 7 in 2024-08-31T04:17:34.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:17:34 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-08-31T04:17:35.293 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:17:35 smithi133 ceph-mon[22177]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-08-31T04:17:35.293 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:17:35 smithi133 ceph-mon[22177]: from='client.24431 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi133:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:17:35.293 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:17:35 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-31T04:17:35.293 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:17:35 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-31T04:17:35.293 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:17:35 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:17:35.294 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:17:35 smithi133 ceph-mon[22177]: Detected new or changed devices on smithi050 2024-08-31T04:17:35.294 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:17:35 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:17:35.294 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:17:35 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:17:35.294 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:17:35 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-08-31T04:17:35.294 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:17:35 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-08-31T04:17:35.294 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:17:35 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-08-31T04:17:35.294 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:17:35 smithi133 ceph-mon[22177]: Adjusting osd_memory_target on smithi050 to 5698M 2024-08-31T04:17:35.294 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:17:35 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:17:35.294 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:17:35 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:17:35.294 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:17:35 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T04:17:35.294 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:17:35 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:17:35.450 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:17:35 smithi050 ceph-mon[17259]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-08-31T04:17:35.450 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:17:35 smithi050 ceph-mon[17259]: from='client.24431 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi133:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:17:35.450 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:17:35 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-31T04:17:35.450 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:17:35 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-31T04:17:35.450 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:17:35 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:17:35.450 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:17:35 smithi050 ceph-mon[17259]: Detected new or changed devices on smithi050 2024-08-31T04:17:35.450 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:17:35 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:17:35.451 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:17:35 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:17:35.451 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:17:35 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-08-31T04:17:35.451 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:17:35 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-08-31T04:17:35.451 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:17:35 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-08-31T04:17:35.451 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:17:35 smithi050 ceph-mon[17259]: Adjusting osd_memory_target on smithi050 to 5698M 2024-08-31T04:17:35.451 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:17:35 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:17:35.451 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:17:35 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:17:35.451 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:17:35 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T04:17:35.451 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:17:35 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:17:35.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:17:35 smithi177 ceph-mon[22025]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-08-31T04:17:35.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:17:35 smithi177 ceph-mon[22025]: from='client.24431 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi133:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:17:35.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:17:35 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-31T04:17:35.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:17:35 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-31T04:17:35.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:17:35 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:17:35.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:17:35 smithi177 ceph-mon[22025]: Detected new or changed devices on smithi050 2024-08-31T04:17:35.497 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:17:35 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:17:35.497 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:17:35 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:17:35.497 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:17:35 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-08-31T04:17:35.497 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:17:35 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-08-31T04:17:35.497 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:17:35 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-08-31T04:17:35.497 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:17:35 smithi177 ceph-mon[22025]: Adjusting osd_memory_target on smithi050 to 5698M 2024-08-31T04:17:35.497 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:17:35 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:17:35.497 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:17:35 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:17:35.497 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:17:35 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T04:17:35.497 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:17:35 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:17:36.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:17:36 smithi050 ceph-mon[17259]: osdmap e43: 7 total, 7 up, 7 in 2024-08-31T04:17:36.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:17:36 smithi177 ceph-mon[22025]: osdmap e43: 7 total, 7 up, 7 in 2024-08-31T04:17:36.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:17:36 smithi133 ceph-mon[22177]: osdmap e43: 7 total, 7 up, 7 in 2024-08-31T04:17:37.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:17:37 smithi050 ceph-mon[17259]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-08-31T04:17:37.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:17:37 smithi050 ceph-mon[17259]: from='client.? 172.21.15.133:0/2978030474' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "512ee507-0d50-4fed-b692-dbdf23a93e8e"} : dispatch 2024-08-31T04:17:37.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:17:37 smithi050 ceph-mon[17259]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "512ee507-0d50-4fed-b692-dbdf23a93e8e"} : dispatch 2024-08-31T04:17:37.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:17:37 smithi050 ceph-mon[17259]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "512ee507-0d50-4fed-b692-dbdf23a93e8e"}]': finished 2024-08-31T04:17:37.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:17:37 smithi050 ceph-mon[17259]: osdmap e44: 8 total, 7 up, 8 in 2024-08-31T04:17:37.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:17:37 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-08-31T04:17:37.701 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:17:37 smithi050 ceph-mon[17259]: from='client.? 172.21.15.133:0/3008006816' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-31T04:17:37.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:17:37 smithi177 ceph-mon[22025]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-08-31T04:17:37.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:17:37 smithi177 ceph-mon[22025]: from='client.? 172.21.15.133:0/2978030474' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "512ee507-0d50-4fed-b692-dbdf23a93e8e"} : dispatch 2024-08-31T04:17:37.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:17:37 smithi177 ceph-mon[22025]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "512ee507-0d50-4fed-b692-dbdf23a93e8e"} : dispatch 2024-08-31T04:17:37.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:17:37 smithi177 ceph-mon[22025]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "512ee507-0d50-4fed-b692-dbdf23a93e8e"}]': finished 2024-08-31T04:17:37.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:17:37 smithi177 ceph-mon[22025]: osdmap e44: 8 total, 7 up, 8 in 2024-08-31T04:17:37.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:17:37 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-08-31T04:17:37.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:17:37 smithi177 ceph-mon[22025]: from='client.? 172.21.15.133:0/3008006816' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-31T04:17:37.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:17:37 smithi133 ceph-mon[22177]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-08-31T04:17:37.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:17:37 smithi133 ceph-mon[22177]: from='client.? 172.21.15.133:0/2978030474' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "512ee507-0d50-4fed-b692-dbdf23a93e8e"} : dispatch 2024-08-31T04:17:37.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:17:37 smithi133 ceph-mon[22177]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "512ee507-0d50-4fed-b692-dbdf23a93e8e"} : dispatch 2024-08-31T04:17:37.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:17:37 smithi133 ceph-mon[22177]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "512ee507-0d50-4fed-b692-dbdf23a93e8e"}]': finished 2024-08-31T04:17:37.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:17:37 smithi133 ceph-mon[22177]: osdmap e44: 8 total, 7 up, 8 in 2024-08-31T04:17:37.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:17:37 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-08-31T04:17:37.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:17:37 smithi133 ceph-mon[22177]: from='client.? 172.21.15.133:0/3008006816' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-31T04:17:39.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:17:39 smithi050 ceph-mon[17259]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-08-31T04:17:39.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:17:39 smithi177 ceph-mon[22025]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-08-31T04:17:39.792 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:17:39 smithi133 ceph-mon[22177]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-08-31T04:17:41.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:17:41 smithi050 ceph-mon[17259]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-08-31T04:17:41.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:17:41 smithi177 ceph-mon[22025]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-08-31T04:17:41.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:17:41 smithi133 ceph-mon[22177]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-08-31T04:17:43.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:17:43 smithi133 ceph-mon[22177]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-08-31T04:17:43.745 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:17:43 smithi177 ceph-mon[22025]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-08-31T04:17:43.950 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:17:43 smithi050 ceph-mon[17259]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-08-31T04:17:45.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:17:45 smithi133 ceph-mon[22177]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-08-31T04:17:45.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:17:45 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.7"} : dispatch 2024-08-31T04:17:45.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:17:45 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:17:45.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:17:45 smithi177 ceph-mon[22025]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-08-31T04:17:45.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:17:45 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.7"} : dispatch 2024-08-31T04:17:45.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:17:45 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:17:45.950 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:17:45 smithi050 ceph-mon[17259]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-08-31T04:17:45.950 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:17:45 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.7"} : dispatch 2024-08-31T04:17:45.950 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:17:45 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:17:46.645 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:17:46 smithi133 ceph-mon[22177]: Deploying daemon osd.7 on smithi133 2024-08-31T04:17:46.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:17:46 smithi177 ceph-mon[22025]: Deploying daemon osd.7 on smithi133 2024-08-31T04:17:46.950 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:17:46 smithi050 ceph-mon[17259]: Deploying daemon osd.7 on smithi133 2024-08-31T04:17:47.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:17:47 smithi177 ceph-mon[22025]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-08-31T04:17:47.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:17:47 smithi133 ceph-mon[22177]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-08-31T04:17:47.950 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:17:47 smithi050 ceph-mon[17259]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-08-31T04:17:49.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:17:49 smithi177 ceph-mon[22025]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-08-31T04:17:49.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:17:49 smithi133 ceph-mon[22177]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-08-31T04:17:49.950 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:17:49 smithi050 ceph-mon[17259]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-08-31T04:17:51.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:17:51 smithi177 ceph-mon[22025]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-08-31T04:17:51.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:17:51 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T04:17:51.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:17:51 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:17:51.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:17:51 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:17:51.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:17:51 smithi133 ceph-mon[22177]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-08-31T04:17:51.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:17:51 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T04:17:51.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:17:51 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:17:51.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:17:51 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:17:51.950 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:17:51 smithi050 ceph-mon[17259]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-08-31T04:17:51.950 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:17:51 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T04:17:51.950 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:17:51 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:17:51.950 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:17:51 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:17:53.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:17:53 smithi133 ceph-mon[22177]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-08-31T04:17:53.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:17:53 smithi177 ceph-mon[22025]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-08-31T04:17:53.950 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:17:53 smithi050 ceph-mon[17259]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-08-31T04:17:54.562 INFO:teuthology.orchestra.run.smithi133.stderr:2024-08-31T04:17:54.559+0000 7fd431ffb640 1 -- 172.21.15.133:0/840684605 <== mgr.14150 v2:172.21.15.50:6800/2146686622 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fd4340635a0 con 0x7fd4240b4b30 2024-08-31T04:17:54.562 INFO:teuthology.orchestra.run.smithi133.stdout:Created osd(s) 7 on host 'smithi133' 2024-08-31T04:17:54.564 INFO:teuthology.orchestra.run.smithi133.stderr:2024-08-31T04:17:54.562+0000 7fd43ad89640 1 -- 172.21.15.133:0/840684605 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fd4240b4b30 msgr2=0x7fd4240b7040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:17:54.564 INFO:teuthology.orchestra.run.smithi133.stderr:2024-08-31T04:17:54.562+0000 7fd43ad89640 1 --2- 172.21.15.133:0/840684605 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fd4240b4b30 0x7fd4240b7040 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fd42800bbe0 tx=0x7fd42800b390 comp rx=0 tx=0).stop 2024-08-31T04:17:54.564 INFO:teuthology.orchestra.run.smithi133.stderr:2024-08-31T04:17:54.562+0000 7fd43ad89640 1 -- 172.21.15.133:0/840684605 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd434109260 msgr2=0x7fd43419aed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:17:54.564 INFO:teuthology.orchestra.run.smithi133.stderr:2024-08-31T04:17:54.562+0000 7fd43ad89640 1 --2- 172.21.15.133:0/840684605 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd434109260 0x7fd43419aed0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fd42c0097b0 tx=0x7fd42c003c20 comp rx=0 tx=0).stop 2024-08-31T04:17:54.564 INFO:teuthology.orchestra.run.smithi133.stderr:2024-08-31T04:17:54.562+0000 7fd43ad89640 1 -- 172.21.15.133:0/840684605 shutdown_connections 2024-08-31T04:17:54.564 INFO:teuthology.orchestra.run.smithi133.stderr:2024-08-31T04:17:54.562+0000 7fd43ad89640 1 --2- 172.21.15.133:0/840684605 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fd4240b4b30 0x7fd4240b7040 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:17:54.564 INFO:teuthology.orchestra.run.smithi133.stderr:2024-08-31T04:17:54.562+0000 7fd43ad89640 1 --2- 172.21.15.133:0/840684605 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd434109260 0x7fd43419aed0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:17:54.564 INFO:teuthology.orchestra.run.smithi133.stderr:2024-08-31T04:17:54.562+0000 7fd43ad89640 1 --2- 172.21.15.133:0/840684605 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd4341066c0 0x7fd43419a330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:17:54.565 INFO:teuthology.orchestra.run.smithi133.stderr:2024-08-31T04:17:54.562+0000 7fd43ad89640 1 --2- 172.21.15.133:0/840684605 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd43406c0e0 0x7fd434199cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:17:54.565 INFO:teuthology.orchestra.run.smithi133.stderr:2024-08-31T04:17:54.562+0000 7fd43ad89640 1 -- 172.21.15.133:0/840684605 >> 172.21.15.133:0/840684605 conn(0x7fd4340fdda0 msgr2=0x7fd434104b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:17:54.565 INFO:teuthology.orchestra.run.smithi133.stderr:2024-08-31T04:17:54.562+0000 7fd43ad89640 1 -- 172.21.15.133:0/840684605 shutdown_connections 2024-08-31T04:17:54.565 INFO:teuthology.orchestra.run.smithi133.stderr:2024-08-31T04:17:54.562+0000 7fd43ad89640 1 -- 172.21.15.133:0/840684605 wait complete. 2024-08-31T04:17:54.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:17:54 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:17:54.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:17:54 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:17:54.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:17:54 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:17:54.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:17:54 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T04:17:54.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:17:54 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:17:54.792 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:17:54 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:17:54.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:17:54 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:17:54.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:17:54 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:17:54.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:17:54 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T04:17:54.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:17:54 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:17:54.950 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:17:54 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:17:54.950 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:17:54 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:17:54.950 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:17:54 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:17:54.950 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:17:54 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T04:17:54.950 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:17:54 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:17:55.243 DEBUG:teuthology.orchestra.run.smithi133:osd.7> sudo journalctl -f -n 0 -u ceph-058d9fc6-674f-11ef-bcd4-c7b262605968@osd.7.service 2024-08-31T04:17:55.246 INFO:tasks.cephadm:Deploying osd.8 on smithi177 with /dev/vg_nvme/lv_2... 2024-08-31T04:17:55.246 DEBUG:teuthology.orchestra.run.smithi177:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 058d9fc6-674f-11ef-bcd4-c7b262605968 -- lvm zap /dev/vg_nvme/lv_2 2024-08-31T04:17:55.502 INFO:teuthology.orchestra.run.smithi177.stderr:Inferring config /var/lib/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/mon.c/config 2024-08-31T04:17:55.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:17:55 smithi133 ceph-mon[22177]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-08-31T04:17:55.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:17:55 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T04:17:55.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:17:55 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:17:55.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:17:55 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:17:55.850 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:17:55 smithi177 ceph-mon[22025]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-08-31T04:17:55.850 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:17:55 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T04:17:55.850 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:17:55 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:17:55.850 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:17:55 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:17:55.950 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:17:55 smithi050 ceph-mon[17259]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-08-31T04:17:55.950 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:17:55 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T04:17:55.950 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:17:55 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:17:55.950 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:17:55 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:17:56.669 INFO:journalctl@ceph.osd.7.smithi133.stdout:Aug 31 04:17:56 smithi133 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-7[40256]: 2024-08-31T04:17:56.549+0000 7fd8f44be640 -1 osd.7 0 log_to_monitors true 2024-08-31T04:17:57.650 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:17:57 smithi133 ceph-mon[22177]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-08-31T04:17:57.650 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:17:57 smithi133 ceph-mon[22177]: from='osd.7 [v2:172.21.15.133:6816/3643454923,v1:172.21.15.133:6817/3643454923]' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2024-08-31T04:17:57.650 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:17:57 smithi133 ceph-mon[22177]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2024-08-31T04:17:57.950 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:17:57 smithi050 ceph-mon[17259]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-08-31T04:17:57.950 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:17:57 smithi050 ceph-mon[17259]: from='osd.7 [v2:172.21.15.133:6816/3643454923,v1:172.21.15.133:6817/3643454923]' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2024-08-31T04:17:57.950 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:17:57 smithi050 ceph-mon[17259]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2024-08-31T04:17:57.996 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:17:57 smithi177 ceph-mon[22025]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-08-31T04:17:57.996 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:17:57 smithi177 ceph-mon[22025]: from='osd.7 [v2:172.21.15.133:6816/3643454923,v1:172.21.15.133:6817/3643454923]' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2024-08-31T04:17:57.996 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:17:57 smithi177 ceph-mon[22025]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2024-08-31T04:17:58.041 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-08-31T04:17:58.067 DEBUG:teuthology.orchestra.run.smithi177:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 058d9fc6-674f-11ef-bcd4-c7b262605968 -- ceph orch daemon add osd smithi177:vg_nvme/lv_2 2024-08-31T04:17:58.318 INFO:teuthology.orchestra.run.smithi177.stderr:Inferring config /var/lib/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/mon.c/config 2024-08-31T04:17:58.708 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:17:58 smithi177 ceph-mon[22025]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-08-31T04:17:58.708 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:17:58 smithi177 ceph-mon[22025]: osdmap e45: 8 total, 7 up, 8 in 2024-08-31T04:17:58.709 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:17:58 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-08-31T04:17:58.709 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:17:58 smithi177 ceph-mon[22025]: from='osd.7 [v2:172.21.15.133:6816/3643454923,v1:172.21.15.133:6817/3643454923]' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi133", "root=default"]} : dispatch 2024-08-31T04:17:58.709 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:17:58 smithi177 ceph-mon[22025]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi133", "root=default"]} : dispatch 2024-08-31T04:17:58.709 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:17:58 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:17:58.709 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:17:58 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:17:58.709 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:17:58 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-08-31T04:17:58.709 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:17:58 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-08-31T04:17:58.709 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:17:58 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-08-31T04:17:58.709 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:17:58 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:17:58.709 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:17:58 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:17:58.709 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:17:58 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T04:17:58.709 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:17:58 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:17:58.808 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-31T04:17:58.800+0000 7f0a658ff640 1 -- 172.21.15.177:0/1749288051 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0a601034f0 msgr2=0x7f0a60103960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:17:58.808 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-31T04:17:58.800+0000 7f0a658ff640 1 --2- 172.21.15.177:0/1749288051 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0a601034f0 0x7f0a60103960 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f0a50009900 tx=0x7f0a5002a480 comp rx=0 tx=0).stop 2024-08-31T04:17:58.808 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-31T04:17:58.800+0000 7f0a658ff640 1 -- 172.21.15.177:0/1749288051 shutdown_connections 2024-08-31T04:17:58.809 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-31T04:17:58.800+0000 7f0a658ff640 1 --2- 172.21.15.177:0/1749288051 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0a60104f20 0x7f0a6010b8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:17:58.809 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-31T04:17:58.800+0000 7f0a658ff640 1 --2- 172.21.15.177:0/1749288051 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0a60104580 0x7f0a60104990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:17:58.809 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-31T04:17:58.800+0000 7f0a658ff640 1 --2- 172.21.15.177:0/1749288051 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0a601034f0 0x7f0a60103960 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:17:58.809 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-31T04:17:58.800+0000 7f0a658ff640 1 -- 172.21.15.177:0/1749288051 >> 172.21.15.177:0/1749288051 conn(0x7f0a600fee60 msgr2=0x7f0a60101310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:17:58.809 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-31T04:17:58.800+0000 7f0a658ff640 1 -- 172.21.15.177:0/1749288051 shutdown_connections 2024-08-31T04:17:58.809 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-31T04:17:58.800+0000 7f0a658ff640 1 -- 172.21.15.177:0/1749288051 wait complete. 2024-08-31T04:17:58.809 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-31T04:17:58.800+0000 7f0a658ff640 1 Processor -- start 2024-08-31T04:17:58.809 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-31T04:17:58.801+0000 7f0a658ff640 1 -- start start 2024-08-31T04:17:58.809 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-31T04:17:58.801+0000 7f0a658ff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0a601034f0 0x7f0a60199d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:17:58.809 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-31T04:17:58.801+0000 7f0a658ff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0a60104580 0x7f0a6019a3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:17:58.809 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-31T04:17:58.801+0000 7f0a658ff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0a60104f20 0x7f0a6019af40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:17:58.809 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-31T04:17:58.801+0000 7f0a658ff640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f0a6010f110 con 0x7f0a60104580 2024-08-31T04:17:58.810 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-31T04:17:58.801+0000 7f0a658ff640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f0a6010ef90 con 0x7f0a601034f0 2024-08-31T04:17:58.810 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-31T04:17:58.801+0000 7f0a658ff640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f0a6010f290 con 0x7f0a60104f20 2024-08-31T04:17:58.810 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-31T04:17:58.801+0000 7f0a5f7fe640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0a60104f20 0x7f0a6019af40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:17:58.810 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-31T04:17:58.801+0000 7f0a5f7fe640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0a60104f20 0x7f0a6019af40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:46506/0 (socket says 172.21.15.177:46506) 2024-08-31T04:17:58.810 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-31T04:17:58.801+0000 7f0a5f7fe640 1 -- 172.21.15.177:0/2310946179 learned_addr learned my addr 172.21.15.177:0/2310946179 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-08-31T04:17:58.810 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-31T04:17:58.801+0000 7f0a5effd640 1 --2- 172.21.15.177:0/2310946179 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0a601034f0 0x7f0a60199d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:17:58.810 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-31T04:17:58.801+0000 7f0a5e7fc640 1 --2- 172.21.15.177:0/2310946179 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0a60104580 0x7f0a6019a3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:17:58.810 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-31T04:17:58.801+0000 7f0a5f7fe640 1 -- 172.21.15.177:0/2310946179 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0a601034f0 msgr2=0x7f0a60199d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:17:58.810 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-31T04:17:58.801+0000 7f0a5f7fe640 1 --2- 172.21.15.177:0/2310946179 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0a601034f0 0x7f0a60199d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:17:58.810 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-31T04:17:58.801+0000 7f0a5f7fe640 1 -- 172.21.15.177:0/2310946179 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0a60104580 msgr2=0x7f0a6019a3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:17:58.810 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-31T04:17:58.801+0000 7f0a5f7fe640 1 --2- 172.21.15.177:0/2310946179 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0a60104580 0x7f0a6019a3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:17:58.810 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-31T04:17:58.802+0000 7f0a5f7fe640 1 -- 172.21.15.177:0/2310946179 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a6019b760 con 0x7f0a60104f20 2024-08-31T04:17:58.811 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-31T04:17:58.802+0000 7f0a5f7fe640 1 --2- 172.21.15.177:0/2310946179 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0a60104f20 0x7f0a6019af40 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f0a5800eaa0 tx=0x7f0a5800ef60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:17:58.811 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-31T04:17:58.802+0000 7f0a648fd640 1 -- 172.21.15.177:0/2310946179 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a5800cdb0 con 0x7f0a60104f20 2024-08-31T04:17:58.811 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-31T04:17:58.802+0000 7f0a658ff640 1 -- 172.21.15.177:0/2310946179 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0a6019ba50 con 0x7f0a60104f20 2024-08-31T04:17:58.811 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-31T04:17:58.802+0000 7f0a648fd640 1 -- 172.21.15.177:0/2310946179 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0a58005020 con 0x7f0a60104f20 2024-08-31T04:17:58.811 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-31T04:17:58.802+0000 7f0a648fd640 1 -- 172.21.15.177:0/2310946179 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a580116d0 con 0x7f0a60104f20 2024-08-31T04:17:58.811 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-31T04:17:58.802+0000 7f0a658ff640 1 -- 172.21.15.177:0/2310946179 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0a601a2150 con 0x7f0a60104f20 2024-08-31T04:17:58.811 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-31T04:17:58.803+0000 7f0a658ff640 1 -- 172.21.15.177:0/2310946179 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0a6010a6d0 con 0x7f0a60104f20 2024-08-31T04:17:58.811 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-31T04:17:58.805+0000 7f0a648fd640 1 -- 172.21.15.177:0/2310946179 <== mon.1 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 16) ==== 152577+0+0 (secure 0 0 0) 0x7f0a580051d0 con 0x7f0a60104f20 2024-08-31T04:17:58.811 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-31T04:17:58.806+0000 7f0a648fd640 1 --2- 172.21.15.177:0/2310946179 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f0a480b4b30 0x7f0a480b7040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:17:58.811 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-31T04:17:58.806+0000 7f0a648fd640 1 -- 172.21.15.177:0/2310946179 <== mon.1 v2:172.21.15.177:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5117+0+0 (secure 0 0 0) 0x7f0a580e4b40 con 0x7f0a60104f20 2024-08-31T04:17:58.811 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-31T04:17:58.806+0000 7f0a5effd640 1 --2- 172.21.15.177:0/2310946179 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f0a480b4b30 0x7f0a480b7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:17:58.811 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-31T04:17:58.807+0000 7f0a5effd640 1 --2- 172.21.15.177:0/2310946179 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f0a480b4b30 0x7f0a480b7040 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f0a50031440 tx=0x7f0a500314a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:17:58.812 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-31T04:17:58.809+0000 7f0a648fd640 1 -- 172.21.15.177:0/2310946179 <== mon.1 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f0a58016030 con 0x7f0a60104f20 2024-08-31T04:17:58.950 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:17:58 smithi050 ceph-mon[17259]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-08-31T04:17:58.950 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:17:58 smithi050 ceph-mon[17259]: osdmap e45: 8 total, 7 up, 8 in 2024-08-31T04:17:58.950 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:17:58 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-08-31T04:17:58.950 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:17:58 smithi050 ceph-mon[17259]: from='osd.7 [v2:172.21.15.133:6816/3643454923,v1:172.21.15.133:6817/3643454923]' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi133", "root=default"]} : dispatch 2024-08-31T04:17:58.950 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:17:58 smithi050 ceph-mon[17259]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi133", "root=default"]} : dispatch 2024-08-31T04:17:58.951 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:17:58 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:17:58.951 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:17:58 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:17:58.951 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:17:58 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-08-31T04:17:58.951 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:17:58 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-08-31T04:17:58.951 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:17:58 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-08-31T04:17:58.951 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:17:58 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:17:58.951 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:17:58 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:17:58.951 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:17:58 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T04:17:58.951 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:17:58 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:17:58.997 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-31T04:17:58.996+0000 7f0a658ff640 1 -- 172.21.15.177:0/2310946179 --> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi177:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7f0a600635a0 con 0x7f0a480b4b30 2024-08-31T04:17:59.043 INFO:journalctl@ceph.osd.7.smithi133.stdout:Aug 31 04:17:58 smithi133 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-7[40256]: 2024-08-31T04:17:58.560+0000 7fd8f0440640 -1 osd.7 0 waiting for initial osdmap 2024-08-31T04:17:59.043 INFO:journalctl@ceph.osd.7.smithi133.stdout:Aug 31 04:17:58 smithi133 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-7[40256]: 2024-08-31T04:17:58.571+0000 7fd8ec23e640 -1 osd.7 46 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-31T04:17:59.043 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:17:58 smithi133 ceph-mon[22177]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-08-31T04:17:59.043 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:17:58 smithi133 ceph-mon[22177]: osdmap e45: 8 total, 7 up, 8 in 2024-08-31T04:17:59.043 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:17:58 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-08-31T04:17:59.043 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:17:58 smithi133 ceph-mon[22177]: from='osd.7 [v2:172.21.15.133:6816/3643454923,v1:172.21.15.133:6817/3643454923]' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi133", "root=default"]} : dispatch 2024-08-31T04:17:59.043 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:17:58 smithi133 ceph-mon[22177]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi133", "root=default"]} : dispatch 2024-08-31T04:17:59.044 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:17:58 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:17:59.044 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:17:58 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:17:59.044 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:17:58 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-08-31T04:17:59.044 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:17:58 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-08-31T04:17:59.044 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:17:58 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-08-31T04:17:59.044 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:17:58 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:17:59.044 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:17:58 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:17:59.044 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:17:58 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T04:17:59.044 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:17:58 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:17:59.662 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:17:59 smithi177 ceph-mon[22025]: purged_snaps scrub starts 2024-08-31T04:17:59.662 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:17:59 smithi177 ceph-mon[22025]: purged_snaps scrub ok 2024-08-31T04:17:59.662 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:17:59 smithi177 ceph-mon[22025]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-08-31T04:17:59.662 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:17:59 smithi177 ceph-mon[22025]: Detected new or changed devices on smithi133 2024-08-31T04:17:59.662 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:17:59 smithi177 ceph-mon[22025]: Adjusting osd_memory_target on smithi133 to 5696M 2024-08-31T04:17:59.662 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:17:59 smithi177 ceph-mon[22025]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi133", "root=default"]}]': finished 2024-08-31T04:17:59.662 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:17:59 smithi177 ceph-mon[22025]: osdmap e46: 8 total, 7 up, 8 in 2024-08-31T04:17:59.662 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:17:59 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-08-31T04:17:59.663 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:17:59 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-08-31T04:17:59.663 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:17:59 smithi177 ceph-mon[22025]: from='client.24460 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi177:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:17:59.663 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:17:59 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-31T04:17:59.663 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:17:59 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-31T04:17:59.663 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:17:59 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:17:59.950 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:17:59 smithi050 ceph-mon[17259]: purged_snaps scrub starts 2024-08-31T04:17:59.950 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:17:59 smithi050 ceph-mon[17259]: purged_snaps scrub ok 2024-08-31T04:17:59.950 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:17:59 smithi050 ceph-mon[17259]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-08-31T04:17:59.950 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:17:59 smithi050 ceph-mon[17259]: Detected new or changed devices on smithi133 2024-08-31T04:17:59.950 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:17:59 smithi050 ceph-mon[17259]: Adjusting osd_memory_target on smithi133 to 5696M 2024-08-31T04:17:59.950 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:17:59 smithi050 ceph-mon[17259]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi133", "root=default"]}]': finished 2024-08-31T04:17:59.951 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:17:59 smithi050 ceph-mon[17259]: osdmap e46: 8 total, 7 up, 8 in 2024-08-31T04:17:59.951 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:17:59 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-08-31T04:17:59.951 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:17:59 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-08-31T04:17:59.951 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:17:59 smithi050 ceph-mon[17259]: from='client.24460 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi177:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:17:59.951 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:17:59 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-31T04:17:59.951 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:17:59 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-31T04:17:59.951 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:17:59 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:18:00.043 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:17:59 smithi133 ceph-mon[22177]: purged_snaps scrub starts 2024-08-31T04:18:00.043 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:17:59 smithi133 ceph-mon[22177]: purged_snaps scrub ok 2024-08-31T04:18:00.043 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:17:59 smithi133 ceph-mon[22177]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-08-31T04:18:00.043 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:17:59 smithi133 ceph-mon[22177]: Detected new or changed devices on smithi133 2024-08-31T04:18:00.043 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:17:59 smithi133 ceph-mon[22177]: Adjusting osd_memory_target on smithi133 to 5696M 2024-08-31T04:18:00.043 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:17:59 smithi133 ceph-mon[22177]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi133", "root=default"]}]': finished 2024-08-31T04:18:00.043 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:17:59 smithi133 ceph-mon[22177]: osdmap e46: 8 total, 7 up, 8 in 2024-08-31T04:18:00.043 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:17:59 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-08-31T04:18:00.043 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:17:59 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-08-31T04:18:00.044 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:17:59 smithi133 ceph-mon[22177]: from='client.24460 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi177:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:18:00.044 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:17:59 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-31T04:18:00.044 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:17:59 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-31T04:18:00.044 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:17:59 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:18:00.686 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:18:00 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-08-31T04:18:00.686 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:18:00 smithi177 ceph-mon[22025]: osd.7 [v2:172.21.15.133:6816/3643454923,v1:172.21.15.133:6817/3643454923] boot 2024-08-31T04:18:00.687 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:18:00 smithi177 ceph-mon[22025]: osdmap e47: 8 total, 8 up, 8 in 2024-08-31T04:18:00.687 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:18:00 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-08-31T04:18:00.687 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:18:00 smithi177 ceph-mon[22025]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-08-31T04:18:00.950 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:18:00 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-08-31T04:18:00.950 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:18:00 smithi050 ceph-mon[17259]: osd.7 [v2:172.21.15.133:6816/3643454923,v1:172.21.15.133:6817/3643454923] boot 2024-08-31T04:18:00.950 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:18:00 smithi050 ceph-mon[17259]: osdmap e47: 8 total, 8 up, 8 in 2024-08-31T04:18:00.950 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:18:00 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-08-31T04:18:00.950 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:18:00 smithi050 ceph-mon[17259]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-08-31T04:18:01.043 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:18:00 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-08-31T04:18:01.043 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:18:00 smithi133 ceph-mon[22177]: osd.7 [v2:172.21.15.133:6816/3643454923,v1:172.21.15.133:6817/3643454923] boot 2024-08-31T04:18:01.043 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:18:00 smithi133 ceph-mon[22177]: osdmap e47: 8 total, 8 up, 8 in 2024-08-31T04:18:01.043 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:18:00 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-08-31T04:18:01.043 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:18:00 smithi133 ceph-mon[22177]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-08-31T04:18:01.950 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:18:01 smithi050 ceph-mon[17259]: osdmap e48: 8 total, 8 up, 8 in 2024-08-31T04:18:01.950 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:18:01 smithi050 ceph-mon[17259]: from='client.? 172.21.15.177:0/4011902708' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "ae99526e-41da-4cb5-857f-2e66f18f2d94"} : dispatch 2024-08-31T04:18:01.950 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:18:01 smithi050 ceph-mon[17259]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "ae99526e-41da-4cb5-857f-2e66f18f2d94"} : dispatch 2024-08-31T04:18:01.950 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:18:01 smithi050 ceph-mon[17259]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ae99526e-41da-4cb5-857f-2e66f18f2d94"}]': finished 2024-08-31T04:18:01.950 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:18:01 smithi050 ceph-mon[17259]: osdmap e49: 9 total, 8 up, 9 in 2024-08-31T04:18:01.950 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:18:01 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-08-31T04:18:01.996 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:18:01 smithi177 ceph-mon[22025]: osdmap e48: 8 total, 8 up, 8 in 2024-08-31T04:18:01.996 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:18:01 smithi177 ceph-mon[22025]: from='client.? 172.21.15.177:0/4011902708' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "ae99526e-41da-4cb5-857f-2e66f18f2d94"} : dispatch 2024-08-31T04:18:01.996 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:18:01 smithi177 ceph-mon[22025]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "ae99526e-41da-4cb5-857f-2e66f18f2d94"} : dispatch 2024-08-31T04:18:01.996 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:18:01 smithi177 ceph-mon[22025]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ae99526e-41da-4cb5-857f-2e66f18f2d94"}]': finished 2024-08-31T04:18:01.996 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:18:01 smithi177 ceph-mon[22025]: osdmap e49: 9 total, 8 up, 9 in 2024-08-31T04:18:01.996 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:18:01 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-08-31T04:18:02.043 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:18:01 smithi133 ceph-mon[22177]: osdmap e48: 8 total, 8 up, 8 in 2024-08-31T04:18:02.043 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:18:01 smithi133 ceph-mon[22177]: from='client.? 172.21.15.177:0/4011902708' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "ae99526e-41da-4cb5-857f-2e66f18f2d94"} : dispatch 2024-08-31T04:18:02.043 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:18:01 smithi133 ceph-mon[22177]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "ae99526e-41da-4cb5-857f-2e66f18f2d94"} : dispatch 2024-08-31T04:18:02.043 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:18:01 smithi133 ceph-mon[22177]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ae99526e-41da-4cb5-857f-2e66f18f2d94"}]': finished 2024-08-31T04:18:02.043 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:18:01 smithi133 ceph-mon[22177]: osdmap e49: 9 total, 8 up, 9 in 2024-08-31T04:18:02.043 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:18:01 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-08-31T04:18:02.950 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:18:02 smithi050 ceph-mon[17259]: pgmap v192: 1 pgs: 1 remapped; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-08-31T04:18:02.950 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:18:02 smithi050 ceph-mon[17259]: from='client.? 172.21.15.177:0/2062523064' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-31T04:18:02.996 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:18:02 smithi177 ceph-mon[22025]: pgmap v192: 1 pgs: 1 remapped; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-08-31T04:18:02.996 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:18:02 smithi177 ceph-mon[22025]: from='client.? 172.21.15.177:0/2062523064' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-31T04:18:03.043 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:18:02 smithi133 ceph-mon[22177]: pgmap v192: 1 pgs: 1 remapped; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-08-31T04:18:03.043 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:18:02 smithi133 ceph-mon[22177]: from='client.? 172.21.15.177:0/2062523064' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-31T04:18:04.200 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:18:03 smithi050 ceph-mon[17259]: Health check failed: Reduced data availability: 1 pg inactive (PG_AVAILABILITY) 2024-08-31T04:18:04.246 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:18:03 smithi177 ceph-mon[22025]: Health check failed: Reduced data availability: 1 pg inactive (PG_AVAILABILITY) 2024-08-31T04:18:04.293 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:18:03 smithi133 ceph-mon[22177]: Health check failed: Reduced data availability: 1 pg inactive (PG_AVAILABILITY) 2024-08-31T04:18:05.200 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:18:04 smithi050 ceph-mon[17259]: pgmap v193: 1 pgs: 1 remapped; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-08-31T04:18:05.245 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:18:04 smithi177 ceph-mon[22025]: pgmap v193: 1 pgs: 1 remapped; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-08-31T04:18:05.293 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:18:04 smithi133 ceph-mon[22177]: pgmap v193: 1 pgs: 1 remapped; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-08-31T04:18:06.246 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:18:05 smithi177 ceph-mon[22025]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg inactive) 2024-08-31T04:18:06.246 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:18:05 smithi177 ceph-mon[22025]: Cluster is now healthy 2024-08-31T04:18:06.293 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:18:05 smithi133 ceph-mon[22177]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg inactive) 2024-08-31T04:18:06.293 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:18:05 smithi133 ceph-mon[22177]: Cluster is now healthy 2024-08-31T04:18:06.450 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:18:05 smithi050 ceph-mon[17259]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg inactive) 2024-08-31T04:18:06.450 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:18:05 smithi050 ceph-mon[17259]: Cluster is now healthy 2024-08-31T04:18:07.234 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:18:06 smithi177 ceph-mon[22025]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail; 92 KiB/s, 0 objects/s recovering 2024-08-31T04:18:07.293 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:18:06 smithi133 ceph-mon[22177]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail; 92 KiB/s, 0 objects/s recovering 2024-08-31T04:18:07.450 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:18:06 smithi050 ceph-mon[17259]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail; 92 KiB/s, 0 objects/s recovering 2024-08-31T04:18:09.181 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:18:08 smithi177 ceph-mon[22025]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-08-31T04:18:09.293 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:18:08 smithi133 ceph-mon[22177]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-08-31T04:18:09.450 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:18:08 smithi050 ceph-mon[17259]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-08-31T04:18:10.246 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:18:09 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.8"} : dispatch 2024-08-31T04:18:10.246 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:18:09 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:18:10.293 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:18:09 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.8"} : dispatch 2024-08-31T04:18:10.293 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:18:09 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:18:10.450 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:18:09 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.8"} : dispatch 2024-08-31T04:18:10.450 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:18:09 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:18:11.246 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:18:10 smithi177 ceph-mon[22025]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail; 125 KiB/s, 0 objects/s recovering 2024-08-31T04:18:11.246 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:18:10 smithi177 ceph-mon[22025]: Deploying daemon osd.8 on smithi177 2024-08-31T04:18:11.293 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:18:10 smithi133 ceph-mon[22177]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail; 125 KiB/s, 0 objects/s recovering 2024-08-31T04:18:11.293 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:18:10 smithi133 ceph-mon[22177]: Deploying daemon osd.8 on smithi177 2024-08-31T04:18:11.450 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:18:10 smithi050 ceph-mon[17259]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail; 125 KiB/s, 0 objects/s recovering 2024-08-31T04:18:11.450 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:18:10 smithi050 ceph-mon[17259]: Deploying daemon osd.8 on smithi177 2024-08-31T04:18:13.246 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:18:12 smithi177 ceph-mon[22025]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail; 111 KiB/s, 0 objects/s recovering 2024-08-31T04:18:13.252 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:18:12 smithi050 ceph-mon[17259]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail; 111 KiB/s, 0 objects/s recovering 2024-08-31T04:18:13.293 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:18:12 smithi133 ceph-mon[22177]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail; 111 KiB/s, 0 objects/s recovering 2024-08-31T04:18:15.199 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:18:14 smithi177 ceph-mon[22025]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-08-31T04:18:15.292 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:18:14 smithi133 ceph-mon[22177]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-08-31T04:18:15.450 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:18:14 smithi050 ceph-mon[17259]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-08-31T04:18:16.216 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:18:15 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T04:18:16.217 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:18:15 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:18:16.217 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:18:15 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:18:16.293 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:18:15 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T04:18:16.293 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:18:15 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:18:16.293 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:18:15 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:18:16.450 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:18:15 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T04:18:16.450 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:18:15 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:18:16.450 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:18:15 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:18:17.490 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:18:17 smithi177 ceph-mon[22025]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-08-31T04:18:17.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:18:17 smithi133 ceph-mon[22177]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-08-31T04:18:17.699 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:18:17 smithi050 ceph-mon[17259]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-08-31T04:18:18.972 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:18:18 smithi177 ceph-mon[22025]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-08-31T04:18:18.973 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:18:18 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:18:18.973 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:18:18 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:18:18.973 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:18:18 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:18:18.973 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:18:18 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T04:18:18.973 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:18:18 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:18:19.016 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-31T04:18:19.014+0000 7f0a648fd640 1 -- 172.21.15.177:0/2310946179 <== mgr.14150 v2:172.21.15.50:6800/2146686622 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f0a600635a0 con 0x7f0a480b4b30 2024-08-31T04:18:19.016 INFO:teuthology.orchestra.run.smithi177.stdout:Created osd(s) 8 on host 'smithi177' 2024-08-31T04:18:19.018 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-31T04:18:19.017+0000 7f0a658ff640 1 -- 172.21.15.177:0/2310946179 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f0a480b4b30 msgr2=0x7f0a480b7040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:18:19.018 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-31T04:18:19.017+0000 7f0a658ff640 1 --2- 172.21.15.177:0/2310946179 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f0a480b4b30 0x7f0a480b7040 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f0a50031440 tx=0x7f0a500314a0 comp rx=0 tx=0).stop 2024-08-31T04:18:19.018 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-31T04:18:19.017+0000 7f0a658ff640 1 -- 172.21.15.177:0/2310946179 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0a60104f20 msgr2=0x7f0a6019af40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:18:19.019 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-31T04:18:19.017+0000 7f0a658ff640 1 --2- 172.21.15.177:0/2310946179 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0a60104f20 0x7f0a6019af40 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f0a5800eaa0 tx=0x7f0a5800ef60 comp rx=0 tx=0).stop 2024-08-31T04:18:19.019 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-31T04:18:19.017+0000 7f0a658ff640 1 -- 172.21.15.177:0/2310946179 shutdown_connections 2024-08-31T04:18:19.019 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-31T04:18:19.017+0000 7f0a658ff640 1 --2- 172.21.15.177:0/2310946179 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f0a480b4b30 0x7f0a480b7040 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:18:19.019 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-31T04:18:19.017+0000 7f0a658ff640 1 --2- 172.21.15.177:0/2310946179 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0a60104f20 0x7f0a6019af40 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:18:19.019 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-31T04:18:19.017+0000 7f0a658ff640 1 --2- 172.21.15.177:0/2310946179 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0a60104580 0x7f0a6019a3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:18:19.019 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-31T04:18:19.017+0000 7f0a658ff640 1 --2- 172.21.15.177:0/2310946179 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0a601034f0 0x7f0a60199d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:18:19.019 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-31T04:18:19.017+0000 7f0a658ff640 1 -- 172.21.15.177:0/2310946179 >> 172.21.15.177:0/2310946179 conn(0x7f0a600fee60 msgr2=0x7f0a601078a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:18:19.019 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-31T04:18:19.017+0000 7f0a658ff640 1 -- 172.21.15.177:0/2310946179 shutdown_connections 2024-08-31T04:18:19.019 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-31T04:18:19.017+0000 7f0a658ff640 1 -- 172.21.15.177:0/2310946179 wait complete. 2024-08-31T04:18:19.200 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:18:18 smithi050 ceph-mon[17259]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-08-31T04:18:19.200 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:18:18 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:18:19.200 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:18:18 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:18:19.200 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:18:18 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:18:19.200 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:18:18 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T04:18:19.201 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:18:18 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:18:19.293 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:18:18 smithi133 ceph-mon[22177]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-08-31T04:18:19.293 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:18:18 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:18:19.293 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:18:18 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:18:19.293 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:18:18 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:18:19.293 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:18:18 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T04:18:19.293 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:18:18 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:18:19.730 DEBUG:teuthology.orchestra.run.smithi177:osd.8> sudo journalctl -f -n 0 -u ceph-058d9fc6-674f-11ef-bcd4-c7b262605968@osd.8.service 2024-08-31T04:18:19.732 INFO:tasks.cephadm:Deploying osd.9 on smithi050 with /dev/vg_nvme/lv_1... 2024-08-31T04:18:19.733 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 058d9fc6-674f-11ef-bcd4-c7b262605968 -- lvm zap /dev/vg_nvme/lv_1 2024-08-31T04:18:19.968 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:18:19 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T04:18:19.968 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:18:19 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:18:19.968 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:18:19 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:18:20.118 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:18:20.200 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:18:19 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T04:18:20.200 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:18:19 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:18:20.200 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:18:19 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:18:20.293 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:18:19 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T04:18:20.293 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:18:19 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:18:20.293 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:18:19 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:18:21.134 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:18:21 smithi050 ceph-mon[17259]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-08-31T04:18:21.141 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:18:21 smithi177 ceph-mon[22025]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-08-31T04:18:21.293 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:18:21 smithi133 ceph-mon[22177]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-08-31T04:18:21.846 INFO:journalctl@ceph.osd.8.smithi177.stdout:Aug 31 04:18:21 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-8[40333]: 2024-08-31T04:18:21.543+0000 7f2448c97640 -1 osd.8 0 log_to_monitors true 2024-08-31T04:18:22.200 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:18:22 smithi050 ceph-mon[17259]: from='osd.8 [v2:172.21.15.177:6816/101973300,v1:172.21.15.177:6817/101973300]' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2024-08-31T04:18:22.200 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:18:22 smithi050 ceph-mon[17259]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2024-08-31T04:18:22.224 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:18:22 smithi177 ceph-mon[22025]: from='osd.8 [v2:172.21.15.177:6816/101973300,v1:172.21.15.177:6817/101973300]' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2024-08-31T04:18:22.224 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:18:22 smithi177 ceph-mon[22025]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2024-08-31T04:18:22.293 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:18:22 smithi133 ceph-mon[22177]: from='osd.8 [v2:172.21.15.177:6816/101973300,v1:172.21.15.177:6817/101973300]' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2024-08-31T04:18:22.293 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:18:22 smithi133 ceph-mon[22177]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2024-08-31T04:18:23.182 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:18:23 smithi050 ceph-mon[17259]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-08-31T04:18:23.182 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:18:23 smithi050 ceph-mon[17259]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-08-31T04:18:23.182 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:18:23 smithi050 ceph-mon[17259]: osdmap e50: 9 total, 8 up, 9 in 2024-08-31T04:18:23.182 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:18:23 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-08-31T04:18:23.183 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:18:23 smithi050 ceph-mon[17259]: from='osd.8 [v2:172.21.15.177:6816/101973300,v1:172.21.15.177:6817/101973300]' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi177", "root=default"]} : dispatch 2024-08-31T04:18:23.183 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:18:23 smithi050 ceph-mon[17259]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi177", "root=default"]} : dispatch 2024-08-31T04:18:23.183 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:18:23 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:18:23.183 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:18:23 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:18:23.183 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:18:23 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-08-31T04:18:23.183 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:18:23 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-08-31T04:18:23.183 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:18:23 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-08-31T04:18:23.183 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:18:23 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:18:23.183 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:18:23 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:18:23.183 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:18:23 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T04:18:23.183 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:18:23 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:18:23.293 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:18:23 smithi133 ceph-mon[22177]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-08-31T04:18:23.293 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:18:23 smithi133 ceph-mon[22177]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-08-31T04:18:23.293 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:18:23 smithi133 ceph-mon[22177]: osdmap e50: 9 total, 8 up, 9 in 2024-08-31T04:18:23.293 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:18:23 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-08-31T04:18:23.293 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:18:23 smithi133 ceph-mon[22177]: from='osd.8 [v2:172.21.15.177:6816/101973300,v1:172.21.15.177:6817/101973300]' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi177", "root=default"]} : dispatch 2024-08-31T04:18:23.293 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:18:23 smithi133 ceph-mon[22177]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi177", "root=default"]} : dispatch 2024-08-31T04:18:23.293 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:18:23 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:18:23.294 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:18:23 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:18:23.294 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:18:23 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-08-31T04:18:23.294 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:18:23 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-08-31T04:18:23.294 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:18:23 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-08-31T04:18:23.294 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:18:23 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:18:23.294 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:18:23 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:18:23.294 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:18:23 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T04:18:23.294 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:18:23 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:18:23.496 INFO:journalctl@ceph.osd.8.smithi177.stdout:Aug 31 04:18:23 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-8[40333]: 2024-08-31T04:18:23.035+0000 7f2444c19640 -1 osd.8 0 waiting for initial osdmap 2024-08-31T04:18:23.496 INFO:journalctl@ceph.osd.8.smithi177.stdout:Aug 31 04:18:23 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-8[40333]: 2024-08-31T04:18:23.045+0000 7f2440a17640 -1 osd.8 51 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-31T04:18:23.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:18:23 smithi177 ceph-mon[22025]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-08-31T04:18:23.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:18:23 smithi177 ceph-mon[22025]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-08-31T04:18:23.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:18:23 smithi177 ceph-mon[22025]: osdmap e50: 9 total, 8 up, 9 in 2024-08-31T04:18:23.497 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:18:23 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-08-31T04:18:23.497 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:18:23 smithi177 ceph-mon[22025]: from='osd.8 [v2:172.21.15.177:6816/101973300,v1:172.21.15.177:6817/101973300]' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi177", "root=default"]} : dispatch 2024-08-31T04:18:23.497 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:18:23 smithi177 ceph-mon[22025]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi177", "root=default"]} : dispatch 2024-08-31T04:18:23.497 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:18:23 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:18:23.497 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:18:23 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:18:23.497 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:18:23 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-08-31T04:18:23.497 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:18:23 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-08-31T04:18:23.497 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:18:23 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-08-31T04:18:23.497 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:18:23 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:18:23.497 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:18:23 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:18:23.497 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:18:23 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T04:18:23.498 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:18:23 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:18:23.508 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-08-31T04:18:23.540 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 058d9fc6-674f-11ef-bcd4-c7b262605968 -- ceph orch daemon add osd smithi050:vg_nvme/lv_1 2024-08-31T04:18:23.928 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:18:24.293 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:18:24 smithi133 ceph-mon[22177]: Detected new or changed devices on smithi177 2024-08-31T04:18:24.293 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:18:24 smithi133 ceph-mon[22177]: Adjusting osd_memory_target on smithi177 to 5695M 2024-08-31T04:18:24.293 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:18:24 smithi133 ceph-mon[22177]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi177", "root=default"]}]': finished 2024-08-31T04:18:24.293 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:18:24 smithi133 ceph-mon[22177]: osdmap e51: 9 total, 8 up, 9 in 2024-08-31T04:18:24.293 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:18:24 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-08-31T04:18:24.293 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:18:24 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-08-31T04:18:24.296 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:18:24 smithi050 ceph-mon[17259]: Detected new or changed devices on smithi177 2024-08-31T04:18:24.296 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:18:24 smithi050 ceph-mon[17259]: Adjusting osd_memory_target on smithi177 to 5695M 2024-08-31T04:18:24.296 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:18:24 smithi050 ceph-mon[17259]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi177", "root=default"]}]': finished 2024-08-31T04:18:24.296 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:18:24 smithi050 ceph-mon[17259]: osdmap e51: 9 total, 8 up, 9 in 2024-08-31T04:18:24.296 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:18:24 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-08-31T04:18:24.296 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:18:24 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-08-31T04:18:24.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:18:24 smithi177 ceph-mon[22025]: Detected new or changed devices on smithi177 2024-08-31T04:18:24.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:18:24 smithi177 ceph-mon[22025]: Adjusting osd_memory_target on smithi177 to 5695M 2024-08-31T04:18:24.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:18:24 smithi177 ceph-mon[22025]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi177", "root=default"]}]': finished 2024-08-31T04:18:24.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:18:24 smithi177 ceph-mon[22025]: osdmap e51: 9 total, 8 up, 9 in 2024-08-31T04:18:24.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:18:24 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-08-31T04:18:24.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:18:24 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-08-31T04:18:24.569 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:18:24.568+0000 7f9b92a00640 1 -- 172.21.15.50:0/1888161544 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9b8c107150 msgr2=0x7f9b8c10daf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:18:24.570 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:18:24.568+0000 7f9b92a00640 1 --2- 172.21.15.50:0/1888161544 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9b8c107150 0x7f9b8c10daf0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f9b84009ca0 tx=0x7f9b8402a950 comp rx=0 tx=0).stop 2024-08-31T04:18:24.570 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:18:24.568+0000 7f9b92a00640 1 -- 172.21.15.50:0/1888161544 shutdown_connections 2024-08-31T04:18:24.570 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:18:24.568+0000 7f9b92a00640 1 --2- 172.21.15.50:0/1888161544 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9b8c107150 0x7f9b8c10daf0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:18:24.570 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:18:24.568+0000 7f9b92a00640 1 --2- 172.21.15.50:0/1888161544 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9b8c1067b0 0x7f9b8c106bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:18:24.570 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:18:24.568+0000 7f9b92a00640 1 --2- 172.21.15.50:0/1888161544 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9b8c105720 0x7f9b8c105b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:18:24.570 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:18:24.568+0000 7f9b92a00640 1 -- 172.21.15.50:0/1888161544 >> 172.21.15.50:0/1888161544 conn(0x7f9b8c101090 msgr2=0x7f9b8c103540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:18:24.570 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:18:24.568+0000 7f9b92a00640 1 -- 172.21.15.50:0/1888161544 shutdown_connections 2024-08-31T04:18:24.570 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:18:24.568+0000 7f9b92a00640 1 -- 172.21.15.50:0/1888161544 wait complete. 2024-08-31T04:18:24.570 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:18:24.569+0000 7f9b92a00640 1 Processor -- start 2024-08-31T04:18:24.571 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:18:24.569+0000 7f9b92a00640 1 -- start start 2024-08-31T04:18:24.571 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:18:24.570+0000 7f9b92a00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9b8c105720 0x7f9b8c19bf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:18:24.571 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:18:24.570+0000 7f9b92a00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9b8c1067b0 0x7f9b8c19c580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:18:24.571 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:18:24.570+0000 7f9b92a00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9b8c107150 0x7f9b8c19d120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:18:24.571 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:18:24.570+0000 7f9b92a00640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f9b8c1113a0 con 0x7f9b8c107150 2024-08-31T04:18:24.571 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:18:24.570+0000 7f9b92a00640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f9b8c111220 con 0x7f9b8c105720 2024-08-31T04:18:24.571 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:18:24.570+0000 7f9b92a00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f9b8c111520 con 0x7f9b8c1067b0 2024-08-31T04:18:24.572 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:18:24.570+0000 7f9b8be00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9b8c105720 0x7f9b8c19bf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:18:24.573 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:18:24.570+0000 7f9b90a00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9b8c107150 0x7f9b8c19d120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:18:24.573 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:18:24.570+0000 7f9b8be00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9b8c105720 0x7f9b8c19bf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.50:54706/0 (socket says 172.21.15.50:54706) 2024-08-31T04:18:24.573 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:18:24.570+0000 7f9b8be00640 1 -- 172.21.15.50:0/3170354966 learned_addr learned my addr 172.21.15.50:0/3170354966 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:18:24.573 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:18:24.570+0000 7f9b8b400640 1 --2- 172.21.15.50:0/3170354966 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9b8c1067b0 0x7f9b8c19c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:18:24.573 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:18:24.571+0000 7f9b8be00640 1 -- 172.21.15.50:0/3170354966 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9b8c1067b0 msgr2=0x7f9b8c19c580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:18:24.573 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:18:24.571+0000 7f9b8be00640 1 --2- 172.21.15.50:0/3170354966 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9b8c1067b0 0x7f9b8c19c580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:18:24.573 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:18:24.571+0000 7f9b8be00640 1 -- 172.21.15.50:0/3170354966 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9b8c107150 msgr2=0x7f9b8c19d120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:18:24.573 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:18:24.571+0000 7f9b8be00640 1 --2- 172.21.15.50:0/3170354966 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9b8c107150 0x7f9b8c19d120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:18:24.573 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:18:24.571+0000 7f9b8be00640 1 -- 172.21.15.50:0/3170354966 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b8c19d940 con 0x7f9b8c105720 2024-08-31T04:18:24.573 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:18:24.571+0000 7f9b8be00640 1 --2- 172.21.15.50:0/3170354966 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9b8c105720 0x7f9b8c19bf10 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f9b7c00ea60 tx=0x7f9b7c00ef20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:18:24.573 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:18:24.571+0000 7f9b88c00640 1 -- 172.21.15.50:0/3170354966 <== mon.2 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b7c00cde0 con 0x7f9b8c105720 2024-08-31T04:18:24.573 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:18:24.571+0000 7f9b92a00640 1 -- 172.21.15.50:0/3170354966 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9b8c19dc30 con 0x7f9b8c105720 2024-08-31T04:18:24.574 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:18:24.571+0000 7f9b88c00640 1 -- 172.21.15.50:0/3170354966 <== mon.2 v2:172.21.15.133:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9b7c0035f0 con 0x7f9b8c105720 2024-08-31T04:18:24.574 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:18:24.571+0000 7f9b88c00640 1 -- 172.21.15.50:0/3170354966 <== mon.2 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b7c010690 con 0x7f9b8c105720 2024-08-31T04:18:24.574 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:18:24.571+0000 7f9b92a00640 1 -- 172.21.15.50:0/3170354966 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9b8c1a4330 con 0x7f9b8c105720 2024-08-31T04:18:24.574 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:18:24.573+0000 7f9b92a00640 1 -- 172.21.15.50:0/3170354966 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9b8c10c900 con 0x7f9b8c105720 2024-08-31T04:18:24.576 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:18:24.575+0000 7f9b88c00640 1 -- 172.21.15.50:0/3170354966 <== mon.2 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 16) ==== 152577+0+0 (secure 0 0 0) 0x7f9b7c0037a0 con 0x7f9b8c105720 2024-08-31T04:18:24.578 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:18:24.577+0000 7f9b88c00640 1 --2- 172.21.15.50:0/3170354966 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f9b700b4b30 0x7f9b700b7040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:18:24.578 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:18:24.577+0000 7f9b88c00640 1 -- 172.21.15.50:0/3170354966 <== mon.2 v2:172.21.15.133:3300/0 5 ==== osd_map(52..52 src has 1..52) ==== 5862+0+0 (secure 0 0 0) 0x7f9b7c0e4d30 con 0x7f9b8c105720 2024-08-31T04:18:24.578 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:18:24.577+0000 7f9b8b400640 1 --2- 172.21.15.50:0/3170354966 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f9b700b4b30 0x7f9b700b7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:18:24.579 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:18:24.578+0000 7f9b8b400640 1 --2- 172.21.15.50:0/3170354966 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f9b700b4b30 0x7f9b700b7040 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f9b78005d00 tx=0x7f9b7800b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:18:24.580 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:18:24.579+0000 7f9b88c00640 1 -- 172.21.15.50:0/3170354966 <== mon.2 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f9b7c056130 con 0x7f9b8c105720 2024-08-31T04:18:24.788 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:18:24.786+0000 7f9b92a00640 1 -- 172.21.15.50:0/3170354966 --> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi050:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7f9b8c0635a0 con 0x7f9b700b4b30 2024-08-31T04:18:25.293 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:18:25 smithi133 ceph-mon[22177]: purged_snaps scrub starts 2024-08-31T04:18:25.293 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:18:25 smithi133 ceph-mon[22177]: purged_snaps scrub ok 2024-08-31T04:18:25.293 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:18:25 smithi133 ceph-mon[22177]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-08-31T04:18:25.293 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:18:25 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-08-31T04:18:25.293 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:18:25 smithi133 ceph-mon[22177]: osd.8 [v2:172.21.15.177:6816/101973300,v1:172.21.15.177:6817/101973300] boot 2024-08-31T04:18:25.293 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:18:25 smithi133 ceph-mon[22177]: osdmap e52: 9 total, 9 up, 9 in 2024-08-31T04:18:25.293 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:18:25 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-08-31T04:18:25.293 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:18:25 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-31T04:18:25.293 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:18:25 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-31T04:18:25.294 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:18:25 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:18:25.383 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:18:25 smithi050 ceph-mon[17259]: purged_snaps scrub starts 2024-08-31T04:18:25.383 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:18:25 smithi050 ceph-mon[17259]: purged_snaps scrub ok 2024-08-31T04:18:25.384 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:18:25 smithi050 ceph-mon[17259]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-08-31T04:18:25.384 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:18:25 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-08-31T04:18:25.384 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:18:25 smithi050 ceph-mon[17259]: osd.8 [v2:172.21.15.177:6816/101973300,v1:172.21.15.177:6817/101973300] boot 2024-08-31T04:18:25.384 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:18:25 smithi050 ceph-mon[17259]: osdmap e52: 9 total, 9 up, 9 in 2024-08-31T04:18:25.384 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:18:25 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-08-31T04:18:25.384 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:18:25 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-31T04:18:25.384 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:18:25 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-31T04:18:25.384 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:18:25 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:18:25.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:18:25 smithi177 ceph-mon[22025]: purged_snaps scrub starts 2024-08-31T04:18:25.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:18:25 smithi177 ceph-mon[22025]: purged_snaps scrub ok 2024-08-31T04:18:25.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:18:25 smithi177 ceph-mon[22025]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-08-31T04:18:25.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:18:25 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-08-31T04:18:25.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:18:25 smithi177 ceph-mon[22025]: osd.8 [v2:172.21.15.177:6816/101973300,v1:172.21.15.177:6817/101973300] boot 2024-08-31T04:18:25.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:18:25 smithi177 ceph-mon[22025]: osdmap e52: 9 total, 9 up, 9 in 2024-08-31T04:18:25.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:18:25 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-08-31T04:18:25.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:18:25 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-31T04:18:25.497 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:18:25 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-31T04:18:25.497 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:18:25 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:18:26.392 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:18:26 smithi050 ceph-mon[17259]: from='client.24476 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi050:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:18:26.392 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:18:26 smithi050 ceph-mon[17259]: osdmap e53: 9 total, 9 up, 9 in 2024-08-31T04:18:26.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:18:26 smithi177 ceph-mon[22025]: from='client.24476 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi050:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:18:26.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:18:26 smithi177 ceph-mon[22025]: osdmap e53: 9 total, 9 up, 9 in 2024-08-31T04:18:26.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:18:26 smithi133 ceph-mon[22177]: from='client.24476 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi050:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:18:26.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:18:26 smithi133 ceph-mon[22177]: osdmap e53: 9 total, 9 up, 9 in 2024-08-31T04:18:27.133 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:18:27 smithi050 ceph-mon[17259]: pgmap v208: 1 pgs: 1 peering; 577 KiB data, 254 MiB used, 804 GiB / 805 GiB avail 2024-08-31T04:18:27.133 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:18:27 smithi050 ceph-mon[17259]: osdmap e54: 9 total, 9 up, 9 in 2024-08-31T04:18:27.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:18:27 smithi177 ceph-mon[22025]: pgmap v208: 1 pgs: 1 peering; 577 KiB data, 254 MiB used, 804 GiB / 805 GiB avail 2024-08-31T04:18:27.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:18:27 smithi177 ceph-mon[22025]: osdmap e54: 9 total, 9 up, 9 in 2024-08-31T04:18:27.542 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:18:27 smithi133 ceph-mon[22177]: pgmap v208: 1 pgs: 1 peering; 577 KiB data, 254 MiB used, 804 GiB / 805 GiB avail 2024-08-31T04:18:27.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:18:27 smithi133 ceph-mon[22177]: osdmap e54: 9 total, 9 up, 9 in 2024-08-31T04:18:29.450 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:18:29 smithi050 ceph-mon[17259]: pgmap v210: 1 pgs: 1 peering; 577 KiB data, 254 MiB used, 804 GiB / 805 GiB avail 2024-08-31T04:18:29.450 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:18:29 smithi050 ceph-mon[17259]: from='client.? 172.21.15.50:0/2187957881' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "fcedbe16-b910-407f-b9d7-1dd03f3e62a7"} : dispatch 2024-08-31T04:18:29.451 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:18:29 smithi050 ceph-mon[17259]: from='client.? 172.21.15.50:0/2187957881' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "fcedbe16-b910-407f-b9d7-1dd03f3e62a7"}]': finished 2024-08-31T04:18:29.451 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:18:29 smithi050 ceph-mon[17259]: osdmap e55: 10 total, 9 up, 10 in 2024-08-31T04:18:29.451 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:18:29 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-08-31T04:18:29.451 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:18:29 smithi050 ceph-mon[17259]: from='client.? 172.21.15.50:0/1631298300' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-31T04:18:29.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:18:29 smithi177 ceph-mon[22025]: pgmap v210: 1 pgs: 1 peering; 577 KiB data, 254 MiB used, 804 GiB / 805 GiB avail 2024-08-31T04:18:29.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:18:29 smithi177 ceph-mon[22025]: from='client.? 172.21.15.50:0/2187957881' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "fcedbe16-b910-407f-b9d7-1dd03f3e62a7"} : dispatch 2024-08-31T04:18:29.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:18:29 smithi177 ceph-mon[22025]: from='client.? 172.21.15.50:0/2187957881' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "fcedbe16-b910-407f-b9d7-1dd03f3e62a7"}]': finished 2024-08-31T04:18:29.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:18:29 smithi177 ceph-mon[22025]: osdmap e55: 10 total, 9 up, 10 in 2024-08-31T04:18:29.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:18:29 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-08-31T04:18:29.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:18:29 smithi177 ceph-mon[22025]: from='client.? 172.21.15.50:0/1631298300' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-31T04:18:29.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:18:29 smithi133 ceph-mon[22177]: pgmap v210: 1 pgs: 1 peering; 577 KiB data, 254 MiB used, 804 GiB / 805 GiB avail 2024-08-31T04:18:29.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:18:29 smithi133 ceph-mon[22177]: from='client.? 172.21.15.50:0/2187957881' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "fcedbe16-b910-407f-b9d7-1dd03f3e62a7"} : dispatch 2024-08-31T04:18:29.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:18:29 smithi133 ceph-mon[22177]: from='client.? 172.21.15.50:0/2187957881' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "fcedbe16-b910-407f-b9d7-1dd03f3e62a7"}]': finished 2024-08-31T04:18:29.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:18:29 smithi133 ceph-mon[22177]: osdmap e55: 10 total, 9 up, 10 in 2024-08-31T04:18:29.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:18:29 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-08-31T04:18:29.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:18:29 smithi133 ceph-mon[22177]: from='client.? 172.21.15.50:0/1631298300' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-31T04:18:31.450 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:18:31 smithi050 ceph-mon[17259]: pgmap v212: 1 pgs: 1 peering; 577 KiB data, 255 MiB used, 804 GiB / 805 GiB avail 2024-08-31T04:18:31.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:18:31 smithi177 ceph-mon[22025]: pgmap v212: 1 pgs: 1 peering; 577 KiB data, 255 MiB used, 804 GiB / 805 GiB avail 2024-08-31T04:18:31.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:18:31 smithi133 ceph-mon[22177]: pgmap v212: 1 pgs: 1 peering; 577 KiB data, 255 MiB used, 804 GiB / 805 GiB avail 2024-08-31T04:18:33.327 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:18:33 smithi050 ceph-mon[17259]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 255 MiB used, 804 GiB / 805 GiB avail; 85 KiB/s, 0 objects/s recovering 2024-08-31T04:18:33.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:18:33 smithi177 ceph-mon[22025]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 255 MiB used, 804 GiB / 805 GiB avail; 85 KiB/s, 0 objects/s recovering 2024-08-31T04:18:33.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:18:33 smithi133 ceph-mon[22177]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 255 MiB used, 804 GiB / 805 GiB avail; 85 KiB/s, 0 objects/s recovering 2024-08-31T04:18:35.336 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:18:35 smithi050 ceph-mon[17259]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 255 MiB used, 804 GiB / 805 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-08-31T04:18:35.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:18:35 smithi177 ceph-mon[22025]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 255 MiB used, 804 GiB / 805 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-08-31T04:18:35.542 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:18:35 smithi133 ceph-mon[22177]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 255 MiB used, 804 GiB / 805 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-08-31T04:18:37.266 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:18:37 smithi050 ceph-mon[17259]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 255 MiB used, 804 GiB / 805 GiB avail; 59 KiB/s, 0 objects/s recovering 2024-08-31T04:18:37.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:18:37 smithi177 ceph-mon[22025]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 255 MiB used, 804 GiB / 805 GiB avail; 59 KiB/s, 0 objects/s recovering 2024-08-31T04:18:37.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:18:37 smithi133 ceph-mon[22177]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 255 MiB used, 804 GiB / 805 GiB avail; 59 KiB/s, 0 objects/s recovering 2024-08-31T04:18:38.200 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:18:38 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.9"} : dispatch 2024-08-31T04:18:38.200 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:18:38 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:18:38.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:18:38 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.9"} : dispatch 2024-08-31T04:18:38.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:18:38 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:18:38.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:18:38 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.9"} : dispatch 2024-08-31T04:18:38.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:18:38 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:18:39.200 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:18:39 smithi050 ceph-mon[17259]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 255 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-08-31T04:18:39.200 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:18:39 smithi050 ceph-mon[17259]: Deploying daemon osd.9 on smithi050 2024-08-31T04:18:39.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:18:39 smithi177 ceph-mon[22025]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 255 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-08-31T04:18:39.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:18:39 smithi177 ceph-mon[22025]: Deploying daemon osd.9 on smithi050 2024-08-31T04:18:39.542 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:18:39 smithi133 ceph-mon[22177]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 255 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-08-31T04:18:39.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:18:39 smithi133 ceph-mon[22177]: Deploying daemon osd.9 on smithi050 2024-08-31T04:18:41.156 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:18:41 smithi050 ceph-mon[17259]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 255 MiB used, 804 GiB / 805 GiB avail; 49 KiB/s, 0 objects/s recovering 2024-08-31T04:18:41.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:18:41 smithi177 ceph-mon[22025]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 255 MiB used, 804 GiB / 805 GiB avail; 49 KiB/s, 0 objects/s recovering 2024-08-31T04:18:41.542 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:18:41 smithi133 ceph-mon[22177]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 255 MiB used, 804 GiB / 805 GiB avail; 49 KiB/s, 0 objects/s recovering 2024-08-31T04:18:43.200 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:18:43 smithi050 ceph-mon[17259]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 255 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-08-31T04:18:43.345 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:18:43 smithi133 ceph-mon[22177]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 255 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-08-31T04:18:43.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:18:43 smithi177 ceph-mon[22025]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 255 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-08-31T04:18:45.450 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:18:45 smithi050 ceph-mon[17259]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 255 MiB used, 804 GiB / 805 GiB avail 2024-08-31T04:18:45.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:18:45 smithi177 ceph-mon[22025]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 255 MiB used, 804 GiB / 805 GiB avail 2024-08-31T04:18:45.544 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:18:45 smithi133 ceph-mon[22177]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 255 MiB used, 804 GiB / 805 GiB avail 2024-08-31T04:18:46.200 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:18:46 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T04:18:46.200 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:18:46 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:18:46.200 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:18:46 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:18:46.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:18:46 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T04:18:46.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:18:46 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:18:46.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:18:46 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:18:46.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:18:46 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T04:18:46.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:18:46 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:18:46.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:18:46 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:18:47.450 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:18:47 smithi050 ceph-mon[17259]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 255 MiB used, 804 GiB / 805 GiB avail 2024-08-31T04:18:47.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:18:47 smithi177 ceph-mon[22025]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 255 MiB used, 804 GiB / 805 GiB avail 2024-08-31T04:18:47.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:18:47 smithi133 ceph-mon[22177]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 255 MiB used, 804 GiB / 805 GiB avail 2024-08-31T04:18:49.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:18:49 smithi050 ceph-mon[17259]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 255 MiB used, 804 GiB / 805 GiB avail 2024-08-31T04:18:49.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:18:49 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:18:49.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:18:49 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:18:49.701 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:18:49 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:18:49.701 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:18:49 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T04:18:49.701 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:18:49 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:18:49.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:18:49 smithi177 ceph-mon[22025]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 255 MiB used, 804 GiB / 805 GiB avail 2024-08-31T04:18:49.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:18:49 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:18:49.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:18:49 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:18:49.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:18:49 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:18:49.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:18:49 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T04:18:49.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:18:49 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:18:49.792 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:18:49 smithi133 ceph-mon[22177]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 255 MiB used, 804 GiB / 805 GiB avail 2024-08-31T04:18:49.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:18:49 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:18:49.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:18:49 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:18:49.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:18:49 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:18:49.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:18:49 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T04:18:49.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:18:49 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:18:50.167 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:18:50.166+0000 7f9b88c00640 1 -- 172.21.15.50:0/3170354966 <== mgr.14150 v2:172.21.15.50:6800/2146686622 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f9b8c0635a0 con 0x7f9b700b4b30 2024-08-31T04:18:50.168 INFO:teuthology.orchestra.run.smithi050.stdout:Created osd(s) 9 on host 'smithi050' 2024-08-31T04:18:50.170 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:18:50.168+0000 7f9b92a00640 1 -- 172.21.15.50:0/3170354966 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f9b700b4b30 msgr2=0x7f9b700b7040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:18:50.170 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:18:50.168+0000 7f9b92a00640 1 --2- 172.21.15.50:0/3170354966 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f9b700b4b30 0x7f9b700b7040 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f9b78005d00 tx=0x7f9b7800b410 comp rx=0 tx=0).stop 2024-08-31T04:18:50.170 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:18:50.168+0000 7f9b92a00640 1 -- 172.21.15.50:0/3170354966 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9b8c105720 msgr2=0x7f9b8c19bf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:18:50.170 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:18:50.168+0000 7f9b92a00640 1 --2- 172.21.15.50:0/3170354966 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9b8c105720 0x7f9b8c19bf10 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f9b7c00ea60 tx=0x7f9b7c00ef20 comp rx=0 tx=0).stop 2024-08-31T04:18:50.170 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:18:50.168+0000 7f9b92a00640 1 -- 172.21.15.50:0/3170354966 shutdown_connections 2024-08-31T04:18:50.170 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:18:50.169+0000 7f9b92a00640 1 --2- 172.21.15.50:0/3170354966 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f9b700b4b30 0x7f9b700b7040 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:18:50.170 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:18:50.169+0000 7f9b92a00640 1 --2- 172.21.15.50:0/3170354966 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9b8c1067b0 0x7f9b8c19c580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:18:50.171 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:18:50.169+0000 7f9b92a00640 1 --2- 172.21.15.50:0/3170354966 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9b8c107150 0x7f9b8c19d120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:18:50.171 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:18:50.169+0000 7f9b92a00640 1 --2- 172.21.15.50:0/3170354966 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9b8c105720 0x7f9b8c19bf10 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:18:50.171 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:18:50.169+0000 7f9b92a00640 1 -- 172.21.15.50:0/3170354966 >> 172.21.15.50:0/3170354966 conn(0x7f9b8c101090 msgr2=0x7f9b8c109ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:18:50.171 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:18:50.169+0000 7f9b92a00640 1 -- 172.21.15.50:0/3170354966 shutdown_connections 2024-08-31T04:18:50.171 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:18:50.169+0000 7f9b92a00640 1 -- 172.21.15.50:0/3170354966 wait complete. 2024-08-31T04:18:50.450 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:18:50 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T04:18:50.450 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:18:50 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:18:50.450 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:18:50 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:18:50.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:18:50 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T04:18:50.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:18:50 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:18:50.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:18:50 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:18:50.792 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:18:50 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T04:18:50.792 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:18:50 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:18:50.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:18:50 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:18:50.901 DEBUG:teuthology.orchestra.run.smithi050:osd.9> sudo journalctl -f -n 0 -u ceph-058d9fc6-674f-11ef-bcd4-c7b262605968@osd.9.service 2024-08-31T04:18:50.905 INFO:tasks.cephadm:Deploying osd.10 on smithi133 with /dev/vg_nvme/lv_1... 2024-08-31T04:18:50.905 DEBUG:teuthology.orchestra.run.smithi133:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 058d9fc6-674f-11ef-bcd4-c7b262605968 -- lvm zap /dev/vg_nvme/lv_1 2024-08-31T04:18:51.159 INFO:teuthology.orchestra.run.smithi133.stderr:Inferring config /var/lib/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/mon.b/config 2024-08-31T04:18:51.450 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:18:51 smithi050 ceph-mon[17259]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 255 MiB used, 804 GiB / 805 GiB avail 2024-08-31T04:18:51.450 INFO:journalctl@ceph.osd.9.smithi050.stdout:Aug 31 04:18:51 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-9[52806]: 2024-08-31T04:18:51.310+0000 7f30ce241640 -1 osd.9 0 log_to_monitors true 2024-08-31T04:18:51.530 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:18:51 smithi133 ceph-mon[22177]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 255 MiB used, 804 GiB / 805 GiB avail 2024-08-31T04:18:51.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:18:51 smithi177 ceph-mon[22025]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 255 MiB used, 804 GiB / 805 GiB avail 2024-08-31T04:18:52.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:18:52 smithi133 ceph-mon[22177]: from='osd.9 [v2:172.21.15.50:6826/53019860,v1:172.21.15.50:6827/53019860]' entity='osd.9' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]} : dispatch 2024-08-31T04:18:52.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:18:52 smithi133 ceph-mon[22177]: from='osd.9 ' entity='osd.9' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]} : dispatch 2024-08-31T04:18:52.633 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:18:52 smithi050 ceph-mon[17259]: from='osd.9 [v2:172.21.15.50:6826/53019860,v1:172.21.15.50:6827/53019860]' entity='osd.9' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]} : dispatch 2024-08-31T04:18:52.634 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:18:52 smithi050 ceph-mon[17259]: from='osd.9 ' entity='osd.9' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]} : dispatch 2024-08-31T04:18:52.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:18:52 smithi177 ceph-mon[22025]: from='osd.9 [v2:172.21.15.50:6826/53019860,v1:172.21.15.50:6827/53019860]' entity='osd.9' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]} : dispatch 2024-08-31T04:18:52.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:18:52 smithi177 ceph-mon[22025]: from='osd.9 ' entity='osd.9' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]} : dispatch 2024-08-31T04:18:53.663 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:18:53 smithi133 ceph-mon[22177]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 255 MiB used, 804 GiB / 805 GiB avail 2024-08-31T04:18:53.663 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:18:53 smithi133 ceph-mon[22177]: from='osd.9 ' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-08-31T04:18:53.663 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:18:53 smithi133 ceph-mon[22177]: osdmap e56: 10 total, 9 up, 10 in 2024-08-31T04:18:53.663 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:18:53 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-08-31T04:18:53.663 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:18:53 smithi133 ceph-mon[22177]: from='osd.9 [v2:172.21.15.50:6826/53019860,v1:172.21.15.50:6827/53019860]' entity='osd.9' cmd={"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi050", "root=default"]} : dispatch 2024-08-31T04:18:53.663 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:18:53 smithi133 ceph-mon[22177]: from='osd.9 ' entity='osd.9' cmd={"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi050", "root=default"]} : dispatch 2024-08-31T04:18:53.665 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-08-31T04:18:53.690 DEBUG:teuthology.orchestra.run.smithi133:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 058d9fc6-674f-11ef-bcd4-c7b262605968 -- ceph orch daemon add osd smithi133:vg_nvme/lv_1 2024-08-31T04:18:53.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:18:53 smithi050 ceph-mon[17259]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 255 MiB used, 804 GiB / 805 GiB avail 2024-08-31T04:18:53.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:18:53 smithi050 ceph-mon[17259]: from='osd.9 ' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-08-31T04:18:53.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:18:53 smithi050 ceph-mon[17259]: osdmap e56: 10 total, 9 up, 10 in 2024-08-31T04:18:53.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:18:53 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-08-31T04:18:53.701 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:18:53 smithi050 ceph-mon[17259]: from='osd.9 [v2:172.21.15.50:6826/53019860,v1:172.21.15.50:6827/53019860]' entity='osd.9' cmd={"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi050", "root=default"]} : dispatch 2024-08-31T04:18:53.701 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:18:53 smithi050 ceph-mon[17259]: from='osd.9 ' entity='osd.9' cmd={"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi050", "root=default"]} : dispatch 2024-08-31T04:18:53.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:18:53 smithi177 ceph-mon[22025]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 255 MiB used, 804 GiB / 805 GiB avail 2024-08-31T04:18:53.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:18:53 smithi177 ceph-mon[22025]: from='osd.9 ' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-08-31T04:18:53.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:18:53 smithi177 ceph-mon[22025]: osdmap e56: 10 total, 9 up, 10 in 2024-08-31T04:18:53.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:18:53 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-08-31T04:18:53.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:18:53 smithi177 ceph-mon[22025]: from='osd.9 [v2:172.21.15.50:6826/53019860,v1:172.21.15.50:6827/53019860]' entity='osd.9' cmd={"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi050", "root=default"]} : dispatch 2024-08-31T04:18:53.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:18:53 smithi177 ceph-mon[22025]: from='osd.9 ' entity='osd.9' cmd={"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi050", "root=default"]} : dispatch 2024-08-31T04:18:53.934 INFO:teuthology.orchestra.run.smithi133.stderr:Inferring config /var/lib/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/mon.b/config 2024-08-31T04:18:54.060 INFO:journalctl@ceph.osd.9.smithi050.stdout:Aug 31 04:18:54 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-9[52806]: 2024-08-31T04:18:54.026+0000 7f30c9400640 -1 osd.9 0 waiting for initial osdmap 2024-08-31T04:18:54.335 INFO:journalctl@ceph.osd.9.smithi050.stdout:Aug 31 04:18:54 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-9[52806]: 2024-08-31T04:18:54.058+0000 7f30bea00640 -1 osd.9 57 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-31T04:18:54.424 INFO:teuthology.orchestra.run.smithi133.stderr:2024-08-31T04:18:54.410+0000 7fe6e83b2640 1 -- 172.21.15.133:0/2101601059 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe6e0104f20 msgr2=0x7fe6e010b8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:18:54.425 INFO:teuthology.orchestra.run.smithi133.stderr:2024-08-31T04:18:54.410+0000 7fe6e83b2640 1 --2- 172.21.15.133:0/2101601059 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe6e0104f20 0x7fe6e010b8c0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fe6d8009ca0 tx=0x7fe6d802a950 comp rx=0 tx=0).stop 2024-08-31T04:18:54.425 INFO:teuthology.orchestra.run.smithi133.stderr:2024-08-31T04:18:54.410+0000 7fe6e83b2640 1 -- 172.21.15.133:0/2101601059 shutdown_connections 2024-08-31T04:18:54.425 INFO:teuthology.orchestra.run.smithi133.stderr:2024-08-31T04:18:54.410+0000 7fe6e83b2640 1 --2- 172.21.15.133:0/2101601059 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe6e0104580 0x7fe6e0104990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:18:54.425 INFO:teuthology.orchestra.run.smithi133.stderr:2024-08-31T04:18:54.410+0000 7fe6e83b2640 1 --2- 172.21.15.133:0/2101601059 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe6e0104f20 0x7fe6e010b8c0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:18:54.425 INFO:teuthology.orchestra.run.smithi133.stderr:2024-08-31T04:18:54.410+0000 7fe6e83b2640 1 --2- 172.21.15.133:0/2101601059 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe6e01034f0 0x7fe6e0103960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:18:54.425 INFO:teuthology.orchestra.run.smithi133.stderr:2024-08-31T04:18:54.410+0000 7fe6e83b2640 1 -- 172.21.15.133:0/2101601059 >> 172.21.15.133:0/2101601059 conn(0x7fe6e00fee60 msgr2=0x7fe6e0101310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:18:54.425 INFO:teuthology.orchestra.run.smithi133.stderr:2024-08-31T04:18:54.410+0000 7fe6e83b2640 1 -- 172.21.15.133:0/2101601059 shutdown_connections 2024-08-31T04:18:54.425 INFO:teuthology.orchestra.run.smithi133.stderr:2024-08-31T04:18:54.410+0000 7fe6e83b2640 1 -- 172.21.15.133:0/2101601059 wait complete. 2024-08-31T04:18:54.425 INFO:teuthology.orchestra.run.smithi133.stderr:2024-08-31T04:18:54.411+0000 7fe6e83b2640 1 Processor -- start 2024-08-31T04:18:54.425 INFO:teuthology.orchestra.run.smithi133.stderr:2024-08-31T04:18:54.411+0000 7fe6e83b2640 1 -- start start 2024-08-31T04:18:54.425 INFO:teuthology.orchestra.run.smithi133.stderr:2024-08-31T04:18:54.411+0000 7fe6e83b2640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe6e01034f0 0x7fe6e0199ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:18:54.426 INFO:teuthology.orchestra.run.smithi133.stderr:2024-08-31T04:18:54.411+0000 7fe6e83b2640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe6e0104580 0x7fe6e019a350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:18:54.426 INFO:teuthology.orchestra.run.smithi133.stderr:2024-08-31T04:18:54.411+0000 7fe6e83b2640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe6e0104f20 0x7fe6e019aef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:18:54.426 INFO:teuthology.orchestra.run.smithi133.stderr:2024-08-31T04:18:54.411+0000 7fe6e83b2640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fe6e010f110 con 0x7fe6e0104580 2024-08-31T04:18:54.426 INFO:teuthology.orchestra.run.smithi133.stderr:2024-08-31T04:18:54.411+0000 7fe6e83b2640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7fe6e010ef90 con 0x7fe6e01034f0 2024-08-31T04:18:54.426 INFO:teuthology.orchestra.run.smithi133.stderr:2024-08-31T04:18:54.411+0000 7fe6e83b2640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fe6e010f290 con 0x7fe6e0104f20 2024-08-31T04:18:54.426 INFO:teuthology.orchestra.run.smithi133.stderr:2024-08-31T04:18:54.411+0000 7fe6e614e640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe6e01034f0 0x7fe6e0199ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:18:54.426 INFO:teuthology.orchestra.run.smithi133.stderr:2024-08-31T04:18:54.411+0000 7fe6e614e640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe6e01034f0 0x7fe6e0199ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:59534/0 (socket says 172.21.15.133:59534) 2024-08-31T04:18:54.426 INFO:teuthology.orchestra.run.smithi133.stderr:2024-08-31T04:18:54.411+0000 7fe6e614e640 1 -- 172.21.15.133:0/4293806562 learned_addr learned my addr 172.21.15.133:0/4293806562 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-08-31T04:18:54.426 INFO:teuthology.orchestra.run.smithi133.stderr:2024-08-31T04:18:54.411+0000 7fe6e694f640 1 --2- 172.21.15.133:0/4293806562 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe6e0104f20 0x7fe6e019aef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:18:54.426 INFO:teuthology.orchestra.run.smithi133.stderr:2024-08-31T04:18:54.411+0000 7fe6e614e640 1 -- 172.21.15.133:0/4293806562 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe6e0104f20 msgr2=0x7fe6e019aef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:18:54.426 INFO:teuthology.orchestra.run.smithi133.stderr:2024-08-31T04:18:54.411+0000 7fe6e614e640 1 --2- 172.21.15.133:0/4293806562 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe6e0104f20 0x7fe6e019aef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:18:54.426 INFO:teuthology.orchestra.run.smithi133.stderr:2024-08-31T04:18:54.411+0000 7fe6e614e640 1 -- 172.21.15.133:0/4293806562 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe6e0104580 msgr2=0x7fe6e019a350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:18:54.427 INFO:teuthology.orchestra.run.smithi133.stderr:2024-08-31T04:18:54.411+0000 7fe6e614e640 1 --2- 172.21.15.133:0/4293806562 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe6e0104580 0x7fe6e019a350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:18:54.427 INFO:teuthology.orchestra.run.smithi133.stderr:2024-08-31T04:18:54.411+0000 7fe6e614e640 1 -- 172.21.15.133:0/4293806562 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6e019b680 con 0x7fe6e01034f0 2024-08-31T04:18:54.427 INFO:teuthology.orchestra.run.smithi133.stderr:2024-08-31T04:18:54.411+0000 7fe6e694f640 1 --2- 172.21.15.133:0/4293806562 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe6e0104f20 0x7fe6e019aef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:18:54.427 INFO:teuthology.orchestra.run.smithi133.stderr:2024-08-31T04:18:54.411+0000 7fe6e614e640 1 --2- 172.21.15.133:0/4293806562 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe6e01034f0 0x7fe6e0199ce0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fe6dc00d950 tx=0x7fe6dc00de10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:18:54.427 INFO:teuthology.orchestra.run.smithi133.stderr:2024-08-31T04:18:54.412+0000 7fe6d77fe640 1 -- 172.21.15.133:0/4293806562 <== mon.2 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6dc017070 con 0x7fe6e01034f0 2024-08-31T04:18:54.427 INFO:teuthology.orchestra.run.smithi133.stderr:2024-08-31T04:18:54.412+0000 7fe6e83b2640 1 -- 172.21.15.133:0/4293806562 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe6e019b970 con 0x7fe6e01034f0 2024-08-31T04:18:54.427 INFO:teuthology.orchestra.run.smithi133.stderr:2024-08-31T04:18:54.412+0000 7fe6d77fe640 1 -- 172.21.15.133:0/4293806562 <== mon.2 v2:172.21.15.133:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe6dc009c30 con 0x7fe6e01034f0 2024-08-31T04:18:54.427 INFO:teuthology.orchestra.run.smithi133.stderr:2024-08-31T04:18:54.412+0000 7fe6d77fe640 1 -- 172.21.15.133:0/4293806562 <== mon.2 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6dc00f620 con 0x7fe6e01034f0 2024-08-31T04:18:54.427 INFO:teuthology.orchestra.run.smithi133.stderr:2024-08-31T04:18:54.412+0000 7fe6e83b2640 1 -- 172.21.15.133:0/4293806562 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe6e01a2100 con 0x7fe6e01034f0 2024-08-31T04:18:54.427 INFO:teuthology.orchestra.run.smithi133.stderr:2024-08-31T04:18:54.413+0000 7fe6e83b2640 1 -- 172.21.15.133:0/4293806562 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe6e010a6b0 con 0x7fe6e01034f0 2024-08-31T04:18:54.427 INFO:teuthology.orchestra.run.smithi133.stderr:2024-08-31T04:18:54.414+0000 7fe6d77fe640 1 -- 172.21.15.133:0/4293806562 <== mon.2 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 16) ==== 152577+0+0 (secure 0 0 0) 0x7fe6dc010460 con 0x7fe6e01034f0 2024-08-31T04:18:54.427 INFO:teuthology.orchestra.run.smithi133.stderr:2024-08-31T04:18:54.415+0000 7fe6d77fe640 1 --2- 172.21.15.133:0/4293806562 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fe6cc0b4b30 0x7fe6cc0b7040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:18:54.427 INFO:teuthology.orchestra.run.smithi133.stderr:2024-08-31T04:18:54.415+0000 7fe6d77fe640 1 -- 172.21.15.133:0/4293806562 <== mon.2 v2:172.21.15.133:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5981+0+0 (secure 0 0 0) 0x7fe6dc0e4500 con 0x7fe6e01034f0 2024-08-31T04:18:54.427 INFO:teuthology.orchestra.run.smithi133.stderr:2024-08-31T04:18:54.415+0000 7fe6e594d640 1 --2- 172.21.15.133:0/4293806562 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fe6cc0b4b30 0x7fe6cc0b7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:18:54.428 INFO:teuthology.orchestra.run.smithi133.stderr:2024-08-31T04:18:54.416+0000 7fe6e594d640 1 --2- 172.21.15.133:0/4293806562 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fe6cc0b4b30 0x7fe6cc0b7040 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fe6d000a990 tx=0x7fe6d0005c70 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:18:54.428 INFO:teuthology.orchestra.run.smithi133.stderr:2024-08-31T04:18:54.418+0000 7fe6d77fe640 1 -- 172.21.15.133:0/4293806562 <== mon.2 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fe6dc0abf50 con 0x7fe6e01034f0 2024-08-31T04:18:54.604 INFO:teuthology.orchestra.run.smithi133.stderr:2024-08-31T04:18:54.603+0000 7fe6e83b2640 1 -- 172.21.15.133:0/4293806562 --> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi133:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7fe6e019bba0 con 0x7fe6cc0b4b30 2024-08-31T04:18:54.605 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:18:54 smithi177 ceph-mon[22025]: purged_snaps scrub starts 2024-08-31T04:18:54.605 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:18:54 smithi177 ceph-mon[22025]: purged_snaps scrub ok 2024-08-31T04:18:54.605 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:18:54 smithi177 ceph-mon[22025]: from='osd.9 ' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi050", "root=default"]}]': finished 2024-08-31T04:18:54.605 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:18:54 smithi177 ceph-mon[22025]: osdmap e57: 10 total, 9 up, 10 in 2024-08-31T04:18:54.605 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:18:54 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-08-31T04:18:54.605 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:18:54 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-08-31T04:18:54.605 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:18:54 smithi177 ceph-mon[22025]: from='osd.9 ' entity='osd.9' 2024-08-31T04:18:54.605 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:18:54 smithi133 ceph-mon[22177]: purged_snaps scrub starts 2024-08-31T04:18:54.605 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:18:54 smithi133 ceph-mon[22177]: purged_snaps scrub ok 2024-08-31T04:18:54.605 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:18:54 smithi133 ceph-mon[22177]: from='osd.9 ' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi050", "root=default"]}]': finished 2024-08-31T04:18:54.606 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:18:54 smithi133 ceph-mon[22177]: osdmap e57: 10 total, 9 up, 10 in 2024-08-31T04:18:54.606 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:18:54 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-08-31T04:18:54.606 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:18:54 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-08-31T04:18:54.606 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:18:54 smithi133 ceph-mon[22177]: from='osd.9 ' entity='osd.9' 2024-08-31T04:18:54.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:18:54 smithi050 ceph-mon[17259]: purged_snaps scrub starts 2024-08-31T04:18:54.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:18:54 smithi050 ceph-mon[17259]: purged_snaps scrub ok 2024-08-31T04:18:54.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:18:54 smithi050 ceph-mon[17259]: from='osd.9 ' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi050", "root=default"]}]': finished 2024-08-31T04:18:54.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:18:54 smithi050 ceph-mon[17259]: osdmap e57: 10 total, 9 up, 10 in 2024-08-31T04:18:54.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:18:54 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-08-31T04:18:54.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:18:54 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-08-31T04:18:54.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:18:54 smithi050 ceph-mon[17259]: from='osd.9 ' entity='osd.9' 2024-08-31T04:18:55.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:18:55 smithi050 ceph-mon[17259]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 255 MiB used, 804 GiB / 805 GiB avail 2024-08-31T04:18:55.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:18:55 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-08-31T04:18:55.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:18:55 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-31T04:18:55.701 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:18:55 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-31T04:18:55.701 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:18:55 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:18:55.701 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:18:55 smithi050 ceph-mon[17259]: osd.9 [v2:172.21.15.50:6826/53019860,v1:172.21.15.50:6827/53019860] boot 2024-08-31T04:18:55.701 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:18:55 smithi050 ceph-mon[17259]: osdmap e58: 10 total, 10 up, 10 in 2024-08-31T04:18:55.701 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:18:55 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-08-31T04:18:55.701 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:18:55 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:18:55.701 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:18:55 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:18:55.701 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:18:55 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-08-31T04:18:55.701 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:18:55 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-08-31T04:18:55.701 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:18:55 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-08-31T04:18:55.706 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:18:55 smithi133 ceph-mon[22177]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 255 MiB used, 804 GiB / 805 GiB avail 2024-08-31T04:18:55.706 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:18:55 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-08-31T04:18:55.706 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:18:55 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-31T04:18:55.706 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:18:55 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-31T04:18:55.706 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:18:55 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:18:55.706 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:18:55 smithi133 ceph-mon[22177]: osd.9 [v2:172.21.15.50:6826/53019860,v1:172.21.15.50:6827/53019860] boot 2024-08-31T04:18:55.707 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:18:55 smithi133 ceph-mon[22177]: osdmap e58: 10 total, 10 up, 10 in 2024-08-31T04:18:55.707 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:18:55 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-08-31T04:18:55.707 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:18:55 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:18:55.707 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:18:55 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:18:55.707 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:18:55 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-08-31T04:18:55.707 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:18:55 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-08-31T04:18:55.707 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:18:55 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-08-31T04:18:55.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:18:55 smithi177 ceph-mon[22025]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 255 MiB used, 804 GiB / 805 GiB avail 2024-08-31T04:18:55.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:18:55 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-08-31T04:18:55.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:18:55 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-31T04:18:55.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:18:55 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-31T04:18:55.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:18:55 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:18:55.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:18:55 smithi177 ceph-mon[22025]: osd.9 [v2:172.21.15.50:6826/53019860,v1:172.21.15.50:6827/53019860] boot 2024-08-31T04:18:55.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:18:55 smithi177 ceph-mon[22025]: osdmap e58: 10 total, 10 up, 10 in 2024-08-31T04:18:55.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:18:55 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-08-31T04:18:55.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:18:55 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:18:55.747 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:18:55 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:18:55.747 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:18:55 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-08-31T04:18:55.747 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:18:55 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-08-31T04:18:55.747 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:18:55 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-08-31T04:18:56.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:18:56 smithi133 ceph-mon[22177]: from='client.24503 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi133:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:18:56.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:18:56 smithi133 ceph-mon[22177]: Detected new or changed devices on smithi050 2024-08-31T04:18:56.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:18:56 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"} : dispatch 2024-08-31T04:18:56.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:18:56 smithi133 ceph-mon[22177]: Adjusting osd_memory_target on smithi050 to 4273M 2024-08-31T04:18:56.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:18:56 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:18:56.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:18:56 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:18:56.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:18:56 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T04:18:56.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:18:56 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:18:56.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:18:56 smithi133 ceph-mon[22177]: osdmap e59: 10 total, 10 up, 10 in 2024-08-31T04:18:56.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:18:56 smithi050 ceph-mon[17259]: from='client.24503 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi133:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:18:56.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:18:56 smithi050 ceph-mon[17259]: Detected new or changed devices on smithi050 2024-08-31T04:18:56.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:18:56 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"} : dispatch 2024-08-31T04:18:56.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:18:56 smithi050 ceph-mon[17259]: Adjusting osd_memory_target on smithi050 to 4273M 2024-08-31T04:18:56.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:18:56 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:18:56.701 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:18:56 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:18:56.701 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:18:56 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T04:18:56.701 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:18:56 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:18:56.701 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:18:56 smithi050 ceph-mon[17259]: osdmap e59: 10 total, 10 up, 10 in 2024-08-31T04:18:56.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:18:56 smithi177 ceph-mon[22025]: from='client.24503 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi133:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:18:56.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:18:56 smithi177 ceph-mon[22025]: Detected new or changed devices on smithi050 2024-08-31T04:18:56.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:18:56 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"} : dispatch 2024-08-31T04:18:56.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:18:56 smithi177 ceph-mon[22025]: Adjusting osd_memory_target on smithi050 to 4273M 2024-08-31T04:18:56.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:18:56 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:18:56.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:18:56 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:18:56.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:18:56 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T04:18:56.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:18:56 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:18:56.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:18:56 smithi177 ceph-mon[22025]: osdmap e59: 10 total, 10 up, 10 in 2024-08-31T04:18:57.641 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:18:57 smithi133 ceph-mon[22177]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 290 MiB used, 894 GiB / 894 GiB avail 2024-08-31T04:18:57.642 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:18:57 smithi133 ceph-mon[22177]: from='client.? 172.21.15.133:0/1692588536' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "3852756e-62f1-4e71-a070-8cff76df99b7"} : dispatch 2024-08-31T04:18:57.642 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:18:57 smithi133 ceph-mon[22177]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "3852756e-62f1-4e71-a070-8cff76df99b7"} : dispatch 2024-08-31T04:18:57.642 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:18:57 smithi133 ceph-mon[22177]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "3852756e-62f1-4e71-a070-8cff76df99b7"}]': finished 2024-08-31T04:18:57.642 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:18:57 smithi133 ceph-mon[22177]: osdmap e60: 11 total, 10 up, 11 in 2024-08-31T04:18:57.642 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:18:57 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-08-31T04:18:57.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:18:57 smithi050 ceph-mon[17259]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 290 MiB used, 894 GiB / 894 GiB avail 2024-08-31T04:18:57.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:18:57 smithi050 ceph-mon[17259]: from='client.? 172.21.15.133:0/1692588536' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "3852756e-62f1-4e71-a070-8cff76df99b7"} : dispatch 2024-08-31T04:18:57.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:18:57 smithi050 ceph-mon[17259]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "3852756e-62f1-4e71-a070-8cff76df99b7"} : dispatch 2024-08-31T04:18:57.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:18:57 smithi050 ceph-mon[17259]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "3852756e-62f1-4e71-a070-8cff76df99b7"}]': finished 2024-08-31T04:18:57.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:18:57 smithi050 ceph-mon[17259]: osdmap e60: 11 total, 10 up, 11 in 2024-08-31T04:18:57.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:18:57 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-08-31T04:18:57.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:18:57 smithi177 ceph-mon[22025]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 290 MiB used, 894 GiB / 894 GiB avail 2024-08-31T04:18:57.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:18:57 smithi177 ceph-mon[22025]: from='client.? 172.21.15.133:0/1692588536' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "3852756e-62f1-4e71-a070-8cff76df99b7"} : dispatch 2024-08-31T04:18:57.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:18:57 smithi177 ceph-mon[22025]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "3852756e-62f1-4e71-a070-8cff76df99b7"} : dispatch 2024-08-31T04:18:57.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:18:57 smithi177 ceph-mon[22025]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "3852756e-62f1-4e71-a070-8cff76df99b7"}]': finished 2024-08-31T04:18:57.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:18:57 smithi177 ceph-mon[22025]: osdmap e60: 11 total, 10 up, 11 in 2024-08-31T04:18:57.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:18:57 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-08-31T04:18:58.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:18:58 smithi050 ceph-mon[17259]: from='client.? 172.21.15.133:0/68826909' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-31T04:18:58.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:18:58 smithi177 ceph-mon[22025]: from='client.? 172.21.15.133:0/68826909' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-31T04:18:58.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:18:58 smithi133 ceph-mon[22177]: from='client.? 172.21.15.133:0/68826909' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-31T04:18:59.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:18:59 smithi050 ceph-mon[17259]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 290 MiB used, 894 GiB / 894 GiB avail 2024-08-31T04:18:59.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:18:59 smithi177 ceph-mon[22025]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 290 MiB used, 894 GiB / 894 GiB avail 2024-08-31T04:18:59.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:18:59 smithi133 ceph-mon[22177]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 290 MiB used, 894 GiB / 894 GiB avail 2024-08-31T04:19:01.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:19:01 smithi050 ceph-mon[17259]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 290 MiB used, 894 GiB / 894 GiB avail 2024-08-31T04:19:01.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:19:01 smithi177 ceph-mon[22025]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 290 MiB used, 894 GiB / 894 GiB avail 2024-08-31T04:19:01.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:19:01 smithi133 ceph-mon[22177]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 290 MiB used, 894 GiB / 894 GiB avail 2024-08-31T04:19:03.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:19:03 smithi050 ceph-mon[17259]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 290 MiB used, 894 GiB / 894 GiB avail 2024-08-31T04:19:03.702 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:19:03 smithi133 ceph-mon[22177]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 290 MiB used, 894 GiB / 894 GiB avail 2024-08-31T04:19:03.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:19:03 smithi177 ceph-mon[22025]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 290 MiB used, 894 GiB / 894 GiB avail 2024-08-31T04:19:05.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:19:05 smithi133 ceph-mon[22177]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 290 MiB used, 894 GiB / 894 GiB avail 2024-08-31T04:19:05.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:19:05 smithi050 ceph-mon[17259]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 290 MiB used, 894 GiB / 894 GiB avail 2024-08-31T04:19:05.745 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:19:05 smithi177 ceph-mon[22025]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 290 MiB used, 894 GiB / 894 GiB avail 2024-08-31T04:19:06.501 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:19:06 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.10"} : dispatch 2024-08-31T04:19:06.502 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:19:06 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:19:06.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:19:06 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.10"} : dispatch 2024-08-31T04:19:06.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:19:06 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:19:06.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:19:06 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.10"} : dispatch 2024-08-31T04:19:06.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:19:06 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:19:07.642 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:19:07 smithi133 ceph-mon[22177]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 290 MiB used, 894 GiB / 894 GiB avail 2024-08-31T04:19:07.642 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:19:07 smithi133 ceph-mon[22177]: Deploying daemon osd.10 on smithi133 2024-08-31T04:19:07.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:19:07 smithi050 ceph-mon[17259]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 290 MiB used, 894 GiB / 894 GiB avail 2024-08-31T04:19:07.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:19:07 smithi050 ceph-mon[17259]: Deploying daemon osd.10 on smithi133 2024-08-31T04:19:07.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:19:07 smithi177 ceph-mon[22025]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 290 MiB used, 894 GiB / 894 GiB avail 2024-08-31T04:19:07.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:19:07 smithi177 ceph-mon[22025]: Deploying daemon osd.10 on smithi133 2024-08-31T04:19:09.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:19:09 smithi050 ceph-mon[17259]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 290 MiB used, 894 GiB / 894 GiB avail 2024-08-31T04:19:09.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:19:09 smithi177 ceph-mon[22025]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 290 MiB used, 894 GiB / 894 GiB avail 2024-08-31T04:19:09.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:19:09 smithi133 ceph-mon[22177]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 290 MiB used, 894 GiB / 894 GiB avail 2024-08-31T04:19:11.641 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:19:11 smithi133 ceph-mon[22177]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 290 MiB used, 894 GiB / 894 GiB avail 2024-08-31T04:19:11.641 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:19:11 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T04:19:11.641 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:19:11 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:19:11.642 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:19:11 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:19:11.699 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:19:11 smithi050 ceph-mon[17259]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 290 MiB used, 894 GiB / 894 GiB avail 2024-08-31T04:19:11.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:19:11 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T04:19:11.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:19:11 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:19:11.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:19:11 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:19:11.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:19:11 smithi177 ceph-mon[22025]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 290 MiB used, 894 GiB / 894 GiB avail 2024-08-31T04:19:11.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:19:11 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T04:19:11.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:19:11 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:19:11.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:19:11 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:19:13.651 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:19:13 smithi133 ceph-mon[22177]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 290 MiB used, 894 GiB / 894 GiB avail 2024-08-31T04:19:13.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:19:13 smithi050 ceph-mon[17259]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 290 MiB used, 894 GiB / 894 GiB avail 2024-08-31T04:19:13.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:19:13 smithi177 ceph-mon[22025]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 290 MiB used, 894 GiB / 894 GiB avail 2024-08-31T04:19:13.972 INFO:teuthology.orchestra.run.smithi133.stdout:Created osd(s) 10 on host 'smithi133' 2024-08-31T04:19:13.972 INFO:teuthology.orchestra.run.smithi133.stderr:2024-08-31T04:19:13.970+0000 7fe6d77fe640 1 -- 172.21.15.133:0/4293806562 <== mgr.14150 v2:172.21.15.50:6800/2146686622 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7fe6d000c950 con 0x7fe6cc0b4b30 2024-08-31T04:19:13.974 INFO:teuthology.orchestra.run.smithi133.stderr:2024-08-31T04:19:13.972+0000 7fe6e83b2640 1 -- 172.21.15.133:0/4293806562 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fe6cc0b4b30 msgr2=0x7fe6cc0b7040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:19:13.974 INFO:teuthology.orchestra.run.smithi133.stderr:2024-08-31T04:19:13.972+0000 7fe6e83b2640 1 --2- 172.21.15.133:0/4293806562 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fe6cc0b4b30 0x7fe6cc0b7040 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fe6d000a990 tx=0x7fe6d0005c70 comp rx=0 tx=0).stop 2024-08-31T04:19:13.974 INFO:teuthology.orchestra.run.smithi133.stderr:2024-08-31T04:19:13.973+0000 7fe6e83b2640 1 -- 172.21.15.133:0/4293806562 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe6e01034f0 msgr2=0x7fe6e0199ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:19:13.974 INFO:teuthology.orchestra.run.smithi133.stderr:2024-08-31T04:19:13.973+0000 7fe6e83b2640 1 --2- 172.21.15.133:0/4293806562 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe6e01034f0 0x7fe6e0199ce0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fe6dc00d950 tx=0x7fe6dc00de10 comp rx=0 tx=0).stop 2024-08-31T04:19:13.975 INFO:teuthology.orchestra.run.smithi133.stderr:2024-08-31T04:19:13.973+0000 7fe6e83b2640 1 -- 172.21.15.133:0/4293806562 shutdown_connections 2024-08-31T04:19:13.975 INFO:teuthology.orchestra.run.smithi133.stderr:2024-08-31T04:19:13.973+0000 7fe6e83b2640 1 --2- 172.21.15.133:0/4293806562 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fe6cc0b4b30 0x7fe6cc0b7040 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:19:13.975 INFO:teuthology.orchestra.run.smithi133.stderr:2024-08-31T04:19:13.973+0000 7fe6e83b2640 1 --2- 172.21.15.133:0/4293806562 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe6e0104f20 0x7fe6e019aef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:19:13.975 INFO:teuthology.orchestra.run.smithi133.stderr:2024-08-31T04:19:13.973+0000 7fe6e83b2640 1 --2- 172.21.15.133:0/4293806562 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe6e0104580 0x7fe6e019a350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:19:13.975 INFO:teuthology.orchestra.run.smithi133.stderr:2024-08-31T04:19:13.973+0000 7fe6e83b2640 1 --2- 172.21.15.133:0/4293806562 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe6e01034f0 0x7fe6e0199ce0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:19:13.975 INFO:teuthology.orchestra.run.smithi133.stderr:2024-08-31T04:19:13.973+0000 7fe6e83b2640 1 -- 172.21.15.133:0/4293806562 >> 172.21.15.133:0/4293806562 conn(0x7fe6e00fee60 msgr2=0x7fe6e0107880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:19:13.975 INFO:teuthology.orchestra.run.smithi133.stderr:2024-08-31T04:19:13.973+0000 7fe6e83b2640 1 -- 172.21.15.133:0/4293806562 shutdown_connections 2024-08-31T04:19:13.975 INFO:teuthology.orchestra.run.smithi133.stderr:2024-08-31T04:19:13.973+0000 7fe6e83b2640 1 -- 172.21.15.133:0/4293806562 wait complete. 2024-08-31T04:19:14.642 DEBUG:teuthology.orchestra.run.smithi133:osd.10> sudo journalctl -f -n 0 -u ceph-058d9fc6-674f-11ef-bcd4-c7b262605968@osd.10.service 2024-08-31T04:19:14.644 INFO:tasks.cephadm:Deploying osd.11 on smithi177 with /dev/vg_nvme/lv_1... 2024-08-31T04:19:14.645 DEBUG:teuthology.orchestra.run.smithi177:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 058d9fc6-674f-11ef-bcd4-c7b262605968 -- lvm zap /dev/vg_nvme/lv_1 2024-08-31T04:19:14.903 INFO:teuthology.orchestra.run.smithi177.stderr:Inferring config /var/lib/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/mon.c/config 2024-08-31T04:19:15.180 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:19:14 smithi050 ceph-mon[17259]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 290 MiB used, 894 GiB / 894 GiB avail 2024-08-31T04:19:15.180 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:19:14 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:19:15.180 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:19:14 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:19:15.246 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:19:14 smithi177 ceph-mon[22025]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 290 MiB used, 894 GiB / 894 GiB avail 2024-08-31T04:19:15.246 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:19:14 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:19:15.246 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:19:14 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:19:15.292 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:19:14 smithi133 ceph-mon[22177]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 290 MiB used, 894 GiB / 894 GiB avail 2024-08-31T04:19:15.293 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:19:14 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:19:15.293 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:19:14 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:19:16.432 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:19:16 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:19:16.432 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:19:16 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:19:16.450 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:19:16 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:19:16.450 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:19:16 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:19:16.498 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:19:16 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:19:16.498 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:19:16 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:19:17.330 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:19:17 smithi177 ceph-mon[22025]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 290 MiB used, 894 GiB / 894 GiB avail 2024-08-31T04:19:17.450 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:19:17 smithi050 ceph-mon[17259]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 290 MiB used, 894 GiB / 894 GiB avail 2024-08-31T04:19:17.451 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:19:17 smithi133 ceph-mon[22177]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 290 MiB used, 894 GiB / 894 GiB avail 2024-08-31T04:19:17.634 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-08-31T04:19:17.660 DEBUG:teuthology.orchestra.run.smithi177:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 058d9fc6-674f-11ef-bcd4-c7b262605968 -- ceph orch daemon add osd smithi177:vg_nvme/lv_1 2024-08-31T04:19:17.793 INFO:journalctl@ceph.osd.10.smithi133.stdout:Aug 31 04:19:17 smithi133 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-10[46762]: 2024-08-31T04:19:17.449+0000 7f8745e66640 -1 osd.10 0 log_to_monitors true 2024-08-31T04:19:17.912 INFO:teuthology.orchestra.run.smithi177.stderr:Inferring config /var/lib/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/mon.c/config 2024-08-31T04:19:18.325 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:19:18 smithi177 ceph-mon[22025]: from='osd.10 [v2:172.21.15.133:6824/4175566493,v1:172.21.15.133:6825/4175566493]' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2024-08-31T04:19:18.325 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:19:18 smithi177 ceph-mon[22025]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2024-08-31T04:19:18.367 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-31T04:19:18.365+0000 7f2e6dea3640 1 -- 172.21.15.177:0/2989977305 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2e68103e20 msgr2=0x7f2e6810a7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:19:18.367 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-31T04:19:18.365+0000 7f2e6dea3640 1 --2- 172.21.15.177:0/2989977305 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2e68103e20 0x7f2e6810a7c0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f2e60009ca0 tx=0x7f2e6002a950 comp rx=0 tx=0).stop 2024-08-31T04:19:18.367 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-31T04:19:18.365+0000 7f2e6dea3640 1 -- 172.21.15.177:0/2989977305 shutdown_connections 2024-08-31T04:19:18.367 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-31T04:19:18.365+0000 7f2e6dea3640 1 --2- 172.21.15.177:0/2989977305 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2e68103e20 0x7f2e6810a7c0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:19:18.368 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-31T04:19:18.365+0000 7f2e6dea3640 1 --2- 172.21.15.177:0/2989977305 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2e68103480 0x7f2e68103890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:19:18.368 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-31T04:19:18.366+0000 7f2e6dea3640 1 --2- 172.21.15.177:0/2989977305 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2e681023f0 0x7f2e68102860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:19:18.368 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-31T04:19:18.366+0000 7f2e6dea3640 1 -- 172.21.15.177:0/2989977305 >> 172.21.15.177:0/2989977305 conn(0x7f2e680fdd80 msgr2=0x7f2e68100210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:19:18.368 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-31T04:19:18.366+0000 7f2e6dea3640 1 -- 172.21.15.177:0/2989977305 shutdown_connections 2024-08-31T04:19:18.368 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-31T04:19:18.366+0000 7f2e6dea3640 1 -- 172.21.15.177:0/2989977305 wait complete. 2024-08-31T04:19:18.370 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-31T04:19:18.366+0000 7f2e6dea3640 1 Processor -- start 2024-08-31T04:19:18.370 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-31T04:19:18.367+0000 7f2e6dea3640 1 -- start start 2024-08-31T04:19:18.370 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-31T04:19:18.367+0000 7f2e6dea3640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2e681023f0 0x7f2e68199cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:19:18.370 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-31T04:19:18.367+0000 7f2e6dea3640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2e68103480 0x7f2e6819a360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:19:18.370 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-31T04:19:18.367+0000 7f2e6dea3640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2e68103e20 0x7f2e6819af00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:19:18.370 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-31T04:19:18.367+0000 7f2e6dea3640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f2e6810e050 con 0x7f2e68103480 2024-08-31T04:19:18.370 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-31T04:19:18.367+0000 7f2e6dea3640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f2e6810ded0 con 0x7f2e68103e20 2024-08-31T04:19:18.370 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-31T04:19:18.367+0000 7f2e6dea3640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f2e6810e1d0 con 0x7f2e681023f0 2024-08-31T04:19:18.370 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-31T04:19:18.367+0000 7f2e677fe640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2e681023f0 0x7f2e68199cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:19:18.370 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-31T04:19:18.367+0000 7f2e677fe640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2e681023f0 0x7f2e68199cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:49022/0 (socket says 172.21.15.177:49022) 2024-08-31T04:19:18.370 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-31T04:19:18.367+0000 7f2e677fe640 1 -- 172.21.15.177:0/2983180117 learned_addr learned my addr 172.21.15.177:0/2983180117 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-08-31T04:19:18.371 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-31T04:19:18.367+0000 7f2e66ffd640 1 --2- 172.21.15.177:0/2983180117 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2e68103480 0x7f2e6819a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:19:18.371 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-31T04:19:18.367+0000 7f2e677fe640 1 -- 172.21.15.177:0/2983180117 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2e68103e20 msgr2=0x7f2e6819af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:19:18.371 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-31T04:19:18.367+0000 7f2e677fe640 1 --2- 172.21.15.177:0/2983180117 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2e68103e20 0x7f2e6819af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:19:18.371 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-31T04:19:18.367+0000 7f2e677fe640 1 -- 172.21.15.177:0/2983180117 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2e68103480 msgr2=0x7f2e6819a360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:19:18.371 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-31T04:19:18.367+0000 7f2e677fe640 1 --2- 172.21.15.177:0/2983180117 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2e68103480 0x7f2e6819a360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:19:18.371 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-31T04:19:18.367+0000 7f2e677fe640 1 -- 172.21.15.177:0/2983180117 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e6819b690 con 0x7f2e681023f0 2024-08-31T04:19:18.371 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-31T04:19:18.367+0000 7f2e677fe640 1 --2- 172.21.15.177:0/2983180117 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2e681023f0 0x7f2e68199cf0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f2e5800d950 tx=0x7f2e5800de10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:19:18.371 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-31T04:19:18.368+0000 7f2e64ff9640 1 -- 172.21.15.177:0/2983180117 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e58017070 con 0x7f2e681023f0 2024-08-31T04:19:18.371 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-31T04:19:18.368+0000 7f2e6dea3640 1 -- 172.21.15.177:0/2983180117 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2e6819b980 con 0x7f2e681023f0 2024-08-31T04:19:18.371 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-31T04:19:18.368+0000 7f2e64ff9640 1 -- 172.21.15.177:0/2983180117 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2e58009c30 con 0x7f2e681023f0 2024-08-31T04:19:18.371 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-31T04:19:18.368+0000 7f2e64ff9640 1 -- 172.21.15.177:0/2983180117 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e5800f620 con 0x7f2e681023f0 2024-08-31T04:19:18.371 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-31T04:19:18.368+0000 7f2e6dea3640 1 -- 172.21.15.177:0/2983180117 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2e68104940 con 0x7f2e681023f0 2024-08-31T04:19:18.372 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-31T04:19:18.369+0000 7f2e6dea3640 1 -- 172.21.15.177:0/2983180117 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2e68102860 con 0x7f2e681023f0 2024-08-31T04:19:18.372 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-31T04:19:18.370+0000 7f2e64ff9640 1 -- 172.21.15.177:0/2983180117 <== mon.1 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 16) ==== 152577+0+0 (secure 0 0 0) 0x7f2e58010460 con 0x7f2e681023f0 2024-08-31T04:19:18.372 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-31T04:19:18.371+0000 7f2e64ff9640 1 --2- 172.21.15.177:0/2983180117 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f2e500b4b30 0x7f2e500b7040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:19:18.373 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-31T04:19:18.371+0000 7f2e64ff9640 1 -- 172.21.15.177:0/2983180117 <== mon.1 v2:172.21.15.177:3300/0 5 ==== osd_map(61..61 src has 1..61) ==== 6398+0+0 (secure 0 0 0) 0x7f2e580e46a0 con 0x7f2e681023f0 2024-08-31T04:19:18.373 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-31T04:19:18.371+0000 7f2e66ffd640 1 --2- 172.21.15.177:0/2983180117 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f2e500b4b30 0x7f2e500b7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:19:18.373 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-31T04:19:18.372+0000 7f2e66ffd640 1 --2- 172.21.15.177:0/2983180117 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f2e500b4b30 0x7f2e500b7040 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f2e5c005e10 tx=0x7f2e5c005da0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:19:18.375 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-31T04:19:18.374+0000 7f2e64ff9640 1 -- 172.21.15.177:0/2983180117 <== mon.1 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f2e580abf50 con 0x7f2e681023f0 2024-08-31T04:19:18.449 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:19:18 smithi050 ceph-mon[17259]: from='osd.10 [v2:172.21.15.133:6824/4175566493,v1:172.21.15.133:6825/4175566493]' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2024-08-31T04:19:18.450 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:19:18 smithi050 ceph-mon[17259]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2024-08-31T04:19:18.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:19:18 smithi133 ceph-mon[22177]: from='osd.10 [v2:172.21.15.133:6824/4175566493,v1:172.21.15.133:6825/4175566493]' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2024-08-31T04:19:18.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:19:18 smithi133 ceph-mon[22177]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2024-08-31T04:19:18.564 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-31T04:19:18.562+0000 7f2e6dea3640 1 -- 172.21.15.177:0/2983180117 --> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi177:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7f2e680ffd30 con 0x7f2e500b4b30 2024-08-31T04:19:19.246 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:19:19 smithi177 ceph-mon[22025]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 290 MiB used, 894 GiB / 894 GiB avail 2024-08-31T04:19:19.246 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:19:19 smithi177 ceph-mon[22025]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-08-31T04:19:19.246 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:19:19 smithi177 ceph-mon[22025]: from='osd.10 [v2:172.21.15.133:6824/4175566493,v1:172.21.15.133:6825/4175566493]' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi133", "root=default"]} : dispatch 2024-08-31T04:19:19.246 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:19:19 smithi177 ceph-mon[22025]: osdmap e61: 11 total, 10 up, 11 in 2024-08-31T04:19:19.247 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:19:19 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-08-31T04:19:19.247 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:19:19 smithi177 ceph-mon[22025]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi133", "root=default"]} : dispatch 2024-08-31T04:19:19.247 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:19:19 smithi177 ceph-mon[22025]: Detected new or changed devices on smithi133 2024-08-31T04:19:19.247 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:19:19 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:19:19.247 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:19:19 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:19:19.247 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:19:19 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-08-31T04:19:19.247 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:19:19 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-08-31T04:19:19.247 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:19:19 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-08-31T04:19:19.247 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:19:19 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"} : dispatch 2024-08-31T04:19:19.247 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:19:19 smithi177 ceph-mon[22025]: Adjusting osd_memory_target on smithi133 to 4272M 2024-08-31T04:19:19.247 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:19:19 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:19:19.247 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:19:19 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:19:19.247 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:19:19 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T04:19:19.248 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:19:19 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:19:19.248 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:19:19 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T04:19:19.248 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:19:19 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:19:19.248 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:19:19 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T04:19:19.248 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:19:19 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:19:19.248 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:19:19 smithi177 ceph-mon[22025]: from='client.24532 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi177:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:19:19.248 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:19:19 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-31T04:19:19.248 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:19:19 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-31T04:19:19.248 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:19:19 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:19:19.450 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:19:19 smithi050 ceph-mon[17259]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 290 MiB used, 894 GiB / 894 GiB avail 2024-08-31T04:19:19.450 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:19:19 smithi050 ceph-mon[17259]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-08-31T04:19:19.451 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:19:19 smithi050 ceph-mon[17259]: from='osd.10 [v2:172.21.15.133:6824/4175566493,v1:172.21.15.133:6825/4175566493]' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi133", "root=default"]} : dispatch 2024-08-31T04:19:19.451 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:19:19 smithi050 ceph-mon[17259]: osdmap e61: 11 total, 10 up, 11 in 2024-08-31T04:19:19.451 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:19:19 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-08-31T04:19:19.451 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:19:19 smithi050 ceph-mon[17259]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi133", "root=default"]} : dispatch 2024-08-31T04:19:19.451 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:19:19 smithi050 ceph-mon[17259]: Detected new or changed devices on smithi133 2024-08-31T04:19:19.451 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:19:19 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:19:19.451 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:19:19 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:19:19.451 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:19:19 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-08-31T04:19:19.451 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:19:19 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-08-31T04:19:19.451 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:19:19 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-08-31T04:19:19.451 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:19:19 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"} : dispatch 2024-08-31T04:19:19.451 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:19:19 smithi050 ceph-mon[17259]: Adjusting osd_memory_target on smithi133 to 4272M 2024-08-31T04:19:19.452 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:19:19 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:19:19.452 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:19:19 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:19:19.452 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:19:19 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T04:19:19.452 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:19:19 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:19:19.452 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:19:19 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T04:19:19.452 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:19:19 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:19:19.452 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:19:19 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T04:19:19.452 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:19:19 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:19:19.452 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:19:19 smithi050 ceph-mon[17259]: from='client.24532 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi177:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:19:19.452 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:19:19 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-31T04:19:19.452 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:19:19 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-31T04:19:19.453 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:19:19 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:19:19.543 INFO:journalctl@ceph.osd.10.smithi133.stdout:Aug 31 04:19:19 smithi133 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-10[46762]: 2024-08-31T04:19:19.161+0000 7f8741de8640 -1 osd.10 0 waiting for initial osdmap 2024-08-31T04:19:19.543 INFO:journalctl@ceph.osd.10.smithi133.stdout:Aug 31 04:19:19 smithi133 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-10[46762]: 2024-08-31T04:19:19.177+0000 7f873dbe6640 -1 osd.10 62 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-31T04:19:19.544 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:19:19 smithi133 ceph-mon[22177]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 290 MiB used, 894 GiB / 894 GiB avail 2024-08-31T04:19:19.544 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:19:19 smithi133 ceph-mon[22177]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-08-31T04:19:19.544 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:19:19 smithi133 ceph-mon[22177]: from='osd.10 [v2:172.21.15.133:6824/4175566493,v1:172.21.15.133:6825/4175566493]' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi133", "root=default"]} : dispatch 2024-08-31T04:19:19.544 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:19:19 smithi133 ceph-mon[22177]: osdmap e61: 11 total, 10 up, 11 in 2024-08-31T04:19:19.544 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:19:19 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-08-31T04:19:19.545 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:19:19 smithi133 ceph-mon[22177]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi133", "root=default"]} : dispatch 2024-08-31T04:19:19.545 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:19:19 smithi133 ceph-mon[22177]: Detected new or changed devices on smithi133 2024-08-31T04:19:19.545 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:19:19 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:19:19.545 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:19:19 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:19:19.545 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:19:19 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-08-31T04:19:19.545 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:19:19 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-08-31T04:19:19.545 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:19:19 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-08-31T04:19:19.546 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:19:19 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"} : dispatch 2024-08-31T04:19:19.546 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:19:19 smithi133 ceph-mon[22177]: Adjusting osd_memory_target on smithi133 to 4272M 2024-08-31T04:19:19.546 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:19:19 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:19:19.546 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:19:19 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:19:19.546 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:19:19 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T04:19:19.546 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:19:19 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:19:19.547 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:19:19 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T04:19:19.547 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:19:19 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:19:19.547 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:19:19 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T04:19:19.547 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:19:19 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:19:19.547 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:19:19 smithi133 ceph-mon[22177]: from='client.24532 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi177:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:19:19.547 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:19:19 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-31T04:19:19.548 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:19:19 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-31T04:19:19.548 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:19:19 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:19:20.246 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:19:20 smithi177 ceph-mon[22025]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi133", "root=default"]}]': finished 2024-08-31T04:19:20.246 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:19:20 smithi177 ceph-mon[22025]: osdmap e62: 11 total, 10 up, 11 in 2024-08-31T04:19:20.246 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:19:20 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-08-31T04:19:20.246 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:19:20 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-08-31T04:19:20.450 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:19:20 smithi050 ceph-mon[17259]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi133", "root=default"]}]': finished 2024-08-31T04:19:20.450 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:19:20 smithi050 ceph-mon[17259]: osdmap e62: 11 total, 10 up, 11 in 2024-08-31T04:19:20.450 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:19:20 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-08-31T04:19:20.450 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:19:20 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-08-31T04:19:20.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:19:20 smithi133 ceph-mon[22177]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi133", "root=default"]}]': finished 2024-08-31T04:19:20.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:19:20 smithi133 ceph-mon[22177]: osdmap e62: 11 total, 10 up, 11 in 2024-08-31T04:19:20.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:19:20 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-08-31T04:19:20.544 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:19:20 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-08-31T04:19:21.450 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:19:21 smithi050 ceph-mon[17259]: purged_snaps scrub starts 2024-08-31T04:19:21.450 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:19:21 smithi050 ceph-mon[17259]: purged_snaps scrub ok 2024-08-31T04:19:21.450 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:19:21 smithi050 ceph-mon[17259]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 290 MiB used, 894 GiB / 894 GiB avail 2024-08-31T04:19:21.450 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:19:21 smithi050 ceph-mon[17259]: osd.10 [v2:172.21.15.133:6824/4175566493,v1:172.21.15.133:6825/4175566493] boot 2024-08-31T04:19:21.450 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:19:21 smithi050 ceph-mon[17259]: osdmap e63: 11 total, 11 up, 11 in 2024-08-31T04:19:21.450 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:19:21 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-08-31T04:19:21.450 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:19:21 smithi050 ceph-mon[17259]: osdmap e64: 11 total, 11 up, 11 in 2024-08-31T04:19:21.450 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:19:21 smithi050 ceph-mon[17259]: from='client.? 172.21.15.177:0/1102178414' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "a154180a-5f2a-4b33-ad3d-fea7317597ec"} : dispatch 2024-08-31T04:19:21.451 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:19:21 smithi050 ceph-mon[17259]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "a154180a-5f2a-4b33-ad3d-fea7317597ec"} : dispatch 2024-08-31T04:19:21.451 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:19:21 smithi050 ceph-mon[17259]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a154180a-5f2a-4b33-ad3d-fea7317597ec"}]': finished 2024-08-31T04:19:21.451 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:19:21 smithi050 ceph-mon[17259]: osdmap e65: 12 total, 11 up, 12 in 2024-08-31T04:19:21.451 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:19:21 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-08-31T04:19:21.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:19:21 smithi177 ceph-mon[22025]: purged_snaps scrub starts 2024-08-31T04:19:21.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:19:21 smithi177 ceph-mon[22025]: purged_snaps scrub ok 2024-08-31T04:19:21.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:19:21 smithi177 ceph-mon[22025]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 290 MiB used, 894 GiB / 894 GiB avail 2024-08-31T04:19:21.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:19:21 smithi177 ceph-mon[22025]: osd.10 [v2:172.21.15.133:6824/4175566493,v1:172.21.15.133:6825/4175566493] boot 2024-08-31T04:19:21.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:19:21 smithi177 ceph-mon[22025]: osdmap e63: 11 total, 11 up, 11 in 2024-08-31T04:19:21.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:19:21 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-08-31T04:19:21.497 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:19:21 smithi177 ceph-mon[22025]: osdmap e64: 11 total, 11 up, 11 in 2024-08-31T04:19:21.497 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:19:21 smithi177 ceph-mon[22025]: from='client.? 172.21.15.177:0/1102178414' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "a154180a-5f2a-4b33-ad3d-fea7317597ec"} : dispatch 2024-08-31T04:19:21.497 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:19:21 smithi177 ceph-mon[22025]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "a154180a-5f2a-4b33-ad3d-fea7317597ec"} : dispatch 2024-08-31T04:19:21.497 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:19:21 smithi177 ceph-mon[22025]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a154180a-5f2a-4b33-ad3d-fea7317597ec"}]': finished 2024-08-31T04:19:21.497 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:19:21 smithi177 ceph-mon[22025]: osdmap e65: 12 total, 11 up, 12 in 2024-08-31T04:19:21.497 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:19:21 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-08-31T04:19:21.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:19:21 smithi133 ceph-mon[22177]: purged_snaps scrub starts 2024-08-31T04:19:21.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:19:21 smithi133 ceph-mon[22177]: purged_snaps scrub ok 2024-08-31T04:19:21.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:19:21 smithi133 ceph-mon[22177]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 290 MiB used, 894 GiB / 894 GiB avail 2024-08-31T04:19:21.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:19:21 smithi133 ceph-mon[22177]: osd.10 [v2:172.21.15.133:6824/4175566493,v1:172.21.15.133:6825/4175566493] boot 2024-08-31T04:19:21.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:19:21 smithi133 ceph-mon[22177]: osdmap e63: 11 total, 11 up, 11 in 2024-08-31T04:19:21.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:19:21 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-08-31T04:19:21.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:19:21 smithi133 ceph-mon[22177]: osdmap e64: 11 total, 11 up, 11 in 2024-08-31T04:19:21.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:19:21 smithi133 ceph-mon[22177]: from='client.? 172.21.15.177:0/1102178414' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "a154180a-5f2a-4b33-ad3d-fea7317597ec"} : dispatch 2024-08-31T04:19:21.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:19:21 smithi133 ceph-mon[22177]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "a154180a-5f2a-4b33-ad3d-fea7317597ec"} : dispatch 2024-08-31T04:19:21.544 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:19:21 smithi133 ceph-mon[22177]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a154180a-5f2a-4b33-ad3d-fea7317597ec"}]': finished 2024-08-31T04:19:21.544 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:19:21 smithi133 ceph-mon[22177]: osdmap e65: 12 total, 11 up, 12 in 2024-08-31T04:19:21.544 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:19:21 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-08-31T04:19:22.450 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:19:22 smithi050 ceph-mon[17259]: from='client.? 172.21.15.177:0/3936494097' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-31T04:19:22.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:19:22 smithi177 ceph-mon[22025]: from='client.? 172.21.15.177:0/3936494097' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-31T04:19:22.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:19:22 smithi133 ceph-mon[22177]: from='client.? 172.21.15.177:0/3936494097' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-31T04:19:23.450 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:19:23 smithi050 ceph-mon[17259]: pgmap v248: 1 pgs: 1 remapped+peering; 577 KiB data, 317 MiB used, 983 GiB / 983 GiB avail 2024-08-31T04:19:23.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:19:23 smithi177 ceph-mon[22025]: pgmap v248: 1 pgs: 1 remapped+peering; 577 KiB data, 317 MiB used, 983 GiB / 983 GiB avail 2024-08-31T04:19:23.542 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:19:23 smithi133 ceph-mon[22177]: pgmap v248: 1 pgs: 1 remapped+peering; 577 KiB data, 317 MiB used, 983 GiB / 983 GiB avail 2024-08-31T04:19:25.450 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:19:25 smithi050 ceph-mon[17259]: pgmap v249: 1 pgs: 1 remapped+peering; 577 KiB data, 318 MiB used, 983 GiB / 983 GiB avail 2024-08-31T04:19:25.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:19:25 smithi177 ceph-mon[22025]: pgmap v249: 1 pgs: 1 remapped+peering; 577 KiB data, 318 MiB used, 983 GiB / 983 GiB avail 2024-08-31T04:19:25.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:19:25 smithi133 ceph-mon[22177]: pgmap v249: 1 pgs: 1 remapped+peering; 577 KiB data, 318 MiB used, 983 GiB / 983 GiB avail 2024-08-31T04:19:27.436 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:19:27 smithi177 ceph-mon[22025]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 318 MiB used, 983 GiB / 983 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-08-31T04:19:27.450 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:19:27 smithi050 ceph-mon[17259]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 318 MiB used, 983 GiB / 983 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-08-31T04:19:27.542 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:19:27 smithi133 ceph-mon[22177]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 318 MiB used, 983 GiB / 983 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-08-31T04:19:29.246 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:19:29 smithi177 ceph-mon[22025]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 318 MiB used, 983 GiB / 983 GiB avail; 75 KiB/s, 0 objects/s recovering 2024-08-31T04:19:29.450 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:19:29 smithi050 ceph-mon[17259]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 318 MiB used, 983 GiB / 983 GiB avail; 75 KiB/s, 0 objects/s recovering 2024-08-31T04:19:29.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:19:29 smithi133 ceph-mon[22177]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 318 MiB used, 983 GiB / 983 GiB avail; 75 KiB/s, 0 objects/s recovering 2024-08-31T04:19:30.442 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:19:30 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.11"} : dispatch 2024-08-31T04:19:30.442 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:19:30 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:19:30.450 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:19:30 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.11"} : dispatch 2024-08-31T04:19:30.450 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:19:30 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:19:30.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:19:30 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.11"} : dispatch 2024-08-31T04:19:30.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:19:30 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:19:31.430 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:19:31 smithi177 ceph-mon[22025]: Deploying daemon osd.11 on smithi177 2024-08-31T04:19:31.430 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:19:31 smithi177 ceph-mon[22025]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 318 MiB used, 983 GiB / 983 GiB avail; 63 KiB/s, 0 objects/s recovering 2024-08-31T04:19:31.450 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:19:31 smithi050 ceph-mon[17259]: Deploying daemon osd.11 on smithi177 2024-08-31T04:19:31.450 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:19:31 smithi050 ceph-mon[17259]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 318 MiB used, 983 GiB / 983 GiB avail; 63 KiB/s, 0 objects/s recovering 2024-08-31T04:19:31.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:19:31 smithi133 ceph-mon[22177]: Deploying daemon osd.11 on smithi177 2024-08-31T04:19:31.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:19:31 smithi133 ceph-mon[22177]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 318 MiB used, 983 GiB / 983 GiB avail; 63 KiB/s, 0 objects/s recovering 2024-08-31T04:19:33.426 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:19:33 smithi177 ceph-mon[22025]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 318 MiB used, 983 GiB / 983 GiB avail; 53 KiB/s, 0 objects/s recovering 2024-08-31T04:19:33.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:19:33 smithi133 ceph-mon[22177]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 318 MiB used, 983 GiB / 983 GiB avail; 53 KiB/s, 0 objects/s recovering 2024-08-31T04:19:33.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:19:33 smithi050 ceph-mon[17259]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 318 MiB used, 983 GiB / 983 GiB avail; 53 KiB/s, 0 objects/s recovering 2024-08-31T04:19:35.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:19:35 smithi177 ceph-mon[22025]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 318 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-08-31T04:19:35.542 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:19:35 smithi133 ceph-mon[22177]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 318 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-08-31T04:19:35.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:19:35 smithi050 ceph-mon[17259]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 318 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-08-31T04:19:36.408 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:19:36 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T04:19:36.408 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:19:36 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:19:36.408 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:19:36 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:19:36.542 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:19:36 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T04:19:36.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:19:36 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:19:36.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:19:36 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:19:36.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:19:36 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T04:19:36.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:19:36 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:19:36.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:19:36 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:19:37.542 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:19:37 smithi133 ceph-mon[22177]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 318 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-08-31T04:19:37.647 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:19:37 smithi177 ceph-mon[22025]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 318 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-08-31T04:19:37.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:19:37 smithi050 ceph-mon[17259]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 318 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-08-31T04:19:39.012 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-31T04:19:39.010+0000 7f2e64ff9640 1 -- 172.21.15.177:0/2983180117 <== mgr.14150 v2:172.21.15.50:6800/2146686622 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7f2e680ffd30 con 0x7f2e500b4b30 2024-08-31T04:19:39.012 INFO:teuthology.orchestra.run.smithi177.stdout:Created osd(s) 11 on host 'smithi177' 2024-08-31T04:19:39.015 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-31T04:19:39.013+0000 7f2e6dea3640 1 -- 172.21.15.177:0/2983180117 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f2e500b4b30 msgr2=0x7f2e500b7040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:19:39.015 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-31T04:19:39.013+0000 7f2e6dea3640 1 --2- 172.21.15.177:0/2983180117 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f2e500b4b30 0x7f2e500b7040 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f2e5c005e10 tx=0x7f2e5c005da0 comp rx=0 tx=0).stop 2024-08-31T04:19:39.015 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-31T04:19:39.013+0000 7f2e6dea3640 1 -- 172.21.15.177:0/2983180117 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2e681023f0 msgr2=0x7f2e68199cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:19:39.015 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-31T04:19:39.013+0000 7f2e6dea3640 1 --2- 172.21.15.177:0/2983180117 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2e681023f0 0x7f2e68199cf0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f2e5800d950 tx=0x7f2e5800de10 comp rx=0 tx=0).stop 2024-08-31T04:19:39.015 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-31T04:19:39.013+0000 7f2e6dea3640 1 -- 172.21.15.177:0/2983180117 shutdown_connections 2024-08-31T04:19:39.015 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-31T04:19:39.013+0000 7f2e6dea3640 1 --2- 172.21.15.177:0/2983180117 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f2e500b4b30 0x7f2e500b7040 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:19:39.015 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-31T04:19:39.013+0000 7f2e6dea3640 1 --2- 172.21.15.177:0/2983180117 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2e68103e20 0x7f2e6819af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:19:39.015 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-31T04:19:39.013+0000 7f2e6dea3640 1 --2- 172.21.15.177:0/2983180117 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2e68103480 0x7f2e6819a360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:19:39.015 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-31T04:19:39.013+0000 7f2e6dea3640 1 --2- 172.21.15.177:0/2983180117 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2e681023f0 0x7f2e68199cf0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:19:39.015 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-31T04:19:39.013+0000 7f2e6dea3640 1 -- 172.21.15.177:0/2983180117 >> 172.21.15.177:0/2983180117 conn(0x7f2e680fdd80 msgr2=0x7f2e680ff620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:19:39.015 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-31T04:19:39.013+0000 7f2e6dea3640 1 -- 172.21.15.177:0/2983180117 shutdown_connections 2024-08-31T04:19:39.016 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-31T04:19:39.013+0000 7f2e6dea3640 1 -- 172.21.15.177:0/2983180117 wait complete. 2024-08-31T04:19:39.246 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:19:39 smithi177 ceph-mon[22025]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 318 MiB used, 983 GiB / 983 GiB avail 2024-08-31T04:19:39.246 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:19:39 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:19:39.246 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:19:39 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:19:39.246 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:19:39 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:19:39.246 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:19:39 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T04:19:39.246 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:19:39 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:19:39.246 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:19:39 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T04:19:39.246 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:19:39 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:19:39.246 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:19:39 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:19:39.450 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:19:39 smithi050 ceph-mon[17259]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 318 MiB used, 983 GiB / 983 GiB avail 2024-08-31T04:19:39.450 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:19:39 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:19:39.450 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:19:39 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:19:39.450 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:19:39 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:19:39.450 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:19:39 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T04:19:39.450 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:19:39 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:19:39.450 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:19:39 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T04:19:39.450 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:19:39 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:19:39.450 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:19:39 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:19:39.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:19:39 smithi133 ceph-mon[22177]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 318 MiB used, 983 GiB / 983 GiB avail 2024-08-31T04:19:39.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:19:39 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:19:39.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:19:39 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:19:39.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:19:39 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:19:39.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:19:39 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T04:19:39.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:19:39 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:19:39.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:19:39 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T04:19:39.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:19:39 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:19:39.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:19:39 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:19:39.682 DEBUG:teuthology.orchestra.run.smithi177:osd.11> sudo journalctl -f -n 0 -u ceph-058d9fc6-674f-11ef-bcd4-c7b262605968@osd.11.service 2024-08-31T04:19:39.685 INFO:tasks.cephadm:Waiting for 12 OSDs to come up... 2024-08-31T04:19:39.685 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 058d9fc6-674f-11ef-bcd4-c7b262605968 -- ceph osd stat -f json 2024-08-31T04:19:40.072 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:19:40.675 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:40.673+0000 7fd166c00640 1 -- 172.21.15.50:0/410663138 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd160103310 msgr2=0x7fd160103780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:19:40.675 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:40.673+0000 7fd166c00640 1 --2- 172.21.15.50:0/410663138 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd160103310 0x7fd160103780 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fd154009900 tx=0x7fd15402a480 comp rx=0 tx=0).stop 2024-08-31T04:19:40.675 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:40.673+0000 7fd166c00640 1 -- 172.21.15.50:0/410663138 shutdown_connections 2024-08-31T04:19:40.675 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:40.673+0000 7fd166c00640 1 --2- 172.21.15.50:0/410663138 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd160104d40 0x7fd16010b6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:19:40.675 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:40.673+0000 7fd166c00640 1 --2- 172.21.15.50:0/410663138 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd1601043a0 0x7fd1601047b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:19:40.675 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:40.673+0000 7fd166c00640 1 --2- 172.21.15.50:0/410663138 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd160103310 0x7fd160103780 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:19:40.676 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:40.673+0000 7fd166c00640 1 -- 172.21.15.50:0/410663138 >> 172.21.15.50:0/410663138 conn(0x7fd1600fec60 msgr2=0x7fd160101130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:19:40.676 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:40.673+0000 7fd166c00640 1 -- 172.21.15.50:0/410663138 shutdown_connections 2024-08-31T04:19:40.676 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:40.673+0000 7fd166c00640 1 -- 172.21.15.50:0/410663138 wait complete. 2024-08-31T04:19:40.676 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:40.675+0000 7fd166c00640 1 Processor -- start 2024-08-31T04:19:40.676 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:40.675+0000 7fd166c00640 1 -- start start 2024-08-31T04:19:40.678 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:40.675+0000 7fd166c00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd160103310 0x7fd160076b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:19:40.678 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:40.675+0000 7fd166c00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd1601043a0 0x7fd1600754b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:19:40.678 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:40.676+0000 7fd166c00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd160104d40 0x7fd1600759f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:19:40.678 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:40.676+0000 7fd166c00640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fd16010efc0 con 0x7fd160103310 2024-08-31T04:19:40.678 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:40.676+0000 7fd166c00640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7fd16010ee40 con 0x7fd1601043a0 2024-08-31T04:19:40.678 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:40.676+0000 7fd166c00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fd16010f140 con 0x7fd160104d40 2024-08-31T04:19:40.678 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:40.676+0000 7fd165800640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd160103310 0x7fd160076b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:19:40.678 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:40.676+0000 7fd165800640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd160103310 0x7fd160076b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:39566/0 (socket says 172.21.15.50:39566) 2024-08-31T04:19:40.678 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:40.676+0000 7fd165800640 1 -- 172.21.15.50:0/4083795560 learned_addr learned my addr 172.21.15.50:0/4083795560 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:19:40.678 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:40.676+0000 7fd166200640 1 --2- 172.21.15.50:0/4083795560 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd160104d40 0x7fd1600759f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:19:40.678 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:40.676+0000 7fd164e00640 1 --2- 172.21.15.50:0/4083795560 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd1601043a0 0x7fd1600754b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:19:40.678 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:40.676+0000 7fd166200640 1 -- 172.21.15.50:0/4083795560 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd1601043a0 msgr2=0x7fd1600754b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:19:40.679 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:40.676+0000 7fd166200640 1 --2- 172.21.15.50:0/4083795560 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd1601043a0 0x7fd1600754b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:19:40.679 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:40.676+0000 7fd166200640 1 -- 172.21.15.50:0/4083795560 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd160103310 msgr2=0x7fd160076b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:19:40.679 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:40.676+0000 7fd166200640 1 --2- 172.21.15.50:0/4083795560 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd160103310 0x7fd160076b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:19:40.679 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:40.676+0000 7fd166200640 1 -- 172.21.15.50:0/4083795560 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd160076090 con 0x7fd160104d40 2024-08-31T04:19:40.679 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:40.676+0000 7fd165800640 1 --2- 172.21.15.50:0/4083795560 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd160103310 0x7fd160076b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:19:40.679 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:40.677+0000 7fd166200640 1 --2- 172.21.15.50:0/4083795560 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd160104d40 0x7fd1600759f0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fd158009fd0 tx=0x7fd15800ef10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:19:40.680 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:40.677+0000 7fd15e000640 1 -- 172.21.15.50:0/4083795560 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd15800ce20 con 0x7fd160104d40 2024-08-31T04:19:40.680 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:40.677+0000 7fd15e000640 1 -- 172.21.15.50:0/4083795560 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd158005020 con 0x7fd160104d40 2024-08-31T04:19:40.680 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:40.677+0000 7fd166c00640 1 -- 172.21.15.50:0/4083795560 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd1601a3c60 con 0x7fd160104d40 2024-08-31T04:19:40.680 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:40.677+0000 7fd15e000640 1 -- 172.21.15.50:0/4083795560 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd158010690 con 0x7fd160104d40 2024-08-31T04:19:40.680 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:40.677+0000 7fd166c00640 1 -- 172.21.15.50:0/4083795560 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd1601a4060 con 0x7fd160104d40 2024-08-31T04:19:40.680 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:40.678+0000 7fd166c00640 1 -- 172.21.15.50:0/4083795560 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd16010a4f0 con 0x7fd160104d40 2024-08-31T04:19:40.682 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:40.680+0000 7fd15e000640 1 -- 172.21.15.50:0/4083795560 <== mon.1 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 16) ==== 152577+0+0 (secure 0 0 0) 0x7fd1580054d0 con 0x7fd160104d40 2024-08-31T04:19:40.683 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:40.682+0000 7fd15e000640 1 --2- 172.21.15.50:0/4083795560 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fd1480b4b30 0x7fd1480b7040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:19:40.683 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:40.682+0000 7fd15e000640 1 -- 172.21.15.50:0/4083795560 <== mon.1 v2:172.21.15.177:3300/0 5 ==== osd_map(65..65 src has 1..65) ==== 6809+0+0 (secure 0 0 0) 0x7fd1580e52a0 con 0x7fd160104d40 2024-08-31T04:19:40.683 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:40.682+0000 7fd165800640 1 --2- 172.21.15.50:0/4083795560 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fd1480b4b30 0x7fd1480b7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:19:40.684 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:40.683+0000 7fd165800640 1 --2- 172.21.15.50:0/4083795560 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fd1480b4b30 0x7fd1480b7040 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fd154005f70 tx=0x7fd1540314a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:19:40.687 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:40.686+0000 7fd15e000640 1 -- 172.21.15.50:0/4083795560 <== mon.1 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fd1580ac910 con 0x7fd160104d40 2024-08-31T04:19:40.883 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:40.882+0000 7fd166c00640 1 -- 172.21.15.50:0/4083795560 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7fd160063e00 con 0x7fd160104d40 2024-08-31T04:19:40.884 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-08-31T04:19:40.884 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:40.882+0000 7fd15e000640 1 -- 172.21.15.50:0/4083795560 <== mon.1 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v65) ==== 74+0+133 (secure 0 0 0) 0x7fd1580ac210 con 0x7fd160104d40 2024-08-31T04:19:40.886 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:40.885+0000 7fd166c00640 1 -- 172.21.15.50:0/4083795560 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fd1480b4b30 msgr2=0x7fd1480b7040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:19:40.887 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:40.885+0000 7fd166c00640 1 --2- 172.21.15.50:0/4083795560 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fd1480b4b30 0x7fd1480b7040 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fd154005f70 tx=0x7fd1540314a0 comp rx=0 tx=0).stop 2024-08-31T04:19:40.887 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:40.885+0000 7fd166c00640 1 -- 172.21.15.50:0/4083795560 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd160104d40 msgr2=0x7fd1600759f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:19:40.887 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:40.885+0000 7fd166c00640 1 --2- 172.21.15.50:0/4083795560 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd160104d40 0x7fd1600759f0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fd158009fd0 tx=0x7fd15800ef10 comp rx=0 tx=0).stop 2024-08-31T04:19:40.887 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:40.885+0000 7fd166c00640 1 -- 172.21.15.50:0/4083795560 shutdown_connections 2024-08-31T04:19:40.887 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:40.885+0000 7fd166c00640 1 --2- 172.21.15.50:0/4083795560 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fd1480b4b30 0x7fd1480b7040 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:19:40.887 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:40.885+0000 7fd166c00640 1 --2- 172.21.15.50:0/4083795560 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd160104d40 0x7fd1600759f0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:19:40.887 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:40.885+0000 7fd166c00640 1 --2- 172.21.15.50:0/4083795560 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd1601043a0 0x7fd1600754b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:19:40.887 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:40.885+0000 7fd166c00640 1 --2- 172.21.15.50:0/4083795560 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd160103310 0x7fd160076b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:19:40.887 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:40.885+0000 7fd166c00640 1 -- 172.21.15.50:0/4083795560 >> 172.21.15.50:0/4083795560 conn(0x7fd1600fec60 msgr2=0x7fd1601076c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:19:40.887 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:40.885+0000 7fd166c00640 1 -- 172.21.15.50:0/4083795560 shutdown_connections 2024-08-31T04:19:40.887 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:40.885+0000 7fd166c00640 1 -- 172.21.15.50:0/4083795560 wait complete. 2024-08-31T04:19:41.450 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:19:41 smithi050 ceph-mon[17259]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 318 MiB used, 983 GiB / 983 GiB avail 2024-08-31T04:19:41.450 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:19:41 smithi050 ceph-mon[17259]: from='client.? 172.21.15.50:0/4083795560' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-08-31T04:19:41.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:19:41 smithi177 ceph-mon[22025]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 318 MiB used, 983 GiB / 983 GiB avail 2024-08-31T04:19:41.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:19:41 smithi177 ceph-mon[22025]: from='client.? 172.21.15.50:0/4083795560' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-08-31T04:19:41.496 INFO:journalctl@ceph.osd.11.smithi177.stdout:Aug 31 04:19:41 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-11[46864]: 2024-08-31T04:19:41.290+0000 7fd60d676640 -1 osd.11 0 log_to_monitors true 2024-08-31T04:19:41.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:19:41 smithi133 ceph-mon[22177]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 318 MiB used, 983 GiB / 983 GiB avail 2024-08-31T04:19:41.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:19:41 smithi133 ceph-mon[22177]: from='client.? 172.21.15.50:0/4083795560' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-08-31T04:19:41.983 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":65,"num_osds":12,"num_up_osds":11,"osd_up_since":1725077960,"num_in_osds":12,"osd_in_since":1725077961,"num_remapped_pgs":0} 2024-08-31T04:19:42.200 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:19:42 smithi050 ceph-mon[17259]: from='osd.11 [v2:172.21.15.177:6824/2103454982,v1:172.21.15.177:6825/2103454982]' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2024-08-31T04:19:42.200 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:19:42 smithi050 ceph-mon[17259]: from='osd.11 ' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2024-08-31T04:19:42.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:19:42 smithi177 ceph-mon[22025]: from='osd.11 [v2:172.21.15.177:6824/2103454982,v1:172.21.15.177:6825/2103454982]' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2024-08-31T04:19:42.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:19:42 smithi177 ceph-mon[22025]: from='osd.11 ' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2024-08-31T04:19:42.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:19:42 smithi133 ceph-mon[22177]: from='osd.11 [v2:172.21.15.177:6824/2103454982,v1:172.21.15.177:6825/2103454982]' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2024-08-31T04:19:42.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:19:42 smithi133 ceph-mon[22177]: from='osd.11 ' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2024-08-31T04:19:42.984 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 058d9fc6-674f-11ef-bcd4-c7b262605968 -- ceph osd stat -f json 2024-08-31T04:19:43.373 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:19:43.376 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:19:43 smithi050 ceph-mon[17259]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 318 MiB used, 983 GiB / 983 GiB avail 2024-08-31T04:19:43.377 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:19:43 smithi050 ceph-mon[17259]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-08-31T04:19:43.377 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:19:43 smithi050 ceph-mon[17259]: osdmap e66: 12 total, 11 up, 12 in 2024-08-31T04:19:43.377 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:19:43 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-08-31T04:19:43.377 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:19:43 smithi050 ceph-mon[17259]: from='osd.11 [v2:172.21.15.177:6824/2103454982,v1:172.21.15.177:6825/2103454982]' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi177", "root=default"]} : dispatch 2024-08-31T04:19:43.377 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:19:43 smithi050 ceph-mon[17259]: from='osd.11 ' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi177", "root=default"]} : dispatch 2024-08-31T04:19:43.377 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:19:43 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:19:43.377 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:19:43 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:19:43.377 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:19:43 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-08-31T04:19:43.377 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:19:43 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-08-31T04:19:43.377 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:19:43 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-08-31T04:19:43.377 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:19:43 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"} : dispatch 2024-08-31T04:19:43.377 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:19:43 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:19:43.378 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:19:43 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:19:43.378 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:19:43 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T04:19:43.378 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:19:43 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:19:43.444 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:19:43 smithi133 ceph-mon[22177]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 318 MiB used, 983 GiB / 983 GiB avail 2024-08-31T04:19:43.445 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:19:43 smithi133 ceph-mon[22177]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-08-31T04:19:43.445 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:19:43 smithi133 ceph-mon[22177]: osdmap e66: 12 total, 11 up, 12 in 2024-08-31T04:19:43.445 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:19:43 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-08-31T04:19:43.445 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:19:43 smithi133 ceph-mon[22177]: from='osd.11 [v2:172.21.15.177:6824/2103454982,v1:172.21.15.177:6825/2103454982]' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi177", "root=default"]} : dispatch 2024-08-31T04:19:43.445 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:19:43 smithi133 ceph-mon[22177]: from='osd.11 ' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi177", "root=default"]} : dispatch 2024-08-31T04:19:43.445 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:19:43 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:19:43.445 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:19:43 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:19:43.445 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:19:43 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-08-31T04:19:43.445 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:19:43 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-08-31T04:19:43.445 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:19:43 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-08-31T04:19:43.445 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:19:43 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"} : dispatch 2024-08-31T04:19:43.445 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:19:43 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:19:43.445 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:19:43 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:19:43.446 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:19:43 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T04:19:43.446 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:19:43 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:19:43.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:19:43 smithi177 ceph-mon[22025]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 318 MiB used, 983 GiB / 983 GiB avail 2024-08-31T04:19:43.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:19:43 smithi177 ceph-mon[22025]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-08-31T04:19:43.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:19:43 smithi177 ceph-mon[22025]: osdmap e66: 12 total, 11 up, 12 in 2024-08-31T04:19:43.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:19:43 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-08-31T04:19:43.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:19:43 smithi177 ceph-mon[22025]: from='osd.11 [v2:172.21.15.177:6824/2103454982,v1:172.21.15.177:6825/2103454982]' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi177", "root=default"]} : dispatch 2024-08-31T04:19:43.497 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:19:43 smithi177 ceph-mon[22025]: from='osd.11 ' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi177", "root=default"]} : dispatch 2024-08-31T04:19:43.497 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:19:43 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:19:43.497 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:19:43 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:19:43.497 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:19:43 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-08-31T04:19:43.497 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:19:43 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-08-31T04:19:43.497 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:19:43 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-08-31T04:19:43.497 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:19:43 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"} : dispatch 2024-08-31T04:19:43.497 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:19:43 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:19:43.497 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:19:43 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:19:43.497 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:19:43 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T04:19:43.497 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:19:43 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:19:43.996 INFO:journalctl@ceph.osd.11.smithi177.stdout:Aug 31 04:19:43 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-11[46864]: 2024-08-31T04:19:43.615+0000 7fd6095f8640 -1 osd.11 0 waiting for initial osdmap 2024-08-31T04:19:43.996 INFO:journalctl@ceph.osd.11.smithi177.stdout:Aug 31 04:19:43 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-11[46864]: 2024-08-31T04:19:43.631+0000 7fd6013ee640 -1 osd.11 67 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-31T04:19:44.160 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:44.158+0000 7f1d30a00640 1 -- 172.21.15.50:0/651755216 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1d2c10b4f0 msgr2=0x7f1d2c10d930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:19:44.161 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:44.158+0000 7f1d30a00640 1 --2- 172.21.15.50:0/651755216 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1d2c10b4f0 0x7f1d2c10d930 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f1d24009ca0 tx=0x7f1d2402a8b0 comp rx=0 tx=0).stop 2024-08-31T04:19:44.161 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:44.158+0000 7f1d30a00640 1 -- 172.21.15.50:0/651755216 shutdown_connections 2024-08-31T04:19:44.161 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:44.158+0000 7f1d30a00640 1 --2- 172.21.15.50:0/651755216 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1d2c075a30 0x7f1d2c075e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:19:44.161 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:44.158+0000 7f1d30a00640 1 --2- 172.21.15.50:0/651755216 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1d2c10b4f0 0x7f1d2c10d930 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:19:44.161 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:44.158+0000 7f1d30a00640 1 --2- 172.21.15.50:0/651755216 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1d2c076e20 0x7f1d2c0754f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:19:44.161 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:44.158+0000 7f1d30a00640 1 -- 172.21.15.50:0/651755216 >> 172.21.15.50:0/651755216 conn(0x7f1d2c0fee60 msgr2=0x7f1d2c101310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:19:44.161 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:44.158+0000 7f1d30a00640 1 -- 172.21.15.50:0/651755216 shutdown_connections 2024-08-31T04:19:44.161 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:44.158+0000 7f1d30a00640 1 -- 172.21.15.50:0/651755216 wait complete. 2024-08-31T04:19:44.163 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:44.160+0000 7f1d30a00640 1 Processor -- start 2024-08-31T04:19:44.163 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:44.160+0000 7f1d30a00640 1 -- start start 2024-08-31T04:19:44.163 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:44.160+0000 7f1d30a00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1d2c075a30 0x7f1d2c19bf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:19:44.163 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:44.160+0000 7f1d30a00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1d2c076e20 0x7f1d2c19c590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:19:44.163 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:44.161+0000 7f1d30a00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1d2c10b4f0 0x7f1d2c19d130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:19:44.163 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:44.161+0000 7f1d30a00640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f1d2c111330 con 0x7f1d2c10b4f0 2024-08-31T04:19:44.163 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:44.161+0000 7f1d30a00640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f1d2c1111b0 con 0x7f1d2c076e20 2024-08-31T04:19:44.163 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:44.161+0000 7f1d30a00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f1d2c1114b0 con 0x7f1d2c075a30 2024-08-31T04:19:44.163 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:44.161+0000 7f1d29400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1d2c076e20 0x7f1d2c19c590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:19:44.164 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:44.161+0000 7f1d29400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1d2c076e20 0x7f1d2c19c590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.50:53036/0 (socket says 172.21.15.50:53036) 2024-08-31T04:19:44.164 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:44.161+0000 7f1d29400640 1 -- 172.21.15.50:0/3089263271 learned_addr learned my addr 172.21.15.50:0/3089263271 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:19:44.164 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:44.161+0000 7f1d29e00640 1 --2- 172.21.15.50:0/3089263271 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1d2c075a30 0x7f1d2c19bf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:19:44.164 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:44.161+0000 7f1d2a800640 1 --2- 172.21.15.50:0/3089263271 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1d2c10b4f0 0x7f1d2c19d130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:19:44.164 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:44.161+0000 7f1d29400640 1 -- 172.21.15.50:0/3089263271 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1d2c075a30 msgr2=0x7f1d2c19bf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:19:44.164 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:44.161+0000 7f1d29400640 1 --2- 172.21.15.50:0/3089263271 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1d2c075a30 0x7f1d2c19bf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:19:44.164 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:44.161+0000 7f1d29400640 1 -- 172.21.15.50:0/3089263271 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1d2c10b4f0 msgr2=0x7f1d2c19d130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:19:44.164 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:44.161+0000 7f1d29400640 1 --2- 172.21.15.50:0/3089263271 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1d2c10b4f0 0x7f1d2c19d130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:19:44.164 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:44.161+0000 7f1d29400640 1 -- 172.21.15.50:0/3089263271 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d2c19d950 con 0x7f1d2c076e20 2024-08-31T04:19:44.164 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:44.161+0000 7f1d29e00640 1 --2- 172.21.15.50:0/3089263271 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1d2c075a30 0x7f1d2c19bf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:19:44.164 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:44.161+0000 7f1d2a800640 1 --2- 172.21.15.50:0/3089263271 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1d2c10b4f0 0x7f1d2c19d130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:19:44.164 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:44.162+0000 7f1d29400640 1 --2- 172.21.15.50:0/3089263271 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1d2c076e20 0x7f1d2c19c590 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f1d1800e9f0 tx=0x7f1d1800edf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:19:44.165 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:44.162+0000 7f1d22a00640 1 -- 172.21.15.50:0/3089263271 <== mon.2 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d1800cd80 con 0x7f1d2c076e20 2024-08-31T04:19:44.165 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:44.162+0000 7f1d30a00640 1 -- 172.21.15.50:0/3089263271 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1d2c19dc40 con 0x7f1d2c076e20 2024-08-31T04:19:44.165 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:44.162+0000 7f1d22a00640 1 -- 172.21.15.50:0/3089263271 <== mon.2 v2:172.21.15.133:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1d180054d0 con 0x7f1d2c076e20 2024-08-31T04:19:44.165 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:44.162+0000 7f1d22a00640 1 -- 172.21.15.50:0/3089263271 <== mon.2 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d18010690 con 0x7f1d2c076e20 2024-08-31T04:19:44.165 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:44.162+0000 7f1d30a00640 1 -- 172.21.15.50:0/3089263271 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1d2c1a4340 con 0x7f1d2c076e20 2024-08-31T04:19:44.165 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:44.163+0000 7f1d30a00640 1 -- 172.21.15.50:0/3089263271 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1d2c109bf0 con 0x7f1d2c076e20 2024-08-31T04:19:44.167 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:44.166+0000 7f1d22a00640 1 -- 172.21.15.50:0/3089263271 <== mon.2 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 16) ==== 152577+0+0 (secure 0 0 0) 0x7f1d18004e90 con 0x7f1d2c076e20 2024-08-31T04:19:44.169 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:44.168+0000 7f1d22a00640 1 --2- 172.21.15.50:0/3089263271 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f1d100b4b30 0x7f1d100b7040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:19:44.169 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:44.168+0000 7f1d22a00640 1 -- 172.21.15.50:0/3089263271 <== mon.2 v2:172.21.15.133:3300/0 5 ==== osd_map(67..67 src has 1..67) ==== 6847+0+0 (secure 0 0 0) 0x7f1d180e50d0 con 0x7f1d2c076e20 2024-08-31T04:19:44.169 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:44.168+0000 7f1d29e00640 1 --2- 172.21.15.50:0/3089263271 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f1d100b4b30 0x7f1d100b7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:19:44.170 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:44.169+0000 7f1d29e00640 1 --2- 172.21.15.50:0/3089263271 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f1d100b4b30 0x7f1d100b7040 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f1d1c0095f0 tx=0x7f1d1c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:19:44.170 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:44.169+0000 7f1d22a00640 1 -- 172.21.15.50:0/3089263271 <== mon.2 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f1d180ac720 con 0x7f1d2c076e20 2024-08-31T04:19:44.369 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:44.368+0000 7f1d30a00640 1 -- 172.21.15.50:0/3089263271 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7f1d2c063d60 con 0x7f1d2c076e20 2024-08-31T04:19:44.370 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:19:44 smithi050 ceph-mon[17259]: Detected new or changed devices on smithi177 2024-08-31T04:19:44.370 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:19:44 smithi050 ceph-mon[17259]: Adjusting osd_memory_target on smithi177 to 4271M 2024-08-31T04:19:44.370 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:19:44 smithi050 ceph-mon[17259]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi177", "root=default"]}]': finished 2024-08-31T04:19:44.370 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:19:44 smithi050 ceph-mon[17259]: osdmap e67: 12 total, 11 up, 12 in 2024-08-31T04:19:44.370 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:19:44 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-08-31T04:19:44.371 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:19:44 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-08-31T04:19:44.371 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:19:44 smithi050 ceph-mon[17259]: from='osd.11 ' entity='osd.11' 2024-08-31T04:19:44.371 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:44.368+0000 7f1d22a00640 1 -- 172.21.15.50:0/3089263271 <== mon.2 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v67) ==== 74+0+133 (secure 0 0 0) 0x7f1d180ac020 con 0x7f1d2c076e20 2024-08-31T04:19:44.371 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-08-31T04:19:44.373 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:44.371+0000 7f1d30a00640 1 -- 172.21.15.50:0/3089263271 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f1d100b4b30 msgr2=0x7f1d100b7040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:19:44.373 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:44.371+0000 7f1d30a00640 1 --2- 172.21.15.50:0/3089263271 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f1d100b4b30 0x7f1d100b7040 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f1d1c0095f0 tx=0x7f1d1c005f90 comp rx=0 tx=0).stop 2024-08-31T04:19:44.373 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:44.371+0000 7f1d30a00640 1 -- 172.21.15.50:0/3089263271 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1d2c076e20 msgr2=0x7f1d2c19c590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:19:44.373 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:44.371+0000 7f1d30a00640 1 --2- 172.21.15.50:0/3089263271 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1d2c076e20 0x7f1d2c19c590 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f1d1800e9f0 tx=0x7f1d1800edf0 comp rx=0 tx=0).stop 2024-08-31T04:19:44.373 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:44.371+0000 7f1d30a00640 1 -- 172.21.15.50:0/3089263271 shutdown_connections 2024-08-31T04:19:44.373 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:44.371+0000 7f1d30a00640 1 --2- 172.21.15.50:0/3089263271 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f1d100b4b30 0x7f1d100b7040 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:19:44.373 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:44.371+0000 7f1d30a00640 1 --2- 172.21.15.50:0/3089263271 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1d2c10b4f0 0x7f1d2c19d130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:19:44.373 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:44.371+0000 7f1d30a00640 1 --2- 172.21.15.50:0/3089263271 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1d2c076e20 0x7f1d2c19c590 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:19:44.374 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:44.371+0000 7f1d30a00640 1 --2- 172.21.15.50:0/3089263271 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1d2c075a30 0x7f1d2c19bf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:19:44.374 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:44.371+0000 7f1d30a00640 1 -- 172.21.15.50:0/3089263271 >> 172.21.15.50:0/3089263271 conn(0x7f1d2c0fee60 msgr2=0x7f1d2c1012f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:19:44.374 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:44.372+0000 7f1d30a00640 1 -- 172.21.15.50:0/3089263271 shutdown_connections 2024-08-31T04:19:44.374 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:44.372+0000 7f1d30a00640 1 -- 172.21.15.50:0/3089263271 wait complete. 2024-08-31T04:19:44.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:19:44 smithi177 ceph-mon[22025]: Detected new or changed devices on smithi177 2024-08-31T04:19:44.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:19:44 smithi177 ceph-mon[22025]: Adjusting osd_memory_target on smithi177 to 4271M 2024-08-31T04:19:44.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:19:44 smithi177 ceph-mon[22025]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi177", "root=default"]}]': finished 2024-08-31T04:19:44.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:19:44 smithi177 ceph-mon[22025]: osdmap e67: 12 total, 11 up, 12 in 2024-08-31T04:19:44.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:19:44 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-08-31T04:19:44.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:19:44 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-08-31T04:19:44.497 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:19:44 smithi177 ceph-mon[22025]: from='osd.11 ' entity='osd.11' 2024-08-31T04:19:44.542 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:19:44 smithi133 ceph-mon[22177]: Detected new or changed devices on smithi177 2024-08-31T04:19:44.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:19:44 smithi133 ceph-mon[22177]: Adjusting osd_memory_target on smithi177 to 4271M 2024-08-31T04:19:44.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:19:44 smithi133 ceph-mon[22177]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi177", "root=default"]}]': finished 2024-08-31T04:19:44.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:19:44 smithi133 ceph-mon[22177]: osdmap e67: 12 total, 11 up, 12 in 2024-08-31T04:19:44.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:19:44 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-08-31T04:19:44.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:19:44 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-08-31T04:19:44.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:19:44 smithi133 ceph-mon[22177]: from='osd.11 ' entity='osd.11' 2024-08-31T04:19:45.246 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:19:45 smithi177 ceph-mon[22025]: purged_snaps scrub starts 2024-08-31T04:19:45.246 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:19:45 smithi177 ceph-mon[22025]: purged_snaps scrub ok 2024-08-31T04:19:45.246 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:19:45 smithi177 ceph-mon[22025]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 318 MiB used, 983 GiB / 983 GiB avail 2024-08-31T04:19:45.246 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:19:45 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-08-31T04:19:45.246 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:19:45 smithi177 ceph-mon[22025]: from='client.? 172.21.15.50:0/3089263271' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-08-31T04:19:45.246 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:19:45 smithi177 ceph-mon[22025]: osd.11 [v2:172.21.15.177:6824/2103454982,v1:172.21.15.177:6825/2103454982] boot 2024-08-31T04:19:45.246 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:19:45 smithi177 ceph-mon[22025]: osdmap e68: 12 total, 12 up, 12 in 2024-08-31T04:19:45.246 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:19:45 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-08-31T04:19:45.250 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":67,"num_osds":12,"num_up_osds":11,"osd_up_since":1725077960,"num_in_osds":12,"osd_in_since":1725077961,"num_remapped_pgs":0} 2024-08-31T04:19:45.450 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:19:45 smithi050 ceph-mon[17259]: purged_snaps scrub starts 2024-08-31T04:19:45.450 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:19:45 smithi050 ceph-mon[17259]: purged_snaps scrub ok 2024-08-31T04:19:45.450 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:19:45 smithi050 ceph-mon[17259]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 318 MiB used, 983 GiB / 983 GiB avail 2024-08-31T04:19:45.450 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:19:45 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-08-31T04:19:45.450 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:19:45 smithi050 ceph-mon[17259]: from='client.? 172.21.15.50:0/3089263271' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-08-31T04:19:45.450 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:19:45 smithi050 ceph-mon[17259]: osd.11 [v2:172.21.15.177:6824/2103454982,v1:172.21.15.177:6825/2103454982] boot 2024-08-31T04:19:45.450 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:19:45 smithi050 ceph-mon[17259]: osdmap e68: 12 total, 12 up, 12 in 2024-08-31T04:19:45.450 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:19:45 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-08-31T04:19:45.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:19:45 smithi133 ceph-mon[22177]: purged_snaps scrub starts 2024-08-31T04:19:45.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:19:45 smithi133 ceph-mon[22177]: purged_snaps scrub ok 2024-08-31T04:19:45.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:19:45 smithi133 ceph-mon[22177]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 318 MiB used, 983 GiB / 983 GiB avail 2024-08-31T04:19:45.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:19:45 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-08-31T04:19:45.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:19:45 smithi133 ceph-mon[22177]: from='client.? 172.21.15.50:0/3089263271' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-08-31T04:19:45.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:19:45 smithi133 ceph-mon[22177]: osd.11 [v2:172.21.15.177:6824/2103454982,v1:172.21.15.177:6825/2103454982] boot 2024-08-31T04:19:45.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:19:45 smithi133 ceph-mon[22177]: osdmap e68: 12 total, 12 up, 12 in 2024-08-31T04:19:45.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:19:45 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-08-31T04:19:46.252 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 058d9fc6-674f-11ef-bcd4-c7b262605968 -- ceph osd stat -f json 2024-08-31T04:19:46.638 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:19:47.278 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:47.277+0000 7f1231200640 1 -- 172.21.15.50:0/3560996249 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f122c104f20 msgr2=0x7f122c10b8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:19:47.279 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:47.277+0000 7f1231200640 1 --2- 172.21.15.50:0/3560996249 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f122c104f20 0x7f122c10b8c0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f1224009ca0 tx=0x7f122402a950 comp rx=0 tx=0).stop 2024-08-31T04:19:47.279 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:47.277+0000 7f1231200640 1 -- 172.21.15.50:0/3560996249 shutdown_connections 2024-08-31T04:19:47.279 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:47.277+0000 7f1231200640 1 --2- 172.21.15.50:0/3560996249 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f122c104580 0x7f122c104990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:19:47.279 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:47.277+0000 7f1231200640 1 --2- 172.21.15.50:0/3560996249 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f122c104f20 0x7f122c10b8c0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:19:47.279 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:47.277+0000 7f1231200640 1 --2- 172.21.15.50:0/3560996249 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f122c1034f0 0x7f122c103960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:19:47.279 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:47.277+0000 7f1231200640 1 -- 172.21.15.50:0/3560996249 >> 172.21.15.50:0/3560996249 conn(0x7f122c0fee60 msgr2=0x7f122c101310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:19:47.279 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:47.277+0000 7f1231200640 1 -- 172.21.15.50:0/3560996249 shutdown_connections 2024-08-31T04:19:47.279 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:47.277+0000 7f1231200640 1 -- 172.21.15.50:0/3560996249 wait complete. 2024-08-31T04:19:47.280 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:47.278+0000 7f1231200640 1 Processor -- start 2024-08-31T04:19:47.280 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:47.278+0000 7f1231200640 1 -- start start 2024-08-31T04:19:47.280 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:47.279+0000 7f1231200640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f122c1034f0 0x7f122c19bf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:19:47.280 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:47.279+0000 7f1231200640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f122c104580 0x7f122c19c5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:19:47.281 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:47.279+0000 7f1231200640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f122c104f20 0x7f122c19d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:19:47.281 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:47.279+0000 7f1231200640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f122c10f190 con 0x7f122c104f20 2024-08-31T04:19:47.281 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:47.279+0000 7f1231200640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f122c10f010 con 0x7f122c1034f0 2024-08-31T04:19:47.281 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:47.279+0000 7f1231200640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f122c10f310 con 0x7f122c104580 2024-08-31T04:19:47.281 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:47.279+0000 7f1229e00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f122c1034f0 0x7f122c19bf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:19:47.281 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:47.279+0000 7f122a800640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f122c104f20 0x7f122c19d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:19:47.281 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:47.279+0000 7f1229e00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f122c1034f0 0x7f122c19bf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.50:53064/0 (socket says 172.21.15.50:53064) 2024-08-31T04:19:47.281 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:47.279+0000 7f1229e00640 1 -- 172.21.15.50:0/3756574312 learned_addr learned my addr 172.21.15.50:0/3756574312 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:19:47.282 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:47.279+0000 7f1223e00640 1 --2- 172.21.15.50:0/3756574312 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f122c104580 0x7f122c19c5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:19:47.282 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:47.279+0000 7f1229e00640 1 -- 172.21.15.50:0/3756574312 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f122c104580 msgr2=0x7f122c19c5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:19:47.282 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:47.279+0000 7f1229e00640 1 --2- 172.21.15.50:0/3756574312 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f122c104580 0x7f122c19c5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:19:47.282 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:47.279+0000 7f1229e00640 1 -- 172.21.15.50:0/3756574312 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f122c104f20 msgr2=0x7f122c19d150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:19:47.282 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:47.279+0000 7f1229e00640 1 --2- 172.21.15.50:0/3756574312 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f122c104f20 0x7f122c19d150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:19:47.282 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:47.279+0000 7f1229e00640 1 -- 172.21.15.50:0/3756574312 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f122c19d970 con 0x7f122c1034f0 2024-08-31T04:19:47.283 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:47.280+0000 7f1229e00640 1 --2- 172.21.15.50:0/3756574312 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f122c1034f0 0x7f122c19bf40 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f121c00e9f0 tx=0x7f121c00eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:19:47.283 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:47.280+0000 7f1222a00640 1 -- 172.21.15.50:0/3756574312 <== mon.2 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f121c00cd80 con 0x7f122c1034f0 2024-08-31T04:19:47.283 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:47.280+0000 7f1231200640 1 -- 172.21.15.50:0/3756574312 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f122c19dc60 con 0x7f122c1034f0 2024-08-31T04:19:47.283 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:47.280+0000 7f1222a00640 1 -- 172.21.15.50:0/3756574312 <== mon.2 v2:172.21.15.133:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f121c0108e0 con 0x7f122c1034f0 2024-08-31T04:19:47.283 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:47.280+0000 7f1222a00640 1 -- 172.21.15.50:0/3756574312 <== mon.2 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f121c018980 con 0x7f122c1034f0 2024-08-31T04:19:47.283 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:47.280+0000 7f1231200640 1 -- 172.21.15.50:0/3756574312 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f122c1a4360 con 0x7f122c1034f0 2024-08-31T04:19:47.283 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:47.282+0000 7f1231200640 1 -- 172.21.15.50:0/3756574312 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f122c1a4530 con 0x7f122c1034f0 2024-08-31T04:19:47.285 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:47.284+0000 7f1222a00640 1 -- 172.21.15.50:0/3756574312 <== mon.2 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 16) ==== 152577+0+0 (secure 0 0 0) 0x7f121c010430 con 0x7f122c1034f0 2024-08-31T04:19:47.286 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:47.285+0000 7f1222a00640 1 --2- 172.21.15.50:0/3756574312 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f12100b4bb0 0x7f12100b70c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:19:47.287 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:47.286+0000 7f1222a00640 1 -- 172.21.15.50:0/3756574312 <== mon.2 v2:172.21.15.133:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 7127+0+0 (secure 0 0 0) 0x7f121c0e5480 con 0x7f122c1034f0 2024-08-31T04:19:47.287 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:47.286+0000 7f1223e00640 1 --2- 172.21.15.50:0/3756574312 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f12100b4bb0 0x7f12100b70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:19:47.287 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:47.286+0000 7f1223e00640 1 --2- 172.21.15.50:0/3756574312 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f12100b4bb0 0x7f12100b70c0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f1214009bb0 tx=0x7f1214005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:19:47.288 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:47.287+0000 7f1222a00640 1 -- 172.21.15.50:0/3756574312 <== mon.2 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f121c0ac360 con 0x7f122c1034f0 2024-08-31T04:19:47.450 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:19:47 smithi050 ceph-mon[17259]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T04:19:47.450 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:19:47 smithi050 ceph-mon[17259]: osdmap e69: 12 total, 12 up, 12 in 2024-08-31T04:19:47.481 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:47.480+0000 7f1231200640 1 -- 172.21.15.50:0/3756574312 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7f122c1a4700 con 0x7f122c1034f0 2024-08-31T04:19:47.482 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:47.481+0000 7f1222a00640 1 -- 172.21.15.50:0/3756574312 <== mon.2 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v69) ==== 74+0+133 (secure 0 0 0) 0x7f121c0b0b20 con 0x7f122c1034f0 2024-08-31T04:19:47.482 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-08-31T04:19:47.485 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:47.483+0000 7f1231200640 1 -- 172.21.15.50:0/3756574312 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f12100b4bb0 msgr2=0x7f12100b70c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:19:47.485 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:47.483+0000 7f1231200640 1 --2- 172.21.15.50:0/3756574312 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f12100b4bb0 0x7f12100b70c0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f1214009bb0 tx=0x7f1214005f90 comp rx=0 tx=0).stop 2024-08-31T04:19:47.485 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:47.483+0000 7f1231200640 1 -- 172.21.15.50:0/3756574312 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f122c1034f0 msgr2=0x7f122c19bf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:19:47.485 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:47.483+0000 7f1231200640 1 --2- 172.21.15.50:0/3756574312 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f122c1034f0 0x7f122c19bf40 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f121c00e9f0 tx=0x7f121c00eeb0 comp rx=0 tx=0).stop 2024-08-31T04:19:47.485 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:47.483+0000 7f1231200640 1 -- 172.21.15.50:0/3756574312 shutdown_connections 2024-08-31T04:19:47.485 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:47.483+0000 7f1231200640 1 --2- 172.21.15.50:0/3756574312 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f12100b4bb0 0x7f12100b70c0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:19:47.485 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:47.483+0000 7f1231200640 1 --2- 172.21.15.50:0/3756574312 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f122c104580 0x7f122c19c5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:19:47.485 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:47.483+0000 7f1231200640 1 --2- 172.21.15.50:0/3756574312 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f122c104f20 0x7f122c19d150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:19:47.485 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:47.483+0000 7f1231200640 1 --2- 172.21.15.50:0/3756574312 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f122c1034f0 0x7f122c19bf40 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:19:47.485 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:47.483+0000 7f1231200640 1 -- 172.21.15.50:0/3756574312 >> 172.21.15.50:0/3756574312 conn(0x7f122c0fee60 msgr2=0x7f122c075390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:19:47.485 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:47.484+0000 7f1231200640 1 -- 172.21.15.50:0/3756574312 shutdown_connections 2024-08-31T04:19:47.486 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:47.484+0000 7f1231200640 1 -- 172.21.15.50:0/3756574312 wait complete. 2024-08-31T04:19:47.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:19:47 smithi177 ceph-mon[22025]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T04:19:47.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:19:47 smithi177 ceph-mon[22025]: osdmap e69: 12 total, 12 up, 12 in 2024-08-31T04:19:47.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:19:47 smithi133 ceph-mon[22177]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T04:19:47.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:19:47 smithi133 ceph-mon[22177]: osdmap e69: 12 total, 12 up, 12 in 2024-08-31T04:19:48.324 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":69,"num_osds":12,"num_up_osds":12,"osd_up_since":1725077984,"num_in_osds":12,"osd_in_since":1725077961,"num_remapped_pgs":0} 2024-08-31T04:19:48.325 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 058d9fc6-674f-11ef-bcd4-c7b262605968 -- ceph osd dump --format=json 2024-08-31T04:19:48.450 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:19:48 smithi050 ceph-mon[17259]: from='client.? 172.21.15.50:0/3756574312' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-08-31T04:19:48.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:19:48 smithi177 ceph-mon[22025]: from='client.? 172.21.15.50:0/3756574312' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-08-31T04:19:48.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:19:48 smithi133 ceph-mon[22177]: from='client.? 172.21.15.50:0/3756574312' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-08-31T04:19:48.698 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:19:49.330 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:49.328+0000 7f7d4fa00640 1 -- 172.21.15.50:0/4189622433 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7d4810bdb0 msgr2=0x7f7d481125e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:19:49.330 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:49.328+0000 7f7d4fa00640 1 --2- 172.21.15.50:0/4189622433 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7d4810bdb0 0x7f7d481125e0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f7d40009ca0 tx=0x7f7d4002a8c0 comp rx=0 tx=0).stop 2024-08-31T04:19:49.331 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:49.328+0000 7f7d4fa00640 1 -- 172.21.15.50:0/4189622433 shutdown_connections 2024-08-31T04:19:49.331 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:49.328+0000 7f7d4fa00640 1 --2- 172.21.15.50:0/4189622433 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7d4810bdb0 0x7f7d481125e0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:19:49.331 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:49.328+0000 7f7d4fa00640 1 --2- 172.21.15.50:0/4189622433 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7d4810b460 0x7f7d4810b870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:19:49.331 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:49.328+0000 7f7d4fa00640 1 --2- 172.21.15.50:0/4189622433 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7d48105b20 0x7f7d48105f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:19:49.331 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:49.328+0000 7f7d4fa00640 1 -- 172.21.15.50:0/4189622433 >> 172.21.15.50:0/4189622433 conn(0x7f7d481015b0 msgr2=0x7f7d48103a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:19:49.331 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:49.328+0000 7f7d4fa00640 1 -- 172.21.15.50:0/4189622433 shutdown_connections 2024-08-31T04:19:49.331 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:49.328+0000 7f7d4fa00640 1 -- 172.21.15.50:0/4189622433 wait complete. 2024-08-31T04:19:49.333 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:49.329+0000 7f7d4fa00640 1 Processor -- start 2024-08-31T04:19:49.333 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:49.330+0000 7f7d4fa00640 1 -- start start 2024-08-31T04:19:49.333 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:49.330+0000 7f7d4fa00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7d48105b20 0x7f7d4819c400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:19:49.333 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:49.330+0000 7f7d4fa00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7d4810b460 0x7f7d4819c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:19:49.333 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:49.330+0000 7f7d4fa00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7d4810bdb0 0x7f7d481a1c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:19:49.333 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:49.330+0000 7f7d4fa00640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f7d48115a70 con 0x7f7d4810bdb0 2024-08-31T04:19:49.333 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:49.330+0000 7f7d4fa00640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f7d481158f0 con 0x7f7d4810b460 2024-08-31T04:19:49.334 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:49.330+0000 7f7d4fa00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f7d48115bf0 con 0x7f7d48105b20 2024-08-31T04:19:49.334 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:49.330+0000 7f7d4da00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7d4810bdb0 0x7f7d481a1c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:19:49.334 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:49.330+0000 7f7d4d000640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7d48105b20 0x7f7d4819c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:19:49.334 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:49.330+0000 7f7d4da00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7d4810bdb0 0x7f7d481a1c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:55342/0 (socket says 172.21.15.50:55342) 2024-08-31T04:19:49.334 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:49.330+0000 7f7d3fe00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7d4810b460 0x7f7d4819c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:19:49.334 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:49.330+0000 7f7d4d000640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7d48105b20 0x7f7d4819c400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.50:57122/0 (socket says 172.21.15.50:57122) 2024-08-31T04:19:49.334 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:49.330+0000 7f7d4da00640 1 -- 172.21.15.50:0/3087979431 learned_addr learned my addr 172.21.15.50:0/3087979431 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:19:49.334 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:49.331+0000 7f7d4d000640 1 -- 172.21.15.50:0/3087979431 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7d4810b460 msgr2=0x7f7d4819c9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:19:49.334 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:49.331+0000 7f7d4d000640 1 --2- 172.21.15.50:0/3087979431 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7d4810b460 0x7f7d4819c9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:19:49.334 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:49.331+0000 7f7d4d000640 1 -- 172.21.15.50:0/3087979431 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7d4810bdb0 msgr2=0x7f7d481a1c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:19:49.334 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:49.331+0000 7f7d4d000640 1 --2- 172.21.15.50:0/3087979431 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7d4810bdb0 0x7f7d481a1c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:19:49.334 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:49.331+0000 7f7d4d000640 1 -- 172.21.15.50:0/3087979431 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d481a2370 con 0x7f7d48105b20 2024-08-31T04:19:49.335 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:49.331+0000 7f7d4da00640 1 --2- 172.21.15.50:0/3087979431 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7d4810bdb0 0x7f7d481a1c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:19:49.335 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:49.331+0000 7f7d4d000640 1 --2- 172.21.15.50:0/3087979431 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7d48105b20 0x7f7d4819c400 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f7d3800e9f0 tx=0x7f7d3800eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:19:49.335 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:49.332+0000 7f7d46000640 1 -- 172.21.15.50:0/3087979431 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d3800ccc0 con 0x7f7d48105b20 2024-08-31T04:19:49.335 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:49.332+0000 7f7d4fa00640 1 -- 172.21.15.50:0/3087979431 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7d481a2660 con 0x7f7d48105b20 2024-08-31T04:19:49.335 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:49.332+0000 7f7d4fa00640 1 -- 172.21.15.50:0/3087979431 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7d481a8dc0 con 0x7f7d48105b20 2024-08-31T04:19:49.335 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:49.332+0000 7f7d46000640 1 -- 172.21.15.50:0/3087979431 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7d380044d0 con 0x7f7d48105b20 2024-08-31T04:19:49.335 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:49.332+0000 7f7d46000640 1 -- 172.21.15.50:0/3087979431 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d3801c070 con 0x7f7d48105b20 2024-08-31T04:19:49.335 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:49.333+0000 7f7d4fa00640 1 -- 172.21.15.50:0/3087979431 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7d240052c0 con 0x7f7d48105b20 2024-08-31T04:19:49.336 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:49.335+0000 7f7d46000640 1 -- 172.21.15.50:0/3087979431 <== mon.1 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 16) ==== 152577+0+0 (secure 0 0 0) 0x7f7d38005020 con 0x7f7d48105b20 2024-08-31T04:19:49.338 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:49.337+0000 7f7d46000640 1 --2- 172.21.15.50:0/3087979431 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f7d2c0b4bb0 0x7f7d2c0b70c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:19:49.338 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:49.337+0000 7f7d46000640 1 -- 172.21.15.50:0/3087979431 <== mon.1 v2:172.21.15.177:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 7127+0+0 (secure 0 0 0) 0x7f7d380e4b20 con 0x7f7d48105b20 2024-08-31T04:19:49.338 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:49.337+0000 7f7d3fe00640 1 --2- 172.21.15.50:0/3087979431 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f7d2c0b4bb0 0x7f7d2c0b70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:19:49.339 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:49.338+0000 7f7d3fe00640 1 --2- 172.21.15.50:0/3087979431 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f7d2c0b4bb0 0x7f7d2c0b70c0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f7d48104e00 tx=0x7f7d30005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:19:49.340 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:49.339+0000 7f7d46000640 1 -- 172.21.15.50:0/3087979431 <== mon.1 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f7d380ac0e0 con 0x7f7d48105b20 2024-08-31T04:19:49.450 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:19:49 smithi050 ceph-mon[17259]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T04:19:49.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:19:49 smithi177 ceph-mon[22025]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T04:19:49.536 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:49.535+0000 7f7d4fa00640 1 -- 172.21.15.50:0/3087979431 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f7d24005880 con 0x7f7d48105b20 2024-08-31T04:19:49.538 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:49.536+0000 7f7d46000640 1 -- 172.21.15.50:0/3087979431 <== mon.1 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v69) ==== 74+0+18470 (secure 0 0 0) 0x7f7d380ab9e0 con 0x7f7d48105b20 2024-08-31T04:19:49.538 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-08-31T04:19:49.538 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":69,"fsid":"058d9fc6-674f-11ef-bcd4-c7b262605968","created":"2024-08-31T04:11:59.576131+0000","modified":"2024-08-31T04:19:46.175488+0000","last_up_change":"2024-08-31T04:19:44.619590+0000","last_in_change":"2024-08-31T04:19:21.022096+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-31T04:15:46.229142+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"416ecbde-4a7b-4bd1-b377-490925a33ce1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":3831273843},{"type":"v1","addr":"172.21.15.50:6803","nonce":3831273843}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":3831273843},{"type":"v1","addr":"172.21.15.50:6805","nonce":3831273843}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":3831273843},{"type":"v1","addr":"172.21.15.50:6809","nonce":3831273843}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":3831273843},{"type":"v1","addr":"172.21.15.50:6807","nonce":3831273843}]},"public_addr":"172.21.15.50:6803/3831273843","cluster_addr":"172.21.15.50:6805/3831273843","heartbeat_back_addr":"172.21.15.50:6809/3831273843","heartbeat_front_addr":"172.21.15.50:6807/3831273843","state":["exists","up"]},{"osd":1,"uuid":"5e008006-004d-4842-9885-93a2d27be1cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":475308203},{"type":"v1","addr":"172.21.15.133:6801","nonce":475308203}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":475308203},{"type":"v1","addr":"172.21.15.133:6803","nonce":475308203}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":475308203},{"type":"v1","addr":"172.21.15.133:6807","nonce":475308203}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":475308203},{"type":"v1","addr":"172.21.15.133:6805","nonce":475308203}]},"public_addr":"172.21.15.133:6801/475308203","cluster_addr":"172.21.15.133:6803/475308203","heartbeat_back_addr":"172.21.15.133:6807/475308203","heartbeat_front_addr":"172.21.15.133:6805/475308203","state":["exists","up"]},{"osd":2,"uuid":"7e6f1a26-f30d-4822-af69-8a08cb89fbce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":3091173426},{"type":"v1","addr":"172.21.15.177:6801","nonce":3091173426}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":3091173426},{"type":"v1","addr":"172.21.15.177:6803","nonce":3091173426}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":3091173426},{"type":"v1","addr":"172.21.15.177:6807","nonce":3091173426}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":3091173426},{"type":"v1","addr":"172.21.15.177:6805","nonce":3091173426}]},"public_addr":"172.21.15.177:6801/3091173426","cluster_addr":"172.21.15.177:6803/3091173426","heartbeat_back_addr":"172.21.15.177:6807/3091173426","heartbeat_front_addr":"172.21.15.177:6805/3091173426","state":["exists","up"]},{"osd":3,"uuid":"8193c2a2-18a1-4684-9a16-cbeae25530ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":3792992620},{"type":"v1","addr":"172.21.15.50:6811","nonce":3792992620}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":3792992620},{"type":"v1","addr":"172.21.15.50:6813","nonce":3792992620}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":3792992620},{"type":"v1","addr":"172.21.15.50:6817","nonce":3792992620}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":3792992620},{"type":"v1","addr":"172.21.15.50:6815","nonce":3792992620}]},"public_addr":"172.21.15.50:6811/3792992620","cluster_addr":"172.21.15.50:6813/3792992620","heartbeat_back_addr":"172.21.15.50:6817/3792992620","heartbeat_front_addr":"172.21.15.50:6815/3792992620","state":["exists","up"]},{"osd":4,"uuid":"2a2b4e64-0f8e-40ec-926c-84dbf691aefe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":2855333596},{"type":"v1","addr":"172.21.15.133:6809","nonce":2855333596}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":2855333596},{"type":"v1","addr":"172.21.15.133:6811","nonce":2855333596}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":2855333596},{"type":"v1","addr":"172.21.15.133:6815","nonce":2855333596}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":2855333596},{"type":"v1","addr":"172.21.15.133:6813","nonce":2855333596}]},"public_addr":"172.21.15.133:6809/2855333596","cluster_addr":"172.21.15.133:6811/2855333596","heartbeat_back_addr":"172.21.15.133:6815/2855333596","heartbeat_front_addr":"172.21.15.133:6813/2855333596","state":["exists","up"]},{"osd":5,"uuid":"83429ff0-ea7d-4fcc-9611-39d9001aa216","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":1166415084},{"type":"v1","addr":"172.21.15.177:6809","nonce":1166415084}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":1166415084},{"type":"v1","addr":"172.21.15.177:6811","nonce":1166415084}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":1166415084},{"type":"v1","addr":"172.21.15.177:6815","nonce":1166415084}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":1166415084},{"type":"v1","addr":"172.21.15.177:6813","nonce":1166415084}]},"public_addr":"172.21.15.177:6809/1166415084","cluster_addr":"172.21.15.177:6811/1166415084","heartbeat_back_addr":"172.21.15.177:6815/1166415084","heartbeat_front_addr":"172.21.15.177:6813/1166415084","state":["exists","up"]},{"osd":6,"uuid":"eeb571ef-5e43-4816-95dd-d01d83aeca83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":1429341184},{"type":"v1","addr":"172.21.15.50:6819","nonce":1429341184}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":1429341184},{"type":"v1","addr":"172.21.15.50:6821","nonce":1429341184}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":1429341184},{"type":"v1","addr":"172.21.15.50:6825","nonce":1429341184}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":1429341184},{"type":"v1","addr":"172.21.15.50:6823","nonce":1429341184}]},"public_addr":"172.21.15.50:6819/1429341184","cluster_addr":"172.21.15.50:6821/1429341184","heartbeat_back_addr":"172.21.15.50:6825/1429341184","heartbeat_front_addr":"172.21.15.50:6823/1429341184","state":["exists","up"]},{"osd":7,"uuid":"512ee507-0d50-4fed-b692-dbdf23a93e8e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":3643454923},{"type":"v1","addr":"172.21.15.133:6817","nonce":3643454923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":3643454923},{"type":"v1","addr":"172.21.15.133:6819","nonce":3643454923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":3643454923},{"type":"v1","addr":"172.21.15.133:6823","nonce":3643454923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":3643454923},{"type":"v1","addr":"172.21.15.133:6821","nonce":3643454923}]},"public_addr":"172.21.15.133:6817/3643454923","cluster_addr":"172.21.15.133:6819/3643454923","heartbeat_back_addr":"172.21.15.133:6823/3643454923","heartbeat_front_addr":"172.21.15.133:6821/3643454923","state":["exists","up"]},{"osd":8,"uuid":"ae99526e-41da-4cb5-857f-2e66f18f2d94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6816","nonce":101973300},{"type":"v1","addr":"172.21.15.177:6817","nonce":101973300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":101973300},{"type":"v1","addr":"172.21.15.177:6819","nonce":101973300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":101973300},{"type":"v1","addr":"172.21.15.177:6823","nonce":101973300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":101973300},{"type":"v1","addr":"172.21.15.177:6821","nonce":101973300}]},"public_addr":"172.21.15.177:6817/101973300","cluster_addr":"172.21.15.177:6819/101973300","heartbeat_back_addr":"172.21.15.177:6823/101973300","heartbeat_front_addr":"172.21.15.177:6821/101973300","state":["exists","up"]},{"osd":9,"uuid":"fcedbe16-b910-407f-b9d7-1dd03f3e62a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":53019860},{"type":"v1","addr":"172.21.15.50:6827","nonce":53019860}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":53019860},{"type":"v1","addr":"172.21.15.50:6829","nonce":53019860}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":53019860},{"type":"v1","addr":"172.21.15.50:6833","nonce":53019860}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":53019860},{"type":"v1","addr":"172.21.15.50:6831","nonce":53019860}]},"public_addr":"172.21.15.50:6827/53019860","cluster_addr":"172.21.15.50:6829/53019860","heartbeat_back_addr":"172.21.15.50:6833/53019860","heartbeat_front_addr":"172.21.15.50:6831/53019860","state":["exists","up"]},{"osd":10,"uuid":"3852756e-62f1-4e71-a070-8cff76df99b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":4175566493},{"type":"v1","addr":"172.21.15.133:6825","nonce":4175566493}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":4175566493},{"type":"v1","addr":"172.21.15.133:6827","nonce":4175566493}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":4175566493},{"type":"v1","addr":"172.21.15.133:6831","nonce":4175566493}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":4175566493},{"type":"v1","addr":"172.21.15.133:6829","nonce":4175566493}]},"public_addr":"172.21.15.133:6825/4175566493","cluster_addr":"172.21.15.133:6827/4175566493","heartbeat_back_addr":"172.21.15.133:6831/4175566493","heartbeat_front_addr":"172.21.15.133:6829/4175566493","state":["exists","up"]},{"osd":11,"uuid":"a154180a-5f2a-4b33-ad3d-fea7317597ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":2103454982},{"type":"v1","addr":"172.21.15.177:6825","nonce":2103454982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":2103454982},{"type":"v1","addr":"172.21.15.177:6827","nonce":2103454982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":2103454982},{"type":"v1","addr":"172.21.15.177:6831","nonce":2103454982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":2103454982},{"type":"v1","addr":"172.21.15.177:6829","nonce":2103454982}]},"public_addr":"172.21.15.177:6825/2103454982","cluster_addr":"172.21.15.177:6827/2103454982","heartbeat_back_addr":"172.21.15.177:6831/2103454982","heartbeat_front_addr":"172.21.15.177:6829/2103454982","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:14:54.683660+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:15:20.007319+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:15:43.613426+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:16:12.387010+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:16:38.079210+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:17:02.750375+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:17:31.735810+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:17:57.600985+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:18:22.503347+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:18:52.316657+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:19:18.444623+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:19:42.331006+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.50:6801/1319056820":"2024-09-01T04:12:55.742020+0000","172.21.15.50:0/1755103674":"2024-09-01T04:12:55.742020+0000","172.21.15.50:6800/1319056820":"2024-09-01T04:12:55.742020+0000","172.21.15.50:0/3701412233":"2024-09-01T04:12:55.742020+0000","172.21.15.50:0/1829556336":"2024-09-01T04:12:55.742020+0000","172.21.15.50:0/1698995126":"2024-09-01T04:12:25.753831+0000","172.21.15.50:0/1554317941":"2024-09-01T04:12:25.753831+0000","172.21.15.50:0/2998110380":"2024-09-01T04:12:25.753831+0000","172.21.15.50:6801/4197277793":"2024-09-01T04:12:25.753831+0000","172.21.15.50:6800/4197277793":"2024-09-01T04:12:25.753831+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-31T04:19:49.541 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:49.539+0000 7f7d4fa00640 1 -- 172.21.15.50:0/3087979431 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f7d2c0b4bb0 msgr2=0x7f7d2c0b70c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:19:49.541 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:49.539+0000 7f7d4fa00640 1 --2- 172.21.15.50:0/3087979431 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f7d2c0b4bb0 0x7f7d2c0b70c0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f7d48104e00 tx=0x7f7d30005f90 comp rx=0 tx=0).stop 2024-08-31T04:19:49.541 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:49.539+0000 7f7d4fa00640 1 -- 172.21.15.50:0/3087979431 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7d48105b20 msgr2=0x7f7d4819c400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:19:49.541 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:49.539+0000 7f7d4fa00640 1 --2- 172.21.15.50:0/3087979431 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7d48105b20 0x7f7d4819c400 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f7d3800e9f0 tx=0x7f7d3800eeb0 comp rx=0 tx=0).stop 2024-08-31T04:19:49.541 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:49.539+0000 7f7d4fa00640 1 -- 172.21.15.50:0/3087979431 shutdown_connections 2024-08-31T04:19:49.541 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:49.539+0000 7f7d4fa00640 1 --2- 172.21.15.50:0/3087979431 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f7d2c0b4bb0 0x7f7d2c0b70c0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:19:49.541 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:49.539+0000 7f7d4fa00640 1 --2- 172.21.15.50:0/3087979431 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7d4810bdb0 0x7f7d481a1c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:19:49.541 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:49.539+0000 7f7d4fa00640 1 --2- 172.21.15.50:0/3087979431 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7d4810b460 0x7f7d4819c9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:19:49.541 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:49.539+0000 7f7d4fa00640 1 --2- 172.21.15.50:0/3087979431 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7d48105b20 0x7f7d4819c400 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:19:49.541 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:49.539+0000 7f7d4fa00640 1 -- 172.21.15.50:0/3087979431 >> 172.21.15.50:0/3087979431 conn(0x7f7d481015b0 msgr2=0x7f7d48108a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:19:49.541 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:49.539+0000 7f7d4fa00640 1 -- 172.21.15.50:0/3087979431 shutdown_connections 2024-08-31T04:19:49.542 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:49.539+0000 7f7d4fa00640 1 -- 172.21.15.50:0/3087979431 wait complete. 2024-08-31T04:19:49.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:19:49 smithi133 ceph-mon[22177]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T04:19:50.332 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-08-31T04:15:46.229142+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-08-31T04:19:50.332 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 058d9fc6-674f-11ef-bcd4-c7b262605968 -- ceph osd pool get .mgr pg_num 2024-08-31T04:19:50.450 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:19:50 smithi050 ceph-mon[17259]: from='client.? 172.21.15.50:0/3087979431' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-31T04:19:50.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:19:50 smithi177 ceph-mon[22025]: from='client.? 172.21.15.50:0/3087979431' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-31T04:19:50.542 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:19:50 smithi133 ceph-mon[22177]: from='client.? 172.21.15.50:0/3087979431' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-31T04:19:50.705 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:19:51.314 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:51.312+0000 7f5817400640 1 -- 172.21.15.50:0/318098289 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f581010b470 msgr2=0x7f581010b880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:19:51.314 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:51.312+0000 7f5817400640 1 --2- 172.21.15.50:0/318098289 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f581010b470 0x7f581010b880 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f57f8009900 tx=0x7f57f802a410 comp rx=0 tx=0).stop 2024-08-31T04:19:51.314 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:51.312+0000 7f5817400640 1 -- 172.21.15.50:0/318098289 shutdown_connections 2024-08-31T04:19:51.314 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:51.312+0000 7f5817400640 1 --2- 172.21.15.50:0/318098289 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f581010bdc0 0x7f58101125f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:19:51.314 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:51.312+0000 7f5817400640 1 --2- 172.21.15.50:0/318098289 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f581010b470 0x7f581010b880 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:19:51.314 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:51.312+0000 7f5817400640 1 --2- 172.21.15.50:0/318098289 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5810105b30 0x7f5810105f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:19:51.315 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:51.312+0000 7f5817400640 1 -- 172.21.15.50:0/318098289 >> 172.21.15.50:0/318098289 conn(0x7f5810101600 msgr2=0x7f5810103a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:19:51.315 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:51.312+0000 7f5817400640 1 -- 172.21.15.50:0/318098289 shutdown_connections 2024-08-31T04:19:51.315 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:51.312+0000 7f5817400640 1 -- 172.21.15.50:0/318098289 wait complete. 2024-08-31T04:19:51.316 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:51.313+0000 7f5817400640 1 Processor -- start 2024-08-31T04:19:51.316 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:51.314+0000 7f5817400640 1 -- start start 2024-08-31T04:19:51.316 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:51.314+0000 7f5817400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5810105b30 0x7f581019c470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:19:51.316 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:51.314+0000 7f5817400640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f581010b470 0x7f581019ca10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:19:51.316 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:51.314+0000 7f5817400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f581010bdc0 0x7f58101a1cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:19:51.316 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:51.314+0000 7f5817400640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f5810115a80 con 0x7f5810105b30 2024-08-31T04:19:51.317 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:51.314+0000 7f5817400640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f5810115900 con 0x7f581010bdc0 2024-08-31T04:19:51.317 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:51.314+0000 7f5817400640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f5810115c00 con 0x7f581010b470 2024-08-31T04:19:51.317 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:51.314+0000 7f5814a00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5810105b30 0x7f581019c470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:19:51.317 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:51.314+0000 7f5814a00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5810105b30 0x7f581019c470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:55356/0 (socket says 172.21.15.50:55356) 2024-08-31T04:19:51.317 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:51.314+0000 7f5814a00640 1 -- 172.21.15.50:0/3421973477 learned_addr learned my addr 172.21.15.50:0/3421973477 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:19:51.317 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:51.315+0000 7f5807e00640 1 --2- 172.21.15.50:0/3421973477 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f581010b470 0x7f581019ca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:19:51.317 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:51.315+0000 7f5815400640 1 --2- 172.21.15.50:0/3421973477 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f581010bdc0 0x7f58101a1cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:19:51.317 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:51.315+0000 7f5814a00640 1 -- 172.21.15.50:0/3421973477 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f581010b470 msgr2=0x7f581019ca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:19:51.317 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:51.315+0000 7f5814a00640 1 --2- 172.21.15.50:0/3421973477 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f581010b470 0x7f581019ca10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:19:51.317 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:51.315+0000 7f5814a00640 1 -- 172.21.15.50:0/3421973477 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f581010bdc0 msgr2=0x7f58101a1cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:19:51.317 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:51.315+0000 7f5814a00640 1 --2- 172.21.15.50:0/3421973477 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f581010bdc0 0x7f58101a1cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:19:51.317 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:51.315+0000 7f5814a00640 1 -- 172.21.15.50:0/3421973477 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58101a23e0 con 0x7f5810105b30 2024-08-31T04:19:51.318 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:51.315+0000 7f5814a00640 1 --2- 172.21.15.50:0/3421973477 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5810105b30 0x7f581019c470 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f580000e9f0 tx=0x7f580000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:19:51.318 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:51.315+0000 7f580e000640 1 -- 172.21.15.50:0/3421973477 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f580000cd80 con 0x7f5810105b30 2024-08-31T04:19:51.318 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:51.316+0000 7f580e000640 1 -- 172.21.15.50:0/3421973477 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f58000108e0 con 0x7f5810105b30 2024-08-31T04:19:51.318 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:51.316+0000 7f580e000640 1 -- 172.21.15.50:0/3421973477 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5800018980 con 0x7f5810105b30 2024-08-31T04:19:51.318 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:51.316+0000 7f5817400640 1 -- 172.21.15.50:0/3421973477 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f58101a26d0 con 0x7f5810105b30 2024-08-31T04:19:51.318 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:51.316+0000 7f5817400640 1 -- 172.21.15.50:0/3421973477 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f58101a8e30 con 0x7f5810105b30 2024-08-31T04:19:51.318 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:51.317+0000 7f5817400640 1 -- 172.21.15.50:0/3421973477 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5810105f40 con 0x7f5810105b30 2024-08-31T04:19:51.320 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:51.319+0000 7f580e000640 1 -- 172.21.15.50:0/3421973477 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 16) ==== 152577+0+0 (secure 0 0 0) 0x7f5800010430 con 0x7f5810105b30 2024-08-31T04:19:51.322 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:51.321+0000 7f580e000640 1 --2- 172.21.15.50:0/3421973477 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f57f40b4bb0 0x7f57f40b70c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:19:51.322 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:51.321+0000 7f580e000640 1 -- 172.21.15.50:0/3421973477 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 7127+0+0 (secure 0 0 0) 0x7f58000e4fc0 con 0x7f5810105b30 2024-08-31T04:19:51.322 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:51.321+0000 7f5807e00640 1 --2- 172.21.15.50:0/3421973477 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f57f40b4bb0 0x7f57f40b70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:19:51.323 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:51.322+0000 7f5807e00640 1 --2- 172.21.15.50:0/3421973477 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f57f40b4bb0 0x7f57f40b70c0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f57f8009230 tx=0x7f57f8031400 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:19:51.326 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:51.325+0000 7f580e000640 1 -- 172.21.15.50:0/3421973477 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f58000abea0 con 0x7f5810105b30 2024-08-31T04:19:51.450 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:19:51 smithi050 ceph-mon[17259]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T04:19:51.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:19:51 smithi177 ceph-mon[22025]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T04:19:51.518 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:51.517+0000 7f5817400640 1 -- 172.21.15.50:0/3421973477 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f581010d620 con 0x7f5810105b30 2024-08-31T04:19:51.518 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:51.517+0000 7f580e000640 1 -- 172.21.15.50:0/3421973477 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v69) ==== 93+0+10 (secure 0 0 0) 0x7f58000b0660 con 0x7f5810105b30 2024-08-31T04:19:51.519 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 1 2024-08-31T04:19:51.521 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:51.520+0000 7f5817400640 1 -- 172.21.15.50:0/3421973477 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f57f40b4bb0 msgr2=0x7f57f40b70c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:19:51.521 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:51.520+0000 7f5817400640 1 --2- 172.21.15.50:0/3421973477 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f57f40b4bb0 0x7f57f40b70c0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f57f8009230 tx=0x7f57f8031400 comp rx=0 tx=0).stop 2024-08-31T04:19:51.521 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:51.520+0000 7f5817400640 1 -- 172.21.15.50:0/3421973477 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5810105b30 msgr2=0x7f581019c470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:19:51.521 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:51.520+0000 7f5817400640 1 --2- 172.21.15.50:0/3421973477 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5810105b30 0x7f581019c470 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f580000e9f0 tx=0x7f580000eeb0 comp rx=0 tx=0).stop 2024-08-31T04:19:51.521 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:51.520+0000 7f5817400640 1 -- 172.21.15.50:0/3421973477 shutdown_connections 2024-08-31T04:19:51.521 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:51.520+0000 7f5817400640 1 --2- 172.21.15.50:0/3421973477 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f57f40b4bb0 0x7f57f40b70c0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:19:51.522 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:51.520+0000 7f5817400640 1 --2- 172.21.15.50:0/3421973477 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f581010b470 0x7f581019ca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:19:51.522 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:51.520+0000 7f5817400640 1 --2- 172.21.15.50:0/3421973477 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f581010bdc0 0x7f58101a1cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:19:51.522 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:51.520+0000 7f5817400640 1 --2- 172.21.15.50:0/3421973477 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5810105b30 0x7f581019c470 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:19:51.522 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:51.520+0000 7f5817400640 1 -- 172.21.15.50:0/3421973477 >> 172.21.15.50:0/3421973477 conn(0x7f5810101600 msgr2=0x7f581010ab20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:19:51.522 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:51.520+0000 7f5817400640 1 -- 172.21.15.50:0/3421973477 shutdown_connections 2024-08-31T04:19:51.522 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:51.520+0000 7f5817400640 1 -- 172.21.15.50:0/3421973477 wait complete. 2024-08-31T04:19:51.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:19:51 smithi133 ceph-mon[22177]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T04:19:52.251 INFO:tasks.cephadm:Adding mds.a on smithi050 2024-08-31T04:19:52.252 INFO:tasks.cephadm:Adding mds.d on smithi050 2024-08-31T04:19:52.252 INFO:tasks.cephadm:Adding mds.g on smithi050 2024-08-31T04:19:52.252 INFO:tasks.cephadm:Adding mds.j on smithi050 2024-08-31T04:19:52.252 INFO:tasks.cephadm:Adding mds.b on smithi133 2024-08-31T04:19:52.252 INFO:tasks.cephadm:Adding mds.e on smithi133 2024-08-31T04:19:52.252 INFO:tasks.cephadm:Adding mds.h on smithi133 2024-08-31T04:19:52.252 INFO:tasks.cephadm:Adding mds.k on smithi133 2024-08-31T04:19:52.252 INFO:tasks.cephadm:Adding mds.c on smithi177 2024-08-31T04:19:52.252 INFO:tasks.cephadm:Adding mds.f on smithi177 2024-08-31T04:19:52.252 INFO:tasks.cephadm:Adding mds.i on smithi177 2024-08-31T04:19:52.252 INFO:tasks.cephadm:Adding mds.l on smithi177 2024-08-31T04:19:52.253 DEBUG:teuthology.orchestra.run.smithi177:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 058d9fc6-674f-11ef-bcd4-c7b262605968 -- ceph orch apply mds all '12;smithi050=a;smithi050=d;smithi050=g;smithi050=j;smithi133=b;smithi133=e;smithi133=h;smithi133=k;smithi177=c;smithi177=f;smithi177=i;smithi177=l' 2024-08-31T04:19:52.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:19:52 smithi177 ceph-mon[22025]: from='client.? 172.21.15.50:0/3421973477' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-08-31T04:19:52.516 INFO:teuthology.orchestra.run.smithi177.stderr:Inferring config /var/lib/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/mon.c/config 2024-08-31T04:19:52.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:19:52 smithi133 ceph-mon[22177]: from='client.? 172.21.15.50:0/3421973477' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-08-31T04:19:52.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:19:52 smithi050 ceph-mon[17259]: from='client.? 172.21.15.50:0/3421973477' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-08-31T04:19:53.033 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-31T04:19:53.025+0000 7f3ca0d4f640 1 -- 172.21.15.177:0/1567965210 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3c9c076e80 msgr2=0x7f3c9c075550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:19:53.033 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-31T04:19:53.025+0000 7f3ca0d4f640 1 --2- 172.21.15.177:0/1567965210 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3c9c076e80 0x7f3c9c075550 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f3c8c009900 tx=0x7f3c8c02a410 comp rx=0 tx=0).stop 2024-08-31T04:19:53.033 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-31T04:19:53.025+0000 7f3ca0d4f640 1 -- 172.21.15.177:0/1567965210 shutdown_connections 2024-08-31T04:19:53.033 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-31T04:19:53.025+0000 7f3ca0d4f640 1 --2- 172.21.15.177:0/1567965210 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3c9c10b490 0x7f3c9c10d930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:19:53.033 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-31T04:19:53.025+0000 7f3ca0d4f640 1 --2- 172.21.15.177:0/1567965210 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3c9c075a90 0x7f3c9c075ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:19:53.033 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-31T04:19:53.025+0000 7f3ca0d4f640 1 --2- 172.21.15.177:0/1567965210 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3c9c076e80 0x7f3c9c075550 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:19:53.034 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-31T04:19:53.025+0000 7f3ca0d4f640 1 -- 172.21.15.177:0/1567965210 >> 172.21.15.177:0/1567965210 conn(0x7f3c9c0fee60 msgr2=0x7f3c9c101310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:19:53.034 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-31T04:19:53.025+0000 7f3ca0d4f640 1 -- 172.21.15.177:0/1567965210 shutdown_connections 2024-08-31T04:19:53.034 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-31T04:19:53.025+0000 7f3ca0d4f640 1 -- 172.21.15.177:0/1567965210 wait complete. 2024-08-31T04:19:53.034 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-31T04:19:53.026+0000 7f3ca0d4f640 1 Processor -- start 2024-08-31T04:19:53.034 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-31T04:19:53.026+0000 7f3ca0d4f640 1 -- start start 2024-08-31T04:19:53.034 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-31T04:19:53.026+0000 7f3ca0d4f640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3c9c075a90 0x7f3c9c19c000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:19:53.034 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-31T04:19:53.026+0000 7f3ca0d4f640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3c9c076e80 0x7f3c9c19c670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:19:53.034 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-31T04:19:53.026+0000 7f3ca0d4f640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3c9c10b490 0x7f3c9c19d210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:19:53.034 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-31T04:19:53.026+0000 7f3ca0d4f640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f3c9c111380 con 0x7f3c9c10b490 2024-08-31T04:19:53.034 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-31T04:19:53.026+0000 7f3ca0d4f640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f3c9c111200 con 0x7f3c9c075a90 2024-08-31T04:19:53.034 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-31T04:19:53.026+0000 7f3ca0d4f640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f3c9c111500 con 0x7f3c9c076e80 2024-08-31T04:19:53.034 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-31T04:19:53.026+0000 7f3c99d9b640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3c9c076e80 0x7f3c9c19c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:19:53.035 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-31T04:19:53.026+0000 7f3c99d9b640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3c9c076e80 0x7f3c9c19c670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:55120/0 (socket says 172.21.15.177:55120) 2024-08-31T04:19:53.035 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-31T04:19:53.026+0000 7f3c99d9b640 1 -- 172.21.15.177:0/293345656 learned_addr learned my addr 172.21.15.177:0/293345656 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-08-31T04:19:53.035 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-31T04:19:53.026+0000 7f3c9a59c640 1 --2- 172.21.15.177:0/293345656 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3c9c075a90 0x7f3c9c19c000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:19:53.035 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-31T04:19:53.026+0000 7f3c99d9b640 1 -- 172.21.15.177:0/293345656 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3c9c075a90 msgr2=0x7f3c9c19c000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:19:53.035 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-31T04:19:53.026+0000 7f3c99d9b640 1 --2- 172.21.15.177:0/293345656 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3c9c075a90 0x7f3c9c19c000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:19:53.035 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-31T04:19:53.027+0000 7f3c99d9b640 1 -- 172.21.15.177:0/293345656 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3c9c10b490 msgr2=0x7f3c9c19d210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:19:53.035 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-31T04:19:53.027+0000 7f3c99d9b640 1 --2- 172.21.15.177:0/293345656 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3c9c10b490 0x7f3c9c19d210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:19:53.035 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-31T04:19:53.027+0000 7f3c99d9b640 1 -- 172.21.15.177:0/293345656 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c9c19da30 con 0x7f3c9c076e80 2024-08-31T04:19:53.035 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-31T04:19:53.027+0000 7f3c99d9b640 1 --2- 172.21.15.177:0/293345656 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3c9c076e80 0x7f3c9c19c670 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f3c9000b4a0 tx=0x7f3c9000b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:19:53.035 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-31T04:19:53.027+0000 7f3c8b7fe640 1 -- 172.21.15.177:0/293345656 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c90014070 con 0x7f3c9c076e80 2024-08-31T04:19:53.035 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-31T04:19:53.027+0000 7f3c8b7fe640 1 -- 172.21.15.177:0/293345656 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3c90010ac0 con 0x7f3c9c076e80 2024-08-31T04:19:53.035 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-31T04:19:53.027+0000 7f3ca0d4f640 1 -- 172.21.15.177:0/293345656 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3c9c19dd20 con 0x7f3c9c076e80 2024-08-31T04:19:53.035 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-31T04:19:53.027+0000 7f3c8b7fe640 1 -- 172.21.15.177:0/293345656 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c90017c30 con 0x7f3c9c076e80 2024-08-31T04:19:53.036 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-31T04:19:53.027+0000 7f3ca0d4f640 1 -- 172.21.15.177:0/293345656 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3c9c1a4420 con 0x7f3c9c076e80 2024-08-31T04:19:53.036 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-31T04:19:53.028+0000 7f3ca0d4f640 1 -- 172.21.15.177:0/293345656 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3c9c1a46b0 con 0x7f3c9c076e80 2024-08-31T04:19:53.036 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-31T04:19:53.029+0000 7f3c8b7fe640 1 -- 172.21.15.177:0/293345656 <== mon.1 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 16) ==== 152577+0+0 (secure 0 0 0) 0x7f3c90017070 con 0x7f3c9c076e80 2024-08-31T04:19:53.036 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-31T04:19:53.030+0000 7f3c8b7fe640 1 --2- 172.21.15.177:0/293345656 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f3c840b4bb0 0x7f3c840b70c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:19:53.036 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-31T04:19:53.030+0000 7f3c8b7fe640 1 -- 172.21.15.177:0/293345656 <== mon.1 v2:172.21.15.177:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 7127+0+0 (secure 0 0 0) 0x7f3c900e41d0 con 0x7f3c9c076e80 2024-08-31T04:19:53.036 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-31T04:19:53.031+0000 7f3c9a59c640 1 --2- 172.21.15.177:0/293345656 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f3c840b4bb0 0x7f3c840b70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:19:53.036 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-31T04:19:53.031+0000 7f3c9a59c640 1 --2- 172.21.15.177:0/293345656 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f3c840b4bb0 0x7f3c840b70c0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f3c8c000c00 tx=0x7f3c8c031400 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:19:53.036 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-31T04:19:53.033+0000 7f3c8b7fe640 1 -- 172.21.15.177:0/293345656 <== mon.1 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f3c900ab7a0 con 0x7f3c9c076e80 2024-08-31T04:19:53.225 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-31T04:19:53.223+0000 7f3ca0d4f640 1 -- 172.21.15.177:0/293345656 --> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] -- mgr_command(tid 0: {"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi050=a;smithi050=d;smithi050=g;smithi050=j;smithi133=b;smithi133=e;smithi133=h;smithi133=k;smithi177=c;smithi177=f;smithi177=i;smithi177=l", "target": ["mon-mgr", ""]}) -- 0x7f3c9c0ffa50 con 0x7f3c840b4bb0 2024-08-31T04:19:53.233 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-31T04:19:53.232+0000 7f3c8b7fe640 1 -- 172.21.15.177:0/293345656 <== mgr.14150 v2:172.21.15.50:6800/2146686622 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+28 (secure 0 0 0) 0x7f3c9c0ffa50 con 0x7f3c840b4bb0 2024-08-31T04:19:53.234 INFO:teuthology.orchestra.run.smithi177.stdout:Scheduled mds.all update... 2024-08-31T04:19:53.236 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-31T04:19:53.234+0000 7f3ca0d4f640 1 -- 172.21.15.177:0/293345656 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f3c840b4bb0 msgr2=0x7f3c840b70c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:19:53.236 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-31T04:19:53.234+0000 7f3ca0d4f640 1 --2- 172.21.15.177:0/293345656 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f3c840b4bb0 0x7f3c840b70c0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f3c8c000c00 tx=0x7f3c8c031400 comp rx=0 tx=0).stop 2024-08-31T04:19:53.236 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-31T04:19:53.234+0000 7f3ca0d4f640 1 -- 172.21.15.177:0/293345656 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3c9c076e80 msgr2=0x7f3c9c19c670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:19:53.236 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-31T04:19:53.234+0000 7f3ca0d4f640 1 --2- 172.21.15.177:0/293345656 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3c9c076e80 0x7f3c9c19c670 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f3c9000b4a0 tx=0x7f3c9000b960 comp rx=0 tx=0).stop 2024-08-31T04:19:53.236 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-31T04:19:53.234+0000 7f3ca0d4f640 1 -- 172.21.15.177:0/293345656 shutdown_connections 2024-08-31T04:19:53.236 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-31T04:19:53.234+0000 7f3ca0d4f640 1 --2- 172.21.15.177:0/293345656 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f3c840b4bb0 0x7f3c840b70c0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:19:53.236 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-31T04:19:53.234+0000 7f3ca0d4f640 1 --2- 172.21.15.177:0/293345656 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3c9c076e80 0x7f3c9c19c670 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:19:53.237 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-31T04:19:53.234+0000 7f3ca0d4f640 1 --2- 172.21.15.177:0/293345656 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3c9c10b490 0x7f3c9c19d210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:19:53.237 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-31T04:19:53.234+0000 7f3ca0d4f640 1 --2- 172.21.15.177:0/293345656 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3c9c075a90 0x7f3c9c19c000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:19:53.237 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-31T04:19:53.234+0000 7f3ca0d4f640 1 -- 172.21.15.177:0/293345656 >> 172.21.15.177:0/293345656 conn(0x7f3c9c0fee60 msgr2=0x7f3c9c0ff340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:19:53.237 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-31T04:19:53.235+0000 7f3ca0d4f640 1 -- 172.21.15.177:0/293345656 shutdown_connections 2024-08-31T04:19:53.237 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-31T04:19:53.235+0000 7f3ca0d4f640 1 -- 172.21.15.177:0/293345656 wait complete. 2024-08-31T04:19:53.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:19:53 smithi177 ceph-mon[22025]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T04:19:53.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:19:53 smithi133 ceph-mon[22177]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T04:19:53.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:19:53 smithi050 ceph-mon[17259]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T04:19:53.882 DEBUG:teuthology.orchestra.run.smithi050:mds.a> sudo journalctl -f -n 0 -u ceph-058d9fc6-674f-11ef-bcd4-c7b262605968@mds.a.service 2024-08-31T04:19:53.887 DEBUG:teuthology.orchestra.run.smithi050:mds.d> sudo journalctl -f -n 0 -u ceph-058d9fc6-674f-11ef-bcd4-c7b262605968@mds.d.service 2024-08-31T04:19:53.932 DEBUG:teuthology.orchestra.run.smithi050:mds.g> sudo journalctl -f -n 0 -u ceph-058d9fc6-674f-11ef-bcd4-c7b262605968@mds.g.service 2024-08-31T04:19:53.976 DEBUG:teuthology.orchestra.run.smithi050:mds.j> sudo journalctl -f -n 0 -u ceph-058d9fc6-674f-11ef-bcd4-c7b262605968@mds.j.service 2024-08-31T04:19:54.022 DEBUG:teuthology.orchestra.run.smithi133:mds.b> sudo journalctl -f -n 0 -u ceph-058d9fc6-674f-11ef-bcd4-c7b262605968@mds.b.service 2024-08-31T04:19:54.024 DEBUG:teuthology.orchestra.run.smithi133:mds.e> sudo journalctl -f -n 0 -u ceph-058d9fc6-674f-11ef-bcd4-c7b262605968@mds.e.service 2024-08-31T04:19:54.067 DEBUG:teuthology.orchestra.run.smithi133:mds.h> sudo journalctl -f -n 0 -u ceph-058d9fc6-674f-11ef-bcd4-c7b262605968@mds.h.service 2024-08-31T04:19:54.110 DEBUG:teuthology.orchestra.run.smithi133:mds.k> sudo journalctl -f -n 0 -u ceph-058d9fc6-674f-11ef-bcd4-c7b262605968@mds.k.service 2024-08-31T04:19:54.153 DEBUG:teuthology.orchestra.run.smithi177:mds.c> sudo journalctl -f -n 0 -u ceph-058d9fc6-674f-11ef-bcd4-c7b262605968@mds.c.service 2024-08-31T04:19:54.156 DEBUG:teuthology.orchestra.run.smithi177:mds.f> sudo journalctl -f -n 0 -u ceph-058d9fc6-674f-11ef-bcd4-c7b262605968@mds.f.service 2024-08-31T04:19:54.199 DEBUG:teuthology.orchestra.run.smithi177:mds.i> sudo journalctl -f -n 0 -u ceph-058d9fc6-674f-11ef-bcd4-c7b262605968@mds.i.service 2024-08-31T04:19:54.242 DEBUG:teuthology.orchestra.run.smithi177:mds.l> sudo journalctl -f -n 0 -u ceph-058d9fc6-674f-11ef-bcd4-c7b262605968@mds.l.service 2024-08-31T04:19:54.285 INFO:tasks.cephadm:Setting up CephFS filesystem(s)... 2024-08-31T04:19:54.286 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 058d9fc6-674f-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-31T04:19:54.455 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:19:54 smithi177 ceph-mon[22025]: from='client.24589 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi050=a;smithi050=d;smithi050=g;smithi050=j;smithi133=b;smithi133=e;smithi133=h;smithi133=k;smithi177=c;smithi177=f;smithi177=i;smithi177=l", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:19:54.455 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:19:54 smithi177 ceph-mon[22025]: Saving service mds.all spec with placement smithi050=a;smithi050=d;smithi050=g;smithi050=j;smithi133=b;smithi133=e;smithi133=h;smithi133=k;smithi177=c;smithi177=f;smithi177=i;smithi177=l;count:12 2024-08-31T04:19:54.455 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:19:54 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:19:54.456 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:19:54 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T04:19:54.456 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:19:54 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:19:54.456 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:19:54 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T04:19:54.456 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:19:54 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:19:54.456 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:19:54 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-31T04:19:54.456 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:19:54 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-31T04:19:54.456 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:19:54 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:19:54.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:19:54 smithi133 ceph-mon[22177]: from='client.24589 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi050=a;smithi050=d;smithi050=g;smithi050=j;smithi133=b;smithi133=e;smithi133=h;smithi133=k;smithi177=c;smithi177=f;smithi177=i;smithi177=l", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:19:54.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:19:54 smithi133 ceph-mon[22177]: Saving service mds.all spec with placement smithi050=a;smithi050=d;smithi050=g;smithi050=j;smithi133=b;smithi133=e;smithi133=h;smithi133=k;smithi177=c;smithi177=f;smithi177=i;smithi177=l;count:12 2024-08-31T04:19:54.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:19:54 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:19:54.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:19:54 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T04:19:54.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:19:54 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:19:54.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:19:54 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T04:19:54.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:19:54 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:19:54.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:19:54 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-31T04:19:54.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:19:54 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-31T04:19:54.544 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:19:54 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:19:54.659 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:19:54.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:19:54 smithi050 ceph-mon[17259]: from='client.24589 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi050=a;smithi050=d;smithi050=g;smithi050=j;smithi133=b;smithi133=e;smithi133=h;smithi133=k;smithi177=c;smithi177=f;smithi177=i;smithi177=l", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:19:54.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:19:54 smithi050 ceph-mon[17259]: Saving service mds.all spec with placement smithi050=a;smithi050=d;smithi050=g;smithi050=j;smithi133=b;smithi133=e;smithi133=h;smithi133=k;smithi177=c;smithi177=f;smithi177=i;smithi177=l;count:12 2024-08-31T04:19:54.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:19:54 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:19:54.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:19:54 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T04:19:54.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:19:54 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:19:54.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:19:54 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T04:19:54.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:19:54 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:19:54.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:19:54 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-31T04:19:54.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:19:54 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-31T04:19:54.701 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:19:54 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:19:55.262 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:55.260+0000 7f30c6200640 1 -- 172.21.15.50:0/1308830105 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f30c0109090 msgr2=0x7f30c01094a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:19:55.262 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:55.260+0000 7f30c6200640 1 --2- 172.21.15.50:0/1308830105 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f30c0109090 0x7f30c01094a0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f30ac009900 tx=0x7f30ac02a3f0 comp rx=0 tx=0).stop 2024-08-31T04:19:55.263 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:55.260+0000 7f30c6200640 1 -- 172.21.15.50:0/1308830105 shutdown_connections 2024-08-31T04:19:55.263 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:55.260+0000 7f30c6200640 1 --2- 172.21.15.50:0/1308830105 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f30c01099e0 0x7f30c0110210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:19:55.263 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:55.260+0000 7f30c6200640 1 --2- 172.21.15.50:0/1308830105 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f30c0109090 0x7f30c01094a0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:19:55.263 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:55.260+0000 7f30c6200640 1 --2- 172.21.15.50:0/1308830105 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f30c0103750 0x7f30c0103b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:19:55.263 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:55.260+0000 7f30c6200640 1 -- 172.21.15.50:0/1308830105 >> 172.21.15.50:0/1308830105 conn(0x7f30c00ff1a0 msgr2=0x7f30c01015f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:19:55.263 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:55.260+0000 7f30c6200640 1 -- 172.21.15.50:0/1308830105 shutdown_connections 2024-08-31T04:19:55.263 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:55.260+0000 7f30c6200640 1 -- 172.21.15.50:0/1308830105 wait complete. 2024-08-31T04:19:55.265 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:55.261+0000 7f30c6200640 1 Processor -- start 2024-08-31T04:19:55.265 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:55.261+0000 7f30c6200640 1 -- start start 2024-08-31T04:19:55.266 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:55.261+0000 7f30c6200640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f30c0103750 0x7f30c019c290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:19:55.266 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:55.261+0000 7f30c6200640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f30c0109090 0x7f30c019c830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:19:55.266 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:55.261+0000 7f30c6200640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f30c01099e0 0x7f30c01a1ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:19:55.266 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:55.261+0000 7f30c6200640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f30c01136a0 con 0x7f30c0103750 2024-08-31T04:19:55.266 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:55.262+0000 7f30c6200640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f30c0113520 con 0x7f30c0109090 2024-08-31T04:19:55.266 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:55.262+0000 7f30c6200640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f30c0113820 con 0x7f30c01099e0 2024-08-31T04:19:55.266 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:55.262+0000 7f30c4e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f30c0103750 0x7f30c019c290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:19:55.266 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:55.262+0000 7f30bfe00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f30c0109090 0x7f30c019c830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:19:55.266 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:55.262+0000 7f30c5800640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f30c01099e0 0x7f30c01a1ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:19:55.266 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:55.262+0000 7f30c5800640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f30c01099e0 0x7f30c01a1ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.50:42200/0 (socket says 172.21.15.50:42200) 2024-08-31T04:19:55.266 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:55.262+0000 7f30bfe00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f30c0109090 0x7f30c019c830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.50:38554/0 (socket says 172.21.15.50:38554) 2024-08-31T04:19:55.266 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:55.262+0000 7f30c5800640 1 -- 172.21.15.50:0/2613906134 learned_addr learned my addr 172.21.15.50:0/2613906134 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:19:55.266 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:55.262+0000 7f30c4e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f30c0103750 0x7f30c019c290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:59558/0 (socket says 172.21.15.50:59558) 2024-08-31T04:19:55.267 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:55.262+0000 7f30c5800640 1 -- 172.21.15.50:0/2613906134 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f30c0109090 msgr2=0x7f30c019c830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:19:55.267 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:55.262+0000 7f30c5800640 1 --2- 172.21.15.50:0/2613906134 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f30c0109090 0x7f30c019c830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:19:55.267 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:55.262+0000 7f30c5800640 1 -- 172.21.15.50:0/2613906134 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f30c0103750 msgr2=0x7f30c019c290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:19:55.267 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:55.262+0000 7f30c5800640 1 --2- 172.21.15.50:0/2613906134 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f30c0103750 0x7f30c019c290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:19:55.267 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:55.262+0000 7f30c5800640 1 -- 172.21.15.50:0/2613906134 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30c01a2200 con 0x7f30c01099e0 2024-08-31T04:19:55.267 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:55.262+0000 7f30c4e00640 1 --2- 172.21.15.50:0/2613906134 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f30c0103750 0x7f30c019c290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:19:55.267 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:55.263+0000 7f30c5800640 1 --2- 172.21.15.50:0/2613906134 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f30c01099e0 0x7f30c01a1ad0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f30b800eb10 tx=0x7f30b800c2d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:19:55.267 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:55.263+0000 7f30bd600640 1 -- 172.21.15.50:0/2613906134 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30b8004b20 con 0x7f30c01099e0 2024-08-31T04:19:55.267 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:55.263+0000 7f30c6200640 1 -- 172.21.15.50:0/2613906134 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f30c01a24f0 con 0x7f30c01099e0 2024-08-31T04:19:55.267 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:55.263+0000 7f30bd600640 1 -- 172.21.15.50:0/2613906134 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f30b8004cc0 con 0x7f30c01099e0 2024-08-31T04:19:55.267 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:55.263+0000 7f30bd600640 1 -- 172.21.15.50:0/2613906134 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30b8010670 con 0x7f30c01099e0 2024-08-31T04:19:55.267 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:55.263+0000 7f30c6200640 1 -- 172.21.15.50:0/2613906134 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f30c01a8c50 con 0x7f30c01099e0 2024-08-31T04:19:55.268 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:55.264+0000 7f30c6200640 1 -- 172.21.15.50:0/2613906134 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f30c0103b60 con 0x7f30c01099e0 2024-08-31T04:19:55.268 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:55.266+0000 7f30bd600640 1 -- 172.21.15.50:0/2613906134 <== mon.1 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 16) ==== 152577+0+0 (secure 0 0 0) 0x7f30b8005020 con 0x7f30c01099e0 2024-08-31T04:19:55.269 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:55.267+0000 7f30bd600640 1 --2- 172.21.15.50:0/2613906134 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f30a80b4b30 0x7f30a80b7040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:19:55.270 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:55.268+0000 7f30bd600640 1 -- 172.21.15.50:0/2613906134 <== mon.1 v2:172.21.15.177:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 7127+0+0 (secure 0 0 0) 0x7f30b80e5300 con 0x7f30c01099e0 2024-08-31T04:19:55.270 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:55.268+0000 7f30c4e00640 1 --2- 172.21.15.50:0/2613906134 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f30a80b4b30 0x7f30a80b7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:19:55.270 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:55.268+0000 7f30c4e00640 1 --2- 172.21.15.50:0/2613906134 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f30a80b4b30 0x7f30a80b7040 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f30b4009fc0 tx=0x7f30b4005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:19:55.273 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:55.271+0000 7f30bd600640 1 -- 172.21.15.50:0/2613906134 <== mon.1 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f30b80ac830 con 0x7f30c01099e0 2024-08-31T04:19:55.450 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:19:55 smithi050 ceph-mon[17259]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T04:19:55.450 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:19:55 smithi050 ceph-mon[17259]: Deploying daemon mds.l on smithi177 2024-08-31T04:19:55.471 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:19:55 smithi177 ceph-mon[22025]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T04:19:55.471 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:19:55 smithi177 ceph-mon[22025]: Deploying daemon mds.l on smithi177 2024-08-31T04:19:55.504 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:55.502+0000 7f30c6200640 1 -- 172.21.15.50:0/2613906134 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f30c01a8e20 con 0x7f30c01099e0 2024-08-31T04:19:55.505 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:55.503+0000 7f30bd600640 1 -- 172.21.15.50:0/2613906134 <== mon.1 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 1 v1) ==== 93+0+611 (secure 0 0 0) 0x7f30b80ac130 con 0x7f30c01099e0 2024-08-31T04:19:55.505 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-08-31T04:19:55.505 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":1,"btime":"2024-08-31T04:11:59:575880+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[]} 2024-08-31T04:19:55.506 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 1 2024-08-31T04:19:55.508 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:55.505+0000 7f30c6200640 1 -- 172.21.15.50:0/2613906134 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f30a80b4b30 msgr2=0x7f30a80b7040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:19:55.508 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:55.505+0000 7f30c6200640 1 --2- 172.21.15.50:0/2613906134 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f30a80b4b30 0x7f30a80b7040 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f30b4009fc0 tx=0x7f30b4005f90 comp rx=0 tx=0).stop 2024-08-31T04:19:55.508 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:55.505+0000 7f30c6200640 1 -- 172.21.15.50:0/2613906134 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f30c01099e0 msgr2=0x7f30c01a1ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:19:55.508 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:55.505+0000 7f30c6200640 1 --2- 172.21.15.50:0/2613906134 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f30c01099e0 0x7f30c01a1ad0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f30b800eb10 tx=0x7f30b800c2d0 comp rx=0 tx=0).stop 2024-08-31T04:19:55.508 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:55.506+0000 7f30c6200640 1 -- 172.21.15.50:0/2613906134 shutdown_connections 2024-08-31T04:19:55.508 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:55.506+0000 7f30c6200640 1 --2- 172.21.15.50:0/2613906134 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f30a80b4b30 0x7f30a80b7040 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:19:55.508 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:55.506+0000 7f30c6200640 1 --2- 172.21.15.50:0/2613906134 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f30c01099e0 0x7f30c01a1ad0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:19:55.508 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:55.506+0000 7f30c6200640 1 --2- 172.21.15.50:0/2613906134 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f30c0109090 0x7f30c019c830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:19:55.509 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:55.506+0000 7f30c6200640 1 --2- 172.21.15.50:0/2613906134 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f30c0103750 0x7f30c019c290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:19:55.509 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:55.506+0000 7f30c6200640 1 -- 172.21.15.50:0/2613906134 >> 172.21.15.50:0/2613906134 conn(0x7f30c00ff1a0 msgr2=0x7f30c0108740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:19:55.509 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:55.506+0000 7f30c6200640 1 -- 172.21.15.50:0/2613906134 shutdown_connections 2024-08-31T04:19:55.509 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:55.506+0000 7f30c6200640 1 -- 172.21.15.50:0/2613906134 wait complete. 2024-08-31T04:19:55.542 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:19:55 smithi133 ceph-mon[22177]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T04:19:55.542 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:19:55 smithi133 ceph-mon[22177]: Deploying daemon mds.l on smithi177 2024-08-31T04:19:56.164 INFO:journalctl@ceph.mds.l.smithi177.stdout:Aug 31 04:19:55 smithi177 systemd[1]: Starting Ceph mds.l for 058d9fc6-674f-11ef-bcd4-c7b262605968... 2024-08-31T04:19:56.438 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:19:56 smithi177 ceph-mon[22025]: from='client.? 172.21.15.50:0/2613906134' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T04:19:56.439 INFO:journalctl@ceph.mds.l.smithi177.stdout:Aug 31 04:19:56 smithi177 podman[51593]: 2024-08-31 04:19:56.066881471 +0000 UTC m=+0.016181583 image pull 79f4cde5e36911a5dca995eeb98098c2c8aae81dd52a088ef2c867bc3363bad0 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61 2024-08-31T04:19:56.439 INFO:journalctl@ceph.mds.l.smithi177.stdout:Aug 31 04:19:56 smithi177 podman[51593]: 2024-08-31 04:19:56.173788052 +0000 UTC m=+0.123088151 container create ac04c1d014388a3bf1bc06da017735a8540c6169474aa059b3eea8de829d714a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-mds-l, io.buildah.version=1.37.1, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux ) 2024-08-31T04:19:56.439 INFO:journalctl@ceph.mds.l.smithi177.stdout:Aug 31 04:19:56 smithi177 podman[51593]: 2024-08-31 04:19:56.401644897 +0000 UTC m=+0.350945002 container init ac04c1d014388a3bf1bc06da017735a8540c6169474aa059b3eea8de829d714a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-mds-l, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, io.buildah.version=1.37.1, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-08-31T04:19:56.439 INFO:journalctl@ceph.mds.l.smithi177.stdout:Aug 31 04:19:56 smithi177 podman[51593]: 2024-08-31 04:19:56.405066562 +0000 UTC m=+0.354366678 container start ac04c1d014388a3bf1bc06da017735a8540c6169474aa059b3eea8de829d714a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-mds-l, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, io.buildah.version=1.37.1, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240731) 2024-08-31T04:19:56.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:19:56 smithi133 ceph-mon[22177]: from='client.? 172.21.15.50:0/2613906134' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T04:19:56.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:19:56 smithi050 ceph-mon[17259]: from='client.? 172.21.15.50:0/2613906134' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T04:19:56.746 INFO:journalctl@ceph.mds.l.smithi177.stdout:Aug 31 04:19:56 smithi177 ceph-mds[51612]: -- 172.21.15.177:0/2183074169 <== mon.1 v2:172.21.15.177:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x562d4086d860 con 0x562d44a13a80 2024-08-31T04:19:56.746 INFO:journalctl@ceph.mds.l.smithi177.stdout:Aug 31 04:19:56 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-mds-l[51608]: starting mds.l at 2024-08-31T04:19:56.746 INFO:journalctl@ceph.mds.l.smithi177.stdout:Aug 31 04:19:56 smithi177 bash[51593]: ac04c1d014388a3bf1bc06da017735a8540c6169474aa059b3eea8de829d714a 2024-08-31T04:19:56.746 INFO:journalctl@ceph.mds.l.smithi177.stdout:Aug 31 04:19:56 smithi177 systemd[1]: Started Ceph mds.l for 058d9fc6-674f-11ef-bcd4-c7b262605968. 2024-08-31T04:19:57.662 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:19:57 smithi133 ceph-mon[22177]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T04:19:57.662 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:19:57 smithi133 ceph-mon[22177]: mds.? [v2:172.21.15.177:6832/1237129793,v1:172.21.15.177:6833/1237129793] up:boot 2024-08-31T04:19:57.663 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:19:57 smithi133 ceph-mon[22177]: fsmap 1 up:standby 2024-08-31T04:19:57.663 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:19:57 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "l"} : dispatch 2024-08-31T04:19:57.663 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:19:57 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:19:57.663 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:19:57 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:19:57.663 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:19:57 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:19:57.663 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:19:57 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-31T04:19:57.663 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:19:57 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-31T04:19:57.663 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:19:57 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:19:57.663 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:19:57 smithi133 ceph-mon[22177]: Deploying daemon mds.k on smithi133 2024-08-31T04:19:57.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:19:57 smithi050 ceph-mon[17259]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T04:19:57.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:19:57 smithi050 ceph-mon[17259]: mds.? [v2:172.21.15.177:6832/1237129793,v1:172.21.15.177:6833/1237129793] up:boot 2024-08-31T04:19:57.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:19:57 smithi050 ceph-mon[17259]: fsmap 1 up:standby 2024-08-31T04:19:57.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:19:57 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "l"} : dispatch 2024-08-31T04:19:57.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:19:57 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:19:57.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:19:57 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:19:57.701 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:19:57 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:19:57.701 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:19:57 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-31T04:19:57.701 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:19:57 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-31T04:19:57.701 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:19:57 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:19:57.701 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:19:57 smithi050 ceph-mon[17259]: Deploying daemon mds.k on smithi133 2024-08-31T04:19:57.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:19:57 smithi177 ceph-mon[22025]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T04:19:57.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:19:57 smithi177 ceph-mon[22025]: mds.? [v2:172.21.15.177:6832/1237129793,v1:172.21.15.177:6833/1237129793] up:boot 2024-08-31T04:19:57.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:19:57 smithi177 ceph-mon[22025]: fsmap 1 up:standby 2024-08-31T04:19:57.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:19:57 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "l"} : dispatch 2024-08-31T04:19:57.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:19:57 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:19:57.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:19:57 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:19:57.747 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:19:57 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:19:57.747 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:19:57 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-31T04:19:57.747 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:19:57 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-31T04:19:57.747 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:19:57 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:19:57.747 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:19:57 smithi177 ceph-mon[22025]: Deploying daemon mds.k on smithi133 2024-08-31T04:19:58.390 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 058d9fc6-674f-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-31T04:19:58.725 INFO:journalctl@ceph.mds.k.smithi133.stdout:Aug 31 04:19:58 smithi133 systemd[1]: Starting Ceph mds.k for 058d9fc6-674f-11ef-bcd4-c7b262605968... 2024-08-31T04:19:58.774 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:19:58.997 INFO:journalctl@ceph.mds.k.smithi133.stdout:Aug 31 04:19:58 smithi133 podman[51166]: 2024-08-31 04:19:58.626269816 +0000 UTC m=+0.015933925 image pull 79f4cde5e36911a5dca995eeb98098c2c8aae81dd52a088ef2c867bc3363bad0 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61 2024-08-31T04:19:58.997 INFO:journalctl@ceph.mds.k.smithi133.stdout:Aug 31 04:19:58 smithi133 podman[51166]: 2024-08-31 04:19:58.749139049 +0000 UTC m=+0.138803204 container create e1b76e7537b40e6cb00fa9ae2c5bce4bdb01ed08ba15254eccc0a2600e11b1d3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-mds-k, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , io.buildah.version=1.37.1, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, ceph=True) 2024-08-31T04:19:58.997 INFO:journalctl@ceph.mds.k.smithi133.stdout:Aug 31 04:19:58 smithi133 podman[51166]: 2024-08-31 04:19:58.960258396 +0000 UTC m=+0.349922505 container init e1b76e7537b40e6cb00fa9ae2c5bce4bdb01ed08ba15254eccc0a2600e11b1d3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-mds-k, ceph=True, io.buildah.version=1.37.1, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.schema-version=1.0, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux ) 2024-08-31T04:19:58.997 INFO:journalctl@ceph.mds.k.smithi133.stdout:Aug 31 04:19:58 smithi133 podman[51166]: 2024-08-31 04:19:58.963061111 +0000 UTC m=+0.352725221 container start e1b76e7537b40e6cb00fa9ae2c5bce4bdb01ed08ba15254eccc0a2600e11b1d3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-mds-k, CEPH_POINT_RELEASE=, io.buildah.version=1.37.1, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, GIT_BRANCH=HEAD) 2024-08-31T04:19:59.293 INFO:journalctl@ceph.mds.k.smithi133.stdout:Aug 31 04:19:58 smithi133 ceph-mds[51185]: -- 172.21.15.133:0/2664587643 <== mon.2 v2:172.21.15.133:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5639a7423c20 con 0x5639ab5c9180 2024-08-31T04:19:59.293 INFO:journalctl@ceph.mds.k.smithi133.stdout:Aug 31 04:19:58 smithi133 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-mds-k[51181]: starting mds.k at 2024-08-31T04:19:59.293 INFO:journalctl@ceph.mds.k.smithi133.stdout:Aug 31 04:19:59 smithi133 bash[51166]: e1b76e7537b40e6cb00fa9ae2c5bce4bdb01ed08ba15254eccc0a2600e11b1d3 2024-08-31T04:19:59.293 INFO:journalctl@ceph.mds.k.smithi133.stdout:Aug 31 04:19:59 smithi133 systemd[1]: Started Ceph mds.k for 058d9fc6-674f-11ef-bcd4-c7b262605968. 2024-08-31T04:19:59.381 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:59.378+0000 7f7a96400640 1 -- 172.21.15.50:0/74194855 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7a9010fec0 msgr2=0x7f7a901122e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:19:59.381 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:59.378+0000 7f7a96400640 1 --2- 172.21.15.50:0/74194855 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7a9010fec0 0x7f7a901122e0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f7a88009be0 tx=0x7f7a8802a6c0 comp rx=0 tx=0).stop 2024-08-31T04:19:59.381 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:59.378+0000 7f7a96400640 1 -- 172.21.15.50:0/74194855 shutdown_connections 2024-08-31T04:19:59.381 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:59.378+0000 7f7a96400640 1 --2- 172.21.15.50:0/74194855 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7a90075e40 0x7f7a9010f980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:19:59.382 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:59.378+0000 7f7a96400640 1 --2- 172.21.15.50:0/74194855 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7a9010fec0 0x7f7a901122e0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:19:59.382 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:59.378+0000 7f7a96400640 1 --2- 172.21.15.50:0/74194855 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7a900754f0 0x7f7a90075900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:19:59.382 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:59.378+0000 7f7a96400640 1 -- 172.21.15.50:0/74194855 >> 172.21.15.50:0/74194855 conn(0x7f7a9007b5f0 msgr2=0x7f7a9007ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:19:59.382 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:59.378+0000 7f7a96400640 1 -- 172.21.15.50:0/74194855 shutdown_connections 2024-08-31T04:19:59.382 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:59.378+0000 7f7a96400640 1 -- 172.21.15.50:0/74194855 wait complete. 2024-08-31T04:19:59.383 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:59.379+0000 7f7a96400640 1 Processor -- start 2024-08-31T04:19:59.383 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:59.380+0000 7f7a96400640 1 -- start start 2024-08-31T04:19:59.383 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:59.380+0000 7f7a96400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7a900754f0 0x7f7a9019c3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:19:59.383 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:59.380+0000 7f7a96400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7a90075e40 0x7f7a9019c960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:19:59.383 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:59.380+0000 7f7a96400640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7a9010fec0 0x7f7a901a1c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:19:59.383 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:59.380+0000 7f7a96400640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f7a90115a30 con 0x7f7a90075e40 2024-08-31T04:19:59.383 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:59.380+0000 7f7a96400640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f7a901158b0 con 0x7f7a900754f0 2024-08-31T04:19:59.383 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:59.380+0000 7f7a96400640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f7a90115bb0 con 0x7f7a9010fec0 2024-08-31T04:19:59.383 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:59.380+0000 7f7a8f400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7a900754f0 0x7f7a9019c3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:19:59.383 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:59.380+0000 7f7a86a00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7a90075e40 0x7f7a9019c960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:19:59.384 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:59.380+0000 7f7a8f400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7a900754f0 0x7f7a9019c3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.50:38566/0 (socket says 172.21.15.50:38566) 2024-08-31T04:19:59.384 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:59.380+0000 7f7a8f400640 1 -- 172.21.15.50:0/3209671130 learned_addr learned my addr 172.21.15.50:0/3209671130 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:19:59.384 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:59.380+0000 7f7a8fe00640 1 --2- 172.21.15.50:0/3209671130 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7a9010fec0 0x7f7a901a1c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:19:59.384 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:59.381+0000 7f7a8f400640 1 -- 172.21.15.50:0/3209671130 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7a9010fec0 msgr2=0x7f7a901a1c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:19:59.385 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:59.381+0000 7f7a8f400640 1 --2- 172.21.15.50:0/3209671130 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7a9010fec0 0x7f7a901a1c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:19:59.385 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:59.381+0000 7f7a8f400640 1 -- 172.21.15.50:0/3209671130 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7a90075e40 msgr2=0x7f7a9019c960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:19:59.385 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:59.381+0000 7f7a8f400640 1 --2- 172.21.15.50:0/3209671130 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7a90075e40 0x7f7a9019c960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:19:59.385 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:59.381+0000 7f7a8f400640 1 -- 172.21.15.50:0/3209671130 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a901a2330 con 0x7f7a900754f0 2024-08-31T04:19:59.385 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:59.381+0000 7f7a8f400640 1 --2- 172.21.15.50:0/3209671130 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7a900754f0 0x7f7a9019c3c0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f7a8000e9c0 tx=0x7f7a8000ee80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:19:59.385 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:59.381+0000 7f7a8cc00640 1 -- 172.21.15.50:0/3209671130 <== mon.2 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a8000cde0 con 0x7f7a900754f0 2024-08-31T04:19:59.385 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:59.381+0000 7f7a8cc00640 1 -- 172.21.15.50:0/3209671130 <== mon.2 v2:172.21.15.133:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7a800035f0 con 0x7f7a900754f0 2024-08-31T04:19:59.385 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:59.381+0000 7f7a96400640 1 -- 172.21.15.50:0/3209671130 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7a901a2620 con 0x7f7a900754f0 2024-08-31T04:19:59.385 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:59.382+0000 7f7a8cc00640 1 -- 172.21.15.50:0/3209671130 <== mon.2 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a80010690 con 0x7f7a900754f0 2024-08-31T04:19:59.385 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:59.382+0000 7f7a96400640 1 -- 172.21.15.50:0/3209671130 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7a901a8d80 con 0x7f7a900754f0 2024-08-31T04:19:59.386 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:59.383+0000 7f7a96400640 1 -- 172.21.15.50:0/3209671130 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7a90075900 con 0x7f7a900754f0 2024-08-31T04:19:59.387 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:59.385+0000 7f7a8cc00640 1 -- 172.21.15.50:0/3209671130 <== mon.2 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 16) ==== 152577+0+0 (secure 0 0 0) 0x7f7a80004000 con 0x7f7a900754f0 2024-08-31T04:19:59.388 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:59.386+0000 7f7a8cc00640 1 --2- 172.21.15.50:0/3209671130 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f7a740b4bb0 0x7f7a740b70c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:19:59.389 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:59.387+0000 7f7a8cc00640 1 -- 172.21.15.50:0/3209671130 <== mon.2 v2:172.21.15.133:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 7127+0+0 (secure 0 0 0) 0x7f7a800e4fb0 con 0x7f7a900754f0 2024-08-31T04:19:59.389 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:59.387+0000 7f7a86a00640 1 --2- 172.21.15.50:0/3209671130 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f7a740b4bb0 0x7f7a740b70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:19:59.389 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:59.387+0000 7f7a86a00640 1 --2- 172.21.15.50:0/3209671130 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f7a740b4bb0 0x7f7a740b70c0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f7a901119a0 tx=0x7f7a78005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:19:59.392 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:59.390+0000 7f7a8cc00640 1 -- 172.21.15.50:0/3209671130 <== mon.2 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f7a80009510 con 0x7f7a900754f0 2024-08-31T04:19:59.650 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:59.647+0000 7f7a96400640 1 -- 172.21.15.50:0/3209671130 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7a901a9080 con 0x7f7a900754f0 2024-08-31T04:19:59.650 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:59.648+0000 7f7a8cc00640 1 -- 172.21.15.50:0/3209671130 <== mon.2 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) ==== 93+0+2266 (secure 0 0 0) 0x7f7a800ac4e0 con 0x7f7a900754f0 2024-08-31T04:19:59.650 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-08-31T04:19:59.651 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":3,"btime":"2024-08-31T04:19:59:449556+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24590,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6833/4283603962","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6832","nonce":4283603962},{"type":"v1","addr":"172.21.15.133:6833","nonce":4283603962}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24601,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6833/1237129793","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":1237129793},{"type":"v1","addr":"172.21.15.177:6833","nonce":1237129793}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-08-31T04:19:59.651 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 3 2024-08-31T04:19:59.653 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:59.651+0000 7f7a96400640 1 -- 172.21.15.50:0/3209671130 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f7a740b4bb0 msgr2=0x7f7a740b70c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:19:59.653 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:59.651+0000 7f7a96400640 1 --2- 172.21.15.50:0/3209671130 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f7a740b4bb0 0x7f7a740b70c0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f7a901119a0 tx=0x7f7a78005f90 comp rx=0 tx=0).stop 2024-08-31T04:19:59.653 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:59.651+0000 7f7a96400640 1 -- 172.21.15.50:0/3209671130 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7a900754f0 msgr2=0x7f7a9019c3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:19:59.653 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:59.651+0000 7f7a96400640 1 --2- 172.21.15.50:0/3209671130 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7a900754f0 0x7f7a9019c3c0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f7a8000e9c0 tx=0x7f7a8000ee80 comp rx=0 tx=0).stop 2024-08-31T04:19:59.654 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:59.651+0000 7f7a96400640 1 -- 172.21.15.50:0/3209671130 shutdown_connections 2024-08-31T04:19:59.654 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:59.651+0000 7f7a96400640 1 --2- 172.21.15.50:0/3209671130 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f7a740b4bb0 0x7f7a740b70c0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:19:59.654 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:59.651+0000 7f7a96400640 1 --2- 172.21.15.50:0/3209671130 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7a9010fec0 0x7f7a901a1c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:19:59.654 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:59.651+0000 7f7a96400640 1 --2- 172.21.15.50:0/3209671130 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7a90075e40 0x7f7a9019c960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:19:59.654 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:59.651+0000 7f7a96400640 1 --2- 172.21.15.50:0/3209671130 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7a900754f0 0x7f7a9019c3c0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:19:59.654 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:59.651+0000 7f7a96400640 1 -- 172.21.15.50:0/3209671130 >> 172.21.15.50:0/3209671130 conn(0x7f7a9007b5f0 msgr2=0x7f7a901099d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:19:59.654 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:59.651+0000 7f7a96400640 1 -- 172.21.15.50:0/3209671130 shutdown_connections 2024-08-31T04:19:59.654 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:19:59.651+0000 7f7a96400640 1 -- 172.21.15.50:0/3209671130 wait complete. 2024-08-31T04:19:59.727 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:19:59 smithi050 ceph-mon[17259]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T04:19:59.728 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:19:59 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:19:59.728 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:19:59 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:19:59.728 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:19:59 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:19:59.728 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:19:59 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-31T04:19:59.728 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:19:59 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-31T04:19:59.728 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:19:59 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:19:59.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:19:59 smithi177 ceph-mon[22025]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T04:19:59.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:19:59 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:19:59.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:19:59 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:19:59.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:19:59 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:19:59.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:19:59 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-31T04:19:59.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:19:59 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-31T04:19:59.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:19:59 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:19:59.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:19:59 smithi133 ceph-mon[22177]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T04:19:59.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:19:59 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:19:59.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:19:59 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:19:59.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:19:59 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:19:59.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:19:59 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-31T04:19:59.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:19:59 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-31T04:19:59.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:19:59 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:20:00.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:20:00 smithi050 ceph-mon[17259]: Deploying daemon mds.j on smithi050 2024-08-31T04:20:00.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:20:00 smithi050 ceph-mon[17259]: mds.? [v2:172.21.15.133:6832/4283603962,v1:172.21.15.133:6833/4283603962] up:boot 2024-08-31T04:20:00.701 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:20:00 smithi050 ceph-mon[17259]: fsmap 2 up:standby 2024-08-31T04:20:00.701 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:20:00 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "k"} : dispatch 2024-08-31T04:20:00.701 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:20:00 smithi050 ceph-mon[17259]: from='client.? 172.21.15.50:0/3209671130' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T04:20:00.701 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:20:00 smithi050 ceph-mon[17259]: overall HEALTH_OK 2024-08-31T04:20:00.748 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:20:00 smithi177 ceph-mon[22025]: Deploying daemon mds.j on smithi050 2024-08-31T04:20:00.749 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:20:00 smithi177 ceph-mon[22025]: mds.? [v2:172.21.15.133:6832/4283603962,v1:172.21.15.133:6833/4283603962] up:boot 2024-08-31T04:20:00.749 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:20:00 smithi177 ceph-mon[22025]: fsmap 2 up:standby 2024-08-31T04:20:00.749 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:20:00 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "k"} : dispatch 2024-08-31T04:20:00.749 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:20:00 smithi177 ceph-mon[22025]: from='client.? 172.21.15.50:0/3209671130' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T04:20:00.749 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:20:00 smithi177 ceph-mon[22025]: overall HEALTH_OK 2024-08-31T04:20:00.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:20:00 smithi133 ceph-mon[22177]: Deploying daemon mds.j on smithi050 2024-08-31T04:20:00.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:20:00 smithi133 ceph-mon[22177]: mds.? [v2:172.21.15.133:6832/4283603962,v1:172.21.15.133:6833/4283603962] up:boot 2024-08-31T04:20:00.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:20:00 smithi133 ceph-mon[22177]: fsmap 2 up:standby 2024-08-31T04:20:00.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:20:00 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "k"} : dispatch 2024-08-31T04:20:00.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:20:00 smithi133 ceph-mon[22177]: from='client.? 172.21.15.50:0/3209671130' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T04:20:00.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:20:00 smithi133 ceph-mon[22177]: overall HEALTH_OK 2024-08-31T04:20:01.740 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:20:01 smithi050 ceph-mon[17259]: pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T04:20:01.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:20:01 smithi177 ceph-mon[22025]: pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T04:20:01.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:20:01 smithi133 ceph-mon[22177]: pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T04:20:02.701 INFO:journalctl@ceph.mds.j.smithi050.stdout:Aug 31 04:20:02 smithi050 systemd[1]: Starting Ceph mds.j for 058d9fc6-674f-11ef-bcd4-c7b262605968... 2024-08-31T04:20:02.988 INFO:journalctl@ceph.mds.j.smithi050.stdout:Aug 31 04:20:02 smithi050 podman[57919]: 2024-08-31 04:20:02.63236245 +0000 UTC m=+0.027467342 image pull 79f4cde5e36911a5dca995eeb98098c2c8aae81dd52a088ef2c867bc3363bad0 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61 2024-08-31T04:20:02.988 INFO:journalctl@ceph.mds.j.smithi050.stdout:Aug 31 04:20:02 smithi050 podman[57919]: 2024-08-31 04:20:02.759077948 +0000 UTC m=+0.154182847 container create 6b2360acad407f80e1bd405860db45f926a30f3c744c36517e310c790d4aac89 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-mds-j, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, io.buildah.version=1.37.1, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, ceph=True) 2024-08-31T04:20:02.988 INFO:journalctl@ceph.mds.j.smithi050.stdout:Aug 31 04:20:02 smithi050 podman[57919]: 2024-08-31 04:20:02.987168037 +0000 UTC m=+0.382272929 container init 6b2360acad407f80e1bd405860db45f926a30f3c744c36517e310c790d4aac89 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-mds-j, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_CLEAN=True, io.buildah.version=1.37.1, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD) 2024-08-31T04:20:03.220 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 058d9fc6-674f-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-31T04:20:03.271 INFO:journalctl@ceph.mds.j.smithi050.stdout:Aug 31 04:20:02 smithi050 podman[57919]: 2024-08-31 04:20:02.993375635 +0000 UTC m=+0.388480526 container start 6b2360acad407f80e1bd405860db45f926a30f3c744c36517e310c790d4aac89 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-mds-j, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.1) 2024-08-31T04:20:03.271 INFO:journalctl@ceph.mds.j.smithi050.stdout:Aug 31 04:20:03 smithi050 ceph-mds[57938]: -- 172.21.15.50:0/3916986730 <== mon.2 v2:172.21.15.133:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5640387ef860 con 0x56403c995600 2024-08-31T04:20:03.271 INFO:journalctl@ceph.mds.j.smithi050.stdout:Aug 31 04:20:03 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-mds-j[57934]: starting mds.j at 2024-08-31T04:20:03.271 INFO:journalctl@ceph.mds.j.smithi050.stdout:Aug 31 04:20:03 smithi050 bash[57919]: 6b2360acad407f80e1bd405860db45f926a30f3c744c36517e310c790d4aac89 2024-08-31T04:20:03.271 INFO:journalctl@ceph.mds.j.smithi050.stdout:Aug 31 04:20:03 smithi050 systemd[1]: Started Ceph mds.j for 058d9fc6-674f-11ef-bcd4-c7b262605968. 2024-08-31T04:20:03.627 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:20:03.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:20:03 smithi050 ceph-mon[17259]: pgmap v272: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T04:20:03.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:20:03 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:20:03.701 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:20:03 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:20:03.701 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:20:03 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:20:03.701 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:20:03 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-31T04:20:03.701 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:20:03 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-31T04:20:03.701 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:20:03 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:20:03.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:20:03 smithi177 ceph-mon[22025]: pgmap v272: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T04:20:03.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:20:03 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:20:03.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:20:03 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:20:03.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:20:03 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:20:03.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:20:03 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-31T04:20:03.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:20:03 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-31T04:20:03.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:20:03 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:20:03.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:20:03 smithi133 ceph-mon[22177]: pgmap v272: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T04:20:03.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:20:03 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:20:03.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:20:03 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:20:03.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:20:03 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:20:03.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:20:03 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-31T04:20:03.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:20:03 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-31T04:20:03.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:20:03 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:20:04.230 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:04.228+0000 7fd0e9e00640 1 -- 172.21.15.50:0/3327770365 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd0e4109240 msgr2=0x7fd0e4109650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:20:04.230 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:04.228+0000 7fd0e9e00640 1 --2- 172.21.15.50:0/3327770365 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd0e4109240 0x7fd0e4109650 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fd0cc009900 tx=0x7fd0cc02a3f0 comp rx=0 tx=0).stop 2024-08-31T04:20:04.230 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:04.228+0000 7fd0e9e00640 1 -- 172.21.15.50:0/3327770365 shutdown_connections 2024-08-31T04:20:04.230 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:04.228+0000 7fd0e9e00640 1 --2- 172.21.15.50:0/3327770365 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd0e4109b90 0x7fd0e41103c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:20:04.230 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:04.228+0000 7fd0e9e00640 1 --2- 172.21.15.50:0/3327770365 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd0e4109240 0x7fd0e4109650 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:20:04.230 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:04.228+0000 7fd0e9e00640 1 --2- 172.21.15.50:0/3327770365 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd0e4103900 0x7fd0e4103d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:20:04.231 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:04.228+0000 7fd0e9e00640 1 -- 172.21.15.50:0/3327770365 >> 172.21.15.50:0/3327770365 conn(0x7fd0e407b5f0 msgr2=0x7fd0e407ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:20:04.231 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:04.228+0000 7fd0e9e00640 1 -- 172.21.15.50:0/3327770365 shutdown_connections 2024-08-31T04:20:04.231 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:04.228+0000 7fd0e9e00640 1 -- 172.21.15.50:0/3327770365 wait complete. 2024-08-31T04:20:04.232 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:04.229+0000 7fd0e9e00640 1 Processor -- start 2024-08-31T04:20:04.232 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:04.229+0000 7fd0e9e00640 1 -- start start 2024-08-31T04:20:04.232 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:04.230+0000 7fd0e9e00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd0e4103900 0x7fd0e419c450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:20:04.232 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:04.230+0000 7fd0e9e00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd0e4109240 0x7fd0e419c9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:20:04.233 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:04.230+0000 7fd0e9e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd0e4109b90 0x7fd0e41a1c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:20:04.233 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:04.230+0000 7fd0e9e00640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fd0e41138a0 con 0x7fd0e4109b90 2024-08-31T04:20:04.233 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:04.230+0000 7fd0e9e00640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7fd0e4113720 con 0x7fd0e4109240 2024-08-31T04:20:04.233 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:04.230+0000 7fd0e9e00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fd0e4113a20 con 0x7fd0e4103900 2024-08-31T04:20:04.233 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:04.230+0000 7fd0e3400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd0e4109b90 0x7fd0e41a1c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:20:04.233 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:04.230+0000 7fd0e2a00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd0e4103900 0x7fd0e419c450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:20:04.233 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:04.230+0000 7fd0e2a00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd0e4103900 0x7fd0e419c450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.50:42410/0 (socket says 172.21.15.50:42410) 2024-08-31T04:20:04.233 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:04.230+0000 7fd0e3400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd0e4109b90 0x7fd0e41a1c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49336/0 (socket says 172.21.15.50:49336) 2024-08-31T04:20:04.233 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:04.230+0000 7fd0e2a00640 1 -- 172.21.15.50:0/3371747665 learned_addr learned my addr 172.21.15.50:0/3371747665 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:20:04.233 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:04.230+0000 7fd0dbe00640 1 --2- 172.21.15.50:0/3371747665 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd0e4109240 0x7fd0e419c9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:20:04.233 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:04.231+0000 7fd0e2a00640 1 -- 172.21.15.50:0/3371747665 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd0e4109240 msgr2=0x7fd0e419c9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:20:04.233 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:04.231+0000 7fd0e2a00640 1 --2- 172.21.15.50:0/3371747665 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd0e4109240 0x7fd0e419c9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:20:04.234 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:04.231+0000 7fd0e2a00640 1 -- 172.21.15.50:0/3371747665 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd0e4109b90 msgr2=0x7fd0e41a1c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:20:04.234 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:04.231+0000 7fd0e2a00640 1 --2- 172.21.15.50:0/3371747665 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd0e4109b90 0x7fd0e41a1c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:20:04.234 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:04.231+0000 7fd0e2a00640 1 -- 172.21.15.50:0/3371747665 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0e41a23c0 con 0x7fd0e4103900 2024-08-31T04:20:04.234 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:04.231+0000 7fd0e3400640 1 --2- 172.21.15.50:0/3371747665 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd0e4109b90 0x7fd0e41a1c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:20:04.234 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:04.231+0000 7fd0e2a00640 1 --2- 172.21.15.50:0/3371747665 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd0e4103900 0x7fd0e419c450 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fd0d400e9f0 tx=0x7fd0d400eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:20:04.234 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:04.231+0000 7fd0e8a00640 1 -- 172.21.15.50:0/3371747665 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0d400cd80 con 0x7fd0e4103900 2024-08-31T04:20:04.235 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:04.231+0000 7fd0e9e00640 1 -- 172.21.15.50:0/3371747665 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd0e41a26b0 con 0x7fd0e4103900 2024-08-31T04:20:04.235 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:04.231+0000 7fd0e8a00640 1 -- 172.21.15.50:0/3371747665 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd0d40108e0 con 0x7fd0e4103900 2024-08-31T04:20:04.235 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:04.231+0000 7fd0e8a00640 1 -- 172.21.15.50:0/3371747665 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0d4018980 con 0x7fd0e4103900 2024-08-31T04:20:04.235 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:04.232+0000 7fd0e9e00640 1 -- 172.21.15.50:0/3371747665 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd0e41a8e10 con 0x7fd0e4103900 2024-08-31T04:20:04.235 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:04.232+0000 7fd0e9e00640 1 -- 172.21.15.50:0/3371747665 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd0e4103d10 con 0x7fd0e4103900 2024-08-31T04:20:04.236 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:04.235+0000 7fd0e8a00640 1 -- 172.21.15.50:0/3371747665 <== mon.1 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 16) ==== 152577+0+0 (secure 0 0 0) 0x7fd0d4010430 con 0x7fd0e4103900 2024-08-31T04:20:04.238 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:04.237+0000 7fd0e8a00640 1 --2- 172.21.15.50:0/3371747665 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fd0c80b4b30 0x7fd0c80b7040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:20:04.238 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:04.237+0000 7fd0e8a00640 1 -- 172.21.15.50:0/3371747665 <== mon.1 v2:172.21.15.177:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 7127+0+0 (secure 0 0 0) 0x7fd0d40e5530 con 0x7fd0e4103900 2024-08-31T04:20:04.238 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:04.237+0000 7fd0dbe00640 1 --2- 172.21.15.50:0/3371747665 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fd0c80b4b30 0x7fd0c80b7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:20:04.238 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:04.238+0000 7fd0dbe00640 1 --2- 172.21.15.50:0/3371747665 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fd0c80b4b30 0x7fd0c80b7040 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fd0cc02a9e0 tx=0x7fd0cc005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:20:04.239 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:04.239+0000 7fd0e8a00640 1 -- 172.21.15.50:0/3371747665 <== mon.1 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fd0d40ac410 con 0x7fd0e4103900 2024-08-31T04:20:04.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:04.479+0000 7fd0e9e00640 1 -- 172.21.15.50:0/3371747665 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd0e41a90b0 con 0x7fd0e4103900 2024-08-31T04:20:04.486 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:04.485+0000 7fd0e8a00640 1 -- 172.21.15.50:0/3371747665 <== mon.1 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 4 v4) ==== 93+0+3091 (secure 0 0 0) 0x7fd0d40b0bd0 con 0x7fd0e4103900 2024-08-31T04:20:04.487 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-08-31T04:20:04.487 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":4,"btime":"2024-08-31T04:20:03:468187+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14622,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/1565557530","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":1565557530},{"type":"v1","addr":"172.21.15.50:6835","nonce":1565557530}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24590,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6833/4283603962","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6832","nonce":4283603962},{"type":"v1","addr":"172.21.15.133:6833","nonce":4283603962}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24601,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6833/1237129793","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":1237129793},{"type":"v1","addr":"172.21.15.177:6833","nonce":1237129793}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-08-31T04:20:04.487 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 4 2024-08-31T04:20:04.489 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:04.488+0000 7fd0e9e00640 1 -- 172.21.15.50:0/3371747665 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fd0c80b4b30 msgr2=0x7fd0c80b7040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:20:04.489 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:04.488+0000 7fd0e9e00640 1 --2- 172.21.15.50:0/3371747665 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fd0c80b4b30 0x7fd0c80b7040 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fd0cc02a9e0 tx=0x7fd0cc005a20 comp rx=0 tx=0).stop 2024-08-31T04:20:04.489 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:04.488+0000 7fd0e9e00640 1 -- 172.21.15.50:0/3371747665 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd0e4103900 msgr2=0x7fd0e419c450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:20:04.490 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:04.488+0000 7fd0e9e00640 1 --2- 172.21.15.50:0/3371747665 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd0e4103900 0x7fd0e419c450 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fd0d400e9f0 tx=0x7fd0d400eeb0 comp rx=0 tx=0).stop 2024-08-31T04:20:04.490 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:04.488+0000 7fd0e9e00640 1 -- 172.21.15.50:0/3371747665 shutdown_connections 2024-08-31T04:20:04.490 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:04.488+0000 7fd0e9e00640 1 --2- 172.21.15.50:0/3371747665 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fd0c80b4b30 0x7fd0c80b7040 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:20:04.490 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:04.488+0000 7fd0e9e00640 1 --2- 172.21.15.50:0/3371747665 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd0e4109b90 0x7fd0e41a1c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:20:04.490 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:04.488+0000 7fd0e9e00640 1 --2- 172.21.15.50:0/3371747665 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd0e4109240 0x7fd0e419c9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:20:04.490 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:04.488+0000 7fd0e9e00640 1 --2- 172.21.15.50:0/3371747665 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd0e4103900 0x7fd0e419c450 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:20:04.490 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:04.488+0000 7fd0e9e00640 1 -- 172.21.15.50:0/3371747665 >> 172.21.15.50:0/3371747665 conn(0x7fd0e407b5f0 msgr2=0x7fd0e4107050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:20:04.490 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:04.488+0000 7fd0e9e00640 1 -- 172.21.15.50:0/3371747665 shutdown_connections 2024-08-31T04:20:04.490 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:04.488+0000 7fd0e9e00640 1 -- 172.21.15.50:0/3371747665 wait complete. 2024-08-31T04:20:04.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:20:04 smithi050 ceph-mon[17259]: Deploying daemon mds.d on smithi050 2024-08-31T04:20:04.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:20:04 smithi050 ceph-mon[17259]: mds.? [v2:172.21.15.50:6834/1565557530,v1:172.21.15.50:6835/1565557530] up:boot 2024-08-31T04:20:04.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:20:04 smithi050 ceph-mon[17259]: fsmap 3 up:standby 2024-08-31T04:20:04.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:20:04 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "j"} : dispatch 2024-08-31T04:20:04.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:20:04 smithi177 ceph-mon[22025]: Deploying daemon mds.d on smithi050 2024-08-31T04:20:04.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:20:04 smithi177 ceph-mon[22025]: mds.? [v2:172.21.15.50:6834/1565557530,v1:172.21.15.50:6835/1565557530] up:boot 2024-08-31T04:20:04.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:20:04 smithi177 ceph-mon[22025]: fsmap 3 up:standby 2024-08-31T04:20:04.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:20:04 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "j"} : dispatch 2024-08-31T04:20:04.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:20:04 smithi133 ceph-mon[22177]: Deploying daemon mds.d on smithi050 2024-08-31T04:20:04.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:20:04 smithi133 ceph-mon[22177]: mds.? [v2:172.21.15.50:6834/1565557530,v1:172.21.15.50:6835/1565557530] up:boot 2024-08-31T04:20:04.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:20:04 smithi133 ceph-mon[22177]: fsmap 3 up:standby 2024-08-31T04:20:04.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:20:04 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "j"} : dispatch 2024-08-31T04:20:05.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:20:05 smithi050 ceph-mon[17259]: pgmap v273: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T04:20:05.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:20:05 smithi050 ceph-mon[17259]: from='client.? 172.21.15.50:0/3371747665' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T04:20:05.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:20:05 smithi177 ceph-mon[22025]: pgmap v273: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T04:20:05.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:20:05 smithi177 ceph-mon[22025]: from='client.? 172.21.15.50:0/3371747665' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T04:20:05.792 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:20:05 smithi133 ceph-mon[22177]: pgmap v273: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T04:20:05.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:20:05 smithi133 ceph-mon[22177]: from='client.? 172.21.15.50:0/3371747665' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T04:20:07.168 INFO:journalctl@ceph.mds.d.smithi050.stdout:Aug 31 04:20:06 smithi050 systemd[1]: Starting Ceph mds.d for 058d9fc6-674f-11ef-bcd4-c7b262605968... 2024-08-31T04:20:07.450 INFO:journalctl@ceph.mds.d.smithi050.stdout:Aug 31 04:20:07 smithi050 podman[58329]: 2024-08-31 04:20:07.071558987 +0000 UTC m=+0.027216312 image pull 79f4cde5e36911a5dca995eeb98098c2c8aae81dd52a088ef2c867bc3363bad0 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61 2024-08-31T04:20:07.450 INFO:journalctl@ceph.mds.d.smithi050.stdout:Aug 31 04:20:07 smithi050 podman[58329]: 2024-08-31 04:20:07.199240805 +0000 UTC m=+0.154898130 container create 0ae382b592766f8fe219669ec263aada1160f878da3fd1fb1cea5c7984f7d122 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-mds-d, GIT_CLEAN=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, io.buildah.version=1.37.1, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS) 2024-08-31T04:20:07.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:20:07 smithi177 ceph-mon[22025]: pgmap v274: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T04:20:07.792 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:20:07 smithi133 ceph-mon[22177]: pgmap v274: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T04:20:07.809 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 058d9fc6-674f-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-31T04:20:07.858 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:20:07 smithi050 ceph-mon[17259]: pgmap v274: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T04:20:07.859 INFO:journalctl@ceph.mds.d.smithi050.stdout:Aug 31 04:20:07 smithi050 podman[58329]: 2024-08-31 04:20:07.468918285 +0000 UTC m=+0.424575610 container init 0ae382b592766f8fe219669ec263aada1160f878da3fd1fb1cea5c7984f7d122 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-mds-d, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.vendor=CentOS, io.buildah.version=1.37.1, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=) 2024-08-31T04:20:07.859 INFO:journalctl@ceph.mds.d.smithi050.stdout:Aug 31 04:20:07 smithi050 podman[58329]: 2024-08-31 04:20:07.474982905 +0000 UTC m=+0.430640231 container start 0ae382b592766f8fe219669ec263aada1160f878da3fd1fb1cea5c7984f7d122 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-mds-d, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.1, org.label-schema.schema-version=1.0, ceph=True, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, maintainer=Guillaume Abrioux ) 2024-08-31T04:20:07.859 INFO:journalctl@ceph.mds.d.smithi050.stdout:Aug 31 04:20:07 smithi050 ceph-mds[58348]: -- 172.21.15.50:0/3223165303 <== mon.0 v2:172.21.15.50:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5609c75e9860 con 0x5609cb78f180 2024-08-31T04:20:07.859 INFO:journalctl@ceph.mds.d.smithi050.stdout:Aug 31 04:20:07 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-mds-d[58344]: starting mds.d at 2024-08-31T04:20:07.859 INFO:journalctl@ceph.mds.d.smithi050.stdout:Aug 31 04:20:07 smithi050 bash[58329]: 0ae382b592766f8fe219669ec263aada1160f878da3fd1fb1cea5c7984f7d122 2024-08-31T04:20:07.859 INFO:journalctl@ceph.mds.d.smithi050.stdout:Aug 31 04:20:07 smithi050 systemd[1]: Started Ceph mds.d for 058d9fc6-674f-11ef-bcd4-c7b262605968. 2024-08-31T04:20:08.189 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:20:08.806 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:08.804+0000 7fa3c6200640 1 -- 172.21.15.50:0/578759302 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa3c0105950 msgr2=0x7fa3c0105d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:20:08.806 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:08.804+0000 7fa3c6200640 1 --2- 172.21.15.50:0/578759302 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa3c0105950 0x7fa3c0105d60 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fa3b4009900 tx=0x7fa3b402a3f0 comp rx=0 tx=0).stop 2024-08-31T04:20:08.806 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:08.804+0000 7fa3c6200640 1 -- 172.21.15.50:0/578759302 shutdown_connections 2024-08-31T04:20:08.807 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:08.804+0000 7fa3c6200640 1 --2- 172.21.15.50:0/578759302 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa3c010b290 0x7fa3c010b6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:20:08.807 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:08.804+0000 7fa3c6200640 1 --2- 172.21.15.50:0/578759302 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa3c010bbe0 0x7fa3c0112410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:20:08.807 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:08.804+0000 7fa3c6200640 1 --2- 172.21.15.50:0/578759302 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa3c0105950 0x7fa3c0105d60 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:20:08.807 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:08.804+0000 7fa3c6200640 1 -- 172.21.15.50:0/578759302 >> 172.21.15.50:0/578759302 conn(0x7fa3c0101420 msgr2=0x7fa3c0103870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:20:08.807 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:08.804+0000 7fa3c6200640 1 -- 172.21.15.50:0/578759302 shutdown_connections 2024-08-31T04:20:08.807 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:08.804+0000 7fa3c6200640 1 -- 172.21.15.50:0/578759302 wait complete. 2024-08-31T04:20:08.809 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:08.805+0000 7fa3c6200640 1 Processor -- start 2024-08-31T04:20:08.809 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:08.806+0000 7fa3c6200640 1 -- start start 2024-08-31T04:20:08.809 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:08.806+0000 7fa3c6200640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa3c0105950 0x7fa3c019c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:20:08.809 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:08.806+0000 7fa3c6200640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa3c010b290 0x7fa3c019c890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:20:08.809 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:08.806+0000 7fa3c6200640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa3c010bbe0 0x7fa3c01a1b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:20:08.809 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:08.806+0000 7fa3c6200640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fa3c01158a0 con 0x7fa3c010bbe0 2024-08-31T04:20:08.809 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:08.806+0000 7fa3c6200640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7fa3c0115720 con 0x7fa3c010b290 2024-08-31T04:20:08.809 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:08.806+0000 7fa3c6200640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fa3c0115a20 con 0x7fa3c0105950 2024-08-31T04:20:08.809 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:08.806+0000 7fa3bfe00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa3c010b290 0x7fa3c019c890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:20:08.810 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:08.806+0000 7fa3bfe00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa3c010b290 0x7fa3c019c890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.50:41326/0 (socket says 172.21.15.50:41326) 2024-08-31T04:20:08.810 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:08.806+0000 7fa3bfe00640 1 -- 172.21.15.50:0/606896123 learned_addr learned my addr 172.21.15.50:0/606896123 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:20:08.810 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:08.806+0000 7fa3c4e00640 1 --2- 172.21.15.50:0/606896123 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa3c0105950 0x7fa3c019c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:20:08.810 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:08.807+0000 7fa3c5800640 1 --2- 172.21.15.50:0/606896123 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa3c010bbe0 0x7fa3c01a1b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:20:08.810 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:08.807+0000 7fa3bfe00640 1 -- 172.21.15.50:0/606896123 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa3c0105950 msgr2=0x7fa3c019c2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:20:08.810 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:08.807+0000 7fa3bfe00640 1 --2- 172.21.15.50:0/606896123 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa3c0105950 0x7fa3c019c2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:20:08.810 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:08.807+0000 7fa3bfe00640 1 -- 172.21.15.50:0/606896123 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa3c010bbe0 msgr2=0x7fa3c01a1b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:20:08.810 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:08.807+0000 7fa3bfe00640 1 --2- 172.21.15.50:0/606896123 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa3c010bbe0 0x7fa3c01a1b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:20:08.810 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:08.807+0000 7fa3bfe00640 1 -- 172.21.15.50:0/606896123 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3c01a2260 con 0x7fa3c010b290 2024-08-31T04:20:08.810 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:08.807+0000 7fa3c5800640 1 --2- 172.21.15.50:0/606896123 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa3c010bbe0 0x7fa3c01a1b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:20:08.810 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:08.807+0000 7fa3bfe00640 1 --2- 172.21.15.50:0/606896123 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa3c010b290 0x7fa3c019c890 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fa3ac00e9c0 tx=0x7fa3ac00ee80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:20:08.810 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:08.807+0000 7fa3bd600640 1 -- 172.21.15.50:0/606896123 <== mon.2 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3ac00ccc0 con 0x7fa3c010b290 2024-08-31T04:20:08.810 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:08.808+0000 7fa3c6200640 1 -- 172.21.15.50:0/606896123 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa3c01a2550 con 0x7fa3c010b290 2024-08-31T04:20:08.810 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:08.808+0000 7fa3bd600640 1 -- 172.21.15.50:0/606896123 <== mon.2 v2:172.21.15.133:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa3ac0054d0 con 0x7fa3c010b290 2024-08-31T04:20:08.811 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:08.808+0000 7fa3bd600640 1 -- 172.21.15.50:0/606896123 <== mon.2 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3ac010430 con 0x7fa3c010b290 2024-08-31T04:20:08.811 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:08.808+0000 7fa3c6200640 1 -- 172.21.15.50:0/606896123 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa3c01a8cb0 con 0x7fa3c010b290 2024-08-31T04:20:08.811 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:08.809+0000 7fa3c6200640 1 -- 172.21.15.50:0/606896123 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa3c0105d60 con 0x7fa3c010b290 2024-08-31T04:20:08.812 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:08.811+0000 7fa3bd600640 1 -- 172.21.15.50:0/606896123 <== mon.2 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 16) ==== 152577+0+0 (secure 0 0 0) 0x7fa3ac005020 con 0x7fa3c010b290 2024-08-31T04:20:08.814 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:08.813+0000 7fa3bd600640 1 --2- 172.21.15.50:0/606896123 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fa3a80b4bb0 0x7fa3a80b70c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:20:08.815 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:08.813+0000 7fa3bd600640 1 -- 172.21.15.50:0/606896123 <== mon.2 v2:172.21.15.133:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 7127+0+0 (secure 0 0 0) 0x7fa3ac0e4ff0 con 0x7fa3c010b290 2024-08-31T04:20:08.815 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:08.813+0000 7fa3c4e00640 1 --2- 172.21.15.50:0/606896123 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fa3a80b4bb0 0x7fa3a80b70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:20:08.815 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:08.814+0000 7fa3bd600640 1 -- 172.21.15.50:0/606896123 <== mon.2 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fa3ac0ac560 con 0x7fa3c010b290 2024-08-31T04:20:08.815 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:08.814+0000 7fa3c4e00640 1 --2- 172.21.15.50:0/606896123 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fa3a80b4bb0 0x7fa3a80b70c0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fa3b4031440 tx=0x7fa3b4009560 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:20:08.950 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:20:08 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:20:08.950 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:20:08 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:20:08.950 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:20:08 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:20:08.950 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:20:08 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-31T04:20:08.950 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:20:08 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-31T04:20:08.950 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:20:08 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:20:08.950 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:20:08 smithi050 ceph-mon[17259]: Deploying daemon mds.e on smithi133 2024-08-31T04:20:08.951 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:20:08 smithi050 ceph-mon[17259]: pgmap v275: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T04:20:08.951 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:20:08 smithi050 ceph-mon[17259]: mds.? [v2:172.21.15.50:6836/2660185946,v1:172.21.15.50:6837/2660185946] up:boot 2024-08-31T04:20:08.951 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:20:08 smithi050 ceph-mon[17259]: fsmap 4 up:standby 2024-08-31T04:20:08.951 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:20:08 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "d"} : dispatch 2024-08-31T04:20:08.996 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:20:08 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:20:08.996 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:20:08 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:20:08.996 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:20:08 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:20:08.996 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:20:08 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-31T04:20:08.996 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:20:08 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-31T04:20:08.996 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:20:08 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:20:08.996 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:20:08 smithi177 ceph-mon[22025]: Deploying daemon mds.e on smithi133 2024-08-31T04:20:08.996 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:20:08 smithi177 ceph-mon[22025]: pgmap v275: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T04:20:08.996 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:20:08 smithi177 ceph-mon[22025]: mds.? [v2:172.21.15.50:6836/2660185946,v1:172.21.15.50:6837/2660185946] up:boot 2024-08-31T04:20:08.997 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:20:08 smithi177 ceph-mon[22025]: fsmap 4 up:standby 2024-08-31T04:20:08.997 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:20:08 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "d"} : dispatch 2024-08-31T04:20:09.043 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:20:08 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:20:09.043 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:20:08 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:20:09.043 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:20:08 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:20:09.043 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:20:08 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-31T04:20:09.043 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:20:08 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-31T04:20:09.043 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:20:08 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:20:09.043 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:20:08 smithi133 ceph-mon[22177]: Deploying daemon mds.e on smithi133 2024-08-31T04:20:09.043 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:20:08 smithi133 ceph-mon[22177]: pgmap v275: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T04:20:09.044 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:20:08 smithi133 ceph-mon[22177]: mds.? [v2:172.21.15.50:6836/2660185946,v1:172.21.15.50:6837/2660185946] up:boot 2024-08-31T04:20:09.044 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:20:08 smithi133 ceph-mon[22177]: fsmap 4 up:standby 2024-08-31T04:20:09.044 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:20:08 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "d"} : dispatch 2024-08-31T04:20:09.052 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:09.051+0000 7fa3c6200640 1 -- 172.21.15.50:0/606896123 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa3c019d420 con 0x7fa3c010b290 2024-08-31T04:20:09.053 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:09.052+0000 7fa3bd600640 1 -- 172.21.15.50:0/606896123 <== mon.2 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 5 v5) ==== 93+0+3916 (secure 0 0 0) 0x7fa3c019d420 con 0x7fa3c010b290 2024-08-31T04:20:09.053 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-08-31T04:20:09.053 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":5,"btime":"2024-08-31T04:20:08:487271+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14622,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/1565557530","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":1565557530},{"type":"v1","addr":"172.21.15.50:6835","nonce":1565557530}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14634,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6837/2660185946","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6836","nonce":2660185946},{"type":"v1","addr":"172.21.15.50:6837","nonce":2660185946}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24590,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6833/4283603962","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6832","nonce":4283603962},{"type":"v1","addr":"172.21.15.133:6833","nonce":4283603962}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24601,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6833/1237129793","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":1237129793},{"type":"v1","addr":"172.21.15.177:6833","nonce":1237129793}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-08-31T04:20:09.053 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 5 2024-08-31T04:20:09.055 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:09.054+0000 7fa3c6200640 1 -- 172.21.15.50:0/606896123 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fa3a80b4bb0 msgr2=0x7fa3a80b70c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:20:09.056 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:09.054+0000 7fa3c6200640 1 --2- 172.21.15.50:0/606896123 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fa3a80b4bb0 0x7fa3a80b70c0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fa3b4031440 tx=0x7fa3b4009560 comp rx=0 tx=0).stop 2024-08-31T04:20:09.056 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:09.054+0000 7fa3c6200640 1 -- 172.21.15.50:0/606896123 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa3c010b290 msgr2=0x7fa3c019c890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:20:09.056 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:09.054+0000 7fa3c6200640 1 --2- 172.21.15.50:0/606896123 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa3c010b290 0x7fa3c019c890 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fa3ac00e9c0 tx=0x7fa3ac00ee80 comp rx=0 tx=0).stop 2024-08-31T04:20:09.056 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:09.054+0000 7fa3c6200640 1 -- 172.21.15.50:0/606896123 shutdown_connections 2024-08-31T04:20:09.056 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:09.054+0000 7fa3c6200640 1 --2- 172.21.15.50:0/606896123 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fa3a80b4bb0 0x7fa3a80b70c0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:20:09.056 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:09.054+0000 7fa3c6200640 1 --2- 172.21.15.50:0/606896123 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa3c010bbe0 0x7fa3c01a1b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:20:09.056 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:09.054+0000 7fa3c6200640 1 --2- 172.21.15.50:0/606896123 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa3c010b290 0x7fa3c019c890 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:20:09.056 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:09.054+0000 7fa3c6200640 1 --2- 172.21.15.50:0/606896123 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa3c0105950 0x7fa3c019c2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:20:09.056 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:09.054+0000 7fa3c6200640 1 -- 172.21.15.50:0/606896123 >> 172.21.15.50:0/606896123 conn(0x7fa3c0101420 msgr2=0x7fa3c0103840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:20:09.056 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:09.054+0000 7fa3c6200640 1 -- 172.21.15.50:0/606896123 shutdown_connections 2024-08-31T04:20:09.056 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:09.054+0000 7fa3c6200640 1 -- 172.21.15.50:0/606896123 wait complete. 2024-08-31T04:20:09.990 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:20:09 smithi133 ceph-mon[22177]: from='client.? 172.21.15.50:0/606896123' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T04:20:09.991 INFO:journalctl@ceph.mds.e.smithi133.stdout:Aug 31 04:20:09 smithi133 systemd[1]: Starting Ceph mds.e for 058d9fc6-674f-11ef-bcd4-c7b262605968... 2024-08-31T04:20:09.996 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:20:09 smithi177 ceph-mon[22025]: from='client.? 172.21.15.50:0/606896123' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T04:20:10.200 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:20:09 smithi050 ceph-mon[17259]: from='client.? 172.21.15.50:0/606896123' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T04:20:10.259 INFO:journalctl@ceph.mds.e.smithi133.stdout:Aug 31 04:20:09 smithi133 podman[51482]: 2024-08-31 04:20:09.89229709 +0000 UTC m=+0.015903882 image pull 79f4cde5e36911a5dca995eeb98098c2c8aae81dd52a088ef2c867bc3363bad0 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61 2024-08-31T04:20:10.259 INFO:journalctl@ceph.mds.e.smithi133.stdout:Aug 31 04:20:09 smithi133 podman[51482]: 2024-08-31 04:20:09.994888604 +0000 UTC m=+0.118495389 container create e5f2accbe9c2990e77c7dd4caadaf9185213c81c55afab51f9ef4a40301561ca (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-mds-e, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, io.buildah.version=1.37.1, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, ceph=True) 2024-08-31T04:20:10.259 INFO:journalctl@ceph.mds.e.smithi133.stdout:Aug 31 04:20:10 smithi133 podman[51482]: 2024-08-31 04:20:10.222824177 +0000 UTC m=+0.346430963 container init e5f2accbe9c2990e77c7dd4caadaf9185213c81c55afab51f9ef4a40301561ca (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-mds-e, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, io.buildah.version=1.37.1, ceph=True) 2024-08-31T04:20:10.259 INFO:journalctl@ceph.mds.e.smithi133.stdout:Aug 31 04:20:10 smithi133 podman[51482]: 2024-08-31 04:20:10.225797669 +0000 UTC m=+0.349404464 container start e5f2accbe9c2990e77c7dd4caadaf9185213c81c55afab51f9ef4a40301561ca (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-mds-e, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, ceph=True, io.buildah.version=1.37.1, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611) 2024-08-31T04:20:10.259 INFO:journalctl@ceph.mds.e.smithi133.stdout:Aug 31 04:20:10 smithi133 ceph-mds[51501]: -- 172.21.15.133:0/396961261 <== mon.2 v2:172.21.15.133:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55f5d2d39860 con 0x55f5d6edfa80 2024-08-31T04:20:10.543 INFO:journalctl@ceph.mds.e.smithi133.stdout:Aug 31 04:20:10 smithi133 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-mds-e[51497]: starting mds.e at 2024-08-31T04:20:10.543 INFO:journalctl@ceph.mds.e.smithi133.stdout:Aug 31 04:20:10 smithi133 bash[51482]: e5f2accbe9c2990e77c7dd4caadaf9185213c81c55afab51f9ef4a40301561ca 2024-08-31T04:20:10.543 INFO:journalctl@ceph.mds.e.smithi133.stdout:Aug 31 04:20:10 smithi133 systemd[1]: Started Ceph mds.e for 058d9fc6-674f-11ef-bcd4-c7b262605968. 2024-08-31T04:20:11.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:20:11 smithi177 ceph-mon[22025]: pgmap v276: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T04:20:11.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:20:11 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:20:11.497 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:20:11 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:20:11.497 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:20:11 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:20:11.497 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:20:11 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-31T04:20:11.497 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:20:11 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-31T04:20:11.497 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:20:11 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:20:11.497 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:20:11 smithi177 ceph-mon[22025]: Deploying daemon mds.f on smithi177 2024-08-31T04:20:11.497 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:20:11 smithi177 ceph-mon[22025]: mds.? [v2:172.21.15.133:6834/3637799701,v1:172.21.15.133:6835/3637799701] up:boot 2024-08-31T04:20:11.497 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:20:11 smithi177 ceph-mon[22025]: fsmap 5 up:standby 2024-08-31T04:20:11.497 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:20:11 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "e"} : dispatch 2024-08-31T04:20:11.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:20:11 smithi050 ceph-mon[17259]: pgmap v276: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T04:20:11.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:20:11 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:20:11.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:20:11 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:20:11.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:20:11 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:20:11.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:20:11 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-31T04:20:11.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:20:11 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-31T04:20:11.701 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:20:11 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:20:11.701 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:20:11 smithi050 ceph-mon[17259]: Deploying daemon mds.f on smithi177 2024-08-31T04:20:11.701 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:20:11 smithi050 ceph-mon[17259]: mds.? [v2:172.21.15.133:6834/3637799701,v1:172.21.15.133:6835/3637799701] up:boot 2024-08-31T04:20:11.701 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:20:11 smithi050 ceph-mon[17259]: fsmap 5 up:standby 2024-08-31T04:20:11.701 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:20:11 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "e"} : dispatch 2024-08-31T04:20:11.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:20:11 smithi133 ceph-mon[22177]: pgmap v276: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T04:20:11.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:20:11 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:20:11.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:20:11 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:20:11.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:20:11 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:20:11.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:20:11 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-31T04:20:11.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:20:11 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-31T04:20:11.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:20:11 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:20:11.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:20:11 smithi133 ceph-mon[22177]: Deploying daemon mds.f on smithi177 2024-08-31T04:20:11.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:20:11 smithi133 ceph-mon[22177]: mds.? [v2:172.21.15.133:6834/3637799701,v1:172.21.15.133:6835/3637799701] up:boot 2024-08-31T04:20:11.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:20:11 smithi133 ceph-mon[22177]: fsmap 5 up:standby 2024-08-31T04:20:11.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:20:11 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "e"} : dispatch 2024-08-31T04:20:11.811 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 058d9fc6-674f-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-31T04:20:12.199 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:20:12.477 INFO:journalctl@ceph.mds.f.smithi177.stdout:Aug 31 04:20:12 smithi177 systemd[1]: Starting Ceph mds.f for 058d9fc6-674f-11ef-bcd4-c7b262605968... 2024-08-31T04:20:12.746 INFO:journalctl@ceph.mds.f.smithi177.stdout:Aug 31 04:20:12 smithi177 podman[51895]: 2024-08-31 04:20:12.377950452 +0000 UTC m=+0.016274813 image pull 79f4cde5e36911a5dca995eeb98098c2c8aae81dd52a088ef2c867bc3363bad0 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61 2024-08-31T04:20:12.746 INFO:journalctl@ceph.mds.f.smithi177.stdout:Aug 31 04:20:12 smithi177 podman[51895]: 2024-08-31 04:20:12.495237044 +0000 UTC m=+0.133561395 container create edeac1f32f75a6a10ce7c7f6f5f58d12ab7cb2d157161dfb073d00bd8e523162 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-mds-f, GIT_CLEAN=True, io.buildah.version=1.37.1, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611) 2024-08-31T04:20:12.853 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:12.851+0000 7f1855000640 1 -- 172.21.15.50:0/2075470416 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1850109b90 msgr2=0x7f18501103c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:20:12.853 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:12.851+0000 7f1855000640 1 --2- 172.21.15.50:0/2075470416 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1850109b90 0x7f18501103c0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f1848009ca0 tx=0x7f184802a8c0 comp rx=0 tx=0).stop 2024-08-31T04:20:12.853 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:12.852+0000 7f1855000640 1 -- 172.21.15.50:0/2075470416 shutdown_connections 2024-08-31T04:20:12.854 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:12.852+0000 7f1855000640 1 --2- 172.21.15.50:0/2075470416 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1850109b90 0x7f18501103c0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:20:12.854 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:12.852+0000 7f1855000640 1 --2- 172.21.15.50:0/2075470416 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1850109240 0x7f1850109650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:20:12.854 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:12.852+0000 7f1855000640 1 --2- 172.21.15.50:0/2075470416 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1850103900 0x7f1850103d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:20:12.854 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:12.852+0000 7f1855000640 1 -- 172.21.15.50:0/2075470416 >> 172.21.15.50:0/2075470416 conn(0x7f185007b5f0 msgr2=0x7f185007ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:20:12.854 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:12.852+0000 7f1855000640 1 -- 172.21.15.50:0/2075470416 shutdown_connections 2024-08-31T04:20:12.854 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:12.852+0000 7f1855000640 1 -- 172.21.15.50:0/2075470416 wait complete. 2024-08-31T04:20:12.855 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:12.853+0000 7f1855000640 1 Processor -- start 2024-08-31T04:20:12.855 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:12.853+0000 7f1855000640 1 -- start start 2024-08-31T04:20:12.855 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:12.853+0000 7f1855000640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1850103900 0x7f18500754b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:20:12.855 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:12.853+0000 7f1855000640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1850109240 0x7f18500759f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:20:12.855 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:12.853+0000 7f1855000640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1850109b90 0x7f1850075f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:20:12.855 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:12.853+0000 7f1855000640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f1850113850 con 0x7f1850103900 2024-08-31T04:20:12.855 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:12.853+0000 7f1855000640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f18501136d0 con 0x7f1850109240 2024-08-31T04:20:12.855 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:12.853+0000 7f1855000640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f18501139d0 con 0x7f1850109b90 2024-08-31T04:20:12.855 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:12.854+0000 7f184de00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1850103900 0x7f18500754b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:20:12.855 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:12.854+0000 7f184d400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1850109240 0x7f18500759f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:20:12.855 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:12.854+0000 7f184e800640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1850109b90 0x7f1850075f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:20:12.856 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:12.854+0000 7f184d400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1850109240 0x7f18500759f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.50:41354/0 (socket says 172.21.15.50:41354) 2024-08-31T04:20:12.856 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:12.854+0000 7f184e800640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1850109b90 0x7f1850075f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.50:42454/0 (socket says 172.21.15.50:42454) 2024-08-31T04:20:12.856 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:12.854+0000 7f184de00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1850103900 0x7f18500754b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49404/0 (socket says 172.21.15.50:49404) 2024-08-31T04:20:12.856 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:12.854+0000 7f184e800640 1 -- 172.21.15.50:0/868150959 learned_addr learned my addr 172.21.15.50:0/868150959 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:20:12.856 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:12.854+0000 7f184d400640 1 -- 172.21.15.50:0/868150959 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1850109b90 msgr2=0x7f1850075f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:20:12.857 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:12.854+0000 7f184d400640 1 --2- 172.21.15.50:0/868150959 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1850109b90 0x7f1850075f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:20:12.857 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:12.854+0000 7f184d400640 1 -- 172.21.15.50:0/868150959 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1850103900 msgr2=0x7f18500754b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:20:12.857 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:12.854+0000 7f184d400640 1 --2- 172.21.15.50:0/868150959 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1850103900 0x7f18500754b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:20:12.857 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:12.854+0000 7f184d400640 1 -- 172.21.15.50:0/868150959 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18501a8480 con 0x7f1850109240 2024-08-31T04:20:12.857 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:12.854+0000 7f184de00640 1 --2- 172.21.15.50:0/868150959 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1850103900 0x7f18500754b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:20:12.857 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:12.855+0000 7f184d400640 1 --2- 172.21.15.50:0/868150959 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1850109240 0x7f18500759f0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f185006c790 tx=0x7f183c00ee50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:20:12.857 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:12.855+0000 7f1846a00640 1 -- 172.21.15.50:0/868150959 <== mon.2 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f183c00cd00 con 0x7f1850109240 2024-08-31T04:20:12.857 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:12.855+0000 7f1846a00640 1 -- 172.21.15.50:0/868150959 <== mon.2 v2:172.21.15.133:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f183c0035f0 con 0x7f1850109240 2024-08-31T04:20:12.857 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:12.855+0000 7f1855000640 1 -- 172.21.15.50:0/868150959 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f18501a8770 con 0x7f1850109240 2024-08-31T04:20:12.857 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:12.855+0000 7f1846a00640 1 -- 172.21.15.50:0/868150959 <== mon.2 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f183c010690 con 0x7f1850109240 2024-08-31T04:20:12.857 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:12.855+0000 7f1855000640 1 -- 172.21.15.50:0/868150959 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f18501a8d00 con 0x7f1850109240 2024-08-31T04:20:12.858 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:12.856+0000 7f1855000640 1 -- 172.21.15.50:0/868150959 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1850103d10 con 0x7f1850109240 2024-08-31T04:20:12.860 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:12.858+0000 7f1846a00640 1 -- 172.21.15.50:0/868150959 <== mon.2 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 16) ==== 152577+0+0 (secure 0 0 0) 0x7f183c0037a0 con 0x7f1850109240 2024-08-31T04:20:12.861 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:12.860+0000 7f1846a00640 1 --2- 172.21.15.50:0/868150959 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f18340b4bb0 0x7f18340b70c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:20:12.861 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:12.860+0000 7f1846a00640 1 -- 172.21.15.50:0/868150959 <== mon.2 v2:172.21.15.133:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 7127+0+0 (secure 0 0 0) 0x7f183c0e5090 con 0x7f1850109240 2024-08-31T04:20:12.861 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:12.860+0000 7f184de00640 1 --2- 172.21.15.50:0/868150959 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f18340b4bb0 0x7f18340b70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:20:12.862 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:12.861+0000 7f184de00640 1 --2- 172.21.15.50:0/868150959 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f18340b4bb0 0x7f18340b70c0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f1850076f00 tx=0x7f184000b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:20:12.863 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:12.862+0000 7f1846a00640 1 -- 172.21.15.50:0/868150959 <== mon.2 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f183c056130 con 0x7f1850109240 2024-08-31T04:20:13.102 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:13.101+0000 7f1855000640 1 -- 172.21.15.50:0/868150959 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f18500767b0 con 0x7f1850109240 2024-08-31T04:20:13.103 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:13.102+0000 7f1846a00640 1 -- 172.21.15.50:0/868150959 <== mon.2 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+4744 (secure 0 0 0) 0x7f183c0ac5c0 con 0x7f1850109240 2024-08-31T04:20:13.103 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-08-31T04:20:13.103 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":6,"btime":"2024-08-31T04:20:10:705520+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14622,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/1565557530","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":1565557530},{"type":"v1","addr":"172.21.15.50:6835","nonce":1565557530}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14634,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6837/2660185946","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6836","nonce":2660185946},{"type":"v1","addr":"172.21.15.50:6837","nonce":2660185946}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24590,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6833/4283603962","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6832","nonce":4283603962},{"type":"v1","addr":"172.21.15.133:6833","nonce":4283603962}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24601,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6833/1237129793","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":1237129793},{"type":"v1","addr":"172.21.15.177:6833","nonce":1237129793}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24626,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6835/3637799701","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":3637799701},{"type":"v1","addr":"172.21.15.133:6835","nonce":3637799701}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[]} 2024-08-31T04:20:13.103 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 6 2024-08-31T04:20:13.106 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:13.104+0000 7f1855000640 1 -- 172.21.15.50:0/868150959 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f18340b4bb0 msgr2=0x7f18340b70c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:20:13.106 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:13.104+0000 7f1855000640 1 --2- 172.21.15.50:0/868150959 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f18340b4bb0 0x7f18340b70c0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f1850076f00 tx=0x7f184000b410 comp rx=0 tx=0).stop 2024-08-31T04:20:13.106 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:13.105+0000 7f1855000640 1 -- 172.21.15.50:0/868150959 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1850109240 msgr2=0x7f18500759f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:20:13.106 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:13.105+0000 7f1855000640 1 --2- 172.21.15.50:0/868150959 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1850109240 0x7f18500759f0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f185006c790 tx=0x7f183c00ee50 comp rx=0 tx=0).stop 2024-08-31T04:20:13.106 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:13.105+0000 7f1855000640 1 -- 172.21.15.50:0/868150959 shutdown_connections 2024-08-31T04:20:13.106 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:13.105+0000 7f1855000640 1 --2- 172.21.15.50:0/868150959 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f18340b4bb0 0x7f18340b70c0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:20:13.106 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:13.105+0000 7f1855000640 1 --2- 172.21.15.50:0/868150959 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1850109b90 0x7f1850075f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:20:13.106 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:13.105+0000 7f1855000640 1 --2- 172.21.15.50:0/868150959 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1850109240 0x7f18500759f0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:20:13.107 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:13.105+0000 7f1855000640 1 --2- 172.21.15.50:0/868150959 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1850103900 0x7f18500754b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:20:13.107 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:13.105+0000 7f1855000640 1 -- 172.21.15.50:0/868150959 >> 172.21.15.50:0/868150959 conn(0x7f185007b5f0 msgr2=0x7f18501051d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:20:13.107 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:13.105+0000 7f1855000640 1 -- 172.21.15.50:0/868150959 shutdown_connections 2024-08-31T04:20:13.107 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:13.105+0000 7f1855000640 1 -- 172.21.15.50:0/868150959 wait complete. 2024-08-31T04:20:13.246 INFO:journalctl@ceph.mds.f.smithi177.stdout:Aug 31 04:20:12 smithi177 podman[51895]: 2024-08-31 04:20:12.756821926 +0000 UTC m=+0.395146277 container init edeac1f32f75a6a10ce7c7f6f5f58d12ab7cb2d157161dfb073d00bd8e523162 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-mds-f, io.buildah.version=1.37.1, org.label-schema.build-date=20240731, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS) 2024-08-31T04:20:13.246 INFO:journalctl@ceph.mds.f.smithi177.stdout:Aug 31 04:20:12 smithi177 podman[51895]: 2024-08-31 04:20:12.759571515 +0000 UTC m=+0.397895866 container start edeac1f32f75a6a10ce7c7f6f5f58d12ab7cb2d157161dfb073d00bd8e523162 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-mds-f, ceph=True, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, io.buildah.version=1.37.1, org.label-schema.build-date=20240731) 2024-08-31T04:20:13.246 INFO:journalctl@ceph.mds.f.smithi177.stdout:Aug 31 04:20:12 smithi177 ceph-mds[51915]: -- 172.21.15.177:0/3289664480 <== mon.1 v2:172.21.15.177:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5593f2e67860 con 0x5593f700d600 2024-08-31T04:20:13.246 INFO:journalctl@ceph.mds.f.smithi177.stdout:Aug 31 04:20:12 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-mds-f[51911]: starting mds.f at 2024-08-31T04:20:13.246 INFO:journalctl@ceph.mds.f.smithi177.stdout:Aug 31 04:20:12 smithi177 bash[51895]: edeac1f32f75a6a10ce7c7f6f5f58d12ab7cb2d157161dfb073d00bd8e523162 2024-08-31T04:20:13.246 INFO:journalctl@ceph.mds.f.smithi177.stdout:Aug 31 04:20:12 smithi177 systemd[1]: Started Ceph mds.f for 058d9fc6-674f-11ef-bcd4-c7b262605968. 2024-08-31T04:20:13.586 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:20:13 smithi177 ceph-mon[22025]: pgmap v277: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T04:20:13.586 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:20:13 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:20:13.586 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:20:13 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:20:13.586 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:20:13 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:20:13.587 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:20:13 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-31T04:20:13.587 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:20:13 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-31T04:20:13.587 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:20:13 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:20:13.587 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:20:13 smithi177 ceph-mon[22025]: from='client.? 172.21.15.50:0/868150959' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T04:20:13.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:20:13 smithi050 ceph-mon[17259]: pgmap v277: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T04:20:13.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:20:13 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:20:13.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:20:13 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:20:13.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:20:13 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:20:13.701 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:20:13 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-31T04:20:13.701 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:20:13 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-31T04:20:13.701 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:20:13 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:20:13.701 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:20:13 smithi050 ceph-mon[17259]: from='client.? 172.21.15.50:0/868150959' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T04:20:13.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:20:13 smithi133 ceph-mon[22177]: pgmap v277: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T04:20:13.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:20:13 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:20:13.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:20:13 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:20:13.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:20:13 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:20:13.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:20:13 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-31T04:20:13.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:20:13 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-31T04:20:13.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:20:13 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:20:13.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:20:13 smithi133 ceph-mon[22177]: from='client.? 172.21.15.50:0/868150959' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T04:20:14.660 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:20:14 smithi177 ceph-mon[22025]: Deploying daemon mds.c on smithi177 2024-08-31T04:20:14.660 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:20:14 smithi177 ceph-mon[22025]: mds.? [v2:172.21.15.177:6834/599392457,v1:172.21.15.177:6835/599392457] up:boot 2024-08-31T04:20:14.660 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:20:14 smithi177 ceph-mon[22025]: fsmap 6 up:standby 2024-08-31T04:20:14.660 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:20:14 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "f"} : dispatch 2024-08-31T04:20:14.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:20:14 smithi050 ceph-mon[17259]: Deploying daemon mds.c on smithi177 2024-08-31T04:20:14.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:20:14 smithi050 ceph-mon[17259]: mds.? [v2:172.21.15.177:6834/599392457,v1:172.21.15.177:6835/599392457] up:boot 2024-08-31T04:20:14.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:20:14 smithi050 ceph-mon[17259]: fsmap 6 up:standby 2024-08-31T04:20:14.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:20:14 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "f"} : dispatch 2024-08-31T04:20:14.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:20:14 smithi133 ceph-mon[22177]: Deploying daemon mds.c on smithi177 2024-08-31T04:20:14.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:20:14 smithi133 ceph-mon[22177]: mds.? [v2:172.21.15.177:6834/599392457,v1:172.21.15.177:6835/599392457] up:boot 2024-08-31T04:20:14.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:20:14 smithi133 ceph-mon[22177]: fsmap 6 up:standby 2024-08-31T04:20:14.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:20:14 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "f"} : dispatch 2024-08-31T04:20:14.926 INFO:journalctl@ceph.mds.c.smithi177.stdout:Aug 31 04:20:14 smithi177 systemd[1]: Starting Ceph mds.c for 058d9fc6-674f-11ef-bcd4-c7b262605968... 2024-08-31T04:20:15.246 INFO:journalctl@ceph.mds.c.smithi177.stdout:Aug 31 04:20:15 smithi177 podman[52200]: 2024-08-31 04:20:14.995185415 +0000 UTC m=+0.015862425 image pull 79f4cde5e36911a5dca995eeb98098c2c8aae81dd52a088ef2c867bc3363bad0 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61 2024-08-31T04:20:15.246 INFO:journalctl@ceph.mds.c.smithi177.stdout:Aug 31 04:20:15 smithi177 podman[52200]: 2024-08-31 04:20:15.110002043 +0000 UTC m=+0.130679040 container create c26f7a754db7c286b03ee2fdbbc4a42f5dcc1ef3d95833d2898b41869cfde156 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-mds-c, io.buildah.version=1.37.1, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.license=GPLv2, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.vendor=CentOS) 2024-08-31T04:20:15.505 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:20:15 smithi177 ceph-mon[22025]: pgmap v278: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T04:20:15.506 INFO:journalctl@ceph.mds.c.smithi177.stdout:Aug 31 04:20:15 smithi177 podman[52200]: 2024-08-31 04:20:15.404410424 +0000 UTC m=+0.425087423 container init c26f7a754db7c286b03ee2fdbbc4a42f5dcc1ef3d95833d2898b41869cfde156 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-mds-c, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, io.buildah.version=1.37.1, org.label-schema.schema-version=1.0) 2024-08-31T04:20:15.506 INFO:journalctl@ceph.mds.c.smithi177.stdout:Aug 31 04:20:15 smithi177 podman[52200]: 2024-08-31 04:20:15.407357798 +0000 UTC m=+0.428034795 container start c26f7a754db7c286b03ee2fdbbc4a42f5dcc1ef3d95833d2898b41869cfde156 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-mds-c, GIT_CLEAN=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, io.buildah.version=1.37.1, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2) 2024-08-31T04:20:15.506 INFO:journalctl@ceph.mds.c.smithi177.stdout:Aug 31 04:20:15 smithi177 ceph-mds[52230]: -- 172.21.15.177:0/2618470417 <== mon.1 v2:172.21.15.177:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x559a22597860 con 0x559a2673d180 2024-08-31T04:20:15.506 INFO:journalctl@ceph.mds.c.smithi177.stdout:Aug 31 04:20:15 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-mds-c[52224]: starting mds.c at 2024-08-31T04:20:15.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:20:15 smithi050 ceph-mon[17259]: pgmap v278: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T04:20:15.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:20:15 smithi133 ceph-mon[22177]: pgmap v278: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T04:20:15.853 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 058d9fc6-674f-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-31T04:20:15.894 INFO:journalctl@ceph.mds.c.smithi177.stdout:Aug 31 04:20:15 smithi177 bash[52200]: c26f7a754db7c286b03ee2fdbbc4a42f5dcc1ef3d95833d2898b41869cfde156 2024-08-31T04:20:15.894 INFO:journalctl@ceph.mds.c.smithi177.stdout:Aug 31 04:20:15 smithi177 systemd[1]: Started Ceph mds.c for 058d9fc6-674f-11ef-bcd4-c7b262605968. 2024-08-31T04:20:16.253 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:20:16.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:20:16 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:20:16.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:20:16 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:20:16.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:20:16 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:20:16.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:20:16 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-31T04:20:16.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:20:16 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-31T04:20:16.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:20:16 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:20:16.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:20:16 smithi133 ceph-mon[22177]: mds.? [v2:172.21.15.177:6836/2159859285,v1:172.21.15.177:6837/2159859285] up:boot 2024-08-31T04:20:16.794 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:20:16 smithi133 ceph-mon[22177]: fsmap 7 up:standby 2024-08-31T04:20:16.794 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:20:16 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "c"} : dispatch 2024-08-31T04:20:16.883 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:16.881+0000 7fbd44400640 1 -- 172.21.15.50:0/3758121944 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbd3c103900 msgr2=0x7fbd3c103d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:20:16.883 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:16.881+0000 7fbd44400640 1 --2- 172.21.15.50:0/3758121944 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbd3c103900 0x7fbd3c103d10 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fbd30009900 tx=0x7fbd3002a410 comp rx=0 tx=0).stop 2024-08-31T04:20:16.883 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:20:16 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:20:16.884 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:20:16 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:20:16.884 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:20:16 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:20:16.884 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:20:16 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-31T04:20:16.884 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:20:16 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-31T04:20:16.884 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:20:16 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:20:16.884 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:20:16 smithi050 ceph-mon[17259]: mds.? [v2:172.21.15.177:6836/2159859285,v1:172.21.15.177:6837/2159859285] up:boot 2024-08-31T04:20:16.884 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:20:16 smithi050 ceph-mon[17259]: fsmap 7 up:standby 2024-08-31T04:20:16.884 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:20:16 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "c"} : dispatch 2024-08-31T04:20:16.885 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:16.881+0000 7fbd44400640 1 -- 172.21.15.50:0/3758121944 shutdown_connections 2024-08-31T04:20:16.885 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:16.881+0000 7fbd44400640 1 --2- 172.21.15.50:0/3758121944 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbd3c109b90 0x7fbd3c1103c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:20:16.885 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:16.881+0000 7fbd44400640 1 --2- 172.21.15.50:0/3758121944 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbd3c109240 0x7fbd3c109650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:20:16.886 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:16.881+0000 7fbd44400640 1 --2- 172.21.15.50:0/3758121944 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbd3c103900 0x7fbd3c103d10 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:20:16.886 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:16.881+0000 7fbd44400640 1 -- 172.21.15.50:0/3758121944 >> 172.21.15.50:0/3758121944 conn(0x7fbd3c07b5f0 msgr2=0x7fbd3c07ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:20:16.886 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:16.881+0000 7fbd44400640 1 -- 172.21.15.50:0/3758121944 shutdown_connections 2024-08-31T04:20:16.886 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:16.881+0000 7fbd44400640 1 -- 172.21.15.50:0/3758121944 wait complete. 2024-08-31T04:20:16.886 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:16.882+0000 7fbd44400640 1 Processor -- start 2024-08-31T04:20:16.886 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:16.882+0000 7fbd44400640 1 -- start start 2024-08-31T04:20:16.886 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:16.883+0000 7fbd44400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbd3c103900 0x7fbd3c0754b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:20:16.886 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:16.883+0000 7fbd44400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbd3c109240 0x7fbd3c0759f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:20:16.886 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:16.883+0000 7fbd44400640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbd3c109b90 0x7fbd3c075f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:20:16.886 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:16.883+0000 7fbd44400640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fbd3c113850 con 0x7fbd3c109240 2024-08-31T04:20:16.886 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:16.883+0000 7fbd44400640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7fbd3c1136d0 con 0x7fbd3c103900 2024-08-31T04:20:16.886 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:16.883+0000 7fbd44400640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fbd3c1139d0 con 0x7fbd3c109b90 2024-08-31T04:20:16.887 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:16.883+0000 7fbd41a00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbd3c103900 0x7fbd3c0754b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:20:16.887 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:16.883+0000 7fbd41000640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbd3c109240 0x7fbd3c0759f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:20:16.887 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:16.883+0000 7fbd41a00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbd3c103900 0x7fbd3c0754b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.50:35266/0 (socket says 172.21.15.50:35266) 2024-08-31T04:20:16.887 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:16.883+0000 7fbd41a00640 1 -- 172.21.15.50:0/1696522097 learned_addr learned my addr 172.21.15.50:0/1696522097 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:20:16.887 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:16.884+0000 7fbd42400640 1 --2- 172.21.15.50:0/1696522097 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbd3c109b90 0x7fbd3c075f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:20:16.887 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:16.884+0000 7fbd41a00640 1 -- 172.21.15.50:0/1696522097 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbd3c109b90 msgr2=0x7fbd3c075f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:20:16.887 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:16.884+0000 7fbd41a00640 1 --2- 172.21.15.50:0/1696522097 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbd3c109b90 0x7fbd3c075f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:20:16.887 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:16.884+0000 7fbd41a00640 1 -- 172.21.15.50:0/1696522097 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbd3c109240 msgr2=0x7fbd3c0759f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:20:16.887 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:16.884+0000 7fbd41a00640 1 --2- 172.21.15.50:0/1696522097 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbd3c109240 0x7fbd3c0759f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:20:16.887 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:16.884+0000 7fbd41a00640 1 -- 172.21.15.50:0/1696522097 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd3c1a8500 con 0x7fbd3c103900 2024-08-31T04:20:16.887 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:16.884+0000 7fbd41a00640 1 --2- 172.21.15.50:0/1696522097 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbd3c103900 0x7fbd3c0754b0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fbd30005940 tx=0x7fbd30004270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:20:16.888 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:16.885+0000 7fbd3a000640 1 -- 172.21.15.50:0/1696522097 <== mon.2 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd3003f030 con 0x7fbd3c103900 2024-08-31T04:20:16.888 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:16.885+0000 7fbd3a000640 1 -- 172.21.15.50:0/1696522097 <== mon.2 v2:172.21.15.133:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbd30003aa0 con 0x7fbd3c103900 2024-08-31T04:20:16.888 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:16.885+0000 7fbd44400640 1 -- 172.21.15.50:0/1696522097 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbd3c1a8790 con 0x7fbd3c103900 2024-08-31T04:20:16.888 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:16.885+0000 7fbd44400640 1 -- 172.21.15.50:0/1696522097 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbd3c1a8c70 con 0x7fbd3c103900 2024-08-31T04:20:16.888 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:16.885+0000 7fbd3a000640 1 -- 172.21.15.50:0/1696522097 <== mon.2 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd30035070 con 0x7fbd3c103900 2024-08-31T04:20:16.888 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:16.886+0000 7fbd44400640 1 -- 172.21.15.50:0/1696522097 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbd1c005290 con 0x7fbd3c103900 2024-08-31T04:20:16.889 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:16.888+0000 7fbd3a000640 1 -- 172.21.15.50:0/1696522097 <== mon.2 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 16) ==== 152577+0+0 (secure 0 0 0) 0x7fbd30042030 con 0x7fbd3c103900 2024-08-31T04:20:16.891 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:16.890+0000 7fbd3a000640 1 --2- 172.21.15.50:0/1696522097 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fbd240b4b30 0x7fbd240b7040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:20:16.891 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:16.890+0000 7fbd3a000640 1 -- 172.21.15.50:0/1696522097 <== mon.2 v2:172.21.15.133:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 7127+0+0 (secure 0 0 0) 0x7fbd301050d0 con 0x7fbd3c103900 2024-08-31T04:20:16.891 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:16.890+0000 7fbd41000640 1 --2- 172.21.15.50:0/1696522097 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fbd240b4b30 0x7fbd240b7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:20:16.892 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:16.891+0000 7fbd41000640 1 --2- 172.21.15.50:0/1696522097 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fbd240b4b30 0x7fbd240b7040 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fbd3c1062d0 tx=0x7fbd2800b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:20:16.895 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:16.894+0000 7fbd3a000640 1 -- 172.21.15.50:0/1696522097 <== mon.2 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fbd300cbfb0 con 0x7fbd3c103900 2024-08-31T04:20:16.996 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:20:16 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:20:16.996 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:20:16 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:20:16.996 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:20:16 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:20:16.996 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:20:16 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-31T04:20:16.996 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:20:16 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-31T04:20:16.996 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:20:16 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:20:16.996 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:20:16 smithi177 ceph-mon[22025]: mds.? [v2:172.21.15.177:6836/2159859285,v1:172.21.15.177:6837/2159859285] up:boot 2024-08-31T04:20:16.996 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:20:16 smithi177 ceph-mon[22025]: fsmap 7 up:standby 2024-08-31T04:20:16.996 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:20:16 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "c"} : dispatch 2024-08-31T04:20:17.132 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:17.131+0000 7fbd44400640 1 -- 172.21.15.50:0/1696522097 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fbd1c005580 con 0x7fbd3c103900 2024-08-31T04:20:17.133 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:17.132+0000 7fbd3a000640 1 -- 172.21.15.50:0/1696522097 <== mon.2 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+6397 (secure 0 0 0) 0x7fbd300d0770 con 0x7fbd3c103900 2024-08-31T04:20:17.134 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-08-31T04:20:17.134 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":8,"btime":"2024-08-31T04:20:16:382376+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14622,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/1565557530","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":1565557530},{"type":"v1","addr":"172.21.15.50:6835","nonce":1565557530}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14634,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6837/2660185946","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6836","nonce":2660185946},{"type":"v1","addr":"172.21.15.50:6837","nonce":2660185946}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24590,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6833/4283603962","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6832","nonce":4283603962},{"type":"v1","addr":"172.21.15.133:6833","nonce":4283603962}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24601,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6833/1237129793","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":1237129793},{"type":"v1","addr":"172.21.15.177:6833","nonce":1237129793}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24626,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6835/3637799701","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":3637799701},{"type":"v1","addr":"172.21.15.133:6835","nonce":3637799701}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24640,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6835/599392457","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6834","nonce":599392457},{"type":"v1","addr":"172.21.15.177:6835","nonce":599392457}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24652,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6837/2159859285","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6836","nonce":2159859285},{"type":"v1","addr":"172.21.15.177:6837","nonce":2159859285}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[]} 2024-08-31T04:20:17.134 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 8 2024-08-31T04:20:17.136 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:17.135+0000 7fbd44400640 1 -- 172.21.15.50:0/1696522097 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fbd240b4b30 msgr2=0x7fbd240b7040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:20:17.137 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:17.135+0000 7fbd44400640 1 --2- 172.21.15.50:0/1696522097 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fbd240b4b30 0x7fbd240b7040 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fbd3c1062d0 tx=0x7fbd2800b390 comp rx=0 tx=0).stop 2024-08-31T04:20:17.137 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:17.135+0000 7fbd44400640 1 -- 172.21.15.50:0/1696522097 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbd3c103900 msgr2=0x7fbd3c0754b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:20:17.137 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:17.135+0000 7fbd44400640 1 --2- 172.21.15.50:0/1696522097 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbd3c103900 0x7fbd3c0754b0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fbd30005940 tx=0x7fbd30004270 comp rx=0 tx=0).stop 2024-08-31T04:20:17.137 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:17.135+0000 7fbd44400640 1 -- 172.21.15.50:0/1696522097 shutdown_connections 2024-08-31T04:20:17.137 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:17.135+0000 7fbd44400640 1 --2- 172.21.15.50:0/1696522097 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fbd240b4b30 0x7fbd240b7040 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:20:17.137 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:17.135+0000 7fbd44400640 1 --2- 172.21.15.50:0/1696522097 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbd3c109b90 0x7fbd3c075f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:20:17.137 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:17.135+0000 7fbd44400640 1 --2- 172.21.15.50:0/1696522097 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbd3c109240 0x7fbd3c0759f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:20:17.137 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:17.135+0000 7fbd44400640 1 --2- 172.21.15.50:0/1696522097 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbd3c103900 0x7fbd3c0754b0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:20:17.137 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:17.135+0000 7fbd44400640 1 -- 172.21.15.50:0/1696522097 >> 172.21.15.50:0/1696522097 conn(0x7fbd3c07b5f0 msgr2=0x7fbd3c1072d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:20:17.137 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:17.135+0000 7fbd44400640 1 -- 172.21.15.50:0/1696522097 shutdown_connections 2024-08-31T04:20:17.137 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:17.135+0000 7fbd44400640 1 -- 172.21.15.50:0/1696522097 wait complete. 2024-08-31T04:20:17.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:20:17 smithi050 ceph-mon[17259]: Deploying daemon mds.h on smithi133 2024-08-31T04:20:17.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:20:17 smithi050 ceph-mon[17259]: pgmap v279: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T04:20:17.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:20:17 smithi050 ceph-mon[17259]: from='client.? 172.21.15.50:0/1696522097' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T04:20:17.742 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:20:17 smithi133 ceph-mon[22177]: Deploying daemon mds.h on smithi133 2024-08-31T04:20:17.742 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:20:17 smithi133 ceph-mon[22177]: pgmap v279: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T04:20:17.742 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:20:17 smithi133 ceph-mon[22177]: from='client.? 172.21.15.50:0/1696522097' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T04:20:17.996 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:20:17 smithi177 ceph-mon[22025]: Deploying daemon mds.h on smithi133 2024-08-31T04:20:17.996 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:20:17 smithi177 ceph-mon[22025]: pgmap v279: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T04:20:17.996 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:20:17 smithi177 ceph-mon[22025]: from='client.? 172.21.15.50:0/1696522097' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T04:20:18.293 INFO:journalctl@ceph.mds.h.smithi133.stdout:Aug 31 04:20:18 smithi133 systemd[1]: Started Ceph mds.h for 058d9fc6-674f-11ef-bcd4-c7b262605968. 2024-08-31T04:20:19.450 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:20:19 smithi050 ceph-mon[17259]: pgmap v280: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T04:20:19.450 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:20:19 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:20:19.450 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:20:19 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:20:19.450 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:20:19 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:20:19.450 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:20:19 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-31T04:20:19.450 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:20:19 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-31T04:20:19.450 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:20:19 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:20:19.451 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:20:19 smithi050 ceph-mon[17259]: Deploying daemon mds.i on smithi177 2024-08-31T04:20:19.451 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:20:19 smithi050 ceph-mon[17259]: mds.? [v2:172.21.15.133:6836/4014853202,v1:172.21.15.133:6837/4014853202] up:boot 2024-08-31T04:20:19.451 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:20:19 smithi050 ceph-mon[17259]: fsmap 8 up:standby 2024-08-31T04:20:19.451 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:20:19 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "h"} : dispatch 2024-08-31T04:20:19.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:20:19 smithi177 ceph-mon[22025]: pgmap v280: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T04:20:19.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:20:19 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:20:19.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:20:19 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:20:19.497 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:20:19 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:20:19.497 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:20:19 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-31T04:20:19.497 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:20:19 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-31T04:20:19.497 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:20:19 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:20:19.497 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:20:19 smithi177 ceph-mon[22025]: Deploying daemon mds.i on smithi177 2024-08-31T04:20:19.497 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:20:19 smithi177 ceph-mon[22025]: mds.? [v2:172.21.15.133:6836/4014853202,v1:172.21.15.133:6837/4014853202] up:boot 2024-08-31T04:20:19.497 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:20:19 smithi177 ceph-mon[22025]: fsmap 8 up:standby 2024-08-31T04:20:19.497 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:20:19 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "h"} : dispatch 2024-08-31T04:20:19.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:20:19 smithi133 ceph-mon[22177]: pgmap v280: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T04:20:19.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:20:19 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:20:19.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:20:19 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:20:19.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:20:19 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:20:19.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:20:19 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-31T04:20:19.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:20:19 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-31T04:20:19.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:20:19 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:20:19.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:20:19 smithi133 ceph-mon[22177]: Deploying daemon mds.i on smithi177 2024-08-31T04:20:19.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:20:19 smithi133 ceph-mon[22177]: mds.? [v2:172.21.15.133:6836/4014853202,v1:172.21.15.133:6837/4014853202] up:boot 2024-08-31T04:20:19.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:20:19 smithi133 ceph-mon[22177]: fsmap 8 up:standby 2024-08-31T04:20:19.544 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:20:19 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "h"} : dispatch 2024-08-31T04:20:19.946 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 058d9fc6-674f-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-31T04:20:20.336 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:20:20.420 INFO:journalctl@ceph.mds.i.smithi177.stdout:Aug 31 04:20:20 smithi177 systemd[1]: Starting Ceph mds.i for 058d9fc6-674f-11ef-bcd4-c7b262605968... 2024-08-31T04:20:20.678 INFO:journalctl@ceph.mds.i.smithi177.stdout:Aug 31 04:20:20 smithi177 podman[52512]: 2024-08-31 04:20:20.321748767 +0000 UTC m=+0.015592904 image pull 79f4cde5e36911a5dca995eeb98098c2c8aae81dd52a088ef2c867bc3363bad0 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61 2024-08-31T04:20:20.679 INFO:journalctl@ceph.mds.i.smithi177.stdout:Aug 31 04:20:20 smithi177 podman[52512]: 2024-08-31 04:20:20.441850508 +0000 UTC m=+0.135694647 container create 68b1404a620127c35f37f80a7ec18ac9c631bc20d468e38606ddb72eb9114191 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-mds-i, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, io.buildah.version=1.37.1, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, ceph=True, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS) 2024-08-31T04:20:20.679 INFO:journalctl@ceph.mds.i.smithi177.stdout:Aug 31 04:20:20 smithi177 podman[52512]: 2024-08-31 04:20:20.678050057 +0000 UTC m=+0.371894205 container init 68b1404a620127c35f37f80a7ec18ac9c631bc20d468e38606ddb72eb9114191 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-mds-i, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, io.buildah.version=1.37.1, ceph=True, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-08-31T04:20:20.976 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:20.973+0000 7f9891000640 1 -- 172.21.15.50:0/784534104 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f988c0754f0 msgr2=0x7f988c075900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:20:20.976 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:20.973+0000 7f9891000640 1 --2- 172.21.15.50:0/784534104 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f988c0754f0 0x7f988c075900 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f987c009860 tx=0x7f987c02a340 comp rx=0 tx=0).stop 2024-08-31T04:20:20.976 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:20.974+0000 7f9891000640 1 -- 172.21.15.50:0/784534104 shutdown_connections 2024-08-31T04:20:20.976 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:20.974+0000 7f9891000640 1 --2- 172.21.15.50:0/784534104 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f988c075e40 0x7f988c10f7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:20:20.976 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:20.974+0000 7f9891000640 1 --2- 172.21.15.50:0/784534104 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f988c10fcf0 0x7f988c112110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:20:20.976 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:20.974+0000 7f9891000640 1 --2- 172.21.15.50:0/784534104 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f988c0754f0 0x7f988c075900 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:20:20.976 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:20.974+0000 7f9891000640 1 -- 172.21.15.50:0/784534104 >> 172.21.15.50:0/784534104 conn(0x7f988c0ff180 msgr2=0x7f988c1015d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:20:20.976 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:20.974+0000 7f9891000640 1 -- 172.21.15.50:0/784534104 shutdown_connections 2024-08-31T04:20:20.976 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:20.974+0000 7f9891000640 1 -- 172.21.15.50:0/784534104 wait complete. 2024-08-31T04:20:20.977 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:20.975+0000 7f9891000640 1 Processor -- start 2024-08-31T04:20:20.977 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:20.975+0000 7f9891000640 1 -- start start 2024-08-31T04:20:20.977 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:20.976+0000 7f9891000640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f988c0754f0 0x7f988c19c2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:20:20.977 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:20.976+0000 7f9891000640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f988c075e40 0x7f988c19c850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:20:20.977 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:20.976+0000 7f9891000640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f988c10fcf0 0x7f988c1a1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:20:20.978 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:20.976+0000 7f9891000640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f988c115860 con 0x7f988c10fcf0 2024-08-31T04:20:20.978 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:20.976+0000 7f9891000640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f988c1156e0 con 0x7f988c0754f0 2024-08-31T04:20:20.978 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:20.976+0000 7f9891000640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f988c1159e0 con 0x7f988c075e40 2024-08-31T04:20:20.978 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:20.976+0000 7f9883e00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f988c075e40 0x7f988c19c850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:20:20.978 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:20.976+0000 7f988b400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f988c0754f0 0x7f988c19c2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:20:20.978 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:20.976+0000 7f988be00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f988c10fcf0 0x7f988c1a1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:20:20.978 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:20.976+0000 7f9883e00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f988c075e40 0x7f988c19c850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.50:54944/0 (socket says 172.21.15.50:54944) 2024-08-31T04:20:20.978 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:20.976+0000 7f9883e00640 1 -- 172.21.15.50:0/1916156223 learned_addr learned my addr 172.21.15.50:0/1916156223 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:20:20.978 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:20.976+0000 7f988b400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f988c0754f0 0x7f988c19c2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.50:35284/0 (socket says 172.21.15.50:35284) 2024-08-31T04:20:20.979 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:20.976+0000 7f9883e00640 1 -- 172.21.15.50:0/1916156223 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f988c0754f0 msgr2=0x7f988c19c2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:20:20.979 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:20.976+0000 7f9883e00640 1 --2- 172.21.15.50:0/1916156223 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f988c0754f0 0x7f988c19c2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:20:20.979 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:20.976+0000 7f9883e00640 1 -- 172.21.15.50:0/1916156223 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f988c10fcf0 msgr2=0x7f988c1a1af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:20:20.979 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:20.976+0000 7f9883e00640 1 --2- 172.21.15.50:0/1916156223 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f988c10fcf0 0x7f988c1a1af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:20:20.979 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:20.976+0000 7f9883e00640 1 -- 172.21.15.50:0/1916156223 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f988c1a2220 con 0x7f988c075e40 2024-08-31T04:20:20.979 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:20.977+0000 7f9883e00640 1 --2- 172.21.15.50:0/1916156223 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f988c075e40 0x7f988c19c850 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f987400e9f0 tx=0x7f987400eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:20:20.979 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:20.977+0000 7f9888c00640 1 -- 172.21.15.50:0/1916156223 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f987400ccc0 con 0x7f988c075e40 2024-08-31T04:20:20.979 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:20.977+0000 7f9891000640 1 -- 172.21.15.50:0/1916156223 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f988c1a2510 con 0x7f988c075e40 2024-08-31T04:20:20.980 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:20.977+0000 7f9888c00640 1 -- 172.21.15.50:0/1916156223 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f98740108e0 con 0x7f988c075e40 2024-08-31T04:20:20.980 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:20.977+0000 7f9888c00640 1 -- 172.21.15.50:0/1916156223 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9874018860 con 0x7f988c075e40 2024-08-31T04:20:20.980 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:20.977+0000 7f9891000640 1 -- 172.21.15.50:0/1916156223 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f988c1a8c70 con 0x7f988c075e40 2024-08-31T04:20:20.980 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:20.978+0000 7f9891000640 1 -- 172.21.15.50:0/1916156223 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f988c075900 con 0x7f988c075e40 2024-08-31T04:20:20.981 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:20.980+0000 7f9888c00640 1 -- 172.21.15.50:0/1916156223 <== mon.1 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 16) ==== 152577+0+0 (secure 0 0 0) 0x7f9874010430 con 0x7f988c075e40 2024-08-31T04:20:20.983 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:20.982+0000 7f9888c00640 1 --2- 172.21.15.50:0/1916156223 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f98700b4bb0 0x7f98700b70c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:20:20.984 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:20.983+0000 7f9888c00640 1 -- 172.21.15.50:0/1916156223 <== mon.1 v2:172.21.15.177:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 7127+0+0 (secure 0 0 0) 0x7f98740e4f20 con 0x7f988c075e40 2024-08-31T04:20:20.984 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:20.983+0000 7f988b400640 1 --2- 172.21.15.50:0/1916156223 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f98700b4bb0 0x7f98700b70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:20:20.985 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:20.983+0000 7f988b400640 1 --2- 172.21.15.50:0/1916156223 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f98700b4bb0 0x7f98700b70c0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f987c009830 tx=0x7f987c030340 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:20:20.987 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:20.986+0000 7f9888c00640 1 -- 172.21.15.50:0/1916156223 <== mon.1 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f98740abe00 con 0x7f988c075e40 2024-08-31T04:20:20.996 INFO:journalctl@ceph.mds.i.smithi177.stdout:Aug 31 04:20:20 smithi177 podman[52512]: 2024-08-31 04:20:20.680902331 +0000 UTC m=+0.374746467 container start 68b1404a620127c35f37f80a7ec18ac9c631bc20d468e38606ddb72eb9114191 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-mds-i, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.1, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731) 2024-08-31T04:20:20.996 INFO:journalctl@ceph.mds.i.smithi177.stdout:Aug 31 04:20:20 smithi177 ceph-mds[52531]: -- 172.21.15.177:0/3441666299 <== mon.1 v2:172.21.15.177:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5611c9c67860 con 0x5611cde0d600 2024-08-31T04:20:20.996 INFO:journalctl@ceph.mds.i.smithi177.stdout:Aug 31 04:20:20 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-mds-i[52527]: starting mds.i at 2024-08-31T04:20:20.996 INFO:journalctl@ceph.mds.i.smithi177.stdout:Aug 31 04:20:20 smithi177 bash[52512]: 68b1404a620127c35f37f80a7ec18ac9c631bc20d468e38606ddb72eb9114191 2024-08-31T04:20:20.996 INFO:journalctl@ceph.mds.i.smithi177.stdout:Aug 31 04:20:20 smithi177 systemd[1]: Started Ceph mds.i for 058d9fc6-674f-11ef-bcd4-c7b262605968. 2024-08-31T04:20:21.227 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:21.226+0000 7f9891000640 1 -- 172.21.15.50:0/1916156223 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f988c1a8f10 con 0x7f988c075e40 2024-08-31T04:20:21.228 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:21.227+0000 7f9888c00640 1 -- 172.21.15.50:0/1916156223 <== mon.1 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) ==== 94+0+8055 (secure 0 0 0) 0x7f98740b05c0 con 0x7f988c075e40 2024-08-31T04:20:21.229 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-08-31T04:20:21.229 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":10,"btime":"2024-08-31T04:20:21:146400+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14622,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/1565557530","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":1565557530},{"type":"v1","addr":"172.21.15.50:6835","nonce":1565557530}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14634,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6837/2660185946","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6836","nonce":2660185946},{"type":"v1","addr":"172.21.15.50:6837","nonce":2660185946}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24590,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6833/4283603962","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6832","nonce":4283603962},{"type":"v1","addr":"172.21.15.133:6833","nonce":4283603962}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24601,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6833/1237129793","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":1237129793},{"type":"v1","addr":"172.21.15.177:6833","nonce":1237129793}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24626,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6835/3637799701","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":3637799701},{"type":"v1","addr":"172.21.15.133:6835","nonce":3637799701}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24640,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6835/599392457","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6834","nonce":599392457},{"type":"v1","addr":"172.21.15.177:6835","nonce":599392457}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24652,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6837/2159859285","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6836","nonce":2159859285},{"type":"v1","addr":"172.21.15.177:6837","nonce":2159859285}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24656,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6837/4014853202","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6836","nonce":4014853202},{"type":"v1","addr":"172.21.15.133:6837","nonce":4014853202}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24667,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6839/3600081752","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6838","nonce":3600081752},{"type":"v1","addr":"172.21.15.177:6839","nonce":3600081752}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[]} 2024-08-31T04:20:21.229 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 10 2024-08-31T04:20:21.233 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:21.231+0000 7f9891000640 1 -- 172.21.15.50:0/1916156223 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f98700b4bb0 msgr2=0x7f98700b70c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:20:21.233 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:21.231+0000 7f9891000640 1 --2- 172.21.15.50:0/1916156223 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f98700b4bb0 0x7f98700b70c0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f987c009830 tx=0x7f987c030340 comp rx=0 tx=0).stop 2024-08-31T04:20:21.233 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:21.231+0000 7f9891000640 1 -- 172.21.15.50:0/1916156223 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f988c075e40 msgr2=0x7f988c19c850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:20:21.233 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:21.231+0000 7f9891000640 1 --2- 172.21.15.50:0/1916156223 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f988c075e40 0x7f988c19c850 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f987400e9f0 tx=0x7f987400eeb0 comp rx=0 tx=0).stop 2024-08-31T04:20:21.233 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:21.231+0000 7f9891000640 1 -- 172.21.15.50:0/1916156223 shutdown_connections 2024-08-31T04:20:21.233 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:21.231+0000 7f9891000640 1 --2- 172.21.15.50:0/1916156223 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f98700b4bb0 0x7f98700b70c0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:20:21.233 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:21.231+0000 7f9891000640 1 --2- 172.21.15.50:0/1916156223 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f988c075e40 0x7f988c19c850 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:20:21.233 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:21.231+0000 7f9891000640 1 --2- 172.21.15.50:0/1916156223 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f988c10fcf0 0x7f988c1a1af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:20:21.233 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:21.231+0000 7f9891000640 1 --2- 172.21.15.50:0/1916156223 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f988c0754f0 0x7f988c19c2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:20:21.233 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:21.231+0000 7f9891000640 1 -- 172.21.15.50:0/1916156223 >> 172.21.15.50:0/1916156223 conn(0x7f988c0ff180 msgr2=0x7f988c1098d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:20:21.234 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:21.231+0000 7f9891000640 1 -- 172.21.15.50:0/1916156223 shutdown_connections 2024-08-31T04:20:21.234 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:21.232+0000 7f9891000640 1 -- 172.21.15.50:0/1916156223 wait complete. 2024-08-31T04:20:21.450 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:20:21 smithi050 ceph-mon[17259]: pgmap v281: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T04:20:21.450 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:20:21 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:20:21.450 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:20:21 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:20:21.450 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:20:21 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:20:21.450 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:20:21 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-31T04:20:21.450 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:20:21 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-31T04:20:21.450 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:20:21 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:20:21.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:20:21 smithi177 ceph-mon[22025]: pgmap v281: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T04:20:21.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:20:21 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:20:21.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:20:21 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:20:21.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:20:21 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:20:21.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:20:21 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-31T04:20:21.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:20:21 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-31T04:20:21.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:20:21 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:20:21.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:20:21 smithi133 ceph-mon[22177]: pgmap v281: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T04:20:21.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:20:21 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:20:21.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:20:21 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:20:21.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:20:21 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:20:21.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:20:21 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-31T04:20:21.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:20:21 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-31T04:20:21.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:20:21 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:20:22.324 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:20:22 smithi050 ceph-mon[17259]: Deploying daemon mds.g on smithi050 2024-08-31T04:20:22.324 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:20:22 smithi050 ceph-mon[17259]: mds.? [v2:172.21.15.177:6838/3600081752,v1:172.21.15.177:6839/3600081752] up:boot 2024-08-31T04:20:22.325 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:20:22 smithi050 ceph-mon[17259]: fsmap 9 up:standby 2024-08-31T04:20:22.325 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:20:22 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "i"} : dispatch 2024-08-31T04:20:22.325 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:20:22 smithi050 ceph-mon[17259]: from='client.? 172.21.15.50:0/1916156223' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T04:20:22.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:20:22 smithi177 ceph-mon[22025]: Deploying daemon mds.g on smithi050 2024-08-31T04:20:22.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:20:22 smithi177 ceph-mon[22025]: mds.? [v2:172.21.15.177:6838/3600081752,v1:172.21.15.177:6839/3600081752] up:boot 2024-08-31T04:20:22.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:20:22 smithi177 ceph-mon[22025]: fsmap 9 up:standby 2024-08-31T04:20:22.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:20:22 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "i"} : dispatch 2024-08-31T04:20:22.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:20:22 smithi177 ceph-mon[22025]: from='client.? 172.21.15.50:0/1916156223' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T04:20:22.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:20:22 smithi133 ceph-mon[22177]: Deploying daemon mds.g on smithi050 2024-08-31T04:20:22.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:20:22 smithi133 ceph-mon[22177]: mds.? [v2:172.21.15.177:6838/3600081752,v1:172.21.15.177:6839/3600081752] up:boot 2024-08-31T04:20:22.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:20:22 smithi133 ceph-mon[22177]: fsmap 9 up:standby 2024-08-31T04:20:22.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:20:22 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "i"} : dispatch 2024-08-31T04:20:22.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:20:22 smithi133 ceph-mon[22177]: from='client.? 172.21.15.50:0/1916156223' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T04:20:23.306 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:20:23 smithi050 ceph-mon[17259]: pgmap v282: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T04:20:23.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:20:23 smithi177 ceph-mon[22025]: pgmap v282: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T04:20:23.542 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:20:23 smithi133 ceph-mon[22177]: pgmap v282: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T04:20:24.077 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 058d9fc6-674f-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-31T04:20:24.603 INFO:journalctl@ceph.mds.g.smithi050.stdout:Aug 31 04:20:24 smithi050 podman[59111]: 2024-08-31 04:20:24.366036419 +0000 UTC m=+0.178127779 container create 73defbf510949c872fae6cf7a881eb955c5a6bb34f403bd1a015c7334f2c5216 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-mds-g, GIT_CLEAN=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, io.buildah.version=1.37.1, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611) 2024-08-31T04:20:24.604 INFO:journalctl@ceph.mds.g.smithi050.stdout:Aug 31 04:20:24 smithi050 podman[59111]: 2024-08-31 04:20:24.602486599 +0000 UTC m=+0.414577952 container init 73defbf510949c872fae6cf7a881eb955c5a6bb34f403bd1a015c7334f2c5216 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-mds-g, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_CLEAN=True, io.buildah.version=1.37.1, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, ceph=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS) 2024-08-31T04:20:24.831 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:20:24.950 INFO:journalctl@ceph.mds.g.smithi050.stdout:Aug 31 04:20:24 smithi050 podman[59111]: 2024-08-31 04:20:24.609195937 +0000 UTC m=+0.421287290 container start 73defbf510949c872fae6cf7a881eb955c5a6bb34f403bd1a015c7334f2c5216 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-mds-g, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, ceph=True, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, io.buildah.version=1.37.1, org.label-schema.vendor=CentOS) 2024-08-31T04:20:24.950 INFO:journalctl@ceph.mds.g.smithi050.stdout:Aug 31 04:20:24 smithi050 bash[59111]: 73defbf510949c872fae6cf7a881eb955c5a6bb34f403bd1a015c7334f2c5216 2024-08-31T04:20:24.950 INFO:journalctl@ceph.mds.g.smithi050.stdout:Aug 31 04:20:24 smithi050 ceph-mds[59155]: -- 172.21.15.50:0/3137436910 <== mon.0 v2:172.21.15.50:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55e20dae1c20 con 0x55e211c87600 2024-08-31T04:20:24.950 INFO:journalctl@ceph.mds.g.smithi050.stdout:Aug 31 04:20:24 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-mds-g[59136]: starting mds.g at 2024-08-31T04:20:24.950 INFO:journalctl@ceph.mds.g.smithi050.stdout:Aug 31 04:20:24 smithi050 systemd[1]: Started Ceph mds.g for 058d9fc6-674f-11ef-bcd4-c7b262605968. 2024-08-31T04:20:25.283 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:20:25 smithi050 ceph-mon[17259]: pgmap v283: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T04:20:25.283 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:20:25 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:20:25.283 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:20:25 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:20:25.283 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:20:25 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:20:25.283 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:20:25 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-31T04:20:25.283 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:20:25 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-31T04:20:25.283 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:20:25 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:20:25.468 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:25.466+0000 7febf1200640 1 -- 172.21.15.50:0/1359817403 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7febec1050c0 msgr2=0x7febec10d610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:20:25.468 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:25.466+0000 7febf1200640 1 --2- 172.21.15.50:0/1359817403 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7febec1050c0 0x7febec10d610 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7febd8009900 tx=0x7febd802a3f0 comp rx=0 tx=0).stop 2024-08-31T04:20:25.468 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:25.467+0000 7febf1200640 1 -- 172.21.15.50:0/1359817403 shutdown_connections 2024-08-31T04:20:25.469 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:25.467+0000 7febf1200640 1 --2- 172.21.15.50:0/1359817403 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7febec10dbd0 0x7febec1100c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:20:25.469 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:25.467+0000 7febf1200640 1 --2- 172.21.15.50:0/1359817403 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7febec1050c0 0x7febec10d610 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:20:25.469 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:25.467+0000 7febf1200640 1 --2- 172.21.15.50:0/1359817403 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7febec104770 0x7febec104b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:20:25.469 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:25.467+0000 7febf1200640 1 -- 172.21.15.50:0/1359817403 >> 172.21.15.50:0/1359817403 conn(0x7febec0794e0 msgr2=0x7febec0798f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:20:25.469 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:25.467+0000 7febf1200640 1 -- 172.21.15.50:0/1359817403 shutdown_connections 2024-08-31T04:20:25.469 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:25.467+0000 7febf1200640 1 -- 172.21.15.50:0/1359817403 wait complete. 2024-08-31T04:20:25.470 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:25.468+0000 7febf1200640 1 Processor -- start 2024-08-31T04:20:25.470 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:25.468+0000 7febf1200640 1 -- start start 2024-08-31T04:20:25.470 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:25.468+0000 7febf1200640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7febec104770 0x7febec1024b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:20:25.470 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:25.468+0000 7febf1200640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7febec1050c0 0x7febec1029f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:20:25.470 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:25.469+0000 7febf1200640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7febec10dbd0 0x7febec102f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:20:25.470 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:25.469+0000 7febf1200640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7febec113840 con 0x7febec1050c0 2024-08-31T04:20:25.470 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:25.469+0000 7febf1200640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7febec1136c0 con 0x7febec10dbd0 2024-08-31T04:20:25.470 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:25.469+0000 7febf1200640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7febec1139c0 con 0x7febec104770 2024-08-31T04:20:25.471 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:25.469+0000 7febe9400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7febec1050c0 0x7febec1029f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:20:25.471 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:25.469+0000 7febea800640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7febec10dbd0 0x7febec102f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:20:25.471 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:25.469+0000 7febe9400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7febec1050c0 0x7febec1029f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:56850/0 (socket says 172.21.15.50:56850) 2024-08-31T04:20:25.471 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:25.469+0000 7febea800640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7febec10dbd0 0x7febec102f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.50:42424/0 (socket says 172.21.15.50:42424) 2024-08-31T04:20:25.471 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:25.469+0000 7febe9400640 1 -- 172.21.15.50:0/830209473 learned_addr learned my addr 172.21.15.50:0/830209473 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:20:25.471 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:25.469+0000 7febe9e00640 1 --2- 172.21.15.50:0/830209473 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7febec104770 0x7febec1024b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:20:25.472 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:25.469+0000 7febea800640 1 -- 172.21.15.50:0/830209473 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7febec104770 msgr2=0x7febec1024b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:20:25.472 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:25.469+0000 7febea800640 1 --2- 172.21.15.50:0/830209473 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7febec104770 0x7febec1024b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:20:25.472 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:25.469+0000 7febea800640 1 -- 172.21.15.50:0/830209473 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7febec1050c0 msgr2=0x7febec1029f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:20:25.472 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:25.469+0000 7febea800640 1 --2- 172.21.15.50:0/830209473 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7febec1050c0 0x7febec1029f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:20:25.472 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:25.469+0000 7febea800640 1 -- 172.21.15.50:0/830209473 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7febec1a84d0 con 0x7febec10dbd0 2024-08-31T04:20:25.472 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:25.470+0000 7febea800640 1 --2- 172.21.15.50:0/830209473 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7febec10dbd0 0x7febec102f30 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7febe4009fd0 tx=0x7febe400ef10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:20:25.472 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:25.470+0000 7febe2a00640 1 -- 172.21.15.50:0/830209473 <== mon.2 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febe400ce20 con 0x7febec10dbd0 2024-08-31T04:20:25.472 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:25.470+0000 7febe2a00640 1 -- 172.21.15.50:0/830209473 <== mon.2 v2:172.21.15.133:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7febe4005020 con 0x7febec10dbd0 2024-08-31T04:20:25.472 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:25.470+0000 7febf1200640 1 -- 172.21.15.50:0/830209473 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7febec1a87c0 con 0x7febec10dbd0 2024-08-31T04:20:25.472 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:25.470+0000 7febe2a00640 1 -- 172.21.15.50:0/830209473 <== mon.2 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febe4010690 con 0x7febec10dbd0 2024-08-31T04:20:25.472 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:25.470+0000 7febf1200640 1 -- 172.21.15.50:0/830209473 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7febec1a8c80 con 0x7febec10dbd0 2024-08-31T04:20:25.473 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:25.471+0000 7febf1200640 1 -- 172.21.15.50:0/830209473 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7febec06bfe0 con 0x7febec10dbd0 2024-08-31T04:20:25.474 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:25.473+0000 7febe2a00640 1 -- 172.21.15.50:0/830209473 <== mon.2 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 16) ==== 152577+0+0 (secure 0 0 0) 0x7febe40054d0 con 0x7febec10dbd0 2024-08-31T04:20:25.476 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:25.475+0000 7febe2a00640 1 --2- 172.21.15.50:0/830209473 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7febd00b4b30 0x7febd00b7040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:20:25.476 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:25.475+0000 7febe2a00640 1 -- 172.21.15.50:0/830209473 <== mon.2 v2:172.21.15.133:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 7127+0+0 (secure 0 0 0) 0x7febe40e5430 con 0x7febec10dbd0 2024-08-31T04:20:25.476 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:25.475+0000 7febe9e00640 1 --2- 172.21.15.50:0/830209473 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7febd00b4b30 0x7febd00b7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:20:25.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:25.476+0000 7febe9e00640 1 --2- 172.21.15.50:0/830209473 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7febd00b4b30 0x7febd00b7040 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7febec103f00 tx=0x7febdc005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:20:25.478 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:25.477+0000 7febe2a00640 1 -- 172.21.15.50:0/830209473 <== mon.2 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7febe40ac960 con 0x7febec10dbd0 2024-08-31T04:20:25.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:20:25 smithi177 ceph-mon[22025]: pgmap v283: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T04:20:25.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:20:25 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:20:25.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:20:25 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:20:25.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:20:25 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:20:25.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:20:25 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-31T04:20:25.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:20:25 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-31T04:20:25.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:20:25 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:20:25.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:20:25 smithi133 ceph-mon[22177]: pgmap v283: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T04:20:25.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:20:25 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:20:25.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:20:25 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:20:25.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:20:25 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:20:25.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:20:25 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-31T04:20:25.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:20:25 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-31T04:20:25.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:20:25 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:20:25.717 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:25.715+0000 7febf1200640 1 -- 172.21.15.50:0/830209473 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7febec104b80 con 0x7febec10dbd0 2024-08-31T04:20:25.718 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:25.717+0000 7febe2a00640 1 -- 172.21.15.50:0/830209473 <== mon.2 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 11 v11) ==== 94+0+8881 (secure 0 0 0) 0x7febec104b80 con 0x7febec10dbd0 2024-08-31T04:20:25.718 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-08-31T04:20:25.718 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":11,"btime":"2024-08-31T04:20:25:165051+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14622,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/1565557530","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":1565557530},{"type":"v1","addr":"172.21.15.50:6835","nonce":1565557530}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14634,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6837/2660185946","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6836","nonce":2660185946},{"type":"v1","addr":"172.21.15.50:6837","nonce":2660185946}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14676,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6839/2105228685","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6838","nonce":2105228685},{"type":"v1","addr":"172.21.15.50:6839","nonce":2105228685}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":24590,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6833/4283603962","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6832","nonce":4283603962},{"type":"v1","addr":"172.21.15.133:6833","nonce":4283603962}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24601,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6833/1237129793","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":1237129793},{"type":"v1","addr":"172.21.15.177:6833","nonce":1237129793}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24626,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6835/3637799701","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":3637799701},{"type":"v1","addr":"172.21.15.133:6835","nonce":3637799701}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24640,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6835/599392457","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6834","nonce":599392457},{"type":"v1","addr":"172.21.15.177:6835","nonce":599392457}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24652,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6837/2159859285","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6836","nonce":2159859285},{"type":"v1","addr":"172.21.15.177:6837","nonce":2159859285}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24656,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6837/4014853202","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6836","nonce":4014853202},{"type":"v1","addr":"172.21.15.133:6837","nonce":4014853202}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24667,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6839/3600081752","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6838","nonce":3600081752},{"type":"v1","addr":"172.21.15.177:6839","nonce":3600081752}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[]} 2024-08-31T04:20:25.718 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 11 2024-08-31T04:20:25.721 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:25.719+0000 7febf1200640 1 -- 172.21.15.50:0/830209473 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7febd00b4b30 msgr2=0x7febd00b7040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:20:25.721 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:25.719+0000 7febf1200640 1 --2- 172.21.15.50:0/830209473 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7febd00b4b30 0x7febd00b7040 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7febec103f00 tx=0x7febdc005f90 comp rx=0 tx=0).stop 2024-08-31T04:20:25.721 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:25.719+0000 7febf1200640 1 -- 172.21.15.50:0/830209473 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7febec10dbd0 msgr2=0x7febec102f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:20:25.721 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:25.719+0000 7febf1200640 1 --2- 172.21.15.50:0/830209473 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7febec10dbd0 0x7febec102f30 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7febe4009fd0 tx=0x7febe400ef10 comp rx=0 tx=0).stop 2024-08-31T04:20:25.721 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:25.719+0000 7febf1200640 1 -- 172.21.15.50:0/830209473 shutdown_connections 2024-08-31T04:20:25.721 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:25.719+0000 7febf1200640 1 --2- 172.21.15.50:0/830209473 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7febd00b4b30 0x7febd00b7040 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:20:25.721 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:25.719+0000 7febf1200640 1 --2- 172.21.15.50:0/830209473 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7febec10dbd0 0x7febec102f30 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:20:25.721 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:25.719+0000 7febf1200640 1 --2- 172.21.15.50:0/830209473 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7febec1050c0 0x7febec1029f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:20:25.721 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:25.719+0000 7febf1200640 1 --2- 172.21.15.50:0/830209473 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7febec104770 0x7febec1024b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:20:25.721 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:25.719+0000 7febf1200640 1 -- 172.21.15.50:0/830209473 >> 172.21.15.50:0/830209473 conn(0x7febec0794e0 msgr2=0x7febec100530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:20:25.721 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:25.719+0000 7febf1200640 1 -- 172.21.15.50:0/830209473 shutdown_connections 2024-08-31T04:20:25.721 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:25.719+0000 7febf1200640 1 -- 172.21.15.50:0/830209473 wait complete. 2024-08-31T04:20:26.246 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:20:26 smithi177 ceph-mon[22025]: Deploying daemon mds.a on smithi050 2024-08-31T04:20:26.246 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:20:26 smithi177 ceph-mon[22025]: mds.? [v2:172.21.15.50:6838/2105228685,v1:172.21.15.50:6839/2105228685] up:boot 2024-08-31T04:20:26.246 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:20:26 smithi177 ceph-mon[22025]: fsmap 10 up:standby 2024-08-31T04:20:26.246 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:20:26 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "g"} : dispatch 2024-08-31T04:20:26.246 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:20:26 smithi177 ceph-mon[22025]: from='client.? 172.21.15.50:0/830209473' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T04:20:26.450 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:20:26 smithi050 ceph-mon[17259]: Deploying daemon mds.a on smithi050 2024-08-31T04:20:26.450 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:20:26 smithi050 ceph-mon[17259]: mds.? [v2:172.21.15.50:6838/2105228685,v1:172.21.15.50:6839/2105228685] up:boot 2024-08-31T04:20:26.450 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:20:26 smithi050 ceph-mon[17259]: fsmap 10 up:standby 2024-08-31T04:20:26.450 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:20:26 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "g"} : dispatch 2024-08-31T04:20:26.450 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:20:26 smithi050 ceph-mon[17259]: from='client.? 172.21.15.50:0/830209473' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T04:20:26.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:20:26 smithi133 ceph-mon[22177]: Deploying daemon mds.a on smithi050 2024-08-31T04:20:26.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:20:26 smithi133 ceph-mon[22177]: mds.? [v2:172.21.15.50:6838/2105228685,v1:172.21.15.50:6839/2105228685] up:boot 2024-08-31T04:20:26.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:20:26 smithi133 ceph-mon[22177]: fsmap 10 up:standby 2024-08-31T04:20:26.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:20:26 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "g"} : dispatch 2024-08-31T04:20:26.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:20:26 smithi133 ceph-mon[22177]: from='client.? 172.21.15.50:0/830209473' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T04:20:27.450 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:20:27 smithi050 ceph-mon[17259]: pgmap v284: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T04:20:27.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:20:27 smithi177 ceph-mon[22025]: pgmap v284: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T04:20:27.542 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:20:27 smithi133 ceph-mon[22177]: pgmap v284: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T04:20:28.200 INFO:journalctl@ceph.mds.a.smithi050.stdout:Aug 31 04:20:27 smithi050 systemd[1]: Starting Ceph mds.a for 058d9fc6-674f-11ef-bcd4-c7b262605968... 2024-08-31T04:20:28.494 INFO:journalctl@ceph.mds.a.smithi050.stdout:Aug 31 04:20:28 smithi050 podman[59502]: 2024-08-31 04:20:28.145016825 +0000 UTC m=+0.027656939 image pull 79f4cde5e36911a5dca995eeb98098c2c8aae81dd52a088ef2c867bc3363bad0 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61 2024-08-31T04:20:28.494 INFO:journalctl@ceph.mds.a.smithi050.stdout:Aug 31 04:20:28 smithi050 podman[59502]: 2024-08-31 04:20:28.26699564 +0000 UTC m=+0.149635730 container create 686fff29296fcc60aaba1579748b176321682db4f8bb0747eb6315b63a0bab7c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-mds-a, io.buildah.version=1.37.1, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_CLEAN=True, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image) 2024-08-31T04:20:28.494 INFO:journalctl@ceph.mds.a.smithi050.stdout:Aug 31 04:20:28 smithi050 podman[59502]: 2024-08-31 04:20:28.492937876 +0000 UTC m=+0.375577990 container init 686fff29296fcc60aaba1579748b176321682db4f8bb0747eb6315b63a0bab7c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-mds-a, org.label-schema.vendor=CentOS, ceph=True, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.1, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731) 2024-08-31T04:20:28.537 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 058d9fc6-674f-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-31T04:20:28.938 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:20:28.950 INFO:journalctl@ceph.mds.a.smithi050.stdout:Aug 31 04:20:28 smithi050 podman[59502]: 2024-08-31 04:20:28.499186665 +0000 UTC m=+0.381826758 container start 686fff29296fcc60aaba1579748b176321682db4f8bb0747eb6315b63a0bab7c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-mds-a, io.buildah.version=1.37.1, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.build-date=20240731, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-08-31T04:20:28.950 INFO:journalctl@ceph.mds.a.smithi050.stdout:Aug 31 04:20:28 smithi050 bash[59502]: 686fff29296fcc60aaba1579748b176321682db4f8bb0747eb6315b63a0bab7c 2024-08-31T04:20:28.950 INFO:journalctl@ceph.mds.a.smithi050.stdout:Aug 31 04:20:28 smithi050 systemd[1]: Started Ceph mds.a for 058d9fc6-674f-11ef-bcd4-c7b262605968. 2024-08-31T04:20:28.950 INFO:journalctl@ceph.mds.a.smithi050.stdout:Aug 31 04:20:28 smithi050 ceph-mds[59521]: -- 172.21.15.50:0/2178757643 <== mon.0 v2:172.21.15.50:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55c238b59860 con 0x55c23ccff180 2024-08-31T04:20:28.950 INFO:journalctl@ceph.mds.a.smithi050.stdout:Aug 31 04:20:28 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-mds-a[59517]: starting mds.a at 2024-08-31T04:20:29.415 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:20:29 smithi050 ceph-mon[17259]: pgmap v285: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T04:20:29.415 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:20:29 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:20:29.415 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:20:29 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:20:29.415 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:20:29 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:20:29.415 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:20:29 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-31T04:20:29.415 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:20:29 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-31T04:20:29.415 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:20:29 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:20:29.432 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:20:29 smithi133 ceph-mon[22177]: pgmap v285: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T04:20:29.432 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:20:29 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:20:29.432 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:20:29 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:20:29.432 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:20:29 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:20:29.432 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:20:29 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-31T04:20:29.432 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:20:29 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-31T04:20:29.432 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:20:29 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:20:29.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:20:29 smithi177 ceph-mon[22025]: pgmap v285: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T04:20:29.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:20:29 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:20:29.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:20:29 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:20:29.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:20:29 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:20:29.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:20:29 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-31T04:20:29.497 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:20:29 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-31T04:20:29.497 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:20:29 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:20:29.594 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:29.592+0000 7f9db5c00640 1 -- 172.21.15.50:0/3928230132 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9db0105b30 msgr2=0x7f9db0105f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:20:29.594 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:29.592+0000 7f9db5c00640 1 --2- 172.21.15.50:0/3928230132 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9db0105b30 0x7f9db0105f40 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f9da0009ca0 tx=0x7f9da002a8c0 comp rx=0 tx=0).stop 2024-08-31T04:20:29.594 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:29.592+0000 7f9db5c00640 1 -- 172.21.15.50:0/3928230132 shutdown_connections 2024-08-31T04:20:29.594 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:29.592+0000 7f9db5c00640 1 --2- 172.21.15.50:0/3928230132 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9db010bdc0 0x7f9db01125f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:20:29.594 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:29.592+0000 7f9db5c00640 1 --2- 172.21.15.50:0/3928230132 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9db010b470 0x7f9db010b880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:20:29.594 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:29.592+0000 7f9db5c00640 1 --2- 172.21.15.50:0/3928230132 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9db0105b30 0x7f9db0105f40 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:20:29.594 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:29.592+0000 7f9db5c00640 1 -- 172.21.15.50:0/3928230132 >> 172.21.15.50:0/3928230132 conn(0x7f9db0101600 msgr2=0x7f9db0103a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:20:29.594 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:29.592+0000 7f9db5c00640 1 -- 172.21.15.50:0/3928230132 shutdown_connections 2024-08-31T04:20:29.594 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:29.592+0000 7f9db5c00640 1 -- 172.21.15.50:0/3928230132 wait complete. 2024-08-31T04:20:29.595 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:29.593+0000 7f9db5c00640 1 Processor -- start 2024-08-31T04:20:29.595 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:29.593+0000 7f9db5c00640 1 -- start start 2024-08-31T04:20:29.595 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:29.594+0000 7f9db5c00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9db0105b30 0x7f9db019c450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:20:29.596 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:29.594+0000 7f9db5c00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9db010b470 0x7f9db019c9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:20:29.596 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:29.594+0000 7f9db5c00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9db010bdc0 0x7f9db01a1c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:20:29.596 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:29.594+0000 7f9db5c00640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f9db0115a80 con 0x7f9db0105b30 2024-08-31T04:20:29.596 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:29.594+0000 7f9db5c00640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f9db0115900 con 0x7f9db010bdc0 2024-08-31T04:20:29.596 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:29.594+0000 7f9db5c00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f9db0115c00 con 0x7f9db010b470 2024-08-31T04:20:29.596 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:29.594+0000 7f9daea00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9db0105b30 0x7f9db019c450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:20:29.596 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:29.594+0000 7f9daf400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9db010bdc0 0x7f9db01a1c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:20:29.596 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:29.594+0000 7f9daea00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9db0105b30 0x7f9db019c450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:56900/0 (socket says 172.21.15.50:56900) 2024-08-31T04:20:29.596 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:29.594+0000 7f9daea00640 1 -- 172.21.15.50:0/2747237043 learned_addr learned my addr 172.21.15.50:0/2747237043 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:20:29.596 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:29.594+0000 7f9da6000640 1 --2- 172.21.15.50:0/2747237043 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9db010b470 0x7f9db019c9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:20:29.597 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:29.595+0000 7f9daf400640 1 -- 172.21.15.50:0/2747237043 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9db010b470 msgr2=0x7f9db019c9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:20:29.597 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:29.595+0000 7f9daf400640 1 --2- 172.21.15.50:0/2747237043 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9db010b470 0x7f9db019c9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:20:29.597 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:29.595+0000 7f9daf400640 1 -- 172.21.15.50:0/2747237043 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9db0105b30 msgr2=0x7f9db019c450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:20:29.597 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:29.595+0000 7f9daf400640 1 --2- 172.21.15.50:0/2747237043 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9db0105b30 0x7f9db019c450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:20:29.597 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:29.595+0000 7f9daf400640 1 -- 172.21.15.50:0/2747237043 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9db01a23c0 con 0x7f9db010bdc0 2024-08-31T04:20:29.597 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:29.595+0000 7f9da6000640 1 --2- 172.21.15.50:0/2747237043 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9db010b470 0x7f9db019c9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:20:29.598 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:29.595+0000 7f9daf400640 1 --2- 172.21.15.50:0/2747237043 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9db010bdc0 0x7f9db01a1c90 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f9da800e970 tx=0x7f9da800ee30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:20:29.598 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:29.595+0000 7f9da7e00640 1 -- 172.21.15.50:0/2747237043 <== mon.2 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9da800ccc0 con 0x7f9db010bdc0 2024-08-31T04:20:29.598 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:29.595+0000 7f9da7e00640 1 -- 172.21.15.50:0/2747237043 <== mon.2 v2:172.21.15.133:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9da8005020 con 0x7f9db010bdc0 2024-08-31T04:20:29.598 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:29.595+0000 7f9db5c00640 1 -- 172.21.15.50:0/2747237043 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9db01a26b0 con 0x7f9db010bdc0 2024-08-31T04:20:29.598 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:29.595+0000 7f9da7e00640 1 -- 172.21.15.50:0/2747237043 <== mon.2 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9da8004a00 con 0x7f9db010bdc0 2024-08-31T04:20:29.598 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:29.595+0000 7f9db5c00640 1 -- 172.21.15.50:0/2747237043 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9db01a8e10 con 0x7f9db010bdc0 2024-08-31T04:20:29.598 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:29.596+0000 7f9db5c00640 1 -- 172.21.15.50:0/2747237043 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9db0105f40 con 0x7f9db010bdc0 2024-08-31T04:20:29.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:29.599+0000 7f9da7e00640 1 -- 172.21.15.50:0/2747237043 <== mon.2 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 16) ==== 152577+0+0 (secure 0 0 0) 0x7f9da8004ba0 con 0x7f9db010bdc0 2024-08-31T04:20:29.601 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:29.600+0000 7f9da7e00640 1 --2- 172.21.15.50:0/2747237043 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f9d940b4b30 0x7f9d940b7040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:20:29.602 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:29.600+0000 7f9da7e00640 1 -- 172.21.15.50:0/2747237043 <== mon.2 v2:172.21.15.133:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 7127+0+0 (secure 0 0 0) 0x7f9da80e4c20 con 0x7f9db010bdc0 2024-08-31T04:20:29.602 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:29.600+0000 7f9daea00640 1 --2- 172.21.15.50:0/2747237043 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f9d940b4b30 0x7f9d940b7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:20:29.602 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:29.601+0000 7f9daea00640 1 --2- 172.21.15.50:0/2747237043 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f9d940b4b30 0x7f9d940b7040 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f9da0004af0 tx=0x7f9da0009360 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:20:29.603 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:29.602+0000 7f9da7e00640 1 -- 172.21.15.50:0/2747237043 <== mon.2 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f9da80ac150 con 0x7f9db010bdc0 2024-08-31T04:20:29.836 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:29.835+0000 7f9db5c00640 1 -- 172.21.15.50:0/2747237043 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9db019d580 con 0x7f9db010bdc0 2024-08-31T04:20:29.837 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:29.836+0000 7f9da7e00640 1 -- 172.21.15.50:0/2747237043 <== mon.2 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) ==== 94+0+9704 (secure 0 0 0) 0x7f9db019d580 con 0x7f9db010bdc0 2024-08-31T04:20:29.837 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-08-31T04:20:29.837 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":12,"btime":"2024-08-31T04:20:29:181710+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14622,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/1565557530","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":1565557530},{"type":"v1","addr":"172.21.15.50:6835","nonce":1565557530}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14634,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6837/2660185946","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6836","nonce":2660185946},{"type":"v1","addr":"172.21.15.50:6837","nonce":2660185946}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14676,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6839/2105228685","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6838","nonce":2105228685},{"type":"v1","addr":"172.21.15.50:6839","nonce":2105228685}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":24590,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6833/4283603962","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6832","nonce":4283603962},{"type":"v1","addr":"172.21.15.133:6833","nonce":4283603962}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24601,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6833/1237129793","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":1237129793},{"type":"v1","addr":"172.21.15.177:6833","nonce":1237129793}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24626,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6835/3637799701","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":3637799701},{"type":"v1","addr":"172.21.15.133:6835","nonce":3637799701}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24640,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6835/599392457","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6834","nonce":599392457},{"type":"v1","addr":"172.21.15.177:6835","nonce":599392457}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24652,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6837/2159859285","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6836","nonce":2159859285},{"type":"v1","addr":"172.21.15.177:6837","nonce":2159859285}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24656,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6837/4014853202","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6836","nonce":4014853202},{"type":"v1","addr":"172.21.15.133:6837","nonce":4014853202}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24667,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6839/3600081752","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6838","nonce":3600081752},{"type":"v1","addr":"172.21.15.177:6839","nonce":3600081752}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24691,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6841/575209862","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6840","nonce":575209862},{"type":"v1","addr":"172.21.15.50:6841","nonce":575209862}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[]} 2024-08-31T04:20:29.838 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 12 2024-08-31T04:20:29.840 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:29.838+0000 7f9db5c00640 1 -- 172.21.15.50:0/2747237043 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f9d940b4b30 msgr2=0x7f9d940b7040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:20:29.840 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:29.838+0000 7f9db5c00640 1 --2- 172.21.15.50:0/2747237043 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f9d940b4b30 0x7f9d940b7040 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f9da0004af0 tx=0x7f9da0009360 comp rx=0 tx=0).stop 2024-08-31T04:20:29.840 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:29.838+0000 7f9db5c00640 1 -- 172.21.15.50:0/2747237043 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9db010bdc0 msgr2=0x7f9db01a1c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:20:29.840 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:29.838+0000 7f9db5c00640 1 --2- 172.21.15.50:0/2747237043 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9db010bdc0 0x7f9db01a1c90 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f9da800e970 tx=0x7f9da800ee30 comp rx=0 tx=0).stop 2024-08-31T04:20:29.840 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:29.839+0000 7f9db5c00640 1 -- 172.21.15.50:0/2747237043 shutdown_connections 2024-08-31T04:20:29.840 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:29.839+0000 7f9db5c00640 1 --2- 172.21.15.50:0/2747237043 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f9d940b4b30 0x7f9d940b7040 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:20:29.840 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:29.839+0000 7f9db5c00640 1 --2- 172.21.15.50:0/2747237043 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9db010b470 0x7f9db019c9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:20:29.840 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:29.839+0000 7f9db5c00640 1 --2- 172.21.15.50:0/2747237043 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9db010bdc0 0x7f9db01a1c90 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:20:29.840 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:29.839+0000 7f9db5c00640 1 --2- 172.21.15.50:0/2747237043 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9db0105b30 0x7f9db019c450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:20:29.841 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:29.839+0000 7f9db5c00640 1 -- 172.21.15.50:0/2747237043 >> 172.21.15.50:0/2747237043 conn(0x7f9db0101600 msgr2=0x7f9db010ab20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:20:29.841 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:29.839+0000 7f9db5c00640 1 -- 172.21.15.50:0/2747237043 shutdown_connections 2024-08-31T04:20:29.841 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:29.839+0000 7f9db5c00640 1 -- 172.21.15.50:0/2747237043 wait complete. 2024-08-31T04:20:30.341 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:20:30 smithi133 ceph-mon[22177]: Deploying daemon mds.b on smithi133 2024-08-31T04:20:30.341 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:20:30 smithi133 ceph-mon[22177]: mds.? [v2:172.21.15.50:6840/575209862,v1:172.21.15.50:6841/575209862] up:boot 2024-08-31T04:20:30.341 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:20:30 smithi133 ceph-mon[22177]: fsmap 11 up:standby 2024-08-31T04:20:30.341 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:20:30 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "a"} : dispatch 2024-08-31T04:20:30.341 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:20:30 smithi133 ceph-mon[22177]: from='client.? 172.21.15.50:0/2747237043' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T04:20:30.450 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:20:30 smithi050 ceph-mon[17259]: Deploying daemon mds.b on smithi133 2024-08-31T04:20:30.450 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:20:30 smithi050 ceph-mon[17259]: mds.? [v2:172.21.15.50:6840/575209862,v1:172.21.15.50:6841/575209862] up:boot 2024-08-31T04:20:30.450 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:20:30 smithi050 ceph-mon[17259]: fsmap 11 up:standby 2024-08-31T04:20:30.450 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:20:30 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "a"} : dispatch 2024-08-31T04:20:30.450 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:20:30 smithi050 ceph-mon[17259]: from='client.? 172.21.15.50:0/2747237043' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T04:20:30.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:20:30 smithi177 ceph-mon[22025]: Deploying daemon mds.b on smithi133 2024-08-31T04:20:30.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:20:30 smithi177 ceph-mon[22025]: mds.? [v2:172.21.15.50:6840/575209862,v1:172.21.15.50:6841/575209862] up:boot 2024-08-31T04:20:30.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:20:30 smithi177 ceph-mon[22025]: fsmap 11 up:standby 2024-08-31T04:20:30.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:20:30 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "a"} : dispatch 2024-08-31T04:20:30.497 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:20:30 smithi177 ceph-mon[22025]: from='client.? 172.21.15.50:0/2747237043' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T04:20:30.738 INFO:journalctl@ceph.mds.b.smithi133.stdout:Aug 31 04:20:30 smithi133 systemd[1]: Starting Ceph mds.b for 058d9fc6-674f-11ef-bcd4-c7b262605968... 2024-08-31T04:20:30.993 INFO:journalctl@ceph.mds.b.smithi133.stdout:Aug 31 04:20:30 smithi133 podman[52097]: 2024-08-31 04:20:30.640295149 +0000 UTC m=+0.016128569 image pull 79f4cde5e36911a5dca995eeb98098c2c8aae81dd52a088ef2c867bc3363bad0 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61 2024-08-31T04:20:30.993 INFO:journalctl@ceph.mds.b.smithi133.stdout:Aug 31 04:20:30 smithi133 podman[52097]: 2024-08-31 04:20:30.746179035 +0000 UTC m=+0.122012441 container create 577c72e4bd06f347614927df37d77becb794dd74056440c4f8352a93a5d1d2ab (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-mds-b, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, CEPH_POINT_RELEASE=, io.buildah.version=1.37.1, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image) 2024-08-31T04:20:30.993 INFO:journalctl@ceph.mds.b.smithi133.stdout:Aug 31 04:20:30 smithi133 podman[52097]: 2024-08-31 04:20:30.957530997 +0000 UTC m=+0.333364409 container init 577c72e4bd06f347614927df37d77becb794dd74056440c4f8352a93a5d1d2ab (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-mds-b, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.1, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux ) 2024-08-31T04:20:30.994 INFO:journalctl@ceph.mds.b.smithi133.stdout:Aug 31 04:20:30 smithi133 podman[52097]: 2024-08-31 04:20:30.960228713 +0000 UTC m=+0.336062120 container start 577c72e4bd06f347614927df37d77becb794dd74056440c4f8352a93a5d1d2ab (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-mds-b, org.label-schema.license=GPLv2, GIT_CLEAN=True, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, io.buildah.version=1.37.1, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=) 2024-08-31T04:20:31.293 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:20:31 smithi133 ceph-mon[22177]: pgmap v286: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T04:20:31.293 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:20:31 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:20:31.293 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:20:31 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:20:31.293 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:20:31 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:20:31.293 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:20:31 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:20:31.293 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:20:31 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:20:31.293 INFO:journalctl@ceph.mds.b.smithi133.stdout:Aug 31 04:20:30 smithi133 ceph-mds[52117]: -- 172.21.15.133:0/1419576553 <== mon.2 v2:172.21.15.133:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5630f5579860 con 0x5630f971fa80 2024-08-31T04:20:31.293 INFO:journalctl@ceph.mds.b.smithi133.stdout:Aug 31 04:20:30 smithi133 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-mds-b[52113]: starting mds.b at 2024-08-31T04:20:31.293 INFO:journalctl@ceph.mds.b.smithi133.stdout:Aug 31 04:20:31 smithi133 bash[52097]: 577c72e4bd06f347614927df37d77becb794dd74056440c4f8352a93a5d1d2ab 2024-08-31T04:20:31.294 INFO:journalctl@ceph.mds.b.smithi133.stdout:Aug 31 04:20:31 smithi133 systemd[1]: Started Ceph mds.b for 058d9fc6-674f-11ef-bcd4-c7b262605968. 2024-08-31T04:20:31.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:20:31 smithi177 ceph-mon[22025]: pgmap v286: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T04:20:31.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:20:31 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:20:31.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:20:31 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:20:31.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:20:31 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:20:31.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:20:31 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:20:31.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:20:31 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:20:31.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:20:31 smithi050 ceph-mon[17259]: pgmap v286: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T04:20:31.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:20:31 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:20:31.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:20:31 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:20:31.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:20:31 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:20:31.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:20:31 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:20:31.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:20:31 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:20:32.450 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:20:32 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:20:32.450 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:20:32 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T04:20:32.450 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:20:32 smithi050 ceph-mon[17259]: mds.? [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] up:boot 2024-08-31T04:20:32.450 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:20:32 smithi050 ceph-mon[17259]: fsmap 12 up:standby 2024-08-31T04:20:32.450 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:20:32 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "b"} : dispatch 2024-08-31T04:20:32.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:20:32 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:20:32.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:20:32 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T04:20:32.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:20:32 smithi177 ceph-mon[22025]: mds.? [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] up:boot 2024-08-31T04:20:32.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:20:32 smithi177 ceph-mon[22025]: fsmap 12 up:standby 2024-08-31T04:20:32.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:20:32 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "b"} : dispatch 2024-08-31T04:20:32.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:20:32 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:20:32.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:20:32 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T04:20:32.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:20:32 smithi133 ceph-mon[22177]: mds.? [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] up:boot 2024-08-31T04:20:32.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:20:32 smithi133 ceph-mon[22177]: fsmap 12 up:standby 2024-08-31T04:20:32.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:20:32 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "b"} : dispatch 2024-08-31T04:20:32.592 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 058d9fc6-674f-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-31T04:20:33.001 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:20:33.450 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:20:33 smithi050 ceph-mon[17259]: pgmap v287: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T04:20:33.450 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:20:33 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:20:33.450 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:20:33 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:20:33.450 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:20:33 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:20:33.450 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:20:33 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:20:33.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:20:33 smithi177 ceph-mon[22025]: pgmap v287: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T04:20:33.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:20:33 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:20:33.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:20:33 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:20:33.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:20:33 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:20:33.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:20:33 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:20:33.542 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:20:33 smithi133 ceph-mon[22177]: pgmap v287: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T04:20:33.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:20:33 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:20:33.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:20:33 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:20:33.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:20:33 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:20:33.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:20:33 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:20:33.644 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:33.641+0000 7f1f29800640 1 -- 172.21.15.50:0/3705473730 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1f2410b290 msgr2=0x7f1f2410b6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:20:33.644 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:33.641+0000 7f1f29800640 1 --2- 172.21.15.50:0/3705473730 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1f2410b290 0x7f1f2410b6a0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f1f10009900 tx=0x7f1f1002a410 comp rx=0 tx=0).stop 2024-08-31T04:20:33.644 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:33.641+0000 7f1f29800640 1 -- 172.21.15.50:0/3705473730 shutdown_connections 2024-08-31T04:20:33.644 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:33.641+0000 7f1f29800640 1 --2- 172.21.15.50:0/3705473730 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1f2410bbe0 0x7f1f24112410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:20:33.644 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:33.641+0000 7f1f29800640 1 --2- 172.21.15.50:0/3705473730 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1f2410b290 0x7f1f2410b6a0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:20:33.644 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:33.641+0000 7f1f29800640 1 --2- 172.21.15.50:0/3705473730 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1f24105950 0x7f1f24105d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:20:33.644 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:33.641+0000 7f1f29800640 1 -- 172.21.15.50:0/3705473730 >> 172.21.15.50:0/3705473730 conn(0x7f1f24101420 msgr2=0x7f1f24103870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:20:33.644 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:33.641+0000 7f1f29800640 1 -- 172.21.15.50:0/3705473730 shutdown_connections 2024-08-31T04:20:33.644 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:33.641+0000 7f1f29800640 1 -- 172.21.15.50:0/3705473730 wait complete. 2024-08-31T04:20:33.645 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:33.642+0000 7f1f29800640 1 Processor -- start 2024-08-31T04:20:33.645 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:33.642+0000 7f1f29800640 1 -- start start 2024-08-31T04:20:33.645 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:33.643+0000 7f1f29800640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1f24105950 0x7f1f2419c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:20:33.646 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:33.643+0000 7f1f29800640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1f2410b290 0x7f1f2419c860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:20:33.646 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:33.643+0000 7f1f29800640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1f2410bbe0 0x7f1f241a1b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:20:33.646 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:33.643+0000 7f1f29800640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f1f241158f0 con 0x7f1f2410bbe0 2024-08-31T04:20:33.646 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:33.643+0000 7f1f29800640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f1f24115770 con 0x7f1f2410b290 2024-08-31T04:20:33.646 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:33.643+0000 7f1f29800640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f1f24115a70 con 0x7f1f24105950 2024-08-31T04:20:33.646 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:33.643+0000 7f1f23e00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1f24105950 0x7f1f2419c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:20:33.646 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:33.643+0000 7f1f23e00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1f24105950 0x7f1f2419c2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.50:56886/0 (socket says 172.21.15.50:56886) 2024-08-31T04:20:33.646 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:33.643+0000 7f1f23e00640 1 -- 172.21.15.50:0/1330280804 learned_addr learned my addr 172.21.15.50:0/1330280804 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:20:33.646 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:33.643+0000 7f1f23400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1f2410b290 0x7f1f2419c860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:20:33.646 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:33.643+0000 7f1f28e00640 1 --2- 172.21.15.50:0/1330280804 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1f2410bbe0 0x7f1f241a1b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:20:33.647 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:33.644+0000 7f1f23e00640 1 -- 172.21.15.50:0/1330280804 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1f2410b290 msgr2=0x7f1f2419c860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:20:33.647 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:33.644+0000 7f1f23e00640 1 --2- 172.21.15.50:0/1330280804 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1f2410b290 0x7f1f2419c860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:20:33.647 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:33.644+0000 7f1f23e00640 1 -- 172.21.15.50:0/1330280804 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1f2410bbe0 msgr2=0x7f1f241a1b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:20:33.647 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:33.644+0000 7f1f23e00640 1 --2- 172.21.15.50:0/1330280804 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1f2410bbe0 0x7f1f241a1b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:20:33.647 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:33.644+0000 7f1f23e00640 1 -- 172.21.15.50:0/1330280804 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f241a2230 con 0x7f1f24105950 2024-08-31T04:20:33.647 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:33.644+0000 7f1f23e00640 1 --2- 172.21.15.50:0/1330280804 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1f24105950 0x7f1f2419c2c0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f1f1400e9f0 tx=0x7f1f1400edf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:20:33.647 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:33.644+0000 7f1f20c00640 1 -- 172.21.15.50:0/1330280804 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f1400cd80 con 0x7f1f24105950 2024-08-31T04:20:33.647 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:33.644+0000 7f1f20c00640 1 -- 172.21.15.50:0/1330280804 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1f140054d0 con 0x7f1f24105950 2024-08-31T04:20:33.647 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:33.644+0000 7f1f29800640 1 -- 172.21.15.50:0/1330280804 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1f241a2520 con 0x7f1f24105950 2024-08-31T04:20:33.648 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:33.644+0000 7f1f20c00640 1 -- 172.21.15.50:0/1330280804 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f14010690 con 0x7f1f24105950 2024-08-31T04:20:33.648 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:33.644+0000 7f1f29800640 1 -- 172.21.15.50:0/1330280804 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1f241a8c80 con 0x7f1f24105950 2024-08-31T04:20:33.648 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:33.645+0000 7f1f29800640 1 -- 172.21.15.50:0/1330280804 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1f24105d60 con 0x7f1f24105950 2024-08-31T04:20:33.650 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:33.648+0000 7f1f20c00640 1 -- 172.21.15.50:0/1330280804 <== mon.1 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 16) ==== 152577+0+0 (secure 0 0 0) 0x7f1f14004e30 con 0x7f1f24105950 2024-08-31T04:20:33.651 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:33.649+0000 7f1f20c00640 1 --2- 172.21.15.50:0/1330280804 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f1f080b4b30 0x7f1f080b7040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:20:33.652 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:33.650+0000 7f1f20c00640 1 -- 172.21.15.50:0/1330280804 <== mon.1 v2:172.21.15.177:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 7127+0+0 (secure 0 0 0) 0x7f1f140e5300 con 0x7f1f24105950 2024-08-31T04:20:33.652 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:33.650+0000 7f1f23400640 1 --2- 172.21.15.50:0/1330280804 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f1f080b4b30 0x7f1f080b7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:20:33.653 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:33.651+0000 7f1f23400640 1 --2- 172.21.15.50:0/1330280804 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f1f080b4b30 0x7f1f080b7040 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f1f1002aa00 tx=0x7f1f10005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:20:33.653 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:33.651+0000 7f1f20c00640 1 -- 172.21.15.50:0/1330280804 <== mon.1 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f1f140ac830 con 0x7f1f24105950 2024-08-31T04:20:33.918 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:33.916+0000 7f1f29800640 1 -- 172.21.15.50:0/1330280804 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1f2419d3f0 con 0x7f1f24105950 2024-08-31T04:20:33.919 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:33.917+0000 7f1f20c00640 1 -- 172.21.15.50:0/1330280804 <== mon.1 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) ==== 94+0+10533 (secure 0 0 0) 0x7f1f2419d3f0 con 0x7f1f24105950 2024-08-31T04:20:33.920 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-08-31T04:20:33.920 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":13,"btime":"2024-08-31T04:20:31:674048+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14622,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/1565557530","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":1565557530},{"type":"v1","addr":"172.21.15.50:6835","nonce":1565557530}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14634,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6837/2660185946","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6836","nonce":2660185946},{"type":"v1","addr":"172.21.15.50:6837","nonce":2660185946}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14676,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6839/2105228685","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6838","nonce":2105228685},{"type":"v1","addr":"172.21.15.50:6839","nonce":2105228685}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":24590,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6833/4283603962","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6832","nonce":4283603962},{"type":"v1","addr":"172.21.15.133:6833","nonce":4283603962}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24601,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6833/1237129793","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":1237129793},{"type":"v1","addr":"172.21.15.177:6833","nonce":1237129793}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24626,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6835/3637799701","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":3637799701},{"type":"v1","addr":"172.21.15.133:6835","nonce":3637799701}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24640,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6835/599392457","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6834","nonce":599392457},{"type":"v1","addr":"172.21.15.177:6835","nonce":599392457}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24652,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6837/2159859285","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6836","nonce":2159859285},{"type":"v1","addr":"172.21.15.177:6837","nonce":2159859285}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24656,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6837/4014853202","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6836","nonce":4014853202},{"type":"v1","addr":"172.21.15.133:6837","nonce":4014853202}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24667,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6839/3600081752","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6838","nonce":3600081752},{"type":"v1","addr":"172.21.15.177:6839","nonce":3600081752}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24691,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6841/575209862","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6840","nonce":575209862},{"type":"v1","addr":"172.21.15.50:6841","nonce":575209862}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24695,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6839/2526402262","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6838","nonce":2526402262},{"type":"v1","addr":"172.21.15.133:6839","nonce":2526402262}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13}],"filesystems":[]} 2024-08-31T04:20:33.920 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 13 2024-08-31T04:20:33.922 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:33.920+0000 7f1f29800640 1 -- 172.21.15.50:0/1330280804 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f1f080b4b30 msgr2=0x7f1f080b7040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:20:33.922 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:33.920+0000 7f1f29800640 1 --2- 172.21.15.50:0/1330280804 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f1f080b4b30 0x7f1f080b7040 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f1f1002aa00 tx=0x7f1f10005a20 comp rx=0 tx=0).stop 2024-08-31T04:20:33.922 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:33.920+0000 7f1f29800640 1 -- 172.21.15.50:0/1330280804 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1f24105950 msgr2=0x7f1f2419c2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:20:33.922 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:33.920+0000 7f1f29800640 1 --2- 172.21.15.50:0/1330280804 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1f24105950 0x7f1f2419c2c0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f1f1400e9f0 tx=0x7f1f1400edf0 comp rx=0 tx=0).stop 2024-08-31T04:20:33.923 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:33.920+0000 7f1f29800640 1 -- 172.21.15.50:0/1330280804 shutdown_connections 2024-08-31T04:20:33.923 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:33.920+0000 7f1f29800640 1 --2- 172.21.15.50:0/1330280804 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f1f080b4b30 0x7f1f080b7040 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:20:33.923 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:33.920+0000 7f1f29800640 1 --2- 172.21.15.50:0/1330280804 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1f2410bbe0 0x7f1f241a1b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:20:33.923 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:33.920+0000 7f1f29800640 1 --2- 172.21.15.50:0/1330280804 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1f2410b290 0x7f1f2419c860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:20:33.923 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:33.920+0000 7f1f29800640 1 --2- 172.21.15.50:0/1330280804 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1f24105950 0x7f1f2419c2c0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:20:33.923 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:33.920+0000 7f1f29800640 1 -- 172.21.15.50:0/1330280804 >> 172.21.15.50:0/1330280804 conn(0x7f1f24101420 msgr2=0x7f1f24103840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:20:33.923 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:33.920+0000 7f1f29800640 1 -- 172.21.15.50:0/1330280804 shutdown_connections 2024-08-31T04:20:33.923 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:33.920+0000 7f1f29800640 1 -- 172.21.15.50:0/1330280804 wait complete. 2024-08-31T04:20:34.664 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 058d9fc6-674f-11ef-bcd4-c7b262605968 -- ceph --format=json-pretty osd lspools 2024-08-31T04:20:34.950 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:20:34 smithi050 ceph-mon[17259]: pgmap v288: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T04:20:34.950 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:20:34 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:20:34.950 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:20:34 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:20:34.950 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:20:34 smithi050 ceph-mon[17259]: from='client.? 172.21.15.50:0/1330280804' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T04:20:34.950 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:20:34 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:20:34.950 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:20:34 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T04:20:34.950 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:20:34 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:20:34.951 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:20:34 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T04:20:35.058 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:20:35.246 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:20:34 smithi177 ceph-mon[22025]: pgmap v288: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T04:20:35.246 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:20:34 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:20:35.246 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:20:34 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:20:35.246 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:20:34 smithi177 ceph-mon[22025]: from='client.? 172.21.15.50:0/1330280804' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T04:20:35.246 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:20:34 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:20:35.246 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:20:34 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T04:20:35.246 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:20:34 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:20:35.246 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:20:34 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T04:20:35.293 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:20:34 smithi133 ceph-mon[22177]: pgmap v288: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T04:20:35.293 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:20:34 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:20:35.293 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:20:34 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:20:35.293 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:20:34 smithi133 ceph-mon[22177]: from='client.? 172.21.15.50:0/1330280804' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T04:20:35.293 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:20:34 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:20:35.293 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:20:34 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T04:20:35.293 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:20:34 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:20:35.293 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:20:34 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T04:20:35.704 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:35.701+0000 7fa782e00640 1 -- 172.21.15.50:0/2356838396 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa77c075550 msgr2=0x7fa77c075960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:20:35.704 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:35.701+0000 7fa782e00640 1 --2- 172.21.15.50:0/2356838396 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa77c075550 0x7fa77c075960 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fa76c009900 tx=0x7fa76c02a3f0 comp rx=0 tx=0).stop 2024-08-31T04:20:35.704 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:35.701+0000 7fa782e00640 1 -- 172.21.15.50:0/2356838396 shutdown_connections 2024-08-31T04:20:35.704 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:35.701+0000 7fa782e00640 1 --2- 172.21.15.50:0/2356838396 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa77c075ea0 0x7fa77c10f930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:20:35.704 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:35.701+0000 7fa782e00640 1 --2- 172.21.15.50:0/2356838396 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa77c10fe70 0x7fa77c1122b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:20:35.704 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:35.701+0000 7fa782e00640 1 --2- 172.21.15.50:0/2356838396 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa77c075550 0x7fa77c075960 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:20:35.705 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:35.701+0000 7fa782e00640 1 -- 172.21.15.50:0/2356838396 >> 172.21.15.50:0/2356838396 conn(0x7fa77c0ff380 msgr2=0x7fa77c1017d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:20:35.705 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:35.701+0000 7fa782e00640 1 -- 172.21.15.50:0/2356838396 shutdown_connections 2024-08-31T04:20:35.705 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:35.701+0000 7fa782e00640 1 -- 172.21.15.50:0/2356838396 wait complete. 2024-08-31T04:20:35.706 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:35.702+0000 7fa782e00640 1 Processor -- start 2024-08-31T04:20:35.706 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:35.702+0000 7fa782e00640 1 -- start start 2024-08-31T04:20:35.706 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:35.703+0000 7fa782e00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa77c075550 0x7fa77c19c450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:20:35.706 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:35.703+0000 7fa782e00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa77c075ea0 0x7fa77c19c9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:20:35.706 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:35.703+0000 7fa782e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa77c10fe70 0x7fa77c1a1c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:20:35.706 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:35.703+0000 7fa782e00640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fa77c115a20 con 0x7fa77c10fe70 2024-08-31T04:20:35.706 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:35.703+0000 7fa782e00640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7fa77c1158a0 con 0x7fa77c075550 2024-08-31T04:20:35.706 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:35.703+0000 7fa782e00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fa77c115ba0 con 0x7fa77c075ea0 2024-08-31T04:20:35.707 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:35.703+0000 7fa77be00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa77c075550 0x7fa77c19c450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:20:35.707 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:35.703+0000 7fa77b400640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa77c075ea0 0x7fa77c19c9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:20:35.707 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:35.703+0000 7fa77be00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa77c075550 0x7fa77c19c450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.50:54496/0 (socket says 172.21.15.50:54496) 2024-08-31T04:20:35.707 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:35.703+0000 7fa77be00640 1 -- 172.21.15.50:0/425875266 learned_addr learned my addr 172.21.15.50:0/425875266 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:20:35.707 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:35.703+0000 7fa780e00640 1 --2- 172.21.15.50:0/425875266 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa77c10fe70 0x7fa77c1a1c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:20:35.707 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:35.704+0000 7fa77b400640 1 -- 172.21.15.50:0/425875266 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa77c075550 msgr2=0x7fa77c19c450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:20:35.707 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:35.704+0000 7fa77b400640 1 --2- 172.21.15.50:0/425875266 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa77c075550 0x7fa77c19c450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:20:35.707 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:35.704+0000 7fa77b400640 1 -- 172.21.15.50:0/425875266 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa77c10fe70 msgr2=0x7fa77c1a1c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:20:35.707 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:35.704+0000 7fa77b400640 1 --2- 172.21.15.50:0/425875266 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa77c10fe70 0x7fa77c1a1c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:20:35.707 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:35.704+0000 7fa77b400640 1 -- 172.21.15.50:0/425875266 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa77c1a2300 con 0x7fa77c075ea0 2024-08-31T04:20:35.707 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:35.704+0000 7fa77b400640 1 --2- 172.21.15.50:0/425875266 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa77c075ea0 0x7fa77c19c9f0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fa76800e9c0 tx=0x7fa76800ee80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:20:35.708 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:35.704+0000 7fa778c00640 1 -- 172.21.15.50:0/425875266 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa76800cd80 con 0x7fa77c075ea0 2024-08-31T04:20:35.708 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:35.704+0000 7fa782e00640 1 -- 172.21.15.50:0/425875266 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa77c1a25f0 con 0x7fa77c075ea0 2024-08-31T04:20:35.708 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:35.704+0000 7fa778c00640 1 -- 172.21.15.50:0/425875266 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa7680108e0 con 0x7fa77c075ea0 2024-08-31T04:20:35.708 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:35.704+0000 7fa778c00640 1 -- 172.21.15.50:0/425875266 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa768018840 con 0x7fa77c075ea0 2024-08-31T04:20:35.708 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:35.704+0000 7fa782e00640 1 -- 172.21.15.50:0/425875266 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa77c1a8e10 con 0x7fa77c075ea0 2024-08-31T04:20:35.708 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:35.705+0000 7fa782e00640 1 -- 172.21.15.50:0/425875266 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa77c075960 con 0x7fa77c075ea0 2024-08-31T04:20:35.710 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:35.708+0000 7fa778c00640 1 -- 172.21.15.50:0/425875266 <== mon.1 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 16) ==== 152577+0+0 (secure 0 0 0) 0x7fa76801f020 con 0x7fa77c075ea0 2024-08-31T04:20:35.712 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:35.710+0000 7fa778c00640 1 --2- 172.21.15.50:0/425875266 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fa7600b4b60 0x7fa7600b7070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:20:35.713 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:35.711+0000 7fa778c00640 1 -- 172.21.15.50:0/425875266 <== mon.1 v2:172.21.15.177:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 7127+0+0 (secure 0 0 0) 0x7fa7680e4df0 con 0x7fa77c075ea0 2024-08-31T04:20:35.713 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:35.711+0000 7fa77be00640 1 --2- 172.21.15.50:0/425875266 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fa7600b4b60 0x7fa7600b7070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:20:35.713 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:35.711+0000 7fa778c00640 1 -- 172.21.15.50:0/425875266 <== mon.1 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fa7680ac320 con 0x7fa77c075ea0 2024-08-31T04:20:35.714 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:35.711+0000 7fa77be00640 1 --2- 172.21.15.50:0/425875266 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fa7600b4b60 0x7fa7600b7070 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fa76c031440 tx=0x7fa76c0058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:20:35.920 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:35.917+0000 7fa782e00640 1 -- 172.21.15.50:0/425875266 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7fa77c1a8fe0 con 0x7fa77c075ea0 2024-08-31T04:20:35.920 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:35.918+0000 7fa778c00640 1 -- 172.21.15.50:0/425875266 <== mon.1 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v69) ==== 84+0+65 (secure 0 0 0) 0x7fa7680abc20 con 0x7fa77c075ea0 2024-08-31T04:20:35.921 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-08-31T04:20:35.921 INFO:teuthology.orchestra.run.smithi050.stdout:[ 2024-08-31T04:20:35.921 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-08-31T04:20:35.921 INFO:teuthology.orchestra.run.smithi050.stdout: "poolnum": 1, 2024-08-31T04:20:35.921 INFO:teuthology.orchestra.run.smithi050.stdout: "poolname": ".mgr" 2024-08-31T04:20:35.921 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T04:20:35.921 INFO:teuthology.orchestra.run.smithi050.stdout:] 2024-08-31T04:20:35.923 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:35.920+0000 7fa782e00640 1 -- 172.21.15.50:0/425875266 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fa7600b4b60 msgr2=0x7fa7600b7070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:20:35.923 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:35.920+0000 7fa782e00640 1 --2- 172.21.15.50:0/425875266 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fa7600b4b60 0x7fa7600b7070 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fa76c031440 tx=0x7fa76c0058d0 comp rx=0 tx=0).stop 2024-08-31T04:20:35.923 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:35.920+0000 7fa782e00640 1 -- 172.21.15.50:0/425875266 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa77c075ea0 msgr2=0x7fa77c19c9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:20:35.923 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:35.920+0000 7fa782e00640 1 --2- 172.21.15.50:0/425875266 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa77c075ea0 0x7fa77c19c9f0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fa76800e9c0 tx=0x7fa76800ee80 comp rx=0 tx=0).stop 2024-08-31T04:20:35.923 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:35.920+0000 7fa782e00640 1 -- 172.21.15.50:0/425875266 shutdown_connections 2024-08-31T04:20:35.923 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:35.920+0000 7fa782e00640 1 --2- 172.21.15.50:0/425875266 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fa7600b4b60 0x7fa7600b7070 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:20:35.923 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:35.920+0000 7fa782e00640 1 --2- 172.21.15.50:0/425875266 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa77c075ea0 0x7fa77c19c9f0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:20:35.923 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:35.920+0000 7fa782e00640 1 --2- 172.21.15.50:0/425875266 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa77c10fe70 0x7fa77c1a1c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:20:35.923 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:35.920+0000 7fa782e00640 1 --2- 172.21.15.50:0/425875266 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa77c075550 0x7fa77c19c450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:20:35.924 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:35.920+0000 7fa782e00640 1 -- 172.21.15.50:0/425875266 >> 172.21.15.50:0/425875266 conn(0x7fa77c0ff380 msgr2=0x7fa77c109a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:20:35.924 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:35.921+0000 7fa782e00640 1 -- 172.21.15.50:0/425875266 shutdown_connections 2024-08-31T04:20:35.924 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:35.921+0000 7fa782e00640 1 -- 172.21.15.50:0/425875266 wait complete. 2024-08-31T04:20:36.920 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-08-31T04:20:36.921 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 058d9fc6-674f-11ef-bcd4-c7b262605968 -- ceph osd pool create cephfs_metadata --pg_num_min 64 2024-08-31T04:20:37.200 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:20:36 smithi050 ceph-mon[17259]: pgmap v289: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T04:20:37.200 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:20:36 smithi050 ceph-mon[17259]: from='client.? 172.21.15.50:0/425875266' entity='client.admin' cmd={"prefix": "osd lspools", "format": "json-pretty"} : dispatch 2024-08-31T04:20:37.200 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:20:36 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:20:37.200 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:20:36 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:20:37.200 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:20:36 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:20:37.200 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:20:36 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:20:37.246 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:20:36 smithi177 ceph-mon[22025]: pgmap v289: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T04:20:37.246 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:20:36 smithi177 ceph-mon[22025]: from='client.? 172.21.15.50:0/425875266' entity='client.admin' cmd={"prefix": "osd lspools", "format": "json-pretty"} : dispatch 2024-08-31T04:20:37.246 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:20:36 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:20:37.246 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:20:36 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:20:37.246 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:20:36 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:20:37.246 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:20:36 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:20:37.293 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:20:36 smithi133 ceph-mon[22177]: pgmap v289: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T04:20:37.293 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:20:36 smithi133 ceph-mon[22177]: from='client.? 172.21.15.50:0/425875266' entity='client.admin' cmd={"prefix": "osd lspools", "format": "json-pretty"} : dispatch 2024-08-31T04:20:37.293 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:20:36 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:20:37.293 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:20:36 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:20:37.293 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:20:36 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:20:37.293 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:20:36 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:20:37.387 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:20:38.016 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:38.013+0000 7f000d400640 1 -- 172.21.15.50:0/3180759267 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0008103910 msgr2=0x7f0008103d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:20:38.016 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:38.013+0000 7f000d400640 1 --2- 172.21.15.50:0/3180759267 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0008103910 0x7f0008103d20 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7efff8009900 tx=0x7efff802a410 comp rx=0 tx=0).stop 2024-08-31T04:20:38.016 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:38.013+0000 7f000d400640 1 -- 172.21.15.50:0/3180759267 shutdown_connections 2024-08-31T04:20:38.016 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:38.013+0000 7f000d400640 1 --2- 172.21.15.50:0/3180759267 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0008109250 0x7f0008109660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:20:38.016 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:38.013+0000 7f000d400640 1 --2- 172.21.15.50:0/3180759267 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0008109ba0 0x7f00081103d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:20:38.016 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:38.013+0000 7f000d400640 1 --2- 172.21.15.50:0/3180759267 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0008103910 0x7f0008103d20 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:20:38.016 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:38.013+0000 7f000d400640 1 -- 172.21.15.50:0/3180759267 >> 172.21.15.50:0/3180759267 conn(0x7f00080ff380 msgr2=0x7f00081017d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:20:38.016 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:38.013+0000 7f000d400640 1 -- 172.21.15.50:0/3180759267 shutdown_connections 2024-08-31T04:20:38.016 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:38.013+0000 7f000d400640 1 -- 172.21.15.50:0/3180759267 wait complete. 2024-08-31T04:20:38.017 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:38.014+0000 7f000d400640 1 Processor -- start 2024-08-31T04:20:38.017 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:38.014+0000 7f000d400640 1 -- start start 2024-08-31T04:20:38.017 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:38.015+0000 7f000d400640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0008103910 0x7f000819c4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:20:38.018 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:38.015+0000 7f000d400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0008109250 0x7f000819ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:20:38.018 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:38.015+0000 7f000d400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0008109ba0 0x7f00081a1ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:20:38.018 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:38.015+0000 7f000d400640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f00081138b0 con 0x7f0008109ba0 2024-08-31T04:20:38.018 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:38.015+0000 7f000d400640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f0008113730 con 0x7f0008109250 2024-08-31T04:20:38.018 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:38.015+0000 7f000d400640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f0008113a30 con 0x7f0008103910 2024-08-31T04:20:38.018 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:38.015+0000 7f0005e00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0008109250 0x7f000819ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:20:38.018 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:38.015+0000 7f0006800640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0008103910 0x7f000819c4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:20:38.018 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:38.015+0000 7f0005e00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0008109250 0x7f000819ca40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.50:54522/0 (socket says 172.21.15.50:54522) 2024-08-31T04:20:38.018 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:38.015+0000 7f0005e00640 1 -- 172.21.15.50:0/1501324837 learned_addr learned my addr 172.21.15.50:0/1501324837 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:20:38.018 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:38.015+0000 7f0007200640 1 --2- 172.21.15.50:0/1501324837 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0008109ba0 0x7f00081a1ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:20:38.019 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:38.016+0000 7f0005e00640 1 -- 172.21.15.50:0/1501324837 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0008103910 msgr2=0x7f000819c4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:20:38.019 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:38.016+0000 7f0005e00640 1 --2- 172.21.15.50:0/1501324837 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0008103910 0x7f000819c4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:20:38.019 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:38.016+0000 7f0005e00640 1 -- 172.21.15.50:0/1501324837 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0008109ba0 msgr2=0x7f00081a1ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:20:38.019 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:38.016+0000 7f0005e00640 1 --2- 172.21.15.50:0/1501324837 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0008109ba0 0x7f00081a1ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:20:38.019 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:38.016+0000 7f0005e00640 1 -- 172.21.15.50:0/1501324837 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00081a2410 con 0x7f0008109250 2024-08-31T04:20:38.019 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:38.016+0000 7f0005e00640 1 --2- 172.21.15.50:0/1501324837 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0008109250 0x7f000819ca40 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7efff400e9c0 tx=0x7efff400ee80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:20:38.019 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:38.016+0000 7effff400640 1 -- 172.21.15.50:0/1501324837 <== mon.2 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efff400ccc0 con 0x7f0008109250 2024-08-31T04:20:38.019 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:38.016+0000 7effff400640 1 -- 172.21.15.50:0/1501324837 <== mon.2 v2:172.21.15.133:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efff40054d0 con 0x7f0008109250 2024-08-31T04:20:38.019 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:38.016+0000 7effff400640 1 -- 172.21.15.50:0/1501324837 <== mon.2 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efff4010430 con 0x7f0008109250 2024-08-31T04:20:38.020 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:38.016+0000 7f000d400640 1 -- 172.21.15.50:0/1501324837 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f00081a2700 con 0x7f0008109250 2024-08-31T04:20:38.020 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:38.016+0000 7f000d400640 1 -- 172.21.15.50:0/1501324837 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f00081a8e60 con 0x7f0008109250 2024-08-31T04:20:38.020 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:38.017+0000 7f000d400640 1 -- 172.21.15.50:0/1501324837 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0008103d20 con 0x7f0008109250 2024-08-31T04:20:38.022 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:38.020+0000 7effff400640 1 -- 172.21.15.50:0/1501324837 <== mon.2 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 16) ==== 152577+0+0 (secure 0 0 0) 0x7efff4005000 con 0x7f0008109250 2024-08-31T04:20:38.023 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:38.021+0000 7effff400640 1 --2- 172.21.15.50:0/1501324837 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7effec0b4b30 0x7effec0b7040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:20:38.023 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:38.021+0000 7effff400640 1 -- 172.21.15.50:0/1501324837 <== mon.2 v2:172.21.15.133:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 7127+0+0 (secure 0 0 0) 0x7efff40e5210 con 0x7f0008109250 2024-08-31T04:20:38.024 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:38.022+0000 7f0006800640 1 --2- 172.21.15.50:0/1501324837 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7effec0b4b30 0x7effec0b7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:20:38.025 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:38.023+0000 7f0006800640 1 --2- 172.21.15.50:0/1501324837 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7effec0b4b30 0x7effec0b7040 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7efff8005ab0 tx=0x7efff8005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:20:38.025 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:38.023+0000 7effff400640 1 -- 172.21.15.50:0/1501324837 <== mon.2 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7efff4056130 con 0x7f0008109250 2024-08-31T04:20:38.234 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:38.232+0000 7f000d400640 1 -- 172.21.15.50:0/1501324837 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f00081a9140 con 0x7f0008109250 2024-08-31T04:20:38.890 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:38.887+0000 7effff400640 1 -- 172.21.15.50:0/1501324837 <== mon.2 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v70) ==== 138+0+0 (secure 0 0 0) 0x7efff40052f0 con 0x7f0008109250 2024-08-31T04:20:38.891 INFO:teuthology.orchestra.run.smithi050.stderr:pool 'cephfs_metadata' created 2024-08-31T04:20:38.895 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:38.893+0000 7f000d400640 1 -- 172.21.15.50:0/1501324837 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7effec0b4b30 msgr2=0x7effec0b7040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:20:38.895 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:38.893+0000 7f000d400640 1 --2- 172.21.15.50:0/1501324837 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7effec0b4b30 0x7effec0b7040 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7efff8005ab0 tx=0x7efff8005a20 comp rx=0 tx=0).stop 2024-08-31T04:20:38.895 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:38.893+0000 7f000d400640 1 -- 172.21.15.50:0/1501324837 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0008109250 msgr2=0x7f000819ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:20:38.895 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:38.893+0000 7f000d400640 1 --2- 172.21.15.50:0/1501324837 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0008109250 0x7f000819ca40 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7efff400e9c0 tx=0x7efff400ee80 comp rx=0 tx=0).stop 2024-08-31T04:20:38.895 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:38.893+0000 7f000d400640 1 -- 172.21.15.50:0/1501324837 shutdown_connections 2024-08-31T04:20:38.895 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:38.893+0000 7f000d400640 1 --2- 172.21.15.50:0/1501324837 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7effec0b4b30 0x7effec0b7040 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:20:38.896 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:38.893+0000 7f000d400640 1 --2- 172.21.15.50:0/1501324837 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0008109ba0 0x7f00081a1ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:20:38.896 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:38.893+0000 7f000d400640 1 --2- 172.21.15.50:0/1501324837 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0008109250 0x7f000819ca40 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:20:38.896 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:38.893+0000 7f000d400640 1 --2- 172.21.15.50:0/1501324837 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0008103910 0x7f000819c4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:20:38.896 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:38.893+0000 7f000d400640 1 -- 172.21.15.50:0/1501324837 >> 172.21.15.50:0/1501324837 conn(0x7f00080ff380 msgr2=0x7f00081088d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:20:38.896 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:38.893+0000 7f000d400640 1 -- 172.21.15.50:0/1501324837 shutdown_connections 2024-08-31T04:20:38.896 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:38.893+0000 7f000d400640 1 -- 172.21.15.50:0/1501324837 wait complete. 2024-08-31T04:20:39.200 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:20:38 smithi050 ceph-mon[17259]: pgmap v290: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T04:20:39.200 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:20:38 smithi050 ceph-mon[17259]: from='client.? 172.21.15.50:0/1501324837' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} : dispatch 2024-08-31T04:20:39.200 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:20:38 smithi050 ceph-mon[17259]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} : dispatch 2024-08-31T04:20:39.200 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:20:38 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:20:39.200 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:20:38 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:20:39.200 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:20:38 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:20:39.200 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:20:38 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T04:20:39.200 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:20:38 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:20:39.246 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:20:38 smithi177 ceph-mon[22025]: pgmap v290: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T04:20:39.246 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:20:38 smithi177 ceph-mon[22025]: from='client.? 172.21.15.50:0/1501324837' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} : dispatch 2024-08-31T04:20:39.246 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:20:38 smithi177 ceph-mon[22025]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} : dispatch 2024-08-31T04:20:39.246 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:20:38 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:20:39.246 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:20:38 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:20:39.246 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:20:38 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:20:39.246 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:20:38 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T04:20:39.246 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:20:38 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:20:39.293 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:20:38 smithi133 ceph-mon[22177]: pgmap v290: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T04:20:39.293 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:20:38 smithi133 ceph-mon[22177]: from='client.? 172.21.15.50:0/1501324837' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} : dispatch 2024-08-31T04:20:39.293 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:20:38 smithi133 ceph-mon[22177]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} : dispatch 2024-08-31T04:20:39.293 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:20:38 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:20:39.293 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:20:38 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:20:39.293 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:20:38 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:20:39.293 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:20:38 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T04:20:39.293 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:20:38 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:20:39.707 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 058d9fc6-674f-11ef-bcd4-c7b262605968 -- ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-08-31T04:20:39.950 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:20:39 smithi050 ceph-mon[17259]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-08-31T04:20:39.950 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:20:39 smithi050 ceph-mon[17259]: osdmap e70: 12 total, 12 up, 12 in 2024-08-31T04:20:40.098 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:20:40.246 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:20:39 smithi177 ceph-mon[22025]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-08-31T04:20:40.246 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:20:39 smithi177 ceph-mon[22025]: osdmap e70: 12 total, 12 up, 12 in 2024-08-31T04:20:40.293 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:20:39 smithi133 ceph-mon[22177]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-08-31T04:20:40.293 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:20:39 smithi133 ceph-mon[22177]: osdmap e70: 12 total, 12 up, 12 in 2024-08-31T04:20:40.709 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:40.707+0000 7f592fe00640 1 -- 172.21.15.50:0/809800741 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5928101d80 msgr2=0x7f5928102190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:20:40.709 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:40.707+0000 7f592fe00640 1 --2- 172.21.15.50:0/809800741 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5928101d80 0x7f5928102190 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f591c009900 tx=0x7f591c02a3f0 comp rx=0 tx=0).stop 2024-08-31T04:20:40.709 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:40.707+0000 7f592fe00640 1 -- 172.21.15.50:0/809800741 shutdown_connections 2024-08-31T04:20:40.709 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:40.707+0000 7f592fe00640 1 --2- 172.21.15.50:0/809800741 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5928109260 0x7f5928109670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:20:40.709 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:40.707+0000 7f592fe00640 1 --2- 172.21.15.50:0/809800741 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5928109bb0 0x7f59281103e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:20:40.709 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:40.707+0000 7f592fe00640 1 --2- 172.21.15.50:0/809800741 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5928101d80 0x7f5928102190 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:20:40.709 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:40.707+0000 7f592fe00640 1 -- 172.21.15.50:0/809800741 >> 172.21.15.50:0/809800741 conn(0x7f5928077960 msgr2=0x7f5928077da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:20:40.710 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:40.707+0000 7f592fe00640 1 -- 172.21.15.50:0/809800741 shutdown_connections 2024-08-31T04:20:40.710 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:40.707+0000 7f592fe00640 1 -- 172.21.15.50:0/809800741 wait complete. 2024-08-31T04:20:40.710 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:40.708+0000 7f592fe00640 1 Processor -- start 2024-08-31T04:20:40.711 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:40.709+0000 7f592fe00640 1 -- start start 2024-08-31T04:20:40.711 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:40.709+0000 7f592fe00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5928101d80 0x7f592819c430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:20:40.711 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:40.709+0000 7f592fe00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5928109260 0x7f592819c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:20:40.711 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:40.709+0000 7f592fe00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5928109bb0 0x7f59281a1c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:20:40.711 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:40.709+0000 7f592fe00640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f5928104070 con 0x7f5928109260 2024-08-31T04:20:40.711 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:40.709+0000 7f592fe00640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f5928103ef0 con 0x7f5928109bb0 2024-08-31T04:20:40.711 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:40.709+0000 7f592fe00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f59281041f0 con 0x7f5928101d80 2024-08-31T04:20:40.711 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:40.709+0000 7f592ca00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5928109260 0x7f592819c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:20:40.711 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:40.709+0000 7f592de00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5928109bb0 0x7f59281a1c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:20:40.711 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:40.709+0000 7f592de00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5928109bb0 0x7f59281a1c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.50:54542/0 (socket says 172.21.15.50:54542) 2024-08-31T04:20:40.711 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:40.710+0000 7f592d400640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5928101d80 0x7f592819c430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:20:40.711 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:40.710+0000 7f592de00640 1 -- 172.21.15.50:0/1133537224 learned_addr learned my addr 172.21.15.50:0/1133537224 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:20:40.712 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:40.710+0000 7f592ca00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5928109260 0x7f592819c9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:56314/0 (socket says 172.21.15.50:56314) 2024-08-31T04:20:40.713 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:40.710+0000 7f592de00640 1 -- 172.21.15.50:0/1133537224 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5928101d80 msgr2=0x7f592819c430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:20:40.713 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:40.710+0000 7f592de00640 1 --2- 172.21.15.50:0/1133537224 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5928101d80 0x7f592819c430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:20:40.713 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:40.710+0000 7f592de00640 1 -- 172.21.15.50:0/1133537224 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5928109260 msgr2=0x7f592819c9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:20:40.713 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:40.710+0000 7f592de00640 1 --2- 172.21.15.50:0/1133537224 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5928109260 0x7f592819c9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:20:40.713 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:40.710+0000 7f592de00640 1 -- 172.21.15.50:0/1133537224 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59281a23a0 con 0x7f5928109bb0 2024-08-31T04:20:40.713 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:40.710+0000 7f592ca00640 1 --2- 172.21.15.50:0/1133537224 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5928109260 0x7f592819c9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:20:40.713 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:40.710+0000 7f592de00640 1 --2- 172.21.15.50:0/1133537224 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5928109bb0 0x7f59281a1c70 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f592000eb10 tx=0x7f592000c2d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:20:40.713 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:40.711+0000 7f5926000640 1 -- 172.21.15.50:0/1133537224 <== mon.2 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5920004b20 con 0x7f5928109bb0 2024-08-31T04:20:40.713 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:40.711+0000 7f5926000640 1 -- 172.21.15.50:0/1133537224 <== mon.2 v2:172.21.15.133:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5920004cc0 con 0x7f5928109bb0 2024-08-31T04:20:40.713 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:40.711+0000 7f592fe00640 1 -- 172.21.15.50:0/1133537224 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f59281a2690 con 0x7f5928109bb0 2024-08-31T04:20:40.714 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:40.711+0000 7f5926000640 1 -- 172.21.15.50:0/1133537224 <== mon.2 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5920010670 con 0x7f5928109bb0 2024-08-31T04:20:40.714 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:40.711+0000 7f592fe00640 1 -- 172.21.15.50:0/1133537224 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f59281a8df0 con 0x7f5928109bb0 2024-08-31T04:20:40.714 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:40.712+0000 7f592fe00640 1 -- 172.21.15.50:0/1133537224 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5928102190 con 0x7f5928109bb0 2024-08-31T04:20:40.715 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:40.714+0000 7f5926000640 1 -- 172.21.15.50:0/1133537224 <== mon.2 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 16) ==== 152577+0+0 (secure 0 0 0) 0x7f5920005000 con 0x7f5928109bb0 2024-08-31T04:20:40.717 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:40.716+0000 7f5926000640 1 --2- 172.21.15.50:0/1133537224 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f59100b4b30 0x7f59100b7040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:20:40.717 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:40.716+0000 7f5926000640 1 -- 172.21.15.50:0/1133537224 <== mon.2 v2:172.21.15.133:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 7497+0+0 (secure 0 0 0) 0x7f59200e55d0 con 0x7f5928109bb0 2024-08-31T04:20:40.717 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:40.716+0000 7f592d400640 1 --2- 172.21.15.50:0/1133537224 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f59100b4b30 0x7f59100b7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:20:40.718 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:40.717+0000 7f592d400640 1 --2- 172.21.15.50:0/1133537224 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f59100b4b30 0x7f59100b7040 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f591c031440 tx=0x7f591c009560 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:20:40.719 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:40.718+0000 7f5926000640 1 -- 172.21.15.50:0/1133537224 <== mon.2 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f5920056130 con 0x7f5928109bb0 2024-08-31T04:20:40.917 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:40.916+0000 7f592fe00640 1 -- 172.21.15.50:0/1133537224 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f592819d560 con 0x7f5928109bb0 2024-08-31T04:20:41.200 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:20:40 smithi050 ceph-mon[17259]: pgmap v292: 33 pgs: 5 creating+peering, 27 unknown, 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T04:20:41.200 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:20:40 smithi050 ceph-mon[17259]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-08-31T04:20:41.200 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:20:40 smithi050 ceph-mon[17259]: osdmap e71: 12 total, 12 up, 12 in 2024-08-31T04:20:41.246 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:20:40 smithi177 ceph-mon[22025]: pgmap v292: 33 pgs: 5 creating+peering, 27 unknown, 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T04:20:41.246 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:20:40 smithi177 ceph-mon[22025]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-08-31T04:20:41.246 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:20:40 smithi177 ceph-mon[22025]: osdmap e71: 12 total, 12 up, 12 in 2024-08-31T04:20:41.293 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:20:40 smithi133 ceph-mon[22177]: pgmap v292: 33 pgs: 5 creating+peering, 27 unknown, 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T04:20:41.293 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:20:40 smithi133 ceph-mon[22177]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-08-31T04:20:41.293 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:20:40 smithi133 ceph-mon[22177]: osdmap e71: 12 total, 12 up, 12 in 2024-08-31T04:20:41.920 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:41.918+0000 7f5926000640 1 -- 172.21.15.50:0/1133537224 <== mon.2 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v73) ==== 170+0+0 (secure 0 0 0) 0x7f592819d560 con 0x7f5928109bb0 2024-08-31T04:20:41.924 INFO:teuthology.orchestra.run.smithi050.stderr:pool 'cephfs_data' created 2024-08-31T04:20:41.927 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:41.926+0000 7f592fe00640 1 -- 172.21.15.50:0/1133537224 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f59100b4b30 msgr2=0x7f59100b7040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:20:41.927 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:41.926+0000 7f592fe00640 1 --2- 172.21.15.50:0/1133537224 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f59100b4b30 0x7f59100b7040 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f591c031440 tx=0x7f591c009560 comp rx=0 tx=0).stop 2024-08-31T04:20:41.928 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:41.926+0000 7f592fe00640 1 -- 172.21.15.50:0/1133537224 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5928109bb0 msgr2=0x7f59281a1c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:20:41.928 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:41.926+0000 7f592fe00640 1 --2- 172.21.15.50:0/1133537224 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5928109bb0 0x7f59281a1c70 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f592000eb10 tx=0x7f592000c2d0 comp rx=0 tx=0).stop 2024-08-31T04:20:41.928 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:41.927+0000 7f592fe00640 1 -- 172.21.15.50:0/1133537224 shutdown_connections 2024-08-31T04:20:41.928 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:41.927+0000 7f592fe00640 1 --2- 172.21.15.50:0/1133537224 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f59100b4b30 0x7f59100b7040 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:20:41.928 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:41.927+0000 7f592fe00640 1 --2- 172.21.15.50:0/1133537224 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5928109bb0 0x7f59281a1c70 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:20:41.929 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:41.927+0000 7f592fe00640 1 --2- 172.21.15.50:0/1133537224 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5928109260 0x7f592819c9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:20:41.929 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:41.927+0000 7f592fe00640 1 --2- 172.21.15.50:0/1133537224 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5928101d80 0x7f592819c430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:20:41.929 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:41.927+0000 7f592fe00640 1 -- 172.21.15.50:0/1133537224 >> 172.21.15.50:0/1133537224 conn(0x7f5928077960 msgr2=0x7f5928100ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:20:41.929 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:41.927+0000 7f592fe00640 1 -- 172.21.15.50:0/1133537224 shutdown_connections 2024-08-31T04:20:41.929 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:41.928+0000 7f592fe00640 1 -- 172.21.15.50:0/1133537224 wait complete. 2024-08-31T04:20:42.200 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:20:41 smithi050 ceph-mon[17259]: osdmap e72: 12 total, 12 up, 12 in 2024-08-31T04:20:42.200 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:20:41 smithi050 ceph-mon[17259]: from='client.? 172.21.15.50:0/1133537224' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} : dispatch 2024-08-31T04:20:42.200 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:20:41 smithi050 ceph-mon[17259]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} : dispatch 2024-08-31T04:20:42.246 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:20:41 smithi177 ceph-mon[22025]: osdmap e72: 12 total, 12 up, 12 in 2024-08-31T04:20:42.246 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:20:41 smithi177 ceph-mon[22025]: from='client.? 172.21.15.50:0/1133537224' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} : dispatch 2024-08-31T04:20:42.246 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:20:41 smithi177 ceph-mon[22025]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} : dispatch 2024-08-31T04:20:42.293 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:20:41 smithi133 ceph-mon[22177]: osdmap e72: 12 total, 12 up, 12 in 2024-08-31T04:20:42.293 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:20:41 smithi133 ceph-mon[22177]: from='client.? 172.21.15.50:0/1133537224' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} : dispatch 2024-08-31T04:20:42.293 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:20:41 smithi133 ceph-mon[22177]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} : dispatch 2024-08-31T04:20:42.841 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 058d9fc6-674f-11ef-bcd4-c7b262605968 -- ceph fs new cephfs cephfs_metadata cephfs_data 2024-08-31T04:20:43.194 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:20:42 smithi133 ceph-mon[22177]: pgmap v295: 33 pgs: 27 active+clean, 5 creating+peering, 1 unknown; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T04:20:43.194 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:20:42 smithi133 ceph-mon[22177]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-08-31T04:20:43.194 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:20:42 smithi133 ceph-mon[22177]: osdmap e73: 12 total, 12 up, 12 in 2024-08-31T04:20:43.200 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:20:42 smithi050 ceph-mon[17259]: pgmap v295: 33 pgs: 27 active+clean, 5 creating+peering, 1 unknown; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T04:20:43.200 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:20:42 smithi050 ceph-mon[17259]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-08-31T04:20:43.200 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:20:42 smithi050 ceph-mon[17259]: osdmap e73: 12 total, 12 up, 12 in 2024-08-31T04:20:43.244 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:20:43.246 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:20:42 smithi177 ceph-mon[22025]: pgmap v295: 33 pgs: 27 active+clean, 5 creating+peering, 1 unknown; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T04:20:43.246 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:20:42 smithi177 ceph-mon[22025]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-08-31T04:20:43.246 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:20:42 smithi177 ceph-mon[22025]: osdmap e73: 12 total, 12 up, 12 in 2024-08-31T04:20:43.886 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:43.884+0000 7f556fa00640 1 -- 172.21.15.50:0/2734038018 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f556810bdb0 msgr2=0x7f55681125e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:20:43.886 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:43.884+0000 7f556fa00640 1 --2- 172.21.15.50:0/2734038018 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f556810bdb0 0x7f55681125e0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f5560009be0 tx=0x7f556002a6c0 comp rx=0 tx=0).stop 2024-08-31T04:20:43.886 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:43.884+0000 7f556fa00640 1 -- 172.21.15.50:0/2734038018 shutdown_connections 2024-08-31T04:20:43.886 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:43.884+0000 7f556fa00640 1 --2- 172.21.15.50:0/2734038018 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f556810b460 0x7f556810b870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:20:43.886 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:43.884+0000 7f556fa00640 1 --2- 172.21.15.50:0/2734038018 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f556810bdb0 0x7f55681125e0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:20:43.887 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:43.884+0000 7f556fa00640 1 --2- 172.21.15.50:0/2734038018 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5568105b20 0x7f5568105f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:20:43.887 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:43.884+0000 7f556fa00640 1 -- 172.21.15.50:0/2734038018 >> 172.21.15.50:0/2734038018 conn(0x7f55681015b0 msgr2=0x7f5568103a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:20:43.887 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:43.884+0000 7f556fa00640 1 -- 172.21.15.50:0/2734038018 shutdown_connections 2024-08-31T04:20:43.887 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:43.884+0000 7f556fa00640 1 -- 172.21.15.50:0/2734038018 wait complete. 2024-08-31T04:20:43.887 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:43.886+0000 7f556fa00640 1 Processor -- start 2024-08-31T04:20:43.887 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:43.886+0000 7f556fa00640 1 -- start start 2024-08-31T04:20:43.888 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:43.886+0000 7f556fa00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5568105b20 0x7f556819c400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:20:43.888 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:43.886+0000 7f556fa00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f556810b460 0x7f556819c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:20:43.888 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:43.886+0000 7f556fa00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f556810bdb0 0x7f55681a1c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:20:43.888 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:43.886+0000 7f556fa00640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f5568115a70 con 0x7f556810bdb0 2024-08-31T04:20:43.888 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:43.886+0000 7f556fa00640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f55681158f0 con 0x7f556810b460 2024-08-31T04:20:43.888 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:43.886+0000 7f556fa00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f5568115bf0 con 0x7f5568105b20 2024-08-31T04:20:43.889 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:43.887+0000 7f5567e00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f556810b460 0x7f556819c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:20:43.889 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:43.887+0000 7f556da00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f556810bdb0 0x7f55681a1c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:20:43.889 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:43.887+0000 7f5567e00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f556810b460 0x7f556819c9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.50:60834/0 (socket says 172.21.15.50:60834) 2024-08-31T04:20:43.889 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:43.887+0000 7f556d000640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5568105b20 0x7f556819c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:20:43.889 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:43.887+0000 7f5567e00640 1 -- 172.21.15.50:0/2566506672 learned_addr learned my addr 172.21.15.50:0/2566506672 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:20:43.889 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:43.887+0000 7f5567e00640 1 -- 172.21.15.50:0/2566506672 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5568105b20 msgr2=0x7f556819c400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:20:43.890 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:43.887+0000 7f5567e00640 1 --2- 172.21.15.50:0/2566506672 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5568105b20 0x7f556819c400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:20:43.890 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:43.887+0000 7f5567e00640 1 -- 172.21.15.50:0/2566506672 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f556810bdb0 msgr2=0x7f55681a1c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:20:43.890 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:43.887+0000 7f5567e00640 1 --2- 172.21.15.50:0/2566506672 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f556810bdb0 0x7f55681a1c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:20:43.890 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:43.887+0000 7f5567e00640 1 -- 172.21.15.50:0/2566506672 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55681a2370 con 0x7f556810b460 2024-08-31T04:20:43.890 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:43.888+0000 7f5567e00640 1 --2- 172.21.15.50:0/2566506672 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f556810b460 0x7f556819c9a0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f555400d740 tx=0x7f555400dc00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:20:43.890 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:43.888+0000 7f5565600640 1 -- 172.21.15.50:0/2566506672 <== mon.2 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5554017070 con 0x7f556810b460 2024-08-31T04:20:43.890 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:43.888+0000 7f5565600640 1 -- 172.21.15.50:0/2566506672 <== mon.2 v2:172.21.15.133:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f555400de50 con 0x7f556810b460 2024-08-31T04:20:43.890 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:43.888+0000 7f556fa00640 1 -- 172.21.15.50:0/2566506672 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f55681a2660 con 0x7f556810b460 2024-08-31T04:20:43.890 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:43.888+0000 7f5565600640 1 -- 172.21.15.50:0/2566506672 <== mon.2 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f555400f620 con 0x7f556810b460 2024-08-31T04:20:43.890 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:43.888+0000 7f556fa00640 1 -- 172.21.15.50:0/2566506672 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f55681a8dc0 con 0x7f556810b460 2024-08-31T04:20:43.891 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:43.890+0000 7f556fa00640 1 -- 172.21.15.50:0/2566506672 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5568105f30 con 0x7f556810b460 2024-08-31T04:20:43.897 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:43.892+0000 7f5565600640 1 -- 172.21.15.50:0/2566506672 <== mon.2 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 16) ==== 152577+0+0 (secure 0 0 0) 0x7f555401a070 con 0x7f556810b460 2024-08-31T04:20:43.897 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:43.894+0000 7f5565600640 1 --2- 172.21.15.50:0/2566506672 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f55500b4b30 0x7f55500b7040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:20:43.897 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:43.894+0000 7f5565600640 1 -- 172.21.15.50:0/2566506672 <== mon.2 v2:172.21.15.133:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7879+0+0 (secure 0 0 0) 0x7f55540e4990 con 0x7f556810b460 2024-08-31T04:20:43.897 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:43.894+0000 7f556d000640 1 --2- 172.21.15.50:0/2566506672 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f55500b4b30 0x7f55500b7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:20:43.897 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:43.895+0000 7f556d000640 1 --2- 172.21.15.50:0/2566506672 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f55500b4b30 0x7f55500b7040 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f555c009530 tx=0x7f555c009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:20:43.898 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:43.897+0000 7f5565600640 1 -- 172.21.15.50:0/2566506672 <== mon.2 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f55540ab580 con 0x7f556810b460 2024-08-31T04:20:44.140 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:44.138+0000 7f556fa00640 1 -- 172.21.15.50:0/2566506672 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f556810d610 con 0x7f556810b460 2024-08-31T04:20:44.140 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:20:43 smithi050 ceph-mon[17259]: osdmap e74: 12 total, 12 up, 12 in 2024-08-31T04:20:44.246 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:20:43 smithi177 ceph-mon[22025]: osdmap e74: 12 total, 12 up, 12 in 2024-08-31T04:20:44.293 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:20:43 smithi133 ceph-mon[22177]: osdmap e74: 12 total, 12 up, 12 in 2024-08-31T04:20:44.945 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:44.944+0000 7f5565600640 1 -- 172.21.15.50:0/2566506672 <== mon.2 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v14) ==== 172+0+0 (secure 0 0 0) 0x7f55540b4110 con 0x7f556810b460 2024-08-31T04:20:44.945 INFO:teuthology.orchestra.run.smithi050.stderr:new fs with metadata pool 2 and data pool 3 2024-08-31T04:20:44.948 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:44.946+0000 7f556fa00640 1 -- 172.21.15.50:0/2566506672 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f55500b4b30 msgr2=0x7f55500b7040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:20:44.948 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:44.946+0000 7f556fa00640 1 --2- 172.21.15.50:0/2566506672 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f55500b4b30 0x7f55500b7040 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f555c009530 tx=0x7f555c009260 comp rx=0 tx=0).stop 2024-08-31T04:20:44.948 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:44.946+0000 7f556fa00640 1 -- 172.21.15.50:0/2566506672 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f556810b460 msgr2=0x7f556819c9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:20:44.948 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:44.946+0000 7f556fa00640 1 --2- 172.21.15.50:0/2566506672 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f556810b460 0x7f556819c9a0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f555400d740 tx=0x7f555400dc00 comp rx=0 tx=0).stop 2024-08-31T04:20:44.948 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:44.947+0000 7f556fa00640 1 -- 172.21.15.50:0/2566506672 shutdown_connections 2024-08-31T04:20:44.948 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:44.947+0000 7f556fa00640 1 --2- 172.21.15.50:0/2566506672 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f55500b4b30 0x7f55500b7040 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:20:44.948 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:44.947+0000 7f556fa00640 1 --2- 172.21.15.50:0/2566506672 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f556810bdb0 0x7f55681a1c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:20:44.949 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:44.947+0000 7f556fa00640 1 --2- 172.21.15.50:0/2566506672 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f556810b460 0x7f556819c9a0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:20:44.949 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:44.947+0000 7f556fa00640 1 --2- 172.21.15.50:0/2566506672 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5568105b20 0x7f556819c400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:20:44.949 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:44.947+0000 7f556fa00640 1 -- 172.21.15.50:0/2566506672 >> 172.21.15.50:0/2566506672 conn(0x7f55681015b0 msgr2=0x7f556810aad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:20:44.949 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:44.947+0000 7f556fa00640 1 -- 172.21.15.50:0/2566506672 shutdown_connections 2024-08-31T04:20:44.949 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:44.947+0000 7f556fa00640 1 -- 172.21.15.50:0/2566506672 wait complete. 2024-08-31T04:20:45.200 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:20:44 smithi050 ceph-mon[17259]: pgmap v298: 97 pgs: 28 active+clean, 19 creating+peering, 50 unknown; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T04:20:45.200 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:20:44 smithi050 ceph-mon[17259]: osdmap e75: 12 total, 12 up, 12 in 2024-08-31T04:20:45.200 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:20:44 smithi050 ceph-mon[17259]: from='client.? 172.21.15.50:0/2566506672' entity='client.admin' cmd={"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} : dispatch 2024-08-31T04:20:45.200 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:20:44 smithi050 ceph-mon[17259]: from='client.? ' entity='client.admin' cmd={"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} : dispatch 2024-08-31T04:20:45.200 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:20:44 smithi050 ceph-mon[17259]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-08-31T04:20:45.246 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:20:44 smithi177 ceph-mon[22025]: pgmap v298: 97 pgs: 28 active+clean, 19 creating+peering, 50 unknown; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T04:20:45.246 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:20:44 smithi177 ceph-mon[22025]: osdmap e75: 12 total, 12 up, 12 in 2024-08-31T04:20:45.246 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:20:44 smithi177 ceph-mon[22025]: from='client.? 172.21.15.50:0/2566506672' entity='client.admin' cmd={"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} : dispatch 2024-08-31T04:20:45.246 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:20:44 smithi177 ceph-mon[22025]: from='client.? ' entity='client.admin' cmd={"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} : dispatch 2024-08-31T04:20:45.246 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:20:44 smithi177 ceph-mon[22025]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-08-31T04:20:45.293 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:20:44 smithi133 ceph-mon[22177]: pgmap v298: 97 pgs: 28 active+clean, 19 creating+peering, 50 unknown; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T04:20:45.293 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:20:44 smithi133 ceph-mon[22177]: osdmap e75: 12 total, 12 up, 12 in 2024-08-31T04:20:45.293 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:20:44 smithi133 ceph-mon[22177]: from='client.? 172.21.15.50:0/2566506672' entity='client.admin' cmd={"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} : dispatch 2024-08-31T04:20:45.293 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:20:44 smithi133 ceph-mon[22177]: from='client.? ' entity='client.admin' cmd={"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} : dispatch 2024-08-31T04:20:45.293 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:20:44 smithi133 ceph-mon[22177]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-08-31T04:20:45.869 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 058d9fc6-674f-11ef-bcd4-c7b262605968 -- ceph osd dump --format=json 2024-08-31T04:20:46.200 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:20:45 smithi050 ceph-mon[17259]: osdmap e76: 12 total, 12 up, 12 in 2024-08-31T04:20:46.200 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:20:45 smithi050 ceph-mon[17259]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-08-31T04:20:46.200 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:20:45 smithi050 ceph-mon[17259]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-08-31T04:20:46.200 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:20:45 smithi050 ceph-mon[17259]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-08-31T04:20:46.200 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:20:45 smithi050 ceph-mon[17259]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-08-31T04:20:46.200 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:20:45 smithi050 ceph-mon[17259]: mds.? [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] up:active 2024-08-31T04:20:46.200 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:20:45 smithi050 ceph-mon[17259]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-08-31T04:20:46.246 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:20:45 smithi177 ceph-mon[22025]: osdmap e76: 12 total, 12 up, 12 in 2024-08-31T04:20:46.246 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:20:45 smithi177 ceph-mon[22025]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-08-31T04:20:46.246 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:20:45 smithi177 ceph-mon[22025]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-08-31T04:20:46.246 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:20:45 smithi177 ceph-mon[22025]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-08-31T04:20:46.246 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:20:45 smithi177 ceph-mon[22025]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-08-31T04:20:46.247 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:20:45 smithi177 ceph-mon[22025]: mds.? [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] up:active 2024-08-31T04:20:46.247 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:20:45 smithi177 ceph-mon[22025]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-08-31T04:20:46.250 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:20:46.293 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:20:45 smithi133 ceph-mon[22177]: osdmap e76: 12 total, 12 up, 12 in 2024-08-31T04:20:46.293 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:20:45 smithi133 ceph-mon[22177]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-08-31T04:20:46.293 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:20:45 smithi133 ceph-mon[22177]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-08-31T04:20:46.293 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:20:45 smithi133 ceph-mon[22177]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-08-31T04:20:46.293 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:20:45 smithi133 ceph-mon[22177]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-08-31T04:20:46.293 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:20:45 smithi133 ceph-mon[22177]: mds.? [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] up:active 2024-08-31T04:20:46.293 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:20:45 smithi133 ceph-mon[22177]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-08-31T04:20:46.905 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:46.903+0000 7f0591000640 1 -- 172.21.15.50:0/2350842162 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f058c103900 msgr2=0x7f058c103d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:20:46.906 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:46.903+0000 7f0591000640 1 --2- 172.21.15.50:0/2350842162 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f058c103900 0x7f058c103d10 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f057c009900 tx=0x7f057c02a410 comp rx=0 tx=0).stop 2024-08-31T04:20:46.906 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:46.903+0000 7f0591000640 1 -- 172.21.15.50:0/2350842162 shutdown_connections 2024-08-31T04:20:46.906 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:46.903+0000 7f0591000640 1 --2- 172.21.15.50:0/2350842162 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f058c109b90 0x7f058c1103c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:20:46.906 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:46.903+0000 7f0591000640 1 --2- 172.21.15.50:0/2350842162 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f058c109240 0x7f058c109650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:20:46.906 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:46.903+0000 7f0591000640 1 --2- 172.21.15.50:0/2350842162 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f058c103900 0x7f058c103d10 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:20:46.907 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:46.903+0000 7f0591000640 1 -- 172.21.15.50:0/2350842162 >> 172.21.15.50:0/2350842162 conn(0x7f058c07b5f0 msgr2=0x7f058c07ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:20:46.907 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:46.903+0000 7f0591000640 1 -- 172.21.15.50:0/2350842162 shutdown_connections 2024-08-31T04:20:46.907 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:46.903+0000 7f0591000640 1 -- 172.21.15.50:0/2350842162 wait complete. 2024-08-31T04:20:46.909 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:46.905+0000 7f0591000640 1 Processor -- start 2024-08-31T04:20:46.909 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:46.905+0000 7f0591000640 1 -- start start 2024-08-31T04:20:46.909 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:46.905+0000 7f0591000640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f058c103900 0x7f058c0754b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:20:46.910 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:46.905+0000 7f0591000640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f058c109240 0x7f058c0759f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:20:46.910 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:46.905+0000 7f0591000640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f058c109b90 0x7f058c075f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:20:46.910 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:46.905+0000 7f0591000640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f058c1138a0 con 0x7f058c109b90 2024-08-31T04:20:46.910 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:46.905+0000 7f0591000640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f058c113720 con 0x7f058c109240 2024-08-31T04:20:46.910 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:46.905+0000 7f0591000640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f058c113a20 con 0x7f058c103900 2024-08-31T04:20:46.910 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:46.905+0000 7f0589e00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f058c103900 0x7f058c0754b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:20:46.910 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:46.906+0000 7f0589e00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f058c103900 0x7f058c0754b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.50:44256/0 (socket says 172.21.15.50:44256) 2024-08-31T04:20:46.911 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:46.906+0000 7f0589e00640 1 -- 172.21.15.50:0/4205720545 learned_addr learned my addr 172.21.15.50:0/4205720545 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:20:46.911 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:46.906+0000 7f058a800640 1 --2- 172.21.15.50:0/4205720545 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f058c109b90 0x7f058c075f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:20:46.911 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:46.906+0000 7f0583e00640 1 --2- 172.21.15.50:0/4205720545 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f058c109240 0x7f058c0759f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:20:46.911 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:46.906+0000 7f058a800640 1 -- 172.21.15.50:0/4205720545 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f058c103900 msgr2=0x7f058c0754b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:20:46.911 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:46.906+0000 7f058a800640 1 --2- 172.21.15.50:0/4205720545 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f058c103900 0x7f058c0754b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:20:46.911 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:46.906+0000 7f058a800640 1 -- 172.21.15.50:0/4205720545 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f058c109240 msgr2=0x7f058c0759f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:20:46.911 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:46.906+0000 7f058a800640 1 --2- 172.21.15.50:0/4205720545 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f058c109240 0x7f058c0759f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:20:46.911 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:46.906+0000 7f058a800640 1 -- 172.21.15.50:0/4205720545 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f058c1a84b0 con 0x7f058c109b90 2024-08-31T04:20:46.911 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:46.906+0000 7f0583e00640 1 --2- 172.21.15.50:0/4205720545 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f058c109240 0x7f058c0759f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:20:46.912 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:46.906+0000 7f058a800640 1 --2- 172.21.15.50:0/4205720545 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f058c109b90 0x7f058c075f30 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f0584009fd0 tx=0x7f058400ef10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:20:46.912 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:46.907+0000 7f0582a00640 1 -- 172.21.15.50:0/4205720545 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f058400ce20 con 0x7f058c109b90 2024-08-31T04:20:46.912 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:46.907+0000 7f0591000640 1 -- 172.21.15.50:0/4205720545 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f058c1a87a0 con 0x7f058c109b90 2024-08-31T04:20:46.912 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:46.907+0000 7f0582a00640 1 -- 172.21.15.50:0/4205720545 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0584005020 con 0x7f058c109b90 2024-08-31T04:20:46.912 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:46.907+0000 7f0582a00640 1 -- 172.21.15.50:0/4205720545 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0584018670 con 0x7f058c109b90 2024-08-31T04:20:46.912 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:46.907+0000 7f0591000640 1 -- 172.21.15.50:0/4205720545 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f058c1a8c90 con 0x7f058c109b90 2024-08-31T04:20:46.912 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:46.908+0000 7f0591000640 1 -- 172.21.15.50:0/4205720545 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f058c103d10 con 0x7f058c109b90 2024-08-31T04:20:46.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:46.912+0000 7f0582a00640 1 -- 172.21.15.50:0/4205720545 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 16) ==== 152577+0+0 (secure 0 0 0) 0x7f05840054d0 con 0x7f058c109b90 2024-08-31T04:20:46.915 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:46.914+0000 7f0582a00640 1 --2- 172.21.15.50:0/4205720545 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f05700b4b30 0x7f05700b7040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:20:46.915 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:46.914+0000 7f0582a00640 1 -- 172.21.15.50:0/4205720545 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 7979+0+0 (secure 0 0 0) 0x7f05840e5800 con 0x7f058c109b90 2024-08-31T04:20:46.916 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:46.914+0000 7f0589e00640 1 --2- 172.21.15.50:0/4205720545 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f05700b4b30 0x7f05700b7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:20:46.916 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:46.915+0000 7f0589e00640 1 --2- 172.21.15.50:0/4205720545 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f05700b4b30 0x7f05700b7040 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f057c005ec0 tx=0x7f057c005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:20:46.918 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:46.917+0000 7f0582a00640 1 -- 172.21.15.50:0/4205720545 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f0584055130 con 0x7f058c109b90 2024-08-31T04:20:46.937 INFO:journalctl@ceph.mds.b.smithi133.stdout:Aug 31 04:20:46 smithi133 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-mds-b[52113]: 2024-08-31T04:20:46.682+0000 7ff08470f640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-08-31T04:20:47.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:47.116+0000 7f0591000640 1 -- 172.21.15.50:0/4205720545 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f058c0767b0 con 0x7f058c109b90 2024-08-31T04:20:47.118 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:20:46 smithi050 ceph-mon[17259]: pgmap v301: 97 pgs: 75 active+clean, 14 creating+peering, 8 unknown; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s wr, 7 op/s 2024-08-31T04:20:47.118 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:20:46 smithi050 ceph-mon[17259]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-08-31T04:20:47.118 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:20:46 smithi050 ceph-mon[17259]: Cluster is now healthy 2024-08-31T04:20:47.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:47.117+0000 7f0582a00640 1 -- 172.21.15.50:0/4205720545 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v76) ==== 74+0+22281 (secure 0 0 0) 0x7f05840aca70 con 0x7f058c109b90 2024-08-31T04:20:47.120 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-08-31T04:20:47.120 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":76,"fsid":"058d9fc6-674f-11ef-bcd4-c7b262605968","created":"2024-08-31T04:11:59.576131+0000","modified":"2024-08-31T04:20:44.140795+0000","last_up_change":"2024-08-31T04:19:44.619590+0000","last_in_change":"2024-08-31T04:19:21.022096+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-31T04:15:46.229142+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-31T04:20:38.249458+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"76","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-31T04:20:40.929092+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"76","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"416ecbde-4a7b-4bd1-b377-490925a33ce1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":3831273843},{"type":"v1","addr":"172.21.15.50:6803","nonce":3831273843}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":3831273843},{"type":"v1","addr":"172.21.15.50:6805","nonce":3831273843}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":3831273843},{"type":"v1","addr":"172.21.15.50:6809","nonce":3831273843}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":3831273843},{"type":"v1","addr":"172.21.15.50:6807","nonce":3831273843}]},"public_addr":"172.21.15.50:6803/3831273843","cluster_addr":"172.21.15.50:6805/3831273843","heartbeat_back_addr":"172.21.15.50:6809/3831273843","heartbeat_front_addr":"172.21.15.50:6807/3831273843","state":["exists","up"]},{"osd":1,"uuid":"5e008006-004d-4842-9885-93a2d27be1cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":475308203},{"type":"v1","addr":"172.21.15.133:6801","nonce":475308203}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":475308203},{"type":"v1","addr":"172.21.15.133:6803","nonce":475308203}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":475308203},{"type":"v1","addr":"172.21.15.133:6807","nonce":475308203}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":475308203},{"type":"v1","addr":"172.21.15.133:6805","nonce":475308203}]},"public_addr":"172.21.15.133:6801/475308203","cluster_addr":"172.21.15.133:6803/475308203","heartbeat_back_addr":"172.21.15.133:6807/475308203","heartbeat_front_addr":"172.21.15.133:6805/475308203","state":["exists","up"]},{"osd":2,"uuid":"7e6f1a26-f30d-4822-af69-8a08cb89fbce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":3091173426},{"type":"v1","addr":"172.21.15.177:6801","nonce":3091173426}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":3091173426},{"type":"v1","addr":"172.21.15.177:6803","nonce":3091173426}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":3091173426},{"type":"v1","addr":"172.21.15.177:6807","nonce":3091173426}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":3091173426},{"type":"v1","addr":"172.21.15.177:6805","nonce":3091173426}]},"public_addr":"172.21.15.177:6801/3091173426","cluster_addr":"172.21.15.177:6803/3091173426","heartbeat_back_addr":"172.21.15.177:6807/3091173426","heartbeat_front_addr":"172.21.15.177:6805/3091173426","state":["exists","up"]},{"osd":3,"uuid":"8193c2a2-18a1-4684-9a16-cbeae25530ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":3792992620},{"type":"v1","addr":"172.21.15.50:6811","nonce":3792992620}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":3792992620},{"type":"v1","addr":"172.21.15.50:6813","nonce":3792992620}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":3792992620},{"type":"v1","addr":"172.21.15.50:6817","nonce":3792992620}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":3792992620},{"type":"v1","addr":"172.21.15.50:6815","nonce":3792992620}]},"public_addr":"172.21.15.50:6811/3792992620","cluster_addr":"172.21.15.50:6813/3792992620","heartbeat_back_addr":"172.21.15.50:6817/3792992620","heartbeat_front_addr":"172.21.15.50:6815/3792992620","state":["exists","up"]},{"osd":4,"uuid":"2a2b4e64-0f8e-40ec-926c-84dbf691aefe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":2855333596},{"type":"v1","addr":"172.21.15.133:6809","nonce":2855333596}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":2855333596},{"type":"v1","addr":"172.21.15.133:6811","nonce":2855333596}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":2855333596},{"type":"v1","addr":"172.21.15.133:6815","nonce":2855333596}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":2855333596},{"type":"v1","addr":"172.21.15.133:6813","nonce":2855333596}]},"public_addr":"172.21.15.133:6809/2855333596","cluster_addr":"172.21.15.133:6811/2855333596","heartbeat_back_addr":"172.21.15.133:6815/2855333596","heartbeat_front_addr":"172.21.15.133:6813/2855333596","state":["exists","up"]},{"osd":5,"uuid":"83429ff0-ea7d-4fcc-9611-39d9001aa216","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":1166415084},{"type":"v1","addr":"172.21.15.177:6809","nonce":1166415084}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":1166415084},{"type":"v1","addr":"172.21.15.177:6811","nonce":1166415084}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":1166415084},{"type":"v1","addr":"172.21.15.177:6815","nonce":1166415084}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":1166415084},{"type":"v1","addr":"172.21.15.177:6813","nonce":1166415084}]},"public_addr":"172.21.15.177:6809/1166415084","cluster_addr":"172.21.15.177:6811/1166415084","heartbeat_back_addr":"172.21.15.177:6815/1166415084","heartbeat_front_addr":"172.21.15.177:6813/1166415084","state":["exists","up"]},{"osd":6,"uuid":"eeb571ef-5e43-4816-95dd-d01d83aeca83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":1429341184},{"type":"v1","addr":"172.21.15.50:6819","nonce":1429341184}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":1429341184},{"type":"v1","addr":"172.21.15.50:6821","nonce":1429341184}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":1429341184},{"type":"v1","addr":"172.21.15.50:6825","nonce":1429341184}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":1429341184},{"type":"v1","addr":"172.21.15.50:6823","nonce":1429341184}]},"public_addr":"172.21.15.50:6819/1429341184","cluster_addr":"172.21.15.50:6821/1429341184","heartbeat_back_addr":"172.21.15.50:6825/1429341184","heartbeat_front_addr":"172.21.15.50:6823/1429341184","state":["exists","up"]},{"osd":7,"uuid":"512ee507-0d50-4fed-b692-dbdf23a93e8e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":3643454923},{"type":"v1","addr":"172.21.15.133:6817","nonce":3643454923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":3643454923},{"type":"v1","addr":"172.21.15.133:6819","nonce":3643454923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":3643454923},{"type":"v1","addr":"172.21.15.133:6823","nonce":3643454923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":3643454923},{"type":"v1","addr":"172.21.15.133:6821","nonce":3643454923}]},"public_addr":"172.21.15.133:6817/3643454923","cluster_addr":"172.21.15.133:6819/3643454923","heartbeat_back_addr":"172.21.15.133:6823/3643454923","heartbeat_front_addr":"172.21.15.133:6821/3643454923","state":["exists","up"]},{"osd":8,"uuid":"ae99526e-41da-4cb5-857f-2e66f18f2d94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6816","nonce":101973300},{"type":"v1","addr":"172.21.15.177:6817","nonce":101973300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":101973300},{"type":"v1","addr":"172.21.15.177:6819","nonce":101973300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":101973300},{"type":"v1","addr":"172.21.15.177:6823","nonce":101973300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":101973300},{"type":"v1","addr":"172.21.15.177:6821","nonce":101973300}]},"public_addr":"172.21.15.177:6817/101973300","cluster_addr":"172.21.15.177:6819/101973300","heartbeat_back_addr":"172.21.15.177:6823/101973300","heartbeat_front_addr":"172.21.15.177:6821/101973300","state":["exists","up"]},{"osd":9,"uuid":"fcedbe16-b910-407f-b9d7-1dd03f3e62a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":53019860},{"type":"v1","addr":"172.21.15.50:6827","nonce":53019860}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":53019860},{"type":"v1","addr":"172.21.15.50:6829","nonce":53019860}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":53019860},{"type":"v1","addr":"172.21.15.50:6833","nonce":53019860}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":53019860},{"type":"v1","addr":"172.21.15.50:6831","nonce":53019860}]},"public_addr":"172.21.15.50:6827/53019860","cluster_addr":"172.21.15.50:6829/53019860","heartbeat_back_addr":"172.21.15.50:6833/53019860","heartbeat_front_addr":"172.21.15.50:6831/53019860","state":["exists","up"]},{"osd":10,"uuid":"3852756e-62f1-4e71-a070-8cff76df99b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":4175566493},{"type":"v1","addr":"172.21.15.133:6825","nonce":4175566493}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":4175566493},{"type":"v1","addr":"172.21.15.133:6827","nonce":4175566493}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":4175566493},{"type":"v1","addr":"172.21.15.133:6831","nonce":4175566493}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":4175566493},{"type":"v1","addr":"172.21.15.133:6829","nonce":4175566493}]},"public_addr":"172.21.15.133:6825/4175566493","cluster_addr":"172.21.15.133:6827/4175566493","heartbeat_back_addr":"172.21.15.133:6831/4175566493","heartbeat_front_addr":"172.21.15.133:6829/4175566493","state":["exists","up"]},{"osd":11,"uuid":"a154180a-5f2a-4b33-ad3d-fea7317597ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":2103454982},{"type":"v1","addr":"172.21.15.177:6825","nonce":2103454982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":2103454982},{"type":"v1","addr":"172.21.15.177:6827","nonce":2103454982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":2103454982},{"type":"v1","addr":"172.21.15.177:6831","nonce":2103454982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":2103454982},{"type":"v1","addr":"172.21.15.177:6829","nonce":2103454982}]},"public_addr":"172.21.15.177:6825/2103454982","cluster_addr":"172.21.15.177:6827/2103454982","heartbeat_back_addr":"172.21.15.177:6831/2103454982","heartbeat_front_addr":"172.21.15.177:6829/2103454982","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:14:54.683660+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:15:20.007319+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:15:43.613426+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:16:12.387010+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:16:38.079210+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:17:02.750375+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:17:31.735810+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:17:57.600985+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:18:22.503347+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:18:52.316657+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:19:18.444623+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:19:42.331006+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.50:6801/1319056820":"2024-09-01T04:12:55.742020+0000","172.21.15.50:0/1755103674":"2024-09-01T04:12:55.742020+0000","172.21.15.50:6800/1319056820":"2024-09-01T04:12:55.742020+0000","172.21.15.50:0/3701412233":"2024-09-01T04:12:55.742020+0000","172.21.15.50:0/1829556336":"2024-09-01T04:12:55.742020+0000","172.21.15.50:0/1698995126":"2024-09-01T04:12:25.753831+0000","172.21.15.50:0/1554317941":"2024-09-01T04:12:25.753831+0000","172.21.15.50:0/2998110380":"2024-09-01T04:12:25.753831+0000","172.21.15.50:6801/4197277793":"2024-09-01T04:12:25.753831+0000","172.21.15.50:6800/4197277793":"2024-09-01T04:12:25.753831+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-31T04:20:47.122 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:47.120+0000 7f0591000640 1 -- 172.21.15.50:0/4205720545 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f05700b4b30 msgr2=0x7f05700b7040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:20:47.122 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:47.120+0000 7f0591000640 1 --2- 172.21.15.50:0/4205720545 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f05700b4b30 0x7f05700b7040 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f057c005ec0 tx=0x7f057c005a20 comp rx=0 tx=0).stop 2024-08-31T04:20:47.123 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:47.120+0000 7f0591000640 1 -- 172.21.15.50:0/4205720545 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f058c109b90 msgr2=0x7f058c075f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:20:47.123 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:47.120+0000 7f0591000640 1 --2- 172.21.15.50:0/4205720545 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f058c109b90 0x7f058c075f30 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f0584009fd0 tx=0x7f058400ef10 comp rx=0 tx=0).stop 2024-08-31T04:20:47.123 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:47.121+0000 7f0591000640 1 -- 172.21.15.50:0/4205720545 shutdown_connections 2024-08-31T04:20:47.123 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:47.121+0000 7f0591000640 1 --2- 172.21.15.50:0/4205720545 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f05700b4b30 0x7f05700b7040 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:20:47.123 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:47.121+0000 7f0591000640 1 --2- 172.21.15.50:0/4205720545 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f058c109b90 0x7f058c075f30 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:20:47.124 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:47.121+0000 7f0591000640 1 --2- 172.21.15.50:0/4205720545 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f058c109240 0x7f058c0759f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:20:47.124 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:47.121+0000 7f0591000640 1 --2- 172.21.15.50:0/4205720545 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f058c103900 0x7f058c0754b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:20:47.124 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:47.121+0000 7f0591000640 1 -- 172.21.15.50:0/4205720545 >> 172.21.15.50:0/4205720545 conn(0x7f058c07b5f0 msgr2=0x7f058c107290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:20:47.124 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:47.121+0000 7f0591000640 1 -- 172.21.15.50:0/4205720545 shutdown_connections 2024-08-31T04:20:47.124 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:47.121+0000 7f0591000640 1 -- 172.21.15.50:0/4205720545 wait complete. 2024-08-31T04:20:47.246 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:20:46 smithi177 ceph-mon[22025]: pgmap v301: 97 pgs: 75 active+clean, 14 creating+peering, 8 unknown; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s wr, 7 op/s 2024-08-31T04:20:47.246 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:20:46 smithi177 ceph-mon[22025]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-08-31T04:20:47.247 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:20:46 smithi177 ceph-mon[22025]: Cluster is now healthy 2024-08-31T04:20:47.293 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:20:46 smithi133 ceph-mon[22177]: pgmap v301: 97 pgs: 75 active+clean, 14 creating+peering, 8 unknown; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s wr, 7 op/s 2024-08-31T04:20:47.293 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:20:46 smithi133 ceph-mon[22177]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-08-31T04:20:47.293 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:20:46 smithi133 ceph-mon[22177]: Cluster is now healthy 2024-08-31T04:20:47.902 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 058d9fc6-674f-11ef-bcd4-c7b262605968 -- ceph osd dump --format=json 2024-08-31T04:20:48.200 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:20:47 smithi050 ceph-mon[17259]: from='client.? 172.21.15.50:0/4205720545' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-31T04:20:48.246 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:20:47 smithi177 ceph-mon[22025]: from='client.? 172.21.15.50:0/4205720545' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-31T04:20:48.281 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:20:48.293 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:20:47 smithi133 ceph-mon[22177]: from='client.? 172.21.15.50:0/4205720545' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-31T04:20:48.937 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:48.936+0000 7f900a600640 1 -- 172.21.15.50:0/2177017685 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9004109240 msgr2=0x7f9004109650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:20:48.937 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:48.936+0000 7f900a600640 1 --2- 172.21.15.50:0/2177017685 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9004109240 0x7f9004109650 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f8fec009900 tx=0x7f8fec02a410 comp rx=0 tx=0).stop 2024-08-31T04:20:48.938 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:48.936+0000 7f900a600640 1 -- 172.21.15.50:0/2177017685 shutdown_connections 2024-08-31T04:20:48.938 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:48.936+0000 7f900a600640 1 --2- 172.21.15.50:0/2177017685 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9004109b90 0x7f90041103c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:20:48.938 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:48.936+0000 7f900a600640 1 --2- 172.21.15.50:0/2177017685 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9004109240 0x7f9004109650 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:20:48.938 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:48.936+0000 7f900a600640 1 --2- 172.21.15.50:0/2177017685 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9004103900 0x7f9004103d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:20:48.938 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:48.936+0000 7f900a600640 1 -- 172.21.15.50:0/2177017685 >> 172.21.15.50:0/2177017685 conn(0x7f900407b5f0 msgr2=0x7f900407ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:20:48.938 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:48.936+0000 7f900a600640 1 -- 172.21.15.50:0/2177017685 shutdown_connections 2024-08-31T04:20:48.938 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:48.936+0000 7f900a600640 1 -- 172.21.15.50:0/2177017685 wait complete. 2024-08-31T04:20:48.939 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:48.937+0000 7f900a600640 1 Processor -- start 2024-08-31T04:20:48.939 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:48.937+0000 7f900a600640 1 -- start start 2024-08-31T04:20:48.939 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:48.938+0000 7f900a600640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9004103900 0x7f900419c460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:20:48.939 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:48.938+0000 7f900a600640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9004109240 0x7f900419ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:20:48.940 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:48.938+0000 7f900a600640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9004109b90 0x7f90041a1ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:20:48.940 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:48.938+0000 7f900a600640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f9004113850 con 0x7f9004109b90 2024-08-31T04:20:48.940 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:48.938+0000 7f900a600640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f90041136d0 con 0x7f9004109240 2024-08-31T04:20:48.940 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:48.938+0000 7f900a600640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f90041139d0 con 0x7f9004103900 2024-08-31T04:20:48.940 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:48.938+0000 7f9003400640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9004103900 0x7f900419c460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:20:48.940 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:48.938+0000 7f9003400640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9004103900 0x7f900419c460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.50:44274/0 (socket says 172.21.15.50:44274) 2024-08-31T04:20:48.940 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:48.938+0000 7f9003400640 1 -- 172.21.15.50:0/4219011934 learned_addr learned my addr 172.21.15.50:0/4219011934 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:20:48.940 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:48.938+0000 7f9003e00640 1 --2- 172.21.15.50:0/4219011934 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9004109b90 0x7f90041a1ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:20:48.940 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:48.938+0000 7f8ffbe00640 1 --2- 172.21.15.50:0/4219011934 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9004109240 0x7f900419ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:20:48.941 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:48.938+0000 7f9003400640 1 -- 172.21.15.50:0/4219011934 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9004109240 msgr2=0x7f900419ca00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:20:48.941 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:48.938+0000 7f9003400640 1 --2- 172.21.15.50:0/4219011934 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9004109240 0x7f900419ca00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:20:48.941 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:48.938+0000 7f9003400640 1 -- 172.21.15.50:0/4219011934 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9004109b90 msgr2=0x7f90041a1ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:20:48.942 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:48.938+0000 7f9003400640 1 --2- 172.21.15.50:0/4219011934 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9004109b90 0x7f90041a1ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:20:48.942 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:48.938+0000 7f9003400640 1 -- 172.21.15.50:0/4219011934 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90041a23d0 con 0x7f9004103900 2024-08-31T04:20:48.942 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:48.939+0000 7f9003400640 1 --2- 172.21.15.50:0/4219011934 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9004103900 0x7f900419c460 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f8ff400e9f0 tx=0x7f8ff400eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:20:48.942 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:48.939+0000 7f9000c00640 1 -- 172.21.15.50:0/4219011934 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ff400cd80 con 0x7f9004103900 2024-08-31T04:20:48.942 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:48.939+0000 7f9000c00640 1 -- 172.21.15.50:0/4219011934 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8ff40108e0 con 0x7f9004103900 2024-08-31T04:20:48.942 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:48.939+0000 7f9000c00640 1 -- 172.21.15.50:0/4219011934 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ff4018980 con 0x7f9004103900 2024-08-31T04:20:48.942 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:48.939+0000 7f900a600640 1 -- 172.21.15.50:0/4219011934 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f90041a26c0 con 0x7f9004103900 2024-08-31T04:20:48.942 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:48.939+0000 7f900a600640 1 -- 172.21.15.50:0/4219011934 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f90041a8e20 con 0x7f9004103900 2024-08-31T04:20:48.942 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:48.940+0000 7f900a600640 1 -- 172.21.15.50:0/4219011934 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9004103d10 con 0x7f9004103900 2024-08-31T04:20:48.944 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:48.943+0000 7f9000c00640 1 -- 172.21.15.50:0/4219011934 <== mon.1 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 16) ==== 152577+0+0 (secure 0 0 0) 0x7f8ff4010430 con 0x7f9004103900 2024-08-31T04:20:48.946 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:48.944+0000 7f9000c00640 1 --2- 172.21.15.50:0/4219011934 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f8fe80b4b30 0x7f8fe80b7040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:20:48.946 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:48.945+0000 7f9000c00640 1 -- 172.21.15.50:0/4219011934 <== mon.1 v2:172.21.15.177:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 7979+0+0 (secure 0 0 0) 0x7f8ff40e5880 con 0x7f9004103900 2024-08-31T04:20:48.946 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:48.945+0000 7f8ffbe00640 1 --2- 172.21.15.50:0/4219011934 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f8fe80b4b30 0x7f8fe80b7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:20:48.946 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:48.945+0000 7f8ffbe00640 1 --2- 172.21.15.50:0/4219011934 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f8fe80b4b30 0x7f8fe80b7040 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f8fec009230 tx=0x7f8fec031400 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:20:48.947 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:48.946+0000 7f9000c00640 1 -- 172.21.15.50:0/4219011934 <== mon.1 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f8ff40ac410 con 0x7f9004103900 2024-08-31T04:20:49.145 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:49.143+0000 7f900a600640 1 -- 172.21.15.50:0/4219011934 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f90041a9120 con 0x7f9004103900 2024-08-31T04:20:49.145 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:20:48 smithi050 ceph-mon[17259]: pgmap v302: 97 pgs: 97 active+clean; 579 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s wr, 6 op/s 2024-08-31T04:20:49.147 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:49.145+0000 7f9000c00640 1 -- 172.21.15.50:0/4219011934 <== mon.1 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v76) ==== 74+0+22281 (secure 0 0 0) 0x7f8ff40b0bd0 con 0x7f9004103900 2024-08-31T04:20:49.147 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-08-31T04:20:49.147 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":76,"fsid":"058d9fc6-674f-11ef-bcd4-c7b262605968","created":"2024-08-31T04:11:59.576131+0000","modified":"2024-08-31T04:20:44.140795+0000","last_up_change":"2024-08-31T04:19:44.619590+0000","last_in_change":"2024-08-31T04:19:21.022096+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-31T04:15:46.229142+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-31T04:20:38.249458+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"76","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-31T04:20:40.929092+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"76","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"416ecbde-4a7b-4bd1-b377-490925a33ce1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":3831273843},{"type":"v1","addr":"172.21.15.50:6803","nonce":3831273843}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":3831273843},{"type":"v1","addr":"172.21.15.50:6805","nonce":3831273843}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":3831273843},{"type":"v1","addr":"172.21.15.50:6809","nonce":3831273843}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":3831273843},{"type":"v1","addr":"172.21.15.50:6807","nonce":3831273843}]},"public_addr":"172.21.15.50:6803/3831273843","cluster_addr":"172.21.15.50:6805/3831273843","heartbeat_back_addr":"172.21.15.50:6809/3831273843","heartbeat_front_addr":"172.21.15.50:6807/3831273843","state":["exists","up"]},{"osd":1,"uuid":"5e008006-004d-4842-9885-93a2d27be1cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":475308203},{"type":"v1","addr":"172.21.15.133:6801","nonce":475308203}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":475308203},{"type":"v1","addr":"172.21.15.133:6803","nonce":475308203}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":475308203},{"type":"v1","addr":"172.21.15.133:6807","nonce":475308203}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":475308203},{"type":"v1","addr":"172.21.15.133:6805","nonce":475308203}]},"public_addr":"172.21.15.133:6801/475308203","cluster_addr":"172.21.15.133:6803/475308203","heartbeat_back_addr":"172.21.15.133:6807/475308203","heartbeat_front_addr":"172.21.15.133:6805/475308203","state":["exists","up"]},{"osd":2,"uuid":"7e6f1a26-f30d-4822-af69-8a08cb89fbce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":3091173426},{"type":"v1","addr":"172.21.15.177:6801","nonce":3091173426}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":3091173426},{"type":"v1","addr":"172.21.15.177:6803","nonce":3091173426}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":3091173426},{"type":"v1","addr":"172.21.15.177:6807","nonce":3091173426}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":3091173426},{"type":"v1","addr":"172.21.15.177:6805","nonce":3091173426}]},"public_addr":"172.21.15.177:6801/3091173426","cluster_addr":"172.21.15.177:6803/3091173426","heartbeat_back_addr":"172.21.15.177:6807/3091173426","heartbeat_front_addr":"172.21.15.177:6805/3091173426","state":["exists","up"]},{"osd":3,"uuid":"8193c2a2-18a1-4684-9a16-cbeae25530ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":3792992620},{"type":"v1","addr":"172.21.15.50:6811","nonce":3792992620}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":3792992620},{"type":"v1","addr":"172.21.15.50:6813","nonce":3792992620}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":3792992620},{"type":"v1","addr":"172.21.15.50:6817","nonce":3792992620}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":3792992620},{"type":"v1","addr":"172.21.15.50:6815","nonce":3792992620}]},"public_addr":"172.21.15.50:6811/3792992620","cluster_addr":"172.21.15.50:6813/3792992620","heartbeat_back_addr":"172.21.15.50:6817/3792992620","heartbeat_front_addr":"172.21.15.50:6815/3792992620","state":["exists","up"]},{"osd":4,"uuid":"2a2b4e64-0f8e-40ec-926c-84dbf691aefe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":2855333596},{"type":"v1","addr":"172.21.15.133:6809","nonce":2855333596}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":2855333596},{"type":"v1","addr":"172.21.15.133:6811","nonce":2855333596}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":2855333596},{"type":"v1","addr":"172.21.15.133:6815","nonce":2855333596}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":2855333596},{"type":"v1","addr":"172.21.15.133:6813","nonce":2855333596}]},"public_addr":"172.21.15.133:6809/2855333596","cluster_addr":"172.21.15.133:6811/2855333596","heartbeat_back_addr":"172.21.15.133:6815/2855333596","heartbeat_front_addr":"172.21.15.133:6813/2855333596","state":["exists","up"]},{"osd":5,"uuid":"83429ff0-ea7d-4fcc-9611-39d9001aa216","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":1166415084},{"type":"v1","addr":"172.21.15.177:6809","nonce":1166415084}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":1166415084},{"type":"v1","addr":"172.21.15.177:6811","nonce":1166415084}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":1166415084},{"type":"v1","addr":"172.21.15.177:6815","nonce":1166415084}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":1166415084},{"type":"v1","addr":"172.21.15.177:6813","nonce":1166415084}]},"public_addr":"172.21.15.177:6809/1166415084","cluster_addr":"172.21.15.177:6811/1166415084","heartbeat_back_addr":"172.21.15.177:6815/1166415084","heartbeat_front_addr":"172.21.15.177:6813/1166415084","state":["exists","up"]},{"osd":6,"uuid":"eeb571ef-5e43-4816-95dd-d01d83aeca83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":1429341184},{"type":"v1","addr":"172.21.15.50:6819","nonce":1429341184}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":1429341184},{"type":"v1","addr":"172.21.15.50:6821","nonce":1429341184}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":1429341184},{"type":"v1","addr":"172.21.15.50:6825","nonce":1429341184}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":1429341184},{"type":"v1","addr":"172.21.15.50:6823","nonce":1429341184}]},"public_addr":"172.21.15.50:6819/1429341184","cluster_addr":"172.21.15.50:6821/1429341184","heartbeat_back_addr":"172.21.15.50:6825/1429341184","heartbeat_front_addr":"172.21.15.50:6823/1429341184","state":["exists","up"]},{"osd":7,"uuid":"512ee507-0d50-4fed-b692-dbdf23a93e8e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":3643454923},{"type":"v1","addr":"172.21.15.133:6817","nonce":3643454923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":3643454923},{"type":"v1","addr":"172.21.15.133:6819","nonce":3643454923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":3643454923},{"type":"v1","addr":"172.21.15.133:6823","nonce":3643454923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":3643454923},{"type":"v1","addr":"172.21.15.133:6821","nonce":3643454923}]},"public_addr":"172.21.15.133:6817/3643454923","cluster_addr":"172.21.15.133:6819/3643454923","heartbeat_back_addr":"172.21.15.133:6823/3643454923","heartbeat_front_addr":"172.21.15.133:6821/3643454923","state":["exists","up"]},{"osd":8,"uuid":"ae99526e-41da-4cb5-857f-2e66f18f2d94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6816","nonce":101973300},{"type":"v1","addr":"172.21.15.177:6817","nonce":101973300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":101973300},{"type":"v1","addr":"172.21.15.177:6819","nonce":101973300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":101973300},{"type":"v1","addr":"172.21.15.177:6823","nonce":101973300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":101973300},{"type":"v1","addr":"172.21.15.177:6821","nonce":101973300}]},"public_addr":"172.21.15.177:6817/101973300","cluster_addr":"172.21.15.177:6819/101973300","heartbeat_back_addr":"172.21.15.177:6823/101973300","heartbeat_front_addr":"172.21.15.177:6821/101973300","state":["exists","up"]},{"osd":9,"uuid":"fcedbe16-b910-407f-b9d7-1dd03f3e62a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":53019860},{"type":"v1","addr":"172.21.15.50:6827","nonce":53019860}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":53019860},{"type":"v1","addr":"172.21.15.50:6829","nonce":53019860}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":53019860},{"type":"v1","addr":"172.21.15.50:6833","nonce":53019860}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":53019860},{"type":"v1","addr":"172.21.15.50:6831","nonce":53019860}]},"public_addr":"172.21.15.50:6827/53019860","cluster_addr":"172.21.15.50:6829/53019860","heartbeat_back_addr":"172.21.15.50:6833/53019860","heartbeat_front_addr":"172.21.15.50:6831/53019860","state":["exists","up"]},{"osd":10,"uuid":"3852756e-62f1-4e71-a070-8cff76df99b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":4175566493},{"type":"v1","addr":"172.21.15.133:6825","nonce":4175566493}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":4175566493},{"type":"v1","addr":"172.21.15.133:6827","nonce":4175566493}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":4175566493},{"type":"v1","addr":"172.21.15.133:6831","nonce":4175566493}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":4175566493},{"type":"v1","addr":"172.21.15.133:6829","nonce":4175566493}]},"public_addr":"172.21.15.133:6825/4175566493","cluster_addr":"172.21.15.133:6827/4175566493","heartbeat_back_addr":"172.21.15.133:6831/4175566493","heartbeat_front_addr":"172.21.15.133:6829/4175566493","state":["exists","up"]},{"osd":11,"uuid":"a154180a-5f2a-4b33-ad3d-fea7317597ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":2103454982},{"type":"v1","addr":"172.21.15.177:6825","nonce":2103454982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":2103454982},{"type":"v1","addr":"172.21.15.177:6827","nonce":2103454982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":2103454982},{"type":"v1","addr":"172.21.15.177:6831","nonce":2103454982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":2103454982},{"type":"v1","addr":"172.21.15.177:6829","nonce":2103454982}]},"public_addr":"172.21.15.177:6825/2103454982","cluster_addr":"172.21.15.177:6827/2103454982","heartbeat_back_addr":"172.21.15.177:6831/2103454982","heartbeat_front_addr":"172.21.15.177:6829/2103454982","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:14:54.683660+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:15:20.007319+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:15:43.613426+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:16:12.387010+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:16:38.079210+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:17:02.750375+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:17:31.735810+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:17:57.600985+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:18:22.503347+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:18:52.316657+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:19:18.444623+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:19:42.331006+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.50:6801/1319056820":"2024-09-01T04:12:55.742020+0000","172.21.15.50:0/1755103674":"2024-09-01T04:12:55.742020+0000","172.21.15.50:6800/1319056820":"2024-09-01T04:12:55.742020+0000","172.21.15.50:0/3701412233":"2024-09-01T04:12:55.742020+0000","172.21.15.50:0/1829556336":"2024-09-01T04:12:55.742020+0000","172.21.15.50:0/1698995126":"2024-09-01T04:12:25.753831+0000","172.21.15.50:0/1554317941":"2024-09-01T04:12:25.753831+0000","172.21.15.50:0/2998110380":"2024-09-01T04:12:25.753831+0000","172.21.15.50:6801/4197277793":"2024-09-01T04:12:25.753831+0000","172.21.15.50:6800/4197277793":"2024-09-01T04:12:25.753831+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-31T04:20:49.149 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:49.148+0000 7f900a600640 1 -- 172.21.15.50:0/4219011934 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f8fe80b4b30 msgr2=0x7f8fe80b7040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:20:49.149 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:49.148+0000 7f900a600640 1 --2- 172.21.15.50:0/4219011934 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f8fe80b4b30 0x7f8fe80b7040 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f8fec009230 tx=0x7f8fec031400 comp rx=0 tx=0).stop 2024-08-31T04:20:49.149 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:49.148+0000 7f900a600640 1 -- 172.21.15.50:0/4219011934 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9004103900 msgr2=0x7f900419c460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:20:49.150 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:49.148+0000 7f900a600640 1 --2- 172.21.15.50:0/4219011934 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9004103900 0x7f900419c460 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f8ff400e9f0 tx=0x7f8ff400eeb0 comp rx=0 tx=0).stop 2024-08-31T04:20:49.150 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:49.148+0000 7f900a600640 1 -- 172.21.15.50:0/4219011934 shutdown_connections 2024-08-31T04:20:49.150 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:49.148+0000 7f900a600640 1 --2- 172.21.15.50:0/4219011934 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f8fe80b4b30 0x7f8fe80b7040 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:20:49.150 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:49.148+0000 7f900a600640 1 --2- 172.21.15.50:0/4219011934 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9004109b90 0x7f90041a1ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:20:49.150 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:49.148+0000 7f900a600640 1 --2- 172.21.15.50:0/4219011934 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9004109240 0x7f900419ca00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:20:49.150 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:49.148+0000 7f900a600640 1 --2- 172.21.15.50:0/4219011934 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9004103900 0x7f900419c460 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:20:49.150 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:49.148+0000 7f900a600640 1 -- 172.21.15.50:0/4219011934 >> 172.21.15.50:0/4219011934 conn(0x7f900407b5f0 msgr2=0x7f9004107150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:20:49.150 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:49.148+0000 7f900a600640 1 -- 172.21.15.50:0/4219011934 shutdown_connections 2024-08-31T04:20:49.150 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:49.148+0000 7f900a600640 1 -- 172.21.15.50:0/4219011934 wait complete. 2024-08-31T04:20:49.246 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:20:48 smithi177 ceph-mon[22025]: pgmap v302: 97 pgs: 97 active+clean; 579 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s wr, 6 op/s 2024-08-31T04:20:49.293 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:20:48 smithi133 ceph-mon[22177]: pgmap v302: 97 pgs: 97 active+clean; 579 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s wr, 6 op/s 2024-08-31T04:20:49.962 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 058d9fc6-674f-11ef-bcd4-c7b262605968 -- ceph fs set cephfs standby_count_wanted 0 2024-08-31T04:20:50.200 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:20:49 smithi050 ceph-mon[17259]: from='client.? 172.21.15.50:0/4219011934' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-31T04:20:50.246 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:20:49 smithi177 ceph-mon[22025]: from='client.? 172.21.15.50:0/4219011934' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-31T04:20:50.293 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:20:49 smithi133 ceph-mon[22177]: from='client.? 172.21.15.50:0/4219011934' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-31T04:20:50.345 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:20:50.962 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:50.961+0000 7f3653200640 1 -- 172.21.15.50:0/1656925723 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3654109090 msgr2=0x7f36541094a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:20:50.963 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:50.961+0000 7f3653200640 1 --2- 172.21.15.50:0/1656925723 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3654109090 0x7f36541094a0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f3640009900 tx=0x7f364002a410 comp rx=0 tx=0).stop 2024-08-31T04:20:50.963 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:50.961+0000 7f3653200640 1 -- 172.21.15.50:0/1656925723 shutdown_connections 2024-08-31T04:20:50.963 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:50.961+0000 7f3653200640 1 --2- 172.21.15.50:0/1656925723 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f36541099e0 0x7f3654110210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:20:50.963 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:50.961+0000 7f3653200640 1 --2- 172.21.15.50:0/1656925723 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3654109090 0x7f36541094a0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:20:50.963 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:50.961+0000 7f3653200640 1 --2- 172.21.15.50:0/1656925723 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3654103750 0x7f3654103b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:20:50.963 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:50.961+0000 7f3653200640 1 -- 172.21.15.50:0/1656925723 >> 172.21.15.50:0/1656925723 conn(0x7f36540ff1a0 msgr2=0x7f36541015f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:20:50.963 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:50.961+0000 7f3653200640 1 -- 172.21.15.50:0/1656925723 shutdown_connections 2024-08-31T04:20:50.963 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:50.961+0000 7f3653200640 1 -- 172.21.15.50:0/1656925723 wait complete. 2024-08-31T04:20:50.964 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:50.962+0000 7f3653200640 1 Processor -- start 2024-08-31T04:20:50.964 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:50.962+0000 7f3653200640 1 -- start start 2024-08-31T04:20:50.964 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:50.962+0000 7f3653200640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3654103750 0x7f36540754b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:20:50.965 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:50.962+0000 7f3653200640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3654109090 0x7f36540759f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:20:50.965 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:50.963+0000 7f3653200640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f36541099e0 0x7f3654075f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:20:50.965 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:50.963+0000 7f3653200640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f36541136a0 con 0x7f3654109090 2024-08-31T04:20:50.965 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:50.963+0000 7f3653200640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f3654113520 con 0x7f36541099e0 2024-08-31T04:20:50.965 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:50.963+0000 7f3653200640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f3654113820 con 0x7f3654103750 2024-08-31T04:20:50.965 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:50.963+0000 7f3651400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3654109090 0x7f36540759f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:20:50.965 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:50.963+0000 7f3651e00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3654103750 0x7f36540754b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:20:50.965 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:50.963+0000 7f3651e00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3654103750 0x7f36540754b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.50:44292/0 (socket says 172.21.15.50:44292) 2024-08-31T04:20:50.965 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:50.963+0000 7f3651400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3654109090 0x7f36540759f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53632/0 (socket says 172.21.15.50:53632) 2024-08-31T04:20:50.965 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:50.963+0000 7f3651e00640 1 -- 172.21.15.50:0/4239855695 learned_addr learned my addr 172.21.15.50:0/4239855695 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:20:50.965 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:50.963+0000 7f3652800640 1 --2- 172.21.15.50:0/4239855695 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f36541099e0 0x7f3654075f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:20:50.965 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:50.963+0000 7f3651e00640 1 -- 172.21.15.50:0/4239855695 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f36541099e0 msgr2=0x7f3654075f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:20:50.965 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:50.963+0000 7f3651e00640 1 --2- 172.21.15.50:0/4239855695 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f36541099e0 0x7f3654075f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:20:50.966 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:50.963+0000 7f3651e00640 1 -- 172.21.15.50:0/4239855695 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3654109090 msgr2=0x7f36540759f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:20:50.966 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:50.963+0000 7f3651e00640 1 --2- 172.21.15.50:0/4239855695 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3654109090 0x7f36540759f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:20:50.966 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:50.963+0000 7f3651e00640 1 -- 172.21.15.50:0/4239855695 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36541a8330 con 0x7f3654103750 2024-08-31T04:20:50.966 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:50.964+0000 7f3651e00640 1 --2- 172.21.15.50:0/4239855695 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3654103750 0x7f36540754b0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f364400e9f0 tx=0x7f364400eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:20:50.966 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:50.964+0000 7f364aa00640 1 -- 172.21.15.50:0/4239855695 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f364400cd80 con 0x7f3654103750 2024-08-31T04:20:50.967 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:50.964+0000 7f364aa00640 1 -- 172.21.15.50:0/4239855695 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f36440108e0 con 0x7f3654103750 2024-08-31T04:20:50.967 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:50.964+0000 7f3653200640 1 -- 172.21.15.50:0/4239855695 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f36541a8620 con 0x7f3654103750 2024-08-31T04:20:50.967 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:50.964+0000 7f364aa00640 1 -- 172.21.15.50:0/4239855695 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3644018980 con 0x7f3654103750 2024-08-31T04:20:50.967 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:50.964+0000 7f3653200640 1 -- 172.21.15.50:0/4239855695 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f36541a8b30 con 0x7f3654103750 2024-08-31T04:20:50.967 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:50.965+0000 7f3653200640 1 -- 172.21.15.50:0/4239855695 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3654103b60 con 0x7f3654103750 2024-08-31T04:20:50.968 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:50.967+0000 7f364aa00640 1 -- 172.21.15.50:0/4239855695 <== mon.1 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 16) ==== 152577+0+0 (secure 0 0 0) 0x7f3644010430 con 0x7f3654103750 2024-08-31T04:20:50.970 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:50.969+0000 7f364aa00640 1 --2- 172.21.15.50:0/4239855695 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f36380b4b30 0x7f36380b7040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:20:50.970 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:50.969+0000 7f364aa00640 1 -- 172.21.15.50:0/4239855695 <== mon.1 v2:172.21.15.177:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 7979+0+0 (secure 0 0 0) 0x7f36440e5390 con 0x7f3654103750 2024-08-31T04:20:50.970 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:50.969+0000 7f3651400640 1 --2- 172.21.15.50:0/4239855695 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f36380b4b30 0x7f36380b7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:20:50.971 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:50.970+0000 7f3651400640 1 --2- 172.21.15.50:0/4239855695 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f36380b4b30 0x7f36380b7040 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f364002aa00 tx=0x7f3640005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:20:50.974 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:50.973+0000 7f364aa00640 1 -- 172.21.15.50:0/4239855695 <== mon.1 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f36440abf20 con 0x7f3654103750 2024-08-31T04:20:51.200 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:20:50 smithi050 ceph-mon[17259]: pgmap v303: 97 pgs: 97 active+clean; 579 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s wr, 6 op/s 2024-08-31T04:20:51.209 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:51.208+0000 7f3653200640 1 -- 172.21.15.50:0/4239855695 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f365402e430 con 0x7f3654103750 2024-08-31T04:20:51.246 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:20:50 smithi177 ceph-mon[22025]: pgmap v303: 97 pgs: 97 active+clean; 579 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s wr, 6 op/s 2024-08-31T04:20:51.293 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:20:50 smithi133 ceph-mon[22177]: pgmap v303: 97 pgs: 97 active+clean; 579 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s wr, 6 op/s 2024-08-31T04:20:51.969 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:51.968+0000 7f364aa00640 1 -- 172.21.15.50:0/4239855695 <== mon.1 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v16) ==== 118+0+0 (secure 0 0 0) 0x7f36440b06e0 con 0x7f3654103750 2024-08-31T04:20:51.973 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:51.971+0000 7f3653200640 1 -- 172.21.15.50:0/4239855695 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f36380b4b30 msgr2=0x7f36380b7040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:20:51.973 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:51.971+0000 7f3653200640 1 --2- 172.21.15.50:0/4239855695 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f36380b4b30 0x7f36380b7040 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f364002aa00 tx=0x7f3640005a20 comp rx=0 tx=0).stop 2024-08-31T04:20:51.973 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:51.971+0000 7f3653200640 1 -- 172.21.15.50:0/4239855695 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3654103750 msgr2=0x7f36540754b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:20:51.973 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:51.971+0000 7f3653200640 1 --2- 172.21.15.50:0/4239855695 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3654103750 0x7f36540754b0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f364400e9f0 tx=0x7f364400eeb0 comp rx=0 tx=0).stop 2024-08-31T04:20:51.973 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:51.971+0000 7f3653200640 1 -- 172.21.15.50:0/4239855695 shutdown_connections 2024-08-31T04:20:51.973 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:51.971+0000 7f3653200640 1 --2- 172.21.15.50:0/4239855695 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f36380b4b30 0x7f36380b7040 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:20:51.973 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:51.971+0000 7f3653200640 1 --2- 172.21.15.50:0/4239855695 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f36541099e0 0x7f3654075f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:20:51.973 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:51.971+0000 7f3653200640 1 --2- 172.21.15.50:0/4239855695 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3654109090 0x7f36540759f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:20:51.973 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:51.971+0000 7f3653200640 1 --2- 172.21.15.50:0/4239855695 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3654103750 0x7f36540754b0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:20:51.973 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:51.971+0000 7f3653200640 1 -- 172.21.15.50:0/4239855695 >> 172.21.15.50:0/4239855695 conn(0x7f36540ff1a0 msgr2=0x7f36541015c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:20:51.973 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:51.971+0000 7f3653200640 1 -- 172.21.15.50:0/4239855695 shutdown_connections 2024-08-31T04:20:51.973 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:51.971+0000 7f3653200640 1 -- 172.21.15.50:0/4239855695 wait complete. 2024-08-31T04:20:52.246 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:20:51 smithi177 ceph-mon[22025]: from='client.? 172.21.15.50:0/4239855695' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} : dispatch 2024-08-31T04:20:52.246 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:20:51 smithi177 ceph-mon[22025]: from='client.? ' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} : dispatch 2024-08-31T04:20:52.293 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:20:51 smithi133 ceph-mon[22177]: from='client.? 172.21.15.50:0/4239855695' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} : dispatch 2024-08-31T04:20:52.293 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:20:51 smithi133 ceph-mon[22177]: from='client.? ' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} : dispatch 2024-08-31T04:20:52.323 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:20:51 smithi050 ceph-mon[17259]: from='client.? 172.21.15.50:0/4239855695' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} : dispatch 2024-08-31T04:20:52.324 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:20:51 smithi050 ceph-mon[17259]: from='client.? ' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} : dispatch 2024-08-31T04:20:52.693 DEBUG:tasks.cephfs.filesystem:fs_config: {'max_mds': 5, 'session_timeout': 300, 'standby_replay': True, 'subvols': {'create': 2, 'subvol_options': '--namespace-isolated'}} 2024-08-31T04:20:52.693 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 058d9fc6-674f-11ef-bcd4-c7b262605968 -- ceph fs set cephfs max_mds 5 2024-08-31T04:20:53.076 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:20:53.233 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:20:52 smithi050 ceph-mon[17259]: pgmap v304: 97 pgs: 97 active+clean; 579 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 5 op/s 2024-08-31T04:20:53.233 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:20:52 smithi050 ceph-mon[17259]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-08-31T04:20:53.233 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:20:52 smithi050 ceph-mon[17259]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-08-31T04:20:53.246 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:20:52 smithi177 ceph-mon[22025]: pgmap v304: 97 pgs: 97 active+clean; 579 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 5 op/s 2024-08-31T04:20:53.246 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:20:52 smithi177 ceph-mon[22025]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-08-31T04:20:53.246 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:20:52 smithi177 ceph-mon[22025]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-08-31T04:20:53.293 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:20:52 smithi133 ceph-mon[22177]: pgmap v304: 97 pgs: 97 active+clean; 579 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 5 op/s 2024-08-31T04:20:53.293 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:20:52 smithi133 ceph-mon[22177]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-08-31T04:20:53.293 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:20:52 smithi133 ceph-mon[22177]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-08-31T04:20:53.685 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:53.683+0000 7fbac6800640 1 -- 172.21.15.50:0/6541144 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbac00776e0 msgr2=0x7fbac0077af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:20:53.685 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:53.683+0000 7fbac6800640 1 --2- 172.21.15.50:0/6541144 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbac00776e0 0x7fbac0077af0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fbab0009900 tx=0x7fbab002a3f0 comp rx=0 tx=0).stop 2024-08-31T04:20:53.685 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:53.683+0000 7fbac6800640 1 -- 172.21.15.50:0/6541144 shutdown_connections 2024-08-31T04:20:53.685 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:53.683+0000 7fbac6800640 1 --2- 172.21.15.50:0/6541144 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbac01144e0 0x7fbac0116900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:20:53.685 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:53.683+0000 7fbac6800640 1 --2- 172.21.15.50:0/6541144 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbac0078030 0x7fbac0113fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:20:53.686 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:53.683+0000 7fbac6800640 1 --2- 172.21.15.50:0/6541144 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbac00776e0 0x7fbac0077af0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:20:53.686 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:53.683+0000 7fbac6800640 1 -- 172.21.15.50:0/6541144 >> 172.21.15.50:0/6541144 conn(0x7fbac0101570 msgr2=0x7fbac01039c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:20:53.686 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:53.683+0000 7fbac6800640 1 -- 172.21.15.50:0/6541144 shutdown_connections 2024-08-31T04:20:53.686 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:53.683+0000 7fbac6800640 1 -- 172.21.15.50:0/6541144 wait complete. 2024-08-31T04:20:53.687 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:53.684+0000 7fbac6800640 1 Processor -- start 2024-08-31T04:20:53.687 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:53.684+0000 7fbac6800640 1 -- start start 2024-08-31T04:20:53.687 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:53.685+0000 7fbac6800640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbac00776e0 0x7fbac01a0830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:20:53.687 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:53.685+0000 7fbac6800640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbac0078030 0x7fbac01a0dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:20:53.687 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:53.685+0000 7fbac6800640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbac01144e0 0x7fbac01a6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:20:53.688 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:53.685+0000 7fbac6800640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fbac0119e60 con 0x7fbac00776e0 2024-08-31T04:20:53.688 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:53.685+0000 7fbac6800640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7fbac0119ce0 con 0x7fbac01144e0 2024-08-31T04:20:53.688 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:53.685+0000 7fbac6800640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fbac0119fe0 con 0x7fbac0078030 2024-08-31T04:20:53.688 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:53.685+0000 7fbabf400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbac00776e0 0x7fbac01a0830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:20:53.688 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:53.685+0000 7fbabf400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbac00776e0 0x7fbac01a0830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48192/0 (socket says 172.21.15.50:48192) 2024-08-31T04:20:53.688 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:53.685+0000 7fbabf400640 1 -- 172.21.15.50:0/4060296322 learned_addr learned my addr 172.21.15.50:0/4060296322 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:20:53.688 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:53.685+0000 7fbabfe00640 1 --2- 172.21.15.50:0/4060296322 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbac01144e0 0x7fbac01a6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:20:53.688 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:53.685+0000 7fbab7e00640 1 --2- 172.21.15.50:0/4060296322 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbac0078030 0x7fbac01a0dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:20:53.688 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:53.686+0000 7fbabf400640 1 -- 172.21.15.50:0/4060296322 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbac0078030 msgr2=0x7fbac01a0dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:20:53.688 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:53.686+0000 7fbabf400640 1 --2- 172.21.15.50:0/4060296322 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbac0078030 0x7fbac01a0dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:20:53.689 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:53.686+0000 7fbabf400640 1 -- 172.21.15.50:0/4060296322 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbac01144e0 msgr2=0x7fbac01a6070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:20:53.689 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:53.686+0000 7fbabf400640 1 --2- 172.21.15.50:0/4060296322 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbac01144e0 0x7fbac01a6070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:20:53.689 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:53.686+0000 7fbabf400640 1 -- 172.21.15.50:0/4060296322 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbac01a67a0 con 0x7fbac00776e0 2024-08-31T04:20:53.689 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:53.686+0000 7fbabfe00640 1 --2- 172.21.15.50:0/4060296322 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbac01144e0 0x7fbac01a6070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:20:53.689 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:53.686+0000 7fbabf400640 1 --2- 172.21.15.50:0/4060296322 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbac00776e0 0x7fbac01a0830 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fbab0005940 tx=0x7fbab00040c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:20:53.689 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:53.686+0000 7fbabcc00640 1 -- 172.21.15.50:0/4060296322 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbab003f030 con 0x7fbac00776e0 2024-08-31T04:20:53.690 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:53.686+0000 7fbac6800640 1 -- 172.21.15.50:0/4060296322 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbac01a6a30 con 0x7fbac00776e0 2024-08-31T04:20:53.690 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:53.686+0000 7fbabcc00640 1 -- 172.21.15.50:0/4060296322 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbab00044c0 con 0x7fbac00776e0 2024-08-31T04:20:53.690 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:53.687+0000 7fbabcc00640 1 -- 172.21.15.50:0/4060296322 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbab0035070 con 0x7fbac00776e0 2024-08-31T04:20:53.690 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:53.687+0000 7fbac6800640 1 -- 172.21.15.50:0/4060296322 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbac01ad1f0 con 0x7fbac00776e0 2024-08-31T04:20:53.690 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:53.688+0000 7fbac6800640 1 -- 172.21.15.50:0/4060296322 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbac0077af0 con 0x7fbac00776e0 2024-08-31T04:20:53.691 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:53.690+0000 7fbabcc00640 1 -- 172.21.15.50:0/4060296322 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 16) ==== 152577+0+0 (secure 0 0 0) 0x7fbab0042030 con 0x7fbac00776e0 2024-08-31T04:20:53.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:53.691+0000 7fbabcc00640 1 --2- 172.21.15.50:0/4060296322 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fbaa40b4bb0 0x7fbaa40b70c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:20:53.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:53.692+0000 7fbabcc00640 1 -- 172.21.15.50:0/4060296322 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 7979+0+0 (secure 0 0 0) 0x7fbab01055c0 con 0x7fbac00776e0 2024-08-31T04:20:53.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:53.692+0000 7fbab7e00640 1 --2- 172.21.15.50:0/4060296322 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fbaa40b4bb0 0x7fbaa40b70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:20:53.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:53.692+0000 7fbab7e00640 1 --2- 172.21.15.50:0/4060296322 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fbaa40b4bb0 0x7fbaa40b70c0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fbaa80095f0 tx=0x7fbaa8005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:20:53.695 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:53.694+0000 7fbabcc00640 1 -- 172.21.15.50:0/4060296322 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fbab00cc150 con 0x7fbac00776e0 2024-08-31T04:20:53.930 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:53.928+0000 7fbac6800640 1 -- 172.21.15.50:0/4060296322 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"} v 0) -- 0x7fbac002e430 con 0x7fbac00776e0 2024-08-31T04:20:53.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:53.973+0000 7fbabcc00640 1 -- 172.21.15.50:0/4060296322 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]=0 v17) ==== 105+0+0 (secure 0 0 0) 0x7fbab00d0910 con 0x7fbac00776e0 2024-08-31T04:20:53.977 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:53.976+0000 7fbac6800640 1 -- 172.21.15.50:0/4060296322 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fbaa40b4bb0 msgr2=0x7fbaa40b70c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:20:53.977 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:53.976+0000 7fbac6800640 1 --2- 172.21.15.50:0/4060296322 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fbaa40b4bb0 0x7fbaa40b70c0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fbaa80095f0 tx=0x7fbaa8005f90 comp rx=0 tx=0).stop 2024-08-31T04:20:53.977 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:53.976+0000 7fbac6800640 1 -- 172.21.15.50:0/4060296322 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbac00776e0 msgr2=0x7fbac01a0830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:20:53.977 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:53.976+0000 7fbac6800640 1 --2- 172.21.15.50:0/4060296322 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbac00776e0 0x7fbac01a0830 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fbab0005940 tx=0x7fbab00040c0 comp rx=0 tx=0).stop 2024-08-31T04:20:53.978 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:53.976+0000 7fbac6800640 1 -- 172.21.15.50:0/4060296322 shutdown_connections 2024-08-31T04:20:53.978 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:53.976+0000 7fbac6800640 1 --2- 172.21.15.50:0/4060296322 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fbaa40b4bb0 0x7fbaa40b70c0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:20:53.978 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:53.976+0000 7fbac6800640 1 --2- 172.21.15.50:0/4060296322 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbac0078030 0x7fbac01a0dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:20:53.978 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:53.976+0000 7fbac6800640 1 --2- 172.21.15.50:0/4060296322 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbac01144e0 0x7fbac01a6070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:20:53.978 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:53.976+0000 7fbac6800640 1 --2- 172.21.15.50:0/4060296322 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbac00776e0 0x7fbac01a0830 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:20:53.978 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:53.976+0000 7fbac6800640 1 -- 172.21.15.50:0/4060296322 >> 172.21.15.50:0/4060296322 conn(0x7fbac0101570 msgr2=0x7fbac01165e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:20:53.978 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:53.976+0000 7fbac6800640 1 -- 172.21.15.50:0/4060296322 shutdown_connections 2024-08-31T04:20:53.978 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:53.976+0000 7fbac6800640 1 -- 172.21.15.50:0/4060296322 wait complete. 2024-08-31T04:20:54.200 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:20:53 smithi050 ceph-mon[17259]: from='client.? 172.21.15.50:0/4060296322' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"} : dispatch 2024-08-31T04:20:54.246 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:20:53 smithi177 ceph-mon[22025]: from='client.? 172.21.15.50:0/4060296322' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"} : dispatch 2024-08-31T04:20:54.293 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:20:53 smithi133 ceph-mon[22177]: from='client.? 172.21.15.50:0/4060296322' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"} : dispatch 2024-08-31T04:20:54.850 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 058d9fc6-674f-11ef-bcd4-c7b262605968 -- ceph fs set cephfs allow_standby_replay true 2024-08-31T04:20:55.200 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:20:54 smithi050 ceph-mon[17259]: pgmap v305: 97 pgs: 97 active+clean; 579 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s wr, 4 op/s 2024-08-31T04:20:55.200 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:20:54 smithi050 ceph-mon[17259]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-08-31T04:20:55.200 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:20:54 smithi050 ceph-mon[17259]: from='client.? 172.21.15.50:0/4060296322' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]': finished 2024-08-31T04:20:55.200 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:20:54 smithi050 ceph-mon[17259]: daemon mds.a assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-08-31T04:20:55.200 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:20:54 smithi050 ceph-mon[17259]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-08-31T04:20:55.200 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:20:54 smithi050 ceph-mon[17259]: fsmap cephfs:2 {0=b=up:active,1=a=up:creating} 10 up:standby 2024-08-31T04:20:55.200 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:20:54 smithi050 ceph-mon[17259]: daemon mds.a is now active in filesystem cephfs as rank 1 2024-08-31T04:20:55.236 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:20:55.246 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:20:54 smithi177 ceph-mon[22025]: pgmap v305: 97 pgs: 97 active+clean; 579 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s wr, 4 op/s 2024-08-31T04:20:55.246 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:20:54 smithi177 ceph-mon[22025]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-08-31T04:20:55.246 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:20:54 smithi177 ceph-mon[22025]: from='client.? 172.21.15.50:0/4060296322' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]': finished 2024-08-31T04:20:55.246 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:20:54 smithi177 ceph-mon[22025]: daemon mds.a assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-08-31T04:20:55.246 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:20:54 smithi177 ceph-mon[22025]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-08-31T04:20:55.246 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:20:54 smithi177 ceph-mon[22025]: fsmap cephfs:2 {0=b=up:active,1=a=up:creating} 10 up:standby 2024-08-31T04:20:55.246 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:20:54 smithi177 ceph-mon[22025]: daemon mds.a is now active in filesystem cephfs as rank 1 2024-08-31T04:20:55.293 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:20:54 smithi133 ceph-mon[22177]: pgmap v305: 97 pgs: 97 active+clean; 579 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s wr, 4 op/s 2024-08-31T04:20:55.293 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:20:54 smithi133 ceph-mon[22177]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-08-31T04:20:55.293 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:20:54 smithi133 ceph-mon[22177]: from='client.? 172.21.15.50:0/4060296322' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]': finished 2024-08-31T04:20:55.293 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:20:54 smithi133 ceph-mon[22177]: daemon mds.a assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-08-31T04:20:55.293 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:20:54 smithi133 ceph-mon[22177]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-08-31T04:20:55.293 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:20:54 smithi133 ceph-mon[22177]: fsmap cephfs:2 {0=b=up:active,1=a=up:creating} 10 up:standby 2024-08-31T04:20:55.293 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:20:54 smithi133 ceph-mon[22177]: daemon mds.a is now active in filesystem cephfs as rank 1 2024-08-31T04:20:55.811 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:55.810+0000 7f40ac800640 1 -- 172.21.15.50:0/130217826 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f40a410bdc0 msgr2=0x7f40a41125f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:20:55.811 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:55.810+0000 7f40ac800640 1 --2- 172.21.15.50:0/130217826 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f40a410bdc0 0x7f40a41125f0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f40a0009ca0 tx=0x7f40a002a8c0 comp rx=0 tx=0).stop 2024-08-31T04:20:55.812 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:55.810+0000 7f40ac800640 1 -- 172.21.15.50:0/130217826 shutdown_connections 2024-08-31T04:20:55.812 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:55.810+0000 7f40ac800640 1 --2- 172.21.15.50:0/130217826 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f40a410bdc0 0x7f40a41125f0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:20:55.812 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:55.810+0000 7f40ac800640 1 --2- 172.21.15.50:0/130217826 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f40a410b470 0x7f40a410b880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:20:55.812 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:55.810+0000 7f40ac800640 1 --2- 172.21.15.50:0/130217826 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f40a4105b30 0x7f40a4105f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:20:55.812 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:55.810+0000 7f40ac800640 1 -- 172.21.15.50:0/130217826 >> 172.21.15.50:0/130217826 conn(0x7f40a4101600 msgr2=0x7f40a4103a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:20:55.812 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:55.810+0000 7f40ac800640 1 -- 172.21.15.50:0/130217826 shutdown_connections 2024-08-31T04:20:55.812 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:55.810+0000 7f40ac800640 1 -- 172.21.15.50:0/130217826 wait complete. 2024-08-31T04:20:55.813 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:55.811+0000 7f40ac800640 1 Processor -- start 2024-08-31T04:20:55.813 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:55.811+0000 7f40ac800640 1 -- start start 2024-08-31T04:20:55.814 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:55.811+0000 7f40ac800640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f40a4105b30 0x7f40a419c440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:20:55.814 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:55.811+0000 7f40ac800640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f40a410b470 0x7f40a419c9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:20:55.814 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:55.811+0000 7f40ac800640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f40a410bdc0 0x7f40a41a1c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:20:55.814 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:55.811+0000 7f40ac800640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f40a4115ad0 con 0x7f40a410b470 2024-08-31T04:20:55.814 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:55.811+0000 7f40ac800640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f40a4115950 con 0x7f40a4105b30 2024-08-31T04:20:55.814 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:55.812+0000 7f40ac800640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f40a4115c50 con 0x7f40a410bdc0 2024-08-31T04:20:55.814 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:55.812+0000 7f40a9400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f40a410b470 0x7f40a419c9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:20:55.814 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:55.812+0000 7f40a9e00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f40a4105b30 0x7f40a419c440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:20:55.814 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:55.812+0000 7f40a9400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f40a410b470 0x7f40a419c9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48208/0 (socket says 172.21.15.50:48208) 2024-08-31T04:20:55.814 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:55.812+0000 7f40a9400640 1 -- 172.21.15.50:0/1223676731 learned_addr learned my addr 172.21.15.50:0/1223676731 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:20:55.814 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:55.812+0000 7f40aa800640 1 --2- 172.21.15.50:0/1223676731 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f40a410bdc0 0x7f40a41a1c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:20:55.814 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:55.812+0000 7f40a9e00640 1 -- 172.21.15.50:0/1223676731 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f40a410bdc0 msgr2=0x7f40a41a1c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:20:55.815 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:55.812+0000 7f40a9e00640 1 --2- 172.21.15.50:0/1223676731 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f40a410bdc0 0x7f40a41a1c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:20:55.815 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:55.812+0000 7f40a9e00640 1 -- 172.21.15.50:0/1223676731 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f40a410b470 msgr2=0x7f40a419c9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:20:55.815 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:55.812+0000 7f40a9e00640 1 --2- 172.21.15.50:0/1223676731 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f40a410b470 0x7f40a419c9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:20:55.815 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:55.812+0000 7f40a9e00640 1 -- 172.21.15.50:0/1223676731 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40a41a23b0 con 0x7f40a4105b30 2024-08-31T04:20:55.815 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:55.812+0000 7f40a9400640 1 --2- 172.21.15.50:0/1223676731 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f40a410b470 0x7f40a419c9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:20:55.815 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:55.813+0000 7f40a9e00640 1 --2- 172.21.15.50:0/1223676731 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f40a4105b30 0x7f40a419c440 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f409800e9f0 tx=0x7f409800eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:20:55.815 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:55.813+0000 7f409ea00640 1 -- 172.21.15.50:0/1223676731 <== mon.2 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f409800ccc0 con 0x7f40a4105b30 2024-08-31T04:20:55.816 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:55.813+0000 7f409ea00640 1 -- 172.21.15.50:0/1223676731 <== mon.2 v2:172.21.15.133:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4098005020 con 0x7f40a4105b30 2024-08-31T04:20:55.816 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:55.813+0000 7f40ac800640 1 -- 172.21.15.50:0/1223676731 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f40a41a26a0 con 0x7f40a4105b30 2024-08-31T04:20:55.816 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:55.813+0000 7f409ea00640 1 -- 172.21.15.50:0/1223676731 <== mon.2 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4098004a00 con 0x7f40a4105b30 2024-08-31T04:20:55.816 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:55.813+0000 7f40ac800640 1 -- 172.21.15.50:0/1223676731 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f40a41a8e00 con 0x7f40a4105b30 2024-08-31T04:20:55.816 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:55.814+0000 7f40ac800640 1 -- 172.21.15.50:0/1223676731 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f40a4105f40 con 0x7f40a4105b30 2024-08-31T04:20:55.818 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:55.817+0000 7f409ea00640 1 -- 172.21.15.50:0/1223676731 <== mon.2 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 16) ==== 152577+0+0 (secure 0 0 0) 0x7f4098004ba0 con 0x7f40a4105b30 2024-08-31T04:20:55.819 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:55.818+0000 7f409ea00640 1 --2- 172.21.15.50:0/1223676731 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f408c0b4b30 0x7f408c0b7040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:20:55.820 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:55.818+0000 7f409ea00640 1 -- 172.21.15.50:0/1223676731 <== mon.2 v2:172.21.15.133:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 7979+0+0 (secure 0 0 0) 0x7f40980e5080 con 0x7f40a4105b30 2024-08-31T04:20:55.820 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:55.819+0000 7f40a9400640 1 --2- 172.21.15.50:0/1223676731 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f408c0b4b30 0x7f408c0b7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:20:55.820 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:55.819+0000 7f40a9400640 1 --2- 172.21.15.50:0/1223676731 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f408c0b4b30 0x7f408c0b7040 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f40a4104eb0 tx=0x7f4094005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:20:55.821 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:55.820+0000 7f409ea00640 1 -- 172.21.15.50:0/1223676731 <== mon.2 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f40980ac2f0 con 0x7f40a4105b30 2024-08-31T04:20:56.071 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:56.069+0000 7f40ac800640 1 -- 172.21.15.50:0/1223676731 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} v 0) -- 0x7f40a402e430 con 0x7f40a4105b30 2024-08-31T04:20:56.246 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:20:55 smithi177 ceph-mon[22025]: mds.? [v2:172.21.15.50:6840/575209862,v1:172.21.15.50:6841/575209862] up:active 2024-08-31T04:20:56.246 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:20:55 smithi177 ceph-mon[22025]: daemon mds.i assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-08-31T04:20:56.246 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:20:55 smithi177 ceph-mon[22025]: fsmap cephfs:2 {0=b=up:active,1=a=up:active} 10 up:standby 2024-08-31T04:20:56.246 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:20:55 smithi177 ceph-mon[22025]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=i=up:creating} 9 up:standby 2024-08-31T04:20:56.247 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:20:55 smithi177 ceph-mon[22025]: daemon mds.i is now active in filesystem cephfs as rank 2 2024-08-31T04:20:56.247 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:20:55 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [2, 4, 8, 11]} : dispatch 2024-08-31T04:20:56.247 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:20:55 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [2, 1]} : dispatch 2024-08-31T04:20:56.247 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:20:55 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [8, 11]} : dispatch 2024-08-31T04:20:56.247 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:20:55 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [4, 6]} : dispatch 2024-08-31T04:20:56.247 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:20:55 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.17", "id": [4, 8]} : dispatch 2024-08-31T04:20:56.247 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:20:55 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.25", "id": [5, 9]} : dispatch 2024-08-31T04:20:56.247 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:20:55 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.29", "id": [3, 9]} : dispatch 2024-08-31T04:20:56.247 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:20:55 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.36", "id": [4, 9]} : dispatch 2024-08-31T04:20:56.293 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:20:55 smithi133 ceph-mon[22177]: mds.? [v2:172.21.15.50:6840/575209862,v1:172.21.15.50:6841/575209862] up:active 2024-08-31T04:20:56.293 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:20:55 smithi133 ceph-mon[22177]: daemon mds.i assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-08-31T04:20:56.293 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:20:55 smithi133 ceph-mon[22177]: fsmap cephfs:2 {0=b=up:active,1=a=up:active} 10 up:standby 2024-08-31T04:20:56.293 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:20:55 smithi133 ceph-mon[22177]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=i=up:creating} 9 up:standby 2024-08-31T04:20:56.293 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:20:55 smithi133 ceph-mon[22177]: daemon mds.i is now active in filesystem cephfs as rank 2 2024-08-31T04:20:56.293 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:20:55 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [2, 4, 8, 11]} : dispatch 2024-08-31T04:20:56.293 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:20:55 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [2, 1]} : dispatch 2024-08-31T04:20:56.294 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:20:55 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [8, 11]} : dispatch 2024-08-31T04:20:56.294 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:20:55 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [4, 6]} : dispatch 2024-08-31T04:20:56.294 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:20:55 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.17", "id": [4, 8]} : dispatch 2024-08-31T04:20:56.294 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:20:55 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.25", "id": [5, 9]} : dispatch 2024-08-31T04:20:56.294 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:20:55 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.29", "id": [3, 9]} : dispatch 2024-08-31T04:20:56.294 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:20:55 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.36", "id": [4, 9]} : dispatch 2024-08-31T04:20:56.450 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:20:55 smithi050 ceph-mon[17259]: mds.? [v2:172.21.15.50:6840/575209862,v1:172.21.15.50:6841/575209862] up:active 2024-08-31T04:20:56.450 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:20:55 smithi050 ceph-mon[17259]: daemon mds.i assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-08-31T04:20:56.450 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:20:55 smithi050 ceph-mon[17259]: fsmap cephfs:2 {0=b=up:active,1=a=up:active} 10 up:standby 2024-08-31T04:20:56.450 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:20:55 smithi050 ceph-mon[17259]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=i=up:creating} 9 up:standby 2024-08-31T04:20:56.450 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:20:55 smithi050 ceph-mon[17259]: daemon mds.i is now active in filesystem cephfs as rank 2 2024-08-31T04:20:56.450 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:20:55 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [2, 4, 8, 11]} : dispatch 2024-08-31T04:20:56.450 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:20:55 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [2, 1]} : dispatch 2024-08-31T04:20:56.450 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:20:55 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [8, 11]} : dispatch 2024-08-31T04:20:56.451 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:20:55 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [4, 6]} : dispatch 2024-08-31T04:20:56.451 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:20:55 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.17", "id": [4, 8]} : dispatch 2024-08-31T04:20:56.451 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:20:55 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.25", "id": [5, 9]} : dispatch 2024-08-31T04:20:56.451 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:20:55 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.29", "id": [3, 9]} : dispatch 2024-08-31T04:20:56.451 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:20:55 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.36", "id": [4, 9]} : dispatch 2024-08-31T04:20:57.004 INFO:journalctl@ceph.mds.b.smithi133.stdout:Aug 31 04:20:56 smithi133 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-mds-b[52113]: 2024-08-31T04:20:56.683+0000 7ff08470f640 -1 mds.pinger is_rank_lagging: rank=2 was never sent ping request. 2024-08-31T04:20:57.018 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:57.017+0000 7f409ea00640 1 -- 172.21.15.50:0/1223676731 <== mon.2 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]=0 v23) ==== 121+0+0 (secure 0 0 0) 0x7f40980abbf0 con 0x7f40a4105b30 2024-08-31T04:20:57.021 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:57.019+0000 7f40ac800640 1 -- 172.21.15.50:0/1223676731 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f408c0b4b30 msgr2=0x7f408c0b7040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:20:57.021 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:57.019+0000 7f40ac800640 1 --2- 172.21.15.50:0/1223676731 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f408c0b4b30 0x7f408c0b7040 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f40a4104eb0 tx=0x7f4094005f90 comp rx=0 tx=0).stop 2024-08-31T04:20:57.021 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:57.019+0000 7f40ac800640 1 -- 172.21.15.50:0/1223676731 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f40a4105b30 msgr2=0x7f40a419c440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:20:57.021 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:57.019+0000 7f40ac800640 1 --2- 172.21.15.50:0/1223676731 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f40a4105b30 0x7f40a419c440 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f409800e9f0 tx=0x7f409800eeb0 comp rx=0 tx=0).stop 2024-08-31T04:20:57.021 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:57.020+0000 7f40ac800640 1 -- 172.21.15.50:0/1223676731 shutdown_connections 2024-08-31T04:20:57.021 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:57.020+0000 7f40ac800640 1 --2- 172.21.15.50:0/1223676731 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f408c0b4b30 0x7f408c0b7040 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:20:57.021 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:57.020+0000 7f40ac800640 1 --2- 172.21.15.50:0/1223676731 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f40a410bdc0 0x7f40a41a1c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:20:57.022 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:57.020+0000 7f40ac800640 1 --2- 172.21.15.50:0/1223676731 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f40a410b470 0x7f40a419c9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:20:57.022 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:57.020+0000 7f40ac800640 1 --2- 172.21.15.50:0/1223676731 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f40a4105b30 0x7f40a419c440 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:20:57.022 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:57.020+0000 7f40ac800640 1 -- 172.21.15.50:0/1223676731 >> 172.21.15.50:0/1223676731 conn(0x7f40a4101600 msgr2=0x7f40a41089c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:20:57.022 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:57.020+0000 7f40ac800640 1 -- 172.21.15.50:0/1223676731 shutdown_connections 2024-08-31T04:20:57.022 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:57.020+0000 7f40ac800640 1 -- 172.21.15.50:0/1223676731 wait complete. 2024-08-31T04:20:57.293 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:20:57 smithi133 ceph-mon[22177]: pgmap v306: 97 pgs: 97 active+clean; 581 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s wr, 8 op/s 2024-08-31T04:20:57.293 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:20:57 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [2, 4, 8, 11]}]': finished 2024-08-31T04:20:57.293 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:20:57 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [2, 1]}]': finished 2024-08-31T04:20:57.293 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:20:57 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [8, 11]}]': finished 2024-08-31T04:20:57.293 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:20:57 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [4, 6]}]': finished 2024-08-31T04:20:57.293 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:20:57 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.17", "id": [4, 8]}]': finished 2024-08-31T04:20:57.293 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:20:57 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.25", "id": [5, 9]}]': finished 2024-08-31T04:20:57.294 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:20:57 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.29", "id": [3, 9]}]': finished 2024-08-31T04:20:57.294 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:20:57 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.36", "id": [4, 9]}]': finished 2024-08-31T04:20:57.294 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:20:57 smithi133 ceph-mon[22177]: mds.? [v2:172.21.15.177:6838/3600081752,v1:172.21.15.177:6839/3600081752] up:active 2024-08-31T04:20:57.294 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:20:57 smithi133 ceph-mon[22177]: daemon mds.h assigned to filesystem cephfs as rank 3 (now has 4 ranks) 2024-08-31T04:20:57.294 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:20:57 smithi133 ceph-mon[22177]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=i=up:active} 9 up:standby 2024-08-31T04:20:57.294 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:20:57 smithi133 ceph-mon[22177]: osdmap e77: 12 total, 12 up, 12 in 2024-08-31T04:20:57.294 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:20:57 smithi133 ceph-mon[22177]: fsmap cephfs:4 {0=b=up:active,1=a=up:active,2=i=up:active,3=h=up:creating} 8 up:standby 2024-08-31T04:20:57.294 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:20:57 smithi133 ceph-mon[22177]: from='client.? 172.21.15.50:0/1223676731' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} : dispatch 2024-08-31T04:20:57.294 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:20:57 smithi133 ceph-mon[22177]: from='client.? ' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} : dispatch 2024-08-31T04:20:57.362 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:20:57 smithi050 ceph-mon[17259]: pgmap v306: 97 pgs: 97 active+clean; 581 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s wr, 8 op/s 2024-08-31T04:20:57.362 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:20:57 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [2, 4, 8, 11]}]': finished 2024-08-31T04:20:57.362 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:20:57 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [2, 1]}]': finished 2024-08-31T04:20:57.362 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:20:57 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [8, 11]}]': finished 2024-08-31T04:20:57.362 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:20:57 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [4, 6]}]': finished 2024-08-31T04:20:57.362 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:20:57 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.17", "id": [4, 8]}]': finished 2024-08-31T04:20:57.362 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:20:57 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.25", "id": [5, 9]}]': finished 2024-08-31T04:20:57.362 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:20:57 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.29", "id": [3, 9]}]': finished 2024-08-31T04:20:57.363 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:20:57 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.36", "id": [4, 9]}]': finished 2024-08-31T04:20:57.363 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:20:57 smithi050 ceph-mon[17259]: mds.? [v2:172.21.15.177:6838/3600081752,v1:172.21.15.177:6839/3600081752] up:active 2024-08-31T04:20:57.363 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:20:57 smithi050 ceph-mon[17259]: daemon mds.h assigned to filesystem cephfs as rank 3 (now has 4 ranks) 2024-08-31T04:20:57.363 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:20:57 smithi050 ceph-mon[17259]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=i=up:active} 9 up:standby 2024-08-31T04:20:57.363 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:20:57 smithi050 ceph-mon[17259]: osdmap e77: 12 total, 12 up, 12 in 2024-08-31T04:20:57.363 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:20:57 smithi050 ceph-mon[17259]: fsmap cephfs:4 {0=b=up:active,1=a=up:active,2=i=up:active,3=h=up:creating} 8 up:standby 2024-08-31T04:20:57.363 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:20:57 smithi050 ceph-mon[17259]: from='client.? 172.21.15.50:0/1223676731' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} : dispatch 2024-08-31T04:20:57.363 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:20:57 smithi050 ceph-mon[17259]: from='client.? ' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} : dispatch 2024-08-31T04:20:57.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:20:57 smithi177 ceph-mon[22025]: pgmap v306: 97 pgs: 97 active+clean; 581 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s wr, 8 op/s 2024-08-31T04:20:57.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:20:57 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [2, 4, 8, 11]}]': finished 2024-08-31T04:20:57.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:20:57 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [2, 1]}]': finished 2024-08-31T04:20:57.497 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:20:57 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [8, 11]}]': finished 2024-08-31T04:20:57.497 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:20:57 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [4, 6]}]': finished 2024-08-31T04:20:57.497 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:20:57 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.17", "id": [4, 8]}]': finished 2024-08-31T04:20:57.497 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:20:57 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.25", "id": [5, 9]}]': finished 2024-08-31T04:20:57.497 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:20:57 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.29", "id": [3, 9]}]': finished 2024-08-31T04:20:57.497 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:20:57 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.36", "id": [4, 9]}]': finished 2024-08-31T04:20:57.497 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:20:57 smithi177 ceph-mon[22025]: mds.? [v2:172.21.15.177:6838/3600081752,v1:172.21.15.177:6839/3600081752] up:active 2024-08-31T04:20:57.497 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:20:57 smithi177 ceph-mon[22025]: daemon mds.h assigned to filesystem cephfs as rank 3 (now has 4 ranks) 2024-08-31T04:20:57.497 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:20:57 smithi177 ceph-mon[22025]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=i=up:active} 9 up:standby 2024-08-31T04:20:57.497 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:20:57 smithi177 ceph-mon[22025]: osdmap e77: 12 total, 12 up, 12 in 2024-08-31T04:20:57.497 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:20:57 smithi177 ceph-mon[22025]: fsmap cephfs:4 {0=b=up:active,1=a=up:active,2=i=up:active,3=h=up:creating} 8 up:standby 2024-08-31T04:20:57.497 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:20:57 smithi177 ceph-mon[22025]: from='client.? 172.21.15.50:0/1223676731' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} : dispatch 2024-08-31T04:20:57.497 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:20:57 smithi177 ceph-mon[22025]: from='client.? ' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} : dispatch 2024-08-31T04:20:57.844 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 058d9fc6-674f-11ef-bcd4-c7b262605968 -- ceph fs set cephfs session_timeout 300 2024-08-31T04:20:58.200 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:20:58 smithi050 ceph-mon[17259]: osdmap e78: 12 total, 12 up, 12 in 2024-08-31T04:20:58.200 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:20:58 smithi050 ceph-mon[17259]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-08-31T04:20:58.200 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:20:58 smithi050 ceph-mon[17259]: fsmap cephfs:4 {0=b=up:active,1=a=up:active,2=i=up:active,3=h=up:creating} 8 up:standby 2024-08-31T04:20:58.223 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:20:58.293 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:20:58 smithi133 ceph-mon[22177]: osdmap e78: 12 total, 12 up, 12 in 2024-08-31T04:20:58.293 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:20:58 smithi133 ceph-mon[22177]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-08-31T04:20:58.293 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:20:58 smithi133 ceph-mon[22177]: fsmap cephfs:4 {0=b=up:active,1=a=up:active,2=i=up:active,3=h=up:creating} 8 up:standby 2024-08-31T04:20:58.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:20:58 smithi177 ceph-mon[22025]: osdmap e78: 12 total, 12 up, 12 in 2024-08-31T04:20:58.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:20:58 smithi177 ceph-mon[22025]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-08-31T04:20:58.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:20:58 smithi177 ceph-mon[22025]: fsmap cephfs:4 {0=b=up:active,1=a=up:active,2=i=up:active,3=h=up:creating} 8 up:standby 2024-08-31T04:20:58.840 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:58.838+0000 7feaec600640 1 -- 172.21.15.50:0/499269565 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feae4109240 msgr2=0x7feae4109650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:20:58.840 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:58.838+0000 7feaec600640 1 --2- 172.21.15.50:0/499269565 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feae4109240 0x7feae4109650 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fead0009900 tx=0x7fead002a410 comp rx=0 tx=0).stop 2024-08-31T04:20:58.840 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:58.838+0000 7feaec600640 1 -- 172.21.15.50:0/499269565 shutdown_connections 2024-08-31T04:20:58.840 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:58.838+0000 7feaec600640 1 --2- 172.21.15.50:0/499269565 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feae4109b90 0x7feae41103c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:20:58.840 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:58.838+0000 7feaec600640 1 --2- 172.21.15.50:0/499269565 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feae4109240 0x7feae4109650 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:20:58.840 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:58.838+0000 7feaec600640 1 --2- 172.21.15.50:0/499269565 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7feae4103900 0x7feae4103d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:20:58.841 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:58.838+0000 7feaec600640 1 -- 172.21.15.50:0/499269565 >> 172.21.15.50:0/499269565 conn(0x7feae407b5f0 msgr2=0x7feae407ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:20:58.841 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:58.838+0000 7feaec600640 1 -- 172.21.15.50:0/499269565 shutdown_connections 2024-08-31T04:20:58.841 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:58.838+0000 7feaec600640 1 -- 172.21.15.50:0/499269565 wait complete. 2024-08-31T04:20:58.843 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:58.839+0000 7feaec600640 1 Processor -- start 2024-08-31T04:20:58.843 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:58.839+0000 7feaec600640 1 -- start start 2024-08-31T04:20:58.843 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:58.840+0000 7feaec600640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feae4103900 0x7feae40754b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:20:58.843 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:58.840+0000 7feaec600640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7feae4109240 0x7feae40759f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:20:58.843 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:58.840+0000 7feaec600640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feae4109b90 0x7feae4075f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:20:58.843 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:58.840+0000 7feaec600640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7feae4113850 con 0x7feae4109b90 2024-08-31T04:20:58.843 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:58.840+0000 7feaec600640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7feae41136d0 con 0x7feae4103900 2024-08-31T04:20:58.844 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:58.840+0000 7feaec600640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7feae41139d0 con 0x7feae4109240 2024-08-31T04:20:58.844 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:58.840+0000 7feaea600640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feae4109b90 0x7feae4075f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:20:58.844 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:58.840+0000 7feae9200640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7feae4109240 0x7feae40759f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:20:58.844 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:58.840+0000 7feae9c00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feae4103900 0x7feae40754b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:20:58.844 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:58.840+0000 7feae9200640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7feae4109240 0x7feae40759f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.50:57366/0 (socket says 172.21.15.50:57366) 2024-08-31T04:20:58.844 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:58.840+0000 7feae9200640 1 -- 172.21.15.50:0/27462967 learned_addr learned my addr 172.21.15.50:0/27462967 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:20:58.844 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:58.840+0000 7feaea600640 1 --2- 172.21.15.50:0/27462967 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feae4109b90 0x7feae4075f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48232/0 (socket says 172.21.15.50:48232) 2024-08-31T04:20:58.844 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:58.841+0000 7feae9200640 1 -- 172.21.15.50:0/27462967 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feae4103900 msgr2=0x7feae40754b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:20:58.844 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:58.841+0000 7feae9200640 1 --2- 172.21.15.50:0/27462967 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feae4103900 0x7feae40754b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:20:58.844 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:58.841+0000 7feae9200640 1 -- 172.21.15.50:0/27462967 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feae4109b90 msgr2=0x7feae4075f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:20:58.844 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:58.841+0000 7feae9200640 1 --2- 172.21.15.50:0/27462967 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feae4109b90 0x7feae4075f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:20:58.845 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:58.841+0000 7feae9200640 1 -- 172.21.15.50:0/27462967 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feae41a8500 con 0x7feae4109240 2024-08-31T04:20:58.845 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:58.841+0000 7feae9c00640 1 --2- 172.21.15.50:0/27462967 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feae4103900 0x7feae40754b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:20:58.845 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:58.841+0000 7feaea600640 1 --2- 172.21.15.50:0/27462967 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feae4109b90 0x7feae4075f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:20:58.845 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:58.841+0000 7feae9200640 1 --2- 172.21.15.50:0/27462967 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7feae4109240 0x7feae40759f0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fead002a930 tx=0x7fead0031a20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:20:58.845 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:58.842+0000 7feae2000640 1 -- 172.21.15.50:0/27462967 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fead003f030 con 0x7feae4109240 2024-08-31T04:20:58.845 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:58.842+0000 7feaec600640 1 -- 172.21.15.50:0/27462967 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feae41a8790 con 0x7feae4109240 2024-08-31T04:20:58.845 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:58.842+0000 7feae2000640 1 -- 172.21.15.50:0/27462967 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fead0004490 con 0x7feae4109240 2024-08-31T04:20:58.845 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:58.842+0000 7feae2000640 1 -- 172.21.15.50:0/27462967 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fead0035070 con 0x7feae4109240 2024-08-31T04:20:58.845 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:58.842+0000 7feaec600640 1 -- 172.21.15.50:0/27462967 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feae41a8c70 con 0x7feae4109240 2024-08-31T04:20:58.846 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:58.843+0000 7feaec600640 1 -- 172.21.15.50:0/27462967 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feae4103d10 con 0x7feae4109240 2024-08-31T04:20:58.846 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:58.845+0000 7feae2000640 1 -- 172.21.15.50:0/27462967 <== mon.1 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 16) ==== 152577+0+0 (secure 0 0 0) 0x7fead0042030 con 0x7feae4109240 2024-08-31T04:20:58.848 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:58.847+0000 7feae2000640 1 --2- 172.21.15.50:0/27462967 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7feacc0b4b30 0x7feacc0b7040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:20:58.848 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:58.847+0000 7feae2000640 1 -- 172.21.15.50:0/27462967 <== mon.1 v2:172.21.15.177:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8219+0+0 (secure 0 0 0) 0x7fead0105850 con 0x7feae4109240 2024-08-31T04:20:58.849 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:58.847+0000 7feae9c00640 1 --2- 172.21.15.50:0/27462967 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7feacc0b4b30 0x7feacc0b7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:20:58.849 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:58.848+0000 7feae9c00640 1 --2- 172.21.15.50:0/27462967 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7feacc0b4b30 0x7feacc0b7040 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7feae4076f00 tx=0x7fead8005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:20:58.850 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:58.849+0000 7feae2000640 1 -- 172.21.15.50:0/27462967 <== mon.1 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fead00cc2e0 con 0x7feae4109240 2024-08-31T04:20:59.096 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:20:59.094+0000 7feaec600640 1 -- 172.21.15.50:0/27462967 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} v 0) -- 0x7feae40767b0 con 0x7feae4109240 2024-08-31T04:20:59.293 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:20:59 smithi133 ceph-mon[22177]: pgmap v309: 97 pgs: 1 peering, 96 active+clean; 582 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s wr, 10 op/s 2024-08-31T04:20:59.450 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:20:59 smithi050 ceph-mon[17259]: pgmap v309: 97 pgs: 1 peering, 96 active+clean; 582 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s wr, 10 op/s 2024-08-31T04:20:59.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:20:59 smithi177 ceph-mon[22025]: pgmap v309: 97 pgs: 1 peering, 96 active+clean; 582 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s wr, 10 op/s 2024-08-31T04:21:00.023 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:00.022+0000 7feae2000640 1 -- 172.21.15.50:0/27462967 <== mon.1 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]=0 v24) ==== 115+0+0 (secure 0 0 0) 0x7feae40767b0 con 0x7feae4109240 2024-08-31T04:21:00.027 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:00.026+0000 7feaec600640 1 -- 172.21.15.50:0/27462967 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7feacc0b4b30 msgr2=0x7feacc0b7040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:21:00.027 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:00.026+0000 7feaec600640 1 --2- 172.21.15.50:0/27462967 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7feacc0b4b30 0x7feacc0b7040 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7feae4076f00 tx=0x7fead8005f90 comp rx=0 tx=0).stop 2024-08-31T04:21:00.027 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:00.026+0000 7feaec600640 1 -- 172.21.15.50:0/27462967 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7feae4109240 msgr2=0x7feae40759f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:21:00.028 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:00.026+0000 7feaec600640 1 --2- 172.21.15.50:0/27462967 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7feae4109240 0x7feae40759f0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fead002a930 tx=0x7fead0031a20 comp rx=0 tx=0).stop 2024-08-31T04:21:00.028 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:00.026+0000 7feaec600640 1 -- 172.21.15.50:0/27462967 shutdown_connections 2024-08-31T04:21:00.028 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:00.026+0000 7feaec600640 1 --2- 172.21.15.50:0/27462967 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7feacc0b4b30 0x7feacc0b7040 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:00.028 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:00.026+0000 7feaec600640 1 --2- 172.21.15.50:0/27462967 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7feae4109240 0x7feae40759f0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:00.028 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:00.026+0000 7feaec600640 1 --2- 172.21.15.50:0/27462967 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feae4109b90 0x7feae4075f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:00.028 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:00.026+0000 7feaec600640 1 --2- 172.21.15.50:0/27462967 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feae4103900 0x7feae40754b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:00.028 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:00.026+0000 7feaec600640 1 -- 172.21.15.50:0/27462967 >> 172.21.15.50:0/27462967 conn(0x7feae407b5f0 msgr2=0x7feae4107330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:21:00.028 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:00.026+0000 7feaec600640 1 -- 172.21.15.50:0/27462967 shutdown_connections 2024-08-31T04:21:00.028 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:00.026+0000 7feaec600640 1 -- 172.21.15.50:0/27462967 wait complete. 2024-08-31T04:21:00.293 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:21:00 smithi133 ceph-mon[22177]: from='client.? 172.21.15.50:0/27462967' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} : dispatch 2024-08-31T04:21:00.293 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:21:00 smithi133 ceph-mon[22177]: from='client.? ' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} : dispatch 2024-08-31T04:21:00.402 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:21:00 smithi050 ceph-mon[17259]: from='client.? 172.21.15.50:0/27462967' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} : dispatch 2024-08-31T04:21:00.402 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:21:00 smithi050 ceph-mon[17259]: from='client.? ' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} : dispatch 2024-08-31T04:21:00.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:21:00 smithi177 ceph-mon[22025]: from='client.? 172.21.15.50:0/27462967' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} : dispatch 2024-08-31T04:21:00.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:21:00 smithi177 ceph-mon[22025]: from='client.? ' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} : dispatch 2024-08-31T04:21:00.934 DEBUG:tasks.cephfs.filesystem:Creating {'create': 2, 'subvol_options': '--namespace-isolated'} subvols for filesystem 'cephfs' 2024-08-31T04:21:00.934 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 058d9fc6-674f-11ef-bcd4-c7b262605968 -- ceph fs subvolumegroup create cephfs qa 2024-08-31T04:21:01.200 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:21:01 smithi050 ceph-mon[17259]: pgmap v310: 97 pgs: 1 peering, 96 active+clean; 582 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s wr, 11 op/s 2024-08-31T04:21:01.200 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:21:01 smithi050 ceph-mon[17259]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-08-31T04:21:01.200 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:21:01 smithi050 ceph-mon[17259]: fsmap cephfs:4 {0=b=up:active,1=a=up:active,2=i=up:active,3=h=up:creating} 8 up:standby 2024-08-31T04:21:01.200 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:21:01 smithi050 ceph-mon[17259]: daemon mds.h is now active in filesystem cephfs as rank 3 2024-08-31T04:21:01.293 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:21:01 smithi133 ceph-mon[22177]: pgmap v310: 97 pgs: 1 peering, 96 active+clean; 582 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s wr, 11 op/s 2024-08-31T04:21:01.293 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:21:01 smithi133 ceph-mon[22177]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-08-31T04:21:01.293 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:21:01 smithi133 ceph-mon[22177]: fsmap cephfs:4 {0=b=up:active,1=a=up:active,2=i=up:active,3=h=up:creating} 8 up:standby 2024-08-31T04:21:01.293 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:21:01 smithi133 ceph-mon[22177]: daemon mds.h is now active in filesystem cephfs as rank 3 2024-08-31T04:21:01.324 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:21:01.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:21:01 smithi177 ceph-mon[22025]: pgmap v310: 97 pgs: 1 peering, 96 active+clean; 582 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s wr, 11 op/s 2024-08-31T04:21:01.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:21:01 smithi177 ceph-mon[22025]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-08-31T04:21:01.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:21:01 smithi177 ceph-mon[22025]: fsmap cephfs:4 {0=b=up:active,1=a=up:active,2=i=up:active,3=h=up:creating} 8 up:standby 2024-08-31T04:21:01.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:21:01 smithi177 ceph-mon[22025]: daemon mds.h is now active in filesystem cephfs as rank 3 2024-08-31T04:21:01.923 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:01.921+0000 7f6c3f200640 1 -- 172.21.15.50:0/2181002297 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6c38109b90 msgr2=0x7f6c381103c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:21:01.923 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:01.921+0000 7f6c3f200640 1 --2- 172.21.15.50:0/2181002297 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6c38109b90 0x7f6c381103c0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f6c30009ca0 tx=0x7f6c3002a8c0 comp rx=0 tx=0).stop 2024-08-31T04:21:01.923 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:01.921+0000 7f6c3f200640 1 -- 172.21.15.50:0/2181002297 shutdown_connections 2024-08-31T04:21:01.923 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:01.921+0000 7f6c3f200640 1 --2- 172.21.15.50:0/2181002297 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6c38109240 0x7f6c38109650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:01.923 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:01.921+0000 7f6c3f200640 1 --2- 172.21.15.50:0/2181002297 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6c38109b90 0x7f6c381103c0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:01.923 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:01.921+0000 7f6c3f200640 1 --2- 172.21.15.50:0/2181002297 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6c38103900 0x7f6c38103d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:01.923 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:01.921+0000 7f6c3f200640 1 -- 172.21.15.50:0/2181002297 >> 172.21.15.50:0/2181002297 conn(0x7f6c3807b5f0 msgr2=0x7f6c3807ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:21:01.923 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:01.921+0000 7f6c3f200640 1 -- 172.21.15.50:0/2181002297 shutdown_connections 2024-08-31T04:21:01.923 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:01.921+0000 7f6c3f200640 1 -- 172.21.15.50:0/2181002297 wait complete. 2024-08-31T04:21:01.925 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:01.922+0000 7f6c3f200640 1 Processor -- start 2024-08-31T04:21:01.925 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:01.922+0000 7f6c3f200640 1 -- start start 2024-08-31T04:21:01.925 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:01.923+0000 7f6c3f200640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6c38103900 0x7f6c380754b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:21:01.925 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:01.923+0000 7f6c3f200640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6c38109240 0x7f6c380759f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:21:01.925 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:01.923+0000 7f6c3f200640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6c38109b90 0x7f6c38075f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:21:01.925 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:01.923+0000 7f6c3f200640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f6c38113850 con 0x7f6c38109240 2024-08-31T04:21:01.925 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:01.923+0000 7f6c3f200640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f6c381136d0 con 0x7f6c38109b90 2024-08-31T04:21:01.925 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:01.923+0000 7f6c3f200640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f6c381139d0 con 0x7f6c38103900 2024-08-31T04:21:01.925 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:01.923+0000 7f6c37e00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6c38103900 0x7f6c380754b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:21:01.925 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:01.923+0000 7f6c2f400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6c38109240 0x7f6c380759f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:21:01.925 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:01.923+0000 7f6c37e00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6c38103900 0x7f6c380754b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.50:57378/0 (socket says 172.21.15.50:57378) 2024-08-31T04:21:01.925 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:01.923+0000 7f6c37e00640 1 -- 172.21.15.50:0/3815518668 learned_addr learned my addr 172.21.15.50:0/3815518668 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:21:01.926 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:01.923+0000 7f6c3d200640 1 --2- 172.21.15.50:0/3815518668 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6c38109b90 0x7f6c38075f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:21:01.926 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:01.923+0000 7f6c37e00640 1 -- 172.21.15.50:0/3815518668 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6c38109b90 msgr2=0x7f6c38075f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:21:01.926 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:01.923+0000 7f6c37e00640 1 --2- 172.21.15.50:0/3815518668 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6c38109b90 0x7f6c38075f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:01.926 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:01.923+0000 7f6c37e00640 1 -- 172.21.15.50:0/3815518668 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6c38109240 msgr2=0x7f6c380759f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:21:01.926 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:01.923+0000 7f6c37e00640 1 --2- 172.21.15.50:0/3815518668 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6c38109240 0x7f6c380759f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:01.926 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:01.923+0000 7f6c37e00640 1 -- 172.21.15.50:0/3815518668 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c381a84c0 con 0x7f6c38103900 2024-08-31T04:21:01.926 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:01.923+0000 7f6c3d200640 1 --2- 172.21.15.50:0/3815518668 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6c38109b90 0x7f6c38075f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:21:01.927 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:01.924+0000 7f6c37e00640 1 --2- 172.21.15.50:0/3815518668 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6c38103900 0x7f6c380754b0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f6c2800e9f0 tx=0x7f6c2800eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:21:01.927 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:01.924+0000 7f6c35600640 1 -- 172.21.15.50:0/3815518668 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c2800cd80 con 0x7f6c38103900 2024-08-31T04:21:01.927 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:01.924+0000 7f6c3f200640 1 -- 172.21.15.50:0/3815518668 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6c381a87b0 con 0x7f6c38103900 2024-08-31T04:21:01.927 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:01.924+0000 7f6c35600640 1 -- 172.21.15.50:0/3815518668 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6c280108e0 con 0x7f6c38103900 2024-08-31T04:21:01.927 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:01.924+0000 7f6c35600640 1 -- 172.21.15.50:0/3815518668 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c28018980 con 0x7f6c38103900 2024-08-31T04:21:01.927 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:01.924+0000 7f6c3f200640 1 -- 172.21.15.50:0/3815518668 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6c381a8cf0 con 0x7f6c38103900 2024-08-31T04:21:01.927 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:01.925+0000 7f6c3f200640 1 -- 172.21.15.50:0/3815518668 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6c38103d10 con 0x7f6c38103900 2024-08-31T04:21:01.929 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:01.928+0000 7f6c35600640 1 -- 172.21.15.50:0/3815518668 <== mon.1 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 16) ==== 152577+0+0 (secure 0 0 0) 0x7f6c28010430 con 0x7f6c38103900 2024-08-31T04:21:01.930 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:01.929+0000 7f6c35600640 1 --2- 172.21.15.50:0/3815518668 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f6c1c0b4b30 0x7f6c1c0b7040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:21:01.931 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:01.930+0000 7f6c35600640 1 -- 172.21.15.50:0/3815518668 <== mon.1 v2:172.21.15.177:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8219+0+0 (secure 0 0 0) 0x7f6c280e5a20 con 0x7f6c38103900 2024-08-31T04:21:01.931 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:01.930+0000 7f6c2f400640 1 --2- 172.21.15.50:0/3815518668 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f6c1c0b4b30 0x7f6c1c0b7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:21:01.931 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:01.930+0000 7f6c2f400640 1 --2- 172.21.15.50:0/3815518668 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f6c1c0b4b30 0x7f6c1c0b7040 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f6c38108de0 tx=0x7f6c20005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:21:01.932 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:01.931+0000 7f6c35600640 1 -- 172.21.15.50:0/3815518668 <== mon.1 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f6c280acb00 con 0x7f6c38103900 2024-08-31T04:21:02.035 INFO:journalctl@ceph.mds.b.smithi133.stdout:Aug 31 04:21:01 smithi133 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-mds-b[52113]: 2024-08-31T04:21:01.683+0000 7ff08470f640 -1 mds.pinger is_rank_lagging: rank=3 was never sent ping request. 2024-08-31T04:21:02.035 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:21:02 smithi050 ceph-mon[17259]: mds.? [v2:172.21.15.133:6836/4014853202,v1:172.21.15.133:6837/4014853202] up:active 2024-08-31T04:21:02.159 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:02.158+0000 7f6c3f200640 1 -- 172.21.15.50:0/3815518668 --> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7f6c380635a0 con 0x7f6c1c0b4b30 2024-08-31T04:21:02.200 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:02.198+0000 7f6c35600640 1 -- 172.21.15.50:0/3815518668 <== mgr.14150 v2:172.21.15.50:6800/2146686622 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f6c380635a0 con 0x7f6c1c0b4b30 2024-08-31T04:21:02.202 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:02.200+0000 7f6c3f200640 1 -- 172.21.15.50:0/3815518668 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f6c1c0b4b30 msgr2=0x7f6c1c0b7040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:21:02.202 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:02.200+0000 7f6c3f200640 1 --2- 172.21.15.50:0/3815518668 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f6c1c0b4b30 0x7f6c1c0b7040 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f6c38108de0 tx=0x7f6c20005f90 comp rx=0 tx=0).stop 2024-08-31T04:21:02.202 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:02.200+0000 7f6c3f200640 1 -- 172.21.15.50:0/3815518668 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6c38103900 msgr2=0x7f6c380754b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:21:02.202 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:02.200+0000 7f6c3f200640 1 --2- 172.21.15.50:0/3815518668 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6c38103900 0x7f6c380754b0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f6c2800e9f0 tx=0x7f6c2800eeb0 comp rx=0 tx=0).stop 2024-08-31T04:21:02.202 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:02.200+0000 7f6c3f200640 1 -- 172.21.15.50:0/3815518668 shutdown_connections 2024-08-31T04:21:02.202 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:02.201+0000 7f6c3f200640 1 --2- 172.21.15.50:0/3815518668 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f6c1c0b4b30 0x7f6c1c0b7040 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:02.202 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:02.201+0000 7f6c3f200640 1 --2- 172.21.15.50:0/3815518668 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6c38109b90 0x7f6c38075f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:02.202 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:02.201+0000 7f6c3f200640 1 --2- 172.21.15.50:0/3815518668 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6c38109240 0x7f6c380759f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:02.202 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:02.201+0000 7f6c3f200640 1 --2- 172.21.15.50:0/3815518668 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6c38103900 0x7f6c380754b0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:02.203 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:02.201+0000 7f6c3f200640 1 -- 172.21.15.50:0/3815518668 >> 172.21.15.50:0/3815518668 conn(0x7f6c3807b5f0 msgr2=0x7f6c38107290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:21:02.203 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:02.201+0000 7f6c3f200640 1 -- 172.21.15.50:0/3815518668 shutdown_connections 2024-08-31T04:21:02.203 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:02.201+0000 7f6c3f200640 1 -- 172.21.15.50:0/3815518668 wait complete. 2024-08-31T04:21:02.292 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:21:02 smithi133 ceph-mon[22177]: mds.? [v2:172.21.15.133:6836/4014853202,v1:172.21.15.133:6837/4014853202] up:active 2024-08-31T04:21:02.293 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:21:02 smithi133 ceph-mon[22177]: daemon mds.c assigned to filesystem cephfs as rank 4 (now has 5 ranks) 2024-08-31T04:21:02.293 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:21:02 smithi133 ceph-mon[22177]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-08-31T04:21:02.293 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:21:02 smithi133 ceph-mon[22177]: Cluster is now healthy 2024-08-31T04:21:02.293 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:21:02 smithi133 ceph-mon[22177]: fsmap cephfs:4 {0=b=up:active,1=a=up:active,2=i=up:active,3=h=up:active} 8 up:standby 2024-08-31T04:21:02.293 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:21:02 smithi133 ceph-mon[22177]: fsmap cephfs:5 1 up:creating 7 up:standby 4 up:active 2024-08-31T04:21:02.293 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:21:02 smithi133 ceph-mon[22177]: daemon mds.c is now active in filesystem cephfs as rank 4 2024-08-31T04:21:02.450 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Aug 31 04:21:02 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-mgr-x[17482]: 2024-08-31T04:21:02.165+0000 7f12bc000640 -1 client.0 error registering admin socket command: (17) File exists 2024-08-31T04:21:02.450 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Aug 31 04:21:02 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-mgr-x[17482]: 2024-08-31T04:21:02.165+0000 7f12bc000640 -1 client.0 error registering admin socket command: (17) File exists 2024-08-31T04:21:02.450 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Aug 31 04:21:02 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-mgr-x[17482]: 2024-08-31T04:21:02.165+0000 7f12bc000640 -1 client.0 error registering admin socket command: (17) File exists 2024-08-31T04:21:02.450 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Aug 31 04:21:02 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-mgr-x[17482]: 2024-08-31T04:21:02.165+0000 7f12bc000640 -1 client.0 error registering admin socket command: (17) File exists 2024-08-31T04:21:02.450 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Aug 31 04:21:02 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-mgr-x[17482]: 2024-08-31T04:21:02.165+0000 7f12bc000640 -1 client.0 error registering admin socket command: (17) File exists 2024-08-31T04:21:02.451 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:21:02 smithi050 ceph-mon[17259]: daemon mds.c assigned to filesystem cephfs as rank 4 (now has 5 ranks) 2024-08-31T04:21:02.451 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:21:02 smithi050 ceph-mon[17259]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-08-31T04:21:02.451 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:21:02 smithi050 ceph-mon[17259]: Cluster is now healthy 2024-08-31T04:21:02.451 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:21:02 smithi050 ceph-mon[17259]: fsmap cephfs:4 {0=b=up:active,1=a=up:active,2=i=up:active,3=h=up:active} 8 up:standby 2024-08-31T04:21:02.451 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:21:02 smithi050 ceph-mon[17259]: fsmap cephfs:5 1 up:creating 7 up:standby 4 up:active 2024-08-31T04:21:02.451 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:21:02 smithi050 ceph-mon[17259]: daemon mds.c is now active in filesystem cephfs as rank 4 2024-08-31T04:21:02.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:21:02 smithi177 ceph-mon[22025]: mds.? [v2:172.21.15.133:6836/4014853202,v1:172.21.15.133:6837/4014853202] up:active 2024-08-31T04:21:02.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:21:02 smithi177 ceph-mon[22025]: daemon mds.c assigned to filesystem cephfs as rank 4 (now has 5 ranks) 2024-08-31T04:21:02.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:21:02 smithi177 ceph-mon[22025]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-08-31T04:21:02.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:21:02 smithi177 ceph-mon[22025]: Cluster is now healthy 2024-08-31T04:21:02.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:21:02 smithi177 ceph-mon[22025]: fsmap cephfs:4 {0=b=up:active,1=a=up:active,2=i=up:active,3=h=up:active} 8 up:standby 2024-08-31T04:21:02.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:21:02 smithi177 ceph-mon[22025]: fsmap cephfs:5 1 up:creating 7 up:standby 4 up:active 2024-08-31T04:21:02.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:21:02 smithi177 ceph-mon[22025]: daemon mds.c is now active in filesystem cephfs as rank 4 2024-08-31T04:21:02.965 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 058d9fc6-674f-11ef-bcd4-c7b262605968 -- ceph fs subvolume create cephfs sv_0 --group_name qa 2024-08-31T04:21:03.200 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:21:03 smithi050 ceph-mon[17259]: pgmap v311: 97 pgs: 97 active+clean; 583 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s wr, 15 op/s; 77 B/s, 1 keys/s, 0 objects/s recovering 2024-08-31T04:21:03.200 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:21:03 smithi050 ceph-mon[17259]: mds.? [v2:172.21.15.177:6836/2159859285,v1:172.21.15.177:6837/2159859285] up:active 2024-08-31T04:21:03.200 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:21:03 smithi050 ceph-mon[17259]: fsmap cephfs:5 7 up:standby 5 up:active 2024-08-31T04:21:03.200 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:21:03 smithi050 ceph-mon[17259]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-31T04:21:03.200 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:21:03 smithi050 ceph-mon[17259]: from='client.24772 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:21:03.344 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:21:03.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:21:03 smithi177 ceph-mon[22025]: pgmap v311: 97 pgs: 97 active+clean; 583 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s wr, 15 op/s; 77 B/s, 1 keys/s, 0 objects/s recovering 2024-08-31T04:21:03.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:21:03 smithi177 ceph-mon[22025]: mds.? [v2:172.21.15.177:6836/2159859285,v1:172.21.15.177:6837/2159859285] up:active 2024-08-31T04:21:03.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:21:03 smithi177 ceph-mon[22025]: fsmap cephfs:5 7 up:standby 5 up:active 2024-08-31T04:21:03.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:21:03 smithi177 ceph-mon[22025]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-31T04:21:03.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:21:03 smithi177 ceph-mon[22025]: from='client.24772 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:21:03.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:21:03 smithi133 ceph-mon[22177]: pgmap v311: 97 pgs: 97 active+clean; 583 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s wr, 15 op/s; 77 B/s, 1 keys/s, 0 objects/s recovering 2024-08-31T04:21:03.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:21:03 smithi133 ceph-mon[22177]: mds.? [v2:172.21.15.177:6836/2159859285,v1:172.21.15.177:6837/2159859285] up:active 2024-08-31T04:21:03.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:21:03 smithi133 ceph-mon[22177]: fsmap cephfs:5 7 up:standby 5 up:active 2024-08-31T04:21:03.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:21:03 smithi133 ceph-mon[22177]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-31T04:21:03.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:21:03 smithi133 ceph-mon[22177]: from='client.24772 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:21:03.941 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:03.939+0000 7fe600800640 1 -- 172.21.15.50:0/4147813942 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe5f810fec0 msgr2=0x7fe5f81122e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:21:03.941 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:03.939+0000 7fe600800640 1 --2- 172.21.15.50:0/4147813942 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe5f810fec0 0x7fe5f81122e0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fe5f4009ca0 tx=0x7fe5f402a8c0 comp rx=0 tx=0).stop 2024-08-31T04:21:03.941 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:03.939+0000 7fe600800640 1 -- 172.21.15.50:0/4147813942 shutdown_connections 2024-08-31T04:21:03.942 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:03.939+0000 7fe600800640 1 --2- 172.21.15.50:0/4147813942 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe5f810fec0 0x7fe5f81122e0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:03.942 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:03.939+0000 7fe600800640 1 --2- 172.21.15.50:0/4147813942 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe5f8075e40 0x7fe5f810f980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:03.942 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:03.939+0000 7fe600800640 1 --2- 172.21.15.50:0/4147813942 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe5f80754f0 0x7fe5f8075900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:03.942 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:03.939+0000 7fe600800640 1 -- 172.21.15.50:0/4147813942 >> 172.21.15.50:0/4147813942 conn(0x7fe5f807b5f0 msgr2=0x7fe5f807ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:21:03.942 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:03.940+0000 7fe600800640 1 -- 172.21.15.50:0/4147813942 shutdown_connections 2024-08-31T04:21:03.942 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:03.940+0000 7fe600800640 1 -- 172.21.15.50:0/4147813942 wait complete. 2024-08-31T04:21:03.943 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:03.941+0000 7fe600800640 1 Processor -- start 2024-08-31T04:21:03.943 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:03.941+0000 7fe600800640 1 -- start start 2024-08-31T04:21:03.943 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:03.941+0000 7fe600800640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe5f80754f0 0x7fe5f819c3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:21:03.944 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:03.941+0000 7fe600800640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe5f8075e40 0x7fe5f819c980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:21:03.944 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:03.941+0000 7fe600800640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe5f810fec0 0x7fe5f81a1c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:21:03.944 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:03.941+0000 7fe600800640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fe5f8115a30 con 0x7fe5f810fec0 2024-08-31T04:21:03.944 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:03.941+0000 7fe600800640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7fe5f81158b0 con 0x7fe5f8075e40 2024-08-31T04:21:03.944 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:03.941+0000 7fe600800640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fe5f8115bb0 con 0x7fe5f80754f0 2024-08-31T04:21:03.944 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:03.941+0000 7fe5fde00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe5f80754f0 0x7fe5f819c3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:21:03.944 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:03.941+0000 7fe5fde00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe5f80754f0 0x7fe5f819c3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.50:33444/0 (socket says 172.21.15.50:33444) 2024-08-31T04:21:03.944 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:03.942+0000 7fe5fde00640 1 -- 172.21.15.50:0/1585492163 learned_addr learned my addr 172.21.15.50:0/1585492163 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:21:03.944 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:03.942+0000 7fe5fe800640 1 --2- 172.21.15.50:0/1585492163 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe5f810fec0 0x7fe5f81a1c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:21:03.944 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:03.942+0000 7fe5fd400640 1 --2- 172.21.15.50:0/1585492163 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe5f8075e40 0x7fe5f819c980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:21:03.944 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:03.942+0000 7fe5fde00640 1 -- 172.21.15.50:0/1585492163 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe5f8075e40 msgr2=0x7fe5f819c980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:21:03.944 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:03.942+0000 7fe5fde00640 1 --2- 172.21.15.50:0/1585492163 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe5f8075e40 0x7fe5f819c980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:03.944 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:03.942+0000 7fe5fde00640 1 -- 172.21.15.50:0/1585492163 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe5f810fec0 msgr2=0x7fe5f81a1c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:21:03.945 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:03.942+0000 7fe5fde00640 1 --2- 172.21.15.50:0/1585492163 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe5f810fec0 0x7fe5f81a1c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:03.945 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:03.942+0000 7fe5fde00640 1 -- 172.21.15.50:0/1585492163 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5f81a2350 con 0x7fe5f80754f0 2024-08-31T04:21:03.945 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:03.942+0000 7fe5fde00640 1 --2- 172.21.15.50:0/1585492163 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe5f80754f0 0x7fe5f819c3e0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fe5ec00e9f0 tx=0x7fe5ec00edf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:21:03.946 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:03.943+0000 7fe5f2a00640 1 -- 172.21.15.50:0/1585492163 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5ec00cd80 con 0x7fe5f80754f0 2024-08-31T04:21:03.946 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:03.943+0000 7fe600800640 1 -- 172.21.15.50:0/1585492163 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe5f81a2640 con 0x7fe5f80754f0 2024-08-31T04:21:03.946 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:03.943+0000 7fe5f2a00640 1 -- 172.21.15.50:0/1585492163 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe5ec0054d0 con 0x7fe5f80754f0 2024-08-31T04:21:03.946 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:03.943+0000 7fe600800640 1 -- 172.21.15.50:0/1585492163 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe5f81a8da0 con 0x7fe5f80754f0 2024-08-31T04:21:03.946 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:03.943+0000 7fe5f2a00640 1 -- 172.21.15.50:0/1585492163 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5ec010430 con 0x7fe5f80754f0 2024-08-31T04:21:03.946 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:03.944+0000 7fe600800640 1 -- 172.21.15.50:0/1585492163 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe5f8075900 con 0x7fe5f80754f0 2024-08-31T04:21:03.948 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:03.947+0000 7fe5f2a00640 1 -- 172.21.15.50:0/1585492163 <== mon.1 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 16) ==== 152577+0+0 (secure 0 0 0) 0x7fe5ec0046c0 con 0x7fe5f80754f0 2024-08-31T04:21:03.949 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:03.948+0000 7fe5f2a00640 1 --2- 172.21.15.50:0/1585492163 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fe5e00b4bb0 0x7fe5e00b70c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:21:03.949 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:03.948+0000 7fe5f2a00640 1 -- 172.21.15.50:0/1585492163 <== mon.1 v2:172.21.15.177:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8219+0+0 (secure 0 0 0) 0x7fe5ec0e5640 con 0x7fe5f80754f0 2024-08-31T04:21:03.949 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:03.948+0000 7fe5fd400640 1 --2- 172.21.15.50:0/1585492163 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fe5e00b4bb0 0x7fe5e00b70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:21:03.952 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:03.949+0000 7fe5fd400640 1 --2- 172.21.15.50:0/1585492163 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fe5e00b4bb0 0x7fe5e00b70c0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fe5f8111c30 tx=0x7fe5e8005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:21:03.952 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:03.950+0000 7fe5f2a00640 1 -- 172.21.15.50:0/1585492163 <== mon.1 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fe5ec056130 con 0x7fe5f80754f0 2024-08-31T04:21:04.067 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:04.066+0000 7fe5f2a00640 1 -- 172.21.15.50:0/1585492163 <== mon.1 v2:172.21.15.177:3300/0 7 ==== mgrmap(e 17) ==== 152628+0+0 (secure 0 0 0) 0x7fe5ec0a82b0 con 0x7fe5f80754f0 2024-08-31T04:21:04.181 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:04.180+0000 7fe600800640 1 -- 172.21.15.50:0/1585492163 --> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7fe5f810a0e0 con 0x7fe5e00b4bb0 2024-08-31T04:21:04.209 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:04.207+0000 7fe5f2a00640 1 -- 172.21.15.50:0/1585492163 <== mgr.14150 v2:172.21.15.50:6800/2146686622 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fe5f810a0e0 con 0x7fe5e00b4bb0 2024-08-31T04:21:04.211 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:04.209+0000 7fe600800640 1 -- 172.21.15.50:0/1585492163 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fe5e00b4bb0 msgr2=0x7fe5e00b70c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:21:04.211 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:04.209+0000 7fe600800640 1 --2- 172.21.15.50:0/1585492163 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fe5e00b4bb0 0x7fe5e00b70c0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fe5f8111c30 tx=0x7fe5e8005f90 comp rx=0 tx=0).stop 2024-08-31T04:21:04.211 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:04.209+0000 7fe600800640 1 -- 172.21.15.50:0/1585492163 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe5f80754f0 msgr2=0x7fe5f819c3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:21:04.211 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:04.209+0000 7fe600800640 1 --2- 172.21.15.50:0/1585492163 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe5f80754f0 0x7fe5f819c3e0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fe5ec00e9f0 tx=0x7fe5ec00edf0 comp rx=0 tx=0).stop 2024-08-31T04:21:04.211 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:04.210+0000 7fe600800640 1 -- 172.21.15.50:0/1585492163 shutdown_connections 2024-08-31T04:21:04.211 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:04.210+0000 7fe600800640 1 --2- 172.21.15.50:0/1585492163 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fe5e00b4bb0 0x7fe5e00b70c0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:04.211 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:04.210+0000 7fe600800640 1 --2- 172.21.15.50:0/1585492163 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe5f810fec0 0x7fe5f81a1c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:04.212 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:04.210+0000 7fe600800640 1 --2- 172.21.15.50:0/1585492163 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe5f8075e40 0x7fe5f819c980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:04.212 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:04.210+0000 7fe600800640 1 --2- 172.21.15.50:0/1585492163 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe5f80754f0 0x7fe5f819c3e0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:04.212 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:04.210+0000 7fe600800640 1 -- 172.21.15.50:0/1585492163 >> 172.21.15.50:0/1585492163 conn(0x7fe5f807b5f0 msgr2=0x7fe5f81099d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:21:04.212 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:04.210+0000 7fe600800640 1 -- 172.21.15.50:0/1585492163 shutdown_connections 2024-08-31T04:21:04.212 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:04.210+0000 7fe600800640 1 -- 172.21.15.50:0/1585492163 wait complete. 2024-08-31T04:21:05.010 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 058d9fc6-674f-11ef-bcd4-c7b262605968 -- ceph fs subvolume getpath cephfs --group_name qa sv_0 2024-08-31T04:21:05.391 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:21:05.450 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:21:05 smithi050 ceph-mon[17259]: pgmap v312: 97 pgs: 97 active+clean; 583 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s wr, 9 op/s; 77 B/s, 1 keys/s, 0 objects/s recovering 2024-08-31T04:21:05.450 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:21:05 smithi050 ceph-mon[17259]: mgrmap e17: x(active, since 8m), standbys: z, y 2024-08-31T04:21:05.450 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:21:05 smithi050 ceph-mon[17259]: from='client.24784 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:21:05.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:21:05 smithi177 ceph-mon[22025]: pgmap v312: 97 pgs: 97 active+clean; 583 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s wr, 9 op/s; 77 B/s, 1 keys/s, 0 objects/s recovering 2024-08-31T04:21:05.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:21:05 smithi177 ceph-mon[22025]: mgrmap e17: x(active, since 8m), standbys: z, y 2024-08-31T04:21:05.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:21:05 smithi177 ceph-mon[22025]: from='client.24784 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:21:05.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:21:05 smithi133 ceph-mon[22177]: pgmap v312: 97 pgs: 97 active+clean; 583 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s wr, 9 op/s; 77 B/s, 1 keys/s, 0 objects/s recovering 2024-08-31T04:21:05.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:21:05 smithi133 ceph-mon[22177]: mgrmap e17: x(active, since 8m), standbys: z, y 2024-08-31T04:21:05.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:21:05 smithi133 ceph-mon[22177]: from='client.24784 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:21:06.138 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:06.136+0000 7fc6e0000640 1 -- 172.21.15.50:0/365186551 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc6d810b460 msgr2=0x7fc6d810b870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:21:06.138 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:06.136+0000 7fc6e0000640 1 --2- 172.21.15.50:0/365186551 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc6d810b460 0x7fc6d810b870 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fc6c4009900 tx=0x7fc6c402a410 comp rx=0 tx=0).stop 2024-08-31T04:21:06.138 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:06.136+0000 7fc6e0000640 1 -- 172.21.15.50:0/365186551 shutdown_connections 2024-08-31T04:21:06.138 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:06.136+0000 7fc6e0000640 1 --2- 172.21.15.50:0/365186551 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc6d810bdb0 0x7fc6d81125e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:06.138 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:06.136+0000 7fc6e0000640 1 --2- 172.21.15.50:0/365186551 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc6d810b460 0x7fc6d810b870 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:06.138 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:06.136+0000 7fc6e0000640 1 --2- 172.21.15.50:0/365186551 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc6d8105b20 0x7fc6d8105f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:06.138 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:06.136+0000 7fc6e0000640 1 -- 172.21.15.50:0/365186551 >> 172.21.15.50:0/365186551 conn(0x7fc6d81015b0 msgr2=0x7fc6d8103a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:21:06.139 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:06.137+0000 7fc6e0000640 1 -- 172.21.15.50:0/365186551 shutdown_connections 2024-08-31T04:21:06.139 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:06.137+0000 7fc6e0000640 1 -- 172.21.15.50:0/365186551 wait complete. 2024-08-31T04:21:06.139 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:06.138+0000 7fc6e0000640 1 Processor -- start 2024-08-31T04:21:06.139 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:06.138+0000 7fc6e0000640 1 -- start start 2024-08-31T04:21:06.140 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:06.138+0000 7fc6e0000640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc6d8105b20 0x7fc6d819c490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:21:06.140 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:06.138+0000 7fc6e0000640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc6d810b460 0x7fc6d819ca30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:21:06.141 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:06.138+0000 7fc6e0000640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc6d810bdb0 0x7fc6d81a1cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:21:06.141 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:06.139+0000 7fc6e0000640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fc6d8115ac0 con 0x7fc6d810bdb0 2024-08-31T04:21:06.141 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:06.139+0000 7fc6e0000640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7fc6d8115940 con 0x7fc6d810b460 2024-08-31T04:21:06.141 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:06.139+0000 7fc6e0000640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fc6d8115c40 con 0x7fc6d8105b20 2024-08-31T04:21:06.141 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:06.139+0000 7fc6dd600640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc6d8105b20 0x7fc6d819c490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:21:06.141 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:06.139+0000 7fc6dcc00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc6d810b460 0x7fc6d819ca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:21:06.141 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:06.139+0000 7fc6de000640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc6d810bdb0 0x7fc6d81a1cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:21:06.141 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:06.139+0000 7fc6dd600640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc6d8105b20 0x7fc6d819c490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.50:33462/0 (socket says 172.21.15.50:33462) 2024-08-31T04:21:06.141 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:06.139+0000 7fc6dcc00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc6d810b460 0x7fc6d819ca30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.50:48626/0 (socket says 172.21.15.50:48626) 2024-08-31T04:21:06.141 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:06.139+0000 7fc6dd600640 1 -- 172.21.15.50:0/39593790 learned_addr learned my addr 172.21.15.50:0/39593790 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:21:06.141 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:06.139+0000 7fc6dd600640 1 -- 172.21.15.50:0/39593790 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc6d810b460 msgr2=0x7fc6d819ca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:21:06.141 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:06.139+0000 7fc6dd600640 1 --2- 172.21.15.50:0/39593790 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc6d810b460 0x7fc6d819ca30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:06.141 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:06.139+0000 7fc6dd600640 1 -- 172.21.15.50:0/39593790 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc6d810bdb0 msgr2=0x7fc6d81a1cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:21:06.142 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:06.139+0000 7fc6dd600640 1 --2- 172.21.15.50:0/39593790 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc6d810bdb0 0x7fc6d81a1cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:06.142 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:06.139+0000 7fc6dd600640 1 -- 172.21.15.50:0/39593790 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6d81a2400 con 0x7fc6d8105b20 2024-08-31T04:21:06.142 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:06.140+0000 7fc6dd600640 1 --2- 172.21.15.50:0/39593790 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc6d8105b20 0x7fc6d819c490 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fc6cc00e9f0 tx=0x7fc6cc00edf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:21:06.142 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:06.140+0000 7fc6d6000640 1 -- 172.21.15.50:0/39593790 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6cc00cd80 con 0x7fc6d8105b20 2024-08-31T04:21:06.143 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:06.140+0000 7fc6e0000640 1 -- 172.21.15.50:0/39593790 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc6d81a26f0 con 0x7fc6d8105b20 2024-08-31T04:21:06.143 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:06.140+0000 7fc6d6000640 1 -- 172.21.15.50:0/39593790 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc6cc0054d0 con 0x7fc6d8105b20 2024-08-31T04:21:06.143 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:06.140+0000 7fc6d6000640 1 -- 172.21.15.50:0/39593790 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6cc010690 con 0x7fc6d8105b20 2024-08-31T04:21:06.143 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:06.140+0000 7fc6e0000640 1 -- 172.21.15.50:0/39593790 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc6d81a8e50 con 0x7fc6d8105b20 2024-08-31T04:21:06.143 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:06.141+0000 7fc6e0000640 1 -- 172.21.15.50:0/39593790 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc6d8105f30 con 0x7fc6d8105b20 2024-08-31T04:21:06.145 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:06.143+0000 7fc6d6000640 1 -- 172.21.15.50:0/39593790 <== mon.1 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 17) ==== 152628+0+0 (secure 0 0 0) 0x7fc6cc004e90 con 0x7fc6d8105b20 2024-08-31T04:21:06.148 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:06.145+0000 7fc6d6000640 1 --2- 172.21.15.50:0/39593790 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fc6c00b4bc0 0x7fc6c00b70d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:21:06.148 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:06.146+0000 7fc6d6000640 1 -- 172.21.15.50:0/39593790 <== mon.1 v2:172.21.15.177:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8219+0+0 (secure 0 0 0) 0x7fc6cc0e56a0 con 0x7fc6d8105b20 2024-08-31T04:21:06.148 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:06.146+0000 7fc6dcc00640 1 --2- 172.21.15.50:0/39593790 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fc6c00b4bc0 0x7fc6c00b70d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:21:06.148 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:06.147+0000 7fc6d6000640 1 -- 172.21.15.50:0/39593790 <== mon.1 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fc6cc0ac620 con 0x7fc6d8105b20 2024-08-31T04:21:06.148 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:06.147+0000 7fc6dcc00640 1 --2- 172.21.15.50:0/39593790 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fc6c00b4bc0 0x7fc6c00b70d0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fc6c402aa00 tx=0x7fc6c4005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:21:06.372 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:06.371+0000 7fc6e0000640 1 -- 172.21.15.50:0/39593790 --> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}) -- 0x7fc6d80635a0 con 0x7fc6c00b4bc0 2024-08-31T04:21:06.378 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:06.376+0000 7fc6d6000640 1 -- 172.21.15.50:0/39593790 <== mgr.14150 v2:172.21.15.50:6800/2146686622 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+54 (secure 0 0 0) 0x7fc6d80635a0 con 0x7fc6c00b4bc0 2024-08-31T04:21:06.378 INFO:teuthology.orchestra.run.smithi050.stdout:/volumes/qa/sv_0/43e4cd7d-95d7-4411-aef0-7c8a933ca351 2024-08-31T04:21:06.381 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:06.379+0000 7fc6e0000640 1 -- 172.21.15.50:0/39593790 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fc6c00b4bc0 msgr2=0x7fc6c00b70d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:21:06.381 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:06.379+0000 7fc6e0000640 1 --2- 172.21.15.50:0/39593790 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fc6c00b4bc0 0x7fc6c00b70d0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fc6c402aa00 tx=0x7fc6c4005a20 comp rx=0 tx=0).stop 2024-08-31T04:21:06.381 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:06.379+0000 7fc6e0000640 1 -- 172.21.15.50:0/39593790 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc6d8105b20 msgr2=0x7fc6d819c490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:21:06.381 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:06.379+0000 7fc6e0000640 1 --2- 172.21.15.50:0/39593790 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc6d8105b20 0x7fc6d819c490 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fc6cc00e9f0 tx=0x7fc6cc00edf0 comp rx=0 tx=0).stop 2024-08-31T04:21:06.381 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:06.379+0000 7fc6e0000640 1 -- 172.21.15.50:0/39593790 shutdown_connections 2024-08-31T04:21:06.381 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:06.379+0000 7fc6e0000640 1 --2- 172.21.15.50:0/39593790 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fc6c00b4bc0 0x7fc6c00b70d0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:06.381 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:06.379+0000 7fc6e0000640 1 --2- 172.21.15.50:0/39593790 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc6d810bdb0 0x7fc6d81a1cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:06.381 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:06.379+0000 7fc6e0000640 1 --2- 172.21.15.50:0/39593790 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc6d810b460 0x7fc6d819ca30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:06.381 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:06.379+0000 7fc6e0000640 1 --2- 172.21.15.50:0/39593790 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc6d8105b20 0x7fc6d819c490 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:06.381 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:06.379+0000 7fc6e0000640 1 -- 172.21.15.50:0/39593790 >> 172.21.15.50:0/39593790 conn(0x7fc6d81015b0 msgr2=0x7fc6d81039d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:21:06.381 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:06.379+0000 7fc6e0000640 1 -- 172.21.15.50:0/39593790 shutdown_connections 2024-08-31T04:21:06.381 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:06.380+0000 7fc6e0000640 1 -- 172.21.15.50:0/39593790 wait complete. 2024-08-31T04:21:07.222 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 058d9fc6-674f-11ef-bcd4-c7b262605968 -- ceph fs subvolume create cephfs sv_1 --group_name qa 2024-08-31T04:21:07.450 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:21:07 smithi050 ceph-mon[17259]: pgmap v313: 97 pgs: 97 active+clean; 585 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 3.1 KiB/s wr, 16 op/s; 63 B/s, 1 keys/s, 0 objects/s recovering 2024-08-31T04:21:07.450 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:21:07 smithi050 ceph-mon[17259]: from='client.24790 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:21:07.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:21:07 smithi177 ceph-mon[22025]: pgmap v313: 97 pgs: 97 active+clean; 585 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 3.1 KiB/s wr, 16 op/s; 63 B/s, 1 keys/s, 0 objects/s recovering 2024-08-31T04:21:07.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:21:07 smithi177 ceph-mon[22025]: from='client.24790 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:21:07.542 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:21:07 smithi133 ceph-mon[22177]: pgmap v313: 97 pgs: 97 active+clean; 585 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 3.1 KiB/s wr, 16 op/s; 63 B/s, 1 keys/s, 0 objects/s recovering 2024-08-31T04:21:07.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:21:07 smithi133 ceph-mon[22177]: from='client.24790 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:21:07.598 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:21:08.198 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:08.196+0000 7fd7ed200640 1 -- 172.21.15.50:0/2478959283 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd7e810b460 msgr2=0x7fd7e810b870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:21:08.198 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:08.196+0000 7fd7ed200640 1 --2- 172.21.15.50:0/2478959283 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd7e810b460 0x7fd7e810b870 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fd7d0009900 tx=0x7fd7d002a410 comp rx=0 tx=0).stop 2024-08-31T04:21:08.198 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:08.196+0000 7fd7ed200640 1 -- 172.21.15.50:0/2478959283 shutdown_connections 2024-08-31T04:21:08.198 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:08.196+0000 7fd7ed200640 1 --2- 172.21.15.50:0/2478959283 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd7e810bdb0 0x7fd7e81125e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:08.198 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:08.196+0000 7fd7ed200640 1 --2- 172.21.15.50:0/2478959283 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd7e810b460 0x7fd7e810b870 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:08.198 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:08.196+0000 7fd7ed200640 1 --2- 172.21.15.50:0/2478959283 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd7e8105b20 0x7fd7e8105f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:08.198 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:08.196+0000 7fd7ed200640 1 -- 172.21.15.50:0/2478959283 >> 172.21.15.50:0/2478959283 conn(0x7fd7e81015b0 msgr2=0x7fd7e8103a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:21:08.198 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:08.196+0000 7fd7ed200640 1 -- 172.21.15.50:0/2478959283 shutdown_connections 2024-08-31T04:21:08.198 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:08.196+0000 7fd7ed200640 1 -- 172.21.15.50:0/2478959283 wait complete. 2024-08-31T04:21:08.199 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:08.197+0000 7fd7ed200640 1 Processor -- start 2024-08-31T04:21:08.199 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:08.197+0000 7fd7ed200640 1 -- start start 2024-08-31T04:21:08.199 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:08.198+0000 7fd7ed200640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd7e8105b20 0x7fd7e819c440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:21:08.199 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:08.198+0000 7fd7ed200640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd7e810b460 0x7fd7e819c9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:21:08.199 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:08.198+0000 7fd7ed200640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd7e810bdb0 0x7fd7e81a1c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:21:08.200 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:08.198+0000 7fd7ed200640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fd7e8115a70 con 0x7fd7e810bdb0 2024-08-31T04:21:08.200 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:08.198+0000 7fd7ed200640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7fd7e81158f0 con 0x7fd7e810b460 2024-08-31T04:21:08.200 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:08.198+0000 7fd7ed200640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fd7e8115bf0 con 0x7fd7e8105b20 2024-08-31T04:21:08.200 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:08.198+0000 7fd7e5e00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd7e8105b20 0x7fd7e819c440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:21:08.200 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:08.198+0000 7fd7e6800640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd7e810bdb0 0x7fd7e81a1c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:21:08.200 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:08.198+0000 7fd7dfe00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd7e810b460 0x7fd7e819c9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:21:08.200 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:08.198+0000 7fd7e5e00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd7e8105b20 0x7fd7e819c440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.50:33466/0 (socket says 172.21.15.50:33466) 2024-08-31T04:21:08.200 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:08.198+0000 7fd7e5e00640 1 -- 172.21.15.50:0/870812613 learned_addr learned my addr 172.21.15.50:0/870812613 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:21:08.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:08.198+0000 7fd7e6800640 1 -- 172.21.15.50:0/870812613 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd7e8105b20 msgr2=0x7fd7e819c440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:21:08.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:08.198+0000 7fd7e6800640 1 --2- 172.21.15.50:0/870812613 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd7e8105b20 0x7fd7e819c440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:08.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:08.198+0000 7fd7e6800640 1 -- 172.21.15.50:0/870812613 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd7e810b460 msgr2=0x7fd7e819c9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:21:08.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:08.198+0000 7fd7e6800640 1 --2- 172.21.15.50:0/870812613 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd7e810b460 0x7fd7e819c9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:08.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:08.198+0000 7fd7e6800640 1 -- 172.21.15.50:0/870812613 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7e81a23b0 con 0x7fd7e810bdb0 2024-08-31T04:21:08.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:08.198+0000 7fd7e5e00640 1 --2- 172.21.15.50:0/870812613 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd7e8105b20 0x7fd7e819c440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:21:08.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:08.199+0000 7fd7e6800640 1 --2- 172.21.15.50:0/870812613 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd7e810bdb0 0x7fd7e81a1c80 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fd7e0009fd0 tx=0x7fd7e000ef10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:21:08.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:08.199+0000 7fd7dea00640 1 -- 172.21.15.50:0/870812613 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7e000ce20 con 0x7fd7e810bdb0 2024-08-31T04:21:08.202 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:08.199+0000 7fd7dea00640 1 -- 172.21.15.50:0/870812613 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd7e0005020 con 0x7fd7e810bdb0 2024-08-31T04:21:08.202 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:08.199+0000 7fd7ed200640 1 -- 172.21.15.50:0/870812613 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd7e81a26a0 con 0x7fd7e810bdb0 2024-08-31T04:21:08.202 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:08.199+0000 7fd7dea00640 1 -- 172.21.15.50:0/870812613 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7e0010690 con 0x7fd7e810bdb0 2024-08-31T04:21:08.202 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:08.199+0000 7fd7ed200640 1 -- 172.21.15.50:0/870812613 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd7e81a8e00 con 0x7fd7e810bdb0 2024-08-31T04:21:08.202 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:08.200+0000 7fd7ed200640 1 -- 172.21.15.50:0/870812613 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd7e8105f30 con 0x7fd7e810bdb0 2024-08-31T04:21:08.204 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:08.203+0000 7fd7dea00640 1 -- 172.21.15.50:0/870812613 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 17) ==== 152628+0+0 (secure 0 0 0) 0x7fd7e00054d0 con 0x7fd7e810bdb0 2024-08-31T04:21:08.205 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:08.204+0000 7fd7dea00640 1 --2- 172.21.15.50:0/870812613 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fd7cc0b4bc0 0x7fd7cc0b70d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:21:08.205 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:08.204+0000 7fd7dea00640 1 -- 172.21.15.50:0/870812613 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8219+0+0 (secure 0 0 0) 0x7fd7e00e59e0 con 0x7fd7e810bdb0 2024-08-31T04:21:08.206 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:08.204+0000 7fd7e5e00640 1 --2- 172.21.15.50:0/870812613 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fd7cc0b4bc0 0x7fd7cc0b70d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:21:08.206 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:08.205+0000 7fd7e5e00640 1 --2- 172.21.15.50:0/870812613 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fd7cc0b4bc0 0x7fd7cc0b70d0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fd7d8011550 tx=0x7fd7d8005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:21:08.209 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:08.208+0000 7fd7dea00640 1 -- 172.21.15.50:0/870812613 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fd7e00ac960 con 0x7fd7e810bdb0 2024-08-31T04:21:08.431 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:08.429+0000 7fd7ed200640 1 -- 172.21.15.50:0/870812613 --> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7fd7e80635a0 con 0x7fd7cc0b4bc0 2024-08-31T04:21:08.460 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:08.459+0000 7fd7dea00640 1 -- 172.21.15.50:0/870812613 <== mgr.14150 v2:172.21.15.50:6800/2146686622 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fd7e80635a0 con 0x7fd7cc0b4bc0 2024-08-31T04:21:08.462 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:08.461+0000 7fd7ed200640 1 -- 172.21.15.50:0/870812613 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fd7cc0b4bc0 msgr2=0x7fd7cc0b70d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:21:08.462 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:08.461+0000 7fd7ed200640 1 --2- 172.21.15.50:0/870812613 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fd7cc0b4bc0 0x7fd7cc0b70d0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fd7d8011550 tx=0x7fd7d8005f90 comp rx=0 tx=0).stop 2024-08-31T04:21:08.462 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:08.461+0000 7fd7ed200640 1 -- 172.21.15.50:0/870812613 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd7e810bdb0 msgr2=0x7fd7e81a1c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:21:08.463 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:08.461+0000 7fd7ed200640 1 --2- 172.21.15.50:0/870812613 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd7e810bdb0 0x7fd7e81a1c80 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fd7e0009fd0 tx=0x7fd7e000ef10 comp rx=0 tx=0).stop 2024-08-31T04:21:08.463 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:08.461+0000 7fd7ed200640 1 -- 172.21.15.50:0/870812613 shutdown_connections 2024-08-31T04:21:08.463 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:08.461+0000 7fd7ed200640 1 --2- 172.21.15.50:0/870812613 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fd7cc0b4bc0 0x7fd7cc0b70d0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:08.463 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:08.461+0000 7fd7ed200640 1 --2- 172.21.15.50:0/870812613 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd7e810bdb0 0x7fd7e81a1c80 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:08.463 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:08.461+0000 7fd7ed200640 1 --2- 172.21.15.50:0/870812613 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd7e810b460 0x7fd7e819c9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:08.463 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:08.461+0000 7fd7ed200640 1 --2- 172.21.15.50:0/870812613 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd7e8105b20 0x7fd7e819c440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:08.463 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:08.461+0000 7fd7ed200640 1 -- 172.21.15.50:0/870812613 >> 172.21.15.50:0/870812613 conn(0x7fd7e81015b0 msgr2=0x7fd7e81039d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:21:08.463 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:08.461+0000 7fd7ed200640 1 -- 172.21.15.50:0/870812613 shutdown_connections 2024-08-31T04:21:08.463 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:08.461+0000 7fd7ed200640 1 -- 172.21.15.50:0/870812613 wait complete. 2024-08-31T04:21:09.198 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 058d9fc6-674f-11ef-bcd4-c7b262605968 -- ceph fs subvolume getpath cephfs --group_name qa sv_1 2024-08-31T04:21:09.450 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:21:09 smithi050 ceph-mon[17259]: pgmap v314: 97 pgs: 97 active+clean; 610 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 5.2 KiB/s wr, 16 op/s; 57 B/s, 0 keys/s, 0 objects/s recovering 2024-08-31T04:21:09.450 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:21:09 smithi050 ceph-mon[17259]: from='client.14793 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:21:09.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:21:09 smithi177 ceph-mon[22025]: pgmap v314: 97 pgs: 97 active+clean; 610 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 5.2 KiB/s wr, 16 op/s; 57 B/s, 0 keys/s, 0 objects/s recovering 2024-08-31T04:21:09.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:21:09 smithi177 ceph-mon[22025]: from='client.14793 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:21:09.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:21:09 smithi133 ceph-mon[22177]: pgmap v314: 97 pgs: 97 active+clean; 610 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 5.2 KiB/s wr, 16 op/s; 57 B/s, 0 keys/s, 0 objects/s recovering 2024-08-31T04:21:09.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:21:09 smithi133 ceph-mon[22177]: from='client.14793 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:21:09.576 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:21:10.174 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:10.172+0000 7f6ad7600640 1 -- 172.21.15.50:0/3142080268 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6ad0105b20 msgr2=0x7f6ad0105f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:21:10.174 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:10.172+0000 7f6ad7600640 1 --2- 172.21.15.50:0/3142080268 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6ad0105b20 0x7f6ad0105f30 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f6ac4009900 tx=0x7f6ac402a410 comp rx=0 tx=0).stop 2024-08-31T04:21:10.174 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:10.172+0000 7f6ad7600640 1 -- 172.21.15.50:0/3142080268 shutdown_connections 2024-08-31T04:21:10.174 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:10.172+0000 7f6ad7600640 1 --2- 172.21.15.50:0/3142080268 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6ad010bdb0 0x7f6ad01125e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:10.174 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:10.172+0000 7f6ad7600640 1 --2- 172.21.15.50:0/3142080268 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6ad010b460 0x7f6ad010b870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:10.174 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:10.172+0000 7f6ad7600640 1 --2- 172.21.15.50:0/3142080268 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6ad0105b20 0x7f6ad0105f30 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:10.174 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:10.172+0000 7f6ad7600640 1 -- 172.21.15.50:0/3142080268 >> 172.21.15.50:0/3142080268 conn(0x7f6ad01015b0 msgr2=0x7f6ad0103a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:21:10.175 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:10.173+0000 7f6ad7600640 1 -- 172.21.15.50:0/3142080268 shutdown_connections 2024-08-31T04:21:10.175 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:10.173+0000 7f6ad7600640 1 -- 172.21.15.50:0/3142080268 wait complete. 2024-08-31T04:21:10.176 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:10.174+0000 7f6ad7600640 1 Processor -- start 2024-08-31T04:21:10.176 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:10.174+0000 7f6ad7600640 1 -- start start 2024-08-31T04:21:10.176 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:10.174+0000 7f6ad7600640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6ad0105b20 0x7f6ad019c460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:21:10.176 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:10.174+0000 7f6ad7600640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6ad010b460 0x7f6ad019ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:21:10.176 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:10.174+0000 7f6ad7600640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6ad010bdb0 0x7f6ad01a1ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:21:10.176 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:10.174+0000 7f6ad7600640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f6ad0115a70 con 0x7f6ad010bdb0 2024-08-31T04:21:10.176 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:10.174+0000 7f6ad7600640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f6ad01158f0 con 0x7f6ad0105b20 2024-08-31T04:21:10.176 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:10.174+0000 7f6ad7600640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f6ad0115bf0 con 0x7f6ad010b460 2024-08-31T04:21:10.176 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:10.174+0000 7f6ad5600640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6ad010bdb0 0x7f6ad01a1ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:21:10.176 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:10.175+0000 7f6ad5600640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6ad010bdb0 0x7f6ad01a1ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:58576/0 (socket says 172.21.15.50:58576) 2024-08-31T04:21:10.177 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:10.175+0000 7f6ad5600640 1 -- 172.21.15.50:0/1522014289 learned_addr learned my addr 172.21.15.50:0/1522014289 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:21:10.177 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:10.175+0000 7f6ad4c00640 1 --2- 172.21.15.50:0/1522014289 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6ad0105b20 0x7f6ad019c460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:21:10.177 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:10.175+0000 7f6acfe00640 1 --2- 172.21.15.50:0/1522014289 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6ad010b460 0x7f6ad019ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:21:10.177 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:10.175+0000 7f6ad5600640 1 -- 172.21.15.50:0/1522014289 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6ad010b460 msgr2=0x7f6ad019ca00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:21:10.177 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:10.175+0000 7f6ad5600640 1 --2- 172.21.15.50:0/1522014289 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6ad010b460 0x7f6ad019ca00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:10.178 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:10.175+0000 7f6ad5600640 1 -- 172.21.15.50:0/1522014289 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6ad0105b20 msgr2=0x7f6ad019c460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:21:10.178 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:10.175+0000 7f6ad5600640 1 --2- 172.21.15.50:0/1522014289 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6ad0105b20 0x7f6ad019c460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:10.178 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:10.175+0000 7f6ad5600640 1 -- 172.21.15.50:0/1522014289 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ad01a23d0 con 0x7f6ad010bdb0 2024-08-31T04:21:10.178 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:10.175+0000 7f6ad5600640 1 --2- 172.21.15.50:0/1522014289 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6ad010bdb0 0x7f6ad01a1ca0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f6ac800eb10 tx=0x7f6ac800c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:21:10.178 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:10.176+0000 7f6acd600640 1 -- 172.21.15.50:0/1522014289 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ac8004b20 con 0x7f6ad010bdb0 2024-08-31T04:21:10.178 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:10.176+0000 7f6acd600640 1 -- 172.21.15.50:0/1522014289 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6ac8004cc0 con 0x7f6ad010bdb0 2024-08-31T04:21:10.178 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:10.176+0000 7f6ad7600640 1 -- 172.21.15.50:0/1522014289 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ad01a26c0 con 0x7f6ad010bdb0 2024-08-31T04:21:10.178 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:10.176+0000 7f6acd600640 1 -- 172.21.15.50:0/1522014289 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ac8010670 con 0x7f6ad010bdb0 2024-08-31T04:21:10.178 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:10.176+0000 7f6ad7600640 1 -- 172.21.15.50:0/1522014289 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ad01a8e20 con 0x7f6ad010bdb0 2024-08-31T04:21:10.178 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:10.177+0000 7f6ad7600640 1 -- 172.21.15.50:0/1522014289 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6ad0105f30 con 0x7f6ad010bdb0 2024-08-31T04:21:10.180 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:10.179+0000 7f6acd600640 1 -- 172.21.15.50:0/1522014289 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 17) ==== 152628+0+0 (secure 0 0 0) 0x7f6ac8005020 con 0x7f6ad010bdb0 2024-08-31T04:21:10.182 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:10.181+0000 7f6acd600640 1 --2- 172.21.15.50:0/1522014289 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f6ab80b4c40 0x7f6ab80b7150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:21:10.182 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:10.181+0000 7f6acd600640 1 -- 172.21.15.50:0/1522014289 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8219+0+0 (secure 0 0 0) 0x7f6ac80e5790 con 0x7f6ad010bdb0 2024-08-31T04:21:10.182 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:10.181+0000 7f6ad4c00640 1 --2- 172.21.15.50:0/1522014289 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f6ab80b4c40 0x7f6ab80b7150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:21:10.183 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:10.182+0000 7f6ad4c00640 1 --2- 172.21.15.50:0/1522014289 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f6ab80b4c40 0x7f6ab80b7150 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f6ac4031440 tx=0x7f6ac4009560 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:21:10.186 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:10.185+0000 7f6acd600640 1 -- 172.21.15.50:0/1522014289 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f6ac80ac770 con 0x7f6ad010bdb0 2024-08-31T04:21:10.413 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:10.411+0000 7f6ad7600640 1 -- 172.21.15.50:0/1522014289 --> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}) -- 0x7f6ad00635a0 con 0x7f6ab80b4c40 2024-08-31T04:21:10.420 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:10.418+0000 7f6acd600640 1 -- 172.21.15.50:0/1522014289 <== mgr.14150 v2:172.21.15.50:6800/2146686622 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+54 (secure 0 0 0) 0x7f6ad00635a0 con 0x7f6ab80b4c40 2024-08-31T04:21:10.420 INFO:teuthology.orchestra.run.smithi050.stdout:/volumes/qa/sv_1/06353fe4-86e8-435f-8a14-3aba2ce8268c 2024-08-31T04:21:10.422 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:10.420+0000 7f6ad7600640 1 -- 172.21.15.50:0/1522014289 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f6ab80b4c40 msgr2=0x7f6ab80b7150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:21:10.422 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:10.420+0000 7f6ad7600640 1 --2- 172.21.15.50:0/1522014289 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f6ab80b4c40 0x7f6ab80b7150 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f6ac4031440 tx=0x7f6ac4009560 comp rx=0 tx=0).stop 2024-08-31T04:21:10.422 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:10.420+0000 7f6ad7600640 1 -- 172.21.15.50:0/1522014289 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6ad010bdb0 msgr2=0x7f6ad01a1ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:21:10.423 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:10.420+0000 7f6ad7600640 1 --2- 172.21.15.50:0/1522014289 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6ad010bdb0 0x7f6ad01a1ca0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f6ac800eb10 tx=0x7f6ac800c2d0 comp rx=0 tx=0).stop 2024-08-31T04:21:10.423 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:10.421+0000 7f6ad7600640 1 -- 172.21.15.50:0/1522014289 shutdown_connections 2024-08-31T04:21:10.423 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:10.421+0000 7f6ad7600640 1 --2- 172.21.15.50:0/1522014289 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f6ab80b4c40 0x7f6ab80b7150 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:10.423 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:10.421+0000 7f6ad7600640 1 --2- 172.21.15.50:0/1522014289 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6ad010b460 0x7f6ad019ca00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:10.423 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:10.421+0000 7f6ad7600640 1 --2- 172.21.15.50:0/1522014289 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6ad010bdb0 0x7f6ad01a1ca0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:10.423 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:10.421+0000 7f6ad7600640 1 --2- 172.21.15.50:0/1522014289 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6ad0105b20 0x7f6ad019c460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:10.423 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:10.421+0000 7f6ad7600640 1 -- 172.21.15.50:0/1522014289 >> 172.21.15.50:0/1522014289 conn(0x7f6ad01015b0 msgr2=0x7f6ad01039d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:21:10.423 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:10.421+0000 7f6ad7600640 1 -- 172.21.15.50:0/1522014289 shutdown_connections 2024-08-31T04:21:10.423 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:10.421+0000 7f6ad7600640 1 -- 172.21.15.50:0/1522014289 wait complete. 2024-08-31T04:21:11.232 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 058d9fc6-674f-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-31T04:21:11.450 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:21:11 smithi050 ceph-mon[17259]: pgmap v315: 97 pgs: 97 active+clean; 610 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 4.7 KiB/s wr, 15 op/s; 51 B/s, 0 keys/s, 0 objects/s recovering 2024-08-31T04:21:11.450 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:21:11 smithi050 ceph-mon[17259]: from='client.14799 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:21:11.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:21:11 smithi177 ceph-mon[22025]: pgmap v315: 97 pgs: 97 active+clean; 610 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 4.7 KiB/s wr, 15 op/s; 51 B/s, 0 keys/s, 0 objects/s recovering 2024-08-31T04:21:11.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:21:11 smithi177 ceph-mon[22025]: from='client.14799 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:21:11.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:21:11 smithi133 ceph-mon[22177]: pgmap v315: 97 pgs: 97 active+clean; 610 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 4.7 KiB/s wr, 15 op/s; 51 B/s, 0 keys/s, 0 objects/s recovering 2024-08-31T04:21:11.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:21:11 smithi133 ceph-mon[22177]: from='client.14799 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:21:11.611 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:21:12.222 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:12.219+0000 7f8785a00640 1 -- 172.21.15.50:0/1020532036 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f878010b460 msgr2=0x7f878010b870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:21:12.222 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:12.219+0000 7f8785a00640 1 --2- 172.21.15.50:0/1020532036 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f878010b460 0x7f878010b870 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f8768009900 tx=0x7f876802a410 comp rx=0 tx=0).stop 2024-08-31T04:21:12.222 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:12.219+0000 7f8785a00640 1 -- 172.21.15.50:0/1020532036 shutdown_connections 2024-08-31T04:21:12.222 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:12.219+0000 7f8785a00640 1 --2- 172.21.15.50:0/1020532036 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f878010bdb0 0x7f87801125e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:12.222 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:12.219+0000 7f8785a00640 1 --2- 172.21.15.50:0/1020532036 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f878010b460 0x7f878010b870 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:12.222 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:12.219+0000 7f8785a00640 1 --2- 172.21.15.50:0/1020532036 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8780105b20 0x7f8780105f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:12.222 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:12.219+0000 7f8785a00640 1 -- 172.21.15.50:0/1020532036 >> 172.21.15.50:0/1020532036 conn(0x7f87801015b0 msgr2=0x7f8780103a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:21:12.222 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:12.219+0000 7f8785a00640 1 -- 172.21.15.50:0/1020532036 shutdown_connections 2024-08-31T04:21:12.222 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:12.219+0000 7f8785a00640 1 -- 172.21.15.50:0/1020532036 wait complete. 2024-08-31T04:21:12.224 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:12.220+0000 7f8785a00640 1 Processor -- start 2024-08-31T04:21:12.224 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:12.220+0000 7f8785a00640 1 -- start start 2024-08-31T04:21:12.224 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:12.221+0000 7f8785a00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8780105b20 0x7f878019c490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:21:12.224 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:12.221+0000 7f8785a00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f878010b460 0x7f878019ca30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:21:12.224 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:12.221+0000 7f8785a00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f878010bdb0 0x7f87801a1cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:21:12.224 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:12.221+0000 7f8785a00640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f8780115ac0 con 0x7f878010bdb0 2024-08-31T04:21:12.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:12.221+0000 7f8785a00640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f8780115940 con 0x7f878010b460 2024-08-31T04:21:12.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:12.221+0000 7f8785a00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f8780115c40 con 0x7f8780105b20 2024-08-31T04:21:12.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:12.221+0000 7f877f400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f878010bdb0 0x7f87801a1cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:21:12.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:12.221+0000 7f877ea00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8780105b20 0x7f878019c490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:21:12.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:12.221+0000 7f877f400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f878010bdb0 0x7f87801a1cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:58604/0 (socket says 172.21.15.50:58604) 2024-08-31T04:21:12.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:12.221+0000 7f877ea00640 1 --2- 172.21.15.50:0/202092466 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8780105b20 0x7f878019c490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.50:33494/0 (socket says 172.21.15.50:33494) 2024-08-31T04:21:12.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:12.221+0000 7f877f400640 1 -- 172.21.15.50:0/202092466 learned_addr learned my addr 172.21.15.50:0/202092466 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:21:12.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:12.221+0000 7f8777e00640 1 --2- 172.21.15.50:0/202092466 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f878010b460 0x7f878019ca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:21:12.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:12.222+0000 7f877ea00640 1 -- 172.21.15.50:0/202092466 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f878010b460 msgr2=0x7f878019ca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:21:12.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:12.222+0000 7f877ea00640 1 --2- 172.21.15.50:0/202092466 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f878010b460 0x7f878019ca30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:12.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:12.222+0000 7f877ea00640 1 -- 172.21.15.50:0/202092466 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f878010bdb0 msgr2=0x7f87801a1cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:21:12.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:12.222+0000 7f877ea00640 1 --2- 172.21.15.50:0/202092466 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f878010bdb0 0x7f87801a1cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:12.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:12.222+0000 7f877ea00640 1 -- 172.21.15.50:0/202092466 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87801a2400 con 0x7f8780105b20 2024-08-31T04:21:12.226 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:12.222+0000 7f877ea00640 1 --2- 172.21.15.50:0/202092466 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8780105b20 0x7f878019c490 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f877000e9f0 tx=0x7f877000eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:21:12.226 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:12.222+0000 7f8777400640 1 -- 172.21.15.50:0/202092466 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f877000ccc0 con 0x7f8780105b20 2024-08-31T04:21:12.226 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:12.222+0000 7f8785a00640 1 -- 172.21.15.50:0/202092466 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f87801a26f0 con 0x7f8780105b20 2024-08-31T04:21:12.226 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:12.222+0000 7f8777400640 1 -- 172.21.15.50:0/202092466 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8770005020 con 0x7f8780105b20 2024-08-31T04:21:12.226 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:12.222+0000 7f8777400640 1 -- 172.21.15.50:0/202092466 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8770004a00 con 0x7f8780105b20 2024-08-31T04:21:12.226 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:12.223+0000 7f8785a00640 1 -- 172.21.15.50:0/202092466 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f87801a8e50 con 0x7f8780105b20 2024-08-31T04:21:12.227 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:12.224+0000 7f8785a00640 1 -- 172.21.15.50:0/202092466 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8780105f30 con 0x7f8780105b20 2024-08-31T04:21:12.228 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:12.226+0000 7f8777400640 1 -- 172.21.15.50:0/202092466 <== mon.1 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 17) ==== 152628+0+0 (secure 0 0 0) 0x7f8770004ba0 con 0x7f8780105b20 2024-08-31T04:21:12.230 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:12.227+0000 7f8777400640 1 --2- 172.21.15.50:0/202092466 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f87640b4bc0 0x7f87640b70d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:21:12.230 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:12.227+0000 7f8777400640 1 -- 172.21.15.50:0/202092466 <== mon.1 v2:172.21.15.177:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8219+0+0 (secure 0 0 0) 0x7f87700e5310 con 0x7f8780105b20 2024-08-31T04:21:12.230 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:12.228+0000 7f8777e00640 1 --2- 172.21.15.50:0/202092466 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f87640b4bc0 0x7f87640b70d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:21:12.230 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:12.228+0000 7f8777e00640 1 --2- 172.21.15.50:0/202092466 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f87640b4bc0 0x7f87640b70d0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f876802aa00 tx=0x7f8768005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:21:12.231 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:12.229+0000 7f8777400640 1 -- 172.21.15.50:0/202092466 <== mon.1 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f87700ac320 con 0x7f8780105b20 2024-08-31T04:21:12.470 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:12.468+0000 7f8785a00640 1 -- 172.21.15.50:0/202092466 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f878019d5c0 con 0x7f8780105b20 2024-08-31T04:21:12.471 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:12.469+0000 7f8777400640 1 -- 172.21.15.50:0/202092466 <== mon.1 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11983 (secure 0 0 0) 0x7f87700abc20 con 0x7f8780105b20 2024-08-31T04:21:12.472 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-08-31T04:21:12.472 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":28,"btime":"2024-08-31T04:21:02:045794+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14622,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/1565557530","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":1565557530},{"type":"v1","addr":"172.21.15.50:6835","nonce":1565557530}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14634,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6837/2660185946","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6836","nonce":2660185946},{"type":"v1","addr":"172.21.15.50:6837","nonce":2660185946}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-31T04:20:44.140709+0000","modified":"2024-08-31T04:21:02.045763+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24695,"mds_1":24691,"mds_2":24667,"mds_3":24656,"mds_4":24652},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14676":{"gid":14676,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.50:6839/2105228685","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6838","nonce":2105228685},{"type":"v1","addr":"172.21.15.50:6839","nonce":2105228685}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24590":{"gid":24590,"name":"k","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.133:6833/4283603962","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6832","nonce":4283603962},{"type":"v1","addr":"172.21.15.133:6833","nonce":4283603962}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24601":{"gid":24601,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.177:6833/1237129793","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":1237129793},{"type":"v1","addr":"172.21.15.177:6833","nonce":1237129793}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24626":{"gid":24626,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.133:6835/3637799701","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":3637799701},{"type":"v1","addr":"172.21.15.133:6835","nonce":3637799701}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24640":{"gid":24640,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.177:6835/599392457","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6834","nonce":599392457},{"type":"v1","addr":"172.21.15.177:6835","nonce":599392457}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24652":{"gid":24652,"name":"c","rank":4,"incarnation":26,"state":"up:active","state_seq":13,"addr":"172.21.15.177:6837/2159859285","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6836","nonce":2159859285},{"type":"v1","addr":"172.21.15.177:6837","nonce":2159859285}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24656":{"gid":24656,"name":"h","rank":3,"incarnation":22,"state":"up:active","state_seq":12,"addr":"172.21.15.133:6837/4014853202","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6836","nonce":4014853202},{"type":"v1","addr":"172.21.15.133:6837","nonce":4014853202}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24667":{"gid":24667,"name":"i","rank":2,"incarnation":20,"state":"up:active","state_seq":10,"addr":"172.21.15.177:6839/3600081752","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6838","nonce":3600081752},{"type":"v1","addr":"172.21.15.177:6839","nonce":3600081752}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24691":{"gid":24691,"name":"a","rank":1,"incarnation":18,"state":"up:active","state_seq":8,"addr":"172.21.15.50:6841/575209862","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6840","nonce":575209862},{"type":"v1","addr":"172.21.15.50:6841","nonce":575209862}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24695":{"gid":24695,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.133:6839/2526402262","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6838","nonce":2526402262},{"type":"v1","addr":"172.21.15.133:6839","nonce":2526402262}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24695,"qdb_cluster":[24667,24695,24656,24691,24652]},"id":1}]} 2024-08-31T04:21:12.472 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 28 2024-08-31T04:21:12.474 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:12.471+0000 7f8785a00640 1 -- 172.21.15.50:0/202092466 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f87640b4bc0 msgr2=0x7f87640b70d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:21:12.474 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:12.471+0000 7f8785a00640 1 --2- 172.21.15.50:0/202092466 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f87640b4bc0 0x7f87640b70d0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f876802aa00 tx=0x7f8768005a20 comp rx=0 tx=0).stop 2024-08-31T04:21:12.474 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:12.471+0000 7f8785a00640 1 -- 172.21.15.50:0/202092466 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8780105b20 msgr2=0x7f878019c490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:21:12.474 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:12.471+0000 7f8785a00640 1 --2- 172.21.15.50:0/202092466 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8780105b20 0x7f878019c490 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f877000e9f0 tx=0x7f877000eeb0 comp rx=0 tx=0).stop 2024-08-31T04:21:12.474 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:12.472+0000 7f8785a00640 1 -- 172.21.15.50:0/202092466 shutdown_connections 2024-08-31T04:21:12.474 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:12.472+0000 7f8785a00640 1 --2- 172.21.15.50:0/202092466 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f87640b4bc0 0x7f87640b70d0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:12.474 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:12.472+0000 7f8785a00640 1 --2- 172.21.15.50:0/202092466 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f878010bdb0 0x7f87801a1cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:12.474 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:12.472+0000 7f8785a00640 1 --2- 172.21.15.50:0/202092466 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f878010b460 0x7f878019ca30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:12.474 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:12.472+0000 7f8785a00640 1 --2- 172.21.15.50:0/202092466 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8780105b20 0x7f878019c490 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:12.475 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:12.472+0000 7f8785a00640 1 -- 172.21.15.50:0/202092466 >> 172.21.15.50:0/202092466 conn(0x7f87801015b0 msgr2=0x7f87801039d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:21:12.475 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:12.472+0000 7f8785a00640 1 -- 172.21.15.50:0/202092466 shutdown_connections 2024-08-31T04:21:12.475 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:12.472+0000 7f8785a00640 1 -- 172.21.15.50:0/202092466 wait complete. 2024-08-31T04:21:13.200 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:21:13 smithi050 ceph-mon[17259]: pgmap v316: 97 pgs: 97 active+clean; 633 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.9 KiB/s wr, 19 op/s; 51 B/s, 0 keys/s, 0 objects/s recovering 2024-08-31T04:21:13.200 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:21:13 smithi050 ceph-mon[17259]: from='client.? 172.21.15.50:0/202092466' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T04:21:13.345 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:21:13 smithi133 ceph-mon[22177]: pgmap v316: 97 pgs: 97 active+clean; 633 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.9 KiB/s wr, 19 op/s; 51 B/s, 0 keys/s, 0 objects/s recovering 2024-08-31T04:21:13.345 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:21:13 smithi133 ceph-mon[22177]: from='client.? 172.21.15.50:0/202092466' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T04:21:13.373 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 058d9fc6-674f-11ef-bcd4-c7b262605968 -- ceph osd dump --format=json 2024-08-31T04:21:13.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:21:13 smithi177 ceph-mon[22025]: pgmap v316: 97 pgs: 97 active+clean; 633 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.9 KiB/s wr, 19 op/s; 51 B/s, 0 keys/s, 0 objects/s recovering 2024-08-31T04:21:13.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:21:13 smithi177 ceph-mon[22025]: from='client.? 172.21.15.50:0/202092466' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T04:21:13.751 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:21:14.353 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:14.350+0000 7f1063e00640 1 -- 172.21.15.50:0/3089514181 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1064103750 msgr2=0x7f1064103b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:21:14.353 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:14.350+0000 7f1063e00640 1 --2- 172.21.15.50:0/3089514181 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1064103750 0x7f1064103b60 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f1054009900 tx=0x7f105402a410 comp rx=0 tx=0).stop 2024-08-31T04:21:14.353 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:14.350+0000 7f1063e00640 1 -- 172.21.15.50:0/3089514181 shutdown_connections 2024-08-31T04:21:14.353 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:14.350+0000 7f1063e00640 1 --2- 172.21.15.50:0/3089514181 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f10641099e0 0x7f1064110210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:14.353 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:14.350+0000 7f1063e00640 1 --2- 172.21.15.50:0/3089514181 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1064109090 0x7f10641094a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:14.353 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:14.350+0000 7f1063e00640 1 --2- 172.21.15.50:0/3089514181 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1064103750 0x7f1064103b60 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:14.353 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:14.350+0000 7f1063e00640 1 -- 172.21.15.50:0/3089514181 >> 172.21.15.50:0/3089514181 conn(0x7f10640ff1e0 msgr2=0x7f1064101630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:21:14.353 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:14.350+0000 7f1063e00640 1 -- 172.21.15.50:0/3089514181 shutdown_connections 2024-08-31T04:21:14.354 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:14.350+0000 7f1063e00640 1 -- 172.21.15.50:0/3089514181 wait complete. 2024-08-31T04:21:14.354 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:14.351+0000 7f1063e00640 1 Processor -- start 2024-08-31T04:21:14.354 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:14.351+0000 7f1063e00640 1 -- start start 2024-08-31T04:21:14.354 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:14.352+0000 7f1063e00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1064103750 0x7f106419c300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:21:14.355 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:14.352+0000 7f1063e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1064109090 0x7f106419c8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:21:14.355 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:14.352+0000 7f1063e00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f10641099e0 0x7f10641a1b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:21:14.355 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:14.352+0000 7f1063e00640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f10641136b0 con 0x7f1064109090 2024-08-31T04:21:14.355 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:14.352+0000 7f1063e00640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f1064113530 con 0x7f10641099e0 2024-08-31T04:21:14.355 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:14.352+0000 7f1063e00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f1064113830 con 0x7f1064103750 2024-08-31T04:21:14.355 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:14.352+0000 7f1062000640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1064109090 0x7f106419c8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:21:14.355 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:14.352+0000 7f1062000640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1064109090 0x7f106419c8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:37730/0 (socket says 172.21.15.50:37730) 2024-08-31T04:21:14.355 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:14.352+0000 7f1062000640 1 -- 172.21.15.50:0/1919449316 learned_addr learned my addr 172.21.15.50:0/1919449316 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:21:14.355 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:14.352+0000 7f1062a00640 1 --2- 172.21.15.50:0/1919449316 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1064103750 0x7f106419c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:21:14.355 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:14.352+0000 7f1063400640 1 --2- 172.21.15.50:0/1919449316 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f10641099e0 0x7f10641a1b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:21:14.356 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:14.353+0000 7f1063400640 1 -- 172.21.15.50:0/1919449316 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1064103750 msgr2=0x7f106419c300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:21:14.356 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:14.353+0000 7f1063400640 1 --2- 172.21.15.50:0/1919449316 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1064103750 0x7f106419c300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:14.356 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:14.353+0000 7f1063400640 1 -- 172.21.15.50:0/1919449316 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1064109090 msgr2=0x7f106419c8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:21:14.356 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:14.353+0000 7f1063400640 1 --2- 172.21.15.50:0/1919449316 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1064109090 0x7f106419c8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:14.357 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:14.353+0000 7f1063400640 1 -- 172.21.15.50:0/1919449316 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10641a2270 con 0x7f10641099e0 2024-08-31T04:21:14.357 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:14.353+0000 7f1062a00640 1 --2- 172.21.15.50:0/1919449316 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1064103750 0x7f106419c300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:21:14.357 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:14.353+0000 7f1062000640 1 --2- 172.21.15.50:0/1919449316 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1064109090 0x7f106419c8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:21:14.357 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:14.353+0000 7f1063400640 1 --2- 172.21.15.50:0/1919449316 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f10641099e0 0x7f10641a1b40 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f105c009fd0 tx=0x7f105c00ef10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:21:14.357 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:14.353+0000 7f105b400640 1 -- 172.21.15.50:0/1919449316 <== mon.2 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f105c00ce20 con 0x7f10641099e0 2024-08-31T04:21:14.357 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:14.353+0000 7f1063e00640 1 -- 172.21.15.50:0/1919449316 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f10641a2560 con 0x7f10641099e0 2024-08-31T04:21:14.357 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:14.354+0000 7f105b400640 1 -- 172.21.15.50:0/1919449316 <== mon.2 v2:172.21.15.133:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f105c005020 con 0x7f10641099e0 2024-08-31T04:21:14.357 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:14.354+0000 7f105b400640 1 -- 172.21.15.50:0/1919449316 <== mon.2 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f105c010690 con 0x7f10641099e0 2024-08-31T04:21:14.357 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:14.354+0000 7f1063e00640 1 -- 172.21.15.50:0/1919449316 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f10641a8cc0 con 0x7f10641099e0 2024-08-31T04:21:14.358 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:14.355+0000 7f1063e00640 1 -- 172.21.15.50:0/1919449316 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1064103b60 con 0x7f10641099e0 2024-08-31T04:21:14.361 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:14.359+0000 7f105b400640 1 -- 172.21.15.50:0/1919449316 <== mon.2 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 17) ==== 152628+0+0 (secure 0 0 0) 0x7f105c0054d0 con 0x7f10641099e0 2024-08-31T04:21:14.363 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:14.361+0000 7f105b400640 1 --2- 172.21.15.50:0/1919449316 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f10480b4bc0 0x7f10480b70d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:21:14.363 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:14.361+0000 7f105b400640 1 -- 172.21.15.50:0/1919449316 <== mon.2 v2:172.21.15.133:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8219+0+0 (secure 0 0 0) 0x7f105c0e59c0 con 0x7f10641099e0 2024-08-31T04:21:14.363 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:14.361+0000 7f1062a00640 1 --2- 172.21.15.50:0/1919449316 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f10480b4bc0 0x7f10480b70d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:21:14.363 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:14.361+0000 7f105b400640 1 -- 172.21.15.50:0/1919449316 <== mon.2 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f105c0ac940 con 0x7f10641099e0 2024-08-31T04:21:14.364 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:14.362+0000 7f1062a00640 1 --2- 172.21.15.50:0/1919449316 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f10480b4bc0 0x7f10480b70d0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f1054031440 tx=0x7f1054032ed0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:21:14.562 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:14.560+0000 7f1063e00640 1 -- 172.21.15.50:0/1919449316 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f10641a8fc0 con 0x7f10641099e0 2024-08-31T04:21:14.564 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:14.561+0000 7f105b400640 1 -- 172.21.15.50:0/1919449316 <== mon.2 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v78) ==== 74+0+22733 (secure 0 0 0) 0x7f105c0ac240 con 0x7f10641099e0 2024-08-31T04:21:14.564 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-08-31T04:21:14.565 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":78,"fsid":"058d9fc6-674f-11ef-bcd4-c7b262605968","created":"2024-08-31T04:11:59.576131+0000","modified":"2024-08-31T04:20:56.994402+0000","last_up_change":"2024-08-31T04:19:44.619590+0000","last_in_change":"2024-08-31T04:19:21.022096+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-31T04:15:46.229142+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-31T04:20:38.249458+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"76","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-31T04:20:40.929092+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"76","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"416ecbde-4a7b-4bd1-b377-490925a33ce1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":3831273843},{"type":"v1","addr":"172.21.15.50:6803","nonce":3831273843}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":3831273843},{"type":"v1","addr":"172.21.15.50:6805","nonce":3831273843}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":3831273843},{"type":"v1","addr":"172.21.15.50:6809","nonce":3831273843}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":3831273843},{"type":"v1","addr":"172.21.15.50:6807","nonce":3831273843}]},"public_addr":"172.21.15.50:6803/3831273843","cluster_addr":"172.21.15.50:6805/3831273843","heartbeat_back_addr":"172.21.15.50:6809/3831273843","heartbeat_front_addr":"172.21.15.50:6807/3831273843","state":["exists","up"]},{"osd":1,"uuid":"5e008006-004d-4842-9885-93a2d27be1cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":475308203},{"type":"v1","addr":"172.21.15.133:6801","nonce":475308203}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":475308203},{"type":"v1","addr":"172.21.15.133:6803","nonce":475308203}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":475308203},{"type":"v1","addr":"172.21.15.133:6807","nonce":475308203}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":475308203},{"type":"v1","addr":"172.21.15.133:6805","nonce":475308203}]},"public_addr":"172.21.15.133:6801/475308203","cluster_addr":"172.21.15.133:6803/475308203","heartbeat_back_addr":"172.21.15.133:6807/475308203","heartbeat_front_addr":"172.21.15.133:6805/475308203","state":["exists","up"]},{"osd":2,"uuid":"7e6f1a26-f30d-4822-af69-8a08cb89fbce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":3091173426},{"type":"v1","addr":"172.21.15.177:6801","nonce":3091173426}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":3091173426},{"type":"v1","addr":"172.21.15.177:6803","nonce":3091173426}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":3091173426},{"type":"v1","addr":"172.21.15.177:6807","nonce":3091173426}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":3091173426},{"type":"v1","addr":"172.21.15.177:6805","nonce":3091173426}]},"public_addr":"172.21.15.177:6801/3091173426","cluster_addr":"172.21.15.177:6803/3091173426","heartbeat_back_addr":"172.21.15.177:6807/3091173426","heartbeat_front_addr":"172.21.15.177:6805/3091173426","state":["exists","up"]},{"osd":3,"uuid":"8193c2a2-18a1-4684-9a16-cbeae25530ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":3792992620},{"type":"v1","addr":"172.21.15.50:6811","nonce":3792992620}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":3792992620},{"type":"v1","addr":"172.21.15.50:6813","nonce":3792992620}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":3792992620},{"type":"v1","addr":"172.21.15.50:6817","nonce":3792992620}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":3792992620},{"type":"v1","addr":"172.21.15.50:6815","nonce":3792992620}]},"public_addr":"172.21.15.50:6811/3792992620","cluster_addr":"172.21.15.50:6813/3792992620","heartbeat_back_addr":"172.21.15.50:6817/3792992620","heartbeat_front_addr":"172.21.15.50:6815/3792992620","state":["exists","up"]},{"osd":4,"uuid":"2a2b4e64-0f8e-40ec-926c-84dbf691aefe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":2855333596},{"type":"v1","addr":"172.21.15.133:6809","nonce":2855333596}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":2855333596},{"type":"v1","addr":"172.21.15.133:6811","nonce":2855333596}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":2855333596},{"type":"v1","addr":"172.21.15.133:6815","nonce":2855333596}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":2855333596},{"type":"v1","addr":"172.21.15.133:6813","nonce":2855333596}]},"public_addr":"172.21.15.133:6809/2855333596","cluster_addr":"172.21.15.133:6811/2855333596","heartbeat_back_addr":"172.21.15.133:6815/2855333596","heartbeat_front_addr":"172.21.15.133:6813/2855333596","state":["exists","up"]},{"osd":5,"uuid":"83429ff0-ea7d-4fcc-9611-39d9001aa216","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":1166415084},{"type":"v1","addr":"172.21.15.177:6809","nonce":1166415084}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":1166415084},{"type":"v1","addr":"172.21.15.177:6811","nonce":1166415084}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":1166415084},{"type":"v1","addr":"172.21.15.177:6815","nonce":1166415084}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":1166415084},{"type":"v1","addr":"172.21.15.177:6813","nonce":1166415084}]},"public_addr":"172.21.15.177:6809/1166415084","cluster_addr":"172.21.15.177:6811/1166415084","heartbeat_back_addr":"172.21.15.177:6815/1166415084","heartbeat_front_addr":"172.21.15.177:6813/1166415084","state":["exists","up"]},{"osd":6,"uuid":"eeb571ef-5e43-4816-95dd-d01d83aeca83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":1429341184},{"type":"v1","addr":"172.21.15.50:6819","nonce":1429341184}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":1429341184},{"type":"v1","addr":"172.21.15.50:6821","nonce":1429341184}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":1429341184},{"type":"v1","addr":"172.21.15.50:6825","nonce":1429341184}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":1429341184},{"type":"v1","addr":"172.21.15.50:6823","nonce":1429341184}]},"public_addr":"172.21.15.50:6819/1429341184","cluster_addr":"172.21.15.50:6821/1429341184","heartbeat_back_addr":"172.21.15.50:6825/1429341184","heartbeat_front_addr":"172.21.15.50:6823/1429341184","state":["exists","up"]},{"osd":7,"uuid":"512ee507-0d50-4fed-b692-dbdf23a93e8e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":3643454923},{"type":"v1","addr":"172.21.15.133:6817","nonce":3643454923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":3643454923},{"type":"v1","addr":"172.21.15.133:6819","nonce":3643454923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":3643454923},{"type":"v1","addr":"172.21.15.133:6823","nonce":3643454923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":3643454923},{"type":"v1","addr":"172.21.15.133:6821","nonce":3643454923}]},"public_addr":"172.21.15.133:6817/3643454923","cluster_addr":"172.21.15.133:6819/3643454923","heartbeat_back_addr":"172.21.15.133:6823/3643454923","heartbeat_front_addr":"172.21.15.133:6821/3643454923","state":["exists","up"]},{"osd":8,"uuid":"ae99526e-41da-4cb5-857f-2e66f18f2d94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6816","nonce":101973300},{"type":"v1","addr":"172.21.15.177:6817","nonce":101973300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":101973300},{"type":"v1","addr":"172.21.15.177:6819","nonce":101973300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":101973300},{"type":"v1","addr":"172.21.15.177:6823","nonce":101973300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":101973300},{"type":"v1","addr":"172.21.15.177:6821","nonce":101973300}]},"public_addr":"172.21.15.177:6817/101973300","cluster_addr":"172.21.15.177:6819/101973300","heartbeat_back_addr":"172.21.15.177:6823/101973300","heartbeat_front_addr":"172.21.15.177:6821/101973300","state":["exists","up"]},{"osd":9,"uuid":"fcedbe16-b910-407f-b9d7-1dd03f3e62a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":53019860},{"type":"v1","addr":"172.21.15.50:6827","nonce":53019860}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":53019860},{"type":"v1","addr":"172.21.15.50:6829","nonce":53019860}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":53019860},{"type":"v1","addr":"172.21.15.50:6833","nonce":53019860}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":53019860},{"type":"v1","addr":"172.21.15.50:6831","nonce":53019860}]},"public_addr":"172.21.15.50:6827/53019860","cluster_addr":"172.21.15.50:6829/53019860","heartbeat_back_addr":"172.21.15.50:6833/53019860","heartbeat_front_addr":"172.21.15.50:6831/53019860","state":["exists","up"]},{"osd":10,"uuid":"3852756e-62f1-4e71-a070-8cff76df99b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":4175566493},{"type":"v1","addr":"172.21.15.133:6825","nonce":4175566493}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":4175566493},{"type":"v1","addr":"172.21.15.133:6827","nonce":4175566493}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":4175566493},{"type":"v1","addr":"172.21.15.133:6831","nonce":4175566493}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":4175566493},{"type":"v1","addr":"172.21.15.133:6829","nonce":4175566493}]},"public_addr":"172.21.15.133:6825/4175566493","cluster_addr":"172.21.15.133:6827/4175566493","heartbeat_back_addr":"172.21.15.133:6831/4175566493","heartbeat_front_addr":"172.21.15.133:6829/4175566493","state":["exists","up"]},{"osd":11,"uuid":"a154180a-5f2a-4b33-ad3d-fea7317597ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":2103454982},{"type":"v1","addr":"172.21.15.177:6825","nonce":2103454982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":2103454982},{"type":"v1","addr":"172.21.15.177:6827","nonce":2103454982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":2103454982},{"type":"v1","addr":"172.21.15.177:6831","nonce":2103454982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":2103454982},{"type":"v1","addr":"172.21.15.177:6829","nonce":2103454982}]},"public_addr":"172.21.15.177:6825/2103454982","cluster_addr":"172.21.15.177:6827/2103454982","heartbeat_back_addr":"172.21.15.177:6831/2103454982","heartbeat_front_addr":"172.21.15.177:6829/2103454982","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:14:54.683660+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:15:20.007319+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:15:43.613426+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:16:12.387010+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:16:38.079210+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:17:02.750375+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:17:31.735810+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:17:57.600985+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:18:22.503347+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:18:52.316657+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:19:18.444623+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:19:42.331006+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.b","mappings":[{"from":2,"to":4},{"from":8,"to":11}]},{"pgid":"2.1b","mappings":[{"from":2,"to":1}]},{"pgid":"2.1d","mappings":[{"from":8,"to":11}]},{"pgid":"3.e","mappings":[{"from":4,"to":6}]},{"pgid":"3.17","mappings":[{"from":4,"to":8}]},{"pgid":"3.25","mappings":[{"from":5,"to":9}]},{"pgid":"3.29","mappings":[{"from":3,"to":9}]},{"pgid":"3.36","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.50:6801/1319056820":"2024-09-01T04:12:55.742020+0000","172.21.15.50:0/1755103674":"2024-09-01T04:12:55.742020+0000","172.21.15.50:6800/1319056820":"2024-09-01T04:12:55.742020+0000","172.21.15.50:0/3701412233":"2024-09-01T04:12:55.742020+0000","172.21.15.50:0/1829556336":"2024-09-01T04:12:55.742020+0000","172.21.15.50:0/1698995126":"2024-09-01T04:12:25.753831+0000","172.21.15.50:0/1554317941":"2024-09-01T04:12:25.753831+0000","172.21.15.50:0/2998110380":"2024-09-01T04:12:25.753831+0000","172.21.15.50:6801/4197277793":"2024-09-01T04:12:25.753831+0000","172.21.15.50:6800/4197277793":"2024-09-01T04:12:25.753831+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-31T04:21:14.566 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:14.564+0000 7f1063e00640 1 -- 172.21.15.50:0/1919449316 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f10480b4bc0 msgr2=0x7f10480b70d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:21:14.566 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:14.564+0000 7f1063e00640 1 --2- 172.21.15.50:0/1919449316 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f10480b4bc0 0x7f10480b70d0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f1054031440 tx=0x7f1054032ed0 comp rx=0 tx=0).stop 2024-08-31T04:21:14.567 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:14.564+0000 7f1063e00640 1 -- 172.21.15.50:0/1919449316 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f10641099e0 msgr2=0x7f10641a1b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:21:14.567 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:14.564+0000 7f1063e00640 1 --2- 172.21.15.50:0/1919449316 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f10641099e0 0x7f10641a1b40 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f105c009fd0 tx=0x7f105c00ef10 comp rx=0 tx=0).stop 2024-08-31T04:21:14.567 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:14.564+0000 7f1063e00640 1 -- 172.21.15.50:0/1919449316 shutdown_connections 2024-08-31T04:21:14.567 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:14.564+0000 7f1063e00640 1 --2- 172.21.15.50:0/1919449316 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f10480b4bc0 0x7f10480b70d0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:14.567 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:14.564+0000 7f1063e00640 1 --2- 172.21.15.50:0/1919449316 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f10641099e0 0x7f10641a1b40 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:14.567 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:14.564+0000 7f1063e00640 1 --2- 172.21.15.50:0/1919449316 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1064109090 0x7f106419c8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:14.567 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:14.564+0000 7f1063e00640 1 --2- 172.21.15.50:0/1919449316 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1064103750 0x7f106419c300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:14.567 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:14.564+0000 7f1063e00640 1 -- 172.21.15.50:0/1919449316 >> 172.21.15.50:0/1919449316 conn(0x7f10640ff1e0 msgr2=0x7f106410e3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:21:14.567 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:14.564+0000 7f1063e00640 1 -- 172.21.15.50:0/1919449316 shutdown_connections 2024-08-31T04:21:14.567 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:14.564+0000 7f1063e00640 1 -- 172.21.15.50:0/1919449316 wait complete. 2024-08-31T04:21:15.404 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:21:15 smithi050 ceph-mon[17259]: pgmap v317: 97 pgs: 97 active+clean; 633 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.2 KiB/s wr, 16 op/s 2024-08-31T04:21:15.405 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:21:15 smithi050 ceph-mon[17259]: from='client.? 172.21.15.50:0/1919449316' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-31T04:21:15.445 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-08-31T04:21:15.445 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 058d9fc6-674f-11ef-bcd4-c7b262605968 -- ceph pg dump --format=json 2024-08-31T04:21:15.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:21:15 smithi177 ceph-mon[22025]: pgmap v317: 97 pgs: 97 active+clean; 633 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.2 KiB/s wr, 16 op/s 2024-08-31T04:21:15.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:21:15 smithi177 ceph-mon[22025]: from='client.? 172.21.15.50:0/1919449316' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-31T04:21:15.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:21:15 smithi133 ceph-mon[22177]: pgmap v317: 97 pgs: 97 active+clean; 633 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.2 KiB/s wr, 16 op/s 2024-08-31T04:21:15.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:21:15 smithi133 ceph-mon[22177]: from='client.? 172.21.15.50:0/1919449316' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-31T04:21:15.825 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:21:16.589 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:16.586+0000 7f8085a00640 1 -- 172.21.15.50:0/2490029291 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8080103900 msgr2=0x7f8080103d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:21:16.590 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:16.586+0000 7f8085a00640 1 --2- 172.21.15.50:0/2490029291 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8080103900 0x7f8080103d10 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f8070009900 tx=0x7f807002a410 comp rx=0 tx=0).stop 2024-08-31T04:21:16.590 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:16.586+0000 7f8085a00640 1 -- 172.21.15.50:0/2490029291 shutdown_connections 2024-08-31T04:21:16.590 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:16.586+0000 7f8085a00640 1 --2- 172.21.15.50:0/2490029291 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8080109240 0x7f8080109650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:16.590 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:16.586+0000 7f8085a00640 1 --2- 172.21.15.50:0/2490029291 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8080109b90 0x7f80801103c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:16.590 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:16.586+0000 7f8085a00640 1 --2- 172.21.15.50:0/2490029291 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8080103900 0x7f8080103d10 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:16.590 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:16.586+0000 7f8085a00640 1 -- 172.21.15.50:0/2490029291 >> 172.21.15.50:0/2490029291 conn(0x7f808007b5f0 msgr2=0x7f808007ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:21:16.590 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:16.586+0000 7f8085a00640 1 -- 172.21.15.50:0/2490029291 shutdown_connections 2024-08-31T04:21:16.590 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:16.586+0000 7f8085a00640 1 -- 172.21.15.50:0/2490029291 wait complete. 2024-08-31T04:21:16.590 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:16.587+0000 7f8085a00640 1 Processor -- start 2024-08-31T04:21:16.590 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:16.587+0000 7f8085a00640 1 -- start start 2024-08-31T04:21:16.592 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:16.588+0000 7f8085a00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8080103900 0x7f808019c4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:21:16.592 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:16.588+0000 7f8085a00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8080109240 0x7f808019ca80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:21:16.592 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:16.588+0000 7f8085a00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8080109b90 0x7f80801a1d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:21:16.592 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:16.588+0000 7f8085a00640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f8080113850 con 0x7f8080109b90 2024-08-31T04:21:16.592 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:16.588+0000 7f8085a00640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f80801136d0 con 0x7f8080109240 2024-08-31T04:21:16.592 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:16.588+0000 7f8085a00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f80801139d0 con 0x7f8080103900 2024-08-31T04:21:16.593 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:16.588+0000 7f807ea00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8080103900 0x7f808019c4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:21:16.593 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:16.588+0000 7f807ea00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8080103900 0x7f808019c4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.50:40260/0 (socket says 172.21.15.50:40260) 2024-08-31T04:21:16.593 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:16.588+0000 7f807ea00640 1 -- 172.21.15.50:0/263390258 learned_addr learned my addr 172.21.15.50:0/263390258 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:21:16.593 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:16.588+0000 7f807f400640 1 --2- 172.21.15.50:0/263390258 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8080109b90 0x7f80801a1d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:21:16.593 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:16.588+0000 7f8077e00640 1 --2- 172.21.15.50:0/263390258 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8080109240 0x7f808019ca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:21:16.593 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:16.589+0000 7f807ea00640 1 -- 172.21.15.50:0/263390258 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8080109240 msgr2=0x7f808019ca80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:21:16.593 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:16.589+0000 7f807ea00640 1 --2- 172.21.15.50:0/263390258 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8080109240 0x7f808019ca80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:16.593 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:16.589+0000 7f807ea00640 1 -- 172.21.15.50:0/263390258 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8080109b90 msgr2=0x7f80801a1d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:21:16.593 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:16.589+0000 7f807ea00640 1 --2- 172.21.15.50:0/263390258 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8080109b90 0x7f80801a1d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:16.593 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:16.589+0000 7f807ea00640 1 -- 172.21.15.50:0/263390258 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80801a2450 con 0x7f8080103900 2024-08-31T04:21:16.593 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:16.589+0000 7f807ea00640 1 --2- 172.21.15.50:0/263390258 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8080103900 0x7f808019c4e0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f8070005940 tx=0x7f80700040c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:21:16.593 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:16.589+0000 7f8077400640 1 -- 172.21.15.50:0/263390258 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f807003f030 con 0x7f8080103900 2024-08-31T04:21:16.593 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:16.590+0000 7f8077400640 1 -- 172.21.15.50:0/263390258 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f80700044c0 con 0x7f8080103900 2024-08-31T04:21:16.593 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:16.590+0000 7f8085a00640 1 -- 172.21.15.50:0/263390258 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f80801a26e0 con 0x7f8080103900 2024-08-31T04:21:16.594 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:16.590+0000 7f8077400640 1 -- 172.21.15.50:0/263390258 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8070035070 con 0x7f8080103900 2024-08-31T04:21:16.594 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:16.590+0000 7f8085a00640 1 -- 172.21.15.50:0/263390258 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f80801a8ea0 con 0x7f8080103900 2024-08-31T04:21:16.594 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:16.591+0000 7f8085a00640 1 -- 172.21.15.50:0/263390258 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8080104b80 con 0x7f8080103900 2024-08-31T04:21:16.595 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:16.593+0000 7f8077400640 1 -- 172.21.15.50:0/263390258 <== mon.1 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 17) ==== 152628+0+0 (secure 0 0 0) 0x7f8070042030 con 0x7f8080103900 2024-08-31T04:21:16.597 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:16.595+0000 7f8077400640 1 --2- 172.21.15.50:0/263390258 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f80640b4bc0 0x7f80640b70d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:21:16.597 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:16.595+0000 7f8077400640 1 -- 172.21.15.50:0/263390258 <== mon.1 v2:172.21.15.177:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8219+0+0 (secure 0 0 0) 0x7f80701058b0 con 0x7f8080103900 2024-08-31T04:21:16.597 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:16.595+0000 7f8077e00640 1 --2- 172.21.15.50:0/263390258 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f80640b4bc0 0x7f80640b70d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:21:16.598 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:16.596+0000 7f8077e00640 1 --2- 172.21.15.50:0/263390258 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f80640b4bc0 0x7f80640b70d0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f8080108d60 tx=0x7f8068005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:21:16.599 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:16.597+0000 7f8077400640 1 -- 172.21.15.50:0/263390258 <== mon.1 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f80700cc1e0 con 0x7f8080103900 2024-08-31T04:21:16.793 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:16.791+0000 7f8085a00640 1 -- 172.21.15.50:0/263390258 --> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f8080107800 con 0x7f80640b4bc0 2024-08-31T04:21:16.799 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:16.797+0000 7f8077400640 1 -- 172.21.15.50:0/263390258 <== mgr.14150 v2:172.21.15.50:6800/2146686622 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258856 (secure 0 0 0) 0x7f8080107800 con 0x7f80640b4bc0 2024-08-31T04:21:16.803 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-08-31T04:21:16.805 INFO:teuthology.orchestra.run.smithi050.stderr:dumped all 2024-08-31T04:21:16.807 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:16.801+0000 7f8085a00640 1 -- 172.21.15.50:0/263390258 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f80640b4bc0 msgr2=0x7f80640b70d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:21:16.807 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:16.801+0000 7f8085a00640 1 --2- 172.21.15.50:0/263390258 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f80640b4bc0 0x7f80640b70d0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f8080108d60 tx=0x7f8068005f90 comp rx=0 tx=0).stop 2024-08-31T04:21:16.807 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:16.801+0000 7f8085a00640 1 -- 172.21.15.50:0/263390258 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8080103900 msgr2=0x7f808019c4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:21:16.807 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:16.801+0000 7f8085a00640 1 --2- 172.21.15.50:0/263390258 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8080103900 0x7f808019c4e0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f8070005940 tx=0x7f80700040c0 comp rx=0 tx=0).stop 2024-08-31T04:21:16.807 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:16.801+0000 7f8085a00640 1 -- 172.21.15.50:0/263390258 shutdown_connections 2024-08-31T04:21:16.807 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:16.801+0000 7f8085a00640 1 --2- 172.21.15.50:0/263390258 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f80640b4bc0 0x7f80640b70d0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:16.807 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:16.801+0000 7f8085a00640 1 --2- 172.21.15.50:0/263390258 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8080109b90 0x7f80801a1d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:16.807 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:16.802+0000 7f8085a00640 1 --2- 172.21.15.50:0/263390258 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8080109240 0x7f808019ca80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:16.807 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:16.802+0000 7f8085a00640 1 --2- 172.21.15.50:0/263390258 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8080103900 0x7f808019c4e0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:16.808 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:16.802+0000 7f8085a00640 1 -- 172.21.15.50:0/263390258 >> 172.21.15.50:0/263390258 conn(0x7f808007b5f0 msgr2=0x7f80801070f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:21:16.808 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:16.802+0000 7f8085a00640 1 -- 172.21.15.50:0/263390258 shutdown_connections 2024-08-31T04:21:16.808 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:16.802+0000 7f8085a00640 1 -- 172.21.15.50:0/263390258 wait complete. 2024-08-31T04:21:17.450 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:21:17 smithi050 ceph-mon[17259]: pgmap v318: 97 pgs: 97 active+clean; 633 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 6.2 KiB/s wr, 19 op/s 2024-08-31T04:21:17.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:21:17 smithi177 ceph-mon[22025]: pgmap v318: 97 pgs: 97 active+clean; 633 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 6.2 KiB/s wr, 19 op/s 2024-08-31T04:21:17.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:21:17 smithi133 ceph-mon[22177]: pgmap v318: 97 pgs: 97 active+clean; 633 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 6.2 KiB/s wr, 19 op/s 2024-08-31T04:21:17.597 INFO:teuthology.orchestra.run.smithi050.stdout:{"pg_ready":true,"pg_map":{"version":318,"stamp":"2024-08-31T04:21:15.855055+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":648307,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":235,"num_read_kb":205,"num_write":366,"num_write_kb":2275,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":2952462,"num_keys_recovered":10,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":301,"ondisk_log_size":301,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":359724,"kb_used_data":10476,"kb_used_omap":18,"kb_used_meta":349037,"kb_avail":1124582100,"statfs":{"total":1151940427776,"available":1151572070400,"internally_reserved":0,"allocated":10727424,"data_stored":6880750,"data_compressed":109023,"data_compressed_allocated":135168,"data_compressed_original":1769472,"omap_allocated":19143,"internal_metadata":357414201},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":51311,"num_objects":20,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":159,"num_read_kb":141,"num_write":73,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003205"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":21,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:20:57.002034+0000","last_change":"2024-08-31T04:20:42.949771+0000","last_active":"2024-08-31T04:20:57.002034+0000","last_peered":"2024-08-31T04:20:57.002034+0000","last_clean":"2024-08-31T04:20:57.002034+0000","last_became_active":"2024-08-31T04:20:42.949372+0000","last_became_peered":"2024-08-31T04:20:42.949372+0000","last_unstale":"2024-08-31T04:20:57.002034+0000","last_undegraded":"2024-08-31T04:20:57.002034+0000","last_fullsized":"2024-08-31T04:20:57.002034+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:16:50.036191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":21,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:20:57.001502+0000","last_change":"2024-08-31T04:20:42.949805+0000","last_active":"2024-08-31T04:20:57.001502+0000","last_peered":"2024-08-31T04:20:57.001502+0000","last_clean":"2024-08-31T04:20:57.001502+0000","last_became_active":"2024-08-31T04:20:42.948015+0000","last_became_peered":"2024-08-31T04:20:42.948015+0000","last_unstale":"2024-08-31T04:20:57.001502+0000","last_undegraded":"2024-08-31T04:20:57.001502+0000","last_fullsized":"2024-08-31T04:20:57.001502+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:25:47.432785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":21,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:20:57.001526+0000","last_change":"2024-08-31T04:20:42.949114+0000","last_active":"2024-08-31T04:20:57.001526+0000","last_peered":"2024-08-31T04:20:57.001526+0000","last_clean":"2024-08-31T04:20:57.001526+0000","last_became_active":"2024-08-31T04:20:42.946763+0000","last_became_peered":"2024-08-31T04:20:42.946763+0000","last_unstale":"2024-08-31T04:20:57.001526+0000","last_undegraded":"2024-08-31T04:20:57.001526+0000","last_fullsized":"2024-08-31T04:20:57.001526+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:33:55.605617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":21,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:20:56.999162+0000","last_change":"2024-08-31T04:20:42.935026+0000","last_active":"2024-08-31T04:20:56.999162+0000","last_peered":"2024-08-31T04:20:56.999162+0000","last_clean":"2024-08-31T04:20:56.999162+0000","last_became_active":"2024-08-31T04:20:42.934534+0000","last_became_peered":"2024-08-31T04:20:42.934534+0000","last_unstale":"2024-08-31T04:20:56.999162+0000","last_undegraded":"2024-08-31T04:20:56.999162+0000","last_fullsized":"2024-08-31T04:20:56.999162+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:33:41.014920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":21,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:20:57.006160+0000","last_change":"2024-08-31T04:20:42.939114+0000","last_active":"2024-08-31T04:20:57.006160+0000","last_peered":"2024-08-31T04:20:57.006160+0000","last_clean":"2024-08-31T04:20:57.006160+0000","last_became_active":"2024-08-31T04:20:42.938710+0000","last_became_peered":"2024-08-31T04:20:42.938710+0000","last_unstale":"2024-08-31T04:20:57.006160+0000","last_undegraded":"2024-08-31T04:20:57.006160+0000","last_fullsized":"2024-08-31T04:20:57.006160+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:42:25.561258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":21,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:20:57.001416+0000","last_change":"2024-08-31T04:20:42.935958+0000","last_active":"2024-08-31T04:20:57.001416+0000","last_peered":"2024-08-31T04:20:57.001416+0000","last_clean":"2024-08-31T04:20:57.001416+0000","last_became_active":"2024-08-31T04:20:42.934865+0000","last_became_peered":"2024-08-31T04:20:42.934865+0000","last_unstale":"2024-08-31T04:20:57.001416+0000","last_undegraded":"2024-08-31T04:20:57.001416+0000","last_fullsized":"2024-08-31T04:20:57.001416+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:28:20.330784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":21,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:20:57.003213+0000","last_change":"2024-08-31T04:20:42.932639+0000","last_active":"2024-08-31T04:20:57.003213+0000","last_peered":"2024-08-31T04:20:57.003213+0000","last_clean":"2024-08-31T04:20:57.003213+0000","last_became_active":"2024-08-31T04:20:42.932238+0000","last_became_peered":"2024-08-31T04:20:42.932238+0000","last_unstale":"2024-08-31T04:20:57.003213+0000","last_undegraded":"2024-08-31T04:20:57.003213+0000","last_fullsized":"2024-08-31T04:20:57.003213+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T04:47:32.128675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":21,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:20:57.338218+0000","last_change":"2024-08-31T04:20:42.941700+0000","last_active":"2024-08-31T04:20:57.338218+0000","last_peered":"2024-08-31T04:20:57.338218+0000","last_clean":"2024-08-31T04:20:57.338218+0000","last_became_active":"2024-08-31T04:20:42.941308+0000","last_became_peered":"2024-08-31T04:20:42.941308+0000","last_unstale":"2024-08-31T04:20:57.338218+0000","last_undegraded":"2024-08-31T04:20:57.338218+0000","last_fullsized":"2024-08-31T04:20:57.338218+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:35:06.058492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":21,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:20:57.223342+0000","last_change":"2024-08-31T04:20:42.935528+0000","last_active":"2024-08-31T04:20:57.223342+0000","last_peered":"2024-08-31T04:20:57.223342+0000","last_clean":"2024-08-31T04:20:57.223342+0000","last_became_active":"2024-08-31T04:20:42.933736+0000","last_became_peered":"2024-08-31T04:20:42.933736+0000","last_unstale":"2024-08-31T04:20:57.223342+0000","last_undegraded":"2024-08-31T04:20:57.223342+0000","last_fullsized":"2024-08-31T04:20:57.223342+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:12:47.877285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":28,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:20:57.006811+0000","last_change":"2024-08-31T04:20:57.006683+0000","last_active":"2024-08-31T04:20:57.006811+0000","last_peered":"2024-08-31T04:20:57.006811+0000","last_clean":"2024-08-31T04:20:57.006811+0000","last_became_active":"2024-08-31T04:20:57.006166+0000","last_became_peered":"2024-08-31T04:20:57.006166+0000","last_unstale":"2024-08-31T04:20:57.006811+0000","last_undegraded":"2024-08-31T04:20:57.006811+0000","last_fullsized":"2024-08-31T04:20:57.006811+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:33:23.377991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,9],"acting":[10,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":21,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:20:57.003953+0000","last_change":"2024-08-31T04:20:42.939489+0000","last_active":"2024-08-31T04:20:57.003953+0000","last_peered":"2024-08-31T04:20:57.003953+0000","last_clean":"2024-08-31T04:20:57.003953+0000","last_became_active":"2024-08-31T04:20:42.939138+0000","last_became_peered":"2024-08-31T04:20:42.939138+0000","last_unstale":"2024-08-31T04:20:57.003953+0000","last_undegraded":"2024-08-31T04:20:57.003953+0000","last_fullsized":"2024-08-31T04:20:57.003953+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T05:00:30.196513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":21,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:20:56.999241+0000","last_change":"2024-08-31T04:20:42.941483+0000","last_active":"2024-08-31T04:20:56.999241+0000","last_peered":"2024-08-31T04:20:56.999241+0000","last_clean":"2024-08-31T04:20:56.999241+0000","last_became_active":"2024-08-31T04:20:42.940200+0000","last_became_peered":"2024-08-31T04:20:42.940200+0000","last_unstale":"2024-08-31T04:20:56.999241+0000","last_undegraded":"2024-08-31T04:20:56.999241+0000","last_fullsized":"2024-08-31T04:20:56.999241+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:40:45.235093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":21,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:20:56.998469+0000","last_change":"2024-08-31T04:20:42.928803+0000","last_active":"2024-08-31T04:20:56.998469+0000","last_peered":"2024-08-31T04:20:56.998469+0000","last_clean":"2024-08-31T04:20:56.998469+0000","last_became_active":"2024-08-31T04:20:42.928410+0000","last_became_peered":"2024-08-31T04:20:42.928410+0000","last_unstale":"2024-08-31T04:20:56.998469+0000","last_undegraded":"2024-08-31T04:20:56.998469+0000","last_fullsized":"2024-08-31T04:20:56.998469+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T04:24:41.811202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":21,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:20:57.001244+0000","last_change":"2024-08-31T04:20:42.945142+0000","last_active":"2024-08-31T04:20:57.001244+0000","last_peered":"2024-08-31T04:20:57.001244+0000","last_clean":"2024-08-31T04:20:57.001244+0000","last_became_active":"2024-08-31T04:20:42.944061+0000","last_became_peered":"2024-08-31T04:20:42.944061+0000","last_unstale":"2024-08-31T04:20:57.001244+0000","last_undegraded":"2024-08-31T04:20:57.001244+0000","last_fullsized":"2024-08-31T04:20:57.001244+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:55:09.045257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":21,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:20:57.001166+0000","last_change":"2024-08-31T04:20:42.945844+0000","last_active":"2024-08-31T04:20:57.001166+0000","last_peered":"2024-08-31T04:20:57.001166+0000","last_clean":"2024-08-31T04:20:57.001166+0000","last_became_active":"2024-08-31T04:20:42.944186+0000","last_became_peered":"2024-08-31T04:20:42.944186+0000","last_unstale":"2024-08-31T04:20:57.001166+0000","last_undegraded":"2024-08-31T04:20:57.001166+0000","last_fullsized":"2024-08-31T04:20:57.001166+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:32:46.878700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":21,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:20:57.222782+0000","last_change":"2024-08-31T04:20:42.952871+0000","last_active":"2024-08-31T04:20:57.222782+0000","last_peered":"2024-08-31T04:20:57.222782+0000","last_clean":"2024-08-31T04:20:57.222782+0000","last_became_active":"2024-08-31T04:20:42.952531+0000","last_became_peered":"2024-08-31T04:20:42.952531+0000","last_unstale":"2024-08-31T04:20:57.222782+0000","last_undegraded":"2024-08-31T04:20:57.222782+0000","last_fullsized":"2024-08-31T04:20:57.222782+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:26:01.690119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":21,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:20:57.002008+0000","last_change":"2024-08-31T04:20:42.949822+0000","last_active":"2024-08-31T04:20:57.002008+0000","last_peered":"2024-08-31T04:20:57.002008+0000","last_clean":"2024-08-31T04:20:57.002008+0000","last_became_active":"2024-08-31T04:20:42.949443+0000","last_became_peered":"2024-08-31T04:20:42.949443+0000","last_unstale":"2024-08-31T04:20:57.002008+0000","last_undegraded":"2024-08-31T04:20:57.002008+0000","last_fullsized":"2024-08-31T04:20:57.002008+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:35:48.270606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":21,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:20:57.004840+0000","last_change":"2024-08-31T04:20:42.940895+0000","last_active":"2024-08-31T04:20:57.004840+0000","last_peered":"2024-08-31T04:20:57.004840+0000","last_clean":"2024-08-31T04:20:57.004840+0000","last_became_active":"2024-08-31T04:20:42.940489+0000","last_became_peered":"2024-08-31T04:20:42.940489+0000","last_unstale":"2024-08-31T04:20:57.004840+0000","last_undegraded":"2024-08-31T04:20:57.004840+0000","last_fullsized":"2024-08-31T04:20:57.004840+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T04:42:20.269895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":21,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:20:57.004087+0000","last_change":"2024-08-31T04:20:42.935303+0000","last_active":"2024-08-31T04:20:57.004087+0000","last_peered":"2024-08-31T04:20:57.004087+0000","last_clean":"2024-08-31T04:20:57.004087+0000","last_became_active":"2024-08-31T04:20:42.934931+0000","last_became_peered":"2024-08-31T04:20:42.934931+0000","last_unstale":"2024-08-31T04:20:57.004087+0000","last_undegraded":"2024-08-31T04:20:57.004087+0000","last_fullsized":"2024-08-31T04:20:57.004087+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:34:40.767333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":21,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:20:57.000940+0000","last_change":"2024-08-31T04:20:42.941518+0000","last_active":"2024-08-31T04:20:57.000940+0000","last_peered":"2024-08-31T04:20:57.000940+0000","last_clean":"2024-08-31T04:20:57.000940+0000","last_became_active":"2024-08-31T04:20:42.941142+0000","last_became_peered":"2024-08-31T04:20:42.941142+0000","last_unstale":"2024-08-31T04:20:57.000940+0000","last_undegraded":"2024-08-31T04:20:57.000940+0000","last_fullsized":"2024-08-31T04:20:57.000940+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:27:50.274057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":21,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:20:56.998500+0000","last_change":"2024-08-31T04:20:42.945136+0000","last_active":"2024-08-31T04:20:56.998500+0000","last_peered":"2024-08-31T04:20:56.998500+0000","last_clean":"2024-08-31T04:20:56.998500+0000","last_became_active":"2024-08-31T04:20:42.944811+0000","last_became_peered":"2024-08-31T04:20:42.944811+0000","last_unstale":"2024-08-31T04:20:56.998500+0000","last_undegraded":"2024-08-31T04:20:56.998500+0000","last_fullsized":"2024-08-31T04:20:56.998500+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:30:47.496668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":21,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:20:57.222956+0000","last_change":"2024-08-31T04:20:42.930854+0000","last_active":"2024-08-31T04:20:57.222956+0000","last_peered":"2024-08-31T04:20:57.222956+0000","last_clean":"2024-08-31T04:20:57.222956+0000","last_became_active":"2024-08-31T04:20:42.930490+0000","last_became_peered":"2024-08-31T04:20:42.930490+0000","last_unstale":"2024-08-31T04:20:57.222956+0000","last_undegraded":"2024-08-31T04:20:57.222956+0000","last_fullsized":"2024-08-31T04:20:57.222956+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:16:17.611414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:20:57.009435+0000","last_change":"2024-08-31T04:20:57.008738+0000","last_active":"2024-08-31T04:20:57.009435+0000","last_peered":"2024-08-31T04:20:57.009435+0000","last_clean":"2024-08-31T04:20:57.009435+0000","last_became_active":"2024-08-31T04:20:57.008209+0000","last_became_peered":"2024-08-31T04:20:57.008209+0000","last_unstale":"2024-08-31T04:20:57.009435+0000","last_undegraded":"2024-08-31T04:20:57.009435+0000","last_fullsized":"2024-08-31T04:20:57.009435+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T05:26:22.508955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,11],"acting":[9,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":21,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:20:56.999443+0000","last_change":"2024-08-31T04:20:42.939859+0000","last_active":"2024-08-31T04:20:56.999443+0000","last_peered":"2024-08-31T04:20:56.999443+0000","last_clean":"2024-08-31T04:20:56.999443+0000","last_became_active":"2024-08-31T04:20:42.938315+0000","last_became_peered":"2024-08-31T04:20:42.938315+0000","last_unstale":"2024-08-31T04:20:56.999443+0000","last_undegraded":"2024-08-31T04:20:56.999443+0000","last_fullsized":"2024-08-31T04:20:56.999443+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:13:00.906454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":21,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:20:57.338551+0000","last_change":"2024-08-31T04:20:42.941861+0000","last_active":"2024-08-31T04:20:57.338551+0000","last_peered":"2024-08-31T04:20:57.338551+0000","last_clean":"2024-08-31T04:20:57.338551+0000","last_became_active":"2024-08-31T04:20:42.939556+0000","last_became_peered":"2024-08-31T04:20:42.939556+0000","last_unstale":"2024-08-31T04:20:57.338551+0000","last_undegraded":"2024-08-31T04:20:57.338551+0000","last_fullsized":"2024-08-31T04:20:57.338551+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:02:53.900917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":21,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:20:57.004438+0000","last_change":"2024-08-31T04:20:42.930792+0000","last_active":"2024-08-31T04:20:57.004438+0000","last_peered":"2024-08-31T04:20:57.004438+0000","last_clean":"2024-08-31T04:20:57.004438+0000","last_became_active":"2024-08-31T04:20:42.930014+0000","last_became_peered":"2024-08-31T04:20:42.930014+0000","last_unstale":"2024-08-31T04:20:57.004438+0000","last_undegraded":"2024-08-31T04:20:57.004438+0000","last_fullsized":"2024-08-31T04:20:57.004438+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:18:26.942604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":28,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:20:57.010285+0000","last_change":"2024-08-31T04:20:57.010093+0000","last_active":"2024-08-31T04:20:57.010285+0000","last_peered":"2024-08-31T04:20:57.010285+0000","last_clean":"2024-08-31T04:20:57.010285+0000","last_became_active":"2024-08-31T04:20:57.008759+0000","last_became_peered":"2024-08-31T04:20:57.008759+0000","last_unstale":"2024-08-31T04:20:57.010285+0000","last_undegraded":"2024-08-31T04:20:57.010285+0000","last_fullsized":"2024-08-31T04:20:57.010285+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T06:55:38.276668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,9],"acting":[11,8,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":21,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:20:56.998387+0000","last_change":"2024-08-31T04:20:42.953378+0000","last_active":"2024-08-31T04:20:56.998387+0000","last_peered":"2024-08-31T04:20:56.998387+0000","last_clean":"2024-08-31T04:20:56.998387+0000","last_became_active":"2024-08-31T04:20:42.953030+0000","last_became_peered":"2024-08-31T04:20:42.953030+0000","last_unstale":"2024-08-31T04:20:56.998387+0000","last_undegraded":"2024-08-31T04:20:56.998387+0000","last_fullsized":"2024-08-31T04:20:56.998387+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:24:46.633234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":21,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:20:57.001390+0000","last_change":"2024-08-31T04:20:42.945142+0000","last_active":"2024-08-31T04:20:57.001390+0000","last_peered":"2024-08-31T04:20:57.001390+0000","last_clean":"2024-08-31T04:20:57.001390+0000","last_became_active":"2024-08-31T04:20:42.943960+0000","last_became_peered":"2024-08-31T04:20:42.943960+0000","last_unstale":"2024-08-31T04:20:57.001390+0000","last_undegraded":"2024-08-31T04:20:57.001390+0000","last_fullsized":"2024-08-31T04:20:57.001390+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T04:29:10.501940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":21,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:20:57.003852+0000","last_change":"2024-08-31T04:20:42.946359+0000","last_active":"2024-08-31T04:20:57.003852+0000","last_peered":"2024-08-31T04:20:57.003852+0000","last_clean":"2024-08-31T04:20:57.003852+0000","last_became_active":"2024-08-31T04:20:42.945974+0000","last_became_peered":"2024-08-31T04:20:42.945974+0000","last_unstale":"2024-08-31T04:20:57.003852+0000","last_undegraded":"2024-08-31T04:20:57.003852+0000","last_fullsized":"2024-08-31T04:20:57.003852+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:01:27.808743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":21,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:20:57.003936+0000","last_change":"2024-08-31T04:20:42.930989+0000","last_active":"2024-08-31T04:20:57.003936+0000","last_peered":"2024-08-31T04:20:57.003936+0000","last_clean":"2024-08-31T04:20:57.003936+0000","last_became_active":"2024-08-31T04:20:42.930610+0000","last_became_peered":"2024-08-31T04:20:42.930610+0000","last_unstale":"2024-08-31T04:20:57.003936+0000","last_undegraded":"2024-08-31T04:20:57.003936+0000","last_fullsized":"2024-08-31T04:20:57.003936+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:01:49.473735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":21,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:20:57.001181+0000","last_change":"2024-08-31T04:20:42.930513+0000","last_active":"2024-08-31T04:20:57.001181+0000","last_peered":"2024-08-31T04:20:57.001181+0000","last_clean":"2024-08-31T04:20:57.001181+0000","last_became_active":"2024-08-31T04:20:42.930127+0000","last_became_peered":"2024-08-31T04:20:42.930127+0000","last_unstale":"2024-08-31T04:20:57.001181+0000","last_undegraded":"2024-08-31T04:20:57.001181+0000","last_fullsized":"2024-08-31T04:20:57.001181+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T05:19:55.307816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":21,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:20:57.005865+0000","last_change":"2024-08-31T04:20:42.928217+0000","last_active":"2024-08-31T04:20:57.005865+0000","last_peered":"2024-08-31T04:20:57.005865+0000","last_clean":"2024-08-31T04:20:57.005865+0000","last_became_active":"2024-08-31T04:20:42.927828+0000","last_became_peered":"2024-08-31T04:20:42.927828+0000","last_unstale":"2024-08-31T04:20:57.005865+0000","last_undegraded":"2024-08-31T04:20:57.005865+0000","last_fullsized":"2024-08-31T04:20:57.005865+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:53:21.266734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"78'6","reported_seq":63,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:21:14.076347+0000","last_change":"2024-08-31T04:20:57.229930+0000","last_active":"2024-08-31T04:21:14.076347+0000","last_peered":"2024-08-31T04:21:14.076347+0000","last_clean":"2024-08-31T04:21:14.076347+0000","last_became_active":"2024-08-31T04:20:57.224761+0000","last_became_peered":"2024-08-31T04:20:57.224761+0000","last_unstale":"2024-08-31T04:21:14.076347+0000","last_undegraded":"2024-08-31T04:21:14.076347+0000","last_fullsized":"2024-08-31T04:21:14.076347+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_clean_scrub_stamp":"2024-08-31T04:20:38.871450+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:07:41.723452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1013,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":17,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":622,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":21,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:20:57.000491+0000","last_change":"2024-08-31T04:20:42.939189+0000","last_active":"2024-08-31T04:20:57.000491+0000","last_peered":"2024-08-31T04:20:57.000491+0000","last_clean":"2024-08-31T04:20:57.000491+0000","last_became_active":"2024-08-31T04:20:42.938817+0000","last_became_peered":"2024-08-31T04:20:42.938817+0000","last_unstale":"2024-08-31T04:20:57.000491+0000","last_undegraded":"2024-08-31T04:20:57.000491+0000","last_fullsized":"2024-08-31T04:20:57.000491+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:19:04.407104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"77'7","reported_seq":34,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:20:57.001432+0000","last_change":"2024-08-31T04:20:39.904392+0000","last_active":"2024-08-31T04:20:57.001432+0000","last_peered":"2024-08-31T04:20:57.001432+0000","last_clean":"2024-08-31T04:20:57.001432+0000","last_became_active":"2024-08-31T04:20:39.904014+0000","last_became_peered":"2024-08-31T04:20:39.904014+0000","last_unstale":"2024-08-31T04:20:57.001432+0000","last_undegraded":"2024-08-31T04:20:57.001432+0000","last_fullsized":"2024-08-31T04:20:57.001432+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_clean_scrub_stamp":"2024-08-31T04:20:38.871450+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:33:56.591237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"78'3","reported_seq":30,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:20:56.998239+0000","last_change":"2024-08-31T04:20:39.899521+0000","last_active":"2024-08-31T04:20:56.998239+0000","last_peered":"2024-08-31T04:20:56.998239+0000","last_clean":"2024-08-31T04:20:56.998239+0000","last_became_active":"2024-08-31T04:20:39.899157+0000","last_became_peered":"2024-08-31T04:20:39.899157+0000","last_unstale":"2024-08-31T04:20:56.998239+0000","last_undegraded":"2024-08-31T04:20:56.998239+0000","last_fullsized":"2024-08-31T04:20:56.998239+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_clean_scrub_stamp":"2024-08-31T04:20:38.871450+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:14:47.067149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":21,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:20:57.338276+0000","last_change":"2024-08-31T04:20:42.950653+0000","last_active":"2024-08-31T04:20:57.338276+0000","last_peered":"2024-08-31T04:20:57.338276+0000","last_clean":"2024-08-31T04:20:57.338276+0000","last_became_active":"2024-08-31T04:20:42.949627+0000","last_became_peered":"2024-08-31T04:20:42.949627+0000","last_unstale":"2024-08-31T04:20:57.338276+0000","last_undegraded":"2024-08-31T04:20:57.338276+0000","last_fullsized":"2024-08-31T04:20:57.338276+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:22:00.000717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"78'3","reported_seq":31,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:21:01.048385+0000","last_change":"2024-08-31T04:20:39.908013+0000","last_active":"2024-08-31T04:21:01.048385+0000","last_peered":"2024-08-31T04:21:01.048385+0000","last_clean":"2024-08-31T04:21:01.048385+0000","last_became_active":"2024-08-31T04:20:39.907482+0000","last_became_peered":"2024-08-31T04:20:39.907482+0000","last_unstale":"2024-08-31T04:21:01.048385+0000","last_undegraded":"2024-08-31T04:21:01.048385+0000","last_fullsized":"2024-08-31T04:21:01.048385+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_clean_scrub_stamp":"2024-08-31T04:20:38.871450+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:50:35.466407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":21,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:20:57.004374+0000","last_change":"2024-08-31T04:20:42.944674+0000","last_active":"2024-08-31T04:20:57.004374+0000","last_peered":"2024-08-31T04:20:57.004374+0000","last_clean":"2024-08-31T04:20:57.004374+0000","last_became_active":"2024-08-31T04:20:42.944424+0000","last_became_peered":"2024-08-31T04:20:42.944424+0000","last_unstale":"2024-08-31T04:20:57.004374+0000","last_undegraded":"2024-08-31T04:20:57.004374+0000","last_fullsized":"2024-08-31T04:20:57.004374+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:10:27.772835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"77'4","reported_seq":51,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:21:11.071818+0000","last_change":"2024-08-31T04:20:39.904188+0000","last_active":"2024-08-31T04:21:11.071818+0000","last_peered":"2024-08-31T04:21:11.071818+0000","last_clean":"2024-08-31T04:21:11.071818+0000","last_became_active":"2024-08-31T04:20:39.903789+0000","last_became_peered":"2024-08-31T04:20:39.903789+0000","last_unstale":"2024-08-31T04:21:11.071818+0000","last_undegraded":"2024-08-31T04:21:11.071818+0000","last_fullsized":"2024-08-31T04:21:11.071818+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_clean_scrub_stamp":"2024-08-31T04:20:38.871450+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T06:54:38.881746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":21,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:20:57.223134+0000","last_change":"2024-08-31T04:20:42.932961+0000","last_active":"2024-08-31T04:20:57.223134+0000","last_peered":"2024-08-31T04:20:57.223134+0000","last_clean":"2024-08-31T04:20:57.223134+0000","last_became_active":"2024-08-31T04:20:42.932562+0000","last_became_peered":"2024-08-31T04:20:42.932562+0000","last_unstale":"2024-08-31T04:20:57.223134+0000","last_undegraded":"2024-08-31T04:20:57.223134+0000","last_fullsized":"2024-08-31T04:20:57.223134+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:20:36.827300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"78'4","reported_seq":31,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:21:01.049286+0000","last_change":"2024-08-31T04:20:39.902279+0000","last_active":"2024-08-31T04:21:01.049286+0000","last_peered":"2024-08-31T04:21:01.049286+0000","last_clean":"2024-08-31T04:21:01.049286+0000","last_became_active":"2024-08-31T04:20:39.901822+0000","last_became_peered":"2024-08-31T04:20:39.901822+0000","last_unstale":"2024-08-31T04:21:01.049286+0000","last_undegraded":"2024-08-31T04:21:01.049286+0000","last_fullsized":"2024-08-31T04:21:01.049286+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_clean_scrub_stamp":"2024-08-31T04:20:38.871450+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:48:09.609644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":28,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:20:57.009187+0000","last_change":"2024-08-31T04:20:57.008955+0000","last_active":"2024-08-31T04:20:57.009187+0000","last_peered":"2024-08-31T04:20:57.009187+0000","last_clean":"2024-08-31T04:20:57.009187+0000","last_became_active":"2024-08-31T04:20:57.008487+0000","last_became_peered":"2024-08-31T04:20:57.008487+0000","last_unstale":"2024-08-31T04:20:57.009187+0000","last_undegraded":"2024-08-31T04:20:57.009187+0000","last_fullsized":"2024-08-31T04:20:57.009187+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:26:23.399089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,5],"acting":[0,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"77'5","reported_seq":33,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:20:56.999868+0000","last_change":"2024-08-31T04:20:39.992197+0000","last_active":"2024-08-31T04:20:56.999868+0000","last_peered":"2024-08-31T04:20:56.999868+0000","last_clean":"2024-08-31T04:20:56.999868+0000","last_became_active":"2024-08-31T04:20:39.991835+0000","last_became_peered":"2024-08-31T04:20:39.991835+0000","last_unstale":"2024-08-31T04:20:56.999868+0000","last_undegraded":"2024-08-31T04:20:56.999868+0000","last_fullsized":"2024-08-31T04:20:56.999868+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_clean_scrub_stamp":"2024-08-31T04:20:38.871450+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:38:02.808469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":21,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:20:57.223159+0000","last_change":"2024-08-31T04:20:42.934874+0000","last_active":"2024-08-31T04:20:57.223159+0000","last_peered":"2024-08-31T04:20:57.223159+0000","last_clean":"2024-08-31T04:20:57.223159+0000","last_became_active":"2024-08-31T04:20:42.934500+0000","last_became_peered":"2024-08-31T04:20:42.934500+0000","last_unstale":"2024-08-31T04:20:57.223159+0000","last_undegraded":"2024-08-31T04:20:57.223159+0000","last_fullsized":"2024-08-31T04:20:57.223159+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:32:59.785563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"78'27","reported_seq":81,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:21:11.080152+0000","last_change":"2024-08-31T04:20:39.907452+0000","last_active":"2024-08-31T04:21:11.080152+0000","last_peered":"2024-08-31T04:21:11.080152+0000","last_clean":"2024-08-31T04:21:11.080152+0000","last_became_active":"2024-08-31T04:20:39.907071+0000","last_became_peered":"2024-08-31T04:20:39.907071+0000","last_unstale":"2024-08-31T04:21:11.080152+0000","last_undegraded":"2024-08-31T04:21:11.080152+0000","last_fullsized":"2024-08-31T04:21:11.080152+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_clean_scrub_stamp":"2024-08-31T04:20:38.871450+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:21:33.318332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50110,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":27,"num_read_kb":61,"num_write":29,"num_write_kb":56,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":21,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:20:57.006637+0000","last_change":"2024-08-31T04:20:42.937750+0000","last_active":"2024-08-31T04:20:57.006637+0000","last_peered":"2024-08-31T04:20:57.006637+0000","last_clean":"2024-08-31T04:20:57.006637+0000","last_became_active":"2024-08-31T04:20:42.937386+0000","last_became_peered":"2024-08-31T04:20:42.937386+0000","last_unstale":"2024-08-31T04:20:57.006637+0000","last_undegraded":"2024-08-31T04:20:57.006637+0000","last_fullsized":"2024-08-31T04:20:57.006637+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:14:03.123558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"78'9","reported_seq":38,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:21:02.054531+0000","last_change":"2024-08-31T04:20:39.902815+0000","last_active":"2024-08-31T04:21:02.054531+0000","last_peered":"2024-08-31T04:21:02.054531+0000","last_clean":"2024-08-31T04:21:02.054531+0000","last_became_active":"2024-08-31T04:20:39.900473+0000","last_became_peered":"2024-08-31T04:20:39.900473+0000","last_unstale":"2024-08-31T04:21:02.054531+0000","last_undegraded":"2024-08-31T04:21:02.054531+0000","last_fullsized":"2024-08-31T04:21:02.054531+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_clean_scrub_stamp":"2024-08-31T04:20:38.871450+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:42:03.902102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":21,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:20:56.998214+0000","last_change":"2024-08-31T04:20:42.932333+0000","last_active":"2024-08-31T04:20:56.998214+0000","last_peered":"2024-08-31T04:20:56.998214+0000","last_clean":"2024-08-31T04:20:56.998214+0000","last_became_active":"2024-08-31T04:20:42.931902+0000","last_became_peered":"2024-08-31T04:20:42.931902+0000","last_unstale":"2024-08-31T04:20:56.998214+0000","last_undegraded":"2024-08-31T04:20:56.998214+0000","last_fullsized":"2024-08-31T04:20:56.998214+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:46:44.716941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"78'5","reported_seq":33,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:21:01.048755+0000","last_change":"2024-08-31T04:20:39.901541+0000","last_active":"2024-08-31T04:21:01.048755+0000","last_peered":"2024-08-31T04:21:01.048755+0000","last_clean":"2024-08-31T04:21:01.048755+0000","last_became_active":"2024-08-31T04:20:39.901116+0000","last_became_peered":"2024-08-31T04:20:39.901116+0000","last_unstale":"2024-08-31T04:21:01.048755+0000","last_undegraded":"2024-08-31T04:21:01.048755+0000","last_fullsized":"2024-08-31T04:21:01.048755+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_clean_scrub_stamp":"2024-08-31T04:20:38.871450+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:57:51.458017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":21,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:20:57.003686+0000","last_change":"2024-08-31T04:20:42.936355+0000","last_active":"2024-08-31T04:20:57.003686+0000","last_peered":"2024-08-31T04:20:57.003686+0000","last_clean":"2024-08-31T04:20:57.003686+0000","last_became_active":"2024-08-31T04:20:42.935975+0000","last_became_peered":"2024-08-31T04:20:42.935975+0000","last_unstale":"2024-08-31T04:20:57.003686+0000","last_undegraded":"2024-08-31T04:20:57.003686+0000","last_fullsized":"2024-08-31T04:20:57.003686+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:37:24.867700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"78'6","reported_seq":50,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:21:14.082486+0000","last_change":"2024-08-31T04:20:39.901314+0000","last_active":"2024-08-31T04:21:14.082486+0000","last_peered":"2024-08-31T04:21:14.082486+0000","last_clean":"2024-08-31T04:21:14.082486+0000","last_became_active":"2024-08-31T04:20:39.900780+0000","last_became_peered":"2024-08-31T04:20:39.900780+0000","last_unstale":"2024-08-31T04:21:14.082486+0000","last_undegraded":"2024-08-31T04:21:14.082486+0000","last_fullsized":"2024-08-31T04:21:14.082486+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_clean_scrub_stamp":"2024-08-31T04:20:38.871450+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:59:40.500765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":979,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":18,"num_read_kb":4,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":21,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:20:57.003241+0000","last_change":"2024-08-31T04:20:42.934382+0000","last_active":"2024-08-31T04:20:57.003241+0000","last_peered":"2024-08-31T04:20:57.003241+0000","last_clean":"2024-08-31T04:20:57.003241+0000","last_became_active":"2024-08-31T04:20:42.933986+0000","last_became_peered":"2024-08-31T04:20:42.933986+0000","last_unstale":"2024-08-31T04:20:57.003241+0000","last_undegraded":"2024-08-31T04:20:57.003241+0000","last_fullsized":"2024-08-31T04:20:57.003241+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:12:16.372504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"78'17","reported_seq":45,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:21:01.047381+0000","last_change":"2024-08-31T04:20:39.990817+0000","last_active":"2024-08-31T04:21:01.047381+0000","last_peered":"2024-08-31T04:21:01.047381+0000","last_clean":"2024-08-31T04:21:01.047381+0000","last_became_active":"2024-08-31T04:20:39.990379+0000","last_became_peered":"2024-08-31T04:20:39.990379+0000","last_unstale":"2024-08-31T04:21:01.047381+0000","last_undegraded":"2024-08-31T04:21:01.047381+0000","last_fullsized":"2024-08-31T04:21:01.047381+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_clean_scrub_stamp":"2024-08-31T04:20:38.871450+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:42:27.435142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":21,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:20:56.999443+0000","last_change":"2024-08-31T04:20:42.942430+0000","last_active":"2024-08-31T04:20:56.999443+0000","last_peered":"2024-08-31T04:20:56.999443+0000","last_clean":"2024-08-31T04:20:56.999443+0000","last_became_active":"2024-08-31T04:20:42.942067+0000","last_became_peered":"2024-08-31T04:20:42.942067+0000","last_unstale":"2024-08-31T04:20:56.999443+0000","last_undegraded":"2024-08-31T04:20:56.999443+0000","last_fullsized":"2024-08-31T04:20:56.999443+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:48:52.441499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"77'2","reported_seq":30,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:20:57.007144+0000","last_change":"2024-08-31T04:20:39.903815+0000","last_active":"2024-08-31T04:20:57.007144+0000","last_peered":"2024-08-31T04:20:57.007144+0000","last_clean":"2024-08-31T04:20:57.007144+0000","last_became_active":"2024-08-31T04:20:39.903183+0000","last_became_peered":"2024-08-31T04:20:39.903183+0000","last_unstale":"2024-08-31T04:20:57.007144+0000","last_undegraded":"2024-08-31T04:20:57.007144+0000","last_fullsized":"2024-08-31T04:20:57.007144+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_clean_scrub_stamp":"2024-08-31T04:20:38.871450+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:39:50.862711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":28,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:20:57.004968+0000","last_change":"2024-08-31T04:20:57.004852+0000","last_active":"2024-08-31T04:20:57.004968+0000","last_peered":"2024-08-31T04:20:57.004968+0000","last_clean":"2024-08-31T04:20:57.004968+0000","last_became_active":"2024-08-31T04:20:57.004435+0000","last_became_peered":"2024-08-31T04:20:57.004435+0000","last_unstale":"2024-08-31T04:20:57.004968+0000","last_undegraded":"2024-08-31T04:20:57.004968+0000","last_fullsized":"2024-08-31T04:20:57.004968+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T06:16:19.010305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,6],"acting":[11,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"78'5","reported_seq":32,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:21:01.047330+0000","last_change":"2024-08-31T04:20:39.901493+0000","last_active":"2024-08-31T04:21:01.047330+0000","last_peered":"2024-08-31T04:21:01.047330+0000","last_clean":"2024-08-31T04:21:01.047330+0000","last_became_active":"2024-08-31T04:20:39.901072+0000","last_became_peered":"2024-08-31T04:20:39.901072+0000","last_unstale":"2024-08-31T04:21:01.047330+0000","last_undegraded":"2024-08-31T04:21:01.047330+0000","last_fullsized":"2024-08-31T04:21:01.047330+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_clean_scrub_stamp":"2024-08-31T04:20:38.871450+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:26:43.893882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":21,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:20:57.004118+0000","last_change":"2024-08-31T04:20:42.938270+0000","last_active":"2024-08-31T04:20:57.004118+0000","last_peered":"2024-08-31T04:20:57.004118+0000","last_clean":"2024-08-31T04:20:57.004118+0000","last_became_active":"2024-08-31T04:20:42.937851+0000","last_became_peered":"2024-08-31T04:20:42.937851+0000","last_unstale":"2024-08-31T04:20:57.004118+0000","last_undegraded":"2024-08-31T04:20:57.004118+0000","last_fullsized":"2024-08-31T04:20:57.004118+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:29:09.315106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"78'3","reported_seq":31,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:21:01.049001+0000","last_change":"2024-08-31T04:20:39.905785+0000","last_active":"2024-08-31T04:21:01.049001+0000","last_peered":"2024-08-31T04:21:01.049001+0000","last_clean":"2024-08-31T04:21:01.049001+0000","last_became_active":"2024-08-31T04:20:39.905403+0000","last_became_peered":"2024-08-31T04:20:39.905403+0000","last_unstale":"2024-08-31T04:21:01.049001+0000","last_undegraded":"2024-08-31T04:21:01.049001+0000","last_fullsized":"2024-08-31T04:21:01.049001+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_clean_scrub_stamp":"2024-08-31T04:20:38.871450+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:48:04.743543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"78'1","reported_seq":22,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:20:57.003984+0000","last_change":"2024-08-31T04:20:42.934433+0000","last_active":"2024-08-31T04:20:57.003984+0000","last_peered":"2024-08-31T04:20:57.003984+0000","last_clean":"2024-08-31T04:20:57.003984+0000","last_became_active":"2024-08-31T04:20:42.934058+0000","last_became_peered":"2024-08-31T04:20:42.934058+0000","last_unstale":"2024-08-31T04:20:57.003984+0000","last_undegraded":"2024-08-31T04:20:57.003984+0000","last_fullsized":"2024-08-31T04:20:57.003984+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:34:42.988905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"78'6","reported_seq":46,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:21:10.072061+0000","last_change":"2024-08-31T04:20:40.202403+0000","last_active":"2024-08-31T04:21:10.072061+0000","last_peered":"2024-08-31T04:21:10.072061+0000","last_clean":"2024-08-31T04:21:10.072061+0000","last_became_active":"2024-08-31T04:20:40.201918+0000","last_became_peered":"2024-08-31T04:20:40.201918+0000","last_unstale":"2024-08-31T04:21:10.072061+0000","last_undegraded":"2024-08-31T04:21:10.072061+0000","last_fullsized":"2024-08-31T04:21:10.072061+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_clean_scrub_stamp":"2024-08-31T04:20:38.871450+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:31:26.675413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1561,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":13,"num_read_kb":3,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":21,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:20:57.004028+0000","last_change":"2024-08-31T04:20:42.931040+0000","last_active":"2024-08-31T04:20:57.004028+0000","last_peered":"2024-08-31T04:20:57.004028+0000","last_clean":"2024-08-31T04:20:57.004028+0000","last_became_active":"2024-08-31T04:20:42.930692+0000","last_became_peered":"2024-08-31T04:20:42.930692+0000","last_unstale":"2024-08-31T04:20:57.004028+0000","last_undegraded":"2024-08-31T04:20:57.004028+0000","last_fullsized":"2024-08-31T04:20:57.004028+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T06:12:23.175092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"20'92","reported_seq":98,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:20:57.003457+0000","last_change":"2024-08-31T04:19:21.361791+0000","last_active":"2024-08-31T04:20:57.003457+0000","last_peered":"2024-08-31T04:20:57.003457+0000","last_clean":"2024-08-31T04:20:57.003457+0000","last_became_active":"2024-08-31T04:19:21.356128+0000","last_became_peered":"2024-08-31T04:19:21.356128+0000","last_unstale":"2024-08-31T04:20:57.003457+0000","last_undegraded":"2024-08-31T04:20:57.003457+0000","last_fullsized":"2024-08-31T04:20:57.003457+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:15:46.442365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:15:46.442365+0000","last_clean_scrub_stamp":"2024-08-31T04:15:46.442365+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:23:05.688680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"78'6","reported_seq":36,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:21:02.053432+0000","last_change":"2024-08-31T04:20:39.904625+0000","last_active":"2024-08-31T04:21:02.053432+0000","last_peered":"2024-08-31T04:21:02.053432+0000","last_clean":"2024-08-31T04:21:02.053432+0000","last_became_active":"2024-08-31T04:20:39.904245+0000","last_became_peered":"2024-08-31T04:20:39.904245+0000","last_unstale":"2024-08-31T04:21:02.053432+0000","last_undegraded":"2024-08-31T04:21:02.053432+0000","last_fullsized":"2024-08-31T04:21:02.053432+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_clean_scrub_stamp":"2024-08-31T04:20:38.871450+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:31:34.711047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":21,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:20:57.338391+0000","last_change":"2024-08-31T04:20:42.944224+0000","last_active":"2024-08-31T04:20:57.338391+0000","last_peered":"2024-08-31T04:20:57.338391+0000","last_clean":"2024-08-31T04:20:57.338391+0000","last_became_active":"2024-08-31T04:20:42.943469+0000","last_became_peered":"2024-08-31T04:20:42.943469+0000","last_unstale":"2024-08-31T04:20:57.338391+0000","last_undegraded":"2024-08-31T04:20:57.338391+0000","last_fullsized":"2024-08-31T04:20:57.338391+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:27:48.533319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"78'4","reported_seq":31,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:20:57.003498+0000","last_change":"2024-08-31T04:20:39.902613+0000","last_active":"2024-08-31T04:20:57.003498+0000","last_peered":"2024-08-31T04:20:57.003498+0000","last_clean":"2024-08-31T04:20:57.003498+0000","last_became_active":"2024-08-31T04:20:39.902033+0000","last_became_peered":"2024-08-31T04:20:39.902033+0000","last_unstale":"2024-08-31T04:20:57.003498+0000","last_undegraded":"2024-08-31T04:20:57.003498+0000","last_fullsized":"2024-08-31T04:20:57.003498+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_clean_scrub_stamp":"2024-08-31T04:20:38.871450+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:13:58.497781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":21,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:20:56.998151+0000","last_change":"2024-08-31T04:20:42.933541+0000","last_active":"2024-08-31T04:20:56.998151+0000","last_peered":"2024-08-31T04:20:56.998151+0000","last_clean":"2024-08-31T04:20:56.998151+0000","last_became_active":"2024-08-31T04:20:42.933155+0000","last_became_peered":"2024-08-31T04:20:42.933155+0000","last_unstale":"2024-08-31T04:20:56.998151+0000","last_undegraded":"2024-08-31T04:20:56.998151+0000","last_fullsized":"2024-08-31T04:20:56.998151+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:22:41.298103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"78'5","reported_seq":46,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:21:13.079492+0000","last_change":"2024-08-31T04:20:39.992067+0000","last_active":"2024-08-31T04:21:13.079492+0000","last_peered":"2024-08-31T04:21:13.079492+0000","last_clean":"2024-08-31T04:21:13.079492+0000","last_became_active":"2024-08-31T04:20:39.991645+0000","last_became_peered":"2024-08-31T04:20:39.991645+0000","last_unstale":"2024-08-31T04:21:13.079492+0000","last_undegraded":"2024-08-31T04:21:13.079492+0000","last_fullsized":"2024-08-31T04:21:13.079492+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_clean_scrub_stamp":"2024-08-31T04:20:38.871450+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:41:18.012094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":21,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:20:56.999491+0000","last_change":"2024-08-31T04:20:42.937324+0000","last_active":"2024-08-31T04:20:56.999491+0000","last_peered":"2024-08-31T04:20:56.999491+0000","last_clean":"2024-08-31T04:20:56.999491+0000","last_became_active":"2024-08-31T04:20:42.936926+0000","last_became_peered":"2024-08-31T04:20:42.936926+0000","last_unstale":"2024-08-31T04:20:56.999491+0000","last_undegraded":"2024-08-31T04:20:56.999491+0000","last_fullsized":"2024-08-31T04:20:56.999491+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:34:57.158304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"78'5","reported_seq":47,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:21:14.082476+0000","last_change":"2024-08-31T04:20:39.905365+0000","last_active":"2024-08-31T04:21:14.082476+0000","last_peered":"2024-08-31T04:21:14.082476+0000","last_clean":"2024-08-31T04:21:14.082476+0000","last_became_active":"2024-08-31T04:20:39.904772+0000","last_became_peered":"2024-08-31T04:20:39.904772+0000","last_unstale":"2024-08-31T04:21:14.082476+0000","last_undegraded":"2024-08-31T04:21:14.082476+0000","last_fullsized":"2024-08-31T04:21:14.082476+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_clean_scrub_stamp":"2024-08-31T04:20:38.871450+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T05:20:23.781639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":15,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":21,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:20:57.001600+0000","last_change":"2024-08-31T04:20:42.944303+0000","last_active":"2024-08-31T04:20:57.001600+0000","last_peered":"2024-08-31T04:20:57.001600+0000","last_clean":"2024-08-31T04:20:57.001600+0000","last_became_active":"2024-08-31T04:20:42.943938+0000","last_became_peered":"2024-08-31T04:20:42.943938+0000","last_unstale":"2024-08-31T04:20:57.001600+0000","last_undegraded":"2024-08-31T04:20:57.001600+0000","last_fullsized":"2024-08-31T04:20:57.001600+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T06:51:28.734751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"77'1","reported_seq":28,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:20:57.004633+0000","last_change":"2024-08-31T04:20:39.993135+0000","last_active":"2024-08-31T04:20:57.004633+0000","last_peered":"2024-08-31T04:20:57.004633+0000","last_clean":"2024-08-31T04:20:57.004633+0000","last_became_active":"2024-08-31T04:20:39.991569+0000","last_became_peered":"2024-08-31T04:20:39.991569+0000","last_unstale":"2024-08-31T04:20:57.004633+0000","last_undegraded":"2024-08-31T04:20:57.004633+0000","last_fullsized":"2024-08-31T04:20:57.004633+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_clean_scrub_stamp":"2024-08-31T04:20:38.871450+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:44:04.375810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"78'1","reported_seq":22,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:20:57.002559+0000","last_change":"2024-08-31T04:20:42.939721+0000","last_active":"2024-08-31T04:20:57.002559+0000","last_peered":"2024-08-31T04:20:57.002559+0000","last_clean":"2024-08-31T04:20:57.002559+0000","last_became_active":"2024-08-31T04:20:42.939380+0000","last_became_peered":"2024-08-31T04:20:42.939380+0000","last_unstale":"2024-08-31T04:20:57.002559+0000","last_undegraded":"2024-08-31T04:20:57.002559+0000","last_fullsized":"2024-08-31T04:20:57.002559+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:55:06.901719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"78'4","reported_seq":32,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:21:01.047625+0000","last_change":"2024-08-31T04:20:39.990968+0000","last_active":"2024-08-31T04:21:01.047625+0000","last_peered":"2024-08-31T04:21:01.047625+0000","last_clean":"2024-08-31T04:21:01.047625+0000","last_became_active":"2024-08-31T04:20:39.990583+0000","last_became_peered":"2024-08-31T04:20:39.990583+0000","last_unstale":"2024-08-31T04:21:01.047625+0000","last_undegraded":"2024-08-31T04:21:01.047625+0000","last_fullsized":"2024-08-31T04:21:01.047625+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_clean_scrub_stamp":"2024-08-31T04:20:38.871450+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:54:39.168179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":21,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:20:56.998550+0000","last_change":"2024-08-31T04:20:42.932914+0000","last_active":"2024-08-31T04:20:56.998550+0000","last_peered":"2024-08-31T04:20:56.998550+0000","last_clean":"2024-08-31T04:20:56.998550+0000","last_became_active":"2024-08-31T04:20:42.932523+0000","last_became_peered":"2024-08-31T04:20:42.932523+0000","last_unstale":"2024-08-31T04:20:56.998550+0000","last_undegraded":"2024-08-31T04:20:56.998550+0000","last_fullsized":"2024-08-31T04:20:56.998550+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:52:49.133428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"78'15","reported_seq":42,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:21:12.952412+0000","last_change":"2024-08-31T04:20:39.903373+0000","last_active":"2024-08-31T04:21:12.952412+0000","last_peered":"2024-08-31T04:21:12.952412+0000","last_clean":"2024-08-31T04:21:12.952412+0000","last_became_active":"2024-08-31T04:20:39.902784+0000","last_became_peered":"2024-08-31T04:20:39.902784+0000","last_unstale":"2024-08-31T04:21:12.952412+0000","last_undegraded":"2024-08-31T04:21:12.952412+0000","last_fullsized":"2024-08-31T04:21:12.952412+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_clean_scrub_stamp":"2024-08-31T04:20:38.871450+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:43:32.251846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":21,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:20:57.338679+0000","last_change":"2024-08-31T04:20:42.939252+0000","last_active":"2024-08-31T04:20:57.338679+0000","last_peered":"2024-08-31T04:20:57.338679+0000","last_clean":"2024-08-31T04:20:57.338679+0000","last_became_active":"2024-08-31T04:20:42.936671+0000","last_became_peered":"2024-08-31T04:20:42.936671+0000","last_unstale":"2024-08-31T04:20:57.338679+0000","last_undegraded":"2024-08-31T04:20:57.338679+0000","last_fullsized":"2024-08-31T04:20:57.338679+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:37:57.544627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"78'7","reported_seq":35,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:21:01.049714+0000","last_change":"2024-08-31T04:20:40.202412+0000","last_active":"2024-08-31T04:21:01.049714+0000","last_peered":"2024-08-31T04:21:01.049714+0000","last_clean":"2024-08-31T04:21:01.049714+0000","last_became_active":"2024-08-31T04:20:40.202000+0000","last_became_peered":"2024-08-31T04:20:40.202000+0000","last_unstale":"2024-08-31T04:21:01.049714+0000","last_undegraded":"2024-08-31T04:21:01.049714+0000","last_fullsized":"2024-08-31T04:21:01.049714+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_clean_scrub_stamp":"2024-08-31T04:20:38.871450+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:24:23.528379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":21,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:20:57.001587+0000","last_change":"2024-08-31T04:20:42.949174+0000","last_active":"2024-08-31T04:20:57.001587+0000","last_peered":"2024-08-31T04:20:57.001587+0000","last_clean":"2024-08-31T04:20:57.001587+0000","last_became_active":"2024-08-31T04:20:42.948013+0000","last_became_peered":"2024-08-31T04:20:42.948013+0000","last_unstale":"2024-08-31T04:20:57.001587+0000","last_undegraded":"2024-08-31T04:20:57.001587+0000","last_fullsized":"2024-08-31T04:20:57.001587+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:36:00.572991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"76'2","reported_seq":29,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:20:57.223195+0000","last_change":"2024-08-31T04:20:39.992477+0000","last_active":"2024-08-31T04:20:57.223195+0000","last_peered":"2024-08-31T04:20:57.223195+0000","last_clean":"2024-08-31T04:20:57.223195+0000","last_became_active":"2024-08-31T04:20:39.992082+0000","last_became_peered":"2024-08-31T04:20:39.992082+0000","last_unstale":"2024-08-31T04:20:57.223195+0000","last_undegraded":"2024-08-31T04:20:57.223195+0000","last_fullsized":"2024-08-31T04:20:57.223195+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_clean_scrub_stamp":"2024-08-31T04:20:38.871450+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:10:35.058693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":21,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:20:57.005828+0000","last_change":"2024-08-31T04:20:42.933915+0000","last_active":"2024-08-31T04:20:57.005828+0000","last_peered":"2024-08-31T04:20:57.005828+0000","last_clean":"2024-08-31T04:20:57.005828+0000","last_became_active":"2024-08-31T04:20:42.933525+0000","last_became_peered":"2024-08-31T04:20:42.933525+0000","last_unstale":"2024-08-31T04:20:57.005828+0000","last_undegraded":"2024-08-31T04:20:57.005828+0000","last_fullsized":"2024-08-31T04:20:57.005828+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:03:35.191136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"78'7","reported_seq":34,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:21:01.047578+0000","last_change":"2024-08-31T04:20:39.903979+0000","last_active":"2024-08-31T04:21:01.047578+0000","last_peered":"2024-08-31T04:21:01.047578+0000","last_clean":"2024-08-31T04:21:01.047578+0000","last_became_active":"2024-08-31T04:20:39.903538+0000","last_became_peered":"2024-08-31T04:20:39.903538+0000","last_unstale":"2024-08-31T04:21:01.047578+0000","last_undegraded":"2024-08-31T04:21:01.047578+0000","last_fullsized":"2024-08-31T04:21:01.047578+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_clean_scrub_stamp":"2024-08-31T04:20:38.871450+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:25:15.944692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":21,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:20:57.001683+0000","last_change":"2024-08-31T04:20:42.947511+0000","last_active":"2024-08-31T04:20:57.001683+0000","last_peered":"2024-08-31T04:20:57.001683+0000","last_clean":"2024-08-31T04:20:57.001683+0000","last_became_active":"2024-08-31T04:20:42.947116+0000","last_became_peered":"2024-08-31T04:20:42.947116+0000","last_unstale":"2024-08-31T04:20:57.001683+0000","last_undegraded":"2024-08-31T04:20:57.001683+0000","last_fullsized":"2024-08-31T04:20:57.001683+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:00:53.022229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"78'3","reported_seq":30,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:20:57.004076+0000","last_change":"2024-08-31T04:20:39.903409+0000","last_active":"2024-08-31T04:20:57.004076+0000","last_peered":"2024-08-31T04:20:57.004076+0000","last_clean":"2024-08-31T04:20:57.004076+0000","last_became_active":"2024-08-31T04:20:39.900366+0000","last_became_peered":"2024-08-31T04:20:39.900366+0000","last_unstale":"2024-08-31T04:20:57.004076+0000","last_undegraded":"2024-08-31T04:20:57.004076+0000","last_fullsized":"2024-08-31T04:20:57.004076+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_clean_scrub_stamp":"2024-08-31T04:20:38.871450+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:01:24.809923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":21,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:20:57.338464+0000","last_change":"2024-08-31T04:20:42.953207+0000","last_active":"2024-08-31T04:20:57.338464+0000","last_peered":"2024-08-31T04:20:57.338464+0000","last_clean":"2024-08-31T04:20:57.338464+0000","last_became_active":"2024-08-31T04:20:42.952854+0000","last_became_peered":"2024-08-31T04:20:42.952854+0000","last_unstale":"2024-08-31T04:20:57.338464+0000","last_undegraded":"2024-08-31T04:20:57.338464+0000","last_fullsized":"2024-08-31T04:20:57.338464+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:33:11.495216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"76'4","reported_seq":21,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:21:00.180014+0000","last_change":"2024-08-31T04:20:57.016087+0000","last_active":"2024-08-31T04:21:00.180014+0000","last_peered":"2024-08-31T04:21:00.180014+0000","last_clean":"2024-08-31T04:21:00.180014+0000","last_became_active":"2024-08-31T04:20:57.005476+0000","last_became_peered":"2024-08-31T04:20:57.005476+0000","last_unstale":"2024-08-31T04:21:00.180014+0000","last_undegraded":"2024-08-31T04:21:00.180014+0000","last_fullsized":"2024-08-31T04:21:00.180014+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_clean_scrub_stamp":"2024-08-31T04:20:38.871450+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:22:21.768548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,7],"acting":[11,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":21,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:20:57.003500+0000","last_change":"2024-08-31T04:20:42.933249+0000","last_active":"2024-08-31T04:20:57.003500+0000","last_peered":"2024-08-31T04:20:57.003500+0000","last_clean":"2024-08-31T04:20:57.003500+0000","last_became_active":"2024-08-31T04:20:42.931651+0000","last_became_peered":"2024-08-31T04:20:42.931651+0000","last_unstale":"2024-08-31T04:20:57.003500+0000","last_undegraded":"2024-08-31T04:20:57.003500+0000","last_fullsized":"2024-08-31T04:20:57.003500+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T06:40:21.010108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":21,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:20:57.000156+0000","last_change":"2024-08-31T04:20:42.942418+0000","last_active":"2024-08-31T04:20:57.000156+0000","last_peered":"2024-08-31T04:20:57.000156+0000","last_clean":"2024-08-31T04:20:57.000156+0000","last_became_active":"2024-08-31T04:20:42.942072+0000","last_became_peered":"2024-08-31T04:20:42.942072+0000","last_unstale":"2024-08-31T04:20:57.000156+0000","last_undegraded":"2024-08-31T04:20:57.000156+0000","last_fullsized":"2024-08-31T04:20:57.000156+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T04:41:38.816730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"78'5","reported_seq":33,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:21:01.049947+0000","last_change":"2024-08-31T04:20:39.903399+0000","last_active":"2024-08-31T04:21:01.049947+0000","last_peered":"2024-08-31T04:21:01.049947+0000","last_clean":"2024-08-31T04:21:01.049947+0000","last_became_active":"2024-08-31T04:20:39.902732+0000","last_became_peered":"2024-08-31T04:20:39.902732+0000","last_unstale":"2024-08-31T04:21:01.049947+0000","last_undegraded":"2024-08-31T04:21:01.049947+0000","last_fullsized":"2024-08-31T04:21:01.049947+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_clean_scrub_stamp":"2024-08-31T04:20:38.871450+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:07:25.324109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":21,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:20:57.223222+0000","last_change":"2024-08-31T04:20:42.931570+0000","last_active":"2024-08-31T04:20:57.223222+0000","last_peered":"2024-08-31T04:20:57.223222+0000","last_clean":"2024-08-31T04:20:57.223222+0000","last_became_active":"2024-08-31T04:20:42.931162+0000","last_became_peered":"2024-08-31T04:20:42.931162+0000","last_unstale":"2024-08-31T04:20:57.223222+0000","last_undegraded":"2024-08-31T04:20:57.223222+0000","last_fullsized":"2024-08-31T04:20:57.223222+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:55:58.784723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"78'12","reported_seq":27,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:21:02.054140+0000","last_change":"2024-08-31T04:20:57.020014+0000","last_active":"2024-08-31T04:21:02.054140+0000","last_peered":"2024-08-31T04:21:02.054140+0000","last_clean":"2024-08-31T04:21:02.054140+0000","last_became_active":"2024-08-31T04:20:57.009489+0000","last_became_peered":"2024-08-31T04:20:57.009489+0000","last_unstale":"2024-08-31T04:21:02.054140+0000","last_undegraded":"2024-08-31T04:21:02.054140+0000","last_fullsized":"2024-08-31T04:21:02.054140+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_clean_scrub_stamp":"2024-08-31T04:20:38.871450+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T05:22:57.227296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":10,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,7],"acting":[11,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":21,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:20:57.001803+0000","last_change":"2024-08-31T04:20:42.947868+0000","last_active":"2024-08-31T04:20:57.001803+0000","last_peered":"2024-08-31T04:20:57.001803+0000","last_clean":"2024-08-31T04:20:57.001803+0000","last_became_active":"2024-08-31T04:20:42.946628+0000","last_became_peered":"2024-08-31T04:20:42.946628+0000","last_unstale":"2024-08-31T04:20:57.001803+0000","last_undegraded":"2024-08-31T04:20:57.001803+0000","last_fullsized":"2024-08-31T04:20:57.001803+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:47:10.939205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"76'2","reported_seq":29,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:20:57.338782+0000","last_change":"2024-08-31T04:20:39.991234+0000","last_active":"2024-08-31T04:20:57.338782+0000","last_peered":"2024-08-31T04:20:57.338782+0000","last_clean":"2024-08-31T04:20:57.338782+0000","last_became_active":"2024-08-31T04:20:39.990416+0000","last_became_peered":"2024-08-31T04:20:39.990416+0000","last_unstale":"2024-08-31T04:20:57.338782+0000","last_undegraded":"2024-08-31T04:20:57.338782+0000","last_fullsized":"2024-08-31T04:20:57.338782+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_clean_scrub_stamp":"2024-08-31T04:20:38.871450+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:47:43.392522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":21,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:20:57.338520+0000","last_change":"2024-08-31T04:20:42.942017+0000","last_active":"2024-08-31T04:20:57.338520+0000","last_peered":"2024-08-31T04:20:57.338520+0000","last_clean":"2024-08-31T04:20:57.338520+0000","last_became_active":"2024-08-31T04:20:42.939661+0000","last_became_peered":"2024-08-31T04:20:42.939661+0000","last_unstale":"2024-08-31T04:20:57.338520+0000","last_undegraded":"2024-08-31T04:20:57.338520+0000","last_fullsized":"2024-08-31T04:20:57.338520+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:13:39.521066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"78'13","reported_seq":55,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:21:14.081718+0000","last_change":"2024-08-31T04:20:39.905996+0000","last_active":"2024-08-31T04:21:14.081718+0000","last_peered":"2024-08-31T04:21:14.081718+0000","last_clean":"2024-08-31T04:21:14.081718+0000","last_became_active":"2024-08-31T04:20:39.905622+0000","last_became_peered":"2024-08-31T04:20:39.905622+0000","last_unstale":"2024-08-31T04:21:14.081718+0000","last_undegraded":"2024-08-31T04:21:14.081718+0000","last_fullsized":"2024-08-31T04:21:14.081718+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_clean_scrub_stamp":"2024-08-31T04:20:38.871450+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:53:36.672295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":57705,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":159,"num_read_kb":141,"num_write":241,"num_write_kb":123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":622,"num_keys_recovered":10,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":540672,"data_stored":173115,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":207,"ondisk_log_size":207,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":245760,"data_stored":2951840,"data_compressed":181705,"data_compressed_allocated":225280,"data_compressed_original":2949120,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":68,"seq":292057776148,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32012,"kb_used_data":828,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713140,"statfs":{"total":95995035648,"available":95962255360,"internally_reserved":0,"allocated":847872,"data_stored":413656,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":63,"seq":270582939671,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27984,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717168,"statfs":{"total":95995035648,"available":95966380032,"internally_reserved":0,"allocated":983040,"data_stored":1045748,"data_compressed":36341,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":58,"seq":249108103199,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36196,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708956,"statfs":{"total":95995035648,"available":95957970944,"internally_reserved":0,"allocated":872448,"data_stored":413195,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,5,6,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":52,"seq":223338299427,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27872,"kb_used_data":848,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717280,"statfs":{"total":95995035648,"available":95966494720,"internally_reserved":0,"allocated":868352,"data_stored":413573,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":47,"seq":201863462954,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27924,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717228,"statfs":{"total":95995035648,"available":95966441472,"internally_reserved":0,"allocated":921600,"data_stored":1006482,"data_compressed":36341,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":42,"seq":180388626478,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32020,"kb_used_data":836,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713132,"statfs":{"total":95995035648,"available":95962247168,"internally_reserved":0,"allocated":856064,"data_stored":412912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":36,"seq":154618822709,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27936,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717216,"statfs":{"total":95995035648,"available":95966429184,"internally_reserved":0,"allocated":933888,"data_stored":1005769,"data_compressed":36341,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986233,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27860,"kb_used_data":836,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717292,"statfs":{"total":95995035648,"available":95966507008,"internally_reserved":0,"allocated":856064,"data_stored":413164,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182461,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36196,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708956,"statfs":{"total":95995035648,"available":95957970944,"internally_reserved":0,"allocated":872448,"data_stored":412737,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411396,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27924,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717228,"statfs":{"total":95995035648,"available":95966441472,"internally_reserved":0,"allocated":921600,"data_stored":463924,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574921,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27920,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717232,"statfs":{"total":95995035648,"available":95966445568,"internally_reserved":0,"allocated":917504,"data_stored":464948,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738444,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27880,"kb_used_data":856,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717272,"statfs":{"total":95995035648,"available":95966486528,"internally_reserved":0,"allocated":876544,"data_stored":414642,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36341,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36341,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36341,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36341,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36341,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2569,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":52875,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":51851,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1091,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3211,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3924,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":52237,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1583,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-31T04:21:17.602 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 058d9fc6-674f-11ef-bcd4-c7b262605968 -- ceph pg dump --format=json 2024-08-31T04:21:17.983 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:21:18.342 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:21:18 smithi050 ceph-mon[17259]: from='client.24820 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-31T04:21:18.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:21:18 smithi177 ceph-mon[22025]: from='client.24820 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-31T04:21:18.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:21:18 smithi133 ceph-mon[22177]: from='client.24820 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-31T04:21:18.668 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:18.665+0000 7f4805600640 1 -- 172.21.15.50:0/795188189 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4800109b90 msgr2=0x7f48001103c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:21:18.668 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:18.665+0000 7f4805600640 1 --2- 172.21.15.50:0/795188189 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4800109b90 0x7f48001103c0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f47f8009ca0 tx=0x7f47f802a8c0 comp rx=0 tx=0).stop 2024-08-31T04:21:18.668 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:18.665+0000 7f4805600640 1 -- 172.21.15.50:0/795188189 shutdown_connections 2024-08-31T04:21:18.668 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:18.665+0000 7f4805600640 1 --2- 172.21.15.50:0/795188189 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4800109b90 0x7f48001103c0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:18.668 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:18.665+0000 7f4805600640 1 --2- 172.21.15.50:0/795188189 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4800109240 0x7f4800109650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:18.668 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:18.665+0000 7f4805600640 1 --2- 172.21.15.50:0/795188189 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4800103900 0x7f4800103d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:18.668 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:18.665+0000 7f4805600640 1 -- 172.21.15.50:0/795188189 >> 172.21.15.50:0/795188189 conn(0x7f480007b5f0 msgr2=0x7f480007ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:21:18.669 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:18.665+0000 7f4805600640 1 -- 172.21.15.50:0/795188189 shutdown_connections 2024-08-31T04:21:18.669 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:18.665+0000 7f4805600640 1 -- 172.21.15.50:0/795188189 wait complete. 2024-08-31T04:21:18.670 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:18.666+0000 7f4805600640 1 Processor -- start 2024-08-31T04:21:18.670 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:18.667+0000 7f4805600640 1 -- start start 2024-08-31T04:21:18.670 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:18.667+0000 7f4805600640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4800103900 0x7f480019c3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:21:18.670 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:18.667+0000 7f4805600640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4800109240 0x7f480019c990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:21:18.670 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:18.667+0000 7f4805600640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4800109b90 0x7f48001a1c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:21:18.670 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:18.667+0000 7f4805600640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f48001138a0 con 0x7f4800109240 2024-08-31T04:21:18.671 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:18.667+0000 7f4805600640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f4800113720 con 0x7f4800109b90 2024-08-31T04:21:18.671 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:18.667+0000 7f4805600640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f4800113a20 con 0x7f4800103900 2024-08-31T04:21:18.671 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:18.667+0000 7f47f6000640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4800109240 0x7f480019c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:21:18.671 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:18.667+0000 7f47fea00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4800103900 0x7f480019c3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:21:18.671 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:18.667+0000 7f47f6000640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4800109240 0x7f480019c990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:37756/0 (socket says 172.21.15.50:37756) 2024-08-31T04:21:18.671 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:18.667+0000 7f47f6000640 1 -- 172.21.15.50:0/4197433055 learned_addr learned my addr 172.21.15.50:0/4197433055 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:21:18.671 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:18.667+0000 7f47ff400640 1 --2- 172.21.15.50:0/4197433055 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4800109b90 0x7f48001a1c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:21:18.671 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:18.668+0000 7f47fea00640 1 -- 172.21.15.50:0/4197433055 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4800109b90 msgr2=0x7f48001a1c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:21:18.671 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:18.668+0000 7f47fea00640 1 --2- 172.21.15.50:0/4197433055 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4800109b90 0x7f48001a1c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:18.671 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:18.668+0000 7f47fea00640 1 -- 172.21.15.50:0/4197433055 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4800109240 msgr2=0x7f480019c990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:21:18.671 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:18.668+0000 7f47fea00640 1 --2- 172.21.15.50:0/4197433055 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4800109240 0x7f480019c990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:18.671 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:18.668+0000 7f47fea00640 1 -- 172.21.15.50:0/4197433055 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48001a2360 con 0x7f4800103900 2024-08-31T04:21:18.671 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:18.668+0000 7f47f6000640 1 --2- 172.21.15.50:0/4197433055 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4800109240 0x7f480019c990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:21:18.673 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:18.668+0000 7f47fea00640 1 --2- 172.21.15.50:0/4197433055 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4800103900 0x7f480019c3f0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f47f000e9f0 tx=0x7f47f000eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:21:18.673 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:18.668+0000 7f47f7e00640 1 -- 172.21.15.50:0/4197433055 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47f000ccc0 con 0x7f4800103900 2024-08-31T04:21:18.673 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:18.668+0000 7f47f7e00640 1 -- 172.21.15.50:0/4197433055 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f47f00108e0 con 0x7f4800103900 2024-08-31T04:21:18.673 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:18.668+0000 7f47f7e00640 1 -- 172.21.15.50:0/4197433055 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47f0018880 con 0x7f4800103900 2024-08-31T04:21:18.673 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:18.669+0000 7f4805600640 1 -- 172.21.15.50:0/4197433055 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f48001a2650 con 0x7f4800103900 2024-08-31T04:21:18.673 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:18.669+0000 7f4805600640 1 -- 172.21.15.50:0/4197433055 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f48001a8db0 con 0x7f4800103900 2024-08-31T04:21:18.673 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:18.670+0000 7f4805600640 1 -- 172.21.15.50:0/4197433055 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4800103d10 con 0x7f4800103900 2024-08-31T04:21:18.674 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:18.672+0000 7f47f7e00640 1 -- 172.21.15.50:0/4197433055 <== mon.1 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 17) ==== 152628+0+0 (secure 0 0 0) 0x7f47f0010430 con 0x7f4800103900 2024-08-31T04:21:18.676 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:18.674+0000 7f47f7e00640 1 --2- 172.21.15.50:0/4197433055 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f47e40b4c40 0x7f47e40b7150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:21:18.676 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:18.674+0000 7f47f7e00640 1 -- 172.21.15.50:0/4197433055 <== mon.1 v2:172.21.15.177:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8219+0+0 (secure 0 0 0) 0x7f47f00e5a70 con 0x7f4800103900 2024-08-31T04:21:18.676 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:18.674+0000 7f47f6000640 1 --2- 172.21.15.50:0/4197433055 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f47e40b4c40 0x7f47e40b7150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:21:18.677 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:18.674+0000 7f47f6000640 1 --2- 172.21.15.50:0/4197433055 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f47e40b4c40 0x7f47e40b7150 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f4800106110 tx=0x7f47e8005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:21:18.677 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:18.675+0000 7f47f7e00640 1 -- 172.21.15.50:0/4197433055 <== mon.1 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f47f00ac3a0 con 0x7f4800103900 2024-08-31T04:21:18.867 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:18.865+0000 7f4805600640 1 -- 172.21.15.50:0/4197433055 --> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f4800107760 con 0x7f47e40b4c40 2024-08-31T04:21:18.872 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:18.870+0000 7f47f7e00640 1 -- 172.21.15.50:0/4197433055 <== mgr.14150 v2:172.21.15.50:6800/2146686622 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258852 (secure 0 0 0) 0x7f4800107760 con 0x7f47e40b4c40 2024-08-31T04:21:18.876 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-08-31T04:21:18.877 INFO:teuthology.orchestra.run.smithi050.stderr:dumped all 2024-08-31T04:21:18.879 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:18.874+0000 7f4805600640 1 -- 172.21.15.50:0/4197433055 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f47e40b4c40 msgr2=0x7f47e40b7150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:21:18.879 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:18.874+0000 7f4805600640 1 --2- 172.21.15.50:0/4197433055 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f47e40b4c40 0x7f47e40b7150 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f4800106110 tx=0x7f47e8005f90 comp rx=0 tx=0).stop 2024-08-31T04:21:18.879 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:18.874+0000 7f4805600640 1 -- 172.21.15.50:0/4197433055 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4800103900 msgr2=0x7f480019c3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:21:18.879 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:18.874+0000 7f4805600640 1 --2- 172.21.15.50:0/4197433055 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4800103900 0x7f480019c3f0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f47f000e9f0 tx=0x7f47f000eeb0 comp rx=0 tx=0).stop 2024-08-31T04:21:18.879 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:18.874+0000 7f4805600640 1 -- 172.21.15.50:0/4197433055 shutdown_connections 2024-08-31T04:21:18.879 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:18.874+0000 7f4805600640 1 --2- 172.21.15.50:0/4197433055 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f47e40b4c40 0x7f47e40b7150 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:18.879 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:18.874+0000 7f4805600640 1 --2- 172.21.15.50:0/4197433055 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4800109b90 0x7f48001a1c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:18.879 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:18.874+0000 7f4805600640 1 --2- 172.21.15.50:0/4197433055 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4800109240 0x7f480019c990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:18.879 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:18.874+0000 7f4805600640 1 --2- 172.21.15.50:0/4197433055 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4800103900 0x7f480019c3f0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:18.879 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:18.874+0000 7f4805600640 1 -- 172.21.15.50:0/4197433055 >> 172.21.15.50:0/4197433055 conn(0x7f480007b5f0 msgr2=0x7f4800107050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:21:18.880 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:18.874+0000 7f4805600640 1 -- 172.21.15.50:0/4197433055 shutdown_connections 2024-08-31T04:21:18.880 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:18.876+0000 7f4805600640 1 -- 172.21.15.50:0/4197433055 wait complete. 2024-08-31T04:21:19.200 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:21:19 smithi050 ceph-mon[17259]: pgmap v319: 97 pgs: 97 active+clean; 637 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 5.3 KiB/s wr, 14 op/s 2024-08-31T04:21:19.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:21:19 smithi177 ceph-mon[22025]: pgmap v319: 97 pgs: 97 active+clean; 637 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 5.3 KiB/s wr, 14 op/s 2024-08-31T04:21:19.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:21:19 smithi133 ceph-mon[22177]: pgmap v319: 97 pgs: 97 active+clean; 637 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 5.3 KiB/s wr, 14 op/s 2024-08-31T04:21:19.676 INFO:teuthology.orchestra.run.smithi050.stdout:{"pg_ready":true,"pg_map":{"version":319,"stamp":"2024-08-31T04:21:17.855682+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":652564,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":261,"num_read_kb":225,"num_write":367,"num_write_kb":2280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":2952462,"num_keys_recovered":10,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":302,"ondisk_log_size":302,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":359744,"kb_used_data":10496,"kb_used_omap":18,"kb_used_meta":349037,"kb_avail":1124582080,"statfs":{"total":1151940427776,"available":1151572049920,"internally_reserved":0,"allocated":10747904,"data_stored":6898311,"data_compressed":109023,"data_compressed_allocated":135168,"data_compressed_original":1769472,"omap_allocated":19143,"internal_metadata":357414201},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":53380,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":138,"num_read_kb":126,"num_write":34,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003378"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":21,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:20:57.002034+0000","last_change":"2024-08-31T04:20:42.949771+0000","last_active":"2024-08-31T04:20:57.002034+0000","last_peered":"2024-08-31T04:20:57.002034+0000","last_clean":"2024-08-31T04:20:57.002034+0000","last_became_active":"2024-08-31T04:20:42.949372+0000","last_became_peered":"2024-08-31T04:20:42.949372+0000","last_unstale":"2024-08-31T04:20:57.002034+0000","last_undegraded":"2024-08-31T04:20:57.002034+0000","last_fullsized":"2024-08-31T04:20:57.002034+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:16:50.036191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":21,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:20:57.001502+0000","last_change":"2024-08-31T04:20:42.949805+0000","last_active":"2024-08-31T04:20:57.001502+0000","last_peered":"2024-08-31T04:20:57.001502+0000","last_clean":"2024-08-31T04:20:57.001502+0000","last_became_active":"2024-08-31T04:20:42.948015+0000","last_became_peered":"2024-08-31T04:20:42.948015+0000","last_unstale":"2024-08-31T04:20:57.001502+0000","last_undegraded":"2024-08-31T04:20:57.001502+0000","last_fullsized":"2024-08-31T04:20:57.001502+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:25:47.432785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":21,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:20:57.001526+0000","last_change":"2024-08-31T04:20:42.949114+0000","last_active":"2024-08-31T04:20:57.001526+0000","last_peered":"2024-08-31T04:20:57.001526+0000","last_clean":"2024-08-31T04:20:57.001526+0000","last_became_active":"2024-08-31T04:20:42.946763+0000","last_became_peered":"2024-08-31T04:20:42.946763+0000","last_unstale":"2024-08-31T04:20:57.001526+0000","last_undegraded":"2024-08-31T04:20:57.001526+0000","last_fullsized":"2024-08-31T04:20:57.001526+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:33:55.605617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":21,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:20:56.999162+0000","last_change":"2024-08-31T04:20:42.935026+0000","last_active":"2024-08-31T04:20:56.999162+0000","last_peered":"2024-08-31T04:20:56.999162+0000","last_clean":"2024-08-31T04:20:56.999162+0000","last_became_active":"2024-08-31T04:20:42.934534+0000","last_became_peered":"2024-08-31T04:20:42.934534+0000","last_unstale":"2024-08-31T04:20:56.999162+0000","last_undegraded":"2024-08-31T04:20:56.999162+0000","last_fullsized":"2024-08-31T04:20:56.999162+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:33:41.014920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":21,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:20:57.006160+0000","last_change":"2024-08-31T04:20:42.939114+0000","last_active":"2024-08-31T04:20:57.006160+0000","last_peered":"2024-08-31T04:20:57.006160+0000","last_clean":"2024-08-31T04:20:57.006160+0000","last_became_active":"2024-08-31T04:20:42.938710+0000","last_became_peered":"2024-08-31T04:20:42.938710+0000","last_unstale":"2024-08-31T04:20:57.006160+0000","last_undegraded":"2024-08-31T04:20:57.006160+0000","last_fullsized":"2024-08-31T04:20:57.006160+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:42:25.561258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":21,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:20:57.001416+0000","last_change":"2024-08-31T04:20:42.935958+0000","last_active":"2024-08-31T04:20:57.001416+0000","last_peered":"2024-08-31T04:20:57.001416+0000","last_clean":"2024-08-31T04:20:57.001416+0000","last_became_active":"2024-08-31T04:20:42.934865+0000","last_became_peered":"2024-08-31T04:20:42.934865+0000","last_unstale":"2024-08-31T04:20:57.001416+0000","last_undegraded":"2024-08-31T04:20:57.001416+0000","last_fullsized":"2024-08-31T04:20:57.001416+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:28:20.330784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":21,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:20:57.003213+0000","last_change":"2024-08-31T04:20:42.932639+0000","last_active":"2024-08-31T04:20:57.003213+0000","last_peered":"2024-08-31T04:20:57.003213+0000","last_clean":"2024-08-31T04:20:57.003213+0000","last_became_active":"2024-08-31T04:20:42.932238+0000","last_became_peered":"2024-08-31T04:20:42.932238+0000","last_unstale":"2024-08-31T04:20:57.003213+0000","last_undegraded":"2024-08-31T04:20:57.003213+0000","last_fullsized":"2024-08-31T04:20:57.003213+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T04:47:32.128675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":21,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:20:57.338218+0000","last_change":"2024-08-31T04:20:42.941700+0000","last_active":"2024-08-31T04:20:57.338218+0000","last_peered":"2024-08-31T04:20:57.338218+0000","last_clean":"2024-08-31T04:20:57.338218+0000","last_became_active":"2024-08-31T04:20:42.941308+0000","last_became_peered":"2024-08-31T04:20:42.941308+0000","last_unstale":"2024-08-31T04:20:57.338218+0000","last_undegraded":"2024-08-31T04:20:57.338218+0000","last_fullsized":"2024-08-31T04:20:57.338218+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:35:06.058492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":21,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:20:57.223342+0000","last_change":"2024-08-31T04:20:42.935528+0000","last_active":"2024-08-31T04:20:57.223342+0000","last_peered":"2024-08-31T04:20:57.223342+0000","last_clean":"2024-08-31T04:20:57.223342+0000","last_became_active":"2024-08-31T04:20:42.933736+0000","last_became_peered":"2024-08-31T04:20:42.933736+0000","last_unstale":"2024-08-31T04:20:57.223342+0000","last_undegraded":"2024-08-31T04:20:57.223342+0000","last_fullsized":"2024-08-31T04:20:57.223342+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:12:47.877285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":28,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:20:57.006811+0000","last_change":"2024-08-31T04:20:57.006683+0000","last_active":"2024-08-31T04:20:57.006811+0000","last_peered":"2024-08-31T04:20:57.006811+0000","last_clean":"2024-08-31T04:20:57.006811+0000","last_became_active":"2024-08-31T04:20:57.006166+0000","last_became_peered":"2024-08-31T04:20:57.006166+0000","last_unstale":"2024-08-31T04:20:57.006811+0000","last_undegraded":"2024-08-31T04:20:57.006811+0000","last_fullsized":"2024-08-31T04:20:57.006811+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:33:23.377991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,9],"acting":[10,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":21,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:20:57.003953+0000","last_change":"2024-08-31T04:20:42.939489+0000","last_active":"2024-08-31T04:20:57.003953+0000","last_peered":"2024-08-31T04:20:57.003953+0000","last_clean":"2024-08-31T04:20:57.003953+0000","last_became_active":"2024-08-31T04:20:42.939138+0000","last_became_peered":"2024-08-31T04:20:42.939138+0000","last_unstale":"2024-08-31T04:20:57.003953+0000","last_undegraded":"2024-08-31T04:20:57.003953+0000","last_fullsized":"2024-08-31T04:20:57.003953+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T05:00:30.196513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":21,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:20:56.999241+0000","last_change":"2024-08-31T04:20:42.941483+0000","last_active":"2024-08-31T04:20:56.999241+0000","last_peered":"2024-08-31T04:20:56.999241+0000","last_clean":"2024-08-31T04:20:56.999241+0000","last_became_active":"2024-08-31T04:20:42.940200+0000","last_became_peered":"2024-08-31T04:20:42.940200+0000","last_unstale":"2024-08-31T04:20:56.999241+0000","last_undegraded":"2024-08-31T04:20:56.999241+0000","last_fullsized":"2024-08-31T04:20:56.999241+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:40:45.235093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":21,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:20:56.998469+0000","last_change":"2024-08-31T04:20:42.928803+0000","last_active":"2024-08-31T04:20:56.998469+0000","last_peered":"2024-08-31T04:20:56.998469+0000","last_clean":"2024-08-31T04:20:56.998469+0000","last_became_active":"2024-08-31T04:20:42.928410+0000","last_became_peered":"2024-08-31T04:20:42.928410+0000","last_unstale":"2024-08-31T04:20:56.998469+0000","last_undegraded":"2024-08-31T04:20:56.998469+0000","last_fullsized":"2024-08-31T04:20:56.998469+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T04:24:41.811202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":21,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:20:57.001244+0000","last_change":"2024-08-31T04:20:42.945142+0000","last_active":"2024-08-31T04:20:57.001244+0000","last_peered":"2024-08-31T04:20:57.001244+0000","last_clean":"2024-08-31T04:20:57.001244+0000","last_became_active":"2024-08-31T04:20:42.944061+0000","last_became_peered":"2024-08-31T04:20:42.944061+0000","last_unstale":"2024-08-31T04:20:57.001244+0000","last_undegraded":"2024-08-31T04:20:57.001244+0000","last_fullsized":"2024-08-31T04:20:57.001244+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:55:09.045257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":21,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:20:57.001166+0000","last_change":"2024-08-31T04:20:42.945844+0000","last_active":"2024-08-31T04:20:57.001166+0000","last_peered":"2024-08-31T04:20:57.001166+0000","last_clean":"2024-08-31T04:20:57.001166+0000","last_became_active":"2024-08-31T04:20:42.944186+0000","last_became_peered":"2024-08-31T04:20:42.944186+0000","last_unstale":"2024-08-31T04:20:57.001166+0000","last_undegraded":"2024-08-31T04:20:57.001166+0000","last_fullsized":"2024-08-31T04:20:57.001166+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:32:46.878700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":21,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:20:57.222782+0000","last_change":"2024-08-31T04:20:42.952871+0000","last_active":"2024-08-31T04:20:57.222782+0000","last_peered":"2024-08-31T04:20:57.222782+0000","last_clean":"2024-08-31T04:20:57.222782+0000","last_became_active":"2024-08-31T04:20:42.952531+0000","last_became_peered":"2024-08-31T04:20:42.952531+0000","last_unstale":"2024-08-31T04:20:57.222782+0000","last_undegraded":"2024-08-31T04:20:57.222782+0000","last_fullsized":"2024-08-31T04:20:57.222782+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:26:01.690119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":21,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:20:57.002008+0000","last_change":"2024-08-31T04:20:42.949822+0000","last_active":"2024-08-31T04:20:57.002008+0000","last_peered":"2024-08-31T04:20:57.002008+0000","last_clean":"2024-08-31T04:20:57.002008+0000","last_became_active":"2024-08-31T04:20:42.949443+0000","last_became_peered":"2024-08-31T04:20:42.949443+0000","last_unstale":"2024-08-31T04:20:57.002008+0000","last_undegraded":"2024-08-31T04:20:57.002008+0000","last_fullsized":"2024-08-31T04:20:57.002008+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:35:48.270606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":21,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:20:57.004840+0000","last_change":"2024-08-31T04:20:42.940895+0000","last_active":"2024-08-31T04:20:57.004840+0000","last_peered":"2024-08-31T04:20:57.004840+0000","last_clean":"2024-08-31T04:20:57.004840+0000","last_became_active":"2024-08-31T04:20:42.940489+0000","last_became_peered":"2024-08-31T04:20:42.940489+0000","last_unstale":"2024-08-31T04:20:57.004840+0000","last_undegraded":"2024-08-31T04:20:57.004840+0000","last_fullsized":"2024-08-31T04:20:57.004840+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T04:42:20.269895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":21,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:20:57.004087+0000","last_change":"2024-08-31T04:20:42.935303+0000","last_active":"2024-08-31T04:20:57.004087+0000","last_peered":"2024-08-31T04:20:57.004087+0000","last_clean":"2024-08-31T04:20:57.004087+0000","last_became_active":"2024-08-31T04:20:42.934931+0000","last_became_peered":"2024-08-31T04:20:42.934931+0000","last_unstale":"2024-08-31T04:20:57.004087+0000","last_undegraded":"2024-08-31T04:20:57.004087+0000","last_fullsized":"2024-08-31T04:20:57.004087+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:34:40.767333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":21,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:20:57.000940+0000","last_change":"2024-08-31T04:20:42.941518+0000","last_active":"2024-08-31T04:20:57.000940+0000","last_peered":"2024-08-31T04:20:57.000940+0000","last_clean":"2024-08-31T04:20:57.000940+0000","last_became_active":"2024-08-31T04:20:42.941142+0000","last_became_peered":"2024-08-31T04:20:42.941142+0000","last_unstale":"2024-08-31T04:20:57.000940+0000","last_undegraded":"2024-08-31T04:20:57.000940+0000","last_fullsized":"2024-08-31T04:20:57.000940+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:27:50.274057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":21,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:20:56.998500+0000","last_change":"2024-08-31T04:20:42.945136+0000","last_active":"2024-08-31T04:20:56.998500+0000","last_peered":"2024-08-31T04:20:56.998500+0000","last_clean":"2024-08-31T04:20:56.998500+0000","last_became_active":"2024-08-31T04:20:42.944811+0000","last_became_peered":"2024-08-31T04:20:42.944811+0000","last_unstale":"2024-08-31T04:20:56.998500+0000","last_undegraded":"2024-08-31T04:20:56.998500+0000","last_fullsized":"2024-08-31T04:20:56.998500+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:30:47.496668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":21,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:20:57.222956+0000","last_change":"2024-08-31T04:20:42.930854+0000","last_active":"2024-08-31T04:20:57.222956+0000","last_peered":"2024-08-31T04:20:57.222956+0000","last_clean":"2024-08-31T04:20:57.222956+0000","last_became_active":"2024-08-31T04:20:42.930490+0000","last_became_peered":"2024-08-31T04:20:42.930490+0000","last_unstale":"2024-08-31T04:20:57.222956+0000","last_undegraded":"2024-08-31T04:20:57.222956+0000","last_fullsized":"2024-08-31T04:20:57.222956+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:16:17.611414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:20:57.009435+0000","last_change":"2024-08-31T04:20:57.008738+0000","last_active":"2024-08-31T04:20:57.009435+0000","last_peered":"2024-08-31T04:20:57.009435+0000","last_clean":"2024-08-31T04:20:57.009435+0000","last_became_active":"2024-08-31T04:20:57.008209+0000","last_became_peered":"2024-08-31T04:20:57.008209+0000","last_unstale":"2024-08-31T04:20:57.009435+0000","last_undegraded":"2024-08-31T04:20:57.009435+0000","last_fullsized":"2024-08-31T04:20:57.009435+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T05:26:22.508955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,11],"acting":[9,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":21,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:20:56.999443+0000","last_change":"2024-08-31T04:20:42.939859+0000","last_active":"2024-08-31T04:20:56.999443+0000","last_peered":"2024-08-31T04:20:56.999443+0000","last_clean":"2024-08-31T04:20:56.999443+0000","last_became_active":"2024-08-31T04:20:42.938315+0000","last_became_peered":"2024-08-31T04:20:42.938315+0000","last_unstale":"2024-08-31T04:20:56.999443+0000","last_undegraded":"2024-08-31T04:20:56.999443+0000","last_fullsized":"2024-08-31T04:20:56.999443+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:13:00.906454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":21,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:20:57.338551+0000","last_change":"2024-08-31T04:20:42.941861+0000","last_active":"2024-08-31T04:20:57.338551+0000","last_peered":"2024-08-31T04:20:57.338551+0000","last_clean":"2024-08-31T04:20:57.338551+0000","last_became_active":"2024-08-31T04:20:42.939556+0000","last_became_peered":"2024-08-31T04:20:42.939556+0000","last_unstale":"2024-08-31T04:20:57.338551+0000","last_undegraded":"2024-08-31T04:20:57.338551+0000","last_fullsized":"2024-08-31T04:20:57.338551+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:02:53.900917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":21,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:20:57.004438+0000","last_change":"2024-08-31T04:20:42.930792+0000","last_active":"2024-08-31T04:20:57.004438+0000","last_peered":"2024-08-31T04:20:57.004438+0000","last_clean":"2024-08-31T04:20:57.004438+0000","last_became_active":"2024-08-31T04:20:42.930014+0000","last_became_peered":"2024-08-31T04:20:42.930014+0000","last_unstale":"2024-08-31T04:20:57.004438+0000","last_undegraded":"2024-08-31T04:20:57.004438+0000","last_fullsized":"2024-08-31T04:20:57.004438+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:18:26.942604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":28,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:20:57.010285+0000","last_change":"2024-08-31T04:20:57.010093+0000","last_active":"2024-08-31T04:20:57.010285+0000","last_peered":"2024-08-31T04:20:57.010285+0000","last_clean":"2024-08-31T04:20:57.010285+0000","last_became_active":"2024-08-31T04:20:57.008759+0000","last_became_peered":"2024-08-31T04:20:57.008759+0000","last_unstale":"2024-08-31T04:20:57.010285+0000","last_undegraded":"2024-08-31T04:20:57.010285+0000","last_fullsized":"2024-08-31T04:20:57.010285+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T06:55:38.276668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,9],"acting":[11,8,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":21,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:20:56.998387+0000","last_change":"2024-08-31T04:20:42.953378+0000","last_active":"2024-08-31T04:20:56.998387+0000","last_peered":"2024-08-31T04:20:56.998387+0000","last_clean":"2024-08-31T04:20:56.998387+0000","last_became_active":"2024-08-31T04:20:42.953030+0000","last_became_peered":"2024-08-31T04:20:42.953030+0000","last_unstale":"2024-08-31T04:20:56.998387+0000","last_undegraded":"2024-08-31T04:20:56.998387+0000","last_fullsized":"2024-08-31T04:20:56.998387+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:24:46.633234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":21,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:20:57.001390+0000","last_change":"2024-08-31T04:20:42.945142+0000","last_active":"2024-08-31T04:20:57.001390+0000","last_peered":"2024-08-31T04:20:57.001390+0000","last_clean":"2024-08-31T04:20:57.001390+0000","last_became_active":"2024-08-31T04:20:42.943960+0000","last_became_peered":"2024-08-31T04:20:42.943960+0000","last_unstale":"2024-08-31T04:20:57.001390+0000","last_undegraded":"2024-08-31T04:20:57.001390+0000","last_fullsized":"2024-08-31T04:20:57.001390+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T04:29:10.501940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":21,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:20:57.003852+0000","last_change":"2024-08-31T04:20:42.946359+0000","last_active":"2024-08-31T04:20:57.003852+0000","last_peered":"2024-08-31T04:20:57.003852+0000","last_clean":"2024-08-31T04:20:57.003852+0000","last_became_active":"2024-08-31T04:20:42.945974+0000","last_became_peered":"2024-08-31T04:20:42.945974+0000","last_unstale":"2024-08-31T04:20:57.003852+0000","last_undegraded":"2024-08-31T04:20:57.003852+0000","last_fullsized":"2024-08-31T04:20:57.003852+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:01:27.808743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":21,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:20:57.003936+0000","last_change":"2024-08-31T04:20:42.930989+0000","last_active":"2024-08-31T04:20:57.003936+0000","last_peered":"2024-08-31T04:20:57.003936+0000","last_clean":"2024-08-31T04:20:57.003936+0000","last_became_active":"2024-08-31T04:20:42.930610+0000","last_became_peered":"2024-08-31T04:20:42.930610+0000","last_unstale":"2024-08-31T04:20:57.003936+0000","last_undegraded":"2024-08-31T04:20:57.003936+0000","last_fullsized":"2024-08-31T04:20:57.003936+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:01:49.473735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":21,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:20:57.001181+0000","last_change":"2024-08-31T04:20:42.930513+0000","last_active":"2024-08-31T04:20:57.001181+0000","last_peered":"2024-08-31T04:20:57.001181+0000","last_clean":"2024-08-31T04:20:57.001181+0000","last_became_active":"2024-08-31T04:20:42.930127+0000","last_became_peered":"2024-08-31T04:20:42.930127+0000","last_unstale":"2024-08-31T04:20:57.001181+0000","last_undegraded":"2024-08-31T04:20:57.001181+0000","last_fullsized":"2024-08-31T04:20:57.001181+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T05:19:55.307816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":21,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:20:57.005865+0000","last_change":"2024-08-31T04:20:42.928217+0000","last_active":"2024-08-31T04:20:57.005865+0000","last_peered":"2024-08-31T04:20:57.005865+0000","last_clean":"2024-08-31T04:20:57.005865+0000","last_became_active":"2024-08-31T04:20:42.927828+0000","last_became_peered":"2024-08-31T04:20:42.927828+0000","last_unstale":"2024-08-31T04:20:57.005865+0000","last_undegraded":"2024-08-31T04:20:57.005865+0000","last_fullsized":"2024-08-31T04:20:57.005865+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:53:21.266734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"78'6","reported_seq":63,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:21:14.076347+0000","last_change":"2024-08-31T04:20:57.229930+0000","last_active":"2024-08-31T04:21:14.076347+0000","last_peered":"2024-08-31T04:21:14.076347+0000","last_clean":"2024-08-31T04:21:14.076347+0000","last_became_active":"2024-08-31T04:20:57.224761+0000","last_became_peered":"2024-08-31T04:20:57.224761+0000","last_unstale":"2024-08-31T04:21:14.076347+0000","last_undegraded":"2024-08-31T04:21:14.076347+0000","last_fullsized":"2024-08-31T04:21:14.076347+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_clean_scrub_stamp":"2024-08-31T04:20:38.871450+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:07:41.723452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1013,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":17,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":622,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":21,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:20:57.000491+0000","last_change":"2024-08-31T04:20:42.939189+0000","last_active":"2024-08-31T04:20:57.000491+0000","last_peered":"2024-08-31T04:20:57.000491+0000","last_clean":"2024-08-31T04:20:57.000491+0000","last_became_active":"2024-08-31T04:20:42.938817+0000","last_became_peered":"2024-08-31T04:20:42.938817+0000","last_unstale":"2024-08-31T04:20:57.000491+0000","last_undegraded":"2024-08-31T04:20:57.000491+0000","last_fullsized":"2024-08-31T04:20:57.000491+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:19:04.407104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"77'7","reported_seq":34,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:20:57.001432+0000","last_change":"2024-08-31T04:20:39.904392+0000","last_active":"2024-08-31T04:20:57.001432+0000","last_peered":"2024-08-31T04:20:57.001432+0000","last_clean":"2024-08-31T04:20:57.001432+0000","last_became_active":"2024-08-31T04:20:39.904014+0000","last_became_peered":"2024-08-31T04:20:39.904014+0000","last_unstale":"2024-08-31T04:20:57.001432+0000","last_undegraded":"2024-08-31T04:20:57.001432+0000","last_fullsized":"2024-08-31T04:20:57.001432+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_clean_scrub_stamp":"2024-08-31T04:20:38.871450+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:33:56.591237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"78'3","reported_seq":30,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:20:56.998239+0000","last_change":"2024-08-31T04:20:39.899521+0000","last_active":"2024-08-31T04:20:56.998239+0000","last_peered":"2024-08-31T04:20:56.998239+0000","last_clean":"2024-08-31T04:20:56.998239+0000","last_became_active":"2024-08-31T04:20:39.899157+0000","last_became_peered":"2024-08-31T04:20:39.899157+0000","last_unstale":"2024-08-31T04:20:56.998239+0000","last_undegraded":"2024-08-31T04:20:56.998239+0000","last_fullsized":"2024-08-31T04:20:56.998239+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_clean_scrub_stamp":"2024-08-31T04:20:38.871450+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:14:47.067149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":21,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:20:57.338276+0000","last_change":"2024-08-31T04:20:42.950653+0000","last_active":"2024-08-31T04:20:57.338276+0000","last_peered":"2024-08-31T04:20:57.338276+0000","last_clean":"2024-08-31T04:20:57.338276+0000","last_became_active":"2024-08-31T04:20:42.949627+0000","last_became_peered":"2024-08-31T04:20:42.949627+0000","last_unstale":"2024-08-31T04:20:57.338276+0000","last_undegraded":"2024-08-31T04:20:57.338276+0000","last_fullsized":"2024-08-31T04:20:57.338276+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:22:00.000717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"78'3","reported_seq":31,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:21:01.048385+0000","last_change":"2024-08-31T04:20:39.908013+0000","last_active":"2024-08-31T04:21:01.048385+0000","last_peered":"2024-08-31T04:21:01.048385+0000","last_clean":"2024-08-31T04:21:01.048385+0000","last_became_active":"2024-08-31T04:20:39.907482+0000","last_became_peered":"2024-08-31T04:20:39.907482+0000","last_unstale":"2024-08-31T04:21:01.048385+0000","last_undegraded":"2024-08-31T04:21:01.048385+0000","last_fullsized":"2024-08-31T04:21:01.048385+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_clean_scrub_stamp":"2024-08-31T04:20:38.871450+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:50:35.466407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":21,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:20:57.004374+0000","last_change":"2024-08-31T04:20:42.944674+0000","last_active":"2024-08-31T04:20:57.004374+0000","last_peered":"2024-08-31T04:20:57.004374+0000","last_clean":"2024-08-31T04:20:57.004374+0000","last_became_active":"2024-08-31T04:20:42.944424+0000","last_became_peered":"2024-08-31T04:20:42.944424+0000","last_unstale":"2024-08-31T04:20:57.004374+0000","last_undegraded":"2024-08-31T04:20:57.004374+0000","last_fullsized":"2024-08-31T04:20:57.004374+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:10:27.772835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"77'4","reported_seq":61,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:21:16.078422+0000","last_change":"2024-08-31T04:20:39.904188+0000","last_active":"2024-08-31T04:21:16.078422+0000","last_peered":"2024-08-31T04:21:16.078422+0000","last_clean":"2024-08-31T04:21:16.078422+0000","last_became_active":"2024-08-31T04:20:39.903789+0000","last_became_peered":"2024-08-31T04:20:39.903789+0000","last_unstale":"2024-08-31T04:21:16.078422+0000","last_undegraded":"2024-08-31T04:21:16.078422+0000","last_fullsized":"2024-08-31T04:21:16.078422+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_clean_scrub_stamp":"2024-08-31T04:20:38.871450+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T06:54:38.881746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":21,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:20:57.223134+0000","last_change":"2024-08-31T04:20:42.932961+0000","last_active":"2024-08-31T04:20:57.223134+0000","last_peered":"2024-08-31T04:20:57.223134+0000","last_clean":"2024-08-31T04:20:57.223134+0000","last_became_active":"2024-08-31T04:20:42.932562+0000","last_became_peered":"2024-08-31T04:20:42.932562+0000","last_unstale":"2024-08-31T04:20:57.223134+0000","last_undegraded":"2024-08-31T04:20:57.223134+0000","last_fullsized":"2024-08-31T04:20:57.223134+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:20:36.827300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"78'4","reported_seq":31,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:21:01.049286+0000","last_change":"2024-08-31T04:20:39.902279+0000","last_active":"2024-08-31T04:21:01.049286+0000","last_peered":"2024-08-31T04:21:01.049286+0000","last_clean":"2024-08-31T04:21:01.049286+0000","last_became_active":"2024-08-31T04:20:39.901822+0000","last_became_peered":"2024-08-31T04:20:39.901822+0000","last_unstale":"2024-08-31T04:21:01.049286+0000","last_undegraded":"2024-08-31T04:21:01.049286+0000","last_fullsized":"2024-08-31T04:21:01.049286+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_clean_scrub_stamp":"2024-08-31T04:20:38.871450+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:48:09.609644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":28,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:20:57.009187+0000","last_change":"2024-08-31T04:20:57.008955+0000","last_active":"2024-08-31T04:20:57.009187+0000","last_peered":"2024-08-31T04:20:57.009187+0000","last_clean":"2024-08-31T04:20:57.009187+0000","last_became_active":"2024-08-31T04:20:57.008487+0000","last_became_peered":"2024-08-31T04:20:57.008487+0000","last_unstale":"2024-08-31T04:20:57.009187+0000","last_undegraded":"2024-08-31T04:20:57.009187+0000","last_fullsized":"2024-08-31T04:20:57.009187+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:26:23.399089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,5],"acting":[0,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"77'5","reported_seq":33,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:20:56.999868+0000","last_change":"2024-08-31T04:20:39.992197+0000","last_active":"2024-08-31T04:20:56.999868+0000","last_peered":"2024-08-31T04:20:56.999868+0000","last_clean":"2024-08-31T04:20:56.999868+0000","last_became_active":"2024-08-31T04:20:39.991835+0000","last_became_peered":"2024-08-31T04:20:39.991835+0000","last_unstale":"2024-08-31T04:20:56.999868+0000","last_undegraded":"2024-08-31T04:20:56.999868+0000","last_fullsized":"2024-08-31T04:20:56.999868+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_clean_scrub_stamp":"2024-08-31T04:20:38.871450+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:38:02.808469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":21,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:20:57.223159+0000","last_change":"2024-08-31T04:20:42.934874+0000","last_active":"2024-08-31T04:20:57.223159+0000","last_peered":"2024-08-31T04:20:57.223159+0000","last_clean":"2024-08-31T04:20:57.223159+0000","last_became_active":"2024-08-31T04:20:42.934500+0000","last_became_peered":"2024-08-31T04:20:42.934500+0000","last_unstale":"2024-08-31T04:20:57.223159+0000","last_undegraded":"2024-08-31T04:20:57.223159+0000","last_fullsized":"2024-08-31T04:20:57.223159+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:32:59.785563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"78'28","reported_seq":93,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:21:16.088951+0000","last_change":"2024-08-31T04:20:39.907452+0000","last_active":"2024-08-31T04:21:16.088951+0000","last_peered":"2024-08-31T04:21:16.088951+0000","last_clean":"2024-08-31T04:21:16.088951+0000","last_became_active":"2024-08-31T04:20:39.907071+0000","last_became_peered":"2024-08-31T04:20:39.907071+0000","last_unstale":"2024-08-31T04:21:16.088951+0000","last_undegraded":"2024-08-31T04:21:16.088951+0000","last_fullsized":"2024-08-31T04:21:16.088951+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_clean_scrub_stamp":"2024-08-31T04:20:38.871450+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:21:33.318332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54367,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":38,"num_read_kb":71,"num_write":30,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":21,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:20:57.006637+0000","last_change":"2024-08-31T04:20:42.937750+0000","last_active":"2024-08-31T04:20:57.006637+0000","last_peered":"2024-08-31T04:20:57.006637+0000","last_clean":"2024-08-31T04:20:57.006637+0000","last_became_active":"2024-08-31T04:20:42.937386+0000","last_became_peered":"2024-08-31T04:20:42.937386+0000","last_unstale":"2024-08-31T04:20:57.006637+0000","last_undegraded":"2024-08-31T04:20:57.006637+0000","last_fullsized":"2024-08-31T04:20:57.006637+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:14:03.123558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"78'9","reported_seq":38,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:21:02.054531+0000","last_change":"2024-08-31T04:20:39.902815+0000","last_active":"2024-08-31T04:21:02.054531+0000","last_peered":"2024-08-31T04:21:02.054531+0000","last_clean":"2024-08-31T04:21:02.054531+0000","last_became_active":"2024-08-31T04:20:39.900473+0000","last_became_peered":"2024-08-31T04:20:39.900473+0000","last_unstale":"2024-08-31T04:21:02.054531+0000","last_undegraded":"2024-08-31T04:21:02.054531+0000","last_fullsized":"2024-08-31T04:21:02.054531+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_clean_scrub_stamp":"2024-08-31T04:20:38.871450+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:42:03.902102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":21,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:20:56.998214+0000","last_change":"2024-08-31T04:20:42.932333+0000","last_active":"2024-08-31T04:20:56.998214+0000","last_peered":"2024-08-31T04:20:56.998214+0000","last_clean":"2024-08-31T04:20:56.998214+0000","last_became_active":"2024-08-31T04:20:42.931902+0000","last_became_peered":"2024-08-31T04:20:42.931902+0000","last_unstale":"2024-08-31T04:20:56.998214+0000","last_undegraded":"2024-08-31T04:20:56.998214+0000","last_fullsized":"2024-08-31T04:20:56.998214+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:46:44.716941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"78'5","reported_seq":33,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:21:01.048755+0000","last_change":"2024-08-31T04:20:39.901541+0000","last_active":"2024-08-31T04:21:01.048755+0000","last_peered":"2024-08-31T04:21:01.048755+0000","last_clean":"2024-08-31T04:21:01.048755+0000","last_became_active":"2024-08-31T04:20:39.901116+0000","last_became_peered":"2024-08-31T04:20:39.901116+0000","last_unstale":"2024-08-31T04:21:01.048755+0000","last_undegraded":"2024-08-31T04:21:01.048755+0000","last_fullsized":"2024-08-31T04:21:01.048755+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_clean_scrub_stamp":"2024-08-31T04:20:38.871450+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:57:51.458017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":21,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:20:57.003686+0000","last_change":"2024-08-31T04:20:42.936355+0000","last_active":"2024-08-31T04:20:57.003686+0000","last_peered":"2024-08-31T04:20:57.003686+0000","last_clean":"2024-08-31T04:20:57.003686+0000","last_became_active":"2024-08-31T04:20:42.935975+0000","last_became_peered":"2024-08-31T04:20:42.935975+0000","last_unstale":"2024-08-31T04:20:57.003686+0000","last_undegraded":"2024-08-31T04:20:57.003686+0000","last_fullsized":"2024-08-31T04:20:57.003686+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:37:24.867700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"78'6","reported_seq":50,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:21:14.082486+0000","last_change":"2024-08-31T04:20:39.901314+0000","last_active":"2024-08-31T04:21:14.082486+0000","last_peered":"2024-08-31T04:21:14.082486+0000","last_clean":"2024-08-31T04:21:14.082486+0000","last_became_active":"2024-08-31T04:20:39.900780+0000","last_became_peered":"2024-08-31T04:20:39.900780+0000","last_unstale":"2024-08-31T04:21:14.082486+0000","last_undegraded":"2024-08-31T04:21:14.082486+0000","last_fullsized":"2024-08-31T04:21:14.082486+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_clean_scrub_stamp":"2024-08-31T04:20:38.871450+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:59:40.500765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":979,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":18,"num_read_kb":4,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":21,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:20:57.003241+0000","last_change":"2024-08-31T04:20:42.934382+0000","last_active":"2024-08-31T04:20:57.003241+0000","last_peered":"2024-08-31T04:20:57.003241+0000","last_clean":"2024-08-31T04:20:57.003241+0000","last_became_active":"2024-08-31T04:20:42.933986+0000","last_became_peered":"2024-08-31T04:20:42.933986+0000","last_unstale":"2024-08-31T04:20:57.003241+0000","last_undegraded":"2024-08-31T04:20:57.003241+0000","last_fullsized":"2024-08-31T04:20:57.003241+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:12:16.372504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"78'17","reported_seq":45,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:21:01.047381+0000","last_change":"2024-08-31T04:20:39.990817+0000","last_active":"2024-08-31T04:21:01.047381+0000","last_peered":"2024-08-31T04:21:01.047381+0000","last_clean":"2024-08-31T04:21:01.047381+0000","last_became_active":"2024-08-31T04:20:39.990379+0000","last_became_peered":"2024-08-31T04:20:39.990379+0000","last_unstale":"2024-08-31T04:21:01.047381+0000","last_undegraded":"2024-08-31T04:21:01.047381+0000","last_fullsized":"2024-08-31T04:21:01.047381+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_clean_scrub_stamp":"2024-08-31T04:20:38.871450+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:42:27.435142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":21,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:20:56.999443+0000","last_change":"2024-08-31T04:20:42.942430+0000","last_active":"2024-08-31T04:20:56.999443+0000","last_peered":"2024-08-31T04:20:56.999443+0000","last_clean":"2024-08-31T04:20:56.999443+0000","last_became_active":"2024-08-31T04:20:42.942067+0000","last_became_peered":"2024-08-31T04:20:42.942067+0000","last_unstale":"2024-08-31T04:20:56.999443+0000","last_undegraded":"2024-08-31T04:20:56.999443+0000","last_fullsized":"2024-08-31T04:20:56.999443+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:48:52.441499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"77'2","reported_seq":30,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:20:57.007144+0000","last_change":"2024-08-31T04:20:39.903815+0000","last_active":"2024-08-31T04:20:57.007144+0000","last_peered":"2024-08-31T04:20:57.007144+0000","last_clean":"2024-08-31T04:20:57.007144+0000","last_became_active":"2024-08-31T04:20:39.903183+0000","last_became_peered":"2024-08-31T04:20:39.903183+0000","last_unstale":"2024-08-31T04:20:57.007144+0000","last_undegraded":"2024-08-31T04:20:57.007144+0000","last_fullsized":"2024-08-31T04:20:57.007144+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_clean_scrub_stamp":"2024-08-31T04:20:38.871450+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:39:50.862711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":28,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:20:57.004968+0000","last_change":"2024-08-31T04:20:57.004852+0000","last_active":"2024-08-31T04:20:57.004968+0000","last_peered":"2024-08-31T04:20:57.004968+0000","last_clean":"2024-08-31T04:20:57.004968+0000","last_became_active":"2024-08-31T04:20:57.004435+0000","last_became_peered":"2024-08-31T04:20:57.004435+0000","last_unstale":"2024-08-31T04:20:57.004968+0000","last_undegraded":"2024-08-31T04:20:57.004968+0000","last_fullsized":"2024-08-31T04:20:57.004968+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T06:16:19.010305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,6],"acting":[11,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"78'5","reported_seq":32,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:21:01.047330+0000","last_change":"2024-08-31T04:20:39.901493+0000","last_active":"2024-08-31T04:21:01.047330+0000","last_peered":"2024-08-31T04:21:01.047330+0000","last_clean":"2024-08-31T04:21:01.047330+0000","last_became_active":"2024-08-31T04:20:39.901072+0000","last_became_peered":"2024-08-31T04:20:39.901072+0000","last_unstale":"2024-08-31T04:21:01.047330+0000","last_undegraded":"2024-08-31T04:21:01.047330+0000","last_fullsized":"2024-08-31T04:21:01.047330+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_clean_scrub_stamp":"2024-08-31T04:20:38.871450+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:26:43.893882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":21,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:20:57.004118+0000","last_change":"2024-08-31T04:20:42.938270+0000","last_active":"2024-08-31T04:20:57.004118+0000","last_peered":"2024-08-31T04:20:57.004118+0000","last_clean":"2024-08-31T04:20:57.004118+0000","last_became_active":"2024-08-31T04:20:42.937851+0000","last_became_peered":"2024-08-31T04:20:42.937851+0000","last_unstale":"2024-08-31T04:20:57.004118+0000","last_undegraded":"2024-08-31T04:20:57.004118+0000","last_fullsized":"2024-08-31T04:20:57.004118+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:29:09.315106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"78'3","reported_seq":31,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:21:01.049001+0000","last_change":"2024-08-31T04:20:39.905785+0000","last_active":"2024-08-31T04:21:01.049001+0000","last_peered":"2024-08-31T04:21:01.049001+0000","last_clean":"2024-08-31T04:21:01.049001+0000","last_became_active":"2024-08-31T04:20:39.905403+0000","last_became_peered":"2024-08-31T04:20:39.905403+0000","last_unstale":"2024-08-31T04:21:01.049001+0000","last_undegraded":"2024-08-31T04:21:01.049001+0000","last_fullsized":"2024-08-31T04:21:01.049001+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_clean_scrub_stamp":"2024-08-31T04:20:38.871450+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:48:04.743543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"78'1","reported_seq":22,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:20:57.003984+0000","last_change":"2024-08-31T04:20:42.934433+0000","last_active":"2024-08-31T04:20:57.003984+0000","last_peered":"2024-08-31T04:20:57.003984+0000","last_clean":"2024-08-31T04:20:57.003984+0000","last_became_active":"2024-08-31T04:20:42.934058+0000","last_became_peered":"2024-08-31T04:20:42.934058+0000","last_unstale":"2024-08-31T04:20:57.003984+0000","last_undegraded":"2024-08-31T04:20:57.003984+0000","last_fullsized":"2024-08-31T04:20:57.003984+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:34:42.988905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"78'6","reported_seq":51,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:21:15.078269+0000","last_change":"2024-08-31T04:20:40.202403+0000","last_active":"2024-08-31T04:21:15.078269+0000","last_peered":"2024-08-31T04:21:15.078269+0000","last_clean":"2024-08-31T04:21:15.078269+0000","last_became_active":"2024-08-31T04:20:40.201918+0000","last_became_peered":"2024-08-31T04:20:40.201918+0000","last_unstale":"2024-08-31T04:21:15.078269+0000","last_undegraded":"2024-08-31T04:21:15.078269+0000","last_fullsized":"2024-08-31T04:21:15.078269+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_clean_scrub_stamp":"2024-08-31T04:20:38.871450+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:31:26.675413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1561,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":18,"num_read_kb":3,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":21,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:20:57.004028+0000","last_change":"2024-08-31T04:20:42.931040+0000","last_active":"2024-08-31T04:20:57.004028+0000","last_peered":"2024-08-31T04:20:57.004028+0000","last_clean":"2024-08-31T04:20:57.004028+0000","last_became_active":"2024-08-31T04:20:42.930692+0000","last_became_peered":"2024-08-31T04:20:42.930692+0000","last_unstale":"2024-08-31T04:20:57.004028+0000","last_undegraded":"2024-08-31T04:20:57.004028+0000","last_fullsized":"2024-08-31T04:20:57.004028+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T06:12:23.175092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"20'92","reported_seq":98,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:20:57.003457+0000","last_change":"2024-08-31T04:19:21.361791+0000","last_active":"2024-08-31T04:20:57.003457+0000","last_peered":"2024-08-31T04:20:57.003457+0000","last_clean":"2024-08-31T04:20:57.003457+0000","last_became_active":"2024-08-31T04:19:21.356128+0000","last_became_peered":"2024-08-31T04:19:21.356128+0000","last_unstale":"2024-08-31T04:20:57.003457+0000","last_undegraded":"2024-08-31T04:20:57.003457+0000","last_fullsized":"2024-08-31T04:20:57.003457+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:15:46.442365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:15:46.442365+0000","last_clean_scrub_stamp":"2024-08-31T04:15:46.442365+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:23:05.688680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"78'6","reported_seq":36,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:21:02.053432+0000","last_change":"2024-08-31T04:20:39.904625+0000","last_active":"2024-08-31T04:21:02.053432+0000","last_peered":"2024-08-31T04:21:02.053432+0000","last_clean":"2024-08-31T04:21:02.053432+0000","last_became_active":"2024-08-31T04:20:39.904245+0000","last_became_peered":"2024-08-31T04:20:39.904245+0000","last_unstale":"2024-08-31T04:21:02.053432+0000","last_undegraded":"2024-08-31T04:21:02.053432+0000","last_fullsized":"2024-08-31T04:21:02.053432+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_clean_scrub_stamp":"2024-08-31T04:20:38.871450+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:31:34.711047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":21,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:20:57.338391+0000","last_change":"2024-08-31T04:20:42.944224+0000","last_active":"2024-08-31T04:20:57.338391+0000","last_peered":"2024-08-31T04:20:57.338391+0000","last_clean":"2024-08-31T04:20:57.338391+0000","last_became_active":"2024-08-31T04:20:42.943469+0000","last_became_peered":"2024-08-31T04:20:42.943469+0000","last_unstale":"2024-08-31T04:20:57.338391+0000","last_undegraded":"2024-08-31T04:20:57.338391+0000","last_fullsized":"2024-08-31T04:20:57.338391+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:27:48.533319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"78'4","reported_seq":31,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:20:57.003498+0000","last_change":"2024-08-31T04:20:39.902613+0000","last_active":"2024-08-31T04:20:57.003498+0000","last_peered":"2024-08-31T04:20:57.003498+0000","last_clean":"2024-08-31T04:20:57.003498+0000","last_became_active":"2024-08-31T04:20:39.902033+0000","last_became_peered":"2024-08-31T04:20:39.902033+0000","last_unstale":"2024-08-31T04:20:57.003498+0000","last_undegraded":"2024-08-31T04:20:57.003498+0000","last_fullsized":"2024-08-31T04:20:57.003498+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_clean_scrub_stamp":"2024-08-31T04:20:38.871450+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:13:58.497781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":21,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:20:56.998151+0000","last_change":"2024-08-31T04:20:42.933541+0000","last_active":"2024-08-31T04:20:56.998151+0000","last_peered":"2024-08-31T04:20:56.998151+0000","last_clean":"2024-08-31T04:20:56.998151+0000","last_became_active":"2024-08-31T04:20:42.933155+0000","last_became_peered":"2024-08-31T04:20:42.933155+0000","last_unstale":"2024-08-31T04:20:56.998151+0000","last_undegraded":"2024-08-31T04:20:56.998151+0000","last_fullsized":"2024-08-31T04:20:56.998151+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:22:41.298103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"78'5","reported_seq":46,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:21:13.079492+0000","last_change":"2024-08-31T04:20:39.992067+0000","last_active":"2024-08-31T04:21:13.079492+0000","last_peered":"2024-08-31T04:21:13.079492+0000","last_clean":"2024-08-31T04:21:13.079492+0000","last_became_active":"2024-08-31T04:20:39.991645+0000","last_became_peered":"2024-08-31T04:20:39.991645+0000","last_unstale":"2024-08-31T04:21:13.079492+0000","last_undegraded":"2024-08-31T04:21:13.079492+0000","last_fullsized":"2024-08-31T04:21:13.079492+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_clean_scrub_stamp":"2024-08-31T04:20:38.871450+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:41:18.012094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":21,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:20:56.999491+0000","last_change":"2024-08-31T04:20:42.937324+0000","last_active":"2024-08-31T04:20:56.999491+0000","last_peered":"2024-08-31T04:20:56.999491+0000","last_clean":"2024-08-31T04:20:56.999491+0000","last_became_active":"2024-08-31T04:20:42.936926+0000","last_became_peered":"2024-08-31T04:20:42.936926+0000","last_unstale":"2024-08-31T04:20:56.999491+0000","last_undegraded":"2024-08-31T04:20:56.999491+0000","last_fullsized":"2024-08-31T04:20:56.999491+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:34:57.158304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"78'5","reported_seq":47,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:21:14.082476+0000","last_change":"2024-08-31T04:20:39.905365+0000","last_active":"2024-08-31T04:21:14.082476+0000","last_peered":"2024-08-31T04:21:14.082476+0000","last_clean":"2024-08-31T04:21:14.082476+0000","last_became_active":"2024-08-31T04:20:39.904772+0000","last_became_peered":"2024-08-31T04:20:39.904772+0000","last_unstale":"2024-08-31T04:21:14.082476+0000","last_undegraded":"2024-08-31T04:21:14.082476+0000","last_fullsized":"2024-08-31T04:21:14.082476+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_clean_scrub_stamp":"2024-08-31T04:20:38.871450+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T05:20:23.781639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":15,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":21,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:20:57.001600+0000","last_change":"2024-08-31T04:20:42.944303+0000","last_active":"2024-08-31T04:20:57.001600+0000","last_peered":"2024-08-31T04:20:57.001600+0000","last_clean":"2024-08-31T04:20:57.001600+0000","last_became_active":"2024-08-31T04:20:42.943938+0000","last_became_peered":"2024-08-31T04:20:42.943938+0000","last_unstale":"2024-08-31T04:20:57.001600+0000","last_undegraded":"2024-08-31T04:20:57.001600+0000","last_fullsized":"2024-08-31T04:20:57.001600+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T06:51:28.734751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"77'1","reported_seq":28,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:20:57.004633+0000","last_change":"2024-08-31T04:20:39.993135+0000","last_active":"2024-08-31T04:20:57.004633+0000","last_peered":"2024-08-31T04:20:57.004633+0000","last_clean":"2024-08-31T04:20:57.004633+0000","last_became_active":"2024-08-31T04:20:39.991569+0000","last_became_peered":"2024-08-31T04:20:39.991569+0000","last_unstale":"2024-08-31T04:20:57.004633+0000","last_undegraded":"2024-08-31T04:20:57.004633+0000","last_fullsized":"2024-08-31T04:20:57.004633+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_clean_scrub_stamp":"2024-08-31T04:20:38.871450+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:44:04.375810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"78'1","reported_seq":22,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:20:57.002559+0000","last_change":"2024-08-31T04:20:42.939721+0000","last_active":"2024-08-31T04:20:57.002559+0000","last_peered":"2024-08-31T04:20:57.002559+0000","last_clean":"2024-08-31T04:20:57.002559+0000","last_became_active":"2024-08-31T04:20:42.939380+0000","last_became_peered":"2024-08-31T04:20:42.939380+0000","last_unstale":"2024-08-31T04:20:57.002559+0000","last_undegraded":"2024-08-31T04:20:57.002559+0000","last_fullsized":"2024-08-31T04:20:57.002559+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:55:06.901719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"78'4","reported_seq":32,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:21:01.047625+0000","last_change":"2024-08-31T04:20:39.990968+0000","last_active":"2024-08-31T04:21:01.047625+0000","last_peered":"2024-08-31T04:21:01.047625+0000","last_clean":"2024-08-31T04:21:01.047625+0000","last_became_active":"2024-08-31T04:20:39.990583+0000","last_became_peered":"2024-08-31T04:20:39.990583+0000","last_unstale":"2024-08-31T04:21:01.047625+0000","last_undegraded":"2024-08-31T04:21:01.047625+0000","last_fullsized":"2024-08-31T04:21:01.047625+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_clean_scrub_stamp":"2024-08-31T04:20:38.871450+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:54:39.168179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":21,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:20:56.998550+0000","last_change":"2024-08-31T04:20:42.932914+0000","last_active":"2024-08-31T04:20:56.998550+0000","last_peered":"2024-08-31T04:20:56.998550+0000","last_clean":"2024-08-31T04:20:56.998550+0000","last_became_active":"2024-08-31T04:20:42.932523+0000","last_became_peered":"2024-08-31T04:20:42.932523+0000","last_unstale":"2024-08-31T04:20:56.998550+0000","last_undegraded":"2024-08-31T04:20:56.998550+0000","last_fullsized":"2024-08-31T04:20:56.998550+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:52:49.133428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"78'15","reported_seq":42,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:21:12.952412+0000","last_change":"2024-08-31T04:20:39.903373+0000","last_active":"2024-08-31T04:21:12.952412+0000","last_peered":"2024-08-31T04:21:12.952412+0000","last_clean":"2024-08-31T04:21:12.952412+0000","last_became_active":"2024-08-31T04:20:39.902784+0000","last_became_peered":"2024-08-31T04:20:39.902784+0000","last_unstale":"2024-08-31T04:21:12.952412+0000","last_undegraded":"2024-08-31T04:21:12.952412+0000","last_fullsized":"2024-08-31T04:21:12.952412+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_clean_scrub_stamp":"2024-08-31T04:20:38.871450+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:43:32.251846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":21,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:20:57.338679+0000","last_change":"2024-08-31T04:20:42.939252+0000","last_active":"2024-08-31T04:20:57.338679+0000","last_peered":"2024-08-31T04:20:57.338679+0000","last_clean":"2024-08-31T04:20:57.338679+0000","last_became_active":"2024-08-31T04:20:42.936671+0000","last_became_peered":"2024-08-31T04:20:42.936671+0000","last_unstale":"2024-08-31T04:20:57.338679+0000","last_undegraded":"2024-08-31T04:20:57.338679+0000","last_fullsized":"2024-08-31T04:20:57.338679+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:37:57.544627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"78'7","reported_seq":35,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:21:01.049714+0000","last_change":"2024-08-31T04:20:40.202412+0000","last_active":"2024-08-31T04:21:01.049714+0000","last_peered":"2024-08-31T04:21:01.049714+0000","last_clean":"2024-08-31T04:21:01.049714+0000","last_became_active":"2024-08-31T04:20:40.202000+0000","last_became_peered":"2024-08-31T04:20:40.202000+0000","last_unstale":"2024-08-31T04:21:01.049714+0000","last_undegraded":"2024-08-31T04:21:01.049714+0000","last_fullsized":"2024-08-31T04:21:01.049714+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_clean_scrub_stamp":"2024-08-31T04:20:38.871450+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:24:23.528379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":21,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:20:57.001587+0000","last_change":"2024-08-31T04:20:42.949174+0000","last_active":"2024-08-31T04:20:57.001587+0000","last_peered":"2024-08-31T04:20:57.001587+0000","last_clean":"2024-08-31T04:20:57.001587+0000","last_became_active":"2024-08-31T04:20:42.948013+0000","last_became_peered":"2024-08-31T04:20:42.948013+0000","last_unstale":"2024-08-31T04:20:57.001587+0000","last_undegraded":"2024-08-31T04:20:57.001587+0000","last_fullsized":"2024-08-31T04:20:57.001587+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:36:00.572991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"76'2","reported_seq":29,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:20:57.223195+0000","last_change":"2024-08-31T04:20:39.992477+0000","last_active":"2024-08-31T04:20:57.223195+0000","last_peered":"2024-08-31T04:20:57.223195+0000","last_clean":"2024-08-31T04:20:57.223195+0000","last_became_active":"2024-08-31T04:20:39.992082+0000","last_became_peered":"2024-08-31T04:20:39.992082+0000","last_unstale":"2024-08-31T04:20:57.223195+0000","last_undegraded":"2024-08-31T04:20:57.223195+0000","last_fullsized":"2024-08-31T04:20:57.223195+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_clean_scrub_stamp":"2024-08-31T04:20:38.871450+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:10:35.058693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":21,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:20:57.005828+0000","last_change":"2024-08-31T04:20:42.933915+0000","last_active":"2024-08-31T04:20:57.005828+0000","last_peered":"2024-08-31T04:20:57.005828+0000","last_clean":"2024-08-31T04:20:57.005828+0000","last_became_active":"2024-08-31T04:20:42.933525+0000","last_became_peered":"2024-08-31T04:20:42.933525+0000","last_unstale":"2024-08-31T04:20:57.005828+0000","last_undegraded":"2024-08-31T04:20:57.005828+0000","last_fullsized":"2024-08-31T04:20:57.005828+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:03:35.191136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"78'7","reported_seq":34,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:21:01.047578+0000","last_change":"2024-08-31T04:20:39.903979+0000","last_active":"2024-08-31T04:21:01.047578+0000","last_peered":"2024-08-31T04:21:01.047578+0000","last_clean":"2024-08-31T04:21:01.047578+0000","last_became_active":"2024-08-31T04:20:39.903538+0000","last_became_peered":"2024-08-31T04:20:39.903538+0000","last_unstale":"2024-08-31T04:21:01.047578+0000","last_undegraded":"2024-08-31T04:21:01.047578+0000","last_fullsized":"2024-08-31T04:21:01.047578+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_clean_scrub_stamp":"2024-08-31T04:20:38.871450+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:25:15.944692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":21,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:20:57.001683+0000","last_change":"2024-08-31T04:20:42.947511+0000","last_active":"2024-08-31T04:20:57.001683+0000","last_peered":"2024-08-31T04:20:57.001683+0000","last_clean":"2024-08-31T04:20:57.001683+0000","last_became_active":"2024-08-31T04:20:42.947116+0000","last_became_peered":"2024-08-31T04:20:42.947116+0000","last_unstale":"2024-08-31T04:20:57.001683+0000","last_undegraded":"2024-08-31T04:20:57.001683+0000","last_fullsized":"2024-08-31T04:20:57.001683+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:00:53.022229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"78'3","reported_seq":30,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:20:57.004076+0000","last_change":"2024-08-31T04:20:39.903409+0000","last_active":"2024-08-31T04:20:57.004076+0000","last_peered":"2024-08-31T04:20:57.004076+0000","last_clean":"2024-08-31T04:20:57.004076+0000","last_became_active":"2024-08-31T04:20:39.900366+0000","last_became_peered":"2024-08-31T04:20:39.900366+0000","last_unstale":"2024-08-31T04:20:57.004076+0000","last_undegraded":"2024-08-31T04:20:57.004076+0000","last_fullsized":"2024-08-31T04:20:57.004076+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_clean_scrub_stamp":"2024-08-31T04:20:38.871450+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:01:24.809923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":21,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:20:57.338464+0000","last_change":"2024-08-31T04:20:42.953207+0000","last_active":"2024-08-31T04:20:57.338464+0000","last_peered":"2024-08-31T04:20:57.338464+0000","last_clean":"2024-08-31T04:20:57.338464+0000","last_became_active":"2024-08-31T04:20:42.952854+0000","last_became_peered":"2024-08-31T04:20:42.952854+0000","last_unstale":"2024-08-31T04:20:57.338464+0000","last_undegraded":"2024-08-31T04:20:57.338464+0000","last_fullsized":"2024-08-31T04:20:57.338464+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:33:11.495216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"76'4","reported_seq":21,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:21:00.180014+0000","last_change":"2024-08-31T04:20:57.016087+0000","last_active":"2024-08-31T04:21:00.180014+0000","last_peered":"2024-08-31T04:21:00.180014+0000","last_clean":"2024-08-31T04:21:00.180014+0000","last_became_active":"2024-08-31T04:20:57.005476+0000","last_became_peered":"2024-08-31T04:20:57.005476+0000","last_unstale":"2024-08-31T04:21:00.180014+0000","last_undegraded":"2024-08-31T04:21:00.180014+0000","last_fullsized":"2024-08-31T04:21:00.180014+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_clean_scrub_stamp":"2024-08-31T04:20:38.871450+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:22:21.768548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,7],"acting":[11,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":21,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:20:57.003500+0000","last_change":"2024-08-31T04:20:42.933249+0000","last_active":"2024-08-31T04:20:57.003500+0000","last_peered":"2024-08-31T04:20:57.003500+0000","last_clean":"2024-08-31T04:20:57.003500+0000","last_became_active":"2024-08-31T04:20:42.931651+0000","last_became_peered":"2024-08-31T04:20:42.931651+0000","last_unstale":"2024-08-31T04:20:57.003500+0000","last_undegraded":"2024-08-31T04:20:57.003500+0000","last_fullsized":"2024-08-31T04:20:57.003500+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T06:40:21.010108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":21,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:20:57.000156+0000","last_change":"2024-08-31T04:20:42.942418+0000","last_active":"2024-08-31T04:20:57.000156+0000","last_peered":"2024-08-31T04:20:57.000156+0000","last_clean":"2024-08-31T04:20:57.000156+0000","last_became_active":"2024-08-31T04:20:42.942072+0000","last_became_peered":"2024-08-31T04:20:42.942072+0000","last_unstale":"2024-08-31T04:20:57.000156+0000","last_undegraded":"2024-08-31T04:20:57.000156+0000","last_fullsized":"2024-08-31T04:20:57.000156+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T04:41:38.816730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"78'5","reported_seq":33,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:21:01.049947+0000","last_change":"2024-08-31T04:20:39.903399+0000","last_active":"2024-08-31T04:21:01.049947+0000","last_peered":"2024-08-31T04:21:01.049947+0000","last_clean":"2024-08-31T04:21:01.049947+0000","last_became_active":"2024-08-31T04:20:39.902732+0000","last_became_peered":"2024-08-31T04:20:39.902732+0000","last_unstale":"2024-08-31T04:21:01.049947+0000","last_undegraded":"2024-08-31T04:21:01.049947+0000","last_fullsized":"2024-08-31T04:21:01.049947+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_clean_scrub_stamp":"2024-08-31T04:20:38.871450+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:07:25.324109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":21,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:20:57.223222+0000","last_change":"2024-08-31T04:20:42.931570+0000","last_active":"2024-08-31T04:20:57.223222+0000","last_peered":"2024-08-31T04:20:57.223222+0000","last_clean":"2024-08-31T04:20:57.223222+0000","last_became_active":"2024-08-31T04:20:42.931162+0000","last_became_peered":"2024-08-31T04:20:42.931162+0000","last_unstale":"2024-08-31T04:20:57.223222+0000","last_undegraded":"2024-08-31T04:20:57.223222+0000","last_fullsized":"2024-08-31T04:20:57.223222+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:55:58.784723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"78'12","reported_seq":27,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:21:02.054140+0000","last_change":"2024-08-31T04:20:57.020014+0000","last_active":"2024-08-31T04:21:02.054140+0000","last_peered":"2024-08-31T04:21:02.054140+0000","last_clean":"2024-08-31T04:21:02.054140+0000","last_became_active":"2024-08-31T04:20:57.009489+0000","last_became_peered":"2024-08-31T04:20:57.009489+0000","last_unstale":"2024-08-31T04:21:02.054140+0000","last_undegraded":"2024-08-31T04:21:02.054140+0000","last_fullsized":"2024-08-31T04:21:02.054140+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_clean_scrub_stamp":"2024-08-31T04:20:38.871450+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T05:22:57.227296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":10,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,7],"acting":[11,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":21,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:20:57.001803+0000","last_change":"2024-08-31T04:20:42.947868+0000","last_active":"2024-08-31T04:20:57.001803+0000","last_peered":"2024-08-31T04:20:57.001803+0000","last_clean":"2024-08-31T04:20:57.001803+0000","last_became_active":"2024-08-31T04:20:42.946628+0000","last_became_peered":"2024-08-31T04:20:42.946628+0000","last_unstale":"2024-08-31T04:20:57.001803+0000","last_undegraded":"2024-08-31T04:20:57.001803+0000","last_fullsized":"2024-08-31T04:20:57.001803+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:47:10.939205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"76'2","reported_seq":29,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:20:57.338782+0000","last_change":"2024-08-31T04:20:39.991234+0000","last_active":"2024-08-31T04:20:57.338782+0000","last_peered":"2024-08-31T04:20:57.338782+0000","last_clean":"2024-08-31T04:20:57.338782+0000","last_became_active":"2024-08-31T04:20:39.990416+0000","last_became_peered":"2024-08-31T04:20:39.990416+0000","last_unstale":"2024-08-31T04:20:57.338782+0000","last_undegraded":"2024-08-31T04:20:57.338782+0000","last_fullsized":"2024-08-31T04:20:57.338782+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_clean_scrub_stamp":"2024-08-31T04:20:38.871450+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:47:43.392522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":21,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:20:57.338520+0000","last_change":"2024-08-31T04:20:42.942017+0000","last_active":"2024-08-31T04:20:57.338520+0000","last_peered":"2024-08-31T04:20:57.338520+0000","last_clean":"2024-08-31T04:20:57.338520+0000","last_became_active":"2024-08-31T04:20:42.939661+0000","last_became_peered":"2024-08-31T04:20:42.939661+0000","last_unstale":"2024-08-31T04:20:57.338520+0000","last_undegraded":"2024-08-31T04:20:57.338520+0000","last_fullsized":"2024-08-31T04:20:57.338520+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:13:39.521066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"78'13","reported_seq":55,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:21:14.081718+0000","last_change":"2024-08-31T04:20:39.905996+0000","last_active":"2024-08-31T04:21:14.081718+0000","last_peered":"2024-08-31T04:21:14.081718+0000","last_clean":"2024-08-31T04:21:14.081718+0000","last_became_active":"2024-08-31T04:20:39.905622+0000","last_became_peered":"2024-08-31T04:20:39.905622+0000","last_unstale":"2024-08-31T04:21:14.081718+0000","last_undegraded":"2024-08-31T04:21:14.081718+0000","last_fullsized":"2024-08-31T04:21:14.081718+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_clean_scrub_stamp":"2024-08-31T04:20:38.871450+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:53:36.672295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":61962,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":185,"num_read_kb":161,"num_write":242,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":622,"num_keys_recovered":10,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":552960,"data_stored":185886,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":208,"ondisk_log_size":208,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":245760,"data_stored":2951840,"data_compressed":181705,"data_compressed_allocated":225280,"data_compressed_original":2949120,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":68,"seq":292057776148,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32012,"kb_used_data":828,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713140,"statfs":{"total":95995035648,"available":95962255360,"internally_reserved":0,"allocated":847872,"data_stored":413656,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":63,"seq":270582939672,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27996,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717156,"statfs":{"total":95995035648,"available":95966367744,"internally_reserved":0,"allocated":995328,"data_stored":1054795,"data_compressed":36341,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":58,"seq":249108103199,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36196,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708956,"statfs":{"total":95995035648,"available":95957970944,"internally_reserved":0,"allocated":872448,"data_stored":413195,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,5,6,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":52,"seq":223338299427,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27872,"kb_used_data":848,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717280,"statfs":{"total":95995035648,"available":95966494720,"internally_reserved":0,"allocated":868352,"data_stored":413573,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":47,"seq":201863462954,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27924,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717228,"statfs":{"total":95995035648,"available":95966441472,"internally_reserved":0,"allocated":921600,"data_stored":1006482,"data_compressed":36341,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":42,"seq":180388626478,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32020,"kb_used_data":836,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713132,"statfs":{"total":95995035648,"available":95962247168,"internally_reserved":0,"allocated":856064,"data_stored":412912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":36,"seq":154618822709,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27936,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717216,"statfs":{"total":95995035648,"available":95966429184,"internally_reserved":0,"allocated":933888,"data_stored":1005769,"data_compressed":36341,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986233,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27860,"kb_used_data":836,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717292,"statfs":{"total":95995035648,"available":95966507008,"internally_reserved":0,"allocated":856064,"data_stored":413164,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182461,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36196,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708956,"statfs":{"total":95995035648,"available":95957970944,"internally_reserved":0,"allocated":872448,"data_stored":412737,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411397,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27928,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717224,"statfs":{"total":95995035648,"available":95966437376,"internally_reserved":0,"allocated":925696,"data_stored":468181,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574922,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27924,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717228,"statfs":{"total":95995035648,"available":95966441472,"internally_reserved":0,"allocated":921600,"data_stored":469205,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738445,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27880,"kb_used_data":856,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717272,"statfs":{"total":95995035648,"available":95966486528,"internally_reserved":0,"allocated":876544,"data_stored":414642,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36341,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36341,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36341,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36341,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36341,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2569,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":57132,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":56108,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1091,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3211,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3924,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":56494,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1583,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-31T04:21:19.680 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-08-31T04:21:19.681 INFO:tasks.cephadm:Setting up client nodes... 2024-08-31T04:21:19.681 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 058d9fc6-674f-11ef-bcd4-c7b262605968 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-08-31T04:21:20.061 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:21:20.376 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:21:20 smithi050 ceph-mon[17259]: from='client.24826 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-31T04:21:20.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:21:20 smithi177 ceph-mon[22025]: from='client.24826 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-31T04:21:20.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:21:20 smithi133 ceph-mon[22177]: from='client.24826 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-31T04:21:20.670 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:20.668+0000 7f900ae00640 1 -- 172.21.15.50:0/2709052290 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9004078a40 msgr2=0x7f9004078e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:21:20.670 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:20.668+0000 7f900ae00640 1 --2- 172.21.15.50:0/2709052290 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9004078a40 0x7f9004078e50 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f8fec009900 tx=0x7f8fec02a480 comp rx=0 tx=0).stop 2024-08-31T04:21:20.670 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:20.668+0000 7f900ae00640 1 -- 172.21.15.50:0/2709052290 shutdown_connections 2024-08-31T04:21:20.670 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:20.668+0000 7f900ae00640 1 --2- 172.21.15.50:0/2709052290 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f90040793e0 0x7f9004079d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:20.670 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:20.668+0000 7f900ae00640 1 --2- 172.21.15.50:0/2709052290 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9004078a40 0x7f9004078e50 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:20.670 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:20.668+0000 7f900ae00640 1 --2- 172.21.15.50:0/2709052290 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f90040779b0 0x7f9004077e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:20.670 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:20.668+0000 7f900ae00640 1 -- 172.21.15.50:0/2709052290 >> 172.21.15.50:0/2709052290 conn(0x7f9004101090 msgr2=0x7f9004103540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:21:20.670 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:20.668+0000 7f900ae00640 1 -- 172.21.15.50:0/2709052290 shutdown_connections 2024-08-31T04:21:20.670 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:20.669+0000 7f900ae00640 1 -- 172.21.15.50:0/2709052290 wait complete. 2024-08-31T04:21:20.671 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:20.670+0000 7f900ae00640 1 Processor -- start 2024-08-31T04:21:20.671 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:20.670+0000 7f900ae00640 1 -- start start 2024-08-31T04:21:20.671 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:20.670+0000 7f900ae00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f90040779b0 0x7f90041a03c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:21:20.671 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:20.670+0000 7f900ae00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9004078a40 0x7f90041a0a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:21:20.671 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:20.670+0000 7f900ae00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f90040793e0 0x7f90041a15d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:21:20.672 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:20.670+0000 7f900ae00640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f90041157f0 con 0x7f90040793e0 2024-08-31T04:21:20.672 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:20.670+0000 7f900ae00640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f9004115670 con 0x7f90040779b0 2024-08-31T04:21:20.672 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:20.670+0000 7f900ae00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f9004115970 con 0x7f9004078a40 2024-08-31T04:21:20.673 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:20.670+0000 7f9008e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f90040793e0 0x7f90041a15d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:21:20.673 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:20.670+0000 7f9003e00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f90040779b0 0x7f90041a03c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:21:20.673 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:20.671+0000 7f9008e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f90040793e0 0x7f90041a15d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:37776/0 (socket says 172.21.15.50:37776) 2024-08-31T04:21:20.673 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:20.671+0000 7f9008e00640 1 -- 172.21.15.50:0/1922020761 learned_addr learned my addr 172.21.15.50:0/1922020761 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:21:20.673 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:20.671+0000 7f9003e00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f90040779b0 0x7f90041a03c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.50:45576/0 (socket says 172.21.15.50:45576) 2024-08-31T04:21:20.673 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:20.671+0000 7f8ffb400640 1 --2- 172.21.15.50:0/1922020761 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9004078a40 0x7f90041a0a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:21:20.673 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:20.671+0000 7f9008e00640 1 -- 172.21.15.50:0/1922020761 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9004078a40 msgr2=0x7f90041a0a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:21:20.673 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:20.671+0000 7f9008e00640 1 --2- 172.21.15.50:0/1922020761 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9004078a40 0x7f90041a0a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:20.673 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:20.671+0000 7f9008e00640 1 -- 172.21.15.50:0/1922020761 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f90040779b0 msgr2=0x7f90041a03c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:21:20.674 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:20.671+0000 7f9008e00640 1 --2- 172.21.15.50:0/1922020761 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f90040779b0 0x7f90041a03c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:20.674 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:20.671+0000 7f9008e00640 1 -- 172.21.15.50:0/1922020761 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90041a1df0 con 0x7f90040793e0 2024-08-31T04:21:20.674 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:20.671+0000 7f9008e00640 1 --2- 172.21.15.50:0/1922020761 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f90040793e0 0x7f90041a15d0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f8ffc009fd0 tx=0x7f8ffc00b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:21:20.674 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:20.672+0000 7f9001600640 1 -- 172.21.15.50:0/1922020761 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ffc017070 con 0x7f90040793e0 2024-08-31T04:21:20.674 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:20.672+0000 7f9001600640 1 -- 172.21.15.50:0/1922020761 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8ffc003e20 con 0x7f90040793e0 2024-08-31T04:21:20.674 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:20.672+0000 7f9001600640 1 -- 172.21.15.50:0/1922020761 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ffc010460 con 0x7f90040793e0 2024-08-31T04:21:20.674 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:20.672+0000 7f900ae00640 1 -- 172.21.15.50:0/1922020761 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f90041a20e0 con 0x7f90040793e0 2024-08-31T04:21:20.674 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:20.672+0000 7f900ae00640 1 -- 172.21.15.50:0/1922020761 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f90041a87e0 con 0x7f90040793e0 2024-08-31T04:21:20.674 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:20.673+0000 7f900ae00640 1 -- 172.21.15.50:0/1922020761 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9004078e50 con 0x7f90040793e0 2024-08-31T04:21:20.676 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:20.675+0000 7f9001600640 1 -- 172.21.15.50:0/1922020761 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 17) ==== 152628+0+0 (secure 0 0 0) 0x7f8ffc003970 con 0x7f90040793e0 2024-08-31T04:21:20.678 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:20.677+0000 7f9001600640 1 --2- 172.21.15.50:0/1922020761 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f8fe80b4c40 0x7f8fe80b7150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:21:20.678 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:20.677+0000 7f9001600640 1 -- 172.21.15.50:0/1922020761 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8219+0+0 (secure 0 0 0) 0x7f8ffc0e4f80 con 0x7f90040793e0 2024-08-31T04:21:20.678 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:20.677+0000 7f9003e00640 1 --2- 172.21.15.50:0/1922020761 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f8fe80b4c40 0x7f8fe80b7150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:21:20.679 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:20.678+0000 7f9003e00640 1 --2- 172.21.15.50:0/1922020761 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f8fe80b4c40 0x7f8fe80b7150 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f8ff400bbe0 tx=0x7f8ff400b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:21:20.680 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:20.679+0000 7f9001600640 1 -- 172.21.15.50:0/1922020761 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f8ffc0ab930 con 0x7f90040793e0 2024-08-31T04:21:20.945 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:20.944+0000 7f900ae00640 1 -- 172.21.15.50:0/1922020761 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) -- 0x7f900402e430 con 0x7f90040793e0 2024-08-31T04:21:20.949 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:20.948+0000 7f9001600640 1 -- 172.21.15.50:0/1922020761 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v32) ==== 170+0+59 (secure 0 0 0) 0x7f8ffc0b00f0 con 0x7f90040793e0 2024-08-31T04:21:20.950 INFO:teuthology.orchestra.run.smithi050.stdout:[client.0] 2024-08-31T04:21:20.950 INFO:teuthology.orchestra.run.smithi050.stdout: key = AQBAmtJmzrNiOBAAJywTe61bC7i5rruQSwFfhg== 2024-08-31T04:21:20.952 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:20.950+0000 7f900ae00640 1 -- 172.21.15.50:0/1922020761 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f8fe80b4c40 msgr2=0x7f8fe80b7150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:21:20.952 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:20.950+0000 7f900ae00640 1 --2- 172.21.15.50:0/1922020761 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f8fe80b4c40 0x7f8fe80b7150 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f8ff400bbe0 tx=0x7f8ff400b390 comp rx=0 tx=0).stop 2024-08-31T04:21:20.952 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:20.950+0000 7f900ae00640 1 -- 172.21.15.50:0/1922020761 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f90040793e0 msgr2=0x7f90041a15d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:21:20.952 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:20.950+0000 7f900ae00640 1 --2- 172.21.15.50:0/1922020761 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f90040793e0 0x7f90041a15d0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f8ffc009fd0 tx=0x7f8ffc00b260 comp rx=0 tx=0).stop 2024-08-31T04:21:20.952 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:20.951+0000 7f900ae00640 1 -- 172.21.15.50:0/1922020761 shutdown_connections 2024-08-31T04:21:20.952 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:20.951+0000 7f900ae00640 1 --2- 172.21.15.50:0/1922020761 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f8fe80b4c40 0x7f8fe80b7150 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:20.952 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:20.951+0000 7f900ae00640 1 --2- 172.21.15.50:0/1922020761 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9004078a40 0x7f90041a0a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:20.952 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:20.951+0000 7f900ae00640 1 --2- 172.21.15.50:0/1922020761 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f90040793e0 0x7f90041a15d0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:20.952 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:20.951+0000 7f900ae00640 1 --2- 172.21.15.50:0/1922020761 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f90040779b0 0x7f90041a03c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:20.953 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:20.951+0000 7f900ae00640 1 -- 172.21.15.50:0/1922020761 >> 172.21.15.50:0/1922020761 conn(0x7f9004101090 msgr2=0x7f900410fb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:21:20.953 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:20.951+0000 7f900ae00640 1 -- 172.21.15.50:0/1922020761 shutdown_connections 2024-08-31T04:21:20.953 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:20.951+0000 7f900ae00640 1 -- 172.21.15.50:0/1922020761 wait complete. 2024-08-31T04:21:21.200 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:21:21 smithi050 ceph-mon[17259]: pgmap v320: 97 pgs: 97 active+clean; 637 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 2.8 KiB/s wr, 10 op/s 2024-08-31T04:21:21.200 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:21:21 smithi050 ceph-mon[17259]: from='client.? 172.21.15.50:0/1922020761' entity='client.admin' cmd={"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} : dispatch 2024-08-31T04:21:21.200 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:21:21 smithi050 ceph-mon[17259]: from='client.? 172.21.15.50:0/1922020761' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-08-31T04:21:21.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:21:21 smithi177 ceph-mon[22025]: pgmap v320: 97 pgs: 97 active+clean; 637 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 2.8 KiB/s wr, 10 op/s 2024-08-31T04:21:21.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:21:21 smithi177 ceph-mon[22025]: from='client.? 172.21.15.50:0/1922020761' entity='client.admin' cmd={"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} : dispatch 2024-08-31T04:21:21.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:21:21 smithi177 ceph-mon[22025]: from='client.? 172.21.15.50:0/1922020761' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-08-31T04:21:21.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:21:21 smithi133 ceph-mon[22177]: pgmap v320: 97 pgs: 97 active+clean; 637 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 2.8 KiB/s wr, 10 op/s 2024-08-31T04:21:21.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:21:21 smithi133 ceph-mon[22177]: from='client.? 172.21.15.50:0/1922020761' entity='client.admin' cmd={"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} : dispatch 2024-08-31T04:21:21.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:21:21 smithi133 ceph-mon[22177]: from='client.? 172.21.15.50:0/1922020761' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-08-31T04:21:21.736 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-08-31T04:21:21.736 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2024-08-31T04:21:21.736 DEBUG:teuthology.orchestra.run.smithi050:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-08-31T04:21:21.818 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 058d9fc6-674f-11ef-bcd4-c7b262605968 -- ceph config log 1 --format=json 2024-08-31T04:21:22.238 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:21:22.849 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:22.847+0000 7f3e60600640 1 -- 172.21.15.50:0/1321195295 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3e58075550 msgr2=0x7f3e58075960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:21:22.849 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:22.847+0000 7f3e60600640 1 --2- 172.21.15.50:0/1321195295 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3e58075550 0x7f3e58075960 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f3e4c009860 tx=0x7f3e4c02a340 comp rx=0 tx=0).stop 2024-08-31T04:21:22.849 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:22.847+0000 7f3e60600640 1 -- 172.21.15.50:0/1321195295 shutdown_connections 2024-08-31T04:21:22.850 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:22.847+0000 7f3e60600640 1 --2- 172.21.15.50:0/1321195295 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3e58075ea0 0x7f3e5810f920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:22.850 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:22.847+0000 7f3e60600640 1 --2- 172.21.15.50:0/1321195295 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3e5810fe60 0x7f3e581122a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:22.850 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:22.847+0000 7f3e60600640 1 --2- 172.21.15.50:0/1321195295 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3e58075550 0x7f3e58075960 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:22.850 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:22.847+0000 7f3e60600640 1 -- 172.21.15.50:0/1321195295 >> 172.21.15.50:0/1321195295 conn(0x7f3e5807b5f0 msgr2=0x7f3e5807ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:21:22.850 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:22.847+0000 7f3e60600640 1 -- 172.21.15.50:0/1321195295 shutdown_connections 2024-08-31T04:21:22.850 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:22.847+0000 7f3e60600640 1 -- 172.21.15.50:0/1321195295 wait complete. 2024-08-31T04:21:22.850 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:22.848+0000 7f3e60600640 1 Processor -- start 2024-08-31T04:21:22.850 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:22.848+0000 7f3e60600640 1 -- start start 2024-08-31T04:21:22.851 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:22.849+0000 7f3e60600640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3e58075550 0x7f3e5819c460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:21:22.851 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:22.849+0000 7f3e60600640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3e58075ea0 0x7f3e5819ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:21:22.851 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:22.849+0000 7f3e60600640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3e5810fe60 0x7f3e581a1ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:21:22.851 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:22.849+0000 7f3e60600640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f3e58115a10 con 0x7f3e58075ea0 2024-08-31T04:21:22.852 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:22.849+0000 7f3e60600640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f3e58115890 con 0x7f3e58075550 2024-08-31T04:21:22.852 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:22.849+0000 7f3e60600640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f3e58115b90 con 0x7f3e5810fe60 2024-08-31T04:21:22.852 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:22.849+0000 7f3e5dc00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3e58075550 0x7f3e5819c460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:21:22.852 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:22.849+0000 7f3e5dc00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3e58075550 0x7f3e5819c460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.50:45592/0 (socket says 172.21.15.50:45592) 2024-08-31T04:21:22.852 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:22.849+0000 7f3e5dc00640 1 -- 172.21.15.50:0/583685453 learned_addr learned my addr 172.21.15.50:0/583685453 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:21:22.852 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:22.849+0000 7f3e5e600640 1 --2- 172.21.15.50:0/583685453 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3e5810fe60 0x7f3e581a1ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:21:22.852 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:22.849+0000 7f3e5d200640 1 --2- 172.21.15.50:0/583685453 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3e58075ea0 0x7f3e5819ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:21:22.852 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:22.849+0000 7f3e5e600640 1 -- 172.21.15.50:0/583685453 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3e58075550 msgr2=0x7f3e5819c460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:21:22.852 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:22.850+0000 7f3e5e600640 1 --2- 172.21.15.50:0/583685453 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3e58075550 0x7f3e5819c460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:22.852 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:22.850+0000 7f3e5e600640 1 -- 172.21.15.50:0/583685453 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3e58075ea0 msgr2=0x7f3e5819ca00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:21:22.852 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:22.850+0000 7f3e5e600640 1 --2- 172.21.15.50:0/583685453 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3e58075ea0 0x7f3e5819ca00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:22.852 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:22.850+0000 7f3e5e600640 1 -- 172.21.15.50:0/583685453 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e581a23d0 con 0x7f3e5810fe60 2024-08-31T04:21:22.852 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:22.850+0000 7f3e5dc00640 1 --2- 172.21.15.50:0/583685453 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3e58075550 0x7f3e5819c460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:21:22.853 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:22.850+0000 7f3e5e600640 1 --2- 172.21.15.50:0/583685453 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3e5810fe60 0x7f3e581a1ca0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f3e5000efc0 tx=0x7f3e5000c800 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:21:22.853 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:22.850+0000 7f3e56000640 1 -- 172.21.15.50:0/583685453 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e50003970 con 0x7f3e5810fe60 2024-08-31T04:21:22.853 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:22.850+0000 7f3e56000640 1 -- 172.21.15.50:0/583685453 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3e50004020 con 0x7f3e5810fe60 2024-08-31T04:21:22.853 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:22.850+0000 7f3e60600640 1 -- 172.21.15.50:0/583685453 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3e581a26c0 con 0x7f3e5810fe60 2024-08-31T04:21:22.853 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:22.850+0000 7f3e56000640 1 -- 172.21.15.50:0/583685453 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e5000b940 con 0x7f3e5810fe60 2024-08-31T04:21:22.853 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:22.850+0000 7f3e60600640 1 -- 172.21.15.50:0/583685453 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3e581a8e20 con 0x7f3e5810fe60 2024-08-31T04:21:22.854 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:22.851+0000 7f3e60600640 1 -- 172.21.15.50:0/583685453 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3e58075960 con 0x7f3e5810fe60 2024-08-31T04:21:22.855 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:22.854+0000 7f3e56000640 1 -- 172.21.15.50:0/583685453 <== mon.1 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 17) ==== 152628+0+0 (secure 0 0 0) 0x7f3e5001d020 con 0x7f3e5810fe60 2024-08-31T04:21:22.856 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:22.855+0000 7f3e56000640 1 --2- 172.21.15.50:0/583685453 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f3e400b4bc0 0x7f3e400b70d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:21:22.856 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:22.855+0000 7f3e56000640 1 -- 172.21.15.50:0/583685453 <== mon.1 v2:172.21.15.177:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8219+0+0 (secure 0 0 0) 0x7f3e500e5790 con 0x7f3e5810fe60 2024-08-31T04:21:22.857 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:22.855+0000 7f3e5dc00640 1 --2- 172.21.15.50:0/583685453 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f3e400b4bc0 0x7f3e400b70d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:21:22.857 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:22.856+0000 7f3e5dc00640 1 --2- 172.21.15.50:0/583685453 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f3e400b4bc0 0x7f3e400b70d0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f3e4c0095f0 tx=0x7f3e4c030340 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:21:22.858 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:22.857+0000 7f3e56000640 1 -- 172.21.15.50:0/583685453 <== mon.1 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f3e500ac710 con 0x7f3e5810fe60 2024-08-31T04:21:23.061 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:23.060+0000 7f3e60600640 1 -- 172.21.15.50:0/583685453 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "config log", "num": 1, "format": "json"} v 0) -- 0x7f3e5819d590 con 0x7f3e5810fe60 2024-08-31T04:21:23.062 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:23.061+0000 7f3e56000640 1 -- 172.21.15.50:0/583685453 <== mon.1 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "config log", "num": 1, "format": "json"}]=0 v48) ==== 86+0+133 (secure 0 0 0) 0x7f3e500ac010 con 0x7f3e5810fe60 2024-08-31T04:21:23.062 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-08-31T04:21:23.065 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:23.063+0000 7f3e60600640 1 -- 172.21.15.50:0/583685453 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f3e400b4bc0 msgr2=0x7f3e400b70d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:21:23.065 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:23.063+0000 7f3e60600640 1 --2- 172.21.15.50:0/583685453 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f3e400b4bc0 0x7f3e400b70d0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f3e4c0095f0 tx=0x7f3e4c030340 comp rx=0 tx=0).stop 2024-08-31T04:21:23.065 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:23.063+0000 7f3e60600640 1 -- 172.21.15.50:0/583685453 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3e5810fe60 msgr2=0x7f3e581a1ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:21:23.065 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:23.063+0000 7f3e60600640 1 --2- 172.21.15.50:0/583685453 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3e5810fe60 0x7f3e581a1ca0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f3e5000efc0 tx=0x7f3e5000c800 comp rx=0 tx=0).stop 2024-08-31T04:21:23.065 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:23.063+0000 7f3e60600640 1 -- 172.21.15.50:0/583685453 shutdown_connections 2024-08-31T04:21:23.065 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:23.063+0000 7f3e60600640 1 --2- 172.21.15.50:0/583685453 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f3e400b4bc0 0x7f3e400b70d0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:23.065 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:23.063+0000 7f3e60600640 1 --2- 172.21.15.50:0/583685453 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3e5810fe60 0x7f3e581a1ca0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:23.066 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:23.063+0000 7f3e60600640 1 --2- 172.21.15.50:0/583685453 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3e58075ea0 0x7f3e5819ca00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:23.066 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:23.063+0000 7f3e60600640 1 --2- 172.21.15.50:0/583685453 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3e58075550 0x7f3e5819c460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:23.066 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:23.063+0000 7f3e60600640 1 -- 172.21.15.50:0/583685453 >> 172.21.15.50:0/583685453 conn(0x7f3e5807b5f0 msgr2=0x7f3e581005d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:21:23.066 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:23.064+0000 7f3e60600640 1 -- 172.21.15.50:0/583685453 shutdown_connections 2024-08-31T04:21:23.066 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:23.064+0000 7f3e60600640 1 -- 172.21.15.50:0/583685453 wait complete. 2024-08-31T04:21:23.387 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:21:23 smithi050 ceph-mon[17259]: pgmap v321: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 3.5 KiB/s wr, 14 op/s 2024-08-31T04:21:23.387 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:21:23 smithi050 ceph-mon[17259]: from='client.? 172.21.15.50:0/583685453' entity='client.admin' cmd={"prefix": "config log", "num": 1, "format": "json"} : dispatch 2024-08-31T04:21:23.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:21:23 smithi177 ceph-mon[22025]: pgmap v321: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 3.5 KiB/s wr, 14 op/s 2024-08-31T04:21:23.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:21:23 smithi177 ceph-mon[22025]: from='client.? 172.21.15.50:0/583685453' entity='client.admin' cmd={"prefix": "config log", "num": 1, "format": "json"} : dispatch 2024-08-31T04:21:23.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:21:23 smithi133 ceph-mon[22177]: pgmap v321: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 3.5 KiB/s wr, 14 op/s 2024-08-31T04:21:23.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:21:23 smithi133 ceph-mon[22177]: from='client.? 172.21.15.50:0/583685453' entity='client.admin' cmd={"prefix": "config log", "num": 1, "format": "json"} : dispatch 2024-08-31T04:21:23.769 INFO:teuthology.orchestra.run.smithi050.stdout:[{"version":48,"timestamp":"2024-08-31T04:20:31.120897+0000","name":"","changes":[{"name":"mds.all/mds_join_fs","new_value":"all"}]}] 2024-08-31T04:21:23.769 INFO:tasks.ceph_manager:config epoch is 48 2024-08-31T04:21:23.769 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-08-31T04:21:23.769 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2024-08-31T04:21:23.769 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 058d9fc6-674f-11ef-bcd4-c7b262605968 -- ceph mgr dump --format=json 2024-08-31T04:21:24.147 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:21:24.747 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:24.745+0000 7f59e9000640 1 -- 172.21.15.50:0/1000554732 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f59e4109090 msgr2=0x7f59e41094a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:21:24.747 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:24.745+0000 7f59e9000640 1 --2- 172.21.15.50:0/1000554732 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f59e4109090 0x7f59e41094a0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f59d0009900 tx=0x7f59d002a410 comp rx=0 tx=0).stop 2024-08-31T04:21:24.747 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:24.745+0000 7f59e9000640 1 -- 172.21.15.50:0/1000554732 shutdown_connections 2024-08-31T04:21:24.747 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:24.745+0000 7f59e9000640 1 --2- 172.21.15.50:0/1000554732 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f59e41099e0 0x7f59e4110210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:24.747 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:24.745+0000 7f59e9000640 1 --2- 172.21.15.50:0/1000554732 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f59e4109090 0x7f59e41094a0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:24.747 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:24.745+0000 7f59e9000640 1 --2- 172.21.15.50:0/1000554732 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f59e4103750 0x7f59e4103b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:24.747 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:24.745+0000 7f59e9000640 1 -- 172.21.15.50:0/1000554732 >> 172.21.15.50:0/1000554732 conn(0x7f59e40ff1a0 msgr2=0x7f59e41015f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:21:24.747 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:24.745+0000 7f59e9000640 1 -- 172.21.15.50:0/1000554732 shutdown_connections 2024-08-31T04:21:24.748 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:24.745+0000 7f59e9000640 1 -- 172.21.15.50:0/1000554732 wait complete. 2024-08-31T04:21:24.748 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:24.746+0000 7f59e9000640 1 Processor -- start 2024-08-31T04:21:24.749 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:24.746+0000 7f59e9000640 1 -- start start 2024-08-31T04:21:24.749 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:24.747+0000 7f59e9000640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f59e4103750 0x7f59e419c280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:21:24.749 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:24.747+0000 7f59e9000640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f59e4109090 0x7f59e419c820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:21:24.749 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:24.747+0000 7f59e9000640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f59e41099e0 0x7f59e41a1ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:21:24.749 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:24.747+0000 7f59e9000640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f59e4113670 con 0x7f59e41099e0 2024-08-31T04:21:24.749 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:24.747+0000 7f59e9000640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f59e41134f0 con 0x7f59e4103750 2024-08-31T04:21:24.749 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:24.747+0000 7f59e9000640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f59e41137f0 con 0x7f59e4109090 2024-08-31T04:21:24.749 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:24.747+0000 7f59e3400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f59e4103750 0x7f59e419c280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:21:24.749 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:24.747+0000 7f59e3e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f59e41099e0 0x7f59e41a1ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:21:24.749 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:24.747+0000 7f59e3400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f59e4103750 0x7f59e419c280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.50:41224/0 (socket says 172.21.15.50:41224) 2024-08-31T04:21:24.749 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:24.747+0000 7f59e3400640 1 -- 172.21.15.50:0/488325266 learned_addr learned my addr 172.21.15.50:0/488325266 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:21:24.749 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:24.747+0000 7f59e2a00640 1 --2- 172.21.15.50:0/488325266 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f59e4109090 0x7f59e419c820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:21:24.750 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:24.748+0000 7f59e3400640 1 -- 172.21.15.50:0/488325266 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f59e4109090 msgr2=0x7f59e419c820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:21:24.750 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:24.748+0000 7f59e3400640 1 --2- 172.21.15.50:0/488325266 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f59e4109090 0x7f59e419c820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:24.751 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:24.748+0000 7f59e3400640 1 -- 172.21.15.50:0/488325266 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f59e41099e0 msgr2=0x7f59e41a1ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:21:24.751 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:24.748+0000 7f59e3400640 1 --2- 172.21.15.50:0/488325266 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f59e41099e0 0x7f59e41a1ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:24.751 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:24.748+0000 7f59e3400640 1 -- 172.21.15.50:0/488325266 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59e41a21f0 con 0x7f59e4103750 2024-08-31T04:21:24.751 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:24.748+0000 7f59e3e00640 1 --2- 172.21.15.50:0/488325266 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f59e41099e0 0x7f59e41a1ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:21:24.751 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:24.748+0000 7f59e3400640 1 --2- 172.21.15.50:0/488325266 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f59e4103750 0x7f59e419c280 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f59d400d950 tx=0x7f59d400de10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:21:24.751 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:24.748+0000 7f59dbe00640 1 -- 172.21.15.50:0/488325266 <== mon.2 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59d4017070 con 0x7f59e4103750 2024-08-31T04:21:24.751 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:24.748+0000 7f59e9000640 1 -- 172.21.15.50:0/488325266 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f59e41a24e0 con 0x7f59e4103750 2024-08-31T04:21:24.751 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:24.748+0000 7f59dbe00640 1 -- 172.21.15.50:0/488325266 <== mon.2 v2:172.21.15.133:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f59d4009c30 con 0x7f59e4103750 2024-08-31T04:21:24.751 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:24.748+0000 7f59dbe00640 1 -- 172.21.15.50:0/488325266 <== mon.2 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59d400f620 con 0x7f59e4103750 2024-08-31T04:21:24.751 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:24.748+0000 7f59e9000640 1 -- 172.21.15.50:0/488325266 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f59e41a8c40 con 0x7f59e4103750 2024-08-31T04:21:24.751 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:24.749+0000 7f59e9000640 1 -- 172.21.15.50:0/488325266 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f59e4103b60 con 0x7f59e4103750 2024-08-31T04:21:24.753 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:24.752+0000 7f59dbe00640 1 -- 172.21.15.50:0/488325266 <== mon.2 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 17) ==== 152628+0+0 (secure 0 0 0) 0x7f59d4005030 con 0x7f59e4103750 2024-08-31T04:21:24.754 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:24.753+0000 7f59dbe00640 1 --2- 172.21.15.50:0/488325266 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f59c80b4bc0 0x7f59c80b70d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:21:24.755 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:24.754+0000 7f59dbe00640 1 -- 172.21.15.50:0/488325266 <== mon.2 v2:172.21.15.133:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8219+0+0 (secure 0 0 0) 0x7f59d40e4eb0 con 0x7f59e4103750 2024-08-31T04:21:24.755 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:24.754+0000 7f59e2a00640 1 --2- 172.21.15.50:0/488325266 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f59c80b4bc0 0x7f59c80b70d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:21:24.755 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:24.754+0000 7f59e2a00640 1 --2- 172.21.15.50:0/488325266 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f59c80b4bc0 0x7f59c80b70d0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f59d0009230 tx=0x7f59d0031400 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:21:24.756 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:24.755+0000 7f59dbe00640 1 -- 172.21.15.50:0/488325266 <== mon.2 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f59d4009de0 con 0x7f59e4103750 2024-08-31T04:21:25.006 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:25.004+0000 7f59e9000640 1 -- 172.21.15.50:0/488325266 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7f59e41a8ee0 con 0x7f59e4103750 2024-08-31T04:21:25.011 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:25.010+0000 7f59dbe00640 1 -- 172.21.15.50:0/488325266 <== mon.2 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v17) ==== 74+0+293192 (secure 0 0 0) 0x7f59d40ab7e0 con 0x7f59e4103750 2024-08-31T04:21:25.015 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-08-31T04:21:25.017 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:25.014+0000 7f59e9000640 1 -- 172.21.15.50:0/488325266 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f59c80b4bc0 msgr2=0x7f59c80b70d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:21:25.017 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:25.014+0000 7f59e9000640 1 --2- 172.21.15.50:0/488325266 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f59c80b4bc0 0x7f59c80b70d0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f59d0009230 tx=0x7f59d0031400 comp rx=0 tx=0).stop 2024-08-31T04:21:25.017 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:25.014+0000 7f59e9000640 1 -- 172.21.15.50:0/488325266 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f59e4103750 msgr2=0x7f59e419c280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:21:25.017 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:25.014+0000 7f59e9000640 1 --2- 172.21.15.50:0/488325266 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f59e4103750 0x7f59e419c280 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f59d400d950 tx=0x7f59d400de10 comp rx=0 tx=0).stop 2024-08-31T04:21:25.017 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:25.014+0000 7f59e9000640 1 -- 172.21.15.50:0/488325266 shutdown_connections 2024-08-31T04:21:25.017 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:25.014+0000 7f59e9000640 1 --2- 172.21.15.50:0/488325266 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f59c80b4bc0 0x7f59c80b70d0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:25.018 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:25.014+0000 7f59e9000640 1 --2- 172.21.15.50:0/488325266 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f59e4109090 0x7f59e419c820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:25.018 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:25.014+0000 7f59e9000640 1 --2- 172.21.15.50:0/488325266 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f59e41099e0 0x7f59e41a1ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:25.018 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:25.014+0000 7f59e9000640 1 --2- 172.21.15.50:0/488325266 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f59e4103750 0x7f59e419c280 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:25.018 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:25.014+0000 7f59e9000640 1 -- 172.21.15.50:0/488325266 >> 172.21.15.50:0/488325266 conn(0x7f59e40ff1a0 msgr2=0x7f59e4108740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:21:25.018 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:25.014+0000 7f59e9000640 1 -- 172.21.15.50:0/488325266 shutdown_connections 2024-08-31T04:21:25.018 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:25.014+0000 7f59e9000640 1 -- 172.21.15.50:0/488325266 wait complete. 2024-08-31T04:21:25.420 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:21:25 smithi050 ceph-mon[17259]: pgmap v322: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 1.2 KiB/s wr, 9 op/s 2024-08-31T04:21:25.420 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:21:25 smithi050 ceph-mon[17259]: from='client.? 172.21.15.50:0/488325266' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json"} : dispatch 2024-08-31T04:21:25.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:21:25 smithi177 ceph-mon[22025]: pgmap v322: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 1.2 KiB/s wr, 9 op/s 2024-08-31T04:21:25.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:21:25 smithi177 ceph-mon[22025]: from='client.? 172.21.15.50:0/488325266' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json"} : dispatch 2024-08-31T04:21:25.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:21:25 smithi133 ceph-mon[22177]: pgmap v322: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 1.2 KiB/s wr, 9 op/s 2024-08-31T04:21:25.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:21:25 smithi133 ceph-mon[22177]: from='client.? 172.21.15.50:0/488325266' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json"} : dispatch 2024-08-31T04:21:25.790 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":17,"flags":0,"active_gid":14150,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":2146686622},{"type":"v1","addr":"172.21.15.50:6801","nonce":2146686622}]},"active_addr":"172.21.15.50:6801/2146686622","active_change":"2024-08-31T04:12:55.742153+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":24145,"name":"z","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:1.26.1","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]},{"gid":24167,"name":"y","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:1.26.1","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:1.26.1","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://172.21.15.50:8443/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":3,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.50:0","nonce":1805013631}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.50:0","nonce":3813608256}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.50:0","nonce":2053368437}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.50:0","nonce":1427192603}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.50:0","nonce":3814013370}]}]} 2024-08-31T04:21:25.797 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2024-08-31T04:21:25.797 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2024-08-31T04:21:25.797 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 058d9fc6-674f-11ef-bcd4-c7b262605968 -- ceph osd dump --format=json 2024-08-31T04:21:26.186 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:21:26.797 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:26.795+0000 7f1352600640 1 -- 172.21.15.50:0/1799604516 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f134c1099e0 msgr2=0x7f134c110210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:21:26.797 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:26.795+0000 7f1352600640 1 --2- 172.21.15.50:0/1799604516 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f134c1099e0 0x7f134c110210 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f1344009ca0 tx=0x7f134402a8c0 comp rx=0 tx=0).stop 2024-08-31T04:21:26.797 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:26.795+0000 7f1352600640 1 -- 172.21.15.50:0/1799604516 shutdown_connections 2024-08-31T04:21:26.797 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:26.795+0000 7f1352600640 1 --2- 172.21.15.50:0/1799604516 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f134c1099e0 0x7f134c110210 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:26.797 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:26.795+0000 7f1352600640 1 --2- 172.21.15.50:0/1799604516 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f134c109090 0x7f134c1094a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:26.797 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:26.795+0000 7f1352600640 1 --2- 172.21.15.50:0/1799604516 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f134c103750 0x7f134c103b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:26.798 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:26.795+0000 7f1352600640 1 -- 172.21.15.50:0/1799604516 >> 172.21.15.50:0/1799604516 conn(0x7f134c0ff1a0 msgr2=0x7f134c1015f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:21:26.798 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:26.796+0000 7f1352600640 1 -- 172.21.15.50:0/1799604516 shutdown_connections 2024-08-31T04:21:26.798 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:26.796+0000 7f1352600640 1 -- 172.21.15.50:0/1799604516 wait complete. 2024-08-31T04:21:26.799 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:26.797+0000 7f1352600640 1 Processor -- start 2024-08-31T04:21:26.799 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:26.797+0000 7f1352600640 1 -- start start 2024-08-31T04:21:26.799 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:26.797+0000 7f1352600640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f134c103750 0x7f134c19c1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:21:26.799 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:26.797+0000 7f1352600640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f134c109090 0x7f134c19c780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:21:26.799 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:26.797+0000 7f1352600640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f134c1099e0 0x7f134c1a1a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:21:26.799 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:26.797+0000 7f1352600640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f134c113690 con 0x7f134c103750 2024-08-31T04:21:26.799 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:26.797+0000 7f1352600640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f134c113510 con 0x7f134c109090 2024-08-31T04:21:26.799 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:26.797+0000 7f1352600640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f134c113810 con 0x7f134c1099e0 2024-08-31T04:21:26.799 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:26.798+0000 7f1351200640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f134c103750 0x7f134c19c1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:21:26.799 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:26.798+0000 7f1351200640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f134c103750 0x7f134c19c1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:42648/0 (socket says 172.21.15.50:42648) 2024-08-31T04:21:26.799 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:26.798+0000 7f1351200640 1 -- 172.21.15.50:0/4013648802 learned_addr learned my addr 172.21.15.50:0/4013648802 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:21:26.799 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:26.798+0000 7f134be00640 1 --2- 172.21.15.50:0/4013648802 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f134c109090 0x7f134c19c780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:21:26.800 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:26.798+0000 7f1351c00640 1 --2- 172.21.15.50:0/4013648802 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f134c1099e0 0x7f134c1a1a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:21:26.800 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:26.798+0000 7f1351200640 1 -- 172.21.15.50:0/4013648802 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f134c1099e0 msgr2=0x7f134c1a1a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:21:26.800 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:26.798+0000 7f1351200640 1 --2- 172.21.15.50:0/4013648802 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f134c1099e0 0x7f134c1a1a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:26.801 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:26.798+0000 7f1351200640 1 -- 172.21.15.50:0/4013648802 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f134c109090 msgr2=0x7f134c19c780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:21:26.801 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:26.798+0000 7f1351200640 1 --2- 172.21.15.50:0/4013648802 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f134c109090 0x7f134c19c780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:26.801 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:26.798+0000 7f1351200640 1 -- 172.21.15.50:0/4013648802 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f134c1a2150 con 0x7f134c103750 2024-08-31T04:21:26.801 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:26.798+0000 7f134be00640 1 --2- 172.21.15.50:0/4013648802 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f134c109090 0x7f134c19c780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:21:26.801 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:26.798+0000 7f1351200640 1 --2- 172.21.15.50:0/4013648802 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f134c103750 0x7f134c19c1e0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f134000e9f0 tx=0x7f134000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:21:26.801 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:26.799+0000 7f1349600640 1 -- 172.21.15.50:0/4013648802 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f134000cd80 con 0x7f134c103750 2024-08-31T04:21:26.801 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:26.799+0000 7f1349600640 1 -- 172.21.15.50:0/4013648802 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f13400108e0 con 0x7f134c103750 2024-08-31T04:21:26.801 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:26.799+0000 7f1352600640 1 -- 172.21.15.50:0/4013648802 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f134c1a2440 con 0x7f134c103750 2024-08-31T04:21:26.801 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:26.799+0000 7f1349600640 1 -- 172.21.15.50:0/4013648802 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1340018980 con 0x7f134c103750 2024-08-31T04:21:26.801 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:26.799+0000 7f1352600640 1 -- 172.21.15.50:0/4013648802 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f134c1a8ba0 con 0x7f134c103750 2024-08-31T04:21:26.802 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:26.800+0000 7f1352600640 1 -- 172.21.15.50:0/4013648802 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f134c103b60 con 0x7f134c103750 2024-08-31T04:21:26.804 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:26.803+0000 7f1349600640 1 -- 172.21.15.50:0/4013648802 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 17) ==== 152628+0+0 (secure 0 0 0) 0x7f1340010430 con 0x7f134c103750 2024-08-31T04:21:26.806 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:26.805+0000 7f1349600640 1 --2- 172.21.15.50:0/4013648802 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f13340b4bc0 0x7f13340b70d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:21:26.806 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:26.805+0000 7f1349600640 1 -- 172.21.15.50:0/4013648802 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8219+0+0 (secure 0 0 0) 0x7f13400e5b10 con 0x7f134c103750 2024-08-31T04:21:26.806 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:26.805+0000 7f134be00640 1 --2- 172.21.15.50:0/4013648802 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f13340b4bc0 0x7f13340b70d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:21:26.807 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:26.806+0000 7f134be00640 1 --2- 172.21.15.50:0/4013648802 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f13340b4bc0 0x7f13340b70d0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f134c107990 tx=0x7f1338005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:21:26.807 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:26.806+0000 7f1349600640 1 -- 172.21.15.50:0/4013648802 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f13400ac440 con 0x7f134c103750 2024-08-31T04:21:27.005 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:27.003+0000 7f1352600640 1 -- 172.21.15.50:0/4013648802 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f134c1a8f90 con 0x7f134c103750 2024-08-31T04:21:27.006 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:27.005+0000 7f1349600640 1 -- 172.21.15.50:0/4013648802 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v78) ==== 74+0+22733 (secure 0 0 0) 0x7f13400b0c00 con 0x7f134c103750 2024-08-31T04:21:27.006 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-08-31T04:21:27.007 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":78,"fsid":"058d9fc6-674f-11ef-bcd4-c7b262605968","created":"2024-08-31T04:11:59.576131+0000","modified":"2024-08-31T04:20:56.994402+0000","last_up_change":"2024-08-31T04:19:44.619590+0000","last_in_change":"2024-08-31T04:19:21.022096+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-31T04:15:46.229142+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-31T04:20:38.249458+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"76","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-31T04:20:40.929092+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"76","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"416ecbde-4a7b-4bd1-b377-490925a33ce1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":3831273843},{"type":"v1","addr":"172.21.15.50:6803","nonce":3831273843}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":3831273843},{"type":"v1","addr":"172.21.15.50:6805","nonce":3831273843}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":3831273843},{"type":"v1","addr":"172.21.15.50:6809","nonce":3831273843}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":3831273843},{"type":"v1","addr":"172.21.15.50:6807","nonce":3831273843}]},"public_addr":"172.21.15.50:6803/3831273843","cluster_addr":"172.21.15.50:6805/3831273843","heartbeat_back_addr":"172.21.15.50:6809/3831273843","heartbeat_front_addr":"172.21.15.50:6807/3831273843","state":["exists","up"]},{"osd":1,"uuid":"5e008006-004d-4842-9885-93a2d27be1cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":475308203},{"type":"v1","addr":"172.21.15.133:6801","nonce":475308203}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":475308203},{"type":"v1","addr":"172.21.15.133:6803","nonce":475308203}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":475308203},{"type":"v1","addr":"172.21.15.133:6807","nonce":475308203}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":475308203},{"type":"v1","addr":"172.21.15.133:6805","nonce":475308203}]},"public_addr":"172.21.15.133:6801/475308203","cluster_addr":"172.21.15.133:6803/475308203","heartbeat_back_addr":"172.21.15.133:6807/475308203","heartbeat_front_addr":"172.21.15.133:6805/475308203","state":["exists","up"]},{"osd":2,"uuid":"7e6f1a26-f30d-4822-af69-8a08cb89fbce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":3091173426},{"type":"v1","addr":"172.21.15.177:6801","nonce":3091173426}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":3091173426},{"type":"v1","addr":"172.21.15.177:6803","nonce":3091173426}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":3091173426},{"type":"v1","addr":"172.21.15.177:6807","nonce":3091173426}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":3091173426},{"type":"v1","addr":"172.21.15.177:6805","nonce":3091173426}]},"public_addr":"172.21.15.177:6801/3091173426","cluster_addr":"172.21.15.177:6803/3091173426","heartbeat_back_addr":"172.21.15.177:6807/3091173426","heartbeat_front_addr":"172.21.15.177:6805/3091173426","state":["exists","up"]},{"osd":3,"uuid":"8193c2a2-18a1-4684-9a16-cbeae25530ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":3792992620},{"type":"v1","addr":"172.21.15.50:6811","nonce":3792992620}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":3792992620},{"type":"v1","addr":"172.21.15.50:6813","nonce":3792992620}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":3792992620},{"type":"v1","addr":"172.21.15.50:6817","nonce":3792992620}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":3792992620},{"type":"v1","addr":"172.21.15.50:6815","nonce":3792992620}]},"public_addr":"172.21.15.50:6811/3792992620","cluster_addr":"172.21.15.50:6813/3792992620","heartbeat_back_addr":"172.21.15.50:6817/3792992620","heartbeat_front_addr":"172.21.15.50:6815/3792992620","state":["exists","up"]},{"osd":4,"uuid":"2a2b4e64-0f8e-40ec-926c-84dbf691aefe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":2855333596},{"type":"v1","addr":"172.21.15.133:6809","nonce":2855333596}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":2855333596},{"type":"v1","addr":"172.21.15.133:6811","nonce":2855333596}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":2855333596},{"type":"v1","addr":"172.21.15.133:6815","nonce":2855333596}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":2855333596},{"type":"v1","addr":"172.21.15.133:6813","nonce":2855333596}]},"public_addr":"172.21.15.133:6809/2855333596","cluster_addr":"172.21.15.133:6811/2855333596","heartbeat_back_addr":"172.21.15.133:6815/2855333596","heartbeat_front_addr":"172.21.15.133:6813/2855333596","state":["exists","up"]},{"osd":5,"uuid":"83429ff0-ea7d-4fcc-9611-39d9001aa216","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":1166415084},{"type":"v1","addr":"172.21.15.177:6809","nonce":1166415084}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":1166415084},{"type":"v1","addr":"172.21.15.177:6811","nonce":1166415084}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":1166415084},{"type":"v1","addr":"172.21.15.177:6815","nonce":1166415084}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":1166415084},{"type":"v1","addr":"172.21.15.177:6813","nonce":1166415084}]},"public_addr":"172.21.15.177:6809/1166415084","cluster_addr":"172.21.15.177:6811/1166415084","heartbeat_back_addr":"172.21.15.177:6815/1166415084","heartbeat_front_addr":"172.21.15.177:6813/1166415084","state":["exists","up"]},{"osd":6,"uuid":"eeb571ef-5e43-4816-95dd-d01d83aeca83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":1429341184},{"type":"v1","addr":"172.21.15.50:6819","nonce":1429341184}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":1429341184},{"type":"v1","addr":"172.21.15.50:6821","nonce":1429341184}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":1429341184},{"type":"v1","addr":"172.21.15.50:6825","nonce":1429341184}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":1429341184},{"type":"v1","addr":"172.21.15.50:6823","nonce":1429341184}]},"public_addr":"172.21.15.50:6819/1429341184","cluster_addr":"172.21.15.50:6821/1429341184","heartbeat_back_addr":"172.21.15.50:6825/1429341184","heartbeat_front_addr":"172.21.15.50:6823/1429341184","state":["exists","up"]},{"osd":7,"uuid":"512ee507-0d50-4fed-b692-dbdf23a93e8e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":3643454923},{"type":"v1","addr":"172.21.15.133:6817","nonce":3643454923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":3643454923},{"type":"v1","addr":"172.21.15.133:6819","nonce":3643454923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":3643454923},{"type":"v1","addr":"172.21.15.133:6823","nonce":3643454923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":3643454923},{"type":"v1","addr":"172.21.15.133:6821","nonce":3643454923}]},"public_addr":"172.21.15.133:6817/3643454923","cluster_addr":"172.21.15.133:6819/3643454923","heartbeat_back_addr":"172.21.15.133:6823/3643454923","heartbeat_front_addr":"172.21.15.133:6821/3643454923","state":["exists","up"]},{"osd":8,"uuid":"ae99526e-41da-4cb5-857f-2e66f18f2d94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6816","nonce":101973300},{"type":"v1","addr":"172.21.15.177:6817","nonce":101973300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":101973300},{"type":"v1","addr":"172.21.15.177:6819","nonce":101973300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":101973300},{"type":"v1","addr":"172.21.15.177:6823","nonce":101973300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":101973300},{"type":"v1","addr":"172.21.15.177:6821","nonce":101973300}]},"public_addr":"172.21.15.177:6817/101973300","cluster_addr":"172.21.15.177:6819/101973300","heartbeat_back_addr":"172.21.15.177:6823/101973300","heartbeat_front_addr":"172.21.15.177:6821/101973300","state":["exists","up"]},{"osd":9,"uuid":"fcedbe16-b910-407f-b9d7-1dd03f3e62a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":53019860},{"type":"v1","addr":"172.21.15.50:6827","nonce":53019860}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":53019860},{"type":"v1","addr":"172.21.15.50:6829","nonce":53019860}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":53019860},{"type":"v1","addr":"172.21.15.50:6833","nonce":53019860}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":53019860},{"type":"v1","addr":"172.21.15.50:6831","nonce":53019860}]},"public_addr":"172.21.15.50:6827/53019860","cluster_addr":"172.21.15.50:6829/53019860","heartbeat_back_addr":"172.21.15.50:6833/53019860","heartbeat_front_addr":"172.21.15.50:6831/53019860","state":["exists","up"]},{"osd":10,"uuid":"3852756e-62f1-4e71-a070-8cff76df99b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":4175566493},{"type":"v1","addr":"172.21.15.133:6825","nonce":4175566493}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":4175566493},{"type":"v1","addr":"172.21.15.133:6827","nonce":4175566493}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":4175566493},{"type":"v1","addr":"172.21.15.133:6831","nonce":4175566493}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":4175566493},{"type":"v1","addr":"172.21.15.133:6829","nonce":4175566493}]},"public_addr":"172.21.15.133:6825/4175566493","cluster_addr":"172.21.15.133:6827/4175566493","heartbeat_back_addr":"172.21.15.133:6831/4175566493","heartbeat_front_addr":"172.21.15.133:6829/4175566493","state":["exists","up"]},{"osd":11,"uuid":"a154180a-5f2a-4b33-ad3d-fea7317597ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":2103454982},{"type":"v1","addr":"172.21.15.177:6825","nonce":2103454982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":2103454982},{"type":"v1","addr":"172.21.15.177:6827","nonce":2103454982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":2103454982},{"type":"v1","addr":"172.21.15.177:6831","nonce":2103454982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":2103454982},{"type":"v1","addr":"172.21.15.177:6829","nonce":2103454982}]},"public_addr":"172.21.15.177:6825/2103454982","cluster_addr":"172.21.15.177:6827/2103454982","heartbeat_back_addr":"172.21.15.177:6831/2103454982","heartbeat_front_addr":"172.21.15.177:6829/2103454982","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:14:54.683660+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:15:20.007319+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:15:43.613426+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:16:12.387010+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:16:38.079210+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:17:02.750375+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:17:31.735810+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:17:57.600985+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:18:22.503347+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:18:52.316657+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:19:18.444623+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:19:42.331006+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.b","mappings":[{"from":2,"to":4},{"from":8,"to":11}]},{"pgid":"2.1b","mappings":[{"from":2,"to":1}]},{"pgid":"2.1d","mappings":[{"from":8,"to":11}]},{"pgid":"3.e","mappings":[{"from":4,"to":6}]},{"pgid":"3.17","mappings":[{"from":4,"to":8}]},{"pgid":"3.25","mappings":[{"from":5,"to":9}]},{"pgid":"3.29","mappings":[{"from":3,"to":9}]},{"pgid":"3.36","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.50:6801/1319056820":"2024-09-01T04:12:55.742020+0000","172.21.15.50:0/1755103674":"2024-09-01T04:12:55.742020+0000","172.21.15.50:6800/1319056820":"2024-09-01T04:12:55.742020+0000","172.21.15.50:0/3701412233":"2024-09-01T04:12:55.742020+0000","172.21.15.50:0/1829556336":"2024-09-01T04:12:55.742020+0000","172.21.15.50:0/1698995126":"2024-09-01T04:12:25.753831+0000","172.21.15.50:0/1554317941":"2024-09-01T04:12:25.753831+0000","172.21.15.50:0/2998110380":"2024-09-01T04:12:25.753831+0000","172.21.15.50:6801/4197277793":"2024-09-01T04:12:25.753831+0000","172.21.15.50:6800/4197277793":"2024-09-01T04:12:25.753831+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-31T04:21:27.009 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:27.007+0000 7f1352600640 1 -- 172.21.15.50:0/4013648802 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f13340b4bc0 msgr2=0x7f13340b70d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:21:27.009 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:27.007+0000 7f1352600640 1 --2- 172.21.15.50:0/4013648802 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f13340b4bc0 0x7f13340b70d0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f134c107990 tx=0x7f1338005f90 comp rx=0 tx=0).stop 2024-08-31T04:21:27.009 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:27.007+0000 7f1352600640 1 -- 172.21.15.50:0/4013648802 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f134c103750 msgr2=0x7f134c19c1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:21:27.009 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:27.007+0000 7f1352600640 1 --2- 172.21.15.50:0/4013648802 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f134c103750 0x7f134c19c1e0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f134000e9f0 tx=0x7f134000eeb0 comp rx=0 tx=0).stop 2024-08-31T04:21:27.009 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:27.007+0000 7f1352600640 1 -- 172.21.15.50:0/4013648802 shutdown_connections 2024-08-31T04:21:27.009 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:27.007+0000 7f1352600640 1 --2- 172.21.15.50:0/4013648802 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f13340b4bc0 0x7f13340b70d0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:27.009 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:27.007+0000 7f1352600640 1 --2- 172.21.15.50:0/4013648802 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f134c1099e0 0x7f134c1a1a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:27.010 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:27.007+0000 7f1352600640 1 --2- 172.21.15.50:0/4013648802 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f134c109090 0x7f134c19c780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:27.010 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:27.007+0000 7f1352600640 1 --2- 172.21.15.50:0/4013648802 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f134c103750 0x7f134c19c1e0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:27.010 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:27.008+0000 7f1352600640 1 -- 172.21.15.50:0/4013648802 >> 172.21.15.50:0/4013648802 conn(0x7f134c0ff1a0 msgr2=0x7f134c10e4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:21:27.010 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:27.008+0000 7f1352600640 1 -- 172.21.15.50:0/4013648802 shutdown_connections 2024-08-31T04:21:27.010 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:27.008+0000 7f1352600640 1 -- 172.21.15.50:0/4013648802 wait complete. 2024-08-31T04:21:27.364 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:21:27 smithi050 ceph-mon[17259]: pgmap v323: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 1.2 KiB/s wr, 11 op/s 2024-08-31T04:21:27.364 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:21:27 smithi050 ceph-mon[17259]: from='client.? 172.21.15.50:0/4013648802' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-31T04:21:27.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:21:27 smithi177 ceph-mon[22025]: pgmap v323: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 1.2 KiB/s wr, 11 op/s 2024-08-31T04:21:27.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:21:27 smithi177 ceph-mon[22025]: from='client.? 172.21.15.50:0/4013648802' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-31T04:21:27.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:21:27 smithi133 ceph-mon[22177]: pgmap v323: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 1.2 KiB/s wr, 11 op/s 2024-08-31T04:21:27.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:21:27 smithi133 ceph-mon[22177]: from='client.? 172.21.15.50:0/4013648802' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-31T04:21:27.731 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2024-08-31T04:21:27.731 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 058d9fc6-674f-11ef-bcd4-c7b262605968 -- ceph osd dump --format=json 2024-08-31T04:21:28.113 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:21:28.698 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:28.697+0000 7f9612a00640 1 -- 172.21.15.50:0/4177610800 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f960c109b90 msgr2=0x7f960c1103c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:21:28.699 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:28.697+0000 7f9612a00640 1 --2- 172.21.15.50:0/4177610800 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f960c109b90 0x7f960c1103c0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f9604009ca0 tx=0x7f960402a8c0 comp rx=0 tx=0).stop 2024-08-31T04:21:28.699 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:28.697+0000 7f9612a00640 1 -- 172.21.15.50:0/4177610800 shutdown_connections 2024-08-31T04:21:28.699 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:28.697+0000 7f9612a00640 1 --2- 172.21.15.50:0/4177610800 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f960c109b90 0x7f960c1103c0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:28.699 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:28.697+0000 7f9612a00640 1 --2- 172.21.15.50:0/4177610800 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f960c109240 0x7f960c109650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:28.699 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:28.697+0000 7f9612a00640 1 --2- 172.21.15.50:0/4177610800 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f960c103900 0x7f960c103d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:28.699 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:28.697+0000 7f9612a00640 1 -- 172.21.15.50:0/4177610800 >> 172.21.15.50:0/4177610800 conn(0x7f960c07b5f0 msgr2=0x7f960c07ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:21:28.699 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:28.697+0000 7f9612a00640 1 -- 172.21.15.50:0/4177610800 shutdown_connections 2024-08-31T04:21:28.699 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:28.697+0000 7f9612a00640 1 -- 172.21.15.50:0/4177610800 wait complete. 2024-08-31T04:21:28.701 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:28.698+0000 7f9612a00640 1 Processor -- start 2024-08-31T04:21:28.701 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:28.698+0000 7f9612a00640 1 -- start start 2024-08-31T04:21:28.701 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:28.698+0000 7f9612a00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f960c103900 0x7f960c0754b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:21:28.701 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:28.698+0000 7f9612a00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f960c109240 0x7f960c0759f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:21:28.701 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:28.699+0000 7f9612a00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f960c109b90 0x7f960c075f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:21:28.701 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:28.699+0000 7f9612a00640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f960c113850 con 0x7f960c109b90 2024-08-31T04:21:28.701 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:28.699+0000 7f9612a00640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f960c1136d0 con 0x7f960c103900 2024-08-31T04:21:28.701 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:28.699+0000 7f9612a00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f960c1139d0 con 0x7f960c109240 2024-08-31T04:21:28.701 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:28.699+0000 7f9610a00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f960c109b90 0x7f960c075f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:21:28.702 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:28.699+0000 7f9610a00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f960c109b90 0x7f960c075f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:42680/0 (socket says 172.21.15.50:42680) 2024-08-31T04:21:28.702 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:28.699+0000 7f9610a00640 1 -- 172.21.15.50:0/2952717845 learned_addr learned my addr 172.21.15.50:0/2952717845 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:21:28.702 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:28.699+0000 7f960b400640 1 --2- 172.21.15.50:0/2952717845 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f960c109240 0x7f960c0759f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:21:28.702 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:28.699+0000 7f960be00640 1 --2- 172.21.15.50:0/2952717845 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f960c103900 0x7f960c0754b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:21:28.702 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:28.699+0000 7f9610a00640 1 -- 172.21.15.50:0/2952717845 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f960c109240 msgr2=0x7f960c0759f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:21:28.702 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:28.699+0000 7f9610a00640 1 --2- 172.21.15.50:0/2952717845 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f960c109240 0x7f960c0759f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:28.702 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:28.699+0000 7f9610a00640 1 -- 172.21.15.50:0/2952717845 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f960c103900 msgr2=0x7f960c0754b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:21:28.702 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:28.699+0000 7f9610a00640 1 --2- 172.21.15.50:0/2952717845 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f960c103900 0x7f960c0754b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:28.702 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:28.699+0000 7f9610a00640 1 -- 172.21.15.50:0/2952717845 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f960c1a8420 con 0x7f960c109b90 2024-08-31T04:21:28.702 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:28.700+0000 7f9610a00640 1 --2- 172.21.15.50:0/2952717845 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f960c109b90 0x7f960c075f30 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f9604005cc0 tx=0x7f9604031700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:21:28.703 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:28.700+0000 7f9608c00640 1 -- 172.21.15.50:0/2952717845 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9604003b70 con 0x7f960c109b90 2024-08-31T04:21:28.703 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:28.700+0000 7f9608c00640 1 -- 172.21.15.50:0/2952717845 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f96040318f0 con 0x7f960c109b90 2024-08-31T04:21:28.703 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:28.700+0000 7f9612a00640 1 -- 172.21.15.50:0/2952717845 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f960c1a86b0 con 0x7f960c109b90 2024-08-31T04:21:28.704 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:28.700+0000 7f9608c00640 1 -- 172.21.15.50:0/2952717845 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f960402f950 con 0x7f960c109b90 2024-08-31T04:21:28.704 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:28.700+0000 7f9612a00640 1 -- 172.21.15.50:0/2952717845 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f960c1a8bf0 con 0x7f960c109b90 2024-08-31T04:21:28.704 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:28.701+0000 7f9612a00640 1 -- 172.21.15.50:0/2952717845 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f960c103d10 con 0x7f960c109b90 2024-08-31T04:21:28.704 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:28.703+0000 7f9608c00640 1 -- 172.21.15.50:0/2952717845 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 17) ==== 152628+0+0 (secure 0 0 0) 0x7f960402fb30 con 0x7f960c109b90 2024-08-31T04:21:28.707 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:28.706+0000 7f9608c00640 1 --2- 172.21.15.50:0/2952717845 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f95f00b4bc0 0x7f95f00b70d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:21:28.707 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:28.706+0000 7f9608c00640 1 -- 172.21.15.50:0/2952717845 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8219+0+0 (secure 0 0 0) 0x7f9604106600 con 0x7f960c109b90 2024-08-31T04:21:28.707 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:28.706+0000 7f960be00640 1 --2- 172.21.15.50:0/2952717845 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f95f00b4bc0 0x7f95f00b70d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:21:28.708 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:28.707+0000 7f960be00640 1 --2- 172.21.15.50:0/2952717845 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f95f00b4bc0 0x7f95f00b70d0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f960c076f00 tx=0x7f95fc005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:21:28.710 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:28.708+0000 7f9608c00640 1 -- 172.21.15.50:0/2952717845 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f96040cd580 con 0x7f960c109b90 2024-08-31T04:21:28.906 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:28.905+0000 7f9612a00640 1 -- 172.21.15.50:0/2952717845 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f960c10b9e0 con 0x7f960c109b90 2024-08-31T04:21:28.908 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:28.907+0000 7f9608c00640 1 -- 172.21.15.50:0/2952717845 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v78) ==== 74+0+22733 (secure 0 0 0) 0x7f96040cce80 con 0x7f960c109b90 2024-08-31T04:21:28.908 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-08-31T04:21:28.909 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":78,"fsid":"058d9fc6-674f-11ef-bcd4-c7b262605968","created":"2024-08-31T04:11:59.576131+0000","modified":"2024-08-31T04:20:56.994402+0000","last_up_change":"2024-08-31T04:19:44.619590+0000","last_in_change":"2024-08-31T04:19:21.022096+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-31T04:15:46.229142+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-31T04:20:38.249458+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"76","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-31T04:20:40.929092+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"76","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"416ecbde-4a7b-4bd1-b377-490925a33ce1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":3831273843},{"type":"v1","addr":"172.21.15.50:6803","nonce":3831273843}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":3831273843},{"type":"v1","addr":"172.21.15.50:6805","nonce":3831273843}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":3831273843},{"type":"v1","addr":"172.21.15.50:6809","nonce":3831273843}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":3831273843},{"type":"v1","addr":"172.21.15.50:6807","nonce":3831273843}]},"public_addr":"172.21.15.50:6803/3831273843","cluster_addr":"172.21.15.50:6805/3831273843","heartbeat_back_addr":"172.21.15.50:6809/3831273843","heartbeat_front_addr":"172.21.15.50:6807/3831273843","state":["exists","up"]},{"osd":1,"uuid":"5e008006-004d-4842-9885-93a2d27be1cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":475308203},{"type":"v1","addr":"172.21.15.133:6801","nonce":475308203}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":475308203},{"type":"v1","addr":"172.21.15.133:6803","nonce":475308203}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":475308203},{"type":"v1","addr":"172.21.15.133:6807","nonce":475308203}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":475308203},{"type":"v1","addr":"172.21.15.133:6805","nonce":475308203}]},"public_addr":"172.21.15.133:6801/475308203","cluster_addr":"172.21.15.133:6803/475308203","heartbeat_back_addr":"172.21.15.133:6807/475308203","heartbeat_front_addr":"172.21.15.133:6805/475308203","state":["exists","up"]},{"osd":2,"uuid":"7e6f1a26-f30d-4822-af69-8a08cb89fbce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":3091173426},{"type":"v1","addr":"172.21.15.177:6801","nonce":3091173426}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":3091173426},{"type":"v1","addr":"172.21.15.177:6803","nonce":3091173426}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":3091173426},{"type":"v1","addr":"172.21.15.177:6807","nonce":3091173426}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":3091173426},{"type":"v1","addr":"172.21.15.177:6805","nonce":3091173426}]},"public_addr":"172.21.15.177:6801/3091173426","cluster_addr":"172.21.15.177:6803/3091173426","heartbeat_back_addr":"172.21.15.177:6807/3091173426","heartbeat_front_addr":"172.21.15.177:6805/3091173426","state":["exists","up"]},{"osd":3,"uuid":"8193c2a2-18a1-4684-9a16-cbeae25530ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":3792992620},{"type":"v1","addr":"172.21.15.50:6811","nonce":3792992620}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":3792992620},{"type":"v1","addr":"172.21.15.50:6813","nonce":3792992620}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":3792992620},{"type":"v1","addr":"172.21.15.50:6817","nonce":3792992620}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":3792992620},{"type":"v1","addr":"172.21.15.50:6815","nonce":3792992620}]},"public_addr":"172.21.15.50:6811/3792992620","cluster_addr":"172.21.15.50:6813/3792992620","heartbeat_back_addr":"172.21.15.50:6817/3792992620","heartbeat_front_addr":"172.21.15.50:6815/3792992620","state":["exists","up"]},{"osd":4,"uuid":"2a2b4e64-0f8e-40ec-926c-84dbf691aefe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":2855333596},{"type":"v1","addr":"172.21.15.133:6809","nonce":2855333596}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":2855333596},{"type":"v1","addr":"172.21.15.133:6811","nonce":2855333596}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":2855333596},{"type":"v1","addr":"172.21.15.133:6815","nonce":2855333596}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":2855333596},{"type":"v1","addr":"172.21.15.133:6813","nonce":2855333596}]},"public_addr":"172.21.15.133:6809/2855333596","cluster_addr":"172.21.15.133:6811/2855333596","heartbeat_back_addr":"172.21.15.133:6815/2855333596","heartbeat_front_addr":"172.21.15.133:6813/2855333596","state":["exists","up"]},{"osd":5,"uuid":"83429ff0-ea7d-4fcc-9611-39d9001aa216","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":1166415084},{"type":"v1","addr":"172.21.15.177:6809","nonce":1166415084}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":1166415084},{"type":"v1","addr":"172.21.15.177:6811","nonce":1166415084}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":1166415084},{"type":"v1","addr":"172.21.15.177:6815","nonce":1166415084}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":1166415084},{"type":"v1","addr":"172.21.15.177:6813","nonce":1166415084}]},"public_addr":"172.21.15.177:6809/1166415084","cluster_addr":"172.21.15.177:6811/1166415084","heartbeat_back_addr":"172.21.15.177:6815/1166415084","heartbeat_front_addr":"172.21.15.177:6813/1166415084","state":["exists","up"]},{"osd":6,"uuid":"eeb571ef-5e43-4816-95dd-d01d83aeca83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":1429341184},{"type":"v1","addr":"172.21.15.50:6819","nonce":1429341184}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":1429341184},{"type":"v1","addr":"172.21.15.50:6821","nonce":1429341184}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":1429341184},{"type":"v1","addr":"172.21.15.50:6825","nonce":1429341184}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":1429341184},{"type":"v1","addr":"172.21.15.50:6823","nonce":1429341184}]},"public_addr":"172.21.15.50:6819/1429341184","cluster_addr":"172.21.15.50:6821/1429341184","heartbeat_back_addr":"172.21.15.50:6825/1429341184","heartbeat_front_addr":"172.21.15.50:6823/1429341184","state":["exists","up"]},{"osd":7,"uuid":"512ee507-0d50-4fed-b692-dbdf23a93e8e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":3643454923},{"type":"v1","addr":"172.21.15.133:6817","nonce":3643454923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":3643454923},{"type":"v1","addr":"172.21.15.133:6819","nonce":3643454923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":3643454923},{"type":"v1","addr":"172.21.15.133:6823","nonce":3643454923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":3643454923},{"type":"v1","addr":"172.21.15.133:6821","nonce":3643454923}]},"public_addr":"172.21.15.133:6817/3643454923","cluster_addr":"172.21.15.133:6819/3643454923","heartbeat_back_addr":"172.21.15.133:6823/3643454923","heartbeat_front_addr":"172.21.15.133:6821/3643454923","state":["exists","up"]},{"osd":8,"uuid":"ae99526e-41da-4cb5-857f-2e66f18f2d94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6816","nonce":101973300},{"type":"v1","addr":"172.21.15.177:6817","nonce":101973300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":101973300},{"type":"v1","addr":"172.21.15.177:6819","nonce":101973300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":101973300},{"type":"v1","addr":"172.21.15.177:6823","nonce":101973300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":101973300},{"type":"v1","addr":"172.21.15.177:6821","nonce":101973300}]},"public_addr":"172.21.15.177:6817/101973300","cluster_addr":"172.21.15.177:6819/101973300","heartbeat_back_addr":"172.21.15.177:6823/101973300","heartbeat_front_addr":"172.21.15.177:6821/101973300","state":["exists","up"]},{"osd":9,"uuid":"fcedbe16-b910-407f-b9d7-1dd03f3e62a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":53019860},{"type":"v1","addr":"172.21.15.50:6827","nonce":53019860}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":53019860},{"type":"v1","addr":"172.21.15.50:6829","nonce":53019860}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":53019860},{"type":"v1","addr":"172.21.15.50:6833","nonce":53019860}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":53019860},{"type":"v1","addr":"172.21.15.50:6831","nonce":53019860}]},"public_addr":"172.21.15.50:6827/53019860","cluster_addr":"172.21.15.50:6829/53019860","heartbeat_back_addr":"172.21.15.50:6833/53019860","heartbeat_front_addr":"172.21.15.50:6831/53019860","state":["exists","up"]},{"osd":10,"uuid":"3852756e-62f1-4e71-a070-8cff76df99b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":4175566493},{"type":"v1","addr":"172.21.15.133:6825","nonce":4175566493}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":4175566493},{"type":"v1","addr":"172.21.15.133:6827","nonce":4175566493}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":4175566493},{"type":"v1","addr":"172.21.15.133:6831","nonce":4175566493}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":4175566493},{"type":"v1","addr":"172.21.15.133:6829","nonce":4175566493}]},"public_addr":"172.21.15.133:6825/4175566493","cluster_addr":"172.21.15.133:6827/4175566493","heartbeat_back_addr":"172.21.15.133:6831/4175566493","heartbeat_front_addr":"172.21.15.133:6829/4175566493","state":["exists","up"]},{"osd":11,"uuid":"a154180a-5f2a-4b33-ad3d-fea7317597ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":2103454982},{"type":"v1","addr":"172.21.15.177:6825","nonce":2103454982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":2103454982},{"type":"v1","addr":"172.21.15.177:6827","nonce":2103454982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":2103454982},{"type":"v1","addr":"172.21.15.177:6831","nonce":2103454982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":2103454982},{"type":"v1","addr":"172.21.15.177:6829","nonce":2103454982}]},"public_addr":"172.21.15.177:6825/2103454982","cluster_addr":"172.21.15.177:6827/2103454982","heartbeat_back_addr":"172.21.15.177:6831/2103454982","heartbeat_front_addr":"172.21.15.177:6829/2103454982","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:14:54.683660+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:15:20.007319+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:15:43.613426+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:16:12.387010+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:16:38.079210+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:17:02.750375+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:17:31.735810+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:17:57.600985+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:18:22.503347+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:18:52.316657+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:19:18.444623+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:19:42.331006+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.b","mappings":[{"from":2,"to":4},{"from":8,"to":11}]},{"pgid":"2.1b","mappings":[{"from":2,"to":1}]},{"pgid":"2.1d","mappings":[{"from":8,"to":11}]},{"pgid":"3.e","mappings":[{"from":4,"to":6}]},{"pgid":"3.17","mappings":[{"from":4,"to":8}]},{"pgid":"3.25","mappings":[{"from":5,"to":9}]},{"pgid":"3.29","mappings":[{"from":3,"to":9}]},{"pgid":"3.36","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.50:6801/1319056820":"2024-09-01T04:12:55.742020+0000","172.21.15.50:0/1755103674":"2024-09-01T04:12:55.742020+0000","172.21.15.50:6800/1319056820":"2024-09-01T04:12:55.742020+0000","172.21.15.50:0/3701412233":"2024-09-01T04:12:55.742020+0000","172.21.15.50:0/1829556336":"2024-09-01T04:12:55.742020+0000","172.21.15.50:0/1698995126":"2024-09-01T04:12:25.753831+0000","172.21.15.50:0/1554317941":"2024-09-01T04:12:25.753831+0000","172.21.15.50:0/2998110380":"2024-09-01T04:12:25.753831+0000","172.21.15.50:6801/4197277793":"2024-09-01T04:12:25.753831+0000","172.21.15.50:6800/4197277793":"2024-09-01T04:12:25.753831+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-31T04:21:28.911 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:28.909+0000 7f9612a00640 1 -- 172.21.15.50:0/2952717845 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f95f00b4bc0 msgr2=0x7f95f00b70d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:21:28.911 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:28.909+0000 7f9612a00640 1 --2- 172.21.15.50:0/2952717845 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f95f00b4bc0 0x7f95f00b70d0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f960c076f00 tx=0x7f95fc005f90 comp rx=0 tx=0).stop 2024-08-31T04:21:28.911 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:28.909+0000 7f9612a00640 1 -- 172.21.15.50:0/2952717845 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f960c109b90 msgr2=0x7f960c075f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:21:28.911 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:28.909+0000 7f9612a00640 1 --2- 172.21.15.50:0/2952717845 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f960c109b90 0x7f960c075f30 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f9604005cc0 tx=0x7f9604031700 comp rx=0 tx=0).stop 2024-08-31T04:21:28.911 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:28.909+0000 7f9612a00640 1 -- 172.21.15.50:0/2952717845 shutdown_connections 2024-08-31T04:21:28.912 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:28.909+0000 7f9612a00640 1 --2- 172.21.15.50:0/2952717845 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f95f00b4bc0 0x7f95f00b70d0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:28.912 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:28.909+0000 7f9612a00640 1 --2- 172.21.15.50:0/2952717845 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f960c109240 0x7f960c0759f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:28.912 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:28.909+0000 7f9612a00640 1 --2- 172.21.15.50:0/2952717845 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f960c109b90 0x7f960c075f30 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:28.912 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:28.909+0000 7f9612a00640 1 --2- 172.21.15.50:0/2952717845 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f960c103900 0x7f960c0754b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:28.912 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:28.909+0000 7f9612a00640 1 -- 172.21.15.50:0/2952717845 >> 172.21.15.50:0/2952717845 conn(0x7f960c07b5f0 msgr2=0x7f960c1051d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:21:28.912 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:28.910+0000 7f9612a00640 1 -- 172.21.15.50:0/2952717845 shutdown_connections 2024-08-31T04:21:28.912 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:28.910+0000 7f9612a00640 1 -- 172.21.15.50:0/2952717845 wait complete. 2024-08-31T04:21:29.200 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:21:29 smithi050 ceph-mon[17259]: pgmap v324: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 1.1 KiB/s wr, 11 op/s 2024-08-31T04:21:29.200 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:21:29 smithi050 ceph-mon[17259]: from='client.? 172.21.15.50:0/2952717845' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-31T04:21:29.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:21:29 smithi177 ceph-mon[22025]: pgmap v324: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 1.1 KiB/s wr, 11 op/s 2024-08-31T04:21:29.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:21:29 smithi177 ceph-mon[22025]: from='client.? 172.21.15.50:0/2952717845' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-31T04:21:29.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:21:29 smithi133 ceph-mon[22177]: pgmap v324: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 1.1 KiB/s wr, 11 op/s 2024-08-31T04:21:29.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:21:29 smithi133 ceph-mon[22177]: from='client.? 172.21.15.50:0/2952717845' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-31T04:21:29.666 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 058d9fc6-674f-11ef-bcd4-c7b262605968 -- ceph tell osd.0 flush_pg_stats 2024-08-31T04:21:29.666 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 058d9fc6-674f-11ef-bcd4-c7b262605968 -- ceph tell osd.1 flush_pg_stats 2024-08-31T04:21:29.667 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 058d9fc6-674f-11ef-bcd4-c7b262605968 -- ceph tell osd.2 flush_pg_stats 2024-08-31T04:21:29.668 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 058d9fc6-674f-11ef-bcd4-c7b262605968 -- ceph tell osd.3 flush_pg_stats 2024-08-31T04:21:29.668 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 058d9fc6-674f-11ef-bcd4-c7b262605968 -- ceph tell osd.4 flush_pg_stats 2024-08-31T04:21:29.669 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 058d9fc6-674f-11ef-bcd4-c7b262605968 -- ceph tell osd.5 flush_pg_stats 2024-08-31T04:21:29.670 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 058d9fc6-674f-11ef-bcd4-c7b262605968 -- ceph tell osd.6 flush_pg_stats 2024-08-31T04:21:29.670 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 058d9fc6-674f-11ef-bcd4-c7b262605968 -- ceph tell osd.7 flush_pg_stats 2024-08-31T04:21:29.671 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 058d9fc6-674f-11ef-bcd4-c7b262605968 -- ceph tell osd.8 flush_pg_stats 2024-08-31T04:21:29.671 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 058d9fc6-674f-11ef-bcd4-c7b262605968 -- ceph tell osd.9 flush_pg_stats 2024-08-31T04:21:29.672 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 058d9fc6-674f-11ef-bcd4-c7b262605968 -- ceph tell osd.10 flush_pg_stats 2024-08-31T04:21:29.672 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 058d9fc6-674f-11ef-bcd4-c7b262605968 -- ceph tell osd.11 flush_pg_stats 2024-08-31T04:21:30.695 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:21:30.722 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:21:30.735 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:21:30.769 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:21:30.830 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:21:30.859 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:21:30.862 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:21:31.183 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:21:31 smithi050 ceph-mon[17259]: pgmap v325: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 682 B/s wr, 9 op/s 2024-08-31T04:21:31.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:21:31 smithi177 ceph-mon[22025]: pgmap v325: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 682 B/s wr, 9 op/s 2024-08-31T04:21:31.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:21:31 smithi133 ceph-mon[22177]: pgmap v325: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 682 B/s wr, 9 op/s 2024-08-31T04:21:31.930 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:31.859+0000 7fbdd4e00640 1 -- 172.21.15.50:0/1275227889 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbdd0104450 msgr2=0x7fbdd0104860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:21:31.931 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:31.859+0000 7fbdd4e00640 1 --2- 172.21.15.50:0/1275227889 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbdd0104450 0x7fbdd0104860 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fbdc0009900 tx=0x7fbdc002a3f0 comp rx=0 tx=0).stop 2024-08-31T04:21:31.931 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:31.859+0000 7fbdd4e00640 1 -- 172.21.15.50:0/1275227889 shutdown_connections 2024-08-31T04:21:31.931 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:31.859+0000 7fbdd4e00640 1 --2- 172.21.15.50:0/1275227889 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbdd0104e80 0x7fbdd010d4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:31.931 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:31.859+0000 7fbdd4e00640 1 --2- 172.21.15.50:0/1275227889 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbdd010da00 0x7fbdd010fea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:31.931 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:31.859+0000 7fbdd4e00640 1 --2- 172.21.15.50:0/1275227889 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbdd0104450 0x7fbdd0104860 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:31.931 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:31.859+0000 7fbdd4e00640 1 -- 172.21.15.50:0/1275227889 >> 172.21.15.50:0/1275227889 conn(0x7fbdd00fe060 msgr2=0x7fbdd01004b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:21:31.931 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:31.859+0000 7fbdd4e00640 1 -- 172.21.15.50:0/1275227889 shutdown_connections 2024-08-31T04:21:31.931 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:31.859+0000 7fbdd4e00640 1 -- 172.21.15.50:0/1275227889 wait complete. 2024-08-31T04:21:31.931 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:31.860+0000 7fbdd4e00640 1 Processor -- start 2024-08-31T04:21:31.931 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:31.860+0000 7fbdd4e00640 1 -- start start 2024-08-31T04:21:31.931 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:31.860+0000 7fbdd4e00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbdd0104450 0x7fbdd0102360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:21:31.931 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:31.861+0000 7fbdd4e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbdd0104e80 0x7fbdd01028a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:21:31.931 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:31.861+0000 7fbdd4e00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbdd010da00 0x7fbdd0102de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:21:31.932 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:31.861+0000 7fbdd4e00640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fbdd0113600 con 0x7fbdd0104e80 2024-08-31T04:21:31.932 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:31.861+0000 7fbdd4e00640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7fbdd0113480 con 0x7fbdd010da00 2024-08-31T04:21:31.932 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:31.861+0000 7fbdd4e00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fbdd0113780 con 0x7fbdd0104450 2024-08-31T04:21:31.932 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:31.861+0000 7fbdcf400640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbdd0104450 0x7fbdd0102360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:21:31.932 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:31.861+0000 7fbdcea00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbdd0104e80 0x7fbdd01028a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:21:31.932 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:31.861+0000 7fbdcf400640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbdd0104450 0x7fbdd0102360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.50:44906/0 (socket says 172.21.15.50:44906) 2024-08-31T04:21:31.932 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:31.861+0000 7fbdcf400640 1 -- 172.21.15.50:0/872533636 learned_addr learned my addr 172.21.15.50:0/872533636 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:21:31.932 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:31.861+0000 7fbdcfe00640 1 --2- 172.21.15.50:0/872533636 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbdd010da00 0x7fbdd0102de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:21:31.932 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:31.861+0000 7fbdcf400640 1 -- 172.21.15.50:0/872533636 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbdd010da00 msgr2=0x7fbdd0102de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:21:31.932 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:31.861+0000 7fbdcf400640 1 --2- 172.21.15.50:0/872533636 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbdd010da00 0x7fbdd0102de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:31.932 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:31.861+0000 7fbdcf400640 1 -- 172.21.15.50:0/872533636 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbdd0104e80 msgr2=0x7fbdd01028a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:21:31.933 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:31.861+0000 7fbdcf400640 1 --2- 172.21.15.50:0/872533636 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbdd0104e80 0x7fbdd01028a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:31.933 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:31.861+0000 7fbdcf400640 1 -- 172.21.15.50:0/872533636 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbdd01a82f0 con 0x7fbdd0104450 2024-08-31T04:21:31.933 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:31.861+0000 7fbdcea00640 1 --2- 172.21.15.50:0/872533636 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbdd0104e80 0x7fbdd01028a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:21:31.933 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:31.862+0000 7fbdcf400640 1 --2- 172.21.15.50:0/872533636 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbdd0104450 0x7fbdd0102360 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fbdc0005940 tx=0x7fbdc00040c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:21:31.933 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:31.862+0000 7fbdc7e00640 1 -- 172.21.15.50:0/872533636 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdc003f030 con 0x7fbdd0104450 2024-08-31T04:21:31.933 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:31.862+0000 7fbdd4e00640 1 -- 172.21.15.50:0/872533636 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbdd01a8580 con 0x7fbdd0104450 2024-08-31T04:21:31.933 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:31.862+0000 7fbdc7e00640 1 -- 172.21.15.50:0/872533636 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbdc00044c0 con 0x7fbdd0104450 2024-08-31T04:21:31.933 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:31.863+0000 7fbdc7e00640 1 -- 172.21.15.50:0/872533636 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdc0035070 con 0x7fbdd0104450 2024-08-31T04:21:31.933 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:31.863+0000 7fbdd4e00640 1 -- 172.21.15.50:0/872533636 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbdd01a8ab0 con 0x7fbdd0104450 2024-08-31T04:21:31.933 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:31.863+0000 7fbdd4e00640 1 -- 172.21.15.50:0/872533636 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fbdd00638b0 con 0x7fbdd0104450 2024-08-31T04:21:31.933 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:31.868+0000 7fbdc7e00640 1 -- 172.21.15.50:0/872533636 <== mon.1 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 17) ==== 152628+0+0 (secure 0 0 0) 0x7fbdc0042030 con 0x7fbdd0104450 2024-08-31T04:21:31.933 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:31.869+0000 7fbdc7e00640 1 --2- 172.21.15.50:0/872533636 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fbdb40b4bc0 0x7fbdb40b70d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:21:31.933 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:31.870+0000 7fbdc7e00640 1 -- 172.21.15.50:0/872533636 <== mon.1 v2:172.21.15.177:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8219+0+0 (secure 0 0 0) 0x7fbdc0105d70 con 0x7fbdd0104450 2024-08-31T04:21:31.934 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:31.870+0000 7fbdcea00640 1 --2- 172.21.15.50:0/872533636 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fbdb40b4bc0 0x7fbdb40b70d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:21:31.934 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:31.870+0000 7fbdc7e00640 1 --2- 172.21.15.50:0/872533636 >> [v2:172.21.15.177:6800/3091173426,v1:172.21.15.177:6801/3091173426] conn(0x7fbdb40be6b0 0x7fbdb40c0ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:21:31.934 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:31.870+0000 7fbdc7e00640 1 -- 172.21.15.50:0/872533636 --> [v2:172.21.15.177:6800/3091173426,v1:172.21.15.177:6801/3091173426] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fbdc003ce50 con 0x7fbdb40be6b0 2024-08-31T04:21:31.934 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:31.870+0000 7fbdc7e00640 1 -- 172.21.15.50:0/872533636 <== mon.1 v2:172.21.15.177:3300/0 6 ==== mon_get_version_reply(handle=1 version=78) ==== 24+0+0 (secure 0 0 0) 0x7fbdc0106120 con 0x7fbdd0104450 2024-08-31T04:21:31.934 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:31.870+0000 7fbdcfe00640 1 --2- 172.21.15.50:0/872533636 >> [v2:172.21.15.177:6800/3091173426,v1:172.21.15.177:6801/3091173426] conn(0x7fbdb40be6b0 0x7fbdb40c0ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:21:31.934 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:31.870+0000 7fbdcea00640 1 --2- 172.21.15.50:0/872533636 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fbdb40b4bc0 0x7fbdb40b70d0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fbdd010faf0 tx=0x7fbdbc005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:21:31.934 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:31.871+0000 7fbdcfe00640 1 --2- 172.21.15.50:0/872533636 >> [v2:172.21.15.177:6800/3091173426,v1:172.21.15.177:6801/3091173426] conn(0x7fbdb40be6b0 0x7fbdb40c0ba0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:21:31.934 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:31.872+0000 7fbdc7e00640 1 -- 172.21.15.50:0/872533636 <== osd.2 v2:172.21.15.177:6800/3091173426 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fbdc003ce50 con 0x7fbdb40be6b0 2024-08-31T04:21:31.935 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:31.887+0000 7fbdd4e00640 1 -- 172.21.15.50:0/872533636 --> [v2:172.21.15.177:6800/3091173426,v1:172.21.15.177:6801/3091173426] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fbdd0063ce0 con 0x7fbdb40be6b0 2024-08-31T04:21:31.935 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:31.887+0000 7fbdc7e00640 1 -- 172.21.15.50:0/872533636 <== osd.2 v2:172.21.15.177:6800/3091173426 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fbdd0063ce0 con 0x7fbdb40be6b0 2024-08-31T04:21:31.935 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:31.888+0000 7fbdd4e00640 1 -- 172.21.15.50:0/872533636 >> [v2:172.21.15.177:6800/3091173426,v1:172.21.15.177:6801/3091173426] conn(0x7fbdb40be6b0 msgr2=0x7fbdb40c0ba0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:21:31.935 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:31.888+0000 7fbdd4e00640 1 --2- 172.21.15.50:0/872533636 >> [v2:172.21.15.177:6800/3091173426,v1:172.21.15.177:6801/3091173426] conn(0x7fbdb40be6b0 0x7fbdb40c0ba0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:31.935 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:31.888+0000 7fbdd4e00640 1 -- 172.21.15.50:0/872533636 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fbdb40b4bc0 msgr2=0x7fbdb40b70d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:21:31.935 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:31.888+0000 7fbdd4e00640 1 --2- 172.21.15.50:0/872533636 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fbdb40b4bc0 0x7fbdb40b70d0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fbdd010faf0 tx=0x7fbdbc005f90 comp rx=0 tx=0).stop 2024-08-31T04:21:31.935 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:31.888+0000 7fbdd4e00640 1 -- 172.21.15.50:0/872533636 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbdd0104450 msgr2=0x7fbdd0102360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:21:31.935 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:31.888+0000 7fbdd4e00640 1 --2- 172.21.15.50:0/872533636 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbdd0104450 0x7fbdd0102360 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fbdc0005940 tx=0x7fbdc00040c0 comp rx=0 tx=0).stop 2024-08-31T04:21:31.935 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:31.888+0000 7fbdcfe00640 1 -- 172.21.15.50:0/872533636 reap_dead start 2024-08-31T04:21:31.935 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:31.888+0000 7fbdd4e00640 1 -- 172.21.15.50:0/872533636 shutdown_connections 2024-08-31T04:21:31.935 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:31.888+0000 7fbdd4e00640 1 -- 172.21.15.50:0/872533636 >> 172.21.15.50:0/872533636 conn(0x7fbdd00fe060 msgr2=0x7fbdd00fe760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:21:31.935 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:31.888+0000 7fbdd4e00640 1 -- 172.21.15.50:0/872533636 shutdown_connections 2024-08-31T04:21:31.935 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:31.888+0000 7fbdd4e00640 1 -- 172.21.15.50:0/872533636 wait complete. 2024-08-31T04:21:32.675 INFO:teuthology.orchestra.run.smithi050.stdout:77309411401 2024-08-31T04:21:32.676 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 058d9fc6-674f-11ef-bcd4-c7b262605968 -- ceph osd last-stat-seq osd.2 2024-08-31T04:21:33.230 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:21:33 smithi050 ceph-mon[17259]: pgmap v326: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 682 B/s wr, 12 op/s 2024-08-31T04:21:33.473 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:33.472+0000 7f08aa400640 1 -- 172.21.15.50:0/570923444 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f08a410bdb0 msgr2=0x7f08a41125e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:21:33.474 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:33.472+0000 7f08aa400640 1 --2- 172.21.15.50:0/570923444 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f08a410bdb0 0x7f08a41125e0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f0894009ca0 tx=0x7f089402a8c0 comp rx=0 tx=0).stop 2024-08-31T04:21:33.474 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:33.472+0000 7f08aa400640 1 -- 172.21.15.50:0/570923444 shutdown_connections 2024-08-31T04:21:33.474 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:33.472+0000 7f08aa400640 1 --2- 172.21.15.50:0/570923444 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f08a410b460 0x7f08a410b870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:33.474 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:33.472+0000 7f08aa400640 1 --2- 172.21.15.50:0/570923444 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f08a410bdb0 0x7f08a41125e0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:33.474 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:33.472+0000 7f08aa400640 1 --2- 172.21.15.50:0/570923444 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f08a4105b20 0x7f08a4105f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:33.474 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:33.472+0000 7f08aa400640 1 -- 172.21.15.50:0/570923444 >> 172.21.15.50:0/570923444 conn(0x7f08a41015b0 msgr2=0x7f08a4103a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:21:33.474 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:33.472+0000 7f08aa400640 1 -- 172.21.15.50:0/570923444 shutdown_connections 2024-08-31T04:21:33.474 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:33.472+0000 7f08aa400640 1 -- 172.21.15.50:0/570923444 wait complete. 2024-08-31T04:21:33.476 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:33.473+0000 7f08aa400640 1 Processor -- start 2024-08-31T04:21:33.476 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:33.473+0000 7f08aa400640 1 -- start start 2024-08-31T04:21:33.476 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:33.474+0000 7f08aa400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f08a4105b20 0x7f08a419c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:21:33.476 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:33.474+0000 7f08aa400640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f08a410b460 0x7f08a419ca20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:21:33.476 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:33.474+0000 7f08aa400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f08a410bdb0 0x7f08a41a1cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:21:33.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:33.474+0000 7f08aa400640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f08a4115a70 con 0x7f08a4105b20 2024-08-31T04:21:33.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:33.474+0000 7f08aa400640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f08a41158f0 con 0x7f08a410bdb0 2024-08-31T04:21:33.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:33.474+0000 7f08aa400640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f08a4115bf0 con 0x7f08a410b460 2024-08-31T04:21:33.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:33.474+0000 7f08a3400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f08a4105b20 0x7f08a419c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:21:33.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:33.474+0000 7f08a3400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f08a4105b20 0x7f08a419c480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:59450/0 (socket says 172.21.15.50:59450) 2024-08-31T04:21:33.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:33.474+0000 7f08a2a00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f08a410b460 0x7f08a419ca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:21:33.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:33.474+0000 7f08a3400640 1 -- 172.21.15.50:0/1516228535 learned_addr learned my addr 172.21.15.50:0/1516228535 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:21:33.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:33.474+0000 7f08a3e00640 1 --2- 172.21.15.50:0/1516228535 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f08a410bdb0 0x7f08a41a1cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:21:33.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:33.474+0000 7f08a3400640 1 -- 172.21.15.50:0/1516228535 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f08a410b460 msgr2=0x7f08a419ca20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:21:33.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:33.474+0000 7f08a3400640 1 --2- 172.21.15.50:0/1516228535 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f08a410b460 0x7f08a419ca20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:33.478 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:33.475+0000 7f08a3400640 1 -- 172.21.15.50:0/1516228535 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f08a410bdb0 msgr2=0x7f08a41a1cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:21:33.478 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:33.475+0000 7f08a3400640 1 --2- 172.21.15.50:0/1516228535 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f08a410bdb0 0x7f08a41a1cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:33.478 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:33.475+0000 7f08a3400640 1 -- 172.21.15.50:0/1516228535 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08a41a23f0 con 0x7f08a4105b20 2024-08-31T04:21:33.478 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:33.475+0000 7f08a3e00640 1 --2- 172.21.15.50:0/1516228535 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f08a410bdb0 0x7f08a41a1cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:21:33.478 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:33.475+0000 7f08a2a00640 1 --2- 172.21.15.50:0/1516228535 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f08a410b460 0x7f08a419ca20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:21:33.478 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:33.475+0000 7f08a3400640 1 --2- 172.21.15.50:0/1516228535 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f08a4105b20 0x7f08a419c480 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f089c00e9f0 tx=0x7f089c00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:21:33.479 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:33.475+0000 7f089be00640 1 -- 172.21.15.50:0/1516228535 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f089c00cd80 con 0x7f08a4105b20 2024-08-31T04:21:33.479 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:33.475+0000 7f089be00640 1 -- 172.21.15.50:0/1516228535 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f089c0108e0 con 0x7f08a4105b20 2024-08-31T04:21:33.479 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:33.475+0000 7f08aa400640 1 -- 172.21.15.50:0/1516228535 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f08a41a26e0 con 0x7f08a4105b20 2024-08-31T04:21:33.479 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:33.475+0000 7f089be00640 1 -- 172.21.15.50:0/1516228535 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f089c018980 con 0x7f08a4105b20 2024-08-31T04:21:33.479 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:33.475+0000 7f08aa400640 1 -- 172.21.15.50:0/1516228535 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f08a41a8e40 con 0x7f08a4105b20 2024-08-31T04:21:33.479 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:33.476+0000 7f08aa400640 1 -- 172.21.15.50:0/1516228535 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f08a40638f0 con 0x7f08a4105b20 2024-08-31T04:21:33.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:33.479+0000 7f089be00640 1 -- 172.21.15.50:0/1516228535 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 17) ==== 152628+0+0 (secure 0 0 0) 0x7f089c010430 con 0x7f08a4105b20 2024-08-31T04:21:33.481 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:33.480+0000 7f089be00640 1 --2- 172.21.15.50:0/1516228535 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f08880b4bc0 0x7f08880b70d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:21:33.482 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:33.481+0000 7f089be00640 1 -- 172.21.15.50:0/1516228535 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8219+0+0 (secure 0 0 0) 0x7f089c0e5dc0 con 0x7f08a4105b20 2024-08-31T04:21:33.482 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:33.481+0000 7f08a2a00640 1 --2- 172.21.15.50:0/1516228535 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f08880b4bc0 0x7f08880b70d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:21:33.482 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:33.481+0000 7f089be00640 1 --2- 172.21.15.50:0/1516228535 >> [v2:172.21.15.50:6818/1429341184,v1:172.21.15.50:6819/1429341184] conn(0x7f08880be6b0 0x7f08880c0ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:21:33.482 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:33.481+0000 7f089be00640 1 -- 172.21.15.50:0/1516228535 --> [v2:172.21.15.50:6818/1429341184,v1:172.21.15.50:6819/1429341184] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f08880c1270 con 0x7f08880be6b0 2024-08-31T04:21:33.482 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:33.481+0000 7f089be00640 1 -- 172.21.15.50:0/1516228535 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_get_version_reply(handle=1 version=78) ==== 24+0+0 (secure 0 0 0) 0x7f089c0e6210 con 0x7f08a4105b20 2024-08-31T04:21:33.483 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:33.481+0000 7f08a3e00640 1 --2- 172.21.15.50:0/1516228535 >> [v2:172.21.15.50:6818/1429341184,v1:172.21.15.50:6819/1429341184] conn(0x7f08880be6b0 0x7f08880c0ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:21:33.483 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:33.481+0000 7f08a2a00640 1 --2- 172.21.15.50:0/1516228535 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f08880b4bc0 0x7f08880b70d0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f08a4104cb0 tx=0x7f088c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:21:33.483 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:33.482+0000 7f08a3e00640 1 --2- 172.21.15.50:0/1516228535 >> [v2:172.21.15.50:6818/1429341184,v1:172.21.15.50:6819/1429341184] conn(0x7f08880be6b0 0x7f08880c0ba0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:21:33.484 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:33.483+0000 7f089be00640 1 -- 172.21.15.50:0/1516228535 <== osd.6 v2:172.21.15.50:6818/1429341184 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f08880c1270 con 0x7f08880be6b0 2024-08-31T04:21:33.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:21:33 smithi177 ceph-mon[22025]: pgmap v326: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 682 B/s wr, 12 op/s 2024-08-31T04:21:33.498 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:33.497+0000 7f08aa400640 1 -- 172.21.15.50:0/1516228535 --> [v2:172.21.15.50:6818/1429341184,v1:172.21.15.50:6819/1429341184] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f08a4063d70 con 0x7f08880be6b0 2024-08-31T04:21:33.499 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:33.497+0000 7f089be00640 1 -- 172.21.15.50:0/1516228535 <== osd.6 v2:172.21.15.50:6818/1429341184 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f08a4063d70 con 0x7f08880be6b0 2024-08-31T04:21:33.499 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:33.498+0000 7f08aa400640 1 -- 172.21.15.50:0/1516228535 >> [v2:172.21.15.50:6818/1429341184,v1:172.21.15.50:6819/1429341184] conn(0x7f08880be6b0 msgr2=0x7f08880c0ba0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:21:33.499 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:33.498+0000 7f08aa400640 1 --2- 172.21.15.50:0/1516228535 >> [v2:172.21.15.50:6818/1429341184,v1:172.21.15.50:6819/1429341184] conn(0x7f08880be6b0 0x7f08880c0ba0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:33.499 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:33.498+0000 7f08aa400640 1 -- 172.21.15.50:0/1516228535 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f08880b4bc0 msgr2=0x7f08880b70d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:21:33.500 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:33.498+0000 7f08aa400640 1 --2- 172.21.15.50:0/1516228535 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f08880b4bc0 0x7f08880b70d0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f08a4104cb0 tx=0x7f088c005f90 comp rx=0 tx=0).stop 2024-08-31T04:21:33.500 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:33.498+0000 7f08aa400640 1 -- 172.21.15.50:0/1516228535 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f08a4105b20 msgr2=0x7f08a419c480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:21:33.500 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:33.498+0000 7f08aa400640 1 --2- 172.21.15.50:0/1516228535 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f08a4105b20 0x7f08a419c480 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f089c00e9f0 tx=0x7f089c00eeb0 comp rx=0 tx=0).stop 2024-08-31T04:21:33.500 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:33.498+0000 7f08a3e00640 1 -- 172.21.15.50:0/1516228535 reap_dead start 2024-08-31T04:21:33.500 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:33.498+0000 7f08aa400640 1 -- 172.21.15.50:0/1516228535 shutdown_connections 2024-08-31T04:21:33.500 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:33.498+0000 7f08aa400640 1 -- 172.21.15.50:0/1516228535 >> 172.21.15.50:0/1516228535 conn(0x7f08a41015b0 msgr2=0x7f08a410aa90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:21:33.500 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:33.498+0000 7f08aa400640 1 -- 172.21.15.50:0/1516228535 shutdown_connections 2024-08-31T04:21:33.500 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:33.499+0000 7f08aa400640 1 -- 172.21.15.50:0/1516228535 wait complete. 2024-08-31T04:21:33.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:21:33 smithi133 ceph-mon[22177]: pgmap v326: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 682 B/s wr, 12 op/s 2024-08-31T04:21:34.141 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:33.695+0000 7f923ba00640 1 -- 172.21.15.50:0/1943425087 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9234105b20 msgr2=0x7f9234105f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:21:34.142 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:33.695+0000 7f923ba00640 1 --2- 172.21.15.50:0/1943425087 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9234105b20 0x7f9234105f30 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f9228009900 tx=0x7f922802a3f0 comp rx=0 tx=0).stop 2024-08-31T04:21:34.142 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:33.696+0000 7f923ba00640 1 -- 172.21.15.50:0/1943425087 shutdown_connections 2024-08-31T04:21:34.142 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:33.696+0000 7f923ba00640 1 --2- 172.21.15.50:0/1943425087 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f923410b460 0x7f923410b870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:34.142 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:33.696+0000 7f923ba00640 1 --2- 172.21.15.50:0/1943425087 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f923410bdb0 0x7f92341125e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:34.142 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:33.696+0000 7f923ba00640 1 --2- 172.21.15.50:0/1943425087 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9234105b20 0x7f9234105f30 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:34.142 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:33.696+0000 7f923ba00640 1 -- 172.21.15.50:0/1943425087 >> 172.21.15.50:0/1943425087 conn(0x7f9234101570 msgr2=0x7f92341039c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:21:34.143 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:33.696+0000 7f923ba00640 1 -- 172.21.15.50:0/1943425087 shutdown_connections 2024-08-31T04:21:34.143 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:33.696+0000 7f923ba00640 1 -- 172.21.15.50:0/1943425087 wait complete. 2024-08-31T04:21:34.143 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:33.697+0000 7f923ba00640 1 Processor -- start 2024-08-31T04:21:34.143 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:33.697+0000 7f923ba00640 1 -- start start 2024-08-31T04:21:34.143 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:33.697+0000 7f923ba00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9234105b20 0x7f923419c530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:21:34.143 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:33.697+0000 7f923ba00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f923410b460 0x7f923419cad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:21:34.143 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:33.697+0000 7f923ba00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f923410bdb0 0x7f92341a1d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:21:34.143 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:33.697+0000 7f923ba00640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f9234115ac0 con 0x7f923410b460 2024-08-31T04:21:34.143 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:33.697+0000 7f923ba00640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f9234115940 con 0x7f923410bdb0 2024-08-31T04:21:34.143 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:33.697+0000 7f923ba00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f9234115c40 con 0x7f9234105b20 2024-08-31T04:21:34.144 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:33.698+0000 7f9233e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f923410b460 0x7f923419cad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:21:34.144 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:33.698+0000 7f9233e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f923410b460 0x7f923419cad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:59472/0 (socket says 172.21.15.50:59472) 2024-08-31T04:21:34.144 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:33.698+0000 7f9233e00640 1 -- 172.21.15.50:0/957930115 learned_addr learned my addr 172.21.15.50:0/957930115 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:21:34.144 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:33.698+0000 7f9239000640 1 --2- 172.21.15.50:0/957930115 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9234105b20 0x7f923419c530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:21:34.144 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:33.698+0000 7f9239a00640 1 --2- 172.21.15.50:0/957930115 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f923410bdb0 0x7f92341a1d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:21:34.144 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:33.698+0000 7f9233e00640 1 -- 172.21.15.50:0/957930115 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9234105b20 msgr2=0x7f923419c530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:21:34.144 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:33.698+0000 7f9233e00640 1 --2- 172.21.15.50:0/957930115 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9234105b20 0x7f923419c530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:34.144 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:33.698+0000 7f9233e00640 1 -- 172.21.15.50:0/957930115 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f923410bdb0 msgr2=0x7f92341a1d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:21:34.144 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:33.698+0000 7f9233e00640 1 --2- 172.21.15.50:0/957930115 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f923410bdb0 0x7f92341a1d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:34.144 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:33.698+0000 7f9233e00640 1 -- 172.21.15.50:0/957930115 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92341a24a0 con 0x7f923410b460 2024-08-31T04:21:34.144 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:33.698+0000 7f9233e00640 1 --2- 172.21.15.50:0/957930115 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f923410b460 0x7f923419cad0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f922000e970 tx=0x7f922000ee30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:21:34.144 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:33.699+0000 7f9231600640 1 -- 172.21.15.50:0/957930115 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f922000cd80 con 0x7f923410b460 2024-08-31T04:21:34.145 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:33.699+0000 7f923ba00640 1 -- 172.21.15.50:0/957930115 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f92341a2790 con 0x7f923410b460 2024-08-31T04:21:34.145 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:33.699+0000 7f9231600640 1 -- 172.21.15.50:0/957930115 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f92200035f0 con 0x7f923410b460 2024-08-31T04:21:34.145 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:33.699+0000 7f9231600640 1 -- 172.21.15.50:0/957930115 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9220010690 con 0x7f923410b460 2024-08-31T04:21:34.145 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:33.699+0000 7f923ba00640 1 -- 172.21.15.50:0/957930115 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f92341a8ef0 con 0x7f923410b460 2024-08-31T04:21:34.145 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:33.700+0000 7f923ba00640 1 -- 172.21.15.50:0/957930115 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f92340638f0 con 0x7f923410b460 2024-08-31T04:21:34.145 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:33.703+0000 7f9231600640 1 -- 172.21.15.50:0/957930115 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 17) ==== 152628+0+0 (secure 0 0 0) 0x7f9220003aa0 con 0x7f923410b460 2024-08-31T04:21:34.145 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:33.704+0000 7f9231600640 1 --2- 172.21.15.50:0/957930115 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f921c0b4bc0 0x7f921c0b70d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:21:34.145 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:33.704+0000 7f9231600640 1 -- 172.21.15.50:0/957930115 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8219+0+0 (secure 0 0 0) 0x7f92200e57a0 con 0x7f923410b460 2024-08-31T04:21:34.145 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:33.704+0000 7f9239000640 1 --2- 172.21.15.50:0/957930115 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f921c0b4bc0 0x7f921c0b70d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:21:34.145 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:33.704+0000 7f9231600640 1 --2- 172.21.15.50:0/957930115 >> [v2:172.21.15.133:6800/475308203,v1:172.21.15.133:6801/475308203] conn(0x7f921c0be6b0 0x7f921c0c0ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:21:34.145 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:33.704+0000 7f9231600640 1 -- 172.21.15.50:0/957930115 --> [v2:172.21.15.133:6800/475308203,v1:172.21.15.133:6801/475308203] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f9220015e80 con 0x7f921c0be6b0 2024-08-31T04:21:34.145 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:33.704+0000 7f9231600640 1 -- 172.21.15.50:0/957930115 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_get_version_reply(handle=1 version=78) ==== 24+0+0 (secure 0 0 0) 0x7f92200e5b50 con 0x7f923410b460 2024-08-31T04:21:34.145 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:33.705+0000 7f9239a00640 1 --2- 172.21.15.50:0/957930115 >> [v2:172.21.15.133:6800/475308203,v1:172.21.15.133:6801/475308203] conn(0x7f921c0be6b0 0x7f921c0c0ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:21:34.146 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:33.705+0000 7f9239000640 1 --2- 172.21.15.50:0/957930115 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f921c0b4bc0 0x7f921c0b70d0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f9228005ab0 tx=0x7f9228005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:21:34.146 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:33.705+0000 7f9239a00640 1 --2- 172.21.15.50:0/957930115 >> [v2:172.21.15.133:6800/475308203,v1:172.21.15.133:6801/475308203] conn(0x7f921c0be6b0 0x7f921c0c0ba0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:21:34.146 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:33.706+0000 7f9231600640 1 -- 172.21.15.50:0/957930115 <== osd.1 v2:172.21.15.133:6800/475308203 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f9220015e80 con 0x7f921c0be6b0 2024-08-31T04:21:34.146 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:33.721+0000 7f923ba00640 1 -- 172.21.15.50:0/957930115 --> [v2:172.21.15.133:6800/475308203,v1:172.21.15.133:6801/475308203] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f9234063d70 con 0x7f921c0be6b0 2024-08-31T04:21:34.146 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:33.722+0000 7f9231600640 1 -- 172.21.15.50:0/957930115 <== osd.1 v2:172.21.15.133:6800/475308203 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f9234063d70 con 0x7f921c0be6b0 2024-08-31T04:21:34.146 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:33.722+0000 7f923ba00640 1 -- 172.21.15.50:0/957930115 >> [v2:172.21.15.133:6800/475308203,v1:172.21.15.133:6801/475308203] conn(0x7f921c0be6b0 msgr2=0x7f921c0c0ba0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:21:34.146 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:33.722+0000 7f923ba00640 1 --2- 172.21.15.50:0/957930115 >> [v2:172.21.15.133:6800/475308203,v1:172.21.15.133:6801/475308203] conn(0x7f921c0be6b0 0x7f921c0c0ba0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:34.147 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:33.722+0000 7f923ba00640 1 -- 172.21.15.50:0/957930115 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f921c0b4bc0 msgr2=0x7f921c0b70d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:21:34.147 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:33.722+0000 7f923ba00640 1 --2- 172.21.15.50:0/957930115 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f921c0b4bc0 0x7f921c0b70d0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f9228005ab0 tx=0x7f9228005a20 comp rx=0 tx=0).stop 2024-08-31T04:21:34.147 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:33.722+0000 7f923ba00640 1 -- 172.21.15.50:0/957930115 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f923410b460 msgr2=0x7f923419cad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:21:34.147 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:33.722+0000 7f923ba00640 1 --2- 172.21.15.50:0/957930115 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f923410b460 0x7f923419cad0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f922000e970 tx=0x7f922000ee30 comp rx=0 tx=0).stop 2024-08-31T04:21:34.147 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:33.722+0000 7f9239a00640 1 -- 172.21.15.50:0/957930115 reap_dead start 2024-08-31T04:21:34.147 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:33.722+0000 7f923ba00640 1 -- 172.21.15.50:0/957930115 shutdown_connections 2024-08-31T04:21:34.147 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:33.722+0000 7f923ba00640 1 -- 172.21.15.50:0/957930115 >> 172.21.15.50:0/957930115 conn(0x7f9234101570 msgr2=0x7f9234103990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:21:34.147 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:33.723+0000 7f923ba00640 1 -- 172.21.15.50:0/957930115 shutdown_connections 2024-08-31T04:21:34.147 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:33.723+0000 7f923ba00640 1 -- 172.21.15.50:0/957930115 wait complete. 2024-08-31T04:21:34.604 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:34.228+0000 7f8c34000640 1 -- 172.21.15.50:0/2535323818 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8c2c10bdb0 msgr2=0x7f8c2c1125e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:21:34.604 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:34.228+0000 7f8c34000640 1 --2- 172.21.15.50:0/2535323818 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8c2c10bdb0 0x7f8c2c1125e0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f8c24009ca0 tx=0x7f8c2402a8c0 comp rx=0 tx=0).stop 2024-08-31T04:21:34.604 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:34.228+0000 7f8c34000640 1 -- 172.21.15.50:0/2535323818 shutdown_connections 2024-08-31T04:21:34.604 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:34.228+0000 7f8c34000640 1 --2- 172.21.15.50:0/2535323818 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8c2c10b460 0x7f8c2c10b870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:34.604 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:34.228+0000 7f8c34000640 1 --2- 172.21.15.50:0/2535323818 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8c2c10bdb0 0x7f8c2c1125e0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:34.604 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:34.228+0000 7f8c34000640 1 --2- 172.21.15.50:0/2535323818 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8c2c105b20 0x7f8c2c105f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:34.604 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:34.228+0000 7f8c34000640 1 -- 172.21.15.50:0/2535323818 >> 172.21.15.50:0/2535323818 conn(0x7f8c2c101590 msgr2=0x7f8c2c1039e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:21:34.605 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:34.228+0000 7f8c34000640 1 -- 172.21.15.50:0/2535323818 shutdown_connections 2024-08-31T04:21:34.605 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:34.228+0000 7f8c34000640 1 -- 172.21.15.50:0/2535323818 wait complete. 2024-08-31T04:21:34.605 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:34.230+0000 7f8c34000640 1 Processor -- start 2024-08-31T04:21:34.605 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:34.230+0000 7f8c34000640 1 -- start start 2024-08-31T04:21:34.605 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:34.230+0000 7f8c34000640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8c2c105b20 0x7f8c2c19c400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:21:34.605 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:34.230+0000 7f8c34000640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8c2c10b460 0x7f8c2c19c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:21:34.605 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:34.230+0000 7f8c34000640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8c2c10bdb0 0x7f8c2c1a1c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:21:34.605 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:34.230+0000 7f8c34000640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f8c2c115a70 con 0x7f8c2c10bdb0 2024-08-31T04:21:34.605 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:34.230+0000 7f8c34000640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f8c2c1158f0 con 0x7f8c2c10b460 2024-08-31T04:21:34.605 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:34.230+0000 7f8c34000640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f8c2c115bf0 con 0x7f8c2c105b20 2024-08-31T04:21:34.605 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:34.231+0000 7f8c32000640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8c2c10bdb0 0x7f8c2c1a1c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:21:34.605 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:34.231+0000 7f8c32000640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8c2c10bdb0 0x7f8c2c1a1c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:59478/0 (socket says 172.21.15.50:59478) 2024-08-31T04:21:34.605 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:34.231+0000 7f8c32000640 1 -- 172.21.15.50:0/1852916751 learned_addr learned my addr 172.21.15.50:0/1852916751 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:21:34.606 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:34.231+0000 7f8c31600640 1 --2- 172.21.15.50:0/1852916751 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8c2c105b20 0x7f8c2c19c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:21:34.606 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:34.231+0000 7f8c30c00640 1 --2- 172.21.15.50:0/1852916751 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8c2c10b460 0x7f8c2c19c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:21:34.606 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:34.231+0000 7f8c32000640 1 -- 172.21.15.50:0/1852916751 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8c2c105b20 msgr2=0x7f8c2c19c400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:21:34.606 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:34.231+0000 7f8c32000640 1 --2- 172.21.15.50:0/1852916751 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8c2c105b20 0x7f8c2c19c400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:34.606 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:34.231+0000 7f8c32000640 1 -- 172.21.15.50:0/1852916751 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8c2c10b460 msgr2=0x7f8c2c19c9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:21:34.606 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:34.231+0000 7f8c32000640 1 --2- 172.21.15.50:0/1852916751 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8c2c10b460 0x7f8c2c19c9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:34.606 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:34.231+0000 7f8c32000640 1 -- 172.21.15.50:0/1852916751 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c2c1a2370 con 0x7f8c2c10bdb0 2024-08-31T04:21:34.606 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:34.231+0000 7f8c32000640 1 --2- 172.21.15.50:0/1852916751 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8c2c10bdb0 0x7f8c2c1a1c40 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f8c24005cc0 tx=0x7f8c24031700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:21:34.606 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:34.232+0000 7f8c2a000640 1 -- 172.21.15.50:0/1852916751 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c24003b70 con 0x7f8c2c10bdb0 2024-08-31T04:21:34.606 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:34.232+0000 7f8c34000640 1 -- 172.21.15.50:0/1852916751 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8c2c1a2600 con 0x7f8c2c10bdb0 2024-08-31T04:21:34.606 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:34.232+0000 7f8c2a000640 1 -- 172.21.15.50:0/1852916751 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8c240318f0 con 0x7f8c2c10bdb0 2024-08-31T04:21:34.606 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:34.232+0000 7f8c2a000640 1 -- 172.21.15.50:0/1852916751 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c2402f950 con 0x7f8c2c10bdb0 2024-08-31T04:21:34.606 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:34.232+0000 7f8c34000640 1 -- 172.21.15.50:0/1852916751 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8c2c1a8dc0 con 0x7f8c2c10bdb0 2024-08-31T04:21:34.607 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:34.233+0000 7f8c34000640 1 -- 172.21.15.50:0/1852916751 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f8c2c0638b0 con 0x7f8c2c10bdb0 2024-08-31T04:21:34.607 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:34.235+0000 7f8c2a000640 1 -- 172.21.15.50:0/1852916751 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 17) ==== 152628+0+0 (secure 0 0 0) 0x7f8c2402faf0 con 0x7f8c2c10bdb0 2024-08-31T04:21:34.607 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:34.237+0000 7f8c2a000640 1 --2- 172.21.15.50:0/1852916751 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f8c140b4bc0 0x7f8c140b70d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:21:34.607 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:34.237+0000 7f8c2a000640 1 -- 172.21.15.50:0/1852916751 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8219+0+0 (secure 0 0 0) 0x7f8c24106710 con 0x7f8c2c10bdb0 2024-08-31T04:21:34.607 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:34.237+0000 7f8c31600640 1 --2- 172.21.15.50:0/1852916751 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f8c140b4bc0 0x7f8c140b70d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:21:34.607 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:34.237+0000 7f8c2a000640 1 --2- 172.21.15.50:0/1852916751 >> [v2:172.21.15.133:6824/4175566493,v1:172.21.15.133:6825/4175566493] conn(0x7f8c140be6b0 0x7f8c140c0ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:21:34.607 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:34.237+0000 7f8c2a000640 1 -- 172.21.15.50:0/1852916751 --> [v2:172.21.15.133:6824/4175566493,v1:172.21.15.133:6825/4175566493] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f8c2403ee50 con 0x7f8c140be6b0 2024-08-31T04:21:34.607 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:34.237+0000 7f8c2a000640 1 -- 172.21.15.50:0/1852916751 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_get_version_reply(handle=1 version=78) ==== 24+0+0 (secure 0 0 0) 0x7f8c24106ac0 con 0x7f8c2c10bdb0 2024-08-31T04:21:34.607 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:34.238+0000 7f8c30c00640 1 --2- 172.21.15.50:0/1852916751 >> [v2:172.21.15.133:6824/4175566493,v1:172.21.15.133:6825/4175566493] conn(0x7f8c140be6b0 0x7f8c140c0ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:21:34.607 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:34.238+0000 7f8c31600640 1 --2- 172.21.15.50:0/1852916751 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f8c140b4bc0 0x7f8c140b70d0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f8c20009bd0 tx=0x7f8c20005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:21:34.607 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:34.238+0000 7f8c30c00640 1 --2- 172.21.15.50:0/1852916751 >> [v2:172.21.15.133:6824/4175566493,v1:172.21.15.133:6825/4175566493] conn(0x7f8c140be6b0 0x7f8c140c0ba0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.10 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:21:34.607 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:34.239+0000 7f8c2a000640 1 -- 172.21.15.50:0/1852916751 <== osd.10 v2:172.21.15.133:6824/4175566493 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f8c2403ee50 con 0x7f8c140be6b0 2024-08-31T04:21:34.607 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:34.254+0000 7f8c34000640 1 -- 172.21.15.50:0/1852916751 --> [v2:172.21.15.133:6824/4175566493,v1:172.21.15.133:6825/4175566493] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f8c2c063ce0 con 0x7f8c140be6b0 2024-08-31T04:21:34.608 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:34.255+0000 7f8c2a000640 1 -- 172.21.15.50:0/1852916751 <== osd.10 v2:172.21.15.133:6824/4175566493 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f8c2c063ce0 con 0x7f8c140be6b0 2024-08-31T04:21:34.608 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:34.255+0000 7f8c34000640 1 -- 172.21.15.50:0/1852916751 >> [v2:172.21.15.133:6824/4175566493,v1:172.21.15.133:6825/4175566493] conn(0x7f8c140be6b0 msgr2=0x7f8c140c0ba0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:21:34.608 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:34.255+0000 7f8c34000640 1 --2- 172.21.15.50:0/1852916751 >> [v2:172.21.15.133:6824/4175566493,v1:172.21.15.133:6825/4175566493] conn(0x7f8c140be6b0 0x7f8c140c0ba0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:34.608 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:34.255+0000 7f8c34000640 1 -- 172.21.15.50:0/1852916751 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f8c140b4bc0 msgr2=0x7f8c140b70d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:21:34.608 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:34.255+0000 7f8c34000640 1 --2- 172.21.15.50:0/1852916751 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f8c140b4bc0 0x7f8c140b70d0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f8c20009bd0 tx=0x7f8c20005f90 comp rx=0 tx=0).stop 2024-08-31T04:21:34.608 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:34.255+0000 7f8c34000640 1 -- 172.21.15.50:0/1852916751 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8c2c10bdb0 msgr2=0x7f8c2c1a1c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:21:34.609 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:34.255+0000 7f8c34000640 1 --2- 172.21.15.50:0/1852916751 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8c2c10bdb0 0x7f8c2c1a1c40 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f8c24005cc0 tx=0x7f8c24031700 comp rx=0 tx=0).stop 2024-08-31T04:21:34.609 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:34.255+0000 7f8c32000640 1 -- 172.21.15.50:0/1852916751 reap_dead start 2024-08-31T04:21:34.609 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:34.255+0000 7f8c34000640 1 -- 172.21.15.50:0/1852916751 shutdown_connections 2024-08-31T04:21:34.609 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:34.255+0000 7f8c34000640 1 -- 172.21.15.50:0/1852916751 >> 172.21.15.50:0/1852916751 conn(0x7f8c2c101590 msgr2=0x7f8c2c10aad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:21:34.609 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:34.255+0000 7f8c34000640 1 -- 172.21.15.50:0/1852916751 shutdown_connections 2024-08-31T04:21:34.609 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:34.255+0000 7f8c34000640 1 -- 172.21.15.50:0/1852916751 wait complete. 2024-08-31T04:21:35.200 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:21:35 smithi050 ceph-mon[17259]: pgmap v327: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 8 op/s 2024-08-31T04:21:35.280 INFO:teuthology.orchestra.run.smithi050.stdout:180388626482 2024-08-31T04:21:35.281 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 058d9fc6-674f-11ef-bcd4-c7b262605968 -- ceph osd last-stat-seq osd.6 2024-08-31T04:21:35.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:21:35 smithi177 ceph-mon[22025]: pgmap v327: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 8 op/s 2024-08-31T04:21:35.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:21:35 smithi133 ceph-mon[22177]: pgmap v327: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 8 op/s 2024-08-31T04:21:35.598 INFO:teuthology.orchestra.run.smithi050.stdout:270582939676 2024-08-31T04:21:35.599 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 058d9fc6-674f-11ef-bcd4-c7b262605968 -- ceph osd last-stat-seq osd.10 2024-08-31T04:21:35.735 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:21:36.063 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:21:36.064 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:21:36.090 INFO:teuthology.orchestra.run.smithi050.stdout:55834574926 2024-08-31T04:21:36.090 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 058d9fc6-674f-11ef-bcd4-c7b262605968 -- ceph osd last-stat-seq osd.1 2024-08-31T04:21:36.175 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:21:36.180 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:21:36.522 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:31.973+0000 7f79ed000640 1 -- 172.21.15.50:0/1571122650 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f79e8102440 msgr2=0x7f79e8102850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:21:36.522 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:31.973+0000 7f79ed000640 1 --2- 172.21.15.50:0/1571122650 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f79e8102440 0x7f79e8102850 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f79d8009900 tx=0x7f79d802a480 comp rx=0 tx=0).stop 2024-08-31T04:21:36.522 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:31.973+0000 7f79ed000640 1 -- 172.21.15.50:0/1571122650 shutdown_connections 2024-08-31T04:21:36.522 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:31.973+0000 7f79ed000640 1 --2- 172.21.15.50:0/1571122650 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f79e810fff0 0x7f79e8112410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:36.522 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:31.973+0000 7f79ed000640 1 --2- 172.21.15.50:0/1571122650 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f79e8102d90 0x7f79e810fab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:36.523 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:31.973+0000 7f79ed000640 1 --2- 172.21.15.50:0/1571122650 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f79e8102440 0x7f79e8102850 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:36.523 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:31.973+0000 7f79ed000640 1 -- 172.21.15.50:0/1571122650 >> 172.21.15.50:0/1571122650 conn(0x7f79e80793f0 msgr2=0x7f79e8079800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:21:36.523 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:31.974+0000 7f79ed000640 1 -- 172.21.15.50:0/1571122650 shutdown_connections 2024-08-31T04:21:36.523 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:31.974+0000 7f79ed000640 1 -- 172.21.15.50:0/1571122650 wait complete. 2024-08-31T04:21:36.523 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:31.975+0000 7f79ed000640 1 Processor -- start 2024-08-31T04:21:36.523 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:31.975+0000 7f79ed000640 1 -- start start 2024-08-31T04:21:36.523 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:31.976+0000 7f79ed000640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f79e8102440 0x7f79e819c5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:21:36.523 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:31.976+0000 7f79ed000640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f79e8102d90 0x7f79e819cb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:21:36.523 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:31.976+0000 7f79ed000640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f79e810fff0 0x7f79e81a1e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:21:36.523 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:31.976+0000 7f79ed000640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f79e8115b30 con 0x7f79e8102440 2024-08-31T04:21:36.523 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:31.976+0000 7f79ed000640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f79e81159b0 con 0x7f79e8102d90 2024-08-31T04:21:36.523 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:31.976+0000 7f79ed000640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f79e8115cb0 con 0x7f79e810fff0 2024-08-31T04:21:36.524 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:31.976+0000 7f79e5e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f79e8102440 0x7f79e819c5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:21:36.524 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:31.976+0000 7f79e5e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f79e8102440 0x7f79e819c5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:42702/0 (socket says 172.21.15.50:42702) 2024-08-31T04:21:36.524 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:31.976+0000 7f79e5e00640 1 -- 172.21.15.50:0/1251317068 learned_addr learned my addr 172.21.15.50:0/1251317068 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:21:36.524 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:31.976+0000 7f79dd400640 1 --2- 172.21.15.50:0/1251317068 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f79e8102d90 0x7f79e819cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:21:36.524 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:31.976+0000 7f79e6800640 1 --2- 172.21.15.50:0/1251317068 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f79e810fff0 0x7f79e81a1e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:21:36.524 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:31.976+0000 7f79e5e00640 1 -- 172.21.15.50:0/1251317068 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f79e810fff0 msgr2=0x7f79e81a1e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:21:36.524 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:31.976+0000 7f79e5e00640 1 --2- 172.21.15.50:0/1251317068 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f79e810fff0 0x7f79e81a1e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:36.524 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:31.976+0000 7f79e5e00640 1 -- 172.21.15.50:0/1251317068 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f79e8102d90 msgr2=0x7f79e819cb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:21:36.524 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:31.976+0000 7f79e5e00640 1 --2- 172.21.15.50:0/1251317068 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f79e8102d90 0x7f79e819cb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:36.524 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:31.976+0000 7f79e5e00640 1 -- 172.21.15.50:0/1251317068 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79e81a2550 con 0x7f79e8102440 2024-08-31T04:21:36.524 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:31.976+0000 7f79dd400640 1 --2- 172.21.15.50:0/1251317068 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f79e8102d90 0x7f79e819cb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:21:36.524 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:31.977+0000 7f79e5e00640 1 --2- 172.21.15.50:0/1251317068 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f79e8102440 0x7f79e819c5e0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f79d8005940 tx=0x7f79d8004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:21:36.525 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:31.977+0000 7f79df400640 1 -- 172.21.15.50:0/1251317068 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79d803f030 con 0x7f79e8102440 2024-08-31T04:21:36.525 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:31.977+0000 7f79df400640 1 -- 172.21.15.50:0/1251317068 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f79d8003aa0 con 0x7f79e8102440 2024-08-31T04:21:36.525 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:31.977+0000 7f79df400640 1 -- 172.21.15.50:0/1251317068 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79d8035070 con 0x7f79e8102440 2024-08-31T04:21:36.525 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:31.977+0000 7f79ed000640 1 -- 172.21.15.50:0/1251317068 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f79e81a27e0 con 0x7f79e8102440 2024-08-31T04:21:36.525 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:31.977+0000 7f79ed000640 1 -- 172.21.15.50:0/1251317068 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f79e81a8fa0 con 0x7f79e8102440 2024-08-31T04:21:36.525 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:31.978+0000 7f79ed000640 1 -- 172.21.15.50:0/1251317068 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f79e810a5b0 con 0x7f79e8102440 2024-08-31T04:21:36.525 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:31.981+0000 7f79df400640 1 -- 172.21.15.50:0/1251317068 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 17) ==== 152628+0+0 (secure 0 0 0) 0x7f79d8042030 con 0x7f79e8102440 2024-08-31T04:21:36.525 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:31.982+0000 7f79df400640 1 --2- 172.21.15.50:0/1251317068 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f79cc0b4c40 0x7f79cc0b7150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:21:36.525 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:31.982+0000 7f79df400640 1 -- 172.21.15.50:0/1251317068 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8219+0+0 (secure 0 0 0) 0x7f79d8105fc0 con 0x7f79e8102440 2024-08-31T04:21:36.525 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:31.982+0000 7f79dd400640 1 --2- 172.21.15.50:0/1251317068 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f79cc0b4c40 0x7f79cc0b7150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:21:36.525 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:31.983+0000 7f79df400640 1 --2- 172.21.15.50:0/1251317068 >> [v2:172.21.15.133:6816/3643454923,v1:172.21.15.133:6817/3643454923] conn(0x7f79cc0be730 0x7f79cc0c0c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:21:36.525 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:31.983+0000 7f79df400640 1 -- 172.21.15.50:0/1251317068 --> [v2:172.21.15.133:6816/3643454923,v1:172.21.15.133:6817/3643454923] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f79cc0c12f0 con 0x7f79cc0be730 2024-08-31T04:21:36.525 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:31.983+0000 7f79df400640 1 -- 172.21.15.50:0/1251317068 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_get_version_reply(handle=1 version=78) ==== 24+0+0 (secure 0 0 0) 0x7f79d8106370 con 0x7f79e8102440 2024-08-31T04:21:36.525 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:31.983+0000 7f79e6800640 1 --2- 172.21.15.50:0/1251317068 >> [v2:172.21.15.133:6816/3643454923,v1:172.21.15.133:6817/3643454923] conn(0x7f79cc0be730 0x7f79cc0c0c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:21:36.526 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:31.983+0000 7f79dd400640 1 --2- 172.21.15.50:0/1251317068 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f79cc0b4c40 0x7f79cc0b7150 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f79e8103f50 tx=0x7f79d0005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:21:36.526 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:31.984+0000 7f79e6800640 1 --2- 172.21.15.50:0/1251317068 >> [v2:172.21.15.133:6816/3643454923,v1:172.21.15.133:6817/3643454923] conn(0x7f79cc0be730 0x7f79cc0c0c20 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:21:36.526 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:31.985+0000 7f79df400640 1 -- 172.21.15.50:0/1251317068 <== osd.7 v2:172.21.15.133:6816/3643454923 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f79cc0c12f0 con 0x7f79cc0be730 2024-08-31T04:21:36.526 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:31.999+0000 7f79ed000640 1 -- 172.21.15.50:0/1251317068 --> [v2:172.21.15.133:6816/3643454923,v1:172.21.15.133:6817/3643454923] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f79e81a2c70 con 0x7f79cc0be730 2024-08-31T04:21:36.526 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:31.999+0000 7f79df400640 1 -- 172.21.15.50:0/1251317068 <== osd.7 v2:172.21.15.133:6816/3643454923 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f79e0009b20 con 0x7f79cc0be730 2024-08-31T04:21:36.526 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:32.000+0000 7f79ed000640 1 -- 172.21.15.50:0/1251317068 >> [v2:172.21.15.133:6816/3643454923,v1:172.21.15.133:6817/3643454923] conn(0x7f79cc0be730 msgr2=0x7f79cc0c0c20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:21:36.526 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:32.000+0000 7f79ed000640 1 --2- 172.21.15.50:0/1251317068 >> [v2:172.21.15.133:6816/3643454923,v1:172.21.15.133:6817/3643454923] conn(0x7f79cc0be730 0x7f79cc0c0c20 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:36.527 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:32.000+0000 7f79ed000640 1 -- 172.21.15.50:0/1251317068 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f79cc0b4c40 msgr2=0x7f79cc0b7150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:21:36.527 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:32.000+0000 7f79ed000640 1 --2- 172.21.15.50:0/1251317068 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f79cc0b4c40 0x7f79cc0b7150 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f79e8103f50 tx=0x7f79d0005f90 comp rx=0 tx=0).stop 2024-08-31T04:21:36.527 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:32.000+0000 7f79ed000640 1 -- 172.21.15.50:0/1251317068 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f79e8102440 msgr2=0x7f79e819c5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:21:36.527 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:32.000+0000 7f79ed000640 1 --2- 172.21.15.50:0/1251317068 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f79e8102440 0x7f79e819c5e0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f79d8005940 tx=0x7f79d8004270 comp rx=0 tx=0).stop 2024-08-31T04:21:36.527 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:32.000+0000 7f79e6800640 1 -- 172.21.15.50:0/1251317068 reap_dead start 2024-08-31T04:21:36.527 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:32.000+0000 7f79ed000640 1 -- 172.21.15.50:0/1251317068 shutdown_connections 2024-08-31T04:21:36.527 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:32.000+0000 7f79ed000640 1 -- 172.21.15.50:0/1251317068 >> 172.21.15.50:0/1251317068 conn(0x7f79e80793f0 msgr2=0x7f79e8109b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:21:36.527 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:32.000+0000 7f79ed000640 1 -- 172.21.15.50:0/1251317068 shutdown_connections 2024-08-31T04:21:36.527 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:32.000+0000 7f79ed000640 1 -- 172.21.15.50:0/1251317068 wait complete. 2024-08-31T04:21:37.380 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:21:37 smithi050 ceph-mon[17259]: pgmap v328: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2024-08-31T04:21:37.382 INFO:teuthology.orchestra.run.smithi050.stdout:201863462958 2024-08-31T04:21:37.382 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 058d9fc6-674f-11ef-bcd4-c7b262605968 -- ceph osd last-stat-seq osd.7 2024-08-31T04:21:37.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:21:37 smithi177 ceph-mon[22025]: pgmap v328: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2024-08-31T04:21:37.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:21:37 smithi133 ceph-mon[22177]: pgmap v328: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2024-08-31T04:21:37.621 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:37.620+0000 7ff2cb600640 1 -- 172.21.15.50:0/724838950 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff2c4103910 msgr2=0x7ff2c4103d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:21:37.622 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:37.620+0000 7ff2cb600640 1 --2- 172.21.15.50:0/724838950 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff2c4103910 0x7ff2c4103d20 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7ff2b8009900 tx=0x7ff2b802a410 comp rx=0 tx=0).stop 2024-08-31T04:21:37.622 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:37.620+0000 7ff2cb600640 1 -- 172.21.15.50:0/724838950 shutdown_connections 2024-08-31T04:21:37.622 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:37.620+0000 7ff2cb600640 1 --2- 172.21.15.50:0/724838950 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff2c4109250 0x7ff2c4109660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:37.622 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:37.620+0000 7ff2cb600640 1 --2- 172.21.15.50:0/724838950 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff2c4109ba0 0x7ff2c41103d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:37.622 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:37.620+0000 7ff2cb600640 1 --2- 172.21.15.50:0/724838950 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff2c4103910 0x7ff2c4103d20 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:37.622 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:37.620+0000 7ff2cb600640 1 -- 172.21.15.50:0/724838950 >> 172.21.15.50:0/724838950 conn(0x7ff2c40ff380 msgr2=0x7ff2c41017d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:21:37.622 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:37.620+0000 7ff2cb600640 1 -- 172.21.15.50:0/724838950 shutdown_connections 2024-08-31T04:21:37.622 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:37.620+0000 7ff2cb600640 1 -- 172.21.15.50:0/724838950 wait complete. 2024-08-31T04:21:37.623 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:37.621+0000 7ff2cb600640 1 Processor -- start 2024-08-31T04:21:37.623 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:37.621+0000 7ff2cb600640 1 -- start start 2024-08-31T04:21:37.623 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:37.622+0000 7ff2cb600640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff2c4103910 0x7ff2c419c490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:21:37.623 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:37.622+0000 7ff2cb600640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff2c4109250 0x7ff2c419ca30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:21:37.623 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:37.622+0000 7ff2cb600640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff2c4109ba0 0x7ff2c41a1cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:21:37.623 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:37.622+0000 7ff2cb600640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7ff2c4113860 con 0x7ff2c4109ba0 2024-08-31T04:21:37.623 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:37.622+0000 7ff2cb600640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7ff2c41136e0 con 0x7ff2c4103910 2024-08-31T04:21:37.624 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:37.622+0000 7ff2cb600640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7ff2c41139e0 con 0x7ff2c4109250 2024-08-31T04:21:37.624 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:37.622+0000 7ff2c3e00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff2c4109250 0x7ff2c419ca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:21:37.624 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:37.622+0000 7ff2c3e00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff2c4109250 0x7ff2c419ca30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.50:53220/0 (socket says 172.21.15.50:53220) 2024-08-31T04:21:37.624 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:37.622+0000 7ff2c3e00640 1 -- 172.21.15.50:0/917985305 learned_addr learned my addr 172.21.15.50:0/917985305 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:21:37.625 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:37.622+0000 7ff2c9600640 1 --2- 172.21.15.50:0/917985305 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff2c4109ba0 0x7ff2c41a1cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:21:37.625 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:37.622+0000 7ff2c8c00640 1 --2- 172.21.15.50:0/917985305 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff2c4103910 0x7ff2c419c490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:21:37.625 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:37.623+0000 7ff2c3e00640 1 -- 172.21.15.50:0/917985305 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff2c4103910 msgr2=0x7ff2c419c490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:21:37.625 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:37.623+0000 7ff2c3e00640 1 --2- 172.21.15.50:0/917985305 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff2c4103910 0x7ff2c419c490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:37.625 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:37.623+0000 7ff2c3e00640 1 -- 172.21.15.50:0/917985305 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff2c4109ba0 msgr2=0x7ff2c41a1cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:21:37.625 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:37.623+0000 7ff2c3e00640 1 --2- 172.21.15.50:0/917985305 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff2c4109ba0 0x7ff2c41a1cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:37.625 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:37.623+0000 7ff2c3e00640 1 -- 172.21.15.50:0/917985305 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2c41a2400 con 0x7ff2c4109250 2024-08-31T04:21:37.625 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:37.623+0000 7ff2c3e00640 1 --2- 172.21.15.50:0/917985305 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff2c4109250 0x7ff2c419ca30 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7ff2b000e9c0 tx=0x7ff2b000ee80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:21:37.625 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:37.623+0000 7ff2c1600640 1 -- 172.21.15.50:0/917985305 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2b000ccc0 con 0x7ff2c4109250 2024-08-31T04:21:37.626 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:37.623+0000 7ff2cb600640 1 -- 172.21.15.50:0/917985305 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff2c41a26f0 con 0x7ff2c4109250 2024-08-31T04:21:37.626 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:37.623+0000 7ff2c1600640 1 -- 172.21.15.50:0/917985305 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff2b00054d0 con 0x7ff2c4109250 2024-08-31T04:21:37.626 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:37.624+0000 7ff2c1600640 1 -- 172.21.15.50:0/917985305 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2b0010430 con 0x7ff2c4109250 2024-08-31T04:21:37.626 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:37.624+0000 7ff2cb600640 1 -- 172.21.15.50:0/917985305 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff2c41a8e50 con 0x7ff2c4109250 2024-08-31T04:21:37.626 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:37.624+0000 7ff2cb600640 1 -- 172.21.15.50:0/917985305 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7ff2c410f990 con 0x7ff2c4109250 2024-08-31T04:21:37.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:37.627+0000 7ff2c1600640 1 -- 172.21.15.50:0/917985305 <== mon.1 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 17) ==== 152628+0+0 (secure 0 0 0) 0x7ff2b0005000 con 0x7ff2c4109250 2024-08-31T04:21:37.631 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:37.630+0000 7ff2c1600640 1 --2- 172.21.15.50:0/917985305 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7ff2ac0b4bc0 0x7ff2ac0b70d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:21:37.631 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:37.630+0000 7ff2c1600640 1 -- 172.21.15.50:0/917985305 <== mon.1 v2:172.21.15.177:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8219+0+0 (secure 0 0 0) 0x7ff2b00e5b00 con 0x7ff2c4109250 2024-08-31T04:21:37.631 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:37.630+0000 7ff2c8c00640 1 --2- 172.21.15.50:0/917985305 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7ff2ac0b4bc0 0x7ff2ac0b70d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:21:37.631 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:37.630+0000 7ff2c1600640 1 --2- 172.21.15.50:0/917985305 >> [v2:172.21.15.177:6824/2103454982,v1:172.21.15.177:6825/2103454982] conn(0x7ff2ac0be6b0 0x7ff2ac0c0ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:21:37.632 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:37.630+0000 7ff2c1600640 1 -- 172.21.15.50:0/917985305 --> [v2:172.21.15.177:6824/2103454982,v1:172.21.15.177:6825/2103454982] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff2b0021e50 con 0x7ff2ac0be6b0 2024-08-31T04:21:37.632 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:37.630+0000 7ff2c1600640 1 -- 172.21.15.50:0/917985305 <== mon.1 v2:172.21.15.177:3300/0 6 ==== mon_get_version_reply(handle=1 version=78) ==== 24+0+0 (secure 0 0 0) 0x7ff2b00e5eb0 con 0x7ff2c4109250 2024-08-31T04:21:37.632 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:37.631+0000 7ff2c9600640 1 --2- 172.21.15.50:0/917985305 >> [v2:172.21.15.177:6824/2103454982,v1:172.21.15.177:6825/2103454982] conn(0x7ff2ac0be6b0 0x7ff2ac0c0ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:21:37.632 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:37.631+0000 7ff2c8c00640 1 --2- 172.21.15.50:0/917985305 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7ff2ac0b4bc0 0x7ff2ac0b70d0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7ff2b8031440 tx=0x7ff2b8005d50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:21:37.632 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:37.631+0000 7ff2c9600640 1 --2- 172.21.15.50:0/917985305 >> [v2:172.21.15.177:6824/2103454982,v1:172.21.15.177:6825/2103454982] conn(0x7ff2ac0be6b0 0x7ff2ac0c0ba0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.11 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:21:37.633 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:37.632+0000 7ff2c1600640 1 -- 172.21.15.50:0/917985305 <== osd.11 v2:172.21.15.177:6824/2103454982 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7ff2b0021e50 con 0x7ff2ac0be6b0 2024-08-31T04:21:37.649 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:37.648+0000 7ff2cb600640 1 -- 172.21.15.50:0/917985305 --> [v2:172.21.15.177:6824/2103454982,v1:172.21.15.177:6825/2103454982] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7ff2c4104b90 con 0x7ff2ac0be6b0 2024-08-31T04:21:37.649 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:37.648+0000 7ff2c1600640 1 -- 172.21.15.50:0/917985305 <== osd.11 v2:172.21.15.177:6824/2103454982 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7ff2c4104b90 con 0x7ff2ac0be6b0 2024-08-31T04:21:37.650 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:37.649+0000 7ff2cb600640 1 -- 172.21.15.50:0/917985305 >> [v2:172.21.15.177:6824/2103454982,v1:172.21.15.177:6825/2103454982] conn(0x7ff2ac0be6b0 msgr2=0x7ff2ac0c0ba0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:21:37.650 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:37.649+0000 7ff2cb600640 1 --2- 172.21.15.50:0/917985305 >> [v2:172.21.15.177:6824/2103454982,v1:172.21.15.177:6825/2103454982] conn(0x7ff2ac0be6b0 0x7ff2ac0c0ba0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:37.650 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:37.649+0000 7ff2cb600640 1 -- 172.21.15.50:0/917985305 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7ff2ac0b4bc0 msgr2=0x7ff2ac0b70d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:21:37.651 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:37.649+0000 7ff2cb600640 1 --2- 172.21.15.50:0/917985305 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7ff2ac0b4bc0 0x7ff2ac0b70d0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7ff2b8031440 tx=0x7ff2b8005d50 comp rx=0 tx=0).stop 2024-08-31T04:21:37.651 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:37.649+0000 7ff2cb600640 1 -- 172.21.15.50:0/917985305 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff2c4109250 msgr2=0x7ff2c419ca30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:21:37.651 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:37.649+0000 7ff2cb600640 1 --2- 172.21.15.50:0/917985305 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff2c4109250 0x7ff2c419ca30 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7ff2b000e9c0 tx=0x7ff2b000ee80 comp rx=0 tx=0).stop 2024-08-31T04:21:37.651 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:37.649+0000 7ff2c9600640 1 -- 172.21.15.50:0/917985305 reap_dead start 2024-08-31T04:21:37.651 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:37.649+0000 7ff2cb600640 1 -- 172.21.15.50:0/917985305 shutdown_connections 2024-08-31T04:21:37.651 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:37.649+0000 7ff2cb600640 1 -- 172.21.15.50:0/917985305 >> 172.21.15.50:0/917985305 conn(0x7ff2c40ff380 msgr2=0x7ff2c4108900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:21:37.651 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:37.649+0000 7ff2cb600640 1 -- 172.21.15.50:0/917985305 shutdown_connections 2024-08-31T04:21:37.651 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:37.649+0000 7ff2cb600640 1 -- 172.21.15.50:0/917985305 wait complete. 2024-08-31T04:21:38.009 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:37.861+0000 7f7256400640 1 -- 172.21.15.50:0/842598083 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7250109240 msgr2=0x7f7250109650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:21:38.009 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:37.861+0000 7f7256400640 1 --2- 172.21.15.50:0/842598083 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7250109240 0x7f7250109650 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f7238009860 tx=0x7f723802a340 comp rx=0 tx=0).stop 2024-08-31T04:21:38.010 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:37.861+0000 7f7256400640 1 -- 172.21.15.50:0/842598083 shutdown_connections 2024-08-31T04:21:38.010 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:37.861+0000 7f7256400640 1 --2- 172.21.15.50:0/842598083 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7250109b90 0x7f72501103c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:38.010 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:37.861+0000 7f7256400640 1 --2- 172.21.15.50:0/842598083 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7250109240 0x7f7250109650 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:38.010 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:37.861+0000 7f7256400640 1 --2- 172.21.15.50:0/842598083 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7250103900 0x7f7250103d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:38.010 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:37.861+0000 7f7256400640 1 -- 172.21.15.50:0/842598083 >> 172.21.15.50:0/842598083 conn(0x7f725007b5f0 msgr2=0x7f725007ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:21:38.010 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:37.861+0000 7f7256400640 1 -- 172.21.15.50:0/842598083 shutdown_connections 2024-08-31T04:21:38.010 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:37.861+0000 7f7256400640 1 -- 172.21.15.50:0/842598083 wait complete. 2024-08-31T04:21:38.010 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:37.862+0000 7f7256400640 1 Processor -- start 2024-08-31T04:21:38.010 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:37.862+0000 7f7256400640 1 -- start start 2024-08-31T04:21:38.010 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:37.863+0000 7f7256400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7250103900 0x7f72500754b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:21:38.010 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:37.863+0000 7f7256400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7250109240 0x7f72500759f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:21:38.010 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:37.863+0000 7f7256400640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7250109b90 0x7f7250075f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:21:38.011 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:37.863+0000 7f7256400640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f7250113850 con 0x7f7250109240 2024-08-31T04:21:38.011 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:37.863+0000 7f7256400640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f72501136d0 con 0x7f7250103900 2024-08-31T04:21:38.011 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:37.863+0000 7f7256400640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f72501139d0 con 0x7f7250109b90 2024-08-31T04:21:38.011 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:37.863+0000 7f7247e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7250109240 0x7f72500759f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:21:38.011 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:37.863+0000 7f7247e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7250109240 0x7f72500759f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:59494/0 (socket says 172.21.15.50:59494) 2024-08-31T04:21:38.011 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:37.863+0000 7f7247e00640 1 -- 172.21.15.50:0/2481479700 learned_addr learned my addr 172.21.15.50:0/2481479700 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:21:38.011 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:37.863+0000 7f724f400640 1 --2- 172.21.15.50:0/2481479700 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7250103900 0x7f72500754b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:21:38.011 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:37.863+0000 7f724fe00640 1 --2- 172.21.15.50:0/2481479700 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7250109b90 0x7f7250075f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:21:38.011 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:37.863+0000 7f7247e00640 1 -- 172.21.15.50:0/2481479700 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7250109b90 msgr2=0x7f7250075f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:21:38.011 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:37.863+0000 7f7247e00640 1 --2- 172.21.15.50:0/2481479700 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7250109b90 0x7f7250075f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:38.011 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:37.863+0000 7f7247e00640 1 -- 172.21.15.50:0/2481479700 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7250103900 msgr2=0x7f72500754b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:21:38.011 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:37.863+0000 7f7247e00640 1 --2- 172.21.15.50:0/2481479700 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7250103900 0x7f72500754b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:38.011 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:37.863+0000 7f7247e00640 1 -- 172.21.15.50:0/2481479700 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72501a8480 con 0x7f7250109240 2024-08-31T04:21:38.012 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:37.863+0000 7f724f400640 1 --2- 172.21.15.50:0/2481479700 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7250103900 0x7f72500754b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:21:38.012 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:37.864+0000 7f7247e00640 1 --2- 172.21.15.50:0/2481479700 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7250109240 0x7f72500759f0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f7238035040 tx=0x7f7238032d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:21:38.012 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:37.864+0000 7f724cc00640 1 -- 172.21.15.50:0/2481479700 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7238040020 con 0x7f7250109240 2024-08-31T04:21:38.012 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:37.864+0000 7f724cc00640 1 -- 172.21.15.50:0/2481479700 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7238030d50 con 0x7f7250109240 2024-08-31T04:21:38.012 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:37.864+0000 7f724cc00640 1 -- 172.21.15.50:0/2481479700 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7238037040 con 0x7f7250109240 2024-08-31T04:21:38.012 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:37.864+0000 7f7256400640 1 -- 172.21.15.50:0/2481479700 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f72501a8710 con 0x7f7250109240 2024-08-31T04:21:38.012 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:37.864+0000 7f7256400640 1 -- 172.21.15.50:0/2481479700 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f72501a8ba0 con 0x7f7250109240 2024-08-31T04:21:38.012 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:37.865+0000 7f7256400640 1 -- 172.21.15.50:0/2481479700 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f72500638f0 con 0x7f7250109240 2024-08-31T04:21:38.012 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:37.868+0000 7f724cc00640 1 -- 172.21.15.50:0/2481479700 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 17) ==== 152628+0+0 (secure 0 0 0) 0x7f7238043020 con 0x7f7250109240 2024-08-31T04:21:38.012 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:37.870+0000 7f724cc00640 1 --2- 172.21.15.50:0/2481479700 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f72340b4c40 0x7f72340b7150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:21:38.012 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:37.870+0000 7f724cc00640 1 -- 172.21.15.50:0/2481479700 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8219+0+0 (secure 0 0 0) 0x7f7238105200 con 0x7f7250109240 2024-08-31T04:21:38.012 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:37.870+0000 7f724f400640 1 --2- 172.21.15.50:0/2481479700 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f72340b4c40 0x7f72340b7150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:21:38.012 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:37.870+0000 7f724cc00640 1 --2- 172.21.15.50:0/2481479700 >> [v2:172.21.15.50:6826/53019860,v1:172.21.15.50:6827/53019860] conn(0x7f72340be730 0x7f72340c0c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:21:38.013 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:37.870+0000 7f724cc00640 1 -- 172.21.15.50:0/2481479700 --> [v2:172.21.15.50:6826/53019860,v1:172.21.15.50:6827/53019860] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f7238043ec0 con 0x7f72340be730 2024-08-31T04:21:38.013 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:37.870+0000 7f724cc00640 1 -- 172.21.15.50:0/2481479700 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_get_version_reply(handle=1 version=78) ==== 24+0+0 (secure 0 0 0) 0x7f72381055b0 con 0x7f7250109240 2024-08-31T04:21:38.013 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:37.871+0000 7f724fe00640 1 --2- 172.21.15.50:0/2481479700 >> [v2:172.21.15.50:6826/53019860,v1:172.21.15.50:6827/53019860] conn(0x7f72340be730 0x7f72340c0c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:21:38.013 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:37.871+0000 7f724f400640 1 --2- 172.21.15.50:0/2481479700 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f72340b4c40 0x7f72340b7150 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f7250076f00 tx=0x7f7240009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:21:38.013 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:37.871+0000 7f724fe00640 1 --2- 172.21.15.50:0/2481479700 >> [v2:172.21.15.50:6826/53019860,v1:172.21.15.50:6827/53019860] conn(0x7f72340be730 0x7f72340c0c20 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.9 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:21:38.013 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:37.872+0000 7f724cc00640 1 -- 172.21.15.50:0/2481479700 <== osd.9 v2:172.21.15.50:6826/53019860 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f7238043ec0 con 0x7f72340be730 2024-08-31T04:21:38.014 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:37.887+0000 7f7256400640 1 -- 172.21.15.50:0/2481479700 --> [v2:172.21.15.50:6826/53019860,v1:172.21.15.50:6827/53019860] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f7250063d40 con 0x7f72340be730 2024-08-31T04:21:38.014 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:37.887+0000 7f724cc00640 1 -- 172.21.15.50:0/2481479700 <== osd.9 v2:172.21.15.50:6826/53019860 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f7250063d40 con 0x7f72340be730 2024-08-31T04:21:38.014 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:37.887+0000 7f7256400640 1 -- 172.21.15.50:0/2481479700 >> [v2:172.21.15.50:6826/53019860,v1:172.21.15.50:6827/53019860] conn(0x7f72340be730 msgr2=0x7f72340c0c20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:21:38.014 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:37.887+0000 7f7256400640 1 --2- 172.21.15.50:0/2481479700 >> [v2:172.21.15.50:6826/53019860,v1:172.21.15.50:6827/53019860] conn(0x7f72340be730 0x7f72340c0c20 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:38.014 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:37.888+0000 7f7256400640 1 -- 172.21.15.50:0/2481479700 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f72340b4c40 msgr2=0x7f72340b7150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:21:38.014 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:37.888+0000 7f7256400640 1 --2- 172.21.15.50:0/2481479700 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f72340b4c40 0x7f72340b7150 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f7250076f00 tx=0x7f7240009260 comp rx=0 tx=0).stop 2024-08-31T04:21:38.014 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:37.888+0000 7f7256400640 1 -- 172.21.15.50:0/2481479700 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7250109240 msgr2=0x7f72500759f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:21:38.014 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:37.888+0000 7f7256400640 1 --2- 172.21.15.50:0/2481479700 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7250109240 0x7f72500759f0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f7238035040 tx=0x7f7238032d50 comp rx=0 tx=0).stop 2024-08-31T04:21:38.014 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:37.888+0000 7f724fe00640 1 -- 172.21.15.50:0/2481479700 reap_dead start 2024-08-31T04:21:38.014 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:37.888+0000 7f7256400640 1 -- 172.21.15.50:0/2481479700 shutdown_connections 2024-08-31T04:21:38.014 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:37.888+0000 7f7256400640 1 -- 172.21.15.50:0/2481479700 >> 172.21.15.50:0/2481479700 conn(0x7f725007b5f0 msgr2=0x7f7250105250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:21:38.014 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:37.888+0000 7f7256400640 1 -- 172.21.15.50:0/2481479700 shutdown_connections 2024-08-31T04:21:38.014 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:37.888+0000 7f7256400640 1 -- 172.21.15.50:0/2481479700 wait complete. 2024-08-31T04:21:38.816 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:38.814+0000 7f5b98a00640 1 -- 172.21.15.50:0/3736137399 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5b94105b30 msgr2=0x7f5b94105f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:21:38.817 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:38.814+0000 7f5b98a00640 1 --2- 172.21.15.50:0/3736137399 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5b94105b30 0x7f5b94105f40 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f5b84009900 tx=0x7f5b8402a3f0 comp rx=0 tx=0).stop 2024-08-31T04:21:38.817 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:38.814+0000 7f5b98a00640 1 -- 172.21.15.50:0/3736137399 shutdown_connections 2024-08-31T04:21:38.817 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:38.814+0000 7f5b98a00640 1 --2- 172.21.15.50:0/3736137399 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5b9410bdc0 0x7f5b941125f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:38.817 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:38.814+0000 7f5b98a00640 1 --2- 172.21.15.50:0/3736137399 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5b9410b470 0x7f5b9410b880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:38.817 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:38.814+0000 7f5b98a00640 1 --2- 172.21.15.50:0/3736137399 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5b94105b30 0x7f5b94105f40 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:38.817 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:38.814+0000 7f5b98a00640 1 -- 172.21.15.50:0/3736137399 >> 172.21.15.50:0/3736137399 conn(0x7f5b94101600 msgr2=0x7f5b94103a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:21:38.817 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:38.815+0000 7f5b98a00640 1 -- 172.21.15.50:0/3736137399 shutdown_connections 2024-08-31T04:21:38.817 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:38.815+0000 7f5b98a00640 1 -- 172.21.15.50:0/3736137399 wait complete. 2024-08-31T04:21:38.820 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:38.816+0000 7f5b98a00640 1 Processor -- start 2024-08-31T04:21:38.820 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:38.816+0000 7f5b98a00640 1 -- start start 2024-08-31T04:21:38.820 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:38.816+0000 7f5b98a00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5b94105b30 0x7f5b9419c450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:21:38.820 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:38.816+0000 7f5b98a00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5b9410b470 0x7f5b9419c9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:21:38.820 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:38.816+0000 7f5b98a00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5b9410bdc0 0x7f5b941a1c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:21:38.820 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:38.816+0000 7f5b98a00640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f5b94115a80 con 0x7f5b94105b30 2024-08-31T04:21:38.820 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:38.816+0000 7f5b98a00640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f5b94115900 con 0x7f5b9410b470 2024-08-31T04:21:38.820 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:38.816+0000 7f5b98a00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f5b94115c00 con 0x7f5b9410bdc0 2024-08-31T04:21:38.821 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:38.817+0000 7f5b91400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5b9410b470 0x7f5b9419c9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:21:38.821 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:38.817+0000 7f5b91400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5b9410b470 0x7f5b9419c9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.50:51774/0 (socket says 172.21.15.50:51774) 2024-08-31T04:21:38.821 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:38.817+0000 7f5b91400640 1 -- 172.21.15.50:0/196421397 learned_addr learned my addr 172.21.15.50:0/196421397 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:21:38.821 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:38.817+0000 7f5b91e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5b94105b30 0x7f5b9419c450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:21:38.821 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:38.817+0000 7f5b92800640 1 --2- 172.21.15.50:0/196421397 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5b9410bdc0 0x7f5b941a1c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:21:38.821 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:38.817+0000 7f5b91400640 1 -- 172.21.15.50:0/196421397 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5b9410bdc0 msgr2=0x7f5b941a1c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:21:38.821 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:38.817+0000 7f5b91400640 1 --2- 172.21.15.50:0/196421397 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5b9410bdc0 0x7f5b941a1c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:38.821 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:38.817+0000 7f5b91400640 1 -- 172.21.15.50:0/196421397 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5b94105b30 msgr2=0x7f5b9419c450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:21:38.822 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:38.817+0000 7f5b91400640 1 --2- 172.21.15.50:0/196421397 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5b94105b30 0x7f5b9419c450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:38.822 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:38.817+0000 7f5b91400640 1 -- 172.21.15.50:0/196421397 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b941a23c0 con 0x7f5b9410b470 2024-08-31T04:21:38.822 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:38.817+0000 7f5b91e00640 1 --2- 172.21.15.50:0/196421397 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5b94105b30 0x7f5b9419c450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:21:38.822 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:38.817+0000 7f5b91400640 1 --2- 172.21.15.50:0/196421397 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5b9410b470 0x7f5b9419c9f0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f5b8000e9f0 tx=0x7f5b8000eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:21:38.822 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:38.818+0000 7f5b8aa00640 1 -- 172.21.15.50:0/196421397 <== mon.2 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b8000ccc0 con 0x7f5b9410b470 2024-08-31T04:21:38.823 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:38.818+0000 7f5b98a00640 1 -- 172.21.15.50:0/196421397 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5b941a26b0 con 0x7f5b9410b470 2024-08-31T04:21:38.823 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:38.818+0000 7f5b8aa00640 1 -- 172.21.15.50:0/196421397 <== mon.2 v2:172.21.15.133:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5b800108e0 con 0x7f5b9410b470 2024-08-31T04:21:38.823 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:38.818+0000 7f5b8aa00640 1 -- 172.21.15.50:0/196421397 <== mon.2 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b80018860 con 0x7f5b9410b470 2024-08-31T04:21:38.823 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:38.818+0000 7f5b98a00640 1 -- 172.21.15.50:0/196421397 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5b941a8e10 con 0x7f5b9410b470 2024-08-31T04:21:38.825 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:38.819+0000 7f5b98a00640 1 -- 172.21.15.50:0/196421397 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f5b74001060 con 0x7f5b9410b470 2024-08-31T04:21:38.826 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:38.822+0000 7f5b8aa00640 1 -- 172.21.15.50:0/196421397 <== mon.2 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 17) ==== 152628+0+0 (secure 0 0 0) 0x7f5b80010430 con 0x7f5b9410b470 2024-08-31T04:21:38.826 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:38.823+0000 7f5b8aa00640 1 --2- 172.21.15.50:0/196421397 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f5b780b4bc0 0x7f5b780b70d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:21:38.826 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:38.823+0000 7f5b8aa00640 1 -- 172.21.15.50:0/196421397 <== mon.2 v2:172.21.15.133:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8219+0+0 (secure 0 0 0) 0x7f5b800e5ed0 con 0x7f5b9410b470 2024-08-31T04:21:38.826 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:38.823+0000 7f5b91e00640 1 --2- 172.21.15.50:0/196421397 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f5b780b4bc0 0x7f5b780b70d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:21:38.826 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:38.824+0000 7f5b8aa00640 1 --2- 172.21.15.50:0/196421397 >> [v2:172.21.15.50:6802/3831273843,v1:172.21.15.50:6803/3831273843] conn(0x7f5b780be6b0 0x7f5b780c0ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:21:38.827 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:38.824+0000 7f5b8aa00640 1 -- 172.21.15.50:0/196421397 --> [v2:172.21.15.50:6802/3831273843,v1:172.21.15.50:6803/3831273843] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f5b780c1270 con 0x7f5b780be6b0 2024-08-31T04:21:38.827 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:38.824+0000 7f5b8aa00640 1 -- 172.21.15.50:0/196421397 <== mon.2 v2:172.21.15.133:3300/0 6 ==== mon_get_version_reply(handle=1 version=78) ==== 24+0+0 (secure 0 0 0) 0x7f5b800e6320 con 0x7f5b9410b470 2024-08-31T04:21:38.827 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:38.824+0000 7f5b92800640 1 --2- 172.21.15.50:0/196421397 >> [v2:172.21.15.50:6802/3831273843,v1:172.21.15.50:6803/3831273843] conn(0x7f5b780be6b0 0x7f5b780c0ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:21:38.827 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:38.824+0000 7f5b91e00640 1 --2- 172.21.15.50:0/196421397 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f5b780b4bc0 0x7f5b780b70d0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f5b84031440 tx=0x7f5b84032ed0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:21:38.828 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:38.825+0000 7f5b92800640 1 --2- 172.21.15.50:0/196421397 >> [v2:172.21.15.50:6802/3831273843,v1:172.21.15.50:6803/3831273843] conn(0x7f5b780be6b0 0x7f5b780c0ba0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:21:38.828 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:38.826+0000 7f5b8aa00640 1 -- 172.21.15.50:0/196421397 <== osd.0 v2:172.21.15.50:6802/3831273843 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f5b780c1270 con 0x7f5b780be6b0 2024-08-31T04:21:38.841 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:38.840+0000 7f5b98a00640 1 -- 172.21.15.50:0/196421397 --> [v2:172.21.15.50:6802/3831273843,v1:172.21.15.50:6803/3831273843] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f5b74002e00 con 0x7f5b780be6b0 2024-08-31T04:21:38.842 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:38.841+0000 7f5b8aa00640 1 -- 172.21.15.50:0/196421397 <== osd.0 v2:172.21.15.50:6802/3831273843 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f5b74002e00 con 0x7f5b780be6b0 2024-08-31T04:21:38.843 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:38.841+0000 7f5b98a00640 1 -- 172.21.15.50:0/196421397 >> [v2:172.21.15.50:6802/3831273843,v1:172.21.15.50:6803/3831273843] conn(0x7f5b780be6b0 msgr2=0x7f5b780c0ba0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:21:38.843 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:38.841+0000 7f5b98a00640 1 --2- 172.21.15.50:0/196421397 >> [v2:172.21.15.50:6802/3831273843,v1:172.21.15.50:6803/3831273843] conn(0x7f5b780be6b0 0x7f5b780c0ba0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:38.843 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:38.841+0000 7f5b98a00640 1 -- 172.21.15.50:0/196421397 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f5b780b4bc0 msgr2=0x7f5b780b70d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:21:38.843 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:38.841+0000 7f5b98a00640 1 --2- 172.21.15.50:0/196421397 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f5b780b4bc0 0x7f5b780b70d0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f5b84031440 tx=0x7f5b84032ed0 comp rx=0 tx=0).stop 2024-08-31T04:21:38.844 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:38.841+0000 7f5b98a00640 1 -- 172.21.15.50:0/196421397 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5b9410b470 msgr2=0x7f5b9419c9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:21:38.844 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:38.841+0000 7f5b98a00640 1 --2- 172.21.15.50:0/196421397 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5b9410b470 0x7f5b9419c9f0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f5b8000e9f0 tx=0x7f5b8000eeb0 comp rx=0 tx=0).stop 2024-08-31T04:21:38.844 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:38.841+0000 7f5b92800640 1 -- 172.21.15.50:0/196421397 reap_dead start 2024-08-31T04:21:38.844 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:38.841+0000 7f5b98a00640 1 -- 172.21.15.50:0/196421397 shutdown_connections 2024-08-31T04:21:38.844 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:38.841+0000 7f5b98a00640 1 -- 172.21.15.50:0/196421397 >> 172.21.15.50:0/196421397 conn(0x7f5b94101600 msgr2=0x7f5b94103a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:21:38.844 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:38.842+0000 7f5b98a00640 1 -- 172.21.15.50:0/196421397 shutdown_connections 2024-08-31T04:21:38.844 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:38.842+0000 7f5b98a00640 1 -- 172.21.15.50:0/196421397 wait complete. 2024-08-31T04:21:39.283 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:21:39 smithi050 ceph-mon[17259]: pgmap v329: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-08-31T04:21:39.283 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:21:39 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T04:21:39.412 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:21:39 smithi177 ceph-mon[22025]: pgmap v329: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-08-31T04:21:39.412 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:21:39 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T04:21:39.440 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:21:39 smithi133 ceph-mon[22177]: pgmap v329: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-08-31T04:21:39.440 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:21:39 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T04:21:39.594 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:39.592+0000 7f9daee00640 1 -- 172.21.15.50:0/198780989 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9da8103750 msgr2=0x7f9da8103b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:21:39.594 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:39.592+0000 7f9daee00640 1 --2- 172.21.15.50:0/198780989 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9da8103750 0x7f9da8103b60 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f9d9c009ca0 tx=0x7f9d9c02a8b0 comp rx=0 tx=0).stop 2024-08-31T04:21:39.594 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:39.592+0000 7f9daee00640 1 -- 172.21.15.50:0/198780989 shutdown_connections 2024-08-31T04:21:39.594 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:39.592+0000 7f9daee00640 1 --2- 172.21.15.50:0/198780989 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9da81099e0 0x7f9da8110210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:39.594 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:39.592+0000 7f9daee00640 1 --2- 172.21.15.50:0/198780989 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9da8109090 0x7f9da81094a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:39.594 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:39.592+0000 7f9daee00640 1 --2- 172.21.15.50:0/198780989 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9da8103750 0x7f9da8103b60 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:39.595 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:39.592+0000 7f9daee00640 1 -- 172.21.15.50:0/198780989 >> 172.21.15.50:0/198780989 conn(0x7f9da80ff1e0 msgr2=0x7f9da8101630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:21:39.595 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:39.592+0000 7f9daee00640 1 -- 172.21.15.50:0/198780989 shutdown_connections 2024-08-31T04:21:39.595 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:39.593+0000 7f9daee00640 1 -- 172.21.15.50:0/198780989 wait complete. 2024-08-31T04:21:39.598 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:39.594+0000 7f9daee00640 1 Processor -- start 2024-08-31T04:21:39.598 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:39.594+0000 7f9daee00640 1 -- start start 2024-08-31T04:21:39.599 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:39.594+0000 7f9daee00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9da8103750 0x7f9da80754b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:21:39.599 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:39.594+0000 7f9daee00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9da8109090 0x7f9da80759f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:21:39.599 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:39.594+0000 7f9daee00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9da81099e0 0x7f9da8075f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:21:39.599 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:39.594+0000 7f9daee00640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f9da8113690 con 0x7f9da8109090 2024-08-31T04:21:39.599 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:39.594+0000 7f9daee00640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f9da8113510 con 0x7f9da8103750 2024-08-31T04:21:39.599 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:39.594+0000 7f9daee00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f9da8113810 con 0x7f9da81099e0 2024-08-31T04:21:39.599 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:39.594+0000 7f9dada00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9da8103750 0x7f9da80754b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:21:39.599 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:39.594+0000 7f9dad000640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9da8109090 0x7f9da80759f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:21:39.599 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:39.595+0000 7f9dada00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9da8103750 0x7f9da80754b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.50:51820/0 (socket says 172.21.15.50:51820) 2024-08-31T04:21:39.599 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:39.595+0000 7f9dada00640 1 -- 172.21.15.50:0/3615372765 learned_addr learned my addr 172.21.15.50:0/3615372765 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:21:39.599 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:39.595+0000 7f9dae400640 1 --2- 172.21.15.50:0/3615372765 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9da81099e0 0x7f9da8075f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:21:39.599 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:39.595+0000 7f9dada00640 1 -- 172.21.15.50:0/3615372765 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9da81099e0 msgr2=0x7f9da8075f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:21:39.599 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:39.595+0000 7f9dada00640 1 --2- 172.21.15.50:0/3615372765 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9da81099e0 0x7f9da8075f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:39.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:39.595+0000 7f9dada00640 1 -- 172.21.15.50:0/3615372765 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9da8109090 msgr2=0x7f9da80759f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:21:39.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:39.595+0000 7f9dada00640 1 --2- 172.21.15.50:0/3615372765 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9da8109090 0x7f9da80759f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:39.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:39.595+0000 7f9dada00640 1 -- 172.21.15.50:0/3615372765 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9da81a83a0 con 0x7f9da8103750 2024-08-31T04:21:39.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:39.595+0000 7f9dae400640 1 --2- 172.21.15.50:0/3615372765 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9da81099e0 0x7f9da8075f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:21:39.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:39.595+0000 7f9dad000640 1 --2- 172.21.15.50:0/3615372765 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9da8109090 0x7f9da80759f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:21:39.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:39.595+0000 7f9dada00640 1 --2- 172.21.15.50:0/3615372765 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9da8103750 0x7f9da80754b0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f9d9c006010 tx=0x7f9d9c030cf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:21:39.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:39.596+0000 7f9da6000640 1 -- 172.21.15.50:0/3615372765 <== mon.2 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d9c004040 con 0x7f9da8103750 2024-08-31T04:21:39.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:39.596+0000 7f9da6000640 1 -- 172.21.15.50:0/3615372765 <== mon.2 v2:172.21.15.133:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9d9c040070 con 0x7f9da8103750 2024-08-31T04:21:39.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:39.596+0000 7f9daee00640 1 -- 172.21.15.50:0/3615372765 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9da81a8630 con 0x7f9da8103750 2024-08-31T04:21:39.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:39.596+0000 7f9da6000640 1 -- 172.21.15.50:0/3615372765 <== mon.2 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d9c045af0 con 0x7f9da8103750 2024-08-31T04:21:39.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:39.596+0000 7f9daee00640 1 -- 172.21.15.50:0/3615372765 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9da81a8b70 con 0x7f9da8103750 2024-08-31T04:21:39.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:39.597+0000 7f9daee00640 1 -- 172.21.15.50:0/3615372765 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f9da80638b0 con 0x7f9da8103750 2024-08-31T04:21:39.601 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:39.599+0000 7f9da6000640 1 -- 172.21.15.50:0/3615372765 <== mon.2 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 17) ==== 152628+0+0 (secure 0 0 0) 0x7f9d9c045c90 con 0x7f9da8103750 2024-08-31T04:21:39.603 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:39.601+0000 7f9da6000640 1 --2- 172.21.15.50:0/3615372765 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f9d900b4bc0 0x7f9d900b70d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:21:39.603 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:39.601+0000 7f9da6000640 1 -- 172.21.15.50:0/3615372765 <== mon.2 v2:172.21.15.133:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8219+0+0 (secure 0 0 0) 0x7f9d9c1065b0 con 0x7f9da8103750 2024-08-31T04:21:39.603 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:39.601+0000 7f9dad000640 1 --2- 172.21.15.50:0/3615372765 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f9d900b4bc0 0x7f9d900b70d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:21:39.603 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:39.601+0000 7f9da6000640 1 --2- 172.21.15.50:0/3615372765 >> [v2:172.21.15.133:6808/2855333596,v1:172.21.15.133:6809/2855333596] conn(0x7f9d900be6b0 0x7f9d900c0ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:21:39.603 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:39.601+0000 7f9da6000640 1 -- 172.21.15.50:0/3615372765 --> [v2:172.21.15.133:6808/2855333596,v1:172.21.15.133:6809/2855333596] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f9d900c1270 con 0x7f9d900be6b0 2024-08-31T04:21:39.603 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:39.601+0000 7f9da6000640 1 -- 172.21.15.50:0/3615372765 <== mon.2 v2:172.21.15.133:3300/0 6 ==== mon_get_version_reply(handle=1 version=78) ==== 24+0+0 (secure 0 0 0) 0x7f9d9c106960 con 0x7f9da8103750 2024-08-31T04:21:39.603 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:39.602+0000 7f9dae400640 1 --2- 172.21.15.50:0/3615372765 >> [v2:172.21.15.133:6808/2855333596,v1:172.21.15.133:6809/2855333596] conn(0x7f9d900be6b0 0x7f9d900c0ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:21:39.603 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:39.602+0000 7f9dad000640 1 --2- 172.21.15.50:0/3615372765 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f9d900b4bc0 0x7f9d900b70d0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f9d940095f0 tx=0x7f9d94005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:21:39.604 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:39.602+0000 7f9dae400640 1 --2- 172.21.15.50:0/3615372765 >> [v2:172.21.15.133:6808/2855333596,v1:172.21.15.133:6809/2855333596] conn(0x7f9d900be6b0 0x7f9d900c0ba0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:21:39.604 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:39.603+0000 7f9da6000640 1 -- 172.21.15.50:0/3615372765 <== osd.4 v2:172.21.15.133:6808/2855333596 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f9d900c1270 con 0x7f9d900be6b0 2024-08-31T04:21:39.619 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:39.618+0000 7f9daee00640 1 -- 172.21.15.50:0/3615372765 --> [v2:172.21.15.133:6808/2855333596,v1:172.21.15.133:6809/2855333596] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f9da8063cb0 con 0x7f9d900be6b0 2024-08-31T04:21:39.619 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:39.618+0000 7f9da6000640 1 -- 172.21.15.50:0/3615372765 <== osd.4 v2:172.21.15.133:6808/2855333596 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f9da8063cb0 con 0x7f9d900be6b0 2024-08-31T04:21:39.620 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:39.618+0000 7f9daee00640 1 -- 172.21.15.50:0/3615372765 >> [v2:172.21.15.133:6808/2855333596,v1:172.21.15.133:6809/2855333596] conn(0x7f9d900be6b0 msgr2=0x7f9d900c0ba0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:21:39.620 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:39.618+0000 7f9daee00640 1 --2- 172.21.15.50:0/3615372765 >> [v2:172.21.15.133:6808/2855333596,v1:172.21.15.133:6809/2855333596] conn(0x7f9d900be6b0 0x7f9d900c0ba0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:39.620 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:39.619+0000 7f9daee00640 1 -- 172.21.15.50:0/3615372765 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f9d900b4bc0 msgr2=0x7f9d900b70d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:21:39.621 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:39.619+0000 7f9daee00640 1 --2- 172.21.15.50:0/3615372765 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f9d900b4bc0 0x7f9d900b70d0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f9d940095f0 tx=0x7f9d94005f90 comp rx=0 tx=0).stop 2024-08-31T04:21:39.621 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:39.619+0000 7f9daee00640 1 -- 172.21.15.50:0/3615372765 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9da8103750 msgr2=0x7f9da80754b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:21:39.621 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:39.619+0000 7f9daee00640 1 --2- 172.21.15.50:0/3615372765 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9da8103750 0x7f9da80754b0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f9d9c006010 tx=0x7f9d9c030cf0 comp rx=0 tx=0).stop 2024-08-31T04:21:39.621 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:39.619+0000 7f9dae400640 1 -- 172.21.15.50:0/3615372765 reap_dead start 2024-08-31T04:21:39.621 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:39.619+0000 7f9daee00640 1 -- 172.21.15.50:0/3615372765 shutdown_connections 2024-08-31T04:21:39.621 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:39.619+0000 7f9daee00640 1 -- 172.21.15.50:0/3615372765 >> 172.21.15.50:0/3615372765 conn(0x7f9da80ff1e0 msgr2=0x7f9da8101600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:21:39.621 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:39.619+0000 7f9daee00640 1 -- 172.21.15.50:0/3615372765 shutdown_connections 2024-08-31T04:21:39.621 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:39.619+0000 7f9daee00640 1 -- 172.21.15.50:0/3615372765 wait complete. 2024-08-31T04:21:39.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:39.273+0000 7f10bc200640 1 -- 172.21.15.50:0/1594580614 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f10b4109240 msgr2=0x7f10b4109650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:21:39.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:39.273+0000 7f10bc200640 1 --2- 172.21.15.50:0/1594580614 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f10b4109240 0x7f10b4109650 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f10a0009900 tx=0x7f10a002a3f0 comp rx=0 tx=0).stop 2024-08-31T04:21:39.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:39.273+0000 7f10bc200640 1 -- 172.21.15.50:0/1594580614 shutdown_connections 2024-08-31T04:21:39.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:39.273+0000 7f10bc200640 1 --2- 172.21.15.50:0/1594580614 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f10b4109b90 0x7f10b41103c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:39.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:39.273+0000 7f10bc200640 1 --2- 172.21.15.50:0/1594580614 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f10b4109240 0x7f10b4109650 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:39.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:39.273+0000 7f10bc200640 1 --2- 172.21.15.50:0/1594580614 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f10b4103900 0x7f10b4103d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:39.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:39.273+0000 7f10bc200640 1 -- 172.21.15.50:0/1594580614 >> 172.21.15.50:0/1594580614 conn(0x7f10b407b5f0 msgr2=0x7f10b407ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:21:39.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:39.273+0000 7f10bc200640 1 -- 172.21.15.50:0/1594580614 shutdown_connections 2024-08-31T04:21:39.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:39.273+0000 7f10bc200640 1 -- 172.21.15.50:0/1594580614 wait complete. 2024-08-31T04:21:39.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:39.274+0000 7f10bc200640 1 Processor -- start 2024-08-31T04:21:39.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:39.274+0000 7f10bc200640 1 -- start start 2024-08-31T04:21:39.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:39.274+0000 7f10bc200640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f10b4103900 0x7f10b419c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:21:39.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:39.274+0000 7f10bc200640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f10b4109240 0x7f10b419ca20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:21:39.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:39.274+0000 7f10bc200640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f10b4109b90 0x7f10b41a1cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:21:39.642 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:39.274+0000 7f10bc200640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f10b4113850 con 0x7f10b4103900 2024-08-31T04:21:39.642 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:39.274+0000 7f10bc200640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f10b41136d0 con 0x7f10b4109b90 2024-08-31T04:21:39.642 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:39.274+0000 7f10bc200640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f10b41139d0 con 0x7f10b4109240 2024-08-31T04:21:39.642 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:39.275+0000 7f10b9800640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f10b4103900 0x7f10b419c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:21:39.642 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:39.275+0000 7f10b8e00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f10b4109240 0x7f10b419ca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:21:39.642 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:39.275+0000 7f10b8e00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f10b4109240 0x7f10b419ca20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.50:53286/0 (socket says 172.21.15.50:53286) 2024-08-31T04:21:39.642 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:39.275+0000 7f10b9800640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f10b4103900 0x7f10b419c480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:59534/0 (socket says 172.21.15.50:59534) 2024-08-31T04:21:39.642 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:39.275+0000 7f10b8e00640 1 -- 172.21.15.50:0/2830784290 learned_addr learned my addr 172.21.15.50:0/2830784290 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:21:39.642 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:39.275+0000 7f10ba200640 1 --2- 172.21.15.50:0/2830784290 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f10b4109b90 0x7f10b41a1cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:21:39.642 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:39.275+0000 7f10b9800640 1 -- 172.21.15.50:0/2830784290 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f10b4109240 msgr2=0x7f10b419ca20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:21:39.642 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:39.275+0000 7f10b9800640 1 --2- 172.21.15.50:0/2830784290 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f10b4109240 0x7f10b419ca20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:39.642 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:39.275+0000 7f10b9800640 1 -- 172.21.15.50:0/2830784290 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f10b4109b90 msgr2=0x7f10b41a1cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:21:39.642 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:39.275+0000 7f10b9800640 1 --2- 172.21.15.50:0/2830784290 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f10b4109b90 0x7f10b41a1cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:39.643 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:39.275+0000 7f10b9800640 1 -- 172.21.15.50:0/2830784290 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10b41a23f0 con 0x7f10b4103900 2024-08-31T04:21:39.643 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:39.275+0000 7f10ba200640 1 --2- 172.21.15.50:0/2830784290 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f10b4109b90 0x7f10b41a1cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:21:39.643 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:39.275+0000 7f10b9800640 1 --2- 172.21.15.50:0/2830784290 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f10b4103900 0x7f10b419c480 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f10a800eb00 tx=0x7f10a800c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:21:39.643 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:39.276+0000 7f10b2000640 1 -- 172.21.15.50:0/2830784290 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10a8010430 con 0x7f10b4103900 2024-08-31T04:21:39.643 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:39.276+0000 7f10bc200640 1 -- 172.21.15.50:0/2830784290 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f10b41a26e0 con 0x7f10b4103900 2024-08-31T04:21:39.643 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:39.276+0000 7f10b2000640 1 -- 172.21.15.50:0/2830784290 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f10a8010a80 con 0x7f10b4103900 2024-08-31T04:21:39.643 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:39.276+0000 7f10b2000640 1 -- 172.21.15.50:0/2830784290 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10a8017a40 con 0x7f10b4103900 2024-08-31T04:21:39.643 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:39.276+0000 7f10bc200640 1 -- 172.21.15.50:0/2830784290 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f10b41a8e40 con 0x7f10b4103900 2024-08-31T04:21:39.643 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:39.277+0000 7f10bc200640 1 -- 172.21.15.50:0/2830784290 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f10b4107b50 con 0x7f10b4103900 2024-08-31T04:21:39.643 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:39.279+0000 7f10b2000640 1 -- 172.21.15.50:0/2830784290 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 17) ==== 152628+0+0 (secure 0 0 0) 0x7f10a8017be0 con 0x7f10b4103900 2024-08-31T04:21:39.643 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:39.281+0000 7f10b2000640 1 --2- 172.21.15.50:0/2830784290 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f109c0b4c40 0x7f109c0b7150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:21:39.643 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:39.281+0000 7f10b2000640 1 -- 172.21.15.50:0/2830784290 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8219+0+0 (secure 0 0 0) 0x7f10a80e5f70 con 0x7f10b4103900 2024-08-31T04:21:39.643 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:39.281+0000 7f10b8e00640 1 --2- 172.21.15.50:0/2830784290 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f109c0b4c40 0x7f109c0b7150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:21:39.643 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:39.281+0000 7f10b2000640 1 --2- 172.21.15.50:0/2830784290 >> [v2:172.21.15.177:6816/101973300,v1:172.21.15.177:6817/101973300] conn(0x7f109c0be730 0x7f109c0c0c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:21:39.644 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:39.281+0000 7f10b2000640 1 -- 172.21.15.50:0/2830784290 --> [v2:172.21.15.177:6816/101973300,v1:172.21.15.177:6817/101973300] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f10a8023e50 con 0x7f109c0be730 2024-08-31T04:21:39.644 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:39.281+0000 7f10b2000640 1 -- 172.21.15.50:0/2830784290 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_get_version_reply(handle=1 version=78) ==== 24+0+0 (secure 0 0 0) 0x7f10a80e6320 con 0x7f10b4103900 2024-08-31T04:21:39.644 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:39.282+0000 7f10ba200640 1 --2- 172.21.15.50:0/2830784290 >> [v2:172.21.15.177:6816/101973300,v1:172.21.15.177:6817/101973300] conn(0x7f109c0be730 0x7f109c0c0c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:21:39.644 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:39.282+0000 7f10b8e00640 1 --2- 172.21.15.50:0/2830784290 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f109c0b4c40 0x7f109c0b7150 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f10b4106340 tx=0x7f10a0009560 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:21:39.645 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:39.282+0000 7f10ba200640 1 --2- 172.21.15.50:0/2830784290 >> [v2:172.21.15.177:6816/101973300,v1:172.21.15.177:6817/101973300] conn(0x7f109c0be730 0x7f109c0c0c20 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:21:39.645 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:39.283+0000 7f10b2000640 1 -- 172.21.15.50:0/2830784290 <== osd.8 v2:172.21.15.177:6816/101973300 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f10a8023e50 con 0x7f109c0be730 2024-08-31T04:21:39.645 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:39.298+0000 7f10bc200640 1 -- 172.21.15.50:0/2830784290 --> [v2:172.21.15.177:6816/101973300,v1:172.21.15.177:6817/101973300] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f10b4104b80 con 0x7f109c0be730 2024-08-31T04:21:39.645 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:39.298+0000 7f10b2000640 1 -- 172.21.15.50:0/2830784290 <== osd.8 v2:172.21.15.177:6816/101973300 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f10b4104b80 con 0x7f109c0be730 2024-08-31T04:21:39.645 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:39.298+0000 7f10bc200640 1 -- 172.21.15.50:0/2830784290 >> [v2:172.21.15.177:6816/101973300,v1:172.21.15.177:6817/101973300] conn(0x7f109c0be730 msgr2=0x7f109c0c0c20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:21:39.645 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:39.298+0000 7f10bc200640 1 --2- 172.21.15.50:0/2830784290 >> [v2:172.21.15.177:6816/101973300,v1:172.21.15.177:6817/101973300] conn(0x7f109c0be730 0x7f109c0c0c20 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:39.645 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:39.299+0000 7f10bc200640 1 -- 172.21.15.50:0/2830784290 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f109c0b4c40 msgr2=0x7f109c0b7150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:21:39.645 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:39.299+0000 7f10bc200640 1 --2- 172.21.15.50:0/2830784290 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f109c0b4c40 0x7f109c0b7150 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f10b4106340 tx=0x7f10a0009560 comp rx=0 tx=0).stop 2024-08-31T04:21:39.645 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:39.299+0000 7f10bc200640 1 -- 172.21.15.50:0/2830784290 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f10b4103900 msgr2=0x7f10b419c480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:21:39.645 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:39.299+0000 7f10bc200640 1 --2- 172.21.15.50:0/2830784290 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f10b4103900 0x7f10b419c480 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f10a800eb00 tx=0x7f10a800c2d0 comp rx=0 tx=0).stop 2024-08-31T04:21:39.645 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:39.299+0000 7f10ba200640 1 -- 172.21.15.50:0/2830784290 reap_dead start 2024-08-31T04:21:39.645 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:39.299+0000 7f10bc200640 1 -- 172.21.15.50:0/2830784290 shutdown_connections 2024-08-31T04:21:39.646 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:39.299+0000 7f10bc200640 1 -- 172.21.15.50:0/2830784290 >> 172.21.15.50:0/2830784290 conn(0x7f10b407b5f0 msgr2=0x7f10b41070f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:21:39.646 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:39.299+0000 7f10bc200640 1 -- 172.21.15.50:0/2830784290 shutdown_connections 2024-08-31T04:21:39.646 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:39.299+0000 7f10bc200640 1 -- 172.21.15.50:0/2830784290 wait complete. 2024-08-31T04:21:40.875 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:40.524+0000 7fbde6a00640 1 -- 172.21.15.50:0/1417475740 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbde0103900 msgr2=0x7fbde0103d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:21:40.875 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:40.524+0000 7fbde6a00640 1 --2- 172.21.15.50:0/1417475740 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbde0103900 0x7fbde0103d10 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fbdd0009860 tx=0x7fbdd002a340 comp rx=0 tx=0).stop 2024-08-31T04:21:40.875 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:40.524+0000 7fbde6a00640 1 -- 172.21.15.50:0/1417475740 shutdown_connections 2024-08-31T04:21:40.875 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:40.524+0000 7fbde6a00640 1 --2- 172.21.15.50:0/1417475740 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbde0109240 0x7fbde0109650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:40.875 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:40.524+0000 7fbde6a00640 1 --2- 172.21.15.50:0/1417475740 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbde0109b90 0x7fbde01103c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:40.875 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:40.524+0000 7fbde6a00640 1 --2- 172.21.15.50:0/1417475740 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbde0103900 0x7fbde0103d10 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:40.875 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:40.525+0000 7fbde6a00640 1 -- 172.21.15.50:0/1417475740 >> 172.21.15.50:0/1417475740 conn(0x7fbde007b5f0 msgr2=0x7fbde007ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:21:40.875 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:40.525+0000 7fbde6a00640 1 -- 172.21.15.50:0/1417475740 shutdown_connections 2024-08-31T04:21:40.875 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:40.525+0000 7fbde6a00640 1 -- 172.21.15.50:0/1417475740 wait complete. 2024-08-31T04:21:40.876 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:40.526+0000 7fbde6a00640 1 Processor -- start 2024-08-31T04:21:40.876 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:40.526+0000 7fbde6a00640 1 -- start start 2024-08-31T04:21:40.876 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:40.526+0000 7fbde6a00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbde0103900 0x7fbde019c400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:21:40.876 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:40.526+0000 7fbde6a00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbde0109240 0x7fbde019c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:21:40.876 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:40.526+0000 7fbde6a00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbde0109b90 0x7fbde01a1c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:21:40.876 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:40.526+0000 7fbde6a00640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fbde0113850 con 0x7fbde0109b90 2024-08-31T04:21:40.876 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:40.526+0000 7fbde6a00640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7fbde01136d0 con 0x7fbde0103900 2024-08-31T04:21:40.876 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:40.526+0000 7fbde6a00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fbde01139d0 con 0x7fbde0109240 2024-08-31T04:21:40.876 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:40.527+0000 7fbddfe00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbde0103900 0x7fbde019c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:21:40.876 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:40.527+0000 7fbddf400640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbde0109240 0x7fbde019c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:21:40.876 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:40.527+0000 7fbddfe00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbde0103900 0x7fbde019c400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.50:51836/0 (socket says 172.21.15.50:51836) 2024-08-31T04:21:40.876 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:40.527+0000 7fbddfe00640 1 -- 172.21.15.50:0/2218427451 learned_addr learned my addr 172.21.15.50:0/2218427451 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:21:40.876 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:40.527+0000 7fbde4a00640 1 --2- 172.21.15.50:0/2218427451 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbde0109b90 0x7fbde01a1c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:21:40.877 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:40.527+0000 7fbddfe00640 1 -- 172.21.15.50:0/2218427451 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbde0109240 msgr2=0x7fbde019c9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:21:40.877 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:40.527+0000 7fbddfe00640 1 --2- 172.21.15.50:0/2218427451 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbde0109240 0x7fbde019c9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:40.877 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:40.527+0000 7fbddfe00640 1 -- 172.21.15.50:0/2218427451 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbde0109b90 msgr2=0x7fbde01a1c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:21:40.877 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:40.527+0000 7fbddfe00640 1 --2- 172.21.15.50:0/2218427451 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbde0109b90 0x7fbde01a1c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:40.877 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:40.527+0000 7fbddfe00640 1 -- 172.21.15.50:0/2218427451 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbde01a2370 con 0x7fbde0103900 2024-08-31T04:21:40.877 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:40.527+0000 7fbddfe00640 1 --2- 172.21.15.50:0/2218427451 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbde0103900 0x7fbde019c400 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fbdd0035040 tx=0x7fbdd0032d50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:21:40.877 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:40.528+0000 7fbddcc00640 1 -- 172.21.15.50:0/2218427451 <== mon.2 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdd0037040 con 0x7fbde0103900 2024-08-31T04:21:40.877 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:40.528+0000 7fbddcc00640 1 -- 172.21.15.50:0/2218427451 <== mon.2 v2:172.21.15.133:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbdd0041070 con 0x7fbde0103900 2024-08-31T04:21:40.877 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:40.528+0000 7fbde6a00640 1 -- 172.21.15.50:0/2218427451 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbde01a2600 con 0x7fbde0103900 2024-08-31T04:21:40.877 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:40.528+0000 7fbddcc00640 1 -- 172.21.15.50:0/2218427451 <== mon.2 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdd0003850 con 0x7fbde0103900 2024-08-31T04:21:40.877 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:40.528+0000 7fbde6a00640 1 -- 172.21.15.50:0/2218427451 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbde01a2a80 con 0x7fbde0103900 2024-08-31T04:21:40.877 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:40.529+0000 7fbde6a00640 1 -- 172.21.15.50:0/2218427451 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fbde0107ab0 con 0x7fbde0103900 2024-08-31T04:21:40.877 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:40.531+0000 7fbddcc00640 1 -- 172.21.15.50:0/2218427451 <== mon.2 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 17) ==== 152628+0+0 (secure 0 0 0) 0x7fbdd00039f0 con 0x7fbde0103900 2024-08-31T04:21:40.878 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:40.533+0000 7fbddcc00640 1 --2- 172.21.15.50:0/2218427451 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fbdc40b4bc0 0x7fbdc40b70d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:21:40.878 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:40.533+0000 7fbddcc00640 1 -- 172.21.15.50:0/2218427451 <== mon.2 v2:172.21.15.133:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8219+0+0 (secure 0 0 0) 0x7fbdd0105a40 con 0x7fbde0103900 2024-08-31T04:21:40.878 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:40.533+0000 7fbddf400640 1 --2- 172.21.15.50:0/2218427451 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fbdc40b4bc0 0x7fbdc40b70d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:21:40.878 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:40.533+0000 7fbddcc00640 1 --2- 172.21.15.50:0/2218427451 >> [v2:172.21.15.50:6810/3792992620,v1:172.21.15.50:6811/3792992620] conn(0x7fbdc40be6b0 0x7fbdc40c0ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:21:40.878 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:40.533+0000 7fbddcc00640 1 -- 172.21.15.50:0/2218427451 --> [v2:172.21.15.50:6810/3792992620,v1:172.21.15.50:6811/3792992620] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fbdd00328f0 con 0x7fbdc40be6b0 2024-08-31T04:21:40.878 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:40.533+0000 7fbddcc00640 1 -- 172.21.15.50:0/2218427451 <== mon.2 v2:172.21.15.133:3300/0 6 ==== mon_get_version_reply(handle=1 version=78) ==== 24+0+0 (secure 0 0 0) 0x7fbdd0105df0 con 0x7fbde0103900 2024-08-31T04:21:40.878 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:40.533+0000 7fbde4a00640 1 --2- 172.21.15.50:0/2218427451 >> [v2:172.21.15.50:6810/3792992620,v1:172.21.15.50:6811/3792992620] conn(0x7fbdc40be6b0 0x7fbdc40c0ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:21:40.878 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:40.534+0000 7fbddf400640 1 --2- 172.21.15.50:0/2218427451 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fbdc40b4bc0 0x7fbdc40b70d0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fbde0108fa0 tx=0x7fbdcc005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:21:40.878 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:40.534+0000 7fbde4a00640 1 --2- 172.21.15.50:0/2218427451 >> [v2:172.21.15.50:6810/3792992620,v1:172.21.15.50:6811/3792992620] conn(0x7fbdc40be6b0 0x7fbdc40c0ba0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:21:40.878 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:40.535+0000 7fbddcc00640 1 -- 172.21.15.50:0/2218427451 <== osd.3 v2:172.21.15.50:6810/3792992620 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fbdd00328f0 con 0x7fbdc40be6b0 2024-08-31T04:21:40.878 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:40.550+0000 7fbde6a00640 1 -- 172.21.15.50:0/2218427451 --> [v2:172.21.15.50:6810/3792992620,v1:172.21.15.50:6811/3792992620] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fbde0104b80 con 0x7fbdc40be6b0 2024-08-31T04:21:40.878 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:40.550+0000 7fbddcc00640 1 -- 172.21.15.50:0/2218427451 <== osd.3 v2:172.21.15.50:6810/3792992620 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fbde0104b80 con 0x7fbdc40be6b0 2024-08-31T04:21:40.879 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:40.551+0000 7fbde6a00640 1 -- 172.21.15.50:0/2218427451 >> [v2:172.21.15.50:6810/3792992620,v1:172.21.15.50:6811/3792992620] conn(0x7fbdc40be6b0 msgr2=0x7fbdc40c0ba0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:21:40.879 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:40.551+0000 7fbde6a00640 1 --2- 172.21.15.50:0/2218427451 >> [v2:172.21.15.50:6810/3792992620,v1:172.21.15.50:6811/3792992620] conn(0x7fbdc40be6b0 0x7fbdc40c0ba0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:40.879 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:40.551+0000 7fbde6a00640 1 -- 172.21.15.50:0/2218427451 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fbdc40b4bc0 msgr2=0x7fbdc40b70d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:21:40.879 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:40.551+0000 7fbde6a00640 1 --2- 172.21.15.50:0/2218427451 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fbdc40b4bc0 0x7fbdc40b70d0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fbde0108fa0 tx=0x7fbdcc005f90 comp rx=0 tx=0).stop 2024-08-31T04:21:40.879 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:40.551+0000 7fbde6a00640 1 -- 172.21.15.50:0/2218427451 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbde0103900 msgr2=0x7fbde019c400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:21:40.879 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:40.551+0000 7fbde6a00640 1 --2- 172.21.15.50:0/2218427451 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbde0103900 0x7fbde019c400 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fbdd0035040 tx=0x7fbdd0032d50 comp rx=0 tx=0).stop 2024-08-31T04:21:40.879 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:40.551+0000 7fbde4a00640 1 -- 172.21.15.50:0/2218427451 reap_dead start 2024-08-31T04:21:40.879 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:40.551+0000 7fbde6a00640 1 -- 172.21.15.50:0/2218427451 shutdown_connections 2024-08-31T04:21:40.879 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:40.551+0000 7fbde6a00640 1 -- 172.21.15.50:0/2218427451 >> 172.21.15.50:0/2218427451 conn(0x7fbde007b5f0 msgr2=0x7fbde0107050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:21:40.879 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:40.551+0000 7fbde6a00640 1 -- 172.21.15.50:0/2218427451 shutdown_connections 2024-08-31T04:21:40.880 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:40.551+0000 7fbde6a00640 1 -- 172.21.15.50:0/2218427451 wait complete. 2024-08-31T04:21:41.277 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:21:40 smithi050 ceph-mon[17259]: pgmap v330: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2024-08-31T04:21:41.277 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:21:40 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:21:41.278 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:21:40 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:21:41.278 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:21:40 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:21:41.278 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:21:40 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:21:41.292 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:21:40 smithi133 ceph-mon[22177]: pgmap v330: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2024-08-31T04:21:41.293 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:21:40 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:21:41.293 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:21:40 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:21:41.293 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:21:40 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:21:41.293 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:21:40 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:21:41.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:21:40 smithi177 ceph-mon[22025]: pgmap v330: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2024-08-31T04:21:41.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:21:40 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:21:41.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:21:40 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:21:41.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:21:40 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:21:41.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:21:40 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:21:41.713 INFO:teuthology.orchestra.run.smithi050.stdout:107374182467 2024-08-31T04:21:41.713 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 058d9fc6-674f-11ef-bcd4-c7b262605968 -- ceph osd last-stat-seq osd.3 2024-08-31T04:21:42.175 INFO:teuthology.orchestra.run.smithi050.stdout:34359738450 2024-08-31T04:21:42.175 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 058d9fc6-674f-11ef-bcd4-c7b262605968 -- ceph osd last-stat-seq osd.0 2024-08-31T04:21:42.515 INFO:teuthology.orchestra.run.smithi050.stdout:249108103204 2024-08-31T04:21:42.515 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 058d9fc6-674f-11ef-bcd4-c7b262605968 -- ceph osd last-stat-seq osd.9 2024-08-31T04:21:42.809 INFO:teuthology.orchestra.run.smithi050.stdout:292057776153 2024-08-31T04:21:42.809 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 058d9fc6-674f-11ef-bcd4-c7b262605968 -- ceph osd last-stat-seq osd.11 2024-08-31T04:21:43.042 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:21:42 smithi050 ceph-mon[17259]: pgmap v331: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-08-31T04:21:43.288 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:21:43.293 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:21:42 smithi133 ceph-mon[22177]: pgmap v331: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-08-31T04:21:43.298 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:21:42 smithi177 ceph-mon[22025]: pgmap v331: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-08-31T04:21:43.474 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:43.472+0000 7fb5dbe00640 1 -- 172.21.15.50:0/2828002747 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb5dc1099e0 msgr2=0x7fb5dc110210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:21:43.474 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:43.472+0000 7fb5dbe00640 1 --2- 172.21.15.50:0/2828002747 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb5dc1099e0 0x7fb5dc110210 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fb5d4009ca0 tx=0x7fb5d402a8c0 comp rx=0 tx=0).stop 2024-08-31T04:21:43.475 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:43.472+0000 7fb5dbe00640 1 -- 172.21.15.50:0/2828002747 shutdown_connections 2024-08-31T04:21:43.475 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:43.472+0000 7fb5dbe00640 1 --2- 172.21.15.50:0/2828002747 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb5dc109090 0x7fb5dc1094a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:43.475 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:43.472+0000 7fb5dbe00640 1 --2- 172.21.15.50:0/2828002747 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb5dc1099e0 0x7fb5dc110210 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:43.475 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:43.472+0000 7fb5dbe00640 1 --2- 172.21.15.50:0/2828002747 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb5dc103750 0x7fb5dc103b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:43.475 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:43.472+0000 7fb5dbe00640 1 -- 172.21.15.50:0/2828002747 >> 172.21.15.50:0/2828002747 conn(0x7fb5dc0ff1e0 msgr2=0x7fb5dc101630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:21:43.475 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:43.473+0000 7fb5dbe00640 1 -- 172.21.15.50:0/2828002747 shutdown_connections 2024-08-31T04:21:43.475 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:43.473+0000 7fb5dbe00640 1 -- 172.21.15.50:0/2828002747 wait complete. 2024-08-31T04:21:43.476 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:43.474+0000 7fb5dbe00640 1 Processor -- start 2024-08-31T04:21:43.476 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:43.474+0000 7fb5dbe00640 1 -- start start 2024-08-31T04:21:43.476 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:43.475+0000 7fb5dbe00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb5dc103750 0x7fb5dc19a060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:21:43.476 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:43.475+0000 7fb5dbe00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb5dc109090 0x7fb5dc19a600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:21:43.476 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:43.475+0000 7fb5dbe00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb5dc1099e0 0x7fb5dc19f8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:21:43.476 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:43.475+0000 7fb5dbe00640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fb5dc1136b0 con 0x7fb5dc103750 2024-08-31T04:21:43.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:43.475+0000 7fb5dbe00640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7fb5dc113530 con 0x7fb5dc1099e0 2024-08-31T04:21:43.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:43.475+0000 7fb5dbe00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fb5dc113830 con 0x7fb5dc109090 2024-08-31T04:21:43.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:43.475+0000 7fb5daa00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb5dc103750 0x7fb5dc19a060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:21:43.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:43.475+0000 7fb5daa00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb5dc103750 0x7fb5dc19a060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:55722/0 (socket says 172.21.15.50:55722) 2024-08-31T04:21:43.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:43.475+0000 7fb5daa00640 1 -- 172.21.15.50:0/1129870140 learned_addr learned my addr 172.21.15.50:0/1129870140 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:21:43.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:43.475+0000 7fb5da000640 1 --2- 172.21.15.50:0/1129870140 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb5dc109090 0x7fb5dc19a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:21:43.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:43.475+0000 7fb5db400640 1 --2- 172.21.15.50:0/1129870140 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb5dc1099e0 0x7fb5dc19f8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:21:43.478 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:43.475+0000 7fb5daa00640 1 -- 172.21.15.50:0/1129870140 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb5dc109090 msgr2=0x7fb5dc19a600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:21:43.478 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:43.475+0000 7fb5daa00640 1 --2- 172.21.15.50:0/1129870140 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb5dc109090 0x7fb5dc19a600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:43.478 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:43.475+0000 7fb5daa00640 1 -- 172.21.15.50:0/1129870140 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb5dc1099e0 msgr2=0x7fb5dc19f8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:21:43.478 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:43.475+0000 7fb5daa00640 1 --2- 172.21.15.50:0/1129870140 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb5dc1099e0 0x7fb5dc19f8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:43.478 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:43.475+0000 7fb5daa00640 1 -- 172.21.15.50:0/1129870140 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5dc19ffd0 con 0x7fb5dc103750 2024-08-31T04:21:43.478 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:43.475+0000 7fb5da000640 1 --2- 172.21.15.50:0/1129870140 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb5dc109090 0x7fb5dc19a600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:21:43.478 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:43.476+0000 7fb5daa00640 1 --2- 172.21.15.50:0/1129870140 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb5dc103750 0x7fb5dc19a060 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fb5cc00ea60 tx=0x7fb5cc00ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:21:43.478 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:43.476+0000 7fb5d3400640 1 -- 172.21.15.50:0/1129870140 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5cc00cde0 con 0x7fb5dc103750 2024-08-31T04:21:43.479 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:43.476+0000 7fb5dbe00640 1 -- 172.21.15.50:0/1129870140 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb5dc1a02c0 con 0x7fb5dc103750 2024-08-31T04:21:43.479 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:43.476+0000 7fb5d3400640 1 -- 172.21.15.50:0/1129870140 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb5cc0035f0 con 0x7fb5dc103750 2024-08-31T04:21:43.479 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:43.476+0000 7fb5d3400640 1 -- 172.21.15.50:0/1129870140 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5cc010690 con 0x7fb5dc103750 2024-08-31T04:21:43.479 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:43.476+0000 7fb5dbe00640 1 -- 172.21.15.50:0/1129870140 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb5dc1a6a20 con 0x7fb5dc103750 2024-08-31T04:21:43.479 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:43.477+0000 7fb5dbe00640 1 -- 172.21.15.50:0/1129870140 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fb5dc0638f0 con 0x7fb5dc103750 2024-08-31T04:21:43.481 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:43.480+0000 7fb5d3400640 1 -- 172.21.15.50:0/1129870140 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 17) ==== 152628+0+0 (secure 0 0 0) 0x7fb5cc0037a0 con 0x7fb5dc103750 2024-08-31T04:21:43.482 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:43.481+0000 7fb5d3400640 1 --2- 172.21.15.50:0/1129870140 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fb5c00b4bc0 0x7fb5c00b70d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:21:43.482 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:43.481+0000 7fb5d3400640 1 -- 172.21.15.50:0/1129870140 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8219+0+0 (secure 0 0 0) 0x7fb5cc0e5a80 con 0x7fb5dc103750 2024-08-31T04:21:43.483 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:43.482+0000 7fb5da000640 1 --2- 172.21.15.50:0/1129870140 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fb5c00b4bc0 0x7fb5c00b70d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:21:43.483 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:43.482+0000 7fb5d3400640 1 --2- 172.21.15.50:0/1129870140 >> [v2:172.21.15.177:6808/1166415084,v1:172.21.15.177:6809/1166415084] conn(0x7fb5c00be6b0 0x7fb5c00c0ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:21:43.483 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:43.482+0000 7fb5d3400640 1 -- 172.21.15.50:0/1129870140 --> [v2:172.21.15.177:6808/1166415084,v1:172.21.15.177:6809/1166415084] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb5cc022e50 con 0x7fb5c00be6b0 2024-08-31T04:21:43.483 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:43.482+0000 7fb5d3400640 1 -- 172.21.15.50:0/1129870140 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_get_version_reply(handle=1 version=78) ==== 24+0+0 (secure 0 0 0) 0x7fb5cc0e5e30 con 0x7fb5dc103750 2024-08-31T04:21:43.484 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:43.482+0000 7fb5db400640 1 --2- 172.21.15.50:0/1129870140 >> [v2:172.21.15.177:6808/1166415084,v1:172.21.15.177:6809/1166415084] conn(0x7fb5c00be6b0 0x7fb5c00c0ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:21:43.484 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:43.482+0000 7fb5da000640 1 --2- 172.21.15.50:0/1129870140 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fb5c00b4bc0 0x7fb5c00b70d0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fb5dc102a30 tx=0x7fb5c8005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:21:43.484 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:43.483+0000 7fb5db400640 1 --2- 172.21.15.50:0/1129870140 >> [v2:172.21.15.177:6808/1166415084,v1:172.21.15.177:6809/1166415084] conn(0x7fb5c00be6b0 0x7fb5c00c0ba0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:21:43.485 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:43.484+0000 7fb5d3400640 1 -- 172.21.15.50:0/1129870140 <== osd.5 v2:172.21.15.177:6808/1166415084 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fb5cc022e50 con 0x7fb5c00be6b0 2024-08-31T04:21:43.501 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:43.499+0000 7fb5dbe00640 1 -- 172.21.15.50:0/1129870140 --> [v2:172.21.15.177:6808/1166415084,v1:172.21.15.177:6809/1166415084] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fb5dc063cf0 con 0x7fb5c00be6b0 2024-08-31T04:21:43.501 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:43.499+0000 7fb5d3400640 1 -- 172.21.15.50:0/1129870140 <== osd.5 v2:172.21.15.177:6808/1166415084 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fb5dc063cf0 con 0x7fb5c00be6b0 2024-08-31T04:21:43.502 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:43.500+0000 7fb5dbe00640 1 -- 172.21.15.50:0/1129870140 >> [v2:172.21.15.177:6808/1166415084,v1:172.21.15.177:6809/1166415084] conn(0x7fb5c00be6b0 msgr2=0x7fb5c00c0ba0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:21:43.502 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:43.500+0000 7fb5dbe00640 1 --2- 172.21.15.50:0/1129870140 >> [v2:172.21.15.177:6808/1166415084,v1:172.21.15.177:6809/1166415084] conn(0x7fb5c00be6b0 0x7fb5c00c0ba0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:43.502 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:43.500+0000 7fb5dbe00640 1 -- 172.21.15.50:0/1129870140 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fb5c00b4bc0 msgr2=0x7fb5c00b70d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:21:43.502 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:43.500+0000 7fb5dbe00640 1 --2- 172.21.15.50:0/1129870140 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fb5c00b4bc0 0x7fb5c00b70d0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fb5dc102a30 tx=0x7fb5c8005f90 comp rx=0 tx=0).stop 2024-08-31T04:21:43.502 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:43.500+0000 7fb5dbe00640 1 -- 172.21.15.50:0/1129870140 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb5dc103750 msgr2=0x7fb5dc19a060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:21:43.502 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:43.500+0000 7fb5dbe00640 1 --2- 172.21.15.50:0/1129870140 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb5dc103750 0x7fb5dc19a060 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fb5cc00ea60 tx=0x7fb5cc00ef20 comp rx=0 tx=0).stop 2024-08-31T04:21:43.502 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:43.500+0000 7fb5db400640 1 -- 172.21.15.50:0/1129870140 reap_dead start 2024-08-31T04:21:43.502 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:43.500+0000 7fb5dbe00640 1 -- 172.21.15.50:0/1129870140 shutdown_connections 2024-08-31T04:21:43.502 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:43.500+0000 7fb5dbe00640 1 -- 172.21.15.50:0/1129870140 >> 172.21.15.50:0/1129870140 conn(0x7fb5dc0ff1e0 msgr2=0x7fb5dc1086f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:21:43.502 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:43.501+0000 7fb5dbe00640 1 -- 172.21.15.50:0/1129870140 shutdown_connections 2024-08-31T04:21:43.502 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:43.501+0000 7fb5dbe00640 1 -- 172.21.15.50:0/1129870140 wait complete. 2024-08-31T04:21:43.874 INFO:teuthology.orchestra.run.smithi050.stdout:133143986238 2024-08-31T04:21:43.874 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 058d9fc6-674f-11ef-bcd4-c7b262605968 -- ceph osd last-stat-seq osd.4 2024-08-31T04:21:44.861 INFO:teuthology.orchestra.run.smithi050.stdout:223338299432 2024-08-31T04:21:44.862 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 058d9fc6-674f-11ef-bcd4-c7b262605968 -- ceph osd last-stat-seq osd.8 2024-08-31T04:21:45.200 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:21:45 smithi050 ceph-mon[17259]: pgmap v332: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-08-31T04:21:45.212 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:21:45.270 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:45.268+0000 7f65f6e00640 1 -- 172.21.15.50:0/1883048905 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f65f010fee0 msgr2=0x7f65f0112300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:21:45.270 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:45.268+0000 7f65f6e00640 1 --2- 172.21.15.50:0/1883048905 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f65f010fee0 0x7f65f0112300 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f65e8009ca0 tx=0x7f65e802a8c0 comp rx=0 tx=0).stop 2024-08-31T04:21:45.270 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:45.268+0000 7f65f6e00640 1 -- 172.21.15.50:0/1883048905 shutdown_connections 2024-08-31T04:21:45.270 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:45.268+0000 7f65f6e00640 1 --2- 172.21.15.50:0/1883048905 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f65f0075e40 0x7f65f010f9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:45.271 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:45.268+0000 7f65f6e00640 1 --2- 172.21.15.50:0/1883048905 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f65f010fee0 0x7f65f0112300 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:45.271 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:45.268+0000 7f65f6e00640 1 --2- 172.21.15.50:0/1883048905 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f65f00754f0 0x7f65f0075900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:45.271 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:45.268+0000 7f65f6e00640 1 -- 172.21.15.50:0/1883048905 >> 172.21.15.50:0/1883048905 conn(0x7f65f00ff370 msgr2=0x7f65f01017c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:21:45.271 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:45.268+0000 7f65f6e00640 1 -- 172.21.15.50:0/1883048905 shutdown_connections 2024-08-31T04:21:45.271 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:45.268+0000 7f65f6e00640 1 -- 172.21.15.50:0/1883048905 wait complete. 2024-08-31T04:21:45.274 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:45.269+0000 7f65f6e00640 1 Processor -- start 2024-08-31T04:21:45.275 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:45.269+0000 7f65f6e00640 1 -- start start 2024-08-31T04:21:45.275 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:45.270+0000 7f65f6e00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f65f00754f0 0x7f65f019c3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:21:45.275 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:45.270+0000 7f65f6e00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f65f0075e40 0x7f65f019c990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:21:45.275 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:45.270+0000 7f65f6e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f65f010fee0 0x7f65f01a1c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:21:45.275 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:45.270+0000 7f65f6e00640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f65f0115aa0 con 0x7f65f010fee0 2024-08-31T04:21:45.276 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:45.270+0000 7f65f6e00640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f65f0115920 con 0x7f65f0075e40 2024-08-31T04:21:45.276 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:45.270+0000 7f65f6e00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f65f0115c20 con 0x7f65f00754f0 2024-08-31T04:21:45.276 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:45.270+0000 7f65f4e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f65f010fee0 0x7f65f01a1c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:21:45.276 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:45.270+0000 7f65ef400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f65f0075e40 0x7f65f019c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:21:45.276 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:45.270+0000 7f65f4e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f65f010fee0 0x7f65f01a1c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:55744/0 (socket says 172.21.15.50:55744) 2024-08-31T04:21:45.276 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:45.270+0000 7f65efe00640 1 --2- 172.21.15.50:0/81384446 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f65f00754f0 0x7f65f019c3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:21:45.277 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:45.270+0000 7f65f4e00640 1 -- 172.21.15.50:0/81384446 learned_addr learned my addr 172.21.15.50:0/81384446 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:21:45.277 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:45.270+0000 7f65ef400640 1 -- 172.21.15.50:0/81384446 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f65f00754f0 msgr2=0x7f65f019c3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:21:45.277 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:45.270+0000 7f65ef400640 1 --2- 172.21.15.50:0/81384446 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f65f00754f0 0x7f65f019c3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:45.277 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:45.270+0000 7f65ef400640 1 -- 172.21.15.50:0/81384446 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f65f010fee0 msgr2=0x7f65f01a1c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:21:45.277 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:45.270+0000 7f65ef400640 1 --2- 172.21.15.50:0/81384446 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f65f010fee0 0x7f65f01a1c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:45.278 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:45.270+0000 7f65ef400640 1 -- 172.21.15.50:0/81384446 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65f01a2360 con 0x7f65f0075e40 2024-08-31T04:21:45.278 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:45.271+0000 7f65ef400640 1 --2- 172.21.15.50:0/81384446 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f65f0075e40 0x7f65f019c990 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f65f0077570 tx=0x7f65dc00ee50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:21:45.278 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:45.271+0000 7f65ecc00640 1 -- 172.21.15.50:0/81384446 <== mon.2 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65dc00cc40 con 0x7f65f0075e40 2024-08-31T04:21:45.278 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:45.271+0000 7f65f6e00640 1 -- 172.21.15.50:0/81384446 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f65f01a2650 con 0x7f65f0075e40 2024-08-31T04:21:45.278 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:45.271+0000 7f65ecc00640 1 -- 172.21.15.50:0/81384446 <== mon.2 v2:172.21.15.133:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f65dc00cde0 con 0x7f65f0075e40 2024-08-31T04:21:45.278 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:45.271+0000 7f65ecc00640 1 -- 172.21.15.50:0/81384446 <== mon.2 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65dc004a00 con 0x7f65f0075e40 2024-08-31T04:21:45.279 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:45.271+0000 7f65f6e00640 1 -- 172.21.15.50:0/81384446 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f65f01a8db0 con 0x7f65f0075e40 2024-08-31T04:21:45.279 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:45.272+0000 7f65f6e00640 1 -- 172.21.15.50:0/81384446 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f65f0075900 con 0x7f65f0075e40 2024-08-31T04:21:45.280 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:45.275+0000 7f65ecc00640 1 -- 172.21.15.50:0/81384446 <== mon.2 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 17) ==== 152628+0+0 (secure 0 0 0) 0x7f65dc004ba0 con 0x7f65f0075e40 2024-08-31T04:21:45.280 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:45.276+0000 7f65ecc00640 1 --2- 172.21.15.50:0/81384446 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f65d40b4bc0 0x7f65d40b70d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:21:45.280 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:45.276+0000 7f65ecc00640 1 -- 172.21.15.50:0/81384446 <== mon.2 v2:172.21.15.133:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8219+0+0 (secure 0 0 0) 0x7f65dc0e51e0 con 0x7f65f0075e40 2024-08-31T04:21:45.280 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:45.276+0000 7f65efe00640 1 --2- 172.21.15.50:0/81384446 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f65d40b4bc0 0x7f65d40b70d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:21:45.281 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:45.277+0000 7f65efe00640 1 --2- 172.21.15.50:0/81384446 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f65d40b4bc0 0x7f65d40b70d0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f65e0009bd0 tx=0x7f65e0005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:21:45.281 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:45.278+0000 7f65ecc00640 1 -- 172.21.15.50:0/81384446 <== mon.2 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f65dc0ac160 con 0x7f65f0075e40 2024-08-31T04:21:45.293 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:21:45 smithi133 ceph-mon[22177]: pgmap v332: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-08-31T04:21:45.487 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:45.485+0000 7f65f6e00640 1 -- 172.21.15.50:0/81384446 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f65f019d520 con 0x7f65f0075e40 2024-08-31T04:21:45.487 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:45.486+0000 7f65ecc00640 1 -- 172.21.15.50:0/81384446 <== mon.2 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f65dc0aba60 con 0x7f65f0075e40 2024-08-31T04:21:45.487 INFO:teuthology.orchestra.run.smithi050.stdout:77309411403 2024-08-31T04:21:45.490 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:45.489+0000 7f65f6e00640 1 -- 172.21.15.50:0/81384446 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f65d40b4bc0 msgr2=0x7f65d40b70d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:21:45.491 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:45.489+0000 7f65f6e00640 1 --2- 172.21.15.50:0/81384446 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f65d40b4bc0 0x7f65d40b70d0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f65e0009bd0 tx=0x7f65e0005f90 comp rx=0 tx=0).stop 2024-08-31T04:21:45.491 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:45.489+0000 7f65f6e00640 1 -- 172.21.15.50:0/81384446 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f65f0075e40 msgr2=0x7f65f019c990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:21:45.491 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:45.489+0000 7f65f6e00640 1 --2- 172.21.15.50:0/81384446 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f65f0075e40 0x7f65f019c990 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f65f0077570 tx=0x7f65dc00ee50 comp rx=0 tx=0).stop 2024-08-31T04:21:45.491 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:45.489+0000 7f65f6e00640 1 -- 172.21.15.50:0/81384446 shutdown_connections 2024-08-31T04:21:45.491 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:45.489+0000 7f65f6e00640 1 --2- 172.21.15.50:0/81384446 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f65d40b4bc0 0x7f65d40b70d0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:45.492 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:45.489+0000 7f65f6e00640 1 --2- 172.21.15.50:0/81384446 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f65f010fee0 0x7f65f01a1c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:45.492 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:45.489+0000 7f65f6e00640 1 --2- 172.21.15.50:0/81384446 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f65f0075e40 0x7f65f019c990 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:45.492 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:45.489+0000 7f65f6e00640 1 --2- 172.21.15.50:0/81384446 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f65f00754f0 0x7f65f019c3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:45.492 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:45.489+0000 7f65f6e00640 1 -- 172.21.15.50:0/81384446 >> 172.21.15.50:0/81384446 conn(0x7f65f00ff370 msgr2=0x7f65f0100f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:21:45.493 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:45.489+0000 7f65f6e00640 1 -- 172.21.15.50:0/81384446 shutdown_connections 2024-08-31T04:21:45.493 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:45.489+0000 7f65f6e00640 1 -- 172.21.15.50:0/81384446 wait complete. 2024-08-31T04:21:45.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:21:45 smithi177 ceph-mon[22025]: pgmap v332: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-08-31T04:21:45.719 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:21:45.745 INFO:teuthology.orchestra.run.smithi050.stdout:154618822715 2024-08-31T04:21:45.745 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 058d9fc6-674f-11ef-bcd4-c7b262605968 -- ceph osd last-stat-seq osd.5 2024-08-31T04:21:46.253 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:21:46 smithi050 ceph-mon[17259]: from='client.? 172.21.15.50:0/81384446' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 2} : dispatch 2024-08-31T04:21:46.293 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:21:46 smithi133 ceph-mon[22177]: from='client.? 172.21.15.50:0/81384446' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 2} : dispatch 2024-08-31T04:21:46.443 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:46.441+0000 7f1d02200640 1 -- 172.21.15.50:0/3288019890 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1cfc10bdc0 msgr2=0x7f1cfc1125f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:21:46.443 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:46.441+0000 7f1d02200640 1 --2- 172.21.15.50:0/3288019890 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1cfc10bdc0 0x7f1cfc1125f0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f1cf4009ca0 tx=0x7f1cf402a8c0 comp rx=0 tx=0).stop 2024-08-31T04:21:46.443 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:46.441+0000 7f1d02200640 1 -- 172.21.15.50:0/3288019890 shutdown_connections 2024-08-31T04:21:46.443 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:46.441+0000 7f1d02200640 1 --2- 172.21.15.50:0/3288019890 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1cfc10bdc0 0x7f1cfc1125f0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:46.443 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:46.441+0000 7f1d02200640 1 --2- 172.21.15.50:0/3288019890 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1cfc10b470 0x7f1cfc10b880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:46.444 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:46.441+0000 7f1d02200640 1 --2- 172.21.15.50:0/3288019890 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1cfc105b30 0x7f1cfc105f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:46.444 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:46.441+0000 7f1d02200640 1 -- 172.21.15.50:0/3288019890 >> 172.21.15.50:0/3288019890 conn(0x7f1cfc101600 msgr2=0x7f1cfc103a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:21:46.444 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:46.441+0000 7f1d02200640 1 -- 172.21.15.50:0/3288019890 shutdown_connections 2024-08-31T04:21:46.444 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:46.441+0000 7f1d02200640 1 -- 172.21.15.50:0/3288019890 wait complete. 2024-08-31T04:21:46.448 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:46.442+0000 7f1d02200640 1 Processor -- start 2024-08-31T04:21:46.448 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:46.443+0000 7f1d02200640 1 -- start start 2024-08-31T04:21:46.448 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:46.443+0000 7f1d02200640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1cfc105b30 0x7f1cfc19c3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:21:46.448 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:46.443+0000 7f1d02200640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1cfc10b470 0x7f1cfc19c980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:21:46.448 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:46.443+0000 7f1d02200640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1cfc10bdc0 0x7f1cfc1a1c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:21:46.448 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:46.443+0000 7f1d02200640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f1cfc115ad0 con 0x7f1cfc105b30 2024-08-31T04:21:46.448 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:46.443+0000 7f1d02200640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f1cfc115950 con 0x7f1cfc10bdc0 2024-08-31T04:21:46.448 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:46.443+0000 7f1d02200640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f1cfc115c50 con 0x7f1cfc10b470 2024-08-31T04:21:46.449 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:46.443+0000 7f1cfb400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1cfc105b30 0x7f1cfc19c3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:21:46.449 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:46.443+0000 7f1cfb400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1cfc105b30 0x7f1cfc19c3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:55768/0 (socket says 172.21.15.50:55768) 2024-08-31T04:21:46.449 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:46.443+0000 7f1cfb400640 1 -- 172.21.15.50:0/70969781 learned_addr learned my addr 172.21.15.50:0/70969781 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:21:46.449 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:46.443+0000 7f1cf3e00640 1 --2- 172.21.15.50:0/70969781 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1cfc10b470 0x7f1cfc19c980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:21:46.449 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:46.444+0000 7f1cfbe00640 1 --2- 172.21.15.50:0/70969781 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1cfc10bdc0 0x7f1cfc1a1c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:21:46.450 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:46.444+0000 7f1cfb400640 1 -- 172.21.15.50:0/70969781 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1cfc10b470 msgr2=0x7f1cfc19c980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:21:46.450 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:46.444+0000 7f1cfb400640 1 --2- 172.21.15.50:0/70969781 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1cfc10b470 0x7f1cfc19c980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:46.450 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:46.444+0000 7f1cfb400640 1 -- 172.21.15.50:0/70969781 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1cfc10bdc0 msgr2=0x7f1cfc1a1c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:21:46.450 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:46.444+0000 7f1cfb400640 1 --2- 172.21.15.50:0/70969781 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1cfc10bdc0 0x7f1cfc1a1c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:46.450 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:46.444+0000 7f1cfb400640 1 -- 172.21.15.50:0/70969781 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1cfc1a2350 con 0x7f1cfc105b30 2024-08-31T04:21:46.450 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:46.444+0000 7f1cf3e00640 1 --2- 172.21.15.50:0/70969781 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1cfc10b470 0x7f1cfc19c980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:21:46.450 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:46.444+0000 7f1cfb400640 1 --2- 172.21.15.50:0/70969781 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1cfc105b30 0x7f1cfc19c3e0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f1cec00d950 tx=0x7f1cec00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:21:46.450 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:46.445+0000 7f1cf8c00640 1 -- 172.21.15.50:0/70969781 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cec017070 con 0x7f1cfc105b30 2024-08-31T04:21:46.451 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:46.445+0000 7f1cf8c00640 1 -- 172.21.15.50:0/70969781 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1cec009c30 con 0x7f1cfc105b30 2024-08-31T04:21:46.451 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:46.445+0000 7f1cf8c00640 1 -- 172.21.15.50:0/70969781 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cec00f620 con 0x7f1cfc105b30 2024-08-31T04:21:46.451 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:46.445+0000 7f1d02200640 1 -- 172.21.15.50:0/70969781 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1cfc1a2640 con 0x7f1cfc105b30 2024-08-31T04:21:46.451 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:46.445+0000 7f1d02200640 1 -- 172.21.15.50:0/70969781 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1cfc1a8da0 con 0x7f1cfc105b30 2024-08-31T04:21:46.451 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:46.446+0000 7f1d02200640 1 -- 172.21.15.50:0/70969781 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1cfc105f40 con 0x7f1cfc105b30 2024-08-31T04:21:46.451 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:46.449+0000 7f1cf8c00640 1 -- 172.21.15.50:0/70969781 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 17) ==== 152628+0+0 (secure 0 0 0) 0x7f1cec005030 con 0x7f1cfc105b30 2024-08-31T04:21:46.452 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:46.451+0000 7f1cf8c00640 1 --2- 172.21.15.50:0/70969781 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f1ce00b4c40 0x7f1ce00b7150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:21:46.453 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:46.452+0000 7f1cf8c00640 1 -- 172.21.15.50:0/70969781 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8219+0+0 (secure 0 0 0) 0x7f1cec0e4de0 con 0x7f1cfc105b30 2024-08-31T04:21:46.453 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:46.452+0000 7f1cf3e00640 1 --2- 172.21.15.50:0/70969781 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f1ce00b4c40 0x7f1ce00b7150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:21:46.453 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:46.452+0000 7f1cf3e00640 1 --2- 172.21.15.50:0/70969781 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f1ce00b4c40 0x7f1ce00b7150 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f1cfc104e50 tx=0x7f1ce4005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:21:46.454 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:46.453+0000 7f1cf8c00640 1 -- 172.21.15.50:0/70969781 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f1cec009de0 con 0x7f1cfc105b30 2024-08-31T04:21:46.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:21:46 smithi177 ceph-mon[22025]: from='client.? 172.21.15.50:0/81384446' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 2} : dispatch 2024-08-31T04:21:46.660 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:46.658+0000 7f1d02200640 1 -- 172.21.15.50:0/70969781 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f1cfc19d510 con 0x7f1cfc105b30 2024-08-31T04:21:46.660 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:46.659+0000 7f1cf8c00640 1 -- 172.21.15.50:0/70969781 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f1cec0ab790 con 0x7f1cfc105b30 2024-08-31T04:21:46.661 INFO:teuthology.orchestra.run.smithi050.stdout:180388626485 2024-08-31T04:21:46.663 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:46.661+0000 7f1d02200640 1 -- 172.21.15.50:0/70969781 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f1ce00b4c40 msgr2=0x7f1ce00b7150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:21:46.663 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:46.661+0000 7f1d02200640 1 --2- 172.21.15.50:0/70969781 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f1ce00b4c40 0x7f1ce00b7150 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f1cfc104e50 tx=0x7f1ce4005f90 comp rx=0 tx=0).stop 2024-08-31T04:21:46.663 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:46.661+0000 7f1d02200640 1 -- 172.21.15.50:0/70969781 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1cfc105b30 msgr2=0x7f1cfc19c3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:21:46.664 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:46.661+0000 7f1d02200640 1 --2- 172.21.15.50:0/70969781 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1cfc105b30 0x7f1cfc19c3e0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f1cec00d950 tx=0x7f1cec00de10 comp rx=0 tx=0).stop 2024-08-31T04:21:46.664 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:46.661+0000 7f1d02200640 1 -- 172.21.15.50:0/70969781 shutdown_connections 2024-08-31T04:21:46.664 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:46.661+0000 7f1d02200640 1 --2- 172.21.15.50:0/70969781 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f1ce00b4c40 0x7f1ce00b7150 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:46.664 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:46.661+0000 7f1d02200640 1 --2- 172.21.15.50:0/70969781 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1cfc10b470 0x7f1cfc19c980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:46.664 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:46.661+0000 7f1d02200640 1 --2- 172.21.15.50:0/70969781 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1cfc10bdc0 0x7f1cfc1a1c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:46.665 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:46.661+0000 7f1d02200640 1 --2- 172.21.15.50:0/70969781 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1cfc105b30 0x7f1cfc19c3e0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:46.665 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:46.661+0000 7f1d02200640 1 -- 172.21.15.50:0/70969781 >> 172.21.15.50:0/70969781 conn(0x7f1cfc101600 msgr2=0x7f1cfc1089c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:21:46.665 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:46.662+0000 7f1d02200640 1 -- 172.21.15.50:0/70969781 shutdown_connections 2024-08-31T04:21:46.665 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:46.662+0000 7f1d02200640 1 -- 172.21.15.50:0/70969781 wait complete. 2024-08-31T04:21:47.007 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:21:47.014 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:21:47.075 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:21:47 smithi050 ceph-mon[17259]: pgmap v333: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2024-08-31T04:21:47.075 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:21:47 smithi050 ceph-mon[17259]: from='client.? 172.21.15.50:0/70969781' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 6} : dispatch 2024-08-31T04:21:47.293 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:21:47 smithi133 ceph-mon[22177]: pgmap v333: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2024-08-31T04:21:47.293 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:21:47 smithi133 ceph-mon[22177]: from='client.? 172.21.15.50:0/70969781' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 6} : dispatch 2024-08-31T04:21:47.353 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:21:47.366 INFO:tasks.cephadm.ceph_manager.ceph:need seq 77309411401 got 77309411403 for osd.2 2024-08-31T04:21:47.366 DEBUG:teuthology.parallel:result is None 2024-08-31T04:21:47.377 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:21:47.378 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:21:47.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:21:47 smithi177 ceph-mon[22025]: pgmap v333: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2024-08-31T04:21:47.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:21:47 smithi177 ceph-mon[22025]: from='client.? 172.21.15.50:0/70969781' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 6} : dispatch 2024-08-31T04:21:47.606 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:21:47.646 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:47.645+0000 7f00ed200640 1 -- 172.21.15.50:0/4159841677 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f00e8109260 msgr2=0x7f00e8109670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:21:47.647 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:47.645+0000 7f00ed200640 1 --2- 172.21.15.50:0/4159841677 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f00e8109260 0x7f00e8109670 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f00d4009900 tx=0x7f00d402a3f0 comp rx=0 tx=0).stop 2024-08-31T04:21:47.647 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:47.645+0000 7f00ed200640 1 -- 172.21.15.50:0/4159841677 shutdown_connections 2024-08-31T04:21:47.647 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:47.645+0000 7f00ed200640 1 --2- 172.21.15.50:0/4159841677 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f00e8109bb0 0x7f00e81103e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:47.647 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:47.645+0000 7f00ed200640 1 --2- 172.21.15.50:0/4159841677 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f00e8109260 0x7f00e8109670 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:47.647 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:47.645+0000 7f00ed200640 1 --2- 172.21.15.50:0/4159841677 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f00e8103920 0x7f00e8103d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:47.647 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:47.645+0000 7f00ed200640 1 -- 172.21.15.50:0/4159841677 >> 172.21.15.50:0/4159841677 conn(0x7f00e80ff3b0 msgr2=0x7f00e8101800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:21:47.647 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:47.645+0000 7f00ed200640 1 -- 172.21.15.50:0/4159841677 shutdown_connections 2024-08-31T04:21:47.647 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:47.645+0000 7f00ed200640 1 -- 172.21.15.50:0/4159841677 wait complete. 2024-08-31T04:21:47.648 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:47.647+0000 7f00ed200640 1 Processor -- start 2024-08-31T04:21:47.648 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:47.647+0000 7f00ed200640 1 -- start start 2024-08-31T04:21:47.649 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:47.647+0000 7f00ed200640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f00e8103920 0x7f00e819a2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:21:47.649 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:47.647+0000 7f00ed200640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f00e8109260 0x7f00e819a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:21:47.649 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:47.647+0000 7f00ed200640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f00e8109bb0 0x7f00e819fb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:21:47.649 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:47.647+0000 7f00ed200640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f00e81138c0 con 0x7f00e8103920 2024-08-31T04:21:47.649 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:47.647+0000 7f00ed200640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f00e8113740 con 0x7f00e8109260 2024-08-31T04:21:47.649 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:47.647+0000 7f00ed200640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f00e8113a40 con 0x7f00e8109bb0 2024-08-31T04:21:47.649 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:47.648+0000 7f00e5e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f00e8103920 0x7f00e819a2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:21:47.650 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:47.648+0000 7f00e5e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f00e8103920 0x7f00e819a2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:55786/0 (socket says 172.21.15.50:55786) 2024-08-31T04:21:47.650 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:47.648+0000 7f00e5e00640 1 -- 172.21.15.50:0/2868579864 learned_addr learned my addr 172.21.15.50:0/2868579864 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:21:47.650 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:47.648+0000 7f00e5400640 1 --2- 172.21.15.50:0/2868579864 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f00e8109260 0x7f00e819a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:21:47.650 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:47.648+0000 7f00e6800640 1 --2- 172.21.15.50:0/2868579864 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f00e8109bb0 0x7f00e819fb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:21:47.650 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:47.648+0000 7f00e5e00640 1 -- 172.21.15.50:0/2868579864 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f00e8109bb0 msgr2=0x7f00e819fb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:21:47.651 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:47.648+0000 7f00e5e00640 1 --2- 172.21.15.50:0/2868579864 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f00e8109bb0 0x7f00e819fb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:47.651 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:47.648+0000 7f00e5e00640 1 -- 172.21.15.50:0/2868579864 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f00e8109260 msgr2=0x7f00e819a870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:21:47.651 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:47.648+0000 7f00e5e00640 1 --2- 172.21.15.50:0/2868579864 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f00e8109260 0x7f00e819a870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:47.651 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:47.648+0000 7f00e5e00640 1 -- 172.21.15.50:0/2868579864 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00e81a0240 con 0x7f00e8103920 2024-08-31T04:21:47.651 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:47.649+0000 7f00e5e00640 1 --2- 172.21.15.50:0/2868579864 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f00e8103920 0x7f00e819a2d0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f00d800e9f0 tx=0x7f00d800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:21:47.651 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:47.649+0000 7f00dea00640 1 -- 172.21.15.50:0/2868579864 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00d800cd80 con 0x7f00e8103920 2024-08-31T04:21:47.651 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:47.649+0000 7f00dea00640 1 -- 172.21.15.50:0/2868579864 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f00d80054d0 con 0x7f00e8103920 2024-08-31T04:21:47.651 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:47.649+0000 7f00dea00640 1 -- 172.21.15.50:0/2868579864 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00d8010690 con 0x7f00e8103920 2024-08-31T04:21:47.651 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:47.649+0000 7f00ed200640 1 -- 172.21.15.50:0/2868579864 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f00e81a0530 con 0x7f00e8103920 2024-08-31T04:21:47.651 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:47.649+0000 7f00ed200640 1 -- 172.21.15.50:0/2868579864 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f00e81a6c90 con 0x7f00e8103920 2024-08-31T04:21:47.652 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:47.650+0000 7f00ed200640 1 -- 172.21.15.50:0/2868579864 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f00e8104ba0 con 0x7f00e8103920 2024-08-31T04:21:47.653 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:47.653+0000 7f00dea00640 1 -- 172.21.15.50:0/2868579864 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 17) ==== 152628+0+0 (secure 0 0 0) 0x7f00d8004e30 con 0x7f00e8103920 2024-08-31T04:21:47.655 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:47.654+0000 7f00dea00640 1 --2- 172.21.15.50:0/2868579864 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f00cc0b4bc0 0x7f00cc0b70d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:21:47.655 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:47.654+0000 7f00dea00640 1 -- 172.21.15.50:0/2868579864 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8219+0+0 (secure 0 0 0) 0x7f00d80e5950 con 0x7f00e8103920 2024-08-31T04:21:47.655 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:47.654+0000 7f00e5400640 1 --2- 172.21.15.50:0/2868579864 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f00cc0b4bc0 0x7f00cc0b70d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:21:47.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:47.655+0000 7f00e5400640 1 --2- 172.21.15.50:0/2868579864 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f00cc0b4bc0 0x7f00cc0b70d0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f00d402a9e0 tx=0x7f00d4005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:21:47.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:47.656+0000 7f00dea00640 1 -- 172.21.15.50:0/2868579864 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f00d80ac8d0 con 0x7f00e8103920 2024-08-31T04:21:47.858 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:47.857+0000 7f00ed200640 1 -- 172.21.15.50:0/2868579864 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f00e8103d30 con 0x7f00e8103920 2024-08-31T04:21:47.858 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:47.857+0000 7f00dea00640 1 -- 172.21.15.50:0/2868579864 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f00d80ac1d0 con 0x7f00e8103920 2024-08-31T04:21:47.859 INFO:teuthology.orchestra.run.smithi050.stdout:55834574928 2024-08-31T04:21:47.861 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:47.859+0000 7f00ed200640 1 -- 172.21.15.50:0/2868579864 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f00cc0b4bc0 msgr2=0x7f00cc0b70d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:21:47.861 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:47.859+0000 7f00ed200640 1 --2- 172.21.15.50:0/2868579864 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f00cc0b4bc0 0x7f00cc0b70d0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f00d402a9e0 tx=0x7f00d4005a20 comp rx=0 tx=0).stop 2024-08-31T04:21:47.861 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:47.859+0000 7f00ed200640 1 -- 172.21.15.50:0/2868579864 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f00e8103920 msgr2=0x7f00e819a2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:21:47.861 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:47.859+0000 7f00ed200640 1 --2- 172.21.15.50:0/2868579864 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f00e8103920 0x7f00e819a2d0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f00d800e9f0 tx=0x7f00d800edf0 comp rx=0 tx=0).stop 2024-08-31T04:21:47.861 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:47.859+0000 7f00ed200640 1 -- 172.21.15.50:0/2868579864 shutdown_connections 2024-08-31T04:21:47.861 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:47.859+0000 7f00ed200640 1 --2- 172.21.15.50:0/2868579864 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f00cc0b4bc0 0x7f00cc0b70d0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:47.861 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:47.859+0000 7f00ed200640 1 --2- 172.21.15.50:0/2868579864 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f00e8109bb0 0x7f00e819fb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:47.861 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:47.860+0000 7f00ed200640 1 --2- 172.21.15.50:0/2868579864 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f00e8109260 0x7f00e819a870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:47.861 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:47.860+0000 7f00ed200640 1 --2- 172.21.15.50:0/2868579864 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f00e8103920 0x7f00e819a2d0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:47.861 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:47.860+0000 7f00ed200640 1 -- 172.21.15.50:0/2868579864 >> 172.21.15.50:0/2868579864 conn(0x7f00e80ff3b0 msgr2=0x7f00e8106870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:21:47.862 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:47.860+0000 7f00ed200640 1 -- 172.21.15.50:0/2868579864 shutdown_connections 2024-08-31T04:21:47.862 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:47.860+0000 7f00ed200640 1 -- 172.21.15.50:0/2868579864 wait complete. 2024-08-31T04:21:48.200 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:21:48 smithi050 ceph-mon[17259]: from='client.? 172.21.15.50:0/2868579864' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 1} : dispatch 2024-08-31T04:21:48.293 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:21:48 smithi133 ceph-mon[22177]: from='client.? 172.21.15.50:0/2868579864' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 1} : dispatch 2024-08-31T04:21:48.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:21:48 smithi177 ceph-mon[22025]: from='client.? 172.21.15.50:0/2868579864' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 1} : dispatch 2024-08-31T04:21:48.940 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:48.914+0000 7fef76000640 1 -- 172.21.15.50:0/3608882841 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fef70104770 msgr2=0x7fef70104b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:21:48.940 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:48.914+0000 7fef76000640 1 --2- 172.21.15.50:0/3608882841 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fef70104770 0x7fef70104b80 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fef60009900 tx=0x7fef6002a3f0 comp rx=0 tx=0).stop 2024-08-31T04:21:48.940 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:48.915+0000 7fef76000640 1 -- 172.21.15.50:0/3608882841 shutdown_connections 2024-08-31T04:21:48.940 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:48.915+0000 7fef76000640 1 --2- 172.21.15.50:0/3608882841 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fef7010dbd0 0x7fef701100c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:48.940 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:48.915+0000 7fef76000640 1 --2- 172.21.15.50:0/3608882841 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fef701050c0 0x7fef7010d610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:48.940 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:48.915+0000 7fef76000640 1 --2- 172.21.15.50:0/3608882841 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fef70104770 0x7fef70104b80 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:48.940 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:48.915+0000 7fef76000640 1 -- 172.21.15.50:0/3608882841 >> 172.21.15.50:0/3608882841 conn(0x7fef700794e0 msgr2=0x7fef700798f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:21:48.940 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:48.915+0000 7fef76000640 1 -- 172.21.15.50:0/3608882841 shutdown_connections 2024-08-31T04:21:48.940 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:48.915+0000 7fef76000640 1 -- 172.21.15.50:0/3608882841 wait complete. 2024-08-31T04:21:48.940 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:48.916+0000 7fef76000640 1 Processor -- start 2024-08-31T04:21:48.941 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:48.916+0000 7fef76000640 1 -- start start 2024-08-31T04:21:48.941 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:48.917+0000 7fef76000640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fef70104770 0x7fef7019a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:21:48.941 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:48.917+0000 7fef76000640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fef701050c0 0x7fef7019a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:21:48.941 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:48.917+0000 7fef76000640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fef7010dbd0 0x7fef7019fae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:21:48.941 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:48.917+0000 7fef76000640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fef70113850 con 0x7fef701050c0 2024-08-31T04:21:48.941 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:48.917+0000 7fef76000640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7fef701136d0 con 0x7fef70104770 2024-08-31T04:21:48.941 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:48.917+0000 7fef76000640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fef701139d0 con 0x7fef7010dbd0 2024-08-31T04:21:48.941 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:48.917+0000 7fef6ea00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fef701050c0 0x7fef7019a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:21:48.941 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:48.917+0000 7fef6ea00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fef701050c0 0x7fef7019a840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:55796/0 (socket says 172.21.15.50:55796) 2024-08-31T04:21:48.941 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:48.917+0000 7fef6ea00640 1 -- 172.21.15.50:0/605329791 learned_addr learned my addr 172.21.15.50:0/605329791 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:21:48.941 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:48.917+0000 7fef6f400640 1 --2- 172.21.15.50:0/605329791 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fef70104770 0x7fef7019a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:21:48.941 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:48.917+0000 7fef6fe00640 1 --2- 172.21.15.50:0/605329791 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fef7010dbd0 0x7fef7019fae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:21:48.942 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:48.918+0000 7fef6ea00640 1 -- 172.21.15.50:0/605329791 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fef7010dbd0 msgr2=0x7fef7019fae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:21:48.942 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:48.918+0000 7fef6ea00640 1 --2- 172.21.15.50:0/605329791 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fef7010dbd0 0x7fef7019fae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:48.942 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:48.918+0000 7fef6ea00640 1 -- 172.21.15.50:0/605329791 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fef70104770 msgr2=0x7fef7019a2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:21:48.942 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:48.918+0000 7fef6ea00640 1 --2- 172.21.15.50:0/605329791 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fef70104770 0x7fef7019a2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:48.942 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:48.918+0000 7fef6ea00640 1 -- 172.21.15.50:0/605329791 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef701a0210 con 0x7fef701050c0 2024-08-31T04:21:48.942 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:48.918+0000 7fef6ea00640 1 --2- 172.21.15.50:0/605329791 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fef701050c0 0x7fef7019a840 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fef5c00e9f0 tx=0x7fef5c00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:21:48.942 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:48.918+0000 7fef67e00640 1 -- 172.21.15.50:0/605329791 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef5c00ccc0 con 0x7fef701050c0 2024-08-31T04:21:48.942 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:48.918+0000 7fef76000640 1 -- 172.21.15.50:0/605329791 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fef701a0500 con 0x7fef701050c0 2024-08-31T04:21:48.942 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:48.918+0000 7fef67e00640 1 -- 172.21.15.50:0/605329791 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fef5c0108e0 con 0x7fef701050c0 2024-08-31T04:21:48.942 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:48.918+0000 7fef67e00640 1 -- 172.21.15.50:0/605329791 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef5c018860 con 0x7fef701050c0 2024-08-31T04:21:48.942 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:48.918+0000 7fef76000640 1 -- 172.21.15.50:0/605329791 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fef701a6c60 con 0x7fef701050c0 2024-08-31T04:21:48.942 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:48.919+0000 7fef76000640 1 -- 172.21.15.50:0/605329791 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fef7006bfe0 con 0x7fef701050c0 2024-08-31T04:21:48.942 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:48.922+0000 7fef67e00640 1 -- 172.21.15.50:0/605329791 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 17) ==== 152628+0+0 (secure 0 0 0) 0x7fef5c010430 con 0x7fef701050c0 2024-08-31T04:21:48.943 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:48.923+0000 7fef67e00640 1 --2- 172.21.15.50:0/605329791 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fef540b4bc0 0x7fef540b70d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:21:48.943 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:48.923+0000 7fef67e00640 1 -- 172.21.15.50:0/605329791 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8219+0+0 (secure 0 0 0) 0x7fef5c0e5a70 con 0x7fef701050c0 2024-08-31T04:21:48.943 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:48.924+0000 7fef6f400640 1 --2- 172.21.15.50:0/605329791 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fef540b4bc0 0x7fef540b70d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:21:48.943 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:48.924+0000 7fef6f400640 1 --2- 172.21.15.50:0/605329791 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fef540b4bc0 0x7fef540b70d0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fef60000c00 tx=0x7fef60031400 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:21:48.943 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:48.925+0000 7fef67e00640 1 -- 172.21.15.50:0/605329791 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fef5c0ac3a0 con 0x7fef701050c0 2024-08-31T04:21:49.050 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:49.025+0000 7fe783e00640 1 -- 172.21.15.50:0/3819299466 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe784077120 msgr2=0x7fe784075550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:21:49.050 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:49.025+0000 7fe783e00640 1 --2- 172.21.15.50:0/3819299466 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe784077120 0x7fe784075550 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fe774009900 tx=0x7fe77402a3f0 comp rx=0 tx=0).stop 2024-08-31T04:21:49.050 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:49.026+0000 7fe783e00640 1 -- 172.21.15.50:0/3819299466 shutdown_connections 2024-08-31T04:21:49.050 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:49.026+0000 7fe783e00640 1 --2- 172.21.15.50:0/3819299466 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe784114020 0x7fe7841164f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:49.051 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:49.026+0000 7fe783e00640 1 --2- 172.21.15.50:0/3819299466 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe784075b70 0x7fe784075f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:49.051 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:49.026+0000 7fe783e00640 1 --2- 172.21.15.50:0/3819299466 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe784077120 0x7fe784075550 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:49.051 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:49.026+0000 7fe783e00640 1 -- 172.21.15.50:0/3819299466 >> 172.21.15.50:0/3819299466 conn(0x7fe7840ff1e0 msgr2=0x7fe784101630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:21:49.051 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:49.026+0000 7fe783e00640 1 -- 172.21.15.50:0/3819299466 shutdown_connections 2024-08-31T04:21:49.051 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:49.026+0000 7fe783e00640 1 -- 172.21.15.50:0/3819299466 wait complete. 2024-08-31T04:21:49.051 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:49.027+0000 7fe783e00640 1 Processor -- start 2024-08-31T04:21:49.051 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:49.027+0000 7fe783e00640 1 -- start start 2024-08-31T04:21:49.051 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:49.027+0000 7fe783e00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe784075b70 0x7fe7841a0690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:21:49.051 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:49.027+0000 7fe783e00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe784077120 0x7fe7841a0c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:21:49.051 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:49.027+0000 7fe783e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe784114020 0x7fe7841a5ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:21:49.051 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:49.027+0000 7fe783e00640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fe784119c60 con 0x7fe784114020 2024-08-31T04:21:49.051 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:49.027+0000 7fe783e00640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7fe784119ae0 con 0x7fe784077120 2024-08-31T04:21:49.051 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:49.027+0000 7fe783e00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fe784119de0 con 0x7fe784075b70 2024-08-31T04:21:49.052 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:49.028+0000 7fe782a00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe784075b70 0x7fe7841a0690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:21:49.052 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:49.028+0000 7fe782000640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe784077120 0x7fe7841a0c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:21:49.052 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:49.028+0000 7fe782a00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe784075b70 0x7fe7841a0690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.50:51326/0 (socket says 172.21.15.50:51326) 2024-08-31T04:21:49.052 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:49.028+0000 7fe782a00640 1 -- 172.21.15.50:0/2790509810 learned_addr learned my addr 172.21.15.50:0/2790509810 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:21:49.052 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:49.028+0000 7fe783400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe784114020 0x7fe7841a5ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:21:49.052 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:49.028+0000 7fe782000640 1 -- 172.21.15.50:0/2790509810 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe784075b70 msgr2=0x7fe7841a0690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:21:49.052 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:49.028+0000 7fe782000640 1 --2- 172.21.15.50:0/2790509810 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe784075b70 0x7fe7841a0690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:49.052 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:49.028+0000 7fe782000640 1 -- 172.21.15.50:0/2790509810 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe784114020 msgr2=0x7fe7841a5ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:21:49.052 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:49.028+0000 7fe782000640 1 --2- 172.21.15.50:0/2790509810 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe784114020 0x7fe7841a5ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:49.052 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:49.028+0000 7fe782000640 1 -- 172.21.15.50:0/2790509810 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7841a6600 con 0x7fe784077120 2024-08-31T04:21:49.052 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:49.028+0000 7fe782a00640 1 --2- 172.21.15.50:0/2790509810 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe784075b70 0x7fe7841a0690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:21:49.052 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:49.028+0000 7fe782000640 1 --2- 172.21.15.50:0/2790509810 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe784077120 0x7fe7841a0c30 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fe77000e9c0 tx=0x7fe77000edc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:21:49.052 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:49.029+0000 7fe77b400640 1 -- 172.21.15.50:0/2790509810 <== mon.2 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe77000ccc0 con 0x7fe784077120 2024-08-31T04:21:49.053 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:49.029+0000 7fe77b400640 1 -- 172.21.15.50:0/2790509810 <== mon.2 v2:172.21.15.133:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe770005020 con 0x7fe784077120 2024-08-31T04:21:49.053 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:49.029+0000 7fe783e00640 1 -- 172.21.15.50:0/2790509810 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe7841a68f0 con 0x7fe784077120 2024-08-31T04:21:49.053 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:49.029+0000 7fe77b400640 1 -- 172.21.15.50:0/2790509810 <== mon.2 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe77000ce60 con 0x7fe784077120 2024-08-31T04:21:49.053 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:49.029+0000 7fe783e00640 1 -- 172.21.15.50:0/2790509810 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe7841ad050 con 0x7fe784077120 2024-08-31T04:21:49.053 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:49.030+0000 7fe783e00640 1 -- 172.21.15.50:0/2790509810 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe784075f80 con 0x7fe784077120 2024-08-31T04:21:49.053 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:49.032+0000 7fe77b400640 1 -- 172.21.15.50:0/2790509810 <== mon.2 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 17) ==== 152628+0+0 (secure 0 0 0) 0x7fe7700051d0 con 0x7fe784077120 2024-08-31T04:21:49.053 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:49.034+0000 7fe77b400640 1 --2- 172.21.15.50:0/2790509810 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fe7680b4c40 0x7fe7680b7150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:21:49.053 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:49.034+0000 7fe77b400640 1 -- 172.21.15.50:0/2790509810 <== mon.2 v2:172.21.15.133:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8219+0+0 (secure 0 0 0) 0x7fe7700e51e0 con 0x7fe784077120 2024-08-31T04:21:49.053 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:49.034+0000 7fe782a00640 1 --2- 172.21.15.50:0/2790509810 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fe7680b4c40 0x7fe7680b7150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:21:49.053 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:49.034+0000 7fe782a00640 1 --2- 172.21.15.50:0/2790509810 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fe7680b4c40 0x7fe7680b7150 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fe774031440 tx=0x7fe7740058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:21:49.053 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:49.038+0000 7fe77b400640 1 -- 172.21.15.50:0/2790509810 <== mon.2 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fe7700ac160 con 0x7fe784077120 2024-08-31T04:21:49.130 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:49.129+0000 7fef76000640 1 -- 172.21.15.50:0/605329791 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7fef7019b3d0 con 0x7fef701050c0 2024-08-31T04:21:49.130 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:49.129+0000 7fef67e00640 1 -- 172.21.15.50:0/605329791 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fef5c0b0b60 con 0x7fef701050c0 2024-08-31T04:21:49.131 INFO:teuthology.orchestra.run.smithi050.stdout:107374182468 2024-08-31T04:21:49.133 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:49.132+0000 7fef76000640 1 -- 172.21.15.50:0/605329791 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fef540b4bc0 msgr2=0x7fef540b70d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:21:49.133 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:49.132+0000 7fef76000640 1 --2- 172.21.15.50:0/605329791 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fef540b4bc0 0x7fef540b70d0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fef60000c00 tx=0x7fef60031400 comp rx=0 tx=0).stop 2024-08-31T04:21:49.134 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:49.132+0000 7fef76000640 1 -- 172.21.15.50:0/605329791 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fef701050c0 msgr2=0x7fef7019a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:21:49.134 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:49.132+0000 7fef76000640 1 --2- 172.21.15.50:0/605329791 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fef701050c0 0x7fef7019a840 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fef5c00e9f0 tx=0x7fef5c00eeb0 comp rx=0 tx=0).stop 2024-08-31T04:21:49.134 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:49.132+0000 7fef76000640 1 -- 172.21.15.50:0/605329791 shutdown_connections 2024-08-31T04:21:49.134 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:49.132+0000 7fef76000640 1 --2- 172.21.15.50:0/605329791 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fef540b4bc0 0x7fef540b70d0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:49.134 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:49.132+0000 7fef76000640 1 --2- 172.21.15.50:0/605329791 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fef7010dbd0 0x7fef7019fae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:49.134 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:49.132+0000 7fef76000640 1 --2- 172.21.15.50:0/605329791 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fef701050c0 0x7fef7019a840 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:49.134 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:49.132+0000 7fef76000640 1 --2- 172.21.15.50:0/605329791 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fef70104770 0x7fef7019a2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:49.134 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:49.132+0000 7fef76000640 1 -- 172.21.15.50:0/605329791 >> 172.21.15.50:0/605329791 conn(0x7fef700794e0 msgr2=0x7fef700ff310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:21:49.134 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:49.132+0000 7fef76000640 1 -- 172.21.15.50:0/605329791 shutdown_connections 2024-08-31T04:21:49.134 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:49.132+0000 7fef76000640 1 -- 172.21.15.50:0/605329791 wait complete. 2024-08-31T04:21:49.248 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:49.247+0000 7fe783e00640 1 -- 172.21.15.50:0/2790509810 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7fe7841127c0 con 0x7fe784077120 2024-08-31T04:21:49.249 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:49.248+0000 7fe77b400640 1 -- 172.21.15.50:0/2790509810 <== mon.2 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fe7700aba60 con 0x7fe784077120 2024-08-31T04:21:49.249 INFO:teuthology.orchestra.run.smithi050.stdout:201863462961 2024-08-31T04:21:49.251 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:49.250+0000 7fe783e00640 1 -- 172.21.15.50:0/2790509810 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fe7680b4c40 msgr2=0x7fe7680b7150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:21:49.252 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:49.250+0000 7fe783e00640 1 --2- 172.21.15.50:0/2790509810 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fe7680b4c40 0x7fe7680b7150 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fe774031440 tx=0x7fe7740058d0 comp rx=0 tx=0).stop 2024-08-31T04:21:49.252 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:49.250+0000 7fe783e00640 1 -- 172.21.15.50:0/2790509810 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe784077120 msgr2=0x7fe7841a0c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:21:49.252 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:49.250+0000 7fe783e00640 1 --2- 172.21.15.50:0/2790509810 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe784077120 0x7fe7841a0c30 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fe77000e9c0 tx=0x7fe77000edc0 comp rx=0 tx=0).stop 2024-08-31T04:21:49.252 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:49.250+0000 7fe783e00640 1 -- 172.21.15.50:0/2790509810 shutdown_connections 2024-08-31T04:21:49.252 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:49.250+0000 7fe783e00640 1 --2- 172.21.15.50:0/2790509810 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fe7680b4c40 0x7fe7680b7150 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:49.252 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:49.250+0000 7fe783e00640 1 --2- 172.21.15.50:0/2790509810 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe784114020 0x7fe7841a5ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:49.252 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:49.250+0000 7fe783e00640 1 --2- 172.21.15.50:0/2790509810 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe784077120 0x7fe7841a0c30 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:49.252 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:49.250+0000 7fe783e00640 1 --2- 172.21.15.50:0/2790509810 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe784075b70 0x7fe7841a0690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:49.252 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:49.250+0000 7fe783e00640 1 -- 172.21.15.50:0/2790509810 >> 172.21.15.50:0/2790509810 conn(0x7fe7840ff1e0 msgr2=0x7fe78410ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:21:49.252 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:49.250+0000 7fe783e00640 1 -- 172.21.15.50:0/2790509810 shutdown_connections 2024-08-31T04:21:49.252 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:49.250+0000 7fe783e00640 1 -- 172.21.15.50:0/2790509810 wait complete. 2024-08-31T04:21:49.273 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:21:49 smithi050 ceph-mon[17259]: pgmap v334: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2024-08-31T04:21:49.293 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:21:49 smithi133 ceph-mon[22177]: pgmap v334: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2024-08-31T04:21:49.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:21:49 smithi177 ceph-mon[22025]: pgmap v334: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2024-08-31T04:21:49.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:49.598+0000 7fd459c00640 1 -- 172.21.15.50:0/790435941 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd454103900 msgr2=0x7fd454103d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:21:49.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:49.598+0000 7fd459c00640 1 --2- 172.21.15.50:0/790435941 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd454103900 0x7fd454103d10 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fd444009900 tx=0x7fd44402a410 comp rx=0 tx=0).stop 2024-08-31T04:21:49.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:49.598+0000 7fd459c00640 1 -- 172.21.15.50:0/790435941 shutdown_connections 2024-08-31T04:21:49.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:49.598+0000 7fd459c00640 1 --2- 172.21.15.50:0/790435941 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd454109240 0x7fd454109650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:49.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:49.598+0000 7fd459c00640 1 --2- 172.21.15.50:0/790435941 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd454109b90 0x7fd4541103c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:49.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:49.598+0000 7fd459c00640 1 --2- 172.21.15.50:0/790435941 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd454103900 0x7fd454103d10 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:49.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:49.598+0000 7fd459c00640 1 -- 172.21.15.50:0/790435941 >> 172.21.15.50:0/790435941 conn(0x7fd45407b5f0 msgr2=0x7fd45407ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:21:49.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:49.598+0000 7fd459c00640 1 -- 172.21.15.50:0/790435941 shutdown_connections 2024-08-31T04:21:49.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:49.598+0000 7fd459c00640 1 -- 172.21.15.50:0/790435941 wait complete. 2024-08-31T04:21:49.601 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:49.599+0000 7fd459c00640 1 Processor -- start 2024-08-31T04:21:49.601 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:49.600+0000 7fd459c00640 1 -- start start 2024-08-31T04:21:49.601 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:49.600+0000 7fd459c00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd454103900 0x7fd45419c450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:21:49.601 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:49.600+0000 7fd459c00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd454109240 0x7fd45419c9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:21:49.601 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:49.600+0000 7fd459c00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd454109b90 0x7fd4541a1c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:21:49.601 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:49.600+0000 7fd459c00640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fd4541138a0 con 0x7fd454109b90 2024-08-31T04:21:49.601 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:49.600+0000 7fd459c00640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7fd454113720 con 0x7fd454109240 2024-08-31T04:21:49.602 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:49.600+0000 7fd459c00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fd454113a20 con 0x7fd454103900 2024-08-31T04:21:49.602 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:49.600+0000 7fd452a00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd454103900 0x7fd45419c450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:21:49.602 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:49.600+0000 7fd453400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd454109b90 0x7fd4541a1c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:21:49.602 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:49.600+0000 7fd452a00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd454103900 0x7fd45419c450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.50:51344/0 (socket says 172.21.15.50:51344) 2024-08-31T04:21:49.602 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:49.600+0000 7fd452a00640 1 -- 172.21.15.50:0/2781774662 learned_addr learned my addr 172.21.15.50:0/2781774662 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:21:49.603 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:49.600+0000 7fd452000640 1 --2- 172.21.15.50:0/2781774662 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd454109240 0x7fd45419c9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:21:49.603 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:49.601+0000 7fd453400640 1 -- 172.21.15.50:0/2781774662 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd454103900 msgr2=0x7fd45419c450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:21:49.603 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:49.601+0000 7fd453400640 1 --2- 172.21.15.50:0/2781774662 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd454103900 0x7fd45419c450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:49.603 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:49.601+0000 7fd453400640 1 -- 172.21.15.50:0/2781774662 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd454109240 msgr2=0x7fd45419c9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:21:49.603 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:49.601+0000 7fd453400640 1 --2- 172.21.15.50:0/2781774662 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd454109240 0x7fd45419c9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:49.603 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:49.601+0000 7fd453400640 1 -- 172.21.15.50:0/2781774662 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4541a23c0 con 0x7fd454109b90 2024-08-31T04:21:49.603 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:49.601+0000 7fd452a00640 1 --2- 172.21.15.50:0/2781774662 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd454103900 0x7fd45419c450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:21:49.603 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:49.601+0000 7fd452000640 1 --2- 172.21.15.50:0/2781774662 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd454109240 0x7fd45419c9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:21:49.603 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:49.601+0000 7fd453400640 1 --2- 172.21.15.50:0/2781774662 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd454109b90 0x7fd4541a1c90 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fd44c009fd0 tx=0x7fd44c00ef10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:21:49.604 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:49.602+0000 7fd44b400640 1 -- 172.21.15.50:0/2781774662 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd44c00ce20 con 0x7fd454109b90 2024-08-31T04:21:49.604 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:49.602+0000 7fd459c00640 1 -- 172.21.15.50:0/2781774662 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd4541a26b0 con 0x7fd454109b90 2024-08-31T04:21:49.604 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:49.602+0000 7fd44b400640 1 -- 172.21.15.50:0/2781774662 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd44c005020 con 0x7fd454109b90 2024-08-31T04:21:49.604 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:49.602+0000 7fd44b400640 1 -- 172.21.15.50:0/2781774662 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd44c010690 con 0x7fd454109b90 2024-08-31T04:21:49.604 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:49.602+0000 7fd459c00640 1 -- 172.21.15.50:0/2781774662 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd4541a8e10 con 0x7fd454109b90 2024-08-31T04:21:49.604 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:49.603+0000 7fd459c00640 1 -- 172.21.15.50:0/2781774662 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd454103d10 con 0x7fd454109b90 2024-08-31T04:21:49.606 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:49.606+0000 7fd44b400640 1 -- 172.21.15.50:0/2781774662 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 17) ==== 152628+0+0 (secure 0 0 0) 0x7fd44c0054d0 con 0x7fd454109b90 2024-08-31T04:21:49.608 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:49.607+0000 7fd44b400640 1 --2- 172.21.15.50:0/2781774662 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fd4380b4bc0 0x7fd4380b70d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:21:49.608 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:49.607+0000 7fd44b400640 1 -- 172.21.15.50:0/2781774662 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8219+0+0 (secure 0 0 0) 0x7fd44c0e59c0 con 0x7fd454109b90 2024-08-31T04:21:49.608 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:49.607+0000 7fd452a00640 1 --2- 172.21.15.50:0/2781774662 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fd4380b4bc0 0x7fd4380b70d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:21:49.609 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:49.608+0000 7fd452a00640 1 --2- 172.21.15.50:0/2781774662 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fd4380b4bc0 0x7fd4380b70d0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fd4440096c0 tx=0x7fd444005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:21:49.610 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:49.609+0000 7fd44b400640 1 -- 172.21.15.50:0/2781774662 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fd44c0ac940 con 0x7fd454109b90 2024-08-31T04:21:49.812 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:49.811+0000 7fd459c00640 1 -- 172.21.15.50:0/2781774662 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7fd45419d580 con 0x7fd454109b90 2024-08-31T04:21:49.812 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:49.811+0000 7fd44b400640 1 -- 172.21.15.50:0/2781774662 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fd45419d580 con 0x7fd454109b90 2024-08-31T04:21:49.813 INFO:teuthology.orchestra.run.smithi050.stdout:133143986240 2024-08-31T04:21:49.815 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:49.813+0000 7fd459c00640 1 -- 172.21.15.50:0/2781774662 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fd4380b4bc0 msgr2=0x7fd4380b70d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:21:49.815 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:49.813+0000 7fd459c00640 1 --2- 172.21.15.50:0/2781774662 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fd4380b4bc0 0x7fd4380b70d0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fd4440096c0 tx=0x7fd444005a20 comp rx=0 tx=0).stop 2024-08-31T04:21:49.815 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:49.813+0000 7fd459c00640 1 -- 172.21.15.50:0/2781774662 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd454109b90 msgr2=0x7fd4541a1c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:21:49.815 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:49.813+0000 7fd459c00640 1 --2- 172.21.15.50:0/2781774662 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd454109b90 0x7fd4541a1c90 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fd44c009fd0 tx=0x7fd44c00ef10 comp rx=0 tx=0).stop 2024-08-31T04:21:49.815 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:49.814+0000 7fd459c00640 1 -- 172.21.15.50:0/2781774662 shutdown_connections 2024-08-31T04:21:49.816 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:49.814+0000 7fd459c00640 1 --2- 172.21.15.50:0/2781774662 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fd4380b4bc0 0x7fd4380b70d0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:49.816 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:49.814+0000 7fd459c00640 1 --2- 172.21.15.50:0/2781774662 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd454109b90 0x7fd4541a1c90 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:49.816 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:49.814+0000 7fd459c00640 1 --2- 172.21.15.50:0/2781774662 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd454109240 0x7fd45419c9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:49.816 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:49.814+0000 7fd459c00640 1 --2- 172.21.15.50:0/2781774662 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd454103900 0x7fd45419c450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:49.816 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:49.814+0000 7fd459c00640 1 -- 172.21.15.50:0/2781774662 >> 172.21.15.50:0/2781774662 conn(0x7fd45407b5f0 msgr2=0x7fd454107050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:21:49.816 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:49.814+0000 7fd459c00640 1 -- 172.21.15.50:0/2781774662 shutdown_connections 2024-08-31T04:21:49.816 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:49.814+0000 7fd459c00640 1 -- 172.21.15.50:0/2781774662 wait complete. 2024-08-31T04:21:50.102 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:21:50 smithi050 ceph-mon[17259]: from='client.? 172.21.15.50:0/605329791' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 3} : dispatch 2024-08-31T04:21:50.103 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:21:50 smithi050 ceph-mon[17259]: from='client.? 172.21.15.50:0/2790509810' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 7} : dispatch 2024-08-31T04:21:50.103 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:21:50 smithi050 ceph-mon[17259]: from='client.? 172.21.15.50:0/2781774662' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 4} : dispatch 2024-08-31T04:21:50.293 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:21:50 smithi133 ceph-mon[22177]: from='client.? 172.21.15.50:0/605329791' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 3} : dispatch 2024-08-31T04:21:50.293 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:21:50 smithi133 ceph-mon[22177]: from='client.? 172.21.15.50:0/2790509810' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 7} : dispatch 2024-08-31T04:21:50.293 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:21:50 smithi133 ceph-mon[22177]: from='client.? 172.21.15.50:0/2781774662' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 4} : dispatch 2024-08-31T04:21:50.389 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:50.387+0000 7f6f29c00640 1 -- 172.21.15.50:0/2885329655 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6f241099e0 msgr2=0x7f6f24110210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:21:50.389 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:50.387+0000 7f6f29c00640 1 --2- 172.21.15.50:0/2885329655 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6f241099e0 0x7f6f24110210 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f6f1c009ca0 tx=0x7f6f1c02a8c0 comp rx=0 tx=0).stop 2024-08-31T04:21:50.389 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:50.387+0000 7f6f29c00640 1 -- 172.21.15.50:0/2885329655 shutdown_connections 2024-08-31T04:21:50.390 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:50.387+0000 7f6f29c00640 1 --2- 172.21.15.50:0/2885329655 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6f24109090 0x7f6f241094a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:50.390 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:50.387+0000 7f6f29c00640 1 --2- 172.21.15.50:0/2885329655 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6f241099e0 0x7f6f24110210 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:50.390 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:50.387+0000 7f6f29c00640 1 --2- 172.21.15.50:0/2885329655 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6f24103750 0x7f6f24103b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:50.390 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:50.387+0000 7f6f29c00640 1 -- 172.21.15.50:0/2885329655 >> 172.21.15.50:0/2885329655 conn(0x7f6f240ff1a0 msgr2=0x7f6f241015f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:21:50.390 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:50.388+0000 7f6f29c00640 1 -- 172.21.15.50:0/2885329655 shutdown_connections 2024-08-31T04:21:50.390 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:50.388+0000 7f6f29c00640 1 -- 172.21.15.50:0/2885329655 wait complete. 2024-08-31T04:21:50.391 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:50.389+0000 7f6f29c00640 1 Processor -- start 2024-08-31T04:21:50.391 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:50.389+0000 7f6f29c00640 1 -- start start 2024-08-31T04:21:50.391 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:50.389+0000 7f6f29c00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6f24103750 0x7f6f240754b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:21:50.391 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:50.389+0000 7f6f29c00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6f24109090 0x7f6f240759f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:21:50.391 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:50.389+0000 7f6f29c00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6f241099e0 0x7f6f24075f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:21:50.392 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:50.389+0000 7f6f29c00640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f6f241136b0 con 0x7f6f24103750 2024-08-31T04:21:50.392 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:50.389+0000 7f6f29c00640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f6f24113530 con 0x7f6f24109090 2024-08-31T04:21:50.392 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:50.389+0000 7f6f29c00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f6f24113830 con 0x7f6f241099e0 2024-08-31T04:21:50.392 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:50.390+0000 7f6f23e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6f24103750 0x7f6f240754b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:21:50.392 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:50.390+0000 7f6f23e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6f24103750 0x7f6f240754b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:55860/0 (socket says 172.21.15.50:55860) 2024-08-31T04:21:50.392 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:50.390+0000 7f6f23e00640 1 -- 172.21.15.50:0/2874069924 learned_addr learned my addr 172.21.15.50:0/2874069924 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:21:50.392 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:50.390+0000 7f6f23400640 1 --2- 172.21.15.50:0/2874069924 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6f24109090 0x7f6f240759f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:21:50.392 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:50.390+0000 7f6f29200640 1 --2- 172.21.15.50:0/2874069924 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6f241099e0 0x7f6f24075f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:21:50.392 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:50.390+0000 7f6f23e00640 1 -- 172.21.15.50:0/2874069924 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6f241099e0 msgr2=0x7f6f24075f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:21:50.392 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:50.390+0000 7f6f23e00640 1 --2- 172.21.15.50:0/2874069924 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6f241099e0 0x7f6f24075f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:50.392 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:50.390+0000 7f6f23e00640 1 -- 172.21.15.50:0/2874069924 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6f24109090 msgr2=0x7f6f240759f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:21:50.392 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:50.390+0000 7f6f23e00640 1 --2- 172.21.15.50:0/2874069924 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6f24109090 0x7f6f240759f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:50.392 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:50.390+0000 7f6f23e00640 1 -- 172.21.15.50:0/2874069924 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f241a8300 con 0x7f6f24103750 2024-08-31T04:21:50.393 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:50.390+0000 7f6f23e00640 1 --2- 172.21.15.50:0/2874069924 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6f24103750 0x7f6f240754b0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f6f1400e9f0 tx=0x7f6f1400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:21:50.393 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:50.391+0000 7f6f20c00640 1 -- 172.21.15.50:0/2874069924 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f1400cd80 con 0x7f6f24103750 2024-08-31T04:21:50.393 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:50.391+0000 7f6f20c00640 1 -- 172.21.15.50:0/2874069924 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6f140108e0 con 0x7f6f24103750 2024-08-31T04:21:50.394 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:50.391+0000 7f6f20c00640 1 -- 172.21.15.50:0/2874069924 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f14018980 con 0x7f6f24103750 2024-08-31T04:21:50.394 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:50.391+0000 7f6f29c00640 1 -- 172.21.15.50:0/2874069924 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6f241a85f0 con 0x7f6f24103750 2024-08-31T04:21:50.394 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:50.391+0000 7f6f29c00640 1 -- 172.21.15.50:0/2874069924 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6f241a8ae0 con 0x7f6f24103750 2024-08-31T04:21:50.394 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:50.392+0000 7f6f29c00640 1 -- 172.21.15.50:0/2874069924 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6f24103b60 con 0x7f6f24103750 2024-08-31T04:21:50.397 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:50.396+0000 7f6f20c00640 1 -- 172.21.15.50:0/2874069924 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 17) ==== 152628+0+0 (secure 0 0 0) 0x7f6f14010430 con 0x7f6f24103750 2024-08-31T04:21:50.399 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:50.397+0000 7f6f20c00640 1 --2- 172.21.15.50:0/2874069924 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f6f080b4c40 0x7f6f080b7150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:21:50.399 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:50.398+0000 7f6f20c00640 1 -- 172.21.15.50:0/2874069924 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8219+0+0 (secure 0 0 0) 0x7f6f140e5b10 con 0x7f6f24103750 2024-08-31T04:21:50.399 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:50.398+0000 7f6f23400640 1 --2- 172.21.15.50:0/2874069924 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f6f080b4c40 0x7f6f080b7150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:21:50.399 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:50.398+0000 7f6f23400640 1 --2- 172.21.15.50:0/2874069924 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f6f080b4c40 0x7f6f080b7150 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f6f24108b90 tx=0x7f6f10005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:21:50.401 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:50.400+0000 7f6f20c00640 1 -- 172.21.15.50:0/2874069924 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f6f140aca90 con 0x7f6f24103750 2024-08-31T04:21:50.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:21:50 smithi177 ceph-mon[22025]: from='client.? 172.21.15.50:0/605329791' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 3} : dispatch 2024-08-31T04:21:50.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:21:50 smithi177 ceph-mon[22025]: from='client.? 172.21.15.50:0/2790509810' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 7} : dispatch 2024-08-31T04:21:50.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:21:50 smithi177 ceph-mon[22025]: from='client.? 172.21.15.50:0/2781774662' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 4} : dispatch 2024-08-31T04:21:50.603 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:50.601+0000 7f6f29c00640 1 -- 172.21.15.50:0/2874069924 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 11} v 0) -- 0x7f6f2402e430 con 0x7f6f24103750 2024-08-31T04:21:50.603 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:50.602+0000 7f6f20c00640 1 -- 172.21.15.50:0/2874069924 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 11}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7f6f140ac390 con 0x7f6f24103750 2024-08-31T04:21:50.603 INFO:teuthology.orchestra.run.smithi050.stdout:292057776155 2024-08-31T04:21:50.605 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:50.604+0000 7f6f29c00640 1 -- 172.21.15.50:0/2874069924 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f6f080b4c40 msgr2=0x7f6f080b7150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:21:50.605 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:50.604+0000 7f6f29c00640 1 --2- 172.21.15.50:0/2874069924 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f6f080b4c40 0x7f6f080b7150 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f6f24108b90 tx=0x7f6f10005f90 comp rx=0 tx=0).stop 2024-08-31T04:21:50.605 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:50.604+0000 7f6f29c00640 1 -- 172.21.15.50:0/2874069924 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6f24103750 msgr2=0x7f6f240754b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:21:50.606 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:50.604+0000 7f6f29c00640 1 --2- 172.21.15.50:0/2874069924 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6f24103750 0x7f6f240754b0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f6f1400e9f0 tx=0x7f6f1400eeb0 comp rx=0 tx=0).stop 2024-08-31T04:21:50.606 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:50.604+0000 7f6f29c00640 1 -- 172.21.15.50:0/2874069924 shutdown_connections 2024-08-31T04:21:50.606 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:50.604+0000 7f6f29c00640 1 --2- 172.21.15.50:0/2874069924 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f6f080b4c40 0x7f6f080b7150 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:50.606 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:50.604+0000 7f6f29c00640 1 --2- 172.21.15.50:0/2874069924 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6f241099e0 0x7f6f24075f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:50.606 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:50.604+0000 7f6f29c00640 1 --2- 172.21.15.50:0/2874069924 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6f24109090 0x7f6f240759f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:50.606 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:50.604+0000 7f6f29c00640 1 --2- 172.21.15.50:0/2874069924 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6f24103750 0x7f6f240754b0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:50.606 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:50.604+0000 7f6f29c00640 1 -- 172.21.15.50:0/2874069924 >> 172.21.15.50:0/2874069924 conn(0x7f6f240ff1a0 msgr2=0x7f6f241015c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:21:50.606 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:50.604+0000 7f6f29c00640 1 -- 172.21.15.50:0/2874069924 shutdown_connections 2024-08-31T04:21:50.606 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:50.604+0000 7f6f29c00640 1 -- 172.21.15.50:0/2874069924 wait complete. 2024-08-31T04:21:50.642 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:21:50.684 INFO:tasks.cephadm.ceph_manager.ceph:need seq 55834574926 got 55834574928 for osd.1 2024-08-31T04:21:50.684 DEBUG:teuthology.parallel:result is None 2024-08-31T04:21:51.290 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:21:51 smithi050 ceph-mon[17259]: pgmap v335: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-08-31T04:21:51.290 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:21:51 smithi050 ceph-mon[17259]: from='client.? 172.21.15.50:0/2874069924' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 11} : dispatch 2024-08-31T04:21:51.292 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:21:51 smithi133 ceph-mon[22177]: pgmap v335: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-08-31T04:21:51.293 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:21:51 smithi133 ceph-mon[22177]: from='client.? 172.21.15.50:0/2874069924' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 11} : dispatch 2024-08-31T04:21:51.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:21:51 smithi177 ceph-mon[22025]: pgmap v335: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-08-31T04:21:51.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:21:51 smithi177 ceph-mon[22025]: from='client.? 172.21.15.50:0/2874069924' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 11} : dispatch 2024-08-31T04:21:51.873 INFO:tasks.cephadm.ceph_manager.ceph:need seq 180388626482 got 180388626485 for osd.6 2024-08-31T04:21:51.873 DEBUG:teuthology.parallel:result is None 2024-08-31T04:21:53.157 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:21:53 smithi050 ceph-mon[17259]: pgmap v336: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2024-08-31T04:21:53.192 INFO:tasks.cephadm.ceph_manager.ceph:need seq 133143986238 got 133143986240 for osd.4 2024-08-31T04:21:53.193 DEBUG:teuthology.parallel:result is None 2024-08-31T04:21:53.293 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:21:53 smithi133 ceph-mon[22177]: pgmap v336: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2024-08-31T04:21:53.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:21:53 smithi177 ceph-mon[22025]: pgmap v336: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2024-08-31T04:21:54.489 INFO:tasks.cephadm.ceph_manager.ceph:need seq 107374182467 got 107374182468 for osd.3 2024-08-31T04:21:54.489 DEBUG:teuthology.parallel:result is None 2024-08-31T04:21:54.692 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:21:54.702 INFO:tasks.cephadm.ceph_manager.ceph:need seq 292057776153 got 292057776155 for osd.11 2024-08-31T04:21:54.702 DEBUG:teuthology.parallel:result is None 2024-08-31T04:21:55.079 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:55.076+0000 7fa14ca00640 1 -- 172.21.15.50:0/2706388665 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa148109250 msgr2=0x7fa148109660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:21:55.079 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:55.076+0000 7fa14ca00640 1 --2- 172.21.15.50:0/2706388665 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa148109250 0x7fa148109660 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fa134009900 tx=0x7fa13402a410 comp rx=0 tx=0).stop 2024-08-31T04:21:55.079 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:55.076+0000 7fa14ca00640 1 -- 172.21.15.50:0/2706388665 shutdown_connections 2024-08-31T04:21:55.079 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:55.076+0000 7fa14ca00640 1 --2- 172.21.15.50:0/2706388665 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa148109ba0 0x7fa1481103d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:55.079 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:55.076+0000 7fa14ca00640 1 --2- 172.21.15.50:0/2706388665 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa148109250 0x7fa148109660 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:55.080 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:55.076+0000 7fa14ca00640 1 --2- 172.21.15.50:0/2706388665 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa148103910 0x7fa148103d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:55.080 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:55.076+0000 7fa14ca00640 1 -- 172.21.15.50:0/2706388665 >> 172.21.15.50:0/2706388665 conn(0x7fa1480ff380 msgr2=0x7fa1481017d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:21:55.080 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:55.076+0000 7fa14ca00640 1 -- 172.21.15.50:0/2706388665 shutdown_connections 2024-08-31T04:21:55.080 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:55.076+0000 7fa14ca00640 1 -- 172.21.15.50:0/2706388665 wait complete. 2024-08-31T04:21:55.080 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:21:55 smithi050 ceph-mon[17259]: pgmap v337: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-08-31T04:21:55.082 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:55.077+0000 7fa14ca00640 1 Processor -- start 2024-08-31T04:21:55.082 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:55.078+0000 7fa14ca00640 1 -- start start 2024-08-31T04:21:55.082 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:55.078+0000 7fa14ca00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa148103910 0x7fa14819c4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:21:55.082 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:55.078+0000 7fa14ca00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa148109250 0x7fa14819ca80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:21:55.082 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:55.078+0000 7fa14ca00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa148109ba0 0x7fa1481a1d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:21:55.082 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:55.078+0000 7fa14ca00640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fa1481138b0 con 0x7fa148103910 2024-08-31T04:21:55.082 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:55.078+0000 7fa14ca00640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7fa148113730 con 0x7fa148109ba0 2024-08-31T04:21:55.082 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:55.078+0000 7fa14ca00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fa148113a30 con 0x7fa148109250 2024-08-31T04:21:55.082 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:55.078+0000 7fa145e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa148103910 0x7fa14819c4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:21:55.082 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:55.078+0000 7fa145400640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa148109250 0x7fa14819ca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:21:55.083 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:55.078+0000 7fa145e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa148103910 0x7fa14819c4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48180/0 (socket says 172.21.15.50:48180) 2024-08-31T04:21:55.083 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:55.078+0000 7fa145e00640 1 -- 172.21.15.50:0/1864511912 learned_addr learned my addr 172.21.15.50:0/1864511912 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:21:55.083 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:55.078+0000 7fa146800640 1 --2- 172.21.15.50:0/1864511912 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa148109ba0 0x7fa1481a1d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:21:55.083 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:55.079+0000 7fa145e00640 1 -- 172.21.15.50:0/1864511912 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa148109250 msgr2=0x7fa14819ca80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:21:55.083 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:55.079+0000 7fa145e00640 1 --2- 172.21.15.50:0/1864511912 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa148109250 0x7fa14819ca80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:55.083 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:55.079+0000 7fa145e00640 1 -- 172.21.15.50:0/1864511912 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa148109ba0 msgr2=0x7fa1481a1d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:21:55.083 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:55.079+0000 7fa145e00640 1 --2- 172.21.15.50:0/1864511912 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa148109ba0 0x7fa1481a1d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:55.083 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:55.079+0000 7fa145e00640 1 -- 172.21.15.50:0/1864511912 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1481a2450 con 0x7fa148103910 2024-08-31T04:21:55.083 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:55.079+0000 7fa146800640 1 --2- 172.21.15.50:0/1864511912 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa148109ba0 0x7fa1481a1d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:21:55.083 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:55.079+0000 7fa145e00640 1 --2- 172.21.15.50:0/1864511912 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa148103910 0x7fa14819c4e0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fa13800e9f0 tx=0x7fa13800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:21:55.083 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:55.080+0000 7fa13ea00640 1 -- 172.21.15.50:0/1864511912 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa13800cd80 con 0x7fa148103910 2024-08-31T04:21:55.083 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:55.080+0000 7fa14ca00640 1 -- 172.21.15.50:0/1864511912 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa1481a2740 con 0x7fa148103910 2024-08-31T04:21:55.083 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:55.080+0000 7fa13ea00640 1 -- 172.21.15.50:0/1864511912 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa1380108e0 con 0x7fa148103910 2024-08-31T04:21:55.084 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:55.080+0000 7fa13ea00640 1 -- 172.21.15.50:0/1864511912 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa138018980 con 0x7fa148103910 2024-08-31T04:21:55.084 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:55.080+0000 7fa14ca00640 1 -- 172.21.15.50:0/1864511912 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa1481a8ea0 con 0x7fa148103910 2024-08-31T04:21:55.084 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:55.081+0000 7fa14ca00640 1 -- 172.21.15.50:0/1864511912 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa148103d20 con 0x7fa148103910 2024-08-31T04:21:55.085 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:55.083+0000 7fa13ea00640 1 -- 172.21.15.50:0/1864511912 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 17) ==== 152628+0+0 (secure 0 0 0) 0x7fa138010430 con 0x7fa148103910 2024-08-31T04:21:55.087 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:55.085+0000 7fa13ea00640 1 --2- 172.21.15.50:0/1864511912 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fa12c0b4bc0 0x7fa12c0b70d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:21:55.087 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:55.085+0000 7fa13ea00640 1 -- 172.21.15.50:0/1864511912 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8219+0+0 (secure 0 0 0) 0x7fa1380e5620 con 0x7fa148103910 2024-08-31T04:21:55.087 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:55.085+0000 7fa145400640 1 --2- 172.21.15.50:0/1864511912 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fa12c0b4bc0 0x7fa12c0b70d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:21:55.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:55.086+0000 7fa145400640 1 --2- 172.21.15.50:0/1864511912 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fa12c0b4bc0 0x7fa12c0b70d0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fa13402aa00 tx=0x7fa134005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:21:55.090 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:55.088+0000 7fa13ea00640 1 -- 172.21.15.50:0/1864511912 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fa1380abf50 con 0x7fa148103910 2024-08-31T04:21:55.293 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:21:55 smithi133 ceph-mon[22177]: pgmap v337: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-08-31T04:21:55.297 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:55.295+0000 7fa14ca00640 1 -- 172.21.15.50:0/1864511912 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 8} v 0) -- 0x7fa1481a91d0 con 0x7fa148103910 2024-08-31T04:21:55.298 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:55.296+0000 7fa13ea00640 1 -- 172.21.15.50:0/1864511912 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 8}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fa1380b0710 con 0x7fa148103910 2024-08-31T04:21:55.298 INFO:teuthology.orchestra.run.smithi050.stdout:223338299435 2024-08-31T04:21:55.300 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:55.298+0000 7fa14ca00640 1 -- 172.21.15.50:0/1864511912 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fa12c0b4bc0 msgr2=0x7fa12c0b70d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:21:55.300 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:55.298+0000 7fa14ca00640 1 --2- 172.21.15.50:0/1864511912 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fa12c0b4bc0 0x7fa12c0b70d0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fa13402aa00 tx=0x7fa134005a20 comp rx=0 tx=0).stop 2024-08-31T04:21:55.300 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:55.298+0000 7fa14ca00640 1 -- 172.21.15.50:0/1864511912 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa148103910 msgr2=0x7fa14819c4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:21:55.300 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:55.298+0000 7fa14ca00640 1 --2- 172.21.15.50:0/1864511912 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa148103910 0x7fa14819c4e0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fa13800e9f0 tx=0x7fa13800eeb0 comp rx=0 tx=0).stop 2024-08-31T04:21:55.301 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:55.298+0000 7fa14ca00640 1 -- 172.21.15.50:0/1864511912 shutdown_connections 2024-08-31T04:21:55.301 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:55.298+0000 7fa14ca00640 1 --2- 172.21.15.50:0/1864511912 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fa12c0b4bc0 0x7fa12c0b70d0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:55.301 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:55.298+0000 7fa14ca00640 1 --2- 172.21.15.50:0/1864511912 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa148109250 0x7fa14819ca80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:55.301 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:55.298+0000 7fa14ca00640 1 --2- 172.21.15.50:0/1864511912 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa148109ba0 0x7fa1481a1d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:55.301 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:55.298+0000 7fa14ca00640 1 --2- 172.21.15.50:0/1864511912 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa148103910 0x7fa14819c4e0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:55.301 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:55.298+0000 7fa14ca00640 1 -- 172.21.15.50:0/1864511912 >> 172.21.15.50:0/1864511912 conn(0x7fa1480ff380 msgr2=0x7fa14810e670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:21:55.301 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:55.298+0000 7fa14ca00640 1 -- 172.21.15.50:0/1864511912 shutdown_connections 2024-08-31T04:21:55.301 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:55.298+0000 7fa14ca00640 1 -- 172.21.15.50:0/1864511912 wait complete. 2024-08-31T04:21:55.316 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:55.313+0000 7f9277e00640 1 -- 172.21.15.50:0/2797145267 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9278077120 msgr2=0x7f9278075550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:21:55.316 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:55.313+0000 7f9277e00640 1 --2- 172.21.15.50:0/2797145267 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9278077120 0x7f9278075550 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f9268009900 tx=0x7f926802a3f0 comp rx=0 tx=0).stop 2024-08-31T04:21:55.316 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:55.313+0000 7f9277e00640 1 -- 172.21.15.50:0/2797145267 shutdown_connections 2024-08-31T04:21:55.316 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:55.313+0000 7f9277e00640 1 --2- 172.21.15.50:0/2797145267 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9278114020 0x7f92781164f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:55.316 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:55.313+0000 7f9277e00640 1 --2- 172.21.15.50:0/2797145267 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9278075b70 0x7f9278075f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:55.316 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:55.313+0000 7f9277e00640 1 --2- 172.21.15.50:0/2797145267 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9278077120 0x7f9278075550 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:55.316 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:55.313+0000 7f9277e00640 1 -- 172.21.15.50:0/2797145267 >> 172.21.15.50:0/2797145267 conn(0x7f92780ff1e0 msgr2=0x7f9278101630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:21:55.316 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:55.314+0000 7f9277e00640 1 -- 172.21.15.50:0/2797145267 shutdown_connections 2024-08-31T04:21:55.317 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:55.315+0000 7f9277e00640 1 -- 172.21.15.50:0/2797145267 wait complete. 2024-08-31T04:21:55.318 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:55.316+0000 7f9277e00640 1 Processor -- start 2024-08-31T04:21:55.318 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:55.316+0000 7f9277e00640 1 -- start start 2024-08-31T04:21:55.319 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:55.316+0000 7f9277e00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9278075b70 0x7f92781a06a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:21:55.319 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:55.317+0000 7f9277e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9278077120 0x7f92781a0c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:21:55.319 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:55.317+0000 7f9277e00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9278114020 0x7f92781a5ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:21:55.319 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:55.317+0000 7f9277e00640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f9278119cb0 con 0x7f9278077120 2024-08-31T04:21:55.319 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:55.317+0000 7f9277e00640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f9278119b30 con 0x7f9278114020 2024-08-31T04:21:55.319 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:55.317+0000 7f9277e00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f9278119e30 con 0x7f9278075b70 2024-08-31T04:21:55.320 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:55.317+0000 7f9276000640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9278077120 0x7f92781a0c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:21:55.320 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:55.317+0000 7f9276000640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9278077120 0x7f92781a0c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48194/0 (socket says 172.21.15.50:48194) 2024-08-31T04:21:55.320 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:55.317+0000 7f9276000640 1 -- 172.21.15.50:0/2928668216 learned_addr learned my addr 172.21.15.50:0/2928668216 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:21:55.320 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:55.317+0000 7f9276a00640 1 --2- 172.21.15.50:0/2928668216 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9278075b70 0x7f92781a06a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:21:55.320 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:55.317+0000 7f9277400640 1 --2- 172.21.15.50:0/2928668216 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9278114020 0x7f92781a5ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:21:55.320 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:55.317+0000 7f9276000640 1 -- 172.21.15.50:0/2928668216 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9278075b70 msgr2=0x7f92781a06a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:21:55.320 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:55.317+0000 7f9276000640 1 --2- 172.21.15.50:0/2928668216 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9278075b70 0x7f92781a06a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:55.320 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:55.317+0000 7f9276000640 1 -- 172.21.15.50:0/2928668216 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9278114020 msgr2=0x7f92781a5ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:21:55.321 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:55.317+0000 7f9276000640 1 --2- 172.21.15.50:0/2928668216 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9278114020 0x7f92781a5ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:55.321 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:55.317+0000 7f9276000640 1 -- 172.21.15.50:0/2928668216 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92781a6610 con 0x7f9278077120 2024-08-31T04:21:55.321 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:55.318+0000 7f9276000640 1 --2- 172.21.15.50:0/2928668216 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9278077120 0x7f92781a0c40 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f926400e9c0 tx=0x7f926400edc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:21:55.321 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:55.318+0000 7f927ca00640 1 -- 172.21.15.50:0/2928668216 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f926400ccc0 con 0x7f9278077120 2024-08-31T04:21:55.321 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:55.318+0000 7f927ca00640 1 -- 172.21.15.50:0/2928668216 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f92640054d0 con 0x7f9278077120 2024-08-31T04:21:55.321 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:55.318+0000 7f927ca00640 1 -- 172.21.15.50:0/2928668216 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9264010430 con 0x7f9278077120 2024-08-31T04:21:55.322 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:55.318+0000 7f9277e00640 1 -- 172.21.15.50:0/2928668216 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f92781a6900 con 0x7f9278077120 2024-08-31T04:21:55.322 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:55.318+0000 7f9277e00640 1 -- 172.21.15.50:0/2928668216 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f92781ad060 con 0x7f9278077120 2024-08-31T04:21:55.322 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:55.320+0000 7f9277e00640 1 -- 172.21.15.50:0/2928668216 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9278075f80 con 0x7f9278077120 2024-08-31T04:21:55.324 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:55.322+0000 7f927ca00640 1 -- 172.21.15.50:0/2928668216 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 17) ==== 152628+0+0 (secure 0 0 0) 0x7f9264004f20 con 0x7f9278077120 2024-08-31T04:21:55.326 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:55.324+0000 7f927ca00640 1 --2- 172.21.15.50:0/2928668216 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f925c0b4c40 0x7f925c0b7150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:21:55.326 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:55.324+0000 7f927ca00640 1 -- 172.21.15.50:0/2928668216 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8219+0+0 (secure 0 0 0) 0x7f92640e5b80 con 0x7f9278077120 2024-08-31T04:21:55.326 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:55.324+0000 7f9276a00640 1 --2- 172.21.15.50:0/2928668216 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f925c0b4c40 0x7f925c0b7150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:21:55.327 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:55.325+0000 7f9276a00640 1 --2- 172.21.15.50:0/2928668216 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f925c0b4c40 0x7f925c0b7150 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f9268005ab0 tx=0x7f9268005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:21:55.330 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:55.328+0000 7f927ca00640 1 -- 172.21.15.50:0/2928668216 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f92640acb00 con 0x7f9278077120 2024-08-31T04:21:55.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:21:55 smithi177 ceph-mon[22025]: pgmap v337: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-08-31T04:21:55.543 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:55.541+0000 7f9277e00640 1 -- 172.21.15.50:0/2928668216 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 9} v 0) -- 0x7f92781a17d0 con 0x7f9278077120 2024-08-31T04:21:55.543 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:55.541+0000 7f927ca00640 1 -- 172.21.15.50:0/2928668216 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 9}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f92781a17d0 con 0x7f9278077120 2024-08-31T04:21:55.544 INFO:teuthology.orchestra.run.smithi050.stdout:249108103207 2024-08-31T04:21:55.546 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:55.544+0000 7f9277e00640 1 -- 172.21.15.50:0/2928668216 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f925c0b4c40 msgr2=0x7f925c0b7150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:21:55.546 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:55.544+0000 7f9277e00640 1 --2- 172.21.15.50:0/2928668216 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f925c0b4c40 0x7f925c0b7150 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f9268005ab0 tx=0x7f9268005a20 comp rx=0 tx=0).stop 2024-08-31T04:21:55.546 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:55.544+0000 7f9277e00640 1 -- 172.21.15.50:0/2928668216 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9278077120 msgr2=0x7f92781a0c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:21:55.546 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:55.544+0000 7f9277e00640 1 --2- 172.21.15.50:0/2928668216 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9278077120 0x7f92781a0c40 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f926400e9c0 tx=0x7f926400edc0 comp rx=0 tx=0).stop 2024-08-31T04:21:55.547 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:55.544+0000 7f9277e00640 1 -- 172.21.15.50:0/2928668216 shutdown_connections 2024-08-31T04:21:55.547 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:55.544+0000 7f9277e00640 1 --2- 172.21.15.50:0/2928668216 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f925c0b4c40 0x7f925c0b7150 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:55.547 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:55.544+0000 7f9277e00640 1 --2- 172.21.15.50:0/2928668216 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9278114020 0x7f92781a5ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:55.547 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:55.544+0000 7f9277e00640 1 --2- 172.21.15.50:0/2928668216 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9278077120 0x7f92781a0c40 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:55.547 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:55.544+0000 7f9277e00640 1 --2- 172.21.15.50:0/2928668216 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9278075b70 0x7f92781a06a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:55.547 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:55.544+0000 7f9277e00640 1 -- 172.21.15.50:0/2928668216 >> 172.21.15.50:0/2928668216 conn(0x7f92780ff1e0 msgr2=0x7f927810ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:21:55.547 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:55.544+0000 7f9277e00640 1 -- 172.21.15.50:0/2928668216 shutdown_connections 2024-08-31T04:21:55.547 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:55.544+0000 7f9277e00640 1 -- 172.21.15.50:0/2928668216 wait complete. 2024-08-31T04:21:56.200 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:21:56 smithi050 ceph-mon[17259]: from='client.? 172.21.15.50:0/1864511912' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 8} : dispatch 2024-08-31T04:21:56.200 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:21:56 smithi050 ceph-mon[17259]: from='client.? 172.21.15.50:0/2928668216' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 9} : dispatch 2024-08-31T04:21:56.293 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:21:56 smithi133 ceph-mon[22177]: from='client.? 172.21.15.50:0/1864511912' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 8} : dispatch 2024-08-31T04:21:56.293 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:21:56 smithi133 ceph-mon[22177]: from='client.? 172.21.15.50:0/2928668216' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 9} : dispatch 2024-08-31T04:21:56.424 INFO:tasks.cephadm.ceph_manager.ceph:need seq 223338299432 got 223338299435 for osd.8 2024-08-31T04:21:56.424 DEBUG:teuthology.parallel:result is None 2024-08-31T04:21:56.486 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:56.227+0000 7f6cfde00640 1 -- 172.21.15.50:0/4192856162 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6cf8103900 msgr2=0x7f6cf8103d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:21:56.486 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:56.227+0000 7f6cfde00640 1 --2- 172.21.15.50:0/4192856162 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6cf8103900 0x7f6cf8103d10 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f6ce8009900 tx=0x7f6ce802a410 comp rx=0 tx=0).stop 2024-08-31T04:21:56.486 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:56.227+0000 7f6cfde00640 1 -- 172.21.15.50:0/4192856162 shutdown_connections 2024-08-31T04:21:56.486 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:56.227+0000 7f6cfde00640 1 --2- 172.21.15.50:0/4192856162 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6cf8109b90 0x7f6cf81103c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:56.486 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:56.227+0000 7f6cfde00640 1 --2- 172.21.15.50:0/4192856162 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6cf8109240 0x7f6cf8109650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:56.486 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:56.227+0000 7f6cfde00640 1 --2- 172.21.15.50:0/4192856162 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6cf8103900 0x7f6cf8103d10 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:56.486 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:56.227+0000 7f6cfde00640 1 -- 172.21.15.50:0/4192856162 >> 172.21.15.50:0/4192856162 conn(0x7f6cf807b5f0 msgr2=0x7f6cf807ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:21:56.487 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:56.227+0000 7f6cfde00640 1 -- 172.21.15.50:0/4192856162 shutdown_connections 2024-08-31T04:21:56.487 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:56.227+0000 7f6cfde00640 1 -- 172.21.15.50:0/4192856162 wait complete. 2024-08-31T04:21:56.487 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:56.228+0000 7f6cfde00640 1 Processor -- start 2024-08-31T04:21:56.487 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:56.228+0000 7f6cfde00640 1 -- start start 2024-08-31T04:21:56.487 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:56.229+0000 7f6cfde00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6cf8103900 0x7f6cf819c4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:21:56.487 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:56.229+0000 7f6cfde00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6cf8109240 0x7f6cf819ca80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:21:56.487 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:56.229+0000 7f6cfde00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6cf8109b90 0x7f6cf81a1d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:21:56.487 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:56.229+0000 7f6cfde00640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f6cf8113850 con 0x7f6cf8103900 2024-08-31T04:21:56.487 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:56.229+0000 7f6cfde00640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f6cf81136d0 con 0x7f6cf8109240 2024-08-31T04:21:56.487 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:56.229+0000 7f6cfde00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f6cf81139d0 con 0x7f6cf8109b90 2024-08-31T04:21:56.487 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:56.229+0000 7f6cf6a00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6cf8103900 0x7f6cf819c4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:21:56.487 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:56.229+0000 7f6cf6a00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6cf8103900 0x7f6cf819c4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48210/0 (socket says 172.21.15.50:48210) 2024-08-31T04:21:56.487 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:56.229+0000 7f6cf6a00640 1 -- 172.21.15.50:0/344881269 learned_addr learned my addr 172.21.15.50:0/344881269 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:21:56.488 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:56.229+0000 7f6cefe00640 1 --2- 172.21.15.50:0/344881269 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6cf8109240 0x7f6cf819ca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:21:56.488 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:56.229+0000 7f6cf7400640 1 --2- 172.21.15.50:0/344881269 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6cf8109b90 0x7f6cf81a1d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:21:56.488 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:56.230+0000 7f6cf6a00640 1 -- 172.21.15.50:0/344881269 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6cf8109b90 msgr2=0x7f6cf81a1d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:21:56.488 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:56.230+0000 7f6cf6a00640 1 --2- 172.21.15.50:0/344881269 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6cf8109b90 0x7f6cf81a1d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:56.488 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:56.230+0000 7f6cf6a00640 1 -- 172.21.15.50:0/344881269 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6cf8109240 msgr2=0x7f6cf819ca80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:21:56.488 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:56.230+0000 7f6cf6a00640 1 --2- 172.21.15.50:0/344881269 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6cf8109240 0x7f6cf819ca80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:56.488 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:56.230+0000 7f6cf6a00640 1 -- 172.21.15.50:0/344881269 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6cf81a2450 con 0x7f6cf8103900 2024-08-31T04:21:56.488 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:56.230+0000 7f6cefe00640 1 --2- 172.21.15.50:0/344881269 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6cf8109240 0x7f6cf819ca80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:21:56.488 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:56.230+0000 7f6cf6a00640 1 --2- 172.21.15.50:0/344881269 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6cf8103900 0x7f6cf819c4e0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f6ce8005940 tx=0x7f6ce80040c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:21:56.488 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:56.230+0000 7f6cfca00640 1 -- 172.21.15.50:0/344881269 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ce803f030 con 0x7f6cf8103900 2024-08-31T04:21:56.488 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:56.230+0000 7f6cfca00640 1 -- 172.21.15.50:0/344881269 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6ce80044c0 con 0x7f6cf8103900 2024-08-31T04:21:56.488 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:56.230+0000 7f6cfca00640 1 -- 172.21.15.50:0/344881269 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ce8035070 con 0x7f6cf8103900 2024-08-31T04:21:56.488 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:56.230+0000 7f6cfde00640 1 -- 172.21.15.50:0/344881269 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6cf81a26e0 con 0x7f6cf8103900 2024-08-31T04:21:56.489 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:56.230+0000 7f6cfde00640 1 -- 172.21.15.50:0/344881269 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6cf81a8ea0 con 0x7f6cf8103900 2024-08-31T04:21:56.489 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:56.232+0000 7f6cfde00640 1 -- 172.21.15.50:0/344881269 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6cf8104b80 con 0x7f6cf8103900 2024-08-31T04:21:56.489 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:56.236+0000 7f6cfca00640 1 -- 172.21.15.50:0/344881269 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 17) ==== 152628+0+0 (secure 0 0 0) 0x7f6ce8042030 con 0x7f6cf8103900 2024-08-31T04:21:56.489 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:56.237+0000 7f6cfca00640 1 --2- 172.21.15.50:0/344881269 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f6cdc0b4bc0 0x7f6cdc0b70d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:21:56.489 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:56.237+0000 7f6cfca00640 1 -- 172.21.15.50:0/344881269 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8219+0+0 (secure 0 0 0) 0x7f6ce81058b0 con 0x7f6cf8103900 2024-08-31T04:21:56.489 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:56.237+0000 7f6cefe00640 1 --2- 172.21.15.50:0/344881269 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f6cdc0b4bc0 0x7f6cdc0b70d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:21:56.489 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:56.238+0000 7f6cefe00640 1 --2- 172.21.15.50:0/344881269 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f6cdc0b4bc0 0x7f6cdc0b70d0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f6cf8108fa0 tx=0x7f6ce0005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:21:56.489 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:56.240+0000 7f6cfca00640 1 -- 172.21.15.50:0/344881269 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f6ce80cc1e0 con 0x7f6cf8103900 2024-08-31T04:21:56.489 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:56.442+0000 7f6cfde00640 1 -- 172.21.15.50:0/344881269 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 10} v 0) -- 0x7f6cf81a9110 con 0x7f6cf8103900 2024-08-31T04:21:56.489 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:56.442+0000 7f6cfca00640 1 -- 172.21.15.50:0/344881269 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 10}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7f6ce80d09a0 con 0x7f6cf8103900 2024-08-31T04:21:56.490 INFO:teuthology.orchestra.run.smithi050.stdout:270582939680 2024-08-31T04:21:56.490 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:56.445+0000 7f6cfde00640 1 -- 172.21.15.50:0/344881269 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f6cdc0b4bc0 msgr2=0x7f6cdc0b70d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:21:56.490 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:56.445+0000 7f6cfde00640 1 --2- 172.21.15.50:0/344881269 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f6cdc0b4bc0 0x7f6cdc0b70d0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f6cf8108fa0 tx=0x7f6ce0005f90 comp rx=0 tx=0).stop 2024-08-31T04:21:56.490 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:56.445+0000 7f6cfde00640 1 -- 172.21.15.50:0/344881269 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6cf8103900 msgr2=0x7f6cf819c4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:21:56.490 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:56.445+0000 7f6cfde00640 1 --2- 172.21.15.50:0/344881269 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6cf8103900 0x7f6cf819c4e0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f6ce8005940 tx=0x7f6ce80040c0 comp rx=0 tx=0).stop 2024-08-31T04:21:56.490 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:56.445+0000 7f6cfde00640 1 -- 172.21.15.50:0/344881269 shutdown_connections 2024-08-31T04:21:56.491 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:56.445+0000 7f6cfde00640 1 --2- 172.21.15.50:0/344881269 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f6cdc0b4bc0 0x7f6cdc0b70d0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:56.491 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:56.445+0000 7f6cfde00640 1 --2- 172.21.15.50:0/344881269 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6cf8109b90 0x7f6cf81a1d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:56.491 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:56.445+0000 7f6cfde00640 1 --2- 172.21.15.50:0/344881269 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6cf8109240 0x7f6cf819ca80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:56.491 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:56.445+0000 7f6cfde00640 1 --2- 172.21.15.50:0/344881269 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6cf8103900 0x7f6cf819c4e0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:56.491 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:56.445+0000 7f6cfde00640 1 -- 172.21.15.50:0/344881269 >> 172.21.15.50:0/344881269 conn(0x7f6cf807b5f0 msgr2=0x7f6cf8107050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:21:56.491 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:56.445+0000 7f6cfde00640 1 -- 172.21.15.50:0/344881269 shutdown_connections 2024-08-31T04:21:56.491 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:56.445+0000 7f6cfde00640 1 -- 172.21.15.50:0/344881269 wait complete. 2024-08-31T04:21:56.495 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:21:56 smithi177 ceph-mon[22025]: from='client.? 172.21.15.50:0/1864511912' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 8} : dispatch 2024-08-31T04:21:56.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:21:56 smithi177 ceph-mon[22025]: from='client.? 172.21.15.50:0/2928668216' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 9} : dispatch 2024-08-31T04:21:57.200 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:21:57 smithi050 ceph-mon[17259]: pgmap v338: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2024-08-31T04:21:57.200 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:21:57 smithi050 ceph-mon[17259]: from='client.? 172.21.15.50:0/344881269' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 10} : dispatch 2024-08-31T04:21:57.246 INFO:tasks.cephadm.ceph_manager.ceph:need seq 249108103204 got 249108103207 for osd.9 2024-08-31T04:21:57.246 DEBUG:teuthology.parallel:result is None 2024-08-31T04:21:57.293 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:21:57 smithi133 ceph-mon[22177]: pgmap v338: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2024-08-31T04:21:57.293 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:21:57 smithi133 ceph-mon[22177]: from='client.? 172.21.15.50:0/344881269' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 10} : dispatch 2024-08-31T04:21:57.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:21:57 smithi177 ceph-mon[22025]: pgmap v338: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2024-08-31T04:21:57.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:21:57 smithi177 ceph-mon[22025]: from='client.? 172.21.15.50:0/344881269' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 10} : dispatch 2024-08-31T04:21:57.607 INFO:tasks.cephadm.ceph_manager.ceph:need seq 201863462958 got 201863462961 for osd.7 2024-08-31T04:21:57.607 DEBUG:teuthology.parallel:result is None 2024-08-31T04:21:58.004 INFO:tasks.cephadm.ceph_manager.ceph:need seq 270582939676 got 270582939680 for osd.10 2024-08-31T04:21:58.004 DEBUG:teuthology.parallel:result is None 2024-08-31T04:21:58.073 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:57.823+0000 7fb560e00640 1 -- 172.21.15.50:0/1584110712 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb55c10bdb0 msgr2=0x7fb55c1125e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:21:58.073 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:57.823+0000 7fb560e00640 1 --2- 172.21.15.50:0/1584110712 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb55c10bdb0 0x7fb55c1125e0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fb554009ca0 tx=0x7fb55402a8c0 comp rx=0 tx=0).stop 2024-08-31T04:21:58.074 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:57.824+0000 7fb560e00640 1 -- 172.21.15.50:0/1584110712 shutdown_connections 2024-08-31T04:21:58.074 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:57.824+0000 7fb560e00640 1 --2- 172.21.15.50:0/1584110712 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb55c10bdb0 0x7fb55c1125e0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:58.074 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:57.824+0000 7fb560e00640 1 --2- 172.21.15.50:0/1584110712 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb55c10b460 0x7fb55c10b870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:58.074 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:57.824+0000 7fb560e00640 1 --2- 172.21.15.50:0/1584110712 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb55c105b20 0x7fb55c105f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:58.074 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:57.824+0000 7fb560e00640 1 -- 172.21.15.50:0/1584110712 >> 172.21.15.50:0/1584110712 conn(0x7fb55c1015b0 msgr2=0x7fb55c103a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:21:58.074 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:57.824+0000 7fb560e00640 1 -- 172.21.15.50:0/1584110712 shutdown_connections 2024-08-31T04:21:58.074 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:57.824+0000 7fb560e00640 1 -- 172.21.15.50:0/1584110712 wait complete. 2024-08-31T04:21:58.074 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:57.825+0000 7fb560e00640 1 Processor -- start 2024-08-31T04:21:58.074 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:57.825+0000 7fb560e00640 1 -- start start 2024-08-31T04:21:58.074 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:57.825+0000 7fb560e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb55c105b20 0x7fb55c19c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:21:58.074 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:57.825+0000 7fb560e00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb55c10b460 0x7fb55c19ca20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:21:58.074 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:57.825+0000 7fb560e00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb55c10bdb0 0x7fb55c1a1cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:21:58.075 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:57.825+0000 7fb560e00640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fb55c115a70 con 0x7fb55c105b20 2024-08-31T04:21:58.075 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:57.825+0000 7fb560e00640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7fb55c1158f0 con 0x7fb55c10bdb0 2024-08-31T04:21:58.075 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:57.825+0000 7fb560e00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fb55c115bf0 con 0x7fb55c10b460 2024-08-31T04:21:58.075 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:57.826+0000 7fb559e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb55c105b20 0x7fb55c19c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:21:58.075 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:57.826+0000 7fb559e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb55c105b20 0x7fb55c19c480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48220/0 (socket says 172.21.15.50:48220) 2024-08-31T04:21:58.075 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:57.826+0000 7fb559e00640 1 -- 172.21.15.50:0/2553277991 learned_addr learned my addr 172.21.15.50:0/2553277991 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:21:58.075 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:57.826+0000 7fb559400640 1 --2- 172.21.15.50:0/2553277991 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb55c10b460 0x7fb55c19ca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:21:58.075 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:57.826+0000 7fb55a800640 1 --2- 172.21.15.50:0/2553277991 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb55c10bdb0 0x7fb55c1a1cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:21:58.075 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:57.826+0000 7fb559e00640 1 -- 172.21.15.50:0/2553277991 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb55c10b460 msgr2=0x7fb55c19ca20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:21:58.075 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:57.826+0000 7fb559e00640 1 --2- 172.21.15.50:0/2553277991 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb55c10b460 0x7fb55c19ca20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:58.075 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:57.826+0000 7fb559e00640 1 -- 172.21.15.50:0/2553277991 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb55c10bdb0 msgr2=0x7fb55c1a1cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:21:58.076 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:57.826+0000 7fb559e00640 1 --2- 172.21.15.50:0/2553277991 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb55c10bdb0 0x7fb55c1a1cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:58.076 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:57.826+0000 7fb559e00640 1 -- 172.21.15.50:0/2553277991 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb55c1a23f0 con 0x7fb55c105b20 2024-08-31T04:21:58.076 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:57.826+0000 7fb559e00640 1 --2- 172.21.15.50:0/2553277991 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb55c105b20 0x7fb55c19c480 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fb54c00e9f0 tx=0x7fb54c00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:21:58.076 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:57.827+0000 7fb552a00640 1 -- 172.21.15.50:0/2553277991 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb54c00cd80 con 0x7fb55c105b20 2024-08-31T04:21:58.076 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:57.827+0000 7fb552a00640 1 -- 172.21.15.50:0/2553277991 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb54c0108e0 con 0x7fb55c105b20 2024-08-31T04:21:58.076 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:57.827+0000 7fb552a00640 1 -- 172.21.15.50:0/2553277991 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb54c018980 con 0x7fb55c105b20 2024-08-31T04:21:58.076 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:57.827+0000 7fb560e00640 1 -- 172.21.15.50:0/2553277991 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb55c1a26e0 con 0x7fb55c105b20 2024-08-31T04:21:58.076 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:57.827+0000 7fb560e00640 1 -- 172.21.15.50:0/2553277991 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb55c1a8e40 con 0x7fb55c105b20 2024-08-31T04:21:58.076 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:57.828+0000 7fb560e00640 1 -- 172.21.15.50:0/2553277991 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb55c105f30 con 0x7fb55c105b20 2024-08-31T04:21:58.076 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:57.830+0000 7fb552a00640 1 -- 172.21.15.50:0/2553277991 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 17) ==== 152628+0+0 (secure 0 0 0) 0x7fb54c010430 con 0x7fb55c105b20 2024-08-31T04:21:58.076 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:57.833+0000 7fb552a00640 1 --2- 172.21.15.50:0/2553277991 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fb5400b4c40 0x7fb5400b7150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:21:58.076 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:57.833+0000 7fb552a00640 1 -- 172.21.15.50:0/2553277991 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8219+0+0 (secure 0 0 0) 0x7fb54c0e5a90 con 0x7fb55c105b20 2024-08-31T04:21:58.076 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:57.833+0000 7fb559400640 1 --2- 172.21.15.50:0/2553277991 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fb5400b4c40 0x7fb5400b7150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:21:58.077 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:57.834+0000 7fb559400640 1 --2- 172.21.15.50:0/2553277991 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fb5400b4c40 0x7fb5400b7150 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fb55c104cb0 tx=0x7fb548005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:21:58.077 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:57.835+0000 7fb552a00640 1 -- 172.21.15.50:0/2553277991 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fb54c0ac3c0 con 0x7fb55c105b20 2024-08-31T04:21:58.077 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:58.036+0000 7fb560e00640 1 -- 172.21.15.50:0/2553277991 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7fb55c02e430 con 0x7fb55c105b20 2024-08-31T04:21:58.077 INFO:teuthology.orchestra.run.smithi050.stdout:34359738453 2024-08-31T04:21:58.077 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:58.037+0000 7fb552a00640 1 -- 172.21.15.50:0/2553277991 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fb54c0b0b80 con 0x7fb55c105b20 2024-08-31T04:21:58.077 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:58.039+0000 7fb560e00640 1 -- 172.21.15.50:0/2553277991 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fb5400b4c40 msgr2=0x7fb5400b7150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:21:58.077 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:58.039+0000 7fb560e00640 1 --2- 172.21.15.50:0/2553277991 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fb5400b4c40 0x7fb5400b7150 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fb55c104cb0 tx=0x7fb548005f90 comp rx=0 tx=0).stop 2024-08-31T04:21:58.078 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:58.039+0000 7fb560e00640 1 -- 172.21.15.50:0/2553277991 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb55c105b20 msgr2=0x7fb55c19c480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:21:58.078 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:58.039+0000 7fb560e00640 1 --2- 172.21.15.50:0/2553277991 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb55c105b20 0x7fb55c19c480 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fb54c00e9f0 tx=0x7fb54c00eeb0 comp rx=0 tx=0).stop 2024-08-31T04:21:58.078 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:58.039+0000 7fb560e00640 1 -- 172.21.15.50:0/2553277991 shutdown_connections 2024-08-31T04:21:58.078 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:58.039+0000 7fb560e00640 1 --2- 172.21.15.50:0/2553277991 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fb5400b4c40 0x7fb5400b7150 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:58.078 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:58.039+0000 7fb560e00640 1 --2- 172.21.15.50:0/2553277991 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb55c10b460 0x7fb55c19ca20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:58.078 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:58.039+0000 7fb560e00640 1 --2- 172.21.15.50:0/2553277991 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb55c10bdb0 0x7fb55c1a1cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:58.078 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:58.039+0000 7fb560e00640 1 --2- 172.21.15.50:0/2553277991 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb55c105b20 0x7fb55c19c480 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:58.078 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:58.039+0000 7fb560e00640 1 -- 172.21.15.50:0/2553277991 >> 172.21.15.50:0/2553277991 conn(0x7fb55c1015b0 msgr2=0x7fb55c108a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:21:58.078 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:58.040+0000 7fb560e00640 1 -- 172.21.15.50:0/2553277991 shutdown_connections 2024-08-31T04:21:58.078 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:58.040+0000 7fb560e00640 1 -- 172.21.15.50:0/2553277991 wait complete. 2024-08-31T04:21:58.092 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:21:58 smithi050 ceph-mon[17259]: from='client.? 172.21.15.50:0/2553277991' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 0} : dispatch 2024-08-31T04:21:58.329 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:21:58.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:21:58 smithi177 ceph-mon[22025]: from='client.? 172.21.15.50:0/2553277991' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 0} : dispatch 2024-08-31T04:21:58.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:21:58 smithi133 ceph-mon[22177]: from='client.? 172.21.15.50:0/2553277991' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 0} : dispatch 2024-08-31T04:21:58.839 INFO:tasks.cephadm.ceph_manager.ceph:need seq 34359738450 got 34359738453 for osd.0 2024-08-31T04:21:58.840 DEBUG:teuthology.parallel:result is None 2024-08-31T04:21:59.380 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:59.377+0000 7fbd6aa00640 1 -- 172.21.15.50:0/4184334499 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbd64077120 msgr2=0x7fbd64075550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:21:59.380 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:59.377+0000 7fbd6aa00640 1 --2- 172.21.15.50:0/4184334499 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbd64077120 0x7fbd64075550 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fbd54009900 tx=0x7fbd5402a410 comp rx=0 tx=0).stop 2024-08-31T04:21:59.380 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:59.377+0000 7fbd6aa00640 1 -- 172.21.15.50:0/4184334499 shutdown_connections 2024-08-31T04:21:59.380 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:59.377+0000 7fbd6aa00640 1 --2- 172.21.15.50:0/4184334499 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbd641141f0 0x7fbd641166c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:59.380 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:59.377+0000 7fbd6aa00640 1 --2- 172.21.15.50:0/4184334499 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbd64075b70 0x7fbd64075f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:59.380 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:59.377+0000 7fbd6aa00640 1 --2- 172.21.15.50:0/4184334499 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbd64077120 0x7fbd64075550 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:59.380 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:59.377+0000 7fbd6aa00640 1 -- 172.21.15.50:0/4184334499 >> 172.21.15.50:0/4184334499 conn(0x7fbd640ff330 msgr2=0x7fbd64101780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:21:59.380 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:59.377+0000 7fbd6aa00640 1 -- 172.21.15.50:0/4184334499 shutdown_connections 2024-08-31T04:21:59.381 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:59.377+0000 7fbd6aa00640 1 -- 172.21.15.50:0/4184334499 wait complete. 2024-08-31T04:21:59.381 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:59.379+0000 7fbd6aa00640 1 Processor -- start 2024-08-31T04:21:59.381 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:59.379+0000 7fbd6aa00640 1 -- start start 2024-08-31T04:21:59.382 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:21:59 smithi050 ceph-mon[17259]: pgmap v339: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-08-31T04:21:59.382 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:59.379+0000 7fbd6aa00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbd64075b70 0x7fbd641a08c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:21:59.382 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:59.379+0000 7fbd6aa00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbd64077120 0x7fbd641a0e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:21:59.382 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:59.379+0000 7fbd6aa00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbd641141f0 0x7fbd641a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:21:59.383 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:59.379+0000 7fbd6aa00640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fbd64119e30 con 0x7fbd64077120 2024-08-31T04:21:59.383 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:59.379+0000 7fbd6aa00640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7fbd64119cb0 con 0x7fbd64075b70 2024-08-31T04:21:59.383 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:59.379+0000 7fbd6aa00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fbd64119fb0 con 0x7fbd641141f0 2024-08-31T04:21:59.383 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:59.380+0000 7fbd63e00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbd64075b70 0x7fbd641a08c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:21:59.383 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:59.380+0000 7fbd63400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbd64077120 0x7fbd641a0e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:21:59.383 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:59.380+0000 7fbd63e00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbd64075b70 0x7fbd641a08c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.50:33956/0 (socket says 172.21.15.50:33956) 2024-08-31T04:21:59.383 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:59.380+0000 7fbd63e00640 1 -- 172.21.15.50:0/571803291 learned_addr learned my addr 172.21.15.50:0/571803291 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:21:59.383 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:59.380+0000 7fbd68a00640 1 --2- 172.21.15.50:0/571803291 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbd641141f0 0x7fbd641a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:21:59.384 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:59.380+0000 7fbd63400640 1 -- 172.21.15.50:0/571803291 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbd641141f0 msgr2=0x7fbd641a6100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:21:59.384 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:59.380+0000 7fbd63400640 1 --2- 172.21.15.50:0/571803291 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbd641141f0 0x7fbd641a6100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:59.384 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:59.380+0000 7fbd63400640 1 -- 172.21.15.50:0/571803291 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbd64075b70 msgr2=0x7fbd641a08c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:21:59.384 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:59.380+0000 7fbd63400640 1 --2- 172.21.15.50:0/571803291 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbd64075b70 0x7fbd641a08c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:59.384 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:59.380+0000 7fbd63400640 1 -- 172.21.15.50:0/571803291 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd641a6830 con 0x7fbd64077120 2024-08-31T04:21:59.385 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:59.381+0000 7fbd63400640 1 --2- 172.21.15.50:0/571803291 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbd64077120 0x7fbd641a0e60 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fbd5000e9c0 tx=0x7fbd5000ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:21:59.385 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:59.381+0000 7fbd60c00640 1 -- 172.21.15.50:0/571803291 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd5000ccc0 con 0x7fbd64077120 2024-08-31T04:21:59.385 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:59.381+0000 7fbd6aa00640 1 -- 172.21.15.50:0/571803291 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbd641a6b20 con 0x7fbd64077120 2024-08-31T04:21:59.385 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:59.381+0000 7fbd60c00640 1 -- 172.21.15.50:0/571803291 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbd500108e0 con 0x7fbd64077120 2024-08-31T04:21:59.385 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:59.381+0000 7fbd60c00640 1 -- 172.21.15.50:0/571803291 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd500187c0 con 0x7fbd64077120 2024-08-31T04:21:59.386 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:59.381+0000 7fbd6aa00640 1 -- 172.21.15.50:0/571803291 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbd641ad280 con 0x7fbd64077120 2024-08-31T04:21:59.386 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:59.384+0000 7fbd6aa00640 1 -- 172.21.15.50:0/571803291 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbd64075f80 con 0x7fbd64077120 2024-08-31T04:21:59.388 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:59.387+0000 7fbd60c00640 1 -- 172.21.15.50:0/571803291 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 17) ==== 152628+0+0 (secure 0 0 0) 0x7fbd50010430 con 0x7fbd64077120 2024-08-31T04:21:59.389 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:59.387+0000 7fbd60c00640 1 --2- 172.21.15.50:0/571803291 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fbd480b4c40 0x7fbd480b7150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:21:59.389 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:59.387+0000 7fbd60c00640 1 -- 172.21.15.50:0/571803291 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8219+0+0 (secure 0 0 0) 0x7fbd500e5b00 con 0x7fbd64077120 2024-08-31T04:21:59.389 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:59.387+0000 7fbd63e00640 1 --2- 172.21.15.50:0/571803291 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fbd480b4c40 0x7fbd480b7150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:21:59.390 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:59.388+0000 7fbd63e00640 1 --2- 172.21.15.50:0/571803291 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fbd480b4c40 0x7fbd480b7150 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fbd540096c0 tx=0x7fbd54005de0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:21:59.395 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:59.393+0000 7fbd60c00640 1 -- 172.21.15.50:0/571803291 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fbd500aca80 con 0x7fbd64077120 2024-08-31T04:21:59.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:21:59 smithi177 ceph-mon[22025]: pgmap v339: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-08-31T04:21:59.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:21:59 smithi133 ceph-mon[22177]: pgmap v339: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-08-31T04:21:59.597 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:59.594+0000 7fbd6aa00640 1 -- 172.21.15.50:0/571803291 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7fbd64112f20 con 0x7fbd64077120 2024-08-31T04:21:59.597 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:59.594+0000 7fbd60c00640 1 -- 172.21.15.50:0/571803291 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fbd500ac380 con 0x7fbd64077120 2024-08-31T04:21:59.597 INFO:teuthology.orchestra.run.smithi050.stdout:154618822718 2024-08-31T04:21:59.599 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:59.598+0000 7fbd6aa00640 1 -- 172.21.15.50:0/571803291 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fbd480b4c40 msgr2=0x7fbd480b7150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:21:59.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:59.598+0000 7fbd6aa00640 1 --2- 172.21.15.50:0/571803291 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fbd480b4c40 0x7fbd480b7150 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fbd540096c0 tx=0x7fbd54005de0 comp rx=0 tx=0).stop 2024-08-31T04:21:59.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:59.598+0000 7fbd6aa00640 1 -- 172.21.15.50:0/571803291 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbd64077120 msgr2=0x7fbd641a0e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:21:59.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:59.598+0000 7fbd6aa00640 1 --2- 172.21.15.50:0/571803291 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbd64077120 0x7fbd641a0e60 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fbd5000e9c0 tx=0x7fbd5000ee80 comp rx=0 tx=0).stop 2024-08-31T04:21:59.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:59.598+0000 7fbd6aa00640 1 -- 172.21.15.50:0/571803291 shutdown_connections 2024-08-31T04:21:59.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:59.598+0000 7fbd6aa00640 1 --2- 172.21.15.50:0/571803291 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fbd480b4c40 0x7fbd480b7150 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:59.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:59.598+0000 7fbd6aa00640 1 --2- 172.21.15.50:0/571803291 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbd641141f0 0x7fbd641a6100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:59.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:59.598+0000 7fbd6aa00640 1 --2- 172.21.15.50:0/571803291 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbd64077120 0x7fbd641a0e60 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:59.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:59.598+0000 7fbd6aa00640 1 --2- 172.21.15.50:0/571803291 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbd64075b70 0x7fbd641a08c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:21:59.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:59.598+0000 7fbd6aa00640 1 -- 172.21.15.50:0/571803291 >> 172.21.15.50:0/571803291 conn(0x7fbd640ff330 msgr2=0x7fbd641100f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:21:59.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:59.598+0000 7fbd6aa00640 1 -- 172.21.15.50:0/571803291 shutdown_connections 2024-08-31T04:21:59.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:21:59.598+0000 7fbd6aa00640 1 -- 172.21.15.50:0/571803291 wait complete. 2024-08-31T04:22:00.430 INFO:tasks.cephadm.ceph_manager.ceph:need seq 154618822715 got 154618822718 for osd.5 2024-08-31T04:22:00.431 DEBUG:teuthology.parallel:result is None 2024-08-31T04:22:00.431 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-08-31T04:22:00.431 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 058d9fc6-674f-11ef-bcd4-c7b262605968 -- ceph pg dump --format=json 2024-08-31T04:22:00.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:22:00 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:22:00.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:22:00 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:22:00.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:22:00 smithi050 ceph-mon[17259]: from='client.? 172.21.15.50:0/571803291' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 5} : dispatch 2024-08-31T04:22:00.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:22:00 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:22:00.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:22:00 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T04:22:00.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:22:00 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:22:00.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:22:00 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:22:00.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:22:00 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:22:00.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:22:00 smithi177 ceph-mon[22025]: from='client.? 172.21.15.50:0/571803291' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 5} : dispatch 2024-08-31T04:22:00.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:22:00 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:22:00.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:22:00 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T04:22:00.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:22:00 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:22:00.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:22:00 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:22:00.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:22:00 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:22:00.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:22:00 smithi133 ceph-mon[22177]: from='client.? 172.21.15.50:0/571803291' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 5} : dispatch 2024-08-31T04:22:00.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:22:00 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:22:00.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:22:00 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T04:22:00.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:22:00 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:22:00.812 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:22:01.449 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:01.447+0000 7f354be00640 1 -- 172.21.15.50:0/3596282720 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f354c1099e0 msgr2=0x7f354c110210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:22:01.449 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:01.447+0000 7f354be00640 1 --2- 172.21.15.50:0/3596282720 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f354c1099e0 0x7f354c110210 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f3544009ca0 tx=0x7f354402a8c0 comp rx=0 tx=0).stop 2024-08-31T04:22:01.450 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:01.447+0000 7f354be00640 1 -- 172.21.15.50:0/3596282720 shutdown_connections 2024-08-31T04:22:01.450 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:01.447+0000 7f354be00640 1 --2- 172.21.15.50:0/3596282720 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f354c109090 0x7f354c1094a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:01.450 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:01.447+0000 7f354be00640 1 --2- 172.21.15.50:0/3596282720 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f354c1099e0 0x7f354c110210 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:01.450 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:01.447+0000 7f354be00640 1 --2- 172.21.15.50:0/3596282720 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f354c103750 0x7f354c103b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:01.450 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:01.447+0000 7f354be00640 1 -- 172.21.15.50:0/3596282720 >> 172.21.15.50:0/3596282720 conn(0x7f354c0ff1e0 msgr2=0x7f354c101630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:22:01.450 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:01.448+0000 7f354be00640 1 -- 172.21.15.50:0/3596282720 shutdown_connections 2024-08-31T04:22:01.450 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:01.448+0000 7f354be00640 1 -- 172.21.15.50:0/3596282720 wait complete. 2024-08-31T04:22:01.451 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:01.449+0000 7f354be00640 1 Processor -- start 2024-08-31T04:22:01.452 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:01.449+0000 7f354be00640 1 -- start start 2024-08-31T04:22:01.452 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:01.449+0000 7f354be00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f354c103750 0x7f354c19c2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:01.452 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:01.449+0000 7f354be00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f354c109090 0x7f354c19c840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:01.452 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:01.449+0000 7f354be00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f354c1099e0 0x7f354c1a1ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:01.452 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:01.449+0000 7f354be00640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f354c1136b0 con 0x7f354c1099e0 2024-08-31T04:22:01.452 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:01.449+0000 7f354be00640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f354c113530 con 0x7f354c103750 2024-08-31T04:22:01.452 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:01.449+0000 7f354be00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f354c113830 con 0x7f354c109090 2024-08-31T04:22:01.452 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:01.450+0000 7f354b400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f354c1099e0 0x7f354c1a1ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:22:01.452 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:01.450+0000 7f354b400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f354c1099e0 0x7f354c1a1ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48254/0 (socket says 172.21.15.50:48254) 2024-08-31T04:22:01.452 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:01.450+0000 7f3543e00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f354c109090 0x7f354c19c840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:22:01.452 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:01.450+0000 7f354b400640 1 -- 172.21.15.50:0/2802869647 learned_addr learned my addr 172.21.15.50:0/2802869647 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:22:01.453 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:01.450+0000 7f354aa00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f354c103750 0x7f354c19c2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:22:01.453 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:01.450+0000 7f3543e00640 1 -- 172.21.15.50:0/2802869647 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f354c103750 msgr2=0x7f354c19c2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:22:01.453 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:01.450+0000 7f3543e00640 1 --2- 172.21.15.50:0/2802869647 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f354c103750 0x7f354c19c2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:01.453 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:01.450+0000 7f3543e00640 1 -- 172.21.15.50:0/2802869647 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f354c1099e0 msgr2=0x7f354c1a1ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:22:01.453 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:01.450+0000 7f3543e00640 1 --2- 172.21.15.50:0/2802869647 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f354c1099e0 0x7f354c1a1ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:01.453 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:01.450+0000 7f3543e00640 1 -- 172.21.15.50:0/2802869647 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f354c1a2210 con 0x7f354c109090 2024-08-31T04:22:01.453 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:01.450+0000 7f354b400640 1 --2- 172.21.15.50:0/2802869647 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f354c1099e0 0x7f354c1a1ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:22:01.453 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:01.451+0000 7f3543e00640 1 --2- 172.21.15.50:0/2802869647 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f354c109090 0x7f354c19c840 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f354c06b730 tx=0x7f353400ee50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:22:01.454 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:01.451+0000 7f3550a00640 1 -- 172.21.15.50:0/2802869647 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f353400cc40 con 0x7f354c109090 2024-08-31T04:22:01.454 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:01.451+0000 7f354be00640 1 -- 172.21.15.50:0/2802869647 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f354c1a2500 con 0x7f354c109090 2024-08-31T04:22:01.454 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:01.451+0000 7f3550a00640 1 -- 172.21.15.50:0/2802869647 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f353400cde0 con 0x7f354c109090 2024-08-31T04:22:01.454 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:01.451+0000 7f3550a00640 1 -- 172.21.15.50:0/2802869647 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3534004a00 con 0x7f354c109090 2024-08-31T04:22:01.454 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:01.451+0000 7f354be00640 1 -- 172.21.15.50:0/2802869647 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f354c1a8c60 con 0x7f354c109090 2024-08-31T04:22:01.454 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:01.452+0000 7f354be00640 1 -- 172.21.15.50:0/2802869647 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f354c103b60 con 0x7f354c109090 2024-08-31T04:22:01.456 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:01.455+0000 7f3550a00640 1 -- 172.21.15.50:0/2802869647 <== mon.1 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 17) ==== 152628+0+0 (secure 0 0 0) 0x7f3534004ba0 con 0x7f354c109090 2024-08-31T04:22:01.457 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:01.456+0000 7f3550a00640 1 --2- 172.21.15.50:0/2802869647 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f35300b4bc0 0x7f35300b70d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:01.458 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:01.456+0000 7f3550a00640 1 -- 172.21.15.50:0/2802869647 <== mon.1 v2:172.21.15.177:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8219+0+0 (secure 0 0 0) 0x7f35340e5260 con 0x7f354c109090 2024-08-31T04:22:01.458 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:01.456+0000 7f354aa00640 1 --2- 172.21.15.50:0/2802869647 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f35300b4bc0 0x7f35300b70d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:22:01.458 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:01.457+0000 7f354aa00640 1 --2- 172.21.15.50:0/2802869647 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f35300b4bc0 0x7f35300b70d0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f353c009bd0 tx=0x7f353c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:22:01.461 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:01.460+0000 7f3550a00640 1 -- 172.21.15.50:0/2802869647 <== mon.1 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f35340ac1e0 con 0x7f354c109090 2024-08-31T04:22:01.655 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:01.653+0000 7f354be00640 1 -- 172.21.15.50:0/2802869647 --> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f354c10fbf0 con 0x7f35300b4bc0 2024-08-31T04:22:01.655 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:22:01 smithi050 ceph-mon[17259]: pgmap v340: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-08-31T04:22:01.659 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:01.658+0000 7f3550a00640 1 -- 172.21.15.50:0/2802869647 <== mgr.14150 v2:172.21.15.50:6800/2146686622 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258853 (secure 0 0 0) 0x7f354c10fbf0 con 0x7f35300b4bc0 2024-08-31T04:22:01.664 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-08-31T04:22:01.665 INFO:teuthology.orchestra.run.smithi050.stderr:dumped all 2024-08-31T04:22:01.669 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:01.663+0000 7f354be00640 1 -- 172.21.15.50:0/2802869647 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f35300b4bc0 msgr2=0x7f35300b70d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:22:01.669 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:01.663+0000 7f354be00640 1 --2- 172.21.15.50:0/2802869647 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f35300b4bc0 0x7f35300b70d0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f353c009bd0 tx=0x7f353c005f90 comp rx=0 tx=0).stop 2024-08-31T04:22:01.670 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:01.663+0000 7f354be00640 1 -- 172.21.15.50:0/2802869647 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f354c109090 msgr2=0x7f354c19c840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:22:01.670 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:01.663+0000 7f354be00640 1 --2- 172.21.15.50:0/2802869647 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f354c109090 0x7f354c19c840 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f354c06b730 tx=0x7f353400ee50 comp rx=0 tx=0).stop 2024-08-31T04:22:01.670 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:01.663+0000 7f354be00640 1 -- 172.21.15.50:0/2802869647 shutdown_connections 2024-08-31T04:22:01.670 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:01.663+0000 7f354be00640 1 --2- 172.21.15.50:0/2802869647 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f35300b4bc0 0x7f35300b70d0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:01.670 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:01.663+0000 7f354be00640 1 --2- 172.21.15.50:0/2802869647 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f354c109090 0x7f354c19c840 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:01.670 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:01.663+0000 7f354be00640 1 --2- 172.21.15.50:0/2802869647 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f354c1099e0 0x7f354c1a1ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:01.670 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:01.663+0000 7f354be00640 1 --2- 172.21.15.50:0/2802869647 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f354c103750 0x7f354c19c2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:01.670 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:01.663+0000 7f354be00640 1 -- 172.21.15.50:0/2802869647 >> 172.21.15.50:0/2802869647 conn(0x7f354c0ff1e0 msgr2=0x7f354c10e4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:22:01.670 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:01.663+0000 7f354be00640 1 -- 172.21.15.50:0/2802869647 shutdown_connections 2024-08-31T04:22:01.670 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:01.663+0000 7f354be00640 1 -- 172.21.15.50:0/2802869647 wait complete. 2024-08-31T04:22:01.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:22:01 smithi177 ceph-mon[22025]: pgmap v340: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-08-31T04:22:01.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:22:01 smithi133 ceph-mon[22177]: pgmap v340: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-08-31T04:22:02.551 INFO:teuthology.orchestra.run.smithi050.stdout:{"pg_ready":true,"pg_map":{"version":340,"stamp":"2024-08-31T04:21:59.867646+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":657959,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":666,"num_read_kb":436,"num_write":372,"num_write_kb":2288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":2952462,"num_keys_recovered":10,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":306,"ondisk_log_size":306,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":359760,"kb_used_data":10512,"kb_used_omap":18,"kb_used_meta":349037,"kb_avail":1124582064,"statfs":{"total":1151940427776,"available":1151572033536,"internally_reserved":0,"allocated":10764288,"data_stored":6918753,"data_compressed":109023,"data_compressed_allocated":135168,"data_compressed_original":1769472,"omap_allocated":19143,"internal_metadata":357414201},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":105,"num_read_kb":55,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003296"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":21,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:20:57.002034+0000","last_change":"2024-08-31T04:20:42.949771+0000","last_active":"2024-08-31T04:20:57.002034+0000","last_peered":"2024-08-31T04:20:57.002034+0000","last_clean":"2024-08-31T04:20:57.002034+0000","last_became_active":"2024-08-31T04:20:42.949372+0000","last_became_peered":"2024-08-31T04:20:42.949372+0000","last_unstale":"2024-08-31T04:20:57.002034+0000","last_undegraded":"2024-08-31T04:20:57.002034+0000","last_fullsized":"2024-08-31T04:20:57.002034+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:16:50.036191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":21,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:20:57.001502+0000","last_change":"2024-08-31T04:20:42.949805+0000","last_active":"2024-08-31T04:20:57.001502+0000","last_peered":"2024-08-31T04:20:57.001502+0000","last_clean":"2024-08-31T04:20:57.001502+0000","last_became_active":"2024-08-31T04:20:42.948015+0000","last_became_peered":"2024-08-31T04:20:42.948015+0000","last_unstale":"2024-08-31T04:20:57.001502+0000","last_undegraded":"2024-08-31T04:20:57.001502+0000","last_fullsized":"2024-08-31T04:20:57.001502+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:25:47.432785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":21,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:20:57.001526+0000","last_change":"2024-08-31T04:20:42.949114+0000","last_active":"2024-08-31T04:20:57.001526+0000","last_peered":"2024-08-31T04:20:57.001526+0000","last_clean":"2024-08-31T04:20:57.001526+0000","last_became_active":"2024-08-31T04:20:42.946763+0000","last_became_peered":"2024-08-31T04:20:42.946763+0000","last_unstale":"2024-08-31T04:20:57.001526+0000","last_undegraded":"2024-08-31T04:20:57.001526+0000","last_fullsized":"2024-08-31T04:20:57.001526+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:33:55.605617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":21,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:20:56.999162+0000","last_change":"2024-08-31T04:20:42.935026+0000","last_active":"2024-08-31T04:20:56.999162+0000","last_peered":"2024-08-31T04:20:56.999162+0000","last_clean":"2024-08-31T04:20:56.999162+0000","last_became_active":"2024-08-31T04:20:42.934534+0000","last_became_peered":"2024-08-31T04:20:42.934534+0000","last_unstale":"2024-08-31T04:20:56.999162+0000","last_undegraded":"2024-08-31T04:20:56.999162+0000","last_fullsized":"2024-08-31T04:20:56.999162+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:33:41.014920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":21,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:20:57.006160+0000","last_change":"2024-08-31T04:20:42.939114+0000","last_active":"2024-08-31T04:20:57.006160+0000","last_peered":"2024-08-31T04:20:57.006160+0000","last_clean":"2024-08-31T04:20:57.006160+0000","last_became_active":"2024-08-31T04:20:42.938710+0000","last_became_peered":"2024-08-31T04:20:42.938710+0000","last_unstale":"2024-08-31T04:20:57.006160+0000","last_undegraded":"2024-08-31T04:20:57.006160+0000","last_fullsized":"2024-08-31T04:20:57.006160+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:42:25.561258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":21,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:20:57.001416+0000","last_change":"2024-08-31T04:20:42.935958+0000","last_active":"2024-08-31T04:20:57.001416+0000","last_peered":"2024-08-31T04:20:57.001416+0000","last_clean":"2024-08-31T04:20:57.001416+0000","last_became_active":"2024-08-31T04:20:42.934865+0000","last_became_peered":"2024-08-31T04:20:42.934865+0000","last_unstale":"2024-08-31T04:20:57.001416+0000","last_undegraded":"2024-08-31T04:20:57.001416+0000","last_fullsized":"2024-08-31T04:20:57.001416+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:28:20.330784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":21,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:20:57.003213+0000","last_change":"2024-08-31T04:20:42.932639+0000","last_active":"2024-08-31T04:20:57.003213+0000","last_peered":"2024-08-31T04:20:57.003213+0000","last_clean":"2024-08-31T04:20:57.003213+0000","last_became_active":"2024-08-31T04:20:42.932238+0000","last_became_peered":"2024-08-31T04:20:42.932238+0000","last_unstale":"2024-08-31T04:20:57.003213+0000","last_undegraded":"2024-08-31T04:20:57.003213+0000","last_fullsized":"2024-08-31T04:20:57.003213+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T04:47:32.128675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":21,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:20:57.338218+0000","last_change":"2024-08-31T04:20:42.941700+0000","last_active":"2024-08-31T04:20:57.338218+0000","last_peered":"2024-08-31T04:20:57.338218+0000","last_clean":"2024-08-31T04:20:57.338218+0000","last_became_active":"2024-08-31T04:20:42.941308+0000","last_became_peered":"2024-08-31T04:20:42.941308+0000","last_unstale":"2024-08-31T04:20:57.338218+0000","last_undegraded":"2024-08-31T04:20:57.338218+0000","last_fullsized":"2024-08-31T04:20:57.338218+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:35:06.058492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":21,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:20:57.223342+0000","last_change":"2024-08-31T04:20:42.935528+0000","last_active":"2024-08-31T04:20:57.223342+0000","last_peered":"2024-08-31T04:20:57.223342+0000","last_clean":"2024-08-31T04:20:57.223342+0000","last_became_active":"2024-08-31T04:20:42.933736+0000","last_became_peered":"2024-08-31T04:20:42.933736+0000","last_unstale":"2024-08-31T04:20:57.223342+0000","last_undegraded":"2024-08-31T04:20:57.223342+0000","last_fullsized":"2024-08-31T04:20:57.223342+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:12:47.877285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":28,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:20:57.006811+0000","last_change":"2024-08-31T04:20:57.006683+0000","last_active":"2024-08-31T04:20:57.006811+0000","last_peered":"2024-08-31T04:20:57.006811+0000","last_clean":"2024-08-31T04:20:57.006811+0000","last_became_active":"2024-08-31T04:20:57.006166+0000","last_became_peered":"2024-08-31T04:20:57.006166+0000","last_unstale":"2024-08-31T04:20:57.006811+0000","last_undegraded":"2024-08-31T04:20:57.006811+0000","last_fullsized":"2024-08-31T04:20:57.006811+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:33:23.377991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,9],"acting":[10,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":21,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:20:57.003953+0000","last_change":"2024-08-31T04:20:42.939489+0000","last_active":"2024-08-31T04:20:57.003953+0000","last_peered":"2024-08-31T04:20:57.003953+0000","last_clean":"2024-08-31T04:20:57.003953+0000","last_became_active":"2024-08-31T04:20:42.939138+0000","last_became_peered":"2024-08-31T04:20:42.939138+0000","last_unstale":"2024-08-31T04:20:57.003953+0000","last_undegraded":"2024-08-31T04:20:57.003953+0000","last_fullsized":"2024-08-31T04:20:57.003953+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T05:00:30.196513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":21,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:20:56.999241+0000","last_change":"2024-08-31T04:20:42.941483+0000","last_active":"2024-08-31T04:20:56.999241+0000","last_peered":"2024-08-31T04:20:56.999241+0000","last_clean":"2024-08-31T04:20:56.999241+0000","last_became_active":"2024-08-31T04:20:42.940200+0000","last_became_peered":"2024-08-31T04:20:42.940200+0000","last_unstale":"2024-08-31T04:20:56.999241+0000","last_undegraded":"2024-08-31T04:20:56.999241+0000","last_fullsized":"2024-08-31T04:20:56.999241+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:40:45.235093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":21,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:20:56.998469+0000","last_change":"2024-08-31T04:20:42.928803+0000","last_active":"2024-08-31T04:20:56.998469+0000","last_peered":"2024-08-31T04:20:56.998469+0000","last_clean":"2024-08-31T04:20:56.998469+0000","last_became_active":"2024-08-31T04:20:42.928410+0000","last_became_peered":"2024-08-31T04:20:42.928410+0000","last_unstale":"2024-08-31T04:20:56.998469+0000","last_undegraded":"2024-08-31T04:20:56.998469+0000","last_fullsized":"2024-08-31T04:20:56.998469+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T04:24:41.811202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":21,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:20:57.001244+0000","last_change":"2024-08-31T04:20:42.945142+0000","last_active":"2024-08-31T04:20:57.001244+0000","last_peered":"2024-08-31T04:20:57.001244+0000","last_clean":"2024-08-31T04:20:57.001244+0000","last_became_active":"2024-08-31T04:20:42.944061+0000","last_became_peered":"2024-08-31T04:20:42.944061+0000","last_unstale":"2024-08-31T04:20:57.001244+0000","last_undegraded":"2024-08-31T04:20:57.001244+0000","last_fullsized":"2024-08-31T04:20:57.001244+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:55:09.045257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":21,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:20:57.001166+0000","last_change":"2024-08-31T04:20:42.945844+0000","last_active":"2024-08-31T04:20:57.001166+0000","last_peered":"2024-08-31T04:20:57.001166+0000","last_clean":"2024-08-31T04:20:57.001166+0000","last_became_active":"2024-08-31T04:20:42.944186+0000","last_became_peered":"2024-08-31T04:20:42.944186+0000","last_unstale":"2024-08-31T04:20:57.001166+0000","last_undegraded":"2024-08-31T04:20:57.001166+0000","last_fullsized":"2024-08-31T04:20:57.001166+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:32:46.878700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":21,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:20:57.222782+0000","last_change":"2024-08-31T04:20:42.952871+0000","last_active":"2024-08-31T04:20:57.222782+0000","last_peered":"2024-08-31T04:20:57.222782+0000","last_clean":"2024-08-31T04:20:57.222782+0000","last_became_active":"2024-08-31T04:20:42.952531+0000","last_became_peered":"2024-08-31T04:20:42.952531+0000","last_unstale":"2024-08-31T04:20:57.222782+0000","last_undegraded":"2024-08-31T04:20:57.222782+0000","last_fullsized":"2024-08-31T04:20:57.222782+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:26:01.690119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":21,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:20:57.002008+0000","last_change":"2024-08-31T04:20:42.949822+0000","last_active":"2024-08-31T04:20:57.002008+0000","last_peered":"2024-08-31T04:20:57.002008+0000","last_clean":"2024-08-31T04:20:57.002008+0000","last_became_active":"2024-08-31T04:20:42.949443+0000","last_became_peered":"2024-08-31T04:20:42.949443+0000","last_unstale":"2024-08-31T04:20:57.002008+0000","last_undegraded":"2024-08-31T04:20:57.002008+0000","last_fullsized":"2024-08-31T04:20:57.002008+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:35:48.270606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":21,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:20:57.004840+0000","last_change":"2024-08-31T04:20:42.940895+0000","last_active":"2024-08-31T04:20:57.004840+0000","last_peered":"2024-08-31T04:20:57.004840+0000","last_clean":"2024-08-31T04:20:57.004840+0000","last_became_active":"2024-08-31T04:20:42.940489+0000","last_became_peered":"2024-08-31T04:20:42.940489+0000","last_unstale":"2024-08-31T04:20:57.004840+0000","last_undegraded":"2024-08-31T04:20:57.004840+0000","last_fullsized":"2024-08-31T04:20:57.004840+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T04:42:20.269895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":21,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:20:57.004087+0000","last_change":"2024-08-31T04:20:42.935303+0000","last_active":"2024-08-31T04:20:57.004087+0000","last_peered":"2024-08-31T04:20:57.004087+0000","last_clean":"2024-08-31T04:20:57.004087+0000","last_became_active":"2024-08-31T04:20:42.934931+0000","last_became_peered":"2024-08-31T04:20:42.934931+0000","last_unstale":"2024-08-31T04:20:57.004087+0000","last_undegraded":"2024-08-31T04:20:57.004087+0000","last_fullsized":"2024-08-31T04:20:57.004087+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:34:40.767333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":21,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:20:57.000940+0000","last_change":"2024-08-31T04:20:42.941518+0000","last_active":"2024-08-31T04:20:57.000940+0000","last_peered":"2024-08-31T04:20:57.000940+0000","last_clean":"2024-08-31T04:20:57.000940+0000","last_became_active":"2024-08-31T04:20:42.941142+0000","last_became_peered":"2024-08-31T04:20:42.941142+0000","last_unstale":"2024-08-31T04:20:57.000940+0000","last_undegraded":"2024-08-31T04:20:57.000940+0000","last_fullsized":"2024-08-31T04:20:57.000940+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:27:50.274057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":21,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:20:56.998500+0000","last_change":"2024-08-31T04:20:42.945136+0000","last_active":"2024-08-31T04:20:56.998500+0000","last_peered":"2024-08-31T04:20:56.998500+0000","last_clean":"2024-08-31T04:20:56.998500+0000","last_became_active":"2024-08-31T04:20:42.944811+0000","last_became_peered":"2024-08-31T04:20:42.944811+0000","last_unstale":"2024-08-31T04:20:56.998500+0000","last_undegraded":"2024-08-31T04:20:56.998500+0000","last_fullsized":"2024-08-31T04:20:56.998500+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:30:47.496668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":21,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:20:57.222956+0000","last_change":"2024-08-31T04:20:42.930854+0000","last_active":"2024-08-31T04:20:57.222956+0000","last_peered":"2024-08-31T04:20:57.222956+0000","last_clean":"2024-08-31T04:20:57.222956+0000","last_became_active":"2024-08-31T04:20:42.930490+0000","last_became_peered":"2024-08-31T04:20:42.930490+0000","last_unstale":"2024-08-31T04:20:57.222956+0000","last_undegraded":"2024-08-31T04:20:57.222956+0000","last_fullsized":"2024-08-31T04:20:57.222956+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:16:17.611414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:20:57.009435+0000","last_change":"2024-08-31T04:20:57.008738+0000","last_active":"2024-08-31T04:20:57.009435+0000","last_peered":"2024-08-31T04:20:57.009435+0000","last_clean":"2024-08-31T04:20:57.009435+0000","last_became_active":"2024-08-31T04:20:57.008209+0000","last_became_peered":"2024-08-31T04:20:57.008209+0000","last_unstale":"2024-08-31T04:20:57.009435+0000","last_undegraded":"2024-08-31T04:20:57.009435+0000","last_fullsized":"2024-08-31T04:20:57.009435+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T05:26:22.508955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,11],"acting":[9,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":21,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:20:56.999443+0000","last_change":"2024-08-31T04:20:42.939859+0000","last_active":"2024-08-31T04:20:56.999443+0000","last_peered":"2024-08-31T04:20:56.999443+0000","last_clean":"2024-08-31T04:20:56.999443+0000","last_became_active":"2024-08-31T04:20:42.938315+0000","last_became_peered":"2024-08-31T04:20:42.938315+0000","last_unstale":"2024-08-31T04:20:56.999443+0000","last_undegraded":"2024-08-31T04:20:56.999443+0000","last_fullsized":"2024-08-31T04:20:56.999443+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:13:00.906454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":21,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:20:57.338551+0000","last_change":"2024-08-31T04:20:42.941861+0000","last_active":"2024-08-31T04:20:57.338551+0000","last_peered":"2024-08-31T04:20:57.338551+0000","last_clean":"2024-08-31T04:20:57.338551+0000","last_became_active":"2024-08-31T04:20:42.939556+0000","last_became_peered":"2024-08-31T04:20:42.939556+0000","last_unstale":"2024-08-31T04:20:57.338551+0000","last_undegraded":"2024-08-31T04:20:57.338551+0000","last_fullsized":"2024-08-31T04:20:57.338551+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:02:53.900917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":21,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:20:57.004438+0000","last_change":"2024-08-31T04:20:42.930792+0000","last_active":"2024-08-31T04:20:57.004438+0000","last_peered":"2024-08-31T04:20:57.004438+0000","last_clean":"2024-08-31T04:20:57.004438+0000","last_became_active":"2024-08-31T04:20:42.930014+0000","last_became_peered":"2024-08-31T04:20:42.930014+0000","last_unstale":"2024-08-31T04:20:57.004438+0000","last_undegraded":"2024-08-31T04:20:57.004438+0000","last_fullsized":"2024-08-31T04:20:57.004438+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:18:26.942604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":28,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:20:57.010285+0000","last_change":"2024-08-31T04:20:57.010093+0000","last_active":"2024-08-31T04:20:57.010285+0000","last_peered":"2024-08-31T04:20:57.010285+0000","last_clean":"2024-08-31T04:20:57.010285+0000","last_became_active":"2024-08-31T04:20:57.008759+0000","last_became_peered":"2024-08-31T04:20:57.008759+0000","last_unstale":"2024-08-31T04:20:57.010285+0000","last_undegraded":"2024-08-31T04:20:57.010285+0000","last_fullsized":"2024-08-31T04:20:57.010285+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T06:55:38.276668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,9],"acting":[11,8,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":21,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:20:56.998387+0000","last_change":"2024-08-31T04:20:42.953378+0000","last_active":"2024-08-31T04:20:56.998387+0000","last_peered":"2024-08-31T04:20:56.998387+0000","last_clean":"2024-08-31T04:20:56.998387+0000","last_became_active":"2024-08-31T04:20:42.953030+0000","last_became_peered":"2024-08-31T04:20:42.953030+0000","last_unstale":"2024-08-31T04:20:56.998387+0000","last_undegraded":"2024-08-31T04:20:56.998387+0000","last_fullsized":"2024-08-31T04:20:56.998387+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:24:46.633234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":21,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:20:57.001390+0000","last_change":"2024-08-31T04:20:42.945142+0000","last_active":"2024-08-31T04:20:57.001390+0000","last_peered":"2024-08-31T04:20:57.001390+0000","last_clean":"2024-08-31T04:20:57.001390+0000","last_became_active":"2024-08-31T04:20:42.943960+0000","last_became_peered":"2024-08-31T04:20:42.943960+0000","last_unstale":"2024-08-31T04:20:57.001390+0000","last_undegraded":"2024-08-31T04:20:57.001390+0000","last_fullsized":"2024-08-31T04:20:57.001390+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T04:29:10.501940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":21,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:20:57.003852+0000","last_change":"2024-08-31T04:20:42.946359+0000","last_active":"2024-08-31T04:20:57.003852+0000","last_peered":"2024-08-31T04:20:57.003852+0000","last_clean":"2024-08-31T04:20:57.003852+0000","last_became_active":"2024-08-31T04:20:42.945974+0000","last_became_peered":"2024-08-31T04:20:42.945974+0000","last_unstale":"2024-08-31T04:20:57.003852+0000","last_undegraded":"2024-08-31T04:20:57.003852+0000","last_fullsized":"2024-08-31T04:20:57.003852+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:01:27.808743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":21,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:20:57.003936+0000","last_change":"2024-08-31T04:20:42.930989+0000","last_active":"2024-08-31T04:20:57.003936+0000","last_peered":"2024-08-31T04:20:57.003936+0000","last_clean":"2024-08-31T04:20:57.003936+0000","last_became_active":"2024-08-31T04:20:42.930610+0000","last_became_peered":"2024-08-31T04:20:42.930610+0000","last_unstale":"2024-08-31T04:20:57.003936+0000","last_undegraded":"2024-08-31T04:20:57.003936+0000","last_fullsized":"2024-08-31T04:20:57.003936+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:01:49.473735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":21,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:20:57.001181+0000","last_change":"2024-08-31T04:20:42.930513+0000","last_active":"2024-08-31T04:20:57.001181+0000","last_peered":"2024-08-31T04:20:57.001181+0000","last_clean":"2024-08-31T04:20:57.001181+0000","last_became_active":"2024-08-31T04:20:42.930127+0000","last_became_peered":"2024-08-31T04:20:42.930127+0000","last_unstale":"2024-08-31T04:20:57.001181+0000","last_undegraded":"2024-08-31T04:20:57.001181+0000","last_fullsized":"2024-08-31T04:20:57.001181+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T05:19:55.307816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":21,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:20:57.005865+0000","last_change":"2024-08-31T04:20:42.928217+0000","last_active":"2024-08-31T04:20:57.005865+0000","last_peered":"2024-08-31T04:20:57.005865+0000","last_clean":"2024-08-31T04:20:57.005865+0000","last_became_active":"2024-08-31T04:20:42.927828+0000","last_became_peered":"2024-08-31T04:20:42.927828+0000","last_unstale":"2024-08-31T04:20:57.005865+0000","last_undegraded":"2024-08-31T04:20:57.005865+0000","last_fullsized":"2024-08-31T04:20:57.005865+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:53:21.266734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"78'6","reported_seq":102,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:21:53.139061+0000","last_change":"2024-08-31T04:20:57.229930+0000","last_active":"2024-08-31T04:21:53.139061+0000","last_peered":"2024-08-31T04:21:53.139061+0000","last_clean":"2024-08-31T04:21:53.139061+0000","last_became_active":"2024-08-31T04:20:57.224761+0000","last_became_peered":"2024-08-31T04:20:57.224761+0000","last_unstale":"2024-08-31T04:21:53.139061+0000","last_undegraded":"2024-08-31T04:21:53.139061+0000","last_fullsized":"2024-08-31T04:21:53.139061+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_clean_scrub_stamp":"2024-08-31T04:20:38.871450+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:07:41.723452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1013,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":56,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":622,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":21,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:20:57.000491+0000","last_change":"2024-08-31T04:20:42.939189+0000","last_active":"2024-08-31T04:20:57.000491+0000","last_peered":"2024-08-31T04:20:57.000491+0000","last_clean":"2024-08-31T04:20:57.000491+0000","last_became_active":"2024-08-31T04:20:42.938817+0000","last_became_peered":"2024-08-31T04:20:42.938817+0000","last_unstale":"2024-08-31T04:20:57.000491+0000","last_undegraded":"2024-08-31T04:20:57.000491+0000","last_fullsized":"2024-08-31T04:20:57.000491+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:19:04.407104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"77'7","reported_seq":34,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:20:57.001432+0000","last_change":"2024-08-31T04:20:39.904392+0000","last_active":"2024-08-31T04:20:57.001432+0000","last_peered":"2024-08-31T04:20:57.001432+0000","last_clean":"2024-08-31T04:20:57.001432+0000","last_became_active":"2024-08-31T04:20:39.904014+0000","last_became_peered":"2024-08-31T04:20:39.904014+0000","last_unstale":"2024-08-31T04:20:57.001432+0000","last_undegraded":"2024-08-31T04:20:57.001432+0000","last_fullsized":"2024-08-31T04:20:57.001432+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_clean_scrub_stamp":"2024-08-31T04:20:38.871450+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:33:56.591237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"78'3","reported_seq":30,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:20:56.998239+0000","last_change":"2024-08-31T04:20:39.899521+0000","last_active":"2024-08-31T04:20:56.998239+0000","last_peered":"2024-08-31T04:20:56.998239+0000","last_clean":"2024-08-31T04:20:56.998239+0000","last_became_active":"2024-08-31T04:20:39.899157+0000","last_became_peered":"2024-08-31T04:20:39.899157+0000","last_unstale":"2024-08-31T04:20:56.998239+0000","last_undegraded":"2024-08-31T04:20:56.998239+0000","last_fullsized":"2024-08-31T04:20:56.998239+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_clean_scrub_stamp":"2024-08-31T04:20:38.871450+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:14:47.067149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":21,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:20:57.338276+0000","last_change":"2024-08-31T04:20:42.950653+0000","last_active":"2024-08-31T04:20:57.338276+0000","last_peered":"2024-08-31T04:20:57.338276+0000","last_clean":"2024-08-31T04:20:57.338276+0000","last_became_active":"2024-08-31T04:20:42.949627+0000","last_became_peered":"2024-08-31T04:20:42.949627+0000","last_unstale":"2024-08-31T04:20:57.338276+0000","last_undegraded":"2024-08-31T04:20:57.338276+0000","last_fullsized":"2024-08-31T04:20:57.338276+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:22:00.000717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"78'3","reported_seq":31,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:21:01.048385+0000","last_change":"2024-08-31T04:20:39.908013+0000","last_active":"2024-08-31T04:21:01.048385+0000","last_peered":"2024-08-31T04:21:01.048385+0000","last_clean":"2024-08-31T04:21:01.048385+0000","last_became_active":"2024-08-31T04:20:39.907482+0000","last_became_peered":"2024-08-31T04:20:39.907482+0000","last_unstale":"2024-08-31T04:21:01.048385+0000","last_undegraded":"2024-08-31T04:21:01.048385+0000","last_fullsized":"2024-08-31T04:21:01.048385+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_clean_scrub_stamp":"2024-08-31T04:20:38.871450+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:50:35.466407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":21,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:20:57.004374+0000","last_change":"2024-08-31T04:20:42.944674+0000","last_active":"2024-08-31T04:20:57.004374+0000","last_peered":"2024-08-31T04:20:57.004374+0000","last_clean":"2024-08-31T04:20:57.004374+0000","last_became_active":"2024-08-31T04:20:42.944424+0000","last_became_peered":"2024-08-31T04:20:42.944424+0000","last_unstale":"2024-08-31T04:20:57.004374+0000","last_undegraded":"2024-08-31T04:20:57.004374+0000","last_fullsized":"2024-08-31T04:20:57.004374+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:10:27.772835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"77'4","reported_seq":141,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:21:56.143070+0000","last_change":"2024-08-31T04:20:39.904188+0000","last_active":"2024-08-31T04:21:56.143070+0000","last_peered":"2024-08-31T04:21:56.143070+0000","last_clean":"2024-08-31T04:21:56.143070+0000","last_became_active":"2024-08-31T04:20:39.903789+0000","last_became_peered":"2024-08-31T04:20:39.903789+0000","last_unstale":"2024-08-31T04:21:56.143070+0000","last_undegraded":"2024-08-31T04:21:56.143070+0000","last_fullsized":"2024-08-31T04:21:56.143070+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_clean_scrub_stamp":"2024-08-31T04:20:38.871450+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T06:54:38.881746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":110,"num_read_kb":110,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":21,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:20:57.223134+0000","last_change":"2024-08-31T04:20:42.932961+0000","last_active":"2024-08-31T04:20:57.223134+0000","last_peered":"2024-08-31T04:20:57.223134+0000","last_clean":"2024-08-31T04:20:57.223134+0000","last_became_active":"2024-08-31T04:20:42.932562+0000","last_became_peered":"2024-08-31T04:20:42.932562+0000","last_unstale":"2024-08-31T04:20:57.223134+0000","last_undegraded":"2024-08-31T04:20:57.223134+0000","last_fullsized":"2024-08-31T04:20:57.223134+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:20:36.827300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"78'4","reported_seq":31,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:21:01.049286+0000","last_change":"2024-08-31T04:20:39.902279+0000","last_active":"2024-08-31T04:21:01.049286+0000","last_peered":"2024-08-31T04:21:01.049286+0000","last_clean":"2024-08-31T04:21:01.049286+0000","last_became_active":"2024-08-31T04:20:39.901822+0000","last_became_peered":"2024-08-31T04:20:39.901822+0000","last_unstale":"2024-08-31T04:21:01.049286+0000","last_undegraded":"2024-08-31T04:21:01.049286+0000","last_fullsized":"2024-08-31T04:21:01.049286+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_clean_scrub_stamp":"2024-08-31T04:20:38.871450+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:48:09.609644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":28,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:20:57.009187+0000","last_change":"2024-08-31T04:20:57.008955+0000","last_active":"2024-08-31T04:20:57.009187+0000","last_peered":"2024-08-31T04:20:57.009187+0000","last_clean":"2024-08-31T04:20:57.009187+0000","last_became_active":"2024-08-31T04:20:57.008487+0000","last_became_peered":"2024-08-31T04:20:57.008487+0000","last_unstale":"2024-08-31T04:20:57.009187+0000","last_undegraded":"2024-08-31T04:20:57.009187+0000","last_fullsized":"2024-08-31T04:20:57.009187+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:26:23.399089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,5],"acting":[0,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"77'5","reported_seq":33,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:20:56.999868+0000","last_change":"2024-08-31T04:20:39.992197+0000","last_active":"2024-08-31T04:20:56.999868+0000","last_peered":"2024-08-31T04:20:56.999868+0000","last_clean":"2024-08-31T04:20:56.999868+0000","last_became_active":"2024-08-31T04:20:39.991835+0000","last_became_peered":"2024-08-31T04:20:39.991835+0000","last_unstale":"2024-08-31T04:20:56.999868+0000","last_undegraded":"2024-08-31T04:20:56.999868+0000","last_fullsized":"2024-08-31T04:20:56.999868+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_clean_scrub_stamp":"2024-08-31T04:20:38.871450+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:38:02.808469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":21,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:20:57.223159+0000","last_change":"2024-08-31T04:20:42.934874+0000","last_active":"2024-08-31T04:20:57.223159+0000","last_peered":"2024-08-31T04:20:57.223159+0000","last_clean":"2024-08-31T04:20:57.223159+0000","last_became_active":"2024-08-31T04:20:42.934500+0000","last_became_peered":"2024-08-31T04:20:42.934500+0000","last_unstale":"2024-08-31T04:20:57.223159+0000","last_undegraded":"2024-08-31T04:20:57.223159+0000","last_fullsized":"2024-08-31T04:20:57.223159+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:32:59.785563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"78'31","reported_seq":177,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:21:56.143134+0000","last_change":"2024-08-31T04:20:39.907452+0000","last_active":"2024-08-31T04:21:56.143134+0000","last_peered":"2024-08-31T04:21:56.143134+0000","last_clean":"2024-08-31T04:21:56.143134+0000","last_became_active":"2024-08-31T04:20:39.907071+0000","last_became_peered":"2024-08-31T04:20:39.907071+0000","last_unstale":"2024-08-31T04:21:56.143134+0000","last_undegraded":"2024-08-31T04:21:56.143134+0000","last_fullsized":"2024-08-31T04:21:56.143134+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_clean_scrub_stamp":"2024-08-31T04:20:38.871450+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:21:33.318332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":59762,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":119,"num_read_kb":117,"num_write":33,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":21,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:20:57.006637+0000","last_change":"2024-08-31T04:20:42.937750+0000","last_active":"2024-08-31T04:20:57.006637+0000","last_peered":"2024-08-31T04:20:57.006637+0000","last_clean":"2024-08-31T04:20:57.006637+0000","last_became_active":"2024-08-31T04:20:42.937386+0000","last_became_peered":"2024-08-31T04:20:42.937386+0000","last_unstale":"2024-08-31T04:20:57.006637+0000","last_undegraded":"2024-08-31T04:20:57.006637+0000","last_fullsized":"2024-08-31T04:20:57.006637+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:14:03.123558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"78'9","reported_seq":38,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:21:02.054531+0000","last_change":"2024-08-31T04:20:39.902815+0000","last_active":"2024-08-31T04:21:02.054531+0000","last_peered":"2024-08-31T04:21:02.054531+0000","last_clean":"2024-08-31T04:21:02.054531+0000","last_became_active":"2024-08-31T04:20:39.900473+0000","last_became_peered":"2024-08-31T04:20:39.900473+0000","last_unstale":"2024-08-31T04:21:02.054531+0000","last_undegraded":"2024-08-31T04:21:02.054531+0000","last_fullsized":"2024-08-31T04:21:02.054531+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_clean_scrub_stamp":"2024-08-31T04:20:38.871450+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:42:03.902102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":21,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:20:56.998214+0000","last_change":"2024-08-31T04:20:42.932333+0000","last_active":"2024-08-31T04:20:56.998214+0000","last_peered":"2024-08-31T04:20:56.998214+0000","last_clean":"2024-08-31T04:20:56.998214+0000","last_became_active":"2024-08-31T04:20:42.931902+0000","last_became_peered":"2024-08-31T04:20:42.931902+0000","last_unstale":"2024-08-31T04:20:56.998214+0000","last_undegraded":"2024-08-31T04:20:56.998214+0000","last_fullsized":"2024-08-31T04:20:56.998214+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:46:44.716941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"78'5","reported_seq":33,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:21:01.048755+0000","last_change":"2024-08-31T04:20:39.901541+0000","last_active":"2024-08-31T04:21:01.048755+0000","last_peered":"2024-08-31T04:21:01.048755+0000","last_clean":"2024-08-31T04:21:01.048755+0000","last_became_active":"2024-08-31T04:20:39.901116+0000","last_became_peered":"2024-08-31T04:20:39.901116+0000","last_unstale":"2024-08-31T04:21:01.048755+0000","last_undegraded":"2024-08-31T04:21:01.048755+0000","last_fullsized":"2024-08-31T04:21:01.048755+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_clean_scrub_stamp":"2024-08-31T04:20:38.871450+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:57:51.458017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":21,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:20:57.003686+0000","last_change":"2024-08-31T04:20:42.936355+0000","last_active":"2024-08-31T04:20:57.003686+0000","last_peered":"2024-08-31T04:20:57.003686+0000","last_clean":"2024-08-31T04:20:57.003686+0000","last_became_active":"2024-08-31T04:20:42.935975+0000","last_became_peered":"2024-08-31T04:20:42.935975+0000","last_unstale":"2024-08-31T04:20:57.003686+0000","last_undegraded":"2024-08-31T04:20:57.003686+0000","last_fullsized":"2024-08-31T04:20:57.003686+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:37:24.867700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"78'6","reported_seq":90,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:21:54.141268+0000","last_change":"2024-08-31T04:20:39.901314+0000","last_active":"2024-08-31T04:21:54.141268+0000","last_peered":"2024-08-31T04:21:54.141268+0000","last_clean":"2024-08-31T04:21:54.141268+0000","last_became_active":"2024-08-31T04:20:39.900780+0000","last_became_peered":"2024-08-31T04:20:39.900780+0000","last_unstale":"2024-08-31T04:21:54.141268+0000","last_undegraded":"2024-08-31T04:21:54.141268+0000","last_fullsized":"2024-08-31T04:21:54.141268+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_clean_scrub_stamp":"2024-08-31T04:20:38.871450+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:59:40.500765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":979,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":58,"num_read_kb":4,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":21,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:20:57.003241+0000","last_change":"2024-08-31T04:20:42.934382+0000","last_active":"2024-08-31T04:20:57.003241+0000","last_peered":"2024-08-31T04:20:57.003241+0000","last_clean":"2024-08-31T04:20:57.003241+0000","last_became_active":"2024-08-31T04:20:42.933986+0000","last_became_peered":"2024-08-31T04:20:42.933986+0000","last_unstale":"2024-08-31T04:20:57.003241+0000","last_undegraded":"2024-08-31T04:20:57.003241+0000","last_fullsized":"2024-08-31T04:20:57.003241+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:12:16.372504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"78'17","reported_seq":45,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:21:01.047381+0000","last_change":"2024-08-31T04:20:39.990817+0000","last_active":"2024-08-31T04:21:01.047381+0000","last_peered":"2024-08-31T04:21:01.047381+0000","last_clean":"2024-08-31T04:21:01.047381+0000","last_became_active":"2024-08-31T04:20:39.990379+0000","last_became_peered":"2024-08-31T04:20:39.990379+0000","last_unstale":"2024-08-31T04:21:01.047381+0000","last_undegraded":"2024-08-31T04:21:01.047381+0000","last_fullsized":"2024-08-31T04:21:01.047381+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_clean_scrub_stamp":"2024-08-31T04:20:38.871450+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:42:27.435142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":21,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:20:56.999443+0000","last_change":"2024-08-31T04:20:42.942430+0000","last_active":"2024-08-31T04:20:56.999443+0000","last_peered":"2024-08-31T04:20:56.999443+0000","last_clean":"2024-08-31T04:20:56.999443+0000","last_became_active":"2024-08-31T04:20:42.942067+0000","last_became_peered":"2024-08-31T04:20:42.942067+0000","last_unstale":"2024-08-31T04:20:56.999443+0000","last_undegraded":"2024-08-31T04:20:56.999443+0000","last_fullsized":"2024-08-31T04:20:56.999443+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:48:52.441499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"77'2","reported_seq":30,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:20:57.007144+0000","last_change":"2024-08-31T04:20:39.903815+0000","last_active":"2024-08-31T04:20:57.007144+0000","last_peered":"2024-08-31T04:20:57.007144+0000","last_clean":"2024-08-31T04:20:57.007144+0000","last_became_active":"2024-08-31T04:20:39.903183+0000","last_became_peered":"2024-08-31T04:20:39.903183+0000","last_unstale":"2024-08-31T04:20:57.007144+0000","last_undegraded":"2024-08-31T04:20:57.007144+0000","last_fullsized":"2024-08-31T04:20:57.007144+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_clean_scrub_stamp":"2024-08-31T04:20:38.871450+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:39:50.862711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":28,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:20:57.004968+0000","last_change":"2024-08-31T04:20:57.004852+0000","last_active":"2024-08-31T04:20:57.004968+0000","last_peered":"2024-08-31T04:20:57.004968+0000","last_clean":"2024-08-31T04:20:57.004968+0000","last_became_active":"2024-08-31T04:20:57.004435+0000","last_became_peered":"2024-08-31T04:20:57.004435+0000","last_unstale":"2024-08-31T04:20:57.004968+0000","last_undegraded":"2024-08-31T04:20:57.004968+0000","last_fullsized":"2024-08-31T04:20:57.004968+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T06:16:19.010305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,6],"acting":[11,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"78'5","reported_seq":32,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:21:01.047330+0000","last_change":"2024-08-31T04:20:39.901493+0000","last_active":"2024-08-31T04:21:01.047330+0000","last_peered":"2024-08-31T04:21:01.047330+0000","last_clean":"2024-08-31T04:21:01.047330+0000","last_became_active":"2024-08-31T04:20:39.901072+0000","last_became_peered":"2024-08-31T04:20:39.901072+0000","last_unstale":"2024-08-31T04:21:01.047330+0000","last_undegraded":"2024-08-31T04:21:01.047330+0000","last_fullsized":"2024-08-31T04:21:01.047330+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_clean_scrub_stamp":"2024-08-31T04:20:38.871450+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:26:43.893882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":21,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:20:57.004118+0000","last_change":"2024-08-31T04:20:42.938270+0000","last_active":"2024-08-31T04:20:57.004118+0000","last_peered":"2024-08-31T04:20:57.004118+0000","last_clean":"2024-08-31T04:20:57.004118+0000","last_became_active":"2024-08-31T04:20:42.937851+0000","last_became_peered":"2024-08-31T04:20:42.937851+0000","last_unstale":"2024-08-31T04:20:57.004118+0000","last_undegraded":"2024-08-31T04:20:57.004118+0000","last_fullsized":"2024-08-31T04:20:57.004118+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:29:09.315106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"78'3","reported_seq":31,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:21:01.049001+0000","last_change":"2024-08-31T04:20:39.905785+0000","last_active":"2024-08-31T04:21:01.049001+0000","last_peered":"2024-08-31T04:21:01.049001+0000","last_clean":"2024-08-31T04:21:01.049001+0000","last_became_active":"2024-08-31T04:20:39.905403+0000","last_became_peered":"2024-08-31T04:20:39.905403+0000","last_unstale":"2024-08-31T04:21:01.049001+0000","last_undegraded":"2024-08-31T04:21:01.049001+0000","last_fullsized":"2024-08-31T04:21:01.049001+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_clean_scrub_stamp":"2024-08-31T04:20:38.871450+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:48:04.743543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"78'1","reported_seq":22,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:20:57.003984+0000","last_change":"2024-08-31T04:20:42.934433+0000","last_active":"2024-08-31T04:20:57.003984+0000","last_peered":"2024-08-31T04:20:57.003984+0000","last_clean":"2024-08-31T04:20:57.003984+0000","last_became_active":"2024-08-31T04:20:42.934058+0000","last_became_peered":"2024-08-31T04:20:42.934058+0000","last_unstale":"2024-08-31T04:20:57.003984+0000","last_undegraded":"2024-08-31T04:20:57.003984+0000","last_fullsized":"2024-08-31T04:20:57.003984+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:34:42.988905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"78'6","reported_seq":91,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:21:55.142328+0000","last_change":"2024-08-31T04:20:40.202403+0000","last_active":"2024-08-31T04:21:55.142328+0000","last_peered":"2024-08-31T04:21:55.142328+0000","last_clean":"2024-08-31T04:21:55.142328+0000","last_became_active":"2024-08-31T04:20:40.201918+0000","last_became_peered":"2024-08-31T04:20:40.201918+0000","last_unstale":"2024-08-31T04:21:55.142328+0000","last_undegraded":"2024-08-31T04:21:55.142328+0000","last_fullsized":"2024-08-31T04:21:55.142328+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_clean_scrub_stamp":"2024-08-31T04:20:38.871450+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:31:26.675413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1561,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":58,"num_read_kb":3,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":21,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:20:57.004028+0000","last_change":"2024-08-31T04:20:42.931040+0000","last_active":"2024-08-31T04:20:57.004028+0000","last_peered":"2024-08-31T04:20:57.004028+0000","last_clean":"2024-08-31T04:20:57.004028+0000","last_became_active":"2024-08-31T04:20:42.930692+0000","last_became_peered":"2024-08-31T04:20:42.930692+0000","last_unstale":"2024-08-31T04:20:57.004028+0000","last_undegraded":"2024-08-31T04:20:57.004028+0000","last_fullsized":"2024-08-31T04:20:57.004028+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T06:12:23.175092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"20'92","reported_seq":98,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:20:57.003457+0000","last_change":"2024-08-31T04:19:21.361791+0000","last_active":"2024-08-31T04:20:57.003457+0000","last_peered":"2024-08-31T04:20:57.003457+0000","last_clean":"2024-08-31T04:20:57.003457+0000","last_became_active":"2024-08-31T04:19:21.356128+0000","last_became_peered":"2024-08-31T04:19:21.356128+0000","last_unstale":"2024-08-31T04:20:57.003457+0000","last_undegraded":"2024-08-31T04:20:57.003457+0000","last_fullsized":"2024-08-31T04:20:57.003457+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:15:46.442365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:15:46.442365+0000","last_clean_scrub_stamp":"2024-08-31T04:15:46.442365+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:23:05.688680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"78'6","reported_seq":36,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:21:02.053432+0000","last_change":"2024-08-31T04:20:39.904625+0000","last_active":"2024-08-31T04:21:02.053432+0000","last_peered":"2024-08-31T04:21:02.053432+0000","last_clean":"2024-08-31T04:21:02.053432+0000","last_became_active":"2024-08-31T04:20:39.904245+0000","last_became_peered":"2024-08-31T04:20:39.904245+0000","last_unstale":"2024-08-31T04:21:02.053432+0000","last_undegraded":"2024-08-31T04:21:02.053432+0000","last_fullsized":"2024-08-31T04:21:02.053432+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_clean_scrub_stamp":"2024-08-31T04:20:38.871450+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:31:34.711047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":21,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:20:57.338391+0000","last_change":"2024-08-31T04:20:42.944224+0000","last_active":"2024-08-31T04:20:57.338391+0000","last_peered":"2024-08-31T04:20:57.338391+0000","last_clean":"2024-08-31T04:20:57.338391+0000","last_became_active":"2024-08-31T04:20:42.943469+0000","last_became_peered":"2024-08-31T04:20:42.943469+0000","last_unstale":"2024-08-31T04:20:57.338391+0000","last_undegraded":"2024-08-31T04:20:57.338391+0000","last_fullsized":"2024-08-31T04:20:57.338391+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:27:48.533319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"78'4","reported_seq":31,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:20:57.003498+0000","last_change":"2024-08-31T04:20:39.902613+0000","last_active":"2024-08-31T04:20:57.003498+0000","last_peered":"2024-08-31T04:20:57.003498+0000","last_clean":"2024-08-31T04:20:57.003498+0000","last_became_active":"2024-08-31T04:20:39.902033+0000","last_became_peered":"2024-08-31T04:20:39.902033+0000","last_unstale":"2024-08-31T04:20:57.003498+0000","last_undegraded":"2024-08-31T04:20:57.003498+0000","last_fullsized":"2024-08-31T04:20:57.003498+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_clean_scrub_stamp":"2024-08-31T04:20:38.871450+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:13:58.497781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":21,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:20:56.998151+0000","last_change":"2024-08-31T04:20:42.933541+0000","last_active":"2024-08-31T04:20:56.998151+0000","last_peered":"2024-08-31T04:20:56.998151+0000","last_clean":"2024-08-31T04:20:56.998151+0000","last_became_active":"2024-08-31T04:20:42.933155+0000","last_became_peered":"2024-08-31T04:20:42.933155+0000","last_unstale":"2024-08-31T04:20:56.998151+0000","last_undegraded":"2024-08-31T04:20:56.998151+0000","last_fullsized":"2024-08-31T04:20:56.998151+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:22:41.298103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"78'5","reported_seq":91,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:21:58.146575+0000","last_change":"2024-08-31T04:20:39.992067+0000","last_active":"2024-08-31T04:21:58.146575+0000","last_peered":"2024-08-31T04:21:58.146575+0000","last_clean":"2024-08-31T04:21:58.146575+0000","last_became_active":"2024-08-31T04:20:39.991645+0000","last_became_peered":"2024-08-31T04:20:39.991645+0000","last_unstale":"2024-08-31T04:21:58.146575+0000","last_undegraded":"2024-08-31T04:21:58.146575+0000","last_fullsized":"2024-08-31T04:21:58.146575+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_clean_scrub_stamp":"2024-08-31T04:20:38.871450+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:41:18.012094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":59,"num_read_kb":59,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":21,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:20:56.999491+0000","last_change":"2024-08-31T04:20:42.937324+0000","last_active":"2024-08-31T04:20:56.999491+0000","last_peered":"2024-08-31T04:20:56.999491+0000","last_clean":"2024-08-31T04:20:56.999491+0000","last_became_active":"2024-08-31T04:20:42.936926+0000","last_became_peered":"2024-08-31T04:20:42.936926+0000","last_unstale":"2024-08-31T04:20:56.999491+0000","last_undegraded":"2024-08-31T04:20:56.999491+0000","last_fullsized":"2024-08-31T04:20:56.999491+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:34:57.158304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"78'5","reported_seq":87,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:21:54.141215+0000","last_change":"2024-08-31T04:20:39.905365+0000","last_active":"2024-08-31T04:21:54.141215+0000","last_peered":"2024-08-31T04:21:54.141215+0000","last_clean":"2024-08-31T04:21:54.141215+0000","last_became_active":"2024-08-31T04:20:39.904772+0000","last_became_peered":"2024-08-31T04:20:39.904772+0000","last_unstale":"2024-08-31T04:21:54.141215+0000","last_undegraded":"2024-08-31T04:21:54.141215+0000","last_fullsized":"2024-08-31T04:21:54.141215+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_clean_scrub_stamp":"2024-08-31T04:20:38.871450+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T05:20:23.781639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":55,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":21,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:20:57.001600+0000","last_change":"2024-08-31T04:20:42.944303+0000","last_active":"2024-08-31T04:20:57.001600+0000","last_peered":"2024-08-31T04:20:57.001600+0000","last_clean":"2024-08-31T04:20:57.001600+0000","last_became_active":"2024-08-31T04:20:42.943938+0000","last_became_peered":"2024-08-31T04:20:42.943938+0000","last_unstale":"2024-08-31T04:20:57.001600+0000","last_undegraded":"2024-08-31T04:20:57.001600+0000","last_fullsized":"2024-08-31T04:20:57.001600+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T06:51:28.734751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"77'1","reported_seq":28,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:20:57.004633+0000","last_change":"2024-08-31T04:20:39.993135+0000","last_active":"2024-08-31T04:20:57.004633+0000","last_peered":"2024-08-31T04:20:57.004633+0000","last_clean":"2024-08-31T04:20:57.004633+0000","last_became_active":"2024-08-31T04:20:39.991569+0000","last_became_peered":"2024-08-31T04:20:39.991569+0000","last_unstale":"2024-08-31T04:20:57.004633+0000","last_undegraded":"2024-08-31T04:20:57.004633+0000","last_fullsized":"2024-08-31T04:20:57.004633+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_clean_scrub_stamp":"2024-08-31T04:20:38.871450+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:44:04.375810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"78'1","reported_seq":22,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:20:57.002559+0000","last_change":"2024-08-31T04:20:42.939721+0000","last_active":"2024-08-31T04:20:57.002559+0000","last_peered":"2024-08-31T04:20:57.002559+0000","last_clean":"2024-08-31T04:20:57.002559+0000","last_became_active":"2024-08-31T04:20:42.939380+0000","last_became_peered":"2024-08-31T04:20:42.939380+0000","last_unstale":"2024-08-31T04:20:57.002559+0000","last_undegraded":"2024-08-31T04:20:57.002559+0000","last_fullsized":"2024-08-31T04:20:57.002559+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:55:06.901719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"78'4","reported_seq":32,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:21:01.047625+0000","last_change":"2024-08-31T04:20:39.990968+0000","last_active":"2024-08-31T04:21:01.047625+0000","last_peered":"2024-08-31T04:21:01.047625+0000","last_clean":"2024-08-31T04:21:01.047625+0000","last_became_active":"2024-08-31T04:20:39.990583+0000","last_became_peered":"2024-08-31T04:20:39.990583+0000","last_unstale":"2024-08-31T04:21:01.047625+0000","last_undegraded":"2024-08-31T04:21:01.047625+0000","last_fullsized":"2024-08-31T04:21:01.047625+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_clean_scrub_stamp":"2024-08-31T04:20:38.871450+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:54:39.168179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":21,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:20:56.998550+0000","last_change":"2024-08-31T04:20:42.932914+0000","last_active":"2024-08-31T04:20:56.998550+0000","last_peered":"2024-08-31T04:20:56.998550+0000","last_clean":"2024-08-31T04:20:56.998550+0000","last_became_active":"2024-08-31T04:20:42.932523+0000","last_became_peered":"2024-08-31T04:20:42.932523+0000","last_unstale":"2024-08-31T04:20:56.998550+0000","last_undegraded":"2024-08-31T04:20:56.998550+0000","last_fullsized":"2024-08-31T04:20:56.998550+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:52:49.133428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"78'16","reported_seq":43,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:21:14.953864+0000","last_change":"2024-08-31T04:20:39.903373+0000","last_active":"2024-08-31T04:21:14.953864+0000","last_peered":"2024-08-31T04:21:14.953864+0000","last_clean":"2024-08-31T04:21:14.953864+0000","last_became_active":"2024-08-31T04:20:39.902784+0000","last_became_peered":"2024-08-31T04:20:39.902784+0000","last_unstale":"2024-08-31T04:21:14.953864+0000","last_undegraded":"2024-08-31T04:21:14.953864+0000","last_fullsized":"2024-08-31T04:21:14.953864+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_clean_scrub_stamp":"2024-08-31T04:20:38.871450+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:43:32.251846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":21,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:20:57.338679+0000","last_change":"2024-08-31T04:20:42.939252+0000","last_active":"2024-08-31T04:20:57.338679+0000","last_peered":"2024-08-31T04:20:57.338679+0000","last_clean":"2024-08-31T04:20:57.338679+0000","last_became_active":"2024-08-31T04:20:42.936671+0000","last_became_peered":"2024-08-31T04:20:42.936671+0000","last_unstale":"2024-08-31T04:20:57.338679+0000","last_undegraded":"2024-08-31T04:20:57.338679+0000","last_fullsized":"2024-08-31T04:20:57.338679+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:37:57.544627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"78'7","reported_seq":35,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:21:01.049714+0000","last_change":"2024-08-31T04:20:40.202412+0000","last_active":"2024-08-31T04:21:01.049714+0000","last_peered":"2024-08-31T04:21:01.049714+0000","last_clean":"2024-08-31T04:21:01.049714+0000","last_became_active":"2024-08-31T04:20:40.202000+0000","last_became_peered":"2024-08-31T04:20:40.202000+0000","last_unstale":"2024-08-31T04:21:01.049714+0000","last_undegraded":"2024-08-31T04:21:01.049714+0000","last_fullsized":"2024-08-31T04:21:01.049714+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_clean_scrub_stamp":"2024-08-31T04:20:38.871450+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:24:23.528379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":21,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:20:57.001587+0000","last_change":"2024-08-31T04:20:42.949174+0000","last_active":"2024-08-31T04:20:57.001587+0000","last_peered":"2024-08-31T04:20:57.001587+0000","last_clean":"2024-08-31T04:20:57.001587+0000","last_became_active":"2024-08-31T04:20:42.948013+0000","last_became_peered":"2024-08-31T04:20:42.948013+0000","last_unstale":"2024-08-31T04:20:57.001587+0000","last_undegraded":"2024-08-31T04:20:57.001587+0000","last_fullsized":"2024-08-31T04:20:57.001587+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:36:00.572991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"76'2","reported_seq":29,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:20:57.223195+0000","last_change":"2024-08-31T04:20:39.992477+0000","last_active":"2024-08-31T04:20:57.223195+0000","last_peered":"2024-08-31T04:20:57.223195+0000","last_clean":"2024-08-31T04:20:57.223195+0000","last_became_active":"2024-08-31T04:20:39.992082+0000","last_became_peered":"2024-08-31T04:20:39.992082+0000","last_unstale":"2024-08-31T04:20:57.223195+0000","last_undegraded":"2024-08-31T04:20:57.223195+0000","last_fullsized":"2024-08-31T04:20:57.223195+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_clean_scrub_stamp":"2024-08-31T04:20:38.871450+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:10:35.058693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":21,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:20:57.005828+0000","last_change":"2024-08-31T04:20:42.933915+0000","last_active":"2024-08-31T04:20:57.005828+0000","last_peered":"2024-08-31T04:20:57.005828+0000","last_clean":"2024-08-31T04:20:57.005828+0000","last_became_active":"2024-08-31T04:20:42.933525+0000","last_became_peered":"2024-08-31T04:20:42.933525+0000","last_unstale":"2024-08-31T04:20:57.005828+0000","last_undegraded":"2024-08-31T04:20:57.005828+0000","last_fullsized":"2024-08-31T04:20:57.005828+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:03:35.191136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"78'7","reported_seq":34,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:21:01.047578+0000","last_change":"2024-08-31T04:20:39.903979+0000","last_active":"2024-08-31T04:21:01.047578+0000","last_peered":"2024-08-31T04:21:01.047578+0000","last_clean":"2024-08-31T04:21:01.047578+0000","last_became_active":"2024-08-31T04:20:39.903538+0000","last_became_peered":"2024-08-31T04:20:39.903538+0000","last_unstale":"2024-08-31T04:21:01.047578+0000","last_undegraded":"2024-08-31T04:21:01.047578+0000","last_fullsized":"2024-08-31T04:21:01.047578+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_clean_scrub_stamp":"2024-08-31T04:20:38.871450+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:25:15.944692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":21,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:20:57.001683+0000","last_change":"2024-08-31T04:20:42.947511+0000","last_active":"2024-08-31T04:20:57.001683+0000","last_peered":"2024-08-31T04:20:57.001683+0000","last_clean":"2024-08-31T04:20:57.001683+0000","last_became_active":"2024-08-31T04:20:42.947116+0000","last_became_peered":"2024-08-31T04:20:42.947116+0000","last_unstale":"2024-08-31T04:20:57.001683+0000","last_undegraded":"2024-08-31T04:20:57.001683+0000","last_fullsized":"2024-08-31T04:20:57.001683+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:00:53.022229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"78'3","reported_seq":30,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:20:57.004076+0000","last_change":"2024-08-31T04:20:39.903409+0000","last_active":"2024-08-31T04:20:57.004076+0000","last_peered":"2024-08-31T04:20:57.004076+0000","last_clean":"2024-08-31T04:20:57.004076+0000","last_became_active":"2024-08-31T04:20:39.900366+0000","last_became_peered":"2024-08-31T04:20:39.900366+0000","last_unstale":"2024-08-31T04:20:57.004076+0000","last_undegraded":"2024-08-31T04:20:57.004076+0000","last_fullsized":"2024-08-31T04:20:57.004076+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_clean_scrub_stamp":"2024-08-31T04:20:38.871450+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:01:24.809923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":21,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:20:57.338464+0000","last_change":"2024-08-31T04:20:42.953207+0000","last_active":"2024-08-31T04:20:57.338464+0000","last_peered":"2024-08-31T04:20:57.338464+0000","last_clean":"2024-08-31T04:20:57.338464+0000","last_became_active":"2024-08-31T04:20:42.952854+0000","last_became_peered":"2024-08-31T04:20:42.952854+0000","last_unstale":"2024-08-31T04:20:57.338464+0000","last_undegraded":"2024-08-31T04:20:57.338464+0000","last_fullsized":"2024-08-31T04:20:57.338464+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:33:11.495216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"76'4","reported_seq":21,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:21:00.180014+0000","last_change":"2024-08-31T04:20:57.016087+0000","last_active":"2024-08-31T04:21:00.180014+0000","last_peered":"2024-08-31T04:21:00.180014+0000","last_clean":"2024-08-31T04:21:00.180014+0000","last_became_active":"2024-08-31T04:20:57.005476+0000","last_became_peered":"2024-08-31T04:20:57.005476+0000","last_unstale":"2024-08-31T04:21:00.180014+0000","last_undegraded":"2024-08-31T04:21:00.180014+0000","last_fullsized":"2024-08-31T04:21:00.180014+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_clean_scrub_stamp":"2024-08-31T04:20:38.871450+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:22:21.768548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,7],"acting":[11,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":21,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:20:57.003500+0000","last_change":"2024-08-31T04:20:42.933249+0000","last_active":"2024-08-31T04:20:57.003500+0000","last_peered":"2024-08-31T04:20:57.003500+0000","last_clean":"2024-08-31T04:20:57.003500+0000","last_became_active":"2024-08-31T04:20:42.931651+0000","last_became_peered":"2024-08-31T04:20:42.931651+0000","last_unstale":"2024-08-31T04:20:57.003500+0000","last_undegraded":"2024-08-31T04:20:57.003500+0000","last_fullsized":"2024-08-31T04:20:57.003500+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T06:40:21.010108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":21,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:20:57.000156+0000","last_change":"2024-08-31T04:20:42.942418+0000","last_active":"2024-08-31T04:20:57.000156+0000","last_peered":"2024-08-31T04:20:57.000156+0000","last_clean":"2024-08-31T04:20:57.000156+0000","last_became_active":"2024-08-31T04:20:42.942072+0000","last_became_peered":"2024-08-31T04:20:42.942072+0000","last_unstale":"2024-08-31T04:20:57.000156+0000","last_undegraded":"2024-08-31T04:20:57.000156+0000","last_fullsized":"2024-08-31T04:20:57.000156+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T04:41:38.816730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"78'5","reported_seq":33,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:21:01.049947+0000","last_change":"2024-08-31T04:20:39.903399+0000","last_active":"2024-08-31T04:21:01.049947+0000","last_peered":"2024-08-31T04:21:01.049947+0000","last_clean":"2024-08-31T04:21:01.049947+0000","last_became_active":"2024-08-31T04:20:39.902732+0000","last_became_peered":"2024-08-31T04:20:39.902732+0000","last_unstale":"2024-08-31T04:21:01.049947+0000","last_undegraded":"2024-08-31T04:21:01.049947+0000","last_fullsized":"2024-08-31T04:21:01.049947+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_clean_scrub_stamp":"2024-08-31T04:20:38.871450+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:07:25.324109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":21,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:20:57.223222+0000","last_change":"2024-08-31T04:20:42.931570+0000","last_active":"2024-08-31T04:20:57.223222+0000","last_peered":"2024-08-31T04:20:57.223222+0000","last_clean":"2024-08-31T04:20:57.223222+0000","last_became_active":"2024-08-31T04:20:42.931162+0000","last_became_peered":"2024-08-31T04:20:42.931162+0000","last_unstale":"2024-08-31T04:20:57.223222+0000","last_undegraded":"2024-08-31T04:20:57.223222+0000","last_fullsized":"2024-08-31T04:20:57.223222+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:55:58.784723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"78'12","reported_seq":27,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:21:02.054140+0000","last_change":"2024-08-31T04:20:57.020014+0000","last_active":"2024-08-31T04:21:02.054140+0000","last_peered":"2024-08-31T04:21:02.054140+0000","last_clean":"2024-08-31T04:21:02.054140+0000","last_became_active":"2024-08-31T04:20:57.009489+0000","last_became_peered":"2024-08-31T04:20:57.009489+0000","last_unstale":"2024-08-31T04:21:02.054140+0000","last_undegraded":"2024-08-31T04:21:02.054140+0000","last_fullsized":"2024-08-31T04:21:02.054140+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_clean_scrub_stamp":"2024-08-31T04:20:38.871450+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T05:22:57.227296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":10,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,7],"acting":[11,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":21,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:20:57.001803+0000","last_change":"2024-08-31T04:20:42.947868+0000","last_active":"2024-08-31T04:20:57.001803+0000","last_peered":"2024-08-31T04:20:57.001803+0000","last_clean":"2024-08-31T04:20:57.001803+0000","last_became_active":"2024-08-31T04:20:42.946628+0000","last_became_peered":"2024-08-31T04:20:42.946628+0000","last_unstale":"2024-08-31T04:20:57.001803+0000","last_undegraded":"2024-08-31T04:20:57.001803+0000","last_fullsized":"2024-08-31T04:20:57.001803+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:47:10.939205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"76'2","reported_seq":29,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:20:57.338782+0000","last_change":"2024-08-31T04:20:39.991234+0000","last_active":"2024-08-31T04:20:57.338782+0000","last_peered":"2024-08-31T04:20:57.338782+0000","last_clean":"2024-08-31T04:20:57.338782+0000","last_became_active":"2024-08-31T04:20:39.990416+0000","last_became_peered":"2024-08-31T04:20:39.990416+0000","last_unstale":"2024-08-31T04:20:57.338782+0000","last_undegraded":"2024-08-31T04:20:57.338782+0000","last_fullsized":"2024-08-31T04:20:57.338782+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_clean_scrub_stamp":"2024-08-31T04:20:38.871450+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:47:43.392522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":21,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:20:57.338520+0000","last_change":"2024-08-31T04:20:42.942017+0000","last_active":"2024-08-31T04:20:57.338520+0000","last_peered":"2024-08-31T04:20:57.338520+0000","last_clean":"2024-08-31T04:20:57.338520+0000","last_became_active":"2024-08-31T04:20:42.939661+0000","last_became_peered":"2024-08-31T04:20:42.939661+0000","last_unstale":"2024-08-31T04:20:57.338520+0000","last_undegraded":"2024-08-31T04:20:57.338520+0000","last_fullsized":"2024-08-31T04:20:57.338520+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:13:39.521066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"78'13","reported_seq":95,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:21:54.140672+0000","last_change":"2024-08-31T04:20:39.905996+0000","last_active":"2024-08-31T04:21:54.140672+0000","last_peered":"2024-08-31T04:21:54.140672+0000","last_clean":"2024-08-31T04:21:54.140672+0000","last_became_active":"2024-08-31T04:20:39.905622+0000","last_became_peered":"2024-08-31T04:20:39.905622+0000","last_unstale":"2024-08-31T04:21:54.140672+0000","last_undegraded":"2024-08-31T04:21:54.140672+0000","last_fullsized":"2024-08-31T04:21:54.140672+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_clean_scrub_stamp":"2024-08-31T04:20:38.871450+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:53:36.672295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":55,"num_read_kb":55,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":67357,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":590,"num_read_kb":372,"num_write":247,"num_write_kb":136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":622,"num_keys_recovered":10,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":565248,"data_stored":202071,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":212,"ondisk_log_size":212,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":245760,"data_stored":2951840,"data_compressed":181705,"data_compressed_allocated":225280,"data_compressed_original":2949120,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":68,"seq":292057776157,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32012,"kb_used_data":828,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713140,"statfs":{"total":95995035648,"available":95962255360,"internally_reserved":0,"allocated":847872,"data_stored":413656,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":63,"seq":270582939681,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28004,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717148,"statfs":{"total":95995035648,"available":95966359552,"internally_reserved":0,"allocated":1003520,"data_stored":1064447,"data_compressed":36341,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":58,"seq":249108103208,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36196,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708956,"statfs":{"total":95995035648,"available":95957970944,"internally_reserved":0,"allocated":872448,"data_stored":413195,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,5,6,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":52,"seq":223338299436,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27872,"kb_used_data":848,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717280,"statfs":{"total":95995035648,"available":95966494720,"internally_reserved":0,"allocated":868352,"data_stored":413573,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":47,"seq":201863462963,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27924,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717228,"statfs":{"total":95995035648,"available":95966441472,"internally_reserved":0,"allocated":921600,"data_stored":1006482,"data_compressed":36341,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":42,"seq":180388626488,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32020,"kb_used_data":836,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713132,"statfs":{"total":95995035648,"available":95962247168,"internally_reserved":0,"allocated":856064,"data_stored":412912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":36,"seq":154618822718,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27936,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717216,"statfs":{"total":95995035648,"available":95966429184,"internally_reserved":0,"allocated":933888,"data_stored":1005769,"data_compressed":36341,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986242,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27860,"kb_used_data":836,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717292,"statfs":{"total":95995035648,"available":95966507008,"internally_reserved":0,"allocated":856064,"data_stored":413164,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182471,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36196,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708956,"statfs":{"total":95995035648,"available":95957970944,"internally_reserved":0,"allocated":872448,"data_stored":412737,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411406,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27932,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717220,"statfs":{"total":95995035648,"available":95966433280,"internally_reserved":0,"allocated":929792,"data_stored":473576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574931,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27928,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717224,"statfs":{"total":95995035648,"available":95966437376,"internally_reserved":0,"allocated":925696,"data_stored":474600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738454,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27880,"kb_used_data":856,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717272,"statfs":{"total":95995035648,"available":95966486528,"internally_reserved":0,"allocated":876544,"data_stored":414642,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36341,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36341,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36341,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36341,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36341,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2569,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":62527,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":61503,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1091,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3211,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3924,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":61889,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1583,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-31T04:22:02.555 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 058d9fc6-674f-11ef-bcd4-c7b262605968 -- ceph pg dump --format=json 2024-08-31T04:22:02.935 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:22:03.565 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:03.564+0000 7ff2c4000640 1 -- 172.21.15.50:0/878871113 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff2bc1141f0 msgr2=0x7ff2bc1166c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:22:03.566 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:03.564+0000 7ff2c4000640 1 --2- 172.21.15.50:0/878871113 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff2bc1141f0 0x7ff2bc1166c0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7ff2b4009ca0 tx=0x7ff2b402a8c0 comp rx=0 tx=0).stop 2024-08-31T04:22:03.566 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:03.564+0000 7ff2c4000640 1 -- 172.21.15.50:0/878871113 shutdown_connections 2024-08-31T04:22:03.566 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:03.564+0000 7ff2c4000640 1 --2- 172.21.15.50:0/878871113 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff2bc075b70 0x7ff2bc075f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:03.566 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:03.564+0000 7ff2c4000640 1 --2- 172.21.15.50:0/878871113 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff2bc1141f0 0x7ff2bc1166c0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:03.566 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:03.564+0000 7ff2c4000640 1 --2- 172.21.15.50:0/878871113 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff2bc077120 0x7ff2bc075550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:03.566 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:03.564+0000 7ff2c4000640 1 -- 172.21.15.50:0/878871113 >> 172.21.15.50:0/878871113 conn(0x7ff2bc0ff370 msgr2=0x7ff2bc1017c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:22:03.566 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:03.564+0000 7ff2c4000640 1 -- 172.21.15.50:0/878871113 shutdown_connections 2024-08-31T04:22:03.566 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:03.564+0000 7ff2c4000640 1 -- 172.21.15.50:0/878871113 wait complete. 2024-08-31T04:22:03.568 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:03.565+0000 7ff2c4000640 1 Processor -- start 2024-08-31T04:22:03.568 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:03.565+0000 7ff2c4000640 1 -- start start 2024-08-31T04:22:03.568 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:03.565+0000 7ff2c4000640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff2bc075b70 0x7ff2bc1a0820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:03.568 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:03.565+0000 7ff2c4000640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff2bc077120 0x7ff2bc1a0dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:03.568 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:03.565+0000 7ff2c4000640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff2bc1141f0 0x7ff2bc1a6060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:03.568 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:03.565+0000 7ff2c4000640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7ff2bc119e30 con 0x7ff2bc075b70 2024-08-31T04:22:03.568 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:03.565+0000 7ff2c4000640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7ff2bc119cb0 con 0x7ff2bc1141f0 2024-08-31T04:22:03.568 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:03.565+0000 7ff2c4000640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7ff2bc119fb0 con 0x7ff2bc077120 2024-08-31T04:22:03.568 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:03.566+0000 7ff2c1600640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff2bc075b70 0x7ff2bc1a0820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:22:03.568 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:03.566+0000 7ff2c1600640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff2bc075b70 0x7ff2bc1a0820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:58464/0 (socket says 172.21.15.50:58464) 2024-08-31T04:22:03.568 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:03.566+0000 7ff2c1600640 1 -- 172.21.15.50:0/538013850 learned_addr learned my addr 172.21.15.50:0/538013850 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:22:03.568 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:03.566+0000 7ff2c0c00640 1 --2- 172.21.15.50:0/538013850 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff2bc077120 0x7ff2bc1a0dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:22:03.569 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:03.566+0000 7ff2c2000640 1 --2- 172.21.15.50:0/538013850 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff2bc1141f0 0x7ff2bc1a6060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:22:03.569 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:03.566+0000 7ff2c1600640 1 -- 172.21.15.50:0/538013850 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff2bc077120 msgr2=0x7ff2bc1a0dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:22:03.569 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:03.566+0000 7ff2c1600640 1 --2- 172.21.15.50:0/538013850 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff2bc077120 0x7ff2bc1a0dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:03.569 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:03.566+0000 7ff2c1600640 1 -- 172.21.15.50:0/538013850 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff2bc1141f0 msgr2=0x7ff2bc1a6060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:22:03.569 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:03.566+0000 7ff2c1600640 1 --2- 172.21.15.50:0/538013850 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff2bc1141f0 0x7ff2bc1a6060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:03.569 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:03.566+0000 7ff2c1600640 1 -- 172.21.15.50:0/538013850 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2bc1a6790 con 0x7ff2bc075b70 2024-08-31T04:22:03.569 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:03.566+0000 7ff2c0c00640 1 --2- 172.21.15.50:0/538013850 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff2bc077120 0x7ff2bc1a0dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:22:03.569 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:03.567+0000 7ff2c1600640 1 --2- 172.21.15.50:0/538013850 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff2bc075b70 0x7ff2bc1a0820 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7ff2b000ea60 tx=0x7ff2b000ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:22:03.570 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:03.567+0000 7ff2ba000640 1 -- 172.21.15.50:0/538013850 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2b000cde0 con 0x7ff2bc075b70 2024-08-31T04:22:03.570 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:03.567+0000 7ff2ba000640 1 -- 172.21.15.50:0/538013850 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff2b00035f0 con 0x7ff2bc075b70 2024-08-31T04:22:03.570 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:03.567+0000 7ff2ba000640 1 -- 172.21.15.50:0/538013850 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2b0010690 con 0x7ff2bc075b70 2024-08-31T04:22:03.570 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:03.567+0000 7ff2c4000640 1 -- 172.21.15.50:0/538013850 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff2bc1a6a80 con 0x7ff2bc075b70 2024-08-31T04:22:03.570 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:03.567+0000 7ff2c4000640 1 -- 172.21.15.50:0/538013850 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff2bc1ad1e0 con 0x7ff2bc075b70 2024-08-31T04:22:03.570 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:03.568+0000 7ff2c4000640 1 -- 172.21.15.50:0/538013850 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff2bc075f80 con 0x7ff2bc075b70 2024-08-31T04:22:03.572 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:03.571+0000 7ff2ba000640 1 -- 172.21.15.50:0/538013850 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 17) ==== 152628+0+0 (secure 0 0 0) 0x7ff2b00037a0 con 0x7ff2bc075b70 2024-08-31T04:22:03.573 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:03.572+0000 7ff2ba000640 1 --2- 172.21.15.50:0/538013850 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7ff2a40b4bc0 0x7ff2a40b70d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:03.573 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:03.572+0000 7ff2ba000640 1 -- 172.21.15.50:0/538013850 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8219+0+0 (secure 0 0 0) 0x7ff2b00e5800 con 0x7ff2bc075b70 2024-08-31T04:22:03.573 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:03.572+0000 7ff2c0c00640 1 --2- 172.21.15.50:0/538013850 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7ff2a40b4bc0 0x7ff2a40b70d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:22:03.574 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:03.573+0000 7ff2c0c00640 1 --2- 172.21.15.50:0/538013850 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7ff2a40b4bc0 0x7ff2a40b70d0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7ff2bc116160 tx=0x7ff2a8005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:22:03.575 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:03.574+0000 7ff2ba000640 1 -- 172.21.15.50:0/538013850 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7ff2b0056130 con 0x7ff2bc075b70 2024-08-31T04:22:03.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:22:03 smithi050 ceph-mon[17259]: from='client.25006 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-31T04:22:03.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:22:03 smithi050 ceph-mon[17259]: pgmap v341: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2024-08-31T04:22:03.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:22:03 smithi177 ceph-mon[22025]: from='client.25006 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-31T04:22:03.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:22:03 smithi177 ceph-mon[22025]: pgmap v341: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2024-08-31T04:22:03.770 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:03.768+0000 7ff2c4000640 1 -- 172.21.15.50:0/538013850 --> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7ff2bc0635a0 con 0x7ff2a40b4bc0 2024-08-31T04:22:03.774 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:03.773+0000 7ff2ba000640 1 -- 172.21.15.50:0/538013850 <== mgr.14150 v2:172.21.15.50:6800/2146686622 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258854 (secure 0 0 0) 0x7ff2bc0635a0 con 0x7ff2a40b4bc0 2024-08-31T04:22:03.777 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-08-31T04:22:03.778 INFO:teuthology.orchestra.run.smithi050.stderr:dumped all 2024-08-31T04:22:03.780 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:03.778+0000 7ff2c4000640 1 -- 172.21.15.50:0/538013850 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7ff2a40b4bc0 msgr2=0x7ff2a40b70d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:22:03.780 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:03.778+0000 7ff2c4000640 1 --2- 172.21.15.50:0/538013850 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7ff2a40b4bc0 0x7ff2a40b70d0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7ff2bc116160 tx=0x7ff2a8005f90 comp rx=0 tx=0).stop 2024-08-31T04:22:03.781 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:03.778+0000 7ff2c4000640 1 -- 172.21.15.50:0/538013850 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff2bc075b70 msgr2=0x7ff2bc1a0820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:22:03.781 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:03.778+0000 7ff2c4000640 1 --2- 172.21.15.50:0/538013850 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff2bc075b70 0x7ff2bc1a0820 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7ff2b000ea60 tx=0x7ff2b000ef20 comp rx=0 tx=0).stop 2024-08-31T04:22:03.781 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:03.778+0000 7ff2c4000640 1 -- 172.21.15.50:0/538013850 shutdown_connections 2024-08-31T04:22:03.781 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:03.778+0000 7ff2c4000640 1 --2- 172.21.15.50:0/538013850 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7ff2a40b4bc0 0x7ff2a40b70d0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:03.781 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:03.778+0000 7ff2c4000640 1 --2- 172.21.15.50:0/538013850 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff2bc077120 0x7ff2bc1a0dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:03.781 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:03.778+0000 7ff2c4000640 1 --2- 172.21.15.50:0/538013850 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff2bc1141f0 0x7ff2bc1a6060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:03.781 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:03.778+0000 7ff2c4000640 1 --2- 172.21.15.50:0/538013850 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff2bc075b70 0x7ff2bc1a0820 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:03.781 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:03.778+0000 7ff2c4000640 1 -- 172.21.15.50:0/538013850 >> 172.21.15.50:0/538013850 conn(0x7ff2bc0ff370 msgr2=0x7ff2bc1100f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:22:03.781 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:03.779+0000 7ff2c4000640 1 -- 172.21.15.50:0/538013850 shutdown_connections 2024-08-31T04:22:03.781 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:03.779+0000 7ff2c4000640 1 -- 172.21.15.50:0/538013850 wait complete. 2024-08-31T04:22:03.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:22:03 smithi133 ceph-mon[22177]: from='client.25006 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-31T04:22:03.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:22:03 smithi133 ceph-mon[22177]: pgmap v341: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2024-08-31T04:22:04.543 INFO:teuthology.orchestra.run.smithi050.stdout:{"pg_ready":true,"pg_map":{"version":341,"stamp":"2024-08-31T04:22:01.868148+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":657959,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":711,"num_read_kb":456,"num_write":372,"num_write_kb":2288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":2952462,"num_keys_recovered":10,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":306,"ondisk_log_size":306,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":359760,"kb_used_data":10512,"kb_used_omap":18,"kb_used_meta":349037,"kb_avail":1124582064,"statfs":{"total":1151940427776,"available":1151572033536,"internally_reserved":0,"allocated":10764288,"data_stored":6918753,"data_compressed":109023,"data_compressed_allocated":135168,"data_compressed_original":1769472,"omap_allocated":19143,"internal_metadata":357414201},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":145,"num_read_kb":70,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003287"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":21,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:20:57.002034+0000","last_change":"2024-08-31T04:20:42.949771+0000","last_active":"2024-08-31T04:20:57.002034+0000","last_peered":"2024-08-31T04:20:57.002034+0000","last_clean":"2024-08-31T04:20:57.002034+0000","last_became_active":"2024-08-31T04:20:42.949372+0000","last_became_peered":"2024-08-31T04:20:42.949372+0000","last_unstale":"2024-08-31T04:20:57.002034+0000","last_undegraded":"2024-08-31T04:20:57.002034+0000","last_fullsized":"2024-08-31T04:20:57.002034+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:16:50.036191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":21,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:20:57.001502+0000","last_change":"2024-08-31T04:20:42.949805+0000","last_active":"2024-08-31T04:20:57.001502+0000","last_peered":"2024-08-31T04:20:57.001502+0000","last_clean":"2024-08-31T04:20:57.001502+0000","last_became_active":"2024-08-31T04:20:42.948015+0000","last_became_peered":"2024-08-31T04:20:42.948015+0000","last_unstale":"2024-08-31T04:20:57.001502+0000","last_undegraded":"2024-08-31T04:20:57.001502+0000","last_fullsized":"2024-08-31T04:20:57.001502+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:25:47.432785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":21,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:20:57.001526+0000","last_change":"2024-08-31T04:20:42.949114+0000","last_active":"2024-08-31T04:20:57.001526+0000","last_peered":"2024-08-31T04:20:57.001526+0000","last_clean":"2024-08-31T04:20:57.001526+0000","last_became_active":"2024-08-31T04:20:42.946763+0000","last_became_peered":"2024-08-31T04:20:42.946763+0000","last_unstale":"2024-08-31T04:20:57.001526+0000","last_undegraded":"2024-08-31T04:20:57.001526+0000","last_fullsized":"2024-08-31T04:20:57.001526+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:33:55.605617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":21,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:20:56.999162+0000","last_change":"2024-08-31T04:20:42.935026+0000","last_active":"2024-08-31T04:20:56.999162+0000","last_peered":"2024-08-31T04:20:56.999162+0000","last_clean":"2024-08-31T04:20:56.999162+0000","last_became_active":"2024-08-31T04:20:42.934534+0000","last_became_peered":"2024-08-31T04:20:42.934534+0000","last_unstale":"2024-08-31T04:20:56.999162+0000","last_undegraded":"2024-08-31T04:20:56.999162+0000","last_fullsized":"2024-08-31T04:20:56.999162+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:33:41.014920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":21,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:20:57.006160+0000","last_change":"2024-08-31T04:20:42.939114+0000","last_active":"2024-08-31T04:20:57.006160+0000","last_peered":"2024-08-31T04:20:57.006160+0000","last_clean":"2024-08-31T04:20:57.006160+0000","last_became_active":"2024-08-31T04:20:42.938710+0000","last_became_peered":"2024-08-31T04:20:42.938710+0000","last_unstale":"2024-08-31T04:20:57.006160+0000","last_undegraded":"2024-08-31T04:20:57.006160+0000","last_fullsized":"2024-08-31T04:20:57.006160+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:42:25.561258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":21,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:20:57.001416+0000","last_change":"2024-08-31T04:20:42.935958+0000","last_active":"2024-08-31T04:20:57.001416+0000","last_peered":"2024-08-31T04:20:57.001416+0000","last_clean":"2024-08-31T04:20:57.001416+0000","last_became_active":"2024-08-31T04:20:42.934865+0000","last_became_peered":"2024-08-31T04:20:42.934865+0000","last_unstale":"2024-08-31T04:20:57.001416+0000","last_undegraded":"2024-08-31T04:20:57.001416+0000","last_fullsized":"2024-08-31T04:20:57.001416+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:28:20.330784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":21,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:20:57.003213+0000","last_change":"2024-08-31T04:20:42.932639+0000","last_active":"2024-08-31T04:20:57.003213+0000","last_peered":"2024-08-31T04:20:57.003213+0000","last_clean":"2024-08-31T04:20:57.003213+0000","last_became_active":"2024-08-31T04:20:42.932238+0000","last_became_peered":"2024-08-31T04:20:42.932238+0000","last_unstale":"2024-08-31T04:20:57.003213+0000","last_undegraded":"2024-08-31T04:20:57.003213+0000","last_fullsized":"2024-08-31T04:20:57.003213+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T04:47:32.128675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":21,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:20:57.338218+0000","last_change":"2024-08-31T04:20:42.941700+0000","last_active":"2024-08-31T04:20:57.338218+0000","last_peered":"2024-08-31T04:20:57.338218+0000","last_clean":"2024-08-31T04:20:57.338218+0000","last_became_active":"2024-08-31T04:20:42.941308+0000","last_became_peered":"2024-08-31T04:20:42.941308+0000","last_unstale":"2024-08-31T04:20:57.338218+0000","last_undegraded":"2024-08-31T04:20:57.338218+0000","last_fullsized":"2024-08-31T04:20:57.338218+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:35:06.058492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":21,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:20:57.223342+0000","last_change":"2024-08-31T04:20:42.935528+0000","last_active":"2024-08-31T04:20:57.223342+0000","last_peered":"2024-08-31T04:20:57.223342+0000","last_clean":"2024-08-31T04:20:57.223342+0000","last_became_active":"2024-08-31T04:20:42.933736+0000","last_became_peered":"2024-08-31T04:20:42.933736+0000","last_unstale":"2024-08-31T04:20:57.223342+0000","last_undegraded":"2024-08-31T04:20:57.223342+0000","last_fullsized":"2024-08-31T04:20:57.223342+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:12:47.877285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":28,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:20:57.006811+0000","last_change":"2024-08-31T04:20:57.006683+0000","last_active":"2024-08-31T04:20:57.006811+0000","last_peered":"2024-08-31T04:20:57.006811+0000","last_clean":"2024-08-31T04:20:57.006811+0000","last_became_active":"2024-08-31T04:20:57.006166+0000","last_became_peered":"2024-08-31T04:20:57.006166+0000","last_unstale":"2024-08-31T04:20:57.006811+0000","last_undegraded":"2024-08-31T04:20:57.006811+0000","last_fullsized":"2024-08-31T04:20:57.006811+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:33:23.377991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,9],"acting":[10,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":21,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:20:57.003953+0000","last_change":"2024-08-31T04:20:42.939489+0000","last_active":"2024-08-31T04:20:57.003953+0000","last_peered":"2024-08-31T04:20:57.003953+0000","last_clean":"2024-08-31T04:20:57.003953+0000","last_became_active":"2024-08-31T04:20:42.939138+0000","last_became_peered":"2024-08-31T04:20:42.939138+0000","last_unstale":"2024-08-31T04:20:57.003953+0000","last_undegraded":"2024-08-31T04:20:57.003953+0000","last_fullsized":"2024-08-31T04:20:57.003953+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T05:00:30.196513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":21,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:20:56.999241+0000","last_change":"2024-08-31T04:20:42.941483+0000","last_active":"2024-08-31T04:20:56.999241+0000","last_peered":"2024-08-31T04:20:56.999241+0000","last_clean":"2024-08-31T04:20:56.999241+0000","last_became_active":"2024-08-31T04:20:42.940200+0000","last_became_peered":"2024-08-31T04:20:42.940200+0000","last_unstale":"2024-08-31T04:20:56.999241+0000","last_undegraded":"2024-08-31T04:20:56.999241+0000","last_fullsized":"2024-08-31T04:20:56.999241+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:40:45.235093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":21,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:20:56.998469+0000","last_change":"2024-08-31T04:20:42.928803+0000","last_active":"2024-08-31T04:20:56.998469+0000","last_peered":"2024-08-31T04:20:56.998469+0000","last_clean":"2024-08-31T04:20:56.998469+0000","last_became_active":"2024-08-31T04:20:42.928410+0000","last_became_peered":"2024-08-31T04:20:42.928410+0000","last_unstale":"2024-08-31T04:20:56.998469+0000","last_undegraded":"2024-08-31T04:20:56.998469+0000","last_fullsized":"2024-08-31T04:20:56.998469+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T04:24:41.811202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":21,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:20:57.001244+0000","last_change":"2024-08-31T04:20:42.945142+0000","last_active":"2024-08-31T04:20:57.001244+0000","last_peered":"2024-08-31T04:20:57.001244+0000","last_clean":"2024-08-31T04:20:57.001244+0000","last_became_active":"2024-08-31T04:20:42.944061+0000","last_became_peered":"2024-08-31T04:20:42.944061+0000","last_unstale":"2024-08-31T04:20:57.001244+0000","last_undegraded":"2024-08-31T04:20:57.001244+0000","last_fullsized":"2024-08-31T04:20:57.001244+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:55:09.045257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":21,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:20:57.001166+0000","last_change":"2024-08-31T04:20:42.945844+0000","last_active":"2024-08-31T04:20:57.001166+0000","last_peered":"2024-08-31T04:20:57.001166+0000","last_clean":"2024-08-31T04:20:57.001166+0000","last_became_active":"2024-08-31T04:20:42.944186+0000","last_became_peered":"2024-08-31T04:20:42.944186+0000","last_unstale":"2024-08-31T04:20:57.001166+0000","last_undegraded":"2024-08-31T04:20:57.001166+0000","last_fullsized":"2024-08-31T04:20:57.001166+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:32:46.878700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":21,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:20:57.222782+0000","last_change":"2024-08-31T04:20:42.952871+0000","last_active":"2024-08-31T04:20:57.222782+0000","last_peered":"2024-08-31T04:20:57.222782+0000","last_clean":"2024-08-31T04:20:57.222782+0000","last_became_active":"2024-08-31T04:20:42.952531+0000","last_became_peered":"2024-08-31T04:20:42.952531+0000","last_unstale":"2024-08-31T04:20:57.222782+0000","last_undegraded":"2024-08-31T04:20:57.222782+0000","last_fullsized":"2024-08-31T04:20:57.222782+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:26:01.690119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":21,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:20:57.002008+0000","last_change":"2024-08-31T04:20:42.949822+0000","last_active":"2024-08-31T04:20:57.002008+0000","last_peered":"2024-08-31T04:20:57.002008+0000","last_clean":"2024-08-31T04:20:57.002008+0000","last_became_active":"2024-08-31T04:20:42.949443+0000","last_became_peered":"2024-08-31T04:20:42.949443+0000","last_unstale":"2024-08-31T04:20:57.002008+0000","last_undegraded":"2024-08-31T04:20:57.002008+0000","last_fullsized":"2024-08-31T04:20:57.002008+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:35:48.270606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":21,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:20:57.004840+0000","last_change":"2024-08-31T04:20:42.940895+0000","last_active":"2024-08-31T04:20:57.004840+0000","last_peered":"2024-08-31T04:20:57.004840+0000","last_clean":"2024-08-31T04:20:57.004840+0000","last_became_active":"2024-08-31T04:20:42.940489+0000","last_became_peered":"2024-08-31T04:20:42.940489+0000","last_unstale":"2024-08-31T04:20:57.004840+0000","last_undegraded":"2024-08-31T04:20:57.004840+0000","last_fullsized":"2024-08-31T04:20:57.004840+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T04:42:20.269895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":21,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:20:57.004087+0000","last_change":"2024-08-31T04:20:42.935303+0000","last_active":"2024-08-31T04:20:57.004087+0000","last_peered":"2024-08-31T04:20:57.004087+0000","last_clean":"2024-08-31T04:20:57.004087+0000","last_became_active":"2024-08-31T04:20:42.934931+0000","last_became_peered":"2024-08-31T04:20:42.934931+0000","last_unstale":"2024-08-31T04:20:57.004087+0000","last_undegraded":"2024-08-31T04:20:57.004087+0000","last_fullsized":"2024-08-31T04:20:57.004087+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:34:40.767333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":21,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:20:57.000940+0000","last_change":"2024-08-31T04:20:42.941518+0000","last_active":"2024-08-31T04:20:57.000940+0000","last_peered":"2024-08-31T04:20:57.000940+0000","last_clean":"2024-08-31T04:20:57.000940+0000","last_became_active":"2024-08-31T04:20:42.941142+0000","last_became_peered":"2024-08-31T04:20:42.941142+0000","last_unstale":"2024-08-31T04:20:57.000940+0000","last_undegraded":"2024-08-31T04:20:57.000940+0000","last_fullsized":"2024-08-31T04:20:57.000940+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:27:50.274057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":21,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:20:56.998500+0000","last_change":"2024-08-31T04:20:42.945136+0000","last_active":"2024-08-31T04:20:56.998500+0000","last_peered":"2024-08-31T04:20:56.998500+0000","last_clean":"2024-08-31T04:20:56.998500+0000","last_became_active":"2024-08-31T04:20:42.944811+0000","last_became_peered":"2024-08-31T04:20:42.944811+0000","last_unstale":"2024-08-31T04:20:56.998500+0000","last_undegraded":"2024-08-31T04:20:56.998500+0000","last_fullsized":"2024-08-31T04:20:56.998500+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:30:47.496668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":21,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:20:57.222956+0000","last_change":"2024-08-31T04:20:42.930854+0000","last_active":"2024-08-31T04:20:57.222956+0000","last_peered":"2024-08-31T04:20:57.222956+0000","last_clean":"2024-08-31T04:20:57.222956+0000","last_became_active":"2024-08-31T04:20:42.930490+0000","last_became_peered":"2024-08-31T04:20:42.930490+0000","last_unstale":"2024-08-31T04:20:57.222956+0000","last_undegraded":"2024-08-31T04:20:57.222956+0000","last_fullsized":"2024-08-31T04:20:57.222956+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:16:17.611414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:20:57.009435+0000","last_change":"2024-08-31T04:20:57.008738+0000","last_active":"2024-08-31T04:20:57.009435+0000","last_peered":"2024-08-31T04:20:57.009435+0000","last_clean":"2024-08-31T04:20:57.009435+0000","last_became_active":"2024-08-31T04:20:57.008209+0000","last_became_peered":"2024-08-31T04:20:57.008209+0000","last_unstale":"2024-08-31T04:20:57.009435+0000","last_undegraded":"2024-08-31T04:20:57.009435+0000","last_fullsized":"2024-08-31T04:20:57.009435+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T05:26:22.508955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,11],"acting":[9,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":21,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:20:56.999443+0000","last_change":"2024-08-31T04:20:42.939859+0000","last_active":"2024-08-31T04:20:56.999443+0000","last_peered":"2024-08-31T04:20:56.999443+0000","last_clean":"2024-08-31T04:20:56.999443+0000","last_became_active":"2024-08-31T04:20:42.938315+0000","last_became_peered":"2024-08-31T04:20:42.938315+0000","last_unstale":"2024-08-31T04:20:56.999443+0000","last_undegraded":"2024-08-31T04:20:56.999443+0000","last_fullsized":"2024-08-31T04:20:56.999443+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:13:00.906454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":21,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:20:57.338551+0000","last_change":"2024-08-31T04:20:42.941861+0000","last_active":"2024-08-31T04:20:57.338551+0000","last_peered":"2024-08-31T04:20:57.338551+0000","last_clean":"2024-08-31T04:20:57.338551+0000","last_became_active":"2024-08-31T04:20:42.939556+0000","last_became_peered":"2024-08-31T04:20:42.939556+0000","last_unstale":"2024-08-31T04:20:57.338551+0000","last_undegraded":"2024-08-31T04:20:57.338551+0000","last_fullsized":"2024-08-31T04:20:57.338551+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:02:53.900917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":21,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:20:57.004438+0000","last_change":"2024-08-31T04:20:42.930792+0000","last_active":"2024-08-31T04:20:57.004438+0000","last_peered":"2024-08-31T04:20:57.004438+0000","last_clean":"2024-08-31T04:20:57.004438+0000","last_became_active":"2024-08-31T04:20:42.930014+0000","last_became_peered":"2024-08-31T04:20:42.930014+0000","last_unstale":"2024-08-31T04:20:57.004438+0000","last_undegraded":"2024-08-31T04:20:57.004438+0000","last_fullsized":"2024-08-31T04:20:57.004438+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:18:26.942604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":28,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:20:57.010285+0000","last_change":"2024-08-31T04:20:57.010093+0000","last_active":"2024-08-31T04:20:57.010285+0000","last_peered":"2024-08-31T04:20:57.010285+0000","last_clean":"2024-08-31T04:20:57.010285+0000","last_became_active":"2024-08-31T04:20:57.008759+0000","last_became_peered":"2024-08-31T04:20:57.008759+0000","last_unstale":"2024-08-31T04:20:57.010285+0000","last_undegraded":"2024-08-31T04:20:57.010285+0000","last_fullsized":"2024-08-31T04:20:57.010285+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T06:55:38.276668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,9],"acting":[11,8,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":21,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:20:56.998387+0000","last_change":"2024-08-31T04:20:42.953378+0000","last_active":"2024-08-31T04:20:56.998387+0000","last_peered":"2024-08-31T04:20:56.998387+0000","last_clean":"2024-08-31T04:20:56.998387+0000","last_became_active":"2024-08-31T04:20:42.953030+0000","last_became_peered":"2024-08-31T04:20:42.953030+0000","last_unstale":"2024-08-31T04:20:56.998387+0000","last_undegraded":"2024-08-31T04:20:56.998387+0000","last_fullsized":"2024-08-31T04:20:56.998387+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:24:46.633234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":21,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:20:57.001390+0000","last_change":"2024-08-31T04:20:42.945142+0000","last_active":"2024-08-31T04:20:57.001390+0000","last_peered":"2024-08-31T04:20:57.001390+0000","last_clean":"2024-08-31T04:20:57.001390+0000","last_became_active":"2024-08-31T04:20:42.943960+0000","last_became_peered":"2024-08-31T04:20:42.943960+0000","last_unstale":"2024-08-31T04:20:57.001390+0000","last_undegraded":"2024-08-31T04:20:57.001390+0000","last_fullsized":"2024-08-31T04:20:57.001390+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T04:29:10.501940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":21,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:20:57.003852+0000","last_change":"2024-08-31T04:20:42.946359+0000","last_active":"2024-08-31T04:20:57.003852+0000","last_peered":"2024-08-31T04:20:57.003852+0000","last_clean":"2024-08-31T04:20:57.003852+0000","last_became_active":"2024-08-31T04:20:42.945974+0000","last_became_peered":"2024-08-31T04:20:42.945974+0000","last_unstale":"2024-08-31T04:20:57.003852+0000","last_undegraded":"2024-08-31T04:20:57.003852+0000","last_fullsized":"2024-08-31T04:20:57.003852+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:01:27.808743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":21,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:20:57.003936+0000","last_change":"2024-08-31T04:20:42.930989+0000","last_active":"2024-08-31T04:20:57.003936+0000","last_peered":"2024-08-31T04:20:57.003936+0000","last_clean":"2024-08-31T04:20:57.003936+0000","last_became_active":"2024-08-31T04:20:42.930610+0000","last_became_peered":"2024-08-31T04:20:42.930610+0000","last_unstale":"2024-08-31T04:20:57.003936+0000","last_undegraded":"2024-08-31T04:20:57.003936+0000","last_fullsized":"2024-08-31T04:20:57.003936+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:01:49.473735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":21,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:20:57.001181+0000","last_change":"2024-08-31T04:20:42.930513+0000","last_active":"2024-08-31T04:20:57.001181+0000","last_peered":"2024-08-31T04:20:57.001181+0000","last_clean":"2024-08-31T04:20:57.001181+0000","last_became_active":"2024-08-31T04:20:42.930127+0000","last_became_peered":"2024-08-31T04:20:42.930127+0000","last_unstale":"2024-08-31T04:20:57.001181+0000","last_undegraded":"2024-08-31T04:20:57.001181+0000","last_fullsized":"2024-08-31T04:20:57.001181+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T05:19:55.307816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":21,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:20:57.005865+0000","last_change":"2024-08-31T04:20:42.928217+0000","last_active":"2024-08-31T04:20:57.005865+0000","last_peered":"2024-08-31T04:20:57.005865+0000","last_clean":"2024-08-31T04:20:57.005865+0000","last_became_active":"2024-08-31T04:20:42.927828+0000","last_became_peered":"2024-08-31T04:20:42.927828+0000","last_unstale":"2024-08-31T04:20:57.005865+0000","last_undegraded":"2024-08-31T04:20:57.005865+0000","last_fullsized":"2024-08-31T04:20:57.005865+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:53:21.266734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"78'6","reported_seq":107,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:21:58.146932+0000","last_change":"2024-08-31T04:20:57.229930+0000","last_active":"2024-08-31T04:21:58.146932+0000","last_peered":"2024-08-31T04:21:58.146932+0000","last_clean":"2024-08-31T04:21:58.146932+0000","last_became_active":"2024-08-31T04:20:57.224761+0000","last_became_peered":"2024-08-31T04:20:57.224761+0000","last_unstale":"2024-08-31T04:21:58.146932+0000","last_undegraded":"2024-08-31T04:21:58.146932+0000","last_fullsized":"2024-08-31T04:21:58.146932+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_clean_scrub_stamp":"2024-08-31T04:20:38.871450+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:07:41.723452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1013,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":61,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":622,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":21,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:20:57.000491+0000","last_change":"2024-08-31T04:20:42.939189+0000","last_active":"2024-08-31T04:20:57.000491+0000","last_peered":"2024-08-31T04:20:57.000491+0000","last_clean":"2024-08-31T04:20:57.000491+0000","last_became_active":"2024-08-31T04:20:42.938817+0000","last_became_peered":"2024-08-31T04:20:42.938817+0000","last_unstale":"2024-08-31T04:20:57.000491+0000","last_undegraded":"2024-08-31T04:20:57.000491+0000","last_fullsized":"2024-08-31T04:20:57.000491+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:19:04.407104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"77'7","reported_seq":34,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:20:57.001432+0000","last_change":"2024-08-31T04:20:39.904392+0000","last_active":"2024-08-31T04:20:57.001432+0000","last_peered":"2024-08-31T04:20:57.001432+0000","last_clean":"2024-08-31T04:20:57.001432+0000","last_became_active":"2024-08-31T04:20:39.904014+0000","last_became_peered":"2024-08-31T04:20:39.904014+0000","last_unstale":"2024-08-31T04:20:57.001432+0000","last_undegraded":"2024-08-31T04:20:57.001432+0000","last_fullsized":"2024-08-31T04:20:57.001432+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_clean_scrub_stamp":"2024-08-31T04:20:38.871450+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:33:56.591237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"78'3","reported_seq":30,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:20:56.998239+0000","last_change":"2024-08-31T04:20:39.899521+0000","last_active":"2024-08-31T04:20:56.998239+0000","last_peered":"2024-08-31T04:20:56.998239+0000","last_clean":"2024-08-31T04:20:56.998239+0000","last_became_active":"2024-08-31T04:20:39.899157+0000","last_became_peered":"2024-08-31T04:20:39.899157+0000","last_unstale":"2024-08-31T04:20:56.998239+0000","last_undegraded":"2024-08-31T04:20:56.998239+0000","last_fullsized":"2024-08-31T04:20:56.998239+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_clean_scrub_stamp":"2024-08-31T04:20:38.871450+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:14:47.067149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":21,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:20:57.338276+0000","last_change":"2024-08-31T04:20:42.950653+0000","last_active":"2024-08-31T04:20:57.338276+0000","last_peered":"2024-08-31T04:20:57.338276+0000","last_clean":"2024-08-31T04:20:57.338276+0000","last_became_active":"2024-08-31T04:20:42.949627+0000","last_became_peered":"2024-08-31T04:20:42.949627+0000","last_unstale":"2024-08-31T04:20:57.338276+0000","last_undegraded":"2024-08-31T04:20:57.338276+0000","last_fullsized":"2024-08-31T04:20:57.338276+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:22:00.000717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"78'3","reported_seq":31,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:21:01.048385+0000","last_change":"2024-08-31T04:20:39.908013+0000","last_active":"2024-08-31T04:21:01.048385+0000","last_peered":"2024-08-31T04:21:01.048385+0000","last_clean":"2024-08-31T04:21:01.048385+0000","last_became_active":"2024-08-31T04:20:39.907482+0000","last_became_peered":"2024-08-31T04:20:39.907482+0000","last_unstale":"2024-08-31T04:21:01.048385+0000","last_undegraded":"2024-08-31T04:21:01.048385+0000","last_fullsized":"2024-08-31T04:21:01.048385+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_clean_scrub_stamp":"2024-08-31T04:20:38.871450+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:50:35.466407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":21,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:20:57.004374+0000","last_change":"2024-08-31T04:20:42.944674+0000","last_active":"2024-08-31T04:20:57.004374+0000","last_peered":"2024-08-31T04:20:57.004374+0000","last_clean":"2024-08-31T04:20:57.004374+0000","last_became_active":"2024-08-31T04:20:42.944424+0000","last_became_peered":"2024-08-31T04:20:42.944424+0000","last_unstale":"2024-08-31T04:20:57.004374+0000","last_undegraded":"2024-08-31T04:20:57.004374+0000","last_fullsized":"2024-08-31T04:20:57.004374+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:10:27.772835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"77'4","reported_seq":151,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:22:01.151165+0000","last_change":"2024-08-31T04:20:39.904188+0000","last_active":"2024-08-31T04:22:01.151165+0000","last_peered":"2024-08-31T04:22:01.151165+0000","last_clean":"2024-08-31T04:22:01.151165+0000","last_became_active":"2024-08-31T04:20:39.903789+0000","last_became_peered":"2024-08-31T04:20:39.903789+0000","last_unstale":"2024-08-31T04:22:01.151165+0000","last_undegraded":"2024-08-31T04:22:01.151165+0000","last_fullsized":"2024-08-31T04:22:01.151165+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_clean_scrub_stamp":"2024-08-31T04:20:38.871450+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T06:54:38.881746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":120,"num_read_kb":120,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":21,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:20:57.223134+0000","last_change":"2024-08-31T04:20:42.932961+0000","last_active":"2024-08-31T04:20:57.223134+0000","last_peered":"2024-08-31T04:20:57.223134+0000","last_clean":"2024-08-31T04:20:57.223134+0000","last_became_active":"2024-08-31T04:20:42.932562+0000","last_became_peered":"2024-08-31T04:20:42.932562+0000","last_unstale":"2024-08-31T04:20:57.223134+0000","last_undegraded":"2024-08-31T04:20:57.223134+0000","last_fullsized":"2024-08-31T04:20:57.223134+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:20:36.827300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"78'4","reported_seq":31,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:21:01.049286+0000","last_change":"2024-08-31T04:20:39.902279+0000","last_active":"2024-08-31T04:21:01.049286+0000","last_peered":"2024-08-31T04:21:01.049286+0000","last_clean":"2024-08-31T04:21:01.049286+0000","last_became_active":"2024-08-31T04:20:39.901822+0000","last_became_peered":"2024-08-31T04:20:39.901822+0000","last_unstale":"2024-08-31T04:21:01.049286+0000","last_undegraded":"2024-08-31T04:21:01.049286+0000","last_fullsized":"2024-08-31T04:21:01.049286+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_clean_scrub_stamp":"2024-08-31T04:20:38.871450+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:48:09.609644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":28,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:20:57.009187+0000","last_change":"2024-08-31T04:20:57.008955+0000","last_active":"2024-08-31T04:20:57.009187+0000","last_peered":"2024-08-31T04:20:57.009187+0000","last_clean":"2024-08-31T04:20:57.009187+0000","last_became_active":"2024-08-31T04:20:57.008487+0000","last_became_peered":"2024-08-31T04:20:57.008487+0000","last_unstale":"2024-08-31T04:20:57.009187+0000","last_undegraded":"2024-08-31T04:20:57.009187+0000","last_fullsized":"2024-08-31T04:20:57.009187+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:26:23.399089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,5],"acting":[0,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"77'5","reported_seq":33,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:20:56.999868+0000","last_change":"2024-08-31T04:20:39.992197+0000","last_active":"2024-08-31T04:20:56.999868+0000","last_peered":"2024-08-31T04:20:56.999868+0000","last_clean":"2024-08-31T04:20:56.999868+0000","last_became_active":"2024-08-31T04:20:39.991835+0000","last_became_peered":"2024-08-31T04:20:39.991835+0000","last_unstale":"2024-08-31T04:20:56.999868+0000","last_undegraded":"2024-08-31T04:20:56.999868+0000","last_fullsized":"2024-08-31T04:20:56.999868+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_clean_scrub_stamp":"2024-08-31T04:20:38.871450+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:38:02.808469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":21,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:20:57.223159+0000","last_change":"2024-08-31T04:20:42.934874+0000","last_active":"2024-08-31T04:20:57.223159+0000","last_peered":"2024-08-31T04:20:57.223159+0000","last_clean":"2024-08-31T04:20:57.223159+0000","last_became_active":"2024-08-31T04:20:42.934500+0000","last_became_peered":"2024-08-31T04:20:42.934500+0000","last_unstale":"2024-08-31T04:20:57.223159+0000","last_undegraded":"2024-08-31T04:20:57.223159+0000","last_fullsized":"2024-08-31T04:20:57.223159+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:32:59.785563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"78'31","reported_seq":187,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:22:01.151132+0000","last_change":"2024-08-31T04:20:39.907452+0000","last_active":"2024-08-31T04:22:01.151132+0000","last_peered":"2024-08-31T04:22:01.151132+0000","last_clean":"2024-08-31T04:22:01.151132+0000","last_became_active":"2024-08-31T04:20:39.907071+0000","last_became_peered":"2024-08-31T04:20:39.907071+0000","last_unstale":"2024-08-31T04:22:01.151132+0000","last_undegraded":"2024-08-31T04:22:01.151132+0000","last_fullsized":"2024-08-31T04:22:01.151132+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_clean_scrub_stamp":"2024-08-31T04:20:38.871450+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:21:33.318332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":59762,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":129,"num_read_kb":122,"num_write":33,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":21,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:20:57.006637+0000","last_change":"2024-08-31T04:20:42.937750+0000","last_active":"2024-08-31T04:20:57.006637+0000","last_peered":"2024-08-31T04:20:57.006637+0000","last_clean":"2024-08-31T04:20:57.006637+0000","last_became_active":"2024-08-31T04:20:42.937386+0000","last_became_peered":"2024-08-31T04:20:42.937386+0000","last_unstale":"2024-08-31T04:20:57.006637+0000","last_undegraded":"2024-08-31T04:20:57.006637+0000","last_fullsized":"2024-08-31T04:20:57.006637+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:14:03.123558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"78'9","reported_seq":38,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:21:02.054531+0000","last_change":"2024-08-31T04:20:39.902815+0000","last_active":"2024-08-31T04:21:02.054531+0000","last_peered":"2024-08-31T04:21:02.054531+0000","last_clean":"2024-08-31T04:21:02.054531+0000","last_became_active":"2024-08-31T04:20:39.900473+0000","last_became_peered":"2024-08-31T04:20:39.900473+0000","last_unstale":"2024-08-31T04:21:02.054531+0000","last_undegraded":"2024-08-31T04:21:02.054531+0000","last_fullsized":"2024-08-31T04:21:02.054531+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_clean_scrub_stamp":"2024-08-31T04:20:38.871450+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:42:03.902102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":21,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:20:56.998214+0000","last_change":"2024-08-31T04:20:42.932333+0000","last_active":"2024-08-31T04:20:56.998214+0000","last_peered":"2024-08-31T04:20:56.998214+0000","last_clean":"2024-08-31T04:20:56.998214+0000","last_became_active":"2024-08-31T04:20:42.931902+0000","last_became_peered":"2024-08-31T04:20:42.931902+0000","last_unstale":"2024-08-31T04:20:56.998214+0000","last_undegraded":"2024-08-31T04:20:56.998214+0000","last_fullsized":"2024-08-31T04:20:56.998214+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:46:44.716941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"78'5","reported_seq":33,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:21:01.048755+0000","last_change":"2024-08-31T04:20:39.901541+0000","last_active":"2024-08-31T04:21:01.048755+0000","last_peered":"2024-08-31T04:21:01.048755+0000","last_clean":"2024-08-31T04:21:01.048755+0000","last_became_active":"2024-08-31T04:20:39.901116+0000","last_became_peered":"2024-08-31T04:20:39.901116+0000","last_unstale":"2024-08-31T04:21:01.048755+0000","last_undegraded":"2024-08-31T04:21:01.048755+0000","last_fullsized":"2024-08-31T04:21:01.048755+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_clean_scrub_stamp":"2024-08-31T04:20:38.871450+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:57:51.458017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":21,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:20:57.003686+0000","last_change":"2024-08-31T04:20:42.936355+0000","last_active":"2024-08-31T04:20:57.003686+0000","last_peered":"2024-08-31T04:20:57.003686+0000","last_clean":"2024-08-31T04:20:57.003686+0000","last_became_active":"2024-08-31T04:20:42.935975+0000","last_became_peered":"2024-08-31T04:20:42.935975+0000","last_unstale":"2024-08-31T04:20:57.003686+0000","last_undegraded":"2024-08-31T04:20:57.003686+0000","last_fullsized":"2024-08-31T04:20:57.003686+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:37:24.867700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"78'6","reported_seq":95,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:21:59.148816+0000","last_change":"2024-08-31T04:20:39.901314+0000","last_active":"2024-08-31T04:21:59.148816+0000","last_peered":"2024-08-31T04:21:59.148816+0000","last_clean":"2024-08-31T04:21:59.148816+0000","last_became_active":"2024-08-31T04:20:39.900780+0000","last_became_peered":"2024-08-31T04:20:39.900780+0000","last_unstale":"2024-08-31T04:21:59.148816+0000","last_undegraded":"2024-08-31T04:21:59.148816+0000","last_fullsized":"2024-08-31T04:21:59.148816+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_clean_scrub_stamp":"2024-08-31T04:20:38.871450+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:59:40.500765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":979,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":63,"num_read_kb":4,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":21,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:20:57.003241+0000","last_change":"2024-08-31T04:20:42.934382+0000","last_active":"2024-08-31T04:20:57.003241+0000","last_peered":"2024-08-31T04:20:57.003241+0000","last_clean":"2024-08-31T04:20:57.003241+0000","last_became_active":"2024-08-31T04:20:42.933986+0000","last_became_peered":"2024-08-31T04:20:42.933986+0000","last_unstale":"2024-08-31T04:20:57.003241+0000","last_undegraded":"2024-08-31T04:20:57.003241+0000","last_fullsized":"2024-08-31T04:20:57.003241+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:12:16.372504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"78'17","reported_seq":45,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:21:01.047381+0000","last_change":"2024-08-31T04:20:39.990817+0000","last_active":"2024-08-31T04:21:01.047381+0000","last_peered":"2024-08-31T04:21:01.047381+0000","last_clean":"2024-08-31T04:21:01.047381+0000","last_became_active":"2024-08-31T04:20:39.990379+0000","last_became_peered":"2024-08-31T04:20:39.990379+0000","last_unstale":"2024-08-31T04:21:01.047381+0000","last_undegraded":"2024-08-31T04:21:01.047381+0000","last_fullsized":"2024-08-31T04:21:01.047381+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_clean_scrub_stamp":"2024-08-31T04:20:38.871450+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:42:27.435142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":21,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:20:56.999443+0000","last_change":"2024-08-31T04:20:42.942430+0000","last_active":"2024-08-31T04:20:56.999443+0000","last_peered":"2024-08-31T04:20:56.999443+0000","last_clean":"2024-08-31T04:20:56.999443+0000","last_became_active":"2024-08-31T04:20:42.942067+0000","last_became_peered":"2024-08-31T04:20:42.942067+0000","last_unstale":"2024-08-31T04:20:56.999443+0000","last_undegraded":"2024-08-31T04:20:56.999443+0000","last_fullsized":"2024-08-31T04:20:56.999443+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:48:52.441499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"77'2","reported_seq":30,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:20:57.007144+0000","last_change":"2024-08-31T04:20:39.903815+0000","last_active":"2024-08-31T04:20:57.007144+0000","last_peered":"2024-08-31T04:20:57.007144+0000","last_clean":"2024-08-31T04:20:57.007144+0000","last_became_active":"2024-08-31T04:20:39.903183+0000","last_became_peered":"2024-08-31T04:20:39.903183+0000","last_unstale":"2024-08-31T04:20:57.007144+0000","last_undegraded":"2024-08-31T04:20:57.007144+0000","last_fullsized":"2024-08-31T04:20:57.007144+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_clean_scrub_stamp":"2024-08-31T04:20:38.871450+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:39:50.862711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":28,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:20:57.004968+0000","last_change":"2024-08-31T04:20:57.004852+0000","last_active":"2024-08-31T04:20:57.004968+0000","last_peered":"2024-08-31T04:20:57.004968+0000","last_clean":"2024-08-31T04:20:57.004968+0000","last_became_active":"2024-08-31T04:20:57.004435+0000","last_became_peered":"2024-08-31T04:20:57.004435+0000","last_unstale":"2024-08-31T04:20:57.004968+0000","last_undegraded":"2024-08-31T04:20:57.004968+0000","last_fullsized":"2024-08-31T04:20:57.004968+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T06:16:19.010305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,6],"acting":[11,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"78'5","reported_seq":32,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:21:01.047330+0000","last_change":"2024-08-31T04:20:39.901493+0000","last_active":"2024-08-31T04:21:01.047330+0000","last_peered":"2024-08-31T04:21:01.047330+0000","last_clean":"2024-08-31T04:21:01.047330+0000","last_became_active":"2024-08-31T04:20:39.901072+0000","last_became_peered":"2024-08-31T04:20:39.901072+0000","last_unstale":"2024-08-31T04:21:01.047330+0000","last_undegraded":"2024-08-31T04:21:01.047330+0000","last_fullsized":"2024-08-31T04:21:01.047330+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_clean_scrub_stamp":"2024-08-31T04:20:38.871450+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:26:43.893882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":21,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:20:57.004118+0000","last_change":"2024-08-31T04:20:42.938270+0000","last_active":"2024-08-31T04:20:57.004118+0000","last_peered":"2024-08-31T04:20:57.004118+0000","last_clean":"2024-08-31T04:20:57.004118+0000","last_became_active":"2024-08-31T04:20:42.937851+0000","last_became_peered":"2024-08-31T04:20:42.937851+0000","last_unstale":"2024-08-31T04:20:57.004118+0000","last_undegraded":"2024-08-31T04:20:57.004118+0000","last_fullsized":"2024-08-31T04:20:57.004118+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:29:09.315106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"78'3","reported_seq":31,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:21:01.049001+0000","last_change":"2024-08-31T04:20:39.905785+0000","last_active":"2024-08-31T04:21:01.049001+0000","last_peered":"2024-08-31T04:21:01.049001+0000","last_clean":"2024-08-31T04:21:01.049001+0000","last_became_active":"2024-08-31T04:20:39.905403+0000","last_became_peered":"2024-08-31T04:20:39.905403+0000","last_unstale":"2024-08-31T04:21:01.049001+0000","last_undegraded":"2024-08-31T04:21:01.049001+0000","last_fullsized":"2024-08-31T04:21:01.049001+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_clean_scrub_stamp":"2024-08-31T04:20:38.871450+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:48:04.743543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"78'1","reported_seq":22,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:20:57.003984+0000","last_change":"2024-08-31T04:20:42.934433+0000","last_active":"2024-08-31T04:20:57.003984+0000","last_peered":"2024-08-31T04:20:57.003984+0000","last_clean":"2024-08-31T04:20:57.003984+0000","last_became_active":"2024-08-31T04:20:42.934058+0000","last_became_peered":"2024-08-31T04:20:42.934058+0000","last_unstale":"2024-08-31T04:20:57.003984+0000","last_undegraded":"2024-08-31T04:20:57.003984+0000","last_fullsized":"2024-08-31T04:20:57.003984+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:34:42.988905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"78'6","reported_seq":96,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:22:00.150160+0000","last_change":"2024-08-31T04:20:40.202403+0000","last_active":"2024-08-31T04:22:00.150160+0000","last_peered":"2024-08-31T04:22:00.150160+0000","last_clean":"2024-08-31T04:22:00.150160+0000","last_became_active":"2024-08-31T04:20:40.201918+0000","last_became_peered":"2024-08-31T04:20:40.201918+0000","last_unstale":"2024-08-31T04:22:00.150160+0000","last_undegraded":"2024-08-31T04:22:00.150160+0000","last_fullsized":"2024-08-31T04:22:00.150160+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_clean_scrub_stamp":"2024-08-31T04:20:38.871450+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:31:26.675413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1561,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":63,"num_read_kb":3,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":21,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:20:57.004028+0000","last_change":"2024-08-31T04:20:42.931040+0000","last_active":"2024-08-31T04:20:57.004028+0000","last_peered":"2024-08-31T04:20:57.004028+0000","last_clean":"2024-08-31T04:20:57.004028+0000","last_became_active":"2024-08-31T04:20:42.930692+0000","last_became_peered":"2024-08-31T04:20:42.930692+0000","last_unstale":"2024-08-31T04:20:57.004028+0000","last_undegraded":"2024-08-31T04:20:57.004028+0000","last_fullsized":"2024-08-31T04:20:57.004028+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T06:12:23.175092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"20'92","reported_seq":98,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:20:57.003457+0000","last_change":"2024-08-31T04:19:21.361791+0000","last_active":"2024-08-31T04:20:57.003457+0000","last_peered":"2024-08-31T04:20:57.003457+0000","last_clean":"2024-08-31T04:20:57.003457+0000","last_became_active":"2024-08-31T04:19:21.356128+0000","last_became_peered":"2024-08-31T04:19:21.356128+0000","last_unstale":"2024-08-31T04:20:57.003457+0000","last_undegraded":"2024-08-31T04:20:57.003457+0000","last_fullsized":"2024-08-31T04:20:57.003457+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:15:46.442365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:15:46.442365+0000","last_clean_scrub_stamp":"2024-08-31T04:15:46.442365+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:23:05.688680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"78'6","reported_seq":36,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:21:02.053432+0000","last_change":"2024-08-31T04:20:39.904625+0000","last_active":"2024-08-31T04:21:02.053432+0000","last_peered":"2024-08-31T04:21:02.053432+0000","last_clean":"2024-08-31T04:21:02.053432+0000","last_became_active":"2024-08-31T04:20:39.904245+0000","last_became_peered":"2024-08-31T04:20:39.904245+0000","last_unstale":"2024-08-31T04:21:02.053432+0000","last_undegraded":"2024-08-31T04:21:02.053432+0000","last_fullsized":"2024-08-31T04:21:02.053432+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_clean_scrub_stamp":"2024-08-31T04:20:38.871450+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:31:34.711047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":21,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:20:57.338391+0000","last_change":"2024-08-31T04:20:42.944224+0000","last_active":"2024-08-31T04:20:57.338391+0000","last_peered":"2024-08-31T04:20:57.338391+0000","last_clean":"2024-08-31T04:20:57.338391+0000","last_became_active":"2024-08-31T04:20:42.943469+0000","last_became_peered":"2024-08-31T04:20:42.943469+0000","last_unstale":"2024-08-31T04:20:57.338391+0000","last_undegraded":"2024-08-31T04:20:57.338391+0000","last_fullsized":"2024-08-31T04:20:57.338391+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:27:48.533319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"78'4","reported_seq":31,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:20:57.003498+0000","last_change":"2024-08-31T04:20:39.902613+0000","last_active":"2024-08-31T04:20:57.003498+0000","last_peered":"2024-08-31T04:20:57.003498+0000","last_clean":"2024-08-31T04:20:57.003498+0000","last_became_active":"2024-08-31T04:20:39.902033+0000","last_became_peered":"2024-08-31T04:20:39.902033+0000","last_unstale":"2024-08-31T04:20:57.003498+0000","last_undegraded":"2024-08-31T04:20:57.003498+0000","last_fullsized":"2024-08-31T04:20:57.003498+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_clean_scrub_stamp":"2024-08-31T04:20:38.871450+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:13:58.497781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":21,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:20:56.998151+0000","last_change":"2024-08-31T04:20:42.933541+0000","last_active":"2024-08-31T04:20:56.998151+0000","last_peered":"2024-08-31T04:20:56.998151+0000","last_clean":"2024-08-31T04:20:56.998151+0000","last_became_active":"2024-08-31T04:20:42.933155+0000","last_became_peered":"2024-08-31T04:20:42.933155+0000","last_unstale":"2024-08-31T04:20:56.998151+0000","last_undegraded":"2024-08-31T04:20:56.998151+0000","last_fullsized":"2024-08-31T04:20:56.998151+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:22:41.298103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"78'5","reported_seq":91,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:21:58.146575+0000","last_change":"2024-08-31T04:20:39.992067+0000","last_active":"2024-08-31T04:21:58.146575+0000","last_peered":"2024-08-31T04:21:58.146575+0000","last_clean":"2024-08-31T04:21:58.146575+0000","last_became_active":"2024-08-31T04:20:39.991645+0000","last_became_peered":"2024-08-31T04:20:39.991645+0000","last_unstale":"2024-08-31T04:21:58.146575+0000","last_undegraded":"2024-08-31T04:21:58.146575+0000","last_fullsized":"2024-08-31T04:21:58.146575+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_clean_scrub_stamp":"2024-08-31T04:20:38.871450+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:41:18.012094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":59,"num_read_kb":59,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":21,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:20:56.999491+0000","last_change":"2024-08-31T04:20:42.937324+0000","last_active":"2024-08-31T04:20:56.999491+0000","last_peered":"2024-08-31T04:20:56.999491+0000","last_clean":"2024-08-31T04:20:56.999491+0000","last_became_active":"2024-08-31T04:20:42.936926+0000","last_became_peered":"2024-08-31T04:20:42.936926+0000","last_unstale":"2024-08-31T04:20:56.999491+0000","last_undegraded":"2024-08-31T04:20:56.999491+0000","last_fullsized":"2024-08-31T04:20:56.999491+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:34:57.158304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"78'5","reported_seq":92,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:21:59.148777+0000","last_change":"2024-08-31T04:20:39.905365+0000","last_active":"2024-08-31T04:21:59.148777+0000","last_peered":"2024-08-31T04:21:59.148777+0000","last_clean":"2024-08-31T04:21:59.148777+0000","last_became_active":"2024-08-31T04:20:39.904772+0000","last_became_peered":"2024-08-31T04:20:39.904772+0000","last_unstale":"2024-08-31T04:21:59.148777+0000","last_undegraded":"2024-08-31T04:21:59.148777+0000","last_fullsized":"2024-08-31T04:21:59.148777+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_clean_scrub_stamp":"2024-08-31T04:20:38.871450+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T05:20:23.781639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":60,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":21,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:20:57.001600+0000","last_change":"2024-08-31T04:20:42.944303+0000","last_active":"2024-08-31T04:20:57.001600+0000","last_peered":"2024-08-31T04:20:57.001600+0000","last_clean":"2024-08-31T04:20:57.001600+0000","last_became_active":"2024-08-31T04:20:42.943938+0000","last_became_peered":"2024-08-31T04:20:42.943938+0000","last_unstale":"2024-08-31T04:20:57.001600+0000","last_undegraded":"2024-08-31T04:20:57.001600+0000","last_fullsized":"2024-08-31T04:20:57.001600+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T06:51:28.734751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"77'1","reported_seq":28,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:20:57.004633+0000","last_change":"2024-08-31T04:20:39.993135+0000","last_active":"2024-08-31T04:20:57.004633+0000","last_peered":"2024-08-31T04:20:57.004633+0000","last_clean":"2024-08-31T04:20:57.004633+0000","last_became_active":"2024-08-31T04:20:39.991569+0000","last_became_peered":"2024-08-31T04:20:39.991569+0000","last_unstale":"2024-08-31T04:20:57.004633+0000","last_undegraded":"2024-08-31T04:20:57.004633+0000","last_fullsized":"2024-08-31T04:20:57.004633+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_clean_scrub_stamp":"2024-08-31T04:20:38.871450+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:44:04.375810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"78'1","reported_seq":22,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:20:57.002559+0000","last_change":"2024-08-31T04:20:42.939721+0000","last_active":"2024-08-31T04:20:57.002559+0000","last_peered":"2024-08-31T04:20:57.002559+0000","last_clean":"2024-08-31T04:20:57.002559+0000","last_became_active":"2024-08-31T04:20:42.939380+0000","last_became_peered":"2024-08-31T04:20:42.939380+0000","last_unstale":"2024-08-31T04:20:57.002559+0000","last_undegraded":"2024-08-31T04:20:57.002559+0000","last_fullsized":"2024-08-31T04:20:57.002559+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:55:06.901719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"78'4","reported_seq":32,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:21:01.047625+0000","last_change":"2024-08-31T04:20:39.990968+0000","last_active":"2024-08-31T04:21:01.047625+0000","last_peered":"2024-08-31T04:21:01.047625+0000","last_clean":"2024-08-31T04:21:01.047625+0000","last_became_active":"2024-08-31T04:20:39.990583+0000","last_became_peered":"2024-08-31T04:20:39.990583+0000","last_unstale":"2024-08-31T04:21:01.047625+0000","last_undegraded":"2024-08-31T04:21:01.047625+0000","last_fullsized":"2024-08-31T04:21:01.047625+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_clean_scrub_stamp":"2024-08-31T04:20:38.871450+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:54:39.168179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":21,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:20:56.998550+0000","last_change":"2024-08-31T04:20:42.932914+0000","last_active":"2024-08-31T04:20:56.998550+0000","last_peered":"2024-08-31T04:20:56.998550+0000","last_clean":"2024-08-31T04:20:56.998550+0000","last_became_active":"2024-08-31T04:20:42.932523+0000","last_became_peered":"2024-08-31T04:20:42.932523+0000","last_unstale":"2024-08-31T04:20:56.998550+0000","last_undegraded":"2024-08-31T04:20:56.998550+0000","last_fullsized":"2024-08-31T04:20:56.998550+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:52:49.133428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"78'16","reported_seq":43,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:21:14.953864+0000","last_change":"2024-08-31T04:20:39.903373+0000","last_active":"2024-08-31T04:21:14.953864+0000","last_peered":"2024-08-31T04:21:14.953864+0000","last_clean":"2024-08-31T04:21:14.953864+0000","last_became_active":"2024-08-31T04:20:39.902784+0000","last_became_peered":"2024-08-31T04:20:39.902784+0000","last_unstale":"2024-08-31T04:21:14.953864+0000","last_undegraded":"2024-08-31T04:21:14.953864+0000","last_fullsized":"2024-08-31T04:21:14.953864+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_clean_scrub_stamp":"2024-08-31T04:20:38.871450+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:43:32.251846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":21,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:20:57.338679+0000","last_change":"2024-08-31T04:20:42.939252+0000","last_active":"2024-08-31T04:20:57.338679+0000","last_peered":"2024-08-31T04:20:57.338679+0000","last_clean":"2024-08-31T04:20:57.338679+0000","last_became_active":"2024-08-31T04:20:42.936671+0000","last_became_peered":"2024-08-31T04:20:42.936671+0000","last_unstale":"2024-08-31T04:20:57.338679+0000","last_undegraded":"2024-08-31T04:20:57.338679+0000","last_fullsized":"2024-08-31T04:20:57.338679+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:37:57.544627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"78'7","reported_seq":35,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:21:01.049714+0000","last_change":"2024-08-31T04:20:40.202412+0000","last_active":"2024-08-31T04:21:01.049714+0000","last_peered":"2024-08-31T04:21:01.049714+0000","last_clean":"2024-08-31T04:21:01.049714+0000","last_became_active":"2024-08-31T04:20:40.202000+0000","last_became_peered":"2024-08-31T04:20:40.202000+0000","last_unstale":"2024-08-31T04:21:01.049714+0000","last_undegraded":"2024-08-31T04:21:01.049714+0000","last_fullsized":"2024-08-31T04:21:01.049714+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_clean_scrub_stamp":"2024-08-31T04:20:38.871450+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:24:23.528379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":21,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:20:57.001587+0000","last_change":"2024-08-31T04:20:42.949174+0000","last_active":"2024-08-31T04:20:57.001587+0000","last_peered":"2024-08-31T04:20:57.001587+0000","last_clean":"2024-08-31T04:20:57.001587+0000","last_became_active":"2024-08-31T04:20:42.948013+0000","last_became_peered":"2024-08-31T04:20:42.948013+0000","last_unstale":"2024-08-31T04:20:57.001587+0000","last_undegraded":"2024-08-31T04:20:57.001587+0000","last_fullsized":"2024-08-31T04:20:57.001587+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:36:00.572991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"76'2","reported_seq":29,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:20:57.223195+0000","last_change":"2024-08-31T04:20:39.992477+0000","last_active":"2024-08-31T04:20:57.223195+0000","last_peered":"2024-08-31T04:20:57.223195+0000","last_clean":"2024-08-31T04:20:57.223195+0000","last_became_active":"2024-08-31T04:20:39.992082+0000","last_became_peered":"2024-08-31T04:20:39.992082+0000","last_unstale":"2024-08-31T04:20:57.223195+0000","last_undegraded":"2024-08-31T04:20:57.223195+0000","last_fullsized":"2024-08-31T04:20:57.223195+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_clean_scrub_stamp":"2024-08-31T04:20:38.871450+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:10:35.058693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":21,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:20:57.005828+0000","last_change":"2024-08-31T04:20:42.933915+0000","last_active":"2024-08-31T04:20:57.005828+0000","last_peered":"2024-08-31T04:20:57.005828+0000","last_clean":"2024-08-31T04:20:57.005828+0000","last_became_active":"2024-08-31T04:20:42.933525+0000","last_became_peered":"2024-08-31T04:20:42.933525+0000","last_unstale":"2024-08-31T04:20:57.005828+0000","last_undegraded":"2024-08-31T04:20:57.005828+0000","last_fullsized":"2024-08-31T04:20:57.005828+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:03:35.191136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"78'7","reported_seq":34,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:21:01.047578+0000","last_change":"2024-08-31T04:20:39.903979+0000","last_active":"2024-08-31T04:21:01.047578+0000","last_peered":"2024-08-31T04:21:01.047578+0000","last_clean":"2024-08-31T04:21:01.047578+0000","last_became_active":"2024-08-31T04:20:39.903538+0000","last_became_peered":"2024-08-31T04:20:39.903538+0000","last_unstale":"2024-08-31T04:21:01.047578+0000","last_undegraded":"2024-08-31T04:21:01.047578+0000","last_fullsized":"2024-08-31T04:21:01.047578+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_clean_scrub_stamp":"2024-08-31T04:20:38.871450+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:25:15.944692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":21,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:20:57.001683+0000","last_change":"2024-08-31T04:20:42.947511+0000","last_active":"2024-08-31T04:20:57.001683+0000","last_peered":"2024-08-31T04:20:57.001683+0000","last_clean":"2024-08-31T04:20:57.001683+0000","last_became_active":"2024-08-31T04:20:42.947116+0000","last_became_peered":"2024-08-31T04:20:42.947116+0000","last_unstale":"2024-08-31T04:20:57.001683+0000","last_undegraded":"2024-08-31T04:20:57.001683+0000","last_fullsized":"2024-08-31T04:20:57.001683+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:00:53.022229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"78'3","reported_seq":30,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:20:57.004076+0000","last_change":"2024-08-31T04:20:39.903409+0000","last_active":"2024-08-31T04:20:57.004076+0000","last_peered":"2024-08-31T04:20:57.004076+0000","last_clean":"2024-08-31T04:20:57.004076+0000","last_became_active":"2024-08-31T04:20:39.900366+0000","last_became_peered":"2024-08-31T04:20:39.900366+0000","last_unstale":"2024-08-31T04:20:57.004076+0000","last_undegraded":"2024-08-31T04:20:57.004076+0000","last_fullsized":"2024-08-31T04:20:57.004076+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_clean_scrub_stamp":"2024-08-31T04:20:38.871450+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:01:24.809923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":21,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:20:57.338464+0000","last_change":"2024-08-31T04:20:42.953207+0000","last_active":"2024-08-31T04:20:57.338464+0000","last_peered":"2024-08-31T04:20:57.338464+0000","last_clean":"2024-08-31T04:20:57.338464+0000","last_became_active":"2024-08-31T04:20:42.952854+0000","last_became_peered":"2024-08-31T04:20:42.952854+0000","last_unstale":"2024-08-31T04:20:57.338464+0000","last_undegraded":"2024-08-31T04:20:57.338464+0000","last_fullsized":"2024-08-31T04:20:57.338464+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:33:11.495216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"76'4","reported_seq":21,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:21:00.180014+0000","last_change":"2024-08-31T04:20:57.016087+0000","last_active":"2024-08-31T04:21:00.180014+0000","last_peered":"2024-08-31T04:21:00.180014+0000","last_clean":"2024-08-31T04:21:00.180014+0000","last_became_active":"2024-08-31T04:20:57.005476+0000","last_became_peered":"2024-08-31T04:20:57.005476+0000","last_unstale":"2024-08-31T04:21:00.180014+0000","last_undegraded":"2024-08-31T04:21:00.180014+0000","last_fullsized":"2024-08-31T04:21:00.180014+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_clean_scrub_stamp":"2024-08-31T04:20:38.871450+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:22:21.768548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,7],"acting":[11,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":21,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:20:57.003500+0000","last_change":"2024-08-31T04:20:42.933249+0000","last_active":"2024-08-31T04:20:57.003500+0000","last_peered":"2024-08-31T04:20:57.003500+0000","last_clean":"2024-08-31T04:20:57.003500+0000","last_became_active":"2024-08-31T04:20:42.931651+0000","last_became_peered":"2024-08-31T04:20:42.931651+0000","last_unstale":"2024-08-31T04:20:57.003500+0000","last_undegraded":"2024-08-31T04:20:57.003500+0000","last_fullsized":"2024-08-31T04:20:57.003500+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T06:40:21.010108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":21,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:20:57.000156+0000","last_change":"2024-08-31T04:20:42.942418+0000","last_active":"2024-08-31T04:20:57.000156+0000","last_peered":"2024-08-31T04:20:57.000156+0000","last_clean":"2024-08-31T04:20:57.000156+0000","last_became_active":"2024-08-31T04:20:42.942072+0000","last_became_peered":"2024-08-31T04:20:42.942072+0000","last_unstale":"2024-08-31T04:20:57.000156+0000","last_undegraded":"2024-08-31T04:20:57.000156+0000","last_fullsized":"2024-08-31T04:20:57.000156+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T04:41:38.816730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"78'5","reported_seq":33,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:21:01.049947+0000","last_change":"2024-08-31T04:20:39.903399+0000","last_active":"2024-08-31T04:21:01.049947+0000","last_peered":"2024-08-31T04:21:01.049947+0000","last_clean":"2024-08-31T04:21:01.049947+0000","last_became_active":"2024-08-31T04:20:39.902732+0000","last_became_peered":"2024-08-31T04:20:39.902732+0000","last_unstale":"2024-08-31T04:21:01.049947+0000","last_undegraded":"2024-08-31T04:21:01.049947+0000","last_fullsized":"2024-08-31T04:21:01.049947+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_clean_scrub_stamp":"2024-08-31T04:20:38.871450+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:07:25.324109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":21,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:20:57.223222+0000","last_change":"2024-08-31T04:20:42.931570+0000","last_active":"2024-08-31T04:20:57.223222+0000","last_peered":"2024-08-31T04:20:57.223222+0000","last_clean":"2024-08-31T04:20:57.223222+0000","last_became_active":"2024-08-31T04:20:42.931162+0000","last_became_peered":"2024-08-31T04:20:42.931162+0000","last_unstale":"2024-08-31T04:20:57.223222+0000","last_undegraded":"2024-08-31T04:20:57.223222+0000","last_fullsized":"2024-08-31T04:20:57.223222+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:55:58.784723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"78'12","reported_seq":27,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:21:02.054140+0000","last_change":"2024-08-31T04:20:57.020014+0000","last_active":"2024-08-31T04:21:02.054140+0000","last_peered":"2024-08-31T04:21:02.054140+0000","last_clean":"2024-08-31T04:21:02.054140+0000","last_became_active":"2024-08-31T04:20:57.009489+0000","last_became_peered":"2024-08-31T04:20:57.009489+0000","last_unstale":"2024-08-31T04:21:02.054140+0000","last_undegraded":"2024-08-31T04:21:02.054140+0000","last_fullsized":"2024-08-31T04:21:02.054140+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_clean_scrub_stamp":"2024-08-31T04:20:38.871450+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T05:22:57.227296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":10,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,7],"acting":[11,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":21,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:20:57.001803+0000","last_change":"2024-08-31T04:20:42.947868+0000","last_active":"2024-08-31T04:20:57.001803+0000","last_peered":"2024-08-31T04:20:57.001803+0000","last_clean":"2024-08-31T04:20:57.001803+0000","last_became_active":"2024-08-31T04:20:42.946628+0000","last_became_peered":"2024-08-31T04:20:42.946628+0000","last_unstale":"2024-08-31T04:20:57.001803+0000","last_undegraded":"2024-08-31T04:20:57.001803+0000","last_fullsized":"2024-08-31T04:20:57.001803+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:47:10.939205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"76'2","reported_seq":29,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:20:57.338782+0000","last_change":"2024-08-31T04:20:39.991234+0000","last_active":"2024-08-31T04:20:57.338782+0000","last_peered":"2024-08-31T04:20:57.338782+0000","last_clean":"2024-08-31T04:20:57.338782+0000","last_became_active":"2024-08-31T04:20:39.990416+0000","last_became_peered":"2024-08-31T04:20:39.990416+0000","last_unstale":"2024-08-31T04:20:57.338782+0000","last_undegraded":"2024-08-31T04:20:57.338782+0000","last_fullsized":"2024-08-31T04:20:57.338782+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_clean_scrub_stamp":"2024-08-31T04:20:38.871450+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:47:43.392522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":21,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:20:57.338520+0000","last_change":"2024-08-31T04:20:42.942017+0000","last_active":"2024-08-31T04:20:57.338520+0000","last_peered":"2024-08-31T04:20:57.338520+0000","last_clean":"2024-08-31T04:20:57.338520+0000","last_became_active":"2024-08-31T04:20:42.939661+0000","last_became_peered":"2024-08-31T04:20:42.939661+0000","last_unstale":"2024-08-31T04:20:57.338520+0000","last_undegraded":"2024-08-31T04:20:57.338520+0000","last_fullsized":"2024-08-31T04:20:57.338520+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:13:39.521066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"78'13","reported_seq":100,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:21:59.148225+0000","last_change":"2024-08-31T04:20:39.905996+0000","last_active":"2024-08-31T04:21:59.148225+0000","last_peered":"2024-08-31T04:21:59.148225+0000","last_clean":"2024-08-31T04:21:59.148225+0000","last_became_active":"2024-08-31T04:20:39.905622+0000","last_became_peered":"2024-08-31T04:20:39.905622+0000","last_unstale":"2024-08-31T04:21:59.148225+0000","last_undegraded":"2024-08-31T04:21:59.148225+0000","last_fullsized":"2024-08-31T04:21:59.148225+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_clean_scrub_stamp":"2024-08-31T04:20:38.871450+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:53:36.672295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":60,"num_read_kb":60,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":67357,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":635,"num_read_kb":392,"num_write":247,"num_write_kb":136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":622,"num_keys_recovered":10,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":565248,"data_stored":202071,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":212,"ondisk_log_size":212,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":245760,"data_stored":2951840,"data_compressed":181705,"data_compressed_allocated":225280,"data_compressed_original":2949120,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":68,"seq":292057776158,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32012,"kb_used_data":828,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713140,"statfs":{"total":95995035648,"available":95962255360,"internally_reserved":0,"allocated":847872,"data_stored":413656,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":63,"seq":270582939682,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28004,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717148,"statfs":{"total":95995035648,"available":95966359552,"internally_reserved":0,"allocated":1003520,"data_stored":1064447,"data_compressed":36341,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":58,"seq":249108103209,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36196,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708956,"statfs":{"total":95995035648,"available":95957970944,"internally_reserved":0,"allocated":872448,"data_stored":413195,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,5,6,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":52,"seq":223338299437,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27872,"kb_used_data":848,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717280,"statfs":{"total":95995035648,"available":95966494720,"internally_reserved":0,"allocated":868352,"data_stored":413573,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":47,"seq":201863462964,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27924,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717228,"statfs":{"total":95995035648,"available":95966441472,"internally_reserved":0,"allocated":921600,"data_stored":1006482,"data_compressed":36341,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":42,"seq":180388626488,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32020,"kb_used_data":836,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713132,"statfs":{"total":95995035648,"available":95962247168,"internally_reserved":0,"allocated":856064,"data_stored":412912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":36,"seq":154618822719,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27936,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717216,"statfs":{"total":95995035648,"available":95966429184,"internally_reserved":0,"allocated":933888,"data_stored":1005769,"data_compressed":36341,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986243,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27860,"kb_used_data":836,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717292,"statfs":{"total":95995035648,"available":95966507008,"internally_reserved":0,"allocated":856064,"data_stored":413164,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182471,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36196,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708956,"statfs":{"total":95995035648,"available":95957970944,"internally_reserved":0,"allocated":872448,"data_stored":412737,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411407,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27932,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717220,"statfs":{"total":95995035648,"available":95966433280,"internally_reserved":0,"allocated":929792,"data_stored":473576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574931,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27928,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717224,"statfs":{"total":95995035648,"available":95966437376,"internally_reserved":0,"allocated":925696,"data_stored":474600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738454,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27880,"kb_used_data":856,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717272,"statfs":{"total":95995035648,"available":95966486528,"internally_reserved":0,"allocated":876544,"data_stored":414642,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36341,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36341,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36341,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36341,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36341,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2569,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":62527,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":61503,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1091,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3211,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3924,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":61889,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1583,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-31T04:22:04.547 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-08-31T04:22:04.547 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-08-31T04:22:04.547 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2024-08-31T04:22:04.547 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 058d9fc6-674f-11ef-bcd4-c7b262605968 -- ceph health --format=json 2024-08-31T04:22:04.926 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:22:05.566 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:05.564+0000 7ffb99c00640 1 -- 172.21.15.50:0/4004631135 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffb9410b290 msgr2=0x7ffb9410b6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:22:05.566 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:05.564+0000 7ffb99c00640 1 --2- 172.21.15.50:0/4004631135 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffb9410b290 0x7ffb9410b6a0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7ffb7c009900 tx=0x7ffb7c02a3f0 comp rx=0 tx=0).stop 2024-08-31T04:22:05.566 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:05.564+0000 7ffb99c00640 1 -- 172.21.15.50:0/4004631135 shutdown_connections 2024-08-31T04:22:05.566 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:05.564+0000 7ffb99c00640 1 --2- 172.21.15.50:0/4004631135 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ffb9410bbe0 0x7ffb94112410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:05.566 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:05.564+0000 7ffb99c00640 1 --2- 172.21.15.50:0/4004631135 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffb9410b290 0x7ffb9410b6a0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:05.566 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:05.564+0000 7ffb99c00640 1 --2- 172.21.15.50:0/4004631135 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ffb94105950 0x7ffb94105d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:05.566 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:05.564+0000 7ffb99c00640 1 -- 172.21.15.50:0/4004631135 >> 172.21.15.50:0/4004631135 conn(0x7ffb94101420 msgr2=0x7ffb94103870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:22:05.566 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:05.564+0000 7ffb99c00640 1 -- 172.21.15.50:0/4004631135 shutdown_connections 2024-08-31T04:22:05.567 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:05.564+0000 7ffb99c00640 1 -- 172.21.15.50:0/4004631135 wait complete. 2024-08-31T04:22:05.568 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:05.565+0000 7ffb99c00640 1 Processor -- start 2024-08-31T04:22:05.568 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:05.565+0000 7ffb99c00640 1 -- start start 2024-08-31T04:22:05.568 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:05.566+0000 7ffb99c00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ffb94105950 0x7ffb9419c2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:05.568 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:05.566+0000 7ffb99c00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffb9410b290 0x7ffb9419c850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:05.568 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:05.566+0000 7ffb99c00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ffb9410bbe0 0x7ffb941a1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:05.568 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:05.566+0000 7ffb99c00640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7ffb941158a0 con 0x7ffb9410b290 2024-08-31T04:22:05.568 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:05.566+0000 7ffb99c00640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7ffb94115720 con 0x7ffb9410bbe0 2024-08-31T04:22:05.569 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:05.566+0000 7ffb99c00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7ffb94115a20 con 0x7ffb94105950 2024-08-31T04:22:05.569 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:05.566+0000 7ffb93e00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ffb94105950 0x7ffb9419c2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:22:05.569 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:05.566+0000 7ffb8be00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffb9410b290 0x7ffb9419c850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:22:05.569 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:05.566+0000 7ffb93e00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ffb94105950 0x7ffb9419c2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.50:48494/0 (socket says 172.21.15.50:48494) 2024-08-31T04:22:05.569 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:05.566+0000 7ffb93e00640 1 -- 172.21.15.50:0/1551080337 learned_addr learned my addr 172.21.15.50:0/1551080337 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:22:05.569 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:05.566+0000 7ffb99200640 1 --2- 172.21.15.50:0/1551080337 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ffb9410bbe0 0x7ffb941a1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:22:05.569 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:05.567+0000 7ffb93e00640 1 -- 172.21.15.50:0/1551080337 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ffb9410bbe0 msgr2=0x7ffb941a1af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:22:05.569 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:05.567+0000 7ffb93e00640 1 --2- 172.21.15.50:0/1551080337 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ffb9410bbe0 0x7ffb941a1af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:05.569 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:05.567+0000 7ffb93e00640 1 -- 172.21.15.50:0/1551080337 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffb9410b290 msgr2=0x7ffb9419c850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:22:05.569 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:05.567+0000 7ffb93e00640 1 --2- 172.21.15.50:0/1551080337 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffb9410b290 0x7ffb9419c850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:05.569 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:05.567+0000 7ffb93e00640 1 -- 172.21.15.50:0/1551080337 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb941a2220 con 0x7ffb94105950 2024-08-31T04:22:05.569 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:05.567+0000 7ffb8be00640 1 --2- 172.21.15.50:0/1551080337 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffb9410b290 0x7ffb9419c850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:22:05.569 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:05.567+0000 7ffb93e00640 1 --2- 172.21.15.50:0/1551080337 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ffb94105950 0x7ffb9419c2b0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7ffb8400d950 tx=0x7ffb8400de10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:22:05.570 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:05.567+0000 7ffb91600640 1 -- 172.21.15.50:0/1551080337 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb84017030 con 0x7ffb94105950 2024-08-31T04:22:05.570 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:05.567+0000 7ffb99c00640 1 -- 172.21.15.50:0/1551080337 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffb941a2510 con 0x7ffb94105950 2024-08-31T04:22:05.570 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:05.567+0000 7ffb91600640 1 -- 172.21.15.50:0/1551080337 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ffb84004020 con 0x7ffb94105950 2024-08-31T04:22:05.571 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:05.567+0000 7ffb91600640 1 -- 172.21.15.50:0/1551080337 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb840047a0 con 0x7ffb94105950 2024-08-31T04:22:05.571 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:05.567+0000 7ffb99c00640 1 -- 172.21.15.50:0/1551080337 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffb941a8c70 con 0x7ffb94105950 2024-08-31T04:22:05.571 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:05.568+0000 7ffb99c00640 1 -- 172.21.15.50:0/1551080337 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffb94105d60 con 0x7ffb94105950 2024-08-31T04:22:05.572 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:05.571+0000 7ffb91600640 1 -- 172.21.15.50:0/1551080337 <== mon.1 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 17) ==== 152628+0+0 (secure 0 0 0) 0x7ffb84009a30 con 0x7ffb94105950 2024-08-31T04:22:05.574 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:05.572+0000 7ffb91600640 1 --2- 172.21.15.50:0/1551080337 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7ffb780b4bc0 0x7ffb780b70d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:05.574 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:05.572+0000 7ffb91600640 1 -- 172.21.15.50:0/1551080337 <== mon.1 v2:172.21.15.177:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8219+0+0 (secure 0 0 0) 0x7ffb840e53c0 con 0x7ffb94105950 2024-08-31T04:22:05.574 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:05.573+0000 7ffb8be00640 1 --2- 172.21.15.50:0/1551080337 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7ffb780b4bc0 0x7ffb780b70d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:22:05.574 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:05.573+0000 7ffb8be00640 1 --2- 172.21.15.50:0/1551080337 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7ffb780b4bc0 0x7ffb780b70d0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7ffb7c009230 tx=0x7ffb7c031400 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:22:05.575 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:05.574+0000 7ffb91600640 1 -- 172.21.15.50:0/1551080337 <== mon.1 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7ffb840ac340 con 0x7ffb94105950 2024-08-31T04:22:05.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:22:05 smithi050 ceph-mon[17259]: from='client.15009 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-31T04:22:05.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:22:05 smithi050 ceph-mon[17259]: pgmap v342: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-08-31T04:22:05.747 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:22:05 smithi177 ceph-mon[22025]: from='client.15009 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-31T04:22:05.747 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:22:05 smithi177 ceph-mon[22025]: pgmap v342: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-08-31T04:22:05.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:22:05 smithi133 ceph-mon[22177]: from='client.15009 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-31T04:22:05.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:22:05 smithi133 ceph-mon[22177]: pgmap v342: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-08-31T04:22:05.811 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:05.809+0000 7ffb99c00640 1 -- 172.21.15.50:0/1551080337 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7ffb9419d3e0 con 0x7ffb94105950 2024-08-31T04:22:05.811 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:05.810+0000 7ffb91600640 1 -- 172.21.15.50:0/1551080337 <== mon.1 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7ffb840abc40 con 0x7ffb94105950 2024-08-31T04:22:05.811 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-08-31T04:22:05.811 INFO:teuthology.orchestra.run.smithi050.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-08-31T04:22:05.814 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:05.812+0000 7ffb99c00640 1 -- 172.21.15.50:0/1551080337 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7ffb780b4bc0 msgr2=0x7ffb780b70d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:22:05.814 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:05.812+0000 7ffb99c00640 1 --2- 172.21.15.50:0/1551080337 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7ffb780b4bc0 0x7ffb780b70d0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7ffb7c009230 tx=0x7ffb7c031400 comp rx=0 tx=0).stop 2024-08-31T04:22:05.814 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:05.812+0000 7ffb99c00640 1 -- 172.21.15.50:0/1551080337 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ffb94105950 msgr2=0x7ffb9419c2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:22:05.814 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:05.812+0000 7ffb99c00640 1 --2- 172.21.15.50:0/1551080337 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ffb94105950 0x7ffb9419c2b0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7ffb8400d950 tx=0x7ffb8400de10 comp rx=0 tx=0).stop 2024-08-31T04:22:05.814 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:05.813+0000 7ffb99c00640 1 -- 172.21.15.50:0/1551080337 shutdown_connections 2024-08-31T04:22:05.814 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:05.813+0000 7ffb99c00640 1 --2- 172.21.15.50:0/1551080337 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7ffb780b4bc0 0x7ffb780b70d0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:05.814 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:05.813+0000 7ffb99c00640 1 --2- 172.21.15.50:0/1551080337 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ffb9410bbe0 0x7ffb941a1af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:05.814 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:05.813+0000 7ffb99c00640 1 --2- 172.21.15.50:0/1551080337 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffb9410b290 0x7ffb9419c850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:05.814 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:05.813+0000 7ffb99c00640 1 --2- 172.21.15.50:0/1551080337 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ffb94105950 0x7ffb9419c2b0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:05.815 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:05.813+0000 7ffb99c00640 1 -- 172.21.15.50:0/1551080337 >> 172.21.15.50:0/1551080337 conn(0x7ffb94101420 msgr2=0x7ffb94103840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:22:05.815 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:05.813+0000 7ffb99c00640 1 -- 172.21.15.50:0/1551080337 shutdown_connections 2024-08-31T04:22:05.815 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:05.813+0000 7ffb99c00640 1 -- 172.21.15.50:0/1551080337 wait complete. 2024-08-31T04:22:06.653 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:22:06 smithi050 ceph-mon[17259]: from='client.? 172.21.15.50:0/1551080337' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2024-08-31T04:22:06.691 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2024-08-31T04:22:06.691 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 058d9fc6-674f-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-31T04:22:06.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:22:06 smithi177 ceph-mon[22025]: from='client.? 172.21.15.50:0/1551080337' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2024-08-31T04:22:06.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:22:06 smithi133 ceph-mon[22177]: from='client.? 172.21.15.50:0/1551080337' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2024-08-31T04:22:07.068 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:22:07.499 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:22:07 smithi050 ceph-mon[17259]: pgmap v343: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2024-08-31T04:22:07.678 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:07.676+0000 7f0295600640 1 -- 172.21.15.50:0/3783431419 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0290105b20 msgr2=0x7f0290105f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:22:07.678 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:07.676+0000 7f0295600640 1 --2- 172.21.15.50:0/3783431419 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0290105b20 0x7f0290105f30 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f0280009900 tx=0x7f028002a3f0 comp rx=0 tx=0).stop 2024-08-31T04:22:07.678 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:07.676+0000 7f0295600640 1 -- 172.21.15.50:0/3783431419 shutdown_connections 2024-08-31T04:22:07.678 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:07.676+0000 7f0295600640 1 --2- 172.21.15.50:0/3783431419 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f029010b460 0x7f029010b870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:07.679 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:07.676+0000 7f0295600640 1 --2- 172.21.15.50:0/3783431419 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f029010bdb0 0x7f02901125e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:07.679 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:07.676+0000 7f0295600640 1 --2- 172.21.15.50:0/3783431419 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0290105b20 0x7f0290105f30 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:07.679 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:07.676+0000 7f0295600640 1 -- 172.21.15.50:0/3783431419 >> 172.21.15.50:0/3783431419 conn(0x7f0290101570 msgr2=0x7f02901039c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:22:07.679 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:07.676+0000 7f0295600640 1 -- 172.21.15.50:0/3783431419 shutdown_connections 2024-08-31T04:22:07.679 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:07.676+0000 7f0295600640 1 -- 172.21.15.50:0/3783431419 wait complete. 2024-08-31T04:22:07.684 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:07.677+0000 7f0295600640 1 Processor -- start 2024-08-31T04:22:07.684 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:07.677+0000 7f0295600640 1 -- start start 2024-08-31T04:22:07.684 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:07.677+0000 7f0295600640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0290105b20 0x7f029019c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:07.684 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:07.677+0000 7f0295600640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f029010b460 0x7f029019ca20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:07.685 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:07.678+0000 7f0295600640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f029010bdb0 0x7f02901a1cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:07.685 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:07.678+0000 7f0295600640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f0290115a70 con 0x7f0290105b20 2024-08-31T04:22:07.685 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:07.678+0000 7f0295600640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f02901158f0 con 0x7f029010bdb0 2024-08-31T04:22:07.685 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:07.678+0000 7f0295600640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f0290115bf0 con 0x7f029010b460 2024-08-31T04:22:07.685 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:07.678+0000 7f028ea00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0290105b20 0x7f029019c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:22:07.686 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:07.678+0000 7f028ea00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0290105b20 0x7f029019c480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:58508/0 (socket says 172.21.15.50:58508) 2024-08-31T04:22:07.686 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:07.678+0000 7f028ea00640 1 -- 172.21.15.50:0/47731966 learned_addr learned my addr 172.21.15.50:0/47731966 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:22:07.686 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:07.678+0000 7f0286000640 1 --2- 172.21.15.50:0/47731966 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f029010b460 0x7f029019ca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:22:07.686 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:07.678+0000 7f028f400640 1 --2- 172.21.15.50:0/47731966 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f029010bdb0 0x7f02901a1cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:22:07.686 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:07.678+0000 7f028ea00640 1 -- 172.21.15.50:0/47731966 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f029010b460 msgr2=0x7f029019ca20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:22:07.687 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:07.678+0000 7f028ea00640 1 --2- 172.21.15.50:0/47731966 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f029010b460 0x7f029019ca20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:07.687 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:07.678+0000 7f028ea00640 1 -- 172.21.15.50:0/47731966 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f029010bdb0 msgr2=0x7f02901a1cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:22:07.687 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:07.678+0000 7f028ea00640 1 --2- 172.21.15.50:0/47731966 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f029010bdb0 0x7f02901a1cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:07.687 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:07.678+0000 7f028ea00640 1 -- 172.21.15.50:0/47731966 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02901a23f0 con 0x7f0290105b20 2024-08-31T04:22:07.687 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:07.678+0000 7f0286000640 1 --2- 172.21.15.50:0/47731966 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f029010b460 0x7f029019ca20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:22:07.687 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:07.678+0000 7f028f400640 1 --2- 172.21.15.50:0/47731966 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f029010bdb0 0x7f02901a1cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:22:07.688 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:07.679+0000 7f028ea00640 1 --2- 172.21.15.50:0/47731966 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0290105b20 0x7f029019c480 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f0280005940 tx=0x7f02800040c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:22:07.688 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:07.679+0000 7f0287e00640 1 -- 172.21.15.50:0/47731966 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f028003f030 con 0x7f0290105b20 2024-08-31T04:22:07.688 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:07.679+0000 7f0287e00640 1 -- 172.21.15.50:0/47731966 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f02800044c0 con 0x7f0290105b20 2024-08-31T04:22:07.688 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:07.679+0000 7f0287e00640 1 -- 172.21.15.50:0/47731966 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0280035070 con 0x7f0290105b20 2024-08-31T04:22:07.688 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:07.679+0000 7f0295600640 1 -- 172.21.15.50:0/47731966 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f02901a2680 con 0x7f0290105b20 2024-08-31T04:22:07.689 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:07.679+0000 7f0295600640 1 -- 172.21.15.50:0/47731966 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f02901a8e40 con 0x7f0290105b20 2024-08-31T04:22:07.689 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:07.680+0000 7f0295600640 1 -- 172.21.15.50:0/47731966 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0290106da0 con 0x7f0290105b20 2024-08-31T04:22:07.689 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:07.683+0000 7f0287e00640 1 -- 172.21.15.50:0/47731966 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 17) ==== 152628+0+0 (secure 0 0 0) 0x7f0280042030 con 0x7f0290105b20 2024-08-31T04:22:07.690 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:07.684+0000 7f0287e00640 1 --2- 172.21.15.50:0/47731966 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f02740b4c40 0x7f02740b7150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:07.691 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:07.684+0000 7f0287e00640 1 -- 172.21.15.50:0/47731966 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8219+0+0 (secure 0 0 0) 0x7f0280105600 con 0x7f0290105b20 2024-08-31T04:22:07.691 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:07.684+0000 7f0286000640 1 --2- 172.21.15.50:0/47731966 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f02740b4c40 0x7f02740b7150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:22:07.691 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:07.685+0000 7f0286000640 1 --2- 172.21.15.50:0/47731966 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f02740b4c40 0x7f02740b7150 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f029010afa0 tx=0x7f0278005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:22:07.691 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:07.688+0000 7f0287e00640 1 -- 172.21.15.50:0/47731966 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f02800cbf30 con 0x7f0290105b20 2024-08-31T04:22:07.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:22:07 smithi177 ceph-mon[22025]: pgmap v343: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2024-08-31T04:22:07.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:22:07 smithi133 ceph-mon[22177]: pgmap v343: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2024-08-31T04:22:07.924 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:07.923+0000 7f0295600640 1 -- 172.21.15.50:0/47731966 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f029010db80 con 0x7f0290105b20 2024-08-31T04:22:07.925 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:07.924+0000 7f0287e00640 1 -- 172.21.15.50:0/47731966 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11983 (secure 0 0 0) 0x7f02800d06f0 con 0x7f0290105b20 2024-08-31T04:22:07.925 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-08-31T04:22:07.925 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":28,"btime":"2024-08-31T04:21:02:045794+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14622,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/1565557530","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":1565557530},{"type":"v1","addr":"172.21.15.50:6835","nonce":1565557530}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14634,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6837/2660185946","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6836","nonce":2660185946},{"type":"v1","addr":"172.21.15.50:6837","nonce":2660185946}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-31T04:20:44.140709+0000","modified":"2024-08-31T04:21:02.045763+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24695,"mds_1":24691,"mds_2":24667,"mds_3":24656,"mds_4":24652},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14676":{"gid":14676,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.50:6839/2105228685","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6838","nonce":2105228685},{"type":"v1","addr":"172.21.15.50:6839","nonce":2105228685}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24590":{"gid":24590,"name":"k","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.133:6833/4283603962","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6832","nonce":4283603962},{"type":"v1","addr":"172.21.15.133:6833","nonce":4283603962}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24601":{"gid":24601,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.177:6833/1237129793","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":1237129793},{"type":"v1","addr":"172.21.15.177:6833","nonce":1237129793}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24626":{"gid":24626,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.133:6835/3637799701","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":3637799701},{"type":"v1","addr":"172.21.15.133:6835","nonce":3637799701}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24640":{"gid":24640,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.177:6835/599392457","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6834","nonce":599392457},{"type":"v1","addr":"172.21.15.177:6835","nonce":599392457}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24652":{"gid":24652,"name":"c","rank":4,"incarnation":26,"state":"up:active","state_seq":13,"addr":"172.21.15.177:6837/2159859285","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6836","nonce":2159859285},{"type":"v1","addr":"172.21.15.177:6837","nonce":2159859285}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24656":{"gid":24656,"name":"h","rank":3,"incarnation":22,"state":"up:active","state_seq":12,"addr":"172.21.15.133:6837/4014853202","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6836","nonce":4014853202},{"type":"v1","addr":"172.21.15.133:6837","nonce":4014853202}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24667":{"gid":24667,"name":"i","rank":2,"incarnation":20,"state":"up:active","state_seq":10,"addr":"172.21.15.177:6839/3600081752","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6838","nonce":3600081752},{"type":"v1","addr":"172.21.15.177:6839","nonce":3600081752}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24691":{"gid":24691,"name":"a","rank":1,"incarnation":18,"state":"up:active","state_seq":8,"addr":"172.21.15.50:6841/575209862","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6840","nonce":575209862},{"type":"v1","addr":"172.21.15.50:6841","nonce":575209862}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24695":{"gid":24695,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.133:6839/2526402262","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6838","nonce":2526402262},{"type":"v1","addr":"172.21.15.133:6839","nonce":2526402262}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24695,"qdb_cluster":[24667,24695,24656,24691,24652]},"id":1}]} 2024-08-31T04:22:07.926 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 28 2024-08-31T04:22:07.927 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:07.926+0000 7f0295600640 1 -- 172.21.15.50:0/47731966 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f02740b4c40 msgr2=0x7f02740b7150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:22:07.927 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:07.926+0000 7f0295600640 1 --2- 172.21.15.50:0/47731966 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f02740b4c40 0x7f02740b7150 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f029010afa0 tx=0x7f0278005f90 comp rx=0 tx=0).stop 2024-08-31T04:22:07.927 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:07.926+0000 7f0295600640 1 -- 172.21.15.50:0/47731966 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0290105b20 msgr2=0x7f029019c480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:22:07.928 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:07.926+0000 7f0295600640 1 --2- 172.21.15.50:0/47731966 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0290105b20 0x7f029019c480 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f0280005940 tx=0x7f02800040c0 comp rx=0 tx=0).stop 2024-08-31T04:22:07.928 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:07.926+0000 7f0295600640 1 -- 172.21.15.50:0/47731966 shutdown_connections 2024-08-31T04:22:07.928 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:07.926+0000 7f0295600640 1 --2- 172.21.15.50:0/47731966 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f02740b4c40 0x7f02740b7150 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:07.928 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:07.926+0000 7f0295600640 1 --2- 172.21.15.50:0/47731966 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f029010b460 0x7f029019ca20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:07.928 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:07.926+0000 7f0295600640 1 --2- 172.21.15.50:0/47731966 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f029010bdb0 0x7f02901a1cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:07.928 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:07.926+0000 7f0295600640 1 --2- 172.21.15.50:0/47731966 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0290105b20 0x7f029019c480 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:07.928 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:07.926+0000 7f0295600640 1 -- 172.21.15.50:0/47731966 >> 172.21.15.50:0/47731966 conn(0x7f0290101570 msgr2=0x7f0290103990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:22:07.928 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:07.926+0000 7f0295600640 1 -- 172.21.15.50:0/47731966 shutdown_connections 2024-08-31T04:22:07.928 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:07.926+0000 7f0295600640 1 -- 172.21.15.50:0/47731966 wait complete. 2024-08-31T04:22:08.637 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:22:08 smithi050 ceph-mon[17259]: from='client.? 172.21.15.50:0/47731966' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T04:22:08.674 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 058d9fc6-674f-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-31T04:22:08.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:22:08 smithi177 ceph-mon[22025]: from='client.? 172.21.15.50:0/47731966' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T04:22:08.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:22:08 smithi133 ceph-mon[22177]: from='client.? 172.21.15.50:0/47731966' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T04:22:09.049 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:22:09.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:22:09 smithi050 ceph-mon[17259]: pgmap v344: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-08-31T04:22:09.710 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:09.708+0000 7fc68d400640 1 -- 172.21.15.50:0/3615014600 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc68810ff40 msgr2=0x7fc688112360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:22:09.710 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:09.708+0000 7fc68d400640 1 --2- 172.21.15.50:0/3615014600 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc68810ff40 0x7fc688112360 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fc680009ca0 tx=0x7fc68002a950 comp rx=0 tx=0).stop 2024-08-31T04:22:09.710 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:09.708+0000 7fc68d400640 1 -- 172.21.15.50:0/3615014600 shutdown_connections 2024-08-31T04:22:09.710 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:09.708+0000 7fc68d400640 1 --2- 172.21.15.50:0/3615014600 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc688102ce0 0x7fc68810fa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:09.710 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:09.708+0000 7fc68d400640 1 --2- 172.21.15.50:0/3615014600 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc68810ff40 0x7fc688112360 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:09.710 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:09.708+0000 7fc68d400640 1 --2- 172.21.15.50:0/3615014600 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc688102390 0x7fc6881027a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:09.711 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:09.708+0000 7fc68d400640 1 -- 172.21.15.50:0/3615014600 >> 172.21.15.50:0/3615014600 conn(0x7fc6880794e0 msgr2=0x7fc6880798f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:22:09.711 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:09.709+0000 7fc68d400640 1 -- 172.21.15.50:0/3615014600 shutdown_connections 2024-08-31T04:22:09.711 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:09.709+0000 7fc68d400640 1 -- 172.21.15.50:0/3615014600 wait complete. 2024-08-31T04:22:09.712 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:09.710+0000 7fc68d400640 1 Processor -- start 2024-08-31T04:22:09.712 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:09.710+0000 7fc68d400640 1 -- start start 2024-08-31T04:22:09.712 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:09.710+0000 7fc68d400640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc688102390 0x7fc68819c3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:09.712 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:09.710+0000 7fc68d400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc688102ce0 0x7fc68819c940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:09.712 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:09.710+0000 7fc68d400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc68810ff40 0x7fc6881a1be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:09.712 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:09.710+0000 7fc68d400640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fc688115a30 con 0x7fc688102ce0 2024-08-31T04:22:09.712 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:09.710+0000 7fc68d400640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7fc6881158b0 con 0x7fc68810ff40 2024-08-31T04:22:09.712 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:09.710+0000 7fc68d400640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fc688115bb0 con 0x7fc688102390 2024-08-31T04:22:09.712 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:09.711+0000 7fc67fe00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc688102ce0 0x7fc68819c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:22:09.712 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:09.711+0000 7fc67fe00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc688102ce0 0x7fc68819c940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:58522/0 (socket says 172.21.15.50:58522) 2024-08-31T04:22:09.713 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:09.711+0000 7fc686800640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc688102390 0x7fc68819c3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:22:09.713 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:09.711+0000 7fc67fe00640 1 -- 172.21.15.50:0/560687842 learned_addr learned my addr 172.21.15.50:0/560687842 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:22:09.713 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:09.711+0000 7fc687200640 1 --2- 172.21.15.50:0/560687842 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc68810ff40 0x7fc6881a1be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:22:09.713 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:09.711+0000 7fc67fe00640 1 -- 172.21.15.50:0/560687842 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc688102390 msgr2=0x7fc68819c3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:22:09.714 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:09.711+0000 7fc67fe00640 1 --2- 172.21.15.50:0/560687842 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc688102390 0x7fc68819c3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:09.714 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:09.711+0000 7fc67fe00640 1 -- 172.21.15.50:0/560687842 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc68810ff40 msgr2=0x7fc6881a1be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:22:09.714 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:09.711+0000 7fc67fe00640 1 --2- 172.21.15.50:0/560687842 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc68810ff40 0x7fc6881a1be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:09.714 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:09.711+0000 7fc67fe00640 1 -- 172.21.15.50:0/560687842 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6881a2310 con 0x7fc688102ce0 2024-08-31T04:22:09.714 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:09.711+0000 7fc67fe00640 1 --2- 172.21.15.50:0/560687842 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc688102ce0 0x7fc68819c940 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fc67000e9f0 tx=0x7fc67000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:22:09.714 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:09.712+0000 7fc67f400640 1 -- 172.21.15.50:0/560687842 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc67000cd80 con 0x7fc688102ce0 2024-08-31T04:22:09.714 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:09.712+0000 7fc67f400640 1 -- 172.21.15.50:0/560687842 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc6700108e0 con 0x7fc688102ce0 2024-08-31T04:22:09.714 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:09.712+0000 7fc67f400640 1 -- 172.21.15.50:0/560687842 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc670018980 con 0x7fc688102ce0 2024-08-31T04:22:09.714 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:09.712+0000 7fc68d400640 1 -- 172.21.15.50:0/560687842 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc6881a2600 con 0x7fc688102ce0 2024-08-31T04:22:09.714 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:09.712+0000 7fc68d400640 1 -- 172.21.15.50:0/560687842 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc6881a8d60 con 0x7fc688102ce0 2024-08-31T04:22:09.715 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:09.713+0000 7fc68d400640 1 -- 172.21.15.50:0/560687842 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc68806bfe0 con 0x7fc688102ce0 2024-08-31T04:22:09.717 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:09.716+0000 7fc67f400640 1 -- 172.21.15.50:0/560687842 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 17) ==== 152628+0+0 (secure 0 0 0) 0x7fc670010430 con 0x7fc688102ce0 2024-08-31T04:22:09.719 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:09.718+0000 7fc67f400640 1 --2- 172.21.15.50:0/560687842 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fc66c0b4c40 0x7fc66c0b7150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:09.719 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:09.718+0000 7fc67f400640 1 -- 172.21.15.50:0/560687842 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8219+0+0 (secure 0 0 0) 0x7fc6700e5e00 con 0x7fc688102ce0 2024-08-31T04:22:09.719 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:09.718+0000 7fc686800640 1 --2- 172.21.15.50:0/560687842 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fc66c0b4c40 0x7fc66c0b7150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:22:09.720 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:09.719+0000 7fc686800640 1 --2- 172.21.15.50:0/560687842 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fc66c0b4c40 0x7fc66c0b7150 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fc678009bd0 tx=0x7fc678005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:22:09.720 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:09.719+0000 7fc67f400640 1 -- 172.21.15.50:0/560687842 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fc6700acde0 con 0x7fc688102ce0 2024-08-31T04:22:09.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:22:09 smithi177 ceph-mon[22025]: pgmap v344: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-08-31T04:22:09.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:22:09 smithi133 ceph-mon[22177]: pgmap v344: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-08-31T04:22:09.951 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:09.950+0000 7fc68d400640 1 -- 172.21.15.50:0/560687842 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc68819d4d0 con 0x7fc688102ce0 2024-08-31T04:22:09.952 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:09.951+0000 7fc67f400640 1 -- 172.21.15.50:0/560687842 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11983 (secure 0 0 0) 0x7fc6700b5320 con 0x7fc688102ce0 2024-08-31T04:22:09.952 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-08-31T04:22:09.953 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":28,"btime":"2024-08-31T04:21:02:045794+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14622,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/1565557530","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":1565557530},{"type":"v1","addr":"172.21.15.50:6835","nonce":1565557530}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14634,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6837/2660185946","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6836","nonce":2660185946},{"type":"v1","addr":"172.21.15.50:6837","nonce":2660185946}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-31T04:20:44.140709+0000","modified":"2024-08-31T04:21:02.045763+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24695,"mds_1":24691,"mds_2":24667,"mds_3":24656,"mds_4":24652},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14676":{"gid":14676,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.50:6839/2105228685","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6838","nonce":2105228685},{"type":"v1","addr":"172.21.15.50:6839","nonce":2105228685}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24590":{"gid":24590,"name":"k","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.133:6833/4283603962","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6832","nonce":4283603962},{"type":"v1","addr":"172.21.15.133:6833","nonce":4283603962}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24601":{"gid":24601,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.177:6833/1237129793","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":1237129793},{"type":"v1","addr":"172.21.15.177:6833","nonce":1237129793}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24626":{"gid":24626,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.133:6835/3637799701","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":3637799701},{"type":"v1","addr":"172.21.15.133:6835","nonce":3637799701}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24640":{"gid":24640,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.177:6835/599392457","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6834","nonce":599392457},{"type":"v1","addr":"172.21.15.177:6835","nonce":599392457}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24652":{"gid":24652,"name":"c","rank":4,"incarnation":26,"state":"up:active","state_seq":13,"addr":"172.21.15.177:6837/2159859285","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6836","nonce":2159859285},{"type":"v1","addr":"172.21.15.177:6837","nonce":2159859285}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24656":{"gid":24656,"name":"h","rank":3,"incarnation":22,"state":"up:active","state_seq":12,"addr":"172.21.15.133:6837/4014853202","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6836","nonce":4014853202},{"type":"v1","addr":"172.21.15.133:6837","nonce":4014853202}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24667":{"gid":24667,"name":"i","rank":2,"incarnation":20,"state":"up:active","state_seq":10,"addr":"172.21.15.177:6839/3600081752","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6838","nonce":3600081752},{"type":"v1","addr":"172.21.15.177:6839","nonce":3600081752}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24691":{"gid":24691,"name":"a","rank":1,"incarnation":18,"state":"up:active","state_seq":8,"addr":"172.21.15.50:6841/575209862","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6840","nonce":575209862},{"type":"v1","addr":"172.21.15.50:6841","nonce":575209862}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24695":{"gid":24695,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.133:6839/2526402262","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6838","nonce":2526402262},{"type":"v1","addr":"172.21.15.133:6839","nonce":2526402262}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24695,"qdb_cluster":[24667,24695,24656,24691,24652]},"id":1}]} 2024-08-31T04:22:09.953 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 28 2024-08-31T04:22:09.954 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:09.953+0000 7fc68d400640 1 -- 172.21.15.50:0/560687842 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fc66c0b4c40 msgr2=0x7fc66c0b7150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:22:09.954 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:09.953+0000 7fc68d400640 1 --2- 172.21.15.50:0/560687842 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fc66c0b4c40 0x7fc66c0b7150 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fc678009bd0 tx=0x7fc678005f90 comp rx=0 tx=0).stop 2024-08-31T04:22:09.954 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:09.953+0000 7fc68d400640 1 -- 172.21.15.50:0/560687842 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc688102ce0 msgr2=0x7fc68819c940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:22:09.955 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:09.953+0000 7fc68d400640 1 --2- 172.21.15.50:0/560687842 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc688102ce0 0x7fc68819c940 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fc67000e9f0 tx=0x7fc67000eeb0 comp rx=0 tx=0).stop 2024-08-31T04:22:09.955 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:09.953+0000 7fc68d400640 1 -- 172.21.15.50:0/560687842 shutdown_connections 2024-08-31T04:22:09.955 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:09.953+0000 7fc68d400640 1 --2- 172.21.15.50:0/560687842 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fc66c0b4c40 0x7fc66c0b7150 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:09.955 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:09.953+0000 7fc68d400640 1 --2- 172.21.15.50:0/560687842 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc68810ff40 0x7fc6881a1be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:09.955 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:09.953+0000 7fc68d400640 1 --2- 172.21.15.50:0/560687842 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc688102ce0 0x7fc68819c940 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:09.955 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:09.953+0000 7fc68d400640 1 --2- 172.21.15.50:0/560687842 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc688102390 0x7fc68819c3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:09.955 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:09.953+0000 7fc68d400640 1 -- 172.21.15.50:0/560687842 >> 172.21.15.50:0/560687842 conn(0x7fc6880794e0 msgr2=0x7fc688109ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:22:09.955 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:09.953+0000 7fc68d400640 1 -- 172.21.15.50:0/560687842 shutdown_connections 2024-08-31T04:22:09.955 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:09.953+0000 7fc68d400640 1 -- 172.21.15.50:0/560687842 wait complete. 2024-08-31T04:22:10.647 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:22:10 smithi050 ceph-mon[17259]: from='client.? 172.21.15.50:0/560687842' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T04:22:10.687 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 058d9fc6-674f-11ef-bcd4-c7b262605968 -- ceph osd dump --format=json 2024-08-31T04:22:10.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:22:10 smithi177 ceph-mon[22025]: from='client.? 172.21.15.50:0/560687842' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T04:22:10.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:22:10 smithi133 ceph-mon[22177]: from='client.? 172.21.15.50:0/560687842' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T04:22:11.068 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:22:11.509 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:22:11 smithi050 ceph-mon[17259]: pgmap v345: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-08-31T04:22:11.688 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:11.686+0000 7fe0e4e00640 1 -- 172.21.15.50:0/2406133735 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe0e0109240 msgr2=0x7fe0e0109650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:22:11.688 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:11.686+0000 7fe0e4e00640 1 --2- 172.21.15.50:0/2406133735 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe0e0109240 0x7fe0e0109650 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fe0c8009900 tx=0x7fe0c802a410 comp rx=0 tx=0).stop 2024-08-31T04:22:11.688 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:11.686+0000 7fe0e4e00640 1 -- 172.21.15.50:0/2406133735 shutdown_connections 2024-08-31T04:22:11.688 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:11.686+0000 7fe0e4e00640 1 --2- 172.21.15.50:0/2406133735 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe0e0109b90 0x7fe0e01103c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:11.688 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:11.686+0000 7fe0e4e00640 1 --2- 172.21.15.50:0/2406133735 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe0e0109240 0x7fe0e0109650 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:11.688 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:11.686+0000 7fe0e4e00640 1 --2- 172.21.15.50:0/2406133735 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe0e0103900 0x7fe0e0103d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:11.689 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:11.686+0000 7fe0e4e00640 1 -- 172.21.15.50:0/2406133735 >> 172.21.15.50:0/2406133735 conn(0x7fe0e007b5f0 msgr2=0x7fe0e007ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:22:11.689 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:11.686+0000 7fe0e4e00640 1 -- 172.21.15.50:0/2406133735 shutdown_connections 2024-08-31T04:22:11.689 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:11.686+0000 7fe0e4e00640 1 -- 172.21.15.50:0/2406133735 wait complete. 2024-08-31T04:22:11.691 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:11.687+0000 7fe0e4e00640 1 Processor -- start 2024-08-31T04:22:11.691 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:11.687+0000 7fe0e4e00640 1 -- start start 2024-08-31T04:22:11.691 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:11.688+0000 7fe0e4e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe0e0103900 0x7fe0e019a320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:11.691 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:11.688+0000 7fe0e4e00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe0e0109240 0x7fe0e019a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:11.691 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:11.688+0000 7fe0e4e00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe0e0109b90 0x7fe0e019fb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:11.691 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:11.688+0000 7fe0e4e00640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fe0e0113850 con 0x7fe0e0103900 2024-08-31T04:22:11.691 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:11.688+0000 7fe0e4e00640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7fe0e01136d0 con 0x7fe0e0109b90 2024-08-31T04:22:11.691 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:11.688+0000 7fe0e4e00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fe0e01139d0 con 0x7fe0e0109240 2024-08-31T04:22:11.691 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:11.688+0000 7fe0dde00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe0e0103900 0x7fe0e019a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:22:11.691 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:11.688+0000 7fe0dde00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe0e0103900 0x7fe0e019a320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:58540/0 (socket says 172.21.15.50:58540) 2024-08-31T04:22:11.692 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:11.688+0000 7fe0dde00640 1 -- 172.21.15.50:0/1123049083 learned_addr learned my addr 172.21.15.50:0/1123049083 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:22:11.692 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:11.688+0000 7fe0de800640 1 --2- 172.21.15.50:0/1123049083 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe0e0109b90 0x7fe0e019fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:22:11.692 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:11.688+0000 7fe0d5400640 1 --2- 172.21.15.50:0/1123049083 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe0e0109240 0x7fe0e019a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:22:11.692 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:11.689+0000 7fe0dde00640 1 -- 172.21.15.50:0/1123049083 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe0e0109240 msgr2=0x7fe0e019a8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:22:11.692 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:11.689+0000 7fe0dde00640 1 --2- 172.21.15.50:0/1123049083 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe0e0109240 0x7fe0e019a8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:11.692 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:11.689+0000 7fe0dde00640 1 -- 172.21.15.50:0/1123049083 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe0e0109b90 msgr2=0x7fe0e019fb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:22:11.692 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:11.689+0000 7fe0dde00640 1 --2- 172.21.15.50:0/1123049083 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe0e0109b90 0x7fe0e019fb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:11.692 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:11.689+0000 7fe0dde00640 1 -- 172.21.15.50:0/1123049083 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0e01a0290 con 0x7fe0e0103900 2024-08-31T04:22:11.692 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:11.689+0000 7fe0de800640 1 --2- 172.21.15.50:0/1123049083 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe0e0109b90 0x7fe0e019fb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:22:11.692 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:11.689+0000 7fe0dde00640 1 --2- 172.21.15.50:0/1123049083 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe0e0103900 0x7fe0e019a320 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fe0d000e9f0 tx=0x7fe0d000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:22:11.692 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:11.689+0000 7fe0d7400640 1 -- 172.21.15.50:0/1123049083 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0d000cd80 con 0x7fe0e0103900 2024-08-31T04:22:11.692 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:11.689+0000 7fe0e4e00640 1 -- 172.21.15.50:0/1123049083 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe0e01a0580 con 0x7fe0e0103900 2024-08-31T04:22:11.692 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:11.689+0000 7fe0d7400640 1 -- 172.21.15.50:0/1123049083 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe0d00054d0 con 0x7fe0e0103900 2024-08-31T04:22:11.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:11.689+0000 7fe0d7400640 1 -- 172.21.15.50:0/1123049083 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0d0010690 con 0x7fe0e0103900 2024-08-31T04:22:11.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:11.689+0000 7fe0e4e00640 1 -- 172.21.15.50:0/1123049083 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe0e01a6ce0 con 0x7fe0e0103900 2024-08-31T04:22:11.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:11.691+0000 7fe0e4e00640 1 -- 172.21.15.50:0/1123049083 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe0e0103d10 con 0x7fe0e0103900 2024-08-31T04:22:11.694 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:11.693+0000 7fe0d7400640 1 -- 172.21.15.50:0/1123049083 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 17) ==== 152628+0+0 (secure 0 0 0) 0x7fe0d0004e90 con 0x7fe0e0103900 2024-08-31T04:22:11.695 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:11.694+0000 7fe0d7400640 1 --2- 172.21.15.50:0/1123049083 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fe0c40b4bc0 0x7fe0c40b70d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:11.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:11.694+0000 7fe0d7400640 1 -- 172.21.15.50:0/1123049083 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8219+0+0 (secure 0 0 0) 0x7fe0d00e5760 con 0x7fe0e0103900 2024-08-31T04:22:11.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:11.694+0000 7fe0d5400640 1 --2- 172.21.15.50:0/1123049083 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fe0c40b4bc0 0x7fe0c40b70d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:22:11.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:11.695+0000 7fe0d5400640 1 --2- 172.21.15.50:0/1123049083 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fe0c40b4bc0 0x7fe0c40b70d0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fe0c8009230 tx=0x7fe0c8031400 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:22:11.700 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:11.699+0000 7fe0d7400640 1 -- 172.21.15.50:0/1123049083 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fe0d00ac6e0 con 0x7fe0e0103900 2024-08-31T04:22:11.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:22:11 smithi177 ceph-mon[22025]: pgmap v345: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-08-31T04:22:11.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:22:11 smithi133 ceph-mon[22177]: pgmap v345: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-08-31T04:22:11.898 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:11.897+0000 7fe0e4e00640 1 -- 172.21.15.50:0/1123049083 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe0e019b450 con 0x7fe0e0103900 2024-08-31T04:22:11.900 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:11.899+0000 7fe0d7400640 1 -- 172.21.15.50:0/1123049083 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v78) ==== 74+0+22733 (secure 0 0 0) 0x7fe0d00abfe0 con 0x7fe0e0103900 2024-08-31T04:22:11.900 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-08-31T04:22:11.900 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":78,"fsid":"058d9fc6-674f-11ef-bcd4-c7b262605968","created":"2024-08-31T04:11:59.576131+0000","modified":"2024-08-31T04:20:56.994402+0000","last_up_change":"2024-08-31T04:19:44.619590+0000","last_in_change":"2024-08-31T04:19:21.022096+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-31T04:15:46.229142+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-31T04:20:38.249458+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"76","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-31T04:20:40.929092+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"76","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"416ecbde-4a7b-4bd1-b377-490925a33ce1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":3831273843},{"type":"v1","addr":"172.21.15.50:6803","nonce":3831273843}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":3831273843},{"type":"v1","addr":"172.21.15.50:6805","nonce":3831273843}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":3831273843},{"type":"v1","addr":"172.21.15.50:6809","nonce":3831273843}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":3831273843},{"type":"v1","addr":"172.21.15.50:6807","nonce":3831273843}]},"public_addr":"172.21.15.50:6803/3831273843","cluster_addr":"172.21.15.50:6805/3831273843","heartbeat_back_addr":"172.21.15.50:6809/3831273843","heartbeat_front_addr":"172.21.15.50:6807/3831273843","state":["exists","up"]},{"osd":1,"uuid":"5e008006-004d-4842-9885-93a2d27be1cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":475308203},{"type":"v1","addr":"172.21.15.133:6801","nonce":475308203}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":475308203},{"type":"v1","addr":"172.21.15.133:6803","nonce":475308203}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":475308203},{"type":"v1","addr":"172.21.15.133:6807","nonce":475308203}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":475308203},{"type":"v1","addr":"172.21.15.133:6805","nonce":475308203}]},"public_addr":"172.21.15.133:6801/475308203","cluster_addr":"172.21.15.133:6803/475308203","heartbeat_back_addr":"172.21.15.133:6807/475308203","heartbeat_front_addr":"172.21.15.133:6805/475308203","state":["exists","up"]},{"osd":2,"uuid":"7e6f1a26-f30d-4822-af69-8a08cb89fbce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":3091173426},{"type":"v1","addr":"172.21.15.177:6801","nonce":3091173426}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":3091173426},{"type":"v1","addr":"172.21.15.177:6803","nonce":3091173426}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":3091173426},{"type":"v1","addr":"172.21.15.177:6807","nonce":3091173426}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":3091173426},{"type":"v1","addr":"172.21.15.177:6805","nonce":3091173426}]},"public_addr":"172.21.15.177:6801/3091173426","cluster_addr":"172.21.15.177:6803/3091173426","heartbeat_back_addr":"172.21.15.177:6807/3091173426","heartbeat_front_addr":"172.21.15.177:6805/3091173426","state":["exists","up"]},{"osd":3,"uuid":"8193c2a2-18a1-4684-9a16-cbeae25530ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":3792992620},{"type":"v1","addr":"172.21.15.50:6811","nonce":3792992620}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":3792992620},{"type":"v1","addr":"172.21.15.50:6813","nonce":3792992620}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":3792992620},{"type":"v1","addr":"172.21.15.50:6817","nonce":3792992620}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":3792992620},{"type":"v1","addr":"172.21.15.50:6815","nonce":3792992620}]},"public_addr":"172.21.15.50:6811/3792992620","cluster_addr":"172.21.15.50:6813/3792992620","heartbeat_back_addr":"172.21.15.50:6817/3792992620","heartbeat_front_addr":"172.21.15.50:6815/3792992620","state":["exists","up"]},{"osd":4,"uuid":"2a2b4e64-0f8e-40ec-926c-84dbf691aefe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":2855333596},{"type":"v1","addr":"172.21.15.133:6809","nonce":2855333596}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":2855333596},{"type":"v1","addr":"172.21.15.133:6811","nonce":2855333596}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":2855333596},{"type":"v1","addr":"172.21.15.133:6815","nonce":2855333596}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":2855333596},{"type":"v1","addr":"172.21.15.133:6813","nonce":2855333596}]},"public_addr":"172.21.15.133:6809/2855333596","cluster_addr":"172.21.15.133:6811/2855333596","heartbeat_back_addr":"172.21.15.133:6815/2855333596","heartbeat_front_addr":"172.21.15.133:6813/2855333596","state":["exists","up"]},{"osd":5,"uuid":"83429ff0-ea7d-4fcc-9611-39d9001aa216","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":1166415084},{"type":"v1","addr":"172.21.15.177:6809","nonce":1166415084}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":1166415084},{"type":"v1","addr":"172.21.15.177:6811","nonce":1166415084}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":1166415084},{"type":"v1","addr":"172.21.15.177:6815","nonce":1166415084}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":1166415084},{"type":"v1","addr":"172.21.15.177:6813","nonce":1166415084}]},"public_addr":"172.21.15.177:6809/1166415084","cluster_addr":"172.21.15.177:6811/1166415084","heartbeat_back_addr":"172.21.15.177:6815/1166415084","heartbeat_front_addr":"172.21.15.177:6813/1166415084","state":["exists","up"]},{"osd":6,"uuid":"eeb571ef-5e43-4816-95dd-d01d83aeca83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":1429341184},{"type":"v1","addr":"172.21.15.50:6819","nonce":1429341184}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":1429341184},{"type":"v1","addr":"172.21.15.50:6821","nonce":1429341184}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":1429341184},{"type":"v1","addr":"172.21.15.50:6825","nonce":1429341184}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":1429341184},{"type":"v1","addr":"172.21.15.50:6823","nonce":1429341184}]},"public_addr":"172.21.15.50:6819/1429341184","cluster_addr":"172.21.15.50:6821/1429341184","heartbeat_back_addr":"172.21.15.50:6825/1429341184","heartbeat_front_addr":"172.21.15.50:6823/1429341184","state":["exists","up"]},{"osd":7,"uuid":"512ee507-0d50-4fed-b692-dbdf23a93e8e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":3643454923},{"type":"v1","addr":"172.21.15.133:6817","nonce":3643454923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":3643454923},{"type":"v1","addr":"172.21.15.133:6819","nonce":3643454923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":3643454923},{"type":"v1","addr":"172.21.15.133:6823","nonce":3643454923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":3643454923},{"type":"v1","addr":"172.21.15.133:6821","nonce":3643454923}]},"public_addr":"172.21.15.133:6817/3643454923","cluster_addr":"172.21.15.133:6819/3643454923","heartbeat_back_addr":"172.21.15.133:6823/3643454923","heartbeat_front_addr":"172.21.15.133:6821/3643454923","state":["exists","up"]},{"osd":8,"uuid":"ae99526e-41da-4cb5-857f-2e66f18f2d94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6816","nonce":101973300},{"type":"v1","addr":"172.21.15.177:6817","nonce":101973300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":101973300},{"type":"v1","addr":"172.21.15.177:6819","nonce":101973300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":101973300},{"type":"v1","addr":"172.21.15.177:6823","nonce":101973300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":101973300},{"type":"v1","addr":"172.21.15.177:6821","nonce":101973300}]},"public_addr":"172.21.15.177:6817/101973300","cluster_addr":"172.21.15.177:6819/101973300","heartbeat_back_addr":"172.21.15.177:6823/101973300","heartbeat_front_addr":"172.21.15.177:6821/101973300","state":["exists","up"]},{"osd":9,"uuid":"fcedbe16-b910-407f-b9d7-1dd03f3e62a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":53019860},{"type":"v1","addr":"172.21.15.50:6827","nonce":53019860}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":53019860},{"type":"v1","addr":"172.21.15.50:6829","nonce":53019860}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":53019860},{"type":"v1","addr":"172.21.15.50:6833","nonce":53019860}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":53019860},{"type":"v1","addr":"172.21.15.50:6831","nonce":53019860}]},"public_addr":"172.21.15.50:6827/53019860","cluster_addr":"172.21.15.50:6829/53019860","heartbeat_back_addr":"172.21.15.50:6833/53019860","heartbeat_front_addr":"172.21.15.50:6831/53019860","state":["exists","up"]},{"osd":10,"uuid":"3852756e-62f1-4e71-a070-8cff76df99b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":4175566493},{"type":"v1","addr":"172.21.15.133:6825","nonce":4175566493}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":4175566493},{"type":"v1","addr":"172.21.15.133:6827","nonce":4175566493}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":4175566493},{"type":"v1","addr":"172.21.15.133:6831","nonce":4175566493}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":4175566493},{"type":"v1","addr":"172.21.15.133:6829","nonce":4175566493}]},"public_addr":"172.21.15.133:6825/4175566493","cluster_addr":"172.21.15.133:6827/4175566493","heartbeat_back_addr":"172.21.15.133:6831/4175566493","heartbeat_front_addr":"172.21.15.133:6829/4175566493","state":["exists","up"]},{"osd":11,"uuid":"a154180a-5f2a-4b33-ad3d-fea7317597ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":2103454982},{"type":"v1","addr":"172.21.15.177:6825","nonce":2103454982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":2103454982},{"type":"v1","addr":"172.21.15.177:6827","nonce":2103454982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":2103454982},{"type":"v1","addr":"172.21.15.177:6831","nonce":2103454982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":2103454982},{"type":"v1","addr":"172.21.15.177:6829","nonce":2103454982}]},"public_addr":"172.21.15.177:6825/2103454982","cluster_addr":"172.21.15.177:6827/2103454982","heartbeat_back_addr":"172.21.15.177:6831/2103454982","heartbeat_front_addr":"172.21.15.177:6829/2103454982","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:14:54.683660+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:15:20.007319+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:15:43.613426+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:16:12.387010+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:16:38.079210+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:17:02.750375+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:17:31.735810+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:17:57.600985+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:18:22.503347+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:18:52.316657+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:19:18.444623+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:19:42.331006+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.b","mappings":[{"from":2,"to":4},{"from":8,"to":11}]},{"pgid":"2.1b","mappings":[{"from":2,"to":1}]},{"pgid":"2.1d","mappings":[{"from":8,"to":11}]},{"pgid":"3.e","mappings":[{"from":4,"to":6}]},{"pgid":"3.17","mappings":[{"from":4,"to":8}]},{"pgid":"3.25","mappings":[{"from":5,"to":9}]},{"pgid":"3.29","mappings":[{"from":3,"to":9}]},{"pgid":"3.36","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.50:6801/1319056820":"2024-09-01T04:12:55.742020+0000","172.21.15.50:0/1755103674":"2024-09-01T04:12:55.742020+0000","172.21.15.50:6800/1319056820":"2024-09-01T04:12:55.742020+0000","172.21.15.50:0/3701412233":"2024-09-01T04:12:55.742020+0000","172.21.15.50:0/1829556336":"2024-09-01T04:12:55.742020+0000","172.21.15.50:0/1698995126":"2024-09-01T04:12:25.753831+0000","172.21.15.50:0/1554317941":"2024-09-01T04:12:25.753831+0000","172.21.15.50:0/2998110380":"2024-09-01T04:12:25.753831+0000","172.21.15.50:6801/4197277793":"2024-09-01T04:12:25.753831+0000","172.21.15.50:6800/4197277793":"2024-09-01T04:12:25.753831+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-31T04:22:11.903 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:11.902+0000 7fe0e4e00640 1 -- 172.21.15.50:0/1123049083 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fe0c40b4bc0 msgr2=0x7fe0c40b70d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:22:11.903 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:11.902+0000 7fe0e4e00640 1 --2- 172.21.15.50:0/1123049083 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fe0c40b4bc0 0x7fe0c40b70d0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fe0c8009230 tx=0x7fe0c8031400 comp rx=0 tx=0).stop 2024-08-31T04:22:11.903 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:11.902+0000 7fe0e4e00640 1 -- 172.21.15.50:0/1123049083 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe0e0103900 msgr2=0x7fe0e019a320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:22:11.903 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:11.902+0000 7fe0e4e00640 1 --2- 172.21.15.50:0/1123049083 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe0e0103900 0x7fe0e019a320 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fe0d000e9f0 tx=0x7fe0d000edf0 comp rx=0 tx=0).stop 2024-08-31T04:22:11.903 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:11.902+0000 7fe0e4e00640 1 -- 172.21.15.50:0/1123049083 shutdown_connections 2024-08-31T04:22:11.904 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:11.902+0000 7fe0e4e00640 1 --2- 172.21.15.50:0/1123049083 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fe0c40b4bc0 0x7fe0c40b70d0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:11.904 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:11.902+0000 7fe0e4e00640 1 --2- 172.21.15.50:0/1123049083 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe0e0109240 0x7fe0e019a8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:11.904 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:11.902+0000 7fe0e4e00640 1 --2- 172.21.15.50:0/1123049083 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe0e0109b90 0x7fe0e019fb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:11.904 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:11.902+0000 7fe0e4e00640 1 --2- 172.21.15.50:0/1123049083 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe0e0103900 0x7fe0e019a320 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:11.904 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:11.902+0000 7fe0e4e00640 1 -- 172.21.15.50:0/1123049083 >> 172.21.15.50:0/1123049083 conn(0x7fe0e007b5f0 msgr2=0x7fe0e0105320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:22:11.904 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:11.902+0000 7fe0e4e00640 1 -- 172.21.15.50:0/1123049083 shutdown_connections 2024-08-31T04:22:11.904 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:11.902+0000 7fe0e4e00640 1 -- 172.21.15.50:0/1123049083 wait complete. 2024-08-31T04:22:12.615 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:22:12 smithi050 ceph-mon[17259]: from='client.? 172.21.15.50:0/1123049083' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-31T04:22:12.653 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 058d9fc6-674f-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-31T04:22:12.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:22:12 smithi177 ceph-mon[22025]: from='client.? 172.21.15.50:0/1123049083' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-31T04:22:12.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:22:12 smithi133 ceph-mon[22177]: from='client.? 172.21.15.50:0/1123049083' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-31T04:22:13.032 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:22:13.648 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:13.646+0000 7fec02e00640 1 -- 172.21.15.50:0/1485511780 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7febfc10bdc0 msgr2=0x7febfc1125f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:22:13.649 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:13.646+0000 7fec02e00640 1 --2- 172.21.15.50:0/1485511780 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7febfc10bdc0 0x7febfc1125f0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7febf4009ca0 tx=0x7febf402a8c0 comp rx=0 tx=0).stop 2024-08-31T04:22:13.649 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:13.646+0000 7fec02e00640 1 -- 172.21.15.50:0/1485511780 shutdown_connections 2024-08-31T04:22:13.649 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:13.647+0000 7fec02e00640 1 --2- 172.21.15.50:0/1485511780 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7febfc10b470 0x7febfc10b880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:13.649 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:13.647+0000 7fec02e00640 1 --2- 172.21.15.50:0/1485511780 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7febfc10bdc0 0x7febfc1125f0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:13.649 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:13.647+0000 7fec02e00640 1 --2- 172.21.15.50:0/1485511780 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7febfc105b30 0x7febfc105f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:13.650 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:13.647+0000 7fec02e00640 1 -- 172.21.15.50:0/1485511780 >> 172.21.15.50:0/1485511780 conn(0x7febfc101600 msgr2=0x7febfc103a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:22:13.650 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:13.647+0000 7fec02e00640 1 -- 172.21.15.50:0/1485511780 shutdown_connections 2024-08-31T04:22:13.650 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:13.647+0000 7fec02e00640 1 -- 172.21.15.50:0/1485511780 wait complete. 2024-08-31T04:22:13.652 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:13.648+0000 7fec02e00640 1 Processor -- start 2024-08-31T04:22:13.653 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:13.648+0000 7fec02e00640 1 -- start start 2024-08-31T04:22:13.653 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:13.648+0000 7fec02e00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7febfc105b30 0x7febfc19c400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:13.653 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:13.648+0000 7fec02e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7febfc10b470 0x7febfc19c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:13.653 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:13.648+0000 7fec02e00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7febfc10bdc0 0x7febfc1a1c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:13.653 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:13.648+0000 7fec02e00640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7febfc115ad0 con 0x7febfc10b470 2024-08-31T04:22:13.654 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:13.648+0000 7fec02e00640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7febfc115950 con 0x7febfc10bdc0 2024-08-31T04:22:13.654 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:13.648+0000 7fec02e00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7febfc115c50 con 0x7febfc105b30 2024-08-31T04:22:13.654 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:13.649+0000 7febfb400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7febfc10b470 0x7febfc19c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:22:13.654 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:13.649+0000 7febfb400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7febfc10b470 0x7febfc19c9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35698/0 (socket says 172.21.15.50:35698) 2024-08-31T04:22:13.654 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:13.649+0000 7febfbe00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7febfc105b30 0x7febfc19c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:22:13.654 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:13.649+0000 7febfb400640 1 -- 172.21.15.50:0/1755218891 learned_addr learned my addr 172.21.15.50:0/1755218891 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:22:13.655 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:13.649+0000 7fec00e00640 1 --2- 172.21.15.50:0/1755218891 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7febfc10bdc0 0x7febfc1a1c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:22:13.655 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:13.649+0000 7febfb400640 1 -- 172.21.15.50:0/1755218891 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7febfc105b30 msgr2=0x7febfc19c400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:22:13.655 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:13.649+0000 7febfb400640 1 --2- 172.21.15.50:0/1755218891 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7febfc105b30 0x7febfc19c400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:13.655 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:13.649+0000 7febfb400640 1 -- 172.21.15.50:0/1755218891 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7febfc10bdc0 msgr2=0x7febfc1a1c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:22:13.655 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:13.649+0000 7febfb400640 1 --2- 172.21.15.50:0/1755218891 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7febfc10bdc0 0x7febfc1a1c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:13.655 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:13.649+0000 7febfb400640 1 -- 172.21.15.50:0/1755218891 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7febfc1a2370 con 0x7febfc10b470 2024-08-31T04:22:13.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:13.649+0000 7fec00e00640 1 --2- 172.21.15.50:0/1755218891 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7febfc10bdc0 0x7febfc1a1c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:22:13.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:13.649+0000 7febfb400640 1 --2- 172.21.15.50:0/1755218891 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7febfc10b470 0x7febfc19c9a0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7febe800e9f0 tx=0x7febe800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:22:13.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:13.650+0000 7febf8c00640 1 -- 172.21.15.50:0/1755218891 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febe800ccc0 con 0x7febfc10b470 2024-08-31T04:22:13.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:13.650+0000 7febf8c00640 1 -- 172.21.15.50:0/1755218891 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7febe80108e0 con 0x7febfc10b470 2024-08-31T04:22:13.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:13.650+0000 7febf8c00640 1 -- 172.21.15.50:0/1755218891 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febe8018860 con 0x7febfc10b470 2024-08-31T04:22:13.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:13.650+0000 7fec02e00640 1 -- 172.21.15.50:0/1755218891 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7febfc1a2660 con 0x7febfc10b470 2024-08-31T04:22:13.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:13.650+0000 7fec02e00640 1 -- 172.21.15.50:0/1755218891 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7febfc1a8dc0 con 0x7febfc10b470 2024-08-31T04:22:13.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:13.651+0000 7fec02e00640 1 -- 172.21.15.50:0/1755218891 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7febfc105f40 con 0x7febfc10b470 2024-08-31T04:22:13.658 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:13.654+0000 7febf8c00640 1 -- 172.21.15.50:0/1755218891 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 17) ==== 152628+0+0 (secure 0 0 0) 0x7febe8010430 con 0x7febfc10b470 2024-08-31T04:22:13.659 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:13.655+0000 7febf8c00640 1 --2- 172.21.15.50:0/1755218891 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7febe00b4bc0 0x7febe00b70d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:13.659 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:13.656+0000 7febf8c00640 1 -- 172.21.15.50:0/1755218891 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8219+0+0 (secure 0 0 0) 0x7febe80e5b70 con 0x7febfc10b470 2024-08-31T04:22:13.659 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:13.656+0000 7febfbe00640 1 --2- 172.21.15.50:0/1755218891 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7febe00b4bc0 0x7febe00b70d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:22:13.659 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:13.656+0000 7febf8c00640 1 -- 172.21.15.50:0/1755218891 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7febe80acaf0 con 0x7febfc10b470 2024-08-31T04:22:13.659 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:13.656+0000 7febfbe00640 1 --2- 172.21.15.50:0/1755218891 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7febe00b4bc0 0x7febe00b70d0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7febec009bd0 tx=0x7febec005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:22:13.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:22:13 smithi177 ceph-mon[22025]: pgmap v346: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2024-08-31T04:22:13.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:22:13 smithi133 ceph-mon[22177]: pgmap v346: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2024-08-31T04:22:13.888 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:13.887+0000 7fec02e00640 1 -- 172.21.15.50:0/1755218891 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7febfc19d530 con 0x7febfc10b470 2024-08-31T04:22:13.888 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:22:13 smithi050 ceph-mon[17259]: pgmap v346: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2024-08-31T04:22:13.889 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:13.888+0000 7febf8c00640 1 -- 172.21.15.50:0/1755218891 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11983 (secure 0 0 0) 0x7febfc19d530 con 0x7febfc10b470 2024-08-31T04:22:13.889 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-08-31T04:22:13.890 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":28,"btime":"2024-08-31T04:21:02:045794+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14622,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/1565557530","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":1565557530},{"type":"v1","addr":"172.21.15.50:6835","nonce":1565557530}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14634,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6837/2660185946","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6836","nonce":2660185946},{"type":"v1","addr":"172.21.15.50:6837","nonce":2660185946}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-31T04:20:44.140709+0000","modified":"2024-08-31T04:21:02.045763+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24695,"mds_1":24691,"mds_2":24667,"mds_3":24656,"mds_4":24652},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14676":{"gid":14676,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.50:6839/2105228685","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6838","nonce":2105228685},{"type":"v1","addr":"172.21.15.50:6839","nonce":2105228685}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24590":{"gid":24590,"name":"k","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.133:6833/4283603962","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6832","nonce":4283603962},{"type":"v1","addr":"172.21.15.133:6833","nonce":4283603962}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24601":{"gid":24601,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.177:6833/1237129793","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":1237129793},{"type":"v1","addr":"172.21.15.177:6833","nonce":1237129793}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24626":{"gid":24626,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.133:6835/3637799701","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":3637799701},{"type":"v1","addr":"172.21.15.133:6835","nonce":3637799701}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24640":{"gid":24640,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.177:6835/599392457","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6834","nonce":599392457},{"type":"v1","addr":"172.21.15.177:6835","nonce":599392457}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24652":{"gid":24652,"name":"c","rank":4,"incarnation":26,"state":"up:active","state_seq":13,"addr":"172.21.15.177:6837/2159859285","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6836","nonce":2159859285},{"type":"v1","addr":"172.21.15.177:6837","nonce":2159859285}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24656":{"gid":24656,"name":"h","rank":3,"incarnation":22,"state":"up:active","state_seq":12,"addr":"172.21.15.133:6837/4014853202","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6836","nonce":4014853202},{"type":"v1","addr":"172.21.15.133:6837","nonce":4014853202}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24667":{"gid":24667,"name":"i","rank":2,"incarnation":20,"state":"up:active","state_seq":10,"addr":"172.21.15.177:6839/3600081752","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6838","nonce":3600081752},{"type":"v1","addr":"172.21.15.177:6839","nonce":3600081752}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24691":{"gid":24691,"name":"a","rank":1,"incarnation":18,"state":"up:active","state_seq":8,"addr":"172.21.15.50:6841/575209862","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6840","nonce":575209862},{"type":"v1","addr":"172.21.15.50:6841","nonce":575209862}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24695":{"gid":24695,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.133:6839/2526402262","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6838","nonce":2526402262},{"type":"v1","addr":"172.21.15.133:6839","nonce":2526402262}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24695,"qdb_cluster":[24667,24695,24656,24691,24652]},"id":1}]} 2024-08-31T04:22:13.890 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 28 2024-08-31T04:22:13.892 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:13.890+0000 7fec02e00640 1 -- 172.21.15.50:0/1755218891 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7febe00b4bc0 msgr2=0x7febe00b70d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:22:13.892 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:13.890+0000 7fec02e00640 1 --2- 172.21.15.50:0/1755218891 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7febe00b4bc0 0x7febe00b70d0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7febec009bd0 tx=0x7febec005f90 comp rx=0 tx=0).stop 2024-08-31T04:22:13.892 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:13.890+0000 7fec02e00640 1 -- 172.21.15.50:0/1755218891 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7febfc10b470 msgr2=0x7febfc19c9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:22:13.892 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:13.890+0000 7fec02e00640 1 --2- 172.21.15.50:0/1755218891 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7febfc10b470 0x7febfc19c9a0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7febe800e9f0 tx=0x7febe800eeb0 comp rx=0 tx=0).stop 2024-08-31T04:22:13.892 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:13.891+0000 7fec02e00640 1 -- 172.21.15.50:0/1755218891 shutdown_connections 2024-08-31T04:22:13.892 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:13.891+0000 7fec02e00640 1 --2- 172.21.15.50:0/1755218891 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7febe00b4bc0 0x7febe00b70d0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:13.892 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:13.891+0000 7fec02e00640 1 --2- 172.21.15.50:0/1755218891 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7febfc10bdc0 0x7febfc1a1c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:13.892 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:13.891+0000 7fec02e00640 1 --2- 172.21.15.50:0/1755218891 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7febfc10b470 0x7febfc19c9a0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:13.892 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:13.891+0000 7fec02e00640 1 --2- 172.21.15.50:0/1755218891 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7febfc105b30 0x7febfc19c400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:13.893 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:13.891+0000 7fec02e00640 1 -- 172.21.15.50:0/1755218891 >> 172.21.15.50:0/1755218891 conn(0x7febfc101600 msgr2=0x7febfc10aa40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:22:13.893 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:13.891+0000 7fec02e00640 1 -- 172.21.15.50:0/1755218891 shutdown_connections 2024-08-31T04:22:13.893 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:13.891+0000 7fec02e00640 1 -- 172.21.15.50:0/1755218891 wait complete. 2024-08-31T04:22:14.656 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 28, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-08-31T04:20:44.140709+0000', 'modified': '2024-08-31T04:21:02.045763+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 5, 'in': [0, 1, 2, 3, 4], 'up': {'mds_0': 24695, 'mds_1': 24691, 'mds_2': 24667, 'mds_3': 24656, 'mds_4': 24652}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_14676': {'gid': 14676, 'name': 'g', 'rank': 4, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.50:6839/2105228685', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.50:6838', 'nonce': 2105228685}, {'type': 'v1', 'addr': '172.21.15.50:6839', 'nonce': 2105228685}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24590': {'gid': 24590, 'name': 'k', 'rank': 3, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.133:6833/4283603962', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.133:6832', 'nonce': 4283603962}, {'type': 'v1', 'addr': '172.21.15.133:6833', 'nonce': 4283603962}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24601': {'gid': 24601, 'name': 'l', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.177:6833/1237129793', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.177:6832', 'nonce': 1237129793}, {'type': 'v1', 'addr': '172.21.15.177:6833', 'nonce': 1237129793}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24626': {'gid': 24626, 'name': 'e', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.133:6835/3637799701', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.133:6834', 'nonce': 3637799701}, {'type': 'v1', 'addr': '172.21.15.133:6835', 'nonce': 3637799701}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24640': {'gid': 24640, 'name': 'f', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.177:6835/599392457', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.177:6834', 'nonce': 599392457}, {'type': 'v1', 'addr': '172.21.15.177:6835', 'nonce': 599392457}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24652': {'gid': 24652, 'name': 'c', 'rank': 4, 'incarnation': 26, 'state': 'up:active', 'state_seq': 13, 'addr': '172.21.15.177:6837/2159859285', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.177:6836', 'nonce': 2159859285}, {'type': 'v1', 'addr': '172.21.15.177:6837', 'nonce': 2159859285}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24656': {'gid': 24656, 'name': 'h', 'rank': 3, 'incarnation': 22, 'state': 'up:active', 'state_seq': 12, 'addr': '172.21.15.133:6837/4014853202', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.133:6836', 'nonce': 4014853202}, {'type': 'v1', 'addr': '172.21.15.133:6837', 'nonce': 4014853202}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24667': {'gid': 24667, 'name': 'i', 'rank': 2, 'incarnation': 20, 'state': 'up:active', 'state_seq': 10, 'addr': '172.21.15.177:6839/3600081752', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.177:6838', 'nonce': 3600081752}, {'type': 'v1', 'addr': '172.21.15.177:6839', 'nonce': 3600081752}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24691': {'gid': 24691, 'name': 'a', 'rank': 1, 'incarnation': 18, 'state': 'up:active', 'state_seq': 8, 'addr': '172.21.15.50:6841/575209862', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.50:6840', 'nonce': 575209862}, {'type': 'v1', 'addr': '172.21.15.50:6841', 'nonce': 575209862}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24695': {'gid': 24695, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 5, 'addr': '172.21.15.133:6839/2526402262', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.133:6838', 'nonce': 2526402262}, {'type': 'v1', 'addr': '172.21.15.133:6839', 'nonce': 2526402262}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24695, 'qdb_cluster': [24667, 24695, 24656, 24691, 24652]} 2024-08-31T04:22:14.656 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 5/5 2024-08-31T04:22:14.656 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 058d9fc6-674f-11ef-bcd4-c7b262605968 -- ceph tell mds.c status 2024-08-31T04:22:14.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:22:14 smithi177 ceph-mon[22025]: from='client.? 172.21.15.50:0/1755218891' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T04:22:14.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:22:14 smithi133 ceph-mon[22177]: from='client.? 172.21.15.50:0/1755218891' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T04:22:14.950 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:22:14 smithi050 ceph-mon[17259]: from='client.? 172.21.15.50:0/1755218891' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T04:22:15.043 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:22:15.677 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:15.675+0000 7f2169e00640 1 -- 172.21.15.50:0/2727900759 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2164114310 msgr2=0x7f2164116730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:22:15.677 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:15.675+0000 7f2169e00640 1 --2- 172.21.15.50:0/2727900759 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2164114310 0x7f2164116730 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f215c009ca0 tx=0x7f215c02a8b0 comp rx=0 tx=0).stop 2024-08-31T04:22:15.677 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:15.675+0000 7f2169e00640 1 -- 172.21.15.50:0/2727900759 shutdown_connections 2024-08-31T04:22:15.678 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:15.675+0000 7f2169e00640 1 --2- 172.21.15.50:0/2727900759 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2164078030 0x7f2164113dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:15.678 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:15.675+0000 7f2169e00640 1 --2- 172.21.15.50:0/2727900759 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2164114310 0x7f2164116730 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:15.678 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:15.675+0000 7f2169e00640 1 --2- 172.21.15.50:0/2727900759 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f21640776e0 0x7f2164077af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:15.678 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:15.675+0000 7f2169e00640 1 -- 172.21.15.50:0/2727900759 >> 172.21.15.50:0/2727900759 conn(0x7f2164101420 msgr2=0x7f2164103870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:22:15.678 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:15.675+0000 7f2169e00640 1 -- 172.21.15.50:0/2727900759 shutdown_connections 2024-08-31T04:22:15.678 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:15.675+0000 7f2169e00640 1 -- 172.21.15.50:0/2727900759 wait complete. 2024-08-31T04:22:15.678 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:15.676+0000 7f2169e00640 1 Processor -- start 2024-08-31T04:22:15.678 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:15.676+0000 7f2169e00640 1 -- start start 2024-08-31T04:22:15.679 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:15.677+0000 7f2169e00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f21640776e0 0x7f21641a06c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:15.680 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:15.677+0000 7f2169e00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2164078030 0x7f21641a0c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:15.680 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:15.677+0000 7f2169e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2164114310 0x7f21641a5f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:15.680 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:15.677+0000 7f2169e00640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f2164119c70 con 0x7f2164114310 2024-08-31T04:22:15.680 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:15.677+0000 7f2169e00640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f2164119af0 con 0x7f2164078030 2024-08-31T04:22:15.680 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:15.677+0000 7f2169e00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f2164119df0 con 0x7f21640776e0 2024-08-31T04:22:15.680 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:15.677+0000 7f2169400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2164114310 0x7f21641a5f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:22:15.680 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:15.677+0000 7f2169400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2164114310 0x7f21641a5f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35706/0 (socket says 172.21.15.50:35706) 2024-08-31T04:22:15.680 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:15.677+0000 7f2169400640 1 -- 172.21.15.50:0/2881485348 learned_addr learned my addr 172.21.15.50:0/2881485348 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:22:15.680 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:15.677+0000 7f2168a00640 1 --2- 172.21.15.50:0/2881485348 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f21640776e0 0x7f21641a06c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:22:15.680 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:15.677+0000 7f2163e00640 1 --2- 172.21.15.50:0/2881485348 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2164078030 0x7f21641a0c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:22:15.680 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:15.677+0000 7f2169400640 1 -- 172.21.15.50:0/2881485348 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f21640776e0 msgr2=0x7f21641a06c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:22:15.681 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:15.677+0000 7f2169400640 1 --2- 172.21.15.50:0/2881485348 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f21640776e0 0x7f21641a06c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:15.681 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:15.677+0000 7f2169400640 1 -- 172.21.15.50:0/2881485348 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2164078030 msgr2=0x7f21641a0c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:22:15.681 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:15.677+0000 7f2169400640 1 --2- 172.21.15.50:0/2881485348 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2164078030 0x7f21641a0c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:15.681 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:15.677+0000 7f2169400640 1 -- 172.21.15.50:0/2881485348 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21641a6630 con 0x7f2164114310 2024-08-31T04:22:15.681 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:15.677+0000 7f2168a00640 1 --2- 172.21.15.50:0/2881485348 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f21640776e0 0x7f21641a06c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:22:15.681 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:15.677+0000 7f2163e00640 1 --2- 172.21.15.50:0/2881485348 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2164078030 0x7f21641a0c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:22:15.681 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:15.678+0000 7f2169400640 1 --2- 172.21.15.50:0/2881485348 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2164114310 0x7f21641a5f00 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f215c005cc0 tx=0x7f215c030db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:22:15.681 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:15.678+0000 7f2161600640 1 -- 172.21.15.50:0/2881485348 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f215c003e00 con 0x7f2164114310 2024-08-31T04:22:15.681 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:15.678+0000 7f2169e00640 1 -- 172.21.15.50:0/2881485348 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f21641a68c0 con 0x7f2164114310 2024-08-31T04:22:15.681 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:15.678+0000 7f2161600640 1 -- 172.21.15.50:0/2881485348 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f215c040070 con 0x7f2164114310 2024-08-31T04:22:15.681 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:15.678+0000 7f2161600640 1 -- 172.21.15.50:0/2881485348 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f215c045a60 con 0x7f2164114310 2024-08-31T04:22:15.681 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:15.678+0000 7f2169e00640 1 -- 172.21.15.50:0/2881485348 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f21641ad080 con 0x7f2164114310 2024-08-31T04:22:15.683 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:15.682+0000 7f2172052740 1 Processor -- start 2024-08-31T04:22:15.683 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:15.682+0000 7f2161600640 1 -- 172.21.15.50:0/2881485348 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 17) ==== 152628+0+0 (secure 0 0 0) 0x7f215c045c20 con 0x7f2164114310 2024-08-31T04:22:15.683 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:15.682+0000 7f2172052740 1 -- start start 2024-08-31T04:22:15.684 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:15.683+0000 7f2172052740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c81f4d2f60 0x55c81f878aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:15.684 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:15.683+0000 7f2172052740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c81f4aa0a0 0x55c81f878fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:15.684 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:15.683+0000 7f2172052740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55c81f4b2280 0x55c81f879520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:15.685 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:15.683+0000 7f2172052740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55c81f7ef550 con 0x55c81f4aa0a0 2024-08-31T04:22:15.685 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:15.683+0000 7f2172052740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x55c81f7deae0 con 0x55c81f4b2280 2024-08-31T04:22:15.685 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:15.683+0000 7f2172052740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x55c81f7e2a90 con 0x55c81f4d2f60 2024-08-31T04:22:15.685 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:15.683+0000 7f2168a00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c81f4aa0a0 0x55c81f878fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:22:15.685 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:15.683+0000 7f2163e00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c81f4d2f60 0x55c81f878aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:22:15.685 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:15.683+0000 7f2168a00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c81f4aa0a0 0x55c81f878fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35708/0 (socket says 172.21.15.50:35708) 2024-08-31T04:22:15.686 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:15.683+0000 7f2168a00640 1 -- 172.21.15.50:0/3087276337 learned_addr learned my addr 172.21.15.50:0/3087276337 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:22:15.686 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:15.683+0000 7f2163e00640 1 --2- 172.21.15.50:0/3087276337 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55c81f4b2280 0x55c81f879520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:22:15.691 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:15.684+0000 7f2163e00640 1 -- 172.21.15.50:0/3087276337 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55c81f4b2280 msgr2=0x55c81f879520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:22:15.691 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:15.684+0000 7f2163e00640 1 --2- 172.21.15.50:0/3087276337 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55c81f4b2280 0x55c81f879520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:15.691 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:15.684+0000 7f2163e00640 1 -- 172.21.15.50:0/3087276337 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c81f4aa0a0 msgr2=0x55c81f878fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:22:15.692 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:15.684+0000 7f2163e00640 1 --2- 172.21.15.50:0/3087276337 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c81f4aa0a0 0x55c81f878fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:15.692 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:15.684+0000 7f2163e00640 1 -- 172.21.15.50:0/3087276337 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c81f53e540 con 0x55c81f4d2f60 2024-08-31T04:22:15.692 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:15.684+0000 7f2163e00640 1 --2- 172.21.15.50:0/3087276337 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c81f4d2f60 0x55c81f878aa0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f21641148b0 tx=0x7f2150004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7adba5c9e95610a8 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:22:15.692 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:15.684+0000 7f2155c00640 1 -- 172.21.15.50:0/3087276337 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2150004030 con 0x55c81f4d2f60 2024-08-31T04:22:15.692 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:15.684+0000 7f2155c00640 1 -- 172.21.15.50:0/3087276337 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2150005020 con 0x55c81f4d2f60 2024-08-31T04:22:15.692 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:15.684+0000 7f2155c00640 1 -- 172.21.15.50:0/3087276337 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f215000fb20 con 0x55c81f4d2f60 2024-08-31T04:22:15.692 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:15.685+0000 7f2161600640 1 --2- 172.21.15.50:0/2881485348 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f214c0b4bc0 0x7f214c0b70d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:15.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:15.685+0000 7f2172052740 1 -- 172.21.15.50:0/3087276337 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c81f4d2f60 msgr2=0x55c81f878aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:22:15.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:15.685+0000 7f2172052740 1 --2- 172.21.15.50:0/3087276337 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c81f4d2f60 0x55c81f878aa0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f21641148b0 tx=0x7f2150004730 comp rx=0 tx=0).stop 2024-08-31T04:22:15.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:15.685+0000 7f2172052740 1 -- 172.21.15.50:0/3087276337 shutdown_connections 2024-08-31T04:22:15.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:15.685+0000 7f2172052740 1 --2- 172.21.15.50:0/3087276337 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55c81f4b2280 0x55c81f879520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:15.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:15.685+0000 7f2172052740 1 --2- 172.21.15.50:0/3087276337 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c81f4aa0a0 0x55c81f878fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:15.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:15.685+0000 7f2172052740 1 --2- 172.21.15.50:0/3087276337 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c81f4d2f60 0x55c81f878aa0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:15.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:15.685+0000 7f2172052740 1 -- 172.21.15.50:0/3087276337 >> 172.21.15.50:0/3087276337 conn(0x55c81f4c7350 msgr2=0x55c81f876990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:22:15.694 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:15.685+0000 7f2161600640 1 -- 172.21.15.50:0/2881485348 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8219+0+0 (secure 0 0 0) 0x7f215c106250 con 0x7f2164114310 2024-08-31T04:22:15.694 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:15.685+0000 7f2168a00640 1 --2- 172.21.15.50:0/2881485348 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f214c0b4bc0 0x7f214c0b70d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:22:15.694 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:15.686+0000 7f2172052740 1 -- 172.21.15.50:0/3087276337 shutdown_connections 2024-08-31T04:22:15.694 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:15.686+0000 7f2172052740 1 -- 172.21.15.50:0/3087276337 wait complete. 2024-08-31T04:22:15.695 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:15.686+0000 7f2168a00640 1 --2- 172.21.15.50:0/2881485348 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f214c0b4bc0 0x7f214c0b70d0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x55c81f877720 tx=0x7f2158005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:22:15.695 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:15.686+0000 7f2172052740 1 -- start start 2024-08-31T04:22:15.695 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:15.687+0000 7f2172052740 1 Processor -- start 2024-08-31T04:22:15.695 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:15.687+0000 7f2172052740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c81f4aa0a0 0x55c81f8842d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:15.695 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:15.687+0000 7f2172052740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55c81f4b2280 0x55c81f884810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:15.695 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:15.687+0000 7f2172052740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c81f4d2f60 0x55c81f8905a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:15.695 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:15.687+0000 7f2172052740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55c81f6415f0 con 0x55c81f4aa0a0 2024-08-31T04:22:15.695 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:15.687+0000 7f2172052740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x55c81f765bd0 con 0x55c81f4b2280 2024-08-31T04:22:15.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:15.687+0000 7f2172052740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x55c81f887280 con 0x55c81f4d2f60 2024-08-31T04:22:15.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:15.687+0000 7f2172052740 10 client.0 _ll_register_callbacks cb 0x55c81f78b210 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:22:15.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:15.687+0000 7f2168a00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c81f4aa0a0 0x55c81f8842d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:22:15.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:15.687+0000 7f2168a00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c81f4aa0a0 0x55c81f8842d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35716/0 (socket says 172.21.15.50:35716) 2024-08-31T04:22:15.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:15.687+0000 7f2168a00640 1 -- 172.21.15.50:0/3844758195 learned_addr learned my addr 172.21.15.50:0/3844758195 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:22:15.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:15.687+0000 7f2169400640 1 --2- 172.21.15.50:0/3844758195 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c81f4d2f60 0x55c81f8905a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:22:15.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:15.687+0000 7f2163e00640 1 --2- 172.21.15.50:0/3844758195 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55c81f4b2280 0x55c81f884810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:22:15.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:15.688+0000 7f2163e00640 1 -- 172.21.15.50:0/3844758195 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c81f4d2f60 msgr2=0x55c81f8905a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:22:15.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:15.688+0000 7f2163e00640 1 --2- 172.21.15.50:0/3844758195 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c81f4d2f60 0x55c81f8905a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:15.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:15.688+0000 7f2163e00640 1 -- 172.21.15.50:0/3844758195 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c81f4aa0a0 msgr2=0x55c81f8842d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:22:15.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:15.688+0000 7f2163e00640 1 --2- 172.21.15.50:0/3844758195 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c81f4aa0a0 0x55c81f8842d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:15.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:15.688+0000 7f2163e00640 1 -- 172.21.15.50:0/3844758195 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c81f7a6650 con 0x55c81f4b2280 2024-08-31T04:22:15.697 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:15.688+0000 7f2169400640 1 --2- 172.21.15.50:0/3844758195 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c81f4d2f60 0x55c81f8905a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:22:15.697 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:15.688+0000 7f2168a00640 1 --2- 172.21.15.50:0/3844758195 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c81f4aa0a0 0x55c81f8842d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:22:15.697 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:15.688+0000 7f2163e00640 1 --2- 172.21.15.50:0/3844758195 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55c81f4b2280 0x55c81f884810 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f21641148b0 tx=0x7f2150011420 comp rx=0 tx=0).ready entity=mon.2 client_cookie=75189b57709c6e26 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:22:15.697 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:15.688+0000 7f214a000640 10 client.0 ms_handle_connect on v2:172.21.15.133:3300/0 2024-08-31T04:22:15.697 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:15.689+0000 7f214a000640 1 -- 172.21.15.50:0/3844758195 <== mon.2 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2150005290 con 0x55c81f4b2280 2024-08-31T04:22:15.697 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:15.689+0000 7f214a000640 1 -- 172.21.15.50:0/3844758195 <== mon.2 v2:172.21.15.133:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8219+0+0 (secure 0 0 0) 0x7f2150005430 con 0x55c81f4b2280 2024-08-31T04:22:15.697 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:15.689+0000 7f2172052740 1 -- 172.21.15.50:0/3844758195 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2150005020 con 0x55c81f4b2280 2024-08-31T04:22:15.697 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:15.689+0000 7f214a000640 1 -- 172.21.15.50:0/3844758195 <== mon.2 v2:172.21.15.133:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f2150005630 con 0x55c81f4b2280 2024-08-31T04:22:15.697 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:15.689+0000 7f2172052740 10 client.25046 fetch_fsmap learned FSMap version 28 2024-08-31T04:22:15.698 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:15.689+0000 7f2172052740 1 -- 172.21.15.50:0/3844758195 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55c81f8930e0 con 0x55c81f4b2280 2024-08-31T04:22:15.698 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:15.689+0000 7f214a000640 1 -- 172.21.15.50:0/3844758195 <== mon.2 v2:172.21.15.133:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2150005020 con 0x55c81f4b2280 2024-08-31T04:22:15.698 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:15.690+0000 7f214a000640 1 -- 172.21.15.50:0/3844758195 <== mon.2 v2:172.21.15.133:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f2150027020 con 0x55c81f4b2280 2024-08-31T04:22:15.698 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:15.690+0000 7f2172052740 10 client.25046 fetch_fsmap finished waiting for FSMap version 28 2024-08-31T04:22:15.698 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:15.690+0000 7f2172052740 10 client.25046 resolve_mds: resolved name 'c' to daemon mds.c 2024-08-31T04:22:15.698 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:15.690+0000 7f2172052740 20 client.25046 populate_metadata read hostname 'smithi050' 2024-08-31T04:22:15.698 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:15.690+0000 7f2172052740 1 --2- 172.21.15.50:0/3844758195 >> [v2:172.21.15.177:6836/2159859285,v1:172.21.15.177:6837/2159859285] conn(0x55c81f4918e0 0x55c81f896880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:15.698 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:15.690+0000 7f2172052740 4 client.25046 mds_command: new command op to 24652 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T04:22:15.698 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:15.690+0000 7f2172052740 1 -- 172.21.15.50:0/3844758195 --> [v2:172.21.15.177:6836/2159859285,v1:172.21.15.177:6837/2159859285] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c81f7f14a0 con 0x55c81f4918e0 2024-08-31T04:22:15.700 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:15.690+0000 7f2168a00640 1 --2- 172.21.15.50:0/3844758195 >> [v2:172.21.15.177:6836/2159859285,v1:172.21.15.177:6837/2159859285] conn(0x55c81f4918e0 0x55c81f896880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:22:15.700 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:15.691+0000 7f2168a00640 1 --2- 172.21.15.50:0/3844758195 >> [v2:172.21.15.177:6836/2159859285,v1:172.21.15.177:6837/2159859285] conn(0x55c81f4918e0 0x55c81f896880 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=ccb1f0fa39c37c1 server_cookie=36daa8efbfa860f1 in_seq=0 out_seq=0 2024-08-31T04:22:15.700 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:15.691+0000 7f214a000640 10 client.25046 ms_handle_connect on v2:172.21.15.177:6836/2159859285 2024-08-31T04:22:15.700 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:15.692+0000 7f214a000640 1 -- 172.21.15.50:0/3844758195 <== mds.4 v2:172.21.15.177:6836/2159859285 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55c81f7f14a0 con 0x55c81f4918e0 2024-08-31T04:22:15.700 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:15.692+0000 7f214a000640 10 client.25046 handle_command_reply: tid=0 2024-08-31T04:22:15.700 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:15.692+0000 7f2172052740 1 client.25046 shutdown 2024-08-31T04:22:15.700 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:15.692+0000 7f2172052740 1 -- 172.21.15.50:0/3844758195 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55c81f4b2280 msgr2=0x55c81f884810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:22:15.700 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:15.692+0000 7f2172052740 1 --2- 172.21.15.50:0/3844758195 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55c81f4b2280 0x55c81f884810 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f21641148b0 tx=0x7f2150011420 comp rx=0 tx=0).stop 2024-08-31T04:22:15.700 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:15.692+0000 7f2172052740 1 -- 172.21.15.50:0/3844758195 shutdown_connections 2024-08-31T04:22:15.701 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:15.692+0000 7f2172052740 1 --2- 172.21.15.50:0/3844758195 >> [v2:172.21.15.177:6836/2159859285,v1:172.21.15.177:6837/2159859285] conn(0x55c81f4918e0 0x55c81f896880 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:15.701 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:15.692+0000 7f2172052740 1 --2- 172.21.15.50:0/3844758195 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c81f4d2f60 0x55c81f8905a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:15.701 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:15.692+0000 7f2172052740 1 --2- 172.21.15.50:0/3844758195 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55c81f4b2280 0x55c81f884810 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:15.701 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:15.692+0000 7f2172052740 1 --2- 172.21.15.50:0/3844758195 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c81f4aa0a0 0x55c81f8842d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:15.701 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:15.692+0000 7f214a000640 0 client.25046 ms_handle_reset on v2:172.21.15.177:6836/2159859285 2024-08-31T04:22:15.701 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:15.692+0000 7f2172052740 1 -- 172.21.15.50:0/3844758195 >> 172.21.15.50:0/3844758195 conn(0x55c81f4c7350 msgr2=0x55c81f87bc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:22:15.701 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:15.692+0000 7f2172052740 1 -- 172.21.15.50:0/3844758195 shutdown_connections 2024-08-31T04:22:15.701 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:15.693+0000 7f2172052740 1 -- 172.21.15.50:0/3844758195 wait complete. 2024-08-31T04:22:15.701 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:15.693+0000 7f2172052740 20 client.25046 trim_cache size 0 max 16384 2024-08-31T04:22:15.713 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:15.712+0000 7f2172052740 1 Processor -- start 2024-08-31T04:22:15.713 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:15.712+0000 7f2172052740 1 -- start start 2024-08-31T04:22:15.714 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:15.712+0000 7f2172052740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c81f4c7350 0x55c81f882b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:15.714 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:15.712+0000 7f2172052740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c81f4aa0a0 0x55c81f87bb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:15.714 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:15.712+0000 7f2172052740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55c81f4b2280 0x55c81f87c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:15.714 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:15.712+0000 7f2172052740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55c81f894bc0 con 0x55c81f4c7350 2024-08-31T04:22:15.715 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:15.712+0000 7f2172052740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x55c81f895290 con 0x55c81f4b2280 2024-08-31T04:22:15.715 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:15.712+0000 7f2172052740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x55c81f895960 con 0x55c81f4aa0a0 2024-08-31T04:22:15.715 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:15.712+0000 7f2168a00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c81f4c7350 0x55c81f882b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:22:15.715 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:15.713+0000 7f2163e00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c81f4aa0a0 0x55c81f87bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:22:15.715 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:15.713+0000 7f2168a00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c81f4c7350 0x55c81f882b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35722/0 (socket says 172.21.15.50:35722) 2024-08-31T04:22:15.715 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:15.713+0000 7f2168a00640 1 -- 172.21.15.50:0/3018786780 learned_addr learned my addr 172.21.15.50:0/3018786780 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:22:15.715 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:15.713+0000 7f2163e00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c81f4aa0a0 0x55c81f87bb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.50:58368/0 (socket says 172.21.15.50:58368) 2024-08-31T04:22:15.715 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:15.713+0000 7f2169400640 1 --2- 172.21.15.50:0/3018786780 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55c81f4b2280 0x55c81f87c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:22:15.715 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:15.713+0000 7f2163e00640 1 -- 172.21.15.50:0/3018786780 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55c81f4b2280 msgr2=0x55c81f87c0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:22:15.715 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:15.713+0000 7f2163e00640 1 --2- 172.21.15.50:0/3018786780 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55c81f4b2280 0x55c81f87c0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:15.715 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:15.713+0000 7f2163e00640 1 -- 172.21.15.50:0/3018786780 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c81f4c7350 msgr2=0x55c81f882b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:22:15.715 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:15.713+0000 7f2163e00640 1 --2- 172.21.15.50:0/3018786780 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c81f4c7350 0x55c81f882b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:15.715 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:15.713+0000 7f2163e00640 1 -- 172.21.15.50:0/3018786780 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c81f87fb60 con 0x55c81f4aa0a0 2024-08-31T04:22:15.716 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:15.713+0000 7f2168a00640 1 --2- 172.21.15.50:0/3018786780 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c81f4c7350 0x55c81f882b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:22:15.716 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:15.713+0000 7f2163e00640 1 --2- 172.21.15.50:0/3018786780 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c81f4aa0a0 0x55c81f87bb70 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f2150004d60 tx=0x7f2150005f10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c543a991a557d364 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:22:15.719 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:15.714+0000 7f2155200640 1 -- 172.21.15.50:0/3018786780 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2150005290 con 0x55c81f4aa0a0 2024-08-31T04:22:15.720 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:15.714+0000 7f2155200640 1 -- 172.21.15.50:0/3018786780 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2150005430 con 0x55c81f4aa0a0 2024-08-31T04:22:15.720 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:15.714+0000 7f2155200640 1 -- 172.21.15.50:0/3018786780 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f215000fb40 con 0x55c81f4aa0a0 2024-08-31T04:22:15.720 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:15.714+0000 7f2172052740 1 -- 172.21.15.50:0/3018786780 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c81f4aa0a0 msgr2=0x55c81f87bb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:22:15.720 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:15.714+0000 7f2172052740 1 --2- 172.21.15.50:0/3018786780 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c81f4aa0a0 0x55c81f87bb70 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f2150004d60 tx=0x7f2150005f10 comp rx=0 tx=0).stop 2024-08-31T04:22:15.720 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:15.714+0000 7f2172052740 1 -- 172.21.15.50:0/3018786780 shutdown_connections 2024-08-31T04:22:15.720 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:15.714+0000 7f2172052740 1 --2- 172.21.15.50:0/3018786780 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c81f4aa0a0 0x55c81f87bb70 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:15.720 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:15.714+0000 7f2172052740 1 --2- 172.21.15.50:0/3018786780 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55c81f4b2280 0x55c81f87c0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:15.720 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:15.714+0000 7f2172052740 1 --2- 172.21.15.50:0/3018786780 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c81f4c7350 0x55c81f882b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:15.720 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:15.714+0000 7f2172052740 1 -- 172.21.15.50:0/3018786780 >> 172.21.15.50:0/3018786780 conn(0x55c81f871b80 msgr2=0x55c81f894430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:22:15.721 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:15.715+0000 7f2172052740 1 -- 172.21.15.50:0/3018786780 shutdown_connections 2024-08-31T04:22:15.721 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:15.715+0000 7f2172052740 1 -- 172.21.15.50:0/3018786780 wait complete. 2024-08-31T04:22:15.721 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:15.715+0000 7f2172052740 1 -- start start 2024-08-31T04:22:15.721 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:15.715+0000 7f2172052740 1 Processor -- start 2024-08-31T04:22:15.721 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:15.716+0000 7f2172052740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c81f4aa0a0 0x55c81f89f2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:15.721 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:15.716+0000 7f2172052740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55c81f4b2280 0x55c81f89a7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:15.721 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:15.716+0000 7f2172052740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c81f4c7350 0x55c81f89ad00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:15.721 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:15.716+0000 7f2172052740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55c81f896700 con 0x55c81f4c7350 2024-08-31T04:22:15.721 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:15.716+0000 7f2172052740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x55c81f896030 con 0x55c81f4b2280 2024-08-31T04:22:15.721 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:15.716+0000 7f2172052740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x55c81f896dd0 con 0x55c81f4aa0a0 2024-08-31T04:22:15.721 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:15.716+0000 7f2172052740 10 client.0 _ll_register_callbacks cb 0x7f21500119b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:22:15.721 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:15.716+0000 7f2168a00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c81f4aa0a0 0x55c81f89f2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:22:15.721 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:15.716+0000 7f2163e00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55c81f4b2280 0x55c81f89a7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:22:15.721 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:15.716+0000 7f2169400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c81f4c7350 0x55c81f89ad00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:22:15.722 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:15.716+0000 7f2168a00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c81f4aa0a0 0x55c81f89f2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.50:58380/0 (socket says 172.21.15.50:58380) 2024-08-31T04:22:15.722 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:15.716+0000 7f2168a00640 1 -- 172.21.15.50:0/3162691570 learned_addr learned my addr 172.21.15.50:0/3162691570 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:22:15.722 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:15.716+0000 7f2168a00640 1 -- 172.21.15.50:0/3162691570 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55c81f4b2280 msgr2=0x55c81f89a7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:22:15.722 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:15.716+0000 7f2168a00640 1 --2- 172.21.15.50:0/3162691570 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55c81f4b2280 0x55c81f89a7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:15.722 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:15.716+0000 7f2168a00640 1 -- 172.21.15.50:0/3162691570 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c81f4c7350 msgr2=0x55c81f89ad00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:22:15.722 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:15.716+0000 7f2168a00640 1 --2- 172.21.15.50:0/3162691570 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c81f4c7350 0x55c81f89ad00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:15.722 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:15.716+0000 7f2168a00640 1 -- 172.21.15.50:0/3162691570 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c81f89b440 con 0x55c81f4aa0a0 2024-08-31T04:22:15.722 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:15.717+0000 7f2168a00640 1 --2- 172.21.15.50:0/3162691570 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c81f4aa0a0 0x55c81f89f2c0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f215800fc70 tx=0x7f21580046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8bdd864ac9c452b server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:22:15.722 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:15.717+0000 7f214a000640 10 client.0 ms_handle_connect on v2:172.21.15.177:3300/0 2024-08-31T04:22:15.722 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:15.717+0000 7f214a000640 1 -- 172.21.15.50:0/3162691570 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f215801f8a0 con 0x55c81f4aa0a0 2024-08-31T04:22:15.722 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:15.717+0000 7f2172052740 1 -- 172.21.15.50:0/3162691570 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2150005430 con 0x55c81f4aa0a0 2024-08-31T04:22:15.722 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:15.717+0000 7f214a000640 1 -- 172.21.15.50:0/3162691570 <== mon.1 v2:172.21.15.177:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8219+0+0 (secure 0 0 0) 0x7f215801fa40 con 0x55c81f4aa0a0 2024-08-31T04:22:15.722 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:15.717+0000 7f214a000640 1 -- 172.21.15.50:0/3162691570 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f215801fc40 con 0x55c81f4aa0a0 2024-08-31T04:22:15.722 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:15.717+0000 7f2172052740 10 client.25060 fetch_fsmap learned FSMap version 28 2024-08-31T04:22:15.723 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:15.717+0000 7f2172052740 1 -- 172.21.15.50:0/3162691570 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55c81f901c80 con 0x55c81f4aa0a0 2024-08-31T04:22:15.723 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:15.718+0000 7f214a000640 1 -- 172.21.15.50:0/3162691570 <== mon.1 v2:172.21.15.177:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2150005430 con 0x55c81f4aa0a0 2024-08-31T04:22:15.723 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:15.718+0000 7f214a000640 1 -- 172.21.15.50:0/3162691570 <== mon.1 v2:172.21.15.177:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f21580049d0 con 0x55c81f4aa0a0 2024-08-31T04:22:15.723 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:15.718+0000 7f2172052740 10 client.25060 fetch_fsmap finished waiting for FSMap version 28 2024-08-31T04:22:15.723 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:15.718+0000 7f2172052740 10 client.25060 resolve_mds: resolved name 'c' to daemon mds.c 2024-08-31T04:22:15.723 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:15.718+0000 7f2172052740 20 client.25060 populate_metadata read hostname 'smithi050' 2024-08-31T04:22:15.723 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:15.718+0000 7f2172052740 1 --2- 172.21.15.50:0/3162691570 >> [v2:172.21.15.177:6836/2159859285,v1:172.21.15.177:6837/2159859285] conn(0x55c81f4d2f60 0x55c81f9055b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:15.723 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:15.718+0000 7f2172052740 4 client.25060 mds_command: new command op to 24652 tid=0 multi_id=0 [{"prefix": "status"}] 2024-08-31T04:22:15.723 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:15.718+0000 7f2172052740 1 -- 172.21.15.50:0/3162691570 --> [v2:172.21.15.177:6836/2159859285,v1:172.21.15.177:6837/2159859285] -- command(tid 0: {"prefix": "status"}) -- 0x55c81f7ecf40 con 0x55c81f4d2f60 2024-08-31T04:22:15.723 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:15.718+0000 7f2163e00640 1 --2- 172.21.15.50:0/3162691570 >> [v2:172.21.15.177:6836/2159859285,v1:172.21.15.177:6837/2159859285] conn(0x55c81f4d2f60 0x55c81f9055b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:22:15.724 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:15.719+0000 7f2163e00640 1 --2- 172.21.15.50:0/3162691570 >> [v2:172.21.15.177:6836/2159859285,v1:172.21.15.177:6837/2159859285] conn(0x55c81f4d2f60 0x55c81f9055b0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=95ff03ffdac58d67 server_cookie=a12889765411d09b in_seq=0 out_seq=0 2024-08-31T04:22:15.724 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:15.719+0000 7f214a000640 10 client.25060 ms_handle_connect on v2:172.21.15.177:6836/2159859285 2024-08-31T04:22:15.725 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:15.719+0000 7f214a000640 1 -- 172.21.15.50:0/3162691570 <== mds.4 v2:172.21.15.177:6836/2159859285 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x55c81f7ecf40 con 0x55c81f4d2f60 2024-08-31T04:22:15.725 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:15.719+0000 7f214a000640 10 client.25060 handle_command_reply: tid=0 2024-08-31T04:22:15.725 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:15.719+0000 7f2172052740 1 client.25060 shutdown 2024-08-31T04:22:15.725 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:15.720+0000 7f2172052740 1 -- 172.21.15.50:0/3162691570 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c81f4aa0a0 msgr2=0x55c81f89f2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:22:15.725 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:15.720+0000 7f2172052740 1 --2- 172.21.15.50:0/3162691570 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c81f4aa0a0 0x55c81f89f2c0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f215800fc70 tx=0x7f21580046c0 comp rx=0 tx=0).stop 2024-08-31T04:22:15.725 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:15.720+0000 7f2172052740 1 -- 172.21.15.50:0/3162691570 shutdown_connections 2024-08-31T04:22:15.725 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:15.720+0000 7f2172052740 1 --2- 172.21.15.50:0/3162691570 >> [v2:172.21.15.177:6836/2159859285,v1:172.21.15.177:6837/2159859285] conn(0x55c81f4d2f60 0x55c81f9055b0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:15.725 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:15.720+0000 7f2172052740 1 --2- 172.21.15.50:0/3162691570 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c81f4c7350 0x55c81f89ad00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:15.725 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:15.720+0000 7f2172052740 1 --2- 172.21.15.50:0/3162691570 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55c81f4b2280 0x55c81f89a7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:15.725 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:15.720+0000 7f2172052740 1 --2- 172.21.15.50:0/3162691570 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c81f4aa0a0 0x55c81f89f2c0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:15.725 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:15.720+0000 7f214a000640 0 client.25060 ms_handle_reset on v2:172.21.15.177:6836/2159859285 2024-08-31T04:22:15.725 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:15.720+0000 7f2172052740 1 -- 172.21.15.50:0/3162691570 >> 172.21.15.50:0/3162691570 conn(0x55c81f871b80 msgr2=0x55c81f894430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:22:15.725 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:15.720+0000 7f2172052740 1 -- 172.21.15.50:0/3162691570 shutdown_connections 2024-08-31T04:22:15.726 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:15.720+0000 7f2172052740 1 -- 172.21.15.50:0/3162691570 wait complete. 2024-08-31T04:22:15.726 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:15.720+0000 7f2172052740 20 client.25060 trim_cache size 0 max 16384 2024-08-31T04:22:15.726 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:22:15 smithi050 ceph-mon[17259]: pgmap v347: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-08-31T04:22:15.726 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-08-31T04:22:15.726 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_fsid": "058d9fc6-674f-11ef-bcd4-c7b262605968", 2024-08-31T04:22:15.726 INFO:teuthology.orchestra.run.smithi050.stdout: "whoami": 4, 2024-08-31T04:22:15.726 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 24652, 2024-08-31T04:22:15.727 INFO:teuthology.orchestra.run.smithi050.stdout: "want_state": "up:active", 2024-08-31T04:22:15.727 INFO:teuthology.orchestra.run.smithi050.stdout: "state": "up:active", 2024-08-31T04:22:15.727 INFO:teuthology.orchestra.run.smithi050.stdout: "fs_name": "cephfs", 2024-08-31T04:22:15.727 INFO:teuthology.orchestra.run.smithi050.stdout: "rank_uptime": 74.682070190000005, 2024-08-31T04:22:15.727 INFO:teuthology.orchestra.run.smithi050.stdout: "mdsmap_epoch": 28, 2024-08-31T04:22:15.727 INFO:teuthology.orchestra.run.smithi050.stdout: "osdmap_epoch": 78, 2024-08-31T04:22:15.727 INFO:teuthology.orchestra.run.smithi050.stdout: "osdmap_epoch_barrier": 78, 2024-08-31T04:22:15.727 INFO:teuthology.orchestra.run.smithi050.stdout: "uptime": 120.277220142 2024-08-31T04:22:15.727 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-08-31T04:22:15.728 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:15.721+0000 7f2169e00640 1 -- 172.21.15.50:0/2881485348 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f214c0b4bc0 msgr2=0x7f214c0b70d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:22:15.728 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:15.721+0000 7f2169e00640 1 --2- 172.21.15.50:0/2881485348 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f214c0b4bc0 0x7f214c0b70d0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x55c81f877720 tx=0x7f2158005f90 comp rx=0 tx=0).stop 2024-08-31T04:22:15.728 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:15.721+0000 7f2169e00640 1 -- 172.21.15.50:0/2881485348 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2164114310 msgr2=0x7f21641a5f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:22:15.728 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:15.721+0000 7f2169e00640 1 --2- 172.21.15.50:0/2881485348 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2164114310 0x7f21641a5f00 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f215c005cc0 tx=0x7f215c030db0 comp rx=0 tx=0).stop 2024-08-31T04:22:15.728 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:15.721+0000 7f2169e00640 1 -- 172.21.15.50:0/2881485348 shutdown_connections 2024-08-31T04:22:15.728 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:15.721+0000 7f2169e00640 1 --2- 172.21.15.50:0/2881485348 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f214c0b4bc0 0x7f214c0b70d0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:15.728 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:15.721+0000 7f2169e00640 1 --2- 172.21.15.50:0/2881485348 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2164114310 0x7f21641a5f00 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:15.728 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:15.721+0000 7f2169e00640 1 --2- 172.21.15.50:0/2881485348 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2164078030 0x7f21641a0c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:15.728 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:15.721+0000 7f2169e00640 1 --2- 172.21.15.50:0/2881485348 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f21640776e0 0x7f21641a06c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:15.728 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:15.721+0000 7f2169e00640 1 -- 172.21.15.50:0/2881485348 >> 172.21.15.50:0/2881485348 conn(0x7f2164101420 msgr2=0x7f2164116370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:22:15.728 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:15.721+0000 7f2169e00640 1 -- 172.21.15.50:0/2881485348 shutdown_connections 2024-08-31T04:22:15.729 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:15.721+0000 7f2169e00640 1 -- 172.21.15.50:0/2881485348 wait complete. 2024-08-31T04:22:15.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:22:15 smithi177 ceph-mon[22025]: pgmap v347: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-08-31T04:22:15.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:22:15 smithi133 ceph-mon[22177]: pgmap v347: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-08-31T04:22:16.557 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 058d9fc6-674f-11ef-bcd4-c7b262605968 -- ceph tell mds.h status 2024-08-31T04:22:16.942 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:22:17.578 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:17.576+0000 7fd094000640 1 -- 172.21.15.50:0/3645854290 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd08c077120 msgr2=0x7fd08c075550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:22:17.579 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:17.576+0000 7fd094000640 1 --2- 172.21.15.50:0/3645854290 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd08c077120 0x7fd08c075550 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fd080009900 tx=0x7fd08002a410 comp rx=0 tx=0).stop 2024-08-31T04:22:17.579 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:17.577+0000 7fd094000640 1 -- 172.21.15.50:0/3645854290 shutdown_connections 2024-08-31T04:22:17.579 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:17.577+0000 7fd094000640 1 --2- 172.21.15.50:0/3645854290 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd08c1141d0 0x7fd08c1166a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:17.579 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:17.577+0000 7fd094000640 1 --2- 172.21.15.50:0/3645854290 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd08c075b70 0x7fd08c075f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:17.579 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:17.577+0000 7fd094000640 1 --2- 172.21.15.50:0/3645854290 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd08c077120 0x7fd08c075550 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:17.579 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:17.577+0000 7fd094000640 1 -- 172.21.15.50:0/3645854290 >> 172.21.15.50:0/3645854290 conn(0x7fd08c07b5f0 msgr2=0x7fd08c07ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:22:17.579 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:17.577+0000 7fd094000640 1 -- 172.21.15.50:0/3645854290 shutdown_connections 2024-08-31T04:22:17.579 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:17.577+0000 7fd094000640 1 -- 172.21.15.50:0/3645854290 wait complete. 2024-08-31T04:22:17.580 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:17.578+0000 7fd094000640 1 Processor -- start 2024-08-31T04:22:17.581 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:17.578+0000 7fd094000640 1 -- start start 2024-08-31T04:22:17.581 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:17.578+0000 7fd094000640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd08c075b70 0x7fd08c1a07d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:17.581 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:17.578+0000 7fd094000640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd08c077120 0x7fd08c1a0d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:17.581 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:17.578+0000 7fd094000640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd08c1141d0 0x7fd08c1a6010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:17.581 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:17.578+0000 7fd094000640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fd08c119e60 con 0x7fd08c075b70 2024-08-31T04:22:17.581 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:17.578+0000 7fd094000640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7fd08c119ce0 con 0x7fd08c077120 2024-08-31T04:22:17.581 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:17.578+0000 7fd094000640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fd08c119fe0 con 0x7fd08c1141d0 2024-08-31T04:22:17.581 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:17.578+0000 7fd091600640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd08c075b70 0x7fd08c1a07d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:22:17.581 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:17.579+0000 7fd091600640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd08c075b70 0x7fd08c1a07d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35746/0 (socket says 172.21.15.50:35746) 2024-08-31T04:22:17.581 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:17.579+0000 7fd091600640 1 -- 172.21.15.50:0/3015776245 learned_addr learned my addr 172.21.15.50:0/3015776245 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:22:17.581 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:17.579+0000 7fd090c00640 1 --2- 172.21.15.50:0/3015776245 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd08c077120 0x7fd08c1a0d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:22:17.581 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:17.579+0000 7fd092000640 1 --2- 172.21.15.50:0/3015776245 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd08c1141d0 0x7fd08c1a6010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:22:17.582 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:17.579+0000 7fd091600640 1 -- 172.21.15.50:0/3015776245 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd08c1141d0 msgr2=0x7fd08c1a6010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:22:17.582 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:17.579+0000 7fd091600640 1 --2- 172.21.15.50:0/3015776245 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd08c1141d0 0x7fd08c1a6010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:17.582 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:17.579+0000 7fd091600640 1 -- 172.21.15.50:0/3015776245 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd08c077120 msgr2=0x7fd08c1a0d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:22:17.582 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:17.579+0000 7fd091600640 1 --2- 172.21.15.50:0/3015776245 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd08c077120 0x7fd08c1a0d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:17.582 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:17.579+0000 7fd091600640 1 -- 172.21.15.50:0/3015776245 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd08c1a6740 con 0x7fd08c075b70 2024-08-31T04:22:17.582 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:17.579+0000 7fd090c00640 1 --2- 172.21.15.50:0/3015776245 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd08c077120 0x7fd08c1a0d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:22:17.582 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:17.579+0000 7fd091600640 1 --2- 172.21.15.50:0/3015776245 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd08c075b70 0x7fd08c1a07d0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fd080005ab0 tx=0x7fd080003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:22:17.583 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:17.580+0000 7fd08a000640 1 -- 172.21.15.50:0/3015776245 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd08003f070 con 0x7fd08c075b70 2024-08-31T04:22:17.583 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:17.580+0000 7fd094000640 1 -- 172.21.15.50:0/3015776245 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd08c1a69d0 con 0x7fd08c075b70 2024-08-31T04:22:17.583 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:17.580+0000 7fd08a000640 1 -- 172.21.15.50:0/3015776245 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd080031b60 con 0x7fd08c075b70 2024-08-31T04:22:17.583 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:17.580+0000 7fd094000640 1 -- 172.21.15.50:0/3015776245 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd08c1ad190 con 0x7fd08c075b70 2024-08-31T04:22:17.583 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:17.580+0000 7fd08a000640 1 -- 172.21.15.50:0/3015776245 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd080049060 con 0x7fd08c075b70 2024-08-31T04:22:17.584 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:17.583+0000 7fd09acab740 1 Processor -- start 2024-08-31T04:22:17.584 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:17.583+0000 7fd09acab740 1 -- start start 2024-08-31T04:22:17.585 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:17.584+0000 7fd09acab740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b067105f60 0x55b0674ab8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:17.585 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:17.584+0000 7fd08a000640 1 -- 172.21.15.50:0/3015776245 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 17) ==== 152628+0+0 (secure 0 0 0) 0x7fd080042070 con 0x7fd08c075b70 2024-08-31T04:22:17.585 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:17.584+0000 7fd09acab740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b0670dd0a0 0x55b0674abe30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:17.585 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:17.584+0000 7fd09acab740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b0670e5280 0x55b0674ac370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:17.586 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:17.584+0000 7fd09acab740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55b067422550 con 0x55b0670e5280 2024-08-31T04:22:17.586 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:17.584+0000 7fd09acab740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x55b067411ae0 con 0x55b067105f60 2024-08-31T04:22:17.586 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:17.584+0000 7fd09acab740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x55b067415a90 con 0x55b0670dd0a0 2024-08-31T04:22:17.586 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:17.584+0000 7fd092000640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b067105f60 0x55b0674ab8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:22:17.586 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:17.584+0000 7fd091600640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b0670dd0a0 0x55b0674abe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:22:17.586 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:17.584+0000 7fd090c00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b0670e5280 0x55b0674ac370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:22:17.586 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:17.584+0000 7fd092000640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b067105f60 0x55b0674ab8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.50:49920/0 (socket says 172.21.15.50:49920) 2024-08-31T04:22:17.586 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:17.584+0000 7fd092000640 1 -- 172.21.15.50:0/4153487279 learned_addr learned my addr 172.21.15.50:0/4153487279 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:22:17.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:17.585+0000 7fd092000640 1 -- 172.21.15.50:0/4153487279 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b0670dd0a0 msgr2=0x55b0674abe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:22:17.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:17.585+0000 7fd092000640 1 --2- 172.21.15.50:0/4153487279 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b0670dd0a0 0x55b0674abe30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:17.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:17.585+0000 7fd092000640 1 -- 172.21.15.50:0/4153487279 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b0670e5280 msgr2=0x55b0674ac370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:22:17.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:17.585+0000 7fd092000640 1 --2- 172.21.15.50:0/4153487279 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b0670e5280 0x55b0674ac370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:17.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:17.585+0000 7fd092000640 1 -- 172.21.15.50:0/4153487279 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b067171540 con 0x55b067105f60 2024-08-31T04:22:17.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:17.585+0000 7fd090c00640 1 --2- 172.21.15.50:0/4153487279 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b0670e5280 0x55b0674ac370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:22:17.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:17.585+0000 7fd092000640 1 --2- 172.21.15.50:0/4153487279 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b067105f60 0x55b0674ab8f0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fd084009fd0 tx=0x7fd0840118d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=af147c3b1780dad5 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:22:17.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:17.585+0000 7fd07e600640 1 -- 172.21.15.50:0/4153487279 <== mon.2 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd084004d20 con 0x55b067105f60 2024-08-31T04:22:17.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:17.585+0000 7fd07e600640 1 -- 172.21.15.50:0/4153487279 <== mon.2 v2:172.21.15.133:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd084004050 con 0x55b067105f60 2024-08-31T04:22:17.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:17.585+0000 7fd07e600640 1 -- 172.21.15.50:0/4153487279 <== mon.2 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd084005280 con 0x55b067105f60 2024-08-31T04:22:17.588 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:17.586+0000 7fd08a000640 1 --2- 172.21.15.50:0/3015776245 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fd0740b4bc0 0x7fd0740b70d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:17.588 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:17.586+0000 7fd08a000640 1 -- 172.21.15.50:0/3015776245 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8219+0+0 (secure 0 0 0) 0x7fd080105960 con 0x7fd08c075b70 2024-08-31T04:22:17.588 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:17.586+0000 7fd091600640 1 --2- 172.21.15.50:0/3015776245 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fd0740b4bc0 0x7fd0740b70d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:22:17.589 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:17.586+0000 7fd09acab740 1 -- 172.21.15.50:0/4153487279 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b067105f60 msgr2=0x55b0674ab8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:22:17.589 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:17.586+0000 7fd09acab740 1 --2- 172.21.15.50:0/4153487279 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b067105f60 0x55b0674ab8f0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fd084009fd0 tx=0x7fd0840118d0 comp rx=0 tx=0).stop 2024-08-31T04:22:17.589 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:17.586+0000 7fd091600640 1 --2- 172.21.15.50:0/3015776245 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fd0740b4bc0 0x7fd0740b70d0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x55b0674aa570 tx=0x7fd08010b550 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:22:17.589 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:17.587+0000 7fd09acab740 1 -- 172.21.15.50:0/4153487279 shutdown_connections 2024-08-31T04:22:17.589 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:17.587+0000 7fd09acab740 1 --2- 172.21.15.50:0/4153487279 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b0670dd0a0 0x55b0674abe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:17.589 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:17.587+0000 7fd09acab740 1 --2- 172.21.15.50:0/4153487279 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b0670e5280 0x55b0674ac370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:17.589 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:17.587+0000 7fd09acab740 1 --2- 172.21.15.50:0/4153487279 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b067105f60 0x55b0674ab8f0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:17.589 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:17.587+0000 7fd09acab740 1 -- 172.21.15.50:0/4153487279 >> 172.21.15.50:0/4153487279 conn(0x55b0670fa350 msgr2=0x55b0674a97e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:22:17.590 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:17.587+0000 7fd09acab740 1 -- 172.21.15.50:0/4153487279 shutdown_connections 2024-08-31T04:22:17.590 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:17.587+0000 7fd09acab740 1 -- 172.21.15.50:0/4153487279 wait complete. 2024-08-31T04:22:17.590 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:17.587+0000 7fd09acab740 1 -- start start 2024-08-31T04:22:17.590 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:17.587+0000 7fd09acab740 1 Processor -- start 2024-08-31T04:22:17.596 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:17.588+0000 7fd09acab740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b0670dd0a0 0x55b0674b7060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:17.596 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:17.588+0000 7fd09acab740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b0670e5280 0x55b0674b75a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:17.596 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:17.588+0000 7fd09acab740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b067105f60 0x55b0674c33f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:17.596 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:17.588+0000 7fd09acab740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55b0672745f0 con 0x55b067105f60 2024-08-31T04:22:17.596 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:17.588+0000 7fd09acab740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x55b067398bd0 con 0x55b0670e5280 2024-08-31T04:22:17.596 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:17.588+0000 7fd09acab740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x55b0674ba0d0 con 0x55b0670dd0a0 2024-08-31T04:22:17.597 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:17.588+0000 7fd09acab740 10 client.0 _ll_register_callbacks cb 0x55b0673be210 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:22:17.597 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:17.588+0000 7fd092000640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b0670dd0a0 0x55b0674b7060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:22:17.597 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:17.588+0000 7fd090c00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b0670e5280 0x55b0674b75a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:22:17.597 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:17.588+0000 7fd092000640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b067105f60 0x55b0674c33f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:22:17.597 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:17.588+0000 7fd090c00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b0670e5280 0x55b0674b75a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.50:49934/0 (socket says 172.21.15.50:49934) 2024-08-31T04:22:17.598 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:17.588+0000 7fd090c00640 1 -- 172.21.15.50:0/1415933860 learned_addr learned my addr 172.21.15.50:0/1415933860 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:22:17.598 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:17.589+0000 7fd090c00640 1 -- 172.21.15.50:0/1415933860 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b0670dd0a0 msgr2=0x55b0674b7060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:22:17.598 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:17.589+0000 7fd090c00640 1 --2- 172.21.15.50:0/1415933860 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b0670dd0a0 0x55b0674b7060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:17.598 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:17.589+0000 7fd090c00640 1 -- 172.21.15.50:0/1415933860 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b067105f60 msgr2=0x55b0674c33f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:22:17.598 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:17.589+0000 7fd090c00640 1 --2- 172.21.15.50:0/1415933860 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b067105f60 0x55b0674c33f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:17.598 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:17.589+0000 7fd090c00640 1 -- 172.21.15.50:0/1415933860 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b0673d9650 con 0x55b0670e5280 2024-08-31T04:22:17.599 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:17.589+0000 7fd090c00640 1 --2- 172.21.15.50:0/1415933860 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b0670e5280 0x55b0674b75a0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fd078012d00 tx=0x7fd07800f790 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f5d93864b8a9ca83 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:22:17.599 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:17.589+0000 7fd072a00640 10 client.0 ms_handle_connect on v2:172.21.15.133:3300/0 2024-08-31T04:22:17.599 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:17.589+0000 7fd072a00640 1 -- 172.21.15.50:0/1415933860 <== mon.2 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd078009d90 con 0x55b0670e5280 2024-08-31T04:22:17.599 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:17.589+0000 7fd09acab740 1 -- 172.21.15.50:0/1415933860 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd084004050 con 0x55b0670e5280 2024-08-31T04:22:17.599 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:17.589+0000 7fd072a00640 1 -- 172.21.15.50:0/1415933860 <== mon.2 v2:172.21.15.133:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8219+0+0 (secure 0 0 0) 0x7fd0780120d0 con 0x55b0670e5280 2024-08-31T04:22:17.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:17.590+0000 7fd072a00640 1 -- 172.21.15.50:0/1415933860 <== mon.2 v2:172.21.15.133:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fd0780047a0 con 0x55b0670e5280 2024-08-31T04:22:17.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:17.590+0000 7fd09acab740 10 client.25064 fetch_fsmap learned FSMap version 28 2024-08-31T04:22:17.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:17.590+0000 7fd09acab740 1 -- 172.21.15.50:0/1415933860 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55b0674c5f80 con 0x55b0670e5280 2024-08-31T04:22:17.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:17.590+0000 7fd072a00640 1 -- 172.21.15.50:0/1415933860 <== mon.2 v2:172.21.15.133:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd084004050 con 0x55b0670e5280 2024-08-31T04:22:17.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:17.590+0000 7fd072a00640 1 -- 172.21.15.50:0/1415933860 <== mon.2 v2:172.21.15.133:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fd0780104c0 con 0x55b0670e5280 2024-08-31T04:22:17.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:17.590+0000 7fd09acab740 10 client.25064 fetch_fsmap finished waiting for FSMap version 28 2024-08-31T04:22:17.601 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:17.591+0000 7fd09acab740 10 client.25064 resolve_mds: resolved name 'h' to daemon mds.h 2024-08-31T04:22:17.601 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:17.591+0000 7fd09acab740 20 client.25064 populate_metadata read hostname 'smithi050' 2024-08-31T04:22:17.601 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:17.591+0000 7fd09acab740 1 --2- 172.21.15.50:0/1415933860 >> [v2:172.21.15.133:6836/4014853202,v1:172.21.15.133:6837/4014853202] conn(0x55b0670c48e0 0x55b0674c99b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:17.601 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:17.591+0000 7fd09acab740 4 client.25064 mds_command: new command op to 24656 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T04:22:17.601 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:17.591+0000 7fd09acab740 1 -- 172.21.15.50:0/1415933860 --> [v2:172.21.15.133:6836/4014853202,v1:172.21.15.133:6837/4014853202] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b0674244a0 con 0x55b0670c48e0 2024-08-31T04:22:17.601 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:17.591+0000 7fd092000640 1 --2- 172.21.15.50:0/1415933860 >> [v2:172.21.15.133:6836/4014853202,v1:172.21.15.133:6837/4014853202] conn(0x55b0670c48e0 0x55b0674c99b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:22:17.602 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:17.592+0000 7fd092000640 1 --2- 172.21.15.50:0/1415933860 >> [v2:172.21.15.133:6836/4014853202,v1:172.21.15.133:6837/4014853202] conn(0x55b0670c48e0 0x55b0674c99b0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=1d7ded3576c951de server_cookie=4e5f7f3105b22e27 in_seq=0 out_seq=0 2024-08-31T04:22:17.602 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:17.592+0000 7fd072a00640 10 client.25064 ms_handle_connect on v2:172.21.15.133:6836/4014853202 2024-08-31T04:22:17.602 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:17.592+0000 7fd072a00640 1 -- 172.21.15.50:0/1415933860 <== mds.3 v2:172.21.15.133:6836/4014853202 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55b0674244a0 con 0x55b0670c48e0 2024-08-31T04:22:17.602 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:17.592+0000 7fd072a00640 10 client.25064 handle_command_reply: tid=0 2024-08-31T04:22:17.602 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:17.593+0000 7fd09acab740 1 client.25064 shutdown 2024-08-31T04:22:17.602 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:17.593+0000 7fd09acab740 1 -- 172.21.15.50:0/1415933860 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b0670e5280 msgr2=0x55b0674b75a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:22:17.603 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:17.593+0000 7fd09acab740 1 --2- 172.21.15.50:0/1415933860 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b0670e5280 0x55b0674b75a0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fd078012d00 tx=0x7fd07800f790 comp rx=0 tx=0).stop 2024-08-31T04:22:17.603 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:17.593+0000 7fd09acab740 1 -- 172.21.15.50:0/1415933860 shutdown_connections 2024-08-31T04:22:17.603 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:17.593+0000 7fd09acab740 1 --2- 172.21.15.50:0/1415933860 >> [v2:172.21.15.133:6836/4014853202,v1:172.21.15.133:6837/4014853202] conn(0x55b0670c48e0 0x55b0674c99b0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:17.603 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:17.593+0000 7fd09acab740 1 --2- 172.21.15.50:0/1415933860 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b067105f60 0x55b0674c33f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:17.603 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:17.593+0000 7fd09acab740 1 --2- 172.21.15.50:0/1415933860 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b0670e5280 0x55b0674b75a0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:17.603 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:17.593+0000 7fd09acab740 1 --2- 172.21.15.50:0/1415933860 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b0670dd0a0 0x55b0674b7060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:17.604 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:17.593+0000 7fd072a00640 0 client.25064 ms_handle_reset on v2:172.21.15.133:6836/4014853202 2024-08-31T04:22:17.604 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:17.593+0000 7fd09acab740 1 -- 172.21.15.50:0/1415933860 >> 172.21.15.50:0/1415933860 conn(0x55b0670fa350 msgr2=0x55b0674aea80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:22:17.604 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:17.593+0000 7fd09acab740 1 -- 172.21.15.50:0/1415933860 shutdown_connections 2024-08-31T04:22:17.604 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:17.593+0000 7fd09acab740 1 -- 172.21.15.50:0/1415933860 wait complete. 2024-08-31T04:22:17.604 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:17.593+0000 7fd09acab740 20 client.25064 trim_cache size 0 max 16384 2024-08-31T04:22:17.615 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:17.612+0000 7fd09acab740 1 Processor -- start 2024-08-31T04:22:17.615 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:17.612+0000 7fd09acab740 1 -- start start 2024-08-31T04:22:17.615 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:17.613+0000 7fd09acab740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b0670dd0a0 0x55b0674a44c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:17.616 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:17.613+0000 7fd09acab740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b0670e5280 0x55b0674b58e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:17.616 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:17.613+0000 7fd09acab740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b067105f60 0x55b0674b5e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:17.616 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:17.613+0000 7fd09acab740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55b0674c7cf0 con 0x55b0670dd0a0 2024-08-31T04:22:17.616 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:17.613+0000 7fd09acab740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x55b0674c83c0 con 0x55b0670e5280 2024-08-31T04:22:17.616 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:17.613+0000 7fd09acab740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x55b0674c8a90 con 0x55b067105f60 2024-08-31T04:22:17.616 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:17.613+0000 7fd092000640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b0670dd0a0 0x55b0674a44c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:22:17.616 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:17.613+0000 7fd092000640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b0670dd0a0 0x55b0674a44c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35780/0 (socket says 172.21.15.50:35780) 2024-08-31T04:22:17.617 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:17.613+0000 7fd092000640 1 -- 172.21.15.50:0/4207007687 learned_addr learned my addr 172.21.15.50:0/4207007687 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:22:17.617 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:17.613+0000 7fd090c00640 1 --2- 172.21.15.50:0/4207007687 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b0670e5280 0x55b0674b58e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:22:17.617 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:17.613+0000 7fd092000640 1 --2- 172.21.15.50:0/4207007687 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b067105f60 0x55b0674b5e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:22:17.617 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:17.613+0000 7fd092000640 1 -- 172.21.15.50:0/4207007687 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b067105f60 msgr2=0x55b0674b5e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:22:17.617 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:17.613+0000 7fd092000640 1 --2- 172.21.15.50:0/4207007687 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b067105f60 0x55b0674b5e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:17.617 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:17.613+0000 7fd092000640 1 -- 172.21.15.50:0/4207007687 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b0670e5280 msgr2=0x55b0674b58e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:22:17.618 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:17.613+0000 7fd092000640 1 --2- 172.21.15.50:0/4207007687 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b0670e5280 0x55b0674b58e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:17.618 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:17.613+0000 7fd092000640 1 -- 172.21.15.50:0/4207007687 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b0674aa0d0 con 0x55b0670dd0a0 2024-08-31T04:22:17.618 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:17.614+0000 7fd092000640 1 --2- 172.21.15.50:0/4207007687 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b0670dd0a0 0x55b0674a44c0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x55b0674aa2b0 tx=0x7fd0840048d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2fe1f920f9ce9af4 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:22:17.618 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:17.614+0000 7fd07dc00640 1 -- 172.21.15.50:0/4207007687 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd084004940 con 0x55b0670dd0a0 2024-08-31T04:22:17.618 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:17.614+0000 7fd07dc00640 1 -- 172.21.15.50:0/4207007687 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd084004050 con 0x55b0670dd0a0 2024-08-31T04:22:17.618 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:17.614+0000 7fd07dc00640 1 -- 172.21.15.50:0/4207007687 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0840052a0 con 0x55b0670dd0a0 2024-08-31T04:22:17.621 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:17.615+0000 7fd09acab740 1 -- 172.21.15.50:0/4207007687 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b0670dd0a0 msgr2=0x55b0674a44c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:22:17.621 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:17.615+0000 7fd09acab740 1 --2- 172.21.15.50:0/4207007687 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b0670dd0a0 0x55b0674a44c0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x55b0674aa2b0 tx=0x7fd0840048d0 comp rx=0 tx=0).stop 2024-08-31T04:22:17.621 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:17.615+0000 7fd09acab740 1 -- 172.21.15.50:0/4207007687 shutdown_connections 2024-08-31T04:22:17.622 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:17.615+0000 7fd09acab740 1 --2- 172.21.15.50:0/4207007687 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b067105f60 0x55b0674b5e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:17.622 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:17.615+0000 7fd09acab740 1 --2- 172.21.15.50:0/4207007687 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b0670e5280 0x55b0674b58e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:17.622 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:17.615+0000 7fd09acab740 1 --2- 172.21.15.50:0/4207007687 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b0670dd0a0 0x55b0674a44c0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:17.622 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:17.615+0000 7fd09acab740 1 -- 172.21.15.50:0/4207007687 >> 172.21.15.50:0/4207007687 conn(0x55b0670fa350 msgr2=0x55b0674c73f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:22:17.622 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:17.615+0000 7fd09acab740 1 -- 172.21.15.50:0/4207007687 shutdown_connections 2024-08-31T04:22:17.622 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:17.615+0000 7fd09acab740 1 -- 172.21.15.50:0/4207007687 wait complete. 2024-08-31T04:22:17.622 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:17.615+0000 7fd09acab740 1 -- start start 2024-08-31T04:22:17.622 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:17.616+0000 7fd09acab740 1 Processor -- start 2024-08-31T04:22:17.622 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:17.616+0000 7fd09acab740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b0670dd0a0 0x55b0674cd570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:17.622 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:17.616+0000 7fd09acab740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b0670e5280 0x55b0674cdb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:17.622 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:17.616+0000 7fd09acab740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b067105f60 0x55b06752ceb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:17.622 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:17.616+0000 7fd09acab740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55b0674c9830 con 0x55b0670e5280 2024-08-31T04:22:17.623 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:17.616+0000 7fd09acab740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x55b0674c9160 con 0x55b0670dd0a0 2024-08-31T04:22:17.623 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:17.616+0000 7fd09acab740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x55b0674c9f00 con 0x55b067105f60 2024-08-31T04:22:17.623 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:17.616+0000 7fd09acab740 10 client.0 _ll_register_callbacks cb 0x7fd078012910 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:22:17.623 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:17.616+0000 7fd090c00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b0670e5280 0x55b0674cdb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:22:17.623 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:17.617+0000 7fd092000640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b0670dd0a0 0x55b0674cd570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:22:17.623 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:17.617+0000 7fd092000640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b0670dd0a0 0x55b0674cd570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.50:49960/0 (socket says 172.21.15.50:49960) 2024-08-31T04:22:17.623 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:17.617+0000 7fd090c00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b0670e5280 0x55b0674cdb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35796/0 (socket says 172.21.15.50:35796) 2024-08-31T04:22:17.623 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:17.617+0000 7fd092000640 1 -- 172.21.15.50:0/1696931296 learned_addr learned my addr 172.21.15.50:0/1696931296 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:22:17.623 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:17.617+0000 7fd092000640 1 --2- 172.21.15.50:0/1696931296 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b067105f60 0x55b06752ceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:22:17.623 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:17.617+0000 7fd090c00640 1 -- 172.21.15.50:0/1696931296 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b067105f60 msgr2=0x55b06752ceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:22:17.623 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:17.617+0000 7fd090c00640 1 --2- 172.21.15.50:0/1696931296 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b067105f60 0x55b06752ceb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:17.623 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:17.617+0000 7fd090c00640 1 -- 172.21.15.50:0/1696931296 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b0670dd0a0 msgr2=0x55b0674cd570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:22:17.623 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:17.617+0000 7fd090c00640 1 --2- 172.21.15.50:0/1696931296 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b0670dd0a0 0x55b0674cd570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:17.623 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:17.617+0000 7fd090c00640 1 -- 172.21.15.50:0/1696931296 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b06752d520 con 0x55b0670e5280 2024-08-31T04:22:17.624 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:17.618+0000 7fd090c00640 1 --2- 172.21.15.50:0/1696931296 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b0670e5280 0x55b0674cdb30 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fd078012cd0 tx=0x7fd078009fa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c68493c73a17c8e server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:22:17.624 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:17.618+0000 7fd072a00640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-08-31T04:22:17.624 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:17.618+0000 7fd072a00640 1 -- 172.21.15.50:0/1696931296 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd078010430 con 0x55b0670e5280 2024-08-31T04:22:17.624 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:17.618+0000 7fd072a00640 1 -- 172.21.15.50:0/1696931296 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8219+0+0 (secure 0 0 0) 0x7fd0780105d0 con 0x55b0670e5280 2024-08-31T04:22:17.624 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:17.618+0000 7fd09acab740 1 -- 172.21.15.50:0/1696931296 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd084004050 con 0x55b0670e5280 2024-08-31T04:22:17.624 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:17.618+0000 7fd072a00640 1 -- 172.21.15.50:0/1696931296 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fd078004040 con 0x55b0670e5280 2024-08-31T04:22:17.624 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:17.618+0000 7fd09acab740 10 client.15075 fetch_fsmap learned FSMap version 28 2024-08-31T04:22:17.624 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:17.618+0000 7fd09acab740 1 -- 172.21.15.50:0/1696931296 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55b067534820 con 0x55b0670e5280 2024-08-31T04:22:17.624 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:17.618+0000 7fd072a00640 1 -- 172.21.15.50:0/1696931296 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd084004050 con 0x55b0670e5280 2024-08-31T04:22:17.624 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:17.619+0000 7fd072a00640 1 -- 172.21.15.50:0/1696931296 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fd078003c10 con 0x55b0670e5280 2024-08-31T04:22:17.624 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:17.619+0000 7fd09acab740 10 client.15075 fetch_fsmap finished waiting for FSMap version 28 2024-08-31T04:22:17.624 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:17.619+0000 7fd09acab740 10 client.15075 resolve_mds: resolved name 'h' to daemon mds.h 2024-08-31T04:22:17.624 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:17.619+0000 7fd09acab740 20 client.15075 populate_metadata read hostname 'smithi050' 2024-08-31T04:22:17.625 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:17.619+0000 7fd09acab740 1 --2- 172.21.15.50:0/1696931296 >> [v2:172.21.15.133:6836/4014853202,v1:172.21.15.133:6837/4014853202] conn(0x55b067099c90 0x55b067538160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:17.625 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:17.619+0000 7fd09acab740 4 client.15075 mds_command: new command op to 24656 tid=0 multi_id=0 [{"prefix": "status"}] 2024-08-31T04:22:17.625 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:17.619+0000 7fd09acab740 1 -- 172.21.15.50:0/1696931296 --> [v2:172.21.15.133:6836/4014853202,v1:172.21.15.133:6837/4014853202] -- command(tid 0: {"prefix": "status"}) -- 0x55b06741ff40 con 0x55b067099c90 2024-08-31T04:22:17.625 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:17.619+0000 7fd092000640 1 --2- 172.21.15.50:0/1696931296 >> [v2:172.21.15.133:6836/4014853202,v1:172.21.15.133:6837/4014853202] conn(0x55b067099c90 0x55b067538160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:22:17.625 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:17.620+0000 7fd092000640 1 --2- 172.21.15.50:0/1696931296 >> [v2:172.21.15.133:6836/4014853202,v1:172.21.15.133:6837/4014853202] conn(0x55b067099c90 0x55b067538160 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=8cae3df15412d828 server_cookie=cad07e2950d6d360 in_seq=0 out_seq=0 2024-08-31T04:22:17.625 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:17.620+0000 7fd072a00640 10 client.15075 ms_handle_connect on v2:172.21.15.133:6836/4014853202 2024-08-31T04:22:17.625 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:17.620+0000 7fd072a00640 1 -- 172.21.15.50:0/1696931296 <== mds.3 v2:172.21.15.133:6836/4014853202 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x55b06741ff40 con 0x55b067099c90 2024-08-31T04:22:17.625 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:17.620+0000 7fd072a00640 10 client.15075 handle_command_reply: tid=0 2024-08-31T04:22:17.625 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:17.620+0000 7fd09acab740 1 client.15075 shutdown 2024-08-31T04:22:17.625 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:17.620+0000 7fd09acab740 1 -- 172.21.15.50:0/1696931296 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b0670e5280 msgr2=0x55b0674cdb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:22:17.625 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:17.620+0000 7fd09acab740 1 --2- 172.21.15.50:0/1696931296 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b0670e5280 0x55b0674cdb30 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fd078012cd0 tx=0x7fd078009fa0 comp rx=0 tx=0).stop 2024-08-31T04:22:17.625 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:17.620+0000 7fd09acab740 1 -- 172.21.15.50:0/1696931296 shutdown_connections 2024-08-31T04:22:17.625 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:17.620+0000 7fd09acab740 1 --2- 172.21.15.50:0/1696931296 >> [v2:172.21.15.133:6836/4014853202,v1:172.21.15.133:6837/4014853202] conn(0x55b067099c90 0x55b067538160 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:17.626 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:17.620+0000 7fd09acab740 1 --2- 172.21.15.50:0/1696931296 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b067105f60 0x55b06752ceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:17.626 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:17.620+0000 7fd09acab740 1 --2- 172.21.15.50:0/1696931296 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b0670e5280 0x55b0674cdb30 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:17.626 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:17.620+0000 7fd09acab740 1 --2- 172.21.15.50:0/1696931296 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b0670dd0a0 0x55b0674cd570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:17.626 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:17.620+0000 7fd072a00640 0 client.15075 ms_handle_reset on v2:172.21.15.133:6836/4014853202 2024-08-31T04:22:17.626 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:17.620+0000 7fd09acab740 1 -- 172.21.15.50:0/1696931296 >> 172.21.15.50:0/1696931296 conn(0x55b0670fa350 msgr2=0x55b0674a44c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:22:17.627 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:17.621+0000 7fd09acab740 1 -- 172.21.15.50:0/1696931296 shutdown_connections 2024-08-31T04:22:17.627 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:17.621+0000 7fd09acab740 1 -- 172.21.15.50:0/1696931296 wait complete. 2024-08-31T04:22:17.627 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:17.621+0000 7fd09acab740 20 client.15075 trim_cache size 0 max 16384 2024-08-31T04:22:17.627 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-08-31T04:22:17.627 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_fsid": "058d9fc6-674f-11ef-bcd4-c7b262605968", 2024-08-31T04:22:17.627 INFO:teuthology.orchestra.run.smithi050.stdout: "whoami": 3, 2024-08-31T04:22:17.627 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 24656, 2024-08-31T04:22:17.627 INFO:teuthology.orchestra.run.smithi050.stdout: "want_state": "up:active", 2024-08-31T04:22:17.627 INFO:teuthology.orchestra.run.smithi050.stdout: "state": "up:active", 2024-08-31T04:22:17.628 INFO:teuthology.orchestra.run.smithi050.stdout: "fs_name": "cephfs", 2024-08-31T04:22:17.628 INFO:teuthology.orchestra.run.smithi050.stdout: "rank_uptime": 81.617852334000005, 2024-08-31T04:22:17.628 INFO:teuthology.orchestra.run.smithi050.stdout: "mdsmap_epoch": 28, 2024-08-31T04:22:17.628 INFO:teuthology.orchestra.run.smithi050.stdout: "osdmap_epoch": 78, 2024-08-31T04:22:17.628 INFO:teuthology.orchestra.run.smithi050.stdout: "osdmap_epoch_barrier": 78, 2024-08-31T04:22:17.628 INFO:teuthology.orchestra.run.smithi050.stdout: "uptime": 119.579218426 2024-08-31T04:22:17.628 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-08-31T04:22:17.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:17.621+0000 7fd094000640 1 -- 172.21.15.50:0/3015776245 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fd0740b4bc0 msgr2=0x7fd0740b70d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:22:17.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:17.621+0000 7fd094000640 1 --2- 172.21.15.50:0/3015776245 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fd0740b4bc0 0x7fd0740b70d0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x55b0674aa570 tx=0x7fd08010b550 comp rx=0 tx=0).stop 2024-08-31T04:22:17.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:17.621+0000 7fd094000640 1 -- 172.21.15.50:0/3015776245 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd08c075b70 msgr2=0x7fd08c1a07d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:22:17.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:17.621+0000 7fd094000640 1 --2- 172.21.15.50:0/3015776245 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd08c075b70 0x7fd08c1a07d0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fd080005ab0 tx=0x7fd080003c10 comp rx=0 tx=0).stop 2024-08-31T04:22:17.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:17.621+0000 7fd094000640 1 -- 172.21.15.50:0/3015776245 shutdown_connections 2024-08-31T04:22:17.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:17.621+0000 7fd094000640 1 --2- 172.21.15.50:0/3015776245 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fd0740b4bc0 0x7fd0740b70d0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:17.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:17.621+0000 7fd094000640 1 --2- 172.21.15.50:0/3015776245 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd08c1141d0 0x7fd08c1a6010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:17.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:17.621+0000 7fd094000640 1 --2- 172.21.15.50:0/3015776245 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd08c077120 0x7fd08c1a0d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:17.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:17.621+0000 7fd094000640 1 --2- 172.21.15.50:0/3015776245 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd08c075b70 0x7fd08c1a07d0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:17.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:17.621+0000 7fd094000640 1 -- 172.21.15.50:0/3015776245 >> 172.21.15.50:0/3015776245 conn(0x7fd08c07b5f0 msgr2=0x7fd08c112de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:22:17.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:17.622+0000 7fd094000640 1 -- 172.21.15.50:0/3015776245 shutdown_connections 2024-08-31T04:22:17.629 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:17.622+0000 7fd094000640 1 -- 172.21.15.50:0/3015776245 wait complete. 2024-08-31T04:22:17.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:22:17 smithi050 ceph-mon[17259]: pgmap v348: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2024-08-31T04:22:17.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:22:17 smithi177 ceph-mon[22025]: pgmap v348: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2024-08-31T04:22:17.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:22:17 smithi133 ceph-mon[22177]: pgmap v348: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2024-08-31T04:22:18.550 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 058d9fc6-674f-11ef-bcd4-c7b262605968 -- ceph tell mds.i status 2024-08-31T04:22:18.932 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:22:19.554 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:19.553+0000 7fedcfc00640 1 -- 172.21.15.50:0/2047709683 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fedc8109260 msgr2=0x7fedc8109670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:22:19.555 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:19.553+0000 7fedcfc00640 1 --2- 172.21.15.50:0/2047709683 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fedc8109260 0x7fedc8109670 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fedb4009900 tx=0x7fedb402a400 comp rx=0 tx=0).stop 2024-08-31T04:22:19.555 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:19.553+0000 7fedcfc00640 1 -- 172.21.15.50:0/2047709683 shutdown_connections 2024-08-31T04:22:19.555 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:19.553+0000 7fedcfc00640 1 --2- 172.21.15.50:0/2047709683 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fedc8109bb0 0x7fedc81103e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:19.555 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:19.553+0000 7fedcfc00640 1 --2- 172.21.15.50:0/2047709683 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fedc8109260 0x7fedc8109670 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:19.555 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:19.553+0000 7fedcfc00640 1 --2- 172.21.15.50:0/2047709683 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fedc8103920 0x7fedc8103d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:19.555 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:19.553+0000 7fedcfc00640 1 -- 172.21.15.50:0/2047709683 >> 172.21.15.50:0/2047709683 conn(0x7fedc80ff370 msgr2=0x7fedc81017c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:22:19.555 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:19.553+0000 7fedcfc00640 1 -- 172.21.15.50:0/2047709683 shutdown_connections 2024-08-31T04:22:19.555 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:19.553+0000 7fedcfc00640 1 -- 172.21.15.50:0/2047709683 wait complete. 2024-08-31T04:22:19.557 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:19.554+0000 7fedcfc00640 1 Processor -- start 2024-08-31T04:22:19.557 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:19.554+0000 7fedcfc00640 1 -- start start 2024-08-31T04:22:19.557 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:19.554+0000 7fedcfc00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fedc8103920 0x7fedc819c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:19.557 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:19.555+0000 7fedcfc00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fedc8109260 0x7fedc819ca20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:19.557 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:19.555+0000 7fedcfc00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fedc8109bb0 0x7fedc81a1cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:19.557 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:19.555+0000 7fedcfc00640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fedc8113870 con 0x7fedc8109bb0 2024-08-31T04:22:19.557 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:19.555+0000 7fedcfc00640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7fedc81136f0 con 0x7fedc8109260 2024-08-31T04:22:19.557 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:19.555+0000 7fedcfc00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fedc81139f0 con 0x7fedc8103920 2024-08-31T04:22:19.557 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:19.555+0000 7fedcd200640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fedc8103920 0x7fedc819c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:22:19.557 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:19.555+0000 7fedcd200640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fedc8103920 0x7fedc819c480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.50:58474/0 (socket says 172.21.15.50:58474) 2024-08-31T04:22:19.557 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:19.555+0000 7fedcdc00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fedc8109bb0 0x7fedc81a1cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:22:19.557 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:19.555+0000 7fedcd200640 1 -- 172.21.15.50:0/968567785 learned_addr learned my addr 172.21.15.50:0/968567785 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:22:19.558 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:19.555+0000 7fedc7e00640 1 --2- 172.21.15.50:0/968567785 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fedc8109260 0x7fedc819ca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:22:19.558 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:19.555+0000 7fedcd200640 1 -- 172.21.15.50:0/968567785 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fedc8109260 msgr2=0x7fedc819ca20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:22:19.558 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:19.555+0000 7fedcd200640 1 --2- 172.21.15.50:0/968567785 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fedc8109260 0x7fedc819ca20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:19.558 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:19.555+0000 7fedcd200640 1 -- 172.21.15.50:0/968567785 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fedc8109bb0 msgr2=0x7fedc81a1cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:22:19.558 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:19.555+0000 7fedcd200640 1 --2- 172.21.15.50:0/968567785 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fedc8109bb0 0x7fedc81a1cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:19.558 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:19.555+0000 7fedcd200640 1 -- 172.21.15.50:0/968567785 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fedc81a23f0 con 0x7fedc8103920 2024-08-31T04:22:19.558 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:19.556+0000 7fedcd200640 1 --2- 172.21.15.50:0/968567785 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fedc8103920 0x7fedc819c480 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fedbc00d950 tx=0x7fedbc00de10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:22:19.559 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:19.556+0000 7fedc5600640 1 -- 172.21.15.50:0/968567785 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedbc017070 con 0x7fedc8103920 2024-08-31T04:22:19.559 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:19.556+0000 7fedcfc00640 1 -- 172.21.15.50:0/968567785 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fedc81a26e0 con 0x7fedc8103920 2024-08-31T04:22:19.559 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:19.556+0000 7fedc5600640 1 -- 172.21.15.50:0/968567785 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fedbc009c30 con 0x7fedc8103920 2024-08-31T04:22:19.559 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:19.556+0000 7fedc5600640 1 -- 172.21.15.50:0/968567785 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedbc00f620 con 0x7fedc8103920 2024-08-31T04:22:19.559 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:19.556+0000 7fedcfc00640 1 -- 172.21.15.50:0/968567785 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fedc81a8e40 con 0x7fedc8103920 2024-08-31T04:22:19.560 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:19.559+0000 7fedd69be740 1 Processor -- start 2024-08-31T04:22:19.560 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:19.559+0000 7fedd69be740 1 -- start start 2024-08-31T04:22:19.562 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:19.560+0000 7fedd69be740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55cfd1870f60 0x55cfd1c168f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:19.563 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:19.560+0000 7fedd69be740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cfd18480a0 0x55cfd1c16e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:19.563 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:19.560+0000 7fedd69be740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55cfd1850280 0x55cfd1c17370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:19.563 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:19.560+0000 7fedd69be740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55cfd1b8d550 con 0x55cfd18480a0 2024-08-31T04:22:19.563 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:19.560+0000 7fedd69be740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x55cfd1b7cae0 con 0x55cfd1870f60 2024-08-31T04:22:19.563 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:19.560+0000 7fedd69be740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x55cfd1b80a90 con 0x55cfd1850280 2024-08-31T04:22:19.563 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:19.560+0000 7fedcdc00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55cfd1870f60 0x55cfd1c168f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:22:19.563 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:19.560+0000 7fedc5600640 1 -- 172.21.15.50:0/968567785 <== mon.1 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 17) ==== 152628+0+0 (secure 0 0 0) 0x7fedbc010460 con 0x7fedc8103920 2024-08-31T04:22:19.564 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:19.560+0000 7fedc7e00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55cfd1850280 0x55cfd1c17370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:22:19.564 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:19.560+0000 7fedcdc00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55cfd1870f60 0x55cfd1c168f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.50:49992/0 (socket says 172.21.15.50:49992) 2024-08-31T04:22:19.564 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:19.560+0000 7fedc7e00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55cfd1850280 0x55cfd1c17370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.50:58484/0 (socket says 172.21.15.50:58484) 2024-08-31T04:22:19.564 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:19.560+0000 7fedcdc00640 1 -- 172.21.15.50:0/178511841 learned_addr learned my addr 172.21.15.50:0/178511841 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:22:19.564 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:19.560+0000 7fedcd200640 1 --2- 172.21.15.50:0/178511841 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cfd18480a0 0x55cfd1c16e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:22:19.564 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:19.560+0000 7fedcdc00640 1 -- 172.21.15.50:0/178511841 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55cfd1850280 msgr2=0x55cfd1c17370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:22:19.564 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:19.560+0000 7fedcdc00640 1 --2- 172.21.15.50:0/178511841 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55cfd1850280 0x55cfd1c17370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:19.564 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:19.561+0000 7fedcdc00640 1 -- 172.21.15.50:0/178511841 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cfd18480a0 msgr2=0x55cfd1c16e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:22:19.564 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:19.561+0000 7fedcdc00640 1 --2- 172.21.15.50:0/178511841 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cfd18480a0 0x55cfd1c16e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:19.564 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:19.561+0000 7fedcdc00640 1 -- 172.21.15.50:0/178511841 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cfd18dc540 con 0x55cfd1870f60 2024-08-31T04:22:19.564 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:19.561+0000 7fedcd200640 1 --2- 172.21.15.50:0/178511841 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cfd18480a0 0x55cfd1c16e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T04:22:19.564 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:19.561+0000 7fedcdc00640 1 --2- 172.21.15.50:0/178511841 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55cfd1870f60 0x55cfd1c168f0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fedc0010370 tx=0x7fedc0010830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1977c5a926c53b46 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:22:19.565 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:19.561+0000 7fedba000640 1 -- 172.21.15.50:0/178511841 <== mon.2 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedc0016070 con 0x55cfd1870f60 2024-08-31T04:22:19.565 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:19.561+0000 7fedba000640 1 -- 172.21.15.50:0/178511841 <== mon.2 v2:172.21.15.133:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fedc0004d20 con 0x55cfd1870f60 2024-08-31T04:22:19.565 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:19.561+0000 7fedba000640 1 -- 172.21.15.50:0/178511841 <== mon.2 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedc0005350 con 0x55cfd1870f60 2024-08-31T04:22:19.568 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:19.562+0000 7fedc5600640 1 --2- 172.21.15.50:0/968567785 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fedb00b4c40 0x7fedb00b7150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:19.569 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:19.562+0000 7fedd69be740 1 -- 172.21.15.50:0/178511841 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55cfd1870f60 msgr2=0x55cfd1c168f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:22:19.569 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:19.562+0000 7fedd69be740 1 --2- 172.21.15.50:0/178511841 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55cfd1870f60 0x55cfd1c168f0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fedc0010370 tx=0x7fedc0010830 comp rx=0 tx=0).stop 2024-08-31T04:22:19.569 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:19.562+0000 7fedcd200640 1 --2- 172.21.15.50:0/968567785 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fedb00b4c40 0x7fedb00b7150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:22:19.569 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:19.562+0000 7fedc5600640 1 -- 172.21.15.50:0/968567785 <== mon.1 v2:172.21.15.177:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8219+0+0 (secure 0 0 0) 0x7fedbc0e4e40 con 0x7fedc8103920 2024-08-31T04:22:19.569 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:19.562+0000 7fedd69be740 1 -- 172.21.15.50:0/178511841 shutdown_connections 2024-08-31T04:22:19.569 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:19.562+0000 7fedd69be740 1 --2- 172.21.15.50:0/178511841 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55cfd1850280 0x55cfd1c17370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:19.569 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:19.562+0000 7fedd69be740 1 --2- 172.21.15.50:0/178511841 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cfd18480a0 0x55cfd1c16e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:19.569 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:19.562+0000 7fedd69be740 1 --2- 172.21.15.50:0/178511841 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55cfd1870f60 0x55cfd1c168f0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:19.570 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:19.562+0000 7fedd69be740 1 -- 172.21.15.50:0/178511841 >> 172.21.15.50:0/178511841 conn(0x55cfd1865350 msgr2=0x55cfd1c147e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:22:19.570 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:19.562+0000 7fedd69be740 1 -- 172.21.15.50:0/178511841 shutdown_connections 2024-08-31T04:22:19.570 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:19.562+0000 7fedd69be740 1 -- 172.21.15.50:0/178511841 wait complete. 2024-08-31T04:22:19.570 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:19.563+0000 7fedcd200640 1 --2- 172.21.15.50:0/968567785 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fedb00b4c40 0x7fedb00b7150 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fedbc0e27d0 tx=0x7fedbc000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:22:19.570 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:19.563+0000 7fedd69be740 1 -- start start 2024-08-31T04:22:19.570 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:19.563+0000 7fedd69be740 1 Processor -- start 2024-08-31T04:22:19.570 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:19.564+0000 7fedd69be740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55cfd18480a0 0x55cfd1c220a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:19.570 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:19.564+0000 7fedd69be740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55cfd1850280 0x55cfd1c225e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:19.570 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:19.564+0000 7fedd69be740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cfd1870f60 0x55cfd1c2e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:19.570 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:19.564+0000 7fedd69be740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55cfd19df5f0 con 0x55cfd1870f60 2024-08-31T04:22:19.570 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:19.564+0000 7fedd69be740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x55cfd1b03bd0 con 0x55cfd18480a0 2024-08-31T04:22:19.570 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:19.564+0000 7fedd69be740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x55cfd1c250d0 con 0x55cfd1850280 2024-08-31T04:22:19.570 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:19.564+0000 7fedd69be740 10 client.0 _ll_register_callbacks cb 0x55cfd1b29210 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:22:19.571 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:19.564+0000 7fedcdc00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55cfd18480a0 0x55cfd1c220a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:22:19.571 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:19.564+0000 7fedc7e00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55cfd1850280 0x55cfd1c225e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:22:19.571 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:19.564+0000 7fedcdc00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cfd1870f60 0x55cfd1c2e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:22:19.571 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:19.564+0000 7fedc7e00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55cfd1850280 0x55cfd1c225e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.50:58488/0 (socket says 172.21.15.50:58488) 2024-08-31T04:22:19.571 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:19.564+0000 7fedc7e00640 1 -- 172.21.15.50:0/2912861719 learned_addr learned my addr 172.21.15.50:0/2912861719 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:22:19.571 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:19.564+0000 7fedc7e00640 1 -- 172.21.15.50:0/2912861719 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55cfd18480a0 msgr2=0x55cfd1c220a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:22:19.571 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:19.564+0000 7fedc7e00640 1 --2- 172.21.15.50:0/2912861719 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55cfd18480a0 0x55cfd1c220a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:19.571 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:19.564+0000 7fedc7e00640 1 -- 172.21.15.50:0/2912861719 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cfd1870f60 msgr2=0x55cfd1c2e3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:22:19.571 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:19.564+0000 7fedc7e00640 1 --2- 172.21.15.50:0/2912861719 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cfd1870f60 0x55cfd1c2e3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:19.571 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:19.564+0000 7fedc7e00640 1 -- 172.21.15.50:0/2912861719 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cfd1b44650 con 0x55cfd1850280 2024-08-31T04:22:19.571 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:19.565+0000 7fedc7e00640 1 --2- 172.21.15.50:0/2912861719 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55cfd1850280 0x55cfd1c225e0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fedb4009900 tx=0x7fedb4032f60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e906d6a6dbd500ca server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:22:19.571 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:19.565+0000 7fedaea00640 10 client.0 ms_handle_connect on v2:172.21.15.177:3300/0 2024-08-31T04:22:19.571 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:19.565+0000 7fedaea00640 1 -- 172.21.15.50:0/2912861719 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedb4035040 con 0x55cfd1850280 2024-08-31T04:22:19.571 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:19.565+0000 7fedd69be740 1 -- 172.21.15.50:0/2912861719 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fedc0004d20 con 0x55cfd1850280 2024-08-31T04:22:19.572 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:19.565+0000 7fedaea00640 1 -- 172.21.15.50:0/2912861719 <== mon.1 v2:172.21.15.177:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8219+0+0 (secure 0 0 0) 0x7fedb4031860 con 0x55cfd1850280 2024-08-31T04:22:19.572 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:19.565+0000 7fedaea00640 1 -- 172.21.15.50:0/2912861719 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fedb4004040 con 0x55cfd1850280 2024-08-31T04:22:19.572 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:19.565+0000 7fedd69be740 10 client.25090 fetch_fsmap learned FSMap version 28 2024-08-31T04:22:19.572 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:19.565+0000 7fedd69be740 1 -- 172.21.15.50:0/2912861719 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55cfd1c30e40 con 0x55cfd1850280 2024-08-31T04:22:19.572 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:19.566+0000 7fedaea00640 1 -- 172.21.15.50:0/2912861719 <== mon.1 v2:172.21.15.177:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fedc0004d20 con 0x55cfd1850280 2024-08-31T04:22:19.572 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:19.566+0000 7fedaea00640 1 -- 172.21.15.50:0/2912861719 <== mon.1 v2:172.21.15.177:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fedb4004770 con 0x55cfd1850280 2024-08-31T04:22:19.572 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:19.566+0000 7fedd69be740 10 client.25090 fetch_fsmap finished waiting for FSMap version 28 2024-08-31T04:22:19.572 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:19.566+0000 7fedd69be740 10 client.25090 resolve_mds: resolved name 'i' to daemon mds.i 2024-08-31T04:22:19.572 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:19.566+0000 7fedd69be740 20 client.25090 populate_metadata read hostname 'smithi050' 2024-08-31T04:22:19.572 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:19.566+0000 7fedd69be740 1 --2- 172.21.15.50:0/2912861719 >> [v2:172.21.15.177:6838/3600081752,v1:172.21.15.177:6839/3600081752] conn(0x55cfd182f8e0 0x55cfd1c34890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:19.572 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:19.566+0000 7fedd69be740 4 client.25090 mds_command: new command op to 24667 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T04:22:19.572 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:19.566+0000 7fedd69be740 1 -- 172.21.15.50:0/2912861719 --> [v2:172.21.15.177:6838/3600081752,v1:172.21.15.177:6839/3600081752] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55cfd1b8f4a0 con 0x55cfd182f8e0 2024-08-31T04:22:19.572 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:19.567+0000 7fedcdc00640 1 --2- 172.21.15.50:0/2912861719 >> [v2:172.21.15.177:6838/3600081752,v1:172.21.15.177:6839/3600081752] conn(0x55cfd182f8e0 0x55cfd1c34890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:22:19.573 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:19.567+0000 7fedcdc00640 1 --2- 172.21.15.50:0/2912861719 >> [v2:172.21.15.177:6838/3600081752,v1:172.21.15.177:6839/3600081752] conn(0x55cfd182f8e0 0x55cfd1c34890 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=cdaa58d19eb5098 server_cookie=3430c7468c1366b6 in_seq=0 out_seq=0 2024-08-31T04:22:19.573 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:19.567+0000 7fedaea00640 10 client.25090 ms_handle_connect on v2:172.21.15.177:6838/3600081752 2024-08-31T04:22:19.574 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:19.568+0000 7fedaea00640 1 -- 172.21.15.50:0/2912861719 <== mds.2 v2:172.21.15.177:6838/3600081752 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55cfd1b8f4a0 con 0x55cfd182f8e0 2024-08-31T04:22:19.574 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:19.568+0000 7fedaea00640 10 client.25090 handle_command_reply: tid=0 2024-08-31T04:22:19.574 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:19.568+0000 7fedd69be740 1 client.25090 shutdown 2024-08-31T04:22:19.574 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:19.568+0000 7fedd69be740 1 -- 172.21.15.50:0/2912861719 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55cfd1850280 msgr2=0x55cfd1c225e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:22:19.574 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:19.568+0000 7fedd69be740 1 --2- 172.21.15.50:0/2912861719 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55cfd1850280 0x55cfd1c225e0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fedb4009900 tx=0x7fedb4032f60 comp rx=0 tx=0).stop 2024-08-31T04:22:19.574 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:19.568+0000 7fedd69be740 1 -- 172.21.15.50:0/2912861719 shutdown_connections 2024-08-31T04:22:19.574 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:19.568+0000 7fedd69be740 1 --2- 172.21.15.50:0/2912861719 >> [v2:172.21.15.177:6838/3600081752,v1:172.21.15.177:6839/3600081752] conn(0x55cfd182f8e0 0x55cfd1c34890 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:19.574 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:19.568+0000 7fedd69be740 1 --2- 172.21.15.50:0/2912861719 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55cfd1850280 0x55cfd1c225e0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:19.574 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:19.568+0000 7fedd69be740 1 --2- 172.21.15.50:0/2912861719 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cfd1870f60 0x55cfd1c2e3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:19.574 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:19.568+0000 7fedd69be740 1 --2- 172.21.15.50:0/2912861719 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55cfd18480a0 0x55cfd1c220a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:19.574 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:19.568+0000 7fedaea00640 0 client.25090 ms_handle_reset on v2:172.21.15.177:6838/3600081752 2024-08-31T04:22:19.574 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:19.568+0000 7fedd69be740 1 -- 172.21.15.50:0/2912861719 >> 172.21.15.50:0/2912861719 conn(0x55cfd1865350 msgr2=0x55cfd1c19ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:22:19.575 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:19.569+0000 7fedd69be740 1 -- 172.21.15.50:0/2912861719 shutdown_connections 2024-08-31T04:22:19.575 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:19.569+0000 7fedd69be740 1 -- 172.21.15.50:0/2912861719 wait complete. 2024-08-31T04:22:19.575 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:19.569+0000 7fedd69be740 20 client.25090 trim_cache size 0 max 16384 2024-08-31T04:22:19.590 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:19.588+0000 7fedd69be740 1 Processor -- start 2024-08-31T04:22:19.590 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:19.588+0000 7fedd69be740 1 -- start start 2024-08-31T04:22:19.590 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:19.588+0000 7fedd69be740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cfd18480a0 0x55cfd1c21590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:19.590 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:19.588+0000 7fedd69be740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55cfd1850280 0x55cfd1c2e330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:19.590 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:19.588+0000 7fedd69be740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55cfd1870f60 0x55cfd1c20920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:19.590 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:19.588+0000 7fedd69be740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55cfd1c32bd0 con 0x55cfd18480a0 2024-08-31T04:22:19.590 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:19.588+0000 7fedd69be740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x55cfd1c332a0 con 0x55cfd1850280 2024-08-31T04:22:19.590 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:19.588+0000 7fedd69be740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x55cfd1c33970 con 0x55cfd1870f60 2024-08-31T04:22:19.591 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:19.588+0000 7fedcdc00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cfd18480a0 0x55cfd1c21590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:22:19.591 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:19.588+0000 7fedcdc00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cfd18480a0 0x55cfd1c21590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35840/0 (socket says 172.21.15.50:35840) 2024-08-31T04:22:19.591 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:19.588+0000 7fedcdc00640 1 -- 172.21.15.50:0/774153923 learned_addr learned my addr 172.21.15.50:0/774153923 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:22:19.591 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:19.588+0000 7fedc7e00640 1 --2- 172.21.15.50:0/774153923 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55cfd1850280 0x55cfd1c2e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:22:19.591 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:19.589+0000 7fedcdc00640 1 --2- 172.21.15.50:0/774153923 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55cfd1870f60 0x55cfd1c20920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:22:19.591 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:19.589+0000 7fedcdc00640 1 -- 172.21.15.50:0/774153923 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55cfd1870f60 msgr2=0x55cfd1c20920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:22:19.591 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:19.589+0000 7fedcdc00640 1 --2- 172.21.15.50:0/774153923 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55cfd1870f60 0x55cfd1c20920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:19.591 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:19.589+0000 7fedcdc00640 1 -- 172.21.15.50:0/774153923 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55cfd1850280 msgr2=0x55cfd1c2e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:22:19.591 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:19.589+0000 7fedcdc00640 1 --2- 172.21.15.50:0/774153923 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55cfd1850280 0x55cfd1c2e330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:19.591 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:19.589+0000 7fedcdc00640 1 -- 172.21.15.50:0/774153923 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cfd1c22be0 con 0x55cfd18480a0 2024-08-31T04:22:19.592 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:19.589+0000 7fedcdc00640 1 --2- 172.21.15.50:0/774153923 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cfd18480a0 0x55cfd1c21590 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fedc00098b0 tx=0x7fedc0009600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99ed59f673a78e30 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:22:19.592 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:19.589+0000 7fedb9600640 1 -- 172.21.15.50:0/774153923 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedc0016040 con 0x55cfd18480a0 2024-08-31T04:22:19.593 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:19.589+0000 7fedb9600640 1 -- 172.21.15.50:0/774153923 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fedc0012d80 con 0x55cfd18480a0 2024-08-31T04:22:19.593 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:19.589+0000 7fedb9600640 1 -- 172.21.15.50:0/774153923 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedc0023040 con 0x55cfd18480a0 2024-08-31T04:22:19.593 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:19.590+0000 7fedd69be740 1 -- 172.21.15.50:0/774153923 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cfd18480a0 msgr2=0x55cfd1c21590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:22:19.593 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:19.590+0000 7fedd69be740 1 --2- 172.21.15.50:0/774153923 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cfd18480a0 0x55cfd1c21590 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fedc00098b0 tx=0x7fedc0009600 comp rx=0 tx=0).stop 2024-08-31T04:22:19.593 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:19.590+0000 7fedd69be740 1 -- 172.21.15.50:0/774153923 shutdown_connections 2024-08-31T04:22:19.593 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:19.590+0000 7fedd69be740 1 --2- 172.21.15.50:0/774153923 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55cfd1870f60 0x55cfd1c20920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:19.593 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:19.590+0000 7fedd69be740 1 --2- 172.21.15.50:0/774153923 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55cfd1850280 0x55cfd1c2e330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:19.593 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:19.590+0000 7fedd69be740 1 --2- 172.21.15.50:0/774153923 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cfd18480a0 0x55cfd1c21590 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:19.593 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:19.590+0000 7fedd69be740 1 -- 172.21.15.50:0/774153923 >> 172.21.15.50:0/774153923 conn(0x55cfd1865350 msgr2=0x55cfd1c0f4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:22:19.593 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:19.590+0000 7fedd69be740 1 -- 172.21.15.50:0/774153923 shutdown_connections 2024-08-31T04:22:19.593 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:19.590+0000 7fedd69be740 1 -- 172.21.15.50:0/774153923 wait complete. 2024-08-31T04:22:19.594 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:19.591+0000 7fedd69be740 1 -- start start 2024-08-31T04:22:19.594 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:19.591+0000 7fedd69be740 1 Processor -- start 2024-08-31T04:22:19.596 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:19.592+0000 7fedd69be740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55cfd18480a0 0x55cfd1c3d310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:19.596 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:19.592+0000 7fedd69be740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cfd1850280 0x55cfd1c36860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:19.596 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:19.592+0000 7fedd69be740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55cfd1870f60 0x55cfd1c36da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:19.596 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:19.592+0000 7fedd69be740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55cfd1c34710 con 0x55cfd1850280 2024-08-31T04:22:19.597 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:19.592+0000 7fedd69be740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x55cfd1c34040 con 0x55cfd18480a0 2024-08-31T04:22:19.597 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:19.592+0000 7fedd69be740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x55cfd1c34de0 con 0x55cfd1870f60 2024-08-31T04:22:19.597 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:19.592+0000 7fedd69be740 10 client.0 _ll_register_callbacks cb 0x7fedb4032bf0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:22:19.597 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:19.592+0000 7fedc7e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cfd1850280 0x55cfd1c36860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:22:19.597 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:19.592+0000 7fedc7e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cfd1850280 0x55cfd1c36860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35846/0 (socket says 172.21.15.50:35846) 2024-08-31T04:22:19.597 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:19.592+0000 7fedc7e00640 1 -- 172.21.15.50:0/1275808786 learned_addr learned my addr 172.21.15.50:0/1275808786 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:22:19.597 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:19.592+0000 7fedcdc00640 1 --2- 172.21.15.50:0/1275808786 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55cfd18480a0 0x55cfd1c3d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:22:19.597 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:19.592+0000 7fedcdc00640 1 --2- 172.21.15.50:0/1275808786 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55cfd1870f60 0x55cfd1c36da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:22:19.597 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:19.592+0000 7fedc7e00640 1 -- 172.21.15.50:0/1275808786 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55cfd1870f60 msgr2=0x55cfd1c36da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:22:19.598 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:19.592+0000 7fedc7e00640 1 --2- 172.21.15.50:0/1275808786 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55cfd1870f60 0x55cfd1c36da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:19.598 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:19.592+0000 7fedc7e00640 1 -- 172.21.15.50:0/1275808786 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55cfd18480a0 msgr2=0x55cfd1c3d310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:22:19.598 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:19.592+0000 7fedc7e00640 1 --2- 172.21.15.50:0/1275808786 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55cfd18480a0 0x55cfd1c3d310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:19.598 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:19.592+0000 7fedc7e00640 1 -- 172.21.15.50:0/1275808786 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cfd1c37530 con 0x55cfd1850280 2024-08-31T04:22:19.598 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:19.592+0000 7fedcdc00640 1 --2- 172.21.15.50:0/1275808786 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55cfd1870f60 0x55cfd1c36da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:22:19.598 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:19.593+0000 7fedc7e00640 1 --2- 172.21.15.50:0/1275808786 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cfd1850280 0x55cfd1c36860 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fedb4000c00 tx=0x7fedb4004410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20f49892b0c7b6f3 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:22:19.598 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:19.593+0000 7fedaea00640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-08-31T04:22:19.598 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:19.593+0000 7fedaea00640 1 -- 172.21.15.50:0/1275808786 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedb4035070 con 0x55cfd1850280 2024-08-31T04:22:19.598 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:19.593+0000 7fedaea00640 1 -- 172.21.15.50:0/1275808786 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8219+0+0 (secure 0 0 0) 0x7fedb4003b90 con 0x55cfd1850280 2024-08-31T04:22:19.598 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:19.593+0000 7fedd69be740 1 -- 172.21.15.50:0/1275808786 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fedc0012d80 con 0x55cfd1850280 2024-08-31T04:22:19.598 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:19.593+0000 7fedaea00640 1 -- 172.21.15.50:0/1275808786 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fedb4062050 con 0x55cfd1850280 2024-08-31T04:22:19.598 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:19.593+0000 7fedd69be740 10 client.15090 fetch_fsmap learned FSMap version 28 2024-08-31T04:22:19.598 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:19.593+0000 7fedd69be740 1 -- 172.21.15.50:0/1275808786 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55cfd1c9fd60 con 0x55cfd1850280 2024-08-31T04:22:19.599 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:19.594+0000 7fedaea00640 1 -- 172.21.15.50:0/1275808786 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fedc0012d80 con 0x55cfd1850280 2024-08-31T04:22:19.599 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:19.594+0000 7fedaea00640 1 -- 172.21.15.50:0/1275808786 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fedb4004cf0 con 0x55cfd1850280 2024-08-31T04:22:19.599 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:19.594+0000 7fedd69be740 10 client.15090 fetch_fsmap finished waiting for FSMap version 28 2024-08-31T04:22:19.599 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:19.594+0000 7fedd69be740 10 client.15090 resolve_mds: resolved name 'i' to daemon mds.i 2024-08-31T04:22:19.599 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:19.594+0000 7fedd69be740 20 client.15090 populate_metadata read hostname 'smithi050' 2024-08-31T04:22:19.599 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:19.594+0000 7fedd69be740 1 --2- 172.21.15.50:0/1275808786 >> [v2:172.21.15.177:6838/3600081752,v1:172.21.15.177:6839/3600081752] conn(0x55cfd1804c90 0x55cfd1ca3540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:19.599 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:19.594+0000 7fedd69be740 4 client.15090 mds_command: new command op to 24667 tid=0 multi_id=0 [{"prefix": "status"}] 2024-08-31T04:22:19.599 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:19.594+0000 7fedd69be740 1 -- 172.21.15.50:0/1275808786 --> [v2:172.21.15.177:6838/3600081752,v1:172.21.15.177:6839/3600081752] -- command(tid 0: {"prefix": "status"}) -- 0x55cfd1b8af40 con 0x55cfd1804c90 2024-08-31T04:22:19.599 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:19.594+0000 7fedcdc00640 1 --2- 172.21.15.50:0/1275808786 >> [v2:172.21.15.177:6838/3600081752,v1:172.21.15.177:6839/3600081752] conn(0x55cfd1804c90 0x55cfd1ca3540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:22:19.599 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:19.595+0000 7fedcdc00640 1 --2- 172.21.15.50:0/1275808786 >> [v2:172.21.15.177:6838/3600081752,v1:172.21.15.177:6839/3600081752] conn(0x55cfd1804c90 0x55cfd1ca3540 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=359d59368423678c server_cookie=2ec8ef46d88732d0 in_seq=0 out_seq=0 2024-08-31T04:22:19.599 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:19.595+0000 7fedaea00640 10 client.15090 ms_handle_connect on v2:172.21.15.177:6838/3600081752 2024-08-31T04:22:19.599 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:19.595+0000 7fedaea00640 1 -- 172.21.15.50:0/1275808786 <== mds.2 v2:172.21.15.177:6838/3600081752 1 ==== command_reply(tid 0: 0 ) ==== 8+0+325 (crc 0 0 0) 0x55cfd1b8af40 con 0x55cfd1804c90 2024-08-31T04:22:19.599 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:19.595+0000 7fedaea00640 10 client.15090 handle_command_reply: tid=0 2024-08-31T04:22:19.599 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:19.595+0000 7fedd69be740 1 client.15090 shutdown 2024-08-31T04:22:19.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:19.595+0000 7fedd69be740 1 -- 172.21.15.50:0/1275808786 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cfd1850280 msgr2=0x55cfd1c36860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:22:19.601 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:19.595+0000 7fedd69be740 1 --2- 172.21.15.50:0/1275808786 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cfd1850280 0x55cfd1c36860 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fedb4000c00 tx=0x7fedb4004410 comp rx=0 tx=0).stop 2024-08-31T04:22:19.601 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:19.595+0000 7fedd69be740 1 -- 172.21.15.50:0/1275808786 shutdown_connections 2024-08-31T04:22:19.601 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:19.596+0000 7fedd69be740 1 --2- 172.21.15.50:0/1275808786 >> [v2:172.21.15.177:6838/3600081752,v1:172.21.15.177:6839/3600081752] conn(0x55cfd1804c90 0x55cfd1ca3540 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:19.601 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:19.596+0000 7fedd69be740 1 --2- 172.21.15.50:0/1275808786 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55cfd1870f60 0x55cfd1c36da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:19.601 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:19.596+0000 7fedaea00640 0 client.15090 ms_handle_reset on v2:172.21.15.177:6838/3600081752 2024-08-31T04:22:19.601 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:19.596+0000 7fedd69be740 1 --2- 172.21.15.50:0/1275808786 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cfd1850280 0x55cfd1c36860 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:19.601 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:19.596+0000 7fedd69be740 1 --2- 172.21.15.50:0/1275808786 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55cfd18480a0 0x55cfd1c3d310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:19.601 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:19.596+0000 7fedd69be740 1 -- 172.21.15.50:0/1275808786 >> 172.21.15.50:0/1275808786 conn(0x55cfd1865350 msgr2=0x55cfd1c208e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:22:19.601 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:19.596+0000 7fedd69be740 1 -- 172.21.15.50:0/1275808786 shutdown_connections 2024-08-31T04:22:19.601 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:19.596+0000 7fedd69be740 1 -- 172.21.15.50:0/1275808786 wait complete. 2024-08-31T04:22:19.601 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:19.596+0000 7fedd69be740 20 client.15090 trim_cache size 0 max 16384 2024-08-31T04:22:19.602 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-08-31T04:22:19.602 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_fsid": "058d9fc6-674f-11ef-bcd4-c7b262605968", 2024-08-31T04:22:19.602 INFO:teuthology.orchestra.run.smithi050.stdout: "whoami": 2, 2024-08-31T04:22:19.602 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 24667, 2024-08-31T04:22:19.602 INFO:teuthology.orchestra.run.smithi050.stdout: "want_state": "up:active", 2024-08-31T04:22:19.602 INFO:teuthology.orchestra.run.smithi050.stdout: "state": "up:active", 2024-08-31T04:22:19.602 INFO:teuthology.orchestra.run.smithi050.stdout: "fs_name": "cephfs", 2024-08-31T04:22:19.602 INFO:teuthology.orchestra.run.smithi050.stdout: "rank_uptime": 84.607285191000003, 2024-08-31T04:22:19.602 INFO:teuthology.orchestra.run.smithi050.stdout: "mdsmap_epoch": 28, 2024-08-31T04:22:19.602 INFO:teuthology.orchestra.run.smithi050.stdout: "osdmap_epoch": 78, 2024-08-31T04:22:19.602 INFO:teuthology.orchestra.run.smithi050.stdout: "osdmap_epoch_barrier": 78, 2024-08-31T04:22:19.602 INFO:teuthology.orchestra.run.smithi050.stdout: "uptime": 118.8793481 2024-08-31T04:22:19.602 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-08-31T04:22:19.603 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:19.597+0000 7fedcfc00640 1 -- 172.21.15.50:0/968567785 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fedb00b4c40 msgr2=0x7fedb00b7150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:22:19.603 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:19.597+0000 7fedcfc00640 1 --2- 172.21.15.50:0/968567785 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fedb00b4c40 0x7fedb00b7150 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fedbc0e27d0 tx=0x7fedbc000bc0 comp rx=0 tx=0).stop 2024-08-31T04:22:19.603 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:19.597+0000 7fedcfc00640 1 -- 172.21.15.50:0/968567785 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fedc8103920 msgr2=0x7fedc819c480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:22:19.603 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:19.597+0000 7fedcfc00640 1 --2- 172.21.15.50:0/968567785 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fedc8103920 0x7fedc819c480 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fedbc00d950 tx=0x7fedbc00de10 comp rx=0 tx=0).stop 2024-08-31T04:22:19.603 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:19.597+0000 7fedcfc00640 1 -- 172.21.15.50:0/968567785 shutdown_connections 2024-08-31T04:22:19.604 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:19.597+0000 7fedcfc00640 1 --2- 172.21.15.50:0/968567785 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fedb00b4c40 0x7fedb00b7150 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:19.604 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:19.597+0000 7fedcfc00640 1 --2- 172.21.15.50:0/968567785 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fedc8109bb0 0x7fedc81a1cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:19.604 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:19.597+0000 7fedcfc00640 1 --2- 172.21.15.50:0/968567785 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fedc8109260 0x7fedc819ca20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:19.604 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:19.597+0000 7fedcfc00640 1 --2- 172.21.15.50:0/968567785 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fedc8103920 0x7fedc819c480 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:19.604 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:19.597+0000 7fedcfc00640 1 -- 172.21.15.50:0/968567785 >> 172.21.15.50:0/968567785 conn(0x7fedc80ff370 msgr2=0x7fedc8108960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:22:19.604 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:19.597+0000 7fedcfc00640 1 -- 172.21.15.50:0/968567785 shutdown_connections 2024-08-31T04:22:19.604 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:19.597+0000 7fedcfc00640 1 -- 172.21.15.50:0/968567785 wait complete. 2024-08-31T04:22:19.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:22:19 smithi050 ceph-mon[17259]: pgmap v349: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-08-31T04:22:19.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:22:19 smithi177 ceph-mon[22025]: pgmap v349: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-08-31T04:22:19.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:22:19 smithi133 ceph-mon[22177]: pgmap v349: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-08-31T04:22:20.479 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 058d9fc6-674f-11ef-bcd4-c7b262605968 -- ceph tell mds.a status 2024-08-31T04:22:20.858 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:22:21.497 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:21.496+0000 7fb210e00640 1 -- 172.21.15.50:0/3230517280 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb20c105b20 msgr2=0x7fb20c105f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:22:21.498 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:21.496+0000 7fb210e00640 1 --2- 172.21.15.50:0/3230517280 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb20c105b20 0x7fb20c105f30 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fb1fc009900 tx=0x7fb1fc02a410 comp rx=0 tx=0).stop 2024-08-31T04:22:21.498 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:21.496+0000 7fb210e00640 1 -- 172.21.15.50:0/3230517280 shutdown_connections 2024-08-31T04:22:21.498 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:21.496+0000 7fb210e00640 1 --2- 172.21.15.50:0/3230517280 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb20c10b460 0x7fb20c10b870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:21.498 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:21.496+0000 7fb210e00640 1 --2- 172.21.15.50:0/3230517280 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb20c10bdb0 0x7fb20c1125e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:21.498 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:21.496+0000 7fb210e00640 1 --2- 172.21.15.50:0/3230517280 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb20c105b20 0x7fb20c105f30 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:21.498 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:21.496+0000 7fb210e00640 1 -- 172.21.15.50:0/3230517280 >> 172.21.15.50:0/3230517280 conn(0x7fb20c1015b0 msgr2=0x7fb20c103a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:22:21.498 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:21.496+0000 7fb210e00640 1 -- 172.21.15.50:0/3230517280 shutdown_connections 2024-08-31T04:22:21.498 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:21.496+0000 7fb210e00640 1 -- 172.21.15.50:0/3230517280 wait complete. 2024-08-31T04:22:21.499 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:21.497+0000 7fb210e00640 1 Processor -- start 2024-08-31T04:22:21.500 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:21.497+0000 7fb210e00640 1 -- start start 2024-08-31T04:22:21.500 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:21.498+0000 7fb210e00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb20c105b20 0x7fb20c19c4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:21.500 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:21.498+0000 7fb210e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb20c10b460 0x7fb20c19ca60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:21.500 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:21.498+0000 7fb210e00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb20c10bdb0 0x7fb20c1a1d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:21.500 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:21.498+0000 7fb210e00640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fb20c115a70 con 0x7fb20c10b460 2024-08-31T04:22:21.500 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:21.498+0000 7fb210e00640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7fb20c1158f0 con 0x7fb20c10bdb0 2024-08-31T04:22:21.500 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:21.498+0000 7fb210e00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fb20c115bf0 con 0x7fb20c105b20 2024-08-31T04:22:21.500 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:21.498+0000 7fb209e00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb20c105b20 0x7fb20c19c4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:22:21.500 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:21.498+0000 7fb203e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb20c10b460 0x7fb20c19ca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:22:21.500 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:21.498+0000 7fb209e00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb20c105b20 0x7fb20c19c4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.50:58532/0 (socket says 172.21.15.50:58532) 2024-08-31T04:22:21.500 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:21.498+0000 7fb209e00640 1 -- 172.21.15.50:0/3602168541 learned_addr learned my addr 172.21.15.50:0/3602168541 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:22:21.500 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:21.498+0000 7fb20a800640 1 --2- 172.21.15.50:0/3602168541 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb20c10bdb0 0x7fb20c1a1d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:22:21.501 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:21.499+0000 7fb209e00640 1 -- 172.21.15.50:0/3602168541 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb20c10bdb0 msgr2=0x7fb20c1a1d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:22:21.501 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:21.499+0000 7fb209e00640 1 --2- 172.21.15.50:0/3602168541 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb20c10bdb0 0x7fb20c1a1d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:21.501 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:21.499+0000 7fb209e00640 1 -- 172.21.15.50:0/3602168541 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb20c10b460 msgr2=0x7fb20c19ca60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:22:21.501 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:21.499+0000 7fb209e00640 1 --2- 172.21.15.50:0/3602168541 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb20c10b460 0x7fb20c19ca60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:21.501 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:21.499+0000 7fb209e00640 1 -- 172.21.15.50:0/3602168541 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb20c1a2430 con 0x7fb20c105b20 2024-08-31T04:22:21.502 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:21.499+0000 7fb209e00640 1 --2- 172.21.15.50:0/3602168541 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb20c105b20 0x7fb20c19c4c0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fb1fc005940 tx=0x7fb1fc004270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:22:21.502 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:21.499+0000 7fb202a00640 1 -- 172.21.15.50:0/3602168541 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1fc03f030 con 0x7fb20c105b20 2024-08-31T04:22:21.502 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:21.499+0000 7fb202a00640 1 -- 172.21.15.50:0/3602168541 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb1fc003aa0 con 0x7fb20c105b20 2024-08-31T04:22:21.502 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:21.499+0000 7fb210e00640 1 -- 172.21.15.50:0/3602168541 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb20c1a26c0 con 0x7fb20c105b20 2024-08-31T04:22:21.502 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:21.499+0000 7fb202a00640 1 -- 172.21.15.50:0/3602168541 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1fc035070 con 0x7fb20c105b20 2024-08-31T04:22:21.502 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:21.499+0000 7fb210e00640 1 -- 172.21.15.50:0/3602168541 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb20c1a8e80 con 0x7fb20c105b20 2024-08-31T04:22:21.504 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:21.502+0000 7fb217be8740 1 Processor -- start 2024-08-31T04:22:21.504 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:21.503+0000 7fb217be8740 1 -- start start 2024-08-31T04:22:21.505 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:21.503+0000 7fb217be8740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x563248e54f60 0x5632491fa8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:21.505 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:21.503+0000 7fb217be8740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563248e2c0a0 0x5632491fae30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:21.505 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:21.503+0000 7fb202a00640 1 -- 172.21.15.50:0/3602168541 <== mon.1 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 17) ==== 152628+0+0 (secure 0 0 0) 0x7fb1fc042030 con 0x7fb20c105b20 2024-08-31T04:22:21.505 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:21.503+0000 7fb217be8740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x563248e34280 0x5632491fb370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:21.505 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:21.503+0000 7fb217be8740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x563249171550 con 0x563248e2c0a0 2024-08-31T04:22:21.505 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:21.503+0000 7fb217be8740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x563249160ae0 con 0x563248e54f60 2024-08-31T04:22:21.505 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:21.503+0000 7fb217be8740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x563249164a90 con 0x563248e34280 2024-08-31T04:22:21.505 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:21.503+0000 7fb209e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563248e2c0a0 0x5632491fae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:22:21.505 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:21.503+0000 7fb20a800640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x563248e54f60 0x5632491fa8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:22:21.505 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:21.503+0000 7fb20a800640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x563248e54f60 0x5632491fa8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.50:50054/0 (socket says 172.21.15.50:50054) 2024-08-31T04:22:21.505 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:21.503+0000 7fb20a800640 1 -- 172.21.15.50:0/512158868 learned_addr learned my addr 172.21.15.50:0/512158868 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:22:21.505 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:21.504+0000 7fb203e00640 1 --2- 172.21.15.50:0/512158868 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x563248e34280 0x5632491fb370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:22:21.506 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:21.504+0000 7fb20a800640 1 -- 172.21.15.50:0/512158868 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x563248e34280 msgr2=0x5632491fb370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:22:21.507 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:21.504+0000 7fb20a800640 1 --2- 172.21.15.50:0/512158868 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x563248e34280 0x5632491fb370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:21.507 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:21.504+0000 7fb20a800640 1 -- 172.21.15.50:0/512158868 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563248e2c0a0 msgr2=0x5632491fae30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:22:21.507 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:21.504+0000 7fb20a800640 1 --2- 172.21.15.50:0/512158868 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563248e2c0a0 0x5632491fae30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:21.507 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:21.504+0000 7fb20a800640 1 -- 172.21.15.50:0/512158868 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563248ec0540 con 0x563248e54f60 2024-08-31T04:22:21.507 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:21.504+0000 7fb20a800640 1 --2- 172.21.15.50:0/512158868 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x563248e54f60 0x5632491fa8f0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fb204009f50 tx=0x7fb2040118d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a80e45a0e1c43d1d server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:22:21.507 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:21.505+0000 7fb1fb400640 1 -- 172.21.15.50:0/512158868 <== mon.2 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb204004d20 con 0x563248e54f60 2024-08-31T04:22:21.507 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:21.505+0000 7fb1fb400640 1 -- 172.21.15.50:0/512158868 <== mon.2 v2:172.21.15.133:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb204004050 con 0x563248e54f60 2024-08-31T04:22:21.507 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:21.505+0000 7fb1fb400640 1 -- 172.21.15.50:0/512158868 <== mon.2 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb204005280 con 0x563248e54f60 2024-08-31T04:22:21.507 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:21.505+0000 7fb202a00640 1 --2- 172.21.15.50:0/3602168541 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fb1f00b4c40 0x7fb1f00b7150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:21.507 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:21.506+0000 7fb209e00640 1 --2- 172.21.15.50:0/3602168541 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fb1f00b4c40 0x7fb1f00b7150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:22:21.507 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:21.506+0000 7fb202a00640 1 -- 172.21.15.50:0/3602168541 <== mon.1 v2:172.21.15.177:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8219+0+0 (secure 0 0 0) 0x7fb1fc105880 con 0x7fb20c105b20 2024-08-31T04:22:21.509 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:21.506+0000 7fb217be8740 1 -- 172.21.15.50:0/512158868 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x563248e54f60 msgr2=0x5632491fa8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:22:21.509 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:21.506+0000 7fb217be8740 1 --2- 172.21.15.50:0/512158868 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x563248e54f60 0x5632491fa8f0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fb204009f50 tx=0x7fb2040118d0 comp rx=0 tx=0).stop 2024-08-31T04:22:21.509 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:21.506+0000 7fb217be8740 1 -- 172.21.15.50:0/512158868 shutdown_connections 2024-08-31T04:22:21.509 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:21.506+0000 7fb217be8740 1 --2- 172.21.15.50:0/512158868 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x563248e34280 0x5632491fb370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:21.509 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:21.506+0000 7fb217be8740 1 --2- 172.21.15.50:0/512158868 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563248e2c0a0 0x5632491fae30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:21.509 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:21.506+0000 7fb217be8740 1 --2- 172.21.15.50:0/512158868 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x563248e54f60 0x5632491fa8f0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:21.510 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:21.506+0000 7fb217be8740 1 -- 172.21.15.50:0/512158868 >> 172.21.15.50:0/512158868 conn(0x563248e49350 msgr2=0x5632491f87e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:22:21.510 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:21.506+0000 7fb217be8740 1 -- 172.21.15.50:0/512158868 shutdown_connections 2024-08-31T04:22:21.510 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:21.506+0000 7fb217be8740 1 -- 172.21.15.50:0/512158868 wait complete. 2024-08-31T04:22:21.510 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:21.506+0000 7fb209e00640 1 --2- 172.21.15.50:0/3602168541 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fb1f00b4c40 0x7fb1f00b7150 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x5632491f9570 tx=0x7fb1fc10b530 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:22:21.510 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:21.507+0000 7fb217be8740 1 -- start start 2024-08-31T04:22:21.510 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:21.507+0000 7fb217be8740 1 Processor -- start 2024-08-31T04:22:21.510 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:21.508+0000 7fb217be8740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563248e2c0a0 0x5632492060b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:21.510 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:21.508+0000 7fb217be8740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x563248e34280 0x5632492065f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:21.510 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:21.508+0000 7fb217be8740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x563248e54f60 0x5632492123c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:21.510 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:21.508+0000 7fb217be8740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x563248fc35f0 con 0x563248e2c0a0 2024-08-31T04:22:21.510 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:21.508+0000 7fb217be8740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x5632490e7bd0 con 0x563248e34280 2024-08-31T04:22:21.510 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:21.508+0000 7fb217be8740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x5632492090d0 con 0x563248e54f60 2024-08-31T04:22:21.510 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:21.508+0000 7fb217be8740 10 client.0 _ll_register_callbacks cb 0x56324910d210 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:22:21.511 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:21.508+0000 7fb203e00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x563248e34280 0x5632492065f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:22:21.511 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:21.508+0000 7fb20a800640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563248e2c0a0 0x5632492060b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:22:21.511 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:21.508+0000 7fb203e00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x563248e34280 0x5632492065f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.50:50066/0 (socket says 172.21.15.50:50066) 2024-08-31T04:22:21.511 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:21.508+0000 7fb203e00640 1 -- 172.21.15.50:0/1635872543 learned_addr learned my addr 172.21.15.50:0/1635872543 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:22:21.511 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:21.508+0000 7fb20a800640 1 --2- 172.21.15.50:0/1635872543 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x563248e54f60 0x5632492123c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:22:21.512 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:21.508+0000 7fb203e00640 1 -- 172.21.15.50:0/1635872543 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x563248e54f60 msgr2=0x5632492123c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:22:21.512 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:21.508+0000 7fb203e00640 1 --2- 172.21.15.50:0/1635872543 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x563248e54f60 0x5632492123c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:21.513 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:21.508+0000 7fb203e00640 1 -- 172.21.15.50:0/1635872543 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563248e2c0a0 msgr2=0x5632492060b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:22:21.513 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:21.508+0000 7fb203e00640 1 --2- 172.21.15.50:0/1635872543 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563248e2c0a0 0x5632492060b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:21.513 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:21.508+0000 7fb203e00640 1 -- 172.21.15.50:0/1635872543 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563249128650 con 0x563248e34280 2024-08-31T04:22:21.513 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:21.509+0000 7fb203e00640 1 --2- 172.21.15.50:0/1635872543 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x563248e34280 0x5632492065f0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fb1f400bed0 tx=0x7fb1f4011810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=563ae0438dc8bd0f server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:22:21.513 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:21.509+0000 7fb1efe00640 10 client.0 ms_handle_connect on v2:172.21.15.133:3300/0 2024-08-31T04:22:21.513 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:21.509+0000 7fb1efe00640 1 -- 172.21.15.50:0/1635872543 <== mon.2 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1f4004020 con 0x563248e34280 2024-08-31T04:22:21.513 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:21.509+0000 7fb1efe00640 1 -- 172.21.15.50:0/1635872543 <== mon.2 v2:172.21.15.133:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8219+0+0 (secure 0 0 0) 0x7fb1f40041c0 con 0x563248e34280 2024-08-31T04:22:21.513 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:21.509+0000 7fb217be8740 1 -- 172.21.15.50:0/1635872543 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb204004050 con 0x563248e34280 2024-08-31T04:22:21.513 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:21.509+0000 7fb1efe00640 1 -- 172.21.15.50:0/1635872543 <== mon.2 v2:172.21.15.133:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fb1f40043c0 con 0x563248e34280 2024-08-31T04:22:21.513 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:21.509+0000 7fb217be8740 10 client.25100 fetch_fsmap learned FSMap version 28 2024-08-31T04:22:21.513 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:21.509+0000 7fb217be8740 1 -- 172.21.15.50:0/1635872543 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x563249214e10 con 0x563248e34280 2024-08-31T04:22:21.513 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:21.510+0000 7fb1efe00640 1 -- 172.21.15.50:0/1635872543 <== mon.2 v2:172.21.15.133:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb204004050 con 0x563248e34280 2024-08-31T04:22:21.514 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:21.510+0000 7fb1efe00640 1 -- 172.21.15.50:0/1635872543 <== mon.2 v2:172.21.15.133:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fb1f4003990 con 0x563248e34280 2024-08-31T04:22:21.514 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:21.510+0000 7fb217be8740 10 client.25100 fetch_fsmap finished waiting for FSMap version 28 2024-08-31T04:22:21.514 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:21.510+0000 7fb217be8740 10 client.25100 resolve_mds: resolved name 'a' to daemon mds.a 2024-08-31T04:22:21.514 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:21.510+0000 7fb217be8740 20 client.25100 populate_metadata read hostname 'smithi050' 2024-08-31T04:22:21.514 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:21.510+0000 7fb217be8740 1 --2- 172.21.15.50:0/1635872543 >> [v2:172.21.15.50:6840/575209862,v1:172.21.15.50:6841/575209862] conn(0x563248e138e0 0x5632492188a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:21.514 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:21.510+0000 7fb217be8740 4 client.25100 mds_command: new command op to 24691 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T04:22:21.514 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:21.510+0000 7fb217be8740 1 -- 172.21.15.50:0/1635872543 --> [v2:172.21.15.50:6840/575209862,v1:172.21.15.50:6841/575209862] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5632491734a0 con 0x563248e138e0 2024-08-31T04:22:21.514 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:21.510+0000 7fb20a800640 1 --2- 172.21.15.50:0/1635872543 >> [v2:172.21.15.50:6840/575209862,v1:172.21.15.50:6841/575209862] conn(0x563248e138e0 0x5632492188a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:22:21.514 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:21.511+0000 7fb20a800640 1 --2- 172.21.15.50:0/1635872543 >> [v2:172.21.15.50:6840/575209862,v1:172.21.15.50:6841/575209862] conn(0x563248e138e0 0x5632492188a0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=d64d65198d1eb22e server_cookie=2d10b8de956ffd57 in_seq=0 out_seq=0 2024-08-31T04:22:21.514 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:21.511+0000 7fb1efe00640 10 client.25100 ms_handle_connect on v2:172.21.15.50:6840/575209862 2024-08-31T04:22:21.515 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:21.512+0000 7fb1efe00640 1 -- 172.21.15.50:0/1635872543 <== mds.1 v2:172.21.15.50:6840/575209862 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5632491734a0 con 0x563248e138e0 2024-08-31T04:22:21.515 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:21.512+0000 7fb1efe00640 10 client.25100 handle_command_reply: tid=0 2024-08-31T04:22:21.515 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:21.512+0000 7fb217be8740 1 client.25100 shutdown 2024-08-31T04:22:21.516 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:21.512+0000 7fb217be8740 1 -- 172.21.15.50:0/1635872543 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x563248e34280 msgr2=0x5632492065f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:22:21.516 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:21.512+0000 7fb217be8740 1 --2- 172.21.15.50:0/1635872543 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x563248e34280 0x5632492065f0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fb1f400bed0 tx=0x7fb1f4011810 comp rx=0 tx=0).stop 2024-08-31T04:22:21.516 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:21.512+0000 7fb217be8740 1 -- 172.21.15.50:0/1635872543 shutdown_connections 2024-08-31T04:22:21.516 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:21.512+0000 7fb217be8740 1 --2- 172.21.15.50:0/1635872543 >> [v2:172.21.15.50:6840/575209862,v1:172.21.15.50:6841/575209862] conn(0x563248e138e0 0x5632492188a0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:21.516 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:21.512+0000 7fb217be8740 1 --2- 172.21.15.50:0/1635872543 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x563248e54f60 0x5632492123c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:21.516 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:21.512+0000 7fb217be8740 1 --2- 172.21.15.50:0/1635872543 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x563248e34280 0x5632492065f0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:21.516 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:21.512+0000 7fb217be8740 1 --2- 172.21.15.50:0/1635872543 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563248e2c0a0 0x5632492060b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:21.516 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:21.512+0000 7fb1efe00640 0 client.25100 ms_handle_reset on v2:172.21.15.50:6840/575209862 2024-08-31T04:22:21.516 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:21.512+0000 7fb217be8740 1 -- 172.21.15.50:0/1635872543 >> 172.21.15.50:0/1635872543 conn(0x563248e49350 msgr2=0x5632491fdad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:22:21.516 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:21.512+0000 7fb217be8740 1 -- 172.21.15.50:0/1635872543 shutdown_connections 2024-08-31T04:22:21.516 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:21.512+0000 7fb217be8740 1 -- 172.21.15.50:0/1635872543 wait complete. 2024-08-31T04:22:21.516 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:21.513+0000 7fb217be8740 20 client.25100 trim_cache size 0 max 16384 2024-08-31T04:22:21.537 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:21.532+0000 7fb217be8740 1 Processor -- start 2024-08-31T04:22:21.537 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:21.532+0000 7fb217be8740 1 -- start start 2024-08-31T04:22:21.537 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:21.532+0000 7fb217be8740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x563248e2c0a0 0x5632491fd9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:21.537 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:21.532+0000 7fb217be8740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x563248e34280 0x5632491fdf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:21.538 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:21.532+0000 7fb217be8740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563248e54f60 0x563249205e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:21.538 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:21.532+0000 7fb217be8740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x563249216be0 con 0x563248e54f60 2024-08-31T04:22:21.538 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:21.532+0000 7fb217be8740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x5632492172b0 con 0x563248e34280 2024-08-31T04:22:21.538 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:21.532+0000 7fb217be8740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x563249217980 con 0x563248e2c0a0 2024-08-31T04:22:21.538 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:21.532+0000 7fb20a800640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563248e54f60 0x563249205e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:22:21.538 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:21.533+0000 7fb203e00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x563248e34280 0x5632491fdf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:22:21.538 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:21.533+0000 7fb20a800640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563248e54f60 0x563249205e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35892/0 (socket says 172.21.15.50:35892) 2024-08-31T04:22:21.538 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:21.533+0000 7fb20a800640 1 -- 172.21.15.50:0/3032918438 learned_addr learned my addr 172.21.15.50:0/3032918438 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:22:21.538 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:21.533+0000 7fb203e00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x563248e34280 0x5632491fdf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.50:50082/0 (socket says 172.21.15.50:50082) 2024-08-31T04:22:21.538 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:21.533+0000 7fb20a800640 1 --2- 172.21.15.50:0/3032918438 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x563248e2c0a0 0x5632491fd9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:22:21.538 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:21.533+0000 7fb20a800640 1 -- 172.21.15.50:0/3032918438 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x563248e2c0a0 msgr2=0x5632491fd9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:22:21.538 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:21.533+0000 7fb20a800640 1 --2- 172.21.15.50:0/3032918438 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x563248e2c0a0 0x5632491fd9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:21.538 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:21.533+0000 7fb20a800640 1 -- 172.21.15.50:0/3032918438 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x563248e34280 msgr2=0x5632491fdf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:22:21.539 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:21.533+0000 7fb20a800640 1 --2- 172.21.15.50:0/3032918438 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x563248e34280 0x5632491fdf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:21.539 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:21.533+0000 7fb20a800640 1 -- 172.21.15.50:0/3032918438 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563249207370 con 0x563248e54f60 2024-08-31T04:22:21.539 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:21.533+0000 7fb203e00640 1 --2- 172.21.15.50:0/3032918438 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x563248e34280 0x5632491fdf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:22:21.539 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:21.533+0000 7fb20a800640 1 --2- 172.21.15.50:0/3032918438 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563248e54f60 0x563249205e60 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fb204011dd0 tx=0x7fb204009500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9858b676ef060b36 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:22:21.539 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:21.533+0000 7fb1faa00640 1 -- 172.21.15.50:0/3032918438 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb204003b00 con 0x563248e54f60 2024-08-31T04:22:21.539 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:21.534+0000 7fb1faa00640 1 -- 172.21.15.50:0/3032918438 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb204004e40 con 0x563248e54f60 2024-08-31T04:22:21.539 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:21.534+0000 7fb1faa00640 1 -- 172.21.15.50:0/3032918438 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2040051d0 con 0x563248e54f60 2024-08-31T04:22:21.539 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:21.534+0000 7fb217be8740 1 -- 172.21.15.50:0/3032918438 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563248e54f60 msgr2=0x563249205e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:22:21.539 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:21.534+0000 7fb217be8740 1 --2- 172.21.15.50:0/3032918438 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563248e54f60 0x563249205e60 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fb204011dd0 tx=0x7fb204009500 comp rx=0 tx=0).stop 2024-08-31T04:22:21.539 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:21.534+0000 7fb217be8740 1 -- 172.21.15.50:0/3032918438 shutdown_connections 2024-08-31T04:22:21.539 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:21.534+0000 7fb217be8740 1 --2- 172.21.15.50:0/3032918438 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563248e54f60 0x563249205e60 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:21.539 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:21.534+0000 7fb217be8740 1 --2- 172.21.15.50:0/3032918438 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x563248e34280 0x5632491fdf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:21.539 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:21.534+0000 7fb217be8740 1 --2- 172.21.15.50:0/3032918438 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x563248e2c0a0 0x5632491fd9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:21.540 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:21.534+0000 7fb217be8740 1 -- 172.21.15.50:0/3032918438 >> 172.21.15.50:0/3032918438 conn(0x563248e49350 msgr2=0x563249204930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:22:21.540 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:21.535+0000 7fb217be8740 1 -- 172.21.15.50:0/3032918438 shutdown_connections 2024-08-31T04:22:21.540 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:21.535+0000 7fb217be8740 1 -- 172.21.15.50:0/3032918438 wait complete. 2024-08-31T04:22:21.540 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:21.535+0000 7fb217be8740 1 -- start start 2024-08-31T04:22:21.540 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:21.535+0000 7fb217be8740 1 Processor -- start 2024-08-31T04:22:21.540 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:21.536+0000 7fb217be8740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x563248e2c0a0 0x56324921cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:21.540 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:21.536+0000 7fb217be8740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563248e34280 0x56324921d310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:21.540 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:21.536+0000 7fb217be8740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x563248e54f60 0x563249282d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:21.540 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:21.536+0000 7fb217be8740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x563249218720 con 0x563248e34280 2024-08-31T04:22:21.540 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:21.536+0000 7fb217be8740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x563249218050 con 0x563248e2c0a0 2024-08-31T04:22:21.540 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:21.536+0000 7fb217be8740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x563249218df0 con 0x563248e54f60 2024-08-31T04:22:21.540 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:21.536+0000 7fb217be8740 10 client.0 _ll_register_callbacks cb 0x7fb1f400b9d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:22:21.540 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:21.536+0000 7fb20a800640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x563248e2c0a0 0x56324921cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:22:21.540 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:21.536+0000 7fb203e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563248e34280 0x56324921d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:22:21.541 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:21.536+0000 7fb203e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563248e34280 0x56324921d310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35906/0 (socket says 172.21.15.50:35906) 2024-08-31T04:22:21.541 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:21.536+0000 7fb20a800640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x563248e2c0a0 0x56324921cdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.50:50084/0 (socket says 172.21.15.50:50084) 2024-08-31T04:22:21.541 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:21.536+0000 7fb203e00640 1 -- 172.21.15.50:0/1103432127 learned_addr learned my addr 172.21.15.50:0/1103432127 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:22:21.541 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:21.536+0000 7fb20a800640 1 --2- 172.21.15.50:0/1103432127 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x563248e54f60 0x563249282d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:22:21.543 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:21.537+0000 7fb203e00640 1 -- 172.21.15.50:0/1103432127 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x563248e54f60 msgr2=0x563249282d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:22:21.543 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:21.537+0000 7fb203e00640 1 --2- 172.21.15.50:0/1103432127 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x563248e54f60 0x563249282d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:21.543 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:21.537+0000 7fb203e00640 1 -- 172.21.15.50:0/1103432127 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x563248e2c0a0 msgr2=0x56324921cdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:22:21.543 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:21.537+0000 7fb203e00640 1 --2- 172.21.15.50:0/1103432127 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x563248e2c0a0 0x56324921cdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:21.543 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:21.537+0000 7fb203e00640 1 -- 172.21.15.50:0/1103432127 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56324921db30 con 0x563248e34280 2024-08-31T04:22:21.543 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:21.537+0000 7fb203e00640 1 --2- 172.21.15.50:0/1103432127 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563248e34280 0x56324921d310 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fb1f4003e00 tx=0x7fb1f400b590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=562156f975262f91 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:22:21.543 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:21.537+0000 7fb1efe00640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-08-31T04:22:21.544 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:21.537+0000 7fb1efe00640 1 -- 172.21.15.50:0/1103432127 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1f4034060 con 0x563248e34280 2024-08-31T04:22:21.544 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:21.537+0000 7fb1efe00640 1 -- 172.21.15.50:0/1103432127 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8219+0+0 (secure 0 0 0) 0x7fb1f4003ff0 con 0x563248e34280 2024-08-31T04:22:21.544 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:21.537+0000 7fb217be8740 1 -- 172.21.15.50:0/1103432127 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x56324916ef40 con 0x563248e34280 2024-08-31T04:22:21.544 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:21.537+0000 7fb1efe00640 1 -- 172.21.15.50:0/1103432127 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fb1f402b040 con 0x563248e34280 2024-08-31T04:22:21.544 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:21.537+0000 7fb217be8740 10 client.15108 fetch_fsmap learned FSMap version 28 2024-08-31T04:22:21.544 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:21.537+0000 7fb217be8740 1 -- 172.21.15.50:0/1103432127 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x563249284280 con 0x563248e34280 2024-08-31T04:22:21.544 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:21.538+0000 7fb1efe00640 1 -- 172.21.15.50:0/1103432127 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x56324916ef40 con 0x563248e34280 2024-08-31T04:22:21.544 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:21.538+0000 7fb1efe00640 1 -- 172.21.15.50:0/1103432127 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fb1f4005310 con 0x563248e34280 2024-08-31T04:22:21.544 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:21.538+0000 7fb217be8740 10 client.15108 fetch_fsmap finished waiting for FSMap version 28 2024-08-31T04:22:21.544 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:21.538+0000 7fb217be8740 10 client.15108 resolve_mds: resolved name 'a' to daemon mds.a 2024-08-31T04:22:21.544 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:21.538+0000 7fb217be8740 20 client.15108 populate_metadata read hostname 'smithi050' 2024-08-31T04:22:21.544 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:21.538+0000 7fb217be8740 1 --2- 172.21.15.50:0/1103432127 >> [v2:172.21.15.50:6840/575209862,v1:172.21.15.50:6841/575209862] conn(0x563248de8c90 0x563249287b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:21.545 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:21.538+0000 7fb217be8740 4 client.15108 mds_command: new command op to 24691 tid=0 multi_id=0 [{"prefix": "status"}] 2024-08-31T04:22:21.545 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:21.538+0000 7fb217be8740 1 -- 172.21.15.50:0/1103432127 --> [v2:172.21.15.50:6840/575209862,v1:172.21.15.50:6841/575209862] -- command(tid 0: {"prefix": "status"}) -- 0x56324916c680 con 0x563248de8c90 2024-08-31T04:22:21.545 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:21.538+0000 7fb20a800640 1 --2- 172.21.15.50:0/1103432127 >> [v2:172.21.15.50:6840/575209862,v1:172.21.15.50:6841/575209862] conn(0x563248de8c90 0x563249287b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:22:21.545 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:21.539+0000 7fb20a800640 1 --2- 172.21.15.50:0/1103432127 >> [v2:172.21.15.50:6840/575209862,v1:172.21.15.50:6841/575209862] conn(0x563248de8c90 0x563249287b50 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=6d7ccad201ddcf41 server_cookie=af6f8932c97582e3 in_seq=0 out_seq=0 2024-08-31T04:22:21.545 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:21.539+0000 7fb1efe00640 10 client.15108 ms_handle_connect on v2:172.21.15.50:6840/575209862 2024-08-31T04:22:21.545 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:21.539+0000 7fb1efe00640 1 -- 172.21.15.50:0/1103432127 <== mds.1 v2:172.21.15.50:6840/575209862 1 ==== command_reply(tid 0: 0 ) ==== 8+0+326 (crc 0 0 0) 0x56324916c680 con 0x563248de8c90 2024-08-31T04:22:21.545 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:21.539+0000 7fb1efe00640 10 client.15108 handle_command_reply: tid=0 2024-08-31T04:22:21.545 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:21.539+0000 7fb217be8740 1 client.15108 shutdown 2024-08-31T04:22:21.545 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:21.539+0000 7fb217be8740 1 -- 172.21.15.50:0/1103432127 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563248e34280 msgr2=0x56324921d310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:22:21.545 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:21.539+0000 7fb217be8740 1 --2- 172.21.15.50:0/1103432127 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563248e34280 0x56324921d310 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fb1f4003e00 tx=0x7fb1f400b590 comp rx=0 tx=0).stop 2024-08-31T04:22:21.545 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:21.539+0000 7fb217be8740 1 -- 172.21.15.50:0/1103432127 shutdown_connections 2024-08-31T04:22:21.545 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:21.539+0000 7fb217be8740 1 --2- 172.21.15.50:0/1103432127 >> [v2:172.21.15.50:6840/575209862,v1:172.21.15.50:6841/575209862] conn(0x563248de8c90 0x563249287b50 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:21.545 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:21.539+0000 7fb217be8740 1 --2- 172.21.15.50:0/1103432127 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x563248e54f60 0x563249282d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:21.545 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:21.539+0000 7fb217be8740 1 --2- 172.21.15.50:0/1103432127 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563248e34280 0x56324921d310 secure :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fb1f4003e00 tx=0x7fb1f400b590 comp rx=0 tx=0).stop 2024-08-31T04:22:21.546 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:21.539+0000 7fb217be8740 1 --2- 172.21.15.50:0/1103432127 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x563248e2c0a0 0x56324921cdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:21.546 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:21.539+0000 7fb217be8740 1 -- 172.21.15.50:0/1103432127 >> 172.21.15.50:0/1103432127 conn(0x563248e49350 msgr2=0x563249205e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:22:21.546 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:21.540+0000 7fb1efe00640 0 client.15108 ms_handle_reset on v2:172.21.15.50:6840/575209862 2024-08-31T04:22:21.546 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:21.540+0000 7fb217be8740 1 -- 172.21.15.50:0/1103432127 shutdown_connections 2024-08-31T04:22:21.546 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:21.540+0000 7fb217be8740 1 -- 172.21.15.50:0/1103432127 wait complete. 2024-08-31T04:22:21.546 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:21.540+0000 7fb217be8740 20 client.15108 trim_cache size 0 max 16384 2024-08-31T04:22:21.546 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-08-31T04:22:21.546 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_fsid": "058d9fc6-674f-11ef-bcd4-c7b262605968", 2024-08-31T04:22:21.546 INFO:teuthology.orchestra.run.smithi050.stdout: "whoami": 1, 2024-08-31T04:22:21.546 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 24691, 2024-08-31T04:22:21.547 INFO:teuthology.orchestra.run.smithi050.stdout: "want_state": "up:active", 2024-08-31T04:22:21.547 INFO:teuthology.orchestra.run.smithi050.stdout: "state": "up:active", 2024-08-31T04:22:21.547 INFO:teuthology.orchestra.run.smithi050.stdout: "fs_name": "cephfs", 2024-08-31T04:22:21.547 INFO:teuthology.orchestra.run.smithi050.stdout: "rank_uptime": 87.557471974999999, 2024-08-31T04:22:21.547 INFO:teuthology.orchestra.run.smithi050.stdout: "mdsmap_epoch": 28, 2024-08-31T04:22:21.547 INFO:teuthology.orchestra.run.smithi050.stdout: "osdmap_epoch": 78, 2024-08-31T04:22:21.547 INFO:teuthology.orchestra.run.smithi050.stdout: "osdmap_epoch_barrier": 78, 2024-08-31T04:22:21.547 INFO:teuthology.orchestra.run.smithi050.stdout: "uptime": 112.92637386 2024-08-31T04:22:21.547 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-08-31T04:22:21.548 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:21.541+0000 7fb210e00640 1 -- 172.21.15.50:0/3602168541 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fb1f00b4c40 msgr2=0x7fb1f00b7150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:22:21.548 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:21.541+0000 7fb210e00640 1 --2- 172.21.15.50:0/3602168541 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fb1f00b4c40 0x7fb1f00b7150 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x5632491f9570 tx=0x7fb1fc10b530 comp rx=0 tx=0).stop 2024-08-31T04:22:21.548 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:21.541+0000 7fb210e00640 1 -- 172.21.15.50:0/3602168541 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb20c105b20 msgr2=0x7fb20c19c4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:22:21.548 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:21.541+0000 7fb210e00640 1 --2- 172.21.15.50:0/3602168541 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb20c105b20 0x7fb20c19c4c0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fb1fc005940 tx=0x7fb1fc004270 comp rx=0 tx=0).stop 2024-08-31T04:22:21.548 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:21.541+0000 7fb210e00640 1 -- 172.21.15.50:0/3602168541 shutdown_connections 2024-08-31T04:22:21.548 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:21.541+0000 7fb210e00640 1 --2- 172.21.15.50:0/3602168541 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fb1f00b4c40 0x7fb1f00b7150 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:21.548 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:21.541+0000 7fb210e00640 1 --2- 172.21.15.50:0/3602168541 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb20c10bdb0 0x7fb20c1a1d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:21.548 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:21.541+0000 7fb210e00640 1 --2- 172.21.15.50:0/3602168541 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb20c10b460 0x7fb20c19ca60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:21.548 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:21.541+0000 7fb210e00640 1 --2- 172.21.15.50:0/3602168541 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb20c105b20 0x7fb20c19c4c0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:21.548 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:21.541+0000 7fb210e00640 1 -- 172.21.15.50:0/3602168541 >> 172.21.15.50:0/3602168541 conn(0x7fb20c1015b0 msgr2=0x7fb20c1039d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:22:21.548 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:21.541+0000 7fb210e00640 1 -- 172.21.15.50:0/3602168541 shutdown_connections 2024-08-31T04:22:21.549 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:21.541+0000 7fb210e00640 1 -- 172.21.15.50:0/3602168541 wait complete. 2024-08-31T04:22:21.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:22:21 smithi050 ceph-mon[17259]: pgmap v350: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-08-31T04:22:21.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:22:21 smithi177 ceph-mon[22025]: pgmap v350: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-08-31T04:22:21.792 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:22:21 smithi133 ceph-mon[22177]: pgmap v350: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-08-31T04:22:22.269 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 058d9fc6-674f-11ef-bcd4-c7b262605968 -- ceph tell mds.b status 2024-08-31T04:22:22.648 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:22:23.307 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:23.305+0000 7f236f200640 1 -- 172.21.15.50:0/942859757 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2368109240 msgr2=0x7f2368109650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:22:23.307 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:23.305+0000 7f236f200640 1 --2- 172.21.15.50:0/942859757 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2368109240 0x7f2368109650 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f2350009900 tx=0x7f235002a3f0 comp rx=0 tx=0).stop 2024-08-31T04:22:23.307 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:23.305+0000 7f236f200640 1 -- 172.21.15.50:0/942859757 shutdown_connections 2024-08-31T04:22:23.308 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:23.305+0000 7f236f200640 1 --2- 172.21.15.50:0/942859757 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2368109b90 0x7f23681103c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:23.308 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:23.305+0000 7f236f200640 1 --2- 172.21.15.50:0/942859757 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2368109240 0x7f2368109650 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:23.308 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:23.305+0000 7f236f200640 1 --2- 172.21.15.50:0/942859757 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2368103900 0x7f2368103d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:23.308 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:23.305+0000 7f236f200640 1 -- 172.21.15.50:0/942859757 >> 172.21.15.50:0/942859757 conn(0x7f236807b5f0 msgr2=0x7f236807ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:22:23.308 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:23.305+0000 7f236f200640 1 -- 172.21.15.50:0/942859757 shutdown_connections 2024-08-31T04:22:23.308 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:23.305+0000 7f236f200640 1 -- 172.21.15.50:0/942859757 wait complete. 2024-08-31T04:22:23.309 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:23.307+0000 7f236f200640 1 Processor -- start 2024-08-31T04:22:23.309 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:23.307+0000 7f236f200640 1 -- start start 2024-08-31T04:22:23.310 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:23.307+0000 7f236f200640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2368103900 0x7f236819a280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:23.310 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:23.307+0000 7f236f200640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2368109240 0x7f236819a820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:23.310 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:23.307+0000 7f236f200640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2368109b90 0x7f236819fac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:23.310 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:23.307+0000 7f236f200640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f2368113850 con 0x7f2368103900 2024-08-31T04:22:23.310 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:23.307+0000 7f236f200640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f23681136d0 con 0x7f2368109b90 2024-08-31T04:22:23.310 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:23.307+0000 7f236f200640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f23681139d0 con 0x7f2368109240 2024-08-31T04:22:23.310 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:23.308+0000 7f2367e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2368103900 0x7f236819a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:22:23.310 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:23.308+0000 7f2367e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2368103900 0x7f236819a280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:33680/0 (socket says 172.21.15.50:33680) 2024-08-31T04:22:23.310 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:23.308+0000 7f2367e00640 1 -- 172.21.15.50:0/2589650047 learned_addr learned my addr 172.21.15.50:0/2589650047 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:22:23.310 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:23.308+0000 7f235f400640 1 --2- 172.21.15.50:0/2589650047 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2368109240 0x7f236819a820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:22:23.310 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:23.308+0000 7f236d200640 1 --2- 172.21.15.50:0/2589650047 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2368109b90 0x7f236819fac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:22:23.310 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:23.308+0000 7f2367e00640 1 -- 172.21.15.50:0/2589650047 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2368109240 msgr2=0x7f236819a820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:22:23.311 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:23.308+0000 7f2367e00640 1 --2- 172.21.15.50:0/2589650047 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2368109240 0x7f236819a820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:23.311 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:23.308+0000 7f2367e00640 1 -- 172.21.15.50:0/2589650047 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2368109b90 msgr2=0x7f236819fac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:22:23.311 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:23.308+0000 7f2367e00640 1 --2- 172.21.15.50:0/2589650047 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2368109b90 0x7f236819fac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:23.311 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:23.308+0000 7f2367e00640 1 -- 172.21.15.50:0/2589650047 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23681a01f0 con 0x7f2368103900 2024-08-31T04:22:23.311 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:23.308+0000 7f2367e00640 1 --2- 172.21.15.50:0/2589650047 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2368103900 0x7f236819a280 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f235800ebc0 tx=0x7f235800c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:22:23.311 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:23.309+0000 7f2365600640 1 -- 172.21.15.50:0/2589650047 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2358010430 con 0x7f2368103900 2024-08-31T04:22:23.311 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:23.309+0000 7f2365600640 1 -- 172.21.15.50:0/2589650047 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2358010a80 con 0x7f2368103900 2024-08-31T04:22:23.311 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:23.309+0000 7f236f200640 1 -- 172.21.15.50:0/2589650047 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f23681a04e0 con 0x7f2368103900 2024-08-31T04:22:23.312 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:23.309+0000 7f2365600640 1 -- 172.21.15.50:0/2589650047 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2358018a50 con 0x7f2368103900 2024-08-31T04:22:23.312 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:23.309+0000 7f236f200640 1 -- 172.21.15.50:0/2589650047 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f23681a6c40 con 0x7f2368103900 2024-08-31T04:22:23.313 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:23.312+0000 7f2375e62740 1 Processor -- start 2024-08-31T04:22:23.313 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:23.312+0000 7f2375e62740 1 -- start start 2024-08-31T04:22:23.314 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:23.313+0000 7f2365600640 1 -- 172.21.15.50:0/2589650047 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 17) ==== 152628+0+0 (secure 0 0 0) 0x7f2358010c30 con 0x7f2368103900 2024-08-31T04:22:23.314 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:23.313+0000 7f2375e62740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ad12cb8f60 0x55ad1305e8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:23.314 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:23.313+0000 7f2375e62740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ad12c900a0 0x55ad1305ee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:23.314 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:23.313+0000 7f2375e62740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ad12c98280 0x55ad1305f370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:23.315 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:23.313+0000 7f2375e62740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55ad12fd5550 con 0x55ad12c900a0 2024-08-31T04:22:23.315 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:23.313+0000 7f2375e62740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x55ad12fc4ae0 con 0x55ad12cb8f60 2024-08-31T04:22:23.315 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:23.313+0000 7f2375e62740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x55ad12fc8a90 con 0x55ad12c98280 2024-08-31T04:22:23.315 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:23.313+0000 7f2367e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ad12c900a0 0x55ad1305ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:22:23.315 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:23.313+0000 7f236d200640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ad12cb8f60 0x55ad1305e8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:22:23.315 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:23.313+0000 7f236d200640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ad12cb8f60 0x55ad1305e8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.50:57668/0 (socket says 172.21.15.50:57668) 2024-08-31T04:22:23.315 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:23.313+0000 7f236d200640 1 -- 172.21.15.50:0/3961765261 learned_addr learned my addr 172.21.15.50:0/3961765261 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:22:23.316 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:23.313+0000 7f235f400640 1 --2- 172.21.15.50:0/3961765261 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ad12c98280 0x55ad1305f370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:22:23.316 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:23.314+0000 7f236d200640 1 -- 172.21.15.50:0/3961765261 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ad12c98280 msgr2=0x55ad1305f370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:22:23.316 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:23.314+0000 7f236d200640 1 --2- 172.21.15.50:0/3961765261 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ad12c98280 0x55ad1305f370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:23.316 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:23.314+0000 7f236d200640 1 -- 172.21.15.50:0/3961765261 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ad12c900a0 msgr2=0x55ad1305ee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:22:23.317 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:23.314+0000 7f236d200640 1 --2- 172.21.15.50:0/3961765261 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ad12c900a0 0x55ad1305ee30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:23.317 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:23.314+0000 7f236d200640 1 -- 172.21.15.50:0/3961765261 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ad12d24540 con 0x55ad12cb8f60 2024-08-31T04:22:23.317 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:23.314+0000 7f235f400640 1 --2- 172.21.15.50:0/3961765261 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ad12c98280 0x55ad1305f370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:22:23.317 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:23.314+0000 7f236d200640 1 --2- 172.21.15.50:0/3961765261 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ad12cb8f60 0x55ad1305e8f0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f2360009c90 tx=0x7f2360011810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=981295e1f81460dc server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:22:23.317 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:23.314+0000 7f235d600640 1 -- 172.21.15.50:0/3961765261 <== mon.2 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2360004230 con 0x55ad12cb8f60 2024-08-31T04:22:23.317 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:23.315+0000 7f235d600640 1 -- 172.21.15.50:0/3961765261 <== mon.2 v2:172.21.15.133:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2360009e40 con 0x55ad12cb8f60 2024-08-31T04:22:23.317 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:23.315+0000 7f235d600640 1 -- 172.21.15.50:0/3961765261 <== mon.2 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2360019710 con 0x55ad12cb8f60 2024-08-31T04:22:23.317 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:23.315+0000 7f2365600640 1 --2- 172.21.15.50:0/2589650047 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f234c0b4c40 0x7f234c0b7150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:23.317 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:23.315+0000 7f2365600640 1 -- 172.21.15.50:0/2589650047 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8219+0+0 (secure 0 0 0) 0x7f23580e5960 con 0x7f2368103900 2024-08-31T04:22:23.317 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:23.315+0000 7f2367e00640 1 --2- 172.21.15.50:0/2589650047 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f234c0b4c40 0x7f234c0b7150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:22:23.319 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:23.316+0000 7f2375e62740 1 -- 172.21.15.50:0/3961765261 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ad12cb8f60 msgr2=0x55ad1305e8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:22:23.319 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:23.316+0000 7f2375e62740 1 --2- 172.21.15.50:0/3961765261 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ad12cb8f60 0x55ad1305e8f0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f2360009c90 tx=0x7f2360011810 comp rx=0 tx=0).stop 2024-08-31T04:22:23.319 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:23.316+0000 7f2367e00640 1 --2- 172.21.15.50:0/2589650047 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f234c0b4c40 0x7f234c0b7150 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f23580ac170 tx=0x7f23580eb530 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:22:23.319 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:23.316+0000 7f2375e62740 1 -- 172.21.15.50:0/3961765261 shutdown_connections 2024-08-31T04:22:23.320 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:23.316+0000 7f2375e62740 1 --2- 172.21.15.50:0/3961765261 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ad12c98280 0x55ad1305f370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:23.320 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:23.316+0000 7f2375e62740 1 --2- 172.21.15.50:0/3961765261 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ad12c900a0 0x55ad1305ee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:23.320 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:23.316+0000 7f2375e62740 1 --2- 172.21.15.50:0/3961765261 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ad12cb8f60 0x55ad1305e8f0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:23.320 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:23.316+0000 7f2375e62740 1 -- 172.21.15.50:0/3961765261 >> 172.21.15.50:0/3961765261 conn(0x55ad12cad350 msgr2=0x55ad1305c7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:22:23.320 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:23.316+0000 7f2375e62740 1 -- 172.21.15.50:0/3961765261 shutdown_connections 2024-08-31T04:22:23.320 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:23.316+0000 7f2375e62740 1 -- 172.21.15.50:0/3961765261 wait complete. 2024-08-31T04:22:23.320 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:23.317+0000 7f2375e62740 1 -- start start 2024-08-31T04:22:23.320 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:23.317+0000 7f2375e62740 1 Processor -- start 2024-08-31T04:22:23.320 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:23.317+0000 7f2375e62740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ad12c900a0 0x55ad1306e4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:23.320 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:23.317+0000 7f2375e62740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ad12c98280 0x55ad1306e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:23.320 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:23.317+0000 7f2375e62740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ad12cb8f60 0x55ad1307a700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:23.320 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:23.317+0000 7f2375e62740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55ad12e275f0 con 0x55ad12c98280 2024-08-31T04:22:23.321 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:23.317+0000 7f2375e62740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x55ad12f4bbd0 con 0x55ad12cb8f60 2024-08-31T04:22:23.321 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:23.317+0000 7f2375e62740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x55ad130713d0 con 0x55ad12c900a0 2024-08-31T04:22:23.321 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:23.317+0000 7f2375e62740 10 client.0 _ll_register_callbacks cb 0x55ad12f71210 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:22:23.321 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:23.318+0000 7f235f400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ad12c98280 0x55ad1306e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:22:23.321 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:23.318+0000 7f235f400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ad12c98280 0x55ad1306e9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:33700/0 (socket says 172.21.15.50:33700) 2024-08-31T04:22:23.321 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:23.318+0000 7f235f400640 1 -- 172.21.15.50:0/1023434059 learned_addr learned my addr 172.21.15.50:0/1023434059 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:22:23.321 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:23.318+0000 7f236d200640 1 --2- 172.21.15.50:0/1023434059 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ad12c900a0 0x55ad1306e4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:22:23.321 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:23.318+0000 7f236d200640 1 --2- 172.21.15.50:0/1023434059 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ad12cb8f60 0x55ad1307a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:22:23.321 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:23.318+0000 7f235f400640 1 -- 172.21.15.50:0/1023434059 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ad12c900a0 msgr2=0x55ad1306e4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:22:23.321 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:23.318+0000 7f235f400640 1 --2- 172.21.15.50:0/1023434059 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ad12c900a0 0x55ad1306e4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:23.321 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:23.318+0000 7f235f400640 1 -- 172.21.15.50:0/1023434059 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ad12cb8f60 msgr2=0x55ad1307a700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:22:23.321 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:23.318+0000 7f235f400640 1 --2- 172.21.15.50:0/1023434059 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ad12cb8f60 0x55ad1307a700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:23.321 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:23.318+0000 7f235f400640 1 -- 172.21.15.50:0/1023434059 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ad12f8c650 con 0x55ad12c98280 2024-08-31T04:22:23.322 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:23.318+0000 7f236d200640 1 --2- 172.21.15.50:0/1023434059 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ad12c900a0 0x55ad1306e4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:22:23.324 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:23.318+0000 7f235f400640 1 --2- 172.21.15.50:0/1023434059 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ad12c98280 0x55ad1306e9f0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f236806c790 tx=0x7f2350032d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f8da44c3a05160b server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:22:23.324 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:23.318+0000 7f2356000640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-08-31T04:22:23.324 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:23.319+0000 7f2356000640 1 -- 172.21.15.50:0/1023434059 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2350035040 con 0x55ad12c98280 2024-08-31T04:22:23.324 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:23.319+0000 7f2356000640 1 -- 172.21.15.50:0/1023434059 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8219+0+0 (secure 0 0 0) 0x7f23500316a0 con 0x55ad12c98280 2024-08-31T04:22:23.324 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:23.319+0000 7f2375e62740 1 -- 172.21.15.50:0/1023434059 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55ad12fd74a0 con 0x55ad12c98280 2024-08-31T04:22:23.324 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:23.319+0000 7f2356000640 1 -- 172.21.15.50:0/1023434059 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f23500318a0 con 0x55ad12c98280 2024-08-31T04:22:23.324 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:23.319+0000 7f2375e62740 10 client.15120 fetch_fsmap learned FSMap version 28 2024-08-31T04:22:23.324 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:23.319+0000 7f2375e62740 1 -- 172.21.15.50:0/1023434059 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55ad1307d1f0 con 0x55ad12c98280 2024-08-31T04:22:23.324 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:23.319+0000 7f2356000640 1 -- 172.21.15.50:0/1023434059 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x55ad12fd74a0 con 0x55ad12c98280 2024-08-31T04:22:23.325 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:23.320+0000 7f2356000640 1 -- 172.21.15.50:0/1023434059 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f2350004750 con 0x55ad12c98280 2024-08-31T04:22:23.325 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:23.320+0000 7f2375e62740 10 client.15120 fetch_fsmap finished waiting for FSMap version 28 2024-08-31T04:22:23.325 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:23.320+0000 7f2375e62740 10 client.15120 resolve_mds: resolved name 'b' to daemon mds.b 2024-08-31T04:22:23.325 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:23.320+0000 7f2375e62740 20 client.15120 populate_metadata read hostname 'smithi050' 2024-08-31T04:22:23.325 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:23.320+0000 7f2375e62740 1 --2- 172.21.15.50:0/1023434059 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x55ad12c778e0 0x55ad13080c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:23.325 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:23.320+0000 7f2375e62740 4 client.15120 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T04:22:23.325 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:23.320+0000 7f2375e62740 1 -- 172.21.15.50:0/1023434059 --> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ad12fd2f40 con 0x55ad12c778e0 2024-08-31T04:22:23.325 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:23.320+0000 7f236d200640 1 --2- 172.21.15.50:0/1023434059 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x55ad12c778e0 0x55ad13080c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:22:23.325 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:23.321+0000 7f236d200640 1 --2- 172.21.15.50:0/1023434059 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x55ad12c778e0 0x55ad13080c40 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4e6de9e0ea751516 server_cookie=763736876cdedb2c in_seq=0 out_seq=0 2024-08-31T04:22:23.325 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:23.321+0000 7f2356000640 10 client.15120 ms_handle_connect on v2:172.21.15.133:6838/2526402262 2024-08-31T04:22:23.325 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:23.322+0000 7f2356000640 1 -- 172.21.15.50:0/1023434059 <== mds.0 v2:172.21.15.133:6838/2526402262 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55ad12fd2f40 con 0x55ad12c778e0 2024-08-31T04:22:23.325 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:23.322+0000 7f2356000640 10 client.15120 handle_command_reply: tid=0 2024-08-31T04:22:23.326 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:23.322+0000 7f2375e62740 1 client.15120 shutdown 2024-08-31T04:22:23.326 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:23.322+0000 7f2375e62740 1 -- 172.21.15.50:0/1023434059 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ad12c98280 msgr2=0x55ad1306e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:22:23.326 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:23.322+0000 7f2375e62740 1 --2- 172.21.15.50:0/1023434059 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ad12c98280 0x55ad1306e9f0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f236806c790 tx=0x7f2350032d50 comp rx=0 tx=0).stop 2024-08-31T04:22:23.326 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:23.322+0000 7f2375e62740 1 -- 172.21.15.50:0/1023434059 shutdown_connections 2024-08-31T04:22:23.326 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:23.322+0000 7f2375e62740 1 --2- 172.21.15.50:0/1023434059 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x55ad12c778e0 0x55ad13080c40 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:23.326 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:23.322+0000 7f2375e62740 1 --2- 172.21.15.50:0/1023434059 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ad12cb8f60 0x55ad1307a700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:23.326 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:23.322+0000 7f2375e62740 1 --2- 172.21.15.50:0/1023434059 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ad12c98280 0x55ad1306e9f0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:23.326 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:23.322+0000 7f2375e62740 1 --2- 172.21.15.50:0/1023434059 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ad12c900a0 0x55ad1306e4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:23.326 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:23.322+0000 7f2375e62740 1 -- 172.21.15.50:0/1023434059 >> 172.21.15.50:0/1023434059 conn(0x55ad12cad350 msgr2=0x55ad130602e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:22:23.326 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:23.322+0000 7f2356000640 0 client.15120 ms_handle_reset on v2:172.21.15.133:6838/2526402262 2024-08-31T04:22:23.326 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:23.322+0000 7f2375e62740 1 -- 172.21.15.50:0/1023434059 shutdown_connections 2024-08-31T04:22:23.326 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:23.323+0000 7f2375e62740 1 -- 172.21.15.50:0/1023434059 wait complete. 2024-08-31T04:22:23.326 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:23.323+0000 7f2375e62740 20 client.15120 trim_cache size 0 max 16384 2024-08-31T04:22:23.343 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:23.342+0000 7f2375e62740 1 Processor -- start 2024-08-31T04:22:23.343 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:23.342+0000 7f2375e62740 1 -- start start 2024-08-31T04:22:23.344 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:23.342+0000 7f2375e62740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ad12c900a0 0x55ad1307a880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:23.344 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:23.342+0000 7f2375e62740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ad12c98280 0x55ad13063960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:23.344 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:23.342+0000 7f2375e62740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ad12cb8f60 0x55ad1306cd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:23.344 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:23.342+0000 7f2375e62740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55ad1307ef80 con 0x55ad12c98280 2024-08-31T04:22:23.344 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:23.342+0000 7f2375e62740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x55ad1307f650 con 0x55ad12c900a0 2024-08-31T04:22:23.344 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:23.342+0000 7f2375e62740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x55ad1307fd20 con 0x55ad12cb8f60 2024-08-31T04:22:23.344 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:23.342+0000 7f235f400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ad12c98280 0x55ad13063960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:22:23.344 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:23.342+0000 7f236d200640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ad12c900a0 0x55ad1307a880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:22:23.345 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:23.342+0000 7f235f400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ad12c98280 0x55ad13063960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:33708/0 (socket says 172.21.15.50:33708) 2024-08-31T04:22:23.345 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:23.342+0000 7f235f400640 1 -- 172.21.15.50:0/2352821202 learned_addr learned my addr 172.21.15.50:0/2352821202 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:22:23.345 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:23.342+0000 7f236d200640 1 --2- 172.21.15.50:0/2352821202 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ad12cb8f60 0x55ad1306cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:22:23.345 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:23.343+0000 7f235f400640 1 -- 172.21.15.50:0/2352821202 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ad12cb8f60 msgr2=0x55ad1306cd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:22:23.345 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:23.343+0000 7f235f400640 1 --2- 172.21.15.50:0/2352821202 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ad12cb8f60 0x55ad1306cd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:23.345 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:23.343+0000 7f235f400640 1 -- 172.21.15.50:0/2352821202 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ad12c900a0 msgr2=0x55ad1307a880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:22:23.345 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:23.343+0000 7f235f400640 1 --2- 172.21.15.50:0/2352821202 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ad12c900a0 0x55ad1307a880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:23.345 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:23.343+0000 7f235f400640 1 -- 172.21.15.50:0/2352821202 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ad1305f730 con 0x55ad12c98280 2024-08-31T04:22:23.346 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:23.343+0000 7f235f400640 1 --2- 172.21.15.50:0/2352821202 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ad12c98280 0x55ad13063960 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f2350006010 tx=0x7f2350001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4c975fd99a03e88 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:22:23.346 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:23.343+0000 7f235cc00640 1 -- 172.21.15.50:0/2352821202 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2350035070 con 0x55ad12c98280 2024-08-31T04:22:23.346 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:23.344+0000 7f235cc00640 1 -- 172.21.15.50:0/2352821202 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f23500316a0 con 0x55ad12c98280 2024-08-31T04:22:23.346 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:23.344+0000 7f235cc00640 1 -- 172.21.15.50:0/2352821202 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2350005370 con 0x55ad12c98280 2024-08-31T04:22:23.346 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:23.344+0000 7f2375e62740 1 -- 172.21.15.50:0/2352821202 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ad12c98280 msgr2=0x55ad13063960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:22:23.347 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:23.344+0000 7f2375e62740 1 --2- 172.21.15.50:0/2352821202 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ad12c98280 0x55ad13063960 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f2350006010 tx=0x7f2350001e70 comp rx=0 tx=0).stop 2024-08-31T04:22:23.347 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:23.344+0000 7f2375e62740 1 -- 172.21.15.50:0/2352821202 shutdown_connections 2024-08-31T04:22:23.347 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:23.344+0000 7f2375e62740 1 --2- 172.21.15.50:0/2352821202 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ad12cb8f60 0x55ad1306cd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:23.347 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:23.344+0000 7f2375e62740 1 --2- 172.21.15.50:0/2352821202 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ad12c98280 0x55ad13063960 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:23.347 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:23.344+0000 7f2375e62740 1 --2- 172.21.15.50:0/2352821202 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ad12c900a0 0x55ad1307a880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:23.347 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:23.344+0000 7f2375e62740 1 -- 172.21.15.50:0/2352821202 >> 172.21.15.50:0/2352821202 conn(0x55ad12cad350 msgr2=0x55ad13064310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:22:23.347 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:23.344+0000 7f2375e62740 1 -- 172.21.15.50:0/2352821202 shutdown_connections 2024-08-31T04:22:23.347 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:23.344+0000 7f2375e62740 1 -- 172.21.15.50:0/2352821202 wait complete. 2024-08-31T04:22:23.347 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:23.345+0000 7f2375e62740 1 -- start start 2024-08-31T04:22:23.347 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:23.345+0000 7f2375e62740 1 Processor -- start 2024-08-31T04:22:23.351 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:23.346+0000 7f2375e62740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ad12c900a0 0x55ad130894c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:23.351 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:23.346+0000 7f2375e62740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ad12c98280 0x55ad13084970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:23.351 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:23.346+0000 7f2375e62740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ad12cb8f60 0x55ad13084eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:23.351 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:23.346+0000 7f2375e62740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55ad13080ac0 con 0x55ad12c98280 2024-08-31T04:22:23.351 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:23.346+0000 7f2375e62740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x55ad130803f0 con 0x55ad12c900a0 2024-08-31T04:22:23.351 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:23.346+0000 7f2375e62740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x55ad13081190 con 0x55ad12cb8f60 2024-08-31T04:22:23.351 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:23.346+0000 7f2375e62740 10 client.0 _ll_register_callbacks cb 0x7f2350005db0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:22:23.351 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:23.346+0000 7f235f400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ad12c98280 0x55ad13084970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:22:23.351 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:23.346+0000 7f235f400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ad12c98280 0x55ad13084970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:33712/0 (socket says 172.21.15.50:33712) 2024-08-31T04:22:23.351 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:23.346+0000 7f236d200640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ad12c900a0 0x55ad130894c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:22:23.352 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:23.346+0000 7f235f400640 1 -- 172.21.15.50:0/3969542221 learned_addr learned my addr 172.21.15.50:0/3969542221 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:22:23.352 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:23.346+0000 7f236d200640 1 --2- 172.21.15.50:0/3969542221 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ad12cb8f60 0x55ad13084eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:22:23.352 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:23.346+0000 7f235f400640 1 -- 172.21.15.50:0/3969542221 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ad12cb8f60 msgr2=0x55ad13084eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:22:23.352 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:23.346+0000 7f235f400640 1 --2- 172.21.15.50:0/3969542221 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ad12cb8f60 0x55ad13084eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:23.352 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:23.346+0000 7f235f400640 1 -- 172.21.15.50:0/3969542221 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ad12c900a0 msgr2=0x55ad130894c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:22:23.352 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:23.346+0000 7f235f400640 1 --2- 172.21.15.50:0/3969542221 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ad12c900a0 0x55ad130894c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:23.352 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:23.346+0000 7f235f400640 1 -- 172.21.15.50:0/3969542221 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ad13085420 con 0x55ad12c98280 2024-08-31T04:22:23.352 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:23.347+0000 7f235f400640 1 --2- 172.21.15.50:0/3969542221 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ad12c98280 0x55ad13084970 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f2350004ba0 tx=0x7f23500044b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=488c9e9cedd204c server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:22:23.352 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:23.347+0000 7f2356000640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-08-31T04:22:23.352 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:23.347+0000 7f2356000640 1 -- 172.21.15.50:0/3969542221 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f235005d020 con 0x55ad12c98280 2024-08-31T04:22:23.352 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:23.347+0000 7f2356000640 1 -- 172.21.15.50:0/3969542221 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8219+0+0 (secure 0 0 0) 0x7f23500050f0 con 0x55ad12c98280 2024-08-31T04:22:23.352 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:23.347+0000 7f2375e62740 1 -- 172.21.15.50:0/3969542221 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f23500316a0 con 0x55ad12c98280 2024-08-31T04:22:23.353 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:23.347+0000 7f2356000640 1 -- 172.21.15.50:0/3969542221 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f2350035070 con 0x55ad12c98280 2024-08-31T04:22:23.353 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:23.347+0000 7f2375e62740 10 client.15126 fetch_fsmap learned FSMap version 28 2024-08-31T04:22:23.353 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:23.347+0000 7f2375e62740 1 -- 172.21.15.50:0/3969542221 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55ad130ebe30 con 0x55ad12c98280 2024-08-31T04:22:23.353 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:23.348+0000 7f2356000640 1 -- 172.21.15.50:0/3969542221 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f23500316a0 con 0x55ad12c98280 2024-08-31T04:22:23.353 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:23.348+0000 7f2356000640 1 -- 172.21.15.50:0/3969542221 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f23500039e0 con 0x55ad12c98280 2024-08-31T04:22:23.353 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:23.348+0000 7f2375e62740 10 client.15126 fetch_fsmap finished waiting for FSMap version 28 2024-08-31T04:22:23.353 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:23.348+0000 7f2375e62740 10 client.15126 resolve_mds: resolved name 'b' to daemon mds.b 2024-08-31T04:22:23.353 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:23.348+0000 7f2375e62740 20 client.15126 populate_metadata read hostname 'smithi050' 2024-08-31T04:22:23.353 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:23.348+0000 7f2375e62740 1 --2- 172.21.15.50:0/3969542221 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x55ad12c4cc90 0x55ad130ef310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:23.353 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:23.348+0000 7f2375e62740 4 client.15126 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "status"}] 2024-08-31T04:22:23.353 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:23.348+0000 7f2375e62740 1 -- 172.21.15.50:0/3969542221 --> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] -- command(tid 0: {"prefix": "status"}) -- 0x55ad12fd0680 con 0x55ad12c4cc90 2024-08-31T04:22:23.353 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:23.348+0000 7f236d200640 1 --2- 172.21.15.50:0/3969542221 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x55ad12c4cc90 0x55ad130ef310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:22:23.353 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:23.349+0000 7f236d200640 1 --2- 172.21.15.50:0/3969542221 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x55ad12c4cc90 0x55ad130ef310 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e0e100082411d31e server_cookie=636afe717d234f88 in_seq=0 out_seq=0 2024-08-31T04:22:23.354 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:23.349+0000 7f2356000640 10 client.15126 ms_handle_connect on v2:172.21.15.133:6838/2526402262 2024-08-31T04:22:23.354 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:23.349+0000 7f2356000640 1 -- 172.21.15.50:0/3969542221 <== mds.0 v2:172.21.15.133:6838/2526402262 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x55ad12fd0680 con 0x55ad12c4cc90 2024-08-31T04:22:23.354 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:23.349+0000 7f2356000640 10 client.15126 handle_command_reply: tid=0 2024-08-31T04:22:23.354 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:23.349+0000 7f2375e62740 1 client.15126 shutdown 2024-08-31T04:22:23.354 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:23.349+0000 7f2375e62740 1 -- 172.21.15.50:0/3969542221 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ad12c98280 msgr2=0x55ad13084970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:22:23.354 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:23.349+0000 7f2375e62740 1 --2- 172.21.15.50:0/3969542221 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ad12c98280 0x55ad13084970 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f2350004ba0 tx=0x7f23500044b0 comp rx=0 tx=0).stop 2024-08-31T04:22:23.354 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:23.349+0000 7f2375e62740 1 -- 172.21.15.50:0/3969542221 shutdown_connections 2024-08-31T04:22:23.354 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:23.349+0000 7f2375e62740 1 --2- 172.21.15.50:0/3969542221 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x55ad12c4cc90 0x55ad130ef310 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:23.354 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:23.349+0000 7f2375e62740 1 --2- 172.21.15.50:0/3969542221 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ad12cb8f60 0x55ad13084eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:23.354 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:23.349+0000 7f2375e62740 1 --2- 172.21.15.50:0/3969542221 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ad12c98280 0x55ad13084970 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:23.354 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:23.349+0000 7f2375e62740 1 --2- 172.21.15.50:0/3969542221 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ad12c900a0 0x55ad130894c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:23.354 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:23.349+0000 7f2356000640 0 client.15126 ms_handle_reset on v2:172.21.15.133:6838/2526402262 2024-08-31T04:22:23.355 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:23.349+0000 7f2375e62740 1 -- 172.21.15.50:0/3969542221 >> 172.21.15.50:0/3969542221 conn(0x55ad12cad350 msgr2=0x55ad1305f920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:22:23.355 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:23.350+0000 7f2375e62740 1 -- 172.21.15.50:0/3969542221 shutdown_connections 2024-08-31T04:22:23.355 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:23.350+0000 7f2375e62740 1 -- 172.21.15.50:0/3969542221 wait complete. 2024-08-31T04:22:23.355 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:23.350+0000 7f2375e62740 20 client.15126 trim_cache size 0 max 16384 2024-08-31T04:22:23.355 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-08-31T04:22:23.355 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_fsid": "058d9fc6-674f-11ef-bcd4-c7b262605968", 2024-08-31T04:22:23.355 INFO:teuthology.orchestra.run.smithi050.stdout: "whoami": 0, 2024-08-31T04:22:23.355 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 24695, 2024-08-31T04:22:23.356 INFO:teuthology.orchestra.run.smithi050.stdout: "want_state": "up:active", 2024-08-31T04:22:23.356 INFO:teuthology.orchestra.run.smithi050.stdout: "state": "up:active", 2024-08-31T04:22:23.356 INFO:teuthology.orchestra.run.smithi050.stdout: "fs_name": "cephfs", 2024-08-31T04:22:23.356 INFO:teuthology.orchestra.run.smithi050.stdout: "rank_uptime": 98.406829127999998, 2024-08-31T04:22:23.356 INFO:teuthology.orchestra.run.smithi050.stdout: "mdsmap_epoch": 28, 2024-08-31T04:22:23.356 INFO:teuthology.orchestra.run.smithi050.stdout: "osdmap_epoch": 78, 2024-08-31T04:22:23.356 INFO:teuthology.orchestra.run.smithi050.stdout: "osdmap_epoch_barrier": 78, 2024-08-31T04:22:23.356 INFO:teuthology.orchestra.run.smithi050.stdout: "uptime": 112.354350573 2024-08-31T04:22:23.356 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-08-31T04:22:23.357 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:23.350+0000 7f236f200640 1 -- 172.21.15.50:0/2589650047 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f234c0b4c40 msgr2=0x7f234c0b7150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:22:23.357 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:23.350+0000 7f236f200640 1 --2- 172.21.15.50:0/2589650047 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f234c0b4c40 0x7f234c0b7150 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f23580ac170 tx=0x7f23580eb530 comp rx=0 tx=0).stop 2024-08-31T04:22:23.357 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:23.350+0000 7f236f200640 1 -- 172.21.15.50:0/2589650047 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2368103900 msgr2=0x7f236819a280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:22:23.357 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:23.350+0000 7f236f200640 1 --2- 172.21.15.50:0/2589650047 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2368103900 0x7f236819a280 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f235800ebc0 tx=0x7f235800c2d0 comp rx=0 tx=0).stop 2024-08-31T04:22:23.357 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:23.350+0000 7f236f200640 1 -- 172.21.15.50:0/2589650047 shutdown_connections 2024-08-31T04:22:23.357 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:23.350+0000 7f236f200640 1 --2- 172.21.15.50:0/2589650047 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f234c0b4c40 0x7f234c0b7150 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:23.357 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:23.350+0000 7f236f200640 1 --2- 172.21.15.50:0/2589650047 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2368109240 0x7f236819a820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:23.357 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:23.350+0000 7f236f200640 1 --2- 172.21.15.50:0/2589650047 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2368109b90 0x7f236819fac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:23.357 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:23.350+0000 7f236f200640 1 --2- 172.21.15.50:0/2589650047 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2368103900 0x7f236819a280 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:23.357 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:23.350+0000 7f236f200640 1 -- 172.21.15.50:0/2589650047 >> 172.21.15.50:0/2589650047 conn(0x7f236807b5f0 msgr2=0x7f2368107340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:22:23.358 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:23.351+0000 7f236f200640 1 -- 172.21.15.50:0/2589650047 shutdown_connections 2024-08-31T04:22:23.358 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:23.351+0000 7f236f200640 1 -- 172.21.15.50:0/2589650047 wait complete. 2024-08-31T04:22:23.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:22:23 smithi177 ceph-mon[22025]: pgmap v351: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2024-08-31T04:22:23.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:22:23 smithi133 ceph-mon[22177]: pgmap v351: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2024-08-31T04:22:23.842 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:22:23 smithi050 ceph-mon[17259]: pgmap v351: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2024-08-31T04:22:24.281 INFO:tasks.cephadm:Setup complete, yielding 2024-08-31T04:22:24.282 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-08-31T04:22:24.292 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi050.front.sepia.ceph.com 2024-08-31T04:22:24.292 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 058d9fc6-674f-11ef-bcd4-c7b262605968 -- bash -c 'ceph orch status' 2024-08-31T04:22:24.671 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:22:25.269 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:25.267+0000 7f88d9a00640 1 -- 172.21.15.50:0/132042282 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f88d4103350 msgr2=0x7f88d41037c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:22:25.269 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:25.267+0000 7f88d9a00640 1 --2- 172.21.15.50:0/132042282 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f88d4103350 0x7f88d41037c0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f88c4009900 tx=0x7f88c402a480 comp rx=0 tx=0).stop 2024-08-31T04:22:25.269 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:25.267+0000 7f88d9a00640 1 -- 172.21.15.50:0/132042282 shutdown_connections 2024-08-31T04:22:25.269 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:25.267+0000 7f88d9a00640 1 --2- 172.21.15.50:0/132042282 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f88d4104d80 0x7f88d410b720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:25.269 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:25.267+0000 7f88d9a00640 1 --2- 172.21.15.50:0/132042282 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f88d41043e0 0x7f88d41047f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:25.269 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:25.267+0000 7f88d9a00640 1 --2- 172.21.15.50:0/132042282 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f88d4103350 0x7f88d41037c0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:25.269 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:25.267+0000 7f88d9a00640 1 -- 172.21.15.50:0/132042282 >> 172.21.15.50:0/132042282 conn(0x7f88d40fecc0 msgr2=0x7f88d4101170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:22:25.270 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:25.267+0000 7f88d9a00640 1 -- 172.21.15.50:0/132042282 shutdown_connections 2024-08-31T04:22:25.270 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:25.267+0000 7f88d9a00640 1 -- 172.21.15.50:0/132042282 wait complete. 2024-08-31T04:22:25.271 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:25.268+0000 7f88d9a00640 1 Processor -- start 2024-08-31T04:22:25.271 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:25.268+0000 7f88d9a00640 1 -- start start 2024-08-31T04:22:25.271 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:25.269+0000 7f88d9a00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f88d4103350 0x7f88d4199ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:25.271 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:25.269+0000 7f88d9a00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f88d41043e0 0x7f88d419a210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:25.271 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:25.269+0000 7f88d9a00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f88d4104d80 0x7f88d419adb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:25.271 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:25.269+0000 7f88d9a00640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f88d410efb0 con 0x7f88d41043e0 2024-08-31T04:22:25.271 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:25.269+0000 7f88d9a00640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f88d410ee30 con 0x7f88d4104d80 2024-08-31T04:22:25.271 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:25.269+0000 7f88d9a00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f88d410f130 con 0x7f88d4103350 2024-08-31T04:22:25.272 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:25.269+0000 7f88d3e00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f88d4103350 0x7f88d4199ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:22:25.272 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:25.269+0000 7f88cb400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f88d41043e0 0x7f88d419a210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:22:25.272 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:25.269+0000 7f88d3e00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f88d4103350 0x7f88d4199ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.50:55588/0 (socket says 172.21.15.50:55588) 2024-08-31T04:22:25.272 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:25.269+0000 7f88d3e00640 1 -- 172.21.15.50:0/453351521 learned_addr learned my addr 172.21.15.50:0/453351521 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:22:25.272 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:25.269+0000 7f88d9000640 1 --2- 172.21.15.50:0/453351521 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f88d4104d80 0x7f88d419adb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:22:25.272 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:25.270+0000 7f88d3e00640 1 -- 172.21.15.50:0/453351521 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f88d4104d80 msgr2=0x7f88d419adb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:22:25.272 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:25.270+0000 7f88d3e00640 1 --2- 172.21.15.50:0/453351521 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f88d4104d80 0x7f88d419adb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:25.272 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:25.270+0000 7f88d3e00640 1 -- 172.21.15.50:0/453351521 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f88d41043e0 msgr2=0x7f88d419a210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:22:25.272 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:25.270+0000 7f88d3e00640 1 --2- 172.21.15.50:0/453351521 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f88d41043e0 0x7f88d419a210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:25.272 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:25.270+0000 7f88d3e00640 1 -- 172.21.15.50:0/453351521 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88d419b5d0 con 0x7f88d4103350 2024-08-31T04:22:25.272 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:25.270+0000 7f88cb400640 1 --2- 172.21.15.50:0/453351521 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f88d41043e0 0x7f88d419a210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:22:25.272 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:25.270+0000 7f88d3e00640 1 --2- 172.21.15.50:0/453351521 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f88d4103350 0x7f88d4199ba0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f88c4006010 tx=0x7f88c4004340 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:22:25.273 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:25.270+0000 7f88d1600640 1 -- 172.21.15.50:0/453351521 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88c403f030 con 0x7f88d4103350 2024-08-31T04:22:25.273 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:25.270+0000 7f88d1600640 1 -- 172.21.15.50:0/453351521 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f88c4003cb0 con 0x7f88d4103350 2024-08-31T04:22:25.273 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:25.270+0000 7f88d9a00640 1 -- 172.21.15.50:0/453351521 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f88d419b860 con 0x7f88d4103350 2024-08-31T04:22:25.273 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:25.270+0000 7f88d1600640 1 -- 172.21.15.50:0/453351521 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88c4035070 con 0x7f88d4103350 2024-08-31T04:22:25.274 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:25.270+0000 7f88d9a00640 1 -- 172.21.15.50:0/453351521 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f88d41a1df0 con 0x7f88d4103350 2024-08-31T04:22:25.274 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:25.271+0000 7f88d9a00640 1 -- 172.21.15.50:0/453351521 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f88d410a530 con 0x7f88d4103350 2024-08-31T04:22:25.275 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:25.274+0000 7f88d1600640 1 -- 172.21.15.50:0/453351521 <== mon.1 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 17) ==== 152628+0+0 (secure 0 0 0) 0x7f88c4042030 con 0x7f88d4103350 2024-08-31T04:22:25.277 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:25.275+0000 7f88d1600640 1 --2- 172.21.15.50:0/453351521 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f88b80b4bc0 0x7f88b80b70d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:25.277 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:25.276+0000 7f88d1600640 1 -- 172.21.15.50:0/453351521 <== mon.1 v2:172.21.15.177:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8219+0+0 (secure 0 0 0) 0x7f88c4105f20 con 0x7f88d4103350 2024-08-31T04:22:25.277 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:25.276+0000 7f88cb400640 1 --2- 172.21.15.50:0/453351521 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f88b80b4bc0 0x7f88b80b70d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:22:25.277 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:25.276+0000 7f88cb400640 1 --2- 172.21.15.50:0/453351521 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f88b80b4bc0 0x7f88b80b70d0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f88bc00bfd0 tx=0x7f88bc00b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:22:25.279 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:25.278+0000 7f88d1600640 1 -- 172.21.15.50:0/453351521 <== mon.1 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f88c4003e60 con 0x7f88d4103350 2024-08-31T04:22:25.493 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:25.492+0000 7f88d9a00640 1 -- 172.21.15.50:0/453351521 --> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] -- mgr_command(tid 0: {"prefix": "orch status", "target": ["mon-mgr", ""]}) -- 0x7f88d40635a0 con 0x7f88b80b4bc0 2024-08-31T04:22:25.494 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:25.493+0000 7f88d1600640 1 -- 172.21.15.50:0/453351521 <== mgr.14150 v2:172.21.15.50:6800/2146686622 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+43 (secure 0 0 0) 0x7f88d40635a0 con 0x7f88b80b4bc0 2024-08-31T04:22:25.494 INFO:teuthology.orchestra.run.smithi050.stdout:Backend: cephadm 2024-08-31T04:22:25.494 INFO:teuthology.orchestra.run.smithi050.stdout:Available: Yes 2024-08-31T04:22:25.494 INFO:teuthology.orchestra.run.smithi050.stdout:Paused: No 2024-08-31T04:22:25.496 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:25.495+0000 7f88d9a00640 1 -- 172.21.15.50:0/453351521 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f88b80b4bc0 msgr2=0x7f88b80b70d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:22:25.497 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:25.495+0000 7f88d9a00640 1 --2- 172.21.15.50:0/453351521 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f88b80b4bc0 0x7f88b80b70d0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f88bc00bfd0 tx=0x7f88bc00b390 comp rx=0 tx=0).stop 2024-08-31T04:22:25.497 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:25.495+0000 7f88d9a00640 1 -- 172.21.15.50:0/453351521 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f88d4103350 msgr2=0x7f88d4199ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:22:25.497 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:25.495+0000 7f88d9a00640 1 --2- 172.21.15.50:0/453351521 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f88d4103350 0x7f88d4199ba0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f88c4006010 tx=0x7f88c4004340 comp rx=0 tx=0).stop 2024-08-31T04:22:25.497 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:25.495+0000 7f88d9a00640 1 -- 172.21.15.50:0/453351521 shutdown_connections 2024-08-31T04:22:25.497 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:25.495+0000 7f88d9a00640 1 --2- 172.21.15.50:0/453351521 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f88b80b4bc0 0x7f88b80b70d0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:25.497 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:25.495+0000 7f88d9a00640 1 --2- 172.21.15.50:0/453351521 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f88d4104d80 0x7f88d419adb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:25.497 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:25.495+0000 7f88d9a00640 1 --2- 172.21.15.50:0/453351521 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f88d41043e0 0x7f88d419a210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:25.497 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:25.495+0000 7f88d9a00640 1 --2- 172.21.15.50:0/453351521 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f88d4103350 0x7f88d4199ba0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:25.497 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:25.495+0000 7f88d9a00640 1 -- 172.21.15.50:0/453351521 >> 172.21.15.50:0/453351521 conn(0x7f88d40fecc0 msgr2=0x7f88d4107700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:22:25.497 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:25.495+0000 7f88d9a00640 1 -- 172.21.15.50:0/453351521 shutdown_connections 2024-08-31T04:22:25.497 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:25.495+0000 7f88d9a00640 1 -- 172.21.15.50:0/453351521 wait complete. 2024-08-31T04:22:25.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:22:25 smithi177 ceph-mon[22025]: pgmap v352: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-08-31T04:22:25.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:22:25 smithi133 ceph-mon[22177]: pgmap v352: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-08-31T04:22:25.902 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:22:25 smithi050 ceph-mon[17259]: pgmap v352: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-08-31T04:22:26.376 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 058d9fc6-674f-11ef-bcd4-c7b262605968 -- bash -c 'ceph orch ps' 2024-08-31T04:22:26.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:22:26 smithi050 ceph-mon[17259]: from='client.25138 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:22:26.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:22:26 smithi177 ceph-mon[22025]: from='client.25138 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:22:26.752 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:22:26.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:22:26 smithi133 ceph-mon[22177]: from='client.25138 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:22:27.382 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:27.380+0000 7f8142200640 1 -- 172.21.15.50:0/1623431681 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f813c104f20 msgr2=0x7f813c10b8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:22:27.382 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:27.380+0000 7f8142200640 1 --2- 172.21.15.50:0/1623431681 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f813c104f20 0x7f813c10b8c0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f8134009ca0 tx=0x7f813402a950 comp rx=0 tx=0).stop 2024-08-31T04:22:27.382 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:27.380+0000 7f8142200640 1 -- 172.21.15.50:0/1623431681 shutdown_connections 2024-08-31T04:22:27.382 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:27.380+0000 7f8142200640 1 --2- 172.21.15.50:0/1623431681 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f813c104580 0x7f813c104990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:27.382 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:27.380+0000 7f8142200640 1 --2- 172.21.15.50:0/1623431681 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f813c104f20 0x7f813c10b8c0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:27.382 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:27.380+0000 7f8142200640 1 --2- 172.21.15.50:0/1623431681 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f813c1034f0 0x7f813c103960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:27.382 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:27.380+0000 7f8142200640 1 -- 172.21.15.50:0/1623431681 >> 172.21.15.50:0/1623431681 conn(0x7f813c0fee60 msgr2=0x7f813c101310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:22:27.382 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:27.380+0000 7f8142200640 1 -- 172.21.15.50:0/1623431681 shutdown_connections 2024-08-31T04:22:27.382 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:27.380+0000 7f8142200640 1 -- 172.21.15.50:0/1623431681 wait complete. 2024-08-31T04:22:27.383 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:27.381+0000 7f8142200640 1 Processor -- start 2024-08-31T04:22:27.383 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:27.382+0000 7f8142200640 1 -- start start 2024-08-31T04:22:27.383 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:27.382+0000 7f8142200640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f813c1034f0 0x7f813c19bed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:27.383 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:27.382+0000 7f8142200640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f813c104580 0x7f813c19c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:27.384 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:27.382+0000 7f8142200640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f813c104f20 0x7f813c19d0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:27.384 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:27.382+0000 7f8142200640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f813c10f110 con 0x7f813c104580 2024-08-31T04:22:27.384 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:27.382+0000 7f8142200640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f813c10ef90 con 0x7f813c1034f0 2024-08-31T04:22:27.384 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:27.382+0000 7f8142200640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f813c10f290 con 0x7f813c104f20 2024-08-31T04:22:27.384 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:27.382+0000 7f8132a00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f813c104580 0x7f813c19c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:22:27.384 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:27.382+0000 7f813b400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f813c1034f0 0x7f813c19bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:22:27.384 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:27.382+0000 7f8132a00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f813c104580 0x7f813c19c540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:33752/0 (socket says 172.21.15.50:33752) 2024-08-31T04:22:27.384 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:27.382+0000 7f8132a00640 1 -- 172.21.15.50:0/202705605 learned_addr learned my addr 172.21.15.50:0/202705605 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:22:27.384 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:27.382+0000 7f813be00640 1 --2- 172.21.15.50:0/202705605 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f813c104f20 0x7f813c19d0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:22:27.385 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:27.383+0000 7f813b400640 1 -- 172.21.15.50:0/202705605 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f813c104f20 msgr2=0x7f813c19d0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:22:27.385 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:27.383+0000 7f813b400640 1 --2- 172.21.15.50:0/202705605 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f813c104f20 0x7f813c19d0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:27.385 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:27.383+0000 7f813b400640 1 -- 172.21.15.50:0/202705605 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f813c104580 msgr2=0x7f813c19c540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:22:27.385 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:27.383+0000 7f813b400640 1 --2- 172.21.15.50:0/202705605 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f813c104580 0x7f813c19c540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:27.385 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:27.383+0000 7f813b400640 1 -- 172.21.15.50:0/202705605 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f813c19d870 con 0x7f813c1034f0 2024-08-31T04:22:27.386 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:27.383+0000 7f813b400640 1 --2- 172.21.15.50:0/202705605 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f813c1034f0 0x7f813c19bed0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f812c00c970 tx=0x7f812c00ce30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:22:27.386 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:27.383+0000 7f8138c00640 1 -- 172.21.15.50:0/202705605 <== mon.2 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f812c007bb0 con 0x7f813c1034f0 2024-08-31T04:22:27.386 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:27.383+0000 7f8142200640 1 -- 172.21.15.50:0/202705605 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f813c19db60 con 0x7f813c1034f0 2024-08-31T04:22:27.386 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:27.383+0000 7f8138c00640 1 -- 172.21.15.50:0/202705605 <== mon.2 v2:172.21.15.133:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f812c007d50 con 0x7f813c1034f0 2024-08-31T04:22:27.386 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:27.383+0000 7f8138c00640 1 -- 172.21.15.50:0/202705605 <== mon.2 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f812c018780 con 0x7f813c1034f0 2024-08-31T04:22:27.386 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:27.383+0000 7f8142200640 1 -- 172.21.15.50:0/202705605 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f813c1a42f0 con 0x7f813c1034f0 2024-08-31T04:22:27.386 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:27.384+0000 7f8142200640 1 -- 172.21.15.50:0/202705605 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f813c1a44c0 con 0x7f813c1034f0 2024-08-31T04:22:27.388 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:27.387+0000 7f8138c00640 1 -- 172.21.15.50:0/202705605 <== mon.2 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 17) ==== 152628+0+0 (secure 0 0 0) 0x7f812c00f450 con 0x7f813c1034f0 2024-08-31T04:22:27.390 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:27.388+0000 7f8138c00640 1 --2- 172.21.15.50:0/202705605 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f81200b4bc0 0x7f81200b70d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:27.390 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:27.389+0000 7f8138c00640 1 -- 172.21.15.50:0/202705605 <== mon.2 v2:172.21.15.133:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8219+0+0 (secure 0 0 0) 0x7f812c0e55a0 con 0x7f813c1034f0 2024-08-31T04:22:27.390 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:27.389+0000 7f8132a00640 1 --2- 172.21.15.50:0/202705605 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f81200b4bc0 0x7f81200b70d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:22:27.390 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:27.389+0000 7f8132a00640 1 --2- 172.21.15.50:0/202705605 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f81200b4bc0 0x7f81200b70d0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f81240095f0 tx=0x7f8124005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:22:27.391 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:27.390+0000 7f8138c00640 1 -- 172.21.15.50:0/202705605 <== mon.2 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f812c014030 con 0x7f813c1034f0 2024-08-31T04:22:27.596 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:27.595+0000 7f8142200640 1 -- 172.21.15.50:0/202705605 --> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f813c076ab0 con 0x7f81200b4bc0 2024-08-31T04:22:27.609 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:27.607+0000 7f8138c00640 1 -- 172.21.15.50:0/202705605 <== mgr.14150 v2:172.21.15.50:6800/2146686622 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+4185 (secure 0 0 0) 0x7f813c076ab0 con 0x7f81200b4bc0 2024-08-31T04:22:27.609 INFO:teuthology.orchestra.run.smithi050.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-08-31T04:22:27.609 INFO:teuthology.orchestra.run.smithi050.stdout:mds.a smithi050 running (119s) 28s ago 118s 84.6M - 19.3.0-4560-gd19e6118 79f4cde5e369 686fff29296f 2024-08-31T04:22:27.609 INFO:teuthology.orchestra.run.smithi050.stdout:mds.b smithi133 running (116s) 47s ago 116s 94.1M - 19.3.0-4560-gd19e6118 79f4cde5e369 577c72e4bd06 2024-08-31T04:22:27.609 INFO:teuthology.orchestra.run.smithi050.stdout:mds.c smithi177 running (2m) 47s ago 2m 85.7M - 19.3.0-4560-gd19e6118 79f4cde5e369 c26f7a754db7 2024-08-31T04:22:27.609 INFO:teuthology.orchestra.run.smithi050.stdout:mds.d smithi050 running (2m) 28s ago 2m 80.5M - 19.3.0-4560-gd19e6118 79f4cde5e369 0ae382b59276 2024-08-31T04:22:27.609 INFO:teuthology.orchestra.run.smithi050.stdout:mds.e smithi133 running (2m) 47s ago 2m 84.4M - 19.3.0-4560-gd19e6118 79f4cde5e369 e5f2accbe9c2 2024-08-31T04:22:27.609 INFO:teuthology.orchestra.run.smithi050.stdout:mds.f smithi177 running (2m) 47s ago 2m 85.0M - 19.3.0-4560-gd19e6118 79f4cde5e369 edeac1f32f75 2024-08-31T04:22:27.609 INFO:teuthology.orchestra.run.smithi050.stdout:mds.g smithi050 running (2m) 28s ago 2m 82.9M - 19.3.0-4560-gd19e6118 79f4cde5e369 73defbf51094 2024-08-31T04:22:27.610 INFO:teuthology.orchestra.run.smithi050.stdout:mds.h smithi133 running (2m) 47s ago 2m 85.5M - 19.3.0-4560-gd19e6118 79f4cde5e369 1a40854abb26 2024-08-31T04:22:27.610 INFO:teuthology.orchestra.run.smithi050.stdout:mds.i smithi177 running (2m) 47s ago 2m 85.7M - 19.3.0-4560-gd19e6118 79f4cde5e369 68b1404a6201 2024-08-31T04:22:27.610 INFO:teuthology.orchestra.run.smithi050.stdout:mds.j smithi050 running (2m) 28s ago 2m 80.4M - 19.3.0-4560-gd19e6118 79f4cde5e369 6b2360acad40 2024-08-31T04:22:27.610 INFO:teuthology.orchestra.run.smithi050.stdout:mds.k smithi133 running (2m) 47s ago 2m 86.8M - 19.3.0-4560-gd19e6118 79f4cde5e369 e1b76e7537b4 2024-08-31T04:22:27.610 INFO:teuthology.orchestra.run.smithi050.stdout:mds.l smithi177 running (2m) 47s ago 2m 84.2M - 19.3.0-4560-gd19e6118 79f4cde5e369 ac04c1d01438 2024-08-31T04:22:27.610 INFO:teuthology.orchestra.run.smithi050.stdout:mgr.x smithi050 *:9283,8765 running (10m) 28s ago 10m 590M - 19.3.0-4560-gd19e6118 79f4cde5e369 01e9fffe4268 2024-08-31T04:22:27.610 INFO:teuthology.orchestra.run.smithi050.stdout:mgr.y smithi133 *:8443,8765 running (8m) 47s ago 8m 523M - 19.3.0-4560-gd19e6118 79f4cde5e369 2f9584956e14 2024-08-31T04:22:27.610 INFO:teuthology.orchestra.run.smithi050.stdout:mgr.z smithi177 *:8443,8765 running (8m) 47s ago 8m 523M - 19.3.0-4560-gd19e6118 79f4cde5e369 c614be5564d8 2024-08-31T04:22:27.610 INFO:teuthology.orchestra.run.smithi050.stdout:mon.a smithi050 running (10m) 28s ago 10m 117M 2048M 19.3.0-4560-gd19e6118 79f4cde5e369 266f494c7418 2024-08-31T04:22:27.610 INFO:teuthology.orchestra.run.smithi050.stdout:mon.b smithi133 running (8m) 47s ago 8m 114M 2048M 19.3.0-4560-gd19e6118 79f4cde5e369 8bce5eda9d5e 2024-08-31T04:22:27.610 INFO:teuthology.orchestra.run.smithi050.stdout:mon.c smithi177 running (8m) 47s ago 8m 110M 2048M 19.3.0-4560-gd19e6118 79f4cde5e369 30c7409d7a61 2024-08-31T04:22:27.610 INFO:teuthology.orchestra.run.smithi050.stdout:osd.0 smithi050 running (7m) 28s ago 7m 112M 4273M 19.3.0-4560-gd19e6118 79f4cde5e369 b6b360e08ce4 2024-08-31T04:22:27.610 INFO:teuthology.orchestra.run.smithi050.stdout:osd.1 smithi133 running (7m) 47s ago 7m 115M 4272M 19.3.0-4560-gd19e6118 79f4cde5e369 31739fc2dfd8 2024-08-31T04:22:27.610 INFO:teuthology.orchestra.run.smithi050.stdout:osd.2 smithi177 running (6m) 47s ago 6m 113M 4271M 19.3.0-4560-gd19e6118 79f4cde5e369 171d35c471dd 2024-08-31T04:22:27.611 INFO:teuthology.orchestra.run.smithi050.stdout:osd.3 smithi050 running (6m) 28s ago 6m 119M 4273M 19.3.0-4560-gd19e6118 79f4cde5e369 4e7e47e9dd12 2024-08-31T04:22:27.611 INFO:teuthology.orchestra.run.smithi050.stdout:osd.4 smithi133 running (5m) 47s ago 5m 110M 4272M 19.3.0-4560-gd19e6118 79f4cde5e369 c0451ab107cf 2024-08-31T04:22:27.611 INFO:teuthology.orchestra.run.smithi050.stdout:osd.5 smithi177 running (5m) 47s ago 5m 114M 4271M 19.3.0-4560-gd19e6118 79f4cde5e369 7c76caf5d9f3 2024-08-31T04:22:27.611 INFO:teuthology.orchestra.run.smithi050.stdout:osd.6 smithi050 running (5m) 28s ago 5m 117M 4273M 19.3.0-4560-gd19e6118 79f4cde5e369 6858ecdc2a71 2024-08-31T04:22:27.611 INFO:teuthology.orchestra.run.smithi050.stdout:osd.7 smithi133 running (4m) 47s ago 4m 110M 4272M 19.3.0-4560-gd19e6118 79f4cde5e369 e97e60099065 2024-08-31T04:22:27.611 INFO:teuthology.orchestra.run.smithi050.stdout:osd.8 smithi177 running (4m) 47s ago 4m 110M 4271M 19.3.0-4560-gd19e6118 79f4cde5e369 79a110aa309e 2024-08-31T04:22:27.611 INFO:teuthology.orchestra.run.smithi050.stdout:osd.9 smithi050 running (3m) 28s ago 3m 118M 4273M 19.3.0-4560-gd19e6118 79f4cde5e369 9465fb723ab4 2024-08-31T04:22:27.611 INFO:teuthology.orchestra.run.smithi050.stdout:osd.10 smithi133 running (3m) 47s ago 3m 110M 4272M 19.3.0-4560-gd19e6118 79f4cde5e369 edd9536e8d45 2024-08-31T04:22:27.611 INFO:teuthology.orchestra.run.smithi050.stdout:osd.11 smithi177 running (2m) 47s ago 2m 118M 4271M 19.3.0-4560-gd19e6118 79f4cde5e369 b137b29927bd 2024-08-31T04:22:27.612 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:27.609+0000 7f8142200640 1 -- 172.21.15.50:0/202705605 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f81200b4bc0 msgr2=0x7f81200b70d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:22:27.612 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:27.609+0000 7f8142200640 1 --2- 172.21.15.50:0/202705605 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f81200b4bc0 0x7f81200b70d0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f81240095f0 tx=0x7f8124005f90 comp rx=0 tx=0).stop 2024-08-31T04:22:27.612 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:27.609+0000 7f8142200640 1 -- 172.21.15.50:0/202705605 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f813c1034f0 msgr2=0x7f813c19bed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:22:27.612 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:27.609+0000 7f8142200640 1 --2- 172.21.15.50:0/202705605 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f813c1034f0 0x7f813c19bed0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f812c00c970 tx=0x7f812c00ce30 comp rx=0 tx=0).stop 2024-08-31T04:22:27.612 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:27.610+0000 7f8142200640 1 -- 172.21.15.50:0/202705605 shutdown_connections 2024-08-31T04:22:27.612 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:27.610+0000 7f8142200640 1 --2- 172.21.15.50:0/202705605 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f81200b4bc0 0x7f81200b70d0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:27.612 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:27.610+0000 7f8142200640 1 --2- 172.21.15.50:0/202705605 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f813c104f20 0x7f813c19d0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:27.612 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:27.610+0000 7f8142200640 1 --2- 172.21.15.50:0/202705605 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f813c104580 0x7f813c19c540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:27.613 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:27.610+0000 7f8142200640 1 --2- 172.21.15.50:0/202705605 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f813c1034f0 0x7f813c19bed0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:27.613 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:27.610+0000 7f8142200640 1 -- 172.21.15.50:0/202705605 >> 172.21.15.50:0/202705605 conn(0x7f813c0fee60 msgr2=0x7f813c075390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:22:27.613 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:27.610+0000 7f8142200640 1 -- 172.21.15.50:0/202705605 shutdown_connections 2024-08-31T04:22:27.613 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:27.610+0000 7f8142200640 1 -- 172.21.15.50:0/202705605 wait complete. 2024-08-31T04:22:27.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:22:27 smithi177 ceph-mon[22025]: pgmap v353: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2024-08-31T04:22:27.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:22:27 smithi133 ceph-mon[22177]: pgmap v353: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2024-08-31T04:22:27.950 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:22:27 smithi050 ceph-mon[17259]: pgmap v353: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2024-08-31T04:22:28.401 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 058d9fc6-674f-11ef-bcd4-c7b262605968 -- bash -c 'ceph orch ls' 2024-08-31T04:22:28.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:22:28 smithi050 ceph-mon[17259]: from='client.25136 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:22:28.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:22:28 smithi133 ceph-mon[22177]: from='client.25136 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:22:28.793 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:22:28.996 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:22:28 smithi177 ceph-mon[22025]: from='client.25136 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:22:29.422 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:29.420+0000 7faa97600640 1 -- 172.21.15.50:0/249311956 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faa90104580 msgr2=0x7faa90104990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:22:29.422 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:29.420+0000 7faa97600640 1 --2- 172.21.15.50:0/249311956 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faa90104580 0x7faa90104990 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7faa7c009900 tx=0x7faa7c02a480 comp rx=0 tx=0).stop 2024-08-31T04:22:29.422 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:29.420+0000 7faa97600640 1 -- 172.21.15.50:0/249311956 shutdown_connections 2024-08-31T04:22:29.422 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:29.420+0000 7faa97600640 1 --2- 172.21.15.50:0/249311956 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7faa90104f20 0x7faa9010b8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:29.422 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:29.420+0000 7faa97600640 1 --2- 172.21.15.50:0/249311956 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faa90104580 0x7faa90104990 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:29.422 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:29.420+0000 7faa97600640 1 --2- 172.21.15.50:0/249311956 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faa901034f0 0x7faa90103960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:29.423 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:29.420+0000 7faa97600640 1 -- 172.21.15.50:0/249311956 >> 172.21.15.50:0/249311956 conn(0x7faa900fee60 msgr2=0x7faa90101310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:22:29.423 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:29.420+0000 7faa97600640 1 -- 172.21.15.50:0/249311956 shutdown_connections 2024-08-31T04:22:29.423 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:29.420+0000 7faa97600640 1 -- 172.21.15.50:0/249311956 wait complete. 2024-08-31T04:22:29.425 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:29.421+0000 7faa97600640 1 Processor -- start 2024-08-31T04:22:29.425 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:29.422+0000 7faa97600640 1 -- start start 2024-08-31T04:22:29.425 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:29.422+0000 7faa97600640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7faa901034f0 0x7faa9019bfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:29.425 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:29.422+0000 7faa97600640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faa90104580 0x7faa9019c620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:29.425 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:29.422+0000 7faa97600640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faa90104f20 0x7faa9019d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:29.425 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:29.422+0000 7faa97600640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7faa9010f170 con 0x7faa90104f20 2024-08-31T04:22:29.425 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:29.422+0000 7faa97600640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7faa9010eff0 con 0x7faa90104580 2024-08-31T04:22:29.425 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:29.422+0000 7faa97600640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7faa9010f2f0 con 0x7faa901034f0 2024-08-31T04:22:29.425 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:29.422+0000 7faa94c00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7faa901034f0 0x7faa9019bfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:22:29.425 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:29.422+0000 7faa94c00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7faa901034f0 0x7faa9019bfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.50:55636/0 (socket says 172.21.15.50:55636) 2024-08-31T04:22:29.426 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:29.422+0000 7faa94c00640 1 -- 172.21.15.50:0/707044610 learned_addr learned my addr 172.21.15.50:0/707044610 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:22:29.426 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:29.422+0000 7faa95600640 1 --2- 172.21.15.50:0/707044610 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faa90104f20 0x7faa9019d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:22:29.426 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:29.422+0000 7faa8fe00640 1 --2- 172.21.15.50:0/707044610 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faa90104580 0x7faa9019c620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:22:29.426 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:29.423+0000 7faa94c00640 1 -- 172.21.15.50:0/707044610 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faa90104580 msgr2=0x7faa9019c620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:22:29.426 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:29.423+0000 7faa94c00640 1 --2- 172.21.15.50:0/707044610 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faa90104580 0x7faa9019c620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:29.426 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:29.423+0000 7faa94c00640 1 -- 172.21.15.50:0/707044610 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faa90104f20 msgr2=0x7faa9019d1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:22:29.426 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:29.423+0000 7faa94c00640 1 --2- 172.21.15.50:0/707044610 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faa90104f20 0x7faa9019d1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:29.426 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:29.423+0000 7faa94c00640 1 -- 172.21.15.50:0/707044610 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa9019d9e0 con 0x7faa901034f0 2024-08-31T04:22:29.426 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:29.423+0000 7faa95600640 1 --2- 172.21.15.50:0/707044610 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faa90104f20 0x7faa9019d1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:22:29.426 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:29.423+0000 7faa94c00640 1 --2- 172.21.15.50:0/707044610 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7faa901034f0 0x7faa9019bfb0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7faa8400e9f0 tx=0x7faa8400eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:22:29.426 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:29.423+0000 7faa8d600640 1 -- 172.21.15.50:0/707044610 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa8400cd80 con 0x7faa901034f0 2024-08-31T04:22:29.427 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:29.423+0000 7faa8d600640 1 -- 172.21.15.50:0/707044610 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7faa840108e0 con 0x7faa901034f0 2024-08-31T04:22:29.427 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:29.423+0000 7faa97600640 1 -- 172.21.15.50:0/707044610 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faa9019dcd0 con 0x7faa901034f0 2024-08-31T04:22:29.427 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:29.423+0000 7faa8d600640 1 -- 172.21.15.50:0/707044610 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa84018980 con 0x7faa901034f0 2024-08-31T04:22:29.427 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:29.424+0000 7faa97600640 1 -- 172.21.15.50:0/707044610 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faa901a43d0 con 0x7faa901034f0 2024-08-31T04:22:29.427 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:29.425+0000 7faa97600640 1 -- 172.21.15.50:0/707044610 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faa901a45a0 con 0x7faa901034f0 2024-08-31T04:22:29.428 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:29.427+0000 7faa8d600640 1 -- 172.21.15.50:0/707044610 <== mon.1 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 18) ==== 152577+0+0 (secure 0 0 0) 0x7faa84010430 con 0x7faa901034f0 2024-08-31T04:22:29.430 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:29.428+0000 7faa8d600640 1 --2- 172.21.15.50:0/707044610 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7faa780b4b30 0x7faa780b7040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:29.430 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:29.429+0000 7faa8d600640 1 -- 172.21.15.50:0/707044610 <== mon.1 v2:172.21.15.177:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8219+0+0 (secure 0 0 0) 0x7faa840e5970 con 0x7faa901034f0 2024-08-31T04:22:29.430 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:29.429+0000 7faa8fe00640 1 --2- 172.21.15.50:0/707044610 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7faa780b4b30 0x7faa780b7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:22:29.430 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:29.429+0000 7faa8fe00640 1 --2- 172.21.15.50:0/707044610 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7faa780b4b30 0x7faa780b7040 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7faa7c004770 tx=0x7faa7c0314a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:22:29.431 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:29.430+0000 7faa8d600640 1 -- 172.21.15.50:0/707044610 <== mon.1 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7faa840ac400 con 0x7faa901034f0 2024-08-31T04:22:29.637 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:29.636+0000 7faa97600640 1 -- 172.21.15.50:0/707044610 --> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] -- mgr_command(tid 0: {"prefix": "orch ls", "target": ["mon-mgr", ""]}) -- 0x7faa90076ab0 con 0x7faa780b4b30 2024-08-31T04:22:29.643 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:29.642+0000 7faa8d600640 1 -- 172.21.15.50:0/707044610 <== mgr.14150 v2:172.21.15.50:6800/2146686622 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+980 (secure 0 0 0) 0x7faa90076ab0 con 0x7faa780b4b30 2024-08-31T04:22:29.643 INFO:teuthology.orchestra.run.smithi050.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2024-08-31T04:22:29.643 INFO:teuthology.orchestra.run.smithi050.stdout:mds.all 12/12 49s ago 2m smithi050=a;smithi050=d;smithi050=g;smithi050=j;smithi133=b;smithi133=e;smithi133=h;smithi133=k;smithi177=c;smithi177=f;smithi177=i;smithi177=l;count:12 2024-08-31T04:22:29.643 INFO:teuthology.orchestra.run.smithi050.stdout:mgr 3/3 49s ago 8m smithi050=x;smithi133=y;smithi177=z;count:3 2024-08-31T04:22:29.644 INFO:teuthology.orchestra.run.smithi050.stdout:mon 3/3 49s ago 8m smithi050:172.21.15.50=a;smithi133:172.21.15.133=b;smithi177:172.21.15.177=c;count:3 2024-08-31T04:22:29.644 INFO:teuthology.orchestra.run.smithi050.stdout:osd 12 49s ago - 2024-08-31T04:22:29.645 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:29.644+0000 7faa97600640 1 -- 172.21.15.50:0/707044610 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7faa780b4b30 msgr2=0x7faa780b7040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:22:29.646 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:29.644+0000 7faa97600640 1 --2- 172.21.15.50:0/707044610 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7faa780b4b30 0x7faa780b7040 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7faa7c004770 tx=0x7faa7c0314a0 comp rx=0 tx=0).stop 2024-08-31T04:22:29.646 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:29.644+0000 7faa97600640 1 -- 172.21.15.50:0/707044610 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7faa901034f0 msgr2=0x7faa9019bfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:22:29.646 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:29.644+0000 7faa97600640 1 --2- 172.21.15.50:0/707044610 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7faa901034f0 0x7faa9019bfb0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7faa8400e9f0 tx=0x7faa8400eeb0 comp rx=0 tx=0).stop 2024-08-31T04:22:29.646 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:29.644+0000 7faa97600640 1 -- 172.21.15.50:0/707044610 shutdown_connections 2024-08-31T04:22:29.646 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:29.644+0000 7faa97600640 1 --2- 172.21.15.50:0/707044610 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7faa780b4b30 0x7faa780b7040 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:29.646 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:29.644+0000 7faa97600640 1 --2- 172.21.15.50:0/707044610 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faa90104f20 0x7faa9019d1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:29.646 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:29.644+0000 7faa97600640 1 --2- 172.21.15.50:0/707044610 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faa90104580 0x7faa9019c620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:29.646 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:29.644+0000 7faa97600640 1 --2- 172.21.15.50:0/707044610 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7faa901034f0 0x7faa9019bfb0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:29.646 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:29.644+0000 7faa97600640 1 -- 172.21.15.50:0/707044610 >> 172.21.15.50:0/707044610 conn(0x7faa900fee60 msgr2=0x7faa90075390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:22:29.646 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:29.644+0000 7faa97600640 1 -- 172.21.15.50:0/707044610 shutdown_connections 2024-08-31T04:22:29.646 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:29.644+0000 7faa97600640 1 -- 172.21.15.50:0/707044610 wait complete. 2024-08-31T04:22:29.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:22:29 smithi133 ceph-mon[22177]: pgmap v354: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 85 B/s wr, 10 op/s 2024-08-31T04:22:29.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:22:29 smithi133 ceph-mon[22177]: mgrmap e18: x(active, since 9m), standbys: z, y 2024-08-31T04:22:29.950 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:22:29 smithi050 ceph-mon[17259]: pgmap v354: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 85 B/s wr, 10 op/s 2024-08-31T04:22:29.950 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:22:29 smithi050 ceph-mon[17259]: mgrmap e18: x(active, since 9m), standbys: z, y 2024-08-31T04:22:29.996 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:22:29 smithi177 ceph-mon[22025]: pgmap v354: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 85 B/s wr, 10 op/s 2024-08-31T04:22:29.996 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:22:29 smithi177 ceph-mon[22025]: mgrmap e18: x(active, since 9m), standbys: z, y 2024-08-31T04:22:30.453 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 058d9fc6-674f-11ef-bcd4-c7b262605968 -- bash -c 'ceph orch host ls' 2024-08-31T04:22:30.833 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:22:31.492 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:31.489+0000 7f02b7e00640 1 -- 172.21.15.50:0/698268123 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f02b8104d80 msgr2=0x7f02b810b720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:22:31.492 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:31.489+0000 7f02b7e00640 1 --2- 172.21.15.50:0/698268123 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f02b8104d80 0x7f02b810b720 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f02b0009ca0 tx=0x7f02b002a950 comp rx=0 tx=0).stop 2024-08-31T04:22:31.493 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:31.489+0000 7f02b7e00640 1 -- 172.21.15.50:0/698268123 shutdown_connections 2024-08-31T04:22:31.493 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:31.489+0000 7f02b7e00640 1 --2- 172.21.15.50:0/698268123 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f02b81043e0 0x7f02b81047f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:31.493 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:31.489+0000 7f02b7e00640 1 --2- 172.21.15.50:0/698268123 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f02b8104d80 0x7f02b810b720 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:31.493 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:31.489+0000 7f02b7e00640 1 --2- 172.21.15.50:0/698268123 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f02b8103350 0x7f02b81037c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:31.493 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:31.490+0000 7f02b7e00640 1 -- 172.21.15.50:0/698268123 >> 172.21.15.50:0/698268123 conn(0x7f02b80fecc0 msgr2=0x7f02b8101170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:22:31.493 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:31.490+0000 7f02b7e00640 1 -- 172.21.15.50:0/698268123 shutdown_connections 2024-08-31T04:22:31.493 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:31.490+0000 7f02b7e00640 1 -- 172.21.15.50:0/698268123 wait complete. 2024-08-31T04:22:31.494 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:31.491+0000 7f02b7e00640 1 Processor -- start 2024-08-31T04:22:31.494 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:31.491+0000 7f02b7e00640 1 -- start start 2024-08-31T04:22:31.494 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:31.491+0000 7f02b7e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f02b8103350 0x7f02b8199b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:31.494 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:31.491+0000 7f02b7e00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f02b81043e0 0x7f02b819a1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:31.495 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:31.491+0000 7f02b7e00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f02b8104d80 0x7f02b819ad60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:31.495 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:31.491+0000 7f02b7e00640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f02b810efb0 con 0x7f02b8103350 2024-08-31T04:22:31.495 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:31.491+0000 7f02b7e00640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f02b810ee30 con 0x7f02b8104d80 2024-08-31T04:22:31.495 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:31.491+0000 7f02b7e00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f02b810f130 con 0x7f02b81043e0 2024-08-31T04:22:31.495 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:31.491+0000 7f02b6a00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f02b8103350 0x7f02b8199b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:22:31.495 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:31.491+0000 7f02b6a00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f02b8103350 0x7f02b8199b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:33782/0 (socket says 172.21.15.50:33782) 2024-08-31T04:22:31.495 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:31.491+0000 7f02b6a00640 1 -- 172.21.15.50:0/2652285988 learned_addr learned my addr 172.21.15.50:0/2652285988 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:22:31.495 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:31.492+0000 7f02b6000640 1 --2- 172.21.15.50:0/2652285988 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f02b81043e0 0x7f02b819a1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:22:31.495 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:31.492+0000 7f02b7400640 1 --2- 172.21.15.50:0/2652285988 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f02b8104d80 0x7f02b819ad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:22:31.495 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:31.492+0000 7f02b6a00640 1 -- 172.21.15.50:0/2652285988 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f02b81043e0 msgr2=0x7f02b819a1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:22:31.495 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:31.492+0000 7f02b6a00640 1 --2- 172.21.15.50:0/2652285988 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f02b81043e0 0x7f02b819a1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:31.495 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:31.492+0000 7f02b6a00640 1 -- 172.21.15.50:0/2652285988 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f02b8104d80 msgr2=0x7f02b819ad60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:22:31.495 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:31.492+0000 7f02b6a00640 1 --2- 172.21.15.50:0/2652285988 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f02b8104d80 0x7f02b819ad60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:31.496 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:31.492+0000 7f02b6a00640 1 -- 172.21.15.50:0/2652285988 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02b819b580 con 0x7f02b8103350 2024-08-31T04:22:31.496 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:31.492+0000 7f02b6a00640 1 --2- 172.21.15.50:0/2652285988 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f02b8103350 0x7f02b8199b50 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f02a800e9f0 tx=0x7f02a800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:22:31.496 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:31.493+0000 7f02af400640 1 -- 172.21.15.50:0/2652285988 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02a800cd80 con 0x7f02b8103350 2024-08-31T04:22:31.496 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:31.493+0000 7f02af400640 1 -- 172.21.15.50:0/2652285988 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f02a80108e0 con 0x7f02b8103350 2024-08-31T04:22:31.497 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:31.493+0000 7f02af400640 1 -- 172.21.15.50:0/2652285988 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02a8018980 con 0x7f02b8103350 2024-08-31T04:22:31.497 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:31.493+0000 7f02b7e00640 1 -- 172.21.15.50:0/2652285988 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f02b819b870 con 0x7f02b8103350 2024-08-31T04:22:31.497 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:31.493+0000 7f02b7e00640 1 -- 172.21.15.50:0/2652285988 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f02b81a1f70 con 0x7f02b8103350 2024-08-31T04:22:31.497 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:31.494+0000 7f02b7e00640 1 -- 172.21.15.50:0/2652285988 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f02b81037c0 con 0x7f02b8103350 2024-08-31T04:22:31.498 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:31.496+0000 7f02af400640 1 -- 172.21.15.50:0/2652285988 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 18) ==== 152577+0+0 (secure 0 0 0) 0x7f02a8010430 con 0x7f02b8103350 2024-08-31T04:22:31.500 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:31.498+0000 7f02af400640 1 --2- 172.21.15.50:0/2652285988 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f029c0b4b30 0x7f029c0b7040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:31.500 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:31.498+0000 7f02af400640 1 -- 172.21.15.50:0/2652285988 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8219+0+0 (secure 0 0 0) 0x7f02a80e5490 con 0x7f02b8103350 2024-08-31T04:22:31.500 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:31.498+0000 7f02b6000640 1 --2- 172.21.15.50:0/2652285988 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f029c0b4b30 0x7f029c0b7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:22:31.500 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:31.498+0000 7f02b6000640 1 --2- 172.21.15.50:0/2652285988 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f029c0b4b30 0x7f029c0b7040 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f02a4009bd0 tx=0x7f02a4005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:22:31.504 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:31.501+0000 7f02af400640 1 -- 172.21.15.50:0/2652285988 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f02a80abf20 con 0x7f02b8103350 2024-08-31T04:22:31.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:22:31 smithi050 ceph-mon[17259]: from='client.25150 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:22:31.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:22:31 smithi050 ceph-mon[17259]: pgmap v355: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 170 B/s wr, 8 op/s 2024-08-31T04:22:31.709 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:31.707+0000 7f02b7e00640 1 -- 172.21.15.50:0/2652285988 --> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""]}) -- 0x7f02b80635a0 con 0x7f029c0b4b30 2024-08-31T04:22:31.711 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:31.709+0000 7f02af400640 1 -- 172.21.15.50:0/2652285988 <== mgr.14150 v2:172.21.15.50:6800/2146686622 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+191 (secure 0 0 0) 0x7f02b80635a0 con 0x7f029c0b4b30 2024-08-31T04:22:31.711 INFO:teuthology.orchestra.run.smithi050.stdout:HOST ADDR LABELS STATUS 2024-08-31T04:22:31.711 INFO:teuthology.orchestra.run.smithi050.stdout:smithi050 172.21.15.50 2024-08-31T04:22:31.712 INFO:teuthology.orchestra.run.smithi050.stdout:smithi133 172.21.15.133 2024-08-31T04:22:31.712 INFO:teuthology.orchestra.run.smithi050.stdout:smithi177 172.21.15.177 2024-08-31T04:22:31.712 INFO:teuthology.orchestra.run.smithi050.stdout:3 hosts in cluster 2024-08-31T04:22:31.713 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:31.711+0000 7f02b7e00640 1 -- 172.21.15.50:0/2652285988 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f029c0b4b30 msgr2=0x7f029c0b7040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:22:31.713 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:31.711+0000 7f02b7e00640 1 --2- 172.21.15.50:0/2652285988 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f029c0b4b30 0x7f029c0b7040 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f02a4009bd0 tx=0x7f02a4005f90 comp rx=0 tx=0).stop 2024-08-31T04:22:31.713 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:31.711+0000 7f02b7e00640 1 -- 172.21.15.50:0/2652285988 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f02b8103350 msgr2=0x7f02b8199b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:22:31.714 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:31.711+0000 7f02b7e00640 1 --2- 172.21.15.50:0/2652285988 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f02b8103350 0x7f02b8199b50 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f02a800e9f0 tx=0x7f02a800eeb0 comp rx=0 tx=0).stop 2024-08-31T04:22:31.714 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:31.711+0000 7f02b7e00640 1 -- 172.21.15.50:0/2652285988 shutdown_connections 2024-08-31T04:22:31.714 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:31.711+0000 7f02b7e00640 1 --2- 172.21.15.50:0/2652285988 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f029c0b4b30 0x7f029c0b7040 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:31.714 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:31.711+0000 7f02b7e00640 1 --2- 172.21.15.50:0/2652285988 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f02b81043e0 0x7f02b819a1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:31.714 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:31.711+0000 7f02b7e00640 1 --2- 172.21.15.50:0/2652285988 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f02b8104d80 0x7f02b819ad60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:31.714 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:31.711+0000 7f02b7e00640 1 --2- 172.21.15.50:0/2652285988 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f02b8103350 0x7f02b8199b50 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:31.714 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:31.711+0000 7f02b7e00640 1 -- 172.21.15.50:0/2652285988 >> 172.21.15.50:0/2652285988 conn(0x7f02b80fecc0 msgr2=0x7f02b81076e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:22:31.714 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:31.711+0000 7f02b7e00640 1 -- 172.21.15.50:0/2652285988 shutdown_connections 2024-08-31T04:22:31.714 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:31.711+0000 7f02b7e00640 1 -- 172.21.15.50:0/2652285988 wait complete. 2024-08-31T04:22:31.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:22:31 smithi133 ceph-mon[22177]: from='client.25150 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:22:31.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:22:31 smithi133 ceph-mon[22177]: pgmap v355: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 170 B/s wr, 8 op/s 2024-08-31T04:22:31.995 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:22:31 smithi177 ceph-mon[22025]: from='client.25150 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:22:31.996 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:22:31 smithi177 ceph-mon[22025]: pgmap v355: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 170 B/s wr, 8 op/s 2024-08-31T04:22:32.543 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 058d9fc6-674f-11ef-bcd4-c7b262605968 -- bash -c 'ceph orch device ls' 2024-08-31T04:22:32.924 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:22:33.563 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:33.560+0000 7f3e89000640 1 -- 172.21.15.50:0/322939587 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3e84104d80 msgr2=0x7f3e8410b720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:22:33.563 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:33.560+0000 7f3e89000640 1 --2- 172.21.15.50:0/322939587 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3e84104d80 0x7f3e8410b720 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f3e7c009ca0 tx=0x7f3e7c02a950 comp rx=0 tx=0).stop 2024-08-31T04:22:33.563 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:33.560+0000 7f3e89000640 1 -- 172.21.15.50:0/322939587 shutdown_connections 2024-08-31T04:22:33.563 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:33.560+0000 7f3e89000640 1 --2- 172.21.15.50:0/322939587 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3e841043e0 0x7f3e841047f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:33.563 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:33.560+0000 7f3e89000640 1 --2- 172.21.15.50:0/322939587 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3e84104d80 0x7f3e8410b720 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:33.564 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:33.560+0000 7f3e89000640 1 --2- 172.21.15.50:0/322939587 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3e84103350 0x7f3e841037c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:33.564 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:33.560+0000 7f3e89000640 1 -- 172.21.15.50:0/322939587 >> 172.21.15.50:0/322939587 conn(0x7f3e840fecc0 msgr2=0x7f3e84101170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:22:33.564 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:33.561+0000 7f3e89000640 1 -- 172.21.15.50:0/322939587 shutdown_connections 2024-08-31T04:22:33.564 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:33.561+0000 7f3e89000640 1 -- 172.21.15.50:0/322939587 wait complete. 2024-08-31T04:22:33.565 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:33.562+0000 7f3e89000640 1 Processor -- start 2024-08-31T04:22:33.565 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:33.562+0000 7f3e89000640 1 -- start start 2024-08-31T04:22:33.565 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:33.562+0000 7f3e89000640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3e84103350 0x7f3e84076be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:33.565 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:33.562+0000 7f3e89000640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3e841043e0 0x7f3e840754b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:33.565 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:33.562+0000 7f3e89000640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3e84104d80 0x7f3e840759f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:33.565 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:33.562+0000 7f3e89000640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f3e8410efb0 con 0x7f3e84104d80 2024-08-31T04:22:33.566 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:33.562+0000 7f3e89000640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f3e8410ee30 con 0x7f3e841043e0 2024-08-31T04:22:33.566 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:33.562+0000 7f3e89000640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f3e8410f130 con 0x7f3e84103350 2024-08-31T04:22:33.566 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:33.562+0000 7f3e83400640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3e84103350 0x7f3e84076be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:22:33.566 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:33.562+0000 7f3e83400640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3e84103350 0x7f3e84076be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.50:39920/0 (socket says 172.21.15.50:39920) 2024-08-31T04:22:33.566 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:33.562+0000 7f3e83400640 1 -- 172.21.15.50:0/324343125 learned_addr learned my addr 172.21.15.50:0/324343125 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:22:33.566 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:33.562+0000 7f3e82a00640 1 --2- 172.21.15.50:0/324343125 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3e841043e0 0x7f3e840754b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:22:33.566 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:33.562+0000 7f3e83e00640 1 --2- 172.21.15.50:0/324343125 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3e84104d80 0x7f3e840759f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:22:33.566 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:33.563+0000 7f3e83400640 1 -- 172.21.15.50:0/324343125 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3e841043e0 msgr2=0x7f3e840754b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:22:33.566 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:33.563+0000 7f3e83400640 1 --2- 172.21.15.50:0/324343125 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3e841043e0 0x7f3e840754b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:33.566 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:33.563+0000 7f3e83400640 1 -- 172.21.15.50:0/324343125 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3e84104d80 msgr2=0x7f3e840759f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:22:33.566 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:33.563+0000 7f3e83400640 1 --2- 172.21.15.50:0/324343125 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3e84104d80 0x7f3e840759f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:33.566 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:33.563+0000 7f3e83400640 1 -- 172.21.15.50:0/324343125 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e840760f0 con 0x7f3e84103350 2024-08-31T04:22:33.566 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:33.563+0000 7f3e83400640 1 --2- 172.21.15.50:0/324343125 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3e84103350 0x7f3e84076be0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f3e7400e9f0 tx=0x7f3e7400eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:22:33.567 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:33.563+0000 7f3e7be00640 1 -- 172.21.15.50:0/324343125 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e7400cd80 con 0x7f3e84103350 2024-08-31T04:22:33.567 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:33.563+0000 7f3e7be00640 1 -- 172.21.15.50:0/324343125 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3e740108e0 con 0x7f3e84103350 2024-08-31T04:22:33.567 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:33.563+0000 7f3e89000640 1 -- 172.21.15.50:0/324343125 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3e841a3bc0 con 0x7f3e84103350 2024-08-31T04:22:33.567 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:33.564+0000 7f3e7be00640 1 -- 172.21.15.50:0/324343125 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e74018980 con 0x7f3e84103350 2024-08-31T04:22:33.567 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:33.564+0000 7f3e89000640 1 -- 172.21.15.50:0/324343125 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3e841a4020 con 0x7f3e84103350 2024-08-31T04:22:33.567 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:33.565+0000 7f3e89000640 1 -- 172.21.15.50:0/324343125 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3e8410a510 con 0x7f3e84103350 2024-08-31T04:22:33.569 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:33.567+0000 7f3e7be00640 1 -- 172.21.15.50:0/324343125 <== mon.1 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 18) ==== 152577+0+0 (secure 0 0 0) 0x7f3e74010430 con 0x7f3e84103350 2024-08-31T04:22:33.570 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:33.568+0000 7f3e7be00640 1 --2- 172.21.15.50:0/324343125 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f3e680b4b30 0x7f3e680b7040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:33.571 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:33.568+0000 7f3e7be00640 1 -- 172.21.15.50:0/324343125 <== mon.1 v2:172.21.15.177:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8219+0+0 (secure 0 0 0) 0x7f3e740e5710 con 0x7f3e84103350 2024-08-31T04:22:33.571 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:33.568+0000 7f3e82a00640 1 --2- 172.21.15.50:0/324343125 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f3e680b4b30 0x7f3e680b7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:22:33.571 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:33.569+0000 7f3e82a00640 1 --2- 172.21.15.50:0/324343125 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f3e680b4b30 0x7f3e680b7040 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f3e7000bbe0 tx=0x7f3e7000b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:22:33.572 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:33.570+0000 7f3e7be00640 1 -- 172.21.15.50:0/324343125 <== mon.1 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f3e740ac1a0 con 0x7f3e84103350 2024-08-31T04:22:33.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:22:33 smithi050 ceph-mon[17259]: from='client.15147 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:22:33.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:22:33 smithi050 ceph-mon[17259]: pgmap v356: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 767 B/s wr, 12 op/s 2024-08-31T04:22:33.775 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:33.772+0000 7f3e89000640 1 -- 172.21.15.50:0/324343125 --> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] -- mgr_command(tid 0: {"prefix": "orch device ls", "target": ["mon-mgr", ""]}) -- 0x7f3e840635a0 con 0x7f3e680b4b30 2024-08-31T04:22:33.776 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:33.774+0000 7f3e7be00640 1 -- 172.21.15.50:0/324343125 <== mgr.14150 v2:172.21.15.50:6800/2146686622 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+532 (secure 0 0 0) 0x7f3e840635a0 con 0x7f3e680b4b30 2024-08-31T04:22:33.777 INFO:teuthology.orchestra.run.smithi050.stdout:HOST PATH TYPE DEVICE ID SIZE AVAILABLE REFRESHED REJECT REASONS 2024-08-31T04:22:33.777 INFO:teuthology.orchestra.run.smithi050.stdout:smithi050 /dev/nvme0n1 ssd INTEL_SSDPED1D480GA_PHMB7513001F480DGN 447G No 3m ago Has a FileSystem, LVM detected 2024-08-31T04:22:33.777 INFO:teuthology.orchestra.run.smithi050.stdout:smithi133 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_PHFT620401AQ400BGN 372G No 3m ago Has a FileSystem, LVM detected 2024-08-31T04:22:33.777 INFO:teuthology.orchestra.run.smithi050.stdout:smithi177 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_CVFT6233007S400BGN 372G No 2m ago Has a FileSystem, LVM detected 2024-08-31T04:22:33.779 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:33.777+0000 7f3e89000640 1 -- 172.21.15.50:0/324343125 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f3e680b4b30 msgr2=0x7f3e680b7040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:22:33.779 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:33.777+0000 7f3e89000640 1 --2- 172.21.15.50:0/324343125 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f3e680b4b30 0x7f3e680b7040 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f3e7000bbe0 tx=0x7f3e7000b390 comp rx=0 tx=0).stop 2024-08-31T04:22:33.779 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:33.777+0000 7f3e89000640 1 -- 172.21.15.50:0/324343125 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3e84103350 msgr2=0x7f3e84076be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:22:33.779 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:33.777+0000 7f3e89000640 1 --2- 172.21.15.50:0/324343125 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3e84103350 0x7f3e84076be0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f3e7400e9f0 tx=0x7f3e7400eeb0 comp rx=0 tx=0).stop 2024-08-31T04:22:33.780 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:33.777+0000 7f3e89000640 1 -- 172.21.15.50:0/324343125 shutdown_connections 2024-08-31T04:22:33.780 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:33.777+0000 7f3e89000640 1 --2- 172.21.15.50:0/324343125 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f3e680b4b30 0x7f3e680b7040 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:33.780 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:33.777+0000 7f3e89000640 1 --2- 172.21.15.50:0/324343125 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3e84104d80 0x7f3e840759f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:33.780 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:33.777+0000 7f3e89000640 1 --2- 172.21.15.50:0/324343125 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3e841043e0 0x7f3e840754b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:33.780 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:33.777+0000 7f3e89000640 1 --2- 172.21.15.50:0/324343125 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3e84103350 0x7f3e84076be0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:33.780 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:33.777+0000 7f3e89000640 1 -- 172.21.15.50:0/324343125 >> 172.21.15.50:0/324343125 conn(0x7f3e840fecc0 msgr2=0x7f3e841076e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:22:33.780 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:33.777+0000 7f3e89000640 1 -- 172.21.15.50:0/324343125 shutdown_connections 2024-08-31T04:22:33.780 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:33.777+0000 7f3e89000640 1 -- 172.21.15.50:0/324343125 wait complete. 2024-08-31T04:22:33.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:22:33 smithi133 ceph-mon[22177]: from='client.15147 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:22:33.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:22:33 smithi133 ceph-mon[22177]: pgmap v356: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 767 B/s wr, 12 op/s 2024-08-31T04:22:33.996 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:22:33 smithi177 ceph-mon[22025]: from='client.15147 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:22:33.996 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:22:33 smithi177 ceph-mon[22025]: pgmap v356: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 767 B/s wr, 12 op/s 2024-08-31T04:22:34.617 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-08-31T04:22:34.626 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi050.front.sepia.ceph.com 2024-08-31T04:22:34.626 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 058d9fc6-674f-11ef-bcd4-c7b262605968 -- bash -c 'ceph fs dump' 2024-08-31T04:22:35.008 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:22:35.653 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:35.650+0000 7f3c1fe00640 1 -- 172.21.15.50:0/1424898147 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3c20103350 msgr2=0x7f3c201037c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:22:35.653 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:35.650+0000 7f3c1fe00640 1 --2- 172.21.15.50:0/1424898147 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3c20103350 0x7f3c201037c0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f3c10009900 tx=0x7f3c1002a480 comp rx=0 tx=0).stop 2024-08-31T04:22:35.653 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:35.650+0000 7f3c1fe00640 1 -- 172.21.15.50:0/1424898147 shutdown_connections 2024-08-31T04:22:35.653 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:35.650+0000 7f3c1fe00640 1 --2- 172.21.15.50:0/1424898147 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3c201043e0 0x7f3c201047f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:35.653 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:35.650+0000 7f3c1fe00640 1 --2- 172.21.15.50:0/1424898147 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3c20104d80 0x7f3c2010b720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:35.653 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:35.650+0000 7f3c1fe00640 1 --2- 172.21.15.50:0/1424898147 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3c20103350 0x7f3c201037c0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:35.653 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:35.650+0000 7f3c1fe00640 1 -- 172.21.15.50:0/1424898147 >> 172.21.15.50:0/1424898147 conn(0x7f3c200fecc0 msgr2=0x7f3c20101170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:22:35.653 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:35.650+0000 7f3c1fe00640 1 -- 172.21.15.50:0/1424898147 shutdown_connections 2024-08-31T04:22:35.653 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:35.650+0000 7f3c1fe00640 1 -- 172.21.15.50:0/1424898147 wait complete. 2024-08-31T04:22:35.655 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:35.651+0000 7f3c1fe00640 1 Processor -- start 2024-08-31T04:22:35.655 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:35.651+0000 7f3c1fe00640 1 -- start start 2024-08-31T04:22:35.655 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:35.652+0000 7f3c1fe00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3c20103350 0x7f3c2019bda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:35.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:35.652+0000 7f3c1fe00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3c201043e0 0x7f3c2019c410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:35.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:35.652+0000 7f3c1fe00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3c20104d80 0x7f3c2019cfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:35.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:35.652+0000 7f3c1fe00640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f3c2010efb0 con 0x7f3c20104d80 2024-08-31T04:22:35.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:35.652+0000 7f3c1fe00640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f3c2010ee30 con 0x7f3c20103350 2024-08-31T04:22:35.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:35.652+0000 7f3c1fe00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f3c2010f130 con 0x7f3c201043e0 2024-08-31T04:22:35.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:35.652+0000 7f3c1f400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3c20104d80 0x7f3c2019cfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:22:35.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:35.652+0000 7f3c1f400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3c20104d80 0x7f3c2019cfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:37732/0 (socket says 172.21.15.50:37732) 2024-08-31T04:22:35.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:35.652+0000 7f3c1f400640 1 -- 172.21.15.50:0/4038485404 learned_addr learned my addr 172.21.15.50:0/4038485404 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:22:35.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:35.652+0000 7f3c1ea00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3c20103350 0x7f3c2019bda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:22:35.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:35.652+0000 7f3c17e00640 1 --2- 172.21.15.50:0/4038485404 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3c201043e0 0x7f3c2019c410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:22:35.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:35.652+0000 7f3c17e00640 1 -- 172.21.15.50:0/4038485404 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3c20103350 msgr2=0x7f3c2019bda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:22:35.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:35.652+0000 7f3c17e00640 1 --2- 172.21.15.50:0/4038485404 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3c20103350 0x7f3c2019bda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:35.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:35.652+0000 7f3c17e00640 1 -- 172.21.15.50:0/4038485404 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3c20104d80 msgr2=0x7f3c2019cfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:22:35.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:35.652+0000 7f3c17e00640 1 --2- 172.21.15.50:0/4038485404 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3c20104d80 0x7f3c2019cfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:35.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:35.652+0000 7f3c17e00640 1 -- 172.21.15.50:0/4038485404 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c2019d7d0 con 0x7f3c201043e0 2024-08-31T04:22:35.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:35.652+0000 7f3c1f400640 1 --2- 172.21.15.50:0/4038485404 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3c20104d80 0x7f3c2019cfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:22:35.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:35.653+0000 7f3c17e00640 1 --2- 172.21.15.50:0/4038485404 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3c201043e0 0x7f3c2019c410 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f3c0800e9f0 tx=0x7f3c0800eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:22:35.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:35.653+0000 7f3c17400640 1 -- 172.21.15.50:0/4038485404 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c0800ccc0 con 0x7f3c201043e0 2024-08-31T04:22:35.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:35.653+0000 7f3c17400640 1 -- 172.21.15.50:0/4038485404 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3c080108e0 con 0x7f3c201043e0 2024-08-31T04:22:35.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:35.653+0000 7f3c1fe00640 1 -- 172.21.15.50:0/4038485404 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3c2019dac0 con 0x7f3c201043e0 2024-08-31T04:22:35.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:35.653+0000 7f3c17400640 1 -- 172.21.15.50:0/4038485404 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c08018880 con 0x7f3c201043e0 2024-08-31T04:22:35.658 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:35.653+0000 7f3c1fe00640 1 -- 172.21.15.50:0/4038485404 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3c201a41c0 con 0x7f3c201043e0 2024-08-31T04:22:35.658 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:35.654+0000 7f3c1fe00640 1 -- 172.21.15.50:0/4038485404 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3c201037c0 con 0x7f3c201043e0 2024-08-31T04:22:35.659 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:35.657+0000 7f3c17400640 1 -- 172.21.15.50:0/4038485404 <== mon.1 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 18) ==== 152577+0+0 (secure 0 0 0) 0x7f3c08010430 con 0x7f3c201043e0 2024-08-31T04:22:35.661 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:35.659+0000 7f3c17400640 1 --2- 172.21.15.50:0/4038485404 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f3c040b4b30 0x7f3c040b7040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:35.661 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:35.659+0000 7f3c17400640 1 -- 172.21.15.50:0/4038485404 <== mon.1 v2:172.21.15.177:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8219+0+0 (secure 0 0 0) 0x7f3c080e5480 con 0x7f3c201043e0 2024-08-31T04:22:35.661 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:35.659+0000 7f3c1ea00640 1 --2- 172.21.15.50:0/4038485404 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f3c040b4b30 0x7f3c040b7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:22:35.662 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:35.660+0000 7f3c1ea00640 1 --2- 172.21.15.50:0/4038485404 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f3c040b4b30 0x7f3c040b7040 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f3c10000c00 tx=0x7f3c10031400 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:22:35.662 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:35.660+0000 7f3c17400640 1 -- 172.21.15.50:0/4038485404 <== mon.1 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f3c080abf10 con 0x7f3c201043e0 2024-08-31T04:22:35.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:22:35 smithi133 ceph-mon[22177]: from='client.25162 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:22:35.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:22:35 smithi133 ceph-mon[22177]: pgmap v357: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 767 B/s wr, 9 op/s 2024-08-31T04:22:35.894 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:35.892+0000 7f3c1fe00640 1 -- 172.21.15.50:0/4038485404 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f3c201a4550 con 0x7f3c201043e0 2024-08-31T04:22:35.894 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:22:35 smithi050 ceph-mon[17259]: from='client.25162 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:22:35.895 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:22:35 smithi050 ceph-mon[17259]: pgmap v357: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 767 B/s wr, 9 op/s 2024-08-31T04:22:35.895 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:35.892+0000 7f3c17400640 1 -- 172.21.15.50:0/4038485404 <== mon.1 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 28 v28) ==== 76+0+3135 (secure 0 0 0) 0x7f3c080b06d0 con 0x7f3c201043e0 2024-08-31T04:22:35.895 INFO:teuthology.orchestra.run.smithi050.stdout:e28 2024-08-31T04:22:35.895 INFO:teuthology.orchestra.run.smithi050.stdout:btime 2024-08-31T04:21:02:045794+0000 2024-08-31T04:22:35.895 INFO:teuthology.orchestra.run.smithi050.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-08-31T04:22:35.895 INFO:teuthology.orchestra.run.smithi050.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-08-31T04:22:35.896 INFO:teuthology.orchestra.run.smithi050.stdout:legacy client fscid: 1 2024-08-31T04:22:35.896 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-08-31T04:22:35.896 INFO:teuthology.orchestra.run.smithi050.stdout:Filesystem 'cephfs' (1) 2024-08-31T04:22:35.896 INFO:teuthology.orchestra.run.smithi050.stdout:fs_name cephfs 2024-08-31T04:22:35.896 INFO:teuthology.orchestra.run.smithi050.stdout:epoch 28 2024-08-31T04:22:35.896 INFO:teuthology.orchestra.run.smithi050.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-08-31T04:22:35.896 INFO:teuthology.orchestra.run.smithi050.stdout:created 2024-08-31T04:20:44.140709+0000 2024-08-31T04:22:35.896 INFO:teuthology.orchestra.run.smithi050.stdout:modified 2024-08-31T04:21:02.045763+0000 2024-08-31T04:22:35.896 INFO:teuthology.orchestra.run.smithi050.stdout:tableserver 0 2024-08-31T04:22:35.896 INFO:teuthology.orchestra.run.smithi050.stdout:root 0 2024-08-31T04:22:35.896 INFO:teuthology.orchestra.run.smithi050.stdout:session_timeout 300 2024-08-31T04:22:35.896 INFO:teuthology.orchestra.run.smithi050.stdout:session_autoclose 300 2024-08-31T04:22:35.896 INFO:teuthology.orchestra.run.smithi050.stdout:max_file_size 1099511627776 2024-08-31T04:22:35.896 INFO:teuthology.orchestra.run.smithi050.stdout:max_xattr_size 65536 2024-08-31T04:22:35.897 INFO:teuthology.orchestra.run.smithi050.stdout:required_client_features {} 2024-08-31T04:22:35.897 INFO:teuthology.orchestra.run.smithi050.stdout:last_failure 0 2024-08-31T04:22:35.897 INFO:teuthology.orchestra.run.smithi050.stdout:last_failure_osd_epoch 0 2024-08-31T04:22:35.897 INFO:teuthology.orchestra.run.smithi050.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-08-31T04:22:35.897 INFO:teuthology.orchestra.run.smithi050.stdout:max_mds 5 2024-08-31T04:22:35.897 INFO:teuthology.orchestra.run.smithi050.stdout:in 0,1,2,3,4 2024-08-31T04:22:35.897 INFO:teuthology.orchestra.run.smithi050.stdout:up {0=24695,1=24691,2=24667,3=24656,4=24652} 2024-08-31T04:22:35.897 INFO:teuthology.orchestra.run.smithi050.stdout:failed 2024-08-31T04:22:35.897 INFO:teuthology.orchestra.run.smithi050.stdout:damaged 2024-08-31T04:22:35.897 INFO:teuthology.orchestra.run.smithi050.stdout:stopped 2024-08-31T04:22:35.897 INFO:teuthology.orchestra.run.smithi050.stdout:data_pools [3] 2024-08-31T04:22:35.897 INFO:teuthology.orchestra.run.smithi050.stdout:metadata_pool 2 2024-08-31T04:22:35.897 INFO:teuthology.orchestra.run.smithi050.stdout:inline_data disabled 2024-08-31T04:22:35.898 INFO:teuthology.orchestra.run.smithi050.stdout:balancer 2024-08-31T04:22:35.898 INFO:teuthology.orchestra.run.smithi050.stdout:bal_rank_mask -1 2024-08-31T04:22:35.898 INFO:teuthology.orchestra.run.smithi050.stdout:standby_count_wanted 0 2024-08-31T04:22:35.898 INFO:teuthology.orchestra.run.smithi050.stdout:qdb_cluster leader: 24695 members: 24667,24695,24656,24691,24652 2024-08-31T04:22:35.898 INFO:teuthology.orchestra.run.smithi050.stdout:[mds.b{0:24695} state up:active seq 5 addr [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] compat {c=[1],r=[1],i=[1fff]}] 2024-08-31T04:22:35.898 INFO:teuthology.orchestra.run.smithi050.stdout:[mds.f{0:24640} state up:standby-replay seq 1 addr [v2:172.21.15.177:6834/599392457,v1:172.21.15.177:6835/599392457] compat {c=[1],r=[1],i=[1fff]}] 2024-08-31T04:22:35.898 INFO:teuthology.orchestra.run.smithi050.stdout:[mds.a{1:24691} state up:active seq 8 addr [v2:172.21.15.50:6840/575209862,v1:172.21.15.50:6841/575209862] compat {c=[1],r=[1],i=[1fff]}] 2024-08-31T04:22:35.898 INFO:teuthology.orchestra.run.smithi050.stdout:[mds.e{1:24626} state up:standby-replay seq 1 addr [v2:172.21.15.133:6834/3637799701,v1:172.21.15.133:6835/3637799701] compat {c=[1],r=[1],i=[1fff]}] 2024-08-31T04:22:35.898 INFO:teuthology.orchestra.run.smithi050.stdout:[mds.i{2:24667} state up:active seq 10 addr [v2:172.21.15.177:6838/3600081752,v1:172.21.15.177:6839/3600081752] compat {c=[1],r=[1],i=[1fff]}] 2024-08-31T04:22:35.898 INFO:teuthology.orchestra.run.smithi050.stdout:[mds.l{2:24601} state up:standby-replay seq 1 addr [v2:172.21.15.177:6832/1237129793,v1:172.21.15.177:6833/1237129793] compat {c=[1],r=[1],i=[1fff]}] 2024-08-31T04:22:35.898 INFO:teuthology.orchestra.run.smithi050.stdout:[mds.h{3:24656} state up:active seq 12 addr [v2:172.21.15.133:6836/4014853202,v1:172.21.15.133:6837/4014853202] compat {c=[1],r=[1],i=[1fff]}] 2024-08-31T04:22:35.898 INFO:teuthology.orchestra.run.smithi050.stdout:[mds.k{3:24590} state up:standby-replay seq 1 addr [v2:172.21.15.133:6832/4283603962,v1:172.21.15.133:6833/4283603962] compat {c=[1],r=[1],i=[1fff]}] 2024-08-31T04:22:35.898 INFO:teuthology.orchestra.run.smithi050.stdout:[mds.c{4:24652} state up:active seq 13 addr [v2:172.21.15.177:6836/2159859285,v1:172.21.15.177:6837/2159859285] compat {c=[1],r=[1],i=[1fff]}] 2024-08-31T04:22:35.899 INFO:teuthology.orchestra.run.smithi050.stdout:[mds.g{4:14676} state up:standby-replay seq 1 addr [v2:172.21.15.50:6838/2105228685,v1:172.21.15.50:6839/2105228685] compat {c=[1],r=[1],i=[1fff]}] 2024-08-31T04:22:35.899 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-08-31T04:22:35.899 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-08-31T04:22:35.899 INFO:teuthology.orchestra.run.smithi050.stdout:Standby daemons: 2024-08-31T04:22:35.899 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-08-31T04:22:35.899 INFO:teuthology.orchestra.run.smithi050.stdout:[mds.j{-1:14622} state up:standby seq 1 addr [v2:172.21.15.50:6834/1565557530,v1:172.21.15.50:6835/1565557530] compat {c=[1],r=[1],i=[1fff]}] 2024-08-31T04:22:35.899 INFO:teuthology.orchestra.run.smithi050.stdout:[mds.d{-1:14634} state up:standby seq 1 addr [v2:172.21.15.50:6836/2660185946,v1:172.21.15.50:6837/2660185946] compat {c=[1],r=[1],i=[1fff]}] 2024-08-31T04:22:35.899 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 28 2024-08-31T04:22:35.900 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:35.896+0000 7f3c1fe00640 1 -- 172.21.15.50:0/4038485404 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f3c040b4b30 msgr2=0x7f3c040b7040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:22:35.900 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:35.896+0000 7f3c1fe00640 1 --2- 172.21.15.50:0/4038485404 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f3c040b4b30 0x7f3c040b7040 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f3c10000c00 tx=0x7f3c10031400 comp rx=0 tx=0).stop 2024-08-31T04:22:35.900 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:35.896+0000 7f3c1fe00640 1 -- 172.21.15.50:0/4038485404 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3c201043e0 msgr2=0x7f3c2019c410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:22:35.900 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:35.896+0000 7f3c1fe00640 1 --2- 172.21.15.50:0/4038485404 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3c201043e0 0x7f3c2019c410 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f3c0800e9f0 tx=0x7f3c0800eeb0 comp rx=0 tx=0).stop 2024-08-31T04:22:35.900 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:35.896+0000 7f3c1fe00640 1 -- 172.21.15.50:0/4038485404 shutdown_connections 2024-08-31T04:22:35.900 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:35.896+0000 7f3c1fe00640 1 --2- 172.21.15.50:0/4038485404 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f3c040b4b30 0x7f3c040b7040 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:35.900 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:35.896+0000 7f3c1fe00640 1 --2- 172.21.15.50:0/4038485404 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3c201043e0 0x7f3c2019c410 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:35.900 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:35.896+0000 7f3c1fe00640 1 --2- 172.21.15.50:0/4038485404 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3c20104d80 0x7f3c2019cfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:35.900 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:35.896+0000 7f3c1fe00640 1 --2- 172.21.15.50:0/4038485404 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3c20103350 0x7f3c2019bda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:35.900 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:35.896+0000 7f3c1fe00640 1 -- 172.21.15.50:0/4038485404 >> 172.21.15.50:0/4038485404 conn(0x7f3c200fecc0 msgr2=0x7f3c20075390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:22:35.900 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:35.896+0000 7f3c1fe00640 1 -- 172.21.15.50:0/4038485404 shutdown_connections 2024-08-31T04:22:35.900 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:35.896+0000 7f3c1fe00640 1 -- 172.21.15.50:0/4038485404 wait complete. 2024-08-31T04:22:35.996 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:22:35 smithi177 ceph-mon[22025]: from='client.25162 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:22:35.996 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:22:35 smithi177 ceph-mon[22025]: pgmap v357: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 767 B/s wr, 9 op/s 2024-08-31T04:22:36.645 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 058d9fc6-674f-11ef-bcd4-c7b262605968 -- bash -c 'ceph osd dump' 2024-08-31T04:22:36.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:22:36 smithi133 ceph-mon[22177]: from='client.? 172.21.15.50:0/4038485404' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-08-31T04:22:36.950 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:22:36 smithi050 ceph-mon[17259]: from='client.? 172.21.15.50:0/4038485404' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-08-31T04:22:36.996 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:22:36 smithi177 ceph-mon[22025]: from='client.? 172.21.15.50:0/4038485404' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-08-31T04:22:37.022 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:22:37.646 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:37.643+0000 7fb310c00640 1 -- 172.21.15.50:0/3154994580 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb30c104580 msgr2=0x7fb30c104990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:22:37.646 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:37.643+0000 7fb310c00640 1 --2- 172.21.15.50:0/3154994580 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb30c104580 0x7fb30c104990 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fb2f8009900 tx=0x7fb2f802a480 comp rx=0 tx=0).stop 2024-08-31T04:22:37.646 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:37.643+0000 7fb310c00640 1 -- 172.21.15.50:0/3154994580 shutdown_connections 2024-08-31T04:22:37.646 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:37.643+0000 7fb310c00640 1 --2- 172.21.15.50:0/3154994580 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb30c104f20 0x7fb30c10b8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:37.646 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:37.643+0000 7fb310c00640 1 --2- 172.21.15.50:0/3154994580 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb30c104580 0x7fb30c104990 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:37.647 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:37.643+0000 7fb310c00640 1 --2- 172.21.15.50:0/3154994580 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb30c1034f0 0x7fb30c103960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:37.647 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:37.643+0000 7fb310c00640 1 -- 172.21.15.50:0/3154994580 >> 172.21.15.50:0/3154994580 conn(0x7fb30c0fee60 msgr2=0x7fb30c101310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:22:37.647 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:37.643+0000 7fb310c00640 1 -- 172.21.15.50:0/3154994580 shutdown_connections 2024-08-31T04:22:37.647 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:37.643+0000 7fb310c00640 1 -- 172.21.15.50:0/3154994580 wait complete. 2024-08-31T04:22:37.649 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:37.644+0000 7fb310c00640 1 Processor -- start 2024-08-31T04:22:37.649 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:37.644+0000 7fb310c00640 1 -- start start 2024-08-31T04:22:37.649 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:37.645+0000 7fb310c00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb30c1034f0 0x7fb30c199d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:37.649 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:37.645+0000 7fb310c00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb30c104580 0x7fb30c19a3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:37.649 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:37.645+0000 7fb310c00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb30c104f20 0x7fb30c19af70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:37.649 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:37.645+0000 7fb310c00640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fb30c10f170 con 0x7fb30c104580 2024-08-31T04:22:37.649 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:37.645+0000 7fb310c00640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7fb30c10eff0 con 0x7fb30c1034f0 2024-08-31T04:22:37.649 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:37.645+0000 7fb310c00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fb30c10f2f0 con 0x7fb30c104f20 2024-08-31T04:22:37.649 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:37.645+0000 7fb309400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb30c104580 0x7fb30c19a3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:22:37.649 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:37.645+0000 7fb309400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb30c104580 0x7fb30c19a3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:37758/0 (socket says 172.21.15.50:37758) 2024-08-31T04:22:37.650 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:37.645+0000 7fb309400640 1 -- 172.21.15.50:0/2265162282 learned_addr learned my addr 172.21.15.50:0/2265162282 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:22:37.650 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:37.645+0000 7fb30a800640 1 --2- 172.21.15.50:0/2265162282 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb30c104f20 0x7fb30c19af70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:22:37.650 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:37.645+0000 7fb309e00640 1 --2- 172.21.15.50:0/2265162282 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb30c1034f0 0x7fb30c199d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:22:37.650 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:37.646+0000 7fb30a800640 1 -- 172.21.15.50:0/2265162282 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb30c1034f0 msgr2=0x7fb30c199d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:22:37.650 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:37.646+0000 7fb30a800640 1 --2- 172.21.15.50:0/2265162282 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb30c1034f0 0x7fb30c199d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:37.650 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:37.646+0000 7fb30a800640 1 -- 172.21.15.50:0/2265162282 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb30c104580 msgr2=0x7fb30c19a3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:22:37.650 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:37.646+0000 7fb30a800640 1 --2- 172.21.15.50:0/2265162282 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb30c104580 0x7fb30c19a3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:37.650 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:37.646+0000 7fb30a800640 1 -- 172.21.15.50:0/2265162282 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb30c19b790 con 0x7fb30c104f20 2024-08-31T04:22:37.650 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:37.646+0000 7fb309400640 1 --2- 172.21.15.50:0/2265162282 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb30c104580 0x7fb30c19a3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:22:37.650 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:37.646+0000 7fb30a800640 1 --2- 172.21.15.50:0/2265162282 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb30c104f20 0x7fb30c19af70 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fb304009fd0 tx=0x7fb30400ef10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:22:37.650 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:37.646+0000 7fb302a00640 1 -- 172.21.15.50:0/2265162282 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb30400ce20 con 0x7fb30c104f20 2024-08-31T04:22:37.650 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:37.646+0000 7fb302a00640 1 -- 172.21.15.50:0/2265162282 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb304005020 con 0x7fb30c104f20 2024-08-31T04:22:37.650 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:37.646+0000 7fb302a00640 1 -- 172.21.15.50:0/2265162282 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb304010690 con 0x7fb30c104f20 2024-08-31T04:22:37.651 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:37.646+0000 7fb310c00640 1 -- 172.21.15.50:0/2265162282 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb30c19ba80 con 0x7fb30c104f20 2024-08-31T04:22:37.651 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:37.646+0000 7fb310c00640 1 -- 172.21.15.50:0/2265162282 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb30c075560 con 0x7fb30c104f20 2024-08-31T04:22:37.651 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:37.647+0000 7fb310c00640 1 -- 172.21.15.50:0/2265162282 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb30c103960 con 0x7fb30c104f20 2024-08-31T04:22:37.652 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:37.650+0000 7fb302a00640 1 -- 172.21.15.50:0/2265162282 <== mon.1 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 18) ==== 152577+0+0 (secure 0 0 0) 0x7fb3040054d0 con 0x7fb30c104f20 2024-08-31T04:22:37.653 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:37.651+0000 7fb302a00640 1 --2- 172.21.15.50:0/2265162282 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fb2f00b4bb0 0x7fb2f00b70c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:37.654 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:37.651+0000 7fb302a00640 1 -- 172.21.15.50:0/2265162282 <== mon.1 v2:172.21.15.177:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8219+0+0 (secure 0 0 0) 0x7fb3040e5810 con 0x7fb30c104f20 2024-08-31T04:22:37.654 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:37.651+0000 7fb309e00640 1 --2- 172.21.15.50:0/2265162282 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fb2f00b4bb0 0x7fb2f00b70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:22:37.654 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:37.652+0000 7fb309e00640 1 --2- 172.21.15.50:0/2265162282 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fb2f00b4bb0 0x7fb2f00b70c0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fb2fc009bd0 tx=0x7fb2fc005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:22:37.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:37.656+0000 7fb302a00640 1 -- 172.21.15.50:0/2265162282 <== mon.1 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fb3040ac8f0 con 0x7fb30c104f20 2024-08-31T04:22:37.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:22:37 smithi133 ceph-mon[22177]: pgmap v358: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 767 B/s wr, 11 op/s 2024-08-31T04:22:37.855 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:37.853+0000 7fb310c00640 1 -- 172.21.15.50:0/2265162282 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd dump"} v 0) -- 0x7fb30c02e730 con 0x7fb30c104f20 2024-08-31T04:22:37.856 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:22:37 smithi050 ceph-mon[17259]: pgmap v358: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 767 B/s wr, 11 op/s 2024-08-31T04:22:37.856 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:37.854+0000 7fb302a00640 1 -- 172.21.15.50:0/2265162282 <== mon.1 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump"}]=0 v78) ==== 56+0+5286 (secure 0 0 0) 0x7fb3040ac1f0 con 0x7fb30c104f20 2024-08-31T04:22:37.857 INFO:teuthology.orchestra.run.smithi050.stdout:epoch 78 2024-08-31T04:22:37.857 INFO:teuthology.orchestra.run.smithi050.stdout:fsid 058d9fc6-674f-11ef-bcd4-c7b262605968 2024-08-31T04:22:37.857 INFO:teuthology.orchestra.run.smithi050.stdout:created 2024-08-31T04:11:59.576131+0000 2024-08-31T04:22:37.857 INFO:teuthology.orchestra.run.smithi050.stdout:modified 2024-08-31T04:20:56.994402+0000 2024-08-31T04:22:37.857 INFO:teuthology.orchestra.run.smithi050.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2024-08-31T04:22:37.857 INFO:teuthology.orchestra.run.smithi050.stdout:crush_version 26 2024-08-31T04:22:37.857 INFO:teuthology.orchestra.run.smithi050.stdout:full_ratio 0.95 2024-08-31T04:22:37.857 INFO:teuthology.orchestra.run.smithi050.stdout:backfillfull_ratio 0.9 2024-08-31T04:22:37.858 INFO:teuthology.orchestra.run.smithi050.stdout:nearfull_ratio 0.85 2024-08-31T04:22:37.858 INFO:teuthology.orchestra.run.smithi050.stdout:require_min_compat_client luminous 2024-08-31T04:22:37.858 INFO:teuthology.orchestra.run.smithi050.stdout:min_compat_client luminous 2024-08-31T04:22:37.858 INFO:teuthology.orchestra.run.smithi050.stdout:require_osd_release squid 2024-08-31T04:22:37.858 INFO:teuthology.orchestra.run.smithi050.stdout:stretch_mode_enabled false 2024-08-31T04:22:37.858 INFO:teuthology.orchestra.run.smithi050.stdout:pool 1 '.mgr' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 21 flags hashpspool stripe_width 0 pg_num_max 32 pg_num_min 1 application mgr read_balance_score 12.00 2024-08-31T04:22:37.858 INFO:teuthology.orchestra.run.smithi050.stdout:pool 2 'cephfs_metadata' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 76 flags hashpspool stripe_width 0 pg_autoscale_bias 4 pg_num_min 16 recovery_priority 5 application cephfs read_balance_score 1.88 2024-08-31T04:22:37.858 INFO:teuthology.orchestra.run.smithi050.stdout:pool 3 'cephfs_data' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 64 pgp_num 64 autoscale_mode off last_change 76 flags hashpspool stripe_width 0 pg_num_min 64 target_size_ratio 0.9 application cephfs read_balance_score 1.50 2024-08-31T04:22:37.858 INFO:teuthology.orchestra.run.smithi050.stdout:max_osd 12 2024-08-31T04:22:37.858 INFO:teuthology.orchestra.run.smithi050.stdout:osd.0 up in weight 1 up_from 8 up_thru 77 down_at 0 last_clean_interval [0,0) [v2:172.21.15.50:6802/3831273843,v1:172.21.15.50:6803/3831273843] [v2:172.21.15.50:6804/3831273843,v1:172.21.15.50:6805/3831273843] exists,up 416ecbde-4a7b-4bd1-b377-490925a33ce1 2024-08-31T04:22:37.858 INFO:teuthology.orchestra.run.smithi050.stdout:osd.1 up in weight 1 up_from 13 up_thru 73 down_at 0 last_clean_interval [0,0) [v2:172.21.15.133:6800/475308203,v1:172.21.15.133:6801/475308203] [v2:172.21.15.133:6802/475308203,v1:172.21.15.133:6803/475308203] exists,up 5e008006-004d-4842-9885-93a2d27be1cc 2024-08-31T04:22:37.858 INFO:teuthology.orchestra.run.smithi050.stdout:osd.2 up in weight 1 up_from 18 up_thru 73 down_at 0 last_clean_interval [0,0) [v2:172.21.15.177:6800/3091173426,v1:172.21.15.177:6801/3091173426] [v2:172.21.15.177:6802/3091173426,v1:172.21.15.177:6803/3091173426] exists,up 7e6f1a26-f30d-4822-af69-8a08cb89fbce 2024-08-31T04:22:37.858 INFO:teuthology.orchestra.run.smithi050.stdout:osd.3 up in weight 1 up_from 25 up_thru 73 down_at 0 last_clean_interval [0,0) [v2:172.21.15.50:6810/3792992620,v1:172.21.15.50:6811/3792992620] [v2:172.21.15.50:6812/3792992620,v1:172.21.15.50:6813/3792992620] exists,up 8193c2a2-18a1-4684-9a16-cbeae25530ca 2024-08-31T04:22:37.858 INFO:teuthology.orchestra.run.smithi050.stdout:osd.4 up in weight 1 up_from 31 up_thru 73 down_at 0 last_clean_interval [0,0) [v2:172.21.15.133:6808/2855333596,v1:172.21.15.133:6809/2855333596] [v2:172.21.15.133:6810/2855333596,v1:172.21.15.133:6811/2855333596] exists,up 2a2b4e64-0f8e-40ec-926c-84dbf691aefe 2024-08-31T04:22:37.859 INFO:teuthology.orchestra.run.smithi050.stdout:osd.5 up in weight 1 up_from 36 up_thru 77 down_at 0 last_clean_interval [0,0) [v2:172.21.15.177:6808/1166415084,v1:172.21.15.177:6809/1166415084] [v2:172.21.15.177:6810/1166415084,v1:172.21.15.177:6811/1166415084] exists,up 83429ff0-ea7d-4fcc-9611-39d9001aa216 2024-08-31T04:22:37.859 INFO:teuthology.orchestra.run.smithi050.stdout:osd.6 up in weight 1 up_from 42 up_thru 73 down_at 0 last_clean_interval [0,0) [v2:172.21.15.50:6818/1429341184,v1:172.21.15.50:6819/1429341184] [v2:172.21.15.50:6820/1429341184,v1:172.21.15.50:6821/1429341184] exists,up eeb571ef-5e43-4816-95dd-d01d83aeca83 2024-08-31T04:22:37.859 INFO:teuthology.orchestra.run.smithi050.stdout:osd.7 up in weight 1 up_from 47 up_thru 73 down_at 0 last_clean_interval [0,0) [v2:172.21.15.133:6816/3643454923,v1:172.21.15.133:6817/3643454923] [v2:172.21.15.133:6818/3643454923,v1:172.21.15.133:6819/3643454923] exists,up 512ee507-0d50-4fed-b692-dbdf23a93e8e 2024-08-31T04:22:37.859 INFO:teuthology.orchestra.run.smithi050.stdout:osd.8 up in weight 1 up_from 52 up_thru 73 down_at 0 last_clean_interval [0,0) [v2:172.21.15.177:6816/101973300,v1:172.21.15.177:6817/101973300] [v2:172.21.15.177:6818/101973300,v1:172.21.15.177:6819/101973300] exists,up ae99526e-41da-4cb5-857f-2e66f18f2d94 2024-08-31T04:22:37.859 INFO:teuthology.orchestra.run.smithi050.stdout:osd.9 up in weight 1 up_from 58 up_thru 77 down_at 0 last_clean_interval [0,0) [v2:172.21.15.50:6826/53019860,v1:172.21.15.50:6827/53019860] [v2:172.21.15.50:6828/53019860,v1:172.21.15.50:6829/53019860] exists,up fcedbe16-b910-407f-b9d7-1dd03f3e62a7 2024-08-31T04:22:37.859 INFO:teuthology.orchestra.run.smithi050.stdout:osd.10 up in weight 1 up_from 63 up_thru 77 down_at 0 last_clean_interval [0,0) [v2:172.21.15.133:6824/4175566493,v1:172.21.15.133:6825/4175566493] [v2:172.21.15.133:6826/4175566493,v1:172.21.15.133:6827/4175566493] exists,up 3852756e-62f1-4e71-a070-8cff76df99b7 2024-08-31T04:22:37.859 INFO:teuthology.orchestra.run.smithi050.stdout:osd.11 up in weight 1 up_from 68 up_thru 77 down_at 0 last_clean_interval [0,0) [v2:172.21.15.177:6824/2103454982,v1:172.21.15.177:6825/2103454982] [v2:172.21.15.177:6826/2103454982,v1:172.21.15.177:6827/2103454982] exists,up a154180a-5f2a-4b33-ad3d-fea7317597ec 2024-08-31T04:22:37.859 INFO:teuthology.orchestra.run.smithi050.stdout:pg_upmap_items 2.b [2,4,8,11] 2024-08-31T04:22:37.859 INFO:teuthology.orchestra.run.smithi050.stdout:pg_upmap_items 2.1b [2,1] 2024-08-31T04:22:37.859 INFO:teuthology.orchestra.run.smithi050.stdout:pg_upmap_items 2.1d [8,11] 2024-08-31T04:22:37.859 INFO:teuthology.orchestra.run.smithi050.stdout:pg_upmap_items 3.e [4,6] 2024-08-31T04:22:37.859 INFO:teuthology.orchestra.run.smithi050.stdout:pg_upmap_items 3.17 [4,8] 2024-08-31T04:22:37.859 INFO:teuthology.orchestra.run.smithi050.stdout:pg_upmap_items 3.25 [5,9] 2024-08-31T04:22:37.859 INFO:teuthology.orchestra.run.smithi050.stdout:pg_upmap_items 3.29 [3,9] 2024-08-31T04:22:37.860 INFO:teuthology.orchestra.run.smithi050.stdout:pg_upmap_items 3.36 [4,9] 2024-08-31T04:22:37.860 INFO:teuthology.orchestra.run.smithi050.stdout:blocklist 172.21.15.50:6801/1319056820 expires 2024-09-01T04:12:55.742020+0000 2024-08-31T04:22:37.860 INFO:teuthology.orchestra.run.smithi050.stdout:blocklist 172.21.15.50:0/1755103674 expires 2024-09-01T04:12:55.742020+0000 2024-08-31T04:22:37.860 INFO:teuthology.orchestra.run.smithi050.stdout:blocklist 172.21.15.50:6800/1319056820 expires 2024-09-01T04:12:55.742020+0000 2024-08-31T04:22:37.860 INFO:teuthology.orchestra.run.smithi050.stdout:blocklist 172.21.15.50:0/3701412233 expires 2024-09-01T04:12:55.742020+0000 2024-08-31T04:22:37.860 INFO:teuthology.orchestra.run.smithi050.stdout:blocklist 172.21.15.50:0/1829556336 expires 2024-09-01T04:12:55.742020+0000 2024-08-31T04:22:37.860 INFO:teuthology.orchestra.run.smithi050.stdout:blocklist 172.21.15.50:0/1698995126 expires 2024-09-01T04:12:25.753831+0000 2024-08-31T04:22:37.860 INFO:teuthology.orchestra.run.smithi050.stdout:blocklist 172.21.15.50:0/1554317941 expires 2024-09-01T04:12:25.753831+0000 2024-08-31T04:22:37.860 INFO:teuthology.orchestra.run.smithi050.stdout:blocklist 172.21.15.50:0/2998110380 expires 2024-09-01T04:12:25.753831+0000 2024-08-31T04:22:37.860 INFO:teuthology.orchestra.run.smithi050.stdout:blocklist 172.21.15.50:6801/4197277793 expires 2024-09-01T04:12:25.753831+0000 2024-08-31T04:22:37.860 INFO:teuthology.orchestra.run.smithi050.stdout:blocklist 172.21.15.50:6800/4197277793 expires 2024-09-01T04:12:25.753831+0000 2024-08-31T04:22:37.861 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:37.857+0000 7fb310c00640 1 -- 172.21.15.50:0/2265162282 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fb2f00b4bb0 msgr2=0x7fb2f00b70c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:22:37.861 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:37.857+0000 7fb310c00640 1 --2- 172.21.15.50:0/2265162282 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fb2f00b4bb0 0x7fb2f00b70c0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fb2fc009bd0 tx=0x7fb2fc005f90 comp rx=0 tx=0).stop 2024-08-31T04:22:37.861 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:37.857+0000 7fb310c00640 1 -- 172.21.15.50:0/2265162282 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb30c104f20 msgr2=0x7fb30c19af70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:22:37.861 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:37.857+0000 7fb310c00640 1 --2- 172.21.15.50:0/2265162282 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb30c104f20 0x7fb30c19af70 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fb304009fd0 tx=0x7fb30400ef10 comp rx=0 tx=0).stop 2024-08-31T04:22:37.862 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:37.858+0000 7fb310c00640 1 -- 172.21.15.50:0/2265162282 shutdown_connections 2024-08-31T04:22:37.862 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:37.858+0000 7fb310c00640 1 --2- 172.21.15.50:0/2265162282 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fb2f00b4bb0 0x7fb2f00b70c0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:37.862 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:37.858+0000 7fb310c00640 1 --2- 172.21.15.50:0/2265162282 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb30c104f20 0x7fb30c19af70 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:37.862 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:37.858+0000 7fb310c00640 1 --2- 172.21.15.50:0/2265162282 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb30c104580 0x7fb30c19a3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:37.862 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:37.858+0000 7fb310c00640 1 --2- 172.21.15.50:0/2265162282 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb30c1034f0 0x7fb30c199d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:37.862 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:37.858+0000 7fb310c00640 1 -- 172.21.15.50:0/2265162282 >> 172.21.15.50:0/2265162282 conn(0x7fb30c0fee60 msgr2=0x7fb30c1078a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:22:37.862 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:37.858+0000 7fb310c00640 1 -- 172.21.15.50:0/2265162282 shutdown_connections 2024-08-31T04:22:37.862 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:37.858+0000 7fb310c00640 1 -- 172.21.15.50:0/2265162282 wait complete. 2024-08-31T04:22:37.996 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:22:37 smithi177 ceph-mon[22025]: pgmap v358: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 767 B/s wr, 11 op/s 2024-08-31T04:22:38.575 INFO:teuthology.run_tasks:Running task fs.ready... 2024-08-31T04:22:38.587 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 058d9fc6-674f-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-31T04:22:38.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:22:38 smithi133 ceph-mon[22177]: from='client.? 172.21.15.50:0/2265162282' entity='client.admin' cmd={"prefix": "osd dump"} : dispatch 2024-08-31T04:22:38.950 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:22:38 smithi050 ceph-mon[17259]: from='client.? 172.21.15.50:0/2265162282' entity='client.admin' cmd={"prefix": "osd dump"} : dispatch 2024-08-31T04:22:38.964 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:22:38.996 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:22:38 smithi177 ceph-mon[22025]: from='client.? 172.21.15.50:0/2265162282' entity='client.admin' cmd={"prefix": "osd dump"} : dispatch 2024-08-31T04:22:39.586 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:39.584+0000 7f2621600640 1 -- 172.21.15.50:0/3565162313 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f261c075550 msgr2=0x7f261c075960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:22:39.586 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:39.584+0000 7f2621600640 1 --2- 172.21.15.50:0/3565162313 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f261c075550 0x7f261c075960 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f260c009900 tx=0x7f260c02a410 comp rx=0 tx=0).stop 2024-08-31T04:22:39.586 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:39.584+0000 7f2621600640 1 -- 172.21.15.50:0/3565162313 shutdown_connections 2024-08-31T04:22:39.586 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:39.584+0000 7f2621600640 1 --2- 172.21.15.50:0/3565162313 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f261c10fe80 0x7f261c1122c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:39.586 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:39.584+0000 7f2621600640 1 --2- 172.21.15.50:0/3565162313 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f261c075ea0 0x7f261c10f940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:39.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:39.584+0000 7f2621600640 1 --2- 172.21.15.50:0/3565162313 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f261c075550 0x7f261c075960 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:39.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:39.585+0000 7f2621600640 1 -- 172.21.15.50:0/3565162313 >> 172.21.15.50:0/3565162313 conn(0x7f261c0ff370 msgr2=0x7f261c1017c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:22:39.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:39.585+0000 7f2621600640 1 -- 172.21.15.50:0/3565162313 shutdown_connections 2024-08-31T04:22:39.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:39.585+0000 7f2621600640 1 -- 172.21.15.50:0/3565162313 wait complete. 2024-08-31T04:22:39.588 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:39.586+0000 7f2621600640 1 Processor -- start 2024-08-31T04:22:39.588 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:39.586+0000 7f2621600640 1 -- start start 2024-08-31T04:22:39.588 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:39.586+0000 7f2621600640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f261c075550 0x7f261c19c3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:39.588 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:39.586+0000 7f2621600640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f261c075ea0 0x7f261c19c980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:39.588 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:39.586+0000 7f2621600640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f261c10fe80 0x7f261c1a1c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:39.588 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:39.586+0000 7f2621600640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f261c115a30 con 0x7f261c075550 2024-08-31T04:22:39.589 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:39.586+0000 7f2621600640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f261c1158b0 con 0x7f261c075ea0 2024-08-31T04:22:39.589 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:39.586+0000 7f2621600640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f261c115bb0 con 0x7f261c10fe80 2024-08-31T04:22:39.589 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:39.586+0000 7f261aa00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f261c075550 0x7f261c19c3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:22:39.589 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:39.586+0000 7f261aa00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f261c075550 0x7f261c19c3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:37778/0 (socket says 172.21.15.50:37778) 2024-08-31T04:22:39.589 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:39.586+0000 7f261aa00640 1 -- 172.21.15.50:0/515275566 learned_addr learned my addr 172.21.15.50:0/515275566 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:22:39.589 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:39.586+0000 7f261a000640 1 --2- 172.21.15.50:0/515275566 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f261c075ea0 0x7f261c19c980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:22:39.589 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:39.587+0000 7f261b400640 1 --2- 172.21.15.50:0/515275566 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f261c10fe80 0x7f261c1a1c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:22:39.589 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:39.587+0000 7f261aa00640 1 -- 172.21.15.50:0/515275566 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f261c10fe80 msgr2=0x7f261c1a1c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:22:39.589 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:39.587+0000 7f261aa00640 1 --2- 172.21.15.50:0/515275566 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f261c10fe80 0x7f261c1a1c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:39.589 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:39.587+0000 7f261aa00640 1 -- 172.21.15.50:0/515275566 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f261c075ea0 msgr2=0x7f261c19c980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:22:39.589 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:39.587+0000 7f261aa00640 1 --2- 172.21.15.50:0/515275566 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f261c075ea0 0x7f261c19c980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:39.589 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:39.587+0000 7f261aa00640 1 -- 172.21.15.50:0/515275566 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f261c1a2350 con 0x7f261c075550 2024-08-31T04:22:39.590 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:39.587+0000 7f261aa00640 1 --2- 172.21.15.50:0/515275566 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f261c075550 0x7f261c19c3e0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f260c005940 tx=0x7f260c0040c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:22:39.590 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:39.588+0000 7f2613400640 1 -- 172.21.15.50:0/515275566 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f260c03f030 con 0x7f261c075550 2024-08-31T04:22:39.590 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:39.588+0000 7f2613400640 1 -- 172.21.15.50:0/515275566 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f260c0044c0 con 0x7f261c075550 2024-08-31T04:22:39.590 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:39.588+0000 7f2621600640 1 -- 172.21.15.50:0/515275566 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f261c1a25e0 con 0x7f261c075550 2024-08-31T04:22:39.590 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:39.588+0000 7f2613400640 1 -- 172.21.15.50:0/515275566 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f260c035070 con 0x7f261c075550 2024-08-31T04:22:39.591 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:39.588+0000 7f2621600640 1 -- 172.21.15.50:0/515275566 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f261c1a8da0 con 0x7f261c075550 2024-08-31T04:22:39.591 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:39.589+0000 7f2621600640 1 -- 172.21.15.50:0/515275566 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f261c075960 con 0x7f261c075550 2024-08-31T04:22:39.592 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:39.591+0000 7f2613400640 1 -- 172.21.15.50:0/515275566 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 18) ==== 152577+0+0 (secure 0 0 0) 0x7f260c042030 con 0x7f261c075550 2024-08-31T04:22:39.594 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:39.592+0000 7f2613400640 1 --2- 172.21.15.50:0/515275566 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f26000b4b30 0x7f26000b7040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:39.594 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:39.593+0000 7f2613400640 1 -- 172.21.15.50:0/515275566 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8219+0+0 (secure 0 0 0) 0x7f260c105720 con 0x7f261c075550 2024-08-31T04:22:39.594 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:39.593+0000 7f261a000640 1 --2- 172.21.15.50:0/515275566 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f26000b4b30 0x7f26000b7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:22:39.594 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:39.593+0000 7f261a000640 1 --2- 172.21.15.50:0/515275566 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f26000b4b30 0x7f26000b7040 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f261c101aa0 tx=0x7f2608005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:22:39.596 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:39.595+0000 7f2613400640 1 -- 172.21.15.50:0/515275566 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f260c0cc1b0 con 0x7f261c075550 2024-08-31T04:22:39.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:22:39 smithi050 ceph-mon[17259]: pgmap v359: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 767 B/s wr, 11 op/s 2024-08-31T04:22:39.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:22:39 smithi133 ceph-mon[22177]: pgmap v359: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 767 B/s wr, 11 op/s 2024-08-31T04:22:39.829 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:39.827+0000 7f2621600640 1 -- 172.21.15.50:0/515275566 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f261c1a9000 con 0x7f261c075550 2024-08-31T04:22:39.829 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:39.828+0000 7f2613400640 1 -- 172.21.15.50:0/515275566 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11983 (secure 0 0 0) 0x7f260c0d0970 con 0x7f261c075550 2024-08-31T04:22:39.830 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-08-31T04:22:39.830 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":28,"btime":"2024-08-31T04:21:02:045794+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14622,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/1565557530","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":1565557530},{"type":"v1","addr":"172.21.15.50:6835","nonce":1565557530}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14634,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6837/2660185946","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6836","nonce":2660185946},{"type":"v1","addr":"172.21.15.50:6837","nonce":2660185946}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-31T04:20:44.140709+0000","modified":"2024-08-31T04:21:02.045763+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24695,"mds_1":24691,"mds_2":24667,"mds_3":24656,"mds_4":24652},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14676":{"gid":14676,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.50:6839/2105228685","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6838","nonce":2105228685},{"type":"v1","addr":"172.21.15.50:6839","nonce":2105228685}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24590":{"gid":24590,"name":"k","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.133:6833/4283603962","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6832","nonce":4283603962},{"type":"v1","addr":"172.21.15.133:6833","nonce":4283603962}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24601":{"gid":24601,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.177:6833/1237129793","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":1237129793},{"type":"v1","addr":"172.21.15.177:6833","nonce":1237129793}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24626":{"gid":24626,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.133:6835/3637799701","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":3637799701},{"type":"v1","addr":"172.21.15.133:6835","nonce":3637799701}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24640":{"gid":24640,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.177:6835/599392457","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6834","nonce":599392457},{"type":"v1","addr":"172.21.15.177:6835","nonce":599392457}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24652":{"gid":24652,"name":"c","rank":4,"incarnation":26,"state":"up:active","state_seq":13,"addr":"172.21.15.177:6837/2159859285","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6836","nonce":2159859285},{"type":"v1","addr":"172.21.15.177:6837","nonce":2159859285}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24656":{"gid":24656,"name":"h","rank":3,"incarnation":22,"state":"up:active","state_seq":12,"addr":"172.21.15.133:6837/4014853202","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6836","nonce":4014853202},{"type":"v1","addr":"172.21.15.133:6837","nonce":4014853202}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24667":{"gid":24667,"name":"i","rank":2,"incarnation":20,"state":"up:active","state_seq":10,"addr":"172.21.15.177:6839/3600081752","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6838","nonce":3600081752},{"type":"v1","addr":"172.21.15.177:6839","nonce":3600081752}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24691":{"gid":24691,"name":"a","rank":1,"incarnation":18,"state":"up:active","state_seq":8,"addr":"172.21.15.50:6841/575209862","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6840","nonce":575209862},{"type":"v1","addr":"172.21.15.50:6841","nonce":575209862}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24695":{"gid":24695,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.133:6839/2526402262","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6838","nonce":2526402262},{"type":"v1","addr":"172.21.15.133:6839","nonce":2526402262}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24695,"qdb_cluster":[24667,24695,24656,24691,24652]},"id":1}]} 2024-08-31T04:22:39.830 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 28 2024-08-31T04:22:39.832 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:39.830+0000 7f2621600640 1 -- 172.21.15.50:0/515275566 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f26000b4b30 msgr2=0x7f26000b7040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:22:39.832 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:39.830+0000 7f2621600640 1 --2- 172.21.15.50:0/515275566 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f26000b4b30 0x7f26000b7040 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f261c101aa0 tx=0x7f2608005f90 comp rx=0 tx=0).stop 2024-08-31T04:22:39.832 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:39.830+0000 7f2621600640 1 -- 172.21.15.50:0/515275566 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f261c075550 msgr2=0x7f261c19c3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:22:39.832 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:39.830+0000 7f2621600640 1 --2- 172.21.15.50:0/515275566 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f261c075550 0x7f261c19c3e0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f260c005940 tx=0x7f260c0040c0 comp rx=0 tx=0).stop 2024-08-31T04:22:39.832 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:39.830+0000 7f2621600640 1 -- 172.21.15.50:0/515275566 shutdown_connections 2024-08-31T04:22:39.832 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:39.830+0000 7f2621600640 1 --2- 172.21.15.50:0/515275566 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f26000b4b30 0x7f26000b7040 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:39.832 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:39.830+0000 7f2621600640 1 --2- 172.21.15.50:0/515275566 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f261c10fe80 0x7f261c1a1c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:39.832 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:39.830+0000 7f2621600640 1 --2- 172.21.15.50:0/515275566 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f261c075ea0 0x7f261c19c980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:39.832 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:39.830+0000 7f2621600640 1 --2- 172.21.15.50:0/515275566 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f261c075550 0x7f261c19c3e0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:39.833 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:39.830+0000 7f2621600640 1 -- 172.21.15.50:0/515275566 >> 172.21.15.50:0/515275566 conn(0x7f261c0ff370 msgr2=0x7f261c1099b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:22:39.833 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:39.831+0000 7f2621600640 1 -- 172.21.15.50:0/515275566 shutdown_connections 2024-08-31T04:22:39.833 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:39.831+0000 7f2621600640 1 -- 172.21.15.50:0/515275566 wait complete. 2024-08-31T04:22:39.996 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:22:39 smithi177 ceph-mon[22025]: pgmap v359: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 767 B/s wr, 11 op/s 2024-08-31T04:22:40.566 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 058d9fc6-674f-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-31T04:22:40.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:22:40 smithi133 ceph-mon[22177]: from='client.? 172.21.15.50:0/515275566' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T04:22:40.945 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:22:40.949 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:22:40 smithi050 ceph-mon[17259]: from='client.? 172.21.15.50:0/515275566' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T04:22:40.996 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:22:40 smithi177 ceph-mon[22025]: from='client.? 172.21.15.50:0/515275566' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T04:22:41.565 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:41.563+0000 7faee5200640 1 -- 172.21.15.50:0/1742864575 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faee00754d0 msgr2=0x7faee00758e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:22:41.565 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:41.563+0000 7faee5200640 1 --2- 172.21.15.50:0/1742864575 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faee00754d0 0x7faee00758e0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7faed0009900 tx=0x7faed002a410 comp rx=0 tx=0).stop 2024-08-31T04:22:41.565 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:41.563+0000 7faee5200640 1 -- 172.21.15.50:0/1742864575 shutdown_connections 2024-08-31T04:22:41.565 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:41.563+0000 7faee5200640 1 --2- 172.21.15.50:0/1742864575 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7faee010fd10 0x7faee0112130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:41.565 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:41.563+0000 7faee5200640 1 --2- 172.21.15.50:0/1742864575 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faee0075e20 0x7faee010f7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:41.565 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:41.563+0000 7faee5200640 1 --2- 172.21.15.50:0/1742864575 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faee00754d0 0x7faee00758e0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:41.565 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:41.563+0000 7faee5200640 1 -- 172.21.15.50:0/1742864575 >> 172.21.15.50:0/1742864575 conn(0x7faee00ff180 msgr2=0x7faee01015d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:22:41.565 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:41.563+0000 7faee5200640 1 -- 172.21.15.50:0/1742864575 shutdown_connections 2024-08-31T04:22:41.565 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:41.563+0000 7faee5200640 1 -- 172.21.15.50:0/1742864575 wait complete. 2024-08-31T04:22:41.567 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:41.564+0000 7faee5200640 1 Processor -- start 2024-08-31T04:22:41.567 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:41.564+0000 7faee5200640 1 -- start start 2024-08-31T04:22:41.567 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:41.565+0000 7faee5200640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faee00754d0 0x7faee019c2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:41.567 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:41.565+0000 7faee5200640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7faee0075e20 0x7faee019c840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:41.567 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:41.565+0000 7faee5200640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faee010fd10 0x7faee01a1ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:41.567 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:41.565+0000 7faee5200640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7faee0115870 con 0x7faee00754d0 2024-08-31T04:22:41.567 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:41.565+0000 7faee5200640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7faee01156f0 con 0x7faee010fd10 2024-08-31T04:22:41.567 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:41.565+0000 7faee5200640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7faee01159f0 con 0x7faee0075e20 2024-08-31T04:22:41.568 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:41.565+0000 7faedf400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faee00754d0 0x7faee019c2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:22:41.568 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:41.565+0000 7faedea00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7faee0075e20 0x7faee019c840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:22:41.568 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:41.565+0000 7faedf400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faee00754d0 0x7faee019c2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:37796/0 (socket says 172.21.15.50:37796) 2024-08-31T04:22:41.568 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:41.565+0000 7faedf400640 1 -- 172.21.15.50:0/3153297755 learned_addr learned my addr 172.21.15.50:0/3153297755 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:22:41.568 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:41.565+0000 7faedfe00640 1 --2- 172.21.15.50:0/3153297755 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faee010fd10 0x7faee01a1ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:22:41.568 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:41.566+0000 7faedea00640 1 -- 172.21.15.50:0/3153297755 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faee010fd10 msgr2=0x7faee01a1ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:22:41.568 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:41.566+0000 7faedea00640 1 --2- 172.21.15.50:0/3153297755 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faee010fd10 0x7faee01a1ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:41.568 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:41.566+0000 7faedea00640 1 -- 172.21.15.50:0/3153297755 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faee00754d0 msgr2=0x7faee019c2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:22:41.568 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:41.566+0000 7faedea00640 1 --2- 172.21.15.50:0/3153297755 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faee00754d0 0x7faee019c2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:41.568 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:41.566+0000 7faedea00640 1 -- 172.21.15.50:0/3153297755 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faee01a2210 con 0x7faee0075e20 2024-08-31T04:22:41.568 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:41.566+0000 7faedf400640 1 --2- 172.21.15.50:0/3153297755 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faee00754d0 0x7faee019c2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:22:41.568 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:41.566+0000 7faedea00640 1 --2- 172.21.15.50:0/3153297755 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7faee0075e20 0x7faee019c840 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7faecc005fd0 tx=0x7faecc00dde0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:22:41.569 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:41.566+0000 7faed7e00640 1 -- 172.21.15.50:0/3153297755 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faecc009c00 con 0x7faee0075e20 2024-08-31T04:22:41.569 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:41.566+0000 7faee5200640 1 -- 172.21.15.50:0/3153297755 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faee01a2500 con 0x7faee0075e20 2024-08-31T04:22:41.569 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:41.566+0000 7faed7e00640 1 -- 172.21.15.50:0/3153297755 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7faecc009da0 con 0x7faee0075e20 2024-08-31T04:22:41.570 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:41.566+0000 7faed7e00640 1 -- 172.21.15.50:0/3153297755 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faecc003db0 con 0x7faee0075e20 2024-08-31T04:22:41.570 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:41.566+0000 7faee5200640 1 -- 172.21.15.50:0/3153297755 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faee01a8c60 con 0x7faee0075e20 2024-08-31T04:22:41.570 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:41.567+0000 7faee5200640 1 -- 172.21.15.50:0/3153297755 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faee00758e0 con 0x7faee0075e20 2024-08-31T04:22:41.572 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:41.571+0000 7faed7e00640 1 -- 172.21.15.50:0/3153297755 <== mon.1 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 18) ==== 152577+0+0 (secure 0 0 0) 0x7faecc003f50 con 0x7faee0075e20 2024-08-31T04:22:41.573 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:41.572+0000 7faed7e00640 1 --2- 172.21.15.50:0/3153297755 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7faec40b4b30 0x7faec40b7040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:41.573 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:41.572+0000 7faed7e00640 1 -- 172.21.15.50:0/3153297755 <== mon.1 v2:172.21.15.177:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8219+0+0 (secure 0 0 0) 0x7faecc0e4c90 con 0x7faee0075e20 2024-08-31T04:22:41.573 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:41.572+0000 7faedf400640 1 --2- 172.21.15.50:0/3153297755 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7faec40b4b30 0x7faec40b7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:22:41.574 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:41.573+0000 7faedf400640 1 --2- 172.21.15.50:0/3153297755 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7faec40b4b30 0x7faec40b7040 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7faed0031440 tx=0x7faed00058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:22:41.577 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:41.576+0000 7faed7e00640 1 -- 172.21.15.50:0/3153297755 <== mon.1 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7faecc017020 con 0x7faee0075e20 2024-08-31T04:22:41.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:22:41 smithi050 ceph-mon[17259]: pgmap v360: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 682 B/s wr, 9 op/s 2024-08-31T04:22:41.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:22:41 smithi133 ceph-mon[22177]: pgmap v360: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 682 B/s wr, 9 op/s 2024-08-31T04:22:41.809 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:41.808+0000 7faee5200640 1 -- 172.21.15.50:0/3153297755 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7faee01a8ee0 con 0x7faee0075e20 2024-08-31T04:22:41.810 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:41.809+0000 7faed7e00640 1 -- 172.21.15.50:0/3153297755 <== mon.1 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11983 (secure 0 0 0) 0x7faecc0ab720 con 0x7faee0075e20 2024-08-31T04:22:41.811 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-08-31T04:22:41.811 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":28,"btime":"2024-08-31T04:21:02:045794+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14622,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/1565557530","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":1565557530},{"type":"v1","addr":"172.21.15.50:6835","nonce":1565557530}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14634,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6837/2660185946","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6836","nonce":2660185946},{"type":"v1","addr":"172.21.15.50:6837","nonce":2660185946}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-31T04:20:44.140709+0000","modified":"2024-08-31T04:21:02.045763+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24695,"mds_1":24691,"mds_2":24667,"mds_3":24656,"mds_4":24652},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14676":{"gid":14676,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.50:6839/2105228685","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6838","nonce":2105228685},{"type":"v1","addr":"172.21.15.50:6839","nonce":2105228685}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24590":{"gid":24590,"name":"k","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.133:6833/4283603962","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6832","nonce":4283603962},{"type":"v1","addr":"172.21.15.133:6833","nonce":4283603962}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24601":{"gid":24601,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.177:6833/1237129793","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":1237129793},{"type":"v1","addr":"172.21.15.177:6833","nonce":1237129793}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24626":{"gid":24626,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.133:6835/3637799701","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":3637799701},{"type":"v1","addr":"172.21.15.133:6835","nonce":3637799701}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24640":{"gid":24640,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.177:6835/599392457","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6834","nonce":599392457},{"type":"v1","addr":"172.21.15.177:6835","nonce":599392457}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24652":{"gid":24652,"name":"c","rank":4,"incarnation":26,"state":"up:active","state_seq":13,"addr":"172.21.15.177:6837/2159859285","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6836","nonce":2159859285},{"type":"v1","addr":"172.21.15.177:6837","nonce":2159859285}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24656":{"gid":24656,"name":"h","rank":3,"incarnation":22,"state":"up:active","state_seq":12,"addr":"172.21.15.133:6837/4014853202","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6836","nonce":4014853202},{"type":"v1","addr":"172.21.15.133:6837","nonce":4014853202}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24667":{"gid":24667,"name":"i","rank":2,"incarnation":20,"state":"up:active","state_seq":10,"addr":"172.21.15.177:6839/3600081752","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6838","nonce":3600081752},{"type":"v1","addr":"172.21.15.177:6839","nonce":3600081752}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24691":{"gid":24691,"name":"a","rank":1,"incarnation":18,"state":"up:active","state_seq":8,"addr":"172.21.15.50:6841/575209862","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6840","nonce":575209862},{"type":"v1","addr":"172.21.15.50:6841","nonce":575209862}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24695":{"gid":24695,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.133:6839/2526402262","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6838","nonce":2526402262},{"type":"v1","addr":"172.21.15.133:6839","nonce":2526402262}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24695,"qdb_cluster":[24667,24695,24656,24691,24652]},"id":1}]} 2024-08-31T04:22:41.811 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 28 2024-08-31T04:22:41.813 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:41.811+0000 7faee5200640 1 -- 172.21.15.50:0/3153297755 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7faec40b4b30 msgr2=0x7faec40b7040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:22:41.813 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:41.811+0000 7faee5200640 1 --2- 172.21.15.50:0/3153297755 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7faec40b4b30 0x7faec40b7040 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7faed0031440 tx=0x7faed00058d0 comp rx=0 tx=0).stop 2024-08-31T04:22:41.813 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:41.811+0000 7faee5200640 1 -- 172.21.15.50:0/3153297755 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7faee0075e20 msgr2=0x7faee019c840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:22:41.813 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:41.812+0000 7faee5200640 1 --2- 172.21.15.50:0/3153297755 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7faee0075e20 0x7faee019c840 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7faecc005fd0 tx=0x7faecc00dde0 comp rx=0 tx=0).stop 2024-08-31T04:22:41.813 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:41.812+0000 7faee5200640 1 -- 172.21.15.50:0/3153297755 shutdown_connections 2024-08-31T04:22:41.813 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:41.812+0000 7faee5200640 1 --2- 172.21.15.50:0/3153297755 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7faec40b4b30 0x7faec40b7040 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:41.813 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:41.812+0000 7faee5200640 1 --2- 172.21.15.50:0/3153297755 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7faee0075e20 0x7faee019c840 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:41.814 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:41.812+0000 7faee5200640 1 --2- 172.21.15.50:0/3153297755 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faee010fd10 0x7faee01a1ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:41.814 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:41.812+0000 7faee5200640 1 --2- 172.21.15.50:0/3153297755 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faee00754d0 0x7faee019c2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:41.814 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:41.812+0000 7faee5200640 1 -- 172.21.15.50:0/3153297755 >> 172.21.15.50:0/3153297755 conn(0x7faee00ff180 msgr2=0x7faee01098b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:22:41.814 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:41.812+0000 7faee5200640 1 -- 172.21.15.50:0/3153297755 shutdown_connections 2024-08-31T04:22:41.814 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:41.812+0000 7faee5200640 1 -- 172.21.15.50:0/3153297755 wait complete. 2024-08-31T04:22:41.996 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:22:41 smithi177 ceph-mon[22025]: pgmap v360: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 682 B/s wr, 9 op/s 2024-08-31T04:22:42.565 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 058d9fc6-674f-11ef-bcd4-c7b262605968 -- ceph osd dump --format=json 2024-08-31T04:22:42.944 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:22:42.950 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:22:42 smithi050 ceph-mon[17259]: from='client.? 172.21.15.50:0/3153297755' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T04:22:42.996 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:22:42 smithi177 ceph-mon[22025]: from='client.? 172.21.15.50:0/3153297755' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T04:22:43.042 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:22:42 smithi133 ceph-mon[22177]: from='client.? 172.21.15.50:0/3153297755' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T04:22:43.607 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:43.606+0000 7fd7eb200640 1 -- 172.21.15.50:0/93237370 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd7ec114020 msgr2=0x7fd7ec1164f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:22:43.608 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:43.606+0000 7fd7eb200640 1 --2- 172.21.15.50:0/93237370 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd7ec114020 0x7fd7ec1164f0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fd7e4009ca0 tx=0x7fd7e402a8c0 comp rx=0 tx=0).stop 2024-08-31T04:22:43.608 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:43.606+0000 7fd7eb200640 1 -- 172.21.15.50:0/93237370 shutdown_connections 2024-08-31T04:22:43.608 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:43.606+0000 7fd7eb200640 1 --2- 172.21.15.50:0/93237370 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd7ec075b70 0x7fd7ec075f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:43.608 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:43.606+0000 7fd7eb200640 1 --2- 172.21.15.50:0/93237370 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd7ec114020 0x7fd7ec1164f0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:43.608 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:43.606+0000 7fd7eb200640 1 --2- 172.21.15.50:0/93237370 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd7ec077120 0x7fd7ec075550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:43.608 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:43.606+0000 7fd7eb200640 1 -- 172.21.15.50:0/93237370 >> 172.21.15.50:0/93237370 conn(0x7fd7ec0ff1e0 msgr2=0x7fd7ec101630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:22:43.608 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:43.606+0000 7fd7eb200640 1 -- 172.21.15.50:0/93237370 shutdown_connections 2024-08-31T04:22:43.608 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:43.606+0000 7fd7eb200640 1 -- 172.21.15.50:0/93237370 wait complete. 2024-08-31T04:22:43.609 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:43.607+0000 7fd7eb200640 1 Processor -- start 2024-08-31T04:22:43.609 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:43.608+0000 7fd7eb200640 1 -- start start 2024-08-31T04:22:43.610 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:43.608+0000 7fd7eb200640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd7ec075b70 0x7fd7ec1a0620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:43.610 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:43.608+0000 7fd7eb200640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd7ec077120 0x7fd7ec1a0bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:43.610 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:43.608+0000 7fd7eb200640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd7ec114020 0x7fd7ec1a5e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:43.610 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:43.608+0000 7fd7eb200640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fd7ec119cb0 con 0x7fd7ec075b70 2024-08-31T04:22:43.610 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:43.608+0000 7fd7eb200640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7fd7ec119b30 con 0x7fd7ec114020 2024-08-31T04:22:43.610 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:43.608+0000 7fd7eb200640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fd7ec119e30 con 0x7fd7ec077120 2024-08-31T04:22:43.611 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:43.609+0000 7fd7e9e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd7ec075b70 0x7fd7ec1a0620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:22:43.611 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:43.609+0000 7fd7e9e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd7ec075b70 0x7fd7ec1a0620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:39606/0 (socket says 172.21.15.50:39606) 2024-08-31T04:22:43.611 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:43.609+0000 7fd7e9e00640 1 -- 172.21.15.50:0/3672691553 learned_addr learned my addr 172.21.15.50:0/3672691553 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:22:43.611 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:43.609+0000 7fd7e9400640 1 --2- 172.21.15.50:0/3672691553 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd7ec077120 0x7fd7ec1a0bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:22:43.611 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:43.609+0000 7fd7ea800640 1 --2- 172.21.15.50:0/3672691553 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd7ec114020 0x7fd7ec1a5e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:22:43.611 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:43.609+0000 7fd7e9e00640 1 -- 172.21.15.50:0/3672691553 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd7ec077120 msgr2=0x7fd7ec1a0bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:22:43.612 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:43.609+0000 7fd7e9e00640 1 --2- 172.21.15.50:0/3672691553 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd7ec077120 0x7fd7ec1a0bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:43.612 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:43.609+0000 7fd7e9e00640 1 -- 172.21.15.50:0/3672691553 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd7ec114020 msgr2=0x7fd7ec1a5e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:22:43.612 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:43.609+0000 7fd7e9e00640 1 --2- 172.21.15.50:0/3672691553 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd7ec114020 0x7fd7ec1a5e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:43.612 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:43.609+0000 7fd7e9e00640 1 -- 172.21.15.50:0/3672691553 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7ec1a6590 con 0x7fd7ec075b70 2024-08-31T04:22:43.612 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:43.610+0000 7fd7e9e00640 1 --2- 172.21.15.50:0/3672691553 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd7ec075b70 0x7fd7ec1a0620 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fd7dc00d950 tx=0x7fd7dc00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:22:43.612 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:43.610+0000 7fd7e2a00640 1 -- 172.21.15.50:0/3672691553 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7dc017030 con 0x7fd7ec075b70 2024-08-31T04:22:43.612 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:43.610+0000 7fd7e2a00640 1 -- 172.21.15.50:0/3672691553 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd7dc004020 con 0x7fd7ec075b70 2024-08-31T04:22:43.612 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:43.610+0000 7fd7e2a00640 1 -- 172.21.15.50:0/3672691553 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7dc0047a0 con 0x7fd7ec075b70 2024-08-31T04:22:43.612 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:43.610+0000 7fd7eb200640 1 -- 172.21.15.50:0/3672691553 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd7ec1a6880 con 0x7fd7ec075b70 2024-08-31T04:22:43.612 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:43.610+0000 7fd7eb200640 1 -- 172.21.15.50:0/3672691553 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd7ec1acfe0 con 0x7fd7ec075b70 2024-08-31T04:22:43.613 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:43.611+0000 7fd7eb200640 1 -- 172.21.15.50:0/3672691553 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd7ec075f80 con 0x7fd7ec075b70 2024-08-31T04:22:43.615 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:43.614+0000 7fd7e2a00640 1 -- 172.21.15.50:0/3672691553 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 18) ==== 152577+0+0 (secure 0 0 0) 0x7fd7dc009a30 con 0x7fd7ec075b70 2024-08-31T04:22:43.618 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:43.616+0000 7fd7e2a00640 1 --2- 172.21.15.50:0/3672691553 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fd7d00b4bb0 0x7fd7d00b70c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:43.618 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:43.616+0000 7fd7e2a00640 1 -- 172.21.15.50:0/3672691553 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8219+0+0 (secure 0 0 0) 0x7fd7dc0e50b0 con 0x7fd7ec075b70 2024-08-31T04:22:43.618 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:43.616+0000 7fd7e9400640 1 --2- 172.21.15.50:0/3672691553 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fd7d00b4bb0 0x7fd7d00b70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:22:43.618 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:43.617+0000 7fd7e9400640 1 --2- 172.21.15.50:0/3672691553 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fd7d00b4bb0 0x7fd7d00b70c0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fd7ec115ed0 tx=0x7fd7d800b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:22:43.619 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:43.618+0000 7fd7e2a00640 1 -- 172.21.15.50:0/3672691553 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fd7dc0ac270 con 0x7fd7ec075b70 2024-08-31T04:22:43.701 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:22:43 smithi050 ceph-mon[17259]: pgmap v361: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 597 B/s wr, 13 op/s 2024-08-31T04:22:43.816 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:43.814+0000 7fd7eb200640 1 -- 172.21.15.50:0/3672691553 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd7ec1a1750 con 0x7fd7ec075b70 2024-08-31T04:22:43.817 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:43.816+0000 7fd7e2a00640 1 -- 172.21.15.50:0/3672691553 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v78) ==== 74+0+22733 (secure 0 0 0) 0x7fd7dc0abb70 con 0x7fd7ec075b70 2024-08-31T04:22:43.818 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-08-31T04:22:43.818 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":78,"fsid":"058d9fc6-674f-11ef-bcd4-c7b262605968","created":"2024-08-31T04:11:59.576131+0000","modified":"2024-08-31T04:20:56.994402+0000","last_up_change":"2024-08-31T04:19:44.619590+0000","last_in_change":"2024-08-31T04:19:21.022096+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-31T04:15:46.229142+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-31T04:20:38.249458+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"76","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-31T04:20:40.929092+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"76","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"416ecbde-4a7b-4bd1-b377-490925a33ce1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":3831273843},{"type":"v1","addr":"172.21.15.50:6803","nonce":3831273843}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":3831273843},{"type":"v1","addr":"172.21.15.50:6805","nonce":3831273843}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":3831273843},{"type":"v1","addr":"172.21.15.50:6809","nonce":3831273843}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":3831273843},{"type":"v1","addr":"172.21.15.50:6807","nonce":3831273843}]},"public_addr":"172.21.15.50:6803/3831273843","cluster_addr":"172.21.15.50:6805/3831273843","heartbeat_back_addr":"172.21.15.50:6809/3831273843","heartbeat_front_addr":"172.21.15.50:6807/3831273843","state":["exists","up"]},{"osd":1,"uuid":"5e008006-004d-4842-9885-93a2d27be1cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":475308203},{"type":"v1","addr":"172.21.15.133:6801","nonce":475308203}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":475308203},{"type":"v1","addr":"172.21.15.133:6803","nonce":475308203}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":475308203},{"type":"v1","addr":"172.21.15.133:6807","nonce":475308203}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":475308203},{"type":"v1","addr":"172.21.15.133:6805","nonce":475308203}]},"public_addr":"172.21.15.133:6801/475308203","cluster_addr":"172.21.15.133:6803/475308203","heartbeat_back_addr":"172.21.15.133:6807/475308203","heartbeat_front_addr":"172.21.15.133:6805/475308203","state":["exists","up"]},{"osd":2,"uuid":"7e6f1a26-f30d-4822-af69-8a08cb89fbce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":3091173426},{"type":"v1","addr":"172.21.15.177:6801","nonce":3091173426}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":3091173426},{"type":"v1","addr":"172.21.15.177:6803","nonce":3091173426}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":3091173426},{"type":"v1","addr":"172.21.15.177:6807","nonce":3091173426}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":3091173426},{"type":"v1","addr":"172.21.15.177:6805","nonce":3091173426}]},"public_addr":"172.21.15.177:6801/3091173426","cluster_addr":"172.21.15.177:6803/3091173426","heartbeat_back_addr":"172.21.15.177:6807/3091173426","heartbeat_front_addr":"172.21.15.177:6805/3091173426","state":["exists","up"]},{"osd":3,"uuid":"8193c2a2-18a1-4684-9a16-cbeae25530ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":3792992620},{"type":"v1","addr":"172.21.15.50:6811","nonce":3792992620}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":3792992620},{"type":"v1","addr":"172.21.15.50:6813","nonce":3792992620}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":3792992620},{"type":"v1","addr":"172.21.15.50:6817","nonce":3792992620}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":3792992620},{"type":"v1","addr":"172.21.15.50:6815","nonce":3792992620}]},"public_addr":"172.21.15.50:6811/3792992620","cluster_addr":"172.21.15.50:6813/3792992620","heartbeat_back_addr":"172.21.15.50:6817/3792992620","heartbeat_front_addr":"172.21.15.50:6815/3792992620","state":["exists","up"]},{"osd":4,"uuid":"2a2b4e64-0f8e-40ec-926c-84dbf691aefe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":2855333596},{"type":"v1","addr":"172.21.15.133:6809","nonce":2855333596}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":2855333596},{"type":"v1","addr":"172.21.15.133:6811","nonce":2855333596}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":2855333596},{"type":"v1","addr":"172.21.15.133:6815","nonce":2855333596}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":2855333596},{"type":"v1","addr":"172.21.15.133:6813","nonce":2855333596}]},"public_addr":"172.21.15.133:6809/2855333596","cluster_addr":"172.21.15.133:6811/2855333596","heartbeat_back_addr":"172.21.15.133:6815/2855333596","heartbeat_front_addr":"172.21.15.133:6813/2855333596","state":["exists","up"]},{"osd":5,"uuid":"83429ff0-ea7d-4fcc-9611-39d9001aa216","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":1166415084},{"type":"v1","addr":"172.21.15.177:6809","nonce":1166415084}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":1166415084},{"type":"v1","addr":"172.21.15.177:6811","nonce":1166415084}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":1166415084},{"type":"v1","addr":"172.21.15.177:6815","nonce":1166415084}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":1166415084},{"type":"v1","addr":"172.21.15.177:6813","nonce":1166415084}]},"public_addr":"172.21.15.177:6809/1166415084","cluster_addr":"172.21.15.177:6811/1166415084","heartbeat_back_addr":"172.21.15.177:6815/1166415084","heartbeat_front_addr":"172.21.15.177:6813/1166415084","state":["exists","up"]},{"osd":6,"uuid":"eeb571ef-5e43-4816-95dd-d01d83aeca83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":1429341184},{"type":"v1","addr":"172.21.15.50:6819","nonce":1429341184}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":1429341184},{"type":"v1","addr":"172.21.15.50:6821","nonce":1429341184}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":1429341184},{"type":"v1","addr":"172.21.15.50:6825","nonce":1429341184}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":1429341184},{"type":"v1","addr":"172.21.15.50:6823","nonce":1429341184}]},"public_addr":"172.21.15.50:6819/1429341184","cluster_addr":"172.21.15.50:6821/1429341184","heartbeat_back_addr":"172.21.15.50:6825/1429341184","heartbeat_front_addr":"172.21.15.50:6823/1429341184","state":["exists","up"]},{"osd":7,"uuid":"512ee507-0d50-4fed-b692-dbdf23a93e8e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":3643454923},{"type":"v1","addr":"172.21.15.133:6817","nonce":3643454923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":3643454923},{"type":"v1","addr":"172.21.15.133:6819","nonce":3643454923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":3643454923},{"type":"v1","addr":"172.21.15.133:6823","nonce":3643454923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":3643454923},{"type":"v1","addr":"172.21.15.133:6821","nonce":3643454923}]},"public_addr":"172.21.15.133:6817/3643454923","cluster_addr":"172.21.15.133:6819/3643454923","heartbeat_back_addr":"172.21.15.133:6823/3643454923","heartbeat_front_addr":"172.21.15.133:6821/3643454923","state":["exists","up"]},{"osd":8,"uuid":"ae99526e-41da-4cb5-857f-2e66f18f2d94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6816","nonce":101973300},{"type":"v1","addr":"172.21.15.177:6817","nonce":101973300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":101973300},{"type":"v1","addr":"172.21.15.177:6819","nonce":101973300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":101973300},{"type":"v1","addr":"172.21.15.177:6823","nonce":101973300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":101973300},{"type":"v1","addr":"172.21.15.177:6821","nonce":101973300}]},"public_addr":"172.21.15.177:6817/101973300","cluster_addr":"172.21.15.177:6819/101973300","heartbeat_back_addr":"172.21.15.177:6823/101973300","heartbeat_front_addr":"172.21.15.177:6821/101973300","state":["exists","up"]},{"osd":9,"uuid":"fcedbe16-b910-407f-b9d7-1dd03f3e62a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":53019860},{"type":"v1","addr":"172.21.15.50:6827","nonce":53019860}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":53019860},{"type":"v1","addr":"172.21.15.50:6829","nonce":53019860}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":53019860},{"type":"v1","addr":"172.21.15.50:6833","nonce":53019860}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":53019860},{"type":"v1","addr":"172.21.15.50:6831","nonce":53019860}]},"public_addr":"172.21.15.50:6827/53019860","cluster_addr":"172.21.15.50:6829/53019860","heartbeat_back_addr":"172.21.15.50:6833/53019860","heartbeat_front_addr":"172.21.15.50:6831/53019860","state":["exists","up"]},{"osd":10,"uuid":"3852756e-62f1-4e71-a070-8cff76df99b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":4175566493},{"type":"v1","addr":"172.21.15.133:6825","nonce":4175566493}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":4175566493},{"type":"v1","addr":"172.21.15.133:6827","nonce":4175566493}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":4175566493},{"type":"v1","addr":"172.21.15.133:6831","nonce":4175566493}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":4175566493},{"type":"v1","addr":"172.21.15.133:6829","nonce":4175566493}]},"public_addr":"172.21.15.133:6825/4175566493","cluster_addr":"172.21.15.133:6827/4175566493","heartbeat_back_addr":"172.21.15.133:6831/4175566493","heartbeat_front_addr":"172.21.15.133:6829/4175566493","state":["exists","up"]},{"osd":11,"uuid":"a154180a-5f2a-4b33-ad3d-fea7317597ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":2103454982},{"type":"v1","addr":"172.21.15.177:6825","nonce":2103454982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":2103454982},{"type":"v1","addr":"172.21.15.177:6827","nonce":2103454982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":2103454982},{"type":"v1","addr":"172.21.15.177:6831","nonce":2103454982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":2103454982},{"type":"v1","addr":"172.21.15.177:6829","nonce":2103454982}]},"public_addr":"172.21.15.177:6825/2103454982","cluster_addr":"172.21.15.177:6827/2103454982","heartbeat_back_addr":"172.21.15.177:6831/2103454982","heartbeat_front_addr":"172.21.15.177:6829/2103454982","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:14:54.683660+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:15:20.007319+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:15:43.613426+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:16:12.387010+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:16:38.079210+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:17:02.750375+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:17:31.735810+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:17:57.600985+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:18:22.503347+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:18:52.316657+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:19:18.444623+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:19:42.331006+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.b","mappings":[{"from":2,"to":4},{"from":8,"to":11}]},{"pgid":"2.1b","mappings":[{"from":2,"to":1}]},{"pgid":"2.1d","mappings":[{"from":8,"to":11}]},{"pgid":"3.e","mappings":[{"from":4,"to":6}]},{"pgid":"3.17","mappings":[{"from":4,"to":8}]},{"pgid":"3.25","mappings":[{"from":5,"to":9}]},{"pgid":"3.29","mappings":[{"from":3,"to":9}]},{"pgid":"3.36","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.50:6801/1319056820":"2024-09-01T04:12:55.742020+0000","172.21.15.50:0/1755103674":"2024-09-01T04:12:55.742020+0000","172.21.15.50:6800/1319056820":"2024-09-01T04:12:55.742020+0000","172.21.15.50:0/3701412233":"2024-09-01T04:12:55.742020+0000","172.21.15.50:0/1829556336":"2024-09-01T04:12:55.742020+0000","172.21.15.50:0/1698995126":"2024-09-01T04:12:25.753831+0000","172.21.15.50:0/1554317941":"2024-09-01T04:12:25.753831+0000","172.21.15.50:0/2998110380":"2024-09-01T04:12:25.753831+0000","172.21.15.50:6801/4197277793":"2024-09-01T04:12:25.753831+0000","172.21.15.50:6800/4197277793":"2024-09-01T04:12:25.753831+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-31T04:22:43.820 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:43.818+0000 7fd7eb200640 1 -- 172.21.15.50:0/3672691553 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fd7d00b4bb0 msgr2=0x7fd7d00b70c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:22:43.820 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:43.818+0000 7fd7eb200640 1 --2- 172.21.15.50:0/3672691553 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fd7d00b4bb0 0x7fd7d00b70c0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fd7ec115ed0 tx=0x7fd7d800b390 comp rx=0 tx=0).stop 2024-08-31T04:22:43.820 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:43.818+0000 7fd7eb200640 1 -- 172.21.15.50:0/3672691553 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd7ec075b70 msgr2=0x7fd7ec1a0620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:22:43.820 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:43.818+0000 7fd7eb200640 1 --2- 172.21.15.50:0/3672691553 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd7ec075b70 0x7fd7ec1a0620 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fd7dc00d950 tx=0x7fd7dc00de10 comp rx=0 tx=0).stop 2024-08-31T04:22:43.820 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:43.819+0000 7fd7eb200640 1 -- 172.21.15.50:0/3672691553 shutdown_connections 2024-08-31T04:22:43.820 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:43.819+0000 7fd7eb200640 1 --2- 172.21.15.50:0/3672691553 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fd7d00b4bb0 0x7fd7d00b70c0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:43.820 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:43.819+0000 7fd7eb200640 1 --2- 172.21.15.50:0/3672691553 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd7ec077120 0x7fd7ec1a0bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:43.820 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:43.819+0000 7fd7eb200640 1 --2- 172.21.15.50:0/3672691553 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd7ec114020 0x7fd7ec1a5e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:43.820 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:43.819+0000 7fd7eb200640 1 --2- 172.21.15.50:0/3672691553 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd7ec075b70 0x7fd7ec1a0620 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:43.821 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:43.819+0000 7fd7eb200640 1 -- 172.21.15.50:0/3672691553 >> 172.21.15.50:0/3672691553 conn(0x7fd7ec0ff1e0 msgr2=0x7fd7ec10ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:22:43.821 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:43.819+0000 7fd7eb200640 1 -- 172.21.15.50:0/3672691553 shutdown_connections 2024-08-31T04:22:43.821 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:43.819+0000 7fd7eb200640 1 -- 172.21.15.50:0/3672691553 wait complete. 2024-08-31T04:22:43.897 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:22:43 smithi177 ceph-mon[22025]: pgmap v361: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 597 B/s wr, 13 op/s 2024-08-31T04:22:43.944 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:22:43 smithi133 ceph-mon[22177]: pgmap v361: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 597 B/s wr, 13 op/s 2024-08-31T04:22:44.626 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 28, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-08-31T04:20:44.140709+0000', 'modified': '2024-08-31T04:21:02.045763+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 5, 'in': [0, 1, 2, 3, 4], 'up': {'mds_0': 24695, 'mds_1': 24691, 'mds_2': 24667, 'mds_3': 24656, 'mds_4': 24652}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_14676': {'gid': 14676, 'name': 'g', 'rank': 4, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.50:6839/2105228685', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.50:6838', 'nonce': 2105228685}, {'type': 'v1', 'addr': '172.21.15.50:6839', 'nonce': 2105228685}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24590': {'gid': 24590, 'name': 'k', 'rank': 3, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.133:6833/4283603962', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.133:6832', 'nonce': 4283603962}, {'type': 'v1', 'addr': '172.21.15.133:6833', 'nonce': 4283603962}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24601': {'gid': 24601, 'name': 'l', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.177:6833/1237129793', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.177:6832', 'nonce': 1237129793}, {'type': 'v1', 'addr': '172.21.15.177:6833', 'nonce': 1237129793}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24626': {'gid': 24626, 'name': 'e', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.133:6835/3637799701', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.133:6834', 'nonce': 3637799701}, {'type': 'v1', 'addr': '172.21.15.133:6835', 'nonce': 3637799701}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24640': {'gid': 24640, 'name': 'f', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.177:6835/599392457', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.177:6834', 'nonce': 599392457}, {'type': 'v1', 'addr': '172.21.15.177:6835', 'nonce': 599392457}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24652': {'gid': 24652, 'name': 'c', 'rank': 4, 'incarnation': 26, 'state': 'up:active', 'state_seq': 13, 'addr': '172.21.15.177:6837/2159859285', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.177:6836', 'nonce': 2159859285}, {'type': 'v1', 'addr': '172.21.15.177:6837', 'nonce': 2159859285}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24656': {'gid': 24656, 'name': 'h', 'rank': 3, 'incarnation': 22, 'state': 'up:active', 'state_seq': 12, 'addr': '172.21.15.133:6837/4014853202', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.133:6836', 'nonce': 4014853202}, {'type': 'v1', 'addr': '172.21.15.133:6837', 'nonce': 4014853202}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24667': {'gid': 24667, 'name': 'i', 'rank': 2, 'incarnation': 20, 'state': 'up:active', 'state_seq': 10, 'addr': '172.21.15.177:6839/3600081752', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.177:6838', 'nonce': 3600081752}, {'type': 'v1', 'addr': '172.21.15.177:6839', 'nonce': 3600081752}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24691': {'gid': 24691, 'name': 'a', 'rank': 1, 'incarnation': 18, 'state': 'up:active', 'state_seq': 8, 'addr': '172.21.15.50:6841/575209862', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.50:6840', 'nonce': 575209862}, {'type': 'v1', 'addr': '172.21.15.50:6841', 'nonce': 575209862}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24695': {'gid': 24695, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 5, 'addr': '172.21.15.133:6839/2526402262', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.133:6838', 'nonce': 2526402262}, {'type': 'v1', 'addr': '172.21.15.133:6839', 'nonce': 2526402262}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24695, 'qdb_cluster': [24667, 24695, 24656, 24691, 24652]} 2024-08-31T04:22:44.627 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 5/5 2024-08-31T04:22:44.627 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 058d9fc6-674f-11ef-bcd4-c7b262605968 -- ceph tell mds.c status 2024-08-31T04:22:44.950 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:22:44 smithi050 ceph-mon[17259]: from='client.? 172.21.15.50:0/3672691553' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-31T04:22:44.996 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:22:44 smithi177 ceph-mon[22025]: from='client.? 172.21.15.50:0/3672691553' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-31T04:22:45.021 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:22:45.042 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:22:44 smithi133 ceph-mon[22177]: from='client.? 172.21.15.50:0/3672691553' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-31T04:22:45.593 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:22:45 smithi050 ceph-mon[17259]: pgmap v362: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-08-31T04:22:45.672 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:45.670+0000 7fd144800640 1 -- 172.21.15.50:0/1781284557 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd13c075ea0 msgr2=0x7fd13c10f920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:22:45.672 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:45.670+0000 7fd144800640 1 --2- 172.21.15.50:0/1781284557 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd13c075ea0 0x7fd13c10f920 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fd12c009900 tx=0x7fd12c02a410 comp rx=0 tx=0).stop 2024-08-31T04:22:45.672 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:45.670+0000 7fd144800640 1 -- 172.21.15.50:0/1781284557 shutdown_connections 2024-08-31T04:22:45.672 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:45.670+0000 7fd144800640 1 --2- 172.21.15.50:0/1781284557 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd13c10fe60 0x7fd13c1122a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:45.672 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:45.670+0000 7fd144800640 1 --2- 172.21.15.50:0/1781284557 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd13c075ea0 0x7fd13c10f920 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:45.672 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:45.670+0000 7fd144800640 1 --2- 172.21.15.50:0/1781284557 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd13c075550 0x7fd13c075960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:45.672 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:45.670+0000 7fd144800640 1 -- 172.21.15.50:0/1781284557 >> 172.21.15.50:0/1781284557 conn(0x7fd13c07b5f0 msgr2=0x7fd13c07ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:22:45.672 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:45.670+0000 7fd144800640 1 -- 172.21.15.50:0/1781284557 shutdown_connections 2024-08-31T04:22:45.672 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:45.670+0000 7fd144800640 1 -- 172.21.15.50:0/1781284557 wait complete. 2024-08-31T04:22:45.673 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:45.671+0000 7fd144800640 1 Processor -- start 2024-08-31T04:22:45.673 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:45.671+0000 7fd144800640 1 -- start start 2024-08-31T04:22:45.674 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:45.672+0000 7fd144800640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd13c075550 0x7fd13c19c410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:45.674 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:45.672+0000 7fd144800640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd13c075ea0 0x7fd13c19c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:45.674 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:45.672+0000 7fd144800640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd13c10fe60 0x7fd13c1a1c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:45.674 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:45.672+0000 7fd144800640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fd13c115a60 con 0x7fd13c10fe60 2024-08-31T04:22:45.674 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:45.672+0000 7fd144800640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7fd13c1158e0 con 0x7fd13c075ea0 2024-08-31T04:22:45.674 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:45.672+0000 7fd144800640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fd13c115be0 con 0x7fd13c075550 2024-08-31T04:22:45.674 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:45.672+0000 7fd142800640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd13c10fe60 0x7fd13c1a1c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:22:45.674 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:45.672+0000 7fd141e00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd13c075550 0x7fd13c19c410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:22:45.674 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:45.672+0000 7fd142800640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd13c10fe60 0x7fd13c1a1c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:39626/0 (socket says 172.21.15.50:39626) 2024-08-31T04:22:45.674 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:45.672+0000 7fd142800640 1 -- 172.21.15.50:0/2746507464 learned_addr learned my addr 172.21.15.50:0/2746507464 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:22:45.675 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:45.672+0000 7fd141400640 1 --2- 172.21.15.50:0/2746507464 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd13c075ea0 0x7fd13c19c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:22:45.675 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:45.672+0000 7fd142800640 1 -- 172.21.15.50:0/2746507464 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd13c075550 msgr2=0x7fd13c19c410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:22:45.675 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:45.672+0000 7fd142800640 1 --2- 172.21.15.50:0/2746507464 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd13c075550 0x7fd13c19c410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:45.675 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:45.672+0000 7fd142800640 1 -- 172.21.15.50:0/2746507464 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd13c075ea0 msgr2=0x7fd13c19c9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:22:45.675 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:45.672+0000 7fd142800640 1 --2- 172.21.15.50:0/2746507464 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd13c075ea0 0x7fd13c19c9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:45.675 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:45.672+0000 7fd142800640 1 -- 172.21.15.50:0/2746507464 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd13c1a2380 con 0x7fd13c10fe60 2024-08-31T04:22:45.675 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:45.672+0000 7fd141e00640 1 --2- 172.21.15.50:0/2746507464 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd13c075550 0x7fd13c19c410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:22:45.676 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:45.673+0000 7fd142800640 1 --2- 172.21.15.50:0/2746507464 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd13c10fe60 0x7fd13c1a1c50 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fd13800eb10 tx=0x7fd13800c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:22:45.676 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:45.673+0000 7fd136a00640 1 -- 172.21.15.50:0/2746507464 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd138004b20 con 0x7fd13c10fe60 2024-08-31T04:22:45.676 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:45.673+0000 7fd136a00640 1 -- 172.21.15.50:0/2746507464 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd138004cc0 con 0x7fd13c10fe60 2024-08-31T04:22:45.676 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:45.673+0000 7fd144800640 1 -- 172.21.15.50:0/2746507464 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd13c1a2670 con 0x7fd13c10fe60 2024-08-31T04:22:45.676 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:45.673+0000 7fd136a00640 1 -- 172.21.15.50:0/2746507464 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd138010670 con 0x7fd13c10fe60 2024-08-31T04:22:45.676 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:45.673+0000 7fd144800640 1 -- 172.21.15.50:0/2746507464 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd13c1a8dd0 con 0x7fd13c10fe60 2024-08-31T04:22:45.677 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:45.676+0000 7fd14b4be740 1 Processor -- start 2024-08-31T04:22:45.678 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:45.677+0000 7fd136a00640 1 -- 172.21.15.50:0/2746507464 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 18) ==== 152577+0+0 (secure 0 0 0) 0x7fd138005020 con 0x7fd13c10fe60 2024-08-31T04:22:45.678 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:45.677+0000 7fd14b4be740 1 -- start start 2024-08-31T04:22:45.679 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:45.678+0000 7fd14b4be740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55e37006cf60 0x55e3704128f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:45.679 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:45.678+0000 7fd14b4be740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e3700440a0 0x55e370412e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:45.679 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:45.678+0000 7fd14b4be740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e37004c280 0x55e370413370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:45.679 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:45.678+0000 7fd14b4be740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55e370389550 con 0x55e37004c280 2024-08-31T04:22:45.680 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:45.678+0000 7fd14b4be740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x55e370378ae0 con 0x55e37006cf60 2024-08-31T04:22:45.680 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:45.678+0000 7fd14b4be740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x55e37037ca90 con 0x55e3700440a0 2024-08-31T04:22:45.680 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:45.678+0000 7fd141400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55e37006cf60 0x55e3704128f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:22:45.680 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:45.678+0000 7fd141e00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e3700440a0 0x55e370412e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:22:45.680 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:45.678+0000 7fd141400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55e37006cf60 0x55e3704128f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.50:58882/0 (socket says 172.21.15.50:58882) 2024-08-31T04:22:45.680 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:45.678+0000 7fd141400640 1 -- 172.21.15.50:0/1765667869 learned_addr learned my addr 172.21.15.50:0/1765667869 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:22:45.680 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:45.678+0000 7fd141e00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e3700440a0 0x55e370412e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.50:53548/0 (socket says 172.21.15.50:53548) 2024-08-31T04:22:45.680 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:45.678+0000 7fd141400640 1 --2- 172.21.15.50:0/1765667869 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e37004c280 0x55e370413370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:22:45.681 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:45.678+0000 7fd141e00640 1 -- 172.21.15.50:0/1765667869 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55e37006cf60 msgr2=0x55e3704128f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:22:45.681 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:45.678+0000 7fd141e00640 1 --2- 172.21.15.50:0/1765667869 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55e37006cf60 0x55e3704128f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:45.681 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:45.679+0000 7fd141e00640 1 -- 172.21.15.50:0/1765667869 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e37004c280 msgr2=0x55e370413370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:22:45.681 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:45.679+0000 7fd141e00640 1 --2- 172.21.15.50:0/1765667869 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e37004c280 0x55e370413370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:45.681 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:45.679+0000 7fd141e00640 1 -- 172.21.15.50:0/1765667869 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e3700d8540 con 0x55e3700440a0 2024-08-31T04:22:45.681 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:45.679+0000 7fd141400640 1 --2- 172.21.15.50:0/1765667869 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e37004c280 0x55e370413370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:22:45.681 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:45.679+0000 7fd141e00640 1 --2- 172.21.15.50:0/1765667869 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e3700440a0 0x55e370412e30 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fd130005fd0 tx=0x7fd130010930 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5803f7bc78ec72de server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:22:45.682 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:45.679+0000 7fd136a00640 1 --2- 172.21.15.50:0/2746507464 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fd1240b4b30 0x7fd1240b7040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:45.682 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:45.679+0000 7fd12b000640 1 -- 172.21.15.50:0/1765667869 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd130011760 con 0x55e3700440a0 2024-08-31T04:22:45.682 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:45.679+0000 7fd136a00640 1 -- 172.21.15.50:0/2746507464 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8219+0+0 (secure 0 0 0) 0x7fd1380e56b0 con 0x7fd13c10fe60 2024-08-31T04:22:45.682 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:45.679+0000 7fd12b000640 1 -- 172.21.15.50:0/1765667869 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd130011db0 con 0x55e3700440a0 2024-08-31T04:22:45.682 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:45.679+0000 7fd12b000640 1 -- 172.21.15.50:0/1765667869 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd13001a380 con 0x55e3700440a0 2024-08-31T04:22:45.682 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:45.679+0000 7fd141400640 1 --2- 172.21.15.50:0/2746507464 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fd1240b4b30 0x7fd1240b7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:22:45.683 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:45.680+0000 7fd14b4be740 1 -- 172.21.15.50:0/1765667869 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e3700440a0 msgr2=0x55e370412e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:22:45.683 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:45.680+0000 7fd141400640 1 --2- 172.21.15.50:0/2746507464 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fd1240b4b30 0x7fd1240b7040 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fd12c005f70 tx=0x7fd12c005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:22:45.683 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:45.680+0000 7fd14b4be740 1 --2- 172.21.15.50:0/1765667869 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e3700440a0 0x55e370412e30 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fd130005fd0 tx=0x7fd130010930 comp rx=0 tx=0).stop 2024-08-31T04:22:45.684 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:45.680+0000 7fd14b4be740 1 -- 172.21.15.50:0/1765667869 shutdown_connections 2024-08-31T04:22:45.684 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:45.680+0000 7fd14b4be740 1 --2- 172.21.15.50:0/1765667869 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e3700440a0 0x55e370412e30 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:45.684 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:45.680+0000 7fd14b4be740 1 --2- 172.21.15.50:0/1765667869 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e37004c280 0x55e370413370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:45.684 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:45.680+0000 7fd14b4be740 1 --2- 172.21.15.50:0/1765667869 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55e37006cf60 0x55e3704128f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:45.684 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:45.680+0000 7fd14b4be740 1 -- 172.21.15.50:0/1765667869 >> 172.21.15.50:0/1765667869 conn(0x55e370061350 msgr2=0x55e3704107e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:22:45.684 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:45.680+0000 7fd14b4be740 1 -- 172.21.15.50:0/1765667869 shutdown_connections 2024-08-31T04:22:45.684 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:45.681+0000 7fd14b4be740 1 -- 172.21.15.50:0/1765667869 wait complete. 2024-08-31T04:22:45.684 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:45.681+0000 7fd14b4be740 1 -- start start 2024-08-31T04:22:45.684 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:45.681+0000 7fd14b4be740 1 Processor -- start 2024-08-31T04:22:45.684 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:45.682+0000 7fd14b4be740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e3700440a0 0x55e37041e080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:45.684 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:45.682+0000 7fd14b4be740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e37004c280 0x55e37041e5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:45.684 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:45.682+0000 7fd14b4be740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55e37006cf60 0x55e37042a3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:45.684 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:45.682+0000 7fd14b4be740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55e3701db5f0 con 0x55e37004c280 2024-08-31T04:22:45.685 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:45.682+0000 7fd14b4be740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x55e3702ffbd0 con 0x55e37006cf60 2024-08-31T04:22:45.685 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:45.682+0000 7fd14b4be740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x55e3704210d0 con 0x55e3700440a0 2024-08-31T04:22:45.685 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:45.682+0000 7fd14b4be740 10 client.0 _ll_register_callbacks cb 0x55e370325210 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:22:45.685 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:45.682+0000 7fd141e00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e3700440a0 0x55e37041e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:22:45.685 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:45.682+0000 7fd141400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e37004c280 0x55e37041e5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:22:45.685 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:45.682+0000 7fd141e00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e3700440a0 0x55e37041e080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.50:53564/0 (socket says 172.21.15.50:53564) 2024-08-31T04:22:45.685 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:45.682+0000 7fd142800640 1 --2- 172.21.15.50:0/2624855387 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55e37006cf60 0x55e37042a3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:22:45.685 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:45.682+0000 7fd141e00640 1 -- 172.21.15.50:0/2624855387 learned_addr learned my addr 172.21.15.50:0/2624855387 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:22:45.687 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:45.683+0000 7fd142800640 1 -- 172.21.15.50:0/2624855387 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e3700440a0 msgr2=0x55e37041e080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:22:45.687 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:45.683+0000 7fd142800640 1 --2- 172.21.15.50:0/2624855387 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e3700440a0 0x55e37041e080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:45.687 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:45.683+0000 7fd142800640 1 -- 172.21.15.50:0/2624855387 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e37004c280 msgr2=0x55e37041e5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:22:45.687 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:45.683+0000 7fd142800640 1 --2- 172.21.15.50:0/2624855387 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e37004c280 0x55e37041e5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:45.687 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:45.683+0000 7fd142800640 1 -- 172.21.15.50:0/2624855387 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e370340650 con 0x55e37006cf60 2024-08-31T04:22:45.687 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:45.683+0000 7fd141400640 1 --2- 172.21.15.50:0/2624855387 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e37004c280 0x55e37041e5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:22:45.687 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:45.683+0000 7fd142800640 1 --2- 172.21.15.50:0/2624855387 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55e37006cf60 0x55e37042a3f0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fd1380a9300 tx=0x7fd1380aba60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5eaf921336819bdc server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:22:45.687 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:45.683+0000 7fd11f400640 10 client.0 ms_handle_connect on v2:172.21.15.133:3300/0 2024-08-31T04:22:45.687 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:45.683+0000 7fd11f400640 1 -- 172.21.15.50:0/2624855387 <== mon.2 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1380d0030 con 0x55e37006cf60 2024-08-31T04:22:45.687 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:45.683+0000 7fd14b4be740 1 -- 172.21.15.50:0/2624855387 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd130011db0 con 0x55e37006cf60 2024-08-31T04:22:45.688 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:45.683+0000 7fd11f400640 1 -- 172.21.15.50:0/2624855387 <== mon.2 v2:172.21.15.133:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8219+0+0 (secure 0 0 0) 0x7fd1380a8680 con 0x55e37006cf60 2024-08-31T04:22:45.688 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:45.683+0000 7fd11f400640 1 -- 172.21.15.50:0/2624855387 <== mon.2 v2:172.21.15.133:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fd1380ac090 con 0x55e37006cf60 2024-08-31T04:22:45.688 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:45.683+0000 7fd14b4be740 10 client.25196 fetch_fsmap learned FSMap version 28 2024-08-31T04:22:45.688 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:45.683+0000 7fd14b4be740 1 -- 172.21.15.50:0/2624855387 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55e37042cf90 con 0x55e37006cf60 2024-08-31T04:22:45.688 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:45.684+0000 7fd11f400640 1 -- 172.21.15.50:0/2624855387 <== mon.2 v2:172.21.15.133:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd130011db0 con 0x55e37006cf60 2024-08-31T04:22:45.688 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:45.684+0000 7fd11f400640 1 -- 172.21.15.50:0/2624855387 <== mon.2 v2:172.21.15.133:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fd1380a7a00 con 0x55e37006cf60 2024-08-31T04:22:45.688 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:45.684+0000 7fd14b4be740 10 client.25196 fetch_fsmap finished waiting for FSMap version 28 2024-08-31T04:22:45.688 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:45.684+0000 7fd14b4be740 10 client.25196 resolve_mds: resolved name 'c' to daemon mds.c 2024-08-31T04:22:45.688 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:45.684+0000 7fd14b4be740 20 client.25196 populate_metadata read hostname 'smithi050' 2024-08-31T04:22:45.688 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:45.684+0000 7fd14b4be740 1 --2- 172.21.15.50:0/2624855387 >> [v2:172.21.15.177:6836/2159859285,v1:172.21.15.177:6837/2159859285] conn(0x55e37002b8e0 0x55e3704309c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:45.688 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:45.684+0000 7fd14b4be740 4 client.25196 mds_command: new command op to 24652 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T04:22:45.688 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:45.684+0000 7fd14b4be740 1 -- 172.21.15.50:0/2624855387 --> [v2:172.21.15.177:6836/2159859285,v1:172.21.15.177:6837/2159859285] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e37038b4a0 con 0x55e37002b8e0 2024-08-31T04:22:45.688 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:45.685+0000 7fd141e00640 1 --2- 172.21.15.50:0/2624855387 >> [v2:172.21.15.177:6836/2159859285,v1:172.21.15.177:6837/2159859285] conn(0x55e37002b8e0 0x55e3704309c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:22:45.688 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:45.685+0000 7fd141e00640 1 --2- 172.21.15.50:0/2624855387 >> [v2:172.21.15.177:6836/2159859285,v1:172.21.15.177:6837/2159859285] conn(0x55e37002b8e0 0x55e3704309c0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=fce29ef110dbdf3 server_cookie=17b6291a11b0897d in_seq=0 out_seq=0 2024-08-31T04:22:45.689 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:45.685+0000 7fd11f400640 10 client.25196 ms_handle_connect on v2:172.21.15.177:6836/2159859285 2024-08-31T04:22:45.689 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:45.686+0000 7fd11f400640 1 -- 172.21.15.50:0/2624855387 <== mds.4 v2:172.21.15.177:6836/2159859285 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55e37038b4a0 con 0x55e37002b8e0 2024-08-31T04:22:45.690 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:45.686+0000 7fd11f400640 10 client.25196 handle_command_reply: tid=0 2024-08-31T04:22:45.690 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:45.686+0000 7fd14b4be740 1 client.25196 shutdown 2024-08-31T04:22:45.690 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:45.686+0000 7fd14b4be740 1 -- 172.21.15.50:0/2624855387 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55e37006cf60 msgr2=0x55e37042a3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:22:45.690 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:45.686+0000 7fd14b4be740 1 --2- 172.21.15.50:0/2624855387 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55e37006cf60 0x55e37042a3f0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fd1380a9300 tx=0x7fd1380aba60 comp rx=0 tx=0).stop 2024-08-31T04:22:45.690 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:45.687+0000 7fd14b4be740 1 -- 172.21.15.50:0/2624855387 shutdown_connections 2024-08-31T04:22:45.690 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:45.687+0000 7fd14b4be740 1 --2- 172.21.15.50:0/2624855387 >> [v2:172.21.15.177:6836/2159859285,v1:172.21.15.177:6837/2159859285] conn(0x55e37002b8e0 0x55e3704309c0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:45.690 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:45.687+0000 7fd14b4be740 1 --2- 172.21.15.50:0/2624855387 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55e37006cf60 0x55e37042a3f0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:45.690 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:45.687+0000 7fd14b4be740 1 --2- 172.21.15.50:0/2624855387 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e37004c280 0x55e37041e5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:45.690 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:45.687+0000 7fd14b4be740 1 --2- 172.21.15.50:0/2624855387 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e3700440a0 0x55e37041e080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:45.690 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:45.687+0000 7fd11f400640 0 client.25196 ms_handle_reset on v2:172.21.15.177:6836/2159859285 2024-08-31T04:22:45.690 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:45.687+0000 7fd14b4be740 1 -- 172.21.15.50:0/2624855387 >> 172.21.15.50:0/2624855387 conn(0x55e370061350 msgr2=0x55e370415a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:22:45.690 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:45.687+0000 7fd14b4be740 1 -- 172.21.15.50:0/2624855387 shutdown_connections 2024-08-31T04:22:45.690 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:45.687+0000 7fd14b4be740 1 -- 172.21.15.50:0/2624855387 wait complete. 2024-08-31T04:22:45.691 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:45.687+0000 7fd14b4be740 20 client.25196 trim_cache size 0 max 16384 2024-08-31T04:22:45.707 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:45.706+0000 7fd14b4be740 1 Processor -- start 2024-08-31T04:22:45.707 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:45.706+0000 7fd14b4be740 1 -- start start 2024-08-31T04:22:45.708 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:45.707+0000 7fd14b4be740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55e3700440a0 0x55e37042fc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:45.708 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:45.707+0000 7fd14b4be740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e37004c280 0x55e37042e400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:45.708 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:45.707+0000 7fd14b4be740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e37006cf60 0x55e37040b4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:45.708 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:45.707+0000 7fd14b4be740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55e37042ed00 con 0x55e37006cf60 2024-08-31T04:22:45.708 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:45.707+0000 7fd14b4be740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x55e37042f3d0 con 0x55e3700440a0 2024-08-31T04:22:45.708 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:45.707+0000 7fd14b4be740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x55e37042faa0 con 0x55e37004c280 2024-08-31T04:22:45.709 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:45.707+0000 7fd142800640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e37006cf60 0x55e37040b4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:22:45.709 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:45.707+0000 7fd142800640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e37006cf60 0x55e37040b4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:39672/0 (socket says 172.21.15.50:39672) 2024-08-31T04:22:45.709 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:45.707+0000 7fd142800640 1 -- 172.21.15.50:0/161971386 learned_addr learned my addr 172.21.15.50:0/161971386 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:22:45.709 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:45.707+0000 7fd141e00640 1 --2- 172.21.15.50:0/161971386 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55e3700440a0 0x55e37042fc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:22:45.709 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:45.707+0000 7fd141400640 1 --2- 172.21.15.50:0/161971386 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e37004c280 0x55e37042e400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:22:45.710 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:45.707+0000 7fd141e00640 1 -- 172.21.15.50:0/161971386 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e37004c280 msgr2=0x55e37042e400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:22:45.710 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:45.707+0000 7fd141e00640 1 --2- 172.21.15.50:0/161971386 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e37004c280 0x55e37042e400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:45.710 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:45.707+0000 7fd141e00640 1 -- 172.21.15.50:0/161971386 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e37006cf60 msgr2=0x55e37040b4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:22:45.710 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:45.707+0000 7fd141e00640 1 --2- 172.21.15.50:0/161971386 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e37006cf60 0x55e37040b4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:45.710 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:45.707+0000 7fd141e00640 1 -- 172.21.15.50:0/161971386 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e37041c580 con 0x55e3700440a0 2024-08-31T04:22:45.710 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:45.708+0000 7fd141e00640 1 --2- 172.21.15.50:0/161971386 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55e3700440a0 0x55e37042fc20 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x55e370414d90 tx=0x7fd13000b410 comp rx=0 tx=0).ready entity=mon.2 client_cookie=59d9a7f359dd89a6 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:22:45.710 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:45.708+0000 7fd12a600640 1 -- 172.21.15.50:0/161971386 <== mon.2 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd13001cdb0 con 0x55e3700440a0 2024-08-31T04:22:45.710 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:45.708+0000 7fd12a600640 1 -- 172.21.15.50:0/161971386 <== mon.2 v2:172.21.15.133:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd13001c480 con 0x55e3700440a0 2024-08-31T04:22:45.710 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:45.708+0000 7fd12a600640 1 -- 172.21.15.50:0/161971386 <== mon.2 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1300053a0 con 0x55e3700440a0 2024-08-31T04:22:45.711 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:45.709+0000 7fd14b4be740 1 -- 172.21.15.50:0/161971386 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55e3700440a0 msgr2=0x55e37042fc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:22:45.712 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:45.709+0000 7fd14b4be740 1 --2- 172.21.15.50:0/161971386 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55e3700440a0 0x55e37042fc20 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x55e370414d90 tx=0x7fd13000b410 comp rx=0 tx=0).stop 2024-08-31T04:22:45.712 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:45.709+0000 7fd14b4be740 1 -- 172.21.15.50:0/161971386 shutdown_connections 2024-08-31T04:22:45.712 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:45.709+0000 7fd14b4be740 1 --2- 172.21.15.50:0/161971386 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e37004c280 0x55e37042e400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:45.712 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:45.709+0000 7fd14b4be740 1 --2- 172.21.15.50:0/161971386 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e37006cf60 0x55e37040b4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:45.712 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:45.709+0000 7fd14b4be740 1 --2- 172.21.15.50:0/161971386 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55e3700440a0 0x55e37042fc20 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:45.712 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:45.709+0000 7fd14b4be740 1 -- 172.21.15.50:0/161971386 >> 172.21.15.50:0/161971386 conn(0x55e370061350 msgr2=0x55e37042a570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:22:45.712 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:45.709+0000 7fd14b4be740 1 -- 172.21.15.50:0/161971386 shutdown_connections 2024-08-31T04:22:45.712 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:45.709+0000 7fd14b4be740 1 -- 172.21.15.50:0/161971386 wait complete. 2024-08-31T04:22:45.712 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:45.710+0000 7fd14b4be740 1 -- start start 2024-08-31T04:22:45.712 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:45.710+0000 7fd14b4be740 1 Processor -- start 2024-08-31T04:22:45.712 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:45.710+0000 7fd14b4be740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e3700440a0 0x55e370434000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:45.712 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:45.710+0000 7fd14b4be740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55e37004c280 0x55e370434540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:45.712 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:45.710+0000 7fd14b4be740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e37006cf60 0x55e370499e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:45.713 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:45.710+0000 7fd14b4be740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55e370430840 con 0x55e37006cf60 2024-08-31T04:22:45.713 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:45.710+0000 7fd14b4be740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x55e370430170 con 0x55e37004c280 2024-08-31T04:22:45.713 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:45.710+0000 7fd14b4be740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x55e370430f10 con 0x55e3700440a0 2024-08-31T04:22:45.713 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:45.710+0000 7fd14b4be740 10 client.0 _ll_register_callbacks cb 0x7fd1380a7f50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:22:45.714 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:45.711+0000 7fd141400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55e37004c280 0x55e370434540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:22:45.714 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:45.711+0000 7fd142800640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e37006cf60 0x55e370499e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:22:45.714 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:45.711+0000 7fd141400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55e37004c280 0x55e370434540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.50:58912/0 (socket says 172.21.15.50:58912) 2024-08-31T04:22:45.715 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:45.711+0000 7fd141400640 1 -- 172.21.15.50:0/3182650022 learned_addr learned my addr 172.21.15.50:0/3182650022 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:22:45.715 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:45.711+0000 7fd141e00640 1 --2- 172.21.15.50:0/3182650022 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e3700440a0 0x55e370434000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:22:45.715 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:45.711+0000 7fd142800640 1 -- 172.21.15.50:0/3182650022 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e3700440a0 msgr2=0x55e370434000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:22:45.715 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:45.711+0000 7fd142800640 1 --2- 172.21.15.50:0/3182650022 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e3700440a0 0x55e370434000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:45.715 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:45.711+0000 7fd142800640 1 -- 172.21.15.50:0/3182650022 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55e37004c280 msgr2=0x55e370434540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:22:45.715 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:45.711+0000 7fd142800640 1 --2- 172.21.15.50:0/3182650022 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55e37004c280 0x55e370434540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:45.715 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:45.711+0000 7fd142800640 1 -- 172.21.15.50:0/3182650022 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e37049a3c0 con 0x55e37006cf60 2024-08-31T04:22:45.715 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:45.711+0000 7fd141400640 1 --2- 172.21.15.50:0/3182650022 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55e37004c280 0x55e370434540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:22:45.715 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:45.711+0000 7fd142800640 1 --2- 172.21.15.50:0/3182650022 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e37006cf60 0x55e370499e80 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fd1380c3040 tx=0x7fd138005750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86a46dba0fb03b6b server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:22:45.715 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:45.711+0000 7fd11f400640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-08-31T04:22:45.715 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:45.712+0000 7fd11f400640 1 -- 172.21.15.50:0/3182650022 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1380d0070 con 0x55e37006cf60 2024-08-31T04:22:45.715 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:45.712+0000 7fd14b4be740 1 -- 172.21.15.50:0/3182650022 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd13001c480 con 0x55e37006cf60 2024-08-31T04:22:45.715 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:45.712+0000 7fd11f400640 1 -- 172.21.15.50:0/3182650022 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8219+0+0 (secure 0 0 0) 0x7fd1380b4f20 con 0x55e37006cf60 2024-08-31T04:22:45.716 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:45.712+0000 7fd11f400640 1 -- 172.21.15.50:0/3182650022 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fd1380b0900 con 0x55e37006cf60 2024-08-31T04:22:45.716 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:45.712+0000 7fd14b4be740 10 client.15201 fetch_fsmap learned FSMap version 28 2024-08-31T04:22:45.716 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:45.712+0000 7fd14b4be740 1 -- 172.21.15.50:0/3182650022 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55e37049b4b0 con 0x55e37006cf60 2024-08-31T04:22:45.716 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:45.712+0000 7fd11f400640 1 -- 172.21.15.50:0/3182650022 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd13001c480 con 0x55e37006cf60 2024-08-31T04:22:45.716 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:45.713+0000 7fd11f400640 1 -- 172.21.15.50:0/3182650022 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fd1380cd3a0 con 0x55e37006cf60 2024-08-31T04:22:45.716 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:45.713+0000 7fd14b4be740 10 client.15201 fetch_fsmap finished waiting for FSMap version 28 2024-08-31T04:22:45.716 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:45.713+0000 7fd14b4be740 10 client.15201 resolve_mds: resolved name 'c' to daemon mds.c 2024-08-31T04:22:45.716 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:45.713+0000 7fd14b4be740 20 client.15201 populate_metadata read hostname 'smithi050' 2024-08-31T04:22:45.716 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:45.713+0000 7fd14b4be740 1 --2- 172.21.15.50:0/3182650022 >> [v2:172.21.15.177:6836/2159859285,v1:172.21.15.177:6837/2159859285] conn(0x55e370000c90 0x55e37049ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:45.716 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:45.713+0000 7fd14b4be740 4 client.15201 mds_command: new command op to 24652 tid=0 multi_id=0 [{"prefix": "status"}] 2024-08-31T04:22:45.716 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:45.713+0000 7fd14b4be740 1 -- 172.21.15.50:0/3182650022 --> [v2:172.21.15.177:6836/2159859285,v1:172.21.15.177:6837/2159859285] -- command(tid 0: {"prefix": "status"}) -- 0x55e370386f40 con 0x55e370000c90 2024-08-31T04:22:45.716 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:45.713+0000 7fd141e00640 1 --2- 172.21.15.50:0/3182650022 >> [v2:172.21.15.177:6836/2159859285,v1:172.21.15.177:6837/2159859285] conn(0x55e370000c90 0x55e37049ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:22:45.717 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:45.714+0000 7fd141e00640 1 --2- 172.21.15.50:0/3182650022 >> [v2:172.21.15.177:6836/2159859285,v1:172.21.15.177:6837/2159859285] conn(0x55e370000c90 0x55e37049ebf0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=287fb34f8dac3052 server_cookie=a0e2cab90f4df6b2 in_seq=0 out_seq=0 2024-08-31T04:22:45.717 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:45.714+0000 7fd11f400640 10 client.15201 ms_handle_connect on v2:172.21.15.177:6836/2159859285 2024-08-31T04:22:45.718 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:45.714+0000 7fd11f400640 1 -- 172.21.15.50:0/3182650022 <== mds.4 v2:172.21.15.177:6836/2159859285 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x55e370386f40 con 0x55e370000c90 2024-08-31T04:22:45.718 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:45.714+0000 7fd11f400640 10 client.15201 handle_command_reply: tid=0 2024-08-31T04:22:45.718 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:45.714+0000 7fd14b4be740 1 client.15201 shutdown 2024-08-31T04:22:45.718 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:45.714+0000 7fd14b4be740 1 -- 172.21.15.50:0/3182650022 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e37006cf60 msgr2=0x55e370499e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:22:45.718 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:45.714+0000 7fd14b4be740 1 --2- 172.21.15.50:0/3182650022 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e37006cf60 0x55e370499e80 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fd1380c3040 tx=0x7fd138005750 comp rx=0 tx=0).stop 2024-08-31T04:22:45.718 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:45.714+0000 7fd14b4be740 1 -- 172.21.15.50:0/3182650022 shutdown_connections 2024-08-31T04:22:45.718 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:45.714+0000 7fd14b4be740 1 --2- 172.21.15.50:0/3182650022 >> [v2:172.21.15.177:6836/2159859285,v1:172.21.15.177:6837/2159859285] conn(0x55e370000c90 0x55e37049ebf0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:45.718 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:45.714+0000 7fd14b4be740 1 --2- 172.21.15.50:0/3182650022 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e37006cf60 0x55e370499e80 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:45.718 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:45.714+0000 7fd14b4be740 1 --2- 172.21.15.50:0/3182650022 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55e37004c280 0x55e370434540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:45.718 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:45.714+0000 7fd14b4be740 1 --2- 172.21.15.50:0/3182650022 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e3700440a0 0x55e370434000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:45.718 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:45.714+0000 7fd14b4be740 1 -- 172.21.15.50:0/3182650022 >> 172.21.15.50:0/3182650022 conn(0x55e370061350 msgr2=0x55e37040b4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:22:45.718 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:45.714+0000 7fd11f400640 0 client.15201 ms_handle_reset on v2:172.21.15.177:6836/2159859285 2024-08-31T04:22:45.718 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:45.715+0000 7fd14b4be740 1 -- 172.21.15.50:0/3182650022 shutdown_connections 2024-08-31T04:22:45.718 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:45.715+0000 7fd14b4be740 1 -- 172.21.15.50:0/3182650022 wait complete. 2024-08-31T04:22:45.719 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:45.715+0000 7fd14b4be740 20 client.15201 trim_cache size 0 max 16384 2024-08-31T04:22:45.719 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-08-31T04:22:45.719 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_fsid": "058d9fc6-674f-11ef-bcd4-c7b262605968", 2024-08-31T04:22:45.719 INFO:teuthology.orchestra.run.smithi050.stdout: "whoami": 4, 2024-08-31T04:22:45.719 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 24652, 2024-08-31T04:22:45.719 INFO:teuthology.orchestra.run.smithi050.stdout: "want_state": "up:active", 2024-08-31T04:22:45.719 INFO:teuthology.orchestra.run.smithi050.stdout: "state": "up:active", 2024-08-31T04:22:45.719 INFO:teuthology.orchestra.run.smithi050.stdout: "fs_name": "cephfs", 2024-08-31T04:22:45.719 INFO:teuthology.orchestra.run.smithi050.stdout: "rank_uptime": 104.67670726199999, 2024-08-31T04:22:45.719 INFO:teuthology.orchestra.run.smithi050.stdout: "mdsmap_epoch": 28, 2024-08-31T04:22:45.719 INFO:teuthology.orchestra.run.smithi050.stdout: "osdmap_epoch": 78, 2024-08-31T04:22:45.720 INFO:teuthology.orchestra.run.smithi050.stdout: "osdmap_epoch_barrier": 78, 2024-08-31T04:22:45.720 INFO:teuthology.orchestra.run.smithi050.stdout: "uptime": 150.27185656899999 2024-08-31T04:22:45.720 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-08-31T04:22:45.721 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:45.715+0000 7fd144800640 1 -- 172.21.15.50:0/2746507464 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fd1240b4b30 msgr2=0x7fd1240b7040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:22:45.721 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:45.715+0000 7fd144800640 1 --2- 172.21.15.50:0/2746507464 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fd1240b4b30 0x7fd1240b7040 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fd12c005f70 tx=0x7fd12c005a20 comp rx=0 tx=0).stop 2024-08-31T04:22:45.721 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:45.715+0000 7fd144800640 1 -- 172.21.15.50:0/2746507464 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd13c10fe60 msgr2=0x7fd13c1a1c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:22:45.721 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:45.715+0000 7fd144800640 1 --2- 172.21.15.50:0/2746507464 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd13c10fe60 0x7fd13c1a1c50 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fd13800eb10 tx=0x7fd13800c2d0 comp rx=0 tx=0).stop 2024-08-31T04:22:45.721 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:45.715+0000 7fd144800640 1 -- 172.21.15.50:0/2746507464 shutdown_connections 2024-08-31T04:22:45.721 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:45.716+0000 7fd144800640 1 --2- 172.21.15.50:0/2746507464 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fd1240b4b30 0x7fd1240b7040 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:45.721 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:45.716+0000 7fd144800640 1 --2- 172.21.15.50:0/2746507464 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd13c10fe60 0x7fd13c1a1c50 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:45.721 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:45.716+0000 7fd144800640 1 --2- 172.21.15.50:0/2746507464 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd13c075ea0 0x7fd13c19c9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:45.721 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:45.716+0000 7fd144800640 1 --2- 172.21.15.50:0/2746507464 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd13c075550 0x7fd13c19c410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:45.722 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:45.716+0000 7fd144800640 1 -- 172.21.15.50:0/2746507464 >> 172.21.15.50:0/2746507464 conn(0x7fd13c07b5f0 msgr2=0x7fd13c1014f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:22:45.722 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:45.716+0000 7fd144800640 1 -- 172.21.15.50:0/2746507464 shutdown_connections 2024-08-31T04:22:45.722 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:45.716+0000 7fd144800640 1 -- 172.21.15.50:0/2746507464 wait complete. 2024-08-31T04:22:45.996 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:22:45 smithi177 ceph-mon[22025]: pgmap v362: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-08-31T04:22:46.043 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:22:45 smithi133 ceph-mon[22177]: pgmap v362: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-08-31T04:22:46.485 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 058d9fc6-674f-11ef-bcd4-c7b262605968 -- ceph tell mds.h status 2024-08-31T04:22:46.863 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:22:47.490 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:47.488+0000 7ffb2b200640 1 -- 172.21.15.50:0/344627247 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffb2c105960 msgr2=0x7ffb2c105d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:22:47.490 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:47.488+0000 7ffb2b200640 1 --2- 172.21.15.50:0/344627247 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffb2c105960 0x7ffb2c105d70 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7ffb1c009900 tx=0x7ffb1c02a410 comp rx=0 tx=0).stop 2024-08-31T04:22:47.490 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:47.489+0000 7ffb2b200640 1 -- 172.21.15.50:0/344627247 shutdown_connections 2024-08-31T04:22:47.491 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:47.489+0000 7ffb2b200640 1 --2- 172.21.15.50:0/344627247 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ffb2c10b2a0 0x7ffb2c10b6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:47.491 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:47.489+0000 7ffb2b200640 1 --2- 172.21.15.50:0/344627247 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ffb2c10bbf0 0x7ffb2c112420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:47.491 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:47.489+0000 7ffb2b200640 1 --2- 172.21.15.50:0/344627247 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffb2c105960 0x7ffb2c105d70 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:47.491 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:47.489+0000 7ffb2b200640 1 -- 172.21.15.50:0/344627247 >> 172.21.15.50:0/344627247 conn(0x7ffb2c101410 msgr2=0x7ffb2c103860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:22:47.491 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:47.489+0000 7ffb2b200640 1 -- 172.21.15.50:0/344627247 shutdown_connections 2024-08-31T04:22:47.491 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:47.489+0000 7ffb2b200640 1 -- 172.21.15.50:0/344627247 wait complete. 2024-08-31T04:22:47.492 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:47.490+0000 7ffb2b200640 1 Processor -- start 2024-08-31T04:22:47.492 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:47.490+0000 7ffb2b200640 1 -- start start 2024-08-31T04:22:47.492 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:47.490+0000 7ffb2b200640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ffb2c105960 0x7ffb2c19c2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:47.492 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:47.490+0000 7ffb2b200640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffb2c10b2a0 0x7ffb2c19c840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:47.492 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:47.490+0000 7ffb2b200640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ffb2c10bbf0 0x7ffb2c1a1ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:47.492 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:47.490+0000 7ffb2b200640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7ffb2c1158b0 con 0x7ffb2c10b2a0 2024-08-31T04:22:47.493 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:47.490+0000 7ffb2b200640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7ffb2c115730 con 0x7ffb2c10bbf0 2024-08-31T04:22:47.493 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:47.490+0000 7ffb2b200640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7ffb2c115a30 con 0x7ffb2c105960 2024-08-31T04:22:47.493 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:47.491+0000 7ffb29400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffb2c10b2a0 0x7ffb2c19c840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:22:47.493 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:47.491+0000 7ffb29e00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ffb2c105960 0x7ffb2c19c2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:22:47.493 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:47.491+0000 7ffb29400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffb2c10b2a0 0x7ffb2c19c840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:39704/0 (socket says 172.21.15.50:39704) 2024-08-31T04:22:47.493 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:47.491+0000 7ffb29400640 1 -- 172.21.15.50:0/394606811 learned_addr learned my addr 172.21.15.50:0/394606811 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:22:47.493 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:47.491+0000 7ffb2a800640 1 --2- 172.21.15.50:0/394606811 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ffb2c10bbf0 0x7ffb2c1a1ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:22:47.494 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:47.491+0000 7ffb29400640 1 -- 172.21.15.50:0/394606811 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ffb2c105960 msgr2=0x7ffb2c19c2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:22:47.494 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:47.491+0000 7ffb29400640 1 --2- 172.21.15.50:0/394606811 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ffb2c105960 0x7ffb2c19c2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:47.494 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:47.491+0000 7ffb29400640 1 -- 172.21.15.50:0/394606811 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ffb2c10bbf0 msgr2=0x7ffb2c1a1ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:22:47.494 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:47.491+0000 7ffb29400640 1 --2- 172.21.15.50:0/394606811 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ffb2c10bbf0 0x7ffb2c1a1ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:47.494 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:47.491+0000 7ffb29400640 1 -- 172.21.15.50:0/394606811 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb2c1a2210 con 0x7ffb2c10b2a0 2024-08-31T04:22:47.494 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:47.491+0000 7ffb29e00640 1 --2- 172.21.15.50:0/394606811 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ffb2c105960 0x7ffb2c19c2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:22:47.494 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:47.492+0000 7ffb29400640 1 --2- 172.21.15.50:0/394606811 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffb2c10b2a0 0x7ffb2c19c840 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7ffb1800d950 tx=0x7ffb1800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:22:47.495 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:47.492+0000 7ffb22a00640 1 -- 172.21.15.50:0/394606811 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb18017070 con 0x7ffb2c10b2a0 2024-08-31T04:22:47.495 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:47.492+0000 7ffb22a00640 1 -- 172.21.15.50:0/394606811 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ffb18009c30 con 0x7ffb2c10b2a0 2024-08-31T04:22:47.495 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:47.492+0000 7ffb22a00640 1 -- 172.21.15.50:0/394606811 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb180047a0 con 0x7ffb2c10b2a0 2024-08-31T04:22:47.495 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:47.492+0000 7ffb2b200640 1 -- 172.21.15.50:0/394606811 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffb2c1a2500 con 0x7ffb2c10b2a0 2024-08-31T04:22:47.495 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:47.492+0000 7ffb2b200640 1 -- 172.21.15.50:0/394606811 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffb2c1a8c60 con 0x7ffb2c10b2a0 2024-08-31T04:22:47.496 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:47.495+0000 7ffb3784e740 1 Processor -- start 2024-08-31T04:22:47.497 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:47.495+0000 7ffb3784e740 1 -- start start 2024-08-31T04:22:47.497 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:47.496+0000 7ffb3784e740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x557c15dc7f60 0x557c1616daa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:47.497 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:47.496+0000 7ffb3784e740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557c15d9f0a0 0x557c1616dfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:47.498 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:47.496+0000 7ffb22a00640 1 -- 172.21.15.50:0/394606811 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 18) ==== 152577+0+0 (secure 0 0 0) 0x7ffb18004020 con 0x7ffb2c10b2a0 2024-08-31T04:22:47.498 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:47.496+0000 7ffb3784e740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557c15da7280 0x557c1616e520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:47.498 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:47.496+0000 7ffb3784e740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x557c160e4550 con 0x557c15d9f0a0 2024-08-31T04:22:47.498 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:47.496+0000 7ffb3784e740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x557c160d3ae0 con 0x557c15dc7f60 2024-08-31T04:22:47.498 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:47.496+0000 7ffb3784e740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x557c160d7a90 con 0x557c15da7280 2024-08-31T04:22:47.498 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:47.496+0000 7ffb29e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557c15d9f0a0 0x557c1616dfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:22:47.498 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:47.496+0000 7ffb29400640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557c15da7280 0x557c1616e520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:22:47.498 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:47.496+0000 7ffb29e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557c15d9f0a0 0x557c1616dfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:39718/0 (socket says 172.21.15.50:39718) 2024-08-31T04:22:47.498 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:47.496+0000 7ffb29e00640 1 -- 172.21.15.50:0/2062276154 learned_addr learned my addr 172.21.15.50:0/2062276154 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:22:47.498 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:47.496+0000 7ffb2a800640 1 --2- 172.21.15.50:0/2062276154 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x557c15dc7f60 0x557c1616daa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:22:47.500 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:47.497+0000 7ffb2a800640 1 -- 172.21.15.50:0/2062276154 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557c15da7280 msgr2=0x557c1616e520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:22:47.501 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:47.497+0000 7ffb2a800640 1 --2- 172.21.15.50:0/2062276154 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557c15da7280 0x557c1616e520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:47.501 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:47.497+0000 7ffb2a800640 1 -- 172.21.15.50:0/2062276154 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557c15d9f0a0 msgr2=0x557c1616dfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:22:47.501 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:47.497+0000 7ffb2a800640 1 --2- 172.21.15.50:0/2062276154 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557c15d9f0a0 0x557c1616dfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:47.501 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:47.497+0000 7ffb2a800640 1 -- 172.21.15.50:0/2062276154 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557c15e33540 con 0x557c15dc7f60 2024-08-31T04:22:47.501 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:47.497+0000 7ffb2a800640 1 --2- 172.21.15.50:0/2062276154 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x557c15dc7f60 0x557c1616daa0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7ffb24009eb0 tx=0x7ffb24010740 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e7ec17a1da5a3936 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:22:47.501 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:47.497+0000 7ffb17000640 1 -- 172.21.15.50:0/2062276154 <== mon.2 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb24016070 con 0x557c15dc7f60 2024-08-31T04:22:47.501 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:47.497+0000 7ffb17000640 1 -- 172.21.15.50:0/2062276154 <== mon.2 v2:172.21.15.133:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ffb24004d20 con 0x557c15dc7f60 2024-08-31T04:22:47.501 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:47.497+0000 7ffb17000640 1 -- 172.21.15.50:0/2062276154 <== mon.2 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb24012780 con 0x557c15dc7f60 2024-08-31T04:22:47.501 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:47.498+0000 7ffb22a00640 1 --2- 172.21.15.50:0/394606811 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7ffb100b4b30 0x7ffb100b7040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:47.501 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:47.498+0000 7ffb22a00640 1 -- 172.21.15.50:0/394606811 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8219+0+0 (secure 0 0 0) 0x7ffb180e4d70 con 0x7ffb2c10b2a0 2024-08-31T04:22:47.501 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:47.498+0000 7ffb29e00640 1 --2- 172.21.15.50:0/394606811 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7ffb100b4b30 0x7ffb100b7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:22:47.501 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:47.498+0000 7ffb3784e740 1 -- 172.21.15.50:0/2062276154 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x557c15dc7f60 msgr2=0x557c1616daa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:22:47.501 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:47.498+0000 7ffb3784e740 1 --2- 172.21.15.50:0/2062276154 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x557c15dc7f60 0x557c1616daa0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7ffb24009eb0 tx=0x7ffb24010740 comp rx=0 tx=0).stop 2024-08-31T04:22:47.502 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:47.498+0000 7ffb3784e740 1 -- 172.21.15.50:0/2062276154 shutdown_connections 2024-08-31T04:22:47.502 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:47.498+0000 7ffb3784e740 1 --2- 172.21.15.50:0/2062276154 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557c15da7280 0x557c1616e520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:47.502 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:47.499+0000 7ffb3784e740 1 --2- 172.21.15.50:0/2062276154 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557c15d9f0a0 0x557c1616dfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:47.502 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:47.499+0000 7ffb3784e740 1 --2- 172.21.15.50:0/2062276154 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x557c15dc7f60 0x557c1616daa0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:47.502 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:47.499+0000 7ffb3784e740 1 -- 172.21.15.50:0/2062276154 >> 172.21.15.50:0/2062276154 conn(0x557c15dbc350 msgr2=0x557c1616b990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:22:47.502 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:47.499+0000 7ffb3784e740 1 -- 172.21.15.50:0/2062276154 shutdown_connections 2024-08-31T04:22:47.502 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:47.499+0000 7ffb3784e740 1 -- 172.21.15.50:0/2062276154 wait complete. 2024-08-31T04:22:47.502 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:47.499+0000 7ffb29e00640 1 --2- 172.21.15.50:0/394606811 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7ffb100b4b30 0x7ffb100b7040 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x557c1616c720 tx=0x7ffb1c005e30 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:22:47.502 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:47.499+0000 7ffb3784e740 1 -- start start 2024-08-31T04:22:47.502 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:47.499+0000 7ffb3784e740 1 Processor -- start 2024-08-31T04:22:47.504 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:47.500+0000 7ffb3784e740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x557c15d9f0a0 0x557c161792a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:47.504 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:47.500+0000 7ffb3784e740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557c15da7280 0x557c161797e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:47.505 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:47.500+0000 7ffb3784e740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557c15dc7f60 0x557c161855d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:47.505 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:47.500+0000 7ffb3784e740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x557c15f365f0 con 0x557c15dc7f60 2024-08-31T04:22:47.505 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:47.500+0000 7ffb3784e740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x557c1605abd0 con 0x557c15d9f0a0 2024-08-31T04:22:47.505 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:47.500+0000 7ffb3784e740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x557c1617c280 con 0x557c15da7280 2024-08-31T04:22:47.505 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:47.500+0000 7ffb3784e740 10 client.0 _ll_register_callbacks cb 0x557c16080210 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:22:47.505 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:47.500+0000 7ffb2a800640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557c15dc7f60 0x557c161855d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:22:47.505 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:47.500+0000 7ffb29e00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x557c15d9f0a0 0x557c161792a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:22:47.505 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:47.500+0000 7ffb29e00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x557c15d9f0a0 0x557c161792a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.50:58944/0 (socket says 172.21.15.50:58944) 2024-08-31T04:22:47.505 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:47.500+0000 7ffb29e00640 1 -- 172.21.15.50:0/2667713164 learned_addr learned my addr 172.21.15.50:0/2667713164 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:22:47.505 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:47.500+0000 7ffb29400640 1 --2- 172.21.15.50:0/2667713164 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557c15da7280 0x557c161797e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:22:47.505 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:47.501+0000 7ffb29e00640 1 -- 172.21.15.50:0/2667713164 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557c15da7280 msgr2=0x557c161797e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:22:47.505 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:47.501+0000 7ffb29e00640 1 --2- 172.21.15.50:0/2667713164 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557c15da7280 0x557c161797e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:47.506 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:47.501+0000 7ffb29e00640 1 -- 172.21.15.50:0/2667713164 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557c15dc7f60 msgr2=0x557c161855d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:22:47.506 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:47.501+0000 7ffb29e00640 1 --2- 172.21.15.50:0/2667713164 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557c15dc7f60 0x557c161855d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:47.506 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:47.501+0000 7ffb29e00640 1 -- 172.21.15.50:0/2667713164 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557c1609b650 con 0x557c15d9f0a0 2024-08-31T04:22:47.506 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:47.501+0000 7ffb29e00640 1 --2- 172.21.15.50:0/2667713164 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x557c15d9f0a0 0x557c161792a0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7ffb1c000c00 tx=0x7ffb1c009260 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bd4681b64ac4b198 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:22:47.506 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:47.501+0000 7ffb0b400640 10 client.0 ms_handle_connect on v2:172.21.15.133:3300/0 2024-08-31T04:22:47.506 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:47.501+0000 7ffb0b400640 1 -- 172.21.15.50:0/2667713164 <== mon.2 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb1c04d070 con 0x557c15d9f0a0 2024-08-31T04:22:47.506 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:47.502+0000 7ffb0b400640 1 -- 172.21.15.50:0/2667713164 <== mon.2 v2:172.21.15.133:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8219+0+0 (secure 0 0 0) 0x7ffb1c004250 con 0x557c15d9f0a0 2024-08-31T04:22:47.506 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:47.502+0000 7ffb3784e740 1 -- 172.21.15.50:0/2667713164 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ffb24004d20 con 0x557c15d9f0a0 2024-08-31T04:22:47.506 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:47.502+0000 7ffb0b400640 1 -- 172.21.15.50:0/2667713164 <== mon.2 v2:172.21.15.133:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7ffb1c059050 con 0x557c15d9f0a0 2024-08-31T04:22:47.506 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:47.502+0000 7ffb3784e740 10 client.25214 fetch_fsmap learned FSMap version 28 2024-08-31T04:22:47.506 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:47.502+0000 7ffb3784e740 1 -- 172.21.15.50:0/2667713164 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x557c161880e0 con 0x557c15d9f0a0 2024-08-31T04:22:47.507 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:47.502+0000 7ffb0b400640 1 -- 172.21.15.50:0/2667713164 <== mon.2 v2:172.21.15.133:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ffb24004d20 con 0x557c15d9f0a0 2024-08-31T04:22:47.507 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:47.502+0000 7ffb0b400640 1 -- 172.21.15.50:0/2667713164 <== mon.2 v2:172.21.15.133:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7ffb1c003790 con 0x557c15d9f0a0 2024-08-31T04:22:47.507 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:47.502+0000 7ffb3784e740 10 client.25214 fetch_fsmap finished waiting for FSMap version 28 2024-08-31T04:22:47.507 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:47.502+0000 7ffb3784e740 10 client.25214 resolve_mds: resolved name 'h' to daemon mds.h 2024-08-31T04:22:47.507 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:47.502+0000 7ffb3784e740 20 client.25214 populate_metadata read hostname 'smithi050' 2024-08-31T04:22:47.507 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:47.502+0000 7ffb3784e740 1 --2- 172.21.15.50:0/2667713164 >> [v2:172.21.15.133:6836/4014853202,v1:172.21.15.133:6837/4014853202] conn(0x557c15d868e0 0x557c1618bbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:47.507 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:47.503+0000 7ffb3784e740 4 client.25214 mds_command: new command op to 24656 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T04:22:47.507 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:47.503+0000 7ffb3784e740 1 -- 172.21.15.50:0/2667713164 --> [v2:172.21.15.133:6836/4014853202,v1:172.21.15.133:6837/4014853202] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557c160e64a0 con 0x557c15d868e0 2024-08-31T04:22:47.507 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:47.503+0000 7ffb29400640 1 --2- 172.21.15.50:0/2667713164 >> [v2:172.21.15.133:6836/4014853202,v1:172.21.15.133:6837/4014853202] conn(0x557c15d868e0 0x557c1618bbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:22:47.507 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:47.503+0000 7ffb29400640 1 --2- 172.21.15.50:0/2667713164 >> [v2:172.21.15.133:6836/4014853202,v1:172.21.15.133:6837/4014853202] conn(0x557c15d868e0 0x557c1618bbc0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=335086708a1325f4 server_cookie=8619bfd8f09fd4d3 in_seq=0 out_seq=0 2024-08-31T04:22:47.507 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:47.503+0000 7ffb0b400640 10 client.25214 ms_handle_connect on v2:172.21.15.133:6836/4014853202 2024-08-31T04:22:47.508 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:47.504+0000 7ffb0b400640 1 -- 172.21.15.50:0/2667713164 <== mds.3 v2:172.21.15.133:6836/4014853202 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x557c160e64a0 con 0x557c15d868e0 2024-08-31T04:22:47.508 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:47.504+0000 7ffb0b400640 10 client.25214 handle_command_reply: tid=0 2024-08-31T04:22:47.508 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:47.504+0000 7ffb3784e740 1 client.25214 shutdown 2024-08-31T04:22:47.509 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:47.504+0000 7ffb3784e740 1 -- 172.21.15.50:0/2667713164 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x557c15d9f0a0 msgr2=0x557c161792a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:22:47.509 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:47.505+0000 7ffb3784e740 1 --2- 172.21.15.50:0/2667713164 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x557c15d9f0a0 0x557c161792a0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7ffb1c000c00 tx=0x7ffb1c009260 comp rx=0 tx=0).stop 2024-08-31T04:22:47.509 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:47.505+0000 7ffb3784e740 1 -- 172.21.15.50:0/2667713164 shutdown_connections 2024-08-31T04:22:47.509 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:47.505+0000 7ffb3784e740 1 --2- 172.21.15.50:0/2667713164 >> [v2:172.21.15.133:6836/4014853202,v1:172.21.15.133:6837/4014853202] conn(0x557c15d868e0 0x557c1618bbc0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:47.509 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:47.505+0000 7ffb3784e740 1 --2- 172.21.15.50:0/2667713164 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557c15da7280 0x557c161797e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:47.509 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:47.505+0000 7ffb3784e740 1 --2- 172.21.15.50:0/2667713164 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557c15dc7f60 0x557c161855d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:47.509 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:47.505+0000 7ffb3784e740 1 --2- 172.21.15.50:0/2667713164 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x557c15d9f0a0 0x557c161792a0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:47.509 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:47.505+0000 7ffb3784e740 1 -- 172.21.15.50:0/2667713164 >> 172.21.15.50:0/2667713164 conn(0x557c15dbc350 msgr2=0x557c16170c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:22:47.509 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:47.505+0000 7ffb0b400640 0 client.25214 ms_handle_reset on v2:172.21.15.133:6836/4014853202 2024-08-31T04:22:47.509 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:47.505+0000 7ffb3784e740 1 -- 172.21.15.50:0/2667713164 shutdown_connections 2024-08-31T04:22:47.509 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:47.505+0000 7ffb3784e740 1 -- 172.21.15.50:0/2667713164 wait complete. 2024-08-31T04:22:47.509 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:47.505+0000 7ffb3784e740 20 client.25214 trim_cache size 0 max 16384 2024-08-31T04:22:47.527 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:47.524+0000 7ffb3784e740 1 Processor -- start 2024-08-31T04:22:47.528 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:47.524+0000 7ffb3784e740 1 -- start start 2024-08-31T04:22:47.528 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:47.524+0000 7ffb3784e740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557c15d9f0a0 0x557c16179050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:47.528 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:47.525+0000 7ffb3784e740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557c15da7280 0x557c16179590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:47.528 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:47.525+0000 7ffb3784e740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x557c15dc7f60 0x557c16170ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:47.529 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:47.525+0000 7ffb3784e740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x557c16189f00 con 0x557c15d9f0a0 2024-08-31T04:22:47.529 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:47.525+0000 7ffb3784e740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x557c1618a5d0 con 0x557c15dc7f60 2024-08-31T04:22:47.529 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:47.525+0000 7ffb3784e740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x557c1618aca0 con 0x557c15da7280 2024-08-31T04:22:47.529 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:47.525+0000 7ffb29e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557c15d9f0a0 0x557c16179050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:22:47.529 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:47.525+0000 7ffb29e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557c15d9f0a0 0x557c16179050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:39738/0 (socket says 172.21.15.50:39738) 2024-08-31T04:22:47.529 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:47.525+0000 7ffb29e00640 1 -- 172.21.15.50:0/1290312468 learned_addr learned my addr 172.21.15.50:0/1290312468 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:22:47.529 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:47.525+0000 7ffb29400640 1 --2- 172.21.15.50:0/1290312468 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557c15da7280 0x557c16179590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:22:47.530 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:47.525+0000 7ffb2a800640 1 --2- 172.21.15.50:0/1290312468 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x557c15dc7f60 0x557c16170ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:22:47.530 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:47.525+0000 7ffb29e00640 1 -- 172.21.15.50:0/1290312468 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557c15da7280 msgr2=0x557c16179590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:22:47.530 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:47.525+0000 7ffb29e00640 1 --2- 172.21.15.50:0/1290312468 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557c15da7280 0x557c16179590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:47.530 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:47.525+0000 7ffb29e00640 1 -- 172.21.15.50:0/1290312468 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x557c15dc7f60 msgr2=0x557c16170ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:22:47.530 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:47.525+0000 7ffb29e00640 1 --2- 172.21.15.50:0/1290312468 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x557c15dc7f60 0x557c16170ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:47.530 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:47.525+0000 7ffb29e00640 1 -- 172.21.15.50:0/1290312468 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557c161777a0 con 0x557c15d9f0a0 2024-08-31T04:22:47.530 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:47.526+0000 7ffb29e00640 1 --2- 172.21.15.50:0/1290312468 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557c15d9f0a0 0x557c16179050 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7ffb1c02a930 tx=0x7ffb1c02a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35eb9e6f282f53c server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:22:47.531 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:47.526+0000 7ffb16600640 1 -- 172.21.15.50:0/1290312468 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb1c04d070 con 0x557c15d9f0a0 2024-08-31T04:22:47.531 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:47.526+0000 7ffb16600640 1 -- 172.21.15.50:0/1290312468 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ffb1c062070 con 0x557c15d9f0a0 2024-08-31T04:22:47.531 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:47.526+0000 7ffb16600640 1 -- 172.21.15.50:0/1290312468 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb1c035040 con 0x557c15d9f0a0 2024-08-31T04:22:47.536 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:47.527+0000 7ffb3784e740 1 -- 172.21.15.50:0/1290312468 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557c15d9f0a0 msgr2=0x557c16179050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:22:47.536 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:47.527+0000 7ffb3784e740 1 --2- 172.21.15.50:0/1290312468 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557c15d9f0a0 0x557c16179050 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7ffb1c02a930 tx=0x7ffb1c02a410 comp rx=0 tx=0).stop 2024-08-31T04:22:47.536 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:47.527+0000 7ffb3784e740 1 -- 172.21.15.50:0/1290312468 shutdown_connections 2024-08-31T04:22:47.536 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:47.527+0000 7ffb3784e740 1 --2- 172.21.15.50:0/1290312468 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557c15da7280 0x557c16179590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:47.536 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:47.527+0000 7ffb3784e740 1 --2- 172.21.15.50:0/1290312468 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x557c15dc7f60 0x557c16170ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:47.537 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:47.527+0000 7ffb3784e740 1 --2- 172.21.15.50:0/1290312468 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557c15d9f0a0 0x557c16179050 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:47.537 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:47.527+0000 7ffb3784e740 1 -- 172.21.15.50:0/1290312468 >> 172.21.15.50:0/1290312468 conn(0x557c15dbc350 msgr2=0x557c16177b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:22:47.537 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:47.527+0000 7ffb3784e740 1 -- 172.21.15.50:0/1290312468 shutdown_connections 2024-08-31T04:22:47.537 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:47.527+0000 7ffb3784e740 1 -- 172.21.15.50:0/1290312468 wait complete. 2024-08-31T04:22:47.537 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:47.527+0000 7ffb3784e740 1 -- start start 2024-08-31T04:22:47.537 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:47.528+0000 7ffb3784e740 1 Processor -- start 2024-08-31T04:22:47.537 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:47.528+0000 7ffb3784e740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557c15d9f0a0 0x557c1618ffc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:47.537 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:47.528+0000 7ffb3784e740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x557c15da7280 0x557c16190500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:47.537 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:47.528+0000 7ffb3784e740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557c15dc7f60 0x557c16190a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:47.538 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:47.528+0000 7ffb3784e740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x557c1618ba40 con 0x557c15d9f0a0 2024-08-31T04:22:47.538 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:47.528+0000 7ffb3784e740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x557c1618b370 con 0x557c15da7280 2024-08-31T04:22:47.538 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:47.528+0000 7ffb3784e740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x557c1618c110 con 0x557c15dc7f60 2024-08-31T04:22:47.538 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:47.528+0000 7ffb3784e740 10 client.0 _ll_register_callbacks cb 0x7ffb1c0318a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:22:47.538 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:47.529+0000 7ffb29e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557c15d9f0a0 0x557c1618ffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:22:47.538 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:47.529+0000 7ffb29e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557c15d9f0a0 0x557c1618ffc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:39754/0 (socket says 172.21.15.50:39754) 2024-08-31T04:22:47.538 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:47.529+0000 7ffb29e00640 1 -- 172.21.15.50:0/1249355672 learned_addr learned my addr 172.21.15.50:0/1249355672 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:22:47.538 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:47.529+0000 7ffb29400640 1 --2- 172.21.15.50:0/1249355672 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x557c15da7280 0x557c16190500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:22:47.538 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:47.529+0000 7ffb2a800640 1 --2- 172.21.15.50:0/1249355672 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557c15dc7f60 0x557c16190a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:22:47.538 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:47.529+0000 7ffb29e00640 1 -- 172.21.15.50:0/1249355672 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557c15dc7f60 msgr2=0x557c16190a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:22:47.538 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:47.529+0000 7ffb29e00640 1 --2- 172.21.15.50:0/1249355672 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557c15dc7f60 0x557c16190a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:47.538 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:47.529+0000 7ffb29e00640 1 -- 172.21.15.50:0/1249355672 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x557c15da7280 msgr2=0x557c16190500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:22:47.538 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:47.529+0000 7ffb29e00640 1 --2- 172.21.15.50:0/1249355672 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x557c15da7280 0x557c16190500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:47.539 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:47.529+0000 7ffb29e00640 1 -- 172.21.15.50:0/1249355672 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557c161f61f0 con 0x557c15d9f0a0 2024-08-31T04:22:47.539 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:47.529+0000 7ffb29e00640 1 --2- 172.21.15.50:0/1249355672 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557c15d9f0a0 0x557c1618ffc0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7ffb1c003c80 tx=0x7ffb1c03f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4723ece5f2d3d99 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:22:47.539 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:47.529+0000 7ffb0b400640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-08-31T04:22:47.539 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:47.530+0000 7ffb0b400640 1 -- 172.21.15.50:0/1249355672 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb1c06a070 con 0x557c15d9f0a0 2024-08-31T04:22:47.539 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:47.530+0000 7ffb0b400640 1 -- 172.21.15.50:0/1249355672 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8219+0+0 (secure 0 0 0) 0x7ffb1c004bf0 con 0x557c15d9f0a0 2024-08-31T04:22:47.539 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:47.530+0000 7ffb3784e740 1 -- 172.21.15.50:0/1249355672 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ffb1c062070 con 0x557c15d9f0a0 2024-08-31T04:22:47.539 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:47.530+0000 7ffb0b400640 1 -- 172.21.15.50:0/1249355672 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7ffb1c076050 con 0x557c15d9f0a0 2024-08-31T04:22:47.539 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:47.530+0000 7ffb3784e740 10 client.15219 fetch_fsmap learned FSMap version 28 2024-08-31T04:22:47.539 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:47.530+0000 7ffb3784e740 1 -- 172.21.15.50:0/1249355672 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x557c161f7470 con 0x557c15d9f0a0 2024-08-31T04:22:47.539 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:47.530+0000 7ffb0b400640 1 -- 172.21.15.50:0/1249355672 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ffb1c062070 con 0x557c15d9f0a0 2024-08-31T04:22:47.539 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:47.531+0000 7ffb0b400640 1 -- 172.21.15.50:0/1249355672 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7ffb1c03d5e0 con 0x557c15d9f0a0 2024-08-31T04:22:47.539 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:47.531+0000 7ffb3784e740 10 client.15219 fetch_fsmap finished waiting for FSMap version 28 2024-08-31T04:22:47.539 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:47.531+0000 7ffb3784e740 10 client.15219 resolve_mds: resolved name 'h' to daemon mds.h 2024-08-31T04:22:47.539 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:47.531+0000 7ffb3784e740 20 client.15219 populate_metadata read hostname 'smithi050' 2024-08-31T04:22:47.540 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:47.531+0000 7ffb3784e740 1 --2- 172.21.15.50:0/1249355672 >> [v2:172.21.15.133:6836/4014853202,v1:172.21.15.133:6837/4014853202] conn(0x557c15d5bc90 0x557c161fa8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:47.540 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:47.531+0000 7ffb3784e740 4 client.15219 mds_command: new command op to 24656 tid=0 multi_id=0 [{"prefix": "status"}] 2024-08-31T04:22:47.540 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:47.531+0000 7ffb3784e740 1 -- 172.21.15.50:0/1249355672 --> [v2:172.21.15.133:6836/4014853202,v1:172.21.15.133:6837/4014853202] -- command(tid 0: {"prefix": "status"}) -- 0x557c160e1f40 con 0x557c15d5bc90 2024-08-31T04:22:47.540 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:47.531+0000 7ffb29400640 1 --2- 172.21.15.50:0/1249355672 >> [v2:172.21.15.133:6836/4014853202,v1:172.21.15.133:6837/4014853202] conn(0x557c15d5bc90 0x557c161fa8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:22:47.540 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:47.532+0000 7ffb29400640 1 --2- 172.21.15.50:0/1249355672 >> [v2:172.21.15.133:6836/4014853202,v1:172.21.15.133:6837/4014853202] conn(0x557c15d5bc90 0x557c161fa8f0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=185a1e59a7952ea6 server_cookie=74af05b14a8339be in_seq=0 out_seq=0 2024-08-31T04:22:47.540 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:47.532+0000 7ffb0b400640 10 client.15219 ms_handle_connect on v2:172.21.15.133:6836/4014853202 2024-08-31T04:22:47.540 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:47.532+0000 7ffb0b400640 1 -- 172.21.15.50:0/1249355672 <== mds.3 v2:172.21.15.133:6836/4014853202 1 ==== command_reply(tid 0: 0 ) ==== 8+0+322 (crc 0 0 0) 0x557c160e1f40 con 0x557c15d5bc90 2024-08-31T04:22:47.540 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:47.532+0000 7ffb0b400640 10 client.15219 handle_command_reply: tid=0 2024-08-31T04:22:47.540 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:47.532+0000 7ffb3784e740 1 client.15219 shutdown 2024-08-31T04:22:47.540 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:47.532+0000 7ffb3784e740 1 -- 172.21.15.50:0/1249355672 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557c15d9f0a0 msgr2=0x557c1618ffc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:22:47.540 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:47.532+0000 7ffb3784e740 1 --2- 172.21.15.50:0/1249355672 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557c15d9f0a0 0x557c1618ffc0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7ffb1c003c80 tx=0x7ffb1c03f000 comp rx=0 tx=0).stop 2024-08-31T04:22:47.540 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:47.532+0000 7ffb3784e740 1 -- 172.21.15.50:0/1249355672 shutdown_connections 2024-08-31T04:22:47.540 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:47.532+0000 7ffb3784e740 1 --2- 172.21.15.50:0/1249355672 >> [v2:172.21.15.133:6836/4014853202,v1:172.21.15.133:6837/4014853202] conn(0x557c15d5bc90 0x557c161fa8f0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:47.541 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:47.532+0000 7ffb3784e740 1 --2- 172.21.15.50:0/1249355672 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557c15dc7f60 0x557c16190a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:47.541 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:47.532+0000 7ffb3784e740 1 --2- 172.21.15.50:0/1249355672 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x557c15da7280 0x557c16190500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:47.541 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:47.532+0000 7ffb3784e740 1 --2- 172.21.15.50:0/1249355672 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557c15d9f0a0 0x557c1618ffc0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:47.541 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:47.532+0000 7ffb3784e740 1 -- 172.21.15.50:0/1249355672 >> 172.21.15.50:0/1249355672 conn(0x557c15dbc350 msgr2=0x557c16179050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:22:47.541 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:47.532+0000 7ffb0b400640 0 client.15219 ms_handle_reset on v2:172.21.15.133:6836/4014853202 2024-08-31T04:22:47.541 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:47.532+0000 7ffb3784e740 1 -- 172.21.15.50:0/1249355672 shutdown_connections 2024-08-31T04:22:47.541 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:47.533+0000 7ffb3784e740 1 -- 172.21.15.50:0/1249355672 wait complete. 2024-08-31T04:22:47.541 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:47.533+0000 7ffb3784e740 20 client.15219 trim_cache size 0 max 16384 2024-08-31T04:22:47.541 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-08-31T04:22:47.542 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_fsid": "058d9fc6-674f-11ef-bcd4-c7b262605968", 2024-08-31T04:22:47.542 INFO:teuthology.orchestra.run.smithi050.stdout: "whoami": 3, 2024-08-31T04:22:47.542 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 24656, 2024-08-31T04:22:47.542 INFO:teuthology.orchestra.run.smithi050.stdout: "want_state": "up:active", 2024-08-31T04:22:47.542 INFO:teuthology.orchestra.run.smithi050.stdout: "state": "up:active", 2024-08-31T04:22:47.542 INFO:teuthology.orchestra.run.smithi050.stdout: "fs_name": "cephfs", 2024-08-31T04:22:47.542 INFO:teuthology.orchestra.run.smithi050.stdout: "rank_uptime": 111.529687223, 2024-08-31T04:22:47.542 INFO:teuthology.orchestra.run.smithi050.stdout: "mdsmap_epoch": 28, 2024-08-31T04:22:47.542 INFO:teuthology.orchestra.run.smithi050.stdout: "osdmap_epoch": 78, 2024-08-31T04:22:47.542 INFO:teuthology.orchestra.run.smithi050.stdout: "osdmap_epoch_barrier": 78, 2024-08-31T04:22:47.542 INFO:teuthology.orchestra.run.smithi050.stdout: "uptime": 149.491053069 2024-08-31T04:22:47.542 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-08-31T04:22:47.543 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:47.533+0000 7ffb2b200640 1 -- 172.21.15.50:0/394606811 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7ffb100b4b30 msgr2=0x7ffb100b7040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:22:47.543 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:47.533+0000 7ffb2b200640 1 --2- 172.21.15.50:0/394606811 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7ffb100b4b30 0x7ffb100b7040 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x557c1616c720 tx=0x7ffb1c005e30 comp rx=0 tx=0).stop 2024-08-31T04:22:47.543 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:47.533+0000 7ffb2b200640 1 -- 172.21.15.50:0/394606811 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffb2c10b2a0 msgr2=0x7ffb2c19c840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:22:47.543 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:47.533+0000 7ffb2b200640 1 --2- 172.21.15.50:0/394606811 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffb2c10b2a0 0x7ffb2c19c840 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7ffb1800d950 tx=0x7ffb1800de10 comp rx=0 tx=0).stop 2024-08-31T04:22:47.543 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:47.534+0000 7ffb2b200640 1 -- 172.21.15.50:0/394606811 shutdown_connections 2024-08-31T04:22:47.543 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:47.534+0000 7ffb2b200640 1 --2- 172.21.15.50:0/394606811 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7ffb100b4b30 0x7ffb100b7040 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:47.543 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:47.534+0000 7ffb2b200640 1 --2- 172.21.15.50:0/394606811 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ffb2c10bbf0 0x7ffb2c1a1ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:47.544 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:47.534+0000 7ffb2b200640 1 --2- 172.21.15.50:0/394606811 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffb2c10b2a0 0x7ffb2c19c840 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:47.544 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:47.534+0000 7ffb2b200640 1 --2- 172.21.15.50:0/394606811 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ffb2c105960 0x7ffb2c19c2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:47.544 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:47.534+0000 7ffb2b200640 1 -- 172.21.15.50:0/394606811 >> 172.21.15.50:0/394606811 conn(0x7ffb2c101410 msgr2=0x7ffb2c10a940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:22:47.544 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:47.534+0000 7ffb2b200640 1 -- 172.21.15.50:0/394606811 shutdown_connections 2024-08-31T04:22:47.544 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:47.534+0000 7ffb2b200640 1 -- 172.21.15.50:0/394606811 wait complete. 2024-08-31T04:22:47.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:22:47 smithi050 ceph-mon[17259]: pgmap v363: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2024-08-31T04:22:47.996 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:22:47 smithi177 ceph-mon[22025]: pgmap v363: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2024-08-31T04:22:48.043 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:22:47 smithi133 ceph-mon[22177]: pgmap v363: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2024-08-31T04:22:48.289 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 058d9fc6-674f-11ef-bcd4-c7b262605968 -- ceph tell mds.i status 2024-08-31T04:22:48.669 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:22:49.287 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:49.285+0000 7fc4b0000640 1 -- 172.21.15.50:0/244909770 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc4a8103900 msgr2=0x7fc4a8103d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:22:49.287 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:49.285+0000 7fc4b0000640 1 --2- 172.21.15.50:0/244909770 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc4a8103900 0x7fc4a8103d10 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fc49c009900 tx=0x7fc49c02a3f0 comp rx=0 tx=0).stop 2024-08-31T04:22:49.288 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:49.286+0000 7fc4b0000640 1 -- 172.21.15.50:0/244909770 shutdown_connections 2024-08-31T04:22:49.288 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:49.286+0000 7fc4b0000640 1 --2- 172.21.15.50:0/244909770 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc4a8109b90 0x7fc4a81103c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:49.288 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:49.286+0000 7fc4b0000640 1 --2- 172.21.15.50:0/244909770 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc4a8109240 0x7fc4a8109650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:49.288 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:49.286+0000 7fc4b0000640 1 --2- 172.21.15.50:0/244909770 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc4a8103900 0x7fc4a8103d10 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:49.288 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:49.286+0000 7fc4b0000640 1 -- 172.21.15.50:0/244909770 >> 172.21.15.50:0/244909770 conn(0x7fc4a807b5f0 msgr2=0x7fc4a807ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:22:49.288 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:49.286+0000 7fc4b0000640 1 -- 172.21.15.50:0/244909770 shutdown_connections 2024-08-31T04:22:49.288 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:49.286+0000 7fc4b0000640 1 -- 172.21.15.50:0/244909770 wait complete. 2024-08-31T04:22:49.289 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:49.287+0000 7fc4b0000640 1 Processor -- start 2024-08-31T04:22:49.289 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:49.287+0000 7fc4b0000640 1 -- start start 2024-08-31T04:22:49.290 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:49.288+0000 7fc4b0000640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc4a8103900 0x7fc4a819a270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:49.290 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:49.288+0000 7fc4b0000640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc4a8109240 0x7fc4a819a810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:49.290 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:49.288+0000 7fc4b0000640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc4a8109b90 0x7fc4a819fab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:49.290 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:49.288+0000 7fc4b0000640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fc4a81138a0 con 0x7fc4a8103900 2024-08-31T04:22:49.290 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:49.288+0000 7fc4b0000640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7fc4a8113720 con 0x7fc4a8109240 2024-08-31T04:22:49.290 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:49.288+0000 7fc4b0000640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fc4a8113a20 con 0x7fc4a8109b90 2024-08-31T04:22:49.290 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:49.288+0000 7fc4ad600640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc4a8103900 0x7fc4a819a270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:22:49.290 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:49.288+0000 7fc4ad600640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc4a8103900 0x7fc4a819a270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:39772/0 (socket says 172.21.15.50:39772) 2024-08-31T04:22:49.290 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:49.288+0000 7fc4ad600640 1 -- 172.21.15.50:0/2487539490 learned_addr learned my addr 172.21.15.50:0/2487539490 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:22:49.290 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:49.288+0000 7fc4ae000640 1 --2- 172.21.15.50:0/2487539490 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc4a8109b90 0x7fc4a819fab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:22:49.291 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:49.288+0000 7fc4acc00640 1 --2- 172.21.15.50:0/2487539490 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc4a8109240 0x7fc4a819a810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:22:49.291 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:49.289+0000 7fc4ad600640 1 -- 172.21.15.50:0/2487539490 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc4a8109b90 msgr2=0x7fc4a819fab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:22:49.291 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:49.289+0000 7fc4ad600640 1 --2- 172.21.15.50:0/2487539490 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc4a8109b90 0x7fc4a819fab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:49.291 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:49.289+0000 7fc4ad600640 1 -- 172.21.15.50:0/2487539490 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc4a8109240 msgr2=0x7fc4a819a810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:22:49.291 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:49.289+0000 7fc4ad600640 1 --2- 172.21.15.50:0/2487539490 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc4a8109240 0x7fc4a819a810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:49.291 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:49.289+0000 7fc4ad600640 1 -- 172.21.15.50:0/2487539490 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4a81a01e0 con 0x7fc4a8103900 2024-08-31T04:22:49.291 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:49.289+0000 7fc4ae000640 1 --2- 172.21.15.50:0/2487539490 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc4a8109b90 0x7fc4a819fab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:22:49.292 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:49.289+0000 7fc4ad600640 1 --2- 172.21.15.50:0/2487539490 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc4a8103900 0x7fc4a819a270 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fc49c005ab0 tx=0x7fc49c003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:22:49.292 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:49.289+0000 7fc4a6000640 1 -- 172.21.15.50:0/2487539490 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc49c03f070 con 0x7fc4a8103900 2024-08-31T04:22:49.292 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:49.289+0000 7fc4b0000640 1 -- 172.21.15.50:0/2487539490 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc4a81a0470 con 0x7fc4a8103900 2024-08-31T04:22:49.292 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:49.289+0000 7fc4a6000640 1 -- 172.21.15.50:0/2487539490 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc49c031b60 con 0x7fc4a8103900 2024-08-31T04:22:49.292 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:49.289+0000 7fc4a6000640 1 -- 172.21.15.50:0/2487539490 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc49c035030 con 0x7fc4a8103900 2024-08-31T04:22:49.292 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:49.290+0000 7fc4b0000640 1 -- 172.21.15.50:0/2487539490 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc4a81a6c30 con 0x7fc4a8103900 2024-08-31T04:22:49.294 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:49.293+0000 7fc4b6c59740 1 Processor -- start 2024-08-31T04:22:49.294 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:49.293+0000 7fc4b6c59740 1 -- start start 2024-08-31T04:22:49.295 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:49.293+0000 7fc4b6c59740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5567972bcf60 0x5567976628f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:49.295 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:49.293+0000 7fc4b6c59740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5567972940a0 0x556797662e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:49.295 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:49.293+0000 7fc4b6c59740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55679729c280 0x556797663370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:49.295 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:49.293+0000 7fc4b6c59740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x5567975d9550 con 0x5567972bcf60 2024-08-31T04:22:49.295 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:49.293+0000 7fc4b6c59740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x5567975c8ae0 con 0x5567972940a0 2024-08-31T04:22:49.295 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:49.293+0000 7fc4b6c59740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x5567975cca90 con 0x55679729c280 2024-08-31T04:22:49.295 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:49.293+0000 7fc4a6000640 1 -- 172.21.15.50:0/2487539490 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 18) ==== 152577+0+0 (secure 0 0 0) 0x7fc49c042070 con 0x7fc4a8103900 2024-08-31T04:22:49.295 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:49.293+0000 7fc4ae000640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5567972bcf60 0x5567976628f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:22:49.295 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:49.293+0000 7fc4ae000640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5567972bcf60 0x5567976628f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:39776/0 (socket says 172.21.15.50:39776) 2024-08-31T04:22:49.296 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:49.294+0000 7fc4ae000640 1 -- 172.21.15.50:0/3563751135 learned_addr learned my addr 172.21.15.50:0/3563751135 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:22:49.296 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:49.294+0000 7fc4acc00640 1 --2- 172.21.15.50:0/3563751135 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55679729c280 0x556797663370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:22:49.296 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:49.294+0000 7fc4ad600640 1 --2- 172.21.15.50:0/3563751135 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5567972940a0 0x556797662e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:22:49.297 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:49.294+0000 7fc4ae000640 1 -- 172.21.15.50:0/3563751135 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55679729c280 msgr2=0x556797663370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:22:49.297 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:49.294+0000 7fc4ae000640 1 --2- 172.21.15.50:0/3563751135 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55679729c280 0x556797663370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:49.297 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:49.294+0000 7fc4ae000640 1 -- 172.21.15.50:0/3563751135 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5567972940a0 msgr2=0x556797662e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:22:49.297 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:49.294+0000 7fc4ae000640 1 --2- 172.21.15.50:0/3563751135 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5567972940a0 0x556797662e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:49.297 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:49.294+0000 7fc4ae000640 1 -- 172.21.15.50:0/3563751135 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556797328540 con 0x5567972bcf60 2024-08-31T04:22:49.297 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:49.294+0000 7fc4ae000640 1 --2- 172.21.15.50:0/3563751135 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5567972bcf60 0x5567976628f0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fc4a0011790 tx=0x7fc4a0011c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38a0d8c2ad6d3c0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:22:49.297 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:49.295+0000 7fc49a600640 1 -- 172.21.15.50:0/3563751135 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4a0003c30 con 0x5567972bcf60 2024-08-31T04:22:49.298 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:49.295+0000 7fc49a600640 1 -- 172.21.15.50:0/3563751135 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc4a000fe50 con 0x5567972bcf60 2024-08-31T04:22:49.298 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:49.295+0000 7fc49a600640 1 -- 172.21.15.50:0/3563751135 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4a00193e0 con 0x5567972bcf60 2024-08-31T04:22:49.298 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:49.295+0000 7fc4a6000640 1 --2- 172.21.15.50:0/2487539490 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fc4900b4b30 0x7fc4900b7040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:49.298 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:49.295+0000 7fc4a6000640 1 -- 172.21.15.50:0/2487539490 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8219+0+0 (secure 0 0 0) 0x7fc49c105870 con 0x7fc4a8103900 2024-08-31T04:22:49.298 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:49.296+0000 7fc4b6c59740 1 -- 172.21.15.50:0/3563751135 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5567972bcf60 msgr2=0x5567976628f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:22:49.298 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:49.296+0000 7fc4b6c59740 1 --2- 172.21.15.50:0/3563751135 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5567972bcf60 0x5567976628f0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fc4a0011790 tx=0x7fc4a0011c50 comp rx=0 tx=0).stop 2024-08-31T04:22:49.298 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:49.296+0000 7fc4ad600640 1 --2- 172.21.15.50:0/2487539490 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fc4900b4b30 0x7fc4900b7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:22:49.298 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:49.296+0000 7fc4b6c59740 1 -- 172.21.15.50:0/3563751135 shutdown_connections 2024-08-31T04:22:49.298 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:49.296+0000 7fc4b6c59740 1 --2- 172.21.15.50:0/3563751135 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55679729c280 0x556797663370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:49.298 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:49.296+0000 7fc4b6c59740 1 --2- 172.21.15.50:0/3563751135 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5567972940a0 0x556797662e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:49.298 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:49.296+0000 7fc4b6c59740 1 --2- 172.21.15.50:0/3563751135 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5567972bcf60 0x5567976628f0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:49.298 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:49.296+0000 7fc4b6c59740 1 -- 172.21.15.50:0/3563751135 >> 172.21.15.50:0/3563751135 conn(0x5567972b1350 msgr2=0x5567976607e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:22:49.298 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:49.296+0000 7fc4b6c59740 1 -- 172.21.15.50:0/3563751135 shutdown_connections 2024-08-31T04:22:49.299 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:49.296+0000 7fc4b6c59740 1 -- 172.21.15.50:0/3563751135 wait complete. 2024-08-31T04:22:49.299 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:49.296+0000 7fc4ad600640 1 --2- 172.21.15.50:0/2487539490 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fc4900b4b30 0x7fc4900b7040 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fc49c000c00 tx=0x7fc49c031400 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:22:49.299 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:49.297+0000 7fc4b6c59740 1 -- start start 2024-08-31T04:22:49.299 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:49.297+0000 7fc4b6c59740 1 Processor -- start 2024-08-31T04:22:49.300 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:49.298+0000 7fc4b6c59740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5567972940a0 0x55679766e0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:49.301 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:49.298+0000 7fc4b6c59740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55679729c280 0x55679766e5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:49.301 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:49.298+0000 7fc4b6c59740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5567972bcf60 0x55679767e7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:49.301 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:49.298+0000 7fc4b6c59740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55679742b5f0 con 0x5567972bcf60 2024-08-31T04:22:49.301 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:49.298+0000 7fc4b6c59740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x55679754fbd0 con 0x5567972940a0 2024-08-31T04:22:49.301 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:49.298+0000 7fc4b6c59740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x5567976710d0 con 0x55679729c280 2024-08-31T04:22:49.301 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:49.298+0000 7fc4b6c59740 10 client.0 _ll_register_callbacks cb 0x556797575210 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:22:49.301 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:49.299+0000 7fc4ae000640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5567972bcf60 0x55679767e7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:22:49.301 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:49.299+0000 7fc4acc00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55679729c280 0x55679766e5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:22:49.301 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:49.299+0000 7fc4ae000640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5567972bcf60 0x55679767e7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:39778/0 (socket says 172.21.15.50:39778) 2024-08-31T04:22:49.301 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:49.299+0000 7fc4ae000640 1 -- 172.21.15.50:0/3912348212 learned_addr learned my addr 172.21.15.50:0/3912348212 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:22:49.301 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:49.299+0000 7fc4acc00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55679729c280 0x55679766e5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.50:53662/0 (socket says 172.21.15.50:53662) 2024-08-31T04:22:49.301 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:49.299+0000 7fc4ae000640 1 --2- 172.21.15.50:0/3912348212 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5567972940a0 0x55679766e0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:22:49.302 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:49.299+0000 7fc4acc00640 1 -- 172.21.15.50:0/3912348212 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5567972940a0 msgr2=0x55679766e0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:22:49.302 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:49.299+0000 7fc4acc00640 1 --2- 172.21.15.50:0/3912348212 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5567972940a0 0x55679766e0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:49.302 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:49.299+0000 7fc4acc00640 1 -- 172.21.15.50:0/3912348212 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5567972bcf60 msgr2=0x55679767e7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:22:49.302 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:49.299+0000 7fc4acc00640 1 --2- 172.21.15.50:0/3912348212 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5567972bcf60 0x55679767e7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:49.302 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:49.299+0000 7fc4acc00640 1 -- 172.21.15.50:0/3912348212 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556797590650 con 0x55679729c280 2024-08-31T04:22:49.302 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:49.300+0000 7fc4acc00640 1 --2- 172.21.15.50:0/3912348212 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55679729c280 0x55679766e5e0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fc4a806c500 tx=0x7fc494012b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c548725c19797d72 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:22:49.302 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:49.300+0000 7fc48ea00640 10 client.0 ms_handle_connect on v2:172.21.15.177:3300/0 2024-08-31T04:22:49.304 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:49.300+0000 7fc48ea00640 1 -- 172.21.15.50:0/3912348212 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc49400f8f0 con 0x55679729c280 2024-08-31T04:22:49.304 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:49.300+0000 7fc4b6c59740 1 -- 172.21.15.50:0/3912348212 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc4a000fe50 con 0x55679729c280 2024-08-31T04:22:49.304 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:49.300+0000 7fc48ea00640 1 -- 172.21.15.50:0/3912348212 <== mon.1 v2:172.21.15.177:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8219+0+0 (secure 0 0 0) 0x7fc49400fa90 con 0x55679729c280 2024-08-31T04:22:49.304 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:49.300+0000 7fc48ea00640 1 -- 172.21.15.50:0/3912348212 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fc49400fc90 con 0x55679729c280 2024-08-31T04:22:49.304 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:49.300+0000 7fc4b6c59740 10 client.25240 fetch_fsmap learned FSMap version 28 2024-08-31T04:22:49.304 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:49.300+0000 7fc4b6c59740 1 -- 172.21.15.50:0/3912348212 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x556797681340 con 0x55679729c280 2024-08-31T04:22:49.304 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:49.301+0000 7fc48ea00640 1 -- 172.21.15.50:0/3912348212 <== mon.1 v2:172.21.15.177:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc4a000fe50 con 0x55679729c280 2024-08-31T04:22:49.304 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:49.301+0000 7fc48ea00640 1 -- 172.21.15.50:0/3912348212 <== mon.1 v2:172.21.15.177:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fc49401c420 con 0x55679729c280 2024-08-31T04:22:49.304 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:49.301+0000 7fc4b6c59740 10 client.25240 fetch_fsmap finished waiting for FSMap version 28 2024-08-31T04:22:49.304 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:49.301+0000 7fc4b6c59740 10 client.25240 resolve_mds: resolved name 'i' to daemon mds.i 2024-08-31T04:22:49.304 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:49.301+0000 7fc4b6c59740 20 client.25240 populate_metadata read hostname 'smithi050' 2024-08-31T04:22:49.305 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:49.301+0000 7fc4b6c59740 1 --2- 172.21.15.50:0/3912348212 >> [v2:172.21.15.177:6838/3600081752,v1:172.21.15.177:6839/3600081752] conn(0x55679727b8e0 0x556797684d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:49.305 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:49.301+0000 7fc4b6c59740 4 client.25240 mds_command: new command op to 24667 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T04:22:49.305 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:49.301+0000 7fc4b6c59740 1 -- 172.21.15.50:0/3912348212 --> [v2:172.21.15.177:6838/3600081752,v1:172.21.15.177:6839/3600081752] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5567975db4a0 con 0x55679727b8e0 2024-08-31T04:22:49.305 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:49.301+0000 7fc4ae000640 1 --2- 172.21.15.50:0/3912348212 >> [v2:172.21.15.177:6838/3600081752,v1:172.21.15.177:6839/3600081752] conn(0x55679727b8e0 0x556797684d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:22:49.305 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:49.302+0000 7fc4ae000640 1 --2- 172.21.15.50:0/3912348212 >> [v2:172.21.15.177:6838/3600081752,v1:172.21.15.177:6839/3600081752] conn(0x55679727b8e0 0x556797684d90 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=406eafdd43fe3592 server_cookie=688cf1fad892d565 in_seq=0 out_seq=0 2024-08-31T04:22:49.305 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:49.302+0000 7fc48ea00640 10 client.25240 ms_handle_connect on v2:172.21.15.177:6838/3600081752 2024-08-31T04:22:49.305 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:49.303+0000 7fc48ea00640 1 -- 172.21.15.50:0/3912348212 <== mds.2 v2:172.21.15.177:6838/3600081752 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5567975db4a0 con 0x55679727b8e0 2024-08-31T04:22:49.305 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:49.303+0000 7fc48ea00640 10 client.25240 handle_command_reply: tid=0 2024-08-31T04:22:49.305 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:49.303+0000 7fc4b6c59740 1 client.25240 shutdown 2024-08-31T04:22:49.306 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:49.303+0000 7fc4b6c59740 1 -- 172.21.15.50:0/3912348212 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55679729c280 msgr2=0x55679766e5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:22:49.306 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:49.303+0000 7fc4b6c59740 1 --2- 172.21.15.50:0/3912348212 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55679729c280 0x55679766e5e0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fc4a806c500 tx=0x7fc494012b60 comp rx=0 tx=0).stop 2024-08-31T04:22:49.306 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:49.303+0000 7fc4b6c59740 1 -- 172.21.15.50:0/3912348212 shutdown_connections 2024-08-31T04:22:49.306 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:49.303+0000 7fc4b6c59740 1 --2- 172.21.15.50:0/3912348212 >> [v2:172.21.15.177:6838/3600081752,v1:172.21.15.177:6839/3600081752] conn(0x55679727b8e0 0x556797684d90 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:49.306 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:49.303+0000 7fc4b6c59740 1 --2- 172.21.15.50:0/3912348212 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55679729c280 0x55679766e5e0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:49.306 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:49.303+0000 7fc4b6c59740 1 --2- 172.21.15.50:0/3912348212 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5567972bcf60 0x55679767e7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:49.306 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:49.303+0000 7fc4b6c59740 1 --2- 172.21.15.50:0/3912348212 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5567972940a0 0x55679766e0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:49.307 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:49.303+0000 7fc48ea00640 0 client.25240 ms_handle_reset on v2:172.21.15.177:6838/3600081752 2024-08-31T04:22:49.307 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:49.303+0000 7fc4b6c59740 1 -- 172.21.15.50:0/3912348212 >> 172.21.15.50:0/3912348212 conn(0x5567972b1350 msgr2=0x556797665ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:22:49.307 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:49.303+0000 7fc4b6c59740 1 -- 172.21.15.50:0/3912348212 shutdown_connections 2024-08-31T04:22:49.307 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:49.303+0000 7fc4b6c59740 1 -- 172.21.15.50:0/3912348212 wait complete. 2024-08-31T04:22:49.307 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:49.303+0000 7fc4b6c59740 20 client.25240 trim_cache size 0 max 16384 2024-08-31T04:22:49.324 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:49.322+0000 7fc4b6c59740 1 Processor -- start 2024-08-31T04:22:49.324 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:49.322+0000 7fc4b6c59740 1 -- start start 2024-08-31T04:22:49.324 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:49.323+0000 7fc4b6c59740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5567972940a0 0x55679767e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:49.324 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:49.323+0000 7fc4b6c59740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55679729c280 0x55679766c920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:49.325 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:49.323+0000 7fc4b6c59740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5567972bcf60 0x55679766ce60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:49.325 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:49.323+0000 7fc4b6c59740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x5567976830d0 con 0x5567972940a0 2024-08-31T04:22:49.325 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:49.323+0000 7fc4b6c59740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x5567976837a0 con 0x5567972bcf60 2024-08-31T04:22:49.325 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:49.323+0000 7fc4b6c59740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x556797683e70 con 0x55679729c280 2024-08-31T04:22:49.325 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:49.323+0000 7fc4ae000640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5567972940a0 0x55679767e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:22:49.325 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:49.323+0000 7fc4acc00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55679729c280 0x55679766c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:22:49.325 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:49.323+0000 7fc4ae000640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5567972940a0 0x55679767e7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:39786/0 (socket says 172.21.15.50:39786) 2024-08-31T04:22:49.325 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:49.323+0000 7fc4ae000640 1 -- 172.21.15.50:0/381687317 learned_addr learned my addr 172.21.15.50:0/381687317 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:22:49.327 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:49.323+0000 7fc4ae000640 1 --2- 172.21.15.50:0/381687317 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5567972bcf60 0x55679766ce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:22:49.327 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:49.323+0000 7fc4acc00640 1 -- 172.21.15.50:0/381687317 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5567972bcf60 msgr2=0x55679766ce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:22:49.327 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:49.323+0000 7fc4acc00640 1 --2- 172.21.15.50:0/381687317 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5567972bcf60 0x55679766ce60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:49.327 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:49.324+0000 7fc4acc00640 1 -- 172.21.15.50:0/381687317 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5567972940a0 msgr2=0x55679767e7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:22:49.327 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:49.324+0000 7fc4acc00640 1 --2- 172.21.15.50:0/381687317 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5567972940a0 0x55679767e7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:49.327 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:49.324+0000 7fc4acc00640 1 -- 172.21.15.50:0/381687317 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556797664be0 con 0x55679729c280 2024-08-31T04:22:49.327 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:49.324+0000 7fc4ae000640 1 --2- 172.21.15.50:0/381687317 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5567972940a0 0x55679767e7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:22:49.327 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:49.324+0000 7fc4acc00640 1 --2- 172.21.15.50:0/381687317 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55679729c280 0x55679766c920 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fc494009e00 tx=0x7fc494009640 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7785f66419d0ecc server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:22:49.327 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:49.324+0000 7fc499c00640 1 -- 172.21.15.50:0/381687317 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc49402b070 con 0x55679729c280 2024-08-31T04:22:49.327 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:49.324+0000 7fc499c00640 1 -- 172.21.15.50:0/381687317 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc494022030 con 0x55679729c280 2024-08-31T04:22:49.327 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:49.324+0000 7fc499c00640 1 -- 172.21.15.50:0/381687317 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc494005370 con 0x55679729c280 2024-08-31T04:22:49.327 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:49.325+0000 7fc4b6c59740 1 -- 172.21.15.50:0/381687317 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55679729c280 msgr2=0x55679766c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:22:49.328 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:49.325+0000 7fc4b6c59740 1 --2- 172.21.15.50:0/381687317 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55679729c280 0x55679766c920 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fc494009e00 tx=0x7fc494009640 comp rx=0 tx=0).stop 2024-08-31T04:22:49.328 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:49.325+0000 7fc4b6c59740 1 -- 172.21.15.50:0/381687317 shutdown_connections 2024-08-31T04:22:49.328 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:49.325+0000 7fc4b6c59740 1 --2- 172.21.15.50:0/381687317 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55679729c280 0x55679766c920 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:49.328 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:49.325+0000 7fc4b6c59740 1 --2- 172.21.15.50:0/381687317 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5567972bcf60 0x55679766ce60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:49.328 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:49.325+0000 7fc4b6c59740 1 --2- 172.21.15.50:0/381687317 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5567972940a0 0x55679767e7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:49.328 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:49.325+0000 7fc4b6c59740 1 -- 172.21.15.50:0/381687317 >> 172.21.15.50:0/381687317 conn(0x5567972b1350 msgr2=0x55679765b4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:22:49.328 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:49.325+0000 7fc4b6c59740 1 -- 172.21.15.50:0/381687317 shutdown_connections 2024-08-31T04:22:49.328 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:49.325+0000 7fc4b6c59740 1 -- 172.21.15.50:0/381687317 wait complete. 2024-08-31T04:22:49.328 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:49.325+0000 7fc4b6c59740 1 -- start start 2024-08-31T04:22:49.328 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:49.326+0000 7fc4b6c59740 1 Processor -- start 2024-08-31T04:22:49.330 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:49.326+0000 7fc4b6c59740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5567972940a0 0x55679768d980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:49.331 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:49.326+0000 7fc4b6c59740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55679729c280 0x556797686e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:49.331 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:49.326+0000 7fc4b6c59740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5567972bcf60 0x556797687520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:49.331 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:49.326+0000 7fc4b6c59740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x556797684c10 con 0x5567972940a0 2024-08-31T04:22:49.331 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:49.326+0000 7fc4b6c59740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x556797684540 con 0x5567972bcf60 2024-08-31T04:22:49.331 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:49.326+0000 7fc4b6c59740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x5567976852e0 con 0x55679729c280 2024-08-31T04:22:49.331 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:49.326+0000 7fc4b6c59740 10 client.0 _ll_register_callbacks cb 0x7fc494009ec0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:22:49.331 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:49.326+0000 7fc4ae000640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5567972940a0 0x55679768d980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:22:49.331 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:49.326+0000 7fc4ae000640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5567972940a0 0x55679768d980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:39788/0 (socket says 172.21.15.50:39788) 2024-08-31T04:22:49.331 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:49.326+0000 7fc4ae000640 1 -- 172.21.15.50:0/3496816655 learned_addr learned my addr 172.21.15.50:0/3496816655 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:22:49.331 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:49.327+0000 7fc4acc00640 1 --2- 172.21.15.50:0/3496816655 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55679729c280 0x556797686e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:22:49.331 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:49.327+0000 7fc4ae000640 1 --2- 172.21.15.50:0/3496816655 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5567972bcf60 0x556797687520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:22:49.332 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:49.327+0000 7fc4ae000640 1 -- 172.21.15.50:0/3496816655 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55679729c280 msgr2=0x556797686e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:22:49.332 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:49.327+0000 7fc4ae000640 1 --2- 172.21.15.50:0/3496816655 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55679729c280 0x556797686e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:49.332 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:49.327+0000 7fc4ae000640 1 -- 172.21.15.50:0/3496816655 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5567972bcf60 msgr2=0x556797687520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:22:49.332 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:49.327+0000 7fc4ae000640 1 --2- 172.21.15.50:0/3496816655 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5567972bcf60 0x556797687520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:49.332 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:49.327+0000 7fc4ae000640 1 -- 172.21.15.50:0/3496816655 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556797687cb0 con 0x5567972940a0 2024-08-31T04:22:49.332 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:49.327+0000 7fc4ae000640 1 --2- 172.21.15.50:0/3496816655 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5567972940a0 0x55679768d980 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fc4a0011760 tx=0x7fc4a0005bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28c47a27534df163 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:22:49.332 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:49.327+0000 7fc48ea00640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-08-31T04:22:49.332 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:49.327+0000 7fc48ea00640 1 -- 172.21.15.50:0/3496816655 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4a000fea0 con 0x5567972940a0 2024-08-31T04:22:49.332 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:49.328+0000 7fc48ea00640 1 -- 172.21.15.50:0/3496816655 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8219+0+0 (secure 0 0 0) 0x7fc4a0004a00 con 0x5567972940a0 2024-08-31T04:22:49.332 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:49.328+0000 7fc4b6c59740 1 -- 172.21.15.50:0/3496816655 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc494022030 con 0x5567972940a0 2024-08-31T04:22:49.332 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:49.328+0000 7fc48ea00640 1 -- 172.21.15.50:0/3496816655 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fc4a0004c00 con 0x5567972940a0 2024-08-31T04:22:49.332 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:49.328+0000 7fc4b6c59740 10 client.15237 fetch_fsmap learned FSMap version 28 2024-08-31T04:22:49.332 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:49.328+0000 7fc4b6c59740 1 -- 172.21.15.50:0/3496816655 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x556797671360 con 0x5567972940a0 2024-08-31T04:22:49.333 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:49.328+0000 7fc48ea00640 1 -- 172.21.15.50:0/3496816655 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc494022030 con 0x5567972940a0 2024-08-31T04:22:49.333 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:49.328+0000 7fc48ea00640 1 -- 172.21.15.50:0/3496816655 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fc4a0018070 con 0x5567972940a0 2024-08-31T04:22:49.333 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:49.328+0000 7fc4b6c59740 10 client.15237 fetch_fsmap finished waiting for FSMap version 28 2024-08-31T04:22:49.333 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:49.329+0000 7fc4b6c59740 10 client.15237 resolve_mds: resolved name 'i' to daemon mds.i 2024-08-31T04:22:49.333 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:49.329+0000 7fc4b6c59740 20 client.15237 populate_metadata read hostname 'smithi050' 2024-08-31T04:22:49.333 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:49.329+0000 7fc4b6c59740 1 --2- 172.21.15.50:0/3496816655 >> [v2:172.21.15.177:6838/3600081752,v1:172.21.15.177:6839/3600081752] conn(0x556797250c90 0x556797674a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:49.333 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:49.329+0000 7fc4b6c59740 4 client.15237 mds_command: new command op to 24667 tid=0 multi_id=0 [{"prefix": "status"}] 2024-08-31T04:22:49.333 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:49.329+0000 7fc4b6c59740 1 -- 172.21.15.50:0/3496816655 --> [v2:172.21.15.177:6838/3600081752,v1:172.21.15.177:6839/3600081752] -- command(tid 0: {"prefix": "status"}) -- 0x5567975d6f40 con 0x556797250c90 2024-08-31T04:22:49.333 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:49.329+0000 7fc4acc00640 1 --2- 172.21.15.50:0/3496816655 >> [v2:172.21.15.177:6838/3600081752,v1:172.21.15.177:6839/3600081752] conn(0x556797250c90 0x556797674a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:22:49.334 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:49.330+0000 7fc4acc00640 1 --2- 172.21.15.50:0/3496816655 >> [v2:172.21.15.177:6838/3600081752,v1:172.21.15.177:6839/3600081752] conn(0x556797250c90 0x556797674a40 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=6f8c00386296b47f server_cookie=3ce9d7a244f13e41 in_seq=0 out_seq=0 2024-08-31T04:22:49.334 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:49.330+0000 7fc48ea00640 10 client.15237 ms_handle_connect on v2:172.21.15.177:6838/3600081752 2024-08-31T04:22:49.335 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:49.330+0000 7fc48ea00640 1 -- 172.21.15.50:0/3496816655 <== mds.2 v2:172.21.15.177:6838/3600081752 1 ==== command_reply(tid 0: 0 ) ==== 8+0+322 (crc 0 0 0) 0x5567975d6f40 con 0x556797250c90 2024-08-31T04:22:49.335 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:49.330+0000 7fc48ea00640 10 client.15237 handle_command_reply: tid=0 2024-08-31T04:22:49.335 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:49.330+0000 7fc4b6c59740 1 client.15237 shutdown 2024-08-31T04:22:49.335 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:49.330+0000 7fc4b6c59740 1 -- 172.21.15.50:0/3496816655 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5567972940a0 msgr2=0x55679768d980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:22:49.335 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:49.330+0000 7fc4b6c59740 1 --2- 172.21.15.50:0/3496816655 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5567972940a0 0x55679768d980 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fc4a0011760 tx=0x7fc4a0005bd0 comp rx=0 tx=0).stop 2024-08-31T04:22:49.335 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:49.330+0000 7fc4b6c59740 1 -- 172.21.15.50:0/3496816655 shutdown_connections 2024-08-31T04:22:49.335 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:49.330+0000 7fc4b6c59740 1 --2- 172.21.15.50:0/3496816655 >> [v2:172.21.15.177:6838/3600081752,v1:172.21.15.177:6839/3600081752] conn(0x556797250c90 0x556797674a40 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:49.335 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:49.330+0000 7fc4b6c59740 1 --2- 172.21.15.50:0/3496816655 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55679729c280 0x556797686e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:49.335 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:49.330+0000 7fc4b6c59740 1 --2- 172.21.15.50:0/3496816655 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5567972bcf60 0x556797687520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:49.335 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:49.330+0000 7fc4b6c59740 1 --2- 172.21.15.50:0/3496816655 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5567972940a0 0x55679768d980 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:49.336 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:49.330+0000 7fc4b6c59740 1 -- 172.21.15.50:0/3496816655 >> 172.21.15.50:0/3496816655 conn(0x5567972b1350 msgr2=0x55679766de50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:22:49.336 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:49.330+0000 7fc48ea00640 0 client.15237 ms_handle_reset on v2:172.21.15.177:6838/3600081752 2024-08-31T04:22:49.336 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:49.330+0000 7fc4b6c59740 1 -- 172.21.15.50:0/3496816655 shutdown_connections 2024-08-31T04:22:49.336 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:49.330+0000 7fc4b6c59740 1 -- 172.21.15.50:0/3496816655 wait complete. 2024-08-31T04:22:49.336 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:49.331+0000 7fc4b6c59740 20 client.15237 trim_cache size 0 max 16384 2024-08-31T04:22:49.336 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-08-31T04:22:49.336 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_fsid": "058d9fc6-674f-11ef-bcd4-c7b262605968", 2024-08-31T04:22:49.336 INFO:teuthology.orchestra.run.smithi050.stdout: "whoami": 2, 2024-08-31T04:22:49.336 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 24667, 2024-08-31T04:22:49.337 INFO:teuthology.orchestra.run.smithi050.stdout: "want_state": "up:active", 2024-08-31T04:22:49.337 INFO:teuthology.orchestra.run.smithi050.stdout: "state": "up:active", 2024-08-31T04:22:49.337 INFO:teuthology.orchestra.run.smithi050.stdout: "fs_name": "cephfs", 2024-08-31T04:22:49.337 INFO:teuthology.orchestra.run.smithi050.stdout: "rank_uptime": 114.341938343, 2024-08-31T04:22:49.337 INFO:teuthology.orchestra.run.smithi050.stdout: "mdsmap_epoch": 28, 2024-08-31T04:22:49.337 INFO:teuthology.orchestra.run.smithi050.stdout: "osdmap_epoch": 78, 2024-08-31T04:22:49.337 INFO:teuthology.orchestra.run.smithi050.stdout: "osdmap_epoch_barrier": 78, 2024-08-31T04:22:49.337 INFO:teuthology.orchestra.run.smithi050.stdout: "uptime": 148.613999689 2024-08-31T04:22:49.337 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-08-31T04:22:49.338 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:49.331+0000 7fc4b0000640 1 -- 172.21.15.50:0/2487539490 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fc4900b4b30 msgr2=0x7fc4900b7040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:22:49.338 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:49.331+0000 7fc4b0000640 1 --2- 172.21.15.50:0/2487539490 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fc4900b4b30 0x7fc4900b7040 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fc49c000c00 tx=0x7fc49c031400 comp rx=0 tx=0).stop 2024-08-31T04:22:49.338 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:49.331+0000 7fc4b0000640 1 -- 172.21.15.50:0/2487539490 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc4a8103900 msgr2=0x7fc4a819a270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:22:49.338 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:49.331+0000 7fc4b0000640 1 --2- 172.21.15.50:0/2487539490 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc4a8103900 0x7fc4a819a270 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fc49c005ab0 tx=0x7fc49c003c10 comp rx=0 tx=0).stop 2024-08-31T04:22:49.338 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:49.331+0000 7fc4b0000640 1 -- 172.21.15.50:0/2487539490 shutdown_connections 2024-08-31T04:22:49.338 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:49.331+0000 7fc4b0000640 1 --2- 172.21.15.50:0/2487539490 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fc4900b4b30 0x7fc4900b7040 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:49.338 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:49.331+0000 7fc4b0000640 1 --2- 172.21.15.50:0/2487539490 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc4a8109b90 0x7fc4a819fab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:49.339 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:49.331+0000 7fc4b0000640 1 --2- 172.21.15.50:0/2487539490 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc4a8109240 0x7fc4a819a810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:49.339 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:49.331+0000 7fc4b0000640 1 --2- 172.21.15.50:0/2487539490 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc4a8103900 0x7fc4a819a270 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:49.339 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:49.331+0000 7fc4b0000640 1 -- 172.21.15.50:0/2487539490 >> 172.21.15.50:0/2487539490 conn(0x7fc4a807b5f0 msgr2=0x7fc4a81072d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:22:49.339 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:49.332+0000 7fc4b0000640 1 -- 172.21.15.50:0/2487539490 shutdown_connections 2024-08-31T04:22:49.339 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:49.332+0000 7fc4b0000640 1 -- 172.21.15.50:0/2487539490 wait complete. 2024-08-31T04:22:49.828 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:22:49 smithi050 ceph-mon[17259]: pgmap v364: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-08-31T04:22:49.996 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:22:49 smithi177 ceph-mon[22025]: pgmap v364: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-08-31T04:22:50.043 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:22:49 smithi133 ceph-mon[22177]: pgmap v364: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-08-31T04:22:50.221 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 058d9fc6-674f-11ef-bcd4-c7b262605968 -- ceph tell mds.a status 2024-08-31T04:22:50.599 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:22:51.221 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:51.219+0000 7fa453e00640 1 -- 172.21.15.50:0/164636064 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa45410fcb0 msgr2=0x7fa4541120f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:22:51.221 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:51.219+0000 7fa453e00640 1 --2- 172.21.15.50:0/164636064 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa45410fcb0 0x7fa4541120f0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fa44c009ca0 tx=0x7fa44c02a8c0 comp rx=0 tx=0).stop 2024-08-31T04:22:51.221 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:51.220+0000 7fa453e00640 1 -- 172.21.15.50:0/164636064 shutdown_connections 2024-08-31T04:22:51.221 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:51.220+0000 7fa453e00640 1 --2- 172.21.15.50:0/164636064 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa454075ea0 0x7fa45410f770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:51.222 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:51.220+0000 7fa453e00640 1 --2- 172.21.15.50:0/164636064 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa45410fcb0 0x7fa4541120f0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:51.222 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:51.220+0000 7fa453e00640 1 --2- 172.21.15.50:0/164636064 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa454075550 0x7fa454075960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:51.222 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:51.220+0000 7fa453e00640 1 -- 172.21.15.50:0/164636064 >> 172.21.15.50:0/164636064 conn(0x7fa4540ff1e0 msgr2=0x7fa454101630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:22:51.222 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:51.220+0000 7fa453e00640 1 -- 172.21.15.50:0/164636064 shutdown_connections 2024-08-31T04:22:51.222 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:51.220+0000 7fa453e00640 1 -- 172.21.15.50:0/164636064 wait complete. 2024-08-31T04:22:51.223 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:51.221+0000 7fa453e00640 1 Processor -- start 2024-08-31T04:22:51.223 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:51.221+0000 7fa453e00640 1 -- start start 2024-08-31T04:22:51.223 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:51.221+0000 7fa453e00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa454075550 0x7fa45419c210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:51.223 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:51.221+0000 7fa453e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa454075ea0 0x7fa45419c7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:51.223 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:51.221+0000 7fa453e00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa45410fcb0 0x7fa4541a1a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:51.223 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:51.221+0000 7fa453e00640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fa454115860 con 0x7fa454075ea0 2024-08-31T04:22:51.223 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:51.221+0000 7fa453e00640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7fa4541156e0 con 0x7fa45410fcb0 2024-08-31T04:22:51.223 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:51.221+0000 7fa453e00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fa4541159e0 con 0x7fa454075550 2024-08-31T04:22:51.224 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:51.222+0000 7fa44be00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa454075ea0 0x7fa45419c7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:22:51.224 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:51.222+0000 7fa44be00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa454075ea0 0x7fa45419c7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:39808/0 (socket says 172.21.15.50:39808) 2024-08-31T04:22:51.224 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:51.222+0000 7fa44be00640 1 -- 172.21.15.50:0/3447071184 learned_addr learned my addr 172.21.15.50:0/3447071184 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:22:51.224 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:51.222+0000 7fa452a00640 1 --2- 172.21.15.50:0/3447071184 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa454075550 0x7fa45419c210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:22:51.224 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:51.222+0000 7fa453400640 1 --2- 172.21.15.50:0/3447071184 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa45410fcb0 0x7fa4541a1a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:22:51.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:51.222+0000 7fa44be00640 1 -- 172.21.15.50:0/3447071184 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa454075550 msgr2=0x7fa45419c210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:22:51.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:51.222+0000 7fa44be00640 1 --2- 172.21.15.50:0/3447071184 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa454075550 0x7fa45419c210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:51.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:51.222+0000 7fa44be00640 1 -- 172.21.15.50:0/3447071184 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa45410fcb0 msgr2=0x7fa4541a1a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:22:51.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:51.222+0000 7fa44be00640 1 --2- 172.21.15.50:0/3447071184 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa45410fcb0 0x7fa4541a1a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:51.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:51.222+0000 7fa44be00640 1 -- 172.21.15.50:0/3447071184 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4541a2180 con 0x7fa454075ea0 2024-08-31T04:22:51.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:51.222+0000 7fa452a00640 1 --2- 172.21.15.50:0/3447071184 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa454075550 0x7fa45419c210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:22:51.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:51.223+0000 7fa44be00640 1 --2- 172.21.15.50:0/3447071184 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa454075ea0 0x7fa45419c7b0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fa43c00e9c0 tx=0x7fa43c00ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:22:51.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:51.223+0000 7fa44b400640 1 -- 172.21.15.50:0/3447071184 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa43c00cd80 con 0x7fa454075ea0 2024-08-31T04:22:51.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:51.223+0000 7fa453e00640 1 -- 172.21.15.50:0/3447071184 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa4541a2470 con 0x7fa454075ea0 2024-08-31T04:22:51.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:51.223+0000 7fa44b400640 1 -- 172.21.15.50:0/3447071184 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa43c0035f0 con 0x7fa454075ea0 2024-08-31T04:22:51.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:51.223+0000 7fa44b400640 1 -- 172.21.15.50:0/3447071184 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa43c010690 con 0x7fa454075ea0 2024-08-31T04:22:51.225 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:51.223+0000 7fa453e00640 1 -- 172.21.15.50:0/3447071184 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4541a8bd0 con 0x7fa454075ea0 2024-08-31T04:22:51.227 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:51.226+0000 7fa4607d1740 1 Processor -- start 2024-08-31T04:22:51.227 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:51.226+0000 7fa4607d1740 1 -- start start 2024-08-31T04:22:51.228 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:51.226+0000 7fa44b400640 1 -- 172.21.15.50:0/3447071184 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 18) ==== 152577+0+0 (secure 0 0 0) 0x7fa43c004000 con 0x7fa454075ea0 2024-08-31T04:22:51.228 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:51.226+0000 7fa4607d1740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559163a9bf60 0x559163e41aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:51.228 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:51.226+0000 7fa4607d1740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559163a730a0 0x559163e41fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:51.229 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:51.227+0000 7fa4607d1740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559163a7b280 0x559163e42520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:51.229 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:51.227+0000 7fa4607d1740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x559163db8550 con 0x559163a730a0 2024-08-31T04:22:51.229 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:51.227+0000 7fa4607d1740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x559163da7ae0 con 0x559163a7b280 2024-08-31T04:22:51.229 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:51.227+0000 7fa4607d1740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x559163daba90 con 0x559163a9bf60 2024-08-31T04:22:51.229 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:51.227+0000 7fa453400640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559163a9bf60 0x559163e41aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:22:51.229 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:51.227+0000 7fa453400640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559163a9bf60 0x559163e41aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.50:53706/0 (socket says 172.21.15.50:53706) 2024-08-31T04:22:51.229 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:51.227+0000 7fa453400640 1 -- 172.21.15.50:0/378730372 learned_addr learned my addr 172.21.15.50:0/378730372 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:22:51.229 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:51.227+0000 7fa452a00640 1 --2- 172.21.15.50:0/378730372 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559163a730a0 0x559163e41fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:22:51.229 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:51.227+0000 7fa44be00640 1 --2- 172.21.15.50:0/378730372 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559163a7b280 0x559163e42520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:22:51.230 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:51.227+0000 7fa453400640 1 -- 172.21.15.50:0/378730372 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559163a7b280 msgr2=0x559163e42520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:22:51.230 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:51.227+0000 7fa453400640 1 --2- 172.21.15.50:0/378730372 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559163a7b280 0x559163e42520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:51.230 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:51.227+0000 7fa453400640 1 -- 172.21.15.50:0/378730372 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559163a730a0 msgr2=0x559163e41fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:22:51.230 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:51.227+0000 7fa453400640 1 --2- 172.21.15.50:0/378730372 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559163a730a0 0x559163e41fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:51.230 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:51.228+0000 7fa453400640 1 -- 172.21.15.50:0/378730372 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559163b07540 con 0x559163a9bf60 2024-08-31T04:22:51.230 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:51.228+0000 7fa452a00640 1 --2- 172.21.15.50:0/378730372 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559163a730a0 0x559163e41fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:22:51.230 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:51.228+0000 7fa44be00640 1 --2- 172.21.15.50:0/378730372 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559163a7b280 0x559163e42520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T04:22:51.230 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:51.228+0000 7fa453400640 1 --2- 172.21.15.50:0/378730372 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559163a9bf60 0x559163e41aa0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fa44c02f410 tx=0x7fa44c02f440 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4e6e41039724ec8f server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:22:51.231 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:51.228+0000 7fa443e00640 1 -- 172.21.15.50:0/378730372 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa44c031cf0 con 0x559163a9bf60 2024-08-31T04:22:51.231 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:51.228+0000 7fa443e00640 1 -- 172.21.15.50:0/378730372 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa44c036030 con 0x559163a9bf60 2024-08-31T04:22:51.231 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:51.228+0000 7fa443e00640 1 -- 172.21.15.50:0/378730372 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa44c0042a0 con 0x559163a9bf60 2024-08-31T04:22:51.232 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:51.229+0000 7fa44b400640 1 --2- 172.21.15.50:0/3447071184 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fa4380b4b30 0x7fa4380b7040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:51.232 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:51.229+0000 7fa44b400640 1 -- 172.21.15.50:0/3447071184 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8219+0+0 (secure 0 0 0) 0x7fa43c0e56a0 con 0x7fa454075ea0 2024-08-31T04:22:51.232 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:51.229+0000 7fa452a00640 1 --2- 172.21.15.50:0/3447071184 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fa4380b4b30 0x7fa4380b7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:22:51.232 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:51.229+0000 7fa4607d1740 1 -- 172.21.15.50:0/378730372 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559163a9bf60 msgr2=0x559163e41aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:22:51.232 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:51.229+0000 7fa4607d1740 1 --2- 172.21.15.50:0/378730372 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559163a9bf60 0x559163e41aa0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fa44c02f410 tx=0x7fa44c02f440 comp rx=0 tx=0).stop 2024-08-31T04:22:51.232 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:51.230+0000 7fa4607d1740 1 -- 172.21.15.50:0/378730372 shutdown_connections 2024-08-31T04:22:51.232 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:51.230+0000 7fa4607d1740 1 --2- 172.21.15.50:0/378730372 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559163a7b280 0x559163e42520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:51.232 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:51.230+0000 7fa4607d1740 1 --2- 172.21.15.50:0/378730372 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559163a730a0 0x559163e41fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:51.232 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:51.230+0000 7fa4607d1740 1 --2- 172.21.15.50:0/378730372 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559163a9bf60 0x559163e41aa0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:51.232 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:51.230+0000 7fa4607d1740 1 -- 172.21.15.50:0/378730372 >> 172.21.15.50:0/378730372 conn(0x559163a90350 msgr2=0x559163e3f990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:22:51.232 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:51.230+0000 7fa452a00640 1 --2- 172.21.15.50:0/3447071184 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fa4380b4b30 0x7fa4380b7040 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x559163e40720 tx=0x7fa444005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:22:51.232 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:51.230+0000 7fa4607d1740 1 -- 172.21.15.50:0/378730372 shutdown_connections 2024-08-31T04:22:51.232 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:51.230+0000 7fa4607d1740 1 -- 172.21.15.50:0/378730372 wait complete. 2024-08-31T04:22:51.233 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:51.230+0000 7fa4607d1740 1 -- start start 2024-08-31T04:22:51.234 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:51.231+0000 7fa4607d1740 1 Processor -- start 2024-08-31T04:22:51.235 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:51.231+0000 7fa4607d1740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559163a730a0 0x559163e4d280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:51.235 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:51.231+0000 7fa4607d1740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559163a7b280 0x559163e4d7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:51.235 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:51.231+0000 7fa4607d1740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559163a9bf60 0x559163e593c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:51.235 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:51.231+0000 7fa4607d1740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x559163c0a5f0 con 0x559163a730a0 2024-08-31T04:22:51.235 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:51.231+0000 7fa4607d1740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x559163d2ebd0 con 0x559163a7b280 2024-08-31T04:22:51.235 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:51.231+0000 7fa4607d1740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x559163e500a0 con 0x559163a9bf60 2024-08-31T04:22:51.235 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:51.231+0000 7fa4607d1740 10 client.0 _ll_register_callbacks cb 0x559163d54210 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:22:51.235 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:51.231+0000 7fa452a00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559163a730a0 0x559163e4d280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:22:51.235 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:51.231+0000 7fa453400640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559163a9bf60 0x559163e593c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:22:51.235 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:51.231+0000 7fa44be00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559163a7b280 0x559163e4d7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:22:51.235 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:51.231+0000 7fa453400640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559163a9bf60 0x559163e593c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.50:53716/0 (socket says 172.21.15.50:53716) 2024-08-31T04:22:51.235 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:51.231+0000 7fa453400640 1 -- 172.21.15.50:0/534496123 learned_addr learned my addr 172.21.15.50:0/534496123 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:22:51.235 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:51.231+0000 7fa44be00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559163a7b280 0x559163e4d7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.50:59048/0 (socket says 172.21.15.50:59048) 2024-08-31T04:22:51.236 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:51.231+0000 7fa452a00640 1 --2- 172.21.15.50:0/534496123 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559163a730a0 0x559163e4d280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:39826/0 (socket says 172.21.15.50:39826) 2024-08-31T04:22:51.236 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:51.232+0000 7fa44be00640 1 -- 172.21.15.50:0/534496123 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559163a9bf60 msgr2=0x559163e593c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:22:51.236 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:51.232+0000 7fa44be00640 1 --2- 172.21.15.50:0/534496123 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559163a9bf60 0x559163e593c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:51.236 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:51.232+0000 7fa44be00640 1 -- 172.21.15.50:0/534496123 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559163a730a0 msgr2=0x559163e4d280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:22:51.236 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:51.232+0000 7fa44be00640 1 --2- 172.21.15.50:0/534496123 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559163a730a0 0x559163e4d280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:51.236 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:51.232+0000 7fa44be00640 1 -- 172.21.15.50:0/534496123 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559163d6f650 con 0x559163a7b280 2024-08-31T04:22:51.236 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:51.232+0000 7fa452a00640 1 --2- 172.21.15.50:0/534496123 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559163a730a0 0x559163e4d280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:22:51.236 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:51.232+0000 7fa44be00640 1 --2- 172.21.15.50:0/534496123 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559163a7b280 0x559163e4d7c0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fa43c00c6a0 tx=0x7fa43c0ab8e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2ea1980e2b85d12d server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:22:51.236 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:51.232+0000 7fa440c00640 10 client.0 ms_handle_connect on v2:172.21.15.133:3300/0 2024-08-31T04:22:51.236 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:51.232+0000 7fa440c00640 1 -- 172.21.15.50:0/534496123 <== mon.2 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa43c0b08f0 con 0x559163a7b280 2024-08-31T04:22:51.236 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:51.232+0000 7fa4607d1740 1 -- 172.21.15.50:0/534496123 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa44c036030 con 0x559163a7b280 2024-08-31T04:22:51.236 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:51.233+0000 7fa440c00640 1 -- 172.21.15.50:0/534496123 <== mon.2 v2:172.21.15.133:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8219+0+0 (secure 0 0 0) 0x7fa43c0037a0 con 0x559163a7b280 2024-08-31T04:22:51.236 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:51.233+0000 7fa440c00640 1 -- 172.21.15.50:0/534496123 <== mon.2 v2:172.21.15.133:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fa43c0b53a0 con 0x559163a7b280 2024-08-31T04:22:51.237 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:51.233+0000 7fa4607d1740 10 client.25244 fetch_fsmap learned FSMap version 28 2024-08-31T04:22:51.237 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:51.233+0000 7fa4607d1740 1 -- 172.21.15.50:0/534496123 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x559163e5bed0 con 0x559163a7b280 2024-08-31T04:22:51.237 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:51.233+0000 7fa440c00640 1 -- 172.21.15.50:0/534496123 <== mon.2 v2:172.21.15.133:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa44c036030 con 0x559163a7b280 2024-08-31T04:22:51.237 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:51.233+0000 7fa440c00640 1 -- 172.21.15.50:0/534496123 <== mon.2 v2:172.21.15.133:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fa43c0a79f0 con 0x559163a7b280 2024-08-31T04:22:51.237 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:51.233+0000 7fa4607d1740 10 client.25244 fetch_fsmap finished waiting for FSMap version 28 2024-08-31T04:22:51.237 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:51.233+0000 7fa4607d1740 10 client.25244 resolve_mds: resolved name 'a' to daemon mds.a 2024-08-31T04:22:51.237 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:51.233+0000 7fa4607d1740 20 client.25244 populate_metadata read hostname 'smithi050' 2024-08-31T04:22:51.237 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:51.233+0000 7fa4607d1740 1 --2- 172.21.15.50:0/534496123 >> [v2:172.21.15.50:6840/575209862,v1:172.21.15.50:6841/575209862] conn(0x559163a5a8e0 0x559163e5f890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:51.237 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:51.234+0000 7fa4607d1740 4 client.25244 mds_command: new command op to 24691 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T04:22:51.237 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:51.234+0000 7fa4607d1740 1 -- 172.21.15.50:0/534496123 --> [v2:172.21.15.50:6840/575209862,v1:172.21.15.50:6841/575209862] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559163dba4a0 con 0x559163a5a8e0 2024-08-31T04:22:51.238 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:51.234+0000 7fa452a00640 1 --2- 172.21.15.50:0/534496123 >> [v2:172.21.15.50:6840/575209862,v1:172.21.15.50:6841/575209862] conn(0x559163a5a8e0 0x559163e5f890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:22:51.238 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:51.234+0000 7fa452a00640 1 --2- 172.21.15.50:0/534496123 >> [v2:172.21.15.50:6840/575209862,v1:172.21.15.50:6841/575209862] conn(0x559163a5a8e0 0x559163e5f890 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=f9e6db0b5ed6064c server_cookie=eeb367a94deb7a7b in_seq=0 out_seq=0 2024-08-31T04:22:51.239 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:51.234+0000 7fa440c00640 10 client.25244 ms_handle_connect on v2:172.21.15.50:6840/575209862 2024-08-31T04:22:51.239 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:51.235+0000 7fa440c00640 1 -- 172.21.15.50:0/534496123 <== mds.1 v2:172.21.15.50:6840/575209862 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x559163dba4a0 con 0x559163a5a8e0 2024-08-31T04:22:51.239 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:51.235+0000 7fa440c00640 10 client.25244 handle_command_reply: tid=0 2024-08-31T04:22:51.239 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:51.235+0000 7fa4607d1740 1 client.25244 shutdown 2024-08-31T04:22:51.239 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:51.235+0000 7fa4607d1740 1 -- 172.21.15.50:0/534496123 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559163a7b280 msgr2=0x559163e4d7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:22:51.239 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:51.235+0000 7fa4607d1740 1 --2- 172.21.15.50:0/534496123 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559163a7b280 0x559163e4d7c0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fa43c00c6a0 tx=0x7fa43c0ab8e0 comp rx=0 tx=0).stop 2024-08-31T04:22:51.239 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:51.236+0000 7fa4607d1740 1 -- 172.21.15.50:0/534496123 shutdown_connections 2024-08-31T04:22:51.239 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:51.236+0000 7fa4607d1740 1 --2- 172.21.15.50:0/534496123 >> [v2:172.21.15.50:6840/575209862,v1:172.21.15.50:6841/575209862] conn(0x559163a5a8e0 0x559163e5f890 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:51.239 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:51.236+0000 7fa4607d1740 1 --2- 172.21.15.50:0/534496123 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559163a9bf60 0x559163e593c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:51.239 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:51.236+0000 7fa4607d1740 1 --2- 172.21.15.50:0/534496123 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559163a7b280 0x559163e4d7c0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:51.239 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:51.236+0000 7fa4607d1740 1 --2- 172.21.15.50:0/534496123 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559163a730a0 0x559163e4d280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:51.239 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:51.236+0000 7fa440c00640 0 client.25244 ms_handle_reset on v2:172.21.15.50:6840/575209862 2024-08-31T04:22:51.239 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:51.236+0000 7fa4607d1740 1 -- 172.21.15.50:0/534496123 >> 172.21.15.50:0/534496123 conn(0x559163a90350 msgr2=0x559163e44c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:22:51.239 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:51.236+0000 7fa4607d1740 1 -- 172.21.15.50:0/534496123 shutdown_connections 2024-08-31T04:22:51.240 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:51.236+0000 7fa4607d1740 1 -- 172.21.15.50:0/534496123 wait complete. 2024-08-31T04:22:51.240 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:51.236+0000 7fa4607d1740 20 client.25244 trim_cache size 0 max 16384 2024-08-31T04:22:51.256 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:51.255+0000 7fa4607d1740 1 Processor -- start 2024-08-31T04:22:51.256 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:51.255+0000 7fa4607d1740 1 -- start start 2024-08-31T04:22:51.257 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:51.256+0000 7fa4607d1740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559163a730a0 0x559163e3a780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:51.257 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:51.256+0000 7fa4607d1740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559163a7b280 0x559163e59330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:51.257 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:51.256+0000 7fa4607d1740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559163a9bf60 0x559163e44ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:51.257 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:51.256+0000 7fa4607d1740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x559163e5dbd0 con 0x559163a730a0 2024-08-31T04:22:51.258 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:51.256+0000 7fa4607d1740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x559163e5e2a0 con 0x559163a7b280 2024-08-31T04:22:51.258 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:51.256+0000 7fa4607d1740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x559163e5e970 con 0x559163a9bf60 2024-08-31T04:22:51.258 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:51.256+0000 7fa452a00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559163a730a0 0x559163e3a780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:22:51.258 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:51.256+0000 7fa452a00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559163a730a0 0x559163e3a780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:39842/0 (socket says 172.21.15.50:39842) 2024-08-31T04:22:51.258 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:51.256+0000 7fa452a00640 1 -- 172.21.15.50:0/3549654323 learned_addr learned my addr 172.21.15.50:0/3549654323 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:22:51.258 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:51.256+0000 7fa453400640 1 --2- 172.21.15.50:0/3549654323 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559163a9bf60 0x559163e44ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:22:51.258 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:51.256+0000 7fa44be00640 1 --2- 172.21.15.50:0/3549654323 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559163a7b280 0x559163e59330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:22:51.258 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:51.256+0000 7fa452a00640 1 -- 172.21.15.50:0/3549654323 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559163a9bf60 msgr2=0x559163e44ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:22:51.258 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:51.256+0000 7fa452a00640 1 --2- 172.21.15.50:0/3549654323 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559163a9bf60 0x559163e44ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:51.258 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:51.256+0000 7fa452a00640 1 -- 172.21.15.50:0/3549654323 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559163a7b280 msgr2=0x559163e59330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:22:51.258 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:51.256+0000 7fa452a00640 1 --2- 172.21.15.50:0/3549654323 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559163a7b280 0x559163e59330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:51.258 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:51.256+0000 7fa452a00640 1 -- 172.21.15.50:0/3549654323 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559163e4e540 con 0x559163a730a0 2024-08-31T04:22:51.259 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:51.257+0000 7fa452a00640 1 --2- 172.21.15.50:0/3549654323 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559163a730a0 0x559163e3a780 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fa444009f80 tx=0x7fa44401b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88058125a2afdc68 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:22:51.260 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:51.257+0000 7fa443400640 1 -- 172.21.15.50:0/3549654323 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa44401d860 con 0x559163a730a0 2024-08-31T04:22:51.260 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:51.257+0000 7fa443400640 1 -- 172.21.15.50:0/3549654323 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa444005020 con 0x559163a730a0 2024-08-31T04:22:51.260 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:51.257+0000 7fa443400640 1 -- 172.21.15.50:0/3549654323 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa444004b20 con 0x559163a730a0 2024-08-31T04:22:51.260 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:51.258+0000 7fa4607d1740 1 -- 172.21.15.50:0/3549654323 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559163a730a0 msgr2=0x559163e3a780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:22:51.260 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:51.258+0000 7fa4607d1740 1 --2- 172.21.15.50:0/3549654323 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559163a730a0 0x559163e3a780 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fa444009f80 tx=0x7fa44401b000 comp rx=0 tx=0).stop 2024-08-31T04:22:51.260 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:51.258+0000 7fa4607d1740 1 -- 172.21.15.50:0/3549654323 shutdown_connections 2024-08-31T04:22:51.260 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:51.258+0000 7fa4607d1740 1 --2- 172.21.15.50:0/3549654323 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559163a9bf60 0x559163e44ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:51.260 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:51.258+0000 7fa4607d1740 1 --2- 172.21.15.50:0/3549654323 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559163a7b280 0x559163e59330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:51.260 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:51.258+0000 7fa4607d1740 1 --2- 172.21.15.50:0/3549654323 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559163a730a0 0x559163e3a780 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:51.260 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:51.258+0000 7fa4607d1740 1 -- 172.21.15.50:0/3549654323 >> 172.21.15.50:0/3549654323 conn(0x559163a90350 msgr2=0x559163e4bb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:22:51.260 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:51.258+0000 7fa4607d1740 1 -- 172.21.15.50:0/3549654323 shutdown_connections 2024-08-31T04:22:51.260 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:51.258+0000 7fa4607d1740 1 -- 172.21.15.50:0/3549654323 wait complete. 2024-08-31T04:22:51.260 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:51.258+0000 7fa4607d1740 1 -- start start 2024-08-31T04:22:51.261 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:51.259+0000 7fa4607d1740 1 Processor -- start 2024-08-31T04:22:51.263 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:51.259+0000 7fa4607d1740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559163a730a0 0x559163e680c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:51.263 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:51.259+0000 7fa4607d1740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559163a7b280 0x559163e63570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:51.263 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:51.259+0000 7fa4607d1740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559163a9bf60 0x559163e63ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:51.263 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:51.259+0000 7fa4607d1740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x559163e5f710 con 0x559163a730a0 2024-08-31T04:22:51.263 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:51.259+0000 7fa4607d1740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x559163e5f040 con 0x559163a9bf60 2024-08-31T04:22:51.263 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:51.259+0000 7fa4607d1740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x559163e5fde0 con 0x559163a7b280 2024-08-31T04:22:51.263 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:51.259+0000 7fa4607d1740 10 client.0 _ll_register_callbacks cb 0x7fa43c0abaa0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:22:51.263 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:51.259+0000 7fa452a00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559163a730a0 0x559163e680c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:22:51.263 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:51.259+0000 7fa452a00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559163a730a0 0x559163e680c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:39846/0 (socket says 172.21.15.50:39846) 2024-08-31T04:22:51.263 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:51.259+0000 7fa452a00640 1 -- 172.21.15.50:0/2409842347 learned_addr learned my addr 172.21.15.50:0/2409842347 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:22:51.264 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:51.259+0000 7fa453400640 1 --2- 172.21.15.50:0/2409842347 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559163a9bf60 0x559163e63ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:22:51.264 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:51.259+0000 7fa44be00640 1 --2- 172.21.15.50:0/2409842347 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559163a7b280 0x559163e63570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:22:51.264 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:51.260+0000 7fa452a00640 1 -- 172.21.15.50:0/2409842347 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559163a7b280 msgr2=0x559163e63570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:22:51.264 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:51.260+0000 7fa452a00640 1 --2- 172.21.15.50:0/2409842347 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559163a7b280 0x559163e63570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:51.264 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:51.260+0000 7fa452a00640 1 -- 172.21.15.50:0/2409842347 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559163a9bf60 msgr2=0x559163e63ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:22:51.264 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:51.260+0000 7fa452a00640 1 --2- 172.21.15.50:0/2409842347 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559163a9bf60 0x559163e63ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:51.264 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:51.260+0000 7fa452a00640 1 -- 172.21.15.50:0/2409842347 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559163e63ff0 con 0x559163a730a0 2024-08-31T04:22:51.264 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:51.260+0000 7fa44be00640 1 --2- 172.21.15.50:0/2409842347 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559163a7b280 0x559163e63570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:22:51.264 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:51.260+0000 7fa453400640 1 --2- 172.21.15.50:0/2409842347 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559163a9bf60 0x559163e63ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:22:51.264 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:51.260+0000 7fa452a00640 1 --2- 172.21.15.50:0/2409842347 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559163a730a0 0x559163e680c0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fa444009c20 tx=0x7fa444005250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5084f0254d8893b server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:22:51.264 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:51.260+0000 7fa440c00640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-08-31T04:22:51.264 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:51.261+0000 7fa440c00640 1 -- 172.21.15.50:0/2409842347 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa44401d860 con 0x559163a730a0 2024-08-31T04:22:51.264 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:51.261+0000 7fa440c00640 1 -- 172.21.15.50:0/2409842347 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8219+0+0 (secure 0 0 0) 0x7fa44401da00 con 0x559163a730a0 2024-08-31T04:22:51.265 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:51.261+0000 7fa4607d1740 1 -- 172.21.15.50:0/2409842347 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa444005020 con 0x559163a730a0 2024-08-31T04:22:51.265 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:51.261+0000 7fa440c00640 1 -- 172.21.15.50:0/2409842347 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fa44401dc00 con 0x559163a730a0 2024-08-31T04:22:51.265 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:51.261+0000 7fa4607d1740 10 client.15255 fetch_fsmap learned FSMap version 28 2024-08-31T04:22:51.265 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:51.261+0000 7fa4607d1740 1 -- 172.21.15.50:0/2409842347 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x559163ecaa20 con 0x559163a730a0 2024-08-31T04:22:51.265 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:51.261+0000 7fa440c00640 1 -- 172.21.15.50:0/2409842347 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa444005020 con 0x559163a730a0 2024-08-31T04:22:51.265 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:51.261+0000 7fa440c00640 1 -- 172.21.15.50:0/2409842347 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fa444038070 con 0x559163a730a0 2024-08-31T04:22:51.265 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:51.261+0000 7fa4607d1740 10 client.15255 fetch_fsmap finished waiting for FSMap version 28 2024-08-31T04:22:51.265 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:51.262+0000 7fa4607d1740 10 client.15255 resolve_mds: resolved name 'a' to daemon mds.a 2024-08-31T04:22:51.265 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:51.262+0000 7fa4607d1740 20 client.15255 populate_metadata read hostname 'smithi050' 2024-08-31T04:22:51.265 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:51.262+0000 7fa4607d1740 1 --2- 172.21.15.50:0/2409842347 >> [v2:172.21.15.50:6840/575209862,v1:172.21.15.50:6841/575209862] conn(0x559163a2fc90 0x559163ece0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:51.265 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:51.262+0000 7fa4607d1740 4 client.15255 mds_command: new command op to 24691 tid=0 multi_id=0 [{"prefix": "status"}] 2024-08-31T04:22:51.265 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:51.262+0000 7fa4607d1740 1 -- 172.21.15.50:0/2409842347 --> [v2:172.21.15.50:6840/575209862,v1:172.21.15.50:6841/575209862] -- command(tid 0: {"prefix": "status"}) -- 0x559163e3ade0 con 0x559163a2fc90 2024-08-31T04:22:51.265 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:51.262+0000 7fa44be00640 1 --2- 172.21.15.50:0/2409842347 >> [v2:172.21.15.50:6840/575209862,v1:172.21.15.50:6841/575209862] conn(0x559163a2fc90 0x559163ece0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:22:51.266 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:51.262+0000 7fa44be00640 1 --2- 172.21.15.50:0/2409842347 >> [v2:172.21.15.50:6840/575209862,v1:172.21.15.50:6841/575209862] conn(0x559163a2fc90 0x559163ece0b0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=9f1fb710b9db0cae server_cookie=52328bed2038146b in_seq=0 out_seq=0 2024-08-31T04:22:51.266 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:51.262+0000 7fa440c00640 10 client.15255 ms_handle_connect on v2:172.21.15.50:6840/575209862 2024-08-31T04:22:51.267 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:51.263+0000 7fa440c00640 1 -- 172.21.15.50:0/2409842347 <== mds.1 v2:172.21.15.50:6840/575209862 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x559163e3ade0 con 0x559163a2fc90 2024-08-31T04:22:51.267 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:51.263+0000 7fa440c00640 10 client.15255 handle_command_reply: tid=0 2024-08-31T04:22:51.267 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:51.263+0000 7fa4607d1740 1 client.15255 shutdown 2024-08-31T04:22:51.267 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:51.263+0000 7fa4607d1740 1 -- 172.21.15.50:0/2409842347 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559163a730a0 msgr2=0x559163e680c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:22:51.267 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:51.263+0000 7fa4607d1740 1 --2- 172.21.15.50:0/2409842347 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559163a730a0 0x559163e680c0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fa444009c20 tx=0x7fa444005250 comp rx=0 tx=0).stop 2024-08-31T04:22:51.267 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:51.263+0000 7fa4607d1740 1 -- 172.21.15.50:0/2409842347 shutdown_connections 2024-08-31T04:22:51.267 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:51.263+0000 7fa4607d1740 1 --2- 172.21.15.50:0/2409842347 >> [v2:172.21.15.50:6840/575209862,v1:172.21.15.50:6841/575209862] conn(0x559163a2fc90 0x559163ece0b0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:51.267 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:51.263+0000 7fa4607d1740 1 --2- 172.21.15.50:0/2409842347 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559163a7b280 0x559163e63570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:51.267 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:51.263+0000 7fa4607d1740 1 --2- 172.21.15.50:0/2409842347 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559163a9bf60 0x559163e63ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:51.267 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:51.263+0000 7fa440c00640 0 client.15255 ms_handle_reset on v2:172.21.15.50:6840/575209862 2024-08-31T04:22:51.267 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:51.263+0000 7fa4607d1740 1 --2- 172.21.15.50:0/2409842347 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559163a730a0 0x559163e680c0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:51.267 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:51.263+0000 7fa4607d1740 1 -- 172.21.15.50:0/2409842347 >> 172.21.15.50:0/2409842347 conn(0x559163a90350 msgr2=0x559163e44ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:22:51.267 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:51.263+0000 7fa4607d1740 1 -- 172.21.15.50:0/2409842347 shutdown_connections 2024-08-31T04:22:51.268 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:51.263+0000 7fa4607d1740 1 -- 172.21.15.50:0/2409842347 wait complete. 2024-08-31T04:22:51.268 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:51.263+0000 7fa4607d1740 20 client.15255 trim_cache size 0 max 16384 2024-08-31T04:22:51.268 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-08-31T04:22:51.268 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_fsid": "058d9fc6-674f-11ef-bcd4-c7b262605968", 2024-08-31T04:22:51.268 INFO:teuthology.orchestra.run.smithi050.stdout: "whoami": 1, 2024-08-31T04:22:51.268 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 24691, 2024-08-31T04:22:51.268 INFO:teuthology.orchestra.run.smithi050.stdout: "want_state": "up:active", 2024-08-31T04:22:51.268 INFO:teuthology.orchestra.run.smithi050.stdout: "state": "up:active", 2024-08-31T04:22:51.268 INFO:teuthology.orchestra.run.smithi050.stdout: "fs_name": "cephfs", 2024-08-31T04:22:51.268 INFO:teuthology.orchestra.run.smithi050.stdout: "rank_uptime": 117.280906954, 2024-08-31T04:22:51.268 INFO:teuthology.orchestra.run.smithi050.stdout: "mdsmap_epoch": 28, 2024-08-31T04:22:51.269 INFO:teuthology.orchestra.run.smithi050.stdout: "osdmap_epoch": 78, 2024-08-31T04:22:51.269 INFO:teuthology.orchestra.run.smithi050.stdout: "osdmap_epoch_barrier": 78, 2024-08-31T04:22:51.269 INFO:teuthology.orchestra.run.smithi050.stdout: "uptime": 142.64980848799999 2024-08-31T04:22:51.269 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-08-31T04:22:51.269 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:51.264+0000 7fa453e00640 1 -- 172.21.15.50:0/3447071184 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fa4380b4b30 msgr2=0x7fa4380b7040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:22:51.270 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:51.264+0000 7fa453e00640 1 --2- 172.21.15.50:0/3447071184 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fa4380b4b30 0x7fa4380b7040 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x559163e40720 tx=0x7fa444005f90 comp rx=0 tx=0).stop 2024-08-31T04:22:51.270 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:51.264+0000 7fa453e00640 1 -- 172.21.15.50:0/3447071184 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa454075ea0 msgr2=0x7fa45419c7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:22:51.270 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:51.264+0000 7fa453e00640 1 --2- 172.21.15.50:0/3447071184 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa454075ea0 0x7fa45419c7b0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fa43c00e9c0 tx=0x7fa43c00ee80 comp rx=0 tx=0).stop 2024-08-31T04:22:51.270 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:51.264+0000 7fa453e00640 1 -- 172.21.15.50:0/3447071184 shutdown_connections 2024-08-31T04:22:51.270 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:51.264+0000 7fa453e00640 1 --2- 172.21.15.50:0/3447071184 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fa4380b4b30 0x7fa4380b7040 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:51.270 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:51.264+0000 7fa453e00640 1 --2- 172.21.15.50:0/3447071184 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa45410fcb0 0x7fa4541a1a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:51.270 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:51.264+0000 7fa453e00640 1 --2- 172.21.15.50:0/3447071184 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa454075ea0 0x7fa45419c7b0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:51.270 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:51.264+0000 7fa453e00640 1 --2- 172.21.15.50:0/3447071184 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa454075550 0x7fa45419c210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:51.270 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:51.264+0000 7fa453e00640 1 -- 172.21.15.50:0/3447071184 >> 172.21.15.50:0/3447071184 conn(0x7fa4540ff1e0 msgr2=0x7fa454100d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:22:51.270 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:51.264+0000 7fa453e00640 1 -- 172.21.15.50:0/3447071184 shutdown_connections 2024-08-31T04:22:51.270 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:51.264+0000 7fa453e00640 1 -- 172.21.15.50:0/3447071184 wait complete. 2024-08-31T04:22:51.902 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:22:51 smithi050 ceph-mon[17259]: pgmap v365: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-08-31T04:22:51.996 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:22:51 smithi177 ceph-mon[22025]: pgmap v365: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-08-31T04:22:52.035 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 058d9fc6-674f-11ef-bcd4-c7b262605968 -- ceph tell mds.b status 2024-08-31T04:22:52.042 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:22:51 smithi133 ceph-mon[22177]: pgmap v365: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-08-31T04:22:52.417 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:22:53.106 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:53.105+0000 7f0c54800640 1 -- 172.21.15.50:0/2752870240 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0c4c103900 msgr2=0x7f0c4c103d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:22:53.107 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:53.105+0000 7f0c54800640 1 --2- 172.21.15.50:0/2752870240 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0c4c103900 0x7f0c4c103d10 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f0c40009900 tx=0x7f0c4002a3f0 comp rx=0 tx=0).stop 2024-08-31T04:22:53.107 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:53.105+0000 7f0c54800640 1 -- 172.21.15.50:0/2752870240 shutdown_connections 2024-08-31T04:22:53.107 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:53.105+0000 7f0c54800640 1 --2- 172.21.15.50:0/2752870240 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0c4c109240 0x7f0c4c109650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:53.107 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:53.105+0000 7f0c54800640 1 --2- 172.21.15.50:0/2752870240 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0c4c109b90 0x7f0c4c1103c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:53.107 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:53.105+0000 7f0c54800640 1 --2- 172.21.15.50:0/2752870240 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0c4c103900 0x7f0c4c103d10 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:53.107 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:53.105+0000 7f0c54800640 1 -- 172.21.15.50:0/2752870240 >> 172.21.15.50:0/2752870240 conn(0x7f0c4c07b5f0 msgr2=0x7f0c4c07ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:22:53.107 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:53.105+0000 7f0c54800640 1 -- 172.21.15.50:0/2752870240 shutdown_connections 2024-08-31T04:22:53.107 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:53.105+0000 7f0c54800640 1 -- 172.21.15.50:0/2752870240 wait complete. 2024-08-31T04:22:53.109 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:53.106+0000 7f0c54800640 1 Processor -- start 2024-08-31T04:22:53.109 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:53.106+0000 7f0c54800640 1 -- start start 2024-08-31T04:22:53.109 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:53.107+0000 7f0c54800640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0c4c103900 0x7f0c4c19a2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:53.109 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:53.107+0000 7f0c54800640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0c4c109240 0x7f0c4c19a860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:53.109 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:53.107+0000 7f0c54800640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0c4c109b90 0x7f0c4c19fb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:53.109 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:53.107+0000 7f0c54800640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f0c4c113850 con 0x7f0c4c109b90 2024-08-31T04:22:53.109 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:53.107+0000 7f0c54800640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f0c4c1136d0 con 0x7f0c4c103900 2024-08-31T04:22:53.109 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:53.107+0000 7f0c54800640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f0c4c1139d0 con 0x7f0c4c109240 2024-08-31T04:22:53.109 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:53.107+0000 7f0c51e00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0c4c103900 0x7f0c4c19a2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:22:53.109 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:53.107+0000 7f0c51e00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0c4c103900 0x7f0c4c19a2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.50:36276/0 (socket says 172.21.15.50:36276) 2024-08-31T04:22:53.109 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:53.107+0000 7f0c51e00640 1 -- 172.21.15.50:0/2839485804 learned_addr learned my addr 172.21.15.50:0/2839485804 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:22:53.110 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:53.107+0000 7f0c51400640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0c4c109240 0x7f0c4c19a860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:22:53.110 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:53.107+0000 7f0c52800640 1 --2- 172.21.15.50:0/2839485804 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0c4c109b90 0x7f0c4c19fb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:22:53.110 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:53.107+0000 7f0c51e00640 1 -- 172.21.15.50:0/2839485804 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0c4c109240 msgr2=0x7f0c4c19a860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:22:53.110 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:53.107+0000 7f0c51e00640 1 --2- 172.21.15.50:0/2839485804 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0c4c109240 0x7f0c4c19a860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:53.110 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:53.107+0000 7f0c51e00640 1 -- 172.21.15.50:0/2839485804 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0c4c109b90 msgr2=0x7f0c4c19fb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:22:53.110 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:53.107+0000 7f0c51e00640 1 --2- 172.21.15.50:0/2839485804 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0c4c109b90 0x7f0c4c19fb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:53.110 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:53.108+0000 7f0c51e00640 1 -- 172.21.15.50:0/2839485804 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c4c1a0230 con 0x7f0c4c103900 2024-08-31T04:22:53.110 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:53.108+0000 7f0c51400640 1 --2- 172.21.15.50:0/2839485804 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0c4c109240 0x7f0c4c19a860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:22:53.111 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:53.108+0000 7f0c51e00640 1 --2- 172.21.15.50:0/2839485804 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0c4c103900 0x7f0c4c19a2c0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f0c40005940 tx=0x7f0c40004270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:22:53.111 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:53.108+0000 7f0c46a00640 1 -- 172.21.15.50:0/2839485804 <== mon.2 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c4003f030 con 0x7f0c4c103900 2024-08-31T04:22:53.111 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:53.108+0000 7f0c54800640 1 -- 172.21.15.50:0/2839485804 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0c4c1a04c0 con 0x7f0c4c103900 2024-08-31T04:22:53.111 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:53.108+0000 7f0c46a00640 1 -- 172.21.15.50:0/2839485804 <== mon.2 v2:172.21.15.133:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0c40003aa0 con 0x7f0c4c103900 2024-08-31T04:22:53.111 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:53.108+0000 7f0c46a00640 1 -- 172.21.15.50:0/2839485804 <== mon.2 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c40035070 con 0x7f0c4c103900 2024-08-31T04:22:53.111 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:53.108+0000 7f0c54800640 1 -- 172.21.15.50:0/2839485804 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0c4c1a6c80 con 0x7f0c4c103900 2024-08-31T04:22:53.112 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:53.111+0000 7f0c5b41a740 1 Processor -- start 2024-08-31T04:22:53.113 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:53.111+0000 7f0c5b41a740 1 -- start start 2024-08-31T04:22:53.113 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:53.112+0000 7f0c5b41a740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d313eb5f60 0x55d31425b8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:53.113 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:53.112+0000 7f0c5b41a740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55d313e8d0a0 0x55d31425be30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:53.113 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:53.112+0000 7f0c5b41a740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d313e95280 0x55d31425c370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:53.114 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:53.112+0000 7f0c5b41a740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55d3141d2550 con 0x55d313e95280 2024-08-31T04:22:53.114 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:53.112+0000 7f0c5b41a740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x55d3141c1ae0 con 0x55d313e8d0a0 2024-08-31T04:22:53.114 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:53.112+0000 7f0c5b41a740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x55d3141c5a90 con 0x55d313eb5f60 2024-08-31T04:22:53.114 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:53.112+0000 7f0c51400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d313e95280 0x55d31425c370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:22:53.114 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:53.112+0000 7f0c51400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d313e95280 0x55d31425c370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:44876/0 (socket says 172.21.15.50:44876) 2024-08-31T04:22:53.114 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:53.112+0000 7f0c51400640 1 -- 172.21.15.50:0/2701459090 learned_addr learned my addr 172.21.15.50:0/2701459090 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:22:53.114 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:53.112+0000 7f0c52800640 1 --2- 172.21.15.50:0/2701459090 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d313eb5f60 0x55d31425b8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:22:53.114 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:53.112+0000 7f0c46a00640 1 -- 172.21.15.50:0/2839485804 <== mon.2 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 18) ==== 152577+0+0 (secure 0 0 0) 0x7f0c40042030 con 0x7f0c4c103900 2024-08-31T04:22:53.115 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:53.113+0000 7f0c51e00640 1 --2- 172.21.15.50:0/2701459090 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55d313e8d0a0 0x55d31425be30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:22:53.115 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:53.113+0000 7f0c51400640 1 -- 172.21.15.50:0/2701459090 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d313eb5f60 msgr2=0x55d31425b8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:22:53.115 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:53.113+0000 7f0c51400640 1 --2- 172.21.15.50:0/2701459090 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d313eb5f60 0x55d31425b8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:53.115 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:53.113+0000 7f0c51400640 1 -- 172.21.15.50:0/2701459090 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55d313e8d0a0 msgr2=0x55d31425be30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:22:53.115 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:53.113+0000 7f0c51400640 1 --2- 172.21.15.50:0/2701459090 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55d313e8d0a0 0x55d31425be30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:53.115 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:53.113+0000 7f0c51400640 1 -- 172.21.15.50:0/2701459090 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d313f21540 con 0x55d313e95280 2024-08-31T04:22:53.115 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:53.113+0000 7f0c52800640 1 --2- 172.21.15.50:0/2701459090 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d313eb5f60 0x55d31425b8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:22:53.115 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:53.113+0000 7f0c51e00640 1 --2- 172.21.15.50:0/2701459090 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55d313e8d0a0 0x55d31425be30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T04:22:53.115 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:53.113+0000 7f0c51400640 1 --2- 172.21.15.50:0/2701459090 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d313e95280 0x55d31425c370 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f0c3c011470 tx=0x7f0c3c011930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=253fc3db65a857cf server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:22:53.115 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:53.113+0000 7f0c3b000640 1 -- 172.21.15.50:0/2701459090 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c3c01e070 con 0x55d313e95280 2024-08-31T04:22:53.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:53.113+0000 7f0c3b000640 1 -- 172.21.15.50:0/2701459090 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0c3c004310 con 0x55d313e95280 2024-08-31T04:22:53.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:53.113+0000 7f0c3b000640 1 -- 172.21.15.50:0/2701459090 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c3c00f900 con 0x55d313e95280 2024-08-31T04:22:53.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:53.114+0000 7f0c46a00640 1 --2- 172.21.15.50:0/2839485804 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f0c340b4b30 0x7f0c340b7040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:53.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:53.114+0000 7f0c5b41a740 1 -- 172.21.15.50:0/2701459090 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d313e95280 msgr2=0x55d31425c370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:22:53.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:53.114+0000 7f0c5b41a740 1 --2- 172.21.15.50:0/2701459090 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d313e95280 0x55d31425c370 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f0c3c011470 tx=0x7f0c3c011930 comp rx=0 tx=0).stop 2024-08-31T04:22:53.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:53.114+0000 7f0c5b41a740 1 -- 172.21.15.50:0/2701459090 shutdown_connections 2024-08-31T04:22:53.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:53.114+0000 7f0c5b41a740 1 --2- 172.21.15.50:0/2701459090 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d313e95280 0x55d31425c370 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:53.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:53.114+0000 7f0c5b41a740 1 --2- 172.21.15.50:0/2701459090 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55d313e8d0a0 0x55d31425be30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:53.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:53.114+0000 7f0c5b41a740 1 --2- 172.21.15.50:0/2701459090 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d313eb5f60 0x55d31425b8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:53.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:53.114+0000 7f0c5b41a740 1 -- 172.21.15.50:0/2701459090 >> 172.21.15.50:0/2701459090 conn(0x55d313eaa350 msgr2=0x55d3142597e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:22:53.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:53.114+0000 7f0c46a00640 1 -- 172.21.15.50:0/2839485804 <== mon.2 v2:172.21.15.133:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8219+0+0 (secure 0 0 0) 0x7f0c401054e0 con 0x7f0c4c103900 2024-08-31T04:22:53.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:53.115+0000 7f0c52800640 1 --2- 172.21.15.50:0/2839485804 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f0c340b4b30 0x7f0c340b7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:22:53.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:53.115+0000 7f0c5b41a740 1 -- 172.21.15.50:0/2701459090 shutdown_connections 2024-08-31T04:22:53.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:53.115+0000 7f0c5b41a740 1 -- 172.21.15.50:0/2701459090 wait complete. 2024-08-31T04:22:53.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:53.115+0000 7f0c52800640 1 --2- 172.21.15.50:0/2839485804 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f0c340b4b30 0x7f0c340b7040 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f0c48005fd0 tx=0x7f0c480096a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:22:53.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:53.115+0000 7f0c5b41a740 1 -- start start 2024-08-31T04:22:53.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:53.116+0000 7f0c5b41a740 1 Processor -- start 2024-08-31T04:22:53.120 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:53.116+0000 7f0c5b41a740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55d313e8d0a0 0x55d314267090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:53.120 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:53.116+0000 7f0c5b41a740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d313e95280 0x55d3142675d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:53.120 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:53.116+0000 7f0c5b41a740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d313eb5f60 0x55d3142777d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:53.120 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:53.116+0000 7f0c5b41a740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55d3140245f0 con 0x55d313e95280 2024-08-31T04:22:53.120 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:53.116+0000 7f0c5b41a740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x55d314148bd0 con 0x55d313e8d0a0 2024-08-31T04:22:53.121 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:53.116+0000 7f0c5b41a740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x55d31426a0d0 con 0x55d313eb5f60 2024-08-31T04:22:53.121 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:53.116+0000 7f0c5b41a740 10 client.0 _ll_register_callbacks cb 0x55d31416e210 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:22:53.121 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:53.117+0000 7f0c51400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d313e95280 0x55d3142675d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:22:53.121 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:53.117+0000 7f0c51400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d313e95280 0x55d3142675d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:44892/0 (socket says 172.21.15.50:44892) 2024-08-31T04:22:53.121 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:53.117+0000 7f0c51400640 1 -- 172.21.15.50:0/1684685299 learned_addr learned my addr 172.21.15.50:0/1684685299 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:22:53.121 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:53.117+0000 7f0c52800640 1 --2- 172.21.15.50:0/1684685299 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d313eb5f60 0x55d3142777d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:22:53.121 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:53.117+0000 7f0c51e00640 1 --2- 172.21.15.50:0/1684685299 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55d313e8d0a0 0x55d314267090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:22:53.121 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:53.117+0000 7f0c51400640 1 -- 172.21.15.50:0/1684685299 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d313eb5f60 msgr2=0x55d3142777d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:22:53.121 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:53.117+0000 7f0c51400640 1 --2- 172.21.15.50:0/1684685299 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d313eb5f60 0x55d3142777d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:53.121 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:53.117+0000 7f0c51400640 1 -- 172.21.15.50:0/1684685299 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55d313e8d0a0 msgr2=0x55d314267090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:22:53.121 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:53.117+0000 7f0c51400640 1 --2- 172.21.15.50:0/1684685299 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55d313e8d0a0 0x55d314267090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:53.121 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:53.117+0000 7f0c51400640 1 -- 172.21.15.50:0/1684685299 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d314189650 con 0x55d313e95280 2024-08-31T04:22:53.121 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:53.117+0000 7f0c52800640 1 --2- 172.21.15.50:0/1684685299 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d313eb5f60 0x55d3142777d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:22:53.122 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:53.118+0000 7f0c51400640 1 --2- 172.21.15.50:0/1684685299 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d313e95280 0x55d3142675d0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f0c3c0096e0 tx=0x7f0c3c005760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15ea4d5f3b52943d server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:22:53.122 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:53.118+0000 7f0c2f400640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-08-31T04:22:53.122 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:53.118+0000 7f0c2f400640 1 -- 172.21.15.50:0/1684685299 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c3c01e050 con 0x55d313e95280 2024-08-31T04:22:53.122 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:53.118+0000 7f0c5b41a740 1 -- 172.21.15.50:0/1684685299 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0c3c004310 con 0x55d313e95280 2024-08-31T04:22:53.122 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:53.118+0000 7f0c2f400640 1 -- 172.21.15.50:0/1684685299 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8219+0+0 (secure 0 0 0) 0x7f0c3c003800 con 0x55d313e95280 2024-08-31T04:22:53.122 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:53.118+0000 7f0c2f400640 1 -- 172.21.15.50:0/1684685299 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f0c3c009be0 con 0x55d313e95280 2024-08-31T04:22:53.122 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:53.118+0000 7f0c5b41a740 10 client.15267 fetch_fsmap learned FSMap version 28 2024-08-31T04:22:53.122 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:53.118+0000 7f0c5b41a740 1 -- 172.21.15.50:0/1684685299 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55d31427a250 con 0x55d313e95280 2024-08-31T04:22:53.122 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:53.119+0000 7f0c2f400640 1 -- 172.21.15.50:0/1684685299 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0c3c004310 con 0x55d313e95280 2024-08-31T04:22:53.122 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:53.119+0000 7f0c2f400640 1 -- 172.21.15.50:0/1684685299 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f0c3c00f6d0 con 0x55d313e95280 2024-08-31T04:22:53.122 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:53.119+0000 7f0c5b41a740 10 client.15267 fetch_fsmap finished waiting for FSMap version 28 2024-08-31T04:22:53.122 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:53.119+0000 7f0c5b41a740 10 client.15267 resolve_mds: resolved name 'b' to daemon mds.b 2024-08-31T04:22:53.122 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:53.119+0000 7f0c5b41a740 20 client.15267 populate_metadata read hostname 'smithi050' 2024-08-31T04:22:53.122 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:53.119+0000 7f0c5b41a740 1 --2- 172.21.15.50:0/1684685299 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x55d313e748e0 0x55d31427dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:53.123 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:53.119+0000 7f0c5b41a740 4 client.15267 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T04:22:53.123 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:53.119+0000 7f0c5b41a740 1 -- 172.21.15.50:0/1684685299 --> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d3141d44a0 con 0x55d313e748e0 2024-08-31T04:22:53.123 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:53.119+0000 7f0c51e00640 1 --2- 172.21.15.50:0/1684685299 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x55d313e748e0 0x55d31427dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:22:53.124 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:53.120+0000 7f0c51e00640 1 --2- 172.21.15.50:0/1684685299 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x55d313e748e0 0x55d31427dac0 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d3006bee355da75e server_cookie=83ec539791190328 in_seq=0 out_seq=0 2024-08-31T04:22:53.124 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:53.120+0000 7f0c2f400640 10 client.15267 ms_handle_connect on v2:172.21.15.133:6838/2526402262 2024-08-31T04:22:53.124 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:53.121+0000 7f0c2f400640 1 -- 172.21.15.50:0/1684685299 <== mds.0 v2:172.21.15.133:6838/2526402262 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55d3141d44a0 con 0x55d313e748e0 2024-08-31T04:22:53.124 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:53.121+0000 7f0c2f400640 10 client.15267 handle_command_reply: tid=0 2024-08-31T04:22:53.124 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:53.121+0000 7f0c5b41a740 1 client.15267 shutdown 2024-08-31T04:22:53.124 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:53.121+0000 7f0c5b41a740 1 -- 172.21.15.50:0/1684685299 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d313e95280 msgr2=0x55d3142675d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:22:53.124 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:53.121+0000 7f0c5b41a740 1 --2- 172.21.15.50:0/1684685299 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d313e95280 0x55d3142675d0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f0c3c0096e0 tx=0x7f0c3c005760 comp rx=0 tx=0).stop 2024-08-31T04:22:53.124 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:53.121+0000 7f0c5b41a740 1 -- 172.21.15.50:0/1684685299 shutdown_connections 2024-08-31T04:22:53.125 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:53.121+0000 7f0c5b41a740 1 --2- 172.21.15.50:0/1684685299 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x55d313e748e0 0x55d31427dac0 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:53.125 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:53.121+0000 7f0c5b41a740 1 --2- 172.21.15.50:0/1684685299 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d313eb5f60 0x55d3142777d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:53.125 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:53.121+0000 7f0c5b41a740 1 --2- 172.21.15.50:0/1684685299 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d313e95280 0x55d3142675d0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:53.125 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:53.121+0000 7f0c5b41a740 1 --2- 172.21.15.50:0/1684685299 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55d313e8d0a0 0x55d314267090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:53.125 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:53.121+0000 7f0c5b41a740 1 -- 172.21.15.50:0/1684685299 >> 172.21.15.50:0/1684685299 conn(0x55d313eaa350 msgr2=0x55d31425ea80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:22:53.125 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:53.121+0000 7f0c2f400640 0 client.15267 ms_handle_reset on v2:172.21.15.133:6838/2526402262 2024-08-31T04:22:53.125 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:53.121+0000 7f0c5b41a740 1 -- 172.21.15.50:0/1684685299 shutdown_connections 2024-08-31T04:22:53.125 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:53.121+0000 7f0c5b41a740 1 -- 172.21.15.50:0/1684685299 wait complete. 2024-08-31T04:22:53.125 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:53.121+0000 7f0c5b41a740 20 client.15267 trim_cache size 0 max 16384 2024-08-31T04:22:53.142 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:53.140+0000 7f0c5b41a740 1 Processor -- start 2024-08-31T04:22:53.142 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:53.141+0000 7f0c5b41a740 1 -- start start 2024-08-31T04:22:53.143 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:53.141+0000 7f0c5b41a740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d313e8d0a0 0x55d31427dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:53.143 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:53.141+0000 7f0c5b41a740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55d313e95280 0x55d3142544c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:53.144 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:53.141+0000 7f0c5b41a740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d313eb5f60 0x55d314265910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:53.144 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:53.141+0000 7f0c5b41a740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55d31427be00 con 0x55d313e8d0a0 2024-08-31T04:22:53.144 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:53.141+0000 7f0c5b41a740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x55d31427c4d0 con 0x55d313e95280 2024-08-31T04:22:53.144 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:53.141+0000 7f0c5b41a740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x55d31427cba0 con 0x55d313eb5f60 2024-08-31T04:22:53.144 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:53.141+0000 7f0c51e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d313e8d0a0 0x55d31427dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:22:53.144 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:53.141+0000 7f0c51e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d313e8d0a0 0x55d31427dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:44906/0 (socket says 172.21.15.50:44906) 2024-08-31T04:22:53.144 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:53.141+0000 7f0c51e00640 1 -- 172.21.15.50:0/3943794332 learned_addr learned my addr 172.21.15.50:0/3943794332 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:22:53.144 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:53.141+0000 7f0c52800640 1 --2- 172.21.15.50:0/3943794332 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d313eb5f60 0x55d314265910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:22:53.144 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:53.141+0000 7f0c51400640 1 --2- 172.21.15.50:0/3943794332 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55d313e95280 0x55d3142544c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:22:53.144 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:53.142+0000 7f0c51e00640 1 -- 172.21.15.50:0/3943794332 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d313eb5f60 msgr2=0x55d314265910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:22:53.144 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:53.142+0000 7f0c51e00640 1 --2- 172.21.15.50:0/3943794332 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d313eb5f60 0x55d314265910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:53.144 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:53.142+0000 7f0c51e00640 1 -- 172.21.15.50:0/3943794332 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55d313e95280 msgr2=0x55d3142544c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:22:53.145 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:53.142+0000 7f0c51e00640 1 --2- 172.21.15.50:0/3943794332 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55d313e95280 0x55d3142544c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:53.145 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:53.142+0000 7f0c51e00640 1 -- 172.21.15.50:0/3943794332 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d314268350 con 0x55d313e8d0a0 2024-08-31T04:22:53.145 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:53.142+0000 7f0c51e00640 1 --2- 172.21.15.50:0/3943794332 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d313e8d0a0 0x55d31427dac0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f0c400cbc70 tx=0x7f0c4002a3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b4602d715b3318d server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:22:53.145 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:53.142+0000 7f0c3a600640 1 -- 172.21.15.50:0/3943794332 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c40049040 con 0x55d313e8d0a0 2024-08-31T04:22:53.145 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:53.142+0000 7f0c3a600640 1 -- 172.21.15.50:0/3943794332 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0c400cbf70 con 0x55d313e8d0a0 2024-08-31T04:22:53.145 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:53.142+0000 7f0c3a600640 1 -- 172.21.15.50:0/3943794332 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c400c8200 con 0x55d313e8d0a0 2024-08-31T04:22:53.147 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:53.143+0000 7f0c5b41a740 1 -- 172.21.15.50:0/3943794332 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d313e8d0a0 msgr2=0x55d31427dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:22:53.147 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:53.143+0000 7f0c5b41a740 1 --2- 172.21.15.50:0/3943794332 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d313e8d0a0 0x55d31427dac0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f0c400cbc70 tx=0x7f0c4002a3f0 comp rx=0 tx=0).stop 2024-08-31T04:22:53.147 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:53.143+0000 7f0c5b41a740 1 -- 172.21.15.50:0/3943794332 shutdown_connections 2024-08-31T04:22:53.147 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:53.143+0000 7f0c5b41a740 1 --2- 172.21.15.50:0/3943794332 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d313eb5f60 0x55d314265910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:53.147 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:53.143+0000 7f0c5b41a740 1 --2- 172.21.15.50:0/3943794332 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55d313e95280 0x55d3142544c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:53.148 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:53.143+0000 7f0c5b41a740 1 --2- 172.21.15.50:0/3943794332 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d313e8d0a0 0x55d31427dac0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:53.148 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:53.143+0000 7f0c5b41a740 1 -- 172.21.15.50:0/3943794332 >> 172.21.15.50:0/3943794332 conn(0x55d313eaa350 msgr2=0x55d3142779d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:22:53.148 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:53.143+0000 7f0c5b41a740 1 -- 172.21.15.50:0/3943794332 shutdown_connections 2024-08-31T04:22:53.148 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:53.143+0000 7f0c5b41a740 1 -- 172.21.15.50:0/3943794332 wait complete. 2024-08-31T04:22:53.148 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:53.144+0000 7f0c5b41a740 1 -- start start 2024-08-31T04:22:53.148 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:53.144+0000 7f0c5b41a740 1 Processor -- start 2024-08-31T04:22:53.148 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:53.144+0000 7f0c5b41a740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d313e8d0a0 0x55d314280de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:53.148 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:53.144+0000 7f0c5b41a740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d313e95280 0x55d314281320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:53.148 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:53.144+0000 7f0c5b41a740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55d313eb5f60 0x55d314281860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:53.148 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:53.144+0000 7f0c5b41a740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55d31427d940 con 0x55d313e8d0a0 2024-08-31T04:22:53.149 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:53.144+0000 7f0c5b41a740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x55d31427d270 con 0x55d313eb5f60 2024-08-31T04:22:53.149 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:53.144+0000 7f0c5b41a740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x55d31427e010 con 0x55d313e95280 2024-08-31T04:22:53.149 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:53.145+0000 7f0c5b41a740 10 client.0 _ll_register_callbacks cb 0x7f0c3c009e60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:22:53.152 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:53.145+0000 7f0c51400640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d313e95280 0x55d314281320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:22:53.152 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:53.145+0000 7f0c51400640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d313e95280 0x55d314281320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.50:39258/0 (socket says 172.21.15.50:39258) 2024-08-31T04:22:53.152 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:53.145+0000 7f0c51e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d313e8d0a0 0x55d314280de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:22:53.153 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:53.145+0000 7f0c51400640 1 -- 172.21.15.50:0/4035947593 learned_addr learned my addr 172.21.15.50:0/4035947593 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:22:53.153 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:53.145+0000 7f0c52800640 1 --2- 172.21.15.50:0/4035947593 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55d313eb5f60 0x55d314281860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:22:53.153 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:53.145+0000 7f0c51400640 1 -- 172.21.15.50:0/4035947593 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55d313eb5f60 msgr2=0x55d314281860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:22:53.153 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:53.145+0000 7f0c51400640 1 --2- 172.21.15.50:0/4035947593 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55d313eb5f60 0x55d314281860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:53.153 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:53.145+0000 7f0c51400640 1 -- 172.21.15.50:0/4035947593 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d313e8d0a0 msgr2=0x55d314280de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:22:53.153 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:53.145+0000 7f0c51400640 1 --2- 172.21.15.50:0/4035947593 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d313e8d0a0 0x55d314280de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:53.153 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:53.145+0000 7f0c51400640 1 -- 172.21.15.50:0/4035947593 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d3142e7030 con 0x55d313e95280 2024-08-31T04:22:53.153 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:53.145+0000 7f0c51400640 1 --2- 172.21.15.50:0/4035947593 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d313e95280 0x55d314281320 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f0c3c0059f0 tx=0x7f0c3c00f770 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d7b389b2395f92d8 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:22:53.153 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:53.145+0000 7f0c2f400640 10 client.0 ms_handle_connect on v2:172.21.15.177:3300/0 2024-08-31T04:22:53.154 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:53.146+0000 7f0c2f400640 1 -- 172.21.15.50:0/4035947593 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c3c01e070 con 0x55d313e95280 2024-08-31T04:22:53.154 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:53.146+0000 7f0c5b41a740 1 -- 172.21.15.50:0/4035947593 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0c400cbf70 con 0x55d313e95280 2024-08-31T04:22:53.154 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:53.146+0000 7f0c2f400640 1 -- 172.21.15.50:0/4035947593 <== mon.1 v2:172.21.15.177:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8219+0+0 (secure 0 0 0) 0x7f0c3c011230 con 0x55d313e95280 2024-08-31T04:22:53.154 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:53.146+0000 7f0c2f400640 1 -- 172.21.15.50:0/4035947593 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f0c3c041050 con 0x55d313e95280 2024-08-31T04:22:53.154 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:53.146+0000 7f0c5b41a740 10 client.25282 fetch_fsmap learned FSMap version 28 2024-08-31T04:22:53.154 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:53.146+0000 7f0c5b41a740 1 -- 172.21.15.50:0/4035947593 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55d3142e8290 con 0x55d313e95280 2024-08-31T04:22:53.156 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:53.146+0000 7f0c2f400640 1 -- 172.21.15.50:0/4035947593 <== mon.1 v2:172.21.15.177:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0c400cbf70 con 0x55d313e95280 2024-08-31T04:22:53.156 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:53.147+0000 7f0c2f400640 1 -- 172.21.15.50:0/4035947593 <== mon.1 v2:172.21.15.177:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f0c3c025900 con 0x55d313e95280 2024-08-31T04:22:53.156 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:53.147+0000 7f0c5b41a740 10 client.25282 fetch_fsmap finished waiting for FSMap version 28 2024-08-31T04:22:53.156 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:53.147+0000 7f0c5b41a740 10 client.25282 resolve_mds: resolved name 'b' to daemon mds.b 2024-08-31T04:22:53.156 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:53.147+0000 7f0c5b41a740 20 client.25282 populate_metadata read hostname 'smithi050' 2024-08-31T04:22:53.156 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:53.147+0000 7f0c5b41a740 1 --2- 172.21.15.50:0/4035947593 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x55d313e49c90 0x55d3142ebbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:53.156 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:53.147+0000 7f0c5b41a740 4 client.25282 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "status"}] 2024-08-31T04:22:53.156 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:53.147+0000 7f0c5b41a740 1 -- 172.21.15.50:0/4035947593 --> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] -- command(tid 0: {"prefix": "status"}) -- 0x55d3141cff40 con 0x55d313e49c90 2024-08-31T04:22:53.157 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:53.147+0000 7f0c51e00640 1 --2- 172.21.15.50:0/4035947593 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x55d313e49c90 0x55d3142ebbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:22:53.157 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:53.148+0000 7f0c51e00640 1 --2- 172.21.15.50:0/4035947593 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x55d313e49c90 0x55d3142ebbf0 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=82be11a48dfa98b4 server_cookie=a2fa8f17d3a917a8 in_seq=0 out_seq=0 2024-08-31T04:22:53.157 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:53.148+0000 7f0c2f400640 10 client.25282 ms_handle_connect on v2:172.21.15.133:6838/2526402262 2024-08-31T04:22:53.157 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:53.148+0000 7f0c2f400640 1 -- 172.21.15.50:0/4035947593 <== mds.0 v2:172.21.15.133:6838/2526402262 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x55d3141cff40 con 0x55d313e49c90 2024-08-31T04:22:53.157 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:53.148+0000 7f0c2f400640 10 client.25282 handle_command_reply: tid=0 2024-08-31T04:22:53.157 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:53.148+0000 7f0c5b41a740 1 client.25282 shutdown 2024-08-31T04:22:53.157 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:53.148+0000 7f0c5b41a740 1 -- 172.21.15.50:0/4035947593 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d313e95280 msgr2=0x55d314281320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:22:53.157 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:53.148+0000 7f0c5b41a740 1 --2- 172.21.15.50:0/4035947593 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d313e95280 0x55d314281320 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f0c3c0059f0 tx=0x7f0c3c00f770 comp rx=0 tx=0).stop 2024-08-31T04:22:53.157 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:53.148+0000 7f0c5b41a740 1 -- 172.21.15.50:0/4035947593 shutdown_connections 2024-08-31T04:22:53.157 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:53.148+0000 7f0c5b41a740 1 --2- 172.21.15.50:0/4035947593 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x55d313e49c90 0x55d3142ebbf0 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:53.157 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:53.148+0000 7f0c5b41a740 1 --2- 172.21.15.50:0/4035947593 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d313e95280 0x55d314281320 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:53.157 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:53.148+0000 7f0c5b41a740 1 --2- 172.21.15.50:0/4035947593 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55d313eb5f60 0x55d314281860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:53.157 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:53.148+0000 7f0c5b41a740 1 --2- 172.21.15.50:0/4035947593 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d313e8d0a0 0x55d314280de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:53.158 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:53.148+0000 7f0c2f400640 0 client.25282 ms_handle_reset on v2:172.21.15.133:6838/2526402262 2024-08-31T04:22:53.158 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:53.148+0000 7f0c5b41a740 1 -- 172.21.15.50:0/4035947593 >> 172.21.15.50:0/4035947593 conn(0x55d313eaa350 msgr2=0x55d3142779d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:22:53.158 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:53.148+0000 7f0c5b41a740 1 -- 172.21.15.50:0/4035947593 shutdown_connections 2024-08-31T04:22:53.158 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:53.148+0000 7f0c5b41a740 1 -- 172.21.15.50:0/4035947593 wait complete. 2024-08-31T04:22:53.158 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:53.149+0000 7f0c5b41a740 20 client.25282 trim_cache size 0 max 16384 2024-08-31T04:22:53.158 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-08-31T04:22:53.158 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_fsid": "058d9fc6-674f-11ef-bcd4-c7b262605968", 2024-08-31T04:22:53.158 INFO:teuthology.orchestra.run.smithi050.stdout: "whoami": 0, 2024-08-31T04:22:53.159 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 24695, 2024-08-31T04:22:53.159 INFO:teuthology.orchestra.run.smithi050.stdout: "want_state": "up:active", 2024-08-31T04:22:53.159 INFO:teuthology.orchestra.run.smithi050.stdout: "state": "up:active", 2024-08-31T04:22:53.159 INFO:teuthology.orchestra.run.smithi050.stdout: "fs_name": "cephfs", 2024-08-31T04:22:53.159 INFO:teuthology.orchestra.run.smithi050.stdout: "rank_uptime": 128.205698262, 2024-08-31T04:22:53.159 INFO:teuthology.orchestra.run.smithi050.stdout: "mdsmap_epoch": 28, 2024-08-31T04:22:53.159 INFO:teuthology.orchestra.run.smithi050.stdout: "osdmap_epoch": 78, 2024-08-31T04:22:53.159 INFO:teuthology.orchestra.run.smithi050.stdout: "osdmap_epoch_barrier": 78, 2024-08-31T04:22:53.159 INFO:teuthology.orchestra.run.smithi050.stdout: "uptime": 142.15321969199999 2024-08-31T04:22:53.159 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-08-31T04:22:53.160 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:53.149+0000 7f0c54800640 1 -- 172.21.15.50:0/2839485804 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f0c340b4b30 msgr2=0x7f0c340b7040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:22:53.160 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:53.149+0000 7f0c54800640 1 --2- 172.21.15.50:0/2839485804 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f0c340b4b30 0x7f0c340b7040 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f0c48005fd0 tx=0x7f0c480096a0 comp rx=0 tx=0).stop 2024-08-31T04:22:53.160 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:53.149+0000 7f0c54800640 1 -- 172.21.15.50:0/2839485804 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0c4c103900 msgr2=0x7f0c4c19a2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:22:53.160 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:53.149+0000 7f0c54800640 1 --2- 172.21.15.50:0/2839485804 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0c4c103900 0x7f0c4c19a2c0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f0c40005940 tx=0x7f0c40004270 comp rx=0 tx=0).stop 2024-08-31T04:22:53.160 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:53.149+0000 7f0c54800640 1 -- 172.21.15.50:0/2839485804 shutdown_connections 2024-08-31T04:22:53.160 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:53.149+0000 7f0c54800640 1 --2- 172.21.15.50:0/2839485804 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f0c340b4b30 0x7f0c340b7040 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:53.160 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:53.149+0000 7f0c54800640 1 --2- 172.21.15.50:0/2839485804 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0c4c109240 0x7f0c4c19a860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:53.160 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:53.149+0000 7f0c54800640 1 --2- 172.21.15.50:0/2839485804 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0c4c109b90 0x7f0c4c19fb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:53.161 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:53.149+0000 7f0c54800640 1 --2- 172.21.15.50:0/2839485804 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0c4c103900 0x7f0c4c19a2c0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:53.161 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:53.149+0000 7f0c54800640 1 -- 172.21.15.50:0/2839485804 >> 172.21.15.50:0/2839485804 conn(0x7f0c4c07b5f0 msgr2=0x7f0c4c107330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:22:53.161 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:53.149+0000 7f0c54800640 1 -- 172.21.15.50:0/2839485804 shutdown_connections 2024-08-31T04:22:53.161 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:53.150+0000 7f0c54800640 1 -- 172.21.15.50:0/2839485804 wait complete. 2024-08-31T04:22:53.825 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:22:53 smithi050 ceph-mon[17259]: pgmap v366: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2024-08-31T04:22:53.862 INFO:teuthology.run_tasks:Running task kclient... 2024-08-31T04:22:53.889 INFO:tasks.kclient:Mounting kernel clients... 2024-08-31T04:22:53.889 INFO:tasks.kclient:config is {'client.0': {}} 2024-08-31T04:22:53.889 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-31T04:22:53.889 DEBUG:teuthology.orchestra.run.smithi050:> ip netns list 2024-08-31T04:22:53.926 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-31T04:22:53.926 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip link delete ceph-brx 2024-08-31T04:22:53.996 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:22:53 smithi177 ceph-mon[22025]: pgmap v366: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2024-08-31T04:22:54.026 INFO:teuthology.orchestra.run.smithi050.stderr:Cannot find device "ceph-brx" 2024-08-31T04:22:54.029 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-31T04:22:54.029 INFO:tasks.kclient:client.0 config is {'mntopts': ['ms_mode=legacy', 'wsync'], 'syntax': 'v2', 'mount_subvol_num': 1} 2024-08-31T04:22:54.030 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-08-31T04:22:54.030 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-08-31T04:22:54.030 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 058d9fc6-674f-11ef-bcd4-c7b262605968 -- ceph fs ls 2024-08-31T04:22:54.042 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:22:53 smithi133 ceph-mon[22177]: pgmap v366: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2024-08-31T04:22:54.407 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:22:55.023 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:55.021+0000 7f0946800640 1 -- 172.21.15.50:0/3757128996 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f09401099e0 msgr2=0x7f0940110210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:22:55.023 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:55.021+0000 7f0946800640 1 --2- 172.21.15.50:0/3757128996 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f09401099e0 0x7f0940110210 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f0938009ca0 tx=0x7f093802a8c0 comp rx=0 tx=0).stop 2024-08-31T04:22:55.023 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:55.021+0000 7f0946800640 1 -- 172.21.15.50:0/3757128996 shutdown_connections 2024-08-31T04:22:55.023 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:55.021+0000 7f0946800640 1 --2- 172.21.15.50:0/3757128996 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f09401099e0 0x7f0940110210 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:55.023 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:55.021+0000 7f0946800640 1 --2- 172.21.15.50:0/3757128996 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0940109090 0x7f09401094a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:55.023 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:55.021+0000 7f0946800640 1 --2- 172.21.15.50:0/3757128996 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0940103750 0x7f0940103b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:55.023 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:55.021+0000 7f0946800640 1 -- 172.21.15.50:0/3757128996 >> 172.21.15.50:0/3757128996 conn(0x7f09400ff1a0 msgr2=0x7f09401015f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:22:55.023 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:55.021+0000 7f0946800640 1 -- 172.21.15.50:0/3757128996 shutdown_connections 2024-08-31T04:22:55.024 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:55.021+0000 7f0946800640 1 -- 172.21.15.50:0/3757128996 wait complete. 2024-08-31T04:22:55.025 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:55.022+0000 7f0946800640 1 Processor -- start 2024-08-31T04:22:55.025 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:55.022+0000 7f0946800640 1 -- start start 2024-08-31T04:22:55.025 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:55.023+0000 7f0946800640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0940103750 0x7f0940076ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:55.025 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:55.023+0000 7f0946800640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0940109090 0x7f09400754b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:55.025 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:55.023+0000 7f0946800640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f09401099e0 0x7f09400759f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:55.025 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:55.023+0000 7f0946800640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f0940113700 con 0x7f0940109090 2024-08-31T04:22:55.025 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:55.023+0000 7f0946800640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f0940113580 con 0x7f09401099e0 2024-08-31T04:22:55.026 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:55.023+0000 7f0946800640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f0940113880 con 0x7f0940103750 2024-08-31T04:22:55.026 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:55.023+0000 7f0944a00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0940109090 0x7f09400754b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:22:55.026 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:55.023+0000 7f0944a00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0940109090 0x7f09400754b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:44928/0 (socket says 172.21.15.50:44928) 2024-08-31T04:22:55.026 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:55.023+0000 7f0944a00640 1 -- 172.21.15.50:0/2661211476 learned_addr learned my addr 172.21.15.50:0/2661211476 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:22:55.026 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:55.023+0000 7f0945400640 1 --2- 172.21.15.50:0/2661211476 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0940103750 0x7f0940076ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:22:55.026 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:55.023+0000 7f0945e00640 1 --2- 172.21.15.50:0/2661211476 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f09401099e0 0x7f09400759f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:22:55.026 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:55.024+0000 7f0944a00640 1 -- 172.21.15.50:0/2661211476 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0940103750 msgr2=0x7f0940076ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:22:55.026 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:55.024+0000 7f0944a00640 1 --2- 172.21.15.50:0/2661211476 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0940103750 0x7f0940076ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:55.026 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:55.024+0000 7f0944a00640 1 -- 172.21.15.50:0/2661211476 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f09401099e0 msgr2=0x7f09400759f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:22:55.026 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:55.024+0000 7f0944a00640 1 --2- 172.21.15.50:0/2661211476 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f09401099e0 0x7f09400759f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:55.026 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:55.024+0000 7f0944a00640 1 -- 172.21.15.50:0/2661211476 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0940076210 con 0x7f0940109090 2024-08-31T04:22:55.026 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:55.024+0000 7f0944a00640 1 --2- 172.21.15.50:0/2661211476 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0940109090 0x7f09400754b0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f092c00e9f0 tx=0x7f092c00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:22:55.027 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:55.024+0000 7f093e000640 1 -- 172.21.15.50:0/2661211476 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f092c00ccc0 con 0x7f0940109090 2024-08-31T04:22:55.027 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:55.024+0000 7f093e000640 1 -- 172.21.15.50:0/2661211476 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f092c0108e0 con 0x7f0940109090 2024-08-31T04:22:55.027 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:55.024+0000 7f0946800640 1 -- 172.21.15.50:0/2661211476 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f09401aca90 con 0x7f0940109090 2024-08-31T04:22:55.027 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:55.024+0000 7f093e000640 1 -- 172.21.15.50:0/2661211476 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f092c018860 con 0x7f0940109090 2024-08-31T04:22:55.027 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:55.025+0000 7f0946800640 1 -- 172.21.15.50:0/2661211476 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f09401acfa0 con 0x7f0940109090 2024-08-31T04:22:55.027 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:55.026+0000 7f0946800640 1 -- 172.21.15.50:0/2661211476 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0940103b60 con 0x7f0940109090 2024-08-31T04:22:55.030 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:55.029+0000 7f093e000640 1 -- 172.21.15.50:0/2661211476 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 18) ==== 152577+0+0 (secure 0 0 0) 0x7f092c010430 con 0x7f0940109090 2024-08-31T04:22:55.032 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:55.031+0000 7f093e000640 1 --2- 172.21.15.50:0/2661211476 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f09280b4b30 0x7f09280b7040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:55.032 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:55.031+0000 7f093e000640 1 -- 172.21.15.50:0/2661211476 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8219+0+0 (secure 0 0 0) 0x7f092c0e53d0 con 0x7f0940109090 2024-08-31T04:22:55.032 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:55.031+0000 7f0945400640 1 --2- 172.21.15.50:0/2661211476 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f09280b4b30 0x7f09280b7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:22:55.033 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:55.032+0000 7f0945400640 1 --2- 172.21.15.50:0/2661211476 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f09280b4b30 0x7f09280b7040 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f094019dfa0 tx=0x7f0934005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:22:55.036 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:55.035+0000 7f093e000640 1 -- 172.21.15.50:0/2661211476 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f092c0abe60 con 0x7f0940109090 2024-08-31T04:22:55.272 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:55.270+0000 7f0946800640 1 -- 172.21.15.50:0/2661211476 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f094002e430 con 0x7f0940109090 2024-08-31T04:22:55.272 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:55.270+0000 7f093e000640 1 -- 172.21.15.50:0/2661211476 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v28) ==== 53+0+73 (secure 0 0 0) 0x7f092c0b0620 con 0x7f0940109090 2024-08-31T04:22:55.272 INFO:teuthology.orchestra.run.smithi050.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-08-31T04:22:55.274 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:55.273+0000 7f0946800640 1 -- 172.21.15.50:0/2661211476 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f09280b4b30 msgr2=0x7f09280b7040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:22:55.275 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:55.273+0000 7f0946800640 1 --2- 172.21.15.50:0/2661211476 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f09280b4b30 0x7f09280b7040 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f094019dfa0 tx=0x7f0934005f90 comp rx=0 tx=0).stop 2024-08-31T04:22:55.275 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:55.273+0000 7f0946800640 1 -- 172.21.15.50:0/2661211476 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0940109090 msgr2=0x7f09400754b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:22:55.275 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:55.273+0000 7f0946800640 1 --2- 172.21.15.50:0/2661211476 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0940109090 0x7f09400754b0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f092c00e9f0 tx=0x7f092c00eeb0 comp rx=0 tx=0).stop 2024-08-31T04:22:55.275 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:55.273+0000 7f0946800640 1 -- 172.21.15.50:0/2661211476 shutdown_connections 2024-08-31T04:22:55.275 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:55.273+0000 7f0946800640 1 --2- 172.21.15.50:0/2661211476 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f09280b4b30 0x7f09280b7040 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:55.275 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:55.273+0000 7f0946800640 1 --2- 172.21.15.50:0/2661211476 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f09401099e0 0x7f09400759f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:55.275 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:55.273+0000 7f0946800640 1 --2- 172.21.15.50:0/2661211476 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0940109090 0x7f09400754b0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:55.275 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:55.273+0000 7f0946800640 1 --2- 172.21.15.50:0/2661211476 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0940103750 0x7f0940076ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:55.275 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:55.273+0000 7f0946800640 1 -- 172.21.15.50:0/2661211476 >> 172.21.15.50:0/2661211476 conn(0x7f09400ff1a0 msgr2=0x7f09401086c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:22:55.275 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:55.273+0000 7f0946800640 1 -- 172.21.15.50:0/2661211476 shutdown_connections 2024-08-31T04:22:55.275 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:55.273+0000 7f0946800640 1 -- 172.21.15.50:0/2661211476 wait complete. 2024-08-31T04:22:55.950 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:22:55 smithi050 ceph-mon[17259]: pgmap v367: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-08-31T04:22:55.950 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:22:55 smithi050 ceph-mon[17259]: from='client.? 172.21.15.50:0/2661211476' entity='client.admin' cmd={"prefix": "fs ls"} : dispatch 2024-08-31T04:22:55.996 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:22:55 smithi177 ceph-mon[22025]: pgmap v367: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-08-31T04:22:55.996 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:22:55 smithi177 ceph-mon[22025]: from='client.? 172.21.15.50:0/2661211476' entity='client.admin' cmd={"prefix": "fs ls"} : dispatch 2024-08-31T04:22:56.033 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-08-31T04:22:56.033 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-08-31T04:22:56.033 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi050.front.sepia.ceph.com 2024-08-31T04:22:56.033 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-08-31T04:22:56.033 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-08-31T04:22:56.033 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-08-31T04:22:56.033 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-08-31T04:22:56.034 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-08-31T04:22:56.034 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-08-31T04:22:56.034 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-31T04:22:56.034 DEBUG:teuthology.orchestra.run.smithi050:> ip addr 2024-08-31T04:22:56.043 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:22:55 smithi133 ceph-mon[22177]: pgmap v367: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-08-31T04:22:56.043 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:22:55 smithi133 ceph-mon[22177]: from='client.? 172.21.15.50:0/2661211476' entity='client.admin' cmd={"prefix": "fs ls"} : dispatch 2024-08-31T04:22:56.069 INFO:teuthology.orchestra.run.smithi050.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-08-31T04:22:56.069 INFO:teuthology.orchestra.run.smithi050.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-08-31T04:22:56.069 INFO:teuthology.orchestra.run.smithi050.stdout: inet 127.0.0.1/8 scope host lo 2024-08-31T04:22:56.070 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2024-08-31T04:22:56.070 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 ::1/128 scope host 2024-08-31T04:22:56.070 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2024-08-31T04:22:56.070 INFO:teuthology.orchestra.run.smithi050.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-31T04:22:56.070 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 0c:c4:7a:6b:fd:f8 brd ff:ff:ff:ff:ff:ff 2024-08-31T04:22:56.070 INFO:teuthology.orchestra.run.smithi050.stdout: altname enp7s0f0 2024-08-31T04:22:56.070 INFO:teuthology.orchestra.run.smithi050.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-31T04:22:56.070 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 0c:c4:7a:6b:fd:f9 brd ff:ff:ff:ff:ff:ff 2024-08-31T04:22:56.070 INFO:teuthology.orchestra.run.smithi050.stdout: altname enp7s0f1 2024-08-31T04:22:56.070 INFO:teuthology.orchestra.run.smithi050.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-08-31T04:22:56.070 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 0c:c4:7a:bd:15:84 brd ff:ff:ff:ff:ff:ff 2024-08-31T04:22:56.070 INFO:teuthology.orchestra.run.smithi050.stdout: altname enp1s0f0 2024-08-31T04:22:56.071 INFO:teuthology.orchestra.run.smithi050.stdout: inet 172.21.15.50/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-08-31T04:22:56.071 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft 42187sec preferred_lft 42187sec 2024-08-31T04:22:56.071 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 fe80::ec4:7aff:febd:1584/64 scope link 2024-08-31T04:22:56.071 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2024-08-31T04:22:56.071 INFO:teuthology.orchestra.run.smithi050.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-31T04:22:56.071 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 0c:c4:7a:bd:15:85 brd ff:ff:ff:ff:ff:ff 2024-08-31T04:22:56.071 INFO:teuthology.orchestra.run.smithi050.stdout: altname enp1s0f1 2024-08-31T04:22:56.072 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-08-31T04:22:56.072 DEBUG:teuthology.orchestra.run.smithi050:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-08-31T04:22:56.073 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2024-08-31T04:22:56.073 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip link add name ceph-brx type bridge 2024-08-31T04:22:56.073 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip addr flush dev ceph-brx 2024-08-31T04:22:56.073 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip link set ceph-brx up 2024-08-31T04:22:56.073 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-08-31T04:22:56.073 DEBUG:teuthology.orchestra.run.smithi050:> ') 2024-08-31T04:22:56.192 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:56 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-08-31T04:22:56.484 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:56 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-31T04:22:56.496 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-31T04:22:56.496 DEBUG:teuthology.orchestra.run.smithi050:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-08-31T04:22:56.554 INFO:teuthology.orchestra.run.smithi050.stdout:1 2024-08-31T04:22:56.557 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-31T04:22:56.557 DEBUG:teuthology.orchestra.run.smithi050:> route 2024-08-31T04:22:56.609 INFO:teuthology.orchestra.run.smithi050.stdout:Kernel IP routing table 2024-08-31T04:22:56.609 INFO:teuthology.orchestra.run.smithi050.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-08-31T04:22:56.610 INFO:teuthology.orchestra.run.smithi050.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-08-31T04:22:56.610 INFO:teuthology.orchestra.run.smithi050.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-08-31T04:22:56.610 INFO:teuthology.orchestra.run.smithi050.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-08-31T04:22:56.610 DEBUG:teuthology.orchestra.run.smithi050:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-08-31T04:22:56.610 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2024-08-31T04:22:56.610 DEBUG:teuthology.orchestra.run.smithi050:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-08-31T04:22:56.610 DEBUG:teuthology.orchestra.run.smithi050:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-08-31T04:22:56.610 DEBUG:teuthology.orchestra.run.smithi050:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-08-31T04:22:56.610 DEBUG:teuthology.orchestra.run.smithi050:> ') 2024-08-31T04:22:56.689 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:56 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-08-31T04:22:57.204 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:57 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-31T04:22:57.213 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-31T04:22:57.213 DEBUG:teuthology.orchestra.run.smithi050:> ip netns list 2024-08-31T04:22:57.252 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-31T04:22:57.253 DEBUG:teuthology.orchestra.run.smithi050:> ip netns list-id 2024-08-31T04:22:57.328 DEBUG:teuthology.orchestra.run.smithi050:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-08-31T04:22:57.328 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2024-08-31T04:22:57.328 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-08-31T04:22:57.328 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-08-31T04:22:57.329 DEBUG:teuthology.orchestra.run.smithi050:> ') 2024-08-31T04:22:57.447 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:57 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-08-31T04:22:57.498 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:57 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-31T04:22:57.507 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-08-31T04:22:57.507 DEBUG:teuthology.orchestra.run.smithi050:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-08-31T04:22:57.507 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2024-08-31T04:22:57.507 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-08-31T04:22:57.507 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-08-31T04:22:57.507 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-08-31T04:22:57.507 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-08-31T04:22:57.507 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-08-31T04:22:57.507 DEBUG:teuthology.orchestra.run.smithi050:> ') 2024-08-31T04:22:57.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:57 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-08-31T04:22:57.739 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:57 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-31T04:22:57.747 DEBUG:teuthology.orchestra.run.smithi050:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-08-31T04:22:57.748 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2024-08-31T04:22:57.748 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip link set brx.0 up 2024-08-31T04:22:57.748 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip link set dev brx.0 master ceph-brx 2024-08-31T04:22:57.748 DEBUG:teuthology.orchestra.run.smithi050:> ') 2024-08-31T04:22:57.827 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:57 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-08-31T04:22:57.843 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:22:57 smithi050 ceph-mon[17259]: pgmap v368: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 10 op/s 2024-08-31T04:22:57.907 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:57 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-31T04:22:57.915 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-31T04:22:57.915 DEBUG:teuthology.orchestra.run.smithi050:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-08-31T04:22:57.950 INFO:teuthology.orchestra.run.smithi050.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-08-31T04:22:57.951 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-31T04:22:57.951 DEBUG:teuthology.orchestra.run.smithi050:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-08-31T04:22:57.995 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:22:57 smithi177 ceph-mon[22025]: pgmap v368: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 10 op/s 2024-08-31T04:22:58.026 WARNING:tasks.cephfs.mount:You cannot specify both: cephfs_mntpt and mount_subvol_num 2024-08-31T04:22:58.026 INFO:tasks.cephfs.mount:Mounting subvol 1 for now 2024-08-31T04:22:58.026 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/volumes/qa/sv_1/06353fe4-86e8-435f-8a14-3aba2ce8268c 2024-08-31T04:22:58.026 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-31T04:22:58.027 DEBUG:teuthology.orchestra.run.smithi050:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/volumes/qa/sv_1/06353fe4-86e8-435f-8a14-3aba2ce8268c /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,ms_mode=legacy,wsync,nofallback 2024-08-31T04:22:58.042 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:22:57 smithi133 ceph-mon[22177]: pgmap v368: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 10 op/s 2024-08-31T04:22:58.250 INFO:teuthology.orchestra.run.smithi050.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,ms_mode=legacy,wsync,nofallback 2024-08-31T04:22:58.250 INFO:teuthology.orchestra.run.smithi050.stdout:mount.ceph: options "norequire_active_mds,norbytes,ms_mode=legacy,wsync". 2024-08-31T04:22:58.904 INFO:teuthology.orchestra.run.smithi050.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,ms_mode=legacy,wsync,nofallback 2024-08-31T04:22:58.904 INFO:teuthology.orchestra.run.smithi050.stdout:mount.ceph: options "norequire_active_mds,norbytes,ms_mode=legacy,wsync". 2024-08-31T04:22:58.904 INFO:teuthology.orchestra.run.smithi050.stdout:mount.ceph: resolved to: "172.21.15.50:6789,172.21.15.133:6789,172.21.15.177:6789" 2024-08-31T04:22:58.905 INFO:teuthology.orchestra.run.smithi050.stdout:mount.ceph: trying mount with new device syntax: 0@058d9fc6-674f-11ef-bcd4-c7b262605968.cephfs=/volumes/qa/sv_1/06353fe4-86e8-435f-8a14-3aba2ce8268c 2024-08-31T04:22:58.905 INFO:teuthology.orchestra.run.smithi050.stdout:mount.ceph: options "norequire_active_mds,norbytes,ms_mode=legacy,wsync,name=0,key=0,mon_addr=172.21.15.50:6789/172.21.15.133:6789/172.21.15.177:6789" will pass to kernel 2024-08-31T04:22:58.907 INFO:teuthology.orchestra.run.smithi050.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-08-31T04:22:58.907 INFO:teuthology.orchestra.run.smithi050.stdout: You just mounted a file system that supports labels which does not 2024-08-31T04:22:58.907 INFO:teuthology.orchestra.run.smithi050.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-08-31T04:22:58.907 INFO:teuthology.orchestra.run.smithi050.stdout: applications will generate AVC messages and not be allowed access to 2024-08-31T04:22:58.907 INFO:teuthology.orchestra.run.smithi050.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-08-31T04:22:58.910 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-08-31T04:22:58.910 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-31T04:22:58.911 DEBUG:teuthology.orchestra.run.smithi050:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-08-31T04:22:58.972 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-08-31T04:22:59.053 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:59 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-08-31T04:22:59.057 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:59 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-31T04:22:59.065 INFO:teuthology.orchestra.run.smithi050.stdout:client15282 2024-08-31T04:22:59.066 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-08-31T04:22:59.066 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-31T04:22:59.102 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-08-31T04:22:59.221 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:59 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-08-31T04:22:59.224 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:59 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-31T04:22:59.232 INFO:teuthology.orchestra.run.smithi050.stdout:client15282 2024-08-31T04:22:59.232 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-08-31T04:22:59.311 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:59 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-08-31T04:22:59.315 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:59 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-31T04:22:59.322 INFO:teuthology.orchestra.run.smithi050.stdout:client15282 2024-08-31T04:22:59.323 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968.client15282/status') 2024-08-31T04:22:59.401 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:59 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-08-31T04:22:59.423 INFO:teuthology.orchestra.run.smithi050.stdout:instance: client.15282 (3)192.168.0.1:0/756845645 2024-08-31T04:22:59.423 INFO:teuthology.orchestra.run.smithi050.stdout:blocklisted: false 2024-08-31T04:22:59.423 INFO:teuthology.orchestra.run.smithi050.stderr:0+1 records in 2024-08-31T04:22:59.423 INFO:teuthology.orchestra.run.smithi050.stderr:0+1 records out 2024-08-31T04:22:59.423 INFO:teuthology.orchestra.run.smithi050.stderr:69 bytes copied, 5.7128e-05 s, 1.2 MB/s 2024-08-31T04:22:59.425 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:59 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-31T04:22:59.433 INFO:teuthology.run_tasks:Running task exec... 2024-08-31T04:22:59.443 INFO:teuthology.task.exec:Executing custom commands... 2024-08-31T04:22:59.443 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi050.front.sepia.ceph.com 2024-08-31T04:22:59.444 DEBUG:teuthology.orchestra.run.smithi050:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs set cephfs balance_automate true' 2024-08-31T04:22:59.666 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:59.664+0000 7ff0ce400640 1 -- 172.21.15.50:0/788855265 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff0c8104e70 msgr2=0x7ff0c810b810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:22:59.667 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:59.665+0000 7ff0ce400640 1 --2- 172.21.15.50:0/788855265 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff0c8104e70 0x7ff0c810b810 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7ff0c0009ca0 tx=0x7ff0c002a8c0 comp rx=0 tx=0).stop 2024-08-31T04:22:59.667 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:59.665+0000 7ff0ce400640 1 -- 172.21.15.50:0/788855265 shutdown_connections 2024-08-31T04:22:59.667 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:59.665+0000 7ff0ce400640 1 --2- 172.21.15.50:0/788855265 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff0c81044d0 0x7ff0c81048e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:59.667 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:59.665+0000 7ff0ce400640 1 --2- 172.21.15.50:0/788855265 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff0c8104e70 0x7ff0c810b810 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:59.667 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:59.665+0000 7ff0ce400640 1 --2- 172.21.15.50:0/788855265 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff0c8103450 0x7ff0c81038c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:59.667 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:59.665+0000 7ff0ce400640 1 -- 172.21.15.50:0/788855265 >> 172.21.15.50:0/788855265 conn(0x7ff0c80fed90 msgr2=0x7ff0c8101240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:22:59.667 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:59.665+0000 7ff0ce400640 1 -- 172.21.15.50:0/788855265 shutdown_connections 2024-08-31T04:22:59.667 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:59.665+0000 7ff0ce400640 1 -- 172.21.15.50:0/788855265 wait complete. 2024-08-31T04:22:59.669 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:59.666+0000 7ff0ce400640 1 Processor -- start 2024-08-31T04:22:59.669 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:59.666+0000 7ff0ce400640 1 -- start start 2024-08-31T04:22:59.669 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:59.666+0000 7ff0ce400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff0c8103450 0x7ff0c8076bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:59.670 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:59.666+0000 7ff0ce400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff0c81044d0 0x7ff0c80754b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:59.670 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:59.666+0000 7ff0ce400640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff0c8104e70 0x7ff0c80759f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:59.671 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:59.666+0000 7ff0ce400640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7ff0c810f0e0 con 0x7ff0c81044d0 2024-08-31T04:22:59.671 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:59.666+0000 7ff0ce400640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7ff0c810ef60 con 0x7ff0c8103450 2024-08-31T04:22:59.671 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:59.666+0000 7ff0ce400640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7ff0c810f260 con 0x7ff0c8104e70 2024-08-31T04:22:59.671 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:59.666+0000 7ff0c6a00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff0c81044d0 0x7ff0c80754b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:22:59.671 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:59.666+0000 7ff0c6a00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff0c81044d0 0x7ff0c80754b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:44946/0 (socket says 172.21.15.50:44946) 2024-08-31T04:22:59.671 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:59.666+0000 7ff0c6a00640 1 -- 172.21.15.50:0/1927466878 learned_addr learned my addr 172.21.15.50:0/1927466878 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:22:59.671 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:59.667+0000 7ff0c7e00640 1 --2- 172.21.15.50:0/1927466878 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff0c8104e70 0x7ff0c80759f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:22:59.671 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:59.667+0000 7ff0c7400640 1 --2- 172.21.15.50:0/1927466878 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff0c8103450 0x7ff0c8076bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:22:59.671 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:59.667+0000 7ff0c6a00640 1 -- 172.21.15.50:0/1927466878 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff0c8104e70 msgr2=0x7ff0c80759f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:22:59.671 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:59.667+0000 7ff0c6a00640 1 --2- 172.21.15.50:0/1927466878 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff0c8104e70 0x7ff0c80759f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:59.671 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:59.667+0000 7ff0c6a00640 1 -- 172.21.15.50:0/1927466878 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff0c8103450 msgr2=0x7ff0c8076bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:22:59.671 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:59.667+0000 7ff0c6a00640 1 --2- 172.21.15.50:0/1927466878 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff0c8103450 0x7ff0c8076bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:22:59.672 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:59.667+0000 7ff0c6a00640 1 -- 172.21.15.50:0/1927466878 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0c8076120 con 0x7ff0c81044d0 2024-08-31T04:22:59.672 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:59.667+0000 7ff0c6a00640 1 --2- 172.21.15.50:0/1927466878 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff0c81044d0 0x7ff0c80754b0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7ff0b400e9f0 tx=0x7ff0b400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:22:59.672 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:59.667+0000 7ff0bfe00640 1 -- 172.21.15.50:0/1927466878 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0b400cd80 con 0x7ff0c81044d0 2024-08-31T04:22:59.672 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:59.668+0000 7ff0bfe00640 1 -- 172.21.15.50:0/1927466878 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff0b40054d0 con 0x7ff0c81044d0 2024-08-31T04:22:59.672 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:59.668+0000 7ff0ce400640 1 -- 172.21.15.50:0/1927466878 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff0c81a3d20 con 0x7ff0c81044d0 2024-08-31T04:22:59.672 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:59.668+0000 7ff0bfe00640 1 -- 172.21.15.50:0/1927466878 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0b4010690 con 0x7ff0c81044d0 2024-08-31T04:22:59.672 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:59.668+0000 7ff0ce400640 1 -- 172.21.15.50:0/1927466878 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff0c81a4190 con 0x7ff0c81044d0 2024-08-31T04:22:59.672 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:59.669+0000 7ff0ce400640 1 -- 172.21.15.50:0/1927466878 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff0c810a600 con 0x7ff0c81044d0 2024-08-31T04:22:59.674 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:59.673+0000 7ff0bfe00640 1 -- 172.21.15.50:0/1927466878 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 18) ==== 152577+0+0 (secure 0 0 0) 0x7ff0b4004e30 con 0x7ff0c81044d0 2024-08-31T04:22:59.675 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:59.674+0000 7ff0bfe00640 1 --2- 172.21.15.50:0/1927466878 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7ff0ac0b4bb0 0x7ff0ac0b70c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:22:59.675 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:59.674+0000 7ff0bfe00640 1 -- 172.21.15.50:0/1927466878 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8219+0+0 (secure 0 0 0) 0x7ff0b40e5720 con 0x7ff0c81044d0 2024-08-31T04:22:59.675 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:59.674+0000 7ff0c7400640 1 --2- 172.21.15.50:0/1927466878 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7ff0ac0b4bb0 0x7ff0ac0b70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:22:59.676 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:59.675+0000 7ff0c7400640 1 --2- 172.21.15.50:0/1927466878 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7ff0ac0b4bb0 0x7ff0ac0b70c0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7ff0b8009bd0 tx=0x7ff0b8005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:22:59.678 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:59.677+0000 7ff0bfe00640 1 -- 172.21.15.50:0/1927466878 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7ff0b4056130 con 0x7ff0c81044d0 2024-08-31T04:22:59.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:22:59 smithi050 ceph-mon[17259]: pgmap v369: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 10 op/s 2024-08-31T04:22:59.912 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:22:59.911+0000 7ff0ce400640 1 -- 172.21.15.50:0/1927466878 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"} v 0) -- 0x7ff0c802e430 con 0x7ff0c81044d0 2024-08-31T04:22:59.996 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:22:59 smithi177 ceph-mon[22025]: pgmap v369: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 10 op/s 2024-08-31T04:23:00.043 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:22:59 smithi133 ceph-mon[22177]: pgmap v369: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 10 op/s 2024-08-31T04:23:00.584 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:00.583+0000 7ff0bfe00640 1 -- 172.21.15.50:0/1927466878 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]=0 v29) ==== 117+0+0 (secure 0 0 0) 0x7ff0b40ac800 con 0x7ff0c81044d0 2024-08-31T04:23:00.586 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:00.585+0000 7ff0ce400640 1 -- 172.21.15.50:0/1927466878 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7ff0ac0b4bb0 msgr2=0x7ff0ac0b70c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:23:00.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:00.585+0000 7ff0ce400640 1 --2- 172.21.15.50:0/1927466878 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7ff0ac0b4bb0 0x7ff0ac0b70c0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7ff0b8009bd0 tx=0x7ff0b8005f90 comp rx=0 tx=0).stop 2024-08-31T04:23:00.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:00.585+0000 7ff0ce400640 1 -- 172.21.15.50:0/1927466878 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff0c81044d0 msgr2=0x7ff0c80754b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:23:00.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:00.585+0000 7ff0ce400640 1 --2- 172.21.15.50:0/1927466878 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff0c81044d0 0x7ff0c80754b0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7ff0b400e9f0 tx=0x7ff0b400edf0 comp rx=0 tx=0).stop 2024-08-31T04:23:00.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:00.585+0000 7ff0ce400640 1 -- 172.21.15.50:0/1927466878 shutdown_connections 2024-08-31T04:23:00.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:00.585+0000 7ff0ce400640 1 --2- 172.21.15.50:0/1927466878 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7ff0ac0b4bb0 0x7ff0ac0b70c0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:00.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:00.585+0000 7ff0ce400640 1 --2- 172.21.15.50:0/1927466878 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff0c8104e70 0x7ff0c80759f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:00.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:00.585+0000 7ff0ce400640 1 --2- 172.21.15.50:0/1927466878 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff0c81044d0 0x7ff0c80754b0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:00.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:00.585+0000 7ff0ce400640 1 --2- 172.21.15.50:0/1927466878 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff0c8103450 0x7ff0c8076bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:00.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:00.585+0000 7ff0ce400640 1 -- 172.21.15.50:0/1927466878 >> 172.21.15.50:0/1927466878 conn(0x7ff0c80fed90 msgr2=0x7ff0c81077d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:23:00.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:00.585+0000 7ff0ce400640 1 -- 172.21.15.50:0/1927466878 shutdown_connections 2024-08-31T04:23:00.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:00.585+0000 7ff0ce400640 1 -- 172.21.15.50:0/1927466878 wait complete. 2024-08-31T04:23:00.615 INFO:teuthology.run_tasks:Running task check-counter... 2024-08-31T04:23:00.626 INFO:teuthology.run_tasks:Running task background_exec... 2024-08-31T04:23:00.665 INFO:teuthology.task.background_exec:Running background command on role mon.a host ubuntu@smithi050.front.sepia.ceph.com 2024-08-31T04:23:00.666 DEBUG:teuthology.orchestra.run.smithi050:> sudo TESTDIR=/home/ubuntu/cephtest daemon-helper kill --kill-group bash -c 'while sleep 13; do ceph tell mds.cephfs:0 flush journal; done' 2024-08-31T04:23:00.670 INFO:teuthology.run_tasks:Running task quiescer... 2024-08-31T04:23:00.723 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-08-31T04:23:00.723 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 058d9fc6-674f-11ef-bcd4-c7b262605968 -- ceph pg dump --format=json 2024-08-31T04:23:00.935 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:23:00 smithi177 ceph-mon[22025]: from='client.? 172.21.15.50:0/1927466878' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"} : dispatch 2024-08-31T04:23:00.936 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:23:00 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T04:23:00.948 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:23:00 smithi133 ceph-mon[22177]: from='client.? 172.21.15.50:0/1927466878' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"} : dispatch 2024-08-31T04:23:00.948 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:23:00 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T04:23:00.949 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:23:00 smithi050 ceph-mon[17259]: from='client.? 172.21.15.50:0/1927466878' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"} : dispatch 2024-08-31T04:23:00.950 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:23:00 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T04:23:01.140 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:23:01.821 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:01.819+0000 7f112e000640 1 -- 172.21.15.50:0/3209531417 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f112810b470 msgr2=0x7f112810b880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:23:01.821 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:01.819+0000 7f112e000640 1 --2- 172.21.15.50:0/3209531417 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f112810b470 0x7f112810b880 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f1114009900 tx=0x7f111402a3f0 comp rx=0 tx=0).stop 2024-08-31T04:23:01.821 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:01.819+0000 7f112e000640 1 -- 172.21.15.50:0/3209531417 shutdown_connections 2024-08-31T04:23:01.821 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:01.819+0000 7f112e000640 1 --2- 172.21.15.50:0/3209531417 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f112810bdc0 0x7f11281125f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:01.821 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:01.819+0000 7f112e000640 1 --2- 172.21.15.50:0/3209531417 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f112810b470 0x7f112810b880 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:01.821 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:01.819+0000 7f112e000640 1 --2- 172.21.15.50:0/3209531417 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1128105b30 0x7f1128105f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:01.822 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:01.819+0000 7f112e000640 1 -- 172.21.15.50:0/3209531417 >> 172.21.15.50:0/3209531417 conn(0x7f1128101600 msgr2=0x7f1128103a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:23:01.822 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:01.819+0000 7f112e000640 1 -- 172.21.15.50:0/3209531417 shutdown_connections 2024-08-31T04:23:01.822 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:01.819+0000 7f112e000640 1 -- 172.21.15.50:0/3209531417 wait complete. 2024-08-31T04:23:01.822 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:01.820+0000 7f112e000640 1 Processor -- start 2024-08-31T04:23:01.823 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:01.821+0000 7f112e000640 1 -- start start 2024-08-31T04:23:01.823 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:01.821+0000 7f112e000640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1128105b30 0x7f112810fa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:01.823 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:01.821+0000 7f112e000640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f112810b470 0x7f112810ffc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:01.823 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:01.821+0000 7f112e000640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f112810bdc0 0x7f1128110500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:01.823 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:01.821+0000 7f112e000640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f1128115a80 con 0x7f112810b470 2024-08-31T04:23:01.823 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:01.821+0000 7f112e000640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f1128115900 con 0x7f112810bdc0 2024-08-31T04:23:01.823 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:01.821+0000 7f112e000640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f1128115c00 con 0x7f1128105b30 2024-08-31T04:23:01.823 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:01.821+0000 7f1127400640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1128105b30 0x7f112810fa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:01.824 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:01.822+0000 7f1127400640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1128105b30 0x7f112810fa80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.50:39296/0 (socket says 172.21.15.50:39296) 2024-08-31T04:23:01.824 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:01.822+0000 7f1127400640 1 -- 172.21.15.50:0/2369290176 learned_addr learned my addr 172.21.15.50:0/2369290176 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:23:01.824 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:01.822+0000 7f1126a00640 1 --2- 172.21.15.50:0/2369290176 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f112810b470 0x7f112810ffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:01.824 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:01.822+0000 7f1127e00640 1 --2- 172.21.15.50:0/2369290176 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f112810bdc0 0x7f1128110500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:01.824 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:01.822+0000 7f1127400640 1 -- 172.21.15.50:0/2369290176 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f112810bdc0 msgr2=0x7f1128110500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:23:01.824 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:01.822+0000 7f1127400640 1 --2- 172.21.15.50:0/2369290176 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f112810bdc0 0x7f1128110500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:01.825 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:01.822+0000 7f1127400640 1 -- 172.21.15.50:0/2369290176 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f112810b470 msgr2=0x7f112810ffc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:23:01.825 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:01.822+0000 7f1127400640 1 --2- 172.21.15.50:0/2369290176 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f112810b470 0x7f112810ffc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:01.825 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:01.822+0000 7f1127400640 1 -- 172.21.15.50:0/2369290176 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11281ac8c0 con 0x7f1128105b30 2024-08-31T04:23:01.825 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:01.823+0000 7f1127400640 1 --2- 172.21.15.50:0/2369290176 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1128105b30 0x7f112810fa80 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f111800e9f0 tx=0x7f111800eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:23:01.825 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:01.823+0000 7f111fe00640 1 -- 172.21.15.50:0/2369290176 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f111800cd80 con 0x7f1128105b30 2024-08-31T04:23:01.825 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:01.823+0000 7f111fe00640 1 -- 172.21.15.50:0/2369290176 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f11180108e0 con 0x7f1128105b30 2024-08-31T04:23:01.825 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:01.823+0000 7f111fe00640 1 -- 172.21.15.50:0/2369290176 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1118018980 con 0x7f1128105b30 2024-08-31T04:23:01.825 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:01.823+0000 7f112e000640 1 -- 172.21.15.50:0/2369290176 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f11281acbb0 con 0x7f1128105b30 2024-08-31T04:23:01.825 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:01.823+0000 7f112e000640 1 -- 172.21.15.50:0/2369290176 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f11281ad070 con 0x7f1128105b30 2024-08-31T04:23:01.826 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:01.825+0000 7f112e000640 1 -- 172.21.15.50:0/2369290176 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1128105f40 con 0x7f1128105b30 2024-08-31T04:23:01.828 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:01.827+0000 7f111fe00640 1 -- 172.21.15.50:0/2369290176 <== mon.1 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 18) ==== 152577+0+0 (secure 0 0 0) 0x7f1118010430 con 0x7f1128105b30 2024-08-31T04:23:01.829 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:01.828+0000 7f111fe00640 1 --2- 172.21.15.50:0/2369290176 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f110c0b4bb0 0x7f110c0b70c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:01.830 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:01.828+0000 7f111fe00640 1 -- 172.21.15.50:0/2369290176 <== mon.1 v2:172.21.15.177:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8219+0+0 (secure 0 0 0) 0x7f11180e5410 con 0x7f1128105b30 2024-08-31T04:23:01.830 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:01.828+0000 7f1126a00640 1 --2- 172.21.15.50:0/2369290176 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f110c0b4bb0 0x7f110c0b70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:01.830 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:01.829+0000 7f1126a00640 1 --2- 172.21.15.50:0/2369290176 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f110c0b4bb0 0x7f110c0b70c0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f1114009230 tx=0x7f1114031400 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:23:01.833 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:01.832+0000 7f111fe00640 1 -- 172.21.15.50:0/2369290176 <== mon.1 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f11180abea0 con 0x7f1128105b30 2024-08-31T04:23:01.950 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:23:01 smithi050 ceph-mon[17259]: pgmap v370: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 85 B/s wr, 8 op/s 2024-08-31T04:23:01.950 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:23:01 smithi050 ceph-mon[17259]: from='client.? 172.21.15.50:0/1927466878' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]': finished 2024-08-31T04:23:01.950 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:23:01 smithi050 ceph-mon[17259]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-31T04:23:01.950 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:23:01 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:23:01.950 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:23:01 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:23:01.996 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:23:01 smithi177 ceph-mon[22025]: pgmap v370: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 85 B/s wr, 8 op/s 2024-08-31T04:23:01.996 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:23:01 smithi177 ceph-mon[22025]: from='client.? 172.21.15.50:0/1927466878' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]': finished 2024-08-31T04:23:01.996 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:23:01 smithi177 ceph-mon[22025]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-31T04:23:01.996 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:23:01 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:23:01.996 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:23:01 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:23:02.038 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:02.037+0000 7f112e000640 1 -- 172.21.15.50:0/2369290176 --> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f11280635a0 con 0x7f110c0b4bb0 2024-08-31T04:23:02.042 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:23:01 smithi133 ceph-mon[22177]: pgmap v370: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 85 B/s wr, 8 op/s 2024-08-31T04:23:02.042 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:23:01 smithi133 ceph-mon[22177]: from='client.? 172.21.15.50:0/1927466878' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]': finished 2024-08-31T04:23:02.043 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:23:01 smithi133 ceph-mon[22177]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-31T04:23:02.043 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:23:01 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:23:02.043 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:23:01 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:23:02.044 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:02.043+0000 7f111fe00640 1 -- 172.21.15.50:0/2369290176 <== mgr.14150 v2:172.21.15.50:6800/2146686622 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258978 (secure 0 0 0) 0x7f11280635a0 con 0x7f110c0b4bb0 2024-08-31T04:23:02.047 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-08-31T04:23:02.048 INFO:teuthology.orchestra.run.smithi050.stderr:dumped all 2024-08-31T04:23:02.050 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:02.048+0000 7f112e000640 1 -- 172.21.15.50:0/2369290176 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f110c0b4bb0 msgr2=0x7f110c0b70c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:23:02.050 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:02.048+0000 7f112e000640 1 --2- 172.21.15.50:0/2369290176 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f110c0b4bb0 0x7f110c0b70c0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f1114009230 tx=0x7f1114031400 comp rx=0 tx=0).stop 2024-08-31T04:23:02.050 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:02.048+0000 7f112e000640 1 -- 172.21.15.50:0/2369290176 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1128105b30 msgr2=0x7f112810fa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:23:02.050 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:02.048+0000 7f112e000640 1 --2- 172.21.15.50:0/2369290176 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1128105b30 0x7f112810fa80 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f111800e9f0 tx=0x7f111800eeb0 comp rx=0 tx=0).stop 2024-08-31T04:23:02.050 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:02.048+0000 7f112e000640 1 -- 172.21.15.50:0/2369290176 shutdown_connections 2024-08-31T04:23:02.050 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:02.048+0000 7f112e000640 1 --2- 172.21.15.50:0/2369290176 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f110c0b4bb0 0x7f110c0b70c0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:02.050 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:02.048+0000 7f112e000640 1 --2- 172.21.15.50:0/2369290176 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f112810bdc0 0x7f1128110500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:02.050 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:02.048+0000 7f112e000640 1 --2- 172.21.15.50:0/2369290176 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f112810b470 0x7f112810ffc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:02.050 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:02.048+0000 7f112e000640 1 --2- 172.21.15.50:0/2369290176 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1128105b30 0x7f112810fa80 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:02.050 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:02.048+0000 7f112e000640 1 -- 172.21.15.50:0/2369290176 >> 172.21.15.50:0/2369290176 conn(0x7f1128101600 msgr2=0x7f1128103a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:23:02.050 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:02.048+0000 7f112e000640 1 -- 172.21.15.50:0/2369290176 shutdown_connections 2024-08-31T04:23:02.050 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:02.048+0000 7f112e000640 1 -- 172.21.15.50:0/2369290176 wait complete. 2024-08-31T04:23:03.043 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:23:02 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:23:03.043 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:23:02 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:23:03.043 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:23:02 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:23:03.043 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:23:02 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:23:03.043 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:23:02 smithi133 ceph-mon[22177]: pgmap v371: 97 pgs: 97 active+clean; 649 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 938 B/s wr, 12 op/s 2024-08-31T04:23:03.043 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:23:02 smithi133 ceph-mon[22177]: from='client.25300 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-31T04:23:03.200 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:23:02 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:23:03.200 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:23:02 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:23:03.200 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:23:02 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:23:03.200 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:23:02 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:23:03.201 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:23:02 smithi050 ceph-mon[17259]: pgmap v371: 97 pgs: 97 active+clean; 649 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 938 B/s wr, 12 op/s 2024-08-31T04:23:03.201 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:23:02 smithi050 ceph-mon[17259]: from='client.25300 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-31T04:23:03.246 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:23:02 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:23:03.246 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:23:02 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:23:03.246 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:23:02 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:23:03.246 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:23:02 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:23:03.246 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:23:02 smithi177 ceph-mon[22025]: pgmap v371: 97 pgs: 97 active+clean; 649 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 938 B/s wr, 12 op/s 2024-08-31T04:23:03.246 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:23:02 smithi177 ceph-mon[22025]: from='client.25300 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-31T04:23:03.524 INFO:teuthology.orchestra.run.smithi050.stdout:{"pg_ready":true,"pg_map":{"version":371,"stamp":"2024-08-31T04:23:01.885121+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":664626,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":1312,"num_read_kb":758,"num_write":390,"num_write_kb":2308,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":2952462,"num_keys_recovered":10,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":822,"ondisk_log_size":822,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":359764,"kb_used_data":10516,"kb_used_omap":18,"kb_used_meta":349037,"kb_avail":1124582060,"statfs":{"total":1151940427776,"available":1151572029440,"internally_reserved":0,"allocated":10768384,"data_stored":6927697,"data_compressed":109023,"data_compressed_allocated":135168,"data_compressed_original":1769472,"omap_allocated":19143,"internal_metadata":357414201},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":5995,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":146,"num_read_kb":71,"num_write":7,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003396"},"pg_stats":[{"pgid":"3.3f","version":"78'8","reported_seq":30,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:22:26.271328+0000","last_change":"2024-08-31T04:20:42.949771+0000","last_active":"2024-08-31T04:22:26.271328+0000","last_peered":"2024-08-31T04:22:26.271328+0000","last_clean":"2024-08-31T04:22:26.271328+0000","last_became_active":"2024-08-31T04:20:42.949372+0000","last_became_peered":"2024-08-31T04:20:42.949372+0000","last_unstale":"2024-08-31T04:22:26.271328+0000","last_undegraded":"2024-08-31T04:22:26.271328+0000","last_fullsized":"2024-08-31T04:22:26.271328+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:16:50.036191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"78'4","reported_seq":26,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:22:26.253427+0000","last_change":"2024-08-31T04:20:42.949805+0000","last_active":"2024-08-31T04:22:26.253427+0000","last_peered":"2024-08-31T04:22:26.253427+0000","last_clean":"2024-08-31T04:22:26.253427+0000","last_became_active":"2024-08-31T04:20:42.948015+0000","last_became_peered":"2024-08-31T04:20:42.948015+0000","last_unstale":"2024-08-31T04:22:26.253427+0000","last_undegraded":"2024-08-31T04:22:26.253427+0000","last_fullsized":"2024-08-31T04:22:26.253427+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:25:47.432785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"78'7","reported_seq":29,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:22:26.262935+0000","last_change":"2024-08-31T04:20:42.949114+0000","last_active":"2024-08-31T04:22:26.262935+0000","last_peered":"2024-08-31T04:22:26.262935+0000","last_clean":"2024-08-31T04:22:26.262935+0000","last_became_active":"2024-08-31T04:20:42.946763+0000","last_became_peered":"2024-08-31T04:20:42.946763+0000","last_unstale":"2024-08-31T04:22:26.262935+0000","last_undegraded":"2024-08-31T04:22:26.262935+0000","last_fullsized":"2024-08-31T04:22:26.262935+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:33:55.605617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"78'8","reported_seq":30,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:22:26.248677+0000","last_change":"2024-08-31T04:20:42.935026+0000","last_active":"2024-08-31T04:22:26.248677+0000","last_peered":"2024-08-31T04:22:26.248677+0000","last_clean":"2024-08-31T04:22:26.248677+0000","last_became_active":"2024-08-31T04:20:42.934534+0000","last_became_peered":"2024-08-31T04:20:42.934534+0000","last_unstale":"2024-08-31T04:22:26.248677+0000","last_undegraded":"2024-08-31T04:22:26.248677+0000","last_fullsized":"2024-08-31T04:22:26.248677+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:33:41.014920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"78'4","reported_seq":25,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:22:26.252143+0000","last_change":"2024-08-31T04:20:42.939114+0000","last_active":"2024-08-31T04:22:26.252143+0000","last_peered":"2024-08-31T04:22:26.252143+0000","last_clean":"2024-08-31T04:22:26.252143+0000","last_became_active":"2024-08-31T04:20:42.938710+0000","last_became_peered":"2024-08-31T04:20:42.938710+0000","last_unstale":"2024-08-31T04:22:26.252143+0000","last_undegraded":"2024-08-31T04:22:26.252143+0000","last_fullsized":"2024-08-31T04:22:26.252143+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:42:25.561258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"78'6","reported_seq":27,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:22:26.255233+0000","last_change":"2024-08-31T04:20:42.935958+0000","last_active":"2024-08-31T04:22:26.255233+0000","last_peered":"2024-08-31T04:22:26.255233+0000","last_clean":"2024-08-31T04:22:26.255233+0000","last_became_active":"2024-08-31T04:20:42.934865+0000","last_became_peered":"2024-08-31T04:20:42.934865+0000","last_unstale":"2024-08-31T04:22:26.255233+0000","last_undegraded":"2024-08-31T04:22:26.255233+0000","last_fullsized":"2024-08-31T04:22:26.255233+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:28:20.330784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"78'5","reported_seq":26,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:22:26.256030+0000","last_change":"2024-08-31T04:20:42.932639+0000","last_active":"2024-08-31T04:22:26.256030+0000","last_peered":"2024-08-31T04:22:26.256030+0000","last_clean":"2024-08-31T04:22:26.256030+0000","last_became_active":"2024-08-31T04:20:42.932238+0000","last_became_peered":"2024-08-31T04:20:42.932238+0000","last_unstale":"2024-08-31T04:22:26.256030+0000","last_undegraded":"2024-08-31T04:22:26.256030+0000","last_fullsized":"2024-08-31T04:22:26.256030+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T04:47:32.128675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"78'9","reported_seq":30,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:22:26.253126+0000","last_change":"2024-08-31T04:20:42.941700+0000","last_active":"2024-08-31T04:22:26.253126+0000","last_peered":"2024-08-31T04:22:26.253126+0000","last_clean":"2024-08-31T04:22:26.253126+0000","last_became_active":"2024-08-31T04:20:42.941308+0000","last_became_peered":"2024-08-31T04:20:42.941308+0000","last_unstale":"2024-08-31T04:22:26.253126+0000","last_undegraded":"2024-08-31T04:22:26.253126+0000","last_fullsized":"2024-08-31T04:22:26.253126+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:35:06.058492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"78'11","reported_seq":32,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:22:26.263740+0000","last_change":"2024-08-31T04:20:42.935528+0000","last_active":"2024-08-31T04:22:26.263740+0000","last_peered":"2024-08-31T04:22:26.263740+0000","last_clean":"2024-08-31T04:22:26.263740+0000","last_became_active":"2024-08-31T04:20:42.933736+0000","last_became_peered":"2024-08-31T04:20:42.933736+0000","last_unstale":"2024-08-31T04:22:26.263740+0000","last_undegraded":"2024-08-31T04:22:26.263740+0000","last_fullsized":"2024-08-31T04:22:26.263740+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:12:47.877285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"78'16","reported_seq":44,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:22:26.259552+0000","last_change":"2024-08-31T04:20:57.006683+0000","last_active":"2024-08-31T04:22:26.259552+0000","last_peered":"2024-08-31T04:22:26.259552+0000","last_clean":"2024-08-31T04:22:26.259552+0000","last_became_active":"2024-08-31T04:20:57.006166+0000","last_became_peered":"2024-08-31T04:20:57.006166+0000","last_unstale":"2024-08-31T04:22:26.259552+0000","last_undegraded":"2024-08-31T04:22:26.259552+0000","last_fullsized":"2024-08-31T04:22:26.259552+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:33:23.377991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,9],"acting":[10,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"78'6","reported_seq":27,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:22:26.257964+0000","last_change":"2024-08-31T04:20:42.939489+0000","last_active":"2024-08-31T04:22:26.257964+0000","last_peered":"2024-08-31T04:22:26.257964+0000","last_clean":"2024-08-31T04:22:26.257964+0000","last_became_active":"2024-08-31T04:20:42.939138+0000","last_became_peered":"2024-08-31T04:20:42.939138+0000","last_unstale":"2024-08-31T04:22:26.257964+0000","last_undegraded":"2024-08-31T04:22:26.257964+0000","last_fullsized":"2024-08-31T04:22:26.257964+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T05:00:30.196513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"78'7","reported_seq":28,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:22:26.249896+0000","last_change":"2024-08-31T04:20:42.941483+0000","last_active":"2024-08-31T04:22:26.249896+0000","last_peered":"2024-08-31T04:22:26.249896+0000","last_clean":"2024-08-31T04:22:26.249896+0000","last_became_active":"2024-08-31T04:20:42.940200+0000","last_became_peered":"2024-08-31T04:20:42.940200+0000","last_unstale":"2024-08-31T04:22:26.249896+0000","last_undegraded":"2024-08-31T04:22:26.249896+0000","last_fullsized":"2024-08-31T04:22:26.249896+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:40:45.235093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"78'10","reported_seq":31,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:22:26.246851+0000","last_change":"2024-08-31T04:20:42.928803+0000","last_active":"2024-08-31T04:22:26.246851+0000","last_peered":"2024-08-31T04:22:26.246851+0000","last_clean":"2024-08-31T04:22:26.246851+0000","last_became_active":"2024-08-31T04:20:42.928410+0000","last_became_peered":"2024-08-31T04:20:42.928410+0000","last_unstale":"2024-08-31T04:22:26.246851+0000","last_undegraded":"2024-08-31T04:22:26.246851+0000","last_fullsized":"2024-08-31T04:22:26.246851+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T04:24:41.811202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"78'7","reported_seq":28,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:22:26.258995+0000","last_change":"2024-08-31T04:20:42.945142+0000","last_active":"2024-08-31T04:22:26.258995+0000","last_peered":"2024-08-31T04:22:26.258995+0000","last_clean":"2024-08-31T04:22:26.258995+0000","last_became_active":"2024-08-31T04:20:42.944061+0000","last_became_peered":"2024-08-31T04:20:42.944061+0000","last_unstale":"2024-08-31T04:22:26.258995+0000","last_undegraded":"2024-08-31T04:22:26.258995+0000","last_fullsized":"2024-08-31T04:22:26.258995+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:55:09.045257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"78'7","reported_seq":28,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:22:26.258595+0000","last_change":"2024-08-31T04:20:42.945844+0000","last_active":"2024-08-31T04:22:26.258595+0000","last_peered":"2024-08-31T04:22:26.258595+0000","last_clean":"2024-08-31T04:22:26.258595+0000","last_became_active":"2024-08-31T04:20:42.944186+0000","last_became_peered":"2024-08-31T04:20:42.944186+0000","last_unstale":"2024-08-31T04:22:26.258595+0000","last_undegraded":"2024-08-31T04:22:26.258595+0000","last_fullsized":"2024-08-31T04:22:26.258595+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:32:46.878700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"78'9","reported_seq":30,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:22:26.263868+0000","last_change":"2024-08-31T04:20:42.952871+0000","last_active":"2024-08-31T04:22:26.263868+0000","last_peered":"2024-08-31T04:22:26.263868+0000","last_clean":"2024-08-31T04:22:26.263868+0000","last_became_active":"2024-08-31T04:20:42.952531+0000","last_became_peered":"2024-08-31T04:20:42.952531+0000","last_unstale":"2024-08-31T04:22:26.263868+0000","last_undegraded":"2024-08-31T04:22:26.263868+0000","last_fullsized":"2024-08-31T04:22:26.263868+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:26:01.690119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"78'8","reported_seq":29,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:22:26.271481+0000","last_change":"2024-08-31T04:20:42.949822+0000","last_active":"2024-08-31T04:22:26.271481+0000","last_peered":"2024-08-31T04:22:26.271481+0000","last_clean":"2024-08-31T04:22:26.271481+0000","last_became_active":"2024-08-31T04:20:42.949443+0000","last_became_peered":"2024-08-31T04:20:42.949443+0000","last_unstale":"2024-08-31T04:22:26.271481+0000","last_undegraded":"2024-08-31T04:22:26.271481+0000","last_fullsized":"2024-08-31T04:22:26.271481+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:35:48.270606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"78'10","reported_seq":31,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:22:26.260870+0000","last_change":"2024-08-31T04:20:42.940895+0000","last_active":"2024-08-31T04:22:26.260870+0000","last_peered":"2024-08-31T04:22:26.260870+0000","last_clean":"2024-08-31T04:22:26.260870+0000","last_became_active":"2024-08-31T04:20:42.940489+0000","last_became_peered":"2024-08-31T04:20:42.940489+0000","last_unstale":"2024-08-31T04:22:26.260870+0000","last_undegraded":"2024-08-31T04:22:26.260870+0000","last_fullsized":"2024-08-31T04:22:26.260870+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T04:42:20.269895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"78'7","reported_seq":29,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:22:26.254453+0000","last_change":"2024-08-31T04:20:42.935303+0000","last_active":"2024-08-31T04:22:26.254453+0000","last_peered":"2024-08-31T04:22:26.254453+0000","last_clean":"2024-08-31T04:22:26.254453+0000","last_became_active":"2024-08-31T04:20:42.934931+0000","last_became_peered":"2024-08-31T04:20:42.934931+0000","last_unstale":"2024-08-31T04:22:26.254453+0000","last_undegraded":"2024-08-31T04:22:26.254453+0000","last_fullsized":"2024-08-31T04:22:26.254453+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:34:40.767333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"78'8","reported_seq":30,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:22:26.257067+0000","last_change":"2024-08-31T04:20:42.941518+0000","last_active":"2024-08-31T04:22:26.257067+0000","last_peered":"2024-08-31T04:22:26.257067+0000","last_clean":"2024-08-31T04:22:26.257067+0000","last_became_active":"2024-08-31T04:20:42.941142+0000","last_became_peered":"2024-08-31T04:20:42.941142+0000","last_unstale":"2024-08-31T04:22:26.257067+0000","last_undegraded":"2024-08-31T04:22:26.257067+0000","last_fullsized":"2024-08-31T04:22:26.257067+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:27:50.274057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"78'11","reported_seq":33,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:22:26.256826+0000","last_change":"2024-08-31T04:20:42.945136+0000","last_active":"2024-08-31T04:22:26.256826+0000","last_peered":"2024-08-31T04:22:26.256826+0000","last_clean":"2024-08-31T04:22:26.256826+0000","last_became_active":"2024-08-31T04:20:42.944811+0000","last_became_peered":"2024-08-31T04:20:42.944811+0000","last_unstale":"2024-08-31T04:22:26.256826+0000","last_undegraded":"2024-08-31T04:22:26.256826+0000","last_fullsized":"2024-08-31T04:22:26.256826+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:30:47.496668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"78'10","reported_seq":32,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:22:26.264249+0000","last_change":"2024-08-31T04:20:42.930854+0000","last_active":"2024-08-31T04:22:26.264249+0000","last_peered":"2024-08-31T04:22:26.264249+0000","last_clean":"2024-08-31T04:22:26.264249+0000","last_became_active":"2024-08-31T04:20:42.930490+0000","last_became_peered":"2024-08-31T04:20:42.930490+0000","last_unstale":"2024-08-31T04:22:26.264249+0000","last_undegraded":"2024-08-31T04:22:26.264249+0000","last_fullsized":"2024-08-31T04:22:26.264249+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:16:17.611414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"78'8","reported_seq":20,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:22:26.252604+0000","last_change":"2024-08-31T04:20:57.008738+0000","last_active":"2024-08-31T04:22:26.252604+0000","last_peered":"2024-08-31T04:22:26.252604+0000","last_clean":"2024-08-31T04:22:26.252604+0000","last_became_active":"2024-08-31T04:20:57.008209+0000","last_became_peered":"2024-08-31T04:20:57.008209+0000","last_unstale":"2024-08-31T04:22:26.252604+0000","last_undegraded":"2024-08-31T04:22:26.252604+0000","last_fullsized":"2024-08-31T04:22:26.252604+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T05:26:22.508955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,11],"acting":[9,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.28","version":"78'6","reported_seq":28,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:22:26.252980+0000","last_change":"2024-08-31T04:20:42.939859+0000","last_active":"2024-08-31T04:22:26.252980+0000","last_peered":"2024-08-31T04:22:26.252980+0000","last_clean":"2024-08-31T04:22:26.252980+0000","last_became_active":"2024-08-31T04:20:42.938315+0000","last_became_peered":"2024-08-31T04:20:42.938315+0000","last_unstale":"2024-08-31T04:22:26.252980+0000","last_undegraded":"2024-08-31T04:22:26.252980+0000","last_fullsized":"2024-08-31T04:22:26.252980+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:13:00.906454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"78'2","reported_seq":24,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:22:26.251738+0000","last_change":"2024-08-31T04:20:42.941861+0000","last_active":"2024-08-31T04:22:26.251738+0000","last_peered":"2024-08-31T04:22:26.251738+0000","last_clean":"2024-08-31T04:22:26.251738+0000","last_became_active":"2024-08-31T04:20:42.939556+0000","last_became_peered":"2024-08-31T04:20:42.939556+0000","last_unstale":"2024-08-31T04:22:26.251738+0000","last_undegraded":"2024-08-31T04:22:26.251738+0000","last_fullsized":"2024-08-31T04:22:26.251738+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:02:53.900917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"78'15","reported_seq":37,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:22:26.252502+0000","last_change":"2024-08-31T04:20:42.930792+0000","last_active":"2024-08-31T04:22:26.252502+0000","last_peered":"2024-08-31T04:22:26.252502+0000","last_clean":"2024-08-31T04:22:26.252502+0000","last_became_active":"2024-08-31T04:20:42.930014+0000","last_became_peered":"2024-08-31T04:20:42.930014+0000","last_unstale":"2024-08-31T04:22:26.252502+0000","last_undegraded":"2024-08-31T04:22:26.252502+0000","last_fullsized":"2024-08-31T04:22:26.252502+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:18:26.942604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"78'6","reported_seq":35,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:22:26.252980+0000","last_change":"2024-08-31T04:20:57.010093+0000","last_active":"2024-08-31T04:22:26.252980+0000","last_peered":"2024-08-31T04:22:26.252980+0000","last_clean":"2024-08-31T04:22:26.252980+0000","last_became_active":"2024-08-31T04:20:57.008759+0000","last_became_peered":"2024-08-31T04:20:57.008759+0000","last_unstale":"2024-08-31T04:22:26.252980+0000","last_undegraded":"2024-08-31T04:22:26.252980+0000","last_fullsized":"2024-08-31T04:22:26.252980+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T06:55:38.276668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,9],"acting":[11,8,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"78'4","reported_seq":26,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:22:26.255417+0000","last_change":"2024-08-31T04:20:42.953378+0000","last_active":"2024-08-31T04:22:26.255417+0000","last_peered":"2024-08-31T04:22:26.255417+0000","last_clean":"2024-08-31T04:22:26.255417+0000","last_became_active":"2024-08-31T04:20:42.953030+0000","last_became_peered":"2024-08-31T04:20:42.953030+0000","last_unstale":"2024-08-31T04:22:26.255417+0000","last_undegraded":"2024-08-31T04:22:26.255417+0000","last_fullsized":"2024-08-31T04:22:26.255417+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:24:46.633234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"78'7","reported_seq":29,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:22:26.258481+0000","last_change":"2024-08-31T04:20:42.945142+0000","last_active":"2024-08-31T04:22:26.258481+0000","last_peered":"2024-08-31T04:22:26.258481+0000","last_clean":"2024-08-31T04:22:26.258481+0000","last_became_active":"2024-08-31T04:20:42.943960+0000","last_became_peered":"2024-08-31T04:20:42.943960+0000","last_unstale":"2024-08-31T04:22:26.258481+0000","last_undegraded":"2024-08-31T04:22:26.258481+0000","last_fullsized":"2024-08-31T04:22:26.258481+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T04:29:10.501940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"78'8","reported_seq":30,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:22:26.257636+0000","last_change":"2024-08-31T04:20:42.946359+0000","last_active":"2024-08-31T04:22:26.257636+0000","last_peered":"2024-08-31T04:22:26.257636+0000","last_clean":"2024-08-31T04:22:26.257636+0000","last_became_active":"2024-08-31T04:20:42.945974+0000","last_became_peered":"2024-08-31T04:20:42.945974+0000","last_unstale":"2024-08-31T04:22:26.257636+0000","last_undegraded":"2024-08-31T04:22:26.257636+0000","last_fullsized":"2024-08-31T04:22:26.257636+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:01:27.808743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"78'12","reported_seq":34,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:22:26.245311+0000","last_change":"2024-08-31T04:20:42.930989+0000","last_active":"2024-08-31T04:22:26.245311+0000","last_peered":"2024-08-31T04:22:26.245311+0000","last_clean":"2024-08-31T04:22:26.245311+0000","last_became_active":"2024-08-31T04:20:42.930610+0000","last_became_peered":"2024-08-31T04:20:42.930610+0000","last_unstale":"2024-08-31T04:22:26.245311+0000","last_undegraded":"2024-08-31T04:22:26.245311+0000","last_fullsized":"2024-08-31T04:22:26.245311+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:01:49.473735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"78'9","reported_seq":31,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:22:26.255676+0000","last_change":"2024-08-31T04:20:42.930513+0000","last_active":"2024-08-31T04:22:26.255676+0000","last_peered":"2024-08-31T04:22:26.255676+0000","last_clean":"2024-08-31T04:22:26.255676+0000","last_became_active":"2024-08-31T04:20:42.930127+0000","last_became_peered":"2024-08-31T04:20:42.930127+0000","last_unstale":"2024-08-31T04:22:26.255676+0000","last_undegraded":"2024-08-31T04:22:26.255676+0000","last_fullsized":"2024-08-31T04:22:26.255676+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T05:19:55.307816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"78'7","reported_seq":28,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:22:26.244290+0000","last_change":"2024-08-31T04:20:42.928217+0000","last_active":"2024-08-31T04:22:26.244290+0000","last_peered":"2024-08-31T04:22:26.244290+0000","last_clean":"2024-08-31T04:22:26.244290+0000","last_became_active":"2024-08-31T04:20:42.927828+0000","last_became_peered":"2024-08-31T04:20:42.927828+0000","last_unstale":"2024-08-31T04:22:26.244290+0000","last_undegraded":"2024-08-31T04:22:26.244290+0000","last_fullsized":"2024-08-31T04:22:26.244290+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:53:21.266734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"78'7","reported_seq":169,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:22:58.241300+0000","last_change":"2024-08-31T04:20:57.229930+0000","last_active":"2024-08-31T04:22:58.241300+0000","last_peered":"2024-08-31T04:22:58.241300+0000","last_clean":"2024-08-31T04:22:58.241300+0000","last_became_active":"2024-08-31T04:20:57.224761+0000","last_became_peered":"2024-08-31T04:20:57.224761+0000","last_unstale":"2024-08-31T04:22:58.241300+0000","last_undegraded":"2024-08-31T04:22:58.241300+0000","last_fullsized":"2024-08-31T04:22:58.241300+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_clean_scrub_stamp":"2024-08-31T04:20:38.871450+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:07:41.723452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1154,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":122,"num_read_kb":4,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":622,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"78'8","reported_seq":29,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:22:26.254392+0000","last_change":"2024-08-31T04:20:42.939189+0000","last_active":"2024-08-31T04:22:26.254392+0000","last_peered":"2024-08-31T04:22:26.254392+0000","last_clean":"2024-08-31T04:22:26.254392+0000","last_became_active":"2024-08-31T04:20:42.938817+0000","last_became_peered":"2024-08-31T04:20:42.938817+0000","last_unstale":"2024-08-31T04:22:26.254392+0000","last_undegraded":"2024-08-31T04:22:26.254392+0000","last_fullsized":"2024-08-31T04:22:26.254392+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:19:04.407104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"77'7","reported_seq":34,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:20:57.001432+0000","last_change":"2024-08-31T04:20:39.904392+0000","last_active":"2024-08-31T04:20:57.001432+0000","last_peered":"2024-08-31T04:20:57.001432+0000","last_clean":"2024-08-31T04:20:57.001432+0000","last_became_active":"2024-08-31T04:20:39.904014+0000","last_became_peered":"2024-08-31T04:20:39.904014+0000","last_unstale":"2024-08-31T04:20:57.001432+0000","last_undegraded":"2024-08-31T04:20:57.001432+0000","last_fullsized":"2024-08-31T04:20:57.001432+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_clean_scrub_stamp":"2024-08-31T04:20:38.871450+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:33:56.591237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"78'3","reported_seq":30,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:20:56.998239+0000","last_change":"2024-08-31T04:20:39.899521+0000","last_active":"2024-08-31T04:20:56.998239+0000","last_peered":"2024-08-31T04:20:56.998239+0000","last_clean":"2024-08-31T04:20:56.998239+0000","last_became_active":"2024-08-31T04:20:39.899157+0000","last_became_peered":"2024-08-31T04:20:39.899157+0000","last_unstale":"2024-08-31T04:20:56.998239+0000","last_undegraded":"2024-08-31T04:20:56.998239+0000","last_fullsized":"2024-08-31T04:20:56.998239+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_clean_scrub_stamp":"2024-08-31T04:20:38.871450+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:14:47.067149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"78'8","reported_seq":29,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:22:26.249334+0000","last_change":"2024-08-31T04:20:42.950653+0000","last_active":"2024-08-31T04:22:26.249334+0000","last_peered":"2024-08-31T04:22:26.249334+0000","last_clean":"2024-08-31T04:22:26.249334+0000","last_became_active":"2024-08-31T04:20:42.949627+0000","last_became_peered":"2024-08-31T04:20:42.949627+0000","last_unstale":"2024-08-31T04:22:26.249334+0000","last_undegraded":"2024-08-31T04:22:26.249334+0000","last_fullsized":"2024-08-31T04:22:26.249334+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:22:00.000717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"78'3","reported_seq":31,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:21:01.048385+0000","last_change":"2024-08-31T04:20:39.908013+0000","last_active":"2024-08-31T04:21:01.048385+0000","last_peered":"2024-08-31T04:21:01.048385+0000","last_clean":"2024-08-31T04:21:01.048385+0000","last_became_active":"2024-08-31T04:20:39.907482+0000","last_became_peered":"2024-08-31T04:20:39.907482+0000","last_unstale":"2024-08-31T04:21:01.048385+0000","last_undegraded":"2024-08-31T04:21:01.048385+0000","last_fullsized":"2024-08-31T04:21:01.048385+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_clean_scrub_stamp":"2024-08-31T04:20:38.871450+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:50:35.466407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"78'11","reported_seq":32,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:22:26.256431+0000","last_change":"2024-08-31T04:20:42.944674+0000","last_active":"2024-08-31T04:22:26.256431+0000","last_peered":"2024-08-31T04:22:26.256431+0000","last_clean":"2024-08-31T04:22:26.256431+0000","last_became_active":"2024-08-31T04:20:42.944424+0000","last_became_peered":"2024-08-31T04:20:42.944424+0000","last_unstale":"2024-08-31T04:22:26.256431+0000","last_undegraded":"2024-08-31T04:22:26.256431+0000","last_fullsized":"2024-08-31T04:22:26.256431+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:10:27.772835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"78'6","reported_seq":271,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:23:00.243510+0000","last_change":"2024-08-31T04:20:39.904188+0000","last_active":"2024-08-31T04:23:00.243510+0000","last_peered":"2024-08-31T04:23:00.243510+0000","last_clean":"2024-08-31T04:23:00.243510+0000","last_became_active":"2024-08-31T04:20:39.903789+0000","last_became_peered":"2024-08-31T04:20:39.903789+0000","last_unstale":"2024-08-31T04:23:00.243510+0000","last_undegraded":"2024-08-31T04:23:00.243510+0000","last_fullsized":"2024-08-31T04:23:00.243510+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_clean_scrub_stamp":"2024-08-31T04:20:38.871450+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T06:54:38.881746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":238,"num_read_kb":238,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"78'10","reported_seq":31,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:22:26.260698+0000","last_change":"2024-08-31T04:20:42.932961+0000","last_active":"2024-08-31T04:22:26.260698+0000","last_peered":"2024-08-31T04:22:26.260698+0000","last_clean":"2024-08-31T04:22:26.260698+0000","last_became_active":"2024-08-31T04:20:42.932562+0000","last_became_peered":"2024-08-31T04:20:42.932562+0000","last_unstale":"2024-08-31T04:22:26.260698+0000","last_undegraded":"2024-08-31T04:22:26.260698+0000","last_fullsized":"2024-08-31T04:22:26.260698+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:20:36.827300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"78'4","reported_seq":31,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:21:01.049286+0000","last_change":"2024-08-31T04:20:39.902279+0000","last_active":"2024-08-31T04:21:01.049286+0000","last_peered":"2024-08-31T04:21:01.049286+0000","last_clean":"2024-08-31T04:21:01.049286+0000","last_became_active":"2024-08-31T04:20:39.901822+0000","last_became_peered":"2024-08-31T04:20:39.901822+0000","last_unstale":"2024-08-31T04:21:01.049286+0000","last_undegraded":"2024-08-31T04:21:01.049286+0000","last_fullsized":"2024-08-31T04:21:01.049286+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_clean_scrub_stamp":"2024-08-31T04:20:38.871450+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:48:09.609644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"78'9","reported_seq":37,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:22:26.258970+0000","last_change":"2024-08-31T04:20:57.008955+0000","last_active":"2024-08-31T04:22:26.258970+0000","last_peered":"2024-08-31T04:22:26.258970+0000","last_clean":"2024-08-31T04:22:26.258970+0000","last_became_active":"2024-08-31T04:20:57.008487+0000","last_became_peered":"2024-08-31T04:20:57.008487+0000","last_unstale":"2024-08-31T04:22:26.258970+0000","last_undegraded":"2024-08-31T04:22:26.258970+0000","last_fullsized":"2024-08-31T04:22:26.258970+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:26:23.399089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,5],"acting":[0,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"77'5","reported_seq":33,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:20:56.999868+0000","last_change":"2024-08-31T04:20:39.992197+0000","last_active":"2024-08-31T04:20:56.999868+0000","last_peered":"2024-08-31T04:20:56.999868+0000","last_clean":"2024-08-31T04:20:56.999868+0000","last_became_active":"2024-08-31T04:20:39.991835+0000","last_became_peered":"2024-08-31T04:20:39.991835+0000","last_unstale":"2024-08-31T04:20:56.999868+0000","last_undegraded":"2024-08-31T04:20:56.999868+0000","last_fullsized":"2024-08-31T04:20:56.999868+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_clean_scrub_stamp":"2024-08-31T04:20:38.871450+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:38:02.808469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"78'11","reported_seq":32,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:22:26.262300+0000","last_change":"2024-08-31T04:20:42.934874+0000","last_active":"2024-08-31T04:22:26.262300+0000","last_peered":"2024-08-31T04:22:26.262300+0000","last_clean":"2024-08-31T04:22:26.262300+0000","last_became_active":"2024-08-31T04:20:42.934500+0000","last_became_peered":"2024-08-31T04:20:42.934500+0000","last_unstale":"2024-08-31T04:22:26.262300+0000","last_undegraded":"2024-08-31T04:22:26.262300+0000","last_fullsized":"2024-08-31T04:22:26.262300+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:32:59.785563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"78'37","reported_seq":314,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:23:01.002755+0000","last_change":"2024-08-31T04:20:39.907452+0000","last_active":"2024-08-31T04:23:01.002755+0000","last_peered":"2024-08-31T04:23:01.002755+0000","last_clean":"2024-08-31T04:23:01.002755+0000","last_became_active":"2024-08-31T04:20:39.907071+0000","last_became_peered":"2024-08-31T04:20:39.907071+0000","last_unstale":"2024-08-31T04:23:01.002755+0000","last_undegraded":"2024-08-31T04:23:01.002755+0000","last_fullsized":"2024-08-31T04:23:01.002755+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_clean_scrub_stamp":"2024-08-31T04:20:38.871450+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:21:33.318332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65695,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":249,"num_read_kb":183,"num_write":39,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"78'6","reported_seq":27,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:22:26.251640+0000","last_change":"2024-08-31T04:20:42.937750+0000","last_active":"2024-08-31T04:22:26.251640+0000","last_peered":"2024-08-31T04:22:26.251640+0000","last_clean":"2024-08-31T04:22:26.251640+0000","last_became_active":"2024-08-31T04:20:42.937386+0000","last_became_peered":"2024-08-31T04:20:42.937386+0000","last_unstale":"2024-08-31T04:22:26.251640+0000","last_undegraded":"2024-08-31T04:22:26.251640+0000","last_fullsized":"2024-08-31T04:22:26.251640+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:14:03.123558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"78'9","reported_seq":39,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:21:02.054882+0000","last_change":"2024-08-31T04:20:39.902815+0000","last_active":"2024-08-31T04:21:02.054882+0000","last_peered":"2024-08-31T04:21:02.054882+0000","last_clean":"2024-08-31T04:21:02.054882+0000","last_became_active":"2024-08-31T04:20:39.900473+0000","last_became_peered":"2024-08-31T04:20:39.900473+0000","last_unstale":"2024-08-31T04:21:02.054882+0000","last_undegraded":"2024-08-31T04:21:02.054882+0000","last_fullsized":"2024-08-31T04:21:02.054882+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_clean_scrub_stamp":"2024-08-31T04:20:38.871450+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:42:03.902102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"78'9","reported_seq":30,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:22:26.254374+0000","last_change":"2024-08-31T04:20:42.932333+0000","last_active":"2024-08-31T04:22:26.254374+0000","last_peered":"2024-08-31T04:22:26.254374+0000","last_clean":"2024-08-31T04:22:26.254374+0000","last_became_active":"2024-08-31T04:20:42.931902+0000","last_became_peered":"2024-08-31T04:20:42.931902+0000","last_unstale":"2024-08-31T04:22:26.254374+0000","last_undegraded":"2024-08-31T04:22:26.254374+0000","last_fullsized":"2024-08-31T04:22:26.254374+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:46:44.716941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"78'5","reported_seq":34,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:21:02.052921+0000","last_change":"2024-08-31T04:20:39.901541+0000","last_active":"2024-08-31T04:21:02.052921+0000","last_peered":"2024-08-31T04:21:02.052921+0000","last_clean":"2024-08-31T04:21:02.052921+0000","last_became_active":"2024-08-31T04:20:39.901116+0000","last_became_peered":"2024-08-31T04:20:39.901116+0000","last_unstale":"2024-08-31T04:21:02.052921+0000","last_undegraded":"2024-08-31T04:21:02.052921+0000","last_fullsized":"2024-08-31T04:21:02.052921+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_clean_scrub_stamp":"2024-08-31T04:20:38.871450+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:57:51.458017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"78'15","reported_seq":36,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:22:26.258400+0000","last_change":"2024-08-31T04:20:42.936355+0000","last_active":"2024-08-31T04:22:26.258400+0000","last_peered":"2024-08-31T04:22:26.258400+0000","last_clean":"2024-08-31T04:22:26.258400+0000","last_became_active":"2024-08-31T04:20:42.935975+0000","last_became_peered":"2024-08-31T04:20:42.935975+0000","last_unstale":"2024-08-31T04:22:26.258400+0000","last_undegraded":"2024-08-31T04:22:26.258400+0000","last_fullsized":"2024-08-31T04:22:26.258400+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:37:24.867700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"78'8","reported_seq":160,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:23:00.244704+0000","last_change":"2024-08-31T04:20:39.901314+0000","last_active":"2024-08-31T04:23:00.244704+0000","last_peered":"2024-08-31T04:23:00.244704+0000","last_clean":"2024-08-31T04:23:00.244704+0000","last_became_active":"2024-08-31T04:20:39.900780+0000","last_became_peered":"2024-08-31T04:20:39.900780+0000","last_unstale":"2024-08-31T04:23:00.244704+0000","last_undegraded":"2024-08-31T04:23:00.244704+0000","last_fullsized":"2024-08-31T04:23:00.244704+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_clean_scrub_stamp":"2024-08-31T04:20:38.871450+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:59:40.500765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1431,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":125,"num_read_kb":6,"num_write":8,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"78'6","reported_seq":27,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:22:26.253973+0000","last_change":"2024-08-31T04:20:42.934382+0000","last_active":"2024-08-31T04:22:26.253973+0000","last_peered":"2024-08-31T04:22:26.253973+0000","last_clean":"2024-08-31T04:22:26.253973+0000","last_became_active":"2024-08-31T04:20:42.933986+0000","last_became_peered":"2024-08-31T04:20:42.933986+0000","last_unstale":"2024-08-31T04:22:26.253973+0000","last_undegraded":"2024-08-31T04:22:26.253973+0000","last_fullsized":"2024-08-31T04:22:26.253973+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:12:16.372504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"78'17","reported_seq":46,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:21:02.053828+0000","last_change":"2024-08-31T04:20:39.990817+0000","last_active":"2024-08-31T04:21:02.053828+0000","last_peered":"2024-08-31T04:21:02.053828+0000","last_clean":"2024-08-31T04:21:02.053828+0000","last_became_active":"2024-08-31T04:20:39.990379+0000","last_became_peered":"2024-08-31T04:20:39.990379+0000","last_unstale":"2024-08-31T04:21:02.053828+0000","last_undegraded":"2024-08-31T04:21:02.053828+0000","last_fullsized":"2024-08-31T04:21:02.053828+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_clean_scrub_stamp":"2024-08-31T04:20:38.871450+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:42:27.435142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"78'6","reported_seq":27,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:22:26.253798+0000","last_change":"2024-08-31T04:20:42.942430+0000","last_active":"2024-08-31T04:22:26.253798+0000","last_peered":"2024-08-31T04:22:26.253798+0000","last_clean":"2024-08-31T04:22:26.253798+0000","last_became_active":"2024-08-31T04:20:42.942067+0000","last_became_peered":"2024-08-31T04:20:42.942067+0000","last_unstale":"2024-08-31T04:22:26.253798+0000","last_undegraded":"2024-08-31T04:22:26.253798+0000","last_fullsized":"2024-08-31T04:22:26.253798+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:48:52.441499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"77'2","reported_seq":31,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:21:02.054755+0000","last_change":"2024-08-31T04:20:39.903815+0000","last_active":"2024-08-31T04:21:02.054755+0000","last_peered":"2024-08-31T04:21:02.054755+0000","last_clean":"2024-08-31T04:21:02.054755+0000","last_became_active":"2024-08-31T04:20:39.903183+0000","last_became_peered":"2024-08-31T04:20:39.903183+0000","last_unstale":"2024-08-31T04:21:02.054755+0000","last_undegraded":"2024-08-31T04:21:02.054755+0000","last_fullsized":"2024-08-31T04:21:02.054755+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_clean_scrub_stamp":"2024-08-31T04:20:38.871450+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:39:50.862711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"78'5","reported_seq":34,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:22:26.255171+0000","last_change":"2024-08-31T04:20:57.004852+0000","last_active":"2024-08-31T04:22:26.255171+0000","last_peered":"2024-08-31T04:22:26.255171+0000","last_clean":"2024-08-31T04:22:26.255171+0000","last_became_active":"2024-08-31T04:20:57.004435+0000","last_became_peered":"2024-08-31T04:20:57.004435+0000","last_unstale":"2024-08-31T04:22:26.255171+0000","last_undegraded":"2024-08-31T04:22:26.255171+0000","last_fullsized":"2024-08-31T04:22:26.255171+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T06:16:19.010305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,6],"acting":[11,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"78'5","reported_seq":33,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:21:01.047914+0000","last_change":"2024-08-31T04:20:39.901493+0000","last_active":"2024-08-31T04:21:01.047914+0000","last_peered":"2024-08-31T04:21:01.047914+0000","last_clean":"2024-08-31T04:21:01.047914+0000","last_became_active":"2024-08-31T04:20:39.901072+0000","last_became_peered":"2024-08-31T04:20:39.901072+0000","last_unstale":"2024-08-31T04:21:01.047914+0000","last_undegraded":"2024-08-31T04:21:01.047914+0000","last_fullsized":"2024-08-31T04:21:01.047914+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_clean_scrub_stamp":"2024-08-31T04:20:38.871450+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:26:43.893882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"78'9","reported_seq":31,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:22:26.247690+0000","last_change":"2024-08-31T04:20:42.938270+0000","last_active":"2024-08-31T04:22:26.247690+0000","last_peered":"2024-08-31T04:22:26.247690+0000","last_clean":"2024-08-31T04:22:26.247690+0000","last_became_active":"2024-08-31T04:20:42.937851+0000","last_became_peered":"2024-08-31T04:20:42.937851+0000","last_unstale":"2024-08-31T04:22:26.247690+0000","last_undegraded":"2024-08-31T04:22:26.247690+0000","last_fullsized":"2024-08-31T04:22:26.247690+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:29:09.315106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"78'3","reported_seq":32,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:21:02.054203+0000","last_change":"2024-08-31T04:20:39.905785+0000","last_active":"2024-08-31T04:21:02.054203+0000","last_peered":"2024-08-31T04:21:02.054203+0000","last_clean":"2024-08-31T04:21:02.054203+0000","last_became_active":"2024-08-31T04:20:39.905403+0000","last_became_peered":"2024-08-31T04:20:39.905403+0000","last_unstale":"2024-08-31T04:21:02.054203+0000","last_undegraded":"2024-08-31T04:21:02.054203+0000","last_fullsized":"2024-08-31T04:21:02.054203+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_clean_scrub_stamp":"2024-08-31T04:20:38.871450+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:48:04.743543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"78'7","reported_seq":29,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:22:26.250051+0000","last_change":"2024-08-31T04:20:42.934433+0000","last_active":"2024-08-31T04:22:26.250051+0000","last_peered":"2024-08-31T04:22:26.250051+0000","last_clean":"2024-08-31T04:22:26.250051+0000","last_became_active":"2024-08-31T04:20:42.934058+0000","last_became_peered":"2024-08-31T04:20:42.934058+0000","last_unstale":"2024-08-31T04:22:26.250051+0000","last_undegraded":"2024-08-31T04:22:26.250051+0000","last_fullsized":"2024-08-31T04:22:26.250051+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:34:42.988905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"78'7","reported_seq":159,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:23:00.244188+0000","last_change":"2024-08-31T04:20:40.202403+0000","last_active":"2024-08-31T04:23:00.244188+0000","last_peered":"2024-08-31T04:23:00.244188+0000","last_clean":"2024-08-31T04:23:00.244188+0000","last_became_active":"2024-08-31T04:20:40.201918+0000","last_became_peered":"2024-08-31T04:20:40.201918+0000","last_unstale":"2024-08-31T04:23:00.244188+0000","last_undegraded":"2024-08-31T04:23:00.244188+0000","last_fullsized":"2024-08-31T04:23:00.244188+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_clean_scrub_stamp":"2024-08-31T04:20:38.871450+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:31:26.675413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1702,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":124,"num_read_kb":4,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"78'7","reported_seq":29,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:22:26.258221+0000","last_change":"2024-08-31T04:20:42.931040+0000","last_active":"2024-08-31T04:22:26.258221+0000","last_peered":"2024-08-31T04:22:26.258221+0000","last_clean":"2024-08-31T04:22:26.258221+0000","last_became_active":"2024-08-31T04:20:42.930692+0000","last_became_peered":"2024-08-31T04:20:42.930692+0000","last_unstale":"2024-08-31T04:22:26.258221+0000","last_undegraded":"2024-08-31T04:22:26.258221+0000","last_fullsized":"2024-08-31T04:22:26.258221+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T06:12:23.175092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"20'92","reported_seq":99,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:20:57.003516+0000","last_change":"2024-08-31T04:19:21.361791+0000","last_active":"2024-08-31T04:20:57.003516+0000","last_peered":"2024-08-31T04:20:57.003516+0000","last_clean":"2024-08-31T04:20:57.003516+0000","last_became_active":"2024-08-31T04:19:21.356128+0000","last_became_peered":"2024-08-31T04:19:21.356128+0000","last_unstale":"2024-08-31T04:20:57.003516+0000","last_undegraded":"2024-08-31T04:20:57.003516+0000","last_fullsized":"2024-08-31T04:20:57.003516+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:15:46.442365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:15:46.442365+0000","last_clean_scrub_stamp":"2024-08-31T04:15:46.442365+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:23:05.688680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"78'6","reported_seq":37,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:21:02.054186+0000","last_change":"2024-08-31T04:20:39.904625+0000","last_active":"2024-08-31T04:21:02.054186+0000","last_peered":"2024-08-31T04:21:02.054186+0000","last_clean":"2024-08-31T04:21:02.054186+0000","last_became_active":"2024-08-31T04:20:39.904245+0000","last_became_peered":"2024-08-31T04:20:39.904245+0000","last_unstale":"2024-08-31T04:21:02.054186+0000","last_undegraded":"2024-08-31T04:21:02.054186+0000","last_fullsized":"2024-08-31T04:21:02.054186+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_clean_scrub_stamp":"2024-08-31T04:20:38.871450+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:31:34.711047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"78'8","reported_seq":30,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:22:26.264104+0000","last_change":"2024-08-31T04:20:42.944224+0000","last_active":"2024-08-31T04:22:26.264104+0000","last_peered":"2024-08-31T04:22:26.264104+0000","last_clean":"2024-08-31T04:22:26.264104+0000","last_became_active":"2024-08-31T04:20:42.943469+0000","last_became_peered":"2024-08-31T04:20:42.943469+0000","last_unstale":"2024-08-31T04:22:26.264104+0000","last_undegraded":"2024-08-31T04:22:26.264104+0000","last_fullsized":"2024-08-31T04:22:26.264104+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:27:48.533319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"78'4","reported_seq":32,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:21:01.049039+0000","last_change":"2024-08-31T04:20:39.902613+0000","last_active":"2024-08-31T04:21:01.049039+0000","last_peered":"2024-08-31T04:21:01.049039+0000","last_clean":"2024-08-31T04:21:01.049039+0000","last_became_active":"2024-08-31T04:20:39.902033+0000","last_became_peered":"2024-08-31T04:20:39.902033+0000","last_unstale":"2024-08-31T04:21:01.049039+0000","last_undegraded":"2024-08-31T04:21:01.049039+0000","last_fullsized":"2024-08-31T04:21:01.049039+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_clean_scrub_stamp":"2024-08-31T04:20:38.871450+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:13:58.497781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"78'5","reported_seq":27,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:22:26.248712+0000","last_change":"2024-08-31T04:20:42.933541+0000","last_active":"2024-08-31T04:22:26.248712+0000","last_peered":"2024-08-31T04:22:26.248712+0000","last_clean":"2024-08-31T04:22:26.248712+0000","last_became_active":"2024-08-31T04:20:42.933155+0000","last_became_peered":"2024-08-31T04:20:42.933155+0000","last_unstale":"2024-08-31T04:22:26.248712+0000","last_undegraded":"2024-08-31T04:22:26.248712+0000","last_fullsized":"2024-08-31T04:22:26.248712+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:22:41.298103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"78'7","reported_seq":153,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:22:58.240824+0000","last_change":"2024-08-31T04:20:39.992067+0000","last_active":"2024-08-31T04:22:58.240824+0000","last_peered":"2024-08-31T04:22:58.240824+0000","last_clean":"2024-08-31T04:22:58.240824+0000","last_became_active":"2024-08-31T04:20:39.991645+0000","last_became_peered":"2024-08-31T04:20:39.991645+0000","last_unstale":"2024-08-31T04:22:58.240824+0000","last_undegraded":"2024-08-31T04:22:58.240824+0000","last_fullsized":"2024-08-31T04:22:58.240824+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_clean_scrub_stamp":"2024-08-31T04:20:38.871450+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:41:18.012094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":118,"num_read_kb":118,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"78'8","reported_seq":30,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:22:26.253434+0000","last_change":"2024-08-31T04:20:42.937324+0000","last_active":"2024-08-31T04:22:26.253434+0000","last_peered":"2024-08-31T04:22:26.253434+0000","last_clean":"2024-08-31T04:22:26.253434+0000","last_became_active":"2024-08-31T04:20:42.936926+0000","last_became_peered":"2024-08-31T04:20:42.936926+0000","last_unstale":"2024-08-31T04:22:26.253434+0000","last_undegraded":"2024-08-31T04:22:26.253434+0000","last_fullsized":"2024-08-31T04:22:26.253434+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:34:57.158304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"78'5","reported_seq":153,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:22:59.241861+0000","last_change":"2024-08-31T04:20:39.905365+0000","last_active":"2024-08-31T04:22:59.241861+0000","last_peered":"2024-08-31T04:22:59.241861+0000","last_clean":"2024-08-31T04:22:59.241861+0000","last_became_active":"2024-08-31T04:20:39.904772+0000","last_became_peered":"2024-08-31T04:20:39.904772+0000","last_unstale":"2024-08-31T04:22:59.241861+0000","last_undegraded":"2024-08-31T04:22:59.241861+0000","last_fullsized":"2024-08-31T04:22:59.241861+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_clean_scrub_stamp":"2024-08-31T04:20:38.871450+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T05:20:23.781639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":120,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"78'7","reported_seq":29,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:22:26.258493+0000","last_change":"2024-08-31T04:20:42.944303+0000","last_active":"2024-08-31T04:22:26.258493+0000","last_peered":"2024-08-31T04:22:26.258493+0000","last_clean":"2024-08-31T04:22:26.258493+0000","last_became_active":"2024-08-31T04:20:42.943938+0000","last_became_peered":"2024-08-31T04:20:42.943938+0000","last_unstale":"2024-08-31T04:22:26.258493+0000","last_undegraded":"2024-08-31T04:22:26.258493+0000","last_fullsized":"2024-08-31T04:22:26.258493+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T06:51:28.734751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"77'1","reported_seq":29,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:20:57.004699+0000","last_change":"2024-08-31T04:20:39.993135+0000","last_active":"2024-08-31T04:20:57.004699+0000","last_peered":"2024-08-31T04:20:57.004699+0000","last_clean":"2024-08-31T04:20:57.004699+0000","last_became_active":"2024-08-31T04:20:39.991569+0000","last_became_peered":"2024-08-31T04:20:39.991569+0000","last_unstale":"2024-08-31T04:20:57.004699+0000","last_undegraded":"2024-08-31T04:20:57.004699+0000","last_fullsized":"2024-08-31T04:20:57.004699+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_clean_scrub_stamp":"2024-08-31T04:20:38.871450+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:44:04.375810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"78'5","reported_seq":27,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:22:26.255803+0000","last_change":"2024-08-31T04:20:42.939721+0000","last_active":"2024-08-31T04:22:26.255803+0000","last_peered":"2024-08-31T04:22:26.255803+0000","last_clean":"2024-08-31T04:22:26.255803+0000","last_became_active":"2024-08-31T04:20:42.939380+0000","last_became_peered":"2024-08-31T04:20:42.939380+0000","last_unstale":"2024-08-31T04:22:26.255803+0000","last_undegraded":"2024-08-31T04:22:26.255803+0000","last_fullsized":"2024-08-31T04:22:26.255803+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:55:06.901719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"78'4","reported_seq":33,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:21:02.054159+0000","last_change":"2024-08-31T04:20:39.990968+0000","last_active":"2024-08-31T04:21:02.054159+0000","last_peered":"2024-08-31T04:21:02.054159+0000","last_clean":"2024-08-31T04:21:02.054159+0000","last_became_active":"2024-08-31T04:20:39.990583+0000","last_became_peered":"2024-08-31T04:20:39.990583+0000","last_unstale":"2024-08-31T04:21:02.054159+0000","last_undegraded":"2024-08-31T04:21:02.054159+0000","last_fullsized":"2024-08-31T04:21:02.054159+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_clean_scrub_stamp":"2024-08-31T04:20:38.871450+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:54:39.168179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"78'9","reported_seq":31,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:22:26.247852+0000","last_change":"2024-08-31T04:20:42.932914+0000","last_active":"2024-08-31T04:22:26.247852+0000","last_peered":"2024-08-31T04:22:26.247852+0000","last_clean":"2024-08-31T04:22:26.247852+0000","last_became_active":"2024-08-31T04:20:42.932523+0000","last_became_peered":"2024-08-31T04:20:42.932523+0000","last_unstale":"2024-08-31T04:22:26.247852+0000","last_undegraded":"2024-08-31T04:22:26.247852+0000","last_fullsized":"2024-08-31T04:22:26.247852+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:52:49.133428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"78'18","reported_seq":46,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:22:50.362860+0000","last_change":"2024-08-31T04:20:39.903373+0000","last_active":"2024-08-31T04:22:50.362860+0000","last_peered":"2024-08-31T04:22:50.362860+0000","last_clean":"2024-08-31T04:22:50.362860+0000","last_became_active":"2024-08-31T04:20:39.902784+0000","last_became_peered":"2024-08-31T04:20:39.902784+0000","last_unstale":"2024-08-31T04:22:50.362860+0000","last_undegraded":"2024-08-31T04:22:50.362860+0000","last_fullsized":"2024-08-31T04:22:50.362860+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_clean_scrub_stamp":"2024-08-31T04:20:38.871450+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:43:32.251846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"78'5","reported_seq":27,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:22:26.252323+0000","last_change":"2024-08-31T04:20:42.939252+0000","last_active":"2024-08-31T04:22:26.252323+0000","last_peered":"2024-08-31T04:22:26.252323+0000","last_clean":"2024-08-31T04:22:26.252323+0000","last_became_active":"2024-08-31T04:20:42.936671+0000","last_became_peered":"2024-08-31T04:20:42.936671+0000","last_unstale":"2024-08-31T04:22:26.252323+0000","last_undegraded":"2024-08-31T04:22:26.252323+0000","last_fullsized":"2024-08-31T04:22:26.252323+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:37:57.544627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"78'7","reported_seq":36,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:21:02.053527+0000","last_change":"2024-08-31T04:20:40.202412+0000","last_active":"2024-08-31T04:21:02.053527+0000","last_peered":"2024-08-31T04:21:02.053527+0000","last_clean":"2024-08-31T04:21:02.053527+0000","last_became_active":"2024-08-31T04:20:40.202000+0000","last_became_peered":"2024-08-31T04:20:40.202000+0000","last_unstale":"2024-08-31T04:21:02.053527+0000","last_undegraded":"2024-08-31T04:21:02.053527+0000","last_fullsized":"2024-08-31T04:21:02.053527+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_clean_scrub_stamp":"2024-08-31T04:20:38.871450+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:24:23.528379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"78'7","reported_seq":29,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:22:26.257761+0000","last_change":"2024-08-31T04:20:42.949174+0000","last_active":"2024-08-31T04:22:26.257761+0000","last_peered":"2024-08-31T04:22:26.257761+0000","last_clean":"2024-08-31T04:22:26.257761+0000","last_became_active":"2024-08-31T04:20:42.948013+0000","last_became_peered":"2024-08-31T04:20:42.948013+0000","last_unstale":"2024-08-31T04:22:26.257761+0000","last_undegraded":"2024-08-31T04:22:26.257761+0000","last_fullsized":"2024-08-31T04:22:26.257761+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:36:00.572991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"76'2","reported_seq":30,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:20:57.223313+0000","last_change":"2024-08-31T04:20:39.992477+0000","last_active":"2024-08-31T04:20:57.223313+0000","last_peered":"2024-08-31T04:20:57.223313+0000","last_clean":"2024-08-31T04:20:57.223313+0000","last_became_active":"2024-08-31T04:20:39.992082+0000","last_became_peered":"2024-08-31T04:20:39.992082+0000","last_unstale":"2024-08-31T04:20:57.223313+0000","last_undegraded":"2024-08-31T04:20:57.223313+0000","last_fullsized":"2024-08-31T04:20:57.223313+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_clean_scrub_stamp":"2024-08-31T04:20:38.871450+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:10:35.058693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"78'2","reported_seq":24,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:22:26.251210+0000","last_change":"2024-08-31T04:20:42.933915+0000","last_active":"2024-08-31T04:22:26.251210+0000","last_peered":"2024-08-31T04:22:26.251210+0000","last_clean":"2024-08-31T04:22:26.251210+0000","last_became_active":"2024-08-31T04:20:42.933525+0000","last_became_peered":"2024-08-31T04:20:42.933525+0000","last_unstale":"2024-08-31T04:22:26.251210+0000","last_undegraded":"2024-08-31T04:22:26.251210+0000","last_fullsized":"2024-08-31T04:22:26.251210+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:03:35.191136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"78'7","reported_seq":35,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:21:01.048268+0000","last_change":"2024-08-31T04:20:39.903979+0000","last_active":"2024-08-31T04:21:01.048268+0000","last_peered":"2024-08-31T04:21:01.048268+0000","last_clean":"2024-08-31T04:21:01.048268+0000","last_became_active":"2024-08-31T04:20:39.903538+0000","last_became_peered":"2024-08-31T04:20:39.903538+0000","last_unstale":"2024-08-31T04:21:01.048268+0000","last_undegraded":"2024-08-31T04:21:01.048268+0000","last_fullsized":"2024-08-31T04:21:01.048268+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_clean_scrub_stamp":"2024-08-31T04:20:38.871450+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:25:15.944692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"78'9","reported_seq":31,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:22:26.257776+0000","last_change":"2024-08-31T04:20:42.947511+0000","last_active":"2024-08-31T04:22:26.257776+0000","last_peered":"2024-08-31T04:22:26.257776+0000","last_clean":"2024-08-31T04:22:26.257776+0000","last_became_active":"2024-08-31T04:20:42.947116+0000","last_became_peered":"2024-08-31T04:20:42.947116+0000","last_unstale":"2024-08-31T04:22:26.257776+0000","last_undegraded":"2024-08-31T04:22:26.257776+0000","last_fullsized":"2024-08-31T04:22:26.257776+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:00:53.022229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"78'3","reported_seq":31,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:21:02.009035+0000","last_change":"2024-08-31T04:20:39.903409+0000","last_active":"2024-08-31T04:21:02.009035+0000","last_peered":"2024-08-31T04:21:02.009035+0000","last_clean":"2024-08-31T04:21:02.009035+0000","last_became_active":"2024-08-31T04:20:39.900366+0000","last_became_peered":"2024-08-31T04:20:39.900366+0000","last_unstale":"2024-08-31T04:21:02.009035+0000","last_undegraded":"2024-08-31T04:21:02.009035+0000","last_fullsized":"2024-08-31T04:21:02.009035+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_clean_scrub_stamp":"2024-08-31T04:20:38.871450+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:01:24.809923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"78'8","reported_seq":30,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:22:26.256433+0000","last_change":"2024-08-31T04:20:42.953207+0000","last_active":"2024-08-31T04:22:26.256433+0000","last_peered":"2024-08-31T04:22:26.256433+0000","last_clean":"2024-08-31T04:22:26.256433+0000","last_became_active":"2024-08-31T04:20:42.952854+0000","last_became_peered":"2024-08-31T04:20:42.952854+0000","last_unstale":"2024-08-31T04:22:26.256433+0000","last_undegraded":"2024-08-31T04:22:26.256433+0000","last_fullsized":"2024-08-31T04:22:26.256433+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:33:11.495216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"76'4","reported_seq":21,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:21:00.180014+0000","last_change":"2024-08-31T04:20:57.016087+0000","last_active":"2024-08-31T04:21:00.180014+0000","last_peered":"2024-08-31T04:21:00.180014+0000","last_clean":"2024-08-31T04:21:00.180014+0000","last_became_active":"2024-08-31T04:20:57.005476+0000","last_became_peered":"2024-08-31T04:20:57.005476+0000","last_unstale":"2024-08-31T04:21:00.180014+0000","last_undegraded":"2024-08-31T04:21:00.180014+0000","last_fullsized":"2024-08-31T04:21:00.180014+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_clean_scrub_stamp":"2024-08-31T04:20:38.871450+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:22:21.768548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,7],"acting":[11,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.a","version":"78'5","reported_seq":27,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:22:26.258724+0000","last_change":"2024-08-31T04:20:42.933249+0000","last_active":"2024-08-31T04:22:26.258724+0000","last_peered":"2024-08-31T04:22:26.258724+0000","last_clean":"2024-08-31T04:22:26.258724+0000","last_became_active":"2024-08-31T04:20:42.931651+0000","last_became_peered":"2024-08-31T04:20:42.931651+0000","last_unstale":"2024-08-31T04:22:26.258724+0000","last_undegraded":"2024-08-31T04:22:26.258724+0000","last_fullsized":"2024-08-31T04:22:26.258724+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T06:40:21.010108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"78'15","reported_seq":36,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:22:26.254278+0000","last_change":"2024-08-31T04:20:42.942418+0000","last_active":"2024-08-31T04:22:26.254278+0000","last_peered":"2024-08-31T04:22:26.254278+0000","last_clean":"2024-08-31T04:22:26.254278+0000","last_became_active":"2024-08-31T04:20:42.942072+0000","last_became_peered":"2024-08-31T04:20:42.942072+0000","last_unstale":"2024-08-31T04:22:26.254278+0000","last_undegraded":"2024-08-31T04:22:26.254278+0000","last_fullsized":"2024-08-31T04:22:26.254278+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T04:41:38.816730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"78'5","reported_seq":33,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:21:01.049947+0000","last_change":"2024-08-31T04:20:39.903399+0000","last_active":"2024-08-31T04:21:01.049947+0000","last_peered":"2024-08-31T04:21:01.049947+0000","last_clean":"2024-08-31T04:21:01.049947+0000","last_became_active":"2024-08-31T04:20:39.902732+0000","last_became_peered":"2024-08-31T04:20:39.902732+0000","last_unstale":"2024-08-31T04:21:01.049947+0000","last_undegraded":"2024-08-31T04:21:01.049947+0000","last_fullsized":"2024-08-31T04:21:01.049947+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_clean_scrub_stamp":"2024-08-31T04:20:38.871450+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:07:25.324109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"78'9","reported_seq":30,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:22:26.261641+0000","last_change":"2024-08-31T04:20:42.931570+0000","last_active":"2024-08-31T04:22:26.261641+0000","last_peered":"2024-08-31T04:22:26.261641+0000","last_clean":"2024-08-31T04:22:26.261641+0000","last_became_active":"2024-08-31T04:20:42.931162+0000","last_became_peered":"2024-08-31T04:20:42.931162+0000","last_unstale":"2024-08-31T04:22:26.261641+0000","last_undegraded":"2024-08-31T04:22:26.261641+0000","last_fullsized":"2024-08-31T04:22:26.261641+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:55:58.784723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"78'12","reported_seq":27,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:21:02.054140+0000","last_change":"2024-08-31T04:20:57.020014+0000","last_active":"2024-08-31T04:21:02.054140+0000","last_peered":"2024-08-31T04:21:02.054140+0000","last_clean":"2024-08-31T04:21:02.054140+0000","last_became_active":"2024-08-31T04:20:57.009489+0000","last_became_peered":"2024-08-31T04:20:57.009489+0000","last_unstale":"2024-08-31T04:21:02.054140+0000","last_undegraded":"2024-08-31T04:21:02.054140+0000","last_fullsized":"2024-08-31T04:21:02.054140+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_clean_scrub_stamp":"2024-08-31T04:20:38.871450+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T05:22:57.227296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":10,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,7],"acting":[11,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1f","version":"78'6","reported_seq":28,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:22:26.262854+0000","last_change":"2024-08-31T04:20:42.947868+0000","last_active":"2024-08-31T04:22:26.262854+0000","last_peered":"2024-08-31T04:22:26.262854+0000","last_clean":"2024-08-31T04:22:26.262854+0000","last_became_active":"2024-08-31T04:20:42.946628+0000","last_became_peered":"2024-08-31T04:20:42.946628+0000","last_unstale":"2024-08-31T04:22:26.262854+0000","last_undegraded":"2024-08-31T04:22:26.262854+0000","last_fullsized":"2024-08-31T04:22:26.262854+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:47:10.939205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"76'2","reported_seq":30,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:20:57.338832+0000","last_change":"2024-08-31T04:20:39.991234+0000","last_active":"2024-08-31T04:20:57.338832+0000","last_peered":"2024-08-31T04:20:57.338832+0000","last_clean":"2024-08-31T04:20:57.338832+0000","last_became_active":"2024-08-31T04:20:39.990416+0000","last_became_peered":"2024-08-31T04:20:39.990416+0000","last_unstale":"2024-08-31T04:20:57.338832+0000","last_undegraded":"2024-08-31T04:20:57.338832+0000","last_fullsized":"2024-08-31T04:20:57.338832+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_clean_scrub_stamp":"2024-08-31T04:20:38.871450+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:47:43.392522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"78'5","reported_seq":27,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:22:26.251186+0000","last_change":"2024-08-31T04:20:42.942017+0000","last_active":"2024-08-31T04:22:26.251186+0000","last_peered":"2024-08-31T04:22:26.251186+0000","last_clean":"2024-08-31T04:22:26.251186+0000","last_became_active":"2024-08-31T04:20:42.939661+0000","last_became_peered":"2024-08-31T04:20:42.939661+0000","last_unstale":"2024-08-31T04:22:26.251186+0000","last_undegraded":"2024-08-31T04:22:26.251186+0000","last_fullsized":"2024-08-31T04:22:26.251186+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:13:39.521066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"78'13","reported_seq":161,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:22:59.241117+0000","last_change":"2024-08-31T04:20:39.905996+0000","last_active":"2024-08-31T04:22:59.241117+0000","last_peered":"2024-08-31T04:22:59.241117+0000","last_clean":"2024-08-31T04:22:59.241117+0000","last_became_active":"2024-08-31T04:20:39.905622+0000","last_became_peered":"2024-08-31T04:20:39.905622+0000","last_unstale":"2024-08-31T04:22:59.241117+0000","last_undegraded":"2024-08-31T04:22:59.241117+0000","last_fullsized":"2024-08-31T04:22:59.241117+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_clean_scrub_stamp":"2024-08-31T04:20:38.871450+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:53:36.672295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":120,"num_read_kb":120,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":74024,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":1236,"num_read_kb":694,"num_write":265,"num_write_kb":156,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":622,"num_keys_recovered":10,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":573440,"data_stored":216388,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":228,"ondisk_log_size":228,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":245760,"data_stored":2951840,"data_compressed":181705,"data_compressed_allocated":225280,"data_compressed_original":2949120,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":68,"seq":292057776170,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32012,"kb_used_data":828,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713140,"statfs":{"total":95995035648,"available":95962255360,"internally_reserved":0,"allocated":847872,"data_stored":413797,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":63,"seq":270582939694,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28004,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717148,"statfs":{"total":95995035648,"available":95966359552,"internally_reserved":0,"allocated":1003520,"data_stored":1065459,"data_compressed":36341,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":58,"seq":249108103221,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36196,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708956,"statfs":{"total":95995035648,"available":95957970944,"internally_reserved":0,"allocated":872448,"data_stored":413195,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,5,6,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":52,"seq":223338299449,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27872,"kb_used_data":848,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717280,"statfs":{"total":95995035648,"available":95966494720,"internally_reserved":0,"allocated":868352,"data_stored":413573,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":47,"seq":201863462976,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27924,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717228,"statfs":{"total":95995035648,"available":95966441472,"internally_reserved":0,"allocated":921600,"data_stored":1007075,"data_compressed":36341,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":42,"seq":180388626500,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32020,"kb_used_data":836,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713132,"statfs":{"total":95995035648,"available":95962247168,"internally_reserved":0,"allocated":856064,"data_stored":412912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":36,"seq":154618822731,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27936,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717216,"statfs":{"total":95995035648,"available":95966429184,"internally_reserved":0,"allocated":933888,"data_stored":1005910,"data_compressed":36341,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986255,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27860,"kb_used_data":836,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717292,"statfs":{"total":95995035648,"available":95966507008,"internally_reserved":0,"allocated":856064,"data_stored":413616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182483,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36196,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708956,"statfs":{"total":95995035648,"available":95957970944,"internally_reserved":0,"allocated":872448,"data_stored":412737,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411419,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27936,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717216,"statfs":{"total":95995035648,"available":95966429184,"internally_reserved":0,"allocated":933888,"data_stored":479650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574943,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27928,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717224,"statfs":{"total":95995035648,"available":95966437376,"internally_reserved":0,"allocated":925696,"data_stored":474990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738466,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27880,"kb_used_data":856,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717272,"statfs":{"total":95995035648,"available":95966486528,"internally_reserved":0,"allocated":876544,"data_stored":414783,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36341,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36341,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36341,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36341,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36341,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2710,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":62917,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":67577,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1543,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3352,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":4517,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":118784,"data_stored":68274,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-31T04:23:03.528 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 058d9fc6-674f-11ef-bcd4-c7b262605968 -- ceph pg dump --format=json 2024-08-31T04:23:03.970 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:23:04.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:04.632+0000 7f61f8a00640 1 -- 172.21.15.50:0/536781502 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f61f410b470 msgr2=0x7f61f410b880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:23:04.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:04.632+0000 7f61f8a00640 1 --2- 172.21.15.50:0/536781502 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f61f410b470 0x7f61f410b880 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f61e0009900 tx=0x7f61e002a410 comp rx=0 tx=0).stop 2024-08-31T04:23:04.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:04.632+0000 7f61f8a00640 1 -- 172.21.15.50:0/536781502 shutdown_connections 2024-08-31T04:23:04.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:04.632+0000 7f61f8a00640 1 --2- 172.21.15.50:0/536781502 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f61f410bdc0 0x7f61f41125f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:04.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:04.632+0000 7f61f8a00640 1 --2- 172.21.15.50:0/536781502 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f61f410b470 0x7f61f410b880 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:04.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:04.632+0000 7f61f8a00640 1 --2- 172.21.15.50:0/536781502 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f61f4105b30 0x7f61f4105f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:04.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:04.632+0000 7f61f8a00640 1 -- 172.21.15.50:0/536781502 >> 172.21.15.50:0/536781502 conn(0x7f61f4101600 msgr2=0x7f61f4103a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:23:04.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:04.633+0000 7f61f8a00640 1 -- 172.21.15.50:0/536781502 shutdown_connections 2024-08-31T04:23:04.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:04.633+0000 7f61f8a00640 1 -- 172.21.15.50:0/536781502 wait complete. 2024-08-31T04:23:04.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:04.634+0000 7f61f8a00640 1 Processor -- start 2024-08-31T04:23:04.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:04.634+0000 7f61f8a00640 1 -- start start 2024-08-31T04:23:04.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:04.635+0000 7f61f8a00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f61f4105b30 0x7f61f419c460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:04.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:04.635+0000 7f61f8a00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f61f410b470 0x7f61f419ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:04.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:04.635+0000 7f61f8a00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f61f410bdc0 0x7f61f41a1ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:04.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:04.635+0000 7f61f8a00640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f61f4115ad0 con 0x7f61f410b470 2024-08-31T04:23:04.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:04.635+0000 7f61f8a00640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f61f4115950 con 0x7f61f410bdc0 2024-08-31T04:23:04.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:04.635+0000 7f61f8a00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f61f4115c50 con 0x7f61f4105b30 2024-08-31T04:23:04.637 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:04.635+0000 7f61f1e00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f61f4105b30 0x7f61f419c460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:04.637 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:04.635+0000 7f61f1e00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f61f4105b30 0x7f61f419c460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.50:34262/0 (socket says 172.21.15.50:34262) 2024-08-31T04:23:04.637 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:04.635+0000 7f61f1e00640 1 -- 172.21.15.50:0/3173565550 learned_addr learned my addr 172.21.15.50:0/3173565550 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:23:04.637 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:04.635+0000 7f61f1400640 1 --2- 172.21.15.50:0/3173565550 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f61f410b470 0x7f61f419ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:04.637 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:04.635+0000 7f61f2800640 1 --2- 172.21.15.50:0/3173565550 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f61f410bdc0 0x7f61f41a1ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:04.637 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:04.636+0000 7f61f1e00640 1 -- 172.21.15.50:0/3173565550 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f61f410bdc0 msgr2=0x7f61f41a1ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:23:04.637 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:04.636+0000 7f61f1e00640 1 --2- 172.21.15.50:0/3173565550 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f61f410bdc0 0x7f61f41a1ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:04.637 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:04.636+0000 7f61f1e00640 1 -- 172.21.15.50:0/3173565550 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f61f410b470 msgr2=0x7f61f419ca00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:23:04.638 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:04.636+0000 7f61f1e00640 1 --2- 172.21.15.50:0/3173565550 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f61f410b470 0x7f61f419ca00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:04.638 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:04.636+0000 7f61f1e00640 1 -- 172.21.15.50:0/3173565550 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61f41a23d0 con 0x7f61f4105b30 2024-08-31T04:23:04.638 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:04.636+0000 7f61f1e00640 1 --2- 172.21.15.50:0/3173565550 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f61f4105b30 0x7f61f419c460 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f61e400e9f0 tx=0x7f61e400eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:23:04.638 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:04.636+0000 7f61eaa00640 1 -- 172.21.15.50:0/3173565550 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61e400cd80 con 0x7f61f4105b30 2024-08-31T04:23:04.638 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:04.637+0000 7f61eaa00640 1 -- 172.21.15.50:0/3173565550 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f61e40108e0 con 0x7f61f4105b30 2024-08-31T04:23:04.638 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:04.637+0000 7f61eaa00640 1 -- 172.21.15.50:0/3173565550 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61e4018980 con 0x7f61f4105b30 2024-08-31T04:23:04.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:04.637+0000 7f61f8a00640 1 -- 172.21.15.50:0/3173565550 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f61f41a26c0 con 0x7f61f4105b30 2024-08-31T04:23:04.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:04.637+0000 7f61f8a00640 1 -- 172.21.15.50:0/3173565550 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f61f41a8e20 con 0x7f61f4105b30 2024-08-31T04:23:04.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:04.638+0000 7f61f8a00640 1 -- 172.21.15.50:0/3173565550 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f61f4105f40 con 0x7f61f4105b30 2024-08-31T04:23:04.642 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:04.641+0000 7f61eaa00640 1 -- 172.21.15.50:0/3173565550 <== mon.1 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 18) ==== 152577+0+0 (secure 0 0 0) 0x7f61e4010430 con 0x7f61f4105b30 2024-08-31T04:23:04.644 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:04.642+0000 7f61eaa00640 1 --2- 172.21.15.50:0/3173565550 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f61d80b4bb0 0x7f61d80b70c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:04.644 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:04.642+0000 7f61eaa00640 1 -- 172.21.15.50:0/3173565550 <== mon.1 v2:172.21.15.177:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8219+0+0 (secure 0 0 0) 0x7f61e40e5900 con 0x7f61f4105b30 2024-08-31T04:23:04.644 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:04.643+0000 7f61f1400640 1 --2- 172.21.15.50:0/3173565550 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f61d80b4bb0 0x7f61d80b70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:04.645 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:04.643+0000 7f61f1400640 1 --2- 172.21.15.50:0/3173565550 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f61d80b4bb0 0x7f61d80b70c0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f61e002aa00 tx=0x7f61e0005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:23:04.645 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:04.644+0000 7f61eaa00640 1 -- 172.21.15.50:0/3173565550 <== mon.1 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f61e40ac390 con 0x7f61f4105b30 2024-08-31T04:23:04.864 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:04.863+0000 7f61f8a00640 1 -- 172.21.15.50:0/3173565550 --> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f61f40635a0 con 0x7f61d80b4bb0 2024-08-31T04:23:04.869 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:04.868+0000 7f61eaa00640 1 -- 172.21.15.50:0/3173565550 <== mgr.14150 v2:172.21.15.50:6800/2146686622 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258978 (secure 0 0 0) 0x7f61f40635a0 con 0x7f61d80b4bb0 2024-08-31T04:23:04.872 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-08-31T04:23:04.872 INFO:teuthology.orchestra.run.smithi050.stderr:dumped all 2024-08-31T04:23:04.875 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:04.872+0000 7f61f8a00640 1 -- 172.21.15.50:0/3173565550 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f61d80b4bb0 msgr2=0x7f61d80b70c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:23:04.875 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:04.872+0000 7f61f8a00640 1 --2- 172.21.15.50:0/3173565550 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f61d80b4bb0 0x7f61d80b70c0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f61e002aa00 tx=0x7f61e0005a20 comp rx=0 tx=0).stop 2024-08-31T04:23:04.875 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:04.872+0000 7f61f8a00640 1 -- 172.21.15.50:0/3173565550 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f61f4105b30 msgr2=0x7f61f419c460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:23:04.875 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:04.872+0000 7f61f8a00640 1 --2- 172.21.15.50:0/3173565550 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f61f4105b30 0x7f61f419c460 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f61e400e9f0 tx=0x7f61e400eeb0 comp rx=0 tx=0).stop 2024-08-31T04:23:04.875 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:04.873+0000 7f61f8a00640 1 -- 172.21.15.50:0/3173565550 shutdown_connections 2024-08-31T04:23:04.875 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:04.873+0000 7f61f8a00640 1 --2- 172.21.15.50:0/3173565550 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f61d80b4bb0 0x7f61d80b70c0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:04.875 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:04.873+0000 7f61f8a00640 1 --2- 172.21.15.50:0/3173565550 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f61f410bdc0 0x7f61f41a1ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:04.875 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:04.873+0000 7f61f8a00640 1 --2- 172.21.15.50:0/3173565550 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f61f410b470 0x7f61f419ca00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:04.875 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:04.873+0000 7f61f8a00640 1 --2- 172.21.15.50:0/3173565550 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f61f4105b30 0x7f61f419c460 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:04.875 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:04.873+0000 7f61f8a00640 1 -- 172.21.15.50:0/3173565550 >> 172.21.15.50:0/3173565550 conn(0x7f61f4101600 msgr2=0x7f61f410aac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:23:04.875 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:04.873+0000 7f61f8a00640 1 -- 172.21.15.50:0/3173565550 shutdown_connections 2024-08-31T04:23:04.875 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:04.873+0000 7f61f8a00640 1 -- 172.21.15.50:0/3173565550 wait complete. 2024-08-31T04:23:05.200 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:23:04 smithi050 ceph-mon[17259]: pgmap v372: 97 pgs: 97 active+clean; 649 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 938 B/s wr, 8 op/s 2024-08-31T04:23:05.200 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:23:04 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:23:05.200 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:23:04 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:23:05.246 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:23:04 smithi177 ceph-mon[22025]: pgmap v372: 97 pgs: 97 active+clean; 649 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 938 B/s wr, 8 op/s 2024-08-31T04:23:05.246 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:23:04 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:23:05.246 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:23:04 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:23:05.293 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:23:04 smithi133 ceph-mon[22177]: pgmap v372: 97 pgs: 97 active+clean; 649 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 938 B/s wr, 8 op/s 2024-08-31T04:23:05.293 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:23:04 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:23:05.293 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:23:04 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:23:05.662 INFO:teuthology.orchestra.run.smithi050.stdout:{"pg_ready":true,"pg_map":{"version":372,"stamp":"2024-08-31T04:23:03.886014+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":664626,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":1312,"num_read_kb":758,"num_write":390,"num_write_kb":2308,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":2952462,"num_keys_recovered":10,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":822,"ondisk_log_size":822,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":359768,"kb_used_data":10520,"kb_used_omap":18,"kb_used_meta":349037,"kb_avail":1124582056,"statfs":{"total":1151940427776,"available":1151572025344,"internally_reserved":0,"allocated":10772480,"data_stored":6933381,"data_compressed":109023,"data_compressed_allocated":135168,"data_compressed_original":1769472,"omap_allocated":19143,"internal_metadata":357414201},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":5995,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":101,"num_read_kb":51,"num_write":7,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003771"},"pg_stats":[{"pgid":"3.3f","version":"78'8","reported_seq":30,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:22:26.271328+0000","last_change":"2024-08-31T04:20:42.949771+0000","last_active":"2024-08-31T04:22:26.271328+0000","last_peered":"2024-08-31T04:22:26.271328+0000","last_clean":"2024-08-31T04:22:26.271328+0000","last_became_active":"2024-08-31T04:20:42.949372+0000","last_became_peered":"2024-08-31T04:20:42.949372+0000","last_unstale":"2024-08-31T04:22:26.271328+0000","last_undegraded":"2024-08-31T04:22:26.271328+0000","last_fullsized":"2024-08-31T04:22:26.271328+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:16:50.036191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"78'4","reported_seq":26,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:22:26.253427+0000","last_change":"2024-08-31T04:20:42.949805+0000","last_active":"2024-08-31T04:22:26.253427+0000","last_peered":"2024-08-31T04:22:26.253427+0000","last_clean":"2024-08-31T04:22:26.253427+0000","last_became_active":"2024-08-31T04:20:42.948015+0000","last_became_peered":"2024-08-31T04:20:42.948015+0000","last_unstale":"2024-08-31T04:22:26.253427+0000","last_undegraded":"2024-08-31T04:22:26.253427+0000","last_fullsized":"2024-08-31T04:22:26.253427+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:25:47.432785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"78'7","reported_seq":29,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:22:26.262935+0000","last_change":"2024-08-31T04:20:42.949114+0000","last_active":"2024-08-31T04:22:26.262935+0000","last_peered":"2024-08-31T04:22:26.262935+0000","last_clean":"2024-08-31T04:22:26.262935+0000","last_became_active":"2024-08-31T04:20:42.946763+0000","last_became_peered":"2024-08-31T04:20:42.946763+0000","last_unstale":"2024-08-31T04:22:26.262935+0000","last_undegraded":"2024-08-31T04:22:26.262935+0000","last_fullsized":"2024-08-31T04:22:26.262935+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:33:55.605617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"78'8","reported_seq":30,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:22:26.248677+0000","last_change":"2024-08-31T04:20:42.935026+0000","last_active":"2024-08-31T04:22:26.248677+0000","last_peered":"2024-08-31T04:22:26.248677+0000","last_clean":"2024-08-31T04:22:26.248677+0000","last_became_active":"2024-08-31T04:20:42.934534+0000","last_became_peered":"2024-08-31T04:20:42.934534+0000","last_unstale":"2024-08-31T04:22:26.248677+0000","last_undegraded":"2024-08-31T04:22:26.248677+0000","last_fullsized":"2024-08-31T04:22:26.248677+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:33:41.014920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"78'4","reported_seq":25,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:22:26.252143+0000","last_change":"2024-08-31T04:20:42.939114+0000","last_active":"2024-08-31T04:22:26.252143+0000","last_peered":"2024-08-31T04:22:26.252143+0000","last_clean":"2024-08-31T04:22:26.252143+0000","last_became_active":"2024-08-31T04:20:42.938710+0000","last_became_peered":"2024-08-31T04:20:42.938710+0000","last_unstale":"2024-08-31T04:22:26.252143+0000","last_undegraded":"2024-08-31T04:22:26.252143+0000","last_fullsized":"2024-08-31T04:22:26.252143+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:42:25.561258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"78'6","reported_seq":27,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:22:26.255233+0000","last_change":"2024-08-31T04:20:42.935958+0000","last_active":"2024-08-31T04:22:26.255233+0000","last_peered":"2024-08-31T04:22:26.255233+0000","last_clean":"2024-08-31T04:22:26.255233+0000","last_became_active":"2024-08-31T04:20:42.934865+0000","last_became_peered":"2024-08-31T04:20:42.934865+0000","last_unstale":"2024-08-31T04:22:26.255233+0000","last_undegraded":"2024-08-31T04:22:26.255233+0000","last_fullsized":"2024-08-31T04:22:26.255233+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:28:20.330784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"78'5","reported_seq":26,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:22:26.256030+0000","last_change":"2024-08-31T04:20:42.932639+0000","last_active":"2024-08-31T04:22:26.256030+0000","last_peered":"2024-08-31T04:22:26.256030+0000","last_clean":"2024-08-31T04:22:26.256030+0000","last_became_active":"2024-08-31T04:20:42.932238+0000","last_became_peered":"2024-08-31T04:20:42.932238+0000","last_unstale":"2024-08-31T04:22:26.256030+0000","last_undegraded":"2024-08-31T04:22:26.256030+0000","last_fullsized":"2024-08-31T04:22:26.256030+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T04:47:32.128675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"78'9","reported_seq":30,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:22:26.253126+0000","last_change":"2024-08-31T04:20:42.941700+0000","last_active":"2024-08-31T04:22:26.253126+0000","last_peered":"2024-08-31T04:22:26.253126+0000","last_clean":"2024-08-31T04:22:26.253126+0000","last_became_active":"2024-08-31T04:20:42.941308+0000","last_became_peered":"2024-08-31T04:20:42.941308+0000","last_unstale":"2024-08-31T04:22:26.253126+0000","last_undegraded":"2024-08-31T04:22:26.253126+0000","last_fullsized":"2024-08-31T04:22:26.253126+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:35:06.058492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"78'11","reported_seq":32,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:22:26.263740+0000","last_change":"2024-08-31T04:20:42.935528+0000","last_active":"2024-08-31T04:22:26.263740+0000","last_peered":"2024-08-31T04:22:26.263740+0000","last_clean":"2024-08-31T04:22:26.263740+0000","last_became_active":"2024-08-31T04:20:42.933736+0000","last_became_peered":"2024-08-31T04:20:42.933736+0000","last_unstale":"2024-08-31T04:22:26.263740+0000","last_undegraded":"2024-08-31T04:22:26.263740+0000","last_fullsized":"2024-08-31T04:22:26.263740+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:12:47.877285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"78'16","reported_seq":44,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:22:26.259552+0000","last_change":"2024-08-31T04:20:57.006683+0000","last_active":"2024-08-31T04:22:26.259552+0000","last_peered":"2024-08-31T04:22:26.259552+0000","last_clean":"2024-08-31T04:22:26.259552+0000","last_became_active":"2024-08-31T04:20:57.006166+0000","last_became_peered":"2024-08-31T04:20:57.006166+0000","last_unstale":"2024-08-31T04:22:26.259552+0000","last_undegraded":"2024-08-31T04:22:26.259552+0000","last_fullsized":"2024-08-31T04:22:26.259552+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:33:23.377991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,9],"acting":[10,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"78'6","reported_seq":27,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:22:26.257964+0000","last_change":"2024-08-31T04:20:42.939489+0000","last_active":"2024-08-31T04:22:26.257964+0000","last_peered":"2024-08-31T04:22:26.257964+0000","last_clean":"2024-08-31T04:22:26.257964+0000","last_became_active":"2024-08-31T04:20:42.939138+0000","last_became_peered":"2024-08-31T04:20:42.939138+0000","last_unstale":"2024-08-31T04:22:26.257964+0000","last_undegraded":"2024-08-31T04:22:26.257964+0000","last_fullsized":"2024-08-31T04:22:26.257964+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T05:00:30.196513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"78'7","reported_seq":28,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:22:26.249896+0000","last_change":"2024-08-31T04:20:42.941483+0000","last_active":"2024-08-31T04:22:26.249896+0000","last_peered":"2024-08-31T04:22:26.249896+0000","last_clean":"2024-08-31T04:22:26.249896+0000","last_became_active":"2024-08-31T04:20:42.940200+0000","last_became_peered":"2024-08-31T04:20:42.940200+0000","last_unstale":"2024-08-31T04:22:26.249896+0000","last_undegraded":"2024-08-31T04:22:26.249896+0000","last_fullsized":"2024-08-31T04:22:26.249896+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:40:45.235093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"78'10","reported_seq":31,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:22:26.246851+0000","last_change":"2024-08-31T04:20:42.928803+0000","last_active":"2024-08-31T04:22:26.246851+0000","last_peered":"2024-08-31T04:22:26.246851+0000","last_clean":"2024-08-31T04:22:26.246851+0000","last_became_active":"2024-08-31T04:20:42.928410+0000","last_became_peered":"2024-08-31T04:20:42.928410+0000","last_unstale":"2024-08-31T04:22:26.246851+0000","last_undegraded":"2024-08-31T04:22:26.246851+0000","last_fullsized":"2024-08-31T04:22:26.246851+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T04:24:41.811202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"78'7","reported_seq":29,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:22:26.259141+0000","last_change":"2024-08-31T04:20:42.945142+0000","last_active":"2024-08-31T04:22:26.259141+0000","last_peered":"2024-08-31T04:22:26.259141+0000","last_clean":"2024-08-31T04:22:26.259141+0000","last_became_active":"2024-08-31T04:20:42.944061+0000","last_became_peered":"2024-08-31T04:20:42.944061+0000","last_unstale":"2024-08-31T04:22:26.259141+0000","last_undegraded":"2024-08-31T04:22:26.259141+0000","last_fullsized":"2024-08-31T04:22:26.259141+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:55:09.045257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"78'7","reported_seq":29,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:22:26.258722+0000","last_change":"2024-08-31T04:20:42.945844+0000","last_active":"2024-08-31T04:22:26.258722+0000","last_peered":"2024-08-31T04:22:26.258722+0000","last_clean":"2024-08-31T04:22:26.258722+0000","last_became_active":"2024-08-31T04:20:42.944186+0000","last_became_peered":"2024-08-31T04:20:42.944186+0000","last_unstale":"2024-08-31T04:22:26.258722+0000","last_undegraded":"2024-08-31T04:22:26.258722+0000","last_fullsized":"2024-08-31T04:22:26.258722+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:32:46.878700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"78'9","reported_seq":31,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:22:26.264057+0000","last_change":"2024-08-31T04:20:42.952871+0000","last_active":"2024-08-31T04:22:26.264057+0000","last_peered":"2024-08-31T04:22:26.264057+0000","last_clean":"2024-08-31T04:22:26.264057+0000","last_became_active":"2024-08-31T04:20:42.952531+0000","last_became_peered":"2024-08-31T04:20:42.952531+0000","last_unstale":"2024-08-31T04:22:26.264057+0000","last_undegraded":"2024-08-31T04:22:26.264057+0000","last_fullsized":"2024-08-31T04:22:26.264057+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:26:01.690119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"78'8","reported_seq":29,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:22:26.271481+0000","last_change":"2024-08-31T04:20:42.949822+0000","last_active":"2024-08-31T04:22:26.271481+0000","last_peered":"2024-08-31T04:22:26.271481+0000","last_clean":"2024-08-31T04:22:26.271481+0000","last_became_active":"2024-08-31T04:20:42.949443+0000","last_became_peered":"2024-08-31T04:20:42.949443+0000","last_unstale":"2024-08-31T04:22:26.271481+0000","last_undegraded":"2024-08-31T04:22:26.271481+0000","last_fullsized":"2024-08-31T04:22:26.271481+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:35:48.270606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"78'10","reported_seq":31,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:22:26.260870+0000","last_change":"2024-08-31T04:20:42.940895+0000","last_active":"2024-08-31T04:22:26.260870+0000","last_peered":"2024-08-31T04:22:26.260870+0000","last_clean":"2024-08-31T04:22:26.260870+0000","last_became_active":"2024-08-31T04:20:42.940489+0000","last_became_peered":"2024-08-31T04:20:42.940489+0000","last_unstale":"2024-08-31T04:22:26.260870+0000","last_undegraded":"2024-08-31T04:22:26.260870+0000","last_fullsized":"2024-08-31T04:22:26.260870+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T04:42:20.269895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"78'7","reported_seq":29,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:22:26.254453+0000","last_change":"2024-08-31T04:20:42.935303+0000","last_active":"2024-08-31T04:22:26.254453+0000","last_peered":"2024-08-31T04:22:26.254453+0000","last_clean":"2024-08-31T04:22:26.254453+0000","last_became_active":"2024-08-31T04:20:42.934931+0000","last_became_peered":"2024-08-31T04:20:42.934931+0000","last_unstale":"2024-08-31T04:22:26.254453+0000","last_undegraded":"2024-08-31T04:22:26.254453+0000","last_fullsized":"2024-08-31T04:22:26.254453+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:34:40.767333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"78'8","reported_seq":30,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:22:26.257067+0000","last_change":"2024-08-31T04:20:42.941518+0000","last_active":"2024-08-31T04:22:26.257067+0000","last_peered":"2024-08-31T04:22:26.257067+0000","last_clean":"2024-08-31T04:22:26.257067+0000","last_became_active":"2024-08-31T04:20:42.941142+0000","last_became_peered":"2024-08-31T04:20:42.941142+0000","last_unstale":"2024-08-31T04:22:26.257067+0000","last_undegraded":"2024-08-31T04:22:26.257067+0000","last_fullsized":"2024-08-31T04:22:26.257067+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:27:50.274057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"78'11","reported_seq":33,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:22:26.256826+0000","last_change":"2024-08-31T04:20:42.945136+0000","last_active":"2024-08-31T04:22:26.256826+0000","last_peered":"2024-08-31T04:22:26.256826+0000","last_clean":"2024-08-31T04:22:26.256826+0000","last_became_active":"2024-08-31T04:20:42.944811+0000","last_became_peered":"2024-08-31T04:20:42.944811+0000","last_unstale":"2024-08-31T04:22:26.256826+0000","last_undegraded":"2024-08-31T04:22:26.256826+0000","last_fullsized":"2024-08-31T04:22:26.256826+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:30:47.496668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"78'10","reported_seq":32,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:22:26.264249+0000","last_change":"2024-08-31T04:20:42.930854+0000","last_active":"2024-08-31T04:22:26.264249+0000","last_peered":"2024-08-31T04:22:26.264249+0000","last_clean":"2024-08-31T04:22:26.264249+0000","last_became_active":"2024-08-31T04:20:42.930490+0000","last_became_peered":"2024-08-31T04:20:42.930490+0000","last_unstale":"2024-08-31T04:22:26.264249+0000","last_undegraded":"2024-08-31T04:22:26.264249+0000","last_fullsized":"2024-08-31T04:22:26.264249+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:16:17.611414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"78'8","reported_seq":20,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:22:26.252604+0000","last_change":"2024-08-31T04:20:57.008738+0000","last_active":"2024-08-31T04:22:26.252604+0000","last_peered":"2024-08-31T04:22:26.252604+0000","last_clean":"2024-08-31T04:22:26.252604+0000","last_became_active":"2024-08-31T04:20:57.008209+0000","last_became_peered":"2024-08-31T04:20:57.008209+0000","last_unstale":"2024-08-31T04:22:26.252604+0000","last_undegraded":"2024-08-31T04:22:26.252604+0000","last_fullsized":"2024-08-31T04:22:26.252604+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T05:26:22.508955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,11],"acting":[9,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.28","version":"78'6","reported_seq":28,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:22:26.252980+0000","last_change":"2024-08-31T04:20:42.939859+0000","last_active":"2024-08-31T04:22:26.252980+0000","last_peered":"2024-08-31T04:22:26.252980+0000","last_clean":"2024-08-31T04:22:26.252980+0000","last_became_active":"2024-08-31T04:20:42.938315+0000","last_became_peered":"2024-08-31T04:20:42.938315+0000","last_unstale":"2024-08-31T04:22:26.252980+0000","last_undegraded":"2024-08-31T04:22:26.252980+0000","last_fullsized":"2024-08-31T04:22:26.252980+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:13:00.906454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"78'2","reported_seq":24,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:22:26.251738+0000","last_change":"2024-08-31T04:20:42.941861+0000","last_active":"2024-08-31T04:22:26.251738+0000","last_peered":"2024-08-31T04:22:26.251738+0000","last_clean":"2024-08-31T04:22:26.251738+0000","last_became_active":"2024-08-31T04:20:42.939556+0000","last_became_peered":"2024-08-31T04:20:42.939556+0000","last_unstale":"2024-08-31T04:22:26.251738+0000","last_undegraded":"2024-08-31T04:22:26.251738+0000","last_fullsized":"2024-08-31T04:22:26.251738+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:02:53.900917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"78'15","reported_seq":37,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:22:26.252502+0000","last_change":"2024-08-31T04:20:42.930792+0000","last_active":"2024-08-31T04:22:26.252502+0000","last_peered":"2024-08-31T04:22:26.252502+0000","last_clean":"2024-08-31T04:22:26.252502+0000","last_became_active":"2024-08-31T04:20:42.930014+0000","last_became_peered":"2024-08-31T04:20:42.930014+0000","last_unstale":"2024-08-31T04:22:26.252502+0000","last_undegraded":"2024-08-31T04:22:26.252502+0000","last_fullsized":"2024-08-31T04:22:26.252502+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:18:26.942604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"78'6","reported_seq":35,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:22:26.252980+0000","last_change":"2024-08-31T04:20:57.010093+0000","last_active":"2024-08-31T04:22:26.252980+0000","last_peered":"2024-08-31T04:22:26.252980+0000","last_clean":"2024-08-31T04:22:26.252980+0000","last_became_active":"2024-08-31T04:20:57.008759+0000","last_became_peered":"2024-08-31T04:20:57.008759+0000","last_unstale":"2024-08-31T04:22:26.252980+0000","last_undegraded":"2024-08-31T04:22:26.252980+0000","last_fullsized":"2024-08-31T04:22:26.252980+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T06:55:38.276668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,9],"acting":[11,8,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"78'4","reported_seq":26,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:22:26.255417+0000","last_change":"2024-08-31T04:20:42.953378+0000","last_active":"2024-08-31T04:22:26.255417+0000","last_peered":"2024-08-31T04:22:26.255417+0000","last_clean":"2024-08-31T04:22:26.255417+0000","last_became_active":"2024-08-31T04:20:42.953030+0000","last_became_peered":"2024-08-31T04:20:42.953030+0000","last_unstale":"2024-08-31T04:22:26.255417+0000","last_undegraded":"2024-08-31T04:22:26.255417+0000","last_fullsized":"2024-08-31T04:22:26.255417+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:24:46.633234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"78'7","reported_seq":29,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:22:26.258481+0000","last_change":"2024-08-31T04:20:42.945142+0000","last_active":"2024-08-31T04:22:26.258481+0000","last_peered":"2024-08-31T04:22:26.258481+0000","last_clean":"2024-08-31T04:22:26.258481+0000","last_became_active":"2024-08-31T04:20:42.943960+0000","last_became_peered":"2024-08-31T04:20:42.943960+0000","last_unstale":"2024-08-31T04:22:26.258481+0000","last_undegraded":"2024-08-31T04:22:26.258481+0000","last_fullsized":"2024-08-31T04:22:26.258481+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T04:29:10.501940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"78'8","reported_seq":30,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:22:26.257636+0000","last_change":"2024-08-31T04:20:42.946359+0000","last_active":"2024-08-31T04:22:26.257636+0000","last_peered":"2024-08-31T04:22:26.257636+0000","last_clean":"2024-08-31T04:22:26.257636+0000","last_became_active":"2024-08-31T04:20:42.945974+0000","last_became_peered":"2024-08-31T04:20:42.945974+0000","last_unstale":"2024-08-31T04:22:26.257636+0000","last_undegraded":"2024-08-31T04:22:26.257636+0000","last_fullsized":"2024-08-31T04:22:26.257636+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:01:27.808743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"78'12","reported_seq":34,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:22:26.245311+0000","last_change":"2024-08-31T04:20:42.930989+0000","last_active":"2024-08-31T04:22:26.245311+0000","last_peered":"2024-08-31T04:22:26.245311+0000","last_clean":"2024-08-31T04:22:26.245311+0000","last_became_active":"2024-08-31T04:20:42.930610+0000","last_became_peered":"2024-08-31T04:20:42.930610+0000","last_unstale":"2024-08-31T04:22:26.245311+0000","last_undegraded":"2024-08-31T04:22:26.245311+0000","last_fullsized":"2024-08-31T04:22:26.245311+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:01:49.473735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"78'9","reported_seq":31,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:22:26.255676+0000","last_change":"2024-08-31T04:20:42.930513+0000","last_active":"2024-08-31T04:22:26.255676+0000","last_peered":"2024-08-31T04:22:26.255676+0000","last_clean":"2024-08-31T04:22:26.255676+0000","last_became_active":"2024-08-31T04:20:42.930127+0000","last_became_peered":"2024-08-31T04:20:42.930127+0000","last_unstale":"2024-08-31T04:22:26.255676+0000","last_undegraded":"2024-08-31T04:22:26.255676+0000","last_fullsized":"2024-08-31T04:22:26.255676+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T05:19:55.307816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"78'7","reported_seq":28,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:22:26.244290+0000","last_change":"2024-08-31T04:20:42.928217+0000","last_active":"2024-08-31T04:22:26.244290+0000","last_peered":"2024-08-31T04:22:26.244290+0000","last_clean":"2024-08-31T04:22:26.244290+0000","last_became_active":"2024-08-31T04:20:42.927828+0000","last_became_peered":"2024-08-31T04:20:42.927828+0000","last_unstale":"2024-08-31T04:22:26.244290+0000","last_undegraded":"2024-08-31T04:22:26.244290+0000","last_fullsized":"2024-08-31T04:22:26.244290+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:53:21.266734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"78'7","reported_seq":169,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:22:58.241300+0000","last_change":"2024-08-31T04:20:57.229930+0000","last_active":"2024-08-31T04:22:58.241300+0000","last_peered":"2024-08-31T04:22:58.241300+0000","last_clean":"2024-08-31T04:22:58.241300+0000","last_became_active":"2024-08-31T04:20:57.224761+0000","last_became_peered":"2024-08-31T04:20:57.224761+0000","last_unstale":"2024-08-31T04:22:58.241300+0000","last_undegraded":"2024-08-31T04:22:58.241300+0000","last_fullsized":"2024-08-31T04:22:58.241300+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_clean_scrub_stamp":"2024-08-31T04:20:38.871450+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:07:41.723452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1154,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":122,"num_read_kb":4,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":622,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"78'8","reported_seq":29,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:22:26.254392+0000","last_change":"2024-08-31T04:20:42.939189+0000","last_active":"2024-08-31T04:22:26.254392+0000","last_peered":"2024-08-31T04:22:26.254392+0000","last_clean":"2024-08-31T04:22:26.254392+0000","last_became_active":"2024-08-31T04:20:42.938817+0000","last_became_peered":"2024-08-31T04:20:42.938817+0000","last_unstale":"2024-08-31T04:22:26.254392+0000","last_undegraded":"2024-08-31T04:22:26.254392+0000","last_fullsized":"2024-08-31T04:22:26.254392+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:19:04.407104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"77'7","reported_seq":34,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:20:57.001432+0000","last_change":"2024-08-31T04:20:39.904392+0000","last_active":"2024-08-31T04:20:57.001432+0000","last_peered":"2024-08-31T04:20:57.001432+0000","last_clean":"2024-08-31T04:20:57.001432+0000","last_became_active":"2024-08-31T04:20:39.904014+0000","last_became_peered":"2024-08-31T04:20:39.904014+0000","last_unstale":"2024-08-31T04:20:57.001432+0000","last_undegraded":"2024-08-31T04:20:57.001432+0000","last_fullsized":"2024-08-31T04:20:57.001432+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_clean_scrub_stamp":"2024-08-31T04:20:38.871450+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:33:56.591237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"78'3","reported_seq":30,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:20:56.998239+0000","last_change":"2024-08-31T04:20:39.899521+0000","last_active":"2024-08-31T04:20:56.998239+0000","last_peered":"2024-08-31T04:20:56.998239+0000","last_clean":"2024-08-31T04:20:56.998239+0000","last_became_active":"2024-08-31T04:20:39.899157+0000","last_became_peered":"2024-08-31T04:20:39.899157+0000","last_unstale":"2024-08-31T04:20:56.998239+0000","last_undegraded":"2024-08-31T04:20:56.998239+0000","last_fullsized":"2024-08-31T04:20:56.998239+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_clean_scrub_stamp":"2024-08-31T04:20:38.871450+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:14:47.067149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"78'8","reported_seq":29,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:22:26.249334+0000","last_change":"2024-08-31T04:20:42.950653+0000","last_active":"2024-08-31T04:22:26.249334+0000","last_peered":"2024-08-31T04:22:26.249334+0000","last_clean":"2024-08-31T04:22:26.249334+0000","last_became_active":"2024-08-31T04:20:42.949627+0000","last_became_peered":"2024-08-31T04:20:42.949627+0000","last_unstale":"2024-08-31T04:22:26.249334+0000","last_undegraded":"2024-08-31T04:22:26.249334+0000","last_fullsized":"2024-08-31T04:22:26.249334+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:22:00.000717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"78'3","reported_seq":31,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:21:01.048385+0000","last_change":"2024-08-31T04:20:39.908013+0000","last_active":"2024-08-31T04:21:01.048385+0000","last_peered":"2024-08-31T04:21:01.048385+0000","last_clean":"2024-08-31T04:21:01.048385+0000","last_became_active":"2024-08-31T04:20:39.907482+0000","last_became_peered":"2024-08-31T04:20:39.907482+0000","last_unstale":"2024-08-31T04:21:01.048385+0000","last_undegraded":"2024-08-31T04:21:01.048385+0000","last_fullsized":"2024-08-31T04:21:01.048385+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_clean_scrub_stamp":"2024-08-31T04:20:38.871450+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:50:35.466407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"78'11","reported_seq":32,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:22:26.256431+0000","last_change":"2024-08-31T04:20:42.944674+0000","last_active":"2024-08-31T04:22:26.256431+0000","last_peered":"2024-08-31T04:22:26.256431+0000","last_clean":"2024-08-31T04:22:26.256431+0000","last_became_active":"2024-08-31T04:20:42.944424+0000","last_became_peered":"2024-08-31T04:20:42.944424+0000","last_unstale":"2024-08-31T04:22:26.256431+0000","last_undegraded":"2024-08-31T04:22:26.256431+0000","last_fullsized":"2024-08-31T04:22:26.256431+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:10:27.772835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"78'6","reported_seq":271,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:23:00.243510+0000","last_change":"2024-08-31T04:20:39.904188+0000","last_active":"2024-08-31T04:23:00.243510+0000","last_peered":"2024-08-31T04:23:00.243510+0000","last_clean":"2024-08-31T04:23:00.243510+0000","last_became_active":"2024-08-31T04:20:39.903789+0000","last_became_peered":"2024-08-31T04:20:39.903789+0000","last_unstale":"2024-08-31T04:23:00.243510+0000","last_undegraded":"2024-08-31T04:23:00.243510+0000","last_fullsized":"2024-08-31T04:23:00.243510+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_clean_scrub_stamp":"2024-08-31T04:20:38.871450+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T06:54:38.881746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":238,"num_read_kb":238,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"78'10","reported_seq":31,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:22:26.260698+0000","last_change":"2024-08-31T04:20:42.932961+0000","last_active":"2024-08-31T04:22:26.260698+0000","last_peered":"2024-08-31T04:22:26.260698+0000","last_clean":"2024-08-31T04:22:26.260698+0000","last_became_active":"2024-08-31T04:20:42.932562+0000","last_became_peered":"2024-08-31T04:20:42.932562+0000","last_unstale":"2024-08-31T04:22:26.260698+0000","last_undegraded":"2024-08-31T04:22:26.260698+0000","last_fullsized":"2024-08-31T04:22:26.260698+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:20:36.827300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"78'4","reported_seq":31,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:21:01.049286+0000","last_change":"2024-08-31T04:20:39.902279+0000","last_active":"2024-08-31T04:21:01.049286+0000","last_peered":"2024-08-31T04:21:01.049286+0000","last_clean":"2024-08-31T04:21:01.049286+0000","last_became_active":"2024-08-31T04:20:39.901822+0000","last_became_peered":"2024-08-31T04:20:39.901822+0000","last_unstale":"2024-08-31T04:21:01.049286+0000","last_undegraded":"2024-08-31T04:21:01.049286+0000","last_fullsized":"2024-08-31T04:21:01.049286+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_clean_scrub_stamp":"2024-08-31T04:20:38.871450+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:48:09.609644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"78'9","reported_seq":37,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:22:26.258970+0000","last_change":"2024-08-31T04:20:57.008955+0000","last_active":"2024-08-31T04:22:26.258970+0000","last_peered":"2024-08-31T04:22:26.258970+0000","last_clean":"2024-08-31T04:22:26.258970+0000","last_became_active":"2024-08-31T04:20:57.008487+0000","last_became_peered":"2024-08-31T04:20:57.008487+0000","last_unstale":"2024-08-31T04:22:26.258970+0000","last_undegraded":"2024-08-31T04:22:26.258970+0000","last_fullsized":"2024-08-31T04:22:26.258970+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:26:23.399089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,5],"acting":[0,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"77'5","reported_seq":33,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:20:56.999868+0000","last_change":"2024-08-31T04:20:39.992197+0000","last_active":"2024-08-31T04:20:56.999868+0000","last_peered":"2024-08-31T04:20:56.999868+0000","last_clean":"2024-08-31T04:20:56.999868+0000","last_became_active":"2024-08-31T04:20:39.991835+0000","last_became_peered":"2024-08-31T04:20:39.991835+0000","last_unstale":"2024-08-31T04:20:56.999868+0000","last_undegraded":"2024-08-31T04:20:56.999868+0000","last_fullsized":"2024-08-31T04:20:56.999868+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_clean_scrub_stamp":"2024-08-31T04:20:38.871450+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:38:02.808469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"78'11","reported_seq":33,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:22:26.262934+0000","last_change":"2024-08-31T04:20:42.934874+0000","last_active":"2024-08-31T04:22:26.262934+0000","last_peered":"2024-08-31T04:22:26.262934+0000","last_clean":"2024-08-31T04:22:26.262934+0000","last_became_active":"2024-08-31T04:20:42.934500+0000","last_became_peered":"2024-08-31T04:20:42.934500+0000","last_unstale":"2024-08-31T04:22:26.262934+0000","last_undegraded":"2024-08-31T04:22:26.262934+0000","last_fullsized":"2024-08-31T04:22:26.262934+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:32:59.785563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"78'37","reported_seq":314,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:23:01.002755+0000","last_change":"2024-08-31T04:20:39.907452+0000","last_active":"2024-08-31T04:23:01.002755+0000","last_peered":"2024-08-31T04:23:01.002755+0000","last_clean":"2024-08-31T04:23:01.002755+0000","last_became_active":"2024-08-31T04:20:39.907071+0000","last_became_peered":"2024-08-31T04:20:39.907071+0000","last_unstale":"2024-08-31T04:23:01.002755+0000","last_undegraded":"2024-08-31T04:23:01.002755+0000","last_fullsized":"2024-08-31T04:23:01.002755+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_clean_scrub_stamp":"2024-08-31T04:20:38.871450+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:21:33.318332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65695,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":249,"num_read_kb":183,"num_write":39,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"78'6","reported_seq":27,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:22:26.251640+0000","last_change":"2024-08-31T04:20:42.937750+0000","last_active":"2024-08-31T04:22:26.251640+0000","last_peered":"2024-08-31T04:22:26.251640+0000","last_clean":"2024-08-31T04:22:26.251640+0000","last_became_active":"2024-08-31T04:20:42.937386+0000","last_became_peered":"2024-08-31T04:20:42.937386+0000","last_unstale":"2024-08-31T04:22:26.251640+0000","last_undegraded":"2024-08-31T04:22:26.251640+0000","last_fullsized":"2024-08-31T04:22:26.251640+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:14:03.123558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"78'9","reported_seq":39,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:21:02.054882+0000","last_change":"2024-08-31T04:20:39.902815+0000","last_active":"2024-08-31T04:21:02.054882+0000","last_peered":"2024-08-31T04:21:02.054882+0000","last_clean":"2024-08-31T04:21:02.054882+0000","last_became_active":"2024-08-31T04:20:39.900473+0000","last_became_peered":"2024-08-31T04:20:39.900473+0000","last_unstale":"2024-08-31T04:21:02.054882+0000","last_undegraded":"2024-08-31T04:21:02.054882+0000","last_fullsized":"2024-08-31T04:21:02.054882+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_clean_scrub_stamp":"2024-08-31T04:20:38.871450+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:42:03.902102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"78'9","reported_seq":30,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:22:26.254374+0000","last_change":"2024-08-31T04:20:42.932333+0000","last_active":"2024-08-31T04:22:26.254374+0000","last_peered":"2024-08-31T04:22:26.254374+0000","last_clean":"2024-08-31T04:22:26.254374+0000","last_became_active":"2024-08-31T04:20:42.931902+0000","last_became_peered":"2024-08-31T04:20:42.931902+0000","last_unstale":"2024-08-31T04:22:26.254374+0000","last_undegraded":"2024-08-31T04:22:26.254374+0000","last_fullsized":"2024-08-31T04:22:26.254374+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:46:44.716941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"78'5","reported_seq":34,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:21:02.052921+0000","last_change":"2024-08-31T04:20:39.901541+0000","last_active":"2024-08-31T04:21:02.052921+0000","last_peered":"2024-08-31T04:21:02.052921+0000","last_clean":"2024-08-31T04:21:02.052921+0000","last_became_active":"2024-08-31T04:20:39.901116+0000","last_became_peered":"2024-08-31T04:20:39.901116+0000","last_unstale":"2024-08-31T04:21:02.052921+0000","last_undegraded":"2024-08-31T04:21:02.052921+0000","last_fullsized":"2024-08-31T04:21:02.052921+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_clean_scrub_stamp":"2024-08-31T04:20:38.871450+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:57:51.458017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"78'15","reported_seq":36,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:22:26.258400+0000","last_change":"2024-08-31T04:20:42.936355+0000","last_active":"2024-08-31T04:22:26.258400+0000","last_peered":"2024-08-31T04:22:26.258400+0000","last_clean":"2024-08-31T04:22:26.258400+0000","last_became_active":"2024-08-31T04:20:42.935975+0000","last_became_peered":"2024-08-31T04:20:42.935975+0000","last_unstale":"2024-08-31T04:22:26.258400+0000","last_undegraded":"2024-08-31T04:22:26.258400+0000","last_fullsized":"2024-08-31T04:22:26.258400+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:37:24.867700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"78'8","reported_seq":160,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:23:00.244704+0000","last_change":"2024-08-31T04:20:39.901314+0000","last_active":"2024-08-31T04:23:00.244704+0000","last_peered":"2024-08-31T04:23:00.244704+0000","last_clean":"2024-08-31T04:23:00.244704+0000","last_became_active":"2024-08-31T04:20:39.900780+0000","last_became_peered":"2024-08-31T04:20:39.900780+0000","last_unstale":"2024-08-31T04:23:00.244704+0000","last_undegraded":"2024-08-31T04:23:00.244704+0000","last_fullsized":"2024-08-31T04:23:00.244704+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_clean_scrub_stamp":"2024-08-31T04:20:38.871450+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:59:40.500765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1431,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":125,"num_read_kb":6,"num_write":8,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"78'6","reported_seq":27,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:22:26.253973+0000","last_change":"2024-08-31T04:20:42.934382+0000","last_active":"2024-08-31T04:22:26.253973+0000","last_peered":"2024-08-31T04:22:26.253973+0000","last_clean":"2024-08-31T04:22:26.253973+0000","last_became_active":"2024-08-31T04:20:42.933986+0000","last_became_peered":"2024-08-31T04:20:42.933986+0000","last_unstale":"2024-08-31T04:22:26.253973+0000","last_undegraded":"2024-08-31T04:22:26.253973+0000","last_fullsized":"2024-08-31T04:22:26.253973+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:12:16.372504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"78'17","reported_seq":46,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:21:02.053828+0000","last_change":"2024-08-31T04:20:39.990817+0000","last_active":"2024-08-31T04:21:02.053828+0000","last_peered":"2024-08-31T04:21:02.053828+0000","last_clean":"2024-08-31T04:21:02.053828+0000","last_became_active":"2024-08-31T04:20:39.990379+0000","last_became_peered":"2024-08-31T04:20:39.990379+0000","last_unstale":"2024-08-31T04:21:02.053828+0000","last_undegraded":"2024-08-31T04:21:02.053828+0000","last_fullsized":"2024-08-31T04:21:02.053828+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_clean_scrub_stamp":"2024-08-31T04:20:38.871450+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:42:27.435142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"78'6","reported_seq":27,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:22:26.253798+0000","last_change":"2024-08-31T04:20:42.942430+0000","last_active":"2024-08-31T04:22:26.253798+0000","last_peered":"2024-08-31T04:22:26.253798+0000","last_clean":"2024-08-31T04:22:26.253798+0000","last_became_active":"2024-08-31T04:20:42.942067+0000","last_became_peered":"2024-08-31T04:20:42.942067+0000","last_unstale":"2024-08-31T04:22:26.253798+0000","last_undegraded":"2024-08-31T04:22:26.253798+0000","last_fullsized":"2024-08-31T04:22:26.253798+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:48:52.441499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"77'2","reported_seq":31,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:21:02.054755+0000","last_change":"2024-08-31T04:20:39.903815+0000","last_active":"2024-08-31T04:21:02.054755+0000","last_peered":"2024-08-31T04:21:02.054755+0000","last_clean":"2024-08-31T04:21:02.054755+0000","last_became_active":"2024-08-31T04:20:39.903183+0000","last_became_peered":"2024-08-31T04:20:39.903183+0000","last_unstale":"2024-08-31T04:21:02.054755+0000","last_undegraded":"2024-08-31T04:21:02.054755+0000","last_fullsized":"2024-08-31T04:21:02.054755+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_clean_scrub_stamp":"2024-08-31T04:20:38.871450+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:39:50.862711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"78'5","reported_seq":34,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:22:26.255171+0000","last_change":"2024-08-31T04:20:57.004852+0000","last_active":"2024-08-31T04:22:26.255171+0000","last_peered":"2024-08-31T04:22:26.255171+0000","last_clean":"2024-08-31T04:22:26.255171+0000","last_became_active":"2024-08-31T04:20:57.004435+0000","last_became_peered":"2024-08-31T04:20:57.004435+0000","last_unstale":"2024-08-31T04:22:26.255171+0000","last_undegraded":"2024-08-31T04:22:26.255171+0000","last_fullsized":"2024-08-31T04:22:26.255171+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T06:16:19.010305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,6],"acting":[11,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"78'5","reported_seq":33,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:21:01.047914+0000","last_change":"2024-08-31T04:20:39.901493+0000","last_active":"2024-08-31T04:21:01.047914+0000","last_peered":"2024-08-31T04:21:01.047914+0000","last_clean":"2024-08-31T04:21:01.047914+0000","last_became_active":"2024-08-31T04:20:39.901072+0000","last_became_peered":"2024-08-31T04:20:39.901072+0000","last_unstale":"2024-08-31T04:21:01.047914+0000","last_undegraded":"2024-08-31T04:21:01.047914+0000","last_fullsized":"2024-08-31T04:21:01.047914+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_clean_scrub_stamp":"2024-08-31T04:20:38.871450+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:26:43.893882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"78'9","reported_seq":31,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:22:26.247690+0000","last_change":"2024-08-31T04:20:42.938270+0000","last_active":"2024-08-31T04:22:26.247690+0000","last_peered":"2024-08-31T04:22:26.247690+0000","last_clean":"2024-08-31T04:22:26.247690+0000","last_became_active":"2024-08-31T04:20:42.937851+0000","last_became_peered":"2024-08-31T04:20:42.937851+0000","last_unstale":"2024-08-31T04:22:26.247690+0000","last_undegraded":"2024-08-31T04:22:26.247690+0000","last_fullsized":"2024-08-31T04:22:26.247690+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:29:09.315106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"78'3","reported_seq":32,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:21:02.054203+0000","last_change":"2024-08-31T04:20:39.905785+0000","last_active":"2024-08-31T04:21:02.054203+0000","last_peered":"2024-08-31T04:21:02.054203+0000","last_clean":"2024-08-31T04:21:02.054203+0000","last_became_active":"2024-08-31T04:20:39.905403+0000","last_became_peered":"2024-08-31T04:20:39.905403+0000","last_unstale":"2024-08-31T04:21:02.054203+0000","last_undegraded":"2024-08-31T04:21:02.054203+0000","last_fullsized":"2024-08-31T04:21:02.054203+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_clean_scrub_stamp":"2024-08-31T04:20:38.871450+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:48:04.743543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"78'7","reported_seq":29,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:22:26.250051+0000","last_change":"2024-08-31T04:20:42.934433+0000","last_active":"2024-08-31T04:22:26.250051+0000","last_peered":"2024-08-31T04:22:26.250051+0000","last_clean":"2024-08-31T04:22:26.250051+0000","last_became_active":"2024-08-31T04:20:42.934058+0000","last_became_peered":"2024-08-31T04:20:42.934058+0000","last_unstale":"2024-08-31T04:22:26.250051+0000","last_undegraded":"2024-08-31T04:22:26.250051+0000","last_fullsized":"2024-08-31T04:22:26.250051+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:34:42.988905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"78'7","reported_seq":159,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:23:00.244188+0000","last_change":"2024-08-31T04:20:40.202403+0000","last_active":"2024-08-31T04:23:00.244188+0000","last_peered":"2024-08-31T04:23:00.244188+0000","last_clean":"2024-08-31T04:23:00.244188+0000","last_became_active":"2024-08-31T04:20:40.201918+0000","last_became_peered":"2024-08-31T04:20:40.201918+0000","last_unstale":"2024-08-31T04:23:00.244188+0000","last_undegraded":"2024-08-31T04:23:00.244188+0000","last_fullsized":"2024-08-31T04:23:00.244188+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_clean_scrub_stamp":"2024-08-31T04:20:38.871450+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:31:26.675413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1702,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":124,"num_read_kb":4,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"78'7","reported_seq":29,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:22:26.258221+0000","last_change":"2024-08-31T04:20:42.931040+0000","last_active":"2024-08-31T04:22:26.258221+0000","last_peered":"2024-08-31T04:22:26.258221+0000","last_clean":"2024-08-31T04:22:26.258221+0000","last_became_active":"2024-08-31T04:20:42.930692+0000","last_became_peered":"2024-08-31T04:20:42.930692+0000","last_unstale":"2024-08-31T04:22:26.258221+0000","last_undegraded":"2024-08-31T04:22:26.258221+0000","last_fullsized":"2024-08-31T04:22:26.258221+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T06:12:23.175092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"20'92","reported_seq":99,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:20:57.003516+0000","last_change":"2024-08-31T04:19:21.361791+0000","last_active":"2024-08-31T04:20:57.003516+0000","last_peered":"2024-08-31T04:20:57.003516+0000","last_clean":"2024-08-31T04:20:57.003516+0000","last_became_active":"2024-08-31T04:19:21.356128+0000","last_became_peered":"2024-08-31T04:19:21.356128+0000","last_unstale":"2024-08-31T04:20:57.003516+0000","last_undegraded":"2024-08-31T04:20:57.003516+0000","last_fullsized":"2024-08-31T04:20:57.003516+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:15:46.442365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:15:46.442365+0000","last_clean_scrub_stamp":"2024-08-31T04:15:46.442365+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:23:05.688680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"78'6","reported_seq":37,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:21:02.054186+0000","last_change":"2024-08-31T04:20:39.904625+0000","last_active":"2024-08-31T04:21:02.054186+0000","last_peered":"2024-08-31T04:21:02.054186+0000","last_clean":"2024-08-31T04:21:02.054186+0000","last_became_active":"2024-08-31T04:20:39.904245+0000","last_became_peered":"2024-08-31T04:20:39.904245+0000","last_unstale":"2024-08-31T04:21:02.054186+0000","last_undegraded":"2024-08-31T04:21:02.054186+0000","last_fullsized":"2024-08-31T04:21:02.054186+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_clean_scrub_stamp":"2024-08-31T04:20:38.871450+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:31:34.711047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"78'8","reported_seq":30,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:22:26.264104+0000","last_change":"2024-08-31T04:20:42.944224+0000","last_active":"2024-08-31T04:22:26.264104+0000","last_peered":"2024-08-31T04:22:26.264104+0000","last_clean":"2024-08-31T04:22:26.264104+0000","last_became_active":"2024-08-31T04:20:42.943469+0000","last_became_peered":"2024-08-31T04:20:42.943469+0000","last_unstale":"2024-08-31T04:22:26.264104+0000","last_undegraded":"2024-08-31T04:22:26.264104+0000","last_fullsized":"2024-08-31T04:22:26.264104+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:27:48.533319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"78'4","reported_seq":32,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:21:01.049039+0000","last_change":"2024-08-31T04:20:39.902613+0000","last_active":"2024-08-31T04:21:01.049039+0000","last_peered":"2024-08-31T04:21:01.049039+0000","last_clean":"2024-08-31T04:21:01.049039+0000","last_became_active":"2024-08-31T04:20:39.902033+0000","last_became_peered":"2024-08-31T04:20:39.902033+0000","last_unstale":"2024-08-31T04:21:01.049039+0000","last_undegraded":"2024-08-31T04:21:01.049039+0000","last_fullsized":"2024-08-31T04:21:01.049039+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_clean_scrub_stamp":"2024-08-31T04:20:38.871450+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:13:58.497781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"78'5","reported_seq":27,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:22:26.248712+0000","last_change":"2024-08-31T04:20:42.933541+0000","last_active":"2024-08-31T04:22:26.248712+0000","last_peered":"2024-08-31T04:22:26.248712+0000","last_clean":"2024-08-31T04:22:26.248712+0000","last_became_active":"2024-08-31T04:20:42.933155+0000","last_became_peered":"2024-08-31T04:20:42.933155+0000","last_unstale":"2024-08-31T04:22:26.248712+0000","last_undegraded":"2024-08-31T04:22:26.248712+0000","last_fullsized":"2024-08-31T04:22:26.248712+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:22:41.298103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"78'7","reported_seq":153,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:22:58.240824+0000","last_change":"2024-08-31T04:20:39.992067+0000","last_active":"2024-08-31T04:22:58.240824+0000","last_peered":"2024-08-31T04:22:58.240824+0000","last_clean":"2024-08-31T04:22:58.240824+0000","last_became_active":"2024-08-31T04:20:39.991645+0000","last_became_peered":"2024-08-31T04:20:39.991645+0000","last_unstale":"2024-08-31T04:22:58.240824+0000","last_undegraded":"2024-08-31T04:22:58.240824+0000","last_fullsized":"2024-08-31T04:22:58.240824+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_clean_scrub_stamp":"2024-08-31T04:20:38.871450+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:41:18.012094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":118,"num_read_kb":118,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"78'8","reported_seq":30,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:22:26.253434+0000","last_change":"2024-08-31T04:20:42.937324+0000","last_active":"2024-08-31T04:22:26.253434+0000","last_peered":"2024-08-31T04:22:26.253434+0000","last_clean":"2024-08-31T04:22:26.253434+0000","last_became_active":"2024-08-31T04:20:42.936926+0000","last_became_peered":"2024-08-31T04:20:42.936926+0000","last_unstale":"2024-08-31T04:22:26.253434+0000","last_undegraded":"2024-08-31T04:22:26.253434+0000","last_fullsized":"2024-08-31T04:22:26.253434+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:34:57.158304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"78'5","reported_seq":153,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:22:59.241861+0000","last_change":"2024-08-31T04:20:39.905365+0000","last_active":"2024-08-31T04:22:59.241861+0000","last_peered":"2024-08-31T04:22:59.241861+0000","last_clean":"2024-08-31T04:22:59.241861+0000","last_became_active":"2024-08-31T04:20:39.904772+0000","last_became_peered":"2024-08-31T04:20:39.904772+0000","last_unstale":"2024-08-31T04:22:59.241861+0000","last_undegraded":"2024-08-31T04:22:59.241861+0000","last_fullsized":"2024-08-31T04:22:59.241861+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_clean_scrub_stamp":"2024-08-31T04:20:38.871450+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T05:20:23.781639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":120,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"78'7","reported_seq":29,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:22:26.258493+0000","last_change":"2024-08-31T04:20:42.944303+0000","last_active":"2024-08-31T04:22:26.258493+0000","last_peered":"2024-08-31T04:22:26.258493+0000","last_clean":"2024-08-31T04:22:26.258493+0000","last_became_active":"2024-08-31T04:20:42.943938+0000","last_became_peered":"2024-08-31T04:20:42.943938+0000","last_unstale":"2024-08-31T04:22:26.258493+0000","last_undegraded":"2024-08-31T04:22:26.258493+0000","last_fullsized":"2024-08-31T04:22:26.258493+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T06:51:28.734751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"77'1","reported_seq":29,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:20:57.004699+0000","last_change":"2024-08-31T04:20:39.993135+0000","last_active":"2024-08-31T04:20:57.004699+0000","last_peered":"2024-08-31T04:20:57.004699+0000","last_clean":"2024-08-31T04:20:57.004699+0000","last_became_active":"2024-08-31T04:20:39.991569+0000","last_became_peered":"2024-08-31T04:20:39.991569+0000","last_unstale":"2024-08-31T04:20:57.004699+0000","last_undegraded":"2024-08-31T04:20:57.004699+0000","last_fullsized":"2024-08-31T04:20:57.004699+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_clean_scrub_stamp":"2024-08-31T04:20:38.871450+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:44:04.375810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"78'5","reported_seq":27,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:22:26.255803+0000","last_change":"2024-08-31T04:20:42.939721+0000","last_active":"2024-08-31T04:22:26.255803+0000","last_peered":"2024-08-31T04:22:26.255803+0000","last_clean":"2024-08-31T04:22:26.255803+0000","last_became_active":"2024-08-31T04:20:42.939380+0000","last_became_peered":"2024-08-31T04:20:42.939380+0000","last_unstale":"2024-08-31T04:22:26.255803+0000","last_undegraded":"2024-08-31T04:22:26.255803+0000","last_fullsized":"2024-08-31T04:22:26.255803+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:55:06.901719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"78'4","reported_seq":33,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:21:02.054159+0000","last_change":"2024-08-31T04:20:39.990968+0000","last_active":"2024-08-31T04:21:02.054159+0000","last_peered":"2024-08-31T04:21:02.054159+0000","last_clean":"2024-08-31T04:21:02.054159+0000","last_became_active":"2024-08-31T04:20:39.990583+0000","last_became_peered":"2024-08-31T04:20:39.990583+0000","last_unstale":"2024-08-31T04:21:02.054159+0000","last_undegraded":"2024-08-31T04:21:02.054159+0000","last_fullsized":"2024-08-31T04:21:02.054159+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_clean_scrub_stamp":"2024-08-31T04:20:38.871450+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:54:39.168179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"78'9","reported_seq":31,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:22:26.247852+0000","last_change":"2024-08-31T04:20:42.932914+0000","last_active":"2024-08-31T04:22:26.247852+0000","last_peered":"2024-08-31T04:22:26.247852+0000","last_clean":"2024-08-31T04:22:26.247852+0000","last_became_active":"2024-08-31T04:20:42.932523+0000","last_became_peered":"2024-08-31T04:20:42.932523+0000","last_unstale":"2024-08-31T04:22:26.247852+0000","last_undegraded":"2024-08-31T04:22:26.247852+0000","last_fullsized":"2024-08-31T04:22:26.247852+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:52:49.133428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"78'18","reported_seq":46,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:22:50.362860+0000","last_change":"2024-08-31T04:20:39.903373+0000","last_active":"2024-08-31T04:22:50.362860+0000","last_peered":"2024-08-31T04:22:50.362860+0000","last_clean":"2024-08-31T04:22:50.362860+0000","last_became_active":"2024-08-31T04:20:39.902784+0000","last_became_peered":"2024-08-31T04:20:39.902784+0000","last_unstale":"2024-08-31T04:22:50.362860+0000","last_undegraded":"2024-08-31T04:22:50.362860+0000","last_fullsized":"2024-08-31T04:22:50.362860+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_clean_scrub_stamp":"2024-08-31T04:20:38.871450+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:43:32.251846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"78'5","reported_seq":27,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:22:26.252323+0000","last_change":"2024-08-31T04:20:42.939252+0000","last_active":"2024-08-31T04:22:26.252323+0000","last_peered":"2024-08-31T04:22:26.252323+0000","last_clean":"2024-08-31T04:22:26.252323+0000","last_became_active":"2024-08-31T04:20:42.936671+0000","last_became_peered":"2024-08-31T04:20:42.936671+0000","last_unstale":"2024-08-31T04:22:26.252323+0000","last_undegraded":"2024-08-31T04:22:26.252323+0000","last_fullsized":"2024-08-31T04:22:26.252323+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:37:57.544627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"78'7","reported_seq":36,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:21:02.053527+0000","last_change":"2024-08-31T04:20:40.202412+0000","last_active":"2024-08-31T04:21:02.053527+0000","last_peered":"2024-08-31T04:21:02.053527+0000","last_clean":"2024-08-31T04:21:02.053527+0000","last_became_active":"2024-08-31T04:20:40.202000+0000","last_became_peered":"2024-08-31T04:20:40.202000+0000","last_unstale":"2024-08-31T04:21:02.053527+0000","last_undegraded":"2024-08-31T04:21:02.053527+0000","last_fullsized":"2024-08-31T04:21:02.053527+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_clean_scrub_stamp":"2024-08-31T04:20:38.871450+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:24:23.528379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"78'7","reported_seq":29,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:22:26.257761+0000","last_change":"2024-08-31T04:20:42.949174+0000","last_active":"2024-08-31T04:22:26.257761+0000","last_peered":"2024-08-31T04:22:26.257761+0000","last_clean":"2024-08-31T04:22:26.257761+0000","last_became_active":"2024-08-31T04:20:42.948013+0000","last_became_peered":"2024-08-31T04:20:42.948013+0000","last_unstale":"2024-08-31T04:22:26.257761+0000","last_undegraded":"2024-08-31T04:22:26.257761+0000","last_fullsized":"2024-08-31T04:22:26.257761+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:36:00.572991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"76'2","reported_seq":30,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:20:57.223313+0000","last_change":"2024-08-31T04:20:39.992477+0000","last_active":"2024-08-31T04:20:57.223313+0000","last_peered":"2024-08-31T04:20:57.223313+0000","last_clean":"2024-08-31T04:20:57.223313+0000","last_became_active":"2024-08-31T04:20:39.992082+0000","last_became_peered":"2024-08-31T04:20:39.992082+0000","last_unstale":"2024-08-31T04:20:57.223313+0000","last_undegraded":"2024-08-31T04:20:57.223313+0000","last_fullsized":"2024-08-31T04:20:57.223313+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_clean_scrub_stamp":"2024-08-31T04:20:38.871450+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:10:35.058693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"78'2","reported_seq":24,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:22:26.251210+0000","last_change":"2024-08-31T04:20:42.933915+0000","last_active":"2024-08-31T04:22:26.251210+0000","last_peered":"2024-08-31T04:22:26.251210+0000","last_clean":"2024-08-31T04:22:26.251210+0000","last_became_active":"2024-08-31T04:20:42.933525+0000","last_became_peered":"2024-08-31T04:20:42.933525+0000","last_unstale":"2024-08-31T04:22:26.251210+0000","last_undegraded":"2024-08-31T04:22:26.251210+0000","last_fullsized":"2024-08-31T04:22:26.251210+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:03:35.191136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"78'7","reported_seq":35,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:21:01.048268+0000","last_change":"2024-08-31T04:20:39.903979+0000","last_active":"2024-08-31T04:21:01.048268+0000","last_peered":"2024-08-31T04:21:01.048268+0000","last_clean":"2024-08-31T04:21:01.048268+0000","last_became_active":"2024-08-31T04:20:39.903538+0000","last_became_peered":"2024-08-31T04:20:39.903538+0000","last_unstale":"2024-08-31T04:21:01.048268+0000","last_undegraded":"2024-08-31T04:21:01.048268+0000","last_fullsized":"2024-08-31T04:21:01.048268+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_clean_scrub_stamp":"2024-08-31T04:20:38.871450+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:25:15.944692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"78'9","reported_seq":31,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:22:26.257776+0000","last_change":"2024-08-31T04:20:42.947511+0000","last_active":"2024-08-31T04:22:26.257776+0000","last_peered":"2024-08-31T04:22:26.257776+0000","last_clean":"2024-08-31T04:22:26.257776+0000","last_became_active":"2024-08-31T04:20:42.947116+0000","last_became_peered":"2024-08-31T04:20:42.947116+0000","last_unstale":"2024-08-31T04:22:26.257776+0000","last_undegraded":"2024-08-31T04:22:26.257776+0000","last_fullsized":"2024-08-31T04:22:26.257776+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:00:53.022229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"78'3","reported_seq":31,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:21:02.009035+0000","last_change":"2024-08-31T04:20:39.903409+0000","last_active":"2024-08-31T04:21:02.009035+0000","last_peered":"2024-08-31T04:21:02.009035+0000","last_clean":"2024-08-31T04:21:02.009035+0000","last_became_active":"2024-08-31T04:20:39.900366+0000","last_became_peered":"2024-08-31T04:20:39.900366+0000","last_unstale":"2024-08-31T04:21:02.009035+0000","last_undegraded":"2024-08-31T04:21:02.009035+0000","last_fullsized":"2024-08-31T04:21:02.009035+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_clean_scrub_stamp":"2024-08-31T04:20:38.871450+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:01:24.809923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"78'8","reported_seq":30,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:22:26.256433+0000","last_change":"2024-08-31T04:20:42.953207+0000","last_active":"2024-08-31T04:22:26.256433+0000","last_peered":"2024-08-31T04:22:26.256433+0000","last_clean":"2024-08-31T04:22:26.256433+0000","last_became_active":"2024-08-31T04:20:42.952854+0000","last_became_peered":"2024-08-31T04:20:42.952854+0000","last_unstale":"2024-08-31T04:22:26.256433+0000","last_undegraded":"2024-08-31T04:22:26.256433+0000","last_fullsized":"2024-08-31T04:22:26.256433+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:33:11.495216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"76'4","reported_seq":21,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:21:00.180014+0000","last_change":"2024-08-31T04:20:57.016087+0000","last_active":"2024-08-31T04:21:00.180014+0000","last_peered":"2024-08-31T04:21:00.180014+0000","last_clean":"2024-08-31T04:21:00.180014+0000","last_became_active":"2024-08-31T04:20:57.005476+0000","last_became_peered":"2024-08-31T04:20:57.005476+0000","last_unstale":"2024-08-31T04:21:00.180014+0000","last_undegraded":"2024-08-31T04:21:00.180014+0000","last_fullsized":"2024-08-31T04:21:00.180014+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_clean_scrub_stamp":"2024-08-31T04:20:38.871450+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:22:21.768548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,7],"acting":[11,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.a","version":"78'5","reported_seq":27,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:22:26.258724+0000","last_change":"2024-08-31T04:20:42.933249+0000","last_active":"2024-08-31T04:22:26.258724+0000","last_peered":"2024-08-31T04:22:26.258724+0000","last_clean":"2024-08-31T04:22:26.258724+0000","last_became_active":"2024-08-31T04:20:42.931651+0000","last_became_peered":"2024-08-31T04:20:42.931651+0000","last_unstale":"2024-08-31T04:22:26.258724+0000","last_undegraded":"2024-08-31T04:22:26.258724+0000","last_fullsized":"2024-08-31T04:22:26.258724+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T06:40:21.010108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"78'15","reported_seq":36,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:22:26.254278+0000","last_change":"2024-08-31T04:20:42.942418+0000","last_active":"2024-08-31T04:22:26.254278+0000","last_peered":"2024-08-31T04:22:26.254278+0000","last_clean":"2024-08-31T04:22:26.254278+0000","last_became_active":"2024-08-31T04:20:42.942072+0000","last_became_peered":"2024-08-31T04:20:42.942072+0000","last_unstale":"2024-08-31T04:22:26.254278+0000","last_undegraded":"2024-08-31T04:22:26.254278+0000","last_fullsized":"2024-08-31T04:22:26.254278+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T04:41:38.816730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"78'5","reported_seq":33,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:21:01.049947+0000","last_change":"2024-08-31T04:20:39.903399+0000","last_active":"2024-08-31T04:21:01.049947+0000","last_peered":"2024-08-31T04:21:01.049947+0000","last_clean":"2024-08-31T04:21:01.049947+0000","last_became_active":"2024-08-31T04:20:39.902732+0000","last_became_peered":"2024-08-31T04:20:39.902732+0000","last_unstale":"2024-08-31T04:21:01.049947+0000","last_undegraded":"2024-08-31T04:21:01.049947+0000","last_fullsized":"2024-08-31T04:21:01.049947+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_clean_scrub_stamp":"2024-08-31T04:20:38.871450+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:07:25.324109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"78'9","reported_seq":30,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:22:26.261641+0000","last_change":"2024-08-31T04:20:42.931570+0000","last_active":"2024-08-31T04:22:26.261641+0000","last_peered":"2024-08-31T04:22:26.261641+0000","last_clean":"2024-08-31T04:22:26.261641+0000","last_became_active":"2024-08-31T04:20:42.931162+0000","last_became_peered":"2024-08-31T04:20:42.931162+0000","last_unstale":"2024-08-31T04:22:26.261641+0000","last_undegraded":"2024-08-31T04:22:26.261641+0000","last_fullsized":"2024-08-31T04:22:26.261641+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:55:58.784723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"78'12","reported_seq":27,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:21:02.054140+0000","last_change":"2024-08-31T04:20:57.020014+0000","last_active":"2024-08-31T04:21:02.054140+0000","last_peered":"2024-08-31T04:21:02.054140+0000","last_clean":"2024-08-31T04:21:02.054140+0000","last_became_active":"2024-08-31T04:20:57.009489+0000","last_became_peered":"2024-08-31T04:20:57.009489+0000","last_unstale":"2024-08-31T04:21:02.054140+0000","last_undegraded":"2024-08-31T04:21:02.054140+0000","last_fullsized":"2024-08-31T04:21:02.054140+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_clean_scrub_stamp":"2024-08-31T04:20:38.871450+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T05:22:57.227296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":10,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,7],"acting":[11,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1f","version":"78'6","reported_seq":28,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:22:26.262854+0000","last_change":"2024-08-31T04:20:42.947868+0000","last_active":"2024-08-31T04:22:26.262854+0000","last_peered":"2024-08-31T04:22:26.262854+0000","last_clean":"2024-08-31T04:22:26.262854+0000","last_became_active":"2024-08-31T04:20:42.946628+0000","last_became_peered":"2024-08-31T04:20:42.946628+0000","last_unstale":"2024-08-31T04:22:26.262854+0000","last_undegraded":"2024-08-31T04:22:26.262854+0000","last_fullsized":"2024-08-31T04:22:26.262854+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:47:10.939205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"76'2","reported_seq":30,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:20:57.338832+0000","last_change":"2024-08-31T04:20:39.991234+0000","last_active":"2024-08-31T04:20:57.338832+0000","last_peered":"2024-08-31T04:20:57.338832+0000","last_clean":"2024-08-31T04:20:57.338832+0000","last_became_active":"2024-08-31T04:20:39.990416+0000","last_became_peered":"2024-08-31T04:20:39.990416+0000","last_unstale":"2024-08-31T04:20:57.338832+0000","last_undegraded":"2024-08-31T04:20:57.338832+0000","last_fullsized":"2024-08-31T04:20:57.338832+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_clean_scrub_stamp":"2024-08-31T04:20:38.871450+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:47:43.392522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"78'5","reported_seq":27,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:22:26.251186+0000","last_change":"2024-08-31T04:20:42.942017+0000","last_active":"2024-08-31T04:22:26.251186+0000","last_peered":"2024-08-31T04:22:26.251186+0000","last_clean":"2024-08-31T04:22:26.251186+0000","last_became_active":"2024-08-31T04:20:42.939661+0000","last_became_peered":"2024-08-31T04:20:42.939661+0000","last_unstale":"2024-08-31T04:22:26.251186+0000","last_undegraded":"2024-08-31T04:22:26.251186+0000","last_fullsized":"2024-08-31T04:22:26.251186+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:13:39.521066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"78'13","reported_seq":161,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:22:59.241117+0000","last_change":"2024-08-31T04:20:39.905996+0000","last_active":"2024-08-31T04:22:59.241117+0000","last_peered":"2024-08-31T04:22:59.241117+0000","last_clean":"2024-08-31T04:22:59.241117+0000","last_became_active":"2024-08-31T04:20:39.905622+0000","last_became_peered":"2024-08-31T04:20:39.905622+0000","last_unstale":"2024-08-31T04:22:59.241117+0000","last_undegraded":"2024-08-31T04:22:59.241117+0000","last_fullsized":"2024-08-31T04:22:59.241117+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_clean_scrub_stamp":"2024-08-31T04:20:38.871450+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:53:36.672295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":120,"num_read_kb":120,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":74024,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":1236,"num_read_kb":694,"num_write":265,"num_write_kb":156,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":622,"num_keys_recovered":10,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":577536,"data_stored":222072,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":228,"ondisk_log_size":228,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":245760,"data_stored":2951840,"data_compressed":181705,"data_compressed_allocated":225280,"data_compressed_original":2949120,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":68,"seq":292057776170,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32012,"kb_used_data":828,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713140,"statfs":{"total":95995035648,"available":95962255360,"internally_reserved":0,"allocated":847872,"data_stored":413797,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":63,"seq":270582939694,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28004,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717148,"statfs":{"total":95995035648,"available":95966359552,"internally_reserved":0,"allocated":1003520,"data_stored":1065459,"data_compressed":36341,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":58,"seq":249108103221,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36196,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708956,"statfs":{"total":95995035648,"available":95957970944,"internally_reserved":0,"allocated":872448,"data_stored":413195,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,5,6,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":52,"seq":223338299449,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27872,"kb_used_data":848,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717280,"statfs":{"total":95995035648,"available":95966494720,"internally_reserved":0,"allocated":868352,"data_stored":413573,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":47,"seq":201863462976,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27924,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717228,"statfs":{"total":95995035648,"available":95966441472,"internally_reserved":0,"allocated":921600,"data_stored":1007075,"data_compressed":36341,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":42,"seq":180388626500,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32020,"kb_used_data":836,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713132,"statfs":{"total":95995035648,"available":95962247168,"internally_reserved":0,"allocated":856064,"data_stored":412912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":36,"seq":154618822731,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27936,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717216,"statfs":{"total":95995035648,"available":95966429184,"internally_reserved":0,"allocated":933888,"data_stored":1005910,"data_compressed":36341,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986255,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27860,"kb_used_data":836,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717292,"statfs":{"total":95995035648,"available":95966507008,"internally_reserved":0,"allocated":856064,"data_stored":413616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182483,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36196,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708956,"statfs":{"total":95995035648,"available":95957970944,"internally_reserved":0,"allocated":872448,"data_stored":412737,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411419,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27936,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717216,"statfs":{"total":95995035648,"available":95966429184,"internally_reserved":0,"allocated":933888,"data_stored":479650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574944,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27932,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717220,"statfs":{"total":95995035648,"available":95966433280,"internally_reserved":0,"allocated":929792,"data_stored":480674,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738467,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27880,"kb_used_data":856,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717272,"statfs":{"total":95995035648,"available":95966486528,"internally_reserved":0,"allocated":876544,"data_stored":414783,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36341,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36341,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36341,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36341,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36341,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2710,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":68601,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":67577,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1543,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3352,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":4517,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":118784,"data_stored":68274,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-31T04:23:05.665 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-08-31T04:23:05.666 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 058d9fc6-674f-11ef-bcd4-c7b262605968 -- ceph pg dump --format=json 2024-08-31T04:23:06.045 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:23:06.200 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:23:05 smithi050 ceph-mon[17259]: from='client.25306 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-31T04:23:06.200 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:23:05 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:23:06.200 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:23:05 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T04:23:06.200 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:23:05 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:23:06.246 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:23:05 smithi177 ceph-mon[22025]: from='client.25306 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-31T04:23:06.246 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:23:05 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:23:06.246 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:23:05 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T04:23:06.246 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:23:05 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:23:06.293 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:23:05 smithi133 ceph-mon[22177]: from='client.25306 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-31T04:23:06.293 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:23:05 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:23:06.293 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:23:05 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T04:23:06.293 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:23:05 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:23:06.695 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:06.694+0000 7fc4d3e00640 1 -- 172.21.15.50:0/358787402 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc4cc1141d0 msgr2=0x7fc4cc1166a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:23:06.695 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:06.694+0000 7fc4d3e00640 1 --2- 172.21.15.50:0/358787402 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc4cc1141d0 0x7fc4cc1166a0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fc4c4009ca0 tx=0x7fc4c402a8b0 comp rx=0 tx=0).stop 2024-08-31T04:23:06.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:06.694+0000 7fc4d3e00640 1 -- 172.21.15.50:0/358787402 shutdown_connections 2024-08-31T04:23:06.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:06.694+0000 7fc4d3e00640 1 --2- 172.21.15.50:0/358787402 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc4cc1141d0 0x7fc4cc1166a0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:06.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:06.694+0000 7fc4d3e00640 1 --2- 172.21.15.50:0/358787402 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc4cc075b70 0x7fc4cc075f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:06.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:06.694+0000 7fc4d3e00640 1 --2- 172.21.15.50:0/358787402 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc4cc077120 0x7fc4cc075550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:06.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:06.694+0000 7fc4d3e00640 1 -- 172.21.15.50:0/358787402 >> 172.21.15.50:0/358787402 conn(0x7fc4cc07b5f0 msgr2=0x7fc4cc07ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:23:06.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:06.694+0000 7fc4d3e00640 1 -- 172.21.15.50:0/358787402 shutdown_connections 2024-08-31T04:23:06.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:06.694+0000 7fc4d3e00640 1 -- 172.21.15.50:0/358787402 wait complete. 2024-08-31T04:23:06.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:06.695+0000 7fc4d3e00640 1 Processor -- start 2024-08-31T04:23:06.697 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:06.696+0000 7fc4d3e00640 1 -- start start 2024-08-31T04:23:06.697 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:06.696+0000 7fc4d3e00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc4cc075b70 0x7fc4cc1a07c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:06.697 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:06.696+0000 7fc4d3e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc4cc077120 0x7fc4cc1a0d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:06.697 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:06.696+0000 7fc4d3e00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc4cc1141d0 0x7fc4cc1a6000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:06.698 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:06.696+0000 7fc4d3e00640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fc4cc119e10 con 0x7fc4cc077120 2024-08-31T04:23:06.698 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:06.696+0000 7fc4d3e00640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7fc4cc119c90 con 0x7fc4cc075b70 2024-08-31T04:23:06.698 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:06.696+0000 7fc4d3e00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fc4cc119f90 con 0x7fc4cc1141d0 2024-08-31T04:23:06.698 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:06.697+0000 7fc4d0a00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc4cc077120 0x7fc4cc1a0d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:06.699 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:06.697+0000 7fc4d1400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc4cc075b70 0x7fc4cc1a07c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:06.699 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:06.697+0000 7fc4d1e00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc4cc1141d0 0x7fc4cc1a6000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:06.699 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:06.697+0000 7fc4d1400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc4cc075b70 0x7fc4cc1a07c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.50:50948/0 (socket says 172.21.15.50:50948) 2024-08-31T04:23:06.699 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:06.697+0000 7fc4d1400640 1 -- 172.21.15.50:0/1572223432 learned_addr learned my addr 172.21.15.50:0/1572223432 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:23:06.699 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:06.697+0000 7fc4d1400640 1 -- 172.21.15.50:0/1572223432 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc4cc1141d0 msgr2=0x7fc4cc1a6000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:23:06.699 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:06.697+0000 7fc4d1400640 1 --2- 172.21.15.50:0/1572223432 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc4cc1141d0 0x7fc4cc1a6000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:06.699 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:06.697+0000 7fc4d1400640 1 -- 172.21.15.50:0/1572223432 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc4cc077120 msgr2=0x7fc4cc1a0d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:23:06.699 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:06.697+0000 7fc4d1400640 1 --2- 172.21.15.50:0/1572223432 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc4cc077120 0x7fc4cc1a0d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:06.699 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:06.697+0000 7fc4d1400640 1 -- 172.21.15.50:0/1572223432 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4cc1a6730 con 0x7fc4cc075b70 2024-08-31T04:23:06.699 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:06.697+0000 7fc4d0a00640 1 --2- 172.21.15.50:0/1572223432 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc4cc077120 0x7fc4cc1a0d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:23:06.699 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:06.697+0000 7fc4d1400640 1 --2- 172.21.15.50:0/1572223432 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc4cc075b70 0x7fc4cc1a07c0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fc4c000e9f0 tx=0x7fc4c000edf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:23:06.700 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:06.698+0000 7fc4ca000640 1 -- 172.21.15.50:0/1572223432 <== mon.2 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4c000cd80 con 0x7fc4cc075b70 2024-08-31T04:23:06.700 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:06.698+0000 7fc4d3e00640 1 -- 172.21.15.50:0/1572223432 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc4cc1a6a20 con 0x7fc4cc075b70 2024-08-31T04:23:06.700 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:06.698+0000 7fc4ca000640 1 -- 172.21.15.50:0/1572223432 <== mon.2 v2:172.21.15.133:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc4c00054d0 con 0x7fc4cc075b70 2024-08-31T04:23:06.700 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:06.698+0000 7fc4ca000640 1 -- 172.21.15.50:0/1572223432 <== mon.2 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4c0010690 con 0x7fc4cc075b70 2024-08-31T04:23:06.700 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:06.698+0000 7fc4d3e00640 1 -- 172.21.15.50:0/1572223432 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc4cc1ad180 con 0x7fc4cc075b70 2024-08-31T04:23:06.701 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:06.699+0000 7fc4d3e00640 1 -- 172.21.15.50:0/1572223432 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc4cc075f80 con 0x7fc4cc075b70 2024-08-31T04:23:06.702 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:06.701+0000 7fc4ca000640 1 -- 172.21.15.50:0/1572223432 <== mon.2 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 18) ==== 152577+0+0 (secure 0 0 0) 0x7fc4c0004e30 con 0x7fc4cc075b70 2024-08-31T04:23:06.704 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:06.703+0000 7fc4ca000640 1 --2- 172.21.15.50:0/1572223432 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fc4b40b4b30 0x7fc4b40b7040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:06.704 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:06.703+0000 7fc4ca000640 1 -- 172.21.15.50:0/1572223432 <== mon.2 v2:172.21.15.133:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8219+0+0 (secure 0 0 0) 0x7fc4c00e5750 con 0x7fc4cc075b70 2024-08-31T04:23:06.705 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:06.703+0000 7fc4d0a00640 1 --2- 172.21.15.50:0/1572223432 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fc4b40b4b30 0x7fc4b40b7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:06.705 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:06.704+0000 7fc4d0a00640 1 --2- 172.21.15.50:0/1572223432 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fc4b40b4b30 0x7fc4b40b7040 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fc4cc1156d0 tx=0x7fc4b8005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:23:06.706 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:06.705+0000 7fc4ca000640 1 -- 172.21.15.50:0/1572223432 <== mon.2 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fc4c00ac830 con 0x7fc4cc075b70 2024-08-31T04:23:06.900 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:06.899+0000 7fc4d3e00640 1 -- 172.21.15.50:0/1572223432 --> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fc4cc113550 con 0x7fc4b40b4b30 2024-08-31T04:23:06.906 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:06.905+0000 7fc4ca000640 1 -- 172.21.15.50:0/1572223432 <== mgr.14150 v2:172.21.15.50:6800/2146686622 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258978 (secure 0 0 0) 0x7fc4cc113550 con 0x7fc4b40b4b30 2024-08-31T04:23:06.909 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-08-31T04:23:06.910 INFO:teuthology.orchestra.run.smithi050.stderr:dumped all 2024-08-31T04:23:06.912 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:06.910+0000 7fc4d3e00640 1 -- 172.21.15.50:0/1572223432 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fc4b40b4b30 msgr2=0x7fc4b40b7040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:23:06.912 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:06.910+0000 7fc4d3e00640 1 --2- 172.21.15.50:0/1572223432 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fc4b40b4b30 0x7fc4b40b7040 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fc4cc1156d0 tx=0x7fc4b8005f90 comp rx=0 tx=0).stop 2024-08-31T04:23:06.912 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:06.910+0000 7fc4d3e00640 1 -- 172.21.15.50:0/1572223432 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc4cc075b70 msgr2=0x7fc4cc1a07c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:23:06.912 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:06.910+0000 7fc4d3e00640 1 --2- 172.21.15.50:0/1572223432 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc4cc075b70 0x7fc4cc1a07c0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fc4c000e9f0 tx=0x7fc4c000edf0 comp rx=0 tx=0).stop 2024-08-31T04:23:06.912 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:06.910+0000 7fc4d3e00640 1 -- 172.21.15.50:0/1572223432 shutdown_connections 2024-08-31T04:23:06.912 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:06.910+0000 7fc4d3e00640 1 --2- 172.21.15.50:0/1572223432 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fc4b40b4b30 0x7fc4b40b7040 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:06.912 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:06.910+0000 7fc4d3e00640 1 --2- 172.21.15.50:0/1572223432 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc4cc1141d0 0x7fc4cc1a6000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:06.913 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:06.910+0000 7fc4d3e00640 1 --2- 172.21.15.50:0/1572223432 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc4cc077120 0x7fc4cc1a0d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:06.913 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:06.910+0000 7fc4d3e00640 1 --2- 172.21.15.50:0/1572223432 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc4cc075b70 0x7fc4cc1a07c0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:06.913 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:06.910+0000 7fc4d3e00640 1 -- 172.21.15.50:0/1572223432 >> 172.21.15.50:0/1572223432 conn(0x7fc4cc07b5f0 msgr2=0x7fc4cc112e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:23:06.913 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:06.910+0000 7fc4d3e00640 1 -- 172.21.15.50:0/1572223432 shutdown_connections 2024-08-31T04:23:06.913 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:06.910+0000 7fc4d3e00640 1 -- 172.21.15.50:0/1572223432 wait complete. 2024-08-31T04:23:07.687 INFO:teuthology.orchestra.run.smithi050.stdout:{"pg_ready":true,"pg_map":{"version":373,"stamp":"2024-08-31T04:23:05.886561+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":664626,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":1337,"num_read_kb":768,"num_write":390,"num_write_kb":2308,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":2952462,"num_keys_recovered":10,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":822,"ondisk_log_size":822,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":359768,"kb_used_data":10520,"kb_used_omap":18,"kb_used_meta":349037,"kb_avail":1124582056,"statfs":{"total":1151940427776,"available":1151572025344,"internally_reserved":0,"allocated":10772480,"data_stored":6933381,"data_compressed":109023,"data_compressed_allocated":135168,"data_compressed_original":1769472,"omap_allocated":19143,"internal_metadata":357414201},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":5995,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":126,"num_read_kb":61,"num_write":7,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003527"},"pg_stats":[{"pgid":"3.3f","version":"78'8","reported_seq":30,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:22:26.271328+0000","last_change":"2024-08-31T04:20:42.949771+0000","last_active":"2024-08-31T04:22:26.271328+0000","last_peered":"2024-08-31T04:22:26.271328+0000","last_clean":"2024-08-31T04:22:26.271328+0000","last_became_active":"2024-08-31T04:20:42.949372+0000","last_became_peered":"2024-08-31T04:20:42.949372+0000","last_unstale":"2024-08-31T04:22:26.271328+0000","last_undegraded":"2024-08-31T04:22:26.271328+0000","last_fullsized":"2024-08-31T04:22:26.271328+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:16:50.036191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"78'4","reported_seq":26,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:22:26.253427+0000","last_change":"2024-08-31T04:20:42.949805+0000","last_active":"2024-08-31T04:22:26.253427+0000","last_peered":"2024-08-31T04:22:26.253427+0000","last_clean":"2024-08-31T04:22:26.253427+0000","last_became_active":"2024-08-31T04:20:42.948015+0000","last_became_peered":"2024-08-31T04:20:42.948015+0000","last_unstale":"2024-08-31T04:22:26.253427+0000","last_undegraded":"2024-08-31T04:22:26.253427+0000","last_fullsized":"2024-08-31T04:22:26.253427+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:25:47.432785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"78'7","reported_seq":29,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:22:26.262935+0000","last_change":"2024-08-31T04:20:42.949114+0000","last_active":"2024-08-31T04:22:26.262935+0000","last_peered":"2024-08-31T04:22:26.262935+0000","last_clean":"2024-08-31T04:22:26.262935+0000","last_became_active":"2024-08-31T04:20:42.946763+0000","last_became_peered":"2024-08-31T04:20:42.946763+0000","last_unstale":"2024-08-31T04:22:26.262935+0000","last_undegraded":"2024-08-31T04:22:26.262935+0000","last_fullsized":"2024-08-31T04:22:26.262935+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:33:55.605617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"78'8","reported_seq":30,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:22:26.248677+0000","last_change":"2024-08-31T04:20:42.935026+0000","last_active":"2024-08-31T04:22:26.248677+0000","last_peered":"2024-08-31T04:22:26.248677+0000","last_clean":"2024-08-31T04:22:26.248677+0000","last_became_active":"2024-08-31T04:20:42.934534+0000","last_became_peered":"2024-08-31T04:20:42.934534+0000","last_unstale":"2024-08-31T04:22:26.248677+0000","last_undegraded":"2024-08-31T04:22:26.248677+0000","last_fullsized":"2024-08-31T04:22:26.248677+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:33:41.014920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"78'4","reported_seq":25,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:22:26.252143+0000","last_change":"2024-08-31T04:20:42.939114+0000","last_active":"2024-08-31T04:22:26.252143+0000","last_peered":"2024-08-31T04:22:26.252143+0000","last_clean":"2024-08-31T04:22:26.252143+0000","last_became_active":"2024-08-31T04:20:42.938710+0000","last_became_peered":"2024-08-31T04:20:42.938710+0000","last_unstale":"2024-08-31T04:22:26.252143+0000","last_undegraded":"2024-08-31T04:22:26.252143+0000","last_fullsized":"2024-08-31T04:22:26.252143+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:42:25.561258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"78'6","reported_seq":27,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:22:26.255233+0000","last_change":"2024-08-31T04:20:42.935958+0000","last_active":"2024-08-31T04:22:26.255233+0000","last_peered":"2024-08-31T04:22:26.255233+0000","last_clean":"2024-08-31T04:22:26.255233+0000","last_became_active":"2024-08-31T04:20:42.934865+0000","last_became_peered":"2024-08-31T04:20:42.934865+0000","last_unstale":"2024-08-31T04:22:26.255233+0000","last_undegraded":"2024-08-31T04:22:26.255233+0000","last_fullsized":"2024-08-31T04:22:26.255233+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:28:20.330784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"78'5","reported_seq":26,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:22:26.256030+0000","last_change":"2024-08-31T04:20:42.932639+0000","last_active":"2024-08-31T04:22:26.256030+0000","last_peered":"2024-08-31T04:22:26.256030+0000","last_clean":"2024-08-31T04:22:26.256030+0000","last_became_active":"2024-08-31T04:20:42.932238+0000","last_became_peered":"2024-08-31T04:20:42.932238+0000","last_unstale":"2024-08-31T04:22:26.256030+0000","last_undegraded":"2024-08-31T04:22:26.256030+0000","last_fullsized":"2024-08-31T04:22:26.256030+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T04:47:32.128675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"78'9","reported_seq":30,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:22:26.253126+0000","last_change":"2024-08-31T04:20:42.941700+0000","last_active":"2024-08-31T04:22:26.253126+0000","last_peered":"2024-08-31T04:22:26.253126+0000","last_clean":"2024-08-31T04:22:26.253126+0000","last_became_active":"2024-08-31T04:20:42.941308+0000","last_became_peered":"2024-08-31T04:20:42.941308+0000","last_unstale":"2024-08-31T04:22:26.253126+0000","last_undegraded":"2024-08-31T04:22:26.253126+0000","last_fullsized":"2024-08-31T04:22:26.253126+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:35:06.058492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"78'11","reported_seq":32,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:22:26.263740+0000","last_change":"2024-08-31T04:20:42.935528+0000","last_active":"2024-08-31T04:22:26.263740+0000","last_peered":"2024-08-31T04:22:26.263740+0000","last_clean":"2024-08-31T04:22:26.263740+0000","last_became_active":"2024-08-31T04:20:42.933736+0000","last_became_peered":"2024-08-31T04:20:42.933736+0000","last_unstale":"2024-08-31T04:22:26.263740+0000","last_undegraded":"2024-08-31T04:22:26.263740+0000","last_fullsized":"2024-08-31T04:22:26.263740+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:12:47.877285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"78'16","reported_seq":44,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:22:26.259552+0000","last_change":"2024-08-31T04:20:57.006683+0000","last_active":"2024-08-31T04:22:26.259552+0000","last_peered":"2024-08-31T04:22:26.259552+0000","last_clean":"2024-08-31T04:22:26.259552+0000","last_became_active":"2024-08-31T04:20:57.006166+0000","last_became_peered":"2024-08-31T04:20:57.006166+0000","last_unstale":"2024-08-31T04:22:26.259552+0000","last_undegraded":"2024-08-31T04:22:26.259552+0000","last_fullsized":"2024-08-31T04:22:26.259552+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:33:23.377991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,9],"acting":[10,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"78'6","reported_seq":27,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:22:26.257964+0000","last_change":"2024-08-31T04:20:42.939489+0000","last_active":"2024-08-31T04:22:26.257964+0000","last_peered":"2024-08-31T04:22:26.257964+0000","last_clean":"2024-08-31T04:22:26.257964+0000","last_became_active":"2024-08-31T04:20:42.939138+0000","last_became_peered":"2024-08-31T04:20:42.939138+0000","last_unstale":"2024-08-31T04:22:26.257964+0000","last_undegraded":"2024-08-31T04:22:26.257964+0000","last_fullsized":"2024-08-31T04:22:26.257964+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T05:00:30.196513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"78'7","reported_seq":28,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:22:26.249896+0000","last_change":"2024-08-31T04:20:42.941483+0000","last_active":"2024-08-31T04:22:26.249896+0000","last_peered":"2024-08-31T04:22:26.249896+0000","last_clean":"2024-08-31T04:22:26.249896+0000","last_became_active":"2024-08-31T04:20:42.940200+0000","last_became_peered":"2024-08-31T04:20:42.940200+0000","last_unstale":"2024-08-31T04:22:26.249896+0000","last_undegraded":"2024-08-31T04:22:26.249896+0000","last_fullsized":"2024-08-31T04:22:26.249896+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:40:45.235093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"78'10","reported_seq":31,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:22:26.246851+0000","last_change":"2024-08-31T04:20:42.928803+0000","last_active":"2024-08-31T04:22:26.246851+0000","last_peered":"2024-08-31T04:22:26.246851+0000","last_clean":"2024-08-31T04:22:26.246851+0000","last_became_active":"2024-08-31T04:20:42.928410+0000","last_became_peered":"2024-08-31T04:20:42.928410+0000","last_unstale":"2024-08-31T04:22:26.246851+0000","last_undegraded":"2024-08-31T04:22:26.246851+0000","last_fullsized":"2024-08-31T04:22:26.246851+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T04:24:41.811202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"78'7","reported_seq":29,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:22:26.259141+0000","last_change":"2024-08-31T04:20:42.945142+0000","last_active":"2024-08-31T04:22:26.259141+0000","last_peered":"2024-08-31T04:22:26.259141+0000","last_clean":"2024-08-31T04:22:26.259141+0000","last_became_active":"2024-08-31T04:20:42.944061+0000","last_became_peered":"2024-08-31T04:20:42.944061+0000","last_unstale":"2024-08-31T04:22:26.259141+0000","last_undegraded":"2024-08-31T04:22:26.259141+0000","last_fullsized":"2024-08-31T04:22:26.259141+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:55:09.045257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"78'7","reported_seq":29,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:22:26.258722+0000","last_change":"2024-08-31T04:20:42.945844+0000","last_active":"2024-08-31T04:22:26.258722+0000","last_peered":"2024-08-31T04:22:26.258722+0000","last_clean":"2024-08-31T04:22:26.258722+0000","last_became_active":"2024-08-31T04:20:42.944186+0000","last_became_peered":"2024-08-31T04:20:42.944186+0000","last_unstale":"2024-08-31T04:22:26.258722+0000","last_undegraded":"2024-08-31T04:22:26.258722+0000","last_fullsized":"2024-08-31T04:22:26.258722+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:32:46.878700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"78'9","reported_seq":31,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:22:26.264057+0000","last_change":"2024-08-31T04:20:42.952871+0000","last_active":"2024-08-31T04:22:26.264057+0000","last_peered":"2024-08-31T04:22:26.264057+0000","last_clean":"2024-08-31T04:22:26.264057+0000","last_became_active":"2024-08-31T04:20:42.952531+0000","last_became_peered":"2024-08-31T04:20:42.952531+0000","last_unstale":"2024-08-31T04:22:26.264057+0000","last_undegraded":"2024-08-31T04:22:26.264057+0000","last_fullsized":"2024-08-31T04:22:26.264057+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:26:01.690119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"78'8","reported_seq":30,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:22:26.271591+0000","last_change":"2024-08-31T04:20:42.949822+0000","last_active":"2024-08-31T04:22:26.271591+0000","last_peered":"2024-08-31T04:22:26.271591+0000","last_clean":"2024-08-31T04:22:26.271591+0000","last_became_active":"2024-08-31T04:20:42.949443+0000","last_became_peered":"2024-08-31T04:20:42.949443+0000","last_unstale":"2024-08-31T04:22:26.271591+0000","last_undegraded":"2024-08-31T04:22:26.271591+0000","last_fullsized":"2024-08-31T04:22:26.271591+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:35:48.270606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"78'10","reported_seq":32,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:22:26.261910+0000","last_change":"2024-08-31T04:20:42.940895+0000","last_active":"2024-08-31T04:22:26.261910+0000","last_peered":"2024-08-31T04:22:26.261910+0000","last_clean":"2024-08-31T04:22:26.261910+0000","last_became_active":"2024-08-31T04:20:42.940489+0000","last_became_peered":"2024-08-31T04:20:42.940489+0000","last_unstale":"2024-08-31T04:22:26.261910+0000","last_undegraded":"2024-08-31T04:22:26.261910+0000","last_fullsized":"2024-08-31T04:22:26.261910+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T04:42:20.269895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"78'7","reported_seq":29,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:22:26.254453+0000","last_change":"2024-08-31T04:20:42.935303+0000","last_active":"2024-08-31T04:22:26.254453+0000","last_peered":"2024-08-31T04:22:26.254453+0000","last_clean":"2024-08-31T04:22:26.254453+0000","last_became_active":"2024-08-31T04:20:42.934931+0000","last_became_peered":"2024-08-31T04:20:42.934931+0000","last_unstale":"2024-08-31T04:22:26.254453+0000","last_undegraded":"2024-08-31T04:22:26.254453+0000","last_fullsized":"2024-08-31T04:22:26.254453+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:34:40.767333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"78'8","reported_seq":30,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:22:26.257067+0000","last_change":"2024-08-31T04:20:42.941518+0000","last_active":"2024-08-31T04:22:26.257067+0000","last_peered":"2024-08-31T04:22:26.257067+0000","last_clean":"2024-08-31T04:22:26.257067+0000","last_became_active":"2024-08-31T04:20:42.941142+0000","last_became_peered":"2024-08-31T04:20:42.941142+0000","last_unstale":"2024-08-31T04:22:26.257067+0000","last_undegraded":"2024-08-31T04:22:26.257067+0000","last_fullsized":"2024-08-31T04:22:26.257067+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:27:50.274057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"78'11","reported_seq":33,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:22:26.256826+0000","last_change":"2024-08-31T04:20:42.945136+0000","last_active":"2024-08-31T04:22:26.256826+0000","last_peered":"2024-08-31T04:22:26.256826+0000","last_clean":"2024-08-31T04:22:26.256826+0000","last_became_active":"2024-08-31T04:20:42.944811+0000","last_became_peered":"2024-08-31T04:20:42.944811+0000","last_unstale":"2024-08-31T04:22:26.256826+0000","last_undegraded":"2024-08-31T04:22:26.256826+0000","last_fullsized":"2024-08-31T04:22:26.256826+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:30:47.496668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"78'10","reported_seq":32,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:22:26.264249+0000","last_change":"2024-08-31T04:20:42.930854+0000","last_active":"2024-08-31T04:22:26.264249+0000","last_peered":"2024-08-31T04:22:26.264249+0000","last_clean":"2024-08-31T04:22:26.264249+0000","last_became_active":"2024-08-31T04:20:42.930490+0000","last_became_peered":"2024-08-31T04:20:42.930490+0000","last_unstale":"2024-08-31T04:22:26.264249+0000","last_undegraded":"2024-08-31T04:22:26.264249+0000","last_fullsized":"2024-08-31T04:22:26.264249+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:16:17.611414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"78'8","reported_seq":20,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:22:26.252604+0000","last_change":"2024-08-31T04:20:57.008738+0000","last_active":"2024-08-31T04:22:26.252604+0000","last_peered":"2024-08-31T04:22:26.252604+0000","last_clean":"2024-08-31T04:22:26.252604+0000","last_became_active":"2024-08-31T04:20:57.008209+0000","last_became_peered":"2024-08-31T04:20:57.008209+0000","last_unstale":"2024-08-31T04:22:26.252604+0000","last_undegraded":"2024-08-31T04:22:26.252604+0000","last_fullsized":"2024-08-31T04:22:26.252604+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T05:26:22.508955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,11],"acting":[9,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.28","version":"78'6","reported_seq":28,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:22:26.252980+0000","last_change":"2024-08-31T04:20:42.939859+0000","last_active":"2024-08-31T04:22:26.252980+0000","last_peered":"2024-08-31T04:22:26.252980+0000","last_clean":"2024-08-31T04:22:26.252980+0000","last_became_active":"2024-08-31T04:20:42.938315+0000","last_became_peered":"2024-08-31T04:20:42.938315+0000","last_unstale":"2024-08-31T04:22:26.252980+0000","last_undegraded":"2024-08-31T04:22:26.252980+0000","last_fullsized":"2024-08-31T04:22:26.252980+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:13:00.906454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"78'2","reported_seq":24,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:22:26.251738+0000","last_change":"2024-08-31T04:20:42.941861+0000","last_active":"2024-08-31T04:22:26.251738+0000","last_peered":"2024-08-31T04:22:26.251738+0000","last_clean":"2024-08-31T04:22:26.251738+0000","last_became_active":"2024-08-31T04:20:42.939556+0000","last_became_peered":"2024-08-31T04:20:42.939556+0000","last_unstale":"2024-08-31T04:22:26.251738+0000","last_undegraded":"2024-08-31T04:22:26.251738+0000","last_fullsized":"2024-08-31T04:22:26.251738+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:02:53.900917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"78'15","reported_seq":37,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:22:26.252502+0000","last_change":"2024-08-31T04:20:42.930792+0000","last_active":"2024-08-31T04:22:26.252502+0000","last_peered":"2024-08-31T04:22:26.252502+0000","last_clean":"2024-08-31T04:22:26.252502+0000","last_became_active":"2024-08-31T04:20:42.930014+0000","last_became_peered":"2024-08-31T04:20:42.930014+0000","last_unstale":"2024-08-31T04:22:26.252502+0000","last_undegraded":"2024-08-31T04:22:26.252502+0000","last_fullsized":"2024-08-31T04:22:26.252502+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:18:26.942604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"78'6","reported_seq":35,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:22:26.252980+0000","last_change":"2024-08-31T04:20:57.010093+0000","last_active":"2024-08-31T04:22:26.252980+0000","last_peered":"2024-08-31T04:22:26.252980+0000","last_clean":"2024-08-31T04:22:26.252980+0000","last_became_active":"2024-08-31T04:20:57.008759+0000","last_became_peered":"2024-08-31T04:20:57.008759+0000","last_unstale":"2024-08-31T04:22:26.252980+0000","last_undegraded":"2024-08-31T04:22:26.252980+0000","last_fullsized":"2024-08-31T04:22:26.252980+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T06:55:38.276668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,9],"acting":[11,8,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"78'4","reported_seq":26,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:22:26.255417+0000","last_change":"2024-08-31T04:20:42.953378+0000","last_active":"2024-08-31T04:22:26.255417+0000","last_peered":"2024-08-31T04:22:26.255417+0000","last_clean":"2024-08-31T04:22:26.255417+0000","last_became_active":"2024-08-31T04:20:42.953030+0000","last_became_peered":"2024-08-31T04:20:42.953030+0000","last_unstale":"2024-08-31T04:22:26.255417+0000","last_undegraded":"2024-08-31T04:22:26.255417+0000","last_fullsized":"2024-08-31T04:22:26.255417+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:24:46.633234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"78'7","reported_seq":29,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:22:26.258481+0000","last_change":"2024-08-31T04:20:42.945142+0000","last_active":"2024-08-31T04:22:26.258481+0000","last_peered":"2024-08-31T04:22:26.258481+0000","last_clean":"2024-08-31T04:22:26.258481+0000","last_became_active":"2024-08-31T04:20:42.943960+0000","last_became_peered":"2024-08-31T04:20:42.943960+0000","last_unstale":"2024-08-31T04:22:26.258481+0000","last_undegraded":"2024-08-31T04:22:26.258481+0000","last_fullsized":"2024-08-31T04:22:26.258481+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T04:29:10.501940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"78'8","reported_seq":30,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:22:26.257636+0000","last_change":"2024-08-31T04:20:42.946359+0000","last_active":"2024-08-31T04:22:26.257636+0000","last_peered":"2024-08-31T04:22:26.257636+0000","last_clean":"2024-08-31T04:22:26.257636+0000","last_became_active":"2024-08-31T04:20:42.945974+0000","last_became_peered":"2024-08-31T04:20:42.945974+0000","last_unstale":"2024-08-31T04:22:26.257636+0000","last_undegraded":"2024-08-31T04:22:26.257636+0000","last_fullsized":"2024-08-31T04:22:26.257636+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:01:27.808743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"78'12","reported_seq":34,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:22:26.245311+0000","last_change":"2024-08-31T04:20:42.930989+0000","last_active":"2024-08-31T04:22:26.245311+0000","last_peered":"2024-08-31T04:22:26.245311+0000","last_clean":"2024-08-31T04:22:26.245311+0000","last_became_active":"2024-08-31T04:20:42.930610+0000","last_became_peered":"2024-08-31T04:20:42.930610+0000","last_unstale":"2024-08-31T04:22:26.245311+0000","last_undegraded":"2024-08-31T04:22:26.245311+0000","last_fullsized":"2024-08-31T04:22:26.245311+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:01:49.473735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"78'9","reported_seq":31,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:22:26.255676+0000","last_change":"2024-08-31T04:20:42.930513+0000","last_active":"2024-08-31T04:22:26.255676+0000","last_peered":"2024-08-31T04:22:26.255676+0000","last_clean":"2024-08-31T04:22:26.255676+0000","last_became_active":"2024-08-31T04:20:42.930127+0000","last_became_peered":"2024-08-31T04:20:42.930127+0000","last_unstale":"2024-08-31T04:22:26.255676+0000","last_undegraded":"2024-08-31T04:22:26.255676+0000","last_fullsized":"2024-08-31T04:22:26.255676+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T05:19:55.307816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"78'7","reported_seq":28,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:22:26.244290+0000","last_change":"2024-08-31T04:20:42.928217+0000","last_active":"2024-08-31T04:22:26.244290+0000","last_peered":"2024-08-31T04:22:26.244290+0000","last_clean":"2024-08-31T04:22:26.244290+0000","last_became_active":"2024-08-31T04:20:42.927828+0000","last_became_peered":"2024-08-31T04:20:42.927828+0000","last_unstale":"2024-08-31T04:22:26.244290+0000","last_undegraded":"2024-08-31T04:22:26.244290+0000","last_fullsized":"2024-08-31T04:22:26.244290+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:53:21.266734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"78'7","reported_seq":174,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:23:03.248935+0000","last_change":"2024-08-31T04:20:57.229930+0000","last_active":"2024-08-31T04:23:03.248935+0000","last_peered":"2024-08-31T04:23:03.248935+0000","last_clean":"2024-08-31T04:23:03.248935+0000","last_became_active":"2024-08-31T04:20:57.224761+0000","last_became_peered":"2024-08-31T04:20:57.224761+0000","last_unstale":"2024-08-31T04:23:03.248935+0000","last_undegraded":"2024-08-31T04:23:03.248935+0000","last_fullsized":"2024-08-31T04:23:03.248935+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_clean_scrub_stamp":"2024-08-31T04:20:38.871450+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:07:41.723452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1154,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":127,"num_read_kb":4,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":622,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"78'8","reported_seq":29,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:22:26.254392+0000","last_change":"2024-08-31T04:20:42.939189+0000","last_active":"2024-08-31T04:22:26.254392+0000","last_peered":"2024-08-31T04:22:26.254392+0000","last_clean":"2024-08-31T04:22:26.254392+0000","last_became_active":"2024-08-31T04:20:42.938817+0000","last_became_peered":"2024-08-31T04:20:42.938817+0000","last_unstale":"2024-08-31T04:22:26.254392+0000","last_undegraded":"2024-08-31T04:22:26.254392+0000","last_fullsized":"2024-08-31T04:22:26.254392+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:19:04.407104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"77'7","reported_seq":34,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:20:57.001432+0000","last_change":"2024-08-31T04:20:39.904392+0000","last_active":"2024-08-31T04:20:57.001432+0000","last_peered":"2024-08-31T04:20:57.001432+0000","last_clean":"2024-08-31T04:20:57.001432+0000","last_became_active":"2024-08-31T04:20:39.904014+0000","last_became_peered":"2024-08-31T04:20:39.904014+0000","last_unstale":"2024-08-31T04:20:57.001432+0000","last_undegraded":"2024-08-31T04:20:57.001432+0000","last_fullsized":"2024-08-31T04:20:57.001432+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_clean_scrub_stamp":"2024-08-31T04:20:38.871450+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:33:56.591237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"78'3","reported_seq":31,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:21:01.048982+0000","last_change":"2024-08-31T04:20:39.899521+0000","last_active":"2024-08-31T04:21:01.048982+0000","last_peered":"2024-08-31T04:21:01.048982+0000","last_clean":"2024-08-31T04:21:01.048982+0000","last_became_active":"2024-08-31T04:20:39.899157+0000","last_became_peered":"2024-08-31T04:20:39.899157+0000","last_unstale":"2024-08-31T04:21:01.048982+0000","last_undegraded":"2024-08-31T04:21:01.048982+0000","last_fullsized":"2024-08-31T04:21:01.048982+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_clean_scrub_stamp":"2024-08-31T04:20:38.871450+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:14:47.067149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"78'8","reported_seq":29,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:22:26.249334+0000","last_change":"2024-08-31T04:20:42.950653+0000","last_active":"2024-08-31T04:22:26.249334+0000","last_peered":"2024-08-31T04:22:26.249334+0000","last_clean":"2024-08-31T04:22:26.249334+0000","last_became_active":"2024-08-31T04:20:42.949627+0000","last_became_peered":"2024-08-31T04:20:42.949627+0000","last_unstale":"2024-08-31T04:22:26.249334+0000","last_undegraded":"2024-08-31T04:22:26.249334+0000","last_fullsized":"2024-08-31T04:22:26.249334+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:22:00.000717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"78'3","reported_seq":32,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:21:02.057481+0000","last_change":"2024-08-31T04:20:39.908013+0000","last_active":"2024-08-31T04:21:02.057481+0000","last_peered":"2024-08-31T04:21:02.057481+0000","last_clean":"2024-08-31T04:21:02.057481+0000","last_became_active":"2024-08-31T04:20:39.907482+0000","last_became_peered":"2024-08-31T04:20:39.907482+0000","last_unstale":"2024-08-31T04:21:02.057481+0000","last_undegraded":"2024-08-31T04:21:02.057481+0000","last_fullsized":"2024-08-31T04:21:02.057481+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_clean_scrub_stamp":"2024-08-31T04:20:38.871450+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:50:35.466407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"78'11","reported_seq":32,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:22:26.256431+0000","last_change":"2024-08-31T04:20:42.944674+0000","last_active":"2024-08-31T04:22:26.256431+0000","last_peered":"2024-08-31T04:22:26.256431+0000","last_clean":"2024-08-31T04:22:26.256431+0000","last_became_active":"2024-08-31T04:20:42.944424+0000","last_became_peered":"2024-08-31T04:20:42.944424+0000","last_unstale":"2024-08-31T04:22:26.256431+0000","last_undegraded":"2024-08-31T04:22:26.256431+0000","last_fullsized":"2024-08-31T04:22:26.256431+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:10:27.772835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"78'6","reported_seq":271,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:23:00.243510+0000","last_change":"2024-08-31T04:20:39.904188+0000","last_active":"2024-08-31T04:23:00.243510+0000","last_peered":"2024-08-31T04:23:00.243510+0000","last_clean":"2024-08-31T04:23:00.243510+0000","last_became_active":"2024-08-31T04:20:39.903789+0000","last_became_peered":"2024-08-31T04:20:39.903789+0000","last_unstale":"2024-08-31T04:23:00.243510+0000","last_undegraded":"2024-08-31T04:23:00.243510+0000","last_fullsized":"2024-08-31T04:23:00.243510+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_clean_scrub_stamp":"2024-08-31T04:20:38.871450+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T06:54:38.881746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":238,"num_read_kb":238,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"78'10","reported_seq":31,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:22:26.260698+0000","last_change":"2024-08-31T04:20:42.932961+0000","last_active":"2024-08-31T04:22:26.260698+0000","last_peered":"2024-08-31T04:22:26.260698+0000","last_clean":"2024-08-31T04:22:26.260698+0000","last_became_active":"2024-08-31T04:20:42.932562+0000","last_became_peered":"2024-08-31T04:20:42.932562+0000","last_unstale":"2024-08-31T04:22:26.260698+0000","last_undegraded":"2024-08-31T04:22:26.260698+0000","last_fullsized":"2024-08-31T04:22:26.260698+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:20:36.827300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"78'4","reported_seq":32,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:21:01.049400+0000","last_change":"2024-08-31T04:20:39.902279+0000","last_active":"2024-08-31T04:21:01.049400+0000","last_peered":"2024-08-31T04:21:01.049400+0000","last_clean":"2024-08-31T04:21:01.049400+0000","last_became_active":"2024-08-31T04:20:39.901822+0000","last_became_peered":"2024-08-31T04:20:39.901822+0000","last_unstale":"2024-08-31T04:21:01.049400+0000","last_undegraded":"2024-08-31T04:21:01.049400+0000","last_fullsized":"2024-08-31T04:21:01.049400+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_clean_scrub_stamp":"2024-08-31T04:20:38.871450+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:48:09.609644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"78'9","reported_seq":37,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:22:26.258970+0000","last_change":"2024-08-31T04:20:57.008955+0000","last_active":"2024-08-31T04:22:26.258970+0000","last_peered":"2024-08-31T04:22:26.258970+0000","last_clean":"2024-08-31T04:22:26.258970+0000","last_became_active":"2024-08-31T04:20:57.008487+0000","last_became_peered":"2024-08-31T04:20:57.008487+0000","last_unstale":"2024-08-31T04:22:26.258970+0000","last_undegraded":"2024-08-31T04:22:26.258970+0000","last_fullsized":"2024-08-31T04:22:26.258970+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:26:23.399089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,5],"acting":[0,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"77'5","reported_seq":34,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:21:02.056824+0000","last_change":"2024-08-31T04:20:39.992197+0000","last_active":"2024-08-31T04:21:02.056824+0000","last_peered":"2024-08-31T04:21:02.056824+0000","last_clean":"2024-08-31T04:21:02.056824+0000","last_became_active":"2024-08-31T04:20:39.991835+0000","last_became_peered":"2024-08-31T04:20:39.991835+0000","last_unstale":"2024-08-31T04:21:02.056824+0000","last_undegraded":"2024-08-31T04:21:02.056824+0000","last_fullsized":"2024-08-31T04:21:02.056824+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_clean_scrub_stamp":"2024-08-31T04:20:38.871450+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:38:02.808469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"78'11","reported_seq":33,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:22:26.262934+0000","last_change":"2024-08-31T04:20:42.934874+0000","last_active":"2024-08-31T04:22:26.262934+0000","last_peered":"2024-08-31T04:22:26.262934+0000","last_clean":"2024-08-31T04:22:26.262934+0000","last_became_active":"2024-08-31T04:20:42.934500+0000","last_became_peered":"2024-08-31T04:20:42.934500+0000","last_unstale":"2024-08-31T04:22:26.262934+0000","last_undegraded":"2024-08-31T04:22:26.262934+0000","last_fullsized":"2024-08-31T04:22:26.262934+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:32:59.785563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"78'37","reported_seq":314,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:23:01.002755+0000","last_change":"2024-08-31T04:20:39.907452+0000","last_active":"2024-08-31T04:23:01.002755+0000","last_peered":"2024-08-31T04:23:01.002755+0000","last_clean":"2024-08-31T04:23:01.002755+0000","last_became_active":"2024-08-31T04:20:39.907071+0000","last_became_peered":"2024-08-31T04:20:39.907071+0000","last_unstale":"2024-08-31T04:23:01.002755+0000","last_undegraded":"2024-08-31T04:23:01.002755+0000","last_fullsized":"2024-08-31T04:23:01.002755+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_clean_scrub_stamp":"2024-08-31T04:20:38.871450+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:21:33.318332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65695,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":249,"num_read_kb":183,"num_write":39,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"78'6","reported_seq":27,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:22:26.251640+0000","last_change":"2024-08-31T04:20:42.937750+0000","last_active":"2024-08-31T04:22:26.251640+0000","last_peered":"2024-08-31T04:22:26.251640+0000","last_clean":"2024-08-31T04:22:26.251640+0000","last_became_active":"2024-08-31T04:20:42.937386+0000","last_became_peered":"2024-08-31T04:20:42.937386+0000","last_unstale":"2024-08-31T04:22:26.251640+0000","last_undegraded":"2024-08-31T04:22:26.251640+0000","last_fullsized":"2024-08-31T04:22:26.251640+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:14:03.123558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"78'9","reported_seq":39,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:21:02.054882+0000","last_change":"2024-08-31T04:20:39.902815+0000","last_active":"2024-08-31T04:21:02.054882+0000","last_peered":"2024-08-31T04:21:02.054882+0000","last_clean":"2024-08-31T04:21:02.054882+0000","last_became_active":"2024-08-31T04:20:39.900473+0000","last_became_peered":"2024-08-31T04:20:39.900473+0000","last_unstale":"2024-08-31T04:21:02.054882+0000","last_undegraded":"2024-08-31T04:21:02.054882+0000","last_fullsized":"2024-08-31T04:21:02.054882+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_clean_scrub_stamp":"2024-08-31T04:20:38.871450+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:42:03.902102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"78'9","reported_seq":31,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:22:26.254515+0000","last_change":"2024-08-31T04:20:42.932333+0000","last_active":"2024-08-31T04:22:26.254515+0000","last_peered":"2024-08-31T04:22:26.254515+0000","last_clean":"2024-08-31T04:22:26.254515+0000","last_became_active":"2024-08-31T04:20:42.931902+0000","last_became_peered":"2024-08-31T04:20:42.931902+0000","last_unstale":"2024-08-31T04:22:26.254515+0000","last_undegraded":"2024-08-31T04:22:26.254515+0000","last_fullsized":"2024-08-31T04:22:26.254515+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:46:44.716941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"78'5","reported_seq":34,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:21:02.052921+0000","last_change":"2024-08-31T04:20:39.901541+0000","last_active":"2024-08-31T04:21:02.052921+0000","last_peered":"2024-08-31T04:21:02.052921+0000","last_clean":"2024-08-31T04:21:02.052921+0000","last_became_active":"2024-08-31T04:20:39.901116+0000","last_became_peered":"2024-08-31T04:20:39.901116+0000","last_unstale":"2024-08-31T04:21:02.052921+0000","last_undegraded":"2024-08-31T04:21:02.052921+0000","last_fullsized":"2024-08-31T04:21:02.052921+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_clean_scrub_stamp":"2024-08-31T04:20:38.871450+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:57:51.458017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"78'15","reported_seq":37,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:22:26.258964+0000","last_change":"2024-08-31T04:20:42.936355+0000","last_active":"2024-08-31T04:22:26.258964+0000","last_peered":"2024-08-31T04:22:26.258964+0000","last_clean":"2024-08-31T04:22:26.258964+0000","last_became_active":"2024-08-31T04:20:42.935975+0000","last_became_peered":"2024-08-31T04:20:42.935975+0000","last_unstale":"2024-08-31T04:22:26.258964+0000","last_undegraded":"2024-08-31T04:22:26.258964+0000","last_fullsized":"2024-08-31T04:22:26.258964+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:37:24.867700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"78'8","reported_seq":165,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:23:04.250717+0000","last_change":"2024-08-31T04:20:39.901314+0000","last_active":"2024-08-31T04:23:04.250717+0000","last_peered":"2024-08-31T04:23:04.250717+0000","last_clean":"2024-08-31T04:23:04.250717+0000","last_became_active":"2024-08-31T04:20:39.900780+0000","last_became_peered":"2024-08-31T04:20:39.900780+0000","last_unstale":"2024-08-31T04:23:04.250717+0000","last_undegraded":"2024-08-31T04:23:04.250717+0000","last_fullsized":"2024-08-31T04:23:04.250717+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_clean_scrub_stamp":"2024-08-31T04:20:38.871450+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:59:40.500765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1431,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":130,"num_read_kb":6,"num_write":8,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"78'6","reported_seq":28,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:22:26.254284+0000","last_change":"2024-08-31T04:20:42.934382+0000","last_active":"2024-08-31T04:22:26.254284+0000","last_peered":"2024-08-31T04:22:26.254284+0000","last_clean":"2024-08-31T04:22:26.254284+0000","last_became_active":"2024-08-31T04:20:42.933986+0000","last_became_peered":"2024-08-31T04:20:42.933986+0000","last_unstale":"2024-08-31T04:22:26.254284+0000","last_undegraded":"2024-08-31T04:22:26.254284+0000","last_fullsized":"2024-08-31T04:22:26.254284+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:12:16.372504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"78'17","reported_seq":46,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:21:02.053828+0000","last_change":"2024-08-31T04:20:39.990817+0000","last_active":"2024-08-31T04:21:02.053828+0000","last_peered":"2024-08-31T04:21:02.053828+0000","last_clean":"2024-08-31T04:21:02.053828+0000","last_became_active":"2024-08-31T04:20:39.990379+0000","last_became_peered":"2024-08-31T04:20:39.990379+0000","last_unstale":"2024-08-31T04:21:02.053828+0000","last_undegraded":"2024-08-31T04:21:02.053828+0000","last_fullsized":"2024-08-31T04:21:02.053828+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_clean_scrub_stamp":"2024-08-31T04:20:38.871450+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:42:27.435142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"78'6","reported_seq":28,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:22:26.253988+0000","last_change":"2024-08-31T04:20:42.942430+0000","last_active":"2024-08-31T04:22:26.253988+0000","last_peered":"2024-08-31T04:22:26.253988+0000","last_clean":"2024-08-31T04:22:26.253988+0000","last_became_active":"2024-08-31T04:20:42.942067+0000","last_became_peered":"2024-08-31T04:20:42.942067+0000","last_unstale":"2024-08-31T04:22:26.253988+0000","last_undegraded":"2024-08-31T04:22:26.253988+0000","last_fullsized":"2024-08-31T04:22:26.253988+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:48:52.441499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"77'2","reported_seq":31,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:21:02.054755+0000","last_change":"2024-08-31T04:20:39.903815+0000","last_active":"2024-08-31T04:21:02.054755+0000","last_peered":"2024-08-31T04:21:02.054755+0000","last_clean":"2024-08-31T04:21:02.054755+0000","last_became_active":"2024-08-31T04:20:39.903183+0000","last_became_peered":"2024-08-31T04:20:39.903183+0000","last_unstale":"2024-08-31T04:21:02.054755+0000","last_undegraded":"2024-08-31T04:21:02.054755+0000","last_fullsized":"2024-08-31T04:21:02.054755+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_clean_scrub_stamp":"2024-08-31T04:20:38.871450+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:39:50.862711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"78'5","reported_seq":34,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:22:26.255171+0000","last_change":"2024-08-31T04:20:57.004852+0000","last_active":"2024-08-31T04:22:26.255171+0000","last_peered":"2024-08-31T04:22:26.255171+0000","last_clean":"2024-08-31T04:22:26.255171+0000","last_became_active":"2024-08-31T04:20:57.004435+0000","last_became_peered":"2024-08-31T04:20:57.004435+0000","last_unstale":"2024-08-31T04:22:26.255171+0000","last_undegraded":"2024-08-31T04:22:26.255171+0000","last_fullsized":"2024-08-31T04:22:26.255171+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T06:16:19.010305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,6],"acting":[11,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"78'5","reported_seq":33,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:21:01.047914+0000","last_change":"2024-08-31T04:20:39.901493+0000","last_active":"2024-08-31T04:21:01.047914+0000","last_peered":"2024-08-31T04:21:01.047914+0000","last_clean":"2024-08-31T04:21:01.047914+0000","last_became_active":"2024-08-31T04:20:39.901072+0000","last_became_peered":"2024-08-31T04:20:39.901072+0000","last_unstale":"2024-08-31T04:21:01.047914+0000","last_undegraded":"2024-08-31T04:21:01.047914+0000","last_fullsized":"2024-08-31T04:21:01.047914+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_clean_scrub_stamp":"2024-08-31T04:20:38.871450+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:26:43.893882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"78'9","reported_seq":31,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:22:26.247690+0000","last_change":"2024-08-31T04:20:42.938270+0000","last_active":"2024-08-31T04:22:26.247690+0000","last_peered":"2024-08-31T04:22:26.247690+0000","last_clean":"2024-08-31T04:22:26.247690+0000","last_became_active":"2024-08-31T04:20:42.937851+0000","last_became_peered":"2024-08-31T04:20:42.937851+0000","last_unstale":"2024-08-31T04:22:26.247690+0000","last_undegraded":"2024-08-31T04:22:26.247690+0000","last_fullsized":"2024-08-31T04:22:26.247690+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:29:09.315106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"78'3","reported_seq":32,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:21:02.054203+0000","last_change":"2024-08-31T04:20:39.905785+0000","last_active":"2024-08-31T04:21:02.054203+0000","last_peered":"2024-08-31T04:21:02.054203+0000","last_clean":"2024-08-31T04:21:02.054203+0000","last_became_active":"2024-08-31T04:20:39.905403+0000","last_became_peered":"2024-08-31T04:20:39.905403+0000","last_unstale":"2024-08-31T04:21:02.054203+0000","last_undegraded":"2024-08-31T04:21:02.054203+0000","last_fullsized":"2024-08-31T04:21:02.054203+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_clean_scrub_stamp":"2024-08-31T04:20:38.871450+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:48:04.743543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"78'7","reported_seq":29,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:22:26.250051+0000","last_change":"2024-08-31T04:20:42.934433+0000","last_active":"2024-08-31T04:22:26.250051+0000","last_peered":"2024-08-31T04:22:26.250051+0000","last_clean":"2024-08-31T04:22:26.250051+0000","last_became_active":"2024-08-31T04:20:42.934058+0000","last_became_peered":"2024-08-31T04:20:42.934058+0000","last_unstale":"2024-08-31T04:22:26.250051+0000","last_undegraded":"2024-08-31T04:22:26.250051+0000","last_fullsized":"2024-08-31T04:22:26.250051+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:34:42.988905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"78'7","reported_seq":159,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:23:00.244188+0000","last_change":"2024-08-31T04:20:40.202403+0000","last_active":"2024-08-31T04:23:00.244188+0000","last_peered":"2024-08-31T04:23:00.244188+0000","last_clean":"2024-08-31T04:23:00.244188+0000","last_became_active":"2024-08-31T04:20:40.201918+0000","last_became_peered":"2024-08-31T04:20:40.201918+0000","last_unstale":"2024-08-31T04:23:00.244188+0000","last_undegraded":"2024-08-31T04:23:00.244188+0000","last_fullsized":"2024-08-31T04:23:00.244188+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_clean_scrub_stamp":"2024-08-31T04:20:38.871450+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:31:26.675413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1702,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":124,"num_read_kb":4,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"78'7","reported_seq":29,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:22:26.258221+0000","last_change":"2024-08-31T04:20:42.931040+0000","last_active":"2024-08-31T04:22:26.258221+0000","last_peered":"2024-08-31T04:22:26.258221+0000","last_clean":"2024-08-31T04:22:26.258221+0000","last_became_active":"2024-08-31T04:20:42.930692+0000","last_became_peered":"2024-08-31T04:20:42.930692+0000","last_unstale":"2024-08-31T04:22:26.258221+0000","last_undegraded":"2024-08-31T04:22:26.258221+0000","last_fullsized":"2024-08-31T04:22:26.258221+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T06:12:23.175092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"20'92","reported_seq":99,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:20:57.003516+0000","last_change":"2024-08-31T04:19:21.361791+0000","last_active":"2024-08-31T04:20:57.003516+0000","last_peered":"2024-08-31T04:20:57.003516+0000","last_clean":"2024-08-31T04:20:57.003516+0000","last_became_active":"2024-08-31T04:19:21.356128+0000","last_became_peered":"2024-08-31T04:19:21.356128+0000","last_unstale":"2024-08-31T04:20:57.003516+0000","last_undegraded":"2024-08-31T04:20:57.003516+0000","last_fullsized":"2024-08-31T04:20:57.003516+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:15:46.442365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:15:46.442365+0000","last_clean_scrub_stamp":"2024-08-31T04:15:46.442365+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:23:05.688680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"78'6","reported_seq":37,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:21:02.054186+0000","last_change":"2024-08-31T04:20:39.904625+0000","last_active":"2024-08-31T04:21:02.054186+0000","last_peered":"2024-08-31T04:21:02.054186+0000","last_clean":"2024-08-31T04:21:02.054186+0000","last_became_active":"2024-08-31T04:20:39.904245+0000","last_became_peered":"2024-08-31T04:20:39.904245+0000","last_unstale":"2024-08-31T04:21:02.054186+0000","last_undegraded":"2024-08-31T04:21:02.054186+0000","last_fullsized":"2024-08-31T04:21:02.054186+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_clean_scrub_stamp":"2024-08-31T04:20:38.871450+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:31:34.711047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"78'8","reported_seq":30,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:22:26.264104+0000","last_change":"2024-08-31T04:20:42.944224+0000","last_active":"2024-08-31T04:22:26.264104+0000","last_peered":"2024-08-31T04:22:26.264104+0000","last_clean":"2024-08-31T04:22:26.264104+0000","last_became_active":"2024-08-31T04:20:42.943469+0000","last_became_peered":"2024-08-31T04:20:42.943469+0000","last_unstale":"2024-08-31T04:22:26.264104+0000","last_undegraded":"2024-08-31T04:22:26.264104+0000","last_fullsized":"2024-08-31T04:22:26.264104+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:27:48.533319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"78'4","reported_seq":32,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:21:01.049039+0000","last_change":"2024-08-31T04:20:39.902613+0000","last_active":"2024-08-31T04:21:01.049039+0000","last_peered":"2024-08-31T04:21:01.049039+0000","last_clean":"2024-08-31T04:21:01.049039+0000","last_became_active":"2024-08-31T04:20:39.902033+0000","last_became_peered":"2024-08-31T04:20:39.902033+0000","last_unstale":"2024-08-31T04:21:01.049039+0000","last_undegraded":"2024-08-31T04:21:01.049039+0000","last_fullsized":"2024-08-31T04:21:01.049039+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_clean_scrub_stamp":"2024-08-31T04:20:38.871450+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:13:58.497781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"78'5","reported_seq":27,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:22:26.248712+0000","last_change":"2024-08-31T04:20:42.933541+0000","last_active":"2024-08-31T04:22:26.248712+0000","last_peered":"2024-08-31T04:22:26.248712+0000","last_clean":"2024-08-31T04:22:26.248712+0000","last_became_active":"2024-08-31T04:20:42.933155+0000","last_became_peered":"2024-08-31T04:20:42.933155+0000","last_unstale":"2024-08-31T04:22:26.248712+0000","last_undegraded":"2024-08-31T04:22:26.248712+0000","last_fullsized":"2024-08-31T04:22:26.248712+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:22:41.298103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"78'7","reported_seq":158,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:23:02.246877+0000","last_change":"2024-08-31T04:20:39.992067+0000","last_active":"2024-08-31T04:23:02.246877+0000","last_peered":"2024-08-31T04:23:02.246877+0000","last_clean":"2024-08-31T04:23:02.246877+0000","last_became_active":"2024-08-31T04:20:39.991645+0000","last_became_peered":"2024-08-31T04:20:39.991645+0000","last_unstale":"2024-08-31T04:23:02.246877+0000","last_undegraded":"2024-08-31T04:23:02.246877+0000","last_fullsized":"2024-08-31T04:23:02.246877+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_clean_scrub_stamp":"2024-08-31T04:20:38.871450+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:41:18.012094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":123,"num_read_kb":123,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"78'8","reported_seq":30,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:22:26.253434+0000","last_change":"2024-08-31T04:20:42.937324+0000","last_active":"2024-08-31T04:22:26.253434+0000","last_peered":"2024-08-31T04:22:26.253434+0000","last_clean":"2024-08-31T04:22:26.253434+0000","last_became_active":"2024-08-31T04:20:42.936926+0000","last_became_peered":"2024-08-31T04:20:42.936926+0000","last_unstale":"2024-08-31T04:22:26.253434+0000","last_undegraded":"2024-08-31T04:22:26.253434+0000","last_fullsized":"2024-08-31T04:22:26.253434+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:34:57.158304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"78'5","reported_seq":158,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:23:04.249653+0000","last_change":"2024-08-31T04:20:39.905365+0000","last_active":"2024-08-31T04:23:04.249653+0000","last_peered":"2024-08-31T04:23:04.249653+0000","last_clean":"2024-08-31T04:23:04.249653+0000","last_became_active":"2024-08-31T04:20:39.904772+0000","last_became_peered":"2024-08-31T04:20:39.904772+0000","last_unstale":"2024-08-31T04:23:04.249653+0000","last_undegraded":"2024-08-31T04:23:04.249653+0000","last_fullsized":"2024-08-31T04:23:04.249653+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_clean_scrub_stamp":"2024-08-31T04:20:38.871450+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T05:20:23.781639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":125,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"78'7","reported_seq":29,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:22:26.258493+0000","last_change":"2024-08-31T04:20:42.944303+0000","last_active":"2024-08-31T04:22:26.258493+0000","last_peered":"2024-08-31T04:22:26.258493+0000","last_clean":"2024-08-31T04:22:26.258493+0000","last_became_active":"2024-08-31T04:20:42.943938+0000","last_became_peered":"2024-08-31T04:20:42.943938+0000","last_unstale":"2024-08-31T04:22:26.258493+0000","last_undegraded":"2024-08-31T04:22:26.258493+0000","last_fullsized":"2024-08-31T04:22:26.258493+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T06:51:28.734751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"77'1","reported_seq":29,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:20:57.004699+0000","last_change":"2024-08-31T04:20:39.993135+0000","last_active":"2024-08-31T04:20:57.004699+0000","last_peered":"2024-08-31T04:20:57.004699+0000","last_clean":"2024-08-31T04:20:57.004699+0000","last_became_active":"2024-08-31T04:20:39.991569+0000","last_became_peered":"2024-08-31T04:20:39.991569+0000","last_unstale":"2024-08-31T04:20:57.004699+0000","last_undegraded":"2024-08-31T04:20:57.004699+0000","last_fullsized":"2024-08-31T04:20:57.004699+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_clean_scrub_stamp":"2024-08-31T04:20:38.871450+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:44:04.375810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"78'5","reported_seq":27,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:22:26.255803+0000","last_change":"2024-08-31T04:20:42.939721+0000","last_active":"2024-08-31T04:22:26.255803+0000","last_peered":"2024-08-31T04:22:26.255803+0000","last_clean":"2024-08-31T04:22:26.255803+0000","last_became_active":"2024-08-31T04:20:42.939380+0000","last_became_peered":"2024-08-31T04:20:42.939380+0000","last_unstale":"2024-08-31T04:22:26.255803+0000","last_undegraded":"2024-08-31T04:22:26.255803+0000","last_fullsized":"2024-08-31T04:22:26.255803+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:55:06.901719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"78'4","reported_seq":33,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:21:02.054159+0000","last_change":"2024-08-31T04:20:39.990968+0000","last_active":"2024-08-31T04:21:02.054159+0000","last_peered":"2024-08-31T04:21:02.054159+0000","last_clean":"2024-08-31T04:21:02.054159+0000","last_became_active":"2024-08-31T04:20:39.990583+0000","last_became_peered":"2024-08-31T04:20:39.990583+0000","last_unstale":"2024-08-31T04:21:02.054159+0000","last_undegraded":"2024-08-31T04:21:02.054159+0000","last_fullsized":"2024-08-31T04:21:02.054159+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_clean_scrub_stamp":"2024-08-31T04:20:38.871450+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:54:39.168179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"78'9","reported_seq":31,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:22:26.247852+0000","last_change":"2024-08-31T04:20:42.932914+0000","last_active":"2024-08-31T04:22:26.247852+0000","last_peered":"2024-08-31T04:22:26.247852+0000","last_clean":"2024-08-31T04:22:26.247852+0000","last_became_active":"2024-08-31T04:20:42.932523+0000","last_became_peered":"2024-08-31T04:20:42.932523+0000","last_unstale":"2024-08-31T04:22:26.247852+0000","last_undegraded":"2024-08-31T04:22:26.247852+0000","last_fullsized":"2024-08-31T04:22:26.247852+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:52:49.133428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"78'18","reported_seq":46,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:22:50.362860+0000","last_change":"2024-08-31T04:20:39.903373+0000","last_active":"2024-08-31T04:22:50.362860+0000","last_peered":"2024-08-31T04:22:50.362860+0000","last_clean":"2024-08-31T04:22:50.362860+0000","last_became_active":"2024-08-31T04:20:39.902784+0000","last_became_peered":"2024-08-31T04:20:39.902784+0000","last_unstale":"2024-08-31T04:22:50.362860+0000","last_undegraded":"2024-08-31T04:22:50.362860+0000","last_fullsized":"2024-08-31T04:22:50.362860+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_clean_scrub_stamp":"2024-08-31T04:20:38.871450+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:43:32.251846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"78'5","reported_seq":27,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:22:26.252323+0000","last_change":"2024-08-31T04:20:42.939252+0000","last_active":"2024-08-31T04:22:26.252323+0000","last_peered":"2024-08-31T04:22:26.252323+0000","last_clean":"2024-08-31T04:22:26.252323+0000","last_became_active":"2024-08-31T04:20:42.936671+0000","last_became_peered":"2024-08-31T04:20:42.936671+0000","last_unstale":"2024-08-31T04:22:26.252323+0000","last_undegraded":"2024-08-31T04:22:26.252323+0000","last_fullsized":"2024-08-31T04:22:26.252323+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:37:57.544627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"78'7","reported_seq":36,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:21:02.053527+0000","last_change":"2024-08-31T04:20:40.202412+0000","last_active":"2024-08-31T04:21:02.053527+0000","last_peered":"2024-08-31T04:21:02.053527+0000","last_clean":"2024-08-31T04:21:02.053527+0000","last_became_active":"2024-08-31T04:20:40.202000+0000","last_became_peered":"2024-08-31T04:20:40.202000+0000","last_unstale":"2024-08-31T04:21:02.053527+0000","last_undegraded":"2024-08-31T04:21:02.053527+0000","last_fullsized":"2024-08-31T04:21:02.053527+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_clean_scrub_stamp":"2024-08-31T04:20:38.871450+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:24:23.528379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"78'7","reported_seq":29,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:22:26.257761+0000","last_change":"2024-08-31T04:20:42.949174+0000","last_active":"2024-08-31T04:22:26.257761+0000","last_peered":"2024-08-31T04:22:26.257761+0000","last_clean":"2024-08-31T04:22:26.257761+0000","last_became_active":"2024-08-31T04:20:42.948013+0000","last_became_peered":"2024-08-31T04:20:42.948013+0000","last_unstale":"2024-08-31T04:22:26.257761+0000","last_undegraded":"2024-08-31T04:22:26.257761+0000","last_fullsized":"2024-08-31T04:22:26.257761+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:36:00.572991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"76'2","reported_seq":30,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:20:57.223313+0000","last_change":"2024-08-31T04:20:39.992477+0000","last_active":"2024-08-31T04:20:57.223313+0000","last_peered":"2024-08-31T04:20:57.223313+0000","last_clean":"2024-08-31T04:20:57.223313+0000","last_became_active":"2024-08-31T04:20:39.992082+0000","last_became_peered":"2024-08-31T04:20:39.992082+0000","last_unstale":"2024-08-31T04:20:57.223313+0000","last_undegraded":"2024-08-31T04:20:57.223313+0000","last_fullsized":"2024-08-31T04:20:57.223313+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_clean_scrub_stamp":"2024-08-31T04:20:38.871450+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:10:35.058693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"78'2","reported_seq":24,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:22:26.251210+0000","last_change":"2024-08-31T04:20:42.933915+0000","last_active":"2024-08-31T04:22:26.251210+0000","last_peered":"2024-08-31T04:22:26.251210+0000","last_clean":"2024-08-31T04:22:26.251210+0000","last_became_active":"2024-08-31T04:20:42.933525+0000","last_became_peered":"2024-08-31T04:20:42.933525+0000","last_unstale":"2024-08-31T04:22:26.251210+0000","last_undegraded":"2024-08-31T04:22:26.251210+0000","last_fullsized":"2024-08-31T04:22:26.251210+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:03:35.191136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"78'7","reported_seq":35,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:21:01.048268+0000","last_change":"2024-08-31T04:20:39.903979+0000","last_active":"2024-08-31T04:21:01.048268+0000","last_peered":"2024-08-31T04:21:01.048268+0000","last_clean":"2024-08-31T04:21:01.048268+0000","last_became_active":"2024-08-31T04:20:39.903538+0000","last_became_peered":"2024-08-31T04:20:39.903538+0000","last_unstale":"2024-08-31T04:21:01.048268+0000","last_undegraded":"2024-08-31T04:21:01.048268+0000","last_fullsized":"2024-08-31T04:21:01.048268+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_clean_scrub_stamp":"2024-08-31T04:20:38.871450+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:25:15.944692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"78'9","reported_seq":31,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:22:26.257776+0000","last_change":"2024-08-31T04:20:42.947511+0000","last_active":"2024-08-31T04:22:26.257776+0000","last_peered":"2024-08-31T04:22:26.257776+0000","last_clean":"2024-08-31T04:22:26.257776+0000","last_became_active":"2024-08-31T04:20:42.947116+0000","last_became_peered":"2024-08-31T04:20:42.947116+0000","last_unstale":"2024-08-31T04:22:26.257776+0000","last_undegraded":"2024-08-31T04:22:26.257776+0000","last_fullsized":"2024-08-31T04:22:26.257776+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:00:53.022229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"78'3","reported_seq":31,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:21:02.009035+0000","last_change":"2024-08-31T04:20:39.903409+0000","last_active":"2024-08-31T04:21:02.009035+0000","last_peered":"2024-08-31T04:21:02.009035+0000","last_clean":"2024-08-31T04:21:02.009035+0000","last_became_active":"2024-08-31T04:20:39.900366+0000","last_became_peered":"2024-08-31T04:20:39.900366+0000","last_unstale":"2024-08-31T04:21:02.009035+0000","last_undegraded":"2024-08-31T04:21:02.009035+0000","last_fullsized":"2024-08-31T04:21:02.009035+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_clean_scrub_stamp":"2024-08-31T04:20:38.871450+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:01:24.809923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"78'8","reported_seq":30,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:22:26.256433+0000","last_change":"2024-08-31T04:20:42.953207+0000","last_active":"2024-08-31T04:22:26.256433+0000","last_peered":"2024-08-31T04:22:26.256433+0000","last_clean":"2024-08-31T04:22:26.256433+0000","last_became_active":"2024-08-31T04:20:42.952854+0000","last_became_peered":"2024-08-31T04:20:42.952854+0000","last_unstale":"2024-08-31T04:22:26.256433+0000","last_undegraded":"2024-08-31T04:22:26.256433+0000","last_fullsized":"2024-08-31T04:22:26.256433+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:33:11.495216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"76'4","reported_seq":21,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:21:00.180014+0000","last_change":"2024-08-31T04:20:57.016087+0000","last_active":"2024-08-31T04:21:00.180014+0000","last_peered":"2024-08-31T04:21:00.180014+0000","last_clean":"2024-08-31T04:21:00.180014+0000","last_became_active":"2024-08-31T04:20:57.005476+0000","last_became_peered":"2024-08-31T04:20:57.005476+0000","last_unstale":"2024-08-31T04:21:00.180014+0000","last_undegraded":"2024-08-31T04:21:00.180014+0000","last_fullsized":"2024-08-31T04:21:00.180014+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_clean_scrub_stamp":"2024-08-31T04:20:38.871450+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:22:21.768548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,7],"acting":[11,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.a","version":"78'5","reported_seq":27,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:22:26.258724+0000","last_change":"2024-08-31T04:20:42.933249+0000","last_active":"2024-08-31T04:22:26.258724+0000","last_peered":"2024-08-31T04:22:26.258724+0000","last_clean":"2024-08-31T04:22:26.258724+0000","last_became_active":"2024-08-31T04:20:42.931651+0000","last_became_peered":"2024-08-31T04:20:42.931651+0000","last_unstale":"2024-08-31T04:22:26.258724+0000","last_undegraded":"2024-08-31T04:22:26.258724+0000","last_fullsized":"2024-08-31T04:22:26.258724+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T06:40:21.010108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"78'15","reported_seq":36,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:22:26.254278+0000","last_change":"2024-08-31T04:20:42.942418+0000","last_active":"2024-08-31T04:22:26.254278+0000","last_peered":"2024-08-31T04:22:26.254278+0000","last_clean":"2024-08-31T04:22:26.254278+0000","last_became_active":"2024-08-31T04:20:42.942072+0000","last_became_peered":"2024-08-31T04:20:42.942072+0000","last_unstale":"2024-08-31T04:22:26.254278+0000","last_undegraded":"2024-08-31T04:22:26.254278+0000","last_fullsized":"2024-08-31T04:22:26.254278+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T04:41:38.816730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"78'5","reported_seq":33,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:21:01.049947+0000","last_change":"2024-08-31T04:20:39.903399+0000","last_active":"2024-08-31T04:21:01.049947+0000","last_peered":"2024-08-31T04:21:01.049947+0000","last_clean":"2024-08-31T04:21:01.049947+0000","last_became_active":"2024-08-31T04:20:39.902732+0000","last_became_peered":"2024-08-31T04:20:39.902732+0000","last_unstale":"2024-08-31T04:21:01.049947+0000","last_undegraded":"2024-08-31T04:21:01.049947+0000","last_fullsized":"2024-08-31T04:21:01.049947+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_clean_scrub_stamp":"2024-08-31T04:20:38.871450+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:07:25.324109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"78'9","reported_seq":30,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:22:26.261641+0000","last_change":"2024-08-31T04:20:42.931570+0000","last_active":"2024-08-31T04:22:26.261641+0000","last_peered":"2024-08-31T04:22:26.261641+0000","last_clean":"2024-08-31T04:22:26.261641+0000","last_became_active":"2024-08-31T04:20:42.931162+0000","last_became_peered":"2024-08-31T04:20:42.931162+0000","last_unstale":"2024-08-31T04:22:26.261641+0000","last_undegraded":"2024-08-31T04:22:26.261641+0000","last_fullsized":"2024-08-31T04:22:26.261641+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:55:58.784723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"78'12","reported_seq":27,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:21:02.054140+0000","last_change":"2024-08-31T04:20:57.020014+0000","last_active":"2024-08-31T04:21:02.054140+0000","last_peered":"2024-08-31T04:21:02.054140+0000","last_clean":"2024-08-31T04:21:02.054140+0000","last_became_active":"2024-08-31T04:20:57.009489+0000","last_became_peered":"2024-08-31T04:20:57.009489+0000","last_unstale":"2024-08-31T04:21:02.054140+0000","last_undegraded":"2024-08-31T04:21:02.054140+0000","last_fullsized":"2024-08-31T04:21:02.054140+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_clean_scrub_stamp":"2024-08-31T04:20:38.871450+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T05:22:57.227296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":10,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,7],"acting":[11,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1f","version":"78'6","reported_seq":28,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:22:26.262854+0000","last_change":"2024-08-31T04:20:42.947868+0000","last_active":"2024-08-31T04:22:26.262854+0000","last_peered":"2024-08-31T04:22:26.262854+0000","last_clean":"2024-08-31T04:22:26.262854+0000","last_became_active":"2024-08-31T04:20:42.946628+0000","last_became_peered":"2024-08-31T04:20:42.946628+0000","last_unstale":"2024-08-31T04:22:26.262854+0000","last_undegraded":"2024-08-31T04:22:26.262854+0000","last_fullsized":"2024-08-31T04:22:26.262854+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:47:10.939205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"76'2","reported_seq":30,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:20:57.338832+0000","last_change":"2024-08-31T04:20:39.991234+0000","last_active":"2024-08-31T04:20:57.338832+0000","last_peered":"2024-08-31T04:20:57.338832+0000","last_clean":"2024-08-31T04:20:57.338832+0000","last_became_active":"2024-08-31T04:20:39.990416+0000","last_became_peered":"2024-08-31T04:20:39.990416+0000","last_unstale":"2024-08-31T04:20:57.338832+0000","last_undegraded":"2024-08-31T04:20:57.338832+0000","last_fullsized":"2024-08-31T04:20:57.338832+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_clean_scrub_stamp":"2024-08-31T04:20:38.871450+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:47:43.392522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"78'5","reported_seq":27,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:22:26.251186+0000","last_change":"2024-08-31T04:20:42.942017+0000","last_active":"2024-08-31T04:22:26.251186+0000","last_peered":"2024-08-31T04:22:26.251186+0000","last_clean":"2024-08-31T04:22:26.251186+0000","last_became_active":"2024-08-31T04:20:42.939661+0000","last_became_peered":"2024-08-31T04:20:42.939661+0000","last_unstale":"2024-08-31T04:22:26.251186+0000","last_undegraded":"2024-08-31T04:22:26.251186+0000","last_fullsized":"2024-08-31T04:22:26.251186+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:41.900614+0000","last_clean_scrub_stamp":"2024-08-31T04:20:41.900614+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:13:39.521066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"78'13","reported_seq":166,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-08-31T04:23:04.249001+0000","last_change":"2024-08-31T04:20:39.905996+0000","last_active":"2024-08-31T04:23:04.249001+0000","last_peered":"2024-08-31T04:23:04.249001+0000","last_clean":"2024-08-31T04:23:04.249001+0000","last_became_active":"2024-08-31T04:20:39.905622+0000","last_became_peered":"2024-08-31T04:20:39.905622+0000","last_unstale":"2024-08-31T04:23:04.249001+0000","last_undegraded":"2024-08-31T04:23:04.249001+0000","last_fullsized":"2024-08-31T04:23:04.249001+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T04:20:38.871450+0000","last_clean_scrub_stamp":"2024-08-31T04:20:38.871450+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:53:36.672295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":125,"num_read_kb":125,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":74024,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":1261,"num_read_kb":704,"num_write":265,"num_write_kb":156,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":622,"num_keys_recovered":10,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":577536,"data_stored":222072,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":228,"ondisk_log_size":228,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":245760,"data_stored":2951840,"data_compressed":181705,"data_compressed_allocated":225280,"data_compressed_original":2949120,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":68,"seq":292057776171,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32012,"kb_used_data":828,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713140,"statfs":{"total":95995035648,"available":95962255360,"internally_reserved":0,"allocated":847872,"data_stored":413797,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":63,"seq":270582939694,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28004,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717148,"statfs":{"total":95995035648,"available":95966359552,"internally_reserved":0,"allocated":1003520,"data_stored":1065459,"data_compressed":36341,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":58,"seq":249108103222,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36196,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708956,"statfs":{"total":95995035648,"available":95957970944,"internally_reserved":0,"allocated":872448,"data_stored":413195,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,5,6,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":52,"seq":223338299450,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27872,"kb_used_data":848,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717280,"statfs":{"total":95995035648,"available":95966494720,"internally_reserved":0,"allocated":868352,"data_stored":413573,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":47,"seq":201863462977,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27924,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717228,"statfs":{"total":95995035648,"available":95966441472,"internally_reserved":0,"allocated":921600,"data_stored":1007075,"data_compressed":36341,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":42,"seq":180388626501,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32020,"kb_used_data":836,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713132,"statfs":{"total":95995035648,"available":95962247168,"internally_reserved":0,"allocated":856064,"data_stored":412912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":36,"seq":154618822732,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27936,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717216,"statfs":{"total":95995035648,"available":95966429184,"internally_reserved":0,"allocated":933888,"data_stored":1005910,"data_compressed":36341,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986256,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27860,"kb_used_data":836,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717292,"statfs":{"total":95995035648,"available":95966507008,"internally_reserved":0,"allocated":856064,"data_stored":413616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182484,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36196,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708956,"statfs":{"total":95995035648,"available":95957970944,"internally_reserved":0,"allocated":872448,"data_stored":412737,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411419,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27936,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717216,"statfs":{"total":95995035648,"available":95966429184,"internally_reserved":0,"allocated":933888,"data_stored":479650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574944,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27932,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717220,"statfs":{"total":95995035648,"available":95966433280,"internally_reserved":0,"allocated":929792,"data_stored":480674,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738467,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27880,"kb_used_data":856,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717272,"statfs":{"total":95995035648,"available":95966486528,"internally_reserved":0,"allocated":876544,"data_stored":414783,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36341,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36341,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36341,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36341,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36341,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2710,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":68601,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":67577,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1543,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3352,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":4517,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":118784,"data_stored":68274,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-31T04:23:07.691 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 058d9fc6-674f-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-31T04:23:07.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:23:07 smithi133 ceph-mon[22177]: pgmap v373: 97 pgs: 97 active+clean; 649 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 938 B/s wr, 11 op/s 2024-08-31T04:23:07.950 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:23:07 smithi050 ceph-mon[17259]: pgmap v373: 97 pgs: 97 active+clean; 649 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 938 B/s wr, 11 op/s 2024-08-31T04:23:07.996 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:23:07 smithi177 ceph-mon[22025]: pgmap v373: 97 pgs: 97 active+clean; 649 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 938 B/s wr, 11 op/s 2024-08-31T04:23:08.073 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:23:08.664 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:08.662+0000 7f1199e00640 1 -- 172.21.15.50:0/1479484131 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1194103920 msgr2=0x7f1194103d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:23:08.664 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:08.662+0000 7f1199e00640 1 --2- 172.21.15.50:0/1479484131 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1194103920 0x7f1194103d30 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f1184009900 tx=0x7f118402a3f0 comp rx=0 tx=0).stop 2024-08-31T04:23:08.664 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:08.662+0000 7f1199e00640 1 -- 172.21.15.50:0/1479484131 shutdown_connections 2024-08-31T04:23:08.664 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:08.662+0000 7f1199e00640 1 --2- 172.21.15.50:0/1479484131 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1194109bb0 0x7f11941103e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:08.664 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:08.662+0000 7f1199e00640 1 --2- 172.21.15.50:0/1479484131 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1194109260 0x7f1194109670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:08.664 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:08.662+0000 7f1199e00640 1 --2- 172.21.15.50:0/1479484131 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1194103920 0x7f1194103d30 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:08.664 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:08.662+0000 7f1199e00640 1 -- 172.21.15.50:0/1479484131 >> 172.21.15.50:0/1479484131 conn(0x7f11940ff370 msgr2=0x7f11941017c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:23:08.664 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:08.662+0000 7f1199e00640 1 -- 172.21.15.50:0/1479484131 shutdown_connections 2024-08-31T04:23:08.664 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:08.662+0000 7f1199e00640 1 -- 172.21.15.50:0/1479484131 wait complete. 2024-08-31T04:23:08.665 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:08.663+0000 7f1199e00640 1 Processor -- start 2024-08-31T04:23:08.665 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:08.664+0000 7f1199e00640 1 -- start start 2024-08-31T04:23:08.665 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:08.664+0000 7f1199e00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1194103920 0x7f119419a230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:08.665 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:08.664+0000 7f1199e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1194109260 0x7f119419a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:08.665 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:08.664+0000 7f1199e00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1194109bb0 0x7f119419fa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:08.666 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:08.664+0000 7f1199e00640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f11941138c0 con 0x7f1194109260 2024-08-31T04:23:08.666 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:08.664+0000 7f1199e00640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f1194113740 con 0x7f1194103920 2024-08-31T04:23:08.666 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:08.664+0000 7f1199e00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f1194113a40 con 0x7f1194109bb0 2024-08-31T04:23:08.667 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:08.664+0000 7f118be00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1194109260 0x7f119419a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:08.667 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:08.665+0000 7f1192a00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1194103920 0x7f119419a230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:08.667 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:08.665+0000 7f1192a00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1194103920 0x7f119419a230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.50:50954/0 (socket says 172.21.15.50:50954) 2024-08-31T04:23:08.667 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:08.665+0000 7f1192a00640 1 -- 172.21.15.50:0/1950385960 learned_addr learned my addr 172.21.15.50:0/1950385960 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:23:08.667 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:08.665+0000 7f1193400640 1 --2- 172.21.15.50:0/1950385960 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1194109bb0 0x7f119419fa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:08.667 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:08.665+0000 7f118be00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1194109260 0x7f119419a7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:54224/0 (socket says 172.21.15.50:54224) 2024-08-31T04:23:08.668 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:08.665+0000 7f118be00640 1 -- 172.21.15.50:0/1950385960 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1194109bb0 msgr2=0x7f119419fa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:23:08.668 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:08.665+0000 7f118be00640 1 --2- 172.21.15.50:0/1950385960 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1194109bb0 0x7f119419fa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:08.668 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:08.665+0000 7f118be00640 1 -- 172.21.15.50:0/1950385960 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1194103920 msgr2=0x7f119419a230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:23:08.668 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:08.665+0000 7f118be00640 1 --2- 172.21.15.50:0/1950385960 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1194103920 0x7f119419a230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:08.668 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:08.665+0000 7f118be00640 1 -- 172.21.15.50:0/1950385960 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11941a01a0 con 0x7f1194109260 2024-08-31T04:23:08.668 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:08.666+0000 7f118be00640 1 --2- 172.21.15.50:0/1950385960 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1194109260 0x7f119419a7d0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f119406c7b0 tx=0x7f117c00ee50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:23:08.668 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:08.666+0000 7f1198a00640 1 -- 172.21.15.50:0/1950385960 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f117c00cc40 con 0x7f1194109260 2024-08-31T04:23:08.668 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:08.666+0000 7f1198a00640 1 -- 172.21.15.50:0/1950385960 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f117c00cde0 con 0x7f1194109260 2024-08-31T04:23:08.668 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:08.666+0000 7f1199e00640 1 -- 172.21.15.50:0/1950385960 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f11941a0490 con 0x7f1194109260 2024-08-31T04:23:08.668 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:08.666+0000 7f1198a00640 1 -- 172.21.15.50:0/1950385960 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f117c018780 con 0x7f1194109260 2024-08-31T04:23:08.668 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:08.666+0000 7f1199e00640 1 -- 172.21.15.50:0/1950385960 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f11941a6bf0 con 0x7f1194109260 2024-08-31T04:23:08.668 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:08.667+0000 7f1199e00640 1 -- 172.21.15.50:0/1950385960 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1194103d30 con 0x7f1194109260 2024-08-31T04:23:08.671 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:08.670+0000 7f1198a00640 1 -- 172.21.15.50:0/1950385960 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 18) ==== 152577+0+0 (secure 0 0 0) 0x7f117c010a90 con 0x7f1194109260 2024-08-31T04:23:08.672 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:08.671+0000 7f1198a00640 1 --2- 172.21.15.50:0/1950385960 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f11780b4bb0 0x7f11780b70c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:08.673 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:08.671+0000 7f1198a00640 1 -- 172.21.15.50:0/1950385960 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8219+0+0 (secure 0 0 0) 0x7f117c0e5860 con 0x7f1194109260 2024-08-31T04:23:08.673 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:08.671+0000 7f1192a00640 1 --2- 172.21.15.50:0/1950385960 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f11780b4bb0 0x7f11780b70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:08.673 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:08.672+0000 7f1192a00640 1 --2- 172.21.15.50:0/1950385960 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f11780b4bb0 0x7f11780b70c0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f11840096c0 tx=0x7f1184005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:23:08.675 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:08.673+0000 7f1198a00640 1 -- 172.21.15.50:0/1950385960 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f117c0ac2f0 con 0x7f1194109260 2024-08-31T04:23:08.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:23:08 smithi133 ceph-mon[22177]: from='client.25295 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-31T04:23:08.908 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:08.906+0000 7f1199e00640 1 -- 172.21.15.50:0/1950385960 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f119419b360 con 0x7f1194109260 2024-08-31T04:23:08.908 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:23:08 smithi050 ceph-mon[17259]: from='client.25295 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-31T04:23:08.909 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:08.907+0000 7f1198a00640 1 -- 172.21.15.50:0/1950385960 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+11983 (secure 0 0 0) 0x7f117c0b0ab0 con 0x7f1194109260 2024-08-31T04:23:08.909 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-08-31T04:23:08.909 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":29,"btime":"2024-08-31T04:23:00:578141+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14622,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/1565557530","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":1565557530},{"type":"v1","addr":"172.21.15.50:6835","nonce":1565557530}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14634,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6837/2660185946","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6836","nonce":2660185946},{"type":"v1","addr":"172.21.15.50:6837","nonce":2660185946}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":29,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-31T04:20:44.140709+0000","modified":"2024-08-31T04:22:59.912983+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24695,"mds_1":24691,"mds_2":24667,"mds_3":24656,"mds_4":24652},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14676":{"gid":14676,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.50:6839/2105228685","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6838","nonce":2105228685},{"type":"v1","addr":"172.21.15.50:6839","nonce":2105228685}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24590":{"gid":24590,"name":"k","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.133:6833/4283603962","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6832","nonce":4283603962},{"type":"v1","addr":"172.21.15.133:6833","nonce":4283603962}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24601":{"gid":24601,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.177:6833/1237129793","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":1237129793},{"type":"v1","addr":"172.21.15.177:6833","nonce":1237129793}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24626":{"gid":24626,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.133:6835/3637799701","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":3637799701},{"type":"v1","addr":"172.21.15.133:6835","nonce":3637799701}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24640":{"gid":24640,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.177:6835/599392457","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6834","nonce":599392457},{"type":"v1","addr":"172.21.15.177:6835","nonce":599392457}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24652":{"gid":24652,"name":"c","rank":4,"incarnation":26,"state":"up:active","state_seq":13,"addr":"172.21.15.177:6837/2159859285","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6836","nonce":2159859285},{"type":"v1","addr":"172.21.15.177:6837","nonce":2159859285}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24656":{"gid":24656,"name":"h","rank":3,"incarnation":22,"state":"up:active","state_seq":12,"addr":"172.21.15.133:6837/4014853202","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6836","nonce":4014853202},{"type":"v1","addr":"172.21.15.133:6837","nonce":4014853202}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24667":{"gid":24667,"name":"i","rank":2,"incarnation":20,"state":"up:active","state_seq":10,"addr":"172.21.15.177:6839/3600081752","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6838","nonce":3600081752},{"type":"v1","addr":"172.21.15.177:6839","nonce":3600081752}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24691":{"gid":24691,"name":"a","rank":1,"incarnation":18,"state":"up:active","state_seq":8,"addr":"172.21.15.50:6841/575209862","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6840","nonce":575209862},{"type":"v1","addr":"172.21.15.50:6841","nonce":575209862}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24695":{"gid":24695,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.133:6839/2526402262","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6838","nonce":2526402262},{"type":"v1","addr":"172.21.15.133:6839","nonce":2526402262}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24695,"qdb_cluster":[24652,24691,24656,24695,24667]},"id":1}]} 2024-08-31T04:23:08.909 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 29 2024-08-31T04:23:08.911 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:08.910+0000 7f1199e00640 1 -- 172.21.15.50:0/1950385960 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f11780b4bb0 msgr2=0x7f11780b70c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:23:08.911 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:08.910+0000 7f1199e00640 1 --2- 172.21.15.50:0/1950385960 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f11780b4bb0 0x7f11780b70c0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f11840096c0 tx=0x7f1184005a20 comp rx=0 tx=0).stop 2024-08-31T04:23:08.911 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:08.910+0000 7f1199e00640 1 -- 172.21.15.50:0/1950385960 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1194109260 msgr2=0x7f119419a7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:23:08.911 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:08.910+0000 7f1199e00640 1 --2- 172.21.15.50:0/1950385960 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1194109260 0x7f119419a7d0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f119406c7b0 tx=0x7f117c00ee50 comp rx=0 tx=0).stop 2024-08-31T04:23:08.912 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:08.910+0000 7f1199e00640 1 -- 172.21.15.50:0/1950385960 shutdown_connections 2024-08-31T04:23:08.912 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:08.910+0000 7f1199e00640 1 --2- 172.21.15.50:0/1950385960 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f11780b4bb0 0x7f11780b70c0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:08.912 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:08.910+0000 7f1199e00640 1 --2- 172.21.15.50:0/1950385960 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1194109bb0 0x7f119419fa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:08.912 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:08.910+0000 7f1199e00640 1 --2- 172.21.15.50:0/1950385960 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1194109260 0x7f119419a7d0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:08.912 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:08.910+0000 7f1199e00640 1 --2- 172.21.15.50:0/1950385960 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1194103920 0x7f119419a230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:08.913 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:08.910+0000 7f1199e00640 1 -- 172.21.15.50:0/1950385960 >> 172.21.15.50:0/1950385960 conn(0x7f11940ff370 msgr2=0x7f1194101790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:23:08.913 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:08.910+0000 7f1199e00640 1 -- 172.21.15.50:0/1950385960 shutdown_connections 2024-08-31T04:23:08.913 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:08.910+0000 7f1199e00640 1 -- 172.21.15.50:0/1950385960 wait complete. 2024-08-31T04:23:08.996 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:23:08 smithi177 ceph-mon[22025]: from='client.25295 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-31T04:23:09.614 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:23:09 smithi050 ceph-mon[17259]: pgmap v374: 97 pgs: 97 active+clean; 649 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 938 B/s wr, 11 op/s 2024-08-31T04:23:09.615 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:23:09 smithi050 ceph-mon[17259]: from='client.? 172.21.15.50:0/1950385960' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T04:23:09.652 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 058d9fc6-674f-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-31T04:23:09.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:23:09 smithi133 ceph-mon[22177]: pgmap v374: 97 pgs: 97 active+clean; 649 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 938 B/s wr, 11 op/s 2024-08-31T04:23:09.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:23:09 smithi133 ceph-mon[22177]: from='client.? 172.21.15.50:0/1950385960' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T04:23:09.996 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:23:09 smithi177 ceph-mon[22025]: pgmap v374: 97 pgs: 97 active+clean; 649 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 938 B/s wr, 11 op/s 2024-08-31T04:23:09.996 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:23:09 smithi177 ceph-mon[22025]: from='client.? 172.21.15.50:0/1950385960' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T04:23:10.033 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:23:10.706 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:10.704+0000 7fbcf7a00640 1 -- 172.21.15.50:0/3958360297 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbcf01050a0 msgr2=0x7fbcf010d5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:23:10.707 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:10.704+0000 7fbcf7a00640 1 --2- 172.21.15.50:0/3958360297 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbcf01050a0 0x7fbcf010d5f0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fbcd8009900 tx=0x7fbcd802a3f0 comp rx=0 tx=0).stop 2024-08-31T04:23:10.707 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:10.704+0000 7fbcf7a00640 1 -- 172.21.15.50:0/3958360297 shutdown_connections 2024-08-31T04:23:10.707 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:10.704+0000 7fbcf7a00640 1 --2- 172.21.15.50:0/3958360297 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbcf010dbb0 0x7fbcf01100a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:10.707 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:10.704+0000 7fbcf7a00640 1 --2- 172.21.15.50:0/3958360297 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbcf01050a0 0x7fbcf010d5f0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:10.707 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:10.704+0000 7fbcf7a00640 1 --2- 172.21.15.50:0/3958360297 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbcf0104750 0x7fbcf0104b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:10.707 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:10.704+0000 7fbcf7a00640 1 -- 172.21.15.50:0/3958360297 >> 172.21.15.50:0/3958360297 conn(0x7fbcf0079500 msgr2=0x7fbcf0079910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:23:10.707 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:10.704+0000 7fbcf7a00640 1 -- 172.21.15.50:0/3958360297 shutdown_connections 2024-08-31T04:23:10.707 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:10.704+0000 7fbcf7a00640 1 -- 172.21.15.50:0/3958360297 wait complete. 2024-08-31T04:23:10.708 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:10.705+0000 7fbcf7a00640 1 Processor -- start 2024-08-31T04:23:10.708 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:10.706+0000 7fbcf7a00640 1 -- start start 2024-08-31T04:23:10.708 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:10.706+0000 7fbcf7a00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbcf0104750 0x7fbcf019c470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:10.708 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:10.706+0000 7fbcf7a00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbcf01050a0 0x7fbcf019ca10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:10.708 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:10.706+0000 7fbcf7a00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbcf010dbb0 0x7fbcf01a1cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:10.709 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:10.706+0000 7fbcf7a00640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fbcf0113840 con 0x7fbcf010dbb0 2024-08-31T04:23:10.709 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:10.706+0000 7fbcf7a00640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7fbcf01136c0 con 0x7fbcf0104750 2024-08-31T04:23:10.709 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:10.706+0000 7fbcf7a00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fbcf01139c0 con 0x7fbcf01050a0 2024-08-31T04:23:10.710 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:10.706+0000 7fbce7e00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbcf01050a0 0x7fbcf019ca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:10.710 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:10.706+0000 7fbcf5000640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbcf0104750 0x7fbcf019c470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:10.710 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:10.706+0000 7fbcf5a00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbcf010dbb0 0x7fbcf01a1cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:10.710 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:10.707+0000 7fbcf5000640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbcf0104750 0x7fbcf019c470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.50:50972/0 (socket says 172.21.15.50:50972) 2024-08-31T04:23:10.710 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:10.707+0000 7fbce7e00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbcf01050a0 0x7fbcf019ca10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.50:34324/0 (socket says 172.21.15.50:34324) 2024-08-31T04:23:10.710 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:10.707+0000 7fbcf5000640 1 -- 172.21.15.50:0/1194626103 learned_addr learned my addr 172.21.15.50:0/1194626103 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:23:10.710 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:10.707+0000 7fbcf5a00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbcf010dbb0 0x7fbcf01a1cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:54240/0 (socket says 172.21.15.50:54240) 2024-08-31T04:23:10.711 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:10.707+0000 7fbce7e00640 1 -- 172.21.15.50:0/1194626103 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbcf0104750 msgr2=0x7fbcf019c470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:23:10.711 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:10.707+0000 7fbce7e00640 1 --2- 172.21.15.50:0/1194626103 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbcf0104750 0x7fbcf019c470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:10.711 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:10.707+0000 7fbce7e00640 1 -- 172.21.15.50:0/1194626103 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbcf010dbb0 msgr2=0x7fbcf01a1cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:23:10.711 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:10.707+0000 7fbce7e00640 1 --2- 172.21.15.50:0/1194626103 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbcf010dbb0 0x7fbcf01a1cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:10.711 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:10.707+0000 7fbce7e00640 1 -- 172.21.15.50:0/1194626103 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbcf01a23e0 con 0x7fbcf01050a0 2024-08-31T04:23:10.711 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:10.707+0000 7fbcf5000640 1 --2- 172.21.15.50:0/1194626103 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbcf0104750 0x7fbcf019c470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:23:10.711 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:10.707+0000 7fbcf5a00640 1 --2- 172.21.15.50:0/1194626103 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbcf010dbb0 0x7fbcf01a1cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:23:10.711 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:10.707+0000 7fbce7e00640 1 --2- 172.21.15.50:0/1194626103 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbcf01050a0 0x7fbcf019ca10 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fbcd8009230 tx=0x7fbcd8003b90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:23:10.711 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:10.708+0000 7fbcee000640 1 -- 172.21.15.50:0/1194626103 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcd803f070 con 0x7fbcf01050a0 2024-08-31T04:23:10.711 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:10.708+0000 7fbcee000640 1 -- 172.21.15.50:0/1194626103 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbcd8031b50 con 0x7fbcf01050a0 2024-08-31T04:23:10.711 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:10.708+0000 7fbcee000640 1 -- 172.21.15.50:0/1194626103 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcd8035030 con 0x7fbcf01050a0 2024-08-31T04:23:10.711 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:10.708+0000 7fbcf7a00640 1 -- 172.21.15.50:0/1194626103 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbcf01a2670 con 0x7fbcf01050a0 2024-08-31T04:23:10.711 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:10.708+0000 7fbcf7a00640 1 -- 172.21.15.50:0/1194626103 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbcf01a2ad0 con 0x7fbcf01050a0 2024-08-31T04:23:10.712 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:10.709+0000 7fbcf7a00640 1 -- 172.21.15.50:0/1194626103 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbcf006c060 con 0x7fbcf01050a0 2024-08-31T04:23:10.713 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:10.711+0000 7fbcee000640 1 -- 172.21.15.50:0/1194626103 <== mon.1 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 18) ==== 152577+0+0 (secure 0 0 0) 0x7fbcd8042070 con 0x7fbcf01050a0 2024-08-31T04:23:10.715 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:10.713+0000 7fbcee000640 1 --2- 172.21.15.50:0/1194626103 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fbcd40b4b30 0x7fbcd40b7040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:10.715 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:10.713+0000 7fbcee000640 1 -- 172.21.15.50:0/1194626103 <== mon.1 v2:172.21.15.177:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8219+0+0 (secure 0 0 0) 0x7fbcd8105320 con 0x7fbcf01050a0 2024-08-31T04:23:10.715 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:10.713+0000 7fbcf5000640 1 --2- 172.21.15.50:0/1194626103 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fbcd40b4b30 0x7fbcd40b7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:10.716 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:10.714+0000 7fbcf5000640 1 --2- 172.21.15.50:0/1194626103 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fbcd40b4b30 0x7fbcd40b7040 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fbce0011500 tx=0x7fbce0005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:23:10.717 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:10.715+0000 7fbcee000640 1 -- 172.21.15.50:0/1194626103 <== mon.1 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fbcd80cbdb0 con 0x7fbcf01050a0 2024-08-31T04:23:10.953 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:10.951+0000 7fbcf7a00640 1 -- 172.21.15.50:0/1194626103 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fbcf0104b60 con 0x7fbcf01050a0 2024-08-31T04:23:10.954 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:10.952+0000 7fbcee000640 1 -- 172.21.15.50:0/1194626103 <== mon.1 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+11983 (secure 0 0 0) 0x7fbcd80d0570 con 0x7fbcf01050a0 2024-08-31T04:23:10.955 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-08-31T04:23:10.955 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":29,"btime":"2024-08-31T04:23:00:578141+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14622,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/1565557530","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":1565557530},{"type":"v1","addr":"172.21.15.50:6835","nonce":1565557530}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14634,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6837/2660185946","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6836","nonce":2660185946},{"type":"v1","addr":"172.21.15.50:6837","nonce":2660185946}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":29,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-31T04:20:44.140709+0000","modified":"2024-08-31T04:22:59.912983+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24695,"mds_1":24691,"mds_2":24667,"mds_3":24656,"mds_4":24652},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14676":{"gid":14676,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.50:6839/2105228685","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6838","nonce":2105228685},{"type":"v1","addr":"172.21.15.50:6839","nonce":2105228685}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24590":{"gid":24590,"name":"k","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.133:6833/4283603962","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6832","nonce":4283603962},{"type":"v1","addr":"172.21.15.133:6833","nonce":4283603962}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24601":{"gid":24601,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.177:6833/1237129793","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":1237129793},{"type":"v1","addr":"172.21.15.177:6833","nonce":1237129793}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24626":{"gid":24626,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.133:6835/3637799701","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":3637799701},{"type":"v1","addr":"172.21.15.133:6835","nonce":3637799701}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24640":{"gid":24640,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.177:6835/599392457","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6834","nonce":599392457},{"type":"v1","addr":"172.21.15.177:6835","nonce":599392457}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24652":{"gid":24652,"name":"c","rank":4,"incarnation":26,"state":"up:active","state_seq":13,"addr":"172.21.15.177:6837/2159859285","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6836","nonce":2159859285},{"type":"v1","addr":"172.21.15.177:6837","nonce":2159859285}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24656":{"gid":24656,"name":"h","rank":3,"incarnation":22,"state":"up:active","state_seq":12,"addr":"172.21.15.133:6837/4014853202","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6836","nonce":4014853202},{"type":"v1","addr":"172.21.15.133:6837","nonce":4014853202}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24667":{"gid":24667,"name":"i","rank":2,"incarnation":20,"state":"up:active","state_seq":10,"addr":"172.21.15.177:6839/3600081752","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6838","nonce":3600081752},{"type":"v1","addr":"172.21.15.177:6839","nonce":3600081752}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24691":{"gid":24691,"name":"a","rank":1,"incarnation":18,"state":"up:active","state_seq":8,"addr":"172.21.15.50:6841/575209862","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6840","nonce":575209862},{"type":"v1","addr":"172.21.15.50:6841","nonce":575209862}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24695":{"gid":24695,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.133:6839/2526402262","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6838","nonce":2526402262},{"type":"v1","addr":"172.21.15.133:6839","nonce":2526402262}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24695,"qdb_cluster":[24652,24691,24656,24695,24667]},"id":1}]} 2024-08-31T04:23:10.955 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 29 2024-08-31T04:23:10.957 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:10.954+0000 7fbcf7a00640 1 -- 172.21.15.50:0/1194626103 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fbcd40b4b30 msgr2=0x7fbcd40b7040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:23:10.957 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:10.954+0000 7fbcf7a00640 1 --2- 172.21.15.50:0/1194626103 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fbcd40b4b30 0x7fbcd40b7040 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fbce0011500 tx=0x7fbce0005f90 comp rx=0 tx=0).stop 2024-08-31T04:23:10.957 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:10.954+0000 7fbcf7a00640 1 -- 172.21.15.50:0/1194626103 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbcf01050a0 msgr2=0x7fbcf019ca10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:23:10.957 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:10.954+0000 7fbcf7a00640 1 --2- 172.21.15.50:0/1194626103 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbcf01050a0 0x7fbcf019ca10 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fbcd8009230 tx=0x7fbcd8003b90 comp rx=0 tx=0).stop 2024-08-31T04:23:10.957 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:10.955+0000 7fbcf7a00640 1 -- 172.21.15.50:0/1194626103 shutdown_connections 2024-08-31T04:23:10.957 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:10.955+0000 7fbcf7a00640 1 --2- 172.21.15.50:0/1194626103 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fbcd40b4b30 0x7fbcd40b7040 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:10.958 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:10.955+0000 7fbcf7a00640 1 --2- 172.21.15.50:0/1194626103 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbcf01050a0 0x7fbcf019ca10 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:10.958 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:10.955+0000 7fbcf7a00640 1 --2- 172.21.15.50:0/1194626103 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbcf010dbb0 0x7fbcf01a1cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:10.958 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:10.955+0000 7fbcf7a00640 1 --2- 172.21.15.50:0/1194626103 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbcf0104750 0x7fbcf019c470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:10.958 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:10.955+0000 7fbcf7a00640 1 -- 172.21.15.50:0/1194626103 >> 172.21.15.50:0/1194626103 conn(0x7fbcf0079500 msgr2=0x7fbcf0100300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:23:10.958 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:10.955+0000 7fbcf7a00640 1 -- 172.21.15.50:0/1194626103 shutdown_connections 2024-08-31T04:23:10.958 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:10.955+0000 7fbcf7a00640 1 -- 172.21.15.50:0/1194626103 wait complete. 2024-08-31T04:23:11.633 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:23:11 smithi050 ceph-mon[17259]: pgmap v375: 97 pgs: 97 active+clean; 649 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 938 B/s wr, 9 op/s 2024-08-31T04:23:11.633 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:23:11 smithi050 ceph-mon[17259]: from='client.? 172.21.15.50:0/1194626103' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T04:23:11.670 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 058d9fc6-674f-11ef-bcd4-c7b262605968 -- ceph osd dump --format=json 2024-08-31T04:23:11.996 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:23:11 smithi177 ceph-mon[22025]: pgmap v375: 97 pgs: 97 active+clean; 649 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 938 B/s wr, 9 op/s 2024-08-31T04:23:11.996 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:23:11 smithi177 ceph-mon[22025]: from='client.? 172.21.15.50:0/1194626103' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T04:23:12.043 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:23:11 smithi133 ceph-mon[22177]: pgmap v375: 97 pgs: 97 active+clean; 649 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 938 B/s wr, 9 op/s 2024-08-31T04:23:12.043 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:23:11 smithi133 ceph-mon[22177]: from='client.? 172.21.15.50:0/1194626103' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T04:23:12.052 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:23:12.692 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:12.689+0000 7f9e57000640 1 -- 172.21.15.50:0/1649533189 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9e50109090 msgr2=0x7f9e501094a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:23:12.692 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:12.689+0000 7f9e57000640 1 --2- 172.21.15.50:0/1649533189 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9e50109090 0x7f9e501094a0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f9e3c009900 tx=0x7f9e3c02a410 comp rx=0 tx=0).stop 2024-08-31T04:23:12.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:12.689+0000 7f9e57000640 1 -- 172.21.15.50:0/1649533189 shutdown_connections 2024-08-31T04:23:12.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:12.689+0000 7f9e57000640 1 --2- 172.21.15.50:0/1649533189 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9e501099e0 0x7f9e50110210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:12.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:12.689+0000 7f9e57000640 1 --2- 172.21.15.50:0/1649533189 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9e50109090 0x7f9e501094a0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:12.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:12.689+0000 7f9e57000640 1 --2- 172.21.15.50:0/1649533189 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9e50103750 0x7f9e50103b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:12.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:12.689+0000 7f9e57000640 1 -- 172.21.15.50:0/1649533189 >> 172.21.15.50:0/1649533189 conn(0x7f9e500ff1a0 msgr2=0x7f9e501015f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:23:12.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:12.689+0000 7f9e57000640 1 -- 172.21.15.50:0/1649533189 shutdown_connections 2024-08-31T04:23:12.693 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:12.690+0000 7f9e57000640 1 -- 172.21.15.50:0/1649533189 wait complete. 2024-08-31T04:23:12.694 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:12.691+0000 7f9e57000640 1 Processor -- start 2024-08-31T04:23:12.694 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:12.691+0000 7f9e57000640 1 -- start start 2024-08-31T04:23:12.694 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:12.692+0000 7f9e57000640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9e50103750 0x7f9e5019a0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:12.694 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:12.692+0000 7f9e57000640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9e50109090 0x7f9e5019a660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:12.694 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:12.692+0000 7f9e57000640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9e501099e0 0x7f9e5019f900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:12.695 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:12.692+0000 7f9e57000640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f9e50113670 con 0x7f9e50109090 2024-08-31T04:23:12.695 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:12.692+0000 7f9e57000640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f9e501134f0 con 0x7f9e501099e0 2024-08-31T04:23:12.695 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:12.692+0000 7f9e57000640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f9e501137f0 con 0x7f9e50103750 2024-08-31T04:23:12.695 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:12.692+0000 7f9e55200640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9e50109090 0x7f9e5019a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:12.695 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:12.692+0000 7f9e55200640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9e50109090 0x7f9e5019a660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:54260/0 (socket says 172.21.15.50:54260) 2024-08-31T04:23:12.695 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:12.692+0000 7f9e55200640 1 -- 172.21.15.50:0/3079678587 learned_addr learned my addr 172.21.15.50:0/3079678587 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:23:12.695 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:12.692+0000 7f9e55c00640 1 --2- 172.21.15.50:0/3079678587 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9e50103750 0x7f9e5019a0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:12.695 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:12.692+0000 7f9e56600640 1 --2- 172.21.15.50:0/3079678587 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9e501099e0 0x7f9e5019f900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:12.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:12.693+0000 7f9e55200640 1 -- 172.21.15.50:0/3079678587 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9e50103750 msgr2=0x7f9e5019a0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:23:12.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:12.693+0000 7f9e55200640 1 --2- 172.21.15.50:0/3079678587 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9e50103750 0x7f9e5019a0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:12.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:12.693+0000 7f9e55200640 1 -- 172.21.15.50:0/3079678587 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9e501099e0 msgr2=0x7f9e5019f900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:23:12.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:12.693+0000 7f9e55200640 1 --2- 172.21.15.50:0/3079678587 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9e501099e0 0x7f9e5019f900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:12.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:12.693+0000 7f9e55200640 1 -- 172.21.15.50:0/3079678587 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e501a0030 con 0x7f9e50109090 2024-08-31T04:23:12.696 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:12.693+0000 7f9e56600640 1 --2- 172.21.15.50:0/3079678587 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9e501099e0 0x7f9e5019f900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:23:12.697 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:12.693+0000 7f9e55200640 1 --2- 172.21.15.50:0/3079678587 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9e50109090 0x7f9e5019a660 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f9e3c02a930 tx=0x7f9e3c031a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:23:12.697 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:12.693+0000 7f9e4e000640 1 -- 172.21.15.50:0/3079678587 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e3c03f030 con 0x7f9e50109090 2024-08-31T04:23:12.697 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:12.693+0000 7f9e57000640 1 -- 172.21.15.50:0/3079678587 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9e501a02c0 con 0x7f9e50109090 2024-08-31T04:23:12.697 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:12.693+0000 7f9e4e000640 1 -- 172.21.15.50:0/3079678587 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9e3c004490 con 0x7f9e50109090 2024-08-31T04:23:12.697 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:12.693+0000 7f9e4e000640 1 -- 172.21.15.50:0/3079678587 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e3c035070 con 0x7f9e50109090 2024-08-31T04:23:12.697 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:12.693+0000 7f9e57000640 1 -- 172.21.15.50:0/3079678587 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9e501a6a80 con 0x7f9e50109090 2024-08-31T04:23:12.697 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:12.695+0000 7f9e57000640 1 -- 172.21.15.50:0/3079678587 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9e501049d0 con 0x7f9e50109090 2024-08-31T04:23:12.699 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:12.697+0000 7f9e4e000640 1 -- 172.21.15.50:0/3079678587 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 18) ==== 152577+0+0 (secure 0 0 0) 0x7f9e3c042030 con 0x7f9e50109090 2024-08-31T04:23:12.701 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:12.698+0000 7f9e4e000640 1 --2- 172.21.15.50:0/3079678587 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f9e380b4b30 0x7f9e380b7040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:12.701 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:12.699+0000 7f9e4e000640 1 -- 172.21.15.50:0/3079678587 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8219+0+0 (secure 0 0 0) 0x7f9e3c105850 con 0x7f9e50109090 2024-08-31T04:23:12.701 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:12.699+0000 7f9e55c00640 1 --2- 172.21.15.50:0/3079678587 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f9e380b4b30 0x7f9e380b7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:12.701 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:12.699+0000 7f9e55c00640 1 --2- 172.21.15.50:0/3079678587 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f9e380b4b30 0x7f9e380b7040 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f9e44005fd0 tx=0x7f9e44009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:23:12.703 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:12.701+0000 7f9e4e000640 1 -- 172.21.15.50:0/3079678587 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f9e3c0cc2e0 con 0x7f9e50109090 2024-08-31T04:23:12.900 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:12.898+0000 7f9e57000640 1 -- 172.21.15.50:0/3079678587 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f9e5010b790 con 0x7f9e50109090 2024-08-31T04:23:12.902 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:12.900+0000 7f9e4e000640 1 -- 172.21.15.50:0/3079678587 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v78) ==== 74+0+22733 (secure 0 0 0) 0x7f9e3c0d3e20 con 0x7f9e50109090 2024-08-31T04:23:12.903 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-08-31T04:23:12.903 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":78,"fsid":"058d9fc6-674f-11ef-bcd4-c7b262605968","created":"2024-08-31T04:11:59.576131+0000","modified":"2024-08-31T04:20:56.994402+0000","last_up_change":"2024-08-31T04:19:44.619590+0000","last_in_change":"2024-08-31T04:19:21.022096+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-31T04:15:46.229142+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-31T04:20:38.249458+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"76","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-31T04:20:40.929092+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"76","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"416ecbde-4a7b-4bd1-b377-490925a33ce1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":3831273843},{"type":"v1","addr":"172.21.15.50:6803","nonce":3831273843}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":3831273843},{"type":"v1","addr":"172.21.15.50:6805","nonce":3831273843}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":3831273843},{"type":"v1","addr":"172.21.15.50:6809","nonce":3831273843}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":3831273843},{"type":"v1","addr":"172.21.15.50:6807","nonce":3831273843}]},"public_addr":"172.21.15.50:6803/3831273843","cluster_addr":"172.21.15.50:6805/3831273843","heartbeat_back_addr":"172.21.15.50:6809/3831273843","heartbeat_front_addr":"172.21.15.50:6807/3831273843","state":["exists","up"]},{"osd":1,"uuid":"5e008006-004d-4842-9885-93a2d27be1cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":475308203},{"type":"v1","addr":"172.21.15.133:6801","nonce":475308203}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":475308203},{"type":"v1","addr":"172.21.15.133:6803","nonce":475308203}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":475308203},{"type":"v1","addr":"172.21.15.133:6807","nonce":475308203}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":475308203},{"type":"v1","addr":"172.21.15.133:6805","nonce":475308203}]},"public_addr":"172.21.15.133:6801/475308203","cluster_addr":"172.21.15.133:6803/475308203","heartbeat_back_addr":"172.21.15.133:6807/475308203","heartbeat_front_addr":"172.21.15.133:6805/475308203","state":["exists","up"]},{"osd":2,"uuid":"7e6f1a26-f30d-4822-af69-8a08cb89fbce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":3091173426},{"type":"v1","addr":"172.21.15.177:6801","nonce":3091173426}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":3091173426},{"type":"v1","addr":"172.21.15.177:6803","nonce":3091173426}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":3091173426},{"type":"v1","addr":"172.21.15.177:6807","nonce":3091173426}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":3091173426},{"type":"v1","addr":"172.21.15.177:6805","nonce":3091173426}]},"public_addr":"172.21.15.177:6801/3091173426","cluster_addr":"172.21.15.177:6803/3091173426","heartbeat_back_addr":"172.21.15.177:6807/3091173426","heartbeat_front_addr":"172.21.15.177:6805/3091173426","state":["exists","up"]},{"osd":3,"uuid":"8193c2a2-18a1-4684-9a16-cbeae25530ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":3792992620},{"type":"v1","addr":"172.21.15.50:6811","nonce":3792992620}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":3792992620},{"type":"v1","addr":"172.21.15.50:6813","nonce":3792992620}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":3792992620},{"type":"v1","addr":"172.21.15.50:6817","nonce":3792992620}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":3792992620},{"type":"v1","addr":"172.21.15.50:6815","nonce":3792992620}]},"public_addr":"172.21.15.50:6811/3792992620","cluster_addr":"172.21.15.50:6813/3792992620","heartbeat_back_addr":"172.21.15.50:6817/3792992620","heartbeat_front_addr":"172.21.15.50:6815/3792992620","state":["exists","up"]},{"osd":4,"uuid":"2a2b4e64-0f8e-40ec-926c-84dbf691aefe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":2855333596},{"type":"v1","addr":"172.21.15.133:6809","nonce":2855333596}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":2855333596},{"type":"v1","addr":"172.21.15.133:6811","nonce":2855333596}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":2855333596},{"type":"v1","addr":"172.21.15.133:6815","nonce":2855333596}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":2855333596},{"type":"v1","addr":"172.21.15.133:6813","nonce":2855333596}]},"public_addr":"172.21.15.133:6809/2855333596","cluster_addr":"172.21.15.133:6811/2855333596","heartbeat_back_addr":"172.21.15.133:6815/2855333596","heartbeat_front_addr":"172.21.15.133:6813/2855333596","state":["exists","up"]},{"osd":5,"uuid":"83429ff0-ea7d-4fcc-9611-39d9001aa216","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":1166415084},{"type":"v1","addr":"172.21.15.177:6809","nonce":1166415084}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":1166415084},{"type":"v1","addr":"172.21.15.177:6811","nonce":1166415084}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":1166415084},{"type":"v1","addr":"172.21.15.177:6815","nonce":1166415084}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":1166415084},{"type":"v1","addr":"172.21.15.177:6813","nonce":1166415084}]},"public_addr":"172.21.15.177:6809/1166415084","cluster_addr":"172.21.15.177:6811/1166415084","heartbeat_back_addr":"172.21.15.177:6815/1166415084","heartbeat_front_addr":"172.21.15.177:6813/1166415084","state":["exists","up"]},{"osd":6,"uuid":"eeb571ef-5e43-4816-95dd-d01d83aeca83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":1429341184},{"type":"v1","addr":"172.21.15.50:6819","nonce":1429341184}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":1429341184},{"type":"v1","addr":"172.21.15.50:6821","nonce":1429341184}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":1429341184},{"type":"v1","addr":"172.21.15.50:6825","nonce":1429341184}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":1429341184},{"type":"v1","addr":"172.21.15.50:6823","nonce":1429341184}]},"public_addr":"172.21.15.50:6819/1429341184","cluster_addr":"172.21.15.50:6821/1429341184","heartbeat_back_addr":"172.21.15.50:6825/1429341184","heartbeat_front_addr":"172.21.15.50:6823/1429341184","state":["exists","up"]},{"osd":7,"uuid":"512ee507-0d50-4fed-b692-dbdf23a93e8e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":3643454923},{"type":"v1","addr":"172.21.15.133:6817","nonce":3643454923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":3643454923},{"type":"v1","addr":"172.21.15.133:6819","nonce":3643454923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":3643454923},{"type":"v1","addr":"172.21.15.133:6823","nonce":3643454923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":3643454923},{"type":"v1","addr":"172.21.15.133:6821","nonce":3643454923}]},"public_addr":"172.21.15.133:6817/3643454923","cluster_addr":"172.21.15.133:6819/3643454923","heartbeat_back_addr":"172.21.15.133:6823/3643454923","heartbeat_front_addr":"172.21.15.133:6821/3643454923","state":["exists","up"]},{"osd":8,"uuid":"ae99526e-41da-4cb5-857f-2e66f18f2d94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6816","nonce":101973300},{"type":"v1","addr":"172.21.15.177:6817","nonce":101973300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":101973300},{"type":"v1","addr":"172.21.15.177:6819","nonce":101973300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":101973300},{"type":"v1","addr":"172.21.15.177:6823","nonce":101973300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":101973300},{"type":"v1","addr":"172.21.15.177:6821","nonce":101973300}]},"public_addr":"172.21.15.177:6817/101973300","cluster_addr":"172.21.15.177:6819/101973300","heartbeat_back_addr":"172.21.15.177:6823/101973300","heartbeat_front_addr":"172.21.15.177:6821/101973300","state":["exists","up"]},{"osd":9,"uuid":"fcedbe16-b910-407f-b9d7-1dd03f3e62a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":53019860},{"type":"v1","addr":"172.21.15.50:6827","nonce":53019860}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":53019860},{"type":"v1","addr":"172.21.15.50:6829","nonce":53019860}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":53019860},{"type":"v1","addr":"172.21.15.50:6833","nonce":53019860}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":53019860},{"type":"v1","addr":"172.21.15.50:6831","nonce":53019860}]},"public_addr":"172.21.15.50:6827/53019860","cluster_addr":"172.21.15.50:6829/53019860","heartbeat_back_addr":"172.21.15.50:6833/53019860","heartbeat_front_addr":"172.21.15.50:6831/53019860","state":["exists","up"]},{"osd":10,"uuid":"3852756e-62f1-4e71-a070-8cff76df99b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":4175566493},{"type":"v1","addr":"172.21.15.133:6825","nonce":4175566493}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":4175566493},{"type":"v1","addr":"172.21.15.133:6827","nonce":4175566493}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":4175566493},{"type":"v1","addr":"172.21.15.133:6831","nonce":4175566493}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":4175566493},{"type":"v1","addr":"172.21.15.133:6829","nonce":4175566493}]},"public_addr":"172.21.15.133:6825/4175566493","cluster_addr":"172.21.15.133:6827/4175566493","heartbeat_back_addr":"172.21.15.133:6831/4175566493","heartbeat_front_addr":"172.21.15.133:6829/4175566493","state":["exists","up"]},{"osd":11,"uuid":"a154180a-5f2a-4b33-ad3d-fea7317597ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":2103454982},{"type":"v1","addr":"172.21.15.177:6825","nonce":2103454982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":2103454982},{"type":"v1","addr":"172.21.15.177:6827","nonce":2103454982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":2103454982},{"type":"v1","addr":"172.21.15.177:6831","nonce":2103454982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":2103454982},{"type":"v1","addr":"172.21.15.177:6829","nonce":2103454982}]},"public_addr":"172.21.15.177:6825/2103454982","cluster_addr":"172.21.15.177:6827/2103454982","heartbeat_back_addr":"172.21.15.177:6831/2103454982","heartbeat_front_addr":"172.21.15.177:6829/2103454982","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:14:54.683660+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:15:20.007319+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:15:43.613426+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:16:12.387010+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:16:38.079210+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:17:02.750375+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:17:31.735810+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:17:57.600985+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:18:22.503347+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:18:52.316657+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:19:18.444623+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:19:42.331006+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.b","mappings":[{"from":2,"to":4},{"from":8,"to":11}]},{"pgid":"2.1b","mappings":[{"from":2,"to":1}]},{"pgid":"2.1d","mappings":[{"from":8,"to":11}]},{"pgid":"3.e","mappings":[{"from":4,"to":6}]},{"pgid":"3.17","mappings":[{"from":4,"to":8}]},{"pgid":"3.25","mappings":[{"from":5,"to":9}]},{"pgid":"3.29","mappings":[{"from":3,"to":9}]},{"pgid":"3.36","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.50:6801/1319056820":"2024-09-01T04:12:55.742020+0000","172.21.15.50:0/1755103674":"2024-09-01T04:12:55.742020+0000","172.21.15.50:6800/1319056820":"2024-09-01T04:12:55.742020+0000","172.21.15.50:0/3701412233":"2024-09-01T04:12:55.742020+0000","172.21.15.50:0/1829556336":"2024-09-01T04:12:55.742020+0000","172.21.15.50:0/1698995126":"2024-09-01T04:12:25.753831+0000","172.21.15.50:0/1554317941":"2024-09-01T04:12:25.753831+0000","172.21.15.50:0/2998110380":"2024-09-01T04:12:25.753831+0000","172.21.15.50:6801/4197277793":"2024-09-01T04:12:25.753831+0000","172.21.15.50:6800/4197277793":"2024-09-01T04:12:25.753831+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-31T04:23:12.905 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:12.902+0000 7f9e57000640 1 -- 172.21.15.50:0/3079678587 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f9e380b4b30 msgr2=0x7f9e380b7040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:23:12.905 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:12.902+0000 7f9e57000640 1 --2- 172.21.15.50:0/3079678587 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f9e380b4b30 0x7f9e380b7040 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f9e44005fd0 tx=0x7f9e44009500 comp rx=0 tx=0).stop 2024-08-31T04:23:12.905 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:12.902+0000 7f9e57000640 1 -- 172.21.15.50:0/3079678587 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9e50109090 msgr2=0x7f9e5019a660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:23:12.905 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:12.902+0000 7f9e57000640 1 --2- 172.21.15.50:0/3079678587 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9e50109090 0x7f9e5019a660 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f9e3c02a930 tx=0x7f9e3c031a20 comp rx=0 tx=0).stop 2024-08-31T04:23:12.905 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:12.902+0000 7f9e57000640 1 -- 172.21.15.50:0/3079678587 shutdown_connections 2024-08-31T04:23:12.905 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:12.902+0000 7f9e57000640 1 --2- 172.21.15.50:0/3079678587 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f9e380b4b30 0x7f9e380b7040 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:12.905 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:12.902+0000 7f9e57000640 1 --2- 172.21.15.50:0/3079678587 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9e501099e0 0x7f9e5019f900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:12.905 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:12.902+0000 7f9e57000640 1 --2- 172.21.15.50:0/3079678587 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9e50109090 0x7f9e5019a660 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:12.906 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:12.902+0000 7f9e57000640 1 --2- 172.21.15.50:0/3079678587 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9e50103750 0x7f9e5019a0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:12.906 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:12.902+0000 7f9e57000640 1 -- 172.21.15.50:0/3079678587 >> 172.21.15.50:0/3079678587 conn(0x7f9e500ff1a0 msgr2=0x7f9e501015c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:23:12.906 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:12.903+0000 7f9e57000640 1 -- 172.21.15.50:0/3079678587 shutdown_connections 2024-08-31T04:23:12.906 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:12.903+0000 7f9e57000640 1 -- 172.21.15.50:0/3079678587 wait complete. 2024-08-31T04:23:13.588 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 058d9fc6-674f-11ef-bcd4-c7b262605968 -- ceph daemon mon.a --format=json config get run_dir 2024-08-31T04:23:13.798 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:23:13 smithi177 ceph-mon[22025]: pgmap v376: 97 pgs: 97 active+clean; 649 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 853 B/s wr, 12 op/s 2024-08-31T04:23:13.798 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:23:13 smithi177 ceph-mon[22025]: from='client.? 172.21.15.50:0/3079678587' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-31T04:23:13.845 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:23:13 smithi133 ceph-mon[22177]: pgmap v376: 97 pgs: 97 active+clean; 649 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 853 B/s wr, 12 op/s 2024-08-31T04:23:13.845 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:23:13 smithi133 ceph-mon[22177]: from='client.? 172.21.15.50:0/3079678587' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-31T04:23:13.948 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:13.945+0000 7f3f69c00640 1 -- 172.21.15.50:0/3799467713 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3f64104300 msgr2=0x7f3f64104710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:23:13.948 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:13.945+0000 7f3f69c00640 1 --2- 172.21.15.50:0/3799467713 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3f64104300 0x7f3f64104710 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f3f50009860 tx=0x7f3f5002a340 comp rx=0 tx=0).stop 2024-08-31T04:23:13.948 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:13.945+0000 7f3f69c00640 1 -- 172.21.15.50:0/3799467713 shutdown_connections 2024-08-31T04:23:13.948 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:13.945+0000 7f3f69c00640 1 --2- 172.21.15.50:0/3799467713 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3f64104300 0x7f3f64104710 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:13.948 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:13.945+0000 7f3f69c00640 1 --2- 172.21.15.50:0/3799467713 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3f64104ca0 0x7f3f6410b640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:13.948 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:13.945+0000 7f3f69c00640 1 --2- 172.21.15.50:0/3799467713 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3f64103280 0x7f3f641036f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:13.948 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:13.945+0000 7f3f69c00640 1 -- 172.21.15.50:0/3799467713 >> 172.21.15.50:0/3799467713 conn(0x7f3f640febc0 msgr2=0x7f3f64101070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:23:13.949 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:13.945+0000 7f3f69c00640 1 -- 172.21.15.50:0/3799467713 shutdown_connections 2024-08-31T04:23:13.949 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:13.945+0000 7f3f69c00640 1 -- 172.21.15.50:0/3799467713 wait complete. 2024-08-31T04:23:13.949 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:13.947+0000 7f3f69c00640 1 Processor -- start 2024-08-31T04:23:13.949 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:13.947+0000 7f3f69c00640 1 -- start start 2024-08-31T04:23:13.950 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:13.947+0000 7f3f69c00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3f64103280 0x7f3f64199b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:13.950 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:13.947+0000 7f3f69c00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3f64104300 0x7f3f6419a1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:13.950 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:13.947+0000 7f3f69c00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3f64104ca0 0x7f3f6419ad50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:13.950 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:13.947+0000 7f3f69c00640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f3f6410ef00 con 0x7f3f64103280 2024-08-31T04:23:13.950 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:13.947+0000 7f3f69c00640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f3f6410ed80 con 0x7f3f64104300 2024-08-31T04:23:13.950 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:13.947+0000 7f3f69c00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f3f6410f080 con 0x7f3f64104ca0 2024-08-31T04:23:13.950 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:23:13 smithi050 ceph-mon[17259]: pgmap v376: 97 pgs: 97 active+clean; 649 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 853 B/s wr, 12 op/s 2024-08-31T04:23:13.950 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:23:13 smithi050 ceph-mon[17259]: from='client.? 172.21.15.50:0/3079678587' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-31T04:23:13.952 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:13.948+0000 7f3f63e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3f64103280 0x7f3f64199b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:13.952 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:13.948+0000 7f3f63e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3f64103280 0x7f3f64199b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:37608/0 (socket says 172.21.15.50:37608) 2024-08-31T04:23:13.952 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:13.948+0000 7f3f63e00640 1 -- 172.21.15.50:0/299214257 learned_addr learned my addr 172.21.15.50:0/299214257 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:23:13.952 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:13.948+0000 7f3f69200640 1 --2- 172.21.15.50:0/299214257 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3f64104ca0 0x7f3f6419ad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:13.952 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:13.948+0000 7f3f63400640 1 --2- 172.21.15.50:0/299214257 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3f64104300 0x7f3f6419a1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:13.952 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:13.948+0000 7f3f63e00640 1 -- 172.21.15.50:0/299214257 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3f64104ca0 msgr2=0x7f3f6419ad50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:23:13.952 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:13.948+0000 7f3f63e00640 1 --2- 172.21.15.50:0/299214257 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3f64104ca0 0x7f3f6419ad50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:13.952 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:13.948+0000 7f3f63e00640 1 -- 172.21.15.50:0/299214257 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3f64104300 msgr2=0x7f3f6419a1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:23:13.952 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:13.948+0000 7f3f63e00640 1 --2- 172.21.15.50:0/299214257 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3f64104300 0x7f3f6419a1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:13.952 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:13.948+0000 7f3f63e00640 1 -- 172.21.15.50:0/299214257 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f6419b570 con 0x7f3f64103280 2024-08-31T04:23:13.952 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:13.948+0000 7f3f69200640 1 --2- 172.21.15.50:0/299214257 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3f64104ca0 0x7f3f6419ad50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:23:13.952 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:13.948+0000 7f3f63400640 1 --2- 172.21.15.50:0/299214257 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3f64104300 0x7f3f6419a1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:23:13.953 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:13.948+0000 7f3f63e00640 1 --2- 172.21.15.50:0/299214257 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3f64103280 0x7f3f64199b30 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f3f5400e9f0 tx=0x7f3f5400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:23:13.953 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:13.949+0000 7f3f60c00640 1 -- 172.21.15.50:0/299214257 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f5400cd80 con 0x7f3f64103280 2024-08-31T04:23:13.953 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:13.949+0000 7f3f60c00640 1 -- 172.21.15.50:0/299214257 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3f540108e0 con 0x7f3f64103280 2024-08-31T04:23:13.953 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:13.949+0000 7f3f69c00640 1 -- 172.21.15.50:0/299214257 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3f6419b860 con 0x7f3f64103280 2024-08-31T04:23:13.953 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:13.949+0000 7f3f60c00640 1 -- 172.21.15.50:0/299214257 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f54018980 con 0x7f3f64103280 2024-08-31T04:23:13.953 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:13.949+0000 7f3f69c00640 1 -- 172.21.15.50:0/299214257 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3f641a1f50 con 0x7f3f64103280 2024-08-31T04:23:13.954 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:13.952+0000 7f3f721cd740 1 Processor -- start 2024-08-31T04:23:13.954 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:13.952+0000 7f3f721cd740 1 -- start start 2024-08-31T04:23:13.956 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:13.953+0000 7f3f721cd740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5623e3ec31b0 0x5623e4268d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:13.956 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:13.953+0000 7f3f721cd740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5623e3e9a2f0 0x5623e42693b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:13.956 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:13.953+0000 7f3f721cd740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5623e3ea24d0 0x5623e4269f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:13.956 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:13.953+0000 7f3f721cd740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x5623e41dbf70 con 0x5623e3ea24d0 2024-08-31T04:23:13.956 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:13.953+0000 7f3f721cd740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x5623e41cb500 con 0x5623e3e9a2f0 2024-08-31T04:23:13.956 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:13.953+0000 7f3f721cd740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x5623e41cf4b0 con 0x5623e3ec31b0 2024-08-31T04:23:13.956 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:13.953+0000 7f3f60c00640 1 -- 172.21.15.50:0/299214257 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 18) ==== 152577+0+0 (secure 0 0 0) 0x7f3f54010430 con 0x7f3f64103280 2024-08-31T04:23:13.957 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:13.953+0000 7f3f69200640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5623e3ec31b0 0x5623e4268d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:13.957 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:13.953+0000 7f3f69200640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5623e3ec31b0 0x5623e4268d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.50:51162/0 (socket says 172.21.15.50:51162) 2024-08-31T04:23:13.957 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:13.953+0000 7f3f69200640 1 -- 172.21.15.50:0/967594700 learned_addr learned my addr 172.21.15.50:0/967594700 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:23:13.957 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:13.953+0000 7f3f63400640 1 --2- 172.21.15.50:0/967594700 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5623e3ea24d0 0x5623e4269f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:13.957 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:13.953+0000 7f3f63e00640 1 --2- 172.21.15.50:0/967594700 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5623e3e9a2f0 0x5623e42693b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:13.957 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:13.953+0000 7f3f69200640 1 -- 172.21.15.50:0/967594700 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5623e3e9a2f0 msgr2=0x5623e42693b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:23:13.957 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:13.954+0000 7f3f69200640 1 --2- 172.21.15.50:0/967594700 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5623e3e9a2f0 0x5623e42693b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:13.957 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:13.954+0000 7f3f69200640 1 -- 172.21.15.50:0/967594700 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5623e3ea24d0 msgr2=0x5623e4269f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:23:13.957 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:13.954+0000 7f3f69200640 1 --2- 172.21.15.50:0/967594700 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5623e3ea24d0 0x5623e4269f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:13.957 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:13.954+0000 7f3f69200640 1 -- 172.21.15.50:0/967594700 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5623e4185c10 con 0x5623e3ec31b0 2024-08-31T04:23:13.957 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:13.954+0000 7f3f63e00640 1 --2- 172.21.15.50:0/967594700 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5623e3e9a2f0 0x5623e42693b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T04:23:13.957 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:13.954+0000 7f3f69200640 1 --2- 172.21.15.50:0/967594700 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5623e3ec31b0 0x5623e4268d40 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f3f5c00f480 tx=0x7f3f5c00f940 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1755afa797a7d681 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:23:13.959 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:13.954+0000 7f3f59600640 1 -- 172.21.15.50:0/967594700 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f5c01d070 con 0x5623e3ec31b0 2024-08-31T04:23:13.959 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:13.954+0000 7f3f59600640 1 -- 172.21.15.50:0/967594700 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3f5c00cc30 con 0x5623e3ec31b0 2024-08-31T04:23:13.959 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:13.954+0000 7f3f59600640 1 -- 172.21.15.50:0/967594700 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f5c018c00 con 0x5623e3ec31b0 2024-08-31T04:23:13.959 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:13.955+0000 7f3f60c00640 1 --2- 172.21.15.50:0/299214257 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f3f480b4b30 0x7f3f480b7040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:13.959 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:13.955+0000 7f3f60c00640 1 -- 172.21.15.50:0/299214257 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8219+0+0 (secure 0 0 0) 0x7f3f540e5590 con 0x7f3f64103280 2024-08-31T04:23:13.959 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:13.955+0000 7f3f63e00640 1 --2- 172.21.15.50:0/299214257 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f3f480b4b30 0x7f3f480b7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:13.959 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:13.956+0000 7f3f721cd740 1 -- 172.21.15.50:0/967594700 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5623e3ec31b0 msgr2=0x5623e4268d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:23:13.960 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:13.956+0000 7f3f721cd740 1 --2- 172.21.15.50:0/967594700 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5623e3ec31b0 0x5623e4268d40 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f3f5c00f480 tx=0x7f3f5c00f940 comp rx=0 tx=0).stop 2024-08-31T04:23:13.960 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:13.956+0000 7f3f721cd740 1 -- 172.21.15.50:0/967594700 shutdown_connections 2024-08-31T04:23:13.960 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:13.956+0000 7f3f721cd740 1 --2- 172.21.15.50:0/967594700 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5623e3ea24d0 0x5623e4269f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:13.960 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:13.956+0000 7f3f721cd740 1 --2- 172.21.15.50:0/967594700 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5623e3e9a2f0 0x5623e42693b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:13.960 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:13.956+0000 7f3f721cd740 1 --2- 172.21.15.50:0/967594700 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5623e3ec31b0 0x5623e4268d40 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:13.960 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:13.956+0000 7f3f721cd740 1 -- 172.21.15.50:0/967594700 >> 172.21.15.50:0/967594700 conn(0x5623e3eb7300 msgr2=0x5623e42647d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:23:13.960 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:13.956+0000 7f3f63e00640 1 --2- 172.21.15.50:0/299214257 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f3f480b4b30 0x7f3f480b7040 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f3f540abcd0 tx=0x7f3f54000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:23:13.960 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:13.956+0000 7f3f721cd740 1 -- 172.21.15.50:0/967594700 shutdown_connections 2024-08-31T04:23:13.960 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:13.956+0000 7f3f721cd740 1 -- 172.21.15.50:0/967594700 wait complete. 2024-08-31T04:23:13.960 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:13.956+0000 7f3f721cd740 1 -- start start 2024-08-31T04:23:13.960 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:13.957+0000 7f3f721cd740 1 Processor -- start 2024-08-31T04:23:13.963 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:13.958+0000 7f3f721cd740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5623e3e9a2f0 0x5623e4272300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:13.963 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:13.958+0000 7f3f721cd740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5623e3ea24d0 0x5623e42729c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:13.963 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:13.958+0000 7f3f721cd740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5623e3ec31b0 0x5623e4273530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:13.963 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:13.958+0000 7f3f721cd740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x5623e4104ab0 con 0x5623e3ea24d0 2024-08-31T04:23:13.963 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:13.958+0000 7f3f721cd740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x5623e4172320 con 0x5623e3ec31b0 2024-08-31T04:23:13.963 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:13.958+0000 7f3f721cd740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x5623e426aa20 con 0x5623e3e9a2f0 2024-08-31T04:23:13.963 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:13.958+0000 7f3f721cd740 10 client.0 _ll_register_callbacks cb 0x5623e41abe80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:23:13.963 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:13.958+0000 7f3f63400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5623e3ea24d0 0x5623e42729c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:13.963 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:13.958+0000 7f3f63400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5623e3ea24d0 0x5623e42729c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:37626/0 (socket says 172.21.15.50:37626) 2024-08-31T04:23:13.963 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:13.958+0000 7f3f63400640 1 -- 172.21.15.50:0/3251450424 learned_addr learned my addr 172.21.15.50:0/3251450424 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:23:13.963 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:13.958+0000 7f3f69200640 1 --2- 172.21.15.50:0/3251450424 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5623e3e9a2f0 0x5623e4272300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:13.964 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:13.958+0000 7f3f69200640 1 --2- 172.21.15.50:0/3251450424 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5623e3ec31b0 0x5623e4273530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:13.964 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:13.959+0000 7f3f63400640 1 -- 172.21.15.50:0/3251450424 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5623e3e9a2f0 msgr2=0x5623e4272300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:23:13.964 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:13.959+0000 7f3f63400640 1 --2- 172.21.15.50:0/3251450424 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5623e3e9a2f0 0x5623e4272300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:13.964 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:13.959+0000 7f3f63400640 1 -- 172.21.15.50:0/3251450424 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5623e3ec31b0 msgr2=0x5623e4273530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:23:13.964 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:13.959+0000 7f3f63400640 1 --2- 172.21.15.50:0/3251450424 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5623e3ec31b0 0x5623e4273530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:13.964 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:13.959+0000 7f3f63400640 1 -- 172.21.15.50:0/3251450424 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5623e3f2e790 con 0x5623e3ea24d0 2024-08-31T04:23:13.964 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:13.959+0000 7f3f63400640 1 --2- 172.21.15.50:0/3251450424 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5623e3ea24d0 0x5623e42729c0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f3f5002a860 tx=0x7f3f50030b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e6fa5de8e2780bf server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:23:13.964 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:13.959+0000 7f3f4e000640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-08-31T04:23:13.964 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:13.959+0000 7f3f4e000640 1 -- 172.21.15.50:0/3251450424 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f50041070 con 0x5623e3ea24d0 2024-08-31T04:23:13.964 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:13.959+0000 7f3f4e000640 1 -- 172.21.15.50:0/3251450424 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8219+0+0 (secure 0 0 0) 0x7f3f50004240 con 0x5623e3ea24d0 2024-08-31T04:23:13.964 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:13.959+0000 7f3f721cd740 1 -- 172.21.15.50:0/3251450424 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3f5c00cc30 con 0x5623e3ea24d0 2024-08-31T04:23:13.964 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:13.960+0000 7f3f4e000640 1 -- 172.21.15.50:0/3251450424 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f3f5004d050 con 0x5623e3ea24d0 2024-08-31T04:23:13.964 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:13.960+0000 7f3f721cd740 10 client.15336 fetch_fsmap learned FSMap version 29 2024-08-31T04:23:13.965 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:13.960+0000 7f3f721cd740 1 -- 172.21.15.50:0/3251450424 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5623e3fa7620 con 0x5623e3ea24d0 2024-08-31T04:23:13.965 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:13.960+0000 7f3f4e000640 1 -- 172.21.15.50:0/3251450424 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3f5c00cc30 con 0x5623e3ea24d0 2024-08-31T04:23:13.965 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:13.960+0000 7f3f4e000640 1 -- 172.21.15.50:0/3251450424 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f3f50004990 con 0x5623e3ea24d0 2024-08-31T04:23:13.965 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:13.960+0000 7f3f721cd740 10 client.15336 fetch_fsmap finished waiting for FSMap version 29 2024-08-31T04:23:13.965 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:13.960+0000 7f3f721cd740 10 client.15336 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T04:23:13.965 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:13.960+0000 7f3f721cd740 20 client.15336 populate_metadata read hostname 'smithi050' 2024-08-31T04:23:13.965 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:13.960+0000 7f3f721cd740 1 --2- 172.21.15.50:0/3251450424 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x5623e3e81d80 0x5623e4288270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:13.965 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:13.960+0000 7f3f721cd740 4 client.15336 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T04:23:13.965 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:13.960+0000 7f3f721cd740 1 -- 172.21.15.50:0/3251450424 --> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5623e41ddec0 con 0x5623e3e81d80 2024-08-31T04:23:13.965 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:13.961+0000 7f3f69200640 1 --2- 172.21.15.50:0/3251450424 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x5623e3e81d80 0x5623e4288270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:13.966 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:13.961+0000 7f3f69200640 1 --2- 172.21.15.50:0/3251450424 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x5623e3e81d80 0x5623e4288270 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=448ef78779ff3097 server_cookie=965811ee06a45e8e in_seq=0 out_seq=0 2024-08-31T04:23:13.966 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:13.961+0000 7f3f4e000640 10 client.15336 ms_handle_connect on v2:172.21.15.133:6838/2526402262 2024-08-31T04:23:13.966 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:13.962+0000 7f3f4e000640 1 -- 172.21.15.50:0/3251450424 <== mds.0 v2:172.21.15.133:6838/2526402262 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5623e41ddec0 con 0x5623e3e81d80 2024-08-31T04:23:13.966 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:13.962+0000 7f3f4e000640 10 client.15336 handle_command_reply: tid=0 2024-08-31T04:23:13.966 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:13.962+0000 7f3f721cd740 1 client.15336 shutdown 2024-08-31T04:23:13.967 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:13.963+0000 7f3f721cd740 1 -- 172.21.15.50:0/3251450424 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5623e3ea24d0 msgr2=0x5623e42729c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:23:13.967 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:13.963+0000 7f3f721cd740 1 --2- 172.21.15.50:0/3251450424 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5623e3ea24d0 0x5623e42729c0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f3f5002a860 tx=0x7f3f50030b10 comp rx=0 tx=0).stop 2024-08-31T04:23:13.967 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:13.963+0000 7f3f721cd740 1 -- 172.21.15.50:0/3251450424 shutdown_connections 2024-08-31T04:23:13.967 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:13.963+0000 7f3f721cd740 1 --2- 172.21.15.50:0/3251450424 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x5623e3e81d80 0x5623e4288270 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:13.967 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:13.963+0000 7f3f721cd740 1 --2- 172.21.15.50:0/3251450424 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5623e3ec31b0 0x5623e4273530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:13.967 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:13.963+0000 7f3f721cd740 1 --2- 172.21.15.50:0/3251450424 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5623e3ea24d0 0x5623e42729c0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:13.967 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:13.963+0000 7f3f721cd740 1 --2- 172.21.15.50:0/3251450424 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5623e3e9a2f0 0x5623e4272300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:13.967 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:13.963+0000 7f3f4e000640 0 client.15336 ms_handle_reset on v2:172.21.15.133:6838/2526402262 2024-08-31T04:23:13.967 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:13.963+0000 7f3f721cd740 1 -- 172.21.15.50:0/3251450424 >> 172.21.15.50:0/3251450424 conn(0x5623e3eb7300 msgr2=0x5623e4269db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:23:13.967 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:13.963+0000 7f3f721cd740 1 -- 172.21.15.50:0/3251450424 shutdown_connections 2024-08-31T04:23:13.967 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:13.963+0000 7f3f721cd740 1 -- 172.21.15.50:0/3251450424 wait complete. 2024-08-31T04:23:13.967 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:13.963+0000 7f3f721cd740 20 client.15336 trim_cache size 0 max 16384 2024-08-31T04:23:13.985 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:23:13.988 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:13.985+0000 7f3f721cd740 1 Processor -- start 2024-08-31T04:23:13.988 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:13.986+0000 7f3f721cd740 1 -- start start 2024-08-31T04:23:13.988 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:13.986+0000 7f3f721cd740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5623e3e9a2f0 0x5623e4272a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:13.988 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:13.986+0000 7f3f721cd740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5623e3ea24d0 0x5623e4269350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:13.988 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:13.986+0000 7f3f721cd740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5623e3ec31b0 0x5623e4264110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:13.988 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:13.986+0000 7f3f721cd740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f3f641a89a0 con 0x5623e3e9a2f0 2024-08-31T04:23:13.988 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:13.986+0000 7f3f721cd740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f3f641aa4e0 con 0x5623e3ec31b0 2024-08-31T04:23:13.988 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:13.986+0000 7f3f721cd740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f3f641a9070 con 0x5623e3ea24d0 2024-08-31T04:23:13.990 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:13.986+0000 7f3f69200640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5623e3e9a2f0 0x5623e4272a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:13.990 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:13.986+0000 7f3f63400640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5623e3ea24d0 0x5623e4269350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:13.990 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:13.986+0000 7f3f69200640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5623e3e9a2f0 0x5623e4272a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:37634/0 (socket says 172.21.15.50:37634) 2024-08-31T04:23:13.990 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:13.986+0000 7f3f69200640 1 -- 172.21.15.50:0/4066512764 learned_addr learned my addr 172.21.15.50:0/4066512764 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:23:13.990 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:13.986+0000 7f3f63400640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5623e3ea24d0 0x5623e4269350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.50:51170/0 (socket says 172.21.15.50:51170) 2024-08-31T04:23:13.990 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:13.987+0000 7f3f69200640 1 --2- 172.21.15.50:0/4066512764 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5623e3ec31b0 0x5623e4264110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:13.990 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:13.987+0000 7f3f63400640 1 -- 172.21.15.50:0/4066512764 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5623e3ec31b0 msgr2=0x5623e4264110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:23:13.990 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:13.987+0000 7f3f63400640 1 --2- 172.21.15.50:0/4066512764 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5623e3ec31b0 0x5623e4264110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:13.990 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:13.987+0000 7f3f63400640 1 -- 172.21.15.50:0/4066512764 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5623e3e9a2f0 msgr2=0x5623e4272a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:23:13.991 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:13.987+0000 7f3f63400640 1 --2- 172.21.15.50:0/4066512764 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5623e3e9a2f0 0x5623e4272a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:13.991 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:13.987+0000 7f3f63400640 1 -- 172.21.15.50:0/4066512764 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5623e4271250 con 0x5623e3ea24d0 2024-08-31T04:23:13.991 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:13.987+0000 7f3f69200640 1 --2- 172.21.15.50:0/4066512764 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5623e3e9a2f0 0x5623e4272a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:23:13.991 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:13.987+0000 7f3f63400640 1 --2- 172.21.15.50:0/4066512764 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5623e3ea24d0 0x5623e4269350 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x5623e426abd0 tx=0x7f3f5002a340 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b9e1d279c9fe1120 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:23:13.991 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:13.987+0000 7f3f58c00640 1 -- 172.21.15.50:0/4066512764 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f50041040 con 0x5623e3ea24d0 2024-08-31T04:23:13.991 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:13.987+0000 7f3f58c00640 1 -- 172.21.15.50:0/4066512764 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3f50004b70 con 0x5623e3ea24d0 2024-08-31T04:23:13.991 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:13.987+0000 7f3f58c00640 1 -- 172.21.15.50:0/4066512764 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f50037040 con 0x5623e3ea24d0 2024-08-31T04:23:13.994 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:13.988+0000 7f3f721cd740 1 -- 172.21.15.50:0/4066512764 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5623e3ea24d0 msgr2=0x5623e4269350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:23:13.994 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:13.988+0000 7f3f721cd740 1 --2- 172.21.15.50:0/4066512764 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5623e3ea24d0 0x5623e4269350 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x5623e426abd0 tx=0x7f3f5002a340 comp rx=0 tx=0).stop 2024-08-31T04:23:13.994 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:13.988+0000 7f3f721cd740 1 -- 172.21.15.50:0/4066512764 shutdown_connections 2024-08-31T04:23:13.994 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:13.988+0000 7f3f721cd740 1 --2- 172.21.15.50:0/4066512764 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5623e3ea24d0 0x5623e4269350 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:13.994 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:13.988+0000 7f3f721cd740 1 --2- 172.21.15.50:0/4066512764 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5623e3ec31b0 0x5623e4264110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:13.994 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:13.988+0000 7f3f721cd740 1 --2- 172.21.15.50:0/4066512764 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5623e3e9a2f0 0x5623e4272a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:13.995 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:13.988+0000 7f3f721cd740 1 -- 172.21.15.50:0/4066512764 >> 172.21.15.50:0/4066512764 conn(0x5623e3eb7300 msgr2=0x5623e4272300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:23:13.995 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:13.988+0000 7f3f721cd740 1 -- 172.21.15.50:0/4066512764 shutdown_connections 2024-08-31T04:23:13.995 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:13.988+0000 7f3f721cd740 1 -- 172.21.15.50:0/4066512764 wait complete. 2024-08-31T04:23:13.995 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:13.989+0000 7f3f721cd740 1 -- start start 2024-08-31T04:23:13.995 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:13.989+0000 7f3f721cd740 1 Processor -- start 2024-08-31T04:23:13.995 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:13.989+0000 7f3f721cd740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5623e3e9a2f0 0x5623e4283ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:13.995 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:13.989+0000 7f3f721cd740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5623e3ea24d0 0x5623e4284590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:13.995 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:13.989+0000 7f3f721cd740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5623e3ec31b0 0x5623e427fdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:13.995 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:13.990+0000 7f3f721cd740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f3f641a9e10 con 0x5623e3e9a2f0 2024-08-31T04:23:13.995 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:13.990+0000 7f3f721cd740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f3f641a9740 con 0x5623e3ec31b0 2024-08-31T04:23:13.995 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:13.990+0000 7f3f721cd740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f3f641a6980 con 0x5623e3ea24d0 2024-08-31T04:23:13.995 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:13.990+0000 7f3f721cd740 10 client.0 _ll_register_callbacks cb 0x7f3f5c009460 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:23:13.995 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:13.990+0000 7f3f69200640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5623e3e9a2f0 0x5623e4283ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:13.995 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:13.990+0000 7f3f69200640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5623e3e9a2f0 0x5623e4283ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:37646/0 (socket says 172.21.15.50:37646) 2024-08-31T04:23:13.996 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:13.990+0000 7f3f69200640 1 -- 172.21.15.50:0/4167785958 learned_addr learned my addr 172.21.15.50:0/4167785958 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:23:13.996 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:13.990+0000 7f3f69200640 1 --2- 172.21.15.50:0/4167785958 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5623e3ec31b0 0x5623e427fdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:13.996 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:13.990+0000 7f3f63400640 1 --2- 172.21.15.50:0/4167785958 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5623e3ea24d0 0x5623e4284590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:13.996 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:13.990+0000 7f3f69200640 1 -- 172.21.15.50:0/4167785958 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5623e3ea24d0 msgr2=0x5623e4284590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:23:13.996 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:13.990+0000 7f3f69200640 1 --2- 172.21.15.50:0/4167785958 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5623e3ea24d0 0x5623e4284590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:13.996 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:13.990+0000 7f3f69200640 1 -- 172.21.15.50:0/4167785958 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5623e3ec31b0 msgr2=0x5623e427fdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:23:13.996 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:13.990+0000 7f3f69200640 1 --2- 172.21.15.50:0/4167785958 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5623e3ec31b0 0x5623e427fdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:13.996 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:13.990+0000 7f3f69200640 1 -- 172.21.15.50:0/4167785958 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5623e42805d0 con 0x5623e3e9a2f0 2024-08-31T04:23:13.996 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:13.990+0000 7f3f69200640 1 --2- 172.21.15.50:0/4167785958 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5623e3e9a2f0 0x5623e4283ed0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f3f5c01b040 tx=0x7f3f5c005fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f619c0c7d11be063 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:23:13.996 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:13.990+0000 7f3f4e000640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-08-31T04:23:13.996 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:13.991+0000 7f3f4e000640 1 -- 172.21.15.50:0/4167785958 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f5c031040 con 0x5623e3e9a2f0 2024-08-31T04:23:13.996 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:13.991+0000 7f3f4e000640 1 -- 172.21.15.50:0/4167785958 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8219+0+0 (secure 0 0 0) 0x7f3f5c00caf0 con 0x5623e3e9a2f0 2024-08-31T04:23:13.996 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:13.991+0000 7f3f721cd740 1 -- 172.21.15.50:0/4167785958 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3f50004b70 con 0x5623e3e9a2f0 2024-08-31T04:23:13.997 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:13.991+0000 7f3f4e000640 1 -- 172.21.15.50:0/4167785958 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f3f5c01d040 con 0x5623e3e9a2f0 2024-08-31T04:23:13.997 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:13.991+0000 7f3f721cd740 10 client.15342 fetch_fsmap learned FSMap version 29 2024-08-31T04:23:13.997 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:13.991+0000 7f3f721cd740 1 -- 172.21.15.50:0/4167785958 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5623e4281c90 con 0x5623e3e9a2f0 2024-08-31T04:23:13.997 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:13.991+0000 7f3f4e000640 1 -- 172.21.15.50:0/4167785958 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3f50004b70 con 0x5623e3e9a2f0 2024-08-31T04:23:13.997 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:13.992+0000 7f3f4e000640 1 -- 172.21.15.50:0/4167785958 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f3f5c023040 con 0x5623e3e9a2f0 2024-08-31T04:23:13.997 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:13.992+0000 7f3f721cd740 10 client.15342 fetch_fsmap finished waiting for FSMap version 29 2024-08-31T04:23:13.997 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:13.992+0000 7f3f721cd740 10 client.15342 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T04:23:13.997 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:13.992+0000 7f3f721cd740 20 client.15342 populate_metadata read hostname 'smithi050' 2024-08-31T04:23:13.997 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:13.992+0000 7f3f721cd740 1 --2- 172.21.15.50:0/4167785958 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x5623e3e571c0 0x5623e42f5330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:13.997 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:13.992+0000 7f3f721cd740 4 client.15342 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-31T04:23:13.997 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:13.992+0000 7f3f721cd740 1 -- 172.21.15.50:0/4167785958 --> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5623e41d9960 con 0x5623e3e571c0 2024-08-31T04:23:13.997 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:13.992+0000 7f3f63400640 1 --2- 172.21.15.50:0/4167785958 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x5623e3e571c0 0x5623e42f5330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:13.998 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:13.993+0000 7f3f63400640 1 --2- 172.21.15.50:0/4167785958 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x5623e3e571c0 0x5623e42f5330 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fb5b9cef89cdbfb2 server_cookie=f1f1c21326359ccd in_seq=0 out_seq=0 2024-08-31T04:23:13.998 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:13.993+0000 7f3f4e000640 10 client.15342 ms_handle_connect on v2:172.21.15.133:6838/2526402262 2024-08-31T04:23:14.009 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:14.006+0000 7f3f4e000640 1 -- 172.21.15.50:0/4167785958 <== mds.0 v2:172.21.15.133:6838/2526402262 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5623e41d9960 con 0x5623e3e571c0 2024-08-31T04:23:14.009 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:14.006+0000 7f3f4e000640 10 client.15342 handle_command_reply: tid=0 2024-08-31T04:23:14.009 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:14.006+0000 7f3f721cd740 1 client.15342 shutdown 2024-08-31T04:23:14.009 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:14.006+0000 7f3f721cd740 1 -- 172.21.15.50:0/4167785958 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5623e3e9a2f0 msgr2=0x5623e4283ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:23:14.009 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:14.006+0000 7f3f721cd740 1 --2- 172.21.15.50:0/4167785958 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5623e3e9a2f0 0x5623e4283ed0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f3f5c01b040 tx=0x7f3f5c005fd0 comp rx=0 tx=0).stop 2024-08-31T04:23:14.009 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:14.007+0000 7f3f721cd740 1 -- 172.21.15.50:0/4167785958 shutdown_connections 2024-08-31T04:23:14.009 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:14.007+0000 7f3f721cd740 1 --2- 172.21.15.50:0/4167785958 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x5623e3e571c0 0x5623e42f5330 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:14.009 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:14.007+0000 7f3f721cd740 1 --2- 172.21.15.50:0/4167785958 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5623e3ea24d0 0x5623e4284590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:14.010 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:14.007+0000 7f3f721cd740 1 --2- 172.21.15.50:0/4167785958 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5623e3ec31b0 0x5623e427fdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:14.010 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:14.007+0000 7f3f721cd740 1 --2- 172.21.15.50:0/4167785958 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5623e3e9a2f0 0x5623e4283ed0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:14.010 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:14.007+0000 7f3f4e000640 0 client.15342 ms_handle_reset on v2:172.21.15.133:6838/2526402262 2024-08-31T04:23:14.010 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:14.007+0000 7f3f721cd740 1 -- 172.21.15.50:0/4167785958 >> 172.21.15.50:0/4167785958 conn(0x5623e3eb7300 msgr2=0x5623e4264110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:23:14.010 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:14.007+0000 7f3f721cd740 1 -- 172.21.15.50:0/4167785958 shutdown_connections 2024-08-31T04:23:14.010 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:14.007+0000 7f3f721cd740 1 -- 172.21.15.50:0/4167785958 wait complete. 2024-08-31T04:23:14.010 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:14.007+0000 7f3f721cd740 20 client.15342 trim_cache size 0 max 16384 2024-08-31T04:23:14.010 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout:{ 2024-08-31T04:23:14.010 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout: "message": "", 2024-08-31T04:23:14.010 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout: "return_code": 0 2024-08-31T04:23:14.011 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout:} 2024-08-31T04:23:14.011 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:14.008+0000 7f3f69c00640 1 -- 172.21.15.50:0/299214257 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f3f480b4b30 msgr2=0x7f3f480b7040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:23:14.011 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:14.008+0000 7f3f69c00640 1 --2- 172.21.15.50:0/299214257 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f3f480b4b30 0x7f3f480b7040 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f3f540abcd0 tx=0x7f3f54000bc0 comp rx=0 tx=0).stop 2024-08-31T04:23:14.011 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:14.008+0000 7f3f69c00640 1 -- 172.21.15.50:0/299214257 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3f64103280 msgr2=0x7f3f64199b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:23:14.011 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:14.008+0000 7f3f69c00640 1 --2- 172.21.15.50:0/299214257 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3f64103280 0x7f3f64199b30 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f3f5400e9f0 tx=0x7f3f5400eeb0 comp rx=0 tx=0).stop 2024-08-31T04:23:14.011 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:14.008+0000 7f3f69c00640 1 -- 172.21.15.50:0/299214257 shutdown_connections 2024-08-31T04:23:14.011 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:14.008+0000 7f3f69c00640 1 --2- 172.21.15.50:0/299214257 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f3f480b4b30 0x7f3f480b7040 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:14.012 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:14.008+0000 7f3f69c00640 1 --2- 172.21.15.50:0/299214257 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3f64104ca0 0x7f3f6419ad50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:14.012 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:14.008+0000 7f3f69c00640 1 --2- 172.21.15.50:0/299214257 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3f64104300 0x7f3f6419a1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:14.012 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:14.008+0000 7f3f69c00640 1 --2- 172.21.15.50:0/299214257 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3f64103280 0x7f3f64199b30 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:14.012 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:14.008+0000 7f3f69c00640 1 -- 172.21.15.50:0/299214257 >> 172.21.15.50:0/299214257 conn(0x7f3f640febc0 msgr2=0x7f3f64107600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:23:14.012 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:14.008+0000 7f3f69c00640 1 -- 172.21.15.50:0/299214257 shutdown_connections 2024-08-31T04:23:14.012 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:14.008+0000 7f3f69c00640 1 -- 172.21.15.50:0/299214257 wait complete. 2024-08-31T04:23:15.393 INFO:teuthology.orchestra.run.smithi050.stdout:{"run_dir":"/var/run/ceph"} 2024-08-31T04:23:15.393 DEBUG:tasks.cephfs.filesystem:_json_asok output { "run_dir": "/var/run/ceph" } 2024-08-31T04:23:15.393 INFO:tasks.quiescer.fs.[cephfs]:Initializing Quiescer with seed 5413 2024-08-31T04:23:15.394 DEBUG:tasks.quiescer:Yielding 2024-08-31T04:23:15.394 INFO:teuthology.run_tasks:Running task workunit... 2024-08-31T04:23:15.408 INFO:tasks.workunit:Pulling workunits from ref d19e6118f7015f0047264006cb0c873528eb3ae6 2024-08-31T04:23:15.409 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-08-31T04:23:15.409 INFO:tasks.workunit:timeout=3h 2024-08-31T04:23:15.409 INFO:tasks.workunit:cleanup=True 2024-08-31T04:23:15.409 DEBUG:teuthology.orchestra.run.smithi050:> stat -- /home/ubuntu/cephtest/mnt.0 2024-08-31T04:23:15.410 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 058d9fc6-674f-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-31T04:23:15.447 INFO:teuthology.orchestra.run.smithi050.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-08-31T04:23:15.447 INFO:teuthology.orchestra.run.smithi050.stdout: Size: 0 Blocks: 0 IO Block: 65536 directory 2024-08-31T04:23:15.448 INFO:teuthology.orchestra.run.smithi050.stdout:Device: 78h/120d Inode: 1099511628283 Links: 2 2024-08-31T04:23:15.448 INFO:teuthology.orchestra.run.smithi050.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-31T04:23:15.448 INFO:teuthology.orchestra.run.smithi050.stdout:Context: system_u:object_r:unlabeled_t:s0 2024-08-31T04:23:15.448 INFO:teuthology.orchestra.run.smithi050.stdout:Access: 2024-08-31 04:21:08.435357477 +0000 2024-08-31T04:23:15.448 INFO:teuthology.orchestra.run.smithi050.stdout:Modify: 2024-08-31 04:21:08.435357477 +0000 2024-08-31T04:23:15.448 INFO:teuthology.orchestra.run.smithi050.stdout:Change: 2024-08-31 04:22:58.966270300 +0000 2024-08-31T04:23:15.448 INFO:teuthology.orchestra.run.smithi050.stdout: Birth: 2024-08-31 04:21:08.435357477 +0000 2024-08-31T04:23:15.448 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-08-31T04:23:15.448 DEBUG:teuthology.orchestra.run.smithi050:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-08-31T04:23:15.557 DEBUG:teuthology.orchestra.run.smithi050:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout d19e6118f7015f0047264006cb0c873528eb3ae6 2024-08-31T04:23:15.600 INFO:tasks.workunit.client.0.smithi050.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-08-31T04:23:15.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:23:15 smithi050 ceph-mon[17259]: pgmap v377: 97 pgs: 97 active+clean; 649 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 8 op/s 2024-08-31T04:23:15.821 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:23:15.996 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:23:15 smithi177 ceph-mon[22025]: pgmap v377: 97 pgs: 97 active+clean; 649 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 8 op/s 2024-08-31T04:23:16.043 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:23:15 smithi133 ceph-mon[22177]: pgmap v377: 97 pgs: 97 active+clean; 649 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 8 op/s 2024-08-31T04:23:16.486 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:16.483+0000 7fae8b200640 1 -- 172.21.15.50:0/2385242672 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fae84103750 msgr2=0x7fae84103b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:23:16.486 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:16.483+0000 7fae8b200640 1 --2- 172.21.15.50:0/2385242672 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fae84103750 0x7fae84103b60 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fae78009900 tx=0x7fae7802a3f0 comp rx=0 tx=0).stop 2024-08-31T04:23:16.487 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:16.484+0000 7fae8b200640 1 -- 172.21.15.50:0/2385242672 shutdown_connections 2024-08-31T04:23:16.487 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:16.484+0000 7fae8b200640 1 --2- 172.21.15.50:0/2385242672 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fae841099e0 0x7fae84110210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:16.487 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:16.484+0000 7fae8b200640 1 --2- 172.21.15.50:0/2385242672 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fae84109090 0x7fae841094a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:16.487 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:16.484+0000 7fae8b200640 1 --2- 172.21.15.50:0/2385242672 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fae84103750 0x7fae84103b60 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:16.487 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:16.484+0000 7fae8b200640 1 -- 172.21.15.50:0/2385242672 >> 172.21.15.50:0/2385242672 conn(0x7fae840ff1e0 msgr2=0x7fae84101630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:23:16.487 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:16.484+0000 7fae8b200640 1 -- 172.21.15.50:0/2385242672 shutdown_connections 2024-08-31T04:23:16.487 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:16.484+0000 7fae8b200640 1 -- 172.21.15.50:0/2385242672 wait complete. 2024-08-31T04:23:16.488 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:16.485+0000 7fae8b200640 1 Processor -- start 2024-08-31T04:23:16.488 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:16.485+0000 7fae8b200640 1 -- start start 2024-08-31T04:23:16.488 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:16.485+0000 7fae8b200640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fae84103750 0x7fae840754b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:16.488 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:16.485+0000 7fae8b200640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fae84109090 0x7fae840759f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:16.488 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:16.485+0000 7fae8b200640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fae841099e0 0x7fae84075f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:16.488 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:16.486+0000 7fae8b200640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fae84113700 con 0x7fae841099e0 2024-08-31T04:23:16.488 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:16.486+0000 7fae8b200640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7fae84113580 con 0x7fae84109090 2024-08-31T04:23:16.488 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:16.486+0000 7fae8b200640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fae84113880 con 0x7fae84103750 2024-08-31T04:23:16.489 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:16.486+0000 7fae8a800640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fae841099e0 0x7fae84075f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:16.489 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:16.486+0000 7fae89400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fae84109090 0x7fae840759f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:16.490 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:16.486+0000 7fae89e00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fae84103750 0x7fae840754b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:16.490 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:16.486+0000 7fae89400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fae84109090 0x7fae840759f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.50:47892/0 (socket says 172.21.15.50:47892) 2024-08-31T04:23:16.490 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:16.486+0000 7fae8a800640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fae841099e0 0x7fae84075f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:37654/0 (socket says 172.21.15.50:37654) 2024-08-31T04:23:16.490 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:16.486+0000 7fae89400640 1 -- 172.21.15.50:0/335587333 learned_addr learned my addr 172.21.15.50:0/335587333 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:23:16.490 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:16.486+0000 7fae89e00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fae84103750 0x7fae840754b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.50:51198/0 (socket says 172.21.15.50:51198) 2024-08-31T04:23:16.490 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:16.486+0000 7fae89400640 1 -- 172.21.15.50:0/335587333 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fae84103750 msgr2=0x7fae840754b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:23:16.490 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:16.486+0000 7fae89400640 1 --2- 172.21.15.50:0/335587333 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fae84103750 0x7fae840754b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:16.490 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:16.486+0000 7fae89400640 1 -- 172.21.15.50:0/335587333 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fae841099e0 msgr2=0x7fae84075f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:23:16.490 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:16.486+0000 7fae89400640 1 --2- 172.21.15.50:0/335587333 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fae841099e0 0x7fae84075f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:16.490 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:16.486+0000 7fae89400640 1 -- 172.21.15.50:0/335587333 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae841a8410 con 0x7fae84109090 2024-08-31T04:23:16.490 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:16.486+0000 7fae8a800640 1 --2- 172.21.15.50:0/335587333 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fae841099e0 0x7fae84075f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:23:16.490 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:16.487+0000 7fae89400640 1 --2- 172.21.15.50:0/335587333 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fae84109090 0x7fae840759f0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fae7400e970 tx=0x7fae7400ee30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:23:16.490 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:16.487+0000 7fae7ea00640 1 -- 172.21.15.50:0/335587333 <== mon.2 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae7400cd80 con 0x7fae84109090 2024-08-31T04:23:16.490 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:16.487+0000 7fae8b200640 1 -- 172.21.15.50:0/335587333 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fae841a8700 con 0x7fae84109090 2024-08-31T04:23:16.491 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:16.487+0000 7fae7ea00640 1 -- 172.21.15.50:0/335587333 <== mon.2 v2:172.21.15.133:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fae740035f0 con 0x7fae84109090 2024-08-31T04:23:16.491 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:16.487+0000 7fae7ea00640 1 -- 172.21.15.50:0/335587333 <== mon.2 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae74010690 con 0x7fae84109090 2024-08-31T04:23:16.491 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:16.487+0000 7fae8b200640 1 -- 172.21.15.50:0/335587333 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fae841a8c60 con 0x7fae84109090 2024-08-31T04:23:16.491 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:16.488+0000 7fae8b200640 1 -- 172.21.15.50:0/335587333 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fae84103b60 con 0x7fae84109090 2024-08-31T04:23:16.494 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:16.492+0000 7fae7ea00640 1 -- 172.21.15.50:0/335587333 <== mon.2 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 18) ==== 152577+0+0 (secure 0 0 0) 0x7fae74003aa0 con 0x7fae84109090 2024-08-31T04:23:16.496 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:16.493+0000 7fae7ea00640 1 --2- 172.21.15.50:0/335587333 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fae6c0b4b30 0x7fae6c0b7040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:16.496 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:16.494+0000 7fae7ea00640 1 -- 172.21.15.50:0/335587333 <== mon.2 v2:172.21.15.133:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8219+0+0 (secure 0 0 0) 0x7fae740e5520 con 0x7fae84109090 2024-08-31T04:23:16.496 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:16.494+0000 7fae89e00640 1 --2- 172.21.15.50:0/335587333 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fae6c0b4b30 0x7fae6c0b7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:16.496 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:16.494+0000 7fae7ea00640 1 -- 172.21.15.50:0/335587333 <== mon.2 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fae740ac600 con 0x7fae84109090 2024-08-31T04:23:16.497 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:16.494+0000 7fae89e00640 1 --2- 172.21.15.50:0/335587333 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fae6c0b4b30 0x7fae6c0b7040 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fae78005ab0 tx=0x7fae78005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:23:16.732 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:16.730+0000 7fae8b200640 1 -- 172.21.15.50:0/335587333 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fae840767b0 con 0x7fae84109090 2024-08-31T04:23:16.733 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:16.731+0000 7fae7ea00640 1 -- 172.21.15.50:0/335587333 <== mon.2 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+11983 (secure 0 0 0) 0x7fae740abf00 con 0x7fae84109090 2024-08-31T04:23:16.734 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-08-31T04:23:16.734 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":29,"btime":"2024-08-31T04:23:00:578141+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14622,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/1565557530","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":1565557530},{"type":"v1","addr":"172.21.15.50:6835","nonce":1565557530}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14634,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6837/2660185946","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6836","nonce":2660185946},{"type":"v1","addr":"172.21.15.50:6837","nonce":2660185946}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":29,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-31T04:20:44.140709+0000","modified":"2024-08-31T04:22:59.912983+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24695,"mds_1":24691,"mds_2":24667,"mds_3":24656,"mds_4":24652},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14676":{"gid":14676,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.50:6839/2105228685","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6838","nonce":2105228685},{"type":"v1","addr":"172.21.15.50:6839","nonce":2105228685}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24590":{"gid":24590,"name":"k","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.133:6833/4283603962","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6832","nonce":4283603962},{"type":"v1","addr":"172.21.15.133:6833","nonce":4283603962}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24601":{"gid":24601,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.177:6833/1237129793","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":1237129793},{"type":"v1","addr":"172.21.15.177:6833","nonce":1237129793}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24626":{"gid":24626,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.133:6835/3637799701","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":3637799701},{"type":"v1","addr":"172.21.15.133:6835","nonce":3637799701}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24640":{"gid":24640,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.177:6835/599392457","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6834","nonce":599392457},{"type":"v1","addr":"172.21.15.177:6835","nonce":599392457}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24652":{"gid":24652,"name":"c","rank":4,"incarnation":26,"state":"up:active","state_seq":13,"addr":"172.21.15.177:6837/2159859285","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6836","nonce":2159859285},{"type":"v1","addr":"172.21.15.177:6837","nonce":2159859285}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24656":{"gid":24656,"name":"h","rank":3,"incarnation":22,"state":"up:active","state_seq":12,"addr":"172.21.15.133:6837/4014853202","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6836","nonce":4014853202},{"type":"v1","addr":"172.21.15.133:6837","nonce":4014853202}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24667":{"gid":24667,"name":"i","rank":2,"incarnation":20,"state":"up:active","state_seq":10,"addr":"172.21.15.177:6839/3600081752","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6838","nonce":3600081752},{"type":"v1","addr":"172.21.15.177:6839","nonce":3600081752}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24691":{"gid":24691,"name":"a","rank":1,"incarnation":18,"state":"up:active","state_seq":8,"addr":"172.21.15.50:6841/575209862","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6840","nonce":575209862},{"type":"v1","addr":"172.21.15.50:6841","nonce":575209862}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24695":{"gid":24695,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.133:6839/2526402262","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6838","nonce":2526402262},{"type":"v1","addr":"172.21.15.133:6839","nonce":2526402262}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24695,"qdb_cluster":[24652,24691,24656,24695,24667]},"id":1}]} 2024-08-31T04:23:16.734 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 29 2024-08-31T04:23:16.736 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:16.734+0000 7fae8b200640 1 -- 172.21.15.50:0/335587333 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fae6c0b4b30 msgr2=0x7fae6c0b7040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:23:16.736 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:16.734+0000 7fae8b200640 1 --2- 172.21.15.50:0/335587333 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fae6c0b4b30 0x7fae6c0b7040 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fae78005ab0 tx=0x7fae78005a20 comp rx=0 tx=0).stop 2024-08-31T04:23:16.736 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:16.734+0000 7fae8b200640 1 -- 172.21.15.50:0/335587333 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fae84109090 msgr2=0x7fae840759f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:23:16.737 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:16.734+0000 7fae8b200640 1 --2- 172.21.15.50:0/335587333 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fae84109090 0x7fae840759f0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fae7400e970 tx=0x7fae7400ee30 comp rx=0 tx=0).stop 2024-08-31T04:23:16.737 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:16.734+0000 7fae8b200640 1 -- 172.21.15.50:0/335587333 shutdown_connections 2024-08-31T04:23:16.737 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:16.734+0000 7fae8b200640 1 --2- 172.21.15.50:0/335587333 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fae6c0b4b30 0x7fae6c0b7040 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:16.737 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:16.734+0000 7fae8b200640 1 --2- 172.21.15.50:0/335587333 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fae841099e0 0x7fae84075f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:16.737 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:16.734+0000 7fae8b200640 1 --2- 172.21.15.50:0/335587333 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fae84109090 0x7fae840759f0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:16.737 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:16.734+0000 7fae8b200640 1 --2- 172.21.15.50:0/335587333 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fae84103750 0x7fae840754b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:16.737 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:16.734+0000 7fae8b200640 1 -- 172.21.15.50:0/335587333 >> 172.21.15.50:0/335587333 conn(0x7fae840ff1e0 msgr2=0x7fae84101600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:23:16.737 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:16.734+0000 7fae8b200640 1 -- 172.21.15.50:0/335587333 shutdown_connections 2024-08-31T04:23:16.737 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:16.734+0000 7fae8b200640 1 -- 172.21.15.50:0/335587333 wait complete. 2024-08-31T04:23:17.437 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 29, 'flags': 306, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': True}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-08-31T04:20:44.140709+0000', 'modified': '2024-08-31T04:22:59.912983+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 5, 'in': [0, 1, 2, 3, 4], 'up': {'mds_0': 24695, 'mds_1': 24691, 'mds_2': 24667, 'mds_3': 24656, 'mds_4': 24652}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_14676': {'gid': 14676, 'name': 'g', 'rank': 4, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.50:6839/2105228685', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.50:6838', 'nonce': 2105228685}, {'type': 'v1', 'addr': '172.21.15.50:6839', 'nonce': 2105228685}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24590': {'gid': 24590, 'name': 'k', 'rank': 3, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.133:6833/4283603962', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.133:6832', 'nonce': 4283603962}, {'type': 'v1', 'addr': '172.21.15.133:6833', 'nonce': 4283603962}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24601': {'gid': 24601, 'name': 'l', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.177:6833/1237129793', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.177:6832', 'nonce': 1237129793}, {'type': 'v1', 'addr': '172.21.15.177:6833', 'nonce': 1237129793}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24626': {'gid': 24626, 'name': 'e', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.133:6835/3637799701', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.133:6834', 'nonce': 3637799701}, {'type': 'v1', 'addr': '172.21.15.133:6835', 'nonce': 3637799701}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24640': {'gid': 24640, 'name': 'f', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.177:6835/599392457', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.177:6834', 'nonce': 599392457}, {'type': 'v1', 'addr': '172.21.15.177:6835', 'nonce': 599392457}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24652': {'gid': 24652, 'name': 'c', 'rank': 4, 'incarnation': 26, 'state': 'up:active', 'state_seq': 13, 'addr': '172.21.15.177:6837/2159859285', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.177:6836', 'nonce': 2159859285}, {'type': 'v1', 'addr': '172.21.15.177:6837', 'nonce': 2159859285}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24656': {'gid': 24656, 'name': 'h', 'rank': 3, 'incarnation': 22, 'state': 'up:active', 'state_seq': 12, 'addr': '172.21.15.133:6837/4014853202', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.133:6836', 'nonce': 4014853202}, {'type': 'v1', 'addr': '172.21.15.133:6837', 'nonce': 4014853202}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24667': {'gid': 24667, 'name': 'i', 'rank': 2, 'incarnation': 20, 'state': 'up:active', 'state_seq': 10, 'addr': '172.21.15.177:6839/3600081752', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.177:6838', 'nonce': 3600081752}, {'type': 'v1', 'addr': '172.21.15.177:6839', 'nonce': 3600081752}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24691': {'gid': 24691, 'name': 'a', 'rank': 1, 'incarnation': 18, 'state': 'up:active', 'state_seq': 8, 'addr': '172.21.15.50:6841/575209862', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.50:6840', 'nonce': 575209862}, {'type': 'v1', 'addr': '172.21.15.50:6841', 'nonce': 575209862}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24695': {'gid': 24695, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 5, 'addr': '172.21.15.133:6839/2526402262', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.133:6838', 'nonce': 2526402262}, {'type': 'v1', 'addr': '172.21.15.133:6839', 'nonce': 2526402262}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24695, 'qdb_cluster': [24652, 24691, 24656, 24695, 24667]} 2024-08-31T04:23:17.437 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 5/5 2024-08-31T04:23:17.438 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 058d9fc6-674f-11ef-bcd4-c7b262605968 -- ceph tell mds.c status 2024-08-31T04:23:17.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:23:17 smithi050 ceph-mon[17259]: pgmap v378: 97 pgs: 97 active+clean; 649 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 938 B/s wr, 13 op/s 2024-08-31T04:23:17.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:23:17 smithi050 ceph-mon[17259]: from='client.? 172.21.15.50:0/335587333' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T04:23:17.856 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:23:17.996 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:23:17 smithi177 ceph-mon[22025]: pgmap v378: 97 pgs: 97 active+clean; 649 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 938 B/s wr, 13 op/s 2024-08-31T04:23:17.996 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:23:17 smithi177 ceph-mon[22025]: from='client.? 172.21.15.50:0/335587333' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T04:23:18.043 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:23:17 smithi133 ceph-mon[22177]: pgmap v378: 97 pgs: 97 active+clean; 649 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 938 B/s wr, 13 op/s 2024-08-31T04:23:18.043 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:23:17 smithi133 ceph-mon[22177]: from='client.? 172.21.15.50:0/335587333' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T04:23:18.497 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:18.494+0000 7fa19ee00640 1 -- 172.21.15.50:0/401071834 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa198102ad0 msgr2=0x7fa19810f7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:23:18.497 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:18.494+0000 7fa19ee00640 1 --2- 172.21.15.50:0/401071834 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa198102ad0 0x7fa19810f7f0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fa184009900 tx=0x7fa18402a480 comp rx=0 tx=0).stop 2024-08-31T04:23:18.497 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:18.495+0000 7fa19ee00640 1 -- 172.21.15.50:0/401071834 shutdown_connections 2024-08-31T04:23:18.498 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:18.495+0000 7fa19ee00640 1 --2- 172.21.15.50:0/401071834 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa19810fd30 0x7fa198112150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:18.498 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:18.495+0000 7fa19ee00640 1 --2- 172.21.15.50:0/401071834 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa198102ad0 0x7fa19810f7f0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:18.498 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:18.495+0000 7fa19ee00640 1 --2- 172.21.15.50:0/401071834 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa198102180 0x7fa198102590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:18.498 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:18.495+0000 7fa19ee00640 1 -- 172.21.15.50:0/401071834 >> 172.21.15.50:0/401071834 conn(0x7fa1980fe060 msgr2=0x7fa1981004b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:23:18.498 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:18.495+0000 7fa19ee00640 1 -- 172.21.15.50:0/401071834 shutdown_connections 2024-08-31T04:23:18.498 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:18.495+0000 7fa19ee00640 1 -- 172.21.15.50:0/401071834 wait complete. 2024-08-31T04:23:18.498 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:18.496+0000 7fa19ee00640 1 Processor -- start 2024-08-31T04:23:18.499 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:18.496+0000 7fa19ee00640 1 -- start start 2024-08-31T04:23:18.499 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:18.496+0000 7fa19ee00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa198102180 0x7fa19819c240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:18.499 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:18.496+0000 7fa19ee00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa198102ad0 0x7fa19819c7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:18.499 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:18.496+0000 7fa19ee00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa19810fd30 0x7fa1981a1a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:18.499 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:18.496+0000 7fa19ee00640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fa198115850 con 0x7fa19810fd30 2024-08-31T04:23:18.499 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:18.496+0000 7fa19ee00640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7fa1981156d0 con 0x7fa198102ad0 2024-08-31T04:23:18.499 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:18.496+0000 7fa19ee00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fa1981159d0 con 0x7fa198102180 2024-08-31T04:23:18.500 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:18.497+0000 7fa19e400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa19810fd30 0x7fa1981a1a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:18.500 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:18.497+0000 7fa19da00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa198102180 0x7fa19819c240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:18.500 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:18.497+0000 7fa19da00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa198102180 0x7fa19819c240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.50:51230/0 (socket says 172.21.15.50:51230) 2024-08-31T04:23:18.500 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:18.497+0000 7fa19da00640 1 -- 172.21.15.50:0/3382063996 learned_addr learned my addr 172.21.15.50:0/3382063996 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:23:18.500 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:18.497+0000 7fa19d000640 1 --2- 172.21.15.50:0/3382063996 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa198102ad0 0x7fa19819c7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:18.500 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:18.497+0000 7fa19da00640 1 -- 172.21.15.50:0/3382063996 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa198102ad0 msgr2=0x7fa19819c7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:23:18.500 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:18.497+0000 7fa19da00640 1 --2- 172.21.15.50:0/3382063996 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa198102ad0 0x7fa19819c7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:18.500 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:18.497+0000 7fa19da00640 1 -- 172.21.15.50:0/3382063996 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa19810fd30 msgr2=0x7fa1981a1a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:23:18.500 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:18.497+0000 7fa19da00640 1 --2- 172.21.15.50:0/3382063996 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa19810fd30 0x7fa1981a1a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:18.500 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:18.497+0000 7fa19da00640 1 -- 172.21.15.50:0/3382063996 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1981a21b0 con 0x7fa198102180 2024-08-31T04:23:18.500 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:18.497+0000 7fa19e400640 1 --2- 172.21.15.50:0/3382063996 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa19810fd30 0x7fa1981a1a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:23:18.501 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:18.498+0000 7fa19da00640 1 --2- 172.21.15.50:0/3382063996 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa198102180 0x7fa19819c240 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fa18c00e9f0 tx=0x7fa18c00edf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:23:18.501 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:18.498+0000 7fa196000640 1 -- 172.21.15.50:0/3382063996 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa18c00cd80 con 0x7fa198102180 2024-08-31T04:23:18.501 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:18.498+0000 7fa196000640 1 -- 172.21.15.50:0/3382063996 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa18c0054d0 con 0x7fa198102180 2024-08-31T04:23:18.501 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:18.498+0000 7fa19ee00640 1 -- 172.21.15.50:0/3382063996 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa1981a24a0 con 0x7fa198102180 2024-08-31T04:23:18.501 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:18.498+0000 7fa196000640 1 -- 172.21.15.50:0/3382063996 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa18c010690 con 0x7fa198102180 2024-08-31T04:23:18.501 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:18.498+0000 7fa19ee00640 1 -- 172.21.15.50:0/3382063996 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa1981a8c00 con 0x7fa198102180 2024-08-31T04:23:18.503 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:18.501+0000 7fa1a71ca740 1 Processor -- start 2024-08-31T04:23:18.503 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:18.501+0000 7fa1a71ca740 1 -- start start 2024-08-31T04:23:18.504 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:18.502+0000 7fa1a71ca740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5575cbcbbf60 0x5575cc061aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:18.504 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:18.502+0000 7fa1a71ca740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5575cbc930a0 0x5575cc061fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:18.504 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:18.502+0000 7fa1a71ca740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5575cbc9b280 0x5575cc062520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:18.504 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:18.502+0000 7fa1a71ca740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x5575cbfd8550 con 0x5575cbcbbf60 2024-08-31T04:23:18.504 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:18.502+0000 7fa1a71ca740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x5575cbfc7ae0 con 0x5575cbc9b280 2024-08-31T04:23:18.504 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:18.502+0000 7fa1a71ca740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x5575cbfcba90 con 0x5575cbc930a0 2024-08-31T04:23:18.504 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:18.502+0000 7fa19e400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5575cbcbbf60 0x5575cc061aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:18.504 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:18.502+0000 7fa19e400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5575cbcbbf60 0x5575cc061aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:37688/0 (socket says 172.21.15.50:37688) 2024-08-31T04:23:18.504 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:18.502+0000 7fa19e400640 1 -- 172.21.15.50:0/2270549711 learned_addr learned my addr 172.21.15.50:0/2270549711 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:23:18.505 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:18.502+0000 7fa19d000640 1 --2- 172.21.15.50:0/2270549711 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5575cbc9b280 0x5575cc062520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:18.505 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:18.502+0000 7fa19e400640 1 -- 172.21.15.50:0/2270549711 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5575cbc930a0 msgr2=0x5575cc061fe0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-31T04:23:18.505 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:18.502+0000 7fa19e400640 1 --2- 172.21.15.50:0/2270549711 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5575cbc930a0 0x5575cc061fe0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:18.506 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:18.502+0000 7fa19e400640 1 -- 172.21.15.50:0/2270549711 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5575cbc9b280 msgr2=0x5575cc062520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:23:18.506 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:18.502+0000 7fa19e400640 1 --2- 172.21.15.50:0/2270549711 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5575cbc9b280 0x5575cc062520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:18.506 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:18.502+0000 7fa196000640 1 -- 172.21.15.50:0/3382063996 <== mon.1 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 18) ==== 152577+0+0 (secure 0 0 0) 0x7fa18c004e90 con 0x7fa198102180 2024-08-31T04:23:18.506 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:18.502+0000 7fa19e400640 1 -- 172.21.15.50:0/2270549711 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5575cbd27540 con 0x5575cbcbbf60 2024-08-31T04:23:18.506 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:18.503+0000 7fa19e400640 1 --2- 172.21.15.50:0/2270549711 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5575cbcbbf60 0x5575cc061aa0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fa1900117e0 tx=0x7fa190011ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf032e24f78baa87 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:23:18.506 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:18.503+0000 7fa18aa00640 1 -- 172.21.15.50:0/2270549711 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa190011310 con 0x5575cbcbbf60 2024-08-31T04:23:18.506 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:18.503+0000 7fa18aa00640 1 -- 172.21.15.50:0/2270549711 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa190003e20 con 0x5575cbcbbf60 2024-08-31T04:23:18.506 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:18.503+0000 7fa18aa00640 1 -- 172.21.15.50:0/2270549711 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1900044f0 con 0x5575cbcbbf60 2024-08-31T04:23:18.507 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:18.504+0000 7fa1a71ca740 1 -- 172.21.15.50:0/2270549711 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5575cbcbbf60 msgr2=0x5575cc061aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:23:18.507 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:18.504+0000 7fa1a71ca740 1 --2- 172.21.15.50:0/2270549711 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5575cbcbbf60 0x5575cc061aa0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fa1900117e0 tx=0x7fa190011ca0 comp rx=0 tx=0).stop 2024-08-31T04:23:18.507 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:18.504+0000 7fa196000640 1 --2- 172.21.15.50:0/3382063996 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fa1800b4b30 0x7fa1800b7040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:18.507 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:18.504+0000 7fa1a71ca740 1 -- 172.21.15.50:0/2270549711 shutdown_connections 2024-08-31T04:23:18.507 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:18.504+0000 7fa1a71ca740 1 --2- 172.21.15.50:0/2270549711 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5575cbc930a0 0x5575cc061fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:18.507 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:18.504+0000 7fa1a71ca740 1 --2- 172.21.15.50:0/2270549711 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5575cbc9b280 0x5575cc062520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:18.507 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:18.504+0000 7fa1a71ca740 1 --2- 172.21.15.50:0/2270549711 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5575cbcbbf60 0x5575cc061aa0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:18.507 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:18.504+0000 7fa1a71ca740 1 -- 172.21.15.50:0/2270549711 >> 172.21.15.50:0/2270549711 conn(0x5575cbcb0350 msgr2=0x5575cc05f990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:23:18.507 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:18.504+0000 7fa196000640 1 -- 172.21.15.50:0/3382063996 <== mon.1 v2:172.21.15.177:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8219+0+0 (secure 0 0 0) 0x7fa18c0e55d0 con 0x7fa198102180 2024-08-31T04:23:18.507 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:18.504+0000 7fa19da00640 1 --2- 172.21.15.50:0/3382063996 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fa1800b4b30 0x7fa1800b7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:18.507 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:18.504+0000 7fa1a71ca740 1 -- 172.21.15.50:0/2270549711 shutdown_connections 2024-08-31T04:23:18.507 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:18.505+0000 7fa1a71ca740 1 -- 172.21.15.50:0/2270549711 wait complete. 2024-08-31T04:23:18.508 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:18.505+0000 7fa19da00640 1 --2- 172.21.15.50:0/3382063996 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fa1800b4b30 0x7fa1800b7040 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fa18c0a9220 tx=0x7fa18c009310 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:23:18.508 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:18.505+0000 7fa1a71ca740 1 -- start start 2024-08-31T04:23:18.508 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:18.505+0000 7fa1a71ca740 1 Processor -- start 2024-08-31T04:23:18.508 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:18.506+0000 7fa1a71ca740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5575cbc930a0 0x5575cc06d210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:18.508 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:18.506+0000 7fa1a71ca740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5575cbc9b280 0x5575cc06d750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:18.509 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:18.506+0000 7fa1a71ca740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5575cbcbbf60 0x5575cc079570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:18.509 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:18.506+0000 7fa1a71ca740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x5575cbe2a5f0 con 0x5575cbcbbf60 2024-08-31T04:23:18.509 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:18.506+0000 7fa1a71ca740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x5575cbf4ebd0 con 0x5575cbc930a0 2024-08-31T04:23:18.509 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:18.506+0000 7fa1a71ca740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x5575cc070280 con 0x5575cbc9b280 2024-08-31T04:23:18.509 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:18.506+0000 7fa1a71ca740 10 client.0 _ll_register_callbacks cb 0x5575cbf74210 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:23:18.510 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:18.506+0000 7fa19e400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5575cbcbbf60 0x5575cc079570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:18.510 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:18.506+0000 7fa19d000640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5575cbc9b280 0x5575cc06d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:18.510 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:18.506+0000 7fa19e400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5575cbc930a0 0x5575cc06d210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:18.510 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:18.507+0000 7fa19d000640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5575cbc9b280 0x5575cc06d750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.50:51238/0 (socket says 172.21.15.50:51238) 2024-08-31T04:23:18.510 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:18.507+0000 7fa19e400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5575cbc930a0 0x5575cc06d210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.50:47930/0 (socket says 172.21.15.50:47930) 2024-08-31T04:23:18.510 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:18.507+0000 7fa19d000640 1 -- 172.21.15.50:0/3020140792 learned_addr learned my addr 172.21.15.50:0/3020140792 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:23:18.510 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:18.507+0000 7fa19d000640 1 -- 172.21.15.50:0/3020140792 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5575cbc930a0 msgr2=0x5575cc06d210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:23:18.510 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:18.507+0000 7fa19d000640 1 --2- 172.21.15.50:0/3020140792 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5575cbc930a0 0x5575cc06d210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:18.510 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:18.507+0000 7fa19d000640 1 -- 172.21.15.50:0/3020140792 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5575cbcbbf60 msgr2=0x5575cc079570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:23:18.510 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:18.507+0000 7fa19d000640 1 --2- 172.21.15.50:0/3020140792 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5575cbcbbf60 0x5575cc079570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:18.510 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:18.507+0000 7fa19d000640 1 -- 172.21.15.50:0/3020140792 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5575cbf8f650 con 0x5575cbc9b280 2024-08-31T04:23:18.510 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:18.507+0000 7fa19e400640 1 --2- 172.21.15.50:0/3020140792 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5575cbc930a0 0x5575cc06d210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:23:18.511 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:18.507+0000 7fa19d000640 1 --2- 172.21.15.50:0/3020140792 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5575cbc9b280 0x5575cc06d750 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fa184000c00 tx=0x7fa1840043b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ba3ae3cff79c1657 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:23:18.511 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:18.507+0000 7fa17f400640 10 client.0 ms_handle_connect on v2:172.21.15.177:3300/0 2024-08-31T04:23:18.511 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:18.508+0000 7fa17f400640 1 -- 172.21.15.50:0/3020140792 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa184035040 con 0x5575cbc9b280 2024-08-31T04:23:18.511 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:18.508+0000 7fa1a71ca740 1 -- 172.21.15.50:0/3020140792 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa190003e20 con 0x5575cbc9b280 2024-08-31T04:23:18.511 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:18.508+0000 7fa17f400640 1 -- 172.21.15.50:0/3020140792 <== mon.1 v2:172.21.15.177:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8219+0+0 (secure 0 0 0) 0x7fa184005450 con 0x5575cbc9b280 2024-08-31T04:23:18.512 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:18.508+0000 7fa17f400640 1 -- 172.21.15.50:0/3020140792 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fa184005650 con 0x5575cbc9b280 2024-08-31T04:23:18.512 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:18.508+0000 7fa1a71ca740 10 client.25363 fetch_fsmap learned FSMap version 29 2024-08-31T04:23:18.512 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:18.508+0000 7fa1a71ca740 1 -- 172.21.15.50:0/3020140792 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5575cc07c050 con 0x5575cbc9b280 2024-08-31T04:23:18.512 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:18.508+0000 7fa17f400640 1 -- 172.21.15.50:0/3020140792 <== mon.1 v2:172.21.15.177:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa190003e20 con 0x5575cbc9b280 2024-08-31T04:23:18.512 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:18.509+0000 7fa17f400640 1 -- 172.21.15.50:0/3020140792 <== mon.1 v2:172.21.15.177:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7fa184003a70 con 0x5575cbc9b280 2024-08-31T04:23:18.512 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:18.509+0000 7fa1a71ca740 10 client.25363 fetch_fsmap finished waiting for FSMap version 29 2024-08-31T04:23:18.512 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:18.509+0000 7fa1a71ca740 10 client.25363 resolve_mds: resolved name 'c' to daemon mds.c 2024-08-31T04:23:18.512 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:18.509+0000 7fa1a71ca740 20 client.25363 populate_metadata read hostname 'smithi050' 2024-08-31T04:23:18.512 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:18.509+0000 7fa1a71ca740 1 --2- 172.21.15.50:0/3020140792 >> [v2:172.21.15.177:6836/2159859285,v1:172.21.15.177:6837/2159859285] conn(0x5575cbc7a8e0 0x5575cc07fac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:18.512 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:18.509+0000 7fa1a71ca740 4 client.25363 mds_command: new command op to 24652 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T04:23:18.512 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:18.509+0000 7fa1a71ca740 1 -- 172.21.15.50:0/3020140792 --> [v2:172.21.15.177:6836/2159859285,v1:172.21.15.177:6837/2159859285] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5575cbfda4a0 con 0x5575cbc7a8e0 2024-08-31T04:23:18.512 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:18.509+0000 7fa19e400640 1 --2- 172.21.15.50:0/3020140792 >> [v2:172.21.15.177:6836/2159859285,v1:172.21.15.177:6837/2159859285] conn(0x5575cbc7a8e0 0x5575cc07fac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:18.514 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:18.510+0000 7fa19e400640 1 --2- 172.21.15.50:0/3020140792 >> [v2:172.21.15.177:6836/2159859285,v1:172.21.15.177:6837/2159859285] conn(0x5575cbc7a8e0 0x5575cc07fac0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=de4c1beb344d0916 server_cookie=d2285784647581dc in_seq=0 out_seq=0 2024-08-31T04:23:18.514 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:18.510+0000 7fa17f400640 10 client.25363 ms_handle_connect on v2:172.21.15.177:6836/2159859285 2024-08-31T04:23:18.514 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:18.512+0000 7fa17f400640 1 -- 172.21.15.50:0/3020140792 <== mds.4 v2:172.21.15.177:6836/2159859285 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5575cbfda4a0 con 0x5575cbc7a8e0 2024-08-31T04:23:18.514 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:18.512+0000 7fa17f400640 10 client.25363 handle_command_reply: tid=0 2024-08-31T04:23:18.514 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:18.512+0000 7fa1a71ca740 1 client.25363 shutdown 2024-08-31T04:23:18.514 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:18.512+0000 7fa1a71ca740 1 -- 172.21.15.50:0/3020140792 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5575cbc9b280 msgr2=0x5575cc06d750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:23:18.514 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:18.512+0000 7fa1a71ca740 1 --2- 172.21.15.50:0/3020140792 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5575cbc9b280 0x5575cc06d750 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fa184000c00 tx=0x7fa1840043b0 comp rx=0 tx=0).stop 2024-08-31T04:23:18.514 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:18.512+0000 7fa1a71ca740 1 -- 172.21.15.50:0/3020140792 shutdown_connections 2024-08-31T04:23:18.514 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:18.512+0000 7fa1a71ca740 1 --2- 172.21.15.50:0/3020140792 >> [v2:172.21.15.177:6836/2159859285,v1:172.21.15.177:6837/2159859285] conn(0x5575cbc7a8e0 0x5575cc07fac0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:18.514 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:18.512+0000 7fa1a71ca740 1 --2- 172.21.15.50:0/3020140792 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5575cbc9b280 0x5575cc06d750 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:18.514 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:18.512+0000 7fa1a71ca740 1 --2- 172.21.15.50:0/3020140792 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5575cbcbbf60 0x5575cc079570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:18.514 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:18.512+0000 7fa1a71ca740 1 --2- 172.21.15.50:0/3020140792 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5575cbc930a0 0x5575cc06d210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:18.514 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:18.512+0000 7fa17f400640 0 client.25363 ms_handle_reset on v2:172.21.15.177:6836/2159859285 2024-08-31T04:23:18.514 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:18.512+0000 7fa1a71ca740 1 -- 172.21.15.50:0/3020140792 >> 172.21.15.50:0/3020140792 conn(0x5575cbcb0350 msgr2=0x5575cc064c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:23:18.515 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:18.512+0000 7fa1a71ca740 1 -- 172.21.15.50:0/3020140792 shutdown_connections 2024-08-31T04:23:18.515 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:18.512+0000 7fa1a71ca740 1 -- 172.21.15.50:0/3020140792 wait complete. 2024-08-31T04:23:18.515 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:18.512+0000 7fa1a71ca740 20 client.25363 trim_cache size 0 max 16384 2024-08-31T04:23:18.533 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:18.531+0000 7fa1a71ca740 1 Processor -- start 2024-08-31T04:23:18.533 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:18.531+0000 7fa1a71ca740 1 -- start start 2024-08-31T04:23:18.534 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:18.531+0000 7fa1a71ca740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5575cbc930a0 0x5575cc05a710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:18.534 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:18.531+0000 7fa1a71ca740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5575cbc9b280 0x5575cc0794e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:18.534 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:18.531+0000 7fa1a71ca740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5575cbcbbf60 0x5575cc05f2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:18.534 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:18.531+0000 7fa1a71ca740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x5575cc07de00 con 0x5575cbc930a0 2024-08-31T04:23:18.534 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:18.531+0000 7fa1a71ca740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x5575cc07e4d0 con 0x5575cbc9b280 2024-08-31T04:23:18.534 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:18.531+0000 7fa1a71ca740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x5575cc07eba0 con 0x5575cbcbbf60 2024-08-31T04:23:18.534 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:18.532+0000 7fa19e400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5575cbc930a0 0x5575cc05a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:18.534 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:18.532+0000 7fa19d000640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5575cbc9b280 0x5575cc0794e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:18.534 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:18.532+0000 7fa19e400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5575cbc930a0 0x5575cc05a710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:37708/0 (socket says 172.21.15.50:37708) 2024-08-31T04:23:18.534 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:18.532+0000 7fa19e400640 1 -- 172.21.15.50:0/4132371814 learned_addr learned my addr 172.21.15.50:0/4132371814 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:23:18.534 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:18.532+0000 7fa19e400640 1 --2- 172.21.15.50:0/4132371814 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5575cbcbbf60 0x5575cc05f2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:18.535 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:18.532+0000 7fa19d000640 1 -- 172.21.15.50:0/4132371814 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5575cbcbbf60 msgr2=0x5575cc05f2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:23:18.535 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:18.532+0000 7fa19d000640 1 --2- 172.21.15.50:0/4132371814 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5575cbcbbf60 0x5575cc05f2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:18.535 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:18.532+0000 7fa19d000640 1 -- 172.21.15.50:0/4132371814 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5575cbc930a0 msgr2=0x5575cc05a710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:23:18.535 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:18.532+0000 7fa19d000640 1 --2- 172.21.15.50:0/4132371814 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5575cbc930a0 0x5575cc05a710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:18.535 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:18.532+0000 7fa19d000640 1 -- 172.21.15.50:0/4132371814 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5575cc06dda0 con 0x5575cbc9b280 2024-08-31T04:23:18.536 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:18.532+0000 7fa19d000640 1 --2- 172.21.15.50:0/4132371814 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5575cbc9b280 0x5575cc0794e0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fa184003e40 tx=0x7fa184005fd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1d2738497f24414d server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:23:18.536 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:18.533+0000 7fa18a000640 1 -- 172.21.15.50:0/4132371814 <== mon.2 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa184035070 con 0x5575cbc9b280 2024-08-31T04:23:18.536 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:18.533+0000 7fa18a000640 1 -- 172.21.15.50:0/4132371814 <== mon.2 v2:172.21.15.133:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa184041070 con 0x5575cbc9b280 2024-08-31T04:23:18.536 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:18.533+0000 7fa18a000640 1 -- 172.21.15.50:0/4132371814 <== mon.2 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa184003af0 con 0x5575cbc9b280 2024-08-31T04:23:18.537 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:18.534+0000 7fa1a71ca740 1 -- 172.21.15.50:0/4132371814 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5575cbc9b280 msgr2=0x5575cc0794e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:23:18.537 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:18.534+0000 7fa1a71ca740 1 --2- 172.21.15.50:0/4132371814 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5575cbc9b280 0x5575cc0794e0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fa184003e40 tx=0x7fa184005fd0 comp rx=0 tx=0).stop 2024-08-31T04:23:18.537 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:18.534+0000 7fa1a71ca740 1 -- 172.21.15.50:0/4132371814 shutdown_connections 2024-08-31T04:23:18.537 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:18.534+0000 7fa1a71ca740 1 --2- 172.21.15.50:0/4132371814 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5575cbcbbf60 0x5575cc05f2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:18.537 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:18.534+0000 7fa1a71ca740 1 --2- 172.21.15.50:0/4132371814 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5575cbc9b280 0x5575cc0794e0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:18.537 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:18.534+0000 7fa1a71ca740 1 --2- 172.21.15.50:0/4132371814 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5575cbc930a0 0x5575cc05a710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:18.537 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:18.534+0000 7fa1a71ca740 1 -- 172.21.15.50:0/4132371814 >> 172.21.15.50:0/4132371814 conn(0x5575cbcb0350 msgr2=0x5575cc06ba90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:23:18.537 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:18.534+0000 7fa1a71ca740 1 -- 172.21.15.50:0/4132371814 shutdown_connections 2024-08-31T04:23:18.537 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:18.534+0000 7fa1a71ca740 1 -- 172.21.15.50:0/4132371814 wait complete. 2024-08-31T04:23:18.537 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:18.534+0000 7fa1a71ca740 1 -- start start 2024-08-31T04:23:18.537 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:18.535+0000 7fa1a71ca740 1 Processor -- start 2024-08-31T04:23:18.538 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:18.535+0000 7fa1a71ca740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5575cbc930a0 0x5575cc088390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:18.538 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:18.535+0000 7fa1a71ca740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5575cbc9b280 0x5575cc081840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:18.538 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:18.535+0000 7fa1a71ca740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5575cbcbbf60 0x5575cc081d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:18.538 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:18.535+0000 7fa1a71ca740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x5575cc07f940 con 0x5575cbcbbf60 2024-08-31T04:23:18.538 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:18.535+0000 7fa1a71ca740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x5575cc07f270 con 0x5575cbc930a0 2024-08-31T04:23:18.539 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:18.535+0000 7fa1a71ca740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x5575cc080010 con 0x5575cbc9b280 2024-08-31T04:23:18.539 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:18.535+0000 7fa1a71ca740 10 client.0 _ll_register_callbacks cb 0x7fa184004040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:23:18.539 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:18.535+0000 7fa19e400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5575cbc930a0 0x5575cc088390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:18.539 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:18.536+0000 7fa19e400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5575cbcbbf60 0x5575cc081d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:18.539 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:18.536+0000 7fa19d000640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5575cbc9b280 0x5575cc081840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:18.539 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:18.536+0000 7fa19d000640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5575cbc9b280 0x5575cc081840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.50:51262/0 (socket says 172.21.15.50:51262) 2024-08-31T04:23:18.539 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:18.536+0000 7fa19e400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5575cbc930a0 0x5575cc088390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.50:47954/0 (socket says 172.21.15.50:47954) 2024-08-31T04:23:18.539 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:18.536+0000 7fa19d000640 1 -- 172.21.15.50:0/1889528038 learned_addr learned my addr 172.21.15.50:0/1889528038 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:23:18.539 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:18.536+0000 7fa19d000640 1 -- 172.21.15.50:0/1889528038 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5575cbc930a0 msgr2=0x5575cc088390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:23:18.539 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:18.536+0000 7fa19d000640 1 --2- 172.21.15.50:0/1889528038 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5575cbc930a0 0x5575cc088390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:18.539 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:18.536+0000 7fa19d000640 1 -- 172.21.15.50:0/1889528038 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5575cbcbbf60 msgr2=0x5575cc081d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:23:18.539 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:18.536+0000 7fa19d000640 1 --2- 172.21.15.50:0/1889528038 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5575cbcbbf60 0x5575cc081d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:18.539 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:18.536+0000 7fa19d000640 1 -- 172.21.15.50:0/1889528038 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5575cc082370 con 0x5575cbc9b280 2024-08-31T04:23:18.541 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:18.536+0000 7fa19d000640 1 --2- 172.21.15.50:0/1889528038 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5575cbc9b280 0x5575cc081840 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fa184005f70 tx=0x7fa184005a20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5cb121c86f7ec322 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:23:18.541 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:18.536+0000 7fa17f400640 10 client.0 ms_handle_connect on v2:172.21.15.177:3300/0 2024-08-31T04:23:18.541 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:18.537+0000 7fa17f400640 1 -- 172.21.15.50:0/1889528038 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa184035030 con 0x5575cbc9b280 2024-08-31T04:23:18.541 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:18.537+0000 7fa17f400640 1 -- 172.21.15.50:0/1889528038 <== mon.1 v2:172.21.15.177:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8219+0+0 (secure 0 0 0) 0x7fa184003870 con 0x5575cbc9b280 2024-08-31T04:23:18.541 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:18.537+0000 7fa1a71ca740 1 -- 172.21.15.50:0/1889528038 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa184041070 con 0x5575cbc9b280 2024-08-31T04:23:18.541 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:18.537+0000 7fa17f400640 1 -- 172.21.15.50:0/1889528038 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fa18406b050 con 0x5575cbc9b280 2024-08-31T04:23:18.541 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:18.537+0000 7fa1a71ca740 10 client.25369 fetch_fsmap learned FSMap version 29 2024-08-31T04:23:18.541 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:18.537+0000 7fa1a71ca740 1 -- 172.21.15.50:0/1889528038 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5575cc087da0 con 0x5575cbc9b280 2024-08-31T04:23:18.541 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:18.537+0000 7fa17f400640 1 -- 172.21.15.50:0/1889528038 <== mon.1 v2:172.21.15.177:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa184041070 con 0x5575cbc9b280 2024-08-31T04:23:18.541 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:18.538+0000 7fa17f400640 1 -- 172.21.15.50:0/1889528038 <== mon.1 v2:172.21.15.177:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7fa184004750 con 0x5575cbc9b280 2024-08-31T04:23:18.541 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:18.538+0000 7fa1a71ca740 10 client.25369 fetch_fsmap finished waiting for FSMap version 29 2024-08-31T04:23:18.541 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:18.538+0000 7fa1a71ca740 10 client.25369 resolve_mds: resolved name 'c' to daemon mds.c 2024-08-31T04:23:18.542 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:18.538+0000 7fa1a71ca740 20 client.25369 populate_metadata read hostname 'smithi050' 2024-08-31T04:23:18.542 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:18.538+0000 7fa1a71ca740 1 --2- 172.21.15.50:0/1889528038 >> [v2:172.21.15.177:6836/2159859285,v1:172.21.15.177:6837/2159859285] conn(0x5575cbc4fc90 0x5575cc0ee3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:18.542 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:18.538+0000 7fa1a71ca740 4 client.25369 mds_command: new command op to 24652 tid=0 multi_id=0 [{"prefix": "status"}] 2024-08-31T04:23:18.542 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:18.538+0000 7fa1a71ca740 1 -- 172.21.15.50:0/1889528038 --> [v2:172.21.15.177:6836/2159859285,v1:172.21.15.177:6837/2159859285] -- command(tid 0: {"prefix": "status"}) -- 0x5575cbfd5f40 con 0x5575cbc4fc90 2024-08-31T04:23:18.542 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:18.538+0000 7fa19e400640 1 --2- 172.21.15.50:0/1889528038 >> [v2:172.21.15.177:6836/2159859285,v1:172.21.15.177:6837/2159859285] conn(0x5575cbc4fc90 0x5575cc0ee3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:18.542 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:18.539+0000 7fa19e400640 1 --2- 172.21.15.50:0/1889528038 >> [v2:172.21.15.177:6836/2159859285,v1:172.21.15.177:6837/2159859285] conn(0x5575cbc4fc90 0x5575cc0ee3e0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=2cb4e6c17e606997 server_cookie=8118e8a910440bd1 in_seq=0 out_seq=0 2024-08-31T04:23:18.542 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:18.539+0000 7fa17f400640 10 client.25369 ms_handle_connect on v2:172.21.15.177:6836/2159859285 2024-08-31T04:23:18.543 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:18.539+0000 7fa17f400640 1 -- 172.21.15.50:0/1889528038 <== mds.4 v2:172.21.15.177:6836/2159859285 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x5575cbfd5f40 con 0x5575cbc4fc90 2024-08-31T04:23:18.543 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:18.539+0000 7fa17f400640 10 client.25369 handle_command_reply: tid=0 2024-08-31T04:23:18.543 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:18.539+0000 7fa1a71ca740 1 client.25369 shutdown 2024-08-31T04:23:18.543 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:18.539+0000 7fa1a71ca740 1 -- 172.21.15.50:0/1889528038 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5575cbc9b280 msgr2=0x5575cc081840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:23:18.543 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:18.539+0000 7fa1a71ca740 1 --2- 172.21.15.50:0/1889528038 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5575cbc9b280 0x5575cc081840 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fa184005f70 tx=0x7fa184005a20 comp rx=0 tx=0).stop 2024-08-31T04:23:18.543 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:18.539+0000 7fa1a71ca740 1 -- 172.21.15.50:0/1889528038 shutdown_connections 2024-08-31T04:23:18.543 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:18.539+0000 7fa1a71ca740 1 --2- 172.21.15.50:0/1889528038 >> [v2:172.21.15.177:6836/2159859285,v1:172.21.15.177:6837/2159859285] conn(0x5575cbc4fc90 0x5575cc0ee3e0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:18.543 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:18.539+0000 7fa1a71ca740 1 --2- 172.21.15.50:0/1889528038 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5575cbc9b280 0x5575cc081840 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:18.543 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:18.539+0000 7fa1a71ca740 1 --2- 172.21.15.50:0/1889528038 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5575cbcbbf60 0x5575cc081d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:18.543 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:18.539+0000 7fa17f400640 0 client.25369 ms_handle_reset on v2:172.21.15.177:6836/2159859285 2024-08-31T04:23:18.543 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:18.539+0000 7fa1a71ca740 1 --2- 172.21.15.50:0/1889528038 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5575cbc930a0 0x5575cc088390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:18.544 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:18.539+0000 7fa1a71ca740 1 -- 172.21.15.50:0/1889528038 >> 172.21.15.50:0/1889528038 conn(0x5575cbcb0350 msgr2=0x5575cc06cfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:23:18.544 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:18.539+0000 7fa1a71ca740 1 -- 172.21.15.50:0/1889528038 shutdown_connections 2024-08-31T04:23:18.544 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:18.540+0000 7fa1a71ca740 1 -- 172.21.15.50:0/1889528038 wait complete. 2024-08-31T04:23:18.544 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:18.540+0000 7fa1a71ca740 20 client.25369 trim_cache size 0 max 16384 2024-08-31T04:23:18.544 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-08-31T04:23:18.544 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_fsid": "058d9fc6-674f-11ef-bcd4-c7b262605968", 2024-08-31T04:23:18.544 INFO:teuthology.orchestra.run.smithi050.stdout: "whoami": 4, 2024-08-31T04:23:18.544 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 24652, 2024-08-31T04:23:18.544 INFO:teuthology.orchestra.run.smithi050.stdout: "want_state": "up:active", 2024-08-31T04:23:18.544 INFO:teuthology.orchestra.run.smithi050.stdout: "state": "up:active", 2024-08-31T04:23:18.544 INFO:teuthology.orchestra.run.smithi050.stdout: "fs_name": "cephfs", 2024-08-31T04:23:18.545 INFO:teuthology.orchestra.run.smithi050.stdout: "rank_uptime": 137.50269133500001, 2024-08-31T04:23:18.545 INFO:teuthology.orchestra.run.smithi050.stdout: "mdsmap_epoch": 29, 2024-08-31T04:23:18.545 INFO:teuthology.orchestra.run.smithi050.stdout: "osdmap_epoch": 78, 2024-08-31T04:23:18.545 INFO:teuthology.orchestra.run.smithi050.stdout: "osdmap_epoch_barrier": 78, 2024-08-31T04:23:18.545 INFO:teuthology.orchestra.run.smithi050.stdout: "uptime": 183.09784071799999 2024-08-31T04:23:18.545 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-08-31T04:23:18.546 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:18.540+0000 7fa19ee00640 1 -- 172.21.15.50:0/3382063996 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fa1800b4b30 msgr2=0x7fa1800b7040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:23:18.546 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:18.540+0000 7fa19ee00640 1 --2- 172.21.15.50:0/3382063996 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fa1800b4b30 0x7fa1800b7040 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fa18c0a9220 tx=0x7fa18c009310 comp rx=0 tx=0).stop 2024-08-31T04:23:18.546 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:18.540+0000 7fa19ee00640 1 -- 172.21.15.50:0/3382063996 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa198102180 msgr2=0x7fa19819c240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:23:18.546 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:18.540+0000 7fa19ee00640 1 --2- 172.21.15.50:0/3382063996 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa198102180 0x7fa19819c240 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fa18c00e9f0 tx=0x7fa18c00edf0 comp rx=0 tx=0).stop 2024-08-31T04:23:18.546 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:18.540+0000 7fa19ee00640 1 -- 172.21.15.50:0/3382063996 shutdown_connections 2024-08-31T04:23:18.546 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:18.540+0000 7fa19ee00640 1 --2- 172.21.15.50:0/3382063996 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fa1800b4b30 0x7fa1800b7040 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:18.546 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:18.540+0000 7fa19ee00640 1 --2- 172.21.15.50:0/3382063996 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa19810fd30 0x7fa1981a1a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:18.546 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:18.540+0000 7fa19ee00640 1 --2- 172.21.15.50:0/3382063996 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa198102ad0 0x7fa19819c7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:18.547 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:18.540+0000 7fa19ee00640 1 --2- 172.21.15.50:0/3382063996 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa198102180 0x7fa19819c240 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:18.547 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:18.540+0000 7fa19ee00640 1 -- 172.21.15.50:0/3382063996 >> 172.21.15.50:0/3382063996 conn(0x7fa1980fe060 msgr2=0x7fa198111e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:23:18.547 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:18.542+0000 7fa19ee00640 1 -- 172.21.15.50:0/3382063996 shutdown_connections 2024-08-31T04:23:18.547 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:18.542+0000 7fa19ee00640 1 -- 172.21.15.50:0/3382063996 wait complete. 2024-08-31T04:23:19.332 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 058d9fc6-674f-11ef-bcd4-c7b262605968 -- ceph tell mds.h status 2024-08-31T04:23:19.712 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:23:19.851 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:23:19 smithi050 ceph-mon[17259]: pgmap v379: 97 pgs: 97 active+clean; 660 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 2.5 KiB/s wr, 14 op/s 2024-08-31T04:23:19.996 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:23:19 smithi177 ceph-mon[22025]: pgmap v379: 97 pgs: 97 active+clean; 660 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 2.5 KiB/s wr, 14 op/s 2024-08-31T04:23:20.043 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:23:19 smithi133 ceph-mon[22177]: pgmap v379: 97 pgs: 97 active+clean; 660 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 2.5 KiB/s wr, 14 op/s 2024-08-31T04:23:20.333 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:20.331+0000 7f4a84400640 1 -- 172.21.15.50:0/2874553267 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4a7c102370 msgr2=0x7f4a7c102780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:23:20.333 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:20.331+0000 7f4a84400640 1 --2- 172.21.15.50:0/2874553267 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4a7c102370 0x7f4a7c102780 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f4a70009900 tx=0x7f4a7002a480 comp rx=0 tx=0).stop 2024-08-31T04:23:20.333 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:20.331+0000 7f4a84400640 1 -- 172.21.15.50:0/2874553267 shutdown_connections 2024-08-31T04:23:20.333 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:20.331+0000 7f4a84400640 1 --2- 172.21.15.50:0/2874553267 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4a7c10ff20 0x7f4a7c112340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:20.333 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:20.331+0000 7f4a84400640 1 --2- 172.21.15.50:0/2874553267 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4a7c102cc0 0x7f4a7c10f9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:20.333 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:20.331+0000 7f4a84400640 1 --2- 172.21.15.50:0/2874553267 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4a7c102370 0x7f4a7c102780 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:20.333 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:20.331+0000 7f4a84400640 1 -- 172.21.15.50:0/2874553267 >> 172.21.15.50:0/2874553267 conn(0x7f4a7c079500 msgr2=0x7f4a7c079910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:23:20.333 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:20.331+0000 7f4a84400640 1 -- 172.21.15.50:0/2874553267 shutdown_connections 2024-08-31T04:23:20.333 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:20.331+0000 7f4a84400640 1 -- 172.21.15.50:0/2874553267 wait complete. 2024-08-31T04:23:20.334 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:20.332+0000 7f4a84400640 1 Processor -- start 2024-08-31T04:23:20.334 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:20.332+0000 7f4a84400640 1 -- start start 2024-08-31T04:23:20.334 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:20.333+0000 7f4a84400640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4a7c102370 0x7f4a7c19c430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:20.334 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:20.333+0000 7f4a84400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4a7c102cc0 0x7f4a7c19c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:20.335 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:20.333+0000 7f4a84400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4a7c10ff20 0x7f4a7c1a1c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:20.335 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:20.333+0000 7f4a84400640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f4a7c115a60 con 0x7f4a7c10ff20 2024-08-31T04:23:20.335 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:20.333+0000 7f4a84400640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f4a7c1158e0 con 0x7f4a7c102cc0 2024-08-31T04:23:20.335 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:20.333+0000 7f4a84400640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f4a7c115be0 con 0x7f4a7c102370 2024-08-31T04:23:20.335 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:20.333+0000 7f4a81a00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4a7c102370 0x7f4a7c19c430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:20.335 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:20.333+0000 7f4a82400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4a7c10ff20 0x7f4a7c1a1c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:20.335 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:20.333+0000 7f4a81000640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4a7c102cc0 0x7f4a7c19c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:20.335 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:20.333+0000 7f4a81a00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4a7c102370 0x7f4a7c19c430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.50:51290/0 (socket says 172.21.15.50:51290) 2024-08-31T04:23:20.335 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:20.333+0000 7f4a81a00640 1 -- 172.21.15.50:0/4176186633 learned_addr learned my addr 172.21.15.50:0/4176186633 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:23:20.336 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:20.334+0000 7f4a82400640 1 -- 172.21.15.50:0/4176186633 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4a7c102370 msgr2=0x7f4a7c19c430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:23:20.336 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:20.334+0000 7f4a82400640 1 --2- 172.21.15.50:0/4176186633 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4a7c102370 0x7f4a7c19c430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:20.336 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:20.334+0000 7f4a82400640 1 -- 172.21.15.50:0/4176186633 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4a7c102cc0 msgr2=0x7f4a7c19c9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:23:20.336 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:20.334+0000 7f4a82400640 1 --2- 172.21.15.50:0/4176186633 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4a7c102cc0 0x7f4a7c19c9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:20.336 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:20.334+0000 7f4a82400640 1 -- 172.21.15.50:0/4176186633 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a7c1a23a0 con 0x7f4a7c10ff20 2024-08-31T04:23:20.337 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:20.334+0000 7f4a81a00640 1 --2- 172.21.15.50:0/4176186633 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4a7c102370 0x7f4a7c19c430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:23:20.337 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:20.334+0000 7f4a82400640 1 --2- 172.21.15.50:0/4176186633 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4a7c10ff20 0x7f4a7c1a1c70 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f4a7400da10 tx=0x7f4a7400ded0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:23:20.337 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:20.334+0000 7f4a7a000640 1 -- 172.21.15.50:0/4176186633 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a7400bd70 con 0x7f4a7c10ff20 2024-08-31T04:23:20.337 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:20.334+0000 7f4a84400640 1 -- 172.21.15.50:0/4176186633 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4a7c1a2690 con 0x7f4a7c10ff20 2024-08-31T04:23:20.337 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:20.334+0000 7f4a7a000640 1 -- 172.21.15.50:0/4176186633 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4a74003e20 con 0x7f4a7c10ff20 2024-08-31T04:23:20.337 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:20.334+0000 7f4a84400640 1 -- 172.21.15.50:0/4176186633 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4a7c1a8df0 con 0x7f4a7c10ff20 2024-08-31T04:23:20.337 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:20.335+0000 7f4a7a000640 1 -- 172.21.15.50:0/4176186633 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a74010660 con 0x7f4a7c10ff20 2024-08-31T04:23:20.338 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:20.337+0000 7f4a8b066740 1 Processor -- start 2024-08-31T04:23:20.339 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:20.338+0000 7f4a7a000640 1 -- 172.21.15.50:0/4176186633 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 18) ==== 152577+0+0 (secure 0 0 0) 0x7f4a74004270 con 0x7f4a7c10ff20 2024-08-31T04:23:20.339 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:20.338+0000 7f4a8b066740 1 -- start start 2024-08-31T04:23:20.340 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:20.339+0000 7f4a8b066740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b285942f60 0x55b285ce88f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:20.340 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:20.339+0000 7f4a8b066740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b28591a0a0 0x55b285ce8e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:20.340 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:20.339+0000 7f4a8b066740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b285922280 0x55b285ce9370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:20.340 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:20.339+0000 7f4a8b066740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55b285c5f550 con 0x55b285942f60 2024-08-31T04:23:20.340 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:20.339+0000 7f4a8b066740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x55b285c4eae0 con 0x55b28591a0a0 2024-08-31T04:23:20.341 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:20.339+0000 7f4a8b066740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x55b285c52a90 con 0x55b285922280 2024-08-31T04:23:20.342 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:20.339+0000 7f4a81000640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b285942f60 0x55b285ce88f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:20.342 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:20.339+0000 7f4a81a00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b28591a0a0 0x55b285ce8e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:20.342 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:20.339+0000 7f4a81a00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b28591a0a0 0x55b285ce8e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.50:47996/0 (socket says 172.21.15.50:47996) 2024-08-31T04:23:20.342 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:20.339+0000 7f4a81a00640 1 -- 172.21.15.50:0/1998315290 learned_addr learned my addr 172.21.15.50:0/1998315290 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:23:20.342 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:20.339+0000 7f4a81a00640 1 -- 172.21.15.50:0/1998315290 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b285922280 msgr2=0x55b285ce9370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:23:20.342 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:20.339+0000 7f4a81a00640 1 --2- 172.21.15.50:0/1998315290 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b285922280 0x55b285ce9370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:20.343 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:20.339+0000 7f4a81a00640 1 -- 172.21.15.50:0/1998315290 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b285942f60 msgr2=0x55b285ce88f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:23:20.343 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:20.339+0000 7f4a81a00640 1 --2- 172.21.15.50:0/1998315290 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b285942f60 0x55b285ce88f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:20.343 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:20.339+0000 7f4a81a00640 1 -- 172.21.15.50:0/1998315290 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b2859ae540 con 0x55b28591a0a0 2024-08-31T04:23:20.343 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:20.340+0000 7f4a7a000640 1 --2- 172.21.15.50:0/4176186633 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f4a640b4b30 0x7f4a640b7040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:20.343 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:20.340+0000 7f4a7a000640 1 -- 172.21.15.50:0/4176186633 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8219+0+0 (secure 0 0 0) 0x7f4a740e5530 con 0x7f4a7c10ff20 2024-08-31T04:23:20.343 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:20.340+0000 7f4a81a00640 1 --2- 172.21.15.50:0/1998315290 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b28591a0a0 0x55b285ce8e30 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f4a70006010 tx=0x7f4a70004560 comp rx=0 tx=0).ready entity=mon.2 client_cookie=73cb72b19481bad4 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:23:20.343 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:20.340+0000 7f4a81000640 1 --2- 172.21.15.50:0/4176186633 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f4a640b4b30 0x7f4a640b7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:20.343 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:20.340+0000 7f4a6ea00640 1 -- 172.21.15.50:0/1998315290 <== mon.2 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a70040070 con 0x55b28591a0a0 2024-08-31T04:23:20.343 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:20.340+0000 7f4a6ea00640 1 -- 172.21.15.50:0/1998315290 <== mon.2 v2:172.21.15.133:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4a700047a0 con 0x55b28591a0a0 2024-08-31T04:23:20.343 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:20.340+0000 7f4a6ea00640 1 -- 172.21.15.50:0/1998315290 <== mon.2 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a70035040 con 0x55b28591a0a0 2024-08-31T04:23:20.345 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:20.341+0000 7f4a8b066740 1 -- 172.21.15.50:0/1998315290 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b28591a0a0 msgr2=0x55b285ce8e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:23:20.346 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:20.341+0000 7f4a81000640 1 --2- 172.21.15.50:0/4176186633 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f4a640b4b30 0x7f4a640b7040 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f4a7c103d20 tx=0x7f4a68009990 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:23:20.346 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:20.341+0000 7f4a8b066740 1 --2- 172.21.15.50:0/1998315290 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b28591a0a0 0x55b285ce8e30 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f4a70006010 tx=0x7f4a70004560 comp rx=0 tx=0).stop 2024-08-31T04:23:20.346 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:20.341+0000 7f4a8b066740 1 -- 172.21.15.50:0/1998315290 shutdown_connections 2024-08-31T04:23:20.346 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:20.341+0000 7f4a8b066740 1 --2- 172.21.15.50:0/1998315290 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b285922280 0x55b285ce9370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:20.346 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:20.341+0000 7f4a8b066740 1 --2- 172.21.15.50:0/1998315290 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b28591a0a0 0x55b285ce8e30 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:20.346 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:20.341+0000 7f4a8b066740 1 --2- 172.21.15.50:0/1998315290 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b285942f60 0x55b285ce88f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:20.346 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:20.341+0000 7f4a8b066740 1 -- 172.21.15.50:0/1998315290 >> 172.21.15.50:0/1998315290 conn(0x55b285937350 msgr2=0x55b285ce67e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:23:20.346 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:20.342+0000 7f4a8b066740 1 -- 172.21.15.50:0/1998315290 shutdown_connections 2024-08-31T04:23:20.346 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:20.342+0000 7f4a8b066740 1 -- 172.21.15.50:0/1998315290 wait complete. 2024-08-31T04:23:20.346 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:20.342+0000 7f4a8b066740 1 -- start start 2024-08-31T04:23:20.346 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:20.342+0000 7f4a8b066740 1 Processor -- start 2024-08-31T04:23:20.346 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:20.343+0000 7f4a8b066740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b28591a0a0 0x55b285cf4060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:20.347 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:20.343+0000 7f4a8b066740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b285922280 0x55b285cf45a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:20.347 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:20.343+0000 7f4a8b066740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b285942f60 0x55b285d00390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:20.347 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:20.343+0000 7f4a8b066740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55b285ab15f0 con 0x55b285922280 2024-08-31T04:23:20.347 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:20.343+0000 7f4a8b066740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x55b285bd5bd0 con 0x55b285942f60 2024-08-31T04:23:20.347 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:20.343+0000 7f4a8b066740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x55b285cf7070 con 0x55b28591a0a0 2024-08-31T04:23:20.347 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:20.343+0000 7f4a8b066740 10 client.0 _ll_register_callbacks cb 0x55b285bfb210 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:23:20.347 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:20.343+0000 7f4a81a00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b28591a0a0 0x55b285cf4060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:20.347 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:20.343+0000 7f4a81a00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b28591a0a0 0x55b285cf4060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.50:51318/0 (socket says 172.21.15.50:51318) 2024-08-31T04:23:20.347 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:20.343+0000 7f4a81a00640 1 -- 172.21.15.50:0/506919358 learned_addr learned my addr 172.21.15.50:0/506919358 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:23:20.347 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:20.343+0000 7f4a81000640 1 --2- 172.21.15.50:0/506919358 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b285922280 0x55b285cf45a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:20.347 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:20.343+0000 7f4a82400640 1 --2- 172.21.15.50:0/506919358 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b285942f60 0x55b285d00390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:20.347 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:20.344+0000 7f4a81a00640 1 -- 172.21.15.50:0/506919358 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b285942f60 msgr2=0x55b285d00390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:23:20.347 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:20.344+0000 7f4a81a00640 1 --2- 172.21.15.50:0/506919358 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b285942f60 0x55b285d00390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:20.348 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:20.344+0000 7f4a81a00640 1 -- 172.21.15.50:0/506919358 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b285922280 msgr2=0x55b285cf45a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:23:20.348 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:20.344+0000 7f4a81a00640 1 --2- 172.21.15.50:0/506919358 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b285922280 0x55b285cf45a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:20.348 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:20.344+0000 7f4a81a00640 1 -- 172.21.15.50:0/506919358 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b285c16650 con 0x55b28591a0a0 2024-08-31T04:23:20.348 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:20.344+0000 7f4a81000640 1 --2- 172.21.15.50:0/506919358 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b285922280 0x55b285cf45a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:23:20.348 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:20.344+0000 7f4a81a00640 1 --2- 172.21.15.50:0/506919358 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b28591a0a0 0x55b285cf4060 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f4a7002aa70 tx=0x7f4a70004c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2c8406ad6d95679d server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:23:20.348 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:20.344+0000 7f4a63400640 10 client.0 ms_handle_connect on v2:172.21.15.177:3300/0 2024-08-31T04:23:20.348 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:20.344+0000 7f4a63400640 1 -- 172.21.15.50:0/506919358 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a7004d060 con 0x55b28591a0a0 2024-08-31T04:23:20.348 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:20.344+0000 7f4a63400640 1 -- 172.21.15.50:0/506919358 <== mon.1 v2:172.21.15.177:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8219+0+0 (secure 0 0 0) 0x7f4a70003d60 con 0x55b28591a0a0 2024-08-31T04:23:20.348 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:20.344+0000 7f4a8b066740 1 -- 172.21.15.50:0/506919358 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4a700047a0 con 0x55b28591a0a0 2024-08-31T04:23:20.350 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:20.345+0000 7f4a63400640 1 -- 172.21.15.50:0/506919358 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f4a70040070 con 0x55b28591a0a0 2024-08-31T04:23:20.350 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:20.345+0000 7f4a8b066740 10 client.25378 fetch_fsmap learned FSMap version 29 2024-08-31T04:23:20.350 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:20.345+0000 7f4a8b066740 1 -- 172.21.15.50:0/506919358 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55b285d02e10 con 0x55b28591a0a0 2024-08-31T04:23:20.350 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:20.345+0000 7f4a63400640 1 -- 172.21.15.50:0/506919358 <== mon.1 v2:172.21.15.177:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4a700047a0 con 0x55b28591a0a0 2024-08-31T04:23:20.350 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:20.345+0000 7f4a63400640 1 -- 172.21.15.50:0/506919358 <== mon.1 v2:172.21.15.177:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f4a70031740 con 0x55b28591a0a0 2024-08-31T04:23:20.351 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:20.345+0000 7f4a8b066740 10 client.25378 fetch_fsmap finished waiting for FSMap version 29 2024-08-31T04:23:20.351 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:20.345+0000 7f4a8b066740 10 client.25378 resolve_mds: resolved name 'h' to daemon mds.h 2024-08-31T04:23:20.351 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:20.345+0000 7f4a8b066740 20 client.25378 populate_metadata read hostname 'smithi050' 2024-08-31T04:23:20.351 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:20.345+0000 7f4a8b066740 1 --2- 172.21.15.50:0/506919358 >> [v2:172.21.15.133:6836/4014853202,v1:172.21.15.133:6837/4014853202] conn(0x55b2859018e0 0x55b285d063f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:20.351 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:20.346+0000 7f4a8b066740 4 client.25378 mds_command: new command op to 24656 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T04:23:20.351 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:20.346+0000 7f4a8b066740 1 -- 172.21.15.50:0/506919358 --> [v2:172.21.15.133:6836/4014853202,v1:172.21.15.133:6837/4014853202] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b285c614a0 con 0x55b2859018e0 2024-08-31T04:23:20.351 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:20.346+0000 7f4a81000640 1 --2- 172.21.15.50:0/506919358 >> [v2:172.21.15.133:6836/4014853202,v1:172.21.15.133:6837/4014853202] conn(0x55b2859018e0 0x55b285d063f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:20.351 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:20.347+0000 7f4a81000640 1 --2- 172.21.15.50:0/506919358 >> [v2:172.21.15.133:6836/4014853202,v1:172.21.15.133:6837/4014853202] conn(0x55b2859018e0 0x55b285d063f0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=28d57dc28d118ee8 server_cookie=1f5c4583483ec455 in_seq=0 out_seq=0 2024-08-31T04:23:20.351 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:20.347+0000 7f4a63400640 10 client.25378 ms_handle_connect on v2:172.21.15.133:6836/4014853202 2024-08-31T04:23:20.351 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:20.347+0000 7f4a63400640 1 -- 172.21.15.50:0/506919358 <== mds.3 v2:172.21.15.133:6836/4014853202 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55b285c614a0 con 0x55b2859018e0 2024-08-31T04:23:20.351 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:20.347+0000 7f4a63400640 10 client.25378 handle_command_reply: tid=0 2024-08-31T04:23:20.351 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:20.347+0000 7f4a8b066740 1 client.25378 shutdown 2024-08-31T04:23:20.351 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:20.348+0000 7f4a8b066740 1 -- 172.21.15.50:0/506919358 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b28591a0a0 msgr2=0x55b285cf4060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:23:20.352 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:20.348+0000 7f4a8b066740 1 --2- 172.21.15.50:0/506919358 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b28591a0a0 0x55b285cf4060 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f4a7002aa70 tx=0x7f4a70004c00 comp rx=0 tx=0).stop 2024-08-31T04:23:20.352 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:20.348+0000 7f4a8b066740 1 -- 172.21.15.50:0/506919358 shutdown_connections 2024-08-31T04:23:20.352 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:20.348+0000 7f4a8b066740 1 --2- 172.21.15.50:0/506919358 >> [v2:172.21.15.133:6836/4014853202,v1:172.21.15.133:6837/4014853202] conn(0x55b2859018e0 0x55b285d063f0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:20.352 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:20.348+0000 7f4a8b066740 1 --2- 172.21.15.50:0/506919358 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b285942f60 0x55b285d00390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:20.352 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:20.348+0000 7f4a8b066740 1 --2- 172.21.15.50:0/506919358 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b285922280 0x55b285cf45a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:20.352 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:20.348+0000 7f4a8b066740 1 --2- 172.21.15.50:0/506919358 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b28591a0a0 0x55b285cf4060 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:20.352 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:20.348+0000 7f4a63400640 0 client.25378 ms_handle_reset on v2:172.21.15.133:6836/4014853202 2024-08-31T04:23:20.352 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:20.348+0000 7f4a8b066740 1 -- 172.21.15.50:0/506919358 >> 172.21.15.50:0/506919358 conn(0x55b285937350 msgr2=0x55b285cebad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:23:20.352 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:20.348+0000 7f4a8b066740 1 -- 172.21.15.50:0/506919358 shutdown_connections 2024-08-31T04:23:20.353 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:20.348+0000 7f4a8b066740 1 -- 172.21.15.50:0/506919358 wait complete. 2024-08-31T04:23:20.353 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:20.348+0000 7f4a8b066740 20 client.25378 trim_cache size 0 max 16384 2024-08-31T04:23:20.368 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:20.367+0000 7f4a8b066740 1 Processor -- start 2024-08-31T04:23:20.369 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:20.367+0000 7f4a8b066740 1 -- start start 2024-08-31T04:23:20.370 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:20.368+0000 7f4a8b066740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b28591a0a0 0x55b285cf4520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:20.370 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:20.368+0000 7f4a8b066740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b285922280 0x55b285d00300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:20.370 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:20.368+0000 7f4a8b066740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b285942f60 0x55b285ceb9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:20.370 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:20.368+0000 7f4a8b066740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55b285d04730 con 0x55b28591a0a0 2024-08-31T04:23:20.370 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:20.368+0000 7f4a8b066740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x55b285d04e00 con 0x55b285922280 2024-08-31T04:23:20.370 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:20.368+0000 7f4a8b066740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x55b285d054d0 con 0x55b285942f60 2024-08-31T04:23:20.370 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:20.368+0000 7f4a81a00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b28591a0a0 0x55b285cf4520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:20.370 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:20.368+0000 7f4a81a00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b28591a0a0 0x55b285cf4520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:37772/0 (socket says 172.21.15.50:37772) 2024-08-31T04:23:20.370 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:20.368+0000 7f4a81a00640 1 -- 172.21.15.50:0/3257369460 learned_addr learned my addr 172.21.15.50:0/3257369460 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:23:20.371 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:20.368+0000 7f4a81000640 1 --2- 172.21.15.50:0/3257369460 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b285922280 0x55b285d00300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:20.371 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:20.368+0000 7f4a82400640 1 --2- 172.21.15.50:0/3257369460 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b285942f60 0x55b285ceb9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:20.371 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:20.368+0000 7f4a81a00640 1 -- 172.21.15.50:0/3257369460 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b285942f60 msgr2=0x55b285ceb9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:23:20.371 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:20.368+0000 7f4a81a00640 1 --2- 172.21.15.50:0/3257369460 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b285942f60 0x55b285ceb9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:20.371 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:20.368+0000 7f4a81a00640 1 -- 172.21.15.50:0/3257369460 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b285922280 msgr2=0x55b285d00300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:23:20.371 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:20.369+0000 7f4a81a00640 1 --2- 172.21.15.50:0/3257369460 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b285922280 0x55b285d00300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:20.371 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:20.369+0000 7f4a81a00640 1 -- 172.21.15.50:0/3257369460 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b285cf2560 con 0x55b28591a0a0 2024-08-31T04:23:20.371 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:20.369+0000 7f4a81000640 1 --2- 172.21.15.50:0/3257369460 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b285922280 0x55b285d00300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:23:20.371 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:20.369+0000 7f4a81a00640 1 --2- 172.21.15.50:0/3257369460 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b28591a0a0 0x55b285cf4520 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f4a7002aa40 tx=0x7f4a70005a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68b9fcdd722a244 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:23:20.373 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:20.369+0000 7f4a6e000640 1 -- 172.21.15.50:0/3257369460 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a70058030 con 0x55b28591a0a0 2024-08-31T04:23:20.373 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:20.369+0000 7f4a6e000640 1 -- 172.21.15.50:0/3257369460 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4a700314a0 con 0x55b28591a0a0 2024-08-31T04:23:20.373 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:20.369+0000 7f4a6e000640 1 -- 172.21.15.50:0/3257369460 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a7004d040 con 0x55b28591a0a0 2024-08-31T04:23:20.373 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:20.370+0000 7f4a8b066740 1 -- 172.21.15.50:0/3257369460 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b28591a0a0 msgr2=0x55b285cf4520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:23:20.374 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:20.370+0000 7f4a8b066740 1 --2- 172.21.15.50:0/3257369460 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b28591a0a0 0x55b285cf4520 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f4a7002aa40 tx=0x7f4a70005a20 comp rx=0 tx=0).stop 2024-08-31T04:23:20.374 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:20.370+0000 7f4a8b066740 1 -- 172.21.15.50:0/3257369460 shutdown_connections 2024-08-31T04:23:20.374 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:20.370+0000 7f4a8b066740 1 --2- 172.21.15.50:0/3257369460 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b285942f60 0x55b285ceb9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:20.374 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:20.370+0000 7f4a8b066740 1 --2- 172.21.15.50:0/3257369460 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b285922280 0x55b285d00300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:20.374 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:20.370+0000 7f4a8b066740 1 --2- 172.21.15.50:0/3257369460 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b28591a0a0 0x55b285cf4520 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:20.374 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:20.370+0000 7f4a8b066740 1 -- 172.21.15.50:0/3257369460 >> 172.21.15.50:0/3257369460 conn(0x55b285937350 msgr2=0x55b285cf3e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:23:20.374 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:20.370+0000 7f4a8b066740 1 -- 172.21.15.50:0/3257369460 shutdown_connections 2024-08-31T04:23:20.374 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:20.370+0000 7f4a8b066740 1 -- 172.21.15.50:0/3257369460 wait complete. 2024-08-31T04:23:20.374 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:20.371+0000 7f4a8b066740 1 -- start start 2024-08-31T04:23:20.374 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:20.371+0000 7f4a8b066740 1 Processor -- start 2024-08-31T04:23:20.374 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:20.371+0000 7f4a8b066740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b28591a0a0 0x55b285d0eca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:20.374 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:20.371+0000 7f4a8b066740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b285922280 0x55b285d0a150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:20.374 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:20.371+0000 7f4a8b066740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b285942f60 0x55b285d0a690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:20.374 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:20.371+0000 7f4a8b066740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55b285d06270 con 0x55b28591a0a0 2024-08-31T04:23:20.375 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:20.371+0000 7f4a8b066740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x55b285d05ba0 con 0x55b285942f60 2024-08-31T04:23:20.375 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:20.371+0000 7f4a8b066740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x55b285d06940 con 0x55b285922280 2024-08-31T04:23:20.375 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:20.371+0000 7f4a8b066740 10 client.0 _ll_register_callbacks cb 0x7f4a70009520 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:23:20.375 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:20.372+0000 7f4a81a00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b28591a0a0 0x55b285d0eca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:20.375 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:20.372+0000 7f4a81a00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b28591a0a0 0x55b285d0eca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:37776/0 (socket says 172.21.15.50:37776) 2024-08-31T04:23:20.375 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:20.372+0000 7f4a81a00640 1 -- 172.21.15.50:0/3764725433 learned_addr learned my addr 172.21.15.50:0/3764725433 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:23:20.375 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:20.372+0000 7f4a82400640 1 --2- 172.21.15.50:0/3764725433 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b285942f60 0x55b285d0a690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:20.375 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:20.372+0000 7f4a81000640 1 --2- 172.21.15.50:0/3764725433 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b285922280 0x55b285d0a150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:20.375 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:20.372+0000 7f4a81000640 1 -- 172.21.15.50:0/3764725433 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b285942f60 msgr2=0x55b285d0a690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:23:20.375 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:20.372+0000 7f4a81000640 1 --2- 172.21.15.50:0/3764725433 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b285942f60 0x55b285d0a690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:20.376 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:20.372+0000 7f4a81000640 1 -- 172.21.15.50:0/3764725433 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b28591a0a0 msgr2=0x55b285d0eca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:23:20.376 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:20.372+0000 7f4a81000640 1 --2- 172.21.15.50:0/3764725433 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b28591a0a0 0x55b285d0eca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:20.376 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:20.372+0000 7f4a81000640 1 -- 172.21.15.50:0/3764725433 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b285d0ac20 con 0x55b285922280 2024-08-31T04:23:20.376 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:20.372+0000 7f4a82400640 1 --2- 172.21.15.50:0/3764725433 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b285942f60 0x55b285d0a690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:23:20.376 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:20.372+0000 7f4a81a00640 1 --2- 172.21.15.50:0/3764725433 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b28591a0a0 0x55b285d0eca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:23:20.378 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:20.373+0000 7f4a81000640 1 --2- 172.21.15.50:0/3764725433 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b285922280 0x55b285d0a150 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x55b285d07230 tx=0x7f4a68017000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4b4653883f14111f server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:23:20.378 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:20.373+0000 7f4a63400640 10 client.0 ms_handle_connect on v2:172.21.15.177:3300/0 2024-08-31T04:23:20.378 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:20.373+0000 7f4a63400640 1 -- 172.21.15.50:0/3764725433 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a68035060 con 0x55b285922280 2024-08-31T04:23:20.378 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:20.373+0000 7f4a8b066740 1 -- 172.21.15.50:0/3764725433 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4a700314a0 con 0x55b285922280 2024-08-31T04:23:20.378 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:20.373+0000 7f4a63400640 1 -- 172.21.15.50:0/3764725433 <== mon.1 v2:172.21.15.177:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8219+0+0 (secure 0 0 0) 0x7f4a6802a500 con 0x55b285922280 2024-08-31T04:23:20.379 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:20.373+0000 7f4a63400640 1 -- 172.21.15.50:0/3764725433 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f4a6802c040 con 0x55b285922280 2024-08-31T04:23:20.379 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:20.373+0000 7f4a8b066740 10 client.25384 fetch_fsmap learned FSMap version 29 2024-08-31T04:23:20.379 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:20.373+0000 7f4a8b066740 1 -- 172.21.15.50:0/3764725433 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55b285d71660 con 0x55b285922280 2024-08-31T04:23:20.379 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:20.373+0000 7f4a63400640 1 -- 172.21.15.50:0/3764725433 <== mon.1 v2:172.21.15.177:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4a700314a0 con 0x55b285922280 2024-08-31T04:23:20.379 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:20.374+0000 7f4a63400640 1 -- 172.21.15.50:0/3764725433 <== mon.1 v2:172.21.15.177:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f4a680308b0 con 0x55b285922280 2024-08-31T04:23:20.379 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:20.374+0000 7f4a8b066740 10 client.25384 fetch_fsmap finished waiting for FSMap version 29 2024-08-31T04:23:20.379 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:20.374+0000 7f4a8b066740 10 client.25384 resolve_mds: resolved name 'h' to daemon mds.h 2024-08-31T04:23:20.379 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:20.374+0000 7f4a8b066740 20 client.25384 populate_metadata read hostname 'smithi050' 2024-08-31T04:23:20.379 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:20.374+0000 7f4a8b066740 1 --2- 172.21.15.50:0/3764725433 >> [v2:172.21.15.133:6836/4014853202,v1:172.21.15.133:6837/4014853202] conn(0x55b2858d6c90 0x55b285d74f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:20.379 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:20.374+0000 7f4a8b066740 4 client.25384 mds_command: new command op to 24656 tid=0 multi_id=0 [{"prefix": "status"}] 2024-08-31T04:23:20.379 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:20.374+0000 7f4a8b066740 1 -- 172.21.15.50:0/3764725433 --> [v2:172.21.15.133:6836/4014853202,v1:172.21.15.133:6837/4014853202] -- command(tid 0: {"prefix": "status"}) -- 0x55b285c5cf40 con 0x55b2858d6c90 2024-08-31T04:23:20.379 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:20.374+0000 7f4a81a00640 1 --2- 172.21.15.50:0/3764725433 >> [v2:172.21.15.133:6836/4014853202,v1:172.21.15.133:6837/4014853202] conn(0x55b2858d6c90 0x55b285d74f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:20.380 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:20.375+0000 7f4a81a00640 1 --2- 172.21.15.50:0/3764725433 >> [v2:172.21.15.133:6836/4014853202,v1:172.21.15.133:6837/4014853202] conn(0x55b2858d6c90 0x55b285d74f20 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=d2de520a38427f53 server_cookie=5cf9d148b6504012 in_seq=0 out_seq=0 2024-08-31T04:23:20.380 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:20.375+0000 7f4a63400640 10 client.25384 ms_handle_connect on v2:172.21.15.133:6836/4014853202 2024-08-31T04:23:20.380 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:20.375+0000 7f4a63400640 1 -- 172.21.15.50:0/3764725433 <== mds.3 v2:172.21.15.133:6836/4014853202 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x55b285c5cf40 con 0x55b2858d6c90 2024-08-31T04:23:20.380 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:20.375+0000 7f4a63400640 10 client.25384 handle_command_reply: tid=0 2024-08-31T04:23:20.380 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:20.375+0000 7f4a8b066740 1 client.25384 shutdown 2024-08-31T04:23:20.380 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:20.375+0000 7f4a8b066740 1 -- 172.21.15.50:0/3764725433 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b285922280 msgr2=0x55b285d0a150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:23:20.380 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:20.375+0000 7f4a8b066740 1 --2- 172.21.15.50:0/3764725433 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b285922280 0x55b285d0a150 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x55b285d07230 tx=0x7f4a68017000 comp rx=0 tx=0).stop 2024-08-31T04:23:20.380 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:20.375+0000 7f4a8b066740 1 -- 172.21.15.50:0/3764725433 shutdown_connections 2024-08-31T04:23:20.380 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:20.375+0000 7f4a8b066740 1 --2- 172.21.15.50:0/3764725433 >> [v2:172.21.15.133:6836/4014853202,v1:172.21.15.133:6837/4014853202] conn(0x55b2858d6c90 0x55b285d74f20 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:20.380 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:20.375+0000 7f4a8b066740 1 --2- 172.21.15.50:0/3764725433 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b285922280 0x55b285d0a150 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:20.380 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:20.375+0000 7f4a8b066740 1 --2- 172.21.15.50:0/3764725433 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b285942f60 0x55b285d0a690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:20.380 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:20.375+0000 7f4a8b066740 1 --2- 172.21.15.50:0/3764725433 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b28591a0a0 0x55b285d0eca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:20.380 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:20.375+0000 7f4a63400640 0 client.25384 ms_handle_reset on v2:172.21.15.133:6836/4014853202 2024-08-31T04:23:20.380 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:20.375+0000 7f4a8b066740 1 -- 172.21.15.50:0/3764725433 >> 172.21.15.50:0/3764725433 conn(0x55b285937350 msgr2=0x55b285ceb9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:23:20.381 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:20.376+0000 7f4a8b066740 1 -- 172.21.15.50:0/3764725433 shutdown_connections 2024-08-31T04:23:20.381 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:20.376+0000 7f4a8b066740 1 -- 172.21.15.50:0/3764725433 wait complete. 2024-08-31T04:23:20.381 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:20.376+0000 7f4a8b066740 20 client.25384 trim_cache size 0 max 16384 2024-08-31T04:23:20.381 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-08-31T04:23:20.381 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_fsid": "058d9fc6-674f-11ef-bcd4-c7b262605968", 2024-08-31T04:23:20.381 INFO:teuthology.orchestra.run.smithi050.stdout: "whoami": 3, 2024-08-31T04:23:20.381 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 24656, 2024-08-31T04:23:20.381 INFO:teuthology.orchestra.run.smithi050.stdout: "want_state": "up:active", 2024-08-31T04:23:20.381 INFO:teuthology.orchestra.run.smithi050.stdout: "state": "up:active", 2024-08-31T04:23:20.381 INFO:teuthology.orchestra.run.smithi050.stdout: "fs_name": "cephfs", 2024-08-31T04:23:20.382 INFO:teuthology.orchestra.run.smithi050.stdout: "rank_uptime": 144.372950401, 2024-08-31T04:23:20.382 INFO:teuthology.orchestra.run.smithi050.stdout: "mdsmap_epoch": 29, 2024-08-31T04:23:20.382 INFO:teuthology.orchestra.run.smithi050.stdout: "osdmap_epoch": 78, 2024-08-31T04:23:20.382 INFO:teuthology.orchestra.run.smithi050.stdout: "osdmap_epoch_barrier": 78, 2024-08-31T04:23:20.382 INFO:teuthology.orchestra.run.smithi050.stdout: "uptime": 182.33431617700001 2024-08-31T04:23:20.382 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-08-31T04:23:20.382 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:20.376+0000 7f4a84400640 1 -- 172.21.15.50:0/4176186633 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f4a640b4b30 msgr2=0x7f4a640b7040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:23:20.383 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:20.376+0000 7f4a84400640 1 --2- 172.21.15.50:0/4176186633 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f4a640b4b30 0x7f4a640b7040 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f4a7c103d20 tx=0x7f4a68009990 comp rx=0 tx=0).stop 2024-08-31T04:23:20.383 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:20.376+0000 7f4a84400640 1 -- 172.21.15.50:0/4176186633 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4a7c10ff20 msgr2=0x7f4a7c1a1c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:23:20.383 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:20.376+0000 7f4a84400640 1 --2- 172.21.15.50:0/4176186633 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4a7c10ff20 0x7f4a7c1a1c70 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f4a7400da10 tx=0x7f4a7400ded0 comp rx=0 tx=0).stop 2024-08-31T04:23:20.383 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:20.377+0000 7f4a84400640 1 -- 172.21.15.50:0/4176186633 shutdown_connections 2024-08-31T04:23:20.383 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:20.377+0000 7f4a84400640 1 --2- 172.21.15.50:0/4176186633 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f4a640b4b30 0x7f4a640b7040 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:20.383 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:20.377+0000 7f4a84400640 1 --2- 172.21.15.50:0/4176186633 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4a7c10ff20 0x7f4a7c1a1c70 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:20.383 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:20.377+0000 7f4a84400640 1 --2- 172.21.15.50:0/4176186633 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4a7c102cc0 0x7f4a7c19c9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:20.383 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:20.377+0000 7f4a84400640 1 --2- 172.21.15.50:0/4176186633 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4a7c102370 0x7f4a7c19c430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:20.383 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:20.377+0000 7f4a84400640 1 -- 172.21.15.50:0/4176186633 >> 172.21.15.50:0/4176186633 conn(0x7f4a7c079500 msgr2=0x7f4a7c109ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:23:20.383 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:20.377+0000 7f4a84400640 1 -- 172.21.15.50:0/4176186633 shutdown_connections 2024-08-31T04:23:20.383 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:20.377+0000 7f4a84400640 1 -- 172.21.15.50:0/4176186633 wait complete. 2024-08-31T04:23:21.410 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 058d9fc6-674f-11ef-bcd4-c7b262605968 -- ceph tell mds.i status 2024-08-31T04:23:21.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:23:21 smithi050 ceph-mon[17259]: pgmap v380: 97 pgs: 97 active+clean; 660 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 2.5 KiB/s wr, 13 op/s 2024-08-31T04:23:21.788 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:23:21.996 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:23:21 smithi177 ceph-mon[22025]: pgmap v380: 97 pgs: 97 active+clean; 660 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 2.5 KiB/s wr, 13 op/s 2024-08-31T04:23:22.043 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:23:21 smithi133 ceph-mon[22177]: pgmap v380: 97 pgs: 97 active+clean; 660 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 2.5 KiB/s wr, 13 op/s 2024-08-31T04:23:22.430 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:22.428+0000 7f25d0600640 1 -- 172.21.15.50:0/559646955 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f25c8103920 msgr2=0x7f25c8103d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:23:22.430 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:22.428+0000 7f25d0600640 1 --2- 172.21.15.50:0/559646955 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f25c8103920 0x7f25c8103d30 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f25bc009900 tx=0x7f25bc02a410 comp rx=0 tx=0).stop 2024-08-31T04:23:22.430 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:22.428+0000 7f25d0600640 1 -- 172.21.15.50:0/559646955 shutdown_connections 2024-08-31T04:23:22.430 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:22.428+0000 7f25d0600640 1 --2- 172.21.15.50:0/559646955 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f25c8109bb0 0x7f25c81103e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:22.430 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:22.428+0000 7f25d0600640 1 --2- 172.21.15.50:0/559646955 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f25c8109260 0x7f25c8109670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:22.430 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:22.428+0000 7f25d0600640 1 --2- 172.21.15.50:0/559646955 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f25c8103920 0x7f25c8103d30 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:22.430 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:22.428+0000 7f25d0600640 1 -- 172.21.15.50:0/559646955 >> 172.21.15.50:0/559646955 conn(0x7f25c80ff370 msgr2=0x7f25c81017c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:23:22.430 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:22.428+0000 7f25d0600640 1 -- 172.21.15.50:0/559646955 shutdown_connections 2024-08-31T04:23:22.430 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:22.428+0000 7f25d0600640 1 -- 172.21.15.50:0/559646955 wait complete. 2024-08-31T04:23:22.431 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:22.429+0000 7f25d0600640 1 Processor -- start 2024-08-31T04:23:22.431 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:22.429+0000 7f25d0600640 1 -- start start 2024-08-31T04:23:22.431 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:22.430+0000 7f25d0600640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f25c8103920 0x7f25c819a250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:22.431 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:22.430+0000 7f25d0600640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f25c8109260 0x7f25c819a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:22.431 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:22.430+0000 7f25d0600640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f25c8109bb0 0x7f25c819fa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:22.431 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:22.430+0000 7f25d0600640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f25c81138c0 con 0x7f25c8109bb0 2024-08-31T04:23:22.432 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:22.430+0000 7f25d0600640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f25c8113740 con 0x7f25c8109260 2024-08-31T04:23:22.432 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:22.430+0000 7f25d0600640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f25c8113a40 con 0x7f25c8103920 2024-08-31T04:23:22.433 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:22.430+0000 7f25ce600640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f25c8109bb0 0x7f25c819fa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:22.433 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:22.430+0000 7f25ce600640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f25c8109bb0 0x7f25c819fa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:37796/0 (socket says 172.21.15.50:37796) 2024-08-31T04:23:22.433 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:22.430+0000 7f25cdc00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f25c8103920 0x7f25c819a250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:22.433 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:22.430+0000 7f25ce600640 1 -- 172.21.15.50:0/460876471 learned_addr learned my addr 172.21.15.50:0/460876471 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:23:22.433 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:22.430+0000 7f25cd200640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f25c8109260 0x7f25c819a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:22.433 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:22.431+0000 7f25ce600640 1 -- 172.21.15.50:0/460876471 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f25c8103920 msgr2=0x7f25c819a250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:23:22.433 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:22.431+0000 7f25ce600640 1 --2- 172.21.15.50:0/460876471 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f25c8103920 0x7f25c819a250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:22.433 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:22.431+0000 7f25ce600640 1 -- 172.21.15.50:0/460876471 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f25c8109260 msgr2=0x7f25c819a7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:23:22.433 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:22.431+0000 7f25ce600640 1 --2- 172.21.15.50:0/460876471 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f25c8109260 0x7f25c819a7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:22.433 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:22.431+0000 7f25ce600640 1 -- 172.21.15.50:0/460876471 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25c81a01c0 con 0x7f25c8109bb0 2024-08-31T04:23:22.433 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:22.431+0000 7f25cd200640 1 --2- 172.21.15.50:0/460876471 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f25c8109260 0x7f25c819a7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:23:22.433 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:22.431+0000 7f25ce600640 1 --2- 172.21.15.50:0/460876471 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f25c8109bb0 0x7f25c819fa90 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f25c000eaa0 tx=0x7f25c000ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:23:22.434 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:22.431+0000 7f25c6000640 1 -- 172.21.15.50:0/460876471 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25c000cdb0 con 0x7f25c8109bb0 2024-08-31T04:23:22.434 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:22.432+0000 7f25c6000640 1 -- 172.21.15.50:0/460876471 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f25c0005020 con 0x7f25c8109bb0 2024-08-31T04:23:22.434 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:22.432+0000 7f25d0600640 1 -- 172.21.15.50:0/460876471 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f25c81a04b0 con 0x7f25c8109bb0 2024-08-31T04:23:22.434 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:22.432+0000 7f25c6000640 1 -- 172.21.15.50:0/460876471 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25c00116d0 con 0x7f25c8109bb0 2024-08-31T04:23:22.434 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:22.432+0000 7f25d0600640 1 -- 172.21.15.50:0/460876471 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f25c81a6c10 con 0x7f25c8109bb0 2024-08-31T04:23:22.436 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:22.435+0000 7f25d72cc740 1 Processor -- start 2024-08-31T04:23:22.437 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:22.436+0000 7f25c6000640 1 -- 172.21.15.50:0/460876471 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 18) ==== 152577+0+0 (secure 0 0 0) 0x7f25c00051d0 con 0x7f25c8109bb0 2024-08-31T04:23:22.437 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:22.436+0000 7f25d72cc740 1 -- start start 2024-08-31T04:23:22.438 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:22.436+0000 7f25d72cc740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5571ad85af60 0x5571adc008f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:22.438 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:22.436+0000 7f25d72cc740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5571ad8320a0 0x5571adc00e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:22.438 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:22.436+0000 7f25d72cc740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5571ad83a280 0x5571adc01370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:22.438 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:22.436+0000 7f25d72cc740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x5571adb77550 con 0x5571ad83a280 2024-08-31T04:23:22.438 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:22.436+0000 7f25d72cc740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x5571adb66ae0 con 0x5571ad8320a0 2024-08-31T04:23:22.438 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:22.436+0000 7f25d72cc740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x5571adb6aa90 con 0x5571ad85af60 2024-08-31T04:23:22.438 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:22.437+0000 7f25cd200640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5571ad85af60 0x5571adc008f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:22.438 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:22.437+0000 7f25cdc00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5571ad8320a0 0x5571adc00e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:22.439 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:22.437+0000 7f25cdc00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5571ad8320a0 0x5571adc00e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.50:48058/0 (socket says 172.21.15.50:48058) 2024-08-31T04:23:22.439 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:22.437+0000 7f25cdc00640 1 -- 172.21.15.50:0/1983887134 learned_addr learned my addr 172.21.15.50:0/1983887134 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:23:22.439 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:22.437+0000 7f25cd200640 1 --2- 172.21.15.50:0/1983887134 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5571ad83a280 0x5571adc01370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:22.440 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:22.437+0000 7f25cdc00640 1 -- 172.21.15.50:0/1983887134 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5571ad85af60 msgr2=0x5571adc008f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:23:22.440 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:22.437+0000 7f25cdc00640 1 --2- 172.21.15.50:0/1983887134 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5571ad85af60 0x5571adc008f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:22.440 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:22.437+0000 7f25cdc00640 1 -- 172.21.15.50:0/1983887134 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5571ad83a280 msgr2=0x5571adc01370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:23:22.440 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:22.437+0000 7f25cdc00640 1 --2- 172.21.15.50:0/1983887134 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5571ad83a280 0x5571adc01370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:22.440 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:22.437+0000 7f25cdc00640 1 -- 172.21.15.50:0/1983887134 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5571ad8c6540 con 0x5571ad8320a0 2024-08-31T04:23:22.440 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:22.438+0000 7f25cdc00640 1 --2- 172.21.15.50:0/1983887134 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5571ad8320a0 0x5571adc00e30 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f25bc009230 tx=0x7f25bc004170 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ef8affe45f23ad66 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:23:22.440 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:22.438+0000 7f25baa00640 1 -- 172.21.15.50:0/1983887134 <== mon.2 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25bc035040 con 0x5571ad8320a0 2024-08-31T04:23:22.440 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:22.438+0000 7f25baa00640 1 -- 172.21.15.50:0/1983887134 <== mon.2 v2:172.21.15.133:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f25bc0054f0 con 0x5571ad8320a0 2024-08-31T04:23:22.440 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:22.438+0000 7f25baa00640 1 -- 172.21.15.50:0/1983887134 <== mon.2 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25bc0035f0 con 0x5571ad8320a0 2024-08-31T04:23:22.440 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:22.438+0000 7f25c6000640 1 --2- 172.21.15.50:0/460876471 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f25b00b4bb0 0x7f25b00b70c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:22.441 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:22.439+0000 7f25c6000640 1 -- 172.21.15.50:0/460876471 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8219+0+0 (secure 0 0 0) 0x7f25c00e52c0 con 0x7f25c8109bb0 2024-08-31T04:23:22.441 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:22.439+0000 7f25cd200640 1 --2- 172.21.15.50:0/460876471 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f25b00b4bb0 0x7f25b00b70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:22.442 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:22.439+0000 7f25d72cc740 1 -- 172.21.15.50:0/1983887134 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5571ad8320a0 msgr2=0x5571adc00e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:23:22.442 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:22.439+0000 7f25d72cc740 1 --2- 172.21.15.50:0/1983887134 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5571ad8320a0 0x5571adc00e30 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f25bc009230 tx=0x7f25bc004170 comp rx=0 tx=0).stop 2024-08-31T04:23:22.443 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:22.439+0000 7f25d72cc740 1 -- 172.21.15.50:0/1983887134 shutdown_connections 2024-08-31T04:23:22.443 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:22.439+0000 7f25d72cc740 1 --2- 172.21.15.50:0/1983887134 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5571ad83a280 0x5571adc01370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:22.443 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:22.439+0000 7f25d72cc740 1 --2- 172.21.15.50:0/1983887134 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5571ad8320a0 0x5571adc00e30 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:22.443 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:22.439+0000 7f25d72cc740 1 --2- 172.21.15.50:0/1983887134 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5571ad85af60 0x5571adc008f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:22.443 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:22.439+0000 7f25d72cc740 1 -- 172.21.15.50:0/1983887134 >> 172.21.15.50:0/1983887134 conn(0x5571ad84f350 msgr2=0x5571adbfe7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:23:22.443 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:22.439+0000 7f25d72cc740 1 -- 172.21.15.50:0/1983887134 shutdown_connections 2024-08-31T04:23:22.443 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:22.439+0000 7f25d72cc740 1 -- 172.21.15.50:0/1983887134 wait complete. 2024-08-31T04:23:22.443 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:22.439+0000 7f25cd200640 1 --2- 172.21.15.50:0/460876471 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f25b00b4bb0 0x7f25b00b70c0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f25b4009730 tx=0x7f25b401a040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:23:22.443 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:22.440+0000 7f25d72cc740 1 -- start start 2024-08-31T04:23:22.443 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:22.440+0000 7f25d72cc740 1 Processor -- start 2024-08-31T04:23:22.443 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:22.441+0000 7f25d72cc740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5571ad8320a0 0x5571adc0bfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:22.443 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:22.441+0000 7f25d72cc740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5571ad83a280 0x5571adc0c510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:22.443 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:22.441+0000 7f25d72cc740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5571ad85af60 0x5571adc18390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:22.443 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:22.441+0000 7f25d72cc740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x5571ad9c95f0 con 0x5571ad85af60 2024-08-31T04:23:22.444 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:22.441+0000 7f25d72cc740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x5571adaedbd0 con 0x5571ad83a280 2024-08-31T04:23:22.444 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:22.441+0000 7f25d72cc740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x5571adc0f070 con 0x5571ad8320a0 2024-08-31T04:23:22.444 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:22.441+0000 7f25d72cc740 10 client.0 _ll_register_callbacks cb 0x5571adb13210 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:23:22.444 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:22.441+0000 7f25cdc00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5571ad8320a0 0x5571adc0bfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:22.444 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:22.441+0000 7f25cdc00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5571ad8320a0 0x5571adc0bfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.50:51384/0 (socket says 172.21.15.50:51384) 2024-08-31T04:23:22.444 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:22.441+0000 7f25cdc00640 1 -- 172.21.15.50:0/1659988790 learned_addr learned my addr 172.21.15.50:0/1659988790 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:23:22.444 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:22.441+0000 7f25cd200640 1 --2- 172.21.15.50:0/1659988790 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5571ad83a280 0x5571adc0c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:22.444 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:22.441+0000 7f25ce600640 1 --2- 172.21.15.50:0/1659988790 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5571ad85af60 0x5571adc18390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:22.446 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:22.442+0000 7f25cdc00640 1 -- 172.21.15.50:0/1659988790 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5571ad83a280 msgr2=0x5571adc0c510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:23:22.446 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:22.442+0000 7f25cdc00640 1 --2- 172.21.15.50:0/1659988790 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5571ad83a280 0x5571adc0c510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:22.446 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:22.442+0000 7f25cdc00640 1 -- 172.21.15.50:0/1659988790 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5571ad85af60 msgr2=0x5571adc18390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:23:22.446 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:22.442+0000 7f25cdc00640 1 --2- 172.21.15.50:0/1659988790 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5571ad85af60 0x5571adc18390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:22.446 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:22.442+0000 7f25cdc00640 1 -- 172.21.15.50:0/1659988790 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5571adb2e650 con 0x5571ad8320a0 2024-08-31T04:23:22.446 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:22.442+0000 7f25ce600640 1 --2- 172.21.15.50:0/1659988790 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5571ad85af60 0x5571adc18390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:23:22.446 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:22.442+0000 7f25cdc00640 1 --2- 172.21.15.50:0/1659988790 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5571ad8320a0 0x5571adc0bfd0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f25bc02a930 tx=0x7f25bc02a410 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8e746eba42538d6e server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:23:22.446 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:22.442+0000 7f25af400640 10 client.0 ms_handle_connect on v2:172.21.15.177:3300/0 2024-08-31T04:23:22.446 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:22.442+0000 7f25af400640 1 -- 172.21.15.50:0/1659988790 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25bc053060 con 0x5571ad8320a0 2024-08-31T04:23:22.447 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:22.442+0000 7f25d72cc740 1 -- 172.21.15.50:0/1659988790 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f25bc0054f0 con 0x5571ad8320a0 2024-08-31T04:23:22.447 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:22.442+0000 7f25af400640 1 -- 172.21.15.50:0/1659988790 <== mon.1 v2:172.21.15.177:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8219+0+0 (secure 0 0 0) 0x7f25bc004980 con 0x5571ad8320a0 2024-08-31T04:23:22.447 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:22.443+0000 7f25af400640 1 -- 172.21.15.50:0/1659988790 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f25bc035050 con 0x5571ad8320a0 2024-08-31T04:23:22.447 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:22.443+0000 7f25d72cc740 10 client.25396 fetch_fsmap learned FSMap version 29 2024-08-31T04:23:22.447 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:22.443+0000 7f25d72cc740 1 -- 172.21.15.50:0/1659988790 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5571adc1ade0 con 0x5571ad8320a0 2024-08-31T04:23:22.447 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:22.443+0000 7f25af400640 1 -- 172.21.15.50:0/1659988790 <== mon.1 v2:172.21.15.177:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f25bc0054f0 con 0x5571ad8320a0 2024-08-31T04:23:22.447 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:22.443+0000 7f25af400640 1 -- 172.21.15.50:0/1659988790 <== mon.1 v2:172.21.15.177:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f25bc003a80 con 0x5571ad8320a0 2024-08-31T04:23:22.447 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:22.443+0000 7f25d72cc740 10 client.25396 fetch_fsmap finished waiting for FSMap version 29 2024-08-31T04:23:22.447 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:22.443+0000 7f25d72cc740 10 client.25396 resolve_mds: resolved name 'i' to daemon mds.i 2024-08-31T04:23:22.447 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:22.443+0000 7f25d72cc740 20 client.25396 populate_metadata read hostname 'smithi050' 2024-08-31T04:23:22.447 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:22.443+0000 7f25d72cc740 1 --2- 172.21.15.50:0/1659988790 >> [v2:172.21.15.177:6838/3600081752,v1:172.21.15.177:6839/3600081752] conn(0x5571ad8198e0 0x5571adc1e3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:22.447 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:22.443+0000 7f25d72cc740 4 client.25396 mds_command: new command op to 24667 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T04:23:22.447 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:22.443+0000 7f25d72cc740 1 -- 172.21.15.50:0/1659988790 --> [v2:172.21.15.177:6838/3600081752,v1:172.21.15.177:6839/3600081752] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5571adb794a0 con 0x5571ad8198e0 2024-08-31T04:23:22.447 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:22.444+0000 7f25cd200640 1 --2- 172.21.15.50:0/1659988790 >> [v2:172.21.15.177:6838/3600081752,v1:172.21.15.177:6839/3600081752] conn(0x5571ad8198e0 0x5571adc1e3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:22.448 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:22.444+0000 7f25cd200640 1 --2- 172.21.15.50:0/1659988790 >> [v2:172.21.15.177:6838/3600081752,v1:172.21.15.177:6839/3600081752] conn(0x5571ad8198e0 0x5571adc1e3a0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=ad35913ffad27b5c server_cookie=f57d1cf3fbff087a in_seq=0 out_seq=0 2024-08-31T04:23:22.448 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:22.444+0000 7f25af400640 10 client.25396 ms_handle_connect on v2:172.21.15.177:6838/3600081752 2024-08-31T04:23:22.449 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:22.445+0000 7f25af400640 1 -- 172.21.15.50:0/1659988790 <== mds.2 v2:172.21.15.177:6838/3600081752 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5571adb794a0 con 0x5571ad8198e0 2024-08-31T04:23:22.449 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:22.445+0000 7f25af400640 10 client.25396 handle_command_reply: tid=0 2024-08-31T04:23:22.449 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:22.445+0000 7f25d72cc740 1 client.25396 shutdown 2024-08-31T04:23:22.449 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:22.445+0000 7f25d72cc740 1 -- 172.21.15.50:0/1659988790 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5571ad8320a0 msgr2=0x5571adc0bfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:23:22.449 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:22.445+0000 7f25d72cc740 1 --2- 172.21.15.50:0/1659988790 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5571ad8320a0 0x5571adc0bfd0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f25bc02a930 tx=0x7f25bc02a410 comp rx=0 tx=0).stop 2024-08-31T04:23:22.449 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:22.446+0000 7f25d72cc740 1 -- 172.21.15.50:0/1659988790 shutdown_connections 2024-08-31T04:23:22.449 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:22.446+0000 7f25d72cc740 1 --2- 172.21.15.50:0/1659988790 >> [v2:172.21.15.177:6838/3600081752,v1:172.21.15.177:6839/3600081752] conn(0x5571ad8198e0 0x5571adc1e3a0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:22.449 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:22.446+0000 7f25d72cc740 1 --2- 172.21.15.50:0/1659988790 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5571ad85af60 0x5571adc18390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:22.449 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:22.446+0000 7f25d72cc740 1 --2- 172.21.15.50:0/1659988790 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5571ad83a280 0x5571adc0c510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:22.449 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:22.446+0000 7f25d72cc740 1 --2- 172.21.15.50:0/1659988790 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5571ad8320a0 0x5571adc0bfd0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:22.449 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:22.446+0000 7f25af400640 0 client.25396 ms_handle_reset on v2:172.21.15.177:6838/3600081752 2024-08-31T04:23:22.450 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:22.446+0000 7f25d72cc740 1 -- 172.21.15.50:0/1659988790 >> 172.21.15.50:0/1659988790 conn(0x5571ad84f350 msgr2=0x5571adc03a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:23:22.450 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:22.446+0000 7f25d72cc740 1 -- 172.21.15.50:0/1659988790 shutdown_connections 2024-08-31T04:23:22.450 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:22.446+0000 7f25d72cc740 1 -- 172.21.15.50:0/1659988790 wait complete. 2024-08-31T04:23:22.450 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:22.446+0000 7f25d72cc740 20 client.25396 trim_cache size 0 max 16384 2024-08-31T04:23:22.466 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:22.465+0000 7f25d72cc740 1 Processor -- start 2024-08-31T04:23:22.466 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:22.465+0000 7f25d72cc740 1 -- start start 2024-08-31T04:23:22.467 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:22.465+0000 7f25d72cc740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5571ad8320a0 0x5571adc0c490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:22.467 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:22.465+0000 7f25d72cc740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5571ad83a280 0x5571adc18300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:22.467 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:22.465+0000 7f25d72cc740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5571ad85af60 0x5571adc039f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:22.467 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:22.465+0000 7f25d72cc740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x5571adc1c6e0 con 0x5571ad83a280 2024-08-31T04:23:22.467 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:22.465+0000 7f25d72cc740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x5571adc1cdb0 con 0x5571ad8320a0 2024-08-31T04:23:22.467 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:22.465+0000 7f25d72cc740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x5571adc1d480 con 0x5571ad85af60 2024-08-31T04:23:22.467 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:22.466+0000 7f25cd200640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5571ad83a280 0x5571adc18300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:22.468 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:22.466+0000 7f25cdc00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5571ad8320a0 0x5571adc0c490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:22.468 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:22.466+0000 7f25cdc00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5571ad8320a0 0x5571adc0c490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.50:48080/0 (socket says 172.21.15.50:48080) 2024-08-31T04:23:22.468 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:22.466+0000 7f25cdc00640 1 -- 172.21.15.50:0/465116814 learned_addr learned my addr 172.21.15.50:0/465116814 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:23:22.468 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:22.466+0000 7f25ce600640 1 --2- 172.21.15.50:0/465116814 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5571ad85af60 0x5571adc039f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:22.469 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:22.466+0000 7f25cdc00640 1 -- 172.21.15.50:0/465116814 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5571ad85af60 msgr2=0x5571adc039f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:23:22.469 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:22.466+0000 7f25cdc00640 1 --2- 172.21.15.50:0/465116814 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5571ad85af60 0x5571adc039f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:22.469 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:22.466+0000 7f25cdc00640 1 -- 172.21.15.50:0/465116814 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5571ad83a280 msgr2=0x5571adc18300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:23:22.469 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:22.466+0000 7f25cdc00640 1 --2- 172.21.15.50:0/465116814 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5571ad83a280 0x5571adc18300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:22.469 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:22.466+0000 7f25cdc00640 1 -- 172.21.15.50:0/465116814 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5571adc02be0 con 0x5571ad8320a0 2024-08-31T04:23:22.469 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:22.466+0000 7f25cd200640 1 --2- 172.21.15.50:0/465116814 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5571ad83a280 0x5571adc18300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:23:22.470 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:22.467+0000 7f25cdc00640 1 --2- 172.21.15.50:0/465116814 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5571ad8320a0 0x5571adc0c490 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f25bc02aa00 tx=0x7f25bc005a20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c8a32b537e599eee server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:23:22.470 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:22.467+0000 7f25ba000640 1 -- 172.21.15.50:0/465116814 <== mon.2 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25bc05d070 con 0x5571ad8320a0 2024-08-31T04:23:22.470 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:22.467+0000 7f25ba000640 1 -- 172.21.15.50:0/465116814 <== mon.2 v2:172.21.15.133:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f25bc003aa0 con 0x5571ad8320a0 2024-08-31T04:23:22.470 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:22.467+0000 7f25ba000640 1 -- 172.21.15.50:0/465116814 <== mon.2 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25bc053040 con 0x5571ad8320a0 2024-08-31T04:23:22.470 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:22.468+0000 7f25d72cc740 1 -- 172.21.15.50:0/465116814 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5571ad8320a0 msgr2=0x5571adc0c490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:23:22.470 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:22.468+0000 7f25d72cc740 1 --2- 172.21.15.50:0/465116814 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5571ad8320a0 0x5571adc0c490 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f25bc02aa00 tx=0x7f25bc005a20 comp rx=0 tx=0).stop 2024-08-31T04:23:22.470 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:22.468+0000 7f25d72cc740 1 -- 172.21.15.50:0/465116814 shutdown_connections 2024-08-31T04:23:22.470 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:22.468+0000 7f25d72cc740 1 --2- 172.21.15.50:0/465116814 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5571ad85af60 0x5571adc039f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:22.470 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:22.468+0000 7f25d72cc740 1 --2- 172.21.15.50:0/465116814 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5571ad83a280 0x5571adc18300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:22.470 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:22.468+0000 7f25d72cc740 1 --2- 172.21.15.50:0/465116814 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5571ad8320a0 0x5571adc0c490 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:22.470 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:22.468+0000 7f25d72cc740 1 -- 172.21.15.50:0/465116814 >> 172.21.15.50:0/465116814 conn(0x5571ad84f350 msgr2=0x5571adc0bd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:23:22.470 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:22.468+0000 7f25d72cc740 1 -- 172.21.15.50:0/465116814 shutdown_connections 2024-08-31T04:23:22.470 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:22.468+0000 7f25d72cc740 1 -- 172.21.15.50:0/465116814 wait complete. 2024-08-31T04:23:22.472 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:22.468+0000 7f25d72cc740 1 -- start start 2024-08-31T04:23:22.472 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:22.469+0000 7f25d72cc740 1 Processor -- start 2024-08-31T04:23:22.472 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:22.469+0000 7f25d72cc740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5571ad8320a0 0x5571adc206f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:22.473 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:22.469+0000 7f25d72cc740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5571ad83a280 0x5571adc20c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:22.473 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:22.469+0000 7f25d72cc740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5571ad85af60 0x5571adc21170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:22.473 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:22.469+0000 7f25d72cc740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x5571adc1e220 con 0x5571ad8320a0 2024-08-31T04:23:22.473 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:22.469+0000 7f25d72cc740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x5571adc1db50 con 0x5571ad83a280 2024-08-31T04:23:22.473 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:22.469+0000 7f25d72cc740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x5571adc1e8f0 con 0x5571ad85af60 2024-08-31T04:23:22.473 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:22.469+0000 7f25d72cc740 10 client.0 _ll_register_callbacks cb 0x7f25bc004040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:23:22.473 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:22.469+0000 7f25cdc00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5571ad8320a0 0x5571adc206f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:22.473 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:22.469+0000 7f25cd200640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5571ad83a280 0x5571adc20c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:22.473 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:22.469+0000 7f25cd200640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5571ad83a280 0x5571adc20c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.50:48090/0 (socket says 172.21.15.50:48090) 2024-08-31T04:23:22.473 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:22.469+0000 7f25cdc00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5571ad8320a0 0x5571adc206f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:37836/0 (socket says 172.21.15.50:37836) 2024-08-31T04:23:22.473 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:22.469+0000 7f25cd200640 1 -- 172.21.15.50:0/1742812024 learned_addr learned my addr 172.21.15.50:0/1742812024 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:23:22.473 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:22.470+0000 7f25ce600640 1 --2- 172.21.15.50:0/1742812024 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5571ad85af60 0x5571adc21170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:22.474 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:22.470+0000 7f25cd200640 1 -- 172.21.15.50:0/1742812024 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5571ad85af60 msgr2=0x5571adc21170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:23:22.474 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:22.470+0000 7f25cd200640 1 --2- 172.21.15.50:0/1742812024 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5571ad85af60 0x5571adc21170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:22.474 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:22.470+0000 7f25cd200640 1 -- 172.21.15.50:0/1742812024 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5571ad8320a0 msgr2=0x5571adc206f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:23:22.474 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:22.470+0000 7f25cd200640 1 --2- 172.21.15.50:0/1742812024 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5571ad8320a0 0x5571adc206f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:22.474 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:22.470+0000 7f25cd200640 1 -- 172.21.15.50:0/1742812024 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5571adc25f50 con 0x5571ad83a280 2024-08-31T04:23:22.474 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:22.470+0000 7f25ce600640 1 --2- 172.21.15.50:0/1742812024 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5571ad85af60 0x5571adc21170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:23:22.474 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:22.470+0000 7f25cdc00640 1 --2- 172.21.15.50:0/1742812024 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5571ad8320a0 0x5571adc206f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:23:22.474 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:22.470+0000 7f25cd200640 1 --2- 172.21.15.50:0/1742812024 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5571ad83a280 0x5571adc20c30 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f25c806c520 tx=0x7f25b4004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7b24877e49e6aca0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:23:22.474 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:22.470+0000 7f25af400640 10 client.0 ms_handle_connect on v2:172.21.15.133:3300/0 2024-08-31T04:23:22.474 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:22.470+0000 7f25af400640 1 -- 172.21.15.50:0/1742812024 <== mon.2 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25b4003bc0 con 0x5571ad83a280 2024-08-31T04:23:22.474 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:22.470+0000 7f25d72cc740 1 -- 172.21.15.50:0/1742812024 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f25bc003aa0 con 0x5571ad83a280 2024-08-31T04:23:22.474 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:22.470+0000 7f25af400640 1 -- 172.21.15.50:0/1742812024 <== mon.2 v2:172.21.15.133:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8219+0+0 (secure 0 0 0) 0x7f25b4003d60 con 0x5571ad83a280 2024-08-31T04:23:22.474 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:22.471+0000 7f25af400640 1 -- 172.21.15.50:0/1742812024 <== mon.2 v2:172.21.15.133:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f25b403e050 con 0x5571ad83a280 2024-08-31T04:23:22.474 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:22.471+0000 7f25d72cc740 10 client.25388 fetch_fsmap learned FSMap version 29 2024-08-31T04:23:22.475 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:22.471+0000 7f25d72cc740 1 -- 172.21.15.50:0/1742812024 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5571adc89c40 con 0x5571ad83a280 2024-08-31T04:23:22.475 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:22.471+0000 7f25af400640 1 -- 172.21.15.50:0/1742812024 <== mon.2 v2:172.21.15.133:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f25bc003aa0 con 0x5571ad83a280 2024-08-31T04:23:22.475 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:22.471+0000 7f25af400640 1 -- 172.21.15.50:0/1742812024 <== mon.2 v2:172.21.15.133:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f25b4004c40 con 0x5571ad83a280 2024-08-31T04:23:22.475 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:22.471+0000 7f25d72cc740 10 client.25388 fetch_fsmap finished waiting for FSMap version 29 2024-08-31T04:23:22.476 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:22.471+0000 7f25d72cc740 10 client.25388 resolve_mds: resolved name 'i' to daemon mds.i 2024-08-31T04:23:22.476 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:22.471+0000 7f25d72cc740 20 client.25388 populate_metadata read hostname 'smithi050' 2024-08-31T04:23:22.476 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:22.471+0000 7f25d72cc740 1 --2- 172.21.15.50:0/1742812024 >> [v2:172.21.15.177:6838/3600081752,v1:172.21.15.177:6839/3600081752] conn(0x5571ad7eec90 0x5571adc8d550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:22.476 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:22.471+0000 7f25d72cc740 4 client.25388 mds_command: new command op to 24667 tid=0 multi_id=0 [{"prefix": "status"}] 2024-08-31T04:23:22.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:22.472+0000 7f25d72cc740 1 -- 172.21.15.50:0/1742812024 --> [v2:172.21.15.177:6838/3600081752,v1:172.21.15.177:6839/3600081752] -- command(tid 0: {"prefix": "status"}) -- 0x5571adb74f40 con 0x5571ad7eec90 2024-08-31T04:23:22.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:22.472+0000 7f25cdc00640 1 --2- 172.21.15.50:0/1742812024 >> [v2:172.21.15.177:6838/3600081752,v1:172.21.15.177:6839/3600081752] conn(0x5571ad7eec90 0x5571adc8d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:22.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:22.472+0000 7f25cdc00640 1 --2- 172.21.15.50:0/1742812024 >> [v2:172.21.15.177:6838/3600081752,v1:172.21.15.177:6839/3600081752] conn(0x5571ad7eec90 0x5571adc8d550 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=17ca4303e0c2c536 server_cookie=a65dcb94964c8e44 in_seq=0 out_seq=0 2024-08-31T04:23:22.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:22.472+0000 7f25af400640 10 client.25388 ms_handle_connect on v2:172.21.15.177:6838/3600081752 2024-08-31T04:23:22.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:22.473+0000 7f25af400640 1 -- 172.21.15.50:0/1742812024 <== mds.2 v2:172.21.15.177:6838/3600081752 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x5571adb74f40 con 0x5571ad7eec90 2024-08-31T04:23:22.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:22.473+0000 7f25af400640 10 client.25388 handle_command_reply: tid=0 2024-08-31T04:23:22.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:22.473+0000 7f25d72cc740 1 client.25388 shutdown 2024-08-31T04:23:22.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:22.473+0000 7f25d72cc740 1 -- 172.21.15.50:0/1742812024 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5571ad83a280 msgr2=0x5571adc20c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:23:22.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:22.473+0000 7f25d72cc740 1 --2- 172.21.15.50:0/1742812024 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5571ad83a280 0x5571adc20c30 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f25c806c520 tx=0x7f25b4004730 comp rx=0 tx=0).stop 2024-08-31T04:23:22.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:22.473+0000 7f25d72cc740 1 -- 172.21.15.50:0/1742812024 shutdown_connections 2024-08-31T04:23:22.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:22.473+0000 7f25d72cc740 1 --2- 172.21.15.50:0/1742812024 >> [v2:172.21.15.177:6838/3600081752,v1:172.21.15.177:6839/3600081752] conn(0x5571ad7eec90 0x5571adc8d550 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:22.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:22.473+0000 7f25d72cc740 1 --2- 172.21.15.50:0/1742812024 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5571ad85af60 0x5571adc21170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:22.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:22.473+0000 7f25d72cc740 1 --2- 172.21.15.50:0/1742812024 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5571ad83a280 0x5571adc20c30 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:22.478 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:22.473+0000 7f25d72cc740 1 --2- 172.21.15.50:0/1742812024 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5571ad8320a0 0x5571adc206f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:22.478 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:22.473+0000 7f25af400640 0 client.25388 ms_handle_reset on v2:172.21.15.177:6838/3600081752 2024-08-31T04:23:22.478 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:22.473+0000 7f25d72cc740 1 -- 172.21.15.50:0/1742812024 >> 172.21.15.50:0/1742812024 conn(0x5571ad84f350 msgr2=0x5571adc039b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:23:22.478 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:22.473+0000 7f25d72cc740 1 -- 172.21.15.50:0/1742812024 shutdown_connections 2024-08-31T04:23:22.478 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:22.473+0000 7f25d72cc740 1 -- 172.21.15.50:0/1742812024 wait complete. 2024-08-31T04:23:22.478 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:22.473+0000 7f25d72cc740 20 client.25388 trim_cache size 0 max 16384 2024-08-31T04:23:22.478 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-08-31T04:23:22.478 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_fsid": "058d9fc6-674f-11ef-bcd4-c7b262605968", 2024-08-31T04:23:22.478 INFO:teuthology.orchestra.run.smithi050.stdout: "whoami": 2, 2024-08-31T04:23:22.478 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 24667, 2024-08-31T04:23:22.479 INFO:teuthology.orchestra.run.smithi050.stdout: "want_state": "up:active", 2024-08-31T04:23:22.479 INFO:teuthology.orchestra.run.smithi050.stdout: "state": "up:active", 2024-08-31T04:23:22.479 INFO:teuthology.orchestra.run.smithi050.stdout: "fs_name": "cephfs", 2024-08-31T04:23:22.479 INFO:teuthology.orchestra.run.smithi050.stdout: "rank_uptime": 147.484812401, 2024-08-31T04:23:22.479 INFO:teuthology.orchestra.run.smithi050.stdout: "mdsmap_epoch": 29, 2024-08-31T04:23:22.479 INFO:teuthology.orchestra.run.smithi050.stdout: "osdmap_epoch": 78, 2024-08-31T04:23:22.479 INFO:teuthology.orchestra.run.smithi050.stdout: "osdmap_epoch_barrier": 78, 2024-08-31T04:23:22.479 INFO:teuthology.orchestra.run.smithi050.stdout: "uptime": 181.75687346199999 2024-08-31T04:23:22.479 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-08-31T04:23:22.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:22.474+0000 7f25d0600640 1 -- 172.21.15.50:0/460876471 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f25b00b4bb0 msgr2=0x7f25b00b70c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:23:22.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:22.474+0000 7f25d0600640 1 --2- 172.21.15.50:0/460876471 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f25b00b4bb0 0x7f25b00b70c0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f25b4009730 tx=0x7f25b401a040 comp rx=0 tx=0).stop 2024-08-31T04:23:22.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:22.474+0000 7f25d0600640 1 -- 172.21.15.50:0/460876471 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f25c8109bb0 msgr2=0x7f25c819fa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:23:22.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:22.474+0000 7f25d0600640 1 --2- 172.21.15.50:0/460876471 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f25c8109bb0 0x7f25c819fa90 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f25c000eaa0 tx=0x7f25c000ef60 comp rx=0 tx=0).stop 2024-08-31T04:23:22.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:22.474+0000 7f25d0600640 1 -- 172.21.15.50:0/460876471 shutdown_connections 2024-08-31T04:23:22.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:22.474+0000 7f25d0600640 1 --2- 172.21.15.50:0/460876471 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f25b00b4bb0 0x7f25b00b70c0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:22.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:22.474+0000 7f25d0600640 1 --2- 172.21.15.50:0/460876471 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f25c8109bb0 0x7f25c819fa90 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:22.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:22.474+0000 7f25d0600640 1 --2- 172.21.15.50:0/460876471 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f25c8109260 0x7f25c819a7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:22.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:22.474+0000 7f25d0600640 1 --2- 172.21.15.50:0/460876471 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f25c8103920 0x7f25c819a250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:22.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:22.474+0000 7f25d0600640 1 -- 172.21.15.50:0/460876471 >> 172.21.15.50:0/460876471 conn(0x7f25c80ff370 msgr2=0x7f25c8101790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:23:22.480 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:22.474+0000 7f25d0600640 1 -- 172.21.15.50:0/460876471 shutdown_connections 2024-08-31T04:23:22.481 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:22.474+0000 7f25d0600640 1 -- 172.21.15.50:0/460876471 wait complete. 2024-08-31T04:23:23.276 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 058d9fc6-674f-11ef-bcd4-c7b262605968 -- ceph tell mds.a status 2024-08-31T04:23:23.655 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:23:23.950 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:23:23 smithi050 ceph-mon[17259]: pgmap v381: 97 pgs: 97 active+clean; 660 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 2.7 KiB/s wr, 17 op/s 2024-08-31T04:23:23.996 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:23:23 smithi177 ceph-mon[22025]: pgmap v381: 97 pgs: 97 active+clean; 660 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 2.7 KiB/s wr, 17 op/s 2024-08-31T04:23:24.043 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:23:23 smithi133 ceph-mon[22177]: pgmap v381: 97 pgs: 97 active+clean; 660 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 2.7 KiB/s wr, 17 op/s 2024-08-31T04:23:24.281 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:24.279+0000 7f9488e00640 1 -- 172.21.15.50:0/3786173554 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9484108ab0 msgr2=0x7f948410f2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:23:24.281 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:24.279+0000 7f9488e00640 1 --2- 172.21.15.50:0/3786173554 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9484108ab0 0x7f948410f2e0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f947c009ca0 tx=0x7f947c02a8c0 comp rx=0 tx=0).stop 2024-08-31T04:23:24.281 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:24.279+0000 7f9488e00640 1 -- 172.21.15.50:0/3786173554 shutdown_connections 2024-08-31T04:23:24.281 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:24.279+0000 7f9488e00640 1 --2- 172.21.15.50:0/3786173554 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9484108160 0x7f9484108570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:24.281 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:24.279+0000 7f9488e00640 1 --2- 172.21.15.50:0/3786173554 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9484108ab0 0x7f948410f2e0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:24.281 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:24.279+0000 7f9488e00640 1 --2- 172.21.15.50:0/3786173554 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9484102820 0x7f9484102c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:24.281 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:24.279+0000 7f9488e00640 1 -- 172.21.15.50:0/3786173554 >> 172.21.15.50:0/3786173554 conn(0x7f94840794e0 msgr2=0x7f94840798f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:23:24.281 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:24.279+0000 7f9488e00640 1 -- 172.21.15.50:0/3786173554 shutdown_connections 2024-08-31T04:23:24.281 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:24.279+0000 7f9488e00640 1 -- 172.21.15.50:0/3786173554 wait complete. 2024-08-31T04:23:24.282 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:24.281+0000 7f9488e00640 1 Processor -- start 2024-08-31T04:23:24.282 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:24.281+0000 7f9488e00640 1 -- start start 2024-08-31T04:23:24.282 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:24.281+0000 7f9488e00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9484102820 0x7f948419c400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:24.282 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:24.281+0000 7f9488e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9484108160 0x7f948419c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:24.283 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:24.281+0000 7f9488e00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9484108ab0 0x7f94841a1c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:24.283 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:24.281+0000 7f9488e00640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f9484112730 con 0x7f9484108160 2024-08-31T04:23:24.283 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:24.281+0000 7f9488e00640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f94841125b0 con 0x7f9484108ab0 2024-08-31T04:23:24.283 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:24.281+0000 7f9488e00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f94841128b0 con 0x7f9484102820 2024-08-31T04:23:24.283 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:24.282+0000 7f9481e00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9484102820 0x7f948419c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:24.283 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:24.282+0000 7f9481e00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9484102820 0x7f948419c400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.50:33812/0 (socket says 172.21.15.50:33812) 2024-08-31T04:23:24.283 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:24.282+0000 7f9481e00640 1 -- 172.21.15.50:0/2435381217 learned_addr learned my addr 172.21.15.50:0/2435381217 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:23:24.284 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:24.282+0000 7f9482800640 1 --2- 172.21.15.50:0/2435381217 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9484108ab0 0x7f94841a1c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:24.284 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:24.282+0000 7f9481400640 1 --2- 172.21.15.50:0/2435381217 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9484108160 0x7f948419c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:24.284 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:24.282+0000 7f9481e00640 1 -- 172.21.15.50:0/2435381217 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9484108ab0 msgr2=0x7f94841a1c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:23:24.285 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:24.282+0000 7f9481e00640 1 --2- 172.21.15.50:0/2435381217 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9484108ab0 0x7f94841a1c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:24.285 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:24.282+0000 7f9481e00640 1 -- 172.21.15.50:0/2435381217 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9484108160 msgr2=0x7f948419c9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:23:24.285 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:24.282+0000 7f9481e00640 1 --2- 172.21.15.50:0/2435381217 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9484108160 0x7f948419c9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:24.285 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:24.282+0000 7f9481e00640 1 -- 172.21.15.50:0/2435381217 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94841a2370 con 0x7f9484102820 2024-08-31T04:23:24.285 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:24.283+0000 7f9481e00640 1 --2- 172.21.15.50:0/2435381217 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9484102820 0x7f948419c400 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f947400e9f0 tx=0x7f947400eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:23:24.285 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:24.283+0000 7f947aa00640 1 -- 172.21.15.50:0/2435381217 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f947400cd80 con 0x7f9484102820 2024-08-31T04:23:24.285 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:24.283+0000 7f947aa00640 1 -- 172.21.15.50:0/2435381217 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f94740108e0 con 0x7f9484102820 2024-08-31T04:23:24.285 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:24.283+0000 7f9488e00640 1 -- 172.21.15.50:0/2435381217 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f94841a2660 con 0x7f9484102820 2024-08-31T04:23:24.285 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:24.283+0000 7f9488e00640 1 -- 172.21.15.50:0/2435381217 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f94841a8dc0 con 0x7f9484102820 2024-08-31T04:23:24.285 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:24.283+0000 7f947aa00640 1 -- 172.21.15.50:0/2435381217 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9474018980 con 0x7f9484102820 2024-08-31T04:23:24.287 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:24.286+0000 7f948fa00740 1 Processor -- start 2024-08-31T04:23:24.287 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:24.286+0000 7f948fa00740 1 -- start start 2024-08-31T04:23:24.288 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:24.287+0000 7f948fa00740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5590e1901f60 0x5590e1ca78f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:24.289 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:24.287+0000 7f948fa00740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5590e18d90a0 0x5590e1ca7e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:24.289 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:24.287+0000 7f948fa00740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5590e18e1280 0x5590e1ca8370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:24.289 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:24.287+0000 7f948fa00740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x5590e1c1e550 con 0x5590e1901f60 2024-08-31T04:23:24.289 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:24.287+0000 7f948fa00740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x5590e1c0dae0 con 0x5590e18e1280 2024-08-31T04:23:24.289 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:24.287+0000 7f948fa00740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x5590e1c11a90 con 0x5590e18d90a0 2024-08-31T04:23:24.289 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:24.287+0000 7f947aa00640 1 -- 172.21.15.50:0/2435381217 <== mon.1 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 18) ==== 152577+0+0 (secure 0 0 0) 0x7f9474018b20 con 0x7f9484102820 2024-08-31T04:23:24.289 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:24.287+0000 7f9481400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5590e18e1280 0x5590e1ca8370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:24.289 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:24.287+0000 7f9481400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5590e18e1280 0x5590e1ca8370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.50:47312/0 (socket says 172.21.15.50:47312) 2024-08-31T04:23:24.289 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:24.287+0000 7f9481400640 1 -- 172.21.15.50:0/766203188 learned_addr learned my addr 172.21.15.50:0/766203188 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:23:24.289 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:24.287+0000 7f9482800640 1 --2- 172.21.15.50:0/766203188 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5590e1901f60 0x5590e1ca78f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:24.290 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:24.287+0000 7f9481e00640 1 --2- 172.21.15.50:0/766203188 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5590e18d90a0 0x5590e1ca7e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:24.291 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:24.287+0000 7f9481400640 1 -- 172.21.15.50:0/766203188 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5590e18d90a0 msgr2=0x5590e1ca7e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:23:24.291 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:24.287+0000 7f9481400640 1 --2- 172.21.15.50:0/766203188 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5590e18d90a0 0x5590e1ca7e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:24.291 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:24.287+0000 7f9481400640 1 -- 172.21.15.50:0/766203188 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5590e1901f60 msgr2=0x5590e1ca78f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:23:24.291 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:24.287+0000 7f9481400640 1 --2- 172.21.15.50:0/766203188 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5590e1901f60 0x5590e1ca78f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:24.292 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:24.288+0000 7f9481400640 1 -- 172.21.15.50:0/766203188 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5590e196d540 con 0x5590e18e1280 2024-08-31T04:23:24.292 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:24.288+0000 7f9481400640 1 --2- 172.21.15.50:0/766203188 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5590e18e1280 0x5590e1ca8370 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f9470009c60 tx=0x7f9470011810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=95b36a61954f09c8 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:23:24.292 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:24.288+0000 7f946f400640 1 -- 172.21.15.50:0/766203188 <== mon.2 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9470004230 con 0x5590e18e1280 2024-08-31T04:23:24.292 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:24.288+0000 7f946f400640 1 -- 172.21.15.50:0/766203188 <== mon.2 v2:172.21.15.133:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f94700043d0 con 0x5590e18e1280 2024-08-31T04:23:24.292 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:24.288+0000 7f946f400640 1 -- 172.21.15.50:0/766203188 <== mon.2 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94700196d0 con 0x5590e18e1280 2024-08-31T04:23:24.292 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:24.289+0000 7f947aa00640 1 --2- 172.21.15.50:0/2435381217 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f94680b4bb0 0x7f94680b70c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:24.292 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:24.289+0000 7f947aa00640 1 -- 172.21.15.50:0/2435381217 <== mon.1 v2:172.21.15.177:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8219+0+0 (secure 0 0 0) 0x7f94740e5250 con 0x7f9484102820 2024-08-31T04:23:24.292 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:24.289+0000 7f9482800640 1 --2- 172.21.15.50:0/2435381217 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f94680b4bb0 0x7f94680b70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:24.292 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:24.289+0000 7f948fa00740 1 -- 172.21.15.50:0/766203188 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5590e18e1280 msgr2=0x5590e1ca8370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:23:24.292 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:24.289+0000 7f948fa00740 1 --2- 172.21.15.50:0/766203188 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5590e18e1280 0x5590e1ca8370 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f9470009c60 tx=0x7f9470011810 comp rx=0 tx=0).stop 2024-08-31T04:23:24.292 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:24.289+0000 7f948fa00740 1 -- 172.21.15.50:0/766203188 shutdown_connections 2024-08-31T04:23:24.292 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:24.289+0000 7f948fa00740 1 --2- 172.21.15.50:0/766203188 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5590e18d90a0 0x5590e1ca7e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:24.292 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:24.289+0000 7f948fa00740 1 --2- 172.21.15.50:0/766203188 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5590e18e1280 0x5590e1ca8370 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:24.293 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:24.289+0000 7f948fa00740 1 --2- 172.21.15.50:0/766203188 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5590e1901f60 0x5590e1ca78f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:24.293 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:24.289+0000 7f948fa00740 1 -- 172.21.15.50:0/766203188 >> 172.21.15.50:0/766203188 conn(0x5590e18f6350 msgr2=0x5590e1ca57e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:23:24.293 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:24.290+0000 7f948fa00740 1 -- 172.21.15.50:0/766203188 shutdown_connections 2024-08-31T04:23:24.293 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:24.290+0000 7f948fa00740 1 -- 172.21.15.50:0/766203188 wait complete. 2024-08-31T04:23:24.293 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:24.290+0000 7f9482800640 1 --2- 172.21.15.50:0/2435381217 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f94680b4bb0 0x7f94680b70c0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f947c02f500 tx=0x7f947c02f310 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:23:24.293 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:24.290+0000 7f948fa00740 1 -- start start 2024-08-31T04:23:24.295 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:24.291+0000 7f948fa00740 1 Processor -- start 2024-08-31T04:23:24.295 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:24.291+0000 7f948fa00740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5590e18d90a0 0x5590e1cb30a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:24.295 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:24.291+0000 7f948fa00740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5590e18e1280 0x5590e1cb35e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:24.295 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:24.291+0000 7f948fa00740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5590e1901f60 0x5590e1cbf450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:24.295 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:24.291+0000 7f948fa00740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x5590e1a705f0 con 0x5590e18e1280 2024-08-31T04:23:24.295 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:24.291+0000 7f948fa00740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x5590e1b94bd0 con 0x5590e1901f60 2024-08-31T04:23:24.295 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:24.291+0000 7f948fa00740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x5590e1cb60d0 con 0x5590e18d90a0 2024-08-31T04:23:24.296 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:24.291+0000 7f948fa00740 10 client.0 _ll_register_callbacks cb 0x5590e1bba210 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:23:24.296 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:24.291+0000 7f9481400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5590e18e1280 0x5590e1cb35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:24.296 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:24.291+0000 7f9481e00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5590e18d90a0 0x5590e1cb30a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:24.296 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:24.291+0000 7f9481e00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5590e18d90a0 0x5590e1cb30a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.50:33830/0 (socket says 172.21.15.50:33830) 2024-08-31T04:23:24.296 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:24.291+0000 7f9481e00640 1 -- 172.21.15.50:0/3091269541 learned_addr learned my addr 172.21.15.50:0/3091269541 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:23:24.296 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:24.291+0000 7f9482800640 1 --2- 172.21.15.50:0/3091269541 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5590e1901f60 0x5590e1cbf450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:24.296 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:24.292+0000 7f9481e00640 1 -- 172.21.15.50:0/3091269541 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5590e1901f60 msgr2=0x5590e1cbf450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:23:24.296 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:24.292+0000 7f9481e00640 1 --2- 172.21.15.50:0/3091269541 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5590e1901f60 0x5590e1cbf450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:24.296 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:24.292+0000 7f9481e00640 1 -- 172.21.15.50:0/3091269541 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5590e18e1280 msgr2=0x5590e1cb35e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:23:24.296 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:24.292+0000 7f9481e00640 1 --2- 172.21.15.50:0/3091269541 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5590e18e1280 0x5590e1cb35e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:24.296 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:24.292+0000 7f9481e00640 1 -- 172.21.15.50:0/3091269541 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5590e1bd5650 con 0x5590e18d90a0 2024-08-31T04:23:24.296 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:24.292+0000 7f9481400640 1 --2- 172.21.15.50:0/3091269541 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5590e18e1280 0x5590e1cb35e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:23:24.296 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:24.292+0000 7f9481e00640 1 --2- 172.21.15.50:0/3091269541 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5590e18d90a0 0x5590e1cb30a0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f94740a8f50 tx=0x7f94740ab6f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=729215485f1ffe39 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:23:24.297 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:24.292+0000 7f9463e00640 10 client.0 ms_handle_connect on v2:172.21.15.177:3300/0 2024-08-31T04:23:24.297 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:24.292+0000 7f9463e00640 1 -- 172.21.15.50:0/3091269541 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94740abce0 con 0x5590e18d90a0 2024-08-31T04:23:24.297 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:24.292+0000 7f9463e00640 1 -- 172.21.15.50:0/3091269541 <== mon.1 v2:172.21.15.177:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8219+0+0 (secure 0 0 0) 0x7f9474010430 con 0x5590e18d90a0 2024-08-31T04:23:24.297 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:24.292+0000 7f948fa00740 1 -- 172.21.15.50:0/3091269541 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f94700043d0 con 0x5590e18d90a0 2024-08-31T04:23:24.297 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:24.293+0000 7f9463e00640 1 -- 172.21.15.50:0/3091269541 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f94740b04a0 con 0x5590e18d90a0 2024-08-31T04:23:24.297 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:24.293+0000 7f948fa00740 10 client.25414 fetch_fsmap learned FSMap version 29 2024-08-31T04:23:24.297 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:24.293+0000 7f948fa00740 1 -- 172.21.15.50:0/3091269541 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5590e1cc1f70 con 0x5590e18d90a0 2024-08-31T04:23:24.297 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:24.293+0000 7f9463e00640 1 -- 172.21.15.50:0/3091269541 <== mon.1 v2:172.21.15.177:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f94700043d0 con 0x5590e18d90a0 2024-08-31T04:23:24.297 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:24.293+0000 7f9463e00640 1 -- 172.21.15.50:0/3091269541 <== mon.1 v2:172.21.15.177:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f9474091b20 con 0x5590e18d90a0 2024-08-31T04:23:24.297 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:24.293+0000 7f948fa00740 10 client.25414 fetch_fsmap finished waiting for FSMap version 29 2024-08-31T04:23:24.297 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:24.293+0000 7f948fa00740 10 client.25414 resolve_mds: resolved name 'a' to daemon mds.a 2024-08-31T04:23:24.297 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:24.293+0000 7f948fa00740 20 client.25414 populate_metadata read hostname 'smithi050' 2024-08-31T04:23:24.298 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:24.293+0000 7f948fa00740 1 --2- 172.21.15.50:0/3091269541 >> [v2:172.21.15.50:6840/575209862,v1:172.21.15.50:6841/575209862] conn(0x5590e18c08e0 0x5590e1cc5a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:24.298 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:24.293+0000 7f948fa00740 4 client.25414 mds_command: new command op to 24691 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T04:23:24.298 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:24.293+0000 7f948fa00740 1 -- 172.21.15.50:0/3091269541 --> [v2:172.21.15.50:6840/575209862,v1:172.21.15.50:6841/575209862] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5590e1c204a0 con 0x5590e18c08e0 2024-08-31T04:23:24.298 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:24.294+0000 7f9481400640 1 --2- 172.21.15.50:0/3091269541 >> [v2:172.21.15.50:6840/575209862,v1:172.21.15.50:6841/575209862] conn(0x5590e18c08e0 0x5590e1cc5a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:24.299 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:24.294+0000 7f9481400640 1 --2- 172.21.15.50:0/3091269541 >> [v2:172.21.15.50:6840/575209862,v1:172.21.15.50:6841/575209862] conn(0x5590e18c08e0 0x5590e1cc5a80 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=27ea64757b29d6b5 server_cookie=40404e2f7a99ef16 in_seq=0 out_seq=0 2024-08-31T04:23:24.299 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:24.294+0000 7f9463e00640 10 client.25414 ms_handle_connect on v2:172.21.15.50:6840/575209862 2024-08-31T04:23:24.299 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:24.295+0000 7f9463e00640 1 -- 172.21.15.50:0/3091269541 <== mds.1 v2:172.21.15.50:6840/575209862 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5590e1c204a0 con 0x5590e18c08e0 2024-08-31T04:23:24.299 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:24.295+0000 7f9463e00640 10 client.25414 handle_command_reply: tid=0 2024-08-31T04:23:24.299 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:24.295+0000 7f948fa00740 1 client.25414 shutdown 2024-08-31T04:23:24.299 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:24.295+0000 7f948fa00740 1 -- 172.21.15.50:0/3091269541 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5590e18d90a0 msgr2=0x5590e1cb30a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:23:24.299 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:24.295+0000 7f948fa00740 1 --2- 172.21.15.50:0/3091269541 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5590e18d90a0 0x5590e1cb30a0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f94740a8f50 tx=0x7f94740ab6f0 comp rx=0 tx=0).stop 2024-08-31T04:23:24.300 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:24.295+0000 7f948fa00740 1 -- 172.21.15.50:0/3091269541 shutdown_connections 2024-08-31T04:23:24.300 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:24.296+0000 7f948fa00740 1 --2- 172.21.15.50:0/3091269541 >> [v2:172.21.15.50:6840/575209862,v1:172.21.15.50:6841/575209862] conn(0x5590e18c08e0 0x5590e1cc5a80 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:24.300 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:24.296+0000 7f948fa00740 1 --2- 172.21.15.50:0/3091269541 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5590e1901f60 0x5590e1cbf450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:24.300 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:24.296+0000 7f948fa00740 1 --2- 172.21.15.50:0/3091269541 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5590e18e1280 0x5590e1cb35e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:24.300 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:24.296+0000 7f948fa00740 1 --2- 172.21.15.50:0/3091269541 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5590e18d90a0 0x5590e1cb30a0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:24.300 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:24.296+0000 7f9463e00640 0 client.25414 ms_handle_reset on v2:172.21.15.50:6840/575209862 2024-08-31T04:23:24.300 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:24.296+0000 7f948fa00740 1 -- 172.21.15.50:0/3091269541 >> 172.21.15.50:0/3091269541 conn(0x5590e18f6350 msgr2=0x5590e1caaa80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:23:24.300 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:24.296+0000 7f948fa00740 1 -- 172.21.15.50:0/3091269541 shutdown_connections 2024-08-31T04:23:24.300 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:24.296+0000 7f948fa00740 1 -- 172.21.15.50:0/3091269541 wait complete. 2024-08-31T04:23:24.300 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:24.296+0000 7f948fa00740 20 client.25414 trim_cache size 0 max 16384 2024-08-31T04:23:24.316 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:24.315+0000 7f948fa00740 1 Processor -- start 2024-08-31T04:23:24.316 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:24.315+0000 7f948fa00740 1 -- start start 2024-08-31T04:23:24.317 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:24.315+0000 7f948fa00740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5590e18d90a0 0x5590e1cb2590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:24.317 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:24.315+0000 7f948fa00740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5590e18e1280 0x5590e1cc3430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:24.317 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:24.315+0000 7f948fa00740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5590e1901f60 0x5590e1cb1920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:24.317 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:24.315+0000 7f948fa00740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x5590e1cc3dc0 con 0x5590e18e1280 2024-08-31T04:23:24.317 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:24.315+0000 7f948fa00740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x5590e1cc4490 con 0x5590e1901f60 2024-08-31T04:23:24.317 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:24.315+0000 7f948fa00740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x5590e1cc4b60 con 0x5590e18d90a0 2024-08-31T04:23:24.318 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:24.316+0000 7f9481400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5590e18e1280 0x5590e1cc3430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:24.318 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:24.316+0000 7f9481e00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5590e18d90a0 0x5590e1cb2590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:24.318 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:24.316+0000 7f9481400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5590e18e1280 0x5590e1cc3430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49102/0 (socket says 172.21.15.50:49102) 2024-08-31T04:23:24.318 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:24.316+0000 7f9481400640 1 -- 172.21.15.50:0/3213872904 learned_addr learned my addr 172.21.15.50:0/3213872904 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:23:24.319 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:24.316+0000 7f9482800640 1 --2- 172.21.15.50:0/3213872904 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5590e1901f60 0x5590e1cb1920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:24.319 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:24.316+0000 7f9481400640 1 -- 172.21.15.50:0/3213872904 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5590e18d90a0 msgr2=0x5590e1cb2590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:23:24.319 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:24.316+0000 7f9481400640 1 --2- 172.21.15.50:0/3213872904 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5590e18d90a0 0x5590e1cb2590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:24.319 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:24.316+0000 7f9481400640 1 -- 172.21.15.50:0/3213872904 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5590e1901f60 msgr2=0x5590e1cb1920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:23:24.319 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:24.316+0000 7f9481400640 1 --2- 172.21.15.50:0/3213872904 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5590e1901f60 0x5590e1cb1920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:24.319 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:24.316+0000 7f9481400640 1 -- 172.21.15.50:0/3213872904 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5590e1ca9be0 con 0x5590e18e1280 2024-08-31T04:23:24.319 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:24.317+0000 7f9481400640 1 --2- 172.21.15.50:0/3213872904 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5590e18e1280 0x5590e1cc3430 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f9470011d10 tx=0x7f9470005fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a22fcebf58a033c3 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:23:24.319 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:24.317+0000 7f946ea00640 1 -- 172.21.15.50:0/3213872904 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f947001f040 con 0x5590e18e1280 2024-08-31T04:23:24.319 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:24.317+0000 7f946ea00640 1 -- 172.21.15.50:0/3213872904 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9470005480 con 0x5590e18e1280 2024-08-31T04:23:24.319 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:24.317+0000 7f946ea00640 1 -- 172.21.15.50:0/3213872904 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94700266c0 con 0x5590e18e1280 2024-08-31T04:23:24.322 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:24.318+0000 7f948fa00740 1 -- 172.21.15.50:0/3213872904 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5590e18e1280 msgr2=0x5590e1cc3430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:23:24.322 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:24.318+0000 7f948fa00740 1 --2- 172.21.15.50:0/3213872904 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5590e18e1280 0x5590e1cc3430 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f9470011d10 tx=0x7f9470005fd0 comp rx=0 tx=0).stop 2024-08-31T04:23:24.322 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:24.318+0000 7f948fa00740 1 -- 172.21.15.50:0/3213872904 shutdown_connections 2024-08-31T04:23:24.322 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:24.318+0000 7f948fa00740 1 --2- 172.21.15.50:0/3213872904 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5590e1901f60 0x5590e1cb1920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:24.322 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:24.318+0000 7f948fa00740 1 --2- 172.21.15.50:0/3213872904 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5590e18e1280 0x5590e1cc3430 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:24.322 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:24.318+0000 7f948fa00740 1 --2- 172.21.15.50:0/3213872904 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5590e18d90a0 0x5590e1cb2590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:24.322 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:24.318+0000 7f948fa00740 1 -- 172.21.15.50:0/3213872904 >> 172.21.15.50:0/3213872904 conn(0x5590e18f6350 msgr2=0x5590e1ca04c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:23:24.322 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:24.318+0000 7f948fa00740 1 -- 172.21.15.50:0/3213872904 shutdown_connections 2024-08-31T04:23:24.322 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:24.318+0000 7f948fa00740 1 -- 172.21.15.50:0/3213872904 wait complete. 2024-08-31T04:23:24.322 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:24.318+0000 7f948fa00740 1 -- start start 2024-08-31T04:23:24.322 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:24.319+0000 7f948fa00740 1 Processor -- start 2024-08-31T04:23:24.323 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:24.319+0000 7f948fa00740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5590e18d90a0 0x5590e1cc9530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:24.323 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:24.319+0000 7f948fa00740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5590e18e1280 0x5590e1cc9ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:24.323 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:24.319+0000 7f948fa00740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5590e1901f60 0x5590e1d37750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:24.323 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:24.319+0000 7f948fa00740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x5590e1cc5900 con 0x5590e18e1280 2024-08-31T04:23:24.323 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:24.319+0000 7f948fa00740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x5590e1cc5230 con 0x5590e18d90a0 2024-08-31T04:23:24.323 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:24.319+0000 7f948fa00740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x5590e1cc5fd0 con 0x5590e1901f60 2024-08-31T04:23:24.323 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:24.319+0000 7f948fa00740 10 client.0 _ll_register_callbacks cb 0x7f94740abab0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:23:24.323 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:24.319+0000 7f9481400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5590e18e1280 0x5590e1cc9ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:24.323 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:24.319+0000 7f9481e00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5590e18d90a0 0x5590e1cc9530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:24.323 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:24.319+0000 7f9482800640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5590e1901f60 0x5590e1d37750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:24.323 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:24.319+0000 7f9481400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5590e18e1280 0x5590e1cc9ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49108/0 (socket says 172.21.15.50:49108) 2024-08-31T04:23:24.323 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:24.319+0000 7f9481400640 1 -- 172.21.15.50:0/3312134000 learned_addr learned my addr 172.21.15.50:0/3312134000 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:23:24.323 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:24.320+0000 7f9481e00640 1 -- 172.21.15.50:0/3312134000 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5590e1901f60 msgr2=0x5590e1d37750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:23:24.323 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:24.320+0000 7f9481e00640 1 --2- 172.21.15.50:0/3312134000 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5590e1901f60 0x5590e1d37750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:24.324 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:24.320+0000 7f9481e00640 1 -- 172.21.15.50:0/3312134000 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5590e18e1280 msgr2=0x5590e1cc9ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:23:24.324 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:24.320+0000 7f9481e00640 1 --2- 172.21.15.50:0/3312134000 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5590e18e1280 0x5590e1cc9ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:24.324 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:24.320+0000 7f9481e00640 1 -- 172.21.15.50:0/3312134000 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5590e1d37d90 con 0x5590e18d90a0 2024-08-31T04:23:24.324 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:24.320+0000 7f9481400640 1 --2- 172.21.15.50:0/3312134000 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5590e18e1280 0x5590e1cc9ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:23:24.324 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:24.320+0000 7f9481e00640 1 --2- 172.21.15.50:0/3312134000 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5590e18d90a0 0x5590e1cc9530 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f94740a8280 tx=0x7f94740abbe0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8429298dc42bbe82 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:23:24.324 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:24.320+0000 7f9463e00640 10 client.0 ms_handle_connect on v2:172.21.15.133:3300/0 2024-08-31T04:23:24.324 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:24.320+0000 7f9463e00640 1 -- 172.21.15.50:0/3312134000 <== mon.2 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94740abce0 con 0x5590e18d90a0 2024-08-31T04:23:24.324 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:24.320+0000 7f948fa00740 1 -- 172.21.15.50:0/3312134000 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9470005480 con 0x5590e18d90a0 2024-08-31T04:23:24.324 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:24.320+0000 7f9463e00640 1 -- 172.21.15.50:0/3312134000 <== mon.2 v2:172.21.15.133:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8219+0+0 (secure 0 0 0) 0x7f9474010430 con 0x5590e18d90a0 2024-08-31T04:23:24.324 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:24.321+0000 7f9463e00640 1 -- 172.21.15.50:0/3312134000 <== mon.2 v2:172.21.15.133:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f9474018420 con 0x5590e18d90a0 2024-08-31T04:23:24.324 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:24.321+0000 7f948fa00740 10 client.25406 fetch_fsmap learned FSMap version 29 2024-08-31T04:23:24.324 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:24.321+0000 7f948fa00740 1 -- 172.21.15.50:0/3312134000 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5590e1d39010 con 0x5590e18d90a0 2024-08-31T04:23:24.326 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:24.321+0000 7f9463e00640 1 -- 172.21.15.50:0/3312134000 <== mon.2 v2:172.21.15.133:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9470005480 con 0x5590e18d90a0 2024-08-31T04:23:24.326 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:24.321+0000 7f9463e00640 1 -- 172.21.15.50:0/3312134000 <== mon.2 v2:172.21.15.133:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f94740aa9b0 con 0x5590e18d90a0 2024-08-31T04:23:24.326 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:24.321+0000 7f948fa00740 10 client.25406 fetch_fsmap finished waiting for FSMap version 29 2024-08-31T04:23:24.326 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:24.321+0000 7f948fa00740 10 client.25406 resolve_mds: resolved name 'a' to daemon mds.a 2024-08-31T04:23:24.326 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:24.321+0000 7f948fa00740 20 client.25406 populate_metadata read hostname 'smithi050' 2024-08-31T04:23:24.326 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:24.321+0000 7f948fa00740 1 --2- 172.21.15.50:0/3312134000 >> [v2:172.21.15.50:6840/575209862,v1:172.21.15.50:6841/575209862] conn(0x5590e1895c90 0x5590e1d3c740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:24.326 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:24.321+0000 7f948fa00740 4 client.25406 mds_command: new command op to 24691 tid=0 multi_id=0 [{"prefix": "status"}] 2024-08-31T04:23:24.326 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:24.321+0000 7f948fa00740 1 -- 172.21.15.50:0/3312134000 --> [v2:172.21.15.50:6840/575209862,v1:172.21.15.50:6841/575209862] -- command(tid 0: {"prefix": "status"}) -- 0x5590e1c1bf40 con 0x5590e1895c90 2024-08-31T04:23:24.326 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:24.322+0000 7f9481400640 1 --2- 172.21.15.50:0/3312134000 >> [v2:172.21.15.50:6840/575209862,v1:172.21.15.50:6841/575209862] conn(0x5590e1895c90 0x5590e1d3c740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:24.327 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:24.322+0000 7f9481400640 1 --2- 172.21.15.50:0/3312134000 >> [v2:172.21.15.50:6840/575209862,v1:172.21.15.50:6841/575209862] conn(0x5590e1895c90 0x5590e1d3c740 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=3e3d5595608700db server_cookie=209ea0e01a2dc582 in_seq=0 out_seq=0 2024-08-31T04:23:24.327 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:24.322+0000 7f9463e00640 10 client.25406 ms_handle_connect on v2:172.21.15.50:6840/575209862 2024-08-31T04:23:24.327 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:24.322+0000 7f9463e00640 1 -- 172.21.15.50:0/3312134000 <== mds.1 v2:172.21.15.50:6840/575209862 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x5590e1c1bf40 con 0x5590e1895c90 2024-08-31T04:23:24.327 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:24.323+0000 7f9463e00640 10 client.25406 handle_command_reply: tid=0 2024-08-31T04:23:24.327 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:24.323+0000 7f948fa00740 1 client.25406 shutdown 2024-08-31T04:23:24.327 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:24.323+0000 7f948fa00740 1 -- 172.21.15.50:0/3312134000 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5590e18d90a0 msgr2=0x5590e1cc9530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:23:24.327 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:24.323+0000 7f948fa00740 1 --2- 172.21.15.50:0/3312134000 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5590e18d90a0 0x5590e1cc9530 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f94740a8280 tx=0x7f94740abbe0 comp rx=0 tx=0).stop 2024-08-31T04:23:24.327 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:24.323+0000 7f948fa00740 1 -- 172.21.15.50:0/3312134000 shutdown_connections 2024-08-31T04:23:24.327 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:24.323+0000 7f948fa00740 1 --2- 172.21.15.50:0/3312134000 >> [v2:172.21.15.50:6840/575209862,v1:172.21.15.50:6841/575209862] conn(0x5590e1895c90 0x5590e1d3c740 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:24.327 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:24.323+0000 7f948fa00740 1 --2- 172.21.15.50:0/3312134000 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5590e1901f60 0x5590e1d37750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:24.327 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:24.323+0000 7f9463e00640 0 client.25406 ms_handle_reset on v2:172.21.15.50:6840/575209862 2024-08-31T04:23:24.328 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:24.323+0000 7f948fa00740 1 --2- 172.21.15.50:0/3312134000 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5590e18e1280 0x5590e1cc9ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:24.328 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:24.323+0000 7f948fa00740 1 --2- 172.21.15.50:0/3312134000 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5590e18d90a0 0x5590e1cc9530 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:24.328 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:24.323+0000 7f948fa00740 1 -- 172.21.15.50:0/3312134000 >> 172.21.15.50:0/3312134000 conn(0x5590e18f6350 msgr2=0x5590e1cc3430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:23:24.328 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:24.323+0000 7f948fa00740 1 -- 172.21.15.50:0/3312134000 shutdown_connections 2024-08-31T04:23:24.328 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:24.323+0000 7f948fa00740 1 -- 172.21.15.50:0/3312134000 wait complete. 2024-08-31T04:23:24.328 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:24.323+0000 7f948fa00740 20 client.25406 trim_cache size 0 max 16384 2024-08-31T04:23:24.328 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-08-31T04:23:24.328 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_fsid": "058d9fc6-674f-11ef-bcd4-c7b262605968", 2024-08-31T04:23:24.328 INFO:teuthology.orchestra.run.smithi050.stdout: "whoami": 1, 2024-08-31T04:23:24.328 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 24691, 2024-08-31T04:23:24.329 INFO:teuthology.orchestra.run.smithi050.stdout: "want_state": "up:active", 2024-08-31T04:23:24.329 INFO:teuthology.orchestra.run.smithi050.stdout: "state": "up:active", 2024-08-31T04:23:24.329 INFO:teuthology.orchestra.run.smithi050.stdout: "fs_name": "cephfs", 2024-08-31T04:23:24.329 INFO:teuthology.orchestra.run.smithi050.stdout: "rank_uptime": 150.34077985799999, 2024-08-31T04:23:24.329 INFO:teuthology.orchestra.run.smithi050.stdout: "mdsmap_epoch": 29, 2024-08-31T04:23:24.329 INFO:teuthology.orchestra.run.smithi050.stdout: "osdmap_epoch": 78, 2024-08-31T04:23:24.329 INFO:teuthology.orchestra.run.smithi050.stdout: "osdmap_epoch_barrier": 78, 2024-08-31T04:23:24.329 INFO:teuthology.orchestra.run.smithi050.stdout: "uptime": 175.70968201400001 2024-08-31T04:23:24.329 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-08-31T04:23:24.330 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:24.324+0000 7f9488e00640 1 -- 172.21.15.50:0/2435381217 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f94680b4bb0 msgr2=0x7f94680b70c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:23:24.330 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:24.324+0000 7f9488e00640 1 --2- 172.21.15.50:0/2435381217 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f94680b4bb0 0x7f94680b70c0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f947c02f500 tx=0x7f947c02f310 comp rx=0 tx=0).stop 2024-08-31T04:23:24.330 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:24.324+0000 7f9488e00640 1 -- 172.21.15.50:0/2435381217 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9484102820 msgr2=0x7f948419c400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:23:24.330 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:24.324+0000 7f9488e00640 1 --2- 172.21.15.50:0/2435381217 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9484102820 0x7f948419c400 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f947400e9f0 tx=0x7f947400eeb0 comp rx=0 tx=0).stop 2024-08-31T04:23:24.330 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:24.324+0000 7f9488e00640 1 -- 172.21.15.50:0/2435381217 shutdown_connections 2024-08-31T04:23:24.330 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:24.324+0000 7f9488e00640 1 --2- 172.21.15.50:0/2435381217 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f94680b4bb0 0x7f94680b70c0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:24.330 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:24.324+0000 7f9488e00640 1 --2- 172.21.15.50:0/2435381217 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9484108ab0 0x7f94841a1c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:24.330 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:24.324+0000 7f9488e00640 1 --2- 172.21.15.50:0/2435381217 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9484108160 0x7f948419c9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:24.330 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:24.324+0000 7f9488e00640 1 --2- 172.21.15.50:0/2435381217 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9484102820 0x7f948419c400 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:24.330 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:24.324+0000 7f9488e00640 1 -- 172.21.15.50:0/2435381217 >> 172.21.15.50:0/2435381217 conn(0x7f94840794e0 msgr2=0x7f948406b8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:23:24.330 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:24.324+0000 7f9488e00640 1 -- 172.21.15.50:0/2435381217 shutdown_connections 2024-08-31T04:23:24.330 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:24.324+0000 7f9488e00640 1 -- 172.21.15.50:0/2435381217 wait complete. 2024-08-31T04:23:25.097 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 058d9fc6-674f-11ef-bcd4-c7b262605968 -- ceph tell mds.b status 2024-08-31T04:23:25.478 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:23:25.822 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:23:25 smithi050 ceph-mon[17259]: pgmap v382: 97 pgs: 97 active+clean; 660 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 2.7 KiB/s wr, 13 op/s 2024-08-31T04:23:25.996 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:23:25 smithi177 ceph-mon[22025]: pgmap v382: 97 pgs: 97 active+clean; 660 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 2.7 KiB/s wr, 13 op/s 2024-08-31T04:23:26.043 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:23:25 smithi133 ceph-mon[22177]: pgmap v382: 97 pgs: 97 active+clean; 660 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 2.7 KiB/s wr, 13 op/s 2024-08-31T04:23:26.114 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:26.113+0000 7fd3b7200640 1 -- 172.21.15.50:0/2983343393 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd3b810bbe0 msgr2=0x7fd3b8112410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:23:26.114 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:26.113+0000 7fd3b7200640 1 --2- 172.21.15.50:0/2983343393 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd3b810bbe0 0x7fd3b8112410 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fd3b0009ca0 tx=0x7fd3b002a8b0 comp rx=0 tx=0).stop 2024-08-31T04:23:26.114 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:26.113+0000 7fd3b7200640 1 -- 172.21.15.50:0/2983343393 shutdown_connections 2024-08-31T04:23:26.115 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:26.113+0000 7fd3b7200640 1 --2- 172.21.15.50:0/2983343393 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd3b810b290 0x7fd3b810b6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:26.115 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:26.113+0000 7fd3b7200640 1 --2- 172.21.15.50:0/2983343393 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd3b810bbe0 0x7fd3b8112410 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:26.115 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:26.113+0000 7fd3b7200640 1 --2- 172.21.15.50:0/2983343393 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd3b8105950 0x7fd3b8105d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:26.115 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:26.113+0000 7fd3b7200640 1 -- 172.21.15.50:0/2983343393 >> 172.21.15.50:0/2983343393 conn(0x7fd3b8101420 msgr2=0x7fd3b8103870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:23:26.115 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:26.113+0000 7fd3b7200640 1 -- 172.21.15.50:0/2983343393 shutdown_connections 2024-08-31T04:23:26.115 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:26.113+0000 7fd3b7200640 1 -- 172.21.15.50:0/2983343393 wait complete. 2024-08-31T04:23:26.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:26.114+0000 7fd3b7200640 1 Processor -- start 2024-08-31T04:23:26.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:26.114+0000 7fd3b7200640 1 -- start start 2024-08-31T04:23:26.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:26.114+0000 7fd3b7200640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd3b8105950 0x7fd3b819c260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:26.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:26.114+0000 7fd3b7200640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd3b810b290 0x7fd3b819c800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:26.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:26.114+0000 7fd3b7200640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd3b810bbe0 0x7fd3b81a1aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:26.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:26.114+0000 7fd3b7200640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fd3b81158f0 con 0x7fd3b8105950 2024-08-31T04:23:26.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:26.114+0000 7fd3b7200640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7fd3b8115770 con 0x7fd3b810bbe0 2024-08-31T04:23:26.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:26.114+0000 7fd3b7200640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fd3b8115a70 con 0x7fd3b810b290 2024-08-31T04:23:26.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:26.115+0000 7fd3b5e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd3b8105950 0x7fd3b819c260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:26.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:26.115+0000 7fd3b5e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd3b8105950 0x7fd3b819c260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49138/0 (socket says 172.21.15.50:49138) 2024-08-31T04:23:26.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:26.115+0000 7fd3b5e00640 1 -- 172.21.15.50:0/2475096677 learned_addr learned my addr 172.21.15.50:0/2475096677 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:23:26.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:26.115+0000 7fd3b5400640 1 --2- 172.21.15.50:0/2475096677 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd3b810b290 0x7fd3b819c800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:26.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:26.115+0000 7fd3b6800640 1 --2- 172.21.15.50:0/2475096677 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd3b810bbe0 0x7fd3b81a1aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:26.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:26.115+0000 7fd3b5e00640 1 -- 172.21.15.50:0/2475096677 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd3b810b290 msgr2=0x7fd3b819c800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:23:26.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:26.115+0000 7fd3b5e00640 1 --2- 172.21.15.50:0/2475096677 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd3b810b290 0x7fd3b819c800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:26.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:26.115+0000 7fd3b5e00640 1 -- 172.21.15.50:0/2475096677 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd3b810bbe0 msgr2=0x7fd3b81a1aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:23:26.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:26.115+0000 7fd3b5e00640 1 --2- 172.21.15.50:0/2475096677 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd3b810bbe0 0x7fd3b81a1aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:26.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:26.115+0000 7fd3b5e00640 1 -- 172.21.15.50:0/2475096677 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3b81a21d0 con 0x7fd3b8105950 2024-08-31T04:23:26.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:26.115+0000 7fd3b5e00640 1 --2- 172.21.15.50:0/2475096677 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd3b8105950 0x7fd3b819c260 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fd3a800e9f0 tx=0x7fd3a800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:23:26.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:26.116+0000 7fd3aea00640 1 -- 172.21.15.50:0/2475096677 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3a800cd80 con 0x7fd3b8105950 2024-08-31T04:23:26.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:26.116+0000 7fd3aea00640 1 -- 172.21.15.50:0/2475096677 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd3a80108e0 con 0x7fd3b8105950 2024-08-31T04:23:26.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:26.116+0000 7fd3b7200640 1 -- 172.21.15.50:0/2475096677 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd3b81a24c0 con 0x7fd3b8105950 2024-08-31T04:23:26.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:26.116+0000 7fd3aea00640 1 -- 172.21.15.50:0/2475096677 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3a8018980 con 0x7fd3b8105950 2024-08-31T04:23:26.119 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:26.116+0000 7fd3b7200640 1 -- 172.21.15.50:0/2475096677 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd3b81a8c20 con 0x7fd3b8105950 2024-08-31T04:23:26.120 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:26.119+0000 7fd3c3a75740 1 Processor -- start 2024-08-31T04:23:26.121 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:26.119+0000 7fd3c3a75740 1 -- start start 2024-08-31T04:23:26.121 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:26.119+0000 7fd3aea00640 1 -- 172.21.15.50:0/2475096677 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 18) ==== 152577+0+0 (secure 0 0 0) 0x7fd3a8010430 con 0x7fd3b8105950 2024-08-31T04:23:26.121 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:26.120+0000 7fd3c3a75740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56268f933f60 0x56268fcd9aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:26.121 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:26.120+0000 7fd3c3a75740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56268f90b0a0 0x56268fcd9fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:26.121 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:26.120+0000 7fd3c3a75740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56268f913280 0x56268fcda520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:26.122 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:26.120+0000 7fd3c3a75740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x56268fc50550 con 0x56268f913280 2024-08-31T04:23:26.122 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:26.120+0000 7fd3c3a75740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x56268fc3fae0 con 0x56268f933f60 2024-08-31T04:23:26.122 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:26.120+0000 7fd3c3a75740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x56268fc43a90 con 0x56268f90b0a0 2024-08-31T04:23:26.122 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:26.120+0000 7fd3b5e00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56268f90b0a0 0x56268fcd9fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:26.122 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:26.120+0000 7fd3b6800640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56268f933f60 0x56268fcd9aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:26.122 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:26.120+0000 7fd3b5400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56268f913280 0x56268fcda520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:26.122 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:26.120+0000 7fd3b6800640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56268f933f60 0x56268fcd9aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.50:47382/0 (socket says 172.21.15.50:47382) 2024-08-31T04:23:26.122 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:26.120+0000 7fd3b6800640 1 -- 172.21.15.50:0/1541074125 learned_addr learned my addr 172.21.15.50:0/1541074125 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:23:26.123 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:26.121+0000 7fd3b6800640 1 -- 172.21.15.50:0/1541074125 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56268f90b0a0 msgr2=0x56268fcd9fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:23:26.123 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:26.121+0000 7fd3b6800640 1 --2- 172.21.15.50:0/1541074125 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56268f90b0a0 0x56268fcd9fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:26.123 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:26.121+0000 7fd3b6800640 1 -- 172.21.15.50:0/1541074125 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56268f913280 msgr2=0x56268fcda520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:23:26.123 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:26.121+0000 7fd3b6800640 1 --2- 172.21.15.50:0/1541074125 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56268f913280 0x56268fcda520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:26.124 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:26.121+0000 7fd3b6800640 1 -- 172.21.15.50:0/1541074125 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56268f99f540 con 0x56268f933f60 2024-08-31T04:23:26.124 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:26.121+0000 7fd3b5e00640 1 --2- 172.21.15.50:0/1541074125 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56268f90b0a0 0x56268fcd9fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:23:26.124 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:26.121+0000 7fd3b6800640 1 --2- 172.21.15.50:0/1541074125 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56268f933f60 0x56268fcd9aa0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fd3b0009ca0 tx=0x7fd3b0009950 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6a4898c1df292358 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:23:26.124 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:26.121+0000 7fd3a3400640 1 -- 172.21.15.50:0/1541074125 <== mon.2 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3b0030800 con 0x56268f933f60 2024-08-31T04:23:26.124 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:26.121+0000 7fd3a3400640 1 -- 172.21.15.50:0/1541074125 <== mon.2 v2:172.21.15.133:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd3b0036030 con 0x56268f933f60 2024-08-31T04:23:26.124 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:26.121+0000 7fd3a3400640 1 -- 172.21.15.50:0/1541074125 <== mon.2 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3b0004440 con 0x56268f933f60 2024-08-31T04:23:26.124 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:26.121+0000 7fd3aea00640 1 --2- 172.21.15.50:0/2475096677 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fd39c0b4bb0 0x7fd39c0b70c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:26.124 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:26.122+0000 7fd3aea00640 1 -- 172.21.15.50:0/2475096677 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8219+0+0 (secure 0 0 0) 0x7fd3a80e5410 con 0x7fd3b8105950 2024-08-31T04:23:26.124 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:26.122+0000 7fd3b5e00640 1 --2- 172.21.15.50:0/2475096677 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fd39c0b4bb0 0x7fd39c0b70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:26.126 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:26.122+0000 7fd3c3a75740 1 -- 172.21.15.50:0/1541074125 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56268f933f60 msgr2=0x56268fcd9aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:23:26.126 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:26.122+0000 7fd3b5e00640 1 --2- 172.21.15.50:0/2475096677 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fd39c0b4bb0 0x7fd39c0b70c0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fd3a800c6a0 tx=0x7fd3a80e8e50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:23:26.126 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:26.122+0000 7fd3c3a75740 1 --2- 172.21.15.50:0/1541074125 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56268f933f60 0x56268fcd9aa0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fd3b0009ca0 tx=0x7fd3b0009950 comp rx=0 tx=0).stop 2024-08-31T04:23:26.127 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:26.123+0000 7fd3c3a75740 1 -- 172.21.15.50:0/1541074125 shutdown_connections 2024-08-31T04:23:26.127 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:26.123+0000 7fd3c3a75740 1 --2- 172.21.15.50:0/1541074125 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56268f90b0a0 0x56268fcd9fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:26.127 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:26.123+0000 7fd3c3a75740 1 --2- 172.21.15.50:0/1541074125 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56268f913280 0x56268fcda520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:26.127 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:26.123+0000 7fd3c3a75740 1 --2- 172.21.15.50:0/1541074125 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56268f933f60 0x56268fcd9aa0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:26.127 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:26.123+0000 7fd3c3a75740 1 -- 172.21.15.50:0/1541074125 >> 172.21.15.50:0/1541074125 conn(0x56268f928350 msgr2=0x56268fcd7990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:23:26.127 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:26.123+0000 7fd3c3a75740 1 -- 172.21.15.50:0/1541074125 shutdown_connections 2024-08-31T04:23:26.127 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:26.123+0000 7fd3c3a75740 1 -- 172.21.15.50:0/1541074125 wait complete. 2024-08-31T04:23:26.127 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:26.123+0000 7fd3c3a75740 1 -- start start 2024-08-31T04:23:26.127 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:26.124+0000 7fd3c3a75740 1 Processor -- start 2024-08-31T04:23:26.127 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:26.124+0000 7fd3c3a75740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56268f90b0a0 0x56268fce5180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:26.127 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:26.124+0000 7fd3c3a75740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56268f913280 0x56268fce56c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:26.128 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:26.124+0000 7fd3c3a75740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56268f933f60 0x56268fcf1540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:26.128 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:26.124+0000 7fd3c3a75740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x56268faa25f0 con 0x56268f913280 2024-08-31T04:23:26.128 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:26.124+0000 7fd3c3a75740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x56268fbc6bd0 con 0x56268f933f60 2024-08-31T04:23:26.128 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:26.124+0000 7fd3c3a75740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x56268fce8220 con 0x56268f90b0a0 2024-08-31T04:23:26.128 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:26.124+0000 7fd3c3a75740 10 client.0 _ll_register_callbacks cb 0x56268fbec210 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:23:26.128 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:26.125+0000 7fd3b5400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56268f913280 0x56268fce56c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:26.128 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:26.125+0000 7fd3b6800640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56268f90b0a0 0x56268fce5180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:26.128 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:26.125+0000 7fd3b5400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56268f913280 0x56268fce56c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49142/0 (socket says 172.21.15.50:49142) 2024-08-31T04:23:26.128 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:26.125+0000 7fd3b5400640 1 -- 172.21.15.50:0/4276603291 learned_addr learned my addr 172.21.15.50:0/4276603291 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:23:26.128 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:26.125+0000 7fd3b6800640 1 --2- 172.21.15.50:0/4276603291 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56268f933f60 0x56268fcf1540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:26.128 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:26.125+0000 7fd3b5400640 1 -- 172.21.15.50:0/4276603291 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56268f90b0a0 msgr2=0x56268fce5180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:23:26.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:26.125+0000 7fd3b5400640 1 --2- 172.21.15.50:0/4276603291 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56268f90b0a0 0x56268fce5180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:26.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:26.125+0000 7fd3b5400640 1 -- 172.21.15.50:0/4276603291 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56268f933f60 msgr2=0x56268fcf1540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:23:26.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:26.125+0000 7fd3b5400640 1 --2- 172.21.15.50:0/4276603291 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56268f933f60 0x56268fcf1540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:26.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:26.125+0000 7fd3b5400640 1 -- 172.21.15.50:0/4276603291 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56268fc07650 con 0x56268f913280 2024-08-31T04:23:26.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:26.125+0000 7fd3b6800640 1 --2- 172.21.15.50:0/4276603291 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56268f933f60 0x56268fcf1540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:23:26.131 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:26.125+0000 7fd3b5400640 1 --2- 172.21.15.50:0/4276603291 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56268f913280 0x56268fce56c0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fd3a400bf50 tx=0x7fd3a40118d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=484a0ee3cb080902 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:23:26.132 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:26.125+0000 7fd397e00640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-08-31T04:23:26.132 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:26.126+0000 7fd397e00640 1 -- 172.21.15.50:0/4276603291 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3a4004020 con 0x56268f913280 2024-08-31T04:23:26.132 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:26.126+0000 7fd397e00640 1 -- 172.21.15.50:0/4276603291 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8219+0+0 (secure 0 0 0) 0x7fd3a40041c0 con 0x56268f913280 2024-08-31T04:23:26.132 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:26.126+0000 7fd3c3a75740 1 -- 172.21.15.50:0/4276603291 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd3b0036030 con 0x56268f913280 2024-08-31T04:23:26.132 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:26.126+0000 7fd397e00640 1 -- 172.21.15.50:0/4276603291 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fd3a40043c0 con 0x56268f913280 2024-08-31T04:23:26.132 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:26.126+0000 7fd3c3a75740 10 client.15432 fetch_fsmap learned FSMap version 29 2024-08-31T04:23:26.132 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:26.126+0000 7fd3c3a75740 1 -- 172.21.15.50:0/4276603291 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x56268fcf3fe0 con 0x56268f913280 2024-08-31T04:23:26.132 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:26.126+0000 7fd397e00640 1 -- 172.21.15.50:0/4276603291 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd3b0036030 con 0x56268f913280 2024-08-31T04:23:26.132 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:26.127+0000 7fd397e00640 1 -- 172.21.15.50:0/4276603291 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7fd3a40039c0 con 0x56268f913280 2024-08-31T04:23:26.132 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:26.127+0000 7fd3c3a75740 10 client.15432 fetch_fsmap finished waiting for FSMap version 29 2024-08-31T04:23:26.133 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:26.127+0000 7fd3c3a75740 10 client.15432 resolve_mds: resolved name 'b' to daemon mds.b 2024-08-31T04:23:26.133 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:26.127+0000 7fd3c3a75740 20 client.15432 populate_metadata read hostname 'smithi050' 2024-08-31T04:23:26.133 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:26.127+0000 7fd3c3a75740 1 --2- 172.21.15.50:0/4276603291 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x56268f8f28e0 0x56268fcf7a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:26.133 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:26.127+0000 7fd3c3a75740 4 client.15432 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T04:23:26.133 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:26.127+0000 7fd3c3a75740 1 -- 172.21.15.50:0/4276603291 --> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56268fc524a0 con 0x56268f8f28e0 2024-08-31T04:23:26.133 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:26.127+0000 7fd3b6800640 1 --2- 172.21.15.50:0/4276603291 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x56268f8f28e0 0x56268fcf7a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:26.133 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:26.128+0000 7fd3b6800640 1 --2- 172.21.15.50:0/4276603291 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x56268f8f28e0 0x56268fcf7a20 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4af40ff88ebced0 server_cookie=eaa9fcabd1728eea in_seq=0 out_seq=0 2024-08-31T04:23:26.133 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:26.128+0000 7fd397e00640 10 client.15432 ms_handle_connect on v2:172.21.15.133:6838/2526402262 2024-08-31T04:23:26.133 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:26.129+0000 7fd397e00640 1 -- 172.21.15.50:0/4276603291 <== mds.0 v2:172.21.15.133:6838/2526402262 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56268fc524a0 con 0x56268f8f28e0 2024-08-31T04:23:26.133 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:26.129+0000 7fd397e00640 10 client.15432 handle_command_reply: tid=0 2024-08-31T04:23:26.133 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:26.129+0000 7fd3c3a75740 1 client.15432 shutdown 2024-08-31T04:23:26.134 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:26.129+0000 7fd3c3a75740 1 -- 172.21.15.50:0/4276603291 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56268f913280 msgr2=0x56268fce56c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:23:26.134 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:26.129+0000 7fd3c3a75740 1 --2- 172.21.15.50:0/4276603291 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56268f913280 0x56268fce56c0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fd3a400bf50 tx=0x7fd3a40118d0 comp rx=0 tx=0).stop 2024-08-31T04:23:26.134 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:26.129+0000 7fd3c3a75740 1 -- 172.21.15.50:0/4276603291 shutdown_connections 2024-08-31T04:23:26.134 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:26.129+0000 7fd3c3a75740 1 --2- 172.21.15.50:0/4276603291 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x56268f8f28e0 0x56268fcf7a20 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:26.134 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:26.129+0000 7fd3c3a75740 1 --2- 172.21.15.50:0/4276603291 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56268f933f60 0x56268fcf1540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:26.134 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:26.129+0000 7fd3c3a75740 1 --2- 172.21.15.50:0/4276603291 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56268f913280 0x56268fce56c0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:26.134 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:26.129+0000 7fd3c3a75740 1 --2- 172.21.15.50:0/4276603291 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56268f90b0a0 0x56268fce5180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:26.134 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:26.129+0000 7fd397e00640 0 client.15432 ms_handle_reset on v2:172.21.15.133:6838/2526402262 2024-08-31T04:23:26.134 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:26.129+0000 7fd3c3a75740 1 -- 172.21.15.50:0/4276603291 >> 172.21.15.50:0/4276603291 conn(0x56268f928350 msgr2=0x56268fcdcc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:23:26.134 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:26.129+0000 7fd3c3a75740 1 -- 172.21.15.50:0/4276603291 shutdown_connections 2024-08-31T04:23:26.134 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:26.129+0000 7fd3c3a75740 1 -- 172.21.15.50:0/4276603291 wait complete. 2024-08-31T04:23:26.134 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:26.129+0000 7fd3c3a75740 20 client.15432 trim_cache size 0 max 16384 2024-08-31T04:23:26.150 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:26.149+0000 7fd3c3a75740 1 Processor -- start 2024-08-31T04:23:26.150 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:26.149+0000 7fd3c3a75740 1 -- start start 2024-08-31T04:23:26.150 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:26.149+0000 7fd3c3a75740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56268f90b0a0 0x56268fcf14b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:26.150 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:26.149+0000 7fd3c3a75740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56268f913280 0x56268fce02c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:26.150 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:26.149+0000 7fd3c3a75740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56268f933f60 0x56268fce0800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:26.151 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:26.149+0000 7fd3c3a75740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x56268fcf5d60 con 0x56268f90b0a0 2024-08-31T04:23:26.151 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:26.149+0000 7fd3c3a75740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x56268fcf6430 con 0x56268f933f60 2024-08-31T04:23:26.151 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:26.149+0000 7fd3c3a75740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x56268fcf6b00 con 0x56268f913280 2024-08-31T04:23:26.152 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:26.149+0000 7fd3b6800640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56268f90b0a0 0x56268fcf14b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:26.152 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:26.149+0000 7fd3b6800640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56268f90b0a0 0x56268fcf14b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49144/0 (socket says 172.21.15.50:49144) 2024-08-31T04:23:26.152 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:26.149+0000 7fd3b6800640 1 -- 172.21.15.50:0/563316342 learned_addr learned my addr 172.21.15.50:0/563316342 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:23:26.152 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:26.149+0000 7fd3b5400640 1 --2- 172.21.15.50:0/563316342 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56268f913280 0x56268fce02c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:26.152 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:26.150+0000 7fd3b6800640 1 --2- 172.21.15.50:0/563316342 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56268f933f60 0x56268fce0800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:26.152 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:26.150+0000 7fd3b5400640 1 -- 172.21.15.50:0/563316342 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56268f933f60 msgr2=0x56268fce0800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:23:26.153 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:26.150+0000 7fd3b5400640 1 --2- 172.21.15.50:0/563316342 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56268f933f60 0x56268fce0800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:26.153 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:26.150+0000 7fd3b5400640 1 -- 172.21.15.50:0/563316342 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56268f90b0a0 msgr2=0x56268fcf14b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:23:26.153 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:26.150+0000 7fd3b5400640 1 --2- 172.21.15.50:0/563316342 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56268f90b0a0 0x56268fcf14b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:26.153 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:26.150+0000 7fd3b5400640 1 -- 172.21.15.50:0/563316342 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56268fcdbd90 con 0x56268f913280 2024-08-31T04:23:26.153 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:26.150+0000 7fd3b5400640 1 --2- 172.21.15.50:0/563316342 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56268f913280 0x56268fce02c0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fd3a4003db0 tx=0x7fd3a400b480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8dc024914c436381 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:23:26.153 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:26.150+0000 7fd3a2a00640 1 -- 172.21.15.50:0/563316342 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3a4003fa0 con 0x56268f913280 2024-08-31T04:23:26.153 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:26.150+0000 7fd3a2a00640 1 -- 172.21.15.50:0/563316342 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd3a4003aa0 con 0x56268f913280 2024-08-31T04:23:26.153 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:26.151+0000 7fd3a2a00640 1 -- 172.21.15.50:0/563316342 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3a4005650 con 0x56268f913280 2024-08-31T04:23:26.156 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:26.151+0000 7fd3c3a75740 1 -- 172.21.15.50:0/563316342 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56268f913280 msgr2=0x56268fce02c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:23:26.156 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:26.151+0000 7fd3c3a75740 1 --2- 172.21.15.50:0/563316342 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56268f913280 0x56268fce02c0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fd3a4003db0 tx=0x7fd3a400b480 comp rx=0 tx=0).stop 2024-08-31T04:23:26.156 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:26.151+0000 7fd3c3a75740 1 -- 172.21.15.50:0/563316342 shutdown_connections 2024-08-31T04:23:26.156 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:26.151+0000 7fd3c3a75740 1 --2- 172.21.15.50:0/563316342 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56268f913280 0x56268fce02c0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:26.156 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:26.151+0000 7fd3c3a75740 1 --2- 172.21.15.50:0/563316342 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56268f933f60 0x56268fce0800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:26.156 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:26.151+0000 7fd3c3a75740 1 --2- 172.21.15.50:0/563316342 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56268f90b0a0 0x56268fcf14b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:26.156 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:26.151+0000 7fd3c3a75740 1 -- 172.21.15.50:0/563316342 >> 172.21.15.50:0/563316342 conn(0x56268f928350 msgr2=0x56268fcf5450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:23:26.156 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:26.151+0000 7fd3c3a75740 1 -- 172.21.15.50:0/563316342 shutdown_connections 2024-08-31T04:23:26.157 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:26.151+0000 7fd3c3a75740 1 -- 172.21.15.50:0/563316342 wait complete. 2024-08-31T04:23:26.157 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:26.152+0000 7fd3c3a75740 1 -- start start 2024-08-31T04:23:26.157 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:26.152+0000 7fd3c3a75740 1 Processor -- start 2024-08-31T04:23:26.157 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:26.152+0000 7fd3c3a75740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56268f90b0a0 0x56268fcf9da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:26.157 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:26.153+0000 7fd3c3a75740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56268f913280 0x56268fcfa2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:26.157 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:26.153+0000 7fd3c3a75740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56268f933f60 0x56268fcfa820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:26.157 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:26.153+0000 7fd3c3a75740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x56268fcf78a0 con 0x56268f933f60 2024-08-31T04:23:26.157 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:26.153+0000 7fd3c3a75740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x56268fcf71d0 con 0x56268f90b0a0 2024-08-31T04:23:26.157 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:26.153+0000 7fd3c3a75740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x56268fcf7f70 con 0x56268f913280 2024-08-31T04:23:26.157 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:26.153+0000 7fd3c3a75740 10 client.0 _ll_register_callbacks cb 0x7fd3a400ba50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:23:26.157 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:26.153+0000 7fd3b5400640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56268f913280 0x56268fcfa2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:26.157 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:26.153+0000 7fd3b5400640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56268f913280 0x56268fcfa2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.50:33886/0 (socket says 172.21.15.50:33886) 2024-08-31T04:23:26.158 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:26.153+0000 7fd3b5400640 1 -- 172.21.15.50:0/2404892397 learned_addr learned my addr 172.21.15.50:0/2404892397 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:23:26.158 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:26.153+0000 7fd3b6800640 1 --2- 172.21.15.50:0/2404892397 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56268f933f60 0x56268fcfa820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:26.158 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:26.153+0000 7fd3b6800640 1 --2- 172.21.15.50:0/2404892397 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56268f90b0a0 0x56268fcf9da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:26.158 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:26.153+0000 7fd3b5400640 1 -- 172.21.15.50:0/2404892397 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56268f90b0a0 msgr2=0x56268fcf9da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:23:26.158 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:26.153+0000 7fd3b5400640 1 --2- 172.21.15.50:0/2404892397 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56268f90b0a0 0x56268fcf9da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:26.158 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:26.153+0000 7fd3b5400640 1 -- 172.21.15.50:0/2404892397 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56268f933f60 msgr2=0x56268fcfa820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:23:26.158 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:26.153+0000 7fd3b5400640 1 --2- 172.21.15.50:0/2404892397 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56268f933f60 0x56268fcfa820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:26.158 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:26.153+0000 7fd3b5400640 1 -- 172.21.15.50:0/2404892397 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56268fcff590 con 0x56268f913280 2024-08-31T04:23:26.158 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:26.153+0000 7fd3b6800640 1 --2- 172.21.15.50:0/2404892397 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56268f90b0a0 0x56268fcf9da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:23:26.158 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:26.154+0000 7fd3b5400640 1 --2- 172.21.15.50:0/2404892397 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56268f913280 0x56268fcfa2e0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fd3a4005890 tx=0x7fd3a4005bd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cd71463659af927a server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:23:26.158 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:26.154+0000 7fd397e00640 10 client.0 ms_handle_connect on v2:172.21.15.177:3300/0 2024-08-31T04:23:26.158 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:26.154+0000 7fd397e00640 1 -- 172.21.15.50:0/2404892397 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3a40055a0 con 0x56268f913280 2024-08-31T04:23:26.159 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:26.154+0000 7fd3c3a75740 1 -- 172.21.15.50:0/2404892397 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd3a4003aa0 con 0x56268f913280 2024-08-31T04:23:26.159 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:26.154+0000 7fd397e00640 1 -- 172.21.15.50:0/2404892397 <== mon.1 v2:172.21.15.177:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8219+0+0 (secure 0 0 0) 0x7fd3a4003f50 con 0x56268f913280 2024-08-31T04:23:26.159 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:26.154+0000 7fd397e00640 1 -- 172.21.15.50:0/2404892397 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fd3a4004150 con 0x56268f913280 2024-08-31T04:23:26.159 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:26.154+0000 7fd3c3a75740 10 client.25438 fetch_fsmap learned FSMap version 29 2024-08-31T04:23:26.159 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:26.154+0000 7fd3c3a75740 1 -- 172.21.15.50:0/2404892397 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x56268fd63210 con 0x56268f913280 2024-08-31T04:23:26.159 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:26.155+0000 7fd397e00640 1 -- 172.21.15.50:0/2404892397 <== mon.1 v2:172.21.15.177:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd3a4003aa0 con 0x56268f913280 2024-08-31T04:23:26.161 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:26.155+0000 7fd397e00640 1 -- 172.21.15.50:0/2404892397 <== mon.1 v2:172.21.15.177:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7fd3a4004660 con 0x56268f913280 2024-08-31T04:23:26.161 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:26.155+0000 7fd3c3a75740 10 client.25438 fetch_fsmap finished waiting for FSMap version 29 2024-08-31T04:23:26.161 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:26.155+0000 7fd3c3a75740 10 client.25438 resolve_mds: resolved name 'b' to daemon mds.b 2024-08-31T04:23:26.161 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:26.155+0000 7fd3c3a75740 20 client.25438 populate_metadata read hostname 'smithi050' 2024-08-31T04:23:26.161 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:26.155+0000 7fd3c3a75740 1 --2- 172.21.15.50:0/2404892397 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x56268f8c7c90 0x56268fd666e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:26.161 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:26.155+0000 7fd3c3a75740 4 client.25438 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "status"}] 2024-08-31T04:23:26.162 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:26.155+0000 7fd3c3a75740 1 -- 172.21.15.50:0/2404892397 --> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] -- command(tid 0: {"prefix": "status"}) -- 0x56268fc4df40 con 0x56268f8c7c90 2024-08-31T04:23:26.162 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:26.156+0000 7fd3b6800640 1 --2- 172.21.15.50:0/2404892397 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x56268f8c7c90 0x56268fd666e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:26.162 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:26.156+0000 7fd3b6800640 1 --2- 172.21.15.50:0/2404892397 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x56268f8c7c90 0x56268fd666e0 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6e72829385ecf2ac server_cookie=53b55775fe2e0692 in_seq=0 out_seq=0 2024-08-31T04:23:26.162 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:26.156+0000 7fd397e00640 10 client.25438 ms_handle_connect on v2:172.21.15.133:6838/2526402262 2024-08-31T04:23:26.162 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:26.156+0000 7fd397e00640 1 -- 172.21.15.50:0/2404892397 <== mds.0 v2:172.21.15.133:6838/2526402262 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x56268fc4df40 con 0x56268f8c7c90 2024-08-31T04:23:26.162 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:26.156+0000 7fd397e00640 10 client.25438 handle_command_reply: tid=0 2024-08-31T04:23:26.162 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:26.156+0000 7fd3c3a75740 1 client.25438 shutdown 2024-08-31T04:23:26.162 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:26.157+0000 7fd3c3a75740 1 -- 172.21.15.50:0/2404892397 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56268f913280 msgr2=0x56268fcfa2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:23:26.162 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:26.157+0000 7fd3c3a75740 1 --2- 172.21.15.50:0/2404892397 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56268f913280 0x56268fcfa2e0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fd3a4005890 tx=0x7fd3a4005bd0 comp rx=0 tx=0).stop 2024-08-31T04:23:26.162 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:26.157+0000 7fd3c3a75740 1 -- 172.21.15.50:0/2404892397 shutdown_connections 2024-08-31T04:23:26.162 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:26.157+0000 7fd3c3a75740 1 --2- 172.21.15.50:0/2404892397 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x56268f8c7c90 0x56268fd666e0 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:26.162 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:26.157+0000 7fd3c3a75740 1 --2- 172.21.15.50:0/2404892397 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56268f913280 0x56268fcfa2e0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:26.162 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:26.157+0000 7fd3c3a75740 1 --2- 172.21.15.50:0/2404892397 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56268f933f60 0x56268fcfa820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:26.163 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:26.157+0000 7fd3c3a75740 1 --2- 172.21.15.50:0/2404892397 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56268f90b0a0 0x56268fcf9da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:26.163 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:26.157+0000 7fd397e00640 0 client.25438 ms_handle_reset on v2:172.21.15.133:6838/2526402262 2024-08-31T04:23:26.163 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:26.157+0000 7fd3c3a75740 1 -- 172.21.15.50:0/2404892397 >> 172.21.15.50:0/2404892397 conn(0x56268f928350 msgr2=0x56268fcd7290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:23:26.163 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:26.157+0000 7fd3c3a75740 1 -- 172.21.15.50:0/2404892397 shutdown_connections 2024-08-31T04:23:26.163 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:26.157+0000 7fd3c3a75740 1 -- 172.21.15.50:0/2404892397 wait complete. 2024-08-31T04:23:26.163 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:26.157+0000 7fd3c3a75740 20 client.25438 trim_cache size 0 max 16384 2024-08-31T04:23:26.163 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-08-31T04:23:26.163 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_fsid": "058d9fc6-674f-11ef-bcd4-c7b262605968", 2024-08-31T04:23:26.164 INFO:teuthology.orchestra.run.smithi050.stdout: "whoami": 0, 2024-08-31T04:23:26.164 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 24695, 2024-08-31T04:23:26.164 INFO:teuthology.orchestra.run.smithi050.stdout: "want_state": "up:active", 2024-08-31T04:23:26.164 INFO:teuthology.orchestra.run.smithi050.stdout: "state": "up:active", 2024-08-31T04:23:26.164 INFO:teuthology.orchestra.run.smithi050.stdout: "fs_name": "cephfs", 2024-08-31T04:23:26.164 INFO:teuthology.orchestra.run.smithi050.stdout: "rank_uptime": 161.21420939399999, 2024-08-31T04:23:26.164 INFO:teuthology.orchestra.run.smithi050.stdout: "mdsmap_epoch": 29, 2024-08-31T04:23:26.164 INFO:teuthology.orchestra.run.smithi050.stdout: "osdmap_epoch": 78, 2024-08-31T04:23:26.164 INFO:teuthology.orchestra.run.smithi050.stdout: "osdmap_epoch_barrier": 78, 2024-08-31T04:23:26.164 INFO:teuthology.orchestra.run.smithi050.stdout: "uptime": 175.161730404 2024-08-31T04:23:26.164 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-08-31T04:23:26.165 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:26.158+0000 7fd3b7200640 1 -- 172.21.15.50:0/2475096677 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fd39c0b4bb0 msgr2=0x7fd39c0b70c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:23:26.165 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:26.158+0000 7fd3b7200640 1 --2- 172.21.15.50:0/2475096677 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fd39c0b4bb0 0x7fd39c0b70c0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fd3a800c6a0 tx=0x7fd3a80e8e50 comp rx=0 tx=0).stop 2024-08-31T04:23:26.165 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:26.158+0000 7fd3b7200640 1 -- 172.21.15.50:0/2475096677 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd3b8105950 msgr2=0x7fd3b819c260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:23:26.165 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:26.158+0000 7fd3b7200640 1 --2- 172.21.15.50:0/2475096677 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd3b8105950 0x7fd3b819c260 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fd3a800e9f0 tx=0x7fd3a800eeb0 comp rx=0 tx=0).stop 2024-08-31T04:23:26.165 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:26.158+0000 7fd3b7200640 1 -- 172.21.15.50:0/2475096677 shutdown_connections 2024-08-31T04:23:26.165 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:26.158+0000 7fd3b7200640 1 --2- 172.21.15.50:0/2475096677 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fd39c0b4bb0 0x7fd39c0b70c0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:26.165 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:26.158+0000 7fd3b7200640 1 --2- 172.21.15.50:0/2475096677 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd3b810b290 0x7fd3b819c800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:26.166 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:26.158+0000 7fd3b7200640 1 --2- 172.21.15.50:0/2475096677 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd3b810bbe0 0x7fd3b81a1aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:26.166 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:26.158+0000 7fd3b7200640 1 --2- 172.21.15.50:0/2475096677 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd3b8105950 0x7fd3b819c260 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:26.166 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:26.158+0000 7fd3b7200640 1 -- 172.21.15.50:0/2475096677 >> 172.21.15.50:0/2475096677 conn(0x7fd3b8101420 msgr2=0x7fd3b810a8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:23:26.166 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:26.158+0000 7fd3b7200640 1 -- 172.21.15.50:0/2475096677 shutdown_connections 2024-08-31T04:23:26.166 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:26.158+0000 7fd3b7200640 1 -- 172.21.15.50:0/2475096677 wait complete. 2024-08-31T04:23:27.149 INFO:tasks.quiescer:Ready to start quiesce thrashing; initial delay: 15 sec 2024-08-31T04:23:27.204 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:27.202+0000 7f61c5e00640 1 -- 172.21.15.50:0/2101428638 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f61c0106510 msgr2=0x7f61c0106920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:23:27.204 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:27.202+0000 7f61c5e00640 1 --2- 172.21.15.50:0/2101428638 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f61c0106510 0x7f61c0106920 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f61ac009900 tx=0x7f61ac02a410 comp rx=0 tx=0).stop 2024-08-31T04:23:27.204 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:27.203+0000 7f61c5e00640 1 -- 172.21.15.50:0/2101428638 shutdown_connections 2024-08-31T04:23:27.205 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:27.203+0000 7f61c5e00640 1 --2- 172.21.15.50:0/2101428638 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f61c0106eb0 0x7f61c010d850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:27.205 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:27.203+0000 7f61c5e00640 1 --2- 172.21.15.50:0/2101428638 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f61c0106510 0x7f61c0106920 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:27.205 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:27.203+0000 7f61c5e00640 1 --2- 172.21.15.50:0/2101428638 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f61c0105490 0x7f61c0105900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:27.205 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:27.203+0000 7f61c5e00640 1 -- 172.21.15.50:0/2101428638 >> 172.21.15.50:0/2101428638 conn(0x7f61c0100df0 msgr2=0x7f61c0103280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:23:27.205 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:27.203+0000 7f61c5e00640 1 -- 172.21.15.50:0/2101428638 shutdown_connections 2024-08-31T04:23:27.205 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:27.203+0000 7f61c5e00640 1 -- 172.21.15.50:0/2101428638 wait complete. 2024-08-31T04:23:27.207 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:27.204+0000 7f61c5e00640 1 Processor -- start 2024-08-31T04:23:27.207 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:27.204+0000 7f61c5e00640 1 -- start start 2024-08-31T04:23:27.207 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:27.204+0000 7f61c5e00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f61c0105490 0x7f61c019bd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:27.207 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:27.204+0000 7f61c5e00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f61c0106510 0x7f61c019c380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:27.207 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:27.204+0000 7f61c5e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f61c0106eb0 0x7f61c019cf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:27.207 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:27.204+0000 7f61c5e00640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f61c0111120 con 0x7f61c0106eb0 2024-08-31T04:23:27.207 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:27.204+0000 7f61c5e00640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f61c0110fa0 con 0x7f61c0105490 2024-08-31T04:23:27.207 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:27.204+0000 7f61c5e00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f61c01112a0 con 0x7f61c0106510 2024-08-31T04:23:27.208 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:27.204+0000 7f61c5400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f61c0106eb0 0x7f61c019cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:27.208 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:27.204+0000 7f61c5400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f61c0106eb0 0x7f61c019cf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49178/0 (socket says 172.21.15.50:49178) 2024-08-31T04:23:27.208 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:27.204+0000 7f61c5400640 1 -- 172.21.15.50:0/1089601709 learned_addr learned my addr 172.21.15.50:0/1089601709 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:23:27.208 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:27.205+0000 7f61bfe00640 1 --2- 172.21.15.50:0/1089601709 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f61c0106510 0x7f61c019c380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:27.208 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:27.205+0000 7f61c4a00640 1 --2- 172.21.15.50:0/1089601709 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f61c0105490 0x7f61c019bd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:27.208 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:27.205+0000 7f61c5400640 1 -- 172.21.15.50:0/1089601709 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f61c0106510 msgr2=0x7f61c019c380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:23:27.208 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:27.205+0000 7f61c5400640 1 --2- 172.21.15.50:0/1089601709 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f61c0106510 0x7f61c019c380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:27.208 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:27.205+0000 7f61c5400640 1 -- 172.21.15.50:0/1089601709 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f61c0105490 msgr2=0x7f61c019bd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:23:27.208 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:27.205+0000 7f61c5400640 1 --2- 172.21.15.50:0/1089601709 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f61c0105490 0x7f61c019bd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:27.208 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:27.205+0000 7f61c5400640 1 -- 172.21.15.50:0/1089601709 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61c019d750 con 0x7f61c0106eb0 2024-08-31T04:23:27.208 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:27.205+0000 7f61c5400640 1 --2- 172.21.15.50:0/1089601709 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f61c0106eb0 0x7f61c019cf30 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f61b800eb10 tx=0x7f61b800c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:23:27.208 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:27.205+0000 7f61bd600640 1 -- 172.21.15.50:0/1089601709 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61b8004b20 con 0x7f61c0106eb0 2024-08-31T04:23:27.208 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:27.205+0000 7f61bd600640 1 -- 172.21.15.50:0/1089601709 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f61b8004cc0 con 0x7f61c0106eb0 2024-08-31T04:23:27.208 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:27.205+0000 7f61c5e00640 1 -- 172.21.15.50:0/1089601709 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f61c019da40 con 0x7f61c0106eb0 2024-08-31T04:23:27.209 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:27.205+0000 7f61bd600640 1 -- 172.21.15.50:0/1089601709 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61b8010670 con 0x7f61c0106eb0 2024-08-31T04:23:27.209 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:27.206+0000 7f61c5e00640 1 -- 172.21.15.50:0/1089601709 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f61c01a4130 con 0x7f61c0106eb0 2024-08-31T04:23:27.210 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:27.209+0000 7f61ce415740 1 Processor -- start 2024-08-31T04:23:27.210 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:27.209+0000 7f61bd600640 1 -- 172.21.15.50:0/1089601709 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 18) ==== 152577+0+0 (secure 0 0 0) 0x7f61b8005020 con 0x7f61c0106eb0 2024-08-31T04:23:27.211 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:27.209+0000 7f61ce415740 1 -- start start 2024-08-31T04:23:27.211 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:27.210+0000 7f61ce415740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55873a5611b0 0x55873a906fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:27.212 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:27.210+0000 7f61ce415740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55873a5382f0 0x55873a907610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:27.212 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:27.210+0000 7f61ce415740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55873a5404d0 0x55873a908160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:27.212 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:27.210+0000 7f61ce415740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55873a879f70 con 0x55873a5382f0 2024-08-31T04:23:27.212 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:27.210+0000 7f61ce415740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x55873a869500 con 0x55873a5404d0 2024-08-31T04:23:27.212 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:27.210+0000 7f61ce415740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x55873a86d4b0 con 0x55873a5611b0 2024-08-31T04:23:27.212 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:27.210+0000 7f61bfe00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55873a5611b0 0x55873a906fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:27.212 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:27.210+0000 7f61c4a00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55873a5382f0 0x55873a907610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:27.212 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:27.210+0000 7f61bfe00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55873a5611b0 0x55873a906fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.50:33910/0 (socket says 172.21.15.50:33910) 2024-08-31T04:23:27.212 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:27.210+0000 7f61bfe00640 1 -- 172.21.15.50:0/2755525401 learned_addr learned my addr 172.21.15.50:0/2755525401 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:23:27.212 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:27.210+0000 7f61bfe00640 1 --2- 172.21.15.50:0/2755525401 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55873a5404d0 0x55873a908160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:27.214 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:27.211+0000 7f61c4a00640 1 -- 172.21.15.50:0/2755525401 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55873a5611b0 msgr2=0x55873a906fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:23:27.214 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:27.211+0000 7f61c4a00640 1 --2- 172.21.15.50:0/2755525401 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55873a5611b0 0x55873a906fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:27.214 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:27.211+0000 7f61c4a00640 1 -- 172.21.15.50:0/2755525401 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55873a5404d0 msgr2=0x55873a908160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:23:27.214 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:27.211+0000 7f61c4a00640 1 --2- 172.21.15.50:0/2755525401 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55873a5404d0 0x55873a908160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:27.214 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:27.211+0000 7f61c4a00640 1 -- 172.21.15.50:0/2755525401 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55873a823c10 con 0x55873a5382f0 2024-08-31T04:23:27.214 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:27.211+0000 7f61c4a00640 1 --2- 172.21.15.50:0/2755525401 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55873a5382f0 0x55873a907610 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f61b4009c00 tx=0x7f61b4011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57ba8eeed312feac server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:23:27.214 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:27.211+0000 7f61b1c00640 1 -- 172.21.15.50:0/2755525401 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61b4004050 con 0x55873a5382f0 2024-08-31T04:23:27.215 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:27.211+0000 7f61b1c00640 1 -- 172.21.15.50:0/2755525401 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f61b40054d0 con 0x55873a5382f0 2024-08-31T04:23:27.215 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:27.211+0000 7f61b1c00640 1 -- 172.21.15.50:0/2755525401 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61b4004c60 con 0x55873a5382f0 2024-08-31T04:23:27.215 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:27.211+0000 7f61bd600640 1 --2- 172.21.15.50:0/1089601709 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f61a80b4bb0 0x7f61a80b70c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:27.215 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:27.212+0000 7f61bd600640 1 -- 172.21.15.50:0/1089601709 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8219+0+0 (secure 0 0 0) 0x7f61b80e56e0 con 0x7f61c0106eb0 2024-08-31T04:23:27.215 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:27.212+0000 7f61bfe00640 1 --2- 172.21.15.50:0/1089601709 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f61a80b4bb0 0x7f61a80b70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:27.215 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:27.212+0000 7f61ce415740 1 -- 172.21.15.50:0/2755525401 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55873a5382f0 msgr2=0x55873a907610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:23:27.215 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:27.212+0000 7f61bfe00640 1 --2- 172.21.15.50:0/1089601709 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f61a80b4bb0 0x7f61a80b70c0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f61ac0096c0 tx=0x7f61ac0314a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:23:27.215 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:27.212+0000 7f61ce415740 1 --2- 172.21.15.50:0/2755525401 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55873a5382f0 0x55873a907610 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f61b4009c00 tx=0x7f61b4011810 comp rx=0 tx=0).stop 2024-08-31T04:23:27.215 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:27.213+0000 7f61ce415740 1 -- 172.21.15.50:0/2755525401 shutdown_connections 2024-08-31T04:23:27.215 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:27.213+0000 7f61ce415740 1 --2- 172.21.15.50:0/2755525401 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55873a5404d0 0x55873a908160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:27.215 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:27.213+0000 7f61ce415740 1 --2- 172.21.15.50:0/2755525401 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55873a5382f0 0x55873a907610 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:27.215 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:27.213+0000 7f61ce415740 1 --2- 172.21.15.50:0/2755525401 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55873a5611b0 0x55873a906fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:27.215 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:27.213+0000 7f61ce415740 1 -- 172.21.15.50:0/2755525401 >> 172.21.15.50:0/2755525401 conn(0x55873a555300 msgr2=0x55873a902a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:23:27.216 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:27.213+0000 7f61ce415740 1 -- 172.21.15.50:0/2755525401 shutdown_connections 2024-08-31T04:23:27.216 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:27.213+0000 7f61ce415740 1 -- 172.21.15.50:0/2755525401 wait complete. 2024-08-31T04:23:27.216 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:27.213+0000 7f61ce415740 1 -- start start 2024-08-31T04:23:27.218 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:27.213+0000 7f61ce415740 1 Processor -- start 2024-08-31T04:23:27.218 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:27.214+0000 7f61ce415740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55873a5382f0 0x55873a9105a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:27.218 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:27.214+0000 7f61ce415740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55873a5404d0 0x55873a910c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:27.218 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:27.214+0000 7f61ce415740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55873a5611b0 0x55873a9117d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:27.218 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:27.214+0000 7f61ce415740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55873a7a2ab0 con 0x55873a5404d0 2024-08-31T04:23:27.219 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:27.214+0000 7f61ce415740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x55873a810320 con 0x55873a5611b0 2024-08-31T04:23:27.219 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:27.214+0000 7f61ce415740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x55873a908c80 con 0x55873a5382f0 2024-08-31T04:23:27.219 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:27.214+0000 7f61ce415740 10 client.0 _ll_register_callbacks cb 0x55873a8166a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:23:27.219 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:27.214+0000 7f61c4a00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55873a5382f0 0x55873a9105a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:27.219 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:27.214+0000 7f61bfe00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55873a5404d0 0x55873a910c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:27.219 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:27.214+0000 7f61c4a00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55873a5382f0 0x55873a9105a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.50:33914/0 (socket says 172.21.15.50:33914) 2024-08-31T04:23:27.219 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:27.214+0000 7f61bfe00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55873a5404d0 0x55873a910c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49210/0 (socket says 172.21.15.50:49210) 2024-08-31T04:23:27.219 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:27.214+0000 7f61bfe00640 1 -- 172.21.15.50:0/3197317156 learned_addr learned my addr 172.21.15.50:0/3197317156 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:23:27.219 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:27.214+0000 7f61c5400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55873a5611b0 0x55873a9117d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:27.219 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:27.215+0000 7f61c5400640 1 -- 172.21.15.50:0/3197317156 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55873a5382f0 msgr2=0x55873a9105a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:23:27.219 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:27.215+0000 7f61c5400640 1 --2- 172.21.15.50:0/3197317156 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55873a5382f0 0x55873a9105a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:27.219 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:27.215+0000 7f61c5400640 1 -- 172.21.15.50:0/3197317156 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55873a5404d0 msgr2=0x55873a910c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:23:27.220 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:27.215+0000 7f61c5400640 1 --2- 172.21.15.50:0/3197317156 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55873a5404d0 0x55873a910c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:27.220 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:27.215+0000 7f61c5400640 1 -- 172.21.15.50:0/3197317156 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55873a5cc790 con 0x55873a5611b0 2024-08-31T04:23:27.220 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:27.215+0000 7f61bfe00640 1 --2- 172.21.15.50:0/3197317156 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55873a5404d0 0x55873a910c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:23:27.220 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:27.215+0000 7f61c5400640 1 --2- 172.21.15.50:0/3197317156 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55873a5611b0 0x55873a9117d0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f61b80a9330 tx=0x7f61b80aba90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=59a82f5d7adbec17 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:23:27.220 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:27.215+0000 7f61a6000640 10 client.0 ms_handle_connect on v2:172.21.15.133:3300/0 2024-08-31T04:23:27.220 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:27.215+0000 7f61a6000640 1 -- 172.21.15.50:0/3197317156 <== mon.2 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61b80ac0c0 con 0x55873a5611b0 2024-08-31T04:23:27.220 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:27.215+0000 7f61ce415740 1 -- 172.21.15.50:0/3197317156 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f61b40054d0 con 0x55873a5611b0 2024-08-31T04:23:27.220 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:27.215+0000 7f61a6000640 1 -- 172.21.15.50:0/3197317156 <== mon.2 v2:172.21.15.133:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8219+0+0 (secure 0 0 0) 0x7f61b80ac530 con 0x55873a5611b0 2024-08-31T04:23:27.220 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:27.215+0000 7f61a6000640 1 -- 172.21.15.50:0/3197317156 <== mon.2 v2:172.21.15.133:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f61b80b0930 con 0x55873a5611b0 2024-08-31T04:23:27.220 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:27.215+0000 7f61ce415740 10 client.25436 fetch_fsmap learned FSMap version 29 2024-08-31T04:23:27.220 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:27.215+0000 7f61ce415740 1 -- 172.21.15.50:0/3197317156 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55873a645620 con 0x55873a5611b0 2024-08-31T04:23:27.220 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:27.216+0000 7f61a6000640 1 -- 172.21.15.50:0/3197317156 <== mon.2 v2:172.21.15.133:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f61b40054d0 con 0x55873a5611b0 2024-08-31T04:23:27.220 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:27.216+0000 7f61a6000640 1 -- 172.21.15.50:0/3197317156 <== mon.2 v2:172.21.15.133:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f61b80a7bc0 con 0x55873a5611b0 2024-08-31T04:23:27.221 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:27.216+0000 7f61ce415740 10 client.25436 fetch_fsmap finished waiting for FSMap version 29 2024-08-31T04:23:27.221 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:27.216+0000 7f61ce415740 10 client.25436 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T04:23:27.221 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:27.216+0000 7f61ce415740 20 client.25436 populate_metadata read hostname 'smithi050' 2024-08-31T04:23:27.221 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:27.216+0000 7f61ce415740 1 --2- 172.21.15.50:0/3197317156 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x55873a51fd80 0x55873a91dd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:27.221 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:27.216+0000 7f61ce415740 4 client.25436 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T04:23:27.221 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:27.216+0000 7f61ce415740 1 -- 172.21.15.50:0/3197317156 --> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55873a87bec0 con 0x55873a51fd80 2024-08-31T04:23:27.221 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:27.216+0000 7f61c4a00640 1 --2- 172.21.15.50:0/3197317156 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x55873a51fd80 0x55873a91dd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:27.221 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:27.217+0000 7f61c4a00640 1 --2- 172.21.15.50:0/3197317156 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x55873a51fd80 0x55873a91dd90 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=78bc9d57eb0b4787 server_cookie=5183e49c8e1d84f3 in_seq=0 out_seq=0 2024-08-31T04:23:27.221 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:27.217+0000 7f61a6000640 10 client.25436 ms_handle_connect on v2:172.21.15.133:6838/2526402262 2024-08-31T04:23:27.222 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:27.218+0000 7f61a6000640 1 -- 172.21.15.50:0/3197317156 <== mds.0 v2:172.21.15.133:6838/2526402262 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55873a87bec0 con 0x55873a51fd80 2024-08-31T04:23:27.222 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:27.218+0000 7f61a6000640 10 client.25436 handle_command_reply: tid=0 2024-08-31T04:23:27.222 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:27.218+0000 7f61ce415740 1 client.25436 shutdown 2024-08-31T04:23:27.222 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:27.218+0000 7f61ce415740 1 -- 172.21.15.50:0/3197317156 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55873a5611b0 msgr2=0x55873a9117d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:23:27.223 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:27.218+0000 7f61ce415740 1 --2- 172.21.15.50:0/3197317156 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55873a5611b0 0x55873a9117d0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f61b80a9330 tx=0x7f61b80aba90 comp rx=0 tx=0).stop 2024-08-31T04:23:27.223 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:27.218+0000 7f61ce415740 1 -- 172.21.15.50:0/3197317156 shutdown_connections 2024-08-31T04:23:27.223 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:27.218+0000 7f61ce415740 1 --2- 172.21.15.50:0/3197317156 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x55873a51fd80 0x55873a91dd90 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:27.223 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:27.218+0000 7f61ce415740 1 --2- 172.21.15.50:0/3197317156 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55873a5611b0 0x55873a9117d0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:27.223 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:27.218+0000 7f61ce415740 1 --2- 172.21.15.50:0/3197317156 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55873a5404d0 0x55873a910c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:27.223 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:27.218+0000 7f61ce415740 1 --2- 172.21.15.50:0/3197317156 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55873a5382f0 0x55873a9105a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:27.223 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:27.218+0000 7f61a6000640 0 client.25436 ms_handle_reset on v2:172.21.15.133:6838/2526402262 2024-08-31T04:23:27.223 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:27.218+0000 7f61ce415740 1 -- 172.21.15.50:0/3197317156 >> 172.21.15.50:0/3197317156 conn(0x55873a555300 msgr2=0x55873a903630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:23:27.223 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:27.218+0000 7f61ce415740 1 -- 172.21.15.50:0/3197317156 shutdown_connections 2024-08-31T04:23:27.223 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:27.219+0000 7f61ce415740 1 -- 172.21.15.50:0/3197317156 wait complete. 2024-08-31T04:23:27.223 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:27.219+0000 7f61ce415740 20 client.25436 trim_cache size 0 max 16384 2024-08-31T04:23:27.235 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:27.234+0000 7f61ce415740 1 Processor -- start 2024-08-31T04:23:27.236 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:27.234+0000 7f61ce415740 1 -- start start 2024-08-31T04:23:27.236 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:27.234+0000 7f61ce415740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55873a5382f0 0x55873a903c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:27.236 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:27.234+0000 7f61ce415740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55873a5404d0 0x55873a90b090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:27.236 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:27.234+0000 7f61ce415740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55873a5611b0 0x55873a90b5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:27.236 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:27.234+0000 7f61ce415740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f61c01acbc0 con 0x55873a5611b0 2024-08-31T04:23:27.236 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:27.234+0000 7f61ce415740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f61c01ae700 con 0x55873a5404d0 2024-08-31T04:23:27.236 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:27.234+0000 7f61ce415740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f61c01ad290 con 0x55873a5382f0 2024-08-31T04:23:27.236 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:27.234+0000 7f61c5400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55873a5611b0 0x55873a90b5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:27.236 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:27.234+0000 7f61c5400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55873a5611b0 0x55873a90b5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49226/0 (socket says 172.21.15.50:49226) 2024-08-31T04:23:27.236 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:27.234+0000 7f61c5400640 1 -- 172.21.15.50:0/3724492523 learned_addr learned my addr 172.21.15.50:0/3724492523 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:23:27.236 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:27.234+0000 7f61bfe00640 1 --2- 172.21.15.50:0/3724492523 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55873a5404d0 0x55873a90b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:27.236 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:27.235+0000 7f61c4a00640 1 --2- 172.21.15.50:0/3724492523 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55873a5382f0 0x55873a903c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:27.238 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:27.235+0000 7f61c5400640 1 -- 172.21.15.50:0/3724492523 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55873a5382f0 msgr2=0x55873a903c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:23:27.238 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:27.235+0000 7f61c5400640 1 --2- 172.21.15.50:0/3724492523 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55873a5382f0 0x55873a903c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:27.238 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:27.235+0000 7f61c5400640 1 -- 172.21.15.50:0/3724492523 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55873a5404d0 msgr2=0x55873a90b090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:23:27.238 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:27.235+0000 7f61c5400640 1 --2- 172.21.15.50:0/3724492523 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55873a5404d0 0x55873a90b090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:27.239 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:27.235+0000 7f61c5400640 1 -- 172.21.15.50:0/3724492523 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55873a903380 con 0x55873a5611b0 2024-08-31T04:23:27.239 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:27.235+0000 7f61c4a00640 1 --2- 172.21.15.50:0/3724492523 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55873a5382f0 0x55873a903c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:23:27.239 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:27.235+0000 7f61c5400640 1 --2- 172.21.15.50:0/3724492523 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55873a5611b0 0x55873a90b5d0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f61b80b0af0 tx=0x7f61b80ac930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a59aed14a61cbc7c server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:23:27.239 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:27.235+0000 7f61b1200640 1 -- 172.21.15.50:0/3724492523 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61b80ac0c0 con 0x55873a5611b0 2024-08-31T04:23:27.239 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:27.235+0000 7f61b1200640 1 -- 172.21.15.50:0/3724492523 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f61b80b53e0 con 0x55873a5611b0 2024-08-31T04:23:27.239 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:27.235+0000 7f61b1200640 1 -- 172.21.15.50:0/3724492523 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61b80b1b90 con 0x55873a5611b0 2024-08-31T04:23:27.239 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:27.236+0000 7f61ce415740 1 -- 172.21.15.50:0/3724492523 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55873a5611b0 msgr2=0x55873a90b5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:23:27.239 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:27.236+0000 7f61ce415740 1 --2- 172.21.15.50:0/3724492523 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55873a5611b0 0x55873a90b5d0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f61b80b0af0 tx=0x7f61b80ac930 comp rx=0 tx=0).stop 2024-08-31T04:23:27.239 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:27.236+0000 7f61ce415740 1 -- 172.21.15.50:0/3724492523 shutdown_connections 2024-08-31T04:23:27.239 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:27.236+0000 7f61ce415740 1 --2- 172.21.15.50:0/3724492523 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55873a5611b0 0x55873a90b5d0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:27.239 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:27.236+0000 7f61ce415740 1 --2- 172.21.15.50:0/3724492523 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55873a5404d0 0x55873a90b090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:27.240 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:27.236+0000 7f61ce415740 1 --2- 172.21.15.50:0/3724492523 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55873a5382f0 0x55873a903c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:27.240 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:27.236+0000 7f61ce415740 1 -- 172.21.15.50:0/3724492523 >> 172.21.15.50:0/3724492523 conn(0x55873a555300 msgr2=0x55873a903570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:23:27.240 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:27.236+0000 7f61ce415740 1 -- 172.21.15.50:0/3724492523 shutdown_connections 2024-08-31T04:23:27.240 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:27.236+0000 7f61ce415740 1 -- 172.21.15.50:0/3724492523 wait complete. 2024-08-31T04:23:27.240 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:27.237+0000 7f61ce415740 1 -- start start 2024-08-31T04:23:27.240 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:27.237+0000 7f61ce415740 1 Processor -- start 2024-08-31T04:23:27.240 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:27.237+0000 7f61ce415740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55873a5382f0 0x55873a915a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:27.240 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:27.237+0000 7f61ce415740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55873a5404d0 0x55873a9160f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:27.240 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:27.237+0000 7f61ce415740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55873a5611b0 0x55873a916bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:27.240 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:27.237+0000 7f61ce415740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f61c01ae030 con 0x55873a5611b0 2024-08-31T04:23:27.240 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:27.237+0000 7f61ce415740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f61c01ad960 con 0x55873a5404d0 2024-08-31T04:23:27.240 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:27.237+0000 7f61ce415740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f61c01aaba0 con 0x55873a5382f0 2024-08-31T04:23:27.240 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:27.237+0000 7f61ce415740 10 client.0 _ll_register_callbacks cb 0x7f61b80a7f80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:23:27.242 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:27.238+0000 7f61c5400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55873a5611b0 0x55873a916bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:27.243 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:27.238+0000 7f61c4a00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55873a5382f0 0x55873a915a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:27.243 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:27.238+0000 7f61c5400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55873a5611b0 0x55873a916bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49232/0 (socket says 172.21.15.50:49232) 2024-08-31T04:23:27.243 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:27.238+0000 7f61c5400640 1 -- 172.21.15.50:0/1738526808 learned_addr learned my addr 172.21.15.50:0/1738526808 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:23:27.243 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:27.238+0000 7f61bfe00640 1 --2- 172.21.15.50:0/1738526808 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55873a5404d0 0x55873a9160f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:27.243 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:27.238+0000 7f61c5400640 1 -- 172.21.15.50:0/1738526808 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55873a5382f0 msgr2=0x55873a915a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:23:27.243 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:27.238+0000 7f61c5400640 1 --2- 172.21.15.50:0/1738526808 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55873a5382f0 0x55873a915a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:27.243 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:27.238+0000 7f61c5400640 1 -- 172.21.15.50:0/1738526808 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55873a5404d0 msgr2=0x55873a9160f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:23:27.243 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:27.238+0000 7f61c5400640 1 --2- 172.21.15.50:0/1738526808 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55873a5404d0 0x55873a9160f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:27.243 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:27.238+0000 7f61c5400640 1 -- 172.21.15.50:0/1738526808 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55873a917350 con 0x55873a5611b0 2024-08-31T04:23:27.243 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:27.238+0000 7f61c4a00640 1 --2- 172.21.15.50:0/1738526808 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55873a5382f0 0x55873a915a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:23:27.243 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:27.238+0000 7f61c5400640 1 --2- 172.21.15.50:0/1738526808 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55873a5611b0 0x55873a916bf0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f61b800cf20 tx=0x7f61b80a7e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6fc5da500de9c605 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:23:27.243 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:27.238+0000 7f61a6000640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-08-31T04:23:27.244 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:27.238+0000 7f61a6000640 1 -- 172.21.15.50:0/1738526808 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61b80ac0c0 con 0x55873a5611b0 2024-08-31T04:23:27.244 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:27.239+0000 7f61a6000640 1 -- 172.21.15.50:0/1738526808 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8219+0+0 (secure 0 0 0) 0x7f61b80aaf20 con 0x55873a5611b0 2024-08-31T04:23:27.244 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:27.239+0000 7f61ce415740 1 -- 172.21.15.50:0/1738526808 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f61b80b53e0 con 0x55873a5611b0 2024-08-31T04:23:27.244 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:27.239+0000 7f61a6000640 1 -- 172.21.15.50:0/1738526808 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f61b80cd3a0 con 0x55873a5611b0 2024-08-31T04:23:27.244 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:27.239+0000 7f61ce415740 10 client.15456 fetch_fsmap learned FSMap version 29 2024-08-31T04:23:27.244 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:27.239+0000 7f61ce415740 1 -- 172.21.15.50:0/1738526808 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55873a918640 con 0x55873a5611b0 2024-08-31T04:23:27.244 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:27.239+0000 7f61a6000640 1 -- 172.21.15.50:0/1738526808 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f61b8089020 con 0x55873a5611b0 2024-08-31T04:23:27.244 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:27.239+0000 7f61a6000640 1 -- 172.21.15.50:0/1738526808 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f61b8097200 con 0x55873a5611b0 2024-08-31T04:23:27.244 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:27.239+0000 7f61ce415740 10 client.15456 fetch_fsmap finished waiting for FSMap version 29 2024-08-31T04:23:27.244 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:27.239+0000 7f61ce415740 10 client.15456 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T04:23:27.244 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:27.239+0000 7f61ce415740 20 client.15456 populate_metadata read hostname 'smithi050' 2024-08-31T04:23:27.244 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:27.239+0000 7f61ce415740 1 --2- 172.21.15.50:0/1738526808 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x55873a4f51c0 0x55873a98a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:27.244 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:27.239+0000 7f61ce415740 4 client.15456 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-31T04:23:27.244 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:27.239+0000 7f61ce415740 1 -- 172.21.15.50:0/1738526808 --> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55873a877960 con 0x55873a4f51c0 2024-08-31T04:23:27.245 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:27.240+0000 7f61c4a00640 1 --2- 172.21.15.50:0/1738526808 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x55873a4f51c0 0x55873a98a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:27.245 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:27.240+0000 7f61c4a00640 1 --2- 172.21.15.50:0/1738526808 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x55873a4f51c0 0x55873a98a7a0 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=61e8b952641c3460 server_cookie=d14cac6f3c6a4de9 in_seq=0 out_seq=0 2024-08-31T04:23:27.245 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:27.240+0000 7f61a6000640 10 client.15456 ms_handle_connect on v2:172.21.15.133:6838/2526402262 2024-08-31T04:23:27.252 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:27.250+0000 7f61a6000640 1 -- 172.21.15.50:0/1738526808 <== mds.0 v2:172.21.15.133:6838/2526402262 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55873a877960 con 0x55873a4f51c0 2024-08-31T04:23:27.252 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:27.250+0000 7f61a6000640 10 client.15456 handle_command_reply: tid=0 2024-08-31T04:23:27.252 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:27.250+0000 7f61ce415740 1 client.15456 shutdown 2024-08-31T04:23:27.252 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:27.250+0000 7f61ce415740 1 -- 172.21.15.50:0/1738526808 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55873a5611b0 msgr2=0x55873a916bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:23:27.252 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:27.250+0000 7f61ce415740 1 --2- 172.21.15.50:0/1738526808 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55873a5611b0 0x55873a916bf0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f61b800cf20 tx=0x7f61b80a7e30 comp rx=0 tx=0).stop 2024-08-31T04:23:27.252 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:27.250+0000 7f61ce415740 1 -- 172.21.15.50:0/1738526808 shutdown_connections 2024-08-31T04:23:27.252 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:27.250+0000 7f61ce415740 1 --2- 172.21.15.50:0/1738526808 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x55873a4f51c0 0x55873a98a7a0 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:27.252 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:27.250+0000 7f61ce415740 1 --2- 172.21.15.50:0/1738526808 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55873a5611b0 0x55873a916bf0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:27.253 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:27.250+0000 7f61ce415740 1 --2- 172.21.15.50:0/1738526808 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55873a5404d0 0x55873a9160f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:27.253 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:27.250+0000 7f61ce415740 1 --2- 172.21.15.50:0/1738526808 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55873a5382f0 0x55873a915a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:27.253 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:27.250+0000 7f61a6000640 0 client.15456 ms_handle_reset on v2:172.21.15.133:6838/2526402262 2024-08-31T04:23:27.253 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:27.250+0000 7f61ce415740 1 -- 172.21.15.50:0/1738526808 >> 172.21.15.50:0/1738526808 conn(0x55873a555300 msgr2=0x55873a90e6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:23:27.253 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:27.251+0000 7f61ce415740 1 -- 172.21.15.50:0/1738526808 shutdown_connections 2024-08-31T04:23:27.253 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:27.251+0000 7f61ce415740 1 -- 172.21.15.50:0/1738526808 wait complete. 2024-08-31T04:23:27.253 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:27.251+0000 7f61ce415740 20 client.15456 trim_cache size 0 max 16384 2024-08-31T04:23:27.253 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout:{ 2024-08-31T04:23:27.253 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout: "message": "", 2024-08-31T04:23:27.253 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout: "return_code": 0 2024-08-31T04:23:27.253 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout:} 2024-08-31T04:23:27.254 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:27.251+0000 7f61c5e00640 1 -- 172.21.15.50:0/1089601709 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f61a80b4bb0 msgr2=0x7f61a80b70c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:23:27.254 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:27.251+0000 7f61c5e00640 1 --2- 172.21.15.50:0/1089601709 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f61a80b4bb0 0x7f61a80b70c0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f61ac0096c0 tx=0x7f61ac0314a0 comp rx=0 tx=0).stop 2024-08-31T04:23:27.254 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:27.251+0000 7f61c5e00640 1 -- 172.21.15.50:0/1089601709 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f61c0106eb0 msgr2=0x7f61c019cf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:23:27.254 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:27.251+0000 7f61c5e00640 1 --2- 172.21.15.50:0/1089601709 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f61c0106eb0 0x7f61c019cf30 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f61b800eb10 tx=0x7f61b800c2d0 comp rx=0 tx=0).stop 2024-08-31T04:23:27.254 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:27.252+0000 7f61c5e00640 1 -- 172.21.15.50:0/1089601709 shutdown_connections 2024-08-31T04:23:27.255 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:27.252+0000 7f61c5e00640 1 --2- 172.21.15.50:0/1089601709 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f61a80b4bb0 0x7f61a80b70c0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:27.255 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:27.252+0000 7f61c5e00640 1 --2- 172.21.15.50:0/1089601709 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f61c0106510 0x7f61c019c380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:27.255 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:27.252+0000 7f61c5e00640 1 --2- 172.21.15.50:0/1089601709 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f61c0106eb0 0x7f61c019cf30 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:27.255 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:27.252+0000 7f61c5e00640 1 --2- 172.21.15.50:0/1089601709 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f61c0105490 0x7f61c019bd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:27.255 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:27.252+0000 7f61c5e00640 1 -- 172.21.15.50:0/1089601709 >> 172.21.15.50:0/1089601709 conn(0x7f61c0100df0 msgr2=0x7f61c0109830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:23:27.255 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:27.252+0000 7f61c5e00640 1 -- 172.21.15.50:0/1089601709 shutdown_connections 2024-08-31T04:23:27.255 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:27.252+0000 7f61c5e00640 1 -- 172.21.15.50:0/1089601709 wait complete. 2024-08-31T04:23:27.950 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:23:27 smithi050 ceph-mon[17259]: pgmap v383: 97 pgs: 97 active+clean; 660 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 2.7 KiB/s wr, 15 op/s 2024-08-31T04:23:27.996 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:23:27 smithi177 ceph-mon[22025]: pgmap v383: 97 pgs: 97 active+clean; 660 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 2.7 KiB/s wr, 15 op/s 2024-08-31T04:23:28.042 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:23:27 smithi133 ceph-mon[22177]: pgmap v383: 97 pgs: 97 active+clean; 660 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 2.7 KiB/s wr, 15 op/s 2024-08-31T04:23:29.950 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:23:29 smithi050 ceph-mon[17259]: pgmap v384: 97 pgs: 97 active+clean; 660 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 1.8 KiB/s wr, 12 op/s 2024-08-31T04:23:29.996 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:23:29 smithi177 ceph-mon[22025]: pgmap v384: 97 pgs: 97 active+clean; 660 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 1.8 KiB/s wr, 12 op/s 2024-08-31T04:23:30.043 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:23:29 smithi133 ceph-mon[22177]: pgmap v384: 97 pgs: 97 active+clean; 660 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 1.8 KiB/s wr, 12 op/s 2024-08-31T04:23:31.950 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:23:31 smithi050 ceph-mon[17259]: pgmap v385: 97 pgs: 97 active+clean; 660 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 255 B/s wr, 9 op/s 2024-08-31T04:23:31.996 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:23:31 smithi177 ceph-mon[22025]: pgmap v385: 97 pgs: 97 active+clean; 660 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 255 B/s wr, 9 op/s 2024-08-31T04:23:32.043 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:23:31 smithi133 ceph-mon[22177]: pgmap v385: 97 pgs: 97 active+clean; 660 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 255 B/s wr, 9 op/s 2024-08-31T04:23:33.949 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:23:33 smithi050 ceph-mon[17259]: pgmap v386: 97 pgs: 97 active+clean; 663 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 1.3 KiB/s wr, 14 op/s 2024-08-31T04:23:33.997 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:23:33 smithi177 ceph-mon[22025]: pgmap v386: 97 pgs: 97 active+clean; 663 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 1.3 KiB/s wr, 14 op/s 2024-08-31T04:23:34.043 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:23:33 smithi133 ceph-mon[22177]: pgmap v386: 97 pgs: 97 active+clean; 663 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 1.3 KiB/s wr, 14 op/s 2024-08-31T04:23:35.950 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:23:35 smithi050 ceph-mon[17259]: pgmap v387: 97 pgs: 97 active+clean; 663 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 1.1 KiB/s wr, 10 op/s 2024-08-31T04:23:35.996 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:23:35 smithi177 ceph-mon[22025]: pgmap v387: 97 pgs: 97 active+clean; 663 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 1.1 KiB/s wr, 10 op/s 2024-08-31T04:23:36.043 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:23:35 smithi133 ceph-mon[22177]: pgmap v387: 97 pgs: 97 active+clean; 663 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 1.1 KiB/s wr, 10 op/s 2024-08-31T04:23:37.950 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:23:37 smithi050 ceph-mon[17259]: pgmap v388: 97 pgs: 97 active+clean; 663 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 1.1 KiB/s wr, 12 op/s 2024-08-31T04:23:37.996 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:23:37 smithi177 ceph-mon[22025]: pgmap v388: 97 pgs: 97 active+clean; 663 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 1.1 KiB/s wr, 12 op/s 2024-08-31T04:23:38.043 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:23:37 smithi133 ceph-mon[22177]: pgmap v388: 97 pgs: 97 active+clean; 663 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 1.1 KiB/s wr, 12 op/s 2024-08-31T04:23:39.949 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:23:39 smithi050 ceph-mon[17259]: pgmap v389: 97 pgs: 97 active+clean; 663 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1.1 KiB/s wr, 12 op/s 2024-08-31T04:23:39.996 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:23:39 smithi177 ceph-mon[22025]: pgmap v389: 97 pgs: 97 active+clean; 663 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1.1 KiB/s wr, 12 op/s 2024-08-31T04:23:40.043 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:23:39 smithi133 ceph-mon[22177]: pgmap v389: 97 pgs: 97 active+clean; 663 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1.1 KiB/s wr, 12 op/s 2024-08-31T04:23:40.443 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:40.441+0000 7fe042e00640 1 -- 172.21.15.50:0/2838369284 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe03c109020 msgr2=0x7fe03c10b530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:23:40.443 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:40.441+0000 7fe042e00640 1 --2- 172.21.15.50:0/2838369284 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe03c109020 0x7fe03c10b530 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fe034009ca0 tx=0x7fe03402a8c0 comp rx=0 tx=0).stop 2024-08-31T04:23:40.443 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:40.441+0000 7fe042e00640 1 -- 172.21.15.50:0/2838369284 shutdown_connections 2024-08-31T04:23:40.443 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:40.441+0000 7fe042e00640 1 --2- 172.21.15.50:0/2838369284 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe03c106460 0x7fe03c1088e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:40.443 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:40.441+0000 7fe042e00640 1 --2- 172.21.15.50:0/2838369284 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe03c109020 0x7fe03c10b530 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:40.443 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:40.441+0000 7fe042e00640 1 --2- 172.21.15.50:0/2838369284 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe03c06b4b0 0x7fe03c105f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:40.443 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:40.441+0000 7fe042e00640 1 -- 172.21.15.50:0/2838369284 >> 172.21.15.50:0/2838369284 conn(0x7fe03c0fdb20 msgr2=0x7fe03c0fffd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:23:40.443 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:40.441+0000 7fe042e00640 1 -- 172.21.15.50:0/2838369284 shutdown_connections 2024-08-31T04:23:40.443 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:40.441+0000 7fe042e00640 1 -- 172.21.15.50:0/2838369284 wait complete. 2024-08-31T04:23:40.444 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:40.442+0000 7fe042e00640 1 Processor -- start 2024-08-31T04:23:40.444 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:40.443+0000 7fe042e00640 1 -- start start 2024-08-31T04:23:40.444 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:40.443+0000 7fe042e00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe03c06b4b0 0x7fe03c199b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:40.444 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:40.443+0000 7fe042e00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe03c106460 0x7fe03c19a180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:40.445 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:40.443+0000 7fe042e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe03c109020 0x7fe03c19ad30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:40.445 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:40.443+0000 7fe042e00640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fe03c10ef20 con 0x7fe03c109020 2024-08-31T04:23:40.445 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:40.443+0000 7fe042e00640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7fe03c10eda0 con 0x7fe03c106460 2024-08-31T04:23:40.445 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:40.443+0000 7fe042e00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fe03c10f0a0 con 0x7fe03c06b4b0 2024-08-31T04:23:40.445 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:40.443+0000 7fe042400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe03c109020 0x7fe03c19ad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:40.445 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:40.443+0000 7fe041a00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe03c06b4b0 0x7fe03c199b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:40.445 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:40.443+0000 7fe041000640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe03c106460 0x7fe03c19a180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:40.445 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:40.443+0000 7fe042400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe03c109020 0x7fe03c19ad30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:34082/0 (socket says 172.21.15.50:34082) 2024-08-31T04:23:40.445 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:40.443+0000 7fe042400640 1 -- 172.21.15.50:0/1856637891 learned_addr learned my addr 172.21.15.50:0/1856637891 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:23:40.446 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:40.444+0000 7fe041000640 1 -- 172.21.15.50:0/1856637891 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe03c06b4b0 msgr2=0x7fe03c199b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:23:40.446 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:40.444+0000 7fe041000640 1 --2- 172.21.15.50:0/1856637891 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe03c06b4b0 0x7fe03c199b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:40.446 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:40.444+0000 7fe041000640 1 -- 172.21.15.50:0/1856637891 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe03c109020 msgr2=0x7fe03c19ad30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:23:40.446 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:40.444+0000 7fe041000640 1 --2- 172.21.15.50:0/1856637891 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe03c109020 0x7fe03c19ad30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:40.446 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:40.444+0000 7fe041000640 1 -- 172.21.15.50:0/1856637891 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe03c19b550 con 0x7fe03c106460 2024-08-31T04:23:40.447 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:40.444+0000 7fe042400640 1 --2- 172.21.15.50:0/1856637891 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe03c109020 0x7fe03c19ad30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:23:40.447 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:40.444+0000 7fe041000640 1 --2- 172.21.15.50:0/1856637891 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe03c106460 0x7fe03c19a180 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fe02800e9c0 tx=0x7fe02800ee80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:23:40.447 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:40.444+0000 7fe03a000640 1 -- 172.21.15.50:0/1856637891 <== mon.2 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe02800ccc0 con 0x7fe03c106460 2024-08-31T04:23:40.447 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:40.444+0000 7fe042e00640 1 -- 172.21.15.50:0/1856637891 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe03c19b840 con 0x7fe03c106460 2024-08-31T04:23:40.447 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:40.445+0000 7fe03a000640 1 -- 172.21.15.50:0/1856637891 <== mon.2 v2:172.21.15.133:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe028005020 con 0x7fe03c106460 2024-08-31T04:23:40.447 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:40.445+0000 7fe03a000640 1 -- 172.21.15.50:0/1856637891 <== mon.2 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe028004a00 con 0x7fe03c106460 2024-08-31T04:23:40.447 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:40.445+0000 7fe042e00640 1 -- 172.21.15.50:0/1856637891 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe03c1a1f30 con 0x7fe03c106460 2024-08-31T04:23:40.449 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:40.448+0000 7fe04b616740 1 Processor -- start 2024-08-31T04:23:40.449 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:40.448+0000 7fe04b616740 1 -- start start 2024-08-31T04:23:40.450 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:40.448+0000 7fe04b616740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55787cd911b0 0x55787d13b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:40.450 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:40.448+0000 7fe04b616740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55787cd682f0 0x55787d13ba20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:40.451 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:40.448+0000 7fe04b616740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55787cd704d0 0x55787d13c570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:40.451 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:40.448+0000 7fe04b616740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55787d0a9f70 con 0x55787cd682f0 2024-08-31T04:23:40.451 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:40.448+0000 7fe04b616740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x55787d099500 con 0x55787cd911b0 2024-08-31T04:23:40.451 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:40.448+0000 7fe04b616740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x55787d09d4b0 con 0x55787cd704d0 2024-08-31T04:23:40.451 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:40.449+0000 7fe041a00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55787cd682f0 0x55787d13ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:40.451 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:40.449+0000 7fe041a00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55787cd682f0 0x55787d13ba20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:34084/0 (socket says 172.21.15.50:34084) 2024-08-31T04:23:40.451 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:40.449+0000 7fe041a00640 1 -- 172.21.15.50:0/1474699849 learned_addr learned my addr 172.21.15.50:0/1474699849 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:23:40.451 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:40.449+0000 7fe042400640 1 --2- 172.21.15.50:0/1474699849 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55787cd911b0 0x55787d13b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:40.451 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:40.449+0000 7fe041a00640 1 -- 172.21.15.50:0/1474699849 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55787cd704d0 msgr2=0x55787d13c570 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-31T04:23:40.451 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:40.449+0000 7fe041a00640 1 --2- 172.21.15.50:0/1474699849 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55787cd704d0 0x55787d13c570 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:40.451 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:40.449+0000 7fe041a00640 1 -- 172.21.15.50:0/1474699849 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55787cd911b0 msgr2=0x55787d13b3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:23:40.451 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:40.449+0000 7fe041a00640 1 --2- 172.21.15.50:0/1474699849 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55787cd911b0 0x55787d13b3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:40.451 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:40.449+0000 7fe041a00640 1 -- 172.21.15.50:0/1474699849 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55787d053c10 con 0x55787cd682f0 2024-08-31T04:23:40.451 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:40.449+0000 7fe041a00640 1 --2- 172.21.15.50:0/1474699849 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55787cd682f0 0x55787d13ba20 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fe030009cf0 tx=0x7fe030011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ac5f6484a4210a3 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:23:40.453 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:40.450+0000 7fe02ea00640 1 -- 172.21.15.50:0/1474699849 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe030004230 con 0x55787cd682f0 2024-08-31T04:23:40.453 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:40.450+0000 7fe02ea00640 1 -- 172.21.15.50:0/1474699849 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe0300043d0 con 0x55787cd682f0 2024-08-31T04:23:40.453 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:40.450+0000 7fe02ea00640 1 -- 172.21.15.50:0/1474699849 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0300197e0 con 0x55787cd682f0 2024-08-31T04:23:40.453 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:40.451+0000 7fe04b616740 1 -- 172.21.15.50:0/1474699849 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55787cd682f0 msgr2=0x55787d13ba20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:23:40.453 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:40.451+0000 7fe04b616740 1 --2- 172.21.15.50:0/1474699849 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55787cd682f0 0x55787d13ba20 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fe030009cf0 tx=0x7fe030011810 comp rx=0 tx=0).stop 2024-08-31T04:23:40.453 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:40.451+0000 7fe04b616740 1 -- 172.21.15.50:0/1474699849 shutdown_connections 2024-08-31T04:23:40.453 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:40.451+0000 7fe04b616740 1 --2- 172.21.15.50:0/1474699849 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55787cd704d0 0x55787d13c570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:40.453 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:40.451+0000 7fe04b616740 1 --2- 172.21.15.50:0/1474699849 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55787cd682f0 0x55787d13ba20 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:40.453 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:40.451+0000 7fe04b616740 1 --2- 172.21.15.50:0/1474699849 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55787cd911b0 0x55787d13b3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:40.453 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:40.451+0000 7fe04b616740 1 -- 172.21.15.50:0/1474699849 >> 172.21.15.50:0/1474699849 conn(0x55787cd85300 msgr2=0x55787d132a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:23:40.454 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:40.451+0000 7fe03a000640 1 -- 172.21.15.50:0/1856637891 <== mon.2 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 18) ==== 152577+0+0 (secure 0 0 0) 0x7fe0280051d0 con 0x7fe03c106460 2024-08-31T04:23:40.454 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:40.451+0000 7fe04b616740 1 -- 172.21.15.50:0/1474699849 shutdown_connections 2024-08-31T04:23:40.454 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:40.451+0000 7fe04b616740 1 -- 172.21.15.50:0/1474699849 wait complete. 2024-08-31T04:23:40.454 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:40.452+0000 7fe04b616740 1 -- start start 2024-08-31T04:23:40.454 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:40.452+0000 7fe04b616740 1 Processor -- start 2024-08-31T04:23:40.456 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:40.452+0000 7fe04b616740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55787cd682f0 0x55787d144ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:40.456 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:40.452+0000 7fe04b616740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55787cd911b0 0x55787d145180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:40.456 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:40.452+0000 7fe04b616740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55787cd4fd80 0x55787d145cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:40.456 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:40.452+0000 7fe04b616740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55787cfd2ab0 con 0x55787cd911b0 2024-08-31T04:23:40.456 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:40.452+0000 7fe04b616740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x55787d040320 con 0x55787cd682f0 2024-08-31T04:23:40.456 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:40.452+0000 7fe04b616740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x55787d13d090 con 0x55787cd4fd80 2024-08-31T04:23:40.456 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:40.452+0000 7fe04b616740 10 client.0 _ll_register_callbacks cb 0x55787d0466a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:23:40.456 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:40.453+0000 7fe042400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55787cd682f0 0x55787d144ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:40.457 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:40.453+0000 7fe042400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55787cd682f0 0x55787d144ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.50:51002/0 (socket says 172.21.15.50:51002) 2024-08-31T04:23:40.457 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:40.453+0000 7fe042400640 1 -- 172.21.15.50:0/225768777 learned_addr learned my addr 172.21.15.50:0/225768777 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:23:40.457 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:40.453+0000 7fe03a000640 1 --2- 172.21.15.50:0/1856637891 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fe0240b4a40 0x7fe0240b6f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:40.457 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:40.453+0000 7fe041a00640 1 --2- 172.21.15.50:0/225768777 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55787cd911b0 0x55787d145180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:40.457 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:40.453+0000 7fe03a000640 1 -- 172.21.15.50:0/1856637891 <== mon.2 v2:172.21.15.133:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8219+0+0 (secure 0 0 0) 0x7fe0280e5100 con 0x7fe03c106460 2024-08-31T04:23:40.457 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:40.453+0000 7fe041000640 1 --2- 172.21.15.50:0/225768777 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55787cd4fd80 0x55787d145cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:40.457 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:40.453+0000 7fe042400640 1 --2- 172.21.15.50:0/1856637891 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fe0240b4a40 0x7fe0240b6f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:40.457 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:40.454+0000 7fe041a00640 1 -- 172.21.15.50:0/225768777 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55787cd4fd80 msgr2=0x55787d145cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:23:40.457 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:40.454+0000 7fe041a00640 1 --2- 172.21.15.50:0/225768777 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55787cd4fd80 0x55787d145cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:40.457 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:40.454+0000 7fe041a00640 1 -- 172.21.15.50:0/225768777 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55787cd682f0 msgr2=0x55787d144ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:23:40.457 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:40.454+0000 7fe041a00640 1 --2- 172.21.15.50:0/225768777 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55787cd682f0 0x55787d144ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:40.457 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:40.454+0000 7fe041a00640 1 -- 172.21.15.50:0/225768777 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55787cdfc790 con 0x55787cd911b0 2024-08-31T04:23:40.457 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:40.454+0000 7fe042400640 1 --2- 172.21.15.50:0/225768777 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55787cd682f0 0x55787d144ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:23:40.457 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:40.454+0000 7fe041a00640 1 --2- 172.21.15.50:0/225768777 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55787cd911b0 0x55787d145180 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fe030009cf0 tx=0x7fe0300038a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3082992ada564cd server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:23:40.458 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:40.454+0000 7fe023400640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-08-31T04:23:40.458 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:40.454+0000 7fe023400640 1 -- 172.21.15.50:0/225768777 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe030027070 con 0x55787cd911b0 2024-08-31T04:23:40.458 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:40.454+0000 7fe042400640 1 --2- 172.21.15.50:0/1856637891 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fe0240b4a40 0x7fe0240b6f50 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fe03402f540 tx=0x7fe0340095c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:23:40.458 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:40.454+0000 7fe023400640 1 -- 172.21.15.50:0/225768777 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8219+0+0 (secure 0 0 0) 0x7fe030005240 con 0x55787cd911b0 2024-08-31T04:23:40.458 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:40.454+0000 7fe04b616740 1 -- 172.21.15.50:0/225768777 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe0300043d0 con 0x55787cd911b0 2024-08-31T04:23:40.458 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:40.455+0000 7fe023400640 1 -- 172.21.15.50:0/225768777 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fe030033050 con 0x55787cd911b0 2024-08-31T04:23:40.458 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:40.455+0000 7fe04b616740 10 client.15468 fetch_fsmap learned FSMap version 29 2024-08-31T04:23:40.458 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:40.455+0000 7fe04b616740 1 -- 172.21.15.50:0/225768777 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55787ce75620 con 0x55787cd911b0 2024-08-31T04:23:40.458 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:40.455+0000 7fe023400640 1 -- 172.21.15.50:0/225768777 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe0300043d0 con 0x55787cd911b0 2024-08-31T04:23:40.460 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:40.455+0000 7fe023400640 1 -- 172.21.15.50:0/225768777 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7fe030004c90 con 0x55787cd911b0 2024-08-31T04:23:40.460 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:40.455+0000 7fe04b616740 10 client.15468 fetch_fsmap finished waiting for FSMap version 29 2024-08-31T04:23:40.460 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:40.455+0000 7fe04b616740 10 client.15468 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T04:23:40.460 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:40.456+0000 7fe04b616740 20 client.15468 populate_metadata read hostname 'smithi050' 2024-08-31T04:23:40.460 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:40.456+0000 7fe04b616740 1 --2- 172.21.15.50:0/225768777 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x55787cd251c0 0x55787d152080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:40.460 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:40.456+0000 7fe04b616740 4 client.15468 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T04:23:40.460 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:40.456+0000 7fe04b616740 1 -- 172.21.15.50:0/225768777 --> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55787d0abec0 con 0x55787cd251c0 2024-08-31T04:23:40.460 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:40.456+0000 7fe041000640 1 --2- 172.21.15.50:0/225768777 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x55787cd251c0 0x55787d152080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:40.460 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:40.457+0000 7fe041000640 1 --2- 172.21.15.50:0/225768777 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x55787cd251c0 0x55787d152080 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=235f06c059ecdb14 server_cookie=bc0561ac1a8c4f6b in_seq=0 out_seq=0 2024-08-31T04:23:40.460 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:40.457+0000 7fe023400640 10 client.15468 ms_handle_connect on v2:172.21.15.133:6838/2526402262 2024-08-31T04:23:40.461 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:40.457+0000 7fe023400640 1 -- 172.21.15.50:0/225768777 <== mds.0 v2:172.21.15.133:6838/2526402262 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55787d0abec0 con 0x55787cd251c0 2024-08-31T04:23:40.461 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:40.457+0000 7fe023400640 10 client.15468 handle_command_reply: tid=0 2024-08-31T04:23:40.461 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:40.457+0000 7fe04b616740 1 client.15468 shutdown 2024-08-31T04:23:40.461 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:40.458+0000 7fe04b616740 1 -- 172.21.15.50:0/225768777 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55787cd911b0 msgr2=0x55787d145180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:23:40.461 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:40.458+0000 7fe04b616740 1 --2- 172.21.15.50:0/225768777 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55787cd911b0 0x55787d145180 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fe030009cf0 tx=0x7fe0300038a0 comp rx=0 tx=0).stop 2024-08-31T04:23:40.461 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:40.458+0000 7fe04b616740 1 -- 172.21.15.50:0/225768777 shutdown_connections 2024-08-31T04:23:40.461 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:40.458+0000 7fe04b616740 1 --2- 172.21.15.50:0/225768777 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x55787cd251c0 0x55787d152080 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:40.461 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:40.458+0000 7fe04b616740 1 --2- 172.21.15.50:0/225768777 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55787cd4fd80 0x55787d145cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:40.461 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:40.458+0000 7fe04b616740 1 --2- 172.21.15.50:0/225768777 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55787cd911b0 0x55787d145180 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:40.461 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:40.458+0000 7fe04b616740 1 --2- 172.21.15.50:0/225768777 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55787cd682f0 0x55787d144ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:40.461 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:40.458+0000 7fe04b616740 1 -- 172.21.15.50:0/225768777 >> 172.21.15.50:0/225768777 conn(0x55787cd85300 msgr2=0x55787d130f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:23:40.461 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:40.458+0000 7fe023400640 0 client.15468 ms_handle_reset on v2:172.21.15.133:6838/2526402262 2024-08-31T04:23:40.461 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:40.458+0000 7fe04b616740 1 -- 172.21.15.50:0/225768777 shutdown_connections 2024-08-31T04:23:40.461 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:40.458+0000 7fe04b616740 1 -- 172.21.15.50:0/225768777 wait complete. 2024-08-31T04:23:40.461 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:40.458+0000 7fe04b616740 20 client.15468 trim_cache size 0 max 16384 2024-08-31T04:23:40.475 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:40.474+0000 7fe04b616740 1 Processor -- start 2024-08-31T04:23:40.476 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:40.474+0000 7fe04b616740 1 -- start start 2024-08-31T04:23:40.476 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:40.474+0000 7fe04b616740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55787cd4fd80 0x55787d132370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:40.476 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:40.474+0000 7fe04b616740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55787cd682f0 0x55787d14cbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:40.476 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:40.474+0000 7fe04b616740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55787cd911b0 0x55787d12d660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:40.476 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:40.474+0000 7fe04b616740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fe03c1a8880 con 0x55787cd682f0 2024-08-31T04:23:40.476 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:40.474+0000 7fe04b616740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7fe03c1aa3c0 con 0x55787cd911b0 2024-08-31T04:23:40.476 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:40.474+0000 7fe04b616740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fe03c1a8f50 con 0x55787cd4fd80 2024-08-31T04:23:40.476 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:40.474+0000 7fe041000640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55787cd682f0 0x55787d14cbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:40.476 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:40.474+0000 7fe041000640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55787cd682f0 0x55787d14cbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:34094/0 (socket says 172.21.15.50:34094) 2024-08-31T04:23:40.476 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:40.474+0000 7fe041000640 1 -- 172.21.15.50:0/4194103594 learned_addr learned my addr 172.21.15.50:0/4194103594 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:23:40.476 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:40.474+0000 7fe041a00640 1 --2- 172.21.15.50:0/4194103594 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55787cd4fd80 0x55787d132370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:40.476 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:40.475+0000 7fe042400640 1 --2- 172.21.15.50:0/4194103594 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55787cd911b0 0x55787d12d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:40.477 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:40.475+0000 7fe041000640 1 -- 172.21.15.50:0/4194103594 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55787cd4fd80 msgr2=0x55787d132370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:23:40.478 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:40.475+0000 7fe041000640 1 --2- 172.21.15.50:0/4194103594 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55787cd4fd80 0x55787d132370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:40.478 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:40.475+0000 7fe041000640 1 -- 172.21.15.50:0/4194103594 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55787cd911b0 msgr2=0x55787d12d660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:23:40.478 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:40.475+0000 7fe041000640 1 --2- 172.21.15.50:0/4194103594 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55787cd911b0 0x55787d12d660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:40.478 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:40.475+0000 7fe041000640 1 -- 172.21.15.50:0/4194103594 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55787d1333b0 con 0x55787cd682f0 2024-08-31T04:23:40.478 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:40.475+0000 7fe041000640 1 --2- 172.21.15.50:0/4194103594 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55787cd682f0 0x55787d14cbd0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fe0280abad0 tx=0x7fe02800efb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a424f2b05ae4004 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:23:40.478 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:40.475+0000 7fe02e000640 1 -- 172.21.15.50:0/4194103594 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe02801c030 con 0x55787cd682f0 2024-08-31T04:23:40.478 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:40.475+0000 7fe02e000640 1 -- 172.21.15.50:0/4194103594 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe0280ac240 con 0x55787cd682f0 2024-08-31T04:23:40.478 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:40.475+0000 7fe02e000640 1 -- 172.21.15.50:0/4194103594 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0280a7dd0 con 0x55787cd682f0 2024-08-31T04:23:40.478 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:40.476+0000 7fe04b616740 1 -- 172.21.15.50:0/4194103594 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55787cd682f0 msgr2=0x55787d14cbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:23:40.478 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:40.476+0000 7fe04b616740 1 --2- 172.21.15.50:0/4194103594 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55787cd682f0 0x55787d14cbd0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fe0280abad0 tx=0x7fe02800efb0 comp rx=0 tx=0).stop 2024-08-31T04:23:40.478 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:40.476+0000 7fe04b616740 1 -- 172.21.15.50:0/4194103594 shutdown_connections 2024-08-31T04:23:40.478 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:40.476+0000 7fe04b616740 1 --2- 172.21.15.50:0/4194103594 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55787cd911b0 0x55787d12d660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:40.478 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:40.476+0000 7fe04b616740 1 --2- 172.21.15.50:0/4194103594 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55787cd682f0 0x55787d14cbd0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:40.479 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:40.476+0000 7fe04b616740 1 --2- 172.21.15.50:0/4194103594 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55787cd4fd80 0x55787d132370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:40.479 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:40.476+0000 7fe04b616740 1 -- 172.21.15.50:0/4194103594 >> 172.21.15.50:0/4194103594 conn(0x55787cd85300 msgr2=0x55787d145020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:23:40.479 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:40.477+0000 7fe04b616740 1 -- 172.21.15.50:0/4194103594 shutdown_connections 2024-08-31T04:23:40.479 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:40.477+0000 7fe04b616740 1 -- 172.21.15.50:0/4194103594 wait complete. 2024-08-31T04:23:40.481 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:40.477+0000 7fe04b616740 1 -- start start 2024-08-31T04:23:40.481 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:40.477+0000 7fe04b616740 1 Processor -- start 2024-08-31T04:23:40.481 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:40.478+0000 7fe04b616740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55787cd4fd80 0x55787d14c8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:40.482 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:40.478+0000 7fe04b616740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55787cd682f0 0x55787d14b560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:40.482 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:40.478+0000 7fe04b616740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55787cd911b0 0x55787d14bac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:40.482 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:40.478+0000 7fe04b616740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fe03c1a9cf0 con 0x55787cd682f0 2024-08-31T04:23:40.482 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:40.478+0000 7fe04b616740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7fe03c1a9620 con 0x55787cd4fd80 2024-08-31T04:23:40.482 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:40.478+0000 7fe04b616740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fe03c1a6860 con 0x55787cd911b0 2024-08-31T04:23:40.482 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:40.478+0000 7fe04b616740 10 client.0 _ll_register_callbacks cb 0x7fe030009640 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:23:40.482 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:40.478+0000 7fe041000640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55787cd682f0 0x55787d14b560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:40.482 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:40.478+0000 7fe041000640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55787cd682f0 0x55787d14b560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:34098/0 (socket says 172.21.15.50:34098) 2024-08-31T04:23:40.482 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:40.478+0000 7fe042400640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55787cd911b0 0x55787d14bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:40.482 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:40.478+0000 7fe041000640 1 -- 172.21.15.50:0/2998859912 learned_addr learned my addr 172.21.15.50:0/2998859912 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:23:40.482 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:40.478+0000 7fe041a00640 1 --2- 172.21.15.50:0/2998859912 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55787cd4fd80 0x55787d14c8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:40.482 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:40.478+0000 7fe042400640 1 -- 172.21.15.50:0/2998859912 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55787cd4fd80 msgr2=0x55787d14c8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:23:40.482 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:40.478+0000 7fe042400640 1 --2- 172.21.15.50:0/2998859912 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55787cd4fd80 0x55787d14c8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:40.483 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:40.478+0000 7fe042400640 1 -- 172.21.15.50:0/2998859912 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55787cd682f0 msgr2=0x55787d14b560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:23:40.483 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:40.478+0000 7fe042400640 1 --2- 172.21.15.50:0/2998859912 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55787cd682f0 0x55787d14b560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:40.483 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:40.478+0000 7fe042400640 1 -- 172.21.15.50:0/2998859912 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55787d14c250 con 0x55787cd911b0 2024-08-31T04:23:40.483 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:40.478+0000 7fe041000640 1 --2- 172.21.15.50:0/2998859912 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55787cd682f0 0x55787d14b560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:23:40.483 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:40.479+0000 7fe042400640 1 --2- 172.21.15.50:0/2998859912 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55787cd911b0 0x55787d14bac0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fe034005e30 tx=0x7fe03402a8c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=54a7937038e48d74 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:23:40.483 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:40.479+0000 7fe023400640 10 client.0 ms_handle_connect on v2:172.21.15.177:3300/0 2024-08-31T04:23:40.483 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:40.479+0000 7fe023400640 1 -- 172.21.15.50:0/2998859912 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe034046070 con 0x55787cd911b0 2024-08-31T04:23:40.483 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:40.479+0000 7fe04b616740 1 -- 172.21.15.50:0/2998859912 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe0280ac240 con 0x55787cd911b0 2024-08-31T04:23:40.483 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:40.479+0000 7fe023400640 1 -- 172.21.15.50:0/2998859912 <== mon.1 v2:172.21.15.177:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8219+0+0 (secure 0 0 0) 0x7fe03402fa20 con 0x55787cd911b0 2024-08-31T04:23:40.483 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:40.479+0000 7fe023400640 1 -- 172.21.15.50:0/2998859912 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fe03402fc20 con 0x55787cd911b0 2024-08-31T04:23:40.483 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:40.479+0000 7fe04b616740 10 client.25471 fetch_fsmap learned FSMap version 29 2024-08-31T04:23:40.483 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:40.479+0000 7fe04b616740 1 -- 172.21.15.50:0/2998859912 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55787d1bcab0 con 0x55787cd911b0 2024-08-31T04:23:40.483 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:40.480+0000 7fe023400640 1 -- 172.21.15.50:0/2998859912 <== mon.1 v2:172.21.15.177:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe0280ac240 con 0x55787cd911b0 2024-08-31T04:23:40.483 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:40.480+0000 7fe023400640 1 -- 172.21.15.50:0/2998859912 <== mon.1 v2:172.21.15.177:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7fe034060020 con 0x55787cd911b0 2024-08-31T04:23:40.484 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:40.480+0000 7fe04b616740 10 client.25471 fetch_fsmap finished waiting for FSMap version 29 2024-08-31T04:23:40.484 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:40.480+0000 7fe04b616740 10 client.25471 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T04:23:40.484 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:40.480+0000 7fe04b616740 20 client.25471 populate_metadata read hostname 'smithi050' 2024-08-31T04:23:40.484 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:40.480+0000 7fe04b616740 1 --2- 172.21.15.50:0/2998859912 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x55787d1bd490 0x55787d1bf8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:40.484 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:40.480+0000 7fe04b616740 4 client.25471 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-31T04:23:40.484 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:40.480+0000 7fe04b616740 1 -- 172.21.15.50:0/2998859912 --> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55787d0a7960 con 0x55787d1bd490 2024-08-31T04:23:40.484 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:40.480+0000 7fe041a00640 1 --2- 172.21.15.50:0/2998859912 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x55787d1bd490 0x55787d1bf8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:40.484 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:40.481+0000 7fe023400640 10 client.25471 ms_handle_connect on v2:172.21.15.133:6838/2526402262 2024-08-31T04:23:40.484 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:40.481+0000 7fe041a00640 1 --2- 172.21.15.50:0/2998859912 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x55787d1bd490 0x55787d1bf8b0 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=69ee9e80ba17478c server_cookie=116fbb79373b6f83 in_seq=0 out_seq=0 2024-08-31T04:23:40.489 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:40.488+0000 7fe023400640 1 -- 172.21.15.50:0/2998859912 <== mds.0 v2:172.21.15.133:6838/2526402262 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55787d0a7960 con 0x55787d1bd490 2024-08-31T04:23:40.489 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:40.488+0000 7fe023400640 10 client.25471 handle_command_reply: tid=0 2024-08-31T04:23:40.490 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:40.488+0000 7fe04b616740 1 client.25471 shutdown 2024-08-31T04:23:40.490 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:40.488+0000 7fe04b616740 1 -- 172.21.15.50:0/2998859912 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55787cd911b0 msgr2=0x55787d14bac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:23:40.490 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:40.488+0000 7fe04b616740 1 --2- 172.21.15.50:0/2998859912 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55787cd911b0 0x55787d14bac0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fe034005e30 tx=0x7fe03402a8c0 comp rx=0 tx=0).stop 2024-08-31T04:23:40.490 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:40.488+0000 7fe04b616740 1 -- 172.21.15.50:0/2998859912 shutdown_connections 2024-08-31T04:23:40.490 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:40.488+0000 7fe04b616740 1 --2- 172.21.15.50:0/2998859912 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x55787d1bd490 0x55787d1bf8b0 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:40.490 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:40.488+0000 7fe04b616740 1 --2- 172.21.15.50:0/2998859912 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55787cd911b0 0x55787d14bac0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:40.490 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:40.488+0000 7fe04b616740 1 --2- 172.21.15.50:0/2998859912 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55787cd682f0 0x55787d14b560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:40.490 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:40.488+0000 7fe04b616740 1 --2- 172.21.15.50:0/2998859912 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55787cd4fd80 0x55787d14c8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:40.490 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:40.488+0000 7fe023400640 0 client.25471 ms_handle_reset on v2:172.21.15.133:6838/2526402262 2024-08-31T04:23:40.490 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:40.488+0000 7fe04b616740 1 -- 172.21.15.50:0/2998859912 >> 172.21.15.50:0/2998859912 conn(0x55787cd85300 msgr2=0x55787d12d660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:23:40.490 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:40.488+0000 7fe04b616740 1 -- 172.21.15.50:0/2998859912 shutdown_connections 2024-08-31T04:23:40.490 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:40.488+0000 7fe04b616740 1 -- 172.21.15.50:0/2998859912 wait complete. 2024-08-31T04:23:40.490 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:40.488+0000 7fe04b616740 20 client.25471 trim_cache size 0 max 16384 2024-08-31T04:23:40.491 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout:{ 2024-08-31T04:23:40.491 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout: "message": "", 2024-08-31T04:23:40.491 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout: "return_code": 0 2024-08-31T04:23:40.491 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout:} 2024-08-31T04:23:40.491 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:40.489+0000 7fe042e00640 1 -- 172.21.15.50:0/1856637891 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fe0240b4a40 msgr2=0x7fe0240b6f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:23:40.491 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:40.489+0000 7fe042e00640 1 --2- 172.21.15.50:0/1856637891 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fe0240b4a40 0x7fe0240b6f50 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fe03402f540 tx=0x7fe0340095c0 comp rx=0 tx=0).stop 2024-08-31T04:23:40.492 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:40.489+0000 7fe042e00640 1 -- 172.21.15.50:0/1856637891 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe03c106460 msgr2=0x7fe03c19a180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:23:40.492 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:40.489+0000 7fe042e00640 1 --2- 172.21.15.50:0/1856637891 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe03c106460 0x7fe03c19a180 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fe02800e9c0 tx=0x7fe02800ee80 comp rx=0 tx=0).stop 2024-08-31T04:23:40.492 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:40.489+0000 7fe042e00640 1 -- 172.21.15.50:0/1856637891 shutdown_connections 2024-08-31T04:23:40.492 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:40.489+0000 7fe042e00640 1 --2- 172.21.15.50:0/1856637891 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fe0240b4a40 0x7fe0240b6f50 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:40.492 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:40.489+0000 7fe042e00640 1 --2- 172.21.15.50:0/1856637891 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe03c109020 0x7fe03c19ad30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:40.492 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:40.489+0000 7fe042e00640 1 --2- 172.21.15.50:0/1856637891 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe03c106460 0x7fe03c19a180 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:40.492 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:40.489+0000 7fe042e00640 1 --2- 172.21.15.50:0/1856637891 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe03c06b4b0 0x7fe03c199b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:40.492 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:40.489+0000 7fe042e00640 1 -- 172.21.15.50:0/1856637891 >> 172.21.15.50:0/1856637891 conn(0x7fe03c0fdb20 msgr2=0x7fe03c104930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:23:40.492 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:40.489+0000 7fe042e00640 1 -- 172.21.15.50:0/1856637891 shutdown_connections 2024-08-31T04:23:40.492 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:40.489+0000 7fe042e00640 1 -- 172.21.15.50:0/1856637891 wait complete. 2024-08-31T04:23:41.950 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:23:41 smithi050 ceph-mon[17259]: pgmap v390: 97 pgs: 97 active+clean; 663 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 1.1 KiB/s wr, 11 op/s 2024-08-31T04:23:41.996 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:23:41 smithi177 ceph-mon[22025]: pgmap v390: 97 pgs: 97 active+clean; 663 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 1.1 KiB/s wr, 11 op/s 2024-08-31T04:23:42.043 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:23:41 smithi133 ceph-mon[22177]: pgmap v390: 97 pgs: 97 active+clean; 663 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 1.1 KiB/s wr, 11 op/s 2024-08-31T04:23:42.151 INFO:tasks.quiescer.fs.[cephfs]:Total duration (52.8) is longer than `split_if_longer` (35.0), will split into two consecutive quiesces 2024-08-31T04:23:42.151 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 26.4 2024-08-31T04:23:42.151 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 058d9fc6-674f-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-31T04:23:42.563 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:23:43.240 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:43.238+0000 7fe9a6200640 1 -- 172.21.15.50:0/3743863884 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe9a010bdb0 msgr2=0x7fe9a01125e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:23:43.240 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:43.238+0000 7fe9a6200640 1 --2- 172.21.15.50:0/3743863884 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe9a010bdb0 0x7fe9a01125e0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fe998009ca0 tx=0x7fe99802a8c0 comp rx=0 tx=0).stop 2024-08-31T04:23:43.240 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:43.238+0000 7fe9a6200640 1 -- 172.21.15.50:0/3743863884 shutdown_connections 2024-08-31T04:23:43.240 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:43.238+0000 7fe9a6200640 1 --2- 172.21.15.50:0/3743863884 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe9a010bdb0 0x7fe9a01125e0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:43.240 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:43.238+0000 7fe9a6200640 1 --2- 172.21.15.50:0/3743863884 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe9a010b460 0x7fe9a010b870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:43.240 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:43.238+0000 7fe9a6200640 1 --2- 172.21.15.50:0/3743863884 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe9a0105b20 0x7fe9a0105f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:43.240 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:43.238+0000 7fe9a6200640 1 -- 172.21.15.50:0/3743863884 >> 172.21.15.50:0/3743863884 conn(0x7fe9a0101570 msgr2=0x7fe9a01039c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:23:43.241 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:43.238+0000 7fe9a6200640 1 -- 172.21.15.50:0/3743863884 shutdown_connections 2024-08-31T04:23:43.241 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:43.238+0000 7fe9a6200640 1 -- 172.21.15.50:0/3743863884 wait complete. 2024-08-31T04:23:43.242 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:43.239+0000 7fe9a6200640 1 Processor -- start 2024-08-31T04:23:43.242 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:43.240+0000 7fe9a6200640 1 -- start start 2024-08-31T04:23:43.242 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:43.240+0000 7fe9a6200640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe9a0105b20 0x7fe9a019c400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:43.242 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:43.240+0000 7fe9a6200640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe9a010b460 0x7fe9a019c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:43.242 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:43.240+0000 7fe9a6200640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe9a010bdb0 0x7fe9a01a1c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:43.242 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:43.240+0000 7fe9a6200640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fe9a0115a70 con 0x7fe9a010bdb0 2024-08-31T04:23:43.242 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:43.240+0000 7fe9a6200640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7fe9a01158f0 con 0x7fe9a010b460 2024-08-31T04:23:43.242 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:43.240+0000 7fe9a6200640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fe9a0115bf0 con 0x7fe9a0105b20 2024-08-31T04:23:43.242 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:43.240+0000 7fe99ea00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe9a010b460 0x7fe9a019c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:43.242 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:43.240+0000 7fe99fe00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe9a010bdb0 0x7fe9a01a1c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:43.242 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:43.241+0000 7fe99f400640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe9a0105b20 0x7fe9a019c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:43.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:43.241+0000 7fe99ea00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe9a010b460 0x7fe9a019c9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.50:49658/0 (socket says 172.21.15.50:49658) 2024-08-31T04:23:43.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:43.241+0000 7fe99f400640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe9a0105b20 0x7fe9a019c400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.50:49930/0 (socket says 172.21.15.50:49930) 2024-08-31T04:23:43.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:43.241+0000 7fe99ea00640 1 -- 172.21.15.50:0/2861880854 learned_addr learned my addr 172.21.15.50:0/2861880854 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:23:43.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:43.241+0000 7fe99fe00640 1 -- 172.21.15.50:0/2861880854 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe9a0105b20 msgr2=0x7fe9a019c400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:23:43.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:43.241+0000 7fe99fe00640 1 --2- 172.21.15.50:0/2861880854 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe9a0105b20 0x7fe9a019c400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:43.243 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:43.241+0000 7fe99fe00640 1 -- 172.21.15.50:0/2861880854 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe9a010b460 msgr2=0x7fe9a019c9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:23:43.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:43.241+0000 7fe99fe00640 1 --2- 172.21.15.50:0/2861880854 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe9a010b460 0x7fe9a019c9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:43.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:43.241+0000 7fe99fe00640 1 -- 172.21.15.50:0/2861880854 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9a01a2370 con 0x7fe9a010bdb0 2024-08-31T04:23:43.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:43.241+0000 7fe99ea00640 1 --2- 172.21.15.50:0/2861880854 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe9a010b460 0x7fe9a019c9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:23:43.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:43.241+0000 7fe99f400640 1 --2- 172.21.15.50:0/2861880854 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe9a0105b20 0x7fe9a019c400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:23:43.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:43.242+0000 7fe99fe00640 1 --2- 172.21.15.50:0/2861880854 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe9a010bdb0 0x7fe9a01a1c40 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fe99802ade0 tx=0x7fe998031660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:23:43.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:43.242+0000 7fe997e00640 1 -- 172.21.15.50:0/2861880854 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe998003b70 con 0x7fe9a010bdb0 2024-08-31T04:23:43.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:43.242+0000 7fe997e00640 1 -- 172.21.15.50:0/2861880854 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe998031910 con 0x7fe9a010bdb0 2024-08-31T04:23:43.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:43.242+0000 7fe9a6200640 1 -- 172.21.15.50:0/2861880854 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe9a01a2600 con 0x7fe9a010bdb0 2024-08-31T04:23:43.244 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:43.242+0000 7fe997e00640 1 -- 172.21.15.50:0/2861880854 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe99802f950 con 0x7fe9a010bdb0 2024-08-31T04:23:43.245 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:43.242+0000 7fe9a6200640 1 -- 172.21.15.50:0/2861880854 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe9a01a8dc0 con 0x7fe9a010bdb0 2024-08-31T04:23:43.245 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:43.243+0000 7fe9a6200640 1 -- 172.21.15.50:0/2861880854 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe9a0105f30 con 0x7fe9a010bdb0 2024-08-31T04:23:43.249 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:43.247+0000 7fe997e00640 1 -- 172.21.15.50:0/2861880854 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 18) ==== 152577+0+0 (secure 0 0 0) 0x7fe998004b40 con 0x7fe9a010bdb0 2024-08-31T04:23:43.250 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:43.249+0000 7fe997e00640 1 --2- 172.21.15.50:0/2861880854 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fe9840b4b30 0x7fe9840b7040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:43.251 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:43.249+0000 7fe997e00640 1 -- 172.21.15.50:0/2861880854 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8219+0+0 (secure 0 0 0) 0x7fe9981063d0 con 0x7fe9a010bdb0 2024-08-31T04:23:43.251 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:43.250+0000 7fe99f400640 1 --2- 172.21.15.50:0/2861880854 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fe9840b4b30 0x7fe9840b7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:43.251 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:43.250+0000 7fe99f400640 1 --2- 172.21.15.50:0/2861880854 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fe9840b4b30 0x7fe9840b7040 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fe990009fc0 tx=0x7fe990005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:23:43.252 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:43.251+0000 7fe997e00640 1 -- 172.21.15.50:0/2861880854 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fe998003d10 con 0x7fe9a010bdb0 2024-08-31T04:23:43.493 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:43.492+0000 7fe9a6200640 1 -- 172.21.15.50:0/2861880854 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe9a019d530 con 0x7fe9a010bdb0 2024-08-31T04:23:43.494 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:43.492+0000 7fe997e00640 1 -- 172.21.15.50:0/2861880854 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+11983 (secure 0 0 0) 0x7fe9a019d530 con 0x7fe9a010bdb0 2024-08-31T04:23:43.494 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-08-31T04:23:43.494 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":29,"btime":"2024-08-31T04:23:00:578141+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14622,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/1565557530","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":1565557530},{"type":"v1","addr":"172.21.15.50:6835","nonce":1565557530}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14634,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6837/2660185946","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6836","nonce":2660185946},{"type":"v1","addr":"172.21.15.50:6837","nonce":2660185946}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":29,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-31T04:20:44.140709+0000","modified":"2024-08-31T04:22:59.912983+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24695,"mds_1":24691,"mds_2":24667,"mds_3":24656,"mds_4":24652},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14676":{"gid":14676,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.50:6839/2105228685","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6838","nonce":2105228685},{"type":"v1","addr":"172.21.15.50:6839","nonce":2105228685}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24590":{"gid":24590,"name":"k","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.133:6833/4283603962","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6832","nonce":4283603962},{"type":"v1","addr":"172.21.15.133:6833","nonce":4283603962}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24601":{"gid":24601,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.177:6833/1237129793","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":1237129793},{"type":"v1","addr":"172.21.15.177:6833","nonce":1237129793}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24626":{"gid":24626,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.133:6835/3637799701","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":3637799701},{"type":"v1","addr":"172.21.15.133:6835","nonce":3637799701}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24640":{"gid":24640,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.177:6835/599392457","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6834","nonce":599392457},{"type":"v1","addr":"172.21.15.177:6835","nonce":599392457}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24652":{"gid":24652,"name":"c","rank":4,"incarnation":26,"state":"up:active","state_seq":13,"addr":"172.21.15.177:6837/2159859285","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6836","nonce":2159859285},{"type":"v1","addr":"172.21.15.177:6837","nonce":2159859285}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24656":{"gid":24656,"name":"h","rank":3,"incarnation":22,"state":"up:active","state_seq":12,"addr":"172.21.15.133:6837/4014853202","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6836","nonce":4014853202},{"type":"v1","addr":"172.21.15.133:6837","nonce":4014853202}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24667":{"gid":24667,"name":"i","rank":2,"incarnation":20,"state":"up:active","state_seq":10,"addr":"172.21.15.177:6839/3600081752","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6838","nonce":3600081752},{"type":"v1","addr":"172.21.15.177:6839","nonce":3600081752}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24691":{"gid":24691,"name":"a","rank":1,"incarnation":18,"state":"up:active","state_seq":8,"addr":"172.21.15.50:6841/575209862","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6840","nonce":575209862},{"type":"v1","addr":"172.21.15.50:6841","nonce":575209862}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24695":{"gid":24695,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.133:6839/2526402262","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6838","nonce":2526402262},{"type":"v1","addr":"172.21.15.133:6839","nonce":2526402262}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24695,"qdb_cluster":[24652,24691,24656,24695,24667]},"id":1}]} 2024-08-31T04:23:43.494 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 29 2024-08-31T04:23:43.497 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:43.495+0000 7fe9a6200640 1 -- 172.21.15.50:0/2861880854 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fe9840b4b30 msgr2=0x7fe9840b7040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:23:43.497 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:43.495+0000 7fe9a6200640 1 --2- 172.21.15.50:0/2861880854 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fe9840b4b30 0x7fe9840b7040 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fe990009fc0 tx=0x7fe990005f90 comp rx=0 tx=0).stop 2024-08-31T04:23:43.497 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:43.495+0000 7fe9a6200640 1 -- 172.21.15.50:0/2861880854 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe9a010bdb0 msgr2=0x7fe9a01a1c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:23:43.497 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:43.495+0000 7fe9a6200640 1 --2- 172.21.15.50:0/2861880854 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe9a010bdb0 0x7fe9a01a1c40 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fe99802ade0 tx=0x7fe998031660 comp rx=0 tx=0).stop 2024-08-31T04:23:43.497 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:43.496+0000 7fe9a6200640 1 -- 172.21.15.50:0/2861880854 shutdown_connections 2024-08-31T04:23:43.497 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:43.496+0000 7fe9a6200640 1 --2- 172.21.15.50:0/2861880854 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fe9840b4b30 0x7fe9840b7040 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:43.497 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:43.496+0000 7fe9a6200640 1 --2- 172.21.15.50:0/2861880854 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe9a010bdb0 0x7fe9a01a1c40 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:43.498 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:43.496+0000 7fe9a6200640 1 --2- 172.21.15.50:0/2861880854 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe9a010b460 0x7fe9a019c9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:43.498 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:43.496+0000 7fe9a6200640 1 --2- 172.21.15.50:0/2861880854 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe9a0105b20 0x7fe9a019c400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:43.498 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:43.496+0000 7fe9a6200640 1 -- 172.21.15.50:0/2861880854 >> 172.21.15.50:0/2861880854 conn(0x7fe9a0101570 msgr2=0x7fe9a0103990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:23:43.498 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:43.496+0000 7fe9a6200640 1 -- 172.21.15.50:0/2861880854 shutdown_connections 2024-08-31T04:23:43.498 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:43.496+0000 7fe9a6200640 1 -- 172.21.15.50:0/2861880854 wait complete. 2024-08-31T04:23:43.855 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:23:43 smithi050 ceph-mon[17259]: pgmap v391: 97 pgs: 97 active+clean; 664 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 1.4 KiB/s wr, 14 op/s 2024-08-31T04:23:43.855 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:23:43 smithi050 ceph-mon[17259]: from='client.? 172.21.15.50:0/2861880854' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T04:23:43.996 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:23:43 smithi177 ceph-mon[22025]: pgmap v391: 97 pgs: 97 active+clean; 664 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 1.4 KiB/s wr, 14 op/s 2024-08-31T04:23:43.996 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:23:43 smithi177 ceph-mon[22025]: from='client.? 172.21.15.50:0/2861880854' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T04:23:44.043 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:23:43 smithi133 ceph-mon[22177]: pgmap v391: 97 pgs: 97 active+clean; 664 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 1.4 KiB/s wr, 14 op/s 2024-08-31T04:23:44.043 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:23:43 smithi133 ceph-mon[22177]: from='client.? 172.21.15.50:0/2861880854' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T04:23:44.417 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24695 quiesce db / --timeout 90 --expiration 146.4 --await-for 45.0' 2024-08-31T04:23:44.417 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 058d9fc6-674f-11ef-bcd4-c7b262605968 -- timeout 105 ceph tell mds.24695 quiesce db / --timeout 90 --expiration 146.4 --await-for 45.0 2024-08-31T04:23:44.846 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:23:45.559 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:45.557+0000 7f4853200640 1 -- 172.21.15.50:0/2716337378 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4854109070 msgr2=0x7f4854109480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:23:45.559 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:45.557+0000 7f4853200640 1 --2- 172.21.15.50:0/2716337378 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4854109070 0x7f4854109480 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f4840009900 tx=0x7f484002a400 comp rx=0 tx=0).stop 2024-08-31T04:23:45.559 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:45.557+0000 7f4853200640 1 -- 172.21.15.50:0/2716337378 shutdown_connections 2024-08-31T04:23:45.560 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:45.557+0000 7f4853200640 1 --2- 172.21.15.50:0/2716337378 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f48541099c0 0x7f48541101f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:45.560 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:45.557+0000 7f4853200640 1 --2- 172.21.15.50:0/2716337378 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4854109070 0x7f4854109480 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:45.560 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:45.557+0000 7f4853200640 1 --2- 172.21.15.50:0/2716337378 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4854103730 0x7f4854103b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:45.560 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:45.557+0000 7f4853200640 1 -- 172.21.15.50:0/2716337378 >> 172.21.15.50:0/2716337378 conn(0x7f48540ff180 msgr2=0x7f48541015d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:23:45.560 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:45.557+0000 7f4853200640 1 -- 172.21.15.50:0/2716337378 shutdown_connections 2024-08-31T04:23:45.560 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:45.557+0000 7f4853200640 1 -- 172.21.15.50:0/2716337378 wait complete. 2024-08-31T04:23:45.560 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:45.559+0000 7f4853200640 1 Processor -- start 2024-08-31T04:23:45.561 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:45.559+0000 7f4853200640 1 -- start start 2024-08-31T04:23:45.561 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:45.560+0000 7f4853200640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4854103730 0x7f485419c270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:45.561 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:45.560+0000 7f4853200640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4854109070 0x7f485419c810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:45.561 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:45.560+0000 7f4853200640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f48541099c0 0x7f48541a1ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:45.561 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:45.560+0000 7f4853200640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f4854113680 con 0x7f48541099c0 2024-08-31T04:23:45.561 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:45.560+0000 7f4853200640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f4854113500 con 0x7f4854109070 2024-08-31T04:23:45.561 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:45.560+0000 7f4853200640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f4854113800 con 0x7f4854103730 2024-08-31T04:23:45.562 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:45.560+0000 7f4851400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4854109070 0x7f485419c810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:45.562 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:45.560+0000 7f4851400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4854109070 0x7f485419c810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.50:49672/0 (socket says 172.21.15.50:49672) 2024-08-31T04:23:45.562 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:45.560+0000 7f4851400640 1 -- 172.21.15.50:0/1346124135 learned_addr learned my addr 172.21.15.50:0/1346124135 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:23:45.562 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:45.560+0000 7f4851e00640 1 --2- 172.21.15.50:0/1346124135 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4854103730 0x7f485419c270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:45.562 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:45.561+0000 7f4852800640 1 --2- 172.21.15.50:0/1346124135 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f48541099c0 0x7f48541a1ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:45.563 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:45.561+0000 7f4851400640 1 -- 172.21.15.50:0/1346124135 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4854103730 msgr2=0x7f485419c270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:23:45.563 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:45.561+0000 7f4851400640 1 --2- 172.21.15.50:0/1346124135 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4854103730 0x7f485419c270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:45.563 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:45.561+0000 7f4851400640 1 -- 172.21.15.50:0/1346124135 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f48541099c0 msgr2=0x7f48541a1ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:23:45.563 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:45.561+0000 7f4851400640 1 --2- 172.21.15.50:0/1346124135 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f48541099c0 0x7f48541a1ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:45.563 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:45.561+0000 7f4851400640 1 -- 172.21.15.50:0/1346124135 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48541a21e0 con 0x7f4854109070 2024-08-31T04:23:45.563 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:45.562+0000 7f4851400640 1 --2- 172.21.15.50:0/1346124135 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4854109070 0x7f485419c810 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f4840005ab0 tx=0x7f4840003b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:23:45.564 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:45.562+0000 7f484aa00640 1 -- 172.21.15.50:0/1346124135 <== mon.2 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f484003f070 con 0x7f4854109070 2024-08-31T04:23:45.564 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:45.562+0000 7f4853200640 1 -- 172.21.15.50:0/1346124135 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f48541a2470 con 0x7f4854109070 2024-08-31T04:23:45.565 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:45.563+0000 7f484aa00640 1 -- 172.21.15.50:0/1346124135 <== mon.2 v2:172.21.15.133:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4840031b50 con 0x7f4854109070 2024-08-31T04:23:45.565 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:45.563+0000 7f484aa00640 1 -- 172.21.15.50:0/1346124135 <== mon.2 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4840035030 con 0x7f4854109070 2024-08-31T04:23:45.565 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:45.563+0000 7f4853200640 1 -- 172.21.15.50:0/1346124135 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f48541a8c30 con 0x7f4854109070 2024-08-31T04:23:45.569 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:45.566+0000 7f485fe03740 1 Processor -- start 2024-08-31T04:23:45.569 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:45.567+0000 7f485fe03740 1 -- start start 2024-08-31T04:23:45.569 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:45.567+0000 7f485fe03740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b965b2a840 0x55b965ed12d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:45.569 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:45.567+0000 7f485fe03740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b965b01980 0x55b965ed1810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:45.569 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:45.567+0000 7f485fe03740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b965b09b60 0x55b965ed1d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:45.569 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:45.567+0000 7f485fe03740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55b965e46530 con 0x55b965b09b60 2024-08-31T04:23:45.570 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:45.567+0000 7f485fe03740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x55b965e35ac0 con 0x55b965b01980 2024-08-31T04:23:45.570 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:45.567+0000 7f485fe03740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x55b965e39a70 con 0x55b965b2a840 2024-08-31T04:23:45.570 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:45.568+0000 7f4851e00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b965b01980 0x55b965ed1810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:45.570 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:45.568+0000 7f4851e00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b965b01980 0x55b965ed1810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.50:49680/0 (socket says 172.21.15.50:49680) 2024-08-31T04:23:45.570 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:45.568+0000 7f4851e00640 1 -- 172.21.15.50:0/1097237201 learned_addr learned my addr 172.21.15.50:0/1097237201 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:23:45.570 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:45.568+0000 7f4852800640 1 --2- 172.21.15.50:0/1097237201 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b965b2a840 0x55b965ed12d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:45.570 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:45.568+0000 7f4851e00640 1 -- 172.21.15.50:0/1097237201 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b965b2a840 msgr2=0x55b965ed12d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:23:45.571 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:45.568+0000 7f4851e00640 1 --2- 172.21.15.50:0/1097237201 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b965b2a840 0x55b965ed12d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:45.571 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:45.568+0000 7f4851e00640 1 -- 172.21.15.50:0/1097237201 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b965b09b60 msgr2=0x55b965ed1d50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-31T04:23:45.571 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:45.568+0000 7f4851e00640 1 --2- 172.21.15.50:0/1097237201 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b965b09b60 0x55b965ed1d50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:45.571 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:45.568+0000 7f4851e00640 1 -- 172.21.15.50:0/1097237201 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b965de8880 con 0x55b965b01980 2024-08-31T04:23:45.571 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:45.569+0000 7f4851e00640 1 --2- 172.21.15.50:0/1097237201 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b965b01980 0x55b965ed1810 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f4844009cf0 tx=0x7f4844011810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a1e28e823a6c6ad2 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:23:45.572 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:45.569+0000 7f484aa00640 1 -- 172.21.15.50:0/1346124135 <== mon.2 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 18) ==== 152577+0+0 (secure 0 0 0) 0x7f4840042070 con 0x7f4854109070 2024-08-31T04:23:45.572 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:45.569+0000 7f483f400640 1 -- 172.21.15.50:0/1097237201 <== mon.2 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4844004230 con 0x55b965b01980 2024-08-31T04:23:45.572 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:45.569+0000 7f483f400640 1 -- 172.21.15.50:0/1097237201 <== mon.2 v2:172.21.15.133:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f48440043d0 con 0x55b965b01980 2024-08-31T04:23:45.572 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:45.569+0000 7f483f400640 1 -- 172.21.15.50:0/1097237201 <== mon.2 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48440198c0 con 0x55b965b01980 2024-08-31T04:23:45.572 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:45.571+0000 7f485fe03740 1 -- 172.21.15.50:0/1097237201 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b965b01980 msgr2=0x55b965ed1810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:23:45.572 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:45.571+0000 7f485fe03740 1 --2- 172.21.15.50:0/1097237201 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b965b01980 0x55b965ed1810 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f4844009cf0 tx=0x7f4844011810 comp rx=0 tx=0).stop 2024-08-31T04:23:45.573 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:45.571+0000 7f485fe03740 1 -- 172.21.15.50:0/1097237201 shutdown_connections 2024-08-31T04:23:45.573 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:45.571+0000 7f485fe03740 1 --2- 172.21.15.50:0/1097237201 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b965b09b60 0x55b965ed1d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:45.573 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:45.571+0000 7f485fe03740 1 --2- 172.21.15.50:0/1097237201 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b965b01980 0x55b965ed1810 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:45.573 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:45.571+0000 7f485fe03740 1 --2- 172.21.15.50:0/1097237201 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b965b2a840 0x55b965ed12d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:45.573 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:45.571+0000 7f485fe03740 1 -- 172.21.15.50:0/1097237201 >> 172.21.15.50:0/1097237201 conn(0x55b965b1e990 msgr2=0x55b965ecf1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:23:45.573 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:45.572+0000 7f484aa00640 1 --2- 172.21.15.50:0/1346124135 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f48380b4b20 0x7f48380b7030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:45.574 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:45.572+0000 7f485fe03740 1 -- 172.21.15.50:0/1097237201 shutdown_connections 2024-08-31T04:23:45.574 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:45.572+0000 7f484aa00640 1 -- 172.21.15.50:0/1346124135 <== mon.2 v2:172.21.15.133:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8219+0+0 (secure 0 0 0) 0x7f4840105370 con 0x7f4854109070 2024-08-31T04:23:45.574 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:45.572+0000 7f485fe03740 1 -- 172.21.15.50:0/1097237201 wait complete. 2024-08-31T04:23:45.574 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:45.573+0000 7f4851e00640 1 --2- 172.21.15.50:0/1346124135 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f48380b4b20 0x7f48380b7030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:45.574 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:45.573+0000 7f485fe03740 1 -- start start 2024-08-31T04:23:45.575 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:45.574+0000 7f485fe03740 1 Processor -- start 2024-08-31T04:23:45.575 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:45.574+0000 7f4851e00640 1 --2- 172.21.15.50:0/1346124135 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f48380b4b20 0x7f48380b7030 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f4844003eb0 tx=0x7f4844003f10 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:23:45.576 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:45.574+0000 7f485fe03740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b965b01980 0x55b965edce30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:45.576 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:45.574+0000 7f485fe03740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b965b09b60 0x55b965edd370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:45.576 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:45.575+0000 7f485fe03740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b965b2a840 0x55b965ee8e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:45.576 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:45.575+0000 7f485fe03740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55b965c987a0 con 0x55b965b2a840 2024-08-31T04:23:45.576 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:45.575+0000 7f485fe03740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x55b965dbc7f0 con 0x55b965b09b60 2024-08-31T04:23:45.576 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:45.575+0000 7f485fe03740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x55b965edfab0 con 0x55b965b01980 2024-08-31T04:23:45.576 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:45.575+0000 7f485fe03740 10 client.0 _ll_register_callbacks cb 0x55b965de1e60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:23:45.577 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:45.575+0000 7f4851400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b965b09b60 0x55b965edd370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:45.578 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:45.575+0000 7f4851e00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b965b01980 0x55b965edce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:45.578 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:45.575+0000 7f4851400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b965b09b60 0x55b965edd370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.50:49688/0 (socket says 172.21.15.50:49688) 2024-08-31T04:23:45.578 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:45.575+0000 7f4851400640 1 -- 172.21.15.50:0/1066750007 learned_addr learned my addr 172.21.15.50:0/1066750007 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:23:45.578 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:45.575+0000 7f4852800640 1 --2- 172.21.15.50:0/1066750007 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b965b2a840 0x55b965ee8e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:45.578 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:45.576+0000 7f4851400640 1 -- 172.21.15.50:0/1066750007 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b965b01980 msgr2=0x55b965edce30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:23:45.578 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:45.576+0000 7f4851400640 1 --2- 172.21.15.50:0/1066750007 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b965b01980 0x55b965edce30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:45.578 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:45.576+0000 7f4851400640 1 -- 172.21.15.50:0/1066750007 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b965b2a840 msgr2=0x55b965ee8e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:23:45.578 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:45.576+0000 7f4851400640 1 --2- 172.21.15.50:0/1066750007 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b965b2a840 0x55b965ee8e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:45.578 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:45.576+0000 7f4851400640 1 -- 172.21.15.50:0/1066750007 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b965ba4b90 con 0x55b965b09b60 2024-08-31T04:23:45.578 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:45.576+0000 7f4852800640 1 --2- 172.21.15.50:0/1066750007 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b965b2a840 0x55b965ee8e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:23:45.579 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:45.576+0000 7f4851400640 1 --2- 172.21.15.50:0/1066750007 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b965b09b60 0x55b965edd370 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f48400c7dd0 tx=0x7f48400cb760 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bd0f9f15a4ef0d7b server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:23:45.579 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:45.576+0000 7f4833e00640 10 client.0 ms_handle_connect on v2:172.21.15.133:3300/0 2024-08-31T04:23:45.580 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:45.577+0000 7f4833e00640 1 -- 172.21.15.50:0/1066750007 <== mon.2 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4840049070 con 0x55b965b09b60 2024-08-31T04:23:45.580 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:45.577+0000 7f4833e00640 1 -- 172.21.15.50:0/1066750007 <== mon.2 v2:172.21.15.133:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8219+0+0 (secure 0 0 0) 0x7f4840031d00 con 0x55b965b09b60 2024-08-31T04:23:45.580 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:45.577+0000 7f485fe03740 1 -- 172.21.15.50:0/1066750007 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f48440043d0 con 0x55b965b09b60 2024-08-31T04:23:45.581 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:45.577+0000 7f4833e00640 1 -- 172.21.15.50:0/1066750007 <== mon.2 v2:172.21.15.133:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f48400f0e60 con 0x55b965b09b60 2024-08-31T04:23:45.581 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:45.577+0000 7f485fe03740 10 client.25478 fetch_fsmap learned FSMap version 29 2024-08-31T04:23:45.581 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:45.577+0000 7f485fe03740 1 -- 172.21.15.50:0/1066750007 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55b965ef42e0 con 0x55b965b09b60 2024-08-31T04:23:45.581 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:45.577+0000 7f4833e00640 1 -- 172.21.15.50:0/1066750007 <== mon.2 v2:172.21.15.133:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f48440043d0 con 0x55b965b09b60 2024-08-31T04:23:45.581 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:45.578+0000 7f4833e00640 1 -- 172.21.15.50:0/1066750007 <== mon.2 v2:172.21.15.133:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f484004c060 con 0x55b965b09b60 2024-08-31T04:23:45.581 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:45.578+0000 7f485fe03740 10 client.25478 fetch_fsmap finished waiting for FSMap version 29 2024-08-31T04:23:45.581 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:45.578+0000 7f485fe03740 10 client.25478 resolve_mds: validated gid 24695 aka daemon mds.b 2024-08-31T04:23:45.581 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:45.578+0000 7f485fe03740 20 client.25478 populate_metadata read hostname 'smithi050' 2024-08-31T04:23:45.581 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:45.578+0000 7f485fe03740 1 --2- 172.21.15.50:0/1066750007 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x55b965ae91c0 0x55b965ef7720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:45.581 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:45.578+0000 7f485fe03740 4 client.25478 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T04:23:45.582 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:45.578+0000 7f485fe03740 1 -- 172.21.15.50:0/1066750007 --> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b965e48480 con 0x55b965ae91c0 2024-08-31T04:23:45.582 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:45.578+0000 7f4851e00640 1 --2- 172.21.15.50:0/1066750007 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x55b965ae91c0 0x55b965ef7720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:45.582 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:45.579+0000 7f4851e00640 1 --2- 172.21.15.50:0/1066750007 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x55b965ae91c0 0x55b965ef7720 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=88f3af2ac915b9ce server_cookie=3ab2dde0ff3f058c in_seq=0 out_seq=0 2024-08-31T04:23:45.582 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:45.579+0000 7f4833e00640 10 client.25478 ms_handle_connect on v2:172.21.15.133:6838/2526402262 2024-08-31T04:23:45.583 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:45.580+0000 7f4833e00640 1 -- 172.21.15.50:0/1066750007 <== mds.0 v2:172.21.15.133:6838/2526402262 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55b965e48480 con 0x55b965ae91c0 2024-08-31T04:23:45.583 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:45.580+0000 7f4833e00640 10 client.25478 handle_command_reply: tid=0 2024-08-31T04:23:45.583 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:45.580+0000 7f485fe03740 1 client.25478 shutdown 2024-08-31T04:23:45.583 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:45.580+0000 7f485fe03740 1 -- 172.21.15.50:0/1066750007 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b965b09b60 msgr2=0x55b965edd370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:23:45.583 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:45.580+0000 7f485fe03740 1 --2- 172.21.15.50:0/1066750007 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b965b09b60 0x55b965edd370 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f48400c7dd0 tx=0x7f48400cb760 comp rx=0 tx=0).stop 2024-08-31T04:23:45.583 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:45.580+0000 7f485fe03740 1 -- 172.21.15.50:0/1066750007 shutdown_connections 2024-08-31T04:23:45.583 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:45.580+0000 7f485fe03740 1 --2- 172.21.15.50:0/1066750007 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x55b965ae91c0 0x55b965ef7720 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:45.583 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:45.581+0000 7f485fe03740 1 --2- 172.21.15.50:0/1066750007 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b965b2a840 0x55b965ee8e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:45.584 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:45.581+0000 7f485fe03740 1 --2- 172.21.15.50:0/1066750007 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b965b09b60 0x55b965edd370 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:45.584 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:45.581+0000 7f485fe03740 1 --2- 172.21.15.50:0/1066750007 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b965b01980 0x55b965edce30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:45.584 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:45.581+0000 7f485fe03740 1 -- 172.21.15.50:0/1066750007 >> 172.21.15.50:0/1066750007 conn(0x55b965b1e990 msgr2=0x55b965ed4460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:23:45.584 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:45.581+0000 7f4833e00640 0 client.25478 ms_handle_reset on v2:172.21.15.133:6838/2526402262 2024-08-31T04:23:45.584 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:45.581+0000 7f485fe03740 1 -- 172.21.15.50:0/1066750007 shutdown_connections 2024-08-31T04:23:45.584 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:45.581+0000 7f485fe03740 1 -- 172.21.15.50:0/1066750007 wait complete. 2024-08-31T04:23:45.584 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:45.581+0000 7f485fe03740 20 client.25478 trim_cache size 0 max 16384 2024-08-31T04:23:45.600 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:45.599+0000 7f485fe03740 1 Processor -- start 2024-08-31T04:23:45.601 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:45.599+0000 7f485fe03740 1 -- start start 2024-08-31T04:23:45.601 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:45.600+0000 7f485fe03740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b965b1e990 0x55b965ecea30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:45.601 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:45.600+0000 7f485fe03740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b965b01980 0x55b965ecef70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:45.601 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:45.600+0000 7f485fe03740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b965b09b60 0x55b965ed9e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:45.601 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:45.600+0000 7f485fe03740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f48541acc20 con 0x55b965b09b60 2024-08-31T04:23:45.602 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:45.600+0000 7f485fe03740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f48541ae760 con 0x55b965b1e990 2024-08-31T04:23:45.602 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:45.600+0000 7f485fe03740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f48541ad2f0 con 0x55b965b01980 2024-08-31T04:23:45.602 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:45.600+0000 7f4851400640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b965b01980 0x55b965ecef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:45.602 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:45.600+0000 7f4851400640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b965b01980 0x55b965ecef70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.50:49958/0 (socket says 172.21.15.50:49958) 2024-08-31T04:23:45.603 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:45.600+0000 7f4851400640 1 -- 172.21.15.50:0/90621138 learned_addr learned my addr 172.21.15.50:0/90621138 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:23:45.603 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:45.600+0000 7f4851e00640 1 --2- 172.21.15.50:0/90621138 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b965b1e990 0x55b965ecea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:45.603 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:45.601+0000 7f4852800640 1 --2- 172.21.15.50:0/90621138 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b965b09b60 0x55b965ed9e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:45.603 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:45.601+0000 7f4851400640 1 -- 172.21.15.50:0/90621138 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b965b1e990 msgr2=0x55b965ecea30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:23:45.603 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:45.601+0000 7f4851400640 1 --2- 172.21.15.50:0/90621138 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b965b1e990 0x55b965ecea30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:45.603 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:45.601+0000 7f4851400640 1 -- 172.21.15.50:0/90621138 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b965b09b60 msgr2=0x55b965ed9e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:23:45.603 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:45.601+0000 7f4851400640 1 --2- 172.21.15.50:0/90621138 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b965b09b60 0x55b965ed9e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:45.603 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:45.601+0000 7f4851400640 1 -- 172.21.15.50:0/90621138 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b965ed84e0 con 0x55b965b01980 2024-08-31T04:23:45.603 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:45.601+0000 7f4851400640 1 --2- 172.21.15.50:0/90621138 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b965b01980 0x55b965ecef70 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f48400c8120 tx=0x7f4840031f70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d266f9db03a2b29d server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:23:45.603 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:45.601+0000 7f483ea00640 1 -- 172.21.15.50:0/90621138 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4840049070 con 0x55b965b01980 2024-08-31T04:23:45.604 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:45.602+0000 7f483ea00640 1 -- 172.21.15.50:0/90621138 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f48400d0020 con 0x55b965b01980 2024-08-31T04:23:45.604 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:45.602+0000 7f483ea00640 1 -- 172.21.15.50:0/90621138 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48400b30f0 con 0x55b965b01980 2024-08-31T04:23:45.604 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:45.603+0000 7f485fe03740 1 -- 172.21.15.50:0/90621138 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b965b01980 msgr2=0x55b965ecef70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:23:45.604 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:45.603+0000 7f485fe03740 1 --2- 172.21.15.50:0/90621138 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b965b01980 0x55b965ecef70 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f48400c8120 tx=0x7f4840031f70 comp rx=0 tx=0).stop 2024-08-31T04:23:45.604 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:45.603+0000 7f485fe03740 1 -- 172.21.15.50:0/90621138 shutdown_connections 2024-08-31T04:23:45.605 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:45.603+0000 7f485fe03740 1 --2- 172.21.15.50:0/90621138 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b965b01980 0x55b965ecef70 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:45.605 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:45.603+0000 7f485fe03740 1 --2- 172.21.15.50:0/90621138 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b965b09b60 0x55b965ed9e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:45.605 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:45.603+0000 7f485fe03740 1 --2- 172.21.15.50:0/90621138 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b965b1e990 0x55b965ecea30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:45.605 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:45.603+0000 7f485fe03740 1 -- 172.21.15.50:0/90621138 >> 172.21.15.50:0/90621138 conn(0x55b965ef7a70 msgr2=0x55b965edb4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:23:45.605 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:45.603+0000 7f485fe03740 1 -- 172.21.15.50:0/90621138 shutdown_connections 2024-08-31T04:23:45.605 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:45.603+0000 7f485fe03740 1 -- 172.21.15.50:0/90621138 wait complete. 2024-08-31T04:23:45.605 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:45.604+0000 7f485fe03740 1 -- start start 2024-08-31T04:23:45.606 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:45.604+0000 7f485fe03740 1 Processor -- start 2024-08-31T04:23:45.606 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:45.605+0000 7f485fe03740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b965b01980 0x55b965ee4d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:45.606 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:45.605+0000 7f485fe03740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b965b09b60 0x55b965ee52b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:45.607 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:45.605+0000 7f485fe03740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b965b1e990 0x55b965edfd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:45.607 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:45.605+0000 7f485fe03740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f48541ae090 con 0x55b965b1e990 2024-08-31T04:23:45.607 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:45.605+0000 7f485fe03740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f48541ad9c0 con 0x55b965b01980 2024-08-31T04:23:45.607 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:45.605+0000 7f485fe03740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f48541aac20 con 0x55b965b09b60 2024-08-31T04:23:45.607 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:45.605+0000 7f485fe03740 10 client.0 _ll_register_callbacks cb 0x7f48400cbb20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:23:45.607 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:45.605+0000 7f4851e00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b965b01980 0x55b965ee4d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:45.608 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:45.606+0000 7f4851e00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b965b01980 0x55b965ee4d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.50:49696/0 (socket says 172.21.15.50:49696) 2024-08-31T04:23:45.608 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:45.606+0000 7f4851e00640 1 -- 172.21.15.50:0/3606850761 learned_addr learned my addr 172.21.15.50:0/3606850761 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:23:45.608 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:45.606+0000 7f4852800640 1 --2- 172.21.15.50:0/3606850761 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b965b1e990 0x55b965edfd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:45.608 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:45.606+0000 7f4851400640 1 --2- 172.21.15.50:0/3606850761 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b965b09b60 0x55b965ee52b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:45.608 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:45.607+0000 7f4852800640 1 -- 172.21.15.50:0/3606850761 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b965b09b60 msgr2=0x55b965ee52b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:23:45.608 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:45.607+0000 7f4852800640 1 --2- 172.21.15.50:0/3606850761 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b965b09b60 0x55b965ee52b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:45.609 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:45.607+0000 7f4852800640 1 -- 172.21.15.50:0/3606850761 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b965b01980 msgr2=0x55b965ee4d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:23:45.609 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:45.607+0000 7f4852800640 1 --2- 172.21.15.50:0/3606850761 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b965b01980 0x55b965ee4d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:45.609 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:45.607+0000 7f4852800640 1 -- 172.21.15.50:0/3606850761 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b965ee59f0 con 0x55b965b1e990 2024-08-31T04:23:45.609 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:45.607+0000 7f4851e00640 1 --2- 172.21.15.50:0/3606850761 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b965b01980 0x55b965ee4d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:23:45.609 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:45.607+0000 7f4852800640 1 --2- 172.21.15.50:0/3606850761 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b965b1e990 0x55b965edfd20 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f484c005fd0 tx=0x7f484c009dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f614490b83621e2 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:23:45.609 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:45.607+0000 7f4833e00640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-08-31T04:23:45.611 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:45.609+0000 7f4833e00640 1 -- 172.21.15.50:0/3606850761 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f484c003970 con 0x55b965b1e990 2024-08-31T04:23:45.611 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:45.609+0000 7f4833e00640 1 -- 172.21.15.50:0/3606850761 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8219+0+0 (secure 0 0 0) 0x7f484c003b10 con 0x55b965b1e990 2024-08-31T04:23:45.611 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:45.609+0000 7f485fe03740 1 -- 172.21.15.50:0/3606850761 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f48400d0020 con 0x55b965b1e990 2024-08-31T04:23:45.611 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:45.610+0000 7f4833e00640 1 -- 172.21.15.50:0/3606850761 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f484c003d10 con 0x55b965b1e990 2024-08-31T04:23:45.611 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:45.610+0000 7f485fe03740 10 client.15495 fetch_fsmap learned FSMap version 29 2024-08-31T04:23:45.611 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:45.610+0000 7f485fe03740 1 -- 172.21.15.50:0/3606850761 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55b965f625c0 con 0x55b965b1e990 2024-08-31T04:23:45.613 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:45.610+0000 7f4833e00640 1 -- 172.21.15.50:0/3606850761 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f48400d0020 con 0x55b965b1e990 2024-08-31T04:23:45.613 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:45.611+0000 7f4833e00640 1 -- 172.21.15.50:0/3606850761 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f484c004640 con 0x55b965b1e990 2024-08-31T04:23:45.613 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:45.611+0000 7f485fe03740 10 client.15495 fetch_fsmap finished waiting for FSMap version 29 2024-08-31T04:23:45.613 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:45.611+0000 7f485fe03740 10 client.15495 resolve_mds: validated gid 24695 aka daemon mds.b 2024-08-31T04:23:45.613 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:45.611+0000 7f485fe03740 20 client.15495 populate_metadata read hostname 'smithi050' 2024-08-31T04:23:45.613 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:45.611+0000 7f485fe03740 1 --2- 172.21.15.50:0/3606850761 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x55b965b2a840 0x55b965f64ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:45.613 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:45.611+0000 7f485fe03740 4 client.15495 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 146.4, "await_for": 45.0}] 2024-08-31T04:23:45.613 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:45.611+0000 7f485fe03740 1 -- 172.21.15.50:0/3606850761 --> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 146.4, "await_for": 45.0}) -- 0x55b965e43f20 con 0x55b965b2a840 2024-08-31T04:23:45.613 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:45.611+0000 7f4851e00640 1 --2- 172.21.15.50:0/3606850761 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x55b965b2a840 0x55b965f64ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:45.614 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:45.612+0000 7f4851e00640 1 --2- 172.21.15.50:0/3606850761 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x55b965b2a840 0x55b965f64ea0 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=912cc9816211e464 server_cookie=f79a4df18880ec6c in_seq=0 out_seq=0 2024-08-31T04:23:45.614 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:45.612+0000 7f4833e00640 10 client.15495 ms_handle_connect on v2:172.21.15.133:6838/2526402262 2024-08-31T04:23:45.625 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:45.624+0000 7f4833e00640 1 -- 172.21.15.50:0/3606850761 <== mds.0 v2:172.21.15.133:6838/2526402262 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x55b965e43f20 con 0x55b965b2a840 2024-08-31T04:23:45.625 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:45.624+0000 7f4833e00640 10 client.15495 handle_command_reply: tid=0 2024-08-31T04:23:45.625 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:45.624+0000 7f485fe03740 1 client.15495 shutdown 2024-08-31T04:23:45.625 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:45.624+0000 7f485fe03740 1 -- 172.21.15.50:0/3606850761 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b965b1e990 msgr2=0x55b965edfd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:23:45.626 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:45.624+0000 7f485fe03740 1 --2- 172.21.15.50:0/3606850761 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b965b1e990 0x55b965edfd20 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f484c005fd0 tx=0x7f484c009dd0 comp rx=0 tx=0).stop 2024-08-31T04:23:45.626 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:45.625+0000 7f485fe03740 1 -- 172.21.15.50:0/3606850761 shutdown_connections 2024-08-31T04:23:45.626 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:45.625+0000 7f485fe03740 1 --2- 172.21.15.50:0/3606850761 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x55b965b2a840 0x55b965f64ea0 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:45.627 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:45.625+0000 7f485fe03740 1 --2- 172.21.15.50:0/3606850761 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b965b09b60 0x55b965ee52b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:45.627 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:45.625+0000 7f485fe03740 1 --2- 172.21.15.50:0/3606850761 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b965b1e990 0x55b965edfd20 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:45.627 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:45.625+0000 7f485fe03740 1 --2- 172.21.15.50:0/3606850761 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b965b01980 0x55b965ee4d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:45.627 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:45.625+0000 7f485fe03740 1 -- 172.21.15.50:0/3606850761 >> 172.21.15.50:0/3606850761 conn(0x55b965ef7a70 msgr2=0x55b965ecea30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:23:45.627 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:45.625+0000 7f4833e00640 0 client.15495 ms_handle_reset on v2:172.21.15.133:6838/2526402262 2024-08-31T04:23:45.627 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:45.625+0000 7f485fe03740 1 -- 172.21.15.50:0/3606850761 shutdown_connections 2024-08-31T04:23:45.627 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:45.625+0000 7f485fe03740 1 -- 172.21.15.50:0/3606850761 wait complete. 2024-08-31T04:23:45.627 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:45.625+0000 7f485fe03740 20 client.15495 trim_cache size 0 max 16384 2024-08-31T04:23:45.628 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-08-31T04:23:45.628 INFO:teuthology.orchestra.run.smithi050.stdout: "epoch": 29, 2024-08-31T04:23:45.628 INFO:teuthology.orchestra.run.smithi050.stdout: "leader": 24695, 2024-08-31T04:23:45.628 INFO:teuthology.orchestra.run.smithi050.stdout: "set_version": 2, 2024-08-31T04:23:45.628 INFO:teuthology.orchestra.run.smithi050.stdout: "sets": { 2024-08-31T04:23:45.628 INFO:teuthology.orchestra.run.smithi050.stdout: "2196db7d": { 2024-08-31T04:23:45.628 INFO:teuthology.orchestra.run.smithi050.stdout: "version": 2, 2024-08-31T04:23:45.628 INFO:teuthology.orchestra.run.smithi050.stdout: "age_ref": 0.0, 2024-08-31T04:23:45.628 INFO:teuthology.orchestra.run.smithi050.stdout: "state": { 2024-08-31T04:23:45.628 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "QUIESCED", 2024-08-31T04:23:45.628 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 0.0 2024-08-31T04:23:45.628 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:23:45.629 INFO:teuthology.orchestra.run.smithi050.stdout: "timeout": 90.0, 2024-08-31T04:23:45.629 INFO:teuthology.orchestra.run.smithi050.stdout: "expiration": 146.4, 2024-08-31T04:23:45.629 INFO:teuthology.orchestra.run.smithi050.stdout: "members": { 2024-08-31T04:23:45.629 INFO:teuthology.orchestra.run.smithi050.stdout: "file:/": { 2024-08-31T04:23:45.629 INFO:teuthology.orchestra.run.smithi050.stdout: "excluded": false, 2024-08-31T04:23:45.629 INFO:teuthology.orchestra.run.smithi050.stdout: "state": { 2024-08-31T04:23:45.629 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "QUIESCED", 2024-08-31T04:23:45.629 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 0.0 2024-08-31T04:23:45.629 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T04:23:45.629 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T04:23:45.629 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T04:23:45.629 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T04:23:45.629 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T04:23:45.629 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-08-31T04:23:45.630 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:45.626+0000 7f4853200640 1 -- 172.21.15.50:0/1346124135 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f48380b4b20 msgr2=0x7f48380b7030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:23:45.630 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:45.626+0000 7f4853200640 1 --2- 172.21.15.50:0/1346124135 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f48380b4b20 0x7f48380b7030 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f4844003eb0 tx=0x7f4844003f10 comp rx=0 tx=0).stop 2024-08-31T04:23:45.630 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:45.626+0000 7f4853200640 1 -- 172.21.15.50:0/1346124135 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4854109070 msgr2=0x7f485419c810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:23:45.630 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:45.626+0000 7f4853200640 1 --2- 172.21.15.50:0/1346124135 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4854109070 0x7f485419c810 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f4840005ab0 tx=0x7f4840003b90 comp rx=0 tx=0).stop 2024-08-31T04:23:45.630 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:45.626+0000 7f4853200640 1 -- 172.21.15.50:0/1346124135 shutdown_connections 2024-08-31T04:23:45.630 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:45.626+0000 7f4853200640 1 --2- 172.21.15.50:0/1346124135 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f48380b4b20 0x7f48380b7030 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:45.631 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:45.626+0000 7f4853200640 1 --2- 172.21.15.50:0/1346124135 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f48541099c0 0x7f48541a1ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:45.631 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:45.626+0000 7f4853200640 1 --2- 172.21.15.50:0/1346124135 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4854109070 0x7f485419c810 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:45.631 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:45.626+0000 7f4853200640 1 --2- 172.21.15.50:0/1346124135 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4854103730 0x7f485419c270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:45.631 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:45.626+0000 7f4853200640 1 -- 172.21.15.50:0/1346124135 >> 172.21.15.50:0/1346124135 conn(0x7f48540ff180 msgr2=0x7f485410e4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:23:45.631 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:45.627+0000 7f4853200640 1 -- 172.21.15.50:0/1346124135 shutdown_connections 2024-08-31T04:23:45.631 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:23:45.627+0000 7f4853200640 1 -- 172.21.15.50:0/1346124135 wait complete. 2024-08-31T04:23:45.950 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:23:45 smithi050 ceph-mon[17259]: pgmap v392: 97 pgs: 97 active+clean; 664 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 341 B/s wr, 8 op/s 2024-08-31T04:23:45.996 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:23:45 smithi177 ceph-mon[22025]: pgmap v392: 97 pgs: 97 active+clean; 664 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 341 B/s wr, 8 op/s 2024-08-31T04:23:46.043 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:23:45 smithi133 ceph-mon[22177]: pgmap v392: 97 pgs: 97 active+clean; 664 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 341 B/s wr, 8 op/s 2024-08-31T04:23:46.570 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '2196db7d', quiesce took 4.4 seconds. Will release after: 22.0 2024-08-31T04:23:47.950 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:23:47 smithi050 ceph-mon[17259]: pgmap v393: 97 pgs: 97 active+clean; 664 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 426 B/s wr, 11 op/s 2024-08-31T04:23:47.996 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:23:47 smithi177 ceph-mon[22025]: pgmap v393: 97 pgs: 97 active+clean; 664 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 426 B/s wr, 11 op/s 2024-08-31T04:23:48.042 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:23:47 smithi133 ceph-mon[22177]: pgmap v393: 97 pgs: 97 active+clean; 664 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 426 B/s wr, 11 op/s 2024-08-31T04:23:49.950 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:23:49 smithi050 ceph-mon[17259]: pgmap v394: 97 pgs: 97 active+clean; 669 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 938 B/s wr, 11 op/s 2024-08-31T04:23:49.996 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:23:49 smithi177 ceph-mon[22025]: pgmap v394: 97 pgs: 97 active+clean; 669 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 938 B/s wr, 11 op/s 2024-08-31T04:23:50.043 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:23:49 smithi133 ceph-mon[22177]: pgmap v394: 97 pgs: 97 active+clean; 669 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 938 B/s wr, 11 op/s 2024-08-31T04:23:51.950 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:23:51 smithi050 ceph-mon[17259]: pgmap v395: 97 pgs: 97 active+clean; 669 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 938 B/s wr, 9 op/s 2024-08-31T04:23:51.996 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:23:51 smithi177 ceph-mon[22025]: pgmap v395: 97 pgs: 97 active+clean; 669 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 938 B/s wr, 9 op/s 2024-08-31T04:23:52.043 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:23:51 smithi133 ceph-mon[22177]: pgmap v395: 97 pgs: 97 active+clean; 669 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 938 B/s wr, 9 op/s 2024-08-31T04:23:52.950 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:23:52 smithi050 ceph-mon[17259]: pgmap v396: 97 pgs: 97 active+clean; 669 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 938 B/s wr, 13 op/s 2024-08-31T04:23:52.996 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:23:52 smithi177 ceph-mon[22025]: pgmap v396: 97 pgs: 97 active+clean; 669 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 938 B/s wr, 13 op/s 2024-08-31T04:23:53.042 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:23:52 smithi133 ceph-mon[22177]: pgmap v396: 97 pgs: 97 active+clean; 669 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 938 B/s wr, 13 op/s 2024-08-31T04:23:53.805 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:53.802+0000 7f6e26600640 1 -- 172.21.15.50:0/734536222 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6e20104ca0 msgr2=0x7f6e2010b640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:23:53.805 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:53.802+0000 7f6e26600640 1 --2- 172.21.15.50:0/734536222 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6e20104ca0 0x7f6e2010b640 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f6e18009be0 tx=0x7f6e1802a6c0 comp rx=0 tx=0).stop 2024-08-31T04:23:53.805 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:53.802+0000 7f6e26600640 1 -- 172.21.15.50:0/734536222 shutdown_connections 2024-08-31T04:23:53.805 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:53.802+0000 7f6e26600640 1 --2- 172.21.15.50:0/734536222 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6e20104ca0 0x7f6e2010b640 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:53.805 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:53.802+0000 7f6e26600640 1 --2- 172.21.15.50:0/734536222 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6e20104300 0x7f6e20104710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:53.805 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:53.802+0000 7f6e26600640 1 --2- 172.21.15.50:0/734536222 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6e20103280 0x7f6e201036f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:53.805 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:53.802+0000 7f6e26600640 1 -- 172.21.15.50:0/734536222 >> 172.21.15.50:0/734536222 conn(0x7f6e200febc0 msgr2=0x7f6e20101070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:23:53.805 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:53.802+0000 7f6e26600640 1 -- 172.21.15.50:0/734536222 shutdown_connections 2024-08-31T04:23:53.805 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:53.802+0000 7f6e26600640 1 -- 172.21.15.50:0/734536222 wait complete. 2024-08-31T04:23:53.806 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:53.804+0000 7f6e26600640 1 Processor -- start 2024-08-31T04:23:53.806 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:53.804+0000 7f6e26600640 1 -- start start 2024-08-31T04:23:53.807 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:53.805+0000 7f6e26600640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6e20103280 0x7f6e2019bcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:53.807 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:53.805+0000 7f6e26600640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6e20104300 0x7f6e2019c320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:53.807 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:53.805+0000 7f6e26600640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6e20104ca0 0x7f6e2019ced0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:53.807 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:53.805+0000 7f6e26600640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f6e2010ef00 con 0x7f6e20104ca0 2024-08-31T04:23:53.807 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:53.805+0000 7f6e26600640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f6e2010ed80 con 0x7f6e20103280 2024-08-31T04:23:53.807 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:53.805+0000 7f6e26600640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f6e2010f080 con 0x7f6e20104300 2024-08-31T04:23:53.808 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:53.805+0000 7f6e25c00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6e20104ca0 0x7f6e2019ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:53.808 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:53.805+0000 7f6e1fe00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6e20104300 0x7f6e2019c320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:53.808 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:53.805+0000 7f6e25200640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6e20103280 0x7f6e2019bcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:53.808 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:53.805+0000 7f6e1fe00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6e20104300 0x7f6e2019c320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.50:57700/0 (socket says 172.21.15.50:57700) 2024-08-31T04:23:53.808 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:53.805+0000 7f6e1fe00640 1 -- 172.21.15.50:0/235703397 learned_addr learned my addr 172.21.15.50:0/235703397 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:23:53.809 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:53.806+0000 7f6e25200640 1 -- 172.21.15.50:0/235703397 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6e20104300 msgr2=0x7f6e2019c320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:23:53.809 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:53.806+0000 7f6e25200640 1 --2- 172.21.15.50:0/235703397 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6e20104300 0x7f6e2019c320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:53.809 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:53.806+0000 7f6e25200640 1 -- 172.21.15.50:0/235703397 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6e20104ca0 msgr2=0x7f6e2019ced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:23:53.809 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:53.806+0000 7f6e25200640 1 --2- 172.21.15.50:0/235703397 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6e20104ca0 0x7f6e2019ced0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:53.809 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:53.806+0000 7f6e25200640 1 -- 172.21.15.50:0/235703397 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e2019d6f0 con 0x7f6e20103280 2024-08-31T04:23:53.809 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:53.806+0000 7f6e1fe00640 1 --2- 172.21.15.50:0/235703397 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6e20104300 0x7f6e2019c320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:23:53.809 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:53.806+0000 7f6e25200640 1 --2- 172.21.15.50:0/235703397 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6e20103280 0x7f6e2019bcb0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f6e1400e9f0 tx=0x7f6e1400eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:23:53.810 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:53.807+0000 7f6e1d600640 1 -- 172.21.15.50:0/235703397 <== mon.2 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e1400ccc0 con 0x7f6e20103280 2024-08-31T04:23:53.810 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:53.807+0000 7f6e1d600640 1 -- 172.21.15.50:0/235703397 <== mon.2 v2:172.21.15.133:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6e14005020 con 0x7f6e20103280 2024-08-31T04:23:53.810 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:53.807+0000 7f6e1d600640 1 -- 172.21.15.50:0/235703397 <== mon.2 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e14004a00 con 0x7f6e20103280 2024-08-31T04:23:53.810 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:53.807+0000 7f6e26600640 1 -- 172.21.15.50:0/235703397 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6e2019d9e0 con 0x7f6e20103280 2024-08-31T04:23:53.810 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:53.807+0000 7f6e26600640 1 -- 172.21.15.50:0/235703397 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6e201a40d0 con 0x7f6e20103280 2024-08-31T04:23:53.813 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:53.812+0000 7f6e2ebfe740 1 Processor -- start 2024-08-31T04:23:53.814 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:53.812+0000 7f6e2ebfe740 1 -- start start 2024-08-31T04:23:53.815 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:53.813+0000 7f6e1d600640 1 -- 172.21.15.50:0/235703397 <== mon.2 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 18) ==== 152577+0+0 (secure 0 0 0) 0x7f6e14004ba0 con 0x7f6e20103280 2024-08-31T04:23:53.815 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:53.813+0000 7f6e2ebfe740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55803bd101b0 0x55803c0be7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:53.816 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:53.813+0000 7f6e2ebfe740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55803bce72f0 0x55803c0bee20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:53.816 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:53.813+0000 7f6e2ebfe740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55803bcef4d0 0x55803c0bf970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:53.816 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:53.813+0000 7f6e2ebfe740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55803c028f70 con 0x55803bd101b0 2024-08-31T04:23:53.816 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:53.813+0000 7f6e2ebfe740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x55803c018500 con 0x55803bce72f0 2024-08-31T04:23:53.816 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:53.813+0000 7f6e2ebfe740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x55803c01c4b0 con 0x55803bcef4d0 2024-08-31T04:23:53.817 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:53.814+0000 7f6e25200640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55803bce72f0 0x55803c0bee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:53.817 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:53.814+0000 7f6e1fe00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55803bcef4d0 0x55803c0bf970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:53.817 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:53.814+0000 7f6e25200640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55803bce72f0 0x55803c0bee20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.50:42580/0 (socket says 172.21.15.50:42580) 2024-08-31T04:23:53.817 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:53.814+0000 7f6e25200640 1 -- 172.21.15.50:0/1924038113 learned_addr learned my addr 172.21.15.50:0/1924038113 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:23:53.817 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:53.814+0000 7f6e25c00640 1 --2- 172.21.15.50:0/1924038113 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55803bd101b0 0x55803c0be7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:53.817 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:53.814+0000 7f6e1fe00640 1 -- 172.21.15.50:0/1924038113 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55803bce72f0 msgr2=0x55803c0bee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:23:53.817 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:53.814+0000 7f6e1fe00640 1 --2- 172.21.15.50:0/1924038113 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55803bce72f0 0x55803c0bee20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:53.817 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:53.814+0000 7f6e1fe00640 1 -- 172.21.15.50:0/1924038113 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55803bd101b0 msgr2=0x55803c0be7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:23:53.818 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:53.815+0000 7f6e1fe00640 1 --2- 172.21.15.50:0/1924038113 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55803bd101b0 0x55803c0be7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:53.818 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:53.815+0000 7f6e1fe00640 1 -- 172.21.15.50:0/1924038113 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55803bfd2c10 con 0x55803bcef4d0 2024-08-31T04:23:53.818 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:53.815+0000 7f6e25c00640 1 --2- 172.21.15.50:0/1924038113 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55803bd101b0 0x55803c0be7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:23:53.818 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:53.815+0000 7f6e1fe00640 1 --2- 172.21.15.50:0/1924038113 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55803bcef4d0 0x55803c0bf970 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f6e0c011510 tx=0x7f6e0c0119d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6ea157728a649852 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:23:53.818 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:53.815+0000 7f6e12000640 1 -- 172.21.15.50:0/1924038113 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e0c01e070 con 0x55803bcef4d0 2024-08-31T04:23:53.818 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:53.815+0000 7f6e12000640 1 -- 172.21.15.50:0/1924038113 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6e0c0035f0 con 0x55803bcef4d0 2024-08-31T04:23:53.818 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:53.815+0000 7f6e12000640 1 -- 172.21.15.50:0/1924038113 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e0c00f820 con 0x55803bcef4d0 2024-08-31T04:23:53.818 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:53.816+0000 7f6e1d600640 1 --2- 172.21.15.50:0/235703397 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f6e080b4bb0 0x7f6e080b70c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:53.819 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:53.816+0000 7f6e1d600640 1 -- 172.21.15.50:0/235703397 <== mon.2 v2:172.21.15.133:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8219+0+0 (secure 0 0 0) 0x7f6e140e4fa0 con 0x7f6e20103280 2024-08-31T04:23:53.819 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:53.816+0000 7f6e25c00640 1 --2- 172.21.15.50:0/235703397 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f6e080b4bb0 0x7f6e080b70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:53.819 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:53.817+0000 7f6e2ebfe740 1 -- 172.21.15.50:0/1924038113 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55803bcef4d0 msgr2=0x55803c0bf970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:23:53.819 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:53.817+0000 7f6e2ebfe740 1 --2- 172.21.15.50:0/1924038113 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55803bcef4d0 0x55803c0bf970 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f6e0c011510 tx=0x7f6e0c0119d0 comp rx=0 tx=0).stop 2024-08-31T04:23:53.820 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:53.817+0000 7f6e2ebfe740 1 -- 172.21.15.50:0/1924038113 shutdown_connections 2024-08-31T04:23:53.820 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:53.817+0000 7f6e2ebfe740 1 --2- 172.21.15.50:0/1924038113 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55803bcef4d0 0x55803c0bf970 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:53.820 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:53.817+0000 7f6e2ebfe740 1 --2- 172.21.15.50:0/1924038113 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55803bce72f0 0x55803c0bee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:53.820 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:53.817+0000 7f6e2ebfe740 1 --2- 172.21.15.50:0/1924038113 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55803bd101b0 0x55803c0be7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:53.820 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:53.817+0000 7f6e2ebfe740 1 -- 172.21.15.50:0/1924038113 >> 172.21.15.50:0/1924038113 conn(0x55803bd04300 msgr2=0x55803c0ba240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:23:53.820 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:53.817+0000 7f6e2ebfe740 1 -- 172.21.15.50:0/1924038113 shutdown_connections 2024-08-31T04:23:53.820 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:53.817+0000 7f6e25c00640 1 --2- 172.21.15.50:0/235703397 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f6e080b4bb0 0x7f6e080b70c0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f6e18004af0 tx=0x7f6e18005fd0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:23:53.820 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:53.817+0000 7f6e2ebfe740 1 -- 172.21.15.50:0/1924038113 wait complete. 2024-08-31T04:23:53.821 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:53.818+0000 7f6e2ebfe740 1 -- start start 2024-08-31T04:23:53.821 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:53.818+0000 7f6e2ebfe740 1 Processor -- start 2024-08-31T04:23:53.821 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:53.819+0000 7f6e2ebfe740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55803bce72f0 0x55803c0c7e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:53.821 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:53.819+0000 7f6e2ebfe740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55803bcef4d0 0x55803c0c8500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:53.821 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:53.819+0000 7f6e2ebfe740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55803bd101b0 0x55803c0c9070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:53.821 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:53.819+0000 7f6e2ebfe740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55803bf51ab0 con 0x55803bd101b0 2024-08-31T04:23:53.821 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:53.819+0000 7f6e2ebfe740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x55803bfbf320 con 0x55803bcef4d0 2024-08-31T04:23:53.822 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:53.819+0000 7f6e2ebfe740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x55803c0c0490 con 0x55803bce72f0 2024-08-31T04:23:53.822 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:53.819+0000 7f6e2ebfe740 10 client.0 _ll_register_callbacks cb 0x55803bfc56a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:23:53.823 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:53.820+0000 7f6e25200640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55803bce72f0 0x55803c0c7e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:53.823 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:53.820+0000 7f6e25200640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55803bce72f0 0x55803c0c7e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.50:57716/0 (socket says 172.21.15.50:57716) 2024-08-31T04:23:53.823 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:53.820+0000 7f6e25200640 1 -- 172.21.15.50:0/3769385319 learned_addr learned my addr 172.21.15.50:0/3769385319 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:23:53.823 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:53.820+0000 7f6e25c00640 1 --2- 172.21.15.50:0/3769385319 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55803bd101b0 0x55803c0c9070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:53.823 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:53.820+0000 7f6e1fe00640 1 --2- 172.21.15.50:0/3769385319 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55803bcef4d0 0x55803c0c8500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:53.823 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:53.820+0000 7f6e25200640 1 -- 172.21.15.50:0/3769385319 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55803bcef4d0 msgr2=0x55803c0c8500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:23:53.823 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:53.820+0000 7f6e25200640 1 --2- 172.21.15.50:0/3769385319 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55803bcef4d0 0x55803c0c8500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:53.823 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:53.820+0000 7f6e25200640 1 -- 172.21.15.50:0/3769385319 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55803bd101b0 msgr2=0x55803c0c9070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:23:53.823 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:53.820+0000 7f6e25200640 1 --2- 172.21.15.50:0/3769385319 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55803bd101b0 0x55803c0c9070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:53.824 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:53.820+0000 7f6e25200640 1 -- 172.21.15.50:0/3769385319 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55803bd7b790 con 0x55803bce72f0 2024-08-31T04:23:53.824 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:53.821+0000 7f6e25200640 1 --2- 172.21.15.50:0/3769385319 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55803bce72f0 0x55803c0c7e40 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f6e1400e9c0 tx=0x7f6e140e8640 comp rx=0 tx=0).ready entity=mon.1 client_cookie=afbacf22e4018a90 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:23:53.824 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:53.821+0000 7f6e06a00640 10 client.0 ms_handle_connect on v2:172.21.15.177:3300/0 2024-08-31T04:23:53.824 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:53.821+0000 7f6e06a00640 1 -- 172.21.15.50:0/3769385319 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e1401c070 con 0x55803bce72f0 2024-08-31T04:23:53.824 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:53.821+0000 7f6e06a00640 1 -- 172.21.15.50:0/3769385319 <== mon.1 v2:172.21.15.177:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8219+0+0 (secure 0 0 0) 0x7f6e140054f0 con 0x55803bce72f0 2024-08-31T04:23:53.824 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:53.821+0000 7f6e2ebfe740 1 -- 172.21.15.50:0/3769385319 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6e0c0035f0 con 0x55803bce72f0 2024-08-31T04:23:53.825 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:53.821+0000 7f6e06a00640 1 -- 172.21.15.50:0/3769385319 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f6e140ab850 con 0x55803bce72f0 2024-08-31T04:23:53.825 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:53.821+0000 7f6e2ebfe740 10 client.25507 fetch_fsmap learned FSMap version 29 2024-08-31T04:23:53.825 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:53.821+0000 7f6e2ebfe740 1 -- 172.21.15.50:0/3769385319 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55803bdf4620 con 0x55803bce72f0 2024-08-31T04:23:53.825 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:53.821+0000 7f6e06a00640 1 -- 172.21.15.50:0/3769385319 <== mon.1 v2:172.21.15.177:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6e0c0035f0 con 0x55803bce72f0 2024-08-31T04:23:53.825 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:53.823+0000 7f6e06a00640 1 -- 172.21.15.50:0/3769385319 <== mon.1 v2:172.21.15.177:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f6e140e8c80 con 0x55803bce72f0 2024-08-31T04:23:53.825 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:53.823+0000 7f6e2ebfe740 10 client.25507 fetch_fsmap finished waiting for FSMap version 29 2024-08-31T04:23:53.825 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:53.823+0000 7f6e2ebfe740 10 client.25507 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T04:23:53.826 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:53.823+0000 7f6e2ebfe740 20 client.25507 populate_metadata read hostname 'smithi050' 2024-08-31T04:23:53.826 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:53.823+0000 7f6e2ebfe740 1 --2- 172.21.15.50:0/3769385319 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x55803bcced80 0x55803c0d5700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:53.826 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:53.823+0000 7f6e2ebfe740 4 client.25507 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T04:23:53.826 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:53.823+0000 7f6e2ebfe740 1 -- 172.21.15.50:0/3769385319 --> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55803c02aec0 con 0x55803bcced80 2024-08-31T04:23:53.826 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:53.823+0000 7f6e1fe00640 1 --2- 172.21.15.50:0/3769385319 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x55803bcced80 0x55803c0d5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:53.826 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:53.824+0000 7f6e1fe00640 1 --2- 172.21.15.50:0/3769385319 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x55803bcced80 0x55803c0d5700 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=437d2d2f104f6869 server_cookie=24d611cf30febbeb in_seq=0 out_seq=0 2024-08-31T04:23:53.826 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:53.824+0000 7f6e06a00640 10 client.25507 ms_handle_connect on v2:172.21.15.133:6838/2526402262 2024-08-31T04:23:53.827 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:53.825+0000 7f6e06a00640 1 -- 172.21.15.50:0/3769385319 <== mds.0 v2:172.21.15.133:6838/2526402262 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55803c02aec0 con 0x55803bcced80 2024-08-31T04:23:53.827 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:53.825+0000 7f6e06a00640 10 client.25507 handle_command_reply: tid=0 2024-08-31T04:23:53.827 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:53.825+0000 7f6e2ebfe740 1 client.25507 shutdown 2024-08-31T04:23:53.828 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:53.825+0000 7f6e2ebfe740 1 -- 172.21.15.50:0/3769385319 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55803bce72f0 msgr2=0x55803c0c7e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:23:53.828 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:53.825+0000 7f6e2ebfe740 1 --2- 172.21.15.50:0/3769385319 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55803bce72f0 0x55803c0c7e40 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f6e1400e9c0 tx=0x7f6e140e8640 comp rx=0 tx=0).stop 2024-08-31T04:23:53.828 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:53.826+0000 7f6e2ebfe740 1 -- 172.21.15.50:0/3769385319 shutdown_connections 2024-08-31T04:23:53.828 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:53.826+0000 7f6e2ebfe740 1 --2- 172.21.15.50:0/3769385319 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x55803bcced80 0x55803c0d5700 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:53.828 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:53.826+0000 7f6e2ebfe740 1 --2- 172.21.15.50:0/3769385319 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55803bd101b0 0x55803c0c9070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:53.828 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:53.826+0000 7f6e2ebfe740 1 --2- 172.21.15.50:0/3769385319 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55803bcef4d0 0x55803c0c8500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:53.829 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:53.826+0000 7f6e2ebfe740 1 --2- 172.21.15.50:0/3769385319 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55803bce72f0 0x55803c0c7e40 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:53.829 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:53.826+0000 7f6e06a00640 0 client.25507 ms_handle_reset on v2:172.21.15.133:6838/2526402262 2024-08-31T04:23:53.829 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:53.826+0000 7f6e2ebfe740 1 -- 172.21.15.50:0/3769385319 >> 172.21.15.50:0/3769385319 conn(0x55803bd04300 msgr2=0x55803c0aff40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:23:53.829 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:53.826+0000 7f6e2ebfe740 1 -- 172.21.15.50:0/3769385319 shutdown_connections 2024-08-31T04:23:53.829 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:53.826+0000 7f6e2ebfe740 1 -- 172.21.15.50:0/3769385319 wait complete. 2024-08-31T04:23:53.829 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:53.826+0000 7f6e2ebfe740 20 client.25507 trim_cache size 0 max 16384 2024-08-31T04:23:53.859 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:53.857+0000 7f6e2ebfe740 1 Processor -- start 2024-08-31T04:23:53.860 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:53.857+0000 7f6e2ebfe740 1 -- start start 2024-08-31T04:23:53.860 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:53.857+0000 7f6e2ebfe740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55803bce72f0 0x55803c0b9b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:53.860 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:53.857+0000 7f6e2ebfe740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55803bcef4d0 0x55803c0c28a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:53.860 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:53.857+0000 7f6e2ebfe740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55803bd101b0 0x55803c0c2de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:53.860 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:53.857+0000 7f6e2ebfe740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f6e201a8870 con 0x55803bd101b0 2024-08-31T04:23:53.860 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:53.857+0000 7f6e2ebfe740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f6e201aa3b0 con 0x55803bcef4d0 2024-08-31T04:23:53.860 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:53.857+0000 7f6e2ebfe740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f6e201a8f40 con 0x55803bce72f0 2024-08-31T04:23:53.861 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:53.858+0000 7f6e1fe00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55803bcef4d0 0x55803c0c28a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:53.861 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:53.858+0000 7f6e1fe00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55803bcef4d0 0x55803c0c28a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.50:42594/0 (socket says 172.21.15.50:42594) 2024-08-31T04:23:53.861 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:53.858+0000 7f6e1fe00640 1 -- 172.21.15.50:0/2948407515 learned_addr learned my addr 172.21.15.50:0/2948407515 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:23:53.862 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:53.858+0000 7f6e25200640 1 --2- 172.21.15.50:0/2948407515 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55803bce72f0 0x55803c0b9b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:53.862 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:53.858+0000 7f6e25c00640 1 --2- 172.21.15.50:0/2948407515 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55803bd101b0 0x55803c0c2de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:53.862 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:53.858+0000 7f6e1fe00640 1 -- 172.21.15.50:0/2948407515 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55803bce72f0 msgr2=0x55803c0b9b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:23:53.862 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:53.858+0000 7f6e1fe00640 1 --2- 172.21.15.50:0/2948407515 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55803bce72f0 0x55803c0b9b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:53.862 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:53.858+0000 7f6e1fe00640 1 -- 172.21.15.50:0/2948407515 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55803bd101b0 msgr2=0x55803c0c2de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:23:53.862 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:53.858+0000 7f6e1fe00640 1 --2- 172.21.15.50:0/2948407515 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55803bd101b0 0x55803c0c2de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:53.862 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:53.858+0000 7f6e1fe00640 1 -- 172.21.15.50:0/2948407515 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55803c0d0310 con 0x55803bcef4d0 2024-08-31T04:23:53.862 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:53.858+0000 7f6e25c00640 1 --2- 172.21.15.50:0/2948407515 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55803bd101b0 0x55803c0c2de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:23:53.862 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:53.859+0000 7f6e1fe00640 1 --2- 172.21.15.50:0/2948407515 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55803bcef4d0 0x55803c0c28a0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f6e0c005a00 tx=0x7f6e0c009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4c34076126d219cd server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:23:53.862 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:53.859+0000 7f6e11600640 1 -- 172.21.15.50:0/2948407515 <== mon.2 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e0c01e040 con 0x55803bcef4d0 2024-08-31T04:23:53.862 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:53.859+0000 7f6e11600640 1 -- 172.21.15.50:0/2948407515 <== mon.2 v2:172.21.15.133:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6e0c0054f0 con 0x55803bcef4d0 2024-08-31T04:23:53.862 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:53.859+0000 7f6e11600640 1 -- 172.21.15.50:0/2948407515 <== mon.2 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e0c0045c0 con 0x55803bcef4d0 2024-08-31T04:23:53.863 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:53.860+0000 7f6e2ebfe740 1 -- 172.21.15.50:0/2948407515 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55803bcef4d0 msgr2=0x55803c0c28a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:23:53.864 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:53.860+0000 7f6e2ebfe740 1 --2- 172.21.15.50:0/2948407515 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55803bcef4d0 0x55803c0c28a0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f6e0c005a00 tx=0x7f6e0c009b80 comp rx=0 tx=0).stop 2024-08-31T04:23:53.864 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:53.860+0000 7f6e2ebfe740 1 -- 172.21.15.50:0/2948407515 shutdown_connections 2024-08-31T04:23:53.864 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:53.860+0000 7f6e2ebfe740 1 --2- 172.21.15.50:0/2948407515 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55803bd101b0 0x55803c0c2de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:53.864 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:53.860+0000 7f6e2ebfe740 1 --2- 172.21.15.50:0/2948407515 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55803bcef4d0 0x55803c0c28a0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:53.864 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:53.860+0000 7f6e2ebfe740 1 --2- 172.21.15.50:0/2948407515 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55803bce72f0 0x55803c0b9b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:53.864 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:53.860+0000 7f6e2ebfe740 1 -- 172.21.15.50:0/2948407515 >> 172.21.15.50:0/2948407515 conn(0x55803bd04300 msgr2=0x55803c0bf5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:23:53.864 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:53.861+0000 7f6e2ebfe740 1 -- 172.21.15.50:0/2948407515 shutdown_connections 2024-08-31T04:23:53.864 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:53.861+0000 7f6e2ebfe740 1 -- 172.21.15.50:0/2948407515 wait complete. 2024-08-31T04:23:53.864 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:53.861+0000 7f6e2ebfe740 1 -- start start 2024-08-31T04:23:53.864 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:53.862+0000 7f6e2ebfe740 1 Processor -- start 2024-08-31T04:23:53.865 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:53.862+0000 7f6e2ebfe740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55803bce72f0 0x55803c0cd120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:53.865 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:53.862+0000 7f6e2ebfe740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55803bcef4d0 0x55803c0cd7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:53.866 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:53.862+0000 7f6e2ebfe740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55803bd101b0 0x55803c0ce300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:53.866 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:53.862+0000 7f6e2ebfe740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f6e201a9ce0 con 0x55803bce72f0 2024-08-31T04:23:53.866 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:53.862+0000 7f6e2ebfe740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f6e201a9610 con 0x55803bd101b0 2024-08-31T04:23:53.866 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:53.862+0000 7f6e2ebfe740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f6e201a6870 con 0x55803bcef4d0 2024-08-31T04:23:53.866 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:53.862+0000 7f6e2ebfe740 10 client.0 _ll_register_callbacks cb 0x7f6e140e8800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:23:53.866 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:53.863+0000 7f6e25200640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55803bce72f0 0x55803c0cd120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:53.866 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:53.863+0000 7f6e1fe00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55803bcef4d0 0x55803c0cd7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:53.866 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:53.863+0000 7f6e1fe00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55803bcef4d0 0x55803c0cd7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.50:57740/0 (socket says 172.21.15.50:57740) 2024-08-31T04:23:53.866 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:53.863+0000 7f6e1fe00640 1 -- 172.21.15.50:0/1670267782 learned_addr learned my addr 172.21.15.50:0/1670267782 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:23:53.866 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:53.863+0000 7f6e25c00640 1 --2- 172.21.15.50:0/1670267782 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55803bd101b0 0x55803c0ce300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:53.866 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:53.863+0000 7f6e1fe00640 1 -- 172.21.15.50:0/1670267782 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55803bd101b0 msgr2=0x55803c0ce300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:23:53.866 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:53.863+0000 7f6e1fe00640 1 --2- 172.21.15.50:0/1670267782 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55803bd101b0 0x55803c0ce300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:53.866 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:53.863+0000 7f6e1fe00640 1 -- 172.21.15.50:0/1670267782 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55803bce72f0 msgr2=0x55803c0cd120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:23:53.866 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:53.863+0000 7f6e1fe00640 1 --2- 172.21.15.50:0/1670267782 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55803bce72f0 0x55803c0cd120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:53.867 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:53.863+0000 7f6e1fe00640 1 -- 172.21.15.50:0/1670267782 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55803c0c93e0 con 0x55803bcef4d0 2024-08-31T04:23:53.867 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:53.863+0000 7f6e1fe00640 1 --2- 172.21.15.50:0/1670267782 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55803bcef4d0 0x55803c0cd7e0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f6e0c005a50 tx=0x7f6e0c0056c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=27f189a4a541a352 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:23:53.867 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:53.863+0000 7f6e06a00640 10 client.0 ms_handle_connect on v2:172.21.15.177:3300/0 2024-08-31T04:23:53.868 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:53.864+0000 7f6e06a00640 1 -- 172.21.15.50:0/1670267782 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e0c01e030 con 0x55803bcef4d0 2024-08-31T04:23:53.868 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:53.864+0000 7f6e06a00640 1 -- 172.21.15.50:0/1670267782 <== mon.1 v2:172.21.15.177:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8219+0+0 (secure 0 0 0) 0x7f6e0c0035f0 con 0x55803bcef4d0 2024-08-31T04:23:53.868 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:53.864+0000 7f6e2ebfe740 1 -- 172.21.15.50:0/1670267782 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6e0c0054f0 con 0x55803bcef4d0 2024-08-31T04:23:53.868 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:53.864+0000 7f6e06a00640 1 -- 172.21.15.50:0/1670267782 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f6e0c032040 con 0x55803bcef4d0 2024-08-31T04:23:53.868 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:53.864+0000 7f6e2ebfe740 10 client.25513 fetch_fsmap learned FSMap version 29 2024-08-31T04:23:53.868 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:53.864+0000 7f6e2ebfe740 1 -- 172.21.15.50:0/1670267782 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55803c0cfb80 con 0x55803bcef4d0 2024-08-31T04:23:53.868 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:53.864+0000 7f6e06a00640 1 -- 172.21.15.50:0/1670267782 <== mon.1 v2:172.21.15.177:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6e0c0054f0 con 0x55803bcef4d0 2024-08-31T04:23:53.869 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:53.865+0000 7f6e06a00640 1 -- 172.21.15.50:0/1670267782 <== mon.1 v2:172.21.15.177:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f6e0c035070 con 0x55803bcef4d0 2024-08-31T04:23:53.869 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:53.865+0000 7f6e2ebfe740 10 client.25513 fetch_fsmap finished waiting for FSMap version 29 2024-08-31T04:23:53.869 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:53.865+0000 7f6e2ebfe740 10 client.25513 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T04:23:53.869 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:53.865+0000 7f6e2ebfe740 20 client.25513 populate_metadata read hostname 'smithi050' 2024-08-31T04:23:53.869 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:53.865+0000 7f6e2ebfe740 1 --2- 172.21.15.50:0/1670267782 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x55803bca41c0 0x55803c142140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:23:53.869 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:53.865+0000 7f6e2ebfe740 4 client.25513 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-31T04:23:53.869 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:53.865+0000 7f6e2ebfe740 1 -- 172.21.15.50:0/1670267782 --> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55803c026960 con 0x55803bca41c0 2024-08-31T04:23:53.869 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:53.866+0000 7f6e25200640 1 --2- 172.21.15.50:0/1670267782 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x55803bca41c0 0x55803c142140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:23:53.869 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:53.866+0000 7f6e25200640 1 --2- 172.21.15.50:0/1670267782 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x55803bca41c0 0x55803c142140 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=46312a0772b94b44 server_cookie=64f24274a60a82f7 in_seq=0 out_seq=0 2024-08-31T04:23:53.869 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:53.866+0000 7f6e06a00640 10 client.25513 ms_handle_connect on v2:172.21.15.133:6838/2526402262 2024-08-31T04:23:53.877 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:53.874+0000 7f6e06a00640 1 -- 172.21.15.50:0/1670267782 <== mds.0 v2:172.21.15.133:6838/2526402262 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55803c026960 con 0x55803bca41c0 2024-08-31T04:23:53.877 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:53.874+0000 7f6e06a00640 10 client.25513 handle_command_reply: tid=0 2024-08-31T04:23:53.877 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:53.874+0000 7f6e2ebfe740 1 client.25513 shutdown 2024-08-31T04:23:53.877 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:53.875+0000 7f6e2ebfe740 1 -- 172.21.15.50:0/1670267782 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55803bcef4d0 msgr2=0x55803c0cd7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:23:53.877 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:53.875+0000 7f6e2ebfe740 1 --2- 172.21.15.50:0/1670267782 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55803bcef4d0 0x55803c0cd7e0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f6e0c005a50 tx=0x7f6e0c0056c0 comp rx=0 tx=0).stop 2024-08-31T04:23:53.878 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:53.875+0000 7f6e2ebfe740 1 -- 172.21.15.50:0/1670267782 shutdown_connections 2024-08-31T04:23:53.878 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:53.875+0000 7f6e2ebfe740 1 --2- 172.21.15.50:0/1670267782 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x55803bca41c0 0x55803c142140 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:53.878 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:53.875+0000 7f6e2ebfe740 1 --2- 172.21.15.50:0/1670267782 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55803bcef4d0 0x55803c0cd7e0 secure :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f6e0c005a50 tx=0x7f6e0c0056c0 comp rx=0 tx=0).stop 2024-08-31T04:23:53.878 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:53.875+0000 7f6e2ebfe740 1 --2- 172.21.15.50:0/1670267782 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55803bd101b0 0x55803c0ce300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:53.878 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:53.875+0000 7f6e06a00640 0 client.25513 ms_handle_reset on v2:172.21.15.133:6838/2526402262 2024-08-31T04:23:53.878 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:53.875+0000 7f6e2ebfe740 1 --2- 172.21.15.50:0/1670267782 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55803bce72f0 0x55803c0cd120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:53.878 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:53.875+0000 7f6e2ebfe740 1 -- 172.21.15.50:0/1670267782 >> 172.21.15.50:0/1670267782 conn(0x55803bd04300 msgr2=0x55803c0c28a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:23:53.878 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:53.875+0000 7f6e2ebfe740 1 -- 172.21.15.50:0/1670267782 shutdown_connections 2024-08-31T04:23:53.879 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:53.876+0000 7f6e2ebfe740 1 -- 172.21.15.50:0/1670267782 wait complete. 2024-08-31T04:23:53.879 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:53.876+0000 7f6e2ebfe740 20 client.25513 trim_cache size 0 max 16384 2024-08-31T04:23:53.879 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout:{ 2024-08-31T04:23:53.879 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout: "message": "", 2024-08-31T04:23:53.879 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout: "return_code": 0 2024-08-31T04:23:53.879 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout:} 2024-08-31T04:23:53.880 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:53.876+0000 7f6e26600640 1 -- 172.21.15.50:0/235703397 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f6e080b4bb0 msgr2=0x7f6e080b70c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:23:53.880 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:53.876+0000 7f6e26600640 1 --2- 172.21.15.50:0/235703397 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f6e080b4bb0 0x7f6e080b70c0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f6e18004af0 tx=0x7f6e18005fd0 comp rx=0 tx=0).stop 2024-08-31T04:23:53.880 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:53.876+0000 7f6e26600640 1 -- 172.21.15.50:0/235703397 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6e20103280 msgr2=0x7f6e2019bcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:23:53.880 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:53.877+0000 7f6e26600640 1 --2- 172.21.15.50:0/235703397 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6e20103280 0x7f6e2019bcb0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f6e1400e9f0 tx=0x7f6e1400eeb0 comp rx=0 tx=0).stop 2024-08-31T04:23:53.880 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:53.877+0000 7f6e26600640 1 -- 172.21.15.50:0/235703397 shutdown_connections 2024-08-31T04:23:53.880 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:53.877+0000 7f6e26600640 1 --2- 172.21.15.50:0/235703397 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f6e080b4bb0 0x7f6e080b70c0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:53.880 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:53.877+0000 7f6e26600640 1 --2- 172.21.15.50:0/235703397 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6e20104300 0x7f6e2019c320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:53.880 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:53.877+0000 7f6e26600640 1 --2- 172.21.15.50:0/235703397 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6e20104ca0 0x7f6e2019ced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:53.880 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:53.877+0000 7f6e26600640 1 --2- 172.21.15.50:0/235703397 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6e20103280 0x7f6e2019bcb0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:23:53.881 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:53.877+0000 7f6e26600640 1 -- 172.21.15.50:0/235703397 >> 172.21.15.50:0/235703397 conn(0x7f6e200febc0 msgr2=0x7f6e20075390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:23:53.881 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:53.877+0000 7f6e26600640 1 -- 172.21.15.50:0/235703397 shutdown_connections 2024-08-31T04:23:53.881 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:23:53.877+0000 7f6e26600640 1 -- 172.21.15.50:0/235703397 wait complete. 2024-08-31T04:23:55.246 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:23:54 smithi177 ceph-mon[22025]: pgmap v397: 97 pgs: 97 active+clean; 669 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 597 B/s wr, 9 op/s 2024-08-31T04:23:55.292 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:23:54 smithi133 ceph-mon[22177]: pgmap v397: 97 pgs: 97 active+clean; 669 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 597 B/s wr, 9 op/s 2024-08-31T04:23:55.360 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:23:54 smithi050 ceph-mon[17259]: pgmap v397: 97 pgs: 97 active+clean; 669 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 597 B/s wr, 9 op/s 2024-08-31T04:23:57.246 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:23:56 smithi177 ceph-mon[22025]: pgmap v398: 97 pgs: 97 active+clean; 669 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 1023 B/s wr, 12 op/s 2024-08-31T04:23:57.293 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:23:56 smithi133 ceph-mon[22177]: pgmap v398: 97 pgs: 97 active+clean; 669 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 1023 B/s wr, 12 op/s 2024-08-31T04:23:57.450 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:23:56 smithi050 ceph-mon[17259]: pgmap v398: 97 pgs: 97 active+clean; 669 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 1023 B/s wr, 12 op/s 2024-08-31T04:23:59.246 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:23:58 smithi177 ceph-mon[22025]: pgmap v399: 97 pgs: 97 active+clean; 670 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 1.3 KiB/s wr, 12 op/s 2024-08-31T04:23:59.293 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:23:58 smithi133 ceph-mon[22177]: pgmap v399: 97 pgs: 97 active+clean; 670 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 1.3 KiB/s wr, 12 op/s 2024-08-31T04:23:59.450 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:23:58 smithi050 ceph-mon[17259]: pgmap v399: 97 pgs: 97 active+clean; 670 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 1.3 KiB/s wr, 12 op/s 2024-08-31T04:24:01.246 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:24:00 smithi177 ceph-mon[22025]: pgmap v400: 97 pgs: 97 active+clean; 670 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 853 B/s wr, 10 op/s 2024-08-31T04:24:01.292 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:24:00 smithi133 ceph-mon[22177]: pgmap v400: 97 pgs: 97 active+clean; 670 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 853 B/s wr, 10 op/s 2024-08-31T04:24:01.450 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:24:00 smithi050 ceph-mon[17259]: pgmap v400: 97 pgs: 97 active+clean; 670 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 853 B/s wr, 10 op/s 2024-08-31T04:24:03.246 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:24:02 smithi177 ceph-mon[22025]: pgmap v401: 97 pgs: 97 active+clean; 670 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 853 B/s wr, 13 op/s 2024-08-31T04:24:03.293 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:24:02 smithi133 ceph-mon[22177]: pgmap v401: 97 pgs: 97 active+clean; 670 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 853 B/s wr, 13 op/s 2024-08-31T04:24:03.450 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:24:02 smithi050 ceph-mon[17259]: pgmap v401: 97 pgs: 97 active+clean; 670 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 853 B/s wr, 13 op/s 2024-08-31T04:24:05.246 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:24:04 smithi177 ceph-mon[22025]: pgmap v402: 97 pgs: 97 active+clean; 670 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 853 B/s wr, 10 op/s 2024-08-31T04:24:05.293 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:24:04 smithi133 ceph-mon[22177]: pgmap v402: 97 pgs: 97 active+clean; 670 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 853 B/s wr, 10 op/s 2024-08-31T04:24:05.450 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:24:04 smithi050 ceph-mon[17259]: pgmap v402: 97 pgs: 97 active+clean; 670 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 853 B/s wr, 10 op/s 2024-08-31T04:24:06.246 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:24:05 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T04:24:06.292 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:24:05 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T04:24:06.450 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:24:05 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T04:24:07.106 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:07.105+0000 7f7a9da00640 1 -- 172.21.15.50:0/4031451139 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7a98109020 msgr2=0x7f7a9810b530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:24:07.106 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:07.105+0000 7f7a9da00640 1 --2- 172.21.15.50:0/4031451139 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7a98109020 0x7f7a9810b530 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f7a90009ca0 tx=0x7f7a9002a8c0 comp rx=0 tx=0).stop 2024-08-31T04:24:07.106 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:07.105+0000 7f7a9da00640 1 -- 172.21.15.50:0/4031451139 shutdown_connections 2024-08-31T04:24:07.106 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:07.105+0000 7f7a9da00640 1 --2- 172.21.15.50:0/4031451139 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7a98109020 0x7f7a9810b530 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:07.107 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:07.105+0000 7f7a9da00640 1 --2- 172.21.15.50:0/4031451139 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7a98106460 0x7f7a981088e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:07.107 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:07.105+0000 7f7a9da00640 1 --2- 172.21.15.50:0/4031451139 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7a9806b4b0 0x7f7a98105f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:07.107 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:07.105+0000 7f7a9da00640 1 -- 172.21.15.50:0/4031451139 >> 172.21.15.50:0/4031451139 conn(0x7f7a980fdb20 msgr2=0x7f7a980fffd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:24:07.107 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:07.105+0000 7f7a9da00640 1 -- 172.21.15.50:0/4031451139 shutdown_connections 2024-08-31T04:24:07.107 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:07.105+0000 7f7a9da00640 1 -- 172.21.15.50:0/4031451139 wait complete. 2024-08-31T04:24:07.107 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:07.106+0000 7f7a9da00640 1 Processor -- start 2024-08-31T04:24:07.107 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:07.106+0000 7f7a9da00640 1 -- start start 2024-08-31T04:24:07.108 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:07.107+0000 7f7a9da00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7a9806b4b0 0x7f7a98199af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:07.108 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:07.107+0000 7f7a9da00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7a98106460 0x7f7a9819a160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:07.108 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:07.107+0000 7f7a9da00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7a98109020 0x7f7a9819ad10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:07.109 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:07.107+0000 7f7a9da00640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f7a9810ef20 con 0x7f7a9806b4b0 2024-08-31T04:24:07.109 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:07.107+0000 7f7a9da00640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f7a9810eda0 con 0x7f7a98106460 2024-08-31T04:24:07.109 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:07.107+0000 7f7a9da00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f7a9810f0a0 con 0x7f7a98109020 2024-08-31T04:24:07.109 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:07.107+0000 7f7a97e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7a9806b4b0 0x7f7a98199af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:24:07.109 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:07.107+0000 7f7a97e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7a9806b4b0 0x7f7a98199af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:34652/0 (socket says 172.21.15.50:34652) 2024-08-31T04:24:07.109 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:07.107+0000 7f7a97e00640 1 -- 172.21.15.50:0/3667780805 learned_addr learned my addr 172.21.15.50:0/3667780805 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:24:07.109 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:07.107+0000 7f7a97400640 1 --2- 172.21.15.50:0/3667780805 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7a98106460 0x7f7a9819a160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:24:07.109 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:07.107+0000 7f7a9d000640 1 --2- 172.21.15.50:0/3667780805 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7a98109020 0x7f7a9819ad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:24:07.109 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:07.107+0000 7f7a97e00640 1 -- 172.21.15.50:0/3667780805 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7a98109020 msgr2=0x7f7a9819ad10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:24:07.109 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:07.107+0000 7f7a97e00640 1 --2- 172.21.15.50:0/3667780805 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7a98109020 0x7f7a9819ad10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:07.109 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:07.107+0000 7f7a97e00640 1 -- 172.21.15.50:0/3667780805 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7a98106460 msgr2=0x7f7a9819a160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:24:07.109 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:07.107+0000 7f7a97e00640 1 --2- 172.21.15.50:0/3667780805 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7a98106460 0x7f7a9819a160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:07.109 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:07.107+0000 7f7a97e00640 1 -- 172.21.15.50:0/3667780805 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a9819b530 con 0x7f7a9806b4b0 2024-08-31T04:24:07.110 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:07.108+0000 7f7a97e00640 1 --2- 172.21.15.50:0/3667780805 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7a9806b4b0 0x7f7a98199af0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f7a8800ea60 tx=0x7f7a8800ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:24:07.110 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:07.108+0000 7f7a94c00640 1 -- 172.21.15.50:0/3667780805 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a8800cde0 con 0x7f7a9806b4b0 2024-08-31T04:24:07.110 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:07.108+0000 7f7a94c00640 1 -- 172.21.15.50:0/3667780805 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7a880035f0 con 0x7f7a9806b4b0 2024-08-31T04:24:07.110 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:07.108+0000 7f7a9da00640 1 -- 172.21.15.50:0/3667780805 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7a9819b820 con 0x7f7a9806b4b0 2024-08-31T04:24:07.110 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:07.108+0000 7f7a94c00640 1 -- 172.21.15.50:0/3667780805 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a88010690 con 0x7f7a9806b4b0 2024-08-31T04:24:07.111 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:07.108+0000 7f7a9da00640 1 -- 172.21.15.50:0/3667780805 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7a98101d00 con 0x7f7a9806b4b0 2024-08-31T04:24:07.113 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:07.112+0000 7f7aa6019740 1 Processor -- start 2024-08-31T04:24:07.113 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:07.112+0000 7f7aa6019740 1 -- start start 2024-08-31T04:24:07.113 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:07.112+0000 7f7aa6019740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56360ceb21b0 0x56360d257d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:07.113 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:07.112+0000 7f7aa6019740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56360ce892f0 0x56360d2583b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:07.114 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:07.112+0000 7f7aa6019740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56360ce914d0 0x56360d258f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:07.114 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:07.112+0000 7f7aa6019740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x56360d1caf70 con 0x56360ceb21b0 2024-08-31T04:24:07.114 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:07.112+0000 7f7aa6019740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x56360d1ba500 con 0x56360ce914d0 2024-08-31T04:24:07.114 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:07.112+0000 7f7aa6019740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x56360d1be4b0 con 0x56360ce892f0 2024-08-31T04:24:07.114 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:07.113+0000 7f7a9d000640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56360ceb21b0 0x56360d257d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:24:07.114 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:07.113+0000 7f7a9d000640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56360ceb21b0 0x56360d257d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:34658/0 (socket says 172.21.15.50:34658) 2024-08-31T04:24:07.114 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:07.113+0000 7f7a9d000640 1 -- 172.21.15.50:0/2991839949 learned_addr learned my addr 172.21.15.50:0/2991839949 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:24:07.114 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:07.113+0000 7f7a97400640 1 --2- 172.21.15.50:0/2991839949 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56360ce914d0 0x56360d258f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:24:07.115 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:07.113+0000 7f7a97400640 1 -- 172.21.15.50:0/2991839949 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56360ce892f0 msgr2=0x56360d2583b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-31T04:24:07.115 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:07.113+0000 7f7a97400640 1 --2- 172.21.15.50:0/2991839949 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56360ce892f0 0x56360d2583b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:07.115 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:07.113+0000 7f7a97400640 1 -- 172.21.15.50:0/2991839949 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56360ceb21b0 msgr2=0x56360d257d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:24:07.115 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:07.113+0000 7f7a97400640 1 --2- 172.21.15.50:0/2991839949 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56360ceb21b0 0x56360d257d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:07.115 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:07.113+0000 7f7a97400640 1 -- 172.21.15.50:0/2991839949 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56360d174c10 con 0x56360ce914d0 2024-08-31T04:24:07.116 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:07.114+0000 7f7a97400640 1 --2- 172.21.15.50:0/2991839949 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56360ce914d0 0x56360d258f00 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f7a84009bf0 tx=0x7f7a84011810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e90f221f9cd9bccd server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:24:07.116 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:07.114+0000 7f7a8d600640 1 -- 172.21.15.50:0/2991839949 <== mon.2 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a84009da0 con 0x56360ce914d0 2024-08-31T04:24:07.116 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:07.114+0000 7f7a8d600640 1 -- 172.21.15.50:0/2991839949 <== mon.2 v2:172.21.15.133:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7a84005020 con 0x56360ce914d0 2024-08-31T04:24:07.116 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:07.114+0000 7f7a8d600640 1 -- 172.21.15.50:0/2991839949 <== mon.2 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a84004a90 con 0x56360ce914d0 2024-08-31T04:24:07.117 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:07.115+0000 7f7a94c00640 1 -- 172.21.15.50:0/3667780805 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 18) ==== 152577+0+0 (secure 0 0 0) 0x7f7a880037a0 con 0x7f7a9806b4b0 2024-08-31T04:24:07.117 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:07.115+0000 7f7aa6019740 1 -- 172.21.15.50:0/2991839949 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56360ce914d0 msgr2=0x56360d258f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:24:07.117 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:07.115+0000 7f7aa6019740 1 --2- 172.21.15.50:0/2991839949 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56360ce914d0 0x56360d258f00 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f7a84009bf0 tx=0x7f7a84011810 comp rx=0 tx=0).stop 2024-08-31T04:24:07.117 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:07.115+0000 7f7aa6019740 1 -- 172.21.15.50:0/2991839949 shutdown_connections 2024-08-31T04:24:07.117 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:07.115+0000 7f7aa6019740 1 --2- 172.21.15.50:0/2991839949 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56360ce892f0 0x56360d2583b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:07.117 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:07.115+0000 7f7aa6019740 1 --2- 172.21.15.50:0/2991839949 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56360ce914d0 0x56360d258f00 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:07.117 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:07.115+0000 7f7aa6019740 1 --2- 172.21.15.50:0/2991839949 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56360ceb21b0 0x56360d257d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:07.117 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:07.115+0000 7f7aa6019740 1 -- 172.21.15.50:0/2991839949 >> 172.21.15.50:0/2991839949 conn(0x56360cea6300 msgr2=0x56360d2537d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:24:07.117 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:07.116+0000 7f7aa6019740 1 -- 172.21.15.50:0/2991839949 shutdown_connections 2024-08-31T04:24:07.117 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:07.116+0000 7f7aa6019740 1 -- 172.21.15.50:0/2991839949 wait complete. 2024-08-31T04:24:07.121 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:07.116+0000 7f7aa6019740 1 -- start start 2024-08-31T04:24:07.121 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:07.117+0000 7f7aa6019740 1 Processor -- start 2024-08-31T04:24:07.122 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:07.117+0000 7f7a94c00640 1 --2- 172.21.15.50:0/3667780805 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f7a7c0b4a40 0x7f7a7c0b6f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:07.122 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:07.117+0000 7f7aa6019740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56360ce892f0 0x56360d261440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:07.122 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:07.117+0000 7f7aa6019740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56360ce914d0 0x56360d261b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:07.122 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:07.117+0000 7f7aa6019740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56360ceb21b0 0x56360d262670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:07.122 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:07.117+0000 7f7aa6019740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x56360d0f3ab0 con 0x56360ce914d0 2024-08-31T04:24:07.122 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:07.117+0000 7f7aa6019740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x56360d161320 con 0x56360ceb21b0 2024-08-31T04:24:07.122 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:07.117+0000 7f7aa6019740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x56360d259a20 con 0x56360ce892f0 2024-08-31T04:24:07.122 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:07.118+0000 7f7aa6019740 10 client.0 _ll_register_callbacks cb 0x56360d19ae80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:24:07.122 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:07.118+0000 7f7a94c00640 1 -- 172.21.15.50:0/3667780805 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8219+0+0 (secure 0 0 0) 0x7f7a880e5530 con 0x7f7a9806b4b0 2024-08-31T04:24:07.122 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:07.118+0000 7f7a97e00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56360ce892f0 0x56360d261440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:24:07.122 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:07.118+0000 7f7a9d000640 1 --2- 172.21.15.50:0/3667780805 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f7a7c0b4a40 0x7f7a7c0b6f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:24:07.122 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:07.118+0000 7f7a97e00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56360ce892f0 0x56360d261440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.50:33726/0 (socket says 172.21.15.50:33726) 2024-08-31T04:24:07.123 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:07.118+0000 7f7a97e00640 1 -- 172.21.15.50:0/2858042027 learned_addr learned my addr 172.21.15.50:0/2858042027 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:24:07.123 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:07.118+0000 7f7a97400640 1 --2- 172.21.15.50:0/2858042027 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56360ce914d0 0x56360d261b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:24:07.123 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:07.119+0000 7f7a97e00640 1 -- 172.21.15.50:0/2858042027 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56360ceb21b0 msgr2=0x56360d262670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:24:07.123 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:07.119+0000 7f7a97e00640 1 --2- 172.21.15.50:0/2858042027 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56360ceb21b0 0x56360d262670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:07.123 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:07.119+0000 7f7a97e00640 1 -- 172.21.15.50:0/2858042027 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56360ce914d0 msgr2=0x56360d261b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:24:07.123 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:07.119+0000 7f7a97e00640 1 --2- 172.21.15.50:0/2858042027 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56360ce914d0 0x56360d261b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:07.123 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:07.119+0000 7f7a97e00640 1 -- 172.21.15.50:0/2858042027 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56360cf1d790 con 0x56360ce892f0 2024-08-31T04:24:07.123 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:07.119+0000 7f7a97e00640 1 --2- 172.21.15.50:0/2858042027 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56360ce892f0 0x56360d261440 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f7a880a9180 tx=0x7f7a880ab740 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5764e3bee3b5f274 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:24:07.123 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:07.119+0000 7f7a82000640 10 client.0 ms_handle_connect on v2:172.21.15.177:3300/0 2024-08-31T04:24:07.123 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:07.119+0000 7f7a82000640 1 -- 172.21.15.50:0/2858042027 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a880abf10 con 0x56360ce892f0 2024-08-31T04:24:07.123 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:07.119+0000 7f7a82000640 1 -- 172.21.15.50:0/2858042027 <== mon.1 v2:172.21.15.177:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8219+0+0 (secure 0 0 0) 0x7f7a880a81a0 con 0x56360ce892f0 2024-08-31T04:24:07.123 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:07.119+0000 7f7aa6019740 1 -- 172.21.15.50:0/2858042027 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7a84005020 con 0x56360ce892f0 2024-08-31T04:24:07.123 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:07.120+0000 7f7a82000640 1 -- 172.21.15.50:0/2858042027 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f7a880b0780 con 0x56360ce892f0 2024-08-31T04:24:07.124 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:07.120+0000 7f7aa6019740 10 client.25522 fetch_fsmap learned FSMap version 29 2024-08-31T04:24:07.124 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:07.120+0000 7f7aa6019740 1 -- 172.21.15.50:0/2858042027 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x56360cf96620 con 0x56360ce892f0 2024-08-31T04:24:07.124 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:07.120+0000 7f7a82000640 1 -- 172.21.15.50:0/2858042027 <== mon.1 v2:172.21.15.177:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7a84005020 con 0x56360ce892f0 2024-08-31T04:24:07.124 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:07.120+0000 7f7a82000640 1 -- 172.21.15.50:0/2858042027 <== mon.1 v2:172.21.15.177:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f7a880b02d0 con 0x56360ce892f0 2024-08-31T04:24:07.124 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:07.120+0000 7f7aa6019740 10 client.25522 fetch_fsmap finished waiting for FSMap version 29 2024-08-31T04:24:07.124 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:07.120+0000 7f7aa6019740 10 client.25522 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T04:24:07.124 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:07.120+0000 7f7aa6019740 20 client.25522 populate_metadata read hostname 'smithi050' 2024-08-31T04:24:07.124 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:07.120+0000 7f7aa6019740 1 --2- 172.21.15.50:0/2858042027 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x56360ce70d80 0x56360d26ead0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:07.124 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:07.120+0000 7f7aa6019740 4 client.25522 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T04:24:07.124 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:07.120+0000 7f7aa6019740 1 -- 172.21.15.50:0/2858042027 --> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56360d1ccec0 con 0x56360ce70d80 2024-08-31T04:24:07.125 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:07.121+0000 7f7a97400640 1 --2- 172.21.15.50:0/2858042027 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x56360ce70d80 0x56360d26ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:24:07.125 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:07.121+0000 7f7a9d000640 1 --2- 172.21.15.50:0/3667780805 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f7a7c0b4a40 0x7f7a7c0b6f50 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f7a900094e0 tx=0x7f7a90031af0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:24:07.125 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:07.122+0000 7f7a82000640 10 client.25522 ms_handle_connect on v2:172.21.15.133:6838/2526402262 2024-08-31T04:24:07.126 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:07.122+0000 7f7a97400640 1 --2- 172.21.15.50:0/2858042027 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x56360ce70d80 0x56360d26ead0 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2cbf96faf9a6d40 server_cookie=7b17ba3039246a07 in_seq=0 out_seq=0 2024-08-31T04:24:07.126 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:07.122+0000 7f7a82000640 1 -- 172.21.15.50:0/2858042027 <== mds.0 v2:172.21.15.133:6838/2526402262 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56360d1ccec0 con 0x56360ce70d80 2024-08-31T04:24:07.126 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:07.122+0000 7f7a82000640 10 client.25522 handle_command_reply: tid=0 2024-08-31T04:24:07.126 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:07.122+0000 7f7aa6019740 1 client.25522 shutdown 2024-08-31T04:24:07.126 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:07.123+0000 7f7aa6019740 1 -- 172.21.15.50:0/2858042027 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56360ce892f0 msgr2=0x56360d261440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:24:07.126 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:07.123+0000 7f7aa6019740 1 --2- 172.21.15.50:0/2858042027 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56360ce892f0 0x56360d261440 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f7a880a9180 tx=0x7f7a880ab740 comp rx=0 tx=0).stop 2024-08-31T04:24:07.126 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:07.123+0000 7f7aa6019740 1 -- 172.21.15.50:0/2858042027 shutdown_connections 2024-08-31T04:24:07.126 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:07.123+0000 7f7aa6019740 1 --2- 172.21.15.50:0/2858042027 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x56360ce70d80 0x56360d26ead0 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:07.126 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:07.123+0000 7f7aa6019740 1 --2- 172.21.15.50:0/2858042027 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56360ceb21b0 0x56360d262670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:07.126 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:07.123+0000 7f7aa6019740 1 --2- 172.21.15.50:0/2858042027 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56360ce914d0 0x56360d261b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:07.126 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:07.123+0000 7f7aa6019740 1 --2- 172.21.15.50:0/2858042027 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56360ce892f0 0x56360d261440 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:07.126 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:07.123+0000 7f7aa6019740 1 -- 172.21.15.50:0/2858042027 >> 172.21.15.50:0/2858042027 conn(0x56360cea6300 msgr2=0x56360d251d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:24:07.126 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:07.123+0000 7f7a82000640 0 client.25522 ms_handle_reset on v2:172.21.15.133:6838/2526402262 2024-08-31T04:24:07.126 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:07.123+0000 7f7aa6019740 1 -- 172.21.15.50:0/2858042027 shutdown_connections 2024-08-31T04:24:07.126 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:07.123+0000 7f7aa6019740 1 -- 172.21.15.50:0/2858042027 wait complete. 2024-08-31T04:24:07.127 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:07.123+0000 7f7aa6019740 20 client.25522 trim_cache size 0 max 16384 2024-08-31T04:24:07.140 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:07.139+0000 7f7aa6019740 1 Processor -- start 2024-08-31T04:24:07.140 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:07.139+0000 7f7aa6019740 1 -- start start 2024-08-31T04:24:07.141 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:07.139+0000 7f7aa6019740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56360ce892f0 0x56360d25c540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:07.141 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:07.139+0000 7f7aa6019740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56360ce914d0 0x56360d251d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:07.141 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:07.139+0000 7f7aa6019740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56360ceb21b0 0x56360d2522b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:07.141 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:07.139+0000 7f7aa6019740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f7a981acd20 con 0x56360ce914d0 2024-08-31T04:24:07.141 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:07.139+0000 7f7aa6019740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f7a981ae860 con 0x56360ceb21b0 2024-08-31T04:24:07.141 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:07.139+0000 7f7aa6019740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f7a981ad3f0 con 0x56360ce892f0 2024-08-31T04:24:07.142 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:07.140+0000 7f7a97e00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56360ce892f0 0x56360d25c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:24:07.142 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:07.140+0000 7f7a97e00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56360ce892f0 0x56360d25c540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.50:33742/0 (socket says 172.21.15.50:33742) 2024-08-31T04:24:07.142 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:07.140+0000 7f7a97e00640 1 -- 172.21.15.50:0/696216393 learned_addr learned my addr 172.21.15.50:0/696216393 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:24:07.142 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:07.140+0000 7f7a97400640 1 --2- 172.21.15.50:0/696216393 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56360ce914d0 0x56360d251d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:24:07.142 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:07.140+0000 7f7a9d000640 1 --2- 172.21.15.50:0/696216393 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56360ceb21b0 0x56360d2522b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:24:07.142 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:07.140+0000 7f7a97e00640 1 -- 172.21.15.50:0/696216393 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56360ceb21b0 msgr2=0x56360d2522b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:24:07.142 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:07.140+0000 7f7a97e00640 1 --2- 172.21.15.50:0/696216393 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56360ceb21b0 0x56360d2522b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:07.142 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:07.140+0000 7f7a97e00640 1 -- 172.21.15.50:0/696216393 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56360ce914d0 msgr2=0x56360d251d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:24:07.142 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:07.140+0000 7f7a97e00640 1 --2- 172.21.15.50:0/696216393 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56360ce914d0 0x56360d251d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:07.142 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:07.140+0000 7f7a97e00640 1 -- 172.21.15.50:0/696216393 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56360d254f10 con 0x56360ce892f0 2024-08-31T04:24:07.143 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:07.140+0000 7f7a97400640 1 --2- 172.21.15.50:0/696216393 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56360ce914d0 0x56360d251d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:24:07.143 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:07.141+0000 7f7a97e00640 1 --2- 172.21.15.50:0/696216393 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56360ce892f0 0x56360d25c540 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f7a880d2040 tx=0x7f7a880095b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=366d08b406f95b28 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:24:07.143 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:07.141+0000 7f7a8cc00640 1 -- 172.21.15.50:0/696216393 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a880abf10 con 0x56360ce892f0 2024-08-31T04:24:07.143 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:07.141+0000 7f7a8cc00640 1 -- 172.21.15.50:0/696216393 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7a880b5230 con 0x56360ce892f0 2024-08-31T04:24:07.144 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:07.141+0000 7f7a8cc00640 1 -- 172.21.15.50:0/696216393 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a880b02d0 con 0x56360ce892f0 2024-08-31T04:24:07.144 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:07.142+0000 7f7aa6019740 1 -- 172.21.15.50:0/696216393 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56360ce892f0 msgr2=0x56360d25c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:24:07.144 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:07.142+0000 7f7aa6019740 1 --2- 172.21.15.50:0/696216393 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56360ce892f0 0x56360d25c540 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f7a880d2040 tx=0x7f7a880095b0 comp rx=0 tx=0).stop 2024-08-31T04:24:07.144 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:07.142+0000 7f7aa6019740 1 -- 172.21.15.50:0/696216393 shutdown_connections 2024-08-31T04:24:07.144 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:07.142+0000 7f7aa6019740 1 --2- 172.21.15.50:0/696216393 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56360ceb21b0 0x56360d2522b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:07.144 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:07.142+0000 7f7aa6019740 1 --2- 172.21.15.50:0/696216393 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56360ce914d0 0x56360d251d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:07.144 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:07.142+0000 7f7aa6019740 1 --2- 172.21.15.50:0/696216393 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56360ce892f0 0x56360d25c540 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:07.144 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:07.142+0000 7f7aa6019740 1 -- 172.21.15.50:0/696216393 >> 172.21.15.50:0/696216393 conn(0x56360cea6300 msgr2=0x56360d25be30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:24:07.144 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:07.142+0000 7f7aa6019740 1 -- 172.21.15.50:0/696216393 shutdown_connections 2024-08-31T04:24:07.144 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:07.142+0000 7f7aa6019740 1 -- 172.21.15.50:0/696216393 wait complete. 2024-08-31T04:24:07.145 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:07.142+0000 7f7aa6019740 1 -- start start 2024-08-31T04:24:07.145 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:07.143+0000 7f7aa6019740 1 Processor -- start 2024-08-31T04:24:07.145 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:07.143+0000 7f7aa6019740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56360ce892f0 0x56360d269050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:07.145 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:07.143+0000 7f7aa6019740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56360ce914d0 0x56360d267d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:07.145 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:07.143+0000 7f7aa6019740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56360ceb21b0 0x56360d268250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:07.146 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:07.143+0000 7f7aa6019740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f7a981ae190 con 0x56360ce892f0 2024-08-31T04:24:07.146 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:07.143+0000 7f7aa6019740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f7a981adac0 con 0x56360ce914d0 2024-08-31T04:24:07.146 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:07.143+0000 7f7aa6019740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f7a981aad00 con 0x56360ceb21b0 2024-08-31T04:24:07.146 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:07.143+0000 7f7aa6019740 10 client.0 _ll_register_callbacks cb 0x7f7a880abd50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:24:07.146 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:07.144+0000 7f7a97e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56360ce892f0 0x56360d269050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:24:07.146 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:07.144+0000 7f7a97e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56360ce892f0 0x56360d269050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:34682/0 (socket says 172.21.15.50:34682) 2024-08-31T04:24:07.146 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:07.144+0000 7f7a97e00640 1 -- 172.21.15.50:0/942784484 learned_addr learned my addr 172.21.15.50:0/942784484 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:24:07.146 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:07.144+0000 7f7a97400640 1 --2- 172.21.15.50:0/942784484 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56360ce914d0 0x56360d267d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:24:07.146 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:07.144+0000 7f7a9d000640 1 --2- 172.21.15.50:0/942784484 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56360ceb21b0 0x56360d268250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:24:07.146 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:07.144+0000 7f7a97400640 1 -- 172.21.15.50:0/942784484 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56360ceb21b0 msgr2=0x56360d268250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:24:07.146 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:07.144+0000 7f7a97400640 1 --2- 172.21.15.50:0/942784484 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56360ceb21b0 0x56360d268250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:07.146 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:07.144+0000 7f7a97400640 1 -- 172.21.15.50:0/942784484 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56360ce892f0 msgr2=0x56360d269050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:24:07.146 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:07.144+0000 7f7a97400640 1 --2- 172.21.15.50:0/942784484 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56360ce892f0 0x56360d269050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:07.146 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:07.144+0000 7f7a97400640 1 -- 172.21.15.50:0/942784484 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56360d2687e0 con 0x56360ce914d0 2024-08-31T04:24:07.148 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:07.145+0000 7f7a97400640 1 --2- 172.21.15.50:0/942784484 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56360ce914d0 0x56360d267d10 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f7a84009700 tx=0x7f7a84009960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=659cfe02b55e64b2 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:24:07.148 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:07.145+0000 7f7a82000640 10 client.0 ms_handle_connect on v2:172.21.15.133:3300/0 2024-08-31T04:24:07.148 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:07.145+0000 7f7a82000640 1 -- 172.21.15.50:0/942784484 <== mon.2 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a84004040 con 0x56360ce914d0 2024-08-31T04:24:07.148 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:07.145+0000 7f7aa6019740 1 -- 172.21.15.50:0/942784484 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7a880b5230 con 0x56360ce914d0 2024-08-31T04:24:07.148 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:07.145+0000 7f7a82000640 1 -- 172.21.15.50:0/942784484 <== mon.2 v2:172.21.15.133:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8219+0+0 (secure 0 0 0) 0x7f7a840041e0 con 0x56360ce914d0 2024-08-31T04:24:07.148 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:07.145+0000 7f7a82000640 1 -- 172.21.15.50:0/942784484 <== mon.2 v2:172.21.15.133:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f7a8403b050 con 0x56360ce914d0 2024-08-31T04:24:07.148 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:07.145+0000 7f7aa6019740 10 client.25517 fetch_fsmap learned FSMap version 29 2024-08-31T04:24:07.148 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:07.145+0000 7f7aa6019740 1 -- 172.21.15.50:0/942784484 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x56360d267620 con 0x56360ce914d0 2024-08-31T04:24:07.148 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:07.146+0000 7f7a82000640 1 -- 172.21.15.50:0/942784484 <== mon.2 v2:172.21.15.133:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7a880b5230 con 0x56360ce914d0 2024-08-31T04:24:07.148 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:07.146+0000 7f7a82000640 1 -- 172.21.15.50:0/942784484 <== mon.2 v2:172.21.15.133:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f7a840047a0 con 0x56360ce914d0 2024-08-31T04:24:07.148 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:07.146+0000 7f7aa6019740 10 client.25517 fetch_fsmap finished waiting for FSMap version 29 2024-08-31T04:24:07.148 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:07.146+0000 7f7aa6019740 10 client.25517 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T04:24:07.149 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:07.146+0000 7f7aa6019740 20 client.25517 populate_metadata read hostname 'smithi050' 2024-08-31T04:24:07.149 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:07.146+0000 7f7aa6019740 1 --2- 172.21.15.50:0/942784484 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x56360ce461c0 0x56360d2db9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:07.149 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:07.146+0000 7f7aa6019740 4 client.25517 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-31T04:24:07.149 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:07.146+0000 7f7aa6019740 1 -- 172.21.15.50:0/942784484 --> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] -- command(tid 0: {"prefix": "flush journal"}) -- 0x56360d1c8960 con 0x56360ce461c0 2024-08-31T04:24:07.149 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:07.147+0000 7f7a97e00640 1 --2- 172.21.15.50:0/942784484 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x56360ce461c0 0x56360d2db9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:24:07.149 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:07.147+0000 7f7a97e00640 1 --2- 172.21.15.50:0/942784484 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x56360ce461c0 0x56360d2db9d0 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=eac1b36b7ad1a283 server_cookie=dfae86fff78b7bee in_seq=0 out_seq=0 2024-08-31T04:24:07.149 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:07.147+0000 7f7a82000640 10 client.25517 ms_handle_connect on v2:172.21.15.133:6838/2526402262 2024-08-31T04:24:07.151 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:07.150+0000 7f7a82000640 1 -- 172.21.15.50:0/942784484 <== mds.0 v2:172.21.15.133:6838/2526402262 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x56360d1c8960 con 0x56360ce461c0 2024-08-31T04:24:07.151 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:07.150+0000 7f7a82000640 10 client.25517 handle_command_reply: tid=0 2024-08-31T04:24:07.152 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:07.150+0000 7f7aa6019740 1 client.25517 shutdown 2024-08-31T04:24:07.152 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:07.151+0000 7f7aa6019740 1 -- 172.21.15.50:0/942784484 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56360ce914d0 msgr2=0x56360d267d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:24:07.152 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:07.151+0000 7f7aa6019740 1 --2- 172.21.15.50:0/942784484 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56360ce914d0 0x56360d267d10 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f7a84009700 tx=0x7f7a84009960 comp rx=0 tx=0).stop 2024-08-31T04:24:07.152 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:07.151+0000 7f7aa6019740 1 -- 172.21.15.50:0/942784484 shutdown_connections 2024-08-31T04:24:07.152 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:07.151+0000 7f7aa6019740 1 --2- 172.21.15.50:0/942784484 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x56360ce461c0 0x56360d2db9d0 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:07.152 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:07.151+0000 7f7aa6019740 1 --2- 172.21.15.50:0/942784484 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56360ceb21b0 0x56360d268250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:07.152 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:07.151+0000 7f7aa6019740 1 --2- 172.21.15.50:0/942784484 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56360ce914d0 0x56360d267d10 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:07.152 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:07.151+0000 7f7aa6019740 1 --2- 172.21.15.50:0/942784484 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56360ce892f0 0x56360d269050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:07.153 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:07.151+0000 7f7aa6019740 1 -- 172.21.15.50:0/942784484 >> 172.21.15.50:0/942784484 conn(0x56360cea6300 msgr2=0x56360d253e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:24:07.153 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:07.151+0000 7f7a82000640 0 client.25517 ms_handle_reset on v2:172.21.15.133:6838/2526402262 2024-08-31T04:24:07.153 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:07.151+0000 7f7aa6019740 1 -- 172.21.15.50:0/942784484 shutdown_connections 2024-08-31T04:24:07.153 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:07.151+0000 7f7aa6019740 1 -- 172.21.15.50:0/942784484 wait complete. 2024-08-31T04:24:07.153 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:07.152+0000 7f7aa6019740 20 client.25517 trim_cache size 0 max 16384 2024-08-31T04:24:07.154 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout:{ 2024-08-31T04:24:07.154 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout: "message": "", 2024-08-31T04:24:07.154 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout: "return_code": 0 2024-08-31T04:24:07.154 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout:} 2024-08-31T04:24:07.154 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:07.152+0000 7f7a9da00640 1 -- 172.21.15.50:0/3667780805 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f7a7c0b4a40 msgr2=0x7f7a7c0b6f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:24:07.155 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:07.152+0000 7f7a9da00640 1 --2- 172.21.15.50:0/3667780805 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f7a7c0b4a40 0x7f7a7c0b6f50 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f7a900094e0 tx=0x7f7a90031af0 comp rx=0 tx=0).stop 2024-08-31T04:24:07.155 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:07.152+0000 7f7a9da00640 1 -- 172.21.15.50:0/3667780805 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7a9806b4b0 msgr2=0x7f7a98199af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:24:07.155 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:07.152+0000 7f7a9da00640 1 --2- 172.21.15.50:0/3667780805 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7a9806b4b0 0x7f7a98199af0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f7a8800ea60 tx=0x7f7a8800ef20 comp rx=0 tx=0).stop 2024-08-31T04:24:07.155 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:07.153+0000 7f7a9da00640 1 -- 172.21.15.50:0/3667780805 shutdown_connections 2024-08-31T04:24:07.155 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:07.153+0000 7f7a9da00640 1 --2- 172.21.15.50:0/3667780805 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f7a7c0b4a40 0x7f7a7c0b6f50 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:07.155 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:07.153+0000 7f7a9da00640 1 --2- 172.21.15.50:0/3667780805 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7a98109020 0x7f7a9819ad10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:07.155 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:07.153+0000 7f7a9da00640 1 --2- 172.21.15.50:0/3667780805 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7a98106460 0x7f7a9819a160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:07.155 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:07.153+0000 7f7a9da00640 1 --2- 172.21.15.50:0/3667780805 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7a9806b4b0 0x7f7a98199af0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:07.155 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:07.153+0000 7f7a9da00640 1 -- 172.21.15.50:0/3667780805 >> 172.21.15.50:0/3667780805 conn(0x7f7a980fdb20 msgr2=0x7f7a98104930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:24:07.155 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:07.153+0000 7f7a9da00640 1 -- 172.21.15.50:0/3667780805 shutdown_connections 2024-08-31T04:24:07.155 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:07.153+0000 7f7a9da00640 1 -- 172.21.15.50:0/3667780805 wait complete. 2024-08-31T04:24:07.293 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:24:07 smithi133 ceph-mon[22177]: pgmap v403: 97 pgs: 97 active+clean; 670 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 853 B/s wr, 12 op/s 2024-08-31T04:24:07.293 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:24:07 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:24:07.293 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:24:07 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:24:07.293 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:24:07 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:24:07.293 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:24:07 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:24:07.293 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:24:07 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:24:07.293 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:24:07 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T04:24:07.293 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:24:07 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:24:07.450 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:24:07 smithi050 ceph-mon[17259]: pgmap v403: 97 pgs: 97 active+clean; 670 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 853 B/s wr, 12 op/s 2024-08-31T04:24:07.450 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:24:07 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:24:07.450 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:24:07 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:24:07.450 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:24:07 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:24:07.450 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:24:07 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:24:07.450 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:24:07 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:24:07.450 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:24:07 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T04:24:07.451 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:24:07 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:24:07.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:24:07 smithi177 ceph-mon[22025]: pgmap v403: 97 pgs: 97 active+clean; 670 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 853 B/s wr, 12 op/s 2024-08-31T04:24:07.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:24:07 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:24:07.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:24:07 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:24:07.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:24:07 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:24:07.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:24:07 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:24:07.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:24:07 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:24:07.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:24:07 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T04:24:07.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:24:07 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:24:08.571 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 058d9fc6-674f-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-31T04:24:09.017 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:24:09.293 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:24:09 smithi133 ceph-mon[22177]: pgmap v404: 97 pgs: 97 active+clean; 670 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 426 B/s wr, 11 op/s 2024-08-31T04:24:09.349 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:24:09 smithi050 ceph-mon[17259]: pgmap v404: 97 pgs: 97 active+clean; 670 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 426 B/s wr, 11 op/s 2024-08-31T04:24:09.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:24:09 smithi177 ceph-mon[22025]: pgmap v404: 97 pgs: 97 active+clean; 670 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 426 B/s wr, 11 op/s 2024-08-31T04:24:09.824 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:09.822+0000 7f0027200640 1 -- 172.21.15.50:0/3784464733 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0028104eb0 msgr2=0x7f002810d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:24:09.825 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:09.822+0000 7f0027200640 1 --2- 172.21.15.50:0/3784464733 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0028104eb0 0x7f002810d400 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f0014009900 tx=0x7f001402a3f0 comp rx=0 tx=0).stop 2024-08-31T04:24:09.825 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:09.823+0000 7f0027200640 1 -- 172.21.15.50:0/3784464733 shutdown_connections 2024-08-31T04:24:09.825 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:09.823+0000 7f0027200640 1 --2- 172.21.15.50:0/3784464733 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f002810d9c0 0x7f002810feb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:09.825 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:09.823+0000 7f0027200640 1 --2- 172.21.15.50:0/3784464733 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0028104eb0 0x7f002810d400 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:09.825 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:09.823+0000 7f0027200640 1 --2- 172.21.15.50:0/3784464733 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0028104560 0x7f0028104970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:09.825 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:09.823+0000 7f0027200640 1 -- 172.21.15.50:0/3784464733 >> 172.21.15.50:0/3784464733 conn(0x7f00280fe060 msgr2=0x7f00281004b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:24:09.825 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:09.823+0000 7f0027200640 1 -- 172.21.15.50:0/3784464733 shutdown_connections 2024-08-31T04:24:09.825 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:09.823+0000 7f0027200640 1 -- 172.21.15.50:0/3784464733 wait complete. 2024-08-31T04:24:09.826 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:09.824+0000 7f0027200640 1 Processor -- start 2024-08-31T04:24:09.826 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:09.825+0000 7f0027200640 1 -- start start 2024-08-31T04:24:09.826 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:09.825+0000 7f0027200640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0028104560 0x7f00281a12f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:09.827 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:09.825+0000 7f0027200640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0028104eb0 0x7f00281a1830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:09.827 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:09.825+0000 7f0027200640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f002810d9c0 0x7f00281ac370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:09.827 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:09.825+0000 7f0027200640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f0028113610 con 0x7f002810d9c0 2024-08-31T04:24:09.827 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:09.825+0000 7f0027200640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f0028113490 con 0x7f0028104eb0 2024-08-31T04:24:09.827 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:09.825+0000 7f0027200640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f0028113790 con 0x7f0028104560 2024-08-31T04:24:09.827 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:09.826+0000 7f0025400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0028104eb0 0x7f00281a1830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:24:09.827 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:09.826+0000 7f0025e00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0028104560 0x7f00281a12f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:24:09.827 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:09.826+0000 7f0025e00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0028104560 0x7f00281a12f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.50:33778/0 (socket says 172.21.15.50:33778) 2024-08-31T04:24:09.827 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:09.826+0000 7f0025e00640 1 -- 172.21.15.50:0/1245810169 learned_addr learned my addr 172.21.15.50:0/1245810169 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:24:09.828 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:09.826+0000 7f0026800640 1 --2- 172.21.15.50:0/1245810169 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f002810d9c0 0x7f00281ac370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:24:09.828 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:09.826+0000 7f0025400640 1 -- 172.21.15.50:0/1245810169 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0028104560 msgr2=0x7f00281a12f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:24:09.828 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:09.826+0000 7f0025400640 1 --2- 172.21.15.50:0/1245810169 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0028104560 0x7f00281a12f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:09.828 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:09.826+0000 7f0025400640 1 -- 172.21.15.50:0/1245810169 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f002810d9c0 msgr2=0x7f00281ac370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:24:09.828 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:09.826+0000 7f0025400640 1 --2- 172.21.15.50:0/1245810169 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f002810d9c0 0x7f00281ac370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:09.829 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:09.826+0000 7f0025400640 1 -- 172.21.15.50:0/1245810169 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00281ac8b0 con 0x7f0028104eb0 2024-08-31T04:24:09.829 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:09.827+0000 7f0026800640 1 --2- 172.21.15.50:0/1245810169 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f002810d9c0 0x7f00281ac370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T04:24:09.829 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:09.827+0000 7f0025400640 1 --2- 172.21.15.50:0/1245810169 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0028104eb0 0x7f00281a1830 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f001402a910 tx=0x7f0014031a20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:24:09.829 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:09.827+0000 7f001ea00640 1 -- 172.21.15.50:0/1245810169 <== mon.2 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f001403f070 con 0x7f0028104eb0 2024-08-31T04:24:09.829 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:09.827+0000 7f001ea00640 1 -- 172.21.15.50:0/1245810169 <== mon.2 v2:172.21.15.133:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0014004490 con 0x7f0028104eb0 2024-08-31T04:24:09.829 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:09.827+0000 7f001ea00640 1 -- 172.21.15.50:0/1245810169 <== mon.2 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0014035070 con 0x7f0028104eb0 2024-08-31T04:24:09.829 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:09.827+0000 7f0027200640 1 -- 172.21.15.50:0/1245810169 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f00281aca80 con 0x7f0028104eb0 2024-08-31T04:24:09.830 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:09.828+0000 7f0027200640 1 -- 172.21.15.50:0/1245810169 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f00281ace80 con 0x7f0028104eb0 2024-08-31T04:24:09.831 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:09.829+0000 7f0027200640 1 -- 172.21.15.50:0/1245810169 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0028104970 con 0x7f0028104eb0 2024-08-31T04:24:09.834 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:09.833+0000 7f001ea00640 1 -- 172.21.15.50:0/1245810169 <== mon.2 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 18) ==== 152577+0+0 (secure 0 0 0) 0x7f001403b460 con 0x7f0028104eb0 2024-08-31T04:24:09.836 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:09.835+0000 7f001ea00640 1 --2- 172.21.15.50:0/1245810169 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f000c0b4bb0 0x7f000c0b70c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:09.836 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:09.835+0000 7f001ea00640 1 -- 172.21.15.50:0/1245810169 <== mon.2 v2:172.21.15.133:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8219+0+0 (secure 0 0 0) 0x7f0014105630 con 0x7f0028104eb0 2024-08-31T04:24:09.837 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:09.835+0000 7f0025e00640 1 --2- 172.21.15.50:0/1245810169 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f000c0b4bb0 0x7f000c0b70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:24:09.837 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:09.836+0000 7f0025e00640 1 --2- 172.21.15.50:0/1245810169 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f000c0b4bb0 0x7f000c0b70c0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f002810d570 tx=0x7f0018005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:24:09.840 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:09.839+0000 7f001ea00640 1 -- 172.21.15.50:0/1245810169 <== mon.2 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f00140cc710 con 0x7f0028104eb0 2024-08-31T04:24:10.096 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:10.094+0000 7f0027200640 1 -- 172.21.15.50:0/1245810169 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f002810ce20 con 0x7f0028104eb0 2024-08-31T04:24:10.097 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:10.095+0000 7f001ea00640 1 -- 172.21.15.50:0/1245810169 <== mon.2 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+11983 (secure 0 0 0) 0x7f00140cc010 con 0x7f0028104eb0 2024-08-31T04:24:10.097 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-08-31T04:24:10.097 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":29,"btime":"2024-08-31T04:23:00:578141+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14622,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/1565557530","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":1565557530},{"type":"v1","addr":"172.21.15.50:6835","nonce":1565557530}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14634,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6837/2660185946","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6836","nonce":2660185946},{"type":"v1","addr":"172.21.15.50:6837","nonce":2660185946}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":29,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-31T04:20:44.140709+0000","modified":"2024-08-31T04:22:59.912983+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24695,"mds_1":24691,"mds_2":24667,"mds_3":24656,"mds_4":24652},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14676":{"gid":14676,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.50:6839/2105228685","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6838","nonce":2105228685},{"type":"v1","addr":"172.21.15.50:6839","nonce":2105228685}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24590":{"gid":24590,"name":"k","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.133:6833/4283603962","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6832","nonce":4283603962},{"type":"v1","addr":"172.21.15.133:6833","nonce":4283603962}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24601":{"gid":24601,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.177:6833/1237129793","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":1237129793},{"type":"v1","addr":"172.21.15.177:6833","nonce":1237129793}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24626":{"gid":24626,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.133:6835/3637799701","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":3637799701},{"type":"v1","addr":"172.21.15.133:6835","nonce":3637799701}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24640":{"gid":24640,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.177:6835/599392457","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6834","nonce":599392457},{"type":"v1","addr":"172.21.15.177:6835","nonce":599392457}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24652":{"gid":24652,"name":"c","rank":4,"incarnation":26,"state":"up:active","state_seq":13,"addr":"172.21.15.177:6837/2159859285","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6836","nonce":2159859285},{"type":"v1","addr":"172.21.15.177:6837","nonce":2159859285}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24656":{"gid":24656,"name":"h","rank":3,"incarnation":22,"state":"up:active","state_seq":12,"addr":"172.21.15.133:6837/4014853202","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6836","nonce":4014853202},{"type":"v1","addr":"172.21.15.133:6837","nonce":4014853202}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24667":{"gid":24667,"name":"i","rank":2,"incarnation":20,"state":"up:active","state_seq":10,"addr":"172.21.15.177:6839/3600081752","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6838","nonce":3600081752},{"type":"v1","addr":"172.21.15.177:6839","nonce":3600081752}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24691":{"gid":24691,"name":"a","rank":1,"incarnation":18,"state":"up:active","state_seq":8,"addr":"172.21.15.50:6841/575209862","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6840","nonce":575209862},{"type":"v1","addr":"172.21.15.50:6841","nonce":575209862}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24695":{"gid":24695,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.133:6839/2526402262","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6838","nonce":2526402262},{"type":"v1","addr":"172.21.15.133:6839","nonce":2526402262}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24695,"qdb_cluster":[24652,24691,24656,24695,24667]},"id":1}]} 2024-08-31T04:24:10.098 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 29 2024-08-31T04:24:10.100 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:10.098+0000 7f0027200640 1 -- 172.21.15.50:0/1245810169 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f000c0b4bb0 msgr2=0x7f000c0b70c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:24:10.100 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:10.098+0000 7f0027200640 1 --2- 172.21.15.50:0/1245810169 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f000c0b4bb0 0x7f000c0b70c0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f002810d570 tx=0x7f0018005f90 comp rx=0 tx=0).stop 2024-08-31T04:24:10.100 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:10.098+0000 7f0027200640 1 -- 172.21.15.50:0/1245810169 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0028104eb0 msgr2=0x7f00281a1830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:24:10.100 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:10.098+0000 7f0027200640 1 --2- 172.21.15.50:0/1245810169 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0028104eb0 0x7f00281a1830 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f001402a910 tx=0x7f0014031a20 comp rx=0 tx=0).stop 2024-08-31T04:24:10.100 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:10.099+0000 7f0027200640 1 -- 172.21.15.50:0/1245810169 shutdown_connections 2024-08-31T04:24:10.100 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:10.099+0000 7f0027200640 1 --2- 172.21.15.50:0/1245810169 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f000c0b4bb0 0x7f000c0b70c0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:10.100 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:10.099+0000 7f0027200640 1 --2- 172.21.15.50:0/1245810169 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f002810d9c0 0x7f00281ac370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:10.100 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:10.099+0000 7f0027200640 1 --2- 172.21.15.50:0/1245810169 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0028104eb0 0x7f00281a1830 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:10.101 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:10.099+0000 7f0027200640 1 --2- 172.21.15.50:0/1245810169 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0028104560 0x7f00281a12f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:10.101 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:10.099+0000 7f0027200640 1 -- 172.21.15.50:0/1245810169 >> 172.21.15.50:0/1245810169 conn(0x7f00280fe060 msgr2=0x7f0028102210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:24:10.101 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:10.099+0000 7f0027200640 1 -- 172.21.15.50:0/1245810169 shutdown_connections 2024-08-31T04:24:10.101 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:10.099+0000 7f0027200640 1 -- 172.21.15.50:0/1245810169 wait complete. 2024-08-31T04:24:11.008 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24695 quiesce db --set-id 2196db7d --release --await' 2024-08-31T04:24:11.008 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 058d9fc6-674f-11ef-bcd4-c7b262605968 -- timeout 105 ceph tell mds.24695 quiesce db --set-id 2196db7d --release --await 2024-08-31T04:24:11.200 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:24:11 smithi050 ceph-mon[17259]: pgmap v405: 97 pgs: 97 active+clean; 670 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-08-31T04:24:11.200 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:24:11 smithi050 ceph-mon[17259]: from='client.? 172.21.15.50:0/1245810169' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T04:24:11.293 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:24:11 smithi133 ceph-mon[22177]: pgmap v405: 97 pgs: 97 active+clean; 670 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-08-31T04:24:11.293 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:24:11 smithi133 ceph-mon[22177]: from='client.? 172.21.15.50:0/1245810169' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T04:24:11.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:24:11 smithi177 ceph-mon[22025]: pgmap v405: 97 pgs: 97 active+clean; 670 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-08-31T04:24:11.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:24:11 smithi177 ceph-mon[22025]: from='client.? 172.21.15.50:0/1245810169' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T04:24:11.650 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:24:12.358 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:12.354+0000 7fedeb200640 1 -- 172.21.15.50:0/1261796895 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fedec102180 msgr2=0x7fedec102590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:24:12.358 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:12.354+0000 7fedeb200640 1 --2- 172.21.15.50:0/1261796895 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fedec102180 0x7fedec102590 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fedd8009900 tx=0x7fedd802a490 comp rx=0 tx=0).stop 2024-08-31T04:24:12.358 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:12.355+0000 7fedeb200640 1 -- 172.21.15.50:0/1261796895 shutdown_connections 2024-08-31T04:24:12.358 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:12.355+0000 7fedeb200640 1 --2- 172.21.15.50:0/1261796895 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fedec10fd30 0x7fedec112150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:12.358 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:12.355+0000 7fedeb200640 1 --2- 172.21.15.50:0/1261796895 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fedec102ad0 0x7fedec10f7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:12.358 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:12.355+0000 7fedeb200640 1 --2- 172.21.15.50:0/1261796895 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fedec102180 0x7fedec102590 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:12.358 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:12.355+0000 7fedeb200640 1 -- 172.21.15.50:0/1261796895 >> 172.21.15.50:0/1261796895 conn(0x7fedec0fe060 msgr2=0x7fedec1004b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:24:12.358 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:12.355+0000 7fedeb200640 1 -- 172.21.15.50:0/1261796895 shutdown_connections 2024-08-31T04:24:12.358 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:12.355+0000 7fedeb200640 1 -- 172.21.15.50:0/1261796895 wait complete. 2024-08-31T04:24:12.359 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:12.357+0000 7fedeb200640 1 Processor -- start 2024-08-31T04:24:12.359 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:12.357+0000 7fedeb200640 1 -- start start 2024-08-31T04:24:12.359 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:12.357+0000 7fedeb200640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fedec102180 0x7fedec104630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:12.359 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:12.357+0000 7fedeb200640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fedec102ad0 0x7fedec104bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:12.360 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:12.357+0000 7fedeb200640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fedec10fd30 0x7fedec10f000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:12.360 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:12.357+0000 7fedeb200640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fedec115830 con 0x7fedec102ad0 2024-08-31T04:24:12.360 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:12.358+0000 7fedeb200640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7fedec1156b0 con 0x7fedec102180 2024-08-31T04:24:12.360 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:12.358+0000 7fedeb200640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fedec1159b0 con 0x7fedec10fd30 2024-08-31T04:24:12.360 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:12.358+0000 7fede9e00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fedec102180 0x7fedec104630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:24:12.360 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:12.358+0000 7fede9e00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fedec102180 0x7fedec104630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.50:43096/0 (socket says 172.21.15.50:43096) 2024-08-31T04:24:12.360 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:12.358+0000 7fede9e00640 1 -- 172.21.15.50:0/1841543643 learned_addr learned my addr 172.21.15.50:0/1841543643 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:24:12.360 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:12.358+0000 7fedea800640 1 --2- 172.21.15.50:0/1841543643 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fedec10fd30 0x7fedec10f000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:24:12.361 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:12.359+0000 7fede9e00640 1 -- 172.21.15.50:0/1841543643 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fedec10fd30 msgr2=0x7fedec10f000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:24:12.361 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:12.359+0000 7fede9e00640 1 --2- 172.21.15.50:0/1841543643 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fedec10fd30 0x7fedec10f000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:12.361 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:12.359+0000 7fede9e00640 1 -- 172.21.15.50:0/1841543643 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fedec102ad0 msgr2=0x7fedec104bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:24:12.361 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:12.359+0000 7fede9e00640 1 --2- 172.21.15.50:0/1841543643 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fedec102ad0 0x7fedec104bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:12.361 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:12.359+0000 7fede9e00640 1 -- 172.21.15.50:0/1841543643 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fedec10f730 con 0x7fedec102180 2024-08-31T04:24:12.361 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:12.360+0000 7fede9e00640 1 --2- 172.21.15.50:0/1841543643 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fedec102180 0x7fedec104630 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fedd8005ab0 tx=0x7fedd8003c10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:24:12.362 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:12.361+0000 7fede2a00640 1 -- 172.21.15.50:0/1841543643 <== mon.2 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedd803f070 con 0x7fedec102180 2024-08-31T04:24:12.363 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:12.361+0000 7fede2a00640 1 -- 172.21.15.50:0/1841543643 <== mon.2 v2:172.21.15.133:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fedd8031b60 con 0x7fedec102180 2024-08-31T04:24:12.363 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:12.361+0000 7fede2a00640 1 -- 172.21.15.50:0/1841543643 <== mon.2 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedd8035030 con 0x7fedec102180 2024-08-31T04:24:12.363 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:12.361+0000 7fedeb200640 1 -- 172.21.15.50:0/1841543643 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fedec10f960 con 0x7fedec102180 2024-08-31T04:24:12.363 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:12.361+0000 7fedeb200640 1 -- 172.21.15.50:0/1841543643 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fedec10a040 con 0x7fedec102180 2024-08-31T04:24:12.367 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:12.364+0000 7fedf7e40740 1 Processor -- start 2024-08-31T04:24:12.368 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:12.365+0000 7fedf7e40740 1 -- start start 2024-08-31T04:24:12.368 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:12.365+0000 7fedf7e40740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b3b2c9e520 0x55b3b3044090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:12.368 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:12.365+0000 7fedf7e40740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b3b2c75660 0x55b3b30445d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:12.368 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:12.365+0000 7fedf7e40740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b3b2c7d840 0x55b3b3044b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:12.368 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:12.365+0000 7fedf7e40740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55b3b2fbaa90 con 0x55b3b2c75660 2024-08-31T04:24:12.368 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:12.365+0000 7fedf7e40740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x55b3b2faa020 con 0x55b3b2c9e520 2024-08-31T04:24:12.368 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:12.365+0000 7fedf7e40740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x55b3b2fadfd0 con 0x55b3b2c7d840 2024-08-31T04:24:12.368 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:12.366+0000 7fede9400640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b3b2c7d840 0x55b3b3044b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:24:12.368 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:12.366+0000 7fede9400640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b3b2c7d840 0x55b3b3044b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.50:33810/0 (socket says 172.21.15.50:33810) 2024-08-31T04:24:12.368 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:12.366+0000 7fede9400640 1 -- 172.21.15.50:0/668849532 learned_addr learned my addr 172.21.15.50:0/668849532 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:24:12.369 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:12.367+0000 7fede9400640 1 -- 172.21.15.50:0/668849532 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b3b2c9e520 msgr2=0x55b3b3044090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:24:12.369 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:12.367+0000 7fede9400640 1 --2- 172.21.15.50:0/668849532 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b3b2c9e520 0x55b3b3044090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:12.369 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:12.367+0000 7fede9400640 1 -- 172.21.15.50:0/668849532 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b3b2c75660 msgr2=0x55b3b30445d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-31T04:24:12.369 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:12.367+0000 7fede9400640 1 --2- 172.21.15.50:0/668849532 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b3b2c75660 0x55b3b30445d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:12.369 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:12.367+0000 7fede9400640 1 -- 172.21.15.50:0/668849532 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b3b2d09b00 con 0x55b3b2c7d840 2024-08-31T04:24:12.369 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:12.367+0000 7fede9400640 1 --2- 172.21.15.50:0/668849532 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b3b2c7d840 0x55b3b3044b10 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7feddc009b20 tx=0x7feddc00e350 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2beb51381c95d289 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:24:12.369 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:12.367+0000 7fedd7400640 1 -- 172.21.15.50:0/668849532 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feddc00ed80 con 0x55b3b2c7d840 2024-08-31T04:24:12.369 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:12.368+0000 7fedd7400640 1 -- 172.21.15.50:0/668849532 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7feddc0108e0 con 0x55b3b2c7d840 2024-08-31T04:24:12.369 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:12.368+0000 7fedd7400640 1 -- 172.21.15.50:0/668849532 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feddc018960 con 0x55b3b2c7d840 2024-08-31T04:24:12.370 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:12.368+0000 7fede2a00640 1 -- 172.21.15.50:0/1841543643 <== mon.2 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 18) ==== 152577+0+0 (secure 0 0 0) 0x7fedd8042070 con 0x7fedec102180 2024-08-31T04:24:12.370 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:12.369+0000 7fedf7e40740 1 -- 172.21.15.50:0/668849532 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b3b2c7d840 msgr2=0x55b3b3044b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:24:12.370 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:12.369+0000 7fedf7e40740 1 --2- 172.21.15.50:0/668849532 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b3b2c7d840 0x55b3b3044b10 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7feddc009b20 tx=0x7feddc00e350 comp rx=0 tx=0).stop 2024-08-31T04:24:12.371 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:12.369+0000 7fedf7e40740 1 -- 172.21.15.50:0/668849532 shutdown_connections 2024-08-31T04:24:12.371 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:12.369+0000 7fedf7e40740 1 --2- 172.21.15.50:0/668849532 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b3b2c7d840 0x55b3b3044b10 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:12.371 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:12.369+0000 7fedf7e40740 1 --2- 172.21.15.50:0/668849532 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b3b2c75660 0x55b3b30445d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:12.371 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:12.369+0000 7fedf7e40740 1 --2- 172.21.15.50:0/668849532 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b3b2c9e520 0x55b3b3044090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:12.371 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:12.369+0000 7fedf7e40740 1 -- 172.21.15.50:0/668849532 >> 172.21.15.50:0/668849532 conn(0x55b3b2c92910 msgr2=0x55b3b3041f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:24:12.371 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:12.370+0000 7fedf7e40740 1 -- 172.21.15.50:0/668849532 shutdown_connections 2024-08-31T04:24:12.371 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:12.370+0000 7fedf7e40740 1 -- 172.21.15.50:0/668849532 wait complete. 2024-08-31T04:24:12.372 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:12.371+0000 7fedf7e40740 1 -- start start 2024-08-31T04:24:12.373 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:12.371+0000 7fedf7e40740 1 Processor -- start 2024-08-31T04:24:12.373 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:12.372+0000 7fede2a00640 1 --2- 172.21.15.50:0/1841543643 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fedd00b4b40 0x7fedd00b7050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:12.374 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:12.372+0000 7fede2a00640 1 -- 172.21.15.50:0/1841543643 <== mon.2 v2:172.21.15.133:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8219+0+0 (secure 0 0 0) 0x7fedd8105610 con 0x7fedec102180 2024-08-31T04:24:12.374 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:12.372+0000 7fedf7e40740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b3b2c75660 0x55b3b3051f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:12.374 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:12.372+0000 7fedf7e40740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b3b2c7d840 0x55b3b304f470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:12.374 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:12.372+0000 7fedf7e40740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b3b2c9e520 0x55b3b304fb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:12.374 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:12.372+0000 7fedf7e40740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55b3b2e0cbb0 con 0x55b3b2c75660 2024-08-31T04:24:12.374 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:12.372+0000 7fedf7e40740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x55b3b2f30f90 con 0x55b3b2c7d840 2024-08-31T04:24:12.374 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:12.372+0000 7fedf7e40740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x55b3b3052870 con 0x55b3b2c9e520 2024-08-31T04:24:12.374 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:12.372+0000 7fedf7e40740 10 client.0 _ll_register_callbacks cb 0x55b3b2f56710 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:24:12.375 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:12.373+0000 7fede9400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b3b2c7d840 0x55b3b304f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:24:12.375 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:12.373+0000 7fede9400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b3b2c7d840 0x55b3b304f470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.50:43108/0 (socket says 172.21.15.50:43108) 2024-08-31T04:24:12.375 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:12.373+0000 7fede9400640 1 -- 172.21.15.50:0/3421425181 learned_addr learned my addr 172.21.15.50:0/3421425181 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:24:12.375 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:12.374+0000 7fedea800640 1 --2- 172.21.15.50:0/1841543643 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fedd00b4b40 0x7fedd00b7050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:24:12.375 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:12.374+0000 7fede9400640 1 -- 172.21.15.50:0/3421425181 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b3b2c9e520 msgr2=0x55b3b304fb80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-31T04:24:12.376 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:12.374+0000 7fede9400640 1 --2- 172.21.15.50:0/3421425181 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b3b2c9e520 0x55b3b304fb80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:12.376 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:12.374+0000 7fede9400640 1 -- 172.21.15.50:0/3421425181 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b3b2c75660 msgr2=0x55b3b3051f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:24:12.376 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:12.374+0000 7fede9400640 1 --2- 172.21.15.50:0/3421425181 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b3b2c75660 0x55b3b3051f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:12.376 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:12.374+0000 7fede9400640 1 -- 172.21.15.50:0/3421425181 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b3b2d80960 con 0x55b3b2c7d840 2024-08-31T04:24:12.376 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:12.374+0000 7fede9400640 1 --2- 172.21.15.50:0/3421425181 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b3b2c7d840 0x55b3b304f470 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7feddc009430 tx=0x7feddc0184c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1ff5d26487b8e2a2 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:24:12.376 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:12.374+0000 7fedcbe00640 10 client.0 ms_handle_connect on v2:172.21.15.133:3300/0 2024-08-31T04:24:12.376 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:12.375+0000 7fedcbe00640 1 -- 172.21.15.50:0/3421425181 <== mon.2 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feddc027070 con 0x55b3b2c7d840 2024-08-31T04:24:12.377 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:12.375+0000 7fedf7e40740 1 -- 172.21.15.50:0/3421425181 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55b3b2f48e30 con 0x55b3b2c7d840 2024-08-31T04:24:12.377 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:12.375+0000 7fedea800640 1 --2- 172.21.15.50:0/1841543643 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fedd00b4b40 0x7fedd00b7050 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fede4005fd0 tx=0x7fede4004a40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:24:12.377 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:12.376+0000 7fedcbe00640 1 -- 172.21.15.50:0/3421425181 <== mon.2 v2:172.21.15.133:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8219+0+0 (secure 0 0 0) 0x7feddc005020 con 0x55b3b2c7d840 2024-08-31T04:24:12.378 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:12.377+0000 7fedcbe00640 1 -- 172.21.15.50:0/3421425181 <== mon.2 v2:172.21.15.133:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7feddc005220 con 0x55b3b2c7d840 2024-08-31T04:24:12.378 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:12.377+0000 7fedf7e40740 10 client.25532 fetch_fsmap learned FSMap version 29 2024-08-31T04:24:12.378 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:12.377+0000 7fedf7e40740 1 -- 172.21.15.50:0/3421425181 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55b3b305e270 con 0x55b3b2c7d840 2024-08-31T04:24:12.378 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:12.377+0000 7fedcbe00640 1 -- 172.21.15.50:0/3421425181 <== mon.2 v2:172.21.15.133:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x55b3b2f48e30 con 0x55b3b2c7d840 2024-08-31T04:24:12.379 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:12.377+0000 7fedcbe00640 1 -- 172.21.15.50:0/3421425181 <== mon.2 v2:172.21.15.133:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7feddc018700 con 0x55b3b2c7d840 2024-08-31T04:24:12.379 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:12.377+0000 7fedf7e40740 10 client.25532 fetch_fsmap finished waiting for FSMap version 29 2024-08-31T04:24:12.379 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:12.377+0000 7fedf7e40740 10 client.25532 resolve_mds: validated gid 24695 aka daemon mds.b 2024-08-31T04:24:12.379 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:12.377+0000 7fedf7e40740 20 client.25532 populate_metadata read hostname 'smithi050' 2024-08-31T04:24:12.379 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:12.377+0000 7fedf7e40740 1 --2- 172.21.15.50:0/3421425181 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x55b3b2c5cea0 0x55b3b3061690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:12.380 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:12.378+0000 7fedf7e40740 4 client.25532 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T04:24:12.380 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:12.378+0000 7fedf7e40740 1 -- 172.21.15.50:0/3421425181 --> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b3b2fbc9e0 con 0x55b3b2c5cea0 2024-08-31T04:24:12.380 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:12.378+0000 7fede9e00640 1 --2- 172.21.15.50:0/3421425181 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x55b3b2c5cea0 0x55b3b3061690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:24:12.380 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:12.379+0000 7fede9e00640 1 --2- 172.21.15.50:0/3421425181 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x55b3b2c5cea0 0x55b3b3061690 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8e7a8b19e49ce135 server_cookie=eb3eae0d9332fbd7 in_seq=0 out_seq=0 2024-08-31T04:24:12.380 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:12.379+0000 7fedcbe00640 10 client.25532 ms_handle_connect on v2:172.21.15.133:6838/2526402262 2024-08-31T04:24:12.381 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:12.380+0000 7fedcbe00640 1 -- 172.21.15.50:0/3421425181 <== mds.0 v2:172.21.15.133:6838/2526402262 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55b3b2fbc9e0 con 0x55b3b2c5cea0 2024-08-31T04:24:12.381 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:12.380+0000 7fedcbe00640 10 client.25532 handle_command_reply: tid=0 2024-08-31T04:24:12.381 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:12.380+0000 7fedf7e40740 1 client.25532 shutdown 2024-08-31T04:24:12.381 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:12.380+0000 7fedf7e40740 1 -- 172.21.15.50:0/3421425181 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b3b2c7d840 msgr2=0x55b3b304f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:24:12.381 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:12.380+0000 7fedf7e40740 1 --2- 172.21.15.50:0/3421425181 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b3b2c7d840 0x55b3b304f470 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7feddc009430 tx=0x7feddc0184c0 comp rx=0 tx=0).stop 2024-08-31T04:24:12.382 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:12.380+0000 7fedf7e40740 1 -- 172.21.15.50:0/3421425181 shutdown_connections 2024-08-31T04:24:12.382 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:12.380+0000 7fedf7e40740 1 --2- 172.21.15.50:0/3421425181 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x55b3b2c5cea0 0x55b3b3061690 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:12.382 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:12.380+0000 7fedf7e40740 1 --2- 172.21.15.50:0/3421425181 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b3b2c9e520 0x55b3b304fb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:12.382 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:12.380+0000 7fedf7e40740 1 --2- 172.21.15.50:0/3421425181 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b3b2c7d840 0x55b3b304f470 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:12.382 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:12.380+0000 7fedf7e40740 1 --2- 172.21.15.50:0/3421425181 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b3b2c75660 0x55b3b3051f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:12.382 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:12.380+0000 7fedf7e40740 1 -- 172.21.15.50:0/3421425181 >> 172.21.15.50:0/3421425181 conn(0x55b3b2c92910 msgr2=0x55b3b30450c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:24:12.382 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:12.381+0000 7fedcbe00640 0 client.25532 ms_handle_reset on v2:172.21.15.133:6838/2526402262 2024-08-31T04:24:12.383 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:12.381+0000 7fedf7e40740 1 -- 172.21.15.50:0/3421425181 shutdown_connections 2024-08-31T04:24:12.383 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:12.381+0000 7fedf7e40740 1 -- 172.21.15.50:0/3421425181 wait complete. 2024-08-31T04:24:12.383 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:12.381+0000 7fedf7e40740 20 client.25532 trim_cache size 0 max 16384 2024-08-31T04:24:12.418 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:12.417+0000 7fedf7e40740 1 Processor -- start 2024-08-31T04:24:12.418 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:12.417+0000 7fedf7e40740 1 -- start start 2024-08-31T04:24:12.419 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:12.418+0000 7fedf7e40740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b3b2c75660 0x55b3b305bb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:12.419 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:12.418+0000 7fedf7e40740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b3b2c7d840 0x55b3b3045a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:12.419 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:12.418+0000 7fedf7e40740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b3b2c9e520 0x55b3b304c7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:12.420 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:12.418+0000 7fedf7e40740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fedec1bdd70 con 0x55b3b2c7d840 2024-08-31T04:24:12.420 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:12.418+0000 7fedf7e40740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7fedec1bf8b0 con 0x55b3b2c75660 2024-08-31T04:24:12.420 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:12.418+0000 7fedf7e40740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fedec1be440 con 0x55b3b2c9e520 2024-08-31T04:24:12.421 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:12.418+0000 7fede9e00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b3b2c75660 0x55b3b305bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:24:12.421 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:12.419+0000 7fede9e00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b3b2c75660 0x55b3b305bb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.50:43116/0 (socket says 172.21.15.50:43116) 2024-08-31T04:24:12.421 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:12.419+0000 7fede9e00640 1 -- 172.21.15.50:0/4271106421 learned_addr learned my addr 172.21.15.50:0/4271106421 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:24:12.421 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:12.418+0000 7fedea800640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b3b2c9e520 0x55b3b304c7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:24:12.421 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:12.419+0000 7fede9e00640 1 -- 172.21.15.50:0/4271106421 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b3b2c9e520 msgr2=0x55b3b304c7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:24:12.421 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:12.419+0000 7fede9e00640 1 --2- 172.21.15.50:0/4271106421 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b3b2c9e520 0x55b3b304c7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:12.421 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:12.419+0000 7fede9e00640 1 -- 172.21.15.50:0/4271106421 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b3b2c7d840 msgr2=0x55b3b3045a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:24:12.421 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:12.419+0000 7fede9e00640 1 --2- 172.21.15.50:0/4271106421 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b3b2c7d840 0x55b3b3045a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:12.422 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:12.419+0000 7fede9e00640 1 -- 172.21.15.50:0/4271106421 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b3b3046380 con 0x55b3b2c75660 2024-08-31T04:24:12.422 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:12.421+0000 7fede9e00640 1 --2- 172.21.15.50:0/4271106421 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b3b2c75660 0x55b3b305bb70 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fedd80c9260 tx=0x7fedd802a490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a796d894a2715185 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:24:12.422 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:12.421+0000 7fedd6a00640 1 -- 172.21.15.50:0/4271106421 <== mon.2 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedd8049040 con 0x55b3b2c75660 2024-08-31T04:24:12.424 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:12.421+0000 7fedd6a00640 1 -- 172.21.15.50:0/4271106421 <== mon.2 v2:172.21.15.133:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fedd80cbff0 con 0x55b3b2c75660 2024-08-31T04:24:12.424 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:12.421+0000 7fedd6a00640 1 -- 172.21.15.50:0/4271106421 <== mon.2 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedd80c8280 con 0x55b3b2c75660 2024-08-31T04:24:12.424 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:12.423+0000 7fedf7e40740 1 -- 172.21.15.50:0/4271106421 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b3b2c75660 msgr2=0x55b3b305bb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:24:12.424 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:12.423+0000 7fedf7e40740 1 --2- 172.21.15.50:0/4271106421 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b3b2c75660 0x55b3b305bb70 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fedd80c9260 tx=0x7fedd802a490 comp rx=0 tx=0).stop 2024-08-31T04:24:12.425 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:12.423+0000 7fedf7e40740 1 -- 172.21.15.50:0/4271106421 shutdown_connections 2024-08-31T04:24:12.425 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:12.423+0000 7fedf7e40740 1 --2- 172.21.15.50:0/4271106421 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b3b2c9e520 0x55b3b304c7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:12.425 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:12.423+0000 7fedf7e40740 1 --2- 172.21.15.50:0/4271106421 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b3b2c7d840 0x55b3b3045a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:12.425 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:12.423+0000 7fedf7e40740 1 --2- 172.21.15.50:0/4271106421 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b3b2c75660 0x55b3b305bb70 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:12.425 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:12.423+0000 7fedf7e40740 1 -- 172.21.15.50:0/4271106421 >> 172.21.15.50:0/4271106421 conn(0x55b3b2c92910 msgr2=0x55b3b3041f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:24:12.426 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:12.424+0000 7fedf7e40740 1 -- 172.21.15.50:0/4271106421 shutdown_connections 2024-08-31T04:24:12.426 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:12.424+0000 7fedf7e40740 1 -- 172.21.15.50:0/4271106421 wait complete. 2024-08-31T04:24:12.426 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:12.425+0000 7fedf7e40740 1 -- start start 2024-08-31T04:24:12.427 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:12.425+0000 7fedf7e40740 1 Processor -- start 2024-08-31T04:24:12.427 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:12.426+0000 7fedf7e40740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b3b2c75660 0x55b3b30636c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:12.429 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:12.426+0000 7fedf7e40740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b3b2c7d840 0x55b3b3063c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:12.429 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:12.426+0000 7fedf7e40740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b3b2c9e520 0x55b3b3064140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:12.429 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:12.426+0000 7fedf7e40740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fedec1bf1e0 con 0x55b3b2c9e520 2024-08-31T04:24:12.429 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:12.426+0000 7fedf7e40740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7fedec1beb10 con 0x55b3b2c75660 2024-08-31T04:24:12.429 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:12.426+0000 7fedf7e40740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fedec1bbd50 con 0x55b3b2c7d840 2024-08-31T04:24:12.429 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:12.426+0000 7fedf7e40740 10 client.0 _ll_register_callbacks cb 0x7feddc00ee90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:24:12.429 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:12.427+0000 7fede9e00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b3b2c75660 0x55b3b30636c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:24:12.429 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:12.427+0000 7fede9e00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b3b2c75660 0x55b3b30636c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.50:43122/0 (socket says 172.21.15.50:43122) 2024-08-31T04:24:12.429 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:12.427+0000 7fede9e00640 1 -- 172.21.15.50:0/123097398 learned_addr learned my addr 172.21.15.50:0/123097398 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:24:12.430 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:12.428+0000 7fede9e00640 1 -- 172.21.15.50:0/123097398 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b3b2c7d840 msgr2=0x55b3b3063c00 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-08-31T04:24:12.430 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:12.428+0000 7fede9e00640 1 --2- 172.21.15.50:0/123097398 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b3b2c7d840 0x55b3b3063c00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:12.430 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:12.428+0000 7fede9e00640 1 -- 172.21.15.50:0/123097398 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b3b2c9e520 msgr2=0x55b3b3064140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:24:12.430 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:12.428+0000 7fede9e00640 1 --2- 172.21.15.50:0/123097398 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b3b2c9e520 0x55b3b3064140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:12.431 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:12.428+0000 7fede9e00640 1 -- 172.21.15.50:0/123097398 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b3b30cbe20 con 0x55b3b2c75660 2024-08-31T04:24:12.431 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:12.429+0000 7fede9e00640 1 --2- 172.21.15.50:0/123097398 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b3b2c75660 0x55b3b30636c0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fedd802aa50 tx=0x7fedd8103060 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c277fe449dcfe544 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:24:12.431 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:12.429+0000 7fedcbe00640 10 client.0 ms_handle_connect on v2:172.21.15.133:3300/0 2024-08-31T04:24:12.431 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:12.430+0000 7fedcbe00640 1 -- 172.21.15.50:0/123097398 <== mon.2 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedd80b7070 con 0x55b3b2c75660 2024-08-31T04:24:12.431 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:12.430+0000 7fedcbe00640 1 -- 172.21.15.50:0/123097398 <== mon.2 v2:172.21.15.133:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8219+0+0 (secure 0 0 0) 0x7fedd80c85e0 con 0x55b3b2c75660 2024-08-31T04:24:12.431 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:12.430+0000 7fedf7e40740 1 -- 172.21.15.50:0/123097398 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fedd80cbff0 con 0x55b3b2c75660 2024-08-31T04:24:12.432 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:12.431+0000 7fedcbe00640 1 -- 172.21.15.50:0/123097398 <== mon.2 v2:172.21.15.133:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fedd8049070 con 0x55b3b2c75660 2024-08-31T04:24:12.432 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:12.431+0000 7fedf7e40740 10 client.25538 fetch_fsmap learned FSMap version 29 2024-08-31T04:24:12.432 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:12.431+0000 7fedf7e40740 1 -- 172.21.15.50:0/123097398 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55b3b30cd0e0 con 0x55b3b2c75660 2024-08-31T04:24:12.433 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:12.431+0000 7fedcbe00640 1 -- 172.21.15.50:0/123097398 <== mon.2 v2:172.21.15.133:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fedd80cbff0 con 0x55b3b2c75660 2024-08-31T04:24:12.433 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:12.431+0000 7fedcbe00640 1 -- 172.21.15.50:0/123097398 <== mon.2 v2:172.21.15.133:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7fedd8079020 con 0x55b3b2c75660 2024-08-31T04:24:12.433 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:12.432+0000 7fedf7e40740 10 client.25538 fetch_fsmap finished waiting for FSMap version 29 2024-08-31T04:24:12.434 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:12.432+0000 7fedf7e40740 10 client.25538 resolve_mds: validated gid 24695 aka daemon mds.b 2024-08-31T04:24:12.434 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:12.432+0000 7fedf7e40740 20 client.25538 populate_metadata read hostname 'smithi050' 2024-08-31T04:24:12.434 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:12.432+0000 7fedf7e40740 1 --2- 172.21.15.50:0/123097398 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x55b3b2c32250 0x55b3b30cf600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:12.434 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:12.433+0000 7fedf7e40740 4 client.25538 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "2196db7d", "release": true, "await": true}] 2024-08-31T04:24:12.435 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:12.433+0000 7fedf7e40740 1 -- 172.21.15.50:0/123097398 --> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] -- command(tid 0: {"prefix": "quiesce db", "set_id": "2196db7d", "release": true, "await": true}) -- 0x55b3b2fb8480 con 0x55b3b2c32250 2024-08-31T04:24:12.435 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:12.434+0000 7fede9400640 1 --2- 172.21.15.50:0/123097398 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x55b3b2c32250 0x55b3b30cf600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:24:12.436 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:12.435+0000 7fede9400640 1 --2- 172.21.15.50:0/123097398 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x55b3b2c32250 0x55b3b30cf600 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f7044706979ab82 server_cookie=5f3ba65f0d625e64 in_seq=0 out_seq=0 2024-08-31T04:24:12.436 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:12.435+0000 7fedcbe00640 10 client.25538 ms_handle_connect on v2:172.21.15.133:6838/2526402262 2024-08-31T04:24:12.438 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:12.437+0000 7fedcbe00640 1 -- 172.21.15.50:0/123097398 <== mds.0 v2:172.21.15.133:6838/2526402262 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x55b3b2fb8480 con 0x55b3b2c32250 2024-08-31T04:24:12.438 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:12.437+0000 7fedcbe00640 10 client.25538 handle_command_reply: tid=0 2024-08-31T04:24:12.438 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:12.437+0000 7fedf7e40740 1 client.25538 shutdown 2024-08-31T04:24:12.439 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:12.438+0000 7fedf7e40740 1 -- 172.21.15.50:0/123097398 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b3b2c75660 msgr2=0x55b3b30636c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:24:12.439 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:12.438+0000 7fedf7e40740 1 --2- 172.21.15.50:0/123097398 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b3b2c75660 0x55b3b30636c0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fedd802aa50 tx=0x7fedd8103060 comp rx=0 tx=0).stop 2024-08-31T04:24:12.440 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:12.438+0000 7fedf7e40740 1 -- 172.21.15.50:0/123097398 shutdown_connections 2024-08-31T04:24:12.440 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:12.438+0000 7fedf7e40740 1 --2- 172.21.15.50:0/123097398 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x55b3b2c32250 0x55b3b30cf600 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:12.440 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:12.438+0000 7fedf7e40740 1 --2- 172.21.15.50:0/123097398 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b3b2c7d840 0x55b3b3063c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:12.440 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:12.438+0000 7fedf7e40740 1 --2- 172.21.15.50:0/123097398 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b3b2c9e520 0x55b3b3064140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:12.440 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:12.438+0000 7fedf7e40740 1 --2- 172.21.15.50:0/123097398 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b3b2c75660 0x55b3b30636c0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:12.440 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:12.438+0000 7fedf7e40740 1 -- 172.21.15.50:0/123097398 >> 172.21.15.50:0/123097398 conn(0x55b3b2c92910 msgr2=0x55b3b3041f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:24:12.441 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:12.438+0000 7fedcbe00640 0 client.25538 ms_handle_reset on v2:172.21.15.133:6838/2526402262 2024-08-31T04:24:12.441 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:12.439+0000 7fedf7e40740 1 -- 172.21.15.50:0/123097398 shutdown_connections 2024-08-31T04:24:12.441 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:12.439+0000 7fedf7e40740 1 -- 172.21.15.50:0/123097398 wait complete. 2024-08-31T04:24:12.441 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:12.439+0000 7fedf7e40740 20 client.25538 trim_cache size 0 max 16384 2024-08-31T04:24:12.442 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-08-31T04:24:12.442 INFO:teuthology.orchestra.run.smithi050.stdout: "epoch": 29, 2024-08-31T04:24:12.442 INFO:teuthology.orchestra.run.smithi050.stdout: "leader": 24695, 2024-08-31T04:24:12.442 INFO:teuthology.orchestra.run.smithi050.stdout: "set_version": 4, 2024-08-31T04:24:12.442 INFO:teuthology.orchestra.run.smithi050.stdout: "sets": { 2024-08-31T04:24:12.442 INFO:teuthology.orchestra.run.smithi050.stdout: "2196db7d": { 2024-08-31T04:24:12.442 INFO:teuthology.orchestra.run.smithi050.stdout: "version": 4, 2024-08-31T04:24:12.442 INFO:teuthology.orchestra.run.smithi050.stdout: "age_ref": 0.0, 2024-08-31T04:24:12.442 INFO:teuthology.orchestra.run.smithi050.stdout: "state": { 2024-08-31T04:24:12.442 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "RELEASED", 2024-08-31T04:24:12.443 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 0.0 2024-08-31T04:24:12.443 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:24:12.443 INFO:teuthology.orchestra.run.smithi050.stdout: "timeout": 90.0, 2024-08-31T04:24:12.443 INFO:teuthology.orchestra.run.smithi050.stdout: "expiration": 146.4, 2024-08-31T04:24:12.443 INFO:teuthology.orchestra.run.smithi050.stdout: "members": { 2024-08-31T04:24:12.443 INFO:teuthology.orchestra.run.smithi050.stdout: "file:/": { 2024-08-31T04:24:12.443 INFO:teuthology.orchestra.run.smithi050.stdout: "excluded": false, 2024-08-31T04:24:12.443 INFO:teuthology.orchestra.run.smithi050.stdout: "state": { 2024-08-31T04:24:12.443 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "RELEASED", 2024-08-31T04:24:12.443 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 0.0 2024-08-31T04:24:12.443 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T04:24:12.443 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T04:24:12.443 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T04:24:12.443 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T04:24:12.444 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T04:24:12.444 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-08-31T04:24:12.444 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:12.442+0000 7fedeb200640 1 -- 172.21.15.50:0/1841543643 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fedd00b4b40 msgr2=0x7fedd00b7050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:24:12.444 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:12.442+0000 7fedeb200640 1 --2- 172.21.15.50:0/1841543643 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fedd00b4b40 0x7fedd00b7050 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fede4005fd0 tx=0x7fede4004a40 comp rx=0 tx=0).stop 2024-08-31T04:24:12.444 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:12.442+0000 7fedeb200640 1 -- 172.21.15.50:0/1841543643 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fedec102180 msgr2=0x7fedec104630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:24:12.444 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:12.442+0000 7fedeb200640 1 --2- 172.21.15.50:0/1841543643 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fedec102180 0x7fedec104630 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fedd8005ab0 tx=0x7fedd8003c10 comp rx=0 tx=0).stop 2024-08-31T04:24:12.444 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:12.442+0000 7fedeb200640 1 -- 172.21.15.50:0/1841543643 shutdown_connections 2024-08-31T04:24:12.445 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:12.442+0000 7fedeb200640 1 --2- 172.21.15.50:0/1841543643 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fedd00b4b40 0x7fedd00b7050 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:12.445 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:12.442+0000 7fedeb200640 1 --2- 172.21.15.50:0/1841543643 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fedec10fd30 0x7fedec10f000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:12.445 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:12.442+0000 7fedeb200640 1 --2- 172.21.15.50:0/1841543643 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fedec102ad0 0x7fedec104bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:12.445 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:12.442+0000 7fedeb200640 1 --2- 172.21.15.50:0/1841543643 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fedec102180 0x7fedec104630 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:12.445 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:12.442+0000 7fedeb200640 1 -- 172.21.15.50:0/1841543643 >> 172.21.15.50:0/1841543643 conn(0x7fedec0fe060 msgr2=0x7fedec100e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:24:12.446 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:12.443+0000 7fedeb200640 1 -- 172.21.15.50:0/1841543643 shutdown_connections 2024-08-31T04:24:12.446 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:12.443+0000 7fedeb200640 1 -- 172.21.15.50:0/1841543643 wait complete. 2024-08-31T04:24:13.200 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:24:13 smithi050 ceph-mon[17259]: pgmap v406: 97 pgs: 97 active+clean; 671 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 255 B/s wr, 12 op/s 2024-08-31T04:24:13.275 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '2196db7d', total seconds elapsed: 31.1 2024-08-31T04:24:13.275 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 26.4 2024-08-31T04:24:13.275 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 058d9fc6-674f-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-31T04:24:13.292 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:24:13 smithi133 ceph-mon[22177]: pgmap v406: 97 pgs: 97 active+clean; 671 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 255 B/s wr, 12 op/s 2024-08-31T04:24:13.298 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:24:13 smithi177 ceph-mon[22025]: pgmap v406: 97 pgs: 97 active+clean; 671 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 255 B/s wr, 12 op/s 2024-08-31T04:24:13.844 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:24:14.607 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:14.604+0000 7f9bbfe00640 1 -- 172.21.15.50:0/2353827712 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9bc0075e20 msgr2=0x7f9bc010f7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:24:14.607 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:14.604+0000 7f9bbfe00640 1 --2- 172.21.15.50:0/2353827712 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9bc0075e20 0x7f9bc010f7f0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f9bac009900 tx=0x7f9bac02a3f0 comp rx=0 tx=0).stop 2024-08-31T04:24:14.607 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:14.604+0000 7f9bbfe00640 1 -- 172.21.15.50:0/2353827712 shutdown_connections 2024-08-31T04:24:14.607 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:14.604+0000 7f9bbfe00640 1 --2- 172.21.15.50:0/2353827712 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9bc010fd30 0x7f9bc0112150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:14.607 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:14.604+0000 7f9bbfe00640 1 --2- 172.21.15.50:0/2353827712 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9bc0075e20 0x7f9bc010f7f0 secure :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f9bac009900 tx=0x7f9bac02a3f0 comp rx=0 tx=0).stop 2024-08-31T04:24:14.607 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:14.604+0000 7f9bbfe00640 1 --2- 172.21.15.50:0/2353827712 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9bc00754d0 0x7f9bc00758e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:14.607 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:14.604+0000 7f9bbfe00640 1 -- 172.21.15.50:0/2353827712 >> 172.21.15.50:0/2353827712 conn(0x7f9bc00ff1a0 msgr2=0x7f9bc01015f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:24:14.607 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:14.605+0000 7f9bbfe00640 1 -- 172.21.15.50:0/2353827712 shutdown_connections 2024-08-31T04:24:14.607 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:14.605+0000 7f9bbfe00640 1 -- 172.21.15.50:0/2353827712 wait complete. 2024-08-31T04:24:14.608 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:14.606+0000 7f9bbfe00640 1 Processor -- start 2024-08-31T04:24:14.608 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:14.607+0000 7f9bbfe00640 1 -- start start 2024-08-31T04:24:14.608 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:14.607+0000 7f9bbfe00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9bc00754d0 0x7f9bc010cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:14.608 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:14.607+0000 7f9bbfe00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9bc010fd30 0x7f9bc010d240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:14.609 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:14.607+0000 7f9bbfe00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9bc010d780 0x7f9bc01a1da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:14.609 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:14.607+0000 7f9bbfe00640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f9bc0115880 con 0x7f9bc010fd30 2024-08-31T04:24:14.609 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:14.607+0000 7f9bbfe00640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f9bc0115700 con 0x7f9bc00754d0 2024-08-31T04:24:14.609 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:14.607+0000 7f9bbfe00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f9bc0115a00 con 0x7f9bc010d780 2024-08-31T04:24:14.609 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:14.608+0000 7f9bbea00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9bc00754d0 0x7f9bc010cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:24:14.609 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:14.608+0000 7f9bbea00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9bc00754d0 0x7f9bc010cd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.50:58864/0 (socket says 172.21.15.50:58864) 2024-08-31T04:24:14.609 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:14.608+0000 7f9bbea00640 1 -- 172.21.15.50:0/919382052 learned_addr learned my addr 172.21.15.50:0/919382052 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:24:14.610 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:14.608+0000 7f9bbf400640 1 --2- 172.21.15.50:0/919382052 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9bc010d780 0x7f9bc01a1da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:24:14.610 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:14.608+0000 7f9bbe000640 1 --2- 172.21.15.50:0/919382052 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9bc010fd30 0x7f9bc010d240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:24:14.610 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:14.608+0000 7f9bbea00640 1 -- 172.21.15.50:0/919382052 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9bc010d780 msgr2=0x7f9bc01a1da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:24:14.610 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:14.608+0000 7f9bbea00640 1 --2- 172.21.15.50:0/919382052 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9bc010d780 0x7f9bc01a1da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:14.611 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:14.608+0000 7f9bbea00640 1 -- 172.21.15.50:0/919382052 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9bc010fd30 msgr2=0x7f9bc010d240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:24:14.611 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:14.608+0000 7f9bbea00640 1 --2- 172.21.15.50:0/919382052 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9bc010fd30 0x7f9bc010d240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:14.611 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:14.608+0000 7f9bbea00640 1 -- 172.21.15.50:0/919382052 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9bc01a24d0 con 0x7f9bc00754d0 2024-08-31T04:24:14.611 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:14.608+0000 7f9bbea00640 1 --2- 172.21.15.50:0/919382052 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9bc00754d0 0x7f9bc010cd00 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f9bb000ea60 tx=0x7f9bb000ef20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:24:14.611 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:14.609+0000 7f9bb7400640 1 -- 172.21.15.50:0/919382052 <== mon.2 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bb000cde0 con 0x7f9bc00754d0 2024-08-31T04:24:14.611 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:14.609+0000 7f9bb7400640 1 -- 172.21.15.50:0/919382052 <== mon.2 v2:172.21.15.133:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9bb00035f0 con 0x7f9bc00754d0 2024-08-31T04:24:14.611 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:14.609+0000 7f9bbfe00640 1 -- 172.21.15.50:0/919382052 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9bc01a27c0 con 0x7f9bc00754d0 2024-08-31T04:24:14.611 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:14.609+0000 7f9bb7400640 1 -- 172.21.15.50:0/919382052 <== mon.2 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bb0010690 con 0x7f9bc00754d0 2024-08-31T04:24:14.611 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:14.609+0000 7f9bbfe00640 1 -- 172.21.15.50:0/919382052 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9bc01a2d20 con 0x7f9bc00754d0 2024-08-31T04:24:14.612 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:14.611+0000 7f9bbfe00640 1 -- 172.21.15.50:0/919382052 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9bc00758e0 con 0x7f9bc00754d0 2024-08-31T04:24:14.616 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:14.615+0000 7f9bb7400640 1 -- 172.21.15.50:0/919382052 <== mon.2 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 18) ==== 152577+0+0 (secure 0 0 0) 0x7f9bb00037a0 con 0x7f9bc00754d0 2024-08-31T04:24:14.619 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:14.618+0000 7f9bb7400640 1 --2- 172.21.15.50:0/919382052 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f9ba40b4bb0 0x7f9ba40b70c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:14.619 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:14.618+0000 7f9bb7400640 1 -- 172.21.15.50:0/919382052 <== mon.2 v2:172.21.15.133:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8219+0+0 (secure 0 0 0) 0x7f9bb00e5440 con 0x7f9bc00754d0 2024-08-31T04:24:14.619 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:14.618+0000 7f9bbe000640 1 --2- 172.21.15.50:0/919382052 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f9ba40b4bb0 0x7f9ba40b70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:24:14.621 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:14.619+0000 7f9bbe000640 1 --2- 172.21.15.50:0/919382052 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f9ba40b4bb0 0x7f9ba40b70c0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f9bac008000 tx=0x7f9bac000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:24:14.622 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:14.621+0000 7f9bb7400640 1 -- 172.21.15.50:0/919382052 <== mon.2 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f9bb00ac520 con 0x7f9bc00754d0 2024-08-31T04:24:14.904 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:14.903+0000 7f9bbfe00640 1 -- 172.21.15.50:0/919382052 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9bc01a31c0 con 0x7f9bc00754d0 2024-08-31T04:24:14.905 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:14.904+0000 7f9bb7400640 1 -- 172.21.15.50:0/919382052 <== mon.2 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+11983 (secure 0 0 0) 0x7f9bb00abe20 con 0x7f9bc00754d0 2024-08-31T04:24:14.906 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-08-31T04:24:14.906 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":29,"btime":"2024-08-31T04:23:00:578141+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14622,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/1565557530","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":1565557530},{"type":"v1","addr":"172.21.15.50:6835","nonce":1565557530}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14634,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6837/2660185946","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6836","nonce":2660185946},{"type":"v1","addr":"172.21.15.50:6837","nonce":2660185946}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":29,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-31T04:20:44.140709+0000","modified":"2024-08-31T04:22:59.912983+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24695,"mds_1":24691,"mds_2":24667,"mds_3":24656,"mds_4":24652},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14676":{"gid":14676,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.50:6839/2105228685","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6838","nonce":2105228685},{"type":"v1","addr":"172.21.15.50:6839","nonce":2105228685}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24590":{"gid":24590,"name":"k","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.133:6833/4283603962","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6832","nonce":4283603962},{"type":"v1","addr":"172.21.15.133:6833","nonce":4283603962}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24601":{"gid":24601,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.177:6833/1237129793","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":1237129793},{"type":"v1","addr":"172.21.15.177:6833","nonce":1237129793}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24626":{"gid":24626,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.133:6835/3637799701","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":3637799701},{"type":"v1","addr":"172.21.15.133:6835","nonce":3637799701}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24640":{"gid":24640,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.177:6835/599392457","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6834","nonce":599392457},{"type":"v1","addr":"172.21.15.177:6835","nonce":599392457}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24652":{"gid":24652,"name":"c","rank":4,"incarnation":26,"state":"up:active","state_seq":13,"addr":"172.21.15.177:6837/2159859285","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6836","nonce":2159859285},{"type":"v1","addr":"172.21.15.177:6837","nonce":2159859285}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24656":{"gid":24656,"name":"h","rank":3,"incarnation":22,"state":"up:active","state_seq":12,"addr":"172.21.15.133:6837/4014853202","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6836","nonce":4014853202},{"type":"v1","addr":"172.21.15.133:6837","nonce":4014853202}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24667":{"gid":24667,"name":"i","rank":2,"incarnation":20,"state":"up:active","state_seq":10,"addr":"172.21.15.177:6839/3600081752","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6838","nonce":3600081752},{"type":"v1","addr":"172.21.15.177:6839","nonce":3600081752}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24691":{"gid":24691,"name":"a","rank":1,"incarnation":18,"state":"up:active","state_seq":8,"addr":"172.21.15.50:6841/575209862","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6840","nonce":575209862},{"type":"v1","addr":"172.21.15.50:6841","nonce":575209862}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24695":{"gid":24695,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.133:6839/2526402262","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6838","nonce":2526402262},{"type":"v1","addr":"172.21.15.133:6839","nonce":2526402262}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24695,"qdb_cluster":[24652,24691,24656,24695,24667]},"id":1}]} 2024-08-31T04:24:14.906 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 29 2024-08-31T04:24:14.909 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:14.908+0000 7f9bbfe00640 1 -- 172.21.15.50:0/919382052 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f9ba40b4bb0 msgr2=0x7f9ba40b70c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:24:14.909 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:14.908+0000 7f9bbfe00640 1 --2- 172.21.15.50:0/919382052 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f9ba40b4bb0 0x7f9ba40b70c0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f9bac008000 tx=0x7f9bac000bc0 comp rx=0 tx=0).stop 2024-08-31T04:24:14.909 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:14.908+0000 7f9bbfe00640 1 -- 172.21.15.50:0/919382052 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9bc00754d0 msgr2=0x7f9bc010cd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:24:14.909 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:14.908+0000 7f9bbfe00640 1 --2- 172.21.15.50:0/919382052 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9bc00754d0 0x7f9bc010cd00 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f9bb000ea60 tx=0x7f9bb000ef20 comp rx=0 tx=0).stop 2024-08-31T04:24:14.909 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:14.908+0000 7f9bbfe00640 1 -- 172.21.15.50:0/919382052 shutdown_connections 2024-08-31T04:24:14.910 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:14.908+0000 7f9bbfe00640 1 --2- 172.21.15.50:0/919382052 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f9ba40b4bb0 0x7f9ba40b70c0 secure :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f9bac008000 tx=0x7f9bac000bc0 comp rx=0 tx=0).stop 2024-08-31T04:24:14.910 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:14.908+0000 7f9bbfe00640 1 --2- 172.21.15.50:0/919382052 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9bc010d780 0x7f9bc01a1da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:14.910 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:14.908+0000 7f9bbfe00640 1 --2- 172.21.15.50:0/919382052 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9bc010fd30 0x7f9bc010d240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:14.910 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:14.908+0000 7f9bbfe00640 1 --2- 172.21.15.50:0/919382052 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9bc00754d0 0x7f9bc010cd00 secure :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f9bb000ea60 tx=0x7f9bb000ef20 comp rx=0 tx=0).stop 2024-08-31T04:24:14.910 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:14.908+0000 7f9bbfe00640 1 -- 172.21.15.50:0/919382052 >> 172.21.15.50:0/919382052 conn(0x7f9bc00ff1a0 msgr2=0x7f9bc0109930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:24:14.910 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:14.909+0000 7f9bbfe00640 1 -- 172.21.15.50:0/919382052 shutdown_connections 2024-08-31T04:24:14.910 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:14.909+0000 7f9bbfe00640 1 -- 172.21.15.50:0/919382052 wait complete. 2024-08-31T04:24:15.200 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:24:15 smithi050 ceph-mon[17259]: pgmap v407: 97 pgs: 97 active+clean; 671 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2024-08-31T04:24:15.200 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:24:15 smithi050 ceph-mon[17259]: from='client.? 172.21.15.50:0/919382052' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T04:24:15.293 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:24:15 smithi133 ceph-mon[22177]: pgmap v407: 97 pgs: 97 active+clean; 671 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2024-08-31T04:24:15.293 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:24:15 smithi133 ceph-mon[22177]: from='client.? 172.21.15.50:0/919382052' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T04:24:15.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:24:15 smithi177 ceph-mon[22025]: pgmap v407: 97 pgs: 97 active+clean; 671 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2024-08-31T04:24:15.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:24:15 smithi177 ceph-mon[22025]: from='client.? 172.21.15.50:0/919382052' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T04:24:15.710 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24695 quiesce db / --timeout 90 --expiration 146.4 --await-for 45.0' 2024-08-31T04:24:15.710 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 058d9fc6-674f-11ef-bcd4-c7b262605968 -- timeout 105 ceph tell mds.24695 quiesce db / --timeout 90 --expiration 146.4 --await-for 45.0 2024-08-31T04:24:16.278 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:24:17.027 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:24:17 smithi050 ceph-mon[17259]: pgmap v408: 97 pgs: 97 active+clean; 671 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 255 B/s wr, 10 op/s 2024-08-31T04:24:17.028 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:17.022+0000 7f5859400640 1 -- 172.21.15.50:0/704003463 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f58541090d0 msgr2=0x7f58541094e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:24:17.028 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:17.022+0000 7f5859400640 1 --2- 172.21.15.50:0/704003463 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f58541090d0 0x7f58541094e0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f5840009900 tx=0x7f584002a3f0 comp rx=0 tx=0).stop 2024-08-31T04:24:17.028 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:17.022+0000 7f5859400640 1 -- 172.21.15.50:0/704003463 shutdown_connections 2024-08-31T04:24:17.028 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:17.022+0000 7f5859400640 1 --2- 172.21.15.50:0/704003463 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f58541090d0 0x7f58541094e0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:17.028 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:17.022+0000 7f5859400640 1 --2- 172.21.15.50:0/704003463 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5854109a20 0x7f5854110250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:17.028 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:17.022+0000 7f5859400640 1 --2- 172.21.15.50:0/704003463 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5854103790 0x7f5854103ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:17.029 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:17.022+0000 7f5859400640 1 -- 172.21.15.50:0/704003463 >> 172.21.15.50:0/704003463 conn(0x7f58540ff220 msgr2=0x7f5854101670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:24:17.029 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:17.023+0000 7f5859400640 1 -- 172.21.15.50:0/704003463 shutdown_connections 2024-08-31T04:24:17.029 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:17.023+0000 7f5859400640 1 -- 172.21.15.50:0/704003463 wait complete. 2024-08-31T04:24:17.029 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:17.024+0000 7f5859400640 1 Processor -- start 2024-08-31T04:24:17.029 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:17.025+0000 7f5859400640 1 -- start start 2024-08-31T04:24:17.029 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:17.025+0000 7f5859400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5854103790 0x7f5854198b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:17.029 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:17.025+0000 7f5859400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f58541090d0 0x7f58541990c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:17.029 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:17.025+0000 7f5859400640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5854109a20 0x7f585419fbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:17.029 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:17.026+0000 7f5853e00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5854103790 0x7f5854198b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:24:17.029 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:17.026+0000 7f5853e00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5854103790 0x7f5854198b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.50:58884/0 (socket says 172.21.15.50:58884) 2024-08-31T04:24:17.029 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:17.026+0000 7f5858a00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5854109a20 0x7f585419fbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:24:17.029 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:17.026+0000 7f5858a00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5854109a20 0x7f585419fbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.50:33258/0 (socket says 172.21.15.50:33258) 2024-08-31T04:24:17.029 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:17.026+0000 7f5853e00640 1 -- 172.21.15.50:0/819779617 learned_addr learned my addr 172.21.15.50:0/819779617 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:24:17.029 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:17.026+0000 7f5859400640 1 -- 172.21.15.50:0/819779617 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f58541136b0 con 0x7f58541090d0 2024-08-31T04:24:17.030 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:17.026+0000 7f5859400640 1 -- 172.21.15.50:0/819779617 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f5854113530 con 0x7f5854103790 2024-08-31T04:24:17.030 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:17.026+0000 7f5859400640 1 -- 172.21.15.50:0/819779617 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f5854113830 con 0x7f5854109a20 2024-08-31T04:24:17.030 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:17.026+0000 7f5853400640 1 --2- 172.21.15.50:0/819779617 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f58541090d0 0x7f58541990c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:24:17.030 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:17.027+0000 7f5858a00640 1 -- 172.21.15.50:0/819779617 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5854103790 msgr2=0x7f5854198b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:24:17.030 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:17.027+0000 7f5858a00640 1 --2- 172.21.15.50:0/819779617 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5854103790 0x7f5854198b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:17.030 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:17.027+0000 7f5858a00640 1 -- 172.21.15.50:0/819779617 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f58541090d0 msgr2=0x7f58541990c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:24:17.031 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:17.027+0000 7f5858a00640 1 --2- 172.21.15.50:0/819779617 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f58541090d0 0x7f58541990c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:17.031 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:17.027+0000 7f5858a00640 1 -- 172.21.15.50:0/819779617 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58541a0120 con 0x7f5854109a20 2024-08-31T04:24:17.031 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:17.028+0000 7f5858a00640 1 --2- 172.21.15.50:0/819779617 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5854109a20 0x7f585419fbe0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f584c009fd0 tx=0x7f584c00ef10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:24:17.031 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:17.029+0000 7f5850c00640 1 -- 172.21.15.50:0/819779617 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f584c00ce20 con 0x7f5854109a20 2024-08-31T04:24:17.031 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:17.029+0000 7f5850c00640 1 -- 172.21.15.50:0/819779617 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f584c005020 con 0x7f5854109a20 2024-08-31T04:24:17.031 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:17.029+0000 7f5850c00640 1 -- 172.21.15.50:0/819779617 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f584c010690 con 0x7f5854109a20 2024-08-31T04:24:17.031 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:17.030+0000 7f5859400640 1 -- 172.21.15.50:0/819779617 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f58541a03b0 con 0x7f5854109a20 2024-08-31T04:24:17.032 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:17.030+0000 7f5859400640 1 -- 172.21.15.50:0/819779617 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f58541a0870 con 0x7f5854109a20 2024-08-31T04:24:17.035 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:17.034+0000 7f5861696740 1 Processor -- start 2024-08-31T04:24:17.037 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:17.036+0000 7f5850c00640 1 -- 172.21.15.50:0/819779617 <== mon.1 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 18) ==== 152577+0+0 (secure 0 0 0) 0x7f584c0054d0 con 0x7f5854109a20 2024-08-31T04:24:17.037 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:17.036+0000 7f5861696740 1 -- start start 2024-08-31T04:24:17.038 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:17.036+0000 7f5861696740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55717c6b0840 0x55717ca572d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:17.040 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:17.037+0000 7f5861696740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55717c687980 0x55717ca57810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:17.040 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:17.037+0000 7f5853400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55717c6b0840 0x55717ca572d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:24:17.040 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:17.037+0000 7f5853400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55717c6b0840 0x55717ca572d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:43020/0 (socket says 172.21.15.50:43020) 2024-08-31T04:24:17.041 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:17.037+0000 7f5861696740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55717c68fb60 0x55717ca57d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:17.041 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:17.037+0000 7f5861696740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55717c9cc530 con 0x55717c6b0840 2024-08-31T04:24:17.041 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:17.037+0000 7f5861696740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x55717c9bbac0 con 0x55717c687980 2024-08-31T04:24:17.041 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:17.037+0000 7f5861696740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x55717c9bfa70 con 0x55717c68fb60 2024-08-31T04:24:17.041 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:17.037+0000 7f5853400640 1 -- 172.21.15.50:0/2423546657 learned_addr learned my addr 172.21.15.50:0/2423546657 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:24:17.041 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:17.038+0000 7f5853e00640 1 --2- 172.21.15.50:0/2423546657 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55717c687980 0x55717ca57810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:24:17.041 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:17.038+0000 7f5853e00640 1 -- 172.21.15.50:0/2423546657 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55717c68fb60 msgr2=0x55717ca57d50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-31T04:24:17.041 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:17.038+0000 7f5853e00640 1 --2- 172.21.15.50:0/2423546657 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55717c68fb60 0x55717ca57d50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:17.041 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:17.038+0000 7f5853e00640 1 -- 172.21.15.50:0/2423546657 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55717c6b0840 msgr2=0x55717ca572d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:24:17.041 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:17.038+0000 7f5853e00640 1 --2- 172.21.15.50:0/2423546657 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55717c6b0840 0x55717ca572d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:17.041 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:17.038+0000 7f5853e00640 1 -- 172.21.15.50:0/2423546657 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55717c96e880 con 0x55717c687980 2024-08-31T04:24:17.041 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:17.038+0000 7f5850c00640 1 --2- 172.21.15.50:0/819779617 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f58380b4ba0 0x7f58380b70b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:17.041 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:17.039+0000 7f5850c00640 1 -- 172.21.15.50:0/819779617 <== mon.1 v2:172.21.15.177:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8219+0+0 (secure 0 0 0) 0x7f584c0e5760 con 0x7f5854109a20 2024-08-31T04:24:17.042 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:17.039+0000 7f5853e00640 1 --2- 172.21.15.50:0/2423546657 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55717c687980 0x55717ca57810 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f5844005fd0 tx=0x7f584400bc70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6e110a4a8932d22e server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:24:17.042 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:17.039+0000 7f5853400640 1 --2- 172.21.15.50:0/819779617 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f58380b4ba0 0x7f58380b70b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:24:17.042 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:17.039+0000 7f5849200640 1 -- 172.21.15.50:0/2423546657 <== mon.2 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f584400be60 con 0x55717c687980 2024-08-31T04:24:17.042 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:17.039+0000 7f5849200640 1 -- 172.21.15.50:0/2423546657 <== mon.2 v2:172.21.15.133:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5844015070 con 0x55717c687980 2024-08-31T04:24:17.043 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:17.039+0000 7f5849200640 1 -- 172.21.15.50:0/2423546657 <== mon.2 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5844004da0 con 0x55717c687980 2024-08-31T04:24:17.043 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:17.040+0000 7f5861696740 1 -- 172.21.15.50:0/2423546657 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55717c687980 msgr2=0x55717ca57810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:24:17.043 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:17.040+0000 7f5861696740 1 --2- 172.21.15.50:0/2423546657 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55717c687980 0x55717ca57810 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f5844005fd0 tx=0x7f584400bc70 comp rx=0 tx=0).stop 2024-08-31T04:24:17.043 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:17.040+0000 7f5853400640 1 --2- 172.21.15.50:0/819779617 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f58380b4ba0 0x7f58380b70b0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f5840005f70 tx=0x7f5840031400 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:24:17.043 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:17.041+0000 7f5861696740 1 -- 172.21.15.50:0/2423546657 shutdown_connections 2024-08-31T04:24:17.043 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:17.041+0000 7f5861696740 1 --2- 172.21.15.50:0/2423546657 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55717c68fb60 0x55717ca57d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:17.043 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:17.041+0000 7f5861696740 1 --2- 172.21.15.50:0/2423546657 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55717c687980 0x55717ca57810 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:17.043 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:17.041+0000 7f5861696740 1 --2- 172.21.15.50:0/2423546657 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55717c6b0840 0x55717ca572d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:17.043 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:17.041+0000 7f5861696740 1 -- 172.21.15.50:0/2423546657 >> 172.21.15.50:0/2423546657 conn(0x55717c6a4990 msgr2=0x55717ca551c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:24:17.043 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:17.041+0000 7f5861696740 1 -- 172.21.15.50:0/2423546657 shutdown_connections 2024-08-31T04:24:17.043 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:17.041+0000 7f5861696740 1 -- 172.21.15.50:0/2423546657 wait complete. 2024-08-31T04:24:17.044 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:17.042+0000 7f5861696740 1 -- start start 2024-08-31T04:24:17.044 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:17.042+0000 7f5861696740 1 Processor -- start 2024-08-31T04:24:17.044 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:17.042+0000 7f5861696740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55717c687980 0x55717ca62ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:17.044 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:17.043+0000 7f5861696740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55717c68fb60 0x55717ca633e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:17.044 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:17.043+0000 7f5861696740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55717c6b0840 0x55717ca6edd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:17.044 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:17.043+0000 7f5861696740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55717c81e7a0 con 0x55717c68fb60 2024-08-31T04:24:17.044 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:17.043+0000 7f5861696740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x55717c9427f0 con 0x55717c6b0840 2024-08-31T04:24:17.045 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:17.043+0000 7f5861696740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x55717ca65ab0 con 0x55717c687980 2024-08-31T04:24:17.045 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:17.043+0000 7f5861696740 10 client.0 _ll_register_callbacks cb 0x55717c967e60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:24:17.046 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:17.043+0000 7f5853e00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55717c687980 0x55717ca62ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:24:17.046 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:17.043+0000 7f5853e00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55717c687980 0x55717ca62ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.50:33264/0 (socket says 172.21.15.50:33264) 2024-08-31T04:24:17.046 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:17.043+0000 7f5853e00640 1 -- 172.21.15.50:0/83120875 learned_addr learned my addr 172.21.15.50:0/83120875 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:24:17.046 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:17.043+0000 7f5853400640 1 --2- 172.21.15.50:0/83120875 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55717c68fb60 0x55717ca633e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:24:17.046 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:17.043+0000 7f5858a00640 1 --2- 172.21.15.50:0/83120875 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55717c6b0840 0x55717ca6edd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:24:17.046 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:17.044+0000 7f5858a00640 1 -- 172.21.15.50:0/83120875 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55717c687980 msgr2=0x55717ca62ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:24:17.046 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:17.044+0000 7f5858a00640 1 --2- 172.21.15.50:0/83120875 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55717c687980 0x55717ca62ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:17.046 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:17.044+0000 7f5858a00640 1 -- 172.21.15.50:0/83120875 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55717c68fb60 msgr2=0x55717ca633e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:24:17.046 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:17.044+0000 7f5858a00640 1 --2- 172.21.15.50:0/83120875 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55717c68fb60 0x55717ca633e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:17.046 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:17.044+0000 7f5858a00640 1 -- 172.21.15.50:0/83120875 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55717c72ab90 con 0x55717c6b0840 2024-08-31T04:24:17.046 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:17.044+0000 7f5853400640 1 --2- 172.21.15.50:0/83120875 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55717c68fb60 0x55717ca633e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:24:17.047 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:17.045+0000 7f5858a00640 1 --2- 172.21.15.50:0/83120875 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55717c6b0840 0x55717ca6edd0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f584c0a93b0 tx=0x7f584c0ac840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=771c3feae2e17d5a server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:24:17.047 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:17.045+0000 7f583d600640 10 client.0 ms_handle_connect on v2:172.21.15.133:3300/0 2024-08-31T04:24:17.048 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:17.045+0000 7f583d600640 1 -- 172.21.15.50:0/83120875 <== mon.2 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f584c0b5460 con 0x55717c6b0840 2024-08-31T04:24:17.048 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:17.045+0000 7f5861696740 1 -- 172.21.15.50:0/83120875 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5844015070 con 0x55717c6b0840 2024-08-31T04:24:17.048 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:17.045+0000 7f583d600640 1 -- 172.21.15.50:0/83120875 <== mon.2 v2:172.21.15.133:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8219+0+0 (secure 0 0 0) 0x7f584c0b4fd0 con 0x55717c6b0840 2024-08-31T04:24:17.048 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:17.046+0000 7f583d600640 1 -- 172.21.15.50:0/83120875 <== mon.2 v2:172.21.15.133:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f584c0b51d0 con 0x55717c6b0840 2024-08-31T04:24:17.048 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:17.046+0000 7f5861696740 10 client.25556 fetch_fsmap learned FSMap version 29 2024-08-31T04:24:17.048 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:17.046+0000 7f5861696740 1 -- 172.21.15.50:0/83120875 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55717ca71b50 con 0x55717c6b0840 2024-08-31T04:24:17.048 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:17.046+0000 7f583d600640 1 -- 172.21.15.50:0/83120875 <== mon.2 v2:172.21.15.133:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5844015070 con 0x55717c6b0840 2024-08-31T04:24:17.048 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:17.046+0000 7f583d600640 1 -- 172.21.15.50:0/83120875 <== mon.2 v2:172.21.15.133:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f584c0aaea0 con 0x55717c6b0840 2024-08-31T04:24:17.049 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:17.046+0000 7f5861696740 10 client.25556 fetch_fsmap finished waiting for FSMap version 29 2024-08-31T04:24:17.049 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:17.046+0000 7f5861696740 10 client.25556 resolve_mds: validated gid 24695 aka daemon mds.b 2024-08-31T04:24:17.049 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:17.047+0000 7f5861696740 20 client.25556 populate_metadata read hostname 'smithi050' 2024-08-31T04:24:17.049 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:17.047+0000 7f5861696740 1 --2- 172.21.15.50:0/83120875 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x55717c66f1c0 0x55717ca74ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:17.049 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:17.047+0000 7f5861696740 4 client.25556 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T04:24:17.049 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:17.047+0000 7f5861696740 1 -- 172.21.15.50:0/83120875 --> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55717c9ce480 con 0x55717c66f1c0 2024-08-31T04:24:17.049 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:17.047+0000 7f5853e00640 1 --2- 172.21.15.50:0/83120875 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x55717c66f1c0 0x55717ca74ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:24:17.049 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:17.048+0000 7f5853e00640 1 --2- 172.21.15.50:0/83120875 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x55717c66f1c0 0x55717ca74ff0 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6dde536306f17c8f server_cookie=95016f4bce60745b in_seq=0 out_seq=0 2024-08-31T04:24:17.049 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:17.048+0000 7f583d600640 10 client.25556 ms_handle_connect on v2:172.21.15.133:6838/2526402262 2024-08-31T04:24:17.050 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:17.049+0000 7f583d600640 1 -- 172.21.15.50:0/83120875 <== mds.0 v2:172.21.15.133:6838/2526402262 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55717c9ce480 con 0x55717c66f1c0 2024-08-31T04:24:17.050 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:17.049+0000 7f583d600640 10 client.25556 handle_command_reply: tid=0 2024-08-31T04:24:17.050 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:17.049+0000 7f5861696740 1 client.25556 shutdown 2024-08-31T04:24:17.051 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:17.049+0000 7f5861696740 1 -- 172.21.15.50:0/83120875 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55717c6b0840 msgr2=0x55717ca6edd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:24:17.051 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:17.049+0000 7f5861696740 1 --2- 172.21.15.50:0/83120875 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55717c6b0840 0x55717ca6edd0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f584c0a93b0 tx=0x7f584c0ac840 comp rx=0 tx=0).stop 2024-08-31T04:24:17.051 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:17.050+0000 7f5861696740 1 -- 172.21.15.50:0/83120875 shutdown_connections 2024-08-31T04:24:17.051 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:17.050+0000 7f5861696740 1 --2- 172.21.15.50:0/83120875 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x55717c66f1c0 0x55717ca74ff0 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:17.051 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:17.050+0000 7f5861696740 1 --2- 172.21.15.50:0/83120875 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55717c6b0840 0x55717ca6edd0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:17.051 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:17.050+0000 7f5861696740 1 --2- 172.21.15.50:0/83120875 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55717c68fb60 0x55717ca633e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:17.051 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:17.050+0000 7f5861696740 1 --2- 172.21.15.50:0/83120875 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55717c687980 0x55717ca62ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:17.051 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:17.050+0000 7f583d600640 0 client.25556 ms_handle_reset on v2:172.21.15.133:6838/2526402262 2024-08-31T04:24:17.051 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:17.050+0000 7f5861696740 1 -- 172.21.15.50:0/83120875 >> 172.21.15.50:0/83120875 conn(0x55717c6a4990 msgr2=0x55717ca5a4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:24:17.052 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:17.050+0000 7f5861696740 1 -- 172.21.15.50:0/83120875 shutdown_connections 2024-08-31T04:24:17.052 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:17.050+0000 7f5861696740 1 -- 172.21.15.50:0/83120875 wait complete. 2024-08-31T04:24:17.052 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:17.051+0000 7f5861696740 20 client.25556 trim_cache size 0 max 16384 2024-08-31T04:24:17.070 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:17.069+0000 7f5861696740 1 Processor -- start 2024-08-31T04:24:17.071 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:17.069+0000 7f5861696740 1 -- start start 2024-08-31T04:24:17.071 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:17.070+0000 7f5861696740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55717c687980 0x55717ca551f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:17.072 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:17.070+0000 7f5861696740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55717c68fb60 0x55717ca6ecd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:17.072 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:17.070+0000 7f5861696740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55717c6b0840 0x55717ca6f210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:17.072 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:17.070+0000 7f5861696740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f58541bdd70 con 0x55717c687980 2024-08-31T04:24:17.072 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:17.070+0000 7f5861696740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f58541bf8b0 con 0x55717c68fb60 2024-08-31T04:24:17.072 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:17.070+0000 7f5861696740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f58541be440 con 0x55717c6b0840 2024-08-31T04:24:17.072 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:17.070+0000 7f5853400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55717c68fb60 0x55717ca6ecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:24:17.072 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:17.070+0000 7f5853400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55717c68fb60 0x55717ca6ecd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.50:58918/0 (socket says 172.21.15.50:58918) 2024-08-31T04:24:17.072 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:17.070+0000 7f5853400640 1 -- 172.21.15.50:0/415196891 learned_addr learned my addr 172.21.15.50:0/415196891 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:24:17.072 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:17.070+0000 7f5858a00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55717c6b0840 0x55717ca6f210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:24:17.073 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:17.071+0000 7f5853e00640 1 --2- 172.21.15.50:0/415196891 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55717c687980 0x55717ca551f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:24:17.073 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:17.071+0000 7f5853400640 1 -- 172.21.15.50:0/415196891 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55717c6b0840 msgr2=0x55717ca6f210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:24:17.073 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:17.071+0000 7f5853400640 1 --2- 172.21.15.50:0/415196891 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55717c6b0840 0x55717ca6f210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:17.073 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:17.071+0000 7f5853400640 1 -- 172.21.15.50:0/415196891 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55717c687980 msgr2=0x55717ca551f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:24:17.073 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:17.071+0000 7f5853400640 1 --2- 172.21.15.50:0/415196891 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55717c687980 0x55717ca551f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:17.073 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:17.071+0000 7f5853400640 1 -- 172.21.15.50:0/415196891 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55717ca506d0 con 0x55717c68fb60 2024-08-31T04:24:17.073 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:17.072+0000 7f5853400640 1 --2- 172.21.15.50:0/415196891 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55717c68fb60 0x55717ca6ecd0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f5840009900 tx=0x7f584003e070 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4661b9e45a60b6b2 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:24:17.074 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:17.072+0000 7f583fe00640 1 -- 172.21.15.50:0/415196891 <== mon.2 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5840035040 con 0x55717c68fb60 2024-08-31T04:24:17.074 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:17.072+0000 7f583fe00640 1 -- 172.21.15.50:0/415196891 <== mon.2 v2:172.21.15.133:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f584004d070 con 0x55717c68fb60 2024-08-31T04:24:17.074 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:17.073+0000 7f583fe00640 1 -- 172.21.15.50:0/415196891 <== mon.2 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5840004e10 con 0x55717c68fb60 2024-08-31T04:24:17.074 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:17.073+0000 7f5861696740 1 -- 172.21.15.50:0/415196891 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55717c68fb60 msgr2=0x55717ca6ecd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:24:17.074 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:17.073+0000 7f5861696740 1 --2- 172.21.15.50:0/415196891 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55717c68fb60 0x55717ca6ecd0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f5840009900 tx=0x7f584003e070 comp rx=0 tx=0).stop 2024-08-31T04:24:17.075 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:17.073+0000 7f5861696740 1 -- 172.21.15.50:0/415196891 shutdown_connections 2024-08-31T04:24:17.075 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:17.073+0000 7f5861696740 1 --2- 172.21.15.50:0/415196891 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55717c6b0840 0x55717ca6f210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:17.075 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:17.073+0000 7f5861696740 1 --2- 172.21.15.50:0/415196891 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55717c68fb60 0x55717ca6ecd0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:17.075 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:17.073+0000 7f5861696740 1 --2- 172.21.15.50:0/415196891 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55717c687980 0x55717ca551f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:17.075 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:17.073+0000 7f5861696740 1 -- 172.21.15.50:0/415196891 >> 172.21.15.50:0/415196891 conn(0x55717c6a4990 msgr2=0x55717ca54ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:24:17.075 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:17.074+0000 7f5861696740 1 -- 172.21.15.50:0/415196891 shutdown_connections 2024-08-31T04:24:17.075 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:17.074+0000 7f5861696740 1 -- 172.21.15.50:0/415196891 wait complete. 2024-08-31T04:24:17.076 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:17.074+0000 7f5861696740 1 -- start start 2024-08-31T04:24:17.076 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:17.074+0000 7f5861696740 1 Processor -- start 2024-08-31T04:24:17.076 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:17.075+0000 7f5861696740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55717c687980 0x55717ca6ad40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:17.076 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:17.075+0000 7f5861696740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55717c68fb60 0x55717ca6b280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:17.077 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:17.075+0000 7f5861696740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55717c6b0840 0x55717ca65cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:17.077 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:17.075+0000 7f5861696740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f58541bf1e0 con 0x55717c68fb60 2024-08-31T04:24:17.077 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:17.075+0000 7f5861696740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f58541beb10 con 0x55717c687980 2024-08-31T04:24:17.077 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:17.075+0000 7f5861696740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f58541bbd50 con 0x55717c6b0840 2024-08-31T04:24:17.077 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:17.075+0000 7f5861696740 10 client.0 _ll_register_callbacks cb 0x7f584c0ab940 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:24:17.078 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:17.076+0000 7f5853e00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55717c687980 0x55717ca6ad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:24:17.078 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:17.076+0000 7f5853e00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55717c687980 0x55717ca6ad40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.50:58930/0 (socket says 172.21.15.50:58930) 2024-08-31T04:24:17.078 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:17.076+0000 7f5853e00640 1 -- 172.21.15.50:0/42856441 learned_addr learned my addr 172.21.15.50:0/42856441 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:24:17.078 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:17.076+0000 7f5858a00640 1 --2- 172.21.15.50:0/42856441 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55717c6b0840 0x55717ca65cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:24:17.078 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:17.076+0000 7f5853400640 1 --2- 172.21.15.50:0/42856441 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55717c68fb60 0x55717ca6b280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:24:17.078 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:17.076+0000 7f5858a00640 1 -- 172.21.15.50:0/42856441 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55717c687980 msgr2=0x55717ca6ad40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:24:17.078 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:17.076+0000 7f5858a00640 1 --2- 172.21.15.50:0/42856441 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55717c687980 0x55717ca6ad40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:17.078 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:17.076+0000 7f5858a00640 1 -- 172.21.15.50:0/42856441 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55717c68fb60 msgr2=0x55717ca6b280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:24:17.079 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:17.076+0000 7f5858a00640 1 --2- 172.21.15.50:0/42856441 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55717c68fb60 0x55717ca6b280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:17.079 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:17.076+0000 7f5858a00640 1 -- 172.21.15.50:0/42856441 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55717ca6b9c0 con 0x55717c6b0840 2024-08-31T04:24:17.079 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:17.077+0000 7f5858a00640 1 --2- 172.21.15.50:0/42856441 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55717c6b0840 0x55717ca65cf0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f584c0abe40 tx=0x7f584c0b0b30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6051d0543542df53 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:24:17.079 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:17.077+0000 7f583d600640 10 client.0 ms_handle_connect on v2:172.21.15.177:3300/0 2024-08-31T04:24:17.080 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:17.077+0000 7f583d600640 1 -- 172.21.15.50:0/42856441 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f584c0b5460 con 0x55717c6b0840 2024-08-31T04:24:17.080 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:17.077+0000 7f583d600640 1 -- 172.21.15.50:0/42856441 <== mon.1 v2:172.21.15.177:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8219+0+0 (secure 0 0 0) 0x7f584c0a8730 con 0x55717c6b0840 2024-08-31T04:24:17.080 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:17.077+0000 7f5861696740 1 -- 172.21.15.50:0/42856441 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f584004d070 con 0x55717c6b0840 2024-08-31T04:24:17.080 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:17.077+0000 7f583d600640 1 -- 172.21.15.50:0/42856441 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f584c0ac140 con 0x55717c6b0840 2024-08-31T04:24:17.080 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:17.077+0000 7f5861696740 10 client.25567 fetch_fsmap learned FSMap version 29 2024-08-31T04:24:17.080 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:17.077+0000 7f5861696740 1 -- 172.21.15.50:0/42856441 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55717cadfe70 con 0x55717c6b0840 2024-08-31T04:24:17.080 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:17.078+0000 7f583d600640 1 -- 172.21.15.50:0/42856441 <== mon.1 v2:172.21.15.177:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f584004d070 con 0x55717c6b0840 2024-08-31T04:24:17.080 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:17.078+0000 7f583d600640 1 -- 172.21.15.50:0/42856441 <== mon.1 v2:172.21.15.177:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f584c004c90 con 0x55717c6b0840 2024-08-31T04:24:17.080 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:17.078+0000 7f5861696740 10 client.25567 fetch_fsmap finished waiting for FSMap version 29 2024-08-31T04:24:17.080 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:17.078+0000 7f5861696740 10 client.25567 resolve_mds: validated gid 24695 aka daemon mds.b 2024-08-31T04:24:17.081 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:17.078+0000 7f5861696740 20 client.25567 populate_metadata read hostname 'smithi050' 2024-08-31T04:24:17.081 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:17.078+0000 7f5861696740 1 --2- 172.21.15.50:0/42856441 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x55717c644570 0x55717cae2440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:17.081 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:17.078+0000 7f5861696740 4 client.25567 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 146.4, "await_for": 45.0}] 2024-08-31T04:24:17.081 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:17.078+0000 7f5861696740 1 -- 172.21.15.50:0/42856441 --> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 146.4, "await_for": 45.0}) -- 0x55717c9c9f20 con 0x55717c644570 2024-08-31T04:24:17.081 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:17.079+0000 7f5853e00640 1 --2- 172.21.15.50:0/42856441 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x55717c644570 0x55717cae2440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:24:17.081 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:17.079+0000 7f5853e00640 1 --2- 172.21.15.50:0/42856441 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x55717c644570 0x55717cae2440 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8f251abbdd6a4cb8 server_cookie=d76c291d1e5126d7 in_seq=0 out_seq=0 2024-08-31T04:24:17.081 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:17.079+0000 7f583d600640 10 client.25567 ms_handle_connect on v2:172.21.15.133:6838/2526402262 2024-08-31T04:24:17.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:17.086+0000 7f583d600640 1 -- 172.21.15.50:0/42856441 <== mds.0 v2:172.21.15.133:6838/2526402262 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x55717c9c9f20 con 0x55717c644570 2024-08-31T04:24:17.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:17.086+0000 7f583d600640 10 client.25567 handle_command_reply: tid=0 2024-08-31T04:24:17.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:17.087+0000 7f5861696740 1 client.25567 shutdown 2024-08-31T04:24:17.089 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:17.087+0000 7f5861696740 1 -- 172.21.15.50:0/42856441 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55717c6b0840 msgr2=0x55717ca65cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:24:17.089 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:17.087+0000 7f5861696740 1 --2- 172.21.15.50:0/42856441 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55717c6b0840 0x55717ca65cf0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f584c0abe40 tx=0x7f584c0b0b30 comp rx=0 tx=0).stop 2024-08-31T04:24:17.089 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:17.087+0000 7f5861696740 1 -- 172.21.15.50:0/42856441 shutdown_connections 2024-08-31T04:24:17.089 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:17.087+0000 7f5861696740 1 --2- 172.21.15.50:0/42856441 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x55717c644570 0x55717cae2440 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:17.089 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:17.087+0000 7f5861696740 1 --2- 172.21.15.50:0/42856441 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55717c6b0840 0x55717ca65cf0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:17.089 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:17.087+0000 7f5861696740 1 --2- 172.21.15.50:0/42856441 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55717c68fb60 0x55717ca6b280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:17.089 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:17.087+0000 7f5861696740 1 --2- 172.21.15.50:0/42856441 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55717c687980 0x55717ca6ad40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:17.089 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:17.087+0000 7f5861696740 1 -- 172.21.15.50:0/42856441 >> 172.21.15.50:0/42856441 conn(0x55717c6a4990 msgr2=0x55717ca537e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:24:17.089 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:17.087+0000 7f583d600640 0 client.25567 ms_handle_reset on v2:172.21.15.133:6838/2526402262 2024-08-31T04:24:17.090 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:17.088+0000 7f5861696740 1 -- 172.21.15.50:0/42856441 shutdown_connections 2024-08-31T04:24:17.090 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:17.088+0000 7f5861696740 1 -- 172.21.15.50:0/42856441 wait complete. 2024-08-31T04:24:17.090 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:17.088+0000 7f5861696740 20 client.25567 trim_cache size 0 max 16384 2024-08-31T04:24:17.090 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-08-31T04:24:17.090 INFO:teuthology.orchestra.run.smithi050.stdout: "epoch": 29, 2024-08-31T04:24:17.091 INFO:teuthology.orchestra.run.smithi050.stdout: "leader": 24695, 2024-08-31T04:24:17.091 INFO:teuthology.orchestra.run.smithi050.stdout: "set_version": 6, 2024-08-31T04:24:17.091 INFO:teuthology.orchestra.run.smithi050.stdout: "sets": { 2024-08-31T04:24:17.091 INFO:teuthology.orchestra.run.smithi050.stdout: "a406ef21": { 2024-08-31T04:24:17.091 INFO:teuthology.orchestra.run.smithi050.stdout: "version": 6, 2024-08-31T04:24:17.091 INFO:teuthology.orchestra.run.smithi050.stdout: "age_ref": 0.0, 2024-08-31T04:24:17.091 INFO:teuthology.orchestra.run.smithi050.stdout: "state": { 2024-08-31T04:24:17.091 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "QUIESCED", 2024-08-31T04:24:17.091 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 0.0 2024-08-31T04:24:17.091 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:24:17.091 INFO:teuthology.orchestra.run.smithi050.stdout: "timeout": 90.0, 2024-08-31T04:24:17.091 INFO:teuthology.orchestra.run.smithi050.stdout: "expiration": 146.4, 2024-08-31T04:24:17.091 INFO:teuthology.orchestra.run.smithi050.stdout: "members": { 2024-08-31T04:24:17.091 INFO:teuthology.orchestra.run.smithi050.stdout: "file:/": { 2024-08-31T04:24:17.092 INFO:teuthology.orchestra.run.smithi050.stdout: "excluded": false, 2024-08-31T04:24:17.092 INFO:teuthology.orchestra.run.smithi050.stdout: "state": { 2024-08-31T04:24:17.092 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "QUIESCED", 2024-08-31T04:24:17.092 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 0.0 2024-08-31T04:24:17.092 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T04:24:17.092 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T04:24:17.092 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T04:24:17.092 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T04:24:17.092 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T04:24:17.092 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-08-31T04:24:17.093 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:17.089+0000 7f5859400640 1 -- 172.21.15.50:0/819779617 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f58380b4ba0 msgr2=0x7f58380b70b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:24:17.093 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:17.089+0000 7f5859400640 1 --2- 172.21.15.50:0/819779617 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f58380b4ba0 0x7f58380b70b0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f5840005f70 tx=0x7f5840031400 comp rx=0 tx=0).stop 2024-08-31T04:24:17.093 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:17.089+0000 7f5859400640 1 -- 172.21.15.50:0/819779617 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5854109a20 msgr2=0x7f585419fbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:24:17.093 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:17.089+0000 7f5859400640 1 --2- 172.21.15.50:0/819779617 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5854109a20 0x7f585419fbe0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f584c009fd0 tx=0x7f584c00ef10 comp rx=0 tx=0).stop 2024-08-31T04:24:17.093 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:17.089+0000 7f5859400640 1 -- 172.21.15.50:0/819779617 shutdown_connections 2024-08-31T04:24:17.093 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:17.089+0000 7f5859400640 1 --2- 172.21.15.50:0/819779617 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f58380b4ba0 0x7f58380b70b0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:17.093 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:17.089+0000 7f5859400640 1 --2- 172.21.15.50:0/819779617 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5854109a20 0x7f585419fbe0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:17.093 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:17.089+0000 7f5859400640 1 --2- 172.21.15.50:0/819779617 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f58541090d0 0x7f58541990c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:17.093 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:17.089+0000 7f5859400640 1 --2- 172.21.15.50:0/819779617 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5854103790 0x7f5854198b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:17.093 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:17.089+0000 7f5859400640 1 -- 172.21.15.50:0/819779617 >> 172.21.15.50:0/819779617 conn(0x7f58540ff220 msgr2=0x7f58540ff630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:24:17.094 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:17.090+0000 7f5859400640 1 -- 172.21.15.50:0/819779617 shutdown_connections 2024-08-31T04:24:17.094 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:17.090+0000 7f5859400640 1 -- 172.21.15.50:0/819779617 wait complete. 2024-08-31T04:24:17.293 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:24:17 smithi133 ceph-mon[22177]: pgmap v408: 97 pgs: 97 active+clean; 671 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 255 B/s wr, 10 op/s 2024-08-31T04:24:17.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:24:17 smithi177 ceph-mon[22025]: pgmap v408: 97 pgs: 97 active+clean; 671 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 255 B/s wr, 10 op/s 2024-08-31T04:24:17.897 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set 'a406ef21', quiesce took 4.6 seconds. Will release after: 21.799999999999997 2024-08-31T04:24:19.293 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:24:19 smithi133 ceph-mon[22177]: pgmap v409: 97 pgs: 97 active+clean; 671 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 255 B/s wr, 10 op/s 2024-08-31T04:24:19.450 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:24:19 smithi050 ceph-mon[17259]: pgmap v409: 97 pgs: 97 active+clean; 671 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 255 B/s wr, 10 op/s 2024-08-31T04:24:19.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:24:19 smithi177 ceph-mon[22025]: pgmap v409: 97 pgs: 97 active+clean; 671 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 255 B/s wr, 10 op/s 2024-08-31T04:24:20.349 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:20.348+0000 7f2769400640 1 -- 172.21.15.50:0/2638296965 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2764104e60 msgr2=0x7f276410b800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:24:20.349 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:20.348+0000 7f2769400640 1 --2- 172.21.15.50:0/2638296965 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2764104e60 0x7f276410b800 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f275c009ca0 tx=0x7f275c02a8c0 comp rx=0 tx=0).stop 2024-08-31T04:24:20.350 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:20.348+0000 7f2769400640 1 -- 172.21.15.50:0/2638296965 shutdown_connections 2024-08-31T04:24:20.350 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:20.348+0000 7f2769400640 1 --2- 172.21.15.50:0/2638296965 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2764104e60 0x7f276410b800 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:20.350 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:20.348+0000 7f2769400640 1 --2- 172.21.15.50:0/2638296965 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f27641044c0 0x7f27641048d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:20.350 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:20.348+0000 7f2769400640 1 --2- 172.21.15.50:0/2638296965 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2764103440 0x7f27641038b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:20.350 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:20.348+0000 7f2769400640 1 -- 172.21.15.50:0/2638296965 >> 172.21.15.50:0/2638296965 conn(0x7f27640fed80 msgr2=0x7f2764101230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:24:20.350 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:20.348+0000 7f2769400640 1 -- 172.21.15.50:0/2638296965 shutdown_connections 2024-08-31T04:24:20.350 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:20.348+0000 7f2769400640 1 -- 172.21.15.50:0/2638296965 wait complete. 2024-08-31T04:24:20.351 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:20.349+0000 7f2769400640 1 Processor -- start 2024-08-31T04:24:20.351 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:20.349+0000 7f2769400640 1 -- start start 2024-08-31T04:24:20.351 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:20.350+0000 7f2769400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2764103440 0x7f2764199c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:20.351 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:20.350+0000 7f2769400640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f27641044c0 0x7f276419a300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:20.351 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:20.350+0000 7f2769400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2764104e60 0x7f276419aeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:20.352 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:20.350+0000 7f2769400640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f276410f110 con 0x7f2764103440 2024-08-31T04:24:20.352 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:20.350+0000 7f2769400640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f276410ef90 con 0x7f2764104e60 2024-08-31T04:24:20.352 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:20.350+0000 7f2769400640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f276410f290 con 0x7f27641044c0 2024-08-31T04:24:20.352 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:20.350+0000 7f2761e00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f27641044c0 0x7f276419a300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:24:20.352 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:20.350+0000 7f2762800640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2764103440 0x7f2764199c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:24:20.352 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:20.350+0000 7f2761e00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f27641044c0 0x7f276419a300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.50:33316/0 (socket says 172.21.15.50:33316) 2024-08-31T04:24:20.352 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:20.350+0000 7f2761e00640 1 -- 172.21.15.50:0/39057005 learned_addr learned my addr 172.21.15.50:0/39057005 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:24:20.352 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:20.350+0000 7f2763200640 1 --2- 172.21.15.50:0/39057005 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2764104e60 0x7f276419aeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:24:20.353 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:20.350+0000 7f2761e00640 1 -- 172.21.15.50:0/39057005 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2764104e60 msgr2=0x7f276419aeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:24:20.353 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:20.350+0000 7f2761e00640 1 --2- 172.21.15.50:0/39057005 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2764104e60 0x7f276419aeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:20.353 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:20.350+0000 7f2761e00640 1 -- 172.21.15.50:0/39057005 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2764103440 msgr2=0x7f2764199c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:24:20.353 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:20.350+0000 7f2761e00640 1 --2- 172.21.15.50:0/39057005 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2764103440 0x7f2764199c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:20.353 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:20.350+0000 7f2761e00640 1 -- 172.21.15.50:0/39057005 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f276419b6d0 con 0x7f27641044c0 2024-08-31T04:24:20.353 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:20.351+0000 7f2761e00640 1 --2- 172.21.15.50:0/39057005 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f27641044c0 0x7f276419a300 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f275000e9f0 tx=0x7f275000edf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:24:20.354 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:20.351+0000 7f275b400640 1 -- 172.21.15.50:0/39057005 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f275000cd80 con 0x7f27641044c0 2024-08-31T04:24:20.354 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:20.351+0000 7f275b400640 1 -- 172.21.15.50:0/39057005 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f27500054d0 con 0x7f27641044c0 2024-08-31T04:24:20.354 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:20.351+0000 7f2769400640 1 -- 172.21.15.50:0/39057005 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f276419b9c0 con 0x7f27641044c0 2024-08-31T04:24:20.354 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:20.351+0000 7f275b400640 1 -- 172.21.15.50:0/39057005 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2750010690 con 0x7f27641044c0 2024-08-31T04:24:20.354 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:20.351+0000 7f2769400640 1 -- 172.21.15.50:0/39057005 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f27641a20b0 con 0x7f27641044c0 2024-08-31T04:24:20.355 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:20.354+0000 7f27703ba740 1 Processor -- start 2024-08-31T04:24:20.356 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:20.355+0000 7f27703ba740 1 -- start start 2024-08-31T04:24:20.356 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:20.355+0000 7f27703ba740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5568030e61b0 0x55680348bdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:20.356 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:20.355+0000 7f27703ba740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5568030bd2f0 0x55680348c430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:20.356 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:20.355+0000 7f27703ba740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5568030c54d0 0x55680348cf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:20.356 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:20.355+0000 7f27703ba740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x5568033fef70 con 0x5568030c54d0 2024-08-31T04:24:20.356 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:20.355+0000 7f27703ba740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x5568033ee500 con 0x5568030bd2f0 2024-08-31T04:24:20.356 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:20.355+0000 7f27703ba740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x5568033f24b0 con 0x5568030e61b0 2024-08-31T04:24:20.358 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:20.355+0000 7f2763200640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5568030e61b0 0x55680348bdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:24:20.358 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:20.355+0000 7f2763200640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5568030e61b0 0x55680348bdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.50:33320/0 (socket says 172.21.15.50:33320) 2024-08-31T04:24:20.358 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:20.355+0000 7f2763200640 1 -- 172.21.15.50:0/2143116476 learned_addr learned my addr 172.21.15.50:0/2143116476 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:24:20.358 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:20.355+0000 7f2762800640 1 --2- 172.21.15.50:0/2143116476 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5568030bd2f0 0x55680348c430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:24:20.358 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:20.355+0000 7f275b400640 1 -- 172.21.15.50:0/39057005 <== mon.1 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 18) ==== 152577+0+0 (secure 0 0 0) 0x7f2750010830 con 0x7f27641044c0 2024-08-31T04:24:20.358 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:20.356+0000 7f2763200640 1 -- 172.21.15.50:0/2143116476 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5568030bd2f0 msgr2=0x55680348c430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:24:20.358 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:20.356+0000 7f2763200640 1 --2- 172.21.15.50:0/2143116476 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5568030bd2f0 0x55680348c430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:20.358 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:20.356+0000 7f2763200640 1 -- 172.21.15.50:0/2143116476 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5568030c54d0 msgr2=0x55680348cf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:24:20.358 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:20.356+0000 7f2763200640 1 --2- 172.21.15.50:0/2143116476 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5568030c54d0 0x55680348cf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:20.358 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:20.356+0000 7f2763200640 1 -- 172.21.15.50:0/2143116476 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5568033a8c10 con 0x5568030e61b0 2024-08-31T04:24:20.358 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:20.356+0000 7f2763200640 1 --2- 172.21.15.50:0/2143116476 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5568030e61b0 0x55680348bdc0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f275c035000 tx=0x7f275c02f3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=704c019f5ad1e5e server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:24:20.359 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:20.357+0000 7f274f400640 1 -- 172.21.15.50:0/2143116476 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f275c031650 con 0x5568030e61b0 2024-08-31T04:24:20.359 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:20.357+0000 7f274f400640 1 -- 172.21.15.50:0/2143116476 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f275c036030 con 0x5568030e61b0 2024-08-31T04:24:20.359 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:20.357+0000 7f274f400640 1 -- 172.21.15.50:0/2143116476 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f275c004680 con 0x5568030e61b0 2024-08-31T04:24:20.360 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:20.357+0000 7f275b400640 1 --2- 172.21.15.50:0/39057005 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f27480b4bb0 0x7f27480b70c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:20.360 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:20.358+0000 7f275b400640 1 -- 172.21.15.50:0/39057005 <== mon.1 v2:172.21.15.177:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8219+0+0 (secure 0 0 0) 0x7f27500e5530 con 0x7f27641044c0 2024-08-31T04:24:20.360 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:20.358+0000 7f2762800640 1 --2- 172.21.15.50:0/39057005 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f27480b4bb0 0x7f27480b70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:24:20.360 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:20.358+0000 7f27703ba740 1 -- 172.21.15.50:0/2143116476 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5568030e61b0 msgr2=0x55680348bdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:24:20.360 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:20.358+0000 7f27703ba740 1 --2- 172.21.15.50:0/2143116476 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5568030e61b0 0x55680348bdc0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f275c035000 tx=0x7f275c02f3a0 comp rx=0 tx=0).stop 2024-08-31T04:24:20.360 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:20.358+0000 7f27703ba740 1 -- 172.21.15.50:0/2143116476 shutdown_connections 2024-08-31T04:24:20.360 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:20.358+0000 7f27703ba740 1 --2- 172.21.15.50:0/2143116476 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5568030c54d0 0x55680348cf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:20.360 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:20.358+0000 7f27703ba740 1 --2- 172.21.15.50:0/2143116476 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5568030bd2f0 0x55680348c430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:20.360 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:20.358+0000 7f27703ba740 1 --2- 172.21.15.50:0/2143116476 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5568030e61b0 0x55680348bdc0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:20.361 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:20.358+0000 7f27703ba740 1 -- 172.21.15.50:0/2143116476 >> 172.21.15.50:0/2143116476 conn(0x5568030da300 msgr2=0x556803487850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:24:20.361 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:20.358+0000 7f27703ba740 1 -- 172.21.15.50:0/2143116476 shutdown_connections 2024-08-31T04:24:20.361 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:20.358+0000 7f27703ba740 1 -- 172.21.15.50:0/2143116476 wait complete. 2024-08-31T04:24:20.361 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:20.358+0000 7f2762800640 1 --2- 172.21.15.50:0/39057005 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f27480b4bb0 0x7f27480b70c0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f2754009e40 tx=0x7f2754005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:24:20.361 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:20.359+0000 7f27703ba740 1 -- start start 2024-08-31T04:24:20.361 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:20.359+0000 7f27703ba740 1 Processor -- start 2024-08-31T04:24:20.364 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:20.360+0000 7f27703ba740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5568030bd2f0 0x5568034996d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:20.364 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:20.360+0000 7f27703ba740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5568030c54d0 0x556803499d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:20.364 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:20.360+0000 7f27703ba740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5568030e61b0 0x55680349a900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:20.364 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:20.360+0000 7f27703ba740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x556803327ab0 con 0x5568030c54d0 2024-08-31T04:24:20.364 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:20.360+0000 7f27703ba740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x556803395320 con 0x5568030bd2f0 2024-08-31T04:24:20.364 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:20.360+0000 7f27703ba740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x55680348d8c0 con 0x5568030e61b0 2024-08-31T04:24:20.364 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:20.360+0000 7f27703ba740 10 client.0 _ll_register_callbacks cb 0x55680339b6a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:24:20.365 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:20.360+0000 7f2761e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5568030c54d0 0x556803499d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:24:20.365 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:20.360+0000 7f2761e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5568030c54d0 0x556803499d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:43092/0 (socket says 172.21.15.50:43092) 2024-08-31T04:24:20.365 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:20.360+0000 7f2761e00640 1 -- 172.21.15.50:0/33037671 learned_addr learned my addr 172.21.15.50:0/33037671 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:24:20.365 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:20.360+0000 7f2762800640 1 --2- 172.21.15.50:0/33037671 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5568030bd2f0 0x5568034996d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:24:20.365 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:20.360+0000 7f2763200640 1 --2- 172.21.15.50:0/33037671 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5568030e61b0 0x55680349a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:24:20.365 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:20.360+0000 7f2761e00640 1 -- 172.21.15.50:0/33037671 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5568030e61b0 msgr2=0x55680349a900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:24:20.365 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:20.360+0000 7f2761e00640 1 --2- 172.21.15.50:0/33037671 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5568030e61b0 0x55680349a900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:20.365 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:20.360+0000 7f2761e00640 1 -- 172.21.15.50:0/33037671 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5568030bd2f0 msgr2=0x5568034996d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:24:20.365 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:20.360+0000 7f2761e00640 1 --2- 172.21.15.50:0/33037671 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5568030bd2f0 0x5568034996d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:20.365 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:20.360+0000 7f2761e00640 1 -- 172.21.15.50:0/33037671 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556803151790 con 0x5568030c54d0 2024-08-31T04:24:20.365 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:20.360+0000 7f2762800640 1 --2- 172.21.15.50:0/33037671 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5568030bd2f0 0x5568034996d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:24:20.365 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:20.361+0000 7f2761e00640 1 --2- 172.21.15.50:0/33037671 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5568030c54d0 0x556803499d90 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f27500abea0 tx=0x7f27500aba20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=422aab1b75e59145 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:24:20.366 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:20.361+0000 7f2743e00640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-08-31T04:24:20.366 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:20.361+0000 7f2743e00640 1 -- 172.21.15.50:0/33037671 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27500abf10 con 0x5568030c54d0 2024-08-31T04:24:20.366 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:20.361+0000 7f2743e00640 1 -- 172.21.15.50:0/33037671 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8219+0+0 (secure 0 0 0) 0x7f27500b0390 con 0x5568030c54d0 2024-08-31T04:24:20.366 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:20.361+0000 7f27703ba740 1 -- 172.21.15.50:0/33037671 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f275c036030 con 0x5568030c54d0 2024-08-31T04:24:20.366 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:20.361+0000 7f2743e00640 1 -- 172.21.15.50:0/33037671 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f27500b0780 con 0x5568030c54d0 2024-08-31T04:24:20.366 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:20.361+0000 7f27703ba740 10 client.15564 fetch_fsmap learned FSMap version 29 2024-08-31T04:24:20.366 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:20.361+0000 7f27703ba740 1 -- 172.21.15.50:0/33037671 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5568031ca620 con 0x5568030c54d0 2024-08-31T04:24:20.366 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:20.361+0000 7f2743e00640 1 -- 172.21.15.50:0/33037671 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f275c036030 con 0x5568030c54d0 2024-08-31T04:24:20.366 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:20.362+0000 7f2743e00640 1 -- 172.21.15.50:0/33037671 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f27500b4da0 con 0x5568030c54d0 2024-08-31T04:24:20.366 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:20.362+0000 7f27703ba740 10 client.15564 fetch_fsmap finished waiting for FSMap version 29 2024-08-31T04:24:20.366 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:20.362+0000 7f27703ba740 10 client.15564 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T04:24:20.366 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:20.362+0000 7f27703ba740 20 client.15564 populate_metadata read hostname 'smithi050' 2024-08-31T04:24:20.366 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:20.362+0000 7f27703ba740 1 --2- 172.21.15.50:0/33037671 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x5568030a4d80 0x5568034a6d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:20.366 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:20.362+0000 7f27703ba740 4 client.15564 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T04:24:20.367 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:20.362+0000 7f27703ba740 1 -- 172.21.15.50:0/33037671 --> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556803400ec0 con 0x5568030a4d80 2024-08-31T04:24:20.367 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:20.362+0000 7f2762800640 1 --2- 172.21.15.50:0/33037671 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x5568030a4d80 0x5568034a6d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:24:20.367 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:20.363+0000 7f2762800640 1 --2- 172.21.15.50:0/33037671 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x5568030a4d80 0x5568034a6d10 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a097adfd89e3b5b2 server_cookie=d065f42f69704a7c in_seq=0 out_seq=0 2024-08-31T04:24:20.367 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:20.363+0000 7f2743e00640 10 client.15564 ms_handle_connect on v2:172.21.15.133:6838/2526402262 2024-08-31T04:24:20.368 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:20.364+0000 7f2743e00640 1 -- 172.21.15.50:0/33037671 <== mds.0 v2:172.21.15.133:6838/2526402262 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x556803400ec0 con 0x5568030a4d80 2024-08-31T04:24:20.368 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:20.364+0000 7f2743e00640 10 client.15564 handle_command_reply: tid=0 2024-08-31T04:24:20.368 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:20.364+0000 7f27703ba740 1 client.15564 shutdown 2024-08-31T04:24:20.368 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:20.364+0000 7f27703ba740 1 -- 172.21.15.50:0/33037671 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5568030c54d0 msgr2=0x556803499d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:24:20.368 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:20.364+0000 7f27703ba740 1 --2- 172.21.15.50:0/33037671 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5568030c54d0 0x556803499d90 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f27500abea0 tx=0x7f27500aba20 comp rx=0 tx=0).stop 2024-08-31T04:24:20.368 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:20.364+0000 7f27703ba740 1 -- 172.21.15.50:0/33037671 shutdown_connections 2024-08-31T04:24:20.368 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:20.364+0000 7f27703ba740 1 --2- 172.21.15.50:0/33037671 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x5568030a4d80 0x5568034a6d10 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:20.368 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:20.364+0000 7f27703ba740 1 --2- 172.21.15.50:0/33037671 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5568030e61b0 0x55680349a900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:20.369 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:20.364+0000 7f27703ba740 1 --2- 172.21.15.50:0/33037671 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5568030c54d0 0x556803499d90 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:20.369 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:20.364+0000 7f2743e00640 0 client.15564 ms_handle_reset on v2:172.21.15.133:6838/2526402262 2024-08-31T04:24:20.369 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:20.364+0000 7f27703ba740 1 --2- 172.21.15.50:0/33037671 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5568030bd2f0 0x5568034996d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:20.369 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:20.364+0000 7f27703ba740 1 -- 172.21.15.50:0/33037671 >> 172.21.15.50:0/33037671 conn(0x5568030da300 msgr2=0x556803485cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:24:20.369 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:20.365+0000 7f27703ba740 1 -- 172.21.15.50:0/33037671 shutdown_connections 2024-08-31T04:24:20.369 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:20.365+0000 7f27703ba740 1 -- 172.21.15.50:0/33037671 wait complete. 2024-08-31T04:24:20.369 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:20.365+0000 7f27703ba740 20 client.15564 trim_cache size 0 max 16384 2024-08-31T04:24:20.382 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:20.380+0000 7f27703ba740 1 Processor -- start 2024-08-31T04:24:20.382 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:20.381+0000 7f27703ba740 1 -- start start 2024-08-31T04:24:20.382 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:20.381+0000 7f27703ba740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5568030bd2f0 0x5568034905c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:20.382 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:20.381+0000 7f27703ba740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5568030c54d0 0x5568034911b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:20.382 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:20.381+0000 7f27703ba740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5568030e61b0 0x5568034916f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:20.382 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:20.381+0000 7f27703ba740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f27641a8990 con 0x5568030bd2f0 2024-08-31T04:24:20.382 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:20.381+0000 7f27703ba740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f27641aa4d0 con 0x5568030c54d0 2024-08-31T04:24:20.382 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:20.381+0000 7f27703ba740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f27641a9060 con 0x5568030e61b0 2024-08-31T04:24:20.383 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:20.381+0000 7f2762800640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5568030bd2f0 0x5568034905c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:24:20.384 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:20.381+0000 7f2761e00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5568030c54d0 0x5568034911b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:24:20.384 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:20.381+0000 7f2761e00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5568030c54d0 0x5568034911b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.50:58980/0 (socket says 172.21.15.50:58980) 2024-08-31T04:24:20.384 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:20.381+0000 7f2761e00640 1 -- 172.21.15.50:0/3236035755 learned_addr learned my addr 172.21.15.50:0/3236035755 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:24:20.384 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:20.381+0000 7f2763200640 1 --2- 172.21.15.50:0/3236035755 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5568030e61b0 0x5568034916f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:24:20.384 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:20.382+0000 7f2761e00640 1 -- 172.21.15.50:0/3236035755 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5568030e61b0 msgr2=0x5568034916f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:24:20.384 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:20.382+0000 7f2761e00640 1 --2- 172.21.15.50:0/3236035755 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5568030e61b0 0x5568034916f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:20.384 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:20.382+0000 7f2761e00640 1 -- 172.21.15.50:0/3236035755 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5568030bd2f0 msgr2=0x5568034905c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:24:20.384 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:20.382+0000 7f2761e00640 1 --2- 172.21.15.50:0/3236035755 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5568030bd2f0 0x5568034905c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:20.384 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:20.382+0000 7f2761e00640 1 -- 172.21.15.50:0/3236035755 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5568034a7080 con 0x5568030c54d0 2024-08-31T04:24:20.384 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:20.382+0000 7f2762800640 1 --2- 172.21.15.50:0/3236035755 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5568030bd2f0 0x5568034905c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:24:20.384 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:20.382+0000 7f2763200640 1 --2- 172.21.15.50:0/3236035755 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5568030e61b0 0x5568034916f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:24:20.384 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:20.382+0000 7f2761e00640 1 --2- 172.21.15.50:0/3236035755 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5568030c54d0 0x5568034911b0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f275000c6a0 tx=0x7f27500e57d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c4374127fe53a752 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:24:20.385 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:20.382+0000 7f274ea00640 1 -- 172.21.15.50:0/3236035755 <== mon.2 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27500abce0 con 0x5568030c54d0 2024-08-31T04:24:20.385 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:20.382+0000 7f274ea00640 1 -- 172.21.15.50:0/3236035755 <== mon.2 v2:172.21.15.133:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f27500abf10 con 0x5568030c54d0 2024-08-31T04:24:20.385 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:20.382+0000 7f274ea00640 1 -- 172.21.15.50:0/3236035755 <== mon.2 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27500b0390 con 0x5568030c54d0 2024-08-31T04:24:20.387 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:20.383+0000 7f27703ba740 1 -- 172.21.15.50:0/3236035755 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5568030c54d0 msgr2=0x5568034911b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:24:20.387 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:20.383+0000 7f27703ba740 1 --2- 172.21.15.50:0/3236035755 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5568030c54d0 0x5568034911b0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f275000c6a0 tx=0x7f27500e57d0 comp rx=0 tx=0).stop 2024-08-31T04:24:20.387 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:20.383+0000 7f27703ba740 1 -- 172.21.15.50:0/3236035755 shutdown_connections 2024-08-31T04:24:20.388 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:20.383+0000 7f27703ba740 1 --2- 172.21.15.50:0/3236035755 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5568030e61b0 0x5568034916f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:20.388 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:20.383+0000 7f27703ba740 1 --2- 172.21.15.50:0/3236035755 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5568030c54d0 0x5568034911b0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:20.388 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:20.383+0000 7f27703ba740 1 --2- 172.21.15.50:0/3236035755 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5568030bd2f0 0x5568034905c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:20.388 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:20.383+0000 7f27703ba740 1 -- 172.21.15.50:0/3236035755 >> 172.21.15.50:0/3236035755 conn(0x5568030da300 msgr2=0x55680348feb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:24:20.388 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:20.383+0000 7f27703ba740 1 -- 172.21.15.50:0/3236035755 shutdown_connections 2024-08-31T04:24:20.388 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:20.384+0000 7f27703ba740 1 -- 172.21.15.50:0/3236035755 wait complete. 2024-08-31T04:24:20.388 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:20.384+0000 7f27703ba740 1 -- start start 2024-08-31T04:24:20.388 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:20.384+0000 7f27703ba740 1 Processor -- start 2024-08-31T04:24:20.388 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:20.384+0000 7f27703ba740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5568030bd2f0 0x5568034a0600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:20.388 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:20.384+0000 7f27703ba740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5568030c54d0 0x5568034a0b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:20.389 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:20.385+0000 7f27703ba740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5568030e61b0 0x5568034a1080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:20.389 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:20.385+0000 7f27703ba740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f27641a9e00 con 0x5568030bd2f0 2024-08-31T04:24:20.389 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:20.385+0000 7f27703ba740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f27641a9730 con 0x5568030c54d0 2024-08-31T04:24:20.389 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:20.385+0000 7f27703ba740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f27641a6970 con 0x5568030e61b0 2024-08-31T04:24:20.389 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:20.385+0000 7f27703ba740 10 client.0 _ll_register_callbacks cb 0x7f27500ab860 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:24:20.389 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:20.385+0000 7f2762800640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5568030bd2f0 0x5568034a0600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:24:20.389 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:20.385+0000 7f2762800640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5568030bd2f0 0x5568034a0600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:43112/0 (socket says 172.21.15.50:43112) 2024-08-31T04:24:20.389 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:20.385+0000 7f2761e00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5568030c54d0 0x5568034a0b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:24:20.389 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:20.385+0000 7f2762800640 1 -- 172.21.15.50:0/2677010230 learned_addr learned my addr 172.21.15.50:0/2677010230 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:24:20.389 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:20.385+0000 7f2763200640 1 --2- 172.21.15.50:0/2677010230 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5568030e61b0 0x5568034a1080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:24:20.389 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:20.385+0000 7f2761e00640 1 -- 172.21.15.50:0/2677010230 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5568030e61b0 msgr2=0x5568034a1080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:24:20.389 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:20.385+0000 7f2761e00640 1 --2- 172.21.15.50:0/2677010230 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5568030e61b0 0x5568034a1080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:20.389 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:20.385+0000 7f2761e00640 1 -- 172.21.15.50:0/2677010230 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5568030bd2f0 msgr2=0x5568034a0600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:24:20.390 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:20.385+0000 7f2761e00640 1 --2- 172.21.15.50:0/2677010230 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5568030bd2f0 0x5568034a0600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:20.390 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:20.385+0000 7f2761e00640 1 -- 172.21.15.50:0/2677010230 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55680349f360 con 0x5568030c54d0 2024-08-31T04:24:20.390 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:20.385+0000 7f2762800640 1 --2- 172.21.15.50:0/2677010230 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5568030bd2f0 0x5568034a0600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:24:20.390 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:20.386+0000 7f2761e00640 1 --2- 172.21.15.50:0/2677010230 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5568030c54d0 0x5568034a0b40 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f27500abea0 tx=0x7f2750097370 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5092799a3e928f68 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:24:20.390 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:20.386+0000 7f2743e00640 10 client.0 ms_handle_connect on v2:172.21.15.133:3300/0 2024-08-31T04:24:20.390 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:20.386+0000 7f2743e00640 1 -- 172.21.15.50:0/2677010230 <== mon.2 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27500abce0 con 0x5568030c54d0 2024-08-31T04:24:20.390 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:20.386+0000 7f27703ba740 1 -- 172.21.15.50:0/2677010230 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f27500abf10 con 0x5568030c54d0 2024-08-31T04:24:20.390 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:20.386+0000 7f2743e00640 1 -- 172.21.15.50:0/2677010230 <== mon.2 v2:172.21.15.133:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8219+0+0 (secure 0 0 0) 0x7f27500a8500 con 0x5568030c54d0 2024-08-31T04:24:20.390 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:20.386+0000 7f2743e00640 1 -- 172.21.15.50:0/2677010230 <== mon.2 v2:172.21.15.133:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f27500ab380 con 0x5568030c54d0 2024-08-31T04:24:20.390 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:20.386+0000 7f27703ba740 10 client.25580 fetch_fsmap learned FSMap version 29 2024-08-31T04:24:20.390 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:20.386+0000 7f27703ba740 1 -- 172.21.15.50:0/2677010230 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55680349f360 con 0x5568030c54d0 2024-08-31T04:24:20.390 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:20.386+0000 7f2743e00640 1 -- 172.21.15.50:0/2677010230 <== mon.2 v2:172.21.15.133:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f27500abf10 con 0x5568030c54d0 2024-08-31T04:24:20.391 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:20.387+0000 7f2743e00640 1 -- 172.21.15.50:0/2677010230 <== mon.2 v2:172.21.15.133:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f27500a7880 con 0x5568030c54d0 2024-08-31T04:24:20.391 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:20.387+0000 7f27703ba740 10 client.25580 fetch_fsmap finished waiting for FSMap version 29 2024-08-31T04:24:20.391 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:20.387+0000 7f27703ba740 10 client.25580 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T04:24:20.391 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:20.387+0000 7f27703ba740 20 client.25580 populate_metadata read hostname 'smithi050' 2024-08-31T04:24:20.391 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:20.387+0000 7f27703ba740 1 --2- 172.21.15.50:0/2677010230 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x55680307a1c0 0x556803514020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:20.392 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:20.387+0000 7f27703ba740 4 client.25580 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-31T04:24:20.392 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:20.387+0000 7f27703ba740 1 -- 172.21.15.50:0/2677010230 --> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5568033fc960 con 0x55680307a1c0 2024-08-31T04:24:20.392 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:20.387+0000 7f2762800640 1 --2- 172.21.15.50:0/2677010230 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x55680307a1c0 0x556803514020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:24:20.392 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:20.388+0000 7f2762800640 1 --2- 172.21.15.50:0/2677010230 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x55680307a1c0 0x556803514020 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3a28550cf32efbb6 server_cookie=457e48d435c6d729 in_seq=0 out_seq=0 2024-08-31T04:24:20.392 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:20.388+0000 7f2743e00640 10 client.25580 ms_handle_connect on v2:172.21.15.133:6838/2526402262 2024-08-31T04:24:20.395 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:20.394+0000 7f2743e00640 1 -- 172.21.15.50:0/2677010230 <== mds.0 v2:172.21.15.133:6838/2526402262 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5568033fc960 con 0x55680307a1c0 2024-08-31T04:24:20.396 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:20.394+0000 7f2743e00640 10 client.25580 handle_command_reply: tid=0 2024-08-31T04:24:20.396 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:20.394+0000 7f27703ba740 1 client.25580 shutdown 2024-08-31T04:24:20.396 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:20.394+0000 7f27703ba740 1 -- 172.21.15.50:0/2677010230 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5568030c54d0 msgr2=0x5568034a0b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:24:20.396 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:20.394+0000 7f27703ba740 1 --2- 172.21.15.50:0/2677010230 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5568030c54d0 0x5568034a0b40 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f27500abea0 tx=0x7f2750097370 comp rx=0 tx=0).stop 2024-08-31T04:24:20.396 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:20.394+0000 7f27703ba740 1 -- 172.21.15.50:0/2677010230 shutdown_connections 2024-08-31T04:24:20.396 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:20.394+0000 7f27703ba740 1 --2- 172.21.15.50:0/2677010230 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x55680307a1c0 0x556803514020 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:20.396 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:20.394+0000 7f27703ba740 1 --2- 172.21.15.50:0/2677010230 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5568030e61b0 0x5568034a1080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:20.396 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:20.394+0000 7f27703ba740 1 --2- 172.21.15.50:0/2677010230 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5568030c54d0 0x5568034a0b40 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:20.396 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:20.394+0000 7f2743e00640 0 client.25580 ms_handle_reset on v2:172.21.15.133:6838/2526402262 2024-08-31T04:24:20.396 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:20.394+0000 7f27703ba740 1 --2- 172.21.15.50:0/2677010230 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5568030bd2f0 0x5568034a0600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:20.397 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:20.394+0000 7f27703ba740 1 -- 172.21.15.50:0/2677010230 >> 172.21.15.50:0/2677010230 conn(0x5568030da300 msgr2=0x556803485cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:24:20.397 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:20.394+0000 7f27703ba740 1 -- 172.21.15.50:0/2677010230 shutdown_connections 2024-08-31T04:24:20.397 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:20.394+0000 7f27703ba740 1 -- 172.21.15.50:0/2677010230 wait complete. 2024-08-31T04:24:20.397 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:20.395+0000 7f27703ba740 20 client.25580 trim_cache size 0 max 16384 2024-08-31T04:24:20.397 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout:{ 2024-08-31T04:24:20.397 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout: "message": "", 2024-08-31T04:24:20.397 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout: "return_code": 0 2024-08-31T04:24:20.397 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout:} 2024-08-31T04:24:20.398 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:20.395+0000 7f2769400640 1 -- 172.21.15.50:0/39057005 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f27480b4bb0 msgr2=0x7f27480b70c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:24:20.398 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:20.395+0000 7f2769400640 1 --2- 172.21.15.50:0/39057005 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f27480b4bb0 0x7f27480b70c0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f2754009e40 tx=0x7f2754005f90 comp rx=0 tx=0).stop 2024-08-31T04:24:20.398 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:20.395+0000 7f2769400640 1 -- 172.21.15.50:0/39057005 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f27641044c0 msgr2=0x7f276419a300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:24:20.398 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:20.395+0000 7f2769400640 1 --2- 172.21.15.50:0/39057005 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f27641044c0 0x7f276419a300 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f275000e9f0 tx=0x7f275000edf0 comp rx=0 tx=0).stop 2024-08-31T04:24:20.398 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:20.396+0000 7f2769400640 1 -- 172.21.15.50:0/39057005 shutdown_connections 2024-08-31T04:24:20.398 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:20.396+0000 7f2769400640 1 --2- 172.21.15.50:0/39057005 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f27480b4bb0 0x7f27480b70c0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:20.399 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:20.396+0000 7f2769400640 1 --2- 172.21.15.50:0/39057005 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f27641044c0 0x7f276419a300 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:20.399 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:20.396+0000 7f2769400640 1 --2- 172.21.15.50:0/39057005 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2764104e60 0x7f276419aeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:20.399 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:20.396+0000 7f2769400640 1 --2- 172.21.15.50:0/39057005 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2764103440 0x7f2764199c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:20.399 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:20.396+0000 7f2769400640 1 -- 172.21.15.50:0/39057005 >> 172.21.15.50:0/39057005 conn(0x7f27640fed80 msgr2=0x7f27641077c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:24:20.399 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:20.396+0000 7f2769400640 1 -- 172.21.15.50:0/39057005 shutdown_connections 2024-08-31T04:24:20.399 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:20.396+0000 7f2769400640 1 -- 172.21.15.50:0/39057005 wait complete. 2024-08-31T04:24:21.293 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:24:21 smithi133 ceph-mon[22177]: pgmap v410: 97 pgs: 97 active+clean; 671 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 255 B/s wr, 9 op/s 2024-08-31T04:24:21.450 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:24:21 smithi050 ceph-mon[17259]: pgmap v410: 97 pgs: 97 active+clean; 671 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 255 B/s wr, 9 op/s 2024-08-31T04:24:21.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:24:21 smithi177 ceph-mon[22025]: pgmap v410: 97 pgs: 97 active+clean; 671 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 255 B/s wr, 9 op/s 2024-08-31T04:24:23.293 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:24:23 smithi133 ceph-mon[22177]: pgmap v411: 97 pgs: 97 active+clean; 672 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 511 B/s wr, 12 op/s 2024-08-31T04:24:23.450 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:24:23 smithi050 ceph-mon[17259]: pgmap v411: 97 pgs: 97 active+clean; 672 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 511 B/s wr, 12 op/s 2024-08-31T04:24:23.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:24:23 smithi177 ceph-mon[22025]: pgmap v411: 97 pgs: 97 active+clean; 672 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 511 B/s wr, 12 op/s 2024-08-31T04:24:25.293 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:24:25 smithi133 ceph-mon[22177]: pgmap v412: 97 pgs: 97 active+clean; 672 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 255 B/s wr, 8 op/s 2024-08-31T04:24:25.449 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:24:25 smithi050 ceph-mon[17259]: pgmap v412: 97 pgs: 97 active+clean; 672 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 255 B/s wr, 8 op/s 2024-08-31T04:24:25.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:24:25 smithi177 ceph-mon[22025]: pgmap v412: 97 pgs: 97 active+clean; 672 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 255 B/s wr, 8 op/s 2024-08-31T04:24:25.520 INFO:tasks.workunit.client.0.smithi050.stderr:Updating files: 58% (7483/12697) Updating files: 59% (7492/12697) Updating files: 60% (7619/12697) Updating files: 61% (7746/12697) Updating files: 62% (7873/12697) Updating files: 63% (8000/12697) Updating files: 64% (8127/12697) Updating files: 65% (8254/12697) Updating files: 66% (8381/12697) Updating files: 67% (8507/12697) Updating files: 68% (8634/12697) Updating files: 69% (8761/12697) Updating files: 70% (8888/12697) Updating files: 71% (9015/12697) Updating files: 72% (9142/12697) Updating files: 73% (9269/12697) Updating files: 74% (9396/12697) Updating files: 75% (9523/12697) Updating files: 76% (9650/12697) Updating files: 77% (9777/12697) Updating files: 78% (9904/12697) Updating files: 79% (10031/12697) Updating files: 80% (10158/12697) Updating files: 81% (10285/12697) Updating files: 82% (10412/12697) Updating files: 83% (10539/12697) Updating files: 84% (10666/12697) Updating files: 85% (10793/12697) Updating files: 86% (10920/12697) Updating files: 87% (11047/12697) Updating files: 88% (11174/12697) Updating files: 89% (11301/12697) Updating files: 90% (11428/12697) Updating files: 91% (11555/12697) Updating files: 92% (11682/12697) Updating files: 93% (11809/12697) Updating files: 94% (11936/12697) Updating files: 95% (12063/12697) Updating files: 96% (12190/12697) Updating files: 96% (12272/12697) Updating files: 97% (12317/12697) Updating files: 98% (12444/12697) Updating files: 99% (12571/12697) Updating files: 100% (12697/12697) Updating files: 100% (12697/12697), done. 2024-08-31T04:24:26.344 INFO:tasks.workunit.client.0.smithi050.stderr:Note: switching to 'd19e6118f7015f0047264006cb0c873528eb3ae6'. 2024-08-31T04:24:26.345 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-08-31T04:24:26.345 INFO:tasks.workunit.client.0.smithi050.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-08-31T04:24:26.345 INFO:tasks.workunit.client.0.smithi050.stderr:changes and commit them, and you can discard any commits you make in this 2024-08-31T04:24:26.345 INFO:tasks.workunit.client.0.smithi050.stderr:state without impacting any branches by switching back to a branch. 2024-08-31T04:24:26.345 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-08-31T04:24:26.345 INFO:tasks.workunit.client.0.smithi050.stderr:If you want to create a new branch to retain commits you create, you may 2024-08-31T04:24:26.345 INFO:tasks.workunit.client.0.smithi050.stderr:do so (now or later) by using -c with the switch command. Example: 2024-08-31T04:24:26.345 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-08-31T04:24:26.345 INFO:tasks.workunit.client.0.smithi050.stderr: git switch -c 2024-08-31T04:24:26.345 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-08-31T04:24:26.345 INFO:tasks.workunit.client.0.smithi050.stderr:Or undo this operation with: 2024-08-31T04:24:26.346 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-08-31T04:24:26.346 INFO:tasks.workunit.client.0.smithi050.stderr: git switch - 2024-08-31T04:24:26.346 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-08-31T04:24:26.346 INFO:tasks.workunit.client.0.smithi050.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-08-31T04:24:26.346 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-08-31T04:24:26.346 INFO:tasks.workunit.client.0.smithi050.stderr:HEAD is now at d19e6118f70 Merge PR #44359 into wip-mchangir-testing-20240828.085847-main-debug 2024-08-31T04:24:26.360 DEBUG:teuthology.orchestra.run.smithi050:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-08-31T04:24:26.409 INFO:tasks.workunit.client.0.smithi050.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-08-31T04:24:26.414 INFO:tasks.workunit.client.0.smithi050.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-08-31T04:24:26.414 INFO:tasks.workunit.client.0.smithi050.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-08-31T04:24:27.114 INFO:tasks.workunit.client.0.smithi050.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-08-31T04:24:27.221 INFO:tasks.workunit.client.0.smithi050.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-08-31T04:24:27.288 INFO:tasks.workunit.client.0.smithi050.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-08-31T04:24:27.291 INFO:tasks.workunit.client.0.smithi050.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-08-31T04:24:27.292 INFO:tasks.workunit.client.0.smithi050.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-08-31T04:24:27.293 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:24:27 smithi133 ceph-mon[22177]: pgmap v413: 97 pgs: 97 active+clean; 672 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 341 B/s wr, 10 op/s 2024-08-31T04:24:27.357 INFO:tasks.workunit.client.0.smithi050.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-08-31T04:24:27.365 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-08-31T04:24:27.365 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-08-31T04:24:27.401 INFO:tasks.workunit:Running workunits matching suites/blogbench.sh on client.0... 2024-08-31T04:24:27.452 INFO:tasks.workunit:Running workunit suites/blogbench.sh... 2024-08-31T04:24:27.452 DEBUG:teuthology.orchestra.run.smithi050:workunit test suites/blogbench.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=d19e6118f7015f0047264006cb0c873528eb3ae6 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/blogbench.sh 2024-08-31T04:24:27.453 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:24:27 smithi050 ceph-mon[17259]: pgmap v413: 97 pgs: 97 active+clean; 672 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 341 B/s wr, 10 op/s 2024-08-31T04:24:27.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:24:27 smithi177 ceph-mon[22025]: pgmap v413: 97 pgs: 97 active+clean; 672 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 341 B/s wr, 10 op/s 2024-08-31T04:24:29.450 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:24:29 smithi050 ceph-mon[17259]: pgmap v414: 97 pgs: 97 active+clean; 672 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 341 B/s wr, 10 op/s 2024-08-31T04:24:29.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:24:29 smithi177 ceph-mon[22025]: pgmap v414: 97 pgs: 97 active+clean; 672 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 341 B/s wr, 10 op/s 2024-08-31T04:24:29.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:24:29 smithi133 ceph-mon[22177]: pgmap v414: 97 pgs: 97 active+clean; 672 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 341 B/s wr, 10 op/s 2024-08-31T04:24:31.450 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:24:31 smithi050 ceph-mon[17259]: pgmap v415: 97 pgs: 97 active+clean; 672 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 341 B/s wr, 9 op/s 2024-08-31T04:24:31.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:24:31 smithi177 ceph-mon[22025]: pgmap v415: 97 pgs: 97 active+clean; 672 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 341 B/s wr, 9 op/s 2024-08-31T04:24:31.542 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:24:31 smithi133 ceph-mon[22177]: pgmap v415: 97 pgs: 97 active+clean; 672 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 341 B/s wr, 9 op/s 2024-08-31T04:24:33.450 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:24:33 smithi050 ceph-mon[17259]: pgmap v416: 97 pgs: 97 active+clean; 676 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 853 B/s wr, 12 op/s 2024-08-31T04:24:33.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:24:33 smithi177 ceph-mon[22025]: pgmap v416: 97 pgs: 97 active+clean; 676 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 853 B/s wr, 12 op/s 2024-08-31T04:24:33.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:24:33 smithi133 ceph-mon[22177]: pgmap v416: 97 pgs: 97 active+clean; 676 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 853 B/s wr, 12 op/s 2024-08-31T04:24:33.609 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:33.607+0000 7fcffe600640 1 -- 172.21.15.50:0/3814746986 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcff81064c0 msgr2=0x7fcff81088e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:24:33.610 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:33.607+0000 7fcffe600640 1 --2- 172.21.15.50:0/3814746986 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcff81064c0 0x7fcff81088e0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fcfe4009900 tx=0x7fcfe402a3f0 comp rx=0 tx=0).stop 2024-08-31T04:24:33.610 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:33.607+0000 7fcffe600640 1 -- 172.21.15.50:0/3814746986 shutdown_connections 2024-08-31T04:24:33.610 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:33.607+0000 7fcffe600640 1 --2- 172.21.15.50:0/3814746986 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcff8109020 0x7fcff810b530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:33.610 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:33.607+0000 7fcffe600640 1 --2- 172.21.15.50:0/3814746986 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcff81064c0 0x7fcff81088e0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:33.610 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:33.607+0000 7fcffe600640 1 --2- 172.21.15.50:0/3814746986 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcff806b450 0x7fcff8105f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:33.610 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:33.607+0000 7fcffe600640 1 -- 172.21.15.50:0/3814746986 >> 172.21.15.50:0/3814746986 conn(0x7fcff80fdb20 msgr2=0x7fcff80fffd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:24:33.610 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:33.607+0000 7fcffe600640 1 -- 172.21.15.50:0/3814746986 shutdown_connections 2024-08-31T04:24:33.610 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:33.607+0000 7fcffe600640 1 -- 172.21.15.50:0/3814746986 wait complete. 2024-08-31T04:24:33.612 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:33.608+0000 7fcffe600640 1 Processor -- start 2024-08-31T04:24:33.612 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:33.608+0000 7fcffe600640 1 -- start start 2024-08-31T04:24:33.612 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:33.609+0000 7fcffe600640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcff806b450 0x7fcff81035c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:33.612 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:33.609+0000 7fcffe600640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcff81064c0 0x7fcff8101e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:33.612 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:33.609+0000 7fcffe600640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcff8109020 0x7fcff81023c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:33.613 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:33.609+0000 7fcffe600640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fcff810ef20 con 0x7fcff806b450 2024-08-31T04:24:33.613 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:33.609+0000 7fcffe600640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7fcff810eda0 con 0x7fcff8109020 2024-08-31T04:24:33.613 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:33.609+0000 7fcffe600640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fcff810f0a0 con 0x7fcff81064c0 2024-08-31T04:24:33.613 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:33.609+0000 7fcffd200640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcff806b450 0x7fcff81035c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:24:33.613 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:33.609+0000 7fcffd200640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcff806b450 0x7fcff81035c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:55796/0 (socket says 172.21.15.50:55796) 2024-08-31T04:24:33.613 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:33.609+0000 7fcffd200640 1 -- 172.21.15.50:0/4065205208 learned_addr learned my addr 172.21.15.50:0/4065205208 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:24:33.613 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:33.609+0000 7fcff7e00640 1 --2- 172.21.15.50:0/4065205208 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcff81064c0 0x7fcff8101e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:24:33.613 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:33.609+0000 7fcffdc00640 1 --2- 172.21.15.50:0/4065205208 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcff8109020 0x7fcff81023c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:24:33.613 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:33.609+0000 7fcffd200640 1 -- 172.21.15.50:0/4065205208 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcff81064c0 msgr2=0x7fcff8101e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:24:33.613 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:33.609+0000 7fcffd200640 1 --2- 172.21.15.50:0/4065205208 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcff81064c0 0x7fcff8101e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:33.613 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:33.609+0000 7fcffd200640 1 -- 172.21.15.50:0/4065205208 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcff8109020 msgr2=0x7fcff81023c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:24:33.613 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:33.609+0000 7fcffd200640 1 --2- 172.21.15.50:0/4065205208 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcff8109020 0x7fcff81023c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:33.613 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:33.609+0000 7fcffd200640 1 -- 172.21.15.50:0/4065205208 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcff8102af0 con 0x7fcff806b450 2024-08-31T04:24:33.614 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:33.610+0000 7fcffd200640 1 --2- 172.21.15.50:0/4065205208 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcff806b450 0x7fcff81035c0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fcfec00e9f0 tx=0x7fcfec00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:24:33.614 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:33.610+0000 7fcff5600640 1 -- 172.21.15.50:0/4065205208 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfec00cd80 con 0x7fcff806b450 2024-08-31T04:24:33.614 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:33.610+0000 7fcff5600640 1 -- 172.21.15.50:0/4065205208 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcfec0054d0 con 0x7fcff806b450 2024-08-31T04:24:33.614 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:33.610+0000 7fcffe600640 1 -- 172.21.15.50:0/4065205208 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcff81a3bb0 con 0x7fcff806b450 2024-08-31T04:24:33.614 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:33.610+0000 7fcff5600640 1 -- 172.21.15.50:0/4065205208 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfec010690 con 0x7fcff806b450 2024-08-31T04:24:33.614 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:33.610+0000 7fcffe600640 1 -- 172.21.15.50:0/4065205208 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcff81a4070 con 0x7fcff806b450 2024-08-31T04:24:33.615 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:33.613+0000 7fd006c79740 1 Processor -- start 2024-08-31T04:24:33.616 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:33.613+0000 7fd006c79740 1 -- start start 2024-08-31T04:24:33.616 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:33.613+0000 7fd006c79740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5647007781b0 0x564700b1dfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:33.617 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:33.613+0000 7fd006c79740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56470074f2f0 0x564700b1e610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:33.617 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:33.613+0000 7fd006c79740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5647007574d0 0x564700b1f160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:33.617 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:33.613+0000 7fcff5600640 1 -- 172.21.15.50:0/4065205208 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 18) ==== 152577+0+0 (secure 0 0 0) 0x7fcfec004e90 con 0x7fcff806b450 2024-08-31T04:24:33.617 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:33.614+0000 7fd006c79740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x564700a90f70 con 0x5647007574d0 2024-08-31T04:24:33.617 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:33.614+0000 7fd006c79740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x564700a80500 con 0x5647007781b0 2024-08-31T04:24:33.617 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:33.614+0000 7fd006c79740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x564700a844b0 con 0x56470074f2f0 2024-08-31T04:24:33.617 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:33.614+0000 7fcff7e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5647007574d0 0x564700b1f160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:24:33.617 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:33.614+0000 7fcffdc00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5647007781b0 0x564700b1dfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:24:33.617 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:33.614+0000 7fcffdc00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5647007781b0 0x564700b1dfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.50:38186/0 (socket says 172.21.15.50:38186) 2024-08-31T04:24:33.617 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:33.614+0000 7fcffdc00640 1 -- 172.21.15.50:0/3092405141 learned_addr learned my addr 172.21.15.50:0/3092405141 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:24:33.617 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:33.614+0000 7fcff7e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5647007574d0 0x564700b1f160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:55802/0 (socket says 172.21.15.50:55802) 2024-08-31T04:24:33.617 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:33.614+0000 7fcffd200640 1 --2- 172.21.15.50:0/3092405141 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56470074f2f0 0x564700b1e610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:24:33.618 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:33.614+0000 7fcffdc00640 1 -- 172.21.15.50:0/3092405141 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56470074f2f0 msgr2=0x564700b1e610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:24:33.618 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:33.614+0000 7fcffdc00640 1 --2- 172.21.15.50:0/3092405141 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56470074f2f0 0x564700b1e610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:33.618 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:33.614+0000 7fcffdc00640 1 -- 172.21.15.50:0/3092405141 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5647007574d0 msgr2=0x564700b1f160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:24:33.618 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:33.614+0000 7fcffdc00640 1 --2- 172.21.15.50:0/3092405141 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5647007574d0 0x564700b1f160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:33.618 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:33.614+0000 7fcffdc00640 1 -- 172.21.15.50:0/3092405141 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564700a3ac10 con 0x5647007781b0 2024-08-31T04:24:33.622 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:33.615+0000 7fcffdc00640 1 --2- 172.21.15.50:0/3092405141 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5647007781b0 0x564700b1dfa0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fcff0009fd0 tx=0x7fcff00118d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bf684820b1108e11 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:24:33.622 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:33.615+0000 7fcfea000640 1 -- 172.21.15.50:0/3092405141 <== mon.2 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcff0004d20 con 0x5647007781b0 2024-08-31T04:24:33.622 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:33.615+0000 7fcfea000640 1 -- 172.21.15.50:0/3092405141 <== mon.2 v2:172.21.15.133:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcff0004050 con 0x5647007781b0 2024-08-31T04:24:33.622 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:33.615+0000 7fcfea000640 1 -- 172.21.15.50:0/3092405141 <== mon.2 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcff0005260 con 0x5647007781b0 2024-08-31T04:24:33.622 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:33.615+0000 7fcff5600640 1 --2- 172.21.15.50:0/4065205208 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fcfe00b4bb0 0x7fcfe00b70c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:33.622 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:33.616+0000 7fcff5600640 1 -- 172.21.15.50:0/4065205208 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8219+0+0 (secure 0 0 0) 0x7fcfec0e5540 con 0x7fcff806b450 2024-08-31T04:24:33.623 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:33.616+0000 7fcffd200640 1 --2- 172.21.15.50:0/4065205208 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fcfe00b4bb0 0x7fcfe00b70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:24:33.623 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:33.616+0000 7fd006c79740 1 -- 172.21.15.50:0/3092405141 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5647007781b0 msgr2=0x564700b1dfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:24:33.623 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:33.616+0000 7fd006c79740 1 --2- 172.21.15.50:0/3092405141 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5647007781b0 0x564700b1dfa0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fcff0009fd0 tx=0x7fcff00118d0 comp rx=0 tx=0).stop 2024-08-31T04:24:33.623 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:33.616+0000 7fd006c79740 1 -- 172.21.15.50:0/3092405141 shutdown_connections 2024-08-31T04:24:33.623 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:33.616+0000 7fd006c79740 1 --2- 172.21.15.50:0/3092405141 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56470074f2f0 0x564700b1e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:33.623 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:33.616+0000 7fd006c79740 1 --2- 172.21.15.50:0/3092405141 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5647007574d0 0x564700b1f160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:33.623 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:33.616+0000 7fd006c79740 1 --2- 172.21.15.50:0/3092405141 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5647007781b0 0x564700b1dfa0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:33.623 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:33.616+0000 7fd006c79740 1 -- 172.21.15.50:0/3092405141 >> 172.21.15.50:0/3092405141 conn(0x56470076c300 msgr2=0x564700b19a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:24:33.623 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:33.616+0000 7fd006c79740 1 -- 172.21.15.50:0/3092405141 shutdown_connections 2024-08-31T04:24:33.623 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:33.616+0000 7fd006c79740 1 -- 172.21.15.50:0/3092405141 wait complete. 2024-08-31T04:24:33.623 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:33.616+0000 7fcffd200640 1 --2- 172.21.15.50:0/4065205208 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fcfe00b4bb0 0x7fcfe00b70c0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fcfec0abeb0 tx=0x7fcfec004a90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:24:33.623 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:33.617+0000 7fd006c79740 1 -- start start 2024-08-31T04:24:33.624 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:33.617+0000 7fd006c79740 1 Processor -- start 2024-08-31T04:24:33.624 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:33.617+0000 7fd006c79740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56470074f2f0 0x564700b27640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:33.624 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:33.617+0000 7fd006c79740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5647007574d0 0x564700b27d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:33.624 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:33.617+0000 7fd006c79740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5647007781b0 0x564700b28870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:33.624 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:33.618+0000 7fd006c79740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x5647009b9ab0 con 0x56470074f2f0 2024-08-31T04:24:33.624 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:33.618+0000 7fd006c79740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x564700a27320 con 0x5647007781b0 2024-08-31T04:24:33.624 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:33.618+0000 7fd006c79740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x564700b1fc80 con 0x5647007574d0 2024-08-31T04:24:33.624 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:33.618+0000 7fd006c79740 10 client.0 _ll_register_callbacks cb 0x564700a2d6a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:24:33.624 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:33.618+0000 7fcffdc00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56470074f2f0 0x564700b27640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:24:33.624 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:33.618+0000 7fcffdc00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56470074f2f0 0x564700b27640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:55806/0 (socket says 172.21.15.50:55806) 2024-08-31T04:24:33.624 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:33.618+0000 7fcffdc00640 1 -- 172.21.15.50:0/2014878849 learned_addr learned my addr 172.21.15.50:0/2014878849 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:24:33.624 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:33.618+0000 7fcff7e00640 1 --2- 172.21.15.50:0/2014878849 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5647007574d0 0x564700b27d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:24:33.625 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:33.618+0000 7fcffdc00640 1 --2- 172.21.15.50:0/2014878849 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5647007781b0 0x564700b28870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:24:33.625 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:33.618+0000 7fcffdc00640 1 -- 172.21.15.50:0/2014878849 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5647007574d0 msgr2=0x564700b27d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:24:33.625 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:33.618+0000 7fcffdc00640 1 --2- 172.21.15.50:0/2014878849 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5647007574d0 0x564700b27d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:33.625 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:33.618+0000 7fcffdc00640 1 -- 172.21.15.50:0/2014878849 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5647007781b0 msgr2=0x564700b28870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:24:33.625 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:33.618+0000 7fcffdc00640 1 --2- 172.21.15.50:0/2014878849 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5647007781b0 0x564700b28870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:33.625 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:33.618+0000 7fcffdc00640 1 -- 172.21.15.50:0/2014878849 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5647007e3790 con 0x56470074f2f0 2024-08-31T04:24:33.625 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:33.619+0000 7fcffdc00640 1 --2- 172.21.15.50:0/2014878849 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56470074f2f0 0x564700b27640 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fcff001b040 tx=0x7fcff0009d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3daeeebad8bb75a0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:24:33.625 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:33.619+0000 7fcfdea00640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-08-31T04:24:33.625 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:33.619+0000 7fcfdea00640 1 -- 172.21.15.50:0/2014878849 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcff0005040 con 0x56470074f2f0 2024-08-31T04:24:33.625 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:33.619+0000 7fcfdea00640 1 -- 172.21.15.50:0/2014878849 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8219+0+0 (secure 0 0 0) 0x7fcff00051e0 con 0x56470074f2f0 2024-08-31T04:24:33.625 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:33.619+0000 7fd006c79740 1 -- 172.21.15.50:0/2014878849 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcff0004050 con 0x56470074f2f0 2024-08-31T04:24:33.625 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:33.619+0000 7fcfdea00640 1 -- 172.21.15.50:0/2014878849 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fcff00053e0 con 0x56470074f2f0 2024-08-31T04:24:33.625 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:33.619+0000 7fd006c79740 10 client.15582 fetch_fsmap learned FSMap version 29 2024-08-31T04:24:33.626 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:33.619+0000 7fd006c79740 1 -- 172.21.15.50:0/2014878849 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x56470085c620 con 0x56470074f2f0 2024-08-31T04:24:33.626 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:33.619+0000 7fcfdea00640 1 -- 172.21.15.50:0/2014878849 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcff0004050 con 0x56470074f2f0 2024-08-31T04:24:33.626 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:33.620+0000 7fcfdea00640 1 -- 172.21.15.50:0/2014878849 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7fcff000fae0 con 0x56470074f2f0 2024-08-31T04:24:33.626 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:33.620+0000 7fd006c79740 10 client.15582 fetch_fsmap finished waiting for FSMap version 29 2024-08-31T04:24:33.626 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:33.620+0000 7fd006c79740 10 client.15582 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T04:24:33.626 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:33.620+0000 7fd006c79740 20 client.15582 populate_metadata read hostname 'smithi050' 2024-08-31T04:24:33.626 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:33.620+0000 7fd006c79740 1 --2- 172.21.15.50:0/2014878849 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x564700736d80 0x564700b34ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:33.626 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:33.620+0000 7fd006c79740 4 client.15582 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T04:24:33.626 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:33.620+0000 7fd006c79740 1 -- 172.21.15.50:0/2014878849 --> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564700a92ec0 con 0x564700736d80 2024-08-31T04:24:33.626 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:33.620+0000 7fcff7e00640 1 --2- 172.21.15.50:0/2014878849 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x564700736d80 0x564700b34ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:24:33.627 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:33.621+0000 7fcff7e00640 1 --2- 172.21.15.50:0/2014878849 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x564700736d80 0x564700b34ba0 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8f47df2e31fd6bcf server_cookie=4677f46840bf2cf1 in_seq=0 out_seq=0 2024-08-31T04:24:33.627 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:33.621+0000 7fcfdea00640 10 client.15582 ms_handle_connect on v2:172.21.15.133:6838/2526402262 2024-08-31T04:24:33.627 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:33.622+0000 7fcfdea00640 1 -- 172.21.15.50:0/2014878849 <== mds.0 v2:172.21.15.133:6838/2526402262 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x564700a92ec0 con 0x564700736d80 2024-08-31T04:24:33.628 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:33.622+0000 7fcfdea00640 10 client.15582 handle_command_reply: tid=0 2024-08-31T04:24:33.628 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:33.622+0000 7fd006c79740 1 client.15582 shutdown 2024-08-31T04:24:33.628 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:33.622+0000 7fd006c79740 1 -- 172.21.15.50:0/2014878849 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56470074f2f0 msgr2=0x564700b27640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:24:33.628 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:33.622+0000 7fd006c79740 1 --2- 172.21.15.50:0/2014878849 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56470074f2f0 0x564700b27640 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fcff001b040 tx=0x7fcff0009d60 comp rx=0 tx=0).stop 2024-08-31T04:24:33.628 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:33.622+0000 7fd006c79740 1 -- 172.21.15.50:0/2014878849 shutdown_connections 2024-08-31T04:24:33.628 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:33.622+0000 7fd006c79740 1 --2- 172.21.15.50:0/2014878849 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x564700736d80 0x564700b34ba0 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:33.628 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:33.622+0000 7fd006c79740 1 --2- 172.21.15.50:0/2014878849 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5647007574d0 0x564700b27d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:33.628 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:33.622+0000 7fd006c79740 1 --2- 172.21.15.50:0/2014878849 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5647007781b0 0x564700b28870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:33.628 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:33.622+0000 7fcfdea00640 0 client.15582 ms_handle_reset on v2:172.21.15.133:6838/2526402262 2024-08-31T04:24:33.628 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:33.622+0000 7fd006c79740 1 --2- 172.21.15.50:0/2014878849 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56470074f2f0 0x564700b27640 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:33.628 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:33.622+0000 7fd006c79740 1 -- 172.21.15.50:0/2014878849 >> 172.21.15.50:0/2014878849 conn(0x56470076c300 msgr2=0x564700b17f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:24:33.628 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:33.622+0000 7fd006c79740 1 -- 172.21.15.50:0/2014878849 shutdown_connections 2024-08-31T04:24:33.629 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:33.622+0000 7fd006c79740 1 -- 172.21.15.50:0/2014878849 wait complete. 2024-08-31T04:24:33.629 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:33.622+0000 7fd006c79740 20 client.15582 trim_cache size 0 max 16384 2024-08-31T04:24:33.640 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:33.638+0000 7fd006c79740 1 Processor -- start 2024-08-31T04:24:33.640 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:33.638+0000 7fd006c79740 1 -- start start 2024-08-31T04:24:33.640 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:33.638+0000 7fd006c79740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56470074f2f0 0x564700b25b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:33.641 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:33.638+0000 7fd006c79740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5647007574d0 0x564700b26090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:33.641 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:33.638+0000 7fd006c79740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5647007781b0 0x564700b18f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:33.641 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:33.638+0000 7fd006c79740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fcff81acd10 con 0x5647007574d0 2024-08-31T04:24:33.641 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:33.638+0000 7fd006c79740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7fcff81ae850 con 0x56470074f2f0 2024-08-31T04:24:33.641 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:33.638+0000 7fd006c79740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fcff81ad3e0 con 0x5647007781b0 2024-08-31T04:24:33.641 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:33.638+0000 7fcff7e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5647007574d0 0x564700b26090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:24:33.641 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:33.638+0000 7fcff7e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5647007574d0 0x564700b26090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:55822/0 (socket says 172.21.15.50:55822) 2024-08-31T04:24:33.641 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:33.638+0000 7fcff7e00640 1 -- 172.21.15.50:0/2800593980 learned_addr learned my addr 172.21.15.50:0/2800593980 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:24:33.641 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:33.638+0000 7fcffdc00640 1 --2- 172.21.15.50:0/2800593980 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56470074f2f0 0x564700b25b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:24:33.642 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:33.638+0000 7fcff7e00640 1 -- 172.21.15.50:0/2800593980 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5647007781b0 msgr2=0x564700b18f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:24:33.643 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:33.638+0000 7fcffdc00640 1 --2- 172.21.15.50:0/2800593980 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5647007781b0 0x564700b18f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:24:33.643 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:33.638+0000 7fcff7e00640 1 --2- 172.21.15.50:0/2800593980 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5647007781b0 0x564700b18f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:33.643 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:33.639+0000 7fcff7e00640 1 -- 172.21.15.50:0/2800593980 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56470074f2f0 msgr2=0x564700b25b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:24:33.643 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:33.639+0000 7fcff7e00640 1 --2- 172.21.15.50:0/2800593980 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56470074f2f0 0x564700b25b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:33.643 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:33.639+0000 7fcff7e00640 1 -- 172.21.15.50:0/2800593980 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564700b2fb10 con 0x5647007574d0 2024-08-31T04:24:33.643 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:33.639+0000 7fcffdc00640 1 --2- 172.21.15.50:0/2800593980 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5647007781b0 0x564700b18f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T04:24:33.643 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:33.639+0000 7fcff7e00640 1 --2- 172.21.15.50:0/2800593980 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5647007574d0 0x564700b26090 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fcfe40096c0 tx=0x7fcfe4004440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68beeac0795210d5 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:24:33.643 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:33.639+0000 7fcfe9600640 1 -- 172.21.15.50:0/2800593980 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfe4035040 con 0x5647007574d0 2024-08-31T04:24:33.643 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:33.639+0000 7fcfe9600640 1 -- 172.21.15.50:0/2800593980 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcfe4003ca0 con 0x5647007574d0 2024-08-31T04:24:33.643 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:33.639+0000 7fcfe9600640 1 -- 172.21.15.50:0/2800593980 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfe4031c30 con 0x5647007574d0 2024-08-31T04:24:33.643 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:33.640+0000 7fd006c79740 1 -- 172.21.15.50:0/2800593980 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5647007574d0 msgr2=0x564700b26090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:24:33.643 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:33.640+0000 7fd006c79740 1 --2- 172.21.15.50:0/2800593980 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5647007574d0 0x564700b26090 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fcfe40096c0 tx=0x7fcfe4004440 comp rx=0 tx=0).stop 2024-08-31T04:24:33.643 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:33.640+0000 7fd006c79740 1 -- 172.21.15.50:0/2800593980 shutdown_connections 2024-08-31T04:24:33.644 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:33.640+0000 7fd006c79740 1 --2- 172.21.15.50:0/2800593980 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5647007781b0 0x564700b18f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:33.644 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:33.640+0000 7fd006c79740 1 --2- 172.21.15.50:0/2800593980 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5647007574d0 0x564700b26090 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:33.644 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:33.640+0000 7fd006c79740 1 --2- 172.21.15.50:0/2800593980 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56470074f2f0 0x564700b25b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:33.644 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:33.640+0000 7fd006c79740 1 -- 172.21.15.50:0/2800593980 >> 172.21.15.50:0/2800593980 conn(0x56470076c300 msgr2=0x564700b1df40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:24:33.644 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:33.640+0000 7fd006c79740 1 -- 172.21.15.50:0/2800593980 shutdown_connections 2024-08-31T04:24:33.644 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:33.640+0000 7fd006c79740 1 -- 172.21.15.50:0/2800593980 wait complete. 2024-08-31T04:24:33.644 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:33.640+0000 7fd006c79740 1 -- start start 2024-08-31T04:24:33.644 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:33.641+0000 7fd006c79740 1 Processor -- start 2024-08-31T04:24:33.646 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:33.641+0000 7fd006c79740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56470074f2f0 0x564700b2f140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:33.647 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:33.641+0000 7fd006c79740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5647007574d0 0x564700b2de00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:33.647 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:33.641+0000 7fd006c79740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5647007781b0 0x564700b2e340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:33.647 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:33.641+0000 7fd006c79740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fcff81ae180 con 0x5647007781b0 2024-08-31T04:24:33.647 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:33.641+0000 7fd006c79740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7fcff81adab0 con 0x5647007574d0 2024-08-31T04:24:33.647 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:33.641+0000 7fd006c79740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fcff81aacf0 con 0x56470074f2f0 2024-08-31T04:24:33.647 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:33.641+0000 7fd006c79740 10 client.0 _ll_register_callbacks cb 0x7fcff0009ea0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:24:33.647 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:33.641+0000 7fcffdc00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5647007781b0 0x564700b2e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:24:33.647 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:33.641+0000 7fcff7e00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5647007574d0 0x564700b2de00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:24:33.647 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:33.641+0000 7fcffdc00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5647007781b0 0x564700b2e340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:55834/0 (socket says 172.21.15.50:55834) 2024-08-31T04:24:33.647 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:33.641+0000 7fcff7e00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5647007574d0 0x564700b2de00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.50:38218/0 (socket says 172.21.15.50:38218) 2024-08-31T04:24:33.647 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:33.641+0000 7fcffdc00640 1 -- 172.21.15.50:0/2708600971 learned_addr learned my addr 172.21.15.50:0/2708600971 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:24:33.647 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:33.642+0000 7fcffdc00640 1 --2- 172.21.15.50:0/2708600971 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56470074f2f0 0x564700b2f140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:24:33.648 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:33.642+0000 7fcff7e00640 1 -- 172.21.15.50:0/2708600971 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56470074f2f0 msgr2=0x564700b2f140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:24:33.648 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:33.642+0000 7fcff7e00640 1 --2- 172.21.15.50:0/2708600971 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56470074f2f0 0x564700b2f140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:33.648 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:33.642+0000 7fcff7e00640 1 -- 172.21.15.50:0/2708600971 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5647007781b0 msgr2=0x564700b2e340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:24:33.648 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:33.642+0000 7fcff7e00640 1 --2- 172.21.15.50:0/2708600971 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5647007781b0 0x564700b2e340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:33.648 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:33.642+0000 7fcff7e00640 1 -- 172.21.15.50:0/2708600971 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564700b2e9b0 con 0x5647007574d0 2024-08-31T04:24:33.648 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:33.642+0000 7fcffdc00640 1 --2- 172.21.15.50:0/2708600971 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56470074f2f0 0x564700b2f140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:24:33.648 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:33.642+0000 7fcff7e00640 1 --2- 172.21.15.50:0/2708600971 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5647007574d0 0x564700b2de00 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fcfe402a910 tx=0x7fcfe402a3f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9492d5aa15ca2515 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:24:33.648 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:33.642+0000 7fcfdea00640 10 client.0 ms_handle_connect on v2:172.21.15.133:3300/0 2024-08-31T04:24:33.648 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:33.643+0000 7fcfdea00640 1 -- 172.21.15.50:0/2708600971 <== mon.2 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfe4035040 con 0x5647007574d0 2024-08-31T04:24:33.648 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:33.643+0000 7fd006c79740 1 -- 172.21.15.50:0/2708600971 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcfe4003ca0 con 0x5647007574d0 2024-08-31T04:24:33.648 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:33.643+0000 7fcfdea00640 1 -- 172.21.15.50:0/2708600971 <== mon.2 v2:172.21.15.133:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8219+0+0 (secure 0 0 0) 0x7fcfe40319b0 con 0x5647007574d0 2024-08-31T04:24:33.648 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:33.643+0000 7fcfdea00640 1 -- 172.21.15.50:0/2708600971 <== mon.2 v2:172.21.15.133:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fcfe4031bb0 con 0x5647007574d0 2024-08-31T04:24:33.648 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:33.643+0000 7fd006c79740 10 client.25598 fetch_fsmap learned FSMap version 29 2024-08-31T04:24:33.649 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:33.643+0000 7fd006c79740 1 -- 172.21.15.50:0/2708600971 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x564700b2d770 con 0x5647007574d0 2024-08-31T04:24:33.649 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:33.643+0000 7fcfdea00640 1 -- 172.21.15.50:0/2708600971 <== mon.2 v2:172.21.15.133:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcfe4003ca0 con 0x5647007574d0 2024-08-31T04:24:33.649 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:33.643+0000 7fcfdea00640 1 -- 172.21.15.50:0/2708600971 <== mon.2 v2:172.21.15.133:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7fcfe4046730 con 0x5647007574d0 2024-08-31T04:24:33.649 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:33.643+0000 7fd006c79740 10 client.25598 fetch_fsmap finished waiting for FSMap version 29 2024-08-31T04:24:33.649 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:33.643+0000 7fd006c79740 10 client.25598 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T04:24:33.649 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:33.643+0000 7fd006c79740 20 client.25598 populate_metadata read hostname 'smithi050' 2024-08-31T04:24:33.649 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:33.643+0000 7fd006c79740 1 --2- 172.21.15.50:0/2708600971 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x56470070c1c0 0x564700ba1cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:33.649 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:33.643+0000 7fd006c79740 4 client.25598 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-31T04:24:33.649 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:33.644+0000 7fd006c79740 1 -- 172.21.15.50:0/2708600971 --> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] -- command(tid 0: {"prefix": "flush journal"}) -- 0x564700a8e960 con 0x56470070c1c0 2024-08-31T04:24:33.649 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:33.644+0000 7fcffdc00640 1 --2- 172.21.15.50:0/2708600971 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x56470070c1c0 0x564700ba1cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:24:33.649 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:33.645+0000 7fcffdc00640 1 --2- 172.21.15.50:0/2708600971 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x56470070c1c0 0x564700ba1cd0 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9de02cb5d9b07c18 server_cookie=9e76fc9a31aa8240 in_seq=0 out_seq=0 2024-08-31T04:24:33.649 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:33.645+0000 7fcfdea00640 10 client.25598 ms_handle_connect on v2:172.21.15.133:6838/2526402262 2024-08-31T04:24:33.651 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:33.648+0000 7fcfdea00640 1 -- 172.21.15.50:0/2708600971 <== mds.0 v2:172.21.15.133:6838/2526402262 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x564700a8e960 con 0x56470070c1c0 2024-08-31T04:24:33.651 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:33.648+0000 7fcfdea00640 10 client.25598 handle_command_reply: tid=0 2024-08-31T04:24:33.651 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:33.648+0000 7fd006c79740 1 client.25598 shutdown 2024-08-31T04:24:33.651 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:33.649+0000 7fd006c79740 1 -- 172.21.15.50:0/2708600971 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5647007574d0 msgr2=0x564700b2de00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:24:33.651 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:33.649+0000 7fd006c79740 1 --2- 172.21.15.50:0/2708600971 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5647007574d0 0x564700b2de00 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fcfe402a910 tx=0x7fcfe402a3f0 comp rx=0 tx=0).stop 2024-08-31T04:24:33.651 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:33.649+0000 7fd006c79740 1 -- 172.21.15.50:0/2708600971 shutdown_connections 2024-08-31T04:24:33.652 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:33.649+0000 7fd006c79740 1 --2- 172.21.15.50:0/2708600971 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x56470070c1c0 0x564700ba1cd0 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:33.652 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:33.649+0000 7fd006c79740 1 --2- 172.21.15.50:0/2708600971 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5647007781b0 0x564700b2e340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:33.652 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:33.649+0000 7fcfdea00640 0 client.25598 ms_handle_reset on v2:172.21.15.133:6838/2526402262 2024-08-31T04:24:33.652 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:33.649+0000 7fd006c79740 1 --2- 172.21.15.50:0/2708600971 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5647007574d0 0x564700b2de00 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:33.652 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:33.649+0000 7fd006c79740 1 --2- 172.21.15.50:0/2708600971 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56470074f2f0 0x564700b2f140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:33.652 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:33.649+0000 7fd006c79740 1 -- 172.21.15.50:0/2708600971 >> 172.21.15.50:0/2708600971 conn(0x56470076c300 msgr2=0x564700b1df40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:24:33.652 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:33.649+0000 7fd006c79740 1 -- 172.21.15.50:0/2708600971 shutdown_connections 2024-08-31T04:24:33.652 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:33.649+0000 7fd006c79740 1 -- 172.21.15.50:0/2708600971 wait complete. 2024-08-31T04:24:33.652 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:33.649+0000 7fd006c79740 20 client.25598 trim_cache size 0 max 16384 2024-08-31T04:24:33.652 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout:{ 2024-08-31T04:24:33.653 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout: "message": "", 2024-08-31T04:24:33.653 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout: "return_code": 0 2024-08-31T04:24:33.653 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout:} 2024-08-31T04:24:33.653 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:33.650+0000 7fcffe600640 1 -- 172.21.15.50:0/4065205208 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fcfe00b4bb0 msgr2=0x7fcfe00b70c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:24:33.654 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:33.650+0000 7fcffe600640 1 --2- 172.21.15.50:0/4065205208 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fcfe00b4bb0 0x7fcfe00b70c0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fcfec0abeb0 tx=0x7fcfec004a90 comp rx=0 tx=0).stop 2024-08-31T04:24:33.654 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:33.650+0000 7fcffe600640 1 -- 172.21.15.50:0/4065205208 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcff806b450 msgr2=0x7fcff81035c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:24:33.654 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:33.650+0000 7fcffe600640 1 --2- 172.21.15.50:0/4065205208 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcff806b450 0x7fcff81035c0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fcfec00e9f0 tx=0x7fcfec00edf0 comp rx=0 tx=0).stop 2024-08-31T04:24:33.654 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:33.650+0000 7fcffe600640 1 -- 172.21.15.50:0/4065205208 shutdown_connections 2024-08-31T04:24:33.654 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:33.650+0000 7fcffe600640 1 --2- 172.21.15.50:0/4065205208 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fcfe00b4bb0 0x7fcfe00b70c0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:33.654 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:33.650+0000 7fcffe600640 1 --2- 172.21.15.50:0/4065205208 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcff81064c0 0x7fcff8101e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:33.654 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:33.650+0000 7fcffe600640 1 --2- 172.21.15.50:0/4065205208 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcff8109020 0x7fcff81023c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:33.654 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:33.650+0000 7fcffe600640 1 --2- 172.21.15.50:0/4065205208 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcff806b450 0x7fcff81035c0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:33.654 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:33.650+0000 7fcffe600640 1 -- 172.21.15.50:0/4065205208 >> 172.21.15.50:0/4065205208 conn(0x7fcff80fdb20 msgr2=0x7fcff81049d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:24:33.654 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:33.650+0000 7fcffe600640 1 -- 172.21.15.50:0/4065205208 shutdown_connections 2024-08-31T04:24:33.654 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:33.650+0000 7fcffe600640 1 -- 172.21.15.50:0/4065205208 wait complete. 2024-08-31T04:24:35.450 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:24:35 smithi050 ceph-mon[17259]: pgmap v417: 97 pgs: 97 active+clean; 676 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 597 B/s wr, 8 op/s 2024-08-31T04:24:35.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:24:35 smithi177 ceph-mon[22025]: pgmap v417: 97 pgs: 97 active+clean; 676 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 597 B/s wr, 8 op/s 2024-08-31T04:24:35.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:24:35 smithi133 ceph-mon[22177]: pgmap v417: 97 pgs: 97 active+clean; 676 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 597 B/s wr, 8 op/s 2024-08-31T04:24:37.450 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:24:37 smithi050 ceph-mon[17259]: pgmap v418: 97 pgs: 97 active+clean; 676 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 597 B/s wr, 10 op/s 2024-08-31T04:24:37.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:24:37 smithi177 ceph-mon[22025]: pgmap v418: 97 pgs: 97 active+clean; 676 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 597 B/s wr, 10 op/s 2024-08-31T04:24:37.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:24:37 smithi133 ceph-mon[22177]: pgmap v418: 97 pgs: 97 active+clean; 676 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 597 B/s wr, 10 op/s 2024-08-31T04:24:39.450 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:24:39 smithi050 ceph-mon[17259]: pgmap v419: 97 pgs: 97 active+clean; 677 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 767 B/s wr, 11 op/s 2024-08-31T04:24:39.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:24:39 smithi177 ceph-mon[22025]: pgmap v419: 97 pgs: 97 active+clean; 677 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 767 B/s wr, 11 op/s 2024-08-31T04:24:39.542 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:24:39 smithi133 ceph-mon[22177]: pgmap v419: 97 pgs: 97 active+clean; 677 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 767 B/s wr, 11 op/s 2024-08-31T04:24:39.697 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 058d9fc6-674f-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-31T04:24:40.092 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:24:40.719 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:40.716+0000 7f9c8f000640 1 -- 172.21.15.50:0/2740085301 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9c88109240 msgr2=0x7f9c88109650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:24:40.719 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:40.716+0000 7f9c8f000640 1 --2- 172.21.15.50:0/2740085301 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9c88109240 0x7f9c88109650 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f9c74009900 tx=0x7f9c7402a410 comp rx=0 tx=0).stop 2024-08-31T04:24:40.719 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:40.716+0000 7f9c8f000640 1 -- 172.21.15.50:0/2740085301 shutdown_connections 2024-08-31T04:24:40.719 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:40.716+0000 7f9c8f000640 1 --2- 172.21.15.50:0/2740085301 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9c88109b90 0x7f9c881103c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:40.719 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:40.716+0000 7f9c8f000640 1 --2- 172.21.15.50:0/2740085301 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9c88109240 0x7f9c88109650 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:40.719 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:40.716+0000 7f9c8f000640 1 --2- 172.21.15.50:0/2740085301 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9c88103900 0x7f9c88103d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:40.719 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:40.716+0000 7f9c8f000640 1 -- 172.21.15.50:0/2740085301 >> 172.21.15.50:0/2740085301 conn(0x7f9c8807b5f0 msgr2=0x7f9c8807ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:24:40.719 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:40.717+0000 7f9c8f000640 1 -- 172.21.15.50:0/2740085301 shutdown_connections 2024-08-31T04:24:40.719 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:40.717+0000 7f9c8f000640 1 -- 172.21.15.50:0/2740085301 wait complete. 2024-08-31T04:24:40.719 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:40.718+0000 7f9c8f000640 1 Processor -- start 2024-08-31T04:24:40.719 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:40.718+0000 7f9c8f000640 1 -- start start 2024-08-31T04:24:40.721 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:40.718+0000 7f9c8f000640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9c88103900 0x7f9c8819c460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:40.721 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:40.718+0000 7f9c8f000640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9c88109240 0x7f9c8819ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:40.721 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:40.718+0000 7f9c8f000640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9c88109b90 0x7f9c881a1ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:40.721 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:40.718+0000 7f9c8f000640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f9c88113850 con 0x7f9c88103900 2024-08-31T04:24:40.721 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:40.718+0000 7f9c8f000640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f9c881136d0 con 0x7f9c88109240 2024-08-31T04:24:40.721 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:40.718+0000 7f9c8f000640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f9c881139d0 con 0x7f9c88109b90 2024-08-31T04:24:40.721 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:40.718+0000 7f9c87e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9c88103900 0x7f9c8819c460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:24:40.722 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:40.718+0000 7f9c87e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9c88103900 0x7f9c8819c460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:55858/0 (socket says 172.21.15.50:55858) 2024-08-31T04:24:40.722 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:40.718+0000 7f9c87e00640 1 -- 172.21.15.50:0/3197947725 learned_addr learned my addr 172.21.15.50:0/3197947725 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:24:40.722 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:40.719+0000 7f9c8d000640 1 --2- 172.21.15.50:0/3197947725 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9c88109b90 0x7f9c881a1ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:24:40.722 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:40.719+0000 7f9c87400640 1 --2- 172.21.15.50:0/3197947725 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9c88109240 0x7f9c8819ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:24:40.722 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:40.719+0000 7f9c87e00640 1 -- 172.21.15.50:0/3197947725 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9c88109b90 msgr2=0x7f9c881a1ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:24:40.722 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:40.719+0000 7f9c87e00640 1 --2- 172.21.15.50:0/3197947725 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9c88109b90 0x7f9c881a1ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:40.722 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:40.719+0000 7f9c87e00640 1 -- 172.21.15.50:0/3197947725 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9c88109240 msgr2=0x7f9c8819ca00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:24:40.722 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:40.719+0000 7f9c87e00640 1 --2- 172.21.15.50:0/3197947725 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9c88109240 0x7f9c8819ca00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:40.722 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:40.719+0000 7f9c87e00640 1 -- 172.21.15.50:0/3197947725 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c881a23d0 con 0x7f9c88103900 2024-08-31T04:24:40.722 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:40.719+0000 7f9c87e00640 1 --2- 172.21.15.50:0/3197947725 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9c88103900 0x7f9c8819c460 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f9c7800e9f0 tx=0x7f9c7800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:24:40.722 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:40.720+0000 7f9c84c00640 1 -- 172.21.15.50:0/3197947725 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c7800cd80 con 0x7f9c88103900 2024-08-31T04:24:40.722 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:40.720+0000 7f9c84c00640 1 -- 172.21.15.50:0/3197947725 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9c780108e0 con 0x7f9c88103900 2024-08-31T04:24:40.722 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:40.720+0000 7f9c8f000640 1 -- 172.21.15.50:0/3197947725 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9c881a26c0 con 0x7f9c88103900 2024-08-31T04:24:40.723 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:40.720+0000 7f9c84c00640 1 -- 172.21.15.50:0/3197947725 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c78018980 con 0x7f9c88103900 2024-08-31T04:24:40.723 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:40.720+0000 7f9c8f000640 1 -- 172.21.15.50:0/3197947725 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9c881a8e20 con 0x7f9c88103900 2024-08-31T04:24:40.723 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:40.721+0000 7f9c8f000640 1 -- 172.21.15.50:0/3197947725 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9c88103d10 con 0x7f9c88103900 2024-08-31T04:24:40.724 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:40.723+0000 7f9c84c00640 1 -- 172.21.15.50:0/3197947725 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 18) ==== 152577+0+0 (secure 0 0 0) 0x7f9c78010430 con 0x7f9c88103900 2024-08-31T04:24:40.726 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:40.725+0000 7f9c84c00640 1 --2- 172.21.15.50:0/3197947725 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f9c6c0b4b30 0x7f9c6c0b7040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:40.726 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:40.725+0000 7f9c84c00640 1 -- 172.21.15.50:0/3197947725 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8219+0+0 (secure 0 0 0) 0x7f9c780e5980 con 0x7f9c88103900 2024-08-31T04:24:40.726 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:40.725+0000 7f9c87400640 1 --2- 172.21.15.50:0/3197947725 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f9c6c0b4b30 0x7f9c6c0b7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:24:40.727 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:40.726+0000 7f9c87400640 1 --2- 172.21.15.50:0/3197947725 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f9c6c0b4b30 0x7f9c6c0b7040 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f9c74009230 tx=0x7f9c74031400 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:24:40.728 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:40.727+0000 7f9c84c00640 1 -- 172.21.15.50:0/3197947725 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f9c780ac410 con 0x7f9c88103900 2024-08-31T04:24:40.963 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:40.962+0000 7f9c8f000640 1 -- 172.21.15.50:0/3197947725 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9c881a9110 con 0x7f9c88103900 2024-08-31T04:24:40.964 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:40.963+0000 7f9c84c00640 1 -- 172.21.15.50:0/3197947725 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+11983 (secure 0 0 0) 0x7f9c780b0bd0 con 0x7f9c88103900 2024-08-31T04:24:40.964 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-08-31T04:24:40.964 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":29,"btime":"2024-08-31T04:23:00:578141+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14622,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/1565557530","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":1565557530},{"type":"v1","addr":"172.21.15.50:6835","nonce":1565557530}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14634,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6837/2660185946","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6836","nonce":2660185946},{"type":"v1","addr":"172.21.15.50:6837","nonce":2660185946}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":29,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-31T04:20:44.140709+0000","modified":"2024-08-31T04:22:59.912983+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24695,"mds_1":24691,"mds_2":24667,"mds_3":24656,"mds_4":24652},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14676":{"gid":14676,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.50:6839/2105228685","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6838","nonce":2105228685},{"type":"v1","addr":"172.21.15.50:6839","nonce":2105228685}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24590":{"gid":24590,"name":"k","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.133:6833/4283603962","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6832","nonce":4283603962},{"type":"v1","addr":"172.21.15.133:6833","nonce":4283603962}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24601":{"gid":24601,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.177:6833/1237129793","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":1237129793},{"type":"v1","addr":"172.21.15.177:6833","nonce":1237129793}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24626":{"gid":24626,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.133:6835/3637799701","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":3637799701},{"type":"v1","addr":"172.21.15.133:6835","nonce":3637799701}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24640":{"gid":24640,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.177:6835/599392457","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6834","nonce":599392457},{"type":"v1","addr":"172.21.15.177:6835","nonce":599392457}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24652":{"gid":24652,"name":"c","rank":4,"incarnation":26,"state":"up:active","state_seq":13,"addr":"172.21.15.177:6837/2159859285","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6836","nonce":2159859285},{"type":"v1","addr":"172.21.15.177:6837","nonce":2159859285}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24656":{"gid":24656,"name":"h","rank":3,"incarnation":22,"state":"up:active","state_seq":12,"addr":"172.21.15.133:6837/4014853202","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6836","nonce":4014853202},{"type":"v1","addr":"172.21.15.133:6837","nonce":4014853202}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24667":{"gid":24667,"name":"i","rank":2,"incarnation":20,"state":"up:active","state_seq":10,"addr":"172.21.15.177:6839/3600081752","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6838","nonce":3600081752},{"type":"v1","addr":"172.21.15.177:6839","nonce":3600081752}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24691":{"gid":24691,"name":"a","rank":1,"incarnation":18,"state":"up:active","state_seq":8,"addr":"172.21.15.50:6841/575209862","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6840","nonce":575209862},{"type":"v1","addr":"172.21.15.50:6841","nonce":575209862}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24695":{"gid":24695,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.133:6839/2526402262","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6838","nonce":2526402262},{"type":"v1","addr":"172.21.15.133:6839","nonce":2526402262}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24695,"qdb_cluster":[24652,24691,24656,24695,24667]},"id":1}]} 2024-08-31T04:24:40.965 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 29 2024-08-31T04:24:40.966 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:40.965+0000 7f9c8f000640 1 -- 172.21.15.50:0/3197947725 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f9c6c0b4b30 msgr2=0x7f9c6c0b7040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:24:40.966 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:40.965+0000 7f9c8f000640 1 --2- 172.21.15.50:0/3197947725 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f9c6c0b4b30 0x7f9c6c0b7040 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f9c74009230 tx=0x7f9c74031400 comp rx=0 tx=0).stop 2024-08-31T04:24:40.967 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:40.965+0000 7f9c8f000640 1 -- 172.21.15.50:0/3197947725 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9c88103900 msgr2=0x7f9c8819c460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:24:40.967 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:40.965+0000 7f9c8f000640 1 --2- 172.21.15.50:0/3197947725 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9c88103900 0x7f9c8819c460 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f9c7800e9f0 tx=0x7f9c7800eeb0 comp rx=0 tx=0).stop 2024-08-31T04:24:40.967 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:40.965+0000 7f9c8f000640 1 -- 172.21.15.50:0/3197947725 shutdown_connections 2024-08-31T04:24:40.967 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:40.965+0000 7f9c8f000640 1 --2- 172.21.15.50:0/3197947725 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f9c6c0b4b30 0x7f9c6c0b7040 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:40.967 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:40.965+0000 7f9c8f000640 1 --2- 172.21.15.50:0/3197947725 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9c88109b90 0x7f9c881a1ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:40.967 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:40.965+0000 7f9c8f000640 1 --2- 172.21.15.50:0/3197947725 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9c88109240 0x7f9c8819ca00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:40.967 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:40.965+0000 7f9c8f000640 1 --2- 172.21.15.50:0/3197947725 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9c88103900 0x7f9c8819c460 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:40.967 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:40.965+0000 7f9c8f000640 1 -- 172.21.15.50:0/3197947725 >> 172.21.15.50:0/3197947725 conn(0x7f9c8807b5f0 msgr2=0x7f9c881070b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:24:40.967 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:40.965+0000 7f9c8f000640 1 -- 172.21.15.50:0/3197947725 shutdown_connections 2024-08-31T04:24:40.967 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:40.965+0000 7f9c8f000640 1 -- 172.21.15.50:0/3197947725 wait complete. 2024-08-31T04:24:41.313 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:24:41 smithi050 ceph-mon[17259]: pgmap v420: 97 pgs: 97 active+clean; 677 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 767 B/s wr, 9 op/s 2024-08-31T04:24:41.313 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:24:41 smithi050 ceph-mon[17259]: from='client.? 172.21.15.50:0/3197947725' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T04:24:41.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:24:41 smithi177 ceph-mon[22025]: pgmap v420: 97 pgs: 97 active+clean; 677 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 767 B/s wr, 9 op/s 2024-08-31T04:24:41.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:24:41 smithi177 ceph-mon[22025]: from='client.? 172.21.15.50:0/3197947725' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T04:24:41.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:24:41 smithi133 ceph-mon[22177]: pgmap v420: 97 pgs: 97 active+clean; 677 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 767 B/s wr, 9 op/s 2024-08-31T04:24:41.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:24:41 smithi133 ceph-mon[22177]: from='client.? 172.21.15.50:0/3197947725' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T04:24:41.802 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24695 quiesce db --set-id a406ef21 --release --await' 2024-08-31T04:24:41.802 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 058d9fc6-674f-11ef-bcd4-c7b262605968 -- timeout 105 ceph tell mds.24695 quiesce db --set-id a406ef21 --release --await 2024-08-31T04:24:42.182 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:24:42.812 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:42.810+0000 7fbebc400640 1 -- 172.21.15.50:0/3996157729 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbeb4109240 msgr2=0x7fbeb4109650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:24:42.812 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:42.810+0000 7fbebc400640 1 --2- 172.21.15.50:0/3996157729 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbeb4109240 0x7fbeb4109650 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fbea0009900 tx=0x7fbea002a410 comp rx=0 tx=0).stop 2024-08-31T04:24:42.812 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:42.810+0000 7fbebc400640 1 -- 172.21.15.50:0/3996157729 shutdown_connections 2024-08-31T04:24:42.812 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:42.810+0000 7fbebc400640 1 --2- 172.21.15.50:0/3996157729 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbeb4109b90 0x7fbeb41103c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:42.812 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:42.810+0000 7fbebc400640 1 --2- 172.21.15.50:0/3996157729 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbeb4109240 0x7fbeb4109650 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:42.812 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:42.810+0000 7fbebc400640 1 --2- 172.21.15.50:0/3996157729 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbeb4103900 0x7fbeb4103d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:42.812 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:42.810+0000 7fbebc400640 1 -- 172.21.15.50:0/3996157729 >> 172.21.15.50:0/3996157729 conn(0x7fbeb407b5f0 msgr2=0x7fbeb407ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:24:42.812 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:42.810+0000 7fbebc400640 1 -- 172.21.15.50:0/3996157729 shutdown_connections 2024-08-31T04:24:42.812 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:42.810+0000 7fbebc400640 1 -- 172.21.15.50:0/3996157729 wait complete. 2024-08-31T04:24:42.813 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:42.812+0000 7fbebc400640 1 Processor -- start 2024-08-31T04:24:42.813 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:42.812+0000 7fbebc400640 1 -- start start 2024-08-31T04:24:42.814 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:42.812+0000 7fbebc400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbeb4103900 0x7fbeb419c450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:42.814 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:42.812+0000 7fbebc400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbeb4109240 0x7fbeb419c9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:42.814 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:42.812+0000 7fbebc400640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbeb4109b90 0x7fbeb41a1c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:42.814 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:42.812+0000 7fbebc400640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fbeb41138a0 con 0x7fbeb4103900 2024-08-31T04:24:42.814 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:42.812+0000 7fbebc400640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7fbeb4113720 con 0x7fbeb4109240 2024-08-31T04:24:42.814 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:42.812+0000 7fbebc400640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fbeb4113a20 con 0x7fbeb4109b90 2024-08-31T04:24:42.814 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:42.813+0000 7fbeb9a00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbeb4103900 0x7fbeb419c450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:24:42.814 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:42.813+0000 7fbeb9000640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbeb4109240 0x7fbeb419c9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:24:42.814 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:42.813+0000 7fbeb9000640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbeb4109240 0x7fbeb419c9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.50:38268/0 (socket says 172.21.15.50:38268) 2024-08-31T04:24:42.815 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:42.813+0000 7fbeb9a00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbeb4103900 0x7fbeb419c450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:55884/0 (socket says 172.21.15.50:55884) 2024-08-31T04:24:42.815 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:42.813+0000 7fbeb9000640 1 -- 172.21.15.50:0/2258205191 learned_addr learned my addr 172.21.15.50:0/2258205191 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:24:42.815 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:42.813+0000 7fbeba400640 1 --2- 172.21.15.50:0/2258205191 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbeb4109b90 0x7fbeb41a1c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:24:42.815 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:42.813+0000 7fbeb9a00640 1 -- 172.21.15.50:0/2258205191 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbeb4109b90 msgr2=0x7fbeb41a1c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:24:42.816 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:42.813+0000 7fbeb9a00640 1 --2- 172.21.15.50:0/2258205191 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbeb4109b90 0x7fbeb41a1c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:42.816 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:42.813+0000 7fbeb9a00640 1 -- 172.21.15.50:0/2258205191 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbeb4109240 msgr2=0x7fbeb419c9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:24:42.816 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:42.813+0000 7fbeb9a00640 1 --2- 172.21.15.50:0/2258205191 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbeb4109240 0x7fbeb419c9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:42.816 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:42.813+0000 7fbeb9a00640 1 -- 172.21.15.50:0/2258205191 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbeb41a23c0 con 0x7fbeb4103900 2024-08-31T04:24:42.816 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:42.813+0000 7fbeb9000640 1 --2- 172.21.15.50:0/2258205191 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbeb4109240 0x7fbeb419c9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:24:42.816 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:42.813+0000 7fbeba400640 1 --2- 172.21.15.50:0/2258205191 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbeb4109b90 0x7fbeb41a1c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:24:42.816 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:42.814+0000 7fbeb9a00640 1 --2- 172.21.15.50:0/2258205191 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbeb4103900 0x7fbeb419c450 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fbea8005fd0 tx=0x7fbea800dde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:24:42.816 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:42.814+0000 7fbeb2000640 1 -- 172.21.15.50:0/2258205191 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbea8009c30 con 0x7fbeb4103900 2024-08-31T04:24:42.816 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:42.814+0000 7fbeb2000640 1 -- 172.21.15.50:0/2258205191 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbea8009dd0 con 0x7fbeb4103900 2024-08-31T04:24:42.816 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:42.814+0000 7fbebc400640 1 -- 172.21.15.50:0/2258205191 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbeb41a26b0 con 0x7fbeb4103900 2024-08-31T04:24:42.816 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:42.814+0000 7fbeb2000640 1 -- 172.21.15.50:0/2258205191 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbea8003e20 con 0x7fbeb4103900 2024-08-31T04:24:42.817 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:42.814+0000 7fbebc400640 1 -- 172.21.15.50:0/2258205191 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbeb41a8e10 con 0x7fbeb4103900 2024-08-31T04:24:42.819 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:42.817+0000 7fbec302e740 1 Processor -- start 2024-08-31T04:24:42.819 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:42.818+0000 7fbec302e740 1 -- start start 2024-08-31T04:24:42.819 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:42.818+0000 7fbeb2000640 1 -- 172.21.15.50:0/2258205191 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 18) ==== 152577+0+0 (secure 0 0 0) 0x7fbea8003fe0 con 0x7fbeb4103900 2024-08-31T04:24:42.820 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:42.818+0000 7fbec302e740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5603d8853520 0x5603d8bf8ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:42.820 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:42.818+0000 7fbec302e740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5603d882a660 0x5603d8bf9430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:42.820 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:42.818+0000 7fbec302e740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5603d8832840 0x5603d8bf9970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:42.820 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:42.818+0000 7fbec302e740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x5603d8b6fa90 con 0x5603d8832840 2024-08-31T04:24:42.820 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:42.818+0000 7fbec302e740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x5603d8b5f020 con 0x5603d8853520 2024-08-31T04:24:42.820 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:42.818+0000 7fbec302e740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x5603d8b62fd0 con 0x5603d882a660 2024-08-31T04:24:42.821 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:42.819+0000 7fbeb9a00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5603d882a660 0x5603d8bf9430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:24:42.821 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:42.819+0000 7fbeba400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5603d8853520 0x5603d8bf8ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:24:42.821 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:42.819+0000 7fbeb9000640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5603d8832840 0x5603d8bf9970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:24:42.821 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:42.819+0000 7fbeba400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5603d8853520 0x5603d8bf8ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.50:38274/0 (socket says 172.21.15.50:38274) 2024-08-31T04:24:42.821 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:42.819+0000 7fbeba400640 1 -- 172.21.15.50:0/72850323 learned_addr learned my addr 172.21.15.50:0/72850323 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:24:42.821 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:42.819+0000 7fbeb9a00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5603d882a660 0x5603d8bf9430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.50:60058/0 (socket says 172.21.15.50:60058) 2024-08-31T04:24:42.822 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:42.819+0000 7fbeba400640 1 -- 172.21.15.50:0/72850323 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5603d882a660 msgr2=0x5603d8bf9430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:24:42.822 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:42.819+0000 7fbeba400640 1 --2- 172.21.15.50:0/72850323 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5603d882a660 0x5603d8bf9430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:42.822 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:42.819+0000 7fbeba400640 1 -- 172.21.15.50:0/72850323 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5603d8832840 msgr2=0x5603d8bf9970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:24:42.822 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:42.819+0000 7fbeba400640 1 --2- 172.21.15.50:0/72850323 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5603d8832840 0x5603d8bf9970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:42.822 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:42.819+0000 7fbeba400640 1 -- 172.21.15.50:0/72850323 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5603d88beb00 con 0x5603d8853520 2024-08-31T04:24:42.822 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:42.819+0000 7fbeb9a00640 1 --2- 172.21.15.50:0/72850323 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5603d882a660 0x5603d8bf9430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:24:42.822 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:42.820+0000 7fbeba400640 1 --2- 172.21.15.50:0/72850323 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5603d8853520 0x5603d8bf8ef0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fbeac011790 tx=0x7fbeac011c50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7d1c8ce8465d7d49 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:24:42.822 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:42.820+0000 7fbeb2000640 1 --2- 172.21.15.50:0/2258205191 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fbe9c0b4b30 0x7fbe9c0b7040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:42.822 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:42.820+0000 7fbea6a00640 1 -- 172.21.15.50:0/72850323 <== mon.2 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbeac003c30 con 0x5603d8853520 2024-08-31T04:24:42.822 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:42.820+0000 7fbea6a00640 1 -- 172.21.15.50:0/72850323 <== mon.2 v2:172.21.15.133:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbeac00fe50 con 0x5603d8853520 2024-08-31T04:24:42.822 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:42.820+0000 7fbea6a00640 1 -- 172.21.15.50:0/72850323 <== mon.2 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbeac0193e0 con 0x5603d8853520 2024-08-31T04:24:42.822 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:42.820+0000 7fbeb9a00640 1 --2- 172.21.15.50:0/2258205191 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fbe9c0b4b30 0x7fbe9c0b7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:24:42.822 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:42.820+0000 7fbeb2000640 1 -- 172.21.15.50:0/2258205191 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8219+0+0 (secure 0 0 0) 0x7fbea80e4cf0 con 0x7fbeb4103900 2024-08-31T04:24:42.824 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:42.821+0000 7fbec302e740 1 -- 172.21.15.50:0/72850323 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5603d8853520 msgr2=0x5603d8bf8ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:24:42.824 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:42.821+0000 7fbec302e740 1 --2- 172.21.15.50:0/72850323 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5603d8853520 0x5603d8bf8ef0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fbeac011790 tx=0x7fbeac011c50 comp rx=0 tx=0).stop 2024-08-31T04:24:42.824 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:42.821+0000 7fbeb9a00640 1 --2- 172.21.15.50:0/2258205191 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fbe9c0b4b30 0x7fbe9c0b7040 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fbea80a89f0 tx=0x7fbea80e8730 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:24:42.824 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:42.821+0000 7fbec302e740 1 -- 172.21.15.50:0/72850323 shutdown_connections 2024-08-31T04:24:42.824 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:42.821+0000 7fbec302e740 1 --2- 172.21.15.50:0/72850323 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5603d882a660 0x5603d8bf9430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:42.824 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:42.821+0000 7fbec302e740 1 --2- 172.21.15.50:0/72850323 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5603d8832840 0x5603d8bf9970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:42.824 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:42.821+0000 7fbec302e740 1 --2- 172.21.15.50:0/72850323 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5603d8853520 0x5603d8bf8ef0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:42.824 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:42.821+0000 7fbec302e740 1 -- 172.21.15.50:0/72850323 >> 172.21.15.50:0/72850323 conn(0x5603d8847910 msgr2=0x5603d8bf6de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:24:42.824 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:42.821+0000 7fbec302e740 1 -- 172.21.15.50:0/72850323 shutdown_connections 2024-08-31T04:24:42.824 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:42.821+0000 7fbec302e740 1 -- 172.21.15.50:0/72850323 wait complete. 2024-08-31T04:24:42.824 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:42.822+0000 7fbec302e740 1 -- start start 2024-08-31T04:24:42.825 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:42.822+0000 7fbec302e740 1 Processor -- start 2024-08-31T04:24:42.825 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:42.822+0000 7fbec302e740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5603d882a660 0x5603d8c04240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:42.825 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:42.822+0000 7fbec302e740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5603d8832840 0x5603d8c04780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:42.825 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:42.822+0000 7fbec302e740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5603d8853520 0x5603d8c04cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:42.825 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:42.822+0000 7fbec302e740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x5603d89c1bb0 con 0x5603d8832840 2024-08-31T04:24:42.825 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:42.822+0000 7fbec302e740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x5603d8ae5f90 con 0x5603d8853520 2024-08-31T04:24:42.825 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:42.822+0000 7fbec302e740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x5603d8c076d0 con 0x5603d882a660 2024-08-31T04:24:42.825 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:42.823+0000 7fbec302e740 10 client.0 _ll_register_callbacks cb 0x5603d8b0b710 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:24:42.827 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:42.823+0000 7fbeb9000640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5603d8832840 0x5603d8c04780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:24:42.827 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:42.823+0000 7fbeba400640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5603d882a660 0x5603d8c04240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:24:42.827 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:42.823+0000 7fbeb9000640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5603d8832840 0x5603d8c04780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:55900/0 (socket says 172.21.15.50:55900) 2024-08-31T04:24:42.827 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:42.823+0000 7fbeb9000640 1 -- 172.21.15.50:0/3482880 learned_addr learned my addr 172.21.15.50:0/3482880 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:24:42.827 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:42.823+0000 7fbeba400640 1 --2- 172.21.15.50:0/3482880 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5603d8853520 0x5603d8c04cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:24:42.827 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:42.823+0000 7fbeb9000640 1 -- 172.21.15.50:0/3482880 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5603d882a660 msgr2=0x5603d8c04240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:24:42.827 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:42.823+0000 7fbeb9000640 1 --2- 172.21.15.50:0/3482880 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5603d882a660 0x5603d8c04240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:42.827 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:42.823+0000 7fbeb9000640 1 -- 172.21.15.50:0/3482880 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5603d8853520 msgr2=0x5603d8c04cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:24:42.827 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:42.823+0000 7fbeb9000640 1 --2- 172.21.15.50:0/3482880 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5603d8853520 0x5603d8c04cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:42.827 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:42.823+0000 7fbeb9000640 1 -- 172.21.15.50:0/3482880 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5603d8935960 con 0x5603d8832840 2024-08-31T04:24:42.827 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:42.823+0000 7fbeba400640 1 --2- 172.21.15.50:0/3482880 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5603d8853520 0x5603d8c04cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:24:42.828 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:42.824+0000 7fbeb9000640 1 --2- 172.21.15.50:0/3482880 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5603d8832840 0x5603d8c04780 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fbea0000c00 tx=0x7fbea0003820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67e39839feb16193 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:24:42.828 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:42.824+0000 7fbe9b400640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-08-31T04:24:42.828 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:42.824+0000 7fbe9b400640 1 -- 172.21.15.50:0/3482880 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbea0035040 con 0x5603d8832840 2024-08-31T04:24:42.828 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:42.824+0000 7fbec302e740 1 -- 172.21.15.50:0/3482880 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5603d8afde30 con 0x5603d8832840 2024-08-31T04:24:42.828 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:42.824+0000 7fbe9b400640 1 -- 172.21.15.50:0/3482880 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8219+0+0 (secure 0 0 0) 0x7fbea0005020 con 0x5603d8832840 2024-08-31T04:24:42.828 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:42.824+0000 7fbe9b400640 1 -- 172.21.15.50:0/3482880 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fbea0005220 con 0x5603d8832840 2024-08-31T04:24:42.828 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:42.824+0000 7fbec302e740 10 client.15606 fetch_fsmap learned FSMap version 29 2024-08-31T04:24:42.828 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:42.824+0000 7fbec302e740 1 -- 172.21.15.50:0/3482880 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5603d8c130b0 con 0x5603d8832840 2024-08-31T04:24:42.828 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:42.825+0000 7fbe9b400640 1 -- 172.21.15.50:0/3482880 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x5603d8afde30 con 0x5603d8832840 2024-08-31T04:24:42.828 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:42.825+0000 7fbe9b400640 1 -- 172.21.15.50:0/3482880 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7fbea00314a0 con 0x5603d8832840 2024-08-31T04:24:42.828 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:42.825+0000 7fbec302e740 10 client.15606 fetch_fsmap finished waiting for FSMap version 29 2024-08-31T04:24:42.828 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:42.825+0000 7fbec302e740 10 client.15606 resolve_mds: validated gid 24695 aka daemon mds.b 2024-08-31T04:24:42.828 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:42.825+0000 7fbec302e740 20 client.15606 populate_metadata read hostname 'smithi050' 2024-08-31T04:24:42.829 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:42.825+0000 7fbec302e740 1 --2- 172.21.15.50:0/3482880 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x5603d8811ea0 0x5603d8c165d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:42.829 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:42.825+0000 7fbec302e740 4 client.15606 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T04:24:42.829 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:42.825+0000 7fbec302e740 1 -- 172.21.15.50:0/3482880 --> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5603d8b719e0 con 0x5603d8811ea0 2024-08-31T04:24:42.829 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:42.825+0000 7fbeba400640 1 --2- 172.21.15.50:0/3482880 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x5603d8811ea0 0x5603d8c165d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:24:42.830 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:42.826+0000 7fbeba400640 1 --2- 172.21.15.50:0/3482880 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x5603d8811ea0 0x5603d8c165d0 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6b35279730a16cdc server_cookie=1144eb7e426e216f in_seq=0 out_seq=0 2024-08-31T04:24:42.830 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:42.826+0000 7fbe9b400640 10 client.15606 ms_handle_connect on v2:172.21.15.133:6838/2526402262 2024-08-31T04:24:42.830 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:42.827+0000 7fbe9b400640 1 -- 172.21.15.50:0/3482880 <== mds.0 v2:172.21.15.133:6838/2526402262 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5603d8b719e0 con 0x5603d8811ea0 2024-08-31T04:24:42.830 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:42.827+0000 7fbe9b400640 10 client.15606 handle_command_reply: tid=0 2024-08-31T04:24:42.830 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:42.827+0000 7fbec302e740 1 client.15606 shutdown 2024-08-31T04:24:42.830 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:42.827+0000 7fbec302e740 1 -- 172.21.15.50:0/3482880 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5603d8832840 msgr2=0x5603d8c04780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:24:42.830 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:42.827+0000 7fbec302e740 1 --2- 172.21.15.50:0/3482880 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5603d8832840 0x5603d8c04780 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fbea0000c00 tx=0x7fbea0003820 comp rx=0 tx=0).stop 2024-08-31T04:24:42.830 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:42.827+0000 7fbec302e740 1 -- 172.21.15.50:0/3482880 shutdown_connections 2024-08-31T04:24:42.830 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:42.827+0000 7fbec302e740 1 --2- 172.21.15.50:0/3482880 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x5603d8811ea0 0x5603d8c165d0 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:42.831 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:42.827+0000 7fbec302e740 1 --2- 172.21.15.50:0/3482880 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5603d8853520 0x5603d8c04cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:42.831 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:42.827+0000 7fbec302e740 1 --2- 172.21.15.50:0/3482880 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5603d8832840 0x5603d8c04780 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:42.831 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:42.827+0000 7fbec302e740 1 --2- 172.21.15.50:0/3482880 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5603d882a660 0x5603d8c04240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:42.831 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:42.827+0000 7fbec302e740 1 -- 172.21.15.50:0/3482880 >> 172.21.15.50:0/3482880 conn(0x5603d8847910 msgr2=0x5603d8bfc080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:24:42.831 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:42.828+0000 7fbe9b400640 0 client.15606 ms_handle_reset on v2:172.21.15.133:6838/2526402262 2024-08-31T04:24:42.831 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:42.828+0000 7fbec302e740 1 -- 172.21.15.50:0/3482880 shutdown_connections 2024-08-31T04:24:42.831 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:42.828+0000 7fbec302e740 1 -- 172.21.15.50:0/3482880 wait complete. 2024-08-31T04:24:42.831 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:42.828+0000 7fbec302e740 20 client.15606 trim_cache size 0 max 16384 2024-08-31T04:24:42.847 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:42.846+0000 7fbec302e740 1 Processor -- start 2024-08-31T04:24:42.847 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:42.846+0000 7fbec302e740 1 -- start start 2024-08-31T04:24:42.847 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:42.846+0000 7fbec302e740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5603d882a660 0x5603d8c05500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:42.847 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:42.846+0000 7fbec302e740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5603d8832840 0x5603d8c05a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:42.848 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:42.846+0000 7fbec302e740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5603d8853520 0x5603d8c01430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:42.848 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:42.846+0000 7fbec302e740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fbeb41b1320 con 0x5603d882a660 2024-08-31T04:24:42.848 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:42.846+0000 7fbec302e740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7fbeb41b2e60 con 0x5603d8853520 2024-08-31T04:24:42.848 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:42.846+0000 7fbec302e740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fbeb41b19f0 con 0x5603d8832840 2024-08-31T04:24:42.849 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:42.847+0000 7fbeb9000640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5603d8832840 0x5603d8c05a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:24:42.849 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:42.847+0000 7fbeb9000640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5603d8832840 0x5603d8c05a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.50:60072/0 (socket says 172.21.15.50:60072) 2024-08-31T04:24:42.849 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:42.847+0000 7fbeb9000640 1 -- 172.21.15.50:0/2207969078 learned_addr learned my addr 172.21.15.50:0/2207969078 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:24:42.849 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:42.847+0000 7fbeba400640 1 --2- 172.21.15.50:0/2207969078 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5603d882a660 0x5603d8c05500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:24:42.849 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:42.847+0000 7fbeb9000640 1 -- 172.21.15.50:0/2207969078 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5603d8853520 msgr2=0x5603d8c01430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:24:42.849 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:42.847+0000 7fbeba400640 1 --2- 172.21.15.50:0/2207969078 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5603d8853520 0x5603d8c01430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:24:42.849 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:42.847+0000 7fbeb9000640 1 --2- 172.21.15.50:0/2207969078 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5603d8853520 0x5603d8c01430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:42.849 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:42.847+0000 7fbeb9000640 1 -- 172.21.15.50:0/2207969078 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5603d882a660 msgr2=0x5603d8c05500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:24:42.850 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:42.847+0000 7fbeb9000640 1 --2- 172.21.15.50:0/2207969078 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5603d882a660 0x5603d8c05500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:42.850 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:42.847+0000 7fbeb9000640 1 -- 172.21.15.50:0/2207969078 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5603d88120d0 con 0x5603d8832840 2024-08-31T04:24:42.850 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:42.847+0000 7fbeb9000640 1 --2- 172.21.15.50:0/2207969078 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5603d8832840 0x5603d8c05a40 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fbea0031870 tx=0x7fbea002a410 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a283ea03fae4650c server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:24:42.850 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:42.848+0000 7fbea6000640 1 -- 172.21.15.50:0/2207969078 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbea0054030 con 0x5603d8832840 2024-08-31T04:24:42.850 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:42.848+0000 7fbea6000640 1 -- 172.21.15.50:0/2207969078 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbea00314a0 con 0x5603d8832840 2024-08-31T04:24:42.850 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:42.848+0000 7fbea6000640 1 -- 172.21.15.50:0/2207969078 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbea0035030 con 0x5603d8832840 2024-08-31T04:24:42.852 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:42.848+0000 7fbec302e740 1 -- 172.21.15.50:0/2207969078 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5603d8832840 msgr2=0x5603d8c05a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:24:42.852 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:42.848+0000 7fbec302e740 1 --2- 172.21.15.50:0/2207969078 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5603d8832840 0x5603d8c05a40 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fbea0031870 tx=0x7fbea002a410 comp rx=0 tx=0).stop 2024-08-31T04:24:42.852 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:42.849+0000 7fbec302e740 1 -- 172.21.15.50:0/2207969078 shutdown_connections 2024-08-31T04:24:42.852 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:42.849+0000 7fbec302e740 1 --2- 172.21.15.50:0/2207969078 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5603d8832840 0x5603d8c05a40 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:42.852 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:42.849+0000 7fbec302e740 1 --2- 172.21.15.50:0/2207969078 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5603d8853520 0x5603d8c01430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:42.852 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:42.849+0000 7fbec302e740 1 --2- 172.21.15.50:0/2207969078 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5603d882a660 0x5603d8c05500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:42.853 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:42.849+0000 7fbec302e740 1 -- 172.21.15.50:0/2207969078 >> 172.21.15.50:0/2207969078 conn(0x5603d8847910 msgr2=0x5603d8bf5d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:24:42.853 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:42.849+0000 7fbec302e740 1 -- 172.21.15.50:0/2207969078 shutdown_connections 2024-08-31T04:24:42.853 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:42.849+0000 7fbec302e740 1 -- 172.21.15.50:0/2207969078 wait complete. 2024-08-31T04:24:42.853 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:42.849+0000 7fbec302e740 1 -- start start 2024-08-31T04:24:42.853 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:42.849+0000 7fbec302e740 1 Processor -- start 2024-08-31T04:24:42.853 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:42.850+0000 7fbec302e740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5603d882a660 0x5603d8c08a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:42.853 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:42.850+0000 7fbec302e740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5603d8832840 0x5603d8c08f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:42.853 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:42.850+0000 7fbec302e740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5603d8853520 0x5603d8c09490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:42.853 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:42.850+0000 7fbec302e740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fbeb41b2790 con 0x5603d882a660 2024-08-31T04:24:42.853 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:42.850+0000 7fbec302e740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7fbeb41b20c0 con 0x5603d8853520 2024-08-31T04:24:42.853 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:42.850+0000 7fbec302e740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fbeb41af300 con 0x5603d8832840 2024-08-31T04:24:42.853 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:42.850+0000 7fbec302e740 10 client.0 _ll_register_callbacks cb 0x7fbea0004530 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:24:42.853 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:42.850+0000 7fbeba400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5603d882a660 0x5603d8c08a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:24:42.853 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:42.850+0000 7fbeba400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5603d882a660 0x5603d8c08a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:55918/0 (socket says 172.21.15.50:55918) 2024-08-31T04:24:42.854 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:42.850+0000 7fbeba400640 1 -- 172.21.15.50:0/1194944010 learned_addr learned my addr 172.21.15.50:0/1194944010 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:24:42.854 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:42.850+0000 7fbeb9000640 1 --2- 172.21.15.50:0/1194944010 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5603d8832840 0x5603d8c08f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:24:42.854 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:42.850+0000 7fbeba400640 1 --2- 172.21.15.50:0/1194944010 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5603d8853520 0x5603d8c09490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:24:42.854 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:42.851+0000 7fbeb9000640 1 -- 172.21.15.50:0/1194944010 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5603d8853520 msgr2=0x5603d8c09490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:24:42.854 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:42.851+0000 7fbeb9000640 1 --2- 172.21.15.50:0/1194944010 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5603d8853520 0x5603d8c09490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:42.854 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:42.851+0000 7fbeb9000640 1 -- 172.21.15.50:0/1194944010 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5603d882a660 msgr2=0x5603d8c08a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:24:42.854 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:42.851+0000 7fbeb9000640 1 --2- 172.21.15.50:0/1194944010 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5603d882a660 0x5603d8c08a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:42.854 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:42.851+0000 7fbeb9000640 1 -- 172.21.15.50:0/1194944010 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5603d8c80080 con 0x5603d8832840 2024-08-31T04:24:42.854 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:42.851+0000 7fbeba400640 1 --2- 172.21.15.50:0/1194944010 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5603d882a660 0x5603d8c08a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:24:42.854 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:42.851+0000 7fbeb9000640 1 --2- 172.21.15.50:0/1194944010 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5603d8832840 0x5603d8c08f50 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fbea0005ab0 tx=0x7fbea0005a20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4c1f3564f95972e0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:24:42.854 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:42.851+0000 7fbe9b400640 10 client.0 ms_handle_connect on v2:172.21.15.177:3300/0 2024-08-31T04:24:42.856 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:42.851+0000 7fbe9b400640 1 -- 172.21.15.50:0/1194944010 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbea0054040 con 0x5603d8832840 2024-08-31T04:24:42.856 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:42.851+0000 7fbec302e740 1 -- 172.21.15.50:0/1194944010 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbea00314a0 con 0x5603d8832840 2024-08-31T04:24:42.856 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:42.851+0000 7fbe9b400640 1 -- 172.21.15.50:0/1194944010 <== mon.1 v2:172.21.15.177:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8219+0+0 (secure 0 0 0) 0x7fbea00048e0 con 0x5603d8832840 2024-08-31T04:24:42.856 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:42.852+0000 7fbe9b400640 1 -- 172.21.15.50:0/1194944010 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fbea0035040 con 0x5603d8832840 2024-08-31T04:24:42.856 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:42.852+0000 7fbec302e740 10 client.25624 fetch_fsmap learned FSMap version 29 2024-08-31T04:24:42.856 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:42.852+0000 7fbec302e740 1 -- 172.21.15.50:0/1194944010 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5603d8c81320 con 0x5603d8832840 2024-08-31T04:24:42.856 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:42.852+0000 7fbe9b400640 1 -- 172.21.15.50:0/1194944010 <== mon.1 v2:172.21.15.177:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbea00314a0 con 0x5603d8832840 2024-08-31T04:24:42.856 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:42.852+0000 7fbe9b400640 1 -- 172.21.15.50:0/1194944010 <== mon.1 v2:172.21.15.177:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7fbea0061560 con 0x5603d8832840 2024-08-31T04:24:42.856 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:42.852+0000 7fbec302e740 10 client.25624 fetch_fsmap finished waiting for FSMap version 29 2024-08-31T04:24:42.856 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:42.852+0000 7fbec302e740 10 client.25624 resolve_mds: validated gid 24695 aka daemon mds.b 2024-08-31T04:24:42.856 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:42.852+0000 7fbec302e740 20 client.25624 populate_metadata read hostname 'smithi050' 2024-08-31T04:24:42.856 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:42.852+0000 7fbec302e740 1 --2- 172.21.15.50:0/1194944010 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x5603d87e7250 0x5603d8c83a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:42.856 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:42.852+0000 7fbec302e740 4 client.25624 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "a406ef21", "release": true, "await": true}] 2024-08-31T04:24:42.857 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:42.852+0000 7fbec302e740 1 -- 172.21.15.50:0/1194944010 --> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] -- command(tid 0: {"prefix": "quiesce db", "set_id": "a406ef21", "release": true, "await": true}) -- 0x5603d8b6d480 con 0x5603d87e7250 2024-08-31T04:24:42.857 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:42.853+0000 7fbeba400640 1 --2- 172.21.15.50:0/1194944010 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x5603d87e7250 0x5603d8c83a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:24:42.857 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:42.853+0000 7fbeba400640 1 --2- 172.21.15.50:0/1194944010 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x5603d87e7250 0x5603d8c83a50 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e8e0ed36ea6b77e9 server_cookie=f67a6b196434d0d5 in_seq=0 out_seq=0 2024-08-31T04:24:42.857 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:42.853+0000 7fbe9b400640 10 client.25624 ms_handle_connect on v2:172.21.15.133:6838/2526402262 2024-08-31T04:24:42.858 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:42.857+0000 7fbe9b400640 1 -- 172.21.15.50:0/1194944010 <== mds.0 v2:172.21.15.133:6838/2526402262 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x5603d8b6d480 con 0x5603d87e7250 2024-08-31T04:24:42.859 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:42.857+0000 7fbe9b400640 10 client.25624 handle_command_reply: tid=0 2024-08-31T04:24:42.859 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:42.857+0000 7fbec302e740 1 client.25624 shutdown 2024-08-31T04:24:42.859 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:42.857+0000 7fbec302e740 1 -- 172.21.15.50:0/1194944010 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5603d8832840 msgr2=0x5603d8c08f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:24:42.859 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:42.857+0000 7fbec302e740 1 --2- 172.21.15.50:0/1194944010 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5603d8832840 0x5603d8c08f50 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fbea0005ab0 tx=0x7fbea0005a20 comp rx=0 tx=0).stop 2024-08-31T04:24:42.859 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:42.857+0000 7fbec302e740 1 -- 172.21.15.50:0/1194944010 shutdown_connections 2024-08-31T04:24:42.859 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:42.857+0000 7fbec302e740 1 --2- 172.21.15.50:0/1194944010 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x5603d87e7250 0x5603d8c83a50 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:42.859 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:42.857+0000 7fbec302e740 1 --2- 172.21.15.50:0/1194944010 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5603d8832840 0x5603d8c08f50 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:42.859 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:42.857+0000 7fbec302e740 1 --2- 172.21.15.50:0/1194944010 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5603d8853520 0x5603d8c09490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:42.859 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:42.857+0000 7fbec302e740 1 --2- 172.21.15.50:0/1194944010 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5603d882a660 0x5603d8c08a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:42.859 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:42.857+0000 7fbec302e740 1 -- 172.21.15.50:0/1194944010 >> 172.21.15.50:0/1194944010 conn(0x5603d8847910 msgr2=0x5603d8bf5d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:24:42.859 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:42.857+0000 7fbe9b400640 0 client.25624 ms_handle_reset on v2:172.21.15.133:6838/2526402262 2024-08-31T04:24:42.859 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:42.857+0000 7fbec302e740 1 -- 172.21.15.50:0/1194944010 shutdown_connections 2024-08-31T04:24:42.860 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:42.857+0000 7fbec302e740 1 -- 172.21.15.50:0/1194944010 wait complete. 2024-08-31T04:24:42.860 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:42.857+0000 7fbec302e740 20 client.25624 trim_cache size 0 max 16384 2024-08-31T04:24:42.860 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-08-31T04:24:42.860 INFO:teuthology.orchestra.run.smithi050.stdout: "epoch": 29, 2024-08-31T04:24:42.860 INFO:teuthology.orchestra.run.smithi050.stdout: "leader": 24695, 2024-08-31T04:24:42.860 INFO:teuthology.orchestra.run.smithi050.stdout: "set_version": 8, 2024-08-31T04:24:42.860 INFO:teuthology.orchestra.run.smithi050.stdout: "sets": { 2024-08-31T04:24:42.860 INFO:teuthology.orchestra.run.smithi050.stdout: "a406ef21": { 2024-08-31T04:24:42.861 INFO:teuthology.orchestra.run.smithi050.stdout: "version": 8, 2024-08-31T04:24:42.861 INFO:teuthology.orchestra.run.smithi050.stdout: "age_ref": 0.0, 2024-08-31T04:24:42.861 INFO:teuthology.orchestra.run.smithi050.stdout: "state": { 2024-08-31T04:24:42.861 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "RELEASED", 2024-08-31T04:24:42.861 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 0.0 2024-08-31T04:24:42.861 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:24:42.861 INFO:teuthology.orchestra.run.smithi050.stdout: "timeout": 90.0, 2024-08-31T04:24:42.861 INFO:teuthology.orchestra.run.smithi050.stdout: "expiration": 146.4, 2024-08-31T04:24:42.861 INFO:teuthology.orchestra.run.smithi050.stdout: "members": { 2024-08-31T04:24:42.861 INFO:teuthology.orchestra.run.smithi050.stdout: "file:/": { 2024-08-31T04:24:42.861 INFO:teuthology.orchestra.run.smithi050.stdout: "excluded": false, 2024-08-31T04:24:42.861 INFO:teuthology.orchestra.run.smithi050.stdout: "state": { 2024-08-31T04:24:42.861 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "RELEASED", 2024-08-31T04:24:42.861 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 0.0 2024-08-31T04:24:42.862 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T04:24:42.862 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T04:24:42.862 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T04:24:42.862 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T04:24:42.862 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T04:24:42.862 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-08-31T04:24:42.863 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:42.858+0000 7fbebc400640 1 -- 172.21.15.50:0/2258205191 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fbe9c0b4b30 msgr2=0x7fbe9c0b7040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:24:42.863 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:42.858+0000 7fbebc400640 1 --2- 172.21.15.50:0/2258205191 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fbe9c0b4b30 0x7fbe9c0b7040 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fbea80a89f0 tx=0x7fbea80e8730 comp rx=0 tx=0).stop 2024-08-31T04:24:42.863 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:42.858+0000 7fbebc400640 1 -- 172.21.15.50:0/2258205191 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbeb4103900 msgr2=0x7fbeb419c450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:24:42.863 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:42.858+0000 7fbebc400640 1 --2- 172.21.15.50:0/2258205191 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbeb4103900 0x7fbeb419c450 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fbea8005fd0 tx=0x7fbea800dde0 comp rx=0 tx=0).stop 2024-08-31T04:24:42.863 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:42.858+0000 7fbebc400640 1 -- 172.21.15.50:0/2258205191 shutdown_connections 2024-08-31T04:24:42.863 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:42.858+0000 7fbebc400640 1 --2- 172.21.15.50:0/2258205191 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fbe9c0b4b30 0x7fbe9c0b7040 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:42.863 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:42.858+0000 7fbebc400640 1 --2- 172.21.15.50:0/2258205191 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbeb4109b90 0x7fbeb41a1c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:42.863 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:42.858+0000 7fbebc400640 1 --2- 172.21.15.50:0/2258205191 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbeb4109240 0x7fbeb419c9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:42.863 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:42.858+0000 7fbebc400640 1 --2- 172.21.15.50:0/2258205191 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbeb4103900 0x7fbeb419c450 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:42.863 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:42.858+0000 7fbebc400640 1 -- 172.21.15.50:0/2258205191 >> 172.21.15.50:0/2258205191 conn(0x7fbeb407b5f0 msgr2=0x7fbeb4107050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:24:42.863 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:42.858+0000 7fbebc400640 1 -- 172.21.15.50:0/2258205191 shutdown_connections 2024-08-31T04:24:42.863 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:24:42.858+0000 7fbebc400640 1 -- 172.21.15.50:0/2258205191 wait complete. 2024-08-31T04:24:42.870 INFO:tasks.workunit.client.0.smithi050.stderr:+ echo 'getting blogbench' 2024-08-31T04:24:42.870 INFO:tasks.workunit.client.0.smithi050.stderr:+ wget http://download.ceph.com/qa/blogbench-1.0.tar.bz2 2024-08-31T04:24:42.870 INFO:tasks.workunit.client.0.smithi050.stdout:getting blogbench 2024-08-31T04:24:43.012 INFO:tasks.workunit.client.0.smithi050.stderr:--2024-08-31 04:24:43-- http://download.ceph.com/qa/blogbench-1.0.tar.bz2 2024-08-31T04:24:43.013 INFO:tasks.workunit.client.0.smithi050.stderr:Resolving download.ceph.com (download.ceph.com)... 158.69.68.124, 2607:5300:201:2000::3:58a1 2024-08-31T04:24:43.035 INFO:tasks.workunit.client.0.smithi050.stderr:Connecting to download.ceph.com (download.ceph.com)|158.69.68.124|:80... connected. 2024-08-31T04:24:43.055 INFO:tasks.workunit.client.0.smithi050.stderr:HTTP request sent, awaiting response... 200 OK 2024-08-31T04:24:43.056 INFO:tasks.workunit.client.0.smithi050.stderr:Length: 103355 (101K) [application/octet-stream] 2024-08-31T04:24:43.058 INFO:tasks.workunit.client.0.smithi050.stderr:Saving to: ‘blogbench-1.0.tar.bz2’ 2024-08-31T04:24:43.062 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-08-31T04:24:43.098 INFO:tasks.workunit.client.0.smithi050.stderr: 0K .......... .......... .......... .......... .......... 49% 1.25M 0s 2024-08-31T04:24:43.118 INFO:tasks.workunit.client.0.smithi050.stderr: 50K .......... .......... .......... .......... .......... 99% 2.36M 0s 2024-08-31T04:24:43.118 INFO:tasks.workunit.client.0.smithi050.stderr: 100K 100% 1.74T=0.06s 2024-08-31T04:24:43.118 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-08-31T04:24:43.118 INFO:tasks.workunit.client.0.smithi050.stderr:2024-08-31 04:24:43 (1.65 MB/s) - ‘blogbench-1.0.tar.bz2’ saved [103355/103355] 2024-08-31T04:24:43.118 INFO:tasks.workunit.client.0.smithi050.stderr: 2024-08-31T04:24:43.119 INFO:tasks.workunit.client.0.smithi050.stderr:+ tar -xvf blogbench-1.0.tar.bz2 2024-08-31T04:24:43.200 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:24:43 smithi050 ceph-mon[17259]: pgmap v421: 97 pgs: 97 active+clean; 677 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 767 B/s wr, 12 op/s 2024-08-31T04:24:43.250 INFO:tasks.workunit.client.0.smithi050.stdout:blogbench-1.0/ 2024-08-31T04:24:43.253 INFO:tasks.workunit.client.0.smithi050.stdout:blogbench-1.0/m4/ 2024-08-31T04:24:43.253 INFO:tasks.workunit.client.0.smithi050.stdout:blogbench-1.0/m4/acx_pthread.m4 2024-08-31T04:24:43.255 INFO:tasks.workunit.client.0.smithi050.stdout:blogbench-1.0/man/ 2024-08-31T04:24:43.256 INFO:tasks.workunit.client.0.smithi050.stdout:blogbench-1.0/man/blogbench.8 2024-08-31T04:24:43.257 INFO:tasks.workunit.client.0.smithi050.stdout:blogbench-1.0/man/Makefile.am 2024-08-31T04:24:43.258 INFO:tasks.workunit.client.0.smithi050.stdout:blogbench-1.0/man/Makefile.in 2024-08-31T04:24:43.259 INFO:tasks.workunit.client.0.smithi050.stdout:blogbench-1.0/src/ 2024-08-31T04:24:43.260 INFO:tasks.workunit.client.0.smithi050.stdout:blogbench-1.0/src/mysnprintf.c 2024-08-31T04:24:43.262 INFO:tasks.workunit.client.0.smithi050.stdout:blogbench-1.0/src/mysnprintf.h 2024-08-31T04:24:43.263 INFO:tasks.workunit.client.0.smithi050.stdout:blogbench-1.0/src/blogbench.c 2024-08-31T04:24:43.264 INFO:tasks.workunit.client.0.smithi050.stdout:blogbench-1.0/src/blogbench.h 2024-08-31T04:24:43.265 INFO:tasks.workunit.client.0.smithi050.stdout:blogbench-1.0/src/fakesnprintf.c 2024-08-31T04:24:43.267 INFO:tasks.workunit.client.0.smithi050.stdout:blogbench-1.0/src/fakesnprintf.h 2024-08-31T04:24:43.268 INFO:tasks.workunit.client.0.smithi050.stdout:blogbench-1.0/src/blogbench_p.h 2024-08-31T04:24:43.269 INFO:tasks.workunit.client.0.smithi050.stdout:blogbench-1.0/src/bsd-getopt_long.c 2024-08-31T04:24:43.270 INFO:tasks.workunit.client.0.smithi050.stdout:blogbench-1.0/src/bsd-getopt_long.h 2024-08-31T04:24:43.272 INFO:tasks.workunit.client.0.smithi050.stdout:blogbench-1.0/src/Makefile.am 2024-08-31T04:24:43.273 INFO:tasks.workunit.client.0.smithi050.stdout:blogbench-1.0/src/Makefile.in 2024-08-31T04:24:43.274 INFO:tasks.workunit.client.0.smithi050.stdout:blogbench-1.0/src/process.c 2024-08-31T04:24:43.276 INFO:tasks.workunit.client.0.smithi050.stdout:blogbench-1.0/src/globals.h 2024-08-31T04:24:43.277 INFO:tasks.workunit.client.0.smithi050.stdout:blogbench-1.0/src/commenter.c 2024-08-31T04:24:43.278 INFO:tasks.workunit.client.0.smithi050.stdout:blogbench-1.0/src/rewriter.c 2024-08-31T04:24:43.280 INFO:tasks.workunit.client.0.smithi050.stdout:blogbench-1.0/src/reader.c 2024-08-31T04:24:43.281 INFO:tasks.workunit.client.0.smithi050.stdout:blogbench-1.0/src/writer.c 2024-08-31T04:24:43.282 INFO:tasks.workunit.client.0.smithi050.stdout:blogbench-1.0/src/helpers.c 2024-08-31T04:24:43.284 INFO:tasks.workunit.client.0.smithi050.stdout:blogbench-1.0/NEWS 2024-08-31T04:24:43.285 INFO:tasks.workunit.client.0.smithi050.stdout:blogbench-1.0/compile 2024-08-31T04:24:43.286 INFO:tasks.workunit.client.0.smithi050.stdout:blogbench-1.0/depcomp 2024-08-31T04:24:43.288 INFO:tasks.workunit.client.0.smithi050.stdout:blogbench-1.0/aclocal.m4 2024-08-31T04:24:43.289 INFO:tasks.workunit.client.0.smithi050.stdout:blogbench-1.0/README 2024-08-31T04:24:43.290 INFO:tasks.workunit.client.0.smithi050.stdout:blogbench-1.0/configure 2024-08-31T04:24:43.295 INFO:tasks.workunit.client.0.smithi050.stdout:blogbench-1.0/configure.ac 2024-08-31T04:24:43.296 INFO:tasks.workunit.client.0.smithi050.stdout:blogbench-1.0/config.guess 2024-08-31T04:24:43.297 INFO:tasks.workunit.client.0.smithi050.stdout:blogbench-1.0/install-sh 2024-08-31T04:24:43.299 INFO:tasks.workunit.client.0.smithi050.stdout:blogbench-1.0/config.sub 2024-08-31T04:24:43.300 INFO:tasks.workunit.client.0.smithi050.stdout:blogbench-1.0/missing 2024-08-31T04:24:43.301 INFO:tasks.workunit.client.0.smithi050.stdout:blogbench-1.0/mkinstalldirs 2024-08-31T04:24:43.303 INFO:tasks.workunit.client.0.smithi050.stdout:blogbench-1.0/Makefile.am 2024-08-31T04:24:43.304 INFO:tasks.workunit.client.0.smithi050.stdout:blogbench-1.0/Makefile.in 2024-08-31T04:24:43.305 INFO:tasks.workunit.client.0.smithi050.stdout:blogbench-1.0/config.h.in 2024-08-31T04:24:43.306 INFO:tasks.workunit.client.0.smithi050.stdout:blogbench-1.0/AUTHORS 2024-08-31T04:24:43.307 INFO:tasks.workunit.client.0.smithi050.stdout:blogbench-1.0/INSTALL 2024-08-31T04:24:43.309 INFO:tasks.workunit.client.0.smithi050.stdout:blogbench-1.0/ChangeLog 2024-08-31T04:24:43.310 INFO:tasks.workunit.client.0.smithi050.stdout:blogbench-1.0/COPYING 2024-08-31T04:24:43.312 INFO:tasks.workunit.client.0.smithi050.stderr:+ cd blogbench-1.0/ 2024-08-31T04:24:43.312 INFO:tasks.workunit.client.0.smithi050.stderr:+ echo 'making blogbench' 2024-08-31T04:24:43.312 INFO:tasks.workunit.client.0.smithi050.stderr:+ ./configure 2024-08-31T04:24:43.312 INFO:tasks.workunit.client.0.smithi050.stdout:making blogbench 2024-08-31T04:24:43.345 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:24:43 smithi133 ceph-mon[22177]: pgmap v421: 97 pgs: 97 active+clean; 677 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 767 B/s wr, 12 op/s 2024-08-31T04:24:43.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:24:43 smithi177 ceph-mon[22025]: pgmap v421: 97 pgs: 97 active+clean; 677 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 767 B/s wr, 12 op/s 2024-08-31T04:24:43.545 INFO:tasks.workunit.client.0.smithi050.stdout:checking for a BSD-compatible install... /usr/bin/install -c 2024-08-31T04:24:43.745 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set 'a406ef21', total seconds elapsed: 30.5 2024-08-31T04:24:44.559 INFO:tasks.workunit.client.0.smithi050.stdout:checking whether build environment is sane... yes 2024-08-31T04:24:44.577 INFO:tasks.workunit.client.0.smithi050.stdout:checking for gawk... gawk 2024-08-31T04:24:44.601 INFO:tasks.workunit.client.0.smithi050.stdout:checking whether make sets $(MAKE)... yes 2024-08-31T04:24:44.633 INFO:tasks.workunit.client.0.smithi050.stdout:checking for gcc... gcc 2024-08-31T04:24:44.722 INFO:tasks.workunit.client.0.smithi050.stdout:checking for C compiler default output file name... a.out 2024-08-31T04:24:44.727 INFO:tasks.workunit.client.0.smithi050.stdout:checking whether the C compiler works... yes 2024-08-31T04:24:44.730 INFO:tasks.workunit.client.0.smithi050.stdout:checking whether we are cross compiling... no 2024-08-31T04:24:44.789 INFO:tasks.workunit.client.0.smithi050.stdout:checking for suffix of executables... 2024-08-31T04:24:44.851 INFO:tasks.workunit.client.0.smithi050.stdout:checking for suffix of object files... o 2024-08-31T04:24:44.913 INFO:tasks.workunit.client.0.smithi050.stdout:checking whether we are using the GNU C compiler... yes 2024-08-31T04:24:44.974 INFO:tasks.workunit.client.0.smithi050.stdout:checking whether gcc accepts -g... yes 2024-08-31T04:24:45.088 INFO:tasks.workunit.client.0.smithi050.stdout:checking for gcc option to accept ANSI C... none needed 2024-08-31T04:24:45.161 INFO:tasks.workunit.client.0.smithi050.stdout:checking for style of include used by make... GNU 2024-08-31T04:24:45.297 INFO:tasks.workunit.client.0.smithi050.stdout:checking dependency style of gcc... gcc3 2024-08-31T04:24:45.297 INFO:tasks.workunit.client.0.smithi050.stdout:checking for a BSD-compatible install... /usr/bin/install -c 2024-08-31T04:24:45.394 INFO:tasks.workunit.client.0.smithi050.stdout:checking how to run the C preprocessor... gcc -E 2024-08-31T04:24:45.449 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:24:45 smithi050 ceph-mon[17259]: pgmap v422: 97 pgs: 97 active+clean; 677 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 255 B/s wr, 8 op/s 2024-08-31T04:24:45.471 INFO:tasks.workunit.client.0.smithi050.stdout:checking for egrep... grep -E 2024-08-31T04:24:45.491 INFO:tasks.workunit.client.0.smithi050.stdout:checking for AIX... no 2024-08-31T04:24:45.495 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:24:45 smithi177 ceph-mon[22025]: pgmap v422: 97 pgs: 97 active+clean; 677 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 255 B/s wr, 8 op/s 2024-08-31T04:24:45.542 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:24:45 smithi133 ceph-mon[22177]: pgmap v422: 97 pgs: 97 active+clean; 677 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 255 B/s wr, 8 op/s 2024-08-31T04:24:45.598 INFO:tasks.workunit.client.0.smithi050.stdout:checking for library containing strerror... none required 2024-08-31T04:24:45.854 INFO:tasks.workunit.client.0.smithi050.stdout:checking for ANSI C header files... yes 2024-08-31T04:24:45.933 INFO:tasks.workunit.client.0.smithi050.stdout:checking whether time.h and sys/time.h may both be included... yes 2024-08-31T04:24:46.018 INFO:tasks.workunit.client.0.smithi050.stdout:checking for sys/types.h... yes 2024-08-31T04:24:46.104 INFO:tasks.workunit.client.0.smithi050.stdout:checking for sys/stat.h... yes 2024-08-31T04:24:46.191 INFO:tasks.workunit.client.0.smithi050.stdout:checking for stdlib.h... yes 2024-08-31T04:24:46.280 INFO:tasks.workunit.client.0.smithi050.stdout:checking for string.h... yes 2024-08-31T04:24:46.370 INFO:tasks.workunit.client.0.smithi050.stdout:checking for memory.h... yes 2024-08-31T04:24:46.459 INFO:tasks.workunit.client.0.smithi050.stdout:checking for strings.h... yes 2024-08-31T04:24:46.550 INFO:tasks.workunit.client.0.smithi050.stdout:checking for inttypes.h... yes 2024-08-31T04:24:46.641 INFO:tasks.workunit.client.0.smithi050.stdout:checking for stdint.h... yes 2024-08-31T04:24:46.733 INFO:tasks.workunit.client.0.smithi050.stdout:checking for unistd.h... yes 2024-08-31T04:24:46.756 INFO:tasks.workunit.client.0.smithi050.stdout:checking for memory.h... (cached) yes 2024-08-31T04:24:46.772 INFO:tasks.workunit.client.0.smithi050.stdout:checking for strings.h... (cached) yes 2024-08-31T04:24:46.787 INFO:tasks.workunit.client.0.smithi050.stdout:checking for unistd.h... (cached) yes 2024-08-31T04:24:46.852 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:46.850+0000 7fe16ec00640 1 -- 172.21.15.50:0/936890366 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe16810b400 msgr2=0x7fe16810d8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:24:46.852 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:46.850+0000 7fe16ec00640 1 --2- 172.21.15.50:0/936890366 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe16810b400 0x7fe16810d8b0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fe160009ca0 tx=0x7fe16002a8c0 comp rx=0 tx=0).stop 2024-08-31T04:24:46.852 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:46.850+0000 7fe16ec00640 1 -- 172.21.15.50:0/936890366 shutdown_connections 2024-08-31T04:24:46.852 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:46.850+0000 7fe16ec00640 1 --2- 172.21.15.50:0/936890366 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe16810b400 0x7fe16810d8b0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:46.852 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:46.850+0000 7fe16ec00640 1 --2- 172.21.15.50:0/936890366 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe168075a90 0x7fe168075ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:46.852 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:46.850+0000 7fe16ec00640 1 --2- 172.21.15.50:0/936890366 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe168076e90 0x7fe168075550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:46.852 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:46.850+0000 7fe16ec00640 1 -- 172.21.15.50:0/936890366 >> 172.21.15.50:0/936890366 conn(0x7fe1680fedd0 msgr2=0x7fe168101260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:24:46.852 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:46.850+0000 7fe16ec00640 1 -- 172.21.15.50:0/936890366 shutdown_connections 2024-08-31T04:24:46.852 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:46.850+0000 7fe16ec00640 1 -- 172.21.15.50:0/936890366 wait complete. 2024-08-31T04:24:46.854 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:46.851+0000 7fe16ec00640 1 Processor -- start 2024-08-31T04:24:46.854 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:46.851+0000 7fe16ec00640 1 -- start start 2024-08-31T04:24:46.854 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:46.852+0000 7fe16ec00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe168075a90 0x7fe16819be80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:46.854 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:46.852+0000 7fe16ec00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe168076e90 0x7fe16819c4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:46.854 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:46.852+0000 7fe16ec00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe16810b400 0x7fe16819d0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:46.854 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:46.852+0000 7fe16ec00640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fe1681112e0 con 0x7fe168076e90 2024-08-31T04:24:46.854 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:46.852+0000 7fe16ec00640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7fe168111160 con 0x7fe168075a90 2024-08-31T04:24:46.854 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:46.852+0000 7fe16ec00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fe168111460 con 0x7fe16810b400 2024-08-31T04:24:46.854 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:46.852+0000 7fe15fe00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe168076e90 0x7fe16819c4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:24:46.854 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:46.852+0000 7fe16cc00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe16810b400 0x7fe16819d0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:24:46.855 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:46.852+0000 7fe15fe00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe168076e90 0x7fe16819c4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:57920/0 (socket says 172.21.15.50:57920) 2024-08-31T04:24:46.855 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:46.852+0000 7fe167e00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe168075a90 0x7fe16819be80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:24:46.855 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:46.852+0000 7fe15fe00640 1 -- 172.21.15.50:0/2281496743 learned_addr learned my addr 172.21.15.50:0/2281496743 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:24:46.855 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:46.853+0000 7fe16cc00640 1 -- 172.21.15.50:0/2281496743 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe168075a90 msgr2=0x7fe16819be80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:24:46.855 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:46.853+0000 7fe16cc00640 1 --2- 172.21.15.50:0/2281496743 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe168075a90 0x7fe16819be80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:46.855 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:46.853+0000 7fe16cc00640 1 -- 172.21.15.50:0/2281496743 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe168076e90 msgr2=0x7fe16819c4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:24:46.855 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:46.853+0000 7fe16cc00640 1 --2- 172.21.15.50:0/2281496743 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe168076e90 0x7fe16819c4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:46.855 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:46.853+0000 7fe16cc00640 1 -- 172.21.15.50:0/2281496743 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe16819d8c0 con 0x7fe16810b400 2024-08-31T04:24:46.856 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:46.853+0000 7fe16cc00640 1 --2- 172.21.15.50:0/2281496743 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe16810b400 0x7fe16819d0a0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fe16002aeb0 tx=0x7fe1600316f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:24:46.856 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:46.853+0000 7fe165600640 1 -- 172.21.15.50:0/2281496743 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe160003b70 con 0x7fe16810b400 2024-08-31T04:24:46.856 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:46.853+0000 7fe16ec00640 1 -- 172.21.15.50:0/2281496743 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe16819db50 con 0x7fe16810b400 2024-08-31T04:24:46.856 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:46.853+0000 7fe165600640 1 -- 172.21.15.50:0/2281496743 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe160003d10 con 0x7fe16810b400 2024-08-31T04:24:46.856 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:46.853+0000 7fe165600640 1 -- 172.21.15.50:0/2281496743 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe16002fae0 con 0x7fe16810b400 2024-08-31T04:24:46.856 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:46.854+0000 7fe16ec00640 1 -- 172.21.15.50:0/2281496743 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe1681a42a0 con 0x7fe16810b400 2024-08-31T04:24:46.857 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:46.856+0000 7fe175c65740 1 Processor -- start 2024-08-31T04:24:46.859 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:46.857+0000 7fe165600640 1 -- 172.21.15.50:0/2281496743 <== mon.1 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 18) ==== 152577+0+0 (secure 0 0 0) 0x7fe16002fc80 con 0x7fe16810b400 2024-08-31T04:24:46.859 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:46.857+0000 7fe175c65740 1 -- start start 2024-08-31T04:24:46.859 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:46.858+0000 7fe175c65740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x563a86ed51b0 0x563a8727adc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:46.859 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:46.858+0000 7fe175c65740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x563a86eac2f0 0x563a8727b430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:46.859 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:46.858+0000 7fe175c65740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563a86eb44d0 0x563a8727bf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:46.859 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:46.858+0000 7fe175c65740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x563a871edf70 con 0x563a86eb44d0 2024-08-31T04:24:46.859 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:46.858+0000 7fe175c65740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x563a871dd500 con 0x563a86eac2f0 2024-08-31T04:24:46.859 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:46.858+0000 7fe175c65740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x563a871e14b0 con 0x563a86ed51b0 2024-08-31T04:24:46.861 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:46.858+0000 7fe15fe00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x563a86ed51b0 0x563a8727adc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:24:46.861 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:46.858+0000 7fe167e00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x563a86eac2f0 0x563a8727b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:24:46.861 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:46.858+0000 7fe15fe00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x563a86ed51b0 0x563a8727adc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.50:36316/0 (socket says 172.21.15.50:36316) 2024-08-31T04:24:46.861 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:46.858+0000 7fe15fe00640 1 -- 172.21.15.50:0/1513085416 learned_addr learned my addr 172.21.15.50:0/1513085416 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:24:46.861 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:46.858+0000 7fe15fe00640 1 --2- 172.21.15.50:0/1513085416 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563a86eb44d0 0x563a8727bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:24:46.861 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:46.859+0000 7fe167e00640 1 -- 172.21.15.50:0/1513085416 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x563a86ed51b0 msgr2=0x563a8727adc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:24:46.861 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:46.859+0000 7fe167e00640 1 --2- 172.21.15.50:0/1513085416 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x563a86ed51b0 0x563a8727adc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:46.861 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:46.859+0000 7fe167e00640 1 -- 172.21.15.50:0/1513085416 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563a86eb44d0 msgr2=0x563a8727bf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:24:46.861 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:46.859+0000 7fe167e00640 1 --2- 172.21.15.50:0/1513085416 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563a86eb44d0 0x563a8727bf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:46.862 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:46.859+0000 7fe167e00640 1 -- 172.21.15.50:0/1513085416 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563a87197c10 con 0x563a86eac2f0 2024-08-31T04:24:46.862 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:46.859+0000 7fe167e00640 1 --2- 172.21.15.50:0/1513085416 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x563a86eac2f0 0x563a8727b430 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fe158009c20 tx=0x7fe158011810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b92c090a0f5d8605 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:24:46.862 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:46.859+0000 7fe15d200640 1 -- 172.21.15.50:0/1513085416 <== mon.2 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe158004050 con 0x563a86eac2f0 2024-08-31T04:24:46.862 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:46.859+0000 7fe15d200640 1 -- 172.21.15.50:0/1513085416 <== mon.2 v2:172.21.15.133:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe1580054d0 con 0x563a86eac2f0 2024-08-31T04:24:46.862 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:46.859+0000 7fe15d200640 1 -- 172.21.15.50:0/1513085416 <== mon.2 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe158004c80 con 0x563a86eac2f0 2024-08-31T04:24:46.862 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:46.859+0000 7fe165600640 1 --2- 172.21.15.50:0/2281496743 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fe14c0b4b30 0x7fe14c0b7040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:46.862 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:46.859+0000 7fe165600640 1 -- 172.21.15.50:0/2281496743 <== mon.1 v2:172.21.15.177:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8219+0+0 (secure 0 0 0) 0x7fe160106480 con 0x7fe16810b400 2024-08-31T04:24:46.862 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:46.860+0000 7fe15fe00640 1 --2- 172.21.15.50:0/2281496743 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fe14c0b4b30 0x7fe14c0b7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:24:46.864 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:46.860+0000 7fe175c65740 1 -- 172.21.15.50:0/1513085416 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x563a86eac2f0 msgr2=0x563a8727b430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:24:46.864 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:46.860+0000 7fe175c65740 1 --2- 172.21.15.50:0/1513085416 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x563a86eac2f0 0x563a8727b430 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fe158009c20 tx=0x7fe158011810 comp rx=0 tx=0).stop 2024-08-31T04:24:46.864 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:46.860+0000 7fe15fe00640 1 --2- 172.21.15.50:0/2281496743 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fe14c0b4b30 0x7fe14c0b7040 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fe150009fd0 tx=0x7fe150005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:24:46.864 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:46.860+0000 7fe175c65740 1 -- 172.21.15.50:0/1513085416 shutdown_connections 2024-08-31T04:24:46.864 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:46.860+0000 7fe175c65740 1 --2- 172.21.15.50:0/1513085416 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563a86eb44d0 0x563a8727bf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:46.865 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:46.860+0000 7fe175c65740 1 --2- 172.21.15.50:0/1513085416 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x563a86eac2f0 0x563a8727b430 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:46.865 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:46.860+0000 7fe175c65740 1 --2- 172.21.15.50:0/1513085416 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x563a86ed51b0 0x563a8727adc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:46.865 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:46.860+0000 7fe175c65740 1 -- 172.21.15.50:0/1513085416 >> 172.21.15.50:0/1513085416 conn(0x563a86ec9300 msgr2=0x563a87276850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:24:46.865 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:46.860+0000 7fe175c65740 1 -- 172.21.15.50:0/1513085416 shutdown_connections 2024-08-31T04:24:46.865 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:46.860+0000 7fe175c65740 1 -- 172.21.15.50:0/1513085416 wait complete. 2024-08-31T04:24:46.865 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:46.861+0000 7fe175c65740 1 -- start start 2024-08-31T04:24:46.866 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:46.861+0000 7fe175c65740 1 Processor -- start 2024-08-31T04:24:46.866 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:46.862+0000 7fe175c65740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563a86eac2f0 0x563a87284400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:46.866 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:46.862+0000 7fe175c65740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x563a86eb44d0 0x563a87284ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:46.866 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:46.862+0000 7fe175c65740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x563a86ed51b0 0x563a87285630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:46.866 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:46.862+0000 7fe175c65740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x563a87116ab0 con 0x563a86eac2f0 2024-08-31T04:24:46.866 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:46.862+0000 7fe175c65740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x563a87184320 con 0x563a86eb44d0 2024-08-31T04:24:46.866 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:46.862+0000 7fe175c65740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x563a8727caa0 con 0x563a86ed51b0 2024-08-31T04:24:46.866 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:46.862+0000 7fe175c65740 10 client.0 _ll_register_callbacks cb 0x563a8718a6a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:24:46.867 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:46.862+0000 7fe167e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563a86eac2f0 0x563a87284400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:24:46.867 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:46.862+0000 7fe15fe00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x563a86eb44d0 0x563a87284ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:24:46.867 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:46.862+0000 7fe167e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563a86eac2f0 0x563a87284400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:57942/0 (socket says 172.21.15.50:57942) 2024-08-31T04:24:46.867 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:46.862+0000 7fe167e00640 1 -- 172.21.15.50:0/2116191286 learned_addr learned my addr 172.21.15.50:0/2116191286 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:24:46.867 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:46.862+0000 7fe16cc00640 1 --2- 172.21.15.50:0/2116191286 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x563a86ed51b0 0x563a87285630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:24:46.867 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:46.863+0000 7fe167e00640 1 -- 172.21.15.50:0/2116191286 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x563a86ed51b0 msgr2=0x563a87285630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:24:46.867 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:46.863+0000 7fe167e00640 1 --2- 172.21.15.50:0/2116191286 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x563a86ed51b0 0x563a87285630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:46.867 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:46.863+0000 7fe167e00640 1 -- 172.21.15.50:0/2116191286 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x563a86eb44d0 msgr2=0x563a87284ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:24:46.867 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:46.863+0000 7fe167e00640 1 --2- 172.21.15.50:0/2116191286 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x563a86eb44d0 0x563a87284ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:46.867 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:46.863+0000 7fe167e00640 1 -- 172.21.15.50:0/2116191286 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563a86f40790 con 0x563a86eac2f0 2024-08-31T04:24:46.867 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:46.863+0000 7fe16cc00640 1 --2- 172.21.15.50:0/2116191286 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x563a86ed51b0 0x563a87285630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:24:46.867 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:46.863+0000 7fe167e00640 1 --2- 172.21.15.50:0/2116191286 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563a86eac2f0 0x563a87284400 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fe15801b040 tx=0x7fe158009850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50fc8b79a460d74a server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:24:46.867 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:46.863+0000 7fe155600640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-08-31T04:24:46.869 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:46.863+0000 7fe155600640 1 -- 172.21.15.50:0/2116191286 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe158029070 con 0x563a86eac2f0 2024-08-31T04:24:46.870 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:46.863+0000 7fe155600640 1 -- 172.21.15.50:0/2116191286 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8219+0+0 (secure 0 0 0) 0x7fe158003a00 con 0x563a86eac2f0 2024-08-31T04:24:46.870 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:46.863+0000 7fe175c65740 1 -- 172.21.15.50:0/2116191286 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe1580054d0 con 0x563a86eac2f0 2024-08-31T04:24:46.870 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:46.864+0000 7fe155600640 1 -- 172.21.15.50:0/2116191286 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fe158035050 con 0x563a86eac2f0 2024-08-31T04:24:46.870 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:46.864+0000 7fe175c65740 10 client.15624 fetch_fsmap learned FSMap version 29 2024-08-31T04:24:46.870 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:46.864+0000 7fe175c65740 1 -- 172.21.15.50:0/2116191286 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x563a86fb9620 con 0x563a86eac2f0 2024-08-31T04:24:46.870 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:46.864+0000 7fe155600640 1 -- 172.21.15.50:0/2116191286 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe1580054d0 con 0x563a86eac2f0 2024-08-31T04:24:46.870 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:46.864+0000 7fe155600640 1 -- 172.21.15.50:0/2116191286 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7fe158023430 con 0x563a86eac2f0 2024-08-31T04:24:46.870 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:46.864+0000 7fe175c65740 10 client.15624 fetch_fsmap finished waiting for FSMap version 29 2024-08-31T04:24:46.870 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:46.864+0000 7fe175c65740 10 client.15624 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T04:24:46.870 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:46.864+0000 7fe175c65740 20 client.15624 populate_metadata read hostname 'smithi050' 2024-08-31T04:24:46.870 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:46.864+0000 7fe175c65740 1 --2- 172.21.15.50:0/2116191286 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x563a86e93d80 0x563a872918e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:46.870 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:46.864+0000 7fe175c65740 4 client.15624 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T04:24:46.870 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:46.864+0000 7fe175c65740 1 -- 172.21.15.50:0/2116191286 --> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563a871efec0 con 0x563a86e93d80 2024-08-31T04:24:46.871 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:46.865+0000 7fe15fe00640 1 --2- 172.21.15.50:0/2116191286 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x563a86e93d80 0x563a872918e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:24:46.871 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:46.865+0000 7fe15fe00640 1 --2- 172.21.15.50:0/2116191286 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x563a86e93d80 0x563a872918e0 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ab312f47a76bfdf5 server_cookie=9b2421765593ba6f in_seq=0 out_seq=0 2024-08-31T04:24:46.871 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:46.865+0000 7fe155600640 10 client.15624 ms_handle_connect on v2:172.21.15.133:6838/2526402262 2024-08-31T04:24:46.871 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:46.867+0000 7fe155600640 1 -- 172.21.15.50:0/2116191286 <== mds.0 v2:172.21.15.133:6838/2526402262 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x563a871efec0 con 0x563a86e93d80 2024-08-31T04:24:46.871 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:46.867+0000 7fe155600640 10 client.15624 handle_command_reply: tid=0 2024-08-31T04:24:46.871 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:46.867+0000 7fe175c65740 1 client.15624 shutdown 2024-08-31T04:24:46.871 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:46.867+0000 7fe175c65740 1 -- 172.21.15.50:0/2116191286 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563a86eac2f0 msgr2=0x563a87284400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:24:46.871 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:46.867+0000 7fe175c65740 1 --2- 172.21.15.50:0/2116191286 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563a86eac2f0 0x563a87284400 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fe15801b040 tx=0x7fe158009850 comp rx=0 tx=0).stop 2024-08-31T04:24:46.871 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:46.867+0000 7fe175c65740 1 -- 172.21.15.50:0/2116191286 shutdown_connections 2024-08-31T04:24:46.871 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:46.867+0000 7fe175c65740 1 --2- 172.21.15.50:0/2116191286 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x563a86e93d80 0x563a872918e0 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:46.871 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:46.867+0000 7fe175c65740 1 --2- 172.21.15.50:0/2116191286 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x563a86ed51b0 0x563a87285630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:46.871 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:46.867+0000 7fe175c65740 1 --2- 172.21.15.50:0/2116191286 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x563a86eb44d0 0x563a87284ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:46.871 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:46.867+0000 7fe175c65740 1 --2- 172.21.15.50:0/2116191286 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563a86eac2f0 0x563a87284400 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:46.871 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:46.867+0000 7fe155600640 0 client.15624 ms_handle_reset on v2:172.21.15.133:6838/2526402262 2024-08-31T04:24:46.871 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:46.867+0000 7fe175c65740 1 -- 172.21.15.50:0/2116191286 >> 172.21.15.50:0/2116191286 conn(0x563a86ec9300 msgr2=0x563a87274cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:24:46.872 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:46.867+0000 7fe175c65740 1 -- 172.21.15.50:0/2116191286 shutdown_connections 2024-08-31T04:24:46.872 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:46.867+0000 7fe175c65740 1 -- 172.21.15.50:0/2116191286 wait complete. 2024-08-31T04:24:46.872 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:46.868+0000 7fe175c65740 20 client.15624 trim_cache size 0 max 16384 2024-08-31T04:24:46.884 INFO:tasks.workunit.client.0.smithi050.stdout:checking locale.h usability... yes 2024-08-31T04:24:46.888 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:46.887+0000 7fe175c65740 1 Processor -- start 2024-08-31T04:24:46.888 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:46.887+0000 7fe175c65740 1 -- start start 2024-08-31T04:24:46.889 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:46.887+0000 7fe175c65740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x563a86eac2f0 0x563a87276190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:46.889 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:46.887+0000 7fe175c65740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x563a86eb44d0 0x563a87282910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:46.890 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:46.887+0000 7fe175c65740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563a86ed51b0 0x563a87282e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:46.890 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:46.887+0000 7fe175c65740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fe1681ace00 con 0x563a86ed51b0 2024-08-31T04:24:46.890 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:46.887+0000 7fe175c65740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7fe1681ae940 con 0x563a86eb44d0 2024-08-31T04:24:46.890 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:46.887+0000 7fe175c65740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fe1681ad4d0 con 0x563a86eac2f0 2024-08-31T04:24:46.890 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:46.887+0000 7fe15fe00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x563a86eb44d0 0x563a87282910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:24:46.890 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:46.887+0000 7fe15fe00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x563a86eb44d0 0x563a87282910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.50:60450/0 (socket says 172.21.15.50:60450) 2024-08-31T04:24:46.890 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:46.888+0000 7fe15fe00640 1 -- 172.21.15.50:0/2518339403 learned_addr learned my addr 172.21.15.50:0/2518339403 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:24:46.890 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:46.888+0000 7fe16cc00640 1 --2- 172.21.15.50:0/2518339403 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563a86ed51b0 0x563a87282e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:24:46.890 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:46.888+0000 7fe167e00640 1 --2- 172.21.15.50:0/2518339403 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x563a86eac2f0 0x563a87276190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:24:46.890 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:46.888+0000 7fe15fe00640 1 -- 172.21.15.50:0/2518339403 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x563a86eac2f0 msgr2=0x563a87276190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:24:46.890 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:46.888+0000 7fe15fe00640 1 --2- 172.21.15.50:0/2518339403 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x563a86eac2f0 0x563a87276190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:46.890 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:46.888+0000 7fe15fe00640 1 -- 172.21.15.50:0/2518339403 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563a86ed51b0 msgr2=0x563a87282e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:24:46.891 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:46.888+0000 7fe15fe00640 1 --2- 172.21.15.50:0/2518339403 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563a86ed51b0 0x563a87282e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:46.891 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:46.888+0000 7fe15fe00640 1 -- 172.21.15.50:0/2518339403 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563a87291c50 con 0x563a86eb44d0 2024-08-31T04:24:46.891 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:46.888+0000 7fe15fe00640 1 --2- 172.21.15.50:0/2518339403 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x563a86eb44d0 0x563a87282910 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x563a87292030 tx=0x7fe1500046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=63f42b3b56b55ed3 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:24:46.891 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:46.888+0000 7fe157e00640 1 -- 172.21.15.50:0/2518339403 <== mon.2 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe150004490 con 0x563a86eb44d0 2024-08-31T04:24:46.891 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:46.888+0000 7fe157e00640 1 -- 172.21.15.50:0/2518339403 <== mon.2 v2:172.21.15.133:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe15000fd40 con 0x563a86eb44d0 2024-08-31T04:24:46.891 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:46.888+0000 7fe157e00640 1 -- 172.21.15.50:0/2518339403 <== mon.2 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe15002ec00 con 0x563a86eb44d0 2024-08-31T04:24:46.893 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:46.889+0000 7fe175c65740 1 -- 172.21.15.50:0/2518339403 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x563a86eb44d0 msgr2=0x563a87282910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:24:46.893 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:46.889+0000 7fe175c65740 1 --2- 172.21.15.50:0/2518339403 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x563a86eb44d0 0x563a87282910 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x563a87292030 tx=0x7fe1500046c0 comp rx=0 tx=0).stop 2024-08-31T04:24:46.893 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:46.889+0000 7fe175c65740 1 -- 172.21.15.50:0/2518339403 shutdown_connections 2024-08-31T04:24:46.893 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:46.889+0000 7fe175c65740 1 --2- 172.21.15.50:0/2518339403 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563a86ed51b0 0x563a87282e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:46.894 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:46.889+0000 7fe175c65740 1 --2- 172.21.15.50:0/2518339403 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x563a86eb44d0 0x563a87282910 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:46.894 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:46.889+0000 7fe175c65740 1 --2- 172.21.15.50:0/2518339403 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x563a86eac2f0 0x563a87276190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:46.894 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:46.889+0000 7fe175c65740 1 -- 172.21.15.50:0/2518339403 >> 172.21.15.50:0/2518339403 conn(0x563a86ec9300 msgr2=0x563a8727ad60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:24:46.894 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:46.890+0000 7fe175c65740 1 -- 172.21.15.50:0/2518339403 shutdown_connections 2024-08-31T04:24:46.894 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:46.890+0000 7fe175c65740 1 -- 172.21.15.50:0/2518339403 wait complete. 2024-08-31T04:24:46.894 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:46.890+0000 7fe175c65740 1 -- start start 2024-08-31T04:24:46.894 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:46.890+0000 7fe175c65740 1 Processor -- start 2024-08-31T04:24:46.894 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:46.891+0000 7fe175c65740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x563a86eac2f0 0x563a8728bec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:46.894 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:46.891+0000 7fe175c65740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563a86eb44d0 0x563a8728ac90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:46.894 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:46.891+0000 7fe175c65740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x563a86ed51b0 0x563a8728b380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:46.894 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:46.891+0000 7fe175c65740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fe1681ae270 con 0x563a86eb44d0 2024-08-31T04:24:46.894 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:46.891+0000 7fe175c65740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7fe1681adba0 con 0x563a86eac2f0 2024-08-31T04:24:46.894 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:46.891+0000 7fe175c65740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fe1681aade0 con 0x563a86ed51b0 2024-08-31T04:24:46.895 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:46.891+0000 7fe175c65740 10 client.0 _ll_register_callbacks cb 0x7fe158009a70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:24:46.895 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:46.891+0000 7fe167e00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x563a86eac2f0 0x563a8728bec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:24:46.895 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:46.891+0000 7fe167e00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x563a86eac2f0 0x563a8728bec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.50:60458/0 (socket says 172.21.15.50:60458) 2024-08-31T04:24:46.895 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:46.891+0000 7fe167e00640 1 -- 172.21.15.50:0/1478766017 learned_addr learned my addr 172.21.15.50:0/1478766017 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:24:46.895 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:46.891+0000 7fe15fe00640 1 --2- 172.21.15.50:0/1478766017 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563a86eb44d0 0x563a8728ac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:24:46.895 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:46.891+0000 7fe16cc00640 1 --2- 172.21.15.50:0/1478766017 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x563a86ed51b0 0x563a8728b380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:24:46.895 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:46.891+0000 7fe167e00640 1 -- 172.21.15.50:0/1478766017 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x563a86ed51b0 msgr2=0x563a8728b380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:24:46.895 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:46.891+0000 7fe167e00640 1 --2- 172.21.15.50:0/1478766017 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x563a86ed51b0 0x563a8728b380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:46.895 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:46.891+0000 7fe167e00640 1 -- 172.21.15.50:0/1478766017 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563a86eb44d0 msgr2=0x563a8728ac90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:24:46.895 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:46.891+0000 7fe167e00640 1 --2- 172.21.15.50:0/1478766017 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563a86eb44d0 0x563a8728ac90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:46.895 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:46.891+0000 7fe167e00640 1 -- 172.21.15.50:0/1478766017 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563a87289800 con 0x563a86eac2f0 2024-08-31T04:24:46.895 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:46.892+0000 7fe167e00640 1 --2- 172.21.15.50:0/1478766017 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x563a86eac2f0 0x563a8728bec0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fe158009380 tx=0x7fe158009940 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6cb4b83ee68736f6 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:24:46.895 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:46.892+0000 7fe155600640 10 client.0 ms_handle_connect on v2:172.21.15.133:3300/0 2024-08-31T04:24:46.895 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:46.892+0000 7fe155600640 1 -- 172.21.15.50:0/1478766017 <== mon.2 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe15803d020 con 0x563a86eac2f0 2024-08-31T04:24:46.896 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:46.892+0000 7fe175c65740 1 -- 172.21.15.50:0/1478766017 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe15000fd40 con 0x563a86eac2f0 2024-08-31T04:24:46.896 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:46.892+0000 7fe155600640 1 -- 172.21.15.50:0/1478766017 <== mon.2 v2:172.21.15.133:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8219+0+0 (secure 0 0 0) 0x7fe158003800 con 0x563a86eac2f0 2024-08-31T04:24:46.896 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:46.892+0000 7fe155600640 1 -- 172.21.15.50:0/1478766017 <== mon.2 v2:172.21.15.133:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fe158029040 con 0x563a86eac2f0 2024-08-31T04:24:46.896 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:46.892+0000 7fe175c65740 10 client.25637 fetch_fsmap learned FSMap version 29 2024-08-31T04:24:46.896 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:46.892+0000 7fe175c65740 1 -- 172.21.15.50:0/1478766017 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x563a872fc590 con 0x563a86eac2f0 2024-08-31T04:24:46.897 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:46.892+0000 7fe155600640 1 -- 172.21.15.50:0/1478766017 <== mon.2 v2:172.21.15.133:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe15000fd40 con 0x563a86eac2f0 2024-08-31T04:24:46.897 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:46.893+0000 7fe155600640 1 -- 172.21.15.50:0/1478766017 <== mon.2 v2:172.21.15.133:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7fe15802e6e0 con 0x563a86eac2f0 2024-08-31T04:24:46.897 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:46.893+0000 7fe175c65740 10 client.25637 fetch_fsmap finished waiting for FSMap version 29 2024-08-31T04:24:46.897 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:46.893+0000 7fe175c65740 10 client.25637 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T04:24:46.897 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:46.893+0000 7fe175c65740 20 client.25637 populate_metadata read hostname 'smithi050' 2024-08-31T04:24:46.897 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:46.893+0000 7fe175c65740 1 --2- 172.21.15.50:0/1478766017 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x563a86e691c0 0x563a872fef80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:24:46.897 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:46.893+0000 7fe175c65740 4 client.25637 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-31T04:24:46.897 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:46.893+0000 7fe175c65740 1 -- 172.21.15.50:0/1478766017 --> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] -- command(tid 0: {"prefix": "flush journal"}) -- 0x563a871eb960 con 0x563a86e691c0 2024-08-31T04:24:46.897 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:46.893+0000 7fe15fe00640 1 --2- 172.21.15.50:0/1478766017 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x563a86e691c0 0x563a872fef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:24:46.897 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:46.894+0000 7fe15fe00640 1 --2- 172.21.15.50:0/1478766017 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x563a86e691c0 0x563a872fef80 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5ca67832f7a23d60 server_cookie=eb8e10a6c999c762 in_seq=0 out_seq=0 2024-08-31T04:24:46.897 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:46.894+0000 7fe155600640 10 client.25637 ms_handle_connect on v2:172.21.15.133:6838/2526402262 2024-08-31T04:24:46.942 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:46.941+0000 7fe155600640 1 -- 172.21.15.50:0/1478766017 <== mds.0 v2:172.21.15.133:6838/2526402262 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x563a871eb960 con 0x563a86e691c0 2024-08-31T04:24:46.943 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:46.941+0000 7fe155600640 10 client.25637 handle_command_reply: tid=0 2024-08-31T04:24:46.943 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:46.941+0000 7fe175c65740 1 client.25637 shutdown 2024-08-31T04:24:46.943 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:46.941+0000 7fe175c65740 1 -- 172.21.15.50:0/1478766017 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x563a86eac2f0 msgr2=0x563a8728bec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:24:46.943 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:46.941+0000 7fe175c65740 1 --2- 172.21.15.50:0/1478766017 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x563a86eac2f0 0x563a8728bec0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fe158009380 tx=0x7fe158009940 comp rx=0 tx=0).stop 2024-08-31T04:24:46.943 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:46.941+0000 7fe175c65740 1 -- 172.21.15.50:0/1478766017 shutdown_connections 2024-08-31T04:24:46.943 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:46.941+0000 7fe175c65740 1 --2- 172.21.15.50:0/1478766017 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x563a86e691c0 0x563a872fef80 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:46.943 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:46.941+0000 7fe175c65740 1 --2- 172.21.15.50:0/1478766017 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x563a86ed51b0 0x563a8728b380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:46.943 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:46.941+0000 7fe175c65740 1 --2- 172.21.15.50:0/1478766017 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563a86eb44d0 0x563a8728ac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:46.943 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:46.941+0000 7fe175c65740 1 --2- 172.21.15.50:0/1478766017 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x563a86eac2f0 0x563a8728bec0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:46.943 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:46.941+0000 7fe155600640 0 client.25637 ms_handle_reset on v2:172.21.15.133:6838/2526402262 2024-08-31T04:24:46.943 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:46.941+0000 7fe175c65740 1 -- 172.21.15.50:0/1478766017 >> 172.21.15.50:0/1478766017 conn(0x563a86ec9300 msgr2=0x563a87275380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:24:46.943 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:46.941+0000 7fe175c65740 1 -- 172.21.15.50:0/1478766017 shutdown_connections 2024-08-31T04:24:46.944 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:46.941+0000 7fe175c65740 1 -- 172.21.15.50:0/1478766017 wait complete. 2024-08-31T04:24:46.944 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:46.941+0000 7fe175c65740 20 client.25637 trim_cache size 0 max 16384 2024-08-31T04:24:46.944 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout:{ 2024-08-31T04:24:46.944 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout: "message": "", 2024-08-31T04:24:46.944 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout: "return_code": 0 2024-08-31T04:24:46.944 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout:} 2024-08-31T04:24:46.945 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:46.942+0000 7fe16ec00640 1 -- 172.21.15.50:0/2281496743 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fe14c0b4b30 msgr2=0x7fe14c0b7040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:24:46.945 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:46.942+0000 7fe16ec00640 1 --2- 172.21.15.50:0/2281496743 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fe14c0b4b30 0x7fe14c0b7040 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fe150009fd0 tx=0x7fe150005f90 comp rx=0 tx=0).stop 2024-08-31T04:24:46.945 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:46.942+0000 7fe16ec00640 1 -- 172.21.15.50:0/2281496743 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe16810b400 msgr2=0x7fe16819d0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:24:46.945 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:46.942+0000 7fe16ec00640 1 --2- 172.21.15.50:0/2281496743 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe16810b400 0x7fe16819d0a0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fe16002aeb0 tx=0x7fe1600316f0 comp rx=0 tx=0).stop 2024-08-31T04:24:46.945 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:46.942+0000 7fe16ec00640 1 -- 172.21.15.50:0/2281496743 shutdown_connections 2024-08-31T04:24:46.945 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:46.942+0000 7fe16ec00640 1 --2- 172.21.15.50:0/2281496743 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fe14c0b4b30 0x7fe14c0b7040 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:46.945 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:46.942+0000 7fe16ec00640 1 --2- 172.21.15.50:0/2281496743 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe16810b400 0x7fe16819d0a0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:46.946 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:46.942+0000 7fe16ec00640 1 --2- 172.21.15.50:0/2281496743 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe168076e90 0x7fe16819c4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:46.946 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:46.942+0000 7fe16ec00640 1 --2- 172.21.15.50:0/2281496743 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe168075a90 0x7fe16819be80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:24:46.946 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:46.942+0000 7fe16ec00640 1 -- 172.21.15.50:0/2281496743 >> 172.21.15.50:0/2281496743 conn(0x7fe1680fedd0 msgr2=0x7fe168101260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:24:46.946 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:46.942+0000 7fe16ec00640 1 -- 172.21.15.50:0/2281496743 shutdown_connections 2024-08-31T04:24:46.946 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:24:46.943+0000 7fe16ec00640 1 -- 172.21.15.50:0/2281496743 wait complete. 2024-08-31T04:24:46.949 INFO:tasks.workunit.client.0.smithi050.stdout:checking locale.h presence... yes 2024-08-31T04:24:46.951 INFO:tasks.workunit.client.0.smithi050.stdout:checking for locale.h... yes 2024-08-31T04:24:46.973 INFO:tasks.workunit.client.0.smithi050.stdout:checking for stdlib.h... (cached) yes 2024-08-31T04:24:46.987 INFO:tasks.workunit.client.0.smithi050.stdout:checking for string.h... (cached) yes 2024-08-31T04:24:47.113 INFO:tasks.workunit.client.0.smithi050.stdout:checking sys/socket.h usability... yes 2024-08-31T04:24:47.154 INFO:tasks.workunit.client.0.smithi050.stdout:checking sys/socket.h presence... yes 2024-08-31T04:24:47.156 INFO:tasks.workunit.client.0.smithi050.stdout:checking for sys/socket.h... yes 2024-08-31T04:24:47.253 INFO:tasks.workunit.client.0.smithi050.stdout:checking sys/time.h usability... yes 2024-08-31T04:24:47.290 INFO:tasks.workunit.client.0.smithi050.stdout:checking sys/time.h presence... yes 2024-08-31T04:24:47.292 INFO:tasks.workunit.client.0.smithi050.stdout:checking for sys/time.h... yes 2024-08-31T04:24:47.390 INFO:tasks.workunit.client.0.smithi050.stdout:checking fcntl.h usability... yes 2024-08-31T04:24:47.427 INFO:tasks.workunit.client.0.smithi050.stdout:checking fcntl.h presence... yes 2024-08-31T04:24:47.429 INFO:tasks.workunit.client.0.smithi050.stdout:checking for fcntl.h... yes 2024-08-31T04:24:47.450 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:24:47 smithi050 ceph-mon[17259]: pgmap v423: 97 pgs: 97 active+clean; 677 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 767 B/s wr, 11 op/s 2024-08-31T04:24:47.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:24:47 smithi177 ceph-mon[22025]: pgmap v423: 97 pgs: 97 active+clean; 677 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 767 B/s wr, 11 op/s 2024-08-31T04:24:47.538 INFO:tasks.workunit.client.0.smithi050.stdout:checking sys/fcntl.h usability... yes 2024-08-31T04:24:47.542 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:24:47 smithi133 ceph-mon[22177]: pgmap v423: 97 pgs: 97 active+clean; 677 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 767 B/s wr, 11 op/s 2024-08-31T04:24:47.576 INFO:tasks.workunit.client.0.smithi050.stdout:checking sys/fcntl.h presence... yes 2024-08-31T04:24:47.578 INFO:tasks.workunit.client.0.smithi050.stdout:checking for sys/fcntl.h... yes 2024-08-31T04:24:47.730 INFO:tasks.workunit.client.0.smithi050.stdout:checking sys/param.h usability... yes 2024-08-31T04:24:47.773 INFO:tasks.workunit.client.0.smithi050.stdout:checking sys/param.h presence... yes 2024-08-31T04:24:47.775 INFO:tasks.workunit.client.0.smithi050.stdout:checking for sys/param.h... yes 2024-08-31T04:24:47.857 INFO:tasks.workunit.client.0.smithi050.stdout:checking ioctl.h usability... no 2024-08-31T04:24:47.894 INFO:tasks.workunit.client.0.smithi050.stdout:checking ioctl.h presence... no 2024-08-31T04:24:47.896 INFO:tasks.workunit.client.0.smithi050.stdout:checking for ioctl.h... no 2024-08-31T04:24:47.990 INFO:tasks.workunit.client.0.smithi050.stdout:checking sys/ioctl.h usability... yes 2024-08-31T04:24:48.031 INFO:tasks.workunit.client.0.smithi050.stdout:checking sys/ioctl.h presence... yes 2024-08-31T04:24:48.033 INFO:tasks.workunit.client.0.smithi050.stdout:checking for sys/ioctl.h... yes 2024-08-31T04:24:48.119 INFO:tasks.workunit.client.0.smithi050.stdout:checking return type of signal handlers... void 2024-08-31T04:24:48.198 INFO:tasks.workunit.client.0.smithi050.stdout:checking for size_t... yes 2024-08-31T04:24:48.267 INFO:tasks.workunit.client.0.smithi050.stdout:checking for dev_t... yes 2024-08-31T04:24:48.373 INFO:tasks.workunit.client.0.smithi050.stdout:checking for short... yes 2024-08-31T04:24:48.500 INFO:tasks.workunit.client.0.smithi050.stdout:checking size of short... 2 2024-08-31T04:24:48.580 INFO:tasks.workunit.client.0.smithi050.stdout:checking for int... yes 2024-08-31T04:24:48.686 INFO:tasks.workunit.client.0.smithi050.stdout:checking size of int... 4 2024-08-31T04:24:48.765 INFO:tasks.workunit.client.0.smithi050.stdout:checking for long... yes 2024-08-31T04:24:48.872 INFO:tasks.workunit.client.0.smithi050.stdout:checking size of long... 8 2024-08-31T04:24:48.952 INFO:tasks.workunit.client.0.smithi050.stdout:checking for long long... yes 2024-08-31T04:24:49.072 INFO:tasks.workunit.client.0.smithi050.stdout:checking size of long long... 8 2024-08-31T04:24:49.155 INFO:tasks.workunit.client.0.smithi050.stdout:checking for ssize_t... yes 2024-08-31T04:24:49.230 INFO:tasks.workunit.client.0.smithi050.stdout:checking for sig_atomic_t... yes 2024-08-31T04:24:49.312 INFO:tasks.workunit.client.0.smithi050.stdout:checking whether gcc needs -traditional... no 2024-08-31T04:24:49.377 INFO:tasks.workunit.client.0.smithi050.stdout:checking for an ANSI C-conforming const... yes 2024-08-31T04:24:49.428 INFO:tasks.workunit.client.0.smithi050.stdout:checking for inline... inline 2024-08-31T04:24:49.449 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:24:49 smithi050 ceph-mon[17259]: pgmap v424: 97 pgs: 97 active+clean; 1.3 MiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 60 KiB/s wr, 19 op/s 2024-08-31T04:24:49.495 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:24:49 smithi177 ceph-mon[22025]: pgmap v424: 97 pgs: 97 active+clean; 1.3 MiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 60 KiB/s wr, 19 op/s 2024-08-31T04:24:49.529 INFO:tasks.workunit.client.0.smithi050.stdout:checking for working alloca.h... yes 2024-08-31T04:24:49.542 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:24:49 smithi133 ceph-mon[22177]: pgmap v424: 97 pgs: 97 active+clean; 1.3 MiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 60 KiB/s wr, 19 op/s 2024-08-31T04:24:49.618 INFO:tasks.workunit.client.0.smithi050.stdout:checking for alloca... yes 2024-08-31T04:24:49.726 INFO:tasks.workunit.client.0.smithi050.stdout:checking for working memcmp... yes 2024-08-31T04:24:49.823 INFO:tasks.workunit.client.0.smithi050.stdout:checking for strftime... yes 2024-08-31T04:24:49.950 INFO:tasks.workunit.client.0.smithi050.stdout:checking whether lstat dereferences a symlink specified with a trailing slash... yes 2024-08-31T04:24:50.050 INFO:tasks.workunit.client.0.smithi050.stdout:checking whether stat accepts an empty string... no 2024-08-31T04:24:50.146 INFO:tasks.workunit.client.0.smithi050.stdout:checking for vprintf... yes 2024-08-31T04:24:50.242 INFO:tasks.workunit.client.0.smithi050.stdout:checking for _doprnt... no 2024-08-31T04:24:50.293 INFO:tasks.workunit.client.0.smithi050.stdout:checking build system type... x86_64-unknown-linux-gnu 2024-08-31T04:24:50.322 INFO:tasks.workunit.client.0.smithi050.stdout:checking host system type... x86_64-unknown-linux-gnu 2024-08-31T04:24:50.430 INFO:tasks.workunit.client.0.smithi050.stdout:checking for the pthreads library -lpthreads... no 2024-08-31T04:24:50.523 INFO:tasks.workunit.client.0.smithi050.stdout:checking whether pthreads work without any flags... yes 2024-08-31T04:24:50.607 INFO:tasks.workunit.client.0.smithi050.stdout:checking for joinable pthread attribute... PTHREAD_CREATE_JOINABLE 2024-08-31T04:24:50.607 INFO:tasks.workunit.client.0.smithi050.stdout:checking if more special flags are required for pthreads... no 2024-08-31T04:24:50.607 INFO:tasks.workunit.client.0.smithi050.stdout:checking for cc_r... gcc 2024-08-31T04:24:50.724 INFO:tasks.workunit.client.0.smithi050.stdout:checking for setrlimit... yes 2024-08-31T04:24:50.828 INFO:tasks.workunit.client.0.smithi050.stdout:checking for setproctitle... no 2024-08-31T04:24:50.929 INFO:tasks.workunit.client.0.smithi050.stdout:checking for getopt_long... yes 2024-08-31T04:24:51.041 INFO:tasks.workunit.client.0.smithi050.stdout:checking for strtoull... yes 2024-08-31T04:24:51.146 INFO:tasks.workunit.client.0.smithi050.stdout:checking for strtoq... yes 2024-08-31T04:24:51.254 INFO:tasks.workunit.client.0.smithi050.stdout:checking for snprintf... yes 2024-08-31T04:24:51.360 INFO:tasks.workunit.client.0.smithi050.stdout:checking for vsnprintf... yes 2024-08-31T04:24:51.449 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:24:51 smithi050 ceph-mon[17259]: pgmap v425: 97 pgs: 97 active+clean; 1.8 MiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 98 KiB/s wr, 26 op/s 2024-08-31T04:24:51.468 INFO:tasks.workunit.client.0.smithi050.stdout:checking for vfprintf... yes 2024-08-31T04:24:51.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:24:51 smithi177 ceph-mon[22025]: pgmap v425: 97 pgs: 97 active+clean; 1.8 MiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 98 KiB/s wr, 26 op/s 2024-08-31T04:24:51.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:24:51 smithi133 ceph-mon[22177]: pgmap v425: 97 pgs: 97 active+clean; 1.8 MiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 98 KiB/s wr, 26 op/s 2024-08-31T04:24:51.576 INFO:tasks.workunit.client.0.smithi050.stdout:checking for gethostname... yes 2024-08-31T04:24:51.683 INFO:tasks.workunit.client.0.smithi050.stdout:checking for setlocale... yes 2024-08-31T04:24:51.789 INFO:tasks.workunit.client.0.smithi050.stdout:checking for sync... yes 2024-08-31T04:24:51.895 INFO:tasks.workunit.client.0.smithi050.stdout:checking whether snprintf is C99 conformant... done 2024-08-31T04:24:51.916 INFO:tasks.workunit.client.0.smithi050.stdout:configure: creating ./config.status 2024-08-31T04:24:52.205 INFO:tasks.workunit.client.0.smithi050.stdout:config.status: creating Makefile 2024-08-31T04:24:52.245 INFO:tasks.workunit.client.0.smithi050.stdout:config.status: creating src/Makefile 2024-08-31T04:24:52.284 INFO:tasks.workunit.client.0.smithi050.stdout:config.status: creating man/Makefile 2024-08-31T04:24:52.305 INFO:tasks.workunit.client.0.smithi050.stdout:config.status: creating config.h 2024-08-31T04:24:52.392 INFO:tasks.workunit.client.0.smithi050.stdout:config.status: executing depfiles commands 2024-08-31T04:24:52.669 INFO:tasks.workunit.client.0.smithi050.stderr:+ make 2024-08-31T04:24:52.680 INFO:tasks.workunit.client.0.smithi050.stdout:make all-recursive 2024-08-31T04:24:52.684 INFO:tasks.workunit.client.0.smithi050.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/mnt.0/client.0/tmp/blogbench-1.0' 2024-08-31T04:24:52.689 INFO:tasks.workunit.client.0.smithi050.stdout:Making all in src 2024-08-31T04:24:52.699 INFO:tasks.workunit.client.0.smithi050.stdout:make[2]: Entering directory '/home/ubuntu/cephtest/mnt.0/client.0/tmp/blogbench-1.0/src' 2024-08-31T04:24:52.699 INFO:tasks.workunit.client.0.smithi050.stdout:if gcc -DHAVE_CONFIG_H -I. -I. -I.. -g -O2 -MT blogbench.o -MD -MP -MF ".deps/blogbench.Tpo" -c -o blogbench.o blogbench.c; \ 2024-08-31T04:24:52.699 INFO:tasks.workunit.client.0.smithi050.stdout:then mv -f ".deps/blogbench.Tpo" ".deps/blogbench.Po"; else rm -f ".deps/blogbench.Tpo"; exit 1; fi 2024-08-31T04:24:52.838 INFO:tasks.workunit.client.0.smithi050.stdout:if gcc -DHAVE_CONFIG_H -I. -I. -I.. -g -O2 -MT process.o -MD -MP -MF ".deps/process.Tpo" -c -o process.o process.c; \ 2024-08-31T04:24:52.838 INFO:tasks.workunit.client.0.smithi050.stdout:then mv -f ".deps/process.Tpo" ".deps/process.Po"; else rm -f ".deps/process.Tpo"; exit 1; fi 2024-08-31T04:24:52.934 INFO:tasks.workunit.client.0.smithi050.stdout:if gcc -DHAVE_CONFIG_H -I. -I. -I.. -g -O2 -MT writer.o -MD -MP -MF ".deps/writer.Tpo" -c -o writer.o writer.c; \ 2024-08-31T04:24:52.934 INFO:tasks.workunit.client.0.smithi050.stdout:then mv -f ".deps/writer.Tpo" ".deps/writer.Po"; else rm -f ".deps/writer.Tpo"; exit 1; fi 2024-08-31T04:24:53.015 INFO:tasks.workunit.client.0.smithi050.stdout:if gcc -DHAVE_CONFIG_H -I. -I. -I.. -g -O2 -MT rewriter.o -MD -MP -MF ".deps/rewriter.Tpo" -c -o rewriter.o rewriter.c; \ 2024-08-31T04:24:53.015 INFO:tasks.workunit.client.0.smithi050.stdout:then mv -f ".deps/rewriter.Tpo" ".deps/rewriter.Po"; else rm -f ".deps/rewriter.Tpo"; exit 1; fi 2024-08-31T04:24:53.093 INFO:tasks.workunit.client.0.smithi050.stdout:if gcc -DHAVE_CONFIG_H -I. -I. -I.. -g -O2 -MT reader.o -MD -MP -MF ".deps/reader.Tpo" -c -o reader.o reader.c; \ 2024-08-31T04:24:53.093 INFO:tasks.workunit.client.0.smithi050.stdout:then mv -f ".deps/reader.Tpo" ".deps/reader.Po"; else rm -f ".deps/reader.Tpo"; exit 1; fi 2024-08-31T04:24:53.171 INFO:tasks.workunit.client.0.smithi050.stdout:if gcc -DHAVE_CONFIG_H -I. -I. -I.. -g -O2 -MT commenter.o -MD -MP -MF ".deps/commenter.Tpo" -c -o commenter.o commenter.c; \ 2024-08-31T04:24:53.171 INFO:tasks.workunit.client.0.smithi050.stdout:then mv -f ".deps/commenter.Tpo" ".deps/commenter.Po"; else rm -f ".deps/commenter.Tpo"; exit 1; fi 2024-08-31T04:24:53.246 INFO:tasks.workunit.client.0.smithi050.stdout:if gcc -DHAVE_CONFIG_H -I. -I. -I.. -g -O2 -MT helpers.o -MD -MP -MF ".deps/helpers.Tpo" -c -o helpers.o helpers.c; \ 2024-08-31T04:24:53.246 INFO:tasks.workunit.client.0.smithi050.stdout:then mv -f ".deps/helpers.Tpo" ".deps/helpers.Po"; else rm -f ".deps/helpers.Tpo"; exit 1; fi 2024-08-31T04:24:53.352 INFO:tasks.workunit.client.0.smithi050.stdout:if gcc -DHAVE_CONFIG_H -I. -I. -I.. -g -O2 -MT bsd-getopt_long.o -MD -MP -MF ".deps/bsd-getopt_long.Tpo" -c -o bsd-getopt_long.o bsd-getopt_long.c; \ 2024-08-31T04:24:53.352 INFO:tasks.workunit.client.0.smithi050.stdout:then mv -f ".deps/bsd-getopt_long.Tpo" ".deps/bsd-getopt_long.Po"; else rm -f ".deps/bsd-getopt_long.Tpo"; exit 1; fi 2024-08-31T04:24:53.411 INFO:tasks.workunit.client.0.smithi050.stdout:if gcc -DHAVE_CONFIG_H -I. -I. -I.. -g -O2 -MT fakesnprintf.o -MD -MP -MF ".deps/fakesnprintf.Tpo" -c -o fakesnprintf.o fakesnprintf.c; \ 2024-08-31T04:24:53.411 INFO:tasks.workunit.client.0.smithi050.stdout:then mv -f ".deps/fakesnprintf.Tpo" ".deps/fakesnprintf.Po"; else rm -f ".deps/fakesnprintf.Tpo"; exit 1; fi 2024-08-31T04:24:53.451 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:24:53 smithi050 ceph-mon[17259]: pgmap v426: 97 pgs: 97 active+clean; 3.6 MiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 169 KiB/s rd, 270 KiB/s wr, 63 op/s 2024-08-31T04:24:53.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:24:53 smithi177 ceph-mon[22025]: pgmap v426: 97 pgs: 97 active+clean; 3.6 MiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 169 KiB/s rd, 270 KiB/s wr, 63 op/s 2024-08-31T04:24:53.542 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:24:53 smithi133 ceph-mon[22177]: pgmap v426: 97 pgs: 97 active+clean; 3.6 MiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 169 KiB/s rd, 270 KiB/s wr, 63 op/s 2024-08-31T04:24:53.555 INFO:tasks.workunit.client.0.smithi050.stdout:if gcc -DHAVE_CONFIG_H -I. -I. -I.. -g -O2 -MT mysnprintf.o -MD -MP -MF ".deps/mysnprintf.Tpo" -c -o mysnprintf.o mysnprintf.c; \ 2024-08-31T04:24:53.556 INFO:tasks.workunit.client.0.smithi050.stdout:then mv -f ".deps/mysnprintf.Tpo" ".deps/mysnprintf.Po"; else rm -f ".deps/mysnprintf.Tpo"; exit 1; fi 2024-08-31T04:24:53.617 INFO:tasks.workunit.client.0.smithi050.stdout:gcc -g -O2 -o blogbench blogbench.o process.o writer.o rewriter.o reader.o commenter.o helpers.o bsd-getopt_long.o fakesnprintf.o mysnprintf.o 2024-08-31T04:24:53.647 INFO:tasks.workunit.client.0.smithi050.stdout:make[2]: Leaving directory '/home/ubuntu/cephtest/mnt.0/client.0/tmp/blogbench-1.0/src' 2024-08-31T04:24:53.647 INFO:tasks.workunit.client.0.smithi050.stdout:Making all in man 2024-08-31T04:24:53.652 INFO:tasks.workunit.client.0.smithi050.stdout:make[2]: Entering directory '/home/ubuntu/cephtest/mnt.0/client.0/tmp/blogbench-1.0/man' 2024-08-31T04:24:53.652 INFO:tasks.workunit.client.0.smithi050.stdout:make[2]: Nothing to be done for 'all'. 2024-08-31T04:24:53.652 INFO:tasks.workunit.client.0.smithi050.stdout:make[2]: Leaving directory '/home/ubuntu/cephtest/mnt.0/client.0/tmp/blogbench-1.0/man' 2024-08-31T04:24:53.655 INFO:tasks.workunit.client.0.smithi050.stdout:make[2]: Entering directory '/home/ubuntu/cephtest/mnt.0/client.0/tmp/blogbench-1.0' 2024-08-31T04:24:53.657 INFO:tasks.workunit.client.0.smithi050.stdout:make[2]: Leaving directory '/home/ubuntu/cephtest/mnt.0/client.0/tmp/blogbench-1.0' 2024-08-31T04:24:53.658 INFO:tasks.workunit.client.0.smithi050.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/mnt.0/client.0/tmp/blogbench-1.0' 2024-08-31T04:24:53.658 INFO:tasks.workunit.client.0.smithi050.stderr:+ cd src 2024-08-31T04:24:53.659 INFO:tasks.workunit.client.0.smithi050.stderr:+ mkdir blogtest_in 2024-08-31T04:24:53.662 INFO:tasks.workunit.client.0.smithi050.stdout:running blogbench 2024-08-31T04:24:53.662 INFO:tasks.workunit.client.0.smithi050.stderr:+ echo 'running blogbench' 2024-08-31T04:24:53.662 INFO:tasks.workunit.client.0.smithi050.stderr:+ ./blogbench -d blogtest_in 2024-08-31T04:24:53.663 INFO:tasks.workunit.client.0.smithi050.stdout: 2024-08-31T04:24:53.663 INFO:tasks.workunit.client.0.smithi050.stdout:Frequency = 10 secs 2024-08-31T04:24:53.663 INFO:tasks.workunit.client.0.smithi050.stdout:Scratch dir = [blogtest_in] 2024-08-31T04:24:55.325 INFO:tasks.workunit.client.0.smithi050.stdout:Spawning 3 writers... 2024-08-31T04:24:55.326 INFO:tasks.workunit.client.0.smithi050.stdout:Spawning 1 rewriters... 2024-08-31T04:24:55.326 INFO:tasks.workunit.client.0.smithi050.stdout:Spawning 5 commenters... 2024-08-31T04:24:55.326 INFO:tasks.workunit.client.0.smithi050.stdout:Spawning 100 readers... 2024-08-31T04:24:55.332 INFO:tasks.workunit.client.0.smithi050.stdout:Benchmarking for 30 iterations. 2024-08-31T04:24:55.332 INFO:tasks.workunit.client.0.smithi050.stdout:The test will run during 5 minutes. 2024-08-31T04:24:55.332 INFO:tasks.workunit.client.0.smithi050.stdout: 2024-08-31T04:24:55.332 INFO:tasks.workunit.client.0.smithi050.stdout: Nb blogs R articles W articles R pictures W pictures R comments W comments 2024-08-31T04:24:55.450 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:24:55 smithi050 ceph-mon[17259]: pgmap v427: 97 pgs: 97 active+clean; 3.7 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 168 KiB/s rd, 280 KiB/s wr, 63 op/s 2024-08-31T04:24:55.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:24:55 smithi177 ceph-mon[22025]: pgmap v427: 97 pgs: 97 active+clean; 3.7 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 168 KiB/s rd, 280 KiB/s wr, 63 op/s 2024-08-31T04:24:55.542 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:24:55 smithi133 ceph-mon[22177]: pgmap v427: 97 pgs: 97 active+clean; 3.7 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 168 KiB/s rd, 280 KiB/s wr, 63 op/s 2024-08-31T04:24:57.450 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:24:57 smithi050 ceph-mon[17259]: pgmap v428: 97 pgs: 97 active+clean; 3.8 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 171 KiB/s rd, 339 KiB/s wr, 86 op/s 2024-08-31T04:24:57.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:24:57 smithi177 ceph-mon[22025]: pgmap v428: 97 pgs: 97 active+clean; 3.8 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 171 KiB/s rd, 339 KiB/s wr, 86 op/s 2024-08-31T04:24:57.542 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:24:57 smithi133 ceph-mon[22177]: pgmap v428: 97 pgs: 97 active+clean; 3.8 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 171 KiB/s rd, 339 KiB/s wr, 86 op/s 2024-08-31T04:24:59.450 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:24:59 smithi050 ceph-mon[17259]: pgmap v429: 97 pgs: 97 active+clean; 5.6 MiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 243 KiB/s rd, 524 KiB/s wr, 98 op/s 2024-08-31T04:24:59.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:24:59 smithi177 ceph-mon[22025]: pgmap v429: 97 pgs: 97 active+clean; 5.6 MiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 243 KiB/s rd, 524 KiB/s wr, 98 op/s 2024-08-31T04:24:59.542 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:24:59 smithi133 ceph-mon[22177]: pgmap v429: 97 pgs: 97 active+clean; 5.6 MiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 243 KiB/s rd, 524 KiB/s wr, 98 op/s 2024-08-31T04:25:00.304 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:00.302+0000 7f363da00640 1 -- 172.21.15.50:0/1884136187 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3638107090 msgr2=0x7f363810da30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:25:00.304 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:00.302+0000 7f363da00640 1 --2- 172.21.15.50:0/1884136187 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3638107090 0x7f363810da30 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f3630009ca0 tx=0x7f363002a8c0 comp rx=0 tx=0).stop 2024-08-31T04:25:00.305 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:00.303+0000 7f363da00640 1 -- 172.21.15.50:0/1884136187 shutdown_connections 2024-08-31T04:25:00.305 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:00.303+0000 7f363da00640 1 --2- 172.21.15.50:0/1884136187 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f36381066f0 0x7f3638106b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:00.305 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:00.303+0000 7f363da00640 1 --2- 172.21.15.50:0/1884136187 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3638107090 0x7f363810da30 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:00.305 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:00.303+0000 7f363da00640 1 --2- 172.21.15.50:0/1884136187 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3638105670 0x7f3638105ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:00.305 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:00.303+0000 7f363da00640 1 -- 172.21.15.50:0/1884136187 >> 172.21.15.50:0/1884136187 conn(0x7f3638100fd0 msgr2=0x7f3638103460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:25:00.305 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:00.303+0000 7f363da00640 1 -- 172.21.15.50:0/1884136187 shutdown_connections 2024-08-31T04:25:00.305 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:00.303+0000 7f363da00640 1 -- 172.21.15.50:0/1884136187 wait complete. 2024-08-31T04:25:00.307 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:00.304+0000 7f363da00640 1 Processor -- start 2024-08-31T04:25:00.307 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:00.304+0000 7f363da00640 1 -- start start 2024-08-31T04:25:00.307 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:00.304+0000 7f363da00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3638105670 0x7f363819be80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:00.307 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:00.304+0000 7f363da00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f36381066f0 0x7f363819c4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:00.307 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:00.304+0000 7f363da00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3638107090 0x7f363819d0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:00.307 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:00.304+0000 7f363da00640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f36381112c0 con 0x7f36381066f0 2024-08-31T04:25:00.307 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:00.304+0000 7f363da00640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f3638111140 con 0x7f3638105670 2024-08-31T04:25:00.307 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:00.304+0000 7f363da00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f3638111440 con 0x7f3638107090 2024-08-31T04:25:00.307 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:00.304+0000 7f3636a00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3638105670 0x7f363819be80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:00.308 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:00.304+0000 7f3636000640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f36381066f0 0x7f363819c4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:00.308 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:00.304+0000 7f3636a00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3638105670 0x7f363819be80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.50:49004/0 (socket says 172.21.15.50:49004) 2024-08-31T04:25:00.308 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:00.304+0000 7f3636a00640 1 -- 172.21.15.50:0/699645515 learned_addr learned my addr 172.21.15.50:0/699645515 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:25:00.308 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:00.305+0000 7f3637400640 1 --2- 172.21.15.50:0/699645515 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3638107090 0x7f363819d0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:00.308 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:00.305+0000 7f3636a00640 1 -- 172.21.15.50:0/699645515 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3638107090 msgr2=0x7f363819d0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:25:00.308 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:00.305+0000 7f3636a00640 1 --2- 172.21.15.50:0/699645515 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3638107090 0x7f363819d0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:00.308 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:00.305+0000 7f3636a00640 1 -- 172.21.15.50:0/699645515 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f36381066f0 msgr2=0x7f363819c4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:25:00.308 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:00.305+0000 7f3636a00640 1 --2- 172.21.15.50:0/699645515 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f36381066f0 0x7f363819c4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:00.308 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:00.305+0000 7f3636a00640 1 -- 172.21.15.50:0/699645515 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f363819d8c0 con 0x7f3638105670 2024-08-31T04:25:00.308 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:00.305+0000 7f3637400640 1 --2- 172.21.15.50:0/699645515 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3638107090 0x7f363819d0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:25:00.308 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:00.305+0000 7f3636000640 1 --2- 172.21.15.50:0/699645515 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f36381066f0 0x7f363819c4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:25:00.308 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:00.305+0000 7f3636a00640 1 --2- 172.21.15.50:0/699645515 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3638105670 0x7f363819be80 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f362800e9f0 tx=0x7f362800eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:25:00.308 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:00.305+0000 7f362f400640 1 -- 172.21.15.50:0/699645515 <== mon.2 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f362800cd80 con 0x7f3638105670 2024-08-31T04:25:00.309 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:00.306+0000 7f363da00640 1 -- 172.21.15.50:0/699645515 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f363819dbb0 con 0x7f3638105670 2024-08-31T04:25:00.309 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:00.306+0000 7f362f400640 1 -- 172.21.15.50:0/699645515 <== mon.2 v2:172.21.15.133:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f36280108e0 con 0x7f3638105670 2024-08-31T04:25:00.309 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:00.306+0000 7f362f400640 1 -- 172.21.15.50:0/699645515 <== mon.2 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3628018980 con 0x7f3638105670 2024-08-31T04:25:00.309 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:00.306+0000 7f363da00640 1 -- 172.21.15.50:0/699645515 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f36381a42a0 con 0x7f3638105670 2024-08-31T04:25:00.310 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:00.309+0000 7f36449dd740 1 Processor -- start 2024-08-31T04:25:00.310 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:00.309+0000 7f36449dd740 1 -- start start 2024-08-31T04:25:00.311 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:00.309+0000 7f36449dd740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a754c491b0 0x55a754feedc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:00.311 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:00.309+0000 7f36449dd740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55a754c202f0 0x55a754fef430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:00.311 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:00.309+0000 7f36449dd740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55a754c284d0 0x55a754feff80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:00.311 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:00.309+0000 7f36449dd740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55a754f61f70 con 0x55a754c491b0 2024-08-31T04:25:00.311 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:00.309+0000 7f36449dd740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x55a754f51500 con 0x55a754c202f0 2024-08-31T04:25:00.311 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:00.309+0000 7f36449dd740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x55a754f554b0 con 0x55a754c284d0 2024-08-31T04:25:00.311 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:00.309+0000 7f3637400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a754c491b0 0x55a754feedc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:00.311 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:00.309+0000 7f3637400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a754c491b0 0x55a754feedc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:54026/0 (socket says 172.21.15.50:54026) 2024-08-31T04:25:00.311 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:00.309+0000 7f3637400640 1 -- 172.21.15.50:0/3002385186 learned_addr learned my addr 172.21.15.50:0/3002385186 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:25:00.311 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:00.309+0000 7f3636000640 1 --2- 172.21.15.50:0/3002385186 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55a754c284d0 0x55a754feff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:00.312 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:00.310+0000 7f362f400640 1 -- 172.21.15.50:0/699645515 <== mon.2 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 18) ==== 152577+0+0 (secure 0 0 0) 0x7f3628010430 con 0x7f3638105670 2024-08-31T04:25:00.312 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:00.310+0000 7f3637400640 1 -- 172.21.15.50:0/3002385186 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55a754c284d0 msgr2=0x55a754feff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:25:00.312 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:00.310+0000 7f3637400640 1 --2- 172.21.15.50:0/3002385186 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55a754c284d0 0x55a754feff80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:00.312 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:00.310+0000 7f3637400640 1 -- 172.21.15.50:0/3002385186 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55a754c202f0 msgr2=0x55a754fef430 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-08-31T04:25:00.312 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:00.310+0000 7f3637400640 1 --2- 172.21.15.50:0/3002385186 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55a754c202f0 0x55a754fef430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:00.312 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:00.310+0000 7f3637400640 1 -- 172.21.15.50:0/3002385186 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a754f0bc10 con 0x55a754c491b0 2024-08-31T04:25:00.313 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:00.310+0000 7f3637400640 1 --2- 172.21.15.50:0/3002385186 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a754c491b0 0x55a754feedc0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f363002f390 tx=0x7f363002f3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=498deb62627ac405 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:25:00.313 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:00.311+0000 7f3623e00640 1 -- 172.21.15.50:0/3002385186 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3630031650 con 0x55a754c491b0 2024-08-31T04:25:00.314 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:00.311+0000 7f3623e00640 1 -- 172.21.15.50:0/3002385186 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3630036040 con 0x55a754c491b0 2024-08-31T04:25:00.314 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:00.311+0000 7f3623e00640 1 -- 172.21.15.50:0/3002385186 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3630004610 con 0x55a754c491b0 2024-08-31T04:25:00.314 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:00.311+0000 7f362f400640 1 --2- 172.21.15.50:0/699645515 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f361c0b4b30 0x7f361c0b7040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:00.314 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:00.311+0000 7f36449dd740 1 -- 172.21.15.50:0/3002385186 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a754c491b0 msgr2=0x55a754feedc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:25:00.314 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:00.311+0000 7f36449dd740 1 --2- 172.21.15.50:0/3002385186 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a754c491b0 0x55a754feedc0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f363002f390 tx=0x7f363002f3c0 comp rx=0 tx=0).stop 2024-08-31T04:25:00.314 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:00.312+0000 7f36449dd740 1 -- 172.21.15.50:0/3002385186 shutdown_connections 2024-08-31T04:25:00.314 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:00.312+0000 7f36449dd740 1 --2- 172.21.15.50:0/3002385186 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55a754c284d0 0x55a754feff80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:00.314 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:00.312+0000 7f36449dd740 1 --2- 172.21.15.50:0/3002385186 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55a754c202f0 0x55a754fef430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:00.314 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:00.312+0000 7f36449dd740 1 --2- 172.21.15.50:0/3002385186 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a754c491b0 0x55a754feedc0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:00.314 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:00.312+0000 7f36449dd740 1 -- 172.21.15.50:0/3002385186 >> 172.21.15.50:0/3002385186 conn(0x55a754c3d300 msgr2=0x55a754fea850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:25:00.314 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:00.312+0000 7f362f400640 1 -- 172.21.15.50:0/699645515 <== mon.2 v2:172.21.15.133:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8219+0+0 (secure 0 0 0) 0x7f36280e5540 con 0x7f3638105670 2024-08-31T04:25:00.314 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:00.312+0000 7f3636a00640 1 --2- 172.21.15.50:0/699645515 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f361c0b4b30 0x7f361c0b7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:00.314 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:00.312+0000 7f36449dd740 1 -- 172.21.15.50:0/3002385186 shutdown_connections 2024-08-31T04:25:00.315 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:00.312+0000 7f36449dd740 1 -- 172.21.15.50:0/3002385186 wait complete. 2024-08-31T04:25:00.315 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:00.312+0000 7f3636a00640 1 --2- 172.21.15.50:0/699645515 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f361c0b4b30 0x7f361c0b7040 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f36280abeb0 tx=0x7f3628018420 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:25:00.315 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:00.312+0000 7f36449dd740 1 -- start start 2024-08-31T04:25:00.315 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:00.313+0000 7f36449dd740 1 Processor -- start 2024-08-31T04:25:00.317 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:00.313+0000 7f36449dd740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a754c202f0 0x55a754ff83b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:00.317 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:00.313+0000 7f36449dd740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55a754c284d0 0x55a754ff8a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:00.317 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:00.313+0000 7f36449dd740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55a754c491b0 0x55a754ff95e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:00.318 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:00.313+0000 7f36449dd740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55a754e8aab0 con 0x55a754c202f0 2024-08-31T04:25:00.318 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:00.313+0000 7f36449dd740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x55a754ef8320 con 0x55a754c491b0 2024-08-31T04:25:00.318 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:00.313+0000 7f36449dd740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x55a754ff0a40 con 0x55a754c284d0 2024-08-31T04:25:00.318 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:00.313+0000 7f36449dd740 10 client.0 _ll_register_callbacks cb 0x55a754efe6a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:25:00.318 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:00.313+0000 7f3636000640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55a754c284d0 0x55a754ff8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:00.318 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:00.313+0000 7f3637400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a754c202f0 0x55a754ff83b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:00.318 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:00.313+0000 7f3636000640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55a754c284d0 0x55a754ff8a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.50:37314/0 (socket says 172.21.15.50:37314) 2024-08-31T04:25:00.318 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:00.313+0000 7f3637400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a754c202f0 0x55a754ff83b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:54034/0 (socket says 172.21.15.50:54034) 2024-08-31T04:25:00.318 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:00.313+0000 7f3636000640 1 -- 172.21.15.50:0/1045921035 learned_addr learned my addr 172.21.15.50:0/1045921035 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:25:00.318 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:00.314+0000 7f3637400640 1 --2- 172.21.15.50:0/1045921035 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55a754c491b0 0x55a754ff95e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:00.318 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:00.314+0000 7f3636000640 1 -- 172.21.15.50:0/1045921035 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55a754c491b0 msgr2=0x55a754ff95e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:25:00.318 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:00.314+0000 7f3636000640 1 --2- 172.21.15.50:0/1045921035 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55a754c491b0 0x55a754ff95e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:00.318 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:00.314+0000 7f3636000640 1 -- 172.21.15.50:0/1045921035 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a754c202f0 msgr2=0x55a754ff83b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:25:00.319 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:00.314+0000 7f3636000640 1 --2- 172.21.15.50:0/1045921035 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a754c202f0 0x55a754ff83b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:00.319 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:00.314+0000 7f3636000640 1 -- 172.21.15.50:0/1045921035 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a754cb4790 con 0x55a754c284d0 2024-08-31T04:25:00.319 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:00.314+0000 7f3637400640 1 --2- 172.21.15.50:0/1045921035 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55a754c491b0 0x55a754ff95e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:25:00.319 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:00.314+0000 7f3636000640 1 --2- 172.21.15.50:0/1045921035 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55a754c284d0 0x55a754ff8a70 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f3624004570 tx=0x7f36240039c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=efa5f869341b514e server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:25:00.319 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:00.314+0000 7f3620c00640 10 client.0 ms_handle_connect on v2:172.21.15.177:3300/0 2024-08-31T04:25:00.319 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:00.314+0000 7f3620c00640 1 -- 172.21.15.50:0/1045921035 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36240117d0 con 0x55a754c284d0 2024-08-31T04:25:00.319 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:00.314+0000 7f3620c00640 1 -- 172.21.15.50:0/1045921035 <== mon.1 v2:172.21.15.177:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8219+0+0 (secure 0 0 0) 0x7f3624011970 con 0x55a754c284d0 2024-08-31T04:25:00.319 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:00.314+0000 7f36449dd740 1 -- 172.21.15.50:0/1045921035 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3630036040 con 0x55a754c284d0 2024-08-31T04:25:00.319 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:00.315+0000 7f3620c00640 1 -- 172.21.15.50:0/1045921035 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f3624011b70 con 0x55a754c284d0 2024-08-31T04:25:00.319 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:00.315+0000 7f36449dd740 10 client.25654 fetch_fsmap learned FSMap version 29 2024-08-31T04:25:00.319 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:00.315+0000 7f36449dd740 1 -- 172.21.15.50:0/1045921035 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55a754d2d620 con 0x55a754c284d0 2024-08-31T04:25:00.319 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:00.315+0000 7f3620c00640 1 -- 172.21.15.50:0/1045921035 <== mon.1 v2:172.21.15.177:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3630036040 con 0x55a754c284d0 2024-08-31T04:25:00.319 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:00.315+0000 7f3620c00640 1 -- 172.21.15.50:0/1045921035 <== mon.1 v2:172.21.15.177:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f3624010440 con 0x55a754c284d0 2024-08-31T04:25:00.319 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:00.316+0000 7f36449dd740 10 client.25654 fetch_fsmap finished waiting for FSMap version 29 2024-08-31T04:25:00.319 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:00.316+0000 7f36449dd740 10 client.25654 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T04:25:00.320 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:00.316+0000 7f36449dd740 20 client.25654 populate_metadata read hostname 'smithi050' 2024-08-31T04:25:00.320 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:00.316+0000 7f36449dd740 1 --2- 172.21.15.50:0/1045921035 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x55a754c07d80 0x55a755005bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:00.320 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:00.316+0000 7f36449dd740 4 client.25654 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T04:25:00.320 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:00.316+0000 7f36449dd740 1 -- 172.21.15.50:0/1045921035 --> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a754f63ec0 con 0x55a754c07d80 2024-08-31T04:25:00.320 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:00.316+0000 7f3637400640 1 --2- 172.21.15.50:0/1045921035 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x55a754c07d80 0x55a755005bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:00.320 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:00.316+0000 7f3620c00640 10 client.25654 ms_handle_connect on v2:172.21.15.133:6838/2526402262 2024-08-31T04:25:00.320 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:00.316+0000 7f3637400640 1 --2- 172.21.15.50:0/1045921035 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x55a754c07d80 0x55a755005bd0 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=32d47e596e17dc0 server_cookie=f38e5c4c40659f94 in_seq=0 out_seq=0 2024-08-31T04:25:00.321 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:00.318+0000 7f3620c00640 1 -- 172.21.15.50:0/1045921035 <== mds.0 v2:172.21.15.133:6838/2526402262 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55a754f63ec0 con 0x55a754c07d80 2024-08-31T04:25:00.321 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:00.318+0000 7f3620c00640 10 client.25654 handle_command_reply: tid=0 2024-08-31T04:25:00.321 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:00.318+0000 7f36449dd740 1 client.25654 shutdown 2024-08-31T04:25:00.321 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:00.319+0000 7f36449dd740 1 -- 172.21.15.50:0/1045921035 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55a754c284d0 msgr2=0x55a754ff8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:25:00.321 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:00.319+0000 7f36449dd740 1 --2- 172.21.15.50:0/1045921035 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55a754c284d0 0x55a754ff8a70 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f3624004570 tx=0x7f36240039c0 comp rx=0 tx=0).stop 2024-08-31T04:25:00.321 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:00.319+0000 7f36449dd740 1 -- 172.21.15.50:0/1045921035 shutdown_connections 2024-08-31T04:25:00.321 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:00.319+0000 7f36449dd740 1 --2- 172.21.15.50:0/1045921035 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x55a754c07d80 0x55a755005bd0 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:00.322 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:00.319+0000 7f36449dd740 1 --2- 172.21.15.50:0/1045921035 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55a754c284d0 0x55a754ff8a70 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:00.322 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:00.319+0000 7f36449dd740 1 --2- 172.21.15.50:0/1045921035 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55a754c491b0 0x55a754ff95e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:00.322 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:00.319+0000 7f3620c00640 0 client.25654 ms_handle_reset on v2:172.21.15.133:6838/2526402262 2024-08-31T04:25:00.322 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:00.319+0000 7f36449dd740 1 --2- 172.21.15.50:0/1045921035 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a754c202f0 0x55a754ff83b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:00.322 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:00.319+0000 7f36449dd740 1 -- 172.21.15.50:0/1045921035 >> 172.21.15.50:0/1045921035 conn(0x55a754c3d300 msgr2=0x55a754fe8cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:25:00.322 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:00.319+0000 7f36449dd740 1 -- 172.21.15.50:0/1045921035 shutdown_connections 2024-08-31T04:25:00.322 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:00.319+0000 7f36449dd740 1 -- 172.21.15.50:0/1045921035 wait complete. 2024-08-31T04:25:00.322 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:00.319+0000 7f36449dd740 20 client.25654 trim_cache size 0 max 16384 2024-08-31T04:25:00.336 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:00.334+0000 7f36449dd740 1 Processor -- start 2024-08-31T04:25:00.336 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:00.335+0000 7f36449dd740 1 -- start start 2024-08-31T04:25:00.336 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:00.335+0000 7f36449dd740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55a754c202f0 0x55a754febd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:00.336 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:00.335+0000 7f36449dd740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55a754c284d0 0x55a754ff8ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:00.336 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:00.335+0000 7f36449dd740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a754c491b0 0x55a754ff2ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:00.336 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:00.335+0000 7f36449dd740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f36381acf30 con 0x55a754c491b0 2024-08-31T04:25:00.336 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:00.335+0000 7f36449dd740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f36381aea70 con 0x55a754c202f0 2024-08-31T04:25:00.336 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:00.335+0000 7f36449dd740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f36381ad600 con 0x55a754c284d0 2024-08-31T04:25:00.337 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:00.335+0000 7f3637400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55a754c202f0 0x55a754febd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:00.337 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:00.335+0000 7f3636000640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55a754c284d0 0x55a754ff8ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:00.338 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:00.335+0000 7f3637400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55a754c202f0 0x55a754febd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.50:49026/0 (socket says 172.21.15.50:49026) 2024-08-31T04:25:00.338 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:00.335+0000 7f3637400640 1 -- 172.21.15.50:0/2331489508 learned_addr learned my addr 172.21.15.50:0/2331489508 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:25:00.338 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:00.335+0000 7f3637400640 1 --2- 172.21.15.50:0/2331489508 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a754c491b0 0x55a754ff2ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:00.338 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:00.336+0000 7f3636000640 1 -- 172.21.15.50:0/2331489508 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55a754c202f0 msgr2=0x55a754febd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:25:00.338 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:00.336+0000 7f3636000640 1 --2- 172.21.15.50:0/2331489508 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55a754c202f0 0x55a754febd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:00.338 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:00.336+0000 7f3636000640 1 -- 172.21.15.50:0/2331489508 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a754c491b0 msgr2=0x55a754ff2ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:25:00.338 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:00.336+0000 7f3636000640 1 --2- 172.21.15.50:0/2331489508 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a754c491b0 0x55a754ff2ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:00.338 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:00.336+0000 7f3636000640 1 -- 172.21.15.50:0/2331489508 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a754fe49f0 con 0x55a754c284d0 2024-08-31T04:25:00.338 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:00.336+0000 7f3637400640 1 --2- 172.21.15.50:0/2331489508 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55a754c202f0 0x55a754febd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:25:00.338 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:00.336+0000 7f3636000640 1 --2- 172.21.15.50:0/2331489508 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55a754c284d0 0x55a754ff8ac0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f3624010860 tx=0x7f3624004080 comp rx=0 tx=0).ready entity=mon.1 client_cookie=18f134b123b06b0c server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:25:00.338 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:00.336+0000 7f3623400640 1 -- 172.21.15.50:0/2331489508 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36240117d0 con 0x55a754c284d0 2024-08-31T04:25:00.338 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:00.336+0000 7f3623400640 1 -- 172.21.15.50:0/2331489508 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3624021030 con 0x55a754c284d0 2024-08-31T04:25:00.338 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:00.336+0000 7f3623400640 1 -- 172.21.15.50:0/2331489508 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f362401b8d0 con 0x55a754c284d0 2024-08-31T04:25:00.340 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:00.337+0000 7f36449dd740 1 -- 172.21.15.50:0/2331489508 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55a754c284d0 msgr2=0x55a754ff8ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:25:00.340 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:00.337+0000 7f36449dd740 1 --2- 172.21.15.50:0/2331489508 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55a754c284d0 0x55a754ff8ac0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f3624010860 tx=0x7f3624004080 comp rx=0 tx=0).stop 2024-08-31T04:25:00.340 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:00.337+0000 7f36449dd740 1 -- 172.21.15.50:0/2331489508 shutdown_connections 2024-08-31T04:25:00.340 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:00.337+0000 7f36449dd740 1 --2- 172.21.15.50:0/2331489508 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55a754c284d0 0x55a754ff8ac0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:00.340 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:00.337+0000 7f36449dd740 1 --2- 172.21.15.50:0/2331489508 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a754c491b0 0x55a754ff2ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:00.340 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:00.337+0000 7f36449dd740 1 --2- 172.21.15.50:0/2331489508 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55a754c202f0 0x55a754febd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:00.340 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:00.337+0000 7f36449dd740 1 -- 172.21.15.50:0/2331489508 >> 172.21.15.50:0/2331489508 conn(0x55a754c3d300 msgr2=0x55a754ff83b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:25:00.341 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:00.337+0000 7f36449dd740 1 -- 172.21.15.50:0/2331489508 shutdown_connections 2024-08-31T04:25:00.341 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:00.337+0000 7f36449dd740 1 -- 172.21.15.50:0/2331489508 wait complete. 2024-08-31T04:25:00.341 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:00.338+0000 7f36449dd740 1 -- start start 2024-08-31T04:25:00.341 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:00.338+0000 7f36449dd740 1 Processor -- start 2024-08-31T04:25:00.341 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:00.338+0000 7f36449dd740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55a754c202f0 0x55a755000290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:00.341 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:00.338+0000 7f36449dd740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a754c284d0 0x55a754ffef50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:00.341 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:00.338+0000 7f36449dd740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55a754c491b0 0x55a754fff5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:00.341 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:00.339+0000 7f36449dd740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f36381ae3a0 con 0x55a754c284d0 2024-08-31T04:25:00.341 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:00.339+0000 7f36449dd740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f36381adcd0 con 0x55a754c202f0 2024-08-31T04:25:00.341 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:00.339+0000 7f36449dd740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f36381aaf10 con 0x55a754c491b0 2024-08-31T04:25:00.341 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:00.339+0000 7f36449dd740 10 client.0 _ll_register_callbacks cb 0x7f3624004180 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:25:00.341 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:00.339+0000 7f3637400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55a754c202f0 0x55a755000290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:00.341 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:00.339+0000 7f3636000640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a754c284d0 0x55a754ffef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:00.342 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:00.339+0000 7f3637400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55a754c202f0 0x55a755000290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.50:49032/0 (socket says 172.21.15.50:49032) 2024-08-31T04:25:00.342 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:00.339+0000 7f3637400640 1 -- 172.21.15.50:0/1080714597 learned_addr learned my addr 172.21.15.50:0/1080714597 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:25:00.342 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:00.339+0000 7f3637400640 1 --2- 172.21.15.50:0/1080714597 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55a754c491b0 0x55a754fff5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:00.343 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:00.339+0000 7f3636000640 1 -- 172.21.15.50:0/1080714597 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55a754c491b0 msgr2=0x55a754fff5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:25:00.343 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:00.339+0000 7f3636000640 1 --2- 172.21.15.50:0/1080714597 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55a754c491b0 0x55a754fff5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:00.343 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:00.339+0000 7f3636000640 1 -- 172.21.15.50:0/1080714597 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55a754c202f0 msgr2=0x55a755000290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:25:00.343 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:00.339+0000 7f3636000640 1 --2- 172.21.15.50:0/1080714597 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55a754c202f0 0x55a755000290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:00.343 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:00.339+0000 7f3636000640 1 -- 172.21.15.50:0/1080714597 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a754fffd10 con 0x55a754c284d0 2024-08-31T04:25:00.343 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:00.340+0000 7f3636000640 1 --2- 172.21.15.50:0/1080714597 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a754c284d0 0x55a754ffef50 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f3624000c00 tx=0x7f3624003ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1cf2d88622ffc9ba server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:25:00.344 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:00.340+0000 7f3620c00640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-08-31T04:25:00.344 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:00.340+0000 7f3620c00640 1 -- 172.21.15.50:0/1080714597 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3624037440 con 0x55a754c284d0 2024-08-31T04:25:00.344 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:00.340+0000 7f3620c00640 1 -- 172.21.15.50:0/1080714597 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8219+0+0 (secure 0 0 0) 0x7f362401b420 con 0x55a754c284d0 2024-08-31T04:25:00.344 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:00.340+0000 7f36449dd740 1 -- 172.21.15.50:0/1080714597 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3624021030 con 0x55a754c284d0 2024-08-31T04:25:00.344 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:00.340+0000 7f3620c00640 1 -- 172.21.15.50:0/1080714597 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f362401b620 con 0x55a754c284d0 2024-08-31T04:25:00.344 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:00.340+0000 7f36449dd740 10 client.15648 fetch_fsmap learned FSMap version 29 2024-08-31T04:25:00.344 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:00.340+0000 7f36449dd740 1 -- 172.21.15.50:0/1080714597 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55a7550705f0 con 0x55a754c284d0 2024-08-31T04:25:00.344 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:00.341+0000 7f3620c00640 1 -- 172.21.15.50:0/1080714597 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3624021030 con 0x55a754c284d0 2024-08-31T04:25:00.344 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:00.341+0000 7f3620c00640 1 -- 172.21.15.50:0/1080714597 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f3624035070 con 0x55a754c284d0 2024-08-31T04:25:00.344 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:00.341+0000 7f36449dd740 10 client.15648 fetch_fsmap finished waiting for FSMap version 29 2024-08-31T04:25:00.344 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:00.341+0000 7f36449dd740 10 client.15648 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T04:25:00.344 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:00.341+0000 7f36449dd740 20 client.15648 populate_metadata read hostname 'smithi050' 2024-08-31T04:25:00.344 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:00.341+0000 7f36449dd740 1 --2- 172.21.15.50:0/1080714597 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x55a754bdd1c0 0x55a755072f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:00.344 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:00.341+0000 7f36449dd740 4 client.15648 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-31T04:25:00.345 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:00.341+0000 7f36449dd740 1 -- 172.21.15.50:0/1080714597 --> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55a754f5f960 con 0x55a754bdd1c0 2024-08-31T04:25:00.345 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:00.341+0000 7f3637400640 1 --2- 172.21.15.50:0/1080714597 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x55a754bdd1c0 0x55a755072f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:00.345 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:00.342+0000 7f3637400640 1 --2- 172.21.15.50:0/1080714597 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x55a754bdd1c0 0x55a755072f40 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a6a580e0dcccda85 server_cookie=e7bdba5593355d0f in_seq=0 out_seq=0 2024-08-31T04:25:00.345 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:00.342+0000 7f3620c00640 10 client.15648 ms_handle_connect on v2:172.21.15.133:6838/2526402262 2024-08-31T04:25:01.451 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:25:01 smithi050 ceph-mon[17259]: pgmap v430: 97 pgs: 97 active+clean; 5.6 MiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 208 KiB/s rd, 475 KiB/s wr, 91 op/s 2024-08-31T04:25:01.495 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:25:01 smithi177 ceph-mon[22025]: pgmap v430: 97 pgs: 97 active+clean; 5.6 MiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 208 KiB/s rd, 475 KiB/s wr, 91 op/s 2024-08-31T04:25:01.542 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:25:01 smithi133 ceph-mon[22177]: pgmap v430: 97 pgs: 97 active+clean; 5.6 MiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 208 KiB/s rd, 475 KiB/s wr, 91 op/s 2024-08-31T04:25:02.035 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:02.033+0000 7f3620c00640 1 -- 172.21.15.50:0/1080714597 <== mds.0 v2:172.21.15.133:6838/2526402262 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55a754f5f960 con 0x55a754bdd1c0 2024-08-31T04:25:02.035 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:02.033+0000 7f3620c00640 10 client.15648 handle_command_reply: tid=0 2024-08-31T04:25:02.035 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:02.033+0000 7f36449dd740 1 client.15648 shutdown 2024-08-31T04:25:02.035 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:02.033+0000 7f36449dd740 1 -- 172.21.15.50:0/1080714597 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a754c284d0 msgr2=0x55a754ffef50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:25:02.035 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:02.033+0000 7f36449dd740 1 --2- 172.21.15.50:0/1080714597 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a754c284d0 0x55a754ffef50 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f3624000c00 tx=0x7f3624003ec0 comp rx=0 tx=0).stop 2024-08-31T04:25:02.035 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:02.033+0000 7f36449dd740 1 -- 172.21.15.50:0/1080714597 shutdown_connections 2024-08-31T04:25:02.035 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:02.033+0000 7f36449dd740 1 --2- 172.21.15.50:0/1080714597 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x55a754bdd1c0 0x55a755072f40 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:02.035 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:02.033+0000 7f36449dd740 1 --2- 172.21.15.50:0/1080714597 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55a754c491b0 0x55a754fff5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:02.036 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:02.033+0000 7f36449dd740 1 --2- 172.21.15.50:0/1080714597 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a754c284d0 0x55a754ffef50 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:02.036 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:02.033+0000 7f36449dd740 1 --2- 172.21.15.50:0/1080714597 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55a754c202f0 0x55a755000290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:02.036 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:02.033+0000 7f3620c00640 0 client.15648 ms_handle_reset on v2:172.21.15.133:6838/2526402262 2024-08-31T04:25:02.036 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:02.033+0000 7f36449dd740 1 -- 172.21.15.50:0/1080714597 >> 172.21.15.50:0/1080714597 conn(0x55a754c3d300 msgr2=0x55a754ff2ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:25:02.036 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:02.034+0000 7f36449dd740 1 -- 172.21.15.50:0/1080714597 shutdown_connections 2024-08-31T04:25:02.036 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:02.034+0000 7f36449dd740 1 -- 172.21.15.50:0/1080714597 wait complete. 2024-08-31T04:25:02.036 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:02.034+0000 7f36449dd740 20 client.15648 trim_cache size 0 max 16384 2024-08-31T04:25:02.036 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout:{ 2024-08-31T04:25:02.036 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout: "message": "", 2024-08-31T04:25:02.036 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout: "return_code": 0 2024-08-31T04:25:02.037 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout:} 2024-08-31T04:25:02.037 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:02.035+0000 7f363da00640 1 -- 172.21.15.50:0/699645515 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f361c0b4b30 msgr2=0x7f361c0b7040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:25:02.037 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:02.035+0000 7f363da00640 1 --2- 172.21.15.50:0/699645515 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f361c0b4b30 0x7f361c0b7040 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f36280abeb0 tx=0x7f3628018420 comp rx=0 tx=0).stop 2024-08-31T04:25:02.037 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:02.035+0000 7f363da00640 1 -- 172.21.15.50:0/699645515 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3638105670 msgr2=0x7f363819be80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:25:02.037 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:02.035+0000 7f363da00640 1 --2- 172.21.15.50:0/699645515 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3638105670 0x7f363819be80 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f362800e9f0 tx=0x7f362800eeb0 comp rx=0 tx=0).stop 2024-08-31T04:25:02.037 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:02.035+0000 7f363da00640 1 -- 172.21.15.50:0/699645515 shutdown_connections 2024-08-31T04:25:02.038 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:02.035+0000 7f363da00640 1 --2- 172.21.15.50:0/699645515 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f361c0b4b30 0x7f361c0b7040 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:02.038 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:02.035+0000 7f363da00640 1 --2- 172.21.15.50:0/699645515 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3638107090 0x7f363819d0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:02.038 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:02.035+0000 7f363da00640 1 --2- 172.21.15.50:0/699645515 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f36381066f0 0x7f363819c4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:02.038 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:02.035+0000 7f363da00640 1 --2- 172.21.15.50:0/699645515 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3638105670 0x7f363819be80 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:02.038 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:02.035+0000 7f363da00640 1 -- 172.21.15.50:0/699645515 >> 172.21.15.50:0/699645515 conn(0x7f3638100fd0 msgr2=0x7f36381099f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:25:02.038 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:02.035+0000 7f363da00640 1 -- 172.21.15.50:0/699645515 shutdown_connections 2024-08-31T04:25:02.038 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:02.035+0000 7f363da00640 1 -- 172.21.15.50:0/699645515 wait complete. 2024-08-31T04:25:03.450 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:25:03 smithi050 ceph-mon[17259]: pgmap v431: 97 pgs: 97 active+clean; 14 MiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 831 KiB/s rd, 1.2 MiB/s wr, 127 op/s 2024-08-31T04:25:03.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:25:03 smithi177 ceph-mon[22025]: pgmap v431: 97 pgs: 97 active+clean; 14 MiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 831 KiB/s rd, 1.2 MiB/s wr, 127 op/s 2024-08-31T04:25:03.542 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:25:03 smithi133 ceph-mon[22177]: pgmap v431: 97 pgs: 97 active+clean; 14 MiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 831 KiB/s rd, 1.2 MiB/s wr, 127 op/s 2024-08-31T04:25:05.346 INFO:tasks.workunit.client.0.smithi050.stdout: 15 228862 982 174246 956 54712 1141 2024-08-31T04:25:05.450 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:25:05 smithi050 ceph-mon[17259]: pgmap v432: 97 pgs: 97 active+clean; 17 MiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 700 KiB/s rd, 1.3 MiB/s wr, 173 op/s 2024-08-31T04:25:05.495 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:25:05 smithi177 ceph-mon[22025]: pgmap v432: 97 pgs: 97 active+clean; 17 MiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 700 KiB/s rd, 1.3 MiB/s wr, 173 op/s 2024-08-31T04:25:05.542 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:25:05 smithi133 ceph-mon[22177]: pgmap v432: 97 pgs: 97 active+clean; 17 MiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 700 KiB/s rd, 1.3 MiB/s wr, 173 op/s 2024-08-31T04:25:07.285 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:25:07 smithi050 ceph-mon[17259]: pgmap v433: 97 pgs: 97 active+clean; 26 MiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 2.5 MiB/s wr, 431 op/s 2024-08-31T04:25:07.285 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:25:07 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T04:25:07.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:25:07 smithi177 ceph-mon[22025]: pgmap v433: 97 pgs: 97 active+clean; 26 MiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 2.5 MiB/s wr, 431 op/s 2024-08-31T04:25:07.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:25:07 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T04:25:07.542 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:25:07 smithi133 ceph-mon[22177]: pgmap v433: 97 pgs: 97 active+clean; 26 MiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 2.5 MiB/s wr, 431 op/s 2024-08-31T04:25:07.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:25:07 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T04:25:08.175 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:25:08 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:25:08.175 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:25:08 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T04:25:08.175 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:25:08 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:25:08.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:25:08 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:25:08.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:25:08 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T04:25:08.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:25:08 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:25:08.542 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:25:08 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:25:08.542 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:25:08 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T04:25:08.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:25:08 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:25:09.450 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:25:09 smithi050 ceph-mon[17259]: pgmap v434: 97 pgs: 97 active+clean; 35 MiB data, 397 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 3.5 MiB/s wr, 470 op/s 2024-08-31T04:25:09.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:25:09 smithi177 ceph-mon[22025]: pgmap v434: 97 pgs: 97 active+clean; 35 MiB data, 397 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 3.5 MiB/s wr, 470 op/s 2024-08-31T04:25:09.542 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:25:09 smithi133 ceph-mon[22177]: pgmap v434: 97 pgs: 97 active+clean; 35 MiB data, 397 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 3.5 MiB/s wr, 470 op/s 2024-08-31T04:25:11.450 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:25:11 smithi050 ceph-mon[17259]: pgmap v435: 97 pgs: 97 active+clean; 43 MiB data, 404 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 4.1 MiB/s wr, 482 op/s 2024-08-31T04:25:11.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:25:11 smithi177 ceph-mon[22025]: pgmap v435: 97 pgs: 97 active+clean; 43 MiB data, 404 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 4.1 MiB/s wr, 482 op/s 2024-08-31T04:25:11.542 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:25:11 smithi133 ceph-mon[22177]: pgmap v435: 97 pgs: 97 active+clean; 43 MiB data, 404 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 4.1 MiB/s wr, 482 op/s 2024-08-31T04:25:12.449 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:25:12 smithi050 ceph-mon[17259]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-31T04:25:12.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:25:12 smithi177 ceph-mon[22025]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-31T04:25:12.542 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:25:12 smithi133 ceph-mon[22177]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-31T04:25:13.351 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:25:13 smithi050 ceph-mon[17259]: pgmap v436: 97 pgs: 97 active+clean; 55 MiB data, 435 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 5.2 MiB/s wr, 552 op/s 2024-08-31T04:25:13.397 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:25:13 smithi177 ceph-mon[22025]: pgmap v436: 97 pgs: 97 active+clean; 55 MiB data, 435 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 5.2 MiB/s wr, 552 op/s 2024-08-31T04:25:13.443 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:25:13 smithi133 ceph-mon[22177]: pgmap v436: 97 pgs: 97 active+clean; 55 MiB data, 435 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 5.2 MiB/s wr, 552 op/s 2024-08-31T04:25:15.282 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:15.280+0000 7fbc79800640 1 -- 172.21.15.50:0/3649526072 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbc74106f70 msgr2=0x7fbc74107470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:25:15.283 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:15.280+0000 7fbc79800640 1 --2- 172.21.15.50:0/3649526072 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbc74106f70 0x7fbc74107470 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fbc6c009c90 tx=0x7fbc6c02a880 comp rx=0 tx=0).stop 2024-08-31T04:25:15.283 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:15.280+0000 7fbc79800640 1 -- 172.21.15.50:0/3649526072 shutdown_connections 2024-08-31T04:25:15.283 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:15.280+0000 7fbc79800640 1 --2- 172.21.15.50:0/3649526072 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbc74106f70 0x7fbc74107470 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:15.283 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:15.280+0000 7fbc79800640 1 --2- 172.21.15.50:0/3649526072 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbc741043b0 0x7fbc74106830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:15.283 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:15.280+0000 7fbc79800640 1 --2- 172.21.15.50:0/3649526072 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbc7406b4b0 0x7fbc74103e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:15.283 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:15.280+0000 7fbc79800640 1 -- 172.21.15.50:0/3649526072 >> 172.21.15.50:0/3649526072 conn(0x7fbc740fdc80 msgr2=0x7fbc74100130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:25:15.283 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:15.280+0000 7fbc79800640 1 -- 172.21.15.50:0/3649526072 shutdown_connections 2024-08-31T04:25:15.283 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:15.280+0000 7fbc79800640 1 -- 172.21.15.50:0/3649526072 wait complete. 2024-08-31T04:25:15.284 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:15.282+0000 7fbc79800640 1 Processor -- start 2024-08-31T04:25:15.284 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:15.282+0000 7fbc79800640 1 -- start start 2024-08-31T04:25:15.285 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:15.282+0000 7fbc79800640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbc7406b4b0 0x7fbc741a0320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:15.285 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:15.282+0000 7fbc79800640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbc741043b0 0x7fbc741a0990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:15.285 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:15.283+0000 7fbc79800640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbc74106f70 0x7fbc741a1540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:15.285 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:15.283+0000 7fbc79800640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fbc74115700 con 0x7fbc741043b0 2024-08-31T04:25:15.285 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:15.283+0000 7fbc79800640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7fbc74115580 con 0x7fbc7406b4b0 2024-08-31T04:25:15.285 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:15.283+0000 7fbc79800640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fbc74115880 con 0x7fbc74106f70 2024-08-31T04:25:15.286 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:15.283+0000 7fbc72a00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbc7406b4b0 0x7fbc741a0320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:15.286 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:15.283+0000 7fbc72a00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbc7406b4b0 0x7fbc741a0320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.50:58876/0 (socket says 172.21.15.50:58876) 2024-08-31T04:25:15.286 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:15.283+0000 7fbc72a00640 1 -- 172.21.15.50:0/3157472582 learned_addr learned my addr 172.21.15.50:0/3157472582 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:25:15.286 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:15.283+0000 7fbc72000640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbc741043b0 0x7fbc741a0990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:15.286 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:15.283+0000 7fbc73400640 1 --2- 172.21.15.50:0/3157472582 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbc74106f70 0x7fbc741a1540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:15.286 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:15.284+0000 7fbc72a00640 1 -- 172.21.15.50:0/3157472582 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbc74106f70 msgr2=0x7fbc741a1540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:25:15.286 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:15.284+0000 7fbc72a00640 1 --2- 172.21.15.50:0/3157472582 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbc74106f70 0x7fbc741a1540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:15.287 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:15.284+0000 7fbc72a00640 1 -- 172.21.15.50:0/3157472582 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbc741043b0 msgr2=0x7fbc741a0990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:25:15.287 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:15.284+0000 7fbc72a00640 1 --2- 172.21.15.50:0/3157472582 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbc741043b0 0x7fbc741a0990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:15.287 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:15.284+0000 7fbc72a00640 1 -- 172.21.15.50:0/3157472582 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc741a1d60 con 0x7fbc7406b4b0 2024-08-31T04:25:15.287 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:15.284+0000 7fbc73400640 1 --2- 172.21.15.50:0/3157472582 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbc74106f70 0x7fbc741a1540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:25:15.287 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:15.284+0000 7fbc72a00640 1 --2- 172.21.15.50:0/3157472582 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbc7406b4b0 0x7fbc741a0320 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fbc6400e9f0 tx=0x7fbc6400eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:25:15.288 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:15.285+0000 7fbc6b400640 1 -- 172.21.15.50:0/3157472582 <== mon.2 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc6400cd80 con 0x7fbc7406b4b0 2024-08-31T04:25:15.288 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:15.285+0000 7fbc6b400640 1 -- 172.21.15.50:0/3157472582 <== mon.2 v2:172.21.15.133:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbc640108e0 con 0x7fbc7406b4b0 2024-08-31T04:25:15.288 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:15.285+0000 7fbc6b400640 1 -- 172.21.15.50:0/3157472582 <== mon.2 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc64018980 con 0x7fbc7406b4b0 2024-08-31T04:25:15.288 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:15.285+0000 7fbc79800640 1 -- 172.21.15.50:0/3157472582 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbc741a2050 con 0x7fbc7406b4b0 2024-08-31T04:25:15.288 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:15.285+0000 7fbc79800640 1 -- 172.21.15.50:0/3157472582 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbc741a8740 con 0x7fbc7406b4b0 2024-08-31T04:25:15.293 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:15.291+0000 7fbc809f9740 1 Processor -- start 2024-08-31T04:25:15.294 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:15.292+0000 7fbc809f9740 1 -- start start 2024-08-31T04:25:15.295 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:15.293+0000 7fbc6b400640 1 -- 172.21.15.50:0/3157472582 <== mon.2 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 18) ==== 152577+0+0 (secure 0 0 0) 0x7fbc64010430 con 0x7fbc7406b4b0 2024-08-31T04:25:15.295 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:15.293+0000 7fbc809f9740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55da6865a1b0 0x55da689ffb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:15.295 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:15.293+0000 7fbc809f9740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55da686312f0 0x55da68a001a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:15.295 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:15.293+0000 7fbc809f9740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55da686394d0 0x55da68a00cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:15.296 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:15.293+0000 7fbc809f9740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55da68972f70 con 0x55da686394d0 2024-08-31T04:25:15.296 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:15.293+0000 7fbc809f9740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x55da68962500 con 0x55da6865a1b0 2024-08-31T04:25:15.296 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:15.293+0000 7fbc809f9740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x55da689664b0 con 0x55da686312f0 2024-08-31T04:25:15.297 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:15.293+0000 7fbc73400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55da6865a1b0 0x55da689ffb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:15.297 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:15.293+0000 7fbc73400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55da6865a1b0 0x55da689ffb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.50:58882/0 (socket says 172.21.15.50:58882) 2024-08-31T04:25:15.297 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:15.293+0000 7fbc73400640 1 -- 172.21.15.50:0/3466063155 learned_addr learned my addr 172.21.15.50:0/3466063155 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:25:15.297 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:15.294+0000 7fbc73400640 1 -- 172.21.15.50:0/3466063155 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55da686312f0 msgr2=0x55da68a001a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:25:15.297 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:15.294+0000 7fbc72000640 1 --2- 172.21.15.50:0/3466063155 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55da686394d0 0x55da68a00cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:15.297 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:15.294+0000 7fbc72a00640 1 --2- 172.21.15.50:0/3466063155 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55da686312f0 0x55da68a001a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:15.297 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:15.294+0000 7fbc73400640 1 --2- 172.21.15.50:0/3466063155 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55da686312f0 0x55da68a001a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:15.297 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:15.294+0000 7fbc73400640 1 -- 172.21.15.50:0/3466063155 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55da686394d0 msgr2=0x55da68a00cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:25:15.297 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:15.294+0000 7fbc73400640 1 --2- 172.21.15.50:0/3466063155 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55da686394d0 0x55da68a00cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:15.297 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:15.295+0000 7fbc73400640 1 -- 172.21.15.50:0/3466063155 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55da6891cc10 con 0x55da6865a1b0 2024-08-31T04:25:15.298 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:15.295+0000 7fbc72a00640 1 --2- 172.21.15.50:0/3466063155 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55da686312f0 0x55da68a001a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T04:25:15.298 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:15.295+0000 7fbc73400640 1 --2- 172.21.15.50:0/3466063155 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55da6865a1b0 0x55da689ffb30 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fbc6c035000 tx=0x7fbc6c009350 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8508440f2f39ad56 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:25:15.299 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:15.295+0000 7fbc72000640 1 --2- 172.21.15.50:0/3466063155 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55da686394d0 0x55da68a00cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T04:25:15.299 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:15.295+0000 7fbc6b400640 1 --2- 172.21.15.50:0/3157472582 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fbc580b4bb0 0x7fbc580b70c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:15.299 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:15.296+0000 7fbc5fe00640 1 -- 172.21.15.50:0/3466063155 <== mon.2 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc6c031610 con 0x55da6865a1b0 2024-08-31T04:25:15.299 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:15.296+0000 7fbc6b400640 1 -- 172.21.15.50:0/3157472582 <== mon.2 v2:172.21.15.133:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8219+0+0 (secure 0 0 0) 0x7fbc640e53b0 con 0x7fbc7406b4b0 2024-08-31T04:25:15.299 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:15.296+0000 7fbc5fe00640 1 -- 172.21.15.50:0/3466063155 <== mon.2 v2:172.21.15.133:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbc6c036040 con 0x55da6865a1b0 2024-08-31T04:25:15.299 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:15.296+0000 7fbc5fe00640 1 -- 172.21.15.50:0/3466063155 <== mon.2 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc6c02fe90 con 0x55da6865a1b0 2024-08-31T04:25:15.299 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:15.296+0000 7fbc72a00640 1 --2- 172.21.15.50:0/3157472582 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fbc580b4bb0 0x7fbc580b70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:15.300 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:15.297+0000 7fbc809f9740 1 -- 172.21.15.50:0/3466063155 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55da6865a1b0 msgr2=0x55da689ffb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:25:15.300 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:15.297+0000 7fbc809f9740 1 --2- 172.21.15.50:0/3466063155 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55da6865a1b0 0x55da689ffb30 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fbc6c035000 tx=0x7fbc6c009350 comp rx=0 tx=0).stop 2024-08-31T04:25:15.300 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:15.297+0000 7fbc72a00640 1 --2- 172.21.15.50:0/3157472582 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fbc580b4bb0 0x7fbc580b70c0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fbc640abba0 tx=0x7fbc64000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:25:15.300 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:15.297+0000 7fbc809f9740 1 -- 172.21.15.50:0/3466063155 shutdown_connections 2024-08-31T04:25:15.300 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:15.297+0000 7fbc809f9740 1 --2- 172.21.15.50:0/3466063155 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55da686312f0 0x55da68a001a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:15.300 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:15.297+0000 7fbc809f9740 1 --2- 172.21.15.50:0/3466063155 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55da686394d0 0x55da68a00cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:15.300 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:15.297+0000 7fbc809f9740 1 --2- 172.21.15.50:0/3466063155 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55da6865a1b0 0x55da689ffb30 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:15.300 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:15.297+0000 7fbc809f9740 1 -- 172.21.15.50:0/3466063155 >> 172.21.15.50:0/3466063155 conn(0x55da6864e300 msgr2=0x55da689fb5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:25:15.301 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:15.298+0000 7fbc809f9740 1 -- 172.21.15.50:0/3466063155 shutdown_connections 2024-08-31T04:25:15.301 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:15.298+0000 7fbc809f9740 1 -- 172.21.15.50:0/3466063155 wait complete. 2024-08-31T04:25:15.301 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:15.299+0000 7fbc809f9740 1 -- start start 2024-08-31T04:25:15.301 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:15.299+0000 7fbc809f9740 1 Processor -- start 2024-08-31T04:25:15.302 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:15.300+0000 7fbc809f9740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55da686312f0 0x55da68a091e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:15.302 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:15.300+0000 7fbc809f9740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55da686394d0 0x55da68a098a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:15.302 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:15.300+0000 7fbc809f9740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55da6865a1b0 0x55da68a0a410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:15.302 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:15.300+0000 7fbc809f9740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55da6889bab0 con 0x55da6865a1b0 2024-08-31T04:25:15.303 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:15.300+0000 7fbc809f9740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x55da68909320 con 0x55da686394d0 2024-08-31T04:25:15.303 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:15.300+0000 7fbc809f9740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x55da68a017b0 con 0x55da686312f0 2024-08-31T04:25:15.303 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:15.300+0000 7fbc809f9740 10 client.0 _ll_register_callbacks cb 0x55da68942e80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:25:15.304 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:15.300+0000 7fbc73400640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55da686312f0 0x55da68a091e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:15.304 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:15.300+0000 7fbc73400640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55da686312f0 0x55da68a091e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.50:48622/0 (socket says 172.21.15.50:48622) 2024-08-31T04:25:15.304 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:15.300+0000 7fbc73400640 1 -- 172.21.15.50:0/3635413096 learned_addr learned my addr 172.21.15.50:0/3635413096 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:25:15.304 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:15.301+0000 7fbc72000640 1 --2- 172.21.15.50:0/3635413096 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55da686394d0 0x55da68a098a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:15.304 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:15.301+0000 7fbc73400640 1 --2- 172.21.15.50:0/3635413096 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55da6865a1b0 0x55da68a0a410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:15.304 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:15.301+0000 7fbc72000640 1 -- 172.21.15.50:0/3635413096 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55da686312f0 msgr2=0x55da68a091e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:25:15.304 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:15.301+0000 7fbc72000640 1 --2- 172.21.15.50:0/3635413096 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55da686312f0 0x55da68a091e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:15.304 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:15.301+0000 7fbc72000640 1 -- 172.21.15.50:0/3635413096 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55da6865a1b0 msgr2=0x55da68a0a410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:25:15.304 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:15.301+0000 7fbc72000640 1 --2- 172.21.15.50:0/3635413096 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55da6865a1b0 0x55da68a0a410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:15.304 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:15.301+0000 7fbc72000640 1 -- 172.21.15.50:0/3635413096 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55da686c5790 con 0x55da686394d0 2024-08-31T04:25:15.305 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:15.302+0000 7fbc72000640 1 --2- 172.21.15.50:0/3635413096 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55da686394d0 0x55da68a098a0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fbc6000b910 tx=0x7fbc6000bdd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c9135fec09b2dcf6 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:25:15.305 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:15.302+0000 7fbc5cc00640 10 client.0 ms_handle_connect on v2:172.21.15.133:3300/0 2024-08-31T04:25:15.306 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:15.302+0000 7fbc5cc00640 1 -- 172.21.15.50:0/3635413096 <== mon.2 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc6001b470 con 0x55da686394d0 2024-08-31T04:25:15.306 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:15.302+0000 7fbc5cc00640 1 -- 172.21.15.50:0/3635413096 <== mon.2 v2:172.21.15.133:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8219+0+0 (secure 0 0 0) 0x7fbc6001b610 con 0x55da686394d0 2024-08-31T04:25:15.306 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:15.303+0000 7fbc809f9740 1 -- 172.21.15.50:0/3635413096 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbc6c036040 con 0x55da686394d0 2024-08-31T04:25:15.306 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:15.303+0000 7fbc5cc00640 1 -- 172.21.15.50:0/3635413096 <== mon.2 v2:172.21.15.133:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fbc6001b810 con 0x55da686394d0 2024-08-31T04:25:15.306 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:15.303+0000 7fbc809f9740 10 client.25664 fetch_fsmap learned FSMap version 30 2024-08-31T04:25:15.306 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:15.303+0000 7fbc809f9740 1 -- 172.21.15.50:0/3635413096 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55da6873e620 con 0x55da686394d0 2024-08-31T04:25:15.306 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:15.303+0000 7fbc5cc00640 1 -- 172.21.15.50:0/3635413096 <== mon.2 v2:172.21.15.133:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbc6c036040 con 0x55da686394d0 2024-08-31T04:25:15.307 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:15.304+0000 7fbc5cc00640 1 -- 172.21.15.50:0/3635413096 <== mon.2 v2:172.21.15.133:3300/0 5 ==== fsmap(e 30) ==== 8366+0+0 (secure 0 0 0) 0x7fbc60012b80 con 0x55da686394d0 2024-08-31T04:25:15.307 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:15.304+0000 7fbc809f9740 10 client.25664 fetch_fsmap finished waiting for FSMap version 30 2024-08-31T04:25:15.307 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:15.304+0000 7fbc809f9740 10 client.25664 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T04:25:15.307 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:15.304+0000 7fbc809f9740 20 client.25664 populate_metadata read hostname 'smithi050' 2024-08-31T04:25:15.307 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:15.304+0000 7fbc809f9740 1 --2- 172.21.15.50:0/3635413096 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x55da68618d80 0x55da68a168a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:15.307 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:15.304+0000 7fbc809f9740 4 client.25664 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T04:25:15.307 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:15.304+0000 7fbc809f9740 1 -- 172.21.15.50:0/3635413096 --> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55da68974ec0 con 0x55da68618d80 2024-08-31T04:25:15.308 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:15.306+0000 7fbc73400640 1 --2- 172.21.15.50:0/3635413096 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x55da68618d80 0x55da68a168a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:15.308 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:15.306+0000 7fbc5cc00640 10 client.25664 ms_handle_connect on v2:172.21.15.133:6838/2526402262 2024-08-31T04:25:15.308 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:15.306+0000 7fbc73400640 1 --2- 172.21.15.50:0/3635413096 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x55da68618d80 0x55da68a168a0 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=be7449be8f5cdec3 server_cookie=9621ab86a083cdeb in_seq=0 out_seq=0 2024-08-31T04:25:15.313 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:15.310+0000 7fbc5cc00640 1 -- 172.21.15.50:0/3635413096 <== mds.0 v2:172.21.15.133:6838/2526402262 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55da68974ec0 con 0x55da68618d80 2024-08-31T04:25:15.313 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:15.310+0000 7fbc5cc00640 10 client.25664 handle_command_reply: tid=0 2024-08-31T04:25:15.313 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:15.311+0000 7fbc809f9740 1 client.25664 shutdown 2024-08-31T04:25:15.314 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:15.312+0000 7fbc809f9740 1 -- 172.21.15.50:0/3635413096 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55da686394d0 msgr2=0x55da68a098a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:25:15.314 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:15.312+0000 7fbc809f9740 1 --2- 172.21.15.50:0/3635413096 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55da686394d0 0x55da68a098a0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fbc6000b910 tx=0x7fbc6000bdd0 comp rx=0 tx=0).stop 2024-08-31T04:25:15.315 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:15.312+0000 7fbc809f9740 1 -- 172.21.15.50:0/3635413096 shutdown_connections 2024-08-31T04:25:15.315 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:15.312+0000 7fbc809f9740 1 --2- 172.21.15.50:0/3635413096 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x55da68618d80 0x55da68a168a0 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:15.315 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:15.312+0000 7fbc809f9740 1 --2- 172.21.15.50:0/3635413096 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55da6865a1b0 0x55da68a0a410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:15.315 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:15.312+0000 7fbc809f9740 1 --2- 172.21.15.50:0/3635413096 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55da686394d0 0x55da68a098a0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:15.315 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:15.312+0000 7fbc809f9740 1 --2- 172.21.15.50:0/3635413096 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55da686312f0 0x55da68a091e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:15.315 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:15.312+0000 7fbc809f9740 1 -- 172.21.15.50:0/3635413096 >> 172.21.15.50:0/3635413096 conn(0x55da6864e300 msgr2=0x55da689f9b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:25:15.315 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:15.312+0000 7fbc5cc00640 0 client.25664 ms_handle_reset on v2:172.21.15.133:6838/2526402262 2024-08-31T04:25:15.315 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:15.312+0000 7fbc809f9740 1 -- 172.21.15.50:0/3635413096 shutdown_connections 2024-08-31T04:25:15.315 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:15.313+0000 7fbc809f9740 1 -- 172.21.15.50:0/3635413096 wait complete. 2024-08-31T04:25:15.316 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:15.313+0000 7fbc809f9740 20 client.25664 trim_cache size 0 max 16384 2024-08-31T04:25:15.341 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:15.339+0000 7fbc809f9740 1 Processor -- start 2024-08-31T04:25:15.341 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:15.339+0000 7fbc809f9740 1 -- start start 2024-08-31T04:25:15.342 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:15.339+0000 7fbc809f9740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55da686312f0 0x55da689fba00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:15.342 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:15.339+0000 7fbc809f9740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55da686394d0 0x55da68a112f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:15.342 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:15.339+0000 7fbc809f9740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55da6865a1b0 0x55da689fbf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:15.342 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:15.339+0000 7fbc809f9740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fbc741b1340 con 0x55da686394d0 2024-08-31T04:25:15.342 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:15.339+0000 7fbc809f9740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7fbc741b2eb0 con 0x55da686312f0 2024-08-31T04:25:15.342 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:15.339+0000 7fbc809f9740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fbc741b1a10 con 0x55da6865a1b0 2024-08-31T04:25:15.342 INFO:tasks.workunit.client.0.smithi050.stdout: 22 273963 296 350157 376 109859 1050 2024-08-31T04:25:15.343 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:15.340+0000 7fbc73400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55da686312f0 0x55da689fba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:15.344 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:15.340+0000 7fbc73400640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55da6865a1b0 0x55da689fbf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:15.344 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:15.340+0000 7fbc73400640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55da6865a1b0 0x55da689fbf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.50:48630/0 (socket says 172.21.15.50:48630) 2024-08-31T04:25:15.344 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:15.340+0000 7fbc73400640 1 -- 172.21.15.50:0/1391267456 learned_addr learned my addr 172.21.15.50:0/1391267456 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:25:15.344 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:15.340+0000 7fbc72000640 1 --2- 172.21.15.50:0/1391267456 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55da686394d0 0x55da68a112f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:15.344 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:15.340+0000 7fbc73400640 1 -- 172.21.15.50:0/1391267456 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55da686312f0 msgr2=0x55da689fba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:25:15.344 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:15.340+0000 7fbc73400640 1 --2- 172.21.15.50:0/1391267456 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55da686312f0 0x55da689fba00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:15.344 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:15.340+0000 7fbc73400640 1 -- 172.21.15.50:0/1391267456 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55da686394d0 msgr2=0x55da68a112f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:25:15.344 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:15.340+0000 7fbc73400640 1 --2- 172.21.15.50:0/1391267456 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55da686394d0 0x55da68a112f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:15.344 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:15.340+0000 7fbc73400640 1 -- 172.21.15.50:0/1391267456 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55da68a073a0 con 0x55da6865a1b0 2024-08-31T04:25:15.344 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:15.341+0000 7fbc73400640 1 --2- 172.21.15.50:0/1391267456 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55da6865a1b0 0x55da689fbf40 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fbc6c02ada0 tx=0x7fbc6c02a880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=397313adfe567886 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:25:15.344 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:15.341+0000 7fbc5f400640 1 -- 172.21.15.50:0/1391267456 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc6c04b040 con 0x55da6865a1b0 2024-08-31T04:25:15.344 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:15.341+0000 7fbc5f400640 1 -- 172.21.15.50:0/1391267456 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbc6c036070 con 0x55da6865a1b0 2024-08-31T04:25:15.345 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:15.341+0000 7fbc5f400640 1 -- 172.21.15.50:0/1391267456 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc6c0307e0 con 0x55da6865a1b0 2024-08-31T04:25:15.346 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:15.342+0000 7fbc809f9740 1 -- 172.21.15.50:0/1391267456 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55da6865a1b0 msgr2=0x55da689fbf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:25:15.347 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:15.342+0000 7fbc809f9740 1 --2- 172.21.15.50:0/1391267456 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55da6865a1b0 0x55da689fbf40 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fbc6c02ada0 tx=0x7fbc6c02a880 comp rx=0 tx=0).stop 2024-08-31T04:25:15.347 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:15.342+0000 7fbc809f9740 1 -- 172.21.15.50:0/1391267456 shutdown_connections 2024-08-31T04:25:15.347 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:15.342+0000 7fbc809f9740 1 --2- 172.21.15.50:0/1391267456 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55da6865a1b0 0x55da689fbf40 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:15.347 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:15.342+0000 7fbc809f9740 1 --2- 172.21.15.50:0/1391267456 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55da686394d0 0x55da68a112f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:15.347 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:15.342+0000 7fbc809f9740 1 --2- 172.21.15.50:0/1391267456 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55da686312f0 0x55da689fba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:15.347 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:15.342+0000 7fbc809f9740 1 -- 172.21.15.50:0/1391267456 >> 172.21.15.50:0/1391267456 conn(0x55da6864e300 msgr2=0x55da689f6240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:25:15.347 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:15.342+0000 7fbc809f9740 1 -- 172.21.15.50:0/1391267456 shutdown_connections 2024-08-31T04:25:15.347 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:15.342+0000 7fbc809f9740 1 -- 172.21.15.50:0/1391267456 wait complete. 2024-08-31T04:25:15.347 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:15.343+0000 7fbc809f9740 1 -- start start 2024-08-31T04:25:15.347 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:15.343+0000 7fbc809f9740 1 Processor -- start 2024-08-31T04:25:15.347 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:15.343+0000 7fbc809f9740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55da686312f0 0x55da68a10fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:15.347 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:15.343+0000 7fbc809f9740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55da686394d0 0x55da68a0fc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:15.348 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:15.343+0000 7fbc809f9740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55da6865a1b0 0x55da68a101a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:15.348 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:15.343+0000 7fbc809f9740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fbc741b27b0 con 0x55da686312f0 2024-08-31T04:25:15.348 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:15.343+0000 7fbc809f9740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7fbc741b20e0 con 0x55da686394d0 2024-08-31T04:25:15.348 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:15.343+0000 7fbc809f9740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fbc741af320 con 0x55da6865a1b0 2024-08-31T04:25:15.348 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:15.343+0000 7fbc809f9740 10 client.0 _ll_register_callbacks cb 0x7fbc60004040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:25:15.348 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:15.344+0000 7fbc72000640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55da686394d0 0x55da68a0fc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:15.348 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:15.344+0000 7fbc72000640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55da686394d0 0x55da68a0fc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.50:58892/0 (socket says 172.21.15.50:58892) 2024-08-31T04:25:15.348 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:15.344+0000 7fbc72000640 1 -- 172.21.15.50:0/3949509277 learned_addr learned my addr 172.21.15.50:0/3949509277 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:25:15.348 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:15.344+0000 7fbc73400640 1 --2- 172.21.15.50:0/3949509277 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55da686312f0 0x55da68a10fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:15.348 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:15.344+0000 7fbc73400640 1 --2- 172.21.15.50:0/3949509277 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55da6865a1b0 0x55da68a101a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:15.348 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:15.344+0000 7fbc72000640 1 -- 172.21.15.50:0/3949509277 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55da6865a1b0 msgr2=0x55da68a101a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:25:15.348 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:15.344+0000 7fbc72000640 1 --2- 172.21.15.50:0/3949509277 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55da6865a1b0 0x55da68a101a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:15.349 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:15.344+0000 7fbc72000640 1 -- 172.21.15.50:0/3949509277 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55da686312f0 msgr2=0x55da68a10fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:25:15.349 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:15.344+0000 7fbc72000640 1 --2- 172.21.15.50:0/3949509277 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55da686312f0 0x55da68a10fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:15.349 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:15.344+0000 7fbc72000640 1 -- 172.21.15.50:0/3949509277 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55da68a108b0 con 0x55da686394d0 2024-08-31T04:25:15.349 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:15.344+0000 7fbc73400640 1 --2- 172.21.15.50:0/3949509277 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55da6865a1b0 0x55da68a101a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:25:15.349 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:15.344+0000 7fbc72000640 1 --2- 172.21.15.50:0/3949509277 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55da686394d0 0x55da68a0fc60 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fbc60003ac0 tx=0x7fbc60003af0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3f09648e872d024c server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:25:15.349 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:15.344+0000 7fbc5cc00640 10 client.0 ms_handle_connect on v2:172.21.15.133:3300/0 2024-08-31T04:25:15.350 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:15.345+0000 7fbc5cc00640 1 -- 172.21.15.50:0/3949509277 <== mon.2 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc6002b040 con 0x55da686394d0 2024-08-31T04:25:15.350 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:15.345+0000 7fbc5cc00640 1 -- 172.21.15.50:0/3949509277 <== mon.2 v2:172.21.15.133:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8219+0+0 (secure 0 0 0) 0x7fbc60004330 con 0x55da686394d0 2024-08-31T04:25:15.350 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:15.345+0000 7fbc809f9740 1 -- 172.21.15.50:0/3949509277 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbc6c036070 con 0x55da686394d0 2024-08-31T04:25:15.350 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:15.345+0000 7fbc5cc00640 1 -- 172.21.15.50:0/3949509277 <== mon.2 v2:172.21.15.133:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fbc600259b0 con 0x55da686394d0 2024-08-31T04:25:15.351 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:15.345+0000 7fbc809f9740 10 client.25670 fetch_fsmap learned FSMap version 30 2024-08-31T04:25:15.351 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:15.345+0000 7fbc809f9740 1 -- 172.21.15.50:0/3949509277 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55da68a81260 con 0x55da686394d0 2024-08-31T04:25:15.351 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:15.346+0000 7fbc5cc00640 1 -- 172.21.15.50:0/3949509277 <== mon.2 v2:172.21.15.133:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbc6c036070 con 0x55da686394d0 2024-08-31T04:25:15.351 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:15.346+0000 7fbc5cc00640 1 -- 172.21.15.50:0/3949509277 <== mon.2 v2:172.21.15.133:3300/0 5 ==== fsmap(e 30) ==== 8366+0+0 (secure 0 0 0) 0x7fbc6002e070 con 0x55da686394d0 2024-08-31T04:25:15.351 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:15.346+0000 7fbc809f9740 10 client.25670 fetch_fsmap finished waiting for FSMap version 30 2024-08-31T04:25:15.351 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:15.346+0000 7fbc809f9740 10 client.25670 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T04:25:15.351 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:15.346+0000 7fbc809f9740 20 client.25670 populate_metadata read hostname 'smithi050' 2024-08-31T04:25:15.351 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:15.346+0000 7fbc809f9740 1 --2- 172.21.15.50:0/3949509277 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x55da685ee1c0 0x55da68a83cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:15.351 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:15.346+0000 7fbc809f9740 4 client.25670 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-31T04:25:15.351 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:15.346+0000 7fbc809f9740 1 -- 172.21.15.50:0/3949509277 --> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55da68970960 con 0x55da685ee1c0 2024-08-31T04:25:15.351 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:15.346+0000 7fbc73400640 1 --2- 172.21.15.50:0/3949509277 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x55da685ee1c0 0x55da68a83cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:15.351 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:15.347+0000 7fbc73400640 1 --2- 172.21.15.50:0/3949509277 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x55da685ee1c0 0x55da68a83cd0 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=61470231f4a7a2d5 server_cookie=72e1cf7dc2753282 in_seq=0 out_seq=0 2024-08-31T04:25:15.352 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:15.347+0000 7fbc5cc00640 10 client.25670 ms_handle_connect on v2:172.21.15.133:6838/2526402262 2024-08-31T04:25:15.450 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:25:15 smithi050 ceph-mon[17259]: pgmap v437: 97 pgs: 97 active+clean; 54 MiB data, 435 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 4.4 MiB/s wr, 510 op/s 2024-08-31T04:25:15.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:25:15 smithi177 ceph-mon[22025]: pgmap v437: 97 pgs: 97 active+clean; 54 MiB data, 435 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 4.4 MiB/s wr, 510 op/s 2024-08-31T04:25:15.542 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:25:15 smithi133 ceph-mon[22177]: pgmap v437: 97 pgs: 97 active+clean; 54 MiB data, 435 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 4.4 MiB/s wr, 510 op/s 2024-08-31T04:25:17.450 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:25:17 smithi050 ceph-mon[17259]: pgmap v438: 97 pgs: 97 active+clean; 63 MiB data, 436 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 5.1 MiB/s wr, 443 op/s 2024-08-31T04:25:17.450 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:25:17 smithi050 ceph-mon[17259]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-31T04:25:17.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:25:17 smithi177 ceph-mon[22025]: pgmap v438: 97 pgs: 97 active+clean; 63 MiB data, 436 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 5.1 MiB/s wr, 443 op/s 2024-08-31T04:25:17.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:25:17 smithi177 ceph-mon[22025]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-31T04:25:17.536 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:17.534+0000 7fbc5cc00640 1 -- 172.21.15.50:0/3949509277 <== mds.0 v2:172.21.15.133:6838/2526402262 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55da68970960 con 0x55da685ee1c0 2024-08-31T04:25:17.536 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:17.534+0000 7fbc5cc00640 10 client.25670 handle_command_reply: tid=0 2024-08-31T04:25:17.536 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:17.534+0000 7fbc809f9740 1 client.25670 shutdown 2024-08-31T04:25:17.536 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:17.535+0000 7fbc809f9740 1 -- 172.21.15.50:0/3949509277 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55da686394d0 msgr2=0x55da68a0fc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:25:17.536 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:17.535+0000 7fbc809f9740 1 --2- 172.21.15.50:0/3949509277 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55da686394d0 0x55da68a0fc60 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fbc60003ac0 tx=0x7fbc60003af0 comp rx=0 tx=0).stop 2024-08-31T04:25:17.537 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:17.535+0000 7fbc809f9740 1 -- 172.21.15.50:0/3949509277 shutdown_connections 2024-08-31T04:25:17.537 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:17.535+0000 7fbc809f9740 1 --2- 172.21.15.50:0/3949509277 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x55da685ee1c0 0x55da68a83cd0 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:17.537 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:17.535+0000 7fbc809f9740 1 --2- 172.21.15.50:0/3949509277 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55da6865a1b0 0x55da68a101a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:17.537 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:17.535+0000 7fbc809f9740 1 --2- 172.21.15.50:0/3949509277 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55da686394d0 0x55da68a0fc60 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:17.537 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:17.535+0000 7fbc809f9740 1 --2- 172.21.15.50:0/3949509277 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55da686312f0 0x55da68a10fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:17.537 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:17.535+0000 7fbc5cc00640 0 client.25670 ms_handle_reset on v2:172.21.15.133:6838/2526402262 2024-08-31T04:25:17.537 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:17.535+0000 7fbc809f9740 1 -- 172.21.15.50:0/3949509277 >> 172.21.15.50:0/3949509277 conn(0x55da6864e300 msgr2=0x55da689f6240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:25:17.537 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:17.535+0000 7fbc809f9740 1 -- 172.21.15.50:0/3949509277 shutdown_connections 2024-08-31T04:25:17.537 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:17.535+0000 7fbc809f9740 1 -- 172.21.15.50:0/3949509277 wait complete. 2024-08-31T04:25:17.538 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:17.535+0000 7fbc809f9740 20 client.25670 trim_cache size 0 max 16384 2024-08-31T04:25:17.538 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout:{ 2024-08-31T04:25:17.538 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout: "message": "", 2024-08-31T04:25:17.538 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout: "return_code": 0 2024-08-31T04:25:17.538 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout:} 2024-08-31T04:25:17.539 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:17.536+0000 7fbc79800640 1 -- 172.21.15.50:0/3157472582 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fbc580b4bb0 msgr2=0x7fbc580b70c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:25:17.539 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:17.536+0000 7fbc79800640 1 --2- 172.21.15.50:0/3157472582 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fbc580b4bb0 0x7fbc580b70c0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fbc640abba0 tx=0x7fbc64000bc0 comp rx=0 tx=0).stop 2024-08-31T04:25:17.539 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:17.536+0000 7fbc79800640 1 -- 172.21.15.50:0/3157472582 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbc7406b4b0 msgr2=0x7fbc741a0320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:25:17.539 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:17.536+0000 7fbc79800640 1 --2- 172.21.15.50:0/3157472582 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbc7406b4b0 0x7fbc741a0320 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fbc6400e9f0 tx=0x7fbc6400eeb0 comp rx=0 tx=0).stop 2024-08-31T04:25:17.539 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:17.536+0000 7fbc79800640 1 -- 172.21.15.50:0/3157472582 shutdown_connections 2024-08-31T04:25:17.539 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:17.536+0000 7fbc79800640 1 --2- 172.21.15.50:0/3157472582 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fbc580b4bb0 0x7fbc580b70c0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:17.539 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:17.536+0000 7fbc79800640 1 --2- 172.21.15.50:0/3157472582 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbc74106f70 0x7fbc741a1540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:17.539 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:17.536+0000 7fbc79800640 1 --2- 172.21.15.50:0/3157472582 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbc741043b0 0x7fbc741a0990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:17.539 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:17.536+0000 7fbc79800640 1 --2- 172.21.15.50:0/3157472582 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbc7406b4b0 0x7fbc741a0320 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:17.539 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:17.536+0000 7fbc79800640 1 -- 172.21.15.50:0/3157472582 >> 172.21.15.50:0/3157472582 conn(0x7fbc740fdc80 msgr2=0x7fbc741052a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:25:17.539 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:17.537+0000 7fbc79800640 1 -- 172.21.15.50:0/3157472582 shutdown_connections 2024-08-31T04:25:17.539 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:17.537+0000 7fbc79800640 1 -- 172.21.15.50:0/3157472582 wait complete. 2024-08-31T04:25:17.542 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:25:17 smithi133 ceph-mon[22177]: pgmap v438: 97 pgs: 97 active+clean; 63 MiB data, 436 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 5.1 MiB/s wr, 443 op/s 2024-08-31T04:25:17.542 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:25:17 smithi133 ceph-mon[22177]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-31T04:25:19.450 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:25:19 smithi050 ceph-mon[17259]: pgmap v439: 97 pgs: 97 active+clean; 63 MiB data, 442 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 3.9 MiB/s wr, 288 op/s 2024-08-31T04:25:19.495 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:25:19 smithi177 ceph-mon[22025]: pgmap v439: 97 pgs: 97 active+clean; 63 MiB data, 442 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 3.9 MiB/s wr, 288 op/s 2024-08-31T04:25:19.542 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:25:19 smithi133 ceph-mon[22177]: pgmap v439: 97 pgs: 97 active+clean; 63 MiB data, 442 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 3.9 MiB/s wr, 288 op/s 2024-08-31T04:25:21.450 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:25:21 smithi050 ceph-mon[17259]: pgmap v440: 97 pgs: 97 active+clean; 59 MiB data, 441 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 2.8 MiB/s wr, 326 op/s 2024-08-31T04:25:21.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:25:21 smithi177 ceph-mon[22025]: pgmap v440: 97 pgs: 97 active+clean; 59 MiB data, 441 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 2.8 MiB/s wr, 326 op/s 2024-08-31T04:25:21.542 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:25:21 smithi133 ceph-mon[22177]: pgmap v440: 97 pgs: 97 active+clean; 59 MiB data, 441 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 2.8 MiB/s wr, 326 op/s 2024-08-31T04:25:23.450 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:25:23 smithi050 ceph-mon[17259]: pgmap v441: 97 pgs: 97 active+clean; 45 MiB data, 435 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.7 MiB/s wr, 633 op/s 2024-08-31T04:25:23.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:25:23 smithi177 ceph-mon[22025]: pgmap v441: 97 pgs: 97 active+clean; 45 MiB data, 435 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.7 MiB/s wr, 633 op/s 2024-08-31T04:25:23.542 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:25:23 smithi133 ceph-mon[22177]: pgmap v441: 97 pgs: 97 active+clean; 45 MiB data, 435 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.7 MiB/s wr, 633 op/s 2024-08-31T04:25:25.342 INFO:tasks.workunit.client.0.smithi050.stdout: 32 135489 525 87638 522 68277 911 2024-08-31T04:25:25.449 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:25:25 smithi050 ceph-mon[17259]: pgmap v442: 97 pgs: 97 active+clean; 45 MiB data, 435 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.6 MiB/s wr, 563 op/s 2024-08-31T04:25:25.495 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:25:25 smithi177 ceph-mon[22025]: pgmap v442: 97 pgs: 97 active+clean; 45 MiB data, 435 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.6 MiB/s wr, 563 op/s 2024-08-31T04:25:25.542 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:25:25 smithi133 ceph-mon[22177]: pgmap v442: 97 pgs: 97 active+clean; 45 MiB data, 435 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.6 MiB/s wr, 563 op/s 2024-08-31T04:25:27.251 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:25:27 smithi050 ceph-mon[17259]: pgmap v443: 97 pgs: 97 active+clean; 51 MiB data, 440 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.2 MiB/s wr, 585 op/s 2024-08-31T04:25:27.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:25:27 smithi177 ceph-mon[22025]: pgmap v443: 97 pgs: 97 active+clean; 51 MiB data, 440 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.2 MiB/s wr, 585 op/s 2024-08-31T04:25:27.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:25:27 smithi133 ceph-mon[22177]: pgmap v443: 97 pgs: 97 active+clean; 51 MiB data, 440 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.2 MiB/s wr, 585 op/s 2024-08-31T04:25:29.228 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:25:29 smithi050 ceph-mon[17259]: pgmap v444: 97 pgs: 97 active+clean; 57 MiB data, 446 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.9 MiB/s wr, 608 op/s 2024-08-31T04:25:29.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:25:29 smithi177 ceph-mon[22025]: pgmap v444: 97 pgs: 97 active+clean; 57 MiB data, 446 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.9 MiB/s wr, 608 op/s 2024-08-31T04:25:29.542 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:25:29 smithi133 ceph-mon[22177]: pgmap v444: 97 pgs: 97 active+clean; 57 MiB data, 446 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.9 MiB/s wr, 608 op/s 2024-08-31T04:25:30.856 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:30.854+0000 7f0bd4a00640 1 -- 172.21.15.50:0/2730986802 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0bd006c0b0 msgr2=0x7f0bd0105ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:25:30.856 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:30.854+0000 7f0bd4a00640 1 --2- 172.21.15.50:0/2730986802 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0bd006c0b0 0x7f0bd0105ee0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f0bc0009900 tx=0x7f0bc002a3f0 comp rx=0 tx=0).stop 2024-08-31T04:25:30.856 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:30.854+0000 7f0bd4a00640 1 -- 172.21.15.50:0/2730986802 shutdown_connections 2024-08-31T04:25:30.856 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:30.854+0000 7f0bd4a00640 1 --2- 172.21.15.50:0/2730986802 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0bd0106420 0x7f0bd01088a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:30.856 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:30.854+0000 7f0bd4a00640 1 --2- 172.21.15.50:0/2730986802 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0bd0108fe0 0x7f0bd010b4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:30.856 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:30.854+0000 7f0bd4a00640 1 --2- 172.21.15.50:0/2730986802 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0bd006c0b0 0x7f0bd0105ee0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:30.856 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:30.854+0000 7f0bd4a00640 1 -- 172.21.15.50:0/2730986802 >> 172.21.15.50:0/2730986802 conn(0x7f0bd00fdae0 msgr2=0x7f0bd00fff90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:25:30.857 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:30.855+0000 7f0bd4a00640 1 -- 172.21.15.50:0/2730986802 shutdown_connections 2024-08-31T04:25:30.857 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:30.855+0000 7f0bd4a00640 1 -- 172.21.15.50:0/2730986802 wait complete. 2024-08-31T04:25:30.858 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:30.856+0000 7f0bd4a00640 1 Processor -- start 2024-08-31T04:25:30.858 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:30.856+0000 7f0bd4a00640 1 -- start start 2024-08-31T04:25:30.858 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:30.856+0000 7f0bd4a00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0bd006c0b0 0x7f0bd019bdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:30.858 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:30.856+0000 7f0bd4a00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0bd0106420 0x7f0bd019c430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:30.858 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:30.856+0000 7f0bd4a00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0bd0108fe0 0x7f0bd019cfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:30.858 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:30.856+0000 7f0bd4a00640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f0bd010ef00 con 0x7f0bd0106420 2024-08-31T04:25:30.859 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:30.856+0000 7f0bd4a00640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f0bd010ed80 con 0x7f0bd0108fe0 2024-08-31T04:25:30.859 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:30.856+0000 7f0bd4a00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f0bd010f080 con 0x7f0bd006c0b0 2024-08-31T04:25:30.859 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:30.856+0000 7f0bce800640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0bd006c0b0 0x7f0bd019bdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:30.859 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:30.856+0000 7f0bcf200640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0bd0108fe0 0x7f0bd019cfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:30.859 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:30.856+0000 7f0bce800640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0bd006c0b0 0x7f0bd019bdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.50:36068/0 (socket says 172.21.15.50:36068) 2024-08-31T04:25:30.859 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:30.856+0000 7f0bcf200640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0bd0108fe0 0x7f0bd019cfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.50:50940/0 (socket says 172.21.15.50:50940) 2024-08-31T04:25:30.859 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:30.857+0000 7f0bcf200640 1 -- 172.21.15.50:0/2509930456 learned_addr learned my addr 172.21.15.50:0/2509930456 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:25:30.859 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:30.857+0000 7f0bcde00640 1 --2- 172.21.15.50:0/2509930456 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0bd0106420 0x7f0bd019c430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:30.859 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:30.857+0000 7f0bcf200640 1 -- 172.21.15.50:0/2509930456 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0bd006c0b0 msgr2=0x7f0bd019bdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:25:30.859 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:30.857+0000 7f0bcf200640 1 --2- 172.21.15.50:0/2509930456 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0bd006c0b0 0x7f0bd019bdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:30.859 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:30.857+0000 7f0bcf200640 1 -- 172.21.15.50:0/2509930456 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0bd0106420 msgr2=0x7f0bd019c430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:25:30.859 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:30.857+0000 7f0bcf200640 1 --2- 172.21.15.50:0/2509930456 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0bd0106420 0x7f0bd019c430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:30.859 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:30.857+0000 7f0bcf200640 1 -- 172.21.15.50:0/2509930456 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0bd019d800 con 0x7f0bd0108fe0 2024-08-31T04:25:30.860 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:30.857+0000 7f0bcde00640 1 --2- 172.21.15.50:0/2509930456 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0bd0106420 0x7f0bd019c430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:25:30.860 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:30.857+0000 7f0bce800640 1 --2- 172.21.15.50:0/2509930456 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0bd006c0b0 0x7f0bd019bdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:25:30.860 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:30.857+0000 7f0bcf200640 1 --2- 172.21.15.50:0/2509930456 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0bd0108fe0 0x7f0bd019cfe0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f0bc800efd0 tx=0x7f0bc800c6a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:25:30.860 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:30.858+0000 7f0bc7400640 1 -- 172.21.15.50:0/2509930456 <== mon.2 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bc8003b70 con 0x7f0bd0108fe0 2024-08-31T04:25:30.861 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:30.858+0000 7f0bc7400640 1 -- 172.21.15.50:0/2509930456 <== mon.2 v2:172.21.15.133:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0bc8003d10 con 0x7f0bd0108fe0 2024-08-31T04:25:30.861 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:30.858+0000 7f0bc7400640 1 -- 172.21.15.50:0/2509930456 <== mon.2 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bc80108a0 con 0x7f0bd0108fe0 2024-08-31T04:25:30.861 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:30.858+0000 7f0bd4a00640 1 -- 172.21.15.50:0/2509930456 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0bd019daf0 con 0x7f0bd0108fe0 2024-08-31T04:25:30.861 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:30.858+0000 7f0bd4a00640 1 -- 172.21.15.50:0/2509930456 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0bd01a41e0 con 0x7f0bd0108fe0 2024-08-31T04:25:30.862 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:30.861+0000 7f0bdc403740 1 Processor -- start 2024-08-31T04:25:30.863 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:30.862+0000 7f0bc7400640 1 -- 172.21.15.50:0/2509930456 <== mon.2 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 18) ==== 152577+0+0 (secure 0 0 0) 0x7f0bc8004020 con 0x7f0bd0108fe0 2024-08-31T04:25:30.863 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:30.862+0000 7f0bdc403740 1 -- start start 2024-08-31T04:25:30.863 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:30.862+0000 7f0bdc403740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d954dcc1b0 0x55d955171fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:30.863 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:30.862+0000 7f0bdc403740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d954da32f0 0x55d955172610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:30.864 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:30.862+0000 7f0bdc403740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55d954dab4d0 0x55d955173160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:30.864 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:30.862+0000 7f0bdc403740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55d9550e4f70 con 0x55d954da32f0 2024-08-31T04:25:30.864 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:30.862+0000 7f0bdc403740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x55d9550d4500 con 0x55d954dab4d0 2024-08-31T04:25:30.864 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:30.862+0000 7f0bdc403740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x55d9550d84b0 con 0x55d954dcc1b0 2024-08-31T04:25:30.865 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:30.863+0000 7f0bce800640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d954da32f0 0x55d955172610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:30.865 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:30.863+0000 7f0bcde00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55d954dab4d0 0x55d955173160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:30.865 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:30.863+0000 7f0bce800640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d954da32f0 0x55d955172610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:54092/0 (socket says 172.21.15.50:54092) 2024-08-31T04:25:30.865 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:30.863+0000 7f0bce800640 1 -- 172.21.15.50:0/2738253334 learned_addr learned my addr 172.21.15.50:0/2738253334 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:25:30.865 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:30.863+0000 7f0bcde00640 1 --2- 172.21.15.50:0/2738253334 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d954dcc1b0 0x55d955171fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:30.865 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:30.863+0000 7f0bce800640 1 -- 172.21.15.50:0/2738253334 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d954dcc1b0 msgr2=0x55d955171fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:25:30.865 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:30.863+0000 7f0bce800640 1 --2- 172.21.15.50:0/2738253334 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d954dcc1b0 0x55d955171fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:30.866 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:30.863+0000 7f0bce800640 1 -- 172.21.15.50:0/2738253334 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55d954dab4d0 msgr2=0x55d955173160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:25:30.866 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:30.863+0000 7f0bce800640 1 --2- 172.21.15.50:0/2738253334 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55d954dab4d0 0x55d955173160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:30.866 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:30.863+0000 7f0bce800640 1 -- 172.21.15.50:0/2738253334 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d95508ec10 con 0x55d954da32f0 2024-08-31T04:25:30.866 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:30.863+0000 7f0bcde00640 1 --2- 172.21.15.50:0/2738253334 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55d954dab4d0 0x55d955173160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:25:30.866 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:30.864+0000 7f0bce800640 1 --2- 172.21.15.50:0/2738253334 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d954da32f0 0x55d955172610 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f0bc0032fd0 tx=0x7f0bc0005e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c17c32ccfbe8ed37 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:25:30.866 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:30.864+0000 7f0bbb400640 1 -- 172.21.15.50:0/2738253334 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bc0035070 con 0x55d954da32f0 2024-08-31T04:25:30.866 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:30.864+0000 7f0bc7400640 1 --2- 172.21.15.50:0/2509930456 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f0bb40b4b30 0x7f0bb40b7040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:30.866 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:30.864+0000 7f0bbb400640 1 -- 172.21.15.50:0/2738253334 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0bc0031820 con 0x55d954da32f0 2024-08-31T04:25:30.866 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:30.864+0000 7f0bbb400640 1 -- 172.21.15.50:0/2738253334 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bc0003dc0 con 0x55d954da32f0 2024-08-31T04:25:30.867 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:30.864+0000 7f0bc7400640 1 -- 172.21.15.50:0/2509930456 <== mon.2 v2:172.21.15.133:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8219+0+0 (secure 0 0 0) 0x7f0bc80e5660 con 0x7f0bd0108fe0 2024-08-31T04:25:30.867 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:30.864+0000 7f0bcde00640 1 --2- 172.21.15.50:0/2509930456 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f0bb40b4b30 0x7f0bb40b7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:30.867 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:30.865+0000 7f0bdc403740 1 -- 172.21.15.50:0/2738253334 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d954da32f0 msgr2=0x55d955172610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:25:30.867 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:30.865+0000 7f0bdc403740 1 --2- 172.21.15.50:0/2738253334 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d954da32f0 0x55d955172610 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f0bc0032fd0 tx=0x7f0bc0005e00 comp rx=0 tx=0).stop 2024-08-31T04:25:30.867 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:30.865+0000 7f0bcde00640 1 --2- 172.21.15.50:0/2509930456 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f0bb40b4b30 0x7f0bb40b7040 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f0bd006c660 tx=0x7f0bbc009680 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:25:30.868 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:30.865+0000 7f0bdc403740 1 -- 172.21.15.50:0/2738253334 shutdown_connections 2024-08-31T04:25:30.868 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:30.865+0000 7f0bdc403740 1 --2- 172.21.15.50:0/2738253334 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55d954dab4d0 0x55d955173160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:30.868 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:30.865+0000 7f0bdc403740 1 --2- 172.21.15.50:0/2738253334 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d954da32f0 0x55d955172610 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:30.868 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:30.865+0000 7f0bdc403740 1 --2- 172.21.15.50:0/2738253334 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d954dcc1b0 0x55d955171fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:30.868 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:30.865+0000 7f0bdc403740 1 -- 172.21.15.50:0/2738253334 >> 172.21.15.50:0/2738253334 conn(0x55d954dc0300 msgr2=0x55d95516da30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:25:30.868 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:30.866+0000 7f0bdc403740 1 -- 172.21.15.50:0/2738253334 shutdown_connections 2024-08-31T04:25:30.868 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:30.866+0000 7f0bdc403740 1 -- 172.21.15.50:0/2738253334 wait complete. 2024-08-31T04:25:30.868 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:30.866+0000 7f0bdc403740 1 -- start start 2024-08-31T04:25:30.869 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:30.867+0000 7f0bdc403740 1 Processor -- start 2024-08-31T04:25:30.871 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:30.868+0000 7f0bdc403740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d954da32f0 0x55d95517b540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:30.871 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:30.868+0000 7f0bdc403740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55d954dab4d0 0x55d95517bc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:30.871 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:30.868+0000 7f0bdc403740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d954dcc1b0 0x55d95517c770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:30.872 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:30.868+0000 7f0bdc403740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55d95500dab0 con 0x55d954da32f0 2024-08-31T04:25:30.872 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:30.868+0000 7f0bdc403740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x55d95507b320 con 0x55d954dab4d0 2024-08-31T04:25:30.872 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:30.868+0000 7f0bdc403740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x55d955173c20 con 0x55d954dcc1b0 2024-08-31T04:25:30.872 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:30.868+0000 7f0bdc403740 10 client.0 _ll_register_callbacks cb 0x55d9550816a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:25:30.872 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:30.868+0000 7f0bcde00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55d954dab4d0 0x55d95517bc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:30.872 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:30.868+0000 7f0bce800640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d954da32f0 0x55d95517b540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:30.872 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:30.868+0000 7f0bcde00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55d954dab4d0 0x55d95517bc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.50:50960/0 (socket says 172.21.15.50:50960) 2024-08-31T04:25:30.872 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:30.868+0000 7f0bcde00640 1 -- 172.21.15.50:0/2957160989 learned_addr learned my addr 172.21.15.50:0/2957160989 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:25:30.872 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:30.868+0000 7f0bcf200640 1 --2- 172.21.15.50:0/2957160989 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d954dcc1b0 0x55d95517c770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:30.872 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:30.868+0000 7f0bcf200640 1 -- 172.21.15.50:0/2957160989 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55d954dab4d0 msgr2=0x55d95517bc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:25:30.872 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:30.868+0000 7f0bcf200640 1 --2- 172.21.15.50:0/2957160989 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55d954dab4d0 0x55d95517bc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:30.872 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:30.868+0000 7f0bcf200640 1 -- 172.21.15.50:0/2957160989 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d954da32f0 msgr2=0x55d95517b540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:25:30.873 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:30.868+0000 7f0bcf200640 1 --2- 172.21.15.50:0/2957160989 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d954da32f0 0x55d95517b540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:30.873 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:30.868+0000 7f0bcf200640 1 -- 172.21.15.50:0/2957160989 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d954e37790 con 0x55d954dcc1b0 2024-08-31T04:25:30.873 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:30.868+0000 7f0bce800640 1 --2- 172.21.15.50:0/2957160989 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d954da32f0 0x55d95517b540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:25:30.873 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:30.869+0000 7f0bcf200640 1 --2- 172.21.15.50:0/2957160989 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d954dcc1b0 0x55d95517c770 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f0bc800cba0 tx=0x7f0bc80abb50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=94490149b8c5a10a server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:25:30.873 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:30.869+0000 7f0bafe00640 10 client.0 ms_handle_connect on v2:172.21.15.177:3300/0 2024-08-31T04:25:30.873 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:30.869+0000 7f0bafe00640 1 -- 172.21.15.50:0/2957160989 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bc80d1030 con 0x55d954dcc1b0 2024-08-31T04:25:30.873 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:30.869+0000 7f0bafe00640 1 -- 172.21.15.50:0/2957160989 <== mon.1 v2:172.21.15.177:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8219+0+0 (secure 0 0 0) 0x7f0bc80a8630 con 0x55d954dcc1b0 2024-08-31T04:25:30.873 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:30.869+0000 7f0bdc403740 1 -- 172.21.15.50:0/2957160989 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0bc0031820 con 0x55d954dcc1b0 2024-08-31T04:25:30.873 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:30.869+0000 7f0bafe00640 1 -- 172.21.15.50:0/2957160989 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f0bc80c6050 con 0x55d954dcc1b0 2024-08-31T04:25:30.873 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:30.869+0000 7f0bdc403740 10 client.25687 fetch_fsmap learned FSMap version 31 2024-08-31T04:25:30.873 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:30.869+0000 7f0bdc403740 1 -- 172.21.15.50:0/2957160989 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55d954eb0620 con 0x55d954dcc1b0 2024-08-31T04:25:30.873 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:30.869+0000 7f0bafe00640 1 -- 172.21.15.50:0/2957160989 <== mon.1 v2:172.21.15.177:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0bc0031820 con 0x55d954dcc1b0 2024-08-31T04:25:30.873 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:30.870+0000 7f0bafe00640 1 -- 172.21.15.50:0/2957160989 <== mon.1 v2:172.21.15.177:3300/0 5 ==== fsmap(e 31) ==== 8378+0+0 (secure 0 0 0) 0x7f0bc801f020 con 0x55d954dcc1b0 2024-08-31T04:25:30.874 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:30.870+0000 7f0bdc403740 10 client.25687 fetch_fsmap finished waiting for FSMap version 31 2024-08-31T04:25:30.874 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:30.870+0000 7f0bdc403740 10 client.25687 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T04:25:30.874 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:30.870+0000 7f0bdc403740 20 client.25687 populate_metadata read hostname 'smithi050' 2024-08-31T04:25:30.874 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:30.870+0000 7f0bdc403740 1 --2- 172.21.15.50:0/2957160989 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x55d954d8ad80 0x55d955188dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:30.874 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:30.870+0000 7f0bdc403740 4 client.25687 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T04:25:30.874 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:30.870+0000 7f0bdc403740 1 -- 172.21.15.50:0/2957160989 --> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d9550e6ec0 con 0x55d954d8ad80 2024-08-31T04:25:30.874 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:30.870+0000 7f0bce800640 1 --2- 172.21.15.50:0/2957160989 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x55d954d8ad80 0x55d955188dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:30.875 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:30.871+0000 7f0bce800640 1 --2- 172.21.15.50:0/2957160989 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x55d954d8ad80 0x55d955188dc0 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5c3777cd0a57ed72 server_cookie=b47cef811aaf049d in_seq=0 out_seq=0 2024-08-31T04:25:30.875 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:30.871+0000 7f0bafe00640 10 client.25687 ms_handle_connect on v2:172.21.15.133:6838/2526402262 2024-08-31T04:25:30.875 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:30.872+0000 7f0bafe00640 1 -- 172.21.15.50:0/2957160989 <== mds.0 v2:172.21.15.133:6838/2526402262 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55d9550e6ec0 con 0x55d954d8ad80 2024-08-31T04:25:30.875 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:30.872+0000 7f0bafe00640 10 client.25687 handle_command_reply: tid=0 2024-08-31T04:25:30.875 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:30.872+0000 7f0bdc403740 1 client.25687 shutdown 2024-08-31T04:25:30.875 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:30.872+0000 7f0bdc403740 1 -- 172.21.15.50:0/2957160989 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d954dcc1b0 msgr2=0x55d95517c770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:25:30.876 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:30.872+0000 7f0bdc403740 1 --2- 172.21.15.50:0/2957160989 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d954dcc1b0 0x55d95517c770 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f0bc800cba0 tx=0x7f0bc80abb50 comp rx=0 tx=0).stop 2024-08-31T04:25:30.876 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:30.873+0000 7f0bdc403740 1 -- 172.21.15.50:0/2957160989 shutdown_connections 2024-08-31T04:25:30.876 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:30.873+0000 7f0bdc403740 1 --2- 172.21.15.50:0/2957160989 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x55d954d8ad80 0x55d955188dc0 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:30.876 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:30.873+0000 7f0bdc403740 1 --2- 172.21.15.50:0/2957160989 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d954dcc1b0 0x55d95517c770 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:30.876 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:30.873+0000 7f0bdc403740 1 --2- 172.21.15.50:0/2957160989 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55d954dab4d0 0x55d95517bc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:30.876 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:30.873+0000 7f0bafe00640 0 client.25687 ms_handle_reset on v2:172.21.15.133:6838/2526402262 2024-08-31T04:25:30.876 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:30.873+0000 7f0bdc403740 1 --2- 172.21.15.50:0/2957160989 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d954da32f0 0x55d95517b540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:30.876 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:30.873+0000 7f0bdc403740 1 -- 172.21.15.50:0/2957160989 >> 172.21.15.50:0/2957160989 conn(0x55d954dc0300 msgr2=0x55d95516e630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:25:30.876 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:30.873+0000 7f0bdc403740 1 -- 172.21.15.50:0/2957160989 shutdown_connections 2024-08-31T04:25:30.876 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:30.873+0000 7f0bdc403740 1 -- 172.21.15.50:0/2957160989 wait complete. 2024-08-31T04:25:30.876 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:30.873+0000 7f0bdc403740 20 client.25687 trim_cache size 0 max 16384 2024-08-31T04:25:30.891 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:30.889+0000 7f0bdc403740 1 Processor -- start 2024-08-31T04:25:30.891 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:30.889+0000 7f0bdc403740 1 -- start start 2024-08-31T04:25:30.891 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:30.889+0000 7f0bdc403740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55d954da32f0 0x55d955171f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:30.891 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:30.889+0000 7f0bdc403740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d954dab4d0 0x55d95516e570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:30.891 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:30.889+0000 7f0bdc403740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d954dcc1b0 0x55d95516eab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:30.891 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:30.889+0000 7f0bdc403740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f0bd01acd30 con 0x55d954dab4d0 2024-08-31T04:25:30.891 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:30.889+0000 7f0bdc403740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f0bd01ae930 con 0x55d954da32f0 2024-08-31T04:25:30.892 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:30.889+0000 7f0bdc403740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f0bd01ad400 con 0x55d954dcc1b0 2024-08-31T04:25:30.892 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:30.890+0000 7f0bce800640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55d954da32f0 0x55d955171f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:30.892 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:30.890+0000 7f0bcde00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d954dab4d0 0x55d95516e570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:30.892 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:30.890+0000 7f0bce800640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55d954da32f0 0x55d955171f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.50:50970/0 (socket says 172.21.15.50:50970) 2024-08-31T04:25:30.892 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:30.890+0000 7f0bce800640 1 -- 172.21.15.50:0/2779841254 learned_addr learned my addr 172.21.15.50:0/2779841254 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:25:30.892 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:30.890+0000 7f0bcf200640 1 --2- 172.21.15.50:0/2779841254 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d954dcc1b0 0x55d95516eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:30.892 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:30.890+0000 7f0bce800640 1 -- 172.21.15.50:0/2779841254 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d954dcc1b0 msgr2=0x55d95516eab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:25:30.892 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:30.890+0000 7f0bce800640 1 --2- 172.21.15.50:0/2779841254 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d954dcc1b0 0x55d95516eab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:30.892 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:30.890+0000 7f0bce800640 1 -- 172.21.15.50:0/2779841254 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d954dab4d0 msgr2=0x55d95516e570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:25:30.892 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:30.890+0000 7f0bce800640 1 --2- 172.21.15.50:0/2779841254 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d954dab4d0 0x55d95516e570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:30.892 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:30.890+0000 7f0bce800640 1 -- 172.21.15.50:0/2779841254 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d95516e380 con 0x55d954da32f0 2024-08-31T04:25:30.893 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:30.890+0000 7f0bce800640 1 --2- 172.21.15.50:0/2779841254 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55d954da32f0 0x55d955171f40 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f0bc002a910 tx=0x7f0bc0031400 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4e66f222d7ab3e23 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:25:30.894 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:30.891+0000 7f0bbaa00640 1 -- 172.21.15.50:0/2779841254 <== mon.2 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bc005c070 con 0x55d954da32f0 2024-08-31T04:25:30.894 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:30.891+0000 7f0bbaa00640 1 -- 172.21.15.50:0/2779841254 <== mon.2 v2:172.21.15.133:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0bc00315a0 con 0x55d954da32f0 2024-08-31T04:25:30.894 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:30.891+0000 7f0bbaa00640 1 -- 172.21.15.50:0/2779841254 <== mon.2 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bc0035040 con 0x55d954da32f0 2024-08-31T04:25:30.894 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:30.891+0000 7f0bdc403740 1 -- 172.21.15.50:0/2779841254 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55d954da32f0 msgr2=0x55d955171f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:25:30.894 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:30.891+0000 7f0bdc403740 1 --2- 172.21.15.50:0/2779841254 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55d954da32f0 0x55d955171f40 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f0bc002a910 tx=0x7f0bc0031400 comp rx=0 tx=0).stop 2024-08-31T04:25:30.894 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:30.891+0000 7f0bdc403740 1 -- 172.21.15.50:0/2779841254 shutdown_connections 2024-08-31T04:25:30.894 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:30.892+0000 7f0bdc403740 1 --2- 172.21.15.50:0/2779841254 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d954dcc1b0 0x55d95516eab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:30.894 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:30.892+0000 7f0bdc403740 1 --2- 172.21.15.50:0/2779841254 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d954dab4d0 0x55d95516e570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:30.894 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:30.892+0000 7f0bdc403740 1 --2- 172.21.15.50:0/2779841254 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55d954da32f0 0x55d955171f40 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:30.894 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:30.892+0000 7f0bdc403740 1 -- 172.21.15.50:0/2779841254 >> 172.21.15.50:0/2779841254 conn(0x55d954dc0300 msgr2=0x55d955168660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:25:30.894 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:30.892+0000 7f0bdc403740 1 -- 172.21.15.50:0/2779841254 shutdown_connections 2024-08-31T04:25:30.894 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:30.892+0000 7f0bdc403740 1 -- 172.21.15.50:0/2779841254 wait complete. 2024-08-31T04:25:30.894 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:30.892+0000 7f0bdc403740 1 -- start start 2024-08-31T04:25:30.895 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:30.892+0000 7f0bdc403740 1 Processor -- start 2024-08-31T04:25:30.897 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:30.893+0000 7f0bdc403740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d954da32f0 0x55d955180940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:30.897 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:30.893+0000 7f0bdc403740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55d954dab4d0 0x55d955181000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:30.897 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:30.893+0000 7f0bdc403740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d954dcc1b0 0x55d955181b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:30.897 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:30.893+0000 7f0bdc403740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f0bd01ae1a0 con 0x55d954da32f0 2024-08-31T04:25:30.897 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:30.893+0000 7f0bdc403740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f0bd01adad0 con 0x55d954dab4d0 2024-08-31T04:25:30.897 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:30.893+0000 7f0bdc403740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f0bd01aad10 con 0x55d954dcc1b0 2024-08-31T04:25:30.897 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:30.893+0000 7f0bdc403740 10 client.0 _ll_register_callbacks cb 0x7f0bc80ab990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:25:30.898 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:30.893+0000 7f0bce800640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d954da32f0 0x55d955180940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:30.898 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:30.893+0000 7f0bcde00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55d954dab4d0 0x55d955181000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:30.898 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:30.893+0000 7f0bcf200640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d954dcc1b0 0x55d955181b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:30.898 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:30.893+0000 7f0bcf200640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d954dcc1b0 0x55d955181b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.50:36106/0 (socket says 172.21.15.50:36106) 2024-08-31T04:25:30.898 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:30.893+0000 7f0bcde00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55d954dab4d0 0x55d955181000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.50:50984/0 (socket says 172.21.15.50:50984) 2024-08-31T04:25:30.898 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:30.893+0000 7f0bcf200640 1 -- 172.21.15.50:0/622834782 learned_addr learned my addr 172.21.15.50:0/622834782 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:25:30.898 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:30.894+0000 7f0bcde00640 1 -- 172.21.15.50:0/622834782 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d954dcc1b0 msgr2=0x55d955181b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:25:30.898 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:30.894+0000 7f0bcde00640 1 --2- 172.21.15.50:0/622834782 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d954dcc1b0 0x55d955181b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:30.898 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:30.894+0000 7f0bcde00640 1 -- 172.21.15.50:0/622834782 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d954da32f0 msgr2=0x55d955180940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:25:30.898 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:30.894+0000 7f0bcde00640 1 --2- 172.21.15.50:0/622834782 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d954da32f0 0x55d955180940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:30.898 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:30.894+0000 7f0bcde00640 1 -- 172.21.15.50:0/622834782 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d9551822d0 con 0x55d954dab4d0 2024-08-31T04:25:30.898 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:30.894+0000 7f0bcf200640 1 --2- 172.21.15.50:0/622834782 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d954dcc1b0 0x55d955181b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:25:30.898 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:30.894+0000 7f0bce800640 1 --2- 172.21.15.50:0/622834782 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d954da32f0 0x55d955180940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:25:30.899 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:30.894+0000 7f0bcde00640 1 --2- 172.21.15.50:0/622834782 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55d954dab4d0 0x55d955181000 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f0bbc010800 tx=0x7f0bbc004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8b1b906e50e26407 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:25:30.899 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:30.894+0000 7f0bafe00640 10 client.0 ms_handle_connect on v2:172.21.15.133:3300/0 2024-08-31T04:25:30.899 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:30.894+0000 7f0bafe00640 1 -- 172.21.15.50:0/622834782 <== mon.2 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bbc005020 con 0x55d954dab4d0 2024-08-31T04:25:30.899 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:30.894+0000 7f0bafe00640 1 -- 172.21.15.50:0/622834782 <== mon.2 v2:172.21.15.133:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8219+0+0 (secure 0 0 0) 0x7f0bbc01b030 con 0x55d954dab4d0 2024-08-31T04:25:30.899 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:30.894+0000 7f0bdc403740 1 -- 172.21.15.50:0/622834782 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0bc00315a0 con 0x55d954dab4d0 2024-08-31T04:25:30.899 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:30.894+0000 7f0bafe00640 1 -- 172.21.15.50:0/622834782 <== mon.2 v2:172.21.15.133:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f0bbc0051c0 con 0x55d954dab4d0 2024-08-31T04:25:30.899 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:30.894+0000 7f0bdc403740 10 client.25688 fetch_fsmap learned FSMap version 31 2024-08-31T04:25:30.899 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:30.894+0000 7f0bdc403740 1 -- 172.21.15.50:0/622834782 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55d955183630 con 0x55d954dab4d0 2024-08-31T04:25:30.899 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:30.895+0000 7f0bafe00640 1 -- 172.21.15.50:0/622834782 <== mon.2 v2:172.21.15.133:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0bc00315a0 con 0x55d954dab4d0 2024-08-31T04:25:30.899 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:30.895+0000 7f0bafe00640 1 -- 172.21.15.50:0/622834782 <== mon.2 v2:172.21.15.133:3300/0 5 ==== fsmap(e 31) ==== 8378+0+0 (secure 0 0 0) 0x7f0bbc0226f0 con 0x55d954dab4d0 2024-08-31T04:25:30.899 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:30.895+0000 7f0bdc403740 10 client.25688 fetch_fsmap finished waiting for FSMap version 31 2024-08-31T04:25:30.899 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:30.895+0000 7f0bdc403740 10 client.25688 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T04:25:30.899 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:30.895+0000 7f0bdc403740 20 client.25688 populate_metadata read hostname 'smithi050' 2024-08-31T04:25:30.900 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:30.895+0000 7f0bdc403740 1 --2- 172.21.15.50:0/622834782 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x55d954d601c0 0x55d9551f5d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:30.900 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:30.895+0000 7f0bdc403740 4 client.25688 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-31T04:25:30.900 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:30.895+0000 7f0bdc403740 1 -- 172.21.15.50:0/622834782 --> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55d9550e2960 con 0x55d954d601c0 2024-08-31T04:25:30.900 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:30.895+0000 7f0bce800640 1 --2- 172.21.15.50:0/622834782 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x55d954d601c0 0x55d9551f5d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:30.900 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:30.896+0000 7f0bce800640 1 --2- 172.21.15.50:0/622834782 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x55d954d601c0 0x55d9551f5d20 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a6fa02ae33a688c3 server_cookie=4f4815b74df48577 in_seq=0 out_seq=0 2024-08-31T04:25:30.900 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:30.896+0000 7f0bafe00640 10 client.25688 ms_handle_connect on v2:172.21.15.133:6838/2526402262 2024-08-31T04:25:31.334 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:31.333+0000 7f0bafe00640 1 -- 172.21.15.50:0/622834782 <== mds.0 v2:172.21.15.133:6838/2526402262 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55d9550e2960 con 0x55d954d601c0 2024-08-31T04:25:31.335 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:31.333+0000 7f0bafe00640 10 client.25688 handle_command_reply: tid=0 2024-08-31T04:25:31.335 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:31.333+0000 7f0bdc403740 1 client.25688 shutdown 2024-08-31T04:25:31.335 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:31.334+0000 7f0bdc403740 1 -- 172.21.15.50:0/622834782 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55d954dab4d0 msgr2=0x55d955181000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:25:31.336 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:31.334+0000 7f0bdc403740 1 --2- 172.21.15.50:0/622834782 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55d954dab4d0 0x55d955181000 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f0bbc010800 tx=0x7f0bbc004730 comp rx=0 tx=0).stop 2024-08-31T04:25:31.336 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:31.334+0000 7f0bdc403740 1 -- 172.21.15.50:0/622834782 shutdown_connections 2024-08-31T04:25:31.336 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:31.334+0000 7f0bdc403740 1 --2- 172.21.15.50:0/622834782 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x55d954d601c0 0x55d9551f5d20 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:31.336 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:31.334+0000 7f0bdc403740 1 --2- 172.21.15.50:0/622834782 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d954dcc1b0 0x55d955181b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:31.336 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:31.334+0000 7f0bdc403740 1 --2- 172.21.15.50:0/622834782 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55d954dab4d0 0x55d955181000 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:31.336 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:31.334+0000 7f0bdc403740 1 --2- 172.21.15.50:0/622834782 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d954da32f0 0x55d955180940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:31.336 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:31.334+0000 7f0bdc403740 1 -- 172.21.15.50:0/622834782 >> 172.21.15.50:0/622834782 conn(0x55d954dc0300 msgr2=0x55d955176030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:25:31.336 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:31.334+0000 7f0bafe00640 0 client.25688 ms_handle_reset on v2:172.21.15.133:6838/2526402262 2024-08-31T04:25:31.336 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:31.334+0000 7f0bdc403740 1 -- 172.21.15.50:0/622834782 shutdown_connections 2024-08-31T04:25:31.336 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:31.334+0000 7f0bdc403740 1 -- 172.21.15.50:0/622834782 wait complete. 2024-08-31T04:25:31.336 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:31.334+0000 7f0bdc403740 20 client.25688 trim_cache size 0 max 16384 2024-08-31T04:25:31.337 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout:{ 2024-08-31T04:25:31.337 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout: "message": "", 2024-08-31T04:25:31.337 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout: "return_code": 0 2024-08-31T04:25:31.337 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout:} 2024-08-31T04:25:31.338 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:31.336+0000 7f0bd4a00640 1 -- 172.21.15.50:0/2509930456 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f0bb40b4b30 msgr2=0x7f0bb40b7040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:25:31.338 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:31.336+0000 7f0bd4a00640 1 --2- 172.21.15.50:0/2509930456 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f0bb40b4b30 0x7f0bb40b7040 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f0bd006c660 tx=0x7f0bbc009680 comp rx=0 tx=0).stop 2024-08-31T04:25:31.338 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:31.336+0000 7f0bd4a00640 1 -- 172.21.15.50:0/2509930456 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0bd0108fe0 msgr2=0x7f0bd019cfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:25:31.338 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:31.336+0000 7f0bd4a00640 1 --2- 172.21.15.50:0/2509930456 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0bd0108fe0 0x7f0bd019cfe0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f0bc800efd0 tx=0x7f0bc800c6a0 comp rx=0 tx=0).stop 2024-08-31T04:25:31.338 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:31.336+0000 7f0bd4a00640 1 -- 172.21.15.50:0/2509930456 shutdown_connections 2024-08-31T04:25:31.338 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:31.336+0000 7f0bd4a00640 1 --2- 172.21.15.50:0/2509930456 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f0bb40b4b30 0x7f0bb40b7040 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:31.338 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:31.336+0000 7f0bd4a00640 1 --2- 172.21.15.50:0/2509930456 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0bd0108fe0 0x7f0bd019cfe0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:31.338 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:31.336+0000 7f0bd4a00640 1 --2- 172.21.15.50:0/2509930456 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0bd0106420 0x7f0bd019c430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:31.338 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:31.336+0000 7f0bd4a00640 1 --2- 172.21.15.50:0/2509930456 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0bd006c0b0 0x7f0bd019bdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:31.338 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:31.336+0000 7f0bd4a00640 1 -- 172.21.15.50:0/2509930456 >> 172.21.15.50:0/2509930456 conn(0x7f0bd00fdae0 msgr2=0x7f0bd01048d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:25:31.339 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:31.336+0000 7f0bd4a00640 1 -- 172.21.15.50:0/2509930456 shutdown_connections 2024-08-31T04:25:31.339 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:31.336+0000 7f0bd4a00640 1 -- 172.21.15.50:0/2509930456 wait complete. 2024-08-31T04:25:31.450 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:25:31 smithi050 ceph-mon[17259]: pgmap v445: 97 pgs: 97 active+clean; 62 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.3 MiB/s wr, 533 op/s 2024-08-31T04:25:31.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:25:31 smithi177 ceph-mon[22025]: pgmap v445: 97 pgs: 97 active+clean; 62 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.3 MiB/s wr, 533 op/s 2024-08-31T04:25:31.542 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:25:31 smithi133 ceph-mon[22177]: pgmap v445: 97 pgs: 97 active+clean; 62 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.3 MiB/s wr, 533 op/s 2024-08-31T04:25:32.188 INFO:journalctl@ceph.mds.f.smithi177.stdout:Aug 31 04:25:31 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-mds-f[51911]: ignoring --setuser ceph since I am not root 2024-08-31T04:25:32.188 INFO:journalctl@ceph.mds.f.smithi177.stdout:Aug 31 04:25:31 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-mds-f[51911]: ignoring --setgroup ceph since I am not root 2024-08-31T04:25:32.188 INFO:journalctl@ceph.mds.f.smithi177.stdout:Aug 31 04:25:31 smithi177 ceph-mds[51915]: -- 172.21.15.177:0/2113496438 <== mon.1 v2:172.21.15.177:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x56166a24fc20 con 0x56166e3f5600 2024-08-31T04:25:32.188 INFO:journalctl@ceph.mds.f.smithi177.stdout:Aug 31 04:25:31 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-mds-f[51911]: starting mds.f at 2024-08-31T04:25:32.453 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:25:32 smithi050 ceph-mon[17259]: daemon mds.f restarted 2024-08-31T04:25:32.495 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:25:32 smithi177 ceph-mon[22025]: daemon mds.f restarted 2024-08-31T04:25:32.542 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:25:32 smithi133 ceph-mon[22177]: daemon mds.f restarted 2024-08-31T04:25:33.357 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:25:33 smithi050 ceph-mon[17259]: pgmap v446: 97 pgs: 97 active+clean; 73 MiB data, 486 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 3.8 MiB/s wr, 590 op/s 2024-08-31T04:25:33.357 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:25:33 smithi050 ceph-mon[17259]: osdmap e79: 12 total, 12 up, 12 in 2024-08-31T04:25:33.357 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:25:33 smithi050 ceph-mon[17259]: mds.? [v2:172.21.15.177:6834/1048370411,v1:172.21.15.177:6835/1048370411] up:boot 2024-08-31T04:25:33.357 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:25:33 smithi050 ceph-mon[17259]: fsmap cephfs:5 4 up:standby-replay 3 up:standby 5 up:active 2024-08-31T04:25:33.358 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:25:33 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "f"} : dispatch 2024-08-31T04:25:33.358 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:25:33 smithi050 ceph-mon[17259]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-31T04:25:33.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:25:33 smithi177 ceph-mon[22025]: pgmap v446: 97 pgs: 97 active+clean; 73 MiB data, 486 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 3.8 MiB/s wr, 590 op/s 2024-08-31T04:25:33.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:25:33 smithi177 ceph-mon[22025]: osdmap e79: 12 total, 12 up, 12 in 2024-08-31T04:25:33.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:25:33 smithi177 ceph-mon[22025]: mds.? [v2:172.21.15.177:6834/1048370411,v1:172.21.15.177:6835/1048370411] up:boot 2024-08-31T04:25:33.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:25:33 smithi177 ceph-mon[22025]: fsmap cephfs:5 4 up:standby-replay 3 up:standby 5 up:active 2024-08-31T04:25:33.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:25:33 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "f"} : dispatch 2024-08-31T04:25:33.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:25:33 smithi177 ceph-mon[22025]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-31T04:25:33.542 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:25:33 smithi133 ceph-mon[22177]: pgmap v446: 97 pgs: 97 active+clean; 73 MiB data, 486 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 3.8 MiB/s wr, 590 op/s 2024-08-31T04:25:33.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:25:33 smithi133 ceph-mon[22177]: osdmap e79: 12 total, 12 up, 12 in 2024-08-31T04:25:33.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:25:33 smithi133 ceph-mon[22177]: mds.? [v2:172.21.15.177:6834/1048370411,v1:172.21.15.177:6835/1048370411] up:boot 2024-08-31T04:25:33.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:25:33 smithi133 ceph-mon[22177]: fsmap cephfs:5 4 up:standby-replay 3 up:standby 5 up:active 2024-08-31T04:25:33.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:25:33 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "f"} : dispatch 2024-08-31T04:25:33.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:25:33 smithi133 ceph-mon[22177]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-31T04:25:35.281 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:25:35 smithi050 ceph-mon[17259]: pgmap v448: 97 pgs: 97 active+clean; 74 MiB data, 491 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 3.9 MiB/s wr, 384 op/s 2024-08-31T04:25:35.342 INFO:tasks.workunit.client.0.smithi050.stdout: 34 75566 146 52569 114 39735 45 2024-08-31T04:25:35.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:25:35 smithi177 ceph-mon[22025]: pgmap v448: 97 pgs: 97 active+clean; 74 MiB data, 491 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 3.9 MiB/s wr, 384 op/s 2024-08-31T04:25:35.542 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:25:35 smithi133 ceph-mon[22177]: pgmap v448: 97 pgs: 97 active+clean; 74 MiB data, 491 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 3.9 MiB/s wr, 384 op/s 2024-08-31T04:25:37.450 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:25:37 smithi050 ceph-mon[17259]: pgmap v449: 97 pgs: 97 active+clean; 99 MiB data, 545 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 7.4 MiB/s wr, 840 op/s 2024-08-31T04:25:37.495 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:25:37 smithi177 ceph-mon[22025]: pgmap v449: 97 pgs: 97 active+clean; 99 MiB data, 545 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 7.4 MiB/s wr, 840 op/s 2024-08-31T04:25:37.542 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:25:37 smithi133 ceph-mon[22177]: pgmap v449: 97 pgs: 97 active+clean; 99 MiB data, 545 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 7.4 MiB/s wr, 840 op/s 2024-08-31T04:25:39.469 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:25:39 smithi050 ceph-mon[17259]: pgmap v450: 97 pgs: 97 active+clean; 120 MiB data, 576 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 8.8 MiB/s wr, 935 op/s 2024-08-31T04:25:39.495 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:25:39 smithi177 ceph-mon[22025]: pgmap v450: 97 pgs: 97 active+clean; 120 MiB data, 576 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 8.8 MiB/s wr, 935 op/s 2024-08-31T04:25:39.542 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:25:39 smithi133 ceph-mon[22177]: pgmap v450: 97 pgs: 97 active+clean; 120 MiB data, 576 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 8.8 MiB/s wr, 935 op/s 2024-08-31T04:25:41.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:25:41 smithi177 ceph-mon[22025]: pgmap v451: 97 pgs: 97 active+clean; 119 MiB data, 575 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 8.4 MiB/s wr, 903 op/s 2024-08-31T04:25:41.542 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:25:41 smithi133 ceph-mon[22177]: pgmap v451: 97 pgs: 97 active+clean; 119 MiB data, 575 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 8.4 MiB/s wr, 903 op/s 2024-08-31T04:25:41.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:25:41 smithi050 ceph-mon[17259]: pgmap v451: 97 pgs: 97 active+clean; 119 MiB data, 575 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 8.4 MiB/s wr, 903 op/s 2024-08-31T04:25:43.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:25:43 smithi177 ceph-mon[22025]: pgmap v452: 97 pgs: 97 active+clean; 122 MiB data, 579 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 6.8 MiB/s wr, 744 op/s 2024-08-31T04:25:43.501 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:25:43 smithi050 ceph-mon[17259]: pgmap v452: 97 pgs: 97 active+clean; 122 MiB data, 579 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 6.8 MiB/s wr, 744 op/s 2024-08-31T04:25:43.542 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:25:43 smithi133 ceph-mon[22177]: pgmap v452: 97 pgs: 97 active+clean; 122 MiB data, 579 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 6.8 MiB/s wr, 744 op/s 2024-08-31T04:25:44.562 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:44.560+0000 7f5e4f000640 1 -- 172.21.15.50:0/1280809324 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5e48108fd0 msgr2=0x7f5e4810b4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:25:44.562 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:44.560+0000 7f5e4f000640 1 --2- 172.21.15.50:0/1280809324 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5e48108fd0 0x7f5e4810b4e0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f5e40009ca0 tx=0x7f5e4002a8c0 comp rx=0 tx=0).stop 2024-08-31T04:25:44.562 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:44.560+0000 7f5e4f000640 1 -- 172.21.15.50:0/1280809324 shutdown_connections 2024-08-31T04:25:44.562 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:44.560+0000 7f5e4f000640 1 --2- 172.21.15.50:0/1280809324 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5e48106410 0x7f5e48108890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:44.563 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:44.560+0000 7f5e4f000640 1 --2- 172.21.15.50:0/1280809324 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5e48108fd0 0x7f5e4810b4e0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:44.563 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:44.560+0000 7f5e4f000640 1 --2- 172.21.15.50:0/1280809324 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5e4806be70 0x7f5e48105ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:44.563 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:44.560+0000 7f5e4f000640 1 -- 172.21.15.50:0/1280809324 >> 172.21.15.50:0/1280809324 conn(0x7f5e480fdad0 msgr2=0x7f5e480fff80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:25:44.563 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:44.561+0000 7f5e4f000640 1 -- 172.21.15.50:0/1280809324 shutdown_connections 2024-08-31T04:25:44.563 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:44.561+0000 7f5e4f000640 1 -- 172.21.15.50:0/1280809324 wait complete. 2024-08-31T04:25:44.565 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:44.562+0000 7f5e4f000640 1 Processor -- start 2024-08-31T04:25:44.565 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:44.562+0000 7f5e4f000640 1 -- start start 2024-08-31T04:25:44.565 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:44.562+0000 7f5e4f000640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5e4806be70 0x7f5e48103510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:44.565 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:44.562+0000 7f5e4f000640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5e48106410 0x7f5e48101dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:44.565 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:44.562+0000 7f5e4f000640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5e48108fd0 0x7f5e48102310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:44.565 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:44.562+0000 7f5e4f000640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f5e4810eef0 con 0x7f5e4806be70 2024-08-31T04:25:44.565 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:44.562+0000 7f5e4f000640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f5e4810ed70 con 0x7f5e48108fd0 2024-08-31T04:25:44.565 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:44.562+0000 7f5e4f000640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f5e4810f070 con 0x7f5e48106410 2024-08-31T04:25:44.565 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:44.562+0000 7f5e4dc00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5e4806be70 0x7f5e48103510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:44.565 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:44.562+0000 7f5e4d200640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5e48106410 0x7f5e48101dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:44.566 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:44.562+0000 7f5e4dc00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5e4806be70 0x7f5e48103510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:52794/0 (socket says 172.21.15.50:52794) 2024-08-31T04:25:44.566 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:44.562+0000 7f5e4dc00640 1 -- 172.21.15.50:0/1330933399 learned_addr learned my addr 172.21.15.50:0/1330933399 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:25:44.566 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:44.562+0000 7f5e4e600640 1 --2- 172.21.15.50:0/1330933399 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5e48108fd0 0x7f5e48102310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:44.566 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:44.563+0000 7f5e4d200640 1 -- 172.21.15.50:0/1330933399 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5e48108fd0 msgr2=0x7f5e48102310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:25:44.566 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:44.563+0000 7f5e4d200640 1 --2- 172.21.15.50:0/1330933399 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5e48108fd0 0x7f5e48102310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:44.566 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:44.563+0000 7f5e4d200640 1 -- 172.21.15.50:0/1330933399 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5e4806be70 msgr2=0x7f5e48103510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:25:44.566 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:44.563+0000 7f5e4d200640 1 --2- 172.21.15.50:0/1330933399 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5e4806be70 0x7f5e48103510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:44.566 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:44.563+0000 7f5e4d200640 1 -- 172.21.15.50:0/1330933399 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e48102a40 con 0x7f5e48106410 2024-08-31T04:25:44.566 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:44.563+0000 7f5e4d200640 1 --2- 172.21.15.50:0/1330933399 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5e48106410 0x7f5e48101dd0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f5e3400e9c0 tx=0x7f5e3400ee80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:25:44.566 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:44.563+0000 7f5e46000640 1 -- 172.21.15.50:0/1330933399 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e3400ccc0 con 0x7f5e48106410 2024-08-31T04:25:44.566 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:44.563+0000 7f5e4f000640 1 -- 172.21.15.50:0/1330933399 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5e481a3b80 con 0x7f5e48106410 2024-08-31T04:25:44.566 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:44.563+0000 7f5e46000640 1 -- 172.21.15.50:0/1330933399 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5e340108e0 con 0x7f5e48106410 2024-08-31T04:25:44.566 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:44.563+0000 7f5e46000640 1 -- 172.21.15.50:0/1330933399 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e340187a0 con 0x7f5e48106410 2024-08-31T04:25:44.567 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:44.564+0000 7f5e4f000640 1 -- 172.21.15.50:0/1330933399 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5e481a4040 con 0x7f5e48106410 2024-08-31T04:25:44.568 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:44.567+0000 7f5e575e5740 1 Processor -- start 2024-08-31T04:25:44.569 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:44.568+0000 7f5e575e5740 1 -- start start 2024-08-31T04:25:44.571 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:44.568+0000 7f5e575e5740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x560c178521b0 0x560c17bf7fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:44.571 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:44.568+0000 7f5e575e5740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x560c178292f0 0x560c17bf8610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:44.571 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:44.568+0000 7f5e575e5740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560c178314d0 0x560c17bf9160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:44.571 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:44.568+0000 7f5e575e5740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x560c17b6af70 con 0x560c178314d0 2024-08-31T04:25:44.571 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:44.568+0000 7f5e575e5740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x560c17b5a500 con 0x560c178292f0 2024-08-31T04:25:44.571 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:44.568+0000 7f5e575e5740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x560c17b5e4b0 con 0x560c178521b0 2024-08-31T04:25:44.571 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:44.568+0000 7f5e4dc00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x560c178292f0 0x560c17bf8610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:44.571 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:44.568+0000 7f5e4dc00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x560c178292f0 0x560c17bf8610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.50:37556/0 (socket says 172.21.15.50:37556) 2024-08-31T04:25:44.571 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:44.568+0000 7f5e4dc00640 1 -- 172.21.15.50:0/1314130442 learned_addr learned my addr 172.21.15.50:0/1314130442 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:25:44.572 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:44.568+0000 7f5e4e600640 1 --2- 172.21.15.50:0/1314130442 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x560c178521b0 0x560c17bf7fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:44.572 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:44.569+0000 7f5e4dc00640 1 -- 172.21.15.50:0/1314130442 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x560c178521b0 msgr2=0x560c17bf7fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:25:44.572 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:44.569+0000 7f5e4dc00640 1 --2- 172.21.15.50:0/1314130442 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x560c178521b0 0x560c17bf7fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:44.572 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:44.569+0000 7f5e4dc00640 1 -- 172.21.15.50:0/1314130442 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560c178314d0 msgr2=0x560c17bf9160 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-31T04:25:44.572 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:44.569+0000 7f5e4dc00640 1 --2- 172.21.15.50:0/1314130442 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560c178314d0 0x560c17bf9160 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:44.572 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:44.569+0000 7f5e4dc00640 1 -- 172.21.15.50:0/1314130442 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560c17b14c10 con 0x560c178292f0 2024-08-31T04:25:44.572 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:44.569+0000 7f5e4dc00640 1 --2- 172.21.15.50:0/1314130442 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x560c178292f0 0x560c17bf8610 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f5e3c009e10 tx=0x7f5e3c011810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=53d42da7ceb38726 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:25:44.572 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:44.569+0000 7f5e46000640 1 -- 172.21.15.50:0/1330933399 <== mon.1 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 18) ==== 152577+0+0 (secure 0 0 0) 0x7f5e34010430 con 0x7f5e48106410 2024-08-31T04:25:44.572 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:44.569+0000 7f5e3aa00640 1 -- 172.21.15.50:0/1314130442 <== mon.2 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e3c01e070 con 0x560c178292f0 2024-08-31T04:25:44.572 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:44.569+0000 7f5e3aa00640 1 -- 172.21.15.50:0/1314130442 <== mon.2 v2:172.21.15.133:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5e3c019ae0 con 0x560c178292f0 2024-08-31T04:25:44.572 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:44.569+0000 7f5e3aa00640 1 -- 172.21.15.50:0/1314130442 <== mon.2 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e3c00fb10 con 0x560c178292f0 2024-08-31T04:25:44.576 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:44.570+0000 7f5e575e5740 1 -- 172.21.15.50:0/1314130442 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x560c178292f0 msgr2=0x560c17bf8610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:25:44.576 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:44.570+0000 7f5e575e5740 1 --2- 172.21.15.50:0/1314130442 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x560c178292f0 0x560c17bf8610 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f5e3c009e10 tx=0x7f5e3c011810 comp rx=0 tx=0).stop 2024-08-31T04:25:44.576 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:44.570+0000 7f5e575e5740 1 -- 172.21.15.50:0/1314130442 shutdown_connections 2024-08-31T04:25:44.576 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:44.570+0000 7f5e575e5740 1 --2- 172.21.15.50:0/1314130442 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560c178314d0 0x560c17bf9160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:44.577 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:44.570+0000 7f5e575e5740 1 --2- 172.21.15.50:0/1314130442 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x560c178292f0 0x560c17bf8610 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:44.580 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:44.570+0000 7f5e575e5740 1 --2- 172.21.15.50:0/1314130442 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x560c178521b0 0x560c17bf7fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:44.580 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:44.570+0000 7f5e575e5740 1 -- 172.21.15.50:0/1314130442 >> 172.21.15.50:0/1314130442 conn(0x560c17846300 msgr2=0x560c17bf3a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:25:44.580 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:44.570+0000 7f5e575e5740 1 -- 172.21.15.50:0/1314130442 shutdown_connections 2024-08-31T04:25:44.580 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:44.570+0000 7f5e575e5740 1 -- 172.21.15.50:0/1314130442 wait complete. 2024-08-31T04:25:44.580 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:44.571+0000 7f5e575e5740 1 -- start start 2024-08-31T04:25:44.580 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:44.571+0000 7f5e46000640 1 --2- 172.21.15.50:0/1330933399 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f5e300b4a40 0x7f5e300b6f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:44.581 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:44.571+0000 7f5e575e5740 1 Processor -- start 2024-08-31T04:25:44.581 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:44.571+0000 7f5e46000640 1 -- 172.21.15.50:0/1330933399 <== mon.1 v2:172.21.15.177:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8219+0+0 (secure 0 0 0) 0x7f5e340e54d0 con 0x7f5e48106410 2024-08-31T04:25:44.581 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:44.571+0000 7f5e4e600640 1 --2- 172.21.15.50:0/1330933399 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f5e300b4a40 0x7f5e300b6f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:44.581 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:44.572+0000 7f5e575e5740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560c178292f0 0x560c17c01660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:44.581 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:44.572+0000 7f5e575e5740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x560c178314d0 0x560c17c01d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:44.581 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:44.572+0000 7f5e575e5740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x560c178521b0 0x560c17c02890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:44.581 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:44.572+0000 7f5e575e5740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x560c17a93ab0 con 0x560c178292f0 2024-08-31T04:25:44.581 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:44.572+0000 7f5e575e5740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x560c17b01320 con 0x560c178521b0 2024-08-31T04:25:44.581 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:44.572+0000 7f5e575e5740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x560c17bf9c80 con 0x560c178314d0 2024-08-31T04:25:44.581 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:44.572+0000 7f5e575e5740 10 client.0 _ll_register_callbacks cb 0x560c17b076a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:25:44.581 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:44.572+0000 7f5e4dc00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560c178292f0 0x560c17c01660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:44.581 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:44.572+0000 7f5e4dc00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560c178292f0 0x560c17c01660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:52800/0 (socket says 172.21.15.50:52800) 2024-08-31T04:25:44.581 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:44.572+0000 7f5e4dc00640 1 -- 172.21.15.50:0/1598746107 learned_addr learned my addr 172.21.15.50:0/1598746107 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:25:44.581 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:44.572+0000 7f5e4d200640 1 --2- 172.21.15.50:0/1598746107 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x560c178314d0 0x560c17c01d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:44.582 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:44.572+0000 7f5e4e600640 1 --2- 172.21.15.50:0/1330933399 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f5e300b4a40 0x7f5e300b6f50 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f5e40004af0 tx=0x7f5e40009440 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:25:44.582 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:44.572+0000 7f5e4e600640 1 --2- 172.21.15.50:0/1598746107 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x560c178521b0 0x560c17c02890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:44.582 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:44.573+0000 7f5e4dc00640 1 -- 172.21.15.50:0/1598746107 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x560c178314d0 msgr2=0x560c17c01d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:25:44.582 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:44.573+0000 7f5e4dc00640 1 --2- 172.21.15.50:0/1598746107 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x560c178314d0 0x560c17c01d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:44.582 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:44.573+0000 7f5e4dc00640 1 -- 172.21.15.50:0/1598746107 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x560c178521b0 msgr2=0x560c17c02890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:25:44.582 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:44.573+0000 7f5e4dc00640 1 --2- 172.21.15.50:0/1598746107 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x560c178521b0 0x560c17c02890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:44.582 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:44.573+0000 7f5e4dc00640 1 -- 172.21.15.50:0/1598746107 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560c178bd790 con 0x560c178292f0 2024-08-31T04:25:44.582 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:44.573+0000 7f5e4e600640 1 --2- 172.21.15.50:0/1598746107 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x560c178521b0 0x560c17c02890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:25:44.582 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:44.573+0000 7f5e4dc00640 1 --2- 172.21.15.50:0/1598746107 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560c178292f0 0x560c17c01660 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f5e3c0094b0 tx=0x7f5e3c00f5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68fd58047d4772bd server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:25:44.582 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:44.573+0000 7f5e2f400640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-08-31T04:25:44.582 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:44.573+0000 7f5e2f400640 1 -- 172.21.15.50:0/1598746107 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e3c01e050 con 0x560c178292f0 2024-08-31T04:25:44.582 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:44.573+0000 7f5e575e5740 1 -- 172.21.15.50:0/1598746107 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5e3c019ae0 con 0x560c178292f0 2024-08-31T04:25:44.582 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:44.573+0000 7f5e2f400640 1 -- 172.21.15.50:0/1598746107 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8219+0+0 (secure 0 0 0) 0x7f5e3c004250 con 0x560c178292f0 2024-08-31T04:25:44.582 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:44.574+0000 7f5e2f400640 1 -- 172.21.15.50:0/1598746107 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f5e3c004450 con 0x560c178292f0 2024-08-31T04:25:44.583 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:44.574+0000 7f5e575e5740 10 client.15693 fetch_fsmap learned FSMap version 33 2024-08-31T04:25:44.583 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:44.574+0000 7f5e575e5740 1 -- 172.21.15.50:0/1598746107 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x560c17936620 con 0x560c178292f0 2024-08-31T04:25:44.583 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:44.574+0000 7f5e2f400640 1 -- 172.21.15.50:0/1598746107 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5e3c019ae0 con 0x560c178292f0 2024-08-31T04:25:44.583 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:44.574+0000 7f5e2f400640 1 -- 172.21.15.50:0/1598746107 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 33) ==== 8378+0+0 (secure 0 0 0) 0x7f5e3c00f8b0 con 0x560c178292f0 2024-08-31T04:25:44.583 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:44.574+0000 7f5e575e5740 10 client.15693 fetch_fsmap finished waiting for FSMap version 33 2024-08-31T04:25:44.583 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:44.574+0000 7f5e575e5740 10 client.15693 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T04:25:44.583 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:44.574+0000 7f5e575e5740 20 client.15693 populate_metadata read hostname 'smithi050' 2024-08-31T04:25:44.583 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:44.574+0000 7f5e575e5740 1 --2- 172.21.15.50:0/1598746107 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x560c17810d80 0x560c17c0ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:44.583 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:44.574+0000 7f5e575e5740 4 client.15693 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T04:25:44.583 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:44.574+0000 7f5e575e5740 1 -- 172.21.15.50:0/1598746107 --> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560c17b6cec0 con 0x560c17810d80 2024-08-31T04:25:44.583 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:44.574+0000 7f5e4d200640 1 --2- 172.21.15.50:0/1598746107 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x560c17810d80 0x560c17c0ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:44.583 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:44.575+0000 7f5e4d200640 1 --2- 172.21.15.50:0/1598746107 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x560c17810d80 0x560c17c0ec40 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b6f3d0a3a641045 server_cookie=363560a5fbe39ce3 in_seq=0 out_seq=0 2024-08-31T04:25:44.583 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:44.575+0000 7f5e2f400640 10 client.15693 ms_handle_connect on v2:172.21.15.133:6838/2526402262 2024-08-31T04:25:44.584 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:44.579+0000 7f5e2f400640 1 -- 172.21.15.50:0/1598746107 <== mds.0 v2:172.21.15.133:6838/2526402262 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x560c17b6cec0 con 0x560c17810d80 2024-08-31T04:25:44.584 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:44.579+0000 7f5e2f400640 10 client.15693 handle_command_reply: tid=0 2024-08-31T04:25:44.584 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:44.579+0000 7f5e575e5740 1 client.15693 shutdown 2024-08-31T04:25:44.584 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:44.579+0000 7f5e575e5740 1 -- 172.21.15.50:0/1598746107 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560c178292f0 msgr2=0x560c17c01660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:25:44.584 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:44.579+0000 7f5e575e5740 1 --2- 172.21.15.50:0/1598746107 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560c178292f0 0x560c17c01660 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f5e3c0094b0 tx=0x7f5e3c00f5f0 comp rx=0 tx=0).stop 2024-08-31T04:25:44.585 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:44.579+0000 7f5e575e5740 1 -- 172.21.15.50:0/1598746107 shutdown_connections 2024-08-31T04:25:44.585 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:44.579+0000 7f5e575e5740 1 --2- 172.21.15.50:0/1598746107 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x560c17810d80 0x560c17c0ec40 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:44.585 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:44.580+0000 7f5e575e5740 1 --2- 172.21.15.50:0/1598746107 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x560c178314d0 0x560c17c01d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:44.585 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:44.580+0000 7f5e575e5740 1 --2- 172.21.15.50:0/1598746107 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x560c178521b0 0x560c17c02890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:44.585 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:44.580+0000 7f5e2f400640 0 client.15693 ms_handle_reset on v2:172.21.15.133:6838/2526402262 2024-08-31T04:25:44.585 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:44.580+0000 7f5e575e5740 1 --2- 172.21.15.50:0/1598746107 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560c178292f0 0x560c17c01660 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:44.585 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:44.580+0000 7f5e575e5740 1 -- 172.21.15.50:0/1598746107 >> 172.21.15.50:0/1598746107 conn(0x560c17846300 msgr2=0x560c17bf1f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:25:44.585 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:44.580+0000 7f5e575e5740 1 -- 172.21.15.50:0/1598746107 shutdown_connections 2024-08-31T04:25:44.585 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:44.580+0000 7f5e575e5740 1 -- 172.21.15.50:0/1598746107 wait complete. 2024-08-31T04:25:44.585 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:44.580+0000 7f5e575e5740 20 client.15693 trim_cache size 0 max 16384 2024-08-31T04:25:44.598 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:44.595+0000 7f5e575e5740 1 Processor -- start 2024-08-31T04:25:44.598 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:44.595+0000 7f5e575e5740 1 -- start start 2024-08-31T04:25:44.598 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:44.596+0000 7f5e575e5740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x560c178292f0 0x560c17bf26f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:44.598 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:44.596+0000 7f5e575e5740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x560c178314d0 0x560c17bf2c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:44.598 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:44.596+0000 7f5e575e5740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560c178521b0 0x560c17bf3e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:44.598 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:44.596+0000 7f5e575e5740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f5e481acce0 con 0x560c178521b0 2024-08-31T04:25:44.599 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:44.596+0000 7f5e575e5740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f5e481ae8e0 con 0x560c178314d0 2024-08-31T04:25:44.599 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:44.596+0000 7f5e575e5740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f5e481ad3b0 con 0x560c178292f0 2024-08-31T04:25:44.599 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:44.596+0000 7f5e4e600640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560c178521b0 0x560c17bf3e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:44.599 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:44.596+0000 7f5e4d200640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x560c178314d0 0x560c17bf2c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:44.599 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:44.596+0000 7f5e4d200640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x560c178314d0 0x560c17bf2c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.50:37578/0 (socket says 172.21.15.50:37578) 2024-08-31T04:25:44.599 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:44.596+0000 7f5e4d200640 1 -- 172.21.15.50:0/1667691620 learned_addr learned my addr 172.21.15.50:0/1667691620 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:25:44.599 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:44.596+0000 7f5e4dc00640 1 --2- 172.21.15.50:0/1667691620 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x560c178292f0 0x560c17bf26f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:44.599 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:44.596+0000 7f5e4d200640 1 -- 172.21.15.50:0/1667691620 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x560c178292f0 msgr2=0x560c17bf26f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:25:44.599 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:44.596+0000 7f5e4d200640 1 --2- 172.21.15.50:0/1667691620 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x560c178292f0 0x560c17bf26f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:44.599 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:44.596+0000 7f5e4d200640 1 -- 172.21.15.50:0/1667691620 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560c178521b0 msgr2=0x560c17bf3e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:25:44.599 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:44.596+0000 7f5e4d200640 1 --2- 172.21.15.50:0/1667691620 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560c178521b0 0x560c17bf3e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:44.600 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:44.596+0000 7f5e4d200640 1 -- 172.21.15.50:0/1667691620 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560c17c02c00 con 0x560c178314d0 2024-08-31T04:25:44.600 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:44.597+0000 7f5e4d200640 1 --2- 172.21.15.50:0/1667691620 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x560c178314d0 0x560c17bf2c30 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f5e340a91d0 tx=0x7f5e340e2e50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7fa2934c9660c66d server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:25:44.600 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:44.597+0000 7f5e3a000640 1 -- 172.21.15.50:0/1667691620 <== mon.2 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e340b51d0 con 0x560c178314d0 2024-08-31T04:25:44.600 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:44.597+0000 7f5e3a000640 1 -- 172.21.15.50:0/1667691620 <== mon.2 v2:172.21.15.133:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5e34010d90 con 0x560c178314d0 2024-08-31T04:25:44.600 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:44.597+0000 7f5e3a000640 1 -- 172.21.15.50:0/1667691620 <== mon.2 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e340e5110 con 0x560c178314d0 2024-08-31T04:25:44.603 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:44.598+0000 7f5e575e5740 1 -- 172.21.15.50:0/1667691620 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x560c178314d0 msgr2=0x560c17bf2c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:25:44.604 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:44.598+0000 7f5e575e5740 1 --2- 172.21.15.50:0/1667691620 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x560c178314d0 0x560c17bf2c30 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f5e340a91d0 tx=0x7f5e340e2e50 comp rx=0 tx=0).stop 2024-08-31T04:25:44.604 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:44.598+0000 7f5e575e5740 1 -- 172.21.15.50:0/1667691620 shutdown_connections 2024-08-31T04:25:44.604 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:44.598+0000 7f5e575e5740 1 --2- 172.21.15.50:0/1667691620 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560c178521b0 0x560c17bf3e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:44.604 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:44.598+0000 7f5e575e5740 1 --2- 172.21.15.50:0/1667691620 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x560c178314d0 0x560c17bf2c30 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:44.604 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:44.598+0000 7f5e575e5740 1 --2- 172.21.15.50:0/1667691620 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x560c178292f0 0x560c17bf26f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:44.604 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:44.598+0000 7f5e575e5740 1 -- 172.21.15.50:0/1667691620 >> 172.21.15.50:0/1667691620 conn(0x560c17846300 msgr2=0x560c17bf7f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:25:44.604 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:44.598+0000 7f5e575e5740 1 -- 172.21.15.50:0/1667691620 shutdown_connections 2024-08-31T04:25:44.604 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:44.598+0000 7f5e575e5740 1 -- 172.21.15.50:0/1667691620 wait complete. 2024-08-31T04:25:44.604 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:44.598+0000 7f5e575e5740 1 -- start start 2024-08-31T04:25:44.604 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:44.598+0000 7f5e575e5740 1 Processor -- start 2024-08-31T04:25:44.604 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:44.599+0000 7f5e575e5740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x560c178292f0 0x560c17c06810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:44.604 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:44.599+0000 7f5e575e5740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x560c178314d0 0x560c17c06ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:44.605 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:44.599+0000 7f5e575e5740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560c178521b0 0x560c17c079f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:44.605 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:44.599+0000 7f5e575e5740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f5e481ae210 con 0x560c178521b0 2024-08-31T04:25:44.605 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:44.599+0000 7f5e575e5740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f5e481ada80 con 0x560c178292f0 2024-08-31T04:25:44.605 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:44.599+0000 7f5e575e5740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f5e481aacc0 con 0x560c178314d0 2024-08-31T04:25:44.605 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:44.599+0000 7f5e575e5740 10 client.0 _ll_register_callbacks cb 0x7f5e3c009c90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:25:44.605 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:44.599+0000 7f5e4dc00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x560c178292f0 0x560c17c06810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:44.605 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:44.599+0000 7f5e4dc00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x560c178292f0 0x560c17c06810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.50:37590/0 (socket says 172.21.15.50:37590) 2024-08-31T04:25:44.605 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:44.599+0000 7f5e4dc00640 1 -- 172.21.15.50:0/3772202085 learned_addr learned my addr 172.21.15.50:0/3772202085 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:25:44.605 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:44.599+0000 7f5e4e600640 1 --2- 172.21.15.50:0/3772202085 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560c178521b0 0x560c17c079f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:44.605 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:44.599+0000 7f5e4d200640 1 --2- 172.21.15.50:0/3772202085 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x560c178314d0 0x560c17c06ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:44.605 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:44.599+0000 7f5e4dc00640 1 -- 172.21.15.50:0/3772202085 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x560c178314d0 msgr2=0x560c17c06ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:25:44.605 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:44.599+0000 7f5e4dc00640 1 --2- 172.21.15.50:0/3772202085 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x560c178314d0 0x560c17c06ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:44.606 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:44.600+0000 7f5e4dc00640 1 -- 172.21.15.50:0/3772202085 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560c178521b0 msgr2=0x560c17c079f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:25:44.606 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:44.600+0000 7f5e4dc00640 1 --2- 172.21.15.50:0/3772202085 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560c178521b0 0x560c17c079f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:44.606 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:44.600+0000 7f5e4dc00640 1 -- 172.21.15.50:0/3772202085 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560c17c08150 con 0x560c178292f0 2024-08-31T04:25:44.606 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:44.600+0000 7f5e4d200640 1 --2- 172.21.15.50:0/3772202085 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x560c178314d0 0x560c17c06ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:25:44.606 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:44.600+0000 7f5e4dc00640 1 --2- 172.21.15.50:0/3772202085 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x560c178292f0 0x560c17c06810 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f5e3c009e10 tx=0x7f5e3c00fad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ed6e01abecab4566 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:25:44.606 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:44.600+0000 7f5e2f400640 10 client.0 ms_handle_connect on v2:172.21.15.133:3300/0 2024-08-31T04:25:44.606 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:44.600+0000 7f5e2f400640 1 -- 172.21.15.50:0/3772202085 <== mon.2 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e3c01e040 con 0x560c178292f0 2024-08-31T04:25:44.606 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:44.600+0000 7f5e2f400640 1 -- 172.21.15.50:0/3772202085 <== mon.2 v2:172.21.15.133:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8219+0+0 (secure 0 0 0) 0x7f5e3c004250 con 0x560c178292f0 2024-08-31T04:25:44.606 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:44.600+0000 7f5e575e5740 1 -- 172.21.15.50:0/3772202085 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5e34010d90 con 0x560c178292f0 2024-08-31T04:25:44.606 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:44.600+0000 7f5e2f400640 1 -- 172.21.15.50:0/3772202085 <== mon.2 v2:172.21.15.133:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f5e3c009a10 con 0x560c178292f0 2024-08-31T04:25:44.606 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:44.600+0000 7f5e575e5740 10 client.25712 fetch_fsmap learned FSMap version 33 2024-08-31T04:25:44.606 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:44.600+0000 7f5e575e5740 1 -- 172.21.15.50:0/3772202085 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x560c17c09470 con 0x560c178292f0 2024-08-31T04:25:44.606 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:44.601+0000 7f5e2f400640 1 -- 172.21.15.50:0/3772202085 <== mon.2 v2:172.21.15.133:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5e34010d90 con 0x560c178292f0 2024-08-31T04:25:44.606 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:44.601+0000 7f5e2f400640 1 -- 172.21.15.50:0/3772202085 <== mon.2 v2:172.21.15.133:3300/0 5 ==== fsmap(e 33) ==== 8378+0+0 (secure 0 0 0) 0x7f5e3c004a00 con 0x560c178292f0 2024-08-31T04:25:44.606 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:44.601+0000 7f5e575e5740 10 client.25712 fetch_fsmap finished waiting for FSMap version 33 2024-08-31T04:25:44.607 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:44.601+0000 7f5e575e5740 10 client.25712 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T04:25:44.607 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:44.601+0000 7f5e575e5740 20 client.25712 populate_metadata read hostname 'smithi050' 2024-08-31T04:25:44.607 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:44.601+0000 7f5e575e5740 1 --2- 172.21.15.50:0/3772202085 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x560c177e61c0 0x560c17c7bb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:25:44.607 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:44.601+0000 7f5e575e5740 4 client.25712 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-31T04:25:44.607 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:44.601+0000 7f5e575e5740 1 -- 172.21.15.50:0/3772202085 --> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] -- command(tid 0: {"prefix": "flush journal"}) -- 0x560c17bf24e0 con 0x560c177e61c0 2024-08-31T04:25:44.607 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:44.601+0000 7f5e4d200640 1 --2- 172.21.15.50:0/3772202085 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x560c177e61c0 0x560c17c7bb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:25:44.607 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:44.602+0000 7f5e2f400640 10 client.25712 ms_handle_connect on v2:172.21.15.133:6838/2526402262 2024-08-31T04:25:44.607 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:44.602+0000 7f5e4d200640 1 --2- 172.21.15.50:0/3772202085 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x560c177e61c0 0x560c17c7bb50 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ea0ddda2406fb90b server_cookie=b085f38b125b4970 in_seq=0 out_seq=0 2024-08-31T04:25:45.342 INFO:tasks.workunit.client.0.smithi050.stdout: 54 287099 1049 192787 992 96758 39 2024-08-31T04:25:45.495 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:25:45 smithi177 ceph-mon[22025]: pgmap v453: 97 pgs: 97 active+clean; 123 MiB data, 580 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 5.9 MiB/s wr, 662 op/s 2024-08-31T04:25:45.542 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:25:45 smithi133 ceph-mon[22177]: pgmap v453: 97 pgs: 97 active+clean; 123 MiB data, 580 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 5.9 MiB/s wr, 662 op/s 2024-08-31T04:25:45.703 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:25:45 smithi050 ceph-mon[17259]: pgmap v453: 97 pgs: 97 active+clean; 123 MiB data, 580 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 5.9 MiB/s wr, 662 op/s 2024-08-31T04:25:46.313 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:46.271+0000 7f5e2f400640 1 -- 172.21.15.50:0/3772202085 <== mds.0 v2:172.21.15.133:6838/2526402262 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x560c17bf24e0 con 0x560c177e61c0 2024-08-31T04:25:46.313 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:46.271+0000 7f5e2f400640 10 client.25712 handle_command_reply: tid=0 2024-08-31T04:25:46.313 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:46.302+0000 7f5e575e5740 1 client.25712 shutdown 2024-08-31T04:25:46.371 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:46.370+0000 7f5e575e5740 1 -- 172.21.15.50:0/3772202085 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x560c178292f0 msgr2=0x560c17c06810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:25:46.371 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:46.370+0000 7f5e575e5740 1 --2- 172.21.15.50:0/3772202085 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x560c178292f0 0x560c17c06810 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f5e3c009e10 tx=0x7f5e3c00fad0 comp rx=0 tx=0).stop 2024-08-31T04:25:46.406 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:46.405+0000 7f5e575e5740 1 -- 172.21.15.50:0/3772202085 shutdown_connections 2024-08-31T04:25:46.406 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:46.405+0000 7f5e575e5740 1 --2- 172.21.15.50:0/3772202085 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x560c177e61c0 0x560c17c7bb50 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:46.406 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:46.405+0000 7f5e575e5740 1 --2- 172.21.15.50:0/3772202085 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x560c178314d0 0x560c17c06ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:46.406 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:46.405+0000 7f5e575e5740 1 --2- 172.21.15.50:0/3772202085 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560c178521b0 0x560c17c079f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:46.406 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:46.405+0000 7f5e575e5740 1 --2- 172.21.15.50:0/3772202085 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x560c178292f0 0x560c17c06810 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:46.407 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:46.405+0000 7f5e575e5740 1 -- 172.21.15.50:0/3772202085 >> 172.21.15.50:0/3772202085 conn(0x560c17846300 msgr2=0x560c17bf2690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:25:46.407 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:46.405+0000 7f5e2f400640 0 client.25712 ms_handle_reset on v2:172.21.15.133:6838/2526402262 2024-08-31T04:25:46.420 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:46.416+0000 7f5e575e5740 1 -- 172.21.15.50:0/3772202085 shutdown_connections 2024-08-31T04:25:46.420 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:46.417+0000 7f5e575e5740 1 -- 172.21.15.50:0/3772202085 wait complete. 2024-08-31T04:25:46.449 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:46.428+0000 7f5e575e5740 20 client.25712 trim_cache size 0 max 16384 2024-08-31T04:25:46.489 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout:{ 2024-08-31T04:25:46.489 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout: "message": "", 2024-08-31T04:25:46.489 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout: "return_code": 0 2024-08-31T04:25:46.489 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout:} 2024-08-31T04:25:46.513 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:46.511+0000 7f5e4f000640 1 -- 172.21.15.50:0/1330933399 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f5e300b4a40 msgr2=0x7f5e300b6f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:25:46.513 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:46.511+0000 7f5e4f000640 1 --2- 172.21.15.50:0/1330933399 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f5e300b4a40 0x7f5e300b6f50 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f5e40004af0 tx=0x7f5e40009440 comp rx=0 tx=0).stop 2024-08-31T04:25:46.513 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:46.511+0000 7f5e4f000640 1 -- 172.21.15.50:0/1330933399 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5e48106410 msgr2=0x7f5e48101dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:25:46.513 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:46.511+0000 7f5e4f000640 1 --2- 172.21.15.50:0/1330933399 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5e48106410 0x7f5e48101dd0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f5e3400e9c0 tx=0x7f5e3400ee80 comp rx=0 tx=0).stop 2024-08-31T04:25:46.521 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:46.520+0000 7f5e4f000640 1 -- 172.21.15.50:0/1330933399 shutdown_connections 2024-08-31T04:25:46.521 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:46.520+0000 7f5e4f000640 1 --2- 172.21.15.50:0/1330933399 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f5e300b4a40 0x7f5e300b6f50 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:46.521 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:46.520+0000 7f5e4f000640 1 --2- 172.21.15.50:0/1330933399 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5e48106410 0x7f5e48101dd0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:46.521 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:46.520+0000 7f5e4f000640 1 --2- 172.21.15.50:0/1330933399 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5e48108fd0 0x7f5e48102310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:46.521 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:46.520+0000 7f5e4f000640 1 --2- 172.21.15.50:0/1330933399 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5e4806be70 0x7f5e48103510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:25:46.521 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:46.520+0000 7f5e4f000640 1 -- 172.21.15.50:0/1330933399 >> 172.21.15.50:0/1330933399 conn(0x7f5e480fdad0 msgr2=0x7f5e48104920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:25:46.534 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:46.533+0000 7f5e4f000640 1 -- 172.21.15.50:0/1330933399 shutdown_connections 2024-08-31T04:25:46.541 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:25:46.540+0000 7f5e4f000640 1 -- 172.21.15.50:0/1330933399 wait complete. 2024-08-31T04:25:47.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:25:47 smithi177 ceph-mon[22025]: pgmap v454: 97 pgs: 97 active+clean; 127 MiB data, 582 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 6.0 MiB/s wr, 621 op/s 2024-08-31T04:25:47.542 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:25:47 smithi133 ceph-mon[22177]: pgmap v454: 97 pgs: 97 active+clean; 127 MiB data, 582 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 6.0 MiB/s wr, 621 op/s 2024-08-31T04:25:47.703 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:25:47 smithi050 ceph-mon[17259]: pgmap v454: 97 pgs: 97 active+clean; 127 MiB data, 582 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 6.0 MiB/s wr, 621 op/s 2024-08-31T04:25:49.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:25:49 smithi177 ceph-mon[22025]: pgmap v455: 97 pgs: 97 active+clean; 122 MiB data, 582 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 2.9 MiB/s wr, 309 op/s 2024-08-31T04:25:49.542 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:25:49 smithi133 ceph-mon[22177]: pgmap v455: 97 pgs: 97 active+clean; 122 MiB data, 582 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 2.9 MiB/s wr, 309 op/s 2024-08-31T04:25:49.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:25:49 smithi050 ceph-mon[17259]: pgmap v455: 97 pgs: 97 active+clean; 122 MiB data, 582 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 2.9 MiB/s wr, 309 op/s 2024-08-31T04:25:51.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:25:51 smithi177 ceph-mon[22025]: pgmap v456: 97 pgs: 97 active+clean; 122 MiB data, 582 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 1.1 MiB/s wr, 252 op/s 2024-08-31T04:25:51.542 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:25:51 smithi133 ceph-mon[22177]: pgmap v456: 97 pgs: 97 active+clean; 122 MiB data, 582 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 1.1 MiB/s wr, 252 op/s 2024-08-31T04:25:51.701 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:25:51 smithi050 ceph-mon[17259]: pgmap v456: 97 pgs: 97 active+clean; 122 MiB data, 582 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 1.1 MiB/s wr, 252 op/s 2024-08-31T04:25:53.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:25:53 smithi177 ceph-mon[22025]: pgmap v457: 97 pgs: 97 active+clean; 125 MiB data, 580 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 1.9 MiB/s wr, 419 op/s 2024-08-31T04:25:53.542 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:25:53 smithi133 ceph-mon[22177]: pgmap v457: 97 pgs: 97 active+clean; 125 MiB data, 580 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 1.9 MiB/s wr, 419 op/s 2024-08-31T04:25:53.630 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:25:53 smithi050 ceph-mon[17259]: pgmap v457: 97 pgs: 97 active+clean; 125 MiB data, 580 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 1.9 MiB/s wr, 419 op/s 2024-08-31T04:25:55.386 INFO:tasks.workunit.client.0.smithi050.stdout: 72 567374 1102 373695 1059 146047 358 2024-08-31T04:25:55.542 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:25:55 smithi133 ceph-mon[22177]: pgmap v458: 97 pgs: 97 active+clean; 125 MiB data, 586 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 1.6 MiB/s wr, 409 op/s 2024-08-31T04:25:55.701 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:25:55 smithi050 ceph-mon[17259]: pgmap v458: 97 pgs: 97 active+clean; 125 MiB data, 586 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 1.6 MiB/s wr, 409 op/s 2024-08-31T04:25:55.745 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:25:55 smithi177 ceph-mon[22025]: pgmap v458: 97 pgs: 97 active+clean; 125 MiB data, 586 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 1.6 MiB/s wr, 409 op/s 2024-08-31T04:25:57.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:25:57 smithi133 ceph-mon[22177]: pgmap v459: 97 pgs: 97 active+clean; 146 MiB data, 613 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 3.4 MiB/s wr, 508 op/s 2024-08-31T04:25:57.701 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:25:57 smithi050 ceph-mon[17259]: pgmap v459: 97 pgs: 97 active+clean; 146 MiB data, 613 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 3.4 MiB/s wr, 508 op/s 2024-08-31T04:25:57.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:25:57 smithi177 ceph-mon[22025]: pgmap v459: 97 pgs: 97 active+clean; 146 MiB data, 613 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 3.4 MiB/s wr, 508 op/s 2024-08-31T04:25:59.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:25:59 smithi133 ceph-mon[22177]: pgmap v460: 97 pgs: 97 active+clean; 154 MiB data, 630 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 3.8 MiB/s wr, 536 op/s 2024-08-31T04:25:59.605 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:25:59 smithi050 ceph-mon[17259]: pgmap v460: 97 pgs: 97 active+clean; 154 MiB data, 630 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 3.8 MiB/s wr, 536 op/s 2024-08-31T04:25:59.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:25:59 smithi177 ceph-mon[22025]: pgmap v460: 97 pgs: 97 active+clean; 154 MiB data, 630 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 3.8 MiB/s wr, 536 op/s 2024-08-31T04:26:00.608 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:00.607+0000 7f3317000640 1 -- 172.21.15.50:0/740614543 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f331010a910 msgr2=0x7f331010ad20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:26:00.609 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:00.607+0000 7f3317000640 1 --2- 172.21.15.50:0/740614543 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f331010a910 0x7f331010ad20 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f32fc009900 tx=0x7f32fc02a400 comp rx=0 tx=0).stop 2024-08-31T04:26:00.609 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:00.607+0000 7f3317000640 1 -- 172.21.15.50:0/740614543 shutdown_connections 2024-08-31T04:26:00.609 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:00.607+0000 7f3317000640 1 --2- 172.21.15.50:0/740614543 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f331010b2b0 0x7f3310111c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:00.609 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:00.607+0000 7f3317000640 1 --2- 172.21.15.50:0/740614543 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f331010a910 0x7f331010ad20 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:00.609 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:00.607+0000 7f3317000640 1 --2- 172.21.15.50:0/740614543 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3310109890 0x7f3310109d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:00.609 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:00.607+0000 7f3317000640 1 -- 172.21.15.50:0/740614543 >> 172.21.15.50:0/740614543 conn(0x7f3310078bd0 msgr2=0x7f331007b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:26:00.610 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:00.608+0000 7f3317000640 1 -- 172.21.15.50:0/740614543 shutdown_connections 2024-08-31T04:26:00.610 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:00.608+0000 7f3317000640 1 -- 172.21.15.50:0/740614543 wait complete. 2024-08-31T04:26:00.610 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:00.609+0000 7f3317000640 1 Processor -- start 2024-08-31T04:26:00.611 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:00.610+0000 7f3317000640 1 -- start start 2024-08-31T04:26:00.612 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:00.611+0000 7f3317000640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3310109890 0x7f33101a0150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:26:00.613 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:00.611+0000 7f3317000640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f331010a910 0x7f33101a07c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:26:00.613 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:00.612+0000 7f3317000640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f331010b2b0 0x7f33101a1370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:26:00.613 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:00.612+0000 7f3317000640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f3310115530 con 0x7f331010a910 2024-08-31T04:26:00.613 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:00.612+0000 7f3317000640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f33101153b0 con 0x7f3310109890 2024-08-31T04:26:00.613 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:00.612+0000 7f3317000640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f33101156b0 con 0x7f331010b2b0 2024-08-31T04:26:00.613 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:00.611+0000 7f3315c00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3310109890 0x7f33101a0150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:26:00.614 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:00.612+0000 7f3315c00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3310109890 0x7f33101a0150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.50:38520/0 (socket says 172.21.15.50:38520) 2024-08-31T04:26:00.614 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:00.612+0000 7f3315c00640 1 -- 172.21.15.50:0/4286058966 learned_addr learned my addr 172.21.15.50:0/4286058966 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:26:00.614 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:00.612+0000 7f3315200640 1 --2- 172.21.15.50:0/4286058966 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f331010a910 0x7f33101a07c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:26:00.614 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:00.612+0000 7f3315c00640 1 -- 172.21.15.50:0/4286058966 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f331010b2b0 msgr2=0x7f33101a1370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:26:00.614 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:00.612+0000 7f3316600640 1 --2- 172.21.15.50:0/4286058966 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f331010b2b0 0x7f33101a1370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:26:00.614 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:00.613+0000 7f3315c00640 1 --2- 172.21.15.50:0/4286058966 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f331010b2b0 0x7f33101a1370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:00.614 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:00.613+0000 7f3315c00640 1 -- 172.21.15.50:0/4286058966 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f331010a910 msgr2=0x7f33101a07c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:26:00.615 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:00.613+0000 7f3315c00640 1 --2- 172.21.15.50:0/4286058966 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f331010a910 0x7f33101a07c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:00.615 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:00.613+0000 7f3315c00640 1 -- 172.21.15.50:0/4286058966 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33101a1b90 con 0x7f3310109890 2024-08-31T04:26:00.615 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:00.613+0000 7f3316600640 1 --2- 172.21.15.50:0/4286058966 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f331010b2b0 0x7f33101a1370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T04:26:00.615 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:00.613+0000 7f3315200640 1 --2- 172.21.15.50:0/4286058966 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f331010a910 0x7f33101a07c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T04:26:00.615 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:00.613+0000 7f3315c00640 1 --2- 172.21.15.50:0/4286058966 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3310109890 0x7f33101a0150 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f330400d950 tx=0x7f330400de10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:26:00.615 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:00.613+0000 7f330e000640 1 -- 172.21.15.50:0/4286058966 <== mon.2 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3304017070 con 0x7f3310109890 2024-08-31T04:26:00.615 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:00.614+0000 7f330e000640 1 -- 172.21.15.50:0/4286058966 <== mon.2 v2:172.21.15.133:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3304009c30 con 0x7f3310109890 2024-08-31T04:26:00.615 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:00.614+0000 7f330e000640 1 -- 172.21.15.50:0/4286058966 <== mon.2 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f330400f620 con 0x7f3310109890 2024-08-31T04:26:00.616 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:00.614+0000 7f3317000640 1 -- 172.21.15.50:0/4286058966 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f33101a1e80 con 0x7f3310109890 2024-08-31T04:26:00.619 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:00.615+0000 7f3317000640 1 -- 172.21.15.50:0/4286058966 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f33101a8570 con 0x7f3310109890 2024-08-31T04:26:00.621 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:00.620+0000 7f331f7d4740 1 Processor -- start 2024-08-31T04:26:00.621 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:00.620+0000 7f331f7d4740 1 -- start start 2024-08-31T04:26:00.622 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:00.621+0000 7f331f7d4740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x560d219e41b0 0x560d21d89d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:26:00.622 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:00.621+0000 7f331f7d4740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560d219bb2f0 0x560d21d8a3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:26:00.622 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:00.621+0000 7f331f7d4740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x560d219c34d0 0x560d21d8af00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:26:00.622 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:00.621+0000 7f331f7d4740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x560d21cfcf70 con 0x560d219bb2f0 2024-08-31T04:26:00.622 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:00.621+0000 7f331f7d4740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x560d21cec500 con 0x560d219e41b0 2024-08-31T04:26:00.622 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:00.621+0000 7f331f7d4740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x560d21cf04b0 con 0x560d219c34d0 2024-08-31T04:26:00.623 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:00.621+0000 7f3316600640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x560d219e41b0 0x560d21d89d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:26:00.623 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:00.621+0000 7f3316600640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x560d219e41b0 0x560d21d89d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.50:38532/0 (socket says 172.21.15.50:38532) 2024-08-31T04:26:00.623 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:00.621+0000 7f3316600640 1 -- 172.21.15.50:0/525419137 learned_addr learned my addr 172.21.15.50:0/525419137 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:26:00.623 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:00.622+0000 7f330e000640 1 -- 172.21.15.50:0/4286058966 <== mon.2 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 18) ==== 152577+0+0 (secure 0 0 0) 0x7f3304005020 con 0x7f3310109890 2024-08-31T04:26:00.623 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:00.622+0000 7f3315200640 1 --2- 172.21.15.50:0/525419137 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x560d219c34d0 0x560d21d8af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:26:00.624 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:00.623+0000 7f3316600640 1 -- 172.21.15.50:0/525419137 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x560d219c34d0 msgr2=0x560d21d8af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:26:00.624 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:00.623+0000 7f3316600640 1 --2- 172.21.15.50:0/525419137 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x560d219c34d0 0x560d21d8af00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:00.624 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:00.623+0000 7f3316600640 1 -- 172.21.15.50:0/525419137 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560d219bb2f0 msgr2=0x560d21d8a3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:26:00.624 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:00.623+0000 7f3316600640 1 --2- 172.21.15.50:0/525419137 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560d219bb2f0 0x560d21d8a3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:00.624 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:00.623+0000 7f3316600640 1 -- 172.21.15.50:0/525419137 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560d21ca6c10 con 0x560d219e41b0 2024-08-31T04:26:00.624 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:00.623+0000 7f3316600640 1 --2- 172.21.15.50:0/525419137 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x560d219e41b0 0x560d21d89d40 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f3308008dd0 tx=0x7f330800d710 comp rx=0 tx=0).ready entity=mon.2 client_cookie=56e88afb9e583ef1 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:26:00.625 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:00.624+0000 7f3302a00640 1 -- 172.21.15.50:0/525419137 <== mon.2 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f330800f830 con 0x560d219e41b0 2024-08-31T04:26:00.625 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:00.624+0000 7f3302a00640 1 -- 172.21.15.50:0/525419137 <== mon.2 v2:172.21.15.133:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f330800de20 con 0x560d219e41b0 2024-08-31T04:26:00.625 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:00.624+0000 7f3302a00640 1 -- 172.21.15.50:0/525419137 <== mon.2 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f330800e3b0 con 0x560d219e41b0 2024-08-31T04:26:00.625 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:00.625+0000 7f330e000640 1 --2- 172.21.15.50:0/4286058966 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f32f80b4d00 0x7f32f80b7210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:26:00.626 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:00.625+0000 7f330e000640 1 -- 172.21.15.50:0/4286058966 <== mon.2 v2:172.21.15.133:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8219+0+0 (secure 0 0 0) 0x7f33040e4210 con 0x7f3310109890 2024-08-31T04:26:00.627 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:00.625+0000 7f3315c00640 1 --2- 172.21.15.50:0/4286058966 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f32f80b4d00 0x7f32f80b7210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:26:00.627 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:00.625+0000 7f331f7d4740 1 -- 172.21.15.50:0/525419137 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x560d219e41b0 msgr2=0x560d21d89d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:26:00.627 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:00.625+0000 7f331f7d4740 1 --2- 172.21.15.50:0/525419137 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x560d219e41b0 0x560d21d89d40 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f3308008dd0 tx=0x7f330800d710 comp rx=0 tx=0).stop 2024-08-31T04:26:00.627 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:00.626+0000 7f331f7d4740 1 -- 172.21.15.50:0/525419137 shutdown_connections 2024-08-31T04:26:00.627 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:00.626+0000 7f331f7d4740 1 --2- 172.21.15.50:0/525419137 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x560d219c34d0 0x560d21d8af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:00.627 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:00.626+0000 7f331f7d4740 1 --2- 172.21.15.50:0/525419137 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560d219bb2f0 0x560d21d8a3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:00.627 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:00.626+0000 7f331f7d4740 1 --2- 172.21.15.50:0/525419137 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x560d219e41b0 0x560d21d89d40 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:00.627 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:00.626+0000 7f331f7d4740 1 -- 172.21.15.50:0/525419137 >> 172.21.15.50:0/525419137 conn(0x560d219d8300 msgr2=0x560d21d857d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:26:00.628 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:00.627+0000 7f3315c00640 1 --2- 172.21.15.50:0/4286058966 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f32f80b4d00 0x7f32f80b7210 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f33040a6ca0 tx=0x7f33040a6bb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:26:00.628 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:00.627+0000 7f331f7d4740 1 -- 172.21.15.50:0/525419137 shutdown_connections 2024-08-31T04:26:00.628 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:00.627+0000 7f331f7d4740 1 -- 172.21.15.50:0/525419137 wait complete. 2024-08-31T04:26:00.629 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:00.628+0000 7f331f7d4740 1 -- start start 2024-08-31T04:26:00.629 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:00.628+0000 7f331f7d4740 1 Processor -- start 2024-08-31T04:26:00.630 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:00.629+0000 7f331f7d4740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x560d219bb2f0 0x560d21d93410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:26:00.631 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:00.629+0000 7f331f7d4740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560d219c34d0 0x560d21d93ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:26:00.631 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:00.629+0000 7f331f7d4740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x560d219e41b0 0x560d21d94640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:26:00.631 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:00.629+0000 7f331f7d4740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x560d21c25ab0 con 0x560d219c34d0 2024-08-31T04:26:00.632 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:00.629+0000 7f331f7d4740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x560d21c93320 con 0x560d219bb2f0 2024-08-31T04:26:00.632 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:00.629+0000 7f331f7d4740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x560d21d8ba20 con 0x560d219e41b0 2024-08-31T04:26:00.632 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:00.629+0000 7f331f7d4740 10 client.0 _ll_register_callbacks cb 0x560d21ccce80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:26:00.632 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:00.629+0000 7f3315200640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560d219c34d0 0x560d21d93ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:26:00.632 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:00.629+0000 7f3315200640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560d219c34d0 0x560d21d93ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:34504/0 (socket says 172.21.15.50:34504) 2024-08-31T04:26:00.632 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:00.629+0000 7f3315200640 1 -- 172.21.15.50:0/3090529362 learned_addr learned my addr 172.21.15.50:0/3090529362 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:26:00.632 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:00.630+0000 7f3316600640 1 --2- 172.21.15.50:0/3090529362 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x560d219bb2f0 0x560d21d93410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:26:00.633 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:00.630+0000 7f3316600640 1 --2- 172.21.15.50:0/3090529362 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x560d219e41b0 0x560d21d94640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:26:00.636 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:00.630+0000 7f3315200640 1 -- 172.21.15.50:0/3090529362 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x560d219e41b0 msgr2=0x560d21d94640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:26:00.636 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:00.630+0000 7f3315200640 1 --2- 172.21.15.50:0/3090529362 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x560d219e41b0 0x560d21d94640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:00.636 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:00.630+0000 7f3315200640 1 -- 172.21.15.50:0/3090529362 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x560d219bb2f0 msgr2=0x560d21d93410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:26:00.636 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:00.630+0000 7f3315200640 1 --2- 172.21.15.50:0/3090529362 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x560d219bb2f0 0x560d21d93410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:00.637 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:00.630+0000 7f3315200640 1 -- 172.21.15.50:0/3090529362 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560d21a4f790 con 0x560d219c34d0 2024-08-31T04:26:00.637 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:00.630+0000 7f3316600640 1 --2- 172.21.15.50:0/3090529362 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x560d219bb2f0 0x560d21d93410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:26:00.637 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:00.631+0000 7f3315200640 1 --2- 172.21.15.50:0/3090529362 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560d219c34d0 0x560d21d93ad0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f32fc004440 tx=0x7f32fc004470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2cb50d77923abc33 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:26:00.637 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:00.631+0000 7f32f7400640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-08-31T04:26:00.637 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:00.631+0000 7f32f7400640 1 -- 172.21.15.50:0/3090529362 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32fc035040 con 0x560d219c34d0 2024-08-31T04:26:00.637 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:00.631+0000 7f32f7400640 1 -- 172.21.15.50:0/3090529362 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8219+0+0 (secure 0 0 0) 0x7f32fc0046c0 con 0x560d219c34d0 2024-08-31T04:26:00.638 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:00.631+0000 7f331f7d4740 1 -- 172.21.15.50:0/3090529362 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f330800de20 con 0x560d219c34d0 2024-08-31T04:26:00.638 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:00.632+0000 7f32f7400640 1 -- 172.21.15.50:0/3090529362 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f32fc005590 con 0x560d219c34d0 2024-08-31T04:26:00.638 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:00.632+0000 7f331f7d4740 10 client.15705 fetch_fsmap learned FSMap version 33 2024-08-31T04:26:00.638 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:00.632+0000 7f331f7d4740 1 -- 172.21.15.50:0/3090529362 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x560d21ac8620 con 0x560d219c34d0 2024-08-31T04:26:00.638 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:00.632+0000 7f32f7400640 1 -- 172.21.15.50:0/3090529362 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f330800de20 con 0x560d219c34d0 2024-08-31T04:26:00.638 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:00.632+0000 7f32f7400640 1 -- 172.21.15.50:0/3090529362 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 33) ==== 8378+0+0 (secure 0 0 0) 0x7f32fc003ae0 con 0x560d219c34d0 2024-08-31T04:26:00.638 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:00.633+0000 7f331f7d4740 10 client.15705 fetch_fsmap finished waiting for FSMap version 33 2024-08-31T04:26:00.638 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:00.633+0000 7f331f7d4740 10 client.15705 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T04:26:00.639 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:00.633+0000 7f331f7d4740 20 client.15705 populate_metadata read hostname 'smithi050' 2024-08-31T04:26:00.639 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:00.633+0000 7f331f7d4740 1 --2- 172.21.15.50:0/3090529362 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x560d219a2d80 0x560d21da0c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:26:00.639 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:00.633+0000 7f331f7d4740 4 client.15705 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T04:26:00.639 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:00.633+0000 7f331f7d4740 1 -- 172.21.15.50:0/3090529362 --> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560d21cfeec0 con 0x560d219a2d80 2024-08-31T04:26:00.639 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:00.633+0000 7f3316600640 1 --2- 172.21.15.50:0/3090529362 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x560d219a2d80 0x560d21da0c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:26:00.639 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:00.633+0000 7f32f7400640 10 client.15705 ms_handle_connect on v2:172.21.15.133:6838/2526402262 2024-08-31T04:26:00.639 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:00.633+0000 7f3316600640 1 --2- 172.21.15.50:0/3090529362 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x560d219a2d80 0x560d21da0c60 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=83f0ec826cae7ec server_cookie=e1ca4cbdc9c2e104 in_seq=0 out_seq=0 2024-08-31T04:26:00.641 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:00.636+0000 7f32f7400640 1 -- 172.21.15.50:0/3090529362 <== mds.0 v2:172.21.15.133:6838/2526402262 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x560d21cfeec0 con 0x560d219a2d80 2024-08-31T04:26:00.641 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:00.636+0000 7f32f7400640 10 client.15705 handle_command_reply: tid=0 2024-08-31T04:26:00.641 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:00.636+0000 7f331f7d4740 1 client.15705 shutdown 2024-08-31T04:26:00.642 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:00.637+0000 7f331f7d4740 1 -- 172.21.15.50:0/3090529362 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560d219c34d0 msgr2=0x560d21d93ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:26:00.642 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:00.637+0000 7f331f7d4740 1 --2- 172.21.15.50:0/3090529362 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560d219c34d0 0x560d21d93ad0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f32fc004440 tx=0x7f32fc004470 comp rx=0 tx=0).stop 2024-08-31T04:26:00.642 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:00.637+0000 7f331f7d4740 1 -- 172.21.15.50:0/3090529362 shutdown_connections 2024-08-31T04:26:00.642 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:00.637+0000 7f331f7d4740 1 --2- 172.21.15.50:0/3090529362 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x560d219a2d80 0x560d21da0c60 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:00.642 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:00.637+0000 7f331f7d4740 1 --2- 172.21.15.50:0/3090529362 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x560d219e41b0 0x560d21d94640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:00.642 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:00.637+0000 7f331f7d4740 1 --2- 172.21.15.50:0/3090529362 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560d219c34d0 0x560d21d93ad0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:00.643 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:00.637+0000 7f331f7d4740 1 --2- 172.21.15.50:0/3090529362 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x560d219bb2f0 0x560d21d93410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:00.643 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:00.637+0000 7f331f7d4740 1 -- 172.21.15.50:0/3090529362 >> 172.21.15.50:0/3090529362 conn(0x560d219d8300 msgr2=0x560d21d83d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:26:00.643 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:00.637+0000 7f32f7400640 0 client.15705 ms_handle_reset on v2:172.21.15.133:6838/2526402262 2024-08-31T04:26:00.643 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:00.637+0000 7f331f7d4740 1 -- 172.21.15.50:0/3090529362 shutdown_connections 2024-08-31T04:26:00.643 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:00.637+0000 7f331f7d4740 1 -- 172.21.15.50:0/3090529362 wait complete. 2024-08-31T04:26:00.643 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:00.637+0000 7f331f7d4740 20 client.15705 trim_cache size 0 max 16384 2024-08-31T04:26:00.658 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:00.656+0000 7f331f7d4740 1 Processor -- start 2024-08-31T04:26:00.658 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:00.656+0000 7f331f7d4740 1 -- start start 2024-08-31T04:26:00.658 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:00.656+0000 7f331f7d4740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x560d219bb2f0 0x560d21d8e540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:26:00.658 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:00.656+0000 7f331f7d4740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560d219c34d0 0x560d21d91920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:26:00.658 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:00.656+0000 7f331f7d4740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x560d219e41b0 0x560d21d91e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:26:00.658 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:00.656+0000 7f331f7d4740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f33101b1270 con 0x560d219c34d0 2024-08-31T04:26:00.659 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:00.656+0000 7f331f7d4740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f33101b2e70 con 0x560d219bb2f0 2024-08-31T04:26:00.659 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:00.656+0000 7f331f7d4740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f33101b1940 con 0x560d219e41b0 2024-08-31T04:26:00.660 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:00.657+0000 7f3316600640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x560d219e41b0 0x560d21d91e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:26:00.660 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:00.657+0000 7f3316600640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x560d219e41b0 0x560d21d91e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.50:39992/0 (socket says 172.21.15.50:39992) 2024-08-31T04:26:00.660 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:00.657+0000 7f3316600640 1 -- 172.21.15.50:0/2917428985 learned_addr learned my addr 172.21.15.50:0/2917428985 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:26:00.660 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:00.657+0000 7f3316600640 1 --2- 172.21.15.50:0/2917428985 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x560d219bb2f0 0x560d21d8e540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:26:00.660 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:00.657+0000 7f3315200640 1 --2- 172.21.15.50:0/2917428985 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560d219c34d0 0x560d21d91920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:26:00.660 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:00.657+0000 7f3316600640 1 -- 172.21.15.50:0/2917428985 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x560d219bb2f0 msgr2=0x560d21d8e540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:26:00.661 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:00.657+0000 7f3316600640 1 --2- 172.21.15.50:0/2917428985 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x560d219bb2f0 0x560d21d8e540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:00.661 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:00.657+0000 7f3316600640 1 -- 172.21.15.50:0/2917428985 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560d219c34d0 msgr2=0x560d21d91920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:26:00.661 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:00.657+0000 7f3316600640 1 --2- 172.21.15.50:0/2917428985 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560d219c34d0 0x560d21d91920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:00.661 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:00.657+0000 7f3316600640 1 -- 172.21.15.50:0/2917428985 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560d21d9b8e0 con 0x560d219e41b0 2024-08-31T04:26:00.661 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:00.657+0000 7f3316600640 1 --2- 172.21.15.50:0/2917428985 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x560d219e41b0 0x560d21d91e60 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f330800dc10 tx=0x7f3308004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=252336a8c126af99 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:26:00.661 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:00.658+0000 7f3302000640 1 -- 172.21.15.50:0/2917428985 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3308022070 con 0x560d219e41b0 2024-08-31T04:26:00.662 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:00.658+0000 7f3302000640 1 -- 172.21.15.50:0/2917428985 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3308023040 con 0x560d219e41b0 2024-08-31T04:26:00.662 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:00.658+0000 7f3302000640 1 -- 172.21.15.50:0/2917428985 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f330802bbf0 con 0x560d219e41b0 2024-08-31T04:26:00.666 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:00.659+0000 7f331f7d4740 1 -- 172.21.15.50:0/2917428985 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x560d219e41b0 msgr2=0x560d21d91e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:26:00.666 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:00.659+0000 7f331f7d4740 1 --2- 172.21.15.50:0/2917428985 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x560d219e41b0 0x560d21d91e60 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f330800dc10 tx=0x7f3308004a40 comp rx=0 tx=0).stop 2024-08-31T04:26:00.666 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:00.660+0000 7f331f7d4740 1 -- 172.21.15.50:0/2917428985 shutdown_connections 2024-08-31T04:26:00.666 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:00.660+0000 7f331f7d4740 1 --2- 172.21.15.50:0/2917428985 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x560d219e41b0 0x560d21d91e60 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:00.667 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:00.660+0000 7f331f7d4740 1 --2- 172.21.15.50:0/2917428985 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560d219c34d0 0x560d21d91920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:00.667 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:00.660+0000 7f331f7d4740 1 --2- 172.21.15.50:0/2917428985 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x560d219bb2f0 0x560d21d8e540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:00.667 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:00.660+0000 7f331f7d4740 1 -- 172.21.15.50:0/2917428985 >> 172.21.15.50:0/2917428985 conn(0x560d219d8300 msgr2=0x560d21d8de30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:26:00.667 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:00.660+0000 7f331f7d4740 1 -- 172.21.15.50:0/2917428985 shutdown_connections 2024-08-31T04:26:00.667 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:00.660+0000 7f331f7d4740 1 -- 172.21.15.50:0/2917428985 wait complete. 2024-08-31T04:26:00.667 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:00.661+0000 7f331f7d4740 1 -- start start 2024-08-31T04:26:00.667 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:00.661+0000 7f331f7d4740 1 Processor -- start 2024-08-31T04:26:00.667 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:00.662+0000 7f331f7d4740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560d219bb2f0 0x560d21d9adf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:26:00.667 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:00.662+0000 7f331f7d4740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x560d219c34d0 0x560d21d99ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:26:00.667 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:00.662+0000 7f331f7d4740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x560d219e41b0 0x560d21d99ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:26:00.667 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:00.662+0000 7f331f7d4740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f33101b27a0 con 0x560d219bb2f0 2024-08-31T04:26:00.667 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:00.662+0000 7f331f7d4740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f33101b2010 con 0x560d219e41b0 2024-08-31T04:26:00.668 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:00.662+0000 7f331f7d4740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f33101af250 con 0x560d219c34d0 2024-08-31T04:26:00.668 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:00.662+0000 7f331f7d4740 10 client.0 _ll_register_callbacks cb 0x7f32fc005d50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:26:00.668 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:00.662+0000 7f3315200640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x560d219c34d0 0x560d21d99ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:26:00.668 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:00.662+0000 7f3315200640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x560d219c34d0 0x560d21d99ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.50:40004/0 (socket says 172.21.15.50:40004) 2024-08-31T04:26:00.668 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:00.662+0000 7f3315200640 1 -- 172.21.15.50:0/4038117987 learned_addr learned my addr 172.21.15.50:0/4038117987 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:26:00.668 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:00.662+0000 7f3316600640 1 --2- 172.21.15.50:0/4038117987 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560d219bb2f0 0x560d21d9adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:26:00.668 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:00.663+0000 7f3315200640 1 -- 172.21.15.50:0/4038117987 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x560d219e41b0 msgr2=0x560d21d99ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:26:00.668 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:00.663+0000 7f3316600640 1 --2- 172.21.15.50:0/4038117987 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x560d219e41b0 0x560d21d99ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:26:00.668 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:00.663+0000 7f3315200640 1 --2- 172.21.15.50:0/4038117987 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x560d219e41b0 0x560d21d99ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:00.668 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:00.663+0000 7f3315200640 1 -- 172.21.15.50:0/4038117987 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560d219bb2f0 msgr2=0x560d21d9adf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:26:00.668 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:00.663+0000 7f3315200640 1 --2- 172.21.15.50:0/4038117987 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560d219bb2f0 0x560d21d9adf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:00.668 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:00.663+0000 7f3315200640 1 -- 172.21.15.50:0/4038117987 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560d21d9a530 con 0x560d219c34d0 2024-08-31T04:26:00.668 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:00.663+0000 7f3316600640 1 --2- 172.21.15.50:0/4038117987 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x560d219e41b0 0x560d21d99ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T04:26:00.668 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:00.663+0000 7f3315200640 1 --2- 172.21.15.50:0/4038117987 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x560d219c34d0 0x560d21d99ab0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f32fc000c00 tx=0x7f32fc031950 comp rx=0 tx=0).ready entity=mon.1 client_cookie=638822fa6f41b89a server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:26:00.669 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:00.663+0000 7f32f7400640 10 client.0 ms_handle_connect on v2:172.21.15.177:3300/0 2024-08-31T04:26:00.669 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:00.664+0000 7f32f7400640 1 -- 172.21.15.50:0/4038117987 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32fc054070 con 0x560d219c34d0 2024-08-31T04:26:00.669 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:00.664+0000 7f32f7400640 1 -- 172.21.15.50:0/4038117987 <== mon.1 v2:172.21.15.177:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8219+0+0 (secure 0 0 0) 0x7f32fc0035f0 con 0x560d219c34d0 2024-08-31T04:26:00.669 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:00.664+0000 7f331f7d4740 1 -- 172.21.15.50:0/4038117987 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3308023040 con 0x560d219c34d0 2024-08-31T04:26:00.669 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:00.664+0000 7f32f7400640 1 -- 172.21.15.50:0/4038117987 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f32fc02aa80 con 0x560d219c34d0 2024-08-31T04:26:00.669 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:00.664+0000 7f331f7d4740 10 client.25729 fetch_fsmap learned FSMap version 33 2024-08-31T04:26:00.669 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:00.664+0000 7f331f7d4740 1 -- 172.21.15.50:0/4038117987 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x560d21d993a0 con 0x560d219c34d0 2024-08-31T04:26:00.669 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:00.665+0000 7f32f7400640 1 -- 172.21.15.50:0/4038117987 <== mon.1 v2:172.21.15.177:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3308023040 con 0x560d219c34d0 2024-08-31T04:26:00.669 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:00.665+0000 7f32f7400640 1 -- 172.21.15.50:0/4038117987 <== mon.1 v2:172.21.15.177:3300/0 5 ==== fsmap(e 33) ==== 8378+0+0 (secure 0 0 0) 0x7f32fc0049c0 con 0x560d219c34d0 2024-08-31T04:26:00.669 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:00.665+0000 7f331f7d4740 10 client.25729 fetch_fsmap finished waiting for FSMap version 33 2024-08-31T04:26:00.669 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:00.665+0000 7f331f7d4740 10 client.25729 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T04:26:00.669 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:00.665+0000 7f331f7d4740 20 client.25729 populate_metadata read hostname 'smithi050' 2024-08-31T04:26:00.669 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:00.665+0000 7f331f7d4740 1 --2- 172.21.15.50:0/4038117987 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x560d219781c0 0x560d21e0de40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:26:00.670 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:00.665+0000 7f331f7d4740 4 client.25729 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-31T04:26:00.670 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:00.665+0000 7f331f7d4740 1 -- 172.21.15.50:0/4038117987 --> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] -- command(tid 0: {"prefix": "flush journal"}) -- 0x560d21cfa960 con 0x560d219781c0 2024-08-31T04:26:00.670 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:00.668+0000 7f3316600640 1 --2- 172.21.15.50:0/4038117987 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x560d219781c0 0x560d21e0de40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:26:00.670 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:00.669+0000 7f32f7400640 10 client.25729 ms_handle_connect on v2:172.21.15.133:6838/2526402262 2024-08-31T04:26:00.670 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:00.669+0000 7f3316600640 1 --2- 172.21.15.50:0/4038117987 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x560d219781c0 0x560d21e0de40 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=982f8e5153953fb5 server_cookie=ba0ecef95c344ca9 in_seq=0 out_seq=0 2024-08-31T04:26:01.542 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:26:01 smithi133 ceph-mon[22177]: pgmap v461: 97 pgs: 97 active+clean; 166 MiB data, 643 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 4.5 MiB/s wr, 490 op/s 2024-08-31T04:26:01.703 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:26:01 smithi050 ceph-mon[17259]: pgmap v461: 97 pgs: 97 active+clean; 166 MiB data, 643 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 4.5 MiB/s wr, 490 op/s 2024-08-31T04:26:01.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:26:01 smithi177 ceph-mon[22025]: pgmap v461: 97 pgs: 97 active+clean; 166 MiB data, 643 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 4.5 MiB/s wr, 490 op/s 2024-08-31T04:26:02.695 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:02.694+0000 7f32f7400640 1 -- 172.21.15.50:0/4038117987 <== mds.0 v2:172.21.15.133:6838/2526402262 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x560d21cfa960 con 0x560d219781c0 2024-08-31T04:26:02.696 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:02.694+0000 7f32f7400640 10 client.25729 handle_command_reply: tid=0 2024-08-31T04:26:02.697 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:02.695+0000 7f331f7d4740 1 client.25729 shutdown 2024-08-31T04:26:02.697 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:02.695+0000 7f331f7d4740 1 -- 172.21.15.50:0/4038117987 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x560d219c34d0 msgr2=0x560d21d99ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:26:02.697 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:02.695+0000 7f331f7d4740 1 --2- 172.21.15.50:0/4038117987 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x560d219c34d0 0x560d21d99ab0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f32fc000c00 tx=0x7f32fc031950 comp rx=0 tx=0).stop 2024-08-31T04:26:02.697 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:02.695+0000 7f331f7d4740 1 -- 172.21.15.50:0/4038117987 shutdown_connections 2024-08-31T04:26:02.697 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:02.695+0000 7f331f7d4740 1 --2- 172.21.15.50:0/4038117987 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x560d219781c0 0x560d21e0de40 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:02.697 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:02.695+0000 7f331f7d4740 1 --2- 172.21.15.50:0/4038117987 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x560d219c34d0 0x560d21d99ab0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:02.697 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:02.695+0000 7f331f7d4740 1 --2- 172.21.15.50:0/4038117987 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x560d219e41b0 0x560d21d99ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:02.697 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:02.695+0000 7f331f7d4740 1 --2- 172.21.15.50:0/4038117987 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560d219bb2f0 0x560d21d9adf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:02.697 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:02.695+0000 7f331f7d4740 1 -- 172.21.15.50:0/4038117987 >> 172.21.15.50:0/4038117987 conn(0x560d219d8300 msgr2=0x560d21d85f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:26:02.698 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:02.695+0000 7f32f7400640 0 client.25729 ms_handle_reset on v2:172.21.15.133:6838/2526402262 2024-08-31T04:26:02.698 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:02.696+0000 7f331f7d4740 1 -- 172.21.15.50:0/4038117987 shutdown_connections 2024-08-31T04:26:02.698 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:02.696+0000 7f331f7d4740 1 -- 172.21.15.50:0/4038117987 wait complete. 2024-08-31T04:26:02.698 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:02.697+0000 7f331f7d4740 20 client.25729 trim_cache size 0 max 16384 2024-08-31T04:26:02.701 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout:{ 2024-08-31T04:26:02.701 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout: "message": "", 2024-08-31T04:26:02.701 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout: "return_code": 0 2024-08-31T04:26:02.701 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout:} 2024-08-31T04:26:02.702 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:02.700+0000 7f3317000640 1 -- 172.21.15.50:0/4286058966 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f32f80b4d00 msgr2=0x7f32f80b7210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:26:02.702 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:02.700+0000 7f3317000640 1 --2- 172.21.15.50:0/4286058966 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f32f80b4d00 0x7f32f80b7210 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f33040a6ca0 tx=0x7f33040a6bb0 comp rx=0 tx=0).stop 2024-08-31T04:26:02.702 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:02.700+0000 7f3317000640 1 -- 172.21.15.50:0/4286058966 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3310109890 msgr2=0x7f33101a0150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:26:02.702 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:02.700+0000 7f3317000640 1 --2- 172.21.15.50:0/4286058966 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3310109890 0x7f33101a0150 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f330400d950 tx=0x7f330400de10 comp rx=0 tx=0).stop 2024-08-31T04:26:02.702 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:02.700+0000 7f3317000640 1 -- 172.21.15.50:0/4286058966 shutdown_connections 2024-08-31T04:26:02.702 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:02.700+0000 7f3317000640 1 --2- 172.21.15.50:0/4286058966 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f32f80b4d00 0x7f32f80b7210 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:02.702 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:02.700+0000 7f3317000640 1 --2- 172.21.15.50:0/4286058966 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f331010b2b0 0x7f33101a1370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:02.702 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:02.700+0000 7f3317000640 1 --2- 172.21.15.50:0/4286058966 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f331010a910 0x7f33101a07c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:02.702 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:02.700+0000 7f3317000640 1 --2- 172.21.15.50:0/4286058966 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3310109890 0x7f33101a0150 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:02.702 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:02.700+0000 7f3317000640 1 -- 172.21.15.50:0/4286058966 >> 172.21.15.50:0/4286058966 conn(0x7f3310078bd0 msgr2=0x7f331010dc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:26:02.703 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:02.700+0000 7f3317000640 1 -- 172.21.15.50:0/4286058966 shutdown_connections 2024-08-31T04:26:02.703 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:02.701+0000 7f3317000640 1 -- 172.21.15.50:0/4286058966 wait complete. 2024-08-31T04:26:03.701 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:26:03 smithi050 ceph-mon[17259]: pgmap v462: 97 pgs: 97 active+clean; 218 MiB data, 655 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 9.0 MiB/s wr, 669 op/s 2024-08-31T04:26:03.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:26:03 smithi177 ceph-mon[22025]: pgmap v462: 97 pgs: 97 active+clean; 218 MiB data, 655 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 9.0 MiB/s wr, 669 op/s 2024-08-31T04:26:03.792 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:26:03 smithi133 ceph-mon[22177]: pgmap v462: 97 pgs: 97 active+clean; 218 MiB data, 655 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 9.0 MiB/s wr, 669 op/s 2024-08-31T04:26:05.386 INFO:tasks.workunit.client.0.smithi050.stdout: 89 463996 996 313753 959 98903 117 2024-08-31T04:26:05.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:26:05 smithi050 ceph-mon[17259]: pgmap v463: 97 pgs: 97 active+clean; 235 MiB data, 658 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 9.6 MiB/s wr, 619 op/s 2024-08-31T04:26:05.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:26:05 smithi177 ceph-mon[22025]: pgmap v463: 97 pgs: 97 active+clean; 235 MiB data, 658 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 9.6 MiB/s wr, 619 op/s 2024-08-31T04:26:05.792 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:26:05 smithi133 ceph-mon[22177]: pgmap v463: 97 pgs: 97 active+clean; 235 MiB data, 658 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 9.6 MiB/s wr, 619 op/s 2024-08-31T04:26:07.720 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:26:07 smithi050 ceph-mon[17259]: pgmap v464: 97 pgs: 97 active+clean; 228 MiB data, 696 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 11 MiB/s wr, 932 op/s 2024-08-31T04:26:07.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:26:07 smithi177 ceph-mon[22025]: pgmap v464: 97 pgs: 97 active+clean; 228 MiB data, 696 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 11 MiB/s wr, 932 op/s 2024-08-31T04:26:07.792 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:26:07 smithi133 ceph-mon[22177]: pgmap v464: 97 pgs: 97 active+clean; 228 MiB data, 696 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 11 MiB/s wr, 932 op/s 2024-08-31T04:26:08.715 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:26:08 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T04:26:08.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:26:08 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T04:26:08.792 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:26:08 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T04:26:09.703 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:26:09 smithi050 ceph-mon[17259]: pgmap v465: 97 pgs: 97 active+clean; 228 MiB data, 719 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 9.2 MiB/s wr, 890 op/s 2024-08-31T04:26:09.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:26:09 smithi177 ceph-mon[22025]: pgmap v465: 97 pgs: 97 active+clean; 228 MiB data, 719 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 9.2 MiB/s wr, 890 op/s 2024-08-31T04:26:09.792 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:26:09 smithi133 ceph-mon[22177]: pgmap v465: 97 pgs: 97 active+clean; 228 MiB data, 719 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 9.2 MiB/s wr, 890 op/s 2024-08-31T04:26:11.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:26:11 smithi050 ceph-mon[17259]: pgmap v466: 97 pgs: 97 active+clean; 228 MiB data, 720 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 8.4 MiB/s wr, 828 op/s 2024-08-31T04:26:11.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:26:11 smithi177 ceph-mon[22025]: pgmap v466: 97 pgs: 97 active+clean; 228 MiB data, 720 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 8.4 MiB/s wr, 828 op/s 2024-08-31T04:26:11.792 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:26:11 smithi133 ceph-mon[22177]: pgmap v466: 97 pgs: 97 active+clean; 228 MiB data, 720 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 8.4 MiB/s wr, 828 op/s 2024-08-31T04:26:13.594 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:26:13 smithi133 ceph-mon[22177]: pgmap v467: 97 pgs: 97 active+clean; 238 MiB data, 733 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 8.3 MiB/s wr, 829 op/s 2024-08-31T04:26:13.701 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:26:13 smithi050 ceph-mon[17259]: pgmap v467: 97 pgs: 97 active+clean; 238 MiB data, 733 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 8.3 MiB/s wr, 829 op/s 2024-08-31T04:26:13.745 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:26:13 smithi177 ceph-mon[22025]: pgmap v467: 97 pgs: 97 active+clean; 238 MiB data, 733 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 8.3 MiB/s wr, 829 op/s 2024-08-31T04:26:14.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:26:14 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:26:14.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:26:14 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T04:26:14.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:26:14 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:26:14.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:26:14 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:26:14.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:26:14 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T04:26:14.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:26:14 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:26:14.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:26:14 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:26:14.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:26:14 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T04:26:14.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:26:14 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:26:15.429 INFO:tasks.workunit.client.0.smithi050.stdout: 108 559318 1091 381716 829 112241 1089 2024-08-31T04:26:15.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:26:15 smithi050 ceph-mon[17259]: pgmap v468: 97 pgs: 97 active+clean; 237 MiB data, 732 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 3.8 MiB/s wr, 605 op/s 2024-08-31T04:26:15.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:26:15 smithi177 ceph-mon[22025]: pgmap v468: 97 pgs: 97 active+clean; 237 MiB data, 732 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 3.8 MiB/s wr, 605 op/s 2024-08-31T04:26:15.792 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:26:15 smithi133 ceph-mon[22177]: pgmap v468: 97 pgs: 97 active+clean; 237 MiB data, 732 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 3.8 MiB/s wr, 605 op/s 2024-08-31T04:26:17.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:26:17 smithi050 ceph-mon[17259]: pgmap v469: 97 pgs: 97 active+clean; 247 MiB data, 741 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 3.3 MiB/s wr, 562 op/s 2024-08-31T04:26:17.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:26:17 smithi177 ceph-mon[22025]: pgmap v469: 97 pgs: 97 active+clean; 247 MiB data, 741 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 3.3 MiB/s wr, 562 op/s 2024-08-31T04:26:17.792 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:26:17 smithi133 ceph-mon[22177]: pgmap v469: 97 pgs: 97 active+clean; 247 MiB data, 741 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 3.3 MiB/s wr, 562 op/s 2024-08-31T04:26:19.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:26:19 smithi050 ceph-mon[17259]: pgmap v470: 97 pgs: 97 active+clean; 256 MiB data, 767 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.8 MiB/s wr, 281 op/s 2024-08-31T04:26:19.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:26:19 smithi177 ceph-mon[22025]: pgmap v470: 97 pgs: 97 active+clean; 256 MiB data, 767 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.8 MiB/s wr, 281 op/s 2024-08-31T04:26:19.792 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:26:19 smithi133 ceph-mon[22177]: pgmap v470: 97 pgs: 97 active+clean; 256 MiB data, 767 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.8 MiB/s wr, 281 op/s 2024-08-31T04:26:19.857 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:19.855+0000 7f38c3e00640 1 -- 172.21.15.50:0/1973677128 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f38c410f5d0 msgr2=0x7f38c410fab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:26:19.857 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:19.855+0000 7f38c3e00640 1 --2- 172.21.15.50:0/1973677128 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f38c410f5d0 0x7f38c410fab0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f38b4009900 tx=0x7f38b402a440 comp rx=0 tx=0).stop 2024-08-31T04:26:19.866 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:19.865+0000 7f38c3e00640 1 -- 172.21.15.50:0/1973677128 shutdown_connections 2024-08-31T04:26:19.871 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:19.865+0000 7f38c3e00640 1 --2- 172.21.15.50:0/1973677128 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f38c410f5d0 0x7f38c410fab0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:19.871 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:19.865+0000 7f38c3e00640 1 --2- 172.21.15.50:0/1973677128 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f38c410cac0 0x7f38c410eee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:19.871 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:19.865+0000 7f38c3e00640 1 --2- 172.21.15.50:0/1973677128 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f38c410a160 0x7f38c410c580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:19.871 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:19.865+0000 7f38c3e00640 1 -- 172.21.15.50:0/1973677128 >> 172.21.15.50:0/1973677128 conn(0x7f38c40703e0 msgr2=0x7f38c4072890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:26:19.871 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:19.865+0000 7f38c3e00640 1 -- 172.21.15.50:0/1973677128 shutdown_connections 2024-08-31T04:26:19.871 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:19.865+0000 7f38c3e00640 1 -- 172.21.15.50:0/1973677128 wait complete. 2024-08-31T04:26:19.871 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:19.867+0000 7f38c3e00640 1 Processor -- start 2024-08-31T04:26:19.872 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:19.870+0000 7f38c3e00640 1 -- start start 2024-08-31T04:26:19.872 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:19.871+0000 7f38c3e00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f38c410a160 0x7f38c41a8a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:26:19.873 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:19.871+0000 7f38c2a00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f38c410a160 0x7f38c41a8a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:26:19.873 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:19.871+0000 7f38c2a00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f38c410a160 0x7f38c41a8a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.50:59946/0 (socket says 172.21.15.50:59946) 2024-08-31T04:26:19.873 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:19.871+0000 7f38c2a00640 1 -- 172.21.15.50:0/1359213974 learned_addr learned my addr 172.21.15.50:0/1359213974 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:26:19.873 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:19.871+0000 7f38c3e00640 1 --2- 172.21.15.50:0/1359213974 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f38c410cac0 0x7f38c41a90d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:26:19.873 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:19.872+0000 7f38c2000640 1 --2- 172.21.15.50:0/1359213974 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f38c410cac0 0x7f38c41a90d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:26:19.876 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:19.873+0000 7f38c3e00640 1 --2- 172.21.15.50:0/1359213974 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f38c410f5d0 0x7f38c41a9c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:26:19.878 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:19.873+0000 7f38c3400640 1 --2- 172.21.15.50:0/1359213974 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f38c410f5d0 0x7f38c41a9c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:26:19.878 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:19.873+0000 7f38c3e00640 1 -- 172.21.15.50:0/1359213974 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f38c411dde0 con 0x7f38c410f5d0 2024-08-31T04:26:19.878 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:19.873+0000 7f38c3e00640 1 -- 172.21.15.50:0/1359213974 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f38c411dc60 con 0x7f38c410a160 2024-08-31T04:26:19.878 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:19.873+0000 7f38c3e00640 1 -- 172.21.15.50:0/1359213974 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f38c411df60 con 0x7f38c410cac0 2024-08-31T04:26:19.878 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:19.874+0000 7f38c2a00640 1 -- 172.21.15.50:0/1359213974 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f38c410cac0 msgr2=0x7f38c41a90d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:26:19.878 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:19.874+0000 7f38c2a00640 1 --2- 172.21.15.50:0/1359213974 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f38c410cac0 0x7f38c41a90d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:19.879 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:19.874+0000 7f38c2a00640 1 -- 172.21.15.50:0/1359213974 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f38c410f5d0 msgr2=0x7f38c41a9c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:26:19.879 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:19.874+0000 7f38c2a00640 1 --2- 172.21.15.50:0/1359213974 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f38c410f5d0 0x7f38c41a9c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:19.880 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:19.874+0000 7f38c2a00640 1 -- 172.21.15.50:0/1359213974 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38c41aa4a0 con 0x7f38c410a160 2024-08-31T04:26:19.880 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:19.875+0000 7f38c3400640 1 --2- 172.21.15.50:0/1359213974 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f38c410f5d0 0x7f38c41a9c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:26:19.880 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:19.875+0000 7f38c2a00640 1 --2- 172.21.15.50:0/1359213974 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f38c410a160 0x7f38c41a8a60 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f38b000b450 tx=0x7f38b000b910 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:26:19.880 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:19.876+0000 7f38c8a00640 1 -- 172.21.15.50:0/1359213974 <== mon.2 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38b0025070 con 0x7f38c410a160 2024-08-31T04:26:19.880 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:19.876+0000 7f38c8a00640 1 -- 172.21.15.50:0/1359213974 <== mon.2 v2:172.21.15.133:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f38b0021cb0 con 0x7f38c410a160 2024-08-31T04:26:19.880 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:19.876+0000 7f38c8a00640 1 -- 172.21.15.50:0/1359213974 <== mon.2 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38b0028d90 con 0x7f38c410a160 2024-08-31T04:26:19.880 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:19.876+0000 7f38c3e00640 1 -- 172.21.15.50:0/1359213974 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f38c41aa790 con 0x7f38c410a160 2024-08-31T04:26:19.880 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:19.876+0000 7f38c3e00640 1 -- 172.21.15.50:0/1359213974 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f38c4111af0 con 0x7f38c410a160 2024-08-31T04:26:19.929 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:19.912+0000 7f38c8a00640 1 -- 172.21.15.50:0/1359213974 <== mon.2 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 18) ==== 152577+0+0 (secure 0 0 0) 0x7f38b0028070 con 0x7f38c410a160 2024-08-31T04:26:19.929 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:19.914+0000 7f38c8a00640 1 --2- 172.21.15.50:0/1359213974 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f38a80b4d40 0x7f38a80b7250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:26:19.929 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:19.923+0000 7f38c2000640 1 --2- 172.21.15.50:0/1359213974 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f38a80b4d40 0x7f38a80b7250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:26:19.930 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:19.928+0000 7f38c8a00640 1 -- 172.21.15.50:0/1359213974 <== mon.2 v2:172.21.15.133:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8219+0+0 (secure 0 0 0) 0x7f38b00f6590 con 0x7f38c410a160 2024-08-31T04:26:19.930 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:19.928+0000 7f38d1029740 1 Processor -- start 2024-08-31T04:26:19.930 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:19.929+0000 7f38c2000640 1 --2- 172.21.15.50:0/1359213974 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f38a80b4d40 0x7f38a80b7250 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f38bc009f90 tx=0x7f38bc0094d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:26:19.943 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:19.941+0000 7f38d1029740 1 -- start start 2024-08-31T04:26:19.943 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:19.941+0000 7f38d1029740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x564c8b2a11b0 0x564c8b646fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:26:19.943 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:19.941+0000 7f38d1029740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x564c8b2782f0 0x564c8b647610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:26:19.943 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:19.941+0000 7f38d1029740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564c8b2804d0 0x564c8b648160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:26:19.943 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:19.941+0000 7f38d1029740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x564c8b5b9f70 con 0x564c8b2804d0 2024-08-31T04:26:19.943 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:19.941+0000 7f38d1029740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x564c8b5a9500 con 0x564c8b2782f0 2024-08-31T04:26:19.943 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:19.941+0000 7f38d1029740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x564c8b5ad4b0 con 0x564c8b2a11b0 2024-08-31T04:26:19.946 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:19.942+0000 7f38c3400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564c8b2804d0 0x564c8b648160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:26:19.946 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:19.942+0000 7f38c3400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564c8b2804d0 0x564c8b648160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:39368/0 (socket says 172.21.15.50:39368) 2024-08-31T04:26:19.946 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:19.943+0000 7f38c3400640 1 -- 172.21.15.50:0/3009952619 learned_addr learned my addr 172.21.15.50:0/3009952619 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:26:19.946 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:19.943+0000 7f38c3400640 1 -- 172.21.15.50:0/3009952619 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x564c8b2a11b0 msgr2=0x564c8b646fa0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-31T04:26:19.946 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:19.943+0000 7f38c3400640 1 --2- 172.21.15.50:0/3009952619 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x564c8b2a11b0 0x564c8b646fa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:19.946 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:19.943+0000 7f38c3400640 1 -- 172.21.15.50:0/3009952619 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x564c8b2782f0 msgr2=0x564c8b647610 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-31T04:26:19.946 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:19.943+0000 7f38c3400640 1 --2- 172.21.15.50:0/3009952619 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x564c8b2782f0 0x564c8b647610 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:19.947 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:19.943+0000 7f38c3400640 1 -- 172.21.15.50:0/3009952619 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564c8b563c10 con 0x564c8b2804d0 2024-08-31T04:26:19.947 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:19.944+0000 7f38c3400640 1 --2- 172.21.15.50:0/3009952619 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564c8b2804d0 0x564c8b648160 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f38b4009900 tx=0x7f38b4004360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b8a255be70da0f7 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:26:19.947 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:19.945+0000 7f38afe00640 1 -- 172.21.15.50:0/3009952619 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38b4035030 con 0x564c8b2804d0 2024-08-31T04:26:19.948 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:19.946+0000 7f38afe00640 1 -- 172.21.15.50:0/3009952619 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f38b4003ca0 con 0x564c8b2804d0 2024-08-31T04:26:19.948 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:19.946+0000 7f38afe00640 1 -- 172.21.15.50:0/3009952619 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38b4031e30 con 0x564c8b2804d0 2024-08-31T04:26:19.952 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:19.947+0000 7f38d1029740 1 -- 172.21.15.50:0/3009952619 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564c8b2804d0 msgr2=0x564c8b648160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:26:19.952 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:19.947+0000 7f38d1029740 1 --2- 172.21.15.50:0/3009952619 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564c8b2804d0 0x564c8b648160 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f38b4009900 tx=0x7f38b4004360 comp rx=0 tx=0).stop 2024-08-31T04:26:19.960 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:19.959+0000 7f38d1029740 1 -- 172.21.15.50:0/3009952619 shutdown_connections 2024-08-31T04:26:19.960 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:19.959+0000 7f38d1029740 1 --2- 172.21.15.50:0/3009952619 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564c8b2804d0 0x564c8b648160 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:19.960 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:19.959+0000 7f38d1029740 1 --2- 172.21.15.50:0/3009952619 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x564c8b2782f0 0x564c8b647610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:19.961 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:19.959+0000 7f38d1029740 1 --2- 172.21.15.50:0/3009952619 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x564c8b2a11b0 0x564c8b646fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:19.961 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:19.959+0000 7f38d1029740 1 -- 172.21.15.50:0/3009952619 >> 172.21.15.50:0/3009952619 conn(0x564c8b295300 msgr2=0x564c8b642a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:26:19.962 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:19.959+0000 7f38d1029740 1 -- 172.21.15.50:0/3009952619 shutdown_connections 2024-08-31T04:26:19.962 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:19.959+0000 7f38d1029740 1 -- 172.21.15.50:0/3009952619 wait complete. 2024-08-31T04:26:19.962 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:19.960+0000 7f38d1029740 1 -- start start 2024-08-31T04:26:19.962 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:19.960+0000 7f38d1029740 1 Processor -- start 2024-08-31T04:26:19.971 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:19.965+0000 7f38d1029740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564c8b2782f0 0x564c8b6506c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:26:19.971 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:19.966+0000 7f38c2a00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564c8b2782f0 0x564c8b6506c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:26:19.972 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:19.966+0000 7f38c2a00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564c8b2782f0 0x564c8b6506c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:39384/0 (socket says 172.21.15.50:39384) 2024-08-31T04:26:19.972 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:19.966+0000 7f38c2a00640 1 -- 172.21.15.50:0/793602818 learned_addr learned my addr 172.21.15.50:0/793602818 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:26:19.972 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:19.966+0000 7f38d1029740 1 --2- 172.21.15.50:0/793602818 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x564c8b2804d0 0x564c8b650d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:26:19.972 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:19.967+0000 7f38d1029740 1 --2- 172.21.15.50:0/793602818 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x564c8b2a11b0 0x564c8b6518f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:26:19.972 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:19.967+0000 7f38c2000640 1 --2- 172.21.15.50:0/793602818 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x564c8b2804d0 0x564c8b650d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:26:19.972 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:19.967+0000 7f38d1029740 1 -- 172.21.15.50:0/793602818 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x564c8b4e2ab0 con 0x564c8b2782f0 2024-08-31T04:26:19.972 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:19.967+0000 7f38d1029740 1 -- 172.21.15.50:0/793602818 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x564c8b550320 con 0x564c8b2a11b0 2024-08-31T04:26:19.972 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:19.967+0000 7f38d1029740 1 -- 172.21.15.50:0/793602818 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x564c8b648c20 con 0x564c8b2804d0 2024-08-31T04:26:19.972 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:19.968+0000 7f38c2a00640 1 -- 172.21.15.50:0/793602818 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x564c8b2804d0 msgr2=0x564c8b650d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:26:19.972 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:19.968+0000 7f38c2a00640 1 --2- 172.21.15.50:0/793602818 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x564c8b2804d0 0x564c8b650d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:19.972 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:19.968+0000 7f38c2a00640 1 -- 172.21.15.50:0/793602818 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x564c8b2a11b0 msgr2=0x564c8b6518f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-31T04:26:19.972 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:19.968+0000 7f38c2a00640 1 --2- 172.21.15.50:0/793602818 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x564c8b2a11b0 0x564c8b6518f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:19.973 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:19.968+0000 7f38c2a00640 1 -- 172.21.15.50:0/793602818 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564c8b30c790 con 0x564c8b2782f0 2024-08-31T04:26:19.973 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:19.969+0000 7f38d1029740 10 client.0 _ll_register_callbacks cb 0x564c8b5566a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:26:19.973 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:19.969+0000 7f38d1029740 1 -- 172.21.15.50:0/793602818 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f38b4003ca0 con 0x564c8b2782f0 2024-08-31T04:26:19.975 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:19.971+0000 7f38c2a00640 1 --2- 172.21.15.50:0/793602818 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564c8b2782f0 0x564c8b6506c0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f38b0004790 tx=0x7f38b00bd590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65d3c704ce10857e server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:26:20.018 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:19.999+0000 7f38acc00640 10 client.15720 ms_handle_connect on v2:172.21.15.50:3300/0 2024-08-31T04:26:20.018 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:19.999+0000 7f38acc00640 1 -- 172.21.15.50:0/793602818 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38b0021e60 con 0x564c8b2782f0 2024-08-31T04:26:20.018 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:19.999+0000 7f38acc00640 1 -- 172.21.15.50:0/793602818 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8219+0+0 (secure 0 0 0) 0x7f38b00f62f0 con 0x564c8b2782f0 2024-08-31T04:26:20.018 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:19.999+0000 7f38acc00640 1 -- 172.21.15.50:0/793602818 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f38b002f040 con 0x564c8b2782f0 2024-08-31T04:26:20.061 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:20.048+0000 7f38d1029740 10 client.15720 fetch_fsmap learned FSMap version 33 2024-08-31T04:26:20.061 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:20.048+0000 7f38d1029740 1 -- 172.21.15.50:0/793602818 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({fsmap=33}) -- 0x564c8b385620 con 0x564c8b2782f0 2024-08-31T04:26:20.081 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:20.079+0000 7f38acc00640 1 -- 172.21.15.50:0/793602818 <== mon.0 v2:172.21.15.50:3300/0 4 ==== fsmap(e 33) ==== 8378+0+0 (secure 0 0 0) 0x7f38b00c1440 con 0x564c8b2782f0 2024-08-31T04:26:20.082 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:20.080+0000 7f38d1029740 10 client.15720 fetch_fsmap finished waiting for FSMap version 33 2024-08-31T04:26:20.082 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:20.080+0000 7f38d1029740 10 client.15720 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T04:26:20.082 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:20.080+0000 7f38d1029740 20 client.15720 populate_metadata read hostname 'smithi050' 2024-08-31T04:26:20.082 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:20.080+0000 7f38d1029740 1 --2- 172.21.15.50:0/793602818 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x564c8b25fd80 0x564c8b67fde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:26:20.082 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:20.080+0000 7f38d1029740 4 client.15720 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T04:26:20.082 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:20.080+0000 7f38d1029740 1 -- 172.21.15.50:0/793602818 --> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564c8b5bbec0 con 0x564c8b25fd80 2024-08-31T04:26:20.122 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:20.120+0000 7f38c2000640 1 --2- 172.21.15.50:0/793602818 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x564c8b25fd80 0x564c8b67fde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:26:20.144 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:20.141+0000 7f38c2000640 1 --2- 172.21.15.50:0/793602818 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x564c8b25fd80 0x564c8b67fde0 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b31406d3034ab6df server_cookie=6921f598c47fbbaa in_seq=0 out_seq=0 2024-08-31T04:26:20.151 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:20.145+0000 7f38acc00640 10 client.15720 ms_handle_connect on v2:172.21.15.133:6838/2526402262 2024-08-31T04:26:20.151 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:20.145+0000 7f38acc00640 1 -- 172.21.15.50:0/793602818 <== mds.0 v2:172.21.15.133:6838/2526402262 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x564c8b5bbec0 con 0x564c8b25fd80 2024-08-31T04:26:20.151 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:20.145+0000 7f38acc00640 10 client.15720 handle_command_reply: tid=0 2024-08-31T04:26:20.151 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:20.145+0000 7f38d1029740 1 client.15720 shutdown 2024-08-31T04:26:20.203 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:20.199+0000 7f38d1029740 1 -- 172.21.15.50:0/793602818 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564c8b2782f0 msgr2=0x564c8b6506c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:26:20.203 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:20.199+0000 7f38d1029740 1 --2- 172.21.15.50:0/793602818 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564c8b2782f0 0x564c8b6506c0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f38b0004790 tx=0x7f38b00bd590 comp rx=0 tx=0).stop 2024-08-31T04:26:20.289 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:20.286+0000 7f38d1029740 1 -- 172.21.15.50:0/793602818 shutdown_connections 2024-08-31T04:26:20.289 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:20.286+0000 7f38d1029740 1 --2- 172.21.15.50:0/793602818 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x564c8b25fd80 0x564c8b67fde0 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:20.289 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:20.286+0000 7f38d1029740 1 --2- 172.21.15.50:0/793602818 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x564c8b2804d0 0x564c8b650d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:20.289 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:20.286+0000 7f38d1029740 1 --2- 172.21.15.50:0/793602818 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x564c8b2a11b0 0x564c8b6518f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:20.289 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:20.286+0000 7f38d1029740 1 --2- 172.21.15.50:0/793602818 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564c8b2782f0 0x564c8b6506c0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:20.289 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:20.286+0000 7f38d1029740 1 -- 172.21.15.50:0/793602818 >> 172.21.15.50:0/793602818 conn(0x564c8b295300 msgr2=0x564c8b640f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:26:20.299 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:20.298+0000 7f38acc00640 0 client.15720 ms_handle_reset on v2:172.21.15.133:6838/2526402262 2024-08-31T04:26:20.300 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:20.299+0000 7f38d1029740 1 -- 172.21.15.50:0/793602818 shutdown_connections 2024-08-31T04:26:20.321 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:20.316+0000 7f38d1029740 1 -- 172.21.15.50:0/793602818 wait complete. 2024-08-31T04:26:20.332 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:20.324+0000 7f38d1029740 20 client.15720 trim_cache size 0 max 16384 2024-08-31T04:26:20.909 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:20.904+0000 7f38d1029740 1 Processor -- start 2024-08-31T04:26:20.910 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:20.908+0000 7f38d1029740 1 -- start start 2024-08-31T04:26:20.910 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:20.908+0000 7f38d1029740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x564c8b2782f0 0x564c8b64bab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:26:20.910 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:20.909+0000 7f38d1029740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x564c8b2804d0 0x564c8b64c540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:26:20.910 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:20.909+0000 7f38c2a00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x564c8b2782f0 0x564c8b64bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:26:20.910 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:20.909+0000 7f38c2a00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x564c8b2782f0 0x564c8b64bab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.50:40540/0 (socket says 172.21.15.50:40540) 2024-08-31T04:26:20.911 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:20.910+0000 7f38d1029740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564c8b2a11b0 0x564c8b64ca80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:26:20.911 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:20.910+0000 7f38d1029740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f38a400e4b0 con 0x564c8b2a11b0 2024-08-31T04:26:20.912 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:20.910+0000 7f38d1029740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f38a40100b0 con 0x564c8b2804d0 2024-08-31T04:26:20.912 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:20.910+0000 7f38d1029740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f38a400eb80 con 0x564c8b2782f0 2024-08-31T04:26:20.912 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:20.910+0000 7f38c2a00640 1 -- 172.21.15.50:0/3030747551 learned_addr learned my addr 172.21.15.50:0/3030747551 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:26:20.912 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:20.910+0000 7f38c2000640 1 --2- 172.21.15.50:0/3030747551 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x564c8b2804d0 0x564c8b64c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:26:20.913 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:20.912+0000 7f38c2a00640 1 -- 172.21.15.50:0/3030747551 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x564c8b2804d0 msgr2=0x564c8b64c540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:26:20.913 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:20.912+0000 7f38c2a00640 1 --2- 172.21.15.50:0/3030747551 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x564c8b2804d0 0x564c8b64c540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:20.913 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:20.912+0000 7f38c2a00640 1 -- 172.21.15.50:0/3030747551 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564c8b2a11b0 msgr2=0x564c8b64ca80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:26:20.913 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:20.912+0000 7f38c2a00640 1 --2- 172.21.15.50:0/3030747551 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564c8b2a11b0 0x564c8b64ca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:20.913 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:20.912+0000 7f38c2a00640 1 -- 172.21.15.50:0/3030747551 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564c8b64cfc0 con 0x564c8b2782f0 2024-08-31T04:26:20.922 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:20.921+0000 7f38c2a00640 1 --2- 172.21.15.50:0/3030747551 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x564c8b2782f0 0x564c8b64bab0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f38b0009fd0 tx=0x7f38b00b8f60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=507856e4574164b1 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:26:20.942 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:20.940+0000 7f38af400640 1 -- 172.21.15.50:0/3030747551 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38b00f3f80 con 0x564c8b2782f0 2024-08-31T04:26:20.942 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:20.941+0000 7f38af400640 1 -- 172.21.15.50:0/3030747551 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f38b4003ca0 con 0x564c8b2782f0 2024-08-31T04:26:20.942 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:20.941+0000 7f38af400640 1 -- 172.21.15.50:0/3030747551 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38b00a8280 con 0x564c8b2782f0 2024-08-31T04:26:20.952 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:20.951+0000 7f38d1029740 1 -- 172.21.15.50:0/3030747551 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x564c8b2782f0 msgr2=0x564c8b64bab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:26:20.952 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:20.951+0000 7f38d1029740 1 --2- 172.21.15.50:0/3030747551 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x564c8b2782f0 0x564c8b64bab0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f38b0009fd0 tx=0x7f38b00b8f60 comp rx=0 tx=0).stop 2024-08-31T04:26:20.971 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:20.969+0000 7f38d1029740 1 -- 172.21.15.50:0/3030747551 shutdown_connections 2024-08-31T04:26:20.971 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:20.969+0000 7f38d1029740 1 --2- 172.21.15.50:0/3030747551 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564c8b2a11b0 0x564c8b64ca80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:20.971 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:20.969+0000 7f38d1029740 1 --2- 172.21.15.50:0/3030747551 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x564c8b2804d0 0x564c8b64c540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:20.971 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:20.969+0000 7f38d1029740 1 --2- 172.21.15.50:0/3030747551 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x564c8b2782f0 0x564c8b64bab0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:20.971 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:20.969+0000 7f38d1029740 1 -- 172.21.15.50:0/3030747551 >> 172.21.15.50:0/3030747551 conn(0x564c8b295300 msgr2=0x564c8b642e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:26:20.983 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:20.981+0000 7f38d1029740 1 -- 172.21.15.50:0/3030747551 shutdown_connections 2024-08-31T04:26:20.986 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:20.983+0000 7f38d1029740 1 -- 172.21.15.50:0/3030747551 wait complete. 2024-08-31T04:26:20.986 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:20.984+0000 7f38d1029740 1 -- start start 2024-08-31T04:26:20.986 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:20.984+0000 7f38d1029740 1 Processor -- start 2024-08-31T04:26:20.994 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:20.985+0000 7f38d1029740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564c8b2782f0 0x564c8b6e2a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:26:20.994 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:20.992+0000 7f38d1029740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x564c8b2804d0 0x564c8b6e3130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:26:20.994 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:20.992+0000 7f38d1029740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x564c8b2a11b0 0x564c8b6e38e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:26:20.994 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:20.992+0000 7f38c2a00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564c8b2782f0 0x564c8b6e2a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:26:20.994 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:20.992+0000 7f38c2a00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564c8b2782f0 0x564c8b6e2a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:39408/0 (socket says 172.21.15.50:39408) 2024-08-31T04:26:20.994 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:20.992+0000 7f38c2000640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x564c8b2804d0 0x564c8b6e3130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:26:20.994 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:20.992+0000 7f38c2000640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x564c8b2804d0 0x564c8b6e3130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.50:59964/0 (socket says 172.21.15.50:59964) 2024-08-31T04:26:20.996 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:20.994+0000 7f38c3400640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x564c8b2a11b0 0x564c8b6e38e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:26:20.996 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:20.995+0000 7f38c3400640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x564c8b2a11b0 0x564c8b6e38e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.50:40550/0 (socket says 172.21.15.50:40550) 2024-08-31T04:26:20.997 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:20.996+0000 7f38c2a00640 1 -- 172.21.15.50:0/497208970 learned_addr learned my addr 172.21.15.50:0/497208970 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:26:20.998 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:20.997+0000 7f38d1029740 1 -- 172.21.15.50:0/497208970 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f38a400f9e0 con 0x564c8b2782f0 2024-08-31T04:26:20.999 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:20.998+0000 7f38d1029740 1 -- 172.21.15.50:0/497208970 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f38a400f250 con 0x564c8b2804d0 2024-08-31T04:26:20.999 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:20.998+0000 7f38d1029740 1 -- 172.21.15.50:0/497208970 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f38a400c490 con 0x564c8b2a11b0 2024-08-31T04:26:21.003 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:21.000+0000 7f38c2a00640 1 -- 172.21.15.50:0/497208970 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x564c8b2a11b0 msgr2=0x564c8b6e38e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:26:21.004 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:21.000+0000 7f38c2a00640 1 --2- 172.21.15.50:0/497208970 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x564c8b2a11b0 0x564c8b6e38e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:21.006 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:21.000+0000 7f38c2a00640 1 -- 172.21.15.50:0/497208970 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x564c8b2804d0 msgr2=0x564c8b6e3130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:26:21.006 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:21.000+0000 7f38c2a00640 1 --2- 172.21.15.50:0/497208970 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x564c8b2804d0 0x564c8b6e3130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:21.006 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:21.000+0000 7f38c2a00640 1 -- 172.21.15.50:0/497208970 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564c8b6e4040 con 0x564c8b2782f0 2024-08-31T04:26:21.006 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:21.001+0000 7f38c2000640 1 --2- 172.21.15.50:0/497208970 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x564c8b2804d0 0x564c8b6e3130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T04:26:21.007 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:21.002+0000 7f38c3400640 1 --2- 172.21.15.50:0/497208970 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x564c8b2a11b0 0x564c8b6e38e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T04:26:21.007 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:21.002+0000 7f38c2a00640 1 --2- 172.21.15.50:0/497208970 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564c8b2782f0 0x564c8b6e2a70 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f38b00b9510 tx=0x7f38b0021a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e909cf3de1e66319 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:26:21.007 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:21.004+0000 7f38d1029740 10 client.0 _ll_register_callbacks cb 0x7f38b00bc770 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:26:21.007 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:21.004+0000 7f38d1029740 1 -- 172.21.15.50:0/497208970 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f38b4003ca0 con 0x564c8b2782f0 2024-08-31T04:26:21.007 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:21.005+0000 7f38acc00640 10 client.15723 ms_handle_connect on v2:172.21.15.50:3300/0 2024-08-31T04:26:21.007 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:21.005+0000 7f38acc00640 1 -- 172.21.15.50:0/497208970 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38b00c6290 con 0x564c8b2782f0 2024-08-31T04:26:21.007 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:21.005+0000 7f38acc00640 1 -- 172.21.15.50:0/497208970 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8219+0+0 (secure 0 0 0) 0x7f38b00f62f0 con 0x564c8b2782f0 2024-08-31T04:26:21.009 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:21.005+0000 7f38acc00640 1 -- 172.21.15.50:0/497208970 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f38b00cd050 con 0x564c8b2782f0 2024-08-31T04:26:21.013 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:21.011+0000 7f38d1029740 10 client.15723 fetch_fsmap learned FSMap version 33 2024-08-31T04:26:21.013 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:21.011+0000 7f38d1029740 1 -- 172.21.15.50:0/497208970 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({fsmap=33}) -- 0x564c8b6eafc0 con 0x564c8b2782f0 2024-08-31T04:26:21.020 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:21.018+0000 7f38acc00640 1 -- 172.21.15.50:0/497208970 <== mon.0 v2:172.21.15.50:3300/0 4 ==== fsmap(e 33) ==== 8378+0+0 (secure 0 0 0) 0x7f38b00d2440 con 0x564c8b2782f0 2024-08-31T04:26:21.021 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:21.018+0000 7f38d1029740 10 client.15723 fetch_fsmap finished waiting for FSMap version 33 2024-08-31T04:26:21.021 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:21.018+0000 7f38d1029740 10 client.15723 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T04:26:21.021 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:21.018+0000 7f38d1029740 20 client.15723 populate_metadata read hostname 'smithi050' 2024-08-31T04:26:21.021 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:21.018+0000 7f38d1029740 1 --2- 172.21.15.50:0/497208970 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x564c8b2351c0 0x564c8b6ed950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:26:21.022 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:21.018+0000 7f38d1029740 4 client.15723 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-31T04:26:21.022 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:21.018+0000 7f38d1029740 1 -- 172.21.15.50:0/497208970 --> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] -- command(tid 0: {"prefix": "flush journal"}) -- 0x7f38b4003ca0 con 0x564c8b2351c0 2024-08-31T04:26:21.043 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:21.036+0000 7f38c2000640 1 --2- 172.21.15.50:0/497208970 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x564c8b2351c0 0x564c8b6ed950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:26:21.044 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:21.042+0000 7f38c2000640 1 --2- 172.21.15.50:0/497208970 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x564c8b2351c0 0x564c8b6ed950 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9b8667d2bbfe2c1 server_cookie=107e65e972b04491 in_seq=0 out_seq=0 2024-08-31T04:26:21.044 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:21.042+0000 7f38acc00640 10 client.15723 ms_handle_connect on v2:172.21.15.133:6838/2526402262 2024-08-31T04:26:21.386 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:26:21 smithi050 ceph-mon[17259]: pgmap v471: 97 pgs: 97 active+clean; 261 MiB data, 788 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 3.1 MiB/s wr, 220 op/s 2024-08-31T04:26:21.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:26:21 smithi177 ceph-mon[22025]: pgmap v471: 97 pgs: 97 active+clean; 261 MiB data, 788 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 3.1 MiB/s wr, 220 op/s 2024-08-31T04:26:21.792 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:26:21 smithi133 ceph-mon[22177]: pgmap v471: 97 pgs: 97 active+clean; 261 MiB data, 788 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 3.1 MiB/s wr, 220 op/s 2024-08-31T04:26:21.803 INFO:tasks.quiescer.fs.[cephfs]:Total duration (43.6) is longer than `split_if_longer` (35.0), will split into two consecutive quiesces 2024-08-31T04:26:21.803 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 21.8 2024-08-31T04:26:21.804 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 058d9fc6-674f-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-31T04:26:23.365 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:26:23.451 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:26:23 smithi050 ceph-mon[17259]: pgmap v472: 97 pgs: 97 active+clean; 294 MiB data, 789 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 6.2 MiB/s wr, 380 op/s 2024-08-31T04:26:23.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:26:23 smithi177 ceph-mon[22025]: pgmap v472: 97 pgs: 97 active+clean; 294 MiB data, 789 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 6.2 MiB/s wr, 380 op/s 2024-08-31T04:26:23.792 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:26:23 smithi133 ceph-mon[22177]: pgmap v472: 97 pgs: 97 active+clean; 294 MiB data, 789 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 6.2 MiB/s wr, 380 op/s 2024-08-31T04:26:24.101 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:24.098+0000 7f38acc00640 1 -- 172.21.15.50:0/497208970 <== mds.0 v2:172.21.15.133:6838/2526402262 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x7f38b4003ca0 con 0x564c8b2351c0 2024-08-31T04:26:24.101 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:24.100+0000 7f38acc00640 10 client.15723 handle_command_reply: tid=0 2024-08-31T04:26:24.102 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:24.100+0000 7f38d1029740 1 client.15723 shutdown 2024-08-31T04:26:24.103 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:24.101+0000 7f38d1029740 1 -- 172.21.15.50:0/497208970 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564c8b2782f0 msgr2=0x564c8b6e2a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:26:24.103 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:24.101+0000 7f38d1029740 1 --2- 172.21.15.50:0/497208970 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564c8b2782f0 0x564c8b6e2a70 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f38b00b9510 tx=0x7f38b0021a30 comp rx=0 tx=0).stop 2024-08-31T04:26:24.103 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:24.102+0000 7f38d1029740 1 -- 172.21.15.50:0/497208970 shutdown_connections 2024-08-31T04:26:24.103 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:24.102+0000 7f38d1029740 1 --2- 172.21.15.50:0/497208970 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x564c8b2351c0 0x564c8b6ed950 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:24.104 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:24.102+0000 7f38d1029740 1 --2- 172.21.15.50:0/497208970 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x564c8b2a11b0 0x564c8b6e38e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:24.104 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:24.102+0000 7f38d1029740 1 --2- 172.21.15.50:0/497208970 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x564c8b2804d0 0x564c8b6e3130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:24.104 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:24.102+0000 7f38d1029740 1 --2- 172.21.15.50:0/497208970 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564c8b2782f0 0x564c8b6e2a70 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:24.104 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:24.102+0000 7f38d1029740 1 -- 172.21.15.50:0/497208970 >> 172.21.15.50:0/497208970 conn(0x564c8b295300 msgr2=0x564c8b64d5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:26:24.104 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:24.102+0000 7f38acc00640 0 client.15723 ms_handle_reset on v2:172.21.15.133:6838/2526402262 2024-08-31T04:26:24.104 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:24.103+0000 7f38d1029740 1 -- 172.21.15.50:0/497208970 shutdown_connections 2024-08-31T04:26:24.104 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:24.103+0000 7f38d1029740 1 -- 172.21.15.50:0/497208970 wait complete. 2024-08-31T04:26:24.104 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:24.103+0000 7f38d1029740 20 client.15723 trim_cache size 0 max 16384 2024-08-31T04:26:24.108 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout:{ 2024-08-31T04:26:24.108 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout: "message": "", 2024-08-31T04:26:24.108 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout: "return_code": 0 2024-08-31T04:26:24.108 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout:} 2024-08-31T04:26:24.108 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:24.107+0000 7f38c3e00640 1 -- 172.21.15.50:0/1359213974 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f38a80b4d40 msgr2=0x7f38a80b7250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:26:24.109 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:24.107+0000 7f38c3e00640 1 --2- 172.21.15.50:0/1359213974 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f38a80b4d40 0x7f38a80b7250 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f38bc009f90 tx=0x7f38bc0094d0 comp rx=0 tx=0).stop 2024-08-31T04:26:24.109 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:24.107+0000 7f38c3e00640 1 -- 172.21.15.50:0/1359213974 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f38c410a160 msgr2=0x7f38c41a8a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:26:24.109 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:24.107+0000 7f38c3e00640 1 --2- 172.21.15.50:0/1359213974 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f38c410a160 0x7f38c41a8a60 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f38b000b450 tx=0x7f38b000b910 comp rx=0 tx=0).stop 2024-08-31T04:26:24.109 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:24.107+0000 7f38c3e00640 1 -- 172.21.15.50:0/1359213974 shutdown_connections 2024-08-31T04:26:24.109 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:24.107+0000 7f38c3e00640 1 --2- 172.21.15.50:0/1359213974 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f38a80b4d40 0x7f38a80b7250 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:24.109 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:24.107+0000 7f38c3e00640 1 --2- 172.21.15.50:0/1359213974 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f38c410cac0 0x7f38c41a90d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:24.109 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:24.107+0000 7f38c3e00640 1 --2- 172.21.15.50:0/1359213974 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f38c410f5d0 0x7f38c41a9c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:24.110 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:24.107+0000 7f38c3e00640 1 --2- 172.21.15.50:0/1359213974 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f38c410a160 0x7f38c41a8a60 secure :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f38b000b450 tx=0x7f38b000b910 comp rx=0 tx=0).stop 2024-08-31T04:26:24.110 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:24.107+0000 7f38c3e00640 1 -- 172.21.15.50:0/1359213974 >> 172.21.15.50:0/1359213974 conn(0x7f38c40703e0 msgr2=0x7f38c410b030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:26:24.110 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:24.108+0000 7f38c3e00640 1 -- 172.21.15.50:0/1359213974 shutdown_connections 2024-08-31T04:26:24.110 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:24.108+0000 7f38c3e00640 1 -- 172.21.15.50:0/1359213974 wait complete. 2024-08-31T04:26:25.076 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:26:25.051+0000 7fdff0800640 1 -- 172.21.15.50:0/2517245902 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdfe8103910 msgr2=0x7fdfe8103d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:26:25.076 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:26:25.051+0000 7fdff0800640 1 --2- 172.21.15.50:0/2517245902 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdfe8103910 0x7fdfe8103d20 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fdfd8009900 tx=0x7fdfd802a420 comp rx=0 tx=0).stop 2024-08-31T04:26:25.077 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:26:25.051+0000 7fdff0800640 1 -- 172.21.15.50:0/2517245902 shutdown_connections 2024-08-31T04:26:25.077 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:26:25.051+0000 7fdff0800640 1 --2- 172.21.15.50:0/2517245902 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdfe8109250 0x7fdfe8109660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:25.077 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:26:25.051+0000 7fdff0800640 1 --2- 172.21.15.50:0/2517245902 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdfe8109ba0 0x7fdfe81103d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:25.077 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:26:25.051+0000 7fdff0800640 1 --2- 172.21.15.50:0/2517245902 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdfe8103910 0x7fdfe8103d20 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:25.077 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:26:25.051+0000 7fdff0800640 1 -- 172.21.15.50:0/2517245902 >> 172.21.15.50:0/2517245902 conn(0x7fdfe80ff380 msgr2=0x7fdfe81017d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:26:25.077 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:26:25.053+0000 7fdff0800640 1 -- 172.21.15.50:0/2517245902 shutdown_connections 2024-08-31T04:26:25.077 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:26:25.053+0000 7fdff0800640 1 -- 172.21.15.50:0/2517245902 wait complete. 2024-08-31T04:26:25.077 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:26:25.054+0000 7fdff0800640 1 Processor -- start 2024-08-31T04:26:25.077 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:26:25.055+0000 7fdff0800640 1 -- start start 2024-08-31T04:26:25.077 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:26:25.055+0000 7fdff0800640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdfe8103910 0x7fdfe810e0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:26:25.077 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:26:25.055+0000 7fdff0800640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdfe8109250 0x7fdfe810a380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:26:25.078 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:26:25.055+0000 7fdff0800640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdfe8109ba0 0x7fdfe810aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:26:25.078 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:26:25.055+0000 7fdff0800640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fdfe81138f0 con 0x7fdfe8109250 2024-08-31T04:26:25.078 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:26:25.055+0000 7fdff0800640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7fdfe8113770 con 0x7fdfe8103910 2024-08-31T04:26:25.078 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:26:25.055+0000 7fdff0800640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fdfe8113a70 con 0x7fdfe8109ba0 2024-08-31T04:26:25.078 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:26:25.056+0000 7fdfede00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdfe8103910 0x7fdfe810e0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:26:25.078 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:26:25.056+0000 7fdfede00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdfe8103910 0x7fdfe810e0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.50:39998/0 (socket says 172.21.15.50:39998) 2024-08-31T04:26:25.078 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:26:25.056+0000 7fdfede00640 1 -- 172.21.15.50:0/1198341126 learned_addr learned my addr 172.21.15.50:0/1198341126 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:26:25.078 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:26:25.056+0000 7fdfede00640 1 -- 172.21.15.50:0/1198341126 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdfe8109ba0 msgr2=0x7fdfe810aaa0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-08-31T04:26:25.078 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:26:25.056+0000 7fdfede00640 1 --2- 172.21.15.50:0/1198341126 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdfe8109ba0 0x7fdfe810aaa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:25.078 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:26:25.056+0000 7fdfede00640 1 -- 172.21.15.50:0/1198341126 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdfe8109250 msgr2=0x7fdfe810a380 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-08-31T04:26:25.078 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:26:25.057+0000 7fdfed400640 1 --2- 172.21.15.50:0/1198341126 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdfe8109250 0x7fdfe810a380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:26:25.078 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:26:25.057+0000 7fdfede00640 1 --2- 172.21.15.50:0/1198341126 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdfe8109250 0x7fdfe810a380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:25.078 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:26:25.057+0000 7fdfede00640 1 -- 172.21.15.50:0/1198341126 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdfe819c210 con 0x7fdfe8103910 2024-08-31T04:26:25.079 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:26:25.057+0000 7fdfed400640 1 --2- 172.21.15.50:0/1198341126 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdfe8109250 0x7fdfe810a380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T04:26:25.079 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:26:25.061+0000 7fdfede00640 1 --2- 172.21.15.50:0/1198341126 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdfe8103910 0x7fdfe810e0a0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fdfd8005ab0 tx=0x7fdfd8003d50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:26:25.079 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:26:25.061+0000 7fdfe2a00640 1 -- 172.21.15.50:0/1198341126 <== mon.2 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfd803f070 con 0x7fdfe8103910 2024-08-31T04:26:25.079 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:26:25.062+0000 7fdfe2a00640 1 -- 172.21.15.50:0/1198341126 <== mon.2 v2:172.21.15.133:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdfd8031d60 con 0x7fdfe8103910 2024-08-31T04:26:25.079 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:26:25.062+0000 7fdff0800640 1 -- 172.21.15.50:0/1198341126 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdfe819c4a0 con 0x7fdfe8103910 2024-08-31T04:26:25.079 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:26:25.062+0000 7fdff0800640 1 -- 172.21.15.50:0/1198341126 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdfe819ca00 con 0x7fdfe8103910 2024-08-31T04:26:25.079 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:26:25.062+0000 7fdfe2a00640 1 -- 172.21.15.50:0/1198341126 <== mon.2 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfd8035030 con 0x7fdfe8103910 2024-08-31T04:26:25.079 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:26:25.065+0000 7fdff0800640 1 -- 172.21.15.50:0/1198341126 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdfcc0052c0 con 0x7fdfe8103910 2024-08-31T04:26:25.099 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:26:25.091+0000 7fdfe2a00640 1 -- 172.21.15.50:0/1198341126 <== mon.2 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 18) ==== 152577+0+0 (secure 0 0 0) 0x7fdfd8042070 con 0x7fdfe8103910 2024-08-31T04:26:25.099 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:26:25.093+0000 7fdfe2a00640 1 --2- 172.21.15.50:0/1198341126 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fdfd00b4c80 0x7fdfd00b7190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:26:25.099 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:26:25.094+0000 7fdfe2a00640 1 -- 172.21.15.50:0/1198341126 <== mon.2 v2:172.21.15.133:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8219+0+0 (secure 0 0 0) 0x7fdfd81055a0 con 0x7fdfe8103910 2024-08-31T04:26:25.099 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:26:25.095+0000 7fdfed400640 1 --2- 172.21.15.50:0/1198341126 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fdfd00b4c80 0x7fdfd00b7190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:26:25.122 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:26:25.096+0000 7fdfe2a00640 1 -- 172.21.15.50:0/1198341126 <== mon.2 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fdfd80cc6e0 con 0x7fdfe8103910 2024-08-31T04:26:25.122 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:26:25.097+0000 7fdfed400640 1 --2- 172.21.15.50:0/1198341126 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fdfd00b4c80 0x7fdfd00b7190 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fdfe81059c0 tx=0x7fdfdc008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:26:25.393 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:26:25 smithi050 ceph-mon[17259]: pgmap v473: 97 pgs: 97 active+clean; 314 MiB data, 831 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 7.0 MiB/s wr, 415 op/s 2024-08-31T04:26:25.454 INFO:tasks.workunit.client.0.smithi050.stdout: 121 529835 757 362776 775 123113 670 2024-08-31T04:26:25.620 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:26:25.618+0000 7fdff0800640 1 -- 172.21.15.50:0/1198341126 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fdfcc0055b0 con 0x7fdfe8103910 2024-08-31T04:26:25.621 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:26:25.619+0000 7fdfe2a00640 1 -- 172.21.15.50:0/1198341126 <== mon.2 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 33 v33) ==== 94+0+11993 (secure 0 0 0) 0x7fdfd80cbfe0 con 0x7fdfe8103910 2024-08-31T04:26:25.653 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-08-31T04:26:25.654 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":33,"btime":"2024-08-31T04:25:32:194673+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14622,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/1565557530","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":1565557530},{"type":"v1","addr":"172.21.15.50:6835","nonce":1565557530}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14634,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6837/2660185946","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6836","nonce":2660185946},{"type":"v1","addr":"172.21.15.50:6837","nonce":2660185946}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":33,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-31T04:20:44.140709+0000","modified":"2024-08-31T04:25:32.194656+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24695,"mds_1":24691,"mds_2":24667,"mds_3":24656,"mds_4":24652},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14676":{"gid":14676,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.50:6839/2105228685","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6838","nonce":2105228685},{"type":"v1","addr":"172.21.15.50:6839","nonce":2105228685}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24590":{"gid":24590,"name":"k","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.133:6833/4283603962","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6832","nonce":4283603962},{"type":"v1","addr":"172.21.15.133:6833","nonce":4283603962}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24601":{"gid":24601,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.177:6833/1237129793","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":1237129793},{"type":"v1","addr":"172.21.15.177:6833","nonce":1237129793}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24626":{"gid":24626,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.133:6835/3637799701","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":3637799701},{"type":"v1","addr":"172.21.15.133:6835","nonce":3637799701}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24652":{"gid":24652,"name":"c","rank":4,"incarnation":26,"state":"up:active","state_seq":13,"addr":"172.21.15.177:6837/2159859285","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6836","nonce":2159859285},{"type":"v1","addr":"172.21.15.177:6837","nonce":2159859285}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24656":{"gid":24656,"name":"h","rank":3,"incarnation":22,"state":"up:active","state_seq":12,"addr":"172.21.15.133:6837/4014853202","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6836","nonce":4014853202},{"type":"v1","addr":"172.21.15.133:6837","nonce":4014853202}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24667":{"gid":24667,"name":"i","rank":2,"incarnation":20,"state":"up:active","state_seq":10,"addr":"172.21.15.177:6839/3600081752","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6838","nonce":3600081752},{"type":"v1","addr":"172.21.15.177:6839","nonce":3600081752}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24691":{"gid":24691,"name":"a","rank":1,"incarnation":18,"state":"up:active","state_seq":8,"addr":"172.21.15.50:6841/575209862","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6840","nonce":575209862},{"type":"v1","addr":"172.21.15.50:6841","nonce":575209862}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24695":{"gid":24695,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.133:6839/2526402262","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6838","nonce":2526402262},{"type":"v1","addr":"172.21.15.133:6839","nonce":2526402262}]},"join_fscid":-1,"export_targets":[1,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_25699":{"gid":25699,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.177:6835/1048370411","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6834","nonce":1048370411},{"type":"v1","addr":"172.21.15.177:6835","nonce":1048370411}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24695,"qdb_cluster":[24652,24691,24656,24695,24667]},"id":1}]} 2024-08-31T04:26:25.654 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 33 2024-08-31T04:26:25.654 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:26:25.624+0000 7fdff0800640 1 -- 172.21.15.50:0/1198341126 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fdfd00b4c80 msgr2=0x7fdfd00b7190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:26:25.654 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:26:25.624+0000 7fdff0800640 1 --2- 172.21.15.50:0/1198341126 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fdfd00b4c80 0x7fdfd00b7190 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fdfe81059c0 tx=0x7fdfdc008040 comp rx=0 tx=0).stop 2024-08-31T04:26:25.654 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:26:25.624+0000 7fdff0800640 1 -- 172.21.15.50:0/1198341126 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdfe8103910 msgr2=0x7fdfe810e0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:26:25.654 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:26:25.624+0000 7fdff0800640 1 --2- 172.21.15.50:0/1198341126 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdfe8103910 0x7fdfe810e0a0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fdfd8005ab0 tx=0x7fdfd8003d50 comp rx=0 tx=0).stop 2024-08-31T04:26:25.654 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:26:25.624+0000 7fdff0800640 1 -- 172.21.15.50:0/1198341126 shutdown_connections 2024-08-31T04:26:25.654 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:26:25.624+0000 7fdff0800640 1 --2- 172.21.15.50:0/1198341126 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fdfd00b4c80 0x7fdfd00b7190 secure :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fdfe81059c0 tx=0x7fdfdc008040 comp rx=0 tx=0).stop 2024-08-31T04:26:25.655 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:26:25.624+0000 7fdff0800640 1 --2- 172.21.15.50:0/1198341126 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdfe8109ba0 0x7fdfe810aaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:25.655 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:26:25.624+0000 7fdff0800640 1 --2- 172.21.15.50:0/1198341126 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdfe8109250 0x7fdfe810a380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:25.655 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:26:25.624+0000 7fdff0800640 1 --2- 172.21.15.50:0/1198341126 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdfe8103910 0x7fdfe810e0a0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:25.655 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:26:25.624+0000 7fdff0800640 1 -- 172.21.15.50:0/1198341126 >> 172.21.15.50:0/1198341126 conn(0x7fdfe80ff380 msgr2=0x7fdfe8108900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:26:25.655 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:26:25.627+0000 7fdff0800640 1 -- 172.21.15.50:0/1198341126 shutdown_connections 2024-08-31T04:26:25.655 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:26:25.627+0000 7fdff0800640 1 -- 172.21.15.50:0/1198341126 wait complete. 2024-08-31T04:26:25.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:26:25 smithi177 ceph-mon[22025]: pgmap v473: 97 pgs: 97 active+clean; 314 MiB data, 831 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 7.0 MiB/s wr, 415 op/s 2024-08-31T04:26:25.792 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:26:25 smithi133 ceph-mon[22177]: pgmap v473: 97 pgs: 97 active+clean; 314 MiB data, 831 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 7.0 MiB/s wr, 415 op/s 2024-08-31T04:26:26.701 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:26:26 smithi050 ceph-mon[17259]: from='client.? 172.21.15.50:0/1198341126' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T04:26:26.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:26:26 smithi177 ceph-mon[22025]: from='client.? 172.21.15.50:0/1198341126' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T04:26:26.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:26:26 smithi133 ceph-mon[22177]: from='client.? 172.21.15.50:0/1198341126' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T04:26:27.125 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24695 quiesce db / --timeout 90 --expiration 141.8 --await-for 45.0' 2024-08-31T04:26:27.126 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 058d9fc6-674f-11ef-bcd4-c7b262605968 -- timeout 105 ceph tell mds.24695 quiesce db / --timeout 90 --expiration 141.8 --await-for 45.0 2024-08-31T04:26:27.400 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:26:27 smithi050 ceph-mon[17259]: pgmap v474: 97 pgs: 97 active+clean; 362 MiB data, 935 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 12 MiB/s wr, 1.05k op/s 2024-08-31T04:26:27.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:26:27 smithi177 ceph-mon[22025]: pgmap v474: 97 pgs: 97 active+clean; 362 MiB data, 935 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 12 MiB/s wr, 1.05k op/s 2024-08-31T04:26:27.792 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:26:27 smithi133 ceph-mon[22177]: pgmap v474: 97 pgs: 97 active+clean; 362 MiB data, 935 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 12 MiB/s wr, 1.05k op/s 2024-08-31T04:26:29.703 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:26:29 smithi050 ceph-mon[17259]: pgmap v475: 97 pgs: 97 active+clean; 351 MiB data, 947 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 12 MiB/s wr, 1.19k op/s 2024-08-31T04:26:29.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:26:29 smithi177 ceph-mon[22025]: pgmap v475: 97 pgs: 97 active+clean; 351 MiB data, 947 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 12 MiB/s wr, 1.19k op/s 2024-08-31T04:26:29.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:26:29 smithi133 ceph-mon[22177]: pgmap v475: 97 pgs: 97 active+clean; 351 MiB data, 947 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 12 MiB/s wr, 1.19k op/s 2024-08-31T04:26:31.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:26:31 smithi050 ceph-mon[17259]: pgmap v476: 97 pgs: 97 active+clean; 352 MiB data, 945 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 11 MiB/s wr, 1.16k op/s 2024-08-31T04:26:31.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:26:31 smithi177 ceph-mon[22025]: pgmap v476: 97 pgs: 97 active+clean; 352 MiB data, 945 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 11 MiB/s wr, 1.16k op/s 2024-08-31T04:26:31.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:26:31 smithi133 ceph-mon[22177]: pgmap v476: 97 pgs: 97 active+clean; 352 MiB data, 945 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 11 MiB/s wr, 1.16k op/s 2024-08-31T04:26:33.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:26:33 smithi050 ceph-mon[17259]: pgmap v477: 97 pgs: 97 active+clean; 361 MiB data, 971 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 11 MiB/s wr, 1.18k op/s 2024-08-31T04:26:33.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:26:33 smithi177 ceph-mon[22025]: pgmap v477: 97 pgs: 97 active+clean; 361 MiB data, 971 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 11 MiB/s wr, 1.18k op/s 2024-08-31T04:26:33.792 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:26:33 smithi133 ceph-mon[22177]: pgmap v477: 97 pgs: 97 active+clean; 361 MiB data, 971 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 11 MiB/s wr, 1.18k op/s 2024-08-31T04:26:34.700 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:26:35.450 INFO:tasks.workunit.client.0.smithi050.stdout: 155 664591 1464 465786 1797 149035 1221 2024-08-31T04:26:35.451 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:26:35 smithi050 ceph-mon[17259]: pgmap v478: 97 pgs: 97 active+clean; 360 MiB data, 978 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 8.2 MiB/s wr, 1.02k op/s 2024-08-31T04:26:35.745 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:26:35 smithi177 ceph-mon[22025]: pgmap v478: 97 pgs: 97 active+clean; 360 MiB data, 978 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 8.2 MiB/s wr, 1.02k op/s 2024-08-31T04:26:35.792 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:26:35 smithi133 ceph-mon[22177]: pgmap v478: 97 pgs: 97 active+clean; 360 MiB data, 978 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 8.2 MiB/s wr, 1.02k op/s 2024-08-31T04:26:37.431 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:26:37 smithi050 ceph-mon[17259]: pgmap v479: 97 pgs: 97 active+clean; 369 MiB data, 993 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 7.5 MiB/s wr, 1.01k op/s 2024-08-31T04:26:37.745 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:26:37 smithi177 ceph-mon[22025]: pgmap v479: 97 pgs: 97 active+clean; 369 MiB data, 993 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 7.5 MiB/s wr, 1.01k op/s 2024-08-31T04:26:37.792 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:26:37 smithi133 ceph-mon[22177]: pgmap v479: 97 pgs: 97 active+clean; 369 MiB data, 993 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 7.5 MiB/s wr, 1.01k op/s 2024-08-31T04:26:38.246 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:26:37.795+0000 7fa2eb200640 1 -- 172.21.15.50:0/2155603669 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa2dc0ab5f0 msgr2=0x7fa2dc0b1e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:26:38.246 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:26:37.795+0000 7fa2eb200640 1 --2- 172.21.15.50:0/2155603669 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa2dc0ab5f0 0x7fa2dc0b1e20 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fa2e4051dc0 tx=0x7fa2e408f7b0 comp rx=0 tx=0).stop 2024-08-31T04:26:38.246 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:26:37.795+0000 7fa2eb200640 1 -- 172.21.15.50:0/2155603669 shutdown_connections 2024-08-31T04:26:38.246 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:26:37.795+0000 7fa2eb200640 1 --2- 172.21.15.50:0/2155603669 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa2dc0ab5f0 0x7fa2dc0b1e20 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:38.246 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:26:37.795+0000 7fa2eb200640 1 --2- 172.21.15.50:0/2155603669 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa2dc0aaca0 0x7fa2dc0ab0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:38.246 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:26:37.795+0000 7fa2eb200640 1 --2- 172.21.15.50:0/2155603669 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa2dc0a5360 0x7fa2dc0a5770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:38.246 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:26:37.795+0000 7fa2eb200640 1 -- 172.21.15.50:0/2155603669 >> 172.21.15.50:0/2155603669 conn(0x7fa2dc01cc60 msgr2=0x7fa2dc01d070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:26:38.246 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:26:37.795+0000 7fa2eb200640 1 -- 172.21.15.50:0/2155603669 shutdown_connections 2024-08-31T04:26:38.247 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:26:37.796+0000 7fa2eb200640 1 -- 172.21.15.50:0/2155603669 wait complete. 2024-08-31T04:26:38.247 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:26:37.798+0000 7fa2eb200640 1 Processor -- start 2024-08-31T04:26:38.247 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:26:37.800+0000 7fa2eb200640 1 -- start start 2024-08-31T04:26:38.247 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:26:37.801+0000 7fa2eb200640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa2dc0a5360 0x7fa2dc0b6b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:26:38.247 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:26:37.801+0000 7fa2eb200640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa2dc0aaca0 0x7fa2dc0b70c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:26:38.247 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:26:37.801+0000 7fa2eb200640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa2dc0ab5f0 0x7fa2dc0c1510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:26:38.247 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:26:37.803+0000 7fa2e9200640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa2dc0ab5f0 0x7fa2dc0c1510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:26:38.247 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:26:37.803+0000 7fa2e3400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa2dc0aaca0 0x7fa2dc0b70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:26:38.247 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:26:37.803+0000 7fa2e9200640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa2dc0ab5f0 0x7fa2dc0c1510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35996/0 (socket says 172.21.15.50:35996) 2024-08-31T04:26:38.247 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:26:37.804+0000 7fa2e3400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa2dc0aaca0 0x7fa2dc0b70c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.50:44130/0 (socket says 172.21.15.50:44130) 2024-08-31T04:26:38.247 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:26:37.804+0000 7fa2e9200640 1 -- 172.21.15.50:0/1778602720 learned_addr learned my addr 172.21.15.50:0/1778602720 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:26:38.247 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:26:37.804+0000 7fa2e3e00640 1 --2- 172.21.15.50:0/1778602720 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa2dc0a5360 0x7fa2dc0b6b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:26:38.248 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:26:37.804+0000 7fa2eb200640 1 -- 172.21.15.50:0/1778602720 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fa2dc0b4aa0 con 0x7fa2dc0ab5f0 2024-08-31T04:26:38.248 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:26:37.804+0000 7fa2eb200640 1 -- 172.21.15.50:0/1778602720 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7fa2dc0b4920 con 0x7fa2dc0aaca0 2024-08-31T04:26:38.248 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:26:37.804+0000 7fa2eb200640 1 -- 172.21.15.50:0/1778602720 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fa2dc0b4c20 con 0x7fa2dc0a5360 2024-08-31T04:26:38.248 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:26:37.805+0000 7fa2e9200640 1 -- 172.21.15.50:0/1778602720 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa2dc0a5360 msgr2=0x7fa2dc0b6b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:26:38.248 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:26:37.805+0000 7fa2e9200640 1 --2- 172.21.15.50:0/1778602720 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa2dc0a5360 0x7fa2dc0b6b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:38.248 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:26:37.805+0000 7fa2e9200640 1 -- 172.21.15.50:0/1778602720 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa2dc0aaca0 msgr2=0x7fa2dc0b70c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:26:38.248 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:26:37.805+0000 7fa2e9200640 1 --2- 172.21.15.50:0/1778602720 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa2dc0aaca0 0x7fa2dc0b70c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:38.248 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:26:37.805+0000 7fa2e9200640 1 -- 172.21.15.50:0/1778602720 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2dc0c1c40 con 0x7fa2dc0ab5f0 2024-08-31T04:26:38.248 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:26:37.805+0000 7fa2e3400640 1 --2- 172.21.15.50:0/1778602720 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa2dc0aaca0 0x7fa2dc0b70c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:26:38.248 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:26:37.807+0000 7fa2e3e00640 1 --2- 172.21.15.50:0/1778602720 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa2dc0a5360 0x7fa2dc0b6b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T04:26:38.248 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:26:37.807+0000 7fa2e9200640 1 --2- 172.21.15.50:0/1778602720 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa2dc0ab5f0 0x7fa2dc0c1510 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fa2e408fda0 tx=0x7fa2e406ef50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:26:38.248 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:26:37.808+0000 7fa2e0c00640 1 -- 172.21.15.50:0/1778602720 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2e40a5070 con 0x7fa2dc0ab5f0 2024-08-31T04:26:38.248 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:26:37.809+0000 7fa2eb200640 1 -- 172.21.15.50:0/1778602720 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa2dc0c1e70 con 0x7fa2dc0ab5f0 2024-08-31T04:26:38.248 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:26:37.809+0000 7fa2e0c00640 1 -- 172.21.15.50:0/1778602720 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa2e4096420 con 0x7fa2dc0ab5f0 2024-08-31T04:26:38.249 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:26:37.810+0000 7fa2eb200640 1 -- 172.21.15.50:0/1778602720 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa2dc0bc660 con 0x7fa2dc0ab5f0 2024-08-31T04:26:38.249 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:26:37.813+0000 7fa2e0c00640 1 -- 172.21.15.50:0/1778602720 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2e40a1720 con 0x7fa2dc0ab5f0 2024-08-31T04:26:38.249 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:26:37.831+0000 7fa2f1ffb740 1 Processor -- start 2024-08-31T04:26:38.249 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:26:37.833+0000 7fa2e0c00640 1 -- 172.21.15.50:0/1778602720 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 18) ==== 152577+0+0 (secure 0 0 0) 0x7fa2e40a8070 con 0x7fa2dc0ab5f0 2024-08-31T04:26:38.249 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:26:37.837+0000 7fa2e0c00640 1 --2- 172.21.15.50:0/1778602720 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fa2cc0b4bf0 0x7fa2cc0b7100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:26:38.249 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:26:37.838+0000 7fa2e3400640 1 --2- 172.21.15.50:0/1778602720 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fa2cc0b4bf0 0x7fa2cc0b7100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:26:38.249 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:26:37.841+0000 7fa2e0c00640 1 -- 172.21.15.50:0/1778602720 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8219+0+0 (secure 0 0 0) 0x7fa2e41691d0 con 0x7fa2dc0ab5f0 2024-08-31T04:26:38.249 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:26:37.842+0000 7fa2e3400640 1 --2- 172.21.15.50:0/1778602720 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fa2cc0b4bf0 0x7fa2cc0b7100 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fa2dc01d700 tx=0x7fa2d000c040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:26:38.249 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:26:37.843+0000 7fa2f1ffb740 1 -- start start 2024-08-31T04:26:38.249 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:26:37.843+0000 7fa2f1ffb740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ed850c2840 0x55ed854692d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:26:38.249 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:26:37.843+0000 7fa2f1ffb740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ed85099980 0x55ed85469810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:26:38.250 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:26:37.843+0000 7fa2f1ffb740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ed850a1b60 0x55ed85469d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:26:38.250 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:26:37.843+0000 7fa2f1ffb740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55ed853de530 con 0x55ed850c2840 2024-08-31T04:26:38.250 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:26:37.843+0000 7fa2f1ffb740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x55ed853cdac0 con 0x55ed850a1b60 2024-08-31T04:26:38.250 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:26:37.843+0000 7fa2f1ffb740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x55ed853d1a70 con 0x55ed85099980 2024-08-31T04:26:38.250 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:26:37.844+0000 7fa2e9200640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ed850a1b60 0x55ed85469d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:26:38.250 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:26:37.844+0000 7fa2e9200640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ed850a1b60 0x55ed85469d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.50:44136/0 (socket says 172.21.15.50:44136) 2024-08-31T04:26:38.250 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:26:37.844+0000 7fa2e9200640 1 -- 172.21.15.50:0/1401562656 learned_addr learned my addr 172.21.15.50:0/1401562656 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:26:38.250 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:26:37.844+0000 7fa2e3400640 1 --2- 172.21.15.50:0/1401562656 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ed85099980 0x55ed85469810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:26:38.250 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:26:37.847+0000 7fa2e3e00640 1 --2- 172.21.15.50:0/1401562656 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ed850c2840 0x55ed854692d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:26:38.250 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:26:37.849+0000 7fa2e3400640 1 -- 172.21.15.50:0/1401562656 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ed850a1b60 msgr2=0x55ed85469d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:26:38.250 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:26:37.849+0000 7fa2e3400640 1 --2- 172.21.15.50:0/1401562656 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ed850a1b60 0x55ed85469d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:38.250 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:26:37.849+0000 7fa2e3400640 1 -- 172.21.15.50:0/1401562656 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ed850c2840 msgr2=0x55ed854692d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:26:38.250 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:26:37.849+0000 7fa2e3400640 1 --2- 172.21.15.50:0/1401562656 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ed850c2840 0x55ed854692d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:38.251 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:26:37.849+0000 7fa2e3400640 1 -- 172.21.15.50:0/1401562656 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ed85380880 con 0x55ed85099980 2024-08-31T04:26:38.251 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:26:37.851+0000 7fa2e3e00640 1 --2- 172.21.15.50:0/1401562656 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ed850c2840 0x55ed854692d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:26:38.251 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:26:37.852+0000 7fa2e3400640 1 --2- 172.21.15.50:0/1401562656 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ed85099980 0x55ed85469810 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fa2dc018460 tx=0x7fa2d000e050 comp rx=0 tx=0).ready entity=mon.1 client_cookie=67dddb320d4da53d server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:26:38.251 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:26:37.853+0000 7fa2d5600640 1 -- 172.21.15.50:0/1401562656 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2d001a0d0 con 0x55ed85099980 2024-08-31T04:26:38.251 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:26:37.853+0000 7fa2d5600640 1 -- 172.21.15.50:0/1401562656 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa2d001a270 con 0x55ed85099980 2024-08-31T04:26:38.251 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:26:37.853+0000 7fa2d5600640 1 -- 172.21.15.50:0/1401562656 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2d0018c10 con 0x55ed85099980 2024-08-31T04:26:38.251 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:26:37.857+0000 7fa2f1ffb740 1 -- 172.21.15.50:0/1401562656 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ed85099980 msgr2=0x55ed85469810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:26:38.251 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:26:37.857+0000 7fa2f1ffb740 1 --2- 172.21.15.50:0/1401562656 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ed85099980 0x55ed85469810 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fa2dc018460 tx=0x7fa2d000e050 comp rx=0 tx=0).stop 2024-08-31T04:26:38.251 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:26:37.861+0000 7fa2f1ffb740 1 -- 172.21.15.50:0/1401562656 shutdown_connections 2024-08-31T04:26:38.251 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:26:37.861+0000 7fa2f1ffb740 1 --2- 172.21.15.50:0/1401562656 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ed85099980 0x55ed85469810 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:38.251 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:26:37.861+0000 7fa2f1ffb740 1 --2- 172.21.15.50:0/1401562656 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ed850a1b60 0x55ed85469d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:38.251 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:26:37.861+0000 7fa2f1ffb740 1 --2- 172.21.15.50:0/1401562656 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ed850c2840 0x55ed854692d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:38.251 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:26:37.861+0000 7fa2f1ffb740 1 -- 172.21.15.50:0/1401562656 >> 172.21.15.50:0/1401562656 conn(0x55ed850b6990 msgr2=0x55ed854671c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:26:38.252 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:26:37.865+0000 7fa2f1ffb740 1 -- 172.21.15.50:0/1401562656 shutdown_connections 2024-08-31T04:26:38.252 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:26:37.866+0000 7fa2f1ffb740 1 -- 172.21.15.50:0/1401562656 wait complete. 2024-08-31T04:26:38.252 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:26:37.867+0000 7fa2f1ffb740 1 -- start start 2024-08-31T04:26:38.252 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:26:37.867+0000 7fa2f1ffb740 1 Processor -- start 2024-08-31T04:26:38.252 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:26:37.868+0000 7fa2f1ffb740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ed85099980 0x55ed85474ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:26:38.252 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:26:37.868+0000 7fa2f1ffb740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ed850a1b60 0x55ed85475410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:26:38.252 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:26:37.868+0000 7fa2f1ffb740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ed850c2840 0x55ed85480dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:26:38.252 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:26:37.868+0000 7fa2f1ffb740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55ed852307a0 con 0x55ed850a1b60 2024-08-31T04:26:38.252 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:26:37.868+0000 7fa2f1ffb740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x55ed853547f0 con 0x55ed85099980 2024-08-31T04:26:38.252 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:26:37.868+0000 7fa2f1ffb740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x55ed85477a50 con 0x55ed850c2840 2024-08-31T04:26:38.252 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:26:37.868+0000 7fa2f1ffb740 10 client.0 _ll_register_callbacks cb 0x55ed85379e60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:26:38.252 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:26:37.869+0000 7fa2e9200640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ed850c2840 0x55ed85480dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:26:38.252 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:26:37.869+0000 7fa2e9200640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ed850c2840 0x55ed85480dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.50:50010/0 (socket says 172.21.15.50:50010) 2024-08-31T04:26:38.253 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:26:37.869+0000 7fa2e9200640 1 -- 172.21.15.50:0/3618363948 learned_addr learned my addr 172.21.15.50:0/3618363948 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:26:38.253 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:26:37.869+0000 7fa2e3e00640 1 --2- 172.21.15.50:0/3618363948 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ed85099980 0x55ed85474ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:26:38.253 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:26:37.869+0000 7fa2e9200640 1 -- 172.21.15.50:0/3618363948 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ed85099980 msgr2=0x55ed85474ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:26:38.253 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:26:37.869+0000 7fa2e9200640 1 --2- 172.21.15.50:0/3618363948 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ed85099980 0x55ed85474ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:38.253 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:26:37.869+0000 7fa2e9200640 1 -- 172.21.15.50:0/3618363948 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ed850a1b60 msgr2=0x55ed85475410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:26:38.253 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:26:37.869+0000 7fa2e3400640 1 --2- 172.21.15.50:0/3618363948 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ed850a1b60 0x55ed85475410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:26:38.253 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:26:37.870+0000 7fa2e9200640 1 --2- 172.21.15.50:0/3618363948 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ed850a1b60 0x55ed85475410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:38.253 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:26:37.870+0000 7fa2e9200640 1 -- 172.21.15.50:0/3618363948 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ed8513cb90 con 0x55ed850c2840 2024-08-31T04:26:38.253 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:26:37.870+0000 7fa2e3e00640 1 --2- 172.21.15.50:0/3618363948 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ed85099980 0x55ed85474ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:26:38.253 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:26:37.870+0000 7fa2e3400640 1 --2- 172.21.15.50:0/3618363948 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ed850a1b60 0x55ed85475410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T04:26:38.253 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:26:37.870+0000 7fa2e9200640 1 --2- 172.21.15.50:0/3618363948 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ed850c2840 0x55ed85480dd0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fa2e412f910 tx=0x7fa2e4130230 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6f3ac0b2b798c56f server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:26:38.253 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:26:37.870+0000 7fa2ca000640 10 client.0 ms_handle_connect on v2:172.21.15.177:3300/0 2024-08-31T04:26:38.254 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:26:37.871+0000 7fa2ca000640 1 -- 172.21.15.50:0/3618363948 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2e412f720 con 0x55ed850c2840 2024-08-31T04:26:38.254 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:26:37.871+0000 7fa2ca000640 1 -- 172.21.15.50:0/3618363948 <== mon.1 v2:172.21.15.177:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8219+0+0 (secure 0 0 0) 0x7fa2e4134220 con 0x55ed850c2840 2024-08-31T04:26:38.254 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:26:37.871+0000 7fa2f1ffb740 1 -- 172.21.15.50:0/3618363948 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55ed853e0480 con 0x55ed850c2840 2024-08-31T04:26:38.254 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:26:37.871+0000 7fa2ca000640 1 -- 172.21.15.50:0/3618363948 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7fa2e4130310 con 0x55ed850c2840 2024-08-31T04:26:38.254 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:26:37.871+0000 7fa2f1ffb740 10 client.25747 fetch_fsmap learned FSMap version 33 2024-08-31T04:26:38.254 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:26:37.871+0000 7fa2f1ffb740 1 -- 172.21.15.50:0/3618363948 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x55ed85483a60 con 0x55ed850c2840 2024-08-31T04:26:38.254 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:26:37.873+0000 7fa2ca000640 1 -- 172.21.15.50:0/3618363948 <== mon.1 v2:172.21.15.177:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x55ed853e0480 con 0x55ed850c2840 2024-08-31T04:26:38.254 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:26:37.873+0000 7fa2ca000640 1 -- 172.21.15.50:0/3618363948 <== mon.1 v2:172.21.15.177:3300/0 5 ==== fsmap(e 33) ==== 8378+0+0 (secure 0 0 0) 0x7fa2e412e8e0 con 0x55ed850c2840 2024-08-31T04:26:38.254 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:26:37.878+0000 7fa2f1ffb740 10 client.25747 fetch_fsmap finished waiting for FSMap version 33 2024-08-31T04:26:38.254 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:26:37.878+0000 7fa2f1ffb740 10 client.25747 resolve_mds: validated gid 24695 aka daemon mds.b 2024-08-31T04:26:38.254 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:26:37.878+0000 7fa2f1ffb740 20 client.25747 populate_metadata read hostname 'smithi050' 2024-08-31T04:26:38.254 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:26:37.878+0000 7fa2f1ffb740 1 --2- 172.21.15.50:0/3618363948 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x55ed850811c0 0x55ed85486f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:26:38.254 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:26:37.878+0000 7fa2f1ffb740 4 client.25747 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T04:26:38.254 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:26:37.878+0000 7fa2f1ffb740 1 -- 172.21.15.50:0/3618363948 --> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ed853dbf20 con 0x55ed850811c0 2024-08-31T04:26:38.255 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:26:37.881+0000 7fa2e3e00640 1 --2- 172.21.15.50:0/3618363948 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x55ed850811c0 0x55ed85486f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:26:38.255 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:26:37.882+0000 7fa2ca000640 10 client.25747 ms_handle_connect on v2:172.21.15.133:6838/2526402262 2024-08-31T04:26:38.255 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:26:37.882+0000 7fa2e3e00640 1 --2- 172.21.15.50:0/3618363948 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x55ed850811c0 0x55ed85486f30 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b1819c00a24fe88 server_cookie=1866d8ebaebd9e8 in_seq=0 out_seq=0 2024-08-31T04:26:38.255 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:26:37.886+0000 7fa2ca000640 1 -- 172.21.15.50:0/3618363948 <== mds.0 v2:172.21.15.133:6838/2526402262 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55ed853dbf20 con 0x55ed850811c0 2024-08-31T04:26:38.255 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:26:37.886+0000 7fa2ca000640 10 client.25747 handle_command_reply: tid=0 2024-08-31T04:26:38.255 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:26:37.886+0000 7fa2f1ffb740 1 client.25747 shutdown 2024-08-31T04:26:38.255 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:26:37.887+0000 7fa2f1ffb740 1 -- 172.21.15.50:0/3618363948 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ed850c2840 msgr2=0x55ed85480dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:26:38.255 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:26:37.887+0000 7fa2f1ffb740 1 --2- 172.21.15.50:0/3618363948 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ed850c2840 0x55ed85480dd0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fa2e412f910 tx=0x7fa2e4130230 comp rx=0 tx=0).stop 2024-08-31T04:26:38.255 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:26:37.888+0000 7fa2f1ffb740 1 -- 172.21.15.50:0/3618363948 shutdown_connections 2024-08-31T04:26:38.255 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:26:37.891+0000 7fa2f1ffb740 1 --2- 172.21.15.50:0/3618363948 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x55ed850811c0 0x55ed85486f30 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:38.255 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:26:37.891+0000 7fa2f1ffb740 1 --2- 172.21.15.50:0/3618363948 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ed850c2840 0x55ed85480dd0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:38.255 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:26:37.891+0000 7fa2f1ffb740 1 --2- 172.21.15.50:0/3618363948 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ed850a1b60 0x55ed85475410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:38.255 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:26:37.891+0000 7fa2f1ffb740 1 --2- 172.21.15.50:0/3618363948 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ed85099980 0x55ed85474ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:38.256 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:26:37.891+0000 7fa2f1ffb740 1 -- 172.21.15.50:0/3618363948 >> 172.21.15.50:0/3618363948 conn(0x55ed850b6990 msgr2=0x55ed8546c460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:26:38.256 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:26:37.891+0000 7fa2ca000640 0 client.25747 ms_handle_reset on v2:172.21.15.133:6838/2526402262 2024-08-31T04:26:38.256 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:26:37.891+0000 7fa2f1ffb740 1 -- 172.21.15.50:0/3618363948 shutdown_connections 2024-08-31T04:26:38.256 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:26:37.891+0000 7fa2f1ffb740 1 -- 172.21.15.50:0/3618363948 wait complete. 2024-08-31T04:26:38.256 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:26:37.892+0000 7fa2f1ffb740 20 client.25747 trim_cache size 0 max 16384 2024-08-31T04:26:38.256 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:26:37.941+0000 7fa2f1ffb740 1 Processor -- start 2024-08-31T04:26:38.256 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:26:37.941+0000 7fa2f1ffb740 1 -- start start 2024-08-31T04:26:38.256 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:26:37.942+0000 7fa2f1ffb740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ed85099980 0x55ed85466ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:26:38.256 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:26:37.942+0000 7fa2f1ffb740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ed850a1b60 0x55ed85467020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:26:38.256 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:26:37.942+0000 7fa2f1ffb740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ed850c2840 0x55ed85471ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:26:38.256 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:26:37.942+0000 7fa2f1ffb740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fa2c400e430 con 0x55ed850c2840 2024-08-31T04:26:38.256 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:26:37.942+0000 7fa2f1ffb740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7fa2c4010030 con 0x55ed85099980 2024-08-31T04:26:38.257 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:26:37.942+0000 7fa2f1ffb740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fa2c400eb00 con 0x55ed850a1b60 2024-08-31T04:26:38.257 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:26:37.943+0000 7fa2e3e00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ed85099980 0x55ed85466ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:26:38.257 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:26:37.943+0000 7fa2e3e00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ed85099980 0x55ed85466ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.50:44142/0 (socket says 172.21.15.50:44142) 2024-08-31T04:26:38.257 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:26:37.943+0000 7fa2e3e00640 1 -- 172.21.15.50:0/1460650933 learned_addr learned my addr 172.21.15.50:0/1460650933 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:26:38.257 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:26:37.943+0000 7fa2e9200640 1 --2- 172.21.15.50:0/1460650933 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ed850c2840 0x55ed85471ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:26:38.257 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:26:37.944+0000 7fa2e9200640 1 -- 172.21.15.50:0/1460650933 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ed850a1b60 msgr2=0x55ed85467020 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-31T04:26:38.257 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:26:37.944+0000 7fa2e9200640 1 --2- 172.21.15.50:0/1460650933 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ed850a1b60 0x55ed85467020 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:38.257 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:26:37.944+0000 7fa2e9200640 1 -- 172.21.15.50:0/1460650933 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ed85099980 msgr2=0x55ed85466ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:26:38.257 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:26:37.944+0000 7fa2e9200640 1 --2- 172.21.15.50:0/1460650933 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ed85099980 0x55ed85466ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:38.257 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:26:37.944+0000 7fa2e9200640 1 -- 172.21.15.50:0/1460650933 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ed85473c30 con 0x55ed850c2840 2024-08-31T04:26:38.257 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:26:37.948+0000 7fa2e9200640 1 --2- 172.21.15.50:0/1460650933 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ed850c2840 0x55ed85471ec0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fa2e4068b70 tx=0x7fa2e412df30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de99f0969ea04579 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:26:38.257 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:26:37.948+0000 7fa2d4c00640 1 -- 172.21.15.50:0/1460650933 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2e412f720 con 0x55ed850c2840 2024-08-31T04:26:38.257 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:26:37.949+0000 7fa2d4c00640 1 -- 172.21.15.50:0/1460650933 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa2e4134070 con 0x55ed850c2840 2024-08-31T04:26:38.258 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:26:37.949+0000 7fa2d4c00640 1 -- 172.21.15.50:0/1460650933 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2e412f080 con 0x55ed850c2840 2024-08-31T04:26:38.258 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:26:37.950+0000 7fa2f1ffb740 1 -- 172.21.15.50:0/1460650933 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ed850c2840 msgr2=0x55ed85471ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:26:38.258 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:26:37.950+0000 7fa2f1ffb740 1 --2- 172.21.15.50:0/1460650933 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ed850c2840 0x55ed85471ec0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fa2e4068b70 tx=0x7fa2e412df30 comp rx=0 tx=0).stop 2024-08-31T04:26:38.258 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:26:37.952+0000 7fa2f1ffb740 1 -- 172.21.15.50:0/1460650933 shutdown_connections 2024-08-31T04:26:38.258 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:26:37.952+0000 7fa2f1ffb740 1 --2- 172.21.15.50:0/1460650933 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ed850a1b60 0x55ed85467020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:38.258 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:26:37.952+0000 7fa2f1ffb740 1 --2- 172.21.15.50:0/1460650933 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ed850c2840 0x55ed85471ec0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:38.258 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:26:37.952+0000 7fa2f1ffb740 1 --2- 172.21.15.50:0/1460650933 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ed85099980 0x55ed85466ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:38.258 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:26:37.952+0000 7fa2f1ffb740 1 -- 172.21.15.50:0/1460650933 >> 172.21.15.50:0/1460650933 conn(0x55ed850b6990 msgr2=0x55ed8546fe80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:26:38.258 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:26:37.952+0000 7fa2f1ffb740 1 -- 172.21.15.50:0/1460650933 shutdown_connections 2024-08-31T04:26:38.258 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:26:37.953+0000 7fa2f1ffb740 1 -- 172.21.15.50:0/1460650933 wait complete. 2024-08-31T04:26:38.258 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:26:37.954+0000 7fa2f1ffb740 1 -- start start 2024-08-31T04:26:38.258 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:26:37.955+0000 7fa2f1ffb740 1 Processor -- start 2024-08-31T04:26:38.258 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:26:37.956+0000 7fa2f1ffb740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ed85099980 0x55ed8547d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:26:38.259 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:26:37.956+0000 7fa2f1ffb740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ed850a1b60 0x55ed8547bd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:26:38.259 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:26:37.956+0000 7fa2f1ffb740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ed850c2840 0x55ed8547c290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:26:38.259 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:26:37.956+0000 7fa2f1ffb740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fa2c400f960 con 0x55ed850a1b60 2024-08-31T04:26:38.259 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:26:37.956+0000 7fa2f1ffb740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7fa2c400f1d0 con 0x55ed85099980 2024-08-31T04:26:38.259 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:26:37.956+0000 7fa2f1ffb740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fa2c400c410 con 0x55ed850c2840 2024-08-31T04:26:38.259 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:26:37.956+0000 7fa2f1ffb740 10 client.0 _ll_register_callbacks cb 0x7fa2e412f9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:26:38.259 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:26:37.958+0000 7fa2e3e00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ed85099980 0x55ed8547d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:26:38.259 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:26:37.958+0000 7fa2e3e00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ed85099980 0x55ed8547d2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.50:44156/0 (socket says 172.21.15.50:44156) 2024-08-31T04:26:38.259 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:26:37.958+0000 7fa2e3e00640 1 -- 172.21.15.50:0/570084720 learned_addr learned my addr 172.21.15.50:0/570084720 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:26:38.259 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:26:37.959+0000 7fa2e9200640 1 --2- 172.21.15.50:0/570084720 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ed850c2840 0x55ed8547c290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:26:38.259 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:26:37.959+0000 7fa2e3400640 1 --2- 172.21.15.50:0/570084720 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ed850a1b60 0x55ed8547bd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:26:38.259 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:26:37.961+0000 7fa2e9200640 1 -- 172.21.15.50:0/570084720 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ed85099980 msgr2=0x55ed8547d2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:26:38.259 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:26:37.961+0000 7fa2e9200640 1 --2- 172.21.15.50:0/570084720 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ed85099980 0x55ed8547d2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:38.260 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:26:37.961+0000 7fa2e9200640 1 -- 172.21.15.50:0/570084720 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ed850a1b60 msgr2=0x55ed8547bd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:26:38.260 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:26:37.961+0000 7fa2e9200640 1 --2- 172.21.15.50:0/570084720 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ed850a1b60 0x55ed8547bd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:38.260 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:26:37.961+0000 7fa2e9200640 1 -- 172.21.15.50:0/570084720 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ed854872a0 con 0x55ed850c2840 2024-08-31T04:26:38.260 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:26:37.961+0000 7fa2e3e00640 1 --2- 172.21.15.50:0/570084720 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ed85099980 0x55ed8547d2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:26:38.260 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:26:37.964+0000 7fa2e3400640 1 --2- 172.21.15.50:0/570084720 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ed850a1b60 0x55ed8547bd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:26:38.260 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:26:37.965+0000 7fa2e9200640 1 --2- 172.21.15.50:0/570084720 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ed850c2840 0x55ed8547c290 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fa2e4051f70 tx=0x7fa2e4069100 comp rx=0 tx=0).ready entity=mon.1 client_cookie=238e6a32a78331de server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:26:38.260 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:26:37.965+0000 7fa2ca000640 10 client.0 ms_handle_connect on v2:172.21.15.177:3300/0 2024-08-31T04:26:38.260 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:26:37.966+0000 7fa2ca000640 1 -- 172.21.15.50:0/570084720 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2e4134480 con 0x55ed850c2840 2024-08-31T04:26:38.260 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:26:37.966+0000 7fa2ca000640 1 -- 172.21.15.50:0/570084720 <== mon.1 v2:172.21.15.177:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8219+0+0 (secure 0 0 0) 0x7fa2e4134220 con 0x55ed850c2840 2024-08-31T04:26:38.260 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:26:37.967+0000 7fa2f1ffb740 1 -- 172.21.15.50:0/570084720 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa2e4134070 con 0x55ed850c2840 2024-08-31T04:26:38.260 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:26:37.967+0000 7fa2ca000640 1 -- 172.21.15.50:0/570084720 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7fa2e412f720 con 0x55ed850c2840 2024-08-31T04:26:38.260 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:26:37.967+0000 7fa2f1ffb740 10 client.25750 fetch_fsmap learned FSMap version 33 2024-08-31T04:26:38.260 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:26:37.967+0000 7fa2f1ffb740 1 -- 172.21.15.50:0/570084720 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x55ed854872a0 con 0x55ed850c2840 2024-08-31T04:26:38.261 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:26:37.967+0000 7fa2ca000640 1 -- 172.21.15.50:0/570084720 <== mon.1 v2:172.21.15.177:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa2e4134070 con 0x55ed850c2840 2024-08-31T04:26:38.261 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:26:37.968+0000 7fa2ca000640 1 -- 172.21.15.50:0/570084720 <== mon.1 v2:172.21.15.177:3300/0 5 ==== fsmap(e 33) ==== 8378+0+0 (secure 0 0 0) 0x7fa2e412b4f0 con 0x55ed850c2840 2024-08-31T04:26:38.261 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:26:37.969+0000 7fa2f1ffb740 10 client.25750 fetch_fsmap finished waiting for FSMap version 33 2024-08-31T04:26:38.261 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:26:37.969+0000 7fa2f1ffb740 10 client.25750 resolve_mds: validated gid 24695 aka daemon mds.b 2024-08-31T04:26:38.261 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:26:37.969+0000 7fa2f1ffb740 20 client.25750 populate_metadata read hostname 'smithi050' 2024-08-31T04:26:38.261 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:26:37.969+0000 7fa2f1ffb740 1 --2- 172.21.15.50:0/570084720 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x55ed85056570 0x55ed854f47d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:26:38.261 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:26:37.969+0000 7fa2f1ffb740 4 client.25750 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 141.8, "await_for": 45.0}] 2024-08-31T04:26:38.261 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:26:37.969+0000 7fa2f1ffb740 1 -- 172.21.15.50:0/570084720 --> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 141.8, "await_for": 45.0}) -- 0x55ed853d9660 con 0x55ed85056570 2024-08-31T04:26:38.261 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:26:37.969+0000 7fa2e3e00640 1 --2- 172.21.15.50:0/570084720 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x55ed85056570 0x55ed854f47d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:26:38.261 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:26:37.970+0000 7fa2ca000640 10 client.25750 ms_handle_connect on v2:172.21.15.133:6838/2526402262 2024-08-31T04:26:38.261 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:26:37.970+0000 7fa2e3e00640 1 --2- 172.21.15.50:0/570084720 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x55ed85056570 0x55ed854f47d0 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=254c4e85d43daca5 server_cookie=ceeef49b9841ac33 in_seq=0 out_seq=0 2024-08-31T04:26:38.435 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:38.433+0000 7fc5e7200640 1 -- 172.21.15.50:0/1298994009 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc5e8106460 msgr2=0x7fc5e81088e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:26:38.435 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:38.433+0000 7fc5e7200640 1 --2- 172.21.15.50:0/1298994009 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc5e8106460 0x7fc5e81088e0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fc5d4009900 tx=0x7fc5d402a410 comp rx=0 tx=0).stop 2024-08-31T04:26:38.435 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:38.433+0000 7fc5e7200640 1 -- 172.21.15.50:0/1298994009 shutdown_connections 2024-08-31T04:26:38.435 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:38.433+0000 7fc5e7200640 1 --2- 172.21.15.50:0/1298994009 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc5e8109020 0x7fc5e810b530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:38.435 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:38.433+0000 7fc5e7200640 1 --2- 172.21.15.50:0/1298994009 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc5e8106460 0x7fc5e81088e0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:38.435 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:38.433+0000 7fc5e7200640 1 --2- 172.21.15.50:0/1298994009 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc5e806b4b0 0x7fc5e8105f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:38.435 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:38.433+0000 7fc5e7200640 1 -- 172.21.15.50:0/1298994009 >> 172.21.15.50:0/1298994009 conn(0x7fc5e80fdb20 msgr2=0x7fc5e80fffd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:26:38.435 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:38.434+0000 7fc5e7200640 1 -- 172.21.15.50:0/1298994009 shutdown_connections 2024-08-31T04:26:38.436 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:38.434+0000 7fc5e7200640 1 -- 172.21.15.50:0/1298994009 wait complete. 2024-08-31T04:26:38.437 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:38.436+0000 7fc5e7200640 1 Processor -- start 2024-08-31T04:26:38.437 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:38.436+0000 7fc5e7200640 1 -- start start 2024-08-31T04:26:38.437 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:38.436+0000 7fc5e7200640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc5e806b4b0 0x7fc5e819bdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:26:38.437 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:38.436+0000 7fc5e7200640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc5e8106460 0x7fc5e819c430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:26:38.438 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:38.436+0000 7fc5e7200640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc5e8109020 0x7fc5e819cfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:26:38.438 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:38.436+0000 7fc5e7200640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fc5e810ef60 con 0x7fc5e806b4b0 2024-08-31T04:26:38.438 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:38.436+0000 7fc5e7200640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7fc5e810ede0 con 0x7fc5e8109020 2024-08-31T04:26:38.438 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:38.436+0000 7fc5e7200640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fc5e810f0e0 con 0x7fc5e8106460 2024-08-31T04:26:38.439 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:38.437+0000 7fc5e5400640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc5e8106460 0x7fc5e819c430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:26:38.439 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:38.437+0000 7fc5e5e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc5e806b4b0 0x7fc5e819bdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:26:38.439 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:38.437+0000 7fc5e5e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc5e806b4b0 0x7fc5e819bdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36052/0 (socket says 172.21.15.50:36052) 2024-08-31T04:26:38.439 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:38.437+0000 7fc5e5e00640 1 -- 172.21.15.50:0/3029295501 learned_addr learned my addr 172.21.15.50:0/3029295501 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:26:38.439 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:38.437+0000 7fc5e5400640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc5e8106460 0x7fc5e819c430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.50:50026/0 (socket says 172.21.15.50:50026) 2024-08-31T04:26:38.439 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:38.437+0000 7fc5e6800640 1 --2- 172.21.15.50:0/3029295501 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc5e8109020 0x7fc5e819cfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:26:38.439 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:38.437+0000 7fc5e5400640 1 -- 172.21.15.50:0/3029295501 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc5e8109020 msgr2=0x7fc5e819cfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:26:38.439 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:38.437+0000 7fc5e5400640 1 --2- 172.21.15.50:0/3029295501 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc5e8109020 0x7fc5e819cfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:38.439 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:38.437+0000 7fc5e5400640 1 -- 172.21.15.50:0/3029295501 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc5e806b4b0 msgr2=0x7fc5e819bdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:26:38.440 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:38.437+0000 7fc5e5400640 1 --2- 172.21.15.50:0/3029295501 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc5e806b4b0 0x7fc5e819bdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:38.440 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:38.437+0000 7fc5e5400640 1 -- 172.21.15.50:0/3029295501 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5e819d800 con 0x7fc5e8106460 2024-08-31T04:26:38.440 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:38.437+0000 7fc5e6800640 1 --2- 172.21.15.50:0/3029295501 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc5e8109020 0x7fc5e819cfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:26:38.440 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:38.438+0000 7fc5e5400640 1 --2- 172.21.15.50:0/3029295501 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc5e8106460 0x7fc5e819c430 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fc5d4009230 tx=0x7fc5d40052b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:26:38.440 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:38.438+0000 7fc5dea00640 1 -- 172.21.15.50:0/3029295501 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5d403f070 con 0x7fc5e8106460 2024-08-31T04:26:38.440 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:38.438+0000 7fc5dea00640 1 -- 172.21.15.50:0/3029295501 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc5d40044d0 con 0x7fc5e8106460 2024-08-31T04:26:38.441 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:38.438+0000 7fc5dea00640 1 -- 172.21.15.50:0/3029295501 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5d4035030 con 0x7fc5e8106460 2024-08-31T04:26:38.441 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:38.439+0000 7fc5e7200640 1 -- 172.21.15.50:0/3029295501 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc5e819da90 con 0x7fc5e8106460 2024-08-31T04:26:38.441 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:38.439+0000 7fc5e7200640 1 -- 172.21.15.50:0/3029295501 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc5e8194640 con 0x7fc5e8106460 2024-08-31T04:26:38.444 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:38.443+0000 7fc5f4453740 1 Processor -- start 2024-08-31T04:26:38.445 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:38.443+0000 7fc5f4453740 1 -- start start 2024-08-31T04:26:38.445 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:38.444+0000 7fc5f4453740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5626729111b0 0x562672cb6fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:26:38.446 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:38.444+0000 7fc5e6800640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5626729111b0 0x562672cb6fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:26:38.446 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:38.445+0000 7fc5f4453740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5626728e82f0 0x562672cb7610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:26:38.446 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:38.445+0000 7fc5f4453740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5626728f04d0 0x562672cb8160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:26:38.446 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:38.445+0000 7fc5f4453740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x562672c29f70 con 0x5626729111b0 2024-08-31T04:26:38.447 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:38.445+0000 7fc5f4453740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x562672c19500 con 0x5626728e82f0 2024-08-31T04:26:38.447 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:38.445+0000 7fc5f4453740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x562672c1d4b0 con 0x5626728f04d0 2024-08-31T04:26:38.447 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:38.445+0000 7fc5e6800640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5626729111b0 0x562672cb6fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36056/0 (socket says 172.21.15.50:36056) 2024-08-31T04:26:38.447 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:38.445+0000 7fc5e6800640 1 -- 172.21.15.50:0/2220696116 learned_addr learned my addr 172.21.15.50:0/2220696116 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:26:38.447 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:38.445+0000 7fc5e5e00640 1 --2- 172.21.15.50:0/2220696116 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5626728e82f0 0x562672cb7610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:26:38.447 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:38.446+0000 7fc5e6800640 1 -- 172.21.15.50:0/2220696116 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5626728f04d0 msgr2=0x562672cb8160 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-31T04:26:38.447 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:38.446+0000 7fc5e6800640 1 --2- 172.21.15.50:0/2220696116 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5626728f04d0 0x562672cb8160 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:38.447 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:38.446+0000 7fc5e6800640 1 -- 172.21.15.50:0/2220696116 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5626728e82f0 msgr2=0x562672cb7610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:26:38.448 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:38.446+0000 7fc5e6800640 1 --2- 172.21.15.50:0/2220696116 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5626728e82f0 0x562672cb7610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:38.448 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:38.446+0000 7fc5e6800640 1 -- 172.21.15.50:0/2220696116 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562672bd3c10 con 0x5626729111b0 2024-08-31T04:26:38.448 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:38.446+0000 7fc5e6800640 1 --2- 172.21.15.50:0/2220696116 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5626729111b0 0x562672cb6fa0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fc5e000c450 tx=0x7fc5e000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2fb9608ea7ff88f1 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:26:38.449 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:38.448+0000 7fc5d3400640 1 -- 172.21.15.50:0/2220696116 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5e0007430 con 0x5626729111b0 2024-08-31T04:26:38.449 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:38.448+0000 7fc5d3400640 1 -- 172.21.15.50:0/2220696116 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc5e0007a80 con 0x5626729111b0 2024-08-31T04:26:38.449 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:38.448+0000 7fc5d3400640 1 -- 172.21.15.50:0/2220696116 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5e000aae0 con 0x5626729111b0 2024-08-31T04:26:38.450 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:38.449+0000 7fc5f4453740 1 -- 172.21.15.50:0/2220696116 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5626729111b0 msgr2=0x562672cb6fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:26:38.450 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:38.449+0000 7fc5f4453740 1 --2- 172.21.15.50:0/2220696116 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5626729111b0 0x562672cb6fa0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fc5e000c450 tx=0x7fc5e000c910 comp rx=0 tx=0).stop 2024-08-31T04:26:38.451 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:38.450+0000 7fc5f4453740 1 -- 172.21.15.50:0/2220696116 shutdown_connections 2024-08-31T04:26:38.451 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:38.450+0000 7fc5f4453740 1 --2- 172.21.15.50:0/2220696116 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5626728f04d0 0x562672cb8160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:38.451 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:38.450+0000 7fc5f4453740 1 --2- 172.21.15.50:0/2220696116 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5626728e82f0 0x562672cb7610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:38.452 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:38.450+0000 7fc5f4453740 1 --2- 172.21.15.50:0/2220696116 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5626729111b0 0x562672cb6fa0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:38.452 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:38.450+0000 7fc5f4453740 1 -- 172.21.15.50:0/2220696116 >> 172.21.15.50:0/2220696116 conn(0x562672905300 msgr2=0x562672cb2a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:26:38.452 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:38.451+0000 7fc5dea00640 1 -- 172.21.15.50:0/3029295501 <== mon.1 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 18) ==== 152577+0+0 (secure 0 0 0) 0x7fc5d4042070 con 0x7fc5e8106460 2024-08-31T04:26:38.454 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:38.453+0000 7fc5dea00640 1 --2- 172.21.15.50:0/3029295501 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fc5cc0b4b30 0x7fc5cc0b7040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:26:38.455 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:38.454+0000 7fc5f4453740 1 -- 172.21.15.50:0/2220696116 shutdown_connections 2024-08-31T04:26:38.455 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:38.454+0000 7fc5dea00640 1 -- 172.21.15.50:0/3029295501 <== mon.1 v2:172.21.15.177:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8219+0+0 (secure 0 0 0) 0x7fc5d40c8a00 con 0x7fc5e8106460 2024-08-31T04:26:38.455 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:38.454+0000 7fc5e5e00640 1 --2- 172.21.15.50:0/3029295501 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fc5cc0b4b30 0x7fc5cc0b7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:26:38.455 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:38.454+0000 7fc5f4453740 1 -- 172.21.15.50:0/2220696116 wait complete. 2024-08-31T04:26:38.456 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:38.455+0000 7fc5f4453740 1 -- start start 2024-08-31T04:26:38.457 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:38.455+0000 7fc5f4453740 1 Processor -- start 2024-08-31T04:26:38.457 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:38.456+0000 7fc5e5e00640 1 --2- 172.21.15.50:0/3029295501 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fc5cc0b4b30 0x7fc5cc0b7040 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fc5d8005fd0 tx=0x7fc5d800b480 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:26:38.458 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:38.457+0000 7fc5f4453740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5626728e82f0 0x562672cc0690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:26:38.458 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:38.457+0000 7fc5f4453740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5626729111b0 0x562672cc0d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:26:38.459 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:38.457+0000 7fc5f4453740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5626728cfd80 0x562672cc18c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:26:38.459 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:38.457+0000 7fc5f4453740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x562672b52ab0 con 0x5626729111b0 2024-08-31T04:26:38.459 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:38.457+0000 7fc5f4453740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x562672bc0320 con 0x5626728cfd80 2024-08-31T04:26:38.459 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:38.457+0000 7fc5f4453740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x562672cb8c80 con 0x5626728e82f0 2024-08-31T04:26:38.459 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:38.457+0000 7fc5f4453740 10 client.0 _ll_register_callbacks cb 0x562672bc66a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:26:38.459 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:38.457+0000 7fc5e5e00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5626728e82f0 0x562672cc0690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:26:38.459 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:38.457+0000 7fc5e5e00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5626728e82f0 0x562672cc0690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.50:50030/0 (socket says 172.21.15.50:50030) 2024-08-31T04:26:38.459 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:38.457+0000 7fc5e6800640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5626728cfd80 0x562672cc18c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:26:38.459 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:38.457+0000 7fc5e5e00640 1 -- 172.21.15.50:0/1538088429 learned_addr learned my addr 172.21.15.50:0/1538088429 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:26:38.460 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:38.458+0000 7fc5e5400640 1 --2- 172.21.15.50:0/1538088429 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5626729111b0 0x562672cc0d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:26:38.460 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:38.458+0000 7fc5e5e00640 1 -- 172.21.15.50:0/1538088429 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5626728cfd80 msgr2=0x562672cc18c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:26:38.460 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:38.458+0000 7fc5e5e00640 1 --2- 172.21.15.50:0/1538088429 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5626728cfd80 0x562672cc18c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:38.460 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:38.458+0000 7fc5e5e00640 1 -- 172.21.15.50:0/1538088429 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5626729111b0 msgr2=0x562672cc0d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:26:38.460 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:38.459+0000 7fc5e5e00640 1 --2- 172.21.15.50:0/1538088429 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5626729111b0 0x562672cc0d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:38.460 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:38.459+0000 7fc5e5e00640 1 -- 172.21.15.50:0/1538088429 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56267297c790 con 0x5626728e82f0 2024-08-31T04:26:38.461 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:38.459+0000 7fc5e5400640 1 --2- 172.21.15.50:0/1538088429 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5626729111b0 0x562672cc0d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:26:38.461 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:38.459+0000 7fc5e5e00640 1 --2- 172.21.15.50:0/1538088429 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5626728e82f0 0x562672cc0690 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fc5d8003f30 tx=0x7fc5d80046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e7cde6bc5e9aa640 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:26:38.461 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:38.460+0000 7fc5c7e00640 10 client.0 ms_handle_connect on v2:172.21.15.177:3300/0 2024-08-31T04:26:38.461 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:38.460+0000 7fc5c7e00640 1 -- 172.21.15.50:0/1538088429 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5d8005220 con 0x5626728e82f0 2024-08-31T04:26:38.462 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:38.460+0000 7fc5c7e00640 1 -- 172.21.15.50:0/1538088429 <== mon.1 v2:172.21.15.177:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8219+0+0 (secure 0 0 0) 0x7fc5d80053c0 con 0x5626728e82f0 2024-08-31T04:26:38.462 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:38.460+0000 7fc5f4453740 1 -- 172.21.15.50:0/1538088429 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc5e0007a80 con 0x5626728e82f0 2024-08-31T04:26:38.463 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:38.461+0000 7fc5c7e00640 1 -- 172.21.15.50:0/1538088429 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7fc5d80055c0 con 0x5626728e82f0 2024-08-31T04:26:38.463 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:38.461+0000 7fc5f4453740 10 client.25756 fetch_fsmap learned FSMap version 33 2024-08-31T04:26:38.463 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:38.461+0000 7fc5f4453740 1 -- 172.21.15.50:0/1538088429 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x5626729f5620 con 0x5626728e82f0 2024-08-31T04:26:38.463 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:38.461+0000 7fc5c7e00640 1 -- 172.21.15.50:0/1538088429 <== mon.1 v2:172.21.15.177:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc5e0007a80 con 0x5626728e82f0 2024-08-31T04:26:38.463 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:38.461+0000 7fc5c7e00640 1 -- 172.21.15.50:0/1538088429 <== mon.1 v2:172.21.15.177:3300/0 5 ==== fsmap(e 33) ==== 8378+0+0 (secure 0 0 0) 0x7fc5d8024070 con 0x5626728e82f0 2024-08-31T04:26:38.463 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:38.461+0000 7fc5f4453740 10 client.25756 fetch_fsmap finished waiting for FSMap version 33 2024-08-31T04:26:38.463 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:38.461+0000 7fc5f4453740 10 client.25756 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T04:26:38.463 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:38.461+0000 7fc5f4453740 20 client.25756 populate_metadata read hostname 'smithi050' 2024-08-31T04:26:38.463 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:38.462+0000 7fc5f4453740 1 --2- 172.21.15.50:0/1538088429 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x5626728a51c0 0x562672ccdfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:26:38.463 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:38.462+0000 7fc5f4453740 4 client.25756 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T04:26:38.463 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:38.462+0000 7fc5f4453740 1 -- 172.21.15.50:0/1538088429 --> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562672c2bec0 con 0x5626728a51c0 2024-08-31T04:26:38.464 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:38.462+0000 7fc5e5400640 1 --2- 172.21.15.50:0/1538088429 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x5626728a51c0 0x562672ccdfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:26:38.464 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:38.463+0000 7fc5e5400640 1 --2- 172.21.15.50:0/1538088429 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x5626728a51c0 0x562672ccdfd0 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a666a905222d2252 server_cookie=c5f58c805fe3788b in_seq=0 out_seq=0 2024-08-31T04:26:38.464 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:38.463+0000 7fc5c7e00640 10 client.25756 ms_handle_connect on v2:172.21.15.133:6838/2526402262 2024-08-31T04:26:38.468 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:38.466+0000 7fc5c7e00640 1 -- 172.21.15.50:0/1538088429 <== mds.0 v2:172.21.15.133:6838/2526402262 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x562672c2bec0 con 0x5626728a51c0 2024-08-31T04:26:38.468 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:38.466+0000 7fc5c7e00640 10 client.25756 handle_command_reply: tid=0 2024-08-31T04:26:38.468 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:38.467+0000 7fc5f4453740 1 client.25756 shutdown 2024-08-31T04:26:38.468 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:38.467+0000 7fc5f4453740 1 -- 172.21.15.50:0/1538088429 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5626728e82f0 msgr2=0x562672cc0690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:26:38.468 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:38.467+0000 7fc5f4453740 1 --2- 172.21.15.50:0/1538088429 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5626728e82f0 0x562672cc0690 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fc5d8003f30 tx=0x7fc5d80046c0 comp rx=0 tx=0).stop 2024-08-31T04:26:38.469 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:38.467+0000 7fc5f4453740 1 -- 172.21.15.50:0/1538088429 shutdown_connections 2024-08-31T04:26:38.469 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:38.467+0000 7fc5f4453740 1 --2- 172.21.15.50:0/1538088429 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x5626728a51c0 0x562672ccdfd0 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:38.469 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:38.467+0000 7fc5c7e00640 0 client.25756 ms_handle_reset on v2:172.21.15.133:6838/2526402262 2024-08-31T04:26:38.469 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:38.467+0000 7fc5f4453740 1 --2- 172.21.15.50:0/1538088429 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5626728cfd80 0x562672cc18c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:38.469 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:38.467+0000 7fc5f4453740 1 --2- 172.21.15.50:0/1538088429 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5626729111b0 0x562672cc0d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:38.469 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:38.467+0000 7fc5f4453740 1 --2- 172.21.15.50:0/1538088429 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5626728e82f0 0x562672cc0690 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:38.469 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:38.467+0000 7fc5f4453740 1 -- 172.21.15.50:0/1538088429 >> 172.21.15.50:0/1538088429 conn(0x562672905300 msgr2=0x562672cb0f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:26:38.469 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:38.468+0000 7fc5f4453740 1 -- 172.21.15.50:0/1538088429 shutdown_connections 2024-08-31T04:26:38.469 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:38.468+0000 7fc5f4453740 1 -- 172.21.15.50:0/1538088429 wait complete. 2024-08-31T04:26:38.470 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:38.468+0000 7fc5f4453740 20 client.25756 trim_cache size 0 max 16384 2024-08-31T04:26:38.501 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:38.499+0000 7fc5f4453740 1 Processor -- start 2024-08-31T04:26:38.501 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:38.499+0000 7fc5f4453740 1 -- start start 2024-08-31T04:26:38.501 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:38.500+0000 7fc5f4453740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5626728cfd80 0x562672cb1d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:26:38.501 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:38.500+0000 7fc5f4453740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5626728e82f0 0x562672cc1f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:26:38.501 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:38.500+0000 7fc5f4453740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5626729111b0 0x562672cb3f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:26:38.501 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:38.500+0000 7fc5f4453740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fc5e81b1130 con 0x5626728cfd80 2024-08-31T04:26:38.501 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:38.500+0000 7fc5f4453740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7fc5e81b2d30 con 0x5626728e82f0 2024-08-31T04:26:38.501 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:38.500+0000 7fc5f4453740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fc5e81b1800 con 0x5626729111b0 2024-08-31T04:26:38.502 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:38.500+0000 7fc5e5e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5626728cfd80 0x562672cb1d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:26:38.502 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:38.500+0000 7fc5e5400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5626728e82f0 0x562672cc1f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:26:38.502 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:38.500+0000 7fc5e5400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5626728e82f0 0x562672cc1f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.50:44204/0 (socket says 172.21.15.50:44204) 2024-08-31T04:26:38.502 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:38.500+0000 7fc5e6800640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5626729111b0 0x562672cb3f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:26:38.503 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:38.500+0000 7fc5e5e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5626728cfd80 0x562672cb1d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:36064/0 (socket says 172.21.15.50:36064) 2024-08-31T04:26:38.503 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:38.500+0000 7fc5e5400640 1 -- 172.21.15.50:0/436781360 learned_addr learned my addr 172.21.15.50:0/436781360 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:26:38.503 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:38.501+0000 7fc5e5400640 1 -- 172.21.15.50:0/436781360 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5626729111b0 msgr2=0x562672cb3f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:26:38.503 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:38.501+0000 7fc5e5400640 1 --2- 172.21.15.50:0/436781360 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5626729111b0 0x562672cb3f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:38.503 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:38.501+0000 7fc5e5400640 1 -- 172.21.15.50:0/436781360 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5626728cfd80 msgr2=0x562672cb1d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:26:38.503 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:38.501+0000 7fc5e5400640 1 --2- 172.21.15.50:0/436781360 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5626728cfd80 0x562672cb1d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:38.503 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:38.501+0000 7fc5e5400640 1 -- 172.21.15.50:0/436781360 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562672cbfff0 con 0x5626728e82f0 2024-08-31T04:26:38.503 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:38.501+0000 7fc5e5400640 1 --2- 172.21.15.50:0/436781360 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5626728e82f0 0x562672cc1f10 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fc5d4006010 tx=0x7fc5d40d3f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a1d0c22399b2fbef server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:26:38.503 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:38.501+0000 7fc5d2a00640 1 -- 172.21.15.50:0/436781360 <== mon.2 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5d40c8c00 con 0x5626728e82f0 2024-08-31T04:26:38.503 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:38.501+0000 7fc5d2a00640 1 -- 172.21.15.50:0/436781360 <== mon.2 v2:172.21.15.133:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc5d403cec0 con 0x5626728e82f0 2024-08-31T04:26:38.503 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:38.501+0000 7fc5d2a00640 1 -- 172.21.15.50:0/436781360 <== mon.2 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5d40c8da0 con 0x5626728e82f0 2024-08-31T04:26:38.504 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:38.502+0000 7fc5f4453740 1 -- 172.21.15.50:0/436781360 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5626728e82f0 msgr2=0x562672cc1f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:26:38.504 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:38.502+0000 7fc5f4453740 1 --2- 172.21.15.50:0/436781360 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5626728e82f0 0x562672cc1f10 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fc5d4006010 tx=0x7fc5d40d3f90 comp rx=0 tx=0).stop 2024-08-31T04:26:38.504 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:38.502+0000 7fc5f4453740 1 -- 172.21.15.50:0/436781360 shutdown_connections 2024-08-31T04:26:38.504 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:38.502+0000 7fc5f4453740 1 --2- 172.21.15.50:0/436781360 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5626729111b0 0x562672cb3f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:38.504 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:38.502+0000 7fc5f4453740 1 --2- 172.21.15.50:0/436781360 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5626728e82f0 0x562672cc1f10 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:38.504 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:38.502+0000 7fc5f4453740 1 --2- 172.21.15.50:0/436781360 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5626728cfd80 0x562672cb1d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:38.504 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:38.502+0000 7fc5f4453740 1 -- 172.21.15.50:0/436781360 >> 172.21.15.50:0/436781360 conn(0x562672905300 msgr2=0x562672cc1800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:26:38.504 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:38.503+0000 7fc5f4453740 1 -- 172.21.15.50:0/436781360 shutdown_connections 2024-08-31T04:26:38.505 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:38.503+0000 7fc5f4453740 1 -- 172.21.15.50:0/436781360 wait complete. 2024-08-31T04:26:38.505 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:38.503+0000 7fc5f4453740 1 -- start start 2024-08-31T04:26:38.505 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:38.503+0000 7fc5f4453740 1 Processor -- start 2024-08-31T04:26:38.506 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:38.504+0000 7fc5f4453740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5626728cfd80 0x562672cc84c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:26:38.506 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:38.504+0000 7fc5f4453740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5626728e82f0 0x562672cc71a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:26:38.506 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:38.504+0000 7fc5f4453740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5626729111b0 0x562672cc78b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:26:38.506 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:38.504+0000 7fc5f4453740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fc5e81b2660 con 0x5626728e82f0 2024-08-31T04:26:38.506 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:38.504+0000 7fc5f4453740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7fc5e81b1ed0 con 0x5626728cfd80 2024-08-31T04:26:38.506 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:38.504+0000 7fc5f4453740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fc5e81af130 con 0x5626729111b0 2024-08-31T04:26:38.506 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:38.505+0000 7fc5f4453740 10 client.0 _ll_register_callbacks cb 0x7fc5d8003be0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:26:38.506 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:38.505+0000 7fc5e5e00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5626728cfd80 0x562672cc84c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:26:38.506 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:38.505+0000 7fc5e5e00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5626728cfd80 0x562672cc84c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.50:44218/0 (socket says 172.21.15.50:44218) 2024-08-31T04:26:38.506 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:38.505+0000 7fc5e6800640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5626729111b0 0x562672cc78b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:26:38.507 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:38.505+0000 7fc5e5e00640 1 -- 172.21.15.50:0/1493642701 learned_addr learned my addr 172.21.15.50:0/1493642701 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:26:38.507 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:38.505+0000 7fc5e5400640 1 --2- 172.21.15.50:0/1493642701 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5626728e82f0 0x562672cc71a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:26:38.507 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:38.505+0000 7fc5e6800640 1 -- 172.21.15.50:0/1493642701 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5626728cfd80 msgr2=0x562672cc84c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:26:38.507 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:38.505+0000 7fc5e6800640 1 --2- 172.21.15.50:0/1493642701 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5626728cfd80 0x562672cc84c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:38.507 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:38.505+0000 7fc5e6800640 1 -- 172.21.15.50:0/1493642701 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5626728e82f0 msgr2=0x562672cc71a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:26:38.507 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:38.505+0000 7fc5e6800640 1 --2- 172.21.15.50:0/1493642701 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5626728e82f0 0x562672cc71a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:38.507 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:38.505+0000 7fc5e6800640 1 -- 172.21.15.50:0/1493642701 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562672cc5d40 con 0x5626729111b0 2024-08-31T04:26:38.508 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:38.506+0000 7fc5e6800640 1 --2- 172.21.15.50:0/1493642701 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5626729111b0 0x562672cc78b0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fc5e0004b90 tx=0x7fc5e000a710 comp rx=0 tx=0).ready entity=mon.1 client_cookie=33726296e7847cb8 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:26:38.508 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:38.506+0000 7fc5c7e00640 10 client.0 ms_handle_connect on v2:172.21.15.177:3300/0 2024-08-31T04:26:38.508 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:38.507+0000 7fc5c7e00640 1 -- 172.21.15.50:0/1493642701 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5e0025070 con 0x5626729111b0 2024-08-31T04:26:38.508 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:38.507+0000 7fc5c7e00640 1 -- 172.21.15.50:0/1493642701 <== mon.1 v2:172.21.15.177:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8219+0+0 (secure 0 0 0) 0x7fc5e0012040 con 0x5626729111b0 2024-08-31T04:26:38.509 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:38.507+0000 7fc5f4453740 1 -- 172.21.15.50:0/1493642701 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc5d403cec0 con 0x5626729111b0 2024-08-31T04:26:38.509 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:38.508+0000 7fc5c7e00640 1 -- 172.21.15.50:0/1493642701 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7fc5e002f050 con 0x5626729111b0 2024-08-31T04:26:38.509 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:38.508+0000 7fc5f4453740 10 client.25762 fetch_fsmap learned FSMap version 33 2024-08-31T04:26:38.509 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:38.508+0000 7fc5f4453740 1 -- 172.21.15.50:0/1493642701 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x562672d38b10 con 0x5626729111b0 2024-08-31T04:26:38.510 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:38.508+0000 7fc5c7e00640 1 -- 172.21.15.50:0/1493642701 <== mon.1 v2:172.21.15.177:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc5d403cec0 con 0x5626729111b0 2024-08-31T04:26:38.510 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:38.508+0000 7fc5c7e00640 1 -- 172.21.15.50:0/1493642701 <== mon.1 v2:172.21.15.177:3300/0 5 ==== fsmap(e 33) ==== 8378+0+0 (secure 0 0 0) 0x7fc5e0021b40 con 0x5626729111b0 2024-08-31T04:26:38.510 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:38.508+0000 7fc5f4453740 10 client.25762 fetch_fsmap finished waiting for FSMap version 33 2024-08-31T04:26:38.510 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:38.508+0000 7fc5f4453740 10 client.25762 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T04:26:38.510 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:38.509+0000 7fc5f4453740 20 client.25762 populate_metadata read hostname 'smithi050' 2024-08-31T04:26:38.510 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:38.509+0000 7fc5f4453740 1 --2- 172.21.15.50:0/1493642701 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x562672d393a0 0x562672d3b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:26:38.510 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:38.509+0000 7fc5f4453740 4 client.25762 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-31T04:26:38.510 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:38.509+0000 7fc5f4453740 1 -- 172.21.15.50:0/1493642701 --> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] -- command(tid 0: {"prefix": "flush journal"}) -- 0x562672c27960 con 0x562672d393a0 2024-08-31T04:26:38.511 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:38.509+0000 7fc5e5e00640 1 --2- 172.21.15.50:0/1493642701 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x562672d393a0 0x562672d3b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:26:38.511 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:38.510+0000 7fc5e5e00640 1 --2- 172.21.15.50:0/1493642701 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x562672d393a0 0x562672d3b7c0 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5a4aa4f34bfdac1a server_cookie=b034b27ce6945111 in_seq=0 out_seq=0 2024-08-31T04:26:38.511 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:38.510+0000 7fc5c7e00640 10 client.25762 ms_handle_connect on v2:172.21.15.133:6838/2526402262 2024-08-31T04:26:39.345 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:39.343+0000 7fc5c7e00640 1 -- 172.21.15.50:0/1493642701 <== mds.0 v2:172.21.15.133:6838/2526402262 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x562672c27960 con 0x562672d393a0 2024-08-31T04:26:39.345 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:39.343+0000 7fc5c7e00640 10 client.25762 handle_command_reply: tid=0 2024-08-31T04:26:39.345 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:39.343+0000 7fc5f4453740 1 client.25762 shutdown 2024-08-31T04:26:39.346 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:39.343+0000 7fc5f4453740 1 -- 172.21.15.50:0/1493642701 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5626729111b0 msgr2=0x562672cc78b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:26:39.346 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:39.343+0000 7fc5f4453740 1 --2- 172.21.15.50:0/1493642701 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5626729111b0 0x562672cc78b0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fc5e0004b90 tx=0x7fc5e000a710 comp rx=0 tx=0).stop 2024-08-31T04:26:39.346 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:39.343+0000 7fc5f4453740 1 -- 172.21.15.50:0/1493642701 shutdown_connections 2024-08-31T04:26:39.346 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:39.343+0000 7fc5f4453740 1 --2- 172.21.15.50:0/1493642701 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x562672d393a0 0x562672d3b7c0 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:39.346 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:39.343+0000 7fc5f4453740 1 --2- 172.21.15.50:0/1493642701 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5626729111b0 0x562672cc78b0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:39.346 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:39.343+0000 7fc5f4453740 1 --2- 172.21.15.50:0/1493642701 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5626728e82f0 0x562672cc71a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:39.346 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:39.343+0000 7fc5f4453740 1 --2- 172.21.15.50:0/1493642701 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5626728cfd80 0x562672cc84c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:39.346 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:39.343+0000 7fc5c7e00640 0 client.25762 ms_handle_reset on v2:172.21.15.133:6838/2526402262 2024-08-31T04:26:39.346 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:39.343+0000 7fc5f4453740 1 -- 172.21.15.50:0/1493642701 >> 172.21.15.50:0/1493642701 conn(0x562672905300 msgr2=0x562672cbb0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:26:39.347 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:39.343+0000 7fc5f4453740 1 -- 172.21.15.50:0/1493642701 shutdown_connections 2024-08-31T04:26:39.347 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:39.343+0000 7fc5f4453740 1 -- 172.21.15.50:0/1493642701 wait complete. 2024-08-31T04:26:39.347 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:39.343+0000 7fc5f4453740 20 client.25762 trim_cache size 0 max 16384 2024-08-31T04:26:39.347 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout:{ 2024-08-31T04:26:39.347 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout: "message": "", 2024-08-31T04:26:39.348 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout: "return_code": 0 2024-08-31T04:26:39.348 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout:} 2024-08-31T04:26:39.348 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:39.343+0000 7fc5e7200640 1 -- 172.21.15.50:0/3029295501 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fc5cc0b4b30 msgr2=0x7fc5cc0b7040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:26:39.348 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:39.343+0000 7fc5e7200640 1 --2- 172.21.15.50:0/3029295501 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fc5cc0b4b30 0x7fc5cc0b7040 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fc5d8005fd0 tx=0x7fc5d800b480 comp rx=0 tx=0).stop 2024-08-31T04:26:39.348 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:39.343+0000 7fc5e7200640 1 -- 172.21.15.50:0/3029295501 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc5e8106460 msgr2=0x7fc5e819c430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:26:39.349 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:39.343+0000 7fc5e7200640 1 --2- 172.21.15.50:0/3029295501 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc5e8106460 0x7fc5e819c430 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fc5d4009230 tx=0x7fc5d40052b0 comp rx=0 tx=0).stop 2024-08-31T04:26:39.349 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:39.343+0000 7fc5e7200640 1 -- 172.21.15.50:0/3029295501 shutdown_connections 2024-08-31T04:26:39.349 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:39.343+0000 7fc5e7200640 1 --2- 172.21.15.50:0/3029295501 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fc5cc0b4b30 0x7fc5cc0b7040 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:39.349 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:39.343+0000 7fc5e7200640 1 --2- 172.21.15.50:0/3029295501 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc5e8106460 0x7fc5e819c430 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:39.349 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:39.343+0000 7fc5e7200640 1 --2- 172.21.15.50:0/3029295501 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc5e8109020 0x7fc5e819cfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:39.349 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:39.343+0000 7fc5e7200640 1 --2- 172.21.15.50:0/3029295501 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc5e806b4b0 0x7fc5e819bdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:39.349 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:39.343+0000 7fc5e7200640 1 -- 172.21.15.50:0/3029295501 >> 172.21.15.50:0/3029295501 conn(0x7fc5e80fdb20 msgr2=0x7fc5e80fff40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:26:39.349 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:39.343+0000 7fc5e7200640 1 -- 172.21.15.50:0/3029295501 shutdown_connections 2024-08-31T04:26:39.349 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:39.343+0000 7fc5e7200640 1 -- 172.21.15.50:0/3029295501 wait complete. 2024-08-31T04:26:39.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:26:39 smithi050 ceph-mon[17259]: pgmap v480: 97 pgs: 97 active+clean; 388 MiB data, 1001 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 3.8 MiB/s wr, 461 op/s 2024-08-31T04:26:39.745 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:26:39 smithi177 ceph-mon[22025]: pgmap v480: 97 pgs: 97 active+clean; 388 MiB data, 1001 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 3.8 MiB/s wr, 461 op/s 2024-08-31T04:26:39.792 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:26:39 smithi133 ceph-mon[22177]: pgmap v480: 97 pgs: 97 active+clean; 388 MiB data, 1001 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 3.8 MiB/s wr, 461 op/s 2024-08-31T04:26:41.701 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:26:41 smithi050 ceph-mon[17259]: pgmap v481: 97 pgs: 97 active+clean; 395 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 4.6 MiB/s wr, 353 op/s 2024-08-31T04:26:41.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:26:41 smithi177 ceph-mon[22025]: pgmap v481: 97 pgs: 97 active+clean; 395 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 4.6 MiB/s wr, 353 op/s 2024-08-31T04:26:41.792 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:26:41 smithi133 ceph-mon[22177]: pgmap v481: 97 pgs: 97 active+clean; 395 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 4.6 MiB/s wr, 353 op/s 2024-08-31T04:26:43.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:26:43 smithi050 ceph-mon[17259]: pgmap v482: 97 pgs: 97 active+clean; 424 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 8.3 MiB/s wr, 784 op/s 2024-08-31T04:26:43.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:26:43 smithi177 ceph-mon[22025]: pgmap v482: 97 pgs: 97 active+clean; 424 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 8.3 MiB/s wr, 784 op/s 2024-08-31T04:26:43.792 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:26:43 smithi133 ceph-mon[22177]: pgmap v482: 97 pgs: 97 active+clean; 424 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 8.3 MiB/s wr, 784 op/s 2024-08-31T04:26:45.450 INFO:tasks.workunit.client.0.smithi050.stdout: 158 125101 285 89850 207 33010 327 2024-08-31T04:26:45.719 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:26:45 smithi050 ceph-mon[17259]: pgmap v483: 97 pgs: 97 active+clean; 441 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 8.9 MiB/s wr, 876 op/s 2024-08-31T04:26:45.745 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:26:45 smithi177 ceph-mon[22025]: pgmap v483: 97 pgs: 97 active+clean; 441 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 8.9 MiB/s wr, 876 op/s 2024-08-31T04:26:45.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:26:45 smithi133 ceph-mon[22177]: pgmap v483: 97 pgs: 97 active+clean; 441 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 8.9 MiB/s wr, 876 op/s 2024-08-31T04:26:46.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:26:46.639+0000 7fa2ca000640 1 -- 172.21.15.50:0/570084720 <== mds.0 v2:172.21.15.133:6838/2526402262 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x55ed853d9660 con 0x55ed85056570 2024-08-31T04:26:46.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:26:46.639+0000 7fa2ca000640 10 client.25750 handle_command_reply: tid=0 2024-08-31T04:26:46.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:26:46.639+0000 7fa2f1ffb740 1 client.25750 shutdown 2024-08-31T04:26:46.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:26:46.639+0000 7fa2f1ffb740 1 -- 172.21.15.50:0/570084720 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ed850c2840 msgr2=0x55ed8547c290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:26:46.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:26:46.639+0000 7fa2f1ffb740 1 --2- 172.21.15.50:0/570084720 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ed850c2840 0x55ed8547c290 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fa2e4051f70 tx=0x7fa2e4069100 comp rx=0 tx=0).stop 2024-08-31T04:26:46.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:26:46.639+0000 7fa2f1ffb740 1 -- 172.21.15.50:0/570084720 shutdown_connections 2024-08-31T04:26:46.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:26:46.639+0000 7fa2f1ffb740 1 --2- 172.21.15.50:0/570084720 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x55ed85056570 0x55ed854f47d0 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:46.642 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:26:46.639+0000 7fa2f1ffb740 1 --2- 172.21.15.50:0/570084720 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ed850c2840 0x55ed8547c290 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:46.642 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:26:46.639+0000 7fa2f1ffb740 1 --2- 172.21.15.50:0/570084720 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ed850a1b60 0x55ed8547bd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:46.642 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:26:46.639+0000 7fa2f1ffb740 1 --2- 172.21.15.50:0/570084720 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ed85099980 0x55ed8547d2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:46.642 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:26:46.639+0000 7fa2f1ffb740 1 -- 172.21.15.50:0/570084720 >> 172.21.15.50:0/570084720 conn(0x55ed850b6990 msgr2=0x55ed8546fe80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:26:46.642 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:26:46.639+0000 7fa2ca000640 0 client.25750 ms_handle_reset on v2:172.21.15.133:6838/2526402262 2024-08-31T04:26:46.642 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:26:46.639+0000 7fa2f1ffb740 1 -- 172.21.15.50:0/570084720 shutdown_connections 2024-08-31T04:26:46.642 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:26:46.639+0000 7fa2f1ffb740 1 -- 172.21.15.50:0/570084720 wait complete. 2024-08-31T04:26:46.642 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:26:46.639+0000 7fa2f1ffb740 20 client.25750 trim_cache size 0 max 16384 2024-08-31T04:26:46.643 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-08-31T04:26:46.643 INFO:teuthology.orchestra.run.smithi050.stdout: "epoch": 33, 2024-08-31T04:26:46.643 INFO:teuthology.orchestra.run.smithi050.stdout: "leader": 24695, 2024-08-31T04:26:46.643 INFO:teuthology.orchestra.run.smithi050.stdout: "set_version": 10, 2024-08-31T04:26:46.643 INFO:teuthology.orchestra.run.smithi050.stdout: "sets": { 2024-08-31T04:26:46.643 INFO:teuthology.orchestra.run.smithi050.stdout: "caac904b": { 2024-08-31T04:26:46.643 INFO:teuthology.orchestra.run.smithi050.stdout: "version": 10, 2024-08-31T04:26:46.643 INFO:teuthology.orchestra.run.smithi050.stdout: "age_ref": 0.0, 2024-08-31T04:26:46.643 INFO:teuthology.orchestra.run.smithi050.stdout: "state": { 2024-08-31T04:26:46.643 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "QUIESCED", 2024-08-31T04:26:46.643 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 0.0 2024-08-31T04:26:46.643 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:26:46.644 INFO:teuthology.orchestra.run.smithi050.stdout: "timeout": 90.0, 2024-08-31T04:26:46.644 INFO:teuthology.orchestra.run.smithi050.stdout: "expiration": 141.8, 2024-08-31T04:26:46.644 INFO:teuthology.orchestra.run.smithi050.stdout: "members": { 2024-08-31T04:26:46.644 INFO:teuthology.orchestra.run.smithi050.stdout: "file:/": { 2024-08-31T04:26:46.644 INFO:teuthology.orchestra.run.smithi050.stdout: "excluded": false, 2024-08-31T04:26:46.644 INFO:teuthology.orchestra.run.smithi050.stdout: "state": { 2024-08-31T04:26:46.644 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "QUIESCED", 2024-08-31T04:26:46.644 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 0.0 2024-08-31T04:26:46.644 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T04:26:46.644 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T04:26:46.644 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T04:26:46.644 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T04:26:46.644 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T04:26:46.645 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-08-31T04:26:46.645 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:26:46.639+0000 7fa2eb200640 1 -- 172.21.15.50:0/1778602720 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fa2cc0b4bf0 msgr2=0x7fa2cc0b7100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:26:46.645 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:26:46.639+0000 7fa2eb200640 1 --2- 172.21.15.50:0/1778602720 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fa2cc0b4bf0 0x7fa2cc0b7100 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fa2dc01d700 tx=0x7fa2d000c040 comp rx=0 tx=0).stop 2024-08-31T04:26:46.645 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:26:46.639+0000 7fa2eb200640 1 -- 172.21.15.50:0/1778602720 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa2dc0ab5f0 msgr2=0x7fa2dc0c1510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:26:46.645 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:26:46.639+0000 7fa2eb200640 1 --2- 172.21.15.50:0/1778602720 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa2dc0ab5f0 0x7fa2dc0c1510 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fa2e408fda0 tx=0x7fa2e406ef50 comp rx=0 tx=0).stop 2024-08-31T04:26:46.645 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:26:46.639+0000 7fa2eb200640 1 -- 172.21.15.50:0/1778602720 shutdown_connections 2024-08-31T04:26:46.645 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:26:46.639+0000 7fa2eb200640 1 --2- 172.21.15.50:0/1778602720 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fa2cc0b4bf0 0x7fa2cc0b7100 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:46.646 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:26:46.639+0000 7fa2eb200640 1 --2- 172.21.15.50:0/1778602720 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa2dc0ab5f0 0x7fa2dc0c1510 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:46.646 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:26:46.639+0000 7fa2eb200640 1 --2- 172.21.15.50:0/1778602720 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa2dc0aaca0 0x7fa2dc0b70c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:46.646 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:26:46.639+0000 7fa2eb200640 1 --2- 172.21.15.50:0/1778602720 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa2dc0a5360 0x7fa2dc0b6b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:46.646 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:26:46.639+0000 7fa2eb200640 1 -- 172.21.15.50:0/1778602720 >> 172.21.15.50:0/1778602720 conn(0x7fa2dc01cc60 msgr2=0x7fa2dc0a7ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:26:46.646 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:26:46.639+0000 7fa2eb200640 1 -- 172.21.15.50:0/1778602720 shutdown_connections 2024-08-31T04:26:46.646 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:26:46.639+0000 7fa2eb200640 1 -- 172.21.15.50:0/1778602720 wait complete. 2024-08-31T04:26:47.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:26:47 smithi177 ceph-mon[22025]: pgmap v484: 97 pgs: 97 active+clean; 512 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 15 MiB/s wr, 1.36k op/s 2024-08-31T04:26:47.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:26:47 smithi133 ceph-mon[22177]: pgmap v484: 97 pgs: 97 active+clean; 512 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 15 MiB/s wr, 1.36k op/s 2024-08-31T04:26:47.950 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:26:47 smithi050 ceph-mon[17259]: pgmap v484: 97 pgs: 97 active+clean; 512 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 15 MiB/s wr, 1.36k op/s 2024-08-31T04:26:49.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:26:49 smithi177 ceph-mon[22025]: pgmap v485: 97 pgs: 97 active+clean; 524 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 15 MiB/s wr, 1.40k op/s 2024-08-31T04:26:49.792 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:26:49 smithi133 ceph-mon[22177]: pgmap v485: 97 pgs: 97 active+clean; 524 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 15 MiB/s wr, 1.40k op/s 2024-08-31T04:26:49.950 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:26:49 smithi050 ceph-mon[17259]: pgmap v485: 97 pgs: 97 active+clean; 524 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 15 MiB/s wr, 1.40k op/s 2024-08-31T04:26:51.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:26:51 smithi177 ceph-mon[22025]: pgmap v486: 97 pgs: 97 active+clean; 530 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 14 MiB/s wr, 1.31k op/s 2024-08-31T04:26:51.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:26:51 smithi133 ceph-mon[22177]: pgmap v486: 97 pgs: 97 active+clean; 530 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 14 MiB/s wr, 1.31k op/s 2024-08-31T04:26:51.950 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:26:51 smithi050 ceph-mon[17259]: pgmap v486: 97 pgs: 97 active+clean; 530 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 14 MiB/s wr, 1.31k op/s 2024-08-31T04:26:52.544 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:52.539+0000 7f83b6400640 1 -- 172.21.15.50:0/2195149016 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f83b0104300 msgr2=0x7f83b0104710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:26:52.544 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:52.539+0000 7f83b6400640 1 --2- 172.21.15.50:0/2195149016 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f83b0104300 0x7f83b0104710 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f839c009860 tx=0x7f839c02a340 comp rx=0 tx=0).stop 2024-08-31T04:26:52.544 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:52.539+0000 7f83b6400640 1 -- 172.21.15.50:0/2195149016 shutdown_connections 2024-08-31T04:26:52.544 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:52.539+0000 7f83b6400640 1 --2- 172.21.15.50:0/2195149016 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f83b0104ca0 0x7f83b010b640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:52.545 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:52.539+0000 7f83b6400640 1 --2- 172.21.15.50:0/2195149016 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f83b0104300 0x7f83b0104710 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:52.545 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:52.539+0000 7f83b6400640 1 --2- 172.21.15.50:0/2195149016 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f83b0103280 0x7f83b01036f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:52.545 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:52.539+0000 7f83b6400640 1 -- 172.21.15.50:0/2195149016 >> 172.21.15.50:0/2195149016 conn(0x7f83b00febc0 msgr2=0x7f83b0101070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:26:52.545 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:52.539+0000 7f83b6400640 1 -- 172.21.15.50:0/2195149016 shutdown_connections 2024-08-31T04:26:52.545 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:52.539+0000 7f83b6400640 1 -- 172.21.15.50:0/2195149016 wait complete. 2024-08-31T04:26:52.545 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:52.539+0000 7f83b6400640 1 Processor -- start 2024-08-31T04:26:52.546 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:52.539+0000 7f83b6400640 1 -- start start 2024-08-31T04:26:52.546 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:52.539+0000 7f83b6400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f83b0103280 0x7f83b019bd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:26:52.547 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:52.539+0000 7f83b6400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f83b0104300 0x7f83b019c3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:26:52.547 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:52.539+0000 7f83b6400640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f83b0104ca0 0x7f83b019cf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:26:52.547 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:52.539+0000 7f83b6400640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f83b010ef00 con 0x7f83b0103280 2024-08-31T04:26:52.547 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:52.539+0000 7f83b6400640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f83b010ed80 con 0x7f83b0104300 2024-08-31T04:26:52.547 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:52.539+0000 7f83b6400640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f83b010f080 con 0x7f83b0104ca0 2024-08-31T04:26:52.547 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:52.539+0000 7f83b5000640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f83b0103280 0x7f83b019bd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:26:52.547 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:52.539+0000 7f83b5000640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f83b0103280 0x7f83b019bd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:51538/0 (socket says 172.21.15.50:51538) 2024-08-31T04:26:52.547 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:52.539+0000 7f83b5000640 1 -- 172.21.15.50:0/406157038 learned_addr learned my addr 172.21.15.50:0/406157038 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:26:52.547 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:52.539+0000 7f83afe00640 1 --2- 172.21.15.50:0/406157038 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f83b0104300 0x7f83b019c3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:26:52.547 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:52.545+0000 7f83b5a00640 1 --2- 172.21.15.50:0/406157038 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f83b0104ca0 0x7f83b019cf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:26:52.547 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:52.545+0000 7f83b5000640 1 -- 172.21.15.50:0/406157038 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f83b0104ca0 msgr2=0x7f83b019cf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:26:52.548 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:52.545+0000 7f83b5000640 1 --2- 172.21.15.50:0/406157038 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f83b0104ca0 0x7f83b019cf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:52.548 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:52.545+0000 7f83b5000640 1 -- 172.21.15.50:0/406157038 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f83b0104300 msgr2=0x7f83b019c3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:26:52.551 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:52.545+0000 7f83b5000640 1 --2- 172.21.15.50:0/406157038 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f83b0104300 0x7f83b019c3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:52.551 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:52.545+0000 7f83b5000640 1 -- 172.21.15.50:0/406157038 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83b019d7b0 con 0x7f83b0103280 2024-08-31T04:26:52.551 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:52.545+0000 7f83b5a00640 1 --2- 172.21.15.50:0/406157038 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f83b0104ca0 0x7f83b019cf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:26:52.551 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:52.545+0000 7f83b5000640 1 --2- 172.21.15.50:0/406157038 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f83b0103280 0x7f83b019bd70 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f83a400e9f0 tx=0x7f83a400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:26:52.551 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:52.545+0000 7f83ad600640 1 -- 172.21.15.50:0/406157038 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83a400cd80 con 0x7f83b0103280 2024-08-31T04:26:52.552 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:52.545+0000 7f83ad600640 1 -- 172.21.15.50:0/406157038 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f83a40108e0 con 0x7f83b0103280 2024-08-31T04:26:52.552 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:52.545+0000 7f83b6400640 1 -- 172.21.15.50:0/406157038 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f83b019daa0 con 0x7f83b0103280 2024-08-31T04:26:52.552 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:52.545+0000 7f83ad600640 1 -- 172.21.15.50:0/406157038 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83a4018980 con 0x7f83b0103280 2024-08-31T04:26:52.552 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:52.545+0000 7f83b6400640 1 -- 172.21.15.50:0/406157038 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f83b01a4190 con 0x7f83b0103280 2024-08-31T04:26:52.552 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:52.545+0000 7f83bec4e740 1 Processor -- start 2024-08-31T04:26:52.557 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:52.550+0000 7f83bec4e740 1 -- start start 2024-08-31T04:26:52.557 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:52.550+0000 7f83bec4e740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559d7f6c01b0 0x559d7fa65fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:26:52.557 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:52.550+0000 7f83bec4e740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559d7f6972f0 0x559d7fa66610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:26:52.557 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:52.550+0000 7f83bec4e740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559d7f69f4d0 0x559d7fa67160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:26:52.557 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:52.550+0000 7f83bec4e740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x559d7f9d8f70 con 0x559d7f6972f0 2024-08-31T04:26:52.557 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:52.550+0000 7f83bec4e740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x559d7f9c8500 con 0x559d7f69f4d0 2024-08-31T04:26:52.557 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:52.550+0000 7f83bec4e740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x559d7f9cc4b0 con 0x559d7f6c01b0 2024-08-31T04:26:52.557 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:52.550+0000 7f83b5a00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559d7f6c01b0 0x559d7fa65fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:26:52.557 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:52.550+0000 7f83b5a00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559d7f6c01b0 0x559d7fa65fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.50:47988/0 (socket says 172.21.15.50:47988) 2024-08-31T04:26:52.557 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:52.550+0000 7f83b5a00640 1 -- 172.21.15.50:0/2215936670 learned_addr learned my addr 172.21.15.50:0/2215936670 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:26:52.557 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:52.550+0000 7f83ad600640 1 -- 172.21.15.50:0/406157038 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 18) ==== 152577+0+0 (secure 0 0 0) 0x7f83a4010430 con 0x7f83b0103280 2024-08-31T04:26:52.558 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:52.550+0000 7f83afe00640 1 --2- 172.21.15.50:0/2215936670 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559d7f69f4d0 0x559d7fa67160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:26:52.558 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:52.550+0000 7f83b5000640 1 --2- 172.21.15.50:0/2215936670 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559d7f6972f0 0x559d7fa66610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:26:52.558 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:52.550+0000 7f83afe00640 1 -- 172.21.15.50:0/2215936670 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559d7f6c01b0 msgr2=0x559d7fa65fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:26:52.558 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:52.550+0000 7f83afe00640 1 --2- 172.21.15.50:0/2215936670 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559d7f6c01b0 0x559d7fa65fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:52.558 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:52.550+0000 7f83afe00640 1 -- 172.21.15.50:0/2215936670 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559d7f6972f0 msgr2=0x559d7fa66610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:26:52.558 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:52.550+0000 7f83afe00640 1 --2- 172.21.15.50:0/2215936670 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559d7f6972f0 0x559d7fa66610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:52.558 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:52.550+0000 7f83afe00640 1 -- 172.21.15.50:0/2215936670 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559d7f982c10 con 0x559d7f69f4d0 2024-08-31T04:26:52.558 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:52.550+0000 7f83b5a00640 1 --2- 172.21.15.50:0/2215936670 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559d7f6c01b0 0x559d7fa65fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:26:52.558 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:52.550+0000 7f83afe00640 1 --2- 172.21.15.50:0/2215936670 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559d7f69f4d0 0x559d7fa67160 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f839c009830 tx=0x7f839c005cf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a6d0c7b18e8c461c server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:26:52.567 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:52.550+0000 7f83a2000640 1 -- 172.21.15.50:0/2215936670 <== mon.2 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f839c041070 con 0x559d7f69f4d0 2024-08-31T04:26:52.568 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:52.550+0000 7f83a2000640 1 -- 172.21.15.50:0/2215936670 <== mon.2 v2:172.21.15.133:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f839c030810 con 0x559d7f69f4d0 2024-08-31T04:26:52.568 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:52.550+0000 7f83a2000640 1 -- 172.21.15.50:0/2215936670 <== mon.2 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f839c037040 con 0x559d7f69f4d0 2024-08-31T04:26:52.568 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:52.550+0000 7f83ad600640 1 --2- 172.21.15.50:0/406157038 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f83980b4b30 0x7f83980b7040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:26:52.568 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:52.550+0000 7f83bec4e740 1 -- 172.21.15.50:0/2215936670 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559d7f69f4d0 msgr2=0x559d7fa67160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:26:52.568 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:52.550+0000 7f83bec4e740 1 --2- 172.21.15.50:0/2215936670 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559d7f69f4d0 0x559d7fa67160 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f839c009830 tx=0x7f839c005cf0 comp rx=0 tx=0).stop 2024-08-31T04:26:52.568 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:52.550+0000 7f83bec4e740 1 -- 172.21.15.50:0/2215936670 shutdown_connections 2024-08-31T04:26:52.568 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:52.550+0000 7f83bec4e740 1 --2- 172.21.15.50:0/2215936670 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559d7f69f4d0 0x559d7fa67160 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:52.568 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:52.550+0000 7f83ad600640 1 -- 172.21.15.50:0/406157038 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8219+0+0 (secure 0 0 0) 0x7f83a40e5540 con 0x7f83b0103280 2024-08-31T04:26:52.568 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:52.550+0000 7f83bec4e740 1 --2- 172.21.15.50:0/2215936670 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559d7f6972f0 0x559d7fa66610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:52.568 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:52.550+0000 7f83bec4e740 1 --2- 172.21.15.50:0/2215936670 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559d7f6c01b0 0x559d7fa65fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:52.568 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:52.550+0000 7f83bec4e740 1 -- 172.21.15.50:0/2215936670 >> 172.21.15.50:0/2215936670 conn(0x559d7f6b4300 msgr2=0x559d7fa61a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:26:52.569 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:52.550+0000 7f83b5a00640 1 --2- 172.21.15.50:0/406157038 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f83980b4b30 0x7f83980b7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:26:52.569 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:52.550+0000 7f83bec4e740 1 -- 172.21.15.50:0/2215936670 shutdown_connections 2024-08-31T04:26:52.569 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:52.550+0000 7f83bec4e740 1 -- 172.21.15.50:0/2215936670 wait complete. 2024-08-31T04:26:52.569 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:52.550+0000 7f83b5a00640 1 --2- 172.21.15.50:0/406157038 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f83980b4b30 0x7f83980b7040 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f83a8005fd0 tx=0x7f83a8011040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:26:52.569 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:52.550+0000 7f83bec4e740 1 -- start start 2024-08-31T04:26:52.569 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:52.550+0000 7f83bec4e740 1 Processor -- start 2024-08-31T04:26:52.569 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:52.550+0000 7f83bec4e740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559d7f6972f0 0x559d7fa6f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:26:52.569 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:52.550+0000 7f83bec4e740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559d7f69f4d0 0x559d7fa6fc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:26:52.569 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:52.550+0000 7f83bec4e740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559d7f6c01b0 0x559d7fa70790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:26:52.569 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:52.550+0000 7f83bec4e740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x559d7f901ab0 con 0x559d7f69f4d0 2024-08-31T04:26:52.569 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:52.550+0000 7f83bec4e740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x559d7f96f320 con 0x559d7f6c01b0 2024-08-31T04:26:52.569 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:52.550+0000 7f83bec4e740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x559d7fa67c20 con 0x559d7f6972f0 2024-08-31T04:26:52.569 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:52.550+0000 7f83bec4e740 10 client.0 _ll_register_callbacks cb 0x559d7f9756a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:26:52.570 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:52.550+0000 7f83afe00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559d7f69f4d0 0x559d7fa6fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:26:52.570 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:52.555+0000 7f83afe00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559d7f69f4d0 0x559d7fa6fc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:51564/0 (socket says 172.21.15.50:51564) 2024-08-31T04:26:52.570 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:52.555+0000 7f83afe00640 1 -- 172.21.15.50:0/450760609 learned_addr learned my addr 172.21.15.50:0/450760609 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:26:52.570 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:52.555+0000 7f83b5000640 1 --2- 172.21.15.50:0/450760609 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559d7f6972f0 0x559d7fa6f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:26:52.570 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:52.555+0000 7f83b5a00640 1 --2- 172.21.15.50:0/450760609 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559d7f6c01b0 0x559d7fa70790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:26:52.570 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:52.555+0000 7f83afe00640 1 -- 172.21.15.50:0/450760609 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559d7f6972f0 msgr2=0x559d7fa6f5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:26:52.570 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:52.555+0000 7f83afe00640 1 --2- 172.21.15.50:0/450760609 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559d7f6972f0 0x559d7fa6f5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:52.570 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:52.555+0000 7f83afe00640 1 -- 172.21.15.50:0/450760609 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559d7f6c01b0 msgr2=0x559d7fa70790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:26:52.570 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:52.555+0000 7f83afe00640 1 --2- 172.21.15.50:0/450760609 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559d7f6c01b0 0x559d7fa70790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:52.570 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:52.555+0000 7f83afe00640 1 -- 172.21.15.50:0/450760609 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559d7f72b790 con 0x559d7f69f4d0 2024-08-31T04:26:52.570 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:52.555+0000 7f83afe00640 1 --2- 172.21.15.50:0/450760609 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559d7f69f4d0 0x559d7fa6fc90 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f839c035040 tx=0x7f839c030ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=efb069188ec9b294 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:26:52.570 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:52.555+0000 7f8396a00640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-08-31T04:26:52.570 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:52.555+0000 7f8396a00640 1 -- 172.21.15.50:0/450760609 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f839c037030 con 0x559d7f69f4d0 2024-08-31T04:26:52.571 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:52.555+0000 7f83bec4e740 1 -- 172.21.15.50:0/450760609 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f839c030810 con 0x559d7f69f4d0 2024-08-31T04:26:52.571 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:52.555+0000 7f8396a00640 1 -- 172.21.15.50:0/450760609 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8219+0+0 (secure 0 0 0) 0x7f839c004230 con 0x559d7f69f4d0 2024-08-31T04:26:52.571 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:52.555+0000 7f8396a00640 1 -- 172.21.15.50:0/450760609 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f839c056050 con 0x559d7f69f4d0 2024-08-31T04:26:52.571 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:52.555+0000 7f83bec4e740 10 client.15768 fetch_fsmap learned FSMap version 33 2024-08-31T04:26:52.571 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:52.555+0000 7f83bec4e740 1 -- 172.21.15.50:0/450760609 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x559d7f7a4620 con 0x559d7f69f4d0 2024-08-31T04:26:52.571 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:52.555+0000 7f8396a00640 1 -- 172.21.15.50:0/450760609 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f839c030810 con 0x559d7f69f4d0 2024-08-31T04:26:52.571 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:52.555+0000 7f8396a00640 1 -- 172.21.15.50:0/450760609 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 33) ==== 8378+0+0 (secure 0 0 0) 0x7f839c03d860 con 0x559d7f69f4d0 2024-08-31T04:26:52.571 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:52.555+0000 7f83bec4e740 10 client.15768 fetch_fsmap finished waiting for FSMap version 33 2024-08-31T04:26:52.571 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:52.555+0000 7f83bec4e740 10 client.15768 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T04:26:52.572 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:52.555+0000 7f83bec4e740 20 client.15768 populate_metadata read hostname 'smithi050' 2024-08-31T04:26:52.572 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:52.555+0000 7f83bec4e740 1 --2- 172.21.15.50:0/450760609 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x559d7f67ed80 0x559d7fa7c890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:26:52.572 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:52.555+0000 7f83bec4e740 4 client.15768 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T04:26:52.572 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:52.555+0000 7f83bec4e740 1 -- 172.21.15.50:0/450760609 --> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559d7f9daec0 con 0x559d7f67ed80 2024-08-31T04:26:52.572 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:52.555+0000 7f83b5000640 1 --2- 172.21.15.50:0/450760609 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x559d7f67ed80 0x559d7fa7c890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:26:52.572 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:52.555+0000 7f83b5000640 1 --2- 172.21.15.50:0/450760609 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x559d7f67ed80 0x559d7fa7c890 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2cf3e1ef4b1d4d7e server_cookie=6000da94b01ad725 in_seq=0 out_seq=0 2024-08-31T04:26:52.572 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:52.555+0000 7f8396a00640 10 client.15768 ms_handle_connect on v2:172.21.15.133:6838/2526402262 2024-08-31T04:26:52.572 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:52.555+0000 7f8396a00640 1 -- 172.21.15.50:0/450760609 <== mds.0 v2:172.21.15.133:6838/2526402262 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x559d7f9daec0 con 0x559d7f67ed80 2024-08-31T04:26:52.572 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:52.555+0000 7f8396a00640 10 client.15768 handle_command_reply: tid=0 2024-08-31T04:26:52.572 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:52.555+0000 7f83bec4e740 1 client.15768 shutdown 2024-08-31T04:26:52.572 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:52.555+0000 7f83bec4e740 1 -- 172.21.15.50:0/450760609 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559d7f69f4d0 msgr2=0x559d7fa6fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:26:52.572 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:52.555+0000 7f83bec4e740 1 --2- 172.21.15.50:0/450760609 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559d7f69f4d0 0x559d7fa6fc90 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f839c035040 tx=0x7f839c030ef0 comp rx=0 tx=0).stop 2024-08-31T04:26:52.573 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:52.555+0000 7f83bec4e740 1 -- 172.21.15.50:0/450760609 shutdown_connections 2024-08-31T04:26:52.573 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:52.555+0000 7f83bec4e740 1 --2- 172.21.15.50:0/450760609 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x559d7f67ed80 0x559d7fa7c890 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:52.573 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:52.555+0000 7f83bec4e740 1 --2- 172.21.15.50:0/450760609 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559d7f6c01b0 0x559d7fa70790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:52.573 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:52.555+0000 7f83bec4e740 1 --2- 172.21.15.50:0/450760609 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559d7f69f4d0 0x559d7fa6fc90 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:52.573 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:52.555+0000 7f83bec4e740 1 --2- 172.21.15.50:0/450760609 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559d7f6972f0 0x559d7fa6f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:52.573 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:52.555+0000 7f83bec4e740 1 -- 172.21.15.50:0/450760609 >> 172.21.15.50:0/450760609 conn(0x559d7f6b4300 msgr2=0x559d7fa62630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:26:52.573 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:52.555+0000 7f8396a00640 0 client.15768 ms_handle_reset on v2:172.21.15.133:6838/2526402262 2024-08-31T04:26:52.573 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:52.555+0000 7f83bec4e740 1 -- 172.21.15.50:0/450760609 shutdown_connections 2024-08-31T04:26:52.573 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:52.555+0000 7f83bec4e740 1 -- 172.21.15.50:0/450760609 wait complete. 2024-08-31T04:26:52.573 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:52.555+0000 7f83bec4e740 20 client.15768 trim_cache size 0 max 16384 2024-08-31T04:26:52.576 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:52.574+0000 7f83bec4e740 1 Processor -- start 2024-08-31T04:26:52.576 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:52.574+0000 7f83bec4e740 1 -- start start 2024-08-31T04:26:52.577 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:52.574+0000 7f83bec4e740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559d7f6972f0 0x559d7fa6e7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:26:52.577 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:52.574+0000 7f83bec4e740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559d7f69f4d0 0x559d7fa6f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:26:52.577 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:52.574+0000 7f83bec4e740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559d7f6c01b0 0x559d7fa6fb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:26:52.578 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:52.574+0000 7f83bec4e740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f83b01acd20 con 0x559d7f69f4d0 2024-08-31T04:26:52.578 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:52.574+0000 7f83bec4e740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f83b01ae920 con 0x559d7f6c01b0 2024-08-31T04:26:52.578 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:52.574+0000 7f83bec4e740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f83b01ad3f0 con 0x559d7f6972f0 2024-08-31T04:26:52.578 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:52.574+0000 7f83afe00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559d7f69f4d0 0x559d7fa6f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:26:52.578 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:52.574+0000 7f83afe00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559d7f69f4d0 0x559d7fa6f5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:51568/0 (socket says 172.21.15.50:51568) 2024-08-31T04:26:52.578 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:52.574+0000 7f83afe00640 1 -- 172.21.15.50:0/3618646862 learned_addr learned my addr 172.21.15.50:0/3618646862 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:26:52.578 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:52.574+0000 7f83b5000640 1 --2- 172.21.15.50:0/3618646862 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559d7f6972f0 0x559d7fa6e7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:26:52.578 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:52.574+0000 7f83b5a00640 1 --2- 172.21.15.50:0/3618646862 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559d7f6c01b0 0x559d7fa6fb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:26:52.578 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:52.574+0000 7f83afe00640 1 -- 172.21.15.50:0/3618646862 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559d7f6972f0 msgr2=0x559d7fa6e7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:26:52.578 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:52.574+0000 7f83afe00640 1 --2- 172.21.15.50:0/3618646862 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559d7f6972f0 0x559d7fa6e7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:52.578 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:52.574+0000 7f83afe00640 1 -- 172.21.15.50:0/3618646862 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559d7f6c01b0 msgr2=0x559d7fa6fb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:26:52.578 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:52.574+0000 7f83afe00640 1 --2- 172.21.15.50:0/3618646862 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559d7f6c01b0 0x559d7fa6fb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:52.578 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:52.574+0000 7f83afe00640 1 -- 172.21.15.50:0/3618646862 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559d7fa674d0 con 0x559d7f69f4d0 2024-08-31T04:26:52.579 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:52.574+0000 7f83b5a00640 1 --2- 172.21.15.50:0/3618646862 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559d7f6c01b0 0x559d7fa6fb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:26:52.579 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:52.574+0000 7f83afe00640 1 --2- 172.21.15.50:0/3618646862 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559d7f69f4d0 0x559d7fa6f5d0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f839c03dc30 tx=0x7f839c005fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8347c4b32c68c6f2 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:26:52.579 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:52.574+0000 7f83a1600640 1 -- 172.21.15.50:0/3618646862 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f839c037040 con 0x559d7f69f4d0 2024-08-31T04:26:52.579 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:52.574+0000 7f83a1600640 1 -- 172.21.15.50:0/3618646862 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f839c004430 con 0x559d7f69f4d0 2024-08-31T04:26:52.579 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:52.574+0000 7f83a1600640 1 -- 172.21.15.50:0/3618646862 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f839c041040 con 0x559d7f69f4d0 2024-08-31T04:26:52.582 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:52.574+0000 7f83bec4e740 1 -- 172.21.15.50:0/3618646862 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559d7f69f4d0 msgr2=0x559d7fa6f5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:26:52.582 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:52.574+0000 7f83bec4e740 1 --2- 172.21.15.50:0/3618646862 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559d7f69f4d0 0x559d7fa6f5d0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f839c03dc30 tx=0x7f839c005fd0 comp rx=0 tx=0).stop 2024-08-31T04:26:52.582 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:52.574+0000 7f83bec4e740 1 -- 172.21.15.50:0/3618646862 shutdown_connections 2024-08-31T04:26:52.582 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:52.574+0000 7f83bec4e740 1 --2- 172.21.15.50:0/3618646862 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559d7f6c01b0 0x559d7fa6fb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:52.582 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:52.574+0000 7f83bec4e740 1 --2- 172.21.15.50:0/3618646862 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559d7f69f4d0 0x559d7fa6f5d0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:52.582 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:52.574+0000 7f83bec4e740 1 --2- 172.21.15.50:0/3618646862 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559d7f6972f0 0x559d7fa6e7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:52.582 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:52.574+0000 7f83bec4e740 1 -- 172.21.15.50:0/3618646862 >> 172.21.15.50:0/3618646862 conn(0x559d7f6b4300 msgr2=0x559d7fa6db60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:26:52.582 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:52.574+0000 7f83bec4e740 1 -- 172.21.15.50:0/3618646862 shutdown_connections 2024-08-31T04:26:52.582 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:52.574+0000 7f83bec4e740 1 -- 172.21.15.50:0/3618646862 wait complete. 2024-08-31T04:26:52.583 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:52.574+0000 7f83bec4e740 1 -- start start 2024-08-31T04:26:52.583 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:52.574+0000 7f83bec4e740 1 Processor -- start 2024-08-31T04:26:52.583 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:52.574+0000 7f83bec4e740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559d7f6972f0 0x559d7fa74600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:26:52.583 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:52.574+0000 7f83bec4e740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559d7f69f4d0 0x559d7fa74cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:26:52.583 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:52.574+0000 7f83bec4e740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559d7f6c01b0 0x559d7fa75830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:26:52.583 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:52.574+0000 7f83bec4e740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f83b01ae250 con 0x559d7f6c01b0 2024-08-31T04:26:52.583 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:52.574+0000 7f83bec4e740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f83b01adac0 con 0x559d7f6972f0 2024-08-31T04:26:52.583 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:52.574+0000 7f83bec4e740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f83b01aad00 con 0x559d7f69f4d0 2024-08-31T04:26:52.583 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:52.574+0000 7f83bec4e740 10 client.0 _ll_register_callbacks cb 0x7f839c0096b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:26:52.583 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:52.574+0000 7f83b5a00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559d7f6c01b0 0x559d7fa75830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:26:52.583 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:52.574+0000 7f83b5a00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559d7f6c01b0 0x559d7fa75830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:51570/0 (socket says 172.21.15.50:51570) 2024-08-31T04:26:52.583 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:52.574+0000 7f83b5a00640 1 -- 172.21.15.50:0/1583717889 learned_addr learned my addr 172.21.15.50:0/1583717889 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:26:52.583 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:52.574+0000 7f83afe00640 1 --2- 172.21.15.50:0/1583717889 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559d7f69f4d0 0x559d7fa74cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:26:52.584 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:52.574+0000 7f83b5a00640 1 -- 172.21.15.50:0/1583717889 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559d7f69f4d0 msgr2=0x559d7fa74cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:26:52.584 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:52.574+0000 7f83b5a00640 1 --2- 172.21.15.50:0/1583717889 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559d7f69f4d0 0x559d7fa74cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:52.584 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:52.574+0000 7f83b5a00640 1 -- 172.21.15.50:0/1583717889 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559d7f6972f0 msgr2=0x559d7fa74600 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-08-31T04:26:52.584 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:52.574+0000 7f83b5a00640 1 --2- 172.21.15.50:0/1583717889 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559d7f6972f0 0x559d7fa74600 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:52.584 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:52.574+0000 7f83b5a00640 1 -- 172.21.15.50:0/1583717889 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559d7fa75f90 con 0x559d7f6c01b0 2024-08-31T04:26:52.584 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:52.574+0000 7f83b5a00640 1 --2- 172.21.15.50:0/1583717889 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559d7f6c01b0 0x559d7fa75830 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f83a8019df0 tx=0x7f83a8004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f93577a9e5b466e7 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:26:52.584 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:52.574+0000 7f8396a00640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-08-31T04:26:52.584 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:52.580+0000 7f8396a00640 1 -- 172.21.15.50:0/1583717889 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83a8028460 con 0x559d7f6c01b0 2024-08-31T04:26:52.584 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:52.580+0000 7f83bec4e740 1 -- 172.21.15.50:0/1583717889 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f839c004430 con 0x559d7f6c01b0 2024-08-31T04:26:52.584 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:52.580+0000 7f8396a00640 1 -- 172.21.15.50:0/1583717889 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8219+0+0 (secure 0 0 0) 0x7f83a8028600 con 0x559d7f6c01b0 2024-08-31T04:26:52.584 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:52.580+0000 7f8396a00640 1 -- 172.21.15.50:0/1583717889 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f83a8028840 con 0x559d7f6c01b0 2024-08-31T04:26:52.584 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:52.580+0000 7f83bec4e740 10 client.15774 fetch_fsmap learned FSMap version 33 2024-08-31T04:26:52.584 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:52.580+0000 7f83bec4e740 1 -- 172.21.15.50:0/1583717889 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x559d7fa77380 con 0x559d7f6c01b0 2024-08-31T04:26:52.584 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:52.580+0000 7f8396a00640 1 -- 172.21.15.50:0/1583717889 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f839c004430 con 0x559d7f6c01b0 2024-08-31T04:26:52.585 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:52.580+0000 7f8396a00640 1 -- 172.21.15.50:0/1583717889 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 33) ==== 8378+0+0 (secure 0 0 0) 0x7f83a800b040 con 0x559d7f6c01b0 2024-08-31T04:26:52.585 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:52.580+0000 7f83bec4e740 10 client.15774 fetch_fsmap finished waiting for FSMap version 33 2024-08-31T04:26:52.585 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:52.580+0000 7f83bec4e740 10 client.15774 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T04:26:52.585 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:52.580+0000 7f83bec4e740 20 client.15774 populate_metadata read hostname 'smithi050' 2024-08-31T04:26:52.585 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:52.580+0000 7f83bec4e740 1 --2- 172.21.15.50:0/1583717889 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x559d7f6541c0 0x559d7fae9800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:26:52.585 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:52.580+0000 7f83bec4e740 4 client.15774 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-31T04:26:52.585 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:52.580+0000 7f83bec4e740 1 -- 172.21.15.50:0/1583717889 --> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] -- command(tid 0: {"prefix": "flush journal"}) -- 0x559d7f9d6960 con 0x559d7f6541c0 2024-08-31T04:26:52.587 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:52.586+0000 7f83b5000640 1 --2- 172.21.15.50:0/1583717889 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x559d7f6541c0 0x559d7fae9800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:26:52.587 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:52.586+0000 7f83b5000640 1 --2- 172.21.15.50:0/1583717889 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x559d7f6541c0 0x559d7fae9800 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=71fe7c1e2d14b64 server_cookie=1e1224cc7a13a91c in_seq=0 out_seq=0 2024-08-31T04:26:52.587 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:52.586+0000 7f8396a00640 10 client.15774 ms_handle_connect on v2:172.21.15.133:6838/2526402262 2024-08-31T04:26:52.769 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:52.763+0000 7f8396a00640 1 -- 172.21.15.50:0/1583717889 <== mds.0 v2:172.21.15.133:6838/2526402262 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x559d7f9d6960 con 0x559d7f6541c0 2024-08-31T04:26:52.769 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:52.763+0000 7f8396a00640 10 client.15774 handle_command_reply: tid=0 2024-08-31T04:26:52.770 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:52.763+0000 7f83bec4e740 1 client.15774 shutdown 2024-08-31T04:26:52.770 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:52.768+0000 7f83bec4e740 1 -- 172.21.15.50:0/1583717889 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559d7f6c01b0 msgr2=0x559d7fa75830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:26:52.770 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:52.768+0000 7f83bec4e740 1 --2- 172.21.15.50:0/1583717889 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559d7f6c01b0 0x559d7fa75830 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f83a8019df0 tx=0x7f83a8004ab0 comp rx=0 tx=0).stop 2024-08-31T04:26:52.770 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:52.768+0000 7f83bec4e740 1 -- 172.21.15.50:0/1583717889 shutdown_connections 2024-08-31T04:26:52.770 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:52.768+0000 7f83bec4e740 1 --2- 172.21.15.50:0/1583717889 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x559d7f6541c0 0x559d7fae9800 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:52.770 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:52.768+0000 7f83bec4e740 1 --2- 172.21.15.50:0/1583717889 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559d7f69f4d0 0x559d7fa74cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:52.770 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:52.768+0000 7f83bec4e740 1 --2- 172.21.15.50:0/1583717889 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559d7f6c01b0 0x559d7fa75830 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:52.770 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:52.768+0000 7f83bec4e740 1 --2- 172.21.15.50:0/1583717889 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559d7f6972f0 0x559d7fa74600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:52.770 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:52.768+0000 7f83bec4e740 1 -- 172.21.15.50:0/1583717889 >> 172.21.15.50:0/1583717889 conn(0x559d7f6b4300 msgr2=0x559d7fa6a000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:26:52.770 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:52.768+0000 7f8396a00640 0 client.15774 ms_handle_reset on v2:172.21.15.133:6838/2526402262 2024-08-31T04:26:52.770 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:52.768+0000 7f83bec4e740 1 -- 172.21.15.50:0/1583717889 shutdown_connections 2024-08-31T04:26:52.770 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:52.768+0000 7f83bec4e740 1 -- 172.21.15.50:0/1583717889 wait complete. 2024-08-31T04:26:52.770 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:52.768+0000 7f83bec4e740 20 client.15774 trim_cache size 0 max 16384 2024-08-31T04:26:52.771 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout:{ 2024-08-31T04:26:52.771 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout: "message": "", 2024-08-31T04:26:52.771 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout: "return_code": 0 2024-08-31T04:26:52.771 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout:} 2024-08-31T04:26:52.772 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:52.768+0000 7f83b6400640 1 -- 172.21.15.50:0/406157038 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f83980b4b30 msgr2=0x7f83980b7040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:26:52.772 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:52.768+0000 7f83b6400640 1 --2- 172.21.15.50:0/406157038 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f83980b4b30 0x7f83980b7040 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f83a8005fd0 tx=0x7f83a8011040 comp rx=0 tx=0).stop 2024-08-31T04:26:52.772 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:52.768+0000 7f83b6400640 1 -- 172.21.15.50:0/406157038 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f83b0103280 msgr2=0x7f83b019bd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:26:52.772 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:52.768+0000 7f83b6400640 1 --2- 172.21.15.50:0/406157038 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f83b0103280 0x7f83b019bd70 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f83a400e9f0 tx=0x7f83a400eeb0 comp rx=0 tx=0).stop 2024-08-31T04:26:52.772 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:52.768+0000 7f83b6400640 1 -- 172.21.15.50:0/406157038 shutdown_connections 2024-08-31T04:26:52.772 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:52.768+0000 7f83b6400640 1 --2- 172.21.15.50:0/406157038 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f83980b4b30 0x7f83980b7040 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:52.772 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:52.768+0000 7f83b6400640 1 --2- 172.21.15.50:0/406157038 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f83b0104ca0 0x7f83b019cf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:52.773 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:52.768+0000 7f83b6400640 1 --2- 172.21.15.50:0/406157038 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f83b0104300 0x7f83b019c3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:52.773 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:52.768+0000 7f83b6400640 1 --2- 172.21.15.50:0/406157038 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f83b0103280 0x7f83b019bd70 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:26:52.773 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:52.768+0000 7f83b6400640 1 -- 172.21.15.50:0/406157038 >> 172.21.15.50:0/406157038 conn(0x7f83b00febc0 msgr2=0x7f83b0075390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:26:52.773 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:52.768+0000 7f83b6400640 1 -- 172.21.15.50:0/406157038 shutdown_connections 2024-08-31T04:26:52.773 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:26:52.768+0000 7f83b6400640 1 -- 172.21.15.50:0/406157038 wait complete. 2024-08-31T04:26:53.751 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:26:53 smithi050 ceph-mon[17259]: pgmap v487: 97 pgs: 97 active+clean; 545 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 14 MiB/s wr, 1.22k op/s 2024-08-31T04:26:53.792 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:26:53 smithi133 ceph-mon[22177]: pgmap v487: 97 pgs: 97 active+clean; 545 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 14 MiB/s wr, 1.22k op/s 2024-08-31T04:26:53.996 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:26:53 smithi177 ceph-mon[22025]: pgmap v487: 97 pgs: 97 active+clean; 545 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 14 MiB/s wr, 1.22k op/s 2024-08-31T04:26:55.450 INFO:tasks.workunit.client.0.smithi050.stdout: 158 59 0 61 0 44 0 2024-08-31T04:26:55.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:26:55 smithi133 ceph-mon[22177]: pgmap v488: 97 pgs: 97 active+clean; 545 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 11 MiB/s wr, 784 op/s 2024-08-31T04:26:55.950 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:26:55 smithi050 ceph-mon[17259]: pgmap v488: 97 pgs: 97 active+clean; 545 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 11 MiB/s wr, 784 op/s 2024-08-31T04:26:55.996 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:26:55 smithi177 ceph-mon[22025]: pgmap v488: 97 pgs: 97 active+clean; 545 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 11 MiB/s wr, 784 op/s 2024-08-31T04:26:57.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:26:57 smithi133 ceph-mon[22177]: pgmap v489: 97 pgs: 97 active+clean; 541 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 9.3 MiB/s wr, 685 op/s 2024-08-31T04:26:57.953 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:26:57 smithi050 ceph-mon[17259]: pgmap v489: 97 pgs: 97 active+clean; 541 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 9.3 MiB/s wr, 685 op/s 2024-08-31T04:26:57.996 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:26:57 smithi177 ceph-mon[22025]: pgmap v489: 97 pgs: 97 active+clean; 541 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 9.3 MiB/s wr, 685 op/s 2024-08-31T04:26:59.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:26:59 smithi133 ceph-mon[22177]: pgmap v490: 97 pgs: 97 active+clean; 537 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 3.1 MiB/s wr, 212 op/s 2024-08-31T04:26:59.950 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:26:59 smithi050 ceph-mon[17259]: pgmap v490: 97 pgs: 97 active+clean; 537 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 3.1 MiB/s wr, 212 op/s 2024-08-31T04:26:59.996 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:26:59 smithi177 ceph-mon[22025]: pgmap v490: 97 pgs: 97 active+clean; 537 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 3.1 MiB/s wr, 212 op/s 2024-08-31T04:27:01.950 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:27:01 smithi050 ceph-mon[17259]: pgmap v491: 97 pgs: 97 active+clean; 537 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.0 MiB/s wr, 96 op/s 2024-08-31T04:27:01.996 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:27:01 smithi177 ceph-mon[22025]: pgmap v491: 97 pgs: 97 active+clean; 537 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.0 MiB/s wr, 96 op/s 2024-08-31T04:27:02.043 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:27:01 smithi133 ceph-mon[22177]: pgmap v491: 97 pgs: 97 active+clean; 537 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.0 MiB/s wr, 96 op/s 2024-08-31T04:27:03.950 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:27:03 smithi050 ceph-mon[17259]: pgmap v492: 97 pgs: 97 active+clean; 537 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.5 MiB/s wr, 94 op/s 2024-08-31T04:27:03.996 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:27:03 smithi177 ceph-mon[22025]: pgmap v492: 97 pgs: 97 active+clean; 537 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.5 MiB/s wr, 94 op/s 2024-08-31T04:27:04.043 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:27:03 smithi133 ceph-mon[22177]: pgmap v492: 97 pgs: 97 active+clean; 537 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.5 MiB/s wr, 94 op/s 2024-08-31T04:27:05.450 INFO:tasks.workunit.client.0.smithi050.stdout: 158 0 0 0 0 0 0 2024-08-31T04:27:05.950 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:27:05 smithi050 ceph-mon[17259]: pgmap v493: 97 pgs: 97 active+clean; 537 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 198 KiB/s wr, 64 op/s 2024-08-31T04:27:05.966 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:05.964+0000 7fcf58600640 1 -- 172.21.15.50:0/504186665 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcf501091b0 msgr2=0x7fcf5010b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:27:05.966 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:05.964+0000 7fcf58600640 1 --2- 172.21.15.50:0/504186665 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcf501091b0 0x7fcf5010b6c0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fcf48009ca0 tx=0x7fcf4802a8c0 comp rx=0 tx=0).stop 2024-08-31T04:27:05.967 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:05.964+0000 7fcf58600640 1 -- 172.21.15.50:0/504186665 shutdown_connections 2024-08-31T04:27:05.967 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:05.964+0000 7fcf58600640 1 --2- 172.21.15.50:0/504186665 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcf501091b0 0x7fcf5010b6c0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:05.967 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:05.964+0000 7fcf58600640 1 --2- 172.21.15.50:0/504186665 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcf501065f0 0x7fcf50108a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:05.967 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:05.964+0000 7fcf58600640 1 --2- 172.21.15.50:0/504186665 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcf5006c250 0x7fcf501060b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:05.967 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:05.964+0000 7fcf58600640 1 -- 172.21.15.50:0/504186665 >> 172.21.15.50:0/504186665 conn(0x7fcf500fdcd0 msgr2=0x7fcf50100160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:27:05.967 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:05.964+0000 7fcf58600640 1 -- 172.21.15.50:0/504186665 shutdown_connections 2024-08-31T04:27:05.967 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:05.964+0000 7fcf58600640 1 -- 172.21.15.50:0/504186665 wait complete. 2024-08-31T04:27:05.968 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:05.964+0000 7fcf58600640 1 Processor -- start 2024-08-31T04:27:05.969 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:05.964+0000 7fcf58600640 1 -- start start 2024-08-31T04:27:05.969 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:05.964+0000 7fcf58600640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcf5006c250 0x7fcf501036f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:27:05.969 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:05.964+0000 7fcf58600640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcf501065f0 0x7fcf50101fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:27:05.969 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:05.964+0000 7fcf58600640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcf501091b0 0x7fcf501024f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:27:05.969 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:05.964+0000 7fcf58600640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fcf5010f120 con 0x7fcf5006c250 2024-08-31T04:27:05.969 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:05.964+0000 7fcf58600640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7fcf5010efa0 con 0x7fcf501091b0 2024-08-31T04:27:05.969 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:05.964+0000 7fcf58600640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fcf5010f2a0 con 0x7fcf501065f0 2024-08-31T04:27:05.969 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:05.964+0000 7fcf55c00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcf5006c250 0x7fcf501036f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:27:05.969 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:05.964+0000 7fcf55c00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcf5006c250 0x7fcf501036f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:51098/0 (socket says 172.21.15.50:51098) 2024-08-31T04:27:05.969 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:05.964+0000 7fcf55c00640 1 -- 172.21.15.50:0/1259650255 learned_addr learned my addr 172.21.15.50:0/1259650255 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:27:05.969 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:05.964+0000 7fcf56600640 1 --2- 172.21.15.50:0/1259650255 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcf501091b0 0x7fcf501024f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:27:05.969 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:05.964+0000 7fcf55c00640 1 -- 172.21.15.50:0/1259650255 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcf501065f0 msgr2=0x7fcf50101fb0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-08-31T04:27:05.970 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:05.964+0000 7fcf55c00640 1 --2- 172.21.15.50:0/1259650255 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcf501065f0 0x7fcf50101fb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:05.970 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:05.964+0000 7fcf55c00640 1 -- 172.21.15.50:0/1259650255 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcf501091b0 msgr2=0x7fcf501024f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:27:05.970 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:05.964+0000 7fcf55c00640 1 --2- 172.21.15.50:0/1259650255 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcf501091b0 0x7fcf501024f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:05.970 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:05.964+0000 7fcf55c00640 1 -- 172.21.15.50:0/1259650255 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf50102c20 con 0x7fcf5006c250 2024-08-31T04:27:05.970 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:05.964+0000 7fcf56600640 1 --2- 172.21.15.50:0/1259650255 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcf501091b0 0x7fcf501024f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:27:05.970 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:05.964+0000 7fcf55c00640 1 --2- 172.21.15.50:0/1259650255 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcf5006c250 0x7fcf501036f0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fcf4400e9f0 tx=0x7fcf4400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:27:05.971 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:05.964+0000 7fcf4e000640 1 -- 172.21.15.50:0/1259650255 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf4400cd80 con 0x7fcf5006c250 2024-08-31T04:27:05.971 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:05.964+0000 7fcf4e000640 1 -- 172.21.15.50:0/1259650255 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcf440054d0 con 0x7fcf5006c250 2024-08-31T04:27:05.972 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:05.964+0000 7fcf58600640 1 -- 172.21.15.50:0/1259650255 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcf501a3d50 con 0x7fcf5006c250 2024-08-31T04:27:05.972 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:05.964+0000 7fcf4e000640 1 -- 172.21.15.50:0/1259650255 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf44010690 con 0x7fcf5006c250 2024-08-31T04:27:05.972 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:05.964+0000 7fcf58600640 1 -- 172.21.15.50:0/1259650255 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcf501a41c0 con 0x7fcf5006c250 2024-08-31T04:27:05.972 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:05.969+0000 7fcf5f6c8740 1 Processor -- start 2024-08-31T04:27:05.972 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:05.969+0000 7fcf5f6c8740 1 -- start start 2024-08-31T04:27:05.974 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:05.969+0000 7fcf5f6c8740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56220bf7e1b0 0x56220c323dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:27:05.974 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:05.969+0000 7fcf5f6c8740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56220bf552f0 0x56220c324430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:27:05.974 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:05.969+0000 7fcf5f6c8740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56220bf5d4d0 0x56220c324f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:27:05.974 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:05.969+0000 7fcf5f6c8740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x56220c296f70 con 0x56220bf7e1b0 2024-08-31T04:27:05.974 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:05.969+0000 7fcf5f6c8740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x56220c286500 con 0x56220bf5d4d0 2024-08-31T04:27:05.974 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:05.969+0000 7fcf5f6c8740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x56220c28a4b0 con 0x56220bf552f0 2024-08-31T04:27:05.974 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:05.969+0000 7fcf4e000640 1 -- 172.21.15.50:0/1259650255 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 18) ==== 152577+0+0 (secure 0 0 0) 0x7fcf44004e90 con 0x7fcf5006c250 2024-08-31T04:27:05.975 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:05.969+0000 7fcf56600640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56220bf7e1b0 0x56220c323dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:27:05.975 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:05.969+0000 7fcf56600640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56220bf7e1b0 0x56220c323dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:51114/0 (socket says 172.21.15.50:51114) 2024-08-31T04:27:05.975 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:05.969+0000 7fcf56600640 1 -- 172.21.15.50:0/4181179109 learned_addr learned my addr 172.21.15.50:0/4181179109 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:27:05.975 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:05.969+0000 7fcf55c00640 1 --2- 172.21.15.50:0/4181179109 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56220bf552f0 0x56220c324430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:27:05.975 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:05.969+0000 7fcf56600640 1 -- 172.21.15.50:0/4181179109 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56220bf552f0 msgr2=0x56220c324430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:27:05.975 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:05.969+0000 7fcf56600640 1 --2- 172.21.15.50:0/4181179109 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56220bf552f0 0x56220c324430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:05.975 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:05.969+0000 7fcf56600640 1 -- 172.21.15.50:0/4181179109 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56220bf5d4d0 msgr2=0x56220c324f80 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-08-31T04:27:05.975 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:05.969+0000 7fcf56600640 1 --2- 172.21.15.50:0/4181179109 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56220bf5d4d0 0x56220c324f80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:05.975 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:05.969+0000 7fcf56600640 1 -- 172.21.15.50:0/4181179109 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56220c240c10 con 0x56220bf7e1b0 2024-08-31T04:27:05.975 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:05.969+0000 7fcf56600640 1 --2- 172.21.15.50:0/4181179109 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56220bf7e1b0 0x56220c323dc0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fcf48031a90 tx=0x7fcf48009420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=564ae903c6e5c645 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:27:05.977 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:05.969+0000 7fcf42a00640 1 -- 172.21.15.50:0/4181179109 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf48031650 con 0x56220bf7e1b0 2024-08-31T04:27:05.977 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:05.969+0000 7fcf42a00640 1 -- 172.21.15.50:0/4181179109 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcf48036040 con 0x56220bf7e1b0 2024-08-31T04:27:05.977 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:05.969+0000 7fcf42a00640 1 -- 172.21.15.50:0/4181179109 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf48004760 con 0x56220bf7e1b0 2024-08-31T04:27:05.977 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:05.969+0000 7fcf4e000640 1 --2- 172.21.15.50:0/1259650255 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fcf380b4bb0 0x7fcf380b70c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:27:05.977 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:05.969+0000 7fcf4e000640 1 -- 172.21.15.50:0/1259650255 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8219+0+0 (secure 0 0 0) 0x7fcf440e56e0 con 0x7fcf5006c250 2024-08-31T04:27:05.977 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:05.969+0000 7fcf5f6c8740 1 -- 172.21.15.50:0/4181179109 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56220bf7e1b0 msgr2=0x56220c323dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:27:05.977 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:05.969+0000 7fcf5f6c8740 1 --2- 172.21.15.50:0/4181179109 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56220bf7e1b0 0x56220c323dc0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fcf48031a90 tx=0x7fcf48009420 comp rx=0 tx=0).stop 2024-08-31T04:27:05.978 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:05.969+0000 7fcf55c00640 1 --2- 172.21.15.50:0/1259650255 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fcf380b4bb0 0x7fcf380b70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:27:05.978 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:05.969+0000 7fcf5f6c8740 1 -- 172.21.15.50:0/4181179109 shutdown_connections 2024-08-31T04:27:05.978 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:05.969+0000 7fcf5f6c8740 1 --2- 172.21.15.50:0/4181179109 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56220bf552f0 0x56220c324430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:05.978 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:05.969+0000 7fcf5f6c8740 1 --2- 172.21.15.50:0/4181179109 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56220bf5d4d0 0x56220c324f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:05.978 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:05.969+0000 7fcf5f6c8740 1 --2- 172.21.15.50:0/4181179109 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56220bf7e1b0 0x56220c323dc0 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:05.978 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:05.969+0000 7fcf5f6c8740 1 -- 172.21.15.50:0/4181179109 >> 172.21.15.50:0/4181179109 conn(0x56220bf72300 msgr2=0x56220c31f850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:27:05.978 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:05.969+0000 7fcf5f6c8740 1 -- 172.21.15.50:0/4181179109 shutdown_connections 2024-08-31T04:27:05.978 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:05.974+0000 7fcf5f6c8740 1 -- 172.21.15.50:0/4181179109 wait complete. 2024-08-31T04:27:05.978 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:05.974+0000 7fcf55c00640 1 --2- 172.21.15.50:0/1259650255 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fcf380b4bb0 0x7fcf380b70c0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fcf4400e9c0 tx=0x7fcf44004a90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:27:05.978 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:05.974+0000 7fcf5f6c8740 1 -- start start 2024-08-31T04:27:05.979 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:05.974+0000 7fcf5f6c8740 1 Processor -- start 2024-08-31T04:27:05.979 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:05.974+0000 7fcf5f6c8740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56220bf552f0 0x56220c32d450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:27:05.979 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:05.974+0000 7fcf5f6c8740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56220bf5d4d0 0x56220c32db10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:27:05.979 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:05.974+0000 7fcf5f6c8740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56220bf7e1b0 0x56220c32e680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:27:05.979 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:05.974+0000 7fcf5f6c8740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x56220c1bfab0 con 0x56220bf5d4d0 2024-08-31T04:27:05.979 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:05.974+0000 7fcf5f6c8740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x56220c22d320 con 0x56220bf7e1b0 2024-08-31T04:27:05.979 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:05.974+0000 7fcf5f6c8740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x56220c325a40 con 0x56220bf552f0 2024-08-31T04:27:05.982 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:05.974+0000 7fcf5f6c8740 10 client.0 _ll_register_callbacks cb 0x56220c2336a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:27:05.982 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:05.974+0000 7fcf55200640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56220bf5d4d0 0x56220c32db10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:27:05.982 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:05.974+0000 7fcf56600640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56220bf552f0 0x56220c32d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:27:05.982 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:05.974+0000 7fcf55200640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56220bf5d4d0 0x56220c32db10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:51118/0 (socket says 172.21.15.50:51118) 2024-08-31T04:27:05.982 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:05.974+0000 7fcf55200640 1 -- 172.21.15.50:0/1168813053 learned_addr learned my addr 172.21.15.50:0/1168813053 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:27:05.982 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:05.974+0000 7fcf56600640 1 --2- 172.21.15.50:0/1168813053 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56220bf7e1b0 0x56220c32e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:27:05.982 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:05.974+0000 7fcf55200640 1 -- 172.21.15.50:0/1168813053 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56220bf552f0 msgr2=0x56220c32d450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:27:05.982 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:05.974+0000 7fcf55200640 1 --2- 172.21.15.50:0/1168813053 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56220bf552f0 0x56220c32d450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:05.983 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:05.974+0000 7fcf55200640 1 -- 172.21.15.50:0/1168813053 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56220bf7e1b0 msgr2=0x56220c32e680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:27:05.983 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:05.974+0000 7fcf55200640 1 --2- 172.21.15.50:0/1168813053 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56220bf7e1b0 0x56220c32e680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:05.983 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:05.974+0000 7fcf55200640 1 -- 172.21.15.50:0/1168813053 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56220bfe9790 con 0x56220bf5d4d0 2024-08-31T04:27:05.983 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:05.974+0000 7fcf56600640 1 --2- 172.21.15.50:0/1168813053 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56220bf7e1b0 0x56220c32e680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:27:05.983 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:05.974+0000 7fcf55200640 1 --2- 172.21.15.50:0/1168813053 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56220bf5d4d0 0x56220c32db10 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fcf3c00e600 tx=0x7fcf3c00eac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc723f0e2f4e184e server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:27:05.983 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:05.974+0000 7fcf37400640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-08-31T04:27:05.983 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:05.974+0000 7fcf37400640 1 -- 172.21.15.50:0/1168813053 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf3c005220 con 0x56220bf5d4d0 2024-08-31T04:27:05.983 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:05.974+0000 7fcf37400640 1 -- 172.21.15.50:0/1168813053 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8219+0+0 (secure 0 0 0) 0x7fcf3c0053c0 con 0x56220bf5d4d0 2024-08-31T04:27:05.983 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:05.974+0000 7fcf5f6c8740 1 -- 172.21.15.50:0/1168813053 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcf48036040 con 0x56220bf5d4d0 2024-08-31T04:27:05.983 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:05.974+0000 7fcf37400640 1 -- 172.21.15.50:0/1168813053 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7fcf3c0055c0 con 0x56220bf5d4d0 2024-08-31T04:27:05.983 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:05.974+0000 7fcf5f6c8740 10 client.15786 fetch_fsmap learned FSMap version 33 2024-08-31T04:27:05.983 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:05.974+0000 7fcf5f6c8740 1 -- 172.21.15.50:0/1168813053 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x56220c062620 con 0x56220bf5d4d0 2024-08-31T04:27:05.983 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:05.974+0000 7fcf37400640 1 -- 172.21.15.50:0/1168813053 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcf48036040 con 0x56220bf5d4d0 2024-08-31T04:27:05.984 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:05.974+0000 7fcf37400640 1 -- 172.21.15.50:0/1168813053 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 33) ==== 8378+0+0 (secure 0 0 0) 0x7fcf3c010c50 con 0x56220bf5d4d0 2024-08-31T04:27:05.984 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:05.974+0000 7fcf5f6c8740 10 client.15786 fetch_fsmap finished waiting for FSMap version 33 2024-08-31T04:27:05.984 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:05.974+0000 7fcf5f6c8740 10 client.15786 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T04:27:05.984 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:05.974+0000 7fcf5f6c8740 20 client.15786 populate_metadata read hostname 'smithi050' 2024-08-31T04:27:05.984 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:05.974+0000 7fcf5f6c8740 1 --2- 172.21.15.50:0/1168813053 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x56220bf3cd80 0x56220c33ad70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:27:05.984 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:05.974+0000 7fcf5f6c8740 4 client.15786 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T04:27:05.984 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:05.974+0000 7fcf5f6c8740 1 -- 172.21.15.50:0/1168813053 --> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56220c298ec0 con 0x56220bf3cd80 2024-08-31T04:27:05.984 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:05.974+0000 7fcf56600640 1 --2- 172.21.15.50:0/1168813053 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x56220bf3cd80 0x56220c33ad70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:27:05.984 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:05.974+0000 7fcf56600640 1 --2- 172.21.15.50:0/1168813053 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x56220bf3cd80 0x56220c33ad70 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=71772742458a1d5b server_cookie=335eafe94d640dfd in_seq=0 out_seq=0 2024-08-31T04:27:05.984 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:05.974+0000 7fcf37400640 10 client.15786 ms_handle_connect on v2:172.21.15.133:6838/2526402262 2024-08-31T04:27:05.985 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:05.979+0000 7fcf37400640 1 -- 172.21.15.50:0/1168813053 <== mds.0 v2:172.21.15.133:6838/2526402262 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56220c298ec0 con 0x56220bf3cd80 2024-08-31T04:27:05.986 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:05.979+0000 7fcf37400640 10 client.15786 handle_command_reply: tid=0 2024-08-31T04:27:05.986 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:05.979+0000 7fcf5f6c8740 1 client.15786 shutdown 2024-08-31T04:27:05.986 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:05.979+0000 7fcf5f6c8740 1 -- 172.21.15.50:0/1168813053 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56220bf5d4d0 msgr2=0x56220c32db10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:27:05.986 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:05.979+0000 7fcf5f6c8740 1 --2- 172.21.15.50:0/1168813053 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56220bf5d4d0 0x56220c32db10 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fcf3c00e600 tx=0x7fcf3c00eac0 comp rx=0 tx=0).stop 2024-08-31T04:27:05.986 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:05.979+0000 7fcf5f6c8740 1 -- 172.21.15.50:0/1168813053 shutdown_connections 2024-08-31T04:27:05.986 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:05.979+0000 7fcf5f6c8740 1 --2- 172.21.15.50:0/1168813053 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x56220bf3cd80 0x56220c33ad70 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:05.986 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:05.979+0000 7fcf5f6c8740 1 --2- 172.21.15.50:0/1168813053 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56220bf7e1b0 0x56220c32e680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:05.986 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:05.979+0000 7fcf5f6c8740 1 --2- 172.21.15.50:0/1168813053 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56220bf5d4d0 0x56220c32db10 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:05.986 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:05.979+0000 7fcf5f6c8740 1 --2- 172.21.15.50:0/1168813053 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56220bf552f0 0x56220c32d450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:05.987 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:05.979+0000 7fcf37400640 0 client.15786 ms_handle_reset on v2:172.21.15.133:6838/2526402262 2024-08-31T04:27:05.987 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:05.979+0000 7fcf5f6c8740 1 -- 172.21.15.50:0/1168813053 >> 172.21.15.50:0/1168813053 conn(0x56220bf72300 msgr2=0x56220c31dcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:27:05.987 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:05.979+0000 7fcf5f6c8740 1 -- 172.21.15.50:0/1168813053 shutdown_connections 2024-08-31T04:27:05.987 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:05.979+0000 7fcf5f6c8740 1 -- 172.21.15.50:0/1168813053 wait complete. 2024-08-31T04:27:05.987 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:05.979+0000 7fcf5f6c8740 20 client.15786 trim_cache size 0 max 16384 2024-08-31T04:27:05.996 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:27:05 smithi177 ceph-mon[22025]: pgmap v493: 97 pgs: 97 active+clean; 537 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 198 KiB/s wr, 64 op/s 2024-08-31T04:27:05.998 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:05.994+0000 7fcf5f6c8740 1 Processor -- start 2024-08-31T04:27:05.999 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:05.994+0000 7fcf5f6c8740 1 -- start start 2024-08-31T04:27:05.999 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:05.994+0000 7fcf5f6c8740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56220bf552f0 0x56220c32c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:27:05.999 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:05.994+0000 7fcf5f6c8740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56220bf5d4d0 0x56220c323d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:27:05.999 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:05.994+0000 7fcf5f6c8740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56220bf7e1b0 0x56220c3242a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:27:05.999 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:05.994+0000 7fcf5f6c8740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fcf501ace30 con 0x56220bf5d4d0 2024-08-31T04:27:05.999 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:05.994+0000 7fcf5f6c8740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7fcf501aea30 con 0x56220bf7e1b0 2024-08-31T04:27:05.999 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:05.994+0000 7fcf5f6c8740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fcf501ad500 con 0x56220bf552f0 2024-08-31T04:27:05.999 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:05.994+0000 7fcf55200640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56220bf5d4d0 0x56220c323d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:27:05.999 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:05.994+0000 7fcf55200640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56220bf5d4d0 0x56220c323d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:51132/0 (socket says 172.21.15.50:51132) 2024-08-31T04:27:05.999 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:05.994+0000 7fcf55200640 1 -- 172.21.15.50:0/2022440464 learned_addr learned my addr 172.21.15.50:0/2022440464 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:27:06.000 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:05.994+0000 7fcf56600640 1 --2- 172.21.15.50:0/2022440464 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56220bf552f0 0x56220c32c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:27:06.000 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:05.994+0000 7fcf56600640 1 --2- 172.21.15.50:0/2022440464 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56220bf7e1b0 0x56220c3242a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:27:06.000 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:05.994+0000 7fcf55200640 1 -- 172.21.15.50:0/2022440464 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56220bf552f0 msgr2=0x56220c32c0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:27:06.000 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:05.994+0000 7fcf55200640 1 --2- 172.21.15.50:0/2022440464 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56220bf552f0 0x56220c32c0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:06.000 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:05.994+0000 7fcf55200640 1 -- 172.21.15.50:0/2022440464 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56220bf7e1b0 msgr2=0x56220c3242a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:27:06.000 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:05.994+0000 7fcf55200640 1 --2- 172.21.15.50:0/2022440464 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56220bf7e1b0 0x56220c3242a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:06.000 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:05.994+0000 7fcf55200640 1 -- 172.21.15.50:0/2022440464 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56220c324860 con 0x56220bf5d4d0 2024-08-31T04:27:06.000 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:05.994+0000 7fcf55200640 1 --2- 172.21.15.50:0/2022440464 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56220bf5d4d0 0x56220c323d60 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fcf3c00e5d0 tx=0x7fcf3c005990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8caafcd128ce633f server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:27:06.000 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:05.994+0000 7fcf42000640 1 -- 172.21.15.50:0/2022440464 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf3c0050d0 con 0x56220bf5d4d0 2024-08-31T04:27:06.000 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:05.994+0000 7fcf42000640 1 -- 172.21.15.50:0/2022440464 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcf3c01e030 con 0x56220bf5d4d0 2024-08-31T04:27:06.001 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:05.994+0000 7fcf42000640 1 -- 172.21.15.50:0/2022440464 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf3c010df0 con 0x56220bf5d4d0 2024-08-31T04:27:06.004 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:05.994+0000 7fcf5f6c8740 1 -- 172.21.15.50:0/2022440464 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56220bf5d4d0 msgr2=0x56220c323d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:27:06.004 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:05.994+0000 7fcf5f6c8740 1 --2- 172.21.15.50:0/2022440464 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56220bf5d4d0 0x56220c323d60 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fcf3c00e5d0 tx=0x7fcf3c005990 comp rx=0 tx=0).stop 2024-08-31T04:27:06.004 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:05.994+0000 7fcf5f6c8740 1 -- 172.21.15.50:0/2022440464 shutdown_connections 2024-08-31T04:27:06.004 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:05.994+0000 7fcf5f6c8740 1 --2- 172.21.15.50:0/2022440464 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56220bf7e1b0 0x56220c3242a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:06.004 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:05.994+0000 7fcf5f6c8740 1 --2- 172.21.15.50:0/2022440464 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56220bf5d4d0 0x56220c323d60 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:06.004 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:05.994+0000 7fcf5f6c8740 1 --2- 172.21.15.50:0/2022440464 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56220bf552f0 0x56220c32c0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:06.004 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:05.994+0000 7fcf5f6c8740 1 -- 172.21.15.50:0/2022440464 >> 172.21.15.50:0/2022440464 conn(0x56220bf72300 msgr2=0x56220c32b9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:27:06.005 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:05.994+0000 7fcf5f6c8740 1 -- 172.21.15.50:0/2022440464 shutdown_connections 2024-08-31T04:27:06.005 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:05.994+0000 7fcf5f6c8740 1 -- 172.21.15.50:0/2022440464 wait complete. 2024-08-31T04:27:06.005 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:05.994+0000 7fcf5f6c8740 1 -- start start 2024-08-31T04:27:06.005 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:05.994+0000 7fcf5f6c8740 1 Processor -- start 2024-08-31T04:27:06.005 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:05.994+0000 7fcf5f6c8740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56220bf552f0 0x56220c334bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:27:06.005 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:05.994+0000 7fcf5f6c8740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56220bf5d4d0 0x56220c333870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:27:06.005 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:05.999+0000 7fcf5f6c8740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56220bf7e1b0 0x56220c333db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:27:06.005 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:05.999+0000 7fcf5f6c8740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fcf501ae360 con 0x56220bf552f0 2024-08-31T04:27:06.005 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:05.999+0000 7fcf5f6c8740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7fcf501adbd0 con 0x56220bf7e1b0 2024-08-31T04:27:06.005 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:05.999+0000 7fcf5f6c8740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fcf501aae10 con 0x56220bf5d4d0 2024-08-31T04:27:06.006 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:05.999+0000 7fcf5f6c8740 10 client.0 _ll_register_callbacks cb 0x7fcf3c009d00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:27:06.006 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:05.999+0000 7fcf56600640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56220bf552f0 0x56220c334bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:27:06.006 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:05.999+0000 7fcf56600640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56220bf552f0 0x56220c334bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:51142/0 (socket says 172.21.15.50:51142) 2024-08-31T04:27:06.006 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:05.999+0000 7fcf56600640 1 -- 172.21.15.50:0/1091336823 learned_addr learned my addr 172.21.15.50:0/1091336823 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:27:06.006 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:05.999+0000 7fcf55200640 1 --2- 172.21.15.50:0/1091336823 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56220bf5d4d0 0x56220c333870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:27:06.006 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:05.999+0000 7fcf56600640 1 --2- 172.21.15.50:0/1091336823 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56220bf7e1b0 0x56220c333db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:27:06.006 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:05.999+0000 7fcf55200640 1 -- 172.21.15.50:0/1091336823 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56220bf7e1b0 msgr2=0x56220c333db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:27:06.006 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:05.999+0000 7fcf55200640 1 --2- 172.21.15.50:0/1091336823 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56220bf7e1b0 0x56220c333db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:06.006 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:05.999+0000 7fcf55200640 1 -- 172.21.15.50:0/1091336823 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56220bf552f0 msgr2=0x56220c334bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:27:06.006 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:05.999+0000 7fcf55200640 1 --2- 172.21.15.50:0/1091336823 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56220bf552f0 0x56220c334bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:06.006 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:05.999+0000 7fcf55200640 1 -- 172.21.15.50:0/1091336823 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56220c334370 con 0x56220bf5d4d0 2024-08-31T04:27:06.007 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:05.999+0000 7fcf56600640 1 --2- 172.21.15.50:0/1091336823 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56220bf552f0 0x56220c334bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:27:06.007 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:05.999+0000 7fcf55200640 1 --2- 172.21.15.50:0/1091336823 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56220bf5d4d0 0x56220c333870 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fcf3c00e5a0 tx=0x7fcf3c018530 comp rx=0 tx=0).ready entity=mon.1 client_cookie=aaa6ac549e5f889 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:27:06.007 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:05.999+0000 7fcf37400640 10 client.0 ms_handle_connect on v2:172.21.15.177:3300/0 2024-08-31T04:27:06.007 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:05.999+0000 7fcf37400640 1 -- 172.21.15.50:0/1091336823 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf3c018860 con 0x56220bf5d4d0 2024-08-31T04:27:06.007 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:05.999+0000 7fcf5f6c8740 1 -- 172.21.15.50:0/1091336823 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcf3c01e030 con 0x56220bf5d4d0 2024-08-31T04:27:06.007 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:05.999+0000 7fcf37400640 1 -- 172.21.15.50:0/1091336823 <== mon.1 v2:172.21.15.177:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8219+0+0 (secure 0 0 0) 0x7fcf3c018a00 con 0x56220bf5d4d0 2024-08-31T04:27:06.007 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:05.999+0000 7fcf37400640 1 -- 172.21.15.50:0/1091336823 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7fcf3c018c20 con 0x56220bf5d4d0 2024-08-31T04:27:06.007 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:05.999+0000 7fcf5f6c8740 10 client.25795 fetch_fsmap learned FSMap version 33 2024-08-31T04:27:06.007 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:05.999+0000 7fcf5f6c8740 1 -- 172.21.15.50:0/1091336823 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x56220c3331b0 con 0x56220bf5d4d0 2024-08-31T04:27:06.007 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:05.999+0000 7fcf37400640 1 -- 172.21.15.50:0/1091336823 <== mon.1 v2:172.21.15.177:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcf3c01e030 con 0x56220bf5d4d0 2024-08-31T04:27:06.007 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:05.999+0000 7fcf37400640 1 -- 172.21.15.50:0/1091336823 <== mon.1 v2:172.21.15.177:3300/0 5 ==== fsmap(e 33) ==== 8378+0+0 (secure 0 0 0) 0x7fcf3c033470 con 0x56220bf5d4d0 2024-08-31T04:27:06.007 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:05.999+0000 7fcf5f6c8740 10 client.25795 fetch_fsmap finished waiting for FSMap version 33 2024-08-31T04:27:06.007 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:05.999+0000 7fcf5f6c8740 10 client.25795 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T04:27:06.008 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:05.999+0000 7fcf5f6c8740 20 client.25795 populate_metadata read hostname 'smithi050' 2024-08-31T04:27:06.008 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:05.999+0000 7fcf5f6c8740 1 --2- 172.21.15.50:0/1091336823 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x56220bf121c0 0x56220c3a7f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:27:06.008 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:05.999+0000 7fcf5f6c8740 4 client.25795 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-31T04:27:06.008 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:05.999+0000 7fcf5f6c8740 1 -- 172.21.15.50:0/1091336823 --> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] -- command(tid 0: {"prefix": "flush journal"}) -- 0x56220c294960 con 0x56220bf121c0 2024-08-31T04:27:06.008 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:05.999+0000 7fcf56600640 1 --2- 172.21.15.50:0/1091336823 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x56220bf121c0 0x56220c3a7f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:27:06.008 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:05.999+0000 7fcf56600640 1 --2- 172.21.15.50:0/1091336823 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x56220bf121c0 0x56220c3a7f70 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=acfd9400440b86a2 server_cookie=e6e6746aac3c1b in_seq=0 out_seq=0 2024-08-31T04:27:06.008 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:05.999+0000 7fcf37400640 10 client.25795 ms_handle_connect on v2:172.21.15.133:6838/2526402262 2024-08-31T04:27:06.026 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:06.021+0000 7fcf37400640 1 -- 172.21.15.50:0/1091336823 <== mds.0 v2:172.21.15.133:6838/2526402262 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x56220c294960 con 0x56220bf121c0 2024-08-31T04:27:06.026 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:06.021+0000 7fcf37400640 10 client.25795 handle_command_reply: tid=0 2024-08-31T04:27:06.026 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:06.021+0000 7fcf5f6c8740 1 client.25795 shutdown 2024-08-31T04:27:06.026 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:06.021+0000 7fcf5f6c8740 1 -- 172.21.15.50:0/1091336823 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56220bf5d4d0 msgr2=0x56220c333870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:27:06.026 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:06.021+0000 7fcf5f6c8740 1 --2- 172.21.15.50:0/1091336823 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56220bf5d4d0 0x56220c333870 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fcf3c00e5a0 tx=0x7fcf3c018530 comp rx=0 tx=0).stop 2024-08-31T04:27:06.026 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:06.021+0000 7fcf5f6c8740 1 -- 172.21.15.50:0/1091336823 shutdown_connections 2024-08-31T04:27:06.026 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:06.021+0000 7fcf5f6c8740 1 --2- 172.21.15.50:0/1091336823 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x56220bf121c0 0x56220c3a7f70 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:06.027 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:06.021+0000 7fcf5f6c8740 1 --2- 172.21.15.50:0/1091336823 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56220bf5d4d0 0x56220c333870 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:06.027 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:06.021+0000 7fcf5f6c8740 1 --2- 172.21.15.50:0/1091336823 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56220bf7e1b0 0x56220c333db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:06.027 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:06.021+0000 7fcf5f6c8740 1 --2- 172.21.15.50:0/1091336823 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56220bf552f0 0x56220c334bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:06.027 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:06.021+0000 7fcf37400640 0 client.25795 ms_handle_reset on v2:172.21.15.133:6838/2526402262 2024-08-31T04:27:06.027 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:06.021+0000 7fcf5f6c8740 1 -- 172.21.15.50:0/1091336823 >> 172.21.15.50:0/1091336823 conn(0x56220bf72300 msgr2=0x56220c31e400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:27:06.027 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:06.021+0000 7fcf5f6c8740 1 -- 172.21.15.50:0/1091336823 shutdown_connections 2024-08-31T04:27:06.027 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:06.021+0000 7fcf5f6c8740 1 -- 172.21.15.50:0/1091336823 wait complete. 2024-08-31T04:27:06.027 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:06.021+0000 7fcf5f6c8740 20 client.25795 trim_cache size 0 max 16384 2024-08-31T04:27:06.027 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout:{ 2024-08-31T04:27:06.028 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout: "message": "", 2024-08-31T04:27:06.028 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout: "return_code": 0 2024-08-31T04:27:06.028 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout:} 2024-08-31T04:27:06.028 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:06.021+0000 7fcf58600640 1 -- 172.21.15.50:0/1259650255 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fcf380b4bb0 msgr2=0x7fcf380b70c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:27:06.028 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:06.021+0000 7fcf58600640 1 --2- 172.21.15.50:0/1259650255 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fcf380b4bb0 0x7fcf380b70c0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fcf4400e9c0 tx=0x7fcf44004a90 comp rx=0 tx=0).stop 2024-08-31T04:27:06.029 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:06.021+0000 7fcf58600640 1 -- 172.21.15.50:0/1259650255 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcf5006c250 msgr2=0x7fcf501036f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:27:06.029 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:06.021+0000 7fcf58600640 1 --2- 172.21.15.50:0/1259650255 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcf5006c250 0x7fcf501036f0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fcf4400e9f0 tx=0x7fcf4400edf0 comp rx=0 tx=0).stop 2024-08-31T04:27:06.029 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:06.021+0000 7fcf58600640 1 -- 172.21.15.50:0/1259650255 shutdown_connections 2024-08-31T04:27:06.029 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:06.021+0000 7fcf58600640 1 --2- 172.21.15.50:0/1259650255 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fcf380b4bb0 0x7fcf380b70c0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:06.029 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:06.021+0000 7fcf58600640 1 --2- 172.21.15.50:0/1259650255 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcf501065f0 0x7fcf50101fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:06.029 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:06.021+0000 7fcf58600640 1 --2- 172.21.15.50:0/1259650255 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcf501091b0 0x7fcf501024f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:06.029 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:06.021+0000 7fcf58600640 1 --2- 172.21.15.50:0/1259650255 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcf5006c250 0x7fcf501036f0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:06.029 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:06.021+0000 7fcf58600640 1 -- 172.21.15.50:0/1259650255 >> 172.21.15.50:0/1259650255 conn(0x7fcf500fdcd0 msgr2=0x7fcf50104a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:27:06.029 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:06.021+0000 7fcf58600640 1 -- 172.21.15.50:0/1259650255 shutdown_connections 2024-08-31T04:27:06.029 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:06.021+0000 7fcf58600640 1 -- 172.21.15.50:0/1259650255 wait complete. 2024-08-31T04:27:06.043 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:27:05 smithi133 ceph-mon[22177]: pgmap v493: 97 pgs: 97 active+clean; 537 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 198 KiB/s wr, 64 op/s 2024-08-31T04:27:07.950 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:27:07 smithi050 ceph-mon[17259]: pgmap v494: 97 pgs: 97 active+clean; 537 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 200 KiB/s wr, 67 op/s 2024-08-31T04:27:07.995 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:27:07 smithi177 ceph-mon[22025]: pgmap v494: 97 pgs: 97 active+clean; 537 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 200 KiB/s wr, 67 op/s 2024-08-31T04:27:08.043 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:27:07 smithi133 ceph-mon[22177]: pgmap v494: 97 pgs: 97 active+clean; 537 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 200 KiB/s wr, 67 op/s 2024-08-31T04:27:09.627 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:27:09 smithi050 ceph-mon[17259]: pgmap v495: 97 pgs: 97 active+clean; 537 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 35 KiB/s wr, 23 op/s 2024-08-31T04:27:09.896 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set 'caac904b', quiesce took 48.1 seconds. Will release after: -26.3 2024-08-31T04:27:09.897 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 058d9fc6-674f-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-31T04:27:09.996 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:27:09 smithi177 ceph-mon[22025]: pgmap v495: 97 pgs: 97 active+clean; 537 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 35 KiB/s wr, 23 op/s 2024-08-31T04:27:10.043 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:27:09 smithi133 ceph-mon[22177]: pgmap v495: 97 pgs: 97 active+clean; 537 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 35 KiB/s wr, 23 op/s 2024-08-31T04:27:10.325 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:27:11.166 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:11.162+0000 7fa612e00640 1 -- 172.21.15.50:0/230983792 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa60c109240 msgr2=0x7fa60c109650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:27:11.166 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:11.162+0000 7fa612e00640 1 --2- 172.21.15.50:0/230983792 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa60c109240 0x7fa60c109650 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fa5f8009900 tx=0x7fa5f802a410 comp rx=0 tx=0).stop 2024-08-31T04:27:11.166 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:11.162+0000 7fa612e00640 1 -- 172.21.15.50:0/230983792 shutdown_connections 2024-08-31T04:27:11.166 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:11.162+0000 7fa612e00640 1 --2- 172.21.15.50:0/230983792 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa60c109b90 0x7fa60c1103c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:11.167 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:11.162+0000 7fa612e00640 1 --2- 172.21.15.50:0/230983792 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa60c109240 0x7fa60c109650 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:11.167 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:11.162+0000 7fa612e00640 1 --2- 172.21.15.50:0/230983792 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa60c103900 0x7fa60c103d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:11.167 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:11.162+0000 7fa612e00640 1 -- 172.21.15.50:0/230983792 >> 172.21.15.50:0/230983792 conn(0x7fa60c07b5f0 msgr2=0x7fa60c07ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:27:11.167 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:11.162+0000 7fa612e00640 1 -- 172.21.15.50:0/230983792 shutdown_connections 2024-08-31T04:27:11.167 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:11.162+0000 7fa612e00640 1 -- 172.21.15.50:0/230983792 wait complete. 2024-08-31T04:27:11.167 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:11.162+0000 7fa612e00640 1 Processor -- start 2024-08-31T04:27:11.167 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:11.162+0000 7fa612e00640 1 -- start start 2024-08-31T04:27:11.168 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:11.162+0000 7fa612e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa60c103900 0x7fa60c19c520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:27:11.168 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:11.162+0000 7fa612e00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa60c109240 0x7fa60c19cac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:27:11.168 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:11.162+0000 7fa612e00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa60c109b90 0x7fa60c1a1d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:27:11.168 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:11.162+0000 7fa612e00640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fa60c1138b0 con 0x7fa60c103900 2024-08-31T04:27:11.168 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:11.162+0000 7fa612e00640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7fa60c113730 con 0x7fa60c109b90 2024-08-31T04:27:11.168 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:11.162+0000 7fa612e00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fa60c113a30 con 0x7fa60c109240 2024-08-31T04:27:11.168 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:11.162+0000 7fa60be00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa60c103900 0x7fa60c19c520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:27:11.168 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:11.162+0000 7fa60be00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa60c103900 0x7fa60c19c520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:51160/0 (socket says 172.21.15.50:51160) 2024-08-31T04:27:11.168 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:11.162+0000 7fa60be00640 1 -- 172.21.15.50:0/1761763842 learned_addr learned my addr 172.21.15.50:0/1761763842 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:27:11.168 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:11.162+0000 7fa60be00640 1 -- 172.21.15.50:0/1761763842 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa60c109240 msgr2=0x7fa60c19cac0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-08-31T04:27:11.169 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:11.162+0000 7fa60be00640 1 --2- 172.21.15.50:0/1761763842 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa60c109240 0x7fa60c19cac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:11.169 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:11.162+0000 7fa60be00640 1 -- 172.21.15.50:0/1761763842 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa60c109b90 msgr2=0x7fa60c1a1d60 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-08-31T04:27:11.169 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:11.162+0000 7fa60be00640 1 --2- 172.21.15.50:0/1761763842 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa60c109b90 0x7fa60c1a1d60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:11.169 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:11.162+0000 7fa60be00640 1 -- 172.21.15.50:0/1761763842 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa60c1a2490 con 0x7fa60c103900 2024-08-31T04:27:11.169 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:11.162+0000 7fa60be00640 1 --2- 172.21.15.50:0/1761763842 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa60c103900 0x7fa60c19c520 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fa5fc00e9f0 tx=0x7fa5fc00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:27:11.169 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:11.162+0000 7fa608c00640 1 -- 172.21.15.50:0/1761763842 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5fc00cd80 con 0x7fa60c103900 2024-08-31T04:27:11.169 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:11.162+0000 7fa612e00640 1 -- 172.21.15.50:0/1761763842 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa60c1a2780 con 0x7fa60c103900 2024-08-31T04:27:11.169 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:11.162+0000 7fa612e00640 1 -- 172.21.15.50:0/1761763842 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa60c1a8ee0 con 0x7fa60c103900 2024-08-31T04:27:11.170 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:11.162+0000 7fa608c00640 1 -- 172.21.15.50:0/1761763842 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa5fc0054d0 con 0x7fa60c103900 2024-08-31T04:27:11.170 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:11.162+0000 7fa608c00640 1 -- 172.21.15.50:0/1761763842 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5fc010690 con 0x7fa60c103900 2024-08-31T04:27:11.170 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:11.167+0000 7fa612e00640 1 -- 172.21.15.50:0/1761763842 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa60c103d10 con 0x7fa60c103900 2024-08-31T04:27:11.172 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:11.167+0000 7fa608c00640 1 -- 172.21.15.50:0/1761763842 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 18) ==== 152577+0+0 (secure 0 0 0) 0x7fa5fc004e50 con 0x7fa60c103900 2024-08-31T04:27:11.174 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:11.172+0000 7fa608c00640 1 --2- 172.21.15.50:0/1761763842 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fa5f00b4bb0 0x7fa5f00b70c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:27:11.174 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:11.172+0000 7fa608c00640 1 -- 172.21.15.50:0/1761763842 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8219+0+0 (secure 0 0 0) 0x7fa5fc0e5880 con 0x7fa60c103900 2024-08-31T04:27:11.175 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:11.172+0000 7fa60b400640 1 --2- 172.21.15.50:0/1761763842 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fa5f00b4bb0 0x7fa5f00b70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:27:11.175 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:11.172+0000 7fa60b400640 1 --2- 172.21.15.50:0/1761763842 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fa5f00b4bb0 0x7fa5f00b70c0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fa5f802a930 tx=0x7fa5f8000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:27:11.178 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:11.175+0000 7fa608c00640 1 -- 172.21.15.50:0/1761763842 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fa5fc056130 con 0x7fa60c103900 2024-08-31T04:27:11.418 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:11.416+0000 7fa612e00640 1 -- 172.21.15.50:0/1761763842 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa60c19d650 con 0x7fa60c103900 2024-08-31T04:27:11.419 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:11.417+0000 7fa608c00640 1 -- 172.21.15.50:0/1761763842 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 33 v33) ==== 94+0+11993 (secure 0 0 0) 0x7fa5fc0ac960 con 0x7fa60c103900 2024-08-31T04:27:11.420 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-08-31T04:27:11.420 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":33,"btime":"2024-08-31T04:25:32:194673+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14622,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/1565557530","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":1565557530},{"type":"v1","addr":"172.21.15.50:6835","nonce":1565557530}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14634,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6837/2660185946","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6836","nonce":2660185946},{"type":"v1","addr":"172.21.15.50:6837","nonce":2660185946}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":33,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-31T04:20:44.140709+0000","modified":"2024-08-31T04:25:32.194656+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24695,"mds_1":24691,"mds_2":24667,"mds_3":24656,"mds_4":24652},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14676":{"gid":14676,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.50:6839/2105228685","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6838","nonce":2105228685},{"type":"v1","addr":"172.21.15.50:6839","nonce":2105228685}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24590":{"gid":24590,"name":"k","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.133:6833/4283603962","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6832","nonce":4283603962},{"type":"v1","addr":"172.21.15.133:6833","nonce":4283603962}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24601":{"gid":24601,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.177:6833/1237129793","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":1237129793},{"type":"v1","addr":"172.21.15.177:6833","nonce":1237129793}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24626":{"gid":24626,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.133:6835/3637799701","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":3637799701},{"type":"v1","addr":"172.21.15.133:6835","nonce":3637799701}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24652":{"gid":24652,"name":"c","rank":4,"incarnation":26,"state":"up:active","state_seq":13,"addr":"172.21.15.177:6837/2159859285","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6836","nonce":2159859285},{"type":"v1","addr":"172.21.15.177:6837","nonce":2159859285}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24656":{"gid":24656,"name":"h","rank":3,"incarnation":22,"state":"up:active","state_seq":12,"addr":"172.21.15.133:6837/4014853202","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6836","nonce":4014853202},{"type":"v1","addr":"172.21.15.133:6837","nonce":4014853202}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24667":{"gid":24667,"name":"i","rank":2,"incarnation":20,"state":"up:active","state_seq":10,"addr":"172.21.15.177:6839/3600081752","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6838","nonce":3600081752},{"type":"v1","addr":"172.21.15.177:6839","nonce":3600081752}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24691":{"gid":24691,"name":"a","rank":1,"incarnation":18,"state":"up:active","state_seq":8,"addr":"172.21.15.50:6841/575209862","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6840","nonce":575209862},{"type":"v1","addr":"172.21.15.50:6841","nonce":575209862}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24695":{"gid":24695,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.133:6839/2526402262","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6838","nonce":2526402262},{"type":"v1","addr":"172.21.15.133:6839","nonce":2526402262}]},"join_fscid":-1,"export_targets":[1,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_25699":{"gid":25699,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.177:6835/1048370411","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6834","nonce":1048370411},{"type":"v1","addr":"172.21.15.177:6835","nonce":1048370411}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24695,"qdb_cluster":[24652,24691,24656,24695,24667]},"id":1}]} 2024-08-31T04:27:11.420 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 33 2024-08-31T04:27:11.422 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:11.417+0000 7fa612e00640 1 -- 172.21.15.50:0/1761763842 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fa5f00b4bb0 msgr2=0x7fa5f00b70c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:27:11.422 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:11.417+0000 7fa612e00640 1 --2- 172.21.15.50:0/1761763842 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fa5f00b4bb0 0x7fa5f00b70c0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fa5f802a930 tx=0x7fa5f8000bc0 comp rx=0 tx=0).stop 2024-08-31T04:27:11.422 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:11.417+0000 7fa612e00640 1 -- 172.21.15.50:0/1761763842 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa60c103900 msgr2=0x7fa60c19c520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:27:11.422 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:11.417+0000 7fa612e00640 1 --2- 172.21.15.50:0/1761763842 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa60c103900 0x7fa60c19c520 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fa5fc00e9f0 tx=0x7fa5fc00edf0 comp rx=0 tx=0).stop 2024-08-31T04:27:11.423 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:11.417+0000 7fa612e00640 1 -- 172.21.15.50:0/1761763842 shutdown_connections 2024-08-31T04:27:11.423 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:11.417+0000 7fa612e00640 1 --2- 172.21.15.50:0/1761763842 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fa5f00b4bb0 0x7fa5f00b70c0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:11.423 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:11.417+0000 7fa612e00640 1 --2- 172.21.15.50:0/1761763842 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa60c109240 0x7fa60c19cac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:11.423 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:11.417+0000 7fa612e00640 1 --2- 172.21.15.50:0/1761763842 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa60c109b90 0x7fa60c1a1d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:11.423 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:11.417+0000 7fa612e00640 1 --2- 172.21.15.50:0/1761763842 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa60c103900 0x7fa60c19c520 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:11.423 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:11.417+0000 7fa612e00640 1 -- 172.21.15.50:0/1761763842 >> 172.21.15.50:0/1761763842 conn(0x7fa60c07b5f0 msgr2=0x7fa60c105070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:27:11.423 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:11.417+0000 7fa612e00640 1 -- 172.21.15.50:0/1761763842 shutdown_connections 2024-08-31T04:27:11.423 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:11.417+0000 7fa612e00640 1 -- 172.21.15.50:0/1761763842 wait complete. 2024-08-31T04:27:11.871 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:27:11 smithi050 ceph-mon[17259]: pgmap v496: 97 pgs: 97 active+clean; 539 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 161 KiB/s wr, 20 op/s 2024-08-31T04:27:11.871 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:27:11 smithi050 ceph-mon[17259]: from='client.? 172.21.15.50:0/1761763842' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T04:27:11.996 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:27:11 smithi177 ceph-mon[22025]: pgmap v496: 97 pgs: 97 active+clean; 539 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 161 KiB/s wr, 20 op/s 2024-08-31T04:27:11.996 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:27:11 smithi177 ceph-mon[22025]: from='client.? 172.21.15.50:0/1761763842' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T04:27:12.042 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:27:11 smithi133 ceph-mon[22177]: pgmap v496: 97 pgs: 97 active+clean; 539 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 161 KiB/s wr, 20 op/s 2024-08-31T04:27:12.043 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:27:11 smithi133 ceph-mon[22177]: from='client.? 172.21.15.50:0/1761763842' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T04:27:12.547 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24695 quiesce db --set-id caac904b --release --await' 2024-08-31T04:27:12.548 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 058d9fc6-674f-11ef-bcd4-c7b262605968 -- timeout 105 ceph tell mds.24695 quiesce db --set-id caac904b --release --await 2024-08-31T04:27:12.964 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:27:13.826 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:27:13 smithi050 ceph-mon[17259]: pgmap v497: 97 pgs: 97 active+clean; 543 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 556 KiB/s wr, 46 op/s 2024-08-31T04:27:13.882 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:13.879+0000 7fb3a9000640 1 -- 172.21.15.50:0/1955547575 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb3a410b470 msgr2=0x7fb3a410b880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:27:13.882 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:13.879+0000 7fb3a9000640 1 --2- 172.21.15.50:0/1955547575 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb3a410b470 0x7fb3a410b880 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fb390009900 tx=0x7fb39002a3f0 comp rx=0 tx=0).stop 2024-08-31T04:27:13.882 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:13.879+0000 7fb3a9000640 1 -- 172.21.15.50:0/1955547575 shutdown_connections 2024-08-31T04:27:13.882 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:13.879+0000 7fb3a9000640 1 --2- 172.21.15.50:0/1955547575 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb3a410bdc0 0x7fb3a41125f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:13.882 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:13.879+0000 7fb3a9000640 1 --2- 172.21.15.50:0/1955547575 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb3a410b470 0x7fb3a410b880 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:13.882 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:13.879+0000 7fb3a9000640 1 --2- 172.21.15.50:0/1955547575 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb3a4105b30 0x7fb3a4105f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:13.882 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:13.879+0000 7fb3a9000640 1 -- 172.21.15.50:0/1955547575 >> 172.21.15.50:0/1955547575 conn(0x7fb3a4101600 msgr2=0x7fb3a4103a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:27:13.882 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:13.879+0000 7fb3a9000640 1 -- 172.21.15.50:0/1955547575 shutdown_connections 2024-08-31T04:27:13.882 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:13.879+0000 7fb3a9000640 1 -- 172.21.15.50:0/1955547575 wait complete. 2024-08-31T04:27:13.883 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:13.879+0000 7fb3a9000640 1 Processor -- start 2024-08-31T04:27:13.883 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:13.879+0000 7fb3a9000640 1 -- start start 2024-08-31T04:27:13.883 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:13.879+0000 7fb3a9000640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb3a4105b30 0x7fb3a419c490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:27:13.883 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:13.879+0000 7fb3a9000640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb3a410b470 0x7fb3a419ca30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:27:13.884 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:13.879+0000 7fb3a9000640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb3a410bdc0 0x7fb3a41a1cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:27:13.884 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:13.879+0000 7fb3a9000640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fb3a4115a80 con 0x7fb3a410bdc0 2024-08-31T04:27:13.884 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:13.879+0000 7fb3a9000640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7fb3a4115900 con 0x7fb3a4105b30 2024-08-31T04:27:13.884 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:13.879+0000 7fb3a9000640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fb3a4115c00 con 0x7fb3a410b470 2024-08-31T04:27:13.884 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:13.879+0000 7fb3a2800640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb3a410bdc0 0x7fb3a41a1cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:27:13.884 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:13.879+0000 7fb3a1e00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb3a4105b30 0x7fb3a419c490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:27:13.884 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:13.879+0000 7fb3a2800640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb3a410bdc0 0x7fb3a41a1cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:40802/0 (socket says 172.21.15.50:40802) 2024-08-31T04:27:13.884 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:13.879+0000 7fb3a1400640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb3a410b470 0x7fb3a419ca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:27:13.884 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:13.879+0000 7fb3a2800640 1 -- 172.21.15.50:0/2595824414 learned_addr learned my addr 172.21.15.50:0/2595824414 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:27:13.885 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:13.879+0000 7fb3a2800640 1 -- 172.21.15.50:0/2595824414 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb3a410b470 msgr2=0x7fb3a419ca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:27:13.885 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:13.882+0000 7fb3a2800640 1 --2- 172.21.15.50:0/2595824414 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb3a410b470 0x7fb3a419ca30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:13.885 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:13.882+0000 7fb3a2800640 1 -- 172.21.15.50:0/2595824414 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb3a4105b30 msgr2=0x7fb3a419c490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:27:13.885 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:13.882+0000 7fb3a2800640 1 --2- 172.21.15.50:0/2595824414 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb3a4105b30 0x7fb3a419c490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:13.886 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:13.882+0000 7fb3a2800640 1 -- 172.21.15.50:0/2595824414 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3a41a2400 con 0x7fb3a410bdc0 2024-08-31T04:27:13.886 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:13.882+0000 7fb3a1400640 1 --2- 172.21.15.50:0/2595824414 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb3a410b470 0x7fb3a419ca30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:27:13.886 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:13.882+0000 7fb3a2800640 1 --2- 172.21.15.50:0/2595824414 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb3a410bdc0 0x7fb3a41a1cd0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fb39c00efd0 tx=0x7fb39c00c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:27:13.886 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:13.883+0000 7fb39aa00640 1 -- 172.21.15.50:0/2595824414 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb39c003b70 con 0x7fb3a410bdc0 2024-08-31T04:27:13.886 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:13.883+0000 7fb3a9000640 1 -- 172.21.15.50:0/2595824414 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb3a41a26f0 con 0x7fb3a410bdc0 2024-08-31T04:27:13.886 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:13.883+0000 7fb39aa00640 1 -- 172.21.15.50:0/2595824414 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb39c003d10 con 0x7fb3a410bdc0 2024-08-31T04:27:13.886 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:13.883+0000 7fb3a9000640 1 -- 172.21.15.50:0/2595824414 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb3a41a8e50 con 0x7fb3a410bdc0 2024-08-31T04:27:13.886 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:13.883+0000 7fb39aa00640 1 -- 172.21.15.50:0/2595824414 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb39c0108a0 con 0x7fb3a410bdc0 2024-08-31T04:27:13.888 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:13.883+0000 7fb3afc87740 1 Processor -- start 2024-08-31T04:27:13.890 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:13.883+0000 7fb39aa00640 1 -- 172.21.15.50:0/2595824414 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 18) ==== 152577+0+0 (secure 0 0 0) 0x7fb39c004020 con 0x7fb3a410bdc0 2024-08-31T04:27:13.890 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:13.883+0000 7fb3afc87740 1 -- start start 2024-08-31T04:27:13.890 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:13.883+0000 7fb3afc87740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563770952520 0x563770cf7ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:27:13.890 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:13.883+0000 7fb3afc87740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x563770929660 0x563770cf8430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:27:13.890 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:13.883+0000 7fb3afc87740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x563770931840 0x563770cf8970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:27:13.890 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:13.883+0000 7fb3afc87740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x563770c6ea90 con 0x563770952520 2024-08-31T04:27:13.890 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:13.883+0000 7fb3afc87740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x563770c5e020 con 0x563770929660 2024-08-31T04:27:13.890 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:13.883+0000 7fb3afc87740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x563770c61fd0 con 0x563770931840 2024-08-31T04:27:13.890 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:13.883+0000 7fb3a1400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563770952520 0x563770cf7ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:27:13.893 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:13.883+0000 7fb3a1400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563770952520 0x563770cf7ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:40812/0 (socket says 172.21.15.50:40812) 2024-08-31T04:27:13.893 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:13.883+0000 7fb3a1400640 1 -- 172.21.15.50:0/1654650712 learned_addr learned my addr 172.21.15.50:0/1654650712 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:27:13.893 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:13.888+0000 7fb3a1400640 1 --2- 172.21.15.50:0/1654650712 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x563770931840 0x563770cf8970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:27:13.893 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:13.888+0000 7fb3a1400640 1 -- 172.21.15.50:0/1654650712 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x563770931840 msgr2=0x563770cf8970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:27:13.893 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:13.888+0000 7fb3a1400640 1 --2- 172.21.15.50:0/1654650712 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x563770931840 0x563770cf8970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:13.893 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:13.888+0000 7fb3a1400640 1 -- 172.21.15.50:0/1654650712 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x563770929660 msgr2=0x563770cf8430 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-08-31T04:27:13.893 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:13.888+0000 7fb3a1400640 1 --2- 172.21.15.50:0/1654650712 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x563770929660 0x563770cf8430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:13.893 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:13.888+0000 7fb3a1400640 1 -- 172.21.15.50:0/1654650712 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5637709bdb00 con 0x563770952520 2024-08-31T04:27:13.893 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:13.888+0000 7fb3a1400640 1 --2- 172.21.15.50:0/1654650712 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563770952520 0x563770cf7ef0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fb390009900 tx=0x7fb390000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b85e47ba09f7b412 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:27:13.893 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:13.888+0000 7fb39aa00640 1 --2- 172.21.15.50:0/2595824414 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fb3880b4bb0 0x7fb3880b70c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:27:13.893 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:13.888+0000 7fb39aa00640 1 -- 172.21.15.50:0/2595824414 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8219+0+0 (secure 0 0 0) 0x7fb39c0e5270 con 0x7fb3a410bdc0 2024-08-31T04:27:13.893 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:13.888+0000 7fb38f400640 1 -- 172.21.15.50:0/1654650712 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb390044020 con 0x563770952520 2024-08-31T04:27:13.894 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:13.888+0000 7fb38f400640 1 -- 172.21.15.50:0/1654650712 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb390005040 con 0x563770952520 2024-08-31T04:27:13.894 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:13.888+0000 7fb38f400640 1 -- 172.21.15.50:0/1654650712 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb390035040 con 0x563770952520 2024-08-31T04:27:13.894 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:13.888+0000 7fb3a1e00640 1 --2- 172.21.15.50:0/2595824414 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fb3880b4bb0 0x7fb3880b70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:27:13.894 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:13.890+0000 7fb3afc87740 1 -- 172.21.15.50:0/1654650712 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563770952520 msgr2=0x563770cf7ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:27:13.894 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:13.890+0000 7fb3afc87740 1 --2- 172.21.15.50:0/1654650712 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563770952520 0x563770cf7ef0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fb390009900 tx=0x7fb390000bc0 comp rx=0 tx=0).stop 2024-08-31T04:27:13.894 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:13.890+0000 7fb3a1e00640 1 --2- 172.21.15.50:0/2595824414 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fb3880b4bb0 0x7fb3880b70c0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fb3940095f0 tx=0x7fb394005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:27:13.897 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:13.890+0000 7fb3afc87740 1 -- 172.21.15.50:0/1654650712 shutdown_connections 2024-08-31T04:27:13.897 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:13.890+0000 7fb3afc87740 1 --2- 172.21.15.50:0/1654650712 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x563770931840 0x563770cf8970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:13.897 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:13.890+0000 7fb3afc87740 1 --2- 172.21.15.50:0/1654650712 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x563770929660 0x563770cf8430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:13.898 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:13.890+0000 7fb3afc87740 1 --2- 172.21.15.50:0/1654650712 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563770952520 0x563770cf7ef0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:13.898 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:13.890+0000 7fb3afc87740 1 -- 172.21.15.50:0/1654650712 >> 172.21.15.50:0/1654650712 conn(0x563770946910 msgr2=0x563770cf5de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:27:13.898 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:13.890+0000 7fb3afc87740 1 -- 172.21.15.50:0/1654650712 shutdown_connections 2024-08-31T04:27:13.898 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:13.890+0000 7fb3afc87740 1 -- 172.21.15.50:0/1654650712 wait complete. 2024-08-31T04:27:13.898 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:13.890+0000 7fb3afc87740 1 -- start start 2024-08-31T04:27:13.898 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:13.892+0000 7fb3afc87740 1 Processor -- start 2024-08-31T04:27:13.898 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:13.892+0000 7fb3afc87740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x563770929660 0x563770d032b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:27:13.898 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:13.892+0000 7fb3afc87740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563770931840 0x563770d037f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:27:13.898 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:13.892+0000 7fb3afc87740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x563770952520 0x563770d03d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:27:13.898 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:13.892+0000 7fb3afc87740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x563770ac0bb0 con 0x563770931840 2024-08-31T04:27:13.898 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:13.892+0000 7fb3afc87740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x563770be4f90 con 0x563770929660 2024-08-31T04:27:13.898 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:13.892+0000 7fb3afc87740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x563770d06670 con 0x563770952520 2024-08-31T04:27:13.899 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:13.892+0000 7fb3afc87740 10 client.0 _ll_register_callbacks cb 0x563770c0a710 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:27:13.899 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:13.892+0000 7fb3a1400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563770931840 0x563770d037f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:27:13.899 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:13.892+0000 7fb3a1e00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x563770929660 0x563770d032b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:27:13.899 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:13.892+0000 7fb3a1e00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x563770929660 0x563770d032b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.50:35788/0 (socket says 172.21.15.50:35788) 2024-08-31T04:27:13.899 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:13.892+0000 7fb3a1e00640 1 -- 172.21.15.50:0/3981175334 learned_addr learned my addr 172.21.15.50:0/3981175334 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:27:13.899 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:13.892+0000 7fb3a2800640 1 --2- 172.21.15.50:0/3981175334 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x563770952520 0x563770d03d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:27:13.899 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:13.892+0000 7fb3a1e00640 1 -- 172.21.15.50:0/3981175334 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x563770952520 msgr2=0x563770d03d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:27:13.899 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:13.892+0000 7fb3a1e00640 1 --2- 172.21.15.50:0/3981175334 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x563770952520 0x563770d03d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:13.899 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:13.892+0000 7fb3a1e00640 1 -- 172.21.15.50:0/3981175334 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563770931840 msgr2=0x563770d037f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:27:13.899 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:13.892+0000 7fb3a1e00640 1 --2- 172.21.15.50:0/3981175334 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563770931840 0x563770d037f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:13.899 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:13.892+0000 7fb3a1e00640 1 -- 172.21.15.50:0/3981175334 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563770a34960 con 0x563770929660 2024-08-31T04:27:13.899 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:13.892+0000 7fb3a1e00640 1 --2- 172.21.15.50:0/3981175334 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x563770929660 0x563770d032b0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fb3940045b0 tx=0x7fb394004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9563b77235b50361 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:27:13.900 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:13.892+0000 7fb383e00640 10 client.0 ms_handle_connect on v2:172.21.15.133:3300/0 2024-08-31T04:27:13.900 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:13.892+0000 7fb383e00640 1 -- 172.21.15.50:0/3981175334 <== mon.2 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb39401e830 con 0x563770929660 2024-08-31T04:27:13.900 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:13.892+0000 7fb3afc87740 1 -- 172.21.15.50:0/3981175334 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x563770bfce30 con 0x563770929660 2024-08-31T04:27:13.900 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:13.892+0000 7fb383e00640 1 -- 172.21.15.50:0/3981175334 <== mon.2 v2:172.21.15.133:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8219+0+0 (secure 0 0 0) 0x7fb39401e9d0 con 0x563770929660 2024-08-31T04:27:13.900 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:13.894+0000 7fb383e00640 1 -- 172.21.15.50:0/3981175334 <== mon.2 v2:172.21.15.133:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7fb39401ebd0 con 0x563770929660 2024-08-31T04:27:13.900 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:13.894+0000 7fb3afc87740 10 client.25814 fetch_fsmap learned FSMap version 33 2024-08-31T04:27:13.900 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:13.894+0000 7fb3afc87740 1 -- 172.21.15.50:0/3981175334 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x563770d12190 con 0x563770929660 2024-08-31T04:27:13.900 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:13.894+0000 7fb383e00640 1 -- 172.21.15.50:0/3981175334 <== mon.2 v2:172.21.15.133:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x563770bfce30 con 0x563770929660 2024-08-31T04:27:13.900 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:13.894+0000 7fb383e00640 1 -- 172.21.15.50:0/3981175334 <== mon.2 v2:172.21.15.133:3300/0 5 ==== fsmap(e 33) ==== 8378+0+0 (secure 0 0 0) 0x7fb3940313f0 con 0x563770929660 2024-08-31T04:27:13.900 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:13.894+0000 7fb3afc87740 10 client.25814 fetch_fsmap finished waiting for FSMap version 33 2024-08-31T04:27:13.900 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:13.894+0000 7fb3afc87740 10 client.25814 resolve_mds: validated gid 24695 aka daemon mds.b 2024-08-31T04:27:13.900 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:13.894+0000 7fb3afc87740 20 client.25814 populate_metadata read hostname 'smithi050' 2024-08-31T04:27:13.900 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:13.894+0000 7fb3afc87740 1 --2- 172.21.15.50:0/3981175334 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x563770910ea0 0x563770d15750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:27:13.901 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:13.894+0000 7fb3afc87740 4 client.25814 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T04:27:13.901 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:13.894+0000 7fb3afc87740 1 -- 172.21.15.50:0/3981175334 --> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563770c709e0 con 0x563770910ea0 2024-08-31T04:27:13.906 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:13.894+0000 7fb3a1400640 1 --2- 172.21.15.50:0/3981175334 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x563770910ea0 0x563770d15750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:27:13.907 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:13.894+0000 7fb3a1400640 1 --2- 172.21.15.50:0/3981175334 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x563770910ea0 0x563770d15750 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b19257a8b72b538a server_cookie=548596ea4ad8fc95 in_seq=0 out_seq=0 2024-08-31T04:27:13.907 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:13.894+0000 7fb383e00640 10 client.25814 ms_handle_connect on v2:172.21.15.133:6838/2526402262 2024-08-31T04:27:13.907 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:13.894+0000 7fb383e00640 1 -- 172.21.15.50:0/3981175334 <== mds.0 v2:172.21.15.133:6838/2526402262 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x563770c709e0 con 0x563770910ea0 2024-08-31T04:27:13.907 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:13.894+0000 7fb383e00640 10 client.25814 handle_command_reply: tid=0 2024-08-31T04:27:13.907 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:13.894+0000 7fb3afc87740 1 client.25814 shutdown 2024-08-31T04:27:13.908 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:13.894+0000 7fb3afc87740 1 -- 172.21.15.50:0/3981175334 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x563770929660 msgr2=0x563770d032b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:27:13.908 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:13.894+0000 7fb3afc87740 1 --2- 172.21.15.50:0/3981175334 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x563770929660 0x563770d032b0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fb3940045b0 tx=0x7fb394004730 comp rx=0 tx=0).stop 2024-08-31T04:27:13.908 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:13.894+0000 7fb3afc87740 1 -- 172.21.15.50:0/3981175334 shutdown_connections 2024-08-31T04:27:13.908 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:13.894+0000 7fb3afc87740 1 --2- 172.21.15.50:0/3981175334 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x563770910ea0 0x563770d15750 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:13.908 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:13.894+0000 7fb3afc87740 1 --2- 172.21.15.50:0/3981175334 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x563770952520 0x563770d03d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:13.908 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:13.894+0000 7fb383e00640 0 client.25814 ms_handle_reset on v2:172.21.15.133:6838/2526402262 2024-08-31T04:27:13.908 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:13.894+0000 7fb3afc87740 1 --2- 172.21.15.50:0/3981175334 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563770931840 0x563770d037f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:13.908 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:13.894+0000 7fb3afc87740 1 --2- 172.21.15.50:0/3981175334 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x563770929660 0x563770d032b0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:13.908 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:13.894+0000 7fb3afc87740 1 -- 172.21.15.50:0/3981175334 >> 172.21.15.50:0/3981175334 conn(0x563770946910 msgr2=0x563770cfb080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:27:13.908 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:13.894+0000 7fb3afc87740 1 -- 172.21.15.50:0/3981175334 shutdown_connections 2024-08-31T04:27:13.909 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:13.894+0000 7fb3afc87740 1 -- 172.21.15.50:0/3981175334 wait complete. 2024-08-31T04:27:13.909 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:13.894+0000 7fb3afc87740 20 client.25814 trim_cache size 0 max 16384 2024-08-31T04:27:13.918 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:13.911+0000 7fb3afc87740 1 Processor -- start 2024-08-31T04:27:13.918 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:13.911+0000 7fb3afc87740 1 -- start start 2024-08-31T04:27:13.918 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:13.916+0000 7fb3afc87740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563770929660 0x563770d0f2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:27:13.919 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:13.916+0000 7fb3afc87740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x563770931840 0x563770d0f7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:27:13.919 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:13.916+0000 7fb3afc87740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x563770952520 0x563770cf53d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:27:13.919 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:13.916+0000 7fb3afc87740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fb38400e420 con 0x563770929660 2024-08-31T04:27:13.919 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:13.916+0000 7fb3afc87740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7fb384010020 con 0x563770952520 2024-08-31T04:27:13.919 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:13.916+0000 7fb3afc87740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fb38400eaf0 con 0x563770931840 2024-08-31T04:27:13.919 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:13.916+0000 7fb3a1e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563770929660 0x563770d0f2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:27:13.919 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:13.916+0000 7fb3a1e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563770929660 0x563770d0f2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:40832/0 (socket says 172.21.15.50:40832) 2024-08-31T04:27:13.919 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:13.916+0000 7fb3a1e00640 1 -- 172.21.15.50:0/3544057722 learned_addr learned my addr 172.21.15.50:0/3544057722 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:27:13.919 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:13.916+0000 7fb3a2800640 1 --2- 172.21.15.50:0/3544057722 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x563770952520 0x563770cf53d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:27:13.920 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:13.916+0000 7fb3a1400640 1 --2- 172.21.15.50:0/3544057722 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x563770931840 0x563770d0f7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:27:13.920 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:13.918+0000 7fb3a2800640 1 -- 172.21.15.50:0/3544057722 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x563770931840 msgr2=0x563770d0f7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:27:13.920 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:13.918+0000 7fb3a2800640 1 --2- 172.21.15.50:0/3544057722 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x563770931840 0x563770d0f7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:13.920 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:13.918+0000 7fb3a2800640 1 -- 172.21.15.50:0/3544057722 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563770929660 msgr2=0x563770d0f2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:27:13.920 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:13.918+0000 7fb3a2800640 1 --2- 172.21.15.50:0/3544057722 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563770929660 0x563770d0f2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:13.920 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:13.918+0000 7fb3a2800640 1 -- 172.21.15.50:0/3544057722 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563770cfad50 con 0x563770952520 2024-08-31T04:27:13.921 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:13.918+0000 7fb3a1e00640 1 --2- 172.21.15.50:0/3544057722 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563770929660 0x563770d0f2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:27:13.921 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:13.918+0000 7fb3a2800640 1 --2- 172.21.15.50:0/3544057722 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x563770952520 0x563770cf53d0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fb39c0e2d80 tx=0x7fb39c0ab4e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=68a6a442063af4ab server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:27:13.921 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:13.918+0000 7fb38ea00640 1 -- 172.21.15.50:0/3544057722 <== mon.2 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb39c0abcb0 con 0x563770952520 2024-08-31T04:27:13.921 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:13.918+0000 7fb38ea00640 1 -- 172.21.15.50:0/3544057722 <== mon.2 v2:172.21.15.133:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb39c0b0520 con 0x563770952520 2024-08-31T04:27:13.921 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:13.918+0000 7fb38ea00640 1 -- 172.21.15.50:0/3544057722 <== mon.2 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb39c091af0 con 0x563770952520 2024-08-31T04:27:13.922 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:13.919+0000 7fb3afc87740 1 -- 172.21.15.50:0/3544057722 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x563770952520 msgr2=0x563770cf53d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:27:13.922 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:13.919+0000 7fb3afc87740 1 --2- 172.21.15.50:0/3544057722 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x563770952520 0x563770cf53d0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fb39c0e2d80 tx=0x7fb39c0ab4e0 comp rx=0 tx=0).stop 2024-08-31T04:27:13.923 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:13.919+0000 7fb3afc87740 1 -- 172.21.15.50:0/3544057722 shutdown_connections 2024-08-31T04:27:13.924 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:13.919+0000 7fb3afc87740 1 --2- 172.21.15.50:0/3544057722 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x563770931840 0x563770d0f7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:13.924 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:13.919+0000 7fb3afc87740 1 --2- 172.21.15.50:0/3544057722 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x563770952520 0x563770cf53d0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:13.924 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:13.919+0000 7fb3afc87740 1 --2- 172.21.15.50:0/3544057722 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563770929660 0x563770d0f2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:13.924 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:13.919+0000 7fb3afc87740 1 -- 172.21.15.50:0/3544057722 >> 172.21.15.50:0/3544057722 conn(0x563770946910 msgr2=0x563770cf97c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:27:13.924 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:13.919+0000 7fb3afc87740 1 -- 172.21.15.50:0/3544057722 shutdown_connections 2024-08-31T04:27:13.924 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:13.919+0000 7fb3afc87740 1 -- 172.21.15.50:0/3544057722 wait complete. 2024-08-31T04:27:13.924 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:13.919+0000 7fb3afc87740 1 -- start start 2024-08-31T04:27:13.924 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:13.919+0000 7fb3afc87740 1 Processor -- start 2024-08-31T04:27:13.924 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:13.919+0000 7fb3afc87740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x563770929660 0x563770d0a190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:27:13.924 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:13.919+0000 7fb3afc87740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x563770931840 0x563770d0a750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:27:13.924 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:13.919+0000 7fb3afc87740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563770952520 0x563770d87930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:27:13.924 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:13.919+0000 7fb3afc87740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fb38400f950 con 0x563770952520 2024-08-31T04:27:13.927 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:13.919+0000 7fb3afc87740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7fb38400f1c0 con 0x563770931840 2024-08-31T04:27:13.927 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:13.919+0000 7fb3afc87740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fb38400c400 con 0x563770929660 2024-08-31T04:27:13.928 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:13.919+0000 7fb3afc87740 10 client.0 _ll_register_callbacks cb 0x7fb3940044b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:27:13.928 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:13.919+0000 7fb3a1400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x563770931840 0x563770d0a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:27:13.928 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:13.919+0000 7fb3a1e00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x563770929660 0x563770d0a190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:27:13.928 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:13.919+0000 7fb3a1400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x563770931840 0x563770d0a750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.50:35810/0 (socket says 172.21.15.50:35810) 2024-08-31T04:27:13.928 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:13.919+0000 7fb3a1400640 1 -- 172.21.15.50:0/3117143918 learned_addr learned my addr 172.21.15.50:0/3117143918 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:27:13.928 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:13.919+0000 7fb3a1400640 1 -- 172.21.15.50:0/3117143918 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x563770929660 msgr2=0x563770d0a190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:27:13.928 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:13.919+0000 7fb3a1400640 1 --2- 172.21.15.50:0/3117143918 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x563770929660 0x563770d0a190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:13.928 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:13.919+0000 7fb3a1400640 1 -- 172.21.15.50:0/3117143918 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563770952520 msgr2=0x563770d87930 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-31T04:27:13.928 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:13.919+0000 7fb3a1400640 1 --2- 172.21.15.50:0/3117143918 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563770952520 0x563770d87930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:13.928 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:13.919+0000 7fb3a1400640 1 -- 172.21.15.50:0/3117143918 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563770d87fa0 con 0x563770931840 2024-08-31T04:27:13.928 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:13.919+0000 7fb3a1400640 1 --2- 172.21.15.50:0/3117143918 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x563770931840 0x563770d0a750 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fb390006010 tx=0x7fb390032ed0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e45ed8cd0c5f4ea5 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:27:13.928 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:13.919+0000 7fb383e00640 10 client.0 ms_handle_connect on v2:172.21.15.133:3300/0 2024-08-31T04:27:13.928 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:13.919+0000 7fb383e00640 1 -- 172.21.15.50:0/3117143918 <== mon.2 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb390044040 con 0x563770931840 2024-08-31T04:27:13.929 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:13.919+0000 7fb383e00640 1 -- 172.21.15.50:0/3117143918 <== mon.2 v2:172.21.15.133:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8219+0+0 (secure 0 0 0) 0x7fb390005510 con 0x563770931840 2024-08-31T04:27:13.929 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:13.919+0000 7fb3afc87740 1 -- 172.21.15.50:0/3117143918 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb39c0b0520 con 0x563770931840 2024-08-31T04:27:13.929 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:13.919+0000 7fb383e00640 1 -- 172.21.15.50:0/3117143918 <== mon.2 v2:172.21.15.133:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7fb390059050 con 0x563770931840 2024-08-31T04:27:13.929 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:13.919+0000 7fb3afc87740 10 client.25820 fetch_fsmap learned FSMap version 33 2024-08-31T04:27:13.929 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:13.919+0000 7fb3afc87740 1 -- 172.21.15.50:0/3117143918 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x563770d89240 con 0x563770931840 2024-08-31T04:27:13.929 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:13.919+0000 7fb383e00640 1 -- 172.21.15.50:0/3117143918 <== mon.2 v2:172.21.15.133:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb39c0b0520 con 0x563770931840 2024-08-31T04:27:13.929 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:13.919+0000 7fb383e00640 1 -- 172.21.15.50:0/3117143918 <== mon.2 v2:172.21.15.133:3300/0 5 ==== fsmap(e 33) ==== 8378+0+0 (secure 0 0 0) 0x7fb390049620 con 0x563770931840 2024-08-31T04:27:13.929 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:13.919+0000 7fb3afc87740 10 client.25820 fetch_fsmap finished waiting for FSMap version 33 2024-08-31T04:27:13.929 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:13.919+0000 7fb3afc87740 10 client.25820 resolve_mds: validated gid 24695 aka daemon mds.b 2024-08-31T04:27:13.929 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:13.919+0000 7fb3afc87740 20 client.25820 populate_metadata read hostname 'smithi050' 2024-08-31T04:27:13.929 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:13.919+0000 7fb3afc87740 1 --2- 172.21.15.50:0/3117143918 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x5637708e6250 0x563770d8b5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:27:13.929 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:13.919+0000 7fb3afc87740 4 client.25820 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "caac904b", "release": true, "await": true}] 2024-08-31T04:27:13.929 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:13.919+0000 7fb3afc87740 1 -- 172.21.15.50:0/3117143918 --> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] -- command(tid 0: {"prefix": "quiesce db", "set_id": "caac904b", "release": true, "await": true}) -- 0x563770c6c480 con 0x5637708e6250 2024-08-31T04:27:13.930 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:13.919+0000 7fb3a1e00640 1 --2- 172.21.15.50:0/3117143918 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x5637708e6250 0x563770d8b5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:27:13.931 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:13.919+0000 7fb3a1e00640 1 --2- 172.21.15.50:0/3117143918 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x5637708e6250 0x563770d8b5f0 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=96447f987d1a5143 server_cookie=7990cec73dada11c in_seq=0 out_seq=0 2024-08-31T04:27:13.931 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:13.925+0000 7fb383e00640 10 client.25820 ms_handle_connect on v2:172.21.15.133:6838/2526402262 2024-08-31T04:27:13.996 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:27:13 smithi177 ceph-mon[22025]: pgmap v497: 97 pgs: 97 active+clean; 543 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 556 KiB/s wr, 46 op/s 2024-08-31T04:27:14.042 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:27:13 smithi133 ceph-mon[22177]: pgmap v497: 97 pgs: 97 active+clean; 543 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 556 KiB/s wr, 46 op/s 2024-08-31T04:27:14.331 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:14.326+0000 7fb383e00640 1 -- 172.21.15.50:0/3117143918 <== mds.0 v2:172.21.15.133:6838/2526402262 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x563770c6c480 con 0x5637708e6250 2024-08-31T04:27:14.332 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:14.326+0000 7fb383e00640 10 client.25820 handle_command_reply: tid=0 2024-08-31T04:27:14.332 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:14.326+0000 7fb3afc87740 1 client.25820 shutdown 2024-08-31T04:27:14.332 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:14.326+0000 7fb3afc87740 1 -- 172.21.15.50:0/3117143918 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x563770931840 msgr2=0x563770d0a750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:27:14.332 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:14.326+0000 7fb3afc87740 1 --2- 172.21.15.50:0/3117143918 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x563770931840 0x563770d0a750 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fb390006010 tx=0x7fb390032ed0 comp rx=0 tx=0).stop 2024-08-31T04:27:14.333 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:14.326+0000 7fb3afc87740 1 -- 172.21.15.50:0/3117143918 shutdown_connections 2024-08-31T04:27:14.333 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:14.326+0000 7fb3afc87740 1 --2- 172.21.15.50:0/3117143918 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x5637708e6250 0x563770d8b5f0 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:14.333 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:14.326+0000 7fb3afc87740 1 --2- 172.21.15.50:0/3117143918 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563770952520 0x563770d87930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:14.333 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:14.326+0000 7fb3afc87740 1 --2- 172.21.15.50:0/3117143918 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x563770931840 0x563770d0a750 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:14.333 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:14.326+0000 7fb3afc87740 1 --2- 172.21.15.50:0/3117143918 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x563770929660 0x563770d0a190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:14.333 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:14.326+0000 7fb3afc87740 1 -- 172.21.15.50:0/3117143918 >> 172.21.15.50:0/3117143918 conn(0x563770946910 msgr2=0x563770cf97c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:27:14.333 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:14.326+0000 7fb383e00640 0 client.25820 ms_handle_reset on v2:172.21.15.133:6838/2526402262 2024-08-31T04:27:14.333 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:14.326+0000 7fb3afc87740 1 -- 172.21.15.50:0/3117143918 shutdown_connections 2024-08-31T04:27:14.333 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:14.326+0000 7fb3afc87740 1 -- 172.21.15.50:0/3117143918 wait complete. 2024-08-31T04:27:14.334 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:14.331+0000 7fb3afc87740 20 client.25820 trim_cache size 0 max 16384 2024-08-31T04:27:14.334 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-08-31T04:27:14.334 INFO:teuthology.orchestra.run.smithi050.stdout: "epoch": 33, 2024-08-31T04:27:14.334 INFO:teuthology.orchestra.run.smithi050.stdout: "leader": 24695, 2024-08-31T04:27:14.334 INFO:teuthology.orchestra.run.smithi050.stdout: "set_version": 12, 2024-08-31T04:27:14.334 INFO:teuthology.orchestra.run.smithi050.stdout: "sets": { 2024-08-31T04:27:14.334 INFO:teuthology.orchestra.run.smithi050.stdout: "caac904b": { 2024-08-31T04:27:14.334 INFO:teuthology.orchestra.run.smithi050.stdout: "version": 12, 2024-08-31T04:27:14.334 INFO:teuthology.orchestra.run.smithi050.stdout: "age_ref": 0.0, 2024-08-31T04:27:14.334 INFO:teuthology.orchestra.run.smithi050.stdout: "state": { 2024-08-31T04:27:14.335 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "RELEASED", 2024-08-31T04:27:14.335 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 0.0 2024-08-31T04:27:14.335 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:27:14.335 INFO:teuthology.orchestra.run.smithi050.stdout: "timeout": 90.0, 2024-08-31T04:27:14.335 INFO:teuthology.orchestra.run.smithi050.stdout: "expiration": 141.8, 2024-08-31T04:27:14.335 INFO:teuthology.orchestra.run.smithi050.stdout: "members": { 2024-08-31T04:27:14.335 INFO:teuthology.orchestra.run.smithi050.stdout: "file:/": { 2024-08-31T04:27:14.335 INFO:teuthology.orchestra.run.smithi050.stdout: "excluded": false, 2024-08-31T04:27:14.335 INFO:teuthology.orchestra.run.smithi050.stdout: "state": { 2024-08-31T04:27:14.335 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "RELEASED", 2024-08-31T04:27:14.335 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 0.0 2024-08-31T04:27:14.335 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T04:27:14.335 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T04:27:14.335 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T04:27:14.336 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T04:27:14.336 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T04:27:14.336 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-08-31T04:27:14.336 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:14.331+0000 7fb3a9000640 1 -- 172.21.15.50:0/2595824414 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fb3880b4bb0 msgr2=0x7fb3880b70c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:27:14.336 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:14.331+0000 7fb3a9000640 1 --2- 172.21.15.50:0/2595824414 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fb3880b4bb0 0x7fb3880b70c0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fb3940095f0 tx=0x7fb394005f90 comp rx=0 tx=0).stop 2024-08-31T04:27:14.336 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:14.331+0000 7fb3a9000640 1 -- 172.21.15.50:0/2595824414 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb3a410bdc0 msgr2=0x7fb3a41a1cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:27:14.336 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:14.331+0000 7fb3a9000640 1 --2- 172.21.15.50:0/2595824414 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb3a410bdc0 0x7fb3a41a1cd0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fb39c00efd0 tx=0x7fb39c00c6a0 comp rx=0 tx=0).stop 2024-08-31T04:27:14.336 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:14.333+0000 7fb3a9000640 1 -- 172.21.15.50:0/2595824414 shutdown_connections 2024-08-31T04:27:14.337 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:14.333+0000 7fb3a9000640 1 --2- 172.21.15.50:0/2595824414 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fb3880b4bb0 0x7fb3880b70c0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:14.337 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:14.333+0000 7fb3a9000640 1 --2- 172.21.15.50:0/2595824414 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb3a410b470 0x7fb3a419ca30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:14.337 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:14.333+0000 7fb3a9000640 1 --2- 172.21.15.50:0/2595824414 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb3a410bdc0 0x7fb3a41a1cd0 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:14.337 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:14.333+0000 7fb3a9000640 1 --2- 172.21.15.50:0/2595824414 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb3a4105b30 0x7fb3a419c490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:14.337 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:14.333+0000 7fb3a9000640 1 -- 172.21.15.50:0/2595824414 >> 172.21.15.50:0/2595824414 conn(0x7fb3a4101600 msgr2=0x7fb3a4103a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:27:14.346 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:14.333+0000 7fb3a9000640 1 -- 172.21.15.50:0/2595824414 shutdown_connections 2024-08-31T04:27:14.346 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:14.333+0000 7fb3a9000640 1 -- 172.21.15.50:0/2595824414 wait complete. 2024-08-31T04:27:14.630 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:27:14 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T04:27:14.996 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:27:14 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T04:27:15.042 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:27:14 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T04:27:15.360 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set 'caac904b', total seconds elapsed: 53.6 2024-08-31T04:27:15.360 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 21.8 2024-08-31T04:27:15.360 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 058d9fc6-674f-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-31T04:27:15.451 INFO:tasks.workunit.client.0.smithi050.stdout: 158 897 11 836 25 290 10 2024-08-31T04:27:15.831 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:27:15.951 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:27:15 smithi050 ceph-mon[17259]: pgmap v498: 97 pgs: 97 active+clean; 545 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 679 KiB/s wr, 48 op/s 2024-08-31T04:27:15.951 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:27:15 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:27:15.951 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:27:15 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T04:27:15.951 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:27:15 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:27:15.996 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:27:15 smithi177 ceph-mon[22025]: pgmap v498: 97 pgs: 97 active+clean; 545 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 679 KiB/s wr, 48 op/s 2024-08-31T04:27:15.996 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:27:15 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:27:15.996 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:27:15 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T04:27:15.996 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:27:15 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:27:16.043 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:27:15 smithi133 ceph-mon[22177]: pgmap v498: 97 pgs: 97 active+clean; 545 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 679 KiB/s wr, 48 op/s 2024-08-31T04:27:16.043 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:27:15 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:27:16.043 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:27:15 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T04:27:16.043 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:27:15 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:27:16.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:16.633+0000 7f7733400640 1 -- 172.21.15.50:0/2931883478 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f772c0754d0 msgr2=0x7f772c0758e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:27:16.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:16.633+0000 7f7733400640 1 --2- 172.21.15.50:0/2931883478 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f772c0754d0 0x7f772c0758e0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f7720009900 tx=0x7f772002a440 comp rx=0 tx=0).stop 2024-08-31T04:27:16.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:16.633+0000 7f7733400640 1 -- 172.21.15.50:0/2931883478 shutdown_connections 2024-08-31T04:27:16.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:16.633+0000 7f7733400640 1 --2- 172.21.15.50:0/2931883478 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f772c10fee0 0x7f772c112300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:16.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:16.633+0000 7f7733400640 1 --2- 172.21.15.50:0/2931883478 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f772c075e20 0x7f772c10f9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:16.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:16.633+0000 7f7733400640 1 --2- 172.21.15.50:0/2931883478 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f772c0754d0 0x7f772c0758e0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:16.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:16.633+0000 7f7733400640 1 -- 172.21.15.50:0/2931883478 >> 172.21.15.50:0/2931883478 conn(0x7f772c07b5f0 msgr2=0x7f772c07ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:27:16.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:16.633+0000 7f7733400640 1 -- 172.21.15.50:0/2931883478 shutdown_connections 2024-08-31T04:27:16.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:16.633+0000 7f7733400640 1 -- 172.21.15.50:0/2931883478 wait complete. 2024-08-31T04:27:16.637 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:16.635+0000 7f7733400640 1 Processor -- start 2024-08-31T04:27:16.637 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:16.635+0000 7f7733400640 1 -- start start 2024-08-31T04:27:16.637 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:16.636+0000 7f7733400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f772c0754d0 0x7f772c19c440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:27:16.637 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:16.636+0000 7f7733400640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f772c075e20 0x7f772c19c9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:27:16.637 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:16.636+0000 7f7733400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f772c10fee0 0x7f772c1a1c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:27:16.638 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:16.636+0000 7f7733400640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f772c115a70 con 0x7f772c10fee0 2024-08-31T04:27:16.638 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:16.636+0000 7f7733400640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f772c1158f0 con 0x7f772c0754d0 2024-08-31T04:27:16.638 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:16.636+0000 7f7733400640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f772c115bf0 con 0x7f772c075e20 2024-08-31T04:27:16.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:16.636+0000 7f7730a00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f772c0754d0 0x7f772c19c440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:27:16.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:16.636+0000 7f7730a00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f772c0754d0 0x7f772c19c440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.50:35826/0 (socket says 172.21.15.50:35826) 2024-08-31T04:27:16.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:16.636+0000 7f7730a00640 1 -- 172.21.15.50:0/1023128635 learned_addr learned my addr 172.21.15.50:0/1023128635 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:27:16.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:16.637+0000 7f7731400640 1 --2- 172.21.15.50:0/1023128635 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f772c10fee0 0x7f772c1a1c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:27:16.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:16.638+0000 7f772be00640 1 --2- 172.21.15.50:0/1023128635 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f772c075e20 0x7f772c19c9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:27:16.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:16.638+0000 7f7730a00640 1 -- 172.21.15.50:0/1023128635 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f772c075e20 msgr2=0x7f772c19c9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:27:16.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:16.638+0000 7f7730a00640 1 --2- 172.21.15.50:0/1023128635 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f772c075e20 0x7f772c19c9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:16.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:16.638+0000 7f7730a00640 1 -- 172.21.15.50:0/1023128635 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f772c10fee0 msgr2=0x7f772c1a1c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:27:16.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:16.638+0000 7f7730a00640 1 --2- 172.21.15.50:0/1023128635 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f772c10fee0 0x7f772c1a1c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:16.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:16.638+0000 7f7730a00640 1 -- 172.21.15.50:0/1023128635 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f772c1a23b0 con 0x7f772c0754d0 2024-08-31T04:27:16.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:16.638+0000 7f7731400640 1 --2- 172.21.15.50:0/1023128635 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f772c10fee0 0x7f772c1a1c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:27:16.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:16.639+0000 7f7730a00640 1 --2- 172.21.15.50:0/1023128635 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f772c0754d0 0x7f772c19c440 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f77200094b0 tx=0x7f7720003f80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:27:16.642 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:16.640+0000 7f7729600640 1 -- 172.21.15.50:0/1023128635 <== mon.2 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7720040030 con 0x7f772c0754d0 2024-08-31T04:27:16.642 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:16.640+0000 7f7729600640 1 -- 172.21.15.50:0/1023128635 <== mon.2 v2:172.21.15.133:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f772003c8f0 con 0x7f772c0754d0 2024-08-31T04:27:16.642 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:16.640+0000 7f7729600640 1 -- 172.21.15.50:0/1023128635 <== mon.2 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7720031ab0 con 0x7f772c0754d0 2024-08-31T04:27:16.642 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:16.640+0000 7f7733400640 1 -- 172.21.15.50:0/1023128635 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f772c1a2640 con 0x7f772c0754d0 2024-08-31T04:27:16.642 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:16.640+0000 7f7733400640 1 -- 172.21.15.50:0/1023128635 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f772c1a8e00 con 0x7f772c0754d0 2024-08-31T04:27:16.644 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:16.643+0000 7f7733400640 1 -- 172.21.15.50:0/1023128635 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f770c005290 con 0x7f772c0754d0 2024-08-31T04:27:16.648 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:16.646+0000 7f7729600640 1 -- 172.21.15.50:0/1023128635 <== mon.2 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 18) ==== 152577+0+0 (secure 0 0 0) 0x7f7720043030 con 0x7f772c0754d0 2024-08-31T04:27:16.650 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:16.648+0000 7f7729600640 1 --2- 172.21.15.50:0/1023128635 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f77140b4bb0 0x7f77140b70c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:27:16.650 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:16.649+0000 7f7729600640 1 -- 172.21.15.50:0/1023128635 <== mon.2 v2:172.21.15.133:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8219+0+0 (secure 0 0 0) 0x7f77201058a0 con 0x7f772c0754d0 2024-08-31T04:27:16.651 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:16.650+0000 7f772be00640 1 --2- 172.21.15.50:0/1023128635 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f77140b4bb0 0x7f77140b70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:27:16.653 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:16.652+0000 7f772be00640 1 --2- 172.21.15.50:0/1023128635 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f77140b4bb0 0x7f77140b70c0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f7718005fd0 tx=0x7f7718005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:27:16.658 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:16.656+0000 7f7729600640 1 -- 172.21.15.50:0/1023128635 <== mon.2 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f77200cc9e0 con 0x7f772c0754d0 2024-08-31T04:27:17.122 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:17.120+0000 7f7733400640 1 -- 172.21.15.50:0/1023128635 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f770c005580 con 0x7f772c0754d0 2024-08-31T04:27:17.127 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-08-31T04:27:17.127 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":33,"btime":"2024-08-31T04:25:32:194673+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14622,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/1565557530","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":1565557530},{"type":"v1","addr":"172.21.15.50:6835","nonce":1565557530}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14634,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6837/2660185946","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6836","nonce":2660185946},{"type":"v1","addr":"172.21.15.50:6837","nonce":2660185946}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":33,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-31T04:20:44.140709+0000","modified":"2024-08-31T04:25:32.194656+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24695,"mds_1":24691,"mds_2":24667,"mds_3":24656,"mds_4":24652},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14676":{"gid":14676,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.50:6839/2105228685","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6838","nonce":2105228685},{"type":"v1","addr":"172.21.15.50:6839","nonce":2105228685}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24590":{"gid":24590,"name":"k","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.133:6833/4283603962","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6832","nonce":4283603962},{"type":"v1","addr":"172.21.15.133:6833","nonce":4283603962}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24601":{"gid":24601,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.177:6833/1237129793","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":1237129793},{"type":"v1","addr":"172.21.15.177:6833","nonce":1237129793}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24626":{"gid":24626,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.133:6835/3637799701","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":3637799701},{"type":"v1","addr":"172.21.15.133:6835","nonce":3637799701}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24652":{"gid":24652,"name":"c","rank":4,"incarnation":26,"state":"up:active","state_seq":13,"addr":"172.21.15.177:6837/2159859285","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6836","nonce":2159859285},{"type":"v1","addr":"172.21.15.177:6837","nonce":2159859285}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24656":{"gid":24656,"name":"h","rank":3,"incarnation":22,"state":"up:active","state_seq":12,"addr":"172.21.15.133:6837/4014853202","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6836","nonce":4014853202},{"type":"v1","addr":"172.21.15.133:6837","nonce":4014853202}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24667":{"gid":24667,"name":"i","rank":2,"incarnation":20,"state":"up:active","state_seq":10,"addr":"172.21.15.177:6839/3600081752","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6838","nonce":3600081752},{"type":"v1","addr":"172.21.15.177:6839","nonce":3600081752}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24691":{"gid":24691,"name":"a","rank":1,"incarnation":18,"state":"up:active","state_seq":8,"addr":"172.21.15.50:6841/575209862","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6840","nonce":575209862},{"type":"v1","addr":"172.21.15.50:6841","nonce":575209862}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24695":{"gid":24695,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.133:6839/2526402262","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6838","nonce":2526402262},{"type":"v1","addr":"172.21.15.133:6839","nonce":2526402262}]},"join_fscid":-1,"export_targets":[1,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_25699":{"gid":25699,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.177:6835/1048370411","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6834","nonce":1048370411},{"type":"v1","addr":"172.21.15.177:6835","nonce":1048370411}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24695,"qdb_cluster":[24652,24691,24656,24695,24667]},"id":1}]} 2024-08-31T04:27:17.128 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:17.122+0000 7f7729600640 1 -- 172.21.15.50:0/1023128635 <== mon.2 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 33 v33) ==== 94+0+11993 (secure 0 0 0) 0x7f77200cc2e0 con 0x7f772c0754d0 2024-08-31T04:27:17.128 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 33 2024-08-31T04:27:17.128 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:17.126+0000 7f7733400640 1 -- 172.21.15.50:0/1023128635 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f77140b4bb0 msgr2=0x7f77140b70c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:27:17.128 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:17.126+0000 7f7733400640 1 --2- 172.21.15.50:0/1023128635 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f77140b4bb0 0x7f77140b70c0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f7718005fd0 tx=0x7f7718005850 comp rx=0 tx=0).stop 2024-08-31T04:27:17.128 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:17.126+0000 7f7733400640 1 -- 172.21.15.50:0/1023128635 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f772c0754d0 msgr2=0x7f772c19c440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:27:17.128 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:17.126+0000 7f7733400640 1 --2- 172.21.15.50:0/1023128635 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f772c0754d0 0x7f772c19c440 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f77200094b0 tx=0x7f7720003f80 comp rx=0 tx=0).stop 2024-08-31T04:27:17.128 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:17.126+0000 7f7733400640 1 -- 172.21.15.50:0/1023128635 shutdown_connections 2024-08-31T04:27:17.128 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:17.126+0000 7f7733400640 1 --2- 172.21.15.50:0/1023128635 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f77140b4bb0 0x7f77140b70c0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:17.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:17.126+0000 7f7733400640 1 --2- 172.21.15.50:0/1023128635 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f772c075e20 0x7f772c19c9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:17.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:17.126+0000 7f7733400640 1 --2- 172.21.15.50:0/1023128635 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f772c10fee0 0x7f772c1a1c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:17.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:17.126+0000 7f7733400640 1 --2- 172.21.15.50:0/1023128635 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f772c0754d0 0x7f772c19c440 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:17.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:17.126+0000 7f7733400640 1 -- 172.21.15.50:0/1023128635 >> 172.21.15.50:0/1023128635 conn(0x7f772c07b5f0 msgr2=0x7f772c1014b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:27:17.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:17.127+0000 7f7733400640 1 -- 172.21.15.50:0/1023128635 shutdown_connections 2024-08-31T04:27:17.129 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:17.128+0000 7f7733400640 1 -- 172.21.15.50:0/1023128635 wait complete. 2024-08-31T04:27:17.950 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:27:17 smithi050 ceph-mon[17259]: pgmap v499: 97 pgs: 97 active+clean; 548 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 963 KiB/s wr, 63 op/s 2024-08-31T04:27:17.950 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:27:17 smithi050 ceph-mon[17259]: from='client.? 172.21.15.50:0/1023128635' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T04:27:17.996 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:27:17 smithi177 ceph-mon[22025]: pgmap v499: 97 pgs: 97 active+clean; 548 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 963 KiB/s wr, 63 op/s 2024-08-31T04:27:17.996 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:27:17 smithi177 ceph-mon[22025]: from='client.? 172.21.15.50:0/1023128635' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T04:27:18.042 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:27:17 smithi133 ceph-mon[22177]: pgmap v499: 97 pgs: 97 active+clean; 548 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 963 KiB/s wr, 63 op/s 2024-08-31T04:27:18.043 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:27:17 smithi133 ceph-mon[22177]: from='client.? 172.21.15.50:0/1023128635' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T04:27:18.115 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24695 quiesce db / --timeout 90 --expiration 141.8 --await-for 45.0' 2024-08-31T04:27:18.115 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 058d9fc6-674f-11ef-bcd4-c7b262605968 -- timeout 105 ceph tell mds.24695 quiesce db / --timeout 90 --expiration 141.8 --await-for 45.0 2024-08-31T04:27:18.796 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:27:19.402 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:19.400+0000 7fd6ae600640 1 -- 172.21.15.50:0/1960892889 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd6a810a160 msgr2=0x7fd6a810a570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:27:19.402 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:19.400+0000 7fd6ae600640 1 --2- 172.21.15.50:0/1960892889 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd6a810a160 0x7fd6a810a570 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fd6a0009ca0 tx=0x7fd6a002a8f0 comp rx=0 tx=0).stop 2024-08-31T04:27:19.403 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:19.401+0000 7fd6ae600640 1 -- 172.21.15.50:0/1960892889 shutdown_connections 2024-08-31T04:27:19.403 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:19.401+0000 7fd6ae600640 1 --2- 172.21.15.50:0/1960892889 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd6a8111d30 0x7fd6a8114150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:19.403 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:19.401+0000 7fd6ae600640 1 --2- 172.21.15.50:0/1960892889 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd6a810ab40 0x7fd6a810b010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:19.403 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:19.401+0000 7fd6ae600640 1 --2- 172.21.15.50:0/1960892889 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd6a810a160 0x7fd6a810a570 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:19.403 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:19.401+0000 7fd6ae600640 1 -- 172.21.15.50:0/1960892889 >> 172.21.15.50:0/1960892889 conn(0x7fd6a80705b0 msgr2=0x7fd6a8072a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:27:19.404 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:19.402+0000 7fd6ae600640 1 -- 172.21.15.50:0/1960892889 shutdown_connections 2024-08-31T04:27:19.404 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:19.402+0000 7fd6ae600640 1 -- 172.21.15.50:0/1960892889 wait complete. 2024-08-31T04:27:19.418 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:19.407+0000 7fd6ae600640 1 Processor -- start 2024-08-31T04:27:19.419 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:19.408+0000 7fd6ae600640 1 -- start start 2024-08-31T04:27:19.419 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:19.410+0000 7fd6ae600640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd6a810a160 0x7fd6a8110cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:27:19.419 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:19.410+0000 7fd6ae600640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd6a810ab40 0x7fd6a8111320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:27:19.419 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:19.410+0000 7fd6ae600640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd6a8111d30 0x7fd6a81a1460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:27:19.419 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:19.410+0000 7fd6ae600640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fd6a81177b0 con 0x7fd6a8111d30 2024-08-31T04:27:19.419 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:19.410+0000 7fd6ae600640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7fd6a8117630 con 0x7fd6a810a160 2024-08-31T04:27:19.419 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:19.410+0000 7fd6ae600640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fd6a8117930 con 0x7fd6a810ab40 2024-08-31T04:27:19.420 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:19.414+0000 7fd6a7e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd6a8111d30 0x7fd6a81a1460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:27:19.420 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:19.414+0000 7fd6a7400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd6a810a160 0x7fd6a8110cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:27:19.420 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:19.414+0000 7fd6a7400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd6a810a160 0x7fd6a8110cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.50:35836/0 (socket says 172.21.15.50:35836) 2024-08-31T04:27:19.420 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:19.415+0000 7fd6a7400640 1 -- 172.21.15.50:0/2882328557 learned_addr learned my addr 172.21.15.50:0/2882328557 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:27:19.420 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:19.415+0000 7fd6a6a00640 1 --2- 172.21.15.50:0/2882328557 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd6a810ab40 0x7fd6a8111320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:27:19.420 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:19.415+0000 7fd6a7e00640 1 -- 172.21.15.50:0/2882328557 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd6a810ab40 msgr2=0x7fd6a8111320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:27:19.420 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:19.415+0000 7fd6a7e00640 1 --2- 172.21.15.50:0/2882328557 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd6a810ab40 0x7fd6a8111320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:19.420 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:19.416+0000 7fd6a7e00640 1 -- 172.21.15.50:0/2882328557 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd6a810a160 msgr2=0x7fd6a8110cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:27:19.421 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:19.416+0000 7fd6a7e00640 1 --2- 172.21.15.50:0/2882328557 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd6a810a160 0x7fd6a8110cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:19.421 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:19.416+0000 7fd6a7e00640 1 -- 172.21.15.50:0/2882328557 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6a81a1bf0 con 0x7fd6a8111d30 2024-08-31T04:27:19.421 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:19.416+0000 7fd6a7e00640 1 --2- 172.21.15.50:0/2882328557 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd6a8111d30 0x7fd6a81a1460 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fd69800c970 tx=0x7fd69800cd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:27:19.421 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:19.418+0000 7fd69fe00640 1 -- 172.21.15.50:0/2882328557 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd698007bb0 con 0x7fd6a8111d30 2024-08-31T04:27:19.421 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:19.418+0000 7fd69fe00640 1 -- 172.21.15.50:0/2882328557 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd69800ae40 con 0x7fd6a8111d30 2024-08-31T04:27:19.421 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:19.418+0000 7fd69fe00640 1 -- 172.21.15.50:0/2882328557 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd698018660 con 0x7fd6a8111d30 2024-08-31T04:27:19.421 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:19.418+0000 7fd6ae600640 1 -- 172.21.15.50:0/2882328557 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd6a81a1ee0 con 0x7fd6a8111d30 2024-08-31T04:27:19.421 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:19.418+0000 7fd6ae600640 1 -- 172.21.15.50:0/2882328557 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd6a81a8460 con 0x7fd6a8111d30 2024-08-31T04:27:19.444 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:19.442+0000 7fd6b583f740 1 Processor -- start 2024-08-31T04:27:19.446 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:19.443+0000 7fd69fe00640 1 -- 172.21.15.50:0/2882328557 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 18) ==== 152577+0+0 (secure 0 0 0) 0x7fd698018800 con 0x7fd6a8111d30 2024-08-31T04:27:19.447 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:19.446+0000 7fd6b583f740 1 -- start start 2024-08-31T04:27:19.449 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:19.448+0000 7fd6b583f740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557b52e8e1b0 0x557b53233dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:27:19.449 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:19.448+0000 7fd6b583f740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557b52e652f0 0x557b53234430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:27:19.450 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:19.449+0000 7fd6a6a00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557b52e8e1b0 0x557b53233dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:27:19.451 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:19.449+0000 7fd6a6a00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557b52e8e1b0 0x557b53233dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.50:34600/0 (socket says 172.21.15.50:34600) 2024-08-31T04:27:19.451 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:19.449+0000 7fd6a6a00640 1 -- 172.21.15.50:0/521561484 learned_addr learned my addr 172.21.15.50:0/521561484 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:27:19.451 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:19.449+0000 7fd6a7400640 1 --2- 172.21.15.50:0/521561484 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557b52e652f0 0x557b53234430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:27:19.453 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:19.449+0000 7fd6b583f740 1 --2- 172.21.15.50:0/521561484 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x557b52e6d4d0 0x557b53234f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:27:19.453 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:19.449+0000 7fd6b583f740 1 -- 172.21.15.50:0/521561484 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x557b531a6f70 con 0x557b52e652f0 2024-08-31T04:27:19.453 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:19.449+0000 7fd6b583f740 1 -- 172.21.15.50:0/521561484 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x557b53196500 con 0x557b52e6d4d0 2024-08-31T04:27:19.453 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:19.449+0000 7fd6b583f740 1 -- 172.21.15.50:0/521561484 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x557b5319a4b0 con 0x557b52e8e1b0 2024-08-31T04:27:19.454 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:19.449+0000 7fd69fe00640 1 --2- 172.21.15.50:0/2882328557 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fd68c0b4c80 0x7fd68c0b7190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:27:19.454 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:19.450+0000 7fd6a6a00640 1 --2- 172.21.15.50:0/521561484 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x557b52e6d4d0 0x557b53234f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:27:19.454 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:19.450+0000 7fd6a6a00640 1 -- 172.21.15.50:0/521561484 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x557b52e6d4d0 msgr2=0x557b53234f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:27:19.454 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:19.450+0000 7fd6a6a00640 1 --2- 172.21.15.50:0/521561484 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x557b52e6d4d0 0x557b53234f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:19.454 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:19.450+0000 7fd6a6a00640 1 -- 172.21.15.50:0/521561484 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557b52e652f0 msgr2=0x557b53234430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:27:19.454 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:19.450+0000 7fd6a6a00640 1 --2- 172.21.15.50:0/521561484 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557b52e652f0 0x557b53234430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:19.454 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:19.450+0000 7fd6a6a00640 1 -- 172.21.15.50:0/521561484 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557b53150c10 con 0x557b52e8e1b0 2024-08-31T04:27:19.454 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:19.450+0000 7fd6a7e00640 1 --2- 172.21.15.50:0/2882328557 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fd68c0b4c80 0x7fd68c0b7190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:27:19.454 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:19.450+0000 7fd6a6a00640 1 --2- 172.21.15.50:0/521561484 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557b52e8e1b0 0x557b53233dc0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fd6940135f0 tx=0x7fd69400a9b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1022ddcd8194981b server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:27:19.455 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:19.451+0000 7fd69fe00640 1 -- 172.21.15.50:0/2882328557 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8219+0+0 (secure 0 0 0) 0x7fd6980e4f30 con 0x7fd6a8111d30 2024-08-31T04:27:19.455 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:19.451+0000 7fd69cc00640 1 -- 172.21.15.50:0/521561484 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd694019030 con 0x557b52e8e1b0 2024-08-31T04:27:19.455 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:19.451+0000 7fd69cc00640 1 -- 172.21.15.50:0/521561484 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd69400fa30 con 0x557b52e8e1b0 2024-08-31T04:27:19.455 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:19.451+0000 7fd69cc00640 1 -- 172.21.15.50:0/521561484 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd694010820 con 0x557b52e8e1b0 2024-08-31T04:27:19.456 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:19.453+0000 7fd6a7e00640 1 --2- 172.21.15.50:0/2882328557 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fd68c0b4c80 0x7fd68c0b7190 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fd6980e2a40 tx=0x7fd6980e8720 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:27:19.456 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:19.454+0000 7fd6b583f740 1 -- 172.21.15.50:0/521561484 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557b52e8e1b0 msgr2=0x557b53233dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:27:19.456 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:19.454+0000 7fd6b583f740 1 --2- 172.21.15.50:0/521561484 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557b52e8e1b0 0x557b53233dc0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fd6940135f0 tx=0x7fd69400a9b0 comp rx=0 tx=0).stop 2024-08-31T04:27:19.457 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:19.455+0000 7fd6b583f740 1 -- 172.21.15.50:0/521561484 shutdown_connections 2024-08-31T04:27:19.458 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:19.455+0000 7fd6b583f740 1 --2- 172.21.15.50:0/521561484 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x557b52e6d4d0 0x557b53234f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:19.458 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:19.455+0000 7fd6b583f740 1 --2- 172.21.15.50:0/521561484 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557b52e652f0 0x557b53234430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:19.458 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:19.455+0000 7fd6b583f740 1 --2- 172.21.15.50:0/521561484 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557b52e8e1b0 0x557b53233dc0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:19.458 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:19.455+0000 7fd6b583f740 1 -- 172.21.15.50:0/521561484 >> 172.21.15.50:0/521561484 conn(0x557b52e82300 msgr2=0x557b5322f850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:27:19.458 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:19.456+0000 7fd6b583f740 1 -- 172.21.15.50:0/521561484 shutdown_connections 2024-08-31T04:27:19.459 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:19.456+0000 7fd6b583f740 1 -- 172.21.15.50:0/521561484 wait complete. 2024-08-31T04:27:19.459 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:19.457+0000 7fd6b583f740 1 -- start start 2024-08-31T04:27:19.459 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:19.457+0000 7fd6b583f740 1 Processor -- start 2024-08-31T04:27:19.461 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:19.459+0000 7fd6b583f740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557b52e652f0 0x557b5323d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:27:19.461 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:19.460+0000 7fd6b583f740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x557b52e6d4d0 0x557b5323dba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:27:19.462 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:19.460+0000 7fd6a7400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x557b52e6d4d0 0x557b5323dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:27:19.462 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:19.460+0000 7fd6b583f740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557b52e8e1b0 0x557b5323e710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:27:19.462 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:19.460+0000 7fd6a7400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x557b52e6d4d0 0x557b5323dba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.50:35844/0 (socket says 172.21.15.50:35844) 2024-08-31T04:27:19.463 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:19.460+0000 7fd6a7400640 1 -- 172.21.15.50:0/1398288942 learned_addr learned my addr 172.21.15.50:0/1398288942 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:27:19.463 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:19.460+0000 7fd6b583f740 1 -- 172.21.15.50:0/1398288942 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x557b530cfab0 con 0x557b52e8e1b0 2024-08-31T04:27:19.463 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:19.460+0000 7fd6b583f740 1 -- 172.21.15.50:0/1398288942 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x557b5313d320 con 0x557b52e6d4d0 2024-08-31T04:27:19.463 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:19.460+0000 7fd6b583f740 1 -- 172.21.15.50:0/1398288942 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x557b53235aa0 con 0x557b52e652f0 2024-08-31T04:27:19.463 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:19.461+0000 7fd6b583f740 10 client.0 _ll_register_callbacks cb 0x557b531436a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:27:19.463 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:19.461+0000 7fd6a6a00640 1 --2- 172.21.15.50:0/1398288942 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557b52e652f0 0x557b5323d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:27:19.464 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:19.462+0000 7fd6a7400640 1 -- 172.21.15.50:0/1398288942 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557b52e652f0 msgr2=0x557b5323d4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:27:19.464 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:19.463+0000 7fd6a7400640 1 --2- 172.21.15.50:0/1398288942 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557b52e652f0 0x557b5323d4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:19.464 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:19.463+0000 7fd6a7400640 1 -- 172.21.15.50:0/1398288942 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557b52e8e1b0 msgr2=0x557b5323e710 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-31T04:27:19.465 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:19.463+0000 7fd6a7400640 1 --2- 172.21.15.50:0/1398288942 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557b52e8e1b0 0x557b5323e710 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:19.465 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:19.463+0000 7fd6a7400640 1 -- 172.21.15.50:0/1398288942 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557b52ef9790 con 0x557b52e6d4d0 2024-08-31T04:27:19.465 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:19.463+0000 7fd6a6a00640 1 --2- 172.21.15.50:0/1398288942 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557b52e652f0 0x557b5323d4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T04:27:19.465 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:19.463+0000 7fd6b583f740 1 -- 172.21.15.50:0/1398288942 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd69400fa30 con 0x557b52e6d4d0 2024-08-31T04:27:19.465 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:19.463+0000 7fd6a7400640 1 --2- 172.21.15.50:0/1398288942 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x557b52e6d4d0 0x557b5323dba0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fd6a0003a20 tx=0x7fd6a0003a50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3b0883d66bede11 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:27:19.466 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:19.464+0000 7fd691600640 10 client.25835 ms_handle_connect on v2:172.21.15.133:3300/0 2024-08-31T04:27:19.466 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:19.464+0000 7fd691600640 1 -- 172.21.15.50:0/1398288942 <== mon.2 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6a00307f0 con 0x557b52e6d4d0 2024-08-31T04:27:19.466 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:19.464+0000 7fd691600640 1 -- 172.21.15.50:0/1398288942 <== mon.2 v2:172.21.15.133:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8219+0+0 (secure 0 0 0) 0x7fd6a0030990 con 0x557b52e6d4d0 2024-08-31T04:27:19.466 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:19.464+0000 7fd691600640 1 -- 172.21.15.50:0/1398288942 <== mon.2 v2:172.21.15.133:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7fd6a0030bf0 con 0x557b52e6d4d0 2024-08-31T04:27:19.466 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:19.465+0000 7fd6b583f740 10 client.25835 fetch_fsmap learned FSMap version 33 2024-08-31T04:27:19.466 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:19.465+0000 7fd6b583f740 1 -- 172.21.15.50:0/1398288942 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({fsmap=33}) -- 0x557b52f72620 con 0x557b52e6d4d0 2024-08-31T04:27:19.467 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:19.465+0000 7fd691600640 1 -- 172.21.15.50:0/1398288942 <== mon.2 v2:172.21.15.133:3300/0 4 ==== fsmap(e 33) ==== 8378+0+0 (secure 0 0 0) 0x7fd6a0043070 con 0x557b52e6d4d0 2024-08-31T04:27:19.468 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:19.466+0000 7fd6b583f740 10 client.25835 fetch_fsmap finished waiting for FSMap version 33 2024-08-31T04:27:19.468 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:19.466+0000 7fd6b583f740 10 client.25835 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T04:27:19.468 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:19.466+0000 7fd6b583f740 20 client.25835 populate_metadata read hostname 'smithi050' 2024-08-31T04:27:19.468 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:19.466+0000 7fd6b583f740 1 --2- 172.21.15.50:0/1398288942 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x557b52e4cd80 0x557b5324ae70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:27:19.468 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:19.466+0000 7fd6b583f740 4 client.25835 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T04:27:19.468 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:19.466+0000 7fd6b583f740 1 -- 172.21.15.50:0/1398288942 --> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557b531a8ec0 con 0x557b52e4cd80 2024-08-31T04:27:19.468 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:19.467+0000 7fd6a6a00640 1 --2- 172.21.15.50:0/1398288942 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x557b52e4cd80 0x557b5324ae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:27:19.469 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:19.468+0000 7fd6a6a00640 1 --2- 172.21.15.50:0/1398288942 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x557b52e4cd80 0x557b5324ae70 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b507b99648366fe3 server_cookie=44f00d80444db44f in_seq=0 out_seq=0 2024-08-31T04:27:19.469 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:19.468+0000 7fd691600640 10 client.25835 ms_handle_connect on v2:172.21.15.133:6838/2526402262 2024-08-31T04:27:19.472 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:19.470+0000 7fd691600640 1 -- 172.21.15.50:0/1398288942 <== mds.0 v2:172.21.15.133:6838/2526402262 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x557b531a8ec0 con 0x557b52e4cd80 2024-08-31T04:27:19.473 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:19.470+0000 7fd691600640 10 client.25835 handle_command_reply: tid=0 2024-08-31T04:27:19.473 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:19.470+0000 7fd6b583f740 1 client.25835 shutdown 2024-08-31T04:27:19.473 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:19.471+0000 7fd6b583f740 1 -- 172.21.15.50:0/1398288942 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x557b52e6d4d0 msgr2=0x557b5323dba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:27:19.473 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:19.471+0000 7fd6b583f740 1 --2- 172.21.15.50:0/1398288942 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x557b52e6d4d0 0x557b5323dba0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fd6a0003a20 tx=0x7fd6a0003a50 comp rx=0 tx=0).stop 2024-08-31T04:27:19.473 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:19.471+0000 7fd6b583f740 1 -- 172.21.15.50:0/1398288942 shutdown_connections 2024-08-31T04:27:19.473 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:19.471+0000 7fd6b583f740 1 --2- 172.21.15.50:0/1398288942 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x557b52e4cd80 0x557b5324ae70 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:19.473 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:19.471+0000 7fd6b583f740 1 --2- 172.21.15.50:0/1398288942 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557b52e8e1b0 0x557b5323e710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:19.473 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:19.471+0000 7fd6b583f740 1 --2- 172.21.15.50:0/1398288942 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x557b52e6d4d0 0x557b5323dba0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:19.473 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:19.471+0000 7fd6b583f740 1 --2- 172.21.15.50:0/1398288942 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557b52e652f0 0x557b5323d4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:19.473 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:19.471+0000 7fd6b583f740 1 -- 172.21.15.50:0/1398288942 >> 172.21.15.50:0/1398288942 conn(0x557b52e82300 msgr2=0x557b5322dcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:27:19.474 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:19.471+0000 7fd691600640 0 client.25835 ms_handle_reset on v2:172.21.15.133:6838/2526402262 2024-08-31T04:27:19.474 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:19.472+0000 7fd6b583f740 1 -- 172.21.15.50:0/1398288942 shutdown_connections 2024-08-31T04:27:19.474 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:19.472+0000 7fd6b583f740 1 -- 172.21.15.50:0/1398288942 wait complete. 2024-08-31T04:27:19.474 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:19.472+0000 7fd6b583f740 20 client.25835 trim_cache size 0 max 16384 2024-08-31T04:27:19.508 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:19.506+0000 7fd6b583f740 1 Processor -- start 2024-08-31T04:27:19.508 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:19.506+0000 7fd6b583f740 1 -- start start 2024-08-31T04:27:19.509 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:19.507+0000 7fd6b583f740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557b52e652f0 0x557b5322eb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:27:19.509 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:19.507+0000 7fd6b583f740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x557b52e6d4d0 0x557b5323d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:27:19.509 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:19.507+0000 7fd6b583f740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557b52e8e1b0 0x557b5323da20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:27:19.509 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:19.507+0000 7fd6b583f740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fd68800e470 con 0x557b52e652f0 2024-08-31T04:27:19.509 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:19.507+0000 7fd6b583f740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7fd688010070 con 0x557b52e6d4d0 2024-08-31T04:27:19.509 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:19.507+0000 7fd6b583f740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fd68800eb40 con 0x557b52e8e1b0 2024-08-31T04:27:19.510 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:19.507+0000 7fd6a7400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x557b52e6d4d0 0x557b5323d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:27:19.510 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:19.508+0000 7fd6a7400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x557b52e6d4d0 0x557b5323d4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.50:35846/0 (socket says 172.21.15.50:35846) 2024-08-31T04:27:19.510 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:19.508+0000 7fd6a7400640 1 -- 172.21.15.50:0/1543596091 learned_addr learned my addr 172.21.15.50:0/1543596091 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:27:19.510 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:19.508+0000 7fd6a6a00640 1 --2- 172.21.15.50:0/1543596091 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557b52e652f0 0x557b5322eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:27:19.511 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:19.509+0000 7fd6a6a00640 1 --2- 172.21.15.50:0/1543596091 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557b52e8e1b0 0x557b5323da20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:27:19.512 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:19.510+0000 7fd6a7400640 1 -- 172.21.15.50:0/1543596091 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557b52e8e1b0 msgr2=0x557b5323da20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:27:19.512 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:19.510+0000 7fd6a7400640 1 --2- 172.21.15.50:0/1543596091 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557b52e8e1b0 0x557b5323da20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:19.512 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:19.510+0000 7fd6a7400640 1 -- 172.21.15.50:0/1543596091 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557b52e652f0 msgr2=0x557b5322eb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:27:19.512 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:19.510+0000 7fd6a7400640 1 --2- 172.21.15.50:0/1543596091 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557b52e652f0 0x557b5322eb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:19.513 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:19.510+0000 7fd6a7400640 1 -- 172.21.15.50:0/1543596091 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557b5322f960 con 0x557b52e6d4d0 2024-08-31T04:27:19.513 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:19.510+0000 7fd6a6a00640 1 --2- 172.21.15.50:0/1543596091 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557b52e652f0 0x557b5322eb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:27:19.513 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:19.511+0000 7fd6a7400640 1 --2- 172.21.15.50:0/1543596091 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x557b52e6d4d0 0x557b5323d4e0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fd6a0006010 tx=0x7fd6a003f000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a8760c269a59f09e server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:27:19.514 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:19.512+0000 7fd693e00640 1 -- 172.21.15.50:0/1543596091 <== mon.2 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6a00305f0 con 0x557b52e6d4d0 2024-08-31T04:27:19.514 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:19.513+0000 7fd693e00640 1 -- 172.21.15.50:0/1543596091 <== mon.2 v2:172.21.15.133:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd69400fa30 con 0x557b52e6d4d0 2024-08-31T04:27:19.514 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:19.513+0000 7fd693e00640 1 -- 172.21.15.50:0/1543596091 <== mon.2 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6a00305f0 con 0x557b52e6d4d0 2024-08-31T04:27:19.515 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:19.514+0000 7fd6b583f740 1 -- 172.21.15.50:0/1543596091 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x557b52e6d4d0 msgr2=0x557b5323d4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:27:19.515 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:19.514+0000 7fd6b583f740 1 --2- 172.21.15.50:0/1543596091 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x557b52e6d4d0 0x557b5323d4e0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fd6a0006010 tx=0x7fd6a003f000 comp rx=0 tx=0).stop 2024-08-31T04:27:19.517 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:19.516+0000 7fd6b583f740 1 -- 172.21.15.50:0/1543596091 shutdown_connections 2024-08-31T04:27:19.519 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:19.516+0000 7fd6b583f740 1 --2- 172.21.15.50:0/1543596091 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557b52e8e1b0 0x557b5323da20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:19.519 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:19.516+0000 7fd6b583f740 1 --2- 172.21.15.50:0/1543596091 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x557b52e6d4d0 0x557b5323d4e0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:19.519 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:19.516+0000 7fd6b583f740 1 --2- 172.21.15.50:0/1543596091 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557b52e652f0 0x557b5322eb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:19.519 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:19.516+0000 7fd6b583f740 1 -- 172.21.15.50:0/1543596091 >> 172.21.15.50:0/1543596091 conn(0x557b52e82300 msgr2=0x557b5322e460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:27:19.520 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:19.519+0000 7fd6b583f740 1 -- 172.21.15.50:0/1543596091 shutdown_connections 2024-08-31T04:27:19.520 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:19.519+0000 7fd6b583f740 1 -- 172.21.15.50:0/1543596091 wait complete. 2024-08-31T04:27:19.520 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:19.519+0000 7fd6b583f740 1 -- start start 2024-08-31T04:27:19.520 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:19.519+0000 7fd6b583f740 1 Processor -- start 2024-08-31T04:27:19.521 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:19.520+0000 7fd6b583f740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557b52e652f0 0x557b532441b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:27:19.522 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:19.521+0000 7fd6a6a00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557b52e652f0 0x557b532441b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:27:19.522 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:19.521+0000 7fd6a6a00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557b52e652f0 0x557b532441b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:40908/0 (socket says 172.21.15.50:40908) 2024-08-31T04:27:19.523 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:19.521+0000 7fd6a6a00640 1 -- 172.21.15.50:0/312280419 learned_addr learned my addr 172.21.15.50:0/312280419 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:27:19.523 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:19.521+0000 7fd6b583f740 1 --2- 172.21.15.50:0/312280419 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x557b52e6d4d0 0x557b53244870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:27:19.523 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:19.521+0000 7fd6b583f740 1 --2- 172.21.15.50:0/312280419 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557b52e8e1b0 0x557b532b3670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:27:19.523 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:19.521+0000 7fd6b583f740 1 -- 172.21.15.50:0/312280419 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fd68800f9a0 con 0x557b52e652f0 2024-08-31T04:27:19.523 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:19.521+0000 7fd6a7400640 1 --2- 172.21.15.50:0/312280419 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x557b52e6d4d0 0x557b53244870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:27:19.523 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:19.521+0000 7fd6b583f740 1 -- 172.21.15.50:0/312280419 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7fd68800f210 con 0x557b52e6d4d0 2024-08-31T04:27:19.523 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:19.521+0000 7fd6b583f740 1 -- 172.21.15.50:0/312280419 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fd68800c450 con 0x557b52e8e1b0 2024-08-31T04:27:19.524 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:19.522+0000 7fd6a7400640 1 -- 172.21.15.50:0/312280419 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557b52e8e1b0 msgr2=0x557b532b3670 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-31T04:27:19.524 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:19.522+0000 7fd6a7400640 1 --2- 172.21.15.50:0/312280419 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557b52e8e1b0 0x557b532b3670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:19.524 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:19.522+0000 7fd6a7400640 1 -- 172.21.15.50:0/312280419 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557b52e652f0 msgr2=0x557b532441b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:27:19.524 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:19.522+0000 7fd6a7400640 1 --2- 172.21.15.50:0/312280419 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557b52e652f0 0x557b532441b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:19.524 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:19.522+0000 7fd6a7400640 1 -- 172.21.15.50:0/312280419 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557b532b3be0 con 0x557b52e6d4d0 2024-08-31T04:27:19.525 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:19.522+0000 7fd6a6a00640 1 --2- 172.21.15.50:0/312280419 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557b52e652f0 0x557b532441b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:27:19.525 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:19.523+0000 7fd6a7400640 1 --2- 172.21.15.50:0/312280419 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x557b52e6d4d0 0x557b53244870 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fd6a0009a60 tx=0x7fd6a0004680 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b226025cf234869 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:27:19.526 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:19.523+0000 7fd691600640 10 client.0 ms_handle_connect on v2:172.21.15.133:3300/0 2024-08-31T04:27:19.526 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:19.523+0000 7fd691600640 1 -- 172.21.15.50:0/312280419 <== mon.2 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6a0030de0 con 0x557b52e6d4d0 2024-08-31T04:27:19.526 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:19.523+0000 7fd691600640 1 -- 172.21.15.50:0/312280419 <== mon.2 v2:172.21.15.133:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8219+0+0 (secure 0 0 0) 0x7fd6a0050610 con 0x557b52e6d4d0 2024-08-31T04:27:19.526 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:19.523+0000 7fd6b583f740 10 client.0 _ll_register_callbacks cb 0x7fd6a0009440 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:27:19.526 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:19.524+0000 7fd6b583f740 1 -- 172.21.15.50:0/312280419 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd69400fa30 con 0x557b52e6d4d0 2024-08-31T04:27:19.527 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:19.524+0000 7fd691600640 1 -- 172.21.15.50:0/312280419 <== mon.2 v2:172.21.15.133:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7fd6a0050810 con 0x557b52e6d4d0 2024-08-31T04:27:19.527 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:19.524+0000 7fd6b583f740 10 client.25841 fetch_fsmap learned FSMap version 33 2024-08-31T04:27:19.527 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:19.524+0000 7fd6b583f740 1 -- 172.21.15.50:0/312280419 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({fsmap=33}) -- 0x557b532b4d40 con 0x557b52e6d4d0 2024-08-31T04:27:19.527 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:19.525+0000 7fd691600640 1 -- 172.21.15.50:0/312280419 <== mon.2 v2:172.21.15.133:3300/0 4 ==== fsmap(e 33) ==== 8378+0+0 (secure 0 0 0) 0x7fd6a0058070 con 0x557b52e6d4d0 2024-08-31T04:27:19.527 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:19.525+0000 7fd6b583f740 10 client.25841 fetch_fsmap finished waiting for FSMap version 33 2024-08-31T04:27:19.527 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:19.525+0000 7fd6b583f740 10 client.25841 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T04:27:19.527 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:19.525+0000 7fd6b583f740 20 client.25841 populate_metadata read hostname 'smithi050' 2024-08-31T04:27:19.527 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:19.525+0000 7fd6b583f740 1 --2- 172.21.15.50:0/312280419 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x557b52e221c0 0x557b532b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:27:19.527 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:19.525+0000 7fd6b583f740 4 client.25841 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-31T04:27:19.527 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:19.525+0000 7fd6b583f740 1 -- 172.21.15.50:0/312280419 --> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] -- command(tid 0: {"prefix": "flush journal"}) -- 0x557b531a4960 con 0x557b52e221c0 2024-08-31T04:27:19.528 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:19.526+0000 7fd6a6a00640 1 --2- 172.21.15.50:0/312280419 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x557b52e221c0 0x557b532b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:27:19.528 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:19.526+0000 7fd6a6a00640 1 --2- 172.21.15.50:0/312280419 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x557b52e221c0 0x557b532b77a0 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1bb9912578ea836e server_cookie=de2b17e4c5b28b93 in_seq=0 out_seq=0 2024-08-31T04:27:19.528 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:19.526+0000 7fd691600640 10 client.25841 ms_handle_connect on v2:172.21.15.133:6838/2526402262 2024-08-31T04:27:19.656 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:19.653+0000 7f0bb7200640 1 -- 172.21.15.50:0/3245057818 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0bb0102380 msgr2=0x7f0bb0102790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:27:19.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:19.653+0000 7f0bb7200640 1 --2- 172.21.15.50:0/3245057818 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0bb0102380 0x7f0bb0102790 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f0ba4009900 tx=0x7f0ba402a400 comp rx=0 tx=0).stop 2024-08-31T04:27:19.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:19.654+0000 7f0bb7200640 1 -- 172.21.15.50:0/3245057818 shutdown_connections 2024-08-31T04:27:19.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:19.654+0000 7f0bb7200640 1 --2- 172.21.15.50:0/3245057818 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0bb01077c0 0x7f0bb0107ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:19.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:19.654+0000 7f0bb7200640 1 --2- 172.21.15.50:0/3245057818 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0bb0102cd0 0x7f0bb0107200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:19.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:19.654+0000 7f0bb7200640 1 --2- 172.21.15.50:0/3245057818 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0bb0102380 0x7f0bb0102790 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:19.657 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:19.654+0000 7f0bb7200640 1 -- 172.21.15.50:0/3245057818 >> 172.21.15.50:0/3245057818 conn(0x7f0bb00fe0d0 msgr2=0x7f0bb0100520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:27:19.658 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:19.654+0000 7f0bb7200640 1 -- 172.21.15.50:0/3245057818 shutdown_connections 2024-08-31T04:27:19.658 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:19.654+0000 7f0bb7200640 1 -- 172.21.15.50:0/3245057818 wait complete. 2024-08-31T04:27:19.658 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:19.656+0000 7f0bb7200640 1 Processor -- start 2024-08-31T04:27:19.658 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:19.656+0000 7f0bb7200640 1 -- start start 2024-08-31T04:27:19.660 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:19.657+0000 7f0bb7200640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0bb0102380 0x7f0bb01a06c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:27:19.660 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:19.657+0000 7f0bb7200640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0bb0102cd0 0x7f0bb01a0c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:27:19.660 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:19.657+0000 7f0bb7200640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0bb01077c0 0x7f0bb01a5f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:27:19.660 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:19.657+0000 7f0bb7200640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f0bb0119cb0 con 0x7f0bb0102cd0 2024-08-31T04:27:19.660 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:19.657+0000 7f0bb7200640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f0bb0119b30 con 0x7f0bb01077c0 2024-08-31T04:27:19.660 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:19.657+0000 7f0bb7200640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f0bb0119e30 con 0x7f0bb0102380 2024-08-31T04:27:19.660 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:19.657+0000 7f0bb5e00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0bb0102380 0x7f0bb01a06c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:27:19.660 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:19.657+0000 7f0bb5e00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0bb0102380 0x7f0bb01a06c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.50:34646/0 (socket says 172.21.15.50:34646) 2024-08-31T04:27:19.661 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:19.657+0000 7f0bb5e00640 1 -- 172.21.15.50:0/3037284954 learned_addr learned my addr 172.21.15.50:0/3037284954 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:27:19.661 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:19.657+0000 7f0bb6800640 1 --2- 172.21.15.50:0/3037284954 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0bb01077c0 0x7f0bb01a5f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:27:19.661 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:19.658+0000 7f0bb5400640 1 --2- 172.21.15.50:0/3037284954 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0bb0102cd0 0x7f0bb01a0c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:27:19.661 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:19.658+0000 7f0bb5e00640 1 -- 172.21.15.50:0/3037284954 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0bb01077c0 msgr2=0x7f0bb01a5f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:27:19.661 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:19.658+0000 7f0bb5e00640 1 --2- 172.21.15.50:0/3037284954 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0bb01077c0 0x7f0bb01a5f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:19.661 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:19.658+0000 7f0bb5e00640 1 -- 172.21.15.50:0/3037284954 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0bb0102cd0 msgr2=0x7f0bb01a0c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:27:19.661 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:19.658+0000 7f0bb5e00640 1 --2- 172.21.15.50:0/3037284954 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0bb0102cd0 0x7f0bb01a0c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:19.661 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:19.658+0000 7f0bb5e00640 1 -- 172.21.15.50:0/3037284954 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0bb01a6630 con 0x7f0bb0102380 2024-08-31T04:27:19.662 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:19.658+0000 7f0bb5400640 1 --2- 172.21.15.50:0/3037284954 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0bb0102cd0 0x7f0bb01a0c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T04:27:19.662 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:19.658+0000 7f0bb5e00640 1 --2- 172.21.15.50:0/3037284954 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0bb0102380 0x7f0bb01a06c0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f0ba402a9f0 tx=0x7f0ba4003c10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:27:19.662 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:19.659+0000 7f0baaa00640 1 -- 172.21.15.50:0/3037284954 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ba403f070 con 0x7f0bb0102380 2024-08-31T04:27:19.662 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:19.659+0000 7f0baaa00640 1 -- 172.21.15.50:0/3037284954 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0ba403bb20 con 0x7f0bb0102380 2024-08-31T04:27:19.662 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:19.659+0000 7f0baaa00640 1 -- 172.21.15.50:0/3037284954 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ba4035030 con 0x7f0bb0102380 2024-08-31T04:27:19.663 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:19.659+0000 7f0bb7200640 1 -- 172.21.15.50:0/3037284954 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0bb01a68c0 con 0x7f0bb0102380 2024-08-31T04:27:19.663 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:19.659+0000 7f0bb7200640 1 -- 172.21.15.50:0/3037284954 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0bb01ad080 con 0x7f0bb0102380 2024-08-31T04:27:19.666 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:19.665+0000 7f0bbf622740 1 Processor -- start 2024-08-31T04:27:19.666 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:19.665+0000 7f0bbf622740 1 -- start start 2024-08-31T04:27:19.667 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:19.666+0000 7f0bbf622740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x558e912a0840 0x558e916472d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:27:19.668 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:19.666+0000 7f0bbf622740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x558e91277980 0x558e91647810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:27:19.668 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:19.666+0000 7f0bbf622740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558e9127fb60 0x558e91647d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:27:19.668 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:19.666+0000 7f0bbf622740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x558e915bc530 con 0x558e9127fb60 2024-08-31T04:27:19.668 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:19.666+0000 7f0bbf622740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x558e915abac0 con 0x558e91277980 2024-08-31T04:27:19.668 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:19.666+0000 7f0bbf622740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x558e915afa70 con 0x558e912a0840 2024-08-31T04:27:19.668 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:19.666+0000 7f0bb6800640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x558e912a0840 0x558e916472d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:27:19.669 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:19.666+0000 7f0bb6800640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x558e912a0840 0x558e916472d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.50:34648/0 (socket says 172.21.15.50:34648) 2024-08-31T04:27:19.669 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:19.666+0000 7f0bb6800640 1 -- 172.21.15.50:0/3511167717 learned_addr learned my addr 172.21.15.50:0/3511167717 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:27:19.670 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:19.667+0000 7f0bb6800640 1 -- 172.21.15.50:0/3511167717 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x558e91277980 msgr2=0x558e91647810 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-31T04:27:19.670 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:19.667+0000 7f0bb6800640 1 --2- 172.21.15.50:0/3511167717 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x558e91277980 0x558e91647810 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:19.670 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:19.667+0000 7f0bb6800640 1 -- 172.21.15.50:0/3511167717 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558e9127fb60 msgr2=0x558e91647d50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-31T04:27:19.670 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:19.667+0000 7f0bb6800640 1 --2- 172.21.15.50:0/3511167717 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558e9127fb60 0x558e91647d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:19.670 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:19.667+0000 7f0bb6800640 1 -- 172.21.15.50:0/3511167717 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558e9155e880 con 0x558e912a0840 2024-08-31T04:27:19.670 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:19.667+0000 7f0bb6800640 1 --2- 172.21.15.50:0/3511167717 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x558e912a0840 0x558e916472d0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f0bac009ee0 tx=0x7f0bac010740 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f98cf23a42b5c686 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:27:19.671 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:19.668+0000 7f0b9f000640 1 -- 172.21.15.50:0/3511167717 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bac016070 con 0x558e912a0840 2024-08-31T04:27:19.671 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:19.668+0000 7f0b9f000640 1 -- 172.21.15.50:0/3511167717 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0bac004d20 con 0x558e912a0840 2024-08-31T04:27:19.671 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:19.668+0000 7f0b9f000640 1 -- 172.21.15.50:0/3511167717 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bac0127c0 con 0x558e912a0840 2024-08-31T04:27:19.671 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:19.670+0000 7f0bbf622740 1 -- 172.21.15.50:0/3511167717 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x558e912a0840 msgr2=0x558e916472d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:27:19.672 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:19.670+0000 7f0bbf622740 1 --2- 172.21.15.50:0/3511167717 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x558e912a0840 0x558e916472d0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f0bac009ee0 tx=0x7f0bac010740 comp rx=0 tx=0).stop 2024-08-31T04:27:19.672 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:19.670+0000 7f0bbf622740 1 -- 172.21.15.50:0/3511167717 shutdown_connections 2024-08-31T04:27:19.672 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:19.670+0000 7f0bbf622740 1 --2- 172.21.15.50:0/3511167717 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558e9127fb60 0x558e91647d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:19.672 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:19.670+0000 7f0bbf622740 1 --2- 172.21.15.50:0/3511167717 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x558e91277980 0x558e91647810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:19.672 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:19.670+0000 7f0bbf622740 1 --2- 172.21.15.50:0/3511167717 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x558e912a0840 0x558e916472d0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:19.672 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:19.670+0000 7f0bbf622740 1 -- 172.21.15.50:0/3511167717 >> 172.21.15.50:0/3511167717 conn(0x558e91294990 msgr2=0x558e916451c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:27:19.673 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:19.671+0000 7f0baaa00640 1 -- 172.21.15.50:0/3037284954 <== mon.1 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 18) ==== 152577+0+0 (secure 0 0 0) 0x7f0ba4042070 con 0x7f0bb0102380 2024-08-31T04:27:19.673 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:19.671+0000 7f0bbf622740 1 -- 172.21.15.50:0/3511167717 shutdown_connections 2024-08-31T04:27:19.673 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:19.671+0000 7f0bbf622740 1 -- 172.21.15.50:0/3511167717 wait complete. 2024-08-31T04:27:19.673 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:19.672+0000 7f0bbf622740 1 -- start start 2024-08-31T04:27:19.674 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:19.672+0000 7f0bbf622740 1 Processor -- start 2024-08-31T04:27:19.676 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:19.673+0000 7f0baaa00640 1 --2- 172.21.15.50:0/3037284954 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f0b980b4b30 0x7f0b980b7040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:27:19.678 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:19.673+0000 7f0bbf622740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x558e9127fb60 0x558e91652f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:27:19.678 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:19.673+0000 7f0bbf622740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558e912a0840 0x558e91653540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:27:19.678 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:19.673+0000 7f0bbf622740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x558e9125f1c0 0x558e91658d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:27:19.678 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:19.673+0000 7f0bbf622740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x558e9140e7a0 con 0x558e912a0840 2024-08-31T04:27:19.679 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:19.673+0000 7f0bbf622740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x558e915327f0 con 0x558e9125f1c0 2024-08-31T04:27:19.679 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:19.673+0000 7f0baaa00640 1 -- 172.21.15.50:0/3037284954 <== mon.1 v2:172.21.15.177:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8219+0+0 (secure 0 0 0) 0x7f0ba4105950 con 0x7f0bb0102380 2024-08-31T04:27:19.679 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:19.673+0000 7f0bbf622740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x558e91655ab0 con 0x558e9127fb60 2024-08-31T04:27:19.679 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:19.674+0000 7f0bbf622740 10 client.0 _ll_register_callbacks cb 0x558e91557e60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:27:19.679 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:19.674+0000 7f0bb6800640 1 --2- 172.21.15.50:0/3037284954 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f0b980b4b30 0x7f0b980b7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:27:19.679 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:19.674+0000 7f0bb6800640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x558e9125f1c0 0x558e91658d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:27:19.679 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:19.674+0000 7f0bb5e00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x558e9127fb60 0x558e91652f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:27:19.679 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:19.674+0000 7f0bb5e00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x558e9127fb60 0x558e91652f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.50:34652/0 (socket says 172.21.15.50:34652) 2024-08-31T04:27:19.679 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:19.674+0000 7f0bb5e00640 1 -- 172.21.15.50:0/3903627659 learned_addr learned my addr 172.21.15.50:0/3903627659 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:27:19.679 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:19.674+0000 7f0bb5400640 1 --2- 172.21.15.50:0/3903627659 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558e912a0840 0x558e91653540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:27:19.679 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:19.674+0000 7f0bb5e00640 1 -- 172.21.15.50:0/3903627659 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x558e9125f1c0 msgr2=0x558e91658d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:27:19.680 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:19.674+0000 7f0bb5e00640 1 --2- 172.21.15.50:0/3903627659 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x558e9125f1c0 0x558e91658d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:19.680 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:19.674+0000 7f0bb5e00640 1 -- 172.21.15.50:0/3903627659 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558e912a0840 msgr2=0x558e91653540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:27:19.680 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:19.674+0000 7f0bb5e00640 1 --2- 172.21.15.50:0/3903627659 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558e912a0840 0x558e91653540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:19.680 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:19.674+0000 7f0bb5e00640 1 -- 172.21.15.50:0/3903627659 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558e9131ab90 con 0x558e9127fb60 2024-08-31T04:27:19.680 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:19.675+0000 7f0bb5e00640 1 --2- 172.21.15.50:0/3903627659 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x558e9127fb60 0x558e91652f80 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f0ba4000c00 tx=0x7f0ba4009260 comp rx=0 tx=0).ready entity=mon.1 client_cookie=aa62488e8b8ca0a7 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:27:19.680 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:19.675+0000 7f0b93400640 10 client.0 ms_handle_connect on v2:172.21.15.177:3300/0 2024-08-31T04:27:19.680 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:19.675+0000 7f0b93400640 1 -- 172.21.15.50:0/3903627659 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ba40b3050 con 0x558e9127fb60 2024-08-31T04:27:19.680 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:19.675+0000 7f0b93400640 1 -- 172.21.15.50:0/3903627659 <== mon.1 v2:172.21.15.177:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8219+0+0 (secure 0 0 0) 0x7f0ba4031430 con 0x558e9127fb60 2024-08-31T04:27:19.680 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:19.676+0000 7f0bb6800640 1 --2- 172.21.15.50:0/3037284954 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f0b980b4b30 0x7f0b980b7040 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f0bac005bd0 tx=0x7f0bac0059e0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:27:19.680 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:19.676+0000 7f0bbf622740 1 -- 172.21.15.50:0/3903627659 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0bac004d20 con 0x558e9127fb60 2024-08-31T04:27:19.680 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:19.676+0000 7f0b93400640 1 -- 172.21.15.50:0/3903627659 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f0ba40cc330 con 0x558e9127fb60 2024-08-31T04:27:19.681 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:19.677+0000 7f0bbf622740 10 client.25843 fetch_fsmap learned FSMap version 33 2024-08-31T04:27:19.681 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:19.677+0000 7f0bbf622740 1 -- 172.21.15.50:0/3903627659 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x558e91661bd0 con 0x558e9127fb60 2024-08-31T04:27:19.681 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:19.677+0000 7f0b93400640 1 -- 172.21.15.50:0/3903627659 <== mon.1 v2:172.21.15.177:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0bac004d20 con 0x558e9127fb60 2024-08-31T04:27:19.682 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:19.677+0000 7f0b93400640 1 -- 172.21.15.50:0/3903627659 <== mon.1 v2:172.21.15.177:3300/0 5 ==== fsmap(e 33) ==== 8378+0+0 (secure 0 0 0) 0x7f0ba40d51c0 con 0x558e9127fb60 2024-08-31T04:27:19.682 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:19.677+0000 7f0bbf622740 10 client.25843 fetch_fsmap finished waiting for FSMap version 33 2024-08-31T04:27:19.682 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:19.677+0000 7f0bbf622740 10 client.25843 resolve_mds: validated gid 24695 aka daemon mds.b 2024-08-31T04:27:19.682 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:19.677+0000 7f0bbf622740 20 client.25843 populate_metadata read hostname 'smithi050' 2024-08-31T04:27:19.682 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:19.677+0000 7f0bbf622740 1 --2- 172.21.15.50:0/3903627659 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x558e91234570 0x558e91665200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:27:19.682 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:19.678+0000 7f0bbf622740 4 client.25843 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T04:27:19.682 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:19.678+0000 7f0bbf622740 1 -- 172.21.15.50:0/3903627659 --> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558e915be480 con 0x558e91234570 2024-08-31T04:27:19.682 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:19.678+0000 7f0bb5400640 1 --2- 172.21.15.50:0/3903627659 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x558e91234570 0x558e91665200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:27:19.682 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:19.679+0000 7f0bb5400640 1 --2- 172.21.15.50:0/3903627659 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x558e91234570 0x558e91665200 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=549f70368c83b0a7 server_cookie=c3f55a7d323d78a0 in_seq=0 out_seq=0 2024-08-31T04:27:19.683 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:19.679+0000 7f0b93400640 10 client.25843 ms_handle_connect on v2:172.21.15.133:6838/2526402262 2024-08-31T04:27:19.684 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:19.681+0000 7f0b93400640 1 -- 172.21.15.50:0/3903627659 <== mds.0 v2:172.21.15.133:6838/2526402262 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x558e915be480 con 0x558e91234570 2024-08-31T04:27:19.684 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:19.681+0000 7f0b93400640 10 client.25843 handle_command_reply: tid=0 2024-08-31T04:27:19.684 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:19.681+0000 7f0bbf622740 1 client.25843 shutdown 2024-08-31T04:27:19.684 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:19.682+0000 7f0bbf622740 1 -- 172.21.15.50:0/3903627659 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x558e9127fb60 msgr2=0x558e91652f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:27:19.684 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:19.682+0000 7f0bbf622740 1 --2- 172.21.15.50:0/3903627659 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x558e9127fb60 0x558e91652f80 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f0ba4000c00 tx=0x7f0ba4009260 comp rx=0 tx=0).stop 2024-08-31T04:27:19.684 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:19.682+0000 7f0bbf622740 1 -- 172.21.15.50:0/3903627659 shutdown_connections 2024-08-31T04:27:19.684 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:19.682+0000 7f0bbf622740 1 --2- 172.21.15.50:0/3903627659 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x558e91234570 0x558e91665200 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:19.684 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:19.682+0000 7f0b93400640 0 client.25843 ms_handle_reset on v2:172.21.15.133:6838/2526402262 2024-08-31T04:27:19.684 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:19.682+0000 7f0bbf622740 1 --2- 172.21.15.50:0/3903627659 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x558e9125f1c0 0x558e91658d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:19.685 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:19.682+0000 7f0bbf622740 1 --2- 172.21.15.50:0/3903627659 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558e912a0840 0x558e91653540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:19.685 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:19.682+0000 7f0bbf622740 1 --2- 172.21.15.50:0/3903627659 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x558e9127fb60 0x558e91652f80 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:19.685 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:19.682+0000 7f0bbf622740 1 -- 172.21.15.50:0/3903627659 >> 172.21.15.50:0/3903627659 conn(0x558e91294990 msgr2=0x558e91648300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:27:19.685 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:19.683+0000 7f0bbf622740 1 -- 172.21.15.50:0/3903627659 shutdown_connections 2024-08-31T04:27:19.685 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:19.683+0000 7f0bbf622740 1 -- 172.21.15.50:0/3903627659 wait complete. 2024-08-31T04:27:19.686 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:19.683+0000 7f0bbf622740 20 client.25843 trim_cache size 0 max 16384 2024-08-31T04:27:19.716 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:19.714+0000 7f0bbf622740 1 Processor -- start 2024-08-31T04:27:19.716 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:19.714+0000 7f0bbf622740 1 -- start start 2024-08-31T04:27:19.717 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:19.714+0000 7f0bbf622740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x558e9125f1c0 0x558e91658ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:27:19.718 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:19.714+0000 7f0bbf622740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558e9127fb60 0x558e9165fb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:27:19.718 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:19.714+0000 7f0bbf622740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x558e912a0840 0x558e916489c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:27:19.718 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:19.714+0000 7f0bbf622740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f0bb0074f10 con 0x558e9127fb60 2024-08-31T04:27:19.718 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:19.714+0000 7f0bbf622740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f0bb01ae9e0 con 0x558e912a0840 2024-08-31T04:27:19.718 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:19.714+0000 7f0bbf622740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f0bb01ad4b0 con 0x558e9125f1c0 2024-08-31T04:27:19.718 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:19.715+0000 7f0bb5400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558e9127fb60 0x558e9165fb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:27:19.719 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:19.715+0000 7f0bb5400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558e9127fb60 0x558e9165fb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:40960/0 (socket says 172.21.15.50:40960) 2024-08-31T04:27:19.719 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:19.715+0000 7f0bb5400640 1 -- 172.21.15.50:0/3720720738 learned_addr learned my addr 172.21.15.50:0/3720720738 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:27:19.719 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:19.715+0000 7f0bb6800640 1 --2- 172.21.15.50:0/3720720738 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x558e912a0840 0x558e916489c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:27:19.719 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:19.716+0000 7f0bb5400640 1 -- 172.21.15.50:0/3720720738 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x558e9125f1c0 msgr2=0x558e91658ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:27:19.719 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:19.716+0000 7f0bb5e00640 1 --2- 172.21.15.50:0/3720720738 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x558e9125f1c0 0x558e91658ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:27:19.719 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:19.716+0000 7f0bb5400640 1 --2- 172.21.15.50:0/3720720738 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x558e9125f1c0 0x558e91658ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:19.721 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:19.716+0000 7f0bb5400640 1 -- 172.21.15.50:0/3720720738 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x558e912a0840 msgr2=0x558e916489c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:27:19.721 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:19.716+0000 7f0bb5400640 1 --2- 172.21.15.50:0/3720720738 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x558e912a0840 0x558e916489c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:19.721 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:19.716+0000 7f0bb5400640 1 -- 172.21.15.50:0/3720720738 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558e916406d0 con 0x558e9127fb60 2024-08-31T04:27:19.721 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:19.716+0000 7f0bb6800640 1 --2- 172.21.15.50:0/3720720738 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x558e912a0840 0x558e916489c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T04:27:19.722 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:19.716+0000 7f0bb5e00640 1 --2- 172.21.15.50:0/3720720738 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x558e9125f1c0 0x558e91658ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T04:27:19.722 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:19.717+0000 7f0bb5400640 1 --2- 172.21.15.50:0/3720720738 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558e9127fb60 0x558e9165fb40 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f0bb0102b90 tx=0x7f0ba00097e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83fa31c92dce9205 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:27:19.722 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:19.718+0000 7f0b9e600640 1 -- 172.21.15.50:0/3720720738 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ba0004050 con 0x558e9127fb60 2024-08-31T04:27:19.722 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:19.719+0000 7f0b9e600640 1 -- 172.21.15.50:0/3720720738 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0ba0005520 con 0x558e9127fb60 2024-08-31T04:27:19.722 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:19.719+0000 7f0b9e600640 1 -- 172.21.15.50:0/3720720738 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ba0004d20 con 0x558e9127fb60 2024-08-31T04:27:19.723 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:19.721+0000 7f0bbf622740 1 -- 172.21.15.50:0/3720720738 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558e9127fb60 msgr2=0x558e9165fb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:27:19.723 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:19.721+0000 7f0bbf622740 1 --2- 172.21.15.50:0/3720720738 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558e9127fb60 0x558e9165fb40 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f0bb0102b90 tx=0x7f0ba00097e0 comp rx=0 tx=0).stop 2024-08-31T04:27:19.724 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:19.721+0000 7f0bbf622740 1 -- 172.21.15.50:0/3720720738 shutdown_connections 2024-08-31T04:27:19.724 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:19.721+0000 7f0bbf622740 1 --2- 172.21.15.50:0/3720720738 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x558e912a0840 0x558e916489c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:19.724 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:19.721+0000 7f0bbf622740 1 --2- 172.21.15.50:0/3720720738 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558e9127fb60 0x558e9165fb40 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:19.724 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:19.721+0000 7f0bbf622740 1 --2- 172.21.15.50:0/3720720738 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x558e9125f1c0 0x558e91658ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:19.725 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:19.721+0000 7f0bbf622740 1 -- 172.21.15.50:0/3720720738 >> 172.21.15.50:0/3720720738 conn(0x558e91294990 msgr2=0x558e916482b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:27:19.725 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:19.722+0000 7f0bbf622740 1 -- 172.21.15.50:0/3720720738 shutdown_connections 2024-08-31T04:27:19.726 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:19.722+0000 7f0bbf622740 1 -- 172.21.15.50:0/3720720738 wait complete. 2024-08-31T04:27:19.726 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:19.722+0000 7f0bbf622740 1 -- start start 2024-08-31T04:27:19.726 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:19.723+0000 7f0bbf622740 1 Processor -- start 2024-08-31T04:27:19.727 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:19.723+0000 7f0bbf622740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558e9125f1c0 0x558e9165fa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:27:19.727 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:19.723+0000 7f0bbf622740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x558e912a0840 0x558e91669b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:27:19.727 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:19.723+0000 7f0bbf622740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x558e9166a080 0x558e9166a490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:27:19.727 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:19.723+0000 7f0bbf622740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f0bb01ae310 con 0x558e9125f1c0 2024-08-31T04:27:19.727 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:19.723+0000 7f0bbf622740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f0bb01adb80 con 0x558e9166a080 2024-08-31T04:27:19.728 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:19.723+0000 7f0bbf622740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f0bb0107200 con 0x558e912a0840 2024-08-31T04:27:19.728 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:19.723+0000 7f0bbf622740 10 client.0 _ll_register_callbacks cb 0x7f0ba40cbc80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:27:19.728 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:19.724+0000 7f0bb6800640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x558e9166a080 0x558e9166a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:27:19.728 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:19.724+0000 7f0bb6800640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x558e9166a080 0x558e9166a490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.50:35904/0 (socket says 172.21.15.50:35904) 2024-08-31T04:27:19.728 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:19.724+0000 7f0bb5400640 1 --2- 172.21.15.50:0/1551714273 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x558e912a0840 0x558e91669b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:27:19.731 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:19.724+0000 7f0bb5e00640 1 --2- 172.21.15.50:0/1551714273 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558e9125f1c0 0x558e9165fa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:27:19.731 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:19.724+0000 7f0bb6800640 1 -- 172.21.15.50:0/1551714273 learned_addr learned my addr 172.21.15.50:0/1551714273 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:27:19.731 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:19.725+0000 7f0bb5400640 1 -- 172.21.15.50:0/1551714273 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x558e9166a080 msgr2=0x558e9166a490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:27:19.731 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:19.725+0000 7f0bb5400640 1 --2- 172.21.15.50:0/1551714273 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x558e9166a080 0x558e9166a490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:19.731 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:19.725+0000 7f0bb5400640 1 -- 172.21.15.50:0/1551714273 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558e9125f1c0 msgr2=0x558e9165fa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:27:19.732 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:19.725+0000 7f0bb5400640 1 --2- 172.21.15.50:0/1551714273 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558e9125f1c0 0x558e9165fa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:19.732 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:19.725+0000 7f0bb5400640 1 -- 172.21.15.50:0/1551714273 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558e916cfbc0 con 0x558e912a0840 2024-08-31T04:27:19.732 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:19.725+0000 7f0bb5400640 1 --2- 172.21.15.50:0/1551714273 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x558e912a0840 0x558e91669b40 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x558e9164a6f0 tx=0x7f0ba0004280 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d6845ac0bcb66b52 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:27:19.732 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:19.726+0000 7f0b93400640 10 client.0 ms_handle_connect on v2:172.21.15.177:3300/0 2024-08-31T04:27:19.732 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:19.726+0000 7f0b93400640 1 -- 172.21.15.50:0/1551714273 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ba00043f0 con 0x558e912a0840 2024-08-31T04:27:19.732 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:19.726+0000 7f0bbf622740 1 -- 172.21.15.50:0/1551714273 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0ba0005520 con 0x558e912a0840 2024-08-31T04:27:19.733 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:19.726+0000 7f0b93400640 1 -- 172.21.15.50:0/1551714273 <== mon.1 v2:172.21.15.177:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8219+0+0 (secure 0 0 0) 0x7f0ba00035f0 con 0x558e912a0840 2024-08-31T04:27:19.733 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:19.727+0000 7f0b93400640 1 -- 172.21.15.50:0/1551714273 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f0ba0038050 con 0x558e912a0840 2024-08-31T04:27:19.733 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:19.727+0000 7f0bbf622740 10 client.25846 fetch_fsmap learned FSMap version 33 2024-08-31T04:27:19.733 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:19.727+0000 7f0bbf622740 1 -- 172.21.15.50:0/1551714273 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x558e916d0c90 con 0x558e912a0840 2024-08-31T04:27:19.733 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:19.727+0000 7f0b93400640 1 -- 172.21.15.50:0/1551714273 <== mon.1 v2:172.21.15.177:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0ba0005520 con 0x558e912a0840 2024-08-31T04:27:19.733 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:19.728+0000 7f0b93400640 1 -- 172.21.15.50:0/1551714273 <== mon.1 v2:172.21.15.177:3300/0 5 ==== fsmap(e 33) ==== 8378+0+0 (secure 0 0 0) 0x7f0ba003b020 con 0x558e912a0840 2024-08-31T04:27:19.734 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:19.728+0000 7f0bbf622740 10 client.25846 fetch_fsmap finished waiting for FSMap version 33 2024-08-31T04:27:19.734 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:19.728+0000 7f0bbf622740 10 client.25846 resolve_mds: validated gid 24695 aka daemon mds.b 2024-08-31T04:27:19.734 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:19.728+0000 7f0bbf622740 20 client.25846 populate_metadata read hostname 'smithi050' 2024-08-31T04:27:19.734 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:19.728+0000 7f0bbf622740 1 --2- 172.21.15.50:0/1551714273 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x558e916d1350 0x558e916d3770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:27:19.734 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:19.728+0000 7f0bbf622740 4 client.25846 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 141.8, "await_for": 45.0}] 2024-08-31T04:27:19.734 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:19.728+0000 7f0bbf622740 1 -- 172.21.15.50:0/1551714273 --> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 141.8, "await_for": 45.0}) -- 0x558e915b9f20 con 0x558e916d1350 2024-08-31T04:27:19.735 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:19.728+0000 7f0bb5e00640 1 --2- 172.21.15.50:0/1551714273 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x558e916d1350 0x558e916d3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:27:19.735 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:19.729+0000 7f0bb5e00640 1 --2- 172.21.15.50:0/1551714273 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x558e916d1350 0x558e916d3770 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4789a7339e5aff5d server_cookie=fac8457279717df9 in_seq=0 out_seq=0 2024-08-31T04:27:19.735 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:19.729+0000 7f0b93400640 10 client.25846 ms_handle_connect on v2:172.21.15.133:6838/2526402262 2024-08-31T04:27:19.950 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:27:19 smithi050 ceph-mon[17259]: pgmap v500: 97 pgs: 97 active+clean; 550 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 112 op/s 2024-08-31T04:27:19.996 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:27:19 smithi177 ceph-mon[22025]: pgmap v500: 97 pgs: 97 active+clean; 550 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 112 op/s 2024-08-31T04:27:20.042 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:27:19 smithi133 ceph-mon[22177]: pgmap v500: 97 pgs: 97 active+clean; 550 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 112 op/s 2024-08-31T04:27:20.860 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:20.859+0000 7fd691600640 1 -- 172.21.15.50:0/312280419 <== mds.0 v2:172.21.15.133:6838/2526402262 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x557b531a4960 con 0x557b52e221c0 2024-08-31T04:27:20.860 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:20.859+0000 7fd691600640 10 client.25841 handle_command_reply: tid=0 2024-08-31T04:27:20.860 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:20.859+0000 7fd6b583f740 1 client.25841 shutdown 2024-08-31T04:27:20.861 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:20.859+0000 7fd6b583f740 1 -- 172.21.15.50:0/312280419 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x557b52e6d4d0 msgr2=0x557b53244870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:27:20.861 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:20.859+0000 7fd6b583f740 1 --2- 172.21.15.50:0/312280419 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x557b52e6d4d0 0x557b53244870 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fd6a0009a60 tx=0x7fd6a0004680 comp rx=0 tx=0).stop 2024-08-31T04:27:20.862 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:20.859+0000 7fd6b583f740 1 -- 172.21.15.50:0/312280419 shutdown_connections 2024-08-31T04:27:20.862 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:20.859+0000 7fd6b583f740 1 --2- 172.21.15.50:0/312280419 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x557b52e221c0 0x557b532b77a0 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:20.862 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:20.859+0000 7fd6b583f740 1 --2- 172.21.15.50:0/312280419 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557b52e8e1b0 0x557b532b3670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:20.862 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:20.859+0000 7fd6b583f740 1 --2- 172.21.15.50:0/312280419 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x557b52e6d4d0 0x557b53244870 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:20.862 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:20.859+0000 7fd691600640 0 client.25841 ms_handle_reset on v2:172.21.15.133:6838/2526402262 2024-08-31T04:27:20.862 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:20.859+0000 7fd6b583f740 1 --2- 172.21.15.50:0/312280419 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557b52e652f0 0x557b532441b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:20.862 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:20.859+0000 7fd6b583f740 1 -- 172.21.15.50:0/312280419 >> 172.21.15.50:0/312280419 conn(0x557b52e82300 msgr2=0x557b5323d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:27:20.862 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:20.860+0000 7fd6b583f740 1 -- 172.21.15.50:0/312280419 shutdown_connections 2024-08-31T04:27:20.862 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:20.860+0000 7fd6b583f740 1 -- 172.21.15.50:0/312280419 wait complete. 2024-08-31T04:27:20.862 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:20.860+0000 7fd6b583f740 20 client.25841 trim_cache size 0 max 16384 2024-08-31T04:27:20.863 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout:{ 2024-08-31T04:27:20.863 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout: "message": "", 2024-08-31T04:27:20.863 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout: "return_code": 0 2024-08-31T04:27:20.863 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout:} 2024-08-31T04:27:20.863 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:20.861+0000 7fd6ae600640 1 -- 172.21.15.50:0/2882328557 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fd68c0b4c80 msgr2=0x7fd68c0b7190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:27:20.864 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:20.861+0000 7fd6ae600640 1 --2- 172.21.15.50:0/2882328557 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fd68c0b4c80 0x7fd68c0b7190 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fd6980e2a40 tx=0x7fd6980e8720 comp rx=0 tx=0).stop 2024-08-31T04:27:20.864 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:20.861+0000 7fd6ae600640 1 -- 172.21.15.50:0/2882328557 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd6a8111d30 msgr2=0x7fd6a81a1460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:27:20.864 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:20.861+0000 7fd6ae600640 1 --2- 172.21.15.50:0/2882328557 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd6a8111d30 0x7fd6a81a1460 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fd69800c970 tx=0x7fd69800cd70 comp rx=0 tx=0).stop 2024-08-31T04:27:20.864 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:20.861+0000 7fd6ae600640 1 -- 172.21.15.50:0/2882328557 shutdown_connections 2024-08-31T04:27:20.864 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:20.861+0000 7fd6ae600640 1 --2- 172.21.15.50:0/2882328557 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fd68c0b4c80 0x7fd68c0b7190 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:20.864 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:20.861+0000 7fd6ae600640 1 --2- 172.21.15.50:0/2882328557 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd6a810ab40 0x7fd6a8111320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:20.864 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:20.861+0000 7fd6ae600640 1 --2- 172.21.15.50:0/2882328557 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd6a8111d30 0x7fd6a81a1460 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:20.864 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:20.861+0000 7fd6ae600640 1 --2- 172.21.15.50:0/2882328557 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd6a810a160 0x7fd6a8110cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:20.864 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:20.861+0000 7fd6ae600640 1 -- 172.21.15.50:0/2882328557 >> 172.21.15.50:0/2882328557 conn(0x7fd6a80705b0 msgr2=0x7fd6a8070a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:27:20.864 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:20.862+0000 7fd6ae600640 1 -- 172.21.15.50:0/2882328557 shutdown_connections 2024-08-31T04:27:20.864 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:20.862+0000 7fd6ae600640 1 -- 172.21.15.50:0/2882328557 wait complete. 2024-08-31T04:27:21.884 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:27:21 smithi050 ceph-mon[17259]: pgmap v501: 97 pgs: 97 active+clean; 550 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 1.1 MiB/s wr, 191 op/s 2024-08-31T04:27:21.996 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:27:21 smithi177 ceph-mon[22025]: pgmap v501: 97 pgs: 97 active+clean; 550 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 1.1 MiB/s wr, 191 op/s 2024-08-31T04:27:22.043 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:27:21 smithi133 ceph-mon[22177]: pgmap v501: 97 pgs: 97 active+clean; 550 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 1.1 MiB/s wr, 191 op/s 2024-08-31T04:27:23.950 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:27:23 smithi050 ceph-mon[17259]: pgmap v502: 97 pgs: 97 active+clean; 557 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 8.0 MiB/s rd, 1.6 MiB/s wr, 440 op/s 2024-08-31T04:27:23.996 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:27:23 smithi177 ceph-mon[22025]: pgmap v502: 97 pgs: 97 active+clean; 557 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 8.0 MiB/s rd, 1.6 MiB/s wr, 440 op/s 2024-08-31T04:27:24.043 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:27:23 smithi133 ceph-mon[22177]: pgmap v502: 97 pgs: 97 active+clean; 557 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 8.0 MiB/s rd, 1.6 MiB/s wr, 440 op/s 2024-08-31T04:27:25.451 INFO:tasks.workunit.client.0.smithi050.stdout: 164 36430 231 26302 224 8621 230 2024-08-31T04:27:25.952 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:27:25 smithi050 ceph-mon[17259]: pgmap v503: 97 pgs: 97 active+clean; 557 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 9.0 MiB/s rd, 1.3 MiB/s wr, 477 op/s 2024-08-31T04:27:25.996 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:27:25 smithi177 ceph-mon[22025]: pgmap v503: 97 pgs: 97 active+clean; 557 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 9.0 MiB/s rd, 1.3 MiB/s wr, 477 op/s 2024-08-31T04:27:26.043 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:27:25 smithi133 ceph-mon[22177]: pgmap v503: 97 pgs: 97 active+clean; 557 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 9.0 MiB/s rd, 1.3 MiB/s wr, 477 op/s 2024-08-31T04:27:27.950 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:27:27 smithi050 ceph-mon[17259]: pgmap v504: 97 pgs: 97 active+clean; 564 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 9.9 MiB/s rd, 2.2 MiB/s wr, 599 op/s 2024-08-31T04:27:27.996 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:27:27 smithi177 ceph-mon[22025]: pgmap v504: 97 pgs: 97 active+clean; 564 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 9.9 MiB/s rd, 2.2 MiB/s wr, 599 op/s 2024-08-31T04:27:28.043 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:27:27 smithi133 ceph-mon[22177]: pgmap v504: 97 pgs: 97 active+clean; 564 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 9.9 MiB/s rd, 2.2 MiB/s wr, 599 op/s 2024-08-31T04:27:28.950 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:27:28 smithi050 ceph-mon[17259]: pgmap v505: 97 pgs: 97 active+clean; 564 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 9.9 MiB/s rd, 1.9 MiB/s wr, 592 op/s 2024-08-31T04:27:28.996 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:27:28 smithi177 ceph-mon[22025]: pgmap v505: 97 pgs: 97 active+clean; 564 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 9.9 MiB/s rd, 1.9 MiB/s wr, 592 op/s 2024-08-31T04:27:29.042 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:27:28 smithi133 ceph-mon[22177]: pgmap v505: 97 pgs: 97 active+clean; 564 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 9.9 MiB/s rd, 1.9 MiB/s wr, 592 op/s 2024-08-31T04:27:31.149 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:27:31 smithi050 ceph-mon[17259]: pgmap v506: 97 pgs: 97 active+clean; 566 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 9.0 MiB/s rd, 1.9 MiB/s wr, 542 op/s 2024-08-31T04:27:31.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:27:31 smithi177 ceph-mon[22025]: pgmap v506: 97 pgs: 97 active+clean; 566 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 9.0 MiB/s rd, 1.9 MiB/s wr, 542 op/s 2024-08-31T04:27:31.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:27:31 smithi133 ceph-mon[22177]: pgmap v506: 97 pgs: 97 active+clean; 566 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 9.0 MiB/s rd, 1.9 MiB/s wr, 542 op/s 2024-08-31T04:27:33.340 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:27:33 smithi050 ceph-mon[17259]: pgmap v507: 97 pgs: 97 active+clean; 566 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 MiB/s rd, 1.9 MiB/s wr, 475 op/s 2024-08-31T04:27:33.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:27:33 smithi177 ceph-mon[22025]: pgmap v507: 97 pgs: 97 active+clean; 566 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 MiB/s rd, 1.9 MiB/s wr, 475 op/s 2024-08-31T04:27:33.542 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:27:33 smithi133 ceph-mon[22177]: pgmap v507: 97 pgs: 97 active+clean; 566 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 MiB/s rd, 1.9 MiB/s wr, 475 op/s 2024-08-31T04:27:34.064 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:34.062+0000 7f3acde00640 1 -- 172.21.15.50:0/162278396 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3ac8103280 msgr2=0x7f3ac81036f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:27:34.064 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:34.062+0000 7f3acde00640 1 --2- 172.21.15.50:0/162278396 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3ac8103280 0x7f3ac81036f0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f3abc009900 tx=0x7f3abc02a420 comp rx=0 tx=0).stop 2024-08-31T04:27:34.064 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:34.062+0000 7f3acde00640 1 -- 172.21.15.50:0/162278396 shutdown_connections 2024-08-31T04:27:34.064 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:34.062+0000 7f3acde00640 1 --2- 172.21.15.50:0/162278396 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3ac8104ca0 0x7f3ac810b640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:34.065 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:34.062+0000 7f3acde00640 1 --2- 172.21.15.50:0/162278396 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3ac8104300 0x7f3ac8104710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:34.065 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:34.062+0000 7f3acde00640 1 --2- 172.21.15.50:0/162278396 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3ac8103280 0x7f3ac81036f0 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:34.065 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:34.062+0000 7f3acde00640 1 -- 172.21.15.50:0/162278396 >> 172.21.15.50:0/162278396 conn(0x7f3ac80febc0 msgr2=0x7f3ac8101070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:27:34.065 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:34.062+0000 7f3acde00640 1 -- 172.21.15.50:0/162278396 shutdown_connections 2024-08-31T04:27:34.065 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:34.062+0000 7f3acde00640 1 -- 172.21.15.50:0/162278396 wait complete. 2024-08-31T04:27:34.067 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:34.062+0000 7f3acde00640 1 Processor -- start 2024-08-31T04:27:34.067 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:34.062+0000 7f3acde00640 1 -- start start 2024-08-31T04:27:34.067 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:34.062+0000 7f3acde00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3ac8103280 0x7f3ac819bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:27:34.067 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:34.064+0000 7f3acde00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3ac8104300 0x7f3ac819c420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:27:34.067 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:34.064+0000 7f3acde00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3ac8104ca0 0x7f3ac819cfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:27:34.068 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:34.064+0000 7f3acde00640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f3ac810ef90 con 0x7f3ac8103280 2024-08-31T04:27:34.068 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:34.064+0000 7f3acde00640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f3ac810ee10 con 0x7f3ac8104300 2024-08-31T04:27:34.068 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:34.064+0000 7f3acde00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f3ac810f110 con 0x7f3ac8104ca0 2024-08-31T04:27:34.068 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:34.064+0000 7f3acca00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3ac8103280 0x7f3ac819bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:27:34.068 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:34.064+0000 7f3acca00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3ac8103280 0x7f3ac819bdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:60372/0 (socket says 172.21.15.50:60372) 2024-08-31T04:27:34.068 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:34.064+0000 7f3acca00640 1 -- 172.21.15.50:0/4116396700 learned_addr learned my addr 172.21.15.50:0/4116396700 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:27:34.068 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:34.064+0000 7f3ac7e00640 1 --2- 172.21.15.50:0/4116396700 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3ac8104300 0x7f3ac819c420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:27:34.068 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:34.064+0000 7f3acca00640 1 -- 172.21.15.50:0/4116396700 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3ac8104ca0 msgr2=0x7f3ac819cfd0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-08-31T04:27:34.068 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:34.064+0000 7f3acca00640 1 --2- 172.21.15.50:0/4116396700 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3ac8104ca0 0x7f3ac819cfd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:34.068 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:34.065+0000 7f3acca00640 1 -- 172.21.15.50:0/4116396700 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3ac8104300 msgr2=0x7f3ac819c420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:27:34.068 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:34.065+0000 7f3acca00640 1 --2- 172.21.15.50:0/4116396700 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3ac8104300 0x7f3ac819c420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:34.069 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:34.065+0000 7f3acca00640 1 -- 172.21.15.50:0/4116396700 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ac819d7f0 con 0x7f3ac8103280 2024-08-31T04:27:34.069 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:34.065+0000 7f3acca00640 1 --2- 172.21.15.50:0/4116396700 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3ac8103280 0x7f3ac819bdb0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f3abc031440 tx=0x7f3abc003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:27:34.069 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:34.065+0000 7f3ac5600640 1 -- 172.21.15.50:0/4116396700 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3abc03f070 con 0x7f3ac8103280 2024-08-31T04:27:34.069 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:34.065+0000 7f3ac5600640 1 -- 172.21.15.50:0/4116396700 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3abc031c50 con 0x7f3ac8103280 2024-08-31T04:27:34.069 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:34.065+0000 7f3ac5600640 1 -- 172.21.15.50:0/4116396700 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3abc035030 con 0x7f3ac8103280 2024-08-31T04:27:34.069 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:34.065+0000 7f3acde00640 1 -- 172.21.15.50:0/4116396700 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3ac819da80 con 0x7f3ac8103280 2024-08-31T04:27:34.069 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:34.066+0000 7f3acde00640 1 -- 172.21.15.50:0/4116396700 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3ac81a3ff0 con 0x7f3ac8103280 2024-08-31T04:27:34.070 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:34.069+0000 7f3ad64d8740 1 Processor -- start 2024-08-31T04:27:34.071 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:34.069+0000 7f3ad64d8740 1 -- start start 2024-08-31T04:27:34.072 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:34.069+0000 7f3ad64d8740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5642047761b0 0x564204b1bd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:27:34.072 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:34.070+0000 7f3ad64d8740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56420474d2f0 0x564204b1c3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:27:34.073 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:34.070+0000 7f3ad64d8740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5642047554d0 0x564204b1cf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:27:34.073 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:34.070+0000 7f3ad64d8740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x564204a8ef70 con 0x5642047761b0 2024-08-31T04:27:34.073 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:34.070+0000 7f3ad64d8740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x564204a7e500 con 0x5642047554d0 2024-08-31T04:27:34.073 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:34.070+0000 7f3ad64d8740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x564204a824b0 con 0x56420474d2f0 2024-08-31T04:27:34.073 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:34.070+0000 7f3acd400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5642047761b0 0x564204b1bd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:27:34.073 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:34.070+0000 7f3acd400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5642047761b0 0x564204b1bd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:60382/0 (socket says 172.21.15.50:60382) 2024-08-31T04:27:34.073 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:34.070+0000 7f3acd400640 1 -- 172.21.15.50:0/2425976571 learned_addr learned my addr 172.21.15.50:0/2425976571 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:27:34.073 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:34.070+0000 7f3ac7e00640 1 --2- 172.21.15.50:0/2425976571 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5642047554d0 0x564204b1cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:27:34.073 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:34.070+0000 7f3ac5600640 1 -- 172.21.15.50:0/4116396700 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 18) ==== 152577+0+0 (secure 0 0 0) 0x7f3abc042070 con 0x7f3ac8103280 2024-08-31T04:27:34.073 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:34.071+0000 7f3acd400640 1 -- 172.21.15.50:0/2425976571 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56420474d2f0 msgr2=0x564204b1c3b0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-08-31T04:27:34.073 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:34.071+0000 7f3acd400640 1 --2- 172.21.15.50:0/2425976571 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56420474d2f0 0x564204b1c3b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:34.074 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:34.071+0000 7f3acd400640 1 -- 172.21.15.50:0/2425976571 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5642047554d0 msgr2=0x564204b1cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:27:34.074 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:34.071+0000 7f3acd400640 1 --2- 172.21.15.50:0/2425976571 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5642047554d0 0x564204b1cf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:34.074 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:34.071+0000 7f3acd400640 1 -- 172.21.15.50:0/2425976571 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564204a38c10 con 0x5642047761b0 2024-08-31T04:27:34.074 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:34.071+0000 7f3ac7e00640 1 --2- 172.21.15.50:0/2425976571 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5642047554d0 0x564204b1cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:27:34.074 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:34.071+0000 7f3acd400640 1 --2- 172.21.15.50:0/2425976571 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5642047761b0 0x564204b1bd40 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f3ac0009d20 tx=0x7f3ac000b420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c9050e2bb1d0093 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:27:34.077 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:34.071+0000 7f3ab9c00640 1 -- 172.21.15.50:0/2425976571 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ac000bd40 con 0x5642047761b0 2024-08-31T04:27:34.077 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:34.071+0000 7f3ab9c00640 1 -- 172.21.15.50:0/2425976571 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3ac0017070 con 0x5642047761b0 2024-08-31T04:27:34.077 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:34.071+0000 7f3ab9c00640 1 -- 172.21.15.50:0/2425976571 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ac00115f0 con 0x5642047761b0 2024-08-31T04:27:34.077 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:34.071+0000 7f3ad64d8740 1 -- 172.21.15.50:0/2425976571 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5642047761b0 msgr2=0x564204b1bd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:27:34.077 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:34.071+0000 7f3ad64d8740 1 --2- 172.21.15.50:0/2425976571 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5642047761b0 0x564204b1bd40 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f3ac0009d20 tx=0x7f3ac000b420 comp rx=0 tx=0).stop 2024-08-31T04:27:34.077 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:34.071+0000 7f3ad64d8740 1 -- 172.21.15.50:0/2425976571 shutdown_connections 2024-08-31T04:27:34.077 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:34.071+0000 7f3ad64d8740 1 --2- 172.21.15.50:0/2425976571 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56420474d2f0 0x564204b1c3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:34.077 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:34.071+0000 7f3ad64d8740 1 --2- 172.21.15.50:0/2425976571 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5642047554d0 0x564204b1cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:34.078 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:34.071+0000 7f3ad64d8740 1 --2- 172.21.15.50:0/2425976571 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5642047761b0 0x564204b1bd40 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:34.078 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:34.071+0000 7f3ad64d8740 1 -- 172.21.15.50:0/2425976571 >> 172.21.15.50:0/2425976571 conn(0x56420476a300 msgr2=0x564204b177d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:27:34.078 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:34.071+0000 7f3ad64d8740 1 -- 172.21.15.50:0/2425976571 shutdown_connections 2024-08-31T04:27:34.078 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:34.071+0000 7f3ad64d8740 1 -- 172.21.15.50:0/2425976571 wait complete. 2024-08-31T04:27:34.078 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:34.071+0000 7f3ac5600640 1 --2- 172.21.15.50:0/4116396700 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f3ab00b4a40 0x7f3ab00b6f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:27:34.078 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:34.071+0000 7f3ac5600640 1 -- 172.21.15.50:0/4116396700 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8219+0+0 (secure 0 0 0) 0x7f3abc1059c0 con 0x7f3ac8103280 2024-08-31T04:27:34.078 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:34.071+0000 7f3ad64d8740 1 -- start start 2024-08-31T04:27:34.078 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:34.071+0000 7f3acd400640 1 --2- 172.21.15.50:0/4116396700 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f3ab00b4a40 0x7f3ab00b6f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:27:34.078 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:34.071+0000 7f3ad64d8740 1 Processor -- start 2024-08-31T04:27:34.078 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:34.074+0000 7f3ad64d8740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56420474d2f0 0x564204b253f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:27:34.078 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:34.074+0000 7f3ad64d8740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5642047554d0 0x564204b25ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:27:34.078 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:34.074+0000 7f3ad64d8740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5642047761b0 0x564204b26600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:27:34.079 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:34.074+0000 7f3ad64d8740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x5642049b7ab0 con 0x5642047554d0 2024-08-31T04:27:34.079 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:34.074+0000 7f3ad64d8740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x564204a25320 con 0x5642047761b0 2024-08-31T04:27:34.079 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:34.074+0000 7f3ad64d8740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x564204b1da20 con 0x56420474d2f0 2024-08-31T04:27:34.079 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:34.074+0000 7f3ad64d8740 10 client.0 _ll_register_callbacks cb 0x564204a5ee80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:27:34.079 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:34.074+0000 7f3acca00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56420474d2f0 0x564204b253f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:27:34.079 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:34.074+0000 7f3acd400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5642047761b0 0x564204b26600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:27:34.079 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:34.074+0000 7f3acca00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56420474d2f0 0x564204b253f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.50:39544/0 (socket says 172.21.15.50:39544) 2024-08-31T04:27:34.079 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:34.074+0000 7f3acca00640 1 -- 172.21.15.50:0/2649945584 learned_addr learned my addr 172.21.15.50:0/2649945584 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:27:34.079 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:34.074+0000 7f3acd400640 1 --2- 172.21.15.50:0/4116396700 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f3ab00b4a40 0x7f3ab00b6f50 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f3ac0009b30 tx=0x7f3ac00071d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:27:34.079 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:34.074+0000 7f3ac7e00640 1 --2- 172.21.15.50:0/2649945584 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5642047554d0 0x564204b25ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:27:34.079 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:34.074+0000 7f3acd400640 1 -- 172.21.15.50:0/2649945584 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56420474d2f0 msgr2=0x564204b253f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:27:34.079 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:34.074+0000 7f3acd400640 1 --2- 172.21.15.50:0/2649945584 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56420474d2f0 0x564204b253f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:34.080 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:34.074+0000 7f3acd400640 1 -- 172.21.15.50:0/2649945584 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5642047554d0 msgr2=0x564204b25ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:27:34.080 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:34.074+0000 7f3acd400640 1 --2- 172.21.15.50:0/2649945584 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5642047554d0 0x564204b25ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:34.080 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:34.074+0000 7f3acd400640 1 -- 172.21.15.50:0/2649945584 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5642047e1790 con 0x5642047761b0 2024-08-31T04:27:34.080 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:34.074+0000 7f3ac7e00640 1 --2- 172.21.15.50:0/2649945584 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5642047554d0 0x564204b25ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:27:34.080 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:34.074+0000 7f3acd400640 1 --2- 172.21.15.50:0/2649945584 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5642047761b0 0x564204b26600 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f3ac0009cf0 tx=0x7f3ac000b420 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7ec596e9c15927ec server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:27:34.080 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:34.074+0000 7f3aae000640 10 client.0 ms_handle_connect on v2:172.21.15.133:3300/0 2024-08-31T04:27:34.080 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:34.074+0000 7f3aae000640 1 -- 172.21.15.50:0/2649945584 <== mon.2 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ac002d030 con 0x5642047761b0 2024-08-31T04:27:34.080 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:34.074+0000 7f3aae000640 1 -- 172.21.15.50:0/2649945584 <== mon.2 v2:172.21.15.133:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8219+0+0 (secure 0 0 0) 0x7f3ac0003d30 con 0x5642047761b0 2024-08-31T04:27:34.080 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:34.074+0000 7f3ad64d8740 1 -- 172.21.15.50:0/2649945584 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3ac0017070 con 0x5642047761b0 2024-08-31T04:27:34.084 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:34.080+0000 7f3aae000640 1 -- 172.21.15.50:0/2649945584 <== mon.2 v2:172.21.15.133:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f3ac0034480 con 0x5642047761b0 2024-08-31T04:27:34.084 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:34.080+0000 7f3ad64d8740 10 client.25865 fetch_fsmap learned FSMap version 33 2024-08-31T04:27:34.084 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:34.080+0000 7f3ad64d8740 1 -- 172.21.15.50:0/2649945584 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x56420485a620 con 0x5642047761b0 2024-08-31T04:27:34.084 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:34.080+0000 7f3aae000640 1 -- 172.21.15.50:0/2649945584 <== mon.2 v2:172.21.15.133:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3ac0017070 con 0x5642047761b0 2024-08-31T04:27:34.085 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:34.080+0000 7f3aae000640 1 -- 172.21.15.50:0/2649945584 <== mon.2 v2:172.21.15.133:3300/0 5 ==== fsmap(e 33) ==== 8378+0+0 (secure 0 0 0) 0x7f3ac0011070 con 0x5642047761b0 2024-08-31T04:27:34.085 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:34.080+0000 7f3ad64d8740 10 client.25865 fetch_fsmap finished waiting for FSMap version 33 2024-08-31T04:27:34.085 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:34.080+0000 7f3ad64d8740 10 client.25865 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T04:27:34.085 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:34.080+0000 7f3ad64d8740 20 client.25865 populate_metadata read hostname 'smithi050' 2024-08-31T04:27:34.085 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:34.080+0000 7f3ad64d8740 1 --2- 172.21.15.50:0/2649945584 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x564204734d80 0x564204b328c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:27:34.085 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:34.080+0000 7f3ad64d8740 4 client.25865 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T04:27:34.086 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:34.080+0000 7f3ad64d8740 1 -- 172.21.15.50:0/2649945584 --> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564204a90ec0 con 0x564204734d80 2024-08-31T04:27:34.086 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:34.080+0000 7f3acca00640 1 --2- 172.21.15.50:0/2649945584 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x564204734d80 0x564204b328c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:27:34.087 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:34.080+0000 7f3aae000640 10 client.25865 ms_handle_connect on v2:172.21.15.133:6838/2526402262 2024-08-31T04:27:34.087 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:34.080+0000 7f3acca00640 1 --2- 172.21.15.50:0/2649945584 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x564204734d80 0x564204b328c0 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5212ff1572071780 server_cookie=86bd9ce4fa1adef3 in_seq=0 out_seq=0 2024-08-31T04:27:34.087 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:34.085+0000 7f3aae000640 1 -- 172.21.15.50:0/2649945584 <== mds.0 v2:172.21.15.133:6838/2526402262 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x564204a90ec0 con 0x564204734d80 2024-08-31T04:27:34.087 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:34.085+0000 7f3aae000640 10 client.25865 handle_command_reply: tid=0 2024-08-31T04:27:34.087 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:34.085+0000 7f3ad64d8740 1 client.25865 shutdown 2024-08-31T04:27:34.087 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:34.085+0000 7f3ad64d8740 1 -- 172.21.15.50:0/2649945584 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5642047761b0 msgr2=0x564204b26600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:27:34.088 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:34.085+0000 7f3ad64d8740 1 --2- 172.21.15.50:0/2649945584 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5642047761b0 0x564204b26600 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f3ac0009cf0 tx=0x7f3ac000b420 comp rx=0 tx=0).stop 2024-08-31T04:27:34.088 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:34.085+0000 7f3ad64d8740 1 -- 172.21.15.50:0/2649945584 shutdown_connections 2024-08-31T04:27:34.088 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:34.085+0000 7f3ad64d8740 1 --2- 172.21.15.50:0/2649945584 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x564204734d80 0x564204b328c0 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:34.088 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:34.085+0000 7f3ad64d8740 1 --2- 172.21.15.50:0/2649945584 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5642047761b0 0x564204b26600 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:34.088 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:34.085+0000 7f3ad64d8740 1 --2- 172.21.15.50:0/2649945584 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5642047554d0 0x564204b25ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:34.088 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:34.085+0000 7f3ad64d8740 1 --2- 172.21.15.50:0/2649945584 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56420474d2f0 0x564204b253f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:34.088 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:34.085+0000 7f3aae000640 0 client.25865 ms_handle_reset on v2:172.21.15.133:6838/2526402262 2024-08-31T04:27:34.088 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:34.085+0000 7f3ad64d8740 1 -- 172.21.15.50:0/2649945584 >> 172.21.15.50:0/2649945584 conn(0x56420476a300 msgr2=0x564204b15d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:27:34.088 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:34.086+0000 7f3ad64d8740 1 -- 172.21.15.50:0/2649945584 shutdown_connections 2024-08-31T04:27:34.088 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:34.086+0000 7f3ad64d8740 1 -- 172.21.15.50:0/2649945584 wait complete. 2024-08-31T04:27:34.088 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:34.086+0000 7f3ad64d8740 20 client.25865 trim_cache size 0 max 16384 2024-08-31T04:27:34.107 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:34.104+0000 7f3ad64d8740 1 Processor -- start 2024-08-31T04:27:34.108 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:34.104+0000 7f3ad64d8740 1 -- start start 2024-08-31T04:27:34.108 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:34.104+0000 7f3ad64d8740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56420474d2f0 0x564204b26b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:27:34.108 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:34.104+0000 7f3ad64d8740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5642047554d0 0x564204b24630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:27:34.108 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:34.104+0000 7f3ad64d8740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5642047761b0 0x564204b1cbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:27:34.108 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:34.104+0000 7f3ad64d8740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f3ac81acd80 con 0x5642047554d0 2024-08-31T04:27:34.108 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:34.104+0000 7f3ad64d8740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f3ac81ae980 con 0x5642047761b0 2024-08-31T04:27:34.108 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:34.104+0000 7f3ad64d8740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f3ac81ad450 con 0x56420474d2f0 2024-08-31T04:27:34.108 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:34.104+0000 7f3acd400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5642047761b0 0x564204b1cbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:27:34.108 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:34.104+0000 7f3ac7e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5642047554d0 0x564204b24630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:27:34.108 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:34.104+0000 7f3acd400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5642047761b0 0x564204b1cbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.50:50152/0 (socket says 172.21.15.50:50152) 2024-08-31T04:27:34.109 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:34.104+0000 7f3acd400640 1 -- 172.21.15.50:0/3764072650 learned_addr learned my addr 172.21.15.50:0/3764072650 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:27:34.109 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:34.104+0000 7f3acca00640 1 --2- 172.21.15.50:0/3764072650 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56420474d2f0 0x564204b26b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:27:34.110 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:34.104+0000 7f3acd400640 1 -- 172.21.15.50:0/3764072650 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56420474d2f0 msgr2=0x564204b26b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:27:34.110 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:34.104+0000 7f3acd400640 1 --2- 172.21.15.50:0/3764072650 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56420474d2f0 0x564204b26b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:34.110 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:34.104+0000 7f3acd400640 1 -- 172.21.15.50:0/3764072650 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5642047554d0 msgr2=0x564204b24630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:27:34.110 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:34.104+0000 7f3acd400640 1 --2- 172.21.15.50:0/3764072650 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5642047554d0 0x564204b24630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:34.110 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:34.104+0000 7f3acd400640 1 -- 172.21.15.50:0/3764072650 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564204b12ba0 con 0x5642047761b0 2024-08-31T04:27:34.110 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:34.104+0000 7f3acca00640 1 --2- 172.21.15.50:0/3764072650 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56420474d2f0 0x564204b26b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T04:27:34.110 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:34.104+0000 7f3ac7e00640 1 --2- 172.21.15.50:0/3764072650 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5642047554d0 0x564204b24630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:27:34.110 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:34.104+0000 7f3acd400640 1 --2- 172.21.15.50:0/3764072650 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5642047761b0 0x564204b1cbd0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f3ac00083a0 tx=0x7f3ac0012740 comp rx=0 tx=0).ready entity=mon.2 client_cookie=503050b6e74652c0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:27:34.110 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:34.104+0000 7f3ab9200640 1 -- 172.21.15.50:0/3764072650 <== mon.2 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ac002d070 con 0x5642047761b0 2024-08-31T04:27:34.110 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:34.104+0000 7f3ab9200640 1 -- 172.21.15.50:0/3764072650 <== mon.2 v2:172.21.15.133:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3ac0017040 con 0x5642047761b0 2024-08-31T04:27:34.111 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:34.104+0000 7f3ab9200640 1 -- 172.21.15.50:0/3764072650 <== mon.2 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ac0034860 con 0x5642047761b0 2024-08-31T04:27:34.111 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:34.109+0000 7f3ad64d8740 1 -- 172.21.15.50:0/3764072650 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5642047761b0 msgr2=0x564204b1cbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:27:34.111 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:34.109+0000 7f3ad64d8740 1 --2- 172.21.15.50:0/3764072650 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5642047761b0 0x564204b1cbd0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f3ac00083a0 tx=0x7f3ac0012740 comp rx=0 tx=0).stop 2024-08-31T04:27:34.112 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:34.109+0000 7f3ad64d8740 1 -- 172.21.15.50:0/3764072650 shutdown_connections 2024-08-31T04:27:34.112 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:34.109+0000 7f3ad64d8740 1 --2- 172.21.15.50:0/3764072650 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5642047761b0 0x564204b1cbd0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:34.112 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:34.109+0000 7f3ad64d8740 1 --2- 172.21.15.50:0/3764072650 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5642047554d0 0x564204b24630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:34.112 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:34.109+0000 7f3ad64d8740 1 --2- 172.21.15.50:0/3764072650 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56420474d2f0 0x564204b26b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:34.112 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:34.109+0000 7f3ad64d8740 1 -- 172.21.15.50:0/3764072650 >> 172.21.15.50:0/3764072650 conn(0x56420476a300 msgr2=0x564204b12490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:27:34.112 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:34.109+0000 7f3ad64d8740 1 -- 172.21.15.50:0/3764072650 shutdown_connections 2024-08-31T04:27:34.112 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:34.109+0000 7f3ad64d8740 1 -- 172.21.15.50:0/3764072650 wait complete. 2024-08-31T04:27:34.112 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:34.110+0000 7f3ad64d8740 1 -- start start 2024-08-31T04:27:34.112 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:34.110+0000 7f3ad64d8740 1 Processor -- start 2024-08-31T04:27:34.113 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:34.110+0000 7f3ad64d8740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56420474d2f0 0x564204b2c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:27:34.113 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:34.110+0000 7f3ad64d8740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5642047554d0 0x564204b2b690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:27:34.113 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:34.110+0000 7f3ad64d8740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5642047761b0 0x564204b2bbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:27:34.113 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:34.110+0000 7f3ad64d8740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f3ac81ae2b0 con 0x56420474d2f0 2024-08-31T04:27:34.113 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:34.110+0000 7f3ad64d8740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f3ac81adb20 con 0x5642047554d0 2024-08-31T04:27:34.113 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:34.110+0000 7f3ad64d8740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f3ac81aad60 con 0x5642047761b0 2024-08-31T04:27:34.113 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:34.110+0000 7f3ad64d8740 10 client.0 _ll_register_callbacks cb 0x7f3ab40097a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:27:34.114 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:34.110+0000 7f3acca00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56420474d2f0 0x564204b2c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:27:34.114 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:34.110+0000 7f3acca00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56420474d2f0 0x564204b2c9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:60422/0 (socket says 172.21.15.50:60422) 2024-08-31T04:27:34.114 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:34.110+0000 7f3acca00640 1 -- 172.21.15.50:0/289228906 learned_addr learned my addr 172.21.15.50:0/289228906 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:27:34.115 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:34.110+0000 7f3acca00640 1 -- 172.21.15.50:0/289228906 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5642047761b0 msgr2=0x564204b2bbd0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-08-31T04:27:34.115 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:34.110+0000 7f3acca00640 1 --2- 172.21.15.50:0/289228906 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5642047761b0 0x564204b2bbd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:34.115 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:34.110+0000 7f3acca00640 1 -- 172.21.15.50:0/289228906 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5642047554d0 msgr2=0x564204b2b690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:27:34.115 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:34.110+0000 7f3acca00640 1 --2- 172.21.15.50:0/289228906 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5642047554d0 0x564204b2b690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:34.116 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:34.110+0000 7f3acca00640 1 -- 172.21.15.50:0/289228906 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564204b2c110 con 0x56420474d2f0 2024-08-31T04:27:34.116 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:34.110+0000 7f3acca00640 1 --2- 172.21.15.50:0/289228906 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56420474d2f0 0x564204b2c9d0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f3abc0c8480 tx=0x7f3abc02a420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=668e0c96d5825871 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:27:34.116 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:34.110+0000 7f3aae000640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-08-31T04:27:34.116 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:34.110+0000 7f3aae000640 1 -- 172.21.15.50:0/289228906 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3abc0b7070 con 0x56420474d2f0 2024-08-31T04:27:34.116 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:34.110+0000 7f3aae000640 1 -- 172.21.15.50:0/289228906 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8219+0+0 (secure 0 0 0) 0x7f3abc0c8690 con 0x56420474d2f0 2024-08-31T04:27:34.116 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:34.110+0000 7f3ad64d8740 1 -- 172.21.15.50:0/289228906 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3ac0017040 con 0x56420474d2f0 2024-08-31T04:27:34.116 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:34.110+0000 7f3aae000640 1 -- 172.21.15.50:0/289228906 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f3abc049040 con 0x56420474d2f0 2024-08-31T04:27:34.116 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:34.110+0000 7f3ad64d8740 10 client.15861 fetch_fsmap learned FSMap version 33 2024-08-31T04:27:34.116 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:34.110+0000 7f3ad64d8740 1 -- 172.21.15.50:0/289228906 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x564204b2af00 con 0x56420474d2f0 2024-08-31T04:27:34.117 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:34.110+0000 7f3aae000640 1 -- 172.21.15.50:0/289228906 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3ac0017040 con 0x56420474d2f0 2024-08-31T04:27:34.117 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:34.110+0000 7f3aae000640 1 -- 172.21.15.50:0/289228906 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 33) ==== 8378+0+0 (secure 0 0 0) 0x7f3abc03b4f0 con 0x56420474d2f0 2024-08-31T04:27:34.117 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:34.110+0000 7f3ad64d8740 10 client.15861 fetch_fsmap finished waiting for FSMap version 33 2024-08-31T04:27:34.117 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:34.110+0000 7f3ad64d8740 10 client.15861 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T04:27:34.117 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:34.110+0000 7f3ad64d8740 20 client.15861 populate_metadata read hostname 'smithi050' 2024-08-31T04:27:34.117 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:34.110+0000 7f3ad64d8740 1 --2- 172.21.15.50:0/289228906 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x56420470a1c0 0x564204b9fa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:27:34.117 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:34.110+0000 7f3ad64d8740 4 client.15861 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-31T04:27:34.117 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:34.110+0000 7f3ad64d8740 1 -- 172.21.15.50:0/289228906 --> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] -- command(tid 0: {"prefix": "flush journal"}) -- 0x564204a8c960 con 0x56420470a1c0 2024-08-31T04:27:34.118 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:34.110+0000 7f3ac7e00640 1 --2- 172.21.15.50:0/289228906 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x56420470a1c0 0x564204b9fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:27:34.118 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:34.110+0000 7f3aae000640 10 client.15861 ms_handle_connect on v2:172.21.15.133:6838/2526402262 2024-08-31T04:27:34.118 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:34.110+0000 7f3ac7e00640 1 --2- 172.21.15.50:0/289228906 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x56420470a1c0 0x564204b9fa10 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5bc32566628da7da server_cookie=5c2945ca42a6312b in_seq=0 out_seq=0 2024-08-31T04:27:34.239 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:34.236+0000 7f3aae000640 1 -- 172.21.15.50:0/289228906 <== mds.0 v2:172.21.15.133:6838/2526402262 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x564204a8c960 con 0x56420470a1c0 2024-08-31T04:27:34.239 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:34.236+0000 7f3aae000640 10 client.15861 handle_command_reply: tid=0 2024-08-31T04:27:34.239 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:34.236+0000 7f3ad64d8740 1 client.15861 shutdown 2024-08-31T04:27:34.239 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:34.236+0000 7f3ad64d8740 1 -- 172.21.15.50:0/289228906 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56420474d2f0 msgr2=0x564204b2c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:27:34.239 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:34.236+0000 7f3ad64d8740 1 --2- 172.21.15.50:0/289228906 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56420474d2f0 0x564204b2c9d0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f3abc0c8480 tx=0x7f3abc02a420 comp rx=0 tx=0).stop 2024-08-31T04:27:34.239 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:34.236+0000 7f3ad64d8740 1 -- 172.21.15.50:0/289228906 shutdown_connections 2024-08-31T04:27:34.239 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:34.236+0000 7f3ad64d8740 1 --2- 172.21.15.50:0/289228906 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x56420470a1c0 0x564204b9fa10 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:34.239 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:34.236+0000 7f3ad64d8740 1 --2- 172.21.15.50:0/289228906 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5642047761b0 0x564204b2bbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:34.239 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:34.236+0000 7f3ad64d8740 1 --2- 172.21.15.50:0/289228906 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5642047554d0 0x564204b2b690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:34.240 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:34.236+0000 7f3ad64d8740 1 --2- 172.21.15.50:0/289228906 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56420474d2f0 0x564204b2c9d0 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:34.240 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:34.236+0000 7f3ad64d8740 1 -- 172.21.15.50:0/289228906 >> 172.21.15.50:0/289228906 conn(0x56420476a300 msgr2=0x564204b12490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:27:34.240 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:34.236+0000 7f3aae000640 0 client.15861 ms_handle_reset on v2:172.21.15.133:6838/2526402262 2024-08-31T04:27:34.240 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:34.236+0000 7f3ad64d8740 1 -- 172.21.15.50:0/289228906 shutdown_connections 2024-08-31T04:27:34.240 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:34.236+0000 7f3ad64d8740 1 -- 172.21.15.50:0/289228906 wait complete. 2024-08-31T04:27:34.240 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:34.236+0000 7f3ad64d8740 20 client.15861 trim_cache size 0 max 16384 2024-08-31T04:27:34.241 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout:{ 2024-08-31T04:27:34.241 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout: "message": "", 2024-08-31T04:27:34.241 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout: "return_code": 0 2024-08-31T04:27:34.241 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout:} 2024-08-31T04:27:34.242 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:34.236+0000 7f3acde00640 1 -- 172.21.15.50:0/4116396700 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f3ab00b4a40 msgr2=0x7f3ab00b6f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:27:34.242 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:34.236+0000 7f3acde00640 1 --2- 172.21.15.50:0/4116396700 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f3ab00b4a40 0x7f3ab00b6f50 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f3ac0009b30 tx=0x7f3ac00071d0 comp rx=0 tx=0).stop 2024-08-31T04:27:34.242 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:34.236+0000 7f3acde00640 1 -- 172.21.15.50:0/4116396700 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3ac8103280 msgr2=0x7f3ac819bdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:27:34.242 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:34.236+0000 7f3acde00640 1 --2- 172.21.15.50:0/4116396700 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3ac8103280 0x7f3ac819bdb0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f3abc031440 tx=0x7f3abc003c10 comp rx=0 tx=0).stop 2024-08-31T04:27:34.242 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:34.236+0000 7f3acde00640 1 -- 172.21.15.50:0/4116396700 shutdown_connections 2024-08-31T04:27:34.242 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:34.236+0000 7f3acde00640 1 --2- 172.21.15.50:0/4116396700 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f3ab00b4a40 0x7f3ab00b6f50 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:34.242 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:34.236+0000 7f3acde00640 1 --2- 172.21.15.50:0/4116396700 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3ac8104ca0 0x7f3ac819cfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:34.242 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:34.236+0000 7f3acde00640 1 --2- 172.21.15.50:0/4116396700 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3ac8104300 0x7f3ac819c420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:34.242 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:34.236+0000 7f3acde00640 1 --2- 172.21.15.50:0/4116396700 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3ac8103280 0x7f3ac819bdb0 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:34.242 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:34.236+0000 7f3acde00640 1 -- 172.21.15.50:0/4116396700 >> 172.21.15.50:0/4116396700 conn(0x7f3ac80febc0 msgr2=0x7f3ac8075390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:27:34.242 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:34.236+0000 7f3acde00640 1 -- 172.21.15.50:0/4116396700 shutdown_connections 2024-08-31T04:27:34.242 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:34.236+0000 7f3acde00640 1 -- 172.21.15.50:0/4116396700 wait complete. 2024-08-31T04:27:35.264 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:27:35 smithi050 ceph-mon[17259]: pgmap v508: 97 pgs: 97 active+clean; 566 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 1.2 MiB/s wr, 243 op/s 2024-08-31T04:27:35.451 INFO:tasks.workunit.client.0.smithi050.stdout: 164 11110 1 7011 0 2454 0 2024-08-31T04:27:35.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:27:35 smithi177 ceph-mon[22025]: pgmap v508: 97 pgs: 97 active+clean; 566 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 1.2 MiB/s wr, 243 op/s 2024-08-31T04:27:35.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:27:35 smithi133 ceph-mon[22177]: pgmap v508: 97 pgs: 97 active+clean; 566 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 1.2 MiB/s wr, 243 op/s 2024-08-31T04:27:37.266 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:27:37 smithi050 ceph-mon[17259]: pgmap v509: 97 pgs: 97 active+clean; 569 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 1.9 MiB/s wr, 367 op/s 2024-08-31T04:27:37.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:27:37 smithi177 ceph-mon[22025]: pgmap v509: 97 pgs: 97 active+clean; 569 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 1.9 MiB/s wr, 367 op/s 2024-08-31T04:27:37.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:27:37 smithi133 ceph-mon[22177]: pgmap v509: 97 pgs: 97 active+clean; 569 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 1.9 MiB/s wr, 367 op/s 2024-08-31T04:27:39.181 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:27:39 smithi050 ceph-mon[17259]: pgmap v510: 97 pgs: 97 active+clean; 574 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 1.3 MiB/s wr, 306 op/s 2024-08-31T04:27:39.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:27:39 smithi177 ceph-mon[22025]: pgmap v510: 97 pgs: 97 active+clean; 574 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 1.3 MiB/s wr, 306 op/s 2024-08-31T04:27:39.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:27:39 smithi133 ceph-mon[22177]: pgmap v510: 97 pgs: 97 active+clean; 574 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 1.3 MiB/s wr, 306 op/s 2024-08-31T04:27:41.156 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:27:41 smithi050 ceph-mon[17259]: pgmap v511: 97 pgs: 97 active+clean; 578 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 1.6 MiB/s wr, 321 op/s 2024-08-31T04:27:41.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:27:41 smithi177 ceph-mon[22025]: pgmap v511: 97 pgs: 97 active+clean; 578 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 1.6 MiB/s wr, 321 op/s 2024-08-31T04:27:41.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:27:41 smithi133 ceph-mon[22177]: pgmap v511: 97 pgs: 97 active+clean; 578 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 1.6 MiB/s wr, 321 op/s 2024-08-31T04:27:41.760 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:41.758+0000 7f0b93400640 1 -- 172.21.15.50:0/1551714273 <== mds.0 v2:172.21.15.133:6838/2526402262 1 ==== command_reply(tid 0: 0 ) ==== 8+0+590 (crc 0 0 0) 0x558e915b9f20 con 0x558e916d1350 2024-08-31T04:27:41.760 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:41.758+0000 7f0b93400640 10 client.25846 handle_command_reply: tid=0 2024-08-31T04:27:41.760 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:41.758+0000 7f0bbf622740 1 client.25846 shutdown 2024-08-31T04:27:41.760 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:41.758+0000 7f0bbf622740 1 -- 172.21.15.50:0/1551714273 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x558e912a0840 msgr2=0x558e91669b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:27:41.760 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:41.758+0000 7f0bbf622740 1 --2- 172.21.15.50:0/1551714273 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x558e912a0840 0x558e91669b40 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x558e9164a6f0 tx=0x7f0ba0004280 comp rx=0 tx=0).stop 2024-08-31T04:27:41.760 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:41.759+0000 7f0bbf622740 1 -- 172.21.15.50:0/1551714273 shutdown_connections 2024-08-31T04:27:41.760 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:41.759+0000 7f0bbf622740 1 --2- 172.21.15.50:0/1551714273 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x558e916d1350 0x558e916d3770 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:41.761 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:41.759+0000 7f0bbf622740 1 --2- 172.21.15.50:0/1551714273 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x558e912a0840 0x558e91669b40 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:41.761 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:41.759+0000 7f0bbf622740 1 --2- 172.21.15.50:0/1551714273 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x558e9166a080 0x558e9166a490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:41.761 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:41.759+0000 7f0bbf622740 1 --2- 172.21.15.50:0/1551714273 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558e9125f1c0 0x558e9165fa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:41.761 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:41.759+0000 7f0bbf622740 1 -- 172.21.15.50:0/1551714273 >> 172.21.15.50:0/1551714273 conn(0x558e91294990 msgr2=0x558e916472b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:27:41.761 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:41.759+0000 7f0b93400640 0 client.25846 ms_handle_reset on v2:172.21.15.133:6838/2526402262 2024-08-31T04:27:41.761 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:41.759+0000 7f0bbf622740 1 -- 172.21.15.50:0/1551714273 shutdown_connections 2024-08-31T04:27:41.761 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:41.759+0000 7f0bbf622740 1 -- 172.21.15.50:0/1551714273 wait complete. 2024-08-31T04:27:41.761 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:41.760+0000 7f0bbf622740 20 client.25846 trim_cache size 0 max 16384 2024-08-31T04:27:41.762 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-08-31T04:27:41.762 INFO:teuthology.orchestra.run.smithi050.stdout: "epoch": 33, 2024-08-31T04:27:41.762 INFO:teuthology.orchestra.run.smithi050.stdout: "leader": 24695, 2024-08-31T04:27:41.762 INFO:teuthology.orchestra.run.smithi050.stdout: "set_version": 14, 2024-08-31T04:27:41.762 INFO:teuthology.orchestra.run.smithi050.stdout: "sets": { 2024-08-31T04:27:41.762 INFO:teuthology.orchestra.run.smithi050.stdout: "87de6d7": { 2024-08-31T04:27:41.762 INFO:teuthology.orchestra.run.smithi050.stdout: "version": 14, 2024-08-31T04:27:41.763 INFO:teuthology.orchestra.run.smithi050.stdout: "age_ref": 0.0, 2024-08-31T04:27:41.763 INFO:teuthology.orchestra.run.smithi050.stdout: "state": { 2024-08-31T04:27:41.763 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "QUIESCED", 2024-08-31T04:27:41.763 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 0.0 2024-08-31T04:27:41.763 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:27:41.763 INFO:teuthology.orchestra.run.smithi050.stdout: "timeout": 90.0, 2024-08-31T04:27:41.763 INFO:teuthology.orchestra.run.smithi050.stdout: "expiration": 141.8, 2024-08-31T04:27:41.763 INFO:teuthology.orchestra.run.smithi050.stdout: "members": { 2024-08-31T04:27:41.763 INFO:teuthology.orchestra.run.smithi050.stdout: "file:/": { 2024-08-31T04:27:41.763 INFO:teuthology.orchestra.run.smithi050.stdout: "excluded": false, 2024-08-31T04:27:41.763 INFO:teuthology.orchestra.run.smithi050.stdout: "state": { 2024-08-31T04:27:41.763 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "QUIESCED", 2024-08-31T04:27:41.763 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 0.0 2024-08-31T04:27:41.763 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T04:27:41.764 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T04:27:41.764 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T04:27:41.764 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T04:27:41.764 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T04:27:41.764 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-08-31T04:27:41.764 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:41.761+0000 7f0bb7200640 1 -- 172.21.15.50:0/3037284954 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f0b980b4b30 msgr2=0x7f0b980b7040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:27:41.765 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:41.761+0000 7f0bb7200640 1 --2- 172.21.15.50:0/3037284954 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f0b980b4b30 0x7f0b980b7040 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f0bac005bd0 tx=0x7f0bac0059e0 comp rx=0 tx=0).stop 2024-08-31T04:27:41.765 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:41.761+0000 7f0bb7200640 1 -- 172.21.15.50:0/3037284954 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0bb0102380 msgr2=0x7f0bb01a06c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:27:41.765 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:41.761+0000 7f0bb7200640 1 --2- 172.21.15.50:0/3037284954 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0bb0102380 0x7f0bb01a06c0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f0ba402a9f0 tx=0x7f0ba4003c10 comp rx=0 tx=0).stop 2024-08-31T04:27:41.765 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:41.761+0000 7f0bb7200640 1 -- 172.21.15.50:0/3037284954 shutdown_connections 2024-08-31T04:27:41.765 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:41.761+0000 7f0bb7200640 1 --2- 172.21.15.50:0/3037284954 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f0b980b4b30 0x7f0b980b7040 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:41.765 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:41.761+0000 7f0bb7200640 1 --2- 172.21.15.50:0/3037284954 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0bb01077c0 0x7f0bb01a5f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:41.765 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:41.761+0000 7f0bb7200640 1 --2- 172.21.15.50:0/3037284954 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0bb0102cd0 0x7f0bb01a0c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:41.765 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:41.761+0000 7f0bb7200640 1 --2- 172.21.15.50:0/3037284954 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0bb0102380 0x7f0bb01a06c0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:41.765 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:41.761+0000 7f0bb7200640 1 -- 172.21.15.50:0/3037284954 >> 172.21.15.50:0/3037284954 conn(0x7f0bb00fe0d0 msgr2=0x7f0bb01051d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:27:41.765 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:41.761+0000 7f0bb7200640 1 -- 172.21.15.50:0/3037284954 shutdown_connections 2024-08-31T04:27:41.765 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:41.761+0000 7f0bb7200640 1 -- 172.21.15.50:0/3037284954 wait complete. 2024-08-31T04:27:43.417 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:27:43 smithi050 ceph-mon[17259]: pgmap v512: 97 pgs: 97 active+clean; 578 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 1.5 MiB/s wr, 324 op/s 2024-08-31T04:27:43.476 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '87de6d7', quiesce took 28.1 seconds. Will release after: -6.300000000000001 2024-08-31T04:27:43.476 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 058d9fc6-674f-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-31T04:27:43.495 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:27:43 smithi177 ceph-mon[22025]: pgmap v512: 97 pgs: 97 active+clean; 578 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 1.5 MiB/s wr, 324 op/s 2024-08-31T04:27:43.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:27:43 smithi133 ceph-mon[22177]: pgmap v512: 97 pgs: 97 active+clean; 578 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 1.5 MiB/s wr, 324 op/s 2024-08-31T04:27:43.993 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:27:44.835 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:44.833+0000 7f5563a00640 1 -- 172.21.15.50:0/1520375367 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f555c1163e0 msgr2=0x7f555c1188f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:27:44.977 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:44.833+0000 7f5563a00640 1 --2- 172.21.15.50:0/1520375367 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f555c1163e0 0x7f555c1188f0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f5548009900 tx=0x7f554802a410 comp rx=0 tx=0).stop 2024-08-31T04:27:44.977 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:44.833+0000 7f5563a00640 1 -- 172.21.15.50:0/1520375367 shutdown_connections 2024-08-31T04:27:44.978 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:44.833+0000 7f5563a00640 1 --2- 172.21.15.50:0/1520375367 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f555c1163e0 0x7f555c1188f0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:44.978 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:44.833+0000 7f5563a00640 1 --2- 172.21.15.50:0/1520375367 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f555c10ac80 0x7f555c115d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:44.978 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:44.833+0000 7f5563a00640 1 --2- 172.21.15.50:0/1520375367 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f555c10a330 0x7f555c10a740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:44.978 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:44.833+0000 7f5563a00640 1 -- 172.21.15.50:0/1520375367 >> 172.21.15.50:0/1520375367 conn(0x7f555c070c60 msgr2=0x7f555c071070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:27:44.980 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:44.834+0000 7f5563a00640 1 -- 172.21.15.50:0/1520375367 shutdown_connections 2024-08-31T04:27:44.980 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:44.834+0000 7f5563a00640 1 -- 172.21.15.50:0/1520375367 wait complete. 2024-08-31T04:27:44.981 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:44.836+0000 7f5563a00640 1 Processor -- start 2024-08-31T04:27:44.981 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:44.836+0000 7f5563a00640 1 -- start start 2024-08-31T04:27:44.981 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:44.837+0000 7f5563a00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f555c10a330 0x7f555c1a0810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:27:44.981 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:44.837+0000 7f5563a00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f555c10ac80 0x7f555c1a0db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:27:44.981 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:44.837+0000 7f5563a00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f555c1163e0 0x7f555c1a6050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:27:44.981 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:44.837+0000 7f5563a00640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f555c119ec0 con 0x7f555c10a330 2024-08-31T04:27:44.981 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:44.837+0000 7f5563a00640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f555c119d40 con 0x7f555c1163e0 2024-08-31T04:27:44.981 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:44.837+0000 7f5563a00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f555c11a040 con 0x7f555c10ac80 2024-08-31T04:27:44.981 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:44.838+0000 7f5561000640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f555c10a330 0x7f555c1a0810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:27:44.981 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:44.838+0000 7f5561000640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f555c10a330 0x7f555c1a0810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49608/0 (socket says 172.21.15.50:49608) 2024-08-31T04:27:44.981 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:44.838+0000 7f5561000640 1 -- 172.21.15.50:0/2756985830 learned_addr learned my addr 172.21.15.50:0/2756985830 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:27:44.982 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:44.838+0000 7f555be00640 1 --2- 172.21.15.50:0/2756985830 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f555c10ac80 0x7f555c1a0db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:27:44.982 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:44.839+0000 7f5561000640 1 -- 172.21.15.50:0/2756985830 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f555c10ac80 msgr2=0x7f555c1a0db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:27:44.982 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:44.839+0000 7f5561000640 1 --2- 172.21.15.50:0/2756985830 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f555c10ac80 0x7f555c1a0db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:44.982 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:44.839+0000 7f5561000640 1 -- 172.21.15.50:0/2756985830 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f555c1163e0 msgr2=0x7f555c1a6050 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-08-31T04:27:44.983 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:44.839+0000 7f5561000640 1 --2- 172.21.15.50:0/2756985830 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f555c1163e0 0x7f555c1a6050 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:44.983 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:44.839+0000 7f5561000640 1 -- 172.21.15.50:0/2756985830 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f555c1a6780 con 0x7f555c10a330 2024-08-31T04:27:44.983 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:44.841+0000 7f5561000640 1 --2- 172.21.15.50:0/2756985830 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f555c10a330 0x7f555c1a0810 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f554c00ea60 tx=0x7f554c00ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:27:44.983 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:44.842+0000 7f5559600640 1 -- 172.21.15.50:0/2756985830 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f554c00cde0 con 0x7f555c10a330 2024-08-31T04:27:44.983 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:44.842+0000 7f5559600640 1 -- 172.21.15.50:0/2756985830 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f554c0035f0 con 0x7f555c10a330 2024-08-31T04:27:44.983 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:44.842+0000 7f5559600640 1 -- 172.21.15.50:0/2756985830 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f554c010690 con 0x7f555c10a330 2024-08-31T04:27:44.983 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:44.842+0000 7f5563a00640 1 -- 172.21.15.50:0/2756985830 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f555c1a6a70 con 0x7f555c10a330 2024-08-31T04:27:44.983 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:44.842+0000 7f5563a00640 1 -- 172.21.15.50:0/2756985830 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f555c1ad1d0 con 0x7f555c10a330 2024-08-31T04:27:44.983 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:44.845+0000 7f5563a00640 1 -- 172.21.15.50:0/2756985830 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f555c10a740 con 0x7f555c10a330 2024-08-31T04:27:44.983 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:44.849+0000 7f5559600640 1 -- 172.21.15.50:0/2756985830 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 18) ==== 152577+0+0 (secure 0 0 0) 0x7f554c004000 con 0x7f555c10a330 2024-08-31T04:27:44.983 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:44.855+0000 7f5559600640 1 --2- 172.21.15.50:0/2756985830 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f55400b9090 0x7f55400bb5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:27:44.983 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:44.855+0000 7f5559600640 1 -- 172.21.15.50:0/2756985830 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8219+0+0 (secure 0 0 0) 0x7f554c0e5410 con 0x7f555c10a330 2024-08-31T04:27:44.983 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:44.856+0000 7f555be00640 1 --2- 172.21.15.50:0/2756985830 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f55400b9090 0x7f55400bb5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:27:44.984 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:44.857+0000 7f555be00640 1 --2- 172.21.15.50:0/2756985830 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f55400b9090 0x7f55400bb5a0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f5554005c40 tx=0x7f5554005bd0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:27:44.984 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:44.864+0000 7f5559600640 1 -- 172.21.15.50:0/2756985830 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f554c0ac550 con 0x7f555c10a330 2024-08-31T04:27:45.107 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:27:45 smithi050 ceph-mon[17259]: pgmap v513: 97 pgs: 97 active+clean; 578 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 1.5 MiB/s wr, 330 op/s 2024-08-31T04:27:45.220 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:45.216+0000 7f5563a00640 1 -- 172.21.15.50:0/2756985830 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f555c1a1940 con 0x7f555c10a330 2024-08-31T04:27:45.223 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-08-31T04:27:45.224 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":33,"btime":"2024-08-31T04:25:32:194673+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14622,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/1565557530","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":1565557530},{"type":"v1","addr":"172.21.15.50:6835","nonce":1565557530}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14634,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6837/2660185946","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6836","nonce":2660185946},{"type":"v1","addr":"172.21.15.50:6837","nonce":2660185946}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":33,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-31T04:20:44.140709+0000","modified":"2024-08-31T04:25:32.194656+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24695,"mds_1":24691,"mds_2":24667,"mds_3":24656,"mds_4":24652},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14676":{"gid":14676,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.50:6839/2105228685","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6838","nonce":2105228685},{"type":"v1","addr":"172.21.15.50:6839","nonce":2105228685}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24590":{"gid":24590,"name":"k","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.133:6833/4283603962","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6832","nonce":4283603962},{"type":"v1","addr":"172.21.15.133:6833","nonce":4283603962}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24601":{"gid":24601,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.177:6833/1237129793","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":1237129793},{"type":"v1","addr":"172.21.15.177:6833","nonce":1237129793}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24626":{"gid":24626,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.133:6835/3637799701","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":3637799701},{"type":"v1","addr":"172.21.15.133:6835","nonce":3637799701}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24652":{"gid":24652,"name":"c","rank":4,"incarnation":26,"state":"up:active","state_seq":13,"addr":"172.21.15.177:6837/2159859285","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6836","nonce":2159859285},{"type":"v1","addr":"172.21.15.177:6837","nonce":2159859285}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24656":{"gid":24656,"name":"h","rank":3,"incarnation":22,"state":"up:active","state_seq":12,"addr":"172.21.15.133:6837/4014853202","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6836","nonce":4014853202},{"type":"v1","addr":"172.21.15.133:6837","nonce":4014853202}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24667":{"gid":24667,"name":"i","rank":2,"incarnation":20,"state":"up:active","state_seq":10,"addr":"172.21.15.177:6839/3600081752","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6838","nonce":3600081752},{"type":"v1","addr":"172.21.15.177:6839","nonce":3600081752}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24691":{"gid":24691,"name":"a","rank":1,"incarnation":18,"state":"up:active","state_seq":8,"addr":"172.21.15.50:6841/575209862","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6840","nonce":575209862},{"type":"v1","addr":"172.21.15.50:6841","nonce":575209862}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24695":{"gid":24695,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.133:6839/2526402262","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6838","nonce":2526402262},{"type":"v1","addr":"172.21.15.133:6839","nonce":2526402262}]},"join_fscid":-1,"export_targets":[1,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_25699":{"gid":25699,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.177:6835/1048370411","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6834","nonce":1048370411},{"type":"v1","addr":"172.21.15.177:6835","nonce":1048370411}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24695,"qdb_cluster":[24652,24691,24656,24695,24667]},"id":1}]} 2024-08-31T04:27:45.224 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:45.219+0000 7f5559600640 1 -- 172.21.15.50:0/2756985830 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 33 v33) ==== 94+0+11993 (secure 0 0 0) 0x7f554c0abe50 con 0x7f555c10a330 2024-08-31T04:27:45.224 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 33 2024-08-31T04:27:45.229 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:45.225+0000 7f5563a00640 1 -- 172.21.15.50:0/2756985830 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f55400b9090 msgr2=0x7f55400bb5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:27:45.229 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:45.226+0000 7f5563a00640 1 --2- 172.21.15.50:0/2756985830 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f55400b9090 0x7f55400bb5a0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f5554005c40 tx=0x7f5554005bd0 comp rx=0 tx=0).stop 2024-08-31T04:27:45.230 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:45.226+0000 7f5563a00640 1 -- 172.21.15.50:0/2756985830 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f555c10a330 msgr2=0x7f555c1a0810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:27:45.230 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:45.226+0000 7f5563a00640 1 --2- 172.21.15.50:0/2756985830 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f555c10a330 0x7f555c1a0810 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f554c00ea60 tx=0x7f554c00ef20 comp rx=0 tx=0).stop 2024-08-31T04:27:45.230 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:45.226+0000 7f5563a00640 1 -- 172.21.15.50:0/2756985830 shutdown_connections 2024-08-31T04:27:45.230 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:45.226+0000 7f5563a00640 1 --2- 172.21.15.50:0/2756985830 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f55400b9090 0x7f55400bb5a0 secure :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f5554005c40 tx=0x7f5554005bd0 comp rx=0 tx=0).stop 2024-08-31T04:27:45.230 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:45.226+0000 7f5563a00640 1 --2- 172.21.15.50:0/2756985830 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f555c10ac80 0x7f555c1a0db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:45.230 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:45.226+0000 7f5563a00640 1 --2- 172.21.15.50:0/2756985830 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f555c1163e0 0x7f555c1a6050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:45.230 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:45.226+0000 7f5563a00640 1 --2- 172.21.15.50:0/2756985830 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f555c10a330 0x7f555c1a0810 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:45.230 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:45.226+0000 7f5563a00640 1 -- 172.21.15.50:0/2756985830 >> 172.21.15.50:0/2756985830 conn(0x7f555c070c60 msgr2=0x7f555c071bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:27:45.230 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:45.227+0000 7f5563a00640 1 -- 172.21.15.50:0/2756985830 shutdown_connections 2024-08-31T04:27:45.231 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:45.227+0000 7f5563a00640 1 -- 172.21.15.50:0/2756985830 wait complete. 2024-08-31T04:27:45.451 INFO:tasks.workunit.client.0.smithi050.stdout: 164 58935 0 40921 0 12934 0 2024-08-31T04:27:45.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:27:45 smithi177 ceph-mon[22025]: pgmap v513: 97 pgs: 97 active+clean; 578 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 1.5 MiB/s wr, 330 op/s 2024-08-31T04:27:45.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:27:45 smithi133 ceph-mon[22177]: pgmap v513: 97 pgs: 97 active+clean; 578 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 1.5 MiB/s wr, 330 op/s 2024-08-31T04:27:46.379 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:27:46 smithi050 ceph-mon[17259]: from='client.? 172.21.15.50:0/2756985830' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T04:27:46.387 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24695 quiesce db --set-id 87de6d7 --release --await' 2024-08-31T04:27:46.387 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 058d9fc6-674f-11ef-bcd4-c7b262605968 -- timeout 105 ceph tell mds.24695 quiesce db --set-id 87de6d7 --release --await 2024-08-31T04:27:46.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:27:46 smithi177 ceph-mon[22025]: from='client.? 172.21.15.50:0/2756985830' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T04:27:46.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:27:46 smithi133 ceph-mon[22177]: from='client.? 172.21.15.50:0/2756985830' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T04:27:46.810 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:27:47.300 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:27:47 smithi050 ceph-mon[17259]: pgmap v514: 97 pgs: 97 active+clean; 580 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 MiB/s rd, 1.7 MiB/s wr, 475 op/s 2024-08-31T04:27:47.485 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:47.482+0000 7fc0d1200640 1 -- 172.21.15.50:0/3271900731 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc0cc075a90 msgr2=0x7fc0cc075ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:27:47.485 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:47.482+0000 7fc0d1200640 1 --2- 172.21.15.50:0/3271900731 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc0cc075a90 0x7fc0cc075ea0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fc0b8009900 tx=0x7fc0b802a3f0 comp rx=0 tx=0).stop 2024-08-31T04:27:47.485 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:47.482+0000 7fc0d1200640 1 -- 172.21.15.50:0/3271900731 shutdown_connections 2024-08-31T04:27:47.486 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:47.482+0000 7fc0d1200640 1 --2- 172.21.15.50:0/3271900731 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc0cc10fbc0 0x7fc0cc111fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:47.486 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:47.482+0000 7fc0d1200640 1 --2- 172.21.15.50:0/3271900731 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc0cc075a90 0x7fc0cc075ea0 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:47.486 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:47.482+0000 7fc0d1200640 1 --2- 172.21.15.50:0/3271900731 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc0cc076e90 0x7fc0cc075550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:47.486 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:47.482+0000 7fc0d1200640 1 -- 172.21.15.50:0/3271900731 >> 172.21.15.50:0/3271900731 conn(0x7fc0cc0fed80 msgr2=0x7fc0cc101230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:27:47.486 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:47.483+0000 7fc0d1200640 1 -- 172.21.15.50:0/3271900731 shutdown_connections 2024-08-31T04:27:47.486 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:47.483+0000 7fc0d1200640 1 -- 172.21.15.50:0/3271900731 wait complete. 2024-08-31T04:27:47.487 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:47.484+0000 7fc0d1200640 1 Processor -- start 2024-08-31T04:27:47.487 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:47.484+0000 7fc0d1200640 1 -- start start 2024-08-31T04:27:47.487 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:47.484+0000 7fc0d1200640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc0cc075a90 0x7fc0cc1a0360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:27:47.487 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:47.484+0000 7fc0d1200640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc0cc076e90 0x7fc0cc1a09d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:27:47.487 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:47.484+0000 7fc0d1200640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc0cc10fbc0 0x7fc0cc1a1510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:27:47.487 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:47.484+0000 7fc0d1200640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fc0cc1156e0 con 0x7fc0cc10fbc0 2024-08-31T04:27:47.487 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:47.484+0000 7fc0d1200640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7fc0cc115560 con 0x7fc0cc076e90 2024-08-31T04:27:47.487 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:47.484+0000 7fc0d1200640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fc0cc115860 con 0x7fc0cc075a90 2024-08-31T04:27:47.488 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:47.485+0000 7fc0ca800640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc0cc10fbc0 0x7fc0cc1a1510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:27:47.488 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:47.485+0000 7fc0c9e00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc0cc075a90 0x7fc0cc1a0360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:27:47.488 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:47.485+0000 7fc0c9e00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc0cc075a90 0x7fc0cc1a0360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.50:57836/0 (socket says 172.21.15.50:57836) 2024-08-31T04:27:47.488 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:47.485+0000 7fc0c9400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc0cc076e90 0x7fc0cc1a09d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:27:47.488 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:47.485+0000 7fc0c9e00640 1 -- 172.21.15.50:0/3706043960 learned_addr learned my addr 172.21.15.50:0/3706043960 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:27:47.489 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:47.485+0000 7fc0c9e00640 1 -- 172.21.15.50:0/3706043960 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc0cc076e90 msgr2=0x7fc0cc1a09d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:27:47.489 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:47.485+0000 7fc0c9e00640 1 --2- 172.21.15.50:0/3706043960 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc0cc076e90 0x7fc0cc1a09d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:47.489 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:47.485+0000 7fc0c9e00640 1 -- 172.21.15.50:0/3706043960 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc0cc10fbc0 msgr2=0x7fc0cc1a1510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:27:47.489 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:47.485+0000 7fc0c9e00640 1 --2- 172.21.15.50:0/3706043960 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc0cc10fbc0 0x7fc0cc1a1510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:47.489 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:47.485+0000 7fc0c9e00640 1 -- 172.21.15.50:0/3706043960 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0cc1a1d30 con 0x7fc0cc075a90 2024-08-31T04:27:47.489 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:47.486+0000 7fc0c9e00640 1 --2- 172.21.15.50:0/3706043960 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc0cc075a90 0x7fc0cc1a0360 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fc0bc00e9f0 tx=0x7fc0bc00edf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:27:47.489 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:47.486+0000 7fc0c2a00640 1 -- 172.21.15.50:0/3706043960 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0bc00cd80 con 0x7fc0cc075a90 2024-08-31T04:27:47.489 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:47.486+0000 7fc0c2a00640 1 -- 172.21.15.50:0/3706043960 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc0bc0054d0 con 0x7fc0cc075a90 2024-08-31T04:27:47.489 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:47.486+0000 7fc0c2a00640 1 -- 172.21.15.50:0/3706043960 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0bc010690 con 0x7fc0cc075a90 2024-08-31T04:27:47.489 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:47.486+0000 7fc0d1200640 1 -- 172.21.15.50:0/3706043960 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc0cc1a2020 con 0x7fc0cc075a90 2024-08-31T04:27:47.490 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:47.486+0000 7fc0d1200640 1 -- 172.21.15.50:0/3706043960 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc0cc1a8710 con 0x7fc0cc075a90 2024-08-31T04:27:47.494 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:47.490+0000 7fc0d82af740 1 Processor -- start 2024-08-31T04:27:47.494 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:47.490+0000 7fc0d82af740 1 -- start start 2024-08-31T04:27:47.494 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:47.491+0000 7fc0d82af740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x558d943411b0 0x558d946e6b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:27:47.494 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:47.491+0000 7fc0d82af740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x558d943182f0 0x558d946e71a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:27:47.494 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:47.491+0000 7fc0d82af740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558d943204d0 0x558d946e7cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:27:47.494 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:47.491+0000 7fc0d82af740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x558d94659f70 con 0x558d943204d0 2024-08-31T04:27:47.494 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:47.491+0000 7fc0d82af740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x558d94649500 con 0x558d943411b0 2024-08-31T04:27:47.494 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:47.491+0000 7fc0d82af740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x558d9464d4b0 con 0x558d943182f0 2024-08-31T04:27:47.494 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:47.491+0000 7fc0c9400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558d943204d0 0x558d946e7cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:27:47.494 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:47.491+0000 7fc0ca800640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x558d943411b0 0x558d946e6b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:27:47.494 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:47.491+0000 7fc0ca800640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x558d943411b0 0x558d946e6b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.50:34820/0 (socket says 172.21.15.50:34820) 2024-08-31T04:27:47.495 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:47.491+0000 7fc0c9400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558d943204d0 0x558d946e7cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49628/0 (socket says 172.21.15.50:49628) 2024-08-31T04:27:47.495 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:47.491+0000 7fc0ca800640 1 -- 172.21.15.50:0/451308926 learned_addr learned my addr 172.21.15.50:0/451308926 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:27:47.496 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:47.491+0000 7fc0c2a00640 1 -- 172.21.15.50:0/3706043960 <== mon.1 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 18) ==== 152577+0+0 (secure 0 0 0) 0x7fc0bc010830 con 0x7fc0cc075a90 2024-08-31T04:27:47.496 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:47.492+0000 7fc0ca800640 1 -- 172.21.15.50:0/451308926 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x558d943182f0 msgr2=0x558d946e71a0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-08-31T04:27:47.496 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:47.492+0000 7fc0ca800640 1 --2- 172.21.15.50:0/451308926 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x558d943182f0 0x558d946e71a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:47.496 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:47.492+0000 7fc0ca800640 1 -- 172.21.15.50:0/451308926 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558d943204d0 msgr2=0x558d946e7cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:27:47.496 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:47.492+0000 7fc0ca800640 1 --2- 172.21.15.50:0/451308926 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558d943204d0 0x558d946e7cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:47.496 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:47.492+0000 7fc0ca800640 1 -- 172.21.15.50:0/451308926 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558d94603c10 con 0x558d943411b0 2024-08-31T04:27:47.496 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:47.492+0000 7fc0ca800640 1 --2- 172.21.15.50:0/451308926 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x558d943411b0 0x558d946e6b30 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fc0c4009fd0 tx=0x7fc0c40118d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f7bd08c158235cb0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:27:47.496 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:47.493+0000 7fc0b7400640 1 -- 172.21.15.50:0/451308926 <== mon.2 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0c4004d20 con 0x558d943411b0 2024-08-31T04:27:47.496 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:47.493+0000 7fc0b7400640 1 -- 172.21.15.50:0/451308926 <== mon.2 v2:172.21.15.133:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc0c4004050 con 0x558d943411b0 2024-08-31T04:27:47.496 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:47.493+0000 7fc0b7400640 1 -- 172.21.15.50:0/451308926 <== mon.2 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0c4005260 con 0x558d943411b0 2024-08-31T04:27:47.497 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:47.493+0000 7fc0c2a00640 1 --2- 172.21.15.50:0/3706043960 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fc0b00b4bb0 0x7fc0b00b70c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:27:47.497 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:47.493+0000 7fc0c2a00640 1 -- 172.21.15.50:0/3706043960 <== mon.1 v2:172.21.15.177:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8219+0+0 (secure 0 0 0) 0x7fc0bc0e54e0 con 0x7fc0cc075a90 2024-08-31T04:27:47.497 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:47.493+0000 7fc0c9e00640 1 --2- 172.21.15.50:0/3706043960 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fc0b00b4bb0 0x7fc0b00b70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:27:47.497 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:27:47 smithi177 ceph-mon[22025]: pgmap v514: 97 pgs: 97 active+clean; 580 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 MiB/s rd, 1.7 MiB/s wr, 475 op/s 2024-08-31T04:27:47.500 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:47.494+0000 7fc0d82af740 1 -- 172.21.15.50:0/451308926 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x558d943411b0 msgr2=0x558d946e6b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:27:47.500 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:47.494+0000 7fc0d82af740 1 --2- 172.21.15.50:0/451308926 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x558d943411b0 0x558d946e6b30 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fc0c4009fd0 tx=0x7fc0c40118d0 comp rx=0 tx=0).stop 2024-08-31T04:27:47.500 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:47.494+0000 7fc0c9e00640 1 --2- 172.21.15.50:0/3706043960 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fc0b00b4bb0 0x7fc0b00b70c0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fc0bc0abc20 tx=0x7fc0bc005680 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:27:47.500 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:47.494+0000 7fc0d82af740 1 -- 172.21.15.50:0/451308926 shutdown_connections 2024-08-31T04:27:47.501 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:47.494+0000 7fc0d82af740 1 --2- 172.21.15.50:0/451308926 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x558d943182f0 0x558d946e71a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:47.501 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:47.494+0000 7fc0d82af740 1 --2- 172.21.15.50:0/451308926 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558d943204d0 0x558d946e7cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:47.501 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:47.494+0000 7fc0d82af740 1 --2- 172.21.15.50:0/451308926 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x558d943411b0 0x558d946e6b30 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:47.501 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:47.494+0000 7fc0d82af740 1 -- 172.21.15.50:0/451308926 >> 172.21.15.50:0/451308926 conn(0x558d94335300 msgr2=0x558d946e25c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:27:47.501 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:47.494+0000 7fc0d82af740 1 -- 172.21.15.50:0/451308926 shutdown_connections 2024-08-31T04:27:47.501 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:47.494+0000 7fc0d82af740 1 -- 172.21.15.50:0/451308926 wait complete. 2024-08-31T04:27:47.501 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:47.495+0000 7fc0d82af740 1 -- start start 2024-08-31T04:27:47.501 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:47.495+0000 7fc0d82af740 1 Processor -- start 2024-08-31T04:27:47.501 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:47.495+0000 7fc0d82af740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x558d943182f0 0x558d946f0190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:27:47.501 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:47.496+0000 7fc0d82af740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558d943204d0 0x558d946f0850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:27:47.501 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:47.496+0000 7fc0d82af740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x558d943411b0 0x558d946f13c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:27:47.501 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:47.496+0000 7fc0d82af740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x558d94582ab0 con 0x558d943204d0 2024-08-31T04:27:47.501 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:47.496+0000 7fc0d82af740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x558d945f0320 con 0x558d943411b0 2024-08-31T04:27:47.502 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:47.496+0000 7fc0d82af740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x558d946e8810 con 0x558d943182f0 2024-08-31T04:27:47.502 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:47.496+0000 7fc0d82af740 10 client.0 _ll_register_callbacks cb 0x558d94629e80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:27:47.502 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:47.496+0000 7fc0c9400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558d943204d0 0x558d946f0850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:27:47.502 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:47.496+0000 7fc0ca800640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x558d943411b0 0x558d946f13c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:27:47.502 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:47.496+0000 7fc0c9400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558d943204d0 0x558d946f0850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49634/0 (socket says 172.21.15.50:49634) 2024-08-31T04:27:47.502 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:47.496+0000 7fc0c9400640 1 -- 172.21.15.50:0/3568468861 learned_addr learned my addr 172.21.15.50:0/3568468861 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:27:47.502 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:47.496+0000 7fc0ca800640 1 --2- 172.21.15.50:0/3568468861 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x558d943182f0 0x558d946f0190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:27:47.502 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:47.496+0000 7fc0c9400640 1 -- 172.21.15.50:0/3568468861 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x558d943182f0 msgr2=0x558d946f0190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:27:47.502 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:47.496+0000 7fc0c9400640 1 --2- 172.21.15.50:0/3568468861 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x558d943182f0 0x558d946f0190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:47.502 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:47.496+0000 7fc0c9400640 1 -- 172.21.15.50:0/3568468861 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x558d943411b0 msgr2=0x558d946f13c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:27:47.502 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:47.496+0000 7fc0c9400640 1 --2- 172.21.15.50:0/3568468861 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x558d943411b0 0x558d946f13c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:47.502 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:47.496+0000 7fc0c9400640 1 -- 172.21.15.50:0/3568468861 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558d943ac790 con 0x558d943204d0 2024-08-31T04:27:47.502 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:47.496+0000 7fc0ca800640 1 --2- 172.21.15.50:0/3568468861 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x558d943182f0 0x558d946f0190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:27:47.503 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:47.497+0000 7fc0c9400640 1 --2- 172.21.15.50:0/3568468861 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558d943204d0 0x558d946f0850 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fc0b8009230 tx=0x7fc0b8004440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d357cf8306a5d7b server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:27:47.503 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:47.497+0000 7fc0abe00640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-08-31T04:27:47.503 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:47.497+0000 7fc0abe00640 1 -- 172.21.15.50:0/3568468861 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0b8035040 con 0x558d943204d0 2024-08-31T04:27:47.503 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:47.497+0000 7fc0d82af740 1 -- 172.21.15.50:0/3568468861 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc0c4004050 con 0x558d943204d0 2024-08-31T04:27:47.503 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:47.497+0000 7fc0abe00640 1 -- 172.21.15.50:0/3568468861 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8219+0+0 (secure 0 0 0) 0x7fc0b8003ac0 con 0x558d943204d0 2024-08-31T04:27:47.503 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:47.497+0000 7fc0abe00640 1 -- 172.21.15.50:0/3568468861 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7fc0b8003cc0 con 0x558d943204d0 2024-08-31T04:27:47.503 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:47.497+0000 7fc0d82af740 10 client.15879 fetch_fsmap learned FSMap version 33 2024-08-31T04:27:47.503 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:47.497+0000 7fc0d82af740 1 -- 172.21.15.50:0/3568468861 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x558d94425620 con 0x558d943204d0 2024-08-31T04:27:47.503 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:47.498+0000 7fc0abe00640 1 -- 172.21.15.50:0/3568468861 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc0c4004050 con 0x558d943204d0 2024-08-31T04:27:47.503 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:47.498+0000 7fc0abe00640 1 -- 172.21.15.50:0/3568468861 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 33) ==== 8378+0+0 (secure 0 0 0) 0x7fc0b803c600 con 0x558d943204d0 2024-08-31T04:27:47.504 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:47.498+0000 7fc0d82af740 10 client.15879 fetch_fsmap finished waiting for FSMap version 33 2024-08-31T04:27:47.504 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:47.498+0000 7fc0d82af740 10 client.15879 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T04:27:47.504 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:47.498+0000 7fc0d82af740 20 client.15879 populate_metadata read hostname 'smithi050' 2024-08-31T04:27:47.504 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:47.498+0000 7fc0d82af740 1 --2- 172.21.15.50:0/3568468861 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x558d942ffd80 0x558d946fda30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:27:47.504 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:47.498+0000 7fc0d82af740 4 client.15879 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T04:27:47.504 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:47.498+0000 7fc0d82af740 1 -- 172.21.15.50:0/3568468861 --> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558d9465bec0 con 0x558d942ffd80 2024-08-31T04:27:47.505 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:47.499+0000 7fc0ca800640 1 --2- 172.21.15.50:0/3568468861 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x558d942ffd80 0x558d946fda30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:27:47.505 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:47.499+0000 7fc0ca800640 1 --2- 172.21.15.50:0/3568468861 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x558d942ffd80 0x558d946fda30 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1ee47a7f58bb08b2 server_cookie=34b444267afc1ffd in_seq=0 out_seq=0 2024-08-31T04:27:47.506 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:47.499+0000 7fc0abe00640 10 client.15879 ms_handle_connect on v2:172.21.15.133:6838/2526402262 2024-08-31T04:27:47.506 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:47.500+0000 7fc0abe00640 1 -- 172.21.15.50:0/3568468861 <== mds.0 v2:172.21.15.133:6838/2526402262 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x558d9465bec0 con 0x558d942ffd80 2024-08-31T04:27:47.506 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:47.500+0000 7fc0abe00640 10 client.15879 handle_command_reply: tid=0 2024-08-31T04:27:47.506 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:47.500+0000 7fc0d82af740 1 client.15879 shutdown 2024-08-31T04:27:47.506 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:47.500+0000 7fc0d82af740 1 -- 172.21.15.50:0/3568468861 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558d943204d0 msgr2=0x558d946f0850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:27:47.506 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:47.500+0000 7fc0d82af740 1 --2- 172.21.15.50:0/3568468861 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558d943204d0 0x558d946f0850 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fc0b8009230 tx=0x7fc0b8004440 comp rx=0 tx=0).stop 2024-08-31T04:27:47.506 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:47.500+0000 7fc0d82af740 1 -- 172.21.15.50:0/3568468861 shutdown_connections 2024-08-31T04:27:47.506 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:47.500+0000 7fc0d82af740 1 --2- 172.21.15.50:0/3568468861 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x558d942ffd80 0x558d946fda30 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:47.506 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:47.500+0000 7fc0d82af740 1 --2- 172.21.15.50:0/3568468861 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x558d943411b0 0x558d946f13c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:47.506 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:47.500+0000 7fc0d82af740 1 --2- 172.21.15.50:0/3568468861 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558d943204d0 0x558d946f0850 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:47.506 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:47.500+0000 7fc0d82af740 1 --2- 172.21.15.50:0/3568468861 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x558d943182f0 0x558d946f0190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:47.506 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:47.500+0000 7fc0abe00640 0 client.15879 ms_handle_reset on v2:172.21.15.133:6838/2526402262 2024-08-31T04:27:47.507 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:47.500+0000 7fc0d82af740 1 -- 172.21.15.50:0/3568468861 >> 172.21.15.50:0/3568468861 conn(0x558d94335300 msgr2=0x558d946e0b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:27:47.507 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:47.501+0000 7fc0d82af740 1 -- 172.21.15.50:0/3568468861 shutdown_connections 2024-08-31T04:27:47.507 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:47.501+0000 7fc0d82af740 1 -- 172.21.15.50:0/3568468861 wait complete. 2024-08-31T04:27:47.507 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:47.501+0000 7fc0d82af740 20 client.15879 trim_cache size 0 max 16384 2024-08-31T04:27:47.519 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:47.517+0000 7fc0d82af740 1 Processor -- start 2024-08-31T04:27:47.519 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:47.517+0000 7fc0d82af740 1 -- start start 2024-08-31T04:27:47.519 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:47.517+0000 7fc0d82af740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x558d943182f0 0x558d946ef390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:27:47.519 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:47.517+0000 7fc0d82af740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x558d943204d0 0x558d946f82a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:27:47.519 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:47.517+0000 7fc0d82af740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558d943411b0 0x558d946ef8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:27:47.519 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:47.517+0000 7fc0d82af740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fc0cc1b12e0 con 0x558d943411b0 2024-08-31T04:27:47.519 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:47.517+0000 7fc0d82af740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7fc0cc1b2ee0 con 0x558d943182f0 2024-08-31T04:27:47.520 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:47.517+0000 7fc0d82af740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fc0cc1b19b0 con 0x558d943204d0 2024-08-31T04:27:47.521 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:47.517+0000 7fc0ca800640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558d943411b0 0x558d946ef8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:27:47.521 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:47.517+0000 7fc0c9400640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x558d943204d0 0x558d946f82a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:27:47.521 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:47.517+0000 7fc0ca800640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558d943411b0 0x558d946ef8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49636/0 (socket says 172.21.15.50:49636) 2024-08-31T04:27:47.521 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:47.517+0000 7fc0ca800640 1 -- 172.21.15.50:0/2415421772 learned_addr learned my addr 172.21.15.50:0/2415421772 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:27:47.521 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:47.518+0000 7fc0ca800640 1 --2- 172.21.15.50:0/2415421772 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x558d943182f0 0x558d946ef390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:27:47.521 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:47.518+0000 7fc0c9400640 1 -- 172.21.15.50:0/2415421772 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x558d943182f0 msgr2=0x558d946ef390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:27:47.521 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:47.518+0000 7fc0c9400640 1 --2- 172.21.15.50:0/2415421772 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x558d943182f0 0x558d946ef390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:47.521 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:47.518+0000 7fc0c9400640 1 -- 172.21.15.50:0/2415421772 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558d943411b0 msgr2=0x558d946ef8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:27:47.521 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:47.518+0000 7fc0c9400640 1 --2- 172.21.15.50:0/2415421772 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558d943411b0 0x558d946ef8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:47.521 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:47.518+0000 7fc0c9400640 1 -- 172.21.15.50:0/2415421772 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558d946eed90 con 0x558d943204d0 2024-08-31T04:27:47.521 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:47.518+0000 7fc0c9400640 1 --2- 172.21.15.50:0/2415421772 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x558d943204d0 0x558d946f82a0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fc0b803c9d0 tx=0x7fc0b8005d50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f4fa5d18ee0681a6 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:27:47.522 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:47.518+0000 7fc0b6a00640 1 -- 172.21.15.50:0/2415421772 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0b8035070 con 0x558d943204d0 2024-08-31T04:27:47.522 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:47.519+0000 7fc0b6a00640 1 -- 172.21.15.50:0/2415421772 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc0b80038c0 con 0x558d943204d0 2024-08-31T04:27:47.522 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:47.519+0000 7fc0b6a00640 1 -- 172.21.15.50:0/2415421772 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0b8000e60 con 0x558d943204d0 2024-08-31T04:27:47.523 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:47.519+0000 7fc0d82af740 1 -- 172.21.15.50:0/2415421772 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x558d943204d0 msgr2=0x558d946f82a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:27:47.523 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:47.519+0000 7fc0d82af740 1 --2- 172.21.15.50:0/2415421772 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x558d943204d0 0x558d946f82a0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fc0b803c9d0 tx=0x7fc0b8005d50 comp rx=0 tx=0).stop 2024-08-31T04:27:47.523 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:47.520+0000 7fc0d82af740 1 -- 172.21.15.50:0/2415421772 shutdown_connections 2024-08-31T04:27:47.523 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:47.520+0000 7fc0d82af740 1 --2- 172.21.15.50:0/2415421772 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x558d943204d0 0x558d946f82a0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:47.523 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:47.520+0000 7fc0d82af740 1 --2- 172.21.15.50:0/2415421772 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558d943411b0 0x558d946ef8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:47.523 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:47.520+0000 7fc0d82af740 1 --2- 172.21.15.50:0/2415421772 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x558d943182f0 0x558d946ef390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:47.523 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:47.520+0000 7fc0d82af740 1 -- 172.21.15.50:0/2415421772 >> 172.21.15.50:0/2415421772 conn(0x558d94335300 msgr2=0x558d946e79c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:27:47.523 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:47.520+0000 7fc0d82af740 1 -- 172.21.15.50:0/2415421772 shutdown_connections 2024-08-31T04:27:47.523 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:47.520+0000 7fc0d82af740 1 -- 172.21.15.50:0/2415421772 wait complete. 2024-08-31T04:27:47.523 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:47.520+0000 7fc0d82af740 1 -- start start 2024-08-31T04:27:47.523 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:47.521+0000 7fc0d82af740 1 Processor -- start 2024-08-31T04:27:47.525 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:47.521+0000 7fc0d82af740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x558d943182f0 0x558d946f6fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:27:47.525 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:47.521+0000 7fc0d82af740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x558d943204d0 0x558d946f7500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:27:47.525 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:47.521+0000 7fc0d82af740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558d943411b0 0x558d946f7a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:27:47.525 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:47.521+0000 7fc0d82af740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fc0cc1b2810 con 0x558d943411b0 2024-08-31T04:27:47.525 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:47.521+0000 7fc0d82af740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7fc0cc1b2080 con 0x558d943204d0 2024-08-31T04:27:47.525 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:47.521+0000 7fc0d82af740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fc0cc1af2c0 con 0x558d943182f0 2024-08-31T04:27:47.525 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:47.521+0000 7fc0d82af740 10 client.0 _ll_register_callbacks cb 0x7fc0b8009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:27:47.525 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:47.522+0000 7fc0ca800640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x558d943182f0 0x558d946f6fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:27:47.525 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:47.522+0000 7fc0ca800640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x558d943182f0 0x558d946f6fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.50:57874/0 (socket says 172.21.15.50:57874) 2024-08-31T04:27:47.525 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:47.522+0000 7fc0ca800640 1 -- 172.21.15.50:0/2055785128 learned_addr learned my addr 172.21.15.50:0/2055785128 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:27:47.525 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:47.522+0000 7fc0ca800640 1 --2- 172.21.15.50:0/2055785128 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558d943411b0 0x558d946f7a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:27:47.525 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:47.522+0000 7fc0c9400640 1 --2- 172.21.15.50:0/2055785128 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x558d943204d0 0x558d946f7500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:27:47.525 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:47.522+0000 7fc0ca800640 1 -- 172.21.15.50:0/2055785128 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x558d943204d0 msgr2=0x558d946f7500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:27:47.526 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:47.522+0000 7fc0ca800640 1 --2- 172.21.15.50:0/2055785128 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x558d943204d0 0x558d946f7500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:47.526 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:47.522+0000 7fc0ca800640 1 -- 172.21.15.50:0/2055785128 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558d943411b0 msgr2=0x558d946f7a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:27:47.526 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:47.522+0000 7fc0ca800640 1 --2- 172.21.15.50:0/2055785128 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558d943411b0 0x558d946f7a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:47.526 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:47.522+0000 7fc0ca800640 1 -- 172.21.15.50:0/2055785128 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558d946f5c00 con 0x558d943182f0 2024-08-31T04:27:47.527 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:47.523+0000 7fc0c9400640 1 --2- 172.21.15.50:0/2055785128 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x558d943204d0 0x558d946f7500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T04:27:47.527 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:47.523+0000 7fc0ca800640 1 --2- 172.21.15.50:0/2055785128 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x558d943182f0 0x558d946f6fc0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fc0c401a000 tx=0x7fc0c402df90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=749e778cccfd75a0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:27:47.527 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:47.523+0000 7fc0abe00640 10 client.0 ms_handle_connect on v2:172.21.15.177:3300/0 2024-08-31T04:27:47.527 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:47.523+0000 7fc0abe00640 1 -- 172.21.15.50:0/2055785128 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0c4004430 con 0x558d943182f0 2024-08-31T04:27:47.527 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:47.523+0000 7fc0abe00640 1 -- 172.21.15.50:0/2055785128 <== mon.1 v2:172.21.15.177:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8219+0+0 (secure 0 0 0) 0x7fc0c401f040 con 0x558d943182f0 2024-08-31T04:27:47.527 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:47.523+0000 7fc0d82af740 1 -- 172.21.15.50:0/2055785128 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc0b80038c0 con 0x558d943182f0 2024-08-31T04:27:47.527 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:47.524+0000 7fc0abe00640 1 -- 172.21.15.50:0/2055785128 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7fc0c40045d0 con 0x558d943182f0 2024-08-31T04:27:47.527 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:47.524+0000 7fc0d82af740 10 client.25867 fetch_fsmap learned FSMap version 33 2024-08-31T04:27:47.527 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:47.524+0000 7fc0d82af740 1 -- 172.21.15.50:0/2055785128 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x558d94768790 con 0x558d943182f0 2024-08-31T04:27:47.528 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:47.525+0000 7fc0abe00640 1 -- 172.21.15.50:0/2055785128 <== mon.1 v2:172.21.15.177:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc0b80038c0 con 0x558d943182f0 2024-08-31T04:27:47.528 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:47.525+0000 7fc0abe00640 1 -- 172.21.15.50:0/2055785128 <== mon.1 v2:172.21.15.177:3300/0 5 ==== fsmap(e 33) ==== 8378+0+0 (secure 0 0 0) 0x7fc0c4039070 con 0x558d943182f0 2024-08-31T04:27:47.528 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:47.525+0000 7fc0d82af740 10 client.25867 fetch_fsmap finished waiting for FSMap version 33 2024-08-31T04:27:47.528 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:47.525+0000 7fc0d82af740 10 client.25867 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T04:27:47.528 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:47.525+0000 7fc0d82af740 20 client.25867 populate_metadata read hostname 'smithi050' 2024-08-31T04:27:47.529 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:47.525+0000 7fc0d82af740 1 --2- 172.21.15.50:0/2055785128 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x558d942d51c0 0x558d9476b060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:27:47.529 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:47.525+0000 7fc0d82af740 4 client.25867 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-31T04:27:47.529 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:47.525+0000 7fc0d82af740 1 -- 172.21.15.50:0/2055785128 --> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] -- command(tid 0: {"prefix": "flush journal"}) -- 0x558d94657960 con 0x558d942d51c0 2024-08-31T04:27:47.529 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:47.526+0000 7fc0c9400640 1 --2- 172.21.15.50:0/2055785128 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x558d942d51c0 0x558d9476b060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:27:47.529 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:47.526+0000 7fc0c9400640 1 --2- 172.21.15.50:0/2055785128 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x558d942d51c0 0x558d9476b060 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8f0ebf7fe6443949 server_cookie=faa7a376bd1ef8a5 in_seq=0 out_seq=0 2024-08-31T04:27:47.529 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:47.526+0000 7fc0abe00640 10 client.25867 ms_handle_connect on v2:172.21.15.133:6838/2526402262 2024-08-31T04:27:47.536 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:47.533+0000 7f4349e00640 1 -- 172.21.15.50:0/782482839 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4344102ca0 msgr2=0x7f43441071d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:27:47.536 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:47.533+0000 7f4349e00640 1 --2- 172.21.15.50:0/782482839 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4344102ca0 0x7f43441071d0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f4330009930 tx=0x7f433002a440 comp rx=0 tx=0).stop 2024-08-31T04:27:47.536 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:47.533+0000 7f4349e00640 1 -- 172.21.15.50:0/782482839 shutdown_connections 2024-08-31T04:27:47.536 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:47.533+0000 7f4349e00640 1 --2- 172.21.15.50:0/782482839 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4344107790 0x7f4344107c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:47.536 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:47.533+0000 7f4349e00640 1 --2- 172.21.15.50:0/782482839 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4344102ca0 0x7f43441071d0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:47.536 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:47.533+0000 7f4349e00640 1 --2- 172.21.15.50:0/782482839 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4344102350 0x7f4344102760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:47.536 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:47.533+0000 7f4349e00640 1 -- 172.21.15.50:0/782482839 >> 172.21.15.50:0/782482839 conn(0x7f43440fe060 msgr2=0x7f43441004b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:27:47.537 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:47.534+0000 7f4349e00640 1 -- 172.21.15.50:0/782482839 shutdown_connections 2024-08-31T04:27:47.538 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:47.534+0000 7f4349e00640 1 -- 172.21.15.50:0/782482839 wait complete. 2024-08-31T04:27:47.538 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:47.535+0000 7f4349e00640 1 Processor -- start 2024-08-31T04:27:47.538 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:47.536+0000 7f4349e00640 1 -- start start 2024-08-31T04:27:47.539 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:47.536+0000 7f4349e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4344102350 0x7f4344074c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:27:47.539 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:47.536+0000 7f4349e00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4344102ca0 0x7f434406df40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:27:47.539 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:47.536+0000 7f4349e00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4344107790 0x7f434406e530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:27:47.539 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:47.536+0000 7f4349e00640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f4344119c50 con 0x7f4344102350 2024-08-31T04:27:47.539 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:47.536+0000 7f4349e00640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f4344119ad0 con 0x7f4344102ca0 2024-08-31T04:27:47.539 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:47.536+0000 7f4349e00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f4344119dd0 con 0x7f4344107790 2024-08-31T04:27:47.540 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:47.537+0000 7f4343e00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4344102ca0 0x7f434406df40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:27:47.540 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:47.537+0000 7f4343e00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4344102ca0 0x7f434406df40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.50:34874/0 (socket says 172.21.15.50:34874) 2024-08-31T04:27:47.540 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:47.537+0000 7f4343e00640 1 -- 172.21.15.50:0/254747600 learned_addr learned my addr 172.21.15.50:0/254747600 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:27:47.540 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:47.537+0000 7f4349400640 1 --2- 172.21.15.50:0/254747600 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4344107790 0x7f434406e530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:27:47.540 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:47.537+0000 7f4348a00640 1 --2- 172.21.15.50:0/254747600 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4344102350 0x7f4344074c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:27:47.540 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:47.537+0000 7f4349400640 1 -- 172.21.15.50:0/254747600 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4344102ca0 msgr2=0x7f434406df40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:27:47.540 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:47.537+0000 7f4349400640 1 --2- 172.21.15.50:0/254747600 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4344102ca0 0x7f434406df40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:47.540 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:47.537+0000 7f4349400640 1 -- 172.21.15.50:0/254747600 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4344102350 msgr2=0x7f4344074c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:27:47.540 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:47.537+0000 7f4349400640 1 --2- 172.21.15.50:0/254747600 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4344102350 0x7f4344074c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:47.540 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:47.537+0000 7f4349400640 1 -- 172.21.15.50:0/254747600 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f434406ed50 con 0x7f4344107790 2024-08-31T04:27:47.540 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:47.537+0000 7f4343e00640 1 --2- 172.21.15.50:0/254747600 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4344102ca0 0x7f434406df40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:27:47.541 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:47.538+0000 7f4349400640 1 --2- 172.21.15.50:0/254747600 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4344107790 0x7f434406e530 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f433c00e940 tx=0x7f433c00ee00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:27:47.541 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:47.538+0000 7f4341600640 1 -- 172.21.15.50:0/254747600 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f433c004d20 con 0x7f4344107790 2024-08-31T04:27:47.541 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:47.538+0000 7f4341600640 1 -- 172.21.15.50:0/254747600 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f433c005020 con 0x7f4344107790 2024-08-31T04:27:47.541 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:47.538+0000 7f4341600640 1 -- 172.21.15.50:0/254747600 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f433c0116d0 con 0x7f4344107790 2024-08-31T04:27:47.541 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:47.538+0000 7f4349e00640 1 -- 172.21.15.50:0/254747600 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4344073a00 con 0x7f4344107790 2024-08-31T04:27:47.541 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:47.538+0000 7f4349e00640 1 -- 172.21.15.50:0/254747600 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4344073ec0 con 0x7f4344107790 2024-08-31T04:27:47.542 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:27:47 smithi133 ceph-mon[22177]: pgmap v514: 97 pgs: 97 active+clean; 580 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 MiB/s rd, 1.7 MiB/s wr, 475 op/s 2024-08-31T04:27:47.546 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:47.543+0000 7f4352076740 1 Processor -- start 2024-08-31T04:27:47.550 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:47.547+0000 7f4352076740 1 -- start start 2024-08-31T04:27:47.550 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:47.547+0000 7f4352076740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56406304a520 0x5640633f0090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:27:47.550 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:47.547+0000 7f4352076740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x564063021660 0x5640633f05d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:27:47.550 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:47.547+0000 7f4352076740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x564063029840 0x5640633f0b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:27:47.550 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:47.547+0000 7f4352076740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x564063366a90 con 0x56406304a520 2024-08-31T04:27:47.550 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:47.547+0000 7f4352076740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x564063356020 con 0x564063029840 2024-08-31T04:27:47.550 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:47.547+0000 7f4352076740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x564063359fd0 con 0x564063021660 2024-08-31T04:27:47.550 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:47.548+0000 7f4341600640 1 -- 172.21.15.50:0/254747600 <== mon.1 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 18) ==== 152577+0+0 (secure 0 0 0) 0x7f433c005460 con 0x7f4344107790 2024-08-31T04:27:47.551 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:47.548+0000 7f4343e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56406304a520 0x5640633f0090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:27:47.551 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:47.548+0000 7f4343e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56406304a520 0x5640633f0090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49662/0 (socket says 172.21.15.50:49662) 2024-08-31T04:27:47.551 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:47.548+0000 7f4343e00640 1 -- 172.21.15.50:0/3710947138 learned_addr learned my addr 172.21.15.50:0/3710947138 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:27:47.552 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:47.549+0000 7f4348a00640 1 --2- 172.21.15.50:0/3710947138 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x564063021660 0x5640633f05d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:27:47.552 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:47.549+0000 7f4343e00640 1 -- 172.21.15.50:0/3710947138 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x564063021660 msgr2=0x5640633f05d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:27:47.552 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:47.549+0000 7f4343e00640 1 --2- 172.21.15.50:0/3710947138 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x564063021660 0x5640633f05d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:47.552 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:47.549+0000 7f4343e00640 1 -- 172.21.15.50:0/3710947138 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x564063029840 msgr2=0x5640633f0b10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-31T04:27:47.552 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:47.549+0000 7f4343e00640 1 --2- 172.21.15.50:0/3710947138 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x564063029840 0x5640633f0b10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:47.553 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:47.549+0000 7f4343e00640 1 -- 172.21.15.50:0/3710947138 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5640630b5b00 con 0x56406304a520 2024-08-31T04:27:47.553 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:47.550+0000 7f4343e00640 1 --2- 172.21.15.50:0/3710947138 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56406304a520 0x5640633f0090 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f4330009230 tx=0x7f4330004610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87c2077e87ee3cdd server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:27:47.553 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:47.551+0000 7f4335c00640 1 -- 172.21.15.50:0/3710947138 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4330035040 con 0x56406304a520 2024-08-31T04:27:47.554 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:47.551+0000 7f4335c00640 1 -- 172.21.15.50:0/3710947138 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4330004c10 con 0x56406304a520 2024-08-31T04:27:47.554 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:47.551+0000 7f4335c00640 1 -- 172.21.15.50:0/3710947138 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4330003a80 con 0x56406304a520 2024-08-31T04:27:47.556 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:47.553+0000 7f4352076740 1 -- 172.21.15.50:0/3710947138 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56406304a520 msgr2=0x5640633f0090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:27:47.556 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:47.553+0000 7f4352076740 1 --2- 172.21.15.50:0/3710947138 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56406304a520 0x5640633f0090 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f4330009230 tx=0x7f4330004610 comp rx=0 tx=0).stop 2024-08-31T04:27:47.556 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:47.553+0000 7f4341600640 1 --2- 172.21.15.50:0/254747600 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f432c0b4bf0 0x7f432c0b7100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:27:47.556 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:47.553+0000 7f4352076740 1 -- 172.21.15.50:0/3710947138 shutdown_connections 2024-08-31T04:27:47.556 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:47.553+0000 7f4352076740 1 --2- 172.21.15.50:0/3710947138 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x564063021660 0x5640633f05d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:47.556 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:47.553+0000 7f4352076740 1 --2- 172.21.15.50:0/3710947138 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x564063029840 0x5640633f0b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:47.556 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:47.553+0000 7f4352076740 1 --2- 172.21.15.50:0/3710947138 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56406304a520 0x5640633f0090 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:47.556 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:47.553+0000 7f4352076740 1 -- 172.21.15.50:0/3710947138 >> 172.21.15.50:0/3710947138 conn(0x56406303e910 msgr2=0x5640633edf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:27:47.557 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:47.554+0000 7f4341600640 1 -- 172.21.15.50:0/254747600 <== mon.1 v2:172.21.15.177:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8219+0+0 (secure 0 0 0) 0x7f433c0e51d0 con 0x7f4344107790 2024-08-31T04:27:47.557 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:47.554+0000 7f4343e00640 1 --2- 172.21.15.50:0/254747600 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f432c0b4bf0 0x7f432c0b7100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:27:47.560 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:47.554+0000 7f4352076740 1 -- 172.21.15.50:0/3710947138 shutdown_connections 2024-08-31T04:27:47.560 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:47.554+0000 7f4352076740 1 -- 172.21.15.50:0/3710947138 wait complete. 2024-08-31T04:27:47.560 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:47.555+0000 7f4343e00640 1 --2- 172.21.15.50:0/254747600 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f432c0b4bf0 0x7f432c0b7100 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f4330004550 tx=0x7f433002a440 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:27:47.561 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:47.555+0000 7f4352076740 1 -- start start 2024-08-31T04:27:47.561 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:47.556+0000 7f4352076740 1 Processor -- start 2024-08-31T04:27:47.563 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:47.556+0000 7f4352076740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x564063021660 0x5640633fb4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:27:47.563 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:47.556+0000 7f4352076740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x564063029840 0x5640633fba00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:27:47.563 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:47.556+0000 7f4352076740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56406304a520 0x5640633fbf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:27:47.563 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:47.556+0000 7f4352076740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x5640631b8bb0 con 0x56406304a520 2024-08-31T04:27:47.563 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:47.556+0000 7f4352076740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x5640632dcf90 con 0x564063021660 2024-08-31T04:27:47.563 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:47.556+0000 7f4352076740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x5640633fe810 con 0x564063029840 2024-08-31T04:27:47.563 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:47.556+0000 7f4352076740 10 client.0 _ll_register_callbacks cb 0x564063302710 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:27:47.563 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:47.556+0000 7f4348a00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x564063021660 0x5640633fb4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:27:47.563 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:47.556+0000 7f4343e00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x564063029840 0x5640633fba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:27:47.563 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:47.557+0000 7f4348a00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x564063021660 0x5640633fb4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.50:34880/0 (socket says 172.21.15.50:34880) 2024-08-31T04:27:47.563 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:47.557+0000 7f4348a00640 1 -- 172.21.15.50:0/3795765999 learned_addr learned my addr 172.21.15.50:0/3795765999 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:27:47.564 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:47.557+0000 7f4343e00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x564063029840 0x5640633fba00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.50:57904/0 (socket says 172.21.15.50:57904) 2024-08-31T04:27:47.564 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:47.557+0000 7f4349400640 1 --2- 172.21.15.50:0/3795765999 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56406304a520 0x5640633fbf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:27:47.564 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:47.557+0000 7f4343e00640 1 -- 172.21.15.50:0/3795765999 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x564063021660 msgr2=0x5640633fb4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:27:47.564 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:47.557+0000 7f4343e00640 1 --2- 172.21.15.50:0/3795765999 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x564063021660 0x5640633fb4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:47.564 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:47.557+0000 7f4343e00640 1 -- 172.21.15.50:0/3795765999 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56406304a520 msgr2=0x5640633fbf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:27:47.564 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:47.557+0000 7f4343e00640 1 --2- 172.21.15.50:0/3795765999 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56406304a520 0x5640633fbf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:47.564 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:47.557+0000 7f4343e00640 1 -- 172.21.15.50:0/3795765999 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56406312c960 con 0x564063029840 2024-08-31T04:27:47.564 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:47.557+0000 7f4349400640 1 --2- 172.21.15.50:0/3795765999 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56406304a520 0x5640633fbf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:27:47.564 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:47.557+0000 7f4343e00640 1 --2- 172.21.15.50:0/3795765999 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x564063029840 0x5640633fba00 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f4330003760 tx=0x7f4330004610 comp rx=0 tx=0).ready entity=mon.1 client_cookie=843a4dbe0ea50619 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:27:47.564 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:47.557+0000 7f432a000640 10 client.0 ms_handle_connect on v2:172.21.15.177:3300/0 2024-08-31T04:27:47.564 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:47.558+0000 7f432a000640 1 -- 172.21.15.50:0/3795765999 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4330003e50 con 0x564063029840 2024-08-31T04:27:47.564 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:47.558+0000 7f432a000640 1 -- 172.21.15.50:0/3795765999 <== mon.1 v2:172.21.15.177:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8219+0+0 (secure 0 0 0) 0x7f4330004970 con 0x564063029840 2024-08-31T04:27:47.565 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:47.558+0000 7f4352076740 1 -- 172.21.15.50:0/3795765999 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5640632f4e30 con 0x564063029840 2024-08-31T04:27:47.565 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:47.558+0000 7f432a000640 1 -- 172.21.15.50:0/3795765999 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f4330004b70 con 0x564063029840 2024-08-31T04:27:47.565 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:47.558+0000 7f4352076740 10 client.25876 fetch_fsmap learned FSMap version 33 2024-08-31T04:27:47.565 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:47.558+0000 7f4352076740 1 -- 172.21.15.50:0/3795765999 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x56406340a260 con 0x564063029840 2024-08-31T04:27:47.565 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:47.558+0000 7f432a000640 1 -- 172.21.15.50:0/3795765999 <== mon.1 v2:172.21.15.177:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x5640632f4e30 con 0x564063029840 2024-08-31T04:27:47.565 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:47.559+0000 7f432a000640 1 -- 172.21.15.50:0/3795765999 <== mon.1 v2:172.21.15.177:3300/0 5 ==== fsmap(e 33) ==== 8378+0+0 (secure 0 0 0) 0x7f4330061070 con 0x564063029840 2024-08-31T04:27:47.565 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:47.559+0000 7f4352076740 10 client.25876 fetch_fsmap finished waiting for FSMap version 33 2024-08-31T04:27:47.565 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:47.559+0000 7f4352076740 10 client.25876 resolve_mds: validated gid 24695 aka daemon mds.b 2024-08-31T04:27:47.565 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:47.559+0000 7f4352076740 20 client.25876 populate_metadata read hostname 'smithi050' 2024-08-31T04:27:47.565 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:47.559+0000 7f4352076740 1 --2- 172.21.15.50:0/3795765999 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x564063008ea0 0x56406340d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:27:47.565 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:47.559+0000 7f4352076740 4 client.25876 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T04:27:47.565 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:47.559+0000 7f4352076740 1 -- 172.21.15.50:0/3795765999 --> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5640633689e0 con 0x564063008ea0 2024-08-31T04:27:47.565 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:47.559+0000 7f4348a00640 1 --2- 172.21.15.50:0/3795765999 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x564063008ea0 0x56406340d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:27:47.566 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:47.560+0000 7f4348a00640 1 --2- 172.21.15.50:0/3795765999 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x564063008ea0 0x56406340d5c0 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=27238ccd015445b4 server_cookie=c8b593c66f1ea93f in_seq=0 out_seq=0 2024-08-31T04:27:47.566 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:47.560+0000 7f432a000640 10 client.25876 ms_handle_connect on v2:172.21.15.133:6838/2526402262 2024-08-31T04:27:47.566 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:47.560+0000 7fc0abe00640 1 -- 172.21.15.50:0/2055785128 <== mds.0 v2:172.21.15.133:6838/2526402262 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x558d94657960 con 0x558d942d51c0 2024-08-31T04:27:47.566 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:47.560+0000 7fc0abe00640 10 client.25867 handle_command_reply: tid=0 2024-08-31T04:27:47.566 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:47.560+0000 7fc0d82af740 1 client.25867 shutdown 2024-08-31T04:27:47.567 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:47.561+0000 7f432a000640 1 -- 172.21.15.50:0/3795765999 <== mds.0 v2:172.21.15.133:6838/2526402262 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5640633689e0 con 0x564063008ea0 2024-08-31T04:27:47.567 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:47.561+0000 7f432a000640 10 client.25876 handle_command_reply: tid=0 2024-08-31T04:27:47.567 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:47.561+0000 7f4352076740 1 client.25876 shutdown 2024-08-31T04:27:47.567 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:47.561+0000 7f4352076740 1 -- 172.21.15.50:0/3795765999 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x564063029840 msgr2=0x5640633fba00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:27:47.567 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:47.561+0000 7f4352076740 1 --2- 172.21.15.50:0/3795765999 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x564063029840 0x5640633fba00 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f4330003760 tx=0x7f4330004610 comp rx=0 tx=0).stop 2024-08-31T04:27:47.567 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:47.561+0000 7f4352076740 1 -- 172.21.15.50:0/3795765999 shutdown_connections 2024-08-31T04:27:47.567 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:47.561+0000 7f4352076740 1 --2- 172.21.15.50:0/3795765999 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x564063008ea0 0x56406340d5c0 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:47.567 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:47.561+0000 7f4352076740 1 --2- 172.21.15.50:0/3795765999 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x564063029840 0x5640633fba00 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:47.567 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:47.561+0000 7f4352076740 1 --2- 172.21.15.50:0/3795765999 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56406304a520 0x5640633fbf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:47.567 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:47.561+0000 7f4352076740 1 --2- 172.21.15.50:0/3795765999 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x564063021660 0x5640633fb4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:47.568 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:47.561+0000 7f432a000640 0 client.25876 ms_handle_reset on v2:172.21.15.133:6838/2526402262 2024-08-31T04:27:47.568 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:47.561+0000 7f4352076740 1 -- 172.21.15.50:0/3795765999 >> 172.21.15.50:0/3795765999 conn(0x56406303e910 msgr2=0x5640633f3270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:27:47.568 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout:{ 2024-08-31T04:27:47.568 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout: "message": "", 2024-08-31T04:27:47.568 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout: "return_code": 0 2024-08-31T04:27:47.568 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout:} 2024-08-31T04:27:47.568 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:47.561+0000 7fc0d82af740 1 -- 172.21.15.50:0/2055785128 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x558d943182f0 msgr2=0x558d946f6fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:27:47.569 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:47.561+0000 7fc0d82af740 1 --2- 172.21.15.50:0/2055785128 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x558d943182f0 0x558d946f6fc0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fc0c401a000 tx=0x7fc0c402df90 comp rx=0 tx=0).stop 2024-08-31T04:27:47.569 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:47.561+0000 7fc0d82af740 1 -- 172.21.15.50:0/2055785128 shutdown_connections 2024-08-31T04:27:47.569 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:47.561+0000 7fc0d82af740 1 --2- 172.21.15.50:0/2055785128 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x558d942d51c0 0x558d9476b060 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:47.569 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:47.561+0000 7fc0d82af740 1 --2- 172.21.15.50:0/2055785128 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558d943411b0 0x558d946f7a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:47.569 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:47.561+0000 7fc0d82af740 1 --2- 172.21.15.50:0/2055785128 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x558d943204d0 0x558d946f7500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:47.569 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:47.561+0000 7fc0d82af740 1 --2- 172.21.15.50:0/2055785128 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x558d943182f0 0x558d946f6fc0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:47.569 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:47.561+0000 7fc0d82af740 1 -- 172.21.15.50:0/2055785128 >> 172.21.15.50:0/2055785128 conn(0x558d94335300 msgr2=0x558d946e79c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:27:47.569 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:47.561+0000 7fc0abe00640 0 client.25867 ms_handle_reset on v2:172.21.15.133:6838/2526402262 2024-08-31T04:27:47.569 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:47.561+0000 7fc0d82af740 1 -- 172.21.15.50:0/2055785128 shutdown_connections 2024-08-31T04:27:47.569 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:47.561+0000 7fc0d82af740 1 -- 172.21.15.50:0/2055785128 wait complete. 2024-08-31T04:27:47.569 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:47.561+0000 7fc0d82af740 20 client.25867 trim_cache size 0 max 16384 2024-08-31T04:27:47.570 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:47.562+0000 7f4352076740 1 -- 172.21.15.50:0/3795765999 shutdown_connections 2024-08-31T04:27:47.570 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:47.562+0000 7f4352076740 1 -- 172.21.15.50:0/3795765999 wait complete. 2024-08-31T04:27:47.570 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:47.562+0000 7f4352076740 20 client.25876 trim_cache size 0 max 16384 2024-08-31T04:27:47.570 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:47.563+0000 7fc0d1200640 1 -- 172.21.15.50:0/3706043960 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fc0b00b4bb0 msgr2=0x7fc0b00b70c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:27:47.571 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:47.563+0000 7fc0d1200640 1 --2- 172.21.15.50:0/3706043960 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fc0b00b4bb0 0x7fc0b00b70c0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fc0bc0abc20 tx=0x7fc0bc005680 comp rx=0 tx=0).stop 2024-08-31T04:27:47.571 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:47.563+0000 7fc0d1200640 1 -- 172.21.15.50:0/3706043960 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc0cc075a90 msgr2=0x7fc0cc1a0360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:27:47.571 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:47.563+0000 7fc0d1200640 1 --2- 172.21.15.50:0/3706043960 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc0cc075a90 0x7fc0cc1a0360 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fc0bc00e9f0 tx=0x7fc0bc00edf0 comp rx=0 tx=0).stop 2024-08-31T04:27:47.571 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:47.563+0000 7fc0d1200640 1 -- 172.21.15.50:0/3706043960 shutdown_connections 2024-08-31T04:27:47.571 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:47.563+0000 7fc0d1200640 1 --2- 172.21.15.50:0/3706043960 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fc0b00b4bb0 0x7fc0b00b70c0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:47.571 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:47.563+0000 7fc0d1200640 1 --2- 172.21.15.50:0/3706043960 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc0cc10fbc0 0x7fc0cc1a1510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:47.571 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:47.563+0000 7fc0d1200640 1 --2- 172.21.15.50:0/3706043960 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc0cc076e90 0x7fc0cc1a09d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:47.571 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:47.563+0000 7fc0d1200640 1 --2- 172.21.15.50:0/3706043960 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc0cc075a90 0x7fc0cc1a0360 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:47.571 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:47.563+0000 7fc0d1200640 1 -- 172.21.15.50:0/3706043960 >> 172.21.15.50:0/3706043960 conn(0x7fc0cc0fed80 msgr2=0x7fc0cc102e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:27:47.571 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:47.563+0000 7fc0d1200640 1 -- 172.21.15.50:0/3706043960 shutdown_connections 2024-08-31T04:27:47.571 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:27:47.563+0000 7fc0d1200640 1 -- 172.21.15.50:0/3706043960 wait complete. 2024-08-31T04:27:47.583 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:47.581+0000 7f4352076740 1 Processor -- start 2024-08-31T04:27:47.583 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:47.581+0000 7f4352076740 1 -- start start 2024-08-31T04:27:47.584 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:47.581+0000 7f4352076740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56406303e910 0x564063407aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:27:47.584 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:47.581+0000 7f4352076740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x564063021660 0x5640633f6780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:27:47.584 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:47.581+0000 7f4352076740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x564063029840 0x5640633f6cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:27:47.584 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:47.581+0000 7f4352076740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f43441bddf0 con 0x56406303e910 2024-08-31T04:27:47.584 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:47.581+0000 7f4352076740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f43441bf9f0 con 0x564063021660 2024-08-31T04:27:47.584 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:47.581+0000 7f4352076740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f43441be4c0 con 0x564063029840 2024-08-31T04:27:47.585 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:47.582+0000 7f4348a00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56406303e910 0x564063407aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:27:47.585 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:47.582+0000 7f4349400640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x564063029840 0x5640633f6cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:27:47.585 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:47.582+0000 7f4343e00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x564063021660 0x5640633f6780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:27:47.585 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:47.582+0000 7f4349400640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x564063029840 0x5640633f6cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.50:57918/0 (socket says 172.21.15.50:57918) 2024-08-31T04:27:47.585 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:47.582+0000 7f4349400640 1 -- 172.21.15.50:0/2876959425 learned_addr learned my addr 172.21.15.50:0/2876959425 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:27:47.585 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:47.582+0000 7f4348a00640 1 --2- 172.21.15.50:0/2876959425 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56406303e910 0x564063407aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49686/0 (socket says 172.21.15.50:49686) 2024-08-31T04:27:47.586 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:47.582+0000 7f4343e00640 1 -- 172.21.15.50:0/2876959425 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x564063029840 msgr2=0x5640633f6cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:27:47.586 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:47.582+0000 7f4343e00640 1 --2- 172.21.15.50:0/2876959425 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x564063029840 0x5640633f6cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:47.586 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:47.582+0000 7f4343e00640 1 -- 172.21.15.50:0/2876959425 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56406303e910 msgr2=0x564063407aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:27:47.586 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:47.582+0000 7f4343e00640 1 --2- 172.21.15.50:0/2876959425 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56406303e910 0x564063407aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:47.586 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:47.582+0000 7f4343e00640 1 -- 172.21.15.50:0/2876959425 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5640633fc780 con 0x564063021660 2024-08-31T04:27:47.586 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:47.583+0000 7f4343e00640 1 --2- 172.21.15.50:0/2876959425 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x564063021660 0x5640633f6780 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f433003c590 tx=0x7f4330003790 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8d405be7c3a463d9 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:27:47.586 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:47.583+0000 7f4335200640 1 -- 172.21.15.50:0/2876959425 <== mon.2 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4330066030 con 0x564063021660 2024-08-31T04:27:47.586 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:47.583+0000 7f4335200640 1 -- 172.21.15.50:0/2876959425 <== mon.2 v2:172.21.15.133:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4330004970 con 0x564063021660 2024-08-31T04:27:47.586 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:47.583+0000 7f4335200640 1 -- 172.21.15.50:0/2876959425 <== mon.2 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43300314a0 con 0x564063021660 2024-08-31T04:27:47.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:47.584+0000 7f4352076740 1 -- 172.21.15.50:0/2876959425 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x564063021660 msgr2=0x5640633f6780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:27:47.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:47.584+0000 7f4352076740 1 --2- 172.21.15.50:0/2876959425 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x564063021660 0x5640633f6780 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f433003c590 tx=0x7f4330003790 comp rx=0 tx=0).stop 2024-08-31T04:27:47.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:47.584+0000 7f4352076740 1 -- 172.21.15.50:0/2876959425 shutdown_connections 2024-08-31T04:27:47.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:47.584+0000 7f4352076740 1 --2- 172.21.15.50:0/2876959425 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x564063029840 0x5640633f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:47.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:47.584+0000 7f4352076740 1 --2- 172.21.15.50:0/2876959425 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x564063021660 0x5640633f6780 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:47.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:47.584+0000 7f4352076740 1 --2- 172.21.15.50:0/2876959425 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56406303e910 0x564063407aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:47.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:47.584+0000 7f4352076740 1 -- 172.21.15.50:0/2876959425 >> 172.21.15.50:0/2876959425 conn(0x5640633fc070 msgr2=0x5640633f6070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:27:47.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:47.584+0000 7f4352076740 1 -- 172.21.15.50:0/2876959425 shutdown_connections 2024-08-31T04:27:47.587 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:47.584+0000 7f4352076740 1 -- 172.21.15.50:0/2876959425 wait complete. 2024-08-31T04:27:47.588 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:47.585+0000 7f4352076740 1 -- start start 2024-08-31T04:27:47.588 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:47.585+0000 7f4352076740 1 Processor -- start 2024-08-31T04:27:47.589 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:47.586+0000 7f4352076740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x564063021660 0x56406346ef60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:27:47.589 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:47.586+0000 7f4352076740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x564063029840 0x56406346f500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:27:47.589 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:47.586+0000 7f4352076740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56406303e910 0x56406346dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:27:47.589 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:47.586+0000 7f4352076740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f43441bf320 con 0x56406303e910 2024-08-31T04:27:47.589 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:47.586+0000 7f4352076740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f43441beb90 con 0x564063029840 2024-08-31T04:27:47.589 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:47.586+0000 7f4352076740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f43441bbdd0 con 0x564063021660 2024-08-31T04:27:47.589 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:47.586+0000 7f4352076740 10 client.0 _ll_register_callbacks cb 0x7f4330005230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:27:47.589 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:47.586+0000 7f4348a00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x564063021660 0x56406346ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:27:47.589 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:47.586+0000 7f4348a00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x564063021660 0x56406346ef60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.50:57920/0 (socket says 172.21.15.50:57920) 2024-08-31T04:27:47.589 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:47.586+0000 7f4348a00640 1 -- 172.21.15.50:0/481723446 learned_addr learned my addr 172.21.15.50:0/481723446 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:27:47.589 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:47.586+0000 7f4343e00640 1 --2- 172.21.15.50:0/481723446 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x564063029840 0x56406346f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:27:47.591 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:47.587+0000 7f4349400640 1 --2- 172.21.15.50:0/481723446 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56406303e910 0x56406346dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:27:47.591 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:47.587+0000 7f4343e00640 1 -- 172.21.15.50:0/481723446 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x564063021660 msgr2=0x56406346ef60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:27:47.591 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:47.587+0000 7f4343e00640 1 --2- 172.21.15.50:0/481723446 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x564063021660 0x56406346ef60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:47.591 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:47.587+0000 7f4343e00640 1 -- 172.21.15.50:0/481723446 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56406303e910 msgr2=0x56406346dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:27:47.591 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:47.587+0000 7f4343e00640 1 --2- 172.21.15.50:0/481723446 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56406303e910 0x56406346dcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:47.591 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:47.587+0000 7f4343e00640 1 -- 172.21.15.50:0/481723446 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56406346e360 con 0x564063029840 2024-08-31T04:27:47.591 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:47.587+0000 7f4349400640 1 --2- 172.21.15.50:0/481723446 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56406303e910 0x56406346dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T04:27:47.591 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:47.587+0000 7f4343e00640 1 --2- 172.21.15.50:0/481723446 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x564063029840 0x56406346f500 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f433003c6d0 tx=0x7f433003cd20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=22fd92255f15d4e2 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:27:47.591 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:47.587+0000 7f432a000640 10 client.0 ms_handle_connect on v2:172.21.15.133:3300/0 2024-08-31T04:27:47.592 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:47.588+0000 7f432a000640 1 -- 172.21.15.50:0/481723446 <== mon.2 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f433006f060 con 0x564063029840 2024-08-31T04:27:47.592 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:47.588+0000 7f432a000640 1 -- 172.21.15.50:0/481723446 <== mon.2 v2:172.21.15.133:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8219+0+0 (secure 0 0 0) 0x7f4330004d10 con 0x564063029840 2024-08-31T04:27:47.592 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:47.588+0000 7f4352076740 1 -- 172.21.15.50:0/481723446 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4330004970 con 0x564063029840 2024-08-31T04:27:47.592 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:47.588+0000 7f432a000640 1 -- 172.21.15.50:0/481723446 <== mon.2 v2:172.21.15.133:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f4330066040 con 0x564063029840 2024-08-31T04:27:47.592 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:47.588+0000 7f4352076740 10 client.25901 fetch_fsmap learned FSMap version 33 2024-08-31T04:27:47.592 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:47.588+0000 7f4352076740 1 -- 172.21.15.50:0/481723446 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x5640634789d0 con 0x564063029840 2024-08-31T04:27:47.592 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:47.589+0000 7f432a000640 1 -- 172.21.15.50:0/481723446 <== mon.2 v2:172.21.15.133:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4330004970 con 0x564063029840 2024-08-31T04:27:47.592 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:47.589+0000 7f432a000640 1 -- 172.21.15.50:0/481723446 <== mon.2 v2:172.21.15.133:3300/0 5 ==== fsmap(e 33) ==== 8378+0+0 (secure 0 0 0) 0x7f4330061040 con 0x564063029840 2024-08-31T04:27:47.593 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:47.589+0000 7f4352076740 10 client.25901 fetch_fsmap finished waiting for FSMap version 33 2024-08-31T04:27:47.593 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:47.589+0000 7f4352076740 10 client.25901 resolve_mds: validated gid 24695 aka daemon mds.b 2024-08-31T04:27:47.593 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:47.589+0000 7f4352076740 20 client.25901 populate_metadata read hostname 'smithi050' 2024-08-31T04:27:47.593 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:47.589+0000 7f4352076740 1 --2- 172.21.15.50:0/481723446 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x56406304a520 0x56406347ae90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:27:47.593 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:47.589+0000 7f4352076740 4 client.25901 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "87de6d7", "release": true, "await": true}] 2024-08-31T04:27:47.593 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:47.589+0000 7f4352076740 1 -- 172.21.15.50:0/481723446 --> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] -- command(tid 0: {"prefix": "quiesce db", "set_id": "87de6d7", "release": true, "await": true}) -- 0x564063364480 con 0x56406304a520 2024-08-31T04:27:47.593 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:47.589+0000 7f4348a00640 1 --2- 172.21.15.50:0/481723446 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x56406304a520 0x56406347ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:27:47.593 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:47.590+0000 7f4348a00640 1 --2- 172.21.15.50:0/481723446 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x56406304a520 0x56406347ae90 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ef6c6ef4b222f7e6 server_cookie=2556234c5ef6c190 in_seq=0 out_seq=0 2024-08-31T04:27:47.594 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:47.590+0000 7f432a000640 10 client.25901 ms_handle_connect on v2:172.21.15.133:6838/2526402262 2024-08-31T04:27:47.973 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:47.969+0000 7f432a000640 1 -- 172.21.15.50:0/481723446 <== mds.0 v2:172.21.15.133:6838/2526402262 1 ==== command_reply(tid 0: 0 ) ==== 8+0+590 (crc 0 0 0) 0x564063364480 con 0x56406304a520 2024-08-31T04:27:47.973 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:47.969+0000 7f432a000640 10 client.25901 handle_command_reply: tid=0 2024-08-31T04:27:47.973 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:47.969+0000 7f4352076740 1 client.25901 shutdown 2024-08-31T04:27:47.973 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:47.970+0000 7f4352076740 1 -- 172.21.15.50:0/481723446 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x564063029840 msgr2=0x56406346f500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:27:47.973 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:47.970+0000 7f4352076740 1 --2- 172.21.15.50:0/481723446 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x564063029840 0x56406346f500 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f433003c6d0 tx=0x7f433003cd20 comp rx=0 tx=0).stop 2024-08-31T04:27:47.974 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:47.970+0000 7f4352076740 1 -- 172.21.15.50:0/481723446 shutdown_connections 2024-08-31T04:27:47.974 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:47.970+0000 7f4352076740 1 --2- 172.21.15.50:0/481723446 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x56406304a520 0x56406347ae90 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:47.974 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:47.970+0000 7f4352076740 1 --2- 172.21.15.50:0/481723446 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56406303e910 0x56406346dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:47.974 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:47.970+0000 7f4352076740 1 --2- 172.21.15.50:0/481723446 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x564063029840 0x56406346f500 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:47.974 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:47.970+0000 7f4352076740 1 --2- 172.21.15.50:0/481723446 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x564063021660 0x56406346ef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:47.974 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:47.970+0000 7f4352076740 1 -- 172.21.15.50:0/481723446 >> 172.21.15.50:0/481723446 conn(0x5640633fc070 msgr2=0x5640633f6a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:27:47.974 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:47.971+0000 7f432a000640 0 client.25901 ms_handle_reset on v2:172.21.15.133:6838/2526402262 2024-08-31T04:27:47.974 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:47.972+0000 7f4352076740 1 -- 172.21.15.50:0/481723446 shutdown_connections 2024-08-31T04:27:47.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:47.972+0000 7f4352076740 1 -- 172.21.15.50:0/481723446 wait complete. 2024-08-31T04:27:47.975 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:47.972+0000 7f4352076740 20 client.25901 trim_cache size 0 max 16384 2024-08-31T04:27:47.975 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-08-31T04:27:47.976 INFO:teuthology.orchestra.run.smithi050.stdout: "epoch": 33, 2024-08-31T04:27:47.976 INFO:teuthology.orchestra.run.smithi050.stdout: "leader": 24695, 2024-08-31T04:27:47.976 INFO:teuthology.orchestra.run.smithi050.stdout: "set_version": 16, 2024-08-31T04:27:47.976 INFO:teuthology.orchestra.run.smithi050.stdout: "sets": { 2024-08-31T04:27:47.976 INFO:teuthology.orchestra.run.smithi050.stdout: "87de6d7": { 2024-08-31T04:27:47.976 INFO:teuthology.orchestra.run.smithi050.stdout: "version": 16, 2024-08-31T04:27:47.976 INFO:teuthology.orchestra.run.smithi050.stdout: "age_ref": 0.0, 2024-08-31T04:27:47.976 INFO:teuthology.orchestra.run.smithi050.stdout: "state": { 2024-08-31T04:27:47.976 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "RELEASED", 2024-08-31T04:27:47.976 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 0.0 2024-08-31T04:27:47.976 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:27:47.976 INFO:teuthology.orchestra.run.smithi050.stdout: "timeout": 90.0, 2024-08-31T04:27:47.977 INFO:teuthology.orchestra.run.smithi050.stdout: "expiration": 141.8, 2024-08-31T04:27:47.977 INFO:teuthology.orchestra.run.smithi050.stdout: "members": { 2024-08-31T04:27:47.977 INFO:teuthology.orchestra.run.smithi050.stdout: "file:/": { 2024-08-31T04:27:47.977 INFO:teuthology.orchestra.run.smithi050.stdout: "excluded": false, 2024-08-31T04:27:47.977 INFO:teuthology.orchestra.run.smithi050.stdout: "state": { 2024-08-31T04:27:47.977 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "RELEASED", 2024-08-31T04:27:47.977 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 0.0 2024-08-31T04:27:47.977 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T04:27:47.977 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T04:27:47.977 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T04:27:47.977 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T04:27:47.977 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T04:27:47.977 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-08-31T04:27:47.978 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:47.973+0000 7f4349e00640 1 -- 172.21.15.50:0/254747600 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f432c0b4bf0 msgr2=0x7f432c0b7100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:27:47.978 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:47.973+0000 7f4349e00640 1 --2- 172.21.15.50:0/254747600 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f432c0b4bf0 0x7f432c0b7100 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f4330004550 tx=0x7f433002a440 comp rx=0 tx=0).stop 2024-08-31T04:27:47.978 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:47.973+0000 7f4349e00640 1 -- 172.21.15.50:0/254747600 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4344107790 msgr2=0x7f434406e530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:27:47.978 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:47.973+0000 7f4349e00640 1 --2- 172.21.15.50:0/254747600 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4344107790 0x7f434406e530 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f433c00e940 tx=0x7f433c00ee00 comp rx=0 tx=0).stop 2024-08-31T04:27:47.978 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:47.973+0000 7f4349e00640 1 -- 172.21.15.50:0/254747600 shutdown_connections 2024-08-31T04:27:47.978 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:47.973+0000 7f4349e00640 1 --2- 172.21.15.50:0/254747600 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f432c0b4bf0 0x7f432c0b7100 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:47.978 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:47.973+0000 7f4349e00640 1 --2- 172.21.15.50:0/254747600 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4344107790 0x7f434406e530 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:47.978 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:47.973+0000 7f4349e00640 1 --2- 172.21.15.50:0/254747600 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4344102ca0 0x7f434406df40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:47.979 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:47.973+0000 7f4349e00640 1 --2- 172.21.15.50:0/254747600 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4344102350 0x7f4344074c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:27:47.979 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:47.973+0000 7f4349e00640 1 -- 172.21.15.50:0/254747600 >> 172.21.15.50:0/254747600 conn(0x7f43440fe060 msgr2=0x7f43441051a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:27:47.979 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:47.973+0000 7f4349e00640 1 -- 172.21.15.50:0/254747600 shutdown_connections 2024-08-31T04:27:47.979 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:27:47.973+0000 7f4349e00640 1 -- 172.21.15.50:0/254747600 wait complete. 2024-08-31T04:27:49.139 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:27:49 smithi050 ceph-mon[17259]: pgmap v515: 97 pgs: 97 active+clean; 580 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 MiB/s rd, 1006 KiB/s wr, 363 op/s 2024-08-31T04:27:49.202 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '87de6d7', total seconds elapsed: 33.8 2024-08-31T04:27:49.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:27:49 smithi177 ceph-mon[22025]: pgmap v515: 97 pgs: 97 active+clean; 580 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 MiB/s rd, 1006 KiB/s wr, 363 op/s 2024-08-31T04:27:49.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:27:49 smithi133 ceph-mon[22177]: pgmap v515: 97 pgs: 97 active+clean; 580 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 MiB/s rd, 1006 KiB/s wr, 363 op/s 2024-08-31T04:27:51.451 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:27:51 smithi050 ceph-mon[17259]: pgmap v516: 97 pgs: 97 active+clean; 582 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 MiB/s rd, 691 KiB/s wr, 309 op/s 2024-08-31T04:27:51.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:27:51 smithi177 ceph-mon[22025]: pgmap v516: 97 pgs: 97 active+clean; 582 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 MiB/s rd, 691 KiB/s wr, 309 op/s 2024-08-31T04:27:51.542 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:27:51 smithi133 ceph-mon[22177]: pgmap v516: 97 pgs: 97 active+clean; 582 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 MiB/s rd, 691 KiB/s wr, 309 op/s 2024-08-31T04:27:53.467 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:27:53 smithi050 ceph-mon[17259]: pgmap v517: 97 pgs: 97 active+clean; 583 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 MiB/s rd, 571 KiB/s wr, 321 op/s 2024-08-31T04:27:53.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:27:53 smithi177 ceph-mon[22025]: pgmap v517: 97 pgs: 97 active+clean; 583 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 MiB/s rd, 571 KiB/s wr, 321 op/s 2024-08-31T04:27:53.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:27:53 smithi133 ceph-mon[22177]: pgmap v517: 97 pgs: 97 active+clean; 583 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 MiB/s rd, 571 KiB/s wr, 321 op/s 2024-08-31T04:27:55.450 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:27:55 smithi050 ceph-mon[17259]: pgmap v518: 97 pgs: 97 active+clean; 583 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 MiB/s rd, 524 KiB/s wr, 319 op/s 2024-08-31T04:27:55.451 INFO:tasks.workunit.client.0.smithi050.stdout: 191 463162 1221 324248 1433 114597 884 2024-08-31T04:27:55.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:27:55 smithi177 ceph-mon[22025]: pgmap v518: 97 pgs: 97 active+clean; 583 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 MiB/s rd, 524 KiB/s wr, 319 op/s 2024-08-31T04:27:55.542 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:27:55 smithi133 ceph-mon[22177]: pgmap v518: 97 pgs: 97 active+clean; 583 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 MiB/s rd, 524 KiB/s wr, 319 op/s 2024-08-31T04:27:57.450 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:27:57 smithi050 ceph-mon[17259]: pgmap v519: 97 pgs: 97 active+clean; 620 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 MiB/s rd, 3.7 MiB/s wr, 427 op/s 2024-08-31T04:27:57.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:27:57 smithi177 ceph-mon[22025]: pgmap v519: 97 pgs: 97 active+clean; 620 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 MiB/s rd, 3.7 MiB/s wr, 427 op/s 2024-08-31T04:27:57.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:27:57 smithi133 ceph-mon[22177]: pgmap v519: 97 pgs: 97 active+clean; 620 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 MiB/s rd, 3.7 MiB/s wr, 427 op/s 2024-08-31T04:27:59.379 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:27:59 smithi050 ceph-mon[17259]: pgmap v520: 97 pgs: 97 active+clean; 630 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 4.5 MiB/s wr, 317 op/s 2024-08-31T04:27:59.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:27:59 smithi177 ceph-mon[22025]: pgmap v520: 97 pgs: 97 active+clean; 630 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 4.5 MiB/s wr, 317 op/s 2024-08-31T04:27:59.542 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:27:59 smithi133 ceph-mon[22177]: pgmap v520: 97 pgs: 97 active+clean; 630 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 4.5 MiB/s wr, 317 op/s 2024-08-31T04:28:00.881 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:00.880+0000 7f5cabc00640 1 -- 172.21.15.50:0/2433913279 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5ca4076e90 msgr2=0x7f5ca4075550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:28:00.881 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:00.880+0000 7f5cabc00640 1 --2- 172.21.15.50:0/2433913279 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5ca4076e90 0x7f5ca4075550 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f5c98009900 tx=0x7f5c9802a400 comp rx=0 tx=0).stop 2024-08-31T04:28:00.882 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:00.880+0000 7f5cabc00640 1 -- 172.21.15.50:0/2433913279 shutdown_connections 2024-08-31T04:28:00.882 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:00.880+0000 7f5cabc00640 1 --2- 172.21.15.50:0/2433913279 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5ca410fbe0 0x7f5ca4112000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:00.882 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:00.880+0000 7f5cabc00640 1 --2- 172.21.15.50:0/2433913279 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5ca4075a90 0x7f5ca4075ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:00.882 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:00.880+0000 7f5cabc00640 1 --2- 172.21.15.50:0/2433913279 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5ca4076e90 0x7f5ca4075550 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:00.882 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:00.880+0000 7f5cabc00640 1 -- 172.21.15.50:0/2433913279 >> 172.21.15.50:0/2433913279 conn(0x7f5ca40fedc0 msgr2=0x7f5ca4101250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:28:00.882 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:00.881+0000 7f5cabc00640 1 -- 172.21.15.50:0/2433913279 shutdown_connections 2024-08-31T04:28:00.882 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:00.881+0000 7f5cabc00640 1 -- 172.21.15.50:0/2433913279 wait complete. 2024-08-31T04:28:00.883 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:00.882+0000 7f5cabc00640 1 Processor -- start 2024-08-31T04:28:00.883 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:00.882+0000 7f5cabc00640 1 -- start start 2024-08-31T04:28:00.884 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:00.883+0000 7f5cabc00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5ca4075a90 0x7f5ca41a02e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:28:00.885 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:00.883+0000 7f5cabc00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5ca4076e90 0x7f5ca41a0950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:28:00.885 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:00.883+0000 7f5cabc00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5ca410fbe0 0x7f5ca41a1500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:28:00.885 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:00.883+0000 7f5cabc00640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f5ca4115680 con 0x7f5ca410fbe0 2024-08-31T04:28:00.885 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:00.883+0000 7f5cabc00640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f5ca4115500 con 0x7f5ca4076e90 2024-08-31T04:28:00.885 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:00.883+0000 7f5cabc00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f5ca4115800 con 0x7f5ca4075a90 2024-08-31T04:28:00.885 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:00.883+0000 7f5ca3e00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5ca4076e90 0x7f5ca41a0950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:28:00.885 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:00.883+0000 7f5ca9200640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5ca4075a90 0x7f5ca41a02e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:28:00.885 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:00.883+0000 7f5ca3e00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5ca4076e90 0x7f5ca41a0950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.50:59422/0 (socket says 172.21.15.50:59422) 2024-08-31T04:28:00.885 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:00.883+0000 7f5ca9200640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5ca4075a90 0x7f5ca41a02e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.50:33746/0 (socket says 172.21.15.50:33746) 2024-08-31T04:28:00.885 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:00.883+0000 7f5ca3e00640 1 -- 172.21.15.50:0/1755592755 learned_addr learned my addr 172.21.15.50:0/1755592755 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:28:00.886 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:00.884+0000 7f5ca9c00640 1 --2- 172.21.15.50:0/1755592755 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5ca410fbe0 0x7f5ca41a1500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:28:00.886 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:00.884+0000 7f5ca9200640 1 -- 172.21.15.50:0/1755592755 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5ca4076e90 msgr2=0x7f5ca41a0950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:28:00.886 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:00.884+0000 7f5ca9200640 1 --2- 172.21.15.50:0/1755592755 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5ca4076e90 0x7f5ca41a0950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:00.886 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:00.884+0000 7f5ca9200640 1 -- 172.21.15.50:0/1755592755 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5ca410fbe0 msgr2=0x7f5ca41a1500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:28:00.886 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:00.884+0000 7f5ca9200640 1 --2- 172.21.15.50:0/1755592755 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5ca410fbe0 0x7f5ca41a1500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:00.886 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:00.884+0000 7f5ca9200640 1 -- 172.21.15.50:0/1755592755 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ca41a1d20 con 0x7f5ca4075a90 2024-08-31T04:28:00.887 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:00.885+0000 7f5ca9200640 1 --2- 172.21.15.50:0/1755592755 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5ca4075a90 0x7f5ca41a02e0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f5c98009850 tx=0x7f5c980042f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:28:00.887 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:00.885+0000 7f5ca1600640 1 -- 172.21.15.50:0/1755592755 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c9803f030 con 0x7f5ca4075a90 2024-08-31T04:28:00.887 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:00.885+0000 7f5cabc00640 1 -- 172.21.15.50:0/1755592755 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5ca41a1fb0 con 0x7f5ca4075a90 2024-08-31T04:28:00.887 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:00.885+0000 7f5cabc00640 1 -- 172.21.15.50:0/1755592755 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ca41075b0 con 0x7f5ca4075a90 2024-08-31T04:28:00.887 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:00.886+0000 7f5ca1600640 1 -- 172.21.15.50:0/1755592755 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5c98003cb0 con 0x7f5ca4075a90 2024-08-31T04:28:00.888 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:00.886+0000 7f5ca1600640 1 -- 172.21.15.50:0/1755592755 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c98035070 con 0x7f5ca4075a90 2024-08-31T04:28:00.891 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:00.890+0000 7f5cb2e2c740 1 Processor -- start 2024-08-31T04:28:00.891 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:00.890+0000 7f5cb2e2c740 1 -- start start 2024-08-31T04:28:00.892 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:00.890+0000 7f5cb2e2c740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55857f8691b0 0x55857fc0edc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:28:00.892 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:00.890+0000 7f5cb2e2c740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55857f8402f0 0x55857fc0f430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:28:00.892 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:00.890+0000 7f5cb2e2c740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55857f8484d0 0x55857fc0ff80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:28:00.892 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:00.890+0000 7f5cb2e2c740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55857fb81f70 con 0x55857f8402f0 2024-08-31T04:28:00.892 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:00.890+0000 7f5cb2e2c740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x55857fb71500 con 0x55857f8691b0 2024-08-31T04:28:00.892 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:00.890+0000 7f5cb2e2c740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x55857fb754b0 con 0x55857f8484d0 2024-08-31T04:28:00.895 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:00.891+0000 7f5ca3e00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55857f8484d0 0x55857fc0ff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:28:00.895 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:00.891+0000 7f5ca3e00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55857f8484d0 0x55857fc0ff80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.50:33752/0 (socket says 172.21.15.50:33752) 2024-08-31T04:28:00.895 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:00.891+0000 7f5ca3e00640 1 -- 172.21.15.50:0/3551444548 learned_addr learned my addr 172.21.15.50:0/3551444548 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:28:00.895 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:00.893+0000 7f5ca3e00640 1 -- 172.21.15.50:0/3551444548 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55857f8691b0 msgr2=0x55857fc0edc0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-08-31T04:28:00.895 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:00.893+0000 7f5ca3e00640 1 --2- 172.21.15.50:0/3551444548 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55857f8691b0 0x55857fc0edc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:00.895 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:00.893+0000 7f5ca3e00640 1 -- 172.21.15.50:0/3551444548 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55857f8402f0 msgr2=0x55857fc0f430 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-31T04:28:00.895 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:00.893+0000 7f5ca3e00640 1 --2- 172.21.15.50:0/3551444548 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55857f8402f0 0x55857fc0f430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:00.895 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:00.893+0000 7f5ca3e00640 1 -- 172.21.15.50:0/3551444548 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55857fb2bc10 con 0x55857f8484d0 2024-08-31T04:28:00.899 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:00.895+0000 7f5ca1600640 1 -- 172.21.15.50:0/1755592755 <== mon.1 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 18) ==== 152577+0+0 (secure 0 0 0) 0x7f5c98042030 con 0x7f5ca4075a90 2024-08-31T04:28:00.899 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:00.895+0000 7f5ca3e00640 1 --2- 172.21.15.50:0/3551444548 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55857f8484d0 0x55857fc0ff80 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f5c90009d30 tx=0x7f5c900117b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=eb64e8ecae601d74 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:28:00.900 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:00.896+0000 7f5c96000640 1 -- 172.21.15.50:0/3551444548 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c90012650 con 0x55857f8484d0 2024-08-31T04:28:00.900 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:00.897+0000 7f5c96000640 1 -- 172.21.15.50:0/3551444548 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5c90009e20 con 0x55857f8484d0 2024-08-31T04:28:00.900 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:00.897+0000 7f5c96000640 1 -- 172.21.15.50:0/3551444548 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c9000fc30 con 0x55857f8484d0 2024-08-31T04:28:00.900 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:00.897+0000 7f5ca1600640 1 --2- 172.21.15.50:0/1755592755 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f5c8c0b4c30 0x7f5c8c0b7140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:28:00.900 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:00.898+0000 7f5ca1600640 1 -- 172.21.15.50:0/1755592755 <== mon.1 v2:172.21.15.177:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8219+0+0 (secure 0 0 0) 0x7f5c98105570 con 0x7f5ca4075a90 2024-08-31T04:28:00.904 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:00.900+0000 7f5cb2e2c740 1 -- 172.21.15.50:0/3551444548 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55857f8484d0 msgr2=0x55857fc0ff80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:28:00.904 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:00.900+0000 7f5cb2e2c740 1 --2- 172.21.15.50:0/3551444548 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55857f8484d0 0x55857fc0ff80 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f5c90009d30 tx=0x7f5c900117b0 comp rx=0 tx=0).stop 2024-08-31T04:28:00.907 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:00.904+0000 7f5ca9c00640 1 --2- 172.21.15.50:0/1755592755 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f5c8c0b4c30 0x7f5c8c0b7140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:28:00.907 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:00.905+0000 7f5ca9c00640 1 --2- 172.21.15.50:0/1755592755 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f5c8c0b4c30 0x7f5c8c0b7140 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f5c9c005c40 tx=0x7f5c9c005bd0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:28:00.907 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:00.905+0000 7f5cb2e2c740 1 -- 172.21.15.50:0/3551444548 shutdown_connections 2024-08-31T04:28:00.907 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:00.906+0000 7f5cb2e2c740 1 --2- 172.21.15.50:0/3551444548 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55857f8484d0 0x55857fc0ff80 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:00.907 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:00.906+0000 7f5cb2e2c740 1 --2- 172.21.15.50:0/3551444548 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55857f8402f0 0x55857fc0f430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:00.907 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:00.906+0000 7f5cb2e2c740 1 --2- 172.21.15.50:0/3551444548 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55857f8691b0 0x55857fc0edc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:00.907 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:00.906+0000 7f5cb2e2c740 1 -- 172.21.15.50:0/3551444548 >> 172.21.15.50:0/3551444548 conn(0x55857f85d300 msgr2=0x55857fc0a850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:28:00.910 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:00.909+0000 7f5cb2e2c740 1 -- 172.21.15.50:0/3551444548 shutdown_connections 2024-08-31T04:28:00.912 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:00.911+0000 7f5cb2e2c740 1 -- 172.21.15.50:0/3551444548 wait complete. 2024-08-31T04:28:00.912 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:00.911+0000 7f5cb2e2c740 1 -- start start 2024-08-31T04:28:00.913 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:00.912+0000 7f5cb2e2c740 1 Processor -- start 2024-08-31T04:28:00.916 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:00.912+0000 7f5cb2e2c740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55857f8402f0 0x55857fc18500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:28:00.916 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:00.912+0000 7f5cb2e2c740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55857f8484d0 0x55857fc18bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:28:00.916 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:00.913+0000 7f5ca9200640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55857f8402f0 0x55857fc18500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:28:00.916 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:00.914+0000 7f5ca9200640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55857f8402f0 0x55857fc18500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:55994/0 (socket says 172.21.15.50:55994) 2024-08-31T04:28:00.916 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:00.914+0000 7f5ca9200640 1 -- 172.21.15.50:0/1465696639 learned_addr learned my addr 172.21.15.50:0/1465696639 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:28:00.916 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:00.914+0000 7f5cb2e2c740 1 --2- 172.21.15.50:0/1465696639 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55857f8691b0 0x55857fc19730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:28:00.917 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:00.914+0000 7f5ca3e00640 1 --2- 172.21.15.50:0/1465696639 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55857f8484d0 0x55857fc18bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:28:00.917 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:00.914+0000 7f5cb2e2c740 1 -- 172.21.15.50:0/1465696639 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55857faaaab0 con 0x55857f8402f0 2024-08-31T04:28:00.917 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:00.914+0000 7f5cb2e2c740 1 -- 172.21.15.50:0/1465696639 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x55857fb18320 con 0x55857f8691b0 2024-08-31T04:28:00.917 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:00.914+0000 7f5cb2e2c740 1 -- 172.21.15.50:0/1465696639 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x55857fc10aa0 con 0x55857f8484d0 2024-08-31T04:28:00.917 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:00.915+0000 7f5ca9c00640 1 --2- 172.21.15.50:0/1465696639 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55857f8691b0 0x55857fc19730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:28:00.917 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:00.915+0000 7f5cb2e2c740 10 client.0 _ll_register_callbacks cb 0x55857fb1e6a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:28:00.918 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:00.915+0000 7f5ca3e00640 1 -- 172.21.15.50:0/1465696639 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55857f8691b0 msgr2=0x55857fc19730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:28:00.918 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:00.915+0000 7f5ca3e00640 1 --2- 172.21.15.50:0/1465696639 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55857f8691b0 0x55857fc19730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:00.918 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:00.915+0000 7f5ca3e00640 1 -- 172.21.15.50:0/1465696639 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55857f8402f0 msgr2=0x55857fc18500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:28:00.918 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:00.915+0000 7f5ca3e00640 1 --2- 172.21.15.50:0/1465696639 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55857f8402f0 0x55857fc18500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:00.918 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:00.915+0000 7f5ca3e00640 1 -- 172.21.15.50:0/1465696639 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55857f8d4790 con 0x55857f8484d0 2024-08-31T04:28:00.918 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:00.916+0000 7f5ca9200640 1 --2- 172.21.15.50:0/1465696639 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55857f8402f0 0x55857fc18500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:28:00.919 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:00.918+0000 7f5ca3e00640 1 --2- 172.21.15.50:0/1465696639 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55857f8484d0 0x55857fc18bc0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f5c90000c00 tx=0x7f5c9000f670 comp rx=0 tx=0).ready entity=mon.1 client_cookie=366abf165aa47b1f server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:28:00.919 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:00.918+0000 7f5c8aa00640 10 client.0 ms_handle_connect on v2:172.21.15.177:3300/0 2024-08-31T04:28:00.919 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:00.918+0000 7f5c8aa00640 1 -- 172.21.15.50:0/1465696639 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c90028020 con 0x55857f8484d0 2024-08-31T04:28:00.919 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:00.918+0000 7f5c8aa00640 1 -- 172.21.15.50:0/1465696639 <== mon.1 v2:172.21.15.177:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8219+0+0 (secure 0 0 0) 0x7f5c9000fc00 con 0x55857f8484d0 2024-08-31T04:28:00.921 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:00.918+0000 7f5cb2e2c740 1 -- 172.21.15.50:0/1465696639 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5c90009e20 con 0x55857f8484d0 2024-08-31T04:28:00.921 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:00.919+0000 7f5c8aa00640 1 -- 172.21.15.50:0/1465696639 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f5c9000fe00 con 0x55857f8484d0 2024-08-31T04:28:00.922 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:00.921+0000 7f5cb2e2c740 10 client.25894 fetch_fsmap learned FSMap version 33 2024-08-31T04:28:00.922 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:00.921+0000 7f5cb2e2c740 1 -- 172.21.15.50:0/1465696639 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x55857f94d620 con 0x55857f8484d0 2024-08-31T04:28:00.922 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:00.921+0000 7f5c8aa00640 1 -- 172.21.15.50:0/1465696639 <== mon.1 v2:172.21.15.177:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5c90009e20 con 0x55857f8484d0 2024-08-31T04:28:00.924 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:00.923+0000 7f5c8aa00640 1 -- 172.21.15.50:0/1465696639 <== mon.1 v2:172.21.15.177:3300/0 5 ==== fsmap(e 33) ==== 8378+0+0 (secure 0 0 0) 0x7f5c90003bc0 con 0x55857f8484d0 2024-08-31T04:28:00.925 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:00.923+0000 7f5cb2e2c740 10 client.25894 fetch_fsmap finished waiting for FSMap version 33 2024-08-31T04:28:00.925 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:00.923+0000 7f5cb2e2c740 10 client.25894 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T04:28:00.925 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:00.923+0000 7f5cb2e2c740 20 client.25894 populate_metadata read hostname 'smithi050' 2024-08-31T04:28:00.925 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:00.923+0000 7f5cb2e2c740 1 --2- 172.21.15.50:0/1465696639 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x55857f827d80 0x55857fc25940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:28:00.925 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:00.923+0000 7f5cb2e2c740 4 client.25894 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T04:28:00.925 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:00.923+0000 7f5cb2e2c740 1 -- 172.21.15.50:0/1465696639 --> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55857fb83ec0 con 0x55857f827d80 2024-08-31T04:28:00.925 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:00.923+0000 7f5ca9200640 1 --2- 172.21.15.50:0/1465696639 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x55857f827d80 0x55857fc25940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:28:00.926 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:00.925+0000 7f5c8aa00640 10 client.25894 ms_handle_connect on v2:172.21.15.133:6838/2526402262 2024-08-31T04:28:00.926 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:00.925+0000 7f5ca9200640 1 --2- 172.21.15.50:0/1465696639 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x55857f827d80 0x55857fc25940 crc :-1 s=READY pgs=90 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3eee835d3e2b9561 server_cookie=3dfcd64eccc122b8 in_seq=0 out_seq=0 2024-08-31T04:28:00.929 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:00.928+0000 7f5c8aa00640 1 -- 172.21.15.50:0/1465696639 <== mds.0 v2:172.21.15.133:6838/2526402262 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55857fb83ec0 con 0x55857f827d80 2024-08-31T04:28:00.929 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:00.928+0000 7f5c8aa00640 10 client.25894 handle_command_reply: tid=0 2024-08-31T04:28:00.929 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:00.928+0000 7f5cb2e2c740 1 client.25894 shutdown 2024-08-31T04:28:00.930 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:00.928+0000 7f5cb2e2c740 1 -- 172.21.15.50:0/1465696639 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55857f8484d0 msgr2=0x55857fc18bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:28:00.934 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:00.928+0000 7f5cb2e2c740 1 --2- 172.21.15.50:0/1465696639 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55857f8484d0 0x55857fc18bc0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f5c90000c00 tx=0x7f5c9000f670 comp rx=0 tx=0).stop 2024-08-31T04:28:00.934 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:00.929+0000 7f5cb2e2c740 1 -- 172.21.15.50:0/1465696639 shutdown_connections 2024-08-31T04:28:00.934 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:00.929+0000 7f5cb2e2c740 1 --2- 172.21.15.50:0/1465696639 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x55857f827d80 0x55857fc25940 crc :-1 s=READY pgs=90 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:00.934 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:00.929+0000 7f5cb2e2c740 1 --2- 172.21.15.50:0/1465696639 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55857f8484d0 0x55857fc18bc0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:00.934 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:00.929+0000 7f5cb2e2c740 1 --2- 172.21.15.50:0/1465696639 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55857f8691b0 0x55857fc19730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:00.935 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:00.929+0000 7f5cb2e2c740 1 --2- 172.21.15.50:0/1465696639 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55857f8402f0 0x55857fc18500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:00.935 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:00.929+0000 7f5cb2e2c740 1 -- 172.21.15.50:0/1465696639 >> 172.21.15.50:0/1465696639 conn(0x55857f85d300 msgr2=0x55857fc08cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:28:00.935 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:00.931+0000 7f5c8aa00640 0 client.25894 ms_handle_reset on v2:172.21.15.133:6838/2526402262 2024-08-31T04:28:00.935 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:00.933+0000 7f5cb2e2c740 1 -- 172.21.15.50:0/1465696639 shutdown_connections 2024-08-31T04:28:00.935 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:00.933+0000 7f5cb2e2c740 1 -- 172.21.15.50:0/1465696639 wait complete. 2024-08-31T04:28:00.935 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:00.933+0000 7f5cb2e2c740 20 client.25894 trim_cache size 0 max 16384 2024-08-31T04:28:00.998 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:00.996+0000 7f5cb2e2c740 1 Processor -- start 2024-08-31T04:28:00.998 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:00.996+0000 7f5cb2e2c740 1 -- start start 2024-08-31T04:28:00.998 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:00.996+0000 7f5cb2e2c740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55857f8402f0 0x55857fc0a190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:28:00.998 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:00.997+0000 7f5cb2e2c740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55857f8484d0 0x55857fc17700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:28:00.999 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:00.997+0000 7f5ca9200640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55857f8402f0 0x55857fc0a190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:28:01.000 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:00.997+0000 7f5cb2e2c740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55857f8691b0 0x55857fc17c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:28:01.000 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:00.997+0000 7f5ca3e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55857f8484d0 0x55857fc17700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:28:01.000 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:00.997+0000 7f5cb2e2c740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f5c8400e430 con 0x55857f8484d0 2024-08-31T04:28:01.000 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:00.997+0000 7f5cb2e2c740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f5c84010030 con 0x55857f8691b0 2024-08-31T04:28:01.003 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:00.997+0000 7f5ca3e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55857f8484d0 0x55857fc17700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:56010/0 (socket says 172.21.15.50:56010) 2024-08-31T04:28:01.003 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:00.997+0000 7f5ca3e00640 1 -- 172.21.15.50:0/1852279918 learned_addr learned my addr 172.21.15.50:0/1852279918 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:28:01.003 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:00.997+0000 7f5cb2e2c740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f5c8400eb00 con 0x55857f8402f0 2024-08-31T04:28:01.003 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:00.997+0000 7f5ca9c00640 1 --2- 172.21.15.50:0/1852279918 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55857f8691b0 0x55857fc17c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:28:01.004 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:00.998+0000 7f5ca9c00640 1 -- 172.21.15.50:0/1852279918 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55857f8402f0 msgr2=0x55857fc0a190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:28:01.004 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:00.998+0000 7f5ca9c00640 1 --2- 172.21.15.50:0/1852279918 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55857f8402f0 0x55857fc0a190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:01.004 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:00.998+0000 7f5ca9c00640 1 -- 172.21.15.50:0/1852279918 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55857f8484d0 msgr2=0x55857fc17700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:28:01.004 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:00.998+0000 7f5ca9c00640 1 --2- 172.21.15.50:0/1852279918 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55857f8484d0 0x55857fc17700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:01.004 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:00.998+0000 7f5ca9c00640 1 -- 172.21.15.50:0/1852279918 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55857fc209d0 con 0x55857f8691b0 2024-08-31T04:28:01.004 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:00.998+0000 7f5ca3e00640 1 --2- 172.21.15.50:0/1852279918 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55857f8484d0 0x55857fc17700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:28:01.004 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:00.999+0000 7f5ca9200640 1 --2- 172.21.15.50:0/1852279918 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55857f8402f0 0x55857fc0a190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T04:28:01.004 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:00.999+0000 7f5ca9c00640 1 --2- 172.21.15.50:0/1852279918 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55857f8691b0 0x55857fc17c40 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f5c9c005fd0 tx=0x7f5c9c013000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=83e3831b8bdd4b47 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:28:01.004 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:01.000+0000 7f5c95600640 1 -- 172.21.15.50:0/1852279918 <== mon.2 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c9c024070 con 0x55857f8691b0 2024-08-31T04:28:01.005 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:01.000+0000 7f5c95600640 1 -- 172.21.15.50:0/1852279918 <== mon.2 v2:172.21.15.133:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5c9c011bd0 con 0x55857f8691b0 2024-08-31T04:28:01.005 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:01.000+0000 7f5c95600640 1 -- 172.21.15.50:0/1852279918 <== mon.2 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c9c020de0 con 0x55857f8691b0 2024-08-31T04:28:01.005 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:01.001+0000 7f5cb2e2c740 1 -- 172.21.15.50:0/1852279918 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55857f8691b0 msgr2=0x55857fc17c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:28:01.005 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:01.001+0000 7f5cb2e2c740 1 --2- 172.21.15.50:0/1852279918 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55857f8691b0 0x55857fc17c40 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f5c9c005fd0 tx=0x7f5c9c013000 comp rx=0 tx=0).stop 2024-08-31T04:28:01.005 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:01.002+0000 7f5cb2e2c740 1 -- 172.21.15.50:0/1852279918 shutdown_connections 2024-08-31T04:28:01.005 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:01.002+0000 7f5cb2e2c740 1 --2- 172.21.15.50:0/1852279918 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55857f8691b0 0x55857fc17c40 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:01.005 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:01.002+0000 7f5cb2e2c740 1 --2- 172.21.15.50:0/1852279918 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55857f8484d0 0x55857fc17700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:01.005 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:01.002+0000 7f5cb2e2c740 1 --2- 172.21.15.50:0/1852279918 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55857f8402f0 0x55857fc0a190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:01.005 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:01.002+0000 7f5cb2e2c740 1 -- 172.21.15.50:0/1852279918 >> 172.21.15.50:0/1852279918 conn(0x55857f85d300 msgr2=0x55857fc19c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:28:01.006 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:01.002+0000 7f5cb2e2c740 1 -- 172.21.15.50:0/1852279918 shutdown_connections 2024-08-31T04:28:01.006 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:01.002+0000 7f5cb2e2c740 1 -- 172.21.15.50:0/1852279918 wait complete. 2024-08-31T04:28:01.006 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:01.003+0000 7f5cb2e2c740 1 -- start start 2024-08-31T04:28:01.006 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:01.003+0000 7f5cb2e2c740 1 Processor -- start 2024-08-31T04:28:01.006 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:01.004+0000 7f5cb2e2c740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55857f8402f0 0x55857fc1f550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:28:01.006 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:01.004+0000 7f5cb2e2c740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55857f8484d0 0x55857fc1fad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:28:01.007 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:01.005+0000 7f5ca3e00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55857f8484d0 0x55857fc1fad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:28:01.007 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:01.005+0000 7f5cb2e2c740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55857f8691b0 0x55857fc1e110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:28:01.007 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:01.005+0000 7f5ca3e00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55857f8484d0 0x55857fc1fad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.50:59446/0 (socket says 172.21.15.50:59446) 2024-08-31T04:28:01.007 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:01.005+0000 7f5ca9200640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55857f8402f0 0x55857fc1f550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:28:01.007 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:01.006+0000 7f5cb2e2c740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f5c8400f960 con 0x55857f8402f0 2024-08-31T04:28:01.008 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:01.006+0000 7f5ca9200640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55857f8402f0 0x55857fc1f550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:56014/0 (socket says 172.21.15.50:56014) 2024-08-31T04:28:01.008 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:01.006+0000 7f5ca9c00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55857f8691b0 0x55857fc1e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:28:01.008 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:01.006+0000 7f5ca9200640 1 -- 172.21.15.50:0/4180168136 learned_addr learned my addr 172.21.15.50:0/4180168136 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:28:01.008 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:01.006+0000 7f5cb2e2c740 1 -- 172.21.15.50:0/4180168136 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f5c8400f1d0 con 0x55857f8484d0 2024-08-31T04:28:01.008 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:01.006+0000 7f5cb2e2c740 1 -- 172.21.15.50:0/4180168136 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f5c8400c410 con 0x55857f8691b0 2024-08-31T04:28:01.009 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:01.006+0000 7f5cb2e2c740 10 client.0 _ll_register_callbacks cb 0x7f5c90004500 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:28:01.009 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:01.007+0000 7f5ca9c00640 1 -- 172.21.15.50:0/4180168136 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55857f8484d0 msgr2=0x55857fc1fad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:28:01.009 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:01.007+0000 7f5ca9c00640 1 --2- 172.21.15.50:0/4180168136 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55857f8484d0 0x55857fc1fad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:01.009 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:01.007+0000 7f5ca9c00640 1 -- 172.21.15.50:0/4180168136 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55857f8402f0 msgr2=0x55857fc1f550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:28:01.009 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:01.007+0000 7f5ca9c00640 1 --2- 172.21.15.50:0/4180168136 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55857f8402f0 0x55857fc1f550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:01.009 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:01.007+0000 7f5ca9c00640 1 -- 172.21.15.50:0/4180168136 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55857fc1e650 con 0x55857f8691b0 2024-08-31T04:28:01.010 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:01.007+0000 7f5ca9200640 1 --2- 172.21.15.50:0/4180168136 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55857f8402f0 0x55857fc1f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:28:01.010 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:01.008+0000 7f5ca9c00640 1 --2- 172.21.15.50:0/4180168136 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55857f8691b0 0x55857fc1e110 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f5c9c005fd0 tx=0x7f5c9c009dc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=299c0b2e60d4b4ec server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:28:01.010 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:01.008+0000 7f5c8aa00640 10 client.0 ms_handle_connect on v2:172.21.15.177:3300/0 2024-08-31T04:28:01.010 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:01.008+0000 7f5c8aa00640 1 -- 172.21.15.50:0/4180168136 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c9c038060 con 0x55857f8691b0 2024-08-31T04:28:01.010 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:01.008+0000 7f5cb2e2c740 1 -- 172.21.15.50:0/4180168136 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5c9c011bd0 con 0x55857f8691b0 2024-08-31T04:28:01.011 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:01.008+0000 7f5c8aa00640 1 -- 172.21.15.50:0/4180168136 <== mon.1 v2:172.21.15.177:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8219+0+0 (secure 0 0 0) 0x7f5c9c020670 con 0x55857f8691b0 2024-08-31T04:28:01.011 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:01.009+0000 7f5c8aa00640 1 -- 172.21.15.50:0/4180168136 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f5c9c024050 con 0x55857f8691b0 2024-08-31T04:28:01.011 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:01.009+0000 7f5cb2e2c740 10 client.25897 fetch_fsmap learned FSMap version 33 2024-08-31T04:28:01.011 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:01.009+0000 7f5cb2e2c740 1 -- 172.21.15.50:0/4180168136 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x55857fc909a0 con 0x55857f8691b0 2024-08-31T04:28:01.012 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:01.011+0000 7f5c8aa00640 1 -- 172.21.15.50:0/4180168136 <== mon.1 v2:172.21.15.177:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5c9c011bd0 con 0x55857f8691b0 2024-08-31T04:28:01.014 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:01.011+0000 7f5c8aa00640 1 -- 172.21.15.50:0/4180168136 <== mon.1 v2:172.21.15.177:3300/0 5 ==== fsmap(e 33) ==== 8378+0+0 (secure 0 0 0) 0x7f5c9c00f040 con 0x55857f8691b0 2024-08-31T04:28:01.014 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:01.011+0000 7f5cb2e2c740 10 client.25897 fetch_fsmap finished waiting for FSMap version 33 2024-08-31T04:28:01.014 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:01.011+0000 7f5cb2e2c740 10 client.25897 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T04:28:01.014 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:01.011+0000 7f5cb2e2c740 20 client.25897 populate_metadata read hostname 'smithi050' 2024-08-31T04:28:01.014 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:01.011+0000 7f5cb2e2c740 1 --2- 172.21.15.50:0/4180168136 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x55857f7fd1c0 0x55857fc93420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:28:01.014 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:01.011+0000 7f5cb2e2c740 4 client.25897 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-31T04:28:01.014 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:01.011+0000 7f5cb2e2c740 1 -- 172.21.15.50:0/4180168136 --> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55857fb7f960 con 0x55857f7fd1c0 2024-08-31T04:28:01.014 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:01.012+0000 7f5ca9200640 1 --2- 172.21.15.50:0/4180168136 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x55857f7fd1c0 0x55857fc93420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:28:01.015 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:01.012+0000 7f5c8aa00640 10 client.25897 ms_handle_connect on v2:172.21.15.133:6838/2526402262 2024-08-31T04:28:01.015 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:01.012+0000 7f5ca9200640 1 --2- 172.21.15.50:0/4180168136 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x55857f7fd1c0 0x55857fc93420 crc :-1 s=READY pgs=91 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7e33a64be908bfaa server_cookie=4d55fdb8dbb25867 in_seq=0 out_seq=0 2024-08-31T04:28:01.451 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:28:01 smithi050 ceph-mon[17259]: pgmap v521: 97 pgs: 97 active+clean; 636 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 5.1 MiB/s wr, 269 op/s 2024-08-31T04:28:01.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:28:01 smithi177 ceph-mon[22025]: pgmap v521: 97 pgs: 97 active+clean; 636 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 5.1 MiB/s wr, 269 op/s 2024-08-31T04:28:01.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:28:01 smithi133 ceph-mon[22177]: pgmap v521: 97 pgs: 97 active+clean; 636 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 5.1 MiB/s wr, 269 op/s 2024-08-31T04:28:02.063 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:02.061+0000 7f5c8aa00640 1 -- 172.21.15.50:0/4180168136 <== mds.0 v2:172.21.15.133:6838/2526402262 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55857fb7f960 con 0x55857f7fd1c0 2024-08-31T04:28:02.064 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:02.061+0000 7f5c8aa00640 10 client.25897 handle_command_reply: tid=0 2024-08-31T04:28:02.064 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:02.061+0000 7f5cb2e2c740 1 client.25897 shutdown 2024-08-31T04:28:02.064 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:02.062+0000 7f5cb2e2c740 1 -- 172.21.15.50:0/4180168136 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55857f8691b0 msgr2=0x55857fc1e110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:28:02.064 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:02.062+0000 7f5cb2e2c740 1 --2- 172.21.15.50:0/4180168136 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55857f8691b0 0x55857fc1e110 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f5c9c005fd0 tx=0x7f5c9c009dc0 comp rx=0 tx=0).stop 2024-08-31T04:28:02.064 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:02.062+0000 7f5cb2e2c740 1 -- 172.21.15.50:0/4180168136 shutdown_connections 2024-08-31T04:28:02.064 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:02.062+0000 7f5cb2e2c740 1 --2- 172.21.15.50:0/4180168136 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x55857f7fd1c0 0x55857fc93420 crc :-1 s=READY pgs=91 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:02.064 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:02.062+0000 7f5cb2e2c740 1 --2- 172.21.15.50:0/4180168136 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55857f8691b0 0x55857fc1e110 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:02.064 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:02.062+0000 7f5cb2e2c740 1 --2- 172.21.15.50:0/4180168136 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55857f8484d0 0x55857fc1fad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:02.064 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:02.062+0000 7f5c8aa00640 0 client.25897 ms_handle_reset on v2:172.21.15.133:6838/2526402262 2024-08-31T04:28:02.064 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:02.062+0000 7f5cb2e2c740 1 --2- 172.21.15.50:0/4180168136 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55857f8402f0 0x55857fc1f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:02.064 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:02.062+0000 7f5cb2e2c740 1 -- 172.21.15.50:0/4180168136 >> 172.21.15.50:0/4180168136 conn(0x55857f85d300 msgr2=0x55857fc17700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:28:02.065 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:02.062+0000 7f5cb2e2c740 1 -- 172.21.15.50:0/4180168136 shutdown_connections 2024-08-31T04:28:02.065 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:02.062+0000 7f5cb2e2c740 1 -- 172.21.15.50:0/4180168136 wait complete. 2024-08-31T04:28:02.065 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:02.062+0000 7f5cb2e2c740 20 client.25897 trim_cache size 0 max 16384 2024-08-31T04:28:02.065 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout:{ 2024-08-31T04:28:02.065 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout: "message": "", 2024-08-31T04:28:02.066 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout: "return_code": 0 2024-08-31T04:28:02.066 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout:} 2024-08-31T04:28:02.066 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:02.063+0000 7f5cabc00640 1 -- 172.21.15.50:0/1755592755 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f5c8c0b4c30 msgr2=0x7f5c8c0b7140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:28:02.066 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:02.063+0000 7f5cabc00640 1 --2- 172.21.15.50:0/1755592755 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f5c8c0b4c30 0x7f5c8c0b7140 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f5c9c005c40 tx=0x7f5c9c005bd0 comp rx=0 tx=0).stop 2024-08-31T04:28:02.066 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:02.063+0000 7f5cabc00640 1 -- 172.21.15.50:0/1755592755 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5ca4075a90 msgr2=0x7f5ca41a02e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:28:02.067 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:02.063+0000 7f5cabc00640 1 --2- 172.21.15.50:0/1755592755 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5ca4075a90 0x7f5ca41a02e0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f5c98009850 tx=0x7f5c980042f0 comp rx=0 tx=0).stop 2024-08-31T04:28:02.067 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:02.063+0000 7f5cabc00640 1 -- 172.21.15.50:0/1755592755 shutdown_connections 2024-08-31T04:28:02.067 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:02.063+0000 7f5cabc00640 1 --2- 172.21.15.50:0/1755592755 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f5c8c0b4c30 0x7f5c8c0b7140 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:02.067 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:02.063+0000 7f5cabc00640 1 --2- 172.21.15.50:0/1755592755 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5ca410fbe0 0x7f5ca41a1500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:02.067 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:02.063+0000 7f5cabc00640 1 --2- 172.21.15.50:0/1755592755 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5ca4076e90 0x7f5ca41a0950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:02.067 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:02.063+0000 7f5cabc00640 1 --2- 172.21.15.50:0/1755592755 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5ca4075a90 0x7f5ca41a02e0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:02.067 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:02.063+0000 7f5cabc00640 1 -- 172.21.15.50:0/1755592755 >> 172.21.15.50:0/1755592755 conn(0x7f5ca40fedc0 msgr2=0x7f5ca4102e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:28:02.067 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:02.064+0000 7f5cabc00640 1 -- 172.21.15.50:0/1755592755 shutdown_connections 2024-08-31T04:28:02.068 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:02.064+0000 7f5cabc00640 1 -- 172.21.15.50:0/1755592755 wait complete. 2024-08-31T04:28:03.450 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:28:03 smithi050 ceph-mon[17259]: pgmap v522: 97 pgs: 97 active+clean; 662 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 7.4 MiB/s wr, 388 op/s 2024-08-31T04:28:03.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:28:03 smithi177 ceph-mon[22025]: pgmap v522: 97 pgs: 97 active+clean; 662 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 7.4 MiB/s wr, 388 op/s 2024-08-31T04:28:03.542 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:28:03 smithi133 ceph-mon[22177]: pgmap v522: 97 pgs: 97 active+clean; 662 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 7.4 MiB/s wr, 388 op/s 2024-08-31T04:28:05.450 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:28:05 smithi050 ceph-mon[17259]: pgmap v523: 97 pgs: 97 active+clean; 667 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 7.7 MiB/s wr, 466 op/s 2024-08-31T04:28:05.451 INFO:tasks.workunit.client.0.smithi050.stdout: 240 333703 2328 230055 2827 80197 804 2024-08-31T04:28:05.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:28:05 smithi177 ceph-mon[22025]: pgmap v523: 97 pgs: 97 active+clean; 667 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 7.7 MiB/s wr, 466 op/s 2024-08-31T04:28:05.542 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:28:05 smithi133 ceph-mon[22177]: pgmap v523: 97 pgs: 97 active+clean; 667 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 7.7 MiB/s wr, 466 op/s 2024-08-31T04:28:07.450 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:28:07 smithi050 ceph-mon[17259]: pgmap v524: 97 pgs: 97 active+clean; 667 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 9.2 MiB/s wr, 814 op/s 2024-08-31T04:28:07.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:28:07 smithi177 ceph-mon[22025]: pgmap v524: 97 pgs: 97 active+clean; 667 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 9.2 MiB/s wr, 814 op/s 2024-08-31T04:28:07.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:28:07 smithi133 ceph-mon[22177]: pgmap v524: 97 pgs: 97 active+clean; 667 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 9.2 MiB/s wr, 814 op/s 2024-08-31T04:28:09.450 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:28:09 smithi050 ceph-mon[17259]: pgmap v525: 97 pgs: 97 active+clean; 666 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 6.1 MiB/s wr, 742 op/s 2024-08-31T04:28:09.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:28:09 smithi177 ceph-mon[22025]: pgmap v525: 97 pgs: 97 active+clean; 666 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 6.1 MiB/s wr, 742 op/s 2024-08-31T04:28:09.542 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:28:09 smithi133 ceph-mon[22177]: pgmap v525: 97 pgs: 97 active+clean; 666 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 6.1 MiB/s wr, 742 op/s 2024-08-31T04:28:11.482 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:28:11 smithi050 ceph-mon[17259]: pgmap v526: 97 pgs: 97 active+clean; 676 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 6.0 MiB/s wr, 720 op/s 2024-08-31T04:28:11.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:28:11 smithi177 ceph-mon[22025]: pgmap v526: 97 pgs: 97 active+clean; 676 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 6.0 MiB/s wr, 720 op/s 2024-08-31T04:28:11.542 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:28:11 smithi133 ceph-mon[22177]: pgmap v526: 97 pgs: 97 active+clean; 676 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 6.0 MiB/s wr, 720 op/s 2024-08-31T04:28:13.451 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:28:13 smithi050 ceph-mon[17259]: pgmap v527: 97 pgs: 97 active+clean; 707 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 8.2 MiB/s wr, 835 op/s 2024-08-31T04:28:13.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:28:13 smithi177 ceph-mon[22025]: pgmap v527: 97 pgs: 97 active+clean; 707 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 8.2 MiB/s wr, 835 op/s 2024-08-31T04:28:13.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:28:13 smithi133 ceph-mon[22177]: pgmap v527: 97 pgs: 97 active+clean; 707 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 8.2 MiB/s wr, 835 op/s 2024-08-31T04:28:15.454 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:28:15 smithi050 ceph-mon[17259]: pgmap v528: 97 pgs: 97 active+clean; 714 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 6.4 MiB/s wr, 737 op/s 2024-08-31T04:28:15.488 INFO:tasks.workunit.client.0.smithi050.stdout: 265 296204 1485 210633 1445 69457 920 2024-08-31T04:28:15.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:28:15 smithi177 ceph-mon[22025]: pgmap v528: 97 pgs: 97 active+clean; 714 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 6.4 MiB/s wr, 737 op/s 2024-08-31T04:28:15.542 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:28:15 smithi133 ceph-mon[22177]: pgmap v528: 97 pgs: 97 active+clean; 714 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 6.4 MiB/s wr, 737 op/s 2024-08-31T04:28:16.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:28:16 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T04:28:16.505 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:28:16 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T04:28:16.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:28:16 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T04:28:17.452 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:28:17 smithi050 ceph-mon[17259]: pgmap v529: 97 pgs: 97 active+clean; 744 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 8.6 MiB/s wr, 733 op/s 2024-08-31T04:28:17.542 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:28:17 smithi133 ceph-mon[22177]: pgmap v529: 97 pgs: 97 active+clean; 744 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 8.6 MiB/s wr, 733 op/s 2024-08-31T04:28:17.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:28:17 smithi177 ceph-mon[22025]: pgmap v529: 97 pgs: 97 active+clean; 744 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 8.6 MiB/s wr, 733 op/s 2024-08-31T04:28:18.781 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:18.778+0000 7fd858e00640 1 -- 172.21.15.50:0/1980217597 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd84c0a6580 msgr2=0x7fd84c0aaef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:28:18.781 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:18.779+0000 7fd858e00640 1 --2- 172.21.15.50:0/1980217597 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd84c0a6580 0x7fd84c0aaef0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fd854052250 tx=0x7fd8540a0bf0 comp rx=0 tx=0).stop 2024-08-31T04:28:18.796 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:18.791+0000 7fd858e00640 1 -- 172.21.15.50:0/1980217597 shutdown_connections 2024-08-31T04:28:18.796 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:18.791+0000 7fd858e00640 1 --2- 172.21.15.50:0/1980217597 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd84c0a6580 0x7fd84c0aaef0 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:18.796 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:18.791+0000 7fd858e00640 1 --2- 172.21.15.50:0/1980217597 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd84c0a5be0 0x7fd84c0a5ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:18.796 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:18.791+0000 7fd858e00640 1 --2- 172.21.15.50:0/1980217597 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd84c0a4cf0 0x7fd84c0a5160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:18.796 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:18.791+0000 7fd858e00640 1 -- 172.21.15.50:0/1980217597 >> 172.21.15.50:0/1980217597 conn(0x7fd84c0a0480 msgr2=0x7fd84c0a2930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:28:18.796 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:18.791+0000 7fd858e00640 1 -- 172.21.15.50:0/1980217597 shutdown_connections 2024-08-31T04:28:18.796 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:18.793+0000 7fd858e00640 1 -- 172.21.15.50:0/1980217597 wait complete. 2024-08-31T04:28:18.796 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:18.794+0000 7fd858e00640 1 Processor -- start 2024-08-31T04:28:18.797 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:18.795+0000 7fd858e00640 1 -- start start 2024-08-31T04:28:18.797 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:18.795+0000 7fd858e00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd84c0a4cf0 0x7fd84c13b510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:28:18.802 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:18.798+0000 7fd858e00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd84c0a5be0 0x7fd84c13bb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:28:18.802 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:18.798+0000 7fd858e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd84c0a6580 0x7fd84c13c730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:28:18.802 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:18.798+0000 7fd851e00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd84c0a4cf0 0x7fd84c13b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:28:18.802 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:18.798+0000 7fd851e00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd84c0a4cf0 0x7fd84c13b510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.50:36504/0 (socket says 172.21.15.50:36504) 2024-08-31T04:28:18.802 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:18.798+0000 7fd851400640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd84c0a5be0 0x7fd84c13bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:28:18.802 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:18.798+0000 7fd858e00640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fd84c0ae890 con 0x7fd84c0a6580 2024-08-31T04:28:18.802 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:18.798+0000 7fd858e00640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7fd84c0ae710 con 0x7fd84c0a4cf0 2024-08-31T04:28:18.802 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:18.798+0000 7fd858e00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fd84c0aea10 con 0x7fd84c0a5be0 2024-08-31T04:28:18.802 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:18.799+0000 7fd851400640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd84c0a5be0 0x7fd84c13bb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.50:54866/0 (socket says 172.21.15.50:54866) 2024-08-31T04:28:18.802 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:18.799+0000 7fd851400640 1 -- 172.21.15.50:0/1931196776 learned_addr learned my addr 172.21.15.50:0/1931196776 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:28:18.803 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:18.799+0000 7fd852800640 1 --2- 172.21.15.50:0/1931196776 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd84c0a6580 0x7fd84c13c730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:28:18.803 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:18.800+0000 7fd851e00640 1 -- 172.21.15.50:0/1931196776 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd84c0a5be0 msgr2=0x7fd84c13bb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:28:18.803 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:18.800+0000 7fd851e00640 1 --2- 172.21.15.50:0/1931196776 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd84c0a5be0 0x7fd84c13bb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:18.803 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:18.800+0000 7fd851e00640 1 -- 172.21.15.50:0/1931196776 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd84c0a6580 msgr2=0x7fd84c13c730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:28:18.803 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:18.800+0000 7fd851e00640 1 --2- 172.21.15.50:0/1931196776 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd84c0a6580 0x7fd84c13c730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:18.803 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:18.800+0000 7fd851e00640 1 -- 172.21.15.50:0/1931196776 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd84c13cf50 con 0x7fd84c0a4cf0 2024-08-31T04:28:18.804 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:18.801+0000 7fd851e00640 1 --2- 172.21.15.50:0/1931196776 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd84c0a4cf0 0x7fd84c13b510 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fd840009fd0 tx=0x7fd84000b870 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:28:18.805 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:18.803+0000 7fd84aa00640 1 -- 172.21.15.50:0/1931196776 <== mon.2 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd840015020 con 0x7fd84c0a4cf0 2024-08-31T04:28:18.806 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:18.803+0000 7fd84aa00640 1 -- 172.21.15.50:0/1931196776 <== mon.2 v2:172.21.15.133:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd840011ce0 con 0x7fd84c0a4cf0 2024-08-31T04:28:18.806 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:18.803+0000 7fd84aa00640 1 -- 172.21.15.50:0/1931196776 <== mon.2 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd840010e40 con 0x7fd84c0a4cf0 2024-08-31T04:28:18.806 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:18.805+0000 7fd858e00640 1 -- 172.21.15.50:0/1931196776 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd84c13d240 con 0x7fd84c0a4cf0 2024-08-31T04:28:18.807 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:18.806+0000 7fd858e00640 1 -- 172.21.15.50:0/1931196776 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd84c1437d0 con 0x7fd84c0a4cf0 2024-08-31T04:28:18.822 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:18.819+0000 7fd85fe56740 1 Processor -- start 2024-08-31T04:28:18.822 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:18.819+0000 7fd85fe56740 1 -- start start 2024-08-31T04:28:18.822 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:18.820+0000 7fd85fe56740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55afec1891b0 0x55afec52ed40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:28:18.822 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:18.820+0000 7fd852800640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55afec1891b0 0x55afec52ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:28:18.822 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:18.820+0000 7fd852800640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55afec1891b0 0x55afec52ed40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:43394/0 (socket says 172.21.15.50:43394) 2024-08-31T04:28:18.822 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:18.820+0000 7fd852800640 1 -- 172.21.15.50:0/2017480613 learned_addr learned my addr 172.21.15.50:0/2017480613 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:28:18.822 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:18.820+0000 7fd85fe56740 1 --2- 172.21.15.50:0/2017480613 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55afec1602f0 0x55afec52f3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:28:18.822 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:18.821+0000 7fd85fe56740 1 --2- 172.21.15.50:0/2017480613 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55afec1684d0 0x55afec52ff00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:28:18.828 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:18.821+0000 7fd84aa00640 1 -- 172.21.15.50:0/1931196776 <== mon.2 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 18) ==== 152577+0+0 (secure 0 0 0) 0x7fd840018020 con 0x7fd84c0a4cf0 2024-08-31T04:28:18.830 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:18.823+0000 7fd84aa00640 1 --2- 172.21.15.50:0/1931196776 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fd8380b4c30 0x7fd8380b7140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:28:18.830 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:18.824+0000 7fd84aa00640 1 -- 172.21.15.50:0/1931196776 <== mon.2 v2:172.21.15.133:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8219+0+0 (secure 0 0 0) 0x7fd8400e46a0 con 0x7fd84c0a4cf0 2024-08-31T04:28:18.830 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:18.824+0000 7fd85fe56740 1 -- 172.21.15.50:0/2017480613 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55afec4a1f70 con 0x55afec1891b0 2024-08-31T04:28:18.830 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:18.824+0000 7fd85fe56740 1 -- 172.21.15.50:0/2017480613 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x55afec491500 con 0x55afec1602f0 2024-08-31T04:28:18.830 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:18.824+0000 7fd85fe56740 1 -- 172.21.15.50:0/2017480613 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x55afec4954b0 con 0x55afec1684d0 2024-08-31T04:28:18.830 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:18.825+0000 7fd851400640 1 --2- 172.21.15.50:0/2017480613 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55afec1684d0 0x55afec52ff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:28:18.830 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:18.825+0000 7fd852800640 1 -- 172.21.15.50:0/2017480613 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55afec1684d0 msgr2=0x55afec52ff00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:28:18.830 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:18.825+0000 7fd852800640 1 --2- 172.21.15.50:0/2017480613 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55afec1684d0 0x55afec52ff00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:18.830 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:18.825+0000 7fd852800640 1 -- 172.21.15.50:0/2017480613 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55afec1602f0 msgr2=0x55afec52f3b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-31T04:28:18.830 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:18.825+0000 7fd852800640 1 --2- 172.21.15.50:0/2017480613 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55afec1602f0 0x55afec52f3b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:18.830 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:18.826+0000 7fd852800640 1 -- 172.21.15.50:0/2017480613 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55afec44bc10 con 0x55afec1891b0 2024-08-31T04:28:18.830 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:18.826+0000 7fd852800640 1 --2- 172.21.15.50:0/2017480613 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55afec1891b0 0x55afec52ed40 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fd854051780 tx=0x7fd854069240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1938aaa1c9b2945a server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:28:18.831 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:18.827+0000 7fd852800640 1 --2- 172.21.15.50:0/1931196776 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fd8380b4c30 0x7fd8380b7140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:28:18.831 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:18.829+0000 7fd83f400640 1 -- 172.21.15.50:0/2017480613 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8540a1dd0 con 0x55afec1891b0 2024-08-31T04:28:18.831 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:18.829+0000 7fd83f400640 1 -- 172.21.15.50:0/2017480613 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd8540b0040 con 0x55afec1891b0 2024-08-31T04:28:18.831 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:18.829+0000 7fd83f400640 1 -- 172.21.15.50:0/2017480613 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8540b4b20 con 0x55afec1891b0 2024-08-31T04:28:18.832 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:18.831+0000 7fd85fe56740 1 -- 172.21.15.50:0/2017480613 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55afec1891b0 msgr2=0x55afec52ed40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:28:18.832 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:18.831+0000 7fd85fe56740 1 --2- 172.21.15.50:0/2017480613 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55afec1891b0 0x55afec52ed40 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fd854051780 tx=0x7fd854069240 comp rx=0 tx=0).stop 2024-08-31T04:28:18.844 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:18.840+0000 7fd852800640 1 --2- 172.21.15.50:0/1931196776 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fd8380b4c30 0x7fd8380b7140 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fd8540a1110 tx=0x7fd8540c1000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:28:18.845 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:18.843+0000 7fd85fe56740 1 -- 172.21.15.50:0/2017480613 shutdown_connections 2024-08-31T04:28:18.845 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:18.843+0000 7fd85fe56740 1 --2- 172.21.15.50:0/2017480613 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55afec1684d0 0x55afec52ff00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:18.845 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:18.843+0000 7fd85fe56740 1 --2- 172.21.15.50:0/2017480613 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55afec1602f0 0x55afec52f3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:18.845 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:18.843+0000 7fd85fe56740 1 --2- 172.21.15.50:0/2017480613 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55afec1891b0 0x55afec52ed40 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:18.845 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:18.843+0000 7fd85fe56740 1 -- 172.21.15.50:0/2017480613 >> 172.21.15.50:0/2017480613 conn(0x55afec17d300 msgr2=0x55afec52a7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:28:18.848 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:18.846+0000 7fd85fe56740 1 -- 172.21.15.50:0/2017480613 shutdown_connections 2024-08-31T04:28:18.848 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:18.846+0000 7fd85fe56740 1 -- 172.21.15.50:0/2017480613 wait complete. 2024-08-31T04:28:18.848 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:18.847+0000 7fd85fe56740 1 -- start start 2024-08-31T04:28:18.848 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:18.847+0000 7fd85fe56740 1 Processor -- start 2024-08-31T04:28:18.849 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:18.848+0000 7fd85fe56740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55afec1602f0 0x55afec538470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:28:18.850 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:18.849+0000 7fd851e00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55afec1602f0 0x55afec538470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:28:18.850 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:18.849+0000 7fd851e00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55afec1602f0 0x55afec538470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.50:36514/0 (socket says 172.21.15.50:36514) 2024-08-31T04:28:18.850 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:18.849+0000 7fd85fe56740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55afec1684d0 0x55afec538b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:28:18.851 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:18.849+0000 7fd851e00640 1 -- 172.21.15.50:0/588449845 learned_addr learned my addr 172.21.15.50:0/588449845 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:28:18.851 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:18.849+0000 7fd85fe56740 1 --2- 172.21.15.50:0/588449845 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55afec1891b0 0x55afec5396a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:28:18.851 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:18.850+0000 7fd85fe56740 1 -- 172.21.15.50:0/588449845 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55afec3caab0 con 0x55afec1684d0 2024-08-31T04:28:18.852 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:18.850+0000 7fd852800640 1 --2- 172.21.15.50:0/588449845 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55afec1891b0 0x55afec5396a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:28:18.852 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:18.850+0000 7fd85fe56740 1 -- 172.21.15.50:0/588449845 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x55afec438320 con 0x55afec1602f0 2024-08-31T04:28:18.852 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:18.850+0000 7fd85fe56740 1 -- 172.21.15.50:0/588449845 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x55afec530a20 con 0x55afec1891b0 2024-08-31T04:28:18.853 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:18.851+0000 7fd852800640 1 -- 172.21.15.50:0/588449845 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55afec1602f0 msgr2=0x55afec538470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:28:18.860 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:18.851+0000 7fd852800640 1 --2- 172.21.15.50:0/588449845 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55afec1602f0 0x55afec538470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:18.860 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:18.851+0000 7fd852800640 1 -- 172.21.15.50:0/588449845 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55afec1684d0 msgr2=0x55afec538b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:28:18.860 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:18.851+0000 7fd852800640 1 --2- 172.21.15.50:0/588449845 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55afec1684d0 0x55afec538b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:18.861 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:18.851+0000 7fd852800640 1 -- 172.21.15.50:0/588449845 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55afec1f4790 con 0x55afec1891b0 2024-08-31T04:28:18.861 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:18.852+0000 7fd852800640 1 --2- 172.21.15.50:0/588449845 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55afec1891b0 0x55afec5396a0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fd854051780 tx=0x7fd854068b30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c0e86f053402fccf server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:28:18.861 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:18.852+0000 7fd833e00640 10 client.0 ms_handle_connect on v2:172.21.15.177:3300/0 2024-08-31T04:28:18.861 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:18.852+0000 7fd833e00640 1 -- 172.21.15.50:0/588449845 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8540a1dd0 con 0x55afec1891b0 2024-08-31T04:28:18.861 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:18.852+0000 7fd833e00640 1 -- 172.21.15.50:0/588449845 <== mon.1 v2:172.21.15.177:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8219+0+0 (secure 0 0 0) 0x7fd8540b4440 con 0x55afec1891b0 2024-08-31T04:28:18.861 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:18.852+0000 7fd833e00640 10 client.0 inactive, discarding osd_map(79..79 src has 1..79) 2024-08-31T04:28:18.861 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:18.853+0000 7fd85fe56740 10 client.0 _ll_register_callbacks cb 0x55afec471e80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:28:18.861 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:18.853+0000 7fd85fe56740 1 -- 172.21.15.50:0/588449845 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd8540b0040 con 0x55afec1891b0 2024-08-31T04:28:18.861 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:18.856+0000 7fd833e00640 1 -- 172.21.15.50:0/588449845 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7fd8540a29d0 con 0x55afec1891b0 2024-08-31T04:28:18.861 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:18.858+0000 7fd85fe56740 10 client.25906 fetch_fsmap learned FSMap version 33 2024-08-31T04:28:18.861 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:18.858+0000 7fd85fe56740 1 -- 172.21.15.50:0/588449845 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({fsmap=33}) -- 0x55afec26d620 con 0x55afec1891b0 2024-08-31T04:28:18.862 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:18.859+0000 7fd833e00640 1 -- 172.21.15.50:0/588449845 <== mon.1 v2:172.21.15.177:3300/0 4 ==== fsmap(e 33) ==== 8378+0+0 (secure 0 0 0) 0x7fd8540a2b70 con 0x55afec1891b0 2024-08-31T04:28:18.862 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:18.859+0000 7fd85fe56740 10 client.25906 fetch_fsmap finished waiting for FSMap version 33 2024-08-31T04:28:18.862 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:18.859+0000 7fd85fe56740 10 client.25906 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T04:28:18.862 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:18.859+0000 7fd85fe56740 20 client.25906 populate_metadata read hostname 'smithi050' 2024-08-31T04:28:18.862 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:18.859+0000 7fd85fe56740 1 --2- 172.21.15.50:0/588449845 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x55afec147d80 0x55afec545c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:28:18.862 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:18.859+0000 7fd85fe56740 4 client.25906 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T04:28:18.862 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:18.859+0000 7fd85fe56740 1 -- 172.21.15.50:0/588449845 --> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55afec4a3ec0 con 0x55afec147d80 2024-08-31T04:28:18.862 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:18.860+0000 7fd851e00640 1 --2- 172.21.15.50:0/588449845 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x55afec147d80 0x55afec545c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:28:18.863 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:18.862+0000 7fd851e00640 1 --2- 172.21.15.50:0/588449845 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x55afec147d80 0x55afec545c80 crc :-1 s=READY pgs=92 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fc22474e6c699cf4 server_cookie=8f7a2f2a7f76c080 in_seq=0 out_seq=0 2024-08-31T04:28:18.863 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:18.862+0000 7fd833e00640 10 client.25906 ms_handle_connect on v2:172.21.15.133:6838/2526402262 2024-08-31T04:28:18.864 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:18.863+0000 7fd833e00640 1 -- 172.21.15.50:0/588449845 <== mds.0 v2:172.21.15.133:6838/2526402262 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55afec4a3ec0 con 0x55afec147d80 2024-08-31T04:28:18.864 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:18.863+0000 7fd833e00640 10 client.25906 handle_command_reply: tid=0 2024-08-31T04:28:18.864 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:18.863+0000 7fd85fe56740 1 client.25906 shutdown 2024-08-31T04:28:18.865 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:18.864+0000 7fd85fe56740 1 -- 172.21.15.50:0/588449845 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55afec1891b0 msgr2=0x55afec5396a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:28:18.865 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:18.864+0000 7fd85fe56740 1 --2- 172.21.15.50:0/588449845 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55afec1891b0 0x55afec5396a0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fd854051780 tx=0x7fd854068b30 comp rx=0 tx=0).stop 2024-08-31T04:28:18.865 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:18.864+0000 7fd85fe56740 1 -- 172.21.15.50:0/588449845 shutdown_connections 2024-08-31T04:28:18.866 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:18.864+0000 7fd85fe56740 1 --2- 172.21.15.50:0/588449845 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x55afec147d80 0x55afec545c80 crc :-1 s=READY pgs=92 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:18.866 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:18.864+0000 7fd85fe56740 1 --2- 172.21.15.50:0/588449845 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55afec1891b0 0x55afec5396a0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:18.866 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:18.864+0000 7fd85fe56740 1 --2- 172.21.15.50:0/588449845 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55afec1684d0 0x55afec538b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:18.866 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:18.864+0000 7fd85fe56740 1 --2- 172.21.15.50:0/588449845 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55afec1602f0 0x55afec538470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:18.866 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:18.864+0000 7fd85fe56740 1 -- 172.21.15.50:0/588449845 >> 172.21.15.50:0/588449845 conn(0x55afec17d300 msgr2=0x55afec528d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:28:18.866 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:18.864+0000 7fd833e00640 0 client.25906 ms_handle_reset on v2:172.21.15.133:6838/2526402262 2024-08-31T04:28:18.866 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:18.865+0000 7fd85fe56740 1 -- 172.21.15.50:0/588449845 shutdown_connections 2024-08-31T04:28:18.867 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:18.865+0000 7fd85fe56740 1 -- 172.21.15.50:0/588449845 wait complete. 2024-08-31T04:28:18.867 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:18.865+0000 7fd85fe56740 20 client.25906 trim_cache size 0 max 16384 2024-08-31T04:28:18.899 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:18.898+0000 7fd85fe56740 1 Processor -- start 2024-08-31T04:28:18.899 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:18.898+0000 7fd85fe56740 1 -- start start 2024-08-31T04:28:18.900 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:18.899+0000 7fd85fe56740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55afec1602f0 0x55afec536980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:28:18.901 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:18.900+0000 7fd85fe56740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55afec1684d0 0x55afec536ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:28:18.902 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:18.900+0000 7fd85fe56740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55afec1891b0 0x55afec52afa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:28:18.902 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:18.900+0000 7fd851e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55afec1602f0 0x55afec536980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:28:18.902 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:18.900+0000 7fd851400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55afec1684d0 0x55afec536ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:28:18.902 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:18.900+0000 7fd851400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55afec1684d0 0x55afec536ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.50:36522/0 (socket says 172.21.15.50:36522) 2024-08-31T04:28:18.902 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:18.901+0000 7fd851400640 1 -- 172.21.15.50:0/366766887 learned_addr learned my addr 172.21.15.50:0/366766887 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:28:18.902 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:18.901+0000 7fd852800640 1 --2- 172.21.15.50:0/366766887 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55afec1891b0 0x55afec52afa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:28:18.903 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:18.901+0000 7fd85fe56740 1 -- 172.21.15.50:0/366766887 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fd84c14c460 con 0x55afec1602f0 2024-08-31T04:28:18.903 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:18.901+0000 7fd85fe56740 1 -- 172.21.15.50:0/366766887 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7fd84c14e060 con 0x55afec1684d0 2024-08-31T04:28:18.903 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:18.901+0000 7fd85fe56740 1 -- 172.21.15.50:0/366766887 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fd84c14cb30 con 0x55afec1891b0 2024-08-31T04:28:18.903 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:18.902+0000 7fd851400640 1 -- 172.21.15.50:0/366766887 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55afec1891b0 msgr2=0x55afec52afa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:28:18.904 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:18.902+0000 7fd851400640 1 --2- 172.21.15.50:0/366766887 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55afec1891b0 0x55afec52afa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:18.904 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:18.902+0000 7fd851400640 1 -- 172.21.15.50:0/366766887 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55afec1602f0 msgr2=0x55afec536980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:28:18.904 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:18.902+0000 7fd851400640 1 --2- 172.21.15.50:0/366766887 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55afec1602f0 0x55afec536980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:18.904 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:18.902+0000 7fd851400640 1 -- 172.21.15.50:0/366766887 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55afec539c00 con 0x55afec1684d0 2024-08-31T04:28:18.905 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:18.902+0000 7fd851e00640 1 --2- 172.21.15.50:0/366766887 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55afec1602f0 0x55afec536980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:28:18.905 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:18.903+0000 7fd851400640 1 --2- 172.21.15.50:0/366766887 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55afec1684d0 0x55afec536ec0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fd844009c40 tx=0x7fd844011690 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c5d350ef51830d7e server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:28:18.905 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:18.903+0000 7fd83ea00640 1 -- 172.21.15.50:0/366766887 <== mon.2 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd844011e40 con 0x55afec1684d0 2024-08-31T04:28:18.905 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:18.903+0000 7fd83ea00640 1 -- 172.21.15.50:0/366766887 <== mon.2 v2:172.21.15.133:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd8440148f0 con 0x55afec1684d0 2024-08-31T04:28:18.905 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:18.903+0000 7fd83ea00640 1 -- 172.21.15.50:0/366766887 <== mon.2 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd84401d8c0 con 0x55afec1684d0 2024-08-31T04:28:18.906 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:18.905+0000 7fd85fe56740 1 -- 172.21.15.50:0/366766887 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55afec1684d0 msgr2=0x55afec536ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:28:18.906 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:18.905+0000 7fd85fe56740 1 --2- 172.21.15.50:0/366766887 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55afec1684d0 0x55afec536ec0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fd844009c40 tx=0x7fd844011690 comp rx=0 tx=0).stop 2024-08-31T04:28:18.906 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:18.905+0000 7fd852800640 1 --2- 172.21.15.50:0/366766887 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55afec1891b0 0x55afec52afa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T04:28:18.907 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:18.905+0000 7fd85fe56740 1 -- 172.21.15.50:0/366766887 shutdown_connections 2024-08-31T04:28:18.907 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:18.905+0000 7fd85fe56740 1 --2- 172.21.15.50:0/366766887 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55afec1891b0 0x55afec52afa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:18.907 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:18.905+0000 7fd85fe56740 1 --2- 172.21.15.50:0/366766887 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55afec1684d0 0x55afec536ec0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:18.907 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:18.905+0000 7fd85fe56740 1 --2- 172.21.15.50:0/366766887 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55afec1602f0 0x55afec536980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:18.907 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:18.905+0000 7fd85fe56740 1 -- 172.21.15.50:0/366766887 >> 172.21.15.50:0/366766887 conn(0x55afec17d300 msgr2=0x55afec52a110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:28:18.907 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:18.906+0000 7fd85fe56740 1 -- 172.21.15.50:0/366766887 shutdown_connections 2024-08-31T04:28:18.908 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:18.906+0000 7fd85fe56740 1 -- 172.21.15.50:0/366766887 wait complete. 2024-08-31T04:28:18.917 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:18.915+0000 7fd85fe56740 1 -- start start 2024-08-31T04:28:18.917 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:18.915+0000 7fd85fe56740 1 Processor -- start 2024-08-31T04:28:18.925 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:18.917+0000 7fd85fe56740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55afec1602f0 0x55afec53d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:28:18.925 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:18.917+0000 7fd85fe56740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55afec1684d0 0x55afec53dd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:28:18.925 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:18.917+0000 7fd85fe56740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55afec1891b0 0x55afec53e880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:28:18.925 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:18.917+0000 7fd85fe56740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fd84c14d990 con 0x55afec1891b0 2024-08-31T04:28:18.925 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:18.917+0000 7fd85fe56740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7fd84c14d200 con 0x55afec1684d0 2024-08-31T04:28:18.925 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:18.917+0000 7fd85fe56740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fd84c14a3d0 con 0x55afec1602f0 2024-08-31T04:28:18.925 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:18.917+0000 7fd85fe56740 10 client.0 _ll_register_callbacks cb 0x7fd844009460 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:28:18.925 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:18.922+0000 7fd851e00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55afec1602f0 0x55afec53d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:28:18.925 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:18.922+0000 7fd851e00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55afec1602f0 0x55afec53d6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.50:54904/0 (socket says 172.21.15.50:54904) 2024-08-31T04:28:18.925 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:18.922+0000 7fd851e00640 1 -- 172.21.15.50:0/3497142771 learned_addr learned my addr 172.21.15.50:0/3497142771 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:28:18.925 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:18.922+0000 7fd851400640 1 --2- 172.21.15.50:0/3497142771 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55afec1684d0 0x55afec53dd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:28:18.926 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:18.923+0000 7fd851e00640 1 -- 172.21.15.50:0/3497142771 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55afec1684d0 msgr2=0x55afec53dd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:28:18.926 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:18.923+0000 7fd851e00640 1 --2- 172.21.15.50:0/3497142771 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55afec1684d0 0x55afec53dd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:18.926 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:18.923+0000 7fd851e00640 1 -- 172.21.15.50:0/3497142771 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55afec1891b0 msgr2=0x55afec53e880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:28:18.926 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:18.923+0000 7fd851e00640 1 --2- 172.21.15.50:0/3497142771 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55afec1891b0 0x55afec53e880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:18.927 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:18.923+0000 7fd851e00640 1 -- 172.21.15.50:0/3497142771 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55afec530900 con 0x55afec1602f0 2024-08-31T04:28:18.927 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:18.924+0000 7fd851e00640 1 --2- 172.21.15.50:0/3497142771 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55afec1602f0 0x55afec53d6a0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fd840006fd0 tx=0x7fd8400106c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=601325129182d9a4 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:28:18.927 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:18.924+0000 7fd833e00640 10 client.0 ms_handle_connect on v2:172.21.15.177:3300/0 2024-08-31T04:28:18.927 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:18.924+0000 7fd833e00640 1 -- 172.21.15.50:0/3497142771 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8400ab080 con 0x55afec1602f0 2024-08-31T04:28:18.927 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:18.924+0000 7fd833e00640 1 -- 172.21.15.50:0/3497142771 <== mon.1 v2:172.21.15.177:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8219+0+0 (secure 0 0 0) 0x7fd8400961c0 con 0x55afec1602f0 2024-08-31T04:28:18.927 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:18.924+0000 7fd85fe56740 1 -- 172.21.15.50:0/3497142771 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd8440148f0 con 0x55afec1602f0 2024-08-31T04:28:18.927 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:18.925+0000 7fd833e00640 1 -- 172.21.15.50:0/3497142771 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7fd8400af8f0 con 0x55afec1602f0 2024-08-31T04:28:18.927 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:18.925+0000 7fd85fe56740 10 client.25909 fetch_fsmap learned FSMap version 33 2024-08-31T04:28:18.927 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:18.925+0000 7fd85fe56740 1 -- 172.21.15.50:0/3497142771 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x55afec540140 con 0x55afec1602f0 2024-08-31T04:28:18.928 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:18.925+0000 7fd833e00640 1 -- 172.21.15.50:0/3497142771 <== mon.1 v2:172.21.15.177:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd8440148f0 con 0x55afec1602f0 2024-08-31T04:28:18.928 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:18.925+0000 7fd833e00640 1 -- 172.21.15.50:0/3497142771 <== mon.1 v2:172.21.15.177:3300/0 5 ==== fsmap(e 33) ==== 8378+0+0 (secure 0 0 0) 0x7fd840022060 con 0x55afec1602f0 2024-08-31T04:28:18.928 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:18.926+0000 7fd85fe56740 10 client.25909 fetch_fsmap finished waiting for FSMap version 33 2024-08-31T04:28:18.928 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:18.926+0000 7fd85fe56740 10 client.25909 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T04:28:18.928 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:18.926+0000 7fd85fe56740 20 client.25909 populate_metadata read hostname 'smithi050' 2024-08-31T04:28:18.928 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:18.926+0000 7fd85fe56740 1 --2- 172.21.15.50:0/3497142771 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x55afec11d1c0 0x55afec5b2820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:28:18.928 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:18.926+0000 7fd85fe56740 4 client.25909 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-31T04:28:18.928 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:18.926+0000 7fd85fe56740 1 -- 172.21.15.50:0/3497142771 --> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55afec49f960 con 0x55afec11d1c0 2024-08-31T04:28:18.929 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:18.926+0000 7fd851400640 1 --2- 172.21.15.50:0/3497142771 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x55afec11d1c0 0x55afec5b2820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:28:18.929 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:18.927+0000 7fd851400640 1 --2- 172.21.15.50:0/3497142771 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x55afec11d1c0 0x55afec5b2820 crc :-1 s=READY pgs=93 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cf0b1c07089113e3 server_cookie=9c906bcb28eab777 in_seq=0 out_seq=0 2024-08-31T04:28:18.929 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:18.927+0000 7fd833e00640 10 client.25909 ms_handle_connect on v2:172.21.15.133:6838/2526402262 2024-08-31T04:28:19.542 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:28:19 smithi133 ceph-mon[22177]: pgmap v530: 97 pgs: 97 active+clean; 783 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 10 MiB/s wr, 526 op/s 2024-08-31T04:28:19.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:28:19 smithi050 ceph-mon[17259]: pgmap v530: 97 pgs: 97 active+clean; 783 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 10 MiB/s wr, 526 op/s 2024-08-31T04:28:19.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:28:19 smithi177 ceph-mon[22025]: pgmap v530: 97 pgs: 97 active+clean; 783 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 10 MiB/s wr, 526 op/s 2024-08-31T04:28:21.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:28:21 smithi133 ceph-mon[22177]: pgmap v531: 97 pgs: 97 active+clean; 813 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 13 MiB/s wr, 577 op/s 2024-08-31T04:28:21.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:28:21 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:28:21.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:28:21 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T04:28:21.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:28:21 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:28:21.609 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:21.608+0000 7fd833e00640 1 -- 172.21.15.50:0/3497142771 <== mds.0 v2:172.21.15.133:6838/2526402262 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55afec49f960 con 0x55afec11d1c0 2024-08-31T04:28:21.610 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:21.608+0000 7fd833e00640 10 client.25909 handle_command_reply: tid=0 2024-08-31T04:28:21.610 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:21.608+0000 7fd85fe56740 1 client.25909 shutdown 2024-08-31T04:28:21.647 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:21.630+0000 7fd85fe56740 1 -- 172.21.15.50:0/3497142771 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55afec1602f0 msgr2=0x55afec53d6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:28:21.647 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:21.630+0000 7fd85fe56740 1 --2- 172.21.15.50:0/3497142771 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55afec1602f0 0x55afec53d6a0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fd840006fd0 tx=0x7fd8400106c0 comp rx=0 tx=0).stop 2024-08-31T04:28:21.647 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:21.634+0000 7fd85fe56740 1 -- 172.21.15.50:0/3497142771 shutdown_connections 2024-08-31T04:28:21.647 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:21.634+0000 7fd85fe56740 1 --2- 172.21.15.50:0/3497142771 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x55afec11d1c0 0x55afec5b2820 crc :-1 s=READY pgs=93 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:21.647 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:21.634+0000 7fd85fe56740 1 --2- 172.21.15.50:0/3497142771 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55afec1891b0 0x55afec53e880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:21.648 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:21.634+0000 7fd85fe56740 1 --2- 172.21.15.50:0/3497142771 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55afec1684d0 0x55afec53dd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:21.648 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:21.634+0000 7fd85fe56740 1 --2- 172.21.15.50:0/3497142771 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55afec1602f0 0x55afec53d6a0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:21.648 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:21.634+0000 7fd85fe56740 1 -- 172.21.15.50:0/3497142771 >> 172.21.15.50:0/3497142771 conn(0x55afec17d300 msgr2=0x55afec52a110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:28:21.648 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:21.642+0000 7fd833e00640 0 client.25909 ms_handle_reset on v2:172.21.15.133:6838/2526402262 2024-08-31T04:28:21.657 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:21.656+0000 7fd85fe56740 1 -- 172.21.15.50:0/3497142771 shutdown_connections 2024-08-31T04:28:21.658 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:21.657+0000 7fd85fe56740 1 -- 172.21.15.50:0/3497142771 wait complete. 2024-08-31T04:28:21.662 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:21.657+0000 7fd85fe56740 20 client.25909 trim_cache size 0 max 16384 2024-08-31T04:28:21.671 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout:{ 2024-08-31T04:28:21.672 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout: "message": "", 2024-08-31T04:28:21.672 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout: "return_code": 0 2024-08-31T04:28:21.672 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout:} 2024-08-31T04:28:21.688 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:21.687+0000 7fd858e00640 1 -- 172.21.15.50:0/1931196776 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fd8380b4c30 msgr2=0x7fd8380b7140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:28:21.688 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:21.687+0000 7fd858e00640 1 --2- 172.21.15.50:0/1931196776 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fd8380b4c30 0x7fd8380b7140 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fd8540a1110 tx=0x7fd8540c1000 comp rx=0 tx=0).stop 2024-08-31T04:28:21.688 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:21.687+0000 7fd858e00640 1 -- 172.21.15.50:0/1931196776 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd84c0a4cf0 msgr2=0x7fd84c13b510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:28:21.688 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:21.687+0000 7fd858e00640 1 --2- 172.21.15.50:0/1931196776 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd84c0a4cf0 0x7fd84c13b510 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fd840009fd0 tx=0x7fd84000b870 comp rx=0 tx=0).stop 2024-08-31T04:28:21.700 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:21.696+0000 7fd858e00640 1 -- 172.21.15.50:0/1931196776 shutdown_connections 2024-08-31T04:28:21.700 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:21.696+0000 7fd858e00640 1 --2- 172.21.15.50:0/1931196776 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fd8380b4c30 0x7fd8380b7140 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:21.700 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:21.696+0000 7fd858e00640 1 --2- 172.21.15.50:0/1931196776 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd84c0a5be0 0x7fd84c13bb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:21.700 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:21.697+0000 7fd858e00640 1 --2- 172.21.15.50:0/1931196776 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd84c0a6580 0x7fd84c13c730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:21.700 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:21.697+0000 7fd858e00640 1 --2- 172.21.15.50:0/1931196776 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd84c0a4cf0 0x7fd84c13b510 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:21.701 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:21.697+0000 7fd858e00640 1 -- 172.21.15.50:0/1931196776 >> 172.21.15.50:0/1931196776 conn(0x7fd84c0a0480 msgr2=0x7fd84c0a8ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:28:21.701 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:28:21 smithi050 ceph-mon[17259]: pgmap v531: 97 pgs: 97 active+clean; 813 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 13 MiB/s wr, 577 op/s 2024-08-31T04:28:21.701 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:28:21 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:28:21.701 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:28:21 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T04:28:21.701 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:28:21 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:28:21.705 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:21.704+0000 7fd858e00640 1 -- 172.21.15.50:0/1931196776 shutdown_connections 2024-08-31T04:28:21.705 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:21.704+0000 7fd858e00640 1 -- 172.21.15.50:0/1931196776 wait complete. 2024-08-31T04:28:21.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:28:21 smithi177 ceph-mon[22025]: pgmap v531: 97 pgs: 97 active+clean; 813 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 13 MiB/s wr, 577 op/s 2024-08-31T04:28:21.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:28:21 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:28:21.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:28:21 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T04:28:21.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:28:21 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:28:23.246 INFO:journalctl@ceph.mds.f.smithi177.stdout:Aug 31 04:28:22 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-mds-f[51911]: *** Caught signal (Segmentation fault) ** 2024-08-31T04:28:23.246 INFO:journalctl@ceph.mds.f.smithi177.stdout:Aug 31 04:28:22 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-mds-f[51911]: in thread 7f13bc1b1640 thread_name:MR_Finisher 2024-08-31T04:28:23.246 INFO:journalctl@ceph.mds.f.smithi177.stdout:Aug 31 04:28:22 smithi177 podman[55377]: 2024-08-31 04:28:22.869852873 +0000 UTC m=+0.018150027 container died edeac1f32f75a6a10ce7c7f6f5f58d12ab7cb2d157161dfb073d00bd8e523162 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-mds-f, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, io.buildah.version=1.37.1, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, ceph=True) 2024-08-31T04:28:23.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:28:23 smithi050 ceph-mon[17259]: pgmap v532: 97 pgs: 97 active+clean; 906 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 20 MiB/s wr, 1.06k op/s 2024-08-31T04:28:23.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:28:23 smithi177 ceph-mon[22025]: pgmap v532: 97 pgs: 97 active+clean; 906 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 20 MiB/s wr, 1.06k op/s 2024-08-31T04:28:23.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:28:23 smithi133 ceph-mon[22177]: pgmap v532: 97 pgs: 97 active+clean; 906 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 20 MiB/s wr, 1.06k op/s 2024-08-31T04:28:25.492 INFO:tasks.workunit.client.0.smithi050.stdout: 280 460458 768 317380 572 97722 124 2024-08-31T04:28:25.703 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:28:25 smithi050 ceph-mon[17259]: pgmap v533: 97 pgs: 97 active+clean; 907 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 17 MiB/s wr, 947 op/s 2024-08-31T04:28:25.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:28:25 smithi177 ceph-mon[22025]: pgmap v533: 97 pgs: 97 active+clean; 907 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 17 MiB/s wr, 947 op/s 2024-08-31T04:28:25.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:28:25 smithi133 ceph-mon[22177]: pgmap v533: 97 pgs: 97 active+clean; 907 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 17 MiB/s wr, 947 op/s 2024-08-31T04:28:27.683 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:28:27 smithi050 ceph-mon[17259]: pgmap v534: 97 pgs: 97 active+clean; 905 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 18 MiB/s wr, 1.04k op/s 2024-08-31T04:28:27.683 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:28:27 smithi050 ceph-mon[17259]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-31T04:28:27.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:28:27 smithi177 ceph-mon[22025]: pgmap v534: 97 pgs: 97 active+clean; 905 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 18 MiB/s wr, 1.04k op/s 2024-08-31T04:28:27.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:28:27 smithi177 ceph-mon[22025]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-31T04:28:27.746 INFO:journalctl@ceph.mds.f.smithi177.stdout:Aug 31 04:28:27 smithi177 podman[55377]: 2024-08-31 04:28:27.526293812 +0000 UTC m=+4.674590958 container remove edeac1f32f75a6a10ce7c7f6f5f58d12ab7cb2d157161dfb073d00bd8e523162 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-mds-f, io.buildah.version=1.37.1, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_CLEAN=True, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, maintainer=Guillaume Abrioux ) 2024-08-31T04:28:27.746 INFO:journalctl@ceph.mds.f.smithi177.stdout:Aug 31 04:28:27 smithi177 systemd[1]: ceph-058d9fc6-674f-11ef-bcd4-c7b262605968@mds.f.service: Main process exited, code=exited, status=139/n/a 2024-08-31T04:28:27.792 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:28:27 smithi133 ceph-mon[22177]: pgmap v534: 97 pgs: 97 active+clean; 905 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 18 MiB/s wr, 1.04k op/s 2024-08-31T04:28:27.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:28:27 smithi133 ceph-mon[22177]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-31T04:28:28.246 INFO:journalctl@ceph.mds.f.smithi177.stdout:Aug 31 04:28:27 smithi177 systemd[1]: ceph-058d9fc6-674f-11ef-bcd4-c7b262605968@mds.f.service: Failed with result 'exit-code'. 2024-08-31T04:28:28.246 INFO:journalctl@ceph.mds.f.smithi177.stdout:Aug 31 04:28:27 smithi177 systemd[1]: ceph-058d9fc6-674f-11ef-bcd4-c7b262605968@mds.f.service: Consumed 16.148s CPU time. 2024-08-31T04:28:29.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:28:29 smithi050 ceph-mon[17259]: pgmap v535: 97 pgs: 97 active+clean; 905 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 15 MiB/s wr, 952 op/s 2024-08-31T04:28:29.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:28:29 smithi177 ceph-mon[22025]: pgmap v535: 97 pgs: 97 active+clean; 905 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 15 MiB/s wr, 952 op/s 2024-08-31T04:28:29.792 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:28:29 smithi133 ceph-mon[22177]: pgmap v535: 97 pgs: 97 active+clean; 905 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 15 MiB/s wr, 952 op/s 2024-08-31T04:28:31.701 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:28:31 smithi050 ceph-mon[17259]: pgmap v536: 97 pgs: 97 active+clean; 905 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 12 MiB/s wr, 810 op/s 2024-08-31T04:28:31.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:28:31 smithi177 ceph-mon[22025]: pgmap v536: 97 pgs: 97 active+clean; 905 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 12 MiB/s wr, 810 op/s 2024-08-31T04:28:31.792 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:28:31 smithi133 ceph-mon[22177]: pgmap v536: 97 pgs: 97 active+clean; 905 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 12 MiB/s wr, 810 op/s 2024-08-31T04:28:32.701 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:28:32 smithi050 ceph-mon[17259]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-31T04:28:32.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:28:32 smithi177 ceph-mon[22025]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-31T04:28:32.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:28:32 smithi133 ceph-mon[22177]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-31T04:28:33.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:28:33 smithi050 ceph-mon[17259]: pgmap v537: 97 pgs: 97 active+clean; 914 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 10 MiB/s wr, 751 op/s 2024-08-31T04:28:33.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:28:33 smithi177 ceph-mon[22025]: pgmap v537: 97 pgs: 97 active+clean; 914 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 10 MiB/s wr, 751 op/s 2024-08-31T04:28:33.792 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:28:33 smithi133 ceph-mon[22177]: pgmap v537: 97 pgs: 97 active+clean; 914 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 10 MiB/s wr, 751 op/s 2024-08-31T04:28:35.503 INFO:tasks.workunit.client.0.smithi050.stdout: 309 580501 1363 397094 1449 123933 772 2024-08-31T04:28:35.707 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:28:35 smithi050 ceph-mon[17259]: pgmap v538: 97 pgs: 97 active+clean; 916 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 2.5 MiB/s wr, 245 op/s 2024-08-31T04:28:35.707 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:28:35 smithi050 ceph-mon[17259]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-31T04:28:35.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:28:35 smithi177 ceph-mon[22025]: pgmap v538: 97 pgs: 97 active+clean; 916 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 2.5 MiB/s wr, 245 op/s 2024-08-31T04:28:35.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:28:35 smithi177 ceph-mon[22025]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-31T04:28:35.792 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:28:35 smithi133 ceph-mon[22177]: pgmap v538: 97 pgs: 97 active+clean; 916 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 2.5 MiB/s wr, 245 op/s 2024-08-31T04:28:35.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:28:35 smithi133 ceph-mon[22177]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-31T04:28:36.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:28:36 smithi050 ceph-mon[17259]: MDS daemon mds.f is removed because it is dead or otherwise unavailable. 2024-08-31T04:28:36.701 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:28:36 smithi050 ceph-mon[17259]: fsmap cephfs:5 5 up:standby-replay 1 up:standby 5 up:active 2024-08-31T04:28:36.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:28:36 smithi177 ceph-mon[22025]: MDS daemon mds.f is removed because it is dead or otherwise unavailable. 2024-08-31T04:28:36.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:28:36 smithi177 ceph-mon[22025]: fsmap cephfs:5 5 up:standby-replay 1 up:standby 5 up:active 2024-08-31T04:28:36.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:28:36 smithi133 ceph-mon[22177]: MDS daemon mds.f is removed because it is dead or otherwise unavailable. 2024-08-31T04:28:36.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:28:36 smithi133 ceph-mon[22177]: fsmap cephfs:5 5 up:standby-replay 1 up:standby 5 up:active 2024-08-31T04:28:37.721 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:28:37 smithi050 ceph-mon[17259]: pgmap v539: 97 pgs: 97 active+clean; 944 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 5.0 MiB/s wr, 349 op/s 2024-08-31T04:28:37.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:28:37 smithi177 ceph-mon[22025]: pgmap v539: 97 pgs: 97 active+clean; 944 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 5.0 MiB/s wr, 349 op/s 2024-08-31T04:28:37.792 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:28:37 smithi133 ceph-mon[22177]: pgmap v539: 97 pgs: 97 active+clean; 944 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 5.0 MiB/s wr, 349 op/s 2024-08-31T04:28:38.275 INFO:journalctl@ceph.mds.f.smithi177.stdout:Aug 31 04:28:37 smithi177 systemd[1]: ceph-058d9fc6-674f-11ef-bcd4-c7b262605968@mds.f.service: Scheduled restart job, restart counter is at 1. 2024-08-31T04:28:38.276 INFO:journalctl@ceph.mds.f.smithi177.stdout:Aug 31 04:28:37 smithi177 systemd[1]: Stopped Ceph mds.f for 058d9fc6-674f-11ef-bcd4-c7b262605968. 2024-08-31T04:28:38.276 INFO:journalctl@ceph.mds.f.smithi177.stdout:Aug 31 04:28:37 smithi177 systemd[1]: ceph-058d9fc6-674f-11ef-bcd4-c7b262605968@mds.f.service: Consumed 16.148s CPU time. 2024-08-31T04:28:38.276 INFO:journalctl@ceph.mds.f.smithi177.stdout:Aug 31 04:28:38 smithi177 systemd[1]: Starting Ceph mds.f for 058d9fc6-674f-11ef-bcd4-c7b262605968... 2024-08-31T04:28:38.746 INFO:journalctl@ceph.mds.f.smithi177.stdout:Aug 31 04:28:38 smithi177 podman[55473]: 2024-08-31 04:28:38.18025743 +0000 UTC m=+0.024289992 image pull 79f4cde5e36911a5dca995eeb98098c2c8aae81dd52a088ef2c867bc3363bad0 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61 2024-08-31T04:28:39.701 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:28:39 smithi050 ceph-mon[17259]: pgmap v540: 97 pgs: 97 active+clean; 956 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 5.2 MiB/s wr, 288 op/s 2024-08-31T04:28:39.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:28:39 smithi177 ceph-mon[22025]: pgmap v540: 97 pgs: 97 active+clean; 956 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 5.2 MiB/s wr, 288 op/s 2024-08-31T04:28:39.746 INFO:journalctl@ceph.mds.f.smithi177.stdout:Aug 31 04:28:39 smithi177 podman[55473]: 2024-08-31 04:28:39.419520567 +0000 UTC m=+1.263553119 container create a7ae3a81cc5d1dc958fe33ad202dd0bfac1ac15a5dc8a55b47a3c2d8984ce527 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-mds-f, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, ceph=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.1, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0) 2024-08-31T04:28:39.792 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:28:39 smithi133 ceph-mon[22177]: pgmap v540: 97 pgs: 97 active+clean; 956 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 5.2 MiB/s wr, 288 op/s 2024-08-31T04:28:40.437 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:28:40 smithi050 ceph-mon[17259]: fsmap cephfs:5 5 up:standby-replay 1 up:standby 5 up:active 2024-08-31T04:28:40.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:28:40 smithi177 ceph-mon[22025]: fsmap cephfs:5 5 up:standby-replay 1 up:standby 5 up:active 2024-08-31T04:28:40.792 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:28:40 smithi133 ceph-mon[22177]: fsmap cephfs:5 5 up:standby-replay 1 up:standby 5 up:active 2024-08-31T04:28:41.173 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:41.163+0000 7fe2b3200640 1 -- 172.21.15.50:0/2877192136 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe2b410aab0 msgr2=0x7fe2b41114a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:28:41.173 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:41.163+0000 7fe2b3200640 1 --2- 172.21.15.50:0/2877192136 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe2b410aab0 0x7fe2b41114a0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fe2a00098b0 tx=0x7fe2a002a3d0 comp rx=0 tx=0).stop 2024-08-31T04:28:41.201 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:41.200+0000 7fe2b3200640 1 -- 172.21.15.50:0/2877192136 shutdown_connections 2024-08-31T04:28:41.201 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:41.200+0000 7fe2b3200640 1 --2- 172.21.15.50:0/2877192136 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe2b41119e0 0x7fe2b4113e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:41.201 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:41.200+0000 7fe2b3200640 1 --2- 172.21.15.50:0/2877192136 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe2b410aab0 0x7fe2b41114a0 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:41.201 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:41.200+0000 7fe2b3200640 1 --2- 172.21.15.50:0/2877192136 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe2b410a160 0x7fe2b410a570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:41.201 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:41.200+0000 7fe2b3200640 1 -- 172.21.15.50:0/2877192136 >> 172.21.15.50:0/2877192136 conn(0x7fe2b40703e0 msgr2=0x7fe2b4072890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:28:41.202 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:41.200+0000 7fe2b3200640 1 -- 172.21.15.50:0/2877192136 shutdown_connections 2024-08-31T04:28:41.202 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:41.200+0000 7fe2b3200640 1 -- 172.21.15.50:0/2877192136 wait complete. 2024-08-31T04:28:41.205 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:41.203+0000 7fe2b3200640 1 Processor -- start 2024-08-31T04:28:41.214 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:41.208+0000 7fe2b3200640 1 -- start start 2024-08-31T04:28:41.217 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:41.209+0000 7fe2b3200640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe2b410a160 0x7fe2b41a89d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:28:41.217 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:41.216+0000 7fe2b1e00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe2b410a160 0x7fe2b41a89d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:28:41.217 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:41.216+0000 7fe2b1e00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe2b410a160 0x7fe2b41a89d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.50:59006/0 (socket says 172.21.15.50:59006) 2024-08-31T04:28:41.224 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:41.220+0000 7fe2b3200640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe2b410aab0 0x7fe2b41a9040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:28:41.224 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:41.220+0000 7fe2b1400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe2b410aab0 0x7fe2b41a9040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:28:41.224 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:41.220+0000 7fe2b1400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe2b410aab0 0x7fe2b41a9040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:52756/0 (socket says 172.21.15.50:52756) 2024-08-31T04:28:41.224 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:41.220+0000 7fe2b3200640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe2b41119e0 0x7fe2b41a9bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:28:41.224 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:41.221+0000 7fe2b1400640 1 -- 172.21.15.50:0/774857949 learned_addr learned my addr 172.21.15.50:0/774857949 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:28:41.224 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:41.221+0000 7fe2b3200640 1 -- 172.21.15.50:0/774857949 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fe2b4115590 con 0x7fe2b410aab0 2024-08-31T04:28:41.224 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:41.221+0000 7fe2b3200640 1 -- 172.21.15.50:0/774857949 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7fe2b4115410 con 0x7fe2b410a160 2024-08-31T04:28:41.224 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:41.221+0000 7fe2b3200640 1 -- 172.21.15.50:0/774857949 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fe2b4115710 con 0x7fe2b41119e0 2024-08-31T04:28:41.224 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:41.221+0000 7fe2b2800640 1 --2- 172.21.15.50:0/774857949 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe2b41119e0 0x7fe2b41a9bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:28:41.224 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:41.222+0000 7fe2b2800640 1 -- 172.21.15.50:0/774857949 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe2b410a160 msgr2=0x7fe2b41a89d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:28:41.225 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:41.222+0000 7fe2b2800640 1 --2- 172.21.15.50:0/774857949 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe2b410a160 0x7fe2b41a89d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:41.225 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:41.222+0000 7fe2b2800640 1 -- 172.21.15.50:0/774857949 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe2b410aab0 msgr2=0x7fe2b41a9040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:28:41.225 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:41.222+0000 7fe2b2800640 1 --2- 172.21.15.50:0/774857949 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe2b410aab0 0x7fe2b41a9040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:41.225 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:41.222+0000 7fe2b2800640 1 -- 172.21.15.50:0/774857949 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2b41aa410 con 0x7fe2b41119e0 2024-08-31T04:28:41.225 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:41.222+0000 7fe2b2800640 1 --2- 172.21.15.50:0/774857949 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe2b41119e0 0x7fe2b41a9bf0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fe2ac00ef00 tx=0x7fe2ac00c740 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:28:41.245 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:41.242+0000 7fe2b1400640 1 --2- 172.21.15.50:0/774857949 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe2b410aab0 0x7fe2b41a9040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T04:28:41.245 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:41.242+0000 7fe2b1e00640 1 --2- 172.21.15.50:0/774857949 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe2b410a160 0x7fe2b41a89d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T04:28:41.245 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:41.244+0000 7fe2aaa00640 1 -- 172.21.15.50:0/774857949 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2ac004b20 con 0x7fe2b41119e0 2024-08-31T04:28:41.245 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:41.244+0000 7fe2aaa00640 1 -- 172.21.15.50:0/774857949 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe2ac003e20 con 0x7fe2b41119e0 2024-08-31T04:28:41.245 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:41.244+0000 7fe2aaa00640 1 -- 172.21.15.50:0/774857949 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2ac00b7d0 con 0x7fe2b41119e0 2024-08-31T04:28:41.260 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:41.258+0000 7fe2b3200640 1 -- 172.21.15.50:0/774857949 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe2b41aa700 con 0x7fe2b41119e0 2024-08-31T04:28:41.263 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:41.259+0000 7fe2b3200640 1 -- 172.21.15.50:0/774857949 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe2b41b0df0 con 0x7fe2b41119e0 2024-08-31T04:28:41.342 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:41.314+0000 7fe2bfbf6740 1 Processor -- start 2024-08-31T04:28:41.342 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:41.325+0000 7fe2aaa00640 1 -- 172.21.15.50:0/774857949 <== mon.1 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 18) ==== 152577+0+0 (secure 0 0 0) 0x7fe2ac01d020 con 0x7fe2b41119e0 2024-08-31T04:28:41.342 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:41.327+0000 7fe2aaa00640 1 --2- 172.21.15.50:0/774857949 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fe2980b4c70 0x7fe2980b7180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:28:41.342 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:41.328+0000 7fe2aaa00640 1 -- 172.21.15.50:0/774857949 <== mon.1 v2:172.21.15.177:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8219+0+0 (secure 0 0 0) 0x7fe2ac0e4ba0 con 0x7fe2b41119e0 2024-08-31T04:28:41.342 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:41.332+0000 7fe2b1400640 1 --2- 172.21.15.50:0/774857949 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fe2980b4c70 0x7fe2980b7180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:28:41.345 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:41.339+0000 7fe2b1400640 1 --2- 172.21.15.50:0/774857949 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fe2980b4c70 0x7fe2980b7180 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fe2a0009880 tx=0x7fe2a0009430 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:28:41.348 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:41.346+0000 7fe2bfbf6740 1 -- start start 2024-08-31T04:28:41.348 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:41.346+0000 7fe2bfbf6740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557f8ffc31b0 0x557f90368fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:28:41.348 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:41.346+0000 7fe2bfbf6740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x557f8ff9a2f0 0x557f90369610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:28:41.348 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:41.346+0000 7fe2bfbf6740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557f8ffa24d0 0x557f9036a160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:28:41.348 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:41.346+0000 7fe2bfbf6740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x557f902dbf70 con 0x557f8ffc31b0 2024-08-31T04:28:41.348 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:41.346+0000 7fe2bfbf6740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x557f902cb500 con 0x557f8ff9a2f0 2024-08-31T04:28:41.348 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:41.346+0000 7fe2bfbf6740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x557f902cf4b0 con 0x557f8ffa24d0 2024-08-31T04:28:41.359 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:41.355+0000 7fe2b1e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557f8ffc31b0 0x557f90368fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:28:41.359 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:41.355+0000 7fe2b1e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557f8ffc31b0 0x557f90368fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:52760/0 (socket says 172.21.15.50:52760) 2024-08-31T04:28:41.359 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:41.355+0000 7fe2b1e00640 1 -- 172.21.15.50:0/2249200266 learned_addr learned my addr 172.21.15.50:0/2249200266 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:28:41.359 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:41.356+0000 7fe2b1400640 1 --2- 172.21.15.50:0/2249200266 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x557f8ff9a2f0 0x557f90369610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:28:41.359 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:41.356+0000 7fe2b1e00640 1 -- 172.21.15.50:0/2249200266 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557f8ffa24d0 msgr2=0x557f9036a160 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-31T04:28:41.359 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:41.356+0000 7fe2b1e00640 1 --2- 172.21.15.50:0/2249200266 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557f8ffa24d0 0x557f9036a160 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:41.359 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:41.356+0000 7fe2b1e00640 1 -- 172.21.15.50:0/2249200266 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x557f8ff9a2f0 msgr2=0x557f90369610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:28:41.359 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:41.356+0000 7fe2b1e00640 1 --2- 172.21.15.50:0/2249200266 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x557f8ff9a2f0 0x557f90369610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:41.359 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:41.356+0000 7fe2b1e00640 1 -- 172.21.15.50:0/2249200266 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557f90285c10 con 0x557f8ffc31b0 2024-08-31T04:28:41.359 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:41.356+0000 7fe2b1e00640 1 --2- 172.21.15.50:0/2249200266 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557f8ffc31b0 0x557f90368fa0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fe2a400a9c0 tx=0x7fe2a400ae80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62a83210163e5611 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:28:41.372 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:41.371+0000 7fe29f000640 1 -- 172.21.15.50:0/2249200266 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2a4015070 con 0x557f8ffc31b0 2024-08-31T04:28:41.372 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:41.371+0000 7fe29f000640 1 -- 172.21.15.50:0/2249200266 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe2a400cc60 con 0x557f8ffc31b0 2024-08-31T04:28:41.372 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:41.371+0000 7fe29f000640 1 -- 172.21.15.50:0/2249200266 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2a40185c0 con 0x557f8ffc31b0 2024-08-31T04:28:41.382 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:41.380+0000 7fe2bfbf6740 1 -- 172.21.15.50:0/2249200266 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557f8ffc31b0 msgr2=0x557f90368fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:28:41.382 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:41.380+0000 7fe2bfbf6740 1 --2- 172.21.15.50:0/2249200266 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557f8ffc31b0 0x557f90368fa0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fe2a400a9c0 tx=0x7fe2a400ae80 comp rx=0 tx=0).stop 2024-08-31T04:28:41.409 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:41.408+0000 7fe2bfbf6740 1 -- 172.21.15.50:0/2249200266 shutdown_connections 2024-08-31T04:28:41.409 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:41.408+0000 7fe2bfbf6740 1 --2- 172.21.15.50:0/2249200266 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557f8ffa24d0 0x557f9036a160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:41.409 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:41.408+0000 7fe2bfbf6740 1 --2- 172.21.15.50:0/2249200266 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x557f8ff9a2f0 0x557f90369610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:41.409 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:41.408+0000 7fe2bfbf6740 1 --2- 172.21.15.50:0/2249200266 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557f8ffc31b0 0x557f90368fa0 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:41.409 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:41.408+0000 7fe2bfbf6740 1 -- 172.21.15.50:0/2249200266 >> 172.21.15.50:0/2249200266 conn(0x557f8ffb7300 msgr2=0x557f90364a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:28:41.411 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:41.410+0000 7fe2bfbf6740 1 -- 172.21.15.50:0/2249200266 shutdown_connections 2024-08-31T04:28:41.422 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:41.417+0000 7fe2bfbf6740 1 -- 172.21.15.50:0/2249200266 wait complete. 2024-08-31T04:28:41.422 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:41.417+0000 7fe2bfbf6740 1 -- start start 2024-08-31T04:28:41.422 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:41.418+0000 7fe2bfbf6740 1 Processor -- start 2024-08-31T04:28:41.445 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:41.442+0000 7fe2bfbf6740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557f8ff9a2f0 0x557f903726f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:28:41.446 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:41.445+0000 7fe2b1e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557f8ff9a2f0 0x557f903726f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:28:41.446 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:41.445+0000 7fe2b1e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557f8ff9a2f0 0x557f903726f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:52776/0 (socket says 172.21.15.50:52776) 2024-08-31T04:28:41.447 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:41.445+0000 7fe2b1e00640 1 -- 172.21.15.50:0/3017791077 learned_addr learned my addr 172.21.15.50:0/3017791077 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:28:41.447 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:41.446+0000 7fe2bfbf6740 1 --2- 172.21.15.50:0/3017791077 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557f8ffa24d0 0x557f90372db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:28:41.453 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:41.447+0000 7fe2bfbf6740 1 --2- 172.21.15.50:0/3017791077 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x557f8ffc31b0 0x557f90373920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:28:41.453 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:41.447+0000 7fe2b1400640 1 --2- 172.21.15.50:0/3017791077 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557f8ffa24d0 0x557f90372db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:28:41.453 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:41.448+0000 7fe2b2800640 1 --2- 172.21.15.50:0/3017791077 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x557f8ffc31b0 0x557f90373920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:28:41.453 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:41.448+0000 7fe2bfbf6740 1 -- 172.21.15.50:0/3017791077 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x557f90204ab0 con 0x557f8ff9a2f0 2024-08-31T04:28:41.453 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:41.448+0000 7fe2bfbf6740 1 -- 172.21.15.50:0/3017791077 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x557f90272320 con 0x557f8ffc31b0 2024-08-31T04:28:41.453 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:41.448+0000 7fe2bfbf6740 1 -- 172.21.15.50:0/3017791077 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x557f9036ac80 con 0x557f8ffa24d0 2024-08-31T04:28:41.453 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:41.449+0000 7fe2b2800640 1 -- 172.21.15.50:0/3017791077 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557f8ffa24d0 msgr2=0x557f90372db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:28:41.453 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:41.449+0000 7fe2b2800640 1 --2- 172.21.15.50:0/3017791077 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557f8ffa24d0 0x557f90372db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:41.454 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:41.449+0000 7fe2b2800640 1 -- 172.21.15.50:0/3017791077 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557f8ff9a2f0 msgr2=0x557f903726f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:28:41.454 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:41.450+0000 7fe2b2800640 1 --2- 172.21.15.50:0/3017791077 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557f8ff9a2f0 0x557f903726f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:41.454 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:41.450+0000 7fe2b2800640 1 -- 172.21.15.50:0/3017791077 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557f9002e790 con 0x557f8ffc31b0 2024-08-31T04:28:41.454 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:41.450+0000 7fe2b2800640 1 --2- 172.21.15.50:0/3017791077 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x557f8ffc31b0 0x557f90373920 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fe2ac0a87f0 tx=0x7fe2ac0ab1d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7751af1aca393171 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:28:41.454 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:41.451+0000 7fe2b1e00640 1 --2- 172.21.15.50:0/3017791077 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557f8ff9a2f0 0x557f903726f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:28:41.454 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:41.451+0000 7fe2bfbf6740 10 client.0 _ll_register_callbacks cb 0x557f902786a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:28:41.454 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:41.451+0000 7fe2bfbf6740 1 -- 172.21.15.50:0/3017791077 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe2a400cc60 con 0x557f8ffc31b0 2024-08-31T04:28:41.457 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:41.453+0000 7fe293400640 10 client.25934 ms_handle_connect on v2:172.21.15.133:3300/0 2024-08-31T04:28:41.459 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:41.457+0000 7fe293400640 1 -- 172.21.15.50:0/3017791077 <== mon.2 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2ac01a070 con 0x557f8ffc31b0 2024-08-31T04:28:41.461 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:41.459+0000 7fe293400640 1 -- 172.21.15.50:0/3017791077 <== mon.2 v2:172.21.15.133:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8219+0+0 (secure 0 0 0) 0x7fe2ac004290 con 0x557f8ffc31b0 2024-08-31T04:28:41.528 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:41.514+0000 7fe293400640 1 -- 172.21.15.50:0/3017791077 <== mon.2 v2:172.21.15.133:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7fe2ac0b48a0 con 0x557f8ffc31b0 2024-08-31T04:28:41.545 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:41.530+0000 7fe2bfbf6740 10 client.25934 fetch_fsmap learned FSMap version 38 2024-08-31T04:28:41.545 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:41.530+0000 7fe2bfbf6740 1 -- 172.21.15.50:0/3017791077 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({fsmap=38}) -- 0x557f900a7620 con 0x557f8ffc31b0 2024-08-31T04:28:41.545 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:41.539+0000 7fe293400640 1 -- 172.21.15.50:0/3017791077 <== mon.2 v2:172.21.15.133:3300/0 4 ==== fsmap(e 38) ==== 7805+0+0 (secure 0 0 0) 0x7fe2ac00b040 con 0x557f8ffc31b0 2024-08-31T04:28:41.545 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:41.540+0000 7fe2bfbf6740 10 client.25934 fetch_fsmap finished waiting for FSMap version 38 2024-08-31T04:28:41.545 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:41.540+0000 7fe2bfbf6740 10 client.25934 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T04:28:41.545 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:41.540+0000 7fe2bfbf6740 20 client.25934 populate_metadata read hostname 'smithi050' 2024-08-31T04:28:41.545 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:41.540+0000 7fe2bfbf6740 1 --2- 172.21.15.50:0/3017791077 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x557f8ff81d80 0x557f9037fc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:28:41.545 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:41.540+0000 7fe2bfbf6740 4 client.25934 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T04:28:41.545 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:41.540+0000 7fe2bfbf6740 1 -- 172.21.15.50:0/3017791077 --> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557f902ddec0 con 0x557f8ff81d80 2024-08-31T04:28:41.546 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:41.543+0000 7fe2b1e00640 1 --2- 172.21.15.50:0/3017791077 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x557f8ff81d80 0x557f9037fc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:28:41.548 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:41.547+0000 7fe2b1e00640 1 --2- 172.21.15.50:0/3017791077 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x557f8ff81d80 0x557f9037fc80 crc :-1 s=READY pgs=94 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1613f2ea97128f95 server_cookie=262071379f50caf3 in_seq=0 out_seq=0 2024-08-31T04:28:41.548 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:41.547+0000 7fe293400640 10 client.25934 ms_handle_connect on v2:172.21.15.133:6838/2526402262 2024-08-31T04:28:41.560 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:41.555+0000 7fe293400640 1 -- 172.21.15.50:0/3017791077 <== mds.0 v2:172.21.15.133:6838/2526402262 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x557f902ddec0 con 0x557f8ff81d80 2024-08-31T04:28:41.560 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:41.555+0000 7fe293400640 10 client.25934 handle_command_reply: tid=0 2024-08-31T04:28:41.560 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:41.555+0000 7fe2bfbf6740 1 client.25934 shutdown 2024-08-31T04:28:41.564 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:41.563+0000 7fe2bfbf6740 1 -- 172.21.15.50:0/3017791077 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x557f8ffc31b0 msgr2=0x557f90373920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:28:41.564 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:41.563+0000 7fe2bfbf6740 1 --2- 172.21.15.50:0/3017791077 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x557f8ffc31b0 0x557f90373920 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fe2ac0a87f0 tx=0x7fe2ac0ab1d0 comp rx=0 tx=0).stop 2024-08-31T04:28:41.565 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:41.563+0000 7fe2bfbf6740 1 -- 172.21.15.50:0/3017791077 shutdown_connections 2024-08-31T04:28:41.565 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:41.563+0000 7fe2bfbf6740 1 --2- 172.21.15.50:0/3017791077 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x557f8ff81d80 0x557f9037fc80 crc :-1 s=READY pgs=94 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:41.565 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:41.563+0000 7fe2bfbf6740 1 --2- 172.21.15.50:0/3017791077 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557f8ffa24d0 0x557f90372db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:41.566 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:41.563+0000 7fe2bfbf6740 1 --2- 172.21.15.50:0/3017791077 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x557f8ffc31b0 0x557f90373920 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:41.566 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:41.563+0000 7fe2bfbf6740 1 --2- 172.21.15.50:0/3017791077 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557f8ff9a2f0 0x557f903726f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:41.566 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:41.563+0000 7fe2bfbf6740 1 -- 172.21.15.50:0/3017791077 >> 172.21.15.50:0/3017791077 conn(0x557f8ffb7300 msgr2=0x557f90362f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:28:41.566 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:41.564+0000 7fe293400640 0 client.25934 ms_handle_reset on v2:172.21.15.133:6838/2526402262 2024-08-31T04:28:41.629 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:41.607+0000 7fe2bfbf6740 1 -- 172.21.15.50:0/3017791077 shutdown_connections 2024-08-31T04:28:41.629 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:41.624+0000 7fe2bfbf6740 1 -- 172.21.15.50:0/3017791077 wait complete. 2024-08-31T04:28:41.637 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:41.634+0000 7fe2bfbf6740 20 client.25934 trim_cache size 0 max 16384 2024-08-31T04:28:41.704 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:28:41 smithi050 ceph-mon[17259]: pgmap v541: 97 pgs: 97 active+clean; 965 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 5.6 MiB/s wr, 300 op/s 2024-08-31T04:28:41.749 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:28:41 smithi177 ceph-mon[22025]: pgmap v541: 97 pgs: 97 active+clean; 965 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 5.6 MiB/s wr, 300 op/s 2024-08-31T04:28:41.794 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:28:41 smithi133 ceph-mon[22177]: pgmap v541: 97 pgs: 97 active+clean; 965 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 5.6 MiB/s wr, 300 op/s 2024-08-31T04:28:42.346 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:42.336+0000 7fe2bfbf6740 1 Processor -- start 2024-08-31T04:28:42.374 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:42.373+0000 7fe2bfbf6740 1 -- start start 2024-08-31T04:28:42.375 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:42.373+0000 7fe2bfbf6740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557f8ff9a2f0 0x557f903695b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:28:42.375 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:42.373+0000 7fe2bfbf6740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x557f8ffa24d0 0x557f9036d770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:28:42.375 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:42.373+0000 7fe2bfbf6740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557f8ffc31b0 0x557f90371110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:28:42.375 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:42.373+0000 7fe2bfbf6740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fe2b41b2e60 con 0x557f8ff9a2f0 2024-08-31T04:28:42.375 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:42.373+0000 7fe2bfbf6740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7fe2b41a8050 con 0x557f8ffa24d0 2024-08-31T04:28:42.375 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:42.373+0000 7fe2bfbf6740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fe2b41b2790 con 0x557f8ffc31b0 2024-08-31T04:28:42.381 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:42.378+0000 7fe2b1e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557f8ff9a2f0 0x557f903695b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:28:42.381 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:42.378+0000 7fe2b1400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x557f8ffa24d0 0x557f9036d770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:28:42.381 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:42.378+0000 7fe2b1e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557f8ff9a2f0 0x557f903695b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:52790/0 (socket says 172.21.15.50:52790) 2024-08-31T04:28:42.381 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:42.378+0000 7fe2b1e00640 1 -- 172.21.15.50:0/1020928368 learned_addr learned my addr 172.21.15.50:0/1020928368 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:28:42.381 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:42.378+0000 7fe2b1e00640 1 -- 172.21.15.50:0/1020928368 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557f8ffc31b0 msgr2=0x557f90371110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:28:42.381 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:42.378+0000 7fe2b1e00640 1 --2- 172.21.15.50:0/1020928368 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557f8ffc31b0 0x557f90371110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:42.381 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:42.378+0000 7fe2b1e00640 1 -- 172.21.15.50:0/1020928368 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x557f8ffa24d0 msgr2=0x557f9036d770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:28:42.382 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:42.378+0000 7fe2b1e00640 1 --2- 172.21.15.50:0/1020928368 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x557f8ffa24d0 0x557f9036d770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:42.382 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:42.378+0000 7fe2b1e00640 1 -- 172.21.15.50:0/1020928368 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557f9035ebe0 con 0x557f8ff9a2f0 2024-08-31T04:28:42.382 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:42.379+0000 7fe2b1e00640 1 --2- 172.21.15.50:0/1020928368 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557f8ff9a2f0 0x557f903695b0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fe2a400a9c0 tx=0x7fe2a400a280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6c971604b42a49d server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:28:42.389 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:42.388+0000 7fe29e600640 1 -- 172.21.15.50:0/1020928368 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2a4015040 con 0x557f8ff9a2f0 2024-08-31T04:28:42.389 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:42.388+0000 7fe29e600640 1 -- 172.21.15.50:0/1020928368 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe2a4011bb0 con 0x557f8ff9a2f0 2024-08-31T04:28:42.389 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:42.388+0000 7fe29e600640 1 -- 172.21.15.50:0/1020928368 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2a40038f0 con 0x557f8ff9a2f0 2024-08-31T04:28:42.399 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:42.398+0000 7fe2bfbf6740 1 -- 172.21.15.50:0/1020928368 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557f8ff9a2f0 msgr2=0x557f903695b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:28:42.400 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:42.398+0000 7fe2bfbf6740 1 --2- 172.21.15.50:0/1020928368 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557f8ff9a2f0 0x557f903695b0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fe2a400a9c0 tx=0x7fe2a400a280 comp rx=0 tx=0).stop 2024-08-31T04:28:42.417 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:42.416+0000 7fe2bfbf6740 1 -- 172.21.15.50:0/1020928368 shutdown_connections 2024-08-31T04:28:42.417 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:42.416+0000 7fe2bfbf6740 1 --2- 172.21.15.50:0/1020928368 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557f8ffc31b0 0x557f90371110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:42.417 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:42.416+0000 7fe2bfbf6740 1 --2- 172.21.15.50:0/1020928368 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x557f8ffa24d0 0x557f9036d770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:42.417 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:42.416+0000 7fe2bfbf6740 1 --2- 172.21.15.50:0/1020928368 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557f8ff9a2f0 0x557f903695b0 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:42.417 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:42.416+0000 7fe2bfbf6740 1 -- 172.21.15.50:0/1020928368 >> 172.21.15.50:0/1020928368 conn(0x557f8ffb7300 msgr2=0x557f9036d060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:28:42.422 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:42.421+0000 7fe2bfbf6740 1 -- 172.21.15.50:0/1020928368 shutdown_connections 2024-08-31T04:28:42.422 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:42.421+0000 7fe2bfbf6740 1 -- 172.21.15.50:0/1020928368 wait complete. 2024-08-31T04:28:42.423 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:42.421+0000 7fe2bfbf6740 1 -- start start 2024-08-31T04:28:42.423 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:42.422+0000 7fe2bfbf6740 1 Processor -- start 2024-08-31T04:28:42.428 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:42.427+0000 7fe2bfbf6740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557f8ff9a2f0 0x557f90379200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:28:42.428 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:42.427+0000 7fe2bfbf6740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557f8ffa24d0 0x557f90379740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:28:42.432 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:42.427+0000 7fe2bfbf6740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x557f8ffc31b0 0x557f90379c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:28:42.432 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:42.427+0000 7fe2bfbf6740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fe2b41b1870 con 0x557f8ffa24d0 2024-08-31T04:28:42.432 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:42.427+0000 7fe2b2800640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x557f8ffc31b0 0x557f90379c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:28:42.432 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:42.427+0000 7fe2b1400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557f8ffa24d0 0x557f90379740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:28:42.432 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:42.427+0000 7fe2b2800640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x557f8ffc31b0 0x557f90379c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.50:59026/0 (socket says 172.21.15.50:59026) 2024-08-31T04:28:42.432 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:42.427+0000 7fe2b2800640 1 -- 172.21.15.50:0/3570541260 learned_addr learned my addr 172.21.15.50:0/3570541260 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:28:42.432 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:42.427+0000 7fe2bfbf6740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7fe2b41b10e0 con 0x557f8ffc31b0 2024-08-31T04:28:42.432 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:42.428+0000 7fe2bfbf6740 1 -- 172.21.15.50:0/3570541260 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fe2b41b2000 con 0x557f8ff9a2f0 2024-08-31T04:28:42.433 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:42.428+0000 7fe2bfbf6740 10 client.0 _ll_register_callbacks cb 0x7fe2ac0aaed0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:28:42.433 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:42.428+0000 7fe2b1400640 1 -- 172.21.15.50:0/3570541260 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557f8ff9a2f0 msgr2=0x557f90379200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:28:42.433 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:42.428+0000 7fe2b1400640 1 --2- 172.21.15.50:0/3570541260 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557f8ff9a2f0 0x557f90379200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:42.433 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:42.428+0000 7fe2b1400640 1 -- 172.21.15.50:0/3570541260 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x557f8ffc31b0 msgr2=0x557f90379c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:28:42.433 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:42.428+0000 7fe2b1400640 1 --2- 172.21.15.50:0/3570541260 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x557f8ffc31b0 0x557f90379c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:42.433 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:42.428+0000 7fe2b1400640 1 -- 172.21.15.50:0/3570541260 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557f90377f20 con 0x557f8ffa24d0 2024-08-31T04:28:42.433 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:42.429+0000 7fe2b1400640 1 --2- 172.21.15.50:0/3570541260 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557f8ffa24d0 0x557f90379740 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fe2a00304c0 tx=0x7fe2a0005f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65ab51610e2bd992 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:28:42.433 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:42.430+0000 7fe2bfbf6740 1 -- 172.21.15.50:0/3570541260 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe2a4011bb0 con 0x557f8ffa24d0 2024-08-31T04:28:42.469 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:42.440+0000 7fe293400640 10 client.15942 ms_handle_connect on v2:172.21.15.50:3300/0 2024-08-31T04:28:42.469 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:42.440+0000 7fe293400640 1 -- 172.21.15.50:0/3570541260 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2a0004ad0 con 0x557f8ffa24d0 2024-08-31T04:28:42.469 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:42.441+0000 7fe293400640 1 -- 172.21.15.50:0/3570541260 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8219+0+0 (secure 0 0 0) 0x7fe2a0004c70 con 0x557f8ffa24d0 2024-08-31T04:28:42.469 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:42.441+0000 7fe293400640 1 -- 172.21.15.50:0/3570541260 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7fe2a0054440 con 0x557f8ffa24d0 2024-08-31T04:28:42.469 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:42.446+0000 7fe2bfbf6740 10 client.15942 fetch_fsmap learned FSMap version 38 2024-08-31T04:28:42.469 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:42.446+0000 7fe2bfbf6740 1 -- 172.21.15.50:0/3570541260 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({fsmap=38}) -- 0x557f903eaa70 con 0x557f8ffa24d0 2024-08-31T04:28:42.470 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:42.467+0000 7fe293400640 1 -- 172.21.15.50:0/3570541260 <== mon.0 v2:172.21.15.50:3300/0 4 ==== fsmap(e 38) ==== 7805+0+0 (secure 0 0 0) 0x7fe2a0052020 con 0x557f8ffa24d0 2024-08-31T04:28:42.472 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:42.471+0000 7fe2bfbf6740 10 client.15942 fetch_fsmap finished waiting for FSMap version 38 2024-08-31T04:28:42.472 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:42.471+0000 7fe2bfbf6740 10 client.15942 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T04:28:42.472 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:42.471+0000 7fe2bfbf6740 20 client.15942 populate_metadata read hostname 'smithi050' 2024-08-31T04:28:42.472 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:42.471+0000 7fe2bfbf6740 1 --2- 172.21.15.50:0/3570541260 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x557f8ff571c0 0x557f903ed340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:28:42.473 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:42.471+0000 7fe2bfbf6740 4 client.15942 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-31T04:28:42.473 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:42.471+0000 7fe2bfbf6740 1 -- 172.21.15.50:0/3570541260 --> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] -- command(tid 0: {"prefix": "flush journal"}) -- 0x557f90364a80 con 0x557f8ff571c0 2024-08-31T04:28:42.473 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:42.471+0000 7fe2b1e00640 1 --2- 172.21.15.50:0/3570541260 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x557f8ff571c0 0x557f903ed340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:28:42.474 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:42.472+0000 7fe293400640 10 client.15942 ms_handle_connect on v2:172.21.15.133:6838/2526402262 2024-08-31T04:28:42.474 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:42.472+0000 7fe2b1e00640 1 --2- 172.21.15.50:0/3570541260 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x557f8ff571c0 0x557f903ed340 crc :-1 s=READY pgs=95 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c6e211b6ac6cdebf server_cookie=d9c479a67d0ecd7e in_seq=0 out_seq=0 2024-08-31T04:28:42.496 INFO:journalctl@ceph.mds.f.smithi177.stdout:Aug 31 04:28:42 smithi177 podman[55473]: 2024-08-31 04:28:42.132685379 +0000 UTC m=+3.976717932 container init a7ae3a81cc5d1dc958fe33ad202dd0bfac1ac15a5dc8a55b47a3c2d8984ce527 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-mds-f, org.label-schema.vendor=CentOS, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.1, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-08-31T04:28:42.496 INFO:journalctl@ceph.mds.f.smithi177.stdout:Aug 31 04:28:42 smithi177 podman[55473]: 2024-08-31 04:28:42.135591368 +0000 UTC m=+3.979623929 container start a7ae3a81cc5d1dc958fe33ad202dd0bfac1ac15a5dc8a55b47a3c2d8984ce527 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-mds-f, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.1, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, maintainer=Guillaume Abrioux , ceph=True) 2024-08-31T04:28:42.496 INFO:journalctl@ceph.mds.f.smithi177.stdout:Aug 31 04:28:42 smithi177 ceph-mds[55495]: -- 172.21.15.177:0/2727640737 <== mon.2 v2:172.21.15.133:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x560d61417c20 con 0x560d655bda80 2024-08-31T04:28:42.496 INFO:journalctl@ceph.mds.f.smithi177.stdout:Aug 31 04:28:42 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-mds-f[55490]: starting mds.f at 2024-08-31T04:28:43.746 INFO:journalctl@ceph.mds.f.smithi177.stdout:Aug 31 04:28:43 smithi177 bash[55473]: a7ae3a81cc5d1dc958fe33ad202dd0bfac1ac15a5dc8a55b47a3c2d8984ce527 2024-08-31T04:28:43.746 INFO:journalctl@ceph.mds.f.smithi177.stdout:Aug 31 04:28:43 smithi177 systemd[1]: Started Ceph mds.f for 058d9fc6-674f-11ef-bcd4-c7b262605968. 2024-08-31T04:28:43.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:28:43 smithi177 ceph-mon[22025]: pgmap v542: 97 pgs: 97 active+clean; 1.0 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 13 MiB/s wr, 606 op/s 2024-08-31T04:28:43.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:28:43 smithi177 ceph-mon[22025]: mds.? [v2:172.21.15.177:6834/4060379633,v1:172.21.15.177:6835/4060379633] up:boot 2024-08-31T04:28:43.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:28:43 smithi177 ceph-mon[22025]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-31T04:28:43.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:28:43 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "f"} : dispatch 2024-08-31T04:28:43.792 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:28:43 smithi133 ceph-mon[22177]: pgmap v542: 97 pgs: 97 active+clean; 1.0 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 13 MiB/s wr, 606 op/s 2024-08-31T04:28:43.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:28:43 smithi133 ceph-mon[22177]: mds.? [v2:172.21.15.177:6834/4060379633,v1:172.21.15.177:6835/4060379633] up:boot 2024-08-31T04:28:43.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:28:43 smithi133 ceph-mon[22177]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-31T04:28:43.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:28:43 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "f"} : dispatch 2024-08-31T04:28:43.973 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:28:43 smithi050 ceph-mon[17259]: pgmap v542: 97 pgs: 97 active+clean; 1.0 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 13 MiB/s wr, 606 op/s 2024-08-31T04:28:43.973 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:28:43 smithi050 ceph-mon[17259]: mds.? [v2:172.21.15.177:6834/4060379633,v1:172.21.15.177:6835/4060379633] up:boot 2024-08-31T04:28:43.973 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:28:43 smithi050 ceph-mon[17259]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-31T04:28:43.973 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:28:43 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "f"} : dispatch 2024-08-31T04:28:45.044 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:45.042+0000 7fe293400640 1 -- 172.21.15.50:0/3570541260 <== mds.0 v2:172.21.15.133:6838/2526402262 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x557f90364a80 con 0x557f8ff571c0 2024-08-31T04:28:45.044 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:45.042+0000 7fe293400640 10 client.15942 handle_command_reply: tid=0 2024-08-31T04:28:45.121 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:45.078+0000 7fe2bfbf6740 1 client.15942 shutdown 2024-08-31T04:28:45.218 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:45.217+0000 7fe2bfbf6740 1 -- 172.21.15.50:0/3570541260 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557f8ffa24d0 msgr2=0x557f90379740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:28:45.218 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:45.217+0000 7fe2bfbf6740 1 --2- 172.21.15.50:0/3570541260 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557f8ffa24d0 0x557f90379740 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fe2a00304c0 tx=0x7fe2a0005f90 comp rx=0 tx=0).stop 2024-08-31T04:28:45.288 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:45.287+0000 7fe2bfbf6740 1 -- 172.21.15.50:0/3570541260 shutdown_connections 2024-08-31T04:28:45.289 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:45.287+0000 7fe2bfbf6740 1 --2- 172.21.15.50:0/3570541260 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x557f8ff571c0 0x557f903ed340 crc :-1 s=READY pgs=95 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:45.289 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:45.287+0000 7fe2bfbf6740 1 --2- 172.21.15.50:0/3570541260 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x557f8ffc31b0 0x557f90379c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:45.289 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:45.287+0000 7fe2bfbf6740 1 --2- 172.21.15.50:0/3570541260 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557f8ffa24d0 0x557f90379740 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:45.289 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:45.287+0000 7fe2bfbf6740 1 --2- 172.21.15.50:0/3570541260 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557f8ff9a2f0 0x557f90379200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:45.289 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:45.287+0000 7fe2bfbf6740 1 -- 172.21.15.50:0/3570541260 >> 172.21.15.50:0/3570541260 conn(0x557f8ffb7300 msgr2=0x557f90363c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:28:45.318 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:45.317+0000 7fe293400640 0 client.15942 ms_handle_reset on v2:172.21.15.133:6838/2526402262 2024-08-31T04:28:45.325 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:45.322+0000 7fe2bfbf6740 1 -- 172.21.15.50:0/3570541260 shutdown_connections 2024-08-31T04:28:45.327 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:45.325+0000 7fe2bfbf6740 1 -- 172.21.15.50:0/3570541260 wait complete. 2024-08-31T04:28:45.334 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:45.327+0000 7fe2bfbf6740 20 client.15942 trim_cache size 0 max 16384 2024-08-31T04:28:45.334 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout:{ 2024-08-31T04:28:45.335 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout: "message": "", 2024-08-31T04:28:45.335 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout: "return_code": 0 2024-08-31T04:28:45.335 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout:} 2024-08-31T04:28:45.336 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:45.335+0000 7fe2b3200640 1 -- 172.21.15.50:0/774857949 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fe2980b4c70 msgr2=0x7fe2980b7180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:28:45.336 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:45.335+0000 7fe2b3200640 1 --2- 172.21.15.50:0/774857949 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fe2980b4c70 0x7fe2980b7180 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fe2a0009880 tx=0x7fe2a0009430 comp rx=0 tx=0).stop 2024-08-31T04:28:45.336 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:45.335+0000 7fe2b3200640 1 -- 172.21.15.50:0/774857949 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe2b41119e0 msgr2=0x7fe2b41a9bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:28:45.337 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:45.335+0000 7fe2b3200640 1 --2- 172.21.15.50:0/774857949 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe2b41119e0 0x7fe2b41a9bf0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fe2ac00ef00 tx=0x7fe2ac00c740 comp rx=0 tx=0).stop 2024-08-31T04:28:45.338 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:45.336+0000 7fe2b3200640 1 -- 172.21.15.50:0/774857949 shutdown_connections 2024-08-31T04:28:45.338 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:45.336+0000 7fe2b3200640 1 --2- 172.21.15.50:0/774857949 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fe2980b4c70 0x7fe2980b7180 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:45.338 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:45.336+0000 7fe2b3200640 1 --2- 172.21.15.50:0/774857949 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe2b41119e0 0x7fe2b41a9bf0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:45.338 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:45.336+0000 7fe2b3200640 1 --2- 172.21.15.50:0/774857949 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe2b410aab0 0x7fe2b41a9040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:45.339 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:45.336+0000 7fe2b3200640 1 --2- 172.21.15.50:0/774857949 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe2b410a160 0x7fe2b41a89d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:28:45.339 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:45.336+0000 7fe2b3200640 1 -- 172.21.15.50:0/774857949 >> 172.21.15.50:0/774857949 conn(0x7fe2b40703e0 msgr2=0x7fe2b410d480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:28:45.339 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:45.336+0000 7fe2b3200640 1 -- 172.21.15.50:0/774857949 shutdown_connections 2024-08-31T04:28:45.339 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:28:45.336+0000 7fe2b3200640 1 -- 172.21.15.50:0/774857949 wait complete. 2024-08-31T04:28:45.507 INFO:tasks.workunit.client.0.smithi050.stdout: 321 493829 585 341554 864 113083 1048 2024-08-31T04:28:45.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:28:45 smithi177 ceph-mon[22025]: pgmap v543: 97 pgs: 97 active+clean; 1.0 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 12 MiB/s wr, 573 op/s 2024-08-31T04:28:45.792 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:28:45 smithi133 ceph-mon[22177]: pgmap v543: 97 pgs: 97 active+clean; 1.0 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 12 MiB/s wr, 573 op/s 2024-08-31T04:28:45.950 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:28:45 smithi050 ceph-mon[17259]: pgmap v543: 97 pgs: 97 active+clean; 1.0 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 12 MiB/s wr, 573 op/s 2024-08-31T04:28:47.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:28:47 smithi177 ceph-mon[22025]: pgmap v544: 97 pgs: 97 active+clean; 1.0 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 13 MiB/s wr, 878 op/s 2024-08-31T04:28:47.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:28:47 smithi133 ceph-mon[22177]: pgmap v544: 97 pgs: 97 active+clean; 1.0 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 13 MiB/s wr, 878 op/s 2024-08-31T04:28:47.795 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:28:47 smithi050 ceph-mon[17259]: pgmap v544: 97 pgs: 97 active+clean; 1.0 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 13 MiB/s wr, 878 op/s 2024-08-31T04:28:49.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:28:49 smithi177 ceph-mon[22025]: pgmap v545: 97 pgs: 97 active+clean; 1.0 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 11 MiB/s wr, 850 op/s 2024-08-31T04:28:49.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:28:49 smithi133 ceph-mon[22177]: pgmap v545: 97 pgs: 97 active+clean; 1.0 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 11 MiB/s wr, 850 op/s 2024-08-31T04:28:49.951 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:28:49 smithi050 ceph-mon[17259]: pgmap v545: 97 pgs: 97 active+clean; 1.0 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 11 MiB/s wr, 850 op/s 2024-08-31T04:28:51.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:28:51 smithi177 ceph-mon[22025]: pgmap v546: 97 pgs: 97 active+clean; 1.0 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 9.4 MiB/s wr, 784 op/s 2024-08-31T04:28:51.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:28:51 smithi133 ceph-mon[22177]: pgmap v546: 97 pgs: 97 active+clean; 1.0 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 9.4 MiB/s wr, 784 op/s 2024-08-31T04:28:51.952 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:28:51 smithi050 ceph-mon[17259]: pgmap v546: 97 pgs: 97 active+clean; 1.0 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 9.4 MiB/s wr, 784 op/s 2024-08-31T04:28:53.772 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:28:53 smithi050 ceph-mon[17259]: pgmap v547: 97 pgs: 97 active+clean; 1.0 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 9.4 MiB/s wr, 815 op/s 2024-08-31T04:28:53.792 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:28:53 smithi133 ceph-mon[22177]: pgmap v547: 97 pgs: 97 active+clean; 1.0 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 9.4 MiB/s wr, 815 op/s 2024-08-31T04:28:53.996 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:28:53 smithi177 ceph-mon[22025]: pgmap v547: 97 pgs: 97 active+clean; 1.0 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 9.4 MiB/s wr, 815 op/s 2024-08-31T04:28:55.523 INFO:tasks.workunit.client.0.smithi050.stdout: 342 559607 1132 392729 1194 137414 1760 2024-08-31T04:28:55.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:28:55 smithi133 ceph-mon[22177]: pgmap v548: 97 pgs: 97 active+clean; 1.0 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.6 MiB/s wr, 507 op/s 2024-08-31T04:28:55.950 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:28:55 smithi050 ceph-mon[17259]: pgmap v548: 97 pgs: 97 active+clean; 1.0 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.6 MiB/s wr, 507 op/s 2024-08-31T04:28:55.996 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:28:55 smithi177 ceph-mon[22025]: pgmap v548: 97 pgs: 97 active+clean; 1.0 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.6 MiB/s wr, 507 op/s 2024-08-31T04:28:57.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:28:57 smithi133 ceph-mon[22177]: pgmap v549: 97 pgs: 97 active+clean; 1.1 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 4.8 MiB/s wr, 651 op/s 2024-08-31T04:28:57.970 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:28:57 smithi050 ceph-mon[17259]: pgmap v549: 97 pgs: 97 active+clean; 1.1 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 4.8 MiB/s wr, 651 op/s 2024-08-31T04:28:57.996 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:28:57 smithi177 ceph-mon[22025]: pgmap v549: 97 pgs: 97 active+clean; 1.1 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 4.8 MiB/s wr, 651 op/s 2024-08-31T04:28:59.703 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:28:59 smithi050 ceph-mon[17259]: pgmap v550: 97 pgs: 97 active+clean; 1.1 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 5.5 MiB/s wr, 401 op/s 2024-08-31T04:28:59.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:28:59 smithi133 ceph-mon[22177]: pgmap v550: 97 pgs: 97 active+clean; 1.1 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 5.5 MiB/s wr, 401 op/s 2024-08-31T04:28:59.996 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:28:59 smithi177 ceph-mon[22025]: pgmap v550: 97 pgs: 97 active+clean; 1.1 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 5.5 MiB/s wr, 401 op/s 2024-08-31T04:29:01.662 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:01.660+0000 7f6869000640 1 -- 172.21.15.50:0/3757654783 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f686410a160 msgr2=0x7f686410c580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:29:01.662 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:01.660+0000 7f6869000640 1 --2- 172.21.15.50:0/3757654783 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f686410a160 0x7f686410c580 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f68500098b0 tx=0x7f685002a3d0 comp rx=0 tx=0).stop 2024-08-31T04:29:01.666 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:01.664+0000 7f6869000640 1 -- 172.21.15.50:0/3757654783 shutdown_connections 2024-08-31T04:29:01.666 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:01.664+0000 7f6869000640 1 --2- 172.21.15.50:0/3757654783 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f686410cac0 0x7f686410eee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:01.666 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:01.664+0000 7f6869000640 1 --2- 172.21.15.50:0/3757654783 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f686410f5d0 0x7f686410fab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:01.666 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:01.665+0000 7f6869000640 1 --2- 172.21.15.50:0/3757654783 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f686410a160 0x7f686410c580 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:01.666 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:01.665+0000 7f6869000640 1 -- 172.21.15.50:0/3757654783 >> 172.21.15.50:0/3757654783 conn(0x7f68640703e0 msgr2=0x7f6864072890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:29:01.670 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:01.668+0000 7f6869000640 1 -- 172.21.15.50:0/3757654783 shutdown_connections 2024-08-31T04:29:01.670 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:01.669+0000 7f6869000640 1 -- 172.21.15.50:0/3757654783 wait complete. 2024-08-31T04:29:01.676 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:01.675+0000 7f6869000640 1 Processor -- start 2024-08-31T04:29:01.677 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:01.675+0000 7f6869000640 1 -- start start 2024-08-31T04:29:01.678 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:01.677+0000 7f6869000640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f686410a160 0x7f68641a8910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:01.679 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:01.678+0000 7f6869000640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f686410cac0 0x7f68641a8f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:01.679 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:01.678+0000 7f6863400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f686410a160 0x7f68641a8910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:29:01.679 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:01.678+0000 7f6863400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f686410a160 0x7f68641a8910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.50:40204/0 (socket says 172.21.15.50:40204) 2024-08-31T04:29:01.681 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:01.679+0000 7f6862a00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f686410cac0 0x7f68641a8f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:29:01.681 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:01.679+0000 7f6862a00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f686410cac0 0x7f68641a8f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35564/0 (socket says 172.21.15.50:35564) 2024-08-31T04:29:01.681 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:01.679+0000 7f6869000640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f686410f5d0 0x7f68641a9b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:01.682 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:01.680+0000 7f6862a00640 1 -- 172.21.15.50:0/3735776948 learned_addr learned my addr 172.21.15.50:0/3735776948 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:29:01.682 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:01.680+0000 7f6869000640 1 -- 172.21.15.50:0/3735776948 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f686411dd50 con 0x7f686410cac0 2024-08-31T04:29:01.682 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:01.680+0000 7f6863e00640 1 --2- 172.21.15.50:0/3735776948 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f686410f5d0 0x7f68641a9b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:29:01.682 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:01.680+0000 7f6869000640 1 -- 172.21.15.50:0/3735776948 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f686411dbd0 con 0x7f686410a160 2024-08-31T04:29:01.682 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:01.681+0000 7f6869000640 1 -- 172.21.15.50:0/3735776948 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f686411ded0 con 0x7f686410f5d0 2024-08-31T04:29:01.686 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:01.683+0000 7f6863e00640 1 -- 172.21.15.50:0/3735776948 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f686410a160 msgr2=0x7f68641a8910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:29:01.686 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:01.683+0000 7f6863e00640 1 --2- 172.21.15.50:0/3735776948 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f686410a160 0x7f68641a8910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:01.686 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:01.683+0000 7f6863e00640 1 -- 172.21.15.50:0/3735776948 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f686410cac0 msgr2=0x7f68641a8f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:29:01.686 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:01.683+0000 7f6863e00640 1 --2- 172.21.15.50:0/3735776948 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f686410cac0 0x7f68641a8f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:01.686 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:01.683+0000 7f6863e00640 1 -- 172.21.15.50:0/3735776948 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68641aa350 con 0x7f686410f5d0 2024-08-31T04:29:01.686 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:01.683+0000 7f6862a00640 1 --2- 172.21.15.50:0/3735776948 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f686410cac0 0x7f68641a8f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:29:01.686 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:01.684+0000 7f6863400640 1 --2- 172.21.15.50:0/3735776948 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f686410a160 0x7f68641a8910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:29:01.690 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:01.688+0000 7f6863e00640 1 --2- 172.21.15.50:0/3735776948 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f686410f5d0 0x7f68641a9b30 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f685c00ef00 tx=0x7f685c00c740 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:29:01.690 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:01.689+0000 7f685be00640 1 -- 172.21.15.50:0/3735776948 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f685c004b20 con 0x7f686410f5d0 2024-08-31T04:29:01.690 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:01.689+0000 7f685be00640 1 -- 172.21.15.50:0/3735776948 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f685c003e20 con 0x7f686410f5d0 2024-08-31T04:29:01.690 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:01.689+0000 7f685be00640 1 -- 172.21.15.50:0/3735776948 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f685c00b570 con 0x7f686410f5d0 2024-08-31T04:29:01.691 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:01.690+0000 7f6869000640 1 -- 172.21.15.50:0/3735776948 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f68641aa640 con 0x7f686410f5d0 2024-08-31T04:29:01.692 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:01.691+0000 7f6869000640 1 -- 172.21.15.50:0/3735776948 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f68641b0d30 con 0x7f686410f5d0 2024-08-31T04:29:01.707 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:01.706+0000 7f68717c4740 1 Processor -- start 2024-08-31T04:29:01.711 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:01.709+0000 7f68717c4740 1 -- start start 2024-08-31T04:29:01.716 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:01.710+0000 7f68717c4740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b60ab031b0 0x55b60aea8d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:01.717 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:01.710+0000 7f68717c4740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b60aada2f0 0x55b60aea93b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:01.717 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:01.710+0000 7f68717c4740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b60aae24d0 0x55b60aea9f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:01.717 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:01.710+0000 7f68717c4740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55b60ae1bf70 con 0x55b60aada2f0 2024-08-31T04:29:01.717 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:01.710+0000 7f68717c4740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x55b60ae0b500 con 0x55b60ab031b0 2024-08-31T04:29:01.717 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:01.710+0000 7f68717c4740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x55b60ae0f4b0 con 0x55b60aae24d0 2024-08-31T04:29:01.717 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:01.710+0000 7f685be00640 1 -- 172.21.15.50:0/3735776948 <== mon.1 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 18) ==== 152577+0+0 (secure 0 0 0) 0x7f685c01d020 con 0x7f686410f5d0 2024-08-31T04:29:01.717 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:01.713+0000 7f6862a00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b60ab031b0 0x55b60aea8d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:29:01.718 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:01.715+0000 7f6862a00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b60ab031b0 0x55b60aea8d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.50:40212/0 (socket says 172.21.15.50:40212) 2024-08-31T04:29:01.718 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:01.715+0000 7f6862a00640 1 -- 172.21.15.50:0/1152114224 learned_addr learned my addr 172.21.15.50:0/1152114224 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:29:01.718 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:01.716+0000 7f6862a00640 1 --2- 172.21.15.50:0/1152114224 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b60aae24d0 0x55b60aea9f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:29:01.721 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:01.719+0000 7f6862a00640 1 -- 172.21.15.50:0/1152114224 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b60aae24d0 msgr2=0x55b60aea9f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:29:01.721 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:01.719+0000 7f6862a00640 1 --2- 172.21.15.50:0/1152114224 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b60aae24d0 0x55b60aea9f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:01.721 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:01.719+0000 7f6862a00640 1 -- 172.21.15.50:0/1152114224 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b60aada2f0 msgr2=0x55b60aea93b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:29:01.721 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:01.719+0000 7f6862a00640 1 --2- 172.21.15.50:0/1152114224 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b60aada2f0 0x55b60aea93b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:01.721 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:01.719+0000 7f6862a00640 1 -- 172.21.15.50:0/1152114224 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b60adc5c10 con 0x55b60ab031b0 2024-08-31T04:29:01.729 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:01.724+0000 7f6862a00640 1 --2- 172.21.15.50:0/1152114224 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b60ab031b0 0x55b60aea8d40 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f6854014ab0 tx=0x7f685400b5c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=98f921deb45b4feb server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:29:01.730 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:01.725+0000 7f6858c00640 1 -- 172.21.15.50:0/1152114224 <== mon.2 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6854004030 con 0x55b60ab031b0 2024-08-31T04:29:01.730 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:01.725+0000 7f6858c00640 1 -- 172.21.15.50:0/1152114224 <== mon.2 v2:172.21.15.133:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6854005020 con 0x55b60ab031b0 2024-08-31T04:29:01.730 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:01.725+0000 7f6858c00640 1 -- 172.21.15.50:0/1152114224 <== mon.2 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f685400dac0 con 0x55b60ab031b0 2024-08-31T04:29:01.731 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:01.727+0000 7f685be00640 1 --2- 172.21.15.50:0/3735776948 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f68480b4d40 0x7f68480b7250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:01.731 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:01.727+0000 7f685be00640 1 -- 172.21.15.50:0/3735776948 <== mon.1 v2:172.21.15.177:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8219+0+0 (secure 0 0 0) 0x7f685c0e4fe0 con 0x7f686410f5d0 2024-08-31T04:29:01.740 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:01.731+0000 7f68717c4740 1 -- 172.21.15.50:0/1152114224 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b60ab031b0 msgr2=0x55b60aea8d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:29:01.740 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:01.731+0000 7f68717c4740 1 --2- 172.21.15.50:0/1152114224 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b60ab031b0 0x55b60aea8d40 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f6854014ab0 tx=0x7f685400b5c0 comp rx=0 tx=0).stop 2024-08-31T04:29:01.741 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:01.737+0000 7f6863400640 1 --2- 172.21.15.50:0/3735776948 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f68480b4d40 0x7f68480b7250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:29:01.750 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:01.748+0000 7f68717c4740 1 -- 172.21.15.50:0/1152114224 shutdown_connections 2024-08-31T04:29:01.750 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:01.748+0000 7f68717c4740 1 --2- 172.21.15.50:0/1152114224 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b60aae24d0 0x55b60aea9f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:01.750 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:01.748+0000 7f68717c4740 1 --2- 172.21.15.50:0/1152114224 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b60aada2f0 0x55b60aea93b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:01.750 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:01.748+0000 7f68717c4740 1 --2- 172.21.15.50:0/1152114224 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b60ab031b0 0x55b60aea8d40 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:01.750 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:01.748+0000 7f68717c4740 1 -- 172.21.15.50:0/1152114224 >> 172.21.15.50:0/1152114224 conn(0x55b60aaf7300 msgr2=0x55b60aea47d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:29:01.752 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:01.751+0000 7f68717c4740 1 -- 172.21.15.50:0/1152114224 shutdown_connections 2024-08-31T04:29:01.757 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:01.754+0000 7f6863400640 1 --2- 172.21.15.50:0/3735776948 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f68480b4d40 0x7f68480b7250 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f6850000c00 tx=0x7f6850005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:29:01.758 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:01.756+0000 7f68717c4740 1 -- 172.21.15.50:0/1152114224 wait complete. 2024-08-31T04:29:01.758 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:01.756+0000 7f68717c4740 1 -- start start 2024-08-31T04:29:01.759 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:01.758+0000 7f68717c4740 1 Processor -- start 2024-08-31T04:29:01.792 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:29:01 smithi133 ceph-mon[22177]: pgmap v551: 97 pgs: 97 active+clean; 1.1 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 5.1 MiB/s wr, 295 op/s 2024-08-31T04:29:01.824 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:01.812+0000 7f68717c4740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b60aada2f0 0x55b60aeb2470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:01.825 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:01.812+0000 7f68717c4740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b60aae24d0 0x55b60aeb2b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:01.825 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:01.812+0000 7f68717c4740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b60ab031b0 0x55b60aeb36a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:01.825 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:01.812+0000 7f68717c4740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55b60ad44ab0 con 0x55b60aada2f0 2024-08-31T04:29:01.825 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:01.812+0000 7f68717c4740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x55b60adb2320 con 0x55b60aae24d0 2024-08-31T04:29:01.825 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:01.812+0000 7f68717c4740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x55b60aeaaa20 con 0x55b60ab031b0 2024-08-31T04:29:01.825 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:01.812+0000 7f68717c4740 10 client.0 _ll_register_callbacks cb 0x55b60adebe80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:29:01.825 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:01.813+0000 7f6863e00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b60ab031b0 0x55b60aeb36a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:29:01.825 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:01.813+0000 7f6863e00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b60ab031b0 0x55b60aeb36a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.50:43190/0 (socket says 172.21.15.50:43190) 2024-08-31T04:29:01.825 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:01.813+0000 7f6863e00640 1 -- 172.21.15.50:0/1878935372 learned_addr learned my addr 172.21.15.50:0/1878935372 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:29:01.825 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:01.813+0000 7f6863400640 1 --2- 172.21.15.50:0/1878935372 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b60aada2f0 0x55b60aeb2470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:29:01.825 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:01.814+0000 7f6862a00640 1 --2- 172.21.15.50:0/1878935372 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b60aae24d0 0x55b60aeb2b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:29:01.825 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:01.818+0000 7f6863e00640 1 -- 172.21.15.50:0/1878935372 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b60aae24d0 msgr2=0x55b60aeb2b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:29:01.826 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:01.818+0000 7f6863e00640 1 --2- 172.21.15.50:0/1878935372 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b60aae24d0 0x55b60aeb2b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:01.826 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:01.818+0000 7f6863e00640 1 -- 172.21.15.50:0/1878935372 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b60aada2f0 msgr2=0x55b60aeb2470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:29:01.826 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:01.818+0000 7f6863e00640 1 --2- 172.21.15.50:0/1878935372 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b60aada2f0 0x55b60aeb2470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:01.826 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:01.818+0000 7f6863e00640 1 -- 172.21.15.50:0/1878935372 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b60ab6e790 con 0x55b60ab031b0 2024-08-31T04:29:01.848 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:01.826+0000 7f6863e00640 1 --2- 172.21.15.50:0/1878935372 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b60ab031b0 0x55b60aeb36a0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f685c0a7a40 tx=0x7f685c0a7210 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f7e7e7b954a0b88c server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:29:01.848 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:01.847+0000 7f684d600640 10 client.0 ms_handle_connect on v2:172.21.15.177:3300/0 2024-08-31T04:29:01.849 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:01.847+0000 7f684d600640 1 -- 172.21.15.50:0/1878935372 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f685c094030 con 0x55b60ab031b0 2024-08-31T04:29:01.849 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:01.847+0000 7f684d600640 1 -- 172.21.15.50:0/1878935372 <== mon.1 v2:172.21.15.177:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8219+0+0 (secure 0 0 0) 0x7f685c0a7fb0 con 0x55b60ab031b0 2024-08-31T04:29:01.850 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:01.849+0000 7f68717c4740 1 -- 172.21.15.50:0/1878935372 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6854005020 con 0x55b60ab031b0 2024-08-31T04:29:01.853 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:01.852+0000 7f684d600640 1 -- 172.21.15.50:0/1878935372 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7f685c01a040 con 0x55b60ab031b0 2024-08-31T04:29:01.853 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:01.852+0000 7f68717c4740 10 client.25936 fetch_fsmap learned FSMap version 39 2024-08-31T04:29:01.853 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:01.852+0000 7f68717c4740 1 -- 172.21.15.50:0/1878935372 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) -- 0x55b60abe7620 con 0x55b60ab031b0 2024-08-31T04:29:01.861 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:01.860+0000 7f684d600640 1 -- 172.21.15.50:0/1878935372 <== mon.1 v2:172.21.15.177:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6854005020 con 0x55b60ab031b0 2024-08-31T04:29:01.861 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:01.860+0000 7f684d600640 1 -- 172.21.15.50:0/1878935372 <== mon.1 v2:172.21.15.177:3300/0 5 ==== fsmap(e 39) ==== 8410+0+0 (secure 0 0 0) 0x7f685c00b040 con 0x55b60ab031b0 2024-08-31T04:29:01.887 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:01.882+0000 7f68717c4740 10 client.25936 fetch_fsmap finished waiting for FSMap version 39 2024-08-31T04:29:01.887 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:01.882+0000 7f68717c4740 10 client.25936 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T04:29:01.887 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:01.882+0000 7f68717c4740 20 client.25936 populate_metadata read hostname 'smithi050' 2024-08-31T04:29:01.887 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:01.882+0000 7f68717c4740 1 --2- 172.21.15.50:0/1878935372 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x55b60aac1d80 0x55b60aebfcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:01.888 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:01.882+0000 7f68717c4740 4 client.25936 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T04:29:01.888 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:01.882+0000 7f68717c4740 1 -- 172.21.15.50:0/1878935372 --> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b60ae1dec0 con 0x55b60aac1d80 2024-08-31T04:29:01.890 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:01.889+0000 7f6863400640 1 --2- 172.21.15.50:0/1878935372 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x55b60aac1d80 0x55b60aebfcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:29:01.896 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:01.895+0000 7f6863400640 1 --2- 172.21.15.50:0/1878935372 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x55b60aac1d80 0x55b60aebfcc0 crc :-1 s=READY pgs=96 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=56889f33ecf70064 server_cookie=476eb4964c6a453a in_seq=0 out_seq=0 2024-08-31T04:29:01.896 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:01.895+0000 7f684d600640 10 client.25936 ms_handle_connect on v2:172.21.15.133:6838/2526402262 2024-08-31T04:29:01.902 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:01.897+0000 7f684d600640 1 -- 172.21.15.50:0/1878935372 <== mds.0 v2:172.21.15.133:6838/2526402262 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55b60ae1dec0 con 0x55b60aac1d80 2024-08-31T04:29:01.902 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:01.897+0000 7f684d600640 10 client.25936 handle_command_reply: tid=0 2024-08-31T04:29:01.902 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:01.897+0000 7f68717c4740 1 client.25936 shutdown 2024-08-31T04:29:01.912 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:29:01 smithi050 ceph-mon[17259]: pgmap v551: 97 pgs: 97 active+clean; 1.1 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 5.1 MiB/s wr, 295 op/s 2024-08-31T04:29:01.938 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:01.936+0000 7f68717c4740 1 -- 172.21.15.50:0/1878935372 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b60ab031b0 msgr2=0x55b60aeb36a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:29:01.938 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:01.936+0000 7f68717c4740 1 --2- 172.21.15.50:0/1878935372 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b60ab031b0 0x55b60aeb36a0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f685c0a7a40 tx=0x7f685c0a7210 comp rx=0 tx=0).stop 2024-08-31T04:29:01.938 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:01.936+0000 7f68717c4740 1 -- 172.21.15.50:0/1878935372 shutdown_connections 2024-08-31T04:29:01.939 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:01.936+0000 7f68717c4740 1 --2- 172.21.15.50:0/1878935372 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x55b60aac1d80 0x55b60aebfcc0 crc :-1 s=READY pgs=96 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:01.939 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:01.936+0000 7f68717c4740 1 --2- 172.21.15.50:0/1878935372 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b60ab031b0 0x55b60aeb36a0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:01.939 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:01.936+0000 7f68717c4740 1 --2- 172.21.15.50:0/1878935372 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b60aae24d0 0x55b60aeb2b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:01.939 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:01.937+0000 7f68717c4740 1 --2- 172.21.15.50:0/1878935372 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b60aada2f0 0x55b60aeb2470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:01.939 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:01.937+0000 7f68717c4740 1 -- 172.21.15.50:0/1878935372 >> 172.21.15.50:0/1878935372 conn(0x55b60aaf7300 msgr2=0x55b60aea2d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:29:01.939 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:01.937+0000 7f684d600640 0 client.25936 ms_handle_reset on v2:172.21.15.133:6838/2526402262 2024-08-31T04:29:01.940 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:01.939+0000 7f68717c4740 1 -- 172.21.15.50:0/1878935372 shutdown_connections 2024-08-31T04:29:01.940 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:01.939+0000 7f68717c4740 1 -- 172.21.15.50:0/1878935372 wait complete. 2024-08-31T04:29:01.940 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:01.939+0000 7f68717c4740 20 client.25936 trim_cache size 0 max 16384 2024-08-31T04:29:01.996 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:29:01 smithi177 ceph-mon[22025]: pgmap v551: 97 pgs: 97 active+clean; 1.1 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 5.1 MiB/s wr, 295 op/s 2024-08-31T04:29:02.483 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:02.450+0000 7f68717c4740 1 Processor -- start 2024-08-31T04:29:02.508 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:02.499+0000 7f68717c4740 1 -- start start 2024-08-31T04:29:02.508 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:02.499+0000 7f68717c4740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b60aada2f0 0x55b60aead560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:02.509 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:02.499+0000 7f68717c4740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b60aae24d0 0x55b60aeb0980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:02.509 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:02.499+0000 7f68717c4740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b60ab031b0 0x55b60aeb0ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:02.509 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:02.499+0000 7f68717c4740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f686407de50 con 0x55b60aae24d0 2024-08-31T04:29:02.509 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:02.499+0000 7f68717c4740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f686407fbd0 con 0x55b60ab031b0 2024-08-31T04:29:02.509 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:02.499+0000 7f68717c4740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f686407e520 con 0x55b60aada2f0 2024-08-31T04:29:02.509 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:02.503+0000 7f6863e00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b60ab031b0 0x55b60aeb0ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:29:02.509 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:02.504+0000 7f6863e00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b60ab031b0 0x55b60aeb0ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.50:40230/0 (socket says 172.21.15.50:40230) 2024-08-31T04:29:02.509 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:02.504+0000 7f6863e00640 1 -- 172.21.15.50:0/1834954689 learned_addr learned my addr 172.21.15.50:0/1834954689 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:29:02.509 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:02.505+0000 7f6863400640 1 --2- 172.21.15.50:0/1834954689 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b60aada2f0 0x55b60aead560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:29:02.509 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:02.506+0000 7f6862a00640 1 --2- 172.21.15.50:0/1834954689 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b60aae24d0 0x55b60aeb0980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:29:02.511 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:02.508+0000 7f6863e00640 1 -- 172.21.15.50:0/1834954689 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b60aada2f0 msgr2=0x55b60aead560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:29:02.511 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:02.509+0000 7f6863e00640 1 --2- 172.21.15.50:0/1834954689 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b60aada2f0 0x55b60aead560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:02.511 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:02.509+0000 7f6863e00640 1 -- 172.21.15.50:0/1834954689 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b60aae24d0 msgr2=0x55b60aeb0980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:29:02.511 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:02.509+0000 7f6863e00640 1 --2- 172.21.15.50:0/1834954689 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b60aae24d0 0x55b60aeb0980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:02.512 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:02.509+0000 7f6863e00640 1 -- 172.21.15.50:0/1834954689 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b60aea96a0 con 0x55b60ab031b0 2024-08-31T04:29:02.584 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:02.536+0000 7f6863e00640 1 --2- 172.21.15.50:0/1834954689 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b60ab031b0 0x55b60aeb0ec0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f685c0a7f60 tx=0x7f685c0a7280 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bf640e708652d12d server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:29:02.584 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:02.545+0000 7f684fe00640 1 -- 172.21.15.50:0/1834954689 <== mon.2 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f685c094020 con 0x55b60ab031b0 2024-08-31T04:29:02.584 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:02.545+0000 7f684fe00640 1 -- 172.21.15.50:0/1834954689 <== mon.2 v2:172.21.15.133:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f685c0b0020 con 0x55b60ab031b0 2024-08-31T04:29:02.584 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:02.545+0000 7f684fe00640 1 -- 172.21.15.50:0/1834954689 <== mon.2 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f685c0b4ce0 con 0x55b60ab031b0 2024-08-31T04:29:02.596 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:02.592+0000 7f68717c4740 1 -- 172.21.15.50:0/1834954689 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b60ab031b0 msgr2=0x55b60aeb0ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:29:02.596 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:02.592+0000 7f68717c4740 1 --2- 172.21.15.50:0/1834954689 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b60ab031b0 0x55b60aeb0ec0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f685c0a7f60 tx=0x7f685c0a7280 comp rx=0 tx=0).stop 2024-08-31T04:29:02.635 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:02.632+0000 7f68717c4740 1 -- 172.21.15.50:0/1834954689 shutdown_connections 2024-08-31T04:29:02.635 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:02.632+0000 7f68717c4740 1 --2- 172.21.15.50:0/1834954689 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b60ab031b0 0x55b60aeb0ec0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:02.635 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:02.632+0000 7f68717c4740 1 --2- 172.21.15.50:0/1834954689 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b60aae24d0 0x55b60aeb0980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:02.636 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:02.632+0000 7f68717c4740 1 --2- 172.21.15.50:0/1834954689 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b60aada2f0 0x55b60aead560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:02.637 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:02.632+0000 7f68717c4740 1 -- 172.21.15.50:0/1834954689 >> 172.21.15.50:0/1834954689 conn(0x55b60aaf7300 msgr2=0x55b60aeace50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:29:02.642 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:02.639+0000 7f68717c4740 1 -- 172.21.15.50:0/1834954689 shutdown_connections 2024-08-31T04:29:02.648 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:02.642+0000 7f68717c4740 1 -- 172.21.15.50:0/1834954689 wait complete. 2024-08-31T04:29:02.679 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:02.663+0000 7f68717c4740 1 -- start start 2024-08-31T04:29:02.679 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:02.663+0000 7f68717c4740 1 Processor -- start 2024-08-31T04:29:02.679 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:02.678+0000 7f68717c4740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b60aada2f0 0x55b60aeb6600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:02.686 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:02.678+0000 7f68717c4740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b60aae24d0 0x55b60aeb8c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:02.687 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:02.678+0000 7f68717c4740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b60ab031b0 0x55b60aeb9350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:02.687 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:02.679+0000 7f6863400640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b60aada2f0 0x55b60aeb6600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:29:02.687 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:02.679+0000 7f6863400640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b60aada2f0 0x55b60aeb6600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.50:43194/0 (socket says 172.21.15.50:43194) 2024-08-31T04:29:02.687 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:02.679+0000 7f6862a00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b60aae24d0 0x55b60aeb8c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:29:02.687 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:02.679+0000 7f6862a00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b60aae24d0 0x55b60aeb8c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.50:40238/0 (socket says 172.21.15.50:40238) 2024-08-31T04:29:02.687 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:02.681+0000 7f6863e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b60ab031b0 0x55b60aeb9350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:29:02.687 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:02.681+0000 7f6863e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b60ab031b0 0x55b60aeb9350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35614/0 (socket says 172.21.15.50:35614) 2024-08-31T04:29:02.687 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:02.681+0000 7f6863400640 1 -- 172.21.15.50:0/1283091356 learned_addr learned my addr 172.21.15.50:0/1283091356 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:29:02.687 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:02.681+0000 7f68717c4740 1 -- 172.21.15.50:0/1283091356 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f686407f440 con 0x55b60ab031b0 2024-08-31T04:29:02.687 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:02.681+0000 7f68717c4740 1 -- 172.21.15.50:0/1283091356 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f686407ecb0 con 0x55b60aae24d0 2024-08-31T04:29:02.687 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:02.681+0000 7f68717c4740 1 -- 172.21.15.50:0/1283091356 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f686407be30 con 0x55b60aada2f0 2024-08-31T04:29:02.687 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:02.682+0000 7f6863e00640 1 -- 172.21.15.50:0/1283091356 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b60aada2f0 msgr2=0x55b60aeb6600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:29:02.687 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:02.682+0000 7f6863e00640 1 --2- 172.21.15.50:0/1283091356 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b60aada2f0 0x55b60aeb6600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:02.688 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:02.682+0000 7f6863e00640 1 -- 172.21.15.50:0/1283091356 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b60aae24d0 msgr2=0x55b60aeb8c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:29:02.688 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:02.682+0000 7f6863e00640 1 --2- 172.21.15.50:0/1283091356 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b60aae24d0 0x55b60aeb8c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:02.688 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:02.682+0000 7f6863e00640 1 -- 172.21.15.50:0/1283091356 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b60aeb9ae0 con 0x55b60ab031b0 2024-08-31T04:29:02.688 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:02.683+0000 7f68717c4740 10 client.0 _ll_register_callbacks cb 0x7f685c004890 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:29:02.688 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:02.683+0000 7f68717c4740 1 -- 172.21.15.50:0/1283091356 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f685c0b0020 con 0x55b60ab031b0 2024-08-31T04:29:02.688 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:02.684+0000 7f6863e00640 1 --2- 172.21.15.50:0/1283091356 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b60ab031b0 0x55b60aeb9350 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f685c0a7f60 tx=0x7f685c0042e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=285f26bf5c559ceb server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:29:02.689 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:02.686+0000 7f684d600640 10 client.15954 ms_handle_connect on v2:172.21.15.50:3300/0 2024-08-31T04:29:02.690 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:02.686+0000 7f684d600640 1 -- 172.21.15.50:0/1283091356 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f685c094070 con 0x55b60ab031b0 2024-08-31T04:29:02.690 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:02.686+0000 7f684d600640 1 -- 172.21.15.50:0/1283091356 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8219+0+0 (secure 0 0 0) 0x7f685c003b80 con 0x55b60ab031b0 2024-08-31T04:29:02.690 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:02.686+0000 7f684d600640 1 -- 172.21.15.50:0/1283091356 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7f685c0b4850 con 0x55b60ab031b0 2024-08-31T04:29:02.773 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:02.722+0000 7f68717c4740 10 client.15954 fetch_fsmap learned FSMap version 39 2024-08-31T04:29:02.773 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:02.722+0000 7f68717c4740 1 -- 172.21.15.50:0/1283091356 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({fsmap=39}) -- 0x55b60af3bc80 con 0x55b60ab031b0 2024-08-31T04:29:02.775 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:02.774+0000 7f684d600640 1 -- 172.21.15.50:0/1283091356 <== mon.0 v2:172.21.15.50:3300/0 4 ==== fsmap(e 39) ==== 8410+0+0 (secure 0 0 0) 0x7f685c0c60f0 con 0x55b60ab031b0 2024-08-31T04:29:02.805 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:02.784+0000 7f68717c4740 10 client.15954 fetch_fsmap finished waiting for FSMap version 39 2024-08-31T04:29:02.806 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:02.784+0000 7f68717c4740 10 client.15954 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T04:29:02.806 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:02.784+0000 7f68717c4740 20 client.15954 populate_metadata read hostname 'smithi050' 2024-08-31T04:29:02.806 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:02.784+0000 7f68717c4740 1 --2- 172.21.15.50:0/1283091356 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x55b60aa971c0 0x55b60af3e400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:02.806 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:02.784+0000 7f68717c4740 4 client.15954 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-31T04:29:02.806 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:02.784+0000 7f68717c4740 1 -- 172.21.15.50:0/1283091356 --> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55b60ae19960 con 0x55b60aa971c0 2024-08-31T04:29:02.842 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:02.819+0000 7f6863400640 1 --2- 172.21.15.50:0/1283091356 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x55b60aa971c0 0x55b60af3e400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:29:02.874 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:02.855+0000 7f6863400640 1 --2- 172.21.15.50:0/1283091356 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x55b60aa971c0 0x55b60af3e400 crc :-1 s=READY pgs=97 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f5c3e055466e6772 server_cookie=7ccebd02de7cf422 in_seq=0 out_seq=0 2024-08-31T04:29:02.950 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:02.949+0000 7f684d600640 10 client.15954 ms_handle_connect on v2:172.21.15.133:6838/2526402262 2024-08-31T04:29:03.950 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:29:03 smithi050 ceph-mon[17259]: pgmap v552: 97 pgs: 97 active+clean; 1.2 GiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 12 MiB/s wr, 661 op/s 2024-08-31T04:29:03.996 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:29:03 smithi177 ceph-mon[22025]: pgmap v552: 97 pgs: 97 active+clean; 1.2 GiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 12 MiB/s wr, 661 op/s 2024-08-31T04:29:04.042 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:29:03 smithi133 ceph-mon[22177]: pgmap v552: 97 pgs: 97 active+clean; 1.2 GiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 12 MiB/s wr, 661 op/s 2024-08-31T04:29:04.455 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:04.448+0000 7f684d600640 1 -- 172.21.15.50:0/1283091356 <== mds.0 v2:172.21.15.133:6838/2526402262 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55b60ae19960 con 0x55b60aa971c0 2024-08-31T04:29:04.455 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:04.449+0000 7f684d600640 10 client.15954 handle_command_reply: tid=0 2024-08-31T04:29:04.455 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:04.449+0000 7f68717c4740 1 client.15954 shutdown 2024-08-31T04:29:04.455 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:04.452+0000 7f68717c4740 1 -- 172.21.15.50:0/1283091356 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b60ab031b0 msgr2=0x55b60aeb9350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:29:04.455 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:04.452+0000 7f68717c4740 1 --2- 172.21.15.50:0/1283091356 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b60ab031b0 0x55b60aeb9350 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f685c0a7f60 tx=0x7f685c0042e0 comp rx=0 tx=0).stop 2024-08-31T04:29:04.455 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:04.453+0000 7f68717c4740 1 -- 172.21.15.50:0/1283091356 shutdown_connections 2024-08-31T04:29:04.455 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:04.453+0000 7f68717c4740 1 --2- 172.21.15.50:0/1283091356 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x55b60aa971c0 0x55b60af3e400 crc :-1 s=READY pgs=97 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:04.455 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:04.453+0000 7f68717c4740 1 --2- 172.21.15.50:0/1283091356 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b60ab031b0 0x55b60aeb9350 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:04.456 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:04.453+0000 7f68717c4740 1 --2- 172.21.15.50:0/1283091356 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b60aae24d0 0x55b60aeb8c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:04.456 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:04.453+0000 7f68717c4740 1 --2- 172.21.15.50:0/1283091356 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b60aada2f0 0x55b60aeb6600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:04.456 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:04.453+0000 7f68717c4740 1 -- 172.21.15.50:0/1283091356 >> 172.21.15.50:0/1283091356 conn(0x55b60aaf7300 msgr2=0x55b60aea5000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:29:04.456 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:04.453+0000 7f684d600640 0 client.15954 ms_handle_reset on v2:172.21.15.133:6838/2526402262 2024-08-31T04:29:04.456 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:04.453+0000 7f68717c4740 1 -- 172.21.15.50:0/1283091356 shutdown_connections 2024-08-31T04:29:04.456 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:04.453+0000 7f68717c4740 1 -- 172.21.15.50:0/1283091356 wait complete. 2024-08-31T04:29:04.468 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:04.467+0000 7f68717c4740 20 client.15954 trim_cache size 0 max 16384 2024-08-31T04:29:04.502 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout:{ 2024-08-31T04:29:04.502 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout: "message": "", 2024-08-31T04:29:04.502 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout: "return_code": 0 2024-08-31T04:29:04.502 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout:} 2024-08-31T04:29:04.517 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:04.515+0000 7f6869000640 1 -- 172.21.15.50:0/3735776948 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f68480b4d40 msgr2=0x7f68480b7250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:29:04.517 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:04.516+0000 7f6869000640 1 --2- 172.21.15.50:0/3735776948 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f68480b4d40 0x7f68480b7250 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f6850000c00 tx=0x7f6850005f90 comp rx=0 tx=0).stop 2024-08-31T04:29:04.518 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:04.517+0000 7f6869000640 1 -- 172.21.15.50:0/3735776948 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f686410f5d0 msgr2=0x7f68641a9b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:29:04.518 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:04.517+0000 7f6869000640 1 --2- 172.21.15.50:0/3735776948 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f686410f5d0 0x7f68641a9b30 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f685c00ef00 tx=0x7f685c00c740 comp rx=0 tx=0).stop 2024-08-31T04:29:04.519 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:04.517+0000 7f6869000640 1 -- 172.21.15.50:0/3735776948 shutdown_connections 2024-08-31T04:29:04.519 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:04.517+0000 7f6869000640 1 --2- 172.21.15.50:0/3735776948 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f68480b4d40 0x7f68480b7250 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:04.519 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:04.517+0000 7f6869000640 1 --2- 172.21.15.50:0/3735776948 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f686410f5d0 0x7f68641a9b30 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:04.519 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:04.517+0000 7f6869000640 1 --2- 172.21.15.50:0/3735776948 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f686410cac0 0x7f68641a8f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:04.519 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:04.517+0000 7f6869000640 1 --2- 172.21.15.50:0/3735776948 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f686410a160 0x7f68641a8910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:04.519 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:04.517+0000 7f6869000640 1 -- 172.21.15.50:0/3735776948 >> 172.21.15.50:0/3735776948 conn(0x7f68640703e0 msgr2=0x7f686410af50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:29:04.522 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:04.518+0000 7f6869000640 1 -- 172.21.15.50:0/3735776948 shutdown_connections 2024-08-31T04:29:04.522 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:04.520+0000 7f6869000640 1 -- 172.21.15.50:0/3735776948 wait complete. 2024-08-31T04:29:05.509 INFO:tasks.workunit.client.0.smithi050.stdout: 358 484170 880 339906 831 124449 567 2024-08-31T04:29:05.950 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:29:05 smithi050 ceph-mon[17259]: pgmap v553: 97 pgs: 97 active+clean; 1.2 GiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 12 MiB/s wr, 645 op/s 2024-08-31T04:29:05.996 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:29:05 smithi177 ceph-mon[22025]: pgmap v553: 97 pgs: 97 active+clean; 1.2 GiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 12 MiB/s wr, 645 op/s 2024-08-31T04:29:06.043 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:29:05 smithi133 ceph-mon[22177]: pgmap v553: 97 pgs: 97 active+clean; 1.2 GiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 12 MiB/s wr, 645 op/s 2024-08-31T04:29:07.950 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:29:07 smithi050 ceph-mon[17259]: pgmap v554: 97 pgs: 97 active+clean; 1.2 GiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 14 MiB/s wr, 873 op/s 2024-08-31T04:29:07.996 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:29:07 smithi177 ceph-mon[22025]: pgmap v554: 97 pgs: 97 active+clean; 1.2 GiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 14 MiB/s wr, 873 op/s 2024-08-31T04:29:08.043 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:29:07 smithi133 ceph-mon[22177]: pgmap v554: 97 pgs: 97 active+clean; 1.2 GiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 14 MiB/s wr, 873 op/s 2024-08-31T04:29:09.950 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:29:09 smithi050 ceph-mon[17259]: pgmap v555: 97 pgs: 97 active+clean; 1.2 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 12 MiB/s wr, 927 op/s 2024-08-31T04:29:09.996 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:29:09 smithi177 ceph-mon[22025]: pgmap v555: 97 pgs: 97 active+clean; 1.2 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 12 MiB/s wr, 927 op/s 2024-08-31T04:29:10.043 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:29:09 smithi133 ceph-mon[22177]: pgmap v555: 97 pgs: 97 active+clean; 1.2 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 12 MiB/s wr, 927 op/s 2024-08-31T04:29:10.175 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 32.7 2024-08-31T04:29:10.176 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 058d9fc6-674f-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-31T04:29:11.952 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:29:11 smithi050 ceph-mon[17259]: pgmap v556: 97 pgs: 97 active+clean; 1.2 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 10 MiB/s wr, 856 op/s 2024-08-31T04:29:11.996 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:29:11 smithi177 ceph-mon[22025]: pgmap v556: 97 pgs: 97 active+clean; 1.2 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 10 MiB/s wr, 856 op/s 2024-08-31T04:29:12.042 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:29:11 smithi133 ceph-mon[22177]: pgmap v556: 97 pgs: 97 active+clean; 1.2 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 10 MiB/s wr, 856 op/s 2024-08-31T04:29:13.845 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:29:13 smithi133 ceph-mon[22177]: pgmap v557: 97 pgs: 97 active+clean; 1.2 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 11 MiB/s wr, 917 op/s 2024-08-31T04:29:13.950 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:29:13 smithi050 ceph-mon[17259]: pgmap v557: 97 pgs: 97 active+clean; 1.2 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 11 MiB/s wr, 917 op/s 2024-08-31T04:29:13.996 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:29:13 smithi177 ceph-mon[22025]: pgmap v557: 97 pgs: 97 active+clean; 1.2 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 11 MiB/s wr, 917 op/s 2024-08-31T04:29:15.528 INFO:tasks.workunit.client.0.smithi050.stdout: 384 558523 1274 392697 1332 142264 1247 2024-08-31T04:29:15.704 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:29:15 smithi050 ceph-mon[17259]: pgmap v558: 97 pgs: 97 active+clean; 1.2 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 4.4 MiB/s wr, 549 op/s 2024-08-31T04:29:15.996 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:29:15 smithi177 ceph-mon[22025]: pgmap v558: 97 pgs: 97 active+clean; 1.2 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 4.4 MiB/s wr, 549 op/s 2024-08-31T04:29:16.042 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:29:15 smithi133 ceph-mon[22177]: pgmap v558: 97 pgs: 97 active+clean; 1.2 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 4.4 MiB/s wr, 549 op/s 2024-08-31T04:29:17.950 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:29:17 smithi050 ceph-mon[17259]: pgmap v559: 97 pgs: 97 active+clean; 1.2 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 4.8 MiB/s wr, 599 op/s 2024-08-31T04:29:17.996 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:29:17 smithi177 ceph-mon[22025]: pgmap v559: 97 pgs: 97 active+clean; 1.2 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 4.8 MiB/s wr, 599 op/s 2024-08-31T04:29:18.043 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:29:17 smithi133 ceph-mon[22177]: pgmap v559: 97 pgs: 97 active+clean; 1.2 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 4.8 MiB/s wr, 599 op/s 2024-08-31T04:29:19.950 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:29:19 smithi050 ceph-mon[17259]: pgmap v560: 97 pgs: 97 active+clean; 1.2 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 5.0 MiB/s wr, 461 op/s 2024-08-31T04:29:19.996 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:29:19 smithi177 ceph-mon[22025]: pgmap v560: 97 pgs: 97 active+clean; 1.2 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 5.0 MiB/s wr, 461 op/s 2024-08-31T04:29:20.043 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:29:19 smithi133 ceph-mon[22177]: pgmap v560: 97 pgs: 97 active+clean; 1.2 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 5.0 MiB/s wr, 461 op/s 2024-08-31T04:29:21.954 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:29:21 smithi050 ceph-mon[17259]: pgmap v561: 97 pgs: 97 active+clean; 1.2 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 3.8 MiB/s wr, 250 op/s 2024-08-31T04:29:21.954 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:29:21 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T04:29:21.996 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:29:21 smithi177 ceph-mon[22025]: pgmap v561: 97 pgs: 97 active+clean; 1.2 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 3.8 MiB/s wr, 250 op/s 2024-08-31T04:29:21.996 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:29:21 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T04:29:22.043 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:29:21 smithi133 ceph-mon[22177]: pgmap v561: 97 pgs: 97 active+clean; 1.2 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 3.8 MiB/s wr, 250 op/s 2024-08-31T04:29:22.043 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:29:21 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T04:29:22.996 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:29:22 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-08-31T04:29:22.996 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:29:22 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-08-31T04:29:22.996 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:29:22 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-08-31T04:29:22.996 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:29:22 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"} : dispatch 2024-08-31T04:29:23.024 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:29:22 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-08-31T04:29:23.024 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:29:22 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-08-31T04:29:23.025 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:29:22 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-08-31T04:29:23.025 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:29:22 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"} : dispatch 2024-08-31T04:29:23.043 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:29:22 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-08-31T04:29:23.043 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:29:22 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-08-31T04:29:23.043 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:29:22 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-08-31T04:29:23.043 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:29:22 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"} : dispatch 2024-08-31T04:29:23.863 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:23.862+0000 7f245ee00640 1 -- 172.21.15.50:0/3105452819 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f245810f5d0 msgr2=0x7f245810fad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:29:23.863 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:23.862+0000 7f245ee00640 1 --2- 172.21.15.50:0/3105452819 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f245810f5d0 0x7f245810fad0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f2450009ca0 tx=0x7f245002a8d0 comp rx=0 tx=0).stop 2024-08-31T04:29:23.870 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:23.869+0000 7f245ee00640 1 -- 172.21.15.50:0/3105452819 shutdown_connections 2024-08-31T04:29:23.870 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:23.869+0000 7f245ee00640 1 --2- 172.21.15.50:0/3105452819 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f245810f5d0 0x7f245810fad0 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:23.870 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:23.869+0000 7f245ee00640 1 --2- 172.21.15.50:0/3105452819 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f245810cac0 0x7f245810eee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:23.870 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:23.869+0000 7f245ee00640 1 --2- 172.21.15.50:0/3105452819 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f245810a160 0x7f245810c580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:23.870 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:23.869+0000 7f245ee00640 1 -- 172.21.15.50:0/3105452819 >> 172.21.15.50:0/3105452819 conn(0x7f2458070410 msgr2=0x7f24580728c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:29:23.873 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:23.869+0000 7f245ee00640 1 -- 172.21.15.50:0/3105452819 shutdown_connections 2024-08-31T04:29:23.878 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:23.872+0000 7f245ee00640 1 -- 172.21.15.50:0/3105452819 wait complete. 2024-08-31T04:29:23.890 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:23.880+0000 7f245ee00640 1 Processor -- start 2024-08-31T04:29:23.899 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:29:23 smithi050 ceph-mon[17259]: Adjusting osd_memory_target on smithi133 to 176.0M 2024-08-31T04:29:23.900 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:29:23 smithi050 ceph-mon[17259]: Unable to set osd_memory_target on smithi133 to 184575283: error parsing value: Value '184575283' is below minimum 939524096 2024-08-31T04:29:23.900 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:29:23 smithi050 ceph-mon[17259]: pgmap v562: 97 pgs: 97 active+clean; 1.2 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 6.5 MiB/s wr, 404 op/s 2024-08-31T04:29:23.902 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:23.899+0000 7f245ee00640 1 -- start start 2024-08-31T04:29:23.902 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:23.899+0000 7f245ee00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f245810a160 0x7f2458116dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:23.902 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:23.899+0000 7f245ee00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f245810cac0 0x7f2458117440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:23.902 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:23.900+0000 7f2457e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f245810a160 0x7f2458116dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:29:23.902 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:23.900+0000 7f2457e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f245810a160 0x7f2458116dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:52318/0 (socket says 172.21.15.50:52318) 2024-08-31T04:29:23.902 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:23.900+0000 7f245ee00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f245810f5d0 0x7f2458117ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:23.902 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:23.900+0000 7f245ee00640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f245811dd60 con 0x7f245810a160 2024-08-31T04:29:23.902 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:23.900+0000 7f245ee00640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f245811dbe0 con 0x7f245810cac0 2024-08-31T04:29:23.902 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:23.900+0000 7f245ee00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f245811dee0 con 0x7f245810f5d0 2024-08-31T04:29:23.904 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:23.901+0000 7f2457400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f245810cac0 0x7f2458117440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:29:23.904 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:23.901+0000 7f2457400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f245810cac0 0x7f2458117440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.50:51446/0 (socket says 172.21.15.50:51446) 2024-08-31T04:29:23.904 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:23.901+0000 7f2457400640 1 -- 172.21.15.50:0/3902249720 learned_addr learned my addr 172.21.15.50:0/3902249720 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:29:23.904 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:23.901+0000 7f245ce00640 1 --2- 172.21.15.50:0/3902249720 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f245810f5d0 0x7f2458117ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:29:23.904 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:23.901+0000 7f2457400640 1 -- 172.21.15.50:0/3902249720 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f245810f5d0 msgr2=0x7f2458117ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:29:23.904 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:23.901+0000 7f2457400640 1 --2- 172.21.15.50:0/3902249720 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f245810f5d0 0x7f2458117ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:23.904 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:23.901+0000 7f2457400640 1 -- 172.21.15.50:0/3902249720 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f245810a160 msgr2=0x7f2458116dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:29:23.904 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:23.901+0000 7f2457400640 1 --2- 172.21.15.50:0/3902249720 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f245810a160 0x7f2458116dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:23.904 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:23.901+0000 7f2457400640 1 -- 172.21.15.50:0/3902249720 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2458118780 con 0x7f245810cac0 2024-08-31T04:29:23.914 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:23.913+0000 7f2457400640 1 --2- 172.21.15.50:0/3902249720 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f245810cac0 0x7f2458117440 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f244400c920 tx=0x7f244400cde0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:29:23.931 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:23.926+0000 7f2454c00640 1 -- 172.21.15.50:0/3902249720 <== mon.2 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2444007c70 con 0x7f245810cac0 2024-08-31T04:29:23.931 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:23.926+0000 7f2454c00640 1 -- 172.21.15.50:0/3902249720 <== mon.2 v2:172.21.15.133:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2444007e10 con 0x7f245810cac0 2024-08-31T04:29:23.931 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:23.926+0000 7f2454c00640 1 -- 172.21.15.50:0/3902249720 <== mon.2 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2444018820 con 0x7f245810cac0 2024-08-31T04:29:23.941 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:23.935+0000 7f245ee00640 1 -- 172.21.15.50:0/3902249720 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2458118a70 con 0x7f245810cac0 2024-08-31T04:29:23.941 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:23.935+0000 7f245ee00640 1 -- 172.21.15.50:0/3902249720 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2458119060 con 0x7f245810cac0 2024-08-31T04:29:23.996 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:29:23 smithi177 ceph-mon[22025]: Adjusting osd_memory_target on smithi133 to 176.0M 2024-08-31T04:29:23.996 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:29:23 smithi177 ceph-mon[22025]: Unable to set osd_memory_target on smithi133 to 184575283: error parsing value: Value '184575283' is below minimum 939524096 2024-08-31T04:29:23.996 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:29:23 smithi177 ceph-mon[22025]: pgmap v562: 97 pgs: 97 active+clean; 1.2 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 6.5 MiB/s wr, 404 op/s 2024-08-31T04:29:23.997 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:23.995+0000 7f2454c00640 1 -- 172.21.15.50:0/3902249720 <== mon.2 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 18) ==== 152577+0+0 (secure 0 0 0) 0x7f244400f450 con 0x7f245810cac0 2024-08-31T04:29:24.000 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:23.998+0000 7f2454c00640 1 --2- 172.21.15.50:0/3902249720 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f243c0b4cc0 0x7f243c0b71d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:24.004 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:23.999+0000 7f2454c00640 1 -- 172.21.15.50:0/3902249720 <== mon.2 v2:172.21.15.133:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8219+0+0 (secure 0 0 0) 0x7f24440a81b0 con 0x7f245810cac0 2024-08-31T04:29:24.004 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:23.999+0000 7f2465e60740 1 Processor -- start 2024-08-31T04:29:24.011 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:24.008+0000 7f2465e60740 1 -- start start 2024-08-31T04:29:24.011 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:24.008+0000 7f2457e00640 1 --2- 172.21.15.50:0/3902249720 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f243c0b4cc0 0x7f243c0b71d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:29:24.011 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:24.009+0000 7f2465e60740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557b16fd11b0 0x557b17376fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:24.011 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:24.009+0000 7f2465e60740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557b16fa82f0 0x557b17377610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:24.011 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:24.009+0000 7f2465e60740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x557b16fb04d0 0x557b17378160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:24.011 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:24.009+0000 7f2465e60740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x557b172e9f70 con 0x557b16fd11b0 2024-08-31T04:29:24.011 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:24.009+0000 7f2465e60740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x557b172d9500 con 0x557b16fb04d0 2024-08-31T04:29:24.011 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:24.009+0000 7f2465e60740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x557b172dd4b0 con 0x557b16fa82f0 2024-08-31T04:29:24.012 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:24.010+0000 7f2457400640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557b16fa82f0 0x557b17377610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:29:24.012 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:24.010+0000 7f2457400640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557b16fa82f0 0x557b17377610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.50:43042/0 (socket says 172.21.15.50:43042) 2024-08-31T04:29:24.012 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:24.010+0000 7f2457400640 1 -- 172.21.15.50:0/879559036 learned_addr learned my addr 172.21.15.50:0/879559036 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:29:24.012 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:24.010+0000 7f2457e00640 1 --2- 172.21.15.50:0/879559036 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557b16fd11b0 0x557b17376fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:29:24.014 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:24.013+0000 7f2457e00640 1 -- 172.21.15.50:0/879559036 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557b16fa82f0 msgr2=0x557b17377610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:29:24.014 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:24.013+0000 7f2457e00640 1 --2- 172.21.15.50:0/879559036 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557b16fa82f0 0x557b17377610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:24.014 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:24.013+0000 7f245ce00640 1 --2- 172.21.15.50:0/879559036 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x557b16fb04d0 0x557b17378160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:29:24.014 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:24.013+0000 7f2457e00640 1 -- 172.21.15.50:0/879559036 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x557b16fb04d0 msgr2=0x557b17378160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:29:24.016 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:24.013+0000 7f2457e00640 1 --2- 172.21.15.50:0/879559036 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x557b16fb04d0 0x557b17378160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:24.016 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:24.013+0000 7f2457e00640 1 -- 172.21.15.50:0/879559036 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557b17293c10 con 0x557b16fd11b0 2024-08-31T04:29:24.016 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:24.013+0000 7f2457e00640 1 --2- 172.21.15.50:0/879559036 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557b16fd11b0 0x557b17376fa0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f2448009fc0 tx=0x7f2448014720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c498d9808b7efacb server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:29:24.017 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:24.014+0000 7f245ce00640 1 --2- 172.21.15.50:0/879559036 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x557b16fb04d0 0x557b17378160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T04:29:24.017 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:24.015+0000 7f2457e00640 1 --2- 172.21.15.50:0/3902249720 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f243c0b4cc0 0x7f243c0b71d0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f2448014c20 tx=0x7f2448012000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:29:24.020 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:24.018+0000 7f244d600640 1 -- 172.21.15.50:0/879559036 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f244801d070 con 0x557b16fd11b0 2024-08-31T04:29:24.020 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:24.018+0000 7f244d600640 1 -- 172.21.15.50:0/879559036 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2448010040 con 0x557b16fd11b0 2024-08-31T04:29:24.020 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:24.018+0000 7f244d600640 1 -- 172.21.15.50:0/879559036 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24480206e0 con 0x557b16fd11b0 2024-08-31T04:29:24.022 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:24.021+0000 7f2465e60740 1 -- 172.21.15.50:0/879559036 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557b16fd11b0 msgr2=0x557b17376fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:29:24.022 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:24.021+0000 7f2465e60740 1 --2- 172.21.15.50:0/879559036 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557b16fd11b0 0x557b17376fa0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f2448009fc0 tx=0x7f2448014720 comp rx=0 tx=0).stop 2024-08-31T04:29:24.028 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:24.026+0000 7f2465e60740 1 -- 172.21.15.50:0/879559036 shutdown_connections 2024-08-31T04:29:24.028 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:24.026+0000 7f2465e60740 1 --2- 172.21.15.50:0/879559036 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557b16fa82f0 0x557b17377610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:24.028 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:24.026+0000 7f2465e60740 1 --2- 172.21.15.50:0/879559036 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x557b16fb04d0 0x557b17378160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:24.028 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:24.026+0000 7f2465e60740 1 --2- 172.21.15.50:0/879559036 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557b16fd11b0 0x557b17376fa0 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:24.028 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:24.026+0000 7f2465e60740 1 -- 172.21.15.50:0/879559036 >> 172.21.15.50:0/879559036 conn(0x557b16fc5300 msgr2=0x557b17372a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:29:24.031 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:24.028+0000 7f2465e60740 1 -- 172.21.15.50:0/879559036 shutdown_connections 2024-08-31T04:29:24.031 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:24.028+0000 7f2465e60740 1 -- 172.21.15.50:0/879559036 wait complete. 2024-08-31T04:29:24.031 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:24.029+0000 7f2465e60740 1 -- start start 2024-08-31T04:29:24.031 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:24.030+0000 7f2465e60740 1 Processor -- start 2024-08-31T04:29:24.035 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:24.034+0000 7f2465e60740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x557b16fa82f0 0x557b173806f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:24.035 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:24.034+0000 7f2465e60740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557b16fb04d0 0x557b17380db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:24.035 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:24.034+0000 7f2457e00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x557b16fa82f0 0x557b173806f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:29:24.036 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:24.034+0000 7f2457e00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x557b16fa82f0 0x557b173806f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.50:51470/0 (socket says 172.21.15.50:51470) 2024-08-31T04:29:24.036 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:24.035+0000 7f2457e00640 1 -- 172.21.15.50:0/17837477 learned_addr learned my addr 172.21.15.50:0/17837477 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:29:24.036 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:24.035+0000 7f2457400640 1 --2- 172.21.15.50:0/17837477 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557b16fb04d0 0x557b17380db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:29:24.039 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:24.035+0000 7f2465e60740 1 --2- 172.21.15.50:0/17837477 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557b16fd11b0 0x557b173818b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:24.040 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:24.037+0000 7f2465e60740 1 -- 172.21.15.50:0/17837477 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x557b17212ab0 con 0x557b16fd11b0 2024-08-31T04:29:24.040 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:24.037+0000 7f2465e60740 1 -- 172.21.15.50:0/17837477 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x557b17280320 con 0x557b16fa82f0 2024-08-31T04:29:24.040 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:24.037+0000 7f2465e60740 1 -- 172.21.15.50:0/17837477 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x557b17378c20 con 0x557b16fb04d0 2024-08-31T04:29:24.040 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:24.037+0000 7f2465e60740 10 client.0 _ll_register_callbacks cb 0x557b172866a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:29:24.041 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:24.039+0000 7f245ce00640 1 --2- 172.21.15.50:0/17837477 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557b16fd11b0 0x557b173818b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:29:24.041 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:24.039+0000 7f2457400640 1 -- 172.21.15.50:0/17837477 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x557b16fa82f0 msgr2=0x557b173806f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:29:24.041 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:24.039+0000 7f2457400640 1 --2- 172.21.15.50:0/17837477 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x557b16fa82f0 0x557b173806f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:24.041 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:24.039+0000 7f2457400640 1 -- 172.21.15.50:0/17837477 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557b16fd11b0 msgr2=0x557b173818b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:29:24.041 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:24.039+0000 7f2457400640 1 --2- 172.21.15.50:0/17837477 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557b16fd11b0 0x557b173818b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:24.042 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:24.039+0000 7f2457400640 1 -- 172.21.15.50:0/17837477 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557b1703c790 con 0x557b16fb04d0 2024-08-31T04:29:24.042 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:29:23 smithi133 ceph-mon[22177]: Adjusting osd_memory_target on smithi133 to 176.0M 2024-08-31T04:29:24.043 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:29:23 smithi133 ceph-mon[22177]: Unable to set osd_memory_target on smithi133 to 184575283: error parsing value: Value '184575283' is below minimum 939524096 2024-08-31T04:29:24.043 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:29:23 smithi133 ceph-mon[22177]: pgmap v562: 97 pgs: 97 active+clean; 1.2 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 6.5 MiB/s wr, 404 op/s 2024-08-31T04:29:24.063 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:24.060+0000 7f2457400640 1 --2- 172.21.15.50:0/17837477 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557b16fb04d0 0x557b17380db0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f24440a86f0 tx=0x7f24440a6270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9a1a2ed4f18af22f server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:29:24.063 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:24.062+0000 7f2442000640 10 client.0 ms_handle_connect on v2:172.21.15.177:3300/0 2024-08-31T04:29:24.076 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:24.075+0000 7f2442000640 1 -- 172.21.15.50:0/17837477 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24440a83b0 con 0x557b16fb04d0 2024-08-31T04:29:24.076 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:24.075+0000 7f2442000640 1 -- 172.21.15.50:0/17837477 <== mon.1 v2:172.21.15.177:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8219+0+0 (secure 0 0 0) 0x7f24440b0360 con 0x557b16fb04d0 2024-08-31T04:29:24.085 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:24.082+0000 7f2465e60740 1 -- 172.21.15.50:0/17837477 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2448010040 con 0x557b16fb04d0 2024-08-31T04:29:24.085 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:24.084+0000 7f2442000640 1 -- 172.21.15.50:0/17837477 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7f24440d2020 con 0x557b16fb04d0 2024-08-31T04:29:24.085 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:24.084+0000 7f2465e60740 10 client.25951 fetch_fsmap learned FSMap version 39 2024-08-31T04:29:24.085 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:24.084+0000 7f2465e60740 1 -- 172.21.15.50:0/17837477 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) -- 0x557b170b5620 con 0x557b16fb04d0 2024-08-31T04:29:24.087 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:24.084+0000 7f2442000640 1 -- 172.21.15.50:0/17837477 <== mon.1 v2:172.21.15.177:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2448010040 con 0x557b16fb04d0 2024-08-31T04:29:24.087 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:24.086+0000 7f2442000640 1 -- 172.21.15.50:0/17837477 <== mon.1 v2:172.21.15.177:3300/0 5 ==== fsmap(e 39) ==== 8410+0+0 (secure 0 0 0) 0x7f2444020020 con 0x557b16fb04d0 2024-08-31T04:29:24.088 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:24.086+0000 7f2465e60740 10 client.25951 fetch_fsmap finished waiting for FSMap version 39 2024-08-31T04:29:24.088 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:24.086+0000 7f2465e60740 10 client.25951 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T04:29:24.088 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:24.086+0000 7f2465e60740 20 client.25951 populate_metadata read hostname 'smithi050' 2024-08-31T04:29:24.088 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:24.086+0000 7f2465e60740 1 --2- 172.21.15.50:0/17837477 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x557b16f8fd80 0x557b1738dd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:24.088 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:24.086+0000 7f2465e60740 4 client.25951 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T04:29:24.088 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:24.086+0000 7f2465e60740 1 -- 172.21.15.50:0/17837477 --> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557b172ebec0 con 0x557b16f8fd80 2024-08-31T04:29:24.088 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:24.087+0000 7f2457e00640 1 --2- 172.21.15.50:0/17837477 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x557b16f8fd80 0x557b1738dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:29:24.090 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:24.088+0000 7f2457e00640 1 --2- 172.21.15.50:0/17837477 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x557b16f8fd80 0x557b1738dd00 crc :-1 s=READY pgs=98 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5a67f43554055b4c server_cookie=3f7a918811e7af5f in_seq=0 out_seq=0 2024-08-31T04:29:24.090 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:24.089+0000 7f2442000640 10 client.25951 ms_handle_connect on v2:172.21.15.133:6838/2526402262 2024-08-31T04:29:24.091 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:24.089+0000 7f2442000640 1 -- 172.21.15.50:0/17837477 <== mds.0 v2:172.21.15.133:6838/2526402262 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x557b172ebec0 con 0x557b16f8fd80 2024-08-31T04:29:24.091 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:24.089+0000 7f2442000640 10 client.25951 handle_command_reply: tid=0 2024-08-31T04:29:24.091 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:24.090+0000 7f2465e60740 1 client.25951 shutdown 2024-08-31T04:29:24.093 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:24.090+0000 7f2465e60740 1 -- 172.21.15.50:0/17837477 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557b16fb04d0 msgr2=0x557b17380db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:29:24.093 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:24.090+0000 7f2465e60740 1 --2- 172.21.15.50:0/17837477 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557b16fb04d0 0x557b17380db0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f24440a86f0 tx=0x7f24440a6270 comp rx=0 tx=0).stop 2024-08-31T04:29:24.093 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:24.092+0000 7f2465e60740 1 -- 172.21.15.50:0/17837477 shutdown_connections 2024-08-31T04:29:24.093 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:24.092+0000 7f2465e60740 1 --2- 172.21.15.50:0/17837477 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x557b16f8fd80 0x557b1738dd00 crc :-1 s=READY pgs=98 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:24.093 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:24.092+0000 7f2465e60740 1 --2- 172.21.15.50:0/17837477 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557b16fb04d0 0x557b17380db0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:24.094 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:24.092+0000 7f2465e60740 1 --2- 172.21.15.50:0/17837477 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557b16fd11b0 0x557b173818b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:24.094 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:24.092+0000 7f2465e60740 1 --2- 172.21.15.50:0/17837477 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x557b16fa82f0 0x557b173806f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:24.094 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:24.092+0000 7f2465e60740 1 -- 172.21.15.50:0/17837477 >> 172.21.15.50:0/17837477 conn(0x557b16fc5300 msgr2=0x557b17370f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:29:24.094 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:24.092+0000 7f2442000640 0 client.25951 ms_handle_reset on v2:172.21.15.133:6838/2526402262 2024-08-31T04:29:24.094 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:24.092+0000 7f2465e60740 1 -- 172.21.15.50:0/17837477 shutdown_connections 2024-08-31T04:29:24.094 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:24.092+0000 7f2465e60740 1 -- 172.21.15.50:0/17837477 wait complete. 2024-08-31T04:29:24.094 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:24.093+0000 7f2465e60740 20 client.25951 trim_cache size 0 max 16384 2024-08-31T04:29:24.564 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:24.554+0000 7f2465e60740 1 Processor -- start 2024-08-31T04:29:24.568 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:24.563+0000 7f2465e60740 1 -- start start 2024-08-31T04:29:24.568 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:24.563+0000 7f2465e60740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557b16fa82f0 0x557b17372370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:24.569 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:24.563+0000 7f2465e60740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x557b16fb04d0 0x557b1737ec80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:24.569 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:24.564+0000 7f2457400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x557b16fb04d0 0x557b1737ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:29:24.569 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:24.564+0000 7f2457400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x557b16fb04d0 0x557b1737ec80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.50:51478/0 (socket says 172.21.15.50:51478) 2024-08-31T04:29:24.569 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:24.564+0000 7f2457e00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557b16fa82f0 0x557b17372370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:29:24.569 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:24.564+0000 7f2457e00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557b16fa82f0 0x557b17372370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.50:43070/0 (socket says 172.21.15.50:43070) 2024-08-31T04:29:24.569 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:24.564+0000 7f2457400640 1 -- 172.21.15.50:0/3769442819 learned_addr learned my addr 172.21.15.50:0/3769442819 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:29:24.569 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:24.564+0000 7f2465e60740 1 --2- 172.21.15.50:0/3769442819 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557b16fd11b0 0x557b1737f1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:24.569 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:24.564+0000 7f2465e60740 1 -- 172.21.15.50:0/3769442819 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f24581c2020 con 0x557b16fd11b0 2024-08-31T04:29:24.569 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:24.564+0000 7f2465e60740 1 -- 172.21.15.50:0/3769442819 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f24581c3da0 con 0x557b16fb04d0 2024-08-31T04:29:24.569 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:24.564+0000 7f2465e60740 1 -- 172.21.15.50:0/3769442819 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f24581c26f0 con 0x557b16fa82f0 2024-08-31T04:29:24.569 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:24.565+0000 7f2457400640 1 -- 172.21.15.50:0/3769442819 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557b16fa82f0 msgr2=0x557b17372370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:29:24.569 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:24.565+0000 7f2457400640 1 --2- 172.21.15.50:0/3769442819 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557b16fa82f0 0x557b17372370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:24.569 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:24.565+0000 7f2457400640 1 -- 172.21.15.50:0/3769442819 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557b16fd11b0 msgr2=0x557b1737f1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:29:24.570 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:24.565+0000 7f2457400640 1 --2- 172.21.15.50:0/3769442819 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557b16fd11b0 0x557b1737f1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:24.570 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:24.565+0000 7f2457400640 1 -- 172.21.15.50:0/3769442819 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557b1737e900 con 0x557b16fb04d0 2024-08-31T04:29:24.570 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:24.566+0000 7f2457400640 1 --2- 172.21.15.50:0/3769442819 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x557b16fb04d0 0x557b1737ec80 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f24440a7ce0 tx=0x7f2444000bc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1929f1023c744db0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:29:24.571 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:24.570+0000 7f244cc00640 1 -- 172.21.15.50:0/3769442819 <== mon.2 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24440a8550 con 0x557b16fb04d0 2024-08-31T04:29:24.571 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:24.570+0000 7f244cc00640 1 -- 172.21.15.50:0/3769442819 <== mon.2 v2:172.21.15.133:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f244401f770 con 0x557b16fb04d0 2024-08-31T04:29:24.571 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:24.570+0000 7f244cc00640 1 -- 172.21.15.50:0/3769442819 <== mon.2 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24440a8720 con 0x557b16fb04d0 2024-08-31T04:29:24.600 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:24.589+0000 7f2465e60740 1 -- 172.21.15.50:0/3769442819 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x557b16fb04d0 msgr2=0x557b1737ec80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:29:24.600 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:24.589+0000 7f2465e60740 1 --2- 172.21.15.50:0/3769442819 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x557b16fb04d0 0x557b1737ec80 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f24440a7ce0 tx=0x7f2444000bc0 comp rx=0 tx=0).stop 2024-08-31T04:29:24.604 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:24.603+0000 7f2465e60740 1 -- 172.21.15.50:0/3769442819 shutdown_connections 2024-08-31T04:29:24.604 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:24.603+0000 7f2465e60740 1 --2- 172.21.15.50:0/3769442819 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557b16fd11b0 0x557b1737f1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:24.604 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:24.603+0000 7f2465e60740 1 --2- 172.21.15.50:0/3769442819 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x557b16fb04d0 0x557b1737ec80 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:24.604 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:24.603+0000 7f2465e60740 1 --2- 172.21.15.50:0/3769442819 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557b16fa82f0 0x557b17372370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:24.604 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:24.603+0000 7f2465e60740 1 -- 172.21.15.50:0/3769442819 >> 172.21.15.50:0/3769442819 conn(0x557b16fc5300 msgr2=0x557b17370f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:29:24.611 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:24.610+0000 7f2465e60740 1 -- 172.21.15.50:0/3769442819 shutdown_connections 2024-08-31T04:29:24.616 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:24.610+0000 7f2465e60740 1 -- 172.21.15.50:0/3769442819 wait complete. 2024-08-31T04:29:24.616 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:24.610+0000 7f2465e60740 1 -- start start 2024-08-31T04:29:24.616 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:24.611+0000 7f2465e60740 1 Processor -- start 2024-08-31T04:29:24.616 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:24.615+0000 7f2465e60740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x557b16fa82f0 0x557b173882d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:24.617 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:24.616+0000 7f2457e00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x557b16fa82f0 0x557b173882d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:29:24.617 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:24.616+0000 7f2457e00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x557b16fa82f0 0x557b173882d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.50:51480/0 (socket says 172.21.15.50:51480) 2024-08-31T04:29:24.617 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:24.616+0000 7f2457e00640 1 -- 172.21.15.50:0/3572269693 learned_addr learned my addr 172.21.15.50:0/3572269693 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:29:24.617 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:24.616+0000 7f2465e60740 1 --2- 172.21.15.50:0/3572269693 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557b16fb04d0 0x557b173840e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:24.618 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:24.617+0000 7f2457400640 1 --2- 172.21.15.50:0/3572269693 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557b16fb04d0 0x557b173840e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:29:24.618 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:24.617+0000 7f2465e60740 1 --2- 172.21.15.50:0/3572269693 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557b16fd11b0 0x557b17384620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:24.626 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:24.618+0000 7f245ce00640 1 --2- 172.21.15.50:0/3572269693 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557b16fd11b0 0x557b17384620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:29:24.626 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:24.618+0000 7f2465e60740 1 -- 172.21.15.50:0/3572269693 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f24581c3610 con 0x557b16fb04d0 2024-08-31T04:29:24.626 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:24.618+0000 7f2465e60740 1 -- 172.21.15.50:0/3572269693 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f24581c2e80 con 0x557b16fa82f0 2024-08-31T04:29:24.626 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:24.618+0000 7f2465e60740 1 -- 172.21.15.50:0/3572269693 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f24581c0000 con 0x557b16fd11b0 2024-08-31T04:29:24.626 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:24.619+0000 7f2457400640 1 -- 172.21.15.50:0/3572269693 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557b16fd11b0 msgr2=0x557b17384620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:29:24.626 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:24.619+0000 7f2457400640 1 --2- 172.21.15.50:0/3572269693 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557b16fd11b0 0x557b17384620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:24.626 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:24.619+0000 7f2457400640 1 -- 172.21.15.50:0/3572269693 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x557b16fa82f0 msgr2=0x557b173882d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:29:24.627 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:24.619+0000 7f2457400640 1 --2- 172.21.15.50:0/3572269693 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x557b16fa82f0 0x557b173882d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:24.627 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:24.619+0000 7f2457400640 1 -- 172.21.15.50:0/3572269693 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557b17384be0 con 0x557b16fb04d0 2024-08-31T04:29:24.627 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:24.619+0000 7f2457400640 1 --2- 172.21.15.50:0/3572269693 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557b16fb04d0 0x557b173840e0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f244401fa90 tx=0x7f244400f950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1bda70e754eb77a4 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:29:24.627 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:24.620+0000 7f245ce00640 1 --2- 172.21.15.50:0/3572269693 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557b16fd11b0 0x557b17384620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T04:29:24.627 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:24.625+0000 7f2465e60740 10 client.0 _ll_register_callbacks cb 0x7f24440ac4a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:29:24.627 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:24.625+0000 7f2465e60740 1 -- 172.21.15.50:0/3572269693 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f244401f770 con 0x557b16fb04d0 2024-08-31T04:29:24.627 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:24.625+0000 7f2442000640 10 client.15969 ms_handle_connect on v2:172.21.15.50:3300/0 2024-08-31T04:29:24.628 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:24.625+0000 7f2442000640 1 -- 172.21.15.50:0/3572269693 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24440cb030 con 0x557b16fb04d0 2024-08-31T04:29:24.628 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:24.625+0000 7f2442000640 1 -- 172.21.15.50:0/3572269693 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8219+0+0 (secure 0 0 0) 0x7f24440a84b0 con 0x557b16fb04d0 2024-08-31T04:29:24.628 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:24.626+0000 7f2442000640 1 -- 172.21.15.50:0/3572269693 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7f24440a88c0 con 0x557b16fb04d0 2024-08-31T04:29:24.641 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:24.631+0000 7f2465e60740 10 client.15969 fetch_fsmap learned FSMap version 39 2024-08-31T04:29:24.641 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:24.631+0000 7f2465e60740 1 -- 172.21.15.50:0/3572269693 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({fsmap=39}) -- 0x557b17385db0 con 0x557b16fb04d0 2024-08-31T04:29:24.644 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:24.643+0000 7f2442000640 1 -- 172.21.15.50:0/3572269693 <== mon.0 v2:172.21.15.50:3300/0 4 ==== fsmap(e 39) ==== 8410+0+0 (secure 0 0 0) 0x7f24440b1bc0 con 0x557b16fb04d0 2024-08-31T04:29:24.644 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:24.643+0000 7f2465e60740 10 client.15969 fetch_fsmap finished waiting for FSMap version 39 2024-08-31T04:29:24.644 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:24.643+0000 7f2465e60740 10 client.15969 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T04:29:24.645 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:24.643+0000 7f2465e60740 20 client.15969 populate_metadata read hostname 'smithi050' 2024-08-31T04:29:24.645 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:24.643+0000 7f2465e60740 1 --2- 172.21.15.50:0/3572269693 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x557b16f651c0 0x557b173fab60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:24.645 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:24.643+0000 7f2465e60740 4 client.15969 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-31T04:29:24.645 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:24.643+0000 7f2465e60740 1 -- 172.21.15.50:0/3572269693 --> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] -- command(tid 0: {"prefix": "flush journal"}) -- 0x557b172e7960 con 0x557b16f651c0 2024-08-31T04:29:24.649 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:24.643+0000 7f2457e00640 1 --2- 172.21.15.50:0/3572269693 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x557b16f651c0 0x557b173fab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:29:24.665 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:24.664+0000 7f2457e00640 1 --2- 172.21.15.50:0/3572269693 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x557b16f651c0 0x557b173fab60 crc :-1 s=READY pgs=99 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=622f7ee6afac4f16 server_cookie=71ef43a5dec93d19 in_seq=0 out_seq=0 2024-08-31T04:29:24.680 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:24.664+0000 7f2442000640 10 client.15969 ms_handle_connect on v2:172.21.15.133:6838/2526402262 2024-08-31T04:29:24.801 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:29:25.128 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:29:24 smithi050 ceph-mon[17259]: pgmap v563: 97 pgs: 97 active+clean; 1.3 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 7.3 MiB/s wr, 427 op/s 2024-08-31T04:29:25.246 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:29:24 smithi177 ceph-mon[22025]: pgmap v563: 97 pgs: 97 active+clean; 1.3 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 7.3 MiB/s wr, 427 op/s 2024-08-31T04:29:25.293 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:29:24 smithi133 ceph-mon[22177]: pgmap v563: 97 pgs: 97 active+clean; 1.3 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 7.3 MiB/s wr, 427 op/s 2024-08-31T04:29:25.532 INFO:tasks.workunit.client.0.smithi050.stdout: 395 453189 669 315254 522 115067 619 2024-08-31T04:29:26.431 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:26.428+0000 7f2442000640 1 -- 172.21.15.50:0/3572269693 <== mds.0 v2:172.21.15.133:6838/2526402262 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x557b172e7960 con 0x557b16f651c0 2024-08-31T04:29:26.431 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:26.428+0000 7f2442000640 10 client.15969 handle_command_reply: tid=0 2024-08-31T04:29:26.431 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:26.428+0000 7f2465e60740 1 client.15969 shutdown 2024-08-31T04:29:26.431 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:26.428+0000 7f2465e60740 1 -- 172.21.15.50:0/3572269693 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557b16fb04d0 msgr2=0x557b173840e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:29:26.431 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:26.428+0000 7f2465e60740 1 --2- 172.21.15.50:0/3572269693 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557b16fb04d0 0x557b173840e0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f244401fa90 tx=0x7f244400f950 comp rx=0 tx=0).stop 2024-08-31T04:29:26.442 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:26.441+0000 7f2465e60740 1 -- 172.21.15.50:0/3572269693 shutdown_connections 2024-08-31T04:29:26.442 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:26.441+0000 7f2465e60740 1 --2- 172.21.15.50:0/3572269693 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x557b16f651c0 0x557b173fab60 crc :-1 s=READY pgs=99 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:26.442 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:26.441+0000 7f2465e60740 1 --2- 172.21.15.50:0/3572269693 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557b16fd11b0 0x557b17384620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:26.442 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:26.441+0000 7f2465e60740 1 --2- 172.21.15.50:0/3572269693 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557b16fb04d0 0x557b173840e0 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:26.443 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:26.441+0000 7f2465e60740 1 --2- 172.21.15.50:0/3572269693 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x557b16fa82f0 0x557b173882d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:26.443 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:26.441+0000 7f2465e60740 1 -- 172.21.15.50:0/3572269693 >> 172.21.15.50:0/3572269693 conn(0x557b16fc5300 msgr2=0x557b17372370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:29:26.443 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:26.441+0000 7f2442000640 0 client.15969 ms_handle_reset on v2:172.21.15.133:6838/2526402262 2024-08-31T04:29:26.462 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:26.447+0000 7f2465e60740 1 -- 172.21.15.50:0/3572269693 shutdown_connections 2024-08-31T04:29:26.462 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:26.456+0000 7f2465e60740 1 -- 172.21.15.50:0/3572269693 wait complete. 2024-08-31T04:29:26.463 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:26.456+0000 7f2465e60740 20 client.15969 trim_cache size 0 max 16384 2024-08-31T04:29:26.467 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout:{ 2024-08-31T04:29:26.467 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout: "message": "", 2024-08-31T04:29:26.467 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout: "return_code": 0 2024-08-31T04:29:26.467 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout:} 2024-08-31T04:29:26.470 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:26.469+0000 7f245ee00640 1 -- 172.21.15.50:0/3902249720 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f243c0b4cc0 msgr2=0x7f243c0b71d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:29:26.470 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:26.469+0000 7f245ee00640 1 --2- 172.21.15.50:0/3902249720 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f243c0b4cc0 0x7f243c0b71d0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f2448014c20 tx=0x7f2448012000 comp rx=0 tx=0).stop 2024-08-31T04:29:26.471 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:26.469+0000 7f245ee00640 1 -- 172.21.15.50:0/3902249720 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f245810cac0 msgr2=0x7f2458117440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:29:26.471 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:26.469+0000 7f245ee00640 1 --2- 172.21.15.50:0/3902249720 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f245810cac0 0x7f2458117440 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f244400c920 tx=0x7f244400cde0 comp rx=0 tx=0).stop 2024-08-31T04:29:26.472 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:26.471+0000 7f245ee00640 1 -- 172.21.15.50:0/3902249720 shutdown_connections 2024-08-31T04:29:26.472 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:26.471+0000 7f245ee00640 1 --2- 172.21.15.50:0/3902249720 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f243c0b4cc0 0x7f243c0b71d0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:26.472 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:26.471+0000 7f245ee00640 1 --2- 172.21.15.50:0/3902249720 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f245810f5d0 0x7f2458117ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:26.472 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:26.471+0000 7f245ee00640 1 --2- 172.21.15.50:0/3902249720 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f245810cac0 0x7f2458117440 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:26.472 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:26.471+0000 7f245ee00640 1 --2- 172.21.15.50:0/3902249720 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f245810a160 0x7f2458116dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:26.472 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:26.471+0000 7f245ee00640 1 -- 172.21.15.50:0/3902249720 >> 172.21.15.50:0/3902249720 conn(0x7f2458070410 msgr2=0x7f245810af50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:29:26.477 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:26.476+0000 7f245ee00640 1 -- 172.21.15.50:0/3902249720 shutdown_connections 2024-08-31T04:29:26.480 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:26.476+0000 7f245ee00640 1 -- 172.21.15.50:0/3902249720 wait complete. 2024-08-31T04:29:27.160 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:29:27 smithi050 ceph-mon[17259]: pgmap v564: 97 pgs: 97 active+clean; 1.3 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 11 MiB/s wr, 714 op/s 2024-08-31T04:29:27.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:29:27 smithi177 ceph-mon[22025]: pgmap v564: 97 pgs: 97 active+clean; 1.3 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 11 MiB/s wr, 714 op/s 2024-08-31T04:29:27.542 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:29:27 smithi133 ceph-mon[22177]: pgmap v564: 97 pgs: 97 active+clean; 1.3 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 11 MiB/s wr, 714 op/s 2024-08-31T04:29:27.963 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-08-31T04:29:27.963 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":39,"btime":"2024-08-31T04:28:42:438289+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14622,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/1565557530","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":1565557530},{"type":"v1","addr":"172.21.15.50:6835","nonce":1565557530}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":25924,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6835/4060379633","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6834","nonce":4060379633},{"type":"v1","addr":"172.21.15.177:6835","nonce":4060379633}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":39}],"filesystems":[{"mdsmap":{"epoch":38,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-31T04:20:44.140709+0000","modified":"2024-08-31T04:28:38.691579+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24695,"mds_1":24691,"mds_2":24667,"mds_3":24656,"mds_4":24652},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14634":{"gid":14634,"name":"d","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.50:6837/2660185946","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6836","nonce":2660185946},{"type":"v1","addr":"172.21.15.50:6837","nonce":2660185946}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14676":{"gid":14676,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.50:6839/2105228685","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6838","nonce":2105228685},{"type":"v1","addr":"172.21.15.50:6839","nonce":2105228685}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24590":{"gid":24590,"name":"k","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.133:6833/4283603962","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6832","nonce":4283603962},{"type":"v1","addr":"172.21.15.133:6833","nonce":4283603962}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24601":{"gid":24601,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.177:6833/1237129793","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":1237129793},{"type":"v1","addr":"172.21.15.177:6833","nonce":1237129793}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24626":{"gid":24626,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.133:6835/3637799701","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":3637799701},{"type":"v1","addr":"172.21.15.133:6835","nonce":3637799701}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24652":{"gid":24652,"name":"c","rank":4,"incarnation":26,"state":"up:active","state_seq":13,"addr":"172.21.15.177:6837/2159859285","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6836","nonce":2159859285},{"type":"v1","addr":"172.21.15.177:6837","nonce":2159859285}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24656":{"gid":24656,"name":"h","rank":3,"incarnation":22,"state":"up:active","state_seq":12,"addr":"172.21.15.133:6837/4014853202","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6836","nonce":4014853202},{"type":"v1","addr":"172.21.15.133:6837","nonce":4014853202}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24667":{"gid":24667,"name":"i","rank":2,"incarnation":20,"state":"up:active","state_seq":10,"addr":"172.21.15.177:6839/3600081752","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6838","nonce":3600081752},{"type":"v1","addr":"172.21.15.177:6839","nonce":3600081752}]},"join_fscid":-1,"export_targets":[0,1,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24691":{"gid":24691,"name":"a","rank":1,"incarnation":18,"state":"up:active","state_seq":8,"addr":"172.21.15.50:6841/575209862","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6840","nonce":575209862},{"type":"v1","addr":"172.21.15.50:6841","nonce":575209862}]},"join_fscid":-1,"export_targets":[0,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24695":{"gid":24695,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.133:6839/2526402262","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6838","nonce":2526402262},{"type":"v1","addr":"172.21.15.133:6839","nonce":2526402262}]},"join_fscid":-1,"export_targets":[1,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24695,"qdb_cluster":[24652,24691,24656,24695,24667]},"id":1}]} 2024-08-31T04:29:27.964 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:29:27.395+0000 7f07c7200640 1 -- 172.21.15.50:0/2324133144 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f07c811c940 msgr2=0x7f07c811ed60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:29:27.964 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:29:27.395+0000 7f07c7200640 1 --2- 172.21.15.50:0/2324133144 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f07c811c940 0x7f07c811ed60 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f07c0009ca0 tx=0x7f07c002a8c0 comp rx=0 tx=0).stop 2024-08-31T04:29:27.964 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:29:27.395+0000 7f07c7200640 1 -- 172.21.15.50:0/2324133144 shutdown_connections 2024-08-31T04:29:27.964 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:29:27.395+0000 7f07c7200640 1 --2- 172.21.15.50:0/2324133144 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f07c810d990 0x7f07c810dda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:27.964 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:29:27.395+0000 7f07c7200640 1 --2- 172.21.15.50:0/2324133144 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f07c811c940 0x7f07c811ed60 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:27.964 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:29:27.395+0000 7f07c7200640 1 --2- 172.21.15.50:0/2324133144 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f07c8111a70 0x7f07c810d450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:27.964 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:29:27.395+0000 7f07c7200640 1 -- 172.21.15.50:0/2324133144 >> 172.21.15.50:0/2324133144 conn(0x7f07c806e790 msgr2=0x7f07c806ebd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:29:27.964 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:29:27.395+0000 7f07c7200640 1 -- 172.21.15.50:0/2324133144 shutdown_connections 2024-08-31T04:29:27.964 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:29:27.396+0000 7f07c7200640 1 -- 172.21.15.50:0/2324133144 wait complete. 2024-08-31T04:29:27.964 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:29:27.403+0000 7f07c7200640 1 Processor -- start 2024-08-31T04:29:27.965 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:29:27.404+0000 7f07c7200640 1 -- start start 2024-08-31T04:29:27.965 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:29:27.405+0000 7f07c7200640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f07c810d990 0x7f07c81a8ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:27.965 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:29:27.405+0000 7f07c7200640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f07c8111a70 0x7f07c81a9280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:27.965 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:29:27.405+0000 7f07c7200640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f07c811c940 0x7f07c81ae520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:27.965 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:29:27.405+0000 7f07c7200640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f07c81224b0 con 0x7f07c811c940 2024-08-31T04:29:27.965 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:29:27.405+0000 7f07c7200640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f07c8122330 con 0x7f07c810d990 2024-08-31T04:29:27.965 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:29:27.405+0000 7f07c7200640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f07c8122630 con 0x7f07c8111a70 2024-08-31T04:29:27.965 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:29:27.407+0000 7f07c5400640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f07c8111a70 0x7f07c81a9280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:29:27.965 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:29:27.407+0000 7f07c5400640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f07c8111a70 0x7f07c81a9280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.50:43098/0 (socket says 172.21.15.50:43098) 2024-08-31T04:29:27.965 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:29:27.407+0000 7f07c5400640 1 -- 172.21.15.50:0/1106879043 learned_addr learned my addr 172.21.15.50:0/1106879043 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:29:27.965 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:29:27.408+0000 7f07c5e00640 1 --2- 172.21.15.50:0/1106879043 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f07c810d990 0x7f07c81a8ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:29:27.966 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:29:27.409+0000 7f07c5e00640 1 -- 172.21.15.50:0/1106879043 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f07c8111a70 msgr2=0x7f07c81a9280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:29:27.966 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:29:27.409+0000 7f07c5e00640 1 --2- 172.21.15.50:0/1106879043 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f07c8111a70 0x7f07c81a9280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:27.966 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:29:27.409+0000 7f07c5e00640 1 -- 172.21.15.50:0/1106879043 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f07c811c940 msgr2=0x7f07c81ae520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:29:27.966 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:29:27.409+0000 7f07c5e00640 1 --2- 172.21.15.50:0/1106879043 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f07c811c940 0x7f07c81ae520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:27.966 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:29:27.409+0000 7f07c5e00640 1 -- 172.21.15.50:0/1106879043 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07c81aec20 con 0x7f07c810d990 2024-08-31T04:29:27.966 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:29:27.409+0000 7f07c5400640 1 --2- 172.21.15.50:0/1106879043 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f07c8111a70 0x7f07c81a9280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:29:27.966 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:29:27.410+0000 7f07c5e00640 1 --2- 172.21.15.50:0/1106879043 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f07c810d990 0x7f07c81a8ce0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f07b800d6d0 tx=0x7f07b800db90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:29:27.966 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:29:27.411+0000 7f07bea00640 1 -- 172.21.15.50:0/1106879043 <== mon.2 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07b8017070 con 0x7f07c810d990 2024-08-31T04:29:27.966 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:29:27.411+0000 7f07bea00640 1 -- 172.21.15.50:0/1106879043 <== mon.2 v2:172.21.15.133:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f07b8009cd0 con 0x7f07c810d990 2024-08-31T04:29:27.966 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:29:27.411+0000 7f07bea00640 1 -- 172.21.15.50:0/1106879043 <== mon.2 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07b8003ba0 con 0x7f07c810d990 2024-08-31T04:29:27.966 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:29:27.411+0000 7f07c7200640 1 -- 172.21.15.50:0/1106879043 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f07c81aef10 con 0x7f07c810d990 2024-08-31T04:29:27.966 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:29:27.412+0000 7f07c7200640 1 -- 172.21.15.50:0/1106879043 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f07c8112120 con 0x7f07c810d990 2024-08-31T04:29:27.966 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:29:27.418+0000 7f07c7200640 1 -- 172.21.15.50:0/1106879043 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f07c8074f40 con 0x7f07c810d990 2024-08-31T04:29:27.967 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:29:27.418+0000 7f07bea00640 1 -- 172.21.15.50:0/1106879043 <== mon.2 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 18) ==== 152577+0+0 (secure 0 0 0) 0x7f07b8010460 con 0x7f07c810d990 2024-08-31T04:29:27.967 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:29:27.421+0000 7f07bea00640 1 --2- 172.21.15.50:0/1106879043 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f07ac0b4c80 0x7f07ac0b7190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:27.967 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:29:27.422+0000 7f07bea00640 1 -- 172.21.15.50:0/1106879043 <== mon.2 v2:172.21.15.133:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8219+0+0 (secure 0 0 0) 0x7f07b80e8060 con 0x7f07c810d990 2024-08-31T04:29:27.967 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:29:27.422+0000 7f07c5400640 1 --2- 172.21.15.50:0/1106879043 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f07ac0b4c80 0x7f07ac0b7190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:29:27.967 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:29:27.423+0000 7f07c5400640 1 --2- 172.21.15.50:0/1106879043 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f07ac0b4c80 0x7f07ac0b7190 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f07c811c3f0 tx=0x7f07b4005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:29:27.967 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:29:27.426+0000 7f07bea00640 1 -- 172.21.15.50:0/1106879043 <== mon.2 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f07b80aafb0 con 0x7f07c810d990 2024-08-31T04:29:27.967 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 39 2024-08-31T04:29:27.967 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:29:27.909+0000 7f07c7200640 1 -- 172.21.15.50:0/1106879043 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f07c8112380 con 0x7f07c810d990 2024-08-31T04:29:27.967 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:29:27.909+0000 7f07bea00640 1 -- 172.21.15.50:0/1106879043 <== mon.2 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 39 v39) ==== 94+0+12008 (secure 0 0 0) 0x7f07b80aa8b0 con 0x7f07c810d990 2024-08-31T04:29:27.967 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:29:27.919+0000 7f07c7200640 1 -- 172.21.15.50:0/1106879043 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f07ac0b4c80 msgr2=0x7f07ac0b7190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:29:27.967 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:29:27.919+0000 7f07c7200640 1 --2- 172.21.15.50:0/1106879043 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f07ac0b4c80 0x7f07ac0b7190 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f07c811c3f0 tx=0x7f07b4005f90 comp rx=0 tx=0).stop 2024-08-31T04:29:27.967 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:29:27.919+0000 7f07c7200640 1 -- 172.21.15.50:0/1106879043 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f07c810d990 msgr2=0x7f07c81a8ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:29:27.967 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:29:27.919+0000 7f07c7200640 1 --2- 172.21.15.50:0/1106879043 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f07c810d990 0x7f07c81a8ce0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f07b800d6d0 tx=0x7f07b800db90 comp rx=0 tx=0).stop 2024-08-31T04:29:27.968 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:29:27.920+0000 7f07c7200640 1 -- 172.21.15.50:0/1106879043 shutdown_connections 2024-08-31T04:29:27.968 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:29:27.920+0000 7f07c7200640 1 --2- 172.21.15.50:0/1106879043 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f07ac0b4c80 0x7f07ac0b7190 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:27.968 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:29:27.920+0000 7f07c7200640 1 --2- 172.21.15.50:0/1106879043 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f07c8111a70 0x7f07c81a9280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:27.968 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:29:27.920+0000 7f07c7200640 1 --2- 172.21.15.50:0/1106879043 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f07c811c940 0x7f07c81ae520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:27.968 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:29:27.920+0000 7f07c7200640 1 --2- 172.21.15.50:0/1106879043 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f07c810d990 0x7f07c81a8ce0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:27.968 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:29:27.920+0000 7f07c7200640 1 -- 172.21.15.50:0/1106879043 >> 172.21.15.50:0/1106879043 conn(0x7f07c806e790 msgr2=0x7f07c8110780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:29:27.968 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:29:27.923+0000 7f07c7200640 1 -- 172.21.15.50:0/1106879043 shutdown_connections 2024-08-31T04:29:27.968 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:29:27.923+0000 7f07c7200640 1 -- 172.21.15.50:0/1106879043 wait complete. 2024-08-31T04:29:28.212 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:29:28 smithi050 ceph-mon[17259]: from='client.? 172.21.15.50:0/1106879043' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T04:29:28.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:29:28 smithi177 ceph-mon[22025]: from='client.? 172.21.15.50:0/1106879043' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T04:29:28.542 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:29:28 smithi133 ceph-mon[22177]: from='client.? 172.21.15.50:0/1106879043' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T04:29:29.450 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:29:29 smithi050 ceph-mon[17259]: pgmap v565: 97 pgs: 97 active+clean; 1.3 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 13 MiB/s wr, 973 op/s 2024-08-31T04:29:29.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:29:29 smithi177 ceph-mon[22025]: pgmap v565: 97 pgs: 97 active+clean; 1.3 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 13 MiB/s wr, 973 op/s 2024-08-31T04:29:29.542 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:29:29 smithi133 ceph-mon[22177]: pgmap v565: 97 pgs: 97 active+clean; 1.3 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 13 MiB/s wr, 973 op/s 2024-08-31T04:29:29.935 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24695 quiesce db / --timeout 90 --expiration 152.7 --await-for 45.0' 2024-08-31T04:29:29.935 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 058d9fc6-674f-11ef-bcd4-c7b262605968 -- timeout 105 ceph tell mds.24695 quiesce db / --timeout 90 --expiration 152.7 --await-for 45.0 2024-08-31T04:29:31.450 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:29:31 smithi050 ceph-mon[17259]: pgmap v566: 97 pgs: 97 active+clean; 1.3 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 11 MiB/s wr, 880 op/s 2024-08-31T04:29:31.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:29:31 smithi177 ceph-mon[22025]: pgmap v566: 97 pgs: 97 active+clean; 1.3 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 11 MiB/s wr, 880 op/s 2024-08-31T04:29:31.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:29:31 smithi133 ceph-mon[22177]: pgmap v566: 97 pgs: 97 active+clean; 1.3 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 11 MiB/s wr, 880 op/s 2024-08-31T04:29:33.450 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:29:33 smithi050 ceph-mon[17259]: pgmap v567: 97 pgs: 97 active+clean; 1.3 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 12 MiB/s wr, 969 op/s 2024-08-31T04:29:33.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:29:33 smithi177 ceph-mon[22025]: pgmap v567: 97 pgs: 97 active+clean; 1.3 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 12 MiB/s wr, 969 op/s 2024-08-31T04:29:33.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:29:33 smithi133 ceph-mon[22177]: pgmap v567: 97 pgs: 97 active+clean; 1.3 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 12 MiB/s wr, 969 op/s 2024-08-31T04:29:35.454 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:29:35 smithi050 ceph-mon[17259]: pgmap v568: 97 pgs: 97 active+clean; 1.3 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 9.9 MiB/s wr, 831 op/s 2024-08-31T04:29:35.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:29:35 smithi177 ceph-mon[22025]: pgmap v568: 97 pgs: 97 active+clean; 1.3 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 9.9 MiB/s wr, 831 op/s 2024-08-31T04:29:35.542 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:29:35 smithi133 ceph-mon[22177]: pgmap v568: 97 pgs: 97 active+clean; 1.3 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 9.9 MiB/s wr, 831 op/s 2024-08-31T04:29:35.564 INFO:tasks.workunit.client.0.smithi050.stdout: 414 504286 1202 348941 974 140724 2383 2024-08-31T04:29:37.450 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:29:37 smithi050 ceph-mon[17259]: pgmap v569: 97 pgs: 97 active+clean; 1.3 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 8.8 MiB/s wr, 786 op/s 2024-08-31T04:29:37.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:29:37 smithi177 ceph-mon[22025]: pgmap v569: 97 pgs: 97 active+clean; 1.3 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 8.8 MiB/s wr, 786 op/s 2024-08-31T04:29:37.542 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:29:37 smithi133 ceph-mon[22177]: pgmap v569: 97 pgs: 97 active+clean; 1.3 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 8.8 MiB/s wr, 786 op/s 2024-08-31T04:29:39.452 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:29:39 smithi050 ceph-mon[17259]: pgmap v570: 97 pgs: 97 active+clean; 1.4 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 6.4 MiB/s wr, 585 op/s 2024-08-31T04:29:39.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:29:39 smithi177 ceph-mon[22025]: pgmap v570: 97 pgs: 97 active+clean; 1.4 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 6.4 MiB/s wr, 585 op/s 2024-08-31T04:29:39.542 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:29:39 smithi133 ceph-mon[22177]: pgmap v570: 97 pgs: 97 active+clean; 1.4 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 6.4 MiB/s wr, 585 op/s 2024-08-31T04:29:41.450 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:29:41 smithi050 ceph-mon[17259]: pgmap v571: 97 pgs: 97 active+clean; 1.4 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.9 MiB/s wr, 232 op/s 2024-08-31T04:29:41.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:29:41 smithi177 ceph-mon[22025]: pgmap v571: 97 pgs: 97 active+clean; 1.4 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.9 MiB/s wr, 232 op/s 2024-08-31T04:29:41.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:29:41 smithi133 ceph-mon[22177]: pgmap v571: 97 pgs: 97 active+clean; 1.4 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.9 MiB/s wr, 232 op/s 2024-08-31T04:29:43.330 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:29:43.456 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:29:43 smithi050 ceph-mon[17259]: pgmap v572: 97 pgs: 97 active+clean; 1.4 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 5.4 MiB/s wr, 367 op/s 2024-08-31T04:29:43.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:29:43 smithi177 ceph-mon[22025]: pgmap v572: 97 pgs: 97 active+clean; 1.4 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 5.4 MiB/s wr, 367 op/s 2024-08-31T04:29:43.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:29:43 smithi133 ceph-mon[22177]: pgmap v572: 97 pgs: 97 active+clean; 1.4 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 5.4 MiB/s wr, 367 op/s 2024-08-31T04:29:45.479 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:29:45 smithi050 ceph-mon[17259]: pgmap v573: 97 pgs: 97 active+clean; 1.4 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 6.0 MiB/s wr, 389 op/s 2024-08-31T04:29:45.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:29:45 smithi177 ceph-mon[22025]: pgmap v573: 97 pgs: 97 active+clean; 1.4 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 6.0 MiB/s wr, 389 op/s 2024-08-31T04:29:45.542 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:29:45 smithi133 ceph-mon[22177]: pgmap v573: 97 pgs: 97 active+clean; 1.4 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 6.0 MiB/s wr, 389 op/s 2024-08-31T04:29:45.572 INFO:tasks.workunit.client.0.smithi050.stdout: 429 451344 768 315389 886 139130 2128 2024-08-31T04:29:46.606 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:46.603+0000 7f6257e00640 1 -- 172.21.15.50:0/2869952768 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f62500a4fa0 msgr2=0x7f62500a5410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:29:46.606 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:46.603+0000 7f6257e00640 1 --2- 172.21.15.50:0/2869952768 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f62500a4fa0 0x7f62500a5410 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f62480098b0 tx=0x7f624802a3b0 comp rx=0 tx=0).stop 2024-08-31T04:29:46.612 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:46.607+0000 7f6257e00640 1 -- 172.21.15.50:0/2869952768 shutdown_connections 2024-08-31T04:29:46.612 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:46.607+0000 7f6257e00640 1 --2- 172.21.15.50:0/2869952768 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f62500a6970 0x7f62500adbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:46.612 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:46.607+0000 7f6257e00640 1 --2- 172.21.15.50:0/2869952768 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f62500a6020 0x7f62500a6430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:46.612 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:46.607+0000 7f6257e00640 1 --2- 172.21.15.50:0/2869952768 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f62500a4fa0 0x7f62500a5410 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:46.612 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:46.607+0000 7f6257e00640 1 -- 172.21.15.50:0/2869952768 >> 172.21.15.50:0/2869952768 conn(0x7f62500a0490 msgr2=0x7f62500a2940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:29:46.612 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:46.610+0000 7f6257e00640 1 -- 172.21.15.50:0/2869952768 shutdown_connections 2024-08-31T04:29:46.612 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:46.610+0000 7f6257e00640 1 -- 172.21.15.50:0/2869952768 wait complete. 2024-08-31T04:29:46.623 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:46.621+0000 7f6257e00640 1 Processor -- start 2024-08-31T04:29:46.623 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:46.621+0000 7f6257e00640 1 -- start start 2024-08-31T04:29:46.628 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:46.625+0000 7f6257e00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f62500a4fa0 0x7f625013b440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:46.630 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:46.627+0000 7f6257e00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f62500a6020 0x7f625013bab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:46.630 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:46.627+0000 7f6256a00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f62500a4fa0 0x7f625013b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:29:46.632 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:46.627+0000 7f6256a00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f62500a4fa0 0x7f625013b440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.50:47440/0 (socket says 172.21.15.50:47440) 2024-08-31T04:29:46.632 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:46.627+0000 7f6256000640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f62500a6020 0x7f625013bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:29:46.632 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:46.628+0000 7f6256000640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f62500a6020 0x7f625013bab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.50:59484/0 (socket says 172.21.15.50:59484) 2024-08-31T04:29:46.632 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:46.628+0000 7f6257e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f62500a6970 0x7f625013c660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:46.634 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:46.631+0000 7f6256000640 1 -- 172.21.15.50:0/3612822306 learned_addr learned my addr 172.21.15.50:0/3612822306 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:29:46.634 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:46.632+0000 7f6257400640 1 --2- 172.21.15.50:0/3612822306 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f62500a6970 0x7f625013c660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:29:46.635 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:46.633+0000 7f6257e00640 1 -- 172.21.15.50:0/3612822306 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f62500b2a50 con 0x7f62500a6970 2024-08-31T04:29:46.636 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:46.634+0000 7f6257e00640 1 -- 172.21.15.50:0/3612822306 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f62500b28d0 con 0x7f62500a4fa0 2024-08-31T04:29:46.636 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:46.634+0000 7f6257e00640 1 -- 172.21.15.50:0/3612822306 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f62500b2bd0 con 0x7f62500a6020 2024-08-31T04:29:46.692 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:46.672+0000 7f6256000640 1 -- 172.21.15.50:0/3612822306 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f62500a4fa0 msgr2=0x7f625013b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:29:46.692 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:46.672+0000 7f6256000640 1 --2- 172.21.15.50:0/3612822306 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f62500a4fa0 0x7f625013b440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:46.692 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:46.672+0000 7f6256000640 1 -- 172.21.15.50:0/3612822306 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f62500a6970 msgr2=0x7f625013c660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:29:46.692 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:46.672+0000 7f6256000640 1 --2- 172.21.15.50:0/3612822306 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f62500a6970 0x7f625013c660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:46.692 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:46.672+0000 7f6256000640 1 -- 172.21.15.50:0/3612822306 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f625013ce80 con 0x7f62500a6020 2024-08-31T04:29:46.692 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:46.673+0000 7f6257400640 1 --2- 172.21.15.50:0/3612822306 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f62500a6970 0x7f625013c660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:29:46.692 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:46.688+0000 7f6256000640 1 --2- 172.21.15.50:0/3612822306 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f62500a6020 0x7f625013bab0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f624400d950 tx=0x7f624400de10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:29:46.727 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:46.699+0000 7f624f400640 1 -- 172.21.15.50:0/3612822306 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6244017070 con 0x7f62500a6020 2024-08-31T04:29:46.727 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:46.699+0000 7f624f400640 1 -- 172.21.15.50:0/3612822306 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6244009c30 con 0x7f62500a6020 2024-08-31T04:29:46.727 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:46.699+0000 7f624f400640 1 -- 172.21.15.50:0/3612822306 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f624400f620 con 0x7f62500a6020 2024-08-31T04:29:46.727 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:46.700+0000 7f6257e00640 1 -- 172.21.15.50:0/3612822306 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f625013d170 con 0x7f62500a6020 2024-08-31T04:29:46.727 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:46.700+0000 7f6257e00640 1 -- 172.21.15.50:0/3612822306 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6250143860 con 0x7f62500a6020 2024-08-31T04:29:46.776 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:46.770+0000 7f624f400640 1 -- 172.21.15.50:0/3612822306 <== mon.1 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 18) ==== 152577+0+0 (secure 0 0 0) 0x7f6244010460 con 0x7f62500a6020 2024-08-31T04:29:46.778 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:46.775+0000 7f62648c5740 1 Processor -- start 2024-08-31T04:29:46.780 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:46.777+0000 7f62648c5740 1 -- start start 2024-08-31T04:29:46.781 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:46.779+0000 7f62648c5740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56273355f1b0 0x562733904fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:46.782 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:46.779+0000 7f62648c5740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5627335362f0 0x562733905610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:46.783 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:46.779+0000 7f624f400640 1 --2- 172.21.15.50:0/3612822306 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f623c0b4ce0 0x7f623c0b71f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:46.783 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:46.780+0000 7f624f400640 1 -- 172.21.15.50:0/3612822306 <== mon.1 v2:172.21.15.177:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8219+0+0 (secure 0 0 0) 0x7f62440e4a20 con 0x7f62500a6020 2024-08-31T04:29:46.783 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:46.780+0000 7f6257400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56273355f1b0 0x562733904fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:29:46.783 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:46.780+0000 7f6257400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56273355f1b0 0x562733904fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.50:47446/0 (socket says 172.21.15.50:47446) 2024-08-31T04:29:46.783 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:46.781+0000 7f6256000640 1 --2- 172.21.15.50:0/3612822306 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f623c0b4ce0 0x7f623c0b71f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:29:46.785 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:46.782+0000 7f6256a00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5627335362f0 0x562733905610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:29:46.785 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:46.783+0000 7f6256a00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5627335362f0 0x562733905610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:34998/0 (socket says 172.21.15.50:34998) 2024-08-31T04:29:46.785 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:46.783+0000 7f6257400640 1 -- 172.21.15.50:0/1523800984 learned_addr learned my addr 172.21.15.50:0/1523800984 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:29:46.786 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:46.783+0000 7f62648c5740 1 --2- 172.21.15.50:0/1523800984 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56273353e4d0 0x562733906160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:46.792 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:46.785+0000 7f62648c5740 1 -- 172.21.15.50:0/1523800984 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x562733877f70 con 0x5627335362f0 2024-08-31T04:29:46.792 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:46.785+0000 7f62648c5740 1 -- 172.21.15.50:0/1523800984 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x562733867500 con 0x56273355f1b0 2024-08-31T04:29:46.792 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:46.785+0000 7f62648c5740 1 -- 172.21.15.50:0/1523800984 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x56273386b4b0 con 0x56273353e4d0 2024-08-31T04:29:46.792 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:46.787+0000 7f6257400640 1 --2- 172.21.15.50:0/1523800984 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56273353e4d0 0x562733906160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:29:46.792 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:46.787+0000 7f6257400640 1 -- 172.21.15.50:0/1523800984 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56273353e4d0 msgr2=0x562733906160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:29:46.792 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:46.787+0000 7f6257400640 1 --2- 172.21.15.50:0/1523800984 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56273353e4d0 0x562733906160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:46.792 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:46.787+0000 7f6257400640 1 -- 172.21.15.50:0/1523800984 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5627335362f0 msgr2=0x562733905610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:29:46.792 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:46.787+0000 7f6257400640 1 --2- 172.21.15.50:0/1523800984 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5627335362f0 0x562733905610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:46.792 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:46.787+0000 7f6257400640 1 -- 172.21.15.50:0/1523800984 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562733821c10 con 0x56273355f1b0 2024-08-31T04:29:46.793 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:46.790+0000 7f6256000640 1 --2- 172.21.15.50:0/3612822306 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f623c0b4ce0 0x7f623c0b71f0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f62440ab1e0 tx=0x7f6244000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:29:46.793 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:46.790+0000 7f6257400640 1 --2- 172.21.15.50:0/1523800984 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56273355f1b0 0x562733904fa0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f6258068ae0 tx=0x7f6258069620 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f01d4bd3e6492fb7 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:29:46.806 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:46.804+0000 7f6243e00640 1 -- 172.21.15.50:0/1523800984 <== mon.2 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62580747e0 con 0x56273355f1b0 2024-08-31T04:29:46.812 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:46.805+0000 7f6243e00640 1 -- 172.21.15.50:0/1523800984 <== mon.2 v2:172.21.15.133:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6258074e30 con 0x56273355f1b0 2024-08-31T04:29:46.812 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:46.806+0000 7f62648c5740 1 -- 172.21.15.50:0/1523800984 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56273355f1b0 msgr2=0x562733904fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:29:46.812 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:46.806+0000 7f6243e00640 1 -- 172.21.15.50:0/1523800984 <== mon.2 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62580747e0 con 0x56273355f1b0 2024-08-31T04:29:46.812 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:46.810+0000 7f62648c5740 1 --2- 172.21.15.50:0/1523800984 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56273355f1b0 0x562733904fa0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f6258068ae0 tx=0x7f6258069620 comp rx=0 tx=0).stop 2024-08-31T04:29:46.813 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:46.810+0000 7f62648c5740 1 -- 172.21.15.50:0/1523800984 shutdown_connections 2024-08-31T04:29:46.813 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:46.810+0000 7f62648c5740 1 --2- 172.21.15.50:0/1523800984 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56273353e4d0 0x562733906160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:46.813 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:46.810+0000 7f62648c5740 1 --2- 172.21.15.50:0/1523800984 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5627335362f0 0x562733905610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:46.813 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:46.810+0000 7f62648c5740 1 --2- 172.21.15.50:0/1523800984 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56273355f1b0 0x562733904fa0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:46.813 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:46.810+0000 7f62648c5740 1 -- 172.21.15.50:0/1523800984 >> 172.21.15.50:0/1523800984 conn(0x562733553300 msgr2=0x562733900a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:29:46.813 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:46.811+0000 7f62648c5740 1 -- 172.21.15.50:0/1523800984 shutdown_connections 2024-08-31T04:29:46.814 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:46.811+0000 7f62648c5740 1 -- 172.21.15.50:0/1523800984 wait complete. 2024-08-31T04:29:46.814 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:46.812+0000 7f62648c5740 1 -- start start 2024-08-31T04:29:46.814 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:46.812+0000 7f62648c5740 1 Processor -- start 2024-08-31T04:29:46.826 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:46.818+0000 7f62648c5740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5627335362f0 0x56273390e570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:46.826 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:46.818+0000 7f62648c5740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56273353e4d0 0x56273390ec30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:46.826 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:46.818+0000 7f62648c5740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56273355f1b0 0x56273390f7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:46.827 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:46.818+0000 7f62648c5740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x5627337a0ab0 con 0x56273355f1b0 2024-08-31T04:29:46.827 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:46.818+0000 7f62648c5740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x56273380e320 con 0x56273353e4d0 2024-08-31T04:29:46.827 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:46.818+0000 7f62648c5740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x562733906c80 con 0x5627335362f0 2024-08-31T04:29:46.827 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:46.818+0000 7f62648c5740 10 client.0 _ll_register_callbacks cb 0x5627338146a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:29:46.827 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:46.819+0000 7f6256a00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56273353e4d0 0x56273390ec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:29:46.827 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:46.819+0000 7f6256a00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56273353e4d0 0x56273390ec30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.50:47456/0 (socket says 172.21.15.50:47456) 2024-08-31T04:29:46.827 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:46.819+0000 7f6256a00640 1 -- 172.21.15.50:0/2597623506 learned_addr learned my addr 172.21.15.50:0/2597623506 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:29:46.827 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:46.819+0000 7f6257400640 1 --2- 172.21.15.50:0/2597623506 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56273355f1b0 0x56273390f7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:29:46.827 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:46.820+0000 7f6257400640 1 -- 172.21.15.50:0/2597623506 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5627335362f0 msgr2=0x56273390e570 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-08-31T04:29:46.827 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:46.820+0000 7f6257400640 1 --2- 172.21.15.50:0/2597623506 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5627335362f0 0x56273390e570 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:46.827 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:46.820+0000 7f6257400640 1 -- 172.21.15.50:0/2597623506 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56273353e4d0 msgr2=0x56273390ec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:29:46.827 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:46.820+0000 7f6257400640 1 --2- 172.21.15.50:0/2597623506 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56273353e4d0 0x56273390ec30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:46.827 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:46.820+0000 7f6257400640 1 -- 172.21.15.50:0/2597623506 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5627335ca790 con 0x56273355f1b0 2024-08-31T04:29:46.829 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:46.826+0000 7f6257400640 1 --2- 172.21.15.50:0/2597623506 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56273355f1b0 0x56273390f7a0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f6258052600 tx=0x7f625807b630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf26bd463410ed35 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:29:46.829 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:46.826+0000 7f6240c00640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-08-31T04:29:46.832 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:46.829+0000 7f6240c00640 1 -- 172.21.15.50:0/2597623506 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f625807b7a0 con 0x56273355f1b0 2024-08-31T04:29:46.833 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:46.829+0000 7f6240c00640 1 -- 172.21.15.50:0/2597623506 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8219+0+0 (secure 0 0 0) 0x7f6258075040 con 0x56273355f1b0 2024-08-31T04:29:46.835 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:46.831+0000 7f62648c5740 1 -- 172.21.15.50:0/2597623506 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6258074e30 con 0x56273355f1b0 2024-08-31T04:29:46.851 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:46.849+0000 7f6240c00640 1 -- 172.21.15.50:0/2597623506 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7f6258092050 con 0x56273355f1b0 2024-08-31T04:29:46.851 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:46.849+0000 7f62648c5740 10 client.15984 fetch_fsmap learned FSMap version 39 2024-08-31T04:29:46.852 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:46.849+0000 7f62648c5740 1 -- 172.21.15.50:0/2597623506 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) -- 0x562733643620 con 0x56273355f1b0 2024-08-31T04:29:46.869 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:46.856+0000 7f6240c00640 1 -- 172.21.15.50:0/2597623506 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6258074e30 con 0x56273355f1b0 2024-08-31T04:29:46.869 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:46.863+0000 7f6240c00640 1 -- 172.21.15.50:0/2597623506 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 39) ==== 8410+0+0 (secure 0 0 0) 0x7f6258084c20 con 0x56273355f1b0 2024-08-31T04:29:46.870 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:46.863+0000 7f62648c5740 10 client.15984 fetch_fsmap finished waiting for FSMap version 39 2024-08-31T04:29:46.870 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:46.863+0000 7f62648c5740 10 client.15984 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T04:29:46.870 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:46.863+0000 7f62648c5740 20 client.15984 populate_metadata read hostname 'smithi050' 2024-08-31T04:29:46.870 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:46.863+0000 7f62648c5740 1 --2- 172.21.15.50:0/2597623506 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x56273351dd80 0x56273391c290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:46.870 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:46.863+0000 7f6256a00640 1 --2- 172.21.15.50:0/2597623506 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x56273351dd80 0x56273391c290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:29:46.870 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:46.866+0000 7f62648c5740 4 client.15984 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T04:29:46.870 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:46.866+0000 7f62648c5740 1 -- 172.21.15.50:0/2597623506 --> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562733879ec0 con 0x56273351dd80 2024-08-31T04:29:46.870 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:46.866+0000 7f6256a00640 1 --2- 172.21.15.50:0/2597623506 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x56273351dd80 0x56273391c290 crc :-1 s=READY pgs=100 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ac954daf49ebbfcd server_cookie=b8d0007b5c6220f6 in_seq=0 out_seq=0 2024-08-31T04:29:46.879 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:46.868+0000 7f6240c00640 10 client.15984 ms_handle_connect on v2:172.21.15.133:6838/2526402262 2024-08-31T04:29:46.880 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:46.868+0000 7f6240c00640 1 -- 172.21.15.50:0/2597623506 <== mds.0 v2:172.21.15.133:6838/2526402262 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x562733879ec0 con 0x56273351dd80 2024-08-31T04:29:46.880 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:46.868+0000 7f6240c00640 10 client.15984 handle_command_reply: tid=0 2024-08-31T04:29:46.880 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:46.871+0000 7f62648c5740 1 client.15984 shutdown 2024-08-31T04:29:46.902 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:46.900+0000 7f62648c5740 1 -- 172.21.15.50:0/2597623506 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56273355f1b0 msgr2=0x56273390f7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:29:46.902 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:46.900+0000 7f62648c5740 1 --2- 172.21.15.50:0/2597623506 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56273355f1b0 0x56273390f7a0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f6258052600 tx=0x7f625807b630 comp rx=0 tx=0).stop 2024-08-31T04:29:46.903 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:46.901+0000 7f62648c5740 1 -- 172.21.15.50:0/2597623506 shutdown_connections 2024-08-31T04:29:46.903 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:46.901+0000 7f62648c5740 1 --2- 172.21.15.50:0/2597623506 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x56273351dd80 0x56273391c290 crc :-1 s=READY pgs=100 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:46.903 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:46.901+0000 7f62648c5740 1 --2- 172.21.15.50:0/2597623506 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56273355f1b0 0x56273390f7a0 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:46.903 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:46.901+0000 7f62648c5740 1 --2- 172.21.15.50:0/2597623506 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56273353e4d0 0x56273390ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:46.903 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:46.901+0000 7f62648c5740 1 --2- 172.21.15.50:0/2597623506 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5627335362f0 0x56273390e570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:46.903 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:46.901+0000 7f62648c5740 1 -- 172.21.15.50:0/2597623506 >> 172.21.15.50:0/2597623506 conn(0x562733553300 msgr2=0x5627338fef40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:29:46.904 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:46.901+0000 7f6240c00640 0 client.15984 ms_handle_reset on v2:172.21.15.133:6838/2526402262 2024-08-31T04:29:46.904 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:46.901+0000 7f62648c5740 1 -- 172.21.15.50:0/2597623506 shutdown_connections 2024-08-31T04:29:46.904 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:46.901+0000 7f62648c5740 1 -- 172.21.15.50:0/2597623506 wait complete. 2024-08-31T04:29:46.904 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:46.902+0000 7f62648c5740 20 client.15984 trim_cache size 0 max 16384 2024-08-31T04:29:47.199 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:29:47.182+0000 7f1ad5c00640 1 -- 172.21.15.50:0/1536390127 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1ad006a370 msgr2=0x7f1ad0101fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:29:47.199 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:29:47.182+0000 7f1ad5c00640 1 --2- 172.21.15.50:0/1536390127 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1ad006a370 0x7f1ad0101fa0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f1ac0009860 tx=0x7f1ac002a360 comp rx=0 tx=0).stop 2024-08-31T04:29:47.199 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:29:47.182+0000 7f1ad5c00640 1 -- 172.21.15.50:0/1536390127 shutdown_connections 2024-08-31T04:29:47.199 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:29:47.182+0000 7f1ad5c00640 1 --2- 172.21.15.50:0/1536390127 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1ad01024e0 0x7f1ad01078e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:47.199 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:29:47.182+0000 7f1ad5c00640 1 --2- 172.21.15.50:0/1536390127 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1ad01028f0 0x7f1ad0107e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:47.199 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:29:47.182+0000 7f1ad5c00640 1 --2- 172.21.15.50:0/1536390127 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1ad006a370 0x7f1ad0101fa0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:47.199 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:29:47.182+0000 7f1ad5c00640 1 -- 172.21.15.50:0/1536390127 >> 172.21.15.50:0/1536390127 conn(0x7f1ad0079cf0 msgr2=0x7f1ad007a100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:29:47.199 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:29:47.183+0000 7f1ad5c00640 1 -- 172.21.15.50:0/1536390127 shutdown_connections 2024-08-31T04:29:47.199 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:29:47.183+0000 7f1ad5c00640 1 -- 172.21.15.50:0/1536390127 wait complete. 2024-08-31T04:29:47.199 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:29:47.185+0000 7f1ad5c00640 1 Processor -- start 2024-08-31T04:29:47.200 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:29:47.185+0000 7f1ad5c00640 1 -- start start 2024-08-31T04:29:47.200 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:29:47.186+0000 7f1ad5c00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1ad006a370 0x7f1ad01980f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:47.200 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:29:47.186+0000 7f1ad5c00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1ad01024e0 0x7f1ad0198690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:47.200 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:29:47.186+0000 7f1ad5c00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1ad01028f0 0x7f1ad019d930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:47.200 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:29:47.186+0000 7f1ad5c00640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f1ad010b7d0 con 0x7f1ad006a370 2024-08-31T04:29:47.200 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:29:47.186+0000 7f1ad5c00640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f1ad010b650 con 0x7f1ad01024e0 2024-08-31T04:29:47.200 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:29:47.186+0000 7f1ad5c00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f1ad010b950 con 0x7f1ad01028f0 2024-08-31T04:29:47.200 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:29:47.186+0000 7f1ace000640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1ad01024e0 0x7f1ad0198690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:29:47.200 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:29:47.186+0000 7f1ace000640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1ad01024e0 0x7f1ad0198690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.50:47468/0 (socket says 172.21.15.50:47468) 2024-08-31T04:29:47.200 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:29:47.186+0000 7f1ace000640 1 -- 172.21.15.50:0/1422250625 learned_addr learned my addr 172.21.15.50:0/1422250625 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:29:47.200 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:29:47.186+0000 7f1acf400640 1 --2- 172.21.15.50:0/1422250625 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1ad01028f0 0x7f1ad019d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:29:47.200 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:29:47.187+0000 7f1ace000640 1 -- 172.21.15.50:0/1422250625 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1ad01028f0 msgr2=0x7f1ad019d930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:29:47.200 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:29:47.187+0000 7f1ace000640 1 --2- 172.21.15.50:0/1422250625 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1ad01028f0 0x7f1ad019d930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:47.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:29:47.187+0000 7f1ace000640 1 -- 172.21.15.50:0/1422250625 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1ad006a370 msgr2=0x7f1ad01980f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-08-31T04:29:47.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:29:47.187+0000 7f1ace000640 1 --2- 172.21.15.50:0/1422250625 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1ad006a370 0x7f1ad01980f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:47.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:29:47.187+0000 7f1ace000640 1 -- 172.21.15.50:0/1422250625 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ad019e060 con 0x7f1ad01024e0 2024-08-31T04:29:47.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:29:47.188+0000 7f1ace000640 1 --2- 172.21.15.50:0/1422250625 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1ad01024e0 0x7f1ad0198690 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f1abc016f00 tx=0x7f1abc014490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:29:47.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:29:47.188+0000 7f1ac7400640 1 -- 172.21.15.50:0/1422250625 <== mon.2 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1abc00fbd0 con 0x7f1ad01024e0 2024-08-31T04:29:47.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:29:47.188+0000 7f1ac7400640 1 -- 172.21.15.50:0/1422250625 <== mon.2 v2:172.21.15.133:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1abc021070 con 0x7f1ad01024e0 2024-08-31T04:29:47.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:29:47.188+0000 7f1ac7400640 1 -- 172.21.15.50:0/1422250625 <== mon.2 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1abc01c800 con 0x7f1ad01024e0 2024-08-31T04:29:47.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:29:47.190+0000 7f1ad5c00640 1 -- 172.21.15.50:0/1422250625 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1ad019e2f0 con 0x7f1ad01024e0 2024-08-31T04:29:47.201 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:29:47.190+0000 7f1ad5c00640 1 -- 172.21.15.50:0/1422250625 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1ad01a4ab0 con 0x7f1ad01024e0 2024-08-31T04:29:47.208 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:29:47.203+0000 7f1ac7400640 1 -- 172.21.15.50:0/1422250625 <== mon.2 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 18) ==== 152577+0+0 (secure 0 0 0) 0x7f1abc01a050 con 0x7f1ad01024e0 2024-08-31T04:29:47.209 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:29:47.204+0000 7f1adc8a5740 1 Processor -- start 2024-08-31T04:29:47.209 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:29:47.204+0000 7f1adc8a5740 1 -- start start 2024-08-31T04:29:47.209 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:29:47.205+0000 7f1adc8a5740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55dcc932c840 0x55dcc96d3110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:47.209 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:29:47.205+0000 7f1adc8a5740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55dcc9303980 0x55dcc96d3650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:47.209 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:29:47.205+0000 7f1adc8a5740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55dcc930bb60 0x55dcc96d3b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:47.209 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:29:47.205+0000 7f1adc8a5740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55dcc9648530 con 0x55dcc930bb60 2024-08-31T04:29:47.209 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:29:47.205+0000 7f1adc8a5740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x55dcc9637ac0 con 0x55dcc9303980 2024-08-31T04:29:47.209 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:29:47.205+0000 7f1adc8a5740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x55dcc963ba70 con 0x55dcc932c840 2024-08-31T04:29:47.210 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:29:47.205+0000 7f1ace000640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55dcc930bb60 0x55dcc96d3b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:29:47.210 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:29:47.205+0000 7f1ace000640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55dcc930bb60 0x55dcc96d3b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35034/0 (socket says 172.21.15.50:35034) 2024-08-31T04:29:47.210 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:29:47.205+0000 7f1ace000640 1 -- 172.21.15.50:0/2293932085 learned_addr learned my addr 172.21.15.50:0/2293932085 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:29:47.210 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:29:47.206+0000 7f1ac7400640 1 --2- 172.21.15.50:0/1422250625 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f1ab40b4bf0 0x7f1ab40b7100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:47.210 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:29:47.206+0000 7f1ace000640 1 -- 172.21.15.50:0/2293932085 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55dcc932c840 msgr2=0x55dcc96d3110 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-31T04:29:47.210 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:29:47.206+0000 7f1ace000640 1 --2- 172.21.15.50:0/2293932085 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55dcc932c840 0x55dcc96d3110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:47.210 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:29:47.206+0000 7f1ace000640 1 -- 172.21.15.50:0/2293932085 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55dcc9303980 msgr2=0x55dcc96d3650 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-31T04:29:47.210 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:29:47.206+0000 7f1ace000640 1 --2- 172.21.15.50:0/2293932085 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55dcc9303980 0x55dcc96d3650 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:47.210 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:29:47.206+0000 7f1ace000640 1 -- 172.21.15.50:0/2293932085 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dcc95ea880 con 0x55dcc930bb60 2024-08-31T04:29:47.210 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:29:47.207+0000 7f1ac7400640 1 -- 172.21.15.50:0/1422250625 <== mon.2 v2:172.21.15.133:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8219+0+0 (secure 0 0 0) 0x7f1abc0ecb00 con 0x7f1ad01024e0 2024-08-31T04:29:47.218 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:29:47.209+0000 7f1ace000640 1 --2- 172.21.15.50:0/2293932085 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55dcc930bb60 0x55dcc96d3b90 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f1abc0b0840 tx=0x7f1abc0b2f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4944d1e5e54eb03d server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:29:47.218 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:29:47.213+0000 7f1abbe00640 1 -- 172.21.15.50:0/2293932085 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1abc0bc190 con 0x55dcc930bb60 2024-08-31T04:29:47.218 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:29:47.213+0000 7f1abbe00640 1 -- 172.21.15.50:0/2293932085 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1abc0b3cd0 con 0x55dcc930bb60 2024-08-31T04:29:47.218 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:29:47.213+0000 7f1abbe00640 1 -- 172.21.15.50:0/2293932085 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1abc0d6310 con 0x55dcc930bb60 2024-08-31T04:29:47.222 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:29:47.217+0000 7f1adc8a5740 1 -- 172.21.15.50:0/2293932085 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55dcc930bb60 msgr2=0x55dcc96d3b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:29:47.222 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:29:47.217+0000 7f1adc8a5740 1 --2- 172.21.15.50:0/2293932085 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55dcc930bb60 0x55dcc96d3b90 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f1abc0b0840 tx=0x7f1abc0b2f20 comp rx=0 tx=0).stop 2024-08-31T04:29:47.222 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:29:47.215+0000 7f1acf400640 1 --2- 172.21.15.50:0/1422250625 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f1ab40b4bf0 0x7f1ab40b7100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:29:47.222 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:29:47.217+0000 7f1adc8a5740 1 -- 172.21.15.50:0/2293932085 shutdown_connections 2024-08-31T04:29:47.222 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:29:47.217+0000 7f1adc8a5740 1 --2- 172.21.15.50:0/2293932085 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55dcc930bb60 0x55dcc96d3b90 secure :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f1abc0b0840 tx=0x7f1abc0b2f20 comp rx=0 tx=0).stop 2024-08-31T04:29:47.222 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:29:47.217+0000 7f1adc8a5740 1 --2- 172.21.15.50:0/2293932085 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55dcc9303980 0x55dcc96d3650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:47.223 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:29:47.217+0000 7f1adc8a5740 1 --2- 172.21.15.50:0/2293932085 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55dcc932c840 0x55dcc96d3110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:47.223 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:29:47.217+0000 7f1adc8a5740 1 -- 172.21.15.50:0/2293932085 >> 172.21.15.50:0/2293932085 conn(0x55dcc9320990 msgr2=0x55dcc96d1000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:29:47.223 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:29:47.220+0000 7f1acf400640 1 --2- 172.21.15.50:0/1422250625 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f1ab40b4bf0 0x7f1ab40b7100 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f1ac8009f00 tx=0x7f1ac800d040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:29:47.237 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:29:47.233+0000 7f1adc8a5740 1 -- 172.21.15.50:0/2293932085 shutdown_connections 2024-08-31T04:29:47.248 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:29:47.234+0000 7f1adc8a5740 1 -- 172.21.15.50:0/2293932085 wait complete. 2024-08-31T04:29:47.248 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:29:47.234+0000 7f1adc8a5740 1 -- start start 2024-08-31T04:29:47.248 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:29:47.235+0000 7f1adc8a5740 1 Processor -- start 2024-08-31T04:29:47.248 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:29:47.235+0000 7f1adc8a5740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55dcc9303980 0x55dcc96df370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:47.249 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:29:47.236+0000 7f1adc8a5740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55dcc932c840 0x55dcc96df930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:47.249 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:29:47.236+0000 7f1adc8a5740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55dcc92eb1c0 0x55dcc96e4970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:47.249 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:29:47.238+0000 7f1ace000640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55dcc932c840 0x55dcc96df930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:29:47.249 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:29:47.238+0000 7f1ace000640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55dcc932c840 0x55dcc96df930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.50:59532/0 (socket says 172.21.15.50:59532) 2024-08-31T04:29:47.249 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:29:47.238+0000 7f1adc8a5740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55dcc949a7a0 con 0x55dcc92eb1c0 2024-08-31T04:29:47.249 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:29:47.238+0000 7f1adc8a5740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x55dcc95be7f0 con 0x55dcc9303980 2024-08-31T04:29:47.249 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:29:47.238+0000 7f1adc8a5740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x55dcc96d9680 con 0x55dcc932c840 2024-08-31T04:29:47.249 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:29:47.238+0000 7f1adc8a5740 10 client.0 _ll_register_callbacks cb 0x55dcc95e3e60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:29:47.249 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:29:47.239+0000 7f1ace000640 1 -- 172.21.15.50:0/1387956089 learned_addr learned my addr 172.21.15.50:0/1387956089 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:29:47.249 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:29:47.239+0000 7f1acea00640 1 --2- 172.21.15.50:0/1387956089 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55dcc9303980 0x55dcc96df370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:29:47.249 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:29:47.239+0000 7f1ace000640 1 -- 172.21.15.50:0/1387956089 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55dcc9303980 msgr2=0x55dcc96df370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:29:47.249 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:29:47.239+0000 7f1ace000640 1 --2- 172.21.15.50:0/1387956089 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55dcc9303980 0x55dcc96df370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:47.250 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:29:47.239+0000 7f1ace000640 1 -- 172.21.15.50:0/1387956089 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55dcc92eb1c0 msgr2=0x55dcc96e4970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:29:47.250 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:29:47.239+0000 7f1ace000640 1 --2- 172.21.15.50:0/1387956089 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55dcc92eb1c0 0x55dcc96e4970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:47.250 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:29:47.239+0000 7f1ace000640 1 -- 172.21.15.50:0/1387956089 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dcc93a6b90 con 0x55dcc932c840 2024-08-31T04:29:47.250 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:29:47.240+0000 7f1ace000640 1 --2- 172.21.15.50:0/1387956089 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55dcc932c840 0x55dcc96df930 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f1abc0ea980 tx=0x7f1abc0af590 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b3fe879ac6fa49a0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:29:47.250 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:29:47.240+0000 7f1ab8c00640 10 client.0 ms_handle_connect on v2:172.21.15.177:3300/0 2024-08-31T04:29:47.250 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:29:47.240+0000 7f1ab8c00640 1 -- 172.21.15.50:0/1387956089 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1abc0bc190 con 0x55dcc932c840 2024-08-31T04:29:47.250 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:29:47.240+0000 7f1ab8c00640 1 -- 172.21.15.50:0/1387956089 <== mon.1 v2:172.21.15.177:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8219+0+0 (secure 0 0 0) 0x7f1abc0bc3d0 con 0x55dcc932c840 2024-08-31T04:29:47.250 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:29:47.240+0000 7f1adc8a5740 1 -- 172.21.15.50:0/1387956089 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1abc0b3cd0 con 0x55dcc932c840 2024-08-31T04:29:47.289 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:29:47.256+0000 7f1ab8c00640 1 -- 172.21.15.50:0/1387956089 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7f1abc0b35d0 con 0x55dcc932c840 2024-08-31T04:29:47.290 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:29:47.256+0000 7f1adc8a5740 10 client.25972 fetch_fsmap learned FSMap version 39 2024-08-31T04:29:47.290 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:29:47.256+0000 7f1adc8a5740 1 -- 172.21.15.50:0/1387956089 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) -- 0x55dcc96ed8b0 con 0x55dcc932c840 2024-08-31T04:29:47.290 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:29:47.256+0000 7f1ab8c00640 1 -- 172.21.15.50:0/1387956089 <== mon.1 v2:172.21.15.177:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1abc0b3cd0 con 0x55dcc932c840 2024-08-31T04:29:47.290 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:29:47.258+0000 7f1ab8c00640 1 -- 172.21.15.50:0/1387956089 <== mon.1 v2:172.21.15.177:3300/0 5 ==== fsmap(e 39) ==== 8410+0+0 (secure 0 0 0) 0x7f1abc0ba190 con 0x55dcc932c840 2024-08-31T04:29:47.290 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:29:47.258+0000 7f1adc8a5740 10 client.25972 fetch_fsmap finished waiting for FSMap version 39 2024-08-31T04:29:47.290 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:29:47.258+0000 7f1adc8a5740 10 client.25972 resolve_mds: validated gid 24695 aka daemon mds.b 2024-08-31T04:29:47.342 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:29:47.258+0000 7f1adc8a5740 20 client.25972 populate_metadata read hostname 'smithi050' 2024-08-31T04:29:47.342 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:29:47.258+0000 7f1adc8a5740 1 --2- 172.21.15.50:0/1387956089 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x55dcc92c0570 0x55dcc96f0cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:47.342 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:29:47.258+0000 7f1adc8a5740 4 client.25972 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T04:29:47.342 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:29:47.258+0000 7f1adc8a5740 1 -- 172.21.15.50:0/1387956089 --> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55dcc964a480 con 0x55dcc92c0570 2024-08-31T04:29:47.342 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:29:47.258+0000 7f1acea00640 1 --2- 172.21.15.50:0/1387956089 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x55dcc92c0570 0x55dcc96f0cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:29:47.342 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:29:47.259+0000 7f1acea00640 1 --2- 172.21.15.50:0/1387956089 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x55dcc92c0570 0x55dcc96f0cd0 crc :-1 s=READY pgs=101 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bb91178176fadd85 server_cookie=5f6fc962ca5f481c in_seq=0 out_seq=0 2024-08-31T04:29:47.342 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:29:47.259+0000 7f1ab8c00640 10 client.25972 ms_handle_connect on v2:172.21.15.133:6838/2526402262 2024-08-31T04:29:47.342 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:29:47.262+0000 7f1ab8c00640 1 -- 172.21.15.50:0/1387956089 <== mds.0 v2:172.21.15.133:6838/2526402262 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55dcc964a480 con 0x55dcc92c0570 2024-08-31T04:29:47.343 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:29:47.262+0000 7f1ab8c00640 10 client.25972 handle_command_reply: tid=0 2024-08-31T04:29:47.343 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:29:47.262+0000 7f1adc8a5740 1 client.25972 shutdown 2024-08-31T04:29:47.343 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:29:47.263+0000 7f1adc8a5740 1 -- 172.21.15.50:0/1387956089 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55dcc932c840 msgr2=0x55dcc96df930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:29:47.343 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:29:47.263+0000 7f1adc8a5740 1 --2- 172.21.15.50:0/1387956089 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55dcc932c840 0x55dcc96df930 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f1abc0ea980 tx=0x7f1abc0af590 comp rx=0 tx=0).stop 2024-08-31T04:29:47.343 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:29:47.263+0000 7f1adc8a5740 1 -- 172.21.15.50:0/1387956089 shutdown_connections 2024-08-31T04:29:47.343 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:29:47.263+0000 7f1adc8a5740 1 --2- 172.21.15.50:0/1387956089 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x55dcc92c0570 0x55dcc96f0cd0 crc :-1 s=READY pgs=101 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:47.343 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:29:47.263+0000 7f1adc8a5740 1 --2- 172.21.15.50:0/1387956089 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55dcc932c840 0x55dcc96df930 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:47.343 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:29:47.263+0000 7f1adc8a5740 1 --2- 172.21.15.50:0/1387956089 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55dcc92eb1c0 0x55dcc96e4970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:47.343 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:29:47.263+0000 7f1adc8a5740 1 --2- 172.21.15.50:0/1387956089 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55dcc9303980 0x55dcc96df370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:47.343 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:29:47.263+0000 7f1adc8a5740 1 -- 172.21.15.50:0/1387956089 >> 172.21.15.50:0/1387956089 conn(0x55dcc9320990 msgr2=0x55dcc96d4140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:29:47.343 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:29:47.263+0000 7f1ab8c00640 0 client.25972 ms_handle_reset on v2:172.21.15.133:6838/2526402262 2024-08-31T04:29:47.343 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:29:47.264+0000 7f1adc8a5740 1 -- 172.21.15.50:0/1387956089 shutdown_connections 2024-08-31T04:29:47.343 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:29:47.264+0000 7f1adc8a5740 1 -- 172.21.15.50:0/1387956089 wait complete. 2024-08-31T04:29:47.343 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:29:47.264+0000 7f1adc8a5740 20 client.25972 trim_cache size 0 max 16384 2024-08-31T04:29:47.344 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:29:47.326+0000 7f1adc8a5740 1 Processor -- start 2024-08-31T04:29:47.350 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:29:47.347+0000 7f1adc8a5740 1 -- start start 2024-08-31T04:29:47.351 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:29:47.348+0000 7f1adc8a5740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55dcc92eb1c0 0x55dcc96d4850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:47.351 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:29:47.348+0000 7f1adc8a5740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55dcc9303980 0x55dcc96da910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:47.351 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:29:47.348+0000 7f1adc8a5740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55dcc932c840 0x55dcc96e47e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:47.351 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:29:47.348+0000 7f1adc8a5740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f1ad01ad190 con 0x55dcc932c840 2024-08-31T04:29:47.351 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:29:47.348+0000 7f1adc8a5740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f1ad01aef10 con 0x55dcc92eb1c0 2024-08-31T04:29:47.351 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:29:47.348+0000 7f1adc8a5740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f1ad01ad860 con 0x55dcc9303980 2024-08-31T04:29:47.351 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:29:47.348+0000 7f1acea00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55dcc92eb1c0 0x55dcc96d4850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:29:47.356 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:29:47.348+0000 7f1acea00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55dcc92eb1c0 0x55dcc96d4850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.50:47476/0 (socket says 172.21.15.50:47476) 2024-08-31T04:29:47.356 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:29:47.352+0000 7f1acea00640 1 -- 172.21.15.50:0/1094668356 learned_addr learned my addr 172.21.15.50:0/1094668356 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:29:47.357 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:29:47.349+0000 7f1acf400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55dcc932c840 0x55dcc96e47e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:29:47.357 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:29:47.354+0000 7f1acea00640 1 -- 172.21.15.50:0/1094668356 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55dcc9303980 msgr2=0x55dcc96da910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:29:47.358 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:29:47.349+0000 7f1ace000640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55dcc9303980 0x55dcc96da910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:29:47.358 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:29:47.355+0000 7f1acea00640 1 --2- 172.21.15.50:0/1094668356 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55dcc9303980 0x55dcc96da910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:47.358 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:29:47.356+0000 7f1acea00640 1 -- 172.21.15.50:0/1094668356 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55dcc932c840 msgr2=0x55dcc96e47e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:29:47.359 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:29:47.356+0000 7f1acea00640 1 --2- 172.21.15.50:0/1094668356 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55dcc932c840 0x55dcc96e47e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:47.359 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:29:47.356+0000 7f1acea00640 1 -- 172.21.15.50:0/1094668356 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dcc96d0340 con 0x55dcc92eb1c0 2024-08-31T04:29:47.359 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:29:47.356+0000 7f1ace000640 1 --2- 172.21.15.50:0/1094668356 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55dcc9303980 0x55dcc96da910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T04:29:47.359 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:29:47.356+0000 7f1acf400640 1 --2- 172.21.15.50:0/1094668356 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55dcc932c840 0x55dcc96e47e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:29:47.359 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:29:47.357+0000 7f1acea00640 1 --2- 172.21.15.50:0/1094668356 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55dcc92eb1c0 0x55dcc96d4850 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x55dcc96d1d90 tx=0x7f1ac0000bc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6794d7d39b795021 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:29:47.361 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:29:47.357+0000 7f1abb400640 1 -- 172.21.15.50:0/1094668356 <== mon.2 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ac0037040 con 0x55dcc92eb1c0 2024-08-31T04:29:47.361 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:29:47.357+0000 7f1abb400640 1 -- 172.21.15.50:0/1094668356 <== mon.2 v2:172.21.15.133:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1ac00054f0 con 0x55dcc92eb1c0 2024-08-31T04:29:47.362 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:29:47.358+0000 7f1abb400640 1 -- 172.21.15.50:0/1094668356 <== mon.2 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ac0030780 con 0x55dcc92eb1c0 2024-08-31T04:29:47.362 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:29:47.359+0000 7f1adc8a5740 1 -- 172.21.15.50:0/1094668356 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55dcc92eb1c0 msgr2=0x55dcc96d4850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:29:47.362 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:29:47.359+0000 7f1adc8a5740 1 --2- 172.21.15.50:0/1094668356 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55dcc92eb1c0 0x55dcc96d4850 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x55dcc96d1d90 tx=0x7f1ac0000bc0 comp rx=0 tx=0).stop 2024-08-31T04:29:47.362 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:29:47.360+0000 7f1adc8a5740 1 -- 172.21.15.50:0/1094668356 shutdown_connections 2024-08-31T04:29:47.362 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:29:47.360+0000 7f1adc8a5740 1 --2- 172.21.15.50:0/1094668356 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55dcc9303980 0x55dcc96da910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:47.363 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:29:47.360+0000 7f1adc8a5740 1 --2- 172.21.15.50:0/1094668356 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55dcc932c840 0x55dcc96e47e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:47.363 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:29:47.360+0000 7f1adc8a5740 1 --2- 172.21.15.50:0/1094668356 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55dcc92eb1c0 0x55dcc96d4850 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:47.363 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:29:47.360+0000 7f1adc8a5740 1 -- 172.21.15.50:0/1094668356 >> 172.21.15.50:0/1094668356 conn(0x55dcc9320990 msgr2=0x55dcc96d4140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:29:47.363 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:29:47.360+0000 7f1adc8a5740 1 -- 172.21.15.50:0/1094668356 shutdown_connections 2024-08-31T04:29:47.363 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:29:47.360+0000 7f1adc8a5740 1 -- 172.21.15.50:0/1094668356 wait complete. 2024-08-31T04:29:47.365 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:29:47.362+0000 7f1adc8a5740 1 -- start start 2024-08-31T04:29:47.365 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:29:47.362+0000 7f1adc8a5740 1 Processor -- start 2024-08-31T04:29:47.374 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:29:47.367+0000 7f1adc8a5740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55dcc92eb1c0 0x55dcc96f6a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:47.374 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:29:47.367+0000 7f1adc8a5740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55dcc9303980 0x55dcc96f6fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:47.375 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:29:47.367+0000 7f1acea00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55dcc92eb1c0 0x55dcc96f6a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:29:47.375 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:29:47.367+0000 7f1acea00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55dcc92eb1c0 0x55dcc96f6a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.50:59560/0 (socket says 172.21.15.50:59560) 2024-08-31T04:29:47.375 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:29:47.368+0000 7f1acea00640 1 -- 172.21.15.50:0/3216946615 learned_addr learned my addr 172.21.15.50:0/3216946615 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:29:47.375 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:29:47.368+0000 7f1adc8a5740 1 --2- 172.21.15.50:0/3216946615 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55dcc932c840 0x55dcc96f74e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:47.375 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:29:47.368+0000 7f1adc8a5740 1 -- 172.21.15.50:0/3216946615 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f1ad01ae780 con 0x55dcc9303980 2024-08-31T04:29:47.375 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:29:47.369+0000 7f1acf400640 1 --2- 172.21.15.50:0/3216946615 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55dcc932c840 0x55dcc96f74e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:29:47.375 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:29:47.373+0000 7f1ace000640 1 --2- 172.21.15.50:0/3216946615 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55dcc9303980 0x55dcc96f6fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:29:47.376 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:29:47.373+0000 7f1adc8a5740 1 -- 172.21.15.50:0/3216946615 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f1ad01adff0 con 0x55dcc932c840 2024-08-31T04:29:47.376 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:29:47.373+0000 7f1adc8a5740 1 -- 172.21.15.50:0/3216946615 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f1ad01ab130 con 0x55dcc92eb1c0 2024-08-31T04:29:47.376 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:29:47.373+0000 7f1adc8a5740 10 client.0 _ll_register_callbacks cb 0x7f1abc00fe70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:29:47.377 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:29:47.374+0000 7f1acf400640 1 -- 172.21.15.50:0/3216946615 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55dcc92eb1c0 msgr2=0x55dcc96f6a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:29:47.377 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:29:47.374+0000 7f1acf400640 1 --2- 172.21.15.50:0/3216946615 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55dcc92eb1c0 0x55dcc96f6a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:47.377 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:29:47.374+0000 7f1acf400640 1 -- 172.21.15.50:0/3216946615 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55dcc9303980 msgr2=0x55dcc96f6fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:29:47.377 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:29:47.374+0000 7f1acf400640 1 --2- 172.21.15.50:0/3216946615 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55dcc9303980 0x55dcc96f6fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:47.387 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:29:47.374+0000 7f1acf400640 1 -- 172.21.15.50:0/3216946615 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dcc975a830 con 0x55dcc932c840 2024-08-31T04:29:47.387 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:29:47.374+0000 7f1acea00640 1 --2- 172.21.15.50:0/3216946615 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55dcc92eb1c0 0x55dcc96f6a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:29:47.387 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:29:47.380+0000 7f1acf400640 1 --2- 172.21.15.50:0/3216946615 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55dcc932c840 0x55dcc96f74e0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f1ac8009fd0 tx=0x7f1ac8009650 comp rx=0 tx=0).ready entity=mon.2 client_cookie=43a77e364401699a server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:29:47.387 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:29:47.380+0000 7f1ab8c00640 10 client.0 ms_handle_connect on v2:172.21.15.133:3300/0 2024-08-31T04:29:47.387 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:29:47.380+0000 7f1ab8c00640 1 -- 172.21.15.50:0/3216946615 <== mon.2 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ac8026020 con 0x55dcc932c840 2024-08-31T04:29:47.387 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:29:47.380+0000 7f1ab8c00640 1 -- 172.21.15.50:0/3216946615 <== mon.2 v2:172.21.15.133:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8219+0+0 (secure 0 0 0) 0x7f1ac8022640 con 0x55dcc932c840 2024-08-31T04:29:47.387 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:29:47.381+0000 7f1adc8a5740 1 -- 172.21.15.50:0/3216946615 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1ac00054f0 con 0x55dcc932c840 2024-08-31T04:29:47.388 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:29:47.381+0000 7f1ab8c00640 1 -- 172.21.15.50:0/3216946615 <== mon.2 v2:172.21.15.133:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7f1ac8013eb0 con 0x55dcc932c840 2024-08-31T04:29:47.388 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:29:47.381+0000 7f1adc8a5740 10 client.26006 fetch_fsmap learned FSMap version 39 2024-08-31T04:29:47.388 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:29:47.381+0000 7f1adc8a5740 1 -- 172.21.15.50:0/3216946615 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) -- 0x55dcc975ba60 con 0x55dcc932c840 2024-08-31T04:29:47.388 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:29:47.382+0000 7f1ab8c00640 1 -- 172.21.15.50:0/3216946615 <== mon.2 v2:172.21.15.133:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1ac00054f0 con 0x55dcc932c840 2024-08-31T04:29:47.388 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:29:47.383+0000 7f1ab8c00640 1 -- 172.21.15.50:0/3216946615 <== mon.2 v2:172.21.15.133:3300/0 5 ==== fsmap(e 39) ==== 8410+0+0 (secure 0 0 0) 0x7f1ac8021840 con 0x55dcc932c840 2024-08-31T04:29:47.388 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:29:47.383+0000 7f1adc8a5740 10 client.26006 fetch_fsmap finished waiting for FSMap version 39 2024-08-31T04:29:47.388 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:29:47.383+0000 7f1adc8a5740 10 client.26006 resolve_mds: validated gid 24695 aka daemon mds.b 2024-08-31T04:29:47.388 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:29:47.383+0000 7f1adc8a5740 20 client.26006 populate_metadata read hostname 'smithi050' 2024-08-31T04:29:47.388 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:29:47.383+0000 7f1adc8a5740 1 --2- 172.21.15.50:0/3216946615 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x55dcc975c2e0 0x55dcc975e700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:47.388 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:29:47.383+0000 7f1adc8a5740 4 client.26006 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 152.7, "await_for": 45.0}] 2024-08-31T04:29:47.388 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:29:47.383+0000 7f1adc8a5740 1 -- 172.21.15.50:0/3216946615 --> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 152.7, "await_for": 45.0}) -- 0x55dcc9645f20 con 0x55dcc975c2e0 2024-08-31T04:29:47.388 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:29:47.384+0000 7f1acea00640 1 --2- 172.21.15.50:0/3216946615 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x55dcc975c2e0 0x55dcc975e700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:29:47.389 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:29:47.385+0000 7f1ab8c00640 10 client.26006 ms_handle_connect on v2:172.21.15.133:6838/2526402262 2024-08-31T04:29:47.389 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:29:47.385+0000 7f1acea00640 1 --2- 172.21.15.50:0/3216946615 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x55dcc975c2e0 0x55dcc975e700 crc :-1 s=READY pgs=102 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b9c6f667039cba86 server_cookie=a0615c562e67648f in_seq=0 out_seq=0 2024-08-31T04:29:47.399 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:47.388+0000 7f62648c5740 1 Processor -- start 2024-08-31T04:29:47.440 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:47.425+0000 7f62648c5740 1 -- start start 2024-08-31T04:29:47.441 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:47.426+0000 7f62648c5740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5627335362f0 0x562733905650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:47.441 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:47.426+0000 7f62648c5740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56273353e4d0 0x56273390d770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:47.441 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:47.426+0000 7f62648c5740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56273355f1b0 0x56273390dcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:47.441 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:47.426+0000 7f62648c5740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f625015d270 con 0x56273353e4d0 2024-08-31T04:29:47.441 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:47.426+0000 7f62648c5740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f625015eff0 con 0x56273355f1b0 2024-08-31T04:29:47.441 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:47.426+0000 7f62648c5740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f625015d940 con 0x5627335362f0 2024-08-31T04:29:47.441 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:47.429+0000 7f6257400640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5627335362f0 0x562733905650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:29:47.441 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:47.429+0000 7f6257400640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5627335362f0 0x562733905650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.50:59564/0 (socket says 172.21.15.50:59564) 2024-08-31T04:29:47.441 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:47.429+0000 7f6257400640 1 -- 172.21.15.50:0/1138663846 learned_addr learned my addr 172.21.15.50:0/1138663846 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:29:47.441 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:47.432+0000 7f6257400640 1 --2- 172.21.15.50:0/1138663846 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56273355f1b0 0x56273390dcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:29:47.441 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:47.433+0000 7f6257400640 1 -- 172.21.15.50:0/1138663846 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56273355f1b0 msgr2=0x56273390dcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:29:47.441 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:47.433+0000 7f6257400640 1 --2- 172.21.15.50:0/1138663846 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56273355f1b0 0x56273390dcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:47.441 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:47.433+0000 7f6257400640 1 -- 172.21.15.50:0/1138663846 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56273353e4d0 msgr2=0x56273390d770 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-31T04:29:47.442 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:47.433+0000 7f6257400640 1 --2- 172.21.15.50:0/1138663846 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56273353e4d0 0x56273390d770 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:47.442 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:47.433+0000 7f6257400640 1 -- 172.21.15.50:0/1138663846 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56273351dfb0 con 0x5627335362f0 2024-08-31T04:29:47.446 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:47.441+0000 7f6257400640 1 --2- 172.21.15.50:0/1138663846 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5627335362f0 0x562733905650 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f6258068ea0 tx=0x7f6258074040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=37cf2612225d3565 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:29:47.455 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:29:47 smithi050 ceph-mon[17259]: pgmap v574: 97 pgs: 97 active+clean; 1.4 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 9.8 MiB/s wr, 583 op/s 2024-08-31T04:29:47.455 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:29:47 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-08-31T04:29:47.484 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:47.465+0000 7f6243400640 1 -- 172.21.15.50:0/1138663846 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f625809d070 con 0x5627335362f0 2024-08-31T04:29:47.484 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:47.465+0000 7f6243400640 1 -- 172.21.15.50:0/1138663846 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6258069bd0 con 0x5627335362f0 2024-08-31T04:29:47.484 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:47.465+0000 7f6243400640 1 -- 172.21.15.50:0/1138663846 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6258092050 con 0x5627335362f0 2024-08-31T04:29:47.484 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:47.468+0000 7f62648c5740 1 -- 172.21.15.50:0/1138663846 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5627335362f0 msgr2=0x562733905650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:29:47.484 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:47.468+0000 7f62648c5740 1 --2- 172.21.15.50:0/1138663846 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5627335362f0 0x562733905650 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f6258068ea0 tx=0x7f6258074040 comp rx=0 tx=0).stop 2024-08-31T04:29:47.491 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:47.489+0000 7f62648c5740 1 -- 172.21.15.50:0/1138663846 shutdown_connections 2024-08-31T04:29:47.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:29:47 smithi177 ceph-mon[22025]: pgmap v574: 97 pgs: 97 active+clean; 1.4 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 9.8 MiB/s wr, 583 op/s 2024-08-31T04:29:47.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:29:47 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-08-31T04:29:47.496 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:47.491+0000 7f62648c5740 1 --2- 172.21.15.50:0/1138663846 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56273355f1b0 0x56273390dcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:47.502 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:47.494+0000 7f62648c5740 1 --2- 172.21.15.50:0/1138663846 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56273353e4d0 0x56273390d770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:47.502 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:47.498+0000 7f62648c5740 1 --2- 172.21.15.50:0/1138663846 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5627335362f0 0x562733905650 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:47.506 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:47.498+0000 7f62648c5740 1 -- 172.21.15.50:0/1138663846 >> 172.21.15.50:0/1138663846 conn(0x562733553300 msgr2=0x562733904f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:29:47.544 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:29:47 smithi133 ceph-mon[22177]: pgmap v574: 97 pgs: 97 active+clean; 1.4 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 9.8 MiB/s wr, 583 op/s 2024-08-31T04:29:47.544 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:29:47 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-08-31T04:29:47.550 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:47.532+0000 7f62648c5740 1 -- 172.21.15.50:0/1138663846 shutdown_connections 2024-08-31T04:29:47.550 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:47.532+0000 7f62648c5740 1 -- 172.21.15.50:0/1138663846 wait complete. 2024-08-31T04:29:47.550 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:47.536+0000 7f62648c5740 1 -- start start 2024-08-31T04:29:47.550 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:47.536+0000 7f62648c5740 1 Processor -- start 2024-08-31T04:29:47.571 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:47.548+0000 7f62648c5740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5627335362f0 0x562733913110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:47.571 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:47.553+0000 7f6257400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5627335362f0 0x562733913110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:29:47.571 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:47.557+0000 7f62648c5740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56273353e4d0 0x5627339137d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:47.571 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:47.559+0000 7f62648c5740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56273355f1b0 0x562733914340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:47.571 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:47.559+0000 7f62648c5740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f625015e860 con 0x5627335362f0 2024-08-31T04:29:47.571 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:47.559+0000 7f6257400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5627335362f0 0x562733913110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35056/0 (socket says 172.21.15.50:35056) 2024-08-31T04:29:47.572 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:47.559+0000 7f6257400640 1 -- 172.21.15.50:0/1921108524 learned_addr learned my addr 172.21.15.50:0/1921108524 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:29:47.572 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:47.559+0000 7f6256a00640 1 --2- 172.21.15.50:0/1921108524 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56273353e4d0 0x5627339137d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:29:47.572 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:47.569+0000 7f62648c5740 1 -- 172.21.15.50:0/1921108524 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f625015e0d0 con 0x56273353e4d0 2024-08-31T04:29:47.572 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:47.569+0000 7f62648c5740 1 -- 172.21.15.50:0/1921108524 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f625015b300 con 0x56273355f1b0 2024-08-31T04:29:47.572 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:47.569+0000 7f62648c5740 10 client.0 _ll_register_callbacks cb 0x7f625807bd90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:29:47.576 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:47.571+0000 7f6257400640 1 --2- 172.21.15.50:0/1921108524 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56273355f1b0 0x562733914340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:29:47.577 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:47.573+0000 7f6256a00640 1 -- 172.21.15.50:0/1921108524 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56273355f1b0 msgr2=0x562733914340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:29:47.577 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:47.573+0000 7f6256a00640 1 --2- 172.21.15.50:0/1921108524 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56273355f1b0 0x562733914340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:47.577 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:47.573+0000 7f6256a00640 1 -- 172.21.15.50:0/1921108524 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5627335362f0 msgr2=0x562733913110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:29:47.577 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:47.573+0000 7f6256a00640 1 --2- 172.21.15.50:0/1921108524 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5627335362f0 0x562733913110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:47.577 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:47.573+0000 7f6256a00640 1 -- 172.21.15.50:0/1921108524 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562733914aa0 con 0x56273353e4d0 2024-08-31T04:29:47.582 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:47.580+0000 7f6256a00640 1 --2- 172.21.15.50:0/1921108524 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56273353e4d0 0x5627339137d0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f6248030380 tx=0x7f6248030e70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=84cb08cec8348af2 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:29:47.582 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:47.580+0000 7f6240c00640 10 client.0 ms_handle_connect on v2:172.21.15.133:3300/0 2024-08-31T04:29:47.610 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:47.584+0000 7f6240c00640 1 -- 172.21.15.50:0/1921108524 <== mon.2 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6248037040 con 0x56273353e4d0 2024-08-31T04:29:47.610 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:47.585+0000 7f62648c5740 1 -- 172.21.15.50:0/1921108524 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6258069bd0 con 0x56273353e4d0 2024-08-31T04:29:47.610 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:47.586+0000 7f6240c00640 1 -- 172.21.15.50:0/1921108524 <== mon.2 v2:172.21.15.133:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8219+0+0 (secure 0 0 0) 0x7f6248030730 con 0x56273353e4d0 2024-08-31T04:29:47.610 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:47.590+0000 7f6240c00640 1 -- 172.21.15.50:0/1921108524 <== mon.2 v2:172.21.15.133:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7f6248037040 con 0x56273353e4d0 2024-08-31T04:29:47.610 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:47.608+0000 7f62648c5740 10 client.26012 fetch_fsmap learned FSMap version 39 2024-08-31T04:29:47.611 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:47.608+0000 7f62648c5740 1 -- 172.21.15.50:0/1921108524 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) -- 0x562733915eb0 con 0x56273353e4d0 2024-08-31T04:29:47.613 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:47.611+0000 7f6240c00640 1 -- 172.21.15.50:0/1921108524 <== mon.2 v2:172.21.15.133:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6258069bd0 con 0x56273353e4d0 2024-08-31T04:29:47.613 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:47.611+0000 7f6240c00640 1 -- 172.21.15.50:0/1921108524 <== mon.2 v2:172.21.15.133:3300/0 5 ==== fsmap(e 39) ==== 8410+0+0 (secure 0 0 0) 0x7f62480046c0 con 0x56273353e4d0 2024-08-31T04:29:47.617 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:47.614+0000 7f62648c5740 10 client.26012 fetch_fsmap finished waiting for FSMap version 39 2024-08-31T04:29:47.617 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:47.614+0000 7f62648c5740 10 client.26012 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T04:29:47.617 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:47.614+0000 7f62648c5740 20 client.26012 populate_metadata read hostname 'smithi050' 2024-08-31T04:29:47.617 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:47.614+0000 7f62648c5740 1 --2- 172.21.15.50:0/1921108524 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x5627334f31c0 0x562733988c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:29:47.617 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:47.614+0000 7f62648c5740 4 client.26012 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-31T04:29:47.617 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:47.614+0000 7f62648c5740 1 -- 172.21.15.50:0/1921108524 --> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] -- command(tid 0: {"prefix": "flush journal"}) -- 0x562733875960 con 0x5627334f31c0 2024-08-31T04:29:47.640 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:47.638+0000 7f6257400640 1 --2- 172.21.15.50:0/1921108524 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x5627334f31c0 0x562733988c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:29:47.645 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:47.643+0000 7f6240c00640 10 client.26012 ms_handle_connect on v2:172.21.15.133:6838/2526402262 2024-08-31T04:29:47.645 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:47.643+0000 7f6257400640 1 --2- 172.21.15.50:0/1921108524 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x5627334f31c0 0x562733988c80 crc :-1 s=READY pgs=103 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=12efa7a99c128892 server_cookie=fbbd719635e6ad5d in_seq=0 out_seq=0 2024-08-31T04:29:48.451 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:29:48 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-08-31T04:29:48.451 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:29:48 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-08-31T04:29:48.451 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:29:48 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"} : dispatch 2024-08-31T04:29:48.451 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:29:48 smithi050 ceph-mon[17259]: Adjusting osd_memory_target on smithi050 to 177.5M 2024-08-31T04:29:48.451 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:29:48 smithi050 ceph-mon[17259]: Unable to set osd_memory_target on smithi050 to 186147225: error parsing value: Value '186147225' is below minimum 939524096 2024-08-31T04:29:48.451 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:29:48 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:29:48.451 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:29:48 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T04:29:48.452 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:29:48 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:29:48.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:29:48 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-08-31T04:29:48.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:29:48 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-08-31T04:29:48.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:29:48 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"} : dispatch 2024-08-31T04:29:48.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:29:48 smithi177 ceph-mon[22025]: Adjusting osd_memory_target on smithi050 to 177.5M 2024-08-31T04:29:48.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:29:48 smithi177 ceph-mon[22025]: Unable to set osd_memory_target on smithi050 to 186147225: error parsing value: Value '186147225' is below minimum 939524096 2024-08-31T04:29:48.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:29:48 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:29:48.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:29:48 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T04:29:48.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:29:48 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:29:48.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:29:48 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-08-31T04:29:48.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:29:48 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-08-31T04:29:48.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:29:48 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"} : dispatch 2024-08-31T04:29:48.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:29:48 smithi133 ceph-mon[22177]: Adjusting osd_memory_target on smithi050 to 177.5M 2024-08-31T04:29:48.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:29:48 smithi133 ceph-mon[22177]: Unable to set osd_memory_target on smithi050 to 186147225: error parsing value: Value '186147225' is below minimum 939524096 2024-08-31T04:29:48.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:29:48 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:29:48.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:29:48 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T04:29:48.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:29:48 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:29:49.309 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:29:49 smithi050 ceph-mon[17259]: pgmap v575: 97 pgs: 97 active+clean; 1.5 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 11 MiB/s wr, 633 op/s 2024-08-31T04:29:49.395 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:49.392+0000 7f6240c00640 1 -- 172.21.15.50:0/1921108524 <== mds.0 v2:172.21.15.133:6838/2526402262 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x562733875960 con 0x5627334f31c0 2024-08-31T04:29:49.395 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:49.392+0000 7f6240c00640 10 client.26012 handle_command_reply: tid=0 2024-08-31T04:29:49.395 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:49.392+0000 7f62648c5740 1 client.26012 shutdown 2024-08-31T04:29:49.396 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:49.393+0000 7f62648c5740 1 -- 172.21.15.50:0/1921108524 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56273353e4d0 msgr2=0x5627339137d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:29:49.396 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:49.393+0000 7f62648c5740 1 --2- 172.21.15.50:0/1921108524 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56273353e4d0 0x5627339137d0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f6248030380 tx=0x7f6248030e70 comp rx=0 tx=0).stop 2024-08-31T04:29:49.396 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:49.393+0000 7f62648c5740 1 -- 172.21.15.50:0/1921108524 shutdown_connections 2024-08-31T04:29:49.396 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:49.393+0000 7f62648c5740 1 --2- 172.21.15.50:0/1921108524 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x5627334f31c0 0x562733988c80 crc :-1 s=READY pgs=103 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:49.396 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:49.393+0000 7f62648c5740 1 --2- 172.21.15.50:0/1921108524 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56273355f1b0 0x562733914340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:49.396 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:49.393+0000 7f62648c5740 1 --2- 172.21.15.50:0/1921108524 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56273353e4d0 0x5627339137d0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:49.396 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:49.393+0000 7f62648c5740 1 --2- 172.21.15.50:0/1921108524 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5627335362f0 0x562733913110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:49.396 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:49.393+0000 7f62648c5740 1 -- 172.21.15.50:0/1921108524 >> 172.21.15.50:0/1921108524 conn(0x562733553300 msgr2=0x56273390d770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:29:49.396 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:49.394+0000 7f6240c00640 0 client.26012 ms_handle_reset on v2:172.21.15.133:6838/2526402262 2024-08-31T04:29:49.397 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:49.394+0000 7f62648c5740 1 -- 172.21.15.50:0/1921108524 shutdown_connections 2024-08-31T04:29:49.397 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:49.394+0000 7f62648c5740 1 -- 172.21.15.50:0/1921108524 wait complete. 2024-08-31T04:29:49.397 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:49.395+0000 7f62648c5740 20 client.26012 trim_cache size 0 max 16384 2024-08-31T04:29:49.397 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout:{ 2024-08-31T04:29:49.397 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout: "message": "", 2024-08-31T04:29:49.398 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout: "return_code": 0 2024-08-31T04:29:49.398 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout:} 2024-08-31T04:29:49.399 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:49.397+0000 7f6257e00640 1 -- 172.21.15.50:0/3612822306 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f623c0b4ce0 msgr2=0x7f623c0b71f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:29:49.399 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:49.397+0000 7f6257e00640 1 --2- 172.21.15.50:0/3612822306 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f623c0b4ce0 0x7f623c0b71f0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f62440ab1e0 tx=0x7f6244000bc0 comp rx=0 tx=0).stop 2024-08-31T04:29:49.399 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:49.397+0000 7f6257e00640 1 -- 172.21.15.50:0/3612822306 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f62500a6020 msgr2=0x7f625013bab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:29:49.399 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:49.397+0000 7f6257e00640 1 --2- 172.21.15.50:0/3612822306 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f62500a6020 0x7f625013bab0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f624400d950 tx=0x7f624400de10 comp rx=0 tx=0).stop 2024-08-31T04:29:49.399 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:49.397+0000 7f6257e00640 1 -- 172.21.15.50:0/3612822306 shutdown_connections 2024-08-31T04:29:49.399 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:49.397+0000 7f6257e00640 1 --2- 172.21.15.50:0/3612822306 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f623c0b4ce0 0x7f623c0b71f0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:49.399 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:49.397+0000 7f6257e00640 1 --2- 172.21.15.50:0/3612822306 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f62500a6020 0x7f625013bab0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:49.400 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:49.397+0000 7f6257e00640 1 --2- 172.21.15.50:0/3612822306 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f62500a6970 0x7f625013c660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:49.400 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:49.397+0000 7f6257e00640 1 --2- 172.21.15.50:0/3612822306 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f62500a4fa0 0x7f625013b440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:29:49.400 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:49.397+0000 7f6257e00640 1 -- 172.21.15.50:0/3612822306 >> 172.21.15.50:0/3612822306 conn(0x7f62500a0490 msgr2=0x7f62500a28b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:29:49.402 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:49.397+0000 7f6257e00640 1 -- 172.21.15.50:0/3612822306 shutdown_connections 2024-08-31T04:29:49.402 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:29:49.397+0000 7f6257e00640 1 -- 172.21.15.50:0/3612822306 wait complete. 2024-08-31T04:29:49.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:29:49 smithi177 ceph-mon[22025]: pgmap v575: 97 pgs: 97 active+clean; 1.5 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 11 MiB/s wr, 633 op/s 2024-08-31T04:29:49.792 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:29:49 smithi133 ceph-mon[22177]: pgmap v575: 97 pgs: 97 active+clean; 1.5 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 11 MiB/s wr, 633 op/s 2024-08-31T04:29:49.840 INFO:journalctl@ceph.mds.d.smithi050.stdout:Aug 31 04:29:49 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-mds-d[58344]: *** Caught signal (Segmentation fault) ** 2024-08-31T04:29:49.840 INFO:journalctl@ceph.mds.d.smithi050.stdout:Aug 31 04:29:49 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-mds-d[58344]: in thread 7fb0a9800640 thread_name:md_log_replay 2024-08-31T04:29:49.840 INFO:journalctl@ceph.mds.d.smithi050.stdout:Aug 31 04:29:49 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-mds-d[58344]: ceph version 19.3.0-4560-gd19e6118 (d19e6118f7015f0047264006cb0c873528eb3ae6) squid (dev) 2024-08-31T04:29:49.840 INFO:journalctl@ceph.mds.d.smithi050.stdout:Aug 31 04:29:49 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-mds-d[58344]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fb0b9a3e6f0] 2024-08-31T04:29:49.840 INFO:journalctl@ceph.mds.d.smithi050.stdout:Aug 31 04:29:49 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-mds-d[58344]: 2: /usr/bin/ceph-mds(+0x1b4865) [0x5609b80f2865] 2024-08-31T04:29:49.840 INFO:journalctl@ceph.mds.d.smithi050.stdout:Aug 31 04:29:49 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-mds-d[58344]: 3: /usr/bin/ceph-mds(+0x1ae798) [0x5609b80ec798] 2024-08-31T04:29:49.841 INFO:journalctl@ceph.mds.d.smithi050.stdout:Aug 31 04:29:49 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-mds-d[58344]: 4: (ECommitted::replay(MDSRank*)+0x23b) [0x5609b80d4b01] 2024-08-31T04:29:49.841 INFO:journalctl@ceph.mds.d.smithi050.stdout:Aug 31 04:29:49 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-mds-d[58344]: 5: (MDLog::_replay_thread()+0x1c46) [0x5609b8417780] 2024-08-31T04:29:49.841 INFO:journalctl@ceph.mds.d.smithi050.stdout:Aug 31 04:29:49 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-mds-d[58344]: 6: /usr/bin/ceph-mds(+0x4c6327) [0x5609b8404327] 2024-08-31T04:29:49.841 INFO:journalctl@ceph.mds.d.smithi050.stdout:Aug 31 04:29:49 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-mds-d[58344]: 7: (Thread::entry_wrapper()+0x43) [0x7fb0ba42fd6f] 2024-08-31T04:29:49.841 INFO:journalctl@ceph.mds.d.smithi050.stdout:Aug 31 04:29:49 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-mds-d[58344]: 8: (Thread::_entry_func(void*)+0xd) [0x7fb0ba42fd8b] 2024-08-31T04:29:49.841 INFO:journalctl@ceph.mds.d.smithi050.stdout:Aug 31 04:29:49 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-mds-d[58344]: 9: /lib64/libc.so.6(+0x89c52) [0x7fb0b9a89c52] 2024-08-31T04:29:49.841 INFO:journalctl@ceph.mds.d.smithi050.stdout:Aug 31 04:29:49 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-mds-d[58344]: 10: /lib64/libc.so.6(+0x10ec80) [0x7fb0b9b0ec80] 2024-08-31T04:29:49.841 INFO:journalctl@ceph.mds.d.smithi050.stdout:Aug 31 04:29:49 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-mds-d[58344]: 2024-08-31T04:29:49.693+0000 7fb0a9800640 -1 *** Caught signal (Segmentation fault) ** 2024-08-31T04:29:49.841 INFO:journalctl@ceph.mds.d.smithi050.stdout:Aug 31 04:29:49 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-mds-d[58344]: in thread 7fb0a9800640 thread_name:md_log_replay 2024-08-31T04:29:49.841 INFO:journalctl@ceph.mds.d.smithi050.stdout:Aug 31 04:29:49 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-mds-d[58344]: 2024-08-31T04:29:49.841 INFO:journalctl@ceph.mds.d.smithi050.stdout:Aug 31 04:29:49 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-mds-d[58344]: ceph version 19.3.0-4560-gd19e6118 (d19e6118f7015f0047264006cb0c873528eb3ae6) squid (dev) 2024-08-31T04:29:49.841 INFO:journalctl@ceph.mds.d.smithi050.stdout:Aug 31 04:29:49 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-mds-d[58344]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fb0b9a3e6f0] 2024-08-31T04:29:49.841 INFO:journalctl@ceph.mds.d.smithi050.stdout:Aug 31 04:29:49 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-mds-d[58344]: 2: /usr/bin/ceph-mds(+0x1b4865) [0x5609b80f2865] 2024-08-31T04:29:49.842 INFO:journalctl@ceph.mds.d.smithi050.stdout:Aug 31 04:29:49 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-mds-d[58344]: 3: /usr/bin/ceph-mds(+0x1ae798) [0x5609b80ec798] 2024-08-31T04:29:49.842 INFO:journalctl@ceph.mds.d.smithi050.stdout:Aug 31 04:29:49 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-mds-d[58344]: 4: (ECommitted::replay(MDSRank*)+0x23b) [0x5609b80d4b01] 2024-08-31T04:29:49.842 INFO:journalctl@ceph.mds.d.smithi050.stdout:Aug 31 04:29:49 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-mds-d[58344]: 5: (MDLog::_replay_thread()+0x1c46) [0x5609b8417780] 2024-08-31T04:29:49.842 INFO:journalctl@ceph.mds.d.smithi050.stdout:Aug 31 04:29:49 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-mds-d[58344]: 6: /usr/bin/ceph-mds(+0x4c6327) [0x5609b8404327] 2024-08-31T04:29:49.842 INFO:journalctl@ceph.mds.d.smithi050.stdout:Aug 31 04:29:49 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-mds-d[58344]: 7: (Thread::entry_wrapper()+0x43) [0x7fb0ba42fd6f] 2024-08-31T04:29:49.842 INFO:journalctl@ceph.mds.d.smithi050.stdout:Aug 31 04:29:49 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-mds-d[58344]: 8: (Thread::_entry_func(void*)+0xd) [0x7fb0ba42fd8b] 2024-08-31T04:29:49.842 INFO:journalctl@ceph.mds.d.smithi050.stdout:Aug 31 04:29:49 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-mds-d[58344]: 9: /lib64/libc.so.6(+0x89c52) [0x7fb0b9a89c52] 2024-08-31T04:29:49.842 INFO:journalctl@ceph.mds.d.smithi050.stdout:Aug 31 04:29:49 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-mds-d[58344]: 10: /lib64/libc.so.6(+0x10ec80) [0x7fb0b9b0ec80] 2024-08-31T04:29:49.842 INFO:journalctl@ceph.mds.d.smithi050.stdout:Aug 31 04:29:49 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-mds-d[58344]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-08-31T04:29:49.842 INFO:journalctl@ceph.mds.d.smithi050.stdout:Aug 31 04:29:49 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-mds-d[58344]: 2024-08-31T04:29:49.842 INFO:journalctl@ceph.mds.d.smithi050.stdout:Aug 31 04:29:49 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-mds-d[58344]: 0> 2024-08-31T04:29:49.693+0000 7fb0a9800640 -1 *** Caught signal (Segmentation fault) ** 2024-08-31T04:29:49.843 INFO:journalctl@ceph.mds.d.smithi050.stdout:Aug 31 04:29:49 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-mds-d[58344]: in thread 7fb0a9800640 thread_name:md_log_replay 2024-08-31T04:29:49.843 INFO:journalctl@ceph.mds.d.smithi050.stdout:Aug 31 04:29:49 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-mds-d[58344]: 2024-08-31T04:29:49.843 INFO:journalctl@ceph.mds.d.smithi050.stdout:Aug 31 04:29:49 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-mds-d[58344]: ceph version 19.3.0-4560-gd19e6118 (d19e6118f7015f0047264006cb0c873528eb3ae6) squid (dev) 2024-08-31T04:29:49.843 INFO:journalctl@ceph.mds.d.smithi050.stdout:Aug 31 04:29:49 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-mds-d[58344]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fb0b9a3e6f0] 2024-08-31T04:29:49.843 INFO:journalctl@ceph.mds.d.smithi050.stdout:Aug 31 04:29:49 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-mds-d[58344]: 2: /usr/bin/ceph-mds(+0x1b4865) [0x5609b80f2865] 2024-08-31T04:29:49.843 INFO:journalctl@ceph.mds.d.smithi050.stdout:Aug 31 04:29:49 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-mds-d[58344]: 3: /usr/bin/ceph-mds(+0x1ae798) [0x5609b80ec798] 2024-08-31T04:29:49.843 INFO:journalctl@ceph.mds.d.smithi050.stdout:Aug 31 04:29:49 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-mds-d[58344]: 4: (ECommitted::replay(MDSRank*)+0x23b) [0x5609b80d4b01] 2024-08-31T04:29:49.843 INFO:journalctl@ceph.mds.d.smithi050.stdout:Aug 31 04:29:49 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-mds-d[58344]: 5: (MDLog::_replay_thread()+0x1c46) [0x5609b8417780] 2024-08-31T04:29:49.843 INFO:journalctl@ceph.mds.d.smithi050.stdout:Aug 31 04:29:49 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-mds-d[58344]: 6: /usr/bin/ceph-mds(+0x4c6327) [0x5609b8404327] 2024-08-31T04:29:49.843 INFO:journalctl@ceph.mds.d.smithi050.stdout:Aug 31 04:29:49 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-mds-d[58344]: 7: (Thread::entry_wrapper()+0x43) [0x7fb0ba42fd6f] 2024-08-31T04:29:49.843 INFO:journalctl@ceph.mds.d.smithi050.stdout:Aug 31 04:29:49 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-mds-d[58344]: 8: (Thread::_entry_func(void*)+0xd) [0x7fb0ba42fd8b] 2024-08-31T04:29:49.843 INFO:journalctl@ceph.mds.d.smithi050.stdout:Aug 31 04:29:49 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-mds-d[58344]: 9: /lib64/libc.so.6(+0x89c52) [0x7fb0b9a89c52] 2024-08-31T04:29:49.843 INFO:journalctl@ceph.mds.d.smithi050.stdout:Aug 31 04:29:49 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-mds-d[58344]: 10: /lib64/libc.so.6(+0x10ec80) [0x7fb0b9b0ec80] 2024-08-31T04:29:49.844 INFO:journalctl@ceph.mds.d.smithi050.stdout:Aug 31 04:29:49 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-mds-d[58344]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-08-31T04:29:49.844 INFO:journalctl@ceph.mds.d.smithi050.stdout:Aug 31 04:29:49 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-mds-d[58344]: 2024-08-31T04:29:49.844 INFO:journalctl@ceph.mds.d.smithi050.stdout:Aug 31 04:29:49 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-mds-d[58344]: 0> 2024-08-31T04:29:49.693+0000 7fb0a9800640 -1 *** Caught signal (Segmentation fault) ** 2024-08-31T04:29:49.844 INFO:journalctl@ceph.mds.d.smithi050.stdout:Aug 31 04:29:49 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-mds-d[58344]: in thread 7fb0a9800640 thread_name:md_log_replay 2024-08-31T04:29:49.844 INFO:journalctl@ceph.mds.d.smithi050.stdout:Aug 31 04:29:49 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-mds-d[58344]: 2024-08-31T04:29:49.844 INFO:journalctl@ceph.mds.d.smithi050.stdout:Aug 31 04:29:49 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-mds-d[58344]: ceph version 19.3.0-4560-gd19e6118 (d19e6118f7015f0047264006cb0c873528eb3ae6) squid (dev) 2024-08-31T04:29:49.844 INFO:journalctl@ceph.mds.d.smithi050.stdout:Aug 31 04:29:49 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-mds-d[58344]: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fb0b9a3e6f0] 2024-08-31T04:29:49.844 INFO:journalctl@ceph.mds.d.smithi050.stdout:Aug 31 04:29:49 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-mds-d[58344]: 2: /usr/bin/ceph-mds(+0x1b4865) [0x5609b80f2865] 2024-08-31T04:29:49.844 INFO:journalctl@ceph.mds.d.smithi050.stdout:Aug 31 04:29:49 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-mds-d[58344]: 3: /usr/bin/ceph-mds(+0x1ae798) [0x5609b80ec798] 2024-08-31T04:29:49.844 INFO:journalctl@ceph.mds.d.smithi050.stdout:Aug 31 04:29:49 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-mds-d[58344]: 4: (ECommitted::replay(MDSRank*)+0x23b) [0x5609b80d4b01] 2024-08-31T04:29:49.844 INFO:journalctl@ceph.mds.d.smithi050.stdout:Aug 31 04:29:49 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-mds-d[58344]: 5: (MDLog::_replay_thread()+0x1c46) [0x5609b8417780] 2024-08-31T04:29:49.844 INFO:journalctl@ceph.mds.d.smithi050.stdout:Aug 31 04:29:49 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-mds-d[58344]: 6: /usr/bin/ceph-mds(+0x4c6327) [0x5609b8404327] 2024-08-31T04:29:49.844 INFO:journalctl@ceph.mds.d.smithi050.stdout:Aug 31 04:29:49 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-mds-d[58344]: 7: (Thread::entry_wrapper()+0x43) [0x7fb0ba42fd6f] 2024-08-31T04:29:49.845 INFO:journalctl@ceph.mds.d.smithi050.stdout:Aug 31 04:29:49 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-mds-d[58344]: 8: (Thread::_entry_func(void*)+0xd) [0x7fb0ba42fd8b] 2024-08-31T04:29:49.845 INFO:journalctl@ceph.mds.d.smithi050.stdout:Aug 31 04:29:49 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-mds-d[58344]: 9: /lib64/libc.so.6(+0x89c52) [0x7fb0b9a89c52] 2024-08-31T04:29:49.845 INFO:journalctl@ceph.mds.d.smithi050.stdout:Aug 31 04:29:49 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-mds-d[58344]: 10: /lib64/libc.so.6(+0x10ec80) [0x7fb0b9b0ec80] 2024-08-31T04:29:49.845 INFO:journalctl@ceph.mds.d.smithi050.stdout:Aug 31 04:29:49 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-mds-d[58344]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-08-31T04:29:49.845 INFO:journalctl@ceph.mds.d.smithi050.stdout:Aug 31 04:29:49 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-mds-d[58344]: 2024-08-31T04:29:50.134 INFO:journalctl@ceph.mds.d.smithi050.stdout:Aug 31 04:29:49 smithi050 podman[80073]: 2024-08-31 04:29:49.892315924 +0000 UTC m=+0.046113273 container died 0ae382b592766f8fe219669ec263aada1160f878da3fd1fb1cea5c7984f7d122 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-mds-d, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, io.buildah.version=1.37.1, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS) 2024-08-31T04:29:50.987 INFO:journalctl@ceph.mds.d.smithi050.stdout:Aug 31 04:29:50 smithi050 podman[80073]: 2024-08-31 04:29:50.840087972 +0000 UTC m=+0.993885330 container remove 0ae382b592766f8fe219669ec263aada1160f878da3fd1fb1cea5c7984f7d122 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-mds-d, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , io.buildah.version=1.37.1, org.label-schema.build-date=20240731, GIT_CLEAN=True, ceph=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-08-31T04:29:50.987 INFO:journalctl@ceph.mds.d.smithi050.stdout:Aug 31 04:29:50 smithi050 systemd[1]: ceph-058d9fc6-674f-11ef-bcd4-c7b262605968@mds.d.service: Main process exited, code=exited, status=139/n/a 2024-08-31T04:29:51.563 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:29:51 smithi050 ceph-mon[17259]: pgmap v576: 97 pgs: 97 active+clean; 1.5 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 12 MiB/s wr, 799 op/s 2024-08-31T04:29:51.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:29:51 smithi177 ceph-mon[22025]: pgmap v576: 97 pgs: 97 active+clean; 1.5 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 12 MiB/s wr, 799 op/s 2024-08-31T04:29:51.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:29:51 smithi133 ceph-mon[22177]: pgmap v576: 97 pgs: 97 active+clean; 1.5 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 12 MiB/s wr, 799 op/s 2024-08-31T04:29:51.821 INFO:journalctl@ceph.mds.d.smithi050.stdout:Aug 31 04:29:51 smithi050 systemd[1]: ceph-058d9fc6-674f-11ef-bcd4-c7b262605968@mds.d.service: Failed with result 'exit-code'. 2024-08-31T04:29:51.822 INFO:journalctl@ceph.mds.d.smithi050.stdout:Aug 31 04:29:51 smithi050 systemd[1]: ceph-058d9fc6-674f-11ef-bcd4-c7b262605968@mds.d.service: Consumed 7.404s CPU time. 2024-08-31T04:29:53.537 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:29:53 smithi050 ceph-mon[17259]: pgmap v577: 97 pgs: 97 active+clean; 1.5 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 12 MiB/s wr, 1.15k op/s 2024-08-31T04:29:53.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:29:53 smithi177 ceph-mon[22025]: pgmap v577: 97 pgs: 97 active+clean; 1.5 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 12 MiB/s wr, 1.15k op/s 2024-08-31T04:29:53.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:29:53 smithi133 ceph-mon[22177]: pgmap v577: 97 pgs: 97 active+clean; 1.5 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 12 MiB/s wr, 1.15k op/s 2024-08-31T04:29:55.570 INFO:tasks.workunit.client.0.smithi050.stdout: 430 86280 3 60710 8 27755 24 2024-08-31T04:29:55.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:29:55 smithi050 ceph-mon[17259]: pgmap v578: 97 pgs: 97 active+clean; 1.5 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 10 MiB/s wr, 1.13k op/s 2024-08-31T04:29:55.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:29:55 smithi177 ceph-mon[22025]: pgmap v578: 97 pgs: 97 active+clean; 1.5 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 10 MiB/s wr, 1.13k op/s 2024-08-31T04:29:55.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:29:55 smithi133 ceph-mon[22177]: pgmap v578: 97 pgs: 97 active+clean; 1.5 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 10 MiB/s wr, 1.13k op/s 2024-08-31T04:29:57.573 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:29:57 smithi050 ceph-mon[17259]: pgmap v579: 97 pgs: 97 active+clean; 1.5 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 9.2 MiB/s wr, 1.06k op/s 2024-08-31T04:29:57.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:29:57 smithi177 ceph-mon[22025]: pgmap v579: 97 pgs: 97 active+clean; 1.5 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 9.2 MiB/s wr, 1.06k op/s 2024-08-31T04:29:57.792 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:29:57 smithi133 ceph-mon[22177]: pgmap v579: 97 pgs: 97 active+clean; 1.5 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 9.2 MiB/s wr, 1.06k op/s 2024-08-31T04:29:59.549 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:29:59 smithi050 ceph-mon[17259]: pgmap v580: 97 pgs: 97 active+clean; 1.5 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 5.6 MiB/s wr, 882 op/s 2024-08-31T04:29:59.747 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:29:59 smithi177 ceph-mon[22025]: pgmap v580: 97 pgs: 97 active+clean; 1.5 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 5.6 MiB/s wr, 882 op/s 2024-08-31T04:29:59.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:29:59 smithi133 ceph-mon[22177]: pgmap v580: 97 pgs: 97 active+clean; 1.5 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 5.6 MiB/s wr, 882 op/s 2024-08-31T04:30:00.393 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:30:00 smithi050 ceph-mon[17259]: overall HEALTH_OK 2024-08-31T04:30:00.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:30:00 smithi177 ceph-mon[22025]: overall HEALTH_OK 2024-08-31T04:30:00.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:30:00 smithi133 ceph-mon[22177]: overall HEALTH_OK 2024-08-31T04:30:01.507 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:30:01 smithi050 ceph-mon[17259]: pgmap v581: 97 pgs: 97 active+clean; 1.5 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 4.3 MiB/s wr, 795 op/s 2024-08-31T04:30:01.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:30:01 smithi177 ceph-mon[22025]: pgmap v581: 97 pgs: 97 active+clean; 1.5 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 4.3 MiB/s wr, 795 op/s 2024-08-31T04:30:01.789 INFO:journalctl@ceph.mds.d.smithi050.stdout:Aug 31 04:30:01 smithi050 systemd[1]: ceph-058d9fc6-674f-11ef-bcd4-c7b262605968@mds.d.service: Scheduled restart job, restart counter is at 1. 2024-08-31T04:30:01.789 INFO:journalctl@ceph.mds.d.smithi050.stdout:Aug 31 04:30:01 smithi050 systemd[1]: Stopped Ceph mds.d for 058d9fc6-674f-11ef-bcd4-c7b262605968. 2024-08-31T04:30:01.789 INFO:journalctl@ceph.mds.d.smithi050.stdout:Aug 31 04:30:01 smithi050 systemd[1]: ceph-058d9fc6-674f-11ef-bcd4-c7b262605968@mds.d.service: Consumed 7.404s CPU time. 2024-08-31T04:30:01.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:30:01 smithi133 ceph-mon[22177]: pgmap v581: 97 pgs: 97 active+clean; 1.5 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 4.3 MiB/s wr, 795 op/s 2024-08-31T04:30:02.072 INFO:journalctl@ceph.mds.d.smithi050.stdout:Aug 31 04:30:01 smithi050 systemd[1]: Starting Ceph mds.d for 058d9fc6-674f-11ef-bcd4-c7b262605968... 2024-08-31T04:30:02.352 INFO:journalctl@ceph.mds.d.smithi050.stdout:Aug 31 04:30:02 smithi050 podman[80159]: 2024-08-31 04:30:02.177095084 +0000 UTC m=+0.027878002 image pull 79f4cde5e36911a5dca995eeb98098c2c8aae81dd52a088ef2c867bc3363bad0 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61 2024-08-31T04:30:02.609 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:02.608+0000 7f6eeda00640 1 -- 172.21.15.50:0/3969648591 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6ee8104ca0 msgr2=0x7f6ee810b640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:30:02.610 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:02.608+0000 7f6eeda00640 1 --2- 172.21.15.50:0/3969648591 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6ee8104ca0 0x7f6ee810b640 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f6ee0009ca0 tx=0x7f6ee002a8c0 comp rx=0 tx=0).stop 2024-08-31T04:30:02.610 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:02.608+0000 7f6eeda00640 1 -- 172.21.15.50:0/3969648591 shutdown_connections 2024-08-31T04:30:02.610 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:02.608+0000 7f6eeda00640 1 --2- 172.21.15.50:0/3969648591 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6ee8104ca0 0x7f6ee810b640 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:02.610 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:02.608+0000 7f6eeda00640 1 --2- 172.21.15.50:0/3969648591 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6ee8104300 0x7f6ee8104710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:02.610 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:02.608+0000 7f6eeda00640 1 --2- 172.21.15.50:0/3969648591 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6ee8103280 0x7f6ee81036f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:02.610 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:02.608+0000 7f6eeda00640 1 -- 172.21.15.50:0/3969648591 >> 172.21.15.50:0/3969648591 conn(0x7f6ee80febc0 msgr2=0x7f6ee8101070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:30:02.610 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:02.608+0000 7f6eeda00640 1 -- 172.21.15.50:0/3969648591 shutdown_connections 2024-08-31T04:30:02.610 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:02.608+0000 7f6eeda00640 1 -- 172.21.15.50:0/3969648591 wait complete. 2024-08-31T04:30:02.611 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:02.609+0000 7f6eeda00640 1 Processor -- start 2024-08-31T04:30:02.611 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:02.609+0000 7f6eeda00640 1 -- start start 2024-08-31T04:30:02.611 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:02.609+0000 7f6eeda00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6ee8103280 0x7f6ee819bca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:30:02.611 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:02.609+0000 7f6eeda00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6ee8104300 0x7f6ee819c310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:30:02.611 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:02.609+0000 7f6eeda00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6ee8104ca0 0x7f6ee819cec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:30:02.611 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:02.609+0000 7f6eeda00640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f6ee810ef50 con 0x7f6ee8104300 2024-08-31T04:30:02.611 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:02.609+0000 7f6eeda00640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f6ee810edd0 con 0x7f6ee8104ca0 2024-08-31T04:30:02.626 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:02.609+0000 7f6eeda00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f6ee810f0d0 con 0x7f6ee8103280 2024-08-31T04:30:02.626 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:02.610+0000 7f6ee7400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6ee8104300 0x7f6ee819c310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:30:02.626 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:02.610+0000 7f6ee7e00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6ee8103280 0x7f6ee819bca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:30:02.626 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:02.610+0000 7f6eed000640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6ee8104ca0 0x7f6ee819cec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:30:02.626 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:02.610+0000 7f6ee7e00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6ee8103280 0x7f6ee819bca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.50:54786/0 (socket says 172.21.15.50:54786) 2024-08-31T04:30:02.626 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:02.610+0000 7f6ee7e00640 1 -- 172.21.15.50:0/3143358628 learned_addr learned my addr 172.21.15.50:0/3143358628 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:30:02.626 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:02.610+0000 7f6ee7e00640 1 -- 172.21.15.50:0/3143358628 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6ee8104ca0 msgr2=0x7f6ee819cec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:30:02.626 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:02.610+0000 7f6ee7e00640 1 --2- 172.21.15.50:0/3143358628 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6ee8104ca0 0x7f6ee819cec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:02.626 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:02.610+0000 7f6ee7e00640 1 -- 172.21.15.50:0/3143358628 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6ee8104300 msgr2=0x7f6ee819c310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:30:02.626 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:02.610+0000 7f6ee7e00640 1 --2- 172.21.15.50:0/3143358628 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6ee8104300 0x7f6ee819c310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:02.627 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:02.610+0000 7f6ee7e00640 1 -- 172.21.15.50:0/3143358628 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ee819d6e0 con 0x7f6ee8103280 2024-08-31T04:30:02.627 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:02.611+0000 7f6ee7e00640 1 --2- 172.21.15.50:0/3143358628 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6ee8103280 0x7f6ee819bca0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f6ed800e9f0 tx=0x7f6ed800edf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:30:02.627 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:02.611+0000 7f6ee4c00640 1 -- 172.21.15.50:0/3143358628 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ed800cd80 con 0x7f6ee8103280 2024-08-31T04:30:02.627 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:02.611+0000 7f6ee4c00640 1 -- 172.21.15.50:0/3143358628 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6ed80054d0 con 0x7f6ee8103280 2024-08-31T04:30:02.627 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:02.611+0000 7f6eeda00640 1 -- 172.21.15.50:0/3143358628 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ee819d9d0 con 0x7f6ee8103280 2024-08-31T04:30:02.627 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:02.611+0000 7f6ee4c00640 1 -- 172.21.15.50:0/3143358628 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ed8010690 con 0x7f6ee8103280 2024-08-31T04:30:02.627 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:02.611+0000 7f6eeda00640 1 -- 172.21.15.50:0/3143358628 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ee81a40c0 con 0x7f6ee8103280 2024-08-31T04:30:02.627 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:02.615+0000 7f6ef5fdc740 1 Processor -- start 2024-08-31T04:30:02.627 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:02.615+0000 7f6ef5fdc740 1 -- start start 2024-08-31T04:30:02.627 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:02.615+0000 7f6ef5fdc740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x563c2dade1b0 0x563c2de83d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:30:02.627 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:02.615+0000 7f6ef5fdc740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563c2dab52f0 0x563c2de843b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:30:02.627 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:02.615+0000 7f6ef5fdc740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x563c2dabd4d0 0x563c2de84f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:30:02.627 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:02.615+0000 7f6ef5fdc740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x563c2ddf6f70 con 0x563c2dab52f0 2024-08-31T04:30:02.628 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:02.615+0000 7f6ef5fdc740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x563c2dde6500 con 0x563c2dade1b0 2024-08-31T04:30:02.628 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:02.615+0000 7f6ef5fdc740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x563c2ddea4b0 con 0x563c2dabd4d0 2024-08-31T04:30:02.628 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:02.616+0000 7f6eed000640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x563c2dade1b0 0x563c2de83d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:30:02.628 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:02.616+0000 7f6ee7400640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x563c2dabd4d0 0x563c2de84f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:30:02.628 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:02.616+0000 7f6eed000640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x563c2dade1b0 0x563c2de83d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.50:58890/0 (socket says 172.21.15.50:58890) 2024-08-31T04:30:02.628 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:02.616+0000 7f6eed000640 1 -- 172.21.15.50:0/1853476618 learned_addr learned my addr 172.21.15.50:0/1853476618 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:30:02.628 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:02.616+0000 7f6eed000640 1 -- 172.21.15.50:0/1853476618 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x563c2dabd4d0 msgr2=0x563c2de84f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:30:02.628 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:02.616+0000 7f6eed000640 1 --2- 172.21.15.50:0/1853476618 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x563c2dabd4d0 0x563c2de84f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:02.628 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:02.616+0000 7f6ee4c00640 1 -- 172.21.15.50:0/3143358628 <== mon.1 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 18) ==== 152577+0+0 (secure 0 0 0) 0x7f6ed8004e90 con 0x7f6ee8103280 2024-08-31T04:30:02.628 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:02.616+0000 7f6eed000640 1 -- 172.21.15.50:0/1853476618 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563c2dab52f0 msgr2=0x563c2de843b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-31T04:30:02.628 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:02.616+0000 7f6eed000640 1 --2- 172.21.15.50:0/1853476618 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563c2dab52f0 0x563c2de843b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:02.628 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:02.616+0000 7f6eed000640 1 -- 172.21.15.50:0/1853476618 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563c2dda0c10 con 0x563c2dade1b0 2024-08-31T04:30:02.629 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:02.616+0000 7f6ee7400640 1 --2- 172.21.15.50:0/1853476618 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x563c2dabd4d0 0x563c2de84f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:30:02.629 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:02.616+0000 7f6eed000640 1 --2- 172.21.15.50:0/1853476618 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x563c2dade1b0 0x563c2de83d40 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f6ee0035000 tx=0x7f6ee002f3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2c44c00ffa286555 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:30:02.629 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:02.617+0000 7f6edd600640 1 -- 172.21.15.50:0/1853476618 <== mon.2 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ee0031650 con 0x563c2dade1b0 2024-08-31T04:30:02.629 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:02.617+0000 7f6edd600640 1 -- 172.21.15.50:0/1853476618 <== mon.2 v2:172.21.15.133:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6ee0036030 con 0x563c2dade1b0 2024-08-31T04:30:02.629 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:02.617+0000 7f6edd600640 1 -- 172.21.15.50:0/1853476618 <== mon.2 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ee0004680 con 0x563c2dade1b0 2024-08-31T04:30:02.629 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:02.617+0000 7f6ef5fdc740 1 -- 172.21.15.50:0/1853476618 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x563c2dade1b0 msgr2=0x563c2de83d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:30:02.629 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:02.617+0000 7f6ef5fdc740 1 --2- 172.21.15.50:0/1853476618 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x563c2dade1b0 0x563c2de83d40 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f6ee0035000 tx=0x7f6ee002f3a0 comp rx=0 tx=0).stop 2024-08-31T04:30:02.629 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:02.618+0000 7f6ee4c00640 1 --2- 172.21.15.50:0/3143358628 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f6ecc0b4b30 0x7f6ecc0b7040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:30:02.629 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:02.618+0000 7f6ef5fdc740 1 -- 172.21.15.50:0/1853476618 shutdown_connections 2024-08-31T04:30:02.629 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:02.618+0000 7f6ef5fdc740 1 --2- 172.21.15.50:0/1853476618 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x563c2dabd4d0 0x563c2de84f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:02.629 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:02.618+0000 7f6ef5fdc740 1 --2- 172.21.15.50:0/1853476618 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563c2dab52f0 0x563c2de843b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:02.629 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:02.618+0000 7f6ef5fdc740 1 --2- 172.21.15.50:0/1853476618 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x563c2dade1b0 0x563c2de83d40 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:02.630 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:02.618+0000 7f6ef5fdc740 1 -- 172.21.15.50:0/1853476618 >> 172.21.15.50:0/1853476618 conn(0x563c2dad2300 msgr2=0x563c2de7f7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:30:02.630 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:02.618+0000 7f6ee4c00640 1 -- 172.21.15.50:0/3143358628 <== mon.1 v2:172.21.15.177:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8219+0+0 (secure 0 0 0) 0x7f6ed80e55d0 con 0x7f6ee8103280 2024-08-31T04:30:02.630 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:02.618+0000 7f6ef5fdc740 1 -- 172.21.15.50:0/1853476618 shutdown_connections 2024-08-31T04:30:02.630 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:02.618+0000 7f6ef5fdc740 1 -- 172.21.15.50:0/1853476618 wait complete. 2024-08-31T04:30:02.630 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:02.618+0000 7f6eed000640 1 --2- 172.21.15.50:0/3143358628 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f6ecc0b4b30 0x7f6ecc0b7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:30:02.630 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:02.619+0000 7f6ef5fdc740 1 -- start start 2024-08-31T04:30:02.630 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:02.619+0000 7f6ef5fdc740 1 Processor -- start 2024-08-31T04:30:02.630 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:02.619+0000 7f6eed000640 1 --2- 172.21.15.50:0/3143358628 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f6ecc0b4b30 0x7f6ecc0b7040 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f6ee0009620 tx=0x7f6ee002a8c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:30:02.630 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:02.619+0000 7f6ef5fdc740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x563c2dab52f0 0x563c2de8d280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:30:02.630 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:02.619+0000 7f6ef5fdc740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x563c2dabd4d0 0x563c2de8d940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:30:02.630 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:02.619+0000 7f6ef5fdc740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563c2dade1b0 0x563c2de8e4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:30:02.630 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:02.619+0000 7f6ef5fdc740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x563c2dd1fab0 con 0x563c2dade1b0 2024-08-31T04:30:02.631 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:02.619+0000 7f6ef5fdc740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x563c2dd8d320 con 0x563c2dabd4d0 2024-08-31T04:30:02.631 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:02.619+0000 7f6ef5fdc740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x563c2de85840 con 0x563c2dab52f0 2024-08-31T04:30:02.631 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:02.619+0000 7f6ef5fdc740 10 client.0 _ll_register_callbacks cb 0x563c2ddc6e80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:30:02.631 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:02.620+0000 7f6ee7400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x563c2dabd4d0 0x563c2de8d940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:30:02.631 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:02.620+0000 7f6ee7400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x563c2dabd4d0 0x563c2de8d940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.50:58892/0 (socket says 172.21.15.50:58892) 2024-08-31T04:30:02.631 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:02.620+0000 7f6ee7e00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x563c2dab52f0 0x563c2de8d280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:30:02.631 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:02.620+0000 7f6ee7400640 1 -- 172.21.15.50:0/1842615184 learned_addr learned my addr 172.21.15.50:0/1842615184 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:30:02.631 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:02.620+0000 7f6eed000640 1 --2- 172.21.15.50:0/1842615184 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563c2dade1b0 0x563c2de8e4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:30:02.631 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:02.620+0000 7f6ee7400640 1 -- 172.21.15.50:0/1842615184 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x563c2dab52f0 msgr2=0x563c2de8d280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:30:02.631 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:02.620+0000 7f6ee7400640 1 --2- 172.21.15.50:0/1842615184 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x563c2dab52f0 0x563c2de8d280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:02.631 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:02.620+0000 7f6ee7400640 1 -- 172.21.15.50:0/1842615184 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563c2dade1b0 msgr2=0x563c2de8e4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:30:02.631 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:02.620+0000 7f6ee7400640 1 --2- 172.21.15.50:0/1842615184 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563c2dade1b0 0x563c2de8e4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:02.631 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:02.620+0000 7f6ee7400640 1 -- 172.21.15.50:0/1842615184 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563c2db49790 con 0x563c2dabd4d0 2024-08-31T04:30:02.631 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:02.620+0000 7f6ee7e00640 1 --2- 172.21.15.50:0/1842615184 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x563c2dab52f0 0x563c2de8d280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:30:02.632 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:02.620+0000 7f6ee7400640 1 --2- 172.21.15.50:0/1842615184 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x563c2dabd4d0 0x563c2de8d940 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f6ed4012810 tx=0x7f6ed4012cd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3de8178f292600c8 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:30:02.632 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:02.620+0000 7f6ed2000640 10 client.0 ms_handle_connect on v2:172.21.15.133:3300/0 2024-08-31T04:30:02.632 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:02.621+0000 7f6ed2000640 1 -- 172.21.15.50:0/1842615184 <== mon.2 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ed4004020 con 0x563c2dabd4d0 2024-08-31T04:30:02.632 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:02.621+0000 7f6ef5fdc740 1 -- 172.21.15.50:0/1842615184 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6ee0036030 con 0x563c2dabd4d0 2024-08-31T04:30:02.632 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:02.621+0000 7f6ed2000640 1 -- 172.21.15.50:0/1842615184 <== mon.2 v2:172.21.15.133:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8219+0+0 (secure 0 0 0) 0x7f6ed40041c0 con 0x563c2dabd4d0 2024-08-31T04:30:02.632 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:02.621+0000 7f6ed2000640 1 -- 172.21.15.50:0/1842615184 <== mon.2 v2:172.21.15.133:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7f6ed40043c0 con 0x563c2dabd4d0 2024-08-31T04:30:02.632 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:02.621+0000 7f6ef5fdc740 10 client.26024 fetch_fsmap learned FSMap version 39 2024-08-31T04:30:02.634 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:02.621+0000 7f6ef5fdc740 1 -- 172.21.15.50:0/1842615184 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) -- 0x563c2dbc2620 con 0x563c2dabd4d0 2024-08-31T04:30:02.634 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:02.621+0000 7f6ed2000640 1 -- 172.21.15.50:0/1842615184 <== mon.2 v2:172.21.15.133:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6ee0036030 con 0x563c2dabd4d0 2024-08-31T04:30:02.634 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:02.622+0000 7f6ed2000640 1 -- 172.21.15.50:0/1842615184 <== mon.2 v2:172.21.15.133:3300/0 5 ==== fsmap(e 39) ==== 8410+0+0 (secure 0 0 0) 0x7f6ed4003ab0 con 0x563c2dabd4d0 2024-08-31T04:30:02.634 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:02.622+0000 7f6ef5fdc740 10 client.26024 fetch_fsmap finished waiting for FSMap version 39 2024-08-31T04:30:02.634 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:02.622+0000 7f6ef5fdc740 10 client.26024 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T04:30:02.634 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:02.622+0000 7f6ef5fdc740 20 client.26024 populate_metadata read hostname 'smithi050' 2024-08-31T04:30:02.635 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:02.622+0000 7f6ef5fdc740 1 --2- 172.21.15.50:0/1842615184 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x563c2da9cd80 0x563c2de9aba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:30:02.635 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:02.622+0000 7f6ef5fdc740 4 client.26024 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T04:30:02.635 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:02.622+0000 7f6ef5fdc740 1 -- 172.21.15.50:0/1842615184 --> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563c2ddf8ec0 con 0x563c2da9cd80 2024-08-31T04:30:02.635 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:02.622+0000 7f6ee7e00640 1 --2- 172.21.15.50:0/1842615184 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x563c2da9cd80 0x563c2de9aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:30:02.635 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:02.623+0000 7f6ee7e00640 1 --2- 172.21.15.50:0/1842615184 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x563c2da9cd80 0x563c2de9aba0 crc :-1 s=READY pgs=104 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=837e874741cec1f2 server_cookie=20a56f3b17bdfcd7 in_seq=0 out_seq=0 2024-08-31T04:30:02.635 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:02.623+0000 7f6ed2000640 10 client.26024 ms_handle_connect on v2:172.21.15.133:6838/2526402262 2024-08-31T04:30:02.635 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:02.624+0000 7f6ed2000640 1 -- 172.21.15.50:0/1842615184 <== mds.0 v2:172.21.15.133:6838/2526402262 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x563c2ddf8ec0 con 0x563c2da9cd80 2024-08-31T04:30:02.635 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:02.624+0000 7f6ed2000640 10 client.26024 handle_command_reply: tid=0 2024-08-31T04:30:02.635 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:02.624+0000 7f6ef5fdc740 1 client.26024 shutdown 2024-08-31T04:30:02.635 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:02.624+0000 7f6ef5fdc740 1 -- 172.21.15.50:0/1842615184 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x563c2dabd4d0 msgr2=0x563c2de8d940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:30:02.635 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:02.624+0000 7f6ef5fdc740 1 --2- 172.21.15.50:0/1842615184 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x563c2dabd4d0 0x563c2de8d940 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f6ed4012810 tx=0x7f6ed4012cd0 comp rx=0 tx=0).stop 2024-08-31T04:30:02.635 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:02.624+0000 7f6ef5fdc740 1 -- 172.21.15.50:0/1842615184 shutdown_connections 2024-08-31T04:30:02.635 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:02.624+0000 7f6ef5fdc740 1 --2- 172.21.15.50:0/1842615184 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x563c2da9cd80 0x563c2de9aba0 crc :-1 s=READY pgs=104 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:02.636 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:02.624+0000 7f6ef5fdc740 1 --2- 172.21.15.50:0/1842615184 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563c2dade1b0 0x563c2de8e4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:02.636 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:02.624+0000 7f6ef5fdc740 1 --2- 172.21.15.50:0/1842615184 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x563c2dabd4d0 0x563c2de8d940 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:02.636 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:02.624+0000 7f6ed2000640 0 client.26024 ms_handle_reset on v2:172.21.15.133:6838/2526402262 2024-08-31T04:30:02.636 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:02.624+0000 7f6ef5fdc740 1 --2- 172.21.15.50:0/1842615184 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x563c2dab52f0 0x563c2de8d280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:02.636 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:02.624+0000 7f6ef5fdc740 1 -- 172.21.15.50:0/1842615184 >> 172.21.15.50:0/1842615184 conn(0x563c2dad2300 msgr2=0x563c2de7dd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:30:02.636 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:02.624+0000 7f6ef5fdc740 1 -- 172.21.15.50:0/1842615184 shutdown_connections 2024-08-31T04:30:02.636 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:02.624+0000 7f6ef5fdc740 1 -- 172.21.15.50:0/1842615184 wait complete. 2024-08-31T04:30:02.636 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:02.624+0000 7f6ef5fdc740 20 client.26024 trim_cache size 0 max 16384 2024-08-31T04:30:02.636 INFO:journalctl@ceph.mds.d.smithi050.stdout:Aug 31 04:30:02 smithi050 podman[80159]: 2024-08-31 04:30:02.432796965 +0000 UTC m=+0.283579883 container create c22de27cfed4797d6e4954d1620c3265097a3ccd82f9776df81f4a544a58e656 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-mds-d, ceph=True, org.label-schema.vendor=CentOS, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, io.buildah.version=1.37.1, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2) 2024-08-31T04:30:02.641 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:02.639+0000 7f6ef5fdc740 1 Processor -- start 2024-08-31T04:30:02.641 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:02.640+0000 7f6ef5fdc740 1 -- start start 2024-08-31T04:30:02.641 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:02.640+0000 7f6ef5fdc740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x563c2dab52f0 0x563c2de8d8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:30:02.641 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:02.640+0000 7f6ef5fdc740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563c2dabd4d0 0x563c2de884b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:30:02.641 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:02.640+0000 7f6ef5fdc740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x563c2dade1b0 0x563c2de8a1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:30:02.641 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:02.640+0000 7f6ef5fdc740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f6ee81acb50 con 0x563c2dabd4d0 2024-08-31T04:30:02.641 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:02.640+0000 7f6ef5fdc740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f6ee81ae8d0 con 0x563c2dade1b0 2024-08-31T04:30:02.642 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:02.640+0000 7f6ef5fdc740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f6ee81ad220 con 0x563c2dab52f0 2024-08-31T04:30:02.643 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:02.640+0000 7f6ee7400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563c2dabd4d0 0x563c2de884b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:30:02.643 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:02.640+0000 7f6ee7400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563c2dabd4d0 0x563c2de884b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35218/0 (socket says 172.21.15.50:35218) 2024-08-31T04:30:02.643 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:02.640+0000 7f6ee7400640 1 -- 172.21.15.50:0/3218096982 learned_addr learned my addr 172.21.15.50:0/3218096982 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:30:02.643 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:02.640+0000 7f6ee7e00640 1 --2- 172.21.15.50:0/3218096982 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x563c2dab52f0 0x563c2de8d8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:30:02.643 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:02.640+0000 7f6eed000640 1 --2- 172.21.15.50:0/3218096982 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x563c2dade1b0 0x563c2de8a1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:30:02.643 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:02.641+0000 7f6ee7e00640 1 -- 172.21.15.50:0/3218096982 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x563c2dade1b0 msgr2=0x563c2de8a1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:30:02.643 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:02.641+0000 7f6ee7e00640 1 --2- 172.21.15.50:0/3218096982 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x563c2dade1b0 0x563c2de8a1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:02.643 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:02.641+0000 7f6ee7e00640 1 -- 172.21.15.50:0/3218096982 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563c2dabd4d0 msgr2=0x563c2de884b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:30:02.643 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:02.641+0000 7f6ee7e00640 1 --2- 172.21.15.50:0/3218096982 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563c2dabd4d0 0x563c2de884b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:02.643 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:02.641+0000 7f6ee7e00640 1 -- 172.21.15.50:0/3218096982 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563c2de8b4b0 con 0x563c2dab52f0 2024-08-31T04:30:02.643 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:02.641+0000 7f6ee7e00640 1 --2- 172.21.15.50:0/3218096982 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x563c2dab52f0 0x563c2de8d8f0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f6ed80e3050 tx=0x7f6ed800cf20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e898db74747fcde6 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:30:02.643 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:02.641+0000 7f6edcc00640 1 -- 172.21.15.50:0/3218096982 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ed80d2070 con 0x563c2dab52f0 2024-08-31T04:30:02.644 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:02.641+0000 7f6edcc00640 1 -- 172.21.15.50:0/3218096982 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6ed80abac0 con 0x563c2dab52f0 2024-08-31T04:30:02.644 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:02.641+0000 7f6edcc00640 1 -- 172.21.15.50:0/3218096982 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ed80046c0 con 0x563c2dab52f0 2024-08-31T04:30:02.646 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:02.642+0000 7f6ef5fdc740 1 -- 172.21.15.50:0/3218096982 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x563c2dab52f0 msgr2=0x563c2de8d8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:30:02.646 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:02.642+0000 7f6ef5fdc740 1 --2- 172.21.15.50:0/3218096982 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x563c2dab52f0 0x563c2de8d8f0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f6ed80e3050 tx=0x7f6ed800cf20 comp rx=0 tx=0).stop 2024-08-31T04:30:02.646 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:02.642+0000 7f6ef5fdc740 1 -- 172.21.15.50:0/3218096982 shutdown_connections 2024-08-31T04:30:02.646 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:02.642+0000 7f6ef5fdc740 1 --2- 172.21.15.50:0/3218096982 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x563c2dade1b0 0x563c2de8a1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:02.646 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:02.642+0000 7f6ef5fdc740 1 --2- 172.21.15.50:0/3218096982 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563c2dabd4d0 0x563c2de884b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:02.646 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:02.642+0000 7f6ef5fdc740 1 --2- 172.21.15.50:0/3218096982 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x563c2dab52f0 0x563c2de8d8f0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:02.647 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:02.642+0000 7f6ef5fdc740 1 -- 172.21.15.50:0/3218096982 >> 172.21.15.50:0/3218096982 conn(0x563c2dad2300 msgr2=0x563c2de87da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:30:02.647 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:02.642+0000 7f6ef5fdc740 1 -- 172.21.15.50:0/3218096982 shutdown_connections 2024-08-31T04:30:02.647 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:02.642+0000 7f6ef5fdc740 1 -- 172.21.15.50:0/3218096982 wait complete. 2024-08-31T04:30:02.647 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:02.642+0000 7f6ef5fdc740 1 -- start start 2024-08-31T04:30:02.647 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:02.643+0000 7f6ef5fdc740 1 Processor -- start 2024-08-31T04:30:02.647 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:02.643+0000 7f6ef5fdc740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x563c2dab52f0 0x563c2de952d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:30:02.647 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:02.643+0000 7f6ef5fdc740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563c2dabd4d0 0x563c2df015c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:30:02.647 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:02.643+0000 7f6ef5fdc740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x563c2dade1b0 0x563c2df03ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:30:02.647 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:02.643+0000 7f6ef5fdc740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f6ee81ae140 con 0x563c2dabd4d0 2024-08-31T04:30:02.647 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:02.643+0000 7f6ef5fdc740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f6ee81ad9b0 con 0x563c2dade1b0 2024-08-31T04:30:02.647 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:02.643+0000 7f6ef5fdc740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f6ee81aab30 con 0x563c2dab52f0 2024-08-31T04:30:02.647 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:02.643+0000 7f6ef5fdc740 10 client.0 _ll_register_callbacks cb 0x7f6ed4009930 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:30:02.648 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:02.643+0000 7f6ee7400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563c2dabd4d0 0x563c2df015c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:30:02.648 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:02.643+0000 7f6eed000640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x563c2dade1b0 0x563c2df03ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:30:02.648 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:02.643+0000 7f6eed000640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x563c2dade1b0 0x563c2df03ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.50:58902/0 (socket says 172.21.15.50:58902) 2024-08-31T04:30:02.648 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:02.643+0000 7f6eed000640 1 -- 172.21.15.50:0/1871983361 learned_addr learned my addr 172.21.15.50:0/1871983361 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:30:02.648 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:02.643+0000 7f6ee7e00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x563c2dab52f0 0x563c2de952d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:30:02.648 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:02.644+0000 7f6ee7400640 1 -- 172.21.15.50:0/1871983361 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x563c2dab52f0 msgr2=0x563c2de952d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:30:02.648 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:02.644+0000 7f6ee7400640 1 --2- 172.21.15.50:0/1871983361 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x563c2dab52f0 0x563c2de952d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:02.648 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:02.644+0000 7f6ee7400640 1 -- 172.21.15.50:0/1871983361 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x563c2dade1b0 msgr2=0x563c2df03ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:30:02.648 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:02.644+0000 7f6ee7400640 1 --2- 172.21.15.50:0/1871983361 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x563c2dade1b0 0x563c2df03ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:02.649 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:02.644+0000 7f6ee7400640 1 -- 172.21.15.50:0/1871983361 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563c2df04470 con 0x563c2dabd4d0 2024-08-31T04:30:02.649 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:02.644+0000 7f6eed000640 1 --2- 172.21.15.50:0/1871983361 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x563c2dade1b0 0x563c2df03ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:30:02.649 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:02.644+0000 7f6ee7400640 1 --2- 172.21.15.50:0/1871983361 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563c2dabd4d0 0x563c2df015c0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f6ed4003f20 tx=0x7f6ed4003ff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a348bf9a6d15e531 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:30:02.649 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:02.644+0000 7f6ed2000640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-08-31T04:30:02.649 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:02.644+0000 7f6ed2000640 1 -- 172.21.15.50:0/1871983361 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ed40041e0 con 0x563c2dabd4d0 2024-08-31T04:30:02.649 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:02.645+0000 7f6ef5fdc740 1 -- 172.21.15.50:0/1871983361 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6ed80abac0 con 0x563c2dabd4d0 2024-08-31T04:30:02.649 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:02.645+0000 7f6ed2000640 1 -- 172.21.15.50:0/1871983361 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8219+0+0 (secure 0 0 0) 0x7f6ed4018040 con 0x563c2dabd4d0 2024-08-31T04:30:02.649 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:02.645+0000 7f6ed2000640 1 -- 172.21.15.50:0/1871983361 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7f6ed400f920 con 0x563c2dabd4d0 2024-08-31T04:30:02.649 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:02.645+0000 7f6ef5fdc740 10 client.16011 fetch_fsmap learned FSMap version 39 2024-08-31T04:30:02.649 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:02.645+0000 7f6ef5fdc740 1 -- 172.21.15.50:0/1871983361 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) -- 0x563c2df05770 con 0x563c2dabd4d0 2024-08-31T04:30:02.650 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:02.645+0000 7f6ed2000640 1 -- 172.21.15.50:0/1871983361 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6ed80abac0 con 0x563c2dabd4d0 2024-08-31T04:30:02.650 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:02.645+0000 7f6ed2000640 1 -- 172.21.15.50:0/1871983361 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 39) ==== 8410+0+0 (secure 0 0 0) 0x7f6ed401c6d0 con 0x563c2dabd4d0 2024-08-31T04:30:02.650 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:02.645+0000 7f6ef5fdc740 10 client.16011 fetch_fsmap finished waiting for FSMap version 39 2024-08-31T04:30:02.650 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:02.645+0000 7f6ef5fdc740 10 client.16011 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T04:30:02.650 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:02.645+0000 7f6ef5fdc740 20 client.16011 populate_metadata read hostname 'smithi050' 2024-08-31T04:30:02.650 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:02.646+0000 7f6ef5fdc740 1 --2- 172.21.15.50:0/1871983361 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x563c2da721c0 0x563c2df08220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:30:02.650 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:02.646+0000 7f6ef5fdc740 4 client.16011 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-31T04:30:02.650 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:02.646+0000 7f6ef5fdc740 1 -- 172.21.15.50:0/1871983361 --> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] -- command(tid 0: {"prefix": "flush journal"}) -- 0x563c2ddf4960 con 0x563c2da721c0 2024-08-31T04:30:02.651 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:02.646+0000 7f6ee7e00640 1 --2- 172.21.15.50:0/1871983361 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x563c2da721c0 0x563c2df08220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:30:02.651 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:02.646+0000 7f6ee7e00640 1 --2- 172.21.15.50:0/1871983361 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x563c2da721c0 0x563c2df08220 crc :-1 s=READY pgs=105 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=121b400cada73d56 server_cookie=e266f1ab1f7016cc in_seq=0 out_seq=0 2024-08-31T04:30:02.651 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:02.646+0000 7f6ed2000640 10 client.16011 ms_handle_connect on v2:172.21.15.133:6838/2526402262 2024-08-31T04:30:02.679 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:02.678+0000 7f6ed2000640 1 -- 172.21.15.50:0/1871983361 <== mds.0 v2:172.21.15.133:6838/2526402262 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x563c2ddf4960 con 0x563c2da721c0 2024-08-31T04:30:02.679 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:02.678+0000 7f6ed2000640 10 client.16011 handle_command_reply: tid=0 2024-08-31T04:30:02.679 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:02.678+0000 7f6ef5fdc740 1 client.16011 shutdown 2024-08-31T04:30:02.679 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:02.678+0000 7f6ef5fdc740 1 -- 172.21.15.50:0/1871983361 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563c2dabd4d0 msgr2=0x563c2df015c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:30:02.679 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:02.678+0000 7f6ef5fdc740 1 --2- 172.21.15.50:0/1871983361 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563c2dabd4d0 0x563c2df015c0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f6ed4003f20 tx=0x7f6ed4003ff0 comp rx=0 tx=0).stop 2024-08-31T04:30:02.679 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:02.678+0000 7f6ef5fdc740 1 -- 172.21.15.50:0/1871983361 shutdown_connections 2024-08-31T04:30:02.679 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:02.678+0000 7f6ef5fdc740 1 --2- 172.21.15.50:0/1871983361 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x563c2da721c0 0x563c2df08220 crc :-1 s=READY pgs=105 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:02.680 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:02.678+0000 7f6ef5fdc740 1 --2- 172.21.15.50:0/1871983361 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x563c2dade1b0 0x563c2df03ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:02.680 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:02.678+0000 7f6ef5fdc740 1 --2- 172.21.15.50:0/1871983361 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563c2dabd4d0 0x563c2df015c0 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:02.680 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:02.678+0000 7f6ef5fdc740 1 --2- 172.21.15.50:0/1871983361 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x563c2dab52f0 0x563c2de952d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:02.680 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:02.678+0000 7f6ed2000640 0 client.16011 ms_handle_reset on v2:172.21.15.133:6838/2526402262 2024-08-31T04:30:02.680 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:02.678+0000 7f6ef5fdc740 1 -- 172.21.15.50:0/1871983361 >> 172.21.15.50:0/1871983361 conn(0x563c2dad2300 msgr2=0x563c2de9f350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:30:02.680 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:02.678+0000 7f6ef5fdc740 1 -- 172.21.15.50:0/1871983361 shutdown_connections 2024-08-31T04:30:02.680 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:02.678+0000 7f6ef5fdc740 1 -- 172.21.15.50:0/1871983361 wait complete. 2024-08-31T04:30:02.681 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:02.678+0000 7f6ef5fdc740 20 client.16011 trim_cache size 0 max 16384 2024-08-31T04:30:02.681 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout:{ 2024-08-31T04:30:02.681 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout: "message": "", 2024-08-31T04:30:02.681 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout: "return_code": 0 2024-08-31T04:30:02.681 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout:} 2024-08-31T04:30:02.682 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:02.679+0000 7f6eeda00640 1 -- 172.21.15.50:0/3143358628 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f6ecc0b4b30 msgr2=0x7f6ecc0b7040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:30:02.682 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:02.679+0000 7f6eeda00640 1 --2- 172.21.15.50:0/3143358628 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f6ecc0b4b30 0x7f6ecc0b7040 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f6ee0009620 tx=0x7f6ee002a8c0 comp rx=0 tx=0).stop 2024-08-31T04:30:02.682 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:02.679+0000 7f6eeda00640 1 -- 172.21.15.50:0/3143358628 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6ee8103280 msgr2=0x7f6ee819bca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:30:02.682 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:02.679+0000 7f6eeda00640 1 --2- 172.21.15.50:0/3143358628 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6ee8103280 0x7f6ee819bca0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f6ed800e9f0 tx=0x7f6ed800edf0 comp rx=0 tx=0).stop 2024-08-31T04:30:02.682 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:02.679+0000 7f6eeda00640 1 -- 172.21.15.50:0/3143358628 shutdown_connections 2024-08-31T04:30:02.682 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:02.679+0000 7f6eeda00640 1 --2- 172.21.15.50:0/3143358628 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f6ecc0b4b30 0x7f6ecc0b7040 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:02.682 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:02.679+0000 7f6eeda00640 1 --2- 172.21.15.50:0/3143358628 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6ee8104ca0 0x7f6ee819cec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:02.682 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:02.679+0000 7f6eeda00640 1 --2- 172.21.15.50:0/3143358628 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6ee8104300 0x7f6ee819c310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:02.682 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:02.679+0000 7f6eeda00640 1 --2- 172.21.15.50:0/3143358628 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6ee8103280 0x7f6ee819bca0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:02.682 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:02.679+0000 7f6eeda00640 1 -- 172.21.15.50:0/3143358628 >> 172.21.15.50:0/3143358628 conn(0x7f6ee80febc0 msgr2=0x7f6ee8075390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:30:02.683 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:02.679+0000 7f6eeda00640 1 -- 172.21.15.50:0/3143358628 shutdown_connections 2024-08-31T04:30:02.683 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:02.679+0000 7f6eeda00640 1 -- 172.21.15.50:0/3143358628 wait complete. 2024-08-31T04:30:03.209 INFO:journalctl@ceph.mds.d.smithi050.stdout:Aug 31 04:30:03 smithi050 podman[80159]: 2024-08-31 04:30:03.043893341 +0000 UTC m=+0.894676259 container init c22de27cfed4797d6e4954d1620c3265097a3ccd82f9776df81f4a544a58e656 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-mds-d, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, ceph=True, org.label-schema.vendor=CentOS, io.buildah.version=1.37.1, CEPH_POINT_RELEASE=) 2024-08-31T04:30:03.209 INFO:journalctl@ceph.mds.d.smithi050.stdout:Aug 31 04:30:03 smithi050 podman[80159]: 2024-08-31 04:30:03.070766373 +0000 UTC m=+0.921549292 container start c22de27cfed4797d6e4954d1620c3265097a3ccd82f9776df81f4a544a58e656 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-mds-d, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, io.buildah.version=1.37.1, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_CLEAN=True) 2024-08-31T04:30:03.209 INFO:journalctl@ceph.mds.d.smithi050.stdout:Aug 31 04:30:03 smithi050 ceph-mds[80223]: -- 172.21.15.50:0/1141964660 <== mon.0 v2:172.21.15.50:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5641f4ea9860 con 0x5641f904f600 2024-08-31T04:30:03.209 INFO:journalctl@ceph.mds.d.smithi050.stdout:Aug 31 04:30:03 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-mds-d[80219]: starting mds.d at 2024-08-31T04:30:03.209 INFO:journalctl@ceph.mds.d.smithi050.stdout:Aug 31 04:30:03 smithi050 bash[80159]: c22de27cfed4797d6e4954d1620c3265097a3ccd82f9776df81f4a544a58e656 2024-08-31T04:30:03.209 INFO:journalctl@ceph.mds.d.smithi050.stdout:Aug 31 04:30:03 smithi050 systemd[1]: Started Ceph mds.d for 058d9fc6-674f-11ef-bcd4-c7b262605968. 2024-08-31T04:30:03.490 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:30:03 smithi050 ceph-mon[17259]: pgmap v582: 97 pgs: 97 active+clean; 1.5 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.4 MiB/s wr, 549 op/s 2024-08-31T04:30:03.490 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:30:03 smithi050 ceph-mon[17259]: daemon mds.d restarted 2024-08-31T04:30:03.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:30:03 smithi177 ceph-mon[22025]: pgmap v582: 97 pgs: 97 active+clean; 1.5 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.4 MiB/s wr, 549 op/s 2024-08-31T04:30:03.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:30:03 smithi177 ceph-mon[22025]: daemon mds.d restarted 2024-08-31T04:30:03.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:30:03 smithi133 ceph-mon[22177]: pgmap v582: 97 pgs: 97 active+clean; 1.5 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.4 MiB/s wr, 549 op/s 2024-08-31T04:30:03.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:30:03 smithi133 ceph-mon[22177]: daemon mds.d restarted 2024-08-31T04:30:04.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:30:04 smithi050 ceph-mon[17259]: osdmap e80: 12 total, 12 up, 12 in 2024-08-31T04:30:04.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:30:04 smithi050 ceph-mon[17259]: mds.? [v2:172.21.15.50:6836/2788697263,v1:172.21.15.50:6837/2788697263] up:boot 2024-08-31T04:30:04.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:30:04 smithi050 ceph-mon[17259]: fsmap cephfs:5 4 up:standby-replay 3 up:standby 5 up:active 2024-08-31T04:30:04.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:30:04 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "d"} : dispatch 2024-08-31T04:30:04.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:30:04 smithi050 ceph-mon[17259]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-31T04:30:04.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:30:04 smithi177 ceph-mon[22025]: osdmap e80: 12 total, 12 up, 12 in 2024-08-31T04:30:04.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:30:04 smithi177 ceph-mon[22025]: mds.? [v2:172.21.15.50:6836/2788697263,v1:172.21.15.50:6837/2788697263] up:boot 2024-08-31T04:30:04.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:30:04 smithi177 ceph-mon[22025]: fsmap cephfs:5 4 up:standby-replay 3 up:standby 5 up:active 2024-08-31T04:30:04.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:30:04 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "d"} : dispatch 2024-08-31T04:30:04.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:30:04 smithi177 ceph-mon[22025]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-31T04:30:04.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:30:04 smithi133 ceph-mon[22177]: osdmap e80: 12 total, 12 up, 12 in 2024-08-31T04:30:04.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:30:04 smithi133 ceph-mon[22177]: mds.? [v2:172.21.15.50:6836/2788697263,v1:172.21.15.50:6837/2788697263] up:boot 2024-08-31T04:30:04.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:30:04 smithi133 ceph-mon[22177]: fsmap cephfs:5 4 up:standby-replay 3 up:standby 5 up:active 2024-08-31T04:30:04.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:30:04 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "d"} : dispatch 2024-08-31T04:30:04.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:30:04 smithi133 ceph-mon[22177]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-31T04:30:05.496 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:30:05 smithi050 ceph-mon[17259]: pgmap v584: 97 pgs: 97 active+clean; 1.5 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.7 MiB/s wr, 106 op/s 2024-08-31T04:30:05.748 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:30:05 smithi177 ceph-mon[22025]: pgmap v584: 97 pgs: 97 active+clean; 1.5 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.7 MiB/s wr, 106 op/s 2024-08-31T04:30:05.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:30:05 smithi133 ceph-mon[22177]: pgmap v584: 97 pgs: 97 active+clean; 1.5 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.7 MiB/s wr, 106 op/s 2024-08-31T04:30:07.420 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:30:07 smithi050 ceph-mon[17259]: pgmap v585: 97 pgs: 97 active+clean; 1.5 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 71 op/s 2024-08-31T04:30:07.420 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:30:07 smithi050 ceph-mon[17259]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-31T04:30:07.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:30:07 smithi177 ceph-mon[22025]: pgmap v585: 97 pgs: 97 active+clean; 1.5 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 71 op/s 2024-08-31T04:30:07.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:30:07 smithi177 ceph-mon[22025]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-31T04:30:07.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:30:07 smithi133 ceph-mon[22177]: pgmap v585: 97 pgs: 97 active+clean; 1.5 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 71 op/s 2024-08-31T04:30:07.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:30:07 smithi133 ceph-mon[22177]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-31T04:30:09.628 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:30:09 smithi050 ceph-mon[17259]: pgmap v586: 97 pgs: 97 active+clean; 1.5 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 997 KiB/s rd, 866 KiB/s wr, 34 op/s 2024-08-31T04:30:09.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:30:09 smithi177 ceph-mon[22025]: pgmap v586: 97 pgs: 97 active+clean; 1.5 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 997 KiB/s rd, 866 KiB/s wr, 34 op/s 2024-08-31T04:30:09.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:30:09 smithi133 ceph-mon[22177]: pgmap v586: 97 pgs: 97 active+clean; 1.5 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 997 KiB/s rd, 866 KiB/s wr, 34 op/s 2024-08-31T04:30:11.609 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:30:11 smithi050 ceph-mon[17259]: pgmap v587: 97 pgs: 97 active+clean; 1.5 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 997 KiB/s rd, 852 KiB/s wr, 33 op/s 2024-08-31T04:30:11.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:30:11 smithi177 ceph-mon[22025]: pgmap v587: 97 pgs: 97 active+clean; 1.5 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 997 KiB/s rd, 852 KiB/s wr, 33 op/s 2024-08-31T04:30:11.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:30:11 smithi133 ceph-mon[22177]: pgmap v587: 97 pgs: 97 active+clean; 1.5 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 997 KiB/s rd, 852 KiB/s wr, 33 op/s 2024-08-31T04:30:13.556 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:30:13 smithi050 ceph-mon[17259]: pgmap v588: 97 pgs: 97 active+clean; 1.5 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 1.3 MiB/s wr, 122 op/s 2024-08-31T04:30:13.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:30:13 smithi177 ceph-mon[22025]: pgmap v588: 97 pgs: 97 active+clean; 1.5 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 1.3 MiB/s wr, 122 op/s 2024-08-31T04:30:13.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:30:13 smithi133 ceph-mon[22177]: pgmap v588: 97 pgs: 97 active+clean; 1.5 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 1.3 MiB/s wr, 122 op/s 2024-08-31T04:30:15.564 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:30:15 smithi050 ceph-mon[17259]: pgmap v589: 97 pgs: 97 active+clean; 1.5 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 2.0 MiB/s wr, 176 op/s 2024-08-31T04:30:15.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:30:15 smithi177 ceph-mon[22025]: pgmap v589: 97 pgs: 97 active+clean; 1.5 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 2.0 MiB/s wr, 176 op/s 2024-08-31T04:30:15.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:30:15 smithi133 ceph-mon[22177]: pgmap v589: 97 pgs: 97 active+clean; 1.5 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 2.0 MiB/s wr, 176 op/s 2024-08-31T04:30:15.933 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:15.932+0000 7fbca8a00640 1 -- 172.21.15.50:0/1813032340 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbca4075a90 msgr2=0x7fbca4075ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:30:15.934 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:15.932+0000 7fbca8a00640 1 --2- 172.21.15.50:0/1813032340 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbca4075a90 0x7fbca4075ea0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fbc90009900 tx=0x7fbc9002a3f0 comp rx=0 tx=0).stop 2024-08-31T04:30:15.934 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:15.932+0000 7fbca8a00640 1 -- 172.21.15.50:0/1813032340 shutdown_connections 2024-08-31T04:30:15.934 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:15.932+0000 7fbca8a00640 1 --2- 172.21.15.50:0/1813032340 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbca410fa00 0x7fbca4111e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:15.934 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:15.932+0000 7fbca8a00640 1 --2- 172.21.15.50:0/1813032340 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbca4075a90 0x7fbca4075ea0 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:15.934 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:15.932+0000 7fbca8a00640 1 --2- 172.21.15.50:0/1813032340 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbca4076e90 0x7fbca4075550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:15.934 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:15.932+0000 7fbca8a00640 1 -- 172.21.15.50:0/1813032340 >> 172.21.15.50:0/1813032340 conn(0x7fbca40febc0 msgr2=0x7fbca4101070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:30:15.934 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:15.932+0000 7fbca8a00640 1 -- 172.21.15.50:0/1813032340 shutdown_connections 2024-08-31T04:30:15.934 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:15.932+0000 7fbca8a00640 1 -- 172.21.15.50:0/1813032340 wait complete. 2024-08-31T04:30:15.935 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:15.933+0000 7fbca8a00640 1 Processor -- start 2024-08-31T04:30:15.935 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:15.934+0000 7fbca8a00640 1 -- start start 2024-08-31T04:30:15.935 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:15.934+0000 7fbca8a00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbca4075a90 0x7fbca41a0180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:30:15.935 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:15.934+0000 7fbca8a00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbca4076e90 0x7fbca41a07f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:30:15.936 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:15.934+0000 7fbca8a00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbca410fa00 0x7fbca41a13a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:30:15.936 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:15.934+0000 7fbca8a00640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fbca4115500 con 0x7fbca410fa00 2024-08-31T04:30:15.936 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:15.934+0000 7fbca8a00640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7fbca4115380 con 0x7fbca4076e90 2024-08-31T04:30:15.936 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:15.934+0000 7fbca8a00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fbca4115680 con 0x7fbca4075a90 2024-08-31T04:30:15.937 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:15.934+0000 7fbca1e00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbca4076e90 0x7fbca41a07f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:30:15.937 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:15.934+0000 7fbca1e00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbca4076e90 0x7fbca41a07f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.50:44832/0 (socket says 172.21.15.50:44832) 2024-08-31T04:30:15.938 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:15.934+0000 7fbca1e00640 1 -- 172.21.15.50:0/1942408379 learned_addr learned my addr 172.21.15.50:0/1942408379 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:30:15.938 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:15.934+0000 7fbca2800640 1 --2- 172.21.15.50:0/1942408379 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbca4075a90 0x7fbca41a0180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:30:15.938 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:15.935+0000 7fbca3200640 1 --2- 172.21.15.50:0/1942408379 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbca410fa00 0x7fbca41a13a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:30:15.938 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:15.935+0000 7fbca1e00640 1 -- 172.21.15.50:0/1942408379 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbca4075a90 msgr2=0x7fbca41a0180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:30:15.938 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:15.935+0000 7fbca1e00640 1 --2- 172.21.15.50:0/1942408379 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbca4075a90 0x7fbca41a0180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:15.938 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:15.935+0000 7fbca1e00640 1 -- 172.21.15.50:0/1942408379 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbca410fa00 msgr2=0x7fbca41a13a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:30:15.938 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:15.935+0000 7fbca1e00640 1 --2- 172.21.15.50:0/1942408379 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbca410fa00 0x7fbca41a13a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:15.938 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:15.935+0000 7fbca1e00640 1 -- 172.21.15.50:0/1942408379 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbca41a1bc0 con 0x7fbca4076e90 2024-08-31T04:30:15.938 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:15.935+0000 7fbca3200640 1 --2- 172.21.15.50:0/1942408379 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbca410fa00 0x7fbca41a13a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:30:15.938 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:15.935+0000 7fbca2800640 1 --2- 172.21.15.50:0/1942408379 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbca4075a90 0x7fbca41a0180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:30:15.938 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:15.935+0000 7fbca1e00640 1 --2- 172.21.15.50:0/1942408379 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbca4076e90 0x7fbca41a07f0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fbc90031440 tx=0x7fbc90003c10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:30:15.938 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:15.936+0000 7fbc9b400640 1 -- 172.21.15.50:0/1942408379 <== mon.2 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc9003f070 con 0x7fbca4076e90 2024-08-31T04:30:15.938 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:15.936+0000 7fbca8a00640 1 -- 172.21.15.50:0/1942408379 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbca41a1e50 con 0x7fbca4076e90 2024-08-31T04:30:15.939 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:15.936+0000 7fbc9b400640 1 -- 172.21.15.50:0/1942408379 <== mon.2 v2:172.21.15.133:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbc90031c50 con 0x7fbca4076e90 2024-08-31T04:30:15.939 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:15.936+0000 7fbc9b400640 1 -- 172.21.15.50:0/1942408379 <== mon.2 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc90035030 con 0x7fbca4076e90 2024-08-31T04:30:15.939 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:15.936+0000 7fbca8a00640 1 -- 172.21.15.50:0/1942408379 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbca41a2160 con 0x7fbca4076e90 2024-08-31T04:30:15.942 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:15.940+0000 7fbcb0476740 1 Processor -- start 2024-08-31T04:30:15.942 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:15.940+0000 7fbc9b400640 1 -- 172.21.15.50:0/1942408379 <== mon.2 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 18) ==== 152577+0+0 (secure 0 0 0) 0x7fbc90042070 con 0x7fbca4076e90 2024-08-31T04:30:15.942 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:15.940+0000 7fbcb0476740 1 -- start start 2024-08-31T04:30:15.943 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:15.941+0000 7fbcb0476740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b634cbb1b0 0x55b635060fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:30:15.943 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:15.941+0000 7fbcb0476740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b634c922f0 0x55b635061610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:30:15.943 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:15.941+0000 7fbcb0476740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b634c9a4d0 0x55b635062160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:30:15.943 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:15.941+0000 7fbcb0476740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55b634fd3f70 con 0x55b634cbb1b0 2024-08-31T04:30:15.943 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:15.941+0000 7fbcb0476740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x55b634fc3500 con 0x55b634c9a4d0 2024-08-31T04:30:15.943 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:15.941+0000 7fbcb0476740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x55b634fc74b0 con 0x55b634c922f0 2024-08-31T04:30:15.943 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:15.941+0000 7fbca3200640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b634cbb1b0 0x55b635060fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:30:15.943 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:15.941+0000 7fbca2800640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b634c922f0 0x55b635061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:30:15.943 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:15.941+0000 7fbca2800640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b634c922f0 0x55b635061610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.50:52030/0 (socket says 172.21.15.50:52030) 2024-08-31T04:30:15.943 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:15.941+0000 7fbca2800640 1 -- 172.21.15.50:0/3741599361 learned_addr learned my addr 172.21.15.50:0/3741599361 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:30:15.943 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:15.942+0000 7fbca1e00640 1 --2- 172.21.15.50:0/3741599361 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b634c9a4d0 0x55b635062160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:30:15.944 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:15.942+0000 7fbca2800640 1 -- 172.21.15.50:0/3741599361 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b634c9a4d0 msgr2=0x55b635062160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:30:15.944 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:15.942+0000 7fbca2800640 1 --2- 172.21.15.50:0/3741599361 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b634c9a4d0 0x55b635062160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:15.945 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:15.942+0000 7fbca2800640 1 -- 172.21.15.50:0/3741599361 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b634cbb1b0 msgr2=0x55b635060fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:30:15.945 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:15.942+0000 7fbca2800640 1 --2- 172.21.15.50:0/3741599361 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b634cbb1b0 0x55b635060fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:15.945 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:15.942+0000 7fbca2800640 1 -- 172.21.15.50:0/3741599361 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b634f7dc10 con 0x55b634c922f0 2024-08-31T04:30:15.945 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:15.942+0000 7fbc9b400640 1 --2- 172.21.15.50:0/1942408379 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fbc880b4b30 0x7fbc880b7040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:30:15.945 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:15.943+0000 7fbca2800640 1 --2- 172.21.15.50:0/3741599361 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b634c922f0 0x55b635061610 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fbc940115f0 tx=0x7fbc94011ab0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=65834345835fb2f6 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:30:15.945 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:15.943+0000 7fbc9b400640 1 -- 172.21.15.50:0/1942408379 <== mon.2 v2:172.21.15.133:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8219+0+0 (secure 0 0 0) 0x7fbc90105970 con 0x7fbca4076e90 2024-08-31T04:30:15.945 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:15.943+0000 7fbca3200640 1 --2- 172.21.15.50:0/1942408379 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fbc880b4b30 0x7fbc880b7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:30:15.945 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:15.943+0000 7fbc8f400640 1 -- 172.21.15.50:0/3741599361 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc9401e070 con 0x55b634c922f0 2024-08-31T04:30:15.945 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:15.943+0000 7fbc8f400640 1 -- 172.21.15.50:0/3741599361 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbc9400faf0 con 0x55b634c922f0 2024-08-31T04:30:15.945 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:15.943+0000 7fbc8f400640 1 -- 172.21.15.50:0/3741599361 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc94019bc0 con 0x55b634c922f0 2024-08-31T04:30:15.946 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:15.944+0000 7fbcb0476740 1 -- 172.21.15.50:0/3741599361 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b634c922f0 msgr2=0x55b635061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:30:15.946 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:15.944+0000 7fbca3200640 1 --2- 172.21.15.50:0/1942408379 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fbc880b4b30 0x7fbc880b7040 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fbc9c005fd0 tx=0x7fbc9c009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:30:15.946 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:15.944+0000 7fbcb0476740 1 --2- 172.21.15.50:0/3741599361 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b634c922f0 0x55b635061610 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fbc940115f0 tx=0x7fbc94011ab0 comp rx=0 tx=0).stop 2024-08-31T04:30:15.946 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:15.944+0000 7fbcb0476740 1 -- 172.21.15.50:0/3741599361 shutdown_connections 2024-08-31T04:30:15.946 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:15.944+0000 7fbcb0476740 1 --2- 172.21.15.50:0/3741599361 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b634c922f0 0x55b635061610 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:15.946 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:15.944+0000 7fbcb0476740 1 --2- 172.21.15.50:0/3741599361 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b634c9a4d0 0x55b635062160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:15.946 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:15.944+0000 7fbcb0476740 1 --2- 172.21.15.50:0/3741599361 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b634cbb1b0 0x55b635060fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:15.946 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:15.944+0000 7fbcb0476740 1 -- 172.21.15.50:0/3741599361 >> 172.21.15.50:0/3741599361 conn(0x55b634caf300 msgr2=0x55b63505ca30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:30:15.946 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:15.944+0000 7fbcb0476740 1 -- 172.21.15.50:0/3741599361 shutdown_connections 2024-08-31T04:30:15.946 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:15.944+0000 7fbcb0476740 1 -- 172.21.15.50:0/3741599361 wait complete. 2024-08-31T04:30:15.947 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:15.945+0000 7fbcb0476740 1 -- start start 2024-08-31T04:30:15.947 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:15.945+0000 7fbcb0476740 1 Processor -- start 2024-08-31T04:30:15.947 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:15.946+0000 7fbcb0476740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b634c922f0 0x55b63506a690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:30:15.948 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:15.946+0000 7fbcb0476740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b634c9a4d0 0x55b63506ad50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:30:15.948 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:15.946+0000 7fbcb0476740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b634cbb1b0 0x55b63506b8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:30:15.948 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:15.946+0000 7fbcb0476740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55b634efcab0 con 0x55b634c9a4d0 2024-08-31T04:30:15.948 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:15.946+0000 7fbcb0476740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x55b634f6a320 con 0x55b634cbb1b0 2024-08-31T04:30:15.949 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:15.946+0000 7fbcb0476740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x55b635062c80 con 0x55b634c922f0 2024-08-31T04:30:15.949 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:15.946+0000 7fbcb0476740 10 client.0 _ll_register_callbacks cb 0x55b634f706a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:30:15.949 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:15.947+0000 7fbca1e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b634c9a4d0 0x55b63506ad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:30:15.949 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:15.947+0000 7fbca2800640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b634c922f0 0x55b63506a690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:30:15.949 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:15.947+0000 7fbca2800640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b634c922f0 0x55b63506a690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.50:52040/0 (socket says 172.21.15.50:52040) 2024-08-31T04:30:15.949 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:15.947+0000 7fbca3200640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b634cbb1b0 0x55b63506b8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:30:15.949 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:15.947+0000 7fbca2800640 1 -- 172.21.15.50:0/342531175 learned_addr learned my addr 172.21.15.50:0/342531175 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:30:15.949 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:15.947+0000 7fbca2800640 1 -- 172.21.15.50:0/342531175 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b634cbb1b0 msgr2=0x55b63506b8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:30:15.949 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:15.947+0000 7fbca2800640 1 --2- 172.21.15.50:0/342531175 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b634cbb1b0 0x55b63506b8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:15.949 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:15.947+0000 7fbca2800640 1 -- 172.21.15.50:0/342531175 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b634c9a4d0 msgr2=0x55b63506ad50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:30:15.949 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:15.947+0000 7fbca2800640 1 --2- 172.21.15.50:0/342531175 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b634c9a4d0 0x55b63506ad50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:15.949 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:15.947+0000 7fbca2800640 1 -- 172.21.15.50:0/342531175 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b634d26790 con 0x55b634c922f0 2024-08-31T04:30:15.949 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:15.947+0000 7fbca3200640 1 --2- 172.21.15.50:0/342531175 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b634cbb1b0 0x55b63506b8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:30:15.951 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:15.947+0000 7fbca2800640 1 --2- 172.21.15.50:0/342531175 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b634c922f0 0x55b63506a690 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fbc9400f640 tx=0x7fbc9400f670 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5fc2069e777a6e23 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:30:15.951 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:15.947+0000 7fbc83e00640 10 client.0 ms_handle_connect on v2:172.21.15.177:3300/0 2024-08-31T04:30:15.951 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:15.948+0000 7fbc83e00640 1 -- 172.21.15.50:0/342531175 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc94027060 con 0x55b634c922f0 2024-08-31T04:30:15.951 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:15.948+0000 7fbc83e00640 1 -- 172.21.15.50:0/342531175 <== mon.1 v2:172.21.15.177:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8219+0+0 (secure 0 0 0) 0x7fbc9400f790 con 0x55b634c922f0 2024-08-31T04:30:15.951 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:15.948+0000 7fbcb0476740 1 -- 172.21.15.50:0/342531175 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbc9400faf0 con 0x55b634c922f0 2024-08-31T04:30:15.951 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:15.948+0000 7fbc83e00640 1 -- 172.21.15.50:0/342531175 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7fbc9401e040 con 0x55b634c922f0 2024-08-31T04:30:15.951 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:15.948+0000 7fbcb0476740 10 client.26017 fetch_fsmap learned FSMap version 42 2024-08-31T04:30:15.951 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:15.948+0000 7fbcb0476740 1 -- 172.21.15.50:0/342531175 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x55b634d9f620 con 0x55b634c922f0 2024-08-31T04:30:15.951 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:15.949+0000 7fbc83e00640 1 -- 172.21.15.50:0/342531175 <== mon.1 v2:172.21.15.177:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbc9400faf0 con 0x55b634c922f0 2024-08-31T04:30:15.951 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:15.949+0000 7fbc83e00640 1 -- 172.21.15.50:0/342531175 <== mon.1 v2:172.21.15.177:3300/0 5 ==== fsmap(e 42) ==== 8398+0+0 (secure 0 0 0) 0x7fbc94021070 con 0x55b634c922f0 2024-08-31T04:30:15.951 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:15.949+0000 7fbcb0476740 10 client.26017 fetch_fsmap finished waiting for FSMap version 42 2024-08-31T04:30:15.951 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:15.949+0000 7fbcb0476740 10 client.26017 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T04:30:15.952 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:15.949+0000 7fbcb0476740 20 client.26017 populate_metadata read hostname 'smithi050' 2024-08-31T04:30:15.952 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:15.949+0000 7fbcb0476740 1 --2- 172.21.15.50:0/342531175 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x55b634c79d80 0x55b635077b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:30:15.952 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:15.949+0000 7fbcb0476740 4 client.26017 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T04:30:15.952 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:15.949+0000 7fbcb0476740 1 -- 172.21.15.50:0/342531175 --> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b634fd5ec0 con 0x55b634c79d80 2024-08-31T04:30:15.952 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:15.949+0000 7fbca1e00640 1 --2- 172.21.15.50:0/342531175 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x55b634c79d80 0x55b635077b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:30:15.953 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:15.950+0000 7fbca1e00640 1 --2- 172.21.15.50:0/342531175 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x55b634c79d80 0x55b635077b10 crc :-1 s=READY pgs=106 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8f2961508ec4b129 server_cookie=b3e30ac4ae267002 in_seq=0 out_seq=0 2024-08-31T04:30:15.953 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:15.950+0000 7fbc83e00640 10 client.26017 ms_handle_connect on v2:172.21.15.133:6838/2526402262 2024-08-31T04:30:15.953 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:15.951+0000 7fbc83e00640 1 -- 172.21.15.50:0/342531175 <== mds.0 v2:172.21.15.133:6838/2526402262 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55b634fd5ec0 con 0x55b634c79d80 2024-08-31T04:30:15.953 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:15.951+0000 7fbc83e00640 10 client.26017 handle_command_reply: tid=0 2024-08-31T04:30:15.953 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:15.951+0000 7fbcb0476740 1 client.26017 shutdown 2024-08-31T04:30:15.954 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:15.951+0000 7fbcb0476740 1 -- 172.21.15.50:0/342531175 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b634c922f0 msgr2=0x55b63506a690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:30:15.954 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:15.951+0000 7fbcb0476740 1 --2- 172.21.15.50:0/342531175 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b634c922f0 0x55b63506a690 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fbc9400f640 tx=0x7fbc9400f670 comp rx=0 tx=0).stop 2024-08-31T04:30:15.954 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:15.951+0000 7fbcb0476740 1 -- 172.21.15.50:0/342531175 shutdown_connections 2024-08-31T04:30:15.954 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:15.951+0000 7fbcb0476740 1 --2- 172.21.15.50:0/342531175 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x55b634c79d80 0x55b635077b10 crc :-1 s=READY pgs=106 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:15.954 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:15.951+0000 7fbcb0476740 1 --2- 172.21.15.50:0/342531175 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b634cbb1b0 0x55b63506b8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:15.954 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:15.951+0000 7fbc83e00640 0 client.26017 ms_handle_reset on v2:172.21.15.133:6838/2526402262 2024-08-31T04:30:15.954 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:15.951+0000 7fbcb0476740 1 --2- 172.21.15.50:0/342531175 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b634c9a4d0 0x55b63506ad50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:15.954 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:15.951+0000 7fbcb0476740 1 --2- 172.21.15.50:0/342531175 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b634c922f0 0x55b63506a690 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:15.954 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:15.951+0000 7fbcb0476740 1 -- 172.21.15.50:0/342531175 >> 172.21.15.50:0/342531175 conn(0x55b634caf300 msgr2=0x55b63505af40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:30:15.954 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:15.952+0000 7fbcb0476740 1 -- 172.21.15.50:0/342531175 shutdown_connections 2024-08-31T04:30:15.954 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:15.952+0000 7fbcb0476740 1 -- 172.21.15.50:0/342531175 wait complete. 2024-08-31T04:30:15.954 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:15.952+0000 7fbcb0476740 20 client.26017 trim_cache size 0 max 16384 2024-08-31T04:30:15.983 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:15.982+0000 7fbcb0476740 1 Processor -- start 2024-08-31T04:30:15.983 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:15.982+0000 7fbcb0476740 1 -- start start 2024-08-31T04:30:15.984 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:15.982+0000 7fbcb0476740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b634c922f0 0x55b63505ce70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:30:15.984 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:15.982+0000 7fbcb0476740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b634c9a4d0 0x55b6350727a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:30:15.984 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:15.982+0000 7fbcb0476740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b634cbb1b0 0x55b63505d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:30:15.984 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:15.982+0000 7fbcb0476740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fbca41b1150 con 0x55b634cbb1b0 2024-08-31T04:30:15.985 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:15.982+0000 7fbcb0476740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7fbca41b2d80 con 0x55b634c922f0 2024-08-31T04:30:15.985 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:15.982+0000 7fbcb0476740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fbca41b1820 con 0x55b634c9a4d0 2024-08-31T04:30:15.985 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:15.983+0000 7fbca3200640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b634cbb1b0 0x55b63505d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:30:15.985 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:15.983+0000 7fbca1e00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b634c9a4d0 0x55b6350727a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:30:15.985 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:15.983+0000 7fbca1e00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b634c9a4d0 0x55b6350727a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.50:52044/0 (socket says 172.21.15.50:52044) 2024-08-31T04:30:15.985 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:15.983+0000 7fbca3200640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b634cbb1b0 0x55b63505d3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50008/0 (socket says 172.21.15.50:50008) 2024-08-31T04:30:15.985 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:15.983+0000 7fbca1e00640 1 -- 172.21.15.50:0/2870128359 learned_addr learned my addr 172.21.15.50:0/2870128359 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:30:15.985 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:15.983+0000 7fbca2800640 1 --2- 172.21.15.50:0/2870128359 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b634c922f0 0x55b63505ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:30:15.986 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:15.983+0000 7fbca1e00640 1 -- 172.21.15.50:0/2870128359 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b634c922f0 msgr2=0x55b63505ce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:30:15.986 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:15.983+0000 7fbca1e00640 1 --2- 172.21.15.50:0/2870128359 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b634c922f0 0x55b63505ce70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:15.986 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:15.983+0000 7fbca1e00640 1 -- 172.21.15.50:0/2870128359 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b634cbb1b0 msgr2=0x55b63505d3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:30:15.986 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:15.983+0000 7fbca1e00640 1 --2- 172.21.15.50:0/2870128359 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b634cbb1b0 0x55b63505d3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:15.986 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:15.984+0000 7fbca1e00640 1 -- 172.21.15.50:0/2870128359 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b635056c40 con 0x55b634c9a4d0 2024-08-31T04:30:15.986 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:15.984+0000 7fbca1e00640 1 --2- 172.21.15.50:0/2870128359 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b634c9a4d0 0x55b6350727a0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fbc900c83d0 tx=0x7fbc90107dc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2c86498c16749770 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:30:15.986 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:15.984+0000 7fbc8ea00640 1 -- 172.21.15.50:0/2870128359 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc90049040 con 0x55b634c9a4d0 2024-08-31T04:30:15.986 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:15.984+0000 7fbc8ea00640 1 -- 172.21.15.50:0/2870128359 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbc90031e00 con 0x55b634c9a4d0 2024-08-31T04:30:15.987 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:15.984+0000 7fbc8ea00640 1 -- 172.21.15.50:0/2870128359 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc900d0bc0 con 0x55b634c9a4d0 2024-08-31T04:30:15.987 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:15.985+0000 7fbcb0476740 1 -- 172.21.15.50:0/2870128359 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b634c9a4d0 msgr2=0x55b6350727a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:30:15.987 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:15.985+0000 7fbcb0476740 1 --2- 172.21.15.50:0/2870128359 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b634c9a4d0 0x55b6350727a0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fbc900c83d0 tx=0x7fbc90107dc0 comp rx=0 tx=0).stop 2024-08-31T04:30:15.988 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:15.985+0000 7fbcb0476740 1 -- 172.21.15.50:0/2870128359 shutdown_connections 2024-08-31T04:30:15.988 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:15.985+0000 7fbcb0476740 1 --2- 172.21.15.50:0/2870128359 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b634c9a4d0 0x55b6350727a0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:15.988 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:15.985+0000 7fbcb0476740 1 --2- 172.21.15.50:0/2870128359 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b634cbb1b0 0x55b63505d3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:15.988 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:15.985+0000 7fbcb0476740 1 --2- 172.21.15.50:0/2870128359 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b634c922f0 0x55b63505ce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:15.988 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:15.985+0000 7fbcb0476740 1 -- 172.21.15.50:0/2870128359 >> 172.21.15.50:0/2870128359 conn(0x55b634caf300 msgr2=0x55b635061de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:30:15.988 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:15.986+0000 7fbcb0476740 1 -- 172.21.15.50:0/2870128359 shutdown_connections 2024-08-31T04:30:15.988 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:15.986+0000 7fbcb0476740 1 -- 172.21.15.50:0/2870128359 wait complete. 2024-08-31T04:30:15.988 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:15.986+0000 7fbcb0476740 1 -- start start 2024-08-31T04:30:15.990 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:15.987+0000 7fbcb0476740 1 Processor -- start 2024-08-31T04:30:15.991 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:15.987+0000 7fbcb0476740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b634c922f0 0x55b6350725b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:30:15.991 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:15.987+0000 7fbcb0476740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b634c9a4d0 0x55b635071270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:30:15.991 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:15.987+0000 7fbcb0476740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b634cbb1b0 0x55b635071910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:30:15.991 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:15.987+0000 7fbcb0476740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fbca41b26b0 con 0x55b634c9a4d0 2024-08-31T04:30:15.991 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:15.987+0000 7fbcb0476740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7fbca41b1fb0 con 0x55b634cbb1b0 2024-08-31T04:30:15.991 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:15.987+0000 7fbcb0476740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fbca41af130 con 0x55b634c922f0 2024-08-31T04:30:15.991 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:15.987+0000 7fbcb0476740 10 client.0 _ll_register_callbacks cb 0x7fbc9010b400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:30:15.991 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:15.987+0000 7fbca2800640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b634c922f0 0x55b6350725b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:30:15.991 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:15.987+0000 7fbca2800640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b634c922f0 0x55b6350725b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.50:52060/0 (socket says 172.21.15.50:52060) 2024-08-31T04:30:15.991 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:15.987+0000 7fbca2800640 1 -- 172.21.15.50:0/4149123848 learned_addr learned my addr 172.21.15.50:0/4149123848 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:30:15.991 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:15.987+0000 7fbca1e00640 1 --2- 172.21.15.50:0/4149123848 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b634c9a4d0 0x55b635071270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:30:15.991 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:15.988+0000 7fbca3200640 1 --2- 172.21.15.50:0/4149123848 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b634cbb1b0 0x55b635071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:30:15.992 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:15.988+0000 7fbca2800640 1 -- 172.21.15.50:0/4149123848 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b634cbb1b0 msgr2=0x55b635071910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:30:15.992 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:15.988+0000 7fbca2800640 1 --2- 172.21.15.50:0/4149123848 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b634cbb1b0 0x55b635071910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:15.992 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:15.988+0000 7fbca2800640 1 -- 172.21.15.50:0/4149123848 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b634c9a4d0 msgr2=0x55b635071270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:30:15.992 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:15.988+0000 7fbca2800640 1 --2- 172.21.15.50:0/4149123848 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b634c9a4d0 0x55b635071270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:15.992 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:15.988+0000 7fbca2800640 1 -- 172.21.15.50:0/4149123848 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b6350720a0 con 0x55b634c922f0 2024-08-31T04:30:15.992 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:15.988+0000 7fbca2800640 1 --2- 172.21.15.50:0/4149123848 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b634c922f0 0x55b6350725b0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fbc94009250 tx=0x7fbc94004a80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3e276955224bf645 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:30:15.992 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:15.988+0000 7fbc83e00640 10 client.0 ms_handle_connect on v2:172.21.15.177:3300/0 2024-08-31T04:30:15.992 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:15.988+0000 7fbc83e00640 1 -- 172.21.15.50:0/4149123848 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc94032070 con 0x55b634c922f0 2024-08-31T04:30:15.992 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:15.988+0000 7fbc83e00640 1 -- 172.21.15.50:0/4149123848 <== mon.1 v2:172.21.15.177:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8219+0+0 (secure 0 0 0) 0x7fbc94004040 con 0x55b634c922f0 2024-08-31T04:30:15.992 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:15.988+0000 7fbcb0476740 1 -- 172.21.15.50:0/4149123848 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55b634fd1960 con 0x55b634c922f0 2024-08-31T04:30:15.993 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:15.989+0000 7fbc83e00640 1 -- 172.21.15.50:0/4149123848 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7fbc94027040 con 0x55b634c922f0 2024-08-31T04:30:15.993 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:15.989+0000 7fbcb0476740 10 client.26023 fetch_fsmap learned FSMap version 42 2024-08-31T04:30:15.993 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:15.989+0000 7fbcb0476740 1 -- 172.21.15.50:0/4149123848 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x55b6350e25e0 con 0x55b634c922f0 2024-08-31T04:30:15.993 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:15.989+0000 7fbc83e00640 1 -- 172.21.15.50:0/4149123848 <== mon.1 v2:172.21.15.177:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x55b634fd1960 con 0x55b634c922f0 2024-08-31T04:30:15.993 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:15.989+0000 7fbc83e00640 1 -- 172.21.15.50:0/4149123848 <== mon.1 v2:172.21.15.177:3300/0 5 ==== fsmap(e 42) ==== 8398+0+0 (secure 0 0 0) 0x7fbc94021070 con 0x55b634c922f0 2024-08-31T04:30:15.993 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:15.989+0000 7fbcb0476740 10 client.26023 fetch_fsmap finished waiting for FSMap version 42 2024-08-31T04:30:15.993 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:15.989+0000 7fbcb0476740 10 client.26023 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T04:30:15.993 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:15.989+0000 7fbcb0476740 20 client.26023 populate_metadata read hostname 'smithi050' 2024-08-31T04:30:15.993 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:15.989+0000 7fbcb0476740 1 --2- 172.21.15.50:0/4149123848 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x55b634c4f1c0 0x55b6350e4fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:30:15.993 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:15.989+0000 7fbcb0476740 4 client.26023 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-31T04:30:15.993 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:15.989+0000 7fbcb0476740 1 -- 172.21.15.50:0/4149123848 --> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55b634fcf0a0 con 0x55b634c4f1c0 2024-08-31T04:30:15.994 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:15.990+0000 7fbca1e00640 1 --2- 172.21.15.50:0/4149123848 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x55b634c4f1c0 0x55b6350e4fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:30:15.994 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:15.990+0000 7fbca1e00640 1 --2- 172.21.15.50:0/4149123848 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x55b634c4f1c0 0x55b6350e4fd0 crc :-1 s=READY pgs=107 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6d2dd40702c09742 server_cookie=f3f2c387be3ee9ae in_seq=0 out_seq=0 2024-08-31T04:30:15.994 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:15.990+0000 7fbc83e00640 10 client.26023 ms_handle_connect on v2:172.21.15.133:6838/2526402262 2024-08-31T04:30:16.091 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:16.089+0000 7fbc83e00640 1 -- 172.21.15.50:0/4149123848 <== mds.0 v2:172.21.15.133:6838/2526402262 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55b634fcf0a0 con 0x55b634c4f1c0 2024-08-31T04:30:16.092 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:16.089+0000 7fbc83e00640 10 client.26023 handle_command_reply: tid=0 2024-08-31T04:30:16.092 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:16.089+0000 7fbcb0476740 1 client.26023 shutdown 2024-08-31T04:30:16.092 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:16.089+0000 7fbcb0476740 1 -- 172.21.15.50:0/4149123848 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b634c922f0 msgr2=0x55b6350725b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:30:16.092 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:16.090+0000 7fbcb0476740 1 --2- 172.21.15.50:0/4149123848 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b634c922f0 0x55b6350725b0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fbc94009250 tx=0x7fbc94004a80 comp rx=0 tx=0).stop 2024-08-31T04:30:16.092 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:16.090+0000 7fbcb0476740 1 -- 172.21.15.50:0/4149123848 shutdown_connections 2024-08-31T04:30:16.092 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:16.090+0000 7fbcb0476740 1 --2- 172.21.15.50:0/4149123848 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x55b634c4f1c0 0x55b6350e4fd0 crc :-1 s=READY pgs=107 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:16.092 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:16.090+0000 7fbcb0476740 1 --2- 172.21.15.50:0/4149123848 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b634cbb1b0 0x55b635071910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:16.092 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:16.090+0000 7fbcb0476740 1 --2- 172.21.15.50:0/4149123848 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b634c9a4d0 0x55b635071270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:16.092 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:16.090+0000 7fbcb0476740 1 --2- 172.21.15.50:0/4149123848 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b634c922f0 0x55b6350725b0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:16.092 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:16.090+0000 7fbcb0476740 1 -- 172.21.15.50:0/4149123848 >> 172.21.15.50:0/4149123848 conn(0x55b634caf300 msgr2=0x55b635065060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:30:16.092 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:16.090+0000 7fbc83e00640 0 client.26023 ms_handle_reset on v2:172.21.15.133:6838/2526402262 2024-08-31T04:30:16.092 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:16.090+0000 7fbcb0476740 1 -- 172.21.15.50:0/4149123848 shutdown_connections 2024-08-31T04:30:16.092 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:16.090+0000 7fbcb0476740 1 -- 172.21.15.50:0/4149123848 wait complete. 2024-08-31T04:30:16.093 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:16.090+0000 7fbcb0476740 20 client.26023 trim_cache size 0 max 16384 2024-08-31T04:30:16.093 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout:{ 2024-08-31T04:30:16.093 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout: "message": "", 2024-08-31T04:30:16.093 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout: "return_code": 0 2024-08-31T04:30:16.093 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout:} 2024-08-31T04:30:16.094 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:16.091+0000 7fbca8a00640 1 -- 172.21.15.50:0/1942408379 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fbc880b4b30 msgr2=0x7fbc880b7040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:30:16.094 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:16.091+0000 7fbca8a00640 1 --2- 172.21.15.50:0/1942408379 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fbc880b4b30 0x7fbc880b7040 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fbc9c005fd0 tx=0x7fbc9c009500 comp rx=0 tx=0).stop 2024-08-31T04:30:16.094 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:16.091+0000 7fbca8a00640 1 -- 172.21.15.50:0/1942408379 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbca4076e90 msgr2=0x7fbca41a07f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:30:16.094 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:16.091+0000 7fbca8a00640 1 --2- 172.21.15.50:0/1942408379 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbca4076e90 0x7fbca41a07f0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fbc90031440 tx=0x7fbc90003c10 comp rx=0 tx=0).stop 2024-08-31T04:30:16.094 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:16.091+0000 7fbca8a00640 1 -- 172.21.15.50:0/1942408379 shutdown_connections 2024-08-31T04:30:16.094 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:16.091+0000 7fbca8a00640 1 --2- 172.21.15.50:0/1942408379 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fbc880b4b30 0x7fbc880b7040 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:16.094 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:16.091+0000 7fbca8a00640 1 --2- 172.21.15.50:0/1942408379 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbca410fa00 0x7fbca41a13a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:16.094 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:16.091+0000 7fbca8a00640 1 --2- 172.21.15.50:0/1942408379 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbca4076e90 0x7fbca41a07f0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:16.094 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:16.091+0000 7fbca8a00640 1 --2- 172.21.15.50:0/1942408379 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbca4075a90 0x7fbca41a0180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:16.095 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:16.091+0000 7fbca8a00640 1 -- 172.21.15.50:0/1942408379 >> 172.21.15.50:0/1942408379 conn(0x7fbca40febc0 msgr2=0x7fbca40ff200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:30:16.095 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:16.091+0000 7fbca8a00640 1 -- 172.21.15.50:0/1942408379 shutdown_connections 2024-08-31T04:30:16.095 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:16.091+0000 7fbca8a00640 1 -- 172.21.15.50:0/1942408379 wait complete. 2024-08-31T04:30:17.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:30:17 smithi050 ceph-mon[17259]: pgmap v590: 97 pgs: 97 active+clean; 1.5 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 126 KiB/s rd, 2.8 MiB/s wr, 209 op/s 2024-08-31T04:30:17.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:30:17 smithi177 ceph-mon[22025]: pgmap v590: 97 pgs: 97 active+clean; 1.5 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 126 KiB/s rd, 2.8 MiB/s wr, 209 op/s 2024-08-31T04:30:17.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:30:17 smithi133 ceph-mon[22177]: pgmap v590: 97 pgs: 97 active+clean; 1.5 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 126 KiB/s rd, 2.8 MiB/s wr, 209 op/s 2024-08-31T04:30:19.659 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:30:19 smithi050 ceph-mon[17259]: pgmap v591: 97 pgs: 97 active+clean; 1.5 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 140 KiB/s rd, 3.5 MiB/s wr, 244 op/s 2024-08-31T04:30:19.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:30:19 smithi177 ceph-mon[22025]: pgmap v591: 97 pgs: 97 active+clean; 1.5 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 140 KiB/s rd, 3.5 MiB/s wr, 244 op/s 2024-08-31T04:30:19.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:30:19 smithi133 ceph-mon[22177]: pgmap v591: 97 pgs: 97 active+clean; 1.5 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 140 KiB/s rd, 3.5 MiB/s wr, 244 op/s 2024-08-31T04:30:21.630 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:30:21 smithi050 ceph-mon[17259]: pgmap v592: 97 pgs: 97 active+clean; 1.5 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 139 KiB/s rd, 4.0 MiB/s wr, 277 op/s 2024-08-31T04:30:21.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:30:21 smithi177 ceph-mon[22025]: pgmap v592: 97 pgs: 97 active+clean; 1.5 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 139 KiB/s rd, 4.0 MiB/s wr, 277 op/s 2024-08-31T04:30:21.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:30:21 smithi133 ceph-mon[22177]: pgmap v592: 97 pgs: 97 active+clean; 1.5 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 139 KiB/s rd, 4.0 MiB/s wr, 277 op/s 2024-08-31T04:30:23.647 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:30:23 smithi050 ceph-mon[17259]: pgmap v593: 97 pgs: 97 active+clean; 1.5 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 244 KiB/s rd, 4.1 MiB/s wr, 300 op/s 2024-08-31T04:30:23.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:30:23 smithi177 ceph-mon[22025]: pgmap v593: 97 pgs: 97 active+clean; 1.5 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 244 KiB/s rd, 4.1 MiB/s wr, 300 op/s 2024-08-31T04:30:23.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:30:23 smithi133 ceph-mon[22177]: pgmap v593: 97 pgs: 97 active+clean; 1.5 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 244 KiB/s rd, 4.1 MiB/s wr, 300 op/s 2024-08-31T04:30:25.595 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:30:25 smithi050 ceph-mon[17259]: pgmap v594: 97 pgs: 97 active+clean; 1.5 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 237 KiB/s rd, 3.1 MiB/s wr, 219 op/s 2024-08-31T04:30:25.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:30:25 smithi177 ceph-mon[22025]: pgmap v594: 97 pgs: 97 active+clean; 1.5 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 237 KiB/s rd, 3.1 MiB/s wr, 219 op/s 2024-08-31T04:30:25.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:30:25 smithi133 ceph-mon[22177]: pgmap v594: 97 pgs: 97 active+clean; 1.5 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 237 KiB/s rd, 3.1 MiB/s wr, 219 op/s 2024-08-31T04:30:27.542 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:30:27 smithi050 ceph-mon[17259]: pgmap v595: 97 pgs: 97 active+clean; 1.5 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 238 KiB/s rd, 2.3 MiB/s wr, 164 op/s 2024-08-31T04:30:27.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:30:27 smithi177 ceph-mon[22025]: pgmap v595: 97 pgs: 97 active+clean; 1.5 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 238 KiB/s rd, 2.3 MiB/s wr, 164 op/s 2024-08-31T04:30:27.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:30:27 smithi133 ceph-mon[22177]: pgmap v595: 97 pgs: 97 active+clean; 1.5 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 238 KiB/s rd, 2.3 MiB/s wr, 164 op/s 2024-08-31T04:30:29.286 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:29.280+0000 7f6f78a00640 1 -- 172.21.15.50:0/2232205721 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6f74076e90 msgr2=0x7f6f74075550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:30:29.287 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:29.280+0000 7f6f78a00640 1 --2- 172.21.15.50:0/2232205721 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6f74076e90 0x7f6f74075550 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f6f64009900 tx=0x7f6f6402a3f0 comp rx=0 tx=0).stop 2024-08-31T04:30:29.287 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:29.280+0000 7f6f78a00640 1 -- 172.21.15.50:0/2232205721 shutdown_connections 2024-08-31T04:30:29.287 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:29.280+0000 7f6f78a00640 1 --2- 172.21.15.50:0/2232205721 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6f74075a90 0x7f6f74075ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:29.287 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:29.280+0000 7f6f78a00640 1 --2- 172.21.15.50:0/2232205721 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6f7410b210 0x7f6f7410d6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:29.288 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:29.280+0000 7f6f78a00640 1 --2- 172.21.15.50:0/2232205721 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6f74076e90 0x7f6f74075550 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:29.288 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:29.280+0000 7f6f78a00640 1 -- 172.21.15.50:0/2232205721 >> 172.21.15.50:0/2232205721 conn(0x7f6f740febc0 msgr2=0x7f6f74101070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:30:29.288 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:29.280+0000 7f6f78a00640 1 -- 172.21.15.50:0/2232205721 shutdown_connections 2024-08-31T04:30:29.288 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:29.280+0000 7f6f78a00640 1 -- 172.21.15.50:0/2232205721 wait complete. 2024-08-31T04:30:29.289 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:29.281+0000 7f6f78a00640 1 Processor -- start 2024-08-31T04:30:29.289 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:29.281+0000 7f6f78a00640 1 -- start start 2024-08-31T04:30:29.289 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:29.282+0000 7f6f78a00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6f74075a90 0x7f6f7419bd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:30:29.289 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:29.282+0000 7f6f78a00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6f74076e90 0x7f6f7419c390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:30:29.289 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:29.282+0000 7f6f78a00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6f7410b210 0x7f6f7419cf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:30:29.290 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:29.282+0000 7f6f78a00640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f6f74111100 con 0x7f6f74076e90 2024-08-31T04:30:29.290 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:29.282+0000 7f6f78a00640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f6f74110f80 con 0x7f6f74075a90 2024-08-31T04:30:29.290 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:29.282+0000 7f6f78a00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f6f74111280 con 0x7f6f7410b210 2024-08-31T04:30:29.290 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:29.282+0000 7f6f72800640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6f74075a90 0x7f6f7419bd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:30:29.290 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:29.282+0000 7f6f71e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6f74076e90 0x7f6f7419c390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:30:29.290 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:29.282+0000 7f6f72800640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6f74075a90 0x7f6f7419bd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.50:49334/0 (socket says 172.21.15.50:49334) 2024-08-31T04:30:29.291 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:29.282+0000 7f6f72800640 1 -- 172.21.15.50:0/1621318975 learned_addr learned my addr 172.21.15.50:0/1621318975 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:30:29.291 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:29.282+0000 7f6f73200640 1 --2- 172.21.15.50:0/1621318975 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6f7410b210 0x7f6f7419cf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:30:29.291 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:29.282+0000 7f6f71e00640 1 -- 172.21.15.50:0/1621318975 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6f7410b210 msgr2=0x7f6f7419cf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:30:29.291 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:29.282+0000 7f6f71e00640 1 --2- 172.21.15.50:0/1621318975 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6f7410b210 0x7f6f7419cf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:29.291 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:29.282+0000 7f6f71e00640 1 -- 172.21.15.50:0/1621318975 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6f74075a90 msgr2=0x7f6f7419bd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:30:29.292 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:29.282+0000 7f6f71e00640 1 --2- 172.21.15.50:0/1621318975 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6f74075a90 0x7f6f7419bd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:29.292 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:29.283+0000 7f6f71e00640 1 -- 172.21.15.50:0/1621318975 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f7419d760 con 0x7f6f74076e90 2024-08-31T04:30:29.292 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:29.283+0000 7f6f71e00640 1 --2- 172.21.15.50:0/1621318975 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6f74076e90 0x7f6f7419c390 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f6f6000e9f0 tx=0x7f6f6000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:30:29.292 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:29.283+0000 7f6f6b400640 1 -- 172.21.15.50:0/1621318975 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f6000ccc0 con 0x7f6f74076e90 2024-08-31T04:30:29.292 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:29.283+0000 7f6f6b400640 1 -- 172.21.15.50:0/1621318975 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6f60005020 con 0x7f6f74076e90 2024-08-31T04:30:29.292 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:29.283+0000 7f6f78a00640 1 -- 172.21.15.50:0/1621318975 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6f7419da50 con 0x7f6f74076e90 2024-08-31T04:30:29.293 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:29.283+0000 7f6f6b400640 1 -- 172.21.15.50:0/1621318975 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f60004a00 con 0x7f6f74076e90 2024-08-31T04:30:29.293 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:29.283+0000 7f6f78a00640 1 -- 172.21.15.50:0/1621318975 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6f741a4140 con 0x7f6f74076e90 2024-08-31T04:30:29.298 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:29.287+0000 7f6f805fd740 1 Processor -- start 2024-08-31T04:30:29.298 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:29.287+0000 7f6f805fd740 1 -- start start 2024-08-31T04:30:29.298 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:29.288+0000 7f6f805fd740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559a0ce0d1b0 0x559a0d1b2fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:30:29.298 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:29.288+0000 7f6f805fd740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559a0cde42f0 0x559a0d1b3610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:30:29.298 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:29.288+0000 7f6f805fd740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559a0cdec4d0 0x559a0d1b4160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:30:29.298 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:29.288+0000 7f6f805fd740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x559a0d125f70 con 0x559a0ce0d1b0 2024-08-31T04:30:29.298 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:29.288+0000 7f6f805fd740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x559a0d115500 con 0x559a0cde42f0 2024-08-31T04:30:29.299 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:29.288+0000 7f6f805fd740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x559a0d1194b0 con 0x559a0cdec4d0 2024-08-31T04:30:29.299 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:29.289+0000 7f6f72800640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559a0cde42f0 0x559a0d1b3610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:30:29.299 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:29.289+0000 7f6f73200640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559a0ce0d1b0 0x559a0d1b2fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:30:29.299 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:29.289+0000 7f6f73200640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559a0ce0d1b0 0x559a0d1b2fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:55038/0 (socket says 172.21.15.50:55038) 2024-08-31T04:30:29.299 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:29.289+0000 7f6f73200640 1 -- 172.21.15.50:0/2883817078 learned_addr learned my addr 172.21.15.50:0/2883817078 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:30:29.299 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:29.289+0000 7f6f73200640 1 -- 172.21.15.50:0/2883817078 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559a0cdec4d0 msgr2=0x559a0d1b4160 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-31T04:30:29.299 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:29.289+0000 7f6f73200640 1 --2- 172.21.15.50:0/2883817078 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559a0cdec4d0 0x559a0d1b4160 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:29.299 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:29.289+0000 7f6f73200640 1 -- 172.21.15.50:0/2883817078 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559a0cde42f0 msgr2=0x559a0d1b3610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:30:29.299 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:29.289+0000 7f6f73200640 1 --2- 172.21.15.50:0/2883817078 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559a0cde42f0 0x559a0d1b3610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:29.299 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:29.289+0000 7f6f73200640 1 -- 172.21.15.50:0/2883817078 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559a0d0cfc10 con 0x559a0ce0d1b0 2024-08-31T04:30:29.299 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:29.289+0000 7f6f72800640 1 --2- 172.21.15.50:0/2883817078 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559a0cde42f0 0x559a0d1b3610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:30:29.299 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:29.289+0000 7f6f6b400640 1 -- 172.21.15.50:0/1621318975 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 18) ==== 152577+0+0 (secure 0 0 0) 0x7f6f60004ba0 con 0x7f6f74076e90 2024-08-31T04:30:29.300 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:29.289+0000 7f6f73200640 1 --2- 172.21.15.50:0/2883817078 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559a0ce0d1b0 0x559a0d1b2fa0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f6f6c009fd0 tx=0x7f6f6c0118d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4394054b47803498 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:30:29.300 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:29.290+0000 7f6f5f400640 1 -- 172.21.15.50:0/2883817078 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f6c004d20 con 0x559a0ce0d1b0 2024-08-31T04:30:29.300 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:29.290+0000 7f6f5f400640 1 -- 172.21.15.50:0/2883817078 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6f6c004050 con 0x559a0ce0d1b0 2024-08-31T04:30:29.300 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:29.290+0000 7f6f5f400640 1 -- 172.21.15.50:0/2883817078 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f6c005220 con 0x559a0ce0d1b0 2024-08-31T04:30:29.300 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:29.291+0000 7f6f805fd740 1 -- 172.21.15.50:0/2883817078 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559a0ce0d1b0 msgr2=0x559a0d1b2fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:30:29.300 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:29.291+0000 7f6f805fd740 1 --2- 172.21.15.50:0/2883817078 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559a0ce0d1b0 0x559a0d1b2fa0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f6f6c009fd0 tx=0x7f6f6c0118d0 comp rx=0 tx=0).stop 2024-08-31T04:30:29.300 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:29.291+0000 7f6f805fd740 1 -- 172.21.15.50:0/2883817078 shutdown_connections 2024-08-31T04:30:29.300 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:29.291+0000 7f6f805fd740 1 --2- 172.21.15.50:0/2883817078 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559a0cdec4d0 0x559a0d1b4160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:29.300 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:29.291+0000 7f6f805fd740 1 --2- 172.21.15.50:0/2883817078 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559a0cde42f0 0x559a0d1b3610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:29.300 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:29.291+0000 7f6f805fd740 1 --2- 172.21.15.50:0/2883817078 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559a0ce0d1b0 0x559a0d1b2fa0 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:29.300 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:29.291+0000 7f6f805fd740 1 -- 172.21.15.50:0/2883817078 >> 172.21.15.50:0/2883817078 conn(0x559a0ce01300 msgr2=0x559a0d1aea30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:30:29.300 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:29.291+0000 7f6f805fd740 1 -- 172.21.15.50:0/2883817078 shutdown_connections 2024-08-31T04:30:29.300 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:29.291+0000 7f6f805fd740 1 -- 172.21.15.50:0/2883817078 wait complete. 2024-08-31T04:30:29.301 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:29.291+0000 7f6f6b400640 1 --2- 172.21.15.50:0/1621318975 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f6f580b4a40 0x7f6f580b6f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:30:29.301 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:29.292+0000 7f6f6b400640 1 -- 172.21.15.50:0/1621318975 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8219+0+0 (secure 0 0 0) 0x7f6f600e5120 con 0x7f6f74076e90 2024-08-31T04:30:29.301 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:29.292+0000 7f6f72800640 1 --2- 172.21.15.50:0/1621318975 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f6f580b4a40 0x7f6f580b6f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:30:29.301 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:29.292+0000 7f6f805fd740 1 -- start start 2024-08-31T04:30:29.301 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:29.292+0000 7f6f805fd740 1 Processor -- start 2024-08-31T04:30:29.301 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:29.293+0000 7f6f805fd740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559a0cde42f0 0x559a0d1bc640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:30:29.301 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:29.293+0000 7f6f805fd740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559a0cdec4d0 0x559a0d1bcd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:30:29.301 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:29.293+0000 7f6f805fd740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559a0ce0d1b0 0x559a0d1bd870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:30:29.301 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:29.293+0000 7f6f805fd740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x559a0d04eab0 con 0x559a0cde42f0 2024-08-31T04:30:29.301 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:29.293+0000 7f6f805fd740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x559a0d0bc320 con 0x559a0ce0d1b0 2024-08-31T04:30:29.301 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:29.293+0000 7f6f805fd740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x559a0d1b4c80 con 0x559a0cdec4d0 2024-08-31T04:30:29.302 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:29.293+0000 7f6f805fd740 10 client.0 _ll_register_callbacks cb 0x559a0d0c26a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:30:29.302 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:29.293+0000 7f6f72800640 1 --2- 172.21.15.50:0/1621318975 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f6f580b4a40 0x7f6f580b6f50 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f6f640096c0 tx=0x7f6f640314a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:30:29.302 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:29.293+0000 7f6f71e00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559a0cdec4d0 0x559a0d1bcd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:30:29.302 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:29.293+0000 7f6f71e00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559a0cdec4d0 0x559a0d1bcd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.50:33284/0 (socket says 172.21.15.50:33284) 2024-08-31T04:30:29.302 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:29.293+0000 7f6f71e00640 1 -- 172.21.15.50:0/2757463739 learned_addr learned my addr 172.21.15.50:0/2757463739 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:30:29.302 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:29.293+0000 7f6f72800640 1 --2- 172.21.15.50:0/2757463739 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559a0cde42f0 0x559a0d1bc640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:30:29.302 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:29.294+0000 7f6f73200640 1 --2- 172.21.15.50:0/2757463739 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559a0ce0d1b0 0x559a0d1bd870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:30:29.302 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:29.294+0000 7f6f71e00640 1 -- 172.21.15.50:0/2757463739 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559a0ce0d1b0 msgr2=0x559a0d1bd870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:30:29.302 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:29.294+0000 7f6f71e00640 1 --2- 172.21.15.50:0/2757463739 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559a0ce0d1b0 0x559a0d1bd870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:29.302 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:29.294+0000 7f6f71e00640 1 -- 172.21.15.50:0/2757463739 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559a0cde42f0 msgr2=0x559a0d1bc640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:30:29.302 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:29.294+0000 7f6f71e00640 1 --2- 172.21.15.50:0/2757463739 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559a0cde42f0 0x559a0d1bc640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:29.302 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:29.294+0000 7f6f71e00640 1 -- 172.21.15.50:0/2757463739 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559a0ce78790 con 0x559a0cdec4d0 2024-08-31T04:30:29.303 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:29.294+0000 7f6f73200640 1 --2- 172.21.15.50:0/2757463739 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559a0ce0d1b0 0x559a0d1bd870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:30:29.303 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:29.294+0000 7f6f72800640 1 --2- 172.21.15.50:0/2757463739 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559a0cde42f0 0x559a0d1bc640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:30:29.303 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:29.294+0000 7f6f71e00640 1 --2- 172.21.15.50:0/2757463739 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559a0cdec4d0 0x559a0d1bcd00 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f6f60009230 tx=0x7f6f600ab330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2d8a963794ee848e server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:30:29.303 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:29.294+0000 7f6f53e00640 10 client.0 ms_handle_connect on v2:172.21.15.177:3300/0 2024-08-31T04:30:29.303 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:29.295+0000 7f6f53e00640 1 -- 172.21.15.50:0/2757463739 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f600d2020 con 0x559a0cdec4d0 2024-08-31T04:30:29.303 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:29.295+0000 7f6f53e00640 1 -- 172.21.15.50:0/2757463739 <== mon.1 v2:172.21.15.177:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8219+0+0 (secure 0 0 0) 0x7f6f600054f0 con 0x559a0cdec4d0 2024-08-31T04:30:29.303 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:29.295+0000 7f6f805fd740 1 -- 172.21.15.50:0/2757463739 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6f6c004050 con 0x559a0cdec4d0 2024-08-31T04:30:29.303 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:29.295+0000 7f6f53e00640 1 -- 172.21.15.50:0/2757463739 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7f6f600c6050 con 0x559a0cdec4d0 2024-08-31T04:30:29.303 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:29.295+0000 7f6f805fd740 10 client.26032 fetch_fsmap learned FSMap version 42 2024-08-31T04:30:29.303 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:29.295+0000 7f6f805fd740 1 -- 172.21.15.50:0/2757463739 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x559a0cef1620 con 0x559a0cdec4d0 2024-08-31T04:30:29.303 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:29.295+0000 7f6f53e00640 1 -- 172.21.15.50:0/2757463739 <== mon.1 v2:172.21.15.177:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6f6c004050 con 0x559a0cdec4d0 2024-08-31T04:30:29.303 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:29.295+0000 7f6f53e00640 1 -- 172.21.15.50:0/2757463739 <== mon.1 v2:172.21.15.177:3300/0 5 ==== fsmap(e 42) ==== 8398+0+0 (secure 0 0 0) 0x7f6f600cebe0 con 0x559a0cdec4d0 2024-08-31T04:30:29.303 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:29.295+0000 7f6f805fd740 10 client.26032 fetch_fsmap finished waiting for FSMap version 42 2024-08-31T04:30:29.304 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:29.295+0000 7f6f805fd740 10 client.26032 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T04:30:29.304 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:29.296+0000 7f6f805fd740 20 client.26032 populate_metadata read hostname 'smithi050' 2024-08-31T04:30:29.304 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:29.296+0000 7f6f805fd740 1 --2- 172.21.15.50:0/2757463739 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x559a0cdcbd80 0x559a0d1c9ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:30:29.304 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:29.296+0000 7f6f805fd740 4 client.26032 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T04:30:29.304 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:29.296+0000 7f6f805fd740 1 -- 172.21.15.50:0/2757463739 --> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559a0d127ec0 con 0x559a0cdcbd80 2024-08-31T04:30:29.304 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:29.296+0000 7f6f72800640 1 --2- 172.21.15.50:0/2757463739 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x559a0cdcbd80 0x559a0d1c9ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:30:29.305 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:29.296+0000 7f6f72800640 1 --2- 172.21.15.50:0/2757463739 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x559a0cdcbd80 0x559a0d1c9ea0 crc :-1 s=READY pgs=108 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=91eee3696d6f1a3b server_cookie=76a57618f744b02c in_seq=0 out_seq=0 2024-08-31T04:30:29.305 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:29.296+0000 7f6f53e00640 10 client.26032 ms_handle_connect on v2:172.21.15.133:6838/2526402262 2024-08-31T04:30:29.305 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:29.297+0000 7f6f53e00640 1 -- 172.21.15.50:0/2757463739 <== mds.0 v2:172.21.15.133:6838/2526402262 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x559a0d127ec0 con 0x559a0cdcbd80 2024-08-31T04:30:29.305 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:29.297+0000 7f6f53e00640 10 client.26032 handle_command_reply: tid=0 2024-08-31T04:30:29.306 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:29.297+0000 7f6f805fd740 1 client.26032 shutdown 2024-08-31T04:30:29.306 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:29.298+0000 7f6f805fd740 1 -- 172.21.15.50:0/2757463739 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559a0cdec4d0 msgr2=0x559a0d1bcd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:30:29.306 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:29.298+0000 7f6f805fd740 1 --2- 172.21.15.50:0/2757463739 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559a0cdec4d0 0x559a0d1bcd00 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f6f60009230 tx=0x7f6f600ab330 comp rx=0 tx=0).stop 2024-08-31T04:30:29.306 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:29.298+0000 7f6f805fd740 1 -- 172.21.15.50:0/2757463739 shutdown_connections 2024-08-31T04:30:29.306 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:29.298+0000 7f6f805fd740 1 --2- 172.21.15.50:0/2757463739 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x559a0cdcbd80 0x559a0d1c9ea0 crc :-1 s=READY pgs=108 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:29.306 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:29.298+0000 7f6f805fd740 1 --2- 172.21.15.50:0/2757463739 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559a0cdec4d0 0x559a0d1bcd00 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:29.306 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:29.298+0000 7f6f805fd740 1 --2- 172.21.15.50:0/2757463739 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559a0ce0d1b0 0x559a0d1bd870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:29.306 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:29.298+0000 7f6f53e00640 0 client.26032 ms_handle_reset on v2:172.21.15.133:6838/2526402262 2024-08-31T04:30:29.306 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:29.298+0000 7f6f805fd740 1 --2- 172.21.15.50:0/2757463739 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559a0cde42f0 0x559a0d1bc640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:29.306 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:29.298+0000 7f6f805fd740 1 -- 172.21.15.50:0/2757463739 >> 172.21.15.50:0/2757463739 conn(0x559a0ce01300 msgr2=0x559a0d1acf40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:30:29.306 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:29.298+0000 7f6f805fd740 1 -- 172.21.15.50:0/2757463739 shutdown_connections 2024-08-31T04:30:29.306 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:29.298+0000 7f6f805fd740 1 -- 172.21.15.50:0/2757463739 wait complete. 2024-08-31T04:30:29.306 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:29.298+0000 7f6f805fd740 20 client.26032 trim_cache size 0 max 16384 2024-08-31T04:30:29.316 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:29.313+0000 7f6f805fd740 1 Processor -- start 2024-08-31T04:30:29.316 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:29.314+0000 7f6f805fd740 1 -- start start 2024-08-31T04:30:29.316 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:29.314+0000 7f6f805fd740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559a0cde42f0 0x559a0d1bbf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:30:29.316 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:29.314+0000 7f6f805fd740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559a0cdec4d0 0x559a0d1b7090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:30:29.317 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:29.314+0000 7f6f805fd740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559a0ce0d1b0 0x559a0d1b75d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:30:29.317 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:29.314+0000 7f6f805fd740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f6f741acd00 con 0x559a0cde42f0 2024-08-31T04:30:29.317 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:29.314+0000 7f6f805fd740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f6f741ae930 con 0x559a0ce0d1b0 2024-08-31T04:30:29.317 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:29.314+0000 7f6f805fd740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f6f741ad3d0 con 0x559a0cdec4d0 2024-08-31T04:30:29.317 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:29.314+0000 7f6f72800640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559a0cde42f0 0x559a0d1bbf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:30:29.317 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:29.314+0000 7f6f72800640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559a0cde42f0 0x559a0d1bbf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:55054/0 (socket says 172.21.15.50:55054) 2024-08-31T04:30:29.317 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:29.314+0000 7f6f72800640 1 -- 172.21.15.50:0/3037796182 learned_addr learned my addr 172.21.15.50:0/3037796182 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:30:29.318 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:29.314+0000 7f6f72800640 1 -- 172.21.15.50:0/3037796182 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559a0cdec4d0 msgr2=0x559a0d1b7090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:30:29.318 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:29.314+0000 7f6f71e00640 1 --2- 172.21.15.50:0/3037796182 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559a0cdec4d0 0x559a0d1b7090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:30:29.318 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:29.315+0000 7f6f72800640 1 --2- 172.21.15.50:0/3037796182 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559a0cdec4d0 0x559a0d1b7090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:29.318 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:29.315+0000 7f6f72800640 1 -- 172.21.15.50:0/3037796182 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559a0ce0d1b0 msgr2=0x559a0d1b75d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:30:29.318 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:29.315+0000 7f6f72800640 1 --2- 172.21.15.50:0/3037796182 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559a0ce0d1b0 0x559a0d1b75d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:29.318 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:29.315+0000 7f6f72800640 1 -- 172.21.15.50:0/3037796182 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559a0d1bdbe0 con 0x559a0cde42f0 2024-08-31T04:30:29.318 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:29.315+0000 7f6f71e00640 1 --2- 172.21.15.50:0/3037796182 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559a0cdec4d0 0x559a0d1b7090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T04:30:29.319 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:29.315+0000 7f6f72800640 1 --2- 172.21.15.50:0/3037796182 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559a0cde42f0 0x559a0d1bbf70 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f6f6402a9e0 tx=0x7f6f64040000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0ce9183102f7f8a server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:30:29.319 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:29.315+0000 7f6f5ea00640 1 -- 172.21.15.50:0/3037796182 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f64035040 con 0x559a0cde42f0 2024-08-31T04:30:29.319 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:29.315+0000 7f6f5ea00640 1 -- 172.21.15.50:0/3037796182 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6f64003e30 con 0x559a0cde42f0 2024-08-31T04:30:29.319 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:29.315+0000 7f6f5ea00640 1 -- 172.21.15.50:0/3037796182 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f6403d820 con 0x559a0cde42f0 2024-08-31T04:30:29.321 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:29.316+0000 7f6f805fd740 1 -- 172.21.15.50:0/3037796182 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559a0cde42f0 msgr2=0x559a0d1bbf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:30:29.321 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:29.316+0000 7f6f805fd740 1 --2- 172.21.15.50:0/3037796182 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559a0cde42f0 0x559a0d1bbf70 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f6f6402a9e0 tx=0x7f6f64040000 comp rx=0 tx=0).stop 2024-08-31T04:30:29.321 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:29.316+0000 7f6f805fd740 1 -- 172.21.15.50:0/3037796182 shutdown_connections 2024-08-31T04:30:29.321 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:29.316+0000 7f6f805fd740 1 --2- 172.21.15.50:0/3037796182 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559a0cdec4d0 0x559a0d1b7090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:29.321 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:29.316+0000 7f6f805fd740 1 --2- 172.21.15.50:0/3037796182 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559a0ce0d1b0 0x559a0d1b75d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:29.321 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:29.316+0000 7f6f805fd740 1 --2- 172.21.15.50:0/3037796182 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559a0cde42f0 0x559a0d1bbf70 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:29.321 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:29.316+0000 7f6f805fd740 1 -- 172.21.15.50:0/3037796182 >> 172.21.15.50:0/3037796182 conn(0x559a0ce01300 msgr2=0x559a0d1bb860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:30:29.322 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:29.317+0000 7f6f805fd740 1 -- 172.21.15.50:0/3037796182 shutdown_connections 2024-08-31T04:30:29.322 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:29.317+0000 7f6f805fd740 1 -- 172.21.15.50:0/3037796182 wait complete. 2024-08-31T04:30:29.322 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:29.317+0000 7f6f805fd740 1 -- start start 2024-08-31T04:30:29.322 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:29.317+0000 7f6f805fd740 1 Processor -- start 2024-08-31T04:30:29.322 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:29.318+0000 7f6f805fd740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559a0cde42f0 0x559a0d1c45d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:30:29.322 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:29.318+0000 7f6f805fd740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559a0cdec4d0 0x559a0d1c3290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:30:29.322 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:29.318+0000 7f6f805fd740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559a0ce0d1b0 0x559a0d1c3980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:30:29.322 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:29.318+0000 7f6f805fd740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f6f741ae260 con 0x559a0ce0d1b0 2024-08-31T04:30:29.322 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:29.318+0000 7f6f805fd740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f6f741adb60 con 0x559a0cdec4d0 2024-08-31T04:30:29.322 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:29.318+0000 7f6f805fd740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f6f741aace0 con 0x559a0cde42f0 2024-08-31T04:30:29.322 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:29.318+0000 7f6f805fd740 10 client.0 _ll_register_callbacks cb 0x7f6f600ab960 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:30:29.322 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:29.318+0000 7f6f72800640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559a0cde42f0 0x559a0d1c45d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:30:29.323 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:29.318+0000 7f6f72800640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559a0cde42f0 0x559a0d1c45d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.50:33304/0 (socket says 172.21.15.50:33304) 2024-08-31T04:30:29.323 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:29.318+0000 7f6f72800640 1 -- 172.21.15.50:0/659059685 learned_addr learned my addr 172.21.15.50:0/659059685 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:30:29.323 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:29.318+0000 7f6f71e00640 1 --2- 172.21.15.50:0/659059685 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559a0cdec4d0 0x559a0d1c3290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:30:29.323 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:29.318+0000 7f6f73200640 1 --2- 172.21.15.50:0/659059685 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559a0ce0d1b0 0x559a0d1c3980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:30:29.323 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:29.319+0000 7f6f72800640 1 -- 172.21.15.50:0/659059685 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559a0cdec4d0 msgr2=0x559a0d1c3290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:30:29.323 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:29.319+0000 7f6f72800640 1 --2- 172.21.15.50:0/659059685 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559a0cdec4d0 0x559a0d1c3290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:29.323 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:29.319+0000 7f6f72800640 1 -- 172.21.15.50:0/659059685 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559a0ce0d1b0 msgr2=0x559a0d1c3980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:30:29.323 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:29.319+0000 7f6f72800640 1 --2- 172.21.15.50:0/659059685 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559a0ce0d1b0 0x559a0d1c3980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:29.323 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:29.319+0000 7f6f72800640 1 -- 172.21.15.50:0/659059685 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559a0d1c1e50 con 0x559a0cde42f0 2024-08-31T04:30:29.323 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:29.319+0000 7f6f72800640 1 --2- 172.21.15.50:0/659059685 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559a0cde42f0 0x559a0d1c45d0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f6f6403d710 tx=0x7f6f6402a3f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8037e0a6a81e72b1 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:30:29.323 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:29.319+0000 7f6f53e00640 10 client.0 ms_handle_connect on v2:172.21.15.177:3300/0 2024-08-31T04:30:29.325 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:29.319+0000 7f6f53e00640 1 -- 172.21.15.50:0/659059685 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f64035070 con 0x559a0cde42f0 2024-08-31T04:30:29.325 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:29.319+0000 7f6f805fd740 1 -- 172.21.15.50:0/659059685 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6f64003e30 con 0x559a0cde42f0 2024-08-31T04:30:29.325 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:29.319+0000 7f6f53e00640 1 -- 172.21.15.50:0/659059685 <== mon.1 v2:172.21.15.177:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8219+0+0 (secure 0 0 0) 0x7f6f6403ddc0 con 0x559a0cde42f0 2024-08-31T04:30:29.325 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:29.320+0000 7f6f53e00640 1 -- 172.21.15.50:0/659059685 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7f6f640315a0 con 0x559a0cde42f0 2024-08-31T04:30:29.325 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:29.320+0000 7f6f805fd740 10 client.26035 fetch_fsmap learned FSMap version 42 2024-08-31T04:30:29.325 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:29.320+0000 7f6f805fd740 1 -- 172.21.15.50:0/659059685 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x559a0d234910 con 0x559a0cde42f0 2024-08-31T04:30:29.325 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:29.320+0000 7f6f53e00640 1 -- 172.21.15.50:0/659059685 <== mon.1 v2:172.21.15.177:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6f64003e30 con 0x559a0cde42f0 2024-08-31T04:30:29.325 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:29.320+0000 7f6f53e00640 1 -- 172.21.15.50:0/659059685 <== mon.1 v2:172.21.15.177:3300/0 5 ==== fsmap(e 42) ==== 8398+0+0 (secure 0 0 0) 0x7f6f64044040 con 0x559a0cde42f0 2024-08-31T04:30:29.325 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:29.320+0000 7f6f805fd740 10 client.26035 fetch_fsmap finished waiting for FSMap version 42 2024-08-31T04:30:29.325 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:29.320+0000 7f6f805fd740 10 client.26035 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T04:30:29.325 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:29.320+0000 7f6f805fd740 20 client.26035 populate_metadata read hostname 'smithi050' 2024-08-31T04:30:29.325 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:29.320+0000 7f6f805fd740 1 --2- 172.21.15.50:0/659059685 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x559a0cda11c0 0x559a0d2372a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:30:29.325 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:29.320+0000 7f6f805fd740 4 client.26035 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-31T04:30:29.326 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:29.320+0000 7f6f805fd740 1 -- 172.21.15.50:0/659059685 --> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] -- command(tid 0: {"prefix": "flush journal"}) -- 0x559a0d123960 con 0x559a0cda11c0 2024-08-31T04:30:29.326 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:29.321+0000 7f6f71e00640 1 --2- 172.21.15.50:0/659059685 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x559a0cda11c0 0x559a0d2372a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:30:29.326 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:29.321+0000 7f6f71e00640 1 --2- 172.21.15.50:0/659059685 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x559a0cda11c0 0x559a0d2372a0 crc :-1 s=READY pgs=109 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=557d3a53cb0d3692 server_cookie=d4ea70a4836c27f0 in_seq=0 out_seq=0 2024-08-31T04:30:29.326 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:29.321+0000 7f6f53e00640 10 client.26035 ms_handle_connect on v2:172.21.15.133:6838/2526402262 2024-08-31T04:30:29.386 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:29.383+0000 7f6f53e00640 1 -- 172.21.15.50:0/659059685 <== mds.0 v2:172.21.15.133:6838/2526402262 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x559a0d123960 con 0x559a0cda11c0 2024-08-31T04:30:29.386 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:29.383+0000 7f6f53e00640 10 client.26035 handle_command_reply: tid=0 2024-08-31T04:30:29.386 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:29.383+0000 7f6f805fd740 1 client.26035 shutdown 2024-08-31T04:30:29.386 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:29.383+0000 7f6f805fd740 1 -- 172.21.15.50:0/659059685 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559a0cde42f0 msgr2=0x559a0d1c45d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:30:29.386 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:29.383+0000 7f6f805fd740 1 --2- 172.21.15.50:0/659059685 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559a0cde42f0 0x559a0d1c45d0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f6f6403d710 tx=0x7f6f6402a3f0 comp rx=0 tx=0).stop 2024-08-31T04:30:29.386 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:29.383+0000 7f6f805fd740 1 -- 172.21.15.50:0/659059685 shutdown_connections 2024-08-31T04:30:29.387 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:29.383+0000 7f6f805fd740 1 --2- 172.21.15.50:0/659059685 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x559a0cda11c0 0x559a0d2372a0 crc :-1 s=READY pgs=109 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:29.387 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:29.383+0000 7f6f805fd740 1 --2- 172.21.15.50:0/659059685 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559a0ce0d1b0 0x559a0d1c3980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:29.387 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:29.383+0000 7f6f805fd740 1 --2- 172.21.15.50:0/659059685 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559a0cdec4d0 0x559a0d1c3290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:29.387 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:29.383+0000 7f6f53e00640 0 client.26035 ms_handle_reset on v2:172.21.15.133:6838/2526402262 2024-08-31T04:30:29.387 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:29.383+0000 7f6f805fd740 1 --2- 172.21.15.50:0/659059685 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559a0cde42f0 0x559a0d1c45d0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:29.387 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:29.383+0000 7f6f805fd740 1 -- 172.21.15.50:0/659059685 >> 172.21.15.50:0/659059685 conn(0x559a0ce01300 msgr2=0x559a0d1af490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:30:29.387 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:29.384+0000 7f6f805fd740 1 -- 172.21.15.50:0/659059685 shutdown_connections 2024-08-31T04:30:29.387 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:29.384+0000 7f6f805fd740 1 -- 172.21.15.50:0/659059685 wait complete. 2024-08-31T04:30:29.387 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:29.384+0000 7f6f805fd740 20 client.26035 trim_cache size 0 max 16384 2024-08-31T04:30:29.387 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout:{ 2024-08-31T04:30:29.387 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout: "message": "", 2024-08-31T04:30:29.388 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout: "return_code": 0 2024-08-31T04:30:29.388 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout:} 2024-08-31T04:30:29.388 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:29.384+0000 7f6f78a00640 1 -- 172.21.15.50:0/1621318975 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f6f580b4a40 msgr2=0x7f6f580b6f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:30:29.388 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:29.384+0000 7f6f78a00640 1 --2- 172.21.15.50:0/1621318975 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f6f580b4a40 0x7f6f580b6f50 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f6f640096c0 tx=0x7f6f640314a0 comp rx=0 tx=0).stop 2024-08-31T04:30:29.388 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:29.384+0000 7f6f78a00640 1 -- 172.21.15.50:0/1621318975 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6f74076e90 msgr2=0x7f6f7419c390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:30:29.388 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:29.385+0000 7f6f78a00640 1 --2- 172.21.15.50:0/1621318975 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6f74076e90 0x7f6f7419c390 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f6f6000e9f0 tx=0x7f6f6000eeb0 comp rx=0 tx=0).stop 2024-08-31T04:30:29.388 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:29.385+0000 7f6f78a00640 1 -- 172.21.15.50:0/1621318975 shutdown_connections 2024-08-31T04:30:29.389 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:29.385+0000 7f6f78a00640 1 --2- 172.21.15.50:0/1621318975 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f6f580b4a40 0x7f6f580b6f50 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:29.389 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:29.385+0000 7f6f78a00640 1 --2- 172.21.15.50:0/1621318975 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6f7410b210 0x7f6f7419cf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:29.389 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:29.385+0000 7f6f78a00640 1 --2- 172.21.15.50:0/1621318975 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6f74076e90 0x7f6f7419c390 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:29.389 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:29.385+0000 7f6f78a00640 1 --2- 172.21.15.50:0/1621318975 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6f74075a90 0x7f6f7419bd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:29.389 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:29.385+0000 7f6f78a00640 1 -- 172.21.15.50:0/1621318975 >> 172.21.15.50:0/1621318975 conn(0x7f6f740febc0 msgr2=0x7f6f741071f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:30:29.389 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:29.385+0000 7f6f78a00640 1 -- 172.21.15.50:0/1621318975 shutdown_connections 2024-08-31T04:30:29.389 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:29.385+0000 7f6f78a00640 1 -- 172.21.15.50:0/1621318975 wait complete. 2024-08-31T04:30:29.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:30:29 smithi050 ceph-mon[17259]: pgmap v596: 97 pgs: 97 active+clean; 1.5 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 146 KiB/s rd, 1.3 MiB/s wr, 113 op/s 2024-08-31T04:30:29.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:30:29 smithi177 ceph-mon[22025]: pgmap v596: 97 pgs: 97 active+clean; 1.5 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 146 KiB/s rd, 1.3 MiB/s wr, 113 op/s 2024-08-31T04:30:29.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:30:29 smithi133 ceph-mon[22177]: pgmap v596: 97 pgs: 97 active+clean; 1.5 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 146 KiB/s rd, 1.3 MiB/s wr, 113 op/s 2024-08-31T04:30:31.460 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:30:31 smithi050 ceph-mon[17259]: pgmap v597: 97 pgs: 97 active+clean; 1.5 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 112 KiB/s rd, 667 KiB/s wr, 67 op/s 2024-08-31T04:30:31.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:30:31 smithi177 ceph-mon[22025]: pgmap v597: 97 pgs: 97 active+clean; 1.5 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 112 KiB/s rd, 667 KiB/s wr, 67 op/s 2024-08-31T04:30:31.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:30:31 smithi133 ceph-mon[22177]: pgmap v597: 97 pgs: 97 active+clean; 1.5 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 112 KiB/s rd, 667 KiB/s wr, 67 op/s 2024-08-31T04:30:32.390 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:32.385+0000 7f1ab8c00640 1 -- 172.21.15.50:0/3216946615 <== mds.0 v2:172.21.15.133:6838/2526402262 1 ==== command_reply(tid 0: -115 ) ==== 8+0+595 (crc 0 0 0) 0x55dcc9645f20 con 0x55dcc975c2e0 2024-08-31T04:30:32.390 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:32.385+0000 7f1ab8c00640 10 client.26006 handle_command_reply: tid=0 2024-08-31T04:30:32.390 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:32.385+0000 7f1adc8a5740 1 client.26006 shutdown 2024-08-31T04:30:32.390 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:32.386+0000 7f1adc8a5740 1 -- 172.21.15.50:0/3216946615 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55dcc932c840 msgr2=0x55dcc96f74e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:30:32.390 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:32.386+0000 7f1adc8a5740 1 --2- 172.21.15.50:0/3216946615 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55dcc932c840 0x55dcc96f74e0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f1ac8009fd0 tx=0x7f1ac8009650 comp rx=0 tx=0).stop 2024-08-31T04:30:32.390 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:32.386+0000 7f1adc8a5740 1 -- 172.21.15.50:0/3216946615 shutdown_connections 2024-08-31T04:30:32.390 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:32.386+0000 7f1adc8a5740 1 --2- 172.21.15.50:0/3216946615 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x55dcc975c2e0 0x55dcc975e700 crc :-1 s=READY pgs=102 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:32.390 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:32.386+0000 7f1adc8a5740 1 --2- 172.21.15.50:0/3216946615 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55dcc932c840 0x55dcc96f74e0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:32.391 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:32.386+0000 7f1adc8a5740 1 --2- 172.21.15.50:0/3216946615 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55dcc9303980 0x55dcc96f6fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:32.391 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:32.386+0000 7f1adc8a5740 1 --2- 172.21.15.50:0/3216946615 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55dcc92eb1c0 0x55dcc96f6a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:32.391 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:32.386+0000 7f1ab8c00640 0 client.26006 ms_handle_reset on v2:172.21.15.133:6838/2526402262 2024-08-31T04:30:32.391 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:32.386+0000 7f1adc8a5740 1 -- 172.21.15.50:0/3216946615 >> 172.21.15.50:0/3216946615 conn(0x55dcc9320990 msgr2=0x55dcc96d07b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:30:32.391 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:32.386+0000 7f1adc8a5740 1 -- 172.21.15.50:0/3216946615 shutdown_connections 2024-08-31T04:30:32.391 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:32.386+0000 7f1adc8a5740 1 -- 172.21.15.50:0/3216946615 wait complete. 2024-08-31T04:30:32.391 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:32.386+0000 7f1adc8a5740 20 client.26006 trim_cache size 0 max 16384 2024-08-31T04:30:32.391 INFO:teuthology.orchestra.run.smithi050.stderr:Error EINPROGRESS: 2024-08-31T04:30:32.391 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-08-31T04:30:32.391 INFO:teuthology.orchestra.run.smithi050.stdout: "epoch": 42, 2024-08-31T04:30:32.392 INFO:teuthology.orchestra.run.smithi050.stdout: "leader": 24695, 2024-08-31T04:30:32.392 INFO:teuthology.orchestra.run.smithi050.stdout: "set_version": 17, 2024-08-31T04:30:32.392 INFO:teuthology.orchestra.run.smithi050.stdout: "sets": { 2024-08-31T04:30:32.392 INFO:teuthology.orchestra.run.smithi050.stdout: "9d491f02": { 2024-08-31T04:30:32.392 INFO:teuthology.orchestra.run.smithi050.stdout: "version": 17, 2024-08-31T04:30:32.392 INFO:teuthology.orchestra.run.smithi050.stdout: "age_ref": 0.0, 2024-08-31T04:30:32.392 INFO:teuthology.orchestra.run.smithi050.stdout: "state": { 2024-08-31T04:30:32.392 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "QUIESCING", 2024-08-31T04:30:32.392 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 45.0 2024-08-31T04:30:32.392 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:30:32.392 INFO:teuthology.orchestra.run.smithi050.stdout: "timeout": 90.0, 2024-08-31T04:30:32.392 INFO:teuthology.orchestra.run.smithi050.stdout: "expiration": 152.7, 2024-08-31T04:30:32.392 INFO:teuthology.orchestra.run.smithi050.stdout: "members": { 2024-08-31T04:30:32.393 INFO:teuthology.orchestra.run.smithi050.stdout: "file:/": { 2024-08-31T04:30:32.393 INFO:teuthology.orchestra.run.smithi050.stdout: "excluded": false, 2024-08-31T04:30:32.393 INFO:teuthology.orchestra.run.smithi050.stdout: "state": { 2024-08-31T04:30:32.393 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "QUIESCING", 2024-08-31T04:30:32.393 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 45.0 2024-08-31T04:30:32.393 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T04:30:32.393 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T04:30:32.393 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T04:30:32.393 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T04:30:32.393 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T04:30:32.393 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-08-31T04:30:33.359 DEBUG:teuthology.orchestra.run:got remote process result: 115 2024-08-31T04:30:33.360 WARNING:tasks.quiescer.fs.[cephfs]:Set '9d491f02' hasn't quiesced after 83.2 seconds (timeout: 90). Dumping ops with locks from all ranks. 2024-08-31T04:30:33.360 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 058d9fc6-674f-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-31T04:30:33.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:30:33 smithi050 ceph-mon[17259]: pgmap v598: 97 pgs: 97 active+clean; 1.5 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 125 KiB/s rd, 86 KiB/s wr, 40 op/s 2024-08-31T04:30:33.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:30:33 smithi177 ceph-mon[22025]: pgmap v598: 97 pgs: 97 active+clean; 1.5 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 125 KiB/s rd, 86 KiB/s wr, 40 op/s 2024-08-31T04:30:33.791 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:30:33.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:30:33 smithi133 ceph-mon[22177]: pgmap v598: 97 pgs: 97 active+clean; 1.5 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 125 KiB/s rd, 86 KiB/s wr, 40 op/s 2024-08-31T04:30:34.780 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:34.777+0000 7efeb7400640 1 -- 172.21.15.50:0/990097459 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efeb0104760 msgr2=0x7efeb0104b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:30:34.781 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:34.777+0000 7efeb7400640 1 --2- 172.21.15.50:0/990097459 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efeb0104760 0x7efeb0104b70 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7efea4009900 tx=0x7efea402a410 comp rx=0 tx=0).stop 2024-08-31T04:30:34.781 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:34.778+0000 7efeb7400640 1 -- 172.21.15.50:0/990097459 shutdown_connections 2024-08-31T04:30:34.781 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:34.778+0000 7efeb7400640 1 --2- 172.21.15.50:0/990097459 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7efeb010dbc0 0x7efeb01100b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:34.781 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:34.778+0000 7efeb7400640 1 --2- 172.21.15.50:0/990097459 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efeb01050b0 0x7efeb010d600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:34.781 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:34.778+0000 7efeb7400640 1 --2- 172.21.15.50:0/990097459 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efeb0104760 0x7efeb0104b70 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:34.781 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:34.778+0000 7efeb7400640 1 -- 172.21.15.50:0/990097459 >> 172.21.15.50:0/990097459 conn(0x7efeb00794d0 msgr2=0x7efeb00798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:30:34.781 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:34.778+0000 7efeb7400640 1 -- 172.21.15.50:0/990097459 shutdown_connections 2024-08-31T04:30:34.781 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:34.778+0000 7efeb7400640 1 -- 172.21.15.50:0/990097459 wait complete. 2024-08-31T04:30:34.782 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:34.779+0000 7efeb7400640 1 Processor -- start 2024-08-31T04:30:34.782 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:34.779+0000 7efeb7400640 1 -- start start 2024-08-31T04:30:34.782 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:34.779+0000 7efeb7400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efeb0104760 0x7efeb019c470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:30:34.782 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:34.779+0000 7efeb7400640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7efeb01050b0 0x7efeb019ca10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:30:34.782 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:34.780+0000 7efeb7400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efeb010dbc0 0x7efeb01a1cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:30:34.782 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:34.780+0000 7efeb7400640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7efeb0113840 con 0x7efeb0104760 2024-08-31T04:30:34.782 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:34.780+0000 7efeb7400640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7efeb01136c0 con 0x7efeb010dbc0 2024-08-31T04:30:34.783 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:34.780+0000 7efeb7400640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7efeb01139c0 con 0x7efeb01050b0 2024-08-31T04:30:34.783 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:34.780+0000 7efeb4a00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efeb0104760 0x7efeb019c470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:30:34.783 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:34.780+0000 7efeb4a00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efeb0104760 0x7efeb019c470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:55184/0 (socket says 172.21.15.50:55184) 2024-08-31T04:30:34.783 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:34.780+0000 7efeb4a00640 1 -- 172.21.15.50:0/2149562543 learned_addr learned my addr 172.21.15.50:0/2149562543 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:30:34.784 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:34.780+0000 7efeafe00640 1 --2- 172.21.15.50:0/2149562543 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7efeb01050b0 0x7efeb019ca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:30:34.784 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:34.780+0000 7efeb5400640 1 --2- 172.21.15.50:0/2149562543 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efeb010dbc0 0x7efeb01a1cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:30:34.784 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:34.781+0000 7efeb4a00640 1 -- 172.21.15.50:0/2149562543 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7efeb01050b0 msgr2=0x7efeb019ca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:30:34.784 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:34.781+0000 7efeb4a00640 1 --2- 172.21.15.50:0/2149562543 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7efeb01050b0 0x7efeb019ca10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:34.784 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:34.781+0000 7efeb4a00640 1 -- 172.21.15.50:0/2149562543 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efeb010dbc0 msgr2=0x7efeb01a1cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:30:34.784 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:34.781+0000 7efeb4a00640 1 --2- 172.21.15.50:0/2149562543 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efeb010dbc0 0x7efeb01a1cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:34.784 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:34.781+0000 7efeb4a00640 1 -- 172.21.15.50:0/2149562543 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efeb01a23e0 con 0x7efeb0104760 2024-08-31T04:30:34.784 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:34.781+0000 7efeb5400640 1 --2- 172.21.15.50:0/2149562543 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efeb010dbc0 0x7efeb01a1cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:30:34.784 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:34.781+0000 7efeb4a00640 1 --2- 172.21.15.50:0/2149562543 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efeb0104760 0x7efeb019c470 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7efea4032fd0 tx=0x7efea4031a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:30:34.785 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:34.781+0000 7efead600640 1 -- 172.21.15.50:0/2149562543 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efea403f030 con 0x7efeb0104760 2024-08-31T04:30:34.785 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:34.781+0000 7efeb7400640 1 -- 172.21.15.50:0/2149562543 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efeb01a2670 con 0x7efeb0104760 2024-08-31T04:30:34.785 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:34.782+0000 7efeb7400640 1 -- 172.21.15.50:0/2149562543 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efeb01a8e30 con 0x7efeb0104760 2024-08-31T04:30:34.785 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:34.782+0000 7efead600640 1 -- 172.21.15.50:0/2149562543 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efea4004490 con 0x7efeb0104760 2024-08-31T04:30:34.785 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:34.782+0000 7efead600640 1 -- 172.21.15.50:0/2149562543 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efea4035070 con 0x7efeb0104760 2024-08-31T04:30:34.785 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:34.783+0000 7efeb7400640 1 -- 172.21.15.50:0/2149562543 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efeb006bf80 con 0x7efeb0104760 2024-08-31T04:30:34.787 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:34.785+0000 7efead600640 1 -- 172.21.15.50:0/2149562543 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 18) ==== 152577+0+0 (secure 0 0 0) 0x7efea4042030 con 0x7efeb0104760 2024-08-31T04:30:34.789 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:34.786+0000 7efead600640 1 --2- 172.21.15.50:0/2149562543 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7efe980b4bb0 0x7efe980b70c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:30:34.789 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:34.787+0000 7efead600640 1 -- 172.21.15.50:0/2149562543 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8219+0+0 (secure 0 0 0) 0x7efea4105430 con 0x7efeb0104760 2024-08-31T04:30:34.789 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:34.787+0000 7efeafe00640 1 --2- 172.21.15.50:0/2149562543 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7efe980b4bb0 0x7efe980b70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:30:34.790 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:34.788+0000 7efeafe00640 1 --2- 172.21.15.50:0/2149562543 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7efe980b4bb0 0x7efe980b70c0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7efeb010fb30 tx=0x7efe9c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:30:34.794 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:34.792+0000 7efead600640 1 -- 172.21.15.50:0/2149562543 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7efea40cbec0 con 0x7efeb0104760 2024-08-31T04:30:35.037 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:35.034+0000 7efeb7400640 1 -- 172.21.15.50:0/2149562543 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7efeb019d5a0 con 0x7efeb0104760 2024-08-31T04:30:35.037 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:35.035+0000 7efead600640 1 -- 172.21.15.50:0/2149562543 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 42 v42) ==== 94+0+12002 (secure 0 0 0) 0x7efeb019d5a0 con 0x7efeb0104760 2024-08-31T04:30:35.038 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-08-31T04:30:35.038 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":42,"btime":"2024-08-31T04:30:06:367307+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14622,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/1565557530","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":1565557530},{"type":"v1","addr":"172.21.15.50:6835","nonce":1565557530}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":25924,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6835/4060379633","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6834","nonce":4060379633},{"type":"v1","addr":"172.21.15.177:6835","nonce":4060379633}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":39}],"filesystems":[{"mdsmap":{"epoch":42,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-31T04:20:44.140709+0000","modified":"2024-08-31T04:30:06.030224+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24695,"mds_1":24691,"mds_2":24667,"mds_3":24656,"mds_4":24652},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14676":{"gid":14676,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.50:6839/2105228685","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6838","nonce":2105228685},{"type":"v1","addr":"172.21.15.50:6839","nonce":2105228685}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24590":{"gid":24590,"name":"k","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.133:6833/4283603962","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6832","nonce":4283603962},{"type":"v1","addr":"172.21.15.133:6833","nonce":4283603962}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24601":{"gid":24601,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.177:6833/1237129793","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":1237129793},{"type":"v1","addr":"172.21.15.177:6833","nonce":1237129793}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24626":{"gid":24626,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.133:6835/3637799701","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":3637799701},{"type":"v1","addr":"172.21.15.133:6835","nonce":3637799701}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24652":{"gid":24652,"name":"c","rank":4,"incarnation":26,"state":"up:active","state_seq":13,"addr":"172.21.15.177:6837/2159859285","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6836","nonce":2159859285},{"type":"v1","addr":"172.21.15.177:6837","nonce":2159859285}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24656":{"gid":24656,"name":"h","rank":3,"incarnation":22,"state":"up:active","state_seq":12,"addr":"172.21.15.133:6837/4014853202","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6836","nonce":4014853202},{"type":"v1","addr":"172.21.15.133:6837","nonce":4014853202}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24667":{"gid":24667,"name":"i","rank":2,"incarnation":20,"state":"up:active","state_seq":10,"addr":"172.21.15.177:6839/3600081752","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6838","nonce":3600081752},{"type":"v1","addr":"172.21.15.177:6839","nonce":3600081752}]},"join_fscid":-1,"export_targets":[0,1,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24691":{"gid":24691,"name":"a","rank":1,"incarnation":18,"state":"up:active","state_seq":8,"addr":"172.21.15.50:6841/575209862","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6840","nonce":575209862},{"type":"v1","addr":"172.21.15.50:6841","nonce":575209862}]},"join_fscid":-1,"export_targets":[0,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24695":{"gid":24695,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.133:6839/2526402262","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6838","nonce":2526402262},{"type":"v1","addr":"172.21.15.133:6839","nonce":2526402262}]},"join_fscid":-1,"export_targets":[1],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_26036":{"gid":26036,"name":"d","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.50:6837/2788697263","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6836","nonce":2788697263},{"type":"v1","addr":"172.21.15.50:6837","nonce":2788697263}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24695,"qdb_cluster":[24667,24695,24656,24691,24652]},"id":1}]} 2024-08-31T04:30:35.038 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 42 2024-08-31T04:30:35.040 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:35.038+0000 7efeb7400640 1 -- 172.21.15.50:0/2149562543 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7efe980b4bb0 msgr2=0x7efe980b70c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:30:35.040 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:35.038+0000 7efeb7400640 1 --2- 172.21.15.50:0/2149562543 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7efe980b4bb0 0x7efe980b70c0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7efeb010fb30 tx=0x7efe9c005f90 comp rx=0 tx=0).stop 2024-08-31T04:30:35.040 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:35.038+0000 7efeb7400640 1 -- 172.21.15.50:0/2149562543 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efeb0104760 msgr2=0x7efeb019c470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:30:35.040 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:35.038+0000 7efeb7400640 1 --2- 172.21.15.50:0/2149562543 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efeb0104760 0x7efeb019c470 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7efea4032fd0 tx=0x7efea4031a20 comp rx=0 tx=0).stop 2024-08-31T04:30:35.041 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:35.038+0000 7efeb7400640 1 -- 172.21.15.50:0/2149562543 shutdown_connections 2024-08-31T04:30:35.041 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:35.038+0000 7efeb7400640 1 --2- 172.21.15.50:0/2149562543 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7efe980b4bb0 0x7efe980b70c0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:35.041 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:35.038+0000 7efeb7400640 1 --2- 172.21.15.50:0/2149562543 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7efeb01050b0 0x7efeb019ca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:35.041 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:35.038+0000 7efeb7400640 1 --2- 172.21.15.50:0/2149562543 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efeb010dbc0 0x7efeb01a1cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:35.041 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:35.038+0000 7efeb7400640 1 --2- 172.21.15.50:0/2149562543 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efeb0104760 0x7efeb019c470 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:35.041 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:35.038+0000 7efeb7400640 1 -- 172.21.15.50:0/2149562543 >> 172.21.15.50:0/2149562543 conn(0x7efeb00794d0 msgr2=0x7efeb0100a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:30:35.041 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:35.038+0000 7efeb7400640 1 -- 172.21.15.50:0/2149562543 shutdown_connections 2024-08-31T04:30:35.041 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:35.038+0000 7efeb7400640 1 -- 172.21.15.50:0/2149562543 wait complete. 2024-08-31T04:30:35.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:30:35 smithi050 ceph-mon[17259]: pgmap v599: 97 pgs: 97 active+clean; 1.5 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 17 KiB/s wr, 19 op/s 2024-08-31T04:30:35.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:30:35 smithi050 ceph-mon[17259]: from='client.? 172.21.15.50:0/2149562543' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T04:30:35.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:30:35 smithi177 ceph-mon[22025]: pgmap v599: 97 pgs: 97 active+clean; 1.5 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 17 KiB/s wr, 19 op/s 2024-08-31T04:30:35.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:30:35 smithi177 ceph-mon[22025]: from='client.? 172.21.15.50:0/2149562543' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T04:30:35.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:30:35 smithi133 ceph-mon[22177]: pgmap v599: 97 pgs: 97 active+clean; 1.5 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 17 KiB/s wr, 19 op/s 2024-08-31T04:30:35.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:30:35 smithi133 ceph-mon[22177]: from='client.? 172.21.15.50:0/2149562543' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T04:30:36.232 DEBUG:tasks.quiescer.fs.[cephfs]:Dumping ops on rank 4 (c) to a remote file /var/run/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/ops-9d491f02-1-mds.c.json 2024-08-31T04:30:36.232 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 058d9fc6-674f-11ef-bcd4-c7b262605968 -- ceph tell mds.1:4 ops --flags=locks --path=/var/run/ceph/ops-9d491f02-1-mds.c.json 2024-08-31T04:30:36.623 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:30:37.553 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:37.551+0000 7fbc17e00640 1 -- 172.21.15.50:0/2940225107 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbc10109240 msgr2=0x7fbc10109650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:30:37.553 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:37.551+0000 7fbc17e00640 1 --2- 172.21.15.50:0/2940225107 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbc10109240 0x7fbc10109650 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fbbfc009900 tx=0x7fbbfc02a3f0 comp rx=0 tx=0).stop 2024-08-31T04:30:37.554 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:37.551+0000 7fbc17e00640 1 -- 172.21.15.50:0/2940225107 shutdown_connections 2024-08-31T04:30:37.554 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:37.551+0000 7fbc17e00640 1 --2- 172.21.15.50:0/2940225107 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbc10109b90 0x7fbc101103c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:37.554 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:37.551+0000 7fbc17e00640 1 --2- 172.21.15.50:0/2940225107 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbc10109240 0x7fbc10109650 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:37.554 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:37.551+0000 7fbc17e00640 1 --2- 172.21.15.50:0/2940225107 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbc10103900 0x7fbc10103d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:37.554 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:37.551+0000 7fbc17e00640 1 -- 172.21.15.50:0/2940225107 >> 172.21.15.50:0/2940225107 conn(0x7fbc1007b5f0 msgr2=0x7fbc1007ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:30:37.554 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:37.551+0000 7fbc17e00640 1 -- 172.21.15.50:0/2940225107 shutdown_connections 2024-08-31T04:30:37.554 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:37.551+0000 7fbc17e00640 1 -- 172.21.15.50:0/2940225107 wait complete. 2024-08-31T04:30:37.555 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:37.552+0000 7fbc17e00640 1 Processor -- start 2024-08-31T04:30:37.555 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:37.553+0000 7fbc17e00640 1 -- start start 2024-08-31T04:30:37.555 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:37.553+0000 7fbc17e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbc10103900 0x7fbc100754b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:30:37.555 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:37.553+0000 7fbc17e00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbc10109240 0x7fbc100759f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:30:37.555 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:37.553+0000 7fbc17e00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbc10109b90 0x7fbc10075f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:30:37.556 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:37.553+0000 7fbc17e00640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fbc10113850 con 0x7fbc10103900 2024-08-31T04:30:37.556 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:37.553+0000 7fbc17e00640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7fbc101136d0 con 0x7fbc10109240 2024-08-31T04:30:37.556 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:37.553+0000 7fbc17e00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fbc101139d0 con 0x7fbc10109b90 2024-08-31T04:30:37.556 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:37.553+0000 7fbc14a00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbc10109240 0x7fbc100759f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:30:37.556 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:37.554+0000 7fbc14a00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbc10109240 0x7fbc100759f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.50:48030/0 (socket says 172.21.15.50:48030) 2024-08-31T04:30:37.556 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:37.554+0000 7fbc14a00640 1 -- 172.21.15.50:0/60103651 learned_addr learned my addr 172.21.15.50:0/60103651 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:30:37.556 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:37.554+0000 7fbc15e00640 1 --2- 172.21.15.50:0/60103651 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbc10109b90 0x7fbc10075f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:30:37.556 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:37.554+0000 7fbc15400640 1 --2- 172.21.15.50:0/60103651 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbc10103900 0x7fbc100754b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:30:37.557 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:37.554+0000 7fbc15e00640 1 -- 172.21.15.50:0/60103651 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbc10109240 msgr2=0x7fbc100759f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:30:37.557 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:37.554+0000 7fbc15e00640 1 --2- 172.21.15.50:0/60103651 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbc10109240 0x7fbc100759f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:37.557 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:37.554+0000 7fbc15e00640 1 -- 172.21.15.50:0/60103651 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbc10103900 msgr2=0x7fbc100754b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:30:37.557 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:37.554+0000 7fbc15e00640 1 --2- 172.21.15.50:0/60103651 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbc10103900 0x7fbc100754b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:37.557 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:37.554+0000 7fbc15e00640 1 -- 172.21.15.50:0/60103651 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc101a84c0 con 0x7fbc10109b90 2024-08-31T04:30:37.557 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:37.555+0000 7fbc15e00640 1 --2- 172.21.15.50:0/60103651 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbc10109b90 0x7fbc10075f30 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fbc08009fd0 tx=0x7fbc0800ef10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:30:37.557 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:37.555+0000 7fbc0e000640 1 -- 172.21.15.50:0/60103651 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc0800ce20 con 0x7fbc10109b90 2024-08-31T04:30:37.557 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:37.555+0000 7fbc0e000640 1 -- 172.21.15.50:0/60103651 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbc08005020 con 0x7fbc10109b90 2024-08-31T04:30:37.557 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:37.555+0000 7fbc17e00640 1 -- 172.21.15.50:0/60103651 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbc101a87b0 con 0x7fbc10109b90 2024-08-31T04:30:37.557 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:37.555+0000 7fbc0e000640 1 -- 172.21.15.50:0/60103651 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc08010690 con 0x7fbc10109b90 2024-08-31T04:30:37.557 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:37.555+0000 7fbc17e00640 1 -- 172.21.15.50:0/60103651 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbc101a8cf0 con 0x7fbc10109b90 2024-08-31T04:30:37.559 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:37.558+0000 7fbc1ea8f740 1 Processor -- start 2024-08-31T04:30:37.560 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:37.559+0000 7fbc0e000640 1 -- 172.21.15.50:0/60103651 <== mon.1 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 18) ==== 152577+0+0 (secure 0 0 0) 0x7fbc080054d0 con 0x7fbc10109b90 2024-08-31T04:30:37.560 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:37.559+0000 7fbc1ea8f740 1 -- start start 2024-08-31T04:30:37.561 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:37.559+0000 7fbc1ea8f740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b21fb3d760 0x55b21fee3870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:30:37.562 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:37.559+0000 7fbc1ea8f740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b21fb14790 0x55b21fee3db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:30:37.562 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:37.559+0000 7fbc1ea8f740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b21fb1c970 0x55b21fee42f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:30:37.562 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:37.559+0000 7fbc1ea8f740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55b21fe59e00 con 0x55b21fb1c970 2024-08-31T04:30:37.562 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:37.559+0000 7fbc1ea8f740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x55b21fe49390 con 0x55b21fb14790 2024-08-31T04:30:37.562 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:37.559+0000 7fbc1ea8f740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x55b21fe4d340 con 0x55b21fb3d760 2024-08-31T04:30:37.562 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:37.560+0000 7fbc15400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b21fb14790 0x55b21fee3db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:30:37.562 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:37.560+0000 7fbc15400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b21fb14790 0x55b21fee3db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.50:48042/0 (socket says 172.21.15.50:48042) 2024-08-31T04:30:37.562 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:37.560+0000 7fbc15400640 1 -- 172.21.15.50:0/1759324403 learned_addr learned my addr 172.21.15.50:0/1759324403 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:30:37.562 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:37.560+0000 7fbc14a00640 1 --2- 172.21.15.50:0/1759324403 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b21fb3d760 0x55b21fee3870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:30:37.562 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:37.560+0000 7fbc14a00640 1 --2- 172.21.15.50:0/1759324403 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b21fb1c970 0x55b21fee42f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:30:37.563 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:37.560+0000 7fbc15400640 1 -- 172.21.15.50:0/1759324403 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b21fb3d760 msgr2=0x55b21fee3870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:30:37.563 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:37.560+0000 7fbc15400640 1 --2- 172.21.15.50:0/1759324403 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b21fb3d760 0x55b21fee3870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:37.563 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:37.560+0000 7fbc15400640 1 -- 172.21.15.50:0/1759324403 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b21fb1c970 msgr2=0x55b21fee42f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:30:37.563 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:37.560+0000 7fbc15400640 1 --2- 172.21.15.50:0/1759324403 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b21fb1c970 0x55b21fee42f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:37.564 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:37.560+0000 7fbc15400640 1 -- 172.21.15.50:0/1759324403 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b21fc1b490 con 0x55b21fb14790 2024-08-31T04:30:37.564 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:37.561+0000 7fbc0e000640 1 --2- 172.21.15.50:0/60103651 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fbbf80b4b30 0x7fbbf80b7040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:30:37.564 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:37.561+0000 7fbc15400640 1 --2- 172.21.15.50:0/1759324403 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b21fb14790 0x55b21fee3db0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fbc04009c90 tx=0x7fbc04011810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=20c58fd491b5f5d7 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:30:37.564 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:37.561+0000 7fbc0e000640 1 -- 172.21.15.50:0/60103651 <== mon.1 v2:172.21.15.177:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8219+0+0 (secure 0 0 0) 0x7fbc080e57c0 con 0x7fbc10109b90 2024-08-31T04:30:37.564 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:37.561+0000 7fbc14a00640 1 --2- 172.21.15.50:0/60103651 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fbbf80b4b30 0x7fbbf80b7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:30:37.564 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:37.561+0000 7fbc02600640 1 -- 172.21.15.50:0/1759324403 <== mon.2 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc04005220 con 0x55b21fb14790 2024-08-31T04:30:37.564 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:37.561+0000 7fbc02600640 1 -- 172.21.15.50:0/1759324403 <== mon.2 v2:172.21.15.133:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbc04004c50 con 0x55b21fb14790 2024-08-31T04:30:37.564 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:37.561+0000 7fbc02600640 1 -- 172.21.15.50:0/1759324403 <== mon.2 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc04019670 con 0x55b21fb14790 2024-08-31T04:30:37.565 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:37.562+0000 7fbc1ea8f740 1 -- 172.21.15.50:0/1759324403 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b21fb14790 msgr2=0x55b21fee3db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:30:37.565 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:37.562+0000 7fbc1ea8f740 1 --2- 172.21.15.50:0/1759324403 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b21fb14790 0x55b21fee3db0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fbc04009c90 tx=0x7fbc04011810 comp rx=0 tx=0).stop 2024-08-31T04:30:37.565 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:37.562+0000 7fbc14a00640 1 --2- 172.21.15.50:0/60103651 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fbbf80b4b30 0x7fbbf80b7040 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fbc101061f0 tx=0x7fbbfc009560 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:30:37.565 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:37.562+0000 7fbc1ea8f740 1 -- 172.21.15.50:0/1759324403 shutdown_connections 2024-08-31T04:30:37.565 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:37.562+0000 7fbc1ea8f740 1 --2- 172.21.15.50:0/1759324403 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b21fb1c970 0x55b21fee42f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:37.565 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:37.562+0000 7fbc1ea8f740 1 --2- 172.21.15.50:0/1759324403 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b21fb14790 0x55b21fee3db0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:37.565 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:37.562+0000 7fbc1ea8f740 1 --2- 172.21.15.50:0/1759324403 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b21fb3d760 0x55b21fee3870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:37.565 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:37.562+0000 7fbc1ea8f740 1 -- 172.21.15.50:0/1759324403 >> 172.21.15.50:0/1759324403 conn(0x55b21fb31560 msgr2=0x55b21fee1760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:30:37.565 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:37.563+0000 7fbc1ea8f740 1 -- 172.21.15.50:0/1759324403 shutdown_connections 2024-08-31T04:30:37.566 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:37.563+0000 7fbc1ea8f740 1 -- 172.21.15.50:0/1759324403 wait complete. 2024-08-31T04:30:37.566 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:37.563+0000 7fbc1ea8f740 1 -- start start 2024-08-31T04:30:37.566 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:37.563+0000 7fbc1ea8f740 1 Processor -- start 2024-08-31T04:30:37.566 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:37.564+0000 7fbc1ea8f740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b21fb14790 0x55b21feeef60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:30:37.567 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:37.564+0000 7fbc1ea8f740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b21fb1c970 0x55b21feef4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:30:37.567 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:37.564+0000 7fbc1ea8f740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b21fb3d760 0x55b21fefb340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:30:37.567 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:37.564+0000 7fbc1ea8f740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55b21fcac380 con 0x55b21fb3d760 2024-08-31T04:30:37.567 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:37.564+0000 7fbc1ea8f740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x55b21fdcfcc0 con 0x55b21fb1c970 2024-08-31T04:30:37.567 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:37.564+0000 7fbc1ea8f740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x55b21fef2050 con 0x55b21fb14790 2024-08-31T04:30:37.567 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:37.564+0000 7fbc1ea8f740 10 client.0 _ll_register_callbacks cb 0x55b21fdff020 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:30:37.567 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:37.564+0000 7fbc15400640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b21fb14790 0x55b21feeef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:30:37.567 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:37.564+0000 7fbc15400640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b21fb14790 0x55b21feeef60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.50:59988/0 (socket says 172.21.15.50:59988) 2024-08-31T04:30:37.567 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:37.564+0000 7fbc15400640 1 -- 172.21.15.50:0/4235159445 learned_addr learned my addr 172.21.15.50:0/4235159445 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:30:37.567 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:37.565+0000 7fbc15e00640 1 --2- 172.21.15.50:0/4235159445 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b21fb3d760 0x55b21fefb340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:30:37.567 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:37.565+0000 7fbc14a00640 1 --2- 172.21.15.50:0/4235159445 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b21fb1c970 0x55b21feef4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:30:37.567 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:37.565+0000 7fbc15400640 1 -- 172.21.15.50:0/4235159445 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b21fb1c970 msgr2=0x55b21feef4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:30:37.568 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:37.565+0000 7fbc15400640 1 --2- 172.21.15.50:0/4235159445 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b21fb1c970 0x55b21feef4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:37.568 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:37.565+0000 7fbc15400640 1 -- 172.21.15.50:0/4235159445 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b21fb3d760 msgr2=0x55b21fefb340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:30:37.568 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:37.565+0000 7fbc15400640 1 --2- 172.21.15.50:0/4235159445 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b21fb3d760 0x55b21fefb340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:37.568 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:37.565+0000 7fbc15400640 1 -- 172.21.15.50:0/4235159445 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b21fe0fb30 con 0x55b21fb14790 2024-08-31T04:30:37.568 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:37.565+0000 7fbc15400640 1 --2- 172.21.15.50:0/4235159445 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b21fb14790 0x55b21feeef60 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fbc04005230 tx=0x7fbc04005260 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6f4e17f7a2d84e75 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:30:37.568 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:37.565+0000 7fbbf6a00640 10 client.0 ms_handle_connect on v2:172.21.15.177:3300/0 2024-08-31T04:30:37.569 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:37.566+0000 7fbbf6a00640 1 -- 172.21.15.50:0/4235159445 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc04029070 con 0x55b21fb14790 2024-08-31T04:30:37.569 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:37.566+0000 7fbbf6a00640 1 -- 172.21.15.50:0/4235159445 <== mon.1 v2:172.21.15.177:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8219+0+0 (secure 0 0 0) 0x7fbc04023840 con 0x55b21fb14790 2024-08-31T04:30:37.569 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:37.566+0000 7fbc1ea8f740 1 -- 172.21.15.50:0/4235159445 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbc04004c50 con 0x55b21fb14790 2024-08-31T04:30:37.570 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:37.566+0000 7fbbf6a00640 1 -- 172.21.15.50:0/4235159445 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7fbc04035050 con 0x55b21fb14790 2024-08-31T04:30:37.570 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:37.566+0000 7fbc1ea8f740 10 client.26053 fetch_fsmap learned FSMap version 42 2024-08-31T04:30:37.570 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:37.566+0000 7fbc1ea8f740 1 -- 172.21.15.50:0/4235159445 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x55b21fefe120 con 0x55b21fb14790 2024-08-31T04:30:37.570 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:37.566+0000 7fbbf6a00640 1 -- 172.21.15.50:0/4235159445 <== mon.1 v2:172.21.15.177:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbc04004c50 con 0x55b21fb14790 2024-08-31T04:30:37.570 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:37.567+0000 7fbbf6a00640 1 -- 172.21.15.50:0/4235159445 <== mon.1 v2:172.21.15.177:3300/0 5 ==== fsmap(e 42) ==== 8398+0+0 (secure 0 0 0) 0x7fbc04019430 con 0x55b21fb14790 2024-08-31T04:30:37.570 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:37.567+0000 7fbc1ea8f740 10 client.26053 fetch_fsmap finished waiting for FSMap version 42 2024-08-31T04:30:37.570 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:37.567+0000 7fbc1ea8f740 10 client.26053 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.c 2024-08-31T04:30:37.570 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:37.567+0000 7fbc1ea8f740 20 client.26053 populate_metadata read hostname 'smithi050' 2024-08-31T04:30:37.570 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:37.567+0000 7fbc1ea8f740 1 --2- 172.21.15.50:0/4235159445 >> [v2:172.21.15.177:6836/2159859285,v1:172.21.15.177:6837/2159859285] conn(0x55b21fafbfd0 0x55b21ff01480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:30:37.570 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:37.567+0000 7fbc1ea8f740 4 client.26053 mds_command: new command op to 24652 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T04:30:37.570 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:37.567+0000 7fbc1ea8f740 1 -- 172.21.15.50:0/4235159445 --> [v2:172.21.15.177:6836/2159859285,v1:172.21.15.177:6837/2159859285] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b21fe5bd50 con 0x55b21fafbfd0 2024-08-31T04:30:37.570 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:37.567+0000 7fbc14a00640 1 --2- 172.21.15.50:0/4235159445 >> [v2:172.21.15.177:6836/2159859285,v1:172.21.15.177:6837/2159859285] conn(0x55b21fafbfd0 0x55b21ff01480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:30:37.570 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:37.568+0000 7fbc14a00640 1 --2- 172.21.15.50:0/4235159445 >> [v2:172.21.15.177:6836/2159859285,v1:172.21.15.177:6837/2159859285] conn(0x55b21fafbfd0 0x55b21ff01480 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=aff2fb34b2cb3c58 server_cookie=81d6ef4d0497e3fc in_seq=0 out_seq=0 2024-08-31T04:30:37.571 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:37.568+0000 7fbbf6a00640 10 client.26053 ms_handle_connect on v2:172.21.15.177:6836/2159859285 2024-08-31T04:30:37.571 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:37.569+0000 7fbbf6a00640 1 -- 172.21.15.50:0/4235159445 <== mds.4 v2:172.21.15.177:6836/2159859285 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55b21fe5bd50 con 0x55b21fafbfd0 2024-08-31T04:30:37.572 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:37.569+0000 7fbbf6a00640 10 client.26053 handle_command_reply: tid=0 2024-08-31T04:30:37.572 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:37.569+0000 7fbc1ea8f740 1 client.26053 shutdown 2024-08-31T04:30:37.572 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:37.569+0000 7fbc1ea8f740 1 -- 172.21.15.50:0/4235159445 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b21fb14790 msgr2=0x55b21feeef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:30:37.572 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:37.569+0000 7fbc1ea8f740 1 --2- 172.21.15.50:0/4235159445 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b21fb14790 0x55b21feeef60 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fbc04005230 tx=0x7fbc04005260 comp rx=0 tx=0).stop 2024-08-31T04:30:37.572 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:37.569+0000 7fbc1ea8f740 1 -- 172.21.15.50:0/4235159445 shutdown_connections 2024-08-31T04:30:37.572 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:37.569+0000 7fbc1ea8f740 1 --2- 172.21.15.50:0/4235159445 >> [v2:172.21.15.177:6836/2159859285,v1:172.21.15.177:6837/2159859285] conn(0x55b21fafbfd0 0x55b21ff01480 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:37.572 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:37.569+0000 7fbc1ea8f740 1 --2- 172.21.15.50:0/4235159445 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b21fb3d760 0x55b21fefb340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:37.572 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:37.569+0000 7fbc1ea8f740 1 --2- 172.21.15.50:0/4235159445 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b21fb1c970 0x55b21feef4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:37.572 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:37.569+0000 7fbc1ea8f740 1 --2- 172.21.15.50:0/4235159445 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b21fb14790 0x55b21feeef60 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:37.572 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:37.569+0000 7fbc1ea8f740 1 -- 172.21.15.50:0/4235159445 >> 172.21.15.50:0/4235159445 conn(0x55b21fb31560 msgr2=0x55b21fee6a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:30:37.572 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:37.569+0000 7fbbf6a00640 0 client.26053 ms_handle_reset on v2:172.21.15.177:6836/2159859285 2024-08-31T04:30:37.572 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:37.569+0000 7fbc1ea8f740 1 -- 172.21.15.50:0/4235159445 shutdown_connections 2024-08-31T04:30:37.572 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:37.570+0000 7fbc1ea8f740 1 -- 172.21.15.50:0/4235159445 wait complete. 2024-08-31T04:30:37.572 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:37.570+0000 7fbc1ea8f740 20 client.26053 trim_cache size 0 max 16384 2024-08-31T04:30:37.588 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:37.586+0000 7fbc1ea8f740 1 Processor -- start 2024-08-31T04:30:37.588 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:37.586+0000 7fbc1ea8f740 1 -- start start 2024-08-31T04:30:37.588 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:37.587+0000 7fbc1ea8f740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b21fb14790 0x55b21feef420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:30:37.588 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:37.587+0000 7fbc1ea8f740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b21fb1c970 0x55b21feec150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:30:37.588 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:37.587+0000 7fbc1ea8f740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b21fb3d760 0x55b21feec690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:30:37.589 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:37.587+0000 7fbc1ea8f740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fbc101b1360 con 0x55b21fb3d760 2024-08-31T04:30:37.589 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:37.587+0000 7fbc1ea8f740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7fbc101b2f90 con 0x55b21fb1c970 2024-08-31T04:30:37.589 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:37.587+0000 7fbc1ea8f740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fbc101b1a30 con 0x55b21fb14790 2024-08-31T04:30:37.589 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:37.587+0000 7fbc15400640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b21fb14790 0x55b21feef420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:30:37.590 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:37.587+0000 7fbc15400640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b21fb14790 0x55b21feef420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.50:59996/0 (socket says 172.21.15.50:59996) 2024-08-31T04:30:37.590 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:37.587+0000 7fbc15400640 1 -- 172.21.15.50:0/1926030740 learned_addr learned my addr 172.21.15.50:0/1926030740 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:30:37.590 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:37.587+0000 7fbc14a00640 1 --2- 172.21.15.50:0/1926030740 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b21fb1c970 0x55b21feec150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:30:37.590 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:37.587+0000 7fbc15e00640 1 --2- 172.21.15.50:0/1926030740 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b21fb3d760 0x55b21feec690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:30:37.590 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:37.588+0000 7fbc14a00640 1 -- 172.21.15.50:0/1926030740 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b21fb14790 msgr2=0x55b21feef420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:30:37.590 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:37.588+0000 7fbc14a00640 1 --2- 172.21.15.50:0/1926030740 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b21fb14790 0x55b21feef420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:37.590 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:37.588+0000 7fbc14a00640 1 -- 172.21.15.50:0/1926030740 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b21fb3d760 msgr2=0x55b21feec690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:30:37.590 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:37.588+0000 7fbc14a00640 1 --2- 172.21.15.50:0/1926030740 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b21fb3d760 0x55b21feec690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:37.590 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:37.588+0000 7fbc14a00640 1 -- 172.21.15.50:0/1926030740 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b21fef0220 con 0x55b21fb1c970 2024-08-31T04:30:37.590 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:37.588+0000 7fbc15400640 1 --2- 172.21.15.50:0/1926030740 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b21fb14790 0x55b21feef420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:30:37.590 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:37.588+0000 7fbc14a00640 1 --2- 172.21.15.50:0/1926030740 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b21fb1c970 0x55b21feec150 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fbbfc031440 tx=0x7fbbfc009260 comp rx=0 tx=0).ready entity=mon.2 client_cookie=179bf438a10ddbb3 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:30:37.591 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:37.588+0000 7fbc01c00640 1 -- 172.21.15.50:0/1926030740 <== mon.2 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbfc035040 con 0x55b21fb1c970 2024-08-31T04:30:37.591 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:37.589+0000 7fbc01c00640 1 -- 172.21.15.50:0/1926030740 <== mon.2 v2:172.21.15.133:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbbfc004490 con 0x55b21fb1c970 2024-08-31T04:30:37.591 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:37.589+0000 7fbc01c00640 1 -- 172.21.15.50:0/1926030740 <== mon.2 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbfc003850 con 0x55b21fb1c970 2024-08-31T04:30:37.591 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:37.589+0000 7fbc1ea8f740 1 -- 172.21.15.50:0/1926030740 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b21fb1c970 msgr2=0x55b21feec150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:30:37.592 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:37.589+0000 7fbc1ea8f740 1 --2- 172.21.15.50:0/1926030740 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b21fb1c970 0x55b21feec150 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fbbfc031440 tx=0x7fbbfc009260 comp rx=0 tx=0).stop 2024-08-31T04:30:37.592 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:37.589+0000 7fbc1ea8f740 1 -- 172.21.15.50:0/1926030740 shutdown_connections 2024-08-31T04:30:37.592 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:37.589+0000 7fbc1ea8f740 1 --2- 172.21.15.50:0/1926030740 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b21fb3d760 0x55b21feec690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:37.592 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:37.589+0000 7fbc1ea8f740 1 --2- 172.21.15.50:0/1926030740 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b21fb1c970 0x55b21feec150 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:37.592 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:37.589+0000 7fbc1ea8f740 1 --2- 172.21.15.50:0/1926030740 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b21fb14790 0x55b21feef420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:37.592 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:37.589+0000 7fbc1ea8f740 1 -- 172.21.15.50:0/1926030740 >> 172.21.15.50:0/1926030740 conn(0x55b21fb31560 msgr2=0x55b21feeed10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:30:37.592 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:37.590+0000 7fbc1ea8f740 1 -- 172.21.15.50:0/1926030740 shutdown_connections 2024-08-31T04:30:37.592 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:37.590+0000 7fbc1ea8f740 1 -- 172.21.15.50:0/1926030740 wait complete. 2024-08-31T04:30:37.592 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:37.590+0000 7fbc1ea8f740 1 -- start start 2024-08-31T04:30:37.592 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:37.590+0000 7fbc1ea8f740 1 Processor -- start 2024-08-31T04:30:37.593 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:37.591+0000 7fbc1ea8f740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b21fb14790 0x55b21fef3ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:30:37.593 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:37.591+0000 7fbc1ea8f740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b21fb1c970 0x55b21fef4160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:30:37.593 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:37.591+0000 7fbc1ea8f740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b21fb3d760 0x55b21ff64c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:30:37.593 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:37.591+0000 7fbc1ea8f740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fbc101b28c0 con 0x55b21fb3d760 2024-08-31T04:30:37.593 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:37.591+0000 7fbc1ea8f740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7fbc101b21c0 con 0x55b21fb14790 2024-08-31T04:30:37.593 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:37.591+0000 7fbc1ea8f740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fbc101af340 con 0x55b21fb1c970 2024-08-31T04:30:37.593 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:37.591+0000 7fbc1ea8f740 10 client.0 _ll_register_callbacks cb 0x7fbbfc009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:30:37.594 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:37.591+0000 7fbc14a00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b21fb1c970 0x55b21fef4160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:30:37.594 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:37.591+0000 7fbc14a00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b21fb1c970 0x55b21fef4160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.50:59998/0 (socket says 172.21.15.50:59998) 2024-08-31T04:30:37.594 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:37.591+0000 7fbc14a00640 1 -- 172.21.15.50:0/1417932682 learned_addr learned my addr 172.21.15.50:0/1417932682 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:30:37.594 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:37.591+0000 7fbc15e00640 1 --2- 172.21.15.50:0/1417932682 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b21fb3d760 0x55b21ff64c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:30:37.594 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:37.591+0000 7fbc15400640 1 --2- 172.21.15.50:0/1417932682 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b21fb14790 0x55b21fef3ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:30:37.594 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:37.592+0000 7fbc14a00640 1 -- 172.21.15.50:0/1417932682 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b21fb14790 msgr2=0x55b21fef3ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:30:37.594 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:37.592+0000 7fbc14a00640 1 --2- 172.21.15.50:0/1417932682 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b21fb14790 0x55b21fef3ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:37.594 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:37.592+0000 7fbc14a00640 1 -- 172.21.15.50:0/1417932682 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b21fb3d760 msgr2=0x55b21ff64c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:30:37.594 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:37.592+0000 7fbc14a00640 1 --2- 172.21.15.50:0/1417932682 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b21fb3d760 0x55b21ff64c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:37.594 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:37.592+0000 7fbc14a00640 1 -- 172.21.15.50:0/1417932682 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b21ff65300 con 0x55b21fb1c970 2024-08-31T04:30:37.594 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:37.592+0000 7fbc15e00640 1 --2- 172.21.15.50:0/1417932682 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b21fb3d760 0x55b21ff64c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:30:37.595 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:37.592+0000 7fbc14a00640 1 --2- 172.21.15.50:0/1417932682 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b21fb1c970 0x55b21fef4160 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fbbfc0318e0 tx=0x7fbbfc02a3f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fa50b796a94b298c server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:30:37.595 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:37.592+0000 7fbbf6a00640 10 client.0 ms_handle_connect on v2:172.21.15.177:3300/0 2024-08-31T04:30:37.596 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:37.592+0000 7fbbf6a00640 1 -- 172.21.15.50:0/1417932682 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbfc035040 con 0x55b21fb1c970 2024-08-31T04:30:37.596 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:37.592+0000 7fbbf6a00640 1 -- 172.21.15.50:0/1417932682 <== mon.1 v2:172.21.15.177:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8219+0+0 (secure 0 0 0) 0x7fbbfc0048e0 con 0x55b21fb1c970 2024-08-31T04:30:37.596 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:37.592+0000 7fbc1ea8f740 1 -- 172.21.15.50:0/1417932682 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbbfc004490 con 0x55b21fb1c970 2024-08-31T04:30:37.596 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:37.593+0000 7fbbf6a00640 1 -- 172.21.15.50:0/1417932682 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7fbbfc004ae0 con 0x55b21fb1c970 2024-08-31T04:30:37.596 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:37.593+0000 7fbc1ea8f740 10 client.26059 fetch_fsmap learned FSMap version 42 2024-08-31T04:30:37.596 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:37.593+0000 7fbc1ea8f740 1 -- 172.21.15.50:0/1417932682 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x55b21ff6c5e0 con 0x55b21fb1c970 2024-08-31T04:30:37.596 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:37.593+0000 7fbbf6a00640 1 -- 172.21.15.50:0/1417932682 <== mon.1 v2:172.21.15.177:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbbfc004490 con 0x55b21fb1c970 2024-08-31T04:30:37.596 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:37.594+0000 7fbbf6a00640 1 -- 172.21.15.50:0/1417932682 <== mon.1 v2:172.21.15.177:3300/0 5 ==== fsmap(e 42) ==== 8398+0+0 (secure 0 0 0) 0x7fbbfc06f020 con 0x55b21fb1c970 2024-08-31T04:30:37.596 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:37.594+0000 7fbc1ea8f740 10 client.26059 fetch_fsmap finished waiting for FSMap version 42 2024-08-31T04:30:37.596 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:37.594+0000 7fbc1ea8f740 10 client.26059 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.c 2024-08-31T04:30:37.596 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:37.594+0000 7fbc1ea8f740 20 client.26059 populate_metadata read hostname 'smithi050' 2024-08-31T04:30:37.596 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:37.594+0000 7fbc1ea8f740 1 --2- 172.21.15.50:0/1417932682 >> [v2:172.21.15.177:6836/2159859285,v1:172.21.15.177:6837/2159859285] conn(0x55b21fad1380 0x55b21ff6ee00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:30:37.596 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:37.594+0000 7fbc1ea8f740 4 client.26059 mds_command: new command op to 24652 tid=0 multi_id=0 [{"prefix": "ops", "flags": ["locks"], "path": "/var/run/ceph/ops-9d491f02-1-mds.c.json"}] 2024-08-31T04:30:37.596 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:37.594+0000 7fbc1ea8f740 1 -- 172.21.15.50:0/1417932682 --> [v2:172.21.15.177:6836/2159859285,v1:172.21.15.177:6837/2159859285] -- command(tid 0: {"prefix": "ops", "flags": ["locks"], "path": "/var/run/ceph/ops-9d491f02-1-mds.c.json"}) -- 0x55b21fe577f0 con 0x55b21fad1380 2024-08-31T04:30:37.597 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:37.594+0000 7fbc15400640 1 --2- 172.21.15.50:0/1417932682 >> [v2:172.21.15.177:6836/2159859285,v1:172.21.15.177:6837/2159859285] conn(0x55b21fad1380 0x55b21ff6ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:30:37.597 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:37.595+0000 7fbbf6a00640 10 client.26059 ms_handle_connect on v2:172.21.15.177:6836/2159859285 2024-08-31T04:30:37.597 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:37.595+0000 7fbc15400640 1 --2- 172.21.15.50:0/1417932682 >> [v2:172.21.15.177:6836/2159859285,v1:172.21.15.177:6837/2159859285] conn(0x55b21fad1380 0x55b21ff6ee00 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=845f230a7270d3dc server_cookie=5ca1f555a75d527a in_seq=0 out_seq=0 2024-08-31T04:30:37.711 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:30:37 smithi050 ceph-mon[17259]: pgmap v600: 97 pgs: 97 active+clean; 1.5 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 17 KiB/s wr, 21 op/s 2024-08-31T04:30:37.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:30:37 smithi177 ceph-mon[22025]: pgmap v600: 97 pgs: 97 active+clean; 1.5 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 17 KiB/s wr, 21 op/s 2024-08-31T04:30:37.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:30:37 smithi133 ceph-mon[22177]: pgmap v600: 97 pgs: 97 active+clean; 1.5 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 17 KiB/s wr, 21 op/s 2024-08-31T04:30:38.284 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:38.282+0000 7fbbf6a00640 1 -- 172.21.15.50:0/1417932682 <== mds.4 v2:172.21.15.177:6836/2159859285 1 ==== command_reply(tid 0: 0 ) ==== 8+0+58 (crc 0 0 0) 0x55b21fe577f0 con 0x55b21fad1380 2024-08-31T04:30:38.284 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:38.282+0000 7fbbf6a00640 10 client.26059 handle_command_reply: tid=0 2024-08-31T04:30:38.284 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:38.282+0000 7fbc1ea8f740 1 client.26059 shutdown 2024-08-31T04:30:38.284 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:38.282+0000 7fbc1ea8f740 1 -- 172.21.15.50:0/1417932682 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b21fb1c970 msgr2=0x55b21fef4160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:30:38.284 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:38.282+0000 7fbc1ea8f740 1 --2- 172.21.15.50:0/1417932682 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b21fb1c970 0x55b21fef4160 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fbbfc0318e0 tx=0x7fbbfc02a3f0 comp rx=0 tx=0).stop 2024-08-31T04:30:38.284 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:38.282+0000 7fbc1ea8f740 1 -- 172.21.15.50:0/1417932682 shutdown_connections 2024-08-31T04:30:38.284 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:38.282+0000 7fbc1ea8f740 1 --2- 172.21.15.50:0/1417932682 >> [v2:172.21.15.177:6836/2159859285,v1:172.21.15.177:6837/2159859285] conn(0x55b21fad1380 0x55b21ff6ee00 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:38.285 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:38.282+0000 7fbc1ea8f740 1 --2- 172.21.15.50:0/1417932682 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b21fb1c970 0x55b21fef4160 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:38.285 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:38.282+0000 7fbc1ea8f740 1 --2- 172.21.15.50:0/1417932682 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b21fb3d760 0x55b21ff64c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:38.285 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:38.282+0000 7fbc1ea8f740 1 --2- 172.21.15.50:0/1417932682 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b21fb14790 0x55b21fef3ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:38.285 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:38.282+0000 7fbc1ea8f740 1 -- 172.21.15.50:0/1417932682 >> 172.21.15.50:0/1417932682 conn(0x55b21fb31560 msgr2=0x55b21fee48a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:30:38.285 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:38.282+0000 7fbbf6a00640 0 client.26059 ms_handle_reset on v2:172.21.15.177:6836/2159859285 2024-08-31T04:30:38.285 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:38.283+0000 7fbc1ea8f740 1 -- 172.21.15.50:0/1417932682 shutdown_connections 2024-08-31T04:30:38.285 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:38.283+0000 7fbc1ea8f740 1 -- 172.21.15.50:0/1417932682 wait complete. 2024-08-31T04:30:38.285 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:38.283+0000 7fbc1ea8f740 20 client.26059 trim_cache size 0 max 16384 2024-08-31T04:30:38.285 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-08-31T04:30:38.286 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/var/run/ceph/ops-9d491f02-1-mds.c.json" 2024-08-31T04:30:38.286 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-08-31T04:30:38.286 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:38.284+0000 7fbc17e00640 1 -- 172.21.15.50:0/60103651 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fbbf80b4b30 msgr2=0x7fbbf80b7040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:30:38.286 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:38.284+0000 7fbc17e00640 1 --2- 172.21.15.50:0/60103651 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fbbf80b4b30 0x7fbbf80b7040 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fbc101061f0 tx=0x7fbbfc009560 comp rx=0 tx=0).stop 2024-08-31T04:30:38.286 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:38.284+0000 7fbc17e00640 1 -- 172.21.15.50:0/60103651 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbc10109b90 msgr2=0x7fbc10075f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:30:38.287 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:38.284+0000 7fbc17e00640 1 --2- 172.21.15.50:0/60103651 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbc10109b90 0x7fbc10075f30 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fbc08009fd0 tx=0x7fbc0800ef10 comp rx=0 tx=0).stop 2024-08-31T04:30:38.287 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:38.284+0000 7fbc17e00640 1 -- 172.21.15.50:0/60103651 shutdown_connections 2024-08-31T04:30:38.287 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:38.284+0000 7fbc17e00640 1 --2- 172.21.15.50:0/60103651 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fbbf80b4b30 0x7fbbf80b7040 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:38.287 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:38.284+0000 7fbc17e00640 1 --2- 172.21.15.50:0/60103651 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbc10109b90 0x7fbc10075f30 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:38.287 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:38.284+0000 7fbc17e00640 1 --2- 172.21.15.50:0/60103651 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbc10109240 0x7fbc100759f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:38.287 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:38.284+0000 7fbc17e00640 1 --2- 172.21.15.50:0/60103651 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbc10103900 0x7fbc100754b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:38.287 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:38.284+0000 7fbc17e00640 1 -- 172.21.15.50:0/60103651 >> 172.21.15.50:0/60103651 conn(0x7fbc1007b5f0 msgr2=0x7fbc10107330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:30:38.287 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:38.284+0000 7fbc17e00640 1 -- 172.21.15.50:0/60103651 shutdown_connections 2024-08-31T04:30:38.287 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:38.284+0000 7fbc17e00640 1 -- 172.21.15.50:0/60103651 wait complete. 2024-08-31T04:30:39.278 DEBUG:tasks.quiescer.fs.[cephfs]:Dumping ops on rank 3 (h) to a remote file /var/run/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/ops-9d491f02-1-mds.h.json 2024-08-31T04:30:39.279 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 058d9fc6-674f-11ef-bcd4-c7b262605968 -- ceph tell mds.1:3 ops --flags=locks --path=/var/run/ceph/ops-9d491f02-1-mds.h.json 2024-08-31T04:30:39.668 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:30:39.674 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:30:39 smithi050 ceph-mon[17259]: pgmap v601: 97 pgs: 97 active+clean; 1.5 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 59 KiB/s wr, 23 op/s 2024-08-31T04:30:39.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:30:39 smithi177 ceph-mon[22025]: pgmap v601: 97 pgs: 97 active+clean; 1.5 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 59 KiB/s wr, 23 op/s 2024-08-31T04:30:39.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:30:39 smithi133 ceph-mon[22177]: pgmap v601: 97 pgs: 97 active+clean; 1.5 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 59 KiB/s wr, 23 op/s 2024-08-31T04:30:40.637 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:40.600+0000 7fe3c3200640 1 -- 172.21.15.50:0/4059863768 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe3bc103920 msgr2=0x7fe3bc103d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:30:40.637 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:40.600+0000 7fe3c3200640 1 --2- 172.21.15.50:0/4059863768 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe3bc103920 0x7fe3bc103d30 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fe3ac009900 tx=0x7fe3ac02a410 comp rx=0 tx=0).stop 2024-08-31T04:30:40.638 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:40.600+0000 7fe3c3200640 1 -- 172.21.15.50:0/4059863768 shutdown_connections 2024-08-31T04:30:40.638 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:40.600+0000 7fe3c3200640 1 --2- 172.21.15.50:0/4059863768 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe3bc109bb0 0x7fe3bc1103e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:40.638 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:40.600+0000 7fe3c3200640 1 --2- 172.21.15.50:0/4059863768 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe3bc109260 0x7fe3bc109670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:40.638 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:40.600+0000 7fe3c3200640 1 --2- 172.21.15.50:0/4059863768 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe3bc103920 0x7fe3bc103d30 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:40.638 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:40.600+0000 7fe3c3200640 1 -- 172.21.15.50:0/4059863768 >> 172.21.15.50:0/4059863768 conn(0x7fe3bc0ff370 msgr2=0x7fe3bc1017c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:30:40.638 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:40.600+0000 7fe3c3200640 1 -- 172.21.15.50:0/4059863768 shutdown_connections 2024-08-31T04:30:40.638 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:40.600+0000 7fe3c3200640 1 -- 172.21.15.50:0/4059863768 wait complete. 2024-08-31T04:30:40.638 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:40.601+0000 7fe3c3200640 1 Processor -- start 2024-08-31T04:30:40.638 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:40.601+0000 7fe3c3200640 1 -- start start 2024-08-31T04:30:40.638 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:40.601+0000 7fe3c3200640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe3bc103920 0x7fe3bc19a270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:30:40.638 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:40.601+0000 7fe3c3200640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe3bc109260 0x7fe3bc19a810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:30:40.638 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:40.601+0000 7fe3c3200640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe3bc109bb0 0x7fe3bc19fab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:30:40.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:40.601+0000 7fe3c3200640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fe3bc1138c0 con 0x7fe3bc109260 2024-08-31T04:30:40.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:40.601+0000 7fe3c3200640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7fe3bc113740 con 0x7fe3bc109bb0 2024-08-31T04:30:40.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:40.601+0000 7fe3c3200640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fe3bc113a40 con 0x7fe3bc103920 2024-08-31T04:30:40.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:40.602+0000 7fe3bb400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe3bc109260 0x7fe3bc19a810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:30:40.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:40.602+0000 7fe3bbe00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe3bc103920 0x7fe3bc19a270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:30:40.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:40.602+0000 7fe3bb400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe3bc109260 0x7fe3bc19a810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:55266/0 (socket says 172.21.15.50:55266) 2024-08-31T04:30:40.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:40.602+0000 7fe3bb400640 1 -- 172.21.15.50:0/329642610 learned_addr learned my addr 172.21.15.50:0/329642610 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:30:40.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:40.602+0000 7fe3bbe00640 1 --2- 172.21.15.50:0/329642610 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe3bc103920 0x7fe3bc19a270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.50:60012/0 (socket says 172.21.15.50:60012) 2024-08-31T04:30:40.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:40.602+0000 7fe3c1200640 1 --2- 172.21.15.50:0/329642610 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe3bc109bb0 0x7fe3bc19fab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:30:40.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:40.602+0000 7fe3bb400640 1 -- 172.21.15.50:0/329642610 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe3bc103920 msgr2=0x7fe3bc19a270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:30:40.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:40.602+0000 7fe3bb400640 1 --2- 172.21.15.50:0/329642610 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe3bc103920 0x7fe3bc19a270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:40.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:40.602+0000 7fe3bb400640 1 -- 172.21.15.50:0/329642610 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe3bc109bb0 msgr2=0x7fe3bc19fab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:30:40.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:40.602+0000 7fe3bb400640 1 --2- 172.21.15.50:0/329642610 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe3bc109bb0 0x7fe3bc19fab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:40.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:40.602+0000 7fe3bb400640 1 -- 172.21.15.50:0/329642610 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3bc1a01e0 con 0x7fe3bc109260 2024-08-31T04:30:40.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:40.602+0000 7fe3bbe00640 1 --2- 172.21.15.50:0/329642610 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe3bc103920 0x7fe3bc19a270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:30:40.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:40.603+0000 7fe3bb400640 1 --2- 172.21.15.50:0/329642610 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe3bc109260 0x7fe3bc19a810 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fe3a800e9f0 tx=0x7fe3a800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:30:40.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:40.603+0000 7fe3b8c00640 1 -- 172.21.15.50:0/329642610 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3a800ccc0 con 0x7fe3bc109260 2024-08-31T04:30:40.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:40.603+0000 7fe3b8c00640 1 -- 172.21.15.50:0/329642610 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe3a80108e0 con 0x7fe3bc109260 2024-08-31T04:30:40.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:40.603+0000 7fe3c3200640 1 -- 172.21.15.50:0/329642610 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe3bc1a04d0 con 0x7fe3bc109260 2024-08-31T04:30:40.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:40.603+0000 7fe3b8c00640 1 -- 172.21.15.50:0/329642610 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3a8018860 con 0x7fe3bc109260 2024-08-31T04:30:40.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:40.603+0000 7fe3c3200640 1 -- 172.21.15.50:0/329642610 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe3bc1a6c30 con 0x7fe3bc109260 2024-08-31T04:30:40.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:40.606+0000 7fe3c9e28740 1 Processor -- start 2024-08-31T04:30:40.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:40.606+0000 7fe3c9e28740 1 -- start start 2024-08-31T04:30:40.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:40.607+0000 7fe3c9e28740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559ca1f20760 0x559ca22c6870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:30:40.640 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:40.607+0000 7fe3c9e28740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559ca1ef7790 0x559ca22c6db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:30:40.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:40.607+0000 7fe3c9e28740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559ca1eff970 0x559ca22c72f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:30:40.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:40.607+0000 7fe3c9e28740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x559ca223ce00 con 0x559ca1ef7790 2024-08-31T04:30:40.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:40.607+0000 7fe3c9e28740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x559ca222c390 con 0x559ca1eff970 2024-08-31T04:30:40.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:40.607+0000 7fe3c9e28740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x559ca2230340 con 0x559ca1f20760 2024-08-31T04:30:40.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:40.607+0000 7fe3c1200640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559ca1f20760 0x559ca22c6870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:30:40.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:40.607+0000 7fe3bbe00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559ca1ef7790 0x559ca22c6db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:30:40.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:40.607+0000 7fe3c1200640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559ca1f20760 0x559ca22c6870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.50:60016/0 (socket says 172.21.15.50:60016) 2024-08-31T04:30:40.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:40.607+0000 7fe3c1200640 1 -- 172.21.15.50:0/1620171825 learned_addr learned my addr 172.21.15.50:0/1620171825 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:30:40.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:40.607+0000 7fe3b8c00640 1 -- 172.21.15.50:0/329642610 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 18) ==== 152577+0+0 (secure 0 0 0) 0x7fe3a8010430 con 0x7fe3bc109260 2024-08-31T04:30:40.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:40.608+0000 7fe3c1200640 1 -- 172.21.15.50:0/1620171825 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559ca1eff970 msgr2=0x559ca22c72f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:30:40.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:40.608+0000 7fe3c1200640 1 --2- 172.21.15.50:0/1620171825 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559ca1eff970 0x559ca22c72f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:40.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:40.608+0000 7fe3c1200640 1 -- 172.21.15.50:0/1620171825 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559ca1ef7790 msgr2=0x559ca22c6db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:30:40.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:40.608+0000 7fe3c1200640 1 --2- 172.21.15.50:0/1620171825 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559ca1ef7790 0x559ca22c6db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:40.642 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:40.608+0000 7fe3c1200640 1 -- 172.21.15.50:0/1620171825 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559ca1ffe490 con 0x559ca1f20760 2024-08-31T04:30:40.642 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:40.608+0000 7fe3bbe00640 1 --2- 172.21.15.50:0/1620171825 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559ca1ef7790 0x559ca22c6db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:30:40.642 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:40.608+0000 7fe3c1200640 1 --2- 172.21.15.50:0/1620171825 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559ca1f20760 0x559ca22c6870 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fe3b4009fd0 tx=0x7fe3b40118d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8ca95e96545eb6d5 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:30:40.642 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:40.608+0000 7fe3b1600640 1 -- 172.21.15.50:0/1620171825 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3b4004d20 con 0x559ca1f20760 2024-08-31T04:30:40.642 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:40.608+0000 7fe3b1600640 1 -- 172.21.15.50:0/1620171825 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe3b4004050 con 0x559ca1f20760 2024-08-31T04:30:40.642 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:40.608+0000 7fe3b1600640 1 -- 172.21.15.50:0/1620171825 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3b4005280 con 0x559ca1f20760 2024-08-31T04:30:40.642 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:40.609+0000 7fe3b8c00640 1 --2- 172.21.15.50:0/329642610 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fe3a00b4b30 0x7fe3a00b7040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:30:40.642 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:40.609+0000 7fe3c9e28740 1 -- 172.21.15.50:0/1620171825 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559ca1f20760 msgr2=0x559ca22c6870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:30:40.642 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:40.609+0000 7fe3c9e28740 1 --2- 172.21.15.50:0/1620171825 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559ca1f20760 0x559ca22c6870 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fe3b4009fd0 tx=0x7fe3b40118d0 comp rx=0 tx=0).stop 2024-08-31T04:30:40.642 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:40.609+0000 7fe3b8c00640 1 -- 172.21.15.50:0/329642610 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8219+0+0 (secure 0 0 0) 0x7fe3a80e5410 con 0x7fe3bc109260 2024-08-31T04:30:40.642 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:40.609+0000 7fe3c9e28740 1 -- 172.21.15.50:0/1620171825 shutdown_connections 2024-08-31T04:30:40.642 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:40.609+0000 7fe3c9e28740 1 --2- 172.21.15.50:0/1620171825 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559ca1eff970 0x559ca22c72f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:40.642 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:40.609+0000 7fe3c9e28740 1 --2- 172.21.15.50:0/1620171825 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559ca1ef7790 0x559ca22c6db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:40.643 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:40.609+0000 7fe3c9e28740 1 --2- 172.21.15.50:0/1620171825 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559ca1f20760 0x559ca22c6870 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:40.643 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:40.609+0000 7fe3c9e28740 1 -- 172.21.15.50:0/1620171825 >> 172.21.15.50:0/1620171825 conn(0x559ca1f14560 msgr2=0x559ca22c4760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:30:40.643 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:40.610+0000 7fe3bbe00640 1 --2- 172.21.15.50:0/329642610 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fe3a00b4b30 0x7fe3a00b7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:30:40.643 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:40.610+0000 7fe3c9e28740 1 -- 172.21.15.50:0/1620171825 shutdown_connections 2024-08-31T04:30:40.643 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:40.610+0000 7fe3c9e28740 1 -- 172.21.15.50:0/1620171825 wait complete. 2024-08-31T04:30:40.643 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:40.610+0000 7fe3c9e28740 1 -- start start 2024-08-31T04:30:40.643 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:40.611+0000 7fe3bbe00640 1 --2- 172.21.15.50:0/329642610 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fe3a00b4b30 0x7fe3a00b7040 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fe3ac005ab0 tx=0x7fe3ac005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:30:40.643 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:40.611+0000 7fe3c9e28740 1 Processor -- start 2024-08-31T04:30:40.643 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:40.611+0000 7fe3c9e28740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559ca1ef7790 0x559ca22d1f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:30:40.643 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:40.611+0000 7fe3c9e28740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559ca1eff970 0x559ca22d24b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:30:40.643 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:40.611+0000 7fe3c9e28740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559ca1f20760 0x559ca22de340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:30:40.643 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:40.611+0000 7fe3c9e28740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x559ca208f380 con 0x559ca1eff970 2024-08-31T04:30:40.644 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:40.611+0000 7fe3c9e28740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x559ca21b2cc0 con 0x559ca1ef7790 2024-08-31T04:30:40.644 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:40.611+0000 7fe3c9e28740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x559ca22d5050 con 0x559ca1f20760 2024-08-31T04:30:40.644 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:40.612+0000 7fe3c9e28740 10 client.0 _ll_register_callbacks cb 0x559ca21e2020 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:30:40.644 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:40.612+0000 7fe3bb400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559ca1eff970 0x559ca22d24b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:30:40.644 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:40.612+0000 7fe3bbe00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559ca1ef7790 0x559ca22d1f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:30:40.644 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:40.612+0000 7fe3bb400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559ca1eff970 0x559ca22d24b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:55282/0 (socket says 172.21.15.50:55282) 2024-08-31T04:30:40.644 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:40.612+0000 7fe3bb400640 1 -- 172.21.15.50:0/3331182521 learned_addr learned my addr 172.21.15.50:0/3331182521 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:30:40.644 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:40.612+0000 7fe3c1200640 1 --2- 172.21.15.50:0/3331182521 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559ca1f20760 0x559ca22de340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:30:40.644 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:40.612+0000 7fe3bb400640 1 -- 172.21.15.50:0/3331182521 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559ca1f20760 msgr2=0x559ca22de340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:30:40.644 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:40.612+0000 7fe3bb400640 1 --2- 172.21.15.50:0/3331182521 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559ca1f20760 0x559ca22de340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:40.644 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:40.612+0000 7fe3bb400640 1 -- 172.21.15.50:0/3331182521 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559ca1ef7790 msgr2=0x559ca22d1f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:30:40.644 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:40.612+0000 7fe3bb400640 1 --2- 172.21.15.50:0/3331182521 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559ca1ef7790 0x559ca22d1f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:40.644 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:40.612+0000 7fe3bb400640 1 -- 172.21.15.50:0/3331182521 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559ca21f2b30 con 0x559ca1eff970 2024-08-31T04:30:40.645 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:40.613+0000 7fe3bb400640 1 --2- 172.21.15.50:0/3331182521 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559ca1eff970 0x559ca22d24b0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fe3a80abe30 tx=0x7fe3a800ce60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6dcf3bd04984b4a7 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:30:40.645 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:40.613+0000 7fe3a6000640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-08-31T04:30:40.645 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:40.613+0000 7fe3a6000640 1 -- 172.21.15.50:0/3331182521 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3a80b0660 con 0x559ca1eff970 2024-08-31T04:30:40.645 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:40.613+0000 7fe3a6000640 1 -- 172.21.15.50:0/3331182521 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8219+0+0 (secure 0 0 0) 0x7fe3a80b02a0 con 0x559ca1eff970 2024-08-31T04:30:40.645 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:40.613+0000 7fe3c9e28740 1 -- 172.21.15.50:0/3331182521 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe3b4004050 con 0x559ca1eff970 2024-08-31T04:30:40.645 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:40.613+0000 7fe3a6000640 1 -- 172.21.15.50:0/3331182521 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7fe3a80b5110 con 0x559ca1eff970 2024-08-31T04:30:40.645 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:40.613+0000 7fe3c9e28740 10 client.16089 fetch_fsmap learned FSMap version 42 2024-08-31T04:30:40.645 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:40.613+0000 7fe3c9e28740 1 -- 172.21.15.50:0/3331182521 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x559ca22e11b0 con 0x559ca1eff970 2024-08-31T04:30:40.645 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:40.613+0000 7fe3a6000640 1 -- 172.21.15.50:0/3331182521 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe3b4004050 con 0x559ca1eff970 2024-08-31T04:30:40.645 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:40.614+0000 7fe3a6000640 1 -- 172.21.15.50:0/3331182521 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 42) ==== 8398+0+0 (secure 0 0 0) 0x7fe3a8091ce0 con 0x559ca1eff970 2024-08-31T04:30:40.645 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:40.614+0000 7fe3c9e28740 10 client.16089 fetch_fsmap finished waiting for FSMap version 42 2024-08-31T04:30:40.645 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:40.614+0000 7fe3c9e28740 10 client.16089 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.h 2024-08-31T04:30:40.645 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:40.614+0000 7fe3c9e28740 20 client.16089 populate_metadata read hostname 'smithi050' 2024-08-31T04:30:40.645 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:40.614+0000 7fe3c9e28740 1 --2- 172.21.15.50:0/3331182521 >> [v2:172.21.15.133:6836/4014853202,v1:172.21.15.133:6837/4014853202] conn(0x559ca1edefd0 0x559ca22e4720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:30:40.645 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:40.614+0000 7fe3c9e28740 4 client.16089 mds_command: new command op to 24656 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T04:30:40.646 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:40.614+0000 7fe3c9e28740 1 -- 172.21.15.50:0/3331182521 --> [v2:172.21.15.133:6836/4014853202,v1:172.21.15.133:6837/4014853202] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559ca223ed50 con 0x559ca1edefd0 2024-08-31T04:30:40.646 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:40.614+0000 7fe3bbe00640 1 --2- 172.21.15.50:0/3331182521 >> [v2:172.21.15.133:6836/4014853202,v1:172.21.15.133:6837/4014853202] conn(0x559ca1edefd0 0x559ca22e4720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:30:40.646 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:40.615+0000 7fe3bbe00640 1 --2- 172.21.15.50:0/3331182521 >> [v2:172.21.15.133:6836/4014853202,v1:172.21.15.133:6837/4014853202] conn(0x559ca1edefd0 0x559ca22e4720 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=c3964a2b7168ca8a server_cookie=67d237f515683e8f in_seq=0 out_seq=0 2024-08-31T04:30:40.646 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:40.615+0000 7fe3a6000640 10 client.16089 ms_handle_connect on v2:172.21.15.133:6836/4014853202 2024-08-31T04:30:40.646 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:40.616+0000 7fe3a6000640 1 -- 172.21.15.50:0/3331182521 <== mds.3 v2:172.21.15.133:6836/4014853202 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x559ca223ed50 con 0x559ca1edefd0 2024-08-31T04:30:40.646 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:40.616+0000 7fe3a6000640 10 client.16089 handle_command_reply: tid=0 2024-08-31T04:30:40.646 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:40.616+0000 7fe3c9e28740 1 client.16089 shutdown 2024-08-31T04:30:40.646 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:40.616+0000 7fe3c9e28740 1 -- 172.21.15.50:0/3331182521 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559ca1eff970 msgr2=0x559ca22d24b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:30:40.646 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:40.616+0000 7fe3c9e28740 1 --2- 172.21.15.50:0/3331182521 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559ca1eff970 0x559ca22d24b0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fe3a80abe30 tx=0x7fe3a800ce60 comp rx=0 tx=0).stop 2024-08-31T04:30:40.646 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:40.616+0000 7fe3c9e28740 1 -- 172.21.15.50:0/3331182521 shutdown_connections 2024-08-31T04:30:40.646 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:40.616+0000 7fe3c9e28740 1 --2- 172.21.15.50:0/3331182521 >> [v2:172.21.15.133:6836/4014853202,v1:172.21.15.133:6837/4014853202] conn(0x559ca1edefd0 0x559ca22e4720 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:40.646 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:40.616+0000 7fe3c9e28740 1 --2- 172.21.15.50:0/3331182521 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559ca1f20760 0x559ca22de340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:40.646 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:40.616+0000 7fe3c9e28740 1 --2- 172.21.15.50:0/3331182521 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559ca1eff970 0x559ca22d24b0 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:40.647 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:40.616+0000 7fe3a6000640 0 client.16089 ms_handle_reset on v2:172.21.15.133:6836/4014853202 2024-08-31T04:30:40.647 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:40.616+0000 7fe3c9e28740 1 --2- 172.21.15.50:0/3331182521 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559ca1ef7790 0x559ca22d1f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:40.647 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:40.616+0000 7fe3c9e28740 1 -- 172.21.15.50:0/3331182521 >> 172.21.15.50:0/3331182521 conn(0x559ca1f14560 msgr2=0x559ca22c9a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:30:40.647 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:40.616+0000 7fe3c9e28740 1 -- 172.21.15.50:0/3331182521 shutdown_connections 2024-08-31T04:30:40.647 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:40.617+0000 7fe3c9e28740 1 -- 172.21.15.50:0/3331182521 wait complete. 2024-08-31T04:30:40.647 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:40.617+0000 7fe3c9e28740 20 client.16089 trim_cache size 0 max 16384 2024-08-31T04:30:40.647 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:40.634+0000 7fe3c9e28740 1 Processor -- start 2024-08-31T04:30:40.647 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:40.634+0000 7fe3c9e28740 1 -- start start 2024-08-31T04:30:40.647 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:40.634+0000 7fe3c9e28740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559ca1ef7790 0x559ca22de240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:30:40.647 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:40.634+0000 7fe3c9e28740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559ca1eff970 0x559ca22c7b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:30:40.647 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:40.634+0000 7fe3c9e28740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559ca1f20760 0x559ca22c80a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:30:40.647 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:40.634+0000 7fe3c9e28740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fe3bc1aced0 con 0x559ca1eff970 2024-08-31T04:30:40.647 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:40.634+0000 7fe3c9e28740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7fe3bc1aeb00 con 0x559ca1ef7790 2024-08-31T04:30:40.647 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:40.634+0000 7fe3c9e28740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fe3bc1ad5a0 con 0x559ca1f20760 2024-08-31T04:30:40.648 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:40.635+0000 7fe3bb400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559ca1eff970 0x559ca22c7b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:30:40.648 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:40.635+0000 7fe3bb400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559ca1eff970 0x559ca22c7b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:55284/0 (socket says 172.21.15.50:55284) 2024-08-31T04:30:40.648 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:40.635+0000 7fe3bb400640 1 -- 172.21.15.50:0/2106644708 learned_addr learned my addr 172.21.15.50:0/2106644708 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:30:40.648 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:40.635+0000 7fe3bbe00640 1 --2- 172.21.15.50:0/2106644708 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559ca1ef7790 0x559ca22de240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:30:40.648 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:40.635+0000 7fe3c1200640 1 --2- 172.21.15.50:0/2106644708 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559ca1f20760 0x559ca22c80a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:30:40.648 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:40.636+0000 7fe3bb400640 1 -- 172.21.15.50:0/2106644708 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559ca1f20760 msgr2=0x559ca22c80a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:30:40.648 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:40.636+0000 7fe3bb400640 1 --2- 172.21.15.50:0/2106644708 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559ca1f20760 0x559ca22c80a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:40.648 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:40.636+0000 7fe3bb400640 1 -- 172.21.15.50:0/2106644708 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559ca1ef7790 msgr2=0x559ca22de240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:30:40.648 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:40.636+0000 7fe3bb400640 1 --2- 172.21.15.50:0/2106644708 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559ca1ef7790 0x559ca22de240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:40.648 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:40.636+0000 7fe3bb400640 1 -- 172.21.15.50:0/2106644708 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559ca22d4550 con 0x559ca1eff970 2024-08-31T04:30:40.651 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:40.636+0000 7fe3bb400640 1 --2- 172.21.15.50:0/2106644708 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559ca1eff970 0x559ca22c7b60 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fe3a800c6a0 tx=0x7fe3a80a7d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95d5a151214f79a6 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:30:40.651 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:40.637+0000 7fe3b0c00640 1 -- 172.21.15.50:0/2106644708 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3a80ab9b0 con 0x559ca1eff970 2024-08-31T04:30:40.651 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:40.637+0000 7fe3b0c00640 1 -- 172.21.15.50:0/2106644708 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe3a80b0660 con 0x559ca1eff970 2024-08-31T04:30:40.651 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:40.637+0000 7fe3b0c00640 1 -- 172.21.15.50:0/2106644708 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3a80aab70 con 0x559ca1eff970 2024-08-31T04:30:40.651 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:40.638+0000 7fe3c9e28740 1 -- 172.21.15.50:0/2106644708 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559ca1eff970 msgr2=0x559ca22c7b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:30:40.651 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:40.638+0000 7fe3c9e28740 1 --2- 172.21.15.50:0/2106644708 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559ca1eff970 0x559ca22c7b60 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fe3a800c6a0 tx=0x7fe3a80a7d60 comp rx=0 tx=0).stop 2024-08-31T04:30:40.651 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:40.638+0000 7fe3c9e28740 1 -- 172.21.15.50:0/2106644708 shutdown_connections 2024-08-31T04:30:40.651 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:40.638+0000 7fe3c9e28740 1 --2- 172.21.15.50:0/2106644708 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559ca1f20760 0x559ca22c80a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:40.652 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:40.638+0000 7fe3c9e28740 1 --2- 172.21.15.50:0/2106644708 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559ca1eff970 0x559ca22c7b60 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:40.652 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:40.638+0000 7fe3c9e28740 1 --2- 172.21.15.50:0/2106644708 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559ca1ef7790 0x559ca22de240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:40.652 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:40.638+0000 7fe3c9e28740 1 -- 172.21.15.50:0/2106644708 >> 172.21.15.50:0/2106644708 conn(0x559ca1f14560 msgr2=0x559ca22c7450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:30:40.652 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:40.638+0000 7fe3c9e28740 1 -- 172.21.15.50:0/2106644708 shutdown_connections 2024-08-31T04:30:40.652 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:40.638+0000 7fe3c9e28740 1 -- 172.21.15.50:0/2106644708 wait complete. 2024-08-31T04:30:40.652 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:40.639+0000 7fe3c9e28740 1 -- start start 2024-08-31T04:30:40.652 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:40.639+0000 7fe3c9e28740 1 Processor -- start 2024-08-31T04:30:40.652 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:40.639+0000 7fe3c9e28740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559ca1ef7790 0x559ca22d8b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:30:40.652 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:40.639+0000 7fe3c9e28740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559ca1eff970 0x559ca22d9170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:30:40.652 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:40.639+0000 7fe3c9e28740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559ca1f20760 0x559ca2348090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:30:40.652 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:40.639+0000 7fe3c9e28740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fe3bc1ae430 con 0x559ca1f20760 2024-08-31T04:30:40.652 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:40.639+0000 7fe3c9e28740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7fe3bc1add30 con 0x559ca1ef7790 2024-08-31T04:30:40.652 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:40.639+0000 7fe3c9e28740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fe3bc1aaeb0 con 0x559ca1eff970 2024-08-31T04:30:40.653 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:40.640+0000 7fe3c9e28740 10 client.0 _ll_register_callbacks cb 0x7fe3a800e940 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:30:40.653 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:40.640+0000 7fe3bbe00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559ca1ef7790 0x559ca22d8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:30:40.653 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:40.640+0000 7fe3bbe00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559ca1ef7790 0x559ca22d8b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.50:48118/0 (socket says 172.21.15.50:48118) 2024-08-31T04:30:40.653 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:40.640+0000 7fe3bbe00640 1 -- 172.21.15.50:0/3876572551 learned_addr learned my addr 172.21.15.50:0/3876572551 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:30:40.653 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:40.640+0000 7fe3c1200640 1 --2- 172.21.15.50:0/3876572551 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559ca1f20760 0x559ca2348090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:30:40.653 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:40.640+0000 7fe3bb400640 1 --2- 172.21.15.50:0/3876572551 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559ca1eff970 0x559ca22d9170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:30:40.653 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:40.640+0000 7fe3bbe00640 1 -- 172.21.15.50:0/3876572551 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559ca1eff970 msgr2=0x559ca22d9170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:30:40.653 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:40.640+0000 7fe3bbe00640 1 --2- 172.21.15.50:0/3876572551 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559ca1eff970 0x559ca22d9170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:40.653 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:40.640+0000 7fe3bbe00640 1 -- 172.21.15.50:0/3876572551 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559ca1f20760 msgr2=0x559ca2348090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:30:40.653 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:40.640+0000 7fe3bbe00640 1 --2- 172.21.15.50:0/3876572551 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559ca1f20760 0x559ca2348090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:40.653 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:40.641+0000 7fe3bbe00640 1 -- 172.21.15.50:0/3876572551 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559ca2348700 con 0x559ca1ef7790 2024-08-31T04:30:40.653 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:40.641+0000 7fe3c1200640 1 --2- 172.21.15.50:0/3876572551 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559ca1f20760 0x559ca2348090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:30:40.653 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:40.641+0000 7fe3bbe00640 1 --2- 172.21.15.50:0/3876572551 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559ca1ef7790 0x559ca22d8b90 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fe3ac000c00 tx=0x7fe3ac02a410 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5860cbef1457a156 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:30:40.653 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:40.641+0000 7fe3a6000640 10 client.0 ms_handle_connect on v2:172.21.15.133:3300/0 2024-08-31T04:30:40.654 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:40.641+0000 7fe3a6000640 1 -- 172.21.15.50:0/3876572551 <== mon.2 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3ac035040 con 0x559ca1ef7790 2024-08-31T04:30:40.654 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:40.641+0000 7fe3c9e28740 1 -- 172.21.15.50:0/3876572551 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe3a80b0660 con 0x559ca1ef7790 2024-08-31T04:30:40.654 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:40.641+0000 7fe3a6000640 1 -- 172.21.15.50:0/3876572551 <== mon.2 v2:172.21.15.133:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8219+0+0 (secure 0 0 0) 0x7fe3ac004770 con 0x559ca1ef7790 2024-08-31T04:30:40.654 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:40.642+0000 7fe3a6000640 1 -- 172.21.15.50:0/3876572551 <== mon.2 v2:172.21.15.133:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7fe3ac004970 con 0x559ca1ef7790 2024-08-31T04:30:40.654 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:40.642+0000 7fe3c9e28740 10 client.26108 fetch_fsmap learned FSMap version 42 2024-08-31T04:30:40.654 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:40.642+0000 7fe3c9e28740 1 -- 172.21.15.50:0/3876572551 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x559ca234f9b0 con 0x559ca1ef7790 2024-08-31T04:30:40.654 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:40.642+0000 7fe3a6000640 1 -- 172.21.15.50:0/3876572551 <== mon.2 v2:172.21.15.133:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe3a80b0660 con 0x559ca1ef7790 2024-08-31T04:30:40.654 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:40.643+0000 7fe3a6000640 1 -- 172.21.15.50:0/3876572551 <== mon.2 v2:172.21.15.133:3300/0 5 ==== fsmap(e 42) ==== 8398+0+0 (secure 0 0 0) 0x7fe3ac0314a0 con 0x559ca1ef7790 2024-08-31T04:30:40.654 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:40.643+0000 7fe3c9e28740 10 client.26108 fetch_fsmap finished waiting for FSMap version 42 2024-08-31T04:30:40.654 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:40.643+0000 7fe3c9e28740 10 client.26108 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.h 2024-08-31T04:30:40.654 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:40.643+0000 7fe3c9e28740 20 client.26108 populate_metadata read hostname 'smithi050' 2024-08-31T04:30:40.654 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:40.643+0000 7fe3c9e28740 1 --2- 172.21.15.50:0/3876572551 >> [v2:172.21.15.133:6836/4014853202,v1:172.21.15.133:6837/4014853202] conn(0x559ca1eb4380 0x559ca23521c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:30:40.654 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:40.643+0000 7fe3c9e28740 4 client.26108 mds_command: new command op to 24656 tid=0 multi_id=0 [{"prefix": "ops", "flags": ["locks"], "path": "/var/run/ceph/ops-9d491f02-1-mds.h.json"}] 2024-08-31T04:30:40.654 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:40.643+0000 7fe3c9e28740 1 -- 172.21.15.50:0/3876572551 --> [v2:172.21.15.133:6836/4014853202,v1:172.21.15.133:6837/4014853202] -- command(tid 0: {"prefix": "ops", "flags": ["locks"], "path": "/var/run/ceph/ops-9d491f02-1-mds.h.json"}) -- 0x559ca223a7f0 con 0x559ca1eb4380 2024-08-31T04:30:40.654 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:40.643+0000 7fe3bb400640 1 --2- 172.21.15.50:0/3876572551 >> [v2:172.21.15.133:6836/4014853202,v1:172.21.15.133:6837/4014853202] conn(0x559ca1eb4380 0x559ca23521c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:30:40.655 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:40.644+0000 7fe3bb400640 1 --2- 172.21.15.50:0/3876572551 >> [v2:172.21.15.133:6836/4014853202,v1:172.21.15.133:6837/4014853202] conn(0x559ca1eb4380 0x559ca23521c0 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=e111c06524990532 server_cookie=df2adf7d72c5482e in_seq=0 out_seq=0 2024-08-31T04:30:40.655 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:40.644+0000 7fe3a6000640 10 client.26108 ms_handle_connect on v2:172.21.15.133:6836/4014853202 2024-08-31T04:30:41.389 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:41.387+0000 7fe3a6000640 1 -- 172.21.15.50:0/3876572551 <== mds.3 v2:172.21.15.133:6836/4014853202 1 ==== command_reply(tid 0: 0 ) ==== 8+0+58 (crc 0 0 0) 0x559ca223a7f0 con 0x559ca1eb4380 2024-08-31T04:30:41.389 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:41.387+0000 7fe3a6000640 10 client.26108 handle_command_reply: tid=0 2024-08-31T04:30:41.390 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:41.387+0000 7fe3c9e28740 1 client.26108 shutdown 2024-08-31T04:30:41.390 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:41.388+0000 7fe3c9e28740 1 -- 172.21.15.50:0/3876572551 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559ca1ef7790 msgr2=0x559ca22d8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:30:41.390 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:41.388+0000 7fe3c9e28740 1 --2- 172.21.15.50:0/3876572551 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559ca1ef7790 0x559ca22d8b90 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fe3ac000c00 tx=0x7fe3ac02a410 comp rx=0 tx=0).stop 2024-08-31T04:30:41.390 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:41.388+0000 7fe3c9e28740 1 -- 172.21.15.50:0/3876572551 shutdown_connections 2024-08-31T04:30:41.390 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:41.388+0000 7fe3c9e28740 1 --2- 172.21.15.50:0/3876572551 >> [v2:172.21.15.133:6836/4014853202,v1:172.21.15.133:6837/4014853202] conn(0x559ca1eb4380 0x559ca23521c0 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:41.390 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:41.388+0000 7fe3c9e28740 1 --2- 172.21.15.50:0/3876572551 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559ca1eff970 0x559ca22d9170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:41.390 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:41.388+0000 7fe3c9e28740 1 --2- 172.21.15.50:0/3876572551 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559ca1f20760 0x559ca2348090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:41.390 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:41.388+0000 7fe3c9e28740 1 --2- 172.21.15.50:0/3876572551 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559ca1ef7790 0x559ca22d8b90 secure :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fe3ac000c00 tx=0x7fe3ac02a410 comp rx=0 tx=0).stop 2024-08-31T04:30:41.390 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:41.388+0000 7fe3c9e28740 1 -- 172.21.15.50:0/3876572551 >> 172.21.15.50:0/3876572551 conn(0x559ca1f14560 msgr2=0x559ca22c7e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:30:41.390 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:41.388+0000 7fe3a6000640 0 client.26108 ms_handle_reset on v2:172.21.15.133:6836/4014853202 2024-08-31T04:30:41.391 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:41.388+0000 7fe3c9e28740 1 -- 172.21.15.50:0/3876572551 shutdown_connections 2024-08-31T04:30:41.391 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:41.389+0000 7fe3c9e28740 1 -- 172.21.15.50:0/3876572551 wait complete. 2024-08-31T04:30:41.391 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:41.389+0000 7fe3c9e28740 20 client.26108 trim_cache size 0 max 16384 2024-08-31T04:30:41.391 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-08-31T04:30:41.391 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/var/run/ceph/ops-9d491f02-1-mds.h.json" 2024-08-31T04:30:41.391 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-08-31T04:30:41.392 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:41.390+0000 7fe3c3200640 1 -- 172.21.15.50:0/329642610 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fe3a00b4b30 msgr2=0x7fe3a00b7040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:30:41.392 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:41.390+0000 7fe3c3200640 1 --2- 172.21.15.50:0/329642610 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fe3a00b4b30 0x7fe3a00b7040 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fe3ac005ab0 tx=0x7fe3ac005a20 comp rx=0 tx=0).stop 2024-08-31T04:30:41.392 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:41.390+0000 7fe3c3200640 1 -- 172.21.15.50:0/329642610 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe3bc109260 msgr2=0x7fe3bc19a810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:30:41.392 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:41.390+0000 7fe3c3200640 1 --2- 172.21.15.50:0/329642610 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe3bc109260 0x7fe3bc19a810 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fe3a800e9f0 tx=0x7fe3a800eeb0 comp rx=0 tx=0).stop 2024-08-31T04:30:41.392 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:41.390+0000 7fe3c3200640 1 -- 172.21.15.50:0/329642610 shutdown_connections 2024-08-31T04:30:41.392 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:41.390+0000 7fe3c3200640 1 --2- 172.21.15.50:0/329642610 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fe3a00b4b30 0x7fe3a00b7040 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:41.393 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:41.390+0000 7fe3c3200640 1 --2- 172.21.15.50:0/329642610 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe3bc109bb0 0x7fe3bc19fab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:41.393 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:41.390+0000 7fe3c3200640 1 --2- 172.21.15.50:0/329642610 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe3bc109260 0x7fe3bc19a810 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:41.393 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:41.390+0000 7fe3c3200640 1 --2- 172.21.15.50:0/329642610 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe3bc103920 0x7fe3bc19a270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:41.393 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:41.390+0000 7fe3c3200640 1 -- 172.21.15.50:0/329642610 >> 172.21.15.50:0/329642610 conn(0x7fe3bc0ff370 msgr2=0x7fe3bc101790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:30:41.393 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:41.390+0000 7fe3c3200640 1 -- 172.21.15.50:0/329642610 shutdown_connections 2024-08-31T04:30:41.393 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:41.390+0000 7fe3c3200640 1 -- 172.21.15.50:0/329642610 wait complete. 2024-08-31T04:30:41.653 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:30:41 smithi050 ceph-mon[17259]: pgmap v602: 97 pgs: 97 active+clean; 1.5 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 58 KiB/s wr, 21 op/s 2024-08-31T04:30:41.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:30:41 smithi177 ceph-mon[22025]: pgmap v602: 97 pgs: 97 active+clean; 1.5 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 58 KiB/s wr, 21 op/s 2024-08-31T04:30:41.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:30:41 smithi133 ceph-mon[22177]: pgmap v602: 97 pgs: 97 active+clean; 1.5 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 58 KiB/s wr, 21 op/s 2024-08-31T04:30:42.339 DEBUG:tasks.quiescer.fs.[cephfs]:Dumping ops on rank 2 (i) to a remote file /var/run/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/ops-9d491f02-1-mds.i.json 2024-08-31T04:30:42.340 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 058d9fc6-674f-11ef-bcd4-c7b262605968 -- ceph tell mds.1:2 ops --flags=locks --path=/var/run/ceph/ops-9d491f02-1-mds.i.json 2024-08-31T04:30:42.581 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:42.579+0000 7f8931600640 1 -- 172.21.15.50:0/4138033254 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f892c075a90 msgr2=0x7f892c075ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:30:42.581 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:42.579+0000 7f8931600640 1 --2- 172.21.15.50:0/4138033254 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f892c075a90 0x7f892c075ea0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f8918009860 tx=0x7f891802a340 comp rx=0 tx=0).stop 2024-08-31T04:30:42.581 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:42.579+0000 7f8931600640 1 -- 172.21.15.50:0/4138033254 shutdown_connections 2024-08-31T04:30:42.581 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:42.579+0000 7f8931600640 1 --2- 172.21.15.50:0/4138033254 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f892c075a90 0x7f892c075ea0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:42.581 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:42.579+0000 7f8931600640 1 --2- 172.21.15.50:0/4138033254 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f892c10fbe0 0x7f892c112000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:42.582 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:42.579+0000 7f8931600640 1 --2- 172.21.15.50:0/4138033254 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f892c076e90 0x7f892c075550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:42.582 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:42.579+0000 7f8931600640 1 -- 172.21.15.50:0/4138033254 >> 172.21.15.50:0/4138033254 conn(0x7f892c0fedc0 msgr2=0x7f892c101250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:30:42.582 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:42.580+0000 7f8931600640 1 -- 172.21.15.50:0/4138033254 shutdown_connections 2024-08-31T04:30:42.582 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:42.580+0000 7f8931600640 1 -- 172.21.15.50:0/4138033254 wait complete. 2024-08-31T04:30:42.584 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:42.581+0000 7f8931600640 1 Processor -- start 2024-08-31T04:30:42.585 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:42.581+0000 7f8931600640 1 -- start start 2024-08-31T04:30:42.585 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:42.581+0000 7f8931600640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f892c075a90 0x7f892c1a02e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:30:42.585 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:42.581+0000 7f8931600640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f892c076e90 0x7f892c1a0950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:30:42.585 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:42.581+0000 7f8931600640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f892c10fbe0 0x7f892c1a1500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:30:42.585 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:42.581+0000 7f8931600640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f892c115690 con 0x7f892c075a90 2024-08-31T04:30:42.585 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:42.581+0000 7f8931600640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f892c115510 con 0x7f892c10fbe0 2024-08-31T04:30:42.585 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:42.581+0000 7f8931600640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f892c115810 con 0x7f892c076e90 2024-08-31T04:30:42.585 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:42.582+0000 7f892a000640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f892c076e90 0x7f892c1a0950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:30:42.585 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:42.582+0000 7f892a000640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f892c076e90 0x7f892c1a0950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.50:60052/0 (socket says 172.21.15.50:60052) 2024-08-31T04:30:42.585 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:42.582+0000 7f892a000640 1 -- 172.21.15.50:0/209571192 learned_addr learned my addr 172.21.15.50:0/209571192 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:30:42.585 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:42.582+0000 7f892b400640 1 --2- 172.21.15.50:0/209571192 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f892c10fbe0 0x7f892c1a1500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:30:42.585 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:42.582+0000 7f892aa00640 1 --2- 172.21.15.50:0/209571192 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f892c075a90 0x7f892c1a02e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:30:42.585 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:42.582+0000 7f892b400640 1 -- 172.21.15.50:0/209571192 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f892c076e90 msgr2=0x7f892c1a0950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:30:42.586 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:42.582+0000 7f892b400640 1 --2- 172.21.15.50:0/209571192 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f892c076e90 0x7f892c1a0950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:42.586 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:42.582+0000 7f892b400640 1 -- 172.21.15.50:0/209571192 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f892c075a90 msgr2=0x7f892c1a02e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:30:42.586 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:42.582+0000 7f892b400640 1 --2- 172.21.15.50:0/209571192 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f892c075a90 0x7f892c1a02e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:42.586 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:42.582+0000 7f892b400640 1 -- 172.21.15.50:0/209571192 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f892c1a1d20 con 0x7f892c10fbe0 2024-08-31T04:30:42.592 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:42.583+0000 7f892b400640 1 --2- 172.21.15.50:0/209571192 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f892c10fbe0 0x7f892c1a1500 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f892400ef00 tx=0x7f892400c740 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:30:42.593 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:42.583+0000 7f8923400640 1 -- 172.21.15.50:0/209571192 <== mon.2 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8924004b20 con 0x7f892c10fbe0 2024-08-31T04:30:42.593 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:42.583+0000 7f8923400640 1 -- 172.21.15.50:0/209571192 <== mon.2 v2:172.21.15.133:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8924003e20 con 0x7f892c10fbe0 2024-08-31T04:30:42.593 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:42.583+0000 7f8931600640 1 -- 172.21.15.50:0/209571192 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f892c1a2010 con 0x7f892c10fbe0 2024-08-31T04:30:42.593 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:42.583+0000 7f8923400640 1 -- 172.21.15.50:0/209571192 <== mon.2 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f892400b570 con 0x7f892c10fbe0 2024-08-31T04:30:42.593 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:42.583+0000 7f8931600640 1 -- 172.21.15.50:0/209571192 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f892c1a8700 con 0x7f892c10fbe0 2024-08-31T04:30:42.593 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:42.586+0000 7f8938846740 1 Processor -- start 2024-08-31T04:30:42.593 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:42.586+0000 7f8923400640 1 -- 172.21.15.50:0/209571192 <== mon.2 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 18) ==== 152577+0+0 (secure 0 0 0) 0x7f892401d020 con 0x7f892c10fbe0 2024-08-31T04:30:42.593 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:42.587+0000 7f8938846740 1 -- start start 2024-08-31T04:30:42.593 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:42.587+0000 7f8938846740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55a46e7431b0 0x55a46eae8dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:30:42.593 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:42.587+0000 7f8938846740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55a46e71a2f0 0x55a46eae9430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:30:42.593 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:42.587+0000 7f8938846740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a46e7224d0 0x55a46eae9f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:30:42.594 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:42.587+0000 7f8938846740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55a46ea5bf70 con 0x55a46e7224d0 2024-08-31T04:30:42.594 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:42.587+0000 7f8938846740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x55a46ea4b500 con 0x55a46e7431b0 2024-08-31T04:30:42.594 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:42.587+0000 7f8938846740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x55a46ea4f4b0 con 0x55a46e71a2f0 2024-08-31T04:30:42.594 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:42.588+0000 7f892a000640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a46e7224d0 0x55a46eae9f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:30:42.594 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:42.588+0000 7f892a000640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a46e7224d0 0x55a46eae9f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:55336/0 (socket says 172.21.15.50:55336) 2024-08-31T04:30:42.594 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:42.588+0000 7f892a000640 1 -- 172.21.15.50:0/1768353641 learned_addr learned my addr 172.21.15.50:0/1768353641 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:30:42.594 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:42.588+0000 7f892a000640 1 --2- 172.21.15.50:0/1768353641 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55a46e7431b0 0x55a46eae8dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:30:42.594 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:42.588+0000 7f892a000640 1 -- 172.21.15.50:0/1768353641 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55a46e71a2f0 msgr2=0x55a46eae9430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:30:42.594 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:42.588+0000 7f892a000640 1 --2- 172.21.15.50:0/1768353641 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55a46e71a2f0 0x55a46eae9430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:42.594 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:42.588+0000 7f892a000640 1 -- 172.21.15.50:0/1768353641 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55a46e7431b0 msgr2=0x55a46eae8dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:30:42.594 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:42.588+0000 7f892a000640 1 --2- 172.21.15.50:0/1768353641 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55a46e7431b0 0x55a46eae8dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:42.594 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:42.588+0000 7f892a000640 1 -- 172.21.15.50:0/1768353641 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a46ea05c10 con 0x55a46e7224d0 2024-08-31T04:30:42.594 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:42.589+0000 7f8923400640 1 --2- 172.21.15.50:0/209571192 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f89100b4b30 0x7f89100b7040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:30:42.595 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:42.589+0000 7f892a000640 1 --2- 172.21.15.50:0/1768353641 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a46e7224d0 0x55a46eae9f80 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f8918035040 tx=0x7f8918005750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6c6cfa251bb9945 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:30:42.595 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:42.589+0000 7f892aa00640 1 --2- 172.21.15.50:0/209571192 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f89100b4b30 0x7f89100b7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:30:42.595 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:42.589+0000 7f8923400640 1 -- 172.21.15.50:0/209571192 <== mon.2 v2:172.21.15.133:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8219+0+0 (secure 0 0 0) 0x7f89240e5070 con 0x7f892c10fbe0 2024-08-31T04:30:42.595 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:42.589+0000 7f8917400640 1 -- 172.21.15.50:0/1768353641 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8918037040 con 0x55a46e7224d0 2024-08-31T04:30:42.595 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:42.589+0000 7f8917400640 1 -- 172.21.15.50:0/1768353641 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8918030860 con 0x55a46e7224d0 2024-08-31T04:30:42.595 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:42.589+0000 7f8917400640 1 -- 172.21.15.50:0/1768353641 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89180046c0 con 0x55a46e7224d0 2024-08-31T04:30:42.595 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:42.590+0000 7f8938846740 1 -- 172.21.15.50:0/1768353641 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a46e7224d0 msgr2=0x55a46eae9f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:30:42.595 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:42.590+0000 7f8938846740 1 --2- 172.21.15.50:0/1768353641 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a46e7224d0 0x55a46eae9f80 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f8918035040 tx=0x7f8918005750 comp rx=0 tx=0).stop 2024-08-31T04:30:42.595 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:42.590+0000 7f892aa00640 1 --2- 172.21.15.50:0/209571192 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f89100b4b30 0x7f89100b7040 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f891c009ca0 tx=0x7f891c009840 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:30:42.595 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:42.591+0000 7f8938846740 1 -- 172.21.15.50:0/1768353641 shutdown_connections 2024-08-31T04:30:42.595 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:42.591+0000 7f8938846740 1 --2- 172.21.15.50:0/1768353641 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55a46e71a2f0 0x55a46eae9430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:42.595 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:42.591+0000 7f8938846740 1 --2- 172.21.15.50:0/1768353641 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a46e7224d0 0x55a46eae9f80 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:42.595 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:42.591+0000 7f8938846740 1 --2- 172.21.15.50:0/1768353641 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55a46e7431b0 0x55a46eae8dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:42.595 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:42.591+0000 7f8938846740 1 -- 172.21.15.50:0/1768353641 >> 172.21.15.50:0/1768353641 conn(0x55a46e737300 msgr2=0x55a46eae4850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:30:42.596 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:42.591+0000 7f8938846740 1 -- 172.21.15.50:0/1768353641 shutdown_connections 2024-08-31T04:30:42.596 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:42.591+0000 7f8938846740 1 -- 172.21.15.50:0/1768353641 wait complete. 2024-08-31T04:30:42.598 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:42.592+0000 7f8938846740 1 -- start start 2024-08-31T04:30:42.598 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:42.592+0000 7f8938846740 1 Processor -- start 2024-08-31T04:30:42.598 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:42.593+0000 7f8938846740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55a46e71a2f0 0x55a46eaf2480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:30:42.598 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:42.593+0000 7f8938846740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a46e7224d0 0x55a46eaf2b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:30:42.598 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:42.593+0000 7f8938846740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55a46e7431b0 0x55a46eaf36b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:30:42.598 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:42.593+0000 7f8938846740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55a46e984ab0 con 0x55a46e7224d0 2024-08-31T04:30:42.598 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:42.593+0000 7f8938846740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x55a46e9f2320 con 0x55a46e71a2f0 2024-08-31T04:30:42.598 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:42.593+0000 7f8938846740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x55a46eaeaa40 con 0x55a46e7431b0 2024-08-31T04:30:42.599 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:42.593+0000 7f8938846740 10 client.0 _ll_register_callbacks cb 0x55a46e9f86a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:30:42.599 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:42.593+0000 7f892aa00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55a46e71a2f0 0x55a46eaf2480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:30:42.599 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:42.593+0000 7f892a000640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a46e7224d0 0x55a46eaf2b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:30:42.599 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:42.593+0000 7f892aa00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55a46e71a2f0 0x55a46eaf2480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.50:48164/0 (socket says 172.21.15.50:48164) 2024-08-31T04:30:42.599 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:42.593+0000 7f892aa00640 1 -- 172.21.15.50:0/1835762223 learned_addr learned my addr 172.21.15.50:0/1835762223 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:30:42.599 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:42.593+0000 7f892b400640 1 --2- 172.21.15.50:0/1835762223 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55a46e7431b0 0x55a46eaf36b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:30:42.599 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:42.594+0000 7f892aa00640 1 -- 172.21.15.50:0/1835762223 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55a46e7431b0 msgr2=0x55a46eaf36b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:30:42.599 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:42.594+0000 7f892aa00640 1 --2- 172.21.15.50:0/1835762223 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55a46e7431b0 0x55a46eaf36b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:42.599 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:42.594+0000 7f892aa00640 1 -- 172.21.15.50:0/1835762223 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a46e7224d0 msgr2=0x55a46eaf2b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:30:42.599 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:42.594+0000 7f892aa00640 1 --2- 172.21.15.50:0/1835762223 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a46e7224d0 0x55a46eaf2b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:42.599 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:42.594+0000 7f892aa00640 1 -- 172.21.15.50:0/1835762223 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a46e7ae790 con 0x55a46e71a2f0 2024-08-31T04:30:42.599 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:42.594+0000 7f892aa00640 1 --2- 172.21.15.50:0/1835762223 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55a46e71a2f0 0x55a46eaf2480 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f891c01cad0 tx=0x7f891c005f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=11fd76d16711e12a server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:30:42.600 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:42.594+0000 7f890be00640 10 client.0 ms_handle_connect on v2:172.21.15.133:3300/0 2024-08-31T04:30:42.600 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:42.594+0000 7f890be00640 1 -- 172.21.15.50:0/1835762223 <== mon.2 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f891c01d8e0 con 0x55a46e71a2f0 2024-08-31T04:30:42.600 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:42.594+0000 7f8938846740 1 -- 172.21.15.50:0/1835762223 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8918030860 con 0x55a46e71a2f0 2024-08-31T04:30:42.600 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:42.594+0000 7f890be00640 1 -- 172.21.15.50:0/1835762223 <== mon.2 v2:172.21.15.133:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8219+0+0 (secure 0 0 0) 0x7f891c01da80 con 0x55a46e71a2f0 2024-08-31T04:30:42.600 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:42.595+0000 7f890be00640 1 -- 172.21.15.50:0/1835762223 <== mon.2 v2:172.21.15.133:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7f891c01dc80 con 0x55a46e71a2f0 2024-08-31T04:30:42.600 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:42.595+0000 7f8938846740 10 client.26120 fetch_fsmap learned FSMap version 42 2024-08-31T04:30:42.600 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:42.595+0000 7f8938846740 1 -- 172.21.15.50:0/1835762223 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x55a46e827620 con 0x55a46e71a2f0 2024-08-31T04:30:42.600 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:42.595+0000 7f890be00640 1 -- 172.21.15.50:0/1835762223 <== mon.2 v2:172.21.15.133:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8918030860 con 0x55a46e71a2f0 2024-08-31T04:30:42.600 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:42.595+0000 7f890be00640 1 -- 172.21.15.50:0/1835762223 <== mon.2 v2:172.21.15.133:3300/0 5 ==== fsmap(e 42) ==== 8398+0+0 (secure 0 0 0) 0x7f891c0333f0 con 0x55a46e71a2f0 2024-08-31T04:30:42.600 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:42.595+0000 7f8938846740 10 client.26120 fetch_fsmap finished waiting for FSMap version 42 2024-08-31T04:30:42.600 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:42.595+0000 7f8938846740 10 client.26120 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T04:30:42.600 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:42.595+0000 7f8938846740 20 client.26120 populate_metadata read hostname 'smithi050' 2024-08-31T04:30:42.600 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:42.595+0000 7f8938846740 1 --2- 172.21.15.50:0/1835762223 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x55a46e701d80 0x55a46eaffd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:30:42.600 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:42.596+0000 7f8938846740 4 client.26120 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T04:30:42.601 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:42.596+0000 7f8938846740 1 -- 172.21.15.50:0/1835762223 --> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a46ea5dec0 con 0x55a46e701d80 2024-08-31T04:30:42.601 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:42.596+0000 7f892a000640 1 --2- 172.21.15.50:0/1835762223 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x55a46e701d80 0x55a46eaffd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:30:42.601 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:42.596+0000 7f892a000640 1 --2- 172.21.15.50:0/1835762223 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x55a46e701d80 0x55a46eaffd50 crc :-1 s=READY pgs=110 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b71adbaf2c31183e server_cookie=da18e94c4a9905d1 in_seq=0 out_seq=0 2024-08-31T04:30:42.601 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:42.596+0000 7f890be00640 10 client.26120 ms_handle_connect on v2:172.21.15.133:6838/2526402262 2024-08-31T04:30:42.602 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:42.597+0000 7f890be00640 1 -- 172.21.15.50:0/1835762223 <== mds.0 v2:172.21.15.133:6838/2526402262 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55a46ea5dec0 con 0x55a46e701d80 2024-08-31T04:30:42.602 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:42.597+0000 7f890be00640 10 client.26120 handle_command_reply: tid=0 2024-08-31T04:30:42.602 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:42.597+0000 7f8938846740 1 client.26120 shutdown 2024-08-31T04:30:42.602 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:42.598+0000 7f8938846740 1 -- 172.21.15.50:0/1835762223 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55a46e71a2f0 msgr2=0x55a46eaf2480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:30:42.602 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:42.598+0000 7f8938846740 1 --2- 172.21.15.50:0/1835762223 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55a46e71a2f0 0x55a46eaf2480 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f891c01cad0 tx=0x7f891c005f90 comp rx=0 tx=0).stop 2024-08-31T04:30:42.602 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:42.598+0000 7f8938846740 1 -- 172.21.15.50:0/1835762223 shutdown_connections 2024-08-31T04:30:42.602 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:42.598+0000 7f8938846740 1 --2- 172.21.15.50:0/1835762223 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x55a46e701d80 0x55a46eaffd50 crc :-1 s=READY pgs=110 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:42.603 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:42.598+0000 7f8938846740 1 --2- 172.21.15.50:0/1835762223 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55a46e7431b0 0x55a46eaf36b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:42.603 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:42.598+0000 7f8938846740 1 --2- 172.21.15.50:0/1835762223 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a46e7224d0 0x55a46eaf2b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:42.603 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:42.598+0000 7f8938846740 1 --2- 172.21.15.50:0/1835762223 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55a46e71a2f0 0x55a46eaf2480 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:42.603 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:42.598+0000 7f8938846740 1 -- 172.21.15.50:0/1835762223 >> 172.21.15.50:0/1835762223 conn(0x55a46e737300 msgr2=0x55a46eae2cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:30:42.603 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:42.598+0000 7f890be00640 0 client.26120 ms_handle_reset on v2:172.21.15.133:6838/2526402262 2024-08-31T04:30:42.603 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:42.598+0000 7f8938846740 1 -- 172.21.15.50:0/1835762223 shutdown_connections 2024-08-31T04:30:42.603 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:42.598+0000 7f8938846740 1 -- 172.21.15.50:0/1835762223 wait complete. 2024-08-31T04:30:42.603 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:42.598+0000 7f8938846740 20 client.26120 trim_cache size 0 max 16384 2024-08-31T04:30:42.615 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:42.614+0000 7f8938846740 1 Processor -- start 2024-08-31T04:30:42.615 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:42.614+0000 7f8938846740 1 -- start start 2024-08-31T04:30:42.615 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:42.614+0000 7f8938846740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55a46e71a2f0 0x55a46eae4190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:30:42.615 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:42.614+0000 7f8938846740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a46e7224d0 0x55a46eaf09d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:30:42.615 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:42.614+0000 7f8938846740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55a46e7431b0 0x55a46eaf0f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:30:42.616 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:42.614+0000 7f8938846740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f892c1b11b0 con 0x55a46e7224d0 2024-08-31T04:30:42.616 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:42.614+0000 7f8938846740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f892c1b2de0 con 0x55a46e7431b0 2024-08-31T04:30:42.616 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:42.614+0000 7f8938846740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f892c1b1880 con 0x55a46e71a2f0 2024-08-31T04:30:42.617 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:42.614+0000 7f892aa00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55a46e71a2f0 0x55a46eae4190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:30:42.617 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:42.615+0000 7f892aa00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55a46e71a2f0 0x55a46eae4190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.50:60070/0 (socket says 172.21.15.50:60070) 2024-08-31T04:30:42.617 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:42.615+0000 7f892aa00640 1 -- 172.21.15.50:0/3161471302 learned_addr learned my addr 172.21.15.50:0/3161471302 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:30:42.617 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:42.615+0000 7f892b400640 1 --2- 172.21.15.50:0/3161471302 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55a46e7431b0 0x55a46eaf0f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:30:42.617 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:42.615+0000 7f892a000640 1 --2- 172.21.15.50:0/3161471302 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a46e7224d0 0x55a46eaf09d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:30:42.617 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:42.615+0000 7f892b400640 1 -- 172.21.15.50:0/3161471302 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55a46e71a2f0 msgr2=0x55a46eae4190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:30:42.617 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:42.615+0000 7f892b400640 1 --2- 172.21.15.50:0/3161471302 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55a46e71a2f0 0x55a46eae4190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:42.617 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:42.615+0000 7f892b400640 1 -- 172.21.15.50:0/3161471302 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a46e7224d0 msgr2=0x55a46eaf09d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:30:42.617 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:42.615+0000 7f892b400640 1 --2- 172.21.15.50:0/3161471302 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a46e7224d0 0x55a46eaf09d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:42.617 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:42.615+0000 7f892b400640 1 -- 172.21.15.50:0/3161471302 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a46eafa950 con 0x55a46e7431b0 2024-08-31T04:30:42.638 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:42.636+0000 7f892b400640 1 --2- 172.21.15.50:0/3161471302 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55a46e7431b0 0x55a46eaf0f10 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f8924005fd0 tx=0x7f8924093040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d418645cca6c03ee server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:30:42.638 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:42.636+0000 7f8916a00640 1 -- 172.21.15.50:0/3161471302 <== mon.2 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f892401a040 con 0x55a46e7431b0 2024-08-31T04:30:42.638 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:42.636+0000 7f8916a00640 1 -- 172.21.15.50:0/3161471302 <== mon.2 v2:172.21.15.133:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f89240ac1b0 con 0x55a46e7431b0 2024-08-31T04:30:42.638 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:42.636+0000 7f8916a00640 1 -- 172.21.15.50:0/3161471302 <== mon.2 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8924004100 con 0x55a46e7431b0 2024-08-31T04:30:42.639 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:42.637+0000 7f8938846740 1 -- 172.21.15.50:0/3161471302 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55a46e7431b0 msgr2=0x55a46eaf0f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:30:42.639 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:42.637+0000 7f8938846740 1 --2- 172.21.15.50:0/3161471302 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55a46e7431b0 0x55a46eaf0f10 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f8924005fd0 tx=0x7f8924093040 comp rx=0 tx=0).stop 2024-08-31T04:30:42.639 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:42.638+0000 7f8938846740 1 -- 172.21.15.50:0/3161471302 shutdown_connections 2024-08-31T04:30:42.639 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:42.638+0000 7f8938846740 1 --2- 172.21.15.50:0/3161471302 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55a46e7431b0 0x55a46eaf0f10 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:42.639 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:42.638+0000 7f8938846740 1 --2- 172.21.15.50:0/3161471302 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a46e7224d0 0x55a46eaf09d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:42.639 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:42.638+0000 7f8938846740 1 --2- 172.21.15.50:0/3161471302 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55a46e71a2f0 0x55a46eae4190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:42.639 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:42.638+0000 7f8938846740 1 -- 172.21.15.50:0/3161471302 >> 172.21.15.50:0/3161471302 conn(0x55a46e737300 msgr2=0x55a46eaf1fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:30:42.639 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:42.638+0000 7f8938846740 1 -- 172.21.15.50:0/3161471302 shutdown_connections 2024-08-31T04:30:42.640 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:42.638+0000 7f8938846740 1 -- 172.21.15.50:0/3161471302 wait complete. 2024-08-31T04:30:42.640 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:42.638+0000 7f8938846740 1 -- start start 2024-08-31T04:30:42.640 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:42.639+0000 7f8938846740 1 Processor -- start 2024-08-31T04:30:42.641 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:42.639+0000 7f8938846740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a46e71a2f0 0x55a46eaf9180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:30:42.641 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:42.639+0000 7f8938846740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55a46e7224d0 0x55a46eaf96c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:30:42.641 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:42.639+0000 7f8938846740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55a46e7431b0 0x55a46eaf9c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:30:42.642 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:42.639+0000 7f8938846740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f892c1b2710 con 0x55a46e71a2f0 2024-08-31T04:30:42.642 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:42.640+0000 7f8938846740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f892c1b2010 con 0x55a46e7224d0 2024-08-31T04:30:42.642 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:42.640+0000 7f8938846740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f892c1af190 con 0x55a46e7431b0 2024-08-31T04:30:42.642 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:42.640+0000 7f8938846740 10 client.0 _ll_register_callbacks cb 0x7f891c01c780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:30:42.642 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:42.640+0000 7f892a000640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55a46e7224d0 0x55a46eaf96c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:30:42.642 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:42.640+0000 7f892a000640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55a46e7224d0 0x55a46eaf96c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.50:48176/0 (socket says 172.21.15.50:48176) 2024-08-31T04:30:42.642 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:42.640+0000 7f892b400640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55a46e7431b0 0x55a46eaf9c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:30:42.643 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:42.640+0000 7f892a000640 1 -- 172.21.15.50:0/433808819 learned_addr learned my addr 172.21.15.50:0/433808819 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:30:42.643 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:42.640+0000 7f892aa00640 1 --2- 172.21.15.50:0/433808819 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a46e71a2f0 0x55a46eaf9180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:30:42.643 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:42.640+0000 7f892a000640 1 -- 172.21.15.50:0/433808819 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55a46e7431b0 msgr2=0x55a46eaf9c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:30:42.643 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:42.640+0000 7f892a000640 1 --2- 172.21.15.50:0/433808819 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55a46e7431b0 0x55a46eaf9c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:42.643 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:42.640+0000 7f892a000640 1 -- 172.21.15.50:0/433808819 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a46e71a2f0 msgr2=0x55a46eaf9180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:30:42.643 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:42.640+0000 7f892a000640 1 --2- 172.21.15.50:0/433808819 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a46e71a2f0 0x55a46eaf9180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:42.643 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:42.640+0000 7f892a000640 1 -- 172.21.15.50:0/433808819 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a46eaf7e40 con 0x55a46e7224d0 2024-08-31T04:30:42.643 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:42.641+0000 7f892a000640 1 --2- 172.21.15.50:0/433808819 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55a46e7224d0 0x55a46eaf96c0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f8918035040 tx=0x7f8918005850 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ef21e0a975c574ec server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:30:42.643 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:42.641+0000 7f890be00640 10 client.0 ms_handle_connect on v2:172.21.15.133:3300/0 2024-08-31T04:30:42.644 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:42.641+0000 7f890be00640 1 -- 172.21.15.50:0/433808819 <== mon.2 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8918037040 con 0x55a46e7224d0 2024-08-31T04:30:42.644 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:42.641+0000 7f8938846740 1 -- 172.21.15.50:0/433808819 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f89240ac1b0 con 0x55a46e7224d0 2024-08-31T04:30:42.645 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:42.641+0000 7f890be00640 1 -- 172.21.15.50:0/433808819 <== mon.2 v2:172.21.15.133:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8219+0+0 (secure 0 0 0) 0x7f8918004040 con 0x55a46e7224d0 2024-08-31T04:30:42.645 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:42.642+0000 7f890be00640 1 -- 172.21.15.50:0/433808819 <== mon.2 v2:172.21.15.133:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7f8918047040 con 0x55a46e7224d0 2024-08-31T04:30:42.645 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:42.642+0000 7f8938846740 10 client.26126 fetch_fsmap learned FSMap version 42 2024-08-31T04:30:42.645 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:42.642+0000 7f8938846740 1 -- 172.21.15.50:0/433808819 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x55a46eb6aa50 con 0x55a46e7224d0 2024-08-31T04:30:42.645 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:42.642+0000 7f890be00640 1 -- 172.21.15.50:0/433808819 <== mon.2 v2:172.21.15.133:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f89240ac1b0 con 0x55a46e7224d0 2024-08-31T04:30:42.645 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:42.642+0000 7f890be00640 1 -- 172.21.15.50:0/433808819 <== mon.2 v2:172.21.15.133:3300/0 5 ==== fsmap(e 42) ==== 8398+0+0 (secure 0 0 0) 0x7f8918052030 con 0x55a46e7224d0 2024-08-31T04:30:42.645 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:42.642+0000 7f8938846740 10 client.26126 fetch_fsmap finished waiting for FSMap version 42 2024-08-31T04:30:42.645 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:42.642+0000 7f8938846740 10 client.26126 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T04:30:42.645 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:42.642+0000 7f8938846740 20 client.26126 populate_metadata read hostname 'smithi050' 2024-08-31T04:30:42.645 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:42.642+0000 7f8938846740 1 --2- 172.21.15.50:0/433808819 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x55a46e6d71c0 0x55a46eb6d060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:30:42.645 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:42.642+0000 7f8938846740 4 client.26126 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-31T04:30:42.645 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:42.642+0000 7f8938846740 1 -- 172.21.15.50:0/433808819 --> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55a46ea59960 con 0x55a46e6d71c0 2024-08-31T04:30:42.645 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:42.643+0000 7f892aa00640 1 --2- 172.21.15.50:0/433808819 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x55a46e6d71c0 0x55a46eb6d060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:30:42.645 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:42.643+0000 7f892aa00640 1 --2- 172.21.15.50:0/433808819 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x55a46e6d71c0 0x55a46eb6d060 crc :-1 s=READY pgs=111 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9fb5209a5a0ceb86 server_cookie=123b300d0eb2df1c in_seq=0 out_seq=0 2024-08-31T04:30:42.646 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:42.643+0000 7f890be00640 10 client.26126 ms_handle_connect on v2:172.21.15.133:6838/2526402262 2024-08-31T04:30:42.712 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:42.710+0000 7f890be00640 1 -- 172.21.15.50:0/433808819 <== mds.0 v2:172.21.15.133:6838/2526402262 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55a46ea59960 con 0x55a46e6d71c0 2024-08-31T04:30:42.712 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:42.710+0000 7f890be00640 10 client.26126 handle_command_reply: tid=0 2024-08-31T04:30:42.713 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:42.710+0000 7f8938846740 1 client.26126 shutdown 2024-08-31T04:30:42.713 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:42.711+0000 7f8938846740 1 -- 172.21.15.50:0/433808819 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55a46e7224d0 msgr2=0x55a46eaf96c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:30:42.713 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:42.711+0000 7f8938846740 1 --2- 172.21.15.50:0/433808819 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55a46e7224d0 0x55a46eaf96c0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f8918035040 tx=0x7f8918005850 comp rx=0 tx=0).stop 2024-08-31T04:30:42.713 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:42.711+0000 7f8938846740 1 -- 172.21.15.50:0/433808819 shutdown_connections 2024-08-31T04:30:42.713 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:42.711+0000 7f8938846740 1 --2- 172.21.15.50:0/433808819 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x55a46e6d71c0 0x55a46eb6d060 crc :-1 s=READY pgs=111 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:42.713 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:42.711+0000 7f8938846740 1 --2- 172.21.15.50:0/433808819 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55a46e7431b0 0x55a46eaf9c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:42.713 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:42.711+0000 7f8938846740 1 --2- 172.21.15.50:0/433808819 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55a46e7224d0 0x55a46eaf96c0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:42.713 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:42.711+0000 7f890be00640 0 client.26126 ms_handle_reset on v2:172.21.15.133:6838/2526402262 2024-08-31T04:30:42.713 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:42.711+0000 7f8938846740 1 --2- 172.21.15.50:0/433808819 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a46e71a2f0 0x55a46eaf9180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:42.713 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:42.711+0000 7f8938846740 1 -- 172.21.15.50:0/433808819 >> 172.21.15.50:0/433808819 conn(0x55a46e737300 msgr2=0x55a46eaf1fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:30:42.713 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:42.711+0000 7f8938846740 1 -- 172.21.15.50:0/433808819 shutdown_connections 2024-08-31T04:30:42.713 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:42.711+0000 7f8938846740 1 -- 172.21.15.50:0/433808819 wait complete. 2024-08-31T04:30:42.714 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:42.711+0000 7f8938846740 20 client.26126 trim_cache size 0 max 16384 2024-08-31T04:30:42.714 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout:{ 2024-08-31T04:30:42.714 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout: "message": "", 2024-08-31T04:30:42.714 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout: "return_code": 0 2024-08-31T04:30:42.714 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout:} 2024-08-31T04:30:42.715 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:42.712+0000 7f8931600640 1 -- 172.21.15.50:0/209571192 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f89100b4b30 msgr2=0x7f89100b7040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:30:42.715 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:42.712+0000 7f8931600640 1 --2- 172.21.15.50:0/209571192 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f89100b4b30 0x7f89100b7040 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f891c009ca0 tx=0x7f891c009840 comp rx=0 tx=0).stop 2024-08-31T04:30:42.715 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:42.712+0000 7f8931600640 1 -- 172.21.15.50:0/209571192 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f892c10fbe0 msgr2=0x7f892c1a1500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:30:42.715 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:42.712+0000 7f8931600640 1 --2- 172.21.15.50:0/209571192 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f892c10fbe0 0x7f892c1a1500 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f892400ef00 tx=0x7f892400c740 comp rx=0 tx=0).stop 2024-08-31T04:30:42.715 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:42.712+0000 7f8931600640 1 -- 172.21.15.50:0/209571192 shutdown_connections 2024-08-31T04:30:42.715 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:42.712+0000 7f8931600640 1 --2- 172.21.15.50:0/209571192 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f89100b4b30 0x7f89100b7040 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:42.715 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:42.712+0000 7f8931600640 1 --2- 172.21.15.50:0/209571192 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f892c076e90 0x7f892c1a0950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:42.715 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:42.712+0000 7f8931600640 1 --2- 172.21.15.50:0/209571192 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f892c10fbe0 0x7f892c1a1500 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:42.715 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:42.712+0000 7f8931600640 1 --2- 172.21.15.50:0/209571192 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f892c075a90 0x7f892c1a02e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:42.715 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:42.712+0000 7f8931600640 1 -- 172.21.15.50:0/209571192 >> 172.21.15.50:0/209571192 conn(0x7f892c0fedc0 msgr2=0x7f892c0ff3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:30:42.715 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:42.712+0000 7f8931600640 1 -- 172.21.15.50:0/209571192 shutdown_connections 2024-08-31T04:30:42.716 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:42.712+0000 7f8931600640 1 -- 172.21.15.50:0/209571192 wait complete. 2024-08-31T04:30:42.793 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:30:43.588 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:30:43 smithi050 ceph-mon[17259]: pgmap v603: 97 pgs: 97 active+clean; 1.5 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 59 KiB/s wr, 26 op/s 2024-08-31T04:30:43.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:30:43 smithi177 ceph-mon[22025]: pgmap v603: 97 pgs: 97 active+clean; 1.5 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 59 KiB/s wr, 26 op/s 2024-08-31T04:30:43.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:30:43 smithi133 ceph-mon[22177]: pgmap v603: 97 pgs: 97 active+clean; 1.5 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 59 KiB/s wr, 26 op/s 2024-08-31T04:30:43.902 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:43.900+0000 7f043e600640 1 -- 172.21.15.50:0/3980402362 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0438103750 msgr2=0x7f0438103b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:30:43.902 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:43.900+0000 7f043e600640 1 --2- 172.21.15.50:0/3980402362 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0438103750 0x7f0438103b60 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f042c009900 tx=0x7f042c02a410 comp rx=0 tx=0).stop 2024-08-31T04:30:43.902 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:43.900+0000 7f043e600640 1 -- 172.21.15.50:0/3980402362 shutdown_connections 2024-08-31T04:30:43.902 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:43.900+0000 7f043e600640 1 --2- 172.21.15.50:0/3980402362 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0438109090 0x7f04381094a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:43.902 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:43.900+0000 7f043e600640 1 --2- 172.21.15.50:0/3980402362 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f04381099e0 0x7f0438110210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:43.902 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:43.900+0000 7f043e600640 1 --2- 172.21.15.50:0/3980402362 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0438103750 0x7f0438103b60 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:43.902 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:43.900+0000 7f043e600640 1 -- 172.21.15.50:0/3980402362 >> 172.21.15.50:0/3980402362 conn(0x7f04380ff1e0 msgr2=0x7f0438101630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:30:43.902 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:43.900+0000 7f043e600640 1 -- 172.21.15.50:0/3980402362 shutdown_connections 2024-08-31T04:30:43.902 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:43.900+0000 7f043e600640 1 -- 172.21.15.50:0/3980402362 wait complete. 2024-08-31T04:30:43.903 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:43.902+0000 7f043e600640 1 Processor -- start 2024-08-31T04:30:43.903 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:43.902+0000 7f043e600640 1 -- start start 2024-08-31T04:30:43.904 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:43.902+0000 7f043e600640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0438103750 0x7f043819a120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:30:43.904 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:43.902+0000 7f043e600640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0438109090 0x7f043819a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:30:43.904 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:43.902+0000 7f043e600640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f04381099e0 0x7f043819f960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:30:43.904 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:43.902+0000 7f043e600640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f0438113690 con 0x7f04381099e0 2024-08-31T04:30:43.904 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:43.902+0000 7f043e600640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f0438113510 con 0x7f0438109090 2024-08-31T04:30:43.904 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:43.902+0000 7f043e600640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f0438113810 con 0x7f0438103750 2024-08-31T04:30:43.904 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:43.903+0000 7f043dc00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f04381099e0 0x7f043819f960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:30:43.904 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:43.903+0000 7f0437e00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0438109090 0x7f043819a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:30:43.905 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:43.903+0000 7f043dc00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f04381099e0 0x7f043819f960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:33764/0 (socket says 172.21.15.50:33764) 2024-08-31T04:30:43.905 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:43.903+0000 7f0437e00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0438109090 0x7f043819a6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.50:56436/0 (socket says 172.21.15.50:56436) 2024-08-31T04:30:43.905 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:43.903+0000 7f043dc00640 1 -- 172.21.15.50:0/4017515531 learned_addr learned my addr 172.21.15.50:0/4017515531 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:30:43.905 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:43.903+0000 7f043d200640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0438103750 0x7f043819a120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:30:43.905 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:43.903+0000 7f0437e00640 1 -- 172.21.15.50:0/4017515531 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0438103750 msgr2=0x7f043819a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:30:43.905 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:43.903+0000 7f0437e00640 1 --2- 172.21.15.50:0/4017515531 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0438103750 0x7f043819a120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:43.906 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:43.903+0000 7f0437e00640 1 -- 172.21.15.50:0/4017515531 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f04381099e0 msgr2=0x7f043819f960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:30:43.906 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:43.903+0000 7f0437e00640 1 --2- 172.21.15.50:0/4017515531 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f04381099e0 0x7f043819f960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:43.906 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:43.903+0000 7f0437e00640 1 -- 172.21.15.50:0/4017515531 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04381a0090 con 0x7f0438109090 2024-08-31T04:30:43.906 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:43.904+0000 7f0437e00640 1 --2- 172.21.15.50:0/4017515531 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0438109090 0x7f043819a6c0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f043806b730 tx=0x7f042400ee50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:30:43.906 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:43.904+0000 7f0435600640 1 -- 172.21.15.50:0/4017515531 <== mon.2 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f042400cc40 con 0x7f0438109090 2024-08-31T04:30:43.906 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:43.904+0000 7f043e600640 1 -- 172.21.15.50:0/4017515531 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f04381a0380 con 0x7f0438109090 2024-08-31T04:30:43.906 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:43.904+0000 7f0435600640 1 -- 172.21.15.50:0/4017515531 <== mon.2 v2:172.21.15.133:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f042400cde0 con 0x7f0438109090 2024-08-31T04:30:43.906 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:43.904+0000 7f0435600640 1 -- 172.21.15.50:0/4017515531 <== mon.2 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0424018760 con 0x7f0438109090 2024-08-31T04:30:43.906 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:43.904+0000 7f043e600640 1 -- 172.21.15.50:0/4017515531 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f04381a6ae0 con 0x7f0438109090 2024-08-31T04:30:43.910 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:43.909+0000 7f044684d740 1 Processor -- start 2024-08-31T04:30:43.910 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:43.909+0000 7f044684d740 1 -- start start 2024-08-31T04:30:43.911 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:43.909+0000 7f044684d740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55f193910760 0x55f193cb6a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:30:43.911 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:43.909+0000 7f044684d740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55f1938e7790 0x55f193cb6f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:30:43.911 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:43.909+0000 7f044684d740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f1938ef970 0x55f193cb74d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:30:43.911 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:43.909+0000 7f044684d740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55f193c2ce00 con 0x55f1938ef970 2024-08-31T04:30:43.911 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:43.909+0000 7f044684d740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x55f193c1c390 con 0x55f1938e7790 2024-08-31T04:30:43.912 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:43.909+0000 7f044684d740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x55f193c20340 con 0x55f193910760 2024-08-31T04:30:43.912 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:43.910+0000 7f043d200640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55f1938e7790 0x55f193cb6f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:30:43.912 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:43.910+0000 7f043dc00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55f193910760 0x55f193cb6a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:30:43.912 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:43.910+0000 7f043d200640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55f1938e7790 0x55f193cb6f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.50:56446/0 (socket says 172.21.15.50:56446) 2024-08-31T04:30:43.912 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:43.910+0000 7f043d200640 1 -- 172.21.15.50:0/185941402 learned_addr learned my addr 172.21.15.50:0/185941402 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:30:43.912 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:43.910+0000 7f043d200640 1 -- 172.21.15.50:0/185941402 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55f193910760 msgr2=0x55f193cb6a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:30:43.913 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:43.910+0000 7f043d200640 1 --2- 172.21.15.50:0/185941402 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55f193910760 0x55f193cb6a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:43.913 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:43.911+0000 7f043d200640 1 -- 172.21.15.50:0/185941402 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f1938ef970 msgr2=0x55f193cb74d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:30:43.913 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:43.911+0000 7f0435600640 1 -- 172.21.15.50:0/4017515531 <== mon.2 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 18) ==== 152577+0+0 (secure 0 0 0) 0x7f0424010a90 con 0x7f0438109090 2024-08-31T04:30:43.913 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:43.911+0000 7f0437e00640 1 --2- 172.21.15.50:0/185941402 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f1938ef970 0x55f193cb74d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:30:43.913 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:43.911+0000 7f043d200640 1 --2- 172.21.15.50:0/185941402 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f1938ef970 0x55f193cb74d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:43.913 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:43.911+0000 7f043d200640 1 -- 172.21.15.50:0/185941402 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f1939ee490 con 0x55f1938e7790 2024-08-31T04:30:43.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:43.911+0000 7f0437e00640 1 --2- 172.21.15.50:0/185941402 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f1938ef970 0x55f193cb74d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T04:30:43.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:43.912+0000 7f043d200640 1 --2- 172.21.15.50:0/185941402 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55f1938e7790 0x55f193cb6f90 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f042c02a930 tx=0x7f042c032ba0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a21d05eab66d68c3 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:30:43.914 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:43.912+0000 7f042a000640 1 -- 172.21.15.50:0/185941402 <== mon.2 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f042c03f070 con 0x55f1938e7790 2024-08-31T04:30:43.915 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:43.912+0000 7f042a000640 1 -- 172.21.15.50:0/185941402 <== mon.2 v2:172.21.15.133:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f042c004030 con 0x55f1938e7790 2024-08-31T04:30:43.915 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:43.912+0000 7f042a000640 1 -- 172.21.15.50:0/185941402 <== mon.2 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f042c035070 con 0x55f1938e7790 2024-08-31T04:30:43.915 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:43.913+0000 7f0435600640 1 --2- 172.21.15.50:0/4017515531 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f04200b4bb0 0x7f04200b70c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:30:43.915 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:43.913+0000 7f0435600640 1 -- 172.21.15.50:0/4017515531 <== mon.2 v2:172.21.15.133:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8219+0+0 (secure 0 0 0) 0x7f04240e5500 con 0x7f0438109090 2024-08-31T04:30:43.919 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:43.914+0000 7f043dc00640 1 --2- 172.21.15.50:0/4017515531 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f04200b4bb0 0x7f04200b70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:30:43.919 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:43.914+0000 7f044684d740 1 -- 172.21.15.50:0/185941402 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55f1938e7790 msgr2=0x55f193cb6f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:30:43.919 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:43.914+0000 7f044684d740 1 --2- 172.21.15.50:0/185941402 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55f1938e7790 0x55f193cb6f90 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f042c02a930 tx=0x7f042c032ba0 comp rx=0 tx=0).stop 2024-08-31T04:30:43.919 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:43.915+0000 7f044684d740 1 -- 172.21.15.50:0/185941402 shutdown_connections 2024-08-31T04:30:43.919 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:43.915+0000 7f044684d740 1 --2- 172.21.15.50:0/185941402 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f1938ef970 0x55f193cb74d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:43.919 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:43.915+0000 7f044684d740 1 --2- 172.21.15.50:0/185941402 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55f1938e7790 0x55f193cb6f90 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:43.919 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:43.915+0000 7f044684d740 1 --2- 172.21.15.50:0/185941402 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55f193910760 0x55f193cb6a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:43.919 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:43.915+0000 7f044684d740 1 -- 172.21.15.50:0/185941402 >> 172.21.15.50:0/185941402 conn(0x55f193904560 msgr2=0x55f193cb4940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:30:43.919 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:43.915+0000 7f044684d740 1 -- 172.21.15.50:0/185941402 shutdown_connections 2024-08-31T04:30:43.919 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:43.915+0000 7f044684d740 1 -- 172.21.15.50:0/185941402 wait complete. 2024-08-31T04:30:43.919 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:43.915+0000 7f043dc00640 1 --2- 172.21.15.50:0/4017515531 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f04200b4bb0 0x7f04200b70c0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f0430005c40 tx=0x7f0430009760 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:30:43.920 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:43.916+0000 7f044684d740 1 -- start start 2024-08-31T04:30:43.920 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:43.916+0000 7f044684d740 1 Processor -- start 2024-08-31T04:30:43.920 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:43.917+0000 7f044684d740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55f1938e7790 0x55f193cc20d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:30:43.920 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:43.917+0000 7f044684d740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55f1938ef970 0x55f193cc2610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:30:43.924 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:43.917+0000 7f044684d740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f193910760 0x55f193cd2900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:30:43.924 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:43.917+0000 7f044684d740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55f193a7f380 con 0x55f193910760 2024-08-31T04:30:43.924 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:43.917+0000 7f044684d740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x55f193ba2cc0 con 0x55f1938ef970 2024-08-31T04:30:43.924 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:43.917+0000 7f044684d740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x55f193cc95e0 con 0x55f1938e7790 2024-08-31T04:30:43.924 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:43.917+0000 7f044684d740 10 client.0 _ll_register_callbacks cb 0x55f193bd2020 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:30:43.924 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:43.917+0000 7f043d200640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55f1938e7790 0x55f193cc20d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:30:43.924 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:43.917+0000 7f043d200640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55f1938e7790 0x55f193cc20d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.50:51842/0 (socket says 172.21.15.50:51842) 2024-08-31T04:30:43.924 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:43.917+0000 7f043d200640 1 -- 172.21.15.50:0/578060651 learned_addr learned my addr 172.21.15.50:0/578060651 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:30:43.924 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:43.918+0000 7f043dc00640 1 --2- 172.21.15.50:0/578060651 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f193910760 0x55f193cd2900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:30:43.924 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:43.918+0000 7f0437e00640 1 --2- 172.21.15.50:0/578060651 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55f1938ef970 0x55f193cc2610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:30:43.924 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:43.918+0000 7f043d200640 1 -- 172.21.15.50:0/578060651 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55f1938ef970 msgr2=0x55f193cc2610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:30:43.924 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:43.918+0000 7f043d200640 1 --2- 172.21.15.50:0/578060651 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55f1938ef970 0x55f193cc2610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:43.925 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:43.918+0000 7f043d200640 1 -- 172.21.15.50:0/578060651 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f193910760 msgr2=0x55f193cd2900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:30:43.925 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:43.918+0000 7f043d200640 1 --2- 172.21.15.50:0/578060651 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f193910760 0x55f193cd2900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:43.925 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:43.918+0000 7f043d200640 1 -- 172.21.15.50:0/578060651 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f193be2b30 con 0x55f1938e7790 2024-08-31T04:30:43.925 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:43.918+0000 7f0437e00640 1 --2- 172.21.15.50:0/578060651 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55f1938ef970 0x55f193cc2610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T04:30:43.925 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:43.918+0000 7f043dc00640 1 --2- 172.21.15.50:0/578060651 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f193910760 0x55f193cd2900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:30:43.925 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:43.919+0000 7f043d200640 1 --2- 172.21.15.50:0/578060651 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55f1938e7790 0x55f193cc20d0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f042c005ab0 tx=0x7f042c005e50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bacfc30dd0e158dc server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:30:43.925 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:43.919+0000 7f041ea00640 10 client.0 ms_handle_connect on v2:172.21.15.177:3300/0 2024-08-31T04:30:43.925 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:43.919+0000 7f041ea00640 1 -- 172.21.15.50:0/578060651 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f042c035070 con 0x55f1938e7790 2024-08-31T04:30:43.925 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:43.919+0000 7f044684d740 1 -- 172.21.15.50:0/578060651 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f042c004030 con 0x55f1938e7790 2024-08-31T04:30:43.925 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:43.919+0000 7f041ea00640 1 -- 172.21.15.50:0/578060651 <== mon.1 v2:172.21.15.177:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8219+0+0 (secure 0 0 0) 0x7f042c0316a0 con 0x55f1938e7790 2024-08-31T04:30:43.925 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:43.920+0000 7f041ea00640 1 -- 172.21.15.50:0/578060651 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7f042c03f040 con 0x55f1938e7790 2024-08-31T04:30:43.925 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:43.920+0000 7f044684d740 10 client.26104 fetch_fsmap learned FSMap version 42 2024-08-31T04:30:43.925 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:43.920+0000 7f044684d740 1 -- 172.21.15.50:0/578060651 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x55f193cd55e0 con 0x55f1938e7790 2024-08-31T04:30:43.926 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:43.920+0000 7f041ea00640 1 -- 172.21.15.50:0/578060651 <== mon.1 v2:172.21.15.177:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f042c004030 con 0x55f1938e7790 2024-08-31T04:30:43.926 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:43.920+0000 7f041ea00640 1 -- 172.21.15.50:0/578060651 <== mon.1 v2:172.21.15.177:3300/0 5 ==== fsmap(e 42) ==== 8398+0+0 (secure 0 0 0) 0x7f042c003660 con 0x55f1938e7790 2024-08-31T04:30:43.926 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:43.921+0000 7f044684d740 10 client.26104 fetch_fsmap finished waiting for FSMap version 42 2024-08-31T04:30:43.926 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:43.921+0000 7f044684d740 10 client.26104 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-08-31T04:30:43.926 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:43.921+0000 7f044684d740 20 client.26104 populate_metadata read hostname 'smithi050' 2024-08-31T04:30:43.926 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:43.921+0000 7f044684d740 1 --2- 172.21.15.50:0/578060651 >> [v2:172.21.15.177:6838/3600081752,v1:172.21.15.177:6839/3600081752] conn(0x55f1938cefd0 0x55f193cd8940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:30:43.926 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:43.921+0000 7f044684d740 4 client.26104 mds_command: new command op to 24667 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T04:30:43.926 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:43.921+0000 7f044684d740 1 -- 172.21.15.50:0/578060651 --> [v2:172.21.15.177:6838/3600081752,v1:172.21.15.177:6839/3600081752] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f193c2ed50 con 0x55f1938cefd0 2024-08-31T04:30:43.927 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:43.921+0000 7f0437e00640 1 --2- 172.21.15.50:0/578060651 >> [v2:172.21.15.177:6838/3600081752,v1:172.21.15.177:6839/3600081752] conn(0x55f1938cefd0 0x55f193cd8940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:30:43.927 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:43.922+0000 7f0437e00640 1 --2- 172.21.15.50:0/578060651 >> [v2:172.21.15.177:6838/3600081752,v1:172.21.15.177:6839/3600081752] conn(0x55f1938cefd0 0x55f193cd8940 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=ac7217383ae1298 server_cookie=e54e5e83e30859db in_seq=0 out_seq=0 2024-08-31T04:30:43.927 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:43.922+0000 7f041ea00640 10 client.26104 ms_handle_connect on v2:172.21.15.177:6838/3600081752 2024-08-31T04:30:43.927 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:43.923+0000 7f041ea00640 1 -- 172.21.15.50:0/578060651 <== mds.2 v2:172.21.15.177:6838/3600081752 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55f193c2ed50 con 0x55f1938cefd0 2024-08-31T04:30:43.927 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:43.923+0000 7f041ea00640 10 client.26104 handle_command_reply: tid=0 2024-08-31T04:30:43.927 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:43.923+0000 7f044684d740 1 client.26104 shutdown 2024-08-31T04:30:43.928 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:43.923+0000 7f044684d740 1 -- 172.21.15.50:0/578060651 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55f1938e7790 msgr2=0x55f193cc20d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:30:43.928 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:43.923+0000 7f044684d740 1 --2- 172.21.15.50:0/578060651 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55f1938e7790 0x55f193cc20d0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f042c005ab0 tx=0x7f042c005e50 comp rx=0 tx=0).stop 2024-08-31T04:30:43.929 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:43.923+0000 7f044684d740 1 -- 172.21.15.50:0/578060651 shutdown_connections 2024-08-31T04:30:43.929 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:43.923+0000 7f044684d740 1 --2- 172.21.15.50:0/578060651 >> [v2:172.21.15.177:6838/3600081752,v1:172.21.15.177:6839/3600081752] conn(0x55f1938cefd0 0x55f193cd8940 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:43.929 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:43.923+0000 7f044684d740 1 --2- 172.21.15.50:0/578060651 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f193910760 0x55f193cd2900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:43.929 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:43.923+0000 7f044684d740 1 --2- 172.21.15.50:0/578060651 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55f1938ef970 0x55f193cc2610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:43.929 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:43.923+0000 7f044684d740 1 --2- 172.21.15.50:0/578060651 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55f1938e7790 0x55f193cc20d0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:43.929 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:43.923+0000 7f044684d740 1 -- 172.21.15.50:0/578060651 >> 172.21.15.50:0/578060651 conn(0x55f193904560 msgr2=0x55f193cb9be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:30:43.929 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:43.923+0000 7f041ea00640 0 client.26104 ms_handle_reset on v2:172.21.15.177:6838/3600081752 2024-08-31T04:30:43.929 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:43.924+0000 7f044684d740 1 -- 172.21.15.50:0/578060651 shutdown_connections 2024-08-31T04:30:43.929 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:43.924+0000 7f044684d740 1 -- 172.21.15.50:0/578060651 wait complete. 2024-08-31T04:30:43.929 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:43.924+0000 7f044684d740 20 client.26104 trim_cache size 0 max 16384 2024-08-31T04:30:43.944 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:43.943+0000 7f044684d740 1 Processor -- start 2024-08-31T04:30:43.945 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:43.943+0000 7f044684d740 1 -- start start 2024-08-31T04:30:43.945 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:43.943+0000 7f044684d740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f1938e7790 0x55f193cb8190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:30:43.945 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:43.943+0000 7f044684d740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55f1938ef970 0x55f193cddee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:30:43.945 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:43.943+0000 7f044684d740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55f193910760 0x55f193cde420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:30:43.945 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:43.943+0000 7f044684d740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f04381acd60 con 0x55f1938e7790 2024-08-31T04:30:43.945 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:43.943+0000 7f044684d740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f04381ae990 con 0x55f193910760 2024-08-31T04:30:43.945 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:43.943+0000 7f044684d740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f04381ad430 con 0x55f1938ef970 2024-08-31T04:30:43.946 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:43.944+0000 7f043d200640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f1938e7790 0x55f193cb8190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:30:43.946 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:43.944+0000 7f0437e00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55f1938ef970 0x55f193cddee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:30:43.946 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:43.944+0000 7f0437e00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55f1938ef970 0x55f193cddee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.50:51846/0 (socket says 172.21.15.50:51846) 2024-08-31T04:30:43.946 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:43.944+0000 7f043d200640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f1938e7790 0x55f193cb8190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:33792/0 (socket says 172.21.15.50:33792) 2024-08-31T04:30:43.946 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:43.944+0000 7f0437e00640 1 -- 172.21.15.50:0/2390247710 learned_addr learned my addr 172.21.15.50:0/2390247710 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:30:43.946 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:43.944+0000 7f043d200640 1 -- 172.21.15.50:0/2390247710 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55f1938ef970 msgr2=0x55f193cddee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:30:43.946 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:43.944+0000 7f043d200640 1 --2- 172.21.15.50:0/2390247710 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55f1938ef970 0x55f193cddee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:43.946 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:43.944+0000 7f043d200640 1 -- 172.21.15.50:0/2390247710 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55f193910760 msgr2=0x55f193cde420 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-08-31T04:30:43.947 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:43.944+0000 7f043d200640 1 --2- 172.21.15.50:0/2390247710 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55f193910760 0x55f193cde420 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:43.947 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:43.944+0000 7f043d200640 1 -- 172.21.15.50:0/2390247710 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f193cd2c40 con 0x55f1938e7790 2024-08-31T04:30:43.947 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:43.945+0000 7f043d200640 1 --2- 172.21.15.50:0/2390247710 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f1938e7790 0x55f193cb8190 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f042c005f70 tx=0x7f042c031400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a746ee0fa65ef4c server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:30:43.947 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:43.945+0000 7f0429600640 1 -- 172.21.15.50:0/2390247710 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f042c035070 con 0x55f1938e7790 2024-08-31T04:30:43.947 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:43.945+0000 7f0429600640 1 -- 172.21.15.50:0/2390247710 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f042c04c070 con 0x55f1938e7790 2024-08-31T04:30:43.947 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:43.945+0000 7f0429600640 1 -- 172.21.15.50:0/2390247710 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f042c0046e0 con 0x55f1938e7790 2024-08-31T04:30:43.948 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:43.946+0000 7f044684d740 1 -- 172.21.15.50:0/2390247710 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f1938e7790 msgr2=0x55f193cb8190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:30:43.948 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:43.946+0000 7f044684d740 1 --2- 172.21.15.50:0/2390247710 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f1938e7790 0x55f193cb8190 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f042c005f70 tx=0x7f042c031400 comp rx=0 tx=0).stop 2024-08-31T04:30:43.948 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:43.946+0000 7f044684d740 1 -- 172.21.15.50:0/2390247710 shutdown_connections 2024-08-31T04:30:43.948 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:43.946+0000 7f044684d740 1 --2- 172.21.15.50:0/2390247710 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55f1938ef970 0x55f193cddee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:43.948 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:43.946+0000 7f044684d740 1 --2- 172.21.15.50:0/2390247710 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55f193910760 0x55f193cde420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:43.948 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:43.946+0000 7f044684d740 1 --2- 172.21.15.50:0/2390247710 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f1938e7790 0x55f193cb8190 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:43.948 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:43.946+0000 7f044684d740 1 -- 172.21.15.50:0/2390247710 >> 172.21.15.50:0/2390247710 conn(0x55f193904560 msgr2=0x55f193cb7a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:30:43.948 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:43.946+0000 7f044684d740 1 -- 172.21.15.50:0/2390247710 shutdown_connections 2024-08-31T04:30:43.948 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:43.947+0000 7f044684d740 1 -- 172.21.15.50:0/2390247710 wait complete. 2024-08-31T04:30:43.949 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:43.947+0000 7f044684d740 1 -- start start 2024-08-31T04:30:43.949 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:43.947+0000 7f044684d740 1 Processor -- start 2024-08-31T04:30:43.949 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:43.948+0000 7f044684d740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55f1938e7790 0x55f193cceec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:30:43.949 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:43.948+0000 7f044684d740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f1938ef970 0x55f193ccb380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:30:43.949 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:43.948+0000 7f044684d740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55f193910760 0x55f193ccb8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:30:43.950 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:43.948+0000 7f044684d740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f04381ae2c0 con 0x55f1938ef970 2024-08-31T04:30:43.950 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:43.948+0000 7f044684d740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f04381adbc0 con 0x55f193910760 2024-08-31T04:30:43.950 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:43.948+0000 7f044684d740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f04381aad80 con 0x55f1938e7790 2024-08-31T04:30:43.950 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:43.948+0000 7f044684d740 10 client.0 _ll_register_callbacks cb 0x7f042c009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:30:43.950 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:43.948+0000 7f043d200640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55f1938e7790 0x55f193cceec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:30:43.950 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:43.948+0000 7f043d200640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55f1938e7790 0x55f193cceec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.50:51852/0 (socket says 172.21.15.50:51852) 2024-08-31T04:30:43.950 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:43.948+0000 7f043d200640 1 -- 172.21.15.50:0/4275340119 learned_addr learned my addr 172.21.15.50:0/4275340119 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:30:43.950 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:43.948+0000 7f0437e00640 1 --2- 172.21.15.50:0/4275340119 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f1938ef970 0x55f193ccb380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:30:43.951 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:43.949+0000 7f0437e00640 1 -- 172.21.15.50:0/4275340119 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55f1938e7790 msgr2=0x55f193cceec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:30:43.951 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:43.949+0000 7f0437e00640 1 --2- 172.21.15.50:0/4275340119 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55f1938e7790 0x55f193cceec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:43.951 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:43.949+0000 7f0437e00640 1 -- 172.21.15.50:0/4275340119 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55f193910760 msgr2=0x55f193ccb8c0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-08-31T04:30:43.951 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:43.949+0000 7f0437e00640 1 --2- 172.21.15.50:0/4275340119 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55f193910760 0x55f193ccb8c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:43.951 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:43.949+0000 7f0437e00640 1 -- 172.21.15.50:0/4275340119 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f193ccbf00 con 0x55f1938ef970 2024-08-31T04:30:43.952 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:43.949+0000 7f0437e00640 1 --2- 172.21.15.50:0/4275340119 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f1938ef970 0x55f193ccb380 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f04240abb90 tx=0x7f0424010e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d59315d200d8a79 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:30:43.952 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:43.949+0000 7f041ea00640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-08-31T04:30:43.952 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:43.950+0000 7f041ea00640 1 -- 172.21.15.50:0/4275340119 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04240b5200 con 0x55f1938ef970 2024-08-31T04:30:43.952 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:43.950+0000 7f041ea00640 1 -- 172.21.15.50:0/4275340119 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8219+0+0 (secure 0 0 0) 0x7f04240e5110 con 0x55f1938ef970 2024-08-31T04:30:43.952 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:43.950+0000 7f044684d740 1 -- 172.21.15.50:0/4275340119 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f042c04c070 con 0x55f1938ef970 2024-08-31T04:30:43.952 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:43.950+0000 7f041ea00640 1 -- 172.21.15.50:0/4275340119 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7f04240b0360 con 0x55f1938ef970 2024-08-31T04:30:43.952 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:43.950+0000 7f044684d740 10 client.16128 fetch_fsmap learned FSMap version 42 2024-08-31T04:30:43.952 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:43.950+0000 7f044684d740 1 -- 172.21.15.50:0/4275340119 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x55f193d43ee0 con 0x55f1938ef970 2024-08-31T04:30:43.952 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:43.951+0000 7f041ea00640 1 -- 172.21.15.50:0/4275340119 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f042c04c070 con 0x55f1938ef970 2024-08-31T04:30:43.953 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:43.951+0000 7f041ea00640 1 -- 172.21.15.50:0/4275340119 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 42) ==== 8398+0+0 (secure 0 0 0) 0x7f04240ab140 con 0x55f1938ef970 2024-08-31T04:30:43.953 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:43.951+0000 7f044684d740 10 client.16128 fetch_fsmap finished waiting for FSMap version 42 2024-08-31T04:30:43.953 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:43.951+0000 7f044684d740 10 client.16128 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-08-31T04:30:43.953 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:43.951+0000 7f044684d740 20 client.16128 populate_metadata read hostname 'smithi050' 2024-08-31T04:30:43.954 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:43.951+0000 7f044684d740 1 --2- 172.21.15.50:0/4275340119 >> [v2:172.21.15.177:6838/3600081752,v1:172.21.15.177:6839/3600081752] conn(0x55f1938a4380 0x55f193d467b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:30:43.954 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:43.951+0000 7f044684d740 4 client.16128 mds_command: new command op to 24667 tid=0 multi_id=0 [{"prefix": "ops", "flags": ["locks"], "path": "/var/run/ceph/ops-9d491f02-1-mds.i.json"}] 2024-08-31T04:30:43.954 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:43.951+0000 7f044684d740 1 -- 172.21.15.50:0/4275340119 --> [v2:172.21.15.177:6838/3600081752,v1:172.21.15.177:6839/3600081752] -- command(tid 0: {"prefix": "ops", "flags": ["locks"], "path": "/var/run/ceph/ops-9d491f02-1-mds.i.json"}) -- 0x55f193c2a7f0 con 0x55f1938a4380 2024-08-31T04:30:43.954 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:43.951+0000 7f043d200640 1 --2- 172.21.15.50:0/4275340119 >> [v2:172.21.15.177:6838/3600081752,v1:172.21.15.177:6839/3600081752] conn(0x55f1938a4380 0x55f193d467b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:30:43.954 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:43.952+0000 7f043d200640 1 --2- 172.21.15.50:0/4275340119 >> [v2:172.21.15.177:6838/3600081752,v1:172.21.15.177:6839/3600081752] conn(0x55f1938a4380 0x55f193d467b0 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=36eb0a2026204a87 server_cookie=682500b70a118cf8 in_seq=0 out_seq=0 2024-08-31T04:30:43.954 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:43.952+0000 7f041ea00640 10 client.16128 ms_handle_connect on v2:172.21.15.177:6838/3600081752 2024-08-31T04:30:44.737 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:44.735+0000 7f041ea00640 1 -- 172.21.15.50:0/4275340119 <== mds.2 v2:172.21.15.177:6838/3600081752 1 ==== command_reply(tid 0: 0 ) ==== 8+0+58 (crc 0 0 0) 0x55f193c2a7f0 con 0x55f1938a4380 2024-08-31T04:30:44.737 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:44.735+0000 7f041ea00640 10 client.16128 handle_command_reply: tid=0 2024-08-31T04:30:44.738 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:44.735+0000 7f044684d740 1 client.16128 shutdown 2024-08-31T04:30:44.738 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:44.735+0000 7f044684d740 1 -- 172.21.15.50:0/4275340119 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f1938ef970 msgr2=0x55f193ccb380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:30:44.738 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:44.735+0000 7f044684d740 1 --2- 172.21.15.50:0/4275340119 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f1938ef970 0x55f193ccb380 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f04240abb90 tx=0x7f0424010e30 comp rx=0 tx=0).stop 2024-08-31T04:30:44.738 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:44.735+0000 7f044684d740 1 -- 172.21.15.50:0/4275340119 shutdown_connections 2024-08-31T04:30:44.738 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:44.735+0000 7f044684d740 1 --2- 172.21.15.50:0/4275340119 >> [v2:172.21.15.177:6838/3600081752,v1:172.21.15.177:6839/3600081752] conn(0x55f1938a4380 0x55f193d467b0 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:44.738 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:44.735+0000 7f044684d740 1 --2- 172.21.15.50:0/4275340119 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55f193910760 0x55f193ccb8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:44.738 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:44.735+0000 7f044684d740 1 --2- 172.21.15.50:0/4275340119 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f1938ef970 0x55f193ccb380 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:44.738 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:44.735+0000 7f044684d740 1 --2- 172.21.15.50:0/4275340119 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55f1938e7790 0x55f193cceec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:44.738 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:44.735+0000 7f044684d740 1 -- 172.21.15.50:0/4275340119 >> 172.21.15.50:0/4275340119 conn(0x55f193904560 msgr2=0x55f193cc3580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:30:44.738 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:44.735+0000 7f041ea00640 0 client.16128 ms_handle_reset on v2:172.21.15.177:6838/3600081752 2024-08-31T04:30:44.738 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:44.735+0000 7f044684d740 1 -- 172.21.15.50:0/4275340119 shutdown_connections 2024-08-31T04:30:44.739 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:44.736+0000 7f044684d740 1 -- 172.21.15.50:0/4275340119 wait complete. 2024-08-31T04:30:44.739 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:44.736+0000 7f044684d740 20 client.16128 trim_cache size 0 max 16384 2024-08-31T04:30:44.739 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-08-31T04:30:44.739 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/var/run/ceph/ops-9d491f02-1-mds.i.json" 2024-08-31T04:30:44.739 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-08-31T04:30:44.740 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:44.737+0000 7f043e600640 1 -- 172.21.15.50:0/4017515531 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f04200b4bb0 msgr2=0x7f04200b70c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:30:44.740 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:44.737+0000 7f043e600640 1 --2- 172.21.15.50:0/4017515531 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f04200b4bb0 0x7f04200b70c0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f0430005c40 tx=0x7f0430009760 comp rx=0 tx=0).stop 2024-08-31T04:30:44.740 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:44.737+0000 7f043e600640 1 -- 172.21.15.50:0/4017515531 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0438109090 msgr2=0x7f043819a6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:30:44.740 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:44.737+0000 7f043e600640 1 --2- 172.21.15.50:0/4017515531 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0438109090 0x7f043819a6c0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f043806b730 tx=0x7f042400ee50 comp rx=0 tx=0).stop 2024-08-31T04:30:44.741 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:44.737+0000 7f043e600640 1 -- 172.21.15.50:0/4017515531 shutdown_connections 2024-08-31T04:30:44.741 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:44.737+0000 7f043e600640 1 --2- 172.21.15.50:0/4017515531 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f04200b4bb0 0x7f04200b70c0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:44.741 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:44.737+0000 7f043e600640 1 --2- 172.21.15.50:0/4017515531 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f04381099e0 0x7f043819f960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:44.741 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:44.737+0000 7f043e600640 1 --2- 172.21.15.50:0/4017515531 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0438109090 0x7f043819a6c0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:44.741 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:44.737+0000 7f043e600640 1 --2- 172.21.15.50:0/4017515531 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0438103750 0x7f043819a120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:44.741 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:44.737+0000 7f043e600640 1 -- 172.21.15.50:0/4017515531 >> 172.21.15.50:0/4017515531 conn(0x7f04380ff1e0 msgr2=0x7f0438101600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:30:44.741 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:44.737+0000 7f043e600640 1 -- 172.21.15.50:0/4017515531 shutdown_connections 2024-08-31T04:30:44.741 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:44.737+0000 7f043e600640 1 -- 172.21.15.50:0/4017515531 wait complete. 2024-08-31T04:30:45.502 DEBUG:tasks.quiescer.fs.[cephfs]:Dumping ops on rank 1 (a) to a remote file /var/run/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/ops-9d491f02-1-mds.a.json 2024-08-31T04:30:45.502 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 058d9fc6-674f-11ef-bcd4-c7b262605968 -- ceph tell mds.1:1 ops --flags=locks --path=/var/run/ceph/ops-9d491f02-1-mds.a.json 2024-08-31T04:30:45.536 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:30:45 smithi050 ceph-mon[17259]: pgmap v604: 97 pgs: 97 active+clean; 1.5 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 51 KiB/s wr, 18 op/s 2024-08-31T04:30:45.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:30:45 smithi177 ceph-mon[22025]: pgmap v604: 97 pgs: 97 active+clean; 1.5 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 51 KiB/s wr, 18 op/s 2024-08-31T04:30:45.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:30:45 smithi133 ceph-mon[22177]: pgmap v604: 97 pgs: 97 active+clean; 1.5 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 51 KiB/s wr, 18 op/s 2024-08-31T04:30:45.890 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:30:46.664 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:46.662+0000 7f4041200640 1 -- 172.21.15.50:0/3050175144 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f403c103900 msgr2=0x7f403c103d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:30:46.665 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:46.662+0000 7f4041200640 1 --2- 172.21.15.50:0/3050175144 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f403c103900 0x7f403c103d10 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f402c009900 tx=0x7f402c02a410 comp rx=0 tx=0).stop 2024-08-31T04:30:46.665 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:46.663+0000 7f4041200640 1 -- 172.21.15.50:0/3050175144 shutdown_connections 2024-08-31T04:30:46.665 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:46.663+0000 7f4041200640 1 --2- 172.21.15.50:0/3050175144 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f403c109b90 0x7f403c1103c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:46.665 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:46.663+0000 7f4041200640 1 --2- 172.21.15.50:0/3050175144 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f403c109240 0x7f403c109650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:46.665 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:46.663+0000 7f4041200640 1 --2- 172.21.15.50:0/3050175144 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f403c103900 0x7f403c103d10 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:46.665 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:46.663+0000 7f4041200640 1 -- 172.21.15.50:0/3050175144 >> 172.21.15.50:0/3050175144 conn(0x7f403c07b5f0 msgr2=0x7f403c07ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:30:46.665 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:46.663+0000 7f4041200640 1 -- 172.21.15.50:0/3050175144 shutdown_connections 2024-08-31T04:30:46.665 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:46.663+0000 7f4041200640 1 -- 172.21.15.50:0/3050175144 wait complete. 2024-08-31T04:30:46.666 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:46.664+0000 7f4041200640 1 Processor -- start 2024-08-31T04:30:46.666 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:46.664+0000 7f4041200640 1 -- start start 2024-08-31T04:30:46.666 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:46.665+0000 7f4041200640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f403c103900 0x7f403c0754b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:30:46.666 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:46.665+0000 7f4041200640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f403c109240 0x7f403c0759f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:30:46.667 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:46.665+0000 7f4041200640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f403c109b90 0x7f403c075f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:30:46.667 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:46.665+0000 7f4041200640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f403c1138b0 con 0x7f403c109240 2024-08-31T04:30:46.667 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:46.665+0000 7f4041200640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f403c113730 con 0x7f403c103900 2024-08-31T04:30:46.667 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:46.665+0000 7f4041200640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f403c113a30 con 0x7f403c109b90 2024-08-31T04:30:46.668 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:46.665+0000 7f4039e00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f403c103900 0x7f403c0754b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:30:46.668 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:46.665+0000 7f4039400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f403c109240 0x7f403c0759f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:30:46.668 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:46.665+0000 7f4039e00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f403c103900 0x7f403c0754b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.50:56486/0 (socket says 172.21.15.50:56486) 2024-08-31T04:30:46.668 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:46.665+0000 7f4039e00640 1 -- 172.21.15.50:0/1884091885 learned_addr learned my addr 172.21.15.50:0/1884091885 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:30:46.668 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:46.665+0000 7f403a800640 1 --2- 172.21.15.50:0/1884091885 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f403c109b90 0x7f403c075f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:30:46.668 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:46.666+0000 7f4039400640 1 -- 172.21.15.50:0/1884091885 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f403c109b90 msgr2=0x7f403c075f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:30:46.669 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:46.666+0000 7f4039400640 1 --2- 172.21.15.50:0/1884091885 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f403c109b90 0x7f403c075f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:46.669 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:46.666+0000 7f4039400640 1 -- 172.21.15.50:0/1884091885 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f403c103900 msgr2=0x7f403c0754b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:30:46.669 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:46.666+0000 7f4039400640 1 --2- 172.21.15.50:0/1884091885 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f403c103900 0x7f403c0754b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:46.669 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:46.666+0000 7f4039400640 1 -- 172.21.15.50:0/1884091885 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f403c1a8640 con 0x7f403c109240 2024-08-31T04:30:46.669 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:46.666+0000 7f4039400640 1 --2- 172.21.15.50:0/1884091885 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f403c109240 0x7f403c0759f0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f403c06c790 tx=0x7f402800b850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:30:46.669 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:46.667+0000 7f4032a00640 1 -- 172.21.15.50:0/1884091885 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4028015020 con 0x7f403c109240 2024-08-31T04:30:46.669 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:46.667+0000 7f4041200640 1 -- 172.21.15.50:0/1884091885 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f403c1a8930 con 0x7f403c109240 2024-08-31T04:30:46.669 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:46.667+0000 7f4032a00640 1 -- 172.21.15.50:0/1884091885 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4028011ce0 con 0x7f403c109240 2024-08-31T04:30:46.669 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:46.667+0000 7f4032a00640 1 -- 172.21.15.50:0/1884091885 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4028010da0 con 0x7f403c109240 2024-08-31T04:30:46.669 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:46.667+0000 7f4041200640 1 -- 172.21.15.50:0/1884091885 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f403c1a8e70 con 0x7f403c109240 2024-08-31T04:30:46.671 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:46.670+0000 7f404800f740 1 Processor -- start 2024-08-31T04:30:46.671 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:46.670+0000 7f404800f740 1 -- start start 2024-08-31T04:30:46.672 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:46.671+0000 7f404800f740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x558bb2a9d760 0x558bb2e43870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:30:46.672 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:46.671+0000 7f404800f740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558bb2a74790 0x558bb2e43db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:30:46.673 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:46.671+0000 7f404800f740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x558bb2a7c970 0x558bb2e442f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:30:46.673 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:46.671+0000 7f404800f740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x558bb2db9e00 con 0x558bb2a74790 2024-08-31T04:30:46.673 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:46.671+0000 7f404800f740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x558bb2da9390 con 0x558bb2a9d760 2024-08-31T04:30:46.673 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:46.671+0000 7f404800f740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x558bb2dad340 con 0x558bb2a7c970 2024-08-31T04:30:46.673 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:46.671+0000 7f4032a00640 1 -- 172.21.15.50:0/1884091885 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 18) ==== 152577+0+0 (secure 0 0 0) 0x7f4028018020 con 0x7f403c109240 2024-08-31T04:30:46.673 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:46.671+0000 7f4039e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558bb2a74790 0x558bb2e43db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:30:46.673 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:46.671+0000 7f403a800640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x558bb2a9d760 0x558bb2e43870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:30:46.673 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:46.671+0000 7f4039e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558bb2a74790 0x558bb2e43db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:33838/0 (socket says 172.21.15.50:33838) 2024-08-31T04:30:46.673 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:46.671+0000 7f4039e00640 1 -- 172.21.15.50:0/3558577102 learned_addr learned my addr 172.21.15.50:0/3558577102 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:30:46.675 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:46.671+0000 7f4039400640 1 --2- 172.21.15.50:0/3558577102 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x558bb2a7c970 0x558bb2e442f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:30:46.676 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:46.672+0000 7f403a800640 1 -- 172.21.15.50:0/3558577102 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x558bb2a7c970 msgr2=0x558bb2e442f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:30:46.676 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:46.672+0000 7f403a800640 1 --2- 172.21.15.50:0/3558577102 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x558bb2a7c970 0x558bb2e442f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:46.676 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:46.672+0000 7f403a800640 1 -- 172.21.15.50:0/3558577102 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558bb2a74790 msgr2=0x558bb2e43db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:30:46.676 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:46.672+0000 7f403a800640 1 --2- 172.21.15.50:0/3558577102 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558bb2a74790 0x558bb2e43db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:46.676 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:46.672+0000 7f403a800640 1 -- 172.21.15.50:0/3558577102 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558bb2b7b490 con 0x558bb2a9d760 2024-08-31T04:30:46.676 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:46.672+0000 7f4039e00640 1 --2- 172.21.15.50:0/3558577102 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558bb2a74790 0x558bb2e43db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:30:46.676 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:46.672+0000 7f403a800640 1 --2- 172.21.15.50:0/3558577102 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x558bb2a9d760 0x558bb2e43870 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f4034009f00 tx=0x7f4034011810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=636c21a3927a11fd server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:30:46.676 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:46.673+0000 7f4027400640 1 -- 172.21.15.50:0/3558577102 <== mon.2 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4034004d20 con 0x558bb2a9d760 2024-08-31T04:30:46.676 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:46.673+0000 7f4027400640 1 -- 172.21.15.50:0/3558577102 <== mon.2 v2:172.21.15.133:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4034004030 con 0x558bb2a9d760 2024-08-31T04:30:46.676 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:46.673+0000 7f4032a00640 1 --2- 172.21.15.50:0/1884091885 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f40200b4b30 0x7f40200b7040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:30:46.676 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:46.673+0000 7f4032a00640 1 -- 172.21.15.50:0/1884091885 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8219+0+0 (secure 0 0 0) 0x7f40280e48e0 con 0x7f403c109240 2024-08-31T04:30:46.676 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:46.673+0000 7f4027400640 1 -- 172.21.15.50:0/3558577102 <== mon.2 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4034005220 con 0x558bb2a9d760 2024-08-31T04:30:46.677 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:46.674+0000 7f4039e00640 1 --2- 172.21.15.50:0/1884091885 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f40200b4b30 0x7f40200b7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:30:46.677 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:46.674+0000 7f404800f740 1 -- 172.21.15.50:0/3558577102 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x558bb2a9d760 msgr2=0x558bb2e43870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:30:46.677 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:46.674+0000 7f404800f740 1 --2- 172.21.15.50:0/3558577102 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x558bb2a9d760 0x558bb2e43870 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f4034009f00 tx=0x7f4034011810 comp rx=0 tx=0).stop 2024-08-31T04:30:46.677 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:46.674+0000 7f404800f740 1 -- 172.21.15.50:0/3558577102 shutdown_connections 2024-08-31T04:30:46.677 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:46.674+0000 7f404800f740 1 --2- 172.21.15.50:0/3558577102 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x558bb2a7c970 0x558bb2e442f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:46.677 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:46.674+0000 7f404800f740 1 --2- 172.21.15.50:0/3558577102 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558bb2a74790 0x558bb2e43db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:46.677 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:46.674+0000 7f404800f740 1 --2- 172.21.15.50:0/3558577102 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x558bb2a9d760 0x558bb2e43870 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:46.677 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:46.674+0000 7f404800f740 1 -- 172.21.15.50:0/3558577102 >> 172.21.15.50:0/3558577102 conn(0x558bb2a91560 msgr2=0x558bb2e41760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:30:46.678 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:46.675+0000 7f4039e00640 1 --2- 172.21.15.50:0/1884091885 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f40200b4b30 0x7f40200b7040 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x558bb2e424f0 tx=0x7f402c009660 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:30:46.678 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:46.675+0000 7f404800f740 1 -- 172.21.15.50:0/3558577102 shutdown_connections 2024-08-31T04:30:46.678 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:46.675+0000 7f404800f740 1 -- 172.21.15.50:0/3558577102 wait complete. 2024-08-31T04:30:46.679 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:46.675+0000 7f404800f740 1 -- start start 2024-08-31T04:30:46.679 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:46.676+0000 7f404800f740 1 Processor -- start 2024-08-31T04:30:46.679 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:46.676+0000 7f404800f740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x558bb2a74790 0x558bb2e4ef10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:30:46.679 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:46.676+0000 7f404800f740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x558bb2a7c970 0x558bb2e4f450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:30:46.679 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:46.676+0000 7f404800f740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558bb2a9d760 0x558bb2e4f9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:30:46.679 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:46.676+0000 7f404800f740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x558bb2c0c380 con 0x558bb2a9d760 2024-08-31T04:30:46.679 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:46.676+0000 7f404800f740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x558bb2d2fcc0 con 0x558bb2a7c970 2024-08-31T04:30:46.679 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:46.676+0000 7f404800f740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x558bb2e520a0 con 0x558bb2a74790 2024-08-31T04:30:46.679 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:46.677+0000 7f404800f740 10 client.0 _ll_register_callbacks cb 0x558bb2d5f020 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:30:46.679 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:46.677+0000 7f4039e00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x558bb2a74790 0x558bb2e4ef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:30:46.679 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:46.677+0000 7f403a800640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558bb2a9d760 0x558bb2e4f9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:30:46.679 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:46.677+0000 7f403a800640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558bb2a9d760 0x558bb2e4f9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:33850/0 (socket says 172.21.15.50:33850) 2024-08-31T04:30:46.679 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:46.677+0000 7f403a800640 1 -- 172.21.15.50:0/1330740160 learned_addr learned my addr 172.21.15.50:0/1330740160 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:30:46.680 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:46.678+0000 7f403a800640 1 -- 172.21.15.50:0/1330740160 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x558bb2a74790 msgr2=0x558bb2e4ef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:30:46.681 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:46.678+0000 7f403a800640 1 --2- 172.21.15.50:0/1330740160 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x558bb2a74790 0x558bb2e4ef10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:46.681 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:46.678+0000 7f403a800640 1 -- 172.21.15.50:0/1330740160 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x558bb2a7c970 msgr2=0x558bb2e4f450 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-08-31T04:30:46.681 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:46.678+0000 7f403a800640 1 --2- 172.21.15.50:0/1330740160 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x558bb2a7c970 0x558bb2e4f450 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:46.681 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:46.678+0000 7f403a800640 1 -- 172.21.15.50:0/1330740160 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558bb2d6fb30 con 0x558bb2a9d760 2024-08-31T04:30:46.681 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:46.678+0000 7f403a800640 1 --2- 172.21.15.50:0/1330740160 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558bb2a9d760 0x558bb2e4f9d0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f4034009270 tx=0x7f4034009ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8caa00d3a79356d server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:30:46.681 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:46.678+0000 7f401be00640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-08-31T04:30:46.681 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:46.678+0000 7f401be00640 1 -- 172.21.15.50:0/1330740160 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4034027020 con 0x558bb2a9d760 2024-08-31T04:30:46.681 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:46.678+0000 7f401be00640 1 -- 172.21.15.50:0/1330740160 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8219+0+0 (secure 0 0 0) 0x7f4034003a30 con 0x558bb2a9d760 2024-08-31T04:30:46.681 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:46.678+0000 7f404800f740 1 -- 172.21.15.50:0/1330740160 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4034004030 con 0x558bb2a9d760 2024-08-31T04:30:46.681 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:46.679+0000 7f401be00640 1 -- 172.21.15.50:0/1330740160 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7f4034003c30 con 0x558bb2a9d760 2024-08-31T04:30:46.681 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:46.679+0000 7f404800f740 10 client.16140 fetch_fsmap learned FSMap version 42 2024-08-31T04:30:46.681 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:46.679+0000 7f404800f740 1 -- 172.21.15.50:0/1330740160 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x558bb2e5e120 con 0x558bb2a9d760 2024-08-31T04:30:46.682 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:46.679+0000 7f401be00640 1 -- 172.21.15.50:0/1330740160 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4034004030 con 0x558bb2a9d760 2024-08-31T04:30:46.682 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:46.680+0000 7f401be00640 1 -- 172.21.15.50:0/1330740160 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 42) ==== 8398+0+0 (secure 0 0 0) 0x7f4034018070 con 0x558bb2a9d760 2024-08-31T04:30:46.683 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:46.680+0000 7f404800f740 10 client.16140 fetch_fsmap finished waiting for FSMap version 42 2024-08-31T04:30:46.683 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:46.680+0000 7f404800f740 10 client.16140 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.a 2024-08-31T04:30:46.683 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:46.680+0000 7f404800f740 20 client.16140 populate_metadata read hostname 'smithi050' 2024-08-31T04:30:46.683 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:46.680+0000 7f404800f740 1 --2- 172.21.15.50:0/1330740160 >> [v2:172.21.15.50:6840/575209862,v1:172.21.15.50:6841/575209862] conn(0x558bb2a5bfd0 0x558bb2e61530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:30:46.683 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:46.680+0000 7f404800f740 4 client.16140 mds_command: new command op to 24691 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T04:30:46.683 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:46.680+0000 7f404800f740 1 -- 172.21.15.50:0/1330740160 --> [v2:172.21.15.50:6840/575209862,v1:172.21.15.50:6841/575209862] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558bb2dbbd50 con 0x558bb2a5bfd0 2024-08-31T04:30:46.683 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:46.681+0000 7f4039e00640 1 --2- 172.21.15.50:0/1330740160 >> [v2:172.21.15.50:6840/575209862,v1:172.21.15.50:6841/575209862] conn(0x558bb2a5bfd0 0x558bb2e61530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:30:46.683 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:46.681+0000 7f4039e00640 1 --2- 172.21.15.50:0/1330740160 >> [v2:172.21.15.50:6840/575209862,v1:172.21.15.50:6841/575209862] conn(0x558bb2a5bfd0 0x558bb2e61530 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=d4f637410d75a6b9 server_cookie=6bafd40f9a58f1af in_seq=0 out_seq=0 2024-08-31T04:30:46.683 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:46.682+0000 7f401be00640 10 client.16140 ms_handle_connect on v2:172.21.15.50:6840/575209862 2024-08-31T04:30:46.684 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:46.682+0000 7f401be00640 1 -- 172.21.15.50:0/1330740160 <== mds.1 v2:172.21.15.50:6840/575209862 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x558bb2dbbd50 con 0x558bb2a5bfd0 2024-08-31T04:30:46.685 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:46.682+0000 7f401be00640 10 client.16140 handle_command_reply: tid=0 2024-08-31T04:30:46.685 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:46.682+0000 7f404800f740 1 client.16140 shutdown 2024-08-31T04:30:46.685 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:46.683+0000 7f404800f740 1 -- 172.21.15.50:0/1330740160 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558bb2a9d760 msgr2=0x558bb2e4f9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:30:46.685 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:46.683+0000 7f404800f740 1 --2- 172.21.15.50:0/1330740160 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558bb2a9d760 0x558bb2e4f9d0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f4034009270 tx=0x7f4034009ca0 comp rx=0 tx=0).stop 2024-08-31T04:30:46.685 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:46.683+0000 7f404800f740 1 -- 172.21.15.50:0/1330740160 shutdown_connections 2024-08-31T04:30:46.685 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:46.683+0000 7f404800f740 1 --2- 172.21.15.50:0/1330740160 >> [v2:172.21.15.50:6840/575209862,v1:172.21.15.50:6841/575209862] conn(0x558bb2a5bfd0 0x558bb2e61530 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:46.685 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:46.683+0000 7f404800f740 1 --2- 172.21.15.50:0/1330740160 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558bb2a9d760 0x558bb2e4f9d0 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:46.685 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:46.683+0000 7f404800f740 1 --2- 172.21.15.50:0/1330740160 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x558bb2a7c970 0x558bb2e4f450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:46.685 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:46.683+0000 7f404800f740 1 --2- 172.21.15.50:0/1330740160 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x558bb2a74790 0x558bb2e4ef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:46.685 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:46.683+0000 7f404800f740 1 -- 172.21.15.50:0/1330740160 >> 172.21.15.50:0/1330740160 conn(0x558bb2a91560 msgr2=0x558bb2e46a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:30:46.685 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:46.683+0000 7f401be00640 0 client.16140 ms_handle_reset on v2:172.21.15.50:6840/575209862 2024-08-31T04:30:46.686 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:46.684+0000 7f404800f740 1 -- 172.21.15.50:0/1330740160 shutdown_connections 2024-08-31T04:30:46.686 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:46.684+0000 7f404800f740 1 -- 172.21.15.50:0/1330740160 wait complete. 2024-08-31T04:30:46.686 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:46.684+0000 7f404800f740 20 client.16140 trim_cache size 0 max 16384 2024-08-31T04:30:46.702 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:46.700+0000 7f404800f740 1 Processor -- start 2024-08-31T04:30:46.702 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:46.701+0000 7f404800f740 1 -- start start 2024-08-31T04:30:46.703 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:46.701+0000 7f404800f740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558bb2a74790 0x558bb2e4c100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:30:46.703 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:46.701+0000 7f404800f740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x558bb2a7c970 0x558bb2e4c640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:30:46.703 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:46.701+0000 7f404800f740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x558bb2a9d760 0x558bb2e66ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:30:46.703 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:46.701+0000 7f404800f740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f403c1b13c0 con 0x558bb2a74790 2024-08-31T04:30:46.703 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:46.701+0000 7f404800f740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f403c1b2ff0 con 0x558bb2a7c970 2024-08-31T04:30:46.703 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:46.701+0000 7f404800f740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f403c1b1a90 con 0x558bb2a9d760 2024-08-31T04:30:46.703 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:46.701+0000 7f4039e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558bb2a74790 0x558bb2e4c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:30:46.703 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:46.701+0000 7f4039e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558bb2a74790 0x558bb2e4c100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:33858/0 (socket says 172.21.15.50:33858) 2024-08-31T04:30:46.703 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:46.701+0000 7f4039e00640 1 -- 172.21.15.50:0/188665256 learned_addr learned my addr 172.21.15.50:0/188665256 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:30:46.703 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:46.701+0000 7f403a800640 1 --2- 172.21.15.50:0/188665256 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x558bb2a9d760 0x558bb2e66ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:30:46.704 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:46.702+0000 7f4039e00640 1 -- 172.21.15.50:0/188665256 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x558bb2a9d760 msgr2=0x558bb2e66ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:30:46.704 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:46.702+0000 7f4039e00640 1 --2- 172.21.15.50:0/188665256 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x558bb2a9d760 0x558bb2e66ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:46.704 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:46.702+0000 7f4039e00640 1 -- 172.21.15.50:0/188665256 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x558bb2a7c970 msgr2=0x558bb2e4c640 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-08-31T04:30:46.704 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:46.702+0000 7f4039e00640 1 --2- 172.21.15.50:0/188665256 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x558bb2a7c970 0x558bb2e4c640 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:46.705 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:46.702+0000 7f4039e00640 1 -- 172.21.15.50:0/188665256 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558bb2e51650 con 0x558bb2a74790 2024-08-31T04:30:46.705 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:46.702+0000 7f4039e00640 1 --2- 172.21.15.50:0/188665256 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558bb2a74790 0x558bb2e4c100 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f402c006010 tx=0x7f402c03d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a6ccbb58fb18231 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:30:46.705 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:46.702+0000 7f4026a00640 1 -- 172.21.15.50:0/188665256 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f402c055070 con 0x558bb2a74790 2024-08-31T04:30:46.705 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:46.702+0000 7f4026a00640 1 -- 172.21.15.50:0/188665256 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f402c004300 con 0x558bb2a74790 2024-08-31T04:30:46.705 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:46.702+0000 7f4026a00640 1 -- 172.21.15.50:0/188665256 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f402c035050 con 0x558bb2a74790 2024-08-31T04:30:46.706 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:46.703+0000 7f404800f740 1 -- 172.21.15.50:0/188665256 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558bb2a74790 msgr2=0x558bb2e4c100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:30:46.706 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:46.703+0000 7f404800f740 1 --2- 172.21.15.50:0/188665256 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558bb2a74790 0x558bb2e4c100 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f402c006010 tx=0x7f402c03d000 comp rx=0 tx=0).stop 2024-08-31T04:30:46.706 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:46.703+0000 7f404800f740 1 -- 172.21.15.50:0/188665256 shutdown_connections 2024-08-31T04:30:46.707 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:46.703+0000 7f404800f740 1 --2- 172.21.15.50:0/188665256 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x558bb2a9d760 0x558bb2e66ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:46.707 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:46.703+0000 7f404800f740 1 --2- 172.21.15.50:0/188665256 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x558bb2a7c970 0x558bb2e4c640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:46.707 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:46.703+0000 7f404800f740 1 --2- 172.21.15.50:0/188665256 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558bb2a74790 0x558bb2e4c100 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:46.707 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:46.703+0000 7f404800f740 1 -- 172.21.15.50:0/188665256 >> 172.21.15.50:0/188665256 conn(0x558bb2a91560 msgr2=0x558bb2e50430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:30:46.707 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:46.704+0000 7f404800f740 1 -- 172.21.15.50:0/188665256 shutdown_connections 2024-08-31T04:30:46.707 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:46.704+0000 7f404800f740 1 -- 172.21.15.50:0/188665256 wait complete. 2024-08-31T04:30:46.707 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:46.704+0000 7f404800f740 1 -- start start 2024-08-31T04:30:46.707 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:46.704+0000 7f404800f740 1 Processor -- start 2024-08-31T04:30:46.707 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:46.705+0000 7f404800f740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x558bb2a74790 0x558bb2e53720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:30:46.707 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:46.705+0000 7f404800f740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x558bb2a7c970 0x558bb2e53c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:30:46.707 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:46.705+0000 7f404800f740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558bb2a9d760 0x558bb2ecaee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:30:46.707 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:46.705+0000 7f404800f740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f403c1b2920 con 0x558bb2a9d760 2024-08-31T04:30:46.707 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:46.705+0000 7f404800f740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f403c1b2220 con 0x558bb2a7c970 2024-08-31T04:30:46.708 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:46.705+0000 7f404800f740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f403c1af3a0 con 0x558bb2a74790 2024-08-31T04:30:46.708 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:46.705+0000 7f404800f740 10 client.0 _ll_register_callbacks cb 0x7f4034009e00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:30:46.708 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:46.705+0000 7f4039e00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x558bb2a74790 0x558bb2e53720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:30:46.708 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:46.705+0000 7f4039e00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x558bb2a74790 0x558bb2e53720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.50:51926/0 (socket says 172.21.15.50:51926) 2024-08-31T04:30:46.708 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:46.705+0000 7f4039e00640 1 -- 172.21.15.50:0/4275286047 learned_addr learned my addr 172.21.15.50:0/4275286047 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:30:46.708 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:46.705+0000 7f403a800640 1 --2- 172.21.15.50:0/4275286047 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558bb2a9d760 0x558bb2ecaee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:30:46.708 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:46.705+0000 7f4039400640 1 --2- 172.21.15.50:0/4275286047 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x558bb2a7c970 0x558bb2e53c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:30:46.708 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:46.706+0000 7f4039400640 1 -- 172.21.15.50:0/4275286047 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x558bb2a74790 msgr2=0x558bb2e53720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:30:46.709 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:46.706+0000 7f4039400640 1 --2- 172.21.15.50:0/4275286047 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x558bb2a74790 0x558bb2e53720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:46.709 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:46.706+0000 7f4039400640 1 -- 172.21.15.50:0/4275286047 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558bb2a9d760 msgr2=0x558bb2ecaee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:30:46.709 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:46.706+0000 7f4039400640 1 --2- 172.21.15.50:0/4275286047 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558bb2a9d760 0x558bb2ecaee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:46.709 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:46.706+0000 7f4039400640 1 -- 172.21.15.50:0/4275286047 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558bb2ecb420 con 0x558bb2a7c970 2024-08-31T04:30:46.709 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:46.706+0000 7f403a800640 1 --2- 172.21.15.50:0/4275286047 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558bb2a9d760 0x558bb2ecaee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:30:46.720 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:46.718+0000 7f4039400640 1 --2- 172.21.15.50:0/4275286047 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x558bb2a7c970 0x558bb2e53c60 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x558bb2d4f3d0 tx=0x7f40280a7240 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a79867346ee06bc7 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:30:46.720 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:46.718+0000 7f401be00640 10 client.0 ms_handle_connect on v2:172.21.15.133:3300/0 2024-08-31T04:30:46.720 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:46.719+0000 7f401be00640 1 -- 172.21.15.50:0/4275286047 <== mon.2 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40280aadd0 con 0x558bb2a7c970 2024-08-31T04:30:46.720 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:46.719+0000 7f401be00640 1 -- 172.21.15.50:0/4275286047 <== mon.2 v2:172.21.15.133:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8219+0+0 (secure 0 0 0) 0x7f4028011830 con 0x558bb2a7c970 2024-08-31T04:30:46.720 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:46.719+0000 7f404800f740 1 -- 172.21.15.50:0/4275286047 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f402c004300 con 0x558bb2a7c970 2024-08-31T04:30:46.721 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:46.719+0000 7f401be00640 1 -- 172.21.15.50:0/4275286047 <== mon.2 v2:172.21.15.133:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7f40280ab9c0 con 0x558bb2a7c970 2024-08-31T04:30:46.721 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:46.719+0000 7f404800f740 10 client.26144 fetch_fsmap learned FSMap version 42 2024-08-31T04:30:46.721 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:46.719+0000 7f404800f740 1 -- 172.21.15.50:0/4275286047 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x558bb2ecc4f0 con 0x558bb2a7c970 2024-08-31T04:30:46.722 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:46.719+0000 7f401be00640 1 -- 172.21.15.50:0/4275286047 <== mon.2 v2:172.21.15.133:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f402c004300 con 0x558bb2a7c970 2024-08-31T04:30:46.722 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:46.720+0000 7f401be00640 1 -- 172.21.15.50:0/4275286047 <== mon.2 v2:172.21.15.133:3300/0 5 ==== fsmap(e 42) ==== 8398+0+0 (secure 0 0 0) 0x7f40280a6c30 con 0x558bb2a7c970 2024-08-31T04:30:46.722 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:46.720+0000 7f404800f740 10 client.26144 fetch_fsmap finished waiting for FSMap version 42 2024-08-31T04:30:46.722 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:46.720+0000 7f404800f740 10 client.26144 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.a 2024-08-31T04:30:46.722 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:46.720+0000 7f404800f740 20 client.26144 populate_metadata read hostname 'smithi050' 2024-08-31T04:30:46.722 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:46.720+0000 7f404800f740 1 --2- 172.21.15.50:0/4275286047 >> [v2:172.21.15.50:6840/575209862,v1:172.21.15.50:6841/575209862] conn(0x558bb2a31380 0x558bb2eced90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:30:46.722 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:46.720+0000 7f404800f740 4 client.26144 mds_command: new command op to 24691 tid=0 multi_id=0 [{"prefix": "ops", "flags": ["locks"], "path": "/var/run/ceph/ops-9d491f02-1-mds.a.json"}] 2024-08-31T04:30:46.722 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:46.720+0000 7f404800f740 1 -- 172.21.15.50:0/4275286047 --> [v2:172.21.15.50:6840/575209862,v1:172.21.15.50:6841/575209862] -- command(tid 0: {"prefix": "ops", "flags": ["locks"], "path": "/var/run/ceph/ops-9d491f02-1-mds.a.json"}) -- 0x558bb2db77f0 con 0x558bb2a31380 2024-08-31T04:30:46.722 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:46.720+0000 7f4039e00640 1 --2- 172.21.15.50:0/4275286047 >> [v2:172.21.15.50:6840/575209862,v1:172.21.15.50:6841/575209862] conn(0x558bb2a31380 0x558bb2eced90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:30:46.723 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:46.721+0000 7f4039e00640 1 --2- 172.21.15.50:0/4275286047 >> [v2:172.21.15.50:6840/575209862,v1:172.21.15.50:6841/575209862] conn(0x558bb2a31380 0x558bb2eced90 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=9ab23ae76babe7a4 server_cookie=d4c341156ac23b72 in_seq=0 out_seq=0 2024-08-31T04:30:46.723 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:46.721+0000 7f401be00640 10 client.26144 ms_handle_connect on v2:172.21.15.50:6840/575209862 2024-08-31T04:30:47.514 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:47.512+0000 7f401be00640 1 -- 172.21.15.50:0/4275286047 <== mds.1 v2:172.21.15.50:6840/575209862 1 ==== command_reply(tid 0: 0 ) ==== 8+0+58 (crc 0 0 0) 0x558bb2db77f0 con 0x558bb2a31380 2024-08-31T04:30:47.514 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:47.512+0000 7f401be00640 10 client.26144 handle_command_reply: tid=0 2024-08-31T04:30:47.514 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:47.512+0000 7f404800f740 1 client.26144 shutdown 2024-08-31T04:30:47.514 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:47.512+0000 7f404800f740 1 -- 172.21.15.50:0/4275286047 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x558bb2a7c970 msgr2=0x558bb2e53c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:30:47.514 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:47.512+0000 7f404800f740 1 --2- 172.21.15.50:0/4275286047 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x558bb2a7c970 0x558bb2e53c60 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x558bb2d4f3d0 tx=0x7f40280a7240 comp rx=0 tx=0).stop 2024-08-31T04:30:47.514 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:47.513+0000 7f404800f740 1 -- 172.21.15.50:0/4275286047 shutdown_connections 2024-08-31T04:30:47.514 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:47.513+0000 7f404800f740 1 --2- 172.21.15.50:0/4275286047 >> [v2:172.21.15.50:6840/575209862,v1:172.21.15.50:6841/575209862] conn(0x558bb2a31380 0x558bb2eced90 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:47.514 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:47.513+0000 7f404800f740 1 --2- 172.21.15.50:0/4275286047 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558bb2a9d760 0x558bb2ecaee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:47.515 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:47.513+0000 7f404800f740 1 --2- 172.21.15.50:0/4275286047 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x558bb2a7c970 0x558bb2e53c60 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:47.515 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:47.513+0000 7f404800f740 1 --2- 172.21.15.50:0/4275286047 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x558bb2a74790 0x558bb2e53720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:47.515 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:47.513+0000 7f404800f740 1 -- 172.21.15.50:0/4275286047 >> 172.21.15.50:0/4275286047 conn(0x558bb2a91560 msgr2=0x558bb2e4d390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:30:47.515 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:47.513+0000 7f401be00640 0 client.26144 ms_handle_reset on v2:172.21.15.50:6840/575209862 2024-08-31T04:30:47.515 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:47.513+0000 7f404800f740 1 -- 172.21.15.50:0/4275286047 shutdown_connections 2024-08-31T04:30:47.515 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:47.513+0000 7f404800f740 1 -- 172.21.15.50:0/4275286047 wait complete. 2024-08-31T04:30:47.515 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:47.513+0000 7f404800f740 20 client.26144 trim_cache size 0 max 16384 2024-08-31T04:30:47.516 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-08-31T04:30:47.516 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/var/run/ceph/ops-9d491f02-1-mds.a.json" 2024-08-31T04:30:47.516 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-08-31T04:30:47.516 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:47.514+0000 7f4041200640 1 -- 172.21.15.50:0/1884091885 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f40200b4b30 msgr2=0x7f40200b7040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:30:47.517 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:47.514+0000 7f4041200640 1 --2- 172.21.15.50:0/1884091885 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f40200b4b30 0x7f40200b7040 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x558bb2e424f0 tx=0x7f402c009660 comp rx=0 tx=0).stop 2024-08-31T04:30:47.517 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:47.514+0000 7f4041200640 1 -- 172.21.15.50:0/1884091885 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f403c109240 msgr2=0x7f403c0759f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:30:47.517 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:47.514+0000 7f4041200640 1 --2- 172.21.15.50:0/1884091885 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f403c109240 0x7f403c0759f0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f403c06c790 tx=0x7f402800b850 comp rx=0 tx=0).stop 2024-08-31T04:30:47.517 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:47.514+0000 7f4041200640 1 -- 172.21.15.50:0/1884091885 shutdown_connections 2024-08-31T04:30:47.517 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:47.514+0000 7f4041200640 1 --2- 172.21.15.50:0/1884091885 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f40200b4b30 0x7f40200b7040 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:47.517 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:47.514+0000 7f4041200640 1 --2- 172.21.15.50:0/1884091885 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f403c109b90 0x7f403c075f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:47.517 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:47.514+0000 7f4041200640 1 --2- 172.21.15.50:0/1884091885 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f403c109240 0x7f403c0759f0 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:47.517 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:47.514+0000 7f4041200640 1 --2- 172.21.15.50:0/1884091885 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f403c103900 0x7f403c0754b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:47.517 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:47.514+0000 7f4041200640 1 -- 172.21.15.50:0/1884091885 >> 172.21.15.50:0/1884091885 conn(0x7f403c07b5f0 msgr2=0x7f403c1073e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:30:47.517 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:47.514+0000 7f4041200640 1 -- 172.21.15.50:0/1884091885 shutdown_connections 2024-08-31T04:30:47.517 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:47.514+0000 7f4041200640 1 -- 172.21.15.50:0/1884091885 wait complete. 2024-08-31T04:30:47.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:30:47 smithi177 ceph-mon[22025]: pgmap v605: 97 pgs: 97 active+clean; 1.5 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 58 KiB/s wr, 25 op/s 2024-08-31T04:30:47.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:30:47 smithi133 ceph-mon[22177]: pgmap v605: 97 pgs: 97 active+clean; 1.5 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 58 KiB/s wr, 25 op/s 2024-08-31T04:30:47.950 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:30:47 smithi050 ceph-mon[17259]: pgmap v605: 97 pgs: 97 active+clean; 1.5 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 58 KiB/s wr, 25 op/s 2024-08-31T04:30:48.610 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:30:48 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T04:30:48.611 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:30:48 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-08-31T04:30:48.611 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:30:48 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-08-31T04:30:48.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:30:48 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T04:30:48.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:30:48 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-08-31T04:30:48.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:30:48 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-08-31T04:30:48.861 DEBUG:tasks.quiescer.fs.[cephfs]:Dumping ops on rank 0 (b) to a remote file /var/run/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/ops-9d491f02-1-mds.b.json 2024-08-31T04:30:48.862 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 058d9fc6-674f-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 ops --flags=locks --path=/var/run/ceph/ops-9d491f02-1-mds.b.json 2024-08-31T04:30:48.996 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:30:48 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T04:30:48.996 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:30:48 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-08-31T04:30:48.996 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:30:48 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-08-31T04:30:49.299 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:30:49.727 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:30:49 smithi050 ceph-mon[17259]: pgmap v606: 97 pgs: 97 active+clean; 1.5 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 71 KiB/s wr, 28 op/s 2024-08-31T04:30:49.727 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:30:49 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-08-31T04:30:49.727 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:30:49 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"} : dispatch 2024-08-31T04:30:49.727 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:30:49 smithi050 ceph-mon[17259]: Adjusting osd_memory_target on smithi177 to 175.9M 2024-08-31T04:30:49.727 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:30:49 smithi050 ceph-mon[17259]: Unable to set osd_memory_target on smithi177 to 184530841: error parsing value: Value '184530841' is below minimum 939524096 2024-08-31T04:30:49.727 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:30:49 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:30:49.727 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:30:49 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T04:30:49.727 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:30:49 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:30:49.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:30:49 smithi133 ceph-mon[22177]: pgmap v606: 97 pgs: 97 active+clean; 1.5 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 71 KiB/s wr, 28 op/s 2024-08-31T04:30:49.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:30:49 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-08-31T04:30:49.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:30:49 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"} : dispatch 2024-08-31T04:30:49.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:30:49 smithi133 ceph-mon[22177]: Adjusting osd_memory_target on smithi177 to 175.9M 2024-08-31T04:30:49.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:30:49 smithi133 ceph-mon[22177]: Unable to set osd_memory_target on smithi177 to 184530841: error parsing value: Value '184530841' is below minimum 939524096 2024-08-31T04:30:49.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:30:49 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:30:49.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:30:49 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T04:30:49.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:30:49 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:30:49.996 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:30:49 smithi177 ceph-mon[22025]: pgmap v606: 97 pgs: 97 active+clean; 1.5 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 71 KiB/s wr, 28 op/s 2024-08-31T04:30:49.996 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:30:49 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-08-31T04:30:49.996 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:30:49 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"} : dispatch 2024-08-31T04:30:49.996 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:30:49 smithi177 ceph-mon[22025]: Adjusting osd_memory_target on smithi177 to 175.9M 2024-08-31T04:30:49.996 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:30:49 smithi177 ceph-mon[22025]: Unable to set osd_memory_target on smithi177 to 184530841: error parsing value: Value '184530841' is below minimum 939524096 2024-08-31T04:30:49.996 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:30:49 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:30:49.997 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:30:49 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T04:30:49.997 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:30:49 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:30:50.166 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:50.164+0000 7f99c6400640 1 -- 172.21.15.50:0/3432333325 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f99c00754f0 msgr2=0x7f99c0075900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:30:50.166 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:50.164+0000 7f99c6400640 1 --2- 172.21.15.50:0/3432333325 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f99c00754f0 0x7f99c0075900 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f99b0009900 tx=0x7f99b002a400 comp rx=0 tx=0).stop 2024-08-31T04:30:50.166 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:50.164+0000 7f99c6400640 1 -- 172.21.15.50:0/3432333325 shutdown_connections 2024-08-31T04:30:50.166 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:50.164+0000 7f99c6400640 1 --2- 172.21.15.50:0/3432333325 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f99c0075e40 0x7f99c010f980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:50.166 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:50.164+0000 7f99c6400640 1 --2- 172.21.15.50:0/3432333325 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f99c010fec0 0x7f99c01122e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:50.166 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:50.164+0000 7f99c6400640 1 --2- 172.21.15.50:0/3432333325 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f99c00754f0 0x7f99c0075900 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:50.166 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:50.164+0000 7f99c6400640 1 -- 172.21.15.50:0/3432333325 >> 172.21.15.50:0/3432333325 conn(0x7f99c007b5f0 msgr2=0x7f99c007ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:30:50.166 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:50.164+0000 7f99c6400640 1 -- 172.21.15.50:0/3432333325 shutdown_connections 2024-08-31T04:30:50.167 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:50.165+0000 7f99c6400640 1 -- 172.21.15.50:0/3432333325 wait complete. 2024-08-31T04:30:50.167 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:50.166+0000 7f99c6400640 1 Processor -- start 2024-08-31T04:30:50.168 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:50.166+0000 7f99c6400640 1 -- start start 2024-08-31T04:30:50.168 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:50.167+0000 7f99c6400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f99c00754f0 0x7f99c019c400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:30:50.168 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:50.167+0000 7f99c6400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f99c0075e40 0x7f99c019c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:30:50.168 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:50.167+0000 7f99c6400640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f99c010fec0 0x7f99c01a1c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:30:50.168 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:50.167+0000 7f99c6400640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f99c0115a30 con 0x7f99c0075e40 2024-08-31T04:30:50.168 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:50.167+0000 7f99c6400640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f99c01158b0 con 0x7f99c00754f0 2024-08-31T04:30:50.169 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:50.167+0000 7f99c6400640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f99c0115bb0 con 0x7f99c010fec0 2024-08-31T04:30:50.169 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:50.167+0000 7f99bf400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f99c00754f0 0x7f99c019c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:30:50.170 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:50.167+0000 7f99bf400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f99c00754f0 0x7f99c019c400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.50:56530/0 (socket says 172.21.15.50:56530) 2024-08-31T04:30:50.170 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:50.167+0000 7f99bf400640 1 -- 172.21.15.50:0/872230662 learned_addr learned my addr 172.21.15.50:0/872230662 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:30:50.170 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:50.167+0000 7f99b7e00640 1 --2- 172.21.15.50:0/872230662 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f99c0075e40 0x7f99c019c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:30:50.170 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:50.167+0000 7f99bfe00640 1 --2- 172.21.15.50:0/872230662 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f99c010fec0 0x7f99c01a1c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:30:50.170 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:50.168+0000 7f99bfe00640 1 -- 172.21.15.50:0/872230662 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f99c00754f0 msgr2=0x7f99c019c400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:30:50.170 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:50.168+0000 7f99bfe00640 1 --2- 172.21.15.50:0/872230662 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f99c00754f0 0x7f99c019c400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:50.170 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:50.168+0000 7f99bfe00640 1 -- 172.21.15.50:0/872230662 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f99c0075e40 msgr2=0x7f99c019c9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:30:50.170 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:50.168+0000 7f99bfe00640 1 --2- 172.21.15.50:0/872230662 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f99c0075e40 0x7f99c019c9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:50.170 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:50.168+0000 7f99bfe00640 1 -- 172.21.15.50:0/872230662 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99c01a2370 con 0x7f99c010fec0 2024-08-31T04:30:50.170 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:50.168+0000 7f99b7e00640 1 --2- 172.21.15.50:0/872230662 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f99c0075e40 0x7f99c019c9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:30:50.172 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:50.171+0000 7f99bfe00640 1 --2- 172.21.15.50:0/872230662 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f99c010fec0 0x7f99c01a1c40 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f99b8009fd0 tx=0x7f99b800ef10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:30:50.172 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:50.171+0000 7f99bcc00640 1 -- 172.21.15.50:0/872230662 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99b800ce20 con 0x7f99c010fec0 2024-08-31T04:30:50.173 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:50.171+0000 7f99bcc00640 1 -- 172.21.15.50:0/872230662 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f99b8005020 con 0x7f99c010fec0 2024-08-31T04:30:50.173 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:50.171+0000 7f99c6400640 1 -- 172.21.15.50:0/872230662 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f99c01a2660 con 0x7f99c010fec0 2024-08-31T04:30:50.173 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:50.171+0000 7f99bcc00640 1 -- 172.21.15.50:0/872230662 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99b8010690 con 0x7f99c010fec0 2024-08-31T04:30:50.173 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:50.171+0000 7f99c6400640 1 -- 172.21.15.50:0/872230662 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f99c01a8dc0 con 0x7f99c010fec0 2024-08-31T04:30:50.176 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:50.175+0000 7f99cd039740 1 Processor -- start 2024-08-31T04:30:50.178 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:50.176+0000 7f99bcc00640 1 -- 172.21.15.50:0/872230662 <== mon.1 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 18) ==== 152577+0+0 (secure 0 0 0) 0x7f99b80054d0 con 0x7f99c010fec0 2024-08-31T04:30:50.178 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:50.177+0000 7f99cd039740 1 -- start start 2024-08-31T04:30:50.179 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:50.177+0000 7f99cd039740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55717ef0f760 0x55717f2b5310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:30:50.179 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:50.177+0000 7f99cd039740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55717eee6790 0x55717f2b5850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:30:50.179 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:50.177+0000 7f99cd039740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55717eeee970 0x55717f2b5d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:30:50.179 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:50.177+0000 7f99cd039740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55717f22be00 con 0x55717ef0f760 2024-08-31T04:30:50.179 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:50.177+0000 7f99cd039740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x55717f21b390 con 0x55717eee6790 2024-08-31T04:30:50.179 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:50.177+0000 7f99cd039740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x55717f21f340 con 0x55717eeee970 2024-08-31T04:30:50.179 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:50.177+0000 7f99b7e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55717ef0f760 0x55717f2b5310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:30:50.179 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:50.177+0000 7f99bf400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55717eee6790 0x55717f2b5850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:30:50.180 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:50.177+0000 7f99bf400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55717eee6790 0x55717f2b5850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.50:56532/0 (socket says 172.21.15.50:56532) 2024-08-31T04:30:50.180 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:50.177+0000 7f99bf400640 1 -- 172.21.15.50:0/2570153512 learned_addr learned my addr 172.21.15.50:0/2570153512 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:30:50.180 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:50.178+0000 7f99b7e00640 1 --2- 172.21.15.50:0/2570153512 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55717eeee970 0x55717f2b5d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:30:50.181 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:50.178+0000 7f99b7e00640 1 -- 172.21.15.50:0/2570153512 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55717eeee970 msgr2=0x55717f2b5d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:30:50.181 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:50.178+0000 7f99b7e00640 1 --2- 172.21.15.50:0/2570153512 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55717eeee970 0x55717f2b5d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:50.181 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:50.178+0000 7f99b7e00640 1 -- 172.21.15.50:0/2570153512 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55717eee6790 msgr2=0x55717f2b5850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:30:50.181 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:50.178+0000 7f99b7e00640 1 --2- 172.21.15.50:0/2570153512 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55717eee6790 0x55717f2b5850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:50.181 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:50.178+0000 7f99b7e00640 1 -- 172.21.15.50:0/2570153512 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55717efed490 con 0x55717ef0f760 2024-08-31T04:30:50.181 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:50.179+0000 7f99b7e00640 1 --2- 172.21.15.50:0/2570153512 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55717ef0f760 0x55717f2b5310 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f99a8009fd0 tx=0x7f99a8005850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84c232cbc023250b server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:30:50.181 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:50.179+0000 7f99bcc00640 1 --2- 172.21.15.50:0/872230662 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f99a40b4b30 0x7f99a40b7040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:30:50.181 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:50.179+0000 7f99b4c00640 1 -- 172.21.15.50:0/2570153512 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99a8013120 con 0x55717ef0f760 2024-08-31T04:30:50.181 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:50.179+0000 7f99bcc00640 1 -- 172.21.15.50:0/872230662 <== mon.1 v2:172.21.15.177:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8219+0+0 (secure 0 0 0) 0x7f99b80e5880 con 0x7f99c010fec0 2024-08-31T04:30:50.182 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:50.179+0000 7f99b4c00640 1 -- 172.21.15.50:0/2570153512 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f99a800f850 con 0x55717ef0f760 2024-08-31T04:30:50.182 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:50.179+0000 7f99b4c00640 1 -- 172.21.15.50:0/2570153512 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99a80044e0 con 0x55717ef0f760 2024-08-31T04:30:50.182 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:50.179+0000 7f99bf400640 1 --2- 172.21.15.50:0/872230662 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f99a40b4b30 0x7f99a40b7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:30:50.184 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:50.180+0000 7f99cd039740 1 -- 172.21.15.50:0/2570153512 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55717ef0f760 msgr2=0x55717f2b5310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:30:50.184 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:50.180+0000 7f99cd039740 1 --2- 172.21.15.50:0/2570153512 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55717ef0f760 0x55717f2b5310 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f99a8009fd0 tx=0x7f99a8005850 comp rx=0 tx=0).stop 2024-08-31T04:30:50.184 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:50.180+0000 7f99bf400640 1 --2- 172.21.15.50:0/872230662 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f99a40b4b30 0x7f99a40b7040 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f99b0005f70 tx=0x7f99b00058b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:30:50.184 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:50.180+0000 7f99cd039740 1 -- 172.21.15.50:0/2570153512 shutdown_connections 2024-08-31T04:30:50.184 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:50.180+0000 7f99cd039740 1 --2- 172.21.15.50:0/2570153512 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55717eeee970 0x55717f2b5d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:50.184 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:50.180+0000 7f99cd039740 1 --2- 172.21.15.50:0/2570153512 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55717eee6790 0x55717f2b5850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:50.184 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:50.180+0000 7f99cd039740 1 --2- 172.21.15.50:0/2570153512 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55717ef0f760 0x55717f2b5310 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:50.184 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:50.180+0000 7f99cd039740 1 -- 172.21.15.50:0/2570153512 >> 172.21.15.50:0/2570153512 conn(0x55717ef03560 msgr2=0x55717f2b3200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:30:50.184 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:50.181+0000 7f99cd039740 1 -- 172.21.15.50:0/2570153512 shutdown_connections 2024-08-31T04:30:50.185 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:50.181+0000 7f99cd039740 1 -- 172.21.15.50:0/2570153512 wait complete. 2024-08-31T04:30:50.185 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:50.181+0000 7f99cd039740 1 -- start start 2024-08-31T04:30:50.185 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:50.182+0000 7f99cd039740 1 Processor -- start 2024-08-31T04:30:50.185 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:50.182+0000 7f99cd039740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55717eee6790 0x55717f2c0a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:30:50.185 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:50.182+0000 7f99cd039740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55717eeee970 0x55717f2c0f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:30:50.185 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:50.182+0000 7f99cd039740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55717ef0f760 0x55717f2ccdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:30:50.185 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:50.182+0000 7f99cd039740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55717f07e380 con 0x55717eee6790 2024-08-31T04:30:50.185 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:50.182+0000 7f99cd039740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x55717f1a1cc0 con 0x55717ef0f760 2024-08-31T04:30:50.185 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:50.182+0000 7f99cd039740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x55717f2c3a90 con 0x55717eeee970 2024-08-31T04:30:50.185 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:50.182+0000 7f99cd039740 10 client.0 _ll_register_callbacks cb 0x55717f1d1020 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:30:50.185 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:50.183+0000 7f99bf400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55717eee6790 0x55717f2c0a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:30:50.186 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:50.183+0000 7f99bf400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55717eee6790 0x55717f2c0a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:33890/0 (socket says 172.21.15.50:33890) 2024-08-31T04:30:50.186 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:50.183+0000 7f99bf400640 1 -- 172.21.15.50:0/983960541 learned_addr learned my addr 172.21.15.50:0/983960541 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:30:50.187 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:50.183+0000 7f99bfe00640 1 --2- 172.21.15.50:0/983960541 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55717ef0f760 0x55717f2ccdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:30:50.187 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:50.183+0000 7f99bf400640 1 -- 172.21.15.50:0/983960541 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55717eeee970 msgr2=0x55717f2c0f80 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-08-31T04:30:50.187 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:50.183+0000 7f99bf400640 1 --2- 172.21.15.50:0/983960541 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55717eeee970 0x55717f2c0f80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:50.187 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:50.183+0000 7f99bf400640 1 -- 172.21.15.50:0/983960541 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55717ef0f760 msgr2=0x55717f2ccdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:30:50.187 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:50.183+0000 7f99bf400640 1 --2- 172.21.15.50:0/983960541 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55717ef0f760 0x55717f2ccdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:50.187 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:50.183+0000 7f99bf400640 1 -- 172.21.15.50:0/983960541 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55717f1e1b30 con 0x55717eee6790 2024-08-31T04:30:50.187 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:50.183+0000 7f99bfe00640 1 --2- 172.21.15.50:0/983960541 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55717ef0f760 0x55717f2ccdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:30:50.187 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:50.184+0000 7f99bf400640 1 --2- 172.21.15.50:0/983960541 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55717eee6790 0x55717f2c0a40 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f99b0032fd0 tx=0x7f99b0009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7272f9ca6b1091ad server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:30:50.187 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:50.184+0000 7f99ad600640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-08-31T04:30:50.187 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:50.184+0000 7f99ad600640 1 -- 172.21.15.50:0/983960541 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99b004c070 con 0x55717eee6790 2024-08-31T04:30:50.187 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:50.184+0000 7f99ad600640 1 -- 172.21.15.50:0/983960541 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8219+0+0 (secure 0 0 0) 0x7f99b0003cc0 con 0x55717eee6790 2024-08-31T04:30:50.188 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:50.184+0000 7f99cd039740 1 -- 172.21.15.50:0/983960541 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f99a800f850 con 0x55717eee6790 2024-08-31T04:30:50.188 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:50.184+0000 7f99ad600640 1 -- 172.21.15.50:0/983960541 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7f99b0058050 con 0x55717eee6790 2024-08-31T04:30:50.188 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:50.184+0000 7f99cd039740 10 client.16158 fetch_fsmap learned FSMap version 42 2024-08-31T04:30:50.188 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:50.184+0000 7f99cd039740 1 -- 172.21.15.50:0/983960541 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x55717f2cfbc0 con 0x55717eee6790 2024-08-31T04:30:50.189 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:50.185+0000 7f99ad600640 1 -- 172.21.15.50:0/983960541 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f99a800f850 con 0x55717eee6790 2024-08-31T04:30:50.189 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:50.185+0000 7f99ad600640 1 -- 172.21.15.50:0/983960541 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 42) ==== 8398+0+0 (secure 0 0 0) 0x7f99b0004960 con 0x55717eee6790 2024-08-31T04:30:50.189 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:50.185+0000 7f99cd039740 10 client.16158 fetch_fsmap finished waiting for FSMap version 42 2024-08-31T04:30:50.189 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:50.185+0000 7f99cd039740 10 client.16158 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T04:30:50.189 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:50.185+0000 7f99cd039740 20 client.16158 populate_metadata read hostname 'smithi050' 2024-08-31T04:30:50.189 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:50.185+0000 7f99cd039740 1 --2- 172.21.15.50:0/983960541 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x55717eecdfd0 0x55717f2d3120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:30:50.189 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:50.185+0000 7f99cd039740 4 client.16158 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T04:30:50.189 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:50.185+0000 7f99cd039740 1 -- 172.21.15.50:0/983960541 --> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55717f22dd50 con 0x55717eecdfd0 2024-08-31T04:30:50.189 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:50.186+0000 7f99b7e00640 1 --2- 172.21.15.50:0/983960541 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x55717eecdfd0 0x55717f2d3120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:30:50.190 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:50.186+0000 7f99b7e00640 1 --2- 172.21.15.50:0/983960541 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x55717eecdfd0 0x55717f2d3120 crc :-1 s=READY pgs=112 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f94981c0aca916a2 server_cookie=6fe1dab56a35d3f9 in_seq=0 out_seq=0 2024-08-31T04:30:50.190 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:50.186+0000 7f99ad600640 10 client.16158 ms_handle_connect on v2:172.21.15.133:6838/2526402262 2024-08-31T04:30:50.191 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:50.188+0000 7f99ad600640 1 -- 172.21.15.50:0/983960541 <== mds.0 v2:172.21.15.133:6838/2526402262 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55717f22dd50 con 0x55717eecdfd0 2024-08-31T04:30:50.191 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:50.188+0000 7f99ad600640 10 client.16158 handle_command_reply: tid=0 2024-08-31T04:30:50.191 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:50.188+0000 7f99cd039740 1 client.16158 shutdown 2024-08-31T04:30:50.191 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:50.188+0000 7f99cd039740 1 -- 172.21.15.50:0/983960541 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55717eee6790 msgr2=0x55717f2c0a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:30:50.191 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:50.188+0000 7f99cd039740 1 --2- 172.21.15.50:0/983960541 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55717eee6790 0x55717f2c0a40 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f99b0032fd0 tx=0x7f99b0009260 comp rx=0 tx=0).stop 2024-08-31T04:30:50.191 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:50.188+0000 7f99cd039740 1 -- 172.21.15.50:0/983960541 shutdown_connections 2024-08-31T04:30:50.191 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:50.188+0000 7f99cd039740 1 --2- 172.21.15.50:0/983960541 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x55717eecdfd0 0x55717f2d3120 crc :-1 s=READY pgs=112 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:50.191 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:50.188+0000 7f99cd039740 1 --2- 172.21.15.50:0/983960541 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55717eeee970 0x55717f2c0f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:50.191 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:50.188+0000 7f99cd039740 1 --2- 172.21.15.50:0/983960541 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55717ef0f760 0x55717f2ccdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:50.191 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:50.188+0000 7f99cd039740 1 --2- 172.21.15.50:0/983960541 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55717eee6790 0x55717f2c0a40 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:50.191 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:50.188+0000 7f99ad600640 0 client.16158 ms_handle_reset on v2:172.21.15.133:6838/2526402262 2024-08-31T04:30:50.192 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:50.188+0000 7f99cd039740 1 -- 172.21.15.50:0/983960541 >> 172.21.15.50:0/983960541 conn(0x55717ef03560 msgr2=0x55717f2b84f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:30:50.192 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:50.189+0000 7f99cd039740 1 -- 172.21.15.50:0/983960541 shutdown_connections 2024-08-31T04:30:50.192 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:50.189+0000 7f99cd039740 1 -- 172.21.15.50:0/983960541 wait complete. 2024-08-31T04:30:50.192 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:50.189+0000 7f99cd039740 20 client.16158 trim_cache size 0 max 16384 2024-08-31T04:30:50.207 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:50.205+0000 7f99cd039740 1 Processor -- start 2024-08-31T04:30:50.207 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:50.205+0000 7f99cd039740 1 -- start start 2024-08-31T04:30:50.207 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:50.206+0000 7f99cd039740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55717eee6790 0x55717f2c0fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:30:50.208 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:50.206+0000 7f99cd039740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55717eeee970 0x55717f2cccb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:30:50.208 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:50.206+0000 7f99cd039740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55717ef0f760 0x55717f2c2920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:30:50.208 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:50.206+0000 7f99cd039740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f99c01b1290 con 0x55717ef0f760 2024-08-31T04:30:50.208 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:50.206+0000 7f99cd039740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f99c01b2ec0 con 0x55717eee6790 2024-08-31T04:30:50.208 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:50.206+0000 7f99cd039740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f99c01b1960 con 0x55717eeee970 2024-08-31T04:30:50.208 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:50.206+0000 7f99bfe00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55717ef0f760 0x55717f2c2920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:30:50.208 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:50.206+0000 7f99bfe00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55717ef0f760 0x55717f2c2920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:33898/0 (socket says 172.21.15.50:33898) 2024-08-31T04:30:50.208 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:50.206+0000 7f99b7e00640 1 --2- 172.21.15.50:0/211083813 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55717eeee970 0x55717f2cccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:30:50.208 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:50.206+0000 7f99bfe00640 1 -- 172.21.15.50:0/211083813 learned_addr learned my addr 172.21.15.50:0/211083813 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:30:50.209 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:50.207+0000 7f99b7e00640 1 -- 172.21.15.50:0/211083813 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55717eee6790 msgr2=0x55717f2c0fc0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-08-31T04:30:50.209 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:50.207+0000 7f99b7e00640 1 --2- 172.21.15.50:0/211083813 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55717eee6790 0x55717f2c0fc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:50.209 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:50.207+0000 7f99b7e00640 1 -- 172.21.15.50:0/211083813 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55717ef0f760 msgr2=0x55717f2c2920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:30:50.209 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:50.207+0000 7f99b7e00640 1 --2- 172.21.15.50:0/211083813 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55717ef0f760 0x55717f2c2920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:50.210 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:50.207+0000 7f99b7e00640 1 -- 172.21.15.50:0/211083813 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55717f2b3b70 con 0x55717eeee970 2024-08-31T04:30:50.210 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:50.207+0000 7f99bfe00640 1 --2- 172.21.15.50:0/211083813 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55717ef0f760 0x55717f2c2920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:30:50.210 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:50.207+0000 7f99b7e00640 1 --2- 172.21.15.50:0/211083813 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55717eeee970 0x55717f2cccb0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x55717f2d3850 tx=0x7f99a80096c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5b4ab19a9c7b0c0c server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:30:50.210 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:50.207+0000 7f99afe00640 1 -- 172.21.15.50:0/211083813 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99a802d070 con 0x55717eeee970 2024-08-31T04:30:50.210 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:50.207+0000 7f99afe00640 1 -- 172.21.15.50:0/211083813 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f99a8013300 con 0x55717eeee970 2024-08-31T04:30:50.210 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:50.207+0000 7f99afe00640 1 -- 172.21.15.50:0/211083813 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99a80035f0 con 0x55717eeee970 2024-08-31T04:30:50.210 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:50.208+0000 7f99cd039740 1 -- 172.21.15.50:0/211083813 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55717eeee970 msgr2=0x55717f2cccb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:30:50.210 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:50.208+0000 7f99cd039740 1 --2- 172.21.15.50:0/211083813 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55717eeee970 0x55717f2cccb0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x55717f2d3850 tx=0x7f99a80096c0 comp rx=0 tx=0).stop 2024-08-31T04:30:50.211 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:50.208+0000 7f99cd039740 1 -- 172.21.15.50:0/211083813 shutdown_connections 2024-08-31T04:30:50.211 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:50.208+0000 7f99cd039740 1 --2- 172.21.15.50:0/211083813 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55717eeee970 0x55717f2cccb0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:50.211 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:50.208+0000 7f99cd039740 1 --2- 172.21.15.50:0/211083813 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55717ef0f760 0x55717f2c2920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:50.211 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:50.208+0000 7f99cd039740 1 --2- 172.21.15.50:0/211083813 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55717eee6790 0x55717f2c0fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:50.211 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:50.208+0000 7f99cd039740 1 -- 172.21.15.50:0/211083813 >> 172.21.15.50:0/211083813 conn(0x55717ef03560 msgr2=0x55717f2b3190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:30:50.213 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:50.208+0000 7f99cd039740 1 -- 172.21.15.50:0/211083813 shutdown_connections 2024-08-31T04:30:50.213 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:50.208+0000 7f99cd039740 1 -- 172.21.15.50:0/211083813 wait complete. 2024-08-31T04:30:50.213 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:50.209+0000 7f99cd039740 1 -- start start 2024-08-31T04:30:50.213 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:50.209+0000 7f99cd039740 1 Processor -- start 2024-08-31T04:30:50.213 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:50.209+0000 7f99cd039740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55717eee6790 0x55717f2c57d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:30:50.213 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:50.209+0000 7f99cd039740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55717eeee970 0x55717f2c5db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:30:50.213 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:50.210+0000 7f99cd039740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55717ef0f760 0x55717f336c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:30:50.213 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:50.210+0000 7f99cd039740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f99c01b27f0 con 0x55717eeee970 2024-08-31T04:30:50.213 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:50.210+0000 7f99cd039740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f99c01b20f0 con 0x55717ef0f760 2024-08-31T04:30:50.213 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:50.210+0000 7f99cd039740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f99c01af270 con 0x55717eee6790 2024-08-31T04:30:50.213 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:50.210+0000 7f99cd039740 10 client.0 _ll_register_callbacks cb 0x7f99a8005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:30:50.213 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:50.210+0000 7f99b7e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55717eeee970 0x55717f2c5db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:30:50.214 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:50.210+0000 7f99bf400640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55717eee6790 0x55717f2c57d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:30:50.214 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:50.210+0000 7f99bf400640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55717eee6790 0x55717f2c57d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.50:51978/0 (socket says 172.21.15.50:51978) 2024-08-31T04:30:50.214 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:50.210+0000 7f99bf400640 1 -- 172.21.15.50:0/2144024504 learned_addr learned my addr 172.21.15.50:0/2144024504 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:30:50.214 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:50.210+0000 7f99bf400640 1 -- 172.21.15.50:0/2144024504 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55717ef0f760 msgr2=0x55717f336c00 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-08-31T04:30:50.214 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:50.210+0000 7f99bf400640 1 --2- 172.21.15.50:0/2144024504 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55717ef0f760 0x55717f336c00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:50.214 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:50.210+0000 7f99bf400640 1 -- 172.21.15.50:0/2144024504 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55717eeee970 msgr2=0x55717f2c5db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:30:50.214 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:50.210+0000 7f99bf400640 1 --2- 172.21.15.50:0/2144024504 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55717eeee970 0x55717f2c5db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:50.214 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:50.210+0000 7f99bf400640 1 -- 172.21.15.50:0/2144024504 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55717f337270 con 0x55717eee6790 2024-08-31T04:30:50.219 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:50.218+0000 7f99bf400640 1 --2- 172.21.15.50:0/2144024504 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55717eee6790 0x55717f2c57d0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f99b0005940 tx=0x7f99b0048650 comp rx=0 tx=0).ready entity=mon.1 client_cookie=38ef18dcced70495 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:30:50.219 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:50.218+0000 7f99ad600640 10 client.0 ms_handle_connect on v2:172.21.15.177:3300/0 2024-08-31T04:30:50.220 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:50.218+0000 7f99ad600640 1 -- 172.21.15.50:0/2144024504 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99b0060020 con 0x55717eee6790 2024-08-31T04:30:50.220 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:50.218+0000 7f99cd039740 1 -- 172.21.15.50:0/2144024504 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f99a8013300 con 0x55717eee6790 2024-08-31T04:30:50.220 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:50.218+0000 7f99ad600640 1 -- 172.21.15.50:0/2144024504 <== mon.1 v2:172.21.15.177:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8219+0+0 (secure 0 0 0) 0x7f99b0004ad0 con 0x55717eee6790 2024-08-31T04:30:50.220 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:50.218+0000 7f99ad600640 1 -- 172.21.15.50:0/2144024504 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7f99b004c050 con 0x55717eee6790 2024-08-31T04:30:50.220 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:50.218+0000 7f99cd039740 10 client.26143 fetch_fsmap learned FSMap version 42 2024-08-31T04:30:50.221 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:50.219+0000 7f99cd039740 1 -- 172.21.15.50:0/2144024504 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x55717f33e620 con 0x55717eee6790 2024-08-31T04:30:50.221 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:50.219+0000 7f99ad600640 1 -- 172.21.15.50:0/2144024504 <== mon.1 v2:172.21.15.177:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f99a8013300 con 0x55717eee6790 2024-08-31T04:30:50.221 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:50.219+0000 7f99ad600640 1 -- 172.21.15.50:0/2144024504 <== mon.1 v2:172.21.15.177:3300/0 5 ==== fsmap(e 42) ==== 8398+0+0 (secure 0 0 0) 0x7f99b00486c0 con 0x55717eee6790 2024-08-31T04:30:50.221 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:50.219+0000 7f99cd039740 10 client.26143 fetch_fsmap finished waiting for FSMap version 42 2024-08-31T04:30:50.222 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:50.219+0000 7f99cd039740 10 client.26143 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T04:30:50.222 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:50.219+0000 7f99cd039740 20 client.26143 populate_metadata read hostname 'smithi050' 2024-08-31T04:30:50.222 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:50.219+0000 7f99cd039740 1 --2- 172.21.15.50:0/2144024504 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x55717eea3380 0x55717f340e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:30:50.222 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:50.219+0000 7f99cd039740 4 client.26143 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "ops", "flags": ["locks"], "path": "/var/run/ceph/ops-9d491f02-1-mds.b.json"}] 2024-08-31T04:30:50.222 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:50.219+0000 7f99cd039740 1 -- 172.21.15.50:0/2144024504 --> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] -- command(tid 0: {"prefix": "ops", "flags": ["locks"], "path": "/var/run/ceph/ops-9d491f02-1-mds.b.json"}) -- 0x55717f2297f0 con 0x55717eea3380 2024-08-31T04:30:50.222 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:50.220+0000 7f99b7e00640 1 --2- 172.21.15.50:0/2144024504 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x55717eea3380 0x55717f340e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:30:50.223 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:50.220+0000 7f99b7e00640 1 --2- 172.21.15.50:0/2144024504 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x55717eea3380 0x55717f340e50 crc :-1 s=READY pgs=113 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9745af07e2b81706 server_cookie=8377f5fa638e5aa9 in_seq=0 out_seq=0 2024-08-31T04:30:50.223 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:50.220+0000 7f99ad600640 10 client.26143 ms_handle_connect on v2:172.21.15.133:6838/2526402262 2024-08-31T04:30:50.229 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:50.228+0000 7f99ad600640 1 -- 172.21.15.50:0/2144024504 <== mds.0 v2:172.21.15.133:6838/2526402262 1 ==== command_reply(tid 0: 0 ) ==== 8+0+58 (crc 0 0 0) 0x55717f2297f0 con 0x55717eea3380 2024-08-31T04:30:50.229 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:50.228+0000 7f99ad600640 10 client.26143 handle_command_reply: tid=0 2024-08-31T04:30:50.229 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:50.228+0000 7f99cd039740 1 client.26143 shutdown 2024-08-31T04:30:50.229 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:50.228+0000 7f99cd039740 1 -- 172.21.15.50:0/2144024504 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55717eee6790 msgr2=0x55717f2c57d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:30:50.229 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:50.228+0000 7f99cd039740 1 --2- 172.21.15.50:0/2144024504 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55717eee6790 0x55717f2c57d0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f99b0005940 tx=0x7f99b0048650 comp rx=0 tx=0).stop 2024-08-31T04:30:50.230 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:50.228+0000 7f99cd039740 1 -- 172.21.15.50:0/2144024504 shutdown_connections 2024-08-31T04:30:50.230 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:50.228+0000 7f99cd039740 1 --2- 172.21.15.50:0/2144024504 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x55717eea3380 0x55717f340e50 crc :-1 s=READY pgs=113 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:50.231 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:50.228+0000 7f99cd039740 1 --2- 172.21.15.50:0/2144024504 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55717ef0f760 0x55717f336c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:50.231 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:50.228+0000 7f99cd039740 1 --2- 172.21.15.50:0/2144024504 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55717eeee970 0x55717f2c5db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:50.231 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:50.228+0000 7f99cd039740 1 --2- 172.21.15.50:0/2144024504 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55717eee6790 0x55717f2c57d0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:50.231 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:50.228+0000 7f99cd039740 1 -- 172.21.15.50:0/2144024504 >> 172.21.15.50:0/2144024504 conn(0x55717ef03560 msgr2=0x55717f2b3190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:30:50.231 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:50.228+0000 7f99ad600640 0 client.26143 ms_handle_reset on v2:172.21.15.133:6838/2526402262 2024-08-31T04:30:50.231 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:50.229+0000 7f99cd039740 1 -- 172.21.15.50:0/2144024504 shutdown_connections 2024-08-31T04:30:50.232 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:50.229+0000 7f99cd039740 1 -- 172.21.15.50:0/2144024504 wait complete. 2024-08-31T04:30:50.232 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:50.229+0000 7f99cd039740 20 client.26143 trim_cache size 0 max 16384 2024-08-31T04:30:50.232 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-08-31T04:30:50.232 INFO:teuthology.orchestra.run.smithi050.stdout: "path": "/var/run/ceph/ops-9d491f02-1-mds.b.json" 2024-08-31T04:30:50.232 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-08-31T04:30:50.233 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:50.229+0000 7f99c6400640 1 -- 172.21.15.50:0/872230662 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f99a40b4b30 msgr2=0x7f99a40b7040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:30:50.233 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:50.229+0000 7f99c6400640 1 --2- 172.21.15.50:0/872230662 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f99a40b4b30 0x7f99a40b7040 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f99b0005f70 tx=0x7f99b00058b0 comp rx=0 tx=0).stop 2024-08-31T04:30:50.233 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:50.229+0000 7f99c6400640 1 -- 172.21.15.50:0/872230662 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f99c010fec0 msgr2=0x7f99c01a1c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:30:50.233 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:50.229+0000 7f99c6400640 1 --2- 172.21.15.50:0/872230662 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f99c010fec0 0x7f99c01a1c40 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f99b8009fd0 tx=0x7f99b800ef10 comp rx=0 tx=0).stop 2024-08-31T04:30:50.233 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:50.230+0000 7f99c6400640 1 -- 172.21.15.50:0/872230662 shutdown_connections 2024-08-31T04:30:50.233 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:50.230+0000 7f99c6400640 1 --2- 172.21.15.50:0/872230662 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f99a40b4b30 0x7f99a40b7040 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:50.233 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:50.230+0000 7f99c6400640 1 --2- 172.21.15.50:0/872230662 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f99c010fec0 0x7f99c01a1c40 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:50.234 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:50.230+0000 7f99c6400640 1 --2- 172.21.15.50:0/872230662 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f99c0075e40 0x7f99c019c9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:50.234 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:50.230+0000 7f99c6400640 1 --2- 172.21.15.50:0/872230662 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f99c00754f0 0x7f99c019c400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:50.234 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:50.230+0000 7f99c6400640 1 -- 172.21.15.50:0/872230662 >> 172.21.15.50:0/872230662 conn(0x7f99c007b5f0 msgr2=0x7f99c0101690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:30:50.234 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:50.230+0000 7f99c6400640 1 -- 172.21.15.50:0/872230662 shutdown_connections 2024-08-31T04:30:50.234 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:30:50.230+0000 7f99c6400640 1 -- 172.21.15.50:0/872230662 wait complete. 2024-08-31T04:30:51.629 DEBUG:teuthology.orchestra.run.smithi177:> mktemp 2024-08-31T04:30:51.648 INFO:teuthology.orchestra.run.smithi177.stdout:/tmp/tmp.TtHTa84CRr 2024-08-31T04:30:51.649 DEBUG:teuthology.orchestra.run.smithi177:> sudo cp /var/run/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/ops-9d491f02-1-mds.c.json /tmp/tmp.TtHTa84CRr 2024-08-31T04:30:51.731 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:30:51 smithi050 ceph-mon[17259]: pgmap v607: 97 pgs: 97 active+clean; 1.5 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 27 KiB/s wr, 23 op/s 2024-08-31T04:30:51.792 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:30:51 smithi133 ceph-mon[22177]: pgmap v607: 97 pgs: 97 active+clean; 1.5 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 27 KiB/s wr, 23 op/s 2024-08-31T04:30:51.891 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:30:51 smithi177 ceph-mon[22025]: pgmap v607: 97 pgs: 97 active+clean; 1.5 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 27 KiB/s wr, 23 op/s 2024-08-31T04:30:51.892 DEBUG:teuthology.orchestra.run.smithi177:> sudo chmod 0666 /tmp/tmp.TtHTa84CRr 2024-08-31T04:30:51.985 DEBUG:teuthology.orchestra.remote:smithi177:/tmp/tmp.TtHTa84CRr is 30MB 2024-08-31T04:30:52.615 DEBUG:teuthology.orchestra.run.smithi177:> rm -fr /tmp/tmp.TtHTa84CRr 2024-08-31T04:30:52.691 DEBUG:tasks.quiescer.fs.[cephfs]:read 31342498B of ops from '/var/run/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/ops-9d491f02-1-mds.c.json' on mds.4 (c) 2024-08-31T04:30:53.502 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:10021 fp=#0x10000000001' 2024-08-31T04:30:53.503 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:10181 fp=#0x50000000c1c' 2024-08-31T04:30:53.504 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:10213 fp=#0x5000000122c' 2024-08-31T04:30:53.524 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13061 fp=#0x30000002ad6' 2024-08-31T04:30:53.525 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13189 fp=#0x50000001789' 2024-08-31T04:30:53.526 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13285 fp=#0x30000001ab0' 2024-08-31T04:30:53.527 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13317 fp=#0x30000002b69' 2024-08-31T04:30:53.527 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13349 fp=#0x30000001a62' 2024-08-31T04:30:53.527 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13381 fp=#0x30000002b98' 2024-08-31T04:30:53.528 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13413 fp=#0x30000002b6d' 2024-08-31T04:30:53.528 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13445 fp=#0x30000002781' 2024-08-31T04:30:53.528 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13477 fp=#0x30000002759' 2024-08-31T04:30:53.529 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13541 fp=#0x50000001237' 2024-08-31T04:30:53.532 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13989 fp=#0x500000009f4' 2024-08-31T04:30:53.533 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14052 fp=#0x50000000c2e' 2024-08-31T04:30:53.533 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14084 fp=#0x50000000c60' 2024-08-31T04:30:53.534 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14148 fp=#0x50000000c86' 2024-08-31T04:30:53.534 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14180 fp=#0x50000000c22' 2024-08-31T04:30:53.534 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14212 fp=#0x50000000ca0' 2024-08-31T04:30:53.535 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14276 fp=#0x10000003ac9' 2024-08-31T04:30:53.536 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14340 fp=#0x50000001852' 2024-08-31T04:30:53.536 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14372 fp=#0x10000003ad5' 2024-08-31T04:30:53.536 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14404 fp=#0x50000000b99' 2024-08-31T04:30:53.537 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14436 fp=#0x50000000b8a' 2024-08-31T04:30:53.537 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14468 fp=#0x50000000b8d' 2024-08-31T04:30:53.537 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14500 fp=#0x50000000bd1' 2024-08-31T04:30:53.537 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14532 fp=#0x50000000bb3' 2024-08-31T04:30:53.538 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14564 fp=#0x50000000be3' 2024-08-31T04:30:53.538 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14596 fp=#0x50000001b7c' 2024-08-31T04:30:53.538 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14628 fp=#0x50000001b93' 2024-08-31T04:30:53.539 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14660 fp=#0x50000001b0a' 2024-08-31T04:30:53.539 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14692 fp=#0x50000001b7d' 2024-08-31T04:30:53.539 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14724 fp=#0x50000001493' 2024-08-31T04:30:53.540 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14756 fp=#0x500000014ac' 2024-08-31T04:30:53.540 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14788 fp=#0x500000014db' 2024-08-31T04:30:53.540 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14820 fp=#0x500000017fc' 2024-08-31T04:30:53.541 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14852 fp=#0x500000018ff' 2024-08-31T04:30:53.541 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14884 fp=#0x50000001875' 2024-08-31T04:30:53.541 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14916 fp=#0x50000001864' 2024-08-31T04:30:53.542 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14948 fp=#0x50000000e5d' 2024-08-31T04:30:53.542 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14980 fp=#0x5000000187b' 2024-08-31T04:30:53.543 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15172 fp=#0x50000001aae' 2024-08-31T04:30:53.544 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15204 fp=#0x50000000fe9' 2024-08-31T04:30:53.544 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15236 fp=#0x50000000fd4' 2024-08-31T04:30:53.544 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15268 fp=#0x50000001aa9' 2024-08-31T04:30:53.545 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15300 fp=#0x5000000150e' 2024-08-31T04:30:53.545 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15332 fp=#0x5000000154c' 2024-08-31T04:30:53.545 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15364 fp=#0x500000014f8' 2024-08-31T04:30:53.546 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15396 fp=#0x5000000110b' 2024-08-31T04:30:53.546 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15428 fp=#0x500000010c1' 2024-08-31T04:30:53.546 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15460 fp=#0x500000010b2' 2024-08-31T04:30:53.548 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15684 fp=#0x500000018f3' 2024-08-31T04:30:53.549 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15812 fp=#0x50000001c14' 2024-08-31T04:30:53.550 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15908 fp=#0x5000000172d' 2024-08-31T04:30:53.550 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15940 fp=#0x50000001700' 2024-08-31T04:30:53.552 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16196 fp=#0x500000012bc' 2024-08-31T04:30:53.554 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16516 fp=#0x50000000cda' 2024-08-31T04:30:53.554 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16548 fp=#0x500000009ce' 2024-08-31T04:30:53.555 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16580 fp=#0x5000000195e' 2024-08-31T04:30:53.555 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16612 fp=#0x5000000175f' 2024-08-31T04:30:53.556 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16708 fp=#0x50000001ab5' 2024-08-31T04:30:53.556 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16740 fp=#0x50000001d22' 2024-08-31T04:30:53.557 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16836 fp=#0x50000001bd2' 2024-08-31T04:30:53.557 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16868 fp=#0x50000000b37' 2024-08-31T04:30:53.558 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16900 fp=#0x50000000a8b' 2024-08-31T04:30:53.558 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16932 fp=#0x5000000177e' 2024-08-31T04:30:53.558 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16964 fp=#0x5000000155a' 2024-08-31T04:30:53.559 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16996 fp=#0x50000001575' 2024-08-31T04:30:53.559 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17028 fp=#0x50000001609' 2024-08-31T04:30:53.559 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17060 fp=#0x5000000161c' 2024-08-31T04:30:53.560 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17092 fp=#0x5000000164e' 2024-08-31T04:30:53.560 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17124 fp=#0x10000003eaf' 2024-08-31T04:30:53.561 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17220 fp=#0x50000001611' 2024-08-31T04:30:53.561 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17252 fp=#0x50000001600' 2024-08-31T04:30:53.561 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17284 fp=#0x5000000156d' 2024-08-31T04:30:53.562 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17316 fp=#0x50000001585' 2024-08-31T04:30:53.562 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17348 fp=#0x100000036c7' 2024-08-31T04:30:53.562 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17380 fp=#0x1000000369d' 2024-08-31T04:30:53.563 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17412 fp=#0x100000036df' 2024-08-31T04:30:53.563 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17444 fp=#0x10000003664' 2024-08-31T04:30:53.564 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17476 fp=#0x10000003759' 2024-08-31T04:30:53.564 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17508 fp=#0x50000001297' 2024-08-31T04:30:53.564 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17572 fp=#0x500000012ac' 2024-08-31T04:30:53.565 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17604 fp=#0x500000012a3' 2024-08-31T04:30:53.565 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17636 fp=#0x500000012ab' 2024-08-31T04:30:53.565 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17668 fp=#0x10000002338' 2024-08-31T04:30:53.566 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17764 fp=#0x1000000233f' 2024-08-31T04:30:53.567 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17924 fp=#0x5000000165a' 2024-08-31T04:30:53.568 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17956 fp=#0x5000000164b' 2024-08-31T04:30:53.568 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17988 fp=#0x5000000167f' 2024-08-31T04:30:53.569 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18020 fp=#0x500000008ff' 2024-08-31T04:30:53.569 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18052 fp=#0x5000000091b' 2024-08-31T04:30:53.569 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18084 fp=#0x50000001a41' 2024-08-31T04:30:53.570 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18148 fp=#0x500000008fd' 2024-08-31T04:30:53.570 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18180 fp=#0x5000000090d' 2024-08-31T04:30:53.570 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18212 fp=#0x50000000918' 2024-08-31T04:30:53.571 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18244 fp=#0x50000001a52' 2024-08-31T04:30:53.571 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18308 fp=#0x50000000e82' 2024-08-31T04:30:53.572 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18340 fp=#0x50000000e8c' 2024-08-31T04:30:53.572 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18372 fp=#0x50000000e36' 2024-08-31T04:30:53.573 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18436 fp=#0x50000000dd7' 2024-08-31T04:30:53.573 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18468 fp=#0x50000000e52' 2024-08-31T04:30:53.573 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18500 fp=#0x10000000443' 2024-08-31T04:30:53.574 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18532 fp=#0x50000000aa8' 2024-08-31T04:30:53.574 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18564 fp=#0x50000000afd' 2024-08-31T04:30:53.574 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18596 fp=#0x10000000e95' 2024-08-31T04:30:53.575 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18628 fp=#0x50000000ac5' 2024-08-31T04:30:53.575 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18660 fp=#0x50000000d58' 2024-08-31T04:30:53.575 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18692 fp=#0x50000000d37' 2024-08-31T04:30:53.575 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18724 fp=#0x50000000d36' 2024-08-31T04:30:53.576 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18756 fp=#0x50000000d6c' 2024-08-31T04:30:53.576 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18788 fp=#0x50000000d26' 2024-08-31T04:30:53.576 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18820 fp=#0x500000011d5' 2024-08-31T04:30:53.577 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18852 fp=#0x50000000e02' 2024-08-31T04:30:53.577 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18884 fp=#0x50000000dd1' 2024-08-31T04:30:53.577 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18916 fp=#0x50000000daa' 2024-08-31T04:30:53.578 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18948 fp=#0x50000000f21' 2024-08-31T04:30:53.578 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18980 fp=#0x50000000dd8' 2024-08-31T04:30:53.578 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19012 fp=#0x500000019c3' 2024-08-31T04:30:53.581 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19076 fp=#0x500000017a0' 2024-08-31T04:30:53.581 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19108 fp=#0x50000001808' 2024-08-31T04:30:53.581 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19140 fp=#0x500000017be' 2024-08-31T04:30:53.582 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19204 fp=#0x500000017bd' 2024-08-31T04:30:53.583 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19332 fp=#0x50000001841' 2024-08-31T04:30:53.583 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19364 fp=#0x50000001c72' 2024-08-31T04:30:53.584 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19396 fp=#0x500000017df' 2024-08-31T04:30:53.584 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19428 fp=#0x500000017f3' 2024-08-31T04:30:53.584 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19460 fp=#0x50000001924' 2024-08-31T04:30:53.585 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19492 fp=#0x500000019fa' 2024-08-31T04:30:53.585 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19524 fp=#0x500000019e5' 2024-08-31T04:30:53.585 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19556 fp=#0x50000001939' 2024-08-31T04:30:53.586 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19588 fp=#0x5000000191e' 2024-08-31T04:30:53.586 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19620 fp=#0x10000003ee6' 2024-08-31T04:30:53.586 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19684 fp=#0x10000003dc9' 2024-08-31T04:30:53.587 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19748 fp=#0x10000003e90' 2024-08-31T04:30:53.587 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19780 fp=#0x50000000983' 2024-08-31T04:30:53.588 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19812 fp=#0x5000000113b' 2024-08-31T04:30:53.588 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19844 fp=#0x50000001162' 2024-08-31T04:30:53.588 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19876 fp=#0x50000001137' 2024-08-31T04:30:53.589 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19908 fp=#0x50000001123' 2024-08-31T04:30:53.589 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19940 fp=#0x50000000fb8' 2024-08-31T04:30:53.589 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19972 fp=#0x50000001cbf' 2024-08-31T04:30:53.590 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20004 fp=#0x50000001cd5' 2024-08-31T04:30:53.590 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20036 fp=#0x50000001cc8' 2024-08-31T04:30:53.590 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20068 fp=#0x50000000fa2' 2024-08-31T04:30:53.591 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20100 fp=#0x50000000fa0' 2024-08-31T04:30:53.591 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20132 fp=#0x50000001057' 2024-08-31T04:30:53.591 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20164 fp=#0x50000001044' 2024-08-31T04:30:53.591 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20196 fp=#0x50000001065' 2024-08-31T04:30:53.592 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20228 fp=#0x50000001048' 2024-08-31T04:30:53.592 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20260 fp=#0x500000011a2' 2024-08-31T04:30:53.592 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20292 fp=#0x500000011a3' 2024-08-31T04:30:53.593 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20324 fp=#0x10000000ec8' 2024-08-31T04:30:53.593 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20356 fp=#0x10000000e69' 2024-08-31T04:30:53.593 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20388 fp=#0x200000002d2' 2024-08-31T04:30:53.594 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20452 fp=#0x10000000dc5' 2024-08-31T04:30:53.594 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20484 fp=#0x100000032f3' 2024-08-31T04:30:53.594 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20516 fp=#0x2000000036d' 2024-08-31T04:30:53.595 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20548 fp=#0x500000018f7' 2024-08-31T04:30:53.595 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20580 fp=#0x500000018fa' 2024-08-31T04:30:53.595 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20612 fp=#0x2000000036b' 2024-08-31T04:30:53.596 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20644 fp=#0x100000031b1' 2024-08-31T04:30:53.596 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20676 fp=#0x500000018d5' 2024-08-31T04:30:53.596 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20708 fp=#0x10000003212' 2024-08-31T04:30:53.597 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20740 fp=#0x10000002b63' 2024-08-31T04:30:53.597 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20772 fp=#0x10000002adb' 2024-08-31T04:30:53.597 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20804 fp=#0x20000000356' 2024-08-31T04:30:53.598 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20836 fp=#0x2000000116d' 2024-08-31T04:30:53.598 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20868 fp=#0x10000002b79' 2024-08-31T04:30:53.598 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20900 fp=#0x10000002b99' 2024-08-31T04:30:53.599 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20932 fp=#0x20000000344' 2024-08-31T04:30:53.599 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20964 fp=#0x200000011c7' 2024-08-31T04:30:53.599 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20996 fp=#0x10000001b9e' 2024-08-31T04:30:53.600 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:21028 fp=#0x10000001a37' 2024-08-31T04:30:53.600 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:21060 fp=#0x10000001b3f' 2024-08-31T04:30:53.600 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:21092 fp=#0x10000001f21' 2024-08-31T04:30:53.601 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:21124 fp=#0x10000001f2f' 2024-08-31T04:30:53.601 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:21156 fp=#0x3000000066f' 2024-08-31T04:30:53.601 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:21188 fp=#0x30000000691' 2024-08-31T04:30:53.602 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:21252 fp=#0x10000001f23' 2024-08-31T04:30:53.602 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:21284 fp=#0x50000001ba9' 2024-08-31T04:30:53.603 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:21316 fp=#0x30000000693' 2024-08-31T04:30:53.603 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:10022 fp=#0x100000001fa' 2024-08-31T04:30:53.604 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:10182 fp=#0x1000000091a' 2024-08-31T04:30:53.604 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:10214 fp=#0x10000001e37' 2024-08-31T04:30:53.605 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:10246 fp=#0x30000002746' 2024-08-31T04:30:53.626 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13062 fp=#0x30000002b35' 2024-08-31T04:30:53.626 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13094 fp=#0x40000001641' 2024-08-31T04:30:53.627 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13126 fp=#0x4000000176c' 2024-08-31T04:30:53.627 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13190 fp=#0x500000018a0' 2024-08-31T04:30:53.628 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13222 fp=#0x500000016c3' 2024-08-31T04:30:53.628 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13286 fp=#0x30000002b9b' 2024-08-31T04:30:53.629 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13318 fp=#0x30000001aa5' 2024-08-31T04:30:53.629 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13350 fp=#0x30000001a6b' 2024-08-31T04:30:53.629 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13382 fp=#0x30000002b50' 2024-08-31T04:30:53.630 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13414 fp=#0x3000000274c' 2024-08-31T04:30:53.630 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13446 fp=#0x3000000279e' 2024-08-31T04:30:53.630 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13478 fp=#0x3000000278e' 2024-08-31T04:30:53.631 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13542 fp=#0x5000000123a' 2024-08-31T04:30:53.635 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14053 fp=#0x50000000cbf' 2024-08-31T04:30:53.635 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14117 fp=#0x50000000c54' 2024-08-31T04:30:53.636 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14149 fp=#0x50000000c98' 2024-08-31T04:30:53.636 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14213 fp=#0x50000000c56' 2024-08-31T04:30:53.637 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14277 fp=#0x10000003ac5' 2024-08-31T04:30:53.637 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14309 fp=#0x10000003ab9' 2024-08-31T04:30:53.638 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14373 fp=#0x10000003abd' 2024-08-31T04:30:53.638 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14405 fp=#0x50000000b95' 2024-08-31T04:30:53.638 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14437 fp=#0x50000000bfa' 2024-08-31T04:30:53.639 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14469 fp=#0x50000000ba6' 2024-08-31T04:30:53.639 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14501 fp=#0x50000000bc3' 2024-08-31T04:30:53.639 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14533 fp=#0x50000000bef' 2024-08-31T04:30:53.640 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14565 fp=#0x50000001b17' 2024-08-31T04:30:53.640 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14597 fp=#0x50000001b0f' 2024-08-31T04:30:53.640 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14629 fp=#0x50000001b66' 2024-08-31T04:30:53.641 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14661 fp=#0x50000001b82' 2024-08-31T04:30:53.641 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14693 fp=#0x50000001b08' 2024-08-31T04:30:53.641 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14725 fp=#0x50000001462' 2024-08-31T04:30:53.642 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14757 fp=#0x500000014c2' 2024-08-31T04:30:53.642 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14789 fp=#0x500000014c4' 2024-08-31T04:30:53.642 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14821 fp=#0x50000001466' 2024-08-31T04:30:53.643 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14853 fp=#0x50000000e9e' 2024-08-31T04:30:53.643 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14885 fp=#0x50000000e2a' 2024-08-31T04:30:53.643 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14917 fp=#0x50000001d7a' 2024-08-31T04:30:53.644 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14949 fp=#0x50000001867' 2024-08-31T04:30:53.644 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14981 fp=#0x50000000e6e' 2024-08-31T04:30:53.645 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15173 fp=#0x50000001002' 2024-08-31T04:30:53.646 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15205 fp=#0x50000001016' 2024-08-31T04:30:53.646 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15237 fp=#0x50000000ff0' 2024-08-31T04:30:53.646 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15269 fp=#0x5000000100b' 2024-08-31T04:30:53.647 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15301 fp=#0x5000000154e' 2024-08-31T04:30:53.647 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15333 fp=#0x5000000152f' 2024-08-31T04:30:53.647 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15365 fp=#0x50000001527' 2024-08-31T04:30:53.648 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15397 fp=#0x50000001114' 2024-08-31T04:30:53.648 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15429 fp=#0x500000010aa' 2024-08-31T04:30:53.648 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15461 fp=#0x500000010d0' 2024-08-31T04:30:53.650 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15749 fp=#0x50000001c05' 2024-08-31T04:30:53.651 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15781 fp=#0x50000001c01' 2024-08-31T04:30:53.651 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15845 fp=#0x50000001bf3' 2024-08-31T04:30:53.652 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15909 fp=#0x50000001729' 2024-08-31T04:30:53.652 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15941 fp=#0x500000016ff' 2024-08-31T04:30:53.656 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16517 fp=#0x500000009e6' 2024-08-31T04:30:53.657 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16549 fp=#0x500000009dc' 2024-08-31T04:30:53.657 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16581 fp=#0x50000001768' 2024-08-31T04:30:53.657 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16613 fp=#0x50000001766' 2024-08-31T04:30:53.658 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16645 fp=#0x50000001d1e' 2024-08-31T04:30:53.658 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16677 fp=#0x50000001a7a' 2024-08-31T04:30:53.658 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16709 fp=#0x50000001a86' 2024-08-31T04:30:53.659 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16741 fp=#0x50000001a64' 2024-08-31T04:30:53.659 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16773 fp=#0x50000001d29' 2024-08-31T04:30:53.659 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16837 fp=#0x50000001bd4' 2024-08-31T04:30:53.660 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16869 fp=#0x50000000b3e' 2024-08-31T04:30:53.660 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16901 fp=#0x50000000a89' 2024-08-31T04:30:53.660 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16933 fp=#0x50000000a7c' 2024-08-31T04:30:53.661 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16965 fp=#0x500000015bb' 2024-08-31T04:30:53.661 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16997 fp=#0x50000001662' 2024-08-31T04:30:53.661 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17029 fp=#0x50000001637' 2024-08-31T04:30:53.662 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17061 fp=#0x50000001635' 2024-08-31T04:30:53.662 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17093 fp=#0x50000001624' 2024-08-31T04:30:53.662 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17157 fp=#0x10000003ea0' 2024-08-31T04:30:53.663 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17221 fp=#0x5000000160a' 2024-08-31T04:30:53.663 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17253 fp=#0x50000001578' 2024-08-31T04:30:53.664 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17285 fp=#0x500000015d5' 2024-08-31T04:30:53.664 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17317 fp=#0x500000015f1' 2024-08-31T04:30:53.664 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17349 fp=#0x10000004093' 2024-08-31T04:30:53.665 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17381 fp=#0x1000000373f' 2024-08-31T04:30:53.665 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17413 fp=#0x100000036c3' 2024-08-31T04:30:53.665 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17445 fp=#0x100000037d8' 2024-08-31T04:30:53.665 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17477 fp=#0x100000035db' 2024-08-31T04:30:53.666 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17509 fp=#0x500000012ed' 2024-08-31T04:30:53.667 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17605 fp=#0x500000012b1' 2024-08-31T04:30:53.667 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17637 fp=#0x50000001258' 2024-08-31T04:30:53.668 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17861 fp=#0x50000001640' 2024-08-31T04:30:53.669 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17893 fp=#0x50000001652' 2024-08-31T04:30:53.669 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17925 fp=#0x50000001680' 2024-08-31T04:30:53.669 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17957 fp=#0x50000001650' 2024-08-31T04:30:53.670 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18021 fp=#0x50000000935' 2024-08-31T04:30:53.670 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18053 fp=#0x50000000903' 2024-08-31T04:30:53.670 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18085 fp=#0x50000001a39' 2024-08-31T04:30:53.671 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18149 fp=#0x50000000914' 2024-08-31T04:30:53.671 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18181 fp=#0x500000008da' 2024-08-31T04:30:53.671 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18213 fp=#0x50000000911' 2024-08-31T04:30:53.672 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18245 fp=#0x50000001a2a' 2024-08-31T04:30:53.672 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18309 fp=#0x50000000e7f' 2024-08-31T04:30:53.673 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18373 fp=#0x50000000ea7' 2024-08-31T04:30:53.673 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18405 fp=#0x50000000dee' 2024-08-31T04:30:53.674 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18469 fp=#0x50000000e16' 2024-08-31T04:30:53.674 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18501 fp=#0x50000000a9b' 2024-08-31T04:30:53.674 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18533 fp=#0x50000000ab6' 2024-08-31T04:30:53.675 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18565 fp=#0x50000000edc' 2024-08-31T04:30:53.675 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18597 fp=#0x10000000434' 2024-08-31T04:30:53.675 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18629 fp=#0x50000000aa0' 2024-08-31T04:30:53.676 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18661 fp=#0x50000000d79' 2024-08-31T04:30:53.676 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18693 fp=#0x50000000d54' 2024-08-31T04:30:53.676 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18725 fp=#0x50000000d48' 2024-08-31T04:30:53.677 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18757 fp=#0x50000000d43' 2024-08-31T04:30:53.677 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18789 fp=#0x50000000d47' 2024-08-31T04:30:53.677 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18821 fp=#0x500000011d1' 2024-08-31T04:30:53.677 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18853 fp=#0x500000019d2' 2024-08-31T04:30:53.678 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18885 fp=#0x50000001447' 2024-08-31T04:30:53.678 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18917 fp=#0x50000000db4' 2024-08-31T04:30:53.678 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18949 fp=#0x50000000d81' 2024-08-31T04:30:53.679 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18981 fp=#0x50000000dbc' 2024-08-31T04:30:53.679 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19013 fp=#0x500000019bb' 2024-08-31T04:30:53.681 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19237 fp=#0x500000017d1' 2024-08-31T04:30:53.681 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19269 fp=#0x500000017ae' 2024-08-31T04:30:53.681 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19301 fp=#0x500000017d3' 2024-08-31T04:30:53.681 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19333 fp=#0x5000000184a' 2024-08-31T04:30:53.682 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19365 fp=#0x50000001c3e' 2024-08-31T04:30:53.682 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19397 fp=#0x500000017db' 2024-08-31T04:30:53.682 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19429 fp=#0x50000001822' 2024-08-31T04:30:53.683 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19461 fp=#0x500000019c6' 2024-08-31T04:30:53.683 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19493 fp=#0x50000001925' 2024-08-31T04:30:53.683 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19525 fp=#0x500000019c0' 2024-08-31T04:30:53.683 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19557 fp=#0x5000000196f' 2024-08-31T04:30:53.684 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19589 fp=#0x50000001953' 2024-08-31T04:30:53.684 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19621 fp=#0x10000003df3' 2024-08-31T04:30:53.685 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19685 fp=#0x10000003e1d' 2024-08-31T04:30:53.685 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19781 fp=#0x5000000097d' 2024-08-31T04:30:53.686 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19813 fp=#0x500000016a3' 2024-08-31T04:30:53.686 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19845 fp=#0x50000001145' 2024-08-31T04:30:53.686 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19877 fp=#0x5000000111c' 2024-08-31T04:30:53.687 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19909 fp=#0x50000001155' 2024-08-31T04:30:53.687 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19941 fp=#0x50000000f92' 2024-08-31T04:30:53.687 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19973 fp=#0x50000000f6b' 2024-08-31T04:30:53.688 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20005 fp=#0x50000001ca1' 2024-08-31T04:30:53.688 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20037 fp=#0x50000001ca9' 2024-08-31T04:30:53.688 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20069 fp=#0x50000001c9e' 2024-08-31T04:30:53.689 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20101 fp=#0x50000000f70' 2024-08-31T04:30:53.689 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20133 fp=#0x500000010a9' 2024-08-31T04:30:53.690 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20165 fp=#0x500000012ff' 2024-08-31T04:30:53.690 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20197 fp=#0x5000000105f' 2024-08-31T04:30:53.690 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20229 fp=#0x5000000104b' 2024-08-31T04:30:53.690 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20261 fp=#0x5000000119b' 2024-08-31T04:30:53.691 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20293 fp=#0x50000001c7f' 2024-08-31T04:30:53.691 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20325 fp=#0x10000001049' 2024-08-31T04:30:53.691 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20357 fp=#0x10000000e24' 2024-08-31T04:30:53.692 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20389 fp=#0x200000002d5' 2024-08-31T04:30:53.692 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20421 fp=#0x10000000ec0' 2024-08-31T04:30:53.692 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20453 fp=#0x200000002cb' 2024-08-31T04:30:53.692 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20485 fp=#0x100000031f0' 2024-08-31T04:30:53.693 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20517 fp=#0x50000001955' 2024-08-31T04:30:53.693 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20549 fp=#0x100000032cd' 2024-08-31T04:30:53.693 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20581 fp=#0x100000031b9' 2024-08-31T04:30:53.694 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20613 fp=#0x500000018ee' 2024-08-31T04:30:53.694 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20645 fp=#0x10000003239' 2024-08-31T04:30:53.695 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20677 fp=#0x500000019e6' 2024-08-31T04:30:53.695 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20709 fp=#0x5000000190e' 2024-08-31T04:30:53.695 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20741 fp=#0x10000002b21' 2024-08-31T04:30:53.695 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20773 fp=#0x200000011a4' 2024-08-31T04:30:53.696 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20805 fp=#0x10000002b57' 2024-08-31T04:30:53.696 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20837 fp=#0x10000002b86' 2024-08-31T04:30:53.696 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20869 fp=#0x10000002b1d' 2024-08-31T04:30:53.697 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20901 fp=#0x10000002bab' 2024-08-31T04:30:53.697 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20933 fp=#0x10000002ab3' 2024-08-31T04:30:53.697 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20965 fp=#0x200000011e6' 2024-08-31T04:30:53.697 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20997 fp=#0x10000001b6e' 2024-08-31T04:30:53.698 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:21029 fp=#0x10000001a82' 2024-08-31T04:30:53.698 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:21061 fp=#0x10000001a41' 2024-08-31T04:30:53.698 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:21093 fp=#0x3000000068b' 2024-08-31T04:30:53.699 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:21125 fp=#0x30000000688' 2024-08-31T04:30:53.699 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:21157 fp=#0x3000000067d' 2024-08-31T04:30:53.699 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:21189 fp=#0x30000000680' 2024-08-31T04:30:53.700 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:21221 fp=#0x10000001e74' 2024-08-31T04:30:53.700 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:21253 fp=#0x10000001ee3' 2024-08-31T04:30:53.700 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:21285 fp=#0x30000000683' 2024-08-31T04:30:53.701 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:10087 fp=#0x30000001b08' 2024-08-31T04:30:53.702 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:10183 fp=#0x10000000dbf' 2024-08-31T04:30:53.702 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:10215 fp=#0x10000002271' 2024-08-31T04:30:53.723 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13095 fp=#0x500000016d6' 2024-08-31T04:30:53.723 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13159 fp=#0x500000018a2' 2024-08-31T04:30:53.724 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13287 fp=#0x30000001af5' 2024-08-31T04:30:53.725 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13319 fp=#0x30000002b7e' 2024-08-31T04:30:53.725 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13351 fp=#0x30000002b75' 2024-08-31T04:30:53.725 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13383 fp=#0x30000001a59' 2024-08-31T04:30:53.726 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13415 fp=#0x30000002797' 2024-08-31T04:30:53.726 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13447 fp=#0x30000002789' 2024-08-31T04:30:53.726 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13479 fp=#0x3000000277e' 2024-08-31T04:30:53.727 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13543 fp=#0x30000002745' 2024-08-31T04:30:53.727 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13607 fp=#0x5000000101b' 2024-08-31T04:30:53.728 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13735 fp=#0x30000002860' 2024-08-31T04:30:53.731 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14054 fp=#0x50000000cba' 2024-08-31T04:30:53.731 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14086 fp=#0x50000000c3d' 2024-08-31T04:30:53.732 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14118 fp=#0x50000000c4b' 2024-08-31T04:30:53.732 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14150 fp=#0x50000000c8d' 2024-08-31T04:30:53.732 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14182 fp=#0x50000000cb6' 2024-08-31T04:30:53.733 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14214 fp=#0x50000000cb8' 2024-08-31T04:30:53.733 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14246 fp=#0x50000001854' 2024-08-31T04:30:53.734 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14406 fp=#0x50000000b7c' 2024-08-31T04:30:53.735 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14438 fp=#0x50000000b61' 2024-08-31T04:30:53.735 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14470 fp=#0x50000000b8e' 2024-08-31T04:30:53.735 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14502 fp=#0x50000000b93' 2024-08-31T04:30:53.735 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14534 fp=#0x50000000be8' 2024-08-31T04:30:53.736 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14566 fp=#0x50000001b8b' 2024-08-31T04:30:53.736 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14598 fp=#0x50000001b73' 2024-08-31T04:30:53.736 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14630 fp=#0x50000001b5e' 2024-08-31T04:30:53.737 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14662 fp=#0x50000001b4e' 2024-08-31T04:30:53.737 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14694 fp=#0x50000001b2c' 2024-08-31T04:30:53.738 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14726 fp=#0x500000014ea' 2024-08-31T04:30:53.738 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14758 fp=#0x500000017fa' 2024-08-31T04:30:53.738 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14790 fp=#0x500000014bf' 2024-08-31T04:30:53.739 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14822 fp=#0x500000014e1' 2024-08-31T04:30:53.739 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14854 fp=#0x5000000185f' 2024-08-31T04:30:53.739 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14886 fp=#0x50000001859' 2024-08-31T04:30:53.739 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14918 fp=#0x50000000e4b' 2024-08-31T04:30:53.740 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14950 fp=#0x50000001869' 2024-08-31T04:30:53.740 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14982 fp=#0x50000000e4e' 2024-08-31T04:30:53.742 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15174 fp=#0x50000000fde' 2024-08-31T04:30:53.742 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15206 fp=#0x50000001a90' 2024-08-31T04:30:53.742 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15238 fp=#0x5000000100c' 2024-08-31T04:30:53.743 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15270 fp=#0x50000001aba' 2024-08-31T04:30:53.743 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15302 fp=#0x5000000154a' 2024-08-31T04:30:53.743 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15334 fp=#0x50000001500' 2024-08-31T04:30:53.744 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15366 fp=#0x50000001511' 2024-08-31T04:30:53.744 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15398 fp=#0x500000010a1' 2024-08-31T04:30:53.744 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15430 fp=#0x500000010b9' 2024-08-31T04:30:53.745 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15462 fp=#0x500000010b1' 2024-08-31T04:30:53.747 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15750 fp=#0x50000001c04' 2024-08-31T04:30:53.748 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15846 fp=#0x50000001bfb' 2024-08-31T04:30:53.748 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15910 fp=#0x500000016f7' 2024-08-31T04:30:53.749 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15942 fp=#0x500000016e7' 2024-08-31T04:30:53.753 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16518 fp=#0x500000009e1' 2024-08-31T04:30:53.753 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16550 fp=#0x50000001942' 2024-08-31T04:30:53.753 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16582 fp=#0x50000001763' 2024-08-31T04:30:53.754 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16614 fp=#0x50000001769' 2024-08-31T04:30:53.754 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16646 fp=#0x50000001d15' 2024-08-31T04:30:53.755 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16710 fp=#0x50000001d23' 2024-08-31T04:30:53.755 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16806 fp=#0x50000001d1d' 2024-08-31T04:30:53.756 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16838 fp=#0x50000001bcc' 2024-08-31T04:30:53.756 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16870 fp=#0x50000000b36' 2024-08-31T04:30:53.756 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16934 fp=#0x50000000a59' 2024-08-31T04:30:53.757 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16966 fp=#0x50000001683' 2024-08-31T04:30:53.758 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16998 fp=#0x500000015d4' 2024-08-31T04:30:53.758 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17030 fp=#0x5000000169a' 2024-08-31T04:30:53.759 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17062 fp=#0x500000015ce' 2024-08-31T04:30:53.759 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17094 fp=#0x500000015fa' 2024-08-31T04:30:53.759 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17126 fp=#0x5000000184b' 2024-08-31T04:30:53.760 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17190 fp=#0x10000003f04' 2024-08-31T04:30:53.760 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17222 fp=#0x50000001565' 2024-08-31T04:30:53.760 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17254 fp=#0x500000015f4' 2024-08-31T04:30:53.761 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17286 fp=#0x500000015dd' 2024-08-31T04:30:53.761 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17318 fp=#0x500000015c5' 2024-08-31T04:30:53.761 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17350 fp=#0x10000003655' 2024-08-31T04:30:53.762 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17382 fp=#0x100000035e7' 2024-08-31T04:30:53.762 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17414 fp=#0x100000036ec' 2024-08-31T04:30:53.762 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17446 fp=#0x50000000952' 2024-08-31T04:30:53.763 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17478 fp=#0x1000000363b' 2024-08-31T04:30:53.763 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17510 fp=#0x500000012eb' 2024-08-31T04:30:53.763 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17542 fp=#0x500000012d2' 2024-08-31T04:30:53.764 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17574 fp=#0x50000001294' 2024-08-31T04:30:53.764 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17606 fp=#0x50000001248' 2024-08-31T04:30:53.765 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17766 fp=#0x1000000228a' 2024-08-31T04:30:53.766 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17798 fp=#0x10000002283' 2024-08-31T04:30:53.766 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17894 fp=#0x50000001654' 2024-08-31T04:30:53.767 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17926 fp=#0x5000000168f' 2024-08-31T04:30:53.767 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17990 fp=#0x5000000168b' 2024-08-31T04:30:53.768 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18054 fp=#0x500000008dd' 2024-08-31T04:30:53.768 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18086 fp=#0x50000001aaf' 2024-08-31T04:30:53.768 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18118 fp=#0x50000001a58' 2024-08-31T04:30:53.769 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18150 fp=#0x50000001a44' 2024-08-31T04:30:53.769 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18182 fp=#0x50000000930' 2024-08-31T04:30:53.770 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18246 fp=#0x50000001a59' 2024-08-31T04:30:53.770 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18342 fp=#0x50000000e84' 2024-08-31T04:30:53.771 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18502 fp=#0x1000000045e' 2024-08-31T04:30:53.772 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18534 fp=#0x100000003b1' 2024-08-31T04:30:53.772 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18566 fp=#0x50000000ee4' 2024-08-31T04:30:53.773 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18598 fp=#0x5000000184d' 2024-08-31T04:30:53.776 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18662 fp=#0x50000000cec' 2024-08-31T04:30:53.776 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18694 fp=#0x50000000cfb' 2024-08-31T04:30:53.776 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18726 fp=#0x50000000d3d' 2024-08-31T04:30:53.777 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18758 fp=#0x50000000d4c' 2024-08-31T04:30:53.777 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18790 fp=#0x50000000d31' 2024-08-31T04:30:53.777 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18822 fp=#0x500000011d4' 2024-08-31T04:30:53.778 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18854 fp=#0x500000019c4' 2024-08-31T04:30:53.778 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18886 fp=#0x50000001448' 2024-08-31T04:30:53.778 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18918 fp=#0x50000000efa' 2024-08-31T04:30:53.779 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18950 fp=#0x50000000d84' 2024-08-31T04:30:53.779 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18982 fp=#0x50000000daf' 2024-08-31T04:30:53.779 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19014 fp=#0x50000000d88' 2024-08-31T04:30:53.780 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19046 fp=#0x500000017fd' 2024-08-31T04:30:53.780 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19078 fp=#0x5000000181c' 2024-08-31T04:30:53.781 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19270 fp=#0x500000017f4' 2024-08-31T04:30:53.782 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19302 fp=#0x500000017a9' 2024-08-31T04:30:53.782 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19334 fp=#0x50000001c5e' 2024-08-31T04:30:53.782 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19366 fp=#0x500000017e5' 2024-08-31T04:30:53.783 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19398 fp=#0x50000001824' 2024-08-31T04:30:53.783 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19430 fp=#0x50000001831' 2024-08-31T04:30:53.783 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19462 fp=#0x50000001a17' 2024-08-31T04:30:53.783 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19494 fp=#0x500000019e8' 2024-08-31T04:30:53.784 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19526 fp=#0x500000019eb' 2024-08-31T04:30:53.784 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19558 fp=#0x50000001a0d' 2024-08-31T04:30:53.784 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19590 fp=#0x50000001957' 2024-08-31T04:30:53.785 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19622 fp=#0x10000003e8e' 2024-08-31T04:30:53.785 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19654 fp=#0x10000003e24' 2024-08-31T04:30:53.785 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19686 fp=#0x10000003e2c' 2024-08-31T04:30:53.786 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19718 fp=#0x10000003e3d' 2024-08-31T04:30:53.786 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19750 fp=#0x10000003e4b' 2024-08-31T04:30:53.786 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19782 fp=#0x5000000097b' 2024-08-31T04:30:53.787 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19814 fp=#0x50000001168' 2024-08-31T04:30:53.787 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19846 fp=#0x5000000115c' 2024-08-31T04:30:53.787 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19878 fp=#0x5000000169b' 2024-08-31T04:30:53.788 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19910 fp=#0x50000001128' 2024-08-31T04:30:53.788 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19942 fp=#0x50000000fb6' 2024-08-31T04:30:53.788 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19974 fp=#0x50000001ca7' 2024-08-31T04:30:53.789 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20006 fp=#0x50000000f77' 2024-08-31T04:30:53.789 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20038 fp=#0x50000000f80' 2024-08-31T04:30:53.789 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20070 fp=#0x50000001cc6' 2024-08-31T04:30:53.790 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20102 fp=#0x50000001cba' 2024-08-31T04:30:53.790 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20134 fp=#0x5000000102c' 2024-08-31T04:30:53.790 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20166 fp=#0x500000010d6' 2024-08-31T04:30:53.790 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20198 fp=#0x50000001039' 2024-08-31T04:30:53.791 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20230 fp=#0x50000001064' 2024-08-31T04:30:53.791 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20262 fp=#0x500000011db' 2024-08-31T04:30:53.792 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20326 fp=#0x200000002ec' 2024-08-31T04:30:53.792 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20358 fp=#0x200000002cd' 2024-08-31T04:30:53.792 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20390 fp=#0x200000003de' 2024-08-31T04:30:53.793 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20422 fp=#0x10000000ff9' 2024-08-31T04:30:53.793 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20454 fp=#0x10000000f26' 2024-08-31T04:30:53.793 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20486 fp=#0x500000019c2' 2024-08-31T04:30:53.793 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20518 fp=#0x10000003203' 2024-08-31T04:30:53.794 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20550 fp=#0x10000003179' 2024-08-31T04:30:53.794 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20582 fp=#0x100000031d2' 2024-08-31T04:30:53.794 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20614 fp=#0x500000019ba' 2024-08-31T04:30:53.795 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20678 fp=#0x100000031c2' 2024-08-31T04:30:53.795 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20710 fp=#0x100000032c4' 2024-08-31T04:30:53.795 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20742 fp=#0x2000000035c' 2024-08-31T04:30:53.796 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20774 fp=#0x10000002b27' 2024-08-31T04:30:53.796 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20806 fp=#0x2000000033d' 2024-08-31T04:30:53.796 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20838 fp=#0x20000001275' 2024-08-31T04:30:53.797 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20870 fp=#0x10000002adf' 2024-08-31T04:30:53.797 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20902 fp=#0x10000002b43' 2024-08-31T04:30:53.798 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20934 fp=#0x200000011ff' 2024-08-31T04:30:53.798 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20966 fp=#0x20000001171' 2024-08-31T04:30:53.798 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20998 fp=#0x10000001bc7' 2024-08-31T04:30:53.798 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:21030 fp=#0x10000001a39' 2024-08-31T04:30:53.799 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:21062 fp=#0x10000001ae6' 2024-08-31T04:30:53.799 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:21094 fp=#0x10000001f17' 2024-08-31T04:30:53.800 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:21126 fp=#0x3000000068c' 2024-08-31T04:30:53.800 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:21158 fp=#0x10000001e80' 2024-08-31T04:30:53.800 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:21222 fp=#0x10000001e3a' 2024-08-31T04:30:53.801 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:21254 fp=#0x30000000694' 2024-08-31T04:30:53.801 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:21286 fp=#0x3000000068d' 2024-08-31T04:30:53.802 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:10024 fp=#0x100000001fb' 2024-08-31T04:30:53.803 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:10184 fp=#0x50000000b5d' 2024-08-31T04:30:53.803 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:10216 fp=#0x100000017b7' 2024-08-31T04:30:53.824 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13064 fp=#0x30000002b08' 2024-08-31T04:30:53.825 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13128 fp=#0x50000001899' 2024-08-31T04:30:53.825 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13160 fp=#0x500000016db' 2024-08-31T04:30:53.826 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13192 fp=#0x400000017db' 2024-08-31T04:30:53.826 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13224 fp=#0x500000018b3' 2024-08-31T04:30:53.827 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13288 fp=#0x30000001a6f' 2024-08-31T04:30:53.827 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13320 fp=#0x30000002b87' 2024-08-31T04:30:53.827 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13352 fp=#0x30000002b8f' 2024-08-31T04:30:53.828 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13384 fp=#0x30000002b93' 2024-08-31T04:30:53.828 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13416 fp=#0x30000002792' 2024-08-31T04:30:53.828 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13448 fp=#0x30000002768' 2024-08-31T04:30:53.829 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13480 fp=#0x30000002778' 2024-08-31T04:30:53.829 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13512 fp=#0x400000013c2' 2024-08-31T04:30:53.830 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13608 fp=#0x50000001306' 2024-08-31T04:30:53.830 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13640 fp=#0x3000000227f' 2024-08-31T04:30:53.833 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14055 fp=#0x50000000c1f' 2024-08-31T04:30:53.834 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14087 fp=#0x50000000cc6' 2024-08-31T04:30:53.834 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14119 fp=#0x50000001430' 2024-08-31T04:30:53.835 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14151 fp=#0x50000000c9d' 2024-08-31T04:30:53.835 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14183 fp=#0x50000000c5e' 2024-08-31T04:30:53.835 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14215 fp=#0x50000000c3f' 2024-08-31T04:30:53.836 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14247 fp=#0x10000003b1f' 2024-08-31T04:30:53.837 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14375 fp=#0x10000003aaa' 2024-08-31T04:30:53.837 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14407 fp=#0x50000000bd6' 2024-08-31T04:30:53.837 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14439 fp=#0x50000000bba' 2024-08-31T04:30:53.838 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14471 fp=#0x50000000bc6' 2024-08-31T04:30:53.838 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14503 fp=#0x50000000b79' 2024-08-31T04:30:53.838 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14535 fp=#0x50000000baf' 2024-08-31T04:30:53.839 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14567 fp=#0x50000001b86' 2024-08-31T04:30:53.839 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14599 fp=#0x50000001b87' 2024-08-31T04:30:53.839 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14631 fp=#0x50000001b19' 2024-08-31T04:30:53.840 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14663 fp=#0x50000001b48' 2024-08-31T04:30:53.840 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14695 fp=#0x50000001b2f' 2024-08-31T04:30:53.840 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14727 fp=#0x500000014aa' 2024-08-31T04:30:53.841 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14759 fp=#0x50000001488' 2024-08-31T04:30:53.841 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14791 fp=#0x5000000147f' 2024-08-31T04:30:53.841 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14823 fp=#0x50000001452' 2024-08-31T04:30:53.841 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14855 fp=#0x50000001862' 2024-08-31T04:30:53.842 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14887 fp=#0x50000001d7c' 2024-08-31T04:30:53.842 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14919 fp=#0x50000000e94' 2024-08-31T04:30:53.843 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14951 fp=#0x50000000e39' 2024-08-31T04:30:53.843 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14983 fp=#0x50000001d7d' 2024-08-31T04:30:53.844 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15175 fp=#0x50000001015' 2024-08-31T04:30:53.845 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15207 fp=#0x50000000fd1' 2024-08-31T04:30:53.845 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15239 fp=#0x50000001001' 2024-08-31T04:30:53.845 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15303 fp=#0x5000000151a' 2024-08-31T04:30:53.846 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15335 fp=#0x50000001503' 2024-08-31T04:30:53.846 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15367 fp=#0x500000014fa' 2024-08-31T04:30:53.846 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15399 fp=#0x5000000110f' 2024-08-31T04:30:53.847 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15431 fp=#0x500000010e2' 2024-08-31T04:30:53.847 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15463 fp=#0x50000001100' 2024-08-31T04:30:53.849 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15783 fp=#0x50000001be3' 2024-08-31T04:30:53.850 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15847 fp=#0x50000001bf4' 2024-08-31T04:30:53.851 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15911 fp=#0x50000001943' 2024-08-31T04:30:53.851 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15943 fp=#0x50000001725' 2024-08-31T04:30:53.855 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16519 fp=#0x500000009e0' 2024-08-31T04:30:53.855 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16551 fp=#0x500000009dd' 2024-08-31T04:30:53.855 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16583 fp=#0x50000001762' 2024-08-31T04:30:53.856 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16615 fp=#0x5000000174b' 2024-08-31T04:30:53.857 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16743 fp=#0x500000018c7' 2024-08-31T04:30:53.857 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16775 fp=#0x500000016cb' 2024-08-31T04:30:53.857 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16807 fp=#0x50000001abe' 2024-08-31T04:30:53.858 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16839 fp=#0x50000001bb7' 2024-08-31T04:30:53.858 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16871 fp=#0x50000000b4f' 2024-08-31T04:30:53.858 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16903 fp=#0x50000000a91' 2024-08-31T04:30:53.859 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16935 fp=#0x50000000a50' 2024-08-31T04:30:53.859 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16967 fp=#0x50000001568' 2024-08-31T04:30:53.859 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16999 fp=#0x50000001653' 2024-08-31T04:30:53.860 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17031 fp=#0x5000000161f' 2024-08-31T04:30:53.860 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17063 fp=#0x50000001686' 2024-08-31T04:30:53.860 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17095 fp=#0x5000000155e' 2024-08-31T04:30:53.861 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17191 fp=#0x10000003eac' 2024-08-31T04:30:53.861 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17223 fp=#0x50000001608' 2024-08-31T04:30:53.862 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17255 fp=#0x500000015d0' 2024-08-31T04:30:53.862 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17287 fp=#0x500000015b7' 2024-08-31T04:30:53.862 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17319 fp=#0x500000015aa' 2024-08-31T04:30:53.862 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17351 fp=#0x100000037e3' 2024-08-31T04:30:53.863 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17383 fp=#0x100000036e4' 2024-08-31T04:30:53.863 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17415 fp=#0x100000037f0' 2024-08-31T04:30:53.863 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17447 fp=#0x100000036d4' 2024-08-31T04:30:53.864 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17479 fp=#0x10000003644' 2024-08-31T04:30:53.864 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17543 fp=#0x5000000192f' 2024-08-31T04:30:53.865 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17575 fp=#0x500000012b2' 2024-08-31T04:30:53.865 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17607 fp=#0x500000012e8' 2024-08-31T04:30:53.865 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17639 fp=#0x500000012cf' 2024-08-31T04:30:53.865 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17671 fp=#0x10000002348' 2024-08-31T04:30:53.866 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17799 fp=#0x1000000233c' 2024-08-31T04:30:53.867 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17863 fp=#0x5000000169c' 2024-08-31T04:30:53.867 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17895 fp=#0x50000001617' 2024-08-31T04:30:53.867 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17927 fp=#0x500000018fb' 2024-08-31T04:30:53.868 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17991 fp=#0x5000000164d' 2024-08-31T04:30:53.868 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18023 fp=#0x50000000933' 2024-08-31T04:30:53.869 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18055 fp=#0x50000000912' 2024-08-31T04:30:53.869 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18119 fp=#0x50000001a85' 2024-08-31T04:30:53.870 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18183 fp=#0x5000000093c' 2024-08-31T04:30:53.870 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18215 fp=#0x50000000928' 2024-08-31T04:30:53.870 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18247 fp=#0x50000001a40' 2024-08-31T04:30:53.871 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18279 fp=#0x50000000e9d' 2024-08-31T04:30:53.871 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18343 fp=#0x50000000eac' 2024-08-31T04:30:53.872 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18375 fp=#0x50000000dda' 2024-08-31T04:30:53.873 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18503 fp=#0x50000000edd' 2024-08-31T04:30:53.873 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18535 fp=#0x50000000aa2' 2024-08-31T04:30:53.874 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18599 fp=#0x100000003d1' 2024-08-31T04:30:53.874 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18631 fp=#0x50000000ee0' 2024-08-31T04:30:53.874 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18663 fp=#0x50000000d1e' 2024-08-31T04:30:53.875 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18695 fp=#0x50000000d62' 2024-08-31T04:30:53.875 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18727 fp=#0x50000000d4d' 2024-08-31T04:30:53.875 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18759 fp=#0x50000000d28' 2024-08-31T04:30:53.876 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18791 fp=#0x50000000d59' 2024-08-31T04:30:53.876 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18823 fp=#0x500000011c8' 2024-08-31T04:30:53.876 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18855 fp=#0x50000000d82' 2024-08-31T04:30:53.877 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18887 fp=#0x50000000d90' 2024-08-31T04:30:53.877 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18919 fp=#0x50000000e0d' 2024-08-31T04:30:53.877 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18951 fp=#0x50000000db8' 2024-08-31T04:30:53.878 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18983 fp=#0x500000019b4' 2024-08-31T04:30:53.878 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19015 fp=#0x50000000db0' 2024-08-31T04:30:53.879 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19143 fp=#0x50000001814' 2024-08-31T04:30:53.880 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19239 fp=#0x500000017d6' 2024-08-31T04:30:53.880 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19271 fp=#0x500000017c2' 2024-08-31T04:30:53.880 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19303 fp=#0x500000017e2' 2024-08-31T04:30:53.880 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19335 fp=#0x50000001829' 2024-08-31T04:30:53.881 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19367 fp=#0x500000017f9' 2024-08-31T04:30:53.881 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19399 fp=#0x50000001c2c' 2024-08-31T04:30:53.881 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19431 fp=#0x50000001c4f' 2024-08-31T04:30:53.882 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19463 fp=#0x5000000195f' 2024-08-31T04:30:53.882 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19495 fp=#0x5000000191b' 2024-08-31T04:30:53.882 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19527 fp=#0x50000001a1b' 2024-08-31T04:30:53.883 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19559 fp=#0x500000019db' 2024-08-31T04:30:53.883 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19591 fp=#0x50000001983' 2024-08-31T04:30:53.884 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19687 fp=#0x10000003e75' 2024-08-31T04:30:53.884 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19719 fp=#0x10000003ded' 2024-08-31T04:30:53.884 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19783 fp=#0x50000000995' 2024-08-31T04:30:53.885 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19815 fp=#0x5000000111a' 2024-08-31T04:30:53.885 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19847 fp=#0x50000001173' 2024-08-31T04:30:53.885 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19879 fp=#0x50000001164' 2024-08-31T04:30:53.886 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19911 fp=#0x50000001160' 2024-08-31T04:30:53.886 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19943 fp=#0x50000001ce5' 2024-08-31T04:30:53.886 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19975 fp=#0x50000000fb7' 2024-08-31T04:30:53.886 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20007 fp=#0x50000001cb9' 2024-08-31T04:30:53.887 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20039 fp=#0x50000001ce8' 2024-08-31T04:30:53.887 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20071 fp=#0x50000001ccd' 2024-08-31T04:30:53.887 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20103 fp=#0x50000001034' 2024-08-31T04:30:53.888 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20135 fp=#0x50000001085' 2024-08-31T04:30:53.888 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20167 fp=#0x50000001078' 2024-08-31T04:30:53.888 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20199 fp=#0x50000001055' 2024-08-31T04:30:53.889 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20231 fp=#0x50000001075' 2024-08-31T04:30:53.889 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20263 fp=#0x500000011ad' 2024-08-31T04:30:53.890 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20327 fp=#0x200000002ef' 2024-08-31T04:30:53.890 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20359 fp=#0x200000002dc' 2024-08-31T04:30:53.890 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20391 fp=#0x1000000105b' 2024-08-31T04:30:53.891 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20423 fp=#0x200000002f4' 2024-08-31T04:30:53.891 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20455 fp=#0x200000003d8' 2024-08-31T04:30:53.891 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20487 fp=#0x100000032ef' 2024-08-31T04:30:53.892 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20519 fp=#0x100000031b6' 2024-08-31T04:30:53.892 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20551 fp=#0x500000018dd' 2024-08-31T04:30:53.892 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20615 fp=#0x10000003259' 2024-08-31T04:30:53.893 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20647 fp=#0x100000031ad' 2024-08-31T04:30:53.893 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20679 fp=#0x100000032d0' 2024-08-31T04:30:53.893 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20711 fp=#0x1000000325d' 2024-08-31T04:30:53.894 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20743 fp=#0x20000000334' 2024-08-31T04:30:53.894 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20775 fp=#0x200000011f8' 2024-08-31T04:30:53.894 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20807 fp=#0x10000002b17' 2024-08-31T04:30:53.895 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20839 fp=#0x10000002ac1' 2024-08-31T04:30:53.895 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20871 fp=#0x10000002b8a' 2024-08-31T04:30:53.895 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20903 fp=#0x20000000350' 2024-08-31T04:30:53.896 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20935 fp=#0x20000001179' 2024-08-31T04:30:53.896 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20967 fp=#0x10000002b29' 2024-08-31T04:30:53.896 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20999 fp=#0x10000001aea' 2024-08-31T04:30:53.897 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:21031 fp=#0x10000001b12' 2024-08-31T04:30:53.897 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:21063 fp=#0x10000001a8e' 2024-08-31T04:30:53.897 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:21095 fp=#0x10000001e84' 2024-08-31T04:30:53.898 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:21127 fp=#0x10000001e7b' 2024-08-31T04:30:53.898 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:21159 fp=#0x10000001e72' 2024-08-31T04:30:53.898 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:21191 fp=#0x50000001c39' 2024-08-31T04:30:53.899 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:21255 fp=#0x10000001e52' 2024-08-31T04:30:53.899 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:21287 fp=#0x10000001e5e' 2024-08-31T04:30:53.900 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:10025 fp=#0x10000000005' 2024-08-31T04:30:53.901 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:10185 fp=#0x10000003173' 2024-08-31T04:30:53.901 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:10217 fp=#0x50000000881' 2024-08-31T04:30:53.902 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:10249 fp=#0x1000000095d' 2024-08-31T04:30:53.922 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:12937 fp=#0x500000018b2' 2024-08-31T04:30:53.923 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13065 fp=#0x30000002ad9' 2024-08-31T04:30:53.923 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13129 fp=#0x40000001749' 2024-08-31T04:30:53.924 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13289 fp=#0x30000002b83' 2024-08-31T04:30:53.925 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13321 fp=#0x30000001aec' 2024-08-31T04:30:53.925 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13353 fp=#0x30000001e8c' 2024-08-31T04:30:53.925 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13385 fp=#0x30000002b8b' 2024-08-31T04:30:53.926 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13417 fp=#0x30000002776' 2024-08-31T04:30:53.926 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13449 fp=#0x30000002773' 2024-08-31T04:30:53.926 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13481 fp=#0x30000002752' 2024-08-31T04:30:53.927 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13545 fp=#0x5000000118d' 2024-08-31T04:30:53.928 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13609 fp=#0x40000000ff4' 2024-08-31T04:30:53.931 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14025 fp=#0x400000007a1' 2024-08-31T04:30:53.931 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14056 fp=#0x50000000c57' 2024-08-31T04:30:53.932 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14088 fp=#0x50000000c28' 2024-08-31T04:30:53.932 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14216 fp=#0x50000000ca5' 2024-08-31T04:30:53.933 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14344 fp=#0x500000016ad' 2024-08-31T04:30:53.934 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14376 fp=#0x10000003b29' 2024-08-31T04:30:53.934 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14408 fp=#0x50000000c0c' 2024-08-31T04:30:53.934 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14440 fp=#0x50000000bf4' 2024-08-31T04:30:53.935 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14472 fp=#0x50000000bce' 2024-08-31T04:30:53.935 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14504 fp=#0x50000000bfd' 2024-08-31T04:30:53.935 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14536 fp=#0x50000000bff' 2024-08-31T04:30:53.936 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14568 fp=#0x50000001b07' 2024-08-31T04:30:53.936 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14600 fp=#0x50000001b56' 2024-08-31T04:30:53.936 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14632 fp=#0x50000001afc' 2024-08-31T04:30:53.937 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14664 fp=#0x50000001b1c' 2024-08-31T04:30:53.937 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14696 fp=#0x50000001b4d' 2024-08-31T04:30:53.937 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14728 fp=#0x500000014e8' 2024-08-31T04:30:53.938 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14760 fp=#0x500000014c9' 2024-08-31T04:30:53.938 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14792 fp=#0x500000014b3' 2024-08-31T04:30:53.938 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14824 fp=#0x500000014b7' 2024-08-31T04:30:53.939 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14856 fp=#0x50000000e17' 2024-08-31T04:30:53.939 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14888 fp=#0x50000000e35' 2024-08-31T04:30:53.939 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14920 fp=#0x50000000e37' 2024-08-31T04:30:53.940 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14952 fp=#0x50000000e14' 2024-08-31T04:30:53.940 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14984 fp=#0x50000001d6e' 2024-08-31T04:30:53.940 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15048 fp=#0x50000001b0b' 2024-08-31T04:30:53.941 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15176 fp=#0x50000000fca' 2024-08-31T04:30:53.942 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15208 fp=#0x50000001ac5' 2024-08-31T04:30:53.942 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15240 fp=#0x5000000100f' 2024-08-31T04:30:53.942 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15272 fp=#0x50000000ff3' 2024-08-31T04:30:53.943 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15304 fp=#0x50000001549' 2024-08-31T04:30:53.943 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15336 fp=#0x50000001534' 2024-08-31T04:30:53.943 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15368 fp=#0x50000001506' 2024-08-31T04:30:53.944 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15400 fp=#0x500000010f9' 2024-08-31T04:30:53.944 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15432 fp=#0x500000010c6' 2024-08-31T04:30:53.944 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15464 fp=#0x500000010ad' 2024-08-31T04:30:53.946 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15784 fp=#0x50000001c15' 2024-08-31T04:30:53.947 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15880 fp=#0x50000001be4' 2024-08-31T04:30:53.948 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15912 fp=#0x50000001728' 2024-08-31T04:30:53.948 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15944 fp=#0x50000001720' 2024-08-31T04:30:53.952 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16520 fp=#0x500000009ef' 2024-08-31T04:30:53.952 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16552 fp=#0x500000009e4' 2024-08-31T04:30:53.952 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16584 fp=#0x50000001771' 2024-08-31T04:30:53.953 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16616 fp=#0x50000001760' 2024-08-31T04:30:53.953 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16648 fp=#0x50000001d01' 2024-08-31T04:30:53.954 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16712 fp=#0x50000001d1a' 2024-08-31T04:30:53.954 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16808 fp=#0x50000001cfc' 2024-08-31T04:30:53.955 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16840 fp=#0x50000001bc0' 2024-08-31T04:30:53.955 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16872 fp=#0x50000000b38' 2024-08-31T04:30:53.955 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16904 fp=#0x50000000a5c' 2024-08-31T04:30:53.955 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16936 fp=#0x50000000a3a' 2024-08-31T04:30:53.956 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16968 fp=#0x50000001593' 2024-08-31T04:30:53.956 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17000 fp=#0x5000000155c' 2024-08-31T04:30:53.956 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17032 fp=#0x50000001688' 2024-08-31T04:30:53.957 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17064 fp=#0x5000000163a' 2024-08-31T04:30:53.957 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17096 fp=#0x5000000167d' 2024-08-31T04:30:53.958 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17224 fp=#0x5000000158c' 2024-08-31T04:30:53.958 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17256 fp=#0x5000000161d' 2024-08-31T04:30:53.959 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17288 fp=#0x500000015ac' 2024-08-31T04:30:53.959 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17320 fp=#0x5000000160d' 2024-08-31T04:30:53.959 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17352 fp=#0x100000036c0' 2024-08-31T04:30:53.960 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17416 fp=#0x100000036d6' 2024-08-31T04:30:53.960 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17448 fp=#0x100000036e9' 2024-08-31T04:30:53.961 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17480 fp=#0x1000000368e' 2024-08-31T04:30:53.961 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17544 fp=#0x500000012ec' 2024-08-31T04:30:53.962 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17608 fp=#0x500000012b4' 2024-08-31T04:30:53.962 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17640 fp=#0x500000012a9' 2024-08-31T04:30:53.962 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17672 fp=#0x10000002343' 2024-08-31T04:30:53.964 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17864 fp=#0x5000000166c' 2024-08-31T04:30:53.964 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17928 fp=#0x50000001657' 2024-08-31T04:30:53.965 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17960 fp=#0x5000000166a' 2024-08-31T04:30:53.965 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17992 fp=#0x500000009fd' 2024-08-31T04:30:53.965 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18024 fp=#0x50000001a98' 2024-08-31T04:30:53.966 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18088 fp=#0x500000008de' 2024-08-31T04:30:53.967 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18152 fp=#0x50000001a5e' 2024-08-31T04:30:53.967 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18184 fp=#0x50000001a51' 2024-08-31T04:30:53.967 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18216 fp=#0x50000001a2f' 2024-08-31T04:30:53.968 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18280 fp=#0x50000000e89' 2024-08-31T04:30:53.968 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18344 fp=#0x50000000e4d' 2024-08-31T04:30:53.970 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18504 fp=#0x100000003d4' 2024-08-31T04:30:53.970 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18536 fp=#0x50000000ab1' 2024-08-31T04:30:53.970 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18568 fp=#0x50000000ace' 2024-08-31T04:30:53.970 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18600 fp=#0x1000000043d' 2024-08-31T04:30:53.971 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18632 fp=#0x50000000ed8' 2024-08-31T04:30:53.971 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18664 fp=#0x50000000d6d' 2024-08-31T04:30:53.971 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18696 fp=#0x50000000d2a' 2024-08-31T04:30:53.972 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18728 fp=#0x50000000d78' 2024-08-31T04:30:53.972 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18760 fp=#0x50000000d6f' 2024-08-31T04:30:53.972 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18792 fp=#0x50000000d46' 2024-08-31T04:30:53.973 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18824 fp=#0x500000011cc' 2024-08-31T04:30:53.973 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18856 fp=#0x500000019ab' 2024-08-31T04:30:53.973 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18888 fp=#0x50000000f11' 2024-08-31T04:30:53.974 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18920 fp=#0x500000019b8' 2024-08-31T04:30:53.974 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18952 fp=#0x50000000d98' 2024-08-31T04:30:53.974 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18984 fp=#0x50000000d8c' 2024-08-31T04:30:53.975 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19016 fp=#0x50000000de3' 2024-08-31T04:30:53.975 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19112 fp=#0x500000017d8' 2024-08-31T04:30:53.976 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19176 fp=#0x500000017dc' 2024-08-31T04:30:53.976 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19208 fp=#0x50000001833' 2024-08-31T04:30:53.977 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19272 fp=#0x500000017cb' 2024-08-31T04:30:53.977 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19304 fp=#0x500000017c0' 2024-08-31T04:30:53.977 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19336 fp=#0x500000017e1' 2024-08-31T04:30:53.978 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19368 fp=#0x50000001846' 2024-08-31T04:30:53.978 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19400 fp=#0x5000000181b' 2024-08-31T04:30:53.978 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19432 fp=#0x50000001c70' 2024-08-31T04:30:53.978 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19464 fp=#0x50000001a15' 2024-08-31T04:30:53.979 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19496 fp=#0x50000001a16' 2024-08-31T04:30:53.979 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19528 fp=#0x500000019dd' 2024-08-31T04:30:53.979 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19560 fp=#0x500000019ea' 2024-08-31T04:30:53.980 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19592 fp=#0x500000019e4' 2024-08-31T04:30:53.980 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19624 fp=#0x10000003e15' 2024-08-31T04:30:53.980 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19656 fp=#0x10000003eb9' 2024-08-31T04:30:53.981 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19752 fp=#0x10000003e0b' 2024-08-31T04:30:53.981 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19784 fp=#0x50000000967' 2024-08-31T04:30:53.982 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19816 fp=#0x50000001132' 2024-08-31T04:30:53.982 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19848 fp=#0x50000001161' 2024-08-31T04:30:53.982 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19880 fp=#0x5000000113f' 2024-08-31T04:30:53.983 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19912 fp=#0x50000001126' 2024-08-31T04:30:53.983 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19944 fp=#0x50000001cdc' 2024-08-31T04:30:53.983 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19976 fp=#0x50000001c8b' 2024-08-31T04:30:53.983 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20008 fp=#0x50000001cab' 2024-08-31T04:30:53.984 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20040 fp=#0x50000001c9d' 2024-08-31T04:30:53.984 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20072 fp=#0x50000001cc7' 2024-08-31T04:30:53.984 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20104 fp=#0x500000010c8' 2024-08-31T04:30:53.985 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20136 fp=#0x500000010c0' 2024-08-31T04:30:53.985 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20168 fp=#0x50000001036' 2024-08-31T04:30:53.985 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20200 fp=#0x500000010c5' 2024-08-31T04:30:53.986 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20232 fp=#0x5000000106f' 2024-08-31T04:30:53.986 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20264 fp=#0x50000001c87' 2024-08-31T04:30:53.986 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20328 fp=#0x10000000e53' 2024-08-31T04:30:53.987 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20360 fp=#0x200000002cc' 2024-08-31T04:30:53.987 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20392 fp=#0x200000002f1' 2024-08-31T04:30:53.987 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20424 fp=#0x200000002f6' 2024-08-31T04:30:53.988 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20456 fp=#0x200000003c4' 2024-08-31T04:30:53.988 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20488 fp=#0x100000031a3' 2024-08-31T04:30:53.989 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20520 fp=#0x20000001b8e' 2024-08-31T04:30:53.989 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20552 fp=#0x1000000327b' 2024-08-31T04:30:53.989 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20584 fp=#0x500000018c3' 2024-08-31T04:30:53.990 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20616 fp=#0x500000018ce' 2024-08-31T04:30:53.990 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20648 fp=#0x100000032e7' 2024-08-31T04:30:53.990 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20680 fp=#0x500000018cb' 2024-08-31T04:30:53.991 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20712 fp=#0x10000003237' 2024-08-31T04:30:53.991 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20744 fp=#0x2000000035e' 2024-08-31T04:30:53.991 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20776 fp=#0x2000000121e' 2024-08-31T04:30:53.991 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20808 fp=#0x10000002b2d' 2024-08-31T04:30:53.992 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20840 fp=#0x20000001254' 2024-08-31T04:30:53.992 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20872 fp=#0x2000000032d' 2024-08-31T04:30:53.992 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20904 fp=#0x10000002bb1' 2024-08-31T04:30:53.993 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20936 fp=#0x200000011ab' 2024-08-31T04:30:53.993 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20968 fp=#0x10000002b35' 2024-08-31T04:30:53.993 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:21000 fp=#0x10000001bae' 2024-08-31T04:30:53.994 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:21032 fp=#0x30000000405' 2024-08-31T04:30:53.994 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:21064 fp=#0x10000001a60' 2024-08-31T04:30:53.994 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:21096 fp=#0x50000001c43' 2024-08-31T04:30:53.995 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:21128 fp=#0x50000001ba7' 2024-08-31T04:30:53.995 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:21160 fp=#0x30000000669' 2024-08-31T04:30:53.995 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:21192 fp=#0x50000001c23' 2024-08-31T04:30:53.995 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:21224 fp=#0x10000001eeb' 2024-08-31T04:30:53.996 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:21256 fp=#0x30000000696' 2024-08-31T04:30:53.996 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:21288 fp=#0x30000000667' 2024-08-31T04:30:53.997 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:10026 fp=#0x10000000006' 2024-08-31T04:30:53.998 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:10186 fp=#0x50000001af7' 2024-08-31T04:30:53.998 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:10218 fp=#0x100000042ac' 2024-08-31T04:30:54.019 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13066 fp=#0x30000002ad8' 2024-08-31T04:30:54.019 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13098 fp=#0x500000018a1' 2024-08-31T04:30:54.020 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13258 fp=#0x40000001682' 2024-08-31T04:30:54.021 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13290 fp=#0x30000001aa1' 2024-08-31T04:30:54.021 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13322 fp=#0x30000002b77' 2024-08-31T04:30:54.021 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13354 fp=#0x30000002b97' 2024-08-31T04:30:54.022 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13386 fp=#0x30000002b86' 2024-08-31T04:30:54.022 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13418 fp=#0x30000002791' 2024-08-31T04:30:54.022 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13450 fp=#0x3000000276a' 2024-08-31T04:30:54.023 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13482 fp=#0x3000000276e' 2024-08-31T04:30:54.024 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13610 fp=#0x500000011bb' 2024-08-31T04:30:54.027 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14089 fp=#0x50000000c2b' 2024-08-31T04:30:54.028 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14121 fp=#0x50000000c37' 2024-08-31T04:30:54.028 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14153 fp=#0x50000000cc9' 2024-08-31T04:30:54.028 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14185 fp=#0x50000000c59' 2024-08-31T04:30:54.029 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14217 fp=#0x50000000c29' 2024-08-31T04:30:54.029 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14249 fp=#0x10000003aaf' 2024-08-31T04:30:54.030 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14313 fp=#0x10000003b16' 2024-08-31T04:30:54.030 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14377 fp=#0x10000003ae3' 2024-08-31T04:30:54.030 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14409 fp=#0x50000000ba3' 2024-08-31T04:30:54.031 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14441 fp=#0x50000000b7d' 2024-08-31T04:30:54.031 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14473 fp=#0x50000000be0' 2024-08-31T04:30:54.031 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14505 fp=#0x50000000bb7' 2024-08-31T04:30:54.032 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14537 fp=#0x50000000b67' 2024-08-31T04:30:54.032 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14569 fp=#0x50000001b43' 2024-08-31T04:30:54.032 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14601 fp=#0x50000001b80' 2024-08-31T04:30:54.033 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14633 fp=#0x50000001b18' 2024-08-31T04:30:54.033 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14665 fp=#0x50000001b39' 2024-08-31T04:30:54.033 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14697 fp=#0x50000001b64' 2024-08-31T04:30:54.034 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14729 fp=#0x5000000144c' 2024-08-31T04:30:54.034 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14761 fp=#0x500000014cd' 2024-08-31T04:30:54.034 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14793 fp=#0x500000014e2' 2024-08-31T04:30:54.035 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14825 fp=#0x500000014be' 2024-08-31T04:30:54.035 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14857 fp=#0x50000001877' 2024-08-31T04:30:54.035 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14889 fp=#0x50000000e3c' 2024-08-31T04:30:54.036 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14921 fp=#0x50000001876' 2024-08-31T04:30:54.036 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14953 fp=#0x50000000e44' 2024-08-31T04:30:54.036 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14985 fp=#0x50000000e8b' 2024-08-31T04:30:54.038 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15177 fp=#0x50000000ff2' 2024-08-31T04:30:54.038 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15209 fp=#0x50000001ab1' 2024-08-31T04:30:54.038 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15241 fp=#0x50000000fda' 2024-08-31T04:30:54.039 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15273 fp=#0x50000000ff9' 2024-08-31T04:30:54.039 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15305 fp=#0x5000000150d' 2024-08-31T04:30:54.039 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15337 fp=#0x50000001515' 2024-08-31T04:30:54.040 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15369 fp=#0x5000000152c' 2024-08-31T04:30:54.040 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15401 fp=#0x50000001096' 2024-08-31T04:30:54.040 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15433 fp=#0x500000010e7' 2024-08-31T04:30:54.041 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15465 fp=#0x500000010f7' 2024-08-31T04:30:54.043 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15753 fp=#0x50000001beb' 2024-08-31T04:30:54.043 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15785 fp=#0x50000001c0d' 2024-08-31T04:30:54.044 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15817 fp=#0x50000001bd8' 2024-08-31T04:30:54.044 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15881 fp=#0x500000016f3' 2024-08-31T04:30:54.044 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15913 fp=#0x500000016ea' 2024-08-31T04:30:54.048 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15945 fp=#0x500000016f8' 2024-08-31T04:30:54.050 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16201 fp=#0x500000018b7' 2024-08-31T04:30:54.052 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16521 fp=#0x500000009f1' 2024-08-31T04:30:54.052 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16553 fp=#0x500000009c9' 2024-08-31T04:30:54.053 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16585 fp=#0x50000001773' 2024-08-31T04:30:54.053 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16617 fp=#0x50000001753' 2024-08-31T04:30:54.053 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16649 fp=#0x50000001a77' 2024-08-31T04:30:54.053 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16681 fp=#0x50000001a46' 2024-08-31T04:30:54.054 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16745 fp=#0x50000001a91' 2024-08-31T04:30:54.054 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16777 fp=#0x50000001a65' 2024-08-31T04:30:54.055 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16809 fp=#0x50000001a88' 2024-08-31T04:30:54.055 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16841 fp=#0x50000001bc1' 2024-08-31T04:30:54.055 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16873 fp=#0x50000000b3c' 2024-08-31T04:30:54.056 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16905 fp=#0x50000000a8c' 2024-08-31T04:30:54.056 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16937 fp=#0x50000000a83' 2024-08-31T04:30:54.056 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16969 fp=#0x50000001588' 2024-08-31T04:30:54.056 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17001 fp=#0x5000000162f' 2024-08-31T04:30:54.057 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17033 fp=#0x500000015f5' 2024-08-31T04:30:54.057 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17065 fp=#0x50000001584' 2024-08-31T04:30:54.057 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17097 fp=#0x500000015ed' 2024-08-31T04:30:54.058 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17129 fp=#0x10000003f06' 2024-08-31T04:30:54.059 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17225 fp=#0x50000001626' 2024-08-31T04:30:54.059 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17257 fp=#0x500000015ff' 2024-08-31T04:30:54.059 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17289 fp=#0x5000000158e' 2024-08-31T04:30:54.060 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17321 fp=#0x5000000159c' 2024-08-31T04:30:54.060 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17353 fp=#0x100000035c9' 2024-08-31T04:30:54.060 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17385 fp=#0x100000037e4' 2024-08-31T04:30:54.061 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17417 fp=#0x100000037e0' 2024-08-31T04:30:54.061 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17449 fp=#0x10000003695' 2024-08-31T04:30:54.061 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17481 fp=#0x100000036dc' 2024-08-31T04:30:54.062 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17513 fp=#0x50000001283' 2024-08-31T04:30:54.062 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17545 fp=#0x500000012d7' 2024-08-31T04:30:54.062 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17577 fp=#0x500000012f1' 2024-08-31T04:30:54.063 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17641 fp=#0x5000000127e' 2024-08-31T04:30:54.063 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17737 fp=#0x1000000234c' 2024-08-31T04:30:54.065 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17897 fp=#0x50000000a02' 2024-08-31T04:30:54.065 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17929 fp=#0x50000000a01' 2024-08-31T04:30:54.065 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17961 fp=#0x50000000a0c' 2024-08-31T04:30:54.066 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17993 fp=#0x5000000165b' 2024-08-31T04:30:54.066 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18025 fp=#0x50000001a7d' 2024-08-31T04:30:54.066 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18057 fp=#0x50000000915' 2024-08-31T04:30:54.067 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18089 fp=#0x500000008e2' 2024-08-31T04:30:54.067 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18121 fp=#0x50000001a9d' 2024-08-31T04:30:54.067 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18153 fp=#0x50000001a3d' 2024-08-31T04:30:54.068 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18217 fp=#0x50000001a68' 2024-08-31T04:30:54.068 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18281 fp=#0x50000000e5e' 2024-08-31T04:30:54.068 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18313 fp=#0x50000000e45' 2024-08-31T04:30:54.070 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18441 fp=#0x50000000de2' 2024-08-31T04:30:54.070 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18505 fp=#0x1000000044f' 2024-08-31T04:30:54.071 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18537 fp=#0x50000000aa1' 2024-08-31T04:30:54.071 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18569 fp=#0x50000000aa7' 2024-08-31T04:30:54.071 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18601 fp=#0x50000000ac9' 2024-08-31T04:30:54.071 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18633 fp=#0x50000000ed3' 2024-08-31T04:30:54.072 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18665 fp=#0x50000000cf5' 2024-08-31T04:30:54.072 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18697 fp=#0x50000000d5c' 2024-08-31T04:30:54.072 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18729 fp=#0x50000000d44' 2024-08-31T04:30:54.072 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18761 fp=#0x50000000d4f' 2024-08-31T04:30:54.073 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18793 fp=#0x50000000d38' 2024-08-31T04:30:54.073 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18825 fp=#0x500000011cb' 2024-08-31T04:30:54.073 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18857 fp=#0x50000000f10' 2024-08-31T04:30:54.074 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18889 fp=#0x50000000d86' 2024-08-31T04:30:54.074 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18921 fp=#0x50000000f0b' 2024-08-31T04:30:54.074 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18953 fp=#0x50000000f1d' 2024-08-31T04:30:54.075 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18985 fp=#0x50000000def' 2024-08-31T04:30:54.075 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19017 fp=#0x50000000d8a' 2024-08-31T04:30:54.076 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19113 fp=#0x500000017da' 2024-08-31T04:30:54.076 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19145 fp=#0x5000000180f' 2024-08-31T04:30:54.077 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19209 fp=#0x500000017b0' 2024-08-31T04:30:54.077 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19273 fp=#0x50000001432' 2024-08-31T04:30:54.078 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19337 fp=#0x50000001845' 2024-08-31T04:30:54.078 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19369 fp=#0x50000001c52' 2024-08-31T04:30:54.078 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19401 fp=#0x5000000180a' 2024-08-31T04:30:54.079 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19433 fp=#0x50000001c5c' 2024-08-31T04:30:54.079 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19465 fp=#0x500000019b9' 2024-08-31T04:30:54.079 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19497 fp=#0x500000019ff' 2024-08-31T04:30:54.079 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19529 fp=#0x50000001a13' 2024-08-31T04:30:54.080 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19561 fp=#0x50000001986' 2024-08-31T04:30:54.080 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19593 fp=#0x5000000198f' 2024-08-31T04:30:54.080 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19625 fp=#0x10000003e4e' 2024-08-31T04:30:54.081 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19689 fp=#0x10000003ee9' 2024-08-31T04:30:54.081 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19721 fp=#0x10000003ead' 2024-08-31T04:30:54.082 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19753 fp=#0x10000003dd9' 2024-08-31T04:30:54.082 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19785 fp=#0x50000000986' 2024-08-31T04:30:54.082 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19817 fp=#0x50000001177' 2024-08-31T04:30:54.083 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19849 fp=#0x5000000112d' 2024-08-31T04:30:54.083 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19881 fp=#0x5000000114e' 2024-08-31T04:30:54.083 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19913 fp=#0x50000001129' 2024-08-31T04:30:54.083 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19945 fp=#0x50000001cc9' 2024-08-31T04:30:54.084 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19977 fp=#0x50000000f91' 2024-08-31T04:30:54.084 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20009 fp=#0x50000001ce9' 2024-08-31T04:30:54.084 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20041 fp=#0x50000000fa3' 2024-08-31T04:30:54.085 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20073 fp=#0x50000001c97' 2024-08-31T04:30:54.085 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20105 fp=#0x500000010be' 2024-08-31T04:30:54.085 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20137 fp=#0x5000000106d' 2024-08-31T04:30:54.086 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20169 fp=#0x500000012c0' 2024-08-31T04:30:54.086 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20201 fp=#0x50000001070' 2024-08-31T04:30:54.086 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20233 fp=#0x5000000108a' 2024-08-31T04:30:54.087 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20265 fp=#0x50000001c7d' 2024-08-31T04:30:54.087 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20329 fp=#0x200000003aa' 2024-08-31T04:30:54.087 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20361 fp=#0x200000003a8' 2024-08-31T04:30:54.088 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20393 fp=#0x200000003e8' 2024-08-31T04:30:54.088 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20425 fp=#0x10000000ef1' 2024-08-31T04:30:54.088 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20457 fp=#0x200000003b3' 2024-08-31T04:30:54.089 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20489 fp=#0x5000000190f' 2024-08-31T04:30:54.089 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20521 fp=#0x10000003180' 2024-08-31T04:30:54.089 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20553 fp=#0x20000000366' 2024-08-31T04:30:54.090 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20585 fp=#0x20000000369' 2024-08-31T04:30:54.090 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20617 fp=#0x10000003303' 2024-08-31T04:30:54.090 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20649 fp=#0x10000003200' 2024-08-31T04:30:54.091 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20681 fp=#0x100000031f6' 2024-08-31T04:30:54.091 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20713 fp=#0x500000019ce' 2024-08-31T04:30:54.091 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20745 fp=#0x10000002b6b' 2024-08-31T04:30:54.092 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20777 fp=#0x2000000033b' 2024-08-31T04:30:54.092 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20809 fp=#0x10000002b1b' 2024-08-31T04:30:54.093 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20841 fp=#0x10000002ae3' 2024-08-31T04:30:54.093 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20873 fp=#0x20000001182' 2024-08-31T04:30:54.093 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20905 fp=#0x200000011c1' 2024-08-31T04:30:54.093 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20937 fp=#0x10000002b03' 2024-08-31T04:30:54.094 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20969 fp=#0x10000002b6f' 2024-08-31T04:30:54.094 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:21001 fp=#0x10000001b8a' 2024-08-31T04:30:54.094 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:21033 fp=#0x10000001bf0' 2024-08-31T04:30:54.095 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:21097 fp=#0x10000001f15' 2024-08-31T04:30:54.095 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:21129 fp=#0x50000001be2' 2024-08-31T04:30:54.096 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:21161 fp=#0x30000000678' 2024-08-31T04:30:54.096 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:21193 fp=#0x10000001e3e' 2024-08-31T04:30:54.096 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:21225 fp=#0x30000000685' 2024-08-31T04:30:54.097 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:21257 fp=#0x10000001ea0' 2024-08-31T04:30:54.097 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:21289 fp=#0x10000001eef' 2024-08-31T04:30:54.097 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:10027 fp=#0x10000000201' 2024-08-31T04:30:54.098 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:10187 fp=#0x5000000144a' 2024-08-31T04:30:54.099 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:10219 fp=#0x1000000039d' 2024-08-31T04:30:54.119 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13067 fp=#0x30000002b2e' 2024-08-31T04:30:54.121 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13259 fp=#0x400000015e2' 2024-08-31T04:30:54.121 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13291 fp=#0x30000001b04' 2024-08-31T04:30:54.122 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13323 fp=#0x30000001a53' 2024-08-31T04:30:54.122 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13355 fp=#0x30000001a6d' 2024-08-31T04:30:54.122 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13387 fp=#0x30000001a43' 2024-08-31T04:30:54.123 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13419 fp=#0x30000002755' 2024-08-31T04:30:54.123 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13451 fp=#0x3000000277c' 2024-08-31T04:30:54.123 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13483 fp=#0x30000002795' 2024-08-31T04:30:54.124 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13515 fp=#0x40000001318' 2024-08-31T04:30:54.127 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13963 fp=#0x40000001ba5' 2024-08-31T04:30:54.128 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14058 fp=#0x50000000cb9' 2024-08-31T04:30:54.128 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14090 fp=#0x50000000c51' 2024-08-31T04:30:54.129 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14122 fp=#0x50000000c63' 2024-08-31T04:30:54.129 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14186 fp=#0x50000000c33' 2024-08-31T04:30:54.130 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14218 fp=#0x50000001d2d' 2024-08-31T04:30:54.130 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14314 fp=#0x10000003af2' 2024-08-31T04:30:54.131 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14410 fp=#0x50000000c0a' 2024-08-31T04:30:54.131 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14442 fp=#0x50000000be2' 2024-08-31T04:30:54.132 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14474 fp=#0x50000000bd5' 2024-08-31T04:30:54.132 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14506 fp=#0x50000000bb2' 2024-08-31T04:30:54.132 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14538 fp=#0x50000000b98' 2024-08-31T04:30:54.133 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14570 fp=#0x50000001b85' 2024-08-31T04:30:54.133 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14602 fp=#0x50000001b77' 2024-08-31T04:30:54.133 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14634 fp=#0x50000001b1d' 2024-08-31T04:30:54.134 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14666 fp=#0x50000001b89' 2024-08-31T04:30:54.134 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14698 fp=#0x50000001b58' 2024-08-31T04:30:54.134 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14730 fp=#0x500000014e7' 2024-08-31T04:30:54.135 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14762 fp=#0x500000014d4' 2024-08-31T04:30:54.135 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14794 fp=#0x500000014c5' 2024-08-31T04:30:54.135 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14826 fp=#0x500000014d1' 2024-08-31T04:30:54.136 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14858 fp=#0x50000001d67' 2024-08-31T04:30:54.136 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14890 fp=#0x50000001d72' 2024-08-31T04:30:54.136 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14922 fp=#0x5000000187d' 2024-08-31T04:30:54.137 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14954 fp=#0x50000001afa' 2024-08-31T04:30:54.137 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14986 fp=#0x50000001d74' 2024-08-31T04:30:54.138 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15178 fp=#0x50000001a7f' 2024-08-31T04:30:54.139 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15210 fp=#0x50000000fd0' 2024-08-31T04:30:54.139 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15242 fp=#0x50000001007' 2024-08-31T04:30:54.139 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15274 fp=#0x50000001516' 2024-08-31T04:30:54.140 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15306 fp=#0x50000001505' 2024-08-31T04:30:54.140 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15338 fp=#0x5000000153b' 2024-08-31T04:30:54.140 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15370 fp=#0x50000001508' 2024-08-31T04:30:54.141 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15402 fp=#0x500000010f0' 2024-08-31T04:30:54.141 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15434 fp=#0x50000001112' 2024-08-31T04:30:54.141 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15466 fp=#0x50000001090' 2024-08-31T04:30:54.144 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15754 fp=#0x50000001bec' 2024-08-31T04:30:54.145 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15882 fp=#0x50000001731' 2024-08-31T04:30:54.145 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15914 fp=#0x50000001736' 2024-08-31T04:30:54.145 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15946 fp=#0x50000001716' 2024-08-31T04:30:54.147 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16138 fp=#0x500000012bb' 2024-08-31T04:30:54.150 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16522 fp=#0x500000009e5' 2024-08-31T04:30:54.150 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16554 fp=#0x500000009e7' 2024-08-31T04:30:54.151 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16586 fp=#0x50000001767' 2024-08-31T04:30:54.151 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16618 fp=#0x50000001761' 2024-08-31T04:30:54.151 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16682 fp=#0x50000001a7c' 2024-08-31T04:30:54.152 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16778 fp=#0x50000001cfe' 2024-08-31T04:30:54.153 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16842 fp=#0x50000001bb0' 2024-08-31T04:30:54.153 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16874 fp=#0x50000000b52' 2024-08-31T04:30:54.153 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16906 fp=#0x50000000a3d' 2024-08-31T04:30:54.154 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16938 fp=#0x50000000a5a' 2024-08-31T04:30:54.154 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16970 fp=#0x5000000155b' 2024-08-31T04:30:54.154 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17002 fp=#0x50000001690' 2024-08-31T04:30:54.154 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17034 fp=#0x500000015d8' 2024-08-31T04:30:54.155 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17066 fp=#0x500000015d9' 2024-08-31T04:30:54.155 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17098 fp=#0x500000015b6' 2024-08-31T04:30:54.156 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17226 fp=#0x500000015e9' 2024-08-31T04:30:54.157 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17258 fp=#0x5000000156e' 2024-08-31T04:30:54.157 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17290 fp=#0x50000001604' 2024-08-31T04:30:54.157 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17322 fp=#0x50000001566' 2024-08-31T04:30:54.158 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17354 fp=#0x100000037e1' 2024-08-31T04:30:54.158 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17386 fp=#0x1000000375d' 2024-08-31T04:30:54.158 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17418 fp=#0x100000036b1' 2024-08-31T04:30:54.159 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17450 fp=#0x100000037de' 2024-08-31T04:30:54.159 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17482 fp=#0x100000036ae' 2024-08-31T04:30:54.160 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17546 fp=#0x50000001232' 2024-08-31T04:30:54.160 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17610 fp=#0x50000001253' 2024-08-31T04:30:54.161 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17706 fp=#0x500000018b6' 2024-08-31T04:30:54.163 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17898 fp=#0x50000001619' 2024-08-31T04:30:54.163 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17930 fp=#0x50000000a04' 2024-08-31T04:30:54.163 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17962 fp=#0x50000001636' 2024-08-31T04:30:54.164 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17994 fp=#0x5000000162d' 2024-08-31T04:30:54.164 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18026 fp=#0x500000008fc' 2024-08-31T04:30:54.164 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18058 fp=#0x50000001a78' 2024-08-31T04:30:54.165 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18090 fp=#0x50000001a92' 2024-08-31T04:30:54.165 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18186 fp=#0x50000001a53' 2024-08-31T04:30:54.166 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18218 fp=#0x50000001a42' 2024-08-31T04:30:54.166 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18282 fp=#0x50000000dfe' 2024-08-31T04:30:54.166 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18314 fp=#0x50000000e48' 2024-08-31T04:30:54.167 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18442 fp=#0x50000000e6b' 2024-08-31T04:30:54.168 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18538 fp=#0x50000000ec9' 2024-08-31T04:30:54.168 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18570 fp=#0x50000000aaa' 2024-08-31T04:30:54.169 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18666 fp=#0x50000000d09' 2024-08-31T04:30:54.170 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18698 fp=#0x50000000cee' 2024-08-31T04:30:54.170 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18730 fp=#0x50000000d70' 2024-08-31T04:30:54.170 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18762 fp=#0x50000000d02' 2024-08-31T04:30:54.171 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18794 fp=#0x50000000cf0' 2024-08-31T04:30:54.171 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18826 fp=#0x500000011d0' 2024-08-31T04:30:54.171 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18858 fp=#0x50000000e00' 2024-08-31T04:30:54.172 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18890 fp=#0x50000000e05' 2024-08-31T04:30:54.172 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18922 fp=#0x50000000d9c' 2024-08-31T04:30:54.172 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18954 fp=#0x50000000dbf' 2024-08-31T04:30:54.172 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18986 fp=#0x50000000db2' 2024-08-31T04:30:54.173 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19018 fp=#0x50000000dae' 2024-08-31T04:30:54.174 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19146 fp=#0x5000000183e' 2024-08-31T04:30:54.174 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19178 fp=#0x500000017ac' 2024-08-31T04:30:54.175 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19274 fp=#0x500000017a4' 2024-08-31T04:30:54.176 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19338 fp=#0x50000001c2d' 2024-08-31T04:30:54.176 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19370 fp=#0x50000001c34' 2024-08-31T04:30:54.176 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19402 fp=#0x50000001837' 2024-08-31T04:30:54.177 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19434 fp=#0x50000001835' 2024-08-31T04:30:54.177 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19466 fp=#0x50000001916' 2024-08-31T04:30:54.177 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19498 fp=#0x5000000195d' 2024-08-31T04:30:54.178 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19530 fp=#0x500000019a5' 2024-08-31T04:30:54.178 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19562 fp=#0x50000001a12' 2024-08-31T04:30:54.178 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19594 fp=#0x500000019f7' 2024-08-31T04:30:54.178 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19626 fp=#0x10000003e42' 2024-08-31T04:30:54.179 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19658 fp=#0x500000011c2' 2024-08-31T04:30:54.179 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19722 fp=#0x10000003e99' 2024-08-31T04:30:54.180 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19754 fp=#0x10000003e5a' 2024-08-31T04:30:54.180 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19786 fp=#0x50000000975' 2024-08-31T04:30:54.180 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19818 fp=#0x50000001158' 2024-08-31T04:30:54.181 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19850 fp=#0x50000001138' 2024-08-31T04:30:54.181 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19882 fp=#0x50000001152' 2024-08-31T04:30:54.181 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19914 fp=#0x50000001141' 2024-08-31T04:30:54.181 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19946 fp=#0x50000001ca6' 2024-08-31T04:30:54.182 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19978 fp=#0x50000001c9a' 2024-08-31T04:30:54.182 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20010 fp=#0x50000001ce1' 2024-08-31T04:30:54.183 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20042 fp=#0x50000001caf' 2024-08-31T04:30:54.183 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20074 fp=#0x50000000f9e' 2024-08-31T04:30:54.183 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20106 fp=#0x50000001025' 2024-08-31T04:30:54.183 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20138 fp=#0x500000010b3' 2024-08-31T04:30:54.184 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20170 fp=#0x50000001cd2' 2024-08-31T04:30:54.184 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20202 fp=#0x5000000107b' 2024-08-31T04:30:54.185 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20234 fp=#0x50000001074' 2024-08-31T04:30:54.185 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20266 fp=#0x50000001c78' 2024-08-31T04:30:54.185 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20330 fp=#0x200000003b8' 2024-08-31T04:30:54.186 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20362 fp=#0x10000000ea8' 2024-08-31T04:30:54.186 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20394 fp=#0x200000002d1' 2024-08-31T04:30:54.186 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20426 fp=#0x10000000e4a' 2024-08-31T04:30:54.187 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20458 fp=#0x10000000dea' 2024-08-31T04:30:54.187 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20522 fp=#0x500000018e9' 2024-08-31T04:30:54.188 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20554 fp=#0x100000032dc' 2024-08-31T04:30:54.188 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20586 fp=#0x50000001913' 2024-08-31T04:30:54.188 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20618 fp=#0x1000000322e' 2024-08-31T04:30:54.189 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20650 fp=#0x500000018e8' 2024-08-31T04:30:54.189 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20682 fp=#0x500000018d4' 2024-08-31T04:30:54.189 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20714 fp=#0x50000001949' 2024-08-31T04:30:54.190 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20746 fp=#0x10000002ace' 2024-08-31T04:30:54.190 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20778 fp=#0x10000002ab8' 2024-08-31T04:30:54.190 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20810 fp=#0x200000011f1' 2024-08-31T04:30:54.191 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20842 fp=#0x10000002aed' 2024-08-31T04:30:54.191 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20874 fp=#0x10000002b2b' 2024-08-31T04:30:54.191 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20906 fp=#0x10000002af7' 2024-08-31T04:30:54.192 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20938 fp=#0x2000000032f' 2024-08-31T04:30:54.192 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20970 fp=#0x20000000337' 2024-08-31T04:30:54.193 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:21034 fp=#0x10000001b03' 2024-08-31T04:30:54.193 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:21066 fp=#0x10000001bba' 2024-08-31T04:30:54.193 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:21098 fp=#0x10000001e4c' 2024-08-31T04:30:54.194 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:21130 fp=#0x10000001f03' 2024-08-31T04:30:54.194 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:21162 fp=#0x30000000668' 2024-08-31T04:30:54.194 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:21194 fp=#0x10000001e48' 2024-08-31T04:30:54.195 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:21226 fp=#0x10000001e7e' 2024-08-31T04:30:54.195 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:21258 fp=#0x10000001e7a' 2024-08-31T04:30:54.195 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:21290 fp=#0x50000001c28' 2024-08-31T04:30:54.197 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:10188 fp=#0x50000000e03' 2024-08-31T04:30:54.197 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:10220 fp=#0x50000000ce3' 2024-08-31T04:30:54.219 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13068 fp=#0x30000002acc' 2024-08-31T04:30:54.219 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13164 fp=#0x5000000189e' 2024-08-31T04:30:54.221 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13292 fp=#0x30000001ae5' 2024-08-31T04:30:54.221 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13324 fp=#0x30000002b55' 2024-08-31T04:30:54.221 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13356 fp=#0x30000001ad5' 2024-08-31T04:30:54.222 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13388 fp=#0x30000001a92' 2024-08-31T04:30:54.222 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13420 fp=#0x3000000276d' 2024-08-31T04:30:54.222 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13452 fp=#0x30000002756' 2024-08-31T04:30:54.222 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13484 fp=#0x3000000277f' 2024-08-31T04:30:54.224 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13612 fp=#0x50000000f66' 2024-08-31T04:30:54.227 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14059 fp=#0x50000000c36' 2024-08-31T04:30:54.227 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14091 fp=#0x50000000caf' 2024-08-31T04:30:54.228 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14123 fp=#0x50000000c67' 2024-08-31T04:30:54.228 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14155 fp=#0x50000000c94' 2024-08-31T04:30:54.228 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14187 fp=#0x50000000c4f' 2024-08-31T04:30:54.229 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14219 fp=#0x50000000c1e' 2024-08-31T04:30:54.230 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14379 fp=#0x10000003afe' 2024-08-31T04:30:54.230 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14411 fp=#0x50000000bd3' 2024-08-31T04:30:54.231 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14443 fp=#0x50000000b74' 2024-08-31T04:30:54.231 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14475 fp=#0x50000000be5' 2024-08-31T04:30:54.231 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14507 fp=#0x50000000b8c' 2024-08-31T04:30:54.232 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14539 fp=#0x50000000bed' 2024-08-31T04:30:54.232 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14571 fp=#0x50000001b1f' 2024-08-31T04:30:54.232 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14603 fp=#0x50000001b5f' 2024-08-31T04:30:54.233 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14635 fp=#0x50000001b37' 2024-08-31T04:30:54.233 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14667 fp=#0x50000001b60' 2024-08-31T04:30:54.233 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14699 fp=#0x50000001b76' 2024-08-31T04:30:54.234 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14731 fp=#0x500000014f1' 2024-08-31T04:30:54.234 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14763 fp=#0x5000000147b' 2024-08-31T04:30:54.234 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14795 fp=#0x500000014e5' 2024-08-31T04:30:54.235 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14827 fp=#0x5000000146b' 2024-08-31T04:30:54.235 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14859 fp=#0x50000000e77' 2024-08-31T04:30:54.235 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14891 fp=#0x50000001856' 2024-08-31T04:30:54.235 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14923 fp=#0x50000001860' 2024-08-31T04:30:54.236 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14955 fp=#0x5000000187a' 2024-08-31T04:30:54.236 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14987 fp=#0x50000001868' 2024-08-31T04:30:54.238 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15179 fp=#0x50000001a94' 2024-08-31T04:30:54.238 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15211 fp=#0x50000000fd5' 2024-08-31T04:30:54.238 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15243 fp=#0x50000000ff1' 2024-08-31T04:30:54.239 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15275 fp=#0x50000001507' 2024-08-31T04:30:54.239 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15307 fp=#0x50000001531' 2024-08-31T04:30:54.239 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15339 fp=#0x50000001520' 2024-08-31T04:30:54.240 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15371 fp=#0x5000000152a' 2024-08-31T04:30:54.240 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15403 fp=#0x50000001104' 2024-08-31T04:30:54.240 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15435 fp=#0x500000010d7' 2024-08-31T04:30:54.241 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15467 fp=#0x500000010f1' 2024-08-31T04:30:54.243 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15787 fp=#0x50000001bef' 2024-08-31T04:30:54.244 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15883 fp=#0x500000016e4' 2024-08-31T04:30:54.244 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15915 fp=#0x50000001710' 2024-08-31T04:30:54.244 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15947 fp=#0x50000001726' 2024-08-31T04:30:54.248 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16523 fp=#0x500000009ec' 2024-08-31T04:30:54.249 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16555 fp=#0x500000009cf' 2024-08-31T04:30:54.249 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16587 fp=#0x5000000176e' 2024-08-31T04:30:54.250 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16619 fp=#0x50000001756' 2024-08-31T04:30:54.250 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16651 fp=#0x50000001d19' 2024-08-31T04:30:54.251 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16715 fp=#0x50000001cfb' 2024-08-31T04:30:54.251 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16779 fp=#0x50000001d06' 2024-08-31T04:30:54.252 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16843 fp=#0x50000001bc8' 2024-08-31T04:30:54.252 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16875 fp=#0x500000016df' 2024-08-31T04:30:54.252 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16907 fp=#0x50000000a72' 2024-08-31T04:30:54.253 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16939 fp=#0x50000000a86' 2024-08-31T04:30:54.253 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16971 fp=#0x5000000160b' 2024-08-31T04:30:54.253 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17003 fp=#0x50000001660' 2024-08-31T04:30:54.253 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17035 fp=#0x5000000159f' 2024-08-31T04:30:54.254 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17067 fp=#0x500000015b2' 2024-08-31T04:30:54.254 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17099 fp=#0x500000015c2' 2024-08-31T04:30:54.255 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17227 fp=#0x5000000162b' 2024-08-31T04:30:54.255 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17259 fp=#0x5000000157c' 2024-08-31T04:30:54.256 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17291 fp=#0x50000001571' 2024-08-31T04:30:54.256 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17323 fp=#0x50000001599' 2024-08-31T04:30:54.256 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17355 fp=#0x100000037f5' 2024-08-31T04:30:54.257 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17387 fp=#0x10000003650' 2024-08-31T04:30:54.257 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17419 fp=#0x100000036a4' 2024-08-31T04:30:54.257 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17451 fp=#0x100000036f2' 2024-08-31T04:30:54.258 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17515 fp=#0x500000012ea' 2024-08-31T04:30:54.258 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17579 fp=#0x500000012a5' 2024-08-31T04:30:54.259 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17611 fp=#0x50000001275' 2024-08-31T04:30:54.260 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17803 fp=#0x1000000228c' 2024-08-31T04:30:54.261 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17931 fp=#0x5000000168d' 2024-08-31T04:30:54.261 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17963 fp=#0x50000000a07' 2024-08-31T04:30:54.262 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18027 fp=#0x50000001a60' 2024-08-31T04:30:54.262 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18059 fp=#0x50000001a76' 2024-08-31T04:30:54.263 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18091 fp=#0x50000001a3e' 2024-08-31T04:30:54.263 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18187 fp=#0x500000008e0' 2024-08-31T04:30:54.264 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18219 fp=#0x50000001a4d' 2024-08-31T04:30:54.264 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18251 fp=#0x5000000091c' 2024-08-31T04:30:54.265 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18347 fp=#0x500000016bf' 2024-08-31T04:30:54.265 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18379 fp=#0x50000000e63' 2024-08-31T04:30:54.266 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18443 fp=#0x50000000e1c' 2024-08-31T04:30:54.266 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18475 fp=#0x50000000e3b' 2024-08-31T04:30:54.266 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18507 fp=#0x50000000ac1' 2024-08-31T04:30:54.267 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18539 fp=#0x100000003c8' 2024-08-31T04:30:54.267 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18571 fp=#0x50000000ee3' 2024-08-31T04:30:54.267 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18603 fp=#0x50000000acb' 2024-08-31T04:30:54.268 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18635 fp=#0x100000003cb' 2024-08-31T04:30:54.268 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18667 fp=#0x50000000d05' 2024-08-31T04:30:54.268 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18699 fp=#0x50000000d4a' 2024-08-31T04:30:54.269 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18731 fp=#0x50000000d35' 2024-08-31T04:30:54.269 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18763 fp=#0x50000000d2e' 2024-08-31T04:30:54.269 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18795 fp=#0x50000000d6b' 2024-08-31T04:30:54.270 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18827 fp=#0x50000000d99' 2024-08-31T04:30:54.270 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18859 fp=#0x50000000e18' 2024-08-31T04:30:54.270 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18891 fp=#0x50000000de5' 2024-08-31T04:30:54.271 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18923 fp=#0x50000000f28' 2024-08-31T04:30:54.271 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18955 fp=#0x500000019aa' 2024-08-31T04:30:54.271 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18987 fp=#0x50000000f0e' 2024-08-31T04:30:54.272 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19019 fp=#0x50000000db1' 2024-08-31T04:30:54.274 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19339 fp=#0x50000001c31' 2024-08-31T04:30:54.274 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19371 fp=#0x50000001c69' 2024-08-31T04:30:54.275 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19403 fp=#0x50000001825' 2024-08-31T04:30:54.275 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19435 fp=#0x50000001c62' 2024-08-31T04:30:54.275 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19467 fp=#0x50000001a14' 2024-08-31T04:30:54.276 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19499 fp=#0x50000001979' 2024-08-31T04:30:54.276 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19531 fp=#0x5000000198b' 2024-08-31T04:30:54.276 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19563 fp=#0x500000019ed' 2024-08-31T04:30:54.277 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19595 fp=#0x500000019e1' 2024-08-31T04:30:54.277 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19627 fp=#0x10000003df7' 2024-08-31T04:30:54.278 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19723 fp=#0x10000003e29' 2024-08-31T04:30:54.278 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19787 fp=#0x5000000096a' 2024-08-31T04:30:54.279 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19819 fp=#0x50000001179' 2024-08-31T04:30:54.279 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19851 fp=#0x5000000112f' 2024-08-31T04:30:54.279 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19883 fp=#0x5000000111f' 2024-08-31T04:30:54.280 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19915 fp=#0x5000000114c' 2024-08-31T04:30:54.280 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19947 fp=#0x50000000fb5' 2024-08-31T04:30:54.280 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19979 fp=#0x50000001ca8' 2024-08-31T04:30:54.281 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20011 fp=#0x50000000f75' 2024-08-31T04:30:54.281 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20043 fp=#0x50000000f83' 2024-08-31T04:30:54.281 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20075 fp=#0x50000001c9b' 2024-08-31T04:30:54.282 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20107 fp=#0x5000000105d' 2024-08-31T04:30:54.282 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20139 fp=#0x5000000108b' 2024-08-31T04:30:54.282 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20171 fp=#0x50000001035' 2024-08-31T04:30:54.282 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20203 fp=#0x50000001066' 2024-08-31T04:30:54.283 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20235 fp=#0x500000012c7' 2024-08-31T04:30:54.283 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20267 fp=#0x50000001c75' 2024-08-31T04:30:54.283 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20299 fp=#0x10000000feb' 2024-08-31T04:30:54.284 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20331 fp=#0x10000000f74' 2024-08-31T04:30:54.284 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20363 fp=#0x200000002e6' 2024-08-31T04:30:54.284 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20395 fp=#0x10000001009' 2024-08-31T04:30:54.285 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20427 fp=#0x10000000de2' 2024-08-31T04:30:54.285 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20459 fp=#0x10000000f7c' 2024-08-31T04:30:54.285 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20491 fp=#0x100000031de' 2024-08-31T04:30:54.286 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20523 fp=#0x10000003186' 2024-08-31T04:30:54.286 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20555 fp=#0x100000031d5' 2024-08-31T04:30:54.286 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20587 fp=#0x10000003274' 2024-08-31T04:30:54.287 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20619 fp=#0x1000000320a' 2024-08-31T04:30:54.287 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20651 fp=#0x100000031f3' 2024-08-31T04:30:54.287 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20683 fp=#0x50000001903' 2024-08-31T04:30:54.288 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20715 fp=#0x1000000317e' 2024-08-31T04:30:54.288 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20747 fp=#0x10000002b2f' 2024-08-31T04:30:54.288 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20779 fp=#0x10000002ab4' 2024-08-31T04:30:54.289 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20811 fp=#0x10000002b3d' 2024-08-31T04:30:54.289 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20843 fp=#0x200000011e2' 2024-08-31T04:30:54.289 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20875 fp=#0x200000011ee' 2024-08-31T04:30:54.290 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20907 fp=#0x200000011d1' 2024-08-31T04:30:54.290 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20939 fp=#0x10000002ad7' 2024-08-31T04:30:54.290 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20971 fp=#0x10000002ad8' 2024-08-31T04:30:54.291 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:21003 fp=#0x10000001ada' 2024-08-31T04:30:54.291 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:21035 fp=#0x10000001bd8' 2024-08-31T04:30:54.291 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:21067 fp=#0x10000001a6b' 2024-08-31T04:30:54.292 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:21099 fp=#0x50000001bac' 2024-08-31T04:30:54.292 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:21131 fp=#0x3000000069f' 2024-08-31T04:30:54.292 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:21163 fp=#0x50000001ba5' 2024-08-31T04:30:54.293 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:21195 fp=#0x3000000069d' 2024-08-31T04:30:54.293 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:21227 fp=#0x50000001ba3' 2024-08-31T04:30:54.294 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:21291 fp=#0x50000001bf0' 2024-08-31T04:30:54.294 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:10029 fp=#0x10000000208' 2024-08-31T04:30:54.295 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:10189 fp=#0x50000000437' 2024-08-31T04:30:54.295 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:10221 fp=#0x500000011c7' 2024-08-31T04:30:54.316 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13069 fp=#0x30000002b02' 2024-08-31T04:30:54.317 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13133 fp=#0x50000001785' 2024-08-31T04:30:54.318 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13197 fp=#0x50000001787' 2024-08-31T04:30:54.318 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13229 fp=#0x400000015bd' 2024-08-31T04:30:54.322 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13293 fp=#0x30000001b06' 2024-08-31T04:30:54.323 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13325 fp=#0x30000001ae3' 2024-08-31T04:30:54.323 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13357 fp=#0x30000002b73' 2024-08-31T04:30:54.323 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13389 fp=#0x30000001aed' 2024-08-31T04:30:54.324 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13421 fp=#0x300000027a2' 2024-08-31T04:30:54.324 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13453 fp=#0x30000002783' 2024-08-31T04:30:54.324 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13485 fp=#0x30000002799' 2024-08-31T04:30:54.326 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13645 fp=#0x3000000227d' 2024-08-31T04:30:54.329 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14156 fp=#0x50000000cc1' 2024-08-31T04:30:54.330 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14188 fp=#0x50000000cbd' 2024-08-31T04:30:54.330 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14220 fp=#0x50000000c44' 2024-08-31T04:30:54.331 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14412 fp=#0x50000000b70' 2024-08-31T04:30:54.332 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14444 fp=#0x50000000c0b' 2024-08-31T04:30:54.332 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14476 fp=#0x50000000c10' 2024-08-31T04:30:54.333 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14508 fp=#0x50000000ba8' 2024-08-31T04:30:54.333 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14540 fp=#0x50000000b81' 2024-08-31T04:30:54.333 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14572 fp=#0x50000001b38' 2024-08-31T04:30:54.334 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14604 fp=#0x50000001b52' 2024-08-31T04:30:54.334 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14636 fp=#0x50000001b1e' 2024-08-31T04:30:54.334 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14668 fp=#0x50000001b69' 2024-08-31T04:30:54.335 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14700 fp=#0x50000001b63' 2024-08-31T04:30:54.335 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14732 fp=#0x500000014c6' 2024-08-31T04:30:54.335 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14764 fp=#0x50000001800' 2024-08-31T04:30:54.336 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14796 fp=#0x5000000148e' 2024-08-31T04:30:54.336 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14828 fp=#0x50000000e90' 2024-08-31T04:30:54.336 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14860 fp=#0x50000001870' 2024-08-31T04:30:54.337 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14892 fp=#0x50000000e4c' 2024-08-31T04:30:54.337 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14924 fp=#0x50000000e0a' 2024-08-31T04:30:54.337 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14956 fp=#0x50000000e83' 2024-08-31T04:30:54.337 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14988 fp=#0x5000000186f' 2024-08-31T04:30:54.339 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15244 fp=#0x50000000fe4' 2024-08-31T04:30:54.340 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15276 fp=#0x5000000153f' 2024-08-31T04:30:54.340 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15308 fp=#0x5000000153c' 2024-08-31T04:30:54.340 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15340 fp=#0x50000001cf2' 2024-08-31T04:30:54.341 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15372 fp=#0x5000000152d' 2024-08-31T04:30:54.341 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15404 fp=#0x5000000109f' 2024-08-31T04:30:54.341 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15436 fp=#0x5000000110a' 2024-08-31T04:30:54.342 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15468 fp=#0x500000010ea' 2024-08-31T04:30:54.344 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15788 fp=#0x50000001c0b' 2024-08-31T04:30:54.345 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15852 fp=#0x50000001bfc' 2024-08-31T04:30:54.345 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15884 fp=#0x5000000171e' 2024-08-31T04:30:54.345 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15916 fp=#0x5000000171b' 2024-08-31T04:30:54.346 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15948 fp=#0x50000001732' 2024-08-31T04:30:54.348 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16204 fp=#0x500000012be' 2024-08-31T04:30:54.348 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16236 fp=#0x500000012b6' 2024-08-31T04:30:54.348 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16268 fp=#0x5000000177c' 2024-08-31T04:30:54.350 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16524 fp=#0x500000009ea' 2024-08-31T04:30:54.351 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16556 fp=#0x500000009de' 2024-08-31T04:30:54.351 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16588 fp=#0x5000000176c' 2024-08-31T04:30:54.351 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16620 fp=#0x5000000174e' 2024-08-31T04:30:54.352 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16716 fp=#0x50000001d18' 2024-08-31T04:30:54.353 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16780 fp=#0x500000016ae' 2024-08-31T04:30:54.353 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16844 fp=#0x50000001bb1' 2024-08-31T04:30:54.354 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16876 fp=#0x50000000b54' 2024-08-31T04:30:54.354 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16908 fp=#0x50000000a81' 2024-08-31T04:30:54.354 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16940 fp=#0x50000000a65' 2024-08-31T04:30:54.355 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16972 fp=#0x50000001692' 2024-08-31T04:30:54.355 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17004 fp=#0x500000015a2' 2024-08-31T04:30:54.355 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17036 fp=#0x50000001d0a' 2024-08-31T04:30:54.356 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17068 fp=#0x500000015ef' 2024-08-31T04:30:54.356 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17100 fp=#0x500000015eb' 2024-08-31T04:30:54.357 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17196 fp=#0x10000003e8c' 2024-08-31T04:30:54.357 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17228 fp=#0x50000001592' 2024-08-31T04:30:54.357 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17260 fp=#0x50000001583' 2024-08-31T04:30:54.358 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17292 fp=#0x50000001569' 2024-08-31T04:30:54.358 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17324 fp=#0x500000015f3' 2024-08-31T04:30:54.358 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17356 fp=#0x1000000369a' 2024-08-31T04:30:54.359 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17388 fp=#0x10000003673' 2024-08-31T04:30:54.359 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17420 fp=#0x1000000364a' 2024-08-31T04:30:54.359 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17452 fp=#0x10000003620' 2024-08-31T04:30:54.360 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17484 fp=#0x100000036da' 2024-08-31T04:30:54.360 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17516 fp=#0x500000012f3' 2024-08-31T04:30:54.360 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17548 fp=#0x50000001243' 2024-08-31T04:30:54.361 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17580 fp=#0x500000012e9' 2024-08-31T04:30:54.361 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17612 fp=#0x5000000129d' 2024-08-31T04:30:54.362 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17644 fp=#0x500000012e4' 2024-08-31T04:30:54.363 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17836 fp=#0x500000012fa' 2024-08-31T04:30:54.364 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17900 fp=#0x500000009fb' 2024-08-31T04:30:54.364 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17964 fp=#0x500000016a6' 2024-08-31T04:30:54.364 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17996 fp=#0x50000001649' 2024-08-31T04:30:54.365 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18028 fp=#0x50000001a3a' 2024-08-31T04:30:54.365 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18092 fp=#0x50000000906' 2024-08-31T04:30:54.367 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18316 fp=#0x50000000e01' 2024-08-31T04:30:54.368 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18348 fp=#0x50000000e78' 2024-08-31T04:30:54.368 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18380 fp=#0x50000000e75' 2024-08-31T04:30:54.368 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18412 fp=#0x500000009c6' 2024-08-31T04:30:54.369 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18444 fp=#0x50000000e33' 2024-08-31T04:30:54.369 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18476 fp=#0x50000000c13' 2024-08-31T04:30:54.369 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18508 fp=#0x50000000ac4' 2024-08-31T04:30:54.369 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18540 fp=#0x50000000abb' 2024-08-31T04:30:54.370 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18572 fp=#0x10000000458' 2024-08-31T04:30:54.370 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18604 fp=#0x100000003e3' 2024-08-31T04:30:54.370 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18636 fp=#0x100000003ec' 2024-08-31T04:30:54.371 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18668 fp=#0x50000000ced' 2024-08-31T04:30:54.371 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18700 fp=#0x50000000ce6' 2024-08-31T04:30:54.371 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18732 fp=#0x50000000d2d' 2024-08-31T04:30:54.372 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18764 fp=#0x50000000d19' 2024-08-31T04:30:54.372 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18796 fp=#0x50000000ce5' 2024-08-31T04:30:54.372 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18828 fp=#0x50000000dfb' 2024-08-31T04:30:54.373 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18860 fp=#0x500000019ca' 2024-08-31T04:30:54.373 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18892 fp=#0x50000000db5' 2024-08-31T04:30:54.373 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18924 fp=#0x50000000f18' 2024-08-31T04:30:54.374 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18956 fp=#0x50000000f15' 2024-08-31T04:30:54.374 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18988 fp=#0x50000000f1e' 2024-08-31T04:30:54.374 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19020 fp=#0x50000000dcb' 2024-08-31T04:30:54.375 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19084 fp=#0x500000017c7' 2024-08-31T04:30:54.375 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19116 fp=#0x500000017bb' 2024-08-31T04:30:54.376 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19148 fp=#0x500000017dd' 2024-08-31T04:30:54.376 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19180 fp=#0x500000017af' 2024-08-31T04:30:54.377 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19340 fp=#0x5000000180c' 2024-08-31T04:30:54.378 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19372 fp=#0x50000001c5f' 2024-08-31T04:30:54.378 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19404 fp=#0x5000000183d' 2024-08-31T04:30:54.378 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19436 fp=#0x50000001c38' 2024-08-31T04:30:54.379 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19468 fp=#0x50000001a1f' 2024-08-31T04:30:54.379 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19500 fp=#0x50000001967' 2024-08-31T04:30:54.379 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19532 fp=#0x50000001959' 2024-08-31T04:30:54.380 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19564 fp=#0x50000001948' 2024-08-31T04:30:54.380 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19596 fp=#0x500000019a9' 2024-08-31T04:30:54.381 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19660 fp=#0x10000003dd4' 2024-08-31T04:30:54.381 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19724 fp=#0x10000003e7b' 2024-08-31T04:30:54.381 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19756 fp=#0x10000003de5' 2024-08-31T04:30:54.382 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19788 fp=#0x500000016bd' 2024-08-31T04:30:54.382 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19820 fp=#0x50000001139' 2024-08-31T04:30:54.382 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19852 fp=#0x50000001140' 2024-08-31T04:30:54.383 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19884 fp=#0x5000000111e' 2024-08-31T04:30:54.383 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19916 fp=#0x50000001159' 2024-08-31T04:30:54.383 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19948 fp=#0x50000001c8e' 2024-08-31T04:30:54.384 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19980 fp=#0x50000000f9c' 2024-08-31T04:30:54.384 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20012 fp=#0x50000000f7c' 2024-08-31T04:30:54.384 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20044 fp=#0x50000000f82' 2024-08-31T04:30:54.385 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20076 fp=#0x50000001cce' 2024-08-31T04:30:54.385 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20108 fp=#0x500000012c2' 2024-08-31T04:30:54.385 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20140 fp=#0x50000001069' 2024-08-31T04:30:54.386 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20172 fp=#0x5000000103a' 2024-08-31T04:30:54.386 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20204 fp=#0x500000010c9' 2024-08-31T04:30:54.386 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20236 fp=#0x5000000102d' 2024-08-31T04:30:54.387 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20268 fp=#0x50000001c89' 2024-08-31T04:30:54.387 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20300 fp=#0x200000002ee' 2024-08-31T04:30:54.388 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20364 fp=#0x200000002de' 2024-08-31T04:30:54.388 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20396 fp=#0x20000001084' 2024-08-31T04:30:54.388 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20428 fp=#0x200000003ae' 2024-08-31T04:30:54.389 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20460 fp=#0x20000000328' 2024-08-31T04:30:54.389 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20492 fp=#0x2000000036a' 2024-08-31T04:30:54.389 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20524 fp=#0x500000018ec' 2024-08-31T04:30:54.389 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20556 fp=#0x500000018d0' 2024-08-31T04:30:54.390 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20588 fp=#0x500000018d7' 2024-08-31T04:30:54.390 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20620 fp=#0x100000031d0' 2024-08-31T04:30:54.391 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20652 fp=#0x500000018d6' 2024-08-31T04:30:54.391 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20684 fp=#0x5000000190b' 2024-08-31T04:30:54.391 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20716 fp=#0x100000032f7' 2024-08-31T04:30:54.392 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20748 fp=#0x2000000034d' 2024-08-31T04:30:54.392 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20780 fp=#0x200000011e8' 2024-08-31T04:30:54.392 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20812 fp=#0x20000001174' 2024-08-31T04:30:54.393 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20844 fp=#0x2000000124e' 2024-08-31T04:30:54.393 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20876 fp=#0x10000002b59' 2024-08-31T04:30:54.393 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20908 fp=#0x10000002b4f' 2024-08-31T04:30:54.394 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20940 fp=#0x10000002ab5' 2024-08-31T04:30:54.394 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20972 fp=#0x10000002ba9' 2024-08-31T04:30:54.394 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:21004 fp=#0x10000001b4c' 2024-08-31T04:30:54.395 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:21036 fp=#0x10000001ae2' 2024-08-31T04:30:54.395 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:21068 fp=#0x3000000116a' 2024-08-31T04:30:54.395 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:21100 fp=#0x10000001e77' 2024-08-31T04:30:54.396 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:21132 fp=#0x30000000677' 2024-08-31T04:30:54.396 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:21164 fp=#0x10000001e8e' 2024-08-31T04:30:54.396 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:21196 fp=#0x50000001c21' 2024-08-31T04:30:54.397 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:21228 fp=#0x3000000067e' 2024-08-31T04:30:54.397 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:21260 fp=#0x10000001ec5' 2024-08-31T04:30:54.397 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:21292 fp=#0x50000001bd7' 2024-08-31T04:30:54.399 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:10190 fp=#0x50000000fc9' 2024-08-31T04:30:54.399 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:10222 fp=#0x50000000d7b' 2024-08-31T04:30:54.399 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:10254 fp=#0x3000000227c' 2024-08-31T04:30:54.421 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13070 fp=#0x30000002b09' 2024-08-31T04:30:54.421 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13134 fp=#0x40000001631' 2024-08-31T04:30:54.422 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13166 fp=#0x4000000176d' 2024-08-31T04:30:54.422 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13230 fp=#0x5000000178b' 2024-08-31T04:30:54.423 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13294 fp=#0x30000001a4c' 2024-08-31T04:30:54.423 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13326 fp=#0x30000001af7' 2024-08-31T04:30:54.424 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13358 fp=#0x30000002b4c' 2024-08-31T04:30:54.424 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13390 fp=#0x30000001a47' 2024-08-31T04:30:54.424 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13422 fp=#0x300000027a4' 2024-08-31T04:30:54.425 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13454 fp=#0x30000002787' 2024-08-31T04:30:54.425 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13486 fp=#0x30000002758' 2024-08-31T04:30:54.427 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13710 fp=#0x3000000289d' 2024-08-31T04:30:54.429 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14030 fp=#0x50000001aef' 2024-08-31T04:30:54.430 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14061 fp=#0x50000000c4e' 2024-08-31T04:30:54.430 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14093 fp=#0x50000000c26' 2024-08-31T04:30:54.430 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14125 fp=#0x50000000c95' 2024-08-31T04:30:54.431 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14157 fp=#0x50000000c85' 2024-08-31T04:30:54.431 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14189 fp=#0x50000000c93' 2024-08-31T04:30:54.431 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14221 fp=#0x50000000cb0' 2024-08-31T04:30:54.432 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14317 fp=#0x10000003ae5' 2024-08-31T04:30:54.433 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14413 fp=#0x50000000c09' 2024-08-31T04:30:54.433 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14445 fp=#0x50000000bf9' 2024-08-31T04:30:54.433 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14477 fp=#0x50000000bdc' 2024-08-31T04:30:54.434 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14509 fp=#0x50000000c04' 2024-08-31T04:30:54.434 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14541 fp=#0x50000000b69' 2024-08-31T04:30:54.434 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14573 fp=#0x50000001b95' 2024-08-31T04:30:54.435 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14605 fp=#0x50000001b6e' 2024-08-31T04:30:54.435 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14637 fp=#0x50000001b65' 2024-08-31T04:30:54.435 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14669 fp=#0x50000001b4f' 2024-08-31T04:30:54.436 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14701 fp=#0x50000001b10' 2024-08-31T04:30:54.436 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14733 fp=#0x50000001495' 2024-08-31T04:30:54.436 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14765 fp=#0x50000001496' 2024-08-31T04:30:54.437 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14797 fp=#0x500000014cb' 2024-08-31T04:30:54.437 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14829 fp=#0x50000001861' 2024-08-31T04:30:54.437 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14861 fp=#0x50000000e69' 2024-08-31T04:30:54.438 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14893 fp=#0x50000000e76' 2024-08-31T04:30:54.438 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14925 fp=#0x50000000e64' 2024-08-31T04:30:54.438 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14957 fp=#0x5000000185d' 2024-08-31T04:30:54.439 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14989 fp=#0x50000001858' 2024-08-31T04:30:54.440 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15181 fp=#0x50000001008' 2024-08-31T04:30:54.440 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15213 fp=#0x50000001aac' 2024-08-31T04:30:54.441 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15245 fp=#0x50000001a87' 2024-08-31T04:30:54.441 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15277 fp=#0x50000001cf5' 2024-08-31T04:30:54.441 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15309 fp=#0x50000001533' 2024-08-31T04:30:54.442 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15341 fp=#0x50000001543' 2024-08-31T04:30:54.442 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15373 fp=#0x50000001545' 2024-08-31T04:30:54.442 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15405 fp=#0x500000010fd' 2024-08-31T04:30:54.443 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15437 fp=#0x500000010b6' 2024-08-31T04:30:54.445 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15725 fp=#0x50000001c11' 2024-08-31T04:30:54.446 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15853 fp=#0x50000001bbb' 2024-08-31T04:30:54.446 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15885 fp=#0x500000016fb' 2024-08-31T04:30:54.447 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15917 fp=#0x50000001712' 2024-08-31T04:30:54.447 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15949 fp=#0x500000016fe' 2024-08-31T04:30:54.451 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16429 fp=#0x50000001ab0' 2024-08-31T04:30:54.451 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16525 fp=#0x500000009e9' 2024-08-31T04:30:54.452 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16557 fp=#0x500000009d4' 2024-08-31T04:30:54.452 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16589 fp=#0x5000000176b' 2024-08-31T04:30:54.452 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16621 fp=#0x5000000174f' 2024-08-31T04:30:54.453 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16685 fp=#0x50000001a70' 2024-08-31T04:30:54.454 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16781 fp=#0x50000001cff' 2024-08-31T04:30:54.454 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16813 fp=#0x50000001438' 2024-08-31T04:30:54.454 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16845 fp=#0x50000001bcb' 2024-08-31T04:30:54.455 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16877 fp=#0x50000000b4c' 2024-08-31T04:30:54.455 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16909 fp=#0x50000000a67' 2024-08-31T04:30:54.455 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16941 fp=#0x50000000a3b' 2024-08-31T04:30:54.455 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16973 fp=#0x500000015a3' 2024-08-31T04:30:54.456 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17005 fp=#0x500000015b9' 2024-08-31T04:30:54.456 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17037 fp=#0x500000015f0' 2024-08-31T04:30:54.457 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17069 fp=#0x50000001612' 2024-08-31T04:30:54.457 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17101 fp=#0x50000001651' 2024-08-31T04:30:54.457 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17133 fp=#0x10000003efb' 2024-08-31T04:30:54.458 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17229 fp=#0x50000001562' 2024-08-31T04:30:54.458 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17261 fp=#0x500000015c4' 2024-08-31T04:30:54.459 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17293 fp=#0x5000000160e' 2024-08-31T04:30:54.459 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17325 fp=#0x500000015d1' 2024-08-31T04:30:54.459 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17357 fp=#0x1000000362c' 2024-08-31T04:30:54.460 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17389 fp=#0x10000003658' 2024-08-31T04:30:54.460 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17421 fp=#0x100000035c7' 2024-08-31T04:30:54.460 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17453 fp=#0x100000036a7' 2024-08-31T04:30:54.461 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17485 fp=#0x100000036b8' 2024-08-31T04:30:54.462 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17581 fp=#0x5000000127a' 2024-08-31T04:30:54.464 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17837 fp=#0x10000002280' 2024-08-31T04:30:54.464 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17869 fp=#0x500000009f7' 2024-08-31T04:30:54.464 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17901 fp=#0x50000000a0b' 2024-08-31T04:30:54.465 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17933 fp=#0x50000001646' 2024-08-31T04:30:54.465 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17965 fp=#0x500000009fc' 2024-08-31T04:30:54.465 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18029 fp=#0x50000000932' 2024-08-31T04:30:54.466 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18061 fp=#0x50000000923' 2024-08-31T04:30:54.466 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18125 fp=#0x50000001a1d' 2024-08-31T04:30:54.467 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18157 fp=#0x50000001aa0' 2024-08-31T04:30:54.467 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18221 fp=#0x50000001a26' 2024-08-31T04:30:54.468 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18253 fp=#0x5000000090c' 2024-08-31T04:30:54.468 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18285 fp=#0x50000000e93' 2024-08-31T04:30:54.469 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18381 fp=#0x50000000e2c' 2024-08-31T04:30:54.469 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18477 fp=#0x1000000043a' 2024-08-31T04:30:54.470 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18509 fp=#0x100000003a7' 2024-08-31T04:30:54.470 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18541 fp=#0x50000000ab3' 2024-08-31T04:30:54.470 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18573 fp=#0x50000000ac6' 2024-08-31T04:30:54.471 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18605 fp=#0x100000003a5' 2024-08-31T04:30:54.471 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18637 fp=#0x50000000ecf' 2024-08-31T04:30:54.471 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18669 fp=#0x50000000d3e' 2024-08-31T04:30:54.472 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18701 fp=#0x50000000d73' 2024-08-31T04:30:54.472 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18733 fp=#0x50000000d10' 2024-08-31T04:30:54.472 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18765 fp=#0x50000000d33' 2024-08-31T04:30:54.472 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18797 fp=#0x50000000d1b' 2024-08-31T04:30:54.473 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18829 fp=#0x50000000f23' 2024-08-31T04:30:54.473 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18861 fp=#0x50000000dd0' 2024-08-31T04:30:54.473 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18893 fp=#0x50000000f04' 2024-08-31T04:30:54.474 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18925 fp=#0x500000019d9' 2024-08-31T04:30:54.474 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18957 fp=#0x50000000da4' 2024-08-31T04:30:54.474 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18989 fp=#0x50000000f09' 2024-08-31T04:30:54.475 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19021 fp=#0x50000000ddc' 2024-08-31T04:30:54.476 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19181 fp=#0x50000001828' 2024-08-31T04:30:54.476 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19245 fp=#0x500000017f6' 2024-08-31T04:30:54.477 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19277 fp=#0x50000001823' 2024-08-31T04:30:54.477 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19341 fp=#0x50000001c4b' 2024-08-31T04:30:54.478 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19373 fp=#0x500000017d0' 2024-08-31T04:30:54.478 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19405 fp=#0x50000001c37' 2024-08-31T04:30:54.478 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19437 fp=#0x50000001c40' 2024-08-31T04:30:54.479 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19469 fp=#0x50000001987' 2024-08-31T04:30:54.479 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19501 fp=#0x50000001982' 2024-08-31T04:30:54.479 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19533 fp=#0x50000001919' 2024-08-31T04:30:54.480 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19565 fp=#0x5000000198c' 2024-08-31T04:30:54.480 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19597 fp=#0x50000001928' 2024-08-31T04:30:54.481 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19757 fp=#0x10000003e54' 2024-08-31T04:30:54.481 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19789 fp=#0x50000000968' 2024-08-31T04:30:54.482 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19821 fp=#0x5000000116d' 2024-08-31T04:30:54.482 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19853 fp=#0x500000016a5' 2024-08-31T04:30:54.482 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19885 fp=#0x50000001165' 2024-08-31T04:30:54.483 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19917 fp=#0x500000016a7' 2024-08-31T04:30:54.483 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19949 fp=#0x50000000fbe' 2024-08-31T04:30:54.483 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19981 fp=#0x50000000f93' 2024-08-31T04:30:54.484 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20013 fp=#0x50000001cc3' 2024-08-31T04:30:54.484 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20045 fp=#0x50000000fa6' 2024-08-31T04:30:54.484 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20077 fp=#0x50000001cae' 2024-08-31T04:30:54.485 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20109 fp=#0x500000010bc' 2024-08-31T04:30:54.485 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20141 fp=#0x50000001080' 2024-08-31T04:30:54.485 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20173 fp=#0x50000001053' 2024-08-31T04:30:54.486 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20205 fp=#0x5000000107e' 2024-08-31T04:30:54.486 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20237 fp=#0x500000010c2' 2024-08-31T04:30:54.486 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20269 fp=#0x500000011b0' 2024-08-31T04:30:54.486 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20301 fp=#0x20000000495' 2024-08-31T04:30:54.487 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20333 fp=#0x200000002fd' 2024-08-31T04:30:54.487 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20365 fp=#0x200000003eb' 2024-08-31T04:30:54.487 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20397 fp=#0x10000000e02' 2024-08-31T04:30:54.488 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20429 fp=#0x10000000faf' 2024-08-31T04:30:54.488 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20461 fp=#0x10000000df2' 2024-08-31T04:30:54.488 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20493 fp=#0x100000032c1' 2024-08-31T04:30:54.489 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20525 fp=#0x100000031e5' 2024-08-31T04:30:54.489 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20557 fp=#0x500000018de' 2024-08-31T04:30:54.489 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20589 fp=#0x1000000324f' 2024-08-31T04:30:54.490 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20621 fp=#0x50000001909' 2024-08-31T04:30:54.490 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20653 fp=#0x200000013d8' 2024-08-31T04:30:54.490 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20685 fp=#0x50000001904' 2024-08-31T04:30:54.491 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20717 fp=#0x50000001984' 2024-08-31T04:30:54.491 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20749 fp=#0x10000002abb' 2024-08-31T04:30:54.491 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20781 fp=#0x10000002ad3' 2024-08-31T04:30:54.492 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20813 fp=#0x20000001280' 2024-08-31T04:30:54.492 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20845 fp=#0x10000002b1f' 2024-08-31T04:30:54.492 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20877 fp=#0x10000002b5f' 2024-08-31T04:30:54.493 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20909 fp=#0x10000002b25' 2024-08-31T04:30:54.493 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20941 fp=#0x2000000125c' 2024-08-31T04:30:54.493 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20973 fp=#0x200000011bd' 2024-08-31T04:30:54.494 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:21005 fp=#0x10000001b61' 2024-08-31T04:30:54.494 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:21037 fp=#0x10000001a6d' 2024-08-31T04:30:54.494 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:21069 fp=#0x10000001b96' 2024-08-31T04:30:54.495 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:21101 fp=#0x10000001f33' 2024-08-31T04:30:54.495 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:21133 fp=#0x10000001ef1' 2024-08-31T04:30:54.495 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:21165 fp=#0x30000000682' 2024-08-31T04:30:54.496 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:21197 fp=#0x10000001e75' 2024-08-31T04:30:54.496 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:21229 fp=#0x10000001e50' 2024-08-31T04:30:54.496 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:21261 fp=#0x10000001e66' 2024-08-31T04:30:54.496 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:21293 fp=#0x10000001e68' 2024-08-31T04:30:54.498 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:10191 fp=#0x500000014f5' 2024-08-31T04:30:54.498 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:10223 fp=#0x10000003f8c' 2024-08-31T04:30:54.498 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:10255 fp=#0x30000002857' 2024-08-31T04:30:54.519 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13071 fp=#0x30000002b38' 2024-08-31T04:30:54.520 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13167 fp=#0x40000001840' 2024-08-31T04:30:54.521 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13231 fp=#0x50000001796' 2024-08-31T04:30:54.521 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13263 fp=#0x500000018b1' 2024-08-31T04:30:54.521 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13295 fp=#0x30000001aac' 2024-08-31T04:30:54.522 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13327 fp=#0x30000001acc' 2024-08-31T04:30:54.522 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13359 fp=#0x30000001ada' 2024-08-31T04:30:54.522 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13391 fp=#0x30000001a87' 2024-08-31T04:30:54.523 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13423 fp=#0x30000002774' 2024-08-31T04:30:54.523 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13455 fp=#0x30000002750' 2024-08-31T04:30:54.523 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13487 fp=#0x30000002785' 2024-08-31T04:30:54.524 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13551 fp=#0x40000000f83' 2024-08-31T04:30:54.525 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13711 fp=#0x300000028a2' 2024-08-31T04:30:54.527 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14062 fp=#0x50000000cc8' 2024-08-31T04:30:54.528 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14094 fp=#0x50000000ca6' 2024-08-31T04:30:54.528 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14126 fp=#0x50000000cae' 2024-08-31T04:30:54.528 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14158 fp=#0x50000000c64' 2024-08-31T04:30:54.529 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14190 fp=#0x50000000c9c' 2024-08-31T04:30:54.529 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14222 fp=#0x50000000c20' 2024-08-31T04:30:54.530 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14318 fp=#0x10000003b0d' 2024-08-31T04:30:54.530 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14414 fp=#0x50000000c12' 2024-08-31T04:30:54.531 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14446 fp=#0x50000000ba2' 2024-08-31T04:30:54.531 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14478 fp=#0x50000000c08' 2024-08-31T04:30:54.531 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14510 fp=#0x50000000b63' 2024-08-31T04:30:54.532 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14542 fp=#0x50000000b75' 2024-08-31T04:30:54.532 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14574 fp=#0x50000001b75' 2024-08-31T04:30:54.532 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14606 fp=#0x50000001b71' 2024-08-31T04:30:54.533 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14638 fp=#0x50000001b5a' 2024-08-31T04:30:54.533 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14670 fp=#0x50000001b8c' 2024-08-31T04:30:54.533 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14702 fp=#0x50000001b88' 2024-08-31T04:30:54.534 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14734 fp=#0x500000014eb' 2024-08-31T04:30:54.534 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14766 fp=#0x500000014a8' 2024-08-31T04:30:54.534 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14798 fp=#0x500000014b5' 2024-08-31T04:30:54.535 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14830 fp=#0x50000000e88' 2024-08-31T04:30:54.535 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14862 fp=#0x50000000e8a' 2024-08-31T04:30:54.535 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14894 fp=#0x50000001d6d' 2024-08-31T04:30:54.536 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14926 fp=#0x5000000185c' 2024-08-31T04:30:54.536 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14958 fp=#0x50000001d7f' 2024-08-31T04:30:54.536 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14990 fp=#0x50000000e19' 2024-08-31T04:30:54.537 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15150 fp=#0x50000000fcf' 2024-08-31T04:30:54.538 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15182 fp=#0x50000001004' 2024-08-31T04:30:54.538 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15214 fp=#0x50000000fee' 2024-08-31T04:30:54.538 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15246 fp=#0x50000000fe7' 2024-08-31T04:30:54.539 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15278 fp=#0x5000000151e' 2024-08-31T04:30:54.539 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15310 fp=#0x50000001544' 2024-08-31T04:30:54.539 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15342 fp=#0x500000014fd' 2024-08-31T04:30:54.540 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15374 fp=#0x50000001550' 2024-08-31T04:30:54.540 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15406 fp=#0x500000010f4' 2024-08-31T04:30:54.540 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15438 fp=#0x5000000108f' 2024-08-31T04:30:54.540 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15470 fp=#0x50000001101' 2024-08-31T04:30:54.542 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15726 fp=#0x50000001c08' 2024-08-31T04:30:54.543 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15790 fp=#0x50000001c13' 2024-08-31T04:30:54.543 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15822 fp=#0x50000001bdb' 2024-08-31T04:30:54.543 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15854 fp=#0x50000001be0' 2024-08-31T04:30:54.544 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15886 fp=#0x50000001715' 2024-08-31T04:30:54.544 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15918 fp=#0x50000001723' 2024-08-31T04:30:54.544 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15950 fp=#0x5000000172c' 2024-08-31T04:30:54.546 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16206 fp=#0x50000001c1c' 2024-08-31T04:30:54.549 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16526 fp=#0x500000009f2' 2024-08-31T04:30:54.549 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16558 fp=#0x500000009df' 2024-08-31T04:30:54.549 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16590 fp=#0x50000001774' 2024-08-31T04:30:54.550 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16622 fp=#0x50000001765' 2024-08-31T04:30:54.550 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16686 fp=#0x50000001d03' 2024-08-31T04:30:54.551 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16718 fp=#0x50000001d21' 2024-08-31T04:30:54.551 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16750 fp=#0x500000016ca' 2024-08-31T04:30:54.551 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16814 fp=#0x50000001ab9' 2024-08-31T04:30:54.552 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16846 fp=#0x50000001bb8' 2024-08-31T04:30:54.552 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16878 fp=#0x50000000b39' 2024-08-31T04:30:54.552 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16910 fp=#0x50000000a7a' 2024-08-31T04:30:54.553 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16942 fp=#0x50000000a7d' 2024-08-31T04:30:54.553 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16974 fp=#0x5000000168e' 2024-08-31T04:30:54.553 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17006 fp=#0x500000015a4' 2024-08-31T04:30:54.554 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17038 fp=#0x500000015a7' 2024-08-31T04:30:54.554 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17070 fp=#0x50000001597' 2024-08-31T04:30:54.554 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17102 fp=#0x50000001563' 2024-08-31T04:30:54.555 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17230 fp=#0x5000000160f' 2024-08-31T04:30:54.556 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17262 fp=#0x500000015f9' 2024-08-31T04:30:54.556 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17294 fp=#0x500000015bf' 2024-08-31T04:30:54.556 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17358 fp=#0x100000037e9' 2024-08-31T04:30:54.557 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17390 fp=#0x100000035a6' 2024-08-31T04:30:54.557 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17422 fp=#0x100000035ce' 2024-08-31T04:30:54.557 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17454 fp=#0x10000003667' 2024-08-31T04:30:54.557 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17486 fp=#0x100000035ec' 2024-08-31T04:30:54.558 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17518 fp=#0x5000000124a' 2024-08-31T04:30:54.558 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17550 fp=#0x5000000124f' 2024-08-31T04:30:54.558 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17582 fp=#0x50000001251' 2024-08-31T04:30:54.559 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17614 fp=#0x50000001272' 2024-08-31T04:30:54.559 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17646 fp=#0x5000000126e' 2024-08-31T04:30:54.559 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17678 fp=#0x10000002341' 2024-08-31T04:30:54.561 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17902 fp=#0x500000009fa' 2024-08-31T04:30:54.561 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17934 fp=#0x50000001699' 2024-08-31T04:30:54.562 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18030 fp=#0x50000001a22' 2024-08-31T04:30:54.562 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18062 fp=#0x50000001a20' 2024-08-31T04:30:54.563 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18094 fp=#0x5000000091f' 2024-08-31T04:30:54.563 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18126 fp=#0x50000000909' 2024-08-31T04:30:54.563 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18158 fp=#0x50000001a31' 2024-08-31T04:30:54.564 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18190 fp=#0x50000000901' 2024-08-31T04:30:54.564 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18222 fp=#0x50000000916' 2024-08-31T04:30:54.564 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18254 fp=#0x50000001a50' 2024-08-31T04:30:54.565 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18350 fp=#0x50000000df1' 2024-08-31T04:30:54.565 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18414 fp=#0x50000000e3e' 2024-08-31T04:30:54.566 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18446 fp=#0x50000000dc9' 2024-08-31T04:30:54.566 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18478 fp=#0x50000000ac3' 2024-08-31T04:30:54.566 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18510 fp=#0x50000000ecb' 2024-08-31T04:30:54.567 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18542 fp=#0x50000000ee9' 2024-08-31T04:30:54.567 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18574 fp=#0x50000000ee7' 2024-08-31T04:30:54.567 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18606 fp=#0x50000000ece' 2024-08-31T04:30:54.568 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18670 fp=#0x50000000d74' 2024-08-31T04:30:54.568 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18702 fp=#0x50000000d61' 2024-08-31T04:30:54.568 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18734 fp=#0x50000000ce4' 2024-08-31T04:30:54.569 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18766 fp=#0x50000000d40' 2024-08-31T04:30:54.569 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18798 fp=#0x50000000d21' 2024-08-31T04:30:54.569 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18830 fp=#0x50000000df4' 2024-08-31T04:30:54.570 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18862 fp=#0x50000000da9' 2024-08-31T04:30:54.570 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18894 fp=#0x50000000f14' 2024-08-31T04:30:54.570 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18926 fp=#0x50000000d83' 2024-08-31T04:30:54.571 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18958 fp=#0x500000019d7' 2024-08-31T04:30:54.571 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18990 fp=#0x50000000d7c' 2024-08-31T04:30:54.571 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19022 fp=#0x500000019b5' 2024-08-31T04:30:54.572 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19086 fp=#0x500000017ca' 2024-08-31T04:30:54.573 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19278 fp=#0x50000001810' 2024-08-31T04:30:54.574 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19342 fp=#0x50000001c55' 2024-08-31T04:30:54.574 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19374 fp=#0x50000001c3f' 2024-08-31T04:30:54.574 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19406 fp=#0x500000017d9' 2024-08-31T04:30:54.575 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19438 fp=#0x5000000180d' 2024-08-31T04:30:54.575 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19470 fp=#0x50000001994' 2024-08-31T04:30:54.575 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19502 fp=#0x5000000193d' 2024-08-31T04:30:54.575 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19534 fp=#0x500000019a3' 2024-08-31T04:30:54.576 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19566 fp=#0x50000001971' 2024-08-31T04:30:54.576 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19598 fp=#0x50000001a0b' 2024-08-31T04:30:54.576 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19630 fp=#0x10000003e6c' 2024-08-31T04:30:54.577 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19758 fp=#0x10000003e5d' 2024-08-31T04:30:54.578 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19790 fp=#0x50000000980' 2024-08-31T04:30:54.578 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19822 fp=#0x50000001cd0' 2024-08-31T04:30:54.578 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19854 fp=#0x5000000111b' 2024-08-31T04:30:54.579 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19886 fp=#0x50000001142' 2024-08-31T04:30:54.579 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19918 fp=#0x5000000116b' 2024-08-31T04:30:54.579 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19950 fp=#0x50000001ce0' 2024-08-31T04:30:54.579 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19982 fp=#0x50000001c94' 2024-08-31T04:30:54.580 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20014 fp=#0x50000001cdf' 2024-08-31T04:30:54.580 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20046 fp=#0x50000001cb2' 2024-08-31T04:30:54.580 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20078 fp=#0x50000001cb7' 2024-08-31T04:30:54.581 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20110 fp=#0x5000000103c' 2024-08-31T04:30:54.581 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20142 fp=#0x50000001083' 2024-08-31T04:30:54.581 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20174 fp=#0x5000000103b' 2024-08-31T04:30:54.582 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20206 fp=#0x5000000103f' 2024-08-31T04:30:54.582 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20238 fp=#0x50000001022' 2024-08-31T04:30:54.582 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20270 fp=#0x50000001c84' 2024-08-31T04:30:54.582 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20302 fp=#0x10000000e82' 2024-08-31T04:30:54.583 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20334 fp=#0x200000002db' 2024-08-31T04:30:54.583 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20366 fp=#0x10000000ee0' 2024-08-31T04:30:54.583 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20398 fp=#0x200000003a9' 2024-08-31T04:30:54.584 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20430 fp=#0x10000000dfa' 2024-08-31T04:30:54.584 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20462 fp=#0x10000000eb0' 2024-08-31T04:30:54.584 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20494 fp=#0x2000000036c' 2024-08-31T04:30:54.585 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20526 fp=#0x5000000190a' 2024-08-31T04:30:54.585 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20558 fp=#0x100000031ea' 2024-08-31T04:30:54.585 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20590 fp=#0x10000003195' 2024-08-31T04:30:54.585 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20622 fp=#0x50000001912' 2024-08-31T04:30:54.586 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20654 fp=#0x100000031e0' 2024-08-31T04:30:54.586 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20686 fp=#0x500000018cd' 2024-08-31T04:30:54.586 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20750 fp=#0x10000002add' 2024-08-31T04:30:54.587 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20782 fp=#0x20000000330' 2024-08-31T04:30:54.587 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20814 fp=#0x10000002af3' 2024-08-31T04:30:54.587 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20846 fp=#0x2000000126c' 2024-08-31T04:30:54.588 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20878 fp=#0x10000002af5' 2024-08-31T04:30:54.588 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20910 fp=#0x10000002b77' 2024-08-31T04:30:54.588 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20942 fp=#0x20000001232' 2024-08-31T04:30:54.589 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20974 fp=#0x10000001bd2' 2024-08-31T04:30:54.589 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:21006 fp=#0x10000001a32' 2024-08-31T04:30:54.589 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:21038 fp=#0x10000001a7e' 2024-08-31T04:30:54.590 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:21070 fp=#0x10000001ab6' 2024-08-31T04:30:54.590 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:21102 fp=#0x10000001ef5' 2024-08-31T04:30:54.590 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:21134 fp=#0x10000001f19' 2024-08-31T04:30:54.591 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:21166 fp=#0x3000000067a' 2024-08-31T04:30:54.591 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:21198 fp=#0x50000001c30' 2024-08-31T04:30:54.591 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:21230 fp=#0x50000001c36' 2024-08-31T04:30:54.592 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:21262 fp=#0x50000001baa' 2024-08-31T04:30:54.592 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:21294 fp=#0x10000001f05' 2024-08-31T04:30:54.592 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:10032 fp=#0x10000000399' 2024-08-31T04:30:54.593 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:10192 fp=#0x5000000108c' 2024-08-31T04:30:54.594 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:10224 fp=#0x500000017cf' 2024-08-31T04:30:54.621 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13072 fp=#0x30000002b3e' 2024-08-31T04:30:54.621 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13104 fp=#0x50000001741' 2024-08-31T04:30:54.622 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13232 fp=#0x5000000178c' 2024-08-31T04:30:54.623 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13264 fp=#0x5000000189f' 2024-08-31T04:30:54.623 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13296 fp=#0x30000001afa' 2024-08-31T04:30:54.623 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13328 fp=#0x30000001af0' 2024-08-31T04:30:54.624 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13360 fp=#0x30000002b4f' 2024-08-31T04:30:54.624 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13392 fp=#0x30000001a93' 2024-08-31T04:30:54.624 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13424 fp=#0x30000002796' 2024-08-31T04:30:54.625 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13456 fp=#0x3000000275d' 2024-08-31T04:30:54.625 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13488 fp=#0x3000000276f' 2024-08-31T04:30:54.626 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13552 fp=#0x40000000fe1' 2024-08-31T04:30:54.626 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13648 fp=#0x30000002375' 2024-08-31T04:30:54.629 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14063 fp=#0x50000000ca8' 2024-08-31T04:30:54.630 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14095 fp=#0x50000000cbb' 2024-08-31T04:30:54.630 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14127 fp=#0x50000000c31' 2024-08-31T04:30:54.630 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14159 fp=#0x50000000c47' 2024-08-31T04:30:54.631 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14191 fp=#0x50000000c5f' 2024-08-31T04:30:54.631 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14223 fp=#0x50000000c42' 2024-08-31T04:30:54.633 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14415 fp=#0x50000000bb9' 2024-08-31T04:30:54.633 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14447 fp=#0x50000000bad' 2024-08-31T04:30:54.633 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14479 fp=#0x50000000bcd' 2024-08-31T04:30:54.634 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14511 fp=#0x50000000bdb' 2024-08-31T04:30:54.634 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14543 fp=#0x50000000b9d' 2024-08-31T04:30:54.634 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14575 fp=#0x50000001b97' 2024-08-31T04:30:54.635 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14607 fp=#0x50000001b1b' 2024-08-31T04:30:54.635 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14639 fp=#0x50000001b6a' 2024-08-31T04:30:54.635 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14671 fp=#0x50000001b6c' 2024-08-31T04:30:54.636 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14703 fp=#0x50000001b02' 2024-08-31T04:30:54.636 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14735 fp=#0x50000001468' 2024-08-31T04:30:54.636 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14767 fp=#0x500000014ec' 2024-08-31T04:30:54.637 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14799 fp=#0x5000000149d' 2024-08-31T04:30:54.637 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14831 fp=#0x50000000e22' 2024-08-31T04:30:54.637 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14863 fp=#0x50000000e3a' 2024-08-31T04:30:54.638 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14895 fp=#0x50000001d6a' 2024-08-31T04:30:54.638 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14927 fp=#0x50000000e1b' 2024-08-31T04:30:54.638 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14959 fp=#0x5000000121f' 2024-08-31T04:30:54.639 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14991 fp=#0x50000000e23' 2024-08-31T04:30:54.640 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15151 fp=#0x5000000100e' 2024-08-31T04:30:54.640 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15183 fp=#0x50000001a9c' 2024-08-31T04:30:54.640 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15215 fp=#0x50000001ac2' 2024-08-31T04:30:54.641 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15247 fp=#0x50000001acf' 2024-08-31T04:30:54.641 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15279 fp=#0x50000001536' 2024-08-31T04:30:54.641 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15311 fp=#0x50000001cf6' 2024-08-31T04:30:54.642 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15343 fp=#0x50000001523' 2024-08-31T04:30:54.642 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15375 fp=#0x50000001cf7' 2024-08-31T04:30:54.642 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15407 fp=#0x500000010d3' 2024-08-31T04:30:54.643 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15439 fp=#0x500000010b4' 2024-08-31T04:30:54.643 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15471 fp=#0x500000010ef' 2024-08-31T04:30:54.645 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15727 fp=#0x50000001bf6' 2024-08-31T04:30:54.646 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15823 fp=#0x500000016bc' 2024-08-31T04:30:54.646 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15887 fp=#0x5000000173a' 2024-08-31T04:30:54.646 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15919 fp=#0x500000016fc' 2024-08-31T04:30:54.647 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15951 fp=#0x50000001717' 2024-08-31T04:30:54.648 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16079 fp=#0x5000000101e' 2024-08-31T04:30:54.651 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16527 fp=#0x500000009ca' 2024-08-31T04:30:54.651 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16559 fp=#0x500000009d7' 2024-08-31T04:30:54.652 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16591 fp=#0x50000001746' 2024-08-31T04:30:54.652 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16623 fp=#0x50000001751' 2024-08-31T04:30:54.654 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16815 fp=#0x50000001bca' 2024-08-31T04:30:54.654 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16847 fp=#0x50000001bc2' 2024-08-31T04:30:54.654 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16879 fp=#0x50000000b40' 2024-08-31T04:30:54.655 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16911 fp=#0x50000000a5f' 2024-08-31T04:30:54.655 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16943 fp=#0x50000000a6f' 2024-08-31T04:30:54.655 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16975 fp=#0x50000001603' 2024-08-31T04:30:54.656 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17007 fp=#0x500000015ca' 2024-08-31T04:30:54.656 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17039 fp=#0x5000000156a' 2024-08-31T04:30:54.656 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17071 fp=#0x500000015ee' 2024-08-31T04:30:54.656 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17103 fp=#0x50000001633' 2024-08-31T04:30:54.657 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17167 fp=#0x10000003f03' 2024-08-31T04:30:54.657 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17199 fp=#0x10000003ed9' 2024-08-31T04:30:54.658 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17231 fp=#0x500000015b5' 2024-08-31T04:30:54.658 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17263 fp=#0x5000000158d' 2024-08-31T04:30:54.658 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17295 fp=#0x500000015d2' 2024-08-31T04:30:54.659 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17359 fp=#0x100000035ef' 2024-08-31T04:30:54.659 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17391 fp=#0x10000003bc6' 2024-08-31T04:30:54.659 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17423 fp=#0x1000000365b' 2024-08-31T04:30:54.660 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17455 fp=#0x100000036cd' 2024-08-31T04:30:54.660 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17487 fp=#0x100000037a0' 2024-08-31T04:30:54.661 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17519 fp=#0x5000000125c' 2024-08-31T04:30:54.661 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17551 fp=#0x50000001256' 2024-08-31T04:30:54.661 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17615 fp=#0x50000001a0e' 2024-08-31T04:30:54.663 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17839 fp=#0x10000002290' 2024-08-31T04:30:54.663 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17903 fp=#0x50000001664' 2024-08-31T04:30:54.664 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17935 fp=#0x50000000a00' 2024-08-31T04:30:54.664 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17967 fp=#0x50000000a06' 2024-08-31T04:30:54.664 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17999 fp=#0x5000000092f' 2024-08-31T04:30:54.665 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18031 fp=#0x5000000093b' 2024-08-31T04:30:54.665 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18063 fp=#0x500000008dc' 2024-08-31T04:30:54.665 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18095 fp=#0x50000001a80' 2024-08-31T04:30:54.666 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18127 fp=#0x50000001a56' 2024-08-31T04:30:54.666 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18159 fp=#0x50000000925' 2024-08-31T04:30:54.667 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18255 fp=#0x500000016c0' 2024-08-31T04:30:54.668 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18479 fp=#0x1000000042b' 2024-08-31T04:30:54.669 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18511 fp=#0x50000000ed4' 2024-08-31T04:30:54.669 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18543 fp=#0x10000000c76' 2024-08-31T04:30:54.669 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18575 fp=#0x50000000aa6' 2024-08-31T04:30:54.669 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18607 fp=#0x10000000422' 2024-08-31T04:30:54.670 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18639 fp=#0x50000000eea' 2024-08-31T04:30:54.670 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18671 fp=#0x50000000d13' 2024-08-31T04:30:54.670 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18703 fp=#0x50000000d12' 2024-08-31T04:30:54.671 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18735 fp=#0x50000000d34' 2024-08-31T04:30:54.671 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18767 fp=#0x50000000d0c' 2024-08-31T04:30:54.671 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18799 fp=#0x50000000d5b' 2024-08-31T04:30:54.672 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18831 fp=#0x50000000d89' 2024-08-31T04:30:54.672 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18863 fp=#0x50000000e0b' 2024-08-31T04:30:54.672 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18895 fp=#0x50000000dc0' 2024-08-31T04:30:54.673 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18927 fp=#0x500000019cc' 2024-08-31T04:30:54.673 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18959 fp=#0x50000000f07' 2024-08-31T04:30:54.673 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18991 fp=#0x500000019e3' 2024-08-31T04:30:54.674 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19023 fp=#0x500000019e0' 2024-08-31T04:30:54.675 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19183 fp=#0x500000017cc' 2024-08-31T04:30:54.676 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19279 fp=#0x50000001804' 2024-08-31T04:30:54.676 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19311 fp=#0x500000017ce' 2024-08-31T04:30:54.676 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19343 fp=#0x50000001c42' 2024-08-31T04:30:54.677 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19375 fp=#0x50000001c5d' 2024-08-31T04:30:54.677 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19407 fp=#0x50000001c3a' 2024-08-31T04:30:54.677 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19439 fp=#0x5000000181a' 2024-08-31T04:30:54.678 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19471 fp=#0x5000000194d' 2024-08-31T04:30:54.678 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19503 fp=#0x5000000198a' 2024-08-31T04:30:54.678 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19535 fp=#0x50000001968' 2024-08-31T04:30:54.678 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19567 fp=#0x500000019a2' 2024-08-31T04:30:54.679 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19599 fp=#0x5000000191a' 2024-08-31T04:30:54.679 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19663 fp=#0x10000003e69' 2024-08-31T04:30:54.680 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19695 fp=#0x50000001441' 2024-08-31T04:30:54.680 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19759 fp=#0x10000003ea8' 2024-08-31T04:30:54.680 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19791 fp=#0x5000000095b' 2024-08-31T04:30:54.681 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19823 fp=#0x50000001124' 2024-08-31T04:30:54.681 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19855 fp=#0x50000001147' 2024-08-31T04:30:54.681 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19887 fp=#0x5000000113d' 2024-08-31T04:30:54.682 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19919 fp=#0x50000001136' 2024-08-31T04:30:54.682 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19951 fp=#0x50000000fa8' 2024-08-31T04:30:54.682 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19983 fp=#0x50000001ca3' 2024-08-31T04:30:54.682 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20015 fp=#0x50000000f95' 2024-08-31T04:30:54.683 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20047 fp=#0x50000000fc2' 2024-08-31T04:30:54.683 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20079 fp=#0x50000000f87' 2024-08-31T04:30:54.683 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20111 fp=#0x50000001054' 2024-08-31T04:30:54.684 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20143 fp=#0x50000001038' 2024-08-31T04:30:54.684 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20175 fp=#0x50000001077' 2024-08-31T04:30:54.684 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20207 fp=#0x5000000106c' 2024-08-31T04:30:54.685 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20239 fp=#0x50000001058' 2024-08-31T04:30:54.685 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20271 fp=#0x50000001c7c' 2024-08-31T04:30:54.685 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20303 fp=#0x200000003ea' 2024-08-31T04:30:54.686 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20335 fp=#0x10000000f2d' 2024-08-31T04:30:54.686 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20399 fp=#0x200000003b1' 2024-08-31T04:30:54.686 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20431 fp=#0x200000002dd' 2024-08-31T04:30:54.687 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20463 fp=#0x10000000f08' 2024-08-31T04:30:54.687 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20527 fp=#0x50000001917' 2024-08-31T04:30:54.688 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20559 fp=#0x100000031d8' 2024-08-31T04:30:54.688 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20591 fp=#0x500000018f0' 2024-08-31T04:30:54.688 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20623 fp=#0x500000018ea' 2024-08-31T04:30:54.689 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20655 fp=#0x100000032fa' 2024-08-31T04:30:54.689 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20687 fp=#0x100000032be' 2024-08-31T04:30:54.689 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20719 fp=#0x500000018f4' 2024-08-31T04:30:54.690 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20751 fp=#0x10000002b04' 2024-08-31T04:30:54.690 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20783 fp=#0x20000000347' 2024-08-31T04:30:54.690 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20815 fp=#0x10000002b4b' 2024-08-31T04:30:54.690 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20847 fp=#0x10000002aef' 2024-08-31T04:30:54.691 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20879 fp=#0x20000001270' 2024-08-31T04:30:54.691 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20911 fp=#0x10000002b92' 2024-08-31T04:30:54.691 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20943 fp=#0x20000001219' 2024-08-31T04:30:54.692 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20975 fp=#0x10000001bc4' 2024-08-31T04:30:54.692 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:21007 fp=#0x10000001baa' 2024-08-31T04:30:54.692 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:21039 fp=#0x10000001b5a' 2024-08-31T04:30:54.693 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:21071 fp=#0x10000001b77' 2024-08-31T04:30:54.693 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:21103 fp=#0x10000001f37' 2024-08-31T04:30:54.693 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:21135 fp=#0x10000001ea2' 2024-08-31T04:30:54.694 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:21167 fp=#0x50000001c4a' 2024-08-31T04:30:54.694 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:21199 fp=#0x50000001794' 2024-08-31T04:30:54.694 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:21231 fp=#0x30000000672' 2024-08-31T04:30:54.695 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:21295 fp=#0x10000001e64' 2024-08-31T04:30:54.696 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:10193 fp=#0x50000000545' 2024-08-31T04:30:54.696 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:10225 fp=#0x10000000461' 2024-08-31T04:30:54.716 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13073 fp=#0x30000002b25' 2024-08-31T04:30:54.717 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13137 fp=#0x400000015f7' 2024-08-31T04:30:54.717 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13169 fp=#0x40000001638' 2024-08-31T04:30:54.718 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13297 fp=#0x30000001a5d' 2024-08-31T04:30:54.719 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13329 fp=#0x30000001ae7' 2024-08-31T04:30:54.719 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13361 fp=#0x30000002b96' 2024-08-31T04:30:54.719 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13393 fp=#0x30000001abb' 2024-08-31T04:30:54.720 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13425 fp=#0x30000002749' 2024-08-31T04:30:54.720 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13457 fp=#0x30000002767' 2024-08-31T04:30:54.720 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13489 fp=#0x30000002762' 2024-08-31T04:30:54.724 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14064 fp=#0x50000000cca' 2024-08-31T04:30:54.725 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14160 fp=#0x50000000c84' 2024-08-31T04:30:54.726 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14192 fp=#0x50000000cc0' 2024-08-31T04:30:54.726 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14224 fp=#0x50000000c45' 2024-08-31T04:30:54.726 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14256 fp=#0x50000001910' 2024-08-31T04:30:54.727 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14320 fp=#0x500000016ac' 2024-08-31T04:30:54.727 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14352 fp=#0x10000003aa8' 2024-08-31T04:30:54.728 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14416 fp=#0x50000000b96' 2024-08-31T04:30:54.728 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14448 fp=#0x50000000ba4' 2024-08-31T04:30:54.728 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14480 fp=#0x50000000bbd' 2024-08-31T04:30:54.729 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14512 fp=#0x50000000be4' 2024-08-31T04:30:54.729 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14544 fp=#0x50000000bf8' 2024-08-31T04:30:54.729 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14576 fp=#0x50000001b0c' 2024-08-31T04:30:54.729 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14608 fp=#0x50000001b7f' 2024-08-31T04:30:54.730 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14640 fp=#0x50000001b96' 2024-08-31T04:30:54.730 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14672 fp=#0x50000001b22' 2024-08-31T04:30:54.731 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14704 fp=#0x50000001b3c' 2024-08-31T04:30:54.731 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14736 fp=#0x5000000146d' 2024-08-31T04:30:54.731 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14768 fp=#0x50000001478' 2024-08-31T04:30:54.732 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14800 fp=#0x5000000145d' 2024-08-31T04:30:54.732 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14832 fp=#0x50000001d7b' 2024-08-31T04:30:54.732 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14864 fp=#0x50000000e7e' 2024-08-31T04:30:54.733 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14896 fp=#0x50000001d7e' 2024-08-31T04:30:54.733 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14928 fp=#0x50000001873' 2024-08-31T04:30:54.733 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14960 fp=#0x50000000e74' 2024-08-31T04:30:54.733 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14992 fp=#0x50000000e71' 2024-08-31T04:30:54.735 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15152 fp=#0x50000000ff8' 2024-08-31T04:30:54.735 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15184 fp=#0x50000001a9a' 2024-08-31T04:30:54.735 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15216 fp=#0x50000000fd6' 2024-08-31T04:30:54.736 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15248 fp=#0x500000016c9' 2024-08-31T04:30:54.736 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15280 fp=#0x50000001553' 2024-08-31T04:30:54.736 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15312 fp=#0x50000001781' 2024-08-31T04:30:54.737 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15344 fp=#0x50000001522' 2024-08-31T04:30:54.737 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15376 fp=#0x5000000150f' 2024-08-31T04:30:54.738 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15440 fp=#0x500000010c4' 2024-08-31T04:30:54.738 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15472 fp=#0x500000010fa' 2024-08-31T04:30:54.741 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15888 fp=#0x5000000173c' 2024-08-31T04:30:54.741 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15920 fp=#0x5000000172a' 2024-08-31T04:30:54.742 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15952 fp=#0x50000001709' 2024-08-31T04:30:54.743 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16176 fp=#0x500000018b8' 2024-08-31T04:30:54.746 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16528 fp=#0x500000009ed' 2024-08-31T04:30:54.746 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16560 fp=#0x500000009d2' 2024-08-31T04:30:54.746 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16592 fp=#0x5000000176f' 2024-08-31T04:30:54.747 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16656 fp=#0x50000001aa2' 2024-08-31T04:30:54.747 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16688 fp=#0x50000001a8b' 2024-08-31T04:30:54.748 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16720 fp=#0x50000001ac6' 2024-08-31T04:30:54.748 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16752 fp=#0x50000001a9e' 2024-08-31T04:30:54.748 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16784 fp=#0x50000001a49' 2024-08-31T04:30:54.749 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16816 fp=#0x50000001bc5' 2024-08-31T04:30:54.749 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16848 fp=#0x50000001bc3' 2024-08-31T04:30:54.749 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16880 fp=#0x50000000b41' 2024-08-31T04:30:54.750 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16912 fp=#0x50000000a79' 2024-08-31T04:30:54.750 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16944 fp=#0x50000000a52' 2024-08-31T04:30:54.750 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16976 fp=#0x5000000168a' 2024-08-31T04:30:54.751 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17008 fp=#0x5000000157f' 2024-08-31T04:30:54.751 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17040 fp=#0x50000001606' 2024-08-31T04:30:54.751 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17072 fp=#0x50000001671' 2024-08-31T04:30:54.752 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17168 fp=#0x10000003e8f' 2024-08-31T04:30:54.753 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17232 fp=#0x50000001b3f' 2024-08-31T04:30:54.753 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17264 fp=#0x50000001623' 2024-08-31T04:30:54.753 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17296 fp=#0x50000001572' 2024-08-31T04:30:54.754 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17328 fp=#0x10000003600' 2024-08-31T04:30:54.754 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17360 fp=#0x100000035f6' 2024-08-31T04:30:54.754 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17392 fp=#0x1000000361a' 2024-08-31T04:30:54.755 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17424 fp=#0x100000035fd' 2024-08-31T04:30:54.755 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17456 fp=#0x1000000363e' 2024-08-31T04:30:54.755 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17488 fp=#0x100000035d1' 2024-08-31T04:30:54.756 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17520 fp=#0x500000012ee' 2024-08-31T04:30:54.756 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17616 fp=#0x5000000126d' 2024-08-31T04:30:54.757 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17648 fp=#0x5000000122f' 2024-08-31T04:30:54.757 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17712 fp=#0x10000002346' 2024-08-31T04:30:54.758 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17808 fp=#0x1000000232b' 2024-08-31T04:30:54.759 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17872 fp=#0x5000000168c' 2024-08-31T04:30:54.759 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17968 fp=#0x5000000165d' 2024-08-31T04:30:54.760 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18000 fp=#0x50000001a4b' 2024-08-31T04:30:54.760 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18032 fp=#0x50000001a8a' 2024-08-31T04:30:54.760 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18064 fp=#0x50000001a54' 2024-08-31T04:30:54.761 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18128 fp=#0x500000008fe' 2024-08-31T04:30:54.761 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18192 fp=#0x50000001a6a' 2024-08-31T04:30:54.762 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18224 fp=#0x50000001a96' 2024-08-31T04:30:54.763 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18416 fp=#0x50000000e43' 2024-08-31T04:30:54.764 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18448 fp=#0x50000000e99' 2024-08-31T04:30:54.764 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18512 fp=#0x1000000040d' 2024-08-31T04:30:54.765 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18544 fp=#0x100000003e9' 2024-08-31T04:30:54.765 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18576 fp=#0x10000000440' 2024-08-31T04:30:54.765 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18608 fp=#0x50000000ab2' 2024-08-31T04:30:54.766 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18640 fp=#0x50000000edb' 2024-08-31T04:30:54.766 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18672 fp=#0x50000000d72' 2024-08-31T04:30:54.766 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18704 fp=#0x50000000d1d' 2024-08-31T04:30:54.766 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18736 fp=#0x50000000d15' 2024-08-31T04:30:54.767 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18768 fp=#0x50000000cea' 2024-08-31T04:30:54.767 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18800 fp=#0x50000000cf3' 2024-08-31T04:30:54.767 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18832 fp=#0x50000000dc3' 2024-08-31T04:30:54.768 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18864 fp=#0x50000000d93' 2024-08-31T04:30:54.768 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18896 fp=#0x50000000db7' 2024-08-31T04:30:54.768 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18928 fp=#0x50000000d9a' 2024-08-31T04:30:54.769 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18960 fp=#0x50000000deb' 2024-08-31T04:30:54.769 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18992 fp=#0x50000000dad' 2024-08-31T04:30:54.769 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19024 fp=#0x500000019c7' 2024-08-31T04:30:54.770 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19088 fp=#0x500000017ef' 2024-08-31T04:30:54.771 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19184 fp=#0x50000001836' 2024-08-31T04:30:54.771 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19216 fp=#0x500000017c3' 2024-08-31T04:30:54.772 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19344 fp=#0x5000000182f' 2024-08-31T04:30:54.773 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19376 fp=#0x50000001807' 2024-08-31T04:30:54.773 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19408 fp=#0x5000000182e' 2024-08-31T04:30:54.773 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19440 fp=#0x50000001c35' 2024-08-31T04:30:54.773 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19472 fp=#0x50000001a18' 2024-08-31T04:30:54.774 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19504 fp=#0x5000000198e' 2024-08-31T04:30:54.774 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19536 fp=#0x50000001930' 2024-08-31T04:30:54.774 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19568 fp=#0x500000019cf' 2024-08-31T04:30:54.775 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19600 fp=#0x5000000199f' 2024-08-31T04:30:54.775 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19664 fp=#0x10000003e8a' 2024-08-31T04:30:54.776 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19728 fp=#0x10000003eb1' 2024-08-31T04:30:54.776 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19792 fp=#0x50000000963' 2024-08-31T04:30:54.777 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19824 fp=#0x50000001120' 2024-08-31T04:30:54.777 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19856 fp=#0x5000000114b' 2024-08-31T04:30:54.777 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19888 fp=#0x50000001117' 2024-08-31T04:30:54.778 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19920 fp=#0x5000000113c' 2024-08-31T04:30:54.778 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19952 fp=#0x50000000f85' 2024-08-31T04:30:54.778 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19984 fp=#0x50000001c93' 2024-08-31T04:30:54.779 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20016 fp=#0x50000001ce7' 2024-08-31T04:30:54.779 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20048 fp=#0x50000001ca0' 2024-08-31T04:30:54.779 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20080 fp=#0x50000001c92' 2024-08-31T04:30:54.780 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20112 fp=#0x500000010d8' 2024-08-31T04:30:54.780 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20144 fp=#0x500000010b0' 2024-08-31T04:30:54.780 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20176 fp=#0x5000000107c' 2024-08-31T04:30:54.781 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20208 fp=#0x50000001056' 2024-08-31T04:30:54.781 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20240 fp=#0x5000000105e' 2024-08-31T04:30:54.781 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20272 fp=#0x50000001c7a' 2024-08-31T04:30:54.782 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20304 fp=#0x10000000fb6' 2024-08-31T04:30:54.782 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20336 fp=#0x10000000fc5' 2024-08-31T04:30:54.782 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20368 fp=#0x200000003d6' 2024-08-31T04:30:54.782 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20400 fp=#0x200000002ed' 2024-08-31T04:30:54.783 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20432 fp=#0x200000002ea' 2024-08-31T04:30:54.783 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20464 fp=#0x200000003af' 2024-08-31T04:30:54.783 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20496 fp=#0x10000003174' 2024-08-31T04:30:54.784 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20528 fp=#0x100000032d6' 2024-08-31T04:30:54.784 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20560 fp=#0x500000018ca' 2024-08-31T04:30:54.784 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20592 fp=#0x500000018e1' 2024-08-31T04:30:54.785 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20624 fp=#0x1000000322c' 2024-08-31T04:30:54.785 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20656 fp=#0x10000003256' 2024-08-31T04:30:54.785 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20688 fp=#0x100000032a3' 2024-08-31T04:30:54.786 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20720 fp=#0x500000018cc' 2024-08-31T04:30:54.786 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20752 fp=#0x10000002afd' 2024-08-31T04:30:54.786 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20784 fp=#0x10000002b5d' 2024-08-31T04:30:54.787 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20816 fp=#0x10000002b53' 2024-08-31T04:30:54.787 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20848 fp=#0x10000002b6d' 2024-08-31T04:30:54.787 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20880 fp=#0x20000000341' 2024-08-31T04:30:54.788 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20912 fp=#0x10000002b0a' 2024-08-31T04:30:54.788 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20944 fp=#0x10000002ac7' 2024-08-31T04:30:54.788 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20976 fp=#0x10000001aaa' 2024-08-31T04:30:54.789 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:21008 fp=#0x10000001ad6' 2024-08-31T04:30:54.789 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:21040 fp=#0x10000001a9a' 2024-08-31T04:30:54.789 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:21072 fp=#0x10000001b45' 2024-08-31T04:30:54.790 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:21104 fp=#0x10000001e81' 2024-08-31T04:30:54.790 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:21136 fp=#0x10000001f0b' 2024-08-31T04:30:54.790 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:21168 fp=#0x10000001e4e' 2024-08-31T04:30:54.791 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:21232 fp=#0x10000001f0d' 2024-08-31T04:30:54.791 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:21264 fp=#0x10000001f11' 2024-08-31T04:30:54.792 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:21296 fp=#0x10000001e6a' 2024-08-31T04:30:54.793 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:10194 fp=#0x1000000446f' 2024-08-31T04:30:54.793 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:10226 fp=#0x50000001915' 2024-08-31T04:30:54.814 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13074 fp=#0x30000002b03' 2024-08-31T04:30:54.814 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13106 fp=#0x50000001758' 2024-08-31T04:30:54.816 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13298 fp=#0x30000001a84' 2024-08-31T04:30:54.816 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13330 fp=#0x30000001ac5' 2024-08-31T04:30:54.817 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13362 fp=#0x30000001b05' 2024-08-31T04:30:54.817 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13394 fp=#0x30000001ad4' 2024-08-31T04:30:54.817 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13426 fp=#0x3000000275f' 2024-08-31T04:30:54.818 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13458 fp=#0x300000027a1' 2024-08-31T04:30:54.818 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13490 fp=#0x3000000278f' 2024-08-31T04:30:54.819 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13650 fp=#0x30000002282' 2024-08-31T04:30:54.821 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13938 fp=#0x500000018af' 2024-08-31T04:30:54.822 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14034 fp=#0x50000001ba0' 2024-08-31T04:30:54.823 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14097 fp=#0x50000000c66' 2024-08-31T04:30:54.823 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14161 fp=#0x50000000c4c' 2024-08-31T04:30:54.824 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14193 fp=#0x50000000c9f' 2024-08-31T04:30:54.824 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14225 fp=#0x50000000c5d' 2024-08-31T04:30:54.826 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14417 fp=#0x50000000c0d' 2024-08-31T04:30:54.826 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14449 fp=#0x50000000b62' 2024-08-31T04:30:54.826 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14481 fp=#0x50000000ba0' 2024-08-31T04:30:54.827 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14513 fp=#0x50000000bb8' 2024-08-31T04:30:54.827 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14545 fp=#0x50000000b77' 2024-08-31T04:30:54.827 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14577 fp=#0x50000001b41' 2024-08-31T04:30:54.828 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14609 fp=#0x50000001b51' 2024-08-31T04:30:54.828 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14641 fp=#0x50000001b61' 2024-08-31T04:30:54.828 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14673 fp=#0x50000001b55' 2024-08-31T04:30:54.828 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14705 fp=#0x50000001b45' 2024-08-31T04:30:54.829 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14737 fp=#0x500000014b6' 2024-08-31T04:30:54.829 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14769 fp=#0x5000000144e' 2024-08-31T04:30:54.829 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14801 fp=#0x500000014dc' 2024-08-31T04:30:54.830 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14833 fp=#0x50000000e86' 2024-08-31T04:30:54.830 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14865 fp=#0x50000000e6f' 2024-08-31T04:30:54.831 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14897 fp=#0x5000000186d' 2024-08-31T04:30:54.831 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14929 fp=#0x50000001855' 2024-08-31T04:30:54.831 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14961 fp=#0x50000000e27' 2024-08-31T04:30:54.832 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14993 fp=#0x50000000e56' 2024-08-31T04:30:54.833 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15153 fp=#0x50000001ac8' 2024-08-31T04:30:54.833 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15185 fp=#0x50000000fd3' 2024-08-31T04:30:54.833 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15217 fp=#0x50000001ac0' 2024-08-31T04:30:54.834 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15249 fp=#0x50000000fe2' 2024-08-31T04:30:54.834 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15281 fp=#0x50000001555' 2024-08-31T04:30:54.834 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15313 fp=#0x5000000154b' 2024-08-31T04:30:54.835 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15345 fp=#0x5000000150a' 2024-08-31T04:30:54.835 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15377 fp=#0x50000001504' 2024-08-31T04:30:54.835 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15409 fp=#0x500000010bb' 2024-08-31T04:30:54.836 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15441 fp=#0x500000010ed' 2024-08-31T04:30:54.836 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15473 fp=#0x500000010df' 2024-08-31T04:30:54.838 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15761 fp=#0x500000011c1' 2024-08-31T04:30:54.839 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15793 fp=#0x50000001bed' 2024-08-31T04:30:54.839 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15857 fp=#0x50000001c0f' 2024-08-31T04:30:54.840 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15889 fp=#0x500000016e8' 2024-08-31T04:30:54.840 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15921 fp=#0x5000000172e' 2024-08-31T04:30:54.840 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15953 fp=#0x500000016e6' 2024-08-31T04:30:54.844 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16529 fp=#0x500000009d6' 2024-08-31T04:30:54.845 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16561 fp=#0x500000009e3' 2024-08-31T04:30:54.845 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16593 fp=#0x50000001755' 2024-08-31T04:30:54.845 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16625 fp=#0x50000001aa8' 2024-08-31T04:30:54.846 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16689 fp=#0x50000001a74' 2024-08-31T04:30:54.846 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16721 fp=#0x50000001a5c' 2024-08-31T04:30:54.847 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16785 fp=#0x50000001d07' 2024-08-31T04:30:54.847 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16817 fp=#0x50000001bc4' 2024-08-31T04:30:54.847 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16849 fp=#0x50000001baf' 2024-08-31T04:30:54.848 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16881 fp=#0x50000000b48' 2024-08-31T04:30:54.848 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16913 fp=#0x50000000a5d' 2024-08-31T04:30:54.848 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16945 fp=#0x50000000a49' 2024-08-31T04:30:54.849 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16977 fp=#0x500000016a1' 2024-08-31T04:30:54.849 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17009 fp=#0x500000015d7' 2024-08-31T04:30:54.849 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17041 fp=#0x50000001641' 2024-08-31T04:30:54.850 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17073 fp=#0x5000000159d' 2024-08-31T04:30:54.851 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17233 fp=#0x5000000161b' 2024-08-31T04:30:54.851 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17265 fp=#0x500000015cc' 2024-08-31T04:30:54.852 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17297 fp=#0x50000001613' 2024-08-31T04:30:54.852 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17329 fp=#0x100000037dc' 2024-08-31T04:30:54.852 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17361 fp=#0x1000000366a' 2024-08-31T04:30:54.853 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17393 fp=#0x500000011be' 2024-08-31T04:30:54.853 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17425 fp=#0x100000036c2' 2024-08-31T04:30:54.853 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17457 fp=#0x100000035dd' 2024-08-31T04:30:54.854 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17489 fp=#0x1000000366d' 2024-08-31T04:30:54.854 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17521 fp=#0x5000000122d' 2024-08-31T04:30:54.854 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17553 fp=#0x500000012a8' 2024-08-31T04:30:54.855 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17585 fp=#0x50000001279' 2024-08-31T04:30:54.855 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17649 fp=#0x50000001239' 2024-08-31T04:30:54.855 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17681 fp=#0x10000002284' 2024-08-31T04:30:54.857 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17873 fp=#0x5000000167c' 2024-08-31T04:30:54.857 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17905 fp=#0x5000000162e' 2024-08-31T04:30:54.858 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17969 fp=#0x50000001668' 2024-08-31T04:30:54.858 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18001 fp=#0x5000000092a' 2024-08-31T04:30:54.858 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18033 fp=#0x500000008db' 2024-08-31T04:30:54.859 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18065 fp=#0x50000001a55' 2024-08-31T04:30:54.859 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18097 fp=#0x50000001a79' 2024-08-31T04:30:54.859 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18129 fp=#0x50000001a2d' 2024-08-31T04:30:54.860 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18225 fp=#0x50000001a7b' 2024-08-31T04:30:54.860 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18257 fp=#0x50000000e2e' 2024-08-31T04:30:54.861 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18289 fp=#0x50000000e29' 2024-08-31T04:30:54.861 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18321 fp=#0x50000000ddf' 2024-08-31T04:30:54.861 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18353 fp=#0x50000000e38' 2024-08-31T04:30:54.862 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18449 fp=#0x50000000e87' 2024-08-31T04:30:54.863 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18481 fp=#0x10000000e0e' 2024-08-31T04:30:54.863 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18513 fp=#0x50000000aff' 2024-08-31T04:30:54.863 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18545 fp=#0x50000000edf' 2024-08-31T04:30:54.863 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18577 fp=#0x100000003e0' 2024-08-31T04:30:54.864 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18609 fp=#0x50000000abf' 2024-08-31T04:30:54.864 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18641 fp=#0x10000000431' 2024-08-31T04:30:54.864 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18673 fp=#0x50000000d3b' 2024-08-31T04:30:54.865 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18705 fp=#0x50000000d14' 2024-08-31T04:30:54.865 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18737 fp=#0x50000000cf6' 2024-08-31T04:30:54.865 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18769 fp=#0x50000000d32' 2024-08-31T04:30:54.866 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18801 fp=#0x50000000d4b' 2024-08-31T04:30:54.866 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18833 fp=#0x500000019dc' 2024-08-31T04:30:54.866 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18865 fp=#0x50000000f20' 2024-08-31T04:30:54.867 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18897 fp=#0x50000000efe' 2024-08-31T04:30:54.867 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18929 fp=#0x50000000da0' 2024-08-31T04:30:54.867 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18961 fp=#0x50000000dc8' 2024-08-31T04:30:54.868 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18993 fp=#0x50000000dde' 2024-08-31T04:30:54.868 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19025 fp=#0x50000000d92' 2024-08-31T04:30:54.868 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19089 fp=#0x50000001806' 2024-08-31T04:30:54.869 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19153 fp=#0x500000017a2' 2024-08-31T04:30:54.870 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19313 fp=#0x5000000183b' 2024-08-31T04:30:54.871 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19345 fp=#0x5000000182b' 2024-08-31T04:30:54.873 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19377 fp=#0x50000001c66' 2024-08-31T04:30:54.874 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19409 fp=#0x5000000180b' 2024-08-31T04:30:54.874 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19441 fp=#0x50000001931' 2024-08-31T04:30:54.874 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19473 fp=#0x50000001929' 2024-08-31T04:30:54.875 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19505 fp=#0x500000019df' 2024-08-31T04:30:54.875 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19537 fp=#0x500000019be' 2024-08-31T04:30:54.875 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19569 fp=#0x50000001954' 2024-08-31T04:30:54.876 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19601 fp=#0x50000001976' 2024-08-31T04:30:54.876 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19665 fp=#0x10000003e6f' 2024-08-31T04:30:54.877 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19761 fp=#0x10000003ed7' 2024-08-31T04:30:54.877 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19793 fp=#0x5000000096c' 2024-08-31T04:30:54.878 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19825 fp=#0x50000001174' 2024-08-31T04:30:54.878 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19857 fp=#0x5000000115e' 2024-08-31T04:30:54.878 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19889 fp=#0x50000001133' 2024-08-31T04:30:54.879 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19921 fp=#0x5000000115b' 2024-08-31T04:30:54.879 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19953 fp=#0x50000000fb9' 2024-08-31T04:30:54.879 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19985 fp=#0x50000001cca' 2024-08-31T04:30:54.880 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20017 fp=#0x50000000f7d' 2024-08-31T04:30:54.880 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20049 fp=#0x50000000f7b' 2024-08-31T04:30:54.880 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20081 fp=#0x50000000f6f' 2024-08-31T04:30:54.880 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20113 fp=#0x50000001089' 2024-08-31T04:30:54.881 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20145 fp=#0x50000001068' 2024-08-31T04:30:54.881 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20177 fp=#0x500000010d9' 2024-08-31T04:30:54.881 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20209 fp=#0x50000001049' 2024-08-31T04:30:54.882 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20241 fp=#0x5000000109c' 2024-08-31T04:30:54.882 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20273 fp=#0x50000001c82' 2024-08-31T04:30:54.882 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20305 fp=#0x200000003b0' 2024-08-31T04:30:54.883 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20337 fp=#0x10000000ef8' 2024-08-31T04:30:54.883 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20369 fp=#0x200000002e3' 2024-08-31T04:30:54.883 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20401 fp=#0x10000000e2c' 2024-08-31T04:30:54.884 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20433 fp=#0x200000002d8' 2024-08-31T04:30:54.884 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20465 fp=#0x10000000f44' 2024-08-31T04:30:54.884 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20497 fp=#0x100000031ed' 2024-08-31T04:30:54.885 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20529 fp=#0x50000001901' 2024-08-31T04:30:54.885 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20561 fp=#0x500000018d9' 2024-08-31T04:30:54.885 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20593 fp=#0x1000000323b' 2024-08-31T04:30:54.886 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20625 fp=#0x100000031da' 2024-08-31T04:30:54.886 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20657 fp=#0x10000003287' 2024-08-31T04:30:54.886 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20689 fp=#0x100000031ee' 2024-08-31T04:30:54.887 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20721 fp=#0x50000001900' 2024-08-31T04:30:54.887 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20753 fp=#0x10000002ad0' 2024-08-31T04:30:54.887 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20785 fp=#0x10000002b51' 2024-08-31T04:30:54.887 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20817 fp=#0x20000001257' 2024-08-31T04:30:54.888 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20849 fp=#0x10000002b7e' 2024-08-31T04:30:54.888 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20881 fp=#0x10000002b69' 2024-08-31T04:30:54.888 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20913 fp=#0x20000001204' 2024-08-31T04:30:54.889 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20945 fp=#0x10000002b0c' 2024-08-31T04:30:54.889 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20977 fp=#0x10000001bc1' 2024-08-31T04:30:54.890 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:21009 fp=#0x10000001b92' 2024-08-31T04:30:54.890 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:21041 fp=#0x10000001a3e' 2024-08-31T04:30:54.890 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:21073 fp=#0x10000001aa6' 2024-08-31T04:30:54.890 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:21105 fp=#0x10000001f1f' 2024-08-31T04:30:54.891 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:21137 fp=#0x10000001ef9' 2024-08-31T04:30:54.891 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:21169 fp=#0x10000001e9c' 2024-08-31T04:30:54.891 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:21201 fp=#0x30000000270' 2024-08-31T04:30:54.892 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:21233 fp=#0x10000001e8c' 2024-08-31T04:30:54.892 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:21265 fp=#0x10000001e6b' 2024-08-31T04:30:54.892 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:21297 fp=#0x10000001e90' 2024-08-31T04:30:54.894 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:10195 fp=#0x500000016e3' 2024-08-31T04:30:54.894 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:10227 fp=#0x10000003dc8' 2024-08-31T04:30:54.915 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13075 fp=#0x30000002aca' 2024-08-31T04:30:54.917 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13331 fp=#0x30000001ade' 2024-08-31T04:30:54.917 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13363 fp=#0x30000002b6b' 2024-08-31T04:30:54.918 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13395 fp=#0x30000001acf' 2024-08-31T04:30:54.918 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13427 fp=#0x3000000275b' 2024-08-31T04:30:54.918 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13459 fp=#0x3000000274e' 2024-08-31T04:30:54.919 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13491 fp=#0x30000002765' 2024-08-31T04:30:54.919 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13523 fp=#0x50000000f65' 2024-08-31T04:30:54.919 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13555 fp=#0x30000001818' 2024-08-31T04:30:54.920 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13587 fp=#0x50000001189' 2024-08-31T04:30:54.920 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13651 fp=#0x30000002299' 2024-08-31T04:30:54.922 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13939 fp=#0x40000001ab3' 2024-08-31T04:30:54.923 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14066 fp=#0x50000000c23' 2024-08-31T04:30:54.924 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14098 fp=#0x50000000cb3' 2024-08-31T04:30:54.924 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14162 fp=#0x50000000c2d' 2024-08-31T04:30:54.925 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14194 fp=#0x50000000c39' 2024-08-31T04:30:54.925 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14226 fp=#0x50000000c97' 2024-08-31T04:30:54.925 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14258 fp=#0x10000003b03' 2024-08-31T04:30:54.926 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14386 fp=#0x50000000b86' 2024-08-31T04:30:54.927 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14418 fp=#0x50000000b80' 2024-08-31T04:30:54.927 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14450 fp=#0x50000000bb5' 2024-08-31T04:30:54.927 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14482 fp=#0x50000000b6f' 2024-08-31T04:30:54.928 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14514 fp=#0x50000000c07' 2024-08-31T04:30:54.928 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14546 fp=#0x50000000b9b' 2024-08-31T04:30:54.928 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14578 fp=#0x50000001b8a' 2024-08-31T04:30:54.929 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14610 fp=#0x50000001b79' 2024-08-31T04:30:54.929 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14642 fp=#0x50000001b8d' 2024-08-31T04:30:54.929 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14674 fp=#0x50000001b3a' 2024-08-31T04:30:54.929 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14706 fp=#0x50000001b78' 2024-08-31T04:30:54.930 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14738 fp=#0x500000014d5' 2024-08-31T04:30:54.930 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14770 fp=#0x50000001475' 2024-08-31T04:30:54.930 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14802 fp=#0x500000014a2' 2024-08-31T04:30:54.931 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14834 fp=#0x5000000187c' 2024-08-31T04:30:54.931 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14866 fp=#0x50000000e47' 2024-08-31T04:30:54.931 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14898 fp=#0x50000000ea0' 2024-08-31T04:30:54.932 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14930 fp=#0x50000001d78' 2024-08-31T04:30:54.932 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14962 fp=#0x50000001871' 2024-08-31T04:30:54.932 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14994 fp=#0x50000001866' 2024-08-31T04:30:54.934 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15154 fp=#0x50000000fd7' 2024-08-31T04:30:54.934 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15186 fp=#0x50000001003' 2024-08-31T04:30:54.934 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15218 fp=#0x50000001018' 2024-08-31T04:30:54.935 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15250 fp=#0x50000000ffb' 2024-08-31T04:30:54.935 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15282 fp=#0x5000000150b' 2024-08-31T04:30:54.935 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15314 fp=#0x5000000154f' 2024-08-31T04:30:54.936 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15346 fp=#0x50000001546' 2024-08-31T04:30:54.936 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15378 fp=#0x5000000153a' 2024-08-31T04:30:54.936 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15410 fp=#0x500000010ee' 2024-08-31T04:30:54.937 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15442 fp=#0x5000000109b' 2024-08-31T04:30:54.937 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15474 fp=#0x5000000108e' 2024-08-31T04:30:54.939 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15730 fp=#0x50000001c0c' 2024-08-31T04:30:54.940 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15858 fp=#0x50000001c07' 2024-08-31T04:30:54.941 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15890 fp=#0x5000000171c' 2024-08-31T04:30:54.941 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15922 fp=#0x500000016f6' 2024-08-31T04:30:54.941 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15954 fp=#0x5000000170d' 2024-08-31T04:30:54.945 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16530 fp=#0x500000009e2' 2024-08-31T04:30:54.946 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16594 fp=#0x50000001764' 2024-08-31T04:30:54.946 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16658 fp=#0x50000001aab' 2024-08-31T04:30:54.947 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16690 fp=#0x50000001d26' 2024-08-31T04:30:54.947 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16722 fp=#0x50000001d1f' 2024-08-31T04:30:54.948 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16786 fp=#0x50000001a8f' 2024-08-31T04:30:54.948 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16818 fp=#0x50000001bd3' 2024-08-31T04:30:54.948 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16850 fp=#0x50000001bbd' 2024-08-31T04:30:54.949 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16882 fp=#0x50000000b4b' 2024-08-31T04:30:54.949 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16914 fp=#0x50000000a6d' 2024-08-31T04:30:54.949 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16946 fp=#0x50000000a7e' 2024-08-31T04:30:54.950 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16978 fp=#0x500000015cf' 2024-08-31T04:30:54.950 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17010 fp=#0x500000015df' 2024-08-31T04:30:54.950 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17042 fp=#0x500000015b8' 2024-08-31T04:30:54.951 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17074 fp=#0x500000015ec' 2024-08-31T04:30:54.951 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17106 fp=#0x10000003ec7' 2024-08-31T04:30:54.951 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17138 fp=#0x10000003ef9' 2024-08-31T04:30:54.951 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17170 fp=#0x10000003e9d' 2024-08-31T04:30:54.952 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17202 fp=#0x10000003ec5' 2024-08-31T04:30:54.952 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17234 fp=#0x500000015ae' 2024-08-31T04:30:54.952 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17266 fp=#0x500000015bd' 2024-08-31T04:30:54.953 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17298 fp=#0x500000015da' 2024-08-31T04:30:54.953 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17330 fp=#0x100000035ab' 2024-08-31T04:30:54.953 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17362 fp=#0x10000003753' 2024-08-31T04:30:54.954 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17394 fp=#0x100000036ac' 2024-08-31T04:30:54.954 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17426 fp=#0x1000000370c' 2024-08-31T04:30:54.955 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17458 fp=#0x10000003787' 2024-08-31T04:30:54.955 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17490 fp=#0x1000000367f' 2024-08-31T04:30:54.955 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17554 fp=#0x500000012d4' 2024-08-31T04:30:54.956 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17586 fp=#0x5000000128a' 2024-08-31T04:30:54.956 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17618 fp=#0x50000001932' 2024-08-31T04:30:54.956 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17650 fp=#0x5000000126a' 2024-08-31T04:30:54.958 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17874 fp=#0x50000001663' 2024-08-31T04:30:54.958 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17906 fp=#0x50000000a0d' 2024-08-31T04:30:54.959 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17938 fp=#0x50000001665' 2024-08-31T04:30:54.959 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17970 fp=#0x5000000165e' 2024-08-31T04:30:54.960 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18066 fp=#0x5000000091d' 2024-08-31T04:30:54.960 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18098 fp=#0x50000001ab6' 2024-08-31T04:30:54.960 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18130 fp=#0x5000000090e' 2024-08-31T04:30:54.961 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18162 fp=#0x5000000090f' 2024-08-31T04:30:54.961 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18194 fp=#0x50000000927' 2024-08-31T04:30:54.961 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18226 fp=#0x50000001a73' 2024-08-31T04:30:54.962 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18322 fp=#0x50000000e06' 2024-08-31T04:30:54.963 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18354 fp=#0x50000000e12' 2024-08-31T04:30:54.963 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18386 fp=#0x50000000e21' 2024-08-31T04:30:54.963 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18450 fp=#0x50000000e7a' 2024-08-31T04:30:54.964 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18482 fp=#0x50000000ee8' 2024-08-31T04:30:54.964 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18514 fp=#0x50000000ab0' 2024-08-31T04:30:54.964 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18546 fp=#0x50000000ab8' 2024-08-31T04:30:54.965 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18578 fp=#0x50000000eca' 2024-08-31T04:30:54.965 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18610 fp=#0x50000000aad' 2024-08-31T04:30:54.965 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18642 fp=#0x50000000ee1' 2024-08-31T04:30:54.966 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18674 fp=#0x50000000d71' 2024-08-31T04:30:54.966 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18706 fp=#0x50000000d25' 2024-08-31T04:30:54.966 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18738 fp=#0x50000000d3c' 2024-08-31T04:30:54.967 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18770 fp=#0x50000000d66' 2024-08-31T04:30:54.967 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18834 fp=#0x50000000df2' 2024-08-31T04:30:54.967 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18866 fp=#0x50000000d96' 2024-08-31T04:30:54.968 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18898 fp=#0x50000000f0d' 2024-08-31T04:30:54.968 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18930 fp=#0x5000000144d' 2024-08-31T04:30:54.968 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18962 fp=#0x50000000d7e' 2024-08-31T04:30:54.969 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18994 fp=#0x50000000d80' 2024-08-31T04:30:54.969 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19026 fp=#0x50000000df7' 2024-08-31T04:30:54.969 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19058 fp=#0x500000017a3' 2024-08-31T04:30:54.970 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19186 fp=#0x500000017ab' 2024-08-31T04:30:54.971 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19250 fp=#0x500000017b8' 2024-08-31T04:30:54.971 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19314 fp=#0x50000001c2f' 2024-08-31T04:30:54.972 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19346 fp=#0x50000001c57' 2024-08-31T04:30:54.972 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19378 fp=#0x500000017d2' 2024-08-31T04:30:54.972 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19410 fp=#0x500000017f0' 2024-08-31T04:30:54.973 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19442 fp=#0x50000001a10' 2024-08-31T04:30:54.973 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19474 fp=#0x5000000192d' 2024-08-31T04:30:54.973 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19506 fp=#0x500000019fc' 2024-08-31T04:30:54.974 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19538 fp=#0x500000019f1' 2024-08-31T04:30:54.974 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19570 fp=#0x5000000191f' 2024-08-31T04:30:54.974 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19602 fp=#0x5000000197e' 2024-08-31T04:30:54.975 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19666 fp=#0x10000003ea4' 2024-08-31T04:30:54.976 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19794 fp=#0x50000000977' 2024-08-31T04:30:54.976 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19826 fp=#0x5000000112e' 2024-08-31T04:30:54.976 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19858 fp=#0x500000016a8' 2024-08-31T04:30:54.977 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19890 fp=#0x5000000116c' 2024-08-31T04:30:54.977 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19922 fp=#0x50000000f74' 2024-08-31T04:30:54.977 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19954 fp=#0x50000000f6e' 2024-08-31T04:30:54.978 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19986 fp=#0x500000011aa' 2024-08-31T04:30:54.978 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20018 fp=#0x50000001cc1' 2024-08-31T04:30:54.978 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20050 fp=#0x50000000f97' 2024-08-31T04:30:54.979 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20082 fp=#0x50000001ce3' 2024-08-31T04:30:54.979 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20114 fp=#0x500000010db' 2024-08-31T04:30:54.979 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20146 fp=#0x5000000109e' 2024-08-31T04:30:54.980 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20178 fp=#0x500000012c1' 2024-08-31T04:30:54.980 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20210 fp=#0x50000001027' 2024-08-31T04:30:54.980 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20242 fp=#0x50000001030' 2024-08-31T04:30:54.981 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20274 fp=#0x50000001c81' 2024-08-31T04:30:54.981 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20306 fp=#0x10000000e3b' 2024-08-31T04:30:54.981 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20338 fp=#0x10000000f95' 2024-08-31T04:30:54.982 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20370 fp=#0x10000000f69' 2024-08-31T04:30:54.982 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20402 fp=#0x10000000f17' 2024-08-31T04:30:54.982 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20434 fp=#0x200000003f5' 2024-08-31T04:30:54.983 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20498 fp=#0x100000032fc' 2024-08-31T04:30:54.983 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20530 fp=#0x1000000317c' 2024-08-31T04:30:54.984 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20562 fp=#0x500000018c8' 2024-08-31T04:30:54.984 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20594 fp=#0x500000019ac' 2024-08-31T04:30:54.984 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20626 fp=#0x20000001216' 2024-08-31T04:30:54.984 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20658 fp=#0x10000003202' 2024-08-31T04:30:54.985 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20690 fp=#0x100000032ec' 2024-08-31T04:30:54.985 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20722 fp=#0x500000018e2' 2024-08-31T04:30:54.985 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20754 fp=#0x10000002b8e' 2024-08-31T04:30:54.986 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20786 fp=#0x20000000340' 2024-08-31T04:30:54.986 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20818 fp=#0x10000002b9d' 2024-08-31T04:30:54.986 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20850 fp=#0x20000000584' 2024-08-31T04:30:54.987 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20882 fp=#0x10000002b3b' 2024-08-31T04:30:54.987 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20914 fp=#0x10000002acb' 2024-08-31T04:30:54.987 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20946 fp=#0x2000000033c' 2024-08-31T04:30:54.988 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20978 fp=#0x10000001a3a' 2024-08-31T04:30:54.988 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:21010 fp=#0x10000001b1d' 2024-08-31T04:30:54.988 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:21042 fp=#0x10000001bb2' 2024-08-31T04:30:54.989 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:21074 fp=#0x10000001bbe' 2024-08-31T04:30:54.989 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:21106 fp=#0x30000000666' 2024-08-31T04:30:54.989 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:21138 fp=#0x10000001ec9' 2024-08-31T04:30:54.990 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:21170 fp=#0x10000001ea4' 2024-08-31T04:30:54.990 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:21202 fp=#0x3000000069b' 2024-08-31T04:30:54.990 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:21234 fp=#0x10000001ee1' 2024-08-31T04:30:54.991 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:21266 fp=#0x30000000679' 2024-08-31T04:30:54.991 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:21298 fp=#0x10000001ed3' 2024-08-31T04:30:54.992 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:10196 fp=#0x5000000068a' 2024-08-31T04:30:54.993 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:10228 fp=#0x50000000958' 2024-08-31T04:30:55.014 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13076 fp=#0x30000002ad1' 2024-08-31T04:30:55.014 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13108 fp=#0x50000001795' 2024-08-31T04:30:55.015 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13268 fp=#0x400000017cc' 2024-08-31T04:30:55.016 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13300 fp=#0x30000001a4f' 2024-08-31T04:30:55.016 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13332 fp=#0x30000001ae1' 2024-08-31T04:30:55.016 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13364 fp=#0x30000002b9a' 2024-08-31T04:30:55.017 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13396 fp=#0x30000002b82' 2024-08-31T04:30:55.017 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13428 fp=#0x3000000279f' 2024-08-31T04:30:55.017 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13460 fp=#0x3000000274d' 2024-08-31T04:30:55.018 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13492 fp=#0x30000002760' 2024-08-31T04:30:55.018 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13556 fp=#0x40000000fc5' 2024-08-31T04:30:55.018 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13588 fp=#0x500000011b5' 2024-08-31T04:30:55.019 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13716 fp=#0x300000028a5' 2024-08-31T04:30:55.021 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13940 fp=#0x5000000193f' 2024-08-31T04:30:55.022 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14099 fp=#0x50000000caa' 2024-08-31T04:30:55.023 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14163 fp=#0x50000000c8c' 2024-08-31T04:30:55.023 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14195 fp=#0x50000000c65' 2024-08-31T04:30:55.024 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14227 fp=#0x50000000c68' 2024-08-31T04:30:55.024 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14259 fp=#0x10000003ae0' 2024-08-31T04:30:55.025 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14387 fp=#0x50000000c06' 2024-08-31T04:30:55.025 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14419 fp=#0x50000000b83' 2024-08-31T04:30:55.026 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14451 fp=#0x50000000b90' 2024-08-31T04:30:55.026 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14483 fp=#0x50000000b72' 2024-08-31T04:30:55.026 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14515 fp=#0x50000000be7' 2024-08-31T04:30:55.027 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14547 fp=#0x50000000b9e' 2024-08-31T04:30:55.027 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14579 fp=#0x50000001b15' 2024-08-31T04:30:55.027 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14611 fp=#0x50000001b0e' 2024-08-31T04:30:55.028 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14643 fp=#0x50000001b54' 2024-08-31T04:30:55.028 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14675 fp=#0x50000001b5d' 2024-08-31T04:30:55.028 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14707 fp=#0x50000001b13' 2024-08-31T04:30:55.028 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14739 fp=#0x50000001d02' 2024-08-31T04:30:55.029 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14771 fp=#0x50000001481' 2024-08-31T04:30:55.029 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14803 fp=#0x50000001802' 2024-08-31T04:30:55.029 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14835 fp=#0x50000000e0f' 2024-08-31T04:30:55.030 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14867 fp=#0x50000000e34' 2024-08-31T04:30:55.030 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14899 fp=#0x5000000187e' 2024-08-31T04:30:55.030 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14931 fp=#0x50000000e80' 2024-08-31T04:30:55.031 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14963 fp=#0x50000001878' 2024-08-31T04:30:55.031 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15027 fp=#0x50000001b4a' 2024-08-31T04:30:55.032 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15155 fp=#0x50000001a8d' 2024-08-31T04:30:55.032 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15187 fp=#0x50000001013' 2024-08-31T04:30:55.033 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15219 fp=#0x50000001ac7' 2024-08-31T04:30:55.033 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15283 fp=#0x5000000153d' 2024-08-31T04:30:55.034 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15315 fp=#0x500000014f6' 2024-08-31T04:30:55.034 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15347 fp=#0x50000001541' 2024-08-31T04:30:55.034 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15379 fp=#0x50000001540' 2024-08-31T04:30:55.035 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15411 fp=#0x500000010fc' 2024-08-31T04:30:55.035 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15443 fp=#0x500000010a0' 2024-08-31T04:30:55.035 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15475 fp=#0x500000010f3' 2024-08-31T04:30:55.037 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15763 fp=#0x50000001bf7' 2024-08-31T04:30:55.038 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15795 fp=#0x50000001c12' 2024-08-31T04:30:55.038 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15859 fp=#0x50000001c02' 2024-08-31T04:30:55.038 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15891 fp=#0x50000001730' 2024-08-31T04:30:55.039 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15923 fp=#0x50000001703' 2024-08-31T04:30:55.039 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15955 fp=#0x50000001706' 2024-08-31T04:30:55.040 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16115 fp=#0x500000011b3' 2024-08-31T04:30:55.043 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16531 fp=#0x500000009d0' 2024-08-31T04:30:55.043 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16563 fp=#0x50000001962' 2024-08-31T04:30:55.044 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16595 fp=#0x5000000174c' 2024-08-31T04:30:55.045 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16755 fp=#0x50000001a69' 2024-08-31T04:30:55.045 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16787 fp=#0x50000001aad' 2024-08-31T04:30:55.046 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16819 fp=#0x50000001bd5' 2024-08-31T04:30:55.046 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16851 fp=#0x50000001bc7' 2024-08-31T04:30:55.046 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16883 fp=#0x50000001b9c' 2024-08-31T04:30:55.047 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16915 fp=#0x50000000a8a' 2024-08-31T04:30:55.047 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16947 fp=#0x50000000a74' 2024-08-31T04:30:55.047 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16979 fp=#0x5000000158a' 2024-08-31T04:30:55.047 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17011 fp=#0x50000001621' 2024-08-31T04:30:55.048 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17043 fp=#0x50000001581' 2024-08-31T04:30:55.048 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17075 fp=#0x50000001594' 2024-08-31T04:30:55.049 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17235 fp=#0x50000001616' 2024-08-31T04:30:55.050 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17267 fp=#0x500000015ad' 2024-08-31T04:30:55.050 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17299 fp=#0x50000001580' 2024-08-31T04:30:55.050 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17331 fp=#0x1000000379b' 2024-08-31T04:30:55.051 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17363 fp=#0x100000035bd' 2024-08-31T04:30:55.051 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17395 fp=#0x100000036d9' 2024-08-31T04:30:55.051 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17427 fp=#0x10000003670' 2024-08-31T04:30:55.051 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17459 fp=#0x10000003647' 2024-08-31T04:30:55.052 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17491 fp=#0x1000000373a' 2024-08-31T04:30:55.052 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17587 fp=#0x500000012c3' 2024-08-31T04:30:55.053 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17619 fp=#0x500000012d3' 2024-08-31T04:30:55.053 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17651 fp=#0x500000012d1' 2024-08-31T04:30:55.053 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17683 fp=#0x1000000234a' 2024-08-31T04:30:55.055 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17875 fp=#0x50000001615' 2024-08-31T04:30:55.055 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17907 fp=#0x5000000169f' 2024-08-31T04:30:55.055 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17939 fp=#0x5000000166e' 2024-08-31T04:30:55.056 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17971 fp=#0x500000009ff' 2024-08-31T04:30:55.056 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18003 fp=#0x50000001aaa' 2024-08-31T04:30:55.057 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18067 fp=#0x50000001a3b' 2024-08-31T04:30:55.057 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18131 fp=#0x50000001a30' 2024-08-31T04:30:55.057 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18163 fp=#0x50000000913' 2024-08-31T04:30:55.058 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18227 fp=#0x500000018f9' 2024-08-31T04:30:55.059 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18291 fp=#0x50000000e31' 2024-08-31T04:30:55.059 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18355 fp=#0x50000000ea5' 2024-08-31T04:30:55.060 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18483 fp=#0x10000000428' 2024-08-31T04:30:55.061 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18579 fp=#0x50000000ed1' 2024-08-31T04:30:55.061 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18611 fp=#0x50000000eec' 2024-08-31T04:30:55.062 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18643 fp=#0x50000000aca' 2024-08-31T04:30:55.062 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18675 fp=#0x50000000d7a' 2024-08-31T04:30:55.062 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18707 fp=#0x50000000d00' 2024-08-31T04:30:55.062 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18739 fp=#0x50000000d53' 2024-08-31T04:30:55.063 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18771 fp=#0x50000000d0f' 2024-08-31T04:30:55.063 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18803 fp=#0x500000011d3' 2024-08-31T04:30:55.063 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18835 fp=#0x50000000da2' 2024-08-31T04:30:55.064 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18867 fp=#0x50000000f25' 2024-08-31T04:30:55.064 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18899 fp=#0x50000000efd' 2024-08-31T04:30:55.064 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18931 fp=#0x500000019c9' 2024-08-31T04:30:55.065 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18963 fp=#0x50000000f1c' 2024-08-31T04:30:55.065 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18995 fp=#0x50000000eff' 2024-08-31T04:30:55.065 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19027 fp=#0x50000000d85' 2024-08-31T04:30:55.066 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19123 fp=#0x500000017ad' 2024-08-31T04:30:55.066 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19155 fp=#0x50000001801' 2024-08-31T04:30:55.067 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19251 fp=#0x500000017c5' 2024-08-31T04:30:55.068 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19315 fp=#0x50000001818' 2024-08-31T04:30:55.068 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19347 fp=#0x50000001c56' 2024-08-31T04:30:55.068 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19379 fp=#0x50000001c3d' 2024-08-31T04:30:55.068 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19411 fp=#0x50000001c4e' 2024-08-31T04:30:55.069 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19443 fp=#0x50000001a09' 2024-08-31T04:30:55.069 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19475 fp=#0x50000001974' 2024-08-31T04:30:55.069 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19507 fp=#0x50000001937' 2024-08-31T04:30:55.070 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19539 fp=#0x50000001978' 2024-08-31T04:30:55.070 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19571 fp=#0x500000019a0' 2024-08-31T04:30:55.070 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19603 fp=#0x5000000199c' 2024-08-31T04:30:55.071 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19635 fp=#0x10000003eb5' 2024-08-31T04:30:55.071 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19667 fp=#0x50000001443' 2024-08-31T04:30:55.071 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19699 fp=#0x10000003ecc' 2024-08-31T04:30:55.071 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19731 fp=#0x10000003e3a' 2024-08-31T04:30:55.072 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19795 fp=#0x50000000989' 2024-08-31T04:30:55.072 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19827 fp=#0x50000001172' 2024-08-31T04:30:55.073 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19859 fp=#0x50000001934' 2024-08-31T04:30:55.073 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19891 fp=#0x50000001143' 2024-08-31T04:30:55.073 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19923 fp=#0x50000000fb2' 2024-08-31T04:30:55.074 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19955 fp=#0x50000001cb3' 2024-08-31T04:30:55.074 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19987 fp=#0x50000001cad' 2024-08-31T04:30:55.074 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20019 fp=#0x50000001c99' 2024-08-31T04:30:55.074 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20051 fp=#0x50000000fa7' 2024-08-31T04:30:55.075 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20083 fp=#0x50000001cdb' 2024-08-31T04:30:55.075 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20115 fp=#0x50000001029' 2024-08-31T04:30:55.075 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20147 fp=#0x5000000102b' 2024-08-31T04:30:55.075 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20179 fp=#0x50000001071' 2024-08-31T04:30:55.076 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20211 fp=#0x500000010b8' 2024-08-31T04:30:55.076 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20243 fp=#0x5000000107a' 2024-08-31T04:30:55.076 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20275 fp=#0x500000011b2' 2024-08-31T04:30:55.077 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20307 fp=#0x10000001055' 2024-08-31T04:30:55.077 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20339 fp=#0x10000000f4b' 2024-08-31T04:30:55.077 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20371 fp=#0x200000003c6' 2024-08-31T04:30:55.078 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20403 fp=#0x200000002e9' 2024-08-31T04:30:55.078 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20435 fp=#0x10000000dd4' 2024-08-31T04:30:55.078 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20467 fp=#0x200000003ed' 2024-08-31T04:30:55.078 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20499 fp=#0x500000018c4' 2024-08-31T04:30:55.079 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20531 fp=#0x500000018d8' 2024-08-31T04:30:55.079 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20563 fp=#0x50000001908' 2024-08-31T04:30:55.079 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20595 fp=#0x50000001960' 2024-08-31T04:30:55.080 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20627 fp=#0x10000003240' 2024-08-31T04:30:55.080 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20659 fp=#0x10000003300' 2024-08-31T04:30:55.080 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20691 fp=#0x500000018d1' 2024-08-31T04:30:55.081 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20723 fp=#0x100000031e7' 2024-08-31T04:30:55.081 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20755 fp=#0x20000000357' 2024-08-31T04:30:55.081 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20787 fp=#0x20000000336' 2024-08-31T04:30:55.082 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20819 fp=#0x20000001223' 2024-08-31T04:30:55.082 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20851 fp=#0x200000011db' 2024-08-31T04:30:55.082 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20883 fp=#0x10000002baf' 2024-08-31T04:30:55.082 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20915 fp=#0x10000002b75' 2024-08-31T04:30:55.083 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20947 fp=#0x10000002aca' 2024-08-31T04:30:55.083 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20979 fp=#0x10000001a86' 2024-08-31T04:30:55.083 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:21011 fp=#0x10000001be1' 2024-08-31T04:30:55.084 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:21043 fp=#0x10000001aba' 2024-08-31T04:30:55.084 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:21075 fp=#0x500000012cd' 2024-08-31T04:30:55.084 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:21107 fp=#0x10000001e38' 2024-08-31T04:30:55.084 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:21139 fp=#0x10000001e9a' 2024-08-31T04:30:55.085 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:21171 fp=#0x50000001c25' 2024-08-31T04:30:55.085 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:21203 fp=#0x10000001ebf' 2024-08-31T04:30:55.085 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:21235 fp=#0x10000001ee9' 2024-08-31T04:30:55.086 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:21267 fp=#0x30000000686' 2024-08-31T04:30:55.086 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:21299 fp=#0x10000001ea6' 2024-08-31T04:30:55.086 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:10069 fp=#0x30000001b5e' 2024-08-31T04:30:55.087 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:10197 fp=#0x5000000064b' 2024-08-31T04:30:55.088 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:10229 fp=#0x50000001115' 2024-08-31T04:30:55.107 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:12949 fp=#0x50000001192' 2024-08-31T04:30:55.108 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13077 fp=#0x30000002b1b' 2024-08-31T04:30:55.108 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13109 fp=#0x40000001735' 2024-08-31T04:30:55.110 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13301 fp=#0x30000001b01' 2024-08-31T04:30:55.110 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13333 fp=#0x30000002b89' 2024-08-31T04:30:55.110 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13365 fp=#0x30000001ad1' 2024-08-31T04:30:55.111 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13397 fp=#0x30000001ae6' 2024-08-31T04:30:55.111 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13429 fp=#0x30000002769' 2024-08-31T04:30:55.111 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13461 fp=#0x30000002753' 2024-08-31T04:30:55.111 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13493 fp=#0x3000000277a' 2024-08-31T04:30:55.112 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13557 fp=#0x50000000f69' 2024-08-31T04:30:55.112 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13589 fp=#0x40000000f94' 2024-08-31T04:30:55.113 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13621 fp=#0x30000002379' 2024-08-31T04:30:55.113 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13685 fp=#0x3000000228d' 2024-08-31T04:30:55.116 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14068 fp=#0x50000000c55' 2024-08-31T04:30:55.116 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14100 fp=#0x50000000c92' 2024-08-31T04:30:55.117 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14132 fp=#0x50000000c3e' 2024-08-31T04:30:55.117 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14164 fp=#0x50000000ca3' 2024-08-31T04:30:55.117 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14196 fp=#0x50000000c50' 2024-08-31T04:30:55.117 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14228 fp=#0x5000000142f' 2024-08-31T04:30:55.118 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14324 fp=#0x10000003b07' 2024-08-31T04:30:55.119 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14388 fp=#0x50000000b64' 2024-08-31T04:30:55.119 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14420 fp=#0x50000000baa' 2024-08-31T04:30:55.119 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14452 fp=#0x50000000bbc' 2024-08-31T04:30:55.119 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14484 fp=#0x50000000bcc' 2024-08-31T04:30:55.120 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14516 fp=#0x50000000b92' 2024-08-31T04:30:55.120 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14548 fp=#0x50000000bb6' 2024-08-31T04:30:55.120 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14580 fp=#0x50000001b29' 2024-08-31T04:30:55.121 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14612 fp=#0x50000001b67' 2024-08-31T04:30:55.121 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14644 fp=#0x50000001b31' 2024-08-31T04:30:55.121 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14676 fp=#0x50000001b2d' 2024-08-31T04:30:55.122 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14708 fp=#0x50000001b68' 2024-08-31T04:30:55.122 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14740 fp=#0x50000001464' 2024-08-31T04:30:55.122 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14772 fp=#0x500000014af' 2024-08-31T04:30:55.123 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14804 fp=#0x5000000149a' 2024-08-31T04:30:55.123 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14836 fp=#0x50000000ea2' 2024-08-31T04:30:55.123 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14868 fp=#0x50000000e60' 2024-08-31T04:30:55.123 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14900 fp=#0x50000000e53' 2024-08-31T04:30:55.124 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14932 fp=#0x50000000e28' 2024-08-31T04:30:55.124 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14964 fp=#0x50000001872' 2024-08-31T04:30:55.125 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15156 fp=#0x50000000fef' 2024-08-31T04:30:55.126 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15188 fp=#0x50000000fea' 2024-08-31T04:30:55.126 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15220 fp=#0x50000001010' 2024-08-31T04:30:55.126 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15252 fp=#0x50000001a81' 2024-08-31T04:30:55.127 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15284 fp=#0x500000014fe' 2024-08-31T04:30:55.127 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15316 fp=#0x50000001519' 2024-08-31T04:30:55.127 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15348 fp=#0x5000000151b' 2024-08-31T04:30:55.127 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15380 fp=#0x50000001512' 2024-08-31T04:30:55.128 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15412 fp=#0x500000010f6' 2024-08-31T04:30:55.128 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15444 fp=#0x500000010fe' 2024-08-31T04:30:55.128 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15476 fp=#0x500000010de' 2024-08-31T04:30:55.131 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15892 fp=#0x500000016f1' 2024-08-31T04:30:55.131 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15924 fp=#0x5000000170f' 2024-08-31T04:30:55.132 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15956 fp=#0x50000001721' 2024-08-31T04:30:55.132 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16020 fp=#0x5000000101d' 2024-08-31T04:30:55.136 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16532 fp=#0x500000009db' 2024-08-31T04:30:55.136 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16564 fp=#0x50000001970' 2024-08-31T04:30:55.136 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16596 fp=#0x5000000175c' 2024-08-31T04:30:55.137 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16660 fp=#0x50000001d05' 2024-08-31T04:30:55.141 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16724 fp=#0x50000001ab2' 2024-08-31T04:30:55.142 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16820 fp=#0x50000001bc9' 2024-08-31T04:30:55.142 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16852 fp=#0x50000000b4a' 2024-08-31T04:30:55.143 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16884 fp=#0x50000000b3a' 2024-08-31T04:30:55.143 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16916 fp=#0x50000000a77' 2024-08-31T04:30:55.143 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16948 fp=#0x50000000a58' 2024-08-31T04:30:55.144 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16980 fp=#0x50000001693' 2024-08-31T04:30:55.144 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17012 fp=#0x50000001656' 2024-08-31T04:30:55.144 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17044 fp=#0x5000000166d' 2024-08-31T04:30:55.145 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17076 fp=#0x50000001655' 2024-08-31T04:30:55.145 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17108 fp=#0x10000003ea2' 2024-08-31T04:30:55.146 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17236 fp=#0x50000001630' 2024-08-31T04:30:55.146 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17268 fp=#0x50000001595' 2024-08-31T04:30:55.146 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17300 fp=#0x500000015a0' 2024-08-31T04:30:55.147 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17332 fp=#0x100000035d8' 2024-08-31T04:30:55.147 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17364 fp=#0x100000035b5' 2024-08-31T04:30:55.147 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17396 fp=#0x100000035b0' 2024-08-31T04:30:55.148 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17428 fp=#0x1000000361d' 2024-08-31T04:30:55.148 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17460 fp=#0x100000035ba' 2024-08-31T04:30:55.148 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17492 fp=#0x100000035f4' 2024-08-31T04:30:55.149 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17524 fp=#0x500000012d5' 2024-08-31T04:30:55.149 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17588 fp=#0x50000001231' 2024-08-31T04:30:55.150 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17620 fp=#0x5000000123d' 2024-08-31T04:30:55.150 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17652 fp=#0x500000012b0' 2024-08-31T04:30:55.152 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17940 fp=#0x5000000163d' 2024-08-31T04:30:55.153 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18004 fp=#0x50000000929' 2024-08-31T04:30:55.153 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18036 fp=#0x50000000936' 2024-08-31T04:30:55.153 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18068 fp=#0x500000018b4' 2024-08-31T04:30:55.154 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18100 fp=#0x50000001a57' 2024-08-31T04:30:55.154 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18132 fp=#0x50000001a99' 2024-08-31T04:30:55.154 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18164 fp=#0x50000001020' 2024-08-31T04:30:55.154 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18196 fp=#0x50000001a38' 2024-08-31T04:30:55.155 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18260 fp=#0x50000000ea9' 2024-08-31T04:30:55.156 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18356 fp=#0x50000000e95' 2024-08-31T04:30:55.156 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18388 fp=#0x50000000e5c' 2024-08-31T04:30:55.157 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18484 fp=#0x50000000ed0' 2024-08-31T04:30:55.157 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18516 fp=#0x1000000042e' 2024-08-31T04:30:55.157 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18548 fp=#0x50000000eda' 2024-08-31T04:30:55.157 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18580 fp=#0x50000000ac2' 2024-08-31T04:30:55.158 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18612 fp=#0x50000000a9a' 2024-08-31T04:30:55.158 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18644 fp=#0x50000000aa4' 2024-08-31T04:30:55.158 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18676 fp=#0x50000000d29' 2024-08-31T04:30:55.159 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18708 fp=#0x50000000d2c' 2024-08-31T04:30:55.159 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18740 fp=#0x50000000d1c' 2024-08-31T04:30:55.159 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18772 fp=#0x50000000d0a' 2024-08-31T04:30:55.159 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18804 fp=#0x500000011ce' 2024-08-31T04:30:55.160 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18836 fp=#0x500000019b6' 2024-08-31T04:30:55.160 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18868 fp=#0x50000000dbd' 2024-08-31T04:30:55.160 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18900 fp=#0x500000019ad' 2024-08-31T04:30:55.161 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18932 fp=#0x50000000db9' 2024-08-31T04:30:55.161 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18964 fp=#0x50000000da7' 2024-08-31T04:30:55.161 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18996 fp=#0x50000000dc7' 2024-08-31T04:30:55.162 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19028 fp=#0x500000019d1' 2024-08-31T04:30:55.162 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19124 fp=#0x500000017bc' 2024-08-31T04:30:55.164 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19316 fp=#0x50000001c6d' 2024-08-31T04:30:55.164 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19348 fp=#0x5000000182a' 2024-08-31T04:30:55.164 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19380 fp=#0x50000001c65' 2024-08-31T04:30:55.165 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19412 fp=#0x500000017f5' 2024-08-31T04:30:55.165 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19444 fp=#0x5000000191d' 2024-08-31T04:30:55.165 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19476 fp=#0x500000019fd' 2024-08-31T04:30:55.166 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19508 fp=#0x50000001990' 2024-08-31T04:30:55.166 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19540 fp=#0x50000001993' 2024-08-31T04:30:55.166 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19572 fp=#0x50000001a05' 2024-08-31T04:30:55.166 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19604 fp=#0x500000019f9' 2024-08-31T04:30:55.167 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19636 fp=#0x10000003e45' 2024-08-31T04:30:55.167 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19668 fp=#0x10000003e34' 2024-08-31T04:30:55.167 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19700 fp=#0x10000003e63' 2024-08-31T04:30:55.168 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19732 fp=#0x10000003ed0' 2024-08-31T04:30:55.168 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19796 fp=#0x5000000098f' 2024-08-31T04:30:55.168 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19828 fp=#0x50000001171' 2024-08-31T04:30:55.169 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19860 fp=#0x5000000112c' 2024-08-31T04:30:55.169 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19892 fp=#0x5000000116f' 2024-08-31T04:30:55.169 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19924 fp=#0x50000001cb5' 2024-08-31T04:30:55.170 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19956 fp=#0x50000000f71' 2024-08-31T04:30:55.170 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19988 fp=#0x50000001ca5' 2024-08-31T04:30:55.170 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20020 fp=#0x50000001c9c' 2024-08-31T04:30:55.171 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20052 fp=#0x50000000fb3' 2024-08-31T04:30:55.171 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20084 fp=#0x50000001cd6' 2024-08-31T04:30:55.171 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20116 fp=#0x5000000105b' 2024-08-31T04:30:55.172 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20148 fp=#0x50000001079' 2024-08-31T04:30:55.172 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20180 fp=#0x500000010ca' 2024-08-31T04:30:55.172 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20212 fp=#0x5000000104c' 2024-08-31T04:30:55.172 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20244 fp=#0x500000011a7' 2024-08-31T04:30:55.173 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20276 fp=#0x50000001c85' 2024-08-31T04:30:55.173 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20308 fp=#0x10000000f3c' 2024-08-31T04:30:55.174 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20372 fp=#0x200000003c0' 2024-08-31T04:30:55.174 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20404 fp=#0x2000000020c' 2024-08-31T04:30:55.174 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20436 fp=#0x10000000f61' 2024-08-31T04:30:55.175 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20468 fp=#0x200000003c8' 2024-08-31T04:30:55.175 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20500 fp=#0x20000000618' 2024-08-31T04:30:55.175 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20532 fp=#0x100000032bb' 2024-08-31T04:30:55.175 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20564 fp=#0x100000031f9' 2024-08-31T04:30:55.176 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20596 fp=#0x10000003192' 2024-08-31T04:30:55.176 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20628 fp=#0x100000032b2' 2024-08-31T04:30:55.176 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20660 fp=#0x1000000329c' 2024-08-31T04:30:55.177 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20692 fp=#0x5000000190c' 2024-08-31T04:30:55.177 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20724 fp=#0x100000031f2' 2024-08-31T04:30:55.177 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20756 fp=#0x10000002b19' 2024-08-31T04:30:55.177 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20788 fp=#0x10000002b97' 2024-08-31T04:30:55.178 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20820 fp=#0x2000000033a' 2024-08-31T04:30:55.178 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20852 fp=#0x10000002b8c' 2024-08-31T04:30:55.178 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20884 fp=#0x2000000032c' 2024-08-31T04:30:55.179 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20916 fp=#0x20000000343' 2024-08-31T04:30:55.179 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20948 fp=#0x10000002b08' 2024-08-31T04:30:55.179 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20980 fp=#0x10000001bed' 2024-08-31T04:30:55.180 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:21012 fp=#0x10000001ba6' 2024-08-31T04:30:55.180 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:21044 fp=#0x10000001b38' 2024-08-31T04:30:55.180 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:21076 fp=#0x10000001b67' 2024-08-31T04:30:55.181 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:21108 fp=#0x10000001e60' 2024-08-31T04:30:55.181 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:21140 fp=#0x10000001ee7' 2024-08-31T04:30:55.181 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:21172 fp=#0x3000000067f' 2024-08-31T04:30:55.182 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:21204 fp=#0x3000000066e' 2024-08-31T04:30:55.182 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:21236 fp=#0x30000000684' 2024-08-31T04:30:55.182 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:21268 fp=#0x30000000674' 2024-08-31T04:30:55.182 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:21300 fp=#0x50000001bab' 2024-08-31T04:30:55.184 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:10230 fp=#0x50000000f6a' 2024-08-31T04:30:55.205 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13078 fp=#0x30000002ad4' 2024-08-31T04:30:55.206 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13270 fp=#0x50000001783' 2024-08-31T04:30:55.207 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13302 fp=#0x30000001a9c' 2024-08-31T04:30:55.207 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13334 fp=#0x30000002b88' 2024-08-31T04:30:55.207 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13366 fp=#0x30000002b4b' 2024-08-31T04:30:55.208 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13398 fp=#0x30000001ad3' 2024-08-31T04:30:55.208 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13430 fp=#0x3000000279d' 2024-08-31T04:30:55.208 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13462 fp=#0x3000000276c' 2024-08-31T04:30:55.209 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13494 fp=#0x30000002775' 2024-08-31T04:30:55.209 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13558 fp=#0x4000000126c' 2024-08-31T04:30:55.213 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14069 fp=#0x50000000cbe' 2024-08-31T04:30:55.214 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14101 fp=#0x50000000c62' 2024-08-31T04:30:55.214 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14133 fp=#0x50000000c48' 2024-08-31T04:30:55.214 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14165 fp=#0x50000000c53' 2024-08-31T04:30:55.214 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14197 fp=#0x50000000c83' 2024-08-31T04:30:55.215 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14229 fp=#0x50000000c96' 2024-08-31T04:30:55.216 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14357 fp=#0x10000003b32' 2024-08-31T04:30:55.216 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14389 fp=#0x50000000c01' 2024-08-31T04:30:55.216 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14421 fp=#0x50000000bf7' 2024-08-31T04:30:55.217 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14453 fp=#0x50000000bc0' 2024-08-31T04:30:55.217 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14485 fp=#0x50000000ba5' 2024-08-31T04:30:55.217 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14517 fp=#0x50000000bbe' 2024-08-31T04:30:55.218 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14549 fp=#0x50000000bdf' 2024-08-31T04:30:55.218 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14581 fp=#0x50000001b25' 2024-08-31T04:30:55.218 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14613 fp=#0x50000001b03' 2024-08-31T04:30:55.219 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14645 fp=#0x50000001af8' 2024-08-31T04:30:55.219 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14677 fp=#0x50000001b09' 2024-08-31T04:30:55.219 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14709 fp=#0x50000001473' 2024-08-31T04:30:55.220 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14741 fp=#0x500000014e0' 2024-08-31T04:30:55.220 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14773 fp=#0x50000001484' 2024-08-31T04:30:55.220 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14805 fp=#0x500000014d3' 2024-08-31T04:30:55.221 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14837 fp=#0x50000000e6c' 2024-08-31T04:30:55.221 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14869 fp=#0x50000000e65' 2024-08-31T04:30:55.221 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14901 fp=#0x50000000e46' 2024-08-31T04:30:55.222 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14933 fp=#0x50000000e5b' 2024-08-31T04:30:55.222 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14965 fp=#0x50000000e6a' 2024-08-31T04:30:55.224 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15157 fp=#0x50000001017' 2024-08-31T04:30:55.224 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15189 fp=#0x50000000ff5' 2024-08-31T04:30:55.224 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15221 fp=#0x50000001006' 2024-08-31T04:30:55.225 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15285 fp=#0x50000001514' 2024-08-31T04:30:55.225 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15317 fp=#0x50000001cf8' 2024-08-31T04:30:55.225 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15349 fp=#0x50000001537' 2024-08-31T04:30:55.226 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15381 fp=#0x50000001108' 2024-08-31T04:30:55.226 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15413 fp=#0x500000010e4' 2024-08-31T04:30:55.226 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15445 fp=#0x500000010a5' 2024-08-31T04:30:55.227 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15477 fp=#0x500000010bd' 2024-08-31T04:30:55.229 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15765 fp=#0x50000001bb9' 2024-08-31T04:30:55.229 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15797 fp=#0x50000001be1' 2024-08-31T04:30:55.229 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15829 fp=#0x50000000cd4' 2024-08-31T04:30:55.230 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15893 fp=#0x50000001705' 2024-08-31T04:30:55.230 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15925 fp=#0x50000001739' 2024-08-31T04:30:55.231 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15957 fp=#0x5000000171d' 2024-08-31T04:30:55.233 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16213 fp=#0x500000012b8' 2024-08-31T04:30:55.235 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16533 fp=#0x50000000cd9' 2024-08-31T04:30:55.236 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16565 fp=#0x50000001975' 2024-08-31T04:30:55.236 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16597 fp=#0x50000001750' 2024-08-31T04:30:55.236 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16629 fp=#0x50000001d25' 2024-08-31T04:30:55.236 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16661 fp=#0x50000001d10' 2024-08-31T04:30:55.237 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16725 fp=#0x50000001d24' 2024-08-31T04:30:55.238 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16821 fp=#0x50000001bd0' 2024-08-31T04:30:55.238 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16853 fp=#0x50000000b45' 2024-08-31T04:30:55.239 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16917 fp=#0x50000001433' 2024-08-31T04:30:55.239 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16949 fp=#0x50000000a6b' 2024-08-31T04:30:55.239 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16981 fp=#0x50000001560' 2024-08-31T04:30:55.239 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17013 fp=#0x50000001574' 2024-08-31T04:30:55.240 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17045 fp=#0x500000015e6' 2024-08-31T04:30:55.240 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17077 fp=#0x500000015c6' 2024-08-31T04:30:55.241 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17237 fp=#0x50000001577' 2024-08-31T04:30:55.242 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17269 fp=#0x500000015a8' 2024-08-31T04:30:55.242 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17301 fp=#0x500000015ba' 2024-08-31T04:30:55.242 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17333 fp=#0x1000000367d' 2024-08-31T04:30:55.243 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17365 fp=#0x100000035ea' 2024-08-31T04:30:55.243 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17397 fp=#0x1000000374b' 2024-08-31T04:30:55.243 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17429 fp=#0x10000003782' 2024-08-31T04:30:55.243 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17461 fp=#0x10000003638' 2024-08-31T04:30:55.244 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17493 fp=#0x100000036e6' 2024-08-31T04:30:55.247 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17941 fp=#0x50000001634' 2024-08-31T04:30:55.247 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17973 fp=#0x50000000a03' 2024-08-31T04:30:55.248 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18037 fp=#0x50000001a48' 2024-08-31T04:30:55.248 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18069 fp=#0x50000000934' 2024-08-31T04:30:55.249 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18133 fp=#0x50000000939' 2024-08-31T04:30:55.249 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18165 fp=#0x50000001a43' 2024-08-31T04:30:55.249 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18197 fp=#0x50000001a45' 2024-08-31T04:30:55.250 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18229 fp=#0x50000000921' 2024-08-31T04:30:55.250 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18293 fp=#0x50000000e66' 2024-08-31T04:30:55.250 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18325 fp=#0x50000000dcf' 2024-08-31T04:30:55.251 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18389 fp=#0x50000000e09' 2024-08-31T04:30:55.251 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18421 fp=#0x50000000e6d' 2024-08-31T04:30:55.252 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18485 fp=#0x1000000039f' 2024-08-31T04:30:55.252 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18517 fp=#0x100000003e6' 2024-08-31T04:30:55.252 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18549 fp=#0x50000000ed7' 2024-08-31T04:30:55.253 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18645 fp=#0x50000000afe' 2024-08-31T04:30:55.254 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18677 fp=#0x50000000d06' 2024-08-31T04:30:55.254 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18709 fp=#0x50000000d30' 2024-08-31T04:30:55.254 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18741 fp=#0x50000000d01' 2024-08-31T04:30:55.254 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18773 fp=#0x50000000d5d' 2024-08-31T04:30:55.255 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18805 fp=#0x500000011cd' 2024-08-31T04:30:55.255 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18837 fp=#0x50000000dba' 2024-08-31T04:30:55.255 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18869 fp=#0x500000019b0' 2024-08-31T04:30:55.256 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18901 fp=#0x50000000dca' 2024-08-31T04:30:55.256 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18933 fp=#0x500000019d6' 2024-08-31T04:30:55.256 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18965 fp=#0x50000000da6' 2024-08-31T04:30:55.256 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18997 fp=#0x50000000f08' 2024-08-31T04:30:55.257 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19029 fp=#0x50000000f2b' 2024-08-31T04:30:55.257 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19093 fp=#0x500000017e3' 2024-08-31T04:30:55.258 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19157 fp=#0x500000017b4' 2024-08-31T04:30:55.259 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19253 fp=#0x500000017b2' 2024-08-31T04:30:55.259 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19317 fp=#0x500000017d4' 2024-08-31T04:30:55.259 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19349 fp=#0x50000001c3b' 2024-08-31T04:30:55.260 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19381 fp=#0x50000001848' 2024-08-31T04:30:55.260 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19413 fp=#0x50000001c73' 2024-08-31T04:30:55.260 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19445 fp=#0x5000000197c' 2024-08-31T04:30:55.261 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19477 fp=#0x50000001927' 2024-08-31T04:30:55.261 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19509 fp=#0x5000000194e' 2024-08-31T04:30:55.261 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19541 fp=#0x50000001947' 2024-08-31T04:30:55.261 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19573 fp=#0x50000001958' 2024-08-31T04:30:55.262 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19605 fp=#0x5000000192c' 2024-08-31T04:30:55.262 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19669 fp=#0x10000003ec4' 2024-08-31T04:30:55.263 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19701 fp=#0x10000003dcf' 2024-08-31T04:30:55.263 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19733 fp=#0x10000003e7e' 2024-08-31T04:30:55.263 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19765 fp=#0x50000001444' 2024-08-31T04:30:55.263 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19797 fp=#0x5000000096e' 2024-08-31T04:30:55.264 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19829 fp=#0x5000000117a' 2024-08-31T04:30:55.264 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19861 fp=#0x50000001176' 2024-08-31T04:30:55.265 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19893 fp=#0x5000000114f' 2024-08-31T04:30:55.265 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19925 fp=#0x50000000f9f' 2024-08-31T04:30:55.265 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19957 fp=#0x50000001cb6' 2024-08-31T04:30:55.265 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19989 fp=#0x50000001cec' 2024-08-31T04:30:55.266 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20021 fp=#0x50000001ce6' 2024-08-31T04:30:55.266 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20053 fp=#0x50000001cbb' 2024-08-31T04:30:55.266 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20085 fp=#0x50000000f8c' 2024-08-31T04:30:55.267 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20117 fp=#0x500000010c7' 2024-08-31T04:30:55.267 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20149 fp=#0x50000001023' 2024-08-31T04:30:55.267 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20181 fp=#0x5000000106b' 2024-08-31T04:30:55.268 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20213 fp=#0x500000012cb' 2024-08-31T04:30:55.268 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20245 fp=#0x500000011a1' 2024-08-31T04:30:55.268 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20277 fp=#0x500000011a9' 2024-08-31T04:30:55.269 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20309 fp=#0x10000001061' 2024-08-31T04:30:55.269 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20341 fp=#0x10000000ed7' 2024-08-31T04:30:55.269 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20373 fp=#0x200000003f1' 2024-08-31T04:30:55.270 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20405 fp=#0x200000003a6' 2024-08-31T04:30:55.270 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20437 fp=#0x200000002ce' 2024-08-31T04:30:55.270 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20469 fp=#0x10000000fcd' 2024-08-31T04:30:55.271 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20501 fp=#0x100000031bf' 2024-08-31T04:30:55.271 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20533 fp=#0x100000032f5' 2024-08-31T04:30:55.271 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20565 fp=#0x500000018e3' 2024-08-31T04:30:55.272 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20597 fp=#0x1000000319d' 2024-08-31T04:30:55.272 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20629 fp=#0x500000018e6' 2024-08-31T04:30:55.272 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20661 fp=#0x500000018f2' 2024-08-31T04:30:55.273 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20693 fp=#0x500000018e4' 2024-08-31T04:30:55.273 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20757 fp=#0x20000000354' 2024-08-31T04:30:55.273 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20789 fp=#0x10000002b49' 2024-08-31T04:30:55.274 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20821 fp=#0x20000001246' 2024-08-31T04:30:55.274 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20853 fp=#0x10000002bad' 2024-08-31T04:30:55.274 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20885 fp=#0x10000002aba' 2024-08-31T04:30:55.275 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20917 fp=#0x10000002b11' 2024-08-31T04:30:55.275 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20949 fp=#0x10000002b0f' 2024-08-31T04:30:55.275 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20981 fp=#0x10000001b7e' 2024-08-31T04:30:55.276 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:21013 fp=#0x10000001a74' 2024-08-31T04:30:55.276 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:21045 fp=#0x10000001b53' 2024-08-31T04:30:55.276 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:21077 fp=#0x10000001a63' 2024-08-31T04:30:55.277 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:21109 fp=#0x10000001e58' 2024-08-31T04:30:55.277 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:21173 fp=#0x10000001ecf' 2024-08-31T04:30:55.278 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:21205 fp=#0x10000001edf' 2024-08-31T04:30:55.278 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:21237 fp=#0x10000001ec3' 2024-08-31T04:30:55.278 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:21269 fp=#0x50000001c67' 2024-08-31T04:30:55.279 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:21301 fp=#0x10000001ef7' 2024-08-31T04:30:55.280 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:10199 fp=#0x500000006f3' 2024-08-31T04:30:55.280 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:10231 fp=#0x50000001021' 2024-08-31T04:30:55.301 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13079 fp=#0x30000002b22' 2024-08-31T04:30:55.302 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13175 fp=#0x50000001195' 2024-08-31T04:30:55.302 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13239 fp=#0x40000001675' 2024-08-31T04:30:55.303 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13271 fp=#0x5000000178a' 2024-08-31T04:30:55.303 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13303 fp=#0x30000001aff' 2024-08-31T04:30:55.303 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13335 fp=#0x30000002b8a' 2024-08-31T04:30:55.304 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13367 fp=#0x30000001afd' 2024-08-31T04:30:55.304 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13399 fp=#0x30000002b9d' 2024-08-31T04:30:55.304 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13431 fp=#0x3000000279c' 2024-08-31T04:30:55.305 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13463 fp=#0x30000002754' 2024-08-31T04:30:55.305 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13495 fp=#0x30000002790' 2024-08-31T04:30:55.306 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13591 fp=#0x40000001502' 2024-08-31T04:30:55.306 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13623 fp=#0x3000000237b' 2024-08-31T04:30:55.307 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13655 fp=#0x30000002378' 2024-08-31T04:30:55.307 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13719 fp=#0x3000000285b' 2024-08-31T04:30:55.310 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14102 fp=#0x50000000ca1' 2024-08-31T04:30:55.311 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14198 fp=#0x50000000c90' 2024-08-31T04:30:55.311 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14230 fp=#0x50000000c88' 2024-08-31T04:30:55.312 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14390 fp=#0x50000000b76' 2024-08-31T04:30:55.313 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14422 fp=#0x50000000b6b' 2024-08-31T04:30:55.313 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14454 fp=#0x50000000bdd' 2024-08-31T04:30:55.313 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14486 fp=#0x50000000dea' 2024-08-31T04:30:55.314 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14518 fp=#0x50000000ba9' 2024-08-31T04:30:55.314 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14550 fp=#0x50000000bc1' 2024-08-31T04:30:55.314 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14582 fp=#0x50000001b0d' 2024-08-31T04:30:55.315 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14614 fp=#0x50000001b90' 2024-08-31T04:30:55.315 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14646 fp=#0x50000001afe' 2024-08-31T04:30:55.315 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14678 fp=#0x50000001b83' 2024-08-31T04:30:55.315 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14710 fp=#0x500000014e4' 2024-08-31T04:30:55.316 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14742 fp=#0x500000014cc' 2024-08-31T04:30:55.316 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14774 fp=#0x500000014ee' 2024-08-31T04:30:55.316 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14806 fp=#0x500000014c0' 2024-08-31T04:30:55.317 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14838 fp=#0x50000000ea6' 2024-08-31T04:30:55.317 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14870 fp=#0x50000001d69' 2024-08-31T04:30:55.317 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14902 fp=#0x50000001865' 2024-08-31T04:30:55.318 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14934 fp=#0x50000000e62' 2024-08-31T04:30:55.318 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14966 fp=#0x50000000e5f' 2024-08-31T04:30:55.319 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15158 fp=#0x50000001019' 2024-08-31T04:30:55.320 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15190 fp=#0x50000000fec' 2024-08-31T04:30:55.320 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15222 fp=#0x50000000fe8' 2024-08-31T04:30:55.321 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15254 fp=#0x50000000ff7' 2024-08-31T04:30:55.321 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15286 fp=#0x50000001528' 2024-08-31T04:30:55.321 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15318 fp=#0x50000001526' 2024-08-31T04:30:55.322 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15350 fp=#0x50000001547' 2024-08-31T04:30:55.322 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15382 fp=#0x50000001103' 2024-08-31T04:30:55.322 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15414 fp=#0x5000000110d' 2024-08-31T04:30:55.322 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15446 fp=#0x50000001b99' 2024-08-31T04:30:55.323 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15478 fp=#0x50000001098' 2024-08-31T04:30:55.324 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15702 fp=#0x5000000184e' 2024-08-31T04:30:55.325 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15734 fp=#0x50000001bdc' 2024-08-31T04:30:55.325 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15766 fp=#0x50000001c18' 2024-08-31T04:30:55.325 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15798 fp=#0x50000001c16' 2024-08-31T04:30:55.326 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15830 fp=#0x50000001be5' 2024-08-31T04:30:55.326 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15894 fp=#0x50000001701' 2024-08-31T04:30:55.326 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15926 fp=#0x500000016f5' 2024-08-31T04:30:55.327 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15958 fp=#0x50000001704' 2024-08-31T04:30:55.331 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16534 fp=#0x500000009cc' 2024-08-31T04:30:55.331 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16566 fp=#0x50000001961' 2024-08-31T04:30:55.331 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16598 fp=#0x50000001748' 2024-08-31T04:30:55.332 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16630 fp=#0x500000018c9' 2024-08-31T04:30:55.332 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16694 fp=#0x50000001d1b' 2024-08-31T04:30:55.333 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16822 fp=#0x50000001bce' 2024-08-31T04:30:55.334 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16854 fp=#0x500000016e0' 2024-08-31T04:30:55.334 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16886 fp=#0x50000000b42' 2024-08-31T04:30:55.334 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16918 fp=#0x50000001434' 2024-08-31T04:30:55.335 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16950 fp=#0x50000000a82' 2024-08-31T04:30:55.335 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16982 fp=#0x50000001567' 2024-08-31T04:30:55.335 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17014 fp=#0x5000000158f' 2024-08-31T04:30:55.336 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17046 fp=#0x500000015c8' 2024-08-31T04:30:55.336 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17078 fp=#0x5000000164a' 2024-08-31T04:30:55.337 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17206 fp=#0x10000003ee5' 2024-08-31T04:30:55.337 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17238 fp=#0x5000000158b' 2024-08-31T04:30:55.338 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17270 fp=#0x500000015c9' 2024-08-31T04:30:55.338 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17302 fp=#0x5000000159e' 2024-08-31T04:30:55.338 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17334 fp=#0x10000003792' 2024-08-31T04:30:55.339 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17366 fp=#0x1000000371f' 2024-08-31T04:30:55.339 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17398 fp=#0x10000003942' 2024-08-31T04:30:55.339 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17430 fp=#0x10000003688' 2024-08-31T04:30:55.340 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17462 fp=#0x10000003744' 2024-08-31T04:30:55.340 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17526 fp=#0x500000012c9' 2024-08-31T04:30:55.341 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17590 fp=#0x50000001259' 2024-08-31T04:30:55.341 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17654 fp=#0x1000000233a' 2024-08-31T04:30:55.342 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17782 fp=#0x1000000227d' 2024-08-31T04:30:55.343 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17878 fp=#0x50000001681' 2024-08-31T04:30:55.343 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17910 fp=#0x50000001687' 2024-08-31T04:30:55.343 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17942 fp=#0x50000001661' 2024-08-31T04:30:55.344 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17974 fp=#0x50000001669' 2024-08-31T04:30:55.344 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18006 fp=#0x50000001a6d' 2024-08-31T04:30:55.345 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18134 fp=#0x50000001a4e' 2024-08-31T04:30:55.346 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18166 fp=#0x50000000900' 2024-08-31T04:30:55.347 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18294 fp=#0x50000000e7d' 2024-08-31T04:30:55.347 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18326 fp=#0x50000000df6' 2024-08-31T04:30:55.348 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18390 fp=#0x50000001b9d' 2024-08-31T04:30:55.348 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18486 fp=#0x10000000455' 2024-08-31T04:30:55.349 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18518 fp=#0x10000000419' 2024-08-31T04:30:55.349 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18550 fp=#0x50000000eeb' 2024-08-31T04:30:55.349 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18582 fp=#0x50000000abe' 2024-08-31T04:30:55.350 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18646 fp=#0x50000000aba' 2024-08-31T04:30:55.350 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18678 fp=#0x50000000d75' 2024-08-31T04:30:55.350 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18710 fp=#0x50000000d45' 2024-08-31T04:30:55.351 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18742 fp=#0x50000000d64' 2024-08-31T04:30:55.351 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18774 fp=#0x500000018ac' 2024-08-31T04:30:55.351 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18806 fp=#0x500000011de' 2024-08-31T04:30:55.352 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18838 fp=#0x50000000e10' 2024-08-31T04:30:55.352 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18870 fp=#0x500000019bc' 2024-08-31T04:30:55.352 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18902 fp=#0x50000000f1a' 2024-08-31T04:30:55.353 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18934 fp=#0x50000000da1' 2024-08-31T04:30:55.353 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18966 fp=#0x50000000d8d' 2024-08-31T04:30:55.353 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18998 fp=#0x50000001454' 2024-08-31T04:30:55.354 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19030 fp=#0x50000000f00' 2024-08-31T04:30:55.356 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19254 fp=#0x5000000183f' 2024-08-31T04:30:55.356 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19318 fp=#0x50000001c50' 2024-08-31T04:30:55.357 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19350 fp=#0x50000001c3c' 2024-08-31T04:30:55.357 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19382 fp=#0x50000001c33' 2024-08-31T04:30:55.357 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19414 fp=#0x500000017ec' 2024-08-31T04:30:55.358 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19446 fp=#0x50000001a08' 2024-08-31T04:30:55.358 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19478 fp=#0x500000019f4' 2024-08-31T04:30:55.358 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19510 fp=#0x5000000195a' 2024-08-31T04:30:55.359 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19542 fp=#0x50000001a02' 2024-08-31T04:30:55.359 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19574 fp=#0x5000000199e' 2024-08-31T04:30:55.359 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19606 fp=#0x500000019e9' 2024-08-31T04:30:55.359 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19638 fp=#0x10000003e08' 2024-08-31T04:30:55.360 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19670 fp=#0x10000003ed5' 2024-08-31T04:30:55.361 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19766 fp=#0x10000003e04' 2024-08-31T04:30:55.361 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19798 fp=#0x5000000095a' 2024-08-31T04:30:55.361 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19830 fp=#0x50000001144' 2024-08-31T04:30:55.362 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19862 fp=#0x5000000169d' 2024-08-31T04:30:55.362 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19894 fp=#0x5000000111d' 2024-08-31T04:30:55.362 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19926 fp=#0x50000001ceb' 2024-08-31T04:30:55.363 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19958 fp=#0x50000000f99' 2024-08-31T04:30:55.363 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19990 fp=#0x50000000f7f' 2024-08-31T04:30:55.363 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20054 fp=#0x50000000f81' 2024-08-31T04:30:55.364 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20086 fp=#0x50000000f8a' 2024-08-31T04:30:55.364 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20118 fp=#0x50000001032' 2024-08-31T04:30:55.364 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20150 fp=#0x500000010cf' 2024-08-31T04:30:55.365 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20182 fp=#0x5000000104d' 2024-08-31T04:30:55.365 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20214 fp=#0x50000001047' 2024-08-31T04:30:55.365 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20246 fp=#0x50000001c86' 2024-08-31T04:30:55.366 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20278 fp=#0x50000001c83' 2024-08-31T04:30:55.366 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20310 fp=#0x10000000e73' 2024-08-31T04:30:55.366 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20342 fp=#0x10000000f1e' 2024-08-31T04:30:55.367 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20374 fp=#0x200000002fa' 2024-08-31T04:30:55.367 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20406 fp=#0x200000002e2' 2024-08-31T04:30:55.367 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20438 fp=#0x10000000e97' 2024-08-31T04:30:55.368 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20470 fp=#0x200000003da' 2024-08-31T04:30:55.368 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20502 fp=#0x100000031b3' 2024-08-31T04:30:55.368 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20534 fp=#0x1000000320f' 2024-08-31T04:30:55.369 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20566 fp=#0x500000018db' 2024-08-31T04:30:55.369 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20598 fp=#0x500000018fd' 2024-08-31T04:30:55.369 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20630 fp=#0x100000031e9' 2024-08-31T04:30:55.370 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20662 fp=#0x100000031aa' 2024-08-31T04:30:55.370 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20694 fp=#0x500000018ed' 2024-08-31T04:30:55.370 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20726 fp=#0x100000032ca' 2024-08-31T04:30:55.371 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20758 fp=#0x20000001262' 2024-08-31T04:30:55.371 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20790 fp=#0x2000000032b' 2024-08-31T04:30:55.371 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20822 fp=#0x10000002ae7' 2024-08-31T04:30:55.372 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20854 fp=#0x20000001269' 2024-08-31T04:30:55.372 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20886 fp=#0x2000000117d' 2024-08-31T04:30:55.372 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20918 fp=#0x20000001187' 2024-08-31T04:30:55.372 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20950 fp=#0x10000002b3f' 2024-08-31T04:30:55.373 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20982 fp=#0x10000001bf3' 2024-08-31T04:30:55.373 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:21046 fp=#0x10000001a45' 2024-08-31T04:30:55.374 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:21078 fp=#0x10000001ba2' 2024-08-31T04:30:55.374 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:21110 fp=#0x10000001ec1' 2024-08-31T04:30:55.374 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:21142 fp=#0x10000001eed' 2024-08-31T04:30:55.375 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:21174 fp=#0x10000001f01' 2024-08-31T04:30:55.375 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:21206 fp=#0x30000000671' 2024-08-31T04:30:55.375 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:21238 fp=#0x10000001e56' 2024-08-31T04:30:55.375 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:21270 fp=#0x10000001e62' 2024-08-31T04:30:55.376 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:21302 fp=#0x10000001ed1' 2024-08-31T04:30:55.377 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:10200 fp=#0x500000009c7' 2024-08-31T04:30:55.377 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:10232 fp=#0x50000001199' 2024-08-31T04:30:55.398 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13080 fp=#0x30000002b06' 2024-08-31T04:30:55.399 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13176 fp=#0x400000016e6' 2024-08-31T04:30:55.400 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13240 fp=#0x50000001708' 2024-08-31T04:30:55.400 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13272 fp=#0x500000016dd' 2024-08-31T04:30:55.401 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13304 fp=#0x30000002b95' 2024-08-31T04:30:55.401 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13336 fp=#0x30000002b9e' 2024-08-31T04:30:55.401 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13368 fp=#0x30000001ac9' 2024-08-31T04:30:55.402 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13400 fp=#0x30000002b8e' 2024-08-31T04:30:55.402 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13432 fp=#0x300000027a5' 2024-08-31T04:30:55.402 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13464 fp=#0x30000002a52' 2024-08-31T04:30:55.402 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13496 fp=#0x3000000275e' 2024-08-31T04:30:55.403 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13560 fp=#0x40000000ff3' 2024-08-31T04:30:55.403 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13592 fp=#0x50000000f5c' 2024-08-31T04:30:55.410 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14071 fp=#0x50000000c2c' 2024-08-31T04:30:55.410 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14103 fp=#0x50000000c87' 2024-08-31T04:30:55.411 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14135 fp=#0x50000000cc7' 2024-08-31T04:30:55.411 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14199 fp=#0x50000000c43' 2024-08-31T04:30:55.412 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14231 fp=#0x50000000c71' 2024-08-31T04:30:55.412 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14327 fp=#0x10000003b1d' 2024-08-31T04:30:55.413 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14391 fp=#0x50000000bb0' 2024-08-31T04:30:55.413 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14423 fp=#0x50000000b68' 2024-08-31T04:30:55.414 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14455 fp=#0x50000000b66' 2024-08-31T04:30:55.414 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14487 fp=#0x50000000bd4' 2024-08-31T04:30:55.414 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14519 fp=#0x50000000bcb' 2024-08-31T04:30:55.415 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14551 fp=#0x50000000bf1' 2024-08-31T04:30:55.415 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14583 fp=#0x50000001b5b' 2024-08-31T04:30:55.415 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14615 fp=#0x50000001b7e' 2024-08-31T04:30:55.416 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14647 fp=#0x50000001b36' 2024-08-31T04:30:55.416 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14679 fp=#0x50000001b30' 2024-08-31T04:30:55.417 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14711 fp=#0x500000014df' 2024-08-31T04:30:55.417 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14743 fp=#0x500000014d9' 2024-08-31T04:30:55.417 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14775 fp=#0x500000014e6' 2024-08-31T04:30:55.417 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14807 fp=#0x500000014bc' 2024-08-31T04:30:55.418 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14839 fp=#0x50000000e1e' 2024-08-31T04:30:55.418 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14871 fp=#0x50000001d68' 2024-08-31T04:30:55.418 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14903 fp=#0x50000001857' 2024-08-31T04:30:55.419 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14935 fp=#0x5000000185b' 2024-08-31T04:30:55.419 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14967 fp=#0x50000000e20' 2024-08-31T04:30:55.421 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15159 fp=#0x50000000ff6' 2024-08-31T04:30:55.421 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15255 fp=#0x50000001a84' 2024-08-31T04:30:55.422 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15287 fp=#0x50000001524' 2024-08-31T04:30:55.422 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15319 fp=#0x50000001530' 2024-08-31T04:30:55.422 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15351 fp=#0x50000001521' 2024-08-31T04:30:55.423 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15383 fp=#0x50000001102' 2024-08-31T04:30:55.423 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15415 fp=#0x5000000109a' 2024-08-31T04:30:55.423 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15447 fp=#0x500000010e8' 2024-08-31T04:30:55.424 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15479 fp=#0x50000001105' 2024-08-31T04:30:55.426 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15735 fp=#0x50000001bdf' 2024-08-31T04:30:55.427 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15895 fp=#0x500000016e9' 2024-08-31T04:30:55.427 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15927 fp=#0x500000016f4' 2024-08-31T04:30:55.428 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15959 fp=#0x500000016ee' 2024-08-31T04:30:55.430 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16279 fp=#0x5000000179f' 2024-08-31T04:30:55.432 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16535 fp=#0x500000009d9' 2024-08-31T04:30:55.432 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16567 fp=#0x5000000196a' 2024-08-31T04:30:55.432 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16599 fp=#0x5000000175b' 2024-08-31T04:30:55.433 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16631 fp=#0x50000001d0b' 2024-08-31T04:30:55.433 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16695 fp=#0x50000001a82' 2024-08-31T04:30:55.434 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16791 fp=#0x50000001d1c' 2024-08-31T04:30:55.434 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16823 fp=#0x50000001bcd' 2024-08-31T04:30:55.435 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16855 fp=#0x50000000b44' 2024-08-31T04:30:55.435 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16887 fp=#0x50000000b43' 2024-08-31T04:30:55.435 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16919 fp=#0x5000000177f' 2024-08-31T04:30:55.436 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16951 fp=#0x50000000a3f' 2024-08-31T04:30:55.436 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16983 fp=#0x500000015b4' 2024-08-31T04:30:55.436 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17015 fp=#0x500000015a1' 2024-08-31T04:30:55.437 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17047 fp=#0x50000001638' 2024-08-31T04:30:55.437 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17079 fp=#0x5000000163c' 2024-08-31T04:30:55.438 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17143 fp=#0x10000003e94' 2024-08-31T04:30:55.438 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17175 fp=#0x10000003edd' 2024-08-31T04:30:55.438 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17239 fp=#0x50000001622' 2024-08-31T04:30:55.439 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17271 fp=#0x500000015b3' 2024-08-31T04:30:55.439 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17303 fp=#0x50000001605' 2024-08-31T04:30:55.439 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17335 fp=#0x10000003617' 2024-08-31T04:30:55.440 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17367 fp=#0x1000000379d' 2024-08-31T04:30:55.440 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17399 fp=#0x1000000362f' 2024-08-31T04:30:55.440 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17431 fp=#0x500000011bd' 2024-08-31T04:30:55.441 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17463 fp=#0x100000035c4' 2024-08-31T04:30:55.441 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17495 fp=#0x500000012e7' 2024-08-31T04:30:55.441 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17527 fp=#0x500000012e2' 2024-08-31T04:30:55.442 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17559 fp=#0x5000000125f' 2024-08-31T04:30:55.444 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17847 fp=#0x10000002335' 2024-08-31T04:30:55.444 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17911 fp=#0x50000001625' 2024-08-31T04:30:55.445 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17943 fp=#0x5000000161e' 2024-08-31T04:30:55.445 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17975 fp=#0x50000001631' 2024-08-31T04:30:55.445 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18039 fp=#0x50000001a4c' 2024-08-31T04:30:55.446 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18071 fp=#0x50000000922' 2024-08-31T04:30:55.446 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18135 fp=#0x50000001aa6' 2024-08-31T04:30:55.447 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18199 fp=#0x50000001a33' 2024-08-31T04:30:55.447 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18263 fp=#0x50000000e72' 2024-08-31T04:30:55.448 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18327 fp=#0x50000000dcc' 2024-08-31T04:30:55.448 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18359 fp=#0x50000000e4f' 2024-08-31T04:30:55.448 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18391 fp=#0x50000000ea3' 2024-08-31T04:30:55.450 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18551 fp=#0x50000000acf' 2024-08-31T04:30:55.450 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18583 fp=#0x100000003ae' 2024-08-31T04:30:55.450 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18615 fp=#0x50000000aa3' 2024-08-31T04:30:55.451 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18647 fp=#0x100000003aa' 2024-08-31T04:30:55.451 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18679 fp=#0x50000000cf1' 2024-08-31T04:30:55.451 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18711 fp=#0x50000000d5e' 2024-08-31T04:30:55.451 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18743 fp=#0x50000000d24' 2024-08-31T04:30:55.452 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18775 fp=#0x50000000d57' 2024-08-31T04:30:55.452 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18807 fp=#0x500000011e0' 2024-08-31T04:30:55.452 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18839 fp=#0x50000000e15' 2024-08-31T04:30:55.453 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18871 fp=#0x50000000de1' 2024-08-31T04:30:55.453 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18903 fp=#0x50000000f0f' 2024-08-31T04:30:55.453 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18935 fp=#0x50000001449' 2024-08-31T04:30:55.454 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18967 fp=#0x50000000ded' 2024-08-31T04:30:55.454 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18999 fp=#0x500000019b1' 2024-08-31T04:30:55.454 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19031 fp=#0x5000000144f' 2024-08-31T04:30:55.455 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19095 fp=#0x500000017b5' 2024-08-31T04:30:55.455 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19191 fp=#0x500000017ed' 2024-08-31T04:30:55.456 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19319 fp=#0x50000001809' 2024-08-31T04:30:55.457 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19351 fp=#0x50000001843' 2024-08-31T04:30:55.457 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19383 fp=#0x50000001c6a' 2024-08-31T04:30:55.457 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19415 fp=#0x5000000181d' 2024-08-31T04:30:55.458 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19447 fp=#0x5000000193c' 2024-08-31T04:30:55.458 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19479 fp=#0x50000001a0a' 2024-08-31T04:30:55.458 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19511 fp=#0x50000001996' 2024-08-31T04:30:55.458 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19543 fp=#0x50000001998' 2024-08-31T04:30:55.459 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19575 fp=#0x50000001952' 2024-08-31T04:30:55.459 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19607 fp=#0x10000003e1a' 2024-08-31T04:30:55.459 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19639 fp=#0x10000003e12' 2024-08-31T04:30:55.460 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19703 fp=#0x10000003e72' 2024-08-31T04:30:55.461 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19799 fp=#0x50000000962' 2024-08-31T04:30:55.461 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19831 fp=#0x50000001121' 2024-08-31T04:30:55.461 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19863 fp=#0x50000001118' 2024-08-31T04:30:55.462 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19895 fp=#0x50000001149' 2024-08-31T04:30:55.462 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19927 fp=#0x50000000f7e' 2024-08-31T04:30:55.462 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19959 fp=#0x50000001ccc' 2024-08-31T04:30:55.463 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19991 fp=#0x50000000fab' 2024-08-31T04:30:55.463 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20023 fp=#0x50000001cb8' 2024-08-31T04:30:55.463 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20055 fp=#0x50000001cbd' 2024-08-31T04:30:55.464 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20087 fp=#0x50000000f8d' 2024-08-31T04:30:55.464 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20119 fp=#0x50000001046' 2024-08-31T04:30:55.464 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20151 fp=#0x500000010ae' 2024-08-31T04:30:55.464 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20183 fp=#0x50000001052' 2024-08-31T04:30:55.465 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20215 fp=#0x500000010a6' 2024-08-31T04:30:55.465 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20247 fp=#0x500000011a0' 2024-08-31T04:30:55.465 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20279 fp=#0x5000000119c' 2024-08-31T04:30:55.466 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20311 fp=#0x10000000fdb' 2024-08-31T04:30:55.466 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20343 fp=#0x200000003bc' 2024-08-31T04:30:55.466 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20375 fp=#0x10000000e0b' 2024-08-31T04:30:55.467 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20407 fp=#0x200000003e3' 2024-08-31T04:30:55.467 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20439 fp=#0x200000002d7' 2024-08-31T04:30:55.467 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20471 fp=#0x200000002f5' 2024-08-31T04:30:55.468 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20503 fp=#0x10000003176' 2024-08-31T04:30:55.468 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20535 fp=#0x100000032e2' 2024-08-31T04:30:55.468 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20567 fp=#0x500000019c8' 2024-08-31T04:30:55.468 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20599 fp=#0x50000001950' 2024-08-31T04:30:55.469 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20631 fp=#0x50000001905' 2024-08-31T04:30:55.469 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20663 fp=#0x500000018f5' 2024-08-31T04:30:55.469 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20695 fp=#0x100000031bc' 2024-08-31T04:30:55.470 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20727 fp=#0x10000003185' 2024-08-31T04:30:55.470 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20759 fp=#0x20000001239' 2024-08-31T04:30:55.470 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20791 fp=#0x10000002b80' 2024-08-31T04:30:55.471 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20823 fp=#0x2000000122d' 2024-08-31T04:30:55.471 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20855 fp=#0x2000000035d' 2024-08-31T04:30:55.471 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20887 fp=#0x10000002b90' 2024-08-31T04:30:55.472 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20919 fp=#0x10000002b71' 2024-08-31T04:30:55.472 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20951 fp=#0x10000002ba1' 2024-08-31T04:30:55.472 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20983 fp=#0x10000001aa2' 2024-08-31T04:30:55.473 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:21015 fp=#0x10000001a9e' 2024-08-31T04:30:55.473 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:21047 fp=#0x10000001a43' 2024-08-31T04:30:55.473 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:21079 fp=#0x10000001a5c' 2024-08-31T04:30:55.474 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:21111 fp=#0x10000001f2d' 2024-08-31T04:30:55.474 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:21143 fp=#0x50000001be7' 2024-08-31T04:30:55.474 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:21175 fp=#0x50000001c1f' 2024-08-31T04:30:55.475 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:21207 fp=#0x50000001c2b' 2024-08-31T04:30:55.475 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:21271 fp=#0x10000001eff' 2024-08-31T04:30:55.477 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:10233 fp=#0x10000002ab2' 2024-08-31T04:30:55.498 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13081 fp=#0x30000002ac5' 2024-08-31T04:30:55.499 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13145 fp=#0x500000016d7' 2024-08-31T04:30:55.500 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13241 fp=#0x50000001759' 2024-08-31T04:30:55.500 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13305 fp=#0x30000002b8c' 2024-08-31T04:30:55.500 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13337 fp=#0x30000002b74' 2024-08-31T04:30:55.501 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13369 fp=#0x30000001a97' 2024-08-31T04:30:55.501 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13401 fp=#0x30000001a55' 2024-08-31T04:30:55.502 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13433 fp=#0x30000002780' 2024-08-31T04:30:55.502 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13465 fp=#0x300000027a3' 2024-08-31T04:30:55.502 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13497 fp=#0x30000002763' 2024-08-31T04:30:55.503 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13529 fp=#0x40000000e31' 2024-08-31T04:30:55.503 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13561 fp=#0x5000000118b' 2024-08-31T04:30:55.507 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14072 fp=#0x50000000c40' 2024-08-31T04:30:55.507 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14104 fp=#0x50000000ca4' 2024-08-31T04:30:55.508 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14136 fp=#0x50000000c99' 2024-08-31T04:30:55.508 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14168 fp=#0x50000000c38' 2024-08-31T04:30:55.508 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14200 fp=#0x50000000c21' 2024-08-31T04:30:55.509 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14232 fp=#0x50000001d37' 2024-08-31T04:30:55.509 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14296 fp=#0x10000003b25' 2024-08-31T04:30:55.510 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14392 fp=#0x50000000c00' 2024-08-31T04:30:55.510 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14424 fp=#0x50000000b7e' 2024-08-31T04:30:55.511 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14456 fp=#0x50000000bf6' 2024-08-31T04:30:55.511 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14488 fp=#0x50000000beb' 2024-08-31T04:30:55.511 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14520 fp=#0x50000000bd8' 2024-08-31T04:30:55.511 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14552 fp=#0x50000000bde' 2024-08-31T04:30:55.512 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14584 fp=#0x50000001b91' 2024-08-31T04:30:55.512 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14616 fp=#0x50000001b33' 2024-08-31T04:30:55.512 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14648 fp=#0x50000001b16' 2024-08-31T04:30:55.513 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14680 fp=#0x50000001b2b' 2024-08-31T04:30:55.513 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14712 fp=#0x5000000145a' 2024-08-31T04:30:55.513 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14744 fp=#0x500000014d0' 2024-08-31T04:30:55.514 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14776 fp=#0x500000014ca' 2024-08-31T04:30:55.514 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14808 fp=#0x500000014dd' 2024-08-31T04:30:55.514 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14840 fp=#0x50000000e8f' 2024-08-31T04:30:55.515 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14872 fp=#0x50000000e7c' 2024-08-31T04:30:55.515 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14904 fp=#0x50000001d79' 2024-08-31T04:30:55.516 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14936 fp=#0x50000000e42' 2024-08-31T04:30:55.516 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14968 fp=#0x50000000e85' 2024-08-31T04:30:55.517 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15160 fp=#0x5000000100d' 2024-08-31T04:30:55.518 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15192 fp=#0x50000000ffe' 2024-08-31T04:30:55.518 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15224 fp=#0x50000001a8e' 2024-08-31T04:30:55.518 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15256 fp=#0x50000000fe0' 2024-08-31T04:30:55.519 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15288 fp=#0x5000000150c' 2024-08-31T04:30:55.519 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15320 fp=#0x50000001552' 2024-08-31T04:30:55.519 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15352 fp=#0x5000000154d' 2024-08-31T04:30:55.519 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15384 fp=#0x500000010a2' 2024-08-31T04:30:55.520 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15416 fp=#0x500000010fb' 2024-08-31T04:30:55.520 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15448 fp=#0x500000010ec' 2024-08-31T04:30:55.520 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15480 fp=#0x500000010af' 2024-08-31T04:30:55.523 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15832 fp=#0x50000001bea' 2024-08-31T04:30:55.524 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15896 fp=#0x50000001737' 2024-08-31T04:30:55.524 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15928 fp=#0x500000016f9' 2024-08-31T04:30:55.524 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15960 fp=#0x5000000170a' 2024-08-31T04:30:55.529 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16536 fp=#0x500000011c3' 2024-08-31T04:30:55.529 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16568 fp=#0x50000001966' 2024-08-31T04:30:55.529 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16600 fp=#0x50000001747' 2024-08-31T04:30:55.530 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16664 fp=#0x50000001cfd' 2024-08-31T04:30:55.530 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16728 fp=#0x50000001d04' 2024-08-31T04:30:55.531 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16760 fp=#0x50000001abc' 2024-08-31T04:30:55.531 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16792 fp=#0x50000001d14' 2024-08-31T04:30:55.531 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16824 fp=#0x50000001bd6' 2024-08-31T04:30:55.531 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16856 fp=#0x50000000b53' 2024-08-31T04:30:55.532 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16920 fp=#0x50000000a61' 2024-08-31T04:30:55.533 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16984 fp=#0x50000001659' 2024-08-31T04:30:55.533 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17016 fp=#0x50000001695' 2024-08-31T04:30:55.533 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17048 fp=#0x5000000163f' 2024-08-31T04:30:55.534 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17080 fp=#0x500000015bc' 2024-08-31T04:30:55.534 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17112 fp=#0x10000003ec1' 2024-08-31T04:30:55.534 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17144 fp=#0x10000003ebe' 2024-08-31T04:30:55.535 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17208 fp=#0x10000003f0d' 2024-08-31T04:30:55.535 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17240 fp=#0x500000015fb' 2024-08-31T04:30:55.536 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17272 fp=#0x500000015d3' 2024-08-31T04:30:55.536 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17304 fp=#0x5000000159a' 2024-08-31T04:30:55.536 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17336 fp=#0x10000003661' 2024-08-31T04:30:55.537 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17368 fp=#0x100000035a0' 2024-08-31T04:30:55.537 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17400 fp=#0x1000000364c' 2024-08-31T04:30:55.537 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17432 fp=#0x10000003702' 2024-08-31T04:30:55.538 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17464 fp=#0x10000003685' 2024-08-31T04:30:55.538 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17496 fp=#0x500000012e1' 2024-08-31T04:30:55.538 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17528 fp=#0x50000001255' 2024-08-31T04:30:55.539 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17560 fp=#0x500000012ef' 2024-08-31T04:30:55.539 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17592 fp=#0x500000012da' 2024-08-31T04:30:55.539 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17624 fp=#0x500000012cc' 2024-08-31T04:30:55.541 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17816 fp=#0x1000000227b' 2024-08-31T04:30:55.541 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17912 fp=#0x5000000167e' 2024-08-31T04:30:55.542 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17944 fp=#0x50000001691' 2024-08-31T04:30:55.542 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17976 fp=#0x50000001644' 2024-08-31T04:30:55.543 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18072 fp=#0x50000001a1e' 2024-08-31T04:30:55.543 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18104 fp=#0x50000001a24' 2024-08-31T04:30:55.543 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18136 fp=#0x50000000905' 2024-08-31T04:30:55.544 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18200 fp=#0x50000001abb' 2024-08-31T04:30:55.545 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18296 fp=#0x500000009c8' 2024-08-31T04:30:55.545 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18328 fp=#0x50000000e61' 2024-08-31T04:30:55.545 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18360 fp=#0x50000000e91' 2024-08-31T04:30:55.546 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18392 fp=#0x50000000de7' 2024-08-31T04:30:55.546 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18424 fp=#0x50000000df9' 2024-08-31T04:30:55.546 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18488 fp=#0x1000000045b' 2024-08-31T04:30:55.547 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18520 fp=#0x100000003da' 2024-08-31T04:30:55.547 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18584 fp=#0x50000000b02' 2024-08-31T04:30:55.548 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18616 fp=#0x100000003c2' 2024-08-31T04:30:55.548 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18680 fp=#0x50000000cf4' 2024-08-31T04:30:55.549 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18712 fp=#0x50000000cfa' 2024-08-31T04:30:55.549 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18744 fp=#0x50000000d4e' 2024-08-31T04:30:55.549 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18776 fp=#0x50000000d50' 2024-08-31T04:30:55.550 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18808 fp=#0x500000011d2' 2024-08-31T04:30:55.550 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18840 fp=#0x50000000d8e' 2024-08-31T04:30:55.550 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18872 fp=#0x50000000d7d' 2024-08-31T04:30:55.551 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18904 fp=#0x500000019de' 2024-08-31T04:30:55.551 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18936 fp=#0x50000000f03' 2024-08-31T04:30:55.551 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18968 fp=#0x50000000dcd' 2024-08-31T04:30:55.552 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19000 fp=#0x500000019a8' 2024-08-31T04:30:55.552 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19032 fp=#0x50000000f19' 2024-08-31T04:30:55.552 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19064 fp=#0x500000017a1' 2024-08-31T04:30:55.553 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19128 fp=#0x500000017a7' 2024-08-31T04:30:55.553 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19160 fp=#0x500000017cd' 2024-08-31T04:30:55.553 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19192 fp=#0x500000017ff' 2024-08-31T04:30:55.555 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19320 fp=#0x50000001847' 2024-08-31T04:30:55.555 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19352 fp=#0x500000017fb' 2024-08-31T04:30:55.555 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19384 fp=#0x50000001840' 2024-08-31T04:30:55.555 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19416 fp=#0x50000001c44' 2024-08-31T04:30:55.556 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19448 fp=#0x50000001995' 2024-08-31T04:30:55.556 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19480 fp=#0x50000001992' 2024-08-31T04:30:55.556 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19512 fp=#0x50000001a19' 2024-08-31T04:30:55.557 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19544 fp=#0x50000001981' 2024-08-31T04:30:55.557 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19576 fp=#0x500000019fb' 2024-08-31T04:30:55.558 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19640 fp=#0x10000003e81' 2024-08-31T04:30:55.558 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19704 fp=#0x10000003e17' 2024-08-31T04:30:55.559 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19736 fp=#0x10000003e57' 2024-08-31T04:30:55.559 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19768 fp=#0x10000003dd1' 2024-08-31T04:30:55.559 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19800 fp=#0x50000000965' 2024-08-31T04:30:55.560 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19832 fp=#0x50000001175' 2024-08-31T04:30:55.560 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19864 fp=#0x50000001131' 2024-08-31T04:30:55.560 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19896 fp=#0x50000001134' 2024-08-31T04:30:55.560 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19928 fp=#0x50000001cd3' 2024-08-31T04:30:55.561 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19960 fp=#0x50000001cd7' 2024-08-31T04:30:55.561 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19992 fp=#0x50000000faf' 2024-08-31T04:30:55.561 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20024 fp=#0x50000001cea' 2024-08-31T04:30:55.562 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20056 fp=#0x50000000fad' 2024-08-31T04:30:55.562 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20088 fp=#0x50000000fa5' 2024-08-31T04:30:55.562 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20120 fp=#0x50000001042' 2024-08-31T04:30:55.563 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20152 fp=#0x5000000104f' 2024-08-31T04:30:55.563 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20184 fp=#0x50000001033' 2024-08-31T04:30:55.563 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20216 fp=#0x50000001060' 2024-08-31T04:30:55.564 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20248 fp=#0x500000011b1' 2024-08-31T04:30:55.564 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20280 fp=#0x5000000119d' 2024-08-31T04:30:55.564 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20312 fp=#0x200000002ca' 2024-08-31T04:30:55.565 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20344 fp=#0x200000003ba' 2024-08-31T04:30:55.565 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20376 fp=#0x1000000104f' 2024-08-31T04:30:55.565 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20408 fp=#0x200000002d6' 2024-08-31T04:30:55.566 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20440 fp=#0x200000002fe' 2024-08-31T04:30:55.566 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20472 fp=#0x200000002cf' 2024-08-31T04:30:55.566 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20504 fp=#0x500000018c2' 2024-08-31T04:30:55.567 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20536 fp=#0x100000032c7' 2024-08-31T04:30:55.567 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20568 fp=#0x100000031a6' 2024-08-31T04:30:55.567 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20600 fp=#0x100000031dc' 2024-08-31T04:30:55.568 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20632 fp=#0x500000018df' 2024-08-31T04:30:55.568 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20664 fp=#0x1000000320d' 2024-08-31T04:30:55.568 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20696 fp=#0x500000018c5' 2024-08-31T04:30:55.568 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20728 fp=#0x10000003280' 2024-08-31T04:30:55.569 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20760 fp=#0x10000002b88' 2024-08-31T04:30:55.569 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20792 fp=#0x2000000032e' 2024-08-31T04:30:55.569 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20824 fp=#0x20000001286' 2024-08-31T04:30:55.570 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20856 fp=#0x200000011b1' 2024-08-31T04:30:55.570 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20888 fp=#0x10000002afb' 2024-08-31T04:30:55.570 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20920 fp=#0x10000002ab7' 2024-08-31T04:30:55.571 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20952 fp=#0x10000002b55' 2024-08-31T04:30:55.571 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20984 fp=#0x10000001bcf' 2024-08-31T04:30:55.571 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:21016 fp=#0x10000001a7a' 2024-08-31T04:30:55.572 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:21080 fp=#0x10000001a68' 2024-08-31T04:30:55.572 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:21112 fp=#0x10000001e71' 2024-08-31T04:30:55.572 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:21144 fp=#0x50000001be6' 2024-08-31T04:30:55.573 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:21176 fp=#0x10000001e42' 2024-08-31T04:30:55.573 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:21208 fp=#0x10000001f35' 2024-08-31T04:30:55.573 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:21240 fp=#0x10000001e54' 2024-08-31T04:30:55.574 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:21272 fp=#0x3000000066a' 2024-08-31T04:30:55.574 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:21304 fp=#0x50000001c54' 2024-08-31T04:30:55.575 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:10202 fp=#0x5000000195b' 2024-08-31T04:30:55.581 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:11002 fp=#0x30000001b2f' 2024-08-31T04:30:55.597 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13114 fp=#0x4000000163b' 2024-08-31T04:30:55.598 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13178 fp=#0x500000016c7' 2024-08-31T04:30:55.599 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13306 fp=#0x30000002b7b' 2024-08-31T04:30:55.599 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13338 fp=#0x30000001a80' 2024-08-31T04:30:55.600 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13370 fp=#0x30000002b7d' 2024-08-31T04:30:55.600 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13402 fp=#0x30000001af8' 2024-08-31T04:30:55.600 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13434 fp=#0x3000000275c' 2024-08-31T04:30:55.600 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13466 fp=#0x3000000279b' 2024-08-31T04:30:55.601 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13498 fp=#0x30000002761' 2024-08-31T04:30:55.601 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13562 fp=#0x400000013e0' 2024-08-31T04:30:55.605 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13978 fp=#0x40000001d82' 2024-08-31T04:30:55.605 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14073 fp=#0x50000000c3c' 2024-08-31T04:30:55.606 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14105 fp=#0x50000000c32' 2024-08-31T04:30:55.606 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14137 fp=#0x50000000c91' 2024-08-31T04:30:55.607 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14201 fp=#0x50000000c82' 2024-08-31T04:30:55.607 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14233 fp=#0x50000000c27' 2024-08-31T04:30:55.607 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14265 fp=#0x10000003aec' 2024-08-31T04:30:55.608 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14393 fp=#0x50000000b8f' 2024-08-31T04:30:55.609 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14425 fp=#0x50000000bee' 2024-08-31T04:30:55.609 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14457 fp=#0x50000000b89' 2024-08-31T04:30:55.609 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14489 fp=#0x50000000bac' 2024-08-31T04:30:55.610 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14521 fp=#0x50000000b9c' 2024-08-31T04:30:55.610 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14553 fp=#0x50000000bd0' 2024-08-31T04:30:55.610 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14585 fp=#0x50000001b34' 2024-08-31T04:30:55.611 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14617 fp=#0x50000001b3e' 2024-08-31T04:30:55.611 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14649 fp=#0x50000001b59' 2024-08-31T04:30:55.611 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14681 fp=#0x50000001b7a' 2024-08-31T04:30:55.612 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14713 fp=#0x500000014bd' 2024-08-31T04:30:55.612 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14745 fp=#0x500000014c8' 2024-08-31T04:30:55.612 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14777 fp=#0x500000014a6' 2024-08-31T04:30:55.613 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14809 fp=#0x50000001497' 2024-08-31T04:30:55.613 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14841 fp=#0x50000000e41' 2024-08-31T04:30:55.613 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14873 fp=#0x50000000e32' 2024-08-31T04:30:55.614 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14905 fp=#0x50000001d71' 2024-08-31T04:30:55.614 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14937 fp=#0x50000000e81' 2024-08-31T04:30:55.614 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14969 fp=#0x50000001879' 2024-08-31T04:30:55.616 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15161 fp=#0x50000000fcb' 2024-08-31T04:30:55.616 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15193 fp=#0x50000001aca' 2024-08-31T04:30:55.617 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15225 fp=#0x50000000fed' 2024-08-31T04:30:55.617 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15257 fp=#0x50000001ab8' 2024-08-31T04:30:55.617 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15289 fp=#0x50000001532' 2024-08-31T04:30:55.618 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15321 fp=#0x50000001518' 2024-08-31T04:30:55.618 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15353 fp=#0x50000001538' 2024-08-31T04:30:55.618 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15385 fp=#0x50000001111' 2024-08-31T04:30:55.619 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15417 fp=#0x50000001093' 2024-08-31T04:30:55.619 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15449 fp=#0x500000010cd' 2024-08-31T04:30:55.619 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15481 fp=#0x500000010ac' 2024-08-31T04:30:55.621 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15705 fp=#0x500000016bb' 2024-08-31T04:30:55.621 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15737 fp=#0x50000001bf9' 2024-08-31T04:30:55.623 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15897 fp=#0x50000001711' 2024-08-31T04:30:55.623 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15929 fp=#0x50000001714' 2024-08-31T04:30:55.623 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15961 fp=#0x500000016e5' 2024-08-31T04:30:55.625 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16153 fp=#0x5000000177b' 2024-08-31T04:30:55.628 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16537 fp=#0x500000009cb' 2024-08-31T04:30:55.628 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16569 fp=#0x50000001965' 2024-08-31T04:30:55.628 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16601 fp=#0x50000001752' 2024-08-31T04:30:55.629 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16697 fp=#0x50000001d16' 2024-08-31T04:30:55.629 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16729 fp=#0x50000001d0c' 2024-08-31T04:30:55.630 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16793 fp=#0x50000001d0f' 2024-08-31T04:30:55.630 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16825 fp=#0x50000001bb2' 2024-08-31T04:30:55.630 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16857 fp=#0x50000000b55' 2024-08-31T04:30:55.631 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16889 fp=#0x50000000b3d' 2024-08-31T04:30:55.631 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16921 fp=#0x50000000a69' 2024-08-31T04:30:55.631 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16953 fp=#0x5000000156c' 2024-08-31T04:30:55.632 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16985 fp=#0x5000000155d' 2024-08-31T04:30:55.632 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17017 fp=#0x5000000162c' 2024-08-31T04:30:55.632 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17049 fp=#0x50000001610' 2024-08-31T04:30:55.633 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17081 fp=#0x50000001673' 2024-08-31T04:30:55.633 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17145 fp=#0x10000003e9a' 2024-08-31T04:30:55.634 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17241 fp=#0x500000016da' 2024-08-31T04:30:55.634 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17273 fp=#0x50000001628' 2024-08-31T04:30:55.635 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17305 fp=#0x50000001b40' 2024-08-31T04:30:55.635 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17337 fp=#0x100000037ed' 2024-08-31T04:30:55.635 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17369 fp=#0x100000036a9' 2024-08-31T04:30:55.635 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17401 fp=#0x100000037eb' 2024-08-31T04:30:55.636 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17433 fp=#0x100000035bf' 2024-08-31T04:30:55.636 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17465 fp=#0x10000003724' 2024-08-31T04:30:55.637 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17497 fp=#0x50000001238' 2024-08-31T04:30:55.637 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17529 fp=#0x500000012d9' 2024-08-31T04:30:55.637 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17593 fp=#0x50000001265' 2024-08-31T04:30:55.638 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17625 fp=#0x500000012b5' 2024-08-31T04:30:55.638 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17657 fp=#0x10000002332' 2024-08-31T04:30:55.638 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17721 fp=#0x1000000227e' 2024-08-31T04:30:55.640 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17881 fp=#0x5000000163b' 2024-08-31T04:30:55.640 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17913 fp=#0x50000001679' 2024-08-31T04:30:55.640 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17945 fp=#0x50000000a05' 2024-08-31T04:30:55.641 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17977 fp=#0x500000009f8' 2024-08-31T04:30:55.641 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18009 fp=#0x50000000938' 2024-08-31T04:30:55.641 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18041 fp=#0x50000001a63' 2024-08-31T04:30:55.642 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18105 fp=#0x50000000937' 2024-08-31T04:30:55.642 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18137 fp=#0x50000001a2c' 2024-08-31T04:30:55.642 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18169 fp=#0x5000000101f' 2024-08-31T04:30:55.643 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18201 fp=#0x50000001a21' 2024-08-31T04:30:55.643 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18233 fp=#0x50000000908' 2024-08-31T04:30:55.643 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18297 fp=#0x50000000e54' 2024-08-31T04:30:55.645 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18425 fp=#0x50000000e24' 2024-08-31T04:30:55.645 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18489 fp=#0x5000000184c' 2024-08-31T04:30:55.645 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18521 fp=#0x50000000ed6' 2024-08-31T04:30:55.646 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18585 fp=#0x50000000ab7' 2024-08-31T04:30:55.646 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18617 fp=#0x50000000aac' 2024-08-31T04:30:55.647 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18681 fp=#0x50000000d1a' 2024-08-31T04:30:55.647 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18713 fp=#0x50000000d07' 2024-08-31T04:30:55.647 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18745 fp=#0x50000000d52' 2024-08-31T04:30:55.648 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18777 fp=#0x50000000d1f' 2024-08-31T04:30:55.648 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18809 fp=#0x500000011d9' 2024-08-31T04:30:55.648 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18841 fp=#0x50000000dc1' 2024-08-31T04:30:55.649 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18873 fp=#0x50000001451' 2024-08-31T04:30:55.649 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18905 fp=#0x50000000da3' 2024-08-31T04:30:55.649 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18937 fp=#0x50000000f06' 2024-08-31T04:30:55.650 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18969 fp=#0x50000000f1f' 2024-08-31T04:30:55.650 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19001 fp=#0x50000000f01' 2024-08-31T04:30:55.650 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19033 fp=#0x50000000dbe' 2024-08-31T04:30:55.651 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19129 fp=#0x500000017b7' 2024-08-31T04:30:55.652 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19161 fp=#0x500000017bf' 2024-08-31T04:30:55.652 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19193 fp=#0x500000017c8' 2024-08-31T04:30:55.653 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19289 fp=#0x500000017f8' 2024-08-31T04:30:55.653 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19321 fp=#0x50000001849' 2024-08-31T04:30:55.653 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19353 fp=#0x50000001813' 2024-08-31T04:30:55.654 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19385 fp=#0x5000000182d' 2024-08-31T04:30:55.654 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19417 fp=#0x50000001c4c' 2024-08-31T04:30:55.655 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19449 fp=#0x5000000196d' 2024-08-31T04:30:55.655 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19481 fp=#0x5000000198d' 2024-08-31T04:30:55.655 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19513 fp=#0x500000019e7' 2024-08-31T04:30:55.656 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19545 fp=#0x500000019ec' 2024-08-31T04:30:55.656 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19577 fp=#0x50000001980' 2024-08-31T04:30:55.657 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19673 fp=#0x10000003e21' 2024-08-31T04:30:55.657 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19737 fp=#0x10000003de9' 2024-08-31T04:30:55.658 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19769 fp=#0x10000003ef2' 2024-08-31T04:30:55.658 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19801 fp=#0x50000000960' 2024-08-31T04:30:55.658 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19833 fp=#0x50000001135' 2024-08-31T04:30:55.659 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19865 fp=#0x50000001697' 2024-08-31T04:30:55.659 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19897 fp=#0x50000001127' 2024-08-31T04:30:55.659 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19929 fp=#0x50000000f96' 2024-08-31T04:30:55.660 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19961 fp=#0x50000001cc5' 2024-08-31T04:30:55.660 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19993 fp=#0x50000001ce2' 2024-08-31T04:30:55.660 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20025 fp=#0x50000001c98' 2024-08-31T04:30:55.661 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20057 fp=#0x50000000f98' 2024-08-31T04:30:55.661 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20089 fp=#0x50000000fb0' 2024-08-31T04:30:55.661 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20121 fp=#0x5000000102a' 2024-08-31T04:30:55.662 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20153 fp=#0x5000000105a' 2024-08-31T04:30:55.662 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20185 fp=#0x50000001082' 2024-08-31T04:30:55.662 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20217 fp=#0x50000001086' 2024-08-31T04:30:55.662 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20249 fp=#0x500000011b4' 2024-08-31T04:30:55.663 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20281 fp=#0x500000011a4' 2024-08-31T04:30:55.663 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20313 fp=#0x10000000dcc' 2024-08-31T04:30:55.663 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20345 fp=#0x10000000f8c' 2024-08-31T04:30:55.664 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20377 fp=#0x200000003b2' 2024-08-31T04:30:55.664 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20409 fp=#0x10000000f9e' 2024-08-31T04:30:55.664 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20441 fp=#0x200000003ac' 2024-08-31T04:30:55.665 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20473 fp=#0x200000002fc' 2024-08-31T04:30:55.665 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20505 fp=#0x200000007b8' 2024-08-31T04:30:55.665 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20537 fp=#0x10000003254' 2024-08-31T04:30:55.666 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20569 fp=#0x10000003208' 2024-08-31T04:30:55.666 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20601 fp=#0x500000019a1' 2024-08-31T04:30:55.666 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20633 fp=#0x100000031a8' 2024-08-31T04:30:55.667 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20665 fp=#0x100000031e1' 2024-08-31T04:30:55.667 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20697 fp=#0x100000032b8' 2024-08-31T04:30:55.667 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20729 fp=#0x500000018f1' 2024-08-31T04:30:55.668 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20761 fp=#0x10000002ac0' 2024-08-31T04:30:55.668 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20793 fp=#0x20000001229' 2024-08-31T04:30:55.668 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20825 fp=#0x10000002b5b' 2024-08-31T04:30:55.669 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20857 fp=#0x20000001276' 2024-08-31T04:30:55.669 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20889 fp=#0x10000002b84' 2024-08-31T04:30:55.669 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20921 fp=#0x20000001288' 2024-08-31T04:30:55.670 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20953 fp=#0x20000001207' 2024-08-31T04:30:55.670 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20985 fp=#0x10000001a56' 2024-08-31T04:30:55.670 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:21017 fp=#0x10000001abf' 2024-08-31T04:30:55.671 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:21049 fp=#0x10000001bb6' 2024-08-31T04:30:55.671 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:21081 fp=#0x50000001906' 2024-08-31T04:30:55.671 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:21113 fp=#0x10000001f29' 2024-08-31T04:30:55.671 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:21145 fp=#0x10000001e44' 2024-08-31T04:30:55.672 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:21177 fp=#0x50000001be9' 2024-08-31T04:30:55.672 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:21209 fp=#0x3000000068f' 2024-08-31T04:30:55.672 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:21241 fp=#0x10000001f0f' 2024-08-31T04:30:55.673 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:21273 fp=#0x10000001e8a' 2024-08-31T04:30:55.673 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:21305 fp=#0x50000001c20' 2024-08-31T04:30:55.674 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:10203 fp=#0x50000001745' 2024-08-31T04:30:55.677 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:10555 fp=#0x30000001b80' 2024-08-31T04:30:55.698 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13051 fp=#0x30000002b21' 2024-08-31T04:30:55.698 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13083 fp=#0x30000002ace' 2024-08-31T04:30:55.699 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13115 fp=#0x5000000143f' 2024-08-31T04:30:55.700 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13307 fp=#0x30000002b59' 2024-08-31T04:30:55.700 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13339 fp=#0x30000001a99' 2024-08-31T04:30:55.701 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13371 fp=#0x30000002b84' 2024-08-31T04:30:55.701 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13403 fp=#0x30000002b94' 2024-08-31T04:30:55.701 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13435 fp=#0x300000027a0' 2024-08-31T04:30:55.702 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13499 fp=#0x30000002764' 2024-08-31T04:30:55.702 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13531 fp=#0x3000000274f' 2024-08-31T04:30:55.703 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13627 fp=#0x30000002376' 2024-08-31T04:30:55.704 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13723 fp=#0x3000000285d' 2024-08-31T04:30:55.706 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13947 fp=#0x50000001a04' 2024-08-31T04:30:55.707 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14074 fp=#0x50000000c24' 2024-08-31T04:30:55.707 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14106 fp=#0x50000000cb2' 2024-08-31T04:30:55.707 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14138 fp=#0x50000000c30' 2024-08-31T04:30:55.708 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14170 fp=#0x50000000cb5' 2024-08-31T04:30:55.708 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14202 fp=#0x50000000cb7' 2024-08-31T04:30:55.708 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14234 fp=#0x50000000cbc' 2024-08-31T04:30:55.710 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14394 fp=#0x50000000ba7' 2024-08-31T04:30:55.710 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14426 fp=#0x50000000c02' 2024-08-31T04:30:55.710 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14458 fp=#0x50000000b97' 2024-08-31T04:30:55.711 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14490 fp=#0x50000000b91' 2024-08-31T04:30:55.711 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14522 fp=#0x50000000b78' 2024-08-31T04:30:55.711 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14554 fp=#0x50000000b7f' 2024-08-31T04:30:55.712 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14586 fp=#0x50000001b8f' 2024-08-31T04:30:55.712 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14618 fp=#0x50000001b35' 2024-08-31T04:30:55.712 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14650 fp=#0x50000001b70' 2024-08-31T04:30:55.713 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14682 fp=#0x50000001b49' 2024-08-31T04:30:55.713 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14714 fp=#0x500000014de' 2024-08-31T04:30:55.713 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14746 fp=#0x5000000147d' 2024-08-31T04:30:55.714 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14778 fp=#0x50000001450' 2024-08-31T04:30:55.714 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14810 fp=#0x50000001469' 2024-08-31T04:30:55.714 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14842 fp=#0x50000000e9c' 2024-08-31T04:30:55.715 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14874 fp=#0x5000000186a' 2024-08-31T04:30:55.715 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14906 fp=#0x5000000186e' 2024-08-31T04:30:55.715 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14938 fp=#0x50000000e2d' 2024-08-31T04:30:55.716 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14970 fp=#0x5000000185a' 2024-08-31T04:30:55.717 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15162 fp=#0x50000000fe1' 2024-08-31T04:30:55.717 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15194 fp=#0x50000000fd8' 2024-08-31T04:30:55.718 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15226 fp=#0x50000000fce' 2024-08-31T04:30:55.718 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15258 fp=#0x50000001aa3' 2024-08-31T04:30:55.718 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15290 fp=#0x50000001501' 2024-08-31T04:30:55.718 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15322 fp=#0x50000001cf3' 2024-08-31T04:30:55.719 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15354 fp=#0x50000001780' 2024-08-31T04:30:55.719 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15386 fp=#0x500000010f2' 2024-08-31T04:30:55.719 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15418 fp=#0x5000000108d' 2024-08-31T04:30:55.720 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15450 fp=#0x500000010bf' 2024-08-31T04:30:55.720 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15482 fp=#0x500000010f5' 2024-08-31T04:30:55.722 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15706 fp=#0x50000001bde' 2024-08-31T04:30:55.722 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15738 fp=#0x50000001c03' 2024-08-31T04:30:55.722 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15770 fp=#0x50000001c0e' 2024-08-31T04:30:55.723 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15898 fp=#0x50000001735' 2024-08-31T04:30:55.724 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15930 fp=#0x500000016fa' 2024-08-31T04:30:55.724 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15962 fp=#0x50000001707' 2024-08-31T04:30:55.726 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16186 fp=#0x5000000143e' 2024-08-31T04:30:55.728 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16538 fp=#0x500000009d3' 2024-08-31T04:30:55.729 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16570 fp=#0x50000001977' 2024-08-31T04:30:55.729 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16602 fp=#0x5000000176d' 2024-08-31T04:30:55.730 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16666 fp=#0x50000001a6e' 2024-08-31T04:30:55.730 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16698 fp=#0x50000001439' 2024-08-31T04:30:55.730 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16730 fp=#0x50000001aa5' 2024-08-31T04:30:55.731 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16762 fp=#0x50000001abf' 2024-08-31T04:30:55.731 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16826 fp=#0x50000001bd1' 2024-08-31T04:30:55.731 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16858 fp=#0x50000000b49' 2024-08-31T04:30:55.732 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16890 fp=#0x50000000b47' 2024-08-31T04:30:55.732 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16922 fp=#0x50000001b46' 2024-08-31T04:30:55.732 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16954 fp=#0x50000001685' 2024-08-31T04:30:55.733 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16986 fp=#0x50000001647' 2024-08-31T04:30:55.733 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17018 fp=#0x50000001618' 2024-08-31T04:30:55.733 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17050 fp=#0x50000001587' 2024-08-31T04:30:55.734 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17082 fp=#0x50000001591' 2024-08-31T04:30:55.734 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17114 fp=#0x500000016b1' 2024-08-31T04:30:55.734 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17146 fp=#0x10000003ee0' 2024-08-31T04:30:55.735 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17242 fp=#0x500000015e5' 2024-08-31T04:30:55.736 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17274 fp=#0x500000015c1' 2024-08-31T04:30:55.736 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17306 fp=#0x500000015f6' 2024-08-31T04:30:55.736 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17338 fp=#0x10000003729' 2024-08-31T04:30:55.737 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17370 fp=#0x10000003776' 2024-08-31T04:30:55.737 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17402 fp=#0x100000036e2' 2024-08-31T04:30:55.737 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17434 fp=#0x100000036ca' 2024-08-31T04:30:55.738 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17466 fp=#0x100000036f7' 2024-08-31T04:30:55.738 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17530 fp=#0x500000012d0' 2024-08-31T04:30:55.738 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17562 fp=#0x500000012ae' 2024-08-31T04:30:55.739 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17594 fp=#0x50000001241' 2024-08-31T04:30:55.739 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17626 fp=#0x50000001236' 2024-08-31T04:30:55.739 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17658 fp=#0x10000002276' 2024-08-31T04:30:55.740 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17786 fp=#0x500000012f9' 2024-08-31T04:30:55.741 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17882 fp=#0x50000001642' 2024-08-31T04:30:55.741 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17914 fp=#0x500000016a4' 2024-08-31T04:30:55.742 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17978 fp=#0x500000018fc' 2024-08-31T04:30:55.742 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18010 fp=#0x50000000919' 2024-08-31T04:30:55.742 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18042 fp=#0x50000001a75' 2024-08-31T04:30:55.743 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18074 fp=#0x50000001a2e' 2024-08-31T04:30:55.743 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18106 fp=#0x50000001a71' 2024-08-31T04:30:55.743 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18138 fp=#0x50000000931' 2024-08-31T04:30:55.744 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18234 fp=#0x500000008e3' 2024-08-31T04:30:55.745 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18298 fp=#0x50000000df3' 2024-08-31T04:30:55.745 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18330 fp=#0x50000000e1a' 2024-08-31T04:30:55.745 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18362 fp=#0x50000000ea1' 2024-08-31T04:30:55.746 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18394 fp=#0x500000016ab' 2024-08-31T04:30:55.746 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18426 fp=#0x50000000dec' 2024-08-31T04:30:55.746 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18458 fp=#0x50000000e70' 2024-08-31T04:30:55.747 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18490 fp=#0x100000003b4' 2024-08-31T04:30:55.747 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18522 fp=#0x50000000ed5' 2024-08-31T04:30:55.747 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18554 fp=#0x50000000a9e' 2024-08-31T04:30:55.747 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18586 fp=#0x50000000ee5' 2024-08-31T04:30:55.748 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18618 fp=#0x50000000b00' 2024-08-31T04:30:55.748 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18650 fp=#0x50000000ac8' 2024-08-31T04:30:55.748 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18682 fp=#0x50000000d5f' 2024-08-31T04:30:55.749 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18714 fp=#0x50000000d11' 2024-08-31T04:30:55.749 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18746 fp=#0x50000000d3f' 2024-08-31T04:30:55.749 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18778 fp=#0x50000000d67' 2024-08-31T04:30:55.750 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18810 fp=#0x500000011d7' 2024-08-31T04:30:55.750 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18842 fp=#0x50000000dfa' 2024-08-31T04:30:55.750 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18874 fp=#0x50000000d91' 2024-08-31T04:30:55.751 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18906 fp=#0x50000000dd5' 2024-08-31T04:30:55.751 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18938 fp=#0x500000019d4' 2024-08-31T04:30:55.751 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18970 fp=#0x50000000dc5' 2024-08-31T04:30:55.752 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19002 fp=#0x50000000dc2' 2024-08-31T04:30:55.752 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19034 fp=#0x50000000dc4' 2024-08-31T04:30:55.753 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19130 fp=#0x500000017a5' 2024-08-31T04:30:55.753 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19226 fp=#0x500000017c6' 2024-08-31T04:30:55.754 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19258 fp=#0x500000017a8' 2024-08-31T04:30:55.754 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19322 fp=#0x50000001815' 2024-08-31T04:30:55.755 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19354 fp=#0x50000001803' 2024-08-31T04:30:55.755 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19386 fp=#0x500000017f7' 2024-08-31T04:30:55.755 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19418 fp=#0x50000001c45' 2024-08-31T04:30:55.756 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19450 fp=#0x50000001a1a' 2024-08-31T04:30:55.756 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19482 fp=#0x50000001a01' 2024-08-31T04:30:55.756 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19514 fp=#0x500000019d3' 2024-08-31T04:30:55.756 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19546 fp=#0x500000019f0' 2024-08-31T04:30:55.757 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19578 fp=#0x500000019f5' 2024-08-31T04:30:55.757 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19610 fp=#0x10000003ddd' 2024-08-31T04:30:55.757 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19642 fp=#0x500000016b9' 2024-08-31T04:30:55.758 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19674 fp=#0x50000001445' 2024-08-31T04:30:55.758 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19738 fp=#0x10000003f16' 2024-08-31T04:30:55.759 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19770 fp=#0x10000003e84' 2024-08-31T04:30:55.759 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19802 fp=#0x50000000966' 2024-08-31T04:30:55.759 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19834 fp=#0x5000000115f' 2024-08-31T04:30:55.759 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19866 fp=#0x50000001119' 2024-08-31T04:30:55.760 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19898 fp=#0x50000001166' 2024-08-31T04:30:55.760 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19930 fp=#0x50000000fbb' 2024-08-31T04:30:55.760 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19962 fp=#0x50000000f6c' 2024-08-31T04:30:55.761 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19994 fp=#0x50000001caa' 2024-08-31T04:30:55.761 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20026 fp=#0x50000000fb4' 2024-08-31T04:30:55.761 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20058 fp=#0x50000000f8b' 2024-08-31T04:30:55.762 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20090 fp=#0x50000001cd1' 2024-08-31T04:30:55.762 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20122 fp=#0x500000012fe' 2024-08-31T04:30:55.762 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20154 fp=#0x50000001051' 2024-08-31T04:30:55.763 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20186 fp=#0x50000001059' 2024-08-31T04:30:55.763 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20218 fp=#0x5000000107f' 2024-08-31T04:30:55.763 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20250 fp=#0x500000011a5' 2024-08-31T04:30:55.763 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20282 fp=#0x500000011a8' 2024-08-31T04:30:55.764 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20314 fp=#0x10000001042' 2024-08-31T04:30:55.764 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20346 fp=#0x10000000ecf' 2024-08-31T04:30:55.764 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20378 fp=#0x200000002da' 2024-08-31T04:30:55.765 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20474 fp=#0x200000002e5' 2024-08-31T04:30:55.765 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20506 fp=#0x20000000367' 2024-08-31T04:30:55.766 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20538 fp=#0x10000003206' 2024-08-31T04:30:55.766 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20570 fp=#0x10000003211' 2024-08-31T04:30:55.766 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20602 fp=#0x200000007ba' 2024-08-31T04:30:55.767 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20634 fp=#0x500000019a4' 2024-08-31T04:30:55.767 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20698 fp=#0x10000003182' 2024-08-31T04:30:55.768 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20730 fp=#0x10000002ae1' 2024-08-31T04:30:55.768 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20762 fp=#0x200000011f0' 2024-08-31T04:30:55.768 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20794 fp=#0x20000001221' 2024-08-31T04:30:55.769 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20826 fp=#0x200000011e0' 2024-08-31T04:30:55.769 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20858 fp=#0x10000002b9b' 2024-08-31T04:30:55.769 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20890 fp=#0x10000002b67' 2024-08-31T04:30:55.770 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20922 fp=#0x10000002b06' 2024-08-31T04:30:55.770 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20954 fp=#0x20000000335' 2024-08-31T04:30:55.770 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20986 fp=#0x10000001a48' 2024-08-31T04:30:55.771 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:21018 fp=#0x10000001a3b' 2024-08-31T04:30:55.771 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:21050 fp=#0x10000001ac9' 2024-08-31T04:30:55.771 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:21082 fp=#0x10000001b0e' 2024-08-31T04:30:55.771 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:21114 fp=#0x50000001c2a' 2024-08-31T04:30:55.772 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:21146 fp=#0x30000000253' 2024-08-31T04:30:55.772 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:21178 fp=#0x50000001c63' 2024-08-31T04:30:55.772 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:21210 fp=#0x50000001c41' 2024-08-31T04:30:55.773 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:21242 fp=#0x10000001e92' 2024-08-31T04:30:55.773 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:21274 fp=#0x30000000673' 2024-08-31T04:30:55.774 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:21306 fp=#0x10000001f1b' 2024-08-31T04:30:55.774 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'client_request(client.15282:310817 rename #0x10000000461/comment-3.xml #0x10000000461/comment-3.xml.tmp 2024-08-31T04:29:46.325967+0000 caller_uid=1000, caller_gid=1333{6,36,1000,1333,})' 2024-08-31T04:30:55.775 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:10204 fp=#0x50000000780' 2024-08-31T04:30:55.795 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13084 fp=#0x30000002b0b' 2024-08-31T04:30:55.796 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13116 fp=#0x400000015e8' 2024-08-31T04:30:55.797 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13308 fp=#0x30000001afe' 2024-08-31T04:30:55.798 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13340 fp=#0x30000001b03' 2024-08-31T04:30:55.798 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13372 fp=#0x30000002b67' 2024-08-31T04:30:55.798 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13404 fp=#0x30000002b6f' 2024-08-31T04:30:55.799 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13468 fp=#0x30000002784' 2024-08-31T04:30:55.799 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13500 fp=#0x3000000277d' 2024-08-31T04:30:55.800 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13596 fp=#0x40000000f7e' 2024-08-31T04:30:55.800 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13628 fp=#0x30000002374' 2024-08-31T04:30:55.801 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13724 fp=#0x3000000289b' 2024-08-31T04:30:55.802 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13948 fp=#0x40000000d7d' 2024-08-31T04:30:55.804 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14075 fp=#0x50000000c8e' 2024-08-31T04:30:55.804 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14107 fp=#0x50000000c61' 2024-08-31T04:30:55.804 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14139 fp=#0x50000000c8a' 2024-08-31T04:30:55.805 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14203 fp=#0x50000000c46' 2024-08-31T04:30:55.805 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14235 fp=#0x50000001d2e' 2024-08-31T04:30:55.806 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14299 fp=#0x10000003afb' 2024-08-31T04:30:55.806 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14395 fp=#0x50000000c0f' 2024-08-31T04:30:55.807 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14427 fp=#0x50000000b60' 2024-08-31T04:30:55.807 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14459 fp=#0x50000000ba1' 2024-08-31T04:30:55.807 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14491 fp=#0x50000000bfc' 2024-08-31T04:30:55.808 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14523 fp=#0x50000000bca' 2024-08-31T04:30:55.808 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14555 fp=#0x50000000c03' 2024-08-31T04:30:55.808 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14587 fp=#0x50000001af9' 2024-08-31T04:30:55.809 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14619 fp=#0x50000001b4c' 2024-08-31T04:30:55.809 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14651 fp=#0x50000001b3d' 2024-08-31T04:30:55.809 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14683 fp=#0x50000001b74' 2024-08-31T04:30:55.810 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14715 fp=#0x50000001487' 2024-08-31T04:30:55.810 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14747 fp=#0x500000014d8' 2024-08-31T04:30:55.810 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14779 fp=#0x500000014ad' 2024-08-31T04:30:55.811 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14811 fp=#0x50000001456' 2024-08-31T04:30:55.811 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14843 fp=#0x50000000e04' 2024-08-31T04:30:55.811 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14875 fp=#0x5000000186b' 2024-08-31T04:30:55.812 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14907 fp=#0x50000001d6f' 2024-08-31T04:30:55.812 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14939 fp=#0x5000000185e' 2024-08-31T04:30:55.812 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14971 fp=#0x50000001863' 2024-08-31T04:30:55.814 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15163 fp=#0x50000000fdd' 2024-08-31T04:30:55.814 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15195 fp=#0x50000001005' 2024-08-31T04:30:55.814 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15227 fp=#0x50000000ff4' 2024-08-31T04:30:55.815 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15259 fp=#0x50000001a93' 2024-08-31T04:30:55.815 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15291 fp=#0x50000001556' 2024-08-31T04:30:55.815 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15323 fp=#0x50000001502' 2024-08-31T04:30:55.816 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15355 fp=#0x5000000152b' 2024-08-31T04:30:55.816 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15387 fp=#0x50000001113' 2024-08-31T04:30:55.816 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15419 fp=#0x500000010da' 2024-08-31T04:30:55.817 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15451 fp=#0x500000010a4' 2024-08-31T04:30:55.817 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15483 fp=#0x500000010e5' 2024-08-31T04:30:55.820 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15803 fp=#0x50000001bf8' 2024-08-31T04:30:55.820 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15867 fp=#0x50000001bfe' 2024-08-31T04:30:55.820 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15899 fp=#0x50000001734' 2024-08-31T04:30:55.821 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15931 fp=#0x5000000173b' 2024-08-31T04:30:55.821 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15963 fp=#0x5000000170b' 2024-08-31T04:30:55.825 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16539 fp=#0x500000009eb' 2024-08-31T04:30:55.825 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16571 fp=#0x5000000196c' 2024-08-31T04:30:55.826 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16603 fp=#0x50000001757' 2024-08-31T04:30:55.826 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16699 fp=#0x50000001d13' 2024-08-31T04:30:55.827 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16795 fp=#0x500000016af' 2024-08-31T04:30:55.827 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16827 fp=#0x50000001bc6' 2024-08-31T04:30:55.828 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16859 fp=#0x50000000b50' 2024-08-31T04:30:55.828 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16891 fp=#0x50000000a85' 2024-08-31T04:30:55.828 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16923 fp=#0x50000000a71' 2024-08-31T04:30:55.829 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16955 fp=#0x50000001678' 2024-08-31T04:30:55.829 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16987 fp=#0x5000000167b' 2024-08-31T04:30:55.829 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17019 fp=#0x50000001573' 2024-08-31T04:30:55.830 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17051 fp=#0x500000015fc' 2024-08-31T04:30:55.830 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17083 fp=#0x50000001645' 2024-08-31T04:30:55.831 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17147 fp=#0x10000003efd' 2024-08-31T04:30:55.831 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17243 fp=#0x5000000160c' 2024-08-31T04:30:55.832 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17275 fp=#0x50000001614' 2024-08-31T04:30:55.832 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17307 fp=#0x5000000156b' 2024-08-31T04:30:55.832 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17339 fp=#0x100000037f2' 2024-08-31T04:30:55.833 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17371 fp=#0x10000003735' 2024-08-31T04:30:55.833 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17403 fp=#0x100000036d0' 2024-08-31T04:30:55.833 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17435 fp=#0x10000003626' 2024-08-31T04:30:55.834 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17467 fp=#0x10000003679' 2024-08-31T04:30:55.834 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17499 fp=#0x500000012df' 2024-08-31T04:30:55.834 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17531 fp=#0x500000012a2' 2024-08-31T04:30:55.835 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17563 fp=#0x500000012a0' 2024-08-31T04:30:55.835 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17595 fp=#0x500000012b3' 2024-08-31T04:30:55.835 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17627 fp=#0x500000012dd' 2024-08-31T04:30:55.837 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17883 fp=#0x50000001666' 2024-08-31T04:30:55.838 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17915 fp=#0x50000001658' 2024-08-31T04:30:55.838 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17947 fp=#0x50000001632' 2024-08-31T04:30:55.838 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17979 fp=#0x50000001689' 2024-08-31T04:30:55.839 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18011 fp=#0x5000000093a' 2024-08-31T04:30:55.839 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18043 fp=#0x50000000920' 2024-08-31T04:30:55.839 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18075 fp=#0x50000001a3c' 2024-08-31T04:30:55.839 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18107 fp=#0x5000000090a' 2024-08-31T04:30:55.840 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18171 fp=#0x50000000926' 2024-08-31T04:30:55.840 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18235 fp=#0x50000001a6b' 2024-08-31T04:30:55.841 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18331 fp=#0x50000000dfc' 2024-08-31T04:30:55.842 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18427 fp=#0x50000000ead' 2024-08-31T04:30:55.843 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18491 fp=#0x10000000437' 2024-08-31T04:30:55.843 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18523 fp=#0x10000000416' 2024-08-31T04:30:55.843 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18555 fp=#0x10000000452' 2024-08-31T04:30:55.843 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18587 fp=#0x50000000aab' 2024-08-31T04:30:55.844 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18619 fp=#0x50000000ecc' 2024-08-31T04:30:55.844 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18651 fp=#0x50000000cf7' 2024-08-31T04:30:55.844 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18683 fp=#0x50000000cef' 2024-08-31T04:30:55.845 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18715 fp=#0x50000000d76' 2024-08-31T04:30:55.845 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18747 fp=#0x50000000d04' 2024-08-31T04:30:55.845 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18779 fp=#0x50000000d08' 2024-08-31T04:30:55.846 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18811 fp=#0x500000011d6' 2024-08-31T04:30:55.846 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18843 fp=#0x50000000efb' 2024-08-31T04:30:55.846 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18875 fp=#0x50000000f0c' 2024-08-31T04:30:55.847 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18939 fp=#0x50000000e13' 2024-08-31T04:30:55.847 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18971 fp=#0x50000000f0a' 2024-08-31T04:30:55.848 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19003 fp=#0x50000000df0' 2024-08-31T04:30:55.848 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19035 fp=#0x50000000d95' 2024-08-31T04:30:55.849 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19131 fp=#0x500000017eb' 2024-08-31T04:30:55.849 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19163 fp=#0x50000001834' 2024-08-31T04:30:55.850 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19323 fp=#0x50000001839' 2024-08-31T04:30:55.851 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19355 fp=#0x50000001c48' 2024-08-31T04:30:55.851 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19387 fp=#0x50000001c49' 2024-08-31T04:30:55.851 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19419 fp=#0x50000001817' 2024-08-31T04:30:55.851 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19451 fp=#0x500000019f6' 2024-08-31T04:30:55.852 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19483 fp=#0x500000019f8' 2024-08-31T04:30:55.852 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19515 fp=#0x50000001936' 2024-08-31T04:30:55.852 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19547 fp=#0x500000019cb' 2024-08-31T04:30:55.853 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19579 fp=#0x500000019ee' 2024-08-31T04:30:55.853 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19611 fp=#0x10000003e93' 2024-08-31T04:30:55.853 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19643 fp=#0x10000003dff' 2024-08-31T04:30:55.854 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19675 fp=#0x10000003e48' 2024-08-31T04:30:55.854 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19707 fp=#0x10000003e87' 2024-08-31T04:30:55.855 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19771 fp=#0x10000003e96' 2024-08-31T04:30:55.855 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19803 fp=#0x50000000973' 2024-08-31T04:30:55.855 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19835 fp=#0x50000001156' 2024-08-31T04:30:55.856 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19867 fp=#0x50000001933' 2024-08-31T04:30:55.856 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19899 fp=#0x5000000112a' 2024-08-31T04:30:55.856 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19931 fp=#0x50000000fc1' 2024-08-31T04:30:55.856 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19963 fp=#0x50000001ca2' 2024-08-31T04:30:55.857 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19995 fp=#0x50000001cdd' 2024-08-31T04:30:55.857 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20027 fp=#0x50000000fac' 2024-08-31T04:30:55.858 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20059 fp=#0x50000001ccf' 2024-08-31T04:30:55.858 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20091 fp=#0x50000001ced' 2024-08-31T04:30:55.858 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20123 fp=#0x5000000177d' 2024-08-31T04:30:55.859 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20155 fp=#0x50000001063' 2024-08-31T04:30:55.859 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20187 fp=#0x5000000103e' 2024-08-31T04:30:55.859 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20219 fp=#0x5000000105c' 2024-08-31T04:30:55.860 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20251 fp=#0x500000011ae' 2024-08-31T04:30:55.860 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20283 fp=#0x5000000119e' 2024-08-31T04:30:55.860 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20315 fp=#0x10000000e1d' 2024-08-31T04:30:55.861 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20347 fp=#0x200000002f7' 2024-08-31T04:30:55.861 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20379 fp=#0x200000002f2' 2024-08-31T04:30:55.861 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20411 fp=#0x10000000f0f' 2024-08-31T04:30:55.861 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20443 fp=#0x200000002ff' 2024-08-31T04:30:55.862 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20475 fp=#0x10000000e58' 2024-08-31T04:30:55.862 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20507 fp=#0x100000031d6' 2024-08-31T04:30:55.862 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20539 fp=#0x100000032a9' 2024-08-31T04:30:55.863 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20571 fp=#0x50000001973' 2024-08-31T04:30:55.863 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20635 fp=#0x500000018d3' 2024-08-31T04:30:55.864 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20667 fp=#0x1000000324b' 2024-08-31T04:30:55.864 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20699 fp=#0x5000000197d' 2024-08-31T04:30:55.864 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20731 fp=#0x2000000034f' 2024-08-31T04:30:55.865 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20763 fp=#0x20000000352' 2024-08-31T04:30:55.865 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20795 fp=#0x10000002ae9' 2024-08-31T04:30:55.865 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20827 fp=#0x20000000498' 2024-08-31T04:30:55.866 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20859 fp=#0x20000000351' 2024-08-31T04:30:55.866 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20891 fp=#0x10000002af9' 2024-08-31T04:30:55.866 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20923 fp=#0x20000000339' 2024-08-31T04:30:55.867 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20955 fp=#0x10000002b9f' 2024-08-31T04:30:55.867 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20987 fp=#0x10000001be4' 2024-08-31T04:30:55.867 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:21019 fp=#0x10000001ade' 2024-08-31T04:30:55.868 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:21051 fp=#0x10000001ab2' 2024-08-31T04:30:55.868 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:21083 fp=#0x10000001af2' 2024-08-31T04:30:55.868 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:21115 fp=#0x50000001c1e' 2024-08-31T04:30:55.869 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:21147 fp=#0x300000011e8' 2024-08-31T04:30:55.869 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:21179 fp=#0x3000000069c' 2024-08-31T04:30:55.869 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:21211 fp=#0x10000001ecd' 2024-08-31T04:30:55.870 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:21243 fp=#0x30000000687' 2024-08-31T04:30:55.870 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:21275 fp=#0x50000001ba1' 2024-08-31T04:30:55.870 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:21307 fp=#0x50000001c29' 2024-08-31T04:30:55.872 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:10205 fp=#0x50000001bae' 2024-08-31T04:30:55.872 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:10237 fp=#0x10000002096' 2024-08-31T04:30:55.876 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:10749 fp=#0x300000018a3' 2024-08-31T04:30:55.893 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13085 fp=#0x30000002b18' 2024-08-31T04:30:55.894 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13181 fp=#0x40000001612' 2024-08-31T04:30:55.895 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13309 fp=#0x30000001b07' 2024-08-31T04:30:55.896 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13341 fp=#0x30000002b85' 2024-08-31T04:30:55.896 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13373 fp=#0x30000001a9f' 2024-08-31T04:30:55.896 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13405 fp=#0x30000002b49' 2024-08-31T04:30:55.897 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13437 fp=#0x30000002748' 2024-08-31T04:30:55.897 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13469 fp=#0x30000002766' 2024-08-31T04:30:55.897 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13501 fp=#0x30000002788' 2024-08-31T04:30:55.898 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13533 fp=#0x50000001435' 2024-08-31T04:30:55.899 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13725 fp=#0x3000000289f' 2024-08-31T04:30:55.901 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13981 fp=#0x40000001d8b' 2024-08-31T04:30:55.901 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14013 fp=#0x50000001b9e' 2024-08-31T04:30:55.902 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14076 fp=#0x50000000cc5' 2024-08-31T04:30:55.902 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14108 fp=#0x50000000cac' 2024-08-31T04:30:55.903 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14172 fp=#0x50000000c5b' 2024-08-31T04:30:55.903 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14204 fp=#0x50000000c80' 2024-08-31T04:30:55.903 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14236 fp=#0x50000000c81' 2024-08-31T04:30:55.904 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14332 fp=#0x10000003ab3' 2024-08-31T04:30:55.905 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14396 fp=#0x50000000bf0' 2024-08-31T04:30:55.905 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14428 fp=#0x50000000bbf' 2024-08-31T04:30:55.905 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14460 fp=#0x50000000bc2' 2024-08-31T04:30:55.906 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14492 fp=#0x50000000bc4' 2024-08-31T04:30:55.906 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14524 fp=#0x50000000bfe' 2024-08-31T04:30:55.906 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14556 fp=#0x50000000b73' 2024-08-31T04:30:55.907 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14588 fp=#0x50000001b8e' 2024-08-31T04:30:55.907 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14620 fp=#0x50000001b20' 2024-08-31T04:30:55.907 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14652 fp=#0x50000001b21' 2024-08-31T04:30:55.908 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14684 fp=#0x50000001b6d' 2024-08-31T04:30:55.908 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14716 fp=#0x500000014b1' 2024-08-31T04:30:55.908 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14748 fp=#0x500000014c7' 2024-08-31T04:30:55.909 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14780 fp=#0x50000001471' 2024-08-31T04:30:55.909 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14812 fp=#0x5000000149e' 2024-08-31T04:30:55.909 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14844 fp=#0x50000000e98' 2024-08-31T04:30:55.910 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14876 fp=#0x50000000e73' 2024-08-31T04:30:55.910 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14908 fp=#0x50000000e0c' 2024-08-31T04:30:55.910 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14940 fp=#0x500000018fe' 2024-08-31T04:30:55.911 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14972 fp=#0x50000000e67' 2024-08-31T04:30:55.912 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15164 fp=#0x50000001014' 2024-08-31T04:30:55.912 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15196 fp=#0x50000001009' 2024-08-31T04:30:55.913 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15260 fp=#0x50000000fe5' 2024-08-31T04:30:55.913 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15292 fp=#0x50000001548' 2024-08-31T04:30:55.914 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15324 fp=#0x50000001517' 2024-08-31T04:30:55.914 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15356 fp=#0x50000001509' 2024-08-31T04:30:55.914 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15388 fp=#0x500000010a8' 2024-08-31T04:30:55.915 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15420 fp=#0x500000010f8' 2024-08-31T04:30:55.915 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15452 fp=#0x50000001097' 2024-08-31T04:30:55.917 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15740 fp=#0x50000001bf2' 2024-08-31T04:30:55.918 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15804 fp=#0x50000001c00' 2024-08-31T04:30:55.918 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15836 fp=#0x50000001bfd' 2024-08-31T04:30:55.919 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15900 fp=#0x5000000173d' 2024-08-31T04:30:55.919 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15932 fp=#0x50000001733' 2024-08-31T04:30:55.919 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15964 fp=#0x50000001724' 2024-08-31T04:30:55.924 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16540 fp=#0x500000009d8' 2024-08-31T04:30:55.924 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16572 fp=#0x50000001969' 2024-08-31T04:30:55.924 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16604 fp=#0x50000001749' 2024-08-31T04:30:55.925 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16668 fp=#0x500000016e1' 2024-08-31T04:30:55.925 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16700 fp=#0x50000001d28' 2024-08-31T04:30:55.926 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16828 fp=#0x50000001bba' 2024-08-31T04:30:55.927 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16860 fp=#0x50000000b4e' 2024-08-31T04:30:55.927 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16892 fp=#0x50000000a80' 2024-08-31T04:30:55.927 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16924 fp=#0x50000001b47' 2024-08-31T04:30:55.928 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16956 fp=#0x500000015c0' 2024-08-31T04:30:55.928 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16988 fp=#0x500000015de' 2024-08-31T04:30:55.928 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17020 fp=#0x500000015fd' 2024-08-31T04:30:55.929 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17052 fp=#0x500000015e4' 2024-08-31T04:30:55.929 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17084 fp=#0x50000001561' 2024-08-31T04:30:55.929 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17148 fp=#0x10000003f09' 2024-08-31T04:30:55.930 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17244 fp=#0x50000001582' 2024-08-31T04:30:55.930 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17276 fp=#0x500000015a6' 2024-08-31T04:30:55.931 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17308 fp=#0x500000015e7' 2024-08-31T04:30:55.931 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17340 fp=#0x100000035e2' 2024-08-31T04:30:55.932 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17372 fp=#0x100000036d1' 2024-08-31T04:30:55.932 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17404 fp=#0x10000003606' 2024-08-31T04:30:55.932 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17436 fp=#0x100000035ae' 2024-08-31T04:30:55.933 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17468 fp=#0x1000000378c' 2024-08-31T04:30:55.933 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17532 fp=#0x5000000124d' 2024-08-31T04:30:55.933 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17564 fp=#0x50000001282' 2024-08-31T04:30:55.934 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17596 fp=#0x500000012b9' 2024-08-31T04:30:55.934 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17660 fp=#0x1000000232f' 2024-08-31T04:30:55.936 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17884 fp=#0x50000001674' 2024-08-31T04:30:55.936 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17916 fp=#0x500000009f6' 2024-08-31T04:30:55.937 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17948 fp=#0x50000001782' 2024-08-31T04:30:55.937 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17980 fp=#0x5000000167a' 2024-08-31T04:30:55.938 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18044 fp=#0x500000011c4' 2024-08-31T04:30:55.938 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18076 fp=#0x50000000c14' 2024-08-31T04:30:55.938 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18108 fp=#0x50000001a35' 2024-08-31T04:30:55.939 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18140 fp=#0x500000008df' 2024-08-31T04:30:55.939 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18172 fp=#0x500000008d8' 2024-08-31T04:30:55.939 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18204 fp=#0x5000000091e' 2024-08-31T04:30:55.940 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18236 fp=#0x5000000091a' 2024-08-31T04:30:55.940 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18332 fp=#0x50000000eaa' 2024-08-31T04:30:55.942 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18492 fp=#0x50000000a9f' 2024-08-31T04:30:55.942 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18556 fp=#0x50000000ed2' 2024-08-31T04:30:55.943 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18588 fp=#0x1000000041c' 2024-08-31T04:30:55.943 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18620 fp=#0x50000000b01' 2024-08-31T04:30:55.943 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18652 fp=#0x50000000d6e' 2024-08-31T04:30:55.943 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18684 fp=#0x50000000d56' 2024-08-31T04:30:55.944 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18716 fp=#0x50000000d49' 2024-08-31T04:30:55.944 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18748 fp=#0x50000000d39' 2024-08-31T04:30:55.944 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18780 fp=#0x50000000d55' 2024-08-31T04:30:55.945 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18812 fp=#0x500000011e1' 2024-08-31T04:30:55.945 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18844 fp=#0x50000000d7f' 2024-08-31T04:30:55.945 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18876 fp=#0x50000000df5' 2024-08-31T04:30:55.946 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18908 fp=#0x500000019cd' 2024-08-31T04:30:55.946 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18940 fp=#0x50000000f27' 2024-08-31T04:30:55.946 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18972 fp=#0x50000000d9f' 2024-08-31T04:30:55.947 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19004 fp=#0x50000000f05' 2024-08-31T04:30:55.947 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19036 fp=#0x50000000f29' 2024-08-31T04:30:55.948 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19228 fp=#0x500000017b3' 2024-08-31T04:30:55.949 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19260 fp=#0x500000017b1' 2024-08-31T04:30:55.949 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19324 fp=#0x500000017ea' 2024-08-31T04:30:55.950 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19356 fp=#0x50000001820' 2024-08-31T04:30:55.950 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19388 fp=#0x50000001c51' 2024-08-31T04:30:55.950 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19420 fp=#0x50000001c4d' 2024-08-31T04:30:55.950 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19452 fp=#0x50000001a1c' 2024-08-31T04:30:55.951 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19484 fp=#0x500000019d5' 2024-08-31T04:30:55.951 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19516 fp=#0x500000019b3' 2024-08-31T04:30:55.951 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19548 fp=#0x5000000194b' 2024-08-31T04:30:55.952 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19580 fp=#0x5000000197b' 2024-08-31T04:30:55.952 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19612 fp=#0x50000001442' 2024-08-31T04:30:55.953 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19676 fp=#0x10000003e66' 2024-08-31T04:30:55.953 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19708 fp=#0x10000003e37' 2024-08-31T04:30:55.953 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19740 fp=#0x10000003e60' 2024-08-31T04:30:55.954 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19772 fp=#0x10000003eec' 2024-08-31T04:30:55.954 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19804 fp=#0x50000000961' 2024-08-31T04:30:55.954 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19836 fp=#0x5000000116a' 2024-08-31T04:30:55.955 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19868 fp=#0x50000001696' 2024-08-31T04:30:55.955 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19900 fp=#0x500000016a9' 2024-08-31T04:30:55.955 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19932 fp=#0x50000000f9d' 2024-08-31T04:30:55.956 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19964 fp=#0x50000000fae' 2024-08-31T04:30:55.956 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19996 fp=#0x50000000f79' 2024-08-31T04:30:55.959 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20028 fp=#0x50000000f8f' 2024-08-31T04:30:55.959 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20060 fp=#0x50000000f8e' 2024-08-31T04:30:55.960 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20092 fp=#0x50000001cde' 2024-08-31T04:30:55.960 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20124 fp=#0x500000010ce' 2024-08-31T04:30:55.960 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20156 fp=#0x500000012c5' 2024-08-31T04:30:55.960 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20188 fp=#0x500000010b5' 2024-08-31T04:30:55.961 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20220 fp=#0x500000010ba' 2024-08-31T04:30:55.961 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20252 fp=#0x500000011ac' 2024-08-31T04:30:55.961 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20284 fp=#0x50000001c8a' 2024-08-31T04:30:55.962 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20316 fp=#0x1000000102c' 2024-08-31T04:30:55.962 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20348 fp=#0x200000002f8' 2024-08-31T04:30:55.962 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20380 fp=#0x200000002e4' 2024-08-31T04:30:55.963 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20412 fp=#0x200000002e8' 2024-08-31T04:30:55.963 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20444 fp=#0x200000002d0' 2024-08-31T04:30:55.963 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20476 fp=#0x10000000e88' 2024-08-31T04:30:55.964 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20508 fp=#0x20000000365' 2024-08-31T04:30:55.964 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20540 fp=#0x10000003234' 2024-08-31T04:30:55.964 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20572 fp=#0x500000018e0' 2024-08-31T04:30:55.965 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20604 fp=#0x10000003231' 2024-08-31T04:30:55.965 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20636 fp=#0x200000007b5' 2024-08-31T04:30:55.965 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20668 fp=#0x100000031c7' 2024-08-31T04:30:55.966 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20700 fp=#0x50000001941' 2024-08-31T04:30:55.966 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20732 fp=#0x2000000119f' 2024-08-31T04:30:55.966 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20764 fp=#0x2000000035f' 2024-08-31T04:30:55.966 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20796 fp=#0x2000000033f' 2024-08-31T04:30:55.967 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20828 fp=#0x10000002b15' 2024-08-31T04:30:55.967 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20860 fp=#0x10000002b7c' 2024-08-31T04:30:55.967 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20892 fp=#0x10000002acd' 2024-08-31T04:30:55.968 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20924 fp=#0x10000002abd' 2024-08-31T04:30:55.968 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20956 fp=#0x10000002b82' 2024-08-31T04:30:55.968 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20988 fp=#0x30000000406' 2024-08-31T04:30:55.969 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:21020 fp=#0x10000001aee' 2024-08-31T04:30:55.969 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:21052 fp=#0x10000001a35' 2024-08-31T04:30:55.969 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:21084 fp=#0x30000001167' 2024-08-31T04:30:55.970 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:21148 fp=#0x30000000697' 2024-08-31T04:30:55.970 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:21180 fp=#0x10000001e5c' 2024-08-31T04:30:55.971 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:21212 fp=#0x3000000066d' 2024-08-31T04:30:55.971 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:21244 fp=#0x10000001e88' 2024-08-31T04:30:55.971 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:21276 fp=#0x50000001ba8' 2024-08-31T04:30:55.971 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:21308 fp=#0x30000000695' 2024-08-31T04:30:55.973 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:10206 fp=#0x50000000b34' 2024-08-31T04:30:55.993 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:12990 fp=#0x500000013d5' 2024-08-31T04:30:55.994 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13054 fp=#0x30000002b3b' 2024-08-31T04:30:55.994 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13150 fp=#0x500000016cc' 2024-08-31T04:30:55.995 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13182 fp=#0x500000016dc' 2024-08-31T04:30:55.995 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13246 fp=#0x500000018a3' 2024-08-31T04:30:55.996 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13310 fp=#0x30000002b90' 2024-08-31T04:30:55.996 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13342 fp=#0x30000001ad6' 2024-08-31T04:30:55.996 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13374 fp=#0x30000001a5e' 2024-08-31T04:30:55.997 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13406 fp=#0x30000002b76' 2024-08-31T04:30:55.997 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13438 fp=#0x30000002770' 2024-08-31T04:30:55.997 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13470 fp=#0x30000002a55' 2024-08-31T04:30:55.998 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13502 fp=#0x30000002794' 2024-08-31T04:30:55.998 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13534 fp=#0x4000000132f' 2024-08-31T04:30:55.998 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13566 fp=#0x40000001357' 2024-08-31T04:30:55.999 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13598 fp=#0x40000000f8e' 2024-08-31T04:30:56.002 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14014 fp=#0x50000001a07' 2024-08-31T04:30:56.002 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14077 fp=#0x50000000c4a' 2024-08-31T04:30:56.003 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14109 fp=#0x50000000c25' 2024-08-31T04:30:56.003 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14173 fp=#0x50000000c9e' 2024-08-31T04:30:56.004 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14237 fp=#0x50000000c52' 2024-08-31T04:30:56.004 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14301 fp=#0x10000003ae1' 2024-08-31T04:30:56.005 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14397 fp=#0x50000000c11' 2024-08-31T04:30:56.005 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14429 fp=#0x50000000bfb' 2024-08-31T04:30:56.006 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14461 fp=#0x50000000c0e' 2024-08-31T04:30:56.006 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14493 fp=#0x50000000bb4' 2024-08-31T04:30:56.007 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14557 fp=#0x50000000bc9' 2024-08-31T04:30:56.007 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14589 fp=#0x50000001b98' 2024-08-31T04:30:56.007 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14621 fp=#0x50000001b53' 2024-08-31T04:30:56.008 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14653 fp=#0x50000001b81' 2024-08-31T04:30:56.008 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14685 fp=#0x50000001b42' 2024-08-31T04:30:56.008 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14717 fp=#0x500000014ed' 2024-08-31T04:30:56.009 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14749 fp=#0x500000014d2' 2024-08-31T04:30:56.009 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14781 fp=#0x500000014b9' 2024-08-31T04:30:56.009 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14813 fp=#0x500000014d6' 2024-08-31T04:30:56.010 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14845 fp=#0x50000001d75' 2024-08-31T04:30:56.010 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14877 fp=#0x50000001851' 2024-08-31T04:30:56.010 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14909 fp=#0x50000001d77' 2024-08-31T04:30:56.011 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14941 fp=#0x50000000e25' 2024-08-31T04:30:56.011 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14973 fp=#0x50000001d73' 2024-08-31T04:30:56.012 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15165 fp=#0x50000000feb' 2024-08-31T04:30:56.013 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15197 fp=#0x50000001ab3' 2024-08-31T04:30:56.013 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15229 fp=#0x50000000fd9' 2024-08-31T04:30:56.013 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15261 fp=#0x50000000fe3' 2024-08-31T04:30:56.014 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15293 fp=#0x50000001525' 2024-08-31T04:30:56.014 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15325 fp=#0x5000000151c' 2024-08-31T04:30:56.014 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15357 fp=#0x5000000152e' 2024-08-31T04:30:56.015 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15389 fp=#0x50000001095' 2024-08-31T04:30:56.015 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15421 fp=#0x5000000109d' 2024-08-31T04:30:56.015 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15453 fp=#0x500000010ff' 2024-08-31T04:30:56.016 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15613 fp=#0x5000000179c' 2024-08-31T04:30:56.017 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15709 fp=#0x50000001c17' 2024-08-31T04:30:56.018 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15773 fp=#0x50000001c09' 2024-08-31T04:30:56.018 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15805 fp=#0x50000001bdd' 2024-08-31T04:30:56.019 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15901 fp=#0x50000001727' 2024-08-31T04:30:56.019 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15933 fp=#0x5000000172b' 2024-08-31T04:30:56.019 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15965 fp=#0x5000000172f' 2024-08-31T04:30:56.022 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16285 fp=#0x500000012bd' 2024-08-31T04:30:56.024 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16541 fp=#0x50000001940' 2024-08-31T04:30:56.024 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16573 fp=#0x5000000195c' 2024-08-31T04:30:56.025 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16605 fp=#0x5000000174d' 2024-08-31T04:30:56.025 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16701 fp=#0x50000001cfa' 2024-08-31T04:30:56.026 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16829 fp=#0x50000001bbf' 2024-08-31T04:30:56.027 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16861 fp=#0x50000000b4d' 2024-08-31T04:30:56.027 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16893 fp=#0x50000000a4b' 2024-08-31T04:30:56.027 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16925 fp=#0x50000000a8d' 2024-08-31T04:30:56.027 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16957 fp=#0x50000001677' 2024-08-31T04:30:56.028 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16989 fp=#0x50000001667' 2024-08-31T04:30:56.028 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17021 fp=#0x50000001570' 2024-08-31T04:30:56.029 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17053 fp=#0x50000001586' 2024-08-31T04:30:56.029 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17085 fp=#0x50000001598' 2024-08-31T04:30:56.029 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17117 fp=#0x10000003e97' 2024-08-31T04:30:56.030 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17181 fp=#0x10000003eed' 2024-08-31T04:30:56.030 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17245 fp=#0x50000001601' 2024-08-31T04:30:56.030 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17277 fp=#0x5000000157e' 2024-08-31T04:30:56.031 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17309 fp=#0x500000015db' 2024-08-31T04:30:56.031 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17341 fp=#0x10000003676' 2024-08-31T04:30:56.031 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17373 fp=#0x1000000369e' 2024-08-31T04:30:56.032 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17405 fp=#0x100000036be' 2024-08-31T04:30:56.032 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17437 fp=#0x100000036ba' 2024-08-31T04:30:56.032 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17469 fp=#0x100000035b3' 2024-08-31T04:30:56.033 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17501 fp=#0x5000000125e' 2024-08-31T04:30:56.033 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17533 fp=#0x500000012b7' 2024-08-31T04:30:56.034 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17597 fp=#0x5000000129b' 2024-08-31T04:30:56.034 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17629 fp=#0x50000001a11' 2024-08-31T04:30:56.034 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17693 fp=#0x10000002334' 2024-08-31T04:30:56.035 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17725 fp=#0x10000002289' 2024-08-31T04:30:56.036 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17885 fp=#0x5000000165c' 2024-08-31T04:30:56.037 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17981 fp=#0x50000001672' 2024-08-31T04:30:56.037 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18045 fp=#0x50000001a5a' 2024-08-31T04:30:56.038 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18109 fp=#0x50000000902' 2024-08-31T04:30:56.038 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18173 fp=#0x50000001a47' 2024-08-31T04:30:56.039 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18205 fp=#0x50000001a29' 2024-08-31T04:30:56.039 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18237 fp=#0x50000000907' 2024-08-31T04:30:56.040 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18365 fp=#0x50000000e4a' 2024-08-31T04:30:56.040 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18397 fp=#0x50000000e1f' 2024-08-31T04:30:56.041 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18461 fp=#0x50000000eab' 2024-08-31T04:30:56.041 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18493 fp=#0x50000000a9d' 2024-08-31T04:30:56.042 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18525 fp=#0x100000003d7' 2024-08-31T04:30:56.042 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18557 fp=#0x50000000aaf' 2024-08-31T04:30:56.042 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18589 fp=#0x100000003c5' 2024-08-31T04:30:56.043 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18621 fp=#0x50000000aa5' 2024-08-31T04:30:56.043 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18653 fp=#0x50000000d69' 2024-08-31T04:30:56.043 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18685 fp=#0x50000000d6a' 2024-08-31T04:30:56.044 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18717 fp=#0x50000000d41' 2024-08-31T04:30:56.044 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18749 fp=#0x50000000d03' 2024-08-31T04:30:56.044 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18781 fp=#0x50000000cf2' 2024-08-31T04:30:56.044 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18813 fp=#0x500000011da' 2024-08-31T04:30:56.045 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18845 fp=#0x50000000d97' 2024-08-31T04:30:56.045 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18877 fp=#0x50000000dd9' 2024-08-31T04:30:56.045 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18909 fp=#0x50000000f17' 2024-08-31T04:30:56.046 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18941 fp=#0x500000019da' 2024-08-31T04:30:56.046 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18973 fp=#0x50000000dbb' 2024-08-31T04:30:56.046 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19005 fp=#0x500000019b2' 2024-08-31T04:30:56.047 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19069 fp=#0x50000001827' 2024-08-31T04:30:56.048 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19133 fp=#0x500000017c1' 2024-08-31T04:30:56.048 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19165 fp=#0x5000000181e' 2024-08-31T04:30:56.049 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19261 fp=#0x500000017e4' 2024-08-31T04:30:56.049 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19325 fp=#0x500000017e0' 2024-08-31T04:30:56.050 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19357 fp=#0x50000001c6e' 2024-08-31T04:30:56.050 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19389 fp=#0x50000001c2e' 2024-08-31T04:30:56.050 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19421 fp=#0x50000001c32' 2024-08-31T04:30:56.051 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19453 fp=#0x5000000199a' 2024-08-31T04:30:56.051 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19485 fp=#0x50000001989' 2024-08-31T04:30:56.051 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19517 fp=#0x50000001918' 2024-08-31T04:30:56.052 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19549 fp=#0x500000019af' 2024-08-31T04:30:56.052 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19581 fp=#0x50000001a06' 2024-08-31T04:30:56.053 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19741 fp=#0x10000003eef' 2024-08-31T04:30:56.054 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19805 fp=#0x5000000095d' 2024-08-31T04:30:56.054 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19837 fp=#0x5000000114a' 2024-08-31T04:30:56.054 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19869 fp=#0x50000001178' 2024-08-31T04:30:56.055 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19901 fp=#0x50000001125' 2024-08-31T04:30:56.055 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19933 fp=#0x50000000fb1' 2024-08-31T04:30:56.055 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19965 fp=#0x50000000faa' 2024-08-31T04:30:56.056 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19997 fp=#0x50000001cda' 2024-08-31T04:30:56.056 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20029 fp=#0x50000001ccb' 2024-08-31T04:30:56.056 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20061 fp=#0x50000001ca4' 2024-08-31T04:30:56.057 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20093 fp=#0x50000000f6d' 2024-08-31T04:30:56.057 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20125 fp=#0x500000010cb' 2024-08-31T04:30:56.057 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20157 fp=#0x5000000103d' 2024-08-31T04:30:56.057 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20189 fp=#0x50000001911' 2024-08-31T04:30:56.058 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20221 fp=#0x50000001045' 2024-08-31T04:30:56.058 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20253 fp=#0x50000001c80' 2024-08-31T04:30:56.058 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20285 fp=#0x5000000119f' 2024-08-31T04:30:56.059 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20317 fp=#0x200000003dc' 2024-08-31T04:30:56.059 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20349 fp=#0x10000000f5a' 2024-08-31T04:30:56.059 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20381 fp=#0x200000003e5' 2024-08-31T04:30:56.059 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20413 fp=#0x10000000fa7' 2024-08-31T04:30:56.060 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20445 fp=#0x10000000f35' 2024-08-31T04:30:56.060 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20477 fp=#0x10000000f53' 2024-08-31T04:30:56.060 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20509 fp=#0x50000001991' 2024-08-31T04:30:56.061 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20541 fp=#0x100000032b5' 2024-08-31T04:30:56.061 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20573 fp=#0x1000000325b' 2024-08-31T04:30:56.061 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20605 fp=#0x1000000326d' 2024-08-31T04:30:56.062 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20669 fp=#0x5000000190d' 2024-08-31T04:30:56.062 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20701 fp=#0x50000001914' 2024-08-31T04:30:56.063 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20733 fp=#0x20000000346' 2024-08-31T04:30:56.063 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20765 fp=#0x20000001250' 2024-08-31T04:30:56.063 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20797 fp=#0x10000002b47' 2024-08-31T04:30:56.064 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20829 fp=#0x10000002b65' 2024-08-31T04:30:56.064 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20861 fp=#0x10000002b4d' 2024-08-31T04:30:56.064 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20893 fp=#0x20000000342' 2024-08-31T04:30:56.065 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20925 fp=#0x10000002b39' 2024-08-31T04:30:56.065 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20957 fp=#0x20000001284' 2024-08-31T04:30:56.065 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20989 fp=#0x10000001bde' 2024-08-31T04:30:56.066 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:21021 fp=#0x10000001b07' 2024-08-31T04:30:56.066 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:21053 fp=#0x10000001a8a' 2024-08-31T04:30:56.066 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:21085 fp=#0x10000001b0a' 2024-08-31T04:30:56.066 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:21117 fp=#0x50000001ba4' 2024-08-31T04:30:56.067 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:21149 fp=#0x30000000698' 2024-08-31T04:30:56.067 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:21181 fp=#0x10000001e6e' 2024-08-31T04:30:56.067 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:21213 fp=#0x10000001f25' 2024-08-31T04:30:56.068 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:21245 fp=#0x30000000675' 2024-08-31T04:30:56.068 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:21277 fp=#0x50000001ba2' 2024-08-31T04:30:56.068 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:21309 fp=#0x3000000066b' 2024-08-31T04:30:56.070 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:10207 fp=#0x50000000a35' 2024-08-31T04:30:56.070 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:10239 fp=#0x30000002ac4' 2024-08-31T04:30:56.091 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13055 fp=#0x30000002b41' 2024-08-31T04:30:56.092 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13151 fp=#0x5000000178f' 2024-08-31T04:30:56.093 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13247 fp=#0x5000000189b' 2024-08-31T04:30:56.093 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13279 fp=#0x50000001776' 2024-08-31T04:30:56.093 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13311 fp=#0x30000001ac1' 2024-08-31T04:30:56.094 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13343 fp=#0x30000002b54' 2024-08-31T04:30:56.094 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13375 fp=#0x30000001ae0' 2024-08-31T04:30:56.094 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13407 fp=#0x30000002b5f' 2024-08-31T04:30:56.094 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13439 fp=#0x30000002793' 2024-08-31T04:30:56.095 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13471 fp=#0x3000000274b' 2024-08-31T04:30:56.095 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13503 fp=#0x30000002771' 2024-08-31T04:30:56.096 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13567 fp=#0x40000000feb' 2024-08-31T04:30:56.096 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13599 fp=#0x400000011f7' 2024-08-31T04:30:56.096 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13631 fp=#0x3000000237c' 2024-08-31T04:30:56.099 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14015 fp=#0x500000009fe' 2024-08-31T04:30:56.100 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14078 fp=#0x50000000cc3' 2024-08-31T04:30:56.100 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14110 fp=#0x50000000c9a' 2024-08-31T04:30:56.100 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14142 fp=#0x50000000c2f' 2024-08-31T04:30:56.101 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14174 fp=#0x50000000ca2' 2024-08-31T04:30:56.101 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14206 fp=#0x50000000c41' 2024-08-31T04:30:56.101 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14238 fp=#0x50000000c58' 2024-08-31T04:30:56.102 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14270 fp=#0x10000003ac1' 2024-08-31T04:30:56.102 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14398 fp=#0x50000000bc5' 2024-08-31T04:30:56.103 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14430 fp=#0x50000000bf2' 2024-08-31T04:30:56.103 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14462 fp=#0x50000000be1' 2024-08-31T04:30:56.103 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14494 fp=#0x50000000be6' 2024-08-31T04:30:56.104 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14526 fp=#0x50000000bc8' 2024-08-31T04:30:56.104 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14558 fp=#0x50000000b5e' 2024-08-31T04:30:56.104 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14590 fp=#0x50000001b50' 2024-08-31T04:30:56.104 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14622 fp=#0x50000001b57' 2024-08-31T04:30:56.105 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14654 fp=#0x50000001b4b' 2024-08-31T04:30:56.105 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14686 fp=#0x50000001b84' 2024-08-31T04:30:56.106 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14718 fp=#0x500000014f0' 2024-08-31T04:30:56.106 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14750 fp=#0x50000001463' 2024-08-31T04:30:56.106 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14782 fp=#0x5000000148b' 2024-08-31T04:30:56.106 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14814 fp=#0x5000000145b' 2024-08-31T04:30:56.107 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14846 fp=#0x50000001d6c' 2024-08-31T04:30:56.107 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14878 fp=#0x50000000e55' 2024-08-31T04:30:56.107 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14910 fp=#0x50000000e51' 2024-08-31T04:30:56.108 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14942 fp=#0x50000000e11' 2024-08-31T04:30:56.108 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14974 fp=#0x50000001d6b' 2024-08-31T04:30:56.110 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15166 fp=#0x50000001012' 2024-08-31T04:30:56.110 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15198 fp=#0x50000001aa7' 2024-08-31T04:30:56.110 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15230 fp=#0x50000001ac3' 2024-08-31T04:30:56.110 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15262 fp=#0x50000000fe6' 2024-08-31T04:30:56.111 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15294 fp=#0x50000001551' 2024-08-31T04:30:56.111 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15326 fp=#0x50000001535' 2024-08-31T04:30:56.111 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15358 fp=#0x500000014fb' 2024-08-31T04:30:56.112 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15390 fp=#0x50000001107' 2024-08-31T04:30:56.112 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15422 fp=#0x50000001092' 2024-08-31T04:30:56.112 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15454 fp=#0x50000001091' 2024-08-31T04:30:56.115 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15774 fp=#0x50000001c06' 2024-08-31T04:30:56.115 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15870 fp=#0x50000001c19' 2024-08-31T04:30:56.116 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15902 fp=#0x50000001702' 2024-08-31T04:30:56.116 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15934 fp=#0x5000000170e' 2024-08-31T04:30:56.116 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15966 fp=#0x500000016ec' 2024-08-31T04:30:56.120 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16542 fp=#0x500000009cd' 2024-08-31T04:30:56.121 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16574 fp=#0x5000000196e' 2024-08-31T04:30:56.121 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16606 fp=#0x50000001754' 2024-08-31T04:30:56.122 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16670 fp=#0x50000001d12' 2024-08-31T04:30:56.122 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16766 fp=#0x50000001d08' 2024-08-31T04:30:56.123 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16798 fp=#0x50000000fbf' 2024-08-31T04:30:56.123 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16830 fp=#0x50000001bb4' 2024-08-31T04:30:56.123 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16862 fp=#0x50000000b56' 2024-08-31T04:30:56.123 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16894 fp=#0x50000000a7f' 2024-08-31T04:30:56.124 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16926 fp=#0x50000000a8f' 2024-08-31T04:30:56.124 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16958 fp=#0x5000000157d' 2024-08-31T04:30:56.124 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16990 fp=#0x5000000164f' 2024-08-31T04:30:56.125 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17022 fp=#0x50000001579' 2024-08-31T04:30:56.125 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17054 fp=#0x5000000166f' 2024-08-31T04:30:56.125 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17086 fp=#0x5000000165f' 2024-08-31T04:30:56.126 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17182 fp=#0x10000003ed1' 2024-08-31T04:30:56.126 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17214 fp=#0x10000003eb3' 2024-08-31T04:30:56.127 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17246 fp=#0x500000015f2' 2024-08-31T04:30:56.127 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17278 fp=#0x500000015a5' 2024-08-31T04:30:56.127 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17310 fp=#0x50000001564' 2024-08-31T04:30:56.128 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17342 fp=#0x100000037d9' 2024-08-31T04:30:56.128 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17374 fp=#0x100000036fd' 2024-08-31T04:30:56.128 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17406 fp=#0x100000035cc' 2024-08-31T04:30:56.129 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17438 fp=#0x10000004095' 2024-08-31T04:30:56.129 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17470 fp=#0x10000003632' 2024-08-31T04:30:56.129 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17502 fp=#0x500000012f0' 2024-08-31T04:30:56.130 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17534 fp=#0x5000000127d' 2024-08-31T04:30:56.130 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17598 fp=#0x50000001280' 2024-08-31T04:30:56.130 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17630 fp=#0x500000012c6' 2024-08-31T04:30:56.131 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17726 fp=#0x1000000228f' 2024-08-31T04:30:56.132 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17790 fp=#0x50000001300' 2024-08-31T04:30:56.132 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17854 fp=#0x10000002278' 2024-08-31T04:30:56.133 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17886 fp=#0x50000000a0a' 2024-08-31T04:30:56.133 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17918 fp=#0x50000001670' 2024-08-31T04:30:56.133 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17950 fp=#0x50000001639' 2024-08-31T04:30:56.134 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18014 fp=#0x5000000092e' 2024-08-31T04:30:56.134 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18046 fp=#0x50000001a36' 2024-08-31T04:30:56.134 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18078 fp=#0x500000011c6' 2024-08-31T04:30:56.135 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18142 fp=#0x50000001a62' 2024-08-31T04:30:56.136 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18366 fp=#0x50000001ad1' 2024-08-31T04:30:56.137 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18430 fp=#0x50000000dd2' 2024-08-31T04:30:56.137 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18462 fp=#0x50000000e8e' 2024-08-31T04:30:56.138 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18494 fp=#0x1000000044c' 2024-08-31T04:30:56.138 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18526 fp=#0x50000000acc' 2024-08-31T04:30:56.138 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18558 fp=#0x50000000ac7' 2024-08-31T04:30:56.139 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18590 fp=#0x50000000abd' 2024-08-31T04:30:56.139 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18654 fp=#0x50000000ce8' 2024-08-31T04:30:56.140 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18686 fp=#0x50000000d2f' 2024-08-31T04:30:56.140 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18718 fp=#0x50000000cf9' 2024-08-31T04:30:56.140 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18750 fp=#0x50000000ceb' 2024-08-31T04:30:56.141 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18782 fp=#0x5000000143a' 2024-08-31T04:30:56.141 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18814 fp=#0x500000011cf' 2024-08-31T04:30:56.141 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18846 fp=#0x50000000dac' 2024-08-31T04:30:56.142 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18878 fp=#0x50000000de8' 2024-08-31T04:30:56.142 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18910 fp=#0x50000000de0' 2024-08-31T04:30:56.142 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18942 fp=#0x50000000f02' 2024-08-31T04:30:56.142 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18974 fp=#0x50000000df8' 2024-08-31T04:30:56.143 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19006 fp=#0x50000000f1b' 2024-08-31T04:30:56.143 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19070 fp=#0x50000001811' 2024-08-31T04:30:56.144 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19134 fp=#0x500000017b9' 2024-08-31T04:30:56.145 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19262 fp=#0x500000017f1' 2024-08-31T04:30:56.145 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19294 fp=#0x5000000183c' 2024-08-31T04:30:56.145 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19326 fp=#0x50000001844' 2024-08-31T04:30:56.146 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19358 fp=#0x500000017d5' 2024-08-31T04:30:56.146 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19390 fp=#0x50000001805' 2024-08-31T04:30:56.146 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19422 fp=#0x500000017e7' 2024-08-31T04:30:56.147 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19454 fp=#0x50000001921' 2024-08-31T04:30:56.147 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19486 fp=#0x500000019ef' 2024-08-31T04:30:56.147 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19518 fp=#0x50000001935' 2024-08-31T04:30:56.147 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19550 fp=#0x50000001997' 2024-08-31T04:30:56.148 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19582 fp=#0x5000000194f' 2024-08-31T04:30:56.148 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19614 fp=#0x10000003e32' 2024-08-31T04:30:56.148 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19646 fp=#0x10000003ed3' 2024-08-31T04:30:56.149 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19710 fp=#0x10000003ee2' 2024-08-31T04:30:56.149 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19742 fp=#0x50000001446' 2024-08-31T04:30:56.149 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19774 fp=#0x10000003e0f' 2024-08-31T04:30:56.150 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19806 fp=#0x500000016be' 2024-08-31T04:30:56.150 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19838 fp=#0x50000001163' 2024-08-31T04:30:56.150 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19870 fp=#0x500000016a0' 2024-08-31T04:30:56.151 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19902 fp=#0x5000000115d' 2024-08-31T04:30:56.151 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19934 fp=#0x50000001c91' 2024-08-31T04:30:56.151 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19966 fp=#0x50000001cd9' 2024-08-31T04:30:56.152 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19998 fp=#0x50000001cee' 2024-08-31T04:30:56.152 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20030 fp=#0x50000001cd4' 2024-08-31T04:30:56.152 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20062 fp=#0x50000001cb1' 2024-08-31T04:30:56.153 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20094 fp=#0x50000001ce4' 2024-08-31T04:30:56.153 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20126 fp=#0x500000010e0' 2024-08-31T04:30:56.153 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20158 fp=#0x5000000106a' 2024-08-31T04:30:56.154 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20190 fp=#0x5000000107d' 2024-08-31T04:30:56.154 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20222 fp=#0x50000001084' 2024-08-31T04:30:56.154 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20254 fp=#0x50000001c77' 2024-08-31T04:30:56.155 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20286 fp=#0x500000018ad' 2024-08-31T04:30:56.155 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20318 fp=#0x200000003c5' 2024-08-31T04:30:56.155 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20350 fp=#0x200000002e0' 2024-08-31T04:30:56.156 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20382 fp=#0x200000003d4' 2024-08-31T04:30:56.156 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20414 fp=#0x20000000496' 2024-08-31T04:30:56.156 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20446 fp=#0x10000000e7c' 2024-08-31T04:30:56.157 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20510 fp=#0x50000001945' 2024-08-31T04:30:56.157 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20542 fp=#0x5000000192b' 2024-08-31T04:30:56.158 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20606 fp=#0x500000018f8' 2024-08-31T04:30:56.158 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20638 fp=#0x100000031f8' 2024-08-31T04:30:56.158 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20702 fp=#0x100000031c9' 2024-08-31T04:30:56.159 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20734 fp=#0x10000002ac8' 2024-08-31T04:30:56.159 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20766 fp=#0x10000002b45' 2024-08-31T04:30:56.159 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20798 fp=#0x200000011d3' 2024-08-31T04:30:56.160 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20830 fp=#0x20000000359' 2024-08-31T04:30:56.160 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20862 fp=#0x10000002b13' 2024-08-31T04:30:56.160 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20894 fp=#0x10000002b41' 2024-08-31T04:30:56.161 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20926 fp=#0x200000011ea' 2024-08-31T04:30:56.161 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20958 fp=#0x2000000124a' 2024-08-31T04:30:56.161 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20990 fp=#0x10000001bdb' 2024-08-31T04:30:56.162 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:21022 fp=#0x10000001b9a' 2024-08-31T04:30:56.162 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:21054 fp=#0x10000001bcc' 2024-08-31T04:30:56.162 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:21086 fp=#0x10000001bca' 2024-08-31T04:30:56.163 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:21118 fp=#0x3000000067b' 2024-08-31T04:30:56.163 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:21150 fp=#0x10000001efd' 2024-08-31T04:30:56.163 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:21182 fp=#0x10000001f31' 2024-08-31T04:30:56.164 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:21246 fp=#0x10000001e46' 2024-08-31T04:30:56.164 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:21278 fp=#0x3000000066c' 2024-08-31T04:30:56.165 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:21310 fp=#0x3000000069e' 2024-08-31T04:30:56.165 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:10080 fp=#0x30000001846' 2024-08-31T04:30:56.166 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:10208 fp=#0x10000001a31' 2024-08-31T04:30:56.187 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13056 fp=#0x30000002b1e' 2024-08-31T04:30:56.188 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13184 fp=#0x500000018a6' 2024-08-31T04:30:56.188 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13248 fp=#0x400000016ee' 2024-08-31T04:30:56.189 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13280 fp=#0x30000001a5f' 2024-08-31T04:30:56.189 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13312 fp=#0x30000001a7e' 2024-08-31T04:30:56.189 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13344 fp=#0x30000001a63' 2024-08-31T04:30:56.190 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13376 fp=#0x30000002b63' 2024-08-31T04:30:56.190 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13408 fp=#0x30000001aa6' 2024-08-31T04:30:56.190 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13440 fp=#0x30000002786' 2024-08-31T04:30:56.191 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13472 fp=#0x30000002772' 2024-08-31T04:30:56.191 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13504 fp=#0x30000002777' 2024-08-31T04:30:56.192 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13600 fp=#0x4000000128a' 2024-08-31T04:30:56.192 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13632 fp=#0x30000002377' 2024-08-31T04:30:56.192 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13664 fp=#0x3000000237a' 2024-08-31T04:30:56.195 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14111 fp=#0x50000000c1d' 2024-08-31T04:30:56.196 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14143 fp=#0x50000000c34' 2024-08-31T04:30:56.196 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14175 fp=#0x50000000c8f' 2024-08-31T04:30:56.196 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14207 fp=#0x50000000cad' 2024-08-31T04:30:56.197 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14239 fp=#0x50000000c7f' 2024-08-31T04:30:56.197 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14303 fp=#0x10000003ace' 2024-08-31T04:30:56.198 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14367 fp=#0x10000003a92' 2024-08-31T04:30:56.198 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14399 fp=#0x50000000b7a' 2024-08-31T04:30:56.198 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14431 fp=#0x50000000bda' 2024-08-31T04:30:56.199 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14463 fp=#0x50000000bd9' 2024-08-31T04:30:56.199 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14495 fp=#0x50000000bea' 2024-08-31T04:30:56.199 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14527 fp=#0x50000000b6a' 2024-08-31T04:30:56.200 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14559 fp=#0x50000000bab' 2024-08-31T04:30:56.200 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14591 fp=#0x50000001b26' 2024-08-31T04:30:56.200 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14623 fp=#0x50000001b62' 2024-08-31T04:30:56.201 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14655 fp=#0x50000001b6b' 2024-08-31T04:30:56.201 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14687 fp=#0x50000001b28' 2024-08-31T04:30:56.201 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14719 fp=#0x50000001460' 2024-08-31T04:30:56.202 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14751 fp=#0x50000001453' 2024-08-31T04:30:56.202 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14783 fp=#0x500000014da' 2024-08-31T04:30:56.202 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14815 fp=#0x5000000149b' 2024-08-31T04:30:56.202 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14847 fp=#0x50000001874' 2024-08-31T04:30:56.203 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14879 fp=#0x50000000e9a' 2024-08-31T04:30:56.203 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14911 fp=#0x5000000186c' 2024-08-31T04:30:56.203 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14943 fp=#0x50000000e8d' 2024-08-31T04:30:56.204 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14975 fp=#0x5000000187f' 2024-08-31T04:30:56.205 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15167 fp=#0x50000001abd' 2024-08-31T04:30:56.205 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15199 fp=#0x50000000fd2' 2024-08-31T04:30:56.206 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15231 fp=#0x50000000ffd' 2024-08-31T04:30:56.206 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15263 fp=#0x50000000fff' 2024-08-31T04:30:56.206 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15295 fp=#0x50000001510' 2024-08-31T04:30:56.207 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15327 fp=#0x50000001cf1' 2024-08-31T04:30:56.207 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15359 fp=#0x50000001cf9' 2024-08-31T04:30:56.207 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15391 fp=#0x50000001099' 2024-08-31T04:30:56.207 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15423 fp=#0x50000001094' 2024-08-31T04:30:56.208 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15455 fp=#0x50000001106' 2024-08-31T04:30:56.210 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15775 fp=#0x50000001c1a' 2024-08-31T04:30:56.211 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15839 fp=#0x50000001bda' 2024-08-31T04:30:56.211 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15871 fp=#0x50000001c0a' 2024-08-31T04:30:56.211 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15903 fp=#0x50000001738' 2024-08-31T04:30:56.212 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15935 fp=#0x50000001713' 2024-08-31T04:30:56.212 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15967 fp=#0x50000001719' 2024-08-31T04:30:56.216 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16543 fp=#0x500000009d1' 2024-08-31T04:30:56.216 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16575 fp=#0x50000001972' 2024-08-31T04:30:56.217 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16607 fp=#0x50000001770' 2024-08-31T04:30:56.217 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16639 fp=#0x500000016e2' 2024-08-31T04:30:56.217 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16671 fp=#0x50000001d11' 2024-08-31T04:30:56.218 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16735 fp=#0x50000001a95' 2024-08-31T04:30:56.218 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16831 fp=#0x50000001bbe' 2024-08-31T04:30:56.219 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16863 fp=#0x50000000b35' 2024-08-31T04:30:56.219 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16895 fp=#0x50000000a36' 2024-08-31T04:30:56.219 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16927 fp=#0x50000000a87' 2024-08-31T04:30:56.220 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16959 fp=#0x500000015af' 2024-08-31T04:30:56.220 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16991 fp=#0x5000000161a' 2024-08-31T04:30:56.220 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17023 fp=#0x500000015ab' 2024-08-31T04:30:56.221 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17055 fp=#0x500000015cd' 2024-08-31T04:30:56.221 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17087 fp=#0x50000001596' 2024-08-31T04:30:56.221 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17151 fp=#0x10000003e91' 2024-08-31T04:30:56.222 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17183 fp=#0x10000003ea6' 2024-08-31T04:30:56.222 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17215 fp=#0x10000003ece' 2024-08-31T04:30:56.222 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17247 fp=#0x500000015be' 2024-08-31T04:30:56.223 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17279 fp=#0x500000015b0' 2024-08-31T04:30:56.223 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17311 fp=#0x50000001607' 2024-08-31T04:30:56.226 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17343 fp=#0x100000035c2' 2024-08-31T04:30:56.226 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17375 fp=#0x100000036b5' 2024-08-31T04:30:56.227 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17407 fp=#0x10000003603' 2024-08-31T04:30:56.227 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17439 fp=#0x100000035e0' 2024-08-31T04:30:56.227 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17471 fp=#0x10000003718' 2024-08-31T04:30:56.227 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17503 fp=#0x500000012ce' 2024-08-31T04:30:56.228 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17535 fp=#0x500000012c4' 2024-08-31T04:30:56.228 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17599 fp=#0x50000001261' 2024-08-31T04:30:56.229 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17663 fp=#0x1000000234f' 2024-08-31T04:30:56.229 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17695 fp=#0x1000000228d' 2024-08-31T04:30:56.230 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17759 fp=#0x10000002351' 2024-08-31T04:30:56.230 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17791 fp=#0x10000002281' 2024-08-31T04:30:56.231 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17919 fp=#0x50000000a09' 2024-08-31T04:30:56.232 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18015 fp=#0x50000001a25' 2024-08-31T04:30:56.232 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18047 fp=#0x50000000917' 2024-08-31T04:30:56.232 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18079 fp=#0x50000001a28' 2024-08-31T04:30:56.233 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18111 fp=#0x50000001a4f' 2024-08-31T04:30:56.233 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18143 fp=#0x50000001a6f' 2024-08-31T04:30:56.233 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18175 fp=#0x50000001a34' 2024-08-31T04:30:56.234 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18207 fp=#0x50000001a32' 2024-08-31T04:30:56.234 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18239 fp=#0x50000001ab4' 2024-08-31T04:30:56.234 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18271 fp=#0x50000000dc6' 2024-08-31T04:30:56.235 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18367 fp=#0x50000000ddd' 2024-08-31T04:30:56.236 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18463 fp=#0x50000001ad2' 2024-08-31T04:30:56.236 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18495 fp=#0x10000000446' 2024-08-31T04:30:56.237 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18527 fp=#0x50000000acd' 2024-08-31T04:30:56.237 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18559 fp=#0x50000000ab9' 2024-08-31T04:30:56.237 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18591 fp=#0x1000000041f' 2024-08-31T04:30:56.237 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18623 fp=#0x100000003b6' 2024-08-31T04:30:56.238 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18655 fp=#0x50000000d20' 2024-08-31T04:30:56.238 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18687 fp=#0x50000000d63' 2024-08-31T04:30:56.238 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18719 fp=#0x50000000d3a' 2024-08-31T04:30:56.239 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18751 fp=#0x50000000d65' 2024-08-31T04:30:56.239 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18783 fp=#0x50000000d0d' 2024-08-31T04:30:56.239 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18815 fp=#0x500000011c9' 2024-08-31T04:30:56.240 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18847 fp=#0x50000000da8' 2024-08-31T04:30:56.240 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18879 fp=#0x50000000dd3' 2024-08-31T04:30:56.240 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18911 fp=#0x500000019c5' 2024-08-31T04:30:56.241 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18943 fp=#0x50000000dff' 2024-08-31T04:30:56.241 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18975 fp=#0x50000000dce' 2024-08-31T04:30:56.241 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19007 fp=#0x50000000f26' 2024-08-31T04:30:56.242 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19039 fp=#0x500000017c9' 2024-08-31T04:30:56.243 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19135 fp=#0x5000000183a' 2024-08-31T04:30:56.244 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19263 fp=#0x500000017e6' 2024-08-31T04:30:56.245 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19295 fp=#0x50000001816' 2024-08-31T04:30:56.245 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19327 fp=#0x500000017fe' 2024-08-31T04:30:56.245 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19359 fp=#0x5000000182c' 2024-08-31T04:30:56.246 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19391 fp=#0x50000001812' 2024-08-31T04:30:56.246 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19423 fp=#0x50000001c61' 2024-08-31T04:30:56.246 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19455 fp=#0x5000000197a' 2024-08-31T04:30:56.247 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19487 fp=#0x500000019a7' 2024-08-31T04:30:56.247 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19519 fp=#0x5000000193a' 2024-08-31T04:30:56.247 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19551 fp=#0x5000000194a' 2024-08-31T04:30:56.248 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19583 fp=#0x500000019f3' 2024-08-31T04:30:56.249 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19711 fp=#0x10000003e9f' 2024-08-31T04:30:56.249 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19743 fp=#0x10000003e51' 2024-08-31T04:30:56.250 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19807 fp=#0x50000000979' 2024-08-31T04:30:56.250 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19839 fp=#0x5000000115a' 2024-08-31T04:30:56.250 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19871 fp=#0x50000001170' 2024-08-31T04:30:56.250 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19903 fp=#0x5000000113e' 2024-08-31T04:30:56.251 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19967 fp=#0x50000001cd8' 2024-08-31T04:30:56.251 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19999 fp=#0x50000001cc2' 2024-08-31T04:30:56.252 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20031 fp=#0x50000001cb4' 2024-08-31T04:30:56.252 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20063 fp=#0x50000001c9f' 2024-08-31T04:30:56.252 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20095 fp=#0x50000001cbc' 2024-08-31T04:30:56.253 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20127 fp=#0x50000001067' 2024-08-31T04:30:56.253 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20159 fp=#0x5000000106e' 2024-08-31T04:30:56.253 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20191 fp=#0x50000001081' 2024-08-31T04:30:56.254 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20223 fp=#0x5000000102f' 2024-08-31T04:30:56.254 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20255 fp=#0x500000011ab' 2024-08-31T04:30:56.254 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20287 fp=#0x50000001c7e' 2024-08-31T04:30:56.255 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20319 fp=#0x200000003a7' 2024-08-31T04:30:56.255 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20383 fp=#0x200000002fb' 2024-08-31T04:30:56.256 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20415 fp=#0x200000002eb' 2024-08-31T04:30:56.256 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20447 fp=#0x100000011ac' 2024-08-31T04:30:56.256 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20479 fp=#0x200000002f3' 2024-08-31T04:30:56.257 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20511 fp=#0x1000000323d' 2024-08-31T04:30:56.257 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20543 fp=#0x50000001922' 2024-08-31T04:30:56.257 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20575 fp=#0x100000032d3' 2024-08-31T04:30:56.258 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20607 fp=#0x10000003242' 2024-08-31T04:30:56.258 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20639 fp=#0x10000003297' 2024-08-31T04:30:56.258 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20671 fp=#0x100000032e9' 2024-08-31T04:30:56.259 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20703 fp=#0x100000032d9' 2024-08-31T04:30:56.259 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20735 fp=#0x10000002b33' 2024-08-31T04:30:56.259 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20767 fp=#0x10000002b61' 2024-08-31T04:30:56.260 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20799 fp=#0x200000011d9' 2024-08-31T04:30:56.260 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20831 fp=#0x20000001214' 2024-08-31T04:30:56.260 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20863 fp=#0x200000011f4' 2024-08-31T04:30:56.260 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20895 fp=#0x2000000118c' 2024-08-31T04:30:56.261 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20927 fp=#0x200000011fc' 2024-08-31T04:30:56.261 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20959 fp=#0x20000000585' 2024-08-31T04:30:56.261 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20991 fp=#0x10000001bf6' 2024-08-31T04:30:56.262 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:21023 fp=#0x10000001a4f' 2024-08-31T04:30:56.262 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:21087 fp=#0x10000001a96' 2024-08-31T04:30:56.263 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:21119 fp=#0x10000001f27' 2024-08-31T04:30:56.263 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:21151 fp=#0x3000000067c' 2024-08-31T04:30:56.263 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:21183 fp=#0x50000001bb5' 2024-08-31T04:30:56.264 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:21215 fp=#0x10000001e9e' 2024-08-31T04:30:56.264 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:21247 fp=#0x10000001e78' 2024-08-31T04:30:56.264 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:21279 fp=#0x10000001ef3' 2024-08-31T04:30:56.265 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:21311 fp=#0x30000000681' 2024-08-31T04:30:56.266 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:10209 fp=#0x50000001559' 2024-08-31T04:30:56.266 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:10241 fp=#0x100000026b6' 2024-08-31T04:30:56.286 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13057 fp=#0x30000002b31' 2024-08-31T04:30:56.287 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13153 fp=#0x400000015fe' 2024-08-31T04:30:56.288 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13281 fp=#0x30000001afb' 2024-08-31T04:30:56.288 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13313 fp=#0x30000001b02' 2024-08-31T04:30:56.288 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13345 fp=#0x30000002b6c' 2024-08-31T04:30:56.289 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13377 fp=#0x30000001aa8' 2024-08-31T04:30:56.289 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13409 fp=#0x30000001ab2' 2024-08-31T04:30:56.289 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13441 fp=#0x3000000278b' 2024-08-31T04:30:56.290 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13473 fp=#0x30000002757' 2024-08-31T04:30:56.290 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13505 fp=#0x30000002747' 2024-08-31T04:30:56.291 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13601 fp=#0x40000001202' 2024-08-31T04:30:56.294 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14080 fp=#0x50000000c8b' 2024-08-31T04:30:56.295 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14112 fp=#0x50000000cc4' 2024-08-31T04:30:56.295 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14144 fp=#0x50000000c4d' 2024-08-31T04:30:56.295 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14176 fp=#0x50000000c3b' 2024-08-31T04:30:56.296 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14208 fp=#0x500000018c6' 2024-08-31T04:30:56.296 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14240 fp=#0x50000000cab' 2024-08-31T04:30:56.296 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14304 fp=#0x10000003b2f' 2024-08-31T04:30:56.297 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14400 fp=#0x50000000bae' 2024-08-31T04:30:56.298 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14432 fp=#0x50000000bbb' 2024-08-31T04:30:56.298 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14464 fp=#0x50000000b88' 2024-08-31T04:30:56.298 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14496 fp=#0x50000000b6c' 2024-08-31T04:30:56.299 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14528 fp=#0x50000000b5f' 2024-08-31T04:30:56.299 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14560 fp=#0x50000000bb1' 2024-08-31T04:30:56.299 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14592 fp=#0x50000001b92' 2024-08-31T04:30:56.300 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14624 fp=#0x50000001b7b' 2024-08-31T04:30:56.300 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14656 fp=#0x50000001b6f' 2024-08-31T04:30:56.300 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14688 fp=#0x50000001b72' 2024-08-31T04:30:56.301 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14720 fp=#0x500000014bb' 2024-08-31T04:30:56.301 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14752 fp=#0x500000014e9' 2024-08-31T04:30:56.301 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14784 fp=#0x500000014c1' 2024-08-31T04:30:56.301 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14816 fp=#0x500000014a0' 2024-08-31T04:30:56.302 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14848 fp=#0x50000001850' 2024-08-31T04:30:56.302 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14880 fp=#0x50000000e7b' 2024-08-31T04:30:56.302 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14912 fp=#0x50000000e3f' 2024-08-31T04:30:56.303 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14944 fp=#0x50000000e49' 2024-08-31T04:30:56.303 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14976 fp=#0x50000000e79' 2024-08-31T04:30:56.304 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15168 fp=#0x50000001aa4' 2024-08-31T04:30:56.305 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15200 fp=#0x50000001a9f' 2024-08-31T04:30:56.305 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15232 fp=#0x50000000fdc' 2024-08-31T04:30:56.305 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15264 fp=#0x500000016c8' 2024-08-31T04:30:56.306 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15296 fp=#0x50000001513' 2024-08-31T04:30:56.306 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15328 fp=#0x5000000151d' 2024-08-31T04:30:56.306 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15360 fp=#0x50000001529' 2024-08-31T04:30:56.306 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15392 fp=#0x500000010cc' 2024-08-31T04:30:56.307 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15424 fp=#0x500000010a3' 2024-08-31T04:30:56.307 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15456 fp=#0x500000010d5' 2024-08-31T04:30:56.309 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15712 fp=#0x50000001bff' 2024-08-31T04:30:56.310 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15776 fp=#0x50000001bee' 2024-08-31T04:30:56.310 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15808 fp=#0x50000001bd9' 2024-08-31T04:30:56.311 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15904 fp=#0x500000016ed' 2024-08-31T04:30:56.311 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15936 fp=#0x500000016f2' 2024-08-31T04:30:56.311 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15968 fp=#0x5000000171f' 2024-08-31T04:30:56.315 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16544 fp=#0x500000009d5' 2024-08-31T04:30:56.315 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16576 fp=#0x50000001964' 2024-08-31T04:30:56.316 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16608 fp=#0x50000001772' 2024-08-31T04:30:56.317 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16832 fp=#0x50000001bb3' 2024-08-31T04:30:56.318 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16864 fp=#0x50000000b51' 2024-08-31T04:30:56.318 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16896 fp=#0x50000000a8e' 2024-08-31T04:30:56.318 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16928 fp=#0x50000000a63' 2024-08-31T04:30:56.318 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16960 fp=#0x50000001698' 2024-08-31T04:30:56.319 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16992 fp=#0x500000015d6' 2024-08-31T04:30:56.319 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17024 fp=#0x5000000157b' 2024-08-31T04:30:56.319 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17056 fp=#0x500000015c3' 2024-08-31T04:30:56.320 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17088 fp=#0x5000000159b' 2024-08-31T04:30:56.321 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17248 fp=#0x5000000157a' 2024-08-31T04:30:56.321 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17280 fp=#0x500000015e0' 2024-08-31T04:30:56.322 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17312 fp=#0x500000015e3' 2024-08-31T04:30:56.322 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17344 fp=#0x100000035fa' 2024-08-31T04:30:56.322 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17376 fp=#0x10000003711' 2024-08-31T04:30:56.323 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17408 fp=#0x10000003611' 2024-08-31T04:30:56.323 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17440 fp=#0x10000003784' 2024-08-31T04:30:56.323 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17472 fp=#0x500000016ba' 2024-08-31T04:30:56.324 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17504 fp=#0x500000012f2' 2024-08-31T04:30:56.324 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17600 fp=#0x500000012db' 2024-08-31T04:30:56.326 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17824 fp=#0x10000002274' 2024-08-31T04:30:56.327 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17920 fp=#0x50000001648' 2024-08-31T04:30:56.327 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17952 fp=#0x50000000a08' 2024-08-31T04:30:56.328 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18016 fp=#0x500000018b5' 2024-08-31T04:30:56.328 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18048 fp=#0x5000000092b' 2024-08-31T04:30:56.328 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18080 fp=#0x50000001a37' 2024-08-31T04:30:56.329 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18112 fp=#0x50000001a3f' 2024-08-31T04:30:56.329 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18144 fp=#0x50000001a4a' 2024-08-31T04:30:56.329 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18208 fp=#0x50000001a5b' 2024-08-31T04:30:56.330 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18240 fp=#0x50000001a83' 2024-08-31T04:30:56.331 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18336 fp=#0x50000000e97' 2024-08-31T04:30:56.331 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18432 fp=#0x50000000de9' 2024-08-31T04:30:56.332 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18496 fp=#0x50000000ee2' 2024-08-31T04:30:56.333 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18592 fp=#0x100000003ce' 2024-08-31T04:30:56.333 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18624 fp=#0x10000000425' 2024-08-31T04:30:56.333 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18656 fp=#0x50000000d68' 2024-08-31T04:30:56.334 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18688 fp=#0x50000000d5a' 2024-08-31T04:30:56.334 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18720 fp=#0x50000000cf8' 2024-08-31T04:30:56.334 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18752 fp=#0x50000000d27' 2024-08-31T04:30:56.335 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18784 fp=#0x50000000d60' 2024-08-31T04:30:56.335 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18816 fp=#0x500000011d8' 2024-08-31T04:30:56.335 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18848 fp=#0x50000000d8f' 2024-08-31T04:30:56.335 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18880 fp=#0x500000019bf' 2024-08-31T04:30:56.336 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18912 fp=#0x50000000d9d' 2024-08-31T04:30:56.336 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18944 fp=#0x50000000dd6' 2024-08-31T04:30:56.336 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18976 fp=#0x50000000dfd' 2024-08-31T04:30:56.337 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19008 fp=#0x50000000dab' 2024-08-31T04:30:56.338 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19168 fp=#0x500000017de' 2024-08-31T04:30:56.339 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19264 fp=#0x500000017aa' 2024-08-31T04:30:56.339 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19328 fp=#0x50000001842' 2024-08-31T04:30:56.340 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19360 fp=#0x50000001830' 2024-08-31T04:30:56.340 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19392 fp=#0x50000001c46' 2024-08-31T04:30:56.340 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19424 fp=#0x50000001c59' 2024-08-31T04:30:56.341 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19456 fp=#0x50000001a0f' 2024-08-31T04:30:56.341 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19488 fp=#0x500000019f2' 2024-08-31T04:30:56.341 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19520 fp=#0x5000000196b' 2024-08-31T04:30:56.342 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19552 fp=#0x50000001920' 2024-08-31T04:30:56.342 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19584 fp=#0x5000000192a' 2024-08-31T04:30:56.342 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19616 fp=#0x10000003e78' 2024-08-31T04:30:56.343 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19776 fp=#0x5000000095e' 2024-08-31T04:30:56.344 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19808 fp=#0x50000000959' 2024-08-31T04:30:56.344 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19840 fp=#0x50000001146' 2024-08-31T04:30:56.344 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19872 fp=#0x50000001148' 2024-08-31T04:30:56.345 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19904 fp=#0x50000001157' 2024-08-31T04:30:56.345 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19936 fp=#0x50000000f72' 2024-08-31T04:30:56.345 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19968 fp=#0x50000000f7a' 2024-08-31T04:30:56.346 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20000 fp=#0x50000000f86' 2024-08-31T04:30:56.346 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20032 fp=#0x50000000f94' 2024-08-31T04:30:56.346 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20064 fp=#0x50000001cef' 2024-08-31T04:30:56.346 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20096 fp=#0x50000001c96' 2024-08-31T04:30:56.347 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20128 fp=#0x50000001043' 2024-08-31T04:30:56.347 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20160 fp=#0x50000001073' 2024-08-31T04:30:56.347 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20192 fp=#0x50000001041' 2024-08-31T04:30:56.348 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20224 fp=#0x50000001024' 2024-08-31T04:30:56.348 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20256 fp=#0x500000011b6' 2024-08-31T04:30:56.348 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20288 fp=#0x50000001c76' 2024-08-31T04:30:56.349 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20320 fp=#0x200000002df' 2024-08-31T04:30:56.349 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20352 fp=#0x10000000f83' 2024-08-31T04:30:56.349 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20384 fp=#0x200000003cf' 2024-08-31T04:30:56.349 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20416 fp=#0x10000000e90' 2024-08-31T04:30:56.350 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20448 fp=#0x200000002d4' 2024-08-31T04:30:56.350 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20480 fp=#0x1000000318f' 2024-08-31T04:30:56.350 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20512 fp=#0x50000001907' 2024-08-31T04:30:56.351 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20544 fp=#0x1000000319a' 2024-08-31T04:30:56.351 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20576 fp=#0x50000001946' 2024-08-31T04:30:56.351 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20608 fp=#0x500000018cf' 2024-08-31T04:30:56.352 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20640 fp=#0x100000032ae' 2024-08-31T04:30:56.352 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20672 fp=#0x200000007b6' 2024-08-31T04:30:56.352 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20704 fp=#0x100000031c6' 2024-08-31T04:30:56.353 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20736 fp=#0x2000000127c' 2024-08-31T04:30:56.353 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20768 fp=#0x10000002aff' 2024-08-31T04:30:56.353 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20800 fp=#0x20000000338' 2024-08-31T04:30:56.354 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20832 fp=#0x10000002ba5' 2024-08-31T04:30:56.354 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20864 fp=#0x20000001212' 2024-08-31T04:30:56.354 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20896 fp=#0x10000002b37' 2024-08-31T04:30:56.354 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20928 fp=#0x200000011ed' 2024-08-31T04:30:56.355 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20960 fp=#0x20000000348' 2024-08-31T04:30:56.355 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20992 fp=#0x10000001ad2' 2024-08-31T04:30:56.355 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:21024 fp=#0x10000001a70' 2024-08-31T04:30:56.356 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:21056 fp=#0x10000001aff' 2024-08-31T04:30:56.356 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:21088 fp=#0x10000001aae' 2024-08-31T04:30:56.356 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:21120 fp=#0x10000001f39' 2024-08-31T04:30:56.357 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:21152 fp=#0x10000001ed9' 2024-08-31T04:30:56.357 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:21184 fp=#0x10000001ed7' 2024-08-31T04:30:56.357 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:21216 fp=#0x10000001e6c' 2024-08-31T04:30:56.358 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:21248 fp=#0x10000001f1d' 2024-08-31T04:30:56.358 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:21280 fp=#0x10000001ee5' 2024-08-31T04:30:56.358 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:21312 fp=#0x30000000271' 2024-08-31T04:30:56.359 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_path:mds.4:10018 fp=#0x1' 2024-08-31T04:30:56.360 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:10210 fp=#0x10000003e8b' 2024-08-31T04:30:56.380 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13058 fp=#0x30000002b2b' 2024-08-31T04:30:56.381 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13154 fp=#0x500000016d4' 2024-08-31T04:30:56.381 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13186 fp=#0x400000017b5' 2024-08-31T04:30:56.382 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13282 fp=#0x30000002b68' 2024-08-31T04:30:56.382 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13314 fp=#0x30000001a57' 2024-08-31T04:30:56.382 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13346 fp=#0x30000002b5e' 2024-08-31T04:30:56.383 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13378 fp=#0x30000002b7a' 2024-08-31T04:30:56.383 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13410 fp=#0x30000001ae8' 2024-08-31T04:30:56.383 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13442 fp=#0x30000002782' 2024-08-31T04:30:56.384 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13474 fp=#0x3000000278c' 2024-08-31T04:30:56.384 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13570 fp=#0x40000001334' 2024-08-31T04:30:56.385 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13602 fp=#0x40000000f81' 2024-08-31T04:30:56.385 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13698 fp=#0x3000000229a' 2024-08-31T04:30:56.387 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13954 fp=#0x500000009f5' 2024-08-31T04:30:56.388 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14081 fp=#0x50000000cc2' 2024-08-31T04:30:56.389 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14177 fp=#0x50000000c89' 2024-08-31T04:30:56.389 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14209 fp=#0x50000000c5a' 2024-08-31T04:30:56.390 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14241 fp=#0x50000000c2a' 2024-08-31T04:30:56.391 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14401 fp=#0x50000000c05' 2024-08-31T04:30:56.391 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14433 fp=#0x50000000be9' 2024-08-31T04:30:56.391 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14465 fp=#0x50000000bd2' 2024-08-31T04:30:56.392 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14497 fp=#0x50000000bd7' 2024-08-31T04:30:56.392 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14529 fp=#0x50000000b9a' 2024-08-31T04:30:56.392 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14561 fp=#0x50000000bc7' 2024-08-31T04:30:56.393 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14593 fp=#0x50000001b11' 2024-08-31T04:30:56.393 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14625 fp=#0x50000001b1a' 2024-08-31T04:30:56.393 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14657 fp=#0x50000001b5c' 2024-08-31T04:30:56.394 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14689 fp=#0x50000001b12' 2024-08-31T04:30:56.394 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14721 fp=#0x500000014e3' 2024-08-31T04:30:56.394 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14753 fp=#0x500000014d7' 2024-08-31T04:30:56.394 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14785 fp=#0x50000001492' 2024-08-31T04:30:56.395 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14817 fp=#0x500000014c3' 2024-08-31T04:30:56.395 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14849 fp=#0x50000000e96' 2024-08-31T04:30:56.395 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14881 fp=#0x50000001853' 2024-08-31T04:30:56.396 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14913 fp=#0x50000000e5a' 2024-08-31T04:30:56.396 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14945 fp=#0x50000000e58' 2024-08-31T04:30:56.396 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14977 fp=#0x50000000e2b' 2024-08-31T04:30:56.398 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15201 fp=#0x50000001ace' 2024-08-31T04:30:56.398 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15233 fp=#0x50000000fdb' 2024-08-31T04:30:56.398 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15265 fp=#0x5000000100a' 2024-08-31T04:30:56.399 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15297 fp=#0x50000001539' 2024-08-31T04:30:56.399 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15329 fp=#0x50000001cf0' 2024-08-31T04:30:56.399 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15361 fp=#0x500000014ff' 2024-08-31T04:30:56.400 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15393 fp=#0x5000000110e' 2024-08-31T04:30:56.400 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15425 fp=#0x50000001110' 2024-08-31T04:30:56.400 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15457 fp=#0x500000010e6' 2024-08-31T04:30:56.401 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15521 fp=#0x5000000184f' 2024-08-31T04:30:56.403 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15777 fp=#0x50000000cd5' 2024-08-31T04:30:56.403 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15841 fp=#0x50000001c1b' 2024-08-31T04:30:56.403 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15873 fp=#0x50000001c10' 2024-08-31T04:30:56.404 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15905 fp=#0x500000016f0' 2024-08-31T04:30:56.404 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15937 fp=#0x5000000171a' 2024-08-31T04:30:56.404 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15969 fp=#0x500000016ef' 2024-08-31T04:30:56.406 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16193 fp=#0x50000001c1d' 2024-08-31T04:30:56.406 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16225 fp=#0x500000012ba' 2024-08-31T04:30:56.407 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16257 fp=#0x500000012bf' 2024-08-31T04:30:56.409 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16545 fp=#0x500000009ee' 2024-08-31T04:30:56.409 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16577 fp=#0x50000001963' 2024-08-31T04:30:56.409 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16609 fp=#0x5000000176a' 2024-08-31T04:30:56.410 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16705 fp=#0x50000001d0d' 2024-08-31T04:30:56.410 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16737 fp=#0x50000001d00' 2024-08-31T04:30:56.411 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16769 fp=#0x50000001a72' 2024-08-31T04:30:56.411 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16801 fp=#0x50000001d09' 2024-08-31T04:30:56.411 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16833 fp=#0x50000001bcf' 2024-08-31T04:30:56.412 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16865 fp=#0x50000000b46' 2024-08-31T04:30:56.412 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16897 fp=#0x50000000a90' 2024-08-31T04:30:56.412 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16929 fp=#0x50000000a43' 2024-08-31T04:30:56.413 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16961 fp=#0x5000000164c' 2024-08-31T04:30:56.413 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16993 fp=#0x5000000163e' 2024-08-31T04:30:56.414 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17025 fp=#0x500000015ea' 2024-08-31T04:30:56.414 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17057 fp=#0x50000001576' 2024-08-31T04:30:56.414 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17089 fp=#0x500000015cb' 2024-08-31T04:30:56.415 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17153 fp=#0x500000016b0' 2024-08-31T04:30:56.415 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17249 fp=#0x500000015dc' 2024-08-31T04:30:56.416 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17281 fp=#0x50000001589' 2024-08-31T04:30:56.416 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17313 fp=#0x500000015fe' 2024-08-31T04:30:56.416 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17345 fp=#0x10000003635' 2024-08-31T04:30:56.417 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17377 fp=#0x1000000360c' 2024-08-31T04:30:56.417 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17409 fp=#0x1000000365e' 2024-08-31T04:30:56.417 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17441 fp=#0x10000003692' 2024-08-31T04:30:56.418 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17473 fp=#0x100000035b8' 2024-08-31T04:30:56.418 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17505 fp=#0x50000001267' 2024-08-31T04:30:56.419 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17601 fp=#0x50000001246' 2024-08-31T04:30:56.419 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17665 fp=#0x10000002353' 2024-08-31T04:30:56.420 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17793 fp=#0x1000000227a' 2024-08-31T04:30:56.421 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17825 fp=#0x1000000232d' 2024-08-31T04:30:56.422 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17921 fp=#0x5000000162a' 2024-08-31T04:30:56.423 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18081 fp=#0x50000001a27' 2024-08-31T04:30:56.423 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18113 fp=#0x500000008fb' 2024-08-31T04:30:56.424 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18209 fp=#0x50000001a66' 2024-08-31T04:30:56.424 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18241 fp=#0x5000000092c' 2024-08-31T04:30:56.425 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18305 fp=#0x50000001b2a' 2024-08-31T04:30:56.425 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18337 fp=#0x50000000e0e' 2024-08-31T04:30:56.425 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18369 fp=#0x50000000de4' 2024-08-31T04:30:56.426 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18433 fp=#0x50000000e57' 2024-08-31T04:30:56.426 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18465 fp=#0x50000000e9b' 2024-08-31T04:30:56.426 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18497 fp=#0x50000000ed9' 2024-08-31T04:30:56.427 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18529 fp=#0x50000000ab5' 2024-08-31T04:30:56.427 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18561 fp=#0x50000000ee6' 2024-08-31T04:30:56.427 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18593 fp=#0x50000000ac0' 2024-08-31T04:30:56.427 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18625 fp=#0x50000000aa9' 2024-08-31T04:30:56.428 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18657 fp=#0x50000000cff' 2024-08-31T04:30:56.428 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18689 fp=#0x50000000d42' 2024-08-31T04:30:56.428 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18721 fp=#0x50000000cfd' 2024-08-31T04:30:56.429 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18753 fp=#0x50000000d22' 2024-08-31T04:30:56.429 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18785 fp=#0x50000000ce9' 2024-08-31T04:30:56.429 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18817 fp=#0x500000011ca' 2024-08-31T04:30:56.430 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18849 fp=#0x50000000ef9' 2024-08-31T04:30:56.430 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18881 fp=#0x500000019bd' 2024-08-31T04:30:56.430 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18913 fp=#0x500000019c1' 2024-08-31T04:30:56.430 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18945 fp=#0x50000000db3' 2024-08-31T04:30:56.431 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18977 fp=#0x50000000f2a' 2024-08-31T04:30:56.431 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19009 fp=#0x50000000efc' 2024-08-31T04:30:56.432 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19073 fp=#0x500000017e9' 2024-08-31T04:30:56.432 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19169 fp=#0x50000001819' 2024-08-31T04:30:56.433 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19201 fp=#0x500000017c4' 2024-08-31T04:30:56.434 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19329 fp=#0x50000001c64' 2024-08-31T04:30:56.434 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19361 fp=#0x50000001c60' 2024-08-31T04:30:56.434 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19393 fp=#0x500000017d7' 2024-08-31T04:30:56.434 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19425 fp=#0x50000001c53' 2024-08-31T04:30:56.435 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19457 fp=#0x5000000192e' 2024-08-31T04:30:56.435 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19489 fp=#0x50000001938' 2024-08-31T04:30:56.435 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19521 fp=#0x5000000193b' 2024-08-31T04:30:56.436 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19553 fp=#0x50000001a03' 2024-08-31T04:30:56.436 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19585 fp=#0x5000000191c' 2024-08-31T04:30:56.437 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19681 fp=#0x10000003e1f' 2024-08-31T04:30:56.437 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19745 fp=#0x10000003e9c' 2024-08-31T04:30:56.438 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19777 fp=#0x5000000098c' 2024-08-31T04:30:56.438 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19809 fp=#0x5000000095f' 2024-08-31T04:30:56.438 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19841 fp=#0x50000001151' 2024-08-31T04:30:56.439 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19873 fp=#0x5000000112b' 2024-08-31T04:30:56.439 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19905 fp=#0x50000001150' 2024-08-31T04:30:56.439 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19937 fp=#0x50000000f88' 2024-08-31T04:30:56.439 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19969 fp=#0x50000001c8c' 2024-08-31T04:30:56.440 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20001 fp=#0x50000000f90' 2024-08-31T04:30:56.440 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20033 fp=#0x50000000f73' 2024-08-31T04:30:56.440 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20065 fp=#0x50000001c8d' 2024-08-31T04:30:56.441 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20097 fp=#0x50000001cc4' 2024-08-31T04:30:56.441 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20129 fp=#0x500000010d4' 2024-08-31T04:30:56.441 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20161 fp=#0x500000010a7' 2024-08-31T04:30:56.442 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20193 fp=#0x50000001040' 2024-08-31T04:30:56.442 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20225 fp=#0x5000000104a' 2024-08-31T04:30:56.442 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20257 fp=#0x50000001c7b' 2024-08-31T04:30:56.443 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20289 fp=#0x5000000119a' 2024-08-31T04:30:56.443 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20321 fp=#0x1000000101d' 2024-08-31T04:30:56.443 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20353 fp=#0x10000000e14' 2024-08-31T04:30:56.444 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20385 fp=#0x10000000e32' 2024-08-31T04:30:56.444 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20417 fp=#0x200000002d9' 2024-08-31T04:30:56.444 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20449 fp=#0x200000003ad' 2024-08-31T04:30:56.444 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20481 fp=#0x100000032fe' 2024-08-31T04:30:56.445 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20513 fp=#0x500000018dc' 2024-08-31T04:30:56.445 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20545 fp=#0x100000032df' 2024-08-31T04:30:56.445 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20577 fp=#0x10000003198' 2024-08-31T04:30:56.446 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20609 fp=#0x10000003290' 2024-08-31T04:30:56.446 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20673 fp=#0x500000018da' 2024-08-31T04:30:56.447 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20705 fp=#0x100000031cb' 2024-08-31T04:30:56.447 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20737 fp=#0x20000000345' 2024-08-31T04:30:56.447 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20769 fp=#0x20000000358' 2024-08-31T04:30:56.448 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20801 fp=#0x10000002ad1' 2024-08-31T04:30:56.448 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20833 fp=#0x10000002b95' 2024-08-31T04:30:56.448 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20865 fp=#0x20000001199' 2024-08-31T04:30:56.448 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20897 fp=#0x10000002aeb' 2024-08-31T04:30:56.449 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20929 fp=#0x20000000332' 2024-08-31T04:30:56.449 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20961 fp=#0x10000002ac4' 2024-08-31T04:30:56.449 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20993 fp=#0x10000001a4c' 2024-08-31T04:30:56.450 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:21025 fp=#0x10000001bea' 2024-08-31T04:30:56.450 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:21057 fp=#0x10000001b2a' 2024-08-31T04:30:56.450 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:21089 fp=#0x10000001b8e' 2024-08-31T04:30:56.451 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:21121 fp=#0x50000001c22' 2024-08-31T04:30:56.451 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:21153 fp=#0x10000001f2b' 2024-08-31T04:30:56.451 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:21185 fp=#0x30000000676' 2024-08-31T04:30:56.451 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:21217 fp=#0x50000001ba6' 2024-08-31T04:30:56.452 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:21249 fp=#0x10000001ecb' 2024-08-31T04:30:56.452 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:21281 fp=#0x30000000254' 2024-08-31T04:30:56.452 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:21313 fp=#0x10000001e86' 2024-08-31T04:30:56.453 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:10019 fp=#0x1' 2024-08-31T04:30:56.454 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:10211 fp=#0x5000000155f' 2024-08-31T04:30:56.454 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:10243 fp=#0x30000001a41' 2024-08-31T04:30:56.474 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13059 fp=#0x30000002b28' 2024-08-31T04:30:56.475 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13155 fp=#0x500000018b0' 2024-08-31T04:30:56.475 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13219 fp=#0x400000015ed' 2024-08-31T04:30:56.476 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13283 fp=#0x30000001af6' 2024-08-31T04:30:56.476 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13315 fp=#0x30000002b66' 2024-08-31T04:30:56.476 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13347 fp=#0x30000002b99' 2024-08-31T04:30:56.477 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13379 fp=#0x30000002b5c' 2024-08-31T04:30:56.477 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13411 fp=#0x30000001a5b' 2024-08-31T04:30:56.477 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13443 fp=#0x30000002751' 2024-08-31T04:30:56.477 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13475 fp=#0x3000000277b' 2024-08-31T04:30:56.481 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13923 fp=#0x50000000953' 2024-08-31T04:30:56.482 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14082 fp=#0x50000000ccb' 2024-08-31T04:30:56.482 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14114 fp=#0x50000000cb1' 2024-08-31T04:30:56.483 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14146 fp=#0x50000000c35' 2024-08-31T04:30:56.483 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14210 fp=#0x50000000c69' 2024-08-31T04:30:56.483 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14242 fp=#0x50000000c9b' 2024-08-31T04:30:56.484 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14338 fp=#0x10000003b13' 2024-08-31T04:30:56.485 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14402 fp=#0x50000000b6d' 2024-08-31T04:30:56.485 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14434 fp=#0x50000000bcf' 2024-08-31T04:30:56.485 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14466 fp=#0x50000000b71' 2024-08-31T04:30:56.485 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14498 fp=#0x50000000b94' 2024-08-31T04:30:56.486 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14530 fp=#0x50000000bf5' 2024-08-31T04:30:56.486 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14562 fp=#0x50000000bf3' 2024-08-31T04:30:56.489 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14594 fp=#0x50000001b14' 2024-08-31T04:30:56.489 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14626 fp=#0x50000001b27' 2024-08-31T04:30:56.489 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14658 fp=#0x50000001b24' 2024-08-31T04:30:56.490 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14690 fp=#0x50000001b06' 2024-08-31T04:30:56.490 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14722 fp=#0x5000000146f' 2024-08-31T04:30:56.490 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14754 fp=#0x500000014a9' 2024-08-31T04:30:56.491 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14786 fp=#0x50000001490' 2024-08-31T04:30:56.491 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14818 fp=#0x500000014ce' 2024-08-31T04:30:56.491 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14850 fp=#0x50000000ea8' 2024-08-31T04:30:56.491 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14882 fp=#0x50000000e1d' 2024-08-31T04:30:56.492 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14914 fp=#0x50000001d76' 2024-08-31T04:30:56.492 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14946 fp=#0x50000000e2f' 2024-08-31T04:30:56.492 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14978 fp=#0x50000000e50' 2024-08-31T04:30:56.494 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15170 fp=#0x50000001011' 2024-08-31T04:30:56.494 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15234 fp=#0x50000001000' 2024-08-31T04:30:56.494 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15266 fp=#0x50000001a89' 2024-08-31T04:30:56.495 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15298 fp=#0x500000014fc' 2024-08-31T04:30:56.495 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15330 fp=#0x50000001554' 2024-08-31T04:30:56.495 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15362 fp=#0x50000001542' 2024-08-31T04:30:56.496 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15394 fp=#0x5000000110c' 2024-08-31T04:30:56.496 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15426 fp=#0x500000010e3' 2024-08-31T04:30:56.496 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15458 fp=#0x50000001109' 2024-08-31T04:30:56.499 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15810 fp=#0x50000001bf5' 2024-08-31T04:30:56.499 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15874 fp=#0x50000001be8' 2024-08-31T04:30:56.500 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15906 fp=#0x50000001718' 2024-08-31T04:30:56.500 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15938 fp=#0x500000016fd' 2024-08-31T04:30:56.504 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16482 fp=#0x50000000a92' 2024-08-31T04:30:56.504 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16546 fp=#0x500000009f0' 2024-08-31T04:30:56.505 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16578 fp=#0x50000001b9b' 2024-08-31T04:30:56.505 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16610 fp=#0x5000000174a' 2024-08-31T04:30:56.505 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16674 fp=#0x50000001ac1' 2024-08-31T04:30:56.506 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16706 fp=#0x50000001a6c' 2024-08-31T04:30:56.506 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16738 fp=#0x50000001a7e' 2024-08-31T04:30:56.506 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16770 fp=#0x50000001a9b' 2024-08-31T04:30:56.507 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16802 fp=#0x50000001d27' 2024-08-31T04:30:56.507 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16834 fp=#0x50000001bb6' 2024-08-31T04:30:56.507 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16866 fp=#0x50000000b3b' 2024-08-31T04:30:56.507 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16898 fp=#0x50000000a47' 2024-08-31T04:30:56.508 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16930 fp=#0x50000000a7b' 2024-08-31T04:30:56.508 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16962 fp=#0x5000000169e' 2024-08-31T04:30:56.508 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16994 fp=#0x500000015f8' 2024-08-31T04:30:56.509 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17026 fp=#0x500000015f7' 2024-08-31T04:30:56.509 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17058 fp=#0x500000015b1' 2024-08-31T04:30:56.509 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17090 fp=#0x50000001627' 2024-08-31T04:30:56.510 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17122 fp=#0x10000003ef6' 2024-08-31T04:30:56.510 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17250 fp=#0x500000015a9' 2024-08-31T04:30:56.511 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17282 fp=#0x50000001602' 2024-08-31T04:30:56.511 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17314 fp=#0x5000000156f' 2024-08-31T04:30:56.511 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17346 fp=#0x10000003629' 2024-08-31T04:30:56.512 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17378 fp=#0x10000003762' 2024-08-31T04:30:56.512 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17410 fp=#0x10000003614' 2024-08-31T04:30:56.512 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17442 fp=#0x10000003682' 2024-08-31T04:30:56.513 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17474 fp=#0x100000035d6' 2024-08-31T04:30:56.513 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17506 fp=#0x50000001234' 2024-08-31T04:30:56.513 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17538 fp=#0x500000012d8' 2024-08-31T04:30:56.514 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17570 fp=#0x50000001268' 2024-08-31T04:30:56.514 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17602 fp=#0x5000000123b' 2024-08-31T04:30:56.514 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17634 fp=#0x500000012d6' 2024-08-31T04:30:56.516 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17890 fp=#0x50000001676' 2024-08-31T04:30:56.516 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17922 fp=#0x50000001694' 2024-08-31T04:30:56.517 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17986 fp=#0x5000000166b' 2024-08-31T04:30:56.517 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18050 fp=#0x500000008e1' 2024-08-31T04:30:56.518 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18082 fp=#0x50000001a61' 2024-08-31T04:30:56.518 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18114 fp=#0x50000001aa1' 2024-08-31T04:30:56.518 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18178 fp=#0x5000000092d' 2024-08-31T04:30:56.519 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18210 fp=#0x50000001a5d' 2024-08-31T04:30:56.519 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18242 fp=#0x50000001a97' 2024-08-31T04:30:56.520 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18370 fp=#0x50000000e9f' 2024-08-31T04:30:56.521 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18434 fp=#0x50000000e68' 2024-08-31T04:30:56.521 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18466 fp=#0x50000000e40' 2024-08-31T04:30:56.521 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18498 fp=#0x50000000ec8' 2024-08-31T04:30:56.521 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18530 fp=#0x10000000449' 2024-08-31T04:30:56.522 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18562 fp=#0x50000000ede' 2024-08-31T04:30:56.522 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18594 fp=#0x100000003bf' 2024-08-31T04:30:56.522 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18626 fp=#0x50000000ecd' 2024-08-31T04:30:56.523 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18658 fp=#0x50000000d17' 2024-08-31T04:30:56.523 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18690 fp=#0x50000000d2b' 2024-08-31T04:30:56.523 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18722 fp=#0x50000000d16' 2024-08-31T04:30:56.524 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18754 fp=#0x50000000cfc' 2024-08-31T04:30:56.524 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18786 fp=#0x50000000d0b' 2024-08-31T04:30:56.524 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18818 fp=#0x500000011dd' 2024-08-31T04:30:56.524 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18850 fp=#0x50000000e08' 2024-08-31T04:30:56.525 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18882 fp=#0x50000000d9e' 2024-08-31T04:30:56.525 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18914 fp=#0x500000019e2' 2024-08-31T04:30:56.525 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18946 fp=#0x500000019ae' 2024-08-31T04:30:56.526 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18978 fp=#0x50000000da5' 2024-08-31T04:30:56.526 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19010 fp=#0x50000000d94' 2024-08-31T04:30:56.527 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19074 fp=#0x500000017ba' 2024-08-31T04:30:56.527 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19106 fp=#0x50000001431' 2024-08-31T04:30:56.529 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19330 fp=#0x50000001c5a' 2024-08-31T04:30:56.529 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19362 fp=#0x50000001c5b' 2024-08-31T04:30:56.529 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19394 fp=#0x50000001c68' 2024-08-31T04:30:56.530 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19426 fp=#0x500000017f2' 2024-08-31T04:30:56.530 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19458 fp=#0x50000001951' 2024-08-31T04:30:56.530 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19490 fp=#0x50000001a00' 2024-08-31T04:30:56.531 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19522 fp=#0x5000000199b' 2024-08-31T04:30:56.531 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19554 fp=#0x50000001985' 2024-08-31T04:30:56.531 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19586 fp=#0x50000001956' 2024-08-31T04:30:56.532 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19650 fp=#0x10000003ebc' 2024-08-31T04:30:56.533 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19778 fp=#0x50000000992' 2024-08-31T04:30:56.533 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19810 fp=#0x5000000116e' 2024-08-31T04:30:56.533 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19842 fp=#0x50000001154' 2024-08-31T04:30:56.534 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19874 fp=#0x50000001130' 2024-08-31T04:30:56.534 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19906 fp=#0x5000000113a' 2024-08-31T04:30:56.534 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19938 fp=#0x50000000f84' 2024-08-31T04:30:56.535 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19970 fp=#0x50000000fa9' 2024-08-31T04:30:56.535 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20002 fp=#0x50000001c90' 2024-08-31T04:30:56.535 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20034 fp=#0x50000001cb0' 2024-08-31T04:30:56.536 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20066 fp=#0x50000000f89' 2024-08-31T04:30:56.536 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20098 fp=#0x50000001cac' 2024-08-31T04:30:56.536 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20130 fp=#0x5000000102e' 2024-08-31T04:30:56.537 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20162 fp=#0x50000001037' 2024-08-31T04:30:56.537 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20194 fp=#0x500000016b2' 2024-08-31T04:30:56.537 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20226 fp=#0x500000010ab' 2024-08-31T04:30:56.538 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20258 fp=#0x500000011af' 2024-08-31T04:30:56.538 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20290 fp=#0x50000001c88' 2024-08-31T04:30:56.538 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20322 fp=#0x10000001066' 2024-08-31T04:30:56.539 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20354 fp=#0x200000002d3' 2024-08-31T04:30:56.539 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20386 fp=#0x200000003e0' 2024-08-31T04:30:56.539 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20418 fp=#0x10000000e43' 2024-08-31T04:30:56.540 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20450 fp=#0x200000002e7' 2024-08-31T04:30:56.540 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20482 fp=#0x500000018eb' 2024-08-31T04:30:56.540 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20514 fp=#0x20000000364' 2024-08-31T04:30:56.541 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20546 fp=#0x10000003205' 2024-08-31T04:30:56.541 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20578 fp=#0x5000000193e' 2024-08-31T04:30:56.541 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20610 fp=#0x500000018d2' 2024-08-31T04:30:56.542 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20642 fp=#0x500000018e5' 2024-08-31T04:30:56.542 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20674 fp=#0x500000018e7' 2024-08-31T04:30:56.542 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20706 fp=#0x100000031fd' 2024-08-31T04:30:56.543 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20738 fp=#0x10000002af1' 2024-08-31T04:30:56.543 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20770 fp=#0x10000002ad6' 2024-08-31T04:30:56.543 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20802 fp=#0x10000002ba7' 2024-08-31T04:30:56.543 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20834 fp=#0x10000002ae5' 2024-08-31T04:30:56.544 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20866 fp=#0x10000002abe' 2024-08-31T04:30:56.544 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20898 fp=#0x10000002b23' 2024-08-31T04:30:56.544 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20930 fp=#0x20000000497' 2024-08-31T04:30:56.545 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20962 fp=#0x2000000125f' 2024-08-31T04:30:56.545 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20994 fp=#0x3000000022f' 2024-08-31T04:30:56.545 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:21026 fp=#0x10000001b16' 2024-08-31T04:30:56.546 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:21058 fp=#0x10000001ace' 2024-08-31T04:30:56.546 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:21090 fp=#0x10000001b24' 2024-08-31T04:30:56.546 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:21122 fp=#0x10000001e96' 2024-08-31T04:30:56.547 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:21154 fp=#0x10000001f07' 2024-08-31T04:30:56.547 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:21186 fp=#0x10000001ec7' 2024-08-31T04:30:56.547 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:21218 fp=#0x50000001bad' 2024-08-31T04:30:56.548 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:21250 fp=#0x10000001edd' 2024-08-31T04:30:56.548 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:21282 fp=#0x10000001f13' 2024-08-31T04:30:56.548 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:21314 fp=#0x10000001efb' 2024-08-31T04:30:56.548 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:10020 fp=#0x10000000000' 2024-08-31T04:30:56.550 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:10212 fp=#0x1000000359d' 2024-08-31T04:30:56.569 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13060 fp=#0x30000002b44' 2024-08-31T04:30:56.570 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13220 fp=#0x50000001740' 2024-08-31T04:30:56.571 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13284 fp=#0x30000001a45' 2024-08-31T04:30:56.571 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13316 fp=#0x30000001a5c' 2024-08-31T04:30:56.572 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13348 fp=#0x30000002b91' 2024-08-31T04:30:56.572 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13380 fp=#0x30000001a74' 2024-08-31T04:30:56.572 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13412 fp=#0x30000001ad8' 2024-08-31T04:30:56.573 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13444 fp=#0x3000000278a' 2024-08-31T04:30:56.573 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13476 fp=#0x3000000275a' 2024-08-31T04:30:56.573 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13508 fp=#0x40000001049' 2024-08-31T04:30:56.574 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13636 fp=#0x30000002295' 2024-08-31T04:30:56.574 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13668 fp=#0x30000002289' 2024-08-31T04:30:56.575 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13732 fp=#0x30000002859' 2024-08-31T04:30:56.576 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13924 fp=#0x50000000a94' 2024-08-31T04:30:56.577 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:13988 fp=#0x50000000951' 2024-08-31T04:30:56.578 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14115 fp=#0x50000000c49' 2024-08-31T04:30:56.578 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14147 fp=#0x50000000c7e' 2024-08-31T04:30:56.578 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14179 fp=#0x50000000c3a' 2024-08-31T04:30:56.579 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14211 fp=#0x50000000ca7' 2024-08-31T04:30:56.580 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14371 fp=#0x10000003afc' 2024-08-31T04:30:56.580 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14403 fp=#0x50000000b84' 2024-08-31T04:30:56.581 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14435 fp=#0x50000000bec' 2024-08-31T04:30:56.581 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14467 fp=#0x50000000b87' 2024-08-31T04:30:56.581 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14499 fp=#0x50000000b65' 2024-08-31T04:30:56.582 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14531 fp=#0x50000000b6e' 2024-08-31T04:30:56.582 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14563 fp=#0x50000000b82' 2024-08-31T04:30:56.582 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14595 fp=#0x50000001b3b' 2024-08-31T04:30:56.582 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14627 fp=#0x50000001b32' 2024-08-31T04:30:56.583 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14659 fp=#0x50000001b23' 2024-08-31T04:30:56.583 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14691 fp=#0x50000001b2e' 2024-08-31T04:30:56.583 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14723 fp=#0x50000001498' 2024-08-31T04:30:56.584 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14755 fp=#0x500000014ba' 2024-08-31T04:30:56.584 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14787 fp=#0x5000000145e' 2024-08-31T04:30:56.584 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14819 fp=#0x500000014cf' 2024-08-31T04:30:56.585 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14851 fp=#0x50000001d70' 2024-08-31T04:30:56.585 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14883 fp=#0x50000000e07' 2024-08-31T04:30:56.585 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14915 fp=#0x50000000ea4' 2024-08-31T04:30:56.585 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14947 fp=#0x50000000e92' 2024-08-31T04:30:56.586 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:14979 fp=#0x50000000e3d' 2024-08-31T04:30:56.587 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15171 fp=#0x5000000101a' 2024-08-31T04:30:56.587 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15203 fp=#0x50000000fdf' 2024-08-31T04:30:56.588 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15235 fp=#0x50000000ffa' 2024-08-31T04:30:56.588 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15267 fp=#0x50000001acc' 2024-08-31T04:30:56.588 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15299 fp=#0x500000014f9' 2024-08-31T04:30:56.589 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15331 fp=#0x50000001cf4' 2024-08-31T04:30:56.589 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15363 fp=#0x5000000153e' 2024-08-31T04:30:56.589 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15395 fp=#0x500000010c3' 2024-08-31T04:30:56.590 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15427 fp=#0x500000010d2' 2024-08-31T04:30:56.590 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15459 fp=#0x500000010e9' 2024-08-31T04:30:56.593 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15875 fp=#0x50000001bf1' 2024-08-31T04:30:56.593 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15907 fp=#0x500000016eb' 2024-08-31T04:30:56.593 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:15939 fp=#0x50000001722' 2024-08-31T04:30:56.598 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16547 fp=#0x500000009e8' 2024-08-31T04:30:56.598 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16579 fp=#0x50000001b9a' 2024-08-31T04:30:56.598 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16611 fp=#0x5000000175d' 2024-08-31T04:30:56.599 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16675 fp=#0x50000001ac4' 2024-08-31T04:30:56.599 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16771 fp=#0x50000001a67' 2024-08-31T04:30:56.600 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16803 fp=#0x50000001d17' 2024-08-31T04:30:56.600 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16835 fp=#0x50000001bbc' 2024-08-31T04:30:56.600 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16867 fp=#0x50000000b3f' 2024-08-31T04:30:56.600 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16899 fp=#0x50000000a84' 2024-08-31T04:30:56.601 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16931 fp=#0x50000000a54' 2024-08-31T04:30:56.601 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16963 fp=#0x500000015e8' 2024-08-31T04:30:56.601 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:16995 fp=#0x50000001643' 2024-08-31T04:30:56.602 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17027 fp=#0x50000001629' 2024-08-31T04:30:56.602 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17059 fp=#0x50000001682' 2024-08-31T04:30:56.602 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17091 fp=#0x500000015e2' 2024-08-31T04:30:56.603 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17187 fp=#0x10000003ef3' 2024-08-31T04:30:56.603 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17251 fp=#0x500000015e1' 2024-08-31T04:30:56.604 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17283 fp=#0x50000001590' 2024-08-31T04:30:56.604 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17315 fp=#0x500000015c7' 2024-08-31T04:30:56.605 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17347 fp=#0x100000035e5' 2024-08-31T04:30:56.605 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17379 fp=#0x100000035a3' 2024-08-31T04:30:56.605 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17411 fp=#0x100000036b3' 2024-08-31T04:30:56.605 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17443 fp=#0x1000000360e' 2024-08-31T04:30:56.606 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17475 fp=#0x10000003641' 2024-08-31T04:30:56.606 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17507 fp=#0x500000012e6' 2024-08-31T04:30:56.606 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17539 fp=#0x5000000124b' 2024-08-31T04:30:56.607 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17571 fp=#0x5000000127b' 2024-08-31T04:30:56.607 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17603 fp=#0x500000012e5' 2024-08-31T04:30:56.607 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17635 fp=#0x50000001244' 2024-08-31T04:30:56.607 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17667 fp=#0x10000002272' 2024-08-31T04:30:56.608 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17699 fp=#0x10000002287' 2024-08-31T04:30:56.608 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17795 fp=#0x10000002336' 2024-08-31T04:30:56.609 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17891 fp=#0x50000001675' 2024-08-31T04:30:56.610 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17923 fp=#0x50000001684' 2024-08-31T04:30:56.610 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:17987 fp=#0x500000016a2' 2024-08-31T04:30:56.610 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18019 fp=#0x50000001a23' 2024-08-31T04:30:56.611 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18051 fp=#0x50000000924' 2024-08-31T04:30:56.611 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18115 fp=#0x50000001a8c' 2024-08-31T04:30:56.612 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18147 fp=#0x50000000c15' 2024-08-31T04:30:56.612 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18179 fp=#0x50000000904' 2024-08-31T04:30:56.612 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18211 fp=#0x50000001a2b' 2024-08-31T04:30:56.613 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18403 fp=#0x50000000e26' 2024-08-31T04:30:56.614 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18435 fp=#0x50000000e59' 2024-08-31T04:30:56.614 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18467 fp=#0x50000000dd4' 2024-08-31T04:30:56.614 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18499 fp=#0x50000000ab4' 2024-08-31T04:30:56.615 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18531 fp=#0x10000000413' 2024-08-31T04:30:56.615 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18595 fp=#0x50000000aae' 2024-08-31T04:30:56.615 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18627 fp=#0x50000000abc' 2024-08-31T04:30:56.616 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18659 fp=#0x50000000d77' 2024-08-31T04:30:56.616 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18691 fp=#0x50000000d51' 2024-08-31T04:30:56.616 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18723 fp=#0x50000000cfe' 2024-08-31T04:30:56.617 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18755 fp=#0x50000000d18' 2024-08-31T04:30:56.617 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18787 fp=#0x50000000d0e' 2024-08-31T04:30:56.617 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18819 fp=#0x500000011df' 2024-08-31T04:30:56.618 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18851 fp=#0x50000000db6' 2024-08-31T04:30:56.618 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18883 fp=#0x50000000de6' 2024-08-31T04:30:56.618 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18915 fp=#0x5000000144b' 2024-08-31T04:30:56.618 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18947 fp=#0x500000019b7' 2024-08-31T04:30:56.619 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:18979 fp=#0x50000000f2c' 2024-08-31T04:30:56.619 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19011 fp=#0x500000019d0' 2024-08-31T04:30:56.619 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19043 fp=#0x50000001838' 2024-08-31T04:30:56.620 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19107 fp=#0x5000000180e' 2024-08-31T04:30:56.620 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19139 fp=#0x50000001821' 2024-08-31T04:30:56.621 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19171 fp=#0x50000001832' 2024-08-31T04:30:56.621 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19203 fp=#0x500000017e8' 2024-08-31T04:30:56.622 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19299 fp=#0x50000001826' 2024-08-31T04:30:56.622 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19331 fp=#0x50000001c47' 2024-08-31T04:30:56.622 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19363 fp=#0x50000001c58' 2024-08-31T04:30:56.623 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19395 fp=#0x5000000181f' 2024-08-31T04:30:56.623 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19427 fp=#0x500000017ee' 2024-08-31T04:30:56.623 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19459 fp=#0x5000000194c' 2024-08-31T04:30:56.623 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19491 fp=#0x50000001988' 2024-08-31T04:30:56.624 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19523 fp=#0x500000019a6' 2024-08-31T04:30:56.624 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19555 fp=#0x5000000197f' 2024-08-31T04:30:56.624 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19587 fp=#0x500000019fe' 2024-08-31T04:30:56.625 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19683 fp=#0x50000001440' 2024-08-31T04:30:56.625 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19715 fp=#0x10000003e40' 2024-08-31T04:30:56.626 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19779 fp=#0x5000000095c' 2024-08-31T04:30:56.626 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19811 fp=#0x50000001169' 2024-08-31T04:30:56.627 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19843 fp=#0x50000001116' 2024-08-31T04:30:56.627 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19875 fp=#0x50000001153' 2024-08-31T04:30:56.627 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19907 fp=#0x50000001167' 2024-08-31T04:30:56.628 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19939 fp=#0x50000001c8f' 2024-08-31T04:30:56.628 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:19971 fp=#0x50000001cbe' 2024-08-31T04:30:56.628 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20003 fp=#0x50000000fba' 2024-08-31T04:30:56.628 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20035 fp=#0x50000000f9b' 2024-08-31T04:30:56.629 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20067 fp=#0x50000001c95' 2024-08-31T04:30:56.629 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20099 fp=#0x50000000f9a' 2024-08-31T04:30:56.629 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20131 fp=#0x50000001031' 2024-08-31T04:30:56.630 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20163 fp=#0x500000012ca' 2024-08-31T04:30:56.630 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20195 fp=#0x500000010b7' 2024-08-31T04:30:56.630 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20227 fp=#0x50000001026' 2024-08-31T04:30:56.630 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20259 fp=#0x500000011dc' 2024-08-31T04:30:56.631 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20291 fp=#0x50000001c79' 2024-08-31T04:30:56.631 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20323 fp=#0x200000003d2' 2024-08-31T04:30:56.631 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20355 fp=#0x200000002e1' 2024-08-31T04:30:56.632 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20387 fp=#0x200000002f9' 2024-08-31T04:30:56.632 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20419 fp=#0x10000000fd3' 2024-08-31T04:30:56.632 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20451 fp=#0x200000002f0' 2024-08-31T04:30:56.633 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20515 fp=#0x500000018c1' 2024-08-31T04:30:56.633 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20547 fp=#0x500000018f6' 2024-08-31T04:30:56.633 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20579 fp=#0x500000019d8' 2024-08-31T04:30:56.634 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20611 fp=#0x5000000199d' 2024-08-31T04:30:56.634 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20643 fp=#0x10000003248' 2024-08-31T04:30:56.634 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20707 fp=#0x10000003264' 2024-08-31T04:30:56.635 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20739 fp=#0x2000000120c' 2024-08-31T04:30:56.635 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20771 fp=#0x20000001193' 2024-08-31T04:30:56.635 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20803 fp=#0x10000002ac5' 2024-08-31T04:30:56.636 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20835 fp=#0x200000011b7' 2024-08-31T04:30:56.636 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20867 fp=#0x10000002ac3' 2024-08-31T04:30:56.636 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20899 fp=#0x2000000034a' 2024-08-31T04:30:56.637 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20931 fp=#0x10000002b31' 2024-08-31T04:30:56.637 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20963 fp=#0x10000002b73' 2024-08-31T04:30:56.637 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:20995 fp=#0x10000001a92' 2024-08-31T04:30:56.638 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:21059 fp=#0x10000001bd5' 2024-08-31T04:30:56.638 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:21091 fp=#0x10000001e3c' 2024-08-31T04:30:56.638 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:21123 fp=#0x10000001e5a' 2024-08-31T04:30:56.639 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:21155 fp=#0x10000001e6f' 2024-08-31T04:30:56.639 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:21187 fp=#0x10000001e40' 2024-08-31T04:30:56.639 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:21219 fp=#0x3000000068a' 2024-08-31T04:30:56.640 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:21251 fp=#0x10000001e94' 2024-08-31T04:30:56.640 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:21283 fp=#0x30000000670' 2024-08-31T04:30:56.640 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 4 (c) for 9d491f02-1: 'internal op quiesce_inode:mds.4:21315 fp=#0x10000001edb' 2024-08-31T04:30:56.642 INFO:tasks.quiescer.fs.[cephfs]:Pulled 11302 ops from rank 4 (c) into home/teuthworker/archive/mchangir-2024-08-30_08:30:37-fs-wip-mchangir-testing-20240828.085847-main-debug-distro-default-smithi/7881274/ops-9d491f02-1-mds.c.json 2024-08-31T04:30:56.642 DEBUG:teuthology.orchestra.run.smithi177:> sudo rm -- /var/run/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/ops-9d491f02-1-mds.c.json 2024-08-31T04:30:56.644 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:30:53 smithi133 ceph-mon[22177]: pgmap v608: 97 pgs: 97 active+clean; 1.5 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 261 KiB/s rd, 434 KiB/s wr, 28 op/s 2024-08-31T04:30:56.644 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:30:55 smithi133 ceph-mon[22177]: pgmap v609: 97 pgs: 97 active+clean; 1.5 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 259 KiB/s rd, 433 KiB/s wr, 24 op/s 2024-08-31T04:30:56.644 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:30:53 smithi050 ceph-mon[17259]: pgmap v608: 97 pgs: 97 active+clean; 1.5 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 261 KiB/s rd, 434 KiB/s wr, 28 op/s 2024-08-31T04:30:56.644 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:30:55 smithi050 ceph-mon[17259]: pgmap v609: 97 pgs: 97 active+clean; 1.5 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 259 KiB/s rd, 433 KiB/s wr, 24 op/s 2024-08-31T04:30:56.644 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:30:53 smithi177 ceph-mon[22025]: pgmap v608: 97 pgs: 97 active+clean; 1.5 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 261 KiB/s rd, 434 KiB/s wr, 28 op/s 2024-08-31T04:30:56.644 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:30:55 smithi177 ceph-mon[22025]: pgmap v609: 97 pgs: 97 active+clean; 1.5 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 259 KiB/s rd, 433 KiB/s wr, 24 op/s 2024-08-31T04:30:56.656 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:55.906+0000 7f6e3b200640 1 -- 172.21.15.50:0/3076264654 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6e3c076e90 msgr2=0x7f6e3c075550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:30:56.656 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:55.906+0000 7f6e3b200640 1 --2- 172.21.15.50:0/3076264654 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6e3c076e90 0x7f6e3c075550 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f6e2c009900 tx=0x7f6e2c02a410 comp rx=0 tx=0).stop 2024-08-31T04:30:56.656 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:55.906+0000 7f6e3b200640 1 -- 172.21.15.50:0/3076264654 shutdown_connections 2024-08-31T04:30:56.656 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:55.906+0000 7f6e3b200640 1 --2- 172.21.15.50:0/3076264654 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6e3c075a90 0x7f6e3c075ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:56.656 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:55.906+0000 7f6e3b200640 1 --2- 172.21.15.50:0/3076264654 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6e3c10fa00 0x7f6e3c111e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:56.656 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:55.906+0000 7f6e3b200640 1 --2- 172.21.15.50:0/3076264654 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6e3c076e90 0x7f6e3c075550 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:56.656 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:55.906+0000 7f6e3b200640 1 -- 172.21.15.50:0/3076264654 >> 172.21.15.50:0/3076264654 conn(0x7f6e3c0febc0 msgr2=0x7f6e3c101070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:30:56.656 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:55.906+0000 7f6e3b200640 1 -- 172.21.15.50:0/3076264654 shutdown_connections 2024-08-31T04:30:56.656 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:55.906+0000 7f6e3b200640 1 -- 172.21.15.50:0/3076264654 wait complete. 2024-08-31T04:30:56.656 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:55.907+0000 7f6e3b200640 1 Processor -- start 2024-08-31T04:30:56.656 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:55.907+0000 7f6e3b200640 1 -- start start 2024-08-31T04:30:56.656 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:55.907+0000 7f6e3b200640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6e3c075a90 0x7f6e3c1a0160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:30:56.657 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:55.907+0000 7f6e3b200640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6e3c076e90 0x7f6e3c1a07d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:30:56.657 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:55.908+0000 7f6e3b200640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6e3c10fa00 0x7f6e3c1a1380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:30:56.657 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:55.908+0000 7f6e3b200640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f6e3c115510 con 0x7f6e3c076e90 2024-08-31T04:30:56.657 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:55.908+0000 7f6e3b200640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f6e3c115390 con 0x7f6e3c10fa00 2024-08-31T04:30:56.657 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:55.908+0000 7f6e3b200640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f6e3c115690 con 0x7f6e3c075a90 2024-08-31T04:30:56.657 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:55.908+0000 7f6e39400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6e3c076e90 0x7f6e3c1a07d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:30:56.657 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:55.908+0000 7f6e39e00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6e3c075a90 0x7f6e3c1a0160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:30:56.657 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:55.908+0000 7f6e39e00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6e3c075a90 0x7f6e3c1a0160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.50:49272/0 (socket says 172.21.15.50:49272) 2024-08-31T04:30:56.657 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:55.908+0000 7f6e39e00640 1 -- 172.21.15.50:0/858656294 learned_addr learned my addr 172.21.15.50:0/858656294 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:30:56.657 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:55.908+0000 7f6e3a800640 1 --2- 172.21.15.50:0/858656294 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6e3c10fa00 0x7f6e3c1a1380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:30:56.657 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:55.908+0000 7f6e39400640 1 -- 172.21.15.50:0/858656294 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6e3c075a90 msgr2=0x7f6e3c1a0160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:30:56.657 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:55.908+0000 7f6e39400640 1 --2- 172.21.15.50:0/858656294 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6e3c075a90 0x7f6e3c1a0160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:56.657 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:55.908+0000 7f6e39400640 1 -- 172.21.15.50:0/858656294 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6e3c10fa00 msgr2=0x7f6e3c1a1380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:30:56.657 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:55.908+0000 7f6e39400640 1 --2- 172.21.15.50:0/858656294 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6e3c10fa00 0x7f6e3c1a1380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:56.657 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:55.908+0000 7f6e39400640 1 -- 172.21.15.50:0/858656294 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e3c1a1ba0 con 0x7f6e3c076e90 2024-08-31T04:30:56.658 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:55.909+0000 7f6e39e00640 1 --2- 172.21.15.50:0/858656294 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6e3c075a90 0x7f6e3c1a0160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:30:56.658 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:55.909+0000 7f6e39400640 1 --2- 172.21.15.50:0/858656294 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6e3c076e90 0x7f6e3c1a07d0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f6e2800e9f0 tx=0x7f6e2800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:30:56.658 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:55.909+0000 7f6e32a00640 1 -- 172.21.15.50:0/858656294 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e2800ccc0 con 0x7f6e3c076e90 2024-08-31T04:30:56.658 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:55.909+0000 7f6e32a00640 1 -- 172.21.15.50:0/858656294 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6e28005020 con 0x7f6e3c076e90 2024-08-31T04:30:56.658 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:55.909+0000 7f6e32a00640 1 -- 172.21.15.50:0/858656294 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e28004a00 con 0x7f6e3c076e90 2024-08-31T04:30:56.658 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:55.909+0000 7f6e3b200640 1 -- 172.21.15.50:0/858656294 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6e3c1a1e90 con 0x7f6e3c076e90 2024-08-31T04:30:56.658 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:55.909+0000 7f6e3b200640 1 -- 172.21.15.50:0/858656294 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6e3c1a8580 con 0x7f6e3c076e90 2024-08-31T04:30:56.658 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:55.913+0000 7f6e32a00640 1 -- 172.21.15.50:0/858656294 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 18) ==== 152577+0+0 (secure 0 0 0) 0x7f6e28004ba0 con 0x7f6e3c076e90 2024-08-31T04:30:56.658 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:55.913+0000 7f6e47a6f740 1 Processor -- start 2024-08-31T04:30:56.658 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:55.913+0000 7f6e47a6f740 1 -- start start 2024-08-31T04:30:56.658 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:55.914+0000 7f6e47a6f740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55cdf9cbe1b0 0x55cdfa063fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:30:56.658 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:55.914+0000 7f6e47a6f740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55cdf9c952f0 0x55cdfa064610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:30:56.658 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:55.914+0000 7f6e47a6f740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cdf9c9d4d0 0x55cdfa065160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:30:56.658 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:55.914+0000 7f6e47a6f740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55cdf9fd6f70 con 0x55cdf9c9d4d0 2024-08-31T04:30:56.659 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:55.914+0000 7f6e47a6f740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x55cdf9fc6500 con 0x55cdf9cbe1b0 2024-08-31T04:30:56.659 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:55.914+0000 7f6e47a6f740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x55cdf9fca4b0 con 0x55cdf9c952f0 2024-08-31T04:30:56.659 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:55.914+0000 7f6e39400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cdf9c9d4d0 0x55cdfa065160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:30:56.659 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:55.914+0000 7f6e39400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cdf9c9d4d0 0x55cdfa065160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:59714/0 (socket says 172.21.15.50:59714) 2024-08-31T04:30:56.659 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:55.914+0000 7f6e39e00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55cdf9c952f0 0x55cdfa064610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:30:56.659 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:55.914+0000 7f6e39400640 1 -- 172.21.15.50:0/4119566351 learned_addr learned my addr 172.21.15.50:0/4119566351 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:30:56.659 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:55.914+0000 7f6e3a800640 1 --2- 172.21.15.50:0/4119566351 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55cdf9cbe1b0 0x55cdfa063fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:30:56.659 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:55.915+0000 7f6e3a800640 1 -- 172.21.15.50:0/4119566351 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55cdf9c952f0 msgr2=0x55cdfa064610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:30:56.659 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:55.915+0000 7f6e3a800640 1 --2- 172.21.15.50:0/4119566351 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55cdf9c952f0 0x55cdfa064610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:56.659 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:55.915+0000 7f6e3a800640 1 -- 172.21.15.50:0/4119566351 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cdf9c9d4d0 msgr2=0x55cdfa065160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:30:56.659 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:55.915+0000 7f6e3a800640 1 --2- 172.21.15.50:0/4119566351 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cdf9c9d4d0 0x55cdfa065160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:56.659 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:55.915+0000 7f6e3a800640 1 -- 172.21.15.50:0/4119566351 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cdf9f80c10 con 0x55cdf9cbe1b0 2024-08-31T04:30:56.659 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:55.915+0000 7f6e32a00640 1 --2- 172.21.15.50:0/858656294 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f6e200b4bb0 0x7f6e200b70c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:30:56.660 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:55.915+0000 7f6e32a00640 1 -- 172.21.15.50:0/858656294 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8219+0+0 (secure 0 0 0) 0x7f6e280e5060 con 0x7f6e3c076e90 2024-08-31T04:30:56.660 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:55.915+0000 7f6e39e00640 1 --2- 172.21.15.50:0/858656294 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f6e200b4bb0 0x7f6e200b70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:30:56.660 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:55.915+0000 7f6e3a800640 1 --2- 172.21.15.50:0/4119566351 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55cdf9cbe1b0 0x55cdfa063fa0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f6e34009f00 tx=0x7f6e34011810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e01622759a0bce75 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:30:56.660 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:55.916+0000 7f6e27000640 1 -- 172.21.15.50:0/4119566351 <== mon.2 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e34004d20 con 0x55cdf9cbe1b0 2024-08-31T04:30:56.660 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:55.916+0000 7f6e27000640 1 -- 172.21.15.50:0/4119566351 <== mon.2 v2:172.21.15.133:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6e34004030 con 0x55cdf9cbe1b0 2024-08-31T04:30:56.660 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:55.916+0000 7f6e27000640 1 -- 172.21.15.50:0/4119566351 <== mon.2 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e34005240 con 0x55cdf9cbe1b0 2024-08-31T04:30:56.660 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:55.916+0000 7f6e47a6f740 1 -- 172.21.15.50:0/4119566351 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55cdf9cbe1b0 msgr2=0x55cdfa063fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:30:56.660 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:55.916+0000 7f6e39e00640 1 --2- 172.21.15.50:0/858656294 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f6e200b4bb0 0x7f6e200b70c0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f6e2c005f70 tx=0x7f6e2c0314a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:30:56.660 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:55.916+0000 7f6e47a6f740 1 --2- 172.21.15.50:0/4119566351 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55cdf9cbe1b0 0x55cdfa063fa0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f6e34009f00 tx=0x7f6e34011810 comp rx=0 tx=0).stop 2024-08-31T04:30:56.660 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:55.917+0000 7f6e47a6f740 1 -- 172.21.15.50:0/4119566351 shutdown_connections 2024-08-31T04:30:56.660 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:55.917+0000 7f6e47a6f740 1 --2- 172.21.15.50:0/4119566351 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55cdf9c952f0 0x55cdfa064610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:56.660 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:55.917+0000 7f6e47a6f740 1 --2- 172.21.15.50:0/4119566351 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cdf9c9d4d0 0x55cdfa065160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:56.660 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:55.917+0000 7f6e47a6f740 1 --2- 172.21.15.50:0/4119566351 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55cdf9cbe1b0 0x55cdfa063fa0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:56.660 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:55.917+0000 7f6e47a6f740 1 -- 172.21.15.50:0/4119566351 >> 172.21.15.50:0/4119566351 conn(0x55cdf9cb2300 msgr2=0x55cdfa05fa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:30:56.661 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:55.917+0000 7f6e47a6f740 1 -- 172.21.15.50:0/4119566351 shutdown_connections 2024-08-31T04:30:56.661 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:55.917+0000 7f6e47a6f740 1 -- 172.21.15.50:0/4119566351 wait complete. 2024-08-31T04:30:56.661 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:55.917+0000 7f6e47a6f740 1 -- start start 2024-08-31T04:30:56.661 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:55.917+0000 7f6e47a6f740 1 Processor -- start 2024-08-31T04:30:56.661 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:55.918+0000 7f6e47a6f740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55cdf9c952f0 0x55cdfa06d5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:30:56.661 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:55.918+0000 7f6e47a6f740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55cdf9c9d4d0 0x55cdfa06dca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:30:56.661 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:55.918+0000 7f6e47a6f740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cdf9cbe1b0 0x55cdfa06e810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:30:56.661 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:55.918+0000 7f6e47a6f740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55cdf9effab0 con 0x55cdf9cbe1b0 2024-08-31T04:30:56.661 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:55.918+0000 7f6e47a6f740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x55cdf9f6d320 con 0x55cdf9c9d4d0 2024-08-31T04:30:56.661 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:55.918+0000 7f6e47a6f740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x55cdfa065c80 con 0x55cdf9c952f0 2024-08-31T04:30:56.661 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:55.918+0000 7f6e47a6f740 10 client.0 _ll_register_callbacks cb 0x55cdf9f736a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:30:56.661 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:55.918+0000 7f6e39e00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55cdf9c952f0 0x55cdfa06d5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:30:56.661 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:55.918+0000 7f6e39e00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55cdf9c952f0 0x55cdfa06d5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.50:49300/0 (socket says 172.21.15.50:49300) 2024-08-31T04:30:56.661 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:55.918+0000 7f6e3a800640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cdf9cbe1b0 0x55cdfa06e810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:30:56.662 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:55.918+0000 7f6e39e00640 1 -- 172.21.15.50:0/4045662660 learned_addr learned my addr 172.21.15.50:0/4045662660 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:30:56.662 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:55.918+0000 7f6e39400640 1 --2- 172.21.15.50:0/4045662660 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55cdf9c9d4d0 0x55cdfa06dca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:30:56.662 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:55.919+0000 7f6e39e00640 1 -- 172.21.15.50:0/4045662660 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55cdf9c9d4d0 msgr2=0x55cdfa06dca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:30:56.662 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:55.919+0000 7f6e39e00640 1 --2- 172.21.15.50:0/4045662660 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55cdf9c9d4d0 0x55cdfa06dca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:56.662 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:55.919+0000 7f6e39e00640 1 -- 172.21.15.50:0/4045662660 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cdf9cbe1b0 msgr2=0x55cdfa06e810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:30:56.662 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:55.919+0000 7f6e39e00640 1 --2- 172.21.15.50:0/4045662660 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cdf9cbe1b0 0x55cdfa06e810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:56.662 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:55.919+0000 7f6e39e00640 1 -- 172.21.15.50:0/4045662660 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cdf9d29790 con 0x55cdf9c952f0 2024-08-31T04:30:56.662 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:55.919+0000 7f6e39e00640 1 --2- 172.21.15.50:0/4045662660 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55cdf9c952f0 0x55cdfa06d5e0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f6e2c006010 tx=0x7f6e2c02a410 comp rx=0 tx=0).ready entity=mon.1 client_cookie=135e6e5aebc4ccd3 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:30:56.662 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:55.919+0000 7f6e1b400640 10 client.0 ms_handle_connect on v2:172.21.15.177:3300/0 2024-08-31T04:30:56.662 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:55.919+0000 7f6e1b400640 1 -- 172.21.15.50:0/4045662660 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e2c035050 con 0x55cdf9c952f0 2024-08-31T04:30:56.662 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:55.919+0000 7f6e1b400640 1 -- 172.21.15.50:0/4045662660 <== mon.1 v2:172.21.15.177:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8219+0+0 (secure 0 0 0) 0x7f6e2c0315a0 con 0x55cdf9c952f0 2024-08-31T04:30:56.662 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:55.919+0000 7f6e47a6f740 1 -- 172.21.15.50:0/4045662660 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6e34004030 con 0x55cdf9c952f0 2024-08-31T04:30:56.662 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:55.920+0000 7f6e1b400640 1 -- 172.21.15.50:0/4045662660 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7f6e2c003e90 con 0x55cdf9c952f0 2024-08-31T04:30:56.662 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:55.920+0000 7f6e47a6f740 10 client.26155 fetch_fsmap learned FSMap version 42 2024-08-31T04:30:56.662 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:55.920+0000 7f6e47a6f740 1 -- 172.21.15.50:0/4045662660 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x55cdf9da2620 con 0x55cdf9c952f0 2024-08-31T04:30:56.663 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:55.921+0000 7f6e1b400640 1 -- 172.21.15.50:0/4045662660 <== mon.1 v2:172.21.15.177:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6e34004030 con 0x55cdf9c952f0 2024-08-31T04:30:56.663 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:55.921+0000 7f6e1b400640 1 -- 172.21.15.50:0/4045662660 <== mon.1 v2:172.21.15.177:3300/0 5 ==== fsmap(e 42) ==== 8398+0+0 (secure 0 0 0) 0x7f6e2c053920 con 0x55cdf9c952f0 2024-08-31T04:30:56.663 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:55.921+0000 7f6e47a6f740 10 client.26155 fetch_fsmap finished waiting for FSMap version 42 2024-08-31T04:30:56.663 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:55.921+0000 7f6e47a6f740 10 client.26155 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T04:30:56.663 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:55.921+0000 7f6e47a6f740 20 client.26155 populate_metadata read hostname 'smithi050' 2024-08-31T04:30:56.663 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:55.921+0000 7f6e47a6f740 1 --2- 172.21.15.50:0/4045662660 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x55cdf9c7cd80 0x55cdfa07add0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:30:56.663 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:55.921+0000 7f6e47a6f740 4 client.26155 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T04:30:56.663 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:55.921+0000 7f6e47a6f740 1 -- 172.21.15.50:0/4045662660 --> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55cdf9fd8ec0 con 0x55cdf9c7cd80 2024-08-31T04:30:56.663 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:55.921+0000 7f6e39400640 1 --2- 172.21.15.50:0/4045662660 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x55cdf9c7cd80 0x55cdfa07add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:30:56.663 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:55.922+0000 7f6e39400640 1 --2- 172.21.15.50:0/4045662660 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x55cdf9c7cd80 0x55cdfa07add0 crc :-1 s=READY pgs=114 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ac74655d6986e39d server_cookie=35536c501a8af91f in_seq=0 out_seq=0 2024-08-31T04:30:56.663 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:55.922+0000 7f6e1b400640 10 client.26155 ms_handle_connect on v2:172.21.15.133:6838/2526402262 2024-08-31T04:30:56.663 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:55.923+0000 7f6e1b400640 1 -- 172.21.15.50:0/4045662660 <== mds.0 v2:172.21.15.133:6838/2526402262 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55cdf9fd8ec0 con 0x55cdf9c7cd80 2024-08-31T04:30:56.663 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:55.923+0000 7f6e1b400640 10 client.26155 handle_command_reply: tid=0 2024-08-31T04:30:56.664 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:55.923+0000 7f6e47a6f740 1 client.26155 shutdown 2024-08-31T04:30:56.664 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:55.923+0000 7f6e47a6f740 1 -- 172.21.15.50:0/4045662660 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55cdf9c952f0 msgr2=0x55cdfa06d5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:30:56.664 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:55.923+0000 7f6e47a6f740 1 --2- 172.21.15.50:0/4045662660 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55cdf9c952f0 0x55cdfa06d5e0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f6e2c006010 tx=0x7f6e2c02a410 comp rx=0 tx=0).stop 2024-08-31T04:30:56.664 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:55.923+0000 7f6e47a6f740 1 -- 172.21.15.50:0/4045662660 shutdown_connections 2024-08-31T04:30:56.664 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:55.923+0000 7f6e47a6f740 1 --2- 172.21.15.50:0/4045662660 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x55cdf9c7cd80 0x55cdfa07add0 crc :-1 s=READY pgs=114 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:56.664 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:55.923+0000 7f6e47a6f740 1 --2- 172.21.15.50:0/4045662660 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cdf9cbe1b0 0x55cdfa06e810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:56.664 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:55.923+0000 7f6e47a6f740 1 --2- 172.21.15.50:0/4045662660 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55cdf9c9d4d0 0x55cdfa06dca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:56.664 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:55.923+0000 7f6e1b400640 0 client.26155 ms_handle_reset on v2:172.21.15.133:6838/2526402262 2024-08-31T04:30:56.664 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:55.923+0000 7f6e47a6f740 1 --2- 172.21.15.50:0/4045662660 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55cdf9c952f0 0x55cdfa06d5e0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:56.664 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:55.923+0000 7f6e47a6f740 1 -- 172.21.15.50:0/4045662660 >> 172.21.15.50:0/4045662660 conn(0x55cdf9cb2300 msgr2=0x55cdfa05df40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:30:56.664 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:55.923+0000 7f6e47a6f740 1 -- 172.21.15.50:0/4045662660 shutdown_connections 2024-08-31T04:30:56.664 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:55.923+0000 7f6e47a6f740 1 -- 172.21.15.50:0/4045662660 wait complete. 2024-08-31T04:30:56.664 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:55.923+0000 7f6e47a6f740 20 client.26155 trim_cache size 0 max 16384 2024-08-31T04:30:56.664 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:55.938+0000 7f6e47a6f740 1 Processor -- start 2024-08-31T04:30:56.665 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:55.939+0000 7f6e47a6f740 1 -- start start 2024-08-31T04:30:56.665 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:55.939+0000 7f6e47a6f740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cdf9c952f0 0x55cdfa05a660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:30:56.665 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:55.939+0000 7f6e47a6f740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55cdf9c9d4d0 0x55cdfa06baf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:30:56.665 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:55.939+0000 7f6e47a6f740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55cdf9cbe1b0 0x55cdfa06c030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:30:56.665 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:55.939+0000 7f6e47a6f740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f6e3c1b10e0 con 0x55cdf9c952f0 2024-08-31T04:30:56.665 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:55.939+0000 7f6e47a6f740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f6e3c1b2d10 con 0x55cdf9c9d4d0 2024-08-31T04:30:56.665 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:55.939+0000 7f6e47a6f740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f6e3c1b17b0 con 0x55cdf9cbe1b0 2024-08-31T04:30:56.665 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:55.939+0000 7f6e39e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cdf9c952f0 0x55cdfa05a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:30:56.665 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:55.939+0000 7f6e39e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cdf9c952f0 0x55cdfa05a660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:59734/0 (socket says 172.21.15.50:59734) 2024-08-31T04:30:56.665 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:55.939+0000 7f6e39e00640 1 -- 172.21.15.50:0/1314324440 learned_addr learned my addr 172.21.15.50:0/1314324440 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:30:56.665 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:55.939+0000 7f6e3a800640 1 --2- 172.21.15.50:0/1314324440 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55cdf9cbe1b0 0x55cdfa06c030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:30:56.665 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:55.939+0000 7f6e39400640 1 --2- 172.21.15.50:0/1314324440 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55cdf9c9d4d0 0x55cdfa06baf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:30:56.665 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:55.940+0000 7f6e39e00640 1 -- 172.21.15.50:0/1314324440 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55cdf9cbe1b0 msgr2=0x55cdfa06c030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:30:56.665 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:55.940+0000 7f6e39e00640 1 --2- 172.21.15.50:0/1314324440 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55cdf9cbe1b0 0x55cdfa06c030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:56.666 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:55.940+0000 7f6e39e00640 1 -- 172.21.15.50:0/1314324440 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55cdf9c9d4d0 msgr2=0x55cdfa06baf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:30:56.666 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:55.940+0000 7f6e39e00640 1 --2- 172.21.15.50:0/1314324440 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55cdf9c9d4d0 0x55cdfa06baf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:56.666 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:55.940+0000 7f6e39e00640 1 -- 172.21.15.50:0/1314324440 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cdfa075ab0 con 0x55cdf9c952f0 2024-08-31T04:30:56.666 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:55.940+0000 7f6e39400640 1 --2- 172.21.15.50:0/1314324440 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55cdf9c9d4d0 0x55cdfa06baf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:30:56.666 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:55.940+0000 7f6e39e00640 1 --2- 172.21.15.50:0/1314324440 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cdf9c952f0 0x55cdfa05a660 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f6e2c0096c0 tx=0x7f6e2c0039d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6822d424eca1f4c2 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:30:56.666 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:55.940+0000 7f6e26600640 1 -- 172.21.15.50:0/1314324440 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e2c0536f0 con 0x55cdf9c952f0 2024-08-31T04:30:56.666 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:55.940+0000 7f6e26600640 1 -- 172.21.15.50:0/1314324440 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6e2c04e070 con 0x55cdf9c952f0 2024-08-31T04:30:56.666 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:55.940+0000 7f6e26600640 1 -- 172.21.15.50:0/1314324440 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e2c04a690 con 0x55cdf9c952f0 2024-08-31T04:30:56.666 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:55.941+0000 7f6e47a6f740 1 -- 172.21.15.50:0/1314324440 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cdf9c952f0 msgr2=0x55cdfa05a660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:30:56.666 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:55.941+0000 7f6e47a6f740 1 --2- 172.21.15.50:0/1314324440 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cdf9c952f0 0x55cdfa05a660 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f6e2c0096c0 tx=0x7f6e2c0039d0 comp rx=0 tx=0).stop 2024-08-31T04:30:56.666 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:55.941+0000 7f6e47a6f740 1 -- 172.21.15.50:0/1314324440 shutdown_connections 2024-08-31T04:30:56.666 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:55.941+0000 7f6e47a6f740 1 --2- 172.21.15.50:0/1314324440 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55cdf9cbe1b0 0x55cdfa06c030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:56.666 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:55.941+0000 7f6e47a6f740 1 --2- 172.21.15.50:0/1314324440 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55cdf9c9d4d0 0x55cdfa06baf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:56.666 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:55.941+0000 7f6e47a6f740 1 --2- 172.21.15.50:0/1314324440 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cdf9c952f0 0x55cdfa05a660 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:56.666 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:55.941+0000 7f6e47a6f740 1 -- 172.21.15.50:0/1314324440 >> 172.21.15.50:0/1314324440 conn(0x55cdf9cb2300 msgr2=0x55cdfa063f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:30:56.667 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:55.941+0000 7f6e47a6f740 1 -- 172.21.15.50:0/1314324440 shutdown_connections 2024-08-31T04:30:56.667 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:55.941+0000 7f6e47a6f740 1 -- 172.21.15.50:0/1314324440 wait complete. 2024-08-31T04:30:56.667 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:55.942+0000 7f6e47a6f740 1 -- start start 2024-08-31T04:30:56.667 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:55.942+0000 7f6e47a6f740 1 Processor -- start 2024-08-31T04:30:56.667 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:55.942+0000 7f6e47a6f740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55cdf9c952f0 0x55cdfa075110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:30:56.667 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:55.942+0000 7f6e47a6f740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cdf9c9d4d0 0x55cdfa073dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:30:56.667 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:55.942+0000 7f6e47a6f740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55cdf9cbe1b0 0x55cdfa074310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:30:56.667 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:55.942+0000 7f6e47a6f740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f6e3c1b2640 con 0x55cdf9c9d4d0 2024-08-31T04:30:56.667 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:55.942+0000 7f6e47a6f740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f6e3c1b1f40 con 0x55cdf9c952f0 2024-08-31T04:30:56.667 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:55.942+0000 7f6e47a6f740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f6e3c1af0c0 con 0x55cdf9cbe1b0 2024-08-31T04:30:56.667 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:55.942+0000 7f6e47a6f740 10 client.0 _ll_register_callbacks cb 0x7f6e2c0037d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:30:56.667 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:55.942+0000 7f6e39400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cdf9c9d4d0 0x55cdfa073dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:30:56.667 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:55.943+0000 7f6e39400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cdf9c9d4d0 0x55cdfa073dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:59750/0 (socket says 172.21.15.50:59750) 2024-08-31T04:30:56.667 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:55.943+0000 7f6e39e00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55cdf9c952f0 0x55cdfa075110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:30:56.668 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:55.943+0000 7f6e39400640 1 -- 172.21.15.50:0/3625361823 learned_addr learned my addr 172.21.15.50:0/3625361823 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:30:56.668 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:55.943+0000 7f6e3a800640 1 --2- 172.21.15.50:0/3625361823 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55cdf9cbe1b0 0x55cdfa074310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:30:56.668 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:55.943+0000 7f6e39400640 1 -- 172.21.15.50:0/3625361823 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55cdf9cbe1b0 msgr2=0x55cdfa074310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:30:56.668 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:55.943+0000 7f6e39400640 1 --2- 172.21.15.50:0/3625361823 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55cdf9cbe1b0 0x55cdfa074310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:56.668 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:55.943+0000 7f6e39400640 1 -- 172.21.15.50:0/3625361823 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55cdf9c952f0 msgr2=0x55cdfa075110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:30:56.668 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:55.943+0000 7f6e39400640 1 --2- 172.21.15.50:0/3625361823 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55cdf9c952f0 0x55cdfa075110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:56.668 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:55.943+0000 7f6e39400640 1 -- 172.21.15.50:0/3625361823 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cdfa0749b0 con 0x55cdf9c9d4d0 2024-08-31T04:30:56.668 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:55.943+0000 7f6e39e00640 1 --2- 172.21.15.50:0/3625361823 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55cdf9c952f0 0x55cdfa075110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:30:56.668 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:55.943+0000 7f6e39400640 1 --2- 172.21.15.50:0/3625361823 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cdf9c9d4d0 0x55cdfa073dd0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f6e2800c6a0 tx=0x7f6e28009f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c94fed8b97ac6bcf server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:30:56.668 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:55.943+0000 7f6e1b400640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-08-31T04:30:56.668 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:55.943+0000 7f6e1b400640 1 -- 172.21.15.50:0/3625361823 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e280ab210 con 0x55cdf9c9d4d0 2024-08-31T04:30:56.668 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:55.944+0000 7f6e1b400640 1 -- 172.21.15.50:0/3625361823 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8219+0+0 (secure 0 0 0) 0x7f6e280054f0 con 0x55cdf9c9d4d0 2024-08-31T04:30:56.668 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:55.944+0000 7f6e47a6f740 1 -- 172.21.15.50:0/3625361823 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6e2c04e070 con 0x55cdf9c9d4d0 2024-08-31T04:30:56.669 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:55.944+0000 7f6e1b400640 1 -- 172.21.15.50:0/3625361823 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7f6e280a7230 con 0x55cdf9c9d4d0 2024-08-31T04:30:56.669 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:55.944+0000 7f6e47a6f740 10 client.16182 fetch_fsmap learned FSMap version 42 2024-08-31T04:30:56.669 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:55.944+0000 7f6e47a6f740 1 -- 172.21.15.50:0/3625361823 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x55cdfa0e5790 con 0x55cdf9c9d4d0 2024-08-31T04:30:56.669 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:55.944+0000 7f6e1b400640 1 -- 172.21.15.50:0/3625361823 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6e2c04e070 con 0x55cdf9c9d4d0 2024-08-31T04:30:56.669 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:55.944+0000 7f6e1b400640 1 -- 172.21.15.50:0/3625361823 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 42) ==== 8398+0+0 (secure 0 0 0) 0x7f6e280a7d30 con 0x55cdf9c9d4d0 2024-08-31T04:30:56.669 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:55.944+0000 7f6e47a6f740 10 client.16182 fetch_fsmap finished waiting for FSMap version 42 2024-08-31T04:30:56.669 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:55.944+0000 7f6e47a6f740 10 client.16182 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T04:30:56.669 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:55.944+0000 7f6e47a6f740 20 client.16182 populate_metadata read hostname 'smithi050' 2024-08-31T04:30:56.669 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:55.945+0000 7f6e47a6f740 1 --2- 172.21.15.50:0/3625361823 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x55cdf9c521c0 0x55cdfa0e80b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:30:56.669 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:55.945+0000 7f6e47a6f740 4 client.16182 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-31T04:30:56.669 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:55.945+0000 7f6e47a6f740 1 -- 172.21.15.50:0/3625361823 --> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55cdf9fd4960 con 0x55cdf9c521c0 2024-08-31T04:30:56.669 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:55.945+0000 7f6e39e00640 1 --2- 172.21.15.50:0/3625361823 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x55cdf9c521c0 0x55cdfa0e80b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:30:56.669 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:55.945+0000 7f6e39e00640 1 --2- 172.21.15.50:0/3625361823 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x55cdf9c521c0 0x55cdfa0e80b0 crc :-1 s=READY pgs=115 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=659993e17512d425 server_cookie=d2b4f0097f25a7de in_seq=0 out_seq=0 2024-08-31T04:30:56.669 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:55.945+0000 7f6e1b400640 10 client.16182 ms_handle_connect on v2:172.21.15.133:6838/2526402262 2024-08-31T04:30:56.670 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:56.522+0000 7f6e1b400640 1 -- 172.21.15.50:0/3625361823 <== mds.0 v2:172.21.15.133:6838/2526402262 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55cdf9fd4960 con 0x55cdf9c521c0 2024-08-31T04:30:56.670 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:56.522+0000 7f6e1b400640 10 client.16182 handle_command_reply: tid=0 2024-08-31T04:30:56.670 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:56.522+0000 7f6e47a6f740 1 client.16182 shutdown 2024-08-31T04:30:56.670 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:56.522+0000 7f6e47a6f740 1 -- 172.21.15.50:0/3625361823 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cdf9c9d4d0 msgr2=0x55cdfa073dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:30:56.670 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:56.522+0000 7f6e47a6f740 1 --2- 172.21.15.50:0/3625361823 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cdf9c9d4d0 0x55cdfa073dd0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f6e2800c6a0 tx=0x7f6e28009f60 comp rx=0 tx=0).stop 2024-08-31T04:30:56.670 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:56.523+0000 7f6e47a6f740 1 -- 172.21.15.50:0/3625361823 shutdown_connections 2024-08-31T04:30:56.670 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:56.523+0000 7f6e47a6f740 1 --2- 172.21.15.50:0/3625361823 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x55cdf9c521c0 0x55cdfa0e80b0 crc :-1 s=READY pgs=115 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:56.670 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:56.523+0000 7f6e47a6f740 1 --2- 172.21.15.50:0/3625361823 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55cdf9cbe1b0 0x55cdfa074310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:56.670 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:56.523+0000 7f6e47a6f740 1 --2- 172.21.15.50:0/3625361823 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cdf9c9d4d0 0x55cdfa073dd0 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:56.670 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:56.523+0000 7f6e47a6f740 1 --2- 172.21.15.50:0/3625361823 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55cdf9c952f0 0x55cdfa075110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:56.670 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:56.523+0000 7f6e47a6f740 1 -- 172.21.15.50:0/3625361823 >> 172.21.15.50:0/3625361823 conn(0x55cdf9cb2300 msgr2=0x55cdfa0680f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:30:56.670 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:56.523+0000 7f6e1b400640 0 client.16182 ms_handle_reset on v2:172.21.15.133:6838/2526402262 2024-08-31T04:30:56.670 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:56.523+0000 7f6e47a6f740 1 -- 172.21.15.50:0/3625361823 shutdown_connections 2024-08-31T04:30:56.670 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:56.523+0000 7f6e47a6f740 1 -- 172.21.15.50:0/3625361823 wait complete. 2024-08-31T04:30:56.670 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:56.524+0000 7f6e47a6f740 20 client.16182 trim_cache size 0 max 16384 2024-08-31T04:30:56.671 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout:{ 2024-08-31T04:30:56.671 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout: "message": "", 2024-08-31T04:30:56.671 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout: "return_code": 0 2024-08-31T04:30:56.671 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout:} 2024-08-31T04:30:56.672 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:56.525+0000 7f6e3b200640 1 -- 172.21.15.50:0/858656294 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f6e200b4bb0 msgr2=0x7f6e200b70c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:30:56.672 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:56.525+0000 7f6e3b200640 1 --2- 172.21.15.50:0/858656294 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f6e200b4bb0 0x7f6e200b70c0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f6e2c005f70 tx=0x7f6e2c0314a0 comp rx=0 tx=0).stop 2024-08-31T04:30:56.672 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:56.525+0000 7f6e3b200640 1 -- 172.21.15.50:0/858656294 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6e3c076e90 msgr2=0x7f6e3c1a07d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:30:56.672 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:56.525+0000 7f6e3b200640 1 --2- 172.21.15.50:0/858656294 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6e3c076e90 0x7f6e3c1a07d0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f6e2800e9f0 tx=0x7f6e2800eeb0 comp rx=0 tx=0).stop 2024-08-31T04:30:56.672 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:56.525+0000 7f6e3b200640 1 -- 172.21.15.50:0/858656294 shutdown_connections 2024-08-31T04:30:56.672 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:56.525+0000 7f6e3b200640 1 --2- 172.21.15.50:0/858656294 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f6e200b4bb0 0x7f6e200b70c0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:56.672 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:56.525+0000 7f6e3b200640 1 --2- 172.21.15.50:0/858656294 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6e3c10fa00 0x7f6e3c1a1380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:56.672 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:56.525+0000 7f6e3b200640 1 --2- 172.21.15.50:0/858656294 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6e3c076e90 0x7f6e3c1a07d0 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:56.672 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:56.525+0000 7f6e3b200640 1 --2- 172.21.15.50:0/858656294 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6e3c075a90 0x7f6e3c1a0160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:30:56.672 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:56.525+0000 7f6e3b200640 1 -- 172.21.15.50:0/858656294 >> 172.21.15.50:0/858656294 conn(0x7f6e3c0febc0 msgr2=0x7f6e3c102c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:30:56.672 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:56.525+0000 7f6e3b200640 1 -- 172.21.15.50:0/858656294 shutdown_connections 2024-08-31T04:30:56.672 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:30:56.525+0000 7f6e3b200640 1 -- 172.21.15.50:0/858656294 wait complete. 2024-08-31T04:30:56.673 DEBUG:teuthology.orchestra.run.smithi133:> mktemp 2024-08-31T04:30:56.689 INFO:teuthology.orchestra.run.smithi133.stdout:/tmp/tmp.HeJegmxiO7 2024-08-31T04:30:56.689 DEBUG:teuthology.orchestra.run.smithi133:> sudo cp /var/run/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/ops-9d491f02-1-mds.h.json /tmp/tmp.HeJegmxiO7 2024-08-31T04:30:56.907 DEBUG:teuthology.orchestra.run.smithi133:> sudo chmod 0666 /tmp/tmp.HeJegmxiO7 2024-08-31T04:30:56.993 DEBUG:teuthology.orchestra.remote:smithi133:/tmp/tmp.HeJegmxiO7 is 33MB 2024-08-31T04:30:57.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:30:57 smithi050 ceph-mon[17259]: pgmap v610: 97 pgs: 97 active+clean; 1.5 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 600 KiB/s rd, 770 KiB/s wr, 23 op/s 2024-08-31T04:30:57.706 DEBUG:teuthology.orchestra.run.smithi133:> rm -fr /tmp/tmp.HeJegmxiO7 2024-08-31T04:30:57.795 DEBUG:tasks.quiescer.fs.[cephfs]:read 34497636B of ops from '/var/run/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/ops-9d491f02-1-mds.h.json' on mds.3 (h) 2024-08-31T04:30:58.965 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 3 (h) for 9d491f02-1: 'internal op quiesce_inode:mds.3:22043 fp=#0x10000001518' 2024-08-31T04:30:59.310 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 3 (h) for 9d491f02-1: 'internal op quiesce_inode:mds.3:22079 fp=#0x10000001507' 2024-08-31T04:30:59.356 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 3 (h) for 9d491f02-1: 'peer_request(client.15282:310817.0 authpin)' 2024-08-31T04:30:59.399 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 3 (h) for 9d491f02-1: 'internal op quiesce_inode:mds.3:22016 fp=#0x20000000520' 2024-08-31T04:30:59.404 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 3 (h) for 9d491f02-1: 'internal op quiesce_path:mds.3:10308 fp=#0x1' 2024-08-31T04:30:59.492 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 3 (h) for 9d491f02-1: 'internal op quiesce_inode:mds.3:10309 fp=#0x1' 2024-08-31T04:30:59.494 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 3 (h) for 9d491f02-1: 'internal op quiesce_inode:mds.3:10469 fp=#0x1000000191a' 2024-08-31T04:30:59.579 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 3 (h) for 9d491f02-1: 'internal op quiesce_inode:mds.3:22082 fp=#0x2000000051c' 2024-08-31T04:30:59.585 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 3 (h) for 9d491f02-1: 'internal op quiesce_inode:mds.3:10310 fp=#0x10000000000' 2024-08-31T04:30:59.673 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 3 (h) for 9d491f02-1: 'internal op quiesce_inode:mds.3:10311 fp=#0x10000000001' 2024-08-31T04:30:59.764 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 3 (h) for 9d491f02-1: 'internal op quiesce_inode:mds.3:10312 fp=#0x100000001fa' 2024-08-31T04:30:59.882 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 3 (h) for 9d491f02-1: 'internal op quiesce_inode:mds.3:14729 fp=#0x30000002b47' 2024-08-31T04:30:59.937 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 3 (h) for 9d491f02-1: 'internal op quiesce_inode:mds.3:10314 fp=#0x100000001fb' 2024-08-31T04:31:00.027 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 3 (h) for 9d491f02-1: 'internal op quiesce_inode:mds.3:10315 fp=#0x10000000005' 2024-08-31T04:31:00.112 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 3 (h) for 9d491f02-1: 'internal op quiesce_inode:mds.3:21992 fp=#0x2000000052d' 2024-08-31T04:31:00.118 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 3 (h) for 9d491f02-1: 'client_request(client.15282:310569 rename #0x40000001ebc/picture-12.jpg #0x40000001ebc/picture-12.jpg.tmp 2024-08-31T04:29:45.216994+0000 caller_uid=1000, caller_gid=1333{6,36,1000,1333,})' 2024-08-31T04:31:00.118 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 3 (h) for 9d491f02-1: 'internal op quiesce_inode:mds.3:10316 fp=#0x10000000006' 2024-08-31T04:31:00.119 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 3 (h) for 9d491f02-1: 'internal op quiesce_inode:mds.3:10540 fp=#0x30000002a56' 2024-08-31T04:31:00.209 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 3 (h) for 9d491f02-1: 'internal op quiesce_inode:mds.3:10317 fp=#0x10000000201' 2024-08-31T04:31:00.386 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 3 (h) for 9d491f02-1: 'internal op quiesce_inode:mds.3:22059 fp=#0x2000000051d' 2024-08-31T04:31:00.392 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 3 (h) for 9d491f02-1: 'internal op quiesce_inode:mds.3:10319 fp=#0x10000000208' 2024-08-31T04:31:00.578 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 3 (h) for 9d491f02-1: 'internal op quiesce_inode:mds.3:10353 fp=#0x30000002448' 2024-08-31T04:31:00.663 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 3 (h) for 9d491f02-1: 'internal op quiesce_inode:mds.3:21774 fp=#0x20000000487' 2024-08-31T04:31:00.671 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 3 (h) for 9d491f02-1: 'internal op quiesce_inode:mds.3:10322 fp=#0x10000000399' 2024-08-31T04:31:00.751 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 3 (h) for 9d491f02-1: 'client_request(client.15282:310902 rename #0x10000004062/comment-28.xml #0x10000004062/comment-28.xml.tmp 2024-08-31T04:29:48.804906+0000 caller_uid=1000, caller_gid=1333{6,36,1000,1333,})' 2024-08-31T04:31:00.844 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 3 (h) for 9d491f02-1: 'internal op quiesce_inode:mds.3:22096 fp=#0x10000001562' 2024-08-31T04:31:00.934 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 3 (h) for 9d491f02-1: 'internal op quiesce_inode:mds.3:21937 fp=#0x10000001559' 2024-08-31T04:31:01.026 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 3 (h) for 9d491f02-1: 'internal op quiesce_inode:mds.3:21970 fp=#0x1000000154a' 2024-08-31T04:31:01.034 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 3 (h) for 9d491f02-1: 'internal op quiesce_inode:mds.3:10454 fp=#0x10000002b0d' 2024-08-31T04:31:01.214 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 3 (h) for 9d491f02-1: 'internal op quiesce_inode:mds.3:21972 fp=#0x2000000052e' 2024-08-31T04:31:01.404 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 3 (h) for 9d491f02-1: 'internal op quiesce_inode:mds.3:22102 fp=#0x20000000539' 2024-08-31T04:31:01.501 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 3 (h) for 9d491f02-1: 'internal op quiesce_inode:mds.3:10491 fp=#0x10000001499' 2024-08-31T04:31:01.533 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 3 (h) for 9d491f02-1: 'internal op quiesce_inode:mds.3:14747 fp=#0x30000002b36' 2024-08-31T04:31:01.602 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 3 (h) for 9d491f02-1: 'internal op quiesce_inode:mds.3:11420 fp=#0x300000024f8' 2024-08-31T04:31:01.686 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 3 (h) for 9d491f02-1: 'internal op quiesce_inode:mds.3:10461 fp=#0x10000002548' 2024-08-31T04:31:01.777 INFO:tasks.quiescer.fs.[cephfs]:Pulled 12506 ops from rank 3 (h) into home/teuthworker/archive/mchangir-2024-08-30_08:30:37-fs-wip-mchangir-testing-20240828.085847-main-debug-distro-default-smithi/7881274/ops-9d491f02-1-mds.h.json 2024-08-31T04:31:01.777 DEBUG:teuthology.orchestra.run.smithi133:> sudo rm -- /var/run/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/ops-9d491f02-1-mds.h.json 2024-08-31T04:31:01.778 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:30:59 smithi050 ceph-mon[17259]: pgmap v611: 97 pgs: 97 active+clean; 1.5 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 39 op/s 2024-08-31T04:31:01.778 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:30:57 smithi177 ceph-mon[22025]: pgmap v610: 97 pgs: 97 active+clean; 1.5 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 600 KiB/s rd, 770 KiB/s wr, 23 op/s 2024-08-31T04:31:01.779 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:30:59 smithi177 ceph-mon[22025]: pgmap v611: 97 pgs: 97 active+clean; 1.5 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 39 op/s 2024-08-31T04:31:01.779 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:30:57 smithi133 ceph-mon[22177]: pgmap v610: 97 pgs: 97 active+clean; 1.5 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 600 KiB/s rd, 770 KiB/s wr, 23 op/s 2024-08-31T04:31:01.779 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:30:59 smithi133 ceph-mon[22177]: pgmap v611: 97 pgs: 97 active+clean; 1.5 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 39 op/s 2024-08-31T04:31:01.804 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:31:01 smithi133 ceph-mon[22177]: pgmap v612: 97 pgs: 97 active+clean; 1.5 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 56 op/s 2024-08-31T04:31:01.810 DEBUG:teuthology.orchestra.run.smithi177:> mktemp 2024-08-31T04:31:01.829 INFO:teuthology.orchestra.run.smithi177.stdout:/tmp/tmp.BLfGOKrmar 2024-08-31T04:31:01.830 DEBUG:teuthology.orchestra.run.smithi177:> sudo cp /var/run/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/ops-9d491f02-1-mds.i.json /tmp/tmp.BLfGOKrmar 2024-08-31T04:31:01.896 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:31:01 smithi177 ceph-mon[22025]: pgmap v612: 97 pgs: 97 active+clean; 1.5 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 56 op/s 2024-08-31T04:31:01.950 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:31:01 smithi050 ceph-mon[17259]: pgmap v612: 97 pgs: 97 active+clean; 1.5 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 56 op/s 2024-08-31T04:31:02.090 DEBUG:teuthology.orchestra.run.smithi177:> sudo chmod 0666 /tmp/tmp.BLfGOKrmar 2024-08-31T04:31:02.222 DEBUG:teuthology.orchestra.remote:smithi177:/tmp/tmp.BLfGOKrmar is 34MB 2024-08-31T04:31:02.940 DEBUG:teuthology.orchestra.run.smithi177:> rm -fr /tmp/tmp.BLfGOKrmar 2024-08-31T04:31:03.020 DEBUG:tasks.quiescer.fs.[cephfs]:read 35649790B of ops from '/var/run/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/ops-9d491f02-1-mds.i.json' on mds.2 (i) 2024-08-31T04:31:04.053 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:9761 fp=#0x10000000399' 2024-08-31T04:31:04.054 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:9825 fp=#0x300000032bb' 2024-08-31T04:31:04.054 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:9857 fp=#0x1000000158f' 2024-08-31T04:31:04.055 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:9921 fp=#0x30000001a41' 2024-08-31T04:31:04.055 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:9953 fp=#0x300000018ef' 2024-08-31T04:31:04.059 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:10497 fp=#0x3000000242a' 2024-08-31T04:31:04.061 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:10721 fp=#0x30000000a64' 2024-08-31T04:31:04.062 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:10785 fp=#0x30000000a67' 2024-08-31T04:31:04.069 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:11777 fp=#0x300000023c1' 2024-08-31T04:31:04.069 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:11809 fp=#0x300000023cd' 2024-08-31T04:31:04.069 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:11841 fp=#0x300000023ae' 2024-08-31T04:31:04.070 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:11937 fp=#0x30000001028' 2024-08-31T04:31:04.071 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12065 fp=#0x30000001020' 2024-08-31T04:31:04.072 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12097 fp=#0x300000031f3' 2024-08-31T04:31:04.072 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12129 fp=#0x30000001096' 2024-08-31T04:31:04.073 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12225 fp=#0x300000009c8' 2024-08-31T04:31:04.073 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12257 fp=#0x300000009b5' 2024-08-31T04:31:04.074 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12321 fp=#0x30000000964' 2024-08-31T04:31:04.074 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12353 fp=#0x30000000967' 2024-08-31T04:31:04.074 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12385 fp=#0x30000000954' 2024-08-31T04:31:04.075 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12417 fp=#0x30000002e13' 2024-08-31T04:31:04.075 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12449 fp=#0x30000002e06' 2024-08-31T04:31:04.075 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12513 fp=#0x30000000f7c' 2024-08-31T04:31:04.076 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12545 fp=#0x30000000f66' 2024-08-31T04:31:04.076 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12577 fp=#0x30000000fd1' 2024-08-31T04:31:04.076 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12609 fp=#0x300000033b1' 2024-08-31T04:31:04.077 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12641 fp=#0x30000003372' 2024-08-31T04:31:04.077 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12673 fp=#0x30000003375' 2024-08-31T04:31:04.077 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12705 fp=#0x3000000336c' 2024-08-31T04:31:04.078 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12737 fp=#0x30000000e45' 2024-08-31T04:31:04.078 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12769 fp=#0x30000002281' 2024-08-31T04:31:04.078 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12801 fp=#0x30000000eaa' 2024-08-31T04:31:04.079 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12865 fp=#0x10000004422' 2024-08-31T04:31:04.079 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12897 fp=#0x100000043ea' 2024-08-31T04:31:04.080 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12929 fp=#0x300000028b6' 2024-08-31T04:31:04.080 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12961 fp=#0x1000000441e' 2024-08-31T04:31:04.080 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12993 fp=#0x100000041d0' 2024-08-31T04:31:04.081 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13025 fp=#0x100000043f4' 2024-08-31T04:31:04.081 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13057 fp=#0x10000004223' 2024-08-31T04:31:04.081 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13089 fp=#0x3000000317e' 2024-08-31T04:31:04.082 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13121 fp=#0x3000000310f' 2024-08-31T04:31:04.082 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13153 fp=#0x300000030ba' 2024-08-31T04:31:04.083 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13313 fp=#0x30000000a52' 2024-08-31T04:31:04.083 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13345 fp=#0x30000000918' 2024-08-31T04:31:04.084 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13377 fp=#0x30000002220' 2024-08-31T04:31:04.084 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13409 fp=#0x30000002251' 2024-08-31T04:31:04.084 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13441 fp=#0x30000002234' 2024-08-31T04:31:04.085 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13473 fp=#0x30000000992' 2024-08-31T04:31:04.085 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13505 fp=#0x3000000099c' 2024-08-31T04:31:04.085 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13537 fp=#0x30000000a4b' 2024-08-31T04:31:04.086 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13569 fp=#0x3000000332f' 2024-08-31T04:31:04.086 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13601 fp=#0x3000000331f' 2024-08-31T04:31:04.086 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13633 fp=#0x300000032a5' 2024-08-31T04:31:04.087 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13665 fp=#0x300000028bd' 2024-08-31T04:31:04.087 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13697 fp=#0x30000002916' 2024-08-31T04:31:04.087 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13729 fp=#0x30000002984' 2024-08-31T04:31:04.087 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13761 fp=#0x3000000299b' 2024-08-31T04:31:04.088 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13793 fp=#0x30000002992' 2024-08-31T04:31:04.088 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13825 fp=#0x300000028d2' 2024-08-31T04:31:04.088 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13857 fp=#0x3000000299d' 2024-08-31T04:31:04.089 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13889 fp=#0x10000003f0a' 2024-08-31T04:31:04.089 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13921 fp=#0x10000003eae' 2024-08-31T04:31:04.089 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13953 fp=#0x10000003d3d' 2024-08-31T04:31:04.090 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13985 fp=#0x10000003ba6' 2024-08-31T04:31:04.090 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14017 fp=#0x10000003d5f' 2024-08-31T04:31:04.090 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14049 fp=#0x30000000c7a' 2024-08-31T04:31:04.091 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14081 fp=#0x30000000c54' 2024-08-31T04:31:04.091 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14113 fp=#0x30000000c51' 2024-08-31T04:31:04.091 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14145 fp=#0x30000002459' 2024-08-31T04:31:04.092 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14177 fp=#0x3000000177d' 2024-08-31T04:31:04.092 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14209 fp=#0x300000017ac' 2024-08-31T04:31:04.092 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14241 fp=#0x300000017b6' 2024-08-31T04:31:04.094 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14401 fp=#0x30000000d2f' 2024-08-31T04:31:04.094 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14433 fp=#0x30000000d35' 2024-08-31T04:31:04.094 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14465 fp=#0x30000000d83' 2024-08-31T04:31:04.095 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14497 fp=#0x30000000d9f' 2024-08-31T04:31:04.095 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14529 fp=#0x30000000d8b' 2024-08-31T04:31:04.095 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14561 fp=#0x30000000d02' 2024-08-31T04:31:04.096 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14593 fp=#0x30000000d43' 2024-08-31T04:31:04.096 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14625 fp=#0x10000002439' 2024-08-31T04:31:04.096 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14657 fp=#0x100000023eb' 2024-08-31T04:31:04.097 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14689 fp=#0x30000002fcb' 2024-08-31T04:31:04.097 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14721 fp=#0x1000000240f' 2024-08-31T04:31:04.097 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14753 fp=#0x100000023f4' 2024-08-31T04:31:04.098 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14816 fp=#0x10000003beb' 2024-08-31T04:31:04.098 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14848 fp=#0x3000000096a' 2024-08-31T04:31:04.098 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14880 fp=#0x30000000933' 2024-08-31T04:31:04.099 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14912 fp=#0x30000000985' 2024-08-31T04:31:04.099 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14944 fp=#0x30000000a14' 2024-08-31T04:31:04.099 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14976 fp=#0x30000001697' 2024-08-31T04:31:04.099 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15008 fp=#0x300000015e8' 2024-08-31T04:31:04.100 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15040 fp=#0x30000001601' 2024-08-31T04:31:04.101 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15072 fp=#0x3000000162d' 2024-08-31T04:31:04.101 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15104 fp=#0x30000001567' 2024-08-31T04:31:04.101 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15136 fp=#0x3000000340b' 2024-08-31T04:31:04.102 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15168 fp=#0x300000033c4' 2024-08-31T04:31:04.102 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15200 fp=#0x30000002e6b' 2024-08-31T04:31:04.102 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15232 fp=#0x30000002e65' 2024-08-31T04:31:04.103 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15264 fp=#0x30000002eb0' 2024-08-31T04:31:04.103 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15296 fp=#0x30000002ee8' 2024-08-31T04:31:04.103 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15328 fp=#0x30000002e81' 2024-08-31T04:31:04.104 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15360 fp=#0x30000002e94' 2024-08-31T04:31:04.104 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15392 fp=#0x300000032e7' 2024-08-31T04:31:04.104 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15424 fp=#0x30000000f19' 2024-08-31T04:31:04.105 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15456 fp=#0x30000000f03' 2024-08-31T04:31:04.105 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15488 fp=#0x30000000eeb' 2024-08-31T04:31:04.105 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15520 fp=#0x30000000ecb' 2024-08-31T04:31:04.106 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15552 fp=#0x30000001d00' 2024-08-31T04:31:04.106 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15584 fp=#0x30000000f07' 2024-08-31T04:31:04.106 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15616 fp=#0x300000004df' 2024-08-31T04:31:04.108 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15839 fp=#0x30000001299' 2024-08-31T04:31:04.108 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15871 fp=#0x300000012fb' 2024-08-31T04:31:04.108 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15903 fp=#0x300000012a2' 2024-08-31T04:31:04.109 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15935 fp=#0x3000000128f' 2024-08-31T04:31:04.109 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15967 fp=#0x3000000127d' 2024-08-31T04:31:04.109 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15999 fp=#0x300000010b3' 2024-08-31T04:31:04.110 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16031 fp=#0x30000001037' 2024-08-31T04:31:04.110 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16063 fp=#0x30000001827' 2024-08-31T04:31:04.110 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16095 fp=#0x3000000181d' 2024-08-31T04:31:04.111 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16127 fp=#0x3000000340d' 2024-08-31T04:31:04.111 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16159 fp=#0x300000034c8' 2024-08-31T04:31:04.111 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16191 fp=#0x300000033f8' 2024-08-31T04:31:04.112 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16223 fp=#0x3000000350e' 2024-08-31T04:31:04.112 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16319 fp=#0x30000003417' 2024-08-31T04:31:04.113 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16348 fp=#0x30000002093' 2024-08-31T04:31:04.113 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16380 fp=#0x30000002086' 2024-08-31T04:31:04.113 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16412 fp=#0x30000002098' 2024-08-31T04:31:04.114 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16444 fp=#0x100000024d7' 2024-08-31T04:31:04.114 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16476 fp=#0x30000001d38' 2024-08-31T04:31:04.114 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16508 fp=#0x30000001d39' 2024-08-31T04:31:04.115 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16572 fp=#0x100000024ff' 2024-08-31T04:31:04.115 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16604 fp=#0x100000024a7' 2024-08-31T04:31:04.115 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16635 fp=#0x300000022dc' 2024-08-31T04:31:04.116 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16667 fp=#0x30000002158' 2024-08-31T04:31:04.116 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16699 fp=#0x3000000216d' 2024-08-31T04:31:04.116 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16731 fp=#0x3000000265b' 2024-08-31T04:31:04.117 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16795 fp=#0x30000001964' 2024-08-31T04:31:04.118 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16891 fp=#0x3000000195b' 2024-08-31T04:31:04.118 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16922 fp=#0x30000001aef' 2024-08-31T04:31:04.118 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16954 fp=#0x30000001af1' 2024-08-31T04:31:04.118 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16986 fp=#0x30000002b64' 2024-08-31T04:31:04.119 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17043 fp=#0x100000036f5' 2024-08-31T04:31:04.119 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17075 fp=#0x10000003704' 2024-08-31T04:31:04.119 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17107 fp=#0x100000036cb' 2024-08-31T04:31:04.120 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17139 fp=#0x30000001814' 2024-08-31T04:31:04.120 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17171 fp=#0x3000000171c' 2024-08-31T04:31:04.120 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17203 fp=#0x300000017ca' 2024-08-31T04:31:04.120 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17235 fp=#0x30000001815' 2024-08-31T04:31:04.121 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17267 fp=#0x30000001809' 2024-08-31T04:31:04.121 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17299 fp=#0x30000002cb1' 2024-08-31T04:31:04.121 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17331 fp=#0x30000003352' 2024-08-31T04:31:04.122 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17363 fp=#0x30000003344' 2024-08-31T04:31:04.123 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17555 fp=#0x3000000319c' 2024-08-31T04:31:04.124 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17587 fp=#0x30000003242' 2024-08-31T04:31:04.124 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17619 fp=#0x300000031db' 2024-08-31T04:31:04.124 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17651 fp=#0x30000000df8' 2024-08-31T04:31:04.125 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17779 fp=#0x3000000115e' 2024-08-31T04:31:04.126 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17811 fp=#0x30000001f4c' 2024-08-31T04:31:04.126 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17843 fp=#0x30000001f81' 2024-08-31T04:31:04.126 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17875 fp=#0x30000001f5c' 2024-08-31T04:31:04.127 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17907 fp=#0x3000000200c' 2024-08-31T04:31:04.127 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17939 fp=#0x300000030f8' 2024-08-31T04:31:04.127 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17971 fp=#0x300000030e9' 2024-08-31T04:31:04.128 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18003 fp=#0x30000001bdf' 2024-08-31T04:31:04.128 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18035 fp=#0x30000001c2d' 2024-08-31T04:31:04.128 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18067 fp=#0x30000001c1a' 2024-08-31T04:31:04.129 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18099 fp=#0x30000001c14' 2024-08-31T04:31:04.129 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18131 fp=#0x30000002534' 2024-08-31T04:31:04.129 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18163 fp=#0x3000000254b' 2024-08-31T04:31:04.130 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18195 fp=#0x3000000256b' 2024-08-31T04:31:04.130 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18227 fp=#0x3000000254f' 2024-08-31T04:31:04.130 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18259 fp=#0x3000000288f' 2024-08-31T04:31:04.131 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18291 fp=#0x300000027e1' 2024-08-31T04:31:04.131 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18323 fp=#0x300000027eb' 2024-08-31T04:31:04.131 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18355 fp=#0x30000002834' 2024-08-31T04:31:04.131 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18387 fp=#0x30000002f1d' 2024-08-31T04:31:04.132 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18419 fp=#0x30000002f4d' 2024-08-31T04:31:04.132 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18451 fp=#0x30000003036' 2024-08-31T04:31:04.132 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18483 fp=#0x30000002f33' 2024-08-31T04:31:04.133 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18515 fp=#0x30000002f2d' 2024-08-31T04:31:04.133 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18547 fp=#0x3000000300c' 2024-08-31T04:31:04.133 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18579 fp=#0x10000001d07' 2024-08-31T04:31:04.134 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18611 fp=#0x10000001cfe' 2024-08-31T04:31:04.134 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18675 fp=#0x10000001d5c' 2024-08-31T04:31:04.135 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18707 fp=#0x30000001500' 2024-08-31T04:31:04.135 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18739 fp=#0x300000013d4' 2024-08-31T04:31:04.135 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18771 fp=#0x300000013bc' 2024-08-31T04:31:04.136 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18803 fp=#0x3000000137b' 2024-08-31T04:31:04.136 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18835 fp=#0x3000000134d' 2024-08-31T04:31:04.136 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18867 fp=#0x300000014f8' 2024-08-31T04:31:04.137 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18899 fp=#0x30000001077' 2024-08-31T04:31:04.137 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18931 fp=#0x30000001d52' 2024-08-31T04:31:04.137 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18963 fp=#0x3000000110a' 2024-08-31T04:31:04.138 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18995 fp=#0x300000010fc' 2024-08-31T04:31:04.138 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19027 fp=#0x300000010af' 2024-08-31T04:31:04.138 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19059 fp=#0x300000011f1' 2024-08-31T04:31:04.139 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19091 fp=#0x30000001172' 2024-08-31T04:31:04.139 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19123 fp=#0x30000001149' 2024-08-31T04:31:04.139 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19155 fp=#0x300000015c3' 2024-08-31T04:31:04.140 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19187 fp=#0x30000001641' 2024-08-31T04:31:04.140 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19219 fp=#0x3000000163d' 2024-08-31T04:31:04.141 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19283 fp=#0x100000008a7' 2024-08-31T04:31:04.141 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19315 fp=#0x3000000152b' 2024-08-31T04:31:04.141 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19347 fp=#0x30000001539' 2024-08-31T04:31:04.142 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19379 fp=#0x1000000089a' 2024-08-31T04:31:04.142 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19411 fp=#0x100000008a9' 2024-08-31T04:31:04.142 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19442 fp=#0x30000000be9' 2024-08-31T04:31:04.143 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19474 fp=#0x30000000b85' 2024-08-31T04:31:04.143 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19506 fp=#0x30000000b59' 2024-08-31T04:31:04.143 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19538 fp=#0x30000000b62' 2024-08-31T04:31:04.144 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19570 fp=#0x30000000a9a' 2024-08-31T04:31:04.144 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19602 fp=#0x30000000ad5' 2024-08-31T04:31:04.144 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19634 fp=#0x30000000a94' 2024-08-31T04:31:04.144 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19666 fp=#0x30000002ca3' 2024-08-31T04:31:04.145 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19698 fp=#0x30000002c4a' 2024-08-31T04:31:04.145 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19730 fp=#0x30000002d5b' 2024-08-31T04:31:04.145 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19762 fp=#0x30000002c01' 2024-08-31T04:31:04.146 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19794 fp=#0x30000002c3c' 2024-08-31T04:31:04.146 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19826 fp=#0x30000001146' 2024-08-31T04:31:04.146 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19858 fp=#0x3000000119a' 2024-08-31T04:31:04.147 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19890 fp=#0x30000001465' 2024-08-31T04:31:04.147 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19922 fp=#0x30000001443' 2024-08-31T04:31:04.147 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19954 fp=#0x3000000143c' 2024-08-31T04:31:04.148 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19986 fp=#0x300000013ee' 2024-08-31T04:31:04.148 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20018 fp=#0x30000001418' 2024-08-31T04:31:04.148 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20050 fp=#0x30000000fd9' 2024-08-31T04:31:04.148 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20082 fp=#0x30000000fba' 2024-08-31T04:31:04.149 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20114 fp=#0x30000000f9a' 2024-08-31T04:31:04.149 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20146 fp=#0x30000001c52' 2024-08-31T04:31:04.149 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20178 fp=#0x300000016b9' 2024-08-31T04:31:04.150 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20210 fp=#0x300000016c3' 2024-08-31T04:31:04.150 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20242 fp=#0x300000030ff' 2024-08-31T04:31:04.150 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20274 fp=#0x300000031f7' 2024-08-31T04:31:04.151 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20306 fp=#0x30000003256' 2024-08-31T04:31:04.151 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20338 fp=#0x30000003183' 2024-08-31T04:31:04.151 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20370 fp=#0x3000000309f' 2024-08-31T04:31:04.151 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20402 fp=#0x30000001dd7' 2024-08-31T04:31:04.152 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20434 fp=#0x30000001ca3' 2024-08-31T04:31:04.152 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20466 fp=#0x30000001ca5' 2024-08-31T04:31:04.152 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20498 fp=#0x30000001c96' 2024-08-31T04:31:04.153 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20530 fp=#0x30000001220' 2024-08-31T04:31:04.153 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20562 fp=#0x3000000123e' 2024-08-31T04:31:04.153 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20594 fp=#0x30000001261' 2024-08-31T04:31:04.154 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20690 fp=#0x30000002175' 2024-08-31T04:31:04.155 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20754 fp=#0x1000000383f' 2024-08-31T04:31:04.155 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20786 fp=#0x10000003725' 2024-08-31T04:31:04.155 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20850 fp=#0x300000030b4' 2024-08-31T04:31:04.156 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20914 fp=#0x3000000303a' 2024-08-31T04:31:04.156 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20946 fp=#0x10000003844' 2024-08-31T04:31:04.157 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20978 fp=#0x300000020d5' 2024-08-31T04:31:04.157 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21010 fp=#0x300000020c8' 2024-08-31T04:31:04.157 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21041 fp=#0x300000016b3' 2024-08-31T04:31:04.157 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21073 fp=#0x300000015c2' 2024-08-31T04:31:04.158 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21105 fp=#0x3000000162b' 2024-08-31T04:31:04.158 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21137 fp=#0x30000002beb' 2024-08-31T04:31:04.159 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21265 fp=#0x30000002bc9' 2024-08-31T04:31:04.159 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21297 fp=#0x1000000337f' 2024-08-31T04:31:04.160 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21329 fp=#0x1000000334f' 2024-08-31T04:31:04.160 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21361 fp=#0x10000003337' 2024-08-31T04:31:04.160 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21393 fp=#0x10000003301' 2024-08-31T04:31:04.161 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21425 fp=#0x10000003261' 2024-08-31T04:31:04.161 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21457 fp=#0x30000002743' 2024-08-31T04:31:04.161 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21489 fp=#0x3000000270d' 2024-08-31T04:31:04.161 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21521 fp=#0x3000000273a' 2024-08-31T04:31:04.162 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21553 fp=#0x300000026a2' 2024-08-31T04:31:04.162 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21585 fp=#0x3000000271b' 2024-08-31T04:31:04.162 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21617 fp=#0x300000036bf' 2024-08-31T04:31:04.163 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21649 fp=#0x30000003672' 2024-08-31T04:31:04.163 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21681 fp=#0x30000000cca' 2024-08-31T04:31:04.163 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21713 fp=#0x30000003694' 2024-08-31T04:31:04.164 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21745 fp=#0x30000000d11' 2024-08-31T04:31:04.164 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21777 fp=#0x30000000add' 2024-08-31T04:31:04.164 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21809 fp=#0x30000000acc' 2024-08-31T04:31:04.165 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21841 fp=#0x30000000b1a' 2024-08-31T04:31:04.165 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21873 fp=#0x30000000ab5' 2024-08-31T04:31:04.166 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21937 fp=#0x300000008de' 2024-08-31T04:31:04.166 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21969 fp=#0x3000000054c' 2024-08-31T04:31:04.166 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22032 fp=#0x30000001921' 2024-08-31T04:31:04.167 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22064 fp=#0x30000002f7e' 2024-08-31T04:31:04.167 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22096 fp=#0x300000018fd' 2024-08-31T04:31:04.167 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22128 fp=#0x30000002977' 2024-08-31T04:31:04.168 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22160 fp=#0x3000000297f' 2024-08-31T04:31:04.168 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22192 fp=#0x3000000292e' 2024-08-31T04:31:04.168 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22224 fp=#0x3000000292b' 2024-08-31T04:31:04.169 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22256 fp=#0x30000002088' 2024-08-31T04:31:04.169 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22288 fp=#0x30000002066' 2024-08-31T04:31:04.169 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22320 fp=#0x30000002003' 2024-08-31T04:31:04.170 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22352 fp=#0x30000002069' 2024-08-31T04:31:04.170 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22384 fp=#0x30000000428' 2024-08-31T04:31:04.171 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22480 fp=#0x30000000438' 2024-08-31T04:31:04.171 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22537 fp=#0x30000002bea' 2024-08-31T04:31:04.171 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22569 fp=#0x30000002c35' 2024-08-31T04:31:04.172 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22600 fp=#0x3000000147d' 2024-08-31T04:31:04.172 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22632 fp=#0x30000001483' 2024-08-31T04:31:04.172 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22664 fp=#0x30000001487' 2024-08-31T04:31:04.174 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:9794 fp=#0x30000003098' 2024-08-31T04:31:04.174 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:9826 fp=#0x30000000eb9' 2024-08-31T04:31:04.175 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:9922 fp=#0x30000000b53' 2024-08-31T04:31:04.175 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:9954 fp=#0x300000028a7' 2024-08-31T04:31:04.180 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:10626 fp=#0x30000000a77' 2024-08-31T04:31:04.180 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:10722 fp=#0x30000000a6b' 2024-08-31T04:31:04.188 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:11778 fp=#0x30000000bd0' 2024-08-31T04:31:04.188 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:11810 fp=#0x30000000bd6' 2024-08-31T04:31:04.188 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:11842 fp=#0x300000023b5' 2024-08-31T04:31:04.189 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:11874 fp=#0x30000000c2f' 2024-08-31T04:31:04.190 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12002 fp=#0x3000000320c' 2024-08-31T04:31:04.190 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12034 fp=#0x300000031e6' 2024-08-31T04:31:04.190 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12066 fp=#0x30000003212' 2024-08-31T04:31:04.191 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12098 fp=#0x3000000101c' 2024-08-31T04:31:04.191 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12130 fp=#0x30000001155' 2024-08-31T04:31:04.192 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12258 fp=#0x30000000996' 2024-08-31T04:31:04.192 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12290 fp=#0x300000009a0' 2024-08-31T04:31:04.193 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12322 fp=#0x30000000910' 2024-08-31T04:31:04.193 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12354 fp=#0x3000000092f' 2024-08-31T04:31:04.194 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12418 fp=#0x30000002e4e' 2024-08-31T04:31:04.194 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12450 fp=#0x30000002e3d' 2024-08-31T04:31:04.194 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12482 fp=#0x30000000f89' 2024-08-31T04:31:04.195 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12514 fp=#0x30000000f45' 2024-08-31T04:31:04.195 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12546 fp=#0x30000000f5b' 2024-08-31T04:31:04.195 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12578 fp=#0x30000000e29' 2024-08-31T04:31:04.195 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12610 fp=#0x30000000e6a' 2024-08-31T04:31:04.196 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12642 fp=#0x30000003373' 2024-08-31T04:31:04.196 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12674 fp=#0x30000000e48' 2024-08-31T04:31:04.196 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12706 fp=#0x300000033cc' 2024-08-31T04:31:04.197 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12738 fp=#0x30000000e18' 2024-08-31T04:31:04.197 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12770 fp=#0x30000003360' 2024-08-31T04:31:04.197 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12802 fp=#0x30000000e2a' 2024-08-31T04:31:04.198 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12834 fp=#0x10000004245' 2024-08-31T04:31:04.198 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12866 fp=#0x3000000287b' 2024-08-31T04:31:04.198 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12898 fp=#0x3000000250c' 2024-08-31T04:31:04.199 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12930 fp=#0x100000042a8' 2024-08-31T04:31:04.199 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12962 fp=#0x30000002828' 2024-08-31T04:31:04.199 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12994 fp=#0x3000000281a' 2024-08-31T04:31:04.199 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13026 fp=#0x10000004225' 2024-08-31T04:31:04.200 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13058 fp=#0x100000043e0' 2024-08-31T04:31:04.200 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13090 fp=#0x3000000312d' 2024-08-31T04:31:04.200 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13122 fp=#0x30000003124' 2024-08-31T04:31:04.201 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13154 fp=#0x3000000311a' 2024-08-31T04:31:04.202 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13314 fp=#0x3000000227e' 2024-08-31T04:31:04.202 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13346 fp=#0x30000002c2e' 2024-08-31T04:31:04.202 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13378 fp=#0x3000000228f' 2024-08-31T04:31:04.203 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13410 fp=#0x3000000226f' 2024-08-31T04:31:04.203 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13442 fp=#0x300000008cb' 2024-08-31T04:31:04.203 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13474 fp=#0x30000002249' 2024-08-31T04:31:04.204 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13506 fp=#0x300000008ce' 2024-08-31T04:31:04.204 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13538 fp=#0x30000000894' 2024-08-31T04:31:04.204 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13570 fp=#0x300000032a0' 2024-08-31T04:31:04.205 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13602 fp=#0x300000032f3' 2024-08-31T04:31:04.205 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13634 fp=#0x30000003290' 2024-08-31T04:31:04.205 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13666 fp=#0x30000002a1e' 2024-08-31T04:31:04.206 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13698 fp=#0x30000002a3b' 2024-08-31T04:31:04.206 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13730 fp=#0x30000002a0d' 2024-08-31T04:31:04.206 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13762 fp=#0x300000029af' 2024-08-31T04:31:04.206 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13794 fp=#0x30000002912' 2024-08-31T04:31:04.207 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13826 fp=#0x30000002953' 2024-08-31T04:31:04.207 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13858 fp=#0x30000002a05' 2024-08-31T04:31:04.207 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13890 fp=#0x10000003c41' 2024-08-31T04:31:04.208 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13922 fp=#0x10000003c32' 2024-08-31T04:31:04.208 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13954 fp=#0x10000003f1d' 2024-08-31T04:31:04.208 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13986 fp=#0x10000003d9a' 2024-08-31T04:31:04.208 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14018 fp=#0x10000003d47' 2024-08-31T04:31:04.209 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14050 fp=#0x30000000c75' 2024-08-31T04:31:04.209 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14082 fp=#0x30000000c4c' 2024-08-31T04:31:04.209 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14114 fp=#0x30000000c77' 2024-08-31T04:31:04.210 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14146 fp=#0x3000000243d' 2024-08-31T04:31:04.210 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14178 fp=#0x3000000242e' 2024-08-31T04:31:04.210 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14210 fp=#0x30000001782' 2024-08-31T04:31:04.211 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14242 fp=#0x300000017cb' 2024-08-31T04:31:04.211 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14274 fp=#0x30000000865' 2024-08-31T04:31:04.212 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14402 fp=#0x30000000cad' 2024-08-31T04:31:04.212 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14434 fp=#0x30000000d22' 2024-08-31T04:31:04.213 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14466 fp=#0x3000000239a' 2024-08-31T04:31:04.213 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14498 fp=#0x300000023a7' 2024-08-31T04:31:04.213 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14530 fp=#0x30000000d12' 2024-08-31T04:31:04.214 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14562 fp=#0x30000000d8d' 2024-08-31T04:31:04.214 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14594 fp=#0x30000000d80' 2024-08-31T04:31:04.214 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14626 fp=#0x10000002494' 2024-08-31T04:31:04.215 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14658 fp=#0x30000002f8f' 2024-08-31T04:31:04.215 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14690 fp=#0x10000002459' 2024-08-31T04:31:04.215 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14722 fp=#0x1000000247b' 2024-08-31T04:31:04.215 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14754 fp=#0x30000002f87' 2024-08-31T04:31:04.216 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14785 fp=#0x10000003bd8' 2024-08-31T04:31:04.216 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14817 fp=#0x10000003bf5' 2024-08-31T04:31:04.216 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14849 fp=#0x30000000a37' 2024-08-31T04:31:04.217 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14881 fp=#0x300000009b1' 2024-08-31T04:31:04.217 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14913 fp=#0x30000000936' 2024-08-31T04:31:04.217 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14945 fp=#0x30000000999' 2024-08-31T04:31:04.218 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14977 fp=#0x3000000150c' 2024-08-31T04:31:04.218 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15009 fp=#0x300000015af' 2024-08-31T04:31:04.218 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15041 fp=#0x300000015d3' 2024-08-31T04:31:04.218 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15073 fp=#0x30000001514' 2024-08-31T04:31:04.219 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15105 fp=#0x30000001581' 2024-08-31T04:31:04.219 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15137 fp=#0x30000003386' 2024-08-31T04:31:04.219 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15169 fp=#0x30000003398' 2024-08-31T04:31:04.220 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15201 fp=#0x30000002f03' 2024-08-31T04:31:04.220 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15233 fp=#0x30000002e68' 2024-08-31T04:31:04.220 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15265 fp=#0x30000002eda' 2024-08-31T04:31:04.221 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15297 fp=#0x30000002e95' 2024-08-31T04:31:04.221 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15329 fp=#0x30000002e5e' 2024-08-31T04:31:04.221 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15361 fp=#0x30000002e9d' 2024-08-31T04:31:04.222 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15393 fp=#0x300000032ea' 2024-08-31T04:31:04.222 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15425 fp=#0x30000000f3b' 2024-08-31T04:31:04.222 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15457 fp=#0x30000000ee1' 2024-08-31T04:31:04.222 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15489 fp=#0x30000000f38' 2024-08-31T04:31:04.223 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15521 fp=#0x30000000efd' 2024-08-31T04:31:04.223 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15553 fp=#0x30000001db4' 2024-08-31T04:31:04.223 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15585 fp=#0x30000000ef9' 2024-08-31T04:31:04.224 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15649 fp=#0x30000000559' 2024-08-31T04:31:04.224 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15681 fp=#0x300000005c6' 2024-08-31T04:31:04.225 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15777 fp=#0x300000004e0' 2024-08-31T04:31:04.225 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15840 fp=#0x300000012ae' 2024-08-31T04:31:04.226 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15872 fp=#0x3000000129f' 2024-08-31T04:31:04.226 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15904 fp=#0x300000012bb' 2024-08-31T04:31:04.226 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15936 fp=#0x3000000130c' 2024-08-31T04:31:04.227 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15968 fp=#0x300000012ad' 2024-08-31T04:31:04.227 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16000 fp=#0x3000000108f' 2024-08-31T04:31:04.227 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16032 fp=#0x30000001065' 2024-08-31T04:31:04.228 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16064 fp=#0x30000002e00' 2024-08-31T04:31:04.228 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16096 fp=#0x30000002dfc' 2024-08-31T04:31:04.228 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16160 fp=#0x300000034dd' 2024-08-31T04:31:04.229 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16192 fp=#0x30000003561' 2024-08-31T04:31:04.229 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16256 fp=#0x30000003403' 2024-08-31T04:31:04.230 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16349 fp=#0x30000002091' 2024-08-31T04:31:04.230 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16381 fp=#0x10000002840' 2024-08-31T04:31:04.230 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16413 fp=#0x3000000208c' 2024-08-31T04:31:04.231 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16445 fp=#0x100000024af' 2024-08-31T04:31:04.231 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16477 fp=#0x30000001d37' 2024-08-31T04:31:04.231 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16509 fp=#0x30000001d4d' 2024-08-31T04:31:04.232 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16541 fp=#0x30000001d2c' 2024-08-31T04:31:04.232 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16573 fp=#0x100000024e5' 2024-08-31T04:31:04.232 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16605 fp=#0x100000024e3' 2024-08-31T04:31:04.233 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16636 fp=#0x30000002357' 2024-08-31T04:31:04.233 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16668 fp=#0x30000002122' 2024-08-31T04:31:04.233 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16700 fp=#0x30000002132' 2024-08-31T04:31:04.234 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16732 fp=#0x3000000265e' 2024-08-31T04:31:04.234 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16796 fp=#0x30000001a2f' 2024-08-31T04:31:04.234 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16828 fp=#0x3000000196e' 2024-08-31T04:31:04.235 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16860 fp=#0x30000001975' 2024-08-31T04:31:04.235 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16892 fp=#0x30000001a1a' 2024-08-31T04:31:04.235 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16923 fp=#0x30000001ac3' 2024-08-31T04:31:04.236 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16955 fp=#0x30000001ab7' 2024-08-31T04:31:04.236 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16987 fp=#0x30000002b52' 2024-08-31T04:31:04.236 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17012 fp=#0x1000000362d' 2024-08-31T04:31:04.237 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17044 fp=#0x100000036c6' 2024-08-31T04:31:04.237 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17076 fp=#0x100000036c1' 2024-08-31T04:31:04.237 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17108 fp=#0x100000036a3' 2024-08-31T04:31:04.238 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17140 fp=#0x300000017f5' 2024-08-31T04:31:04.238 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17172 fp=#0x3000000173a' 2024-08-31T04:31:04.238 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17204 fp=#0x300000017d0' 2024-08-31T04:31:04.239 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17236 fp=#0x30000002ce6' 2024-08-31T04:31:04.239 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17268 fp=#0x30000001715' 2024-08-31T04:31:04.239 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17300 fp=#0x30000002ca4' 2024-08-31T04:31:04.240 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17332 fp=#0x3000000335d' 2024-08-31T04:31:04.240 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17364 fp=#0x30000003351' 2024-08-31T04:31:04.241 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17556 fp=#0x30000000dd4' 2024-08-31T04:31:04.242 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17588 fp=#0x300000031cd' 2024-08-31T04:31:04.242 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17620 fp=#0x300000031a9' 2024-08-31T04:31:04.242 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17652 fp=#0x300000031ec' 2024-08-31T04:31:04.243 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17812 fp=#0x30000001f99' 2024-08-31T04:31:04.244 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17844 fp=#0x30000002052' 2024-08-31T04:31:04.244 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17876 fp=#0x30000001f96' 2024-08-31T04:31:04.244 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17908 fp=#0x30000001fda' 2024-08-31T04:31:04.245 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17940 fp=#0x30000003100' 2024-08-31T04:31:04.245 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17972 fp=#0x300000030a7' 2024-08-31T04:31:04.245 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18004 fp=#0x30000001c11' 2024-08-31T04:31:04.246 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18036 fp=#0x30000001c05' 2024-08-31T04:31:04.246 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18068 fp=#0x30000001c15' 2024-08-31T04:31:04.246 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18100 fp=#0x30000001c9a' 2024-08-31T04:31:04.247 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18132 fp=#0x30000002537' 2024-08-31T04:31:04.247 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18164 fp=#0x30000002555' 2024-08-31T04:31:04.247 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18196 fp=#0x30000002566' 2024-08-31T04:31:04.248 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18228 fp=#0x30000002552' 2024-08-31T04:31:04.248 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18260 fp=#0x300000027e2' 2024-08-31T04:31:04.248 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18292 fp=#0x300000027ec' 2024-08-31T04:31:04.249 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18324 fp=#0x300000027d0' 2024-08-31T04:31:04.249 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18356 fp=#0x300000027ee' 2024-08-31T04:31:04.249 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18388 fp=#0x3000000301b' 2024-08-31T04:31:04.250 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18420 fp=#0x30000002f52' 2024-08-31T04:31:04.250 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18452 fp=#0x3000000300a' 2024-08-31T04:31:04.250 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18484 fp=#0x30000002f14' 2024-08-31T04:31:04.251 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18516 fp=#0x30000002fed' 2024-08-31T04:31:04.251 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18548 fp=#0x30000002ff5' 2024-08-31T04:31:04.251 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18580 fp=#0x10000001d5b' 2024-08-31T04:31:04.252 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18676 fp=#0x10000001cf8' 2024-08-31T04:31:04.252 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18708 fp=#0x300000013b4' 2024-08-31T04:31:04.253 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18740 fp=#0x300000013a5' 2024-08-31T04:31:04.253 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18772 fp=#0x30000001518' 2024-08-31T04:31:04.253 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18804 fp=#0x300000014df' 2024-08-31T04:31:04.254 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18836 fp=#0x300000013c4' 2024-08-31T04:31:04.254 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18868 fp=#0x30000001343' 2024-08-31T04:31:04.254 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18900 fp=#0x30000001105' 2024-08-31T04:31:04.255 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18932 fp=#0x30000001d78' 2024-08-31T04:31:04.255 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18964 fp=#0x30000001d67' 2024-08-31T04:31:04.255 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18996 fp=#0x300000010c2' 2024-08-31T04:31:04.256 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19028 fp=#0x3000000108b' 2024-08-31T04:31:04.256 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19060 fp=#0x30000001205' 2024-08-31T04:31:04.256 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19092 fp=#0x3000000115d' 2024-08-31T04:31:04.257 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19124 fp=#0x3000000116f' 2024-08-31T04:31:04.257 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19156 fp=#0x3000000165b' 2024-08-31T04:31:04.257 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19188 fp=#0x30000001659' 2024-08-31T04:31:04.258 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19284 fp=#0x100000008a3' 2024-08-31T04:31:04.258 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19316 fp=#0x300000014bb' 2024-08-31T04:31:04.259 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19348 fp=#0x30000002bb9' 2024-08-31T04:31:04.259 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19380 fp=#0x100000008b6' 2024-08-31T04:31:04.259 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19412 fp=#0x100000008ac' 2024-08-31T04:31:04.260 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19443 fp=#0x30000000b92' 2024-08-31T04:31:04.260 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19475 fp=#0x30000000b9c' 2024-08-31T04:31:04.260 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19507 fp=#0x30000000b90' 2024-08-31T04:31:04.261 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19539 fp=#0x30000000bc1' 2024-08-31T04:31:04.261 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19571 fp=#0x30000000b39' 2024-08-31T04:31:04.261 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19603 fp=#0x30000000b2f' 2024-08-31T04:31:04.262 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19635 fp=#0x30000000adc' 2024-08-31T04:31:04.262 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19667 fp=#0x30000002de1' 2024-08-31T04:31:04.262 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19699 fp=#0x30000002d56' 2024-08-31T04:31:04.263 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19731 fp=#0x30000002de7' 2024-08-31T04:31:04.263 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19763 fp=#0x30000002d49' 2024-08-31T04:31:04.263 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19795 fp=#0x30000002c89' 2024-08-31T04:31:04.264 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19827 fp=#0x3000000117f' 2024-08-31T04:31:04.264 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19859 fp=#0x300000011bd' 2024-08-31T04:31:04.264 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19891 fp=#0x300000011fa' 2024-08-31T04:31:04.265 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19923 fp=#0x3000000144a' 2024-08-31T04:31:04.265 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19955 fp=#0x30000001413' 2024-08-31T04:31:04.265 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19987 fp=#0x300000013ed' 2024-08-31T04:31:04.266 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20019 fp=#0x30000001414' 2024-08-31T04:31:04.266 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20051 fp=#0x30000000fb0' 2024-08-31T04:31:04.266 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20083 fp=#0x30000001ddb' 2024-08-31T04:31:04.267 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20115 fp=#0x30000000fe7' 2024-08-31T04:31:04.267 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20147 fp=#0x300000016f1' 2024-08-31T04:31:04.267 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20179 fp=#0x30000001704' 2024-08-31T04:31:04.268 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20211 fp=#0x300000016e7' 2024-08-31T04:31:04.268 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20243 fp=#0x30000003091' 2024-08-31T04:31:04.268 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20275 fp=#0x30000003096' 2024-08-31T04:31:04.269 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20307 fp=#0x30000003182' 2024-08-31T04:31:04.269 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20339 fp=#0x30000003149' 2024-08-31T04:31:04.269 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20371 fp=#0x30000003249' 2024-08-31T04:31:04.270 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20403 fp=#0x30000001c6c' 2024-08-31T04:31:04.270 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20435 fp=#0x30000001c98' 2024-08-31T04:31:04.270 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20467 fp=#0x30000001cae' 2024-08-31T04:31:04.271 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20499 fp=#0x30000001cd8' 2024-08-31T04:31:04.271 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20531 fp=#0x30000001213' 2024-08-31T04:31:04.271 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20563 fp=#0x3000000126a' 2024-08-31T04:31:04.272 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20595 fp=#0x3000000124f' 2024-08-31T04:31:04.272 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20627 fp=#0x300000021b4' 2024-08-31T04:31:04.272 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20659 fp=#0x300000032b9' 2024-08-31T04:31:04.273 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20691 fp=#0x3000000218a' 2024-08-31T04:31:04.273 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20723 fp=#0x3000000215c' 2024-08-31T04:31:04.273 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20755 fp=#0x10000003734' 2024-08-31T04:31:04.274 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20787 fp=#0x30000003076' 2024-08-31T04:31:04.274 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20819 fp=#0x1000000372d' 2024-08-31T04:31:04.274 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20851 fp=#0x300000030db' 2024-08-31T04:31:04.275 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20883 fp=#0x1000000373e' 2024-08-31T04:31:04.275 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20915 fp=#0x30000003047' 2024-08-31T04:31:04.275 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20947 fp=#0x300000030d0' 2024-08-31T04:31:04.276 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20979 fp=#0x300000020d1' 2024-08-31T04:31:04.276 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21011 fp=#0x300000020c2' 2024-08-31T04:31:04.276 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21042 fp=#0x30000001651' 2024-08-31T04:31:04.276 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21074 fp=#0x30000001565' 2024-08-31T04:31:04.277 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21106 fp=#0x3000000160e' 2024-08-31T04:31:04.278 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21202 fp=#0x30000002bf2' 2024-08-31T04:31:04.278 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21298 fp=#0x10000003375' 2024-08-31T04:31:04.279 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21330 fp=#0x10000003377' 2024-08-31T04:31:04.279 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21362 fp=#0x1000000331c' 2024-08-31T04:31:04.279 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21394 fp=#0x10000003250' 2024-08-31T04:31:04.280 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21426 fp=#0x1000000334d' 2024-08-31T04:31:04.280 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21458 fp=#0x3000000268e' 2024-08-31T04:31:04.280 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21490 fp=#0x3000000272a' 2024-08-31T04:31:04.281 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21522 fp=#0x30000003078' 2024-08-31T04:31:04.281 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21554 fp=#0x300000026dd' 2024-08-31T04:31:04.281 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21586 fp=#0x300000026f7' 2024-08-31T04:31:04.282 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21618 fp=#0x300000036d9' 2024-08-31T04:31:04.282 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21650 fp=#0x30000000ce9' 2024-08-31T04:31:04.282 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21682 fp=#0x30000000ca6' 2024-08-31T04:31:04.283 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21714 fp=#0x3000000369a' 2024-08-31T04:31:04.283 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21746 fp=#0x30000000ceb' 2024-08-31T04:31:04.283 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21778 fp=#0x30000000ad6' 2024-08-31T04:31:04.283 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21810 fp=#0x30000000b23' 2024-08-31T04:31:04.284 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21842 fp=#0x30000000b10' 2024-08-31T04:31:04.284 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21874 fp=#0x30000000b42' 2024-08-31T04:31:04.285 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21906 fp=#0x30000000934' 2024-08-31T04:31:04.285 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21970 fp=#0x3000000052f' 2024-08-31T04:31:04.286 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22033 fp=#0x30000001935' 2024-08-31T04:31:04.286 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22065 fp=#0x300000018f9' 2024-08-31T04:31:04.286 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22097 fp=#0x30000001931' 2024-08-31T04:31:04.287 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22129 fp=#0x300000029b8' 2024-08-31T04:31:04.287 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22161 fp=#0x3000000295a' 2024-08-31T04:31:04.287 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22193 fp=#0x300000028c8' 2024-08-31T04:31:04.288 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22225 fp=#0x30000002995' 2024-08-31T04:31:04.288 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22257 fp=#0x30000002016' 2024-08-31T04:31:04.288 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22289 fp=#0x3000000207b' 2024-08-31T04:31:04.288 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22321 fp=#0x3000000203e' 2024-08-31T04:31:04.289 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22353 fp=#0x30000002062' 2024-08-31T04:31:04.289 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22385 fp=#0x3000000049c' 2024-08-31T04:31:04.289 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22417 fp=#0x300000004a7' 2024-08-31T04:31:04.290 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22481 fp=#0x30000000423' 2024-08-31T04:31:04.290 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22513 fp=#0x30000000425' 2024-08-31T04:31:04.291 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22538 fp=#0x30000002c5c' 2024-08-31T04:31:04.291 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22570 fp=#0x30000002bd3' 2024-08-31T04:31:04.291 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22601 fp=#0x30000001480' 2024-08-31T04:31:04.292 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22633 fp=#0x30000001475' 2024-08-31T04:31:04.292 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22665 fp=#0x10000000fe5' 2024-08-31T04:31:04.292 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22727 fp=#0x50000001307' 2024-08-31T04:31:04.293 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:9795 fp=#0x300000006d0' 2024-08-31T04:31:04.293 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:9827 fp=#0x300000004dc' 2024-08-31T04:31:04.294 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:9923 fp=#0x30000000a87' 2024-08-31T04:31:04.295 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:9955 fp=#0x30000001fd1' 2024-08-31T04:31:04.300 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:10691 fp=#0x30000000a6c' 2024-08-31T04:31:04.308 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:11811 fp=#0x30000000bde' 2024-08-31T04:31:04.309 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:11939 fp=#0x30000003204' 2024-08-31T04:31:04.310 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:11971 fp=#0x30000001066' 2024-08-31T04:31:04.310 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12003 fp=#0x300000010f1' 2024-08-31T04:31:04.310 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12035 fp=#0x30000001109' 2024-08-31T04:31:04.311 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12067 fp=#0x3000000107d' 2024-08-31T04:31:04.311 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12131 fp=#0x30000001036' 2024-08-31T04:31:04.312 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12227 fp=#0x30000000928' 2024-08-31T04:31:04.313 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12259 fp=#0x30000000960' 2024-08-31T04:31:04.314 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12387 fp=#0x3000000096d' 2024-08-31T04:31:04.314 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12451 fp=#0x30000002e0e' 2024-08-31T04:31:04.315 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12483 fp=#0x30000000f84' 2024-08-31T04:31:04.315 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12515 fp=#0x30000000f50' 2024-08-31T04:31:04.315 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12547 fp=#0x30000000f8a' 2024-08-31T04:31:04.316 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12579 fp=#0x30000000e61' 2024-08-31T04:31:04.316 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12611 fp=#0x30000000e47' 2024-08-31T04:31:04.316 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12643 fp=#0x30000000ea3' 2024-08-31T04:31:04.317 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12675 fp=#0x30000000e52' 2024-08-31T04:31:04.317 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12707 fp=#0x30000000e8b' 2024-08-31T04:31:04.317 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12739 fp=#0x30000000e80' 2024-08-31T04:31:04.318 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12771 fp=#0x30000000e77' 2024-08-31T04:31:04.318 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12803 fp=#0x30000000e4c' 2024-08-31T04:31:04.318 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12835 fp=#0x300000028af' 2024-08-31T04:31:04.319 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12867 fp=#0x1000000425f' 2024-08-31T04:31:04.319 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12899 fp=#0x30000002832' 2024-08-31T04:31:04.319 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12931 fp=#0x30000002837' 2024-08-31T04:31:04.320 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12963 fp=#0x300000028ab' 2024-08-31T04:31:04.320 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12995 fp=#0x1000000436e' 2024-08-31T04:31:04.320 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13027 fp=#0x30000002806' 2024-08-31T04:31:04.321 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13059 fp=#0x100000041e5' 2024-08-31T04:31:04.321 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13091 fp=#0x3000000317c' 2024-08-31T04:31:04.321 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13123 fp=#0x30000003115' 2024-08-31T04:31:04.322 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13155 fp=#0x30000003190' 2024-08-31T04:31:04.323 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13315 fp=#0x30000002268' 2024-08-31T04:31:04.323 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13347 fp=#0x3000000099e' 2024-08-31T04:31:04.323 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13379 fp=#0x300000008af' 2024-08-31T04:31:04.324 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13411 fp=#0x300000008c5' 2024-08-31T04:31:04.324 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13443 fp=#0x30000002256' 2024-08-31T04:31:04.324 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13475 fp=#0x300000008b1' 2024-08-31T04:31:04.325 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13507 fp=#0x30000000a47' 2024-08-31T04:31:04.325 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13539 fp=#0x3000000227b' 2024-08-31T04:31:04.325 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13571 fp=#0x300000032b0' 2024-08-31T04:31:04.326 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13603 fp=#0x30000003343' 2024-08-31T04:31:04.326 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13635 fp=#0x30000003283' 2024-08-31T04:31:04.326 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13667 fp=#0x300000028e1' 2024-08-31T04:31:04.327 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13699 fp=#0x300000028a6' 2024-08-31T04:31:04.327 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13731 fp=#0x30000002931' 2024-08-31T04:31:04.327 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13763 fp=#0x300000029c5' 2024-08-31T04:31:04.327 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13795 fp=#0x300000028e7' 2024-08-31T04:31:04.328 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13827 fp=#0x30000002970' 2024-08-31T04:31:04.328 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13859 fp=#0x300000028f6' 2024-08-31T04:31:04.329 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13955 fp=#0x10000003dfd' 2024-08-31T04:31:04.329 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13987 fp=#0x10000003c38' 2024-08-31T04:31:04.330 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14019 fp=#0x10000003c16' 2024-08-31T04:31:04.330 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14051 fp=#0x30000000c74' 2024-08-31T04:31:04.330 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14083 fp=#0x30000000c53' 2024-08-31T04:31:04.330 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14115 fp=#0x30000001c92' 2024-08-31T04:31:04.331 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14147 fp=#0x30000001762' 2024-08-31T04:31:04.331 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14179 fp=#0x30000002487' 2024-08-31T04:31:04.331 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14211 fp=#0x300000017a0' 2024-08-31T04:31:04.332 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14243 fp=#0x3000000244c' 2024-08-31T04:31:04.333 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14403 fp=#0x30000000cd5' 2024-08-31T04:31:04.333 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14435 fp=#0x30000000d88' 2024-08-31T04:31:04.334 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14467 fp=#0x30000000cb7' 2024-08-31T04:31:04.334 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14499 fp=#0x30000000d65' 2024-08-31T04:31:04.334 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14531 fp=#0x30000000d08' 2024-08-31T04:31:04.335 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14563 fp=#0x3000000238d' 2024-08-31T04:31:04.335 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14595 fp=#0x30000000ca9' 2024-08-31T04:31:04.335 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14627 fp=#0x10000002418' 2024-08-31T04:31:04.336 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14659 fp=#0x30000002fb8' 2024-08-31T04:31:04.336 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14691 fp=#0x30000002fd3' 2024-08-31T04:31:04.336 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14723 fp=#0x30000002f9e' 2024-08-31T04:31:04.337 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14755 fp=#0x30000002fbc' 2024-08-31T04:31:04.337 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14786 fp=#0x10000003bb0' 2024-08-31T04:31:04.337 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14818 fp=#0x10000003be3' 2024-08-31T04:31:04.338 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14850 fp=#0x300000009df' 2024-08-31T04:31:04.338 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14882 fp=#0x300000009bd' 2024-08-31T04:31:04.338 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14914 fp=#0x30000000a21' 2024-08-31T04:31:04.339 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14946 fp=#0x30000000a0a' 2024-08-31T04:31:04.339 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14978 fp=#0x30000001557' 2024-08-31T04:31:04.339 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15010 fp=#0x3000000163c' 2024-08-31T04:31:04.340 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15042 fp=#0x3000000161d' 2024-08-31T04:31:04.340 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15074 fp=#0x300000015bd' 2024-08-31T04:31:04.340 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15106 fp=#0x3000000167b' 2024-08-31T04:31:04.341 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15138 fp=#0x30000003402' 2024-08-31T04:31:04.341 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15170 fp=#0x30000003411' 2024-08-31T04:31:04.341 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15202 fp=#0x30000002efe' 2024-08-31T04:31:04.342 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15234 fp=#0x30000002e93' 2024-08-31T04:31:04.342 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15266 fp=#0x30000002ef3' 2024-08-31T04:31:04.342 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15298 fp=#0x30000002eb5' 2024-08-31T04:31:04.343 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15330 fp=#0x30000002ec7' 2024-08-31T04:31:04.343 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15362 fp=#0x30000002ec4' 2024-08-31T04:31:04.343 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15394 fp=#0x300000032e1' 2024-08-31T04:31:04.346 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15426 fp=#0x30000000eee' 2024-08-31T04:31:04.347 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15458 fp=#0x30000000f12' 2024-08-31T04:31:04.347 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15490 fp=#0x30000001db8' 2024-08-31T04:31:04.347 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15522 fp=#0x30000000f14' 2024-08-31T04:31:04.348 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15554 fp=#0x30000000ef3' 2024-08-31T04:31:04.348 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15586 fp=#0x30000001dd0' 2024-08-31T04:31:04.348 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15618 fp=#0x300000005f4' 2024-08-31T04:31:04.349 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15650 fp=#0x300000005b2' 2024-08-31T04:31:04.350 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15778 fp=#0x300000005c4' 2024-08-31T04:31:04.350 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15841 fp=#0x300000012aa' 2024-08-31T04:31:04.351 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15873 fp=#0x30000002fb5' 2024-08-31T04:31:04.351 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15905 fp=#0x300000012a3' 2024-08-31T04:31:04.351 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15937 fp=#0x30000002fb6' 2024-08-31T04:31:04.352 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15969 fp=#0x300000012fc' 2024-08-31T04:31:04.352 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16001 fp=#0x300000010a4' 2024-08-31T04:31:04.352 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16033 fp=#0x3000000100c' 2024-08-31T04:31:04.353 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16065 fp=#0x3000000181e' 2024-08-31T04:31:04.353 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16097 fp=#0x300000036b0' 2024-08-31T04:31:04.353 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16161 fp=#0x3000000063a' 2024-08-31T04:31:04.354 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16225 fp=#0x30000003412' 2024-08-31T04:31:04.355 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16289 fp=#0x300000034ce' 2024-08-31T04:31:04.355 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16350 fp=#0x1000000286a' 2024-08-31T04:31:04.356 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16382 fp=#0x1000000284e' 2024-08-31T04:31:04.356 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16414 fp=#0x10000002831' 2024-08-31T04:31:04.356 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16446 fp=#0x30000001cd3' 2024-08-31T04:31:04.357 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16478 fp=#0x100000024c5' 2024-08-31T04:31:04.357 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16510 fp=#0x30000001d1f' 2024-08-31T04:31:04.357 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16542 fp=#0x30000001d33' 2024-08-31T04:31:04.358 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16574 fp=#0x30000001d30' 2024-08-31T04:31:04.358 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16606 fp=#0x100000024e9' 2024-08-31T04:31:04.358 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16637 fp=#0x300000021dd' 2024-08-31T04:31:04.358 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16669 fp=#0x3000000216c' 2024-08-31T04:31:04.359 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16701 fp=#0x30000002103' 2024-08-31T04:31:04.359 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16733 fp=#0x30000002616' 2024-08-31T04:31:04.360 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16829 fp=#0x30000001965' 2024-08-31T04:31:04.361 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16861 fp=#0x300000019ed' 2024-08-31T04:31:04.361 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16893 fp=#0x30000001974' 2024-08-31T04:31:04.361 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16924 fp=#0x30000002b71' 2024-08-31T04:31:04.362 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16956 fp=#0x30000001adb' 2024-08-31T04:31:04.362 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16988 fp=#0x30000002b9f' 2024-08-31T04:31:04.362 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17013 fp=#0x100000036ff' 2024-08-31T04:31:04.363 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17045 fp=#0x100000036e5' 2024-08-31T04:31:04.363 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17077 fp=#0x10000003678' 2024-08-31T04:31:04.363 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17109 fp=#0x100000036ed' 2024-08-31T04:31:04.364 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17141 fp=#0x30000001816' 2024-08-31T04:31:04.364 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17173 fp=#0x300000017f3' 2024-08-31T04:31:04.364 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17205 fp=#0x30000002cc5' 2024-08-31T04:31:04.365 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17237 fp=#0x300000017e1' 2024-08-31T04:31:04.365 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17269 fp=#0x300000017e0' 2024-08-31T04:31:04.365 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17301 fp=#0x30000001730' 2024-08-31T04:31:04.366 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17333 fp=#0x30000003358' 2024-08-31T04:31:04.366 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17365 fp=#0x3000000330d' 2024-08-31T04:31:04.366 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17397 fp=#0x300000023e1' 2024-08-31T04:31:04.368 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17557 fp=#0x30000000dfe' 2024-08-31T04:31:04.368 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17589 fp=#0x30000000e10' 2024-08-31T04:31:04.368 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17621 fp=#0x30000003230' 2024-08-31T04:31:04.369 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17653 fp=#0x300000031b1' 2024-08-31T04:31:04.370 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17813 fp=#0x3000000201c' 2024-08-31T04:31:04.370 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17845 fp=#0x30000001fe9' 2024-08-31T04:31:04.371 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17877 fp=#0x30000002474' 2024-08-31T04:31:04.371 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17909 fp=#0x30000001f45' 2024-08-31T04:31:04.371 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17941 fp=#0x3000000312e' 2024-08-31T04:31:04.372 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17973 fp=#0x3000000314f' 2024-08-31T04:31:04.372 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18005 fp=#0x30000001c3a' 2024-08-31T04:31:04.372 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18037 fp=#0x30000001c10' 2024-08-31T04:31:04.373 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18069 fp=#0x30000001bef' 2024-08-31T04:31:04.373 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18101 fp=#0x30000001be6' 2024-08-31T04:31:04.373 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18133 fp=#0x3000000255e' 2024-08-31T04:31:04.374 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18165 fp=#0x300000025a5' 2024-08-31T04:31:04.374 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18197 fp=#0x30000002540' 2024-08-31T04:31:04.374 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18229 fp=#0x3000000256a' 2024-08-31T04:31:04.375 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18261 fp=#0x3000000288a' 2024-08-31T04:31:04.375 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18293 fp=#0x300000027e3' 2024-08-31T04:31:04.375 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18325 fp=#0x30000002863' 2024-08-31T04:31:04.376 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18357 fp=#0x3000000286b' 2024-08-31T04:31:04.376 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18389 fp=#0x30000002f35' 2024-08-31T04:31:04.376 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18421 fp=#0x30000002f49' 2024-08-31T04:31:04.376 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18453 fp=#0x30000002f25' 2024-08-31T04:31:04.377 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18485 fp=#0x30000002ff9' 2024-08-31T04:31:04.377 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18517 fp=#0x30000002ffa' 2024-08-31T04:31:04.377 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18549 fp=#0x30000002f39' 2024-08-31T04:31:04.378 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18581 fp=#0x10000001d52' 2024-08-31T04:31:04.378 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18613 fp=#0x10000001d7e' 2024-08-31T04:31:04.378 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18645 fp=#0x10000001d61' 2024-08-31T04:31:04.379 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18677 fp=#0x10000001cfb' 2024-08-31T04:31:04.379 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18709 fp=#0x30000001337' 2024-08-31T04:31:04.379 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18741 fp=#0x300000013e3' 2024-08-31T04:31:04.380 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18773 fp=#0x300000013db' 2024-08-31T04:31:04.380 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18805 fp=#0x300000013be' 2024-08-31T04:31:04.380 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18837 fp=#0x300000014e6' 2024-08-31T04:31:04.381 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18869 fp=#0x300000013c3' 2024-08-31T04:31:04.381 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18901 fp=#0x30000001d62' 2024-08-31T04:31:04.381 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18933 fp=#0x3000000106d' 2024-08-31T04:31:04.382 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18965 fp=#0x300000021f4' 2024-08-31T04:31:04.382 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18997 fp=#0x30000001d6a' 2024-08-31T04:31:04.382 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19029 fp=#0x30000001d7e' 2024-08-31T04:31:04.383 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19061 fp=#0x3000000112e' 2024-08-31T04:31:04.383 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19093 fp=#0x3000000113d' 2024-08-31T04:31:04.383 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19125 fp=#0x30000001147' 2024-08-31T04:31:04.384 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19157 fp=#0x300000015e7' 2024-08-31T04:31:04.384 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19189 fp=#0x30000001646' 2024-08-31T04:31:04.384 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19221 fp=#0x3000000158b' 2024-08-31T04:31:04.385 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19285 fp=#0x100000008ed' 2024-08-31T04:31:04.385 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19317 fp=#0x100000008ec' 2024-08-31T04:31:04.386 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19349 fp=#0x10000000ea5' 2024-08-31T04:31:04.386 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19381 fp=#0x100000008e5' 2024-08-31T04:31:04.386 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19413 fp=#0x100000008ca' 2024-08-31T04:31:04.387 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19444 fp=#0x30000000be6' 2024-08-31T04:31:04.387 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19476 fp=#0x30000000bbd' 2024-08-31T04:31:04.387 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19508 fp=#0x30000000b58' 2024-08-31T04:31:04.388 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19540 fp=#0x30000000b60' 2024-08-31T04:31:04.388 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19572 fp=#0x30000000b0b' 2024-08-31T04:31:04.388 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19604 fp=#0x30000000aa3' 2024-08-31T04:31:04.389 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19636 fp=#0x30000000aac' 2024-08-31T04:31:04.389 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19668 fp=#0x30000002d3a' 2024-08-31T04:31:04.389 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19700 fp=#0x30000002c33' 2024-08-31T04:31:04.390 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19732 fp=#0x30000002d4b' 2024-08-31T04:31:04.390 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19764 fp=#0x30000002d59' 2024-08-31T04:31:04.390 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19796 fp=#0x30000002c94' 2024-08-31T04:31:04.391 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19828 fp=#0x30000001173' 2024-08-31T04:31:04.391 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19860 fp=#0x300000011a0' 2024-08-31T04:31:04.391 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19892 fp=#0x300000011dc' 2024-08-31T04:31:04.392 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19924 fp=#0x30000001444' 2024-08-31T04:31:04.392 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19956 fp=#0x30000001430' 2024-08-31T04:31:04.392 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19988 fp=#0x300000013f2' 2024-08-31T04:31:04.393 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20020 fp=#0x3000000142a' 2024-08-31T04:31:04.393 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20052 fp=#0x30000000ff6' 2024-08-31T04:31:04.393 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20084 fp=#0x30000000fbf' 2024-08-31T04:31:04.394 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20116 fp=#0x30000000fc5' 2024-08-31T04:31:04.394 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20148 fp=#0x300000016d7' 2024-08-31T04:31:04.394 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20180 fp=#0x300000016c1' 2024-08-31T04:31:04.395 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20212 fp=#0x300000016ce' 2024-08-31T04:31:04.395 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20244 fp=#0x30000003260' 2024-08-31T04:31:04.395 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20276 fp=#0x30000003191' 2024-08-31T04:31:04.396 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20308 fp=#0x30000003122' 2024-08-31T04:31:04.396 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20340 fp=#0x30000003114' 2024-08-31T04:31:04.396 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20372 fp=#0x3000000307e' 2024-08-31T04:31:04.397 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20404 fp=#0x30000001cc4' 2024-08-31T04:31:04.397 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20436 fp=#0x30000001c68' 2024-08-31T04:31:04.397 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20468 fp=#0x30000001c7a' 2024-08-31T04:31:04.398 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20500 fp=#0x30000001c8d' 2024-08-31T04:31:04.398 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20532 fp=#0x3000000125d' 2024-08-31T04:31:04.398 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20564 fp=#0x3000000122f' 2024-08-31T04:31:04.399 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20596 fp=#0x30000001f64' 2024-08-31T04:31:04.399 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20628 fp=#0x3000000219a' 2024-08-31T04:31:04.400 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20724 fp=#0x3000000217b' 2024-08-31T04:31:04.400 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20756 fp=#0x300000030ec' 2024-08-31T04:31:04.400 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20788 fp=#0x30000003090' 2024-08-31T04:31:04.401 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20820 fp=#0x30000003039' 2024-08-31T04:31:04.402 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20980 fp=#0x300000020d0' 2024-08-31T04:31:04.402 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21012 fp=#0x300000020db' 2024-08-31T04:31:04.403 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21043 fp=#0x300000015f9' 2024-08-31T04:31:04.403 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21075 fp=#0x300000015be' 2024-08-31T04:31:04.403 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21107 fp=#0x3000000157b' 2024-08-31T04:31:04.404 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21171 fp=#0x30000001de2' 2024-08-31T04:31:04.405 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21299 fp=#0x10000003210' 2024-08-31T04:31:04.405 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21331 fp=#0x100000032c3' 2024-08-31T04:31:04.406 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21363 fp=#0x10000003238' 2024-08-31T04:31:04.406 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21395 fp=#0x30000001201' 2024-08-31T04:31:04.406 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21427 fp=#0x10000003229' 2024-08-31T04:31:04.407 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21459 fp=#0x3000000265f' 2024-08-31T04:31:04.407 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21491 fp=#0x30000002644' 2024-08-31T04:31:04.407 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21523 fp=#0x3000000264f' 2024-08-31T04:31:04.408 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21555 fp=#0x300000025f9' 2024-08-31T04:31:04.408 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21587 fp=#0x30000000d44' 2024-08-31T04:31:04.408 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21619 fp=#0x30000000d1d' 2024-08-31T04:31:04.409 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21651 fp=#0x30000000d1b' 2024-08-31T04:31:04.409 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21683 fp=#0x300000036bc' 2024-08-31T04:31:04.409 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21715 fp=#0x30000000ca8' 2024-08-31T04:31:04.410 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21747 fp=#0x30000000cd0' 2024-08-31T04:31:04.410 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21779 fp=#0x30000000ab1' 2024-08-31T04:31:04.410 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21811 fp=#0x30000000b2c' 2024-08-31T04:31:04.411 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21843 fp=#0x30000000ac4' 2024-08-31T04:31:04.411 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21875 fp=#0x30000000aa6' 2024-08-31T04:31:04.411 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21907 fp=#0x3000000056f' 2024-08-31T04:31:04.412 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21971 fp=#0x3000000055d' 2024-08-31T04:31:04.412 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22034 fp=#0x300000018f4' 2024-08-31T04:31:04.413 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22066 fp=#0x30000001901' 2024-08-31T04:31:04.413 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22098 fp=#0x300000018fb' 2024-08-31T04:31:04.413 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22130 fp=#0x30000002921' 2024-08-31T04:31:04.414 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22162 fp=#0x300000029aa' 2024-08-31T04:31:04.414 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22194 fp=#0x3000000293e' 2024-08-31T04:31:04.414 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22226 fp=#0x300000028bc' 2024-08-31T04:31:04.415 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22258 fp=#0x30000002087' 2024-08-31T04:31:04.415 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22290 fp=#0x30000002030' 2024-08-31T04:31:04.415 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22322 fp=#0x30000002065' 2024-08-31T04:31:04.416 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22354 fp=#0x30000002015' 2024-08-31T04:31:04.416 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22450 fp=#0x300000004a1' 2024-08-31T04:31:04.417 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22514 fp=#0x3000000042b' 2024-08-31T04:31:04.417 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22539 fp=#0x30000002c29' 2024-08-31T04:31:04.418 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22571 fp=#0x30000003756' 2024-08-31T04:31:04.418 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22602 fp=#0x30000001495' 2024-08-31T04:31:04.418 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22634 fp=#0x300000033c5' 2024-08-31T04:31:04.419 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22666 fp=#0x30000001498' 2024-08-31T04:31:04.419 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:9796 fp=#0x10000002811' 2024-08-31T04:31:04.420 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:9828 fp=#0x30000001275' 2024-08-31T04:31:04.421 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:9956 fp=#0x3000000040f' 2024-08-31T04:31:04.425 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:10468 fp=#0x30000002517' 2024-08-31T04:31:04.427 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:10724 fp=#0x30000001fd0' 2024-08-31T04:31:04.428 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:10788 fp=#0x30000000d89' 2024-08-31T04:31:04.435 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:11780 fp=#0x30000000c3e' 2024-08-31T04:31:04.435 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:11812 fp=#0x300000023c3' 2024-08-31T04:31:04.436 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:11876 fp=#0x300000023d0' 2024-08-31T04:31:04.436 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:11908 fp=#0x3000000105a' 2024-08-31T04:31:04.437 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:11940 fp=#0x300000011a5' 2024-08-31T04:31:04.437 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:11972 fp=#0x30000001161' 2024-08-31T04:31:04.437 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12004 fp=#0x30000001014' 2024-08-31T04:31:04.438 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12036 fp=#0x300000031ed' 2024-08-31T04:31:04.438 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12068 fp=#0x30000001012' 2024-08-31T04:31:04.438 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12100 fp=#0x30000001007' 2024-08-31T04:31:04.439 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12132 fp=#0x30000001090' 2024-08-31T04:31:04.440 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12228 fp=#0x300000009f0' 2024-08-31T04:31:04.441 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12356 fp=#0x300000009be' 2024-08-31T04:31:04.442 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12484 fp=#0x30000000f53' 2024-08-31T04:31:04.442 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12516 fp=#0x30000000f47' 2024-08-31T04:31:04.442 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12548 fp=#0x30000000f69' 2024-08-31T04:31:04.443 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12580 fp=#0x300000033ce' 2024-08-31T04:31:04.443 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12612 fp=#0x30000000ff5' 2024-08-31T04:31:04.443 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12644 fp=#0x30000000e2f' 2024-08-31T04:31:04.444 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12676 fp=#0x30000000ff7' 2024-08-31T04:31:04.444 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12708 fp=#0x30000000fe5' 2024-08-31T04:31:04.444 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12740 fp=#0x30000000e44' 2024-08-31T04:31:04.445 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12772 fp=#0x30000002273' 2024-08-31T04:31:04.445 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12804 fp=#0x30000000e4f' 2024-08-31T04:31:04.445 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12836 fp=#0x100000043f8' 2024-08-31T04:31:04.446 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12868 fp=#0x100000042ca' 2024-08-31T04:31:04.446 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12900 fp=#0x30000002835' 2024-08-31T04:31:04.447 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12932 fp=#0x10000004219' 2024-08-31T04:31:04.447 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12964 fp=#0x10000004383' 2024-08-31T04:31:04.447 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12996 fp=#0x10000004214' 2024-08-31T04:31:04.448 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13028 fp=#0x3000000281d' 2024-08-31T04:31:04.448 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13060 fp=#0x1000000421f' 2024-08-31T04:31:04.448 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13092 fp=#0x300000030c4' 2024-08-31T04:31:04.449 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13124 fp=#0x3000000313c' 2024-08-31T04:31:04.449 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13156 fp=#0x30000003146' 2024-08-31T04:31:04.450 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13220 fp=#0x30000002f6a' 2024-08-31T04:31:04.450 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13316 fp=#0x300000008fe' 2024-08-31T04:31:04.451 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13348 fp=#0x300000008f7' 2024-08-31T04:31:04.451 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13380 fp=#0x300000008dc' 2024-08-31T04:31:04.451 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13412 fp=#0x30000002284' 2024-08-31T04:31:04.451 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13444 fp=#0x30000002227' 2024-08-31T04:31:04.452 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13476 fp=#0x3000000224c' 2024-08-31T04:31:04.452 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13508 fp=#0x30000000888' 2024-08-31T04:31:04.452 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13540 fp=#0x300000008ed' 2024-08-31T04:31:04.453 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13572 fp=#0x300000032eb' 2024-08-31T04:31:04.453 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13604 fp=#0x30000003331' 2024-08-31T04:31:04.453 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13636 fp=#0x30000003318' 2024-08-31T04:31:04.454 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13668 fp=#0x3000000294d' 2024-08-31T04:31:04.454 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13700 fp=#0x300000028f2' 2024-08-31T04:31:04.454 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13732 fp=#0x30000002976' 2024-08-31T04:31:04.455 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13764 fp=#0x300000029b9' 2024-08-31T04:31:04.455 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13796 fp=#0x3000000297e' 2024-08-31T04:31:04.455 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13828 fp=#0x30000002a00' 2024-08-31T04:31:04.456 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13860 fp=#0x300000029c8' 2024-08-31T04:31:04.456 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13892 fp=#0x10000003bb1' 2024-08-31T04:31:04.456 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13924 fp=#0x10000003b9a' 2024-08-31T04:31:04.457 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13988 fp=#0x10000003c21' 2024-08-31T04:31:04.457 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14020 fp=#0x10000003da6' 2024-08-31T04:31:04.457 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14052 fp=#0x30000000c83' 2024-08-31T04:31:04.458 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14084 fp=#0x30000000c58' 2024-08-31T04:31:04.458 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14116 fp=#0x30000000c67' 2024-08-31T04:31:04.458 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14148 fp=#0x300000017c7' 2024-08-31T04:31:04.459 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14180 fp=#0x3000000174a' 2024-08-31T04:31:04.459 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14244 fp=#0x3000000248e' 2024-08-31T04:31:04.460 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14308 fp=#0x3000000237f' 2024-08-31T04:31:04.460 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14404 fp=#0x30000000ccd' 2024-08-31T04:31:04.461 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14436 fp=#0x30000000d7f' 2024-08-31T04:31:04.461 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14468 fp=#0x30000002397' 2024-08-31T04:31:04.462 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14500 fp=#0x30000000d97' 2024-08-31T04:31:04.462 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14532 fp=#0x30000000cbb' 2024-08-31T04:31:04.462 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14564 fp=#0x30000000cd3' 2024-08-31T04:31:04.462 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14596 fp=#0x30000000d6d' 2024-08-31T04:31:04.463 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14628 fp=#0x30000002f9f' 2024-08-31T04:31:04.463 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14660 fp=#0x10000002477' 2024-08-31T04:31:04.463 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14692 fp=#0x1000000242c' 2024-08-31T04:31:04.464 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14724 fp=#0x10000002471' 2024-08-31T04:31:04.464 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14756 fp=#0x30000002f9a' 2024-08-31T04:31:04.464 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14787 fp=#0x10000003c3f' 2024-08-31T04:31:04.465 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14819 fp=#0x10000003bb4' 2024-08-31T04:31:04.465 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14851 fp=#0x30000000a36' 2024-08-31T04:31:04.465 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14883 fp=#0x300000009f1' 2024-08-31T04:31:04.466 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14915 fp=#0x3000000099b' 2024-08-31T04:31:04.466 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14947 fp=#0x30000000a01' 2024-08-31T04:31:04.466 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14979 fp=#0x300000016ab' 2024-08-31T04:31:04.467 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15011 fp=#0x30000001655' 2024-08-31T04:31:04.467 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15043 fp=#0x300000016ad' 2024-08-31T04:31:04.467 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15075 fp=#0x3000000155e' 2024-08-31T04:31:04.468 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15107 fp=#0x300000014e5' 2024-08-31T04:31:04.468 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15139 fp=#0x300000033e5' 2024-08-31T04:31:04.468 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15171 fp=#0x30000003381' 2024-08-31T04:31:04.468 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15203 fp=#0x30000002e5c' 2024-08-31T04:31:04.469 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15235 fp=#0x30000002ef4' 2024-08-31T04:31:04.469 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15267 fp=#0x30000002e6e' 2024-08-31T04:31:04.469 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15299 fp=#0x30000002eb9' 2024-08-31T04:31:04.470 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15331 fp=#0x30000002efb' 2024-08-31T04:31:04.470 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15363 fp=#0x30000002ef0' 2024-08-31T04:31:04.470 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15395 fp=#0x300000032ca' 2024-08-31T04:31:04.471 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15427 fp=#0x30000000ed4' 2024-08-31T04:31:04.471 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15459 fp=#0x30000000ef8' 2024-08-31T04:31:04.471 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15491 fp=#0x30000000f0a' 2024-08-31T04:31:04.472 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15523 fp=#0x30000000ed2' 2024-08-31T04:31:04.472 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15555 fp=#0x30000000f28' 2024-08-31T04:31:04.472 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15587 fp=#0x30000001dc1' 2024-08-31T04:31:04.473 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15619 fp=#0x300000004f0' 2024-08-31T04:31:04.473 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15715 fp=#0x300000005fd' 2024-08-31T04:31:04.474 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15779 fp=#0x3000000053b' 2024-08-31T04:31:04.474 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15811 fp=#0x300000005e2' 2024-08-31T04:31:04.475 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15842 fp=#0x30000001291' 2024-08-31T04:31:04.475 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15874 fp=#0x30000001277' 2024-08-31T04:31:04.475 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15906 fp=#0x300000012dd' 2024-08-31T04:31:04.476 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15938 fp=#0x300000012c7' 2024-08-31T04:31:04.476 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15970 fp=#0x30000001296' 2024-08-31T04:31:04.476 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16002 fp=#0x3000000109e' 2024-08-31T04:31:04.477 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16034 fp=#0x3000000102d' 2024-08-31T04:31:04.477 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16066 fp=#0x3000000183a' 2024-08-31T04:31:04.477 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16098 fp=#0x30000002dfb' 2024-08-31T04:31:04.478 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16130 fp=#0x3000000351d' 2024-08-31T04:31:04.478 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16162 fp=#0x300000034ad' 2024-08-31T04:31:04.479 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16226 fp=#0x30000003518' 2024-08-31T04:31:04.479 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16258 fp=#0x300000005e5' 2024-08-31T04:31:04.479 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16290 fp=#0x300000033fa' 2024-08-31T04:31:04.480 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16351 fp=#0x1000000283b' 2024-08-31T04:31:04.480 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16383 fp=#0x30000002073' 2024-08-31T04:31:04.480 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16415 fp=#0x1000000282d' 2024-08-31T04:31:04.481 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16447 fp=#0x10000002545' 2024-08-31T04:31:04.481 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16479 fp=#0x30000001cca' 2024-08-31T04:31:04.481 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16511 fp=#0x100000024db' 2024-08-31T04:31:04.482 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16543 fp=#0x30000001d10' 2024-08-31T04:31:04.482 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16575 fp=#0x3000000040b' 2024-08-31T04:31:04.482 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16607 fp=#0x10000002519' 2024-08-31T04:31:04.483 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16638 fp=#0x3000000210e' 2024-08-31T04:31:04.483 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16670 fp=#0x30000002173' 2024-08-31T04:31:04.483 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16702 fp=#0x30000002106' 2024-08-31T04:31:04.484 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16734 fp=#0x300000003f7' 2024-08-31T04:31:04.484 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16798 fp=#0x30000001a2e' 2024-08-31T04:31:04.485 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16830 fp=#0x30000001976' 2024-08-31T04:31:04.485 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16862 fp=#0x30000001a00' 2024-08-31T04:31:04.486 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16925 fp=#0x30000002b72' 2024-08-31T04:31:04.486 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16957 fp=#0x30000001adf' 2024-08-31T04:31:04.486 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16989 fp=#0x30000001a86' 2024-08-31T04:31:04.486 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17014 fp=#0x100000036f3' 2024-08-31T04:31:04.487 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17046 fp=#0x100000036d2' 2024-08-31T04:31:04.487 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17078 fp=#0x10000003686' 2024-08-31T04:31:04.487 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17110 fp=#0x10000003660' 2024-08-31T04:31:04.488 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17142 fp=#0x30000001737' 2024-08-31T04:31:04.488 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17174 fp=#0x30000001807' 2024-08-31T04:31:04.488 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17206 fp=#0x300000017e2' 2024-08-31T04:31:04.489 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17238 fp=#0x3000000180d' 2024-08-31T04:31:04.489 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17270 fp=#0x300000017e9' 2024-08-31T04:31:04.489 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17302 fp=#0x3000000176e' 2024-08-31T04:31:04.490 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17334 fp=#0x30000003356' 2024-08-31T04:31:04.490 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17366 fp=#0x30000003354' 2024-08-31T04:31:04.491 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17526 fp=#0x30000000e06' 2024-08-31T04:31:04.492 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17558 fp=#0x30000000df0' 2024-08-31T04:31:04.492 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17590 fp=#0x300000031f9' 2024-08-31T04:31:04.492 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17622 fp=#0x30000000df2' 2024-08-31T04:31:04.493 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17654 fp=#0x300000031c0' 2024-08-31T04:31:04.494 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17814 fp=#0x30000001f44' 2024-08-31T04:31:04.494 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17846 fp=#0x30000001fce' 2024-08-31T04:31:04.495 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17878 fp=#0x30000001fd4' 2024-08-31T04:31:04.495 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17910 fp=#0x30000002041' 2024-08-31T04:31:04.495 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17942 fp=#0x300000030af' 2024-08-31T04:31:04.495 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17974 fp=#0x300000030f2' 2024-08-31T04:31:04.496 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18006 fp=#0x30000001be8' 2024-08-31T04:31:04.496 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18038 fp=#0x30000001c07' 2024-08-31T04:31:04.496 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18070 fp=#0x30000001c0b' 2024-08-31T04:31:04.497 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18102 fp=#0x30000002e87' 2024-08-31T04:31:04.497 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18134 fp=#0x3000000258e' 2024-08-31T04:31:04.497 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18166 fp=#0x30000002578' 2024-08-31T04:31:04.498 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18198 fp=#0x3000000255c' 2024-08-31T04:31:04.498 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18230 fp=#0x30000002576' 2024-08-31T04:31:04.498 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18262 fp=#0x300000027b1' 2024-08-31T04:31:04.498 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18294 fp=#0x300000027f4' 2024-08-31T04:31:04.499 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18326 fp=#0x300000027f3' 2024-08-31T04:31:04.499 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18358 fp=#0x300000027d7' 2024-08-31T04:31:04.500 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18390 fp=#0x30000002f66' 2024-08-31T04:31:04.500 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18422 fp=#0x30000003021' 2024-08-31T04:31:04.500 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18454 fp=#0x30000002f2f' 2024-08-31T04:31:04.500 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18486 fp=#0x30000002f3a' 2024-08-31T04:31:04.501 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18518 fp=#0x30000002fe8' 2024-08-31T04:31:04.501 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18550 fp=#0x30000002f3f' 2024-08-31T04:31:04.501 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18582 fp=#0x10000001d66' 2024-08-31T04:31:04.502 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18646 fp=#0x10000001d14' 2024-08-31T04:31:04.502 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18678 fp=#0x10000001d13' 2024-08-31T04:31:04.503 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18710 fp=#0x30000001363' 2024-08-31T04:31:04.503 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18742 fp=#0x300000013c9' 2024-08-31T04:31:04.503 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18774 fp=#0x300000013d3' 2024-08-31T04:31:04.503 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18806 fp=#0x3000000139e' 2024-08-31T04:31:04.504 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18838 fp=#0x30000001389' 2024-08-31T04:31:04.504 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18870 fp=#0x30000001395' 2024-08-31T04:31:04.504 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18902 fp=#0x30000001d65' 2024-08-31T04:31:04.505 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18934 fp=#0x30000001d5c' 2024-08-31T04:31:04.505 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18966 fp=#0x300000010a6' 2024-08-31T04:31:04.505 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18998 fp=#0x30000001d6c' 2024-08-31T04:31:04.506 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19030 fp=#0x300000010d6' 2024-08-31T04:31:04.506 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19062 fp=#0x300000011f9' 2024-08-31T04:31:04.506 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19094 fp=#0x30000001152' 2024-08-31T04:31:04.507 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19126 fp=#0x300000011d6' 2024-08-31T04:31:04.507 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19158 fp=#0x3000000162c' 2024-08-31T04:31:04.507 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19190 fp=#0x30000001669' 2024-08-31T04:31:04.507 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19222 fp=#0x3000000159c' 2024-08-31T04:31:04.508 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19254 fp=#0x300000015aa' 2024-08-31T04:31:04.508 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19286 fp=#0x100000008b1' 2024-08-31T04:31:04.508 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19318 fp=#0x100000008da' 2024-08-31T04:31:04.509 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19350 fp=#0x30000002bc6' 2024-08-31T04:31:04.509 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19382 fp=#0x100000008ce' 2024-08-31T04:31:04.509 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19414 fp=#0x100000008d7' 2024-08-31T04:31:04.510 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19445 fp=#0x30000000bfa' 2024-08-31T04:31:04.510 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19509 fp=#0x30000000bcb' 2024-08-31T04:31:04.510 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19541 fp=#0x30000000b63' 2024-08-31T04:31:04.511 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19573 fp=#0x30000000afa' 2024-08-31T04:31:04.511 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19605 fp=#0x30000000ac5' 2024-08-31T04:31:04.511 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19637 fp=#0x30000000b00' 2024-08-31T04:31:04.512 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19669 fp=#0x30000002c26' 2024-08-31T04:31:04.512 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19701 fp=#0x30000002de2' 2024-08-31T04:31:04.512 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19733 fp=#0x30000002ddf' 2024-08-31T04:31:04.513 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19765 fp=#0x30000002d06' 2024-08-31T04:31:04.513 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19797 fp=#0x30000002d00' 2024-08-31T04:31:04.513 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19829 fp=#0x30000001132' 2024-08-31T04:31:04.514 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19861 fp=#0x30000001447' 2024-08-31T04:31:04.514 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19893 fp=#0x30000001194' 2024-08-31T04:31:04.514 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19925 fp=#0x300000011c1' 2024-08-31T04:31:04.515 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19957 fp=#0x30000001d07' 2024-08-31T04:31:04.515 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19989 fp=#0x3000000140b' 2024-08-31T04:31:04.515 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20021 fp=#0x300000013fd' 2024-08-31T04:31:04.516 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20053 fp=#0x30000000f9b' 2024-08-31T04:31:04.516 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20085 fp=#0x30000000fa0' 2024-08-31T04:31:04.516 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20117 fp=#0x30000000fcd' 2024-08-31T04:31:04.517 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20149 fp=#0x300000016f4' 2024-08-31T04:31:04.517 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20181 fp=#0x300000016ee' 2024-08-31T04:31:04.517 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20213 fp=#0x300000016f9' 2024-08-31T04:31:04.517 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20245 fp=#0x30000003133' 2024-08-31T04:31:04.518 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20277 fp=#0x3000000307f' 2024-08-31T04:31:04.518 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20309 fp=#0x30000003072' 2024-08-31T04:31:04.518 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20341 fp=#0x30000003087' 2024-08-31T04:31:04.519 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20373 fp=#0x30000003052' 2024-08-31T04:31:04.519 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20405 fp=#0x30000001cb8' 2024-08-31T04:31:04.519 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20437 fp=#0x30000001c89' 2024-08-31T04:31:04.520 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20469 fp=#0x30000001ce0' 2024-08-31T04:31:04.520 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20501 fp=#0x30000001c6d' 2024-08-31T04:31:04.520 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20533 fp=#0x30000001254' 2024-08-31T04:31:04.521 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20565 fp=#0x30000001211' 2024-08-31T04:31:04.521 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20597 fp=#0x3000000125a' 2024-08-31T04:31:04.521 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20629 fp=#0x3000000216a' 2024-08-31T04:31:04.522 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20725 fp=#0x30000002163' 2024-08-31T04:31:04.522 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20757 fp=#0x1000000383d' 2024-08-31T04:31:04.523 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20789 fp=#0x1000000381b' 2024-08-31T04:31:04.523 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20821 fp=#0x30000003073' 2024-08-31T04:31:04.524 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20917 fp=#0x300000030fe' 2024-08-31T04:31:04.524 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20949 fp=#0x30000003054' 2024-08-31T04:31:04.524 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20981 fp=#0x300000020e7' 2024-08-31T04:31:04.525 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21013 fp=#0x300000027ac' 2024-08-31T04:31:04.525 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21044 fp=#0x300000016a5' 2024-08-31T04:31:04.525 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21076 fp=#0x300000015d8' 2024-08-31T04:31:04.526 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21108 fp=#0x30000001615' 2024-08-31T04:31:04.527 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21300 fp=#0x1000000329b' 2024-08-31T04:31:04.527 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21332 fp=#0x10000003369' 2024-08-31T04:31:04.528 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21364 fp=#0x10000003306' 2024-08-31T04:31:04.528 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21396 fp=#0x1000000336e' 2024-08-31T04:31:04.529 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21428 fp=#0x1000000320e' 2024-08-31T04:31:04.529 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21460 fp=#0x3000000262a' 2024-08-31T04:31:04.529 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21492 fp=#0x3000000271c' 2024-08-31T04:31:04.530 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21524 fp=#0x30000002601' 2024-08-31T04:31:04.530 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21556 fp=#0x3000000269b' 2024-08-31T04:31:04.530 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21588 fp=#0x30000003687' 2024-08-31T04:31:04.530 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21620 fp=#0x300000036a8' 2024-08-31T04:31:04.531 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21652 fp=#0x300000036e8' 2024-08-31T04:31:04.531 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21684 fp=#0x300000036d0' 2024-08-31T04:31:04.531 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21716 fp=#0x30000000cc6' 2024-08-31T04:31:04.532 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21748 fp=#0x3000000370e' 2024-08-31T04:31:04.532 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21780 fp=#0x30000000b4c' 2024-08-31T04:31:04.532 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21812 fp=#0x30000000a8e' 2024-08-31T04:31:04.533 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21844 fp=#0x30000002512' 2024-08-31T04:31:04.533 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21876 fp=#0x30000000b01' 2024-08-31T04:31:04.533 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21908 fp=#0x30000000564' 2024-08-31T04:31:04.534 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21940 fp=#0x300000004f9' 2024-08-31T04:31:04.534 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21972 fp=#0x30000000906' 2024-08-31T04:31:04.534 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22035 fp=#0x3000000192e' 2024-08-31T04:31:04.535 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22067 fp=#0x30000001913' 2024-08-31T04:31:04.535 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22099 fp=#0x30000002f86' 2024-08-31T04:31:04.535 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22131 fp=#0x300000028d9' 2024-08-31T04:31:04.536 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22163 fp=#0x3000000290b' 2024-08-31T04:31:04.536 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22195 fp=#0x3000000296d' 2024-08-31T04:31:04.536 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22227 fp=#0x30000002927' 2024-08-31T04:31:04.537 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22259 fp=#0x30000001fd6' 2024-08-31T04:31:04.537 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22291 fp=#0x3000000206f' 2024-08-31T04:31:04.537 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22323 fp=#0x3000000200f' 2024-08-31T04:31:04.538 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22355 fp=#0x30000002085' 2024-08-31T04:31:04.538 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22387 fp=#0x30000000413' 2024-08-31T04:31:04.538 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22419 fp=#0x3000000048f' 2024-08-31T04:31:04.539 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22540 fp=#0x30000002c1e' 2024-08-31T04:31:04.540 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22572 fp=#0x30000002c06' 2024-08-31T04:31:04.540 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22603 fp=#0x3000000338f' 2024-08-31T04:31:04.540 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22635 fp=#0x300000033ac' 2024-08-31T04:31:04.542 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:9797 fp=#0x30000000881' 2024-08-31T04:31:04.542 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:9829 fp=#0x30000001001' 2024-08-31T04:31:04.543 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:9925 fp=#0x30000002bf3' 2024-08-31T04:31:04.543 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:9957 fp=#0x3000000199f' 2024-08-31T04:31:04.556 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:11781 fp=#0x30000000bb2' 2024-08-31T04:31:04.557 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:11909 fp=#0x3000000119c' 2024-08-31T04:31:04.557 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:11941 fp=#0x3000000120e' 2024-08-31T04:31:04.557 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:11973 fp=#0x3000000100b' 2024-08-31T04:31:04.558 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12005 fp=#0x3000000114a' 2024-08-31T04:31:04.558 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12069 fp=#0x3000000107b' 2024-08-31T04:31:04.558 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12101 fp=#0x3000000108d' 2024-08-31T04:31:04.559 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12133 fp=#0x30000001099' 2024-08-31T04:31:04.559 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12229 fp=#0x30000000993' 2024-08-31T04:31:04.561 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12357 fp=#0x3000000090e' 2024-08-31T04:31:04.561 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12389 fp=#0x30000000994' 2024-08-31T04:31:04.561 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12421 fp=#0x30000002e43' 2024-08-31T04:31:04.562 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12485 fp=#0x30000000f83' 2024-08-31T04:31:04.562 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12517 fp=#0x30000000f58' 2024-08-31T04:31:04.562 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12549 fp=#0x30000000f61' 2024-08-31T04:31:04.563 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12581 fp=#0x30000000fce' 2024-08-31T04:31:04.563 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12613 fp=#0x30000000e32' 2024-08-31T04:31:04.563 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12645 fp=#0x3000000228a' 2024-08-31T04:31:04.564 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12677 fp=#0x30000003391' 2024-08-31T04:31:04.564 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12709 fp=#0x30000000e7c' 2024-08-31T04:31:04.564 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12741 fp=#0x30000001fbe' 2024-08-31T04:31:04.565 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12773 fp=#0x30000000e1d' 2024-08-31T04:31:04.565 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12805 fp=#0x30000000e67' 2024-08-31T04:31:04.565 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12837 fp=#0x1000000420b' 2024-08-31T04:31:04.566 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12869 fp=#0x10000004217' 2024-08-31T04:31:04.566 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12933 fp=#0x10000004228' 2024-08-31T04:31:04.567 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12965 fp=#0x1000000440b' 2024-08-31T04:31:04.567 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12997 fp=#0x10000004354' 2024-08-31T04:31:04.567 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13029 fp=#0x1000000432a' 2024-08-31T04:31:04.568 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13061 fp=#0x10000004224' 2024-08-31T04:31:04.568 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13093 fp=#0x30000003119' 2024-08-31T04:31:04.568 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13125 fp=#0x300000030ca' 2024-08-31T04:31:04.569 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13157 fp=#0x300000031a4' 2024-08-31T04:31:04.570 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13285 fp=#0x300000008a6' 2024-08-31T04:31:04.570 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13317 fp=#0x30000000891' 2024-08-31T04:31:04.570 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13349 fp=#0x300000009a8' 2024-08-31T04:31:04.571 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13381 fp=#0x30000002439' 2024-08-31T04:31:04.571 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13413 fp=#0x300000008ad' 2024-08-31T04:31:04.571 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13445 fp=#0x300000008b0' 2024-08-31T04:31:04.572 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13477 fp=#0x300000008e2' 2024-08-31T04:31:04.572 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13509 fp=#0x3000000220d' 2024-08-31T04:31:04.572 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13541 fp=#0x3000000224b' 2024-08-31T04:31:04.573 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13573 fp=#0x300000032ef' 2024-08-31T04:31:04.573 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13605 fp=#0x30000003301' 2024-08-31T04:31:04.573 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13637 fp=#0x30000003286' 2024-08-31T04:31:04.574 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13669 fp=#0x30000002a1b' 2024-08-31T04:31:04.574 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13701 fp=#0x300000028f7' 2024-08-31T04:31:04.574 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13733 fp=#0x30000002947' 2024-08-31T04:31:04.575 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13765 fp=#0x300000029ea' 2024-08-31T04:31:04.575 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13797 fp=#0x30000002a15' 2024-08-31T04:31:04.576 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13829 fp=#0x300000029ef' 2024-08-31T04:31:04.576 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13861 fp=#0x10000003dcc' 2024-08-31T04:31:04.576 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13893 fp=#0x10000003def' 2024-08-31T04:31:04.577 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13925 fp=#0x10000003c48' 2024-08-31T04:31:04.577 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13989 fp=#0x10000003bfc' 2024-08-31T04:31:04.577 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14021 fp=#0x10000003ec2' 2024-08-31T04:31:04.578 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14053 fp=#0x30000000c64' 2024-08-31T04:31:04.578 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14085 fp=#0x30000000c84' 2024-08-31T04:31:04.578 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14117 fp=#0x30000000c56' 2024-08-31T04:31:04.579 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14149 fp=#0x300000017c1' 2024-08-31T04:31:04.579 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14181 fp=#0x3000000246d' 2024-08-31T04:31:04.579 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14213 fp=#0x30000002430' 2024-08-31T04:31:04.579 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14245 fp=#0x30000002468' 2024-08-31T04:31:04.580 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14309 fp=#0x30000001c4c' 2024-08-31T04:31:04.581 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14373 fp=#0x3000000237e' 2024-08-31T04:31:04.581 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14405 fp=#0x30000000c9d' 2024-08-31T04:31:04.581 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14437 fp=#0x30000000d63' 2024-08-31T04:31:04.581 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14469 fp=#0x300000023ab' 2024-08-31T04:31:04.582 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14501 fp=#0x30000000d4f' 2024-08-31T04:31:04.582 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14533 fp=#0x30000000cf4' 2024-08-31T04:31:04.583 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14565 fp=#0x30000000d7a' 2024-08-31T04:31:04.583 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14597 fp=#0x10000002421' 2024-08-31T04:31:04.583 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14629 fp=#0x1000000241d' 2024-08-31T04:31:04.583 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14661 fp=#0x30000002f99' 2024-08-31T04:31:04.584 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14693 fp=#0x30000002fac' 2024-08-31T04:31:04.584 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14725 fp=#0x30000002f8c' 2024-08-31T04:31:04.584 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14757 fp=#0x30000002fa3' 2024-08-31T04:31:04.585 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14788 fp=#0x300000011b2' 2024-08-31T04:31:04.585 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14820 fp=#0x10000003bf9' 2024-08-31T04:31:04.585 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14852 fp=#0x30000000a46' 2024-08-31T04:31:04.586 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14884 fp=#0x30000000a16' 2024-08-31T04:31:04.586 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14916 fp=#0x300000009fe' 2024-08-31T04:31:04.586 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14948 fp=#0x3000000098d' 2024-08-31T04:31:04.586 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14980 fp=#0x30000001671' 2024-08-31T04:31:04.587 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15012 fp=#0x30000001501' 2024-08-31T04:31:04.587 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15044 fp=#0x300000015f1' 2024-08-31T04:31:04.587 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15076 fp=#0x300000015df' 2024-08-31T04:31:04.588 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15108 fp=#0x3000000160d' 2024-08-31T04:31:04.588 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15140 fp=#0x30000003435' 2024-08-31T04:31:04.588 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15172 fp=#0x30000003426' 2024-08-31T04:31:04.589 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15204 fp=#0x30000002e9b' 2024-08-31T04:31:04.589 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15236 fp=#0x30000002e63' 2024-08-31T04:31:04.589 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15268 fp=#0x30000002eb6' 2024-08-31T04:31:04.590 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15300 fp=#0x30000002e76' 2024-08-31T04:31:04.590 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15332 fp=#0x30000002e84' 2024-08-31T04:31:04.590 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15364 fp=#0x30000002e67' 2024-08-31T04:31:04.590 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15396 fp=#0x300000032d5' 2024-08-31T04:31:04.591 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15428 fp=#0x30000000f2f' 2024-08-31T04:31:04.591 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15460 fp=#0x30000000f15' 2024-08-31T04:31:04.591 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15492 fp=#0x30000000f02' 2024-08-31T04:31:04.592 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15524 fp=#0x30000001dad' 2024-08-31T04:31:04.592 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15556 fp=#0x30000000ec5' 2024-08-31T04:31:04.592 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15588 fp=#0x30000000f2d' 2024-08-31T04:31:04.593 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15620 fp=#0x300000005ef' 2024-08-31T04:31:04.593 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15652 fp=#0x300000005b5' 2024-08-31T04:31:04.594 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15748 fp=#0x300000005d3' 2024-08-31T04:31:04.594 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15843 fp=#0x300000012e5' 2024-08-31T04:31:04.595 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15875 fp=#0x300000012cf' 2024-08-31T04:31:04.595 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15907 fp=#0x300000012ef' 2024-08-31T04:31:04.595 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15939 fp=#0x300000012a0' 2024-08-31T04:31:04.596 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15971 fp=#0x3000000127f' 2024-08-31T04:31:04.596 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16003 fp=#0x3000000109b' 2024-08-31T04:31:04.596 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16035 fp=#0x30000001035' 2024-08-31T04:31:04.597 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16067 fp=#0x30000001825' 2024-08-31T04:31:04.597 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16099 fp=#0x30000001839' 2024-08-31T04:31:04.597 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16163 fp=#0x30000001de0' 2024-08-31T04:31:04.598 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16195 fp=#0x30000003505' 2024-08-31T04:31:04.598 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16291 fp=#0x30000003410' 2024-08-31T04:31:04.599 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16352 fp=#0x10000002850' 2024-08-31T04:31:04.599 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16384 fp=#0x10000002819' 2024-08-31T04:31:04.600 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16416 fp=#0x10000002833' 2024-08-31T04:31:04.600 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16448 fp=#0x100000024f3' 2024-08-31T04:31:04.600 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16480 fp=#0x10000002521' 2024-08-31T04:31:04.600 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16512 fp=#0x100000024ef' 2024-08-31T04:31:04.601 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16544 fp=#0x100000024f7' 2024-08-31T04:31:04.601 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16576 fp=#0x100000024eb' 2024-08-31T04:31:04.601 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16608 fp=#0x1000000252f' 2024-08-31T04:31:04.602 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16639 fp=#0x30000002a8b' 2024-08-31T04:31:04.602 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16671 fp=#0x30000002231' 2024-08-31T04:31:04.602 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16703 fp=#0x3000000220c' 2024-08-31T04:31:04.603 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16735 fp=#0x30000001f2c' 2024-08-31T04:31:04.603 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16799 fp=#0x30000001a3c' 2024-08-31T04:31:04.603 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16831 fp=#0x30000001951' 2024-08-31T04:31:04.604 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16863 fp=#0x300000019b7' 2024-08-31T04:31:04.604 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16895 fp=#0x30000001a0f' 2024-08-31T04:31:04.604 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16926 fp=#0x30000001ae9' 2024-08-31T04:31:04.605 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16958 fp=#0x30000002b62' 2024-08-31T04:31:04.605 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16990 fp=#0x30000001aea' 2024-08-31T04:31:04.605 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17015 fp=#0x10000003602' 2024-08-31T04:31:04.606 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17047 fp=#0x100000036bc' 2024-08-31T04:31:04.606 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17079 fp=#0x1000000362a' 2024-08-31T04:31:04.606 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17111 fp=#0x1000000361e' 2024-08-31T04:31:04.607 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17143 fp=#0x300000017af' 2024-08-31T04:31:04.607 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17175 fp=#0x30000001710' 2024-08-31T04:31:04.607 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17207 fp=#0x3000000171a' 2024-08-31T04:31:04.607 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17239 fp=#0x300000017d2' 2024-08-31T04:31:04.608 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17271 fp=#0x300000017bf' 2024-08-31T04:31:04.608 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17303 fp=#0x300000017fd' 2024-08-31T04:31:04.608 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17335 fp=#0x30000003367' 2024-08-31T04:31:04.609 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17367 fp=#0x30000003312' 2024-08-31T04:31:04.610 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17527 fp=#0x300000031bc' 2024-08-31T04:31:04.610 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17559 fp=#0x30000000ddd' 2024-08-31T04:31:04.611 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17591 fp=#0x30000000db9' 2024-08-31T04:31:04.611 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17623 fp=#0x30000000dc3' 2024-08-31T04:31:04.611 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17655 fp=#0x30000000dd1' 2024-08-31T04:31:04.613 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17815 fp=#0x30000002004' 2024-08-31T04:31:04.613 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17847 fp=#0x30000001f56' 2024-08-31T04:31:04.613 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17879 fp=#0x30000001fed' 2024-08-31T04:31:04.613 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17911 fp=#0x30000001f9b' 2024-08-31T04:31:04.614 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17943 fp=#0x30000003123' 2024-08-31T04:31:04.614 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17975 fp=#0x300000030be' 2024-08-31T04:31:04.614 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18007 fp=#0x30000001bfc' 2024-08-31T04:31:04.615 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18039 fp=#0x30000001c18' 2024-08-31T04:31:04.615 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18071 fp=#0x30000001c39' 2024-08-31T04:31:04.615 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18103 fp=#0x3000000253b' 2024-08-31T04:31:04.616 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18135 fp=#0x3000000251c' 2024-08-31T04:31:04.616 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18167 fp=#0x3000000253d' 2024-08-31T04:31:04.616 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18199 fp=#0x3000000259b' 2024-08-31T04:31:04.617 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18231 fp=#0x30000002575' 2024-08-31T04:31:04.617 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18263 fp=#0x30000002887' 2024-08-31T04:31:04.617 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18295 fp=#0x300000027cf' 2024-08-31T04:31:04.617 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18327 fp=#0x3000000282d' 2024-08-31T04:31:04.618 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18359 fp=#0x30000002841' 2024-08-31T04:31:04.618 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18391 fp=#0x30000002f68' 2024-08-31T04:31:04.618 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18423 fp=#0x30000003020' 2024-08-31T04:31:04.619 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18455 fp=#0x30000002f65' 2024-08-31T04:31:04.619 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18487 fp=#0x30000003010' 2024-08-31T04:31:04.619 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18519 fp=#0x30000003037' 2024-08-31T04:31:04.620 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18551 fp=#0x30000002f11' 2024-08-31T04:31:04.620 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18647 fp=#0x10000001d0f' 2024-08-31T04:31:04.621 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18711 fp=#0x30000001383' 2024-08-31T04:31:04.621 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18743 fp=#0x300000013e6' 2024-08-31T04:31:04.622 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18775 fp=#0x3000000136b' 2024-08-31T04:31:04.622 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18807 fp=#0x300000013e0' 2024-08-31T04:31:04.622 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18839 fp=#0x300000013c2' 2024-08-31T04:31:04.622 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18871 fp=#0x3000000139b' 2024-08-31T04:31:04.623 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18903 fp=#0x30000001050' 2024-08-31T04:31:04.623 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18935 fp=#0x30000001d54' 2024-08-31T04:31:04.623 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18967 fp=#0x300000010fe' 2024-08-31T04:31:04.624 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18999 fp=#0x30000001083' 2024-08-31T04:31:04.624 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19031 fp=#0x300000010ac' 2024-08-31T04:31:04.624 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19063 fp=#0x300000011c8' 2024-08-31T04:31:04.624 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19095 fp=#0x30000001185' 2024-08-31T04:31:04.625 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19127 fp=#0x30000001142' 2024-08-31T04:31:04.625 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19159 fp=#0x30000001623' 2024-08-31T04:31:04.626 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19223 fp=#0x30000001649' 2024-08-31T04:31:04.626 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19255 fp=#0x30000001635' 2024-08-31T04:31:04.626 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19287 fp=#0x100000008eb' 2024-08-31T04:31:04.627 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19319 fp=#0x100000008b0' 2024-08-31T04:31:04.627 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19351 fp=#0x1000000089c' 2024-08-31T04:31:04.627 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19383 fp=#0x100000008e8' 2024-08-31T04:31:04.628 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19415 fp=#0x30000002bab' 2024-08-31T04:31:04.628 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19446 fp=#0x30000000b7e' 2024-08-31T04:31:04.628 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19478 fp=#0x30000000b5c' 2024-08-31T04:31:04.628 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19510 fp=#0x30000000b7c' 2024-08-31T04:31:04.629 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19542 fp=#0x30000000b7b' 2024-08-31T04:31:04.629 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19574 fp=#0x30000000b22' 2024-08-31T04:31:04.629 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19606 fp=#0x30000000af4' 2024-08-31T04:31:04.630 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19638 fp=#0x30000000ad9' 2024-08-31T04:31:04.630 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19670 fp=#0x30000002de0' 2024-08-31T04:31:04.630 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19702 fp=#0x30000002d87' 2024-08-31T04:31:04.631 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19734 fp=#0x30000002d25' 2024-08-31T04:31:04.631 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19766 fp=#0x30000002dde' 2024-08-31T04:31:04.631 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19798 fp=#0x30000002d52' 2024-08-31T04:31:04.632 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19830 fp=#0x30000001204' 2024-08-31T04:31:04.632 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19862 fp=#0x300000011cd' 2024-08-31T04:31:04.632 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19894 fp=#0x30000001448' 2024-08-31T04:31:04.633 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19926 fp=#0x3000000144b' 2024-08-31T04:31:04.633 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19958 fp=#0x300000013fe' 2024-08-31T04:31:04.633 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19990 fp=#0x300000013f3' 2024-08-31T04:31:04.634 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20022 fp=#0x30000001402' 2024-08-31T04:31:04.634 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20054 fp=#0x30000000f9e' 2024-08-31T04:31:04.634 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20086 fp=#0x30000000fc6' 2024-08-31T04:31:04.635 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20118 fp=#0x30000000f9d' 2024-08-31T04:31:04.635 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20150 fp=#0x30000001702' 2024-08-31T04:31:04.635 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20182 fp=#0x300000016f2' 2024-08-31T04:31:04.636 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20214 fp=#0x300000016e6' 2024-08-31T04:31:04.636 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20246 fp=#0x3000000325b' 2024-08-31T04:31:04.636 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20278 fp=#0x3000000325f' 2024-08-31T04:31:04.637 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20310 fp=#0x3000000307b' 2024-08-31T04:31:04.637 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20342 fp=#0x3000000323a' 2024-08-31T04:31:04.637 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20374 fp=#0x30000003151' 2024-08-31T04:31:04.638 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20406 fp=#0x30000001cd7' 2024-08-31T04:31:04.638 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20438 fp=#0x30000001c94' 2024-08-31T04:31:04.638 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20470 fp=#0x30000001cb1' 2024-08-31T04:31:04.639 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20502 fp=#0x30000001c73' 2024-08-31T04:31:04.639 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20534 fp=#0x3000000123c' 2024-08-31T04:31:04.639 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20566 fp=#0x3000000122e' 2024-08-31T04:31:04.640 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20598 fp=#0x30000001241' 2024-08-31T04:31:04.640 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20662 fp=#0x3000000216e' 2024-08-31T04:31:04.641 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20758 fp=#0x30000003082' 2024-08-31T04:31:04.642 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20822 fp=#0x10000003741' 2024-08-31T04:31:04.642 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20886 fp=#0x30000003045' 2024-08-31T04:31:04.643 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20950 fp=#0x30000003063' 2024-08-31T04:31:04.643 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20982 fp=#0x300000020ab' 2024-08-31T04:31:04.643 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21014 fp=#0x300000020cc' 2024-08-31T04:31:04.644 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21045 fp=#0x3000000159e' 2024-08-31T04:31:04.647 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21077 fp=#0x30000001624' 2024-08-31T04:31:04.647 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21109 fp=#0x30000001549' 2024-08-31T04:31:04.648 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21173 fp=#0x30000002c02' 2024-08-31T04:31:04.648 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21205 fp=#0x30000002c46' 2024-08-31T04:31:04.649 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21301 fp=#0x10000003373' 2024-08-31T04:31:04.649 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21333 fp=#0x10000003357' 2024-08-31T04:31:04.650 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21365 fp=#0x10000003236' 2024-08-31T04:31:04.650 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21397 fp=#0x100000032ac' 2024-08-31T04:31:04.650 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21429 fp=#0x1000000326e' 2024-08-31T04:31:04.651 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21461 fp=#0x30000002737' 2024-08-31T04:31:04.651 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21493 fp=#0x300000026f3' 2024-08-31T04:31:04.651 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21525 fp=#0x300000026a8' 2024-08-31T04:31:04.652 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21557 fp=#0x30000002730' 2024-08-31T04:31:04.652 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21589 fp=#0x30000000d37' 2024-08-31T04:31:04.652 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21621 fp=#0x30000000d0b' 2024-08-31T04:31:04.653 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21653 fp=#0x300000036e1' 2024-08-31T04:31:04.653 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21685 fp=#0x30000003686' 2024-08-31T04:31:04.653 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21717 fp=#0x30000000cdf' 2024-08-31T04:31:04.654 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21749 fp=#0x300000036ea' 2024-08-31T04:31:04.654 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21781 fp=#0x30000000af1' 2024-08-31T04:31:04.654 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21813 fp=#0x30000000ac1' 2024-08-31T04:31:04.654 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21845 fp=#0x30000000b44' 2024-08-31T04:31:04.655 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21877 fp=#0x30000000b0e' 2024-08-31T04:31:04.655 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21941 fp=#0x3000000092b' 2024-08-31T04:31:04.656 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21973 fp=#0x30000000505' 2024-08-31T04:31:04.656 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22005 fp=#0x3000000090d' 2024-08-31T04:31:04.656 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22036 fp=#0x30000001925' 2024-08-31T04:31:04.657 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22068 fp=#0x30000001908' 2024-08-31T04:31:04.657 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22100 fp=#0x30000001928' 2024-08-31T04:31:04.657 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22132 fp=#0x300000029a0' 2024-08-31T04:31:04.658 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22164 fp=#0x3000000298a' 2024-08-31T04:31:04.658 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22196 fp=#0x300000028d5' 2024-08-31T04:31:04.658 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22228 fp=#0x300000028ae' 2024-08-31T04:31:04.659 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22260 fp=#0x30000002006' 2024-08-31T04:31:04.659 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22292 fp=#0x3000000205c' 2024-08-31T04:31:04.659 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22324 fp=#0x30000001fde' 2024-08-31T04:31:04.660 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22356 fp=#0x30000001fe8' 2024-08-31T04:31:04.660 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22420 fp=#0x3000000041c' 2024-08-31T04:31:04.661 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22452 fp=#0x30000000437' 2024-08-31T04:31:04.661 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22484 fp=#0x30000000416' 2024-08-31T04:31:04.661 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22516 fp=#0x30000000481' 2024-08-31T04:31:04.661 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22541 fp=#0x30000002c1b' 2024-08-31T04:31:04.662 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22573 fp=#0x30000002bfc' 2024-08-31T04:31:04.663 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22668 fp=#0x3000000146e' 2024-08-31T04:31:04.663 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:9798 fp=#0x30000003281' 2024-08-31T04:31:04.664 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:9830 fp=#0x300000023d1' 2024-08-31T04:31:04.664 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:9926 fp=#0x10000000fd8' 2024-08-31T04:31:04.670 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:10726 fp=#0x3000000183f' 2024-08-31T04:31:04.678 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:11782 fp=#0x300000023af' 2024-08-31T04:31:04.679 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:11846 fp=#0x30000000bb6' 2024-08-31T04:31:04.679 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:11878 fp=#0x30000000bc4' 2024-08-31T04:31:04.680 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:11974 fp=#0x300000010db' 2024-08-31T04:31:04.680 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12038 fp=#0x3000000120c' 2024-08-31T04:31:04.681 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12070 fp=#0x3000000103a' 2024-08-31T04:31:04.681 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12102 fp=#0x30000001145' 2024-08-31T04:31:04.681 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12134 fp=#0x300000010d3' 2024-08-31T04:31:04.682 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12230 fp=#0x300000009f5' 2024-08-31T04:31:04.684 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12422 fp=#0x30000002e19' 2024-08-31T04:31:04.684 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12454 fp=#0x30000002e3e' 2024-08-31T04:31:04.684 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12486 fp=#0x30000000f4a' 2024-08-31T04:31:04.685 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12518 fp=#0x30000000f5f' 2024-08-31T04:31:04.685 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12550 fp=#0x30000000f4c' 2024-08-31T04:31:04.685 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12582 fp=#0x30000000e40' 2024-08-31T04:31:04.686 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12614 fp=#0x30000003364' 2024-08-31T04:31:04.686 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12646 fp=#0x30000000e91' 2024-08-31T04:31:04.686 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12678 fp=#0x30000000e90' 2024-08-31T04:31:04.687 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12710 fp=#0x30000000e6e' 2024-08-31T04:31:04.687 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12742 fp=#0x30000000eb3' 2024-08-31T04:31:04.687 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12774 fp=#0x300000033d5' 2024-08-31T04:31:04.687 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12806 fp=#0x30000000e8e' 2024-08-31T04:31:04.688 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12838 fp=#0x30000002855' 2024-08-31T04:31:04.688 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12870 fp=#0x3000000250b' 2024-08-31T04:31:04.688 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12902 fp=#0x100000041ef' 2024-08-31T04:31:04.689 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12934 fp=#0x100000042e4' 2024-08-31T04:31:04.689 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12966 fp=#0x1000000433f' 2024-08-31T04:31:04.689 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12998 fp=#0x100000042f8' 2024-08-31T04:31:04.690 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13030 fp=#0x300000027fc' 2024-08-31T04:31:04.690 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13062 fp=#0x10000004258' 2024-08-31T04:31:04.690 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13094 fp=#0x300000031d1' 2024-08-31T04:31:04.691 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13126 fp=#0x30000003150' 2024-08-31T04:31:04.691 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13158 fp=#0x300000030d2' 2024-08-31T04:31:04.692 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13286 fp=#0x30000000a4e' 2024-08-31T04:31:04.692 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13318 fp=#0x30000002257' 2024-08-31T04:31:04.693 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13350 fp=#0x30000002265' 2024-08-31T04:31:04.693 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13382 fp=#0x30000002276' 2024-08-31T04:31:04.693 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13414 fp=#0x300000008f5' 2024-08-31T04:31:04.694 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13446 fp=#0x30000002285' 2024-08-31T04:31:04.694 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13478 fp=#0x300000008c8' 2024-08-31T04:31:04.694 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13510 fp=#0x3000000225c' 2024-08-31T04:31:04.695 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13542 fp=#0x30000002205' 2024-08-31T04:31:04.695 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13574 fp=#0x30000003291' 2024-08-31T04:31:04.695 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13606 fp=#0x3000000332d' 2024-08-31T04:31:04.695 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13638 fp=#0x3000000334d' 2024-08-31T04:31:04.696 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13670 fp=#0x3000000290d' 2024-08-31T04:31:04.696 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13702 fp=#0x30000002941' 2024-08-31T04:31:04.696 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13734 fp=#0x30000002935' 2024-08-31T04:31:04.697 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13766 fp=#0x30000002a41' 2024-08-31T04:31:04.697 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13798 fp=#0x3000000295b' 2024-08-31T04:31:04.697 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13830 fp=#0x3000000294b' 2024-08-31T04:31:04.698 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13862 fp=#0x10000003db1' 2024-08-31T04:31:04.698 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13894 fp=#0x10000003c04' 2024-08-31T04:31:04.698 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13926 fp=#0x10000003c4d' 2024-08-31T04:31:04.699 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13958 fp=#0x10000003ddb' 2024-08-31T04:31:04.699 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13990 fp=#0x10000003dc1' 2024-08-31T04:31:04.699 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14022 fp=#0x10000003bb9' 2024-08-31T04:31:04.700 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14054 fp=#0x30000000c85' 2024-08-31T04:31:04.700 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14086 fp=#0x30000000c4f' 2024-08-31T04:31:04.700 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14118 fp=#0x30000001779' 2024-08-31T04:31:04.700 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14150 fp=#0x3000000245d' 2024-08-31T04:31:04.701 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14182 fp=#0x3000000177b' 2024-08-31T04:31:04.701 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14214 fp=#0x30000001789' 2024-08-31T04:31:04.701 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14246 fp=#0x30000001763' 2024-08-31T04:31:04.703 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14406 fp=#0x30000000d5f' 2024-08-31T04:31:04.703 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14438 fp=#0x30000000d1a' 2024-08-31T04:31:04.703 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14470 fp=#0x30000000d33' 2024-08-31T04:31:04.703 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14502 fp=#0x30000000d1e' 2024-08-31T04:31:04.704 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14534 fp=#0x30000000d93' 2024-08-31T04:31:04.704 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14566 fp=#0x30000000ca7' 2024-08-31T04:31:04.704 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14598 fp=#0x30000002fa1' 2024-08-31T04:31:04.705 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14630 fp=#0x30000002fa2' 2024-08-31T04:31:04.705 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14662 fp=#0x30000002f91' 2024-08-31T04:31:04.705 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14694 fp=#0x30000002f88' 2024-08-31T04:31:04.706 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14726 fp=#0x10000002429' 2024-08-31T04:31:04.706 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14758 fp=#0x1000000243d' 2024-08-31T04:31:04.706 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14789 fp=#0x10000003bce' 2024-08-31T04:31:04.707 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14821 fp=#0x10000003c10' 2024-08-31T04:31:04.707 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14853 fp=#0x300000009a7' 2024-08-31T04:31:04.707 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14885 fp=#0x30000000920' 2024-08-31T04:31:04.708 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14917 fp=#0x30000000a05' 2024-08-31T04:31:04.708 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14949 fp=#0x30000000a26' 2024-08-31T04:31:04.708 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14981 fp=#0x300000016ae' 2024-08-31T04:31:04.709 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15013 fp=#0x3000000168c' 2024-08-31T04:31:04.709 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15045 fp=#0x300000016a2' 2024-08-31T04:31:04.709 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15077 fp=#0x3000000152f' 2024-08-31T04:31:04.709 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15109 fp=#0x30000003429' 2024-08-31T04:31:04.710 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15141 fp=#0x3000000340a' 2024-08-31T04:31:04.710 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15173 fp=#0x300000033de' 2024-08-31T04:31:04.710 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15205 fp=#0x30000002efd' 2024-08-31T04:31:04.711 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15237 fp=#0x30000002eeb' 2024-08-31T04:31:04.711 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15269 fp=#0x30000002e7c' 2024-08-31T04:31:04.711 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15301 fp=#0x30000002ef9' 2024-08-31T04:31:04.712 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15333 fp=#0x30000002ec5' 2024-08-31T04:31:04.712 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15365 fp=#0x30000002ee0' 2024-08-31T04:31:04.712 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15397 fp=#0x300000032c1' 2024-08-31T04:31:04.713 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15429 fp=#0x30000000ebf' 2024-08-31T04:31:04.713 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15461 fp=#0x30000001dbc' 2024-08-31T04:31:04.714 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15493 fp=#0x30000001d9e' 2024-08-31T04:31:04.714 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15525 fp=#0x30000000ee8' 2024-08-31T04:31:04.714 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15557 fp=#0x30000000ef1' 2024-08-31T04:31:04.714 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15589 fp=#0x30000001dc7' 2024-08-31T04:31:04.716 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15749 fp=#0x3000000054e' 2024-08-31T04:31:04.716 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15844 fp=#0x300000014e7' 2024-08-31T04:31:04.717 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15876 fp=#0x30000001303' 2024-08-31T04:31:04.717 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15908 fp=#0x300000012e4' 2024-08-31T04:31:04.717 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15940 fp=#0x300000012bd' 2024-08-31T04:31:04.718 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15972 fp=#0x3000000128b' 2024-08-31T04:31:04.718 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16004 fp=#0x300000010b6' 2024-08-31T04:31:04.718 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16036 fp=#0x3000000106a' 2024-08-31T04:31:04.718 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16068 fp=#0x3000000181a' 2024-08-31T04:31:04.719 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16100 fp=#0x30000002dff' 2024-08-31T04:31:04.719 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16132 fp=#0x300000034d4' 2024-08-31T04:31:04.719 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16164 fp=#0x30000000631' 2024-08-31T04:31:04.720 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16196 fp=#0x300000033f1' 2024-08-31T04:31:04.721 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16292 fp=#0x300000005c5' 2024-08-31T04:31:04.721 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16353 fp=#0x1000000283f' 2024-08-31T04:31:04.721 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16385 fp=#0x300000020ba' 2024-08-31T04:31:04.721 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16417 fp=#0x10000002861' 2024-08-31T04:31:04.722 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16449 fp=#0x10000002541' 2024-08-31T04:31:04.722 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16481 fp=#0x30000001d1a' 2024-08-31T04:31:04.722 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16513 fp=#0x30000001cd6' 2024-08-31T04:31:04.723 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16545 fp=#0x100000024be' 2024-08-31T04:31:04.723 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16577 fp=#0x30000001cfd' 2024-08-31T04:31:04.723 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16609 fp=#0x30000001d31' 2024-08-31T04:31:04.724 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16640 fp=#0x3000000232d' 2024-08-31T04:31:04.724 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16672 fp=#0x300000020fa' 2024-08-31T04:31:04.724 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16704 fp=#0x30000002137' 2024-08-31T04:31:04.724 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16736 fp=#0x30000002617' 2024-08-31T04:31:04.725 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16800 fp=#0x3000000197a' 2024-08-31T04:31:04.725 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16832 fp=#0x3000000197d' 2024-08-31T04:31:04.726 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16864 fp=#0x30000001955' 2024-08-31T04:31:04.726 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16896 fp=#0x300000019f7' 2024-08-31T04:31:04.726 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16927 fp=#0x30000001a51' 2024-08-31T04:31:04.727 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16959 fp=#0x30000001a7a' 2024-08-31T04:31:04.727 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16991 fp=#0x30000002b48' 2024-08-31T04:31:04.727 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17016 fp=#0x100000036a5' 2024-08-31T04:31:04.728 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17048 fp=#0x10000003639' 2024-08-31T04:31:04.728 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17080 fp=#0x10000003699' 2024-08-31T04:31:04.728 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17112 fp=#0x100000035ff' 2024-08-31T04:31:04.729 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17144 fp=#0x3000000180a' 2024-08-31T04:31:04.729 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17176 fp=#0x300000017cf' 2024-08-31T04:31:04.729 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17208 fp=#0x300000017fb' 2024-08-31T04:31:04.730 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17240 fp=#0x300000017cc' 2024-08-31T04:31:04.730 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17272 fp=#0x3000000180c' 2024-08-31T04:31:04.730 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17304 fp=#0x30000001733' 2024-08-31T04:31:04.730 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17336 fp=#0x3000000335e' 2024-08-31T04:31:04.731 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17368 fp=#0x300000032fc' 2024-08-31T04:31:04.732 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17528 fp=#0x30000000dfc' 2024-08-31T04:31:04.732 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17560 fp=#0x30000000db1' 2024-08-31T04:31:04.733 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17592 fp=#0x3000000319b' 2024-08-31T04:31:04.733 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17624 fp=#0x30000000dcb' 2024-08-31T04:31:04.733 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17656 fp=#0x30000003223' 2024-08-31T04:31:04.734 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17720 fp=#0x3000000076f' 2024-08-31T04:31:04.735 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17816 fp=#0x3000000203c' 2024-08-31T04:31:04.735 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17848 fp=#0x30000001f55' 2024-08-31T04:31:04.735 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17880 fp=#0x30000001fb8' 2024-08-31T04:31:04.735 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17912 fp=#0x30000001fa7' 2024-08-31T04:31:04.736 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17944 fp=#0x300000030e2' 2024-08-31T04:31:04.736 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17976 fp=#0x30000003138' 2024-08-31T04:31:04.736 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18008 fp=#0x30000001bf8' 2024-08-31T04:31:04.737 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18040 fp=#0x30000001bf3' 2024-08-31T04:31:04.737 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18072 fp=#0x30000001c1b' 2024-08-31T04:31:04.737 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18104 fp=#0x3000000259d' 2024-08-31T04:31:04.738 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18136 fp=#0x30000002532' 2024-08-31T04:31:04.738 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18168 fp=#0x30000002523' 2024-08-31T04:31:04.738 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18200 fp=#0x3000000257b' 2024-08-31T04:31:04.739 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18232 fp=#0x30000002588' 2024-08-31T04:31:04.739 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18264 fp=#0x3000000289e' 2024-08-31T04:31:04.739 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18296 fp=#0x30000002800' 2024-08-31T04:31:04.740 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18328 fp=#0x3000000283d' 2024-08-31T04:31:04.740 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18360 fp=#0x300000027c1' 2024-08-31T04:31:04.740 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18392 fp=#0x30000002f3c' 2024-08-31T04:31:04.741 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18424 fp=#0x30000002f19' 2024-08-31T04:31:04.741 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18456 fp=#0x3000000301d' 2024-08-31T04:31:04.741 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18488 fp=#0x30000002ff2' 2024-08-31T04:31:04.742 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18520 fp=#0x30000002f28' 2024-08-31T04:31:04.742 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18552 fp=#0x30000003003' 2024-08-31T04:31:04.742 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18584 fp=#0x10000001d1c' 2024-08-31T04:31:04.743 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18648 fp=#0x10000001d05' 2024-08-31T04:31:04.743 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18680 fp=#0x10000001d1e' 2024-08-31T04:31:04.743 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18712 fp=#0x3000000137f' 2024-08-31T04:31:04.744 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18744 fp=#0x3000000136f' 2024-08-31T04:31:04.744 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18776 fp=#0x300000013cc' 2024-08-31T04:31:04.744 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18808 fp=#0x300000013e4' 2024-08-31T04:31:04.745 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18840 fp=#0x30000001331' 2024-08-31T04:31:04.745 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18872 fp=#0x30000002eb8' 2024-08-31T04:31:04.745 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18904 fp=#0x30000001d7a' 2024-08-31T04:31:04.746 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18936 fp=#0x300000021f7' 2024-08-31T04:31:04.746 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18968 fp=#0x30000001081' 2024-08-31T04:31:04.746 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19000 fp=#0x3000000104d' 2024-08-31T04:31:04.746 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19032 fp=#0x300000021f8' 2024-08-31T04:31:04.747 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19064 fp=#0x3000000111d' 2024-08-31T04:31:04.747 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19096 fp=#0x30000001165' 2024-08-31T04:31:04.747 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19128 fp=#0x300000011c4' 2024-08-31T04:31:04.748 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19160 fp=#0x300000015c8' 2024-08-31T04:31:04.748 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19192 fp=#0x30000001618' 2024-08-31T04:31:04.748 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19224 fp=#0x300000015ed' 2024-08-31T04:31:04.749 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19256 fp=#0x300000015b4' 2024-08-31T04:31:04.749 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19288 fp=#0x30000002bc3' 2024-08-31T04:31:04.749 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19320 fp=#0x300000014bf' 2024-08-31T04:31:04.750 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19352 fp=#0x3000000152e' 2024-08-31T04:31:04.750 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19384 fp=#0x3000000151a' 2024-08-31T04:31:04.750 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19416 fp=#0x30000002bd7' 2024-08-31T04:31:04.750 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19447 fp=#0x30000000b5b' 2024-08-31T04:31:04.751 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19479 fp=#0x30000000b66' 2024-08-31T04:31:04.751 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19511 fp=#0x30000000b77' 2024-08-31T04:31:04.751 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19543 fp=#0x30000000b9e' 2024-08-31T04:31:04.752 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19575 fp=#0x30000001d29' 2024-08-31T04:31:04.752 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19607 fp=#0x30000000b15' 2024-08-31T04:31:04.752 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19639 fp=#0x30000000ab3' 2024-08-31T04:31:04.753 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19671 fp=#0x30000002de9' 2024-08-31T04:31:04.753 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19703 fp=#0x30000002ca0' 2024-08-31T04:31:04.753 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19735 fp=#0x30000002d17' 2024-08-31T04:31:04.753 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19767 fp=#0x30000002d5d' 2024-08-31T04:31:04.754 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19799 fp=#0x30000002d22' 2024-08-31T04:31:04.754 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19831 fp=#0x3000000119d' 2024-08-31T04:31:04.754 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19863 fp=#0x30000001467' 2024-08-31T04:31:04.755 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19895 fp=#0x3000000144f' 2024-08-31T04:31:04.755 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19927 fp=#0x3000000117c' 2024-08-31T04:31:04.755 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19959 fp=#0x300000013fa' 2024-08-31T04:31:04.756 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19991 fp=#0x3000000143b' 2024-08-31T04:31:04.756 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20023 fp=#0x30000001d05' 2024-08-31T04:31:04.756 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20055 fp=#0x30000000fc4' 2024-08-31T04:31:04.757 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20087 fp=#0x30000000fab' 2024-08-31T04:31:04.757 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20151 fp=#0x300000016c7' 2024-08-31T04:31:04.757 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20183 fp=#0x300000016df' 2024-08-31T04:31:04.758 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20215 fp=#0x300000016d8' 2024-08-31T04:31:04.758 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20247 fp=#0x30000003075' 2024-08-31T04:31:04.758 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20279 fp=#0x30000003225' 2024-08-31T04:31:04.759 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20311 fp=#0x3000000313a' 2024-08-31T04:31:04.759 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20343 fp=#0x3000000311f' 2024-08-31T04:31:04.759 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20375 fp=#0x30000003166' 2024-08-31T04:31:04.759 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20407 fp=#0x30000001c81' 2024-08-31T04:31:04.760 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20439 fp=#0x30000001caa' 2024-08-31T04:31:04.760 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20471 fp=#0x30000001c80' 2024-08-31T04:31:04.760 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20503 fp=#0x30000001c8a' 2024-08-31T04:31:04.761 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20535 fp=#0x3000000124b' 2024-08-31T04:31:04.761 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20567 fp=#0x30000001236' 2024-08-31T04:31:04.761 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20599 fp=#0x30000001215' 2024-08-31T04:31:04.762 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20695 fp=#0x30000002167' 2024-08-31T04:31:04.763 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20791 fp=#0x30000003068' 2024-08-31T04:31:04.763 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20823 fp=#0x30000003043' 2024-08-31T04:31:04.763 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20855 fp=#0x3000000305d' 2024-08-31T04:31:04.764 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20919 fp=#0x1000000373c' 2024-08-31T04:31:04.764 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20951 fp=#0x30000003042' 2024-08-31T04:31:04.765 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20983 fp=#0x300000020bd' 2024-08-31T04:31:04.765 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21015 fp=#0x300000020d7' 2024-08-31T04:31:04.765 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21046 fp=#0x300000015ac' 2024-08-31T04:31:04.766 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21078 fp=#0x300000015db' 2024-08-31T04:31:04.766 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21110 fp=#0x30000001606' 2024-08-31T04:31:04.767 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21174 fp=#0x30000002bfe' 2024-08-31T04:31:04.767 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21206 fp=#0x30000002c24' 2024-08-31T04:31:04.767 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21270 fp=#0x30000002be3' 2024-08-31T04:31:04.768 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21302 fp=#0x10000003244' 2024-08-31T04:31:04.768 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21334 fp=#0x1000000331f' 2024-08-31T04:31:04.768 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21366 fp=#0x10000003241' 2024-08-31T04:31:04.769 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21398 fp=#0x100000032a0' 2024-08-31T04:31:04.769 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21430 fp=#0x10000003363' 2024-08-31T04:31:04.769 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21462 fp=#0x3000000266c' 2024-08-31T04:31:04.770 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21494 fp=#0x3000000273d' 2024-08-31T04:31:04.770 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21526 fp=#0x3000000260f' 2024-08-31T04:31:04.770 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21558 fp=#0x300000025fe' 2024-08-31T04:31:04.771 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21590 fp=#0x300000032b6' 2024-08-31T04:31:04.771 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21622 fp=#0x30000000d3a' 2024-08-31T04:31:04.771 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21654 fp=#0x30000003710' 2024-08-31T04:31:04.772 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21686 fp=#0x30000000cc8' 2024-08-31T04:31:04.772 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21718 fp=#0x300000036c7' 2024-08-31T04:31:04.772 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21750 fp=#0x30000000d3d' 2024-08-31T04:31:04.773 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21782 fp=#0x30000000b4a' 2024-08-31T04:31:04.773 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21814 fp=#0x30000000ada' 2024-08-31T04:31:04.773 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21846 fp=#0x30000001ddc' 2024-08-31T04:31:04.774 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21878 fp=#0x30000000ab9' 2024-08-31T04:31:04.774 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21974 fp=#0x30000000913' 2024-08-31T04:31:04.775 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22006 fp=#0x30000000931' 2024-08-31T04:31:04.775 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22037 fp=#0x3000000190d' 2024-08-31T04:31:04.775 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22069 fp=#0x30000001918' 2024-08-31T04:31:04.776 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22101 fp=#0x30000001922' 2024-08-31T04:31:04.776 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22133 fp=#0x30000002909' 2024-08-31T04:31:04.776 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22165 fp=#0x300000028c1' 2024-08-31T04:31:04.777 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22197 fp=#0x3000000290c' 2024-08-31T04:31:04.777 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22229 fp=#0x30000002981' 2024-08-31T04:31:04.777 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22261 fp=#0x3000000209f' 2024-08-31T04:31:04.778 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22293 fp=#0x30000002099' 2024-08-31T04:31:04.778 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22325 fp=#0x3000000207e' 2024-08-31T04:31:04.778 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22357 fp=#0x30000002067' 2024-08-31T04:31:04.778 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22389 fp=#0x300000004a9' 2024-08-31T04:31:04.779 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22421 fp=#0x30000000427' 2024-08-31T04:31:04.779 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22453 fp=#0x3000000041a' 2024-08-31T04:31:04.779 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22485 fp=#0x3000000087f' 2024-08-31T04:31:04.780 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22542 fp=#0x30000002c8a' 2024-08-31T04:31:04.780 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22574 fp=#0x30000002c43' 2024-08-31T04:31:04.780 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22605 fp=#0x3000000148e' 2024-08-31T04:31:04.781 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22637 fp=#0x3000000148c' 2024-08-31T04:31:04.781 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22669 fp=#0x3000000147b' 2024-08-31T04:31:04.782 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:9799 fp=#0x300000028a1' 2024-08-31T04:31:04.782 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:9831 fp=#0x30000001819' 2024-08-31T04:31:04.783 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:9927 fp=#0x3000000112b' 2024-08-31T04:31:04.786 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:10375 fp=#0x3000000087d' 2024-08-31T04:31:04.788 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:10599 fp=#0x30000000a82' 2024-08-31T04:31:04.796 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:11783 fp=#0x300000023b8' 2024-08-31T04:31:04.796 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:11815 fp=#0x300000023be' 2024-08-31T04:31:04.797 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:11879 fp=#0x300000023b0' 2024-08-31T04:31:04.797 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:11911 fp=#0x30000001010' 2024-08-31T04:31:04.797 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:11943 fp=#0x300000010d9' 2024-08-31T04:31:04.798 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12007 fp=#0x30000001063' 2024-08-31T04:31:04.798 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12071 fp=#0x30000001170' 2024-08-31T04:31:04.799 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12103 fp=#0x30000001024' 2024-08-31T04:31:04.799 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12135 fp=#0x300000010f7' 2024-08-31T04:31:04.800 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12231 fp=#0x30000000941' 2024-08-31T04:31:04.801 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12327 fp=#0x30000000921' 2024-08-31T04:31:04.802 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12455 fp=#0x30000002e11' 2024-08-31T04:31:04.802 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12487 fp=#0x30000000f92' 2024-08-31T04:31:04.802 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12519 fp=#0x30000000f63' 2024-08-31T04:31:04.803 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12551 fp=#0x30000002ebc' 2024-08-31T04:31:04.803 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12583 fp=#0x3000000338c' 2024-08-31T04:31:04.803 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12615 fp=#0x30000000e35' 2024-08-31T04:31:04.803 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12647 fp=#0x30000000e27' 2024-08-31T04:31:04.804 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12679 fp=#0x30000002277' 2024-08-31T04:31:04.804 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12711 fp=#0x30000000e51' 2024-08-31T04:31:04.804 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12743 fp=#0x30000000e68' 2024-08-31T04:31:04.805 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12775 fp=#0x30000000e4b' 2024-08-31T04:31:04.805 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12807 fp=#0x30000000e72' 2024-08-31T04:31:04.805 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12839 fp=#0x100000042d8' 2024-08-31T04:31:04.806 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12871 fp=#0x100000041f6' 2024-08-31T04:31:04.806 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12903 fp=#0x3000000280c' 2024-08-31T04:31:04.806 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12935 fp=#0x10000004419' 2024-08-31T04:31:04.806 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12967 fp=#0x1000000426d' 2024-08-31T04:31:04.807 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12999 fp=#0x10000004212' 2024-08-31T04:31:04.807 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13031 fp=#0x100000041ce' 2024-08-31T04:31:04.807 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13063 fp=#0x10000004391' 2024-08-31T04:31:04.808 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13095 fp=#0x300000031e0' 2024-08-31T04:31:04.808 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13127 fp=#0x3000000315c' 2024-08-31T04:31:04.808 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13159 fp=#0x30000003155' 2024-08-31T04:31:04.809 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13287 fp=#0x3000000223e' 2024-08-31T04:31:04.810 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13319 fp=#0x30000002222' 2024-08-31T04:31:04.810 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13351 fp=#0x30000002264' 2024-08-31T04:31:04.810 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13383 fp=#0x30000002228' 2024-08-31T04:31:04.811 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13415 fp=#0x3000000094e' 2024-08-31T04:31:04.811 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13447 fp=#0x30000002211' 2024-08-31T04:31:04.811 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13479 fp=#0x300000008ef' 2024-08-31T04:31:04.812 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13511 fp=#0x30000002230' 2024-08-31T04:31:04.812 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13543 fp=#0x30000002252' 2024-08-31T04:31:04.812 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13575 fp=#0x30000003313' 2024-08-31T04:31:04.813 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13607 fp=#0x3000000328d' 2024-08-31T04:31:04.813 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13639 fp=#0x3000000329a' 2024-08-31T04:31:04.813 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13671 fp=#0x3000000298e' 2024-08-31T04:31:04.814 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13703 fp=#0x30000002a0a' 2024-08-31T04:31:04.814 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13735 fp=#0x300000028b7' 2024-08-31T04:31:04.814 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13767 fp=#0x300000029c1' 2024-08-31T04:31:04.815 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13799 fp=#0x30000002972' 2024-08-31T04:31:04.815 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13831 fp=#0x30000002a19' 2024-08-31T04:31:04.815 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13863 fp=#0x10000003c19' 2024-08-31T04:31:04.816 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13895 fp=#0x10000003eb6' 2024-08-31T04:31:04.816 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13927 fp=#0x10000003f12' 2024-08-31T04:31:04.817 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14023 fp=#0x10000003d58' 2024-08-31T04:31:04.817 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14055 fp=#0x30000002bed' 2024-08-31T04:31:04.818 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14087 fp=#0x30000000c7c' 2024-08-31T04:31:04.818 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14119 fp=#0x30000001755' 2024-08-31T04:31:04.818 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14151 fp=#0x3000000245b' 2024-08-31T04:31:04.818 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14183 fp=#0x30000001784' 2024-08-31T04:31:04.819 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14215 fp=#0x30000002432' 2024-08-31T04:31:04.819 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14247 fp=#0x3000000174f' 2024-08-31T04:31:04.820 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14343 fp=#0x3000000114b' 2024-08-31T04:31:04.820 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14407 fp=#0x30000000d9b' 2024-08-31T04:31:04.821 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14439 fp=#0x30000000d76' 2024-08-31T04:31:04.821 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14471 fp=#0x30000002381' 2024-08-31T04:31:04.821 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14503 fp=#0x30000000ce4' 2024-08-31T04:31:04.822 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14535 fp=#0x30000000d64' 2024-08-31T04:31:04.822 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14567 fp=#0x300000023a0' 2024-08-31T04:31:04.822 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14599 fp=#0x100000023ef' 2024-08-31T04:31:04.823 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14631 fp=#0x10000002461' 2024-08-31T04:31:04.823 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14663 fp=#0x30000002fd8' 2024-08-31T04:31:04.823 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14695 fp=#0x30000002fd2' 2024-08-31T04:31:04.824 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14727 fp=#0x1000000245d' 2024-08-31T04:31:04.824 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14759 fp=#0x1000000241a' 2024-08-31T04:31:04.824 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14790 fp=#0x10000003c27' 2024-08-31T04:31:04.825 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14822 fp=#0x10000003bb8' 2024-08-31T04:31:04.825 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14854 fp=#0x30000000943' 2024-08-31T04:31:04.825 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14886 fp=#0x30000000945' 2024-08-31T04:31:04.826 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14918 fp=#0x300000009e7' 2024-08-31T04:31:04.826 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14950 fp=#0x30000000949' 2024-08-31T04:31:04.826 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14982 fp=#0x300000014cb' 2024-08-31T04:31:04.827 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15014 fp=#0x300000015ab' 2024-08-31T04:31:04.827 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15046 fp=#0x300000015b8' 2024-08-31T04:31:04.827 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15078 fp=#0x300000014c4' 2024-08-31T04:31:04.827 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15110 fp=#0x3000000341e' 2024-08-31T04:31:04.828 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15142 fp=#0x30000003389' 2024-08-31T04:31:04.828 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15174 fp=#0x300000033e8' 2024-08-31T04:31:04.828 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15206 fp=#0x30000002e73' 2024-08-31T04:31:04.829 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15238 fp=#0x30000002eff' 2024-08-31T04:31:04.829 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15270 fp=#0x30000002e88' 2024-08-31T04:31:04.829 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15302 fp=#0x30000002ec1' 2024-08-31T04:31:04.829 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15334 fp=#0x30000002e7f' 2024-08-31T04:31:04.830 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15366 fp=#0x300000032df' 2024-08-31T04:31:04.830 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15398 fp=#0x300000032d6' 2024-08-31T04:31:04.830 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15430 fp=#0x30000000ebb' 2024-08-31T04:31:04.831 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15462 fp=#0x30000001dbb' 2024-08-31T04:31:04.831 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15494 fp=#0x30000000efb' 2024-08-31T04:31:04.831 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15526 fp=#0x30000001dcb' 2024-08-31T04:31:04.832 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15558 fp=#0x30000001dd2' 2024-08-31T04:31:04.832 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15590 fp=#0x30000000ef2' 2024-08-31T04:31:04.834 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15845 fp=#0x300000012b8' 2024-08-31T04:31:04.834 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15877 fp=#0x30000001292' 2024-08-31T04:31:04.834 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15909 fp=#0x300000012f4' 2024-08-31T04:31:04.835 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15941 fp=#0x300000014c9' 2024-08-31T04:31:04.835 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15973 fp=#0x300000012b2' 2024-08-31T04:31:04.835 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16005 fp=#0x30000001017' 2024-08-31T04:31:04.836 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16037 fp=#0x30000001013' 2024-08-31T04:31:04.836 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16069 fp=#0x30000002dfa' 2024-08-31T04:31:04.836 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16101 fp=#0x30000001834' 2024-08-31T04:31:04.837 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16133 fp=#0x300000005e3' 2024-08-31T04:31:04.838 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16261 fp=#0x30000000627' 2024-08-31T04:31:04.838 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16293 fp=#0x30000000630' 2024-08-31T04:31:04.839 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16354 fp=#0x30000002076' 2024-08-31T04:31:04.839 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16386 fp=#0x1000000285d' 2024-08-31T04:31:04.839 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16418 fp=#0x10000002879' 2024-08-31T04:31:04.840 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16450 fp=#0x30000001d44' 2024-08-31T04:31:04.840 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16482 fp=#0x30000001d1b' 2024-08-31T04:31:04.840 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16514 fp=#0x1000000254a' 2024-08-31T04:31:04.841 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16546 fp=#0x30000001d0c' 2024-08-31T04:31:04.841 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16578 fp=#0x30000001d0d' 2024-08-31T04:31:04.841 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16610 fp=#0x30000001d4c' 2024-08-31T04:31:04.842 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16641 fp=#0x30000002184' 2024-08-31T04:31:04.842 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16673 fp=#0x300000022f1' 2024-08-31T04:31:04.842 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16705 fp=#0x30000002118' 2024-08-31T04:31:04.842 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16737 fp=#0x300000003d6' 2024-08-31T04:31:04.843 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16833 fp=#0x30000001981' 2024-08-31T04:31:04.844 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16897 fp=#0x30000001970' 2024-08-31T04:31:04.844 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16928 fp=#0x30000002b5a' 2024-08-31T04:31:04.844 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16960 fp=#0x30000001a78' 2024-08-31T04:31:04.845 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16992 fp=#0x30000001ab6' 2024-08-31T04:31:04.845 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17017 fp=#0x100000036f0' 2024-08-31T04:31:04.845 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17049 fp=#0x100000036e3' 2024-08-31T04:31:04.846 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17081 fp=#0x1000000364d' 2024-08-31T04:31:04.846 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17113 fp=#0x1000000366f' 2024-08-31T04:31:04.846 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17145 fp=#0x30000001724' 2024-08-31T04:31:04.846 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17177 fp=#0x30000001800' 2024-08-31T04:31:04.847 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17209 fp=#0x30000002cb7' 2024-08-31T04:31:04.847 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17241 fp=#0x30000001773' 2024-08-31T04:31:04.847 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17273 fp=#0x300000017ec' 2024-08-31T04:31:04.848 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17305 fp=#0x3000000176a' 2024-08-31T04:31:04.848 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17337 fp=#0x3000000333a' 2024-08-31T04:31:04.848 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17369 fp=#0x30000003345' 2024-08-31T04:31:04.849 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17529 fp=#0x30000003238' 2024-08-31T04:31:04.850 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17561 fp=#0x30000000dc9' 2024-08-31T04:31:04.850 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17593 fp=#0x30000000db0' 2024-08-31T04:31:04.850 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17625 fp=#0x300000031b2' 2024-08-31T04:31:04.851 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17657 fp=#0x30000003206' 2024-08-31T04:31:04.851 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17689 fp=#0x30000001d2a' 2024-08-31T04:31:04.852 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17817 fp=#0x30000001fc5' 2024-08-31T04:31:04.852 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17849 fp=#0x30000001f5d' 2024-08-31T04:31:04.852 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17881 fp=#0x30000002048' 2024-08-31T04:31:04.853 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17913 fp=#0x30000002010' 2024-08-31T04:31:04.853 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17945 fp=#0x3000000315d' 2024-08-31T04:31:04.853 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17977 fp=#0x30000003125' 2024-08-31T04:31:04.854 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18009 fp=#0x30000001be0' 2024-08-31T04:31:04.854 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18041 fp=#0x30000001c1f' 2024-08-31T04:31:04.854 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18073 fp=#0x30000001c3c' 2024-08-31T04:31:04.855 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18105 fp=#0x30000002598' 2024-08-31T04:31:04.855 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18137 fp=#0x30000002585' 2024-08-31T04:31:04.855 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18169 fp=#0x3000000253c' 2024-08-31T04:31:04.855 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18201 fp=#0x3000000256c' 2024-08-31T04:31:04.856 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18233 fp=#0x30000002533' 2024-08-31T04:31:04.856 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18265 fp=#0x300000027f8' 2024-08-31T04:31:04.856 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18297 fp=#0x30000002809' 2024-08-31T04:31:04.857 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18329 fp=#0x300000027d3' 2024-08-31T04:31:04.857 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18361 fp=#0x300000027b6' 2024-08-31T04:31:04.857 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18393 fp=#0x30000002f5c' 2024-08-31T04:31:04.858 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18425 fp=#0x30000002f51' 2024-08-31T04:31:04.858 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18457 fp=#0x30000002fea' 2024-08-31T04:31:04.858 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18489 fp=#0x30000002f1f' 2024-08-31T04:31:04.859 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18521 fp=#0x30000002f41' 2024-08-31T04:31:04.859 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18553 fp=#0x10000001d6d' 2024-08-31T04:31:04.859 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18585 fp=#0x10000001d5f' 2024-08-31T04:31:04.860 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18617 fp=#0x10000001d03' 2024-08-31T04:31:04.860 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18649 fp=#0x10000001d6a' 2024-08-31T04:31:04.860 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18681 fp=#0x10000001d55' 2024-08-31T04:31:04.861 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18713 fp=#0x30000001353' 2024-08-31T04:31:04.861 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18745 fp=#0x300000014d7' 2024-08-31T04:31:04.861 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18777 fp=#0x3000000133f' 2024-08-31T04:31:04.861 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18809 fp=#0x30000001335' 2024-08-31T04:31:04.862 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18841 fp=#0x30000001384' 2024-08-31T04:31:04.862 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18873 fp=#0x300000014bd' 2024-08-31T04:31:04.862 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18905 fp=#0x30000001d84' 2024-08-31T04:31:04.863 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18937 fp=#0x3000000107f' 2024-08-31T04:31:04.863 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18969 fp=#0x30000001d79' 2024-08-31T04:31:04.863 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19001 fp=#0x3000000109a' 2024-08-31T04:31:04.864 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19033 fp=#0x30000001d8b' 2024-08-31T04:31:04.864 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19065 fp=#0x300000011b1' 2024-08-31T04:31:04.864 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19097 fp=#0x30000001195' 2024-08-31T04:31:04.865 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19129 fp=#0x300000011b5' 2024-08-31T04:31:04.865 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19161 fp=#0x30000001682' 2024-08-31T04:31:04.865 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19193 fp=#0x30000001674' 2024-08-31T04:31:04.865 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19225 fp=#0x30000001657' 2024-08-31T04:31:04.866 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19257 fp=#0x30000001631' 2024-08-31T04:31:04.866 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19289 fp=#0x30000002bb6' 2024-08-31T04:31:04.866 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19321 fp=#0x100000008bb' 2024-08-31T04:31:04.867 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19353 fp=#0x30000002bc5' 2024-08-31T04:31:04.867 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19385 fp=#0x100000008a0' 2024-08-31T04:31:04.867 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19417 fp=#0x30000002bb8' 2024-08-31T04:31:04.868 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19448 fp=#0x30000000bf0' 2024-08-31T04:31:04.868 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19480 fp=#0x30000000bf2' 2024-08-31T04:31:04.868 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19512 fp=#0x30000000b6d' 2024-08-31T04:31:04.869 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19544 fp=#0x30000000b86' 2024-08-31T04:31:04.869 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19576 fp=#0x30000000aa8' 2024-08-31T04:31:04.869 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19608 fp=#0x30000000a90' 2024-08-31T04:31:04.870 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19640 fp=#0x30000000b24' 2024-08-31T04:31:04.870 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19672 fp=#0x30000002d08' 2024-08-31T04:31:04.870 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19704 fp=#0x30000002cdd' 2024-08-31T04:31:04.871 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19736 fp=#0x30000002c99' 2024-08-31T04:31:04.871 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19768 fp=#0x30000002c77' 2024-08-31T04:31:04.871 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19800 fp=#0x30000002d75' 2024-08-31T04:31:04.871 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19832 fp=#0x300000011ff' 2024-08-31T04:31:04.872 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19864 fp=#0x30000001164' 2024-08-31T04:31:04.872 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19896 fp=#0x300000011a3' 2024-08-31T04:31:04.872 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19928 fp=#0x3000000113e' 2024-08-31T04:31:04.873 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19960 fp=#0x30000001437' 2024-08-31T04:31:04.873 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19992 fp=#0x30000001433' 2024-08-31T04:31:04.873 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20024 fp=#0x30000001400' 2024-08-31T04:31:04.874 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20056 fp=#0x30000000f99' 2024-08-31T04:31:04.874 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20088 fp=#0x30000000fd2' 2024-08-31T04:31:04.874 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20120 fp=#0x30000001718' 2024-08-31T04:31:04.875 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20152 fp=#0x300000016fc' 2024-08-31T04:31:04.875 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20184 fp=#0x300000016d9' 2024-08-31T04:31:04.875 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20216 fp=#0x30000001711' 2024-08-31T04:31:04.876 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20248 fp=#0x30000003258' 2024-08-31T04:31:04.876 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20280 fp=#0x3000000312f' 2024-08-31T04:31:04.876 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20312 fp=#0x300000030b6' 2024-08-31T04:31:04.877 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20344 fp=#0x30000003067' 2024-08-31T04:31:04.877 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20376 fp=#0x300000031f0' 2024-08-31T04:31:04.877 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20408 fp=#0x30000001cc9' 2024-08-31T04:31:04.878 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20440 fp=#0x30000001c9d' 2024-08-31T04:31:04.878 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20472 fp=#0x30000001c6b' 2024-08-31T04:31:04.878 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20504 fp=#0x30000001cc0' 2024-08-31T04:31:04.879 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20536 fp=#0x30000001231' 2024-08-31T04:31:04.879 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20568 fp=#0x3000000124d' 2024-08-31T04:31:04.879 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20600 fp=#0x30000001253' 2024-08-31T04:31:04.879 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20632 fp=#0x300000021ab' 2024-08-31T04:31:04.880 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20664 fp=#0x300000021c2' 2024-08-31T04:31:04.880 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20696 fp=#0x300000021ba' 2024-08-31T04:31:04.881 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20760 fp=#0x1000000371d' 2024-08-31T04:31:04.881 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20792 fp=#0x30000003038' 2024-08-31T04:31:04.881 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20824 fp=#0x3000000303b' 2024-08-31T04:31:04.882 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20920 fp=#0x3000000306a' 2024-08-31T04:31:04.882 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20952 fp=#0x10000003727' 2024-08-31T04:31:04.883 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20984 fp=#0x300000020af' 2024-08-31T04:31:04.883 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21016 fp=#0x300000020df' 2024-08-31T04:31:04.883 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21047 fp=#0x3000000162e' 2024-08-31T04:31:04.884 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21079 fp=#0x300000016b1' 2024-08-31T04:31:04.884 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21111 fp=#0x30000001559' 2024-08-31T04:31:04.885 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21239 fp=#0x300000011ef' 2024-08-31T04:31:04.886 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21303 fp=#0x10000003286' 2024-08-31T04:31:04.886 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21335 fp=#0x100000032b7' 2024-08-31T04:31:04.886 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21367 fp=#0x10000003284' 2024-08-31T04:31:04.886 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21399 fp=#0x1000000323e' 2024-08-31T04:31:04.887 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21431 fp=#0x10000003213' 2024-08-31T04:31:04.887 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21463 fp=#0x300000025f1' 2024-08-31T04:31:04.887 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21495 fp=#0x3000000266f' 2024-08-31T04:31:04.888 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21527 fp=#0x300000026d2' 2024-08-31T04:31:04.888 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21559 fp=#0x30000002696' 2024-08-31T04:31:04.888 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21591 fp=#0x30000000c8c' 2024-08-31T04:31:04.889 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21623 fp=#0x30000000caa' 2024-08-31T04:31:04.889 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21655 fp=#0x300000036a4' 2024-08-31T04:31:04.889 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21687 fp=#0x30000000cd8' 2024-08-31T04:31:04.889 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21719 fp=#0x30000000cc4' 2024-08-31T04:31:04.890 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21751 fp=#0x300000036fa' 2024-08-31T04:31:04.890 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21783 fp=#0x30000000aa0' 2024-08-31T04:31:04.890 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21815 fp=#0x30000000aed' 2024-08-31T04:31:04.891 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21847 fp=#0x30000000b1c' 2024-08-31T04:31:04.891 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21911 fp=#0x30000000561' 2024-08-31T04:31:04.892 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21943 fp=#0x3000000052b' 2024-08-31T04:31:04.892 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21975 fp=#0x3000000056e' 2024-08-31T04:31:04.892 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22007 fp=#0x300000008e0' 2024-08-31T04:31:04.893 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22038 fp=#0x300000018f0' 2024-08-31T04:31:04.893 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22070 fp=#0x30000002f7d' 2024-08-31T04:31:04.893 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22102 fp=#0x3000000191b' 2024-08-31T04:31:04.894 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22134 fp=#0x300000028ac' 2024-08-31T04:31:04.894 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22166 fp=#0x300000028d8' 2024-08-31T04:31:04.894 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22198 fp=#0x30000002918' 2024-08-31T04:31:04.895 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22230 fp=#0x300000028e4' 2024-08-31T04:31:04.895 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22262 fp=#0x3000000206a' 2024-08-31T04:31:04.895 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22294 fp=#0x3000000207a' 2024-08-31T04:31:04.896 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22326 fp=#0x30000002021' 2024-08-31T04:31:04.896 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22358 fp=#0x30000001ff4' 2024-08-31T04:31:04.896 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22390 fp=#0x3000000041d' 2024-08-31T04:31:04.897 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22422 fp=#0x3000000041e' 2024-08-31T04:31:04.897 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22486 fp=#0x30000000494' 2024-08-31T04:31:04.898 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22543 fp=#0x30000002bd9' 2024-08-31T04:31:04.898 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22575 fp=#0x30000002bcb' 2024-08-31T04:31:04.898 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22606 fp=#0x3000000146c' 2024-08-31T04:31:04.899 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22638 fp=#0x300000033a5' 2024-08-31T04:31:04.899 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:9800 fp=#0x30000002bca' 2024-08-31T04:31:04.900 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:9832 fp=#0x300000005ba' 2024-08-31T04:31:04.900 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:9896 fp=#0x100000035f7' 2024-08-31T04:31:04.907 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:10792 fp=#0x30000000a7a' 2024-08-31T04:31:04.915 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:11816 fp=#0x300000023bb' 2024-08-31T04:31:04.915 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:11912 fp=#0x30000001188' 2024-08-31T04:31:04.916 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:11944 fp=#0x30000001082' 2024-08-31T04:31:04.917 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12072 fp=#0x300000010d5' 2024-08-31T04:31:04.917 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12104 fp=#0x300000031da' 2024-08-31T04:31:04.917 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12136 fp=#0x300000010e9' 2024-08-31T04:31:04.918 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12232 fp=#0x300000009d8' 2024-08-31T04:31:04.918 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12264 fp=#0x300000009ae' 2024-08-31T04:31:04.919 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12296 fp=#0x30000000914' 2024-08-31T04:31:04.920 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12456 fp=#0x30000002e0c' 2024-08-31T04:31:04.920 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12488 fp=#0x30000000f73' 2024-08-31T04:31:04.921 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12520 fp=#0x30000000f79' 2024-08-31T04:31:04.921 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12552 fp=#0x30000000f81' 2024-08-31T04:31:04.921 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12584 fp=#0x30000000e58' 2024-08-31T04:31:04.922 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12616 fp=#0x3000000336a' 2024-08-31T04:31:04.922 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12648 fp=#0x30000000fef' 2024-08-31T04:31:04.922 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12680 fp=#0x30000000e88' 2024-08-31T04:31:04.923 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12712 fp=#0x3000000337e' 2024-08-31T04:31:04.923 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12744 fp=#0x30000003362' 2024-08-31T04:31:04.923 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12776 fp=#0x30000000ea4' 2024-08-31T04:31:04.923 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12808 fp=#0x3000000338a' 2024-08-31T04:31:04.924 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12840 fp=#0x10000004236' 2024-08-31T04:31:04.924 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12872 fp=#0x30000002820' 2024-08-31T04:31:04.924 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12904 fp=#0x1000000439b' 2024-08-31T04:31:04.925 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12936 fp=#0x3000000285e' 2024-08-31T04:31:04.925 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12968 fp=#0x10000004226' 2024-08-31T04:31:04.925 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13000 fp=#0x100000041e8' 2024-08-31T04:31:04.926 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13032 fp=#0x300000028b9' 2024-08-31T04:31:04.926 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13064 fp=#0x10000004285' 2024-08-31T04:31:04.926 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13096 fp=#0x30000003127' 2024-08-31T04:31:04.926 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13128 fp=#0x30000003161' 2024-08-31T04:31:04.927 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13160 fp=#0x3000000311c' 2024-08-31T04:31:04.928 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13288 fp=#0x30000000885' 2024-08-31T04:31:04.928 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13320 fp=#0x30000000a51' 2024-08-31T04:31:04.928 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13352 fp=#0x300000008aa' 2024-08-31T04:31:04.929 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13384 fp=#0x3000000092e' 2024-08-31T04:31:04.929 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13416 fp=#0x3000000224f' 2024-08-31T04:31:04.929 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13448 fp=#0x300000009d5' 2024-08-31T04:31:04.930 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13480 fp=#0x30000000911' 2024-08-31T04:31:04.930 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13512 fp=#0x30000002242' 2024-08-31T04:31:04.930 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13544 fp=#0x3000000222c' 2024-08-31T04:31:04.931 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13576 fp=#0x30000003321' 2024-08-31T04:31:04.931 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13608 fp=#0x3000000333f' 2024-08-31T04:31:04.931 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13640 fp=#0x30000003307' 2024-08-31T04:31:04.931 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13672 fp=#0x3000000293b' 2024-08-31T04:31:04.932 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13704 fp=#0x300000028cc' 2024-08-31T04:31:04.932 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13736 fp=#0x30000002957' 2024-08-31T04:31:04.935 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13768 fp=#0x30000002a2d' 2024-08-31T04:31:04.935 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13800 fp=#0x30000002951' 2024-08-31T04:31:04.935 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13832 fp=#0x300000028c4' 2024-08-31T04:31:04.936 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13896 fp=#0x10000003ef5' 2024-08-31T04:31:04.936 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13960 fp=#0x10000003c49' 2024-08-31T04:31:04.937 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13992 fp=#0x10000003d3a' 2024-08-31T04:31:04.937 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14024 fp=#0x10000003f15' 2024-08-31T04:31:04.938 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14056 fp=#0x30000000c79' 2024-08-31T04:31:04.938 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14088 fp=#0x30000001c54' 2024-08-31T04:31:04.938 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14120 fp=#0x300000017a9' 2024-08-31T04:31:04.938 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14152 fp=#0x30000001781' 2024-08-31T04:31:04.939 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14184 fp=#0x3000000243a' 2024-08-31T04:31:04.939 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14216 fp=#0x300000017c6' 2024-08-31T04:31:04.939 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14248 fp=#0x30000002476' 2024-08-31T04:31:04.941 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14408 fp=#0x30000000cea' 2024-08-31T04:31:04.941 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14440 fp=#0x30000000d53' 2024-08-31T04:31:04.941 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14472 fp=#0x30000000d27' 2024-08-31T04:31:04.942 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14504 fp=#0x3000000238a' 2024-08-31T04:31:04.942 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14536 fp=#0x30000000d6e' 2024-08-31T04:31:04.942 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14568 fp=#0x30000002398' 2024-08-31T04:31:04.942 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14600 fp=#0x1000000240b' 2024-08-31T04:31:04.943 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14632 fp=#0x30000002fba' 2024-08-31T04:31:04.943 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14664 fp=#0x1000000242f' 2024-08-31T04:31:04.943 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14696 fp=#0x1000000249a' 2024-08-31T04:31:04.944 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14728 fp=#0x100000023ed' 2024-08-31T04:31:04.944 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14760 fp=#0x100000023f7' 2024-08-31T04:31:04.944 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14791 fp=#0x10000003ba1' 2024-08-31T04:31:04.945 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14823 fp=#0x10000003b92' 2024-08-31T04:31:04.945 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14855 fp=#0x30000000a3d' 2024-08-31T04:31:04.945 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14887 fp=#0x30000000966' 2024-08-31T04:31:04.946 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14919 fp=#0x3000000093d' 2024-08-31T04:31:04.946 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14951 fp=#0x30000000a08' 2024-08-31T04:31:04.946 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14983 fp=#0x30000001575' 2024-08-31T04:31:04.946 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15015 fp=#0x3000000167d' 2024-08-31T04:31:04.947 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15047 fp=#0x3000000153d' 2024-08-31T04:31:04.947 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15079 fp=#0x30000001694' 2024-08-31T04:31:04.947 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15111 fp=#0x3000000341d' 2024-08-31T04:31:04.948 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15143 fp=#0x30000003393' 2024-08-31T04:31:04.948 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15175 fp=#0x30000003382' 2024-08-31T04:31:04.948 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15207 fp=#0x30000002ebe' 2024-08-31T04:31:04.949 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15239 fp=#0x30000002eb7' 2024-08-31T04:31:04.949 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15271 fp=#0x30000002ebf' 2024-08-31T04:31:04.949 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15303 fp=#0x30000002ea2' 2024-08-31T04:31:04.949 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15335 fp=#0x30000002ef2' 2024-08-31T04:31:04.950 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15367 fp=#0x300000032da' 2024-08-31T04:31:04.950 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15399 fp=#0x300000032c4' 2024-08-31T04:31:04.950 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15431 fp=#0x30000000eff' 2024-08-31T04:31:04.951 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15463 fp=#0x30000000f23' 2024-08-31T04:31:04.951 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15495 fp=#0x30000001dcc' 2024-08-31T04:31:04.951 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15527 fp=#0x30000000f26' 2024-08-31T04:31:04.952 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15559 fp=#0x30000000ec0' 2024-08-31T04:31:04.952 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15591 fp=#0x30000001da1' 2024-08-31T04:31:04.952 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15655 fp=#0x300000005cd' 2024-08-31T04:31:04.953 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15719 fp=#0x300000005ec' 2024-08-31T04:31:04.954 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15846 fp=#0x300000014e0' 2024-08-31T04:31:04.954 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15878 fp=#0x300000012f1' 2024-08-31T04:31:04.954 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15910 fp=#0x300000014f6' 2024-08-31T04:31:04.955 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15942 fp=#0x30000001279' 2024-08-31T04:31:04.955 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15974 fp=#0x30000001307' 2024-08-31T04:31:04.955 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16006 fp=#0x300000010a7' 2024-08-31T04:31:04.955 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16038 fp=#0x30000001008' 2024-08-31T04:31:04.956 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16070 fp=#0x30000002df1' 2024-08-31T04:31:04.956 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16102 fp=#0x3000000181c' 2024-08-31T04:31:04.957 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16198 fp=#0x30000000639' 2024-08-31T04:31:04.958 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16294 fp=#0x30000003506' 2024-08-31T04:31:04.958 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16323 fp=#0x30000000276' 2024-08-31T04:31:04.958 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16355 fp=#0x1000000285f' 2024-08-31T04:31:04.959 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16387 fp=#0x1000000281e' 2024-08-31T04:31:04.959 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16419 fp=#0x30000002082' 2024-08-31T04:31:04.959 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16451 fp=#0x30000001d3b' 2024-08-31T04:31:04.960 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16483 fp=#0x100000024b1' 2024-08-31T04:31:04.960 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16515 fp=#0x30000001d34' 2024-08-31T04:31:04.960 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16547 fp=#0x10000002505' 2024-08-31T04:31:04.961 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16579 fp=#0x30000001cf7' 2024-08-31T04:31:04.961 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16611 fp=#0x30000001d3d' 2024-08-31T04:31:04.961 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16642 fp=#0x30000002101' 2024-08-31T04:31:04.961 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16674 fp=#0x3000000211c' 2024-08-31T04:31:04.962 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16706 fp=#0x3000000221c' 2024-08-31T04:31:04.962 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16738 fp=#0x3000000260a' 2024-08-31T04:31:04.963 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16802 fp=#0x30000001957' 2024-08-31T04:31:04.963 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16834 fp=#0x300000019c5' 2024-08-31T04:31:04.963 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16898 fp=#0x30000001a24' 2024-08-31T04:31:04.964 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16929 fp=#0x30000001ad7' 2024-08-31T04:31:04.964 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16961 fp=#0x30000001a4a' 2024-08-31T04:31:04.964 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16993 fp=#0x30000002b51' 2024-08-31T04:31:04.965 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17018 fp=#0x10000003645' 2024-08-31T04:31:04.965 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17050 fp=#0x100000036bb' 2024-08-31T04:31:04.965 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17082 fp=#0x100000036e7' 2024-08-31T04:31:04.966 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17114 fp=#0x100000036de' 2024-08-31T04:31:04.966 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17146 fp=#0x30000001743' 2024-08-31T04:31:04.966 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17178 fp=#0x300000017f7' 2024-08-31T04:31:04.967 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17210 fp=#0x3000000174b' 2024-08-31T04:31:04.967 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17242 fp=#0x30000001726' 2024-08-31T04:31:04.967 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17274 fp=#0x3000000175a' 2024-08-31T04:31:04.968 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17306 fp=#0x30000001770' 2024-08-31T04:31:04.968 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17338 fp=#0x30000003325' 2024-08-31T04:31:04.968 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17370 fp=#0x30000003336' 2024-08-31T04:31:04.969 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17530 fp=#0x30000000dfa' 2024-08-31T04:31:04.970 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17562 fp=#0x30000000da6' 2024-08-31T04:31:04.970 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17594 fp=#0x300000031c2' 2024-08-31T04:31:04.970 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17626 fp=#0x30000000dae' 2024-08-31T04:31:04.971 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17658 fp=#0x300000031fb' 2024-08-31T04:31:04.972 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17786 fp=#0x30000001f53' 2024-08-31T04:31:04.972 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17818 fp=#0x30000002026' 2024-08-31T04:31:04.972 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17850 fp=#0x30000001f8b' 2024-08-31T04:31:04.973 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17882 fp=#0x30000001ff5' 2024-08-31T04:31:04.973 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17914 fp=#0x30000001f4b' 2024-08-31T04:31:04.973 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17946 fp=#0x3000000312c' 2024-08-31T04:31:04.974 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17978 fp=#0x30000003093' 2024-08-31T04:31:04.974 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18010 fp=#0x30000001c41' 2024-08-31T04:31:04.974 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18042 fp=#0x30000001c23' 2024-08-31T04:31:04.975 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18074 fp=#0x30000001bf5' 2024-08-31T04:31:04.975 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18106 fp=#0x30000002528' 2024-08-31T04:31:04.975 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18138 fp=#0x30000002599' 2024-08-31T04:31:04.976 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18170 fp=#0x30000002541' 2024-08-31T04:31:04.976 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18202 fp=#0x3000000259e' 2024-08-31T04:31:04.976 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18234 fp=#0x3000000259a' 2024-08-31T04:31:04.977 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18266 fp=#0x300000027d5' 2024-08-31T04:31:04.977 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18298 fp=#0x3000000280f' 2024-08-31T04:31:04.977 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18330 fp=#0x300000027d2' 2024-08-31T04:31:04.977 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18362 fp=#0x300000027dc' 2024-08-31T04:31:04.978 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18394 fp=#0x30000002f13' 2024-08-31T04:31:04.978 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18426 fp=#0x30000002f48' 2024-08-31T04:31:04.978 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18458 fp=#0x30000002f17' 2024-08-31T04:31:04.979 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18490 fp=#0x30000003030' 2024-08-31T04:31:04.979 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18522 fp=#0x30000002fe7' 2024-08-31T04:31:04.979 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18554 fp=#0x10000001d65' 2024-08-31T04:31:04.980 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18586 fp=#0x10000001d56' 2024-08-31T04:31:04.981 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18714 fp=#0x300000013d0' 2024-08-31T04:31:04.981 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18746 fp=#0x30000001fb9' 2024-08-31T04:31:04.981 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18778 fp=#0x30000001369' 2024-08-31T04:31:04.981 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18810 fp=#0x300000013d1' 2024-08-31T04:31:04.982 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18842 fp=#0x300000014c5' 2024-08-31T04:31:04.982 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18874 fp=#0x3000000135f' 2024-08-31T04:31:04.982 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18906 fp=#0x300000010e2' 2024-08-31T04:31:04.983 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18938 fp=#0x30000001088' 2024-08-31T04:31:04.983 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18970 fp=#0x30000001d80' 2024-08-31T04:31:04.983 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19002 fp=#0x30000001d7d' 2024-08-31T04:31:04.984 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19034 fp=#0x300000010f6' 2024-08-31T04:31:04.984 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19066 fp=#0x300000011df' 2024-08-31T04:31:04.984 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19098 fp=#0x30000001200' 2024-08-31T04:31:04.985 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19130 fp=#0x3000000119e' 2024-08-31T04:31:04.985 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19162 fp=#0x30000001643' 2024-08-31T04:31:04.985 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19194 fp=#0x30000001679' 2024-08-31T04:31:04.986 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19226 fp=#0x30000001619' 2024-08-31T04:31:04.986 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19258 fp=#0x30000001638' 2024-08-31T04:31:04.986 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19290 fp=#0x30000002ba4' 2024-08-31T04:31:04.986 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19322 fp=#0x100000008b2' 2024-08-31T04:31:04.987 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19354 fp=#0x100000008f1' 2024-08-31T04:31:04.987 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19386 fp=#0x30000001523' 2024-08-31T04:31:04.987 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19418 fp=#0x100000008e4' 2024-08-31T04:31:04.988 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19449 fp=#0x30000000b6f' 2024-08-31T04:31:04.988 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19481 fp=#0x30000000ba0' 2024-08-31T04:31:04.988 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19513 fp=#0x30000000bd9' 2024-08-31T04:31:04.989 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19545 fp=#0x30000000bb3' 2024-08-31T04:31:04.989 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19577 fp=#0x30000000b13' 2024-08-31T04:31:04.989 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19609 fp=#0x30000000aeb' 2024-08-31T04:31:04.990 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19641 fp=#0x30000000a89' 2024-08-31T04:31:04.990 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19673 fp=#0x30000002c7f' 2024-08-31T04:31:04.990 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19705 fp=#0x30000002ca6' 2024-08-31T04:31:04.990 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19737 fp=#0x30000002c23' 2024-08-31T04:31:04.991 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19769 fp=#0x30000002d1a' 2024-08-31T04:31:04.991 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19801 fp=#0x30000002d51' 2024-08-31T04:31:04.991 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19833 fp=#0x30000001460' 2024-08-31T04:31:04.992 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19865 fp=#0x300000011da' 2024-08-31T04:31:04.992 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19897 fp=#0x30000001148' 2024-08-31T04:31:04.992 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19929 fp=#0x3000000145e' 2024-08-31T04:31:04.993 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19961 fp=#0x30000001408' 2024-08-31T04:31:04.993 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19993 fp=#0x30000001422' 2024-08-31T04:31:04.993 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20025 fp=#0x30000001403' 2024-08-31T04:31:04.994 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20057 fp=#0x30000000fe3' 2024-08-31T04:31:04.994 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20089 fp=#0x30000000fae' 2024-08-31T04:31:04.994 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20121 fp=#0x3000000170c' 2024-08-31T04:31:04.995 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20153 fp=#0x300000016ea' 2024-08-31T04:31:04.995 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20185 fp=#0x30000001705' 2024-08-31T04:31:04.995 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20217 fp=#0x300000016d1' 2024-08-31T04:31:04.996 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20249 fp=#0x30000003280' 2024-08-31T04:31:04.996 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20281 fp=#0x30000003156' 2024-08-31T04:31:04.996 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20313 fp=#0x300000031a8' 2024-08-31T04:31:04.997 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20345 fp=#0x30000003055' 2024-08-31T04:31:04.997 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20377 fp=#0x300000030a9' 2024-08-31T04:31:04.997 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20409 fp=#0x30000001cbc' 2024-08-31T04:31:04.997 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20441 fp=#0x30000001caf' 2024-08-31T04:31:04.998 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20473 fp=#0x30000001c90' 2024-08-31T04:31:04.998 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20505 fp=#0x30000001cad' 2024-08-31T04:31:04.998 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20537 fp=#0x3000000124e' 2024-08-31T04:31:04.999 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20569 fp=#0x3000000121e' 2024-08-31T04:31:04.999 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20601 fp=#0x30000001240' 2024-08-31T04:31:05.000 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20761 fp=#0x1000000386b' 2024-08-31T04:31:05.001 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20825 fp=#0x300000030ef' 2024-08-31T04:31:05.001 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20921 fp=#0x30000003077' 2024-08-31T04:31:05.002 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20953 fp=#0x10000003737' 2024-08-31T04:31:05.002 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20985 fp=#0x300000020cb' 2024-08-31T04:31:05.002 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21017 fp=#0x30000002bdf' 2024-08-31T04:31:05.003 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21048 fp=#0x3000000154d' 2024-08-31T04:31:05.003 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21080 fp=#0x3000000168d' 2024-08-31T04:31:05.003 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21112 fp=#0x30000001642' 2024-08-31T04:31:05.004 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21208 fp=#0x30000002bc0' 2024-08-31T04:31:05.004 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21240 fp=#0x3000000183c' 2024-08-31T04:31:05.005 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21304 fp=#0x10000003393' 2024-08-31T04:31:05.005 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21336 fp=#0x10000003345' 2024-08-31T04:31:05.005 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21368 fp=#0x10000003243' 2024-08-31T04:31:05.006 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21400 fp=#0x10000003289' 2024-08-31T04:31:05.006 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21432 fp=#0x10000003269' 2024-08-31T04:31:05.006 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21464 fp=#0x300000026d9' 2024-08-31T04:31:05.007 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21496 fp=#0x30000002727' 2024-08-31T04:31:05.007 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21528 fp=#0x3000000270b' 2024-08-31T04:31:05.007 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21560 fp=#0x300000025f4' 2024-08-31T04:31:05.008 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21592 fp=#0x3000000370a' 2024-08-31T04:31:05.008 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21624 fp=#0x30000000d25' 2024-08-31T04:31:05.008 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21656 fp=#0x30000000cb4' 2024-08-31T04:31:05.009 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21688 fp=#0x30000000d05' 2024-08-31T04:31:05.009 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21720 fp=#0x30000000d2e' 2024-08-31T04:31:05.009 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21752 fp=#0x30000000cc2' 2024-08-31T04:31:05.010 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21784 fp=#0x30000000b49' 2024-08-31T04:31:05.010 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21816 fp=#0x30000000b4e' 2024-08-31T04:31:05.010 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21848 fp=#0x30000000b47' 2024-08-31T04:31:05.010 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21880 fp=#0x300000008f6' 2024-08-31T04:31:05.011 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21912 fp=#0x30000000917' 2024-08-31T04:31:05.011 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21976 fp=#0x30000000534' 2024-08-31T04:31:05.012 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22008 fp=#0x3000000053a' 2024-08-31T04:31:05.012 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22039 fp=#0x3000000191c' 2024-08-31T04:31:05.012 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22071 fp=#0x30000001943' 2024-08-31T04:31:05.013 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22103 fp=#0x30000001932' 2024-08-31T04:31:05.013 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22135 fp=#0x30000002942' 2024-08-31T04:31:05.013 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22167 fp=#0x300000028c5' 2024-08-31T04:31:05.014 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22199 fp=#0x30000002991' 2024-08-31T04:31:05.014 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22231 fp=#0x30000002975' 2024-08-31T04:31:05.014 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22263 fp=#0x300000020a2' 2024-08-31T04:31:05.015 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22295 fp=#0x30000001ffe' 2024-08-31T04:31:05.015 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22327 fp=#0x30000002060' 2024-08-31T04:31:05.015 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22359 fp=#0x30000002077' 2024-08-31T04:31:05.016 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22391 fp=#0x300000004a5' 2024-08-31T04:31:05.016 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22423 fp=#0x3000000042f' 2024-08-31T04:31:05.016 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22455 fp=#0x3000000041f' 2024-08-31T04:31:05.017 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22487 fp=#0x30000000419' 2024-08-31T04:31:05.017 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22544 fp=#0x30000002bf4' 2024-08-31T04:31:05.017 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22576 fp=#0x30000002bd0' 2024-08-31T04:31:05.018 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22607 fp=#0x10000000fed' 2024-08-31T04:31:05.018 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22639 fp=#0x300000033bf' 2024-08-31T04:31:05.018 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22671 fp=#0x300000033d1' 2024-08-31T04:31:05.019 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:9801 fp=#0x100000024a0' 2024-08-31T04:31:05.020 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:9897 fp=#0x30000001708' 2024-08-31T04:31:05.025 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:10473 fp=#0x3000000087c' 2024-08-31T04:31:05.027 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:10697 fp=#0x30000000a80' 2024-08-31T04:31:05.027 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:10761 fp=#0x30000000a68' 2024-08-31T04:31:05.027 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:10793 fp=#0x30000000a72' 2024-08-31T04:31:05.035 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:11817 fp=#0x300000023cf' 2024-08-31T04:31:05.036 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:11849 fp=#0x300000023c9' 2024-08-31T04:31:05.036 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:11913 fp=#0x30000001034' 2024-08-31T04:31:05.037 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:11945 fp=#0x300000011b3' 2024-08-31T04:31:05.037 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:11977 fp=#0x30000001140' 2024-08-31T04:31:05.038 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12041 fp=#0x300000010ee' 2024-08-31T04:31:05.038 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12073 fp=#0x30000003219' 2024-08-31T04:31:05.038 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12105 fp=#0x300000010cd' 2024-08-31T04:31:05.040 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12265 fp=#0x3000000095e' 2024-08-31T04:31:05.041 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12393 fp=#0x300000009d0' 2024-08-31T04:31:05.041 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12425 fp=#0x30000002e15' 2024-08-31T04:31:05.041 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12457 fp=#0x30000002e45' 2024-08-31T04:31:05.042 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12489 fp=#0x30000000f94' 2024-08-31T04:31:05.042 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12521 fp=#0x30000000f44' 2024-08-31T04:31:05.042 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12553 fp=#0x30000000f42' 2024-08-31T04:31:05.043 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12585 fp=#0x30000000ff9' 2024-08-31T04:31:05.043 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12617 fp=#0x30000000e5b' 2024-08-31T04:31:05.044 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12649 fp=#0x30000000eac' 2024-08-31T04:31:05.044 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12681 fp=#0x30000000e3a' 2024-08-31T04:31:05.044 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12713 fp=#0x3000000338e' 2024-08-31T04:31:05.045 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12745 fp=#0x30000000e63' 2024-08-31T04:31:05.045 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12777 fp=#0x30000000e21' 2024-08-31T04:31:05.045 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12809 fp=#0x30000000ea0' 2024-08-31T04:31:05.046 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12841 fp=#0x1000000441b' 2024-08-31T04:31:05.046 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12905 fp=#0x100000041df' 2024-08-31T04:31:05.046 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12937 fp=#0x10000004397' 2024-08-31T04:31:05.047 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12969 fp=#0x30000002849' 2024-08-31T04:31:05.047 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13001 fp=#0x100000043f1' 2024-08-31T04:31:05.047 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13033 fp=#0x1000000421e' 2024-08-31T04:31:05.048 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13065 fp=#0x30000002853' 2024-08-31T04:31:05.048 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13097 fp=#0x30000003196' 2024-08-31T04:31:05.048 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13129 fp=#0x300000030b3' 2024-08-31T04:31:05.049 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13161 fp=#0x300000030fc' 2024-08-31T04:31:05.050 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13289 fp=#0x30000000a49' 2024-08-31T04:31:05.050 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13321 fp=#0x300000021fc' 2024-08-31T04:31:05.051 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13353 fp=#0x300000009cf' 2024-08-31T04:31:05.051 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13385 fp=#0x30000000887' 2024-08-31T04:31:05.051 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13417 fp=#0x30000000904' 2024-08-31T04:31:05.052 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13449 fp=#0x300000008d3' 2024-08-31T04:31:05.052 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13481 fp=#0x300000008bb' 2024-08-31T04:31:05.052 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13513 fp=#0x300000008b7' 2024-08-31T04:31:05.053 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13545 fp=#0x300000008ca' 2024-08-31T04:31:05.053 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13577 fp=#0x30000003304' 2024-08-31T04:31:05.053 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13609 fp=#0x300000032ff' 2024-08-31T04:31:05.054 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13641 fp=#0x30000003315' 2024-08-31T04:31:05.054 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13673 fp=#0x30000002a3f' 2024-08-31T04:31:05.054 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13705 fp=#0x300000028c6' 2024-08-31T04:31:05.055 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13737 fp=#0x3000000290e' 2024-08-31T04:31:05.055 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13769 fp=#0x300000029ad' 2024-08-31T04:31:05.055 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13801 fp=#0x30000002906' 2024-08-31T04:31:05.055 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13833 fp=#0x3000000291c' 2024-08-31T04:31:05.056 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13865 fp=#0x10000003dab' 2024-08-31T04:31:05.056 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13897 fp=#0x10000003d7c' 2024-08-31T04:31:05.057 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13961 fp=#0x10000003bdc' 2024-08-31T04:31:05.057 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13993 fp=#0x10000003c3e' 2024-08-31T04:31:05.057 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14025 fp=#0x10000003efc' 2024-08-31T04:31:05.058 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14057 fp=#0x30000000c80' 2024-08-31T04:31:05.058 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14089 fp=#0x30000002bf0' 2024-08-31T04:31:05.059 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14121 fp=#0x3000000248b' 2024-08-31T04:31:05.059 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14153 fp=#0x30000002028' 2024-08-31T04:31:05.059 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14185 fp=#0x3000000246a' 2024-08-31T04:31:05.060 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14217 fp=#0x300000017a1' 2024-08-31T04:31:05.060 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14249 fp=#0x30000002431' 2024-08-31T04:31:05.061 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14409 fp=#0x30000000d99' 2024-08-31T04:31:05.062 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14441 fp=#0x30000000d79' 2024-08-31T04:31:05.062 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14473 fp=#0x30000000cd1' 2024-08-31T04:31:05.062 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14505 fp=#0x30000002391' 2024-08-31T04:31:05.063 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14537 fp=#0x30000000d14' 2024-08-31T04:31:05.063 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14569 fp=#0x30000002393' 2024-08-31T04:31:05.063 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14601 fp=#0x1000000246d' 2024-08-31T04:31:05.064 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14633 fp=#0x30000002fc3' 2024-08-31T04:31:05.064 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14665 fp=#0x10000002485' 2024-08-31T04:31:05.064 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14697 fp=#0x30000002fa4' 2024-08-31T04:31:05.065 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14729 fp=#0x1000000247d' 2024-08-31T04:31:05.065 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14761 fp=#0x30000002fcf' 2024-08-31T04:31:05.065 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14792 fp=#0x10000003c1f' 2024-08-31T04:31:05.066 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14824 fp=#0x10000003be8' 2024-08-31T04:31:05.066 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14856 fp=#0x30000000908' 2024-08-31T04:31:05.066 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14888 fp=#0x30000000a3e' 2024-08-31T04:31:05.067 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14920 fp=#0x300000009dc' 2024-08-31T04:31:05.067 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14952 fp=#0x30000000902' 2024-08-31T04:31:05.067 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14984 fp=#0x3000000169e' 2024-08-31T04:31:05.068 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15016 fp=#0x300000014d2' 2024-08-31T04:31:05.068 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15048 fp=#0x3000000154f' 2024-08-31T04:31:05.068 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15080 fp=#0x3000000153a' 2024-08-31T04:31:05.069 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15112 fp=#0x3000000343f' 2024-08-31T04:31:05.069 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15144 fp=#0x300000033e0' 2024-08-31T04:31:05.069 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15176 fp=#0x3000000342b' 2024-08-31T04:31:05.070 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15208 fp=#0x30000002e8f' 2024-08-31T04:31:05.070 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15240 fp=#0x30000002eaf' 2024-08-31T04:31:05.070 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15272 fp=#0x30000002f0b' 2024-08-31T04:31:05.071 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15304 fp=#0x30000002ee3' 2024-08-31T04:31:05.071 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15336 fp=#0x30000002ea0' 2024-08-31T04:31:05.071 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15368 fp=#0x300000032bd' 2024-08-31T04:31:05.072 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15400 fp=#0x300000032bf' 2024-08-31T04:31:05.072 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15432 fp=#0x30000000f36' 2024-08-31T04:31:05.072 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15464 fp=#0x30000000ee0' 2024-08-31T04:31:05.073 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15496 fp=#0x30000001dc4' 2024-08-31T04:31:05.073 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15528 fp=#0x30000000eed' 2024-08-31T04:31:05.073 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15560 fp=#0x30000000f1e' 2024-08-31T04:31:05.074 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15592 fp=#0x30000001da8' 2024-08-31T04:31:05.074 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15656 fp=#0x30000000556' 2024-08-31T04:31:05.075 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15752 fp=#0x30000000539' 2024-08-31T04:31:05.076 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15847 fp=#0x300000012e2' 2024-08-31T04:31:05.076 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15879 fp=#0x3000000128a' 2024-08-31T04:31:05.076 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15911 fp=#0x300000012eb' 2024-08-31T04:31:05.077 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15943 fp=#0x300000012ea' 2024-08-31T04:31:05.077 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15975 fp=#0x3000000128d' 2024-08-31T04:31:05.077 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16007 fp=#0x30000001056' 2024-08-31T04:31:05.078 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16039 fp=#0x3000000108c' 2024-08-31T04:31:05.078 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16071 fp=#0x3000000183b' 2024-08-31T04:31:05.078 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16103 fp=#0x30000001823' 2024-08-31T04:31:05.079 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16135 fp=#0x30000000633' 2024-08-31T04:31:05.079 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16167 fp=#0x3000000063e' 2024-08-31T04:31:05.079 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16199 fp=#0x300000034f3' 2024-08-31T04:31:05.079 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16231 fp=#0x300000005d6' 2024-08-31T04:31:05.080 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16295 fp=#0x300000034ed' 2024-08-31T04:31:05.080 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16324 fp=#0x10000002856' 2024-08-31T04:31:05.081 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16356 fp=#0x300000020c1' 2024-08-31T04:31:05.081 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16388 fp=#0x1000000281d' 2024-08-31T04:31:05.081 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16420 fp=#0x300000020c3' 2024-08-31T04:31:05.082 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16452 fp=#0x30000001d27' 2024-08-31T04:31:05.082 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16484 fp=#0x30000001d01' 2024-08-31T04:31:05.082 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16516 fp=#0x30000001cf9' 2024-08-31T04:31:05.083 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16548 fp=#0x30000001d26' 2024-08-31T04:31:05.083 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16580 fp=#0x30000001d4e' 2024-08-31T04:31:05.083 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16612 fp=#0x100000024b5' 2024-08-31T04:31:05.084 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16643 fp=#0x30000002117' 2024-08-31T04:31:05.084 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16675 fp=#0x300000021a2' 2024-08-31T04:31:05.084 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16707 fp=#0x300000022cb' 2024-08-31T04:31:05.084 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16739 fp=#0x3000000267a' 2024-08-31T04:31:05.085 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16803 fp=#0x30000001a33' 2024-08-31T04:31:05.085 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16835 fp=#0x30000001a1b' 2024-08-31T04:31:05.086 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16867 fp=#0x30000001954' 2024-08-31T04:31:05.086 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16899 fp=#0x30000001959' 2024-08-31T04:31:05.086 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16930 fp=#0x30000001b00' 2024-08-31T04:31:05.087 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16962 fp=#0x30000001af2' 2024-08-31T04:31:05.087 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16994 fp=#0x30000002b78' 2024-08-31T04:31:05.087 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17019 fp=#0x1000000368c' 2024-08-31T04:31:05.088 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17051 fp=#0x100000036d5' 2024-08-31T04:31:05.088 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17083 fp=#0x100000036ad' 2024-08-31T04:31:05.088 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17115 fp=#0x10000003605' 2024-08-31T04:31:05.089 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17147 fp=#0x30000001768' 2024-08-31T04:31:05.089 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17179 fp=#0x300000017df' 2024-08-31T04:31:05.089 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17211 fp=#0x30000002cae' 2024-08-31T04:31:05.090 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17243 fp=#0x3000000172c' 2024-08-31T04:31:05.090 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17275 fp=#0x300000017ce' 2024-08-31T04:31:05.090 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17307 fp=#0x300000017bd' 2024-08-31T04:31:05.091 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17339 fp=#0x3000000334f' 2024-08-31T04:31:05.091 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17371 fp=#0x30000003329' 2024-08-31T04:31:05.092 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17531 fp=#0x300000031f4' 2024-08-31T04:31:05.092 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17563 fp=#0x30000000dcf' 2024-08-31T04:31:05.093 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17595 fp=#0x300000031ac' 2024-08-31T04:31:05.093 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17627 fp=#0x30000000da8' 2024-08-31T04:31:05.093 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17659 fp=#0x30000000dea' 2024-08-31T04:31:05.094 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17787 fp=#0x30000002045' 2024-08-31T04:31:05.095 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17819 fp=#0x3000000200e' 2024-08-31T04:31:05.095 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17851 fp=#0x30000001f5e' 2024-08-31T04:31:05.095 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17883 fp=#0x30000001f69' 2024-08-31T04:31:05.096 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17915 fp=#0x30000001fec' 2024-08-31T04:31:05.096 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17947 fp=#0x30000003097' 2024-08-31T04:31:05.096 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17979 fp=#0x30000003104' 2024-08-31T04:31:05.097 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18011 fp=#0x30000001c06' 2024-08-31T04:31:05.097 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18043 fp=#0x30000001c2a' 2024-08-31T04:31:05.097 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18075 fp=#0x30000001c21' 2024-08-31T04:31:05.098 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18107 fp=#0x30000002564' 2024-08-31T04:31:05.098 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18139 fp=#0x30000002573' 2024-08-31T04:31:05.098 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18171 fp=#0x3000000255a' 2024-08-31T04:31:05.099 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18203 fp=#0x3000000257e' 2024-08-31T04:31:05.099 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18235 fp=#0x30000002525' 2024-08-31T04:31:05.099 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18267 fp=#0x30000002894' 2024-08-31T04:31:05.100 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18299 fp=#0x30000002852' 2024-08-31T04:31:05.100 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18331 fp=#0x300000027ba' 2024-08-31T04:31:05.100 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18363 fp=#0x30000002856' 2024-08-31T04:31:05.101 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18395 fp=#0x30000002f27' 2024-08-31T04:31:05.101 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18427 fp=#0x30000003007' 2024-08-31T04:31:05.101 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18459 fp=#0x30000003002' 2024-08-31T04:31:05.102 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18491 fp=#0x30000002fe6' 2024-08-31T04:31:05.102 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18523 fp=#0x3000000300e' 2024-08-31T04:31:05.102 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18555 fp=#0x10000001d0d' 2024-08-31T04:31:05.103 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18651 fp=#0x10000001d48' 2024-08-31T04:31:05.104 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18715 fp=#0x30000001513' 2024-08-31T04:31:05.104 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18747 fp=#0x300000013a4' 2024-08-31T04:31:05.104 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18779 fp=#0x30000001373' 2024-08-31T04:31:05.105 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18811 fp=#0x3000000137e' 2024-08-31T04:31:05.105 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18843 fp=#0x30000001339' 2024-08-31T04:31:05.105 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18875 fp=#0x300000013dd' 2024-08-31T04:31:05.106 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18907 fp=#0x30000001d73' 2024-08-31T04:31:05.106 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18939 fp=#0x30000001d8f' 2024-08-31T04:31:05.106 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18971 fp=#0x30000001d63' 2024-08-31T04:31:05.107 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19003 fp=#0x300000010ef' 2024-08-31T04:31:05.107 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19035 fp=#0x30000001d91' 2024-08-31T04:31:05.107 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19067 fp=#0x30000001129' 2024-08-31T04:31:05.107 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19099 fp=#0x3000000117b' 2024-08-31T04:31:05.108 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19131 fp=#0x300000011d8' 2024-08-31T04:31:05.108 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19163 fp=#0x3000000167f' 2024-08-31T04:31:05.109 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19259 fp=#0x3000000166b' 2024-08-31T04:31:05.109 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19291 fp=#0x100000008ea' 2024-08-31T04:31:05.110 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19323 fp=#0x30000002ba5' 2024-08-31T04:31:05.110 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19355 fp=#0x3000000150e' 2024-08-31T04:31:05.110 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19387 fp=#0x100000008d4' 2024-08-31T04:31:05.110 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19419 fp=#0x30000002bc1' 2024-08-31T04:31:05.111 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19450 fp=#0x30000000bbf' 2024-08-31T04:31:05.111 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19482 fp=#0x30000000b98' 2024-08-31T04:31:05.111 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19514 fp=#0x30000000b9a' 2024-08-31T04:31:05.112 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19546 fp=#0x30000000b9d' 2024-08-31T04:31:05.112 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19578 fp=#0x30000000b02' 2024-08-31T04:31:05.112 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19610 fp=#0x30000000af2' 2024-08-31T04:31:05.113 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19642 fp=#0x30000000b04' 2024-08-31T04:31:05.113 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19674 fp=#0x30000002de4' 2024-08-31T04:31:05.113 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19706 fp=#0x30000002bfd' 2024-08-31T04:31:05.114 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19738 fp=#0x30000002c2d' 2024-08-31T04:31:05.114 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19770 fp=#0x30000002cd8' 2024-08-31T04:31:05.114 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19802 fp=#0x30000002d2f' 2024-08-31T04:31:05.115 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19834 fp=#0x30000001457' 2024-08-31T04:31:05.115 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19866 fp=#0x300000011e4' 2024-08-31T04:31:05.115 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19898 fp=#0x300000011bb' 2024-08-31T04:31:05.116 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19930 fp=#0x30000001456' 2024-08-31T04:31:05.116 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19962 fp=#0x30000001435' 2024-08-31T04:31:05.116 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19994 fp=#0x30000001405' 2024-08-31T04:31:05.117 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20026 fp=#0x3000000141b' 2024-08-31T04:31:05.117 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20058 fp=#0x30000000fdc' 2024-08-31T04:31:05.117 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20090 fp=#0x30000002fe0' 2024-08-31T04:31:05.118 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20122 fp=#0x300000016bd' 2024-08-31T04:31:05.118 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20154 fp=#0x30000001729' 2024-08-31T04:31:05.118 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20186 fp=#0x300000016c4' 2024-08-31T04:31:05.119 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20218 fp=#0x300000016b8' 2024-08-31T04:31:05.119 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20250 fp=#0x3000000317b' 2024-08-31T04:31:05.119 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20282 fp=#0x30000003137' 2024-08-31T04:31:05.120 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20314 fp=#0x30000003153' 2024-08-31T04:31:05.120 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20346 fp=#0x30000003111' 2024-08-31T04:31:05.120 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20378 fp=#0x30000003192' 2024-08-31T04:31:05.121 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20410 fp=#0x30000001ca4' 2024-08-31T04:31:05.121 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20442 fp=#0x30000001ceb' 2024-08-31T04:31:05.121 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20474 fp=#0x30000001ca0' 2024-08-31T04:31:05.122 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20538 fp=#0x3000000125c' 2024-08-31T04:31:05.122 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20570 fp=#0x30000001221' 2024-08-31T04:31:05.122 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20602 fp=#0x30000001232' 2024-08-31T04:31:05.123 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20730 fp=#0x3000000217d' 2024-08-31T04:31:05.124 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20794 fp=#0x10000003842' 2024-08-31T04:31:05.124 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20826 fp=#0x10000003751' 2024-08-31T04:31:05.124 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20858 fp=#0x300000030d9' 2024-08-31T04:31:05.125 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20986 fp=#0x300000020d2' 2024-08-31T04:31:05.126 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21018 fp=#0x300000020c5' 2024-08-31T04:31:05.126 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21049 fp=#0x30000001542' 2024-08-31T04:31:05.127 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21081 fp=#0x3000000165a' 2024-08-31T04:31:05.127 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21113 fp=#0x30000001639' 2024-08-31T04:31:05.128 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21209 fp=#0x30000002c1a' 2024-08-31T04:31:05.128 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21241 fp=#0x300000004be' 2024-08-31T04:31:05.128 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21273 fp=#0x30000002c2b' 2024-08-31T04:31:05.128 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21305 fp=#0x10000003353' 2024-08-31T04:31:05.129 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21337 fp=#0x100000032f1' 2024-08-31T04:31:05.129 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21369 fp=#0x100000032cf' 2024-08-31T04:31:05.129 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21401 fp=#0x1000000337b' 2024-08-31T04:31:05.130 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21433 fp=#0x10000003270' 2024-08-31T04:31:05.130 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21465 fp=#0x3000000273e' 2024-08-31T04:31:05.130 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21497 fp=#0x30000002605' 2024-08-31T04:31:05.131 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21529 fp=#0x30000002626' 2024-08-31T04:31:05.131 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21561 fp=#0x3000000271d' 2024-08-31T04:31:05.131 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21593 fp=#0x30000000d34' 2024-08-31T04:31:05.132 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21625 fp=#0x30000000d13' 2024-08-31T04:31:05.132 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21657 fp=#0x30000000d54' 2024-08-31T04:31:05.132 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21689 fp=#0x30000003680' 2024-08-31T04:31:05.133 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21721 fp=#0x30000003681' 2024-08-31T04:31:05.133 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21753 fp=#0x30000003696' 2024-08-31T04:31:05.133 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21785 fp=#0x30000000b52' 2024-08-31T04:31:05.134 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21817 fp=#0x30000000ac0' 2024-08-31T04:31:05.134 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21849 fp=#0x30000000ad0' 2024-08-31T04:31:05.134 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21881 fp=#0x30000000546' 2024-08-31T04:31:05.134 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21913 fp=#0x3000000091e' 2024-08-31T04:31:05.135 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21945 fp=#0x300000004fd' 2024-08-31T04:31:05.135 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21977 fp=#0x30000000513' 2024-08-31T04:31:05.135 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22009 fp=#0x30000000549' 2024-08-31T04:31:05.136 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22040 fp=#0x30000001902' 2024-08-31T04:31:05.136 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22072 fp=#0x30000002f81' 2024-08-31T04:31:05.136 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22104 fp=#0x30000001920' 2024-08-31T04:31:05.137 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22136 fp=#0x300000029ab' 2024-08-31T04:31:05.137 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22168 fp=#0x300000028e8' 2024-08-31T04:31:05.137 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22200 fp=#0x3000000291f' 2024-08-31T04:31:05.137 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22232 fp=#0x30000002967' 2024-08-31T04:31:05.138 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22264 fp=#0x30000002014' 2024-08-31T04:31:05.138 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22296 fp=#0x30000002011' 2024-08-31T04:31:05.138 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22328 fp=#0x30000002064' 2024-08-31T04:31:05.139 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22360 fp=#0x30000001ff1' 2024-08-31T04:31:05.140 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22545 fp=#0x30000002be1' 2024-08-31T04:31:05.140 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22577 fp=#0x30000002c0f' 2024-08-31T04:31:05.141 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22608 fp=#0x30000003394' 2024-08-31T04:31:05.141 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22640 fp=#0x3000000148a' 2024-08-31T04:31:05.142 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:9802 fp=#0x10000003b93' 2024-08-31T04:31:05.143 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:9898 fp=#0x300000032f8' 2024-08-31T04:31:05.143 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:9930 fp=#0x300000013ec' 2024-08-31T04:31:05.147 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:10442 fp=#0x30000001c4e' 2024-08-31T04:31:05.148 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:10602 fp=#0x30000000a6a' 2024-08-31T04:31:05.149 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:10698 fp=#0x30000000a78' 2024-08-31T04:31:05.149 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:10730 fp=#0x30000000a61' 2024-08-31T04:31:05.149 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:10762 fp=#0x30000000868' 2024-08-31T04:31:05.150 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:10794 fp=#0x30000000a6d' 2024-08-31T04:31:05.157 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:11786 fp=#0x30000000c33' 2024-08-31T04:31:05.157 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:11850 fp=#0x30000000c2d' 2024-08-31T04:31:05.158 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:11882 fp=#0x30000000bbc' 2024-08-31T04:31:05.158 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:11914 fp=#0x300000010c7' 2024-08-31T04:31:05.158 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:11946 fp=#0x300000023fb' 2024-08-31T04:31:05.159 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:11978 fp=#0x30000001040' 2024-08-31T04:31:05.159 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12042 fp=#0x300000031e5' 2024-08-31T04:31:05.159 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12074 fp=#0x300000010cb' 2024-08-31T04:31:05.160 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12106 fp=#0x300000031f2' 2024-08-31T04:31:05.160 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12138 fp=#0x30000001131' 2024-08-31T04:31:05.161 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12234 fp=#0x300000009e8' 2024-08-31T04:31:05.161 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12298 fp=#0x300000009ed' 2024-08-31T04:31:05.162 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12330 fp=#0x30000000939' 2024-08-31T04:31:05.162 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12362 fp=#0x3000000099a' 2024-08-31T04:31:05.163 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12490 fp=#0x30000000f51' 2024-08-31T04:31:05.163 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12522 fp=#0x30000000f91' 2024-08-31T04:31:05.164 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12554 fp=#0x30000000f78' 2024-08-31T04:31:05.164 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12586 fp=#0x30000000e9f' 2024-08-31T04:31:05.164 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12618 fp=#0x3000000337f' 2024-08-31T04:31:05.164 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12650 fp=#0x30000000e53' 2024-08-31T04:31:05.165 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12682 fp=#0x3000000336d' 2024-08-31T04:31:05.165 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12714 fp=#0x30000003368' 2024-08-31T04:31:05.165 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12746 fp=#0x30000002274' 2024-08-31T04:31:05.166 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12778 fp=#0x30000000e64' 2024-08-31T04:31:05.166 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12810 fp=#0x30000000e8d' 2024-08-31T04:31:05.166 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12842 fp=#0x100000043c7' 2024-08-31T04:31:05.167 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12874 fp=#0x30000002824' 2024-08-31T04:31:05.167 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12906 fp=#0x10000004412' 2024-08-31T04:31:05.167 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12938 fp=#0x300000027ff' 2024-08-31T04:31:05.168 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12970 fp=#0x30000002858' 2024-08-31T04:31:05.168 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13002 fp=#0x10000004259' 2024-08-31T04:31:05.168 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13034 fp=#0x100000043d6' 2024-08-31T04:31:05.169 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13066 fp=#0x100000043cc' 2024-08-31T04:31:05.169 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13098 fp=#0x300000030a0' 2024-08-31T04:31:05.169 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13130 fp=#0x300000030e7' 2024-08-31T04:31:05.170 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13162 fp=#0x30000003176' 2024-08-31T04:31:05.171 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13290 fp=#0x30000000897' 2024-08-31T04:31:05.171 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13322 fp=#0x30000000a5a' 2024-08-31T04:31:05.171 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13354 fp=#0x30000000882' 2024-08-31T04:31:05.172 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13386 fp=#0x300000009c1' 2024-08-31T04:31:05.172 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13418 fp=#0x30000002209' 2024-08-31T04:31:05.172 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13450 fp=#0x30000002c28' 2024-08-31T04:31:05.173 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13482 fp=#0x3000000225d' 2024-08-31T04:31:05.173 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13514 fp=#0x30000002200' 2024-08-31T04:31:05.173 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13546 fp=#0x300000008d0' 2024-08-31T04:31:05.174 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13578 fp=#0x300000032a6' 2024-08-31T04:31:05.174 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13610 fp=#0x3000000333b' 2024-08-31T04:31:05.174 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13642 fp=#0x30000003309' 2024-08-31T04:31:05.175 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13674 fp=#0x30000002a02' 2024-08-31T04:31:05.175 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13706 fp=#0x3000000297c' 2024-08-31T04:31:05.175 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13738 fp=#0x30000002964' 2024-08-31T04:31:05.176 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13770 fp=#0x30000002966' 2024-08-31T04:31:05.176 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13802 fp=#0x3000000293d' 2024-08-31T04:31:05.176 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13834 fp=#0x300000029fc' 2024-08-31T04:31:05.177 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13866 fp=#0x10000003b96' 2024-08-31T04:31:05.177 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13898 fp=#0x10000003d5c' 2024-08-31T04:31:05.177 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13930 fp=#0x10000003d77' 2024-08-31T04:31:05.178 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13962 fp=#0x10000003eb2' 2024-08-31T04:31:05.178 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13994 fp=#0x10000003dd7' 2024-08-31T04:31:05.178 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14026 fp=#0x10000003ef0' 2024-08-31T04:31:05.178 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14058 fp=#0x30000000c7e' 2024-08-31T04:31:05.179 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14090 fp=#0x30000000c5f' 2024-08-31T04:31:05.179 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14122 fp=#0x30000001786' 2024-08-31T04:31:05.179 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14154 fp=#0x300000017c0' 2024-08-31T04:31:05.180 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14186 fp=#0x3000000179e' 2024-08-31T04:31:05.180 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14218 fp=#0x30000001793' 2024-08-31T04:31:05.180 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14250 fp=#0x3000000243c' 2024-08-31T04:31:05.181 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14410 fp=#0x300000023a2' 2024-08-31T04:31:05.182 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14442 fp=#0x30000002396' 2024-08-31T04:31:05.182 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14474 fp=#0x30000000ce6' 2024-08-31T04:31:05.182 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14506 fp=#0x30000000d4d' 2024-08-31T04:31:05.183 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14538 fp=#0x30000000d96' 2024-08-31T04:31:05.183 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14570 fp=#0x30000000c91' 2024-08-31T04:31:05.183 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14602 fp=#0x30000002fd7' 2024-08-31T04:31:05.184 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14634 fp=#0x100000023fa' 2024-08-31T04:31:05.184 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14666 fp=#0x1000000248e' 2024-08-31T04:31:05.184 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14698 fp=#0x30000002fd6' 2024-08-31T04:31:05.185 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14730 fp=#0x30000002fa7' 2024-08-31T04:31:05.185 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14762 fp=#0x30000002fc7' 2024-08-31T04:31:05.185 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14793 fp=#0x10000003c4b' 2024-08-31T04:31:05.185 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14825 fp=#0x10000003bd3' 2024-08-31T04:31:05.186 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14857 fp=#0x30000000981' 2024-08-31T04:31:05.186 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14889 fp=#0x300000009f7' 2024-08-31T04:31:05.186 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14921 fp=#0x3000000093b' 2024-08-31T04:31:05.187 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14953 fp=#0x3000000095b' 2024-08-31T04:31:05.187 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14985 fp=#0x300000014ec' 2024-08-31T04:31:05.187 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15017 fp=#0x30000001609' 2024-08-31T04:31:05.188 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15049 fp=#0x300000014f0' 2024-08-31T04:31:05.188 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15081 fp=#0x30000001529' 2024-08-31T04:31:05.188 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15113 fp=#0x300000033fb' 2024-08-31T04:31:05.189 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15145 fp=#0x30000003405' 2024-08-31T04:31:05.189 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15177 fp=#0x300000033eb' 2024-08-31T04:31:05.189 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15209 fp=#0x30000002f0c' 2024-08-31T04:31:05.190 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15241 fp=#0x30000002ef8' 2024-08-31T04:31:05.190 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15273 fp=#0x30000002ede' 2024-08-31T04:31:05.190 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15305 fp=#0x30000002ee7' 2024-08-31T04:31:05.190 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15337 fp=#0x30000002eec' 2024-08-31T04:31:05.191 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15369 fp=#0x300000032d9' 2024-08-31T04:31:05.191 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15401 fp=#0x300000032dd' 2024-08-31T04:31:05.191 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15433 fp=#0x30000000ec9' 2024-08-31T04:31:05.192 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15465 fp=#0x30000001da3' 2024-08-31T04:31:05.192 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15497 fp=#0x30000001da7' 2024-08-31T04:31:05.192 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15529 fp=#0x30000000eda' 2024-08-31T04:31:05.193 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15561 fp=#0x30000000ed9' 2024-08-31T04:31:05.193 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15593 fp=#0x30000000ed1' 2024-08-31T04:31:05.194 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15721 fp=#0x3000000055f' 2024-08-31T04:31:05.194 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15785 fp=#0x300000005b8' 2024-08-31T04:31:05.195 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15817 fp=#0x30000000525' 2024-08-31T04:31:05.195 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15848 fp=#0x30000001286' 2024-08-31T04:31:05.195 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15880 fp=#0x300000014e3' 2024-08-31T04:31:05.196 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15912 fp=#0x300000014d8' 2024-08-31T04:31:05.196 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15944 fp=#0x300000012f3' 2024-08-31T04:31:05.196 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15976 fp=#0x300000012b0' 2024-08-31T04:31:05.197 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16008 fp=#0x3000000103d' 2024-08-31T04:31:05.197 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16040 fp=#0x30000001029' 2024-08-31T04:31:05.197 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16072 fp=#0x30000002df5' 2024-08-31T04:31:05.198 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16104 fp=#0x30000002dfd' 2024-08-31T04:31:05.198 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16168 fp=#0x30000000635' 2024-08-31T04:31:05.199 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16200 fp=#0x300000034ea' 2024-08-31T04:31:05.199 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16232 fp=#0x300000034c5' 2024-08-31T04:31:05.199 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16264 fp=#0x3000000062a' 2024-08-31T04:31:05.199 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16296 fp=#0x300000034da' 2024-08-31T04:31:05.200 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16325 fp=#0x300000020c0' 2024-08-31T04:31:05.200 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16357 fp=#0x10000002815' 2024-08-31T04:31:05.200 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16389 fp=#0x10000002863' 2024-08-31T04:31:05.201 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16421 fp=#0x300000020a0' 2024-08-31T04:31:05.201 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16453 fp=#0x30000001cff' 2024-08-31T04:31:05.201 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16485 fp=#0x100000024a1' 2024-08-31T04:31:05.202 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16517 fp=#0x100000024c2' 2024-08-31T04:31:05.202 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16549 fp=#0x30000001d03' 2024-08-31T04:31:05.202 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16581 fp=#0x30000001ccc' 2024-08-31T04:31:05.203 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16613 fp=#0x10000002533' 2024-08-31T04:31:05.203 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16644 fp=#0x3000000212b' 2024-08-31T04:31:05.203 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16676 fp=#0x300000020f0' 2024-08-31T04:31:05.204 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16708 fp=#0x30000002140' 2024-08-31T04:31:05.204 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16740 fp=#0x300000003df' 2024-08-31T04:31:05.204 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16804 fp=#0x3000000196b' 2024-08-31T04:31:05.205 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16836 fp=#0x3000000364e' 2024-08-31T04:31:05.205 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16900 fp=#0x30000001a09' 2024-08-31T04:31:05.206 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16931 fp=#0x30000001aee' 2024-08-31T04:31:05.206 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16963 fp=#0x30000001abd' 2024-08-31T04:31:05.206 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16995 fp=#0x30000002b7f' 2024-08-31T04:31:05.207 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17020 fp=#0x10000003713' 2024-08-31T04:31:05.207 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17052 fp=#0x10000003612' 2024-08-31T04:31:05.207 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17084 fp=#0x10000003654' 2024-08-31T04:31:05.207 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17116 fp=#0x10000003669' 2024-08-31T04:31:05.208 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17148 fp=#0x30000001761' 2024-08-31T04:31:05.208 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17180 fp=#0x300000017c8' 2024-08-31T04:31:05.208 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17212 fp=#0x30000002cf7' 2024-08-31T04:31:05.209 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17244 fp=#0x3000000177a' 2024-08-31T04:31:05.209 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17276 fp=#0x30000001783' 2024-08-31T04:31:05.209 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17308 fp=#0x300000017e4' 2024-08-31T04:31:05.210 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17340 fp=#0x300000032fe' 2024-08-31T04:31:05.210 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17372 fp=#0x30000003314' 2024-08-31T04:31:05.211 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17532 fp=#0x30000000e11' 2024-08-31T04:31:05.211 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17564 fp=#0x30000003201' 2024-08-31T04:31:05.212 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17596 fp=#0x30000000da9' 2024-08-31T04:31:05.212 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17628 fp=#0x30000000df4' 2024-08-31T04:31:05.212 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17660 fp=#0x30000000db6' 2024-08-31T04:31:05.213 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17788 fp=#0x30000002038' 2024-08-31T04:31:05.214 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17820 fp=#0x30000001fcf' 2024-08-31T04:31:05.214 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17852 fp=#0x30000001fe3' 2024-08-31T04:31:05.214 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17884 fp=#0x30000001fc3' 2024-08-31T04:31:05.215 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17916 fp=#0x3000000314d' 2024-08-31T04:31:05.215 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17948 fp=#0x300000030b5' 2024-08-31T04:31:05.215 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17980 fp=#0x300000030f4' 2024-08-31T04:31:05.216 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18012 fp=#0x30000001c3f' 2024-08-31T04:31:05.216 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18044 fp=#0x30000001bed' 2024-08-31T04:31:05.216 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18076 fp=#0x30000001c0c' 2024-08-31T04:31:05.217 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18108 fp=#0x30000002597' 2024-08-31T04:31:05.217 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18140 fp=#0x30000002592' 2024-08-31T04:31:05.217 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18172 fp=#0x30000002542' 2024-08-31T04:31:05.218 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18204 fp=#0x30000002546' 2024-08-31T04:31:05.218 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18236 fp=#0x3000000255f' 2024-08-31T04:31:05.218 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18268 fp=#0x300000027c0' 2024-08-31T04:31:05.219 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18300 fp=#0x300000027c9' 2024-08-31T04:31:05.219 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18332 fp=#0x30000002866' 2024-08-31T04:31:05.219 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18364 fp=#0x300000027b8' 2024-08-31T04:31:05.220 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18396 fp=#0x30000002f23' 2024-08-31T04:31:05.220 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18428 fp=#0x30000003008' 2024-08-31T04:31:05.220 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18460 fp=#0x30000002ff4' 2024-08-31T04:31:05.221 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18492 fp=#0x30000002f53' 2024-08-31T04:31:05.221 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18524 fp=#0x30000003016' 2024-08-31T04:31:05.221 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18556 fp=#0x10000001d64' 2024-08-31T04:31:05.222 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18588 fp=#0x10000001d18' 2024-08-31T04:31:05.222 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18652 fp=#0x10000001d15' 2024-08-31T04:31:05.222 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18684 fp=#0x10000001d67' 2024-08-31T04:31:05.223 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18716 fp=#0x3000000138d' 2024-08-31T04:31:05.223 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18748 fp=#0x300000014c1' 2024-08-31T04:31:05.223 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18780 fp=#0x30000001390' 2024-08-31T04:31:05.224 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18812 fp=#0x300000013cb' 2024-08-31T04:31:05.224 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18844 fp=#0x3000000139d' 2024-08-31T04:31:05.224 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18876 fp=#0x300000010fb' 2024-08-31T04:31:05.225 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18908 fp=#0x30000001d51' 2024-08-31T04:31:05.225 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18940 fp=#0x30000001d59' 2024-08-31T04:31:05.225 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18972 fp=#0x3000000108e' 2024-08-31T04:31:05.226 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19004 fp=#0x30000001d53' 2024-08-31T04:31:05.226 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19036 fp=#0x30000001d6b' 2024-08-31T04:31:05.226 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19068 fp=#0x30000001114' 2024-08-31T04:31:05.227 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19100 fp=#0x300000011ee' 2024-08-31T04:31:05.227 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19132 fp=#0x300000011ad' 2024-08-31T04:31:05.228 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19228 fp=#0x30000001668' 2024-08-31T04:31:05.228 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19260 fp=#0x3000000167c' 2024-08-31T04:31:05.228 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19292 fp=#0x100000008f4' 2024-08-31T04:31:05.228 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19324 fp=#0x100000008c8' 2024-08-31T04:31:05.229 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19356 fp=#0x30000002bcf' 2024-08-31T04:31:05.229 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19388 fp=#0x100000008b7' 2024-08-31T04:31:05.229 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19420 fp=#0x3000000151e' 2024-08-31T04:31:05.232 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19483 fp=#0x30000000b91' 2024-08-31T04:31:05.233 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19515 fp=#0x30000000ba3' 2024-08-31T04:31:05.233 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19547 fp=#0x30000000b8f' 2024-08-31T04:31:05.234 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19579 fp=#0x30000000ad1' 2024-08-31T04:31:05.234 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19611 fp=#0x30000000acb' 2024-08-31T04:31:05.234 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19643 fp=#0x30000000ae4' 2024-08-31T04:31:05.234 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19675 fp=#0x30000002c53' 2024-08-31T04:31:05.235 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19707 fp=#0x30000002cfd' 2024-08-31T04:31:05.235 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19739 fp=#0x30000002cb4' 2024-08-31T04:31:05.235 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19771 fp=#0x30000002d42' 2024-08-31T04:31:05.236 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19803 fp=#0x30000002c50' 2024-08-31T04:31:05.236 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19835 fp=#0x30000001446' 2024-08-31T04:31:05.236 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19867 fp=#0x3000000145d' 2024-08-31T04:31:05.236 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19899 fp=#0x30000001445' 2024-08-31T04:31:05.237 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19931 fp=#0x30000001451' 2024-08-31T04:31:05.237 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19963 fp=#0x30000001434' 2024-08-31T04:31:05.238 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19995 fp=#0x3000000140a' 2024-08-31T04:31:05.238 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20027 fp=#0x30000001426' 2024-08-31T04:31:05.239 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20059 fp=#0x30000000fa5' 2024-08-31T04:31:05.240 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20091 fp=#0x30000000fd6' 2024-08-31T04:31:05.240 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20123 fp=#0x3000000170a' 2024-08-31T04:31:05.240 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20155 fp=#0x30000001701' 2024-08-31T04:31:05.241 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20187 fp=#0x300000016bf' 2024-08-31T04:31:05.241 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20219 fp=#0x300000016be' 2024-08-31T04:31:05.241 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20251 fp=#0x3000000310a' 2024-08-31T04:31:05.242 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20283 fp=#0x30000003059' 2024-08-31T04:31:05.242 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20315 fp=#0x300000030ea' 2024-08-31T04:31:05.242 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20347 fp=#0x30000003200' 2024-08-31T04:31:05.243 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20411 fp=#0x30000001c7d' 2024-08-31T04:31:05.243 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20443 fp=#0x30000001ca6' 2024-08-31T04:31:05.243 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20475 fp=#0x30000001c5e' 2024-08-31T04:31:05.244 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20507 fp=#0x30000001268' 2024-08-31T04:31:05.244 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20539 fp=#0x30000001256' 2024-08-31T04:31:05.244 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20571 fp=#0x3000000125e' 2024-08-31T04:31:05.245 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20603 fp=#0x3000000121b' 2024-08-31T04:31:05.245 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20667 fp=#0x300000021ae' 2024-08-31T04:31:05.246 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20763 fp=#0x10000003870' 2024-08-31T04:31:05.247 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20827 fp=#0x10000003760' 2024-08-31T04:31:05.247 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20859 fp=#0x1000000386e' 2024-08-31T04:31:05.247 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20891 fp=#0x10000003831' 2024-08-31T04:31:05.247 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20923 fp=#0x3000000306d' 2024-08-31T04:31:05.248 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20987 fp=#0x300000020d6' 2024-08-31T04:31:05.248 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21050 fp=#0x30000001596' 2024-08-31T04:31:05.249 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21082 fp=#0x30000001616' 2024-08-31T04:31:05.249 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21114 fp=#0x3000000153e' 2024-08-31T04:31:05.250 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21178 fp=#0x30000002bb5' 2024-08-31T04:31:05.250 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21274 fp=#0x30000002c0a' 2024-08-31T04:31:05.251 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21306 fp=#0x10000003418' 2024-08-31T04:31:05.251 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21338 fp=#0x1000000334b' 2024-08-31T04:31:05.251 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21370 fp=#0x100000032ed' 2024-08-31T04:31:05.252 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21402 fp=#0x10000003322' 2024-08-31T04:31:05.252 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21434 fp=#0x100000032aa' 2024-08-31T04:31:05.252 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21466 fp=#0x30000002609' 2024-08-31T04:31:05.253 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21498 fp=#0x30000002628' 2024-08-31T04:31:05.253 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21530 fp=#0x30000002672' 2024-08-31T04:31:05.253 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21562 fp=#0x30000002635' 2024-08-31T04:31:05.254 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21594 fp=#0x300000036cd' 2024-08-31T04:31:05.254 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21626 fp=#0x30000000ce3' 2024-08-31T04:31:05.254 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21658 fp=#0x300000036d3' 2024-08-31T04:31:05.254 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21690 fp=#0x30000000c88' 2024-08-31T04:31:05.255 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21722 fp=#0x30000000cc0' 2024-08-31T04:31:05.255 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21754 fp=#0x300000036a7' 2024-08-31T04:31:05.255 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21786 fp=#0x30000000b1d' 2024-08-31T04:31:05.256 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21818 fp=#0x30000000aa2' 2024-08-31T04:31:05.256 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21850 fp=#0x30000000b28' 2024-08-31T04:31:05.257 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21914 fp=#0x30000000580' 2024-08-31T04:31:05.257 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21946 fp=#0x30000000922' 2024-08-31T04:31:05.257 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22010 fp=#0x30000001d1d' 2024-08-31T04:31:05.258 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22041 fp=#0x3000000191f' 2024-08-31T04:31:05.258 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22073 fp=#0x3000000190f' 2024-08-31T04:31:05.258 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22105 fp=#0x30000002f7a' 2024-08-31T04:31:05.259 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22137 fp=#0x300000028c2' 2024-08-31T04:31:05.259 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22169 fp=#0x300000028f8' 2024-08-31T04:31:05.259 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22201 fp=#0x300000028e6' 2024-08-31T04:31:05.260 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22233 fp=#0x300000028db' 2024-08-31T04:31:05.260 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22265 fp=#0x3000000208f' 2024-08-31T04:31:05.260 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22297 fp=#0x30000002002' 2024-08-31T04:31:05.260 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22329 fp=#0x30000002044' 2024-08-31T04:31:05.261 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22361 fp=#0x30000001ff6' 2024-08-31T04:31:05.261 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22425 fp=#0x30000000436' 2024-08-31T04:31:05.262 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22457 fp=#0x30000000471' 2024-08-31T04:31:05.262 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22546 fp=#0x30000002c0d' 2024-08-31T04:31:05.262 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22578 fp=#0x30000002c2f' 2024-08-31T04:31:05.263 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22609 fp=#0x30000003392' 2024-08-31T04:31:05.263 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22641 fp=#0x300000033bd' 2024-08-31T04:31:05.263 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22673 fp=#0x3000000148f' 2024-08-31T04:31:05.264 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:9803 fp=#0x30000000c46' 2024-08-31T04:31:05.265 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:9931 fp=#0x30000000f96' 2024-08-31T04:31:05.269 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:10475 fp=#0x30000000d72' 2024-08-31T04:31:05.270 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:10539 fp=#0x300000023e9' 2024-08-31T04:31:05.271 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:10635 fp=#0x30000000a65' 2024-08-31T04:31:05.280 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:11883 fp=#0x30000000c30' 2024-08-31T04:31:05.338 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:11947 fp=#0x30000001048' 2024-08-31T04:31:05.338 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:11979 fp=#0x30000003205' 2024-08-31T04:31:05.338 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12011 fp=#0x30000001085' 2024-08-31T04:31:05.339 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12043 fp=#0x300000011a2' 2024-08-31T04:31:05.339 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12075 fp=#0x300000031f6' 2024-08-31T04:31:05.340 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12139 fp=#0x300000010f4' 2024-08-31T04:31:05.341 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12235 fp=#0x3000000242c' 2024-08-31T04:31:05.343 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12491 fp=#0x30000000f88' 2024-08-31T04:31:05.343 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12555 fp=#0x30000000f56' 2024-08-31T04:31:05.344 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12587 fp=#0x3000000319d' 2024-08-31T04:31:05.344 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12619 fp=#0x30000003399' 2024-08-31T04:31:05.344 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12651 fp=#0x3000000226a' 2024-08-31T04:31:05.344 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12683 fp=#0x30000002294' 2024-08-31T04:31:05.345 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12715 fp=#0x30000000e22' 2024-08-31T04:31:05.345 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12747 fp=#0x30000000e3d' 2024-08-31T04:31:05.345 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12779 fp=#0x30000002271' 2024-08-31T04:31:05.346 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12811 fp=#0x30000000e7f' 2024-08-31T04:31:05.346 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12843 fp=#0x1000000441f' 2024-08-31T04:31:05.346 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12875 fp=#0x10000004239' 2024-08-31T04:31:05.347 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12907 fp=#0x10000004292' 2024-08-31T04:31:05.347 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12939 fp=#0x10000004378' 2024-08-31T04:31:05.347 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12971 fp=#0x30000002822' 2024-08-31T04:31:05.348 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13003 fp=#0x3000000281f' 2024-08-31T04:31:05.348 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13035 fp=#0x100000041d4' 2024-08-31T04:31:05.348 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13067 fp=#0x1000000438b' 2024-08-31T04:31:05.349 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13099 fp=#0x300000030f3' 2024-08-31T04:31:05.349 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13131 fp=#0x3000000310d' 2024-08-31T04:31:05.349 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13163 fp=#0x30000003109' 2024-08-31T04:31:05.350 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13195 fp=#0x30000000757' 2024-08-31T04:31:05.350 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13291 fp=#0x300000008cf' 2024-08-31T04:31:05.351 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13323 fp=#0x30000002272' 2024-08-31T04:31:05.351 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13355 fp=#0x300000008da' 2024-08-31T04:31:05.351 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13387 fp=#0x3000000226b' 2024-08-31T04:31:05.352 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13419 fp=#0x3000000097d' 2024-08-31T04:31:05.352 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13451 fp=#0x300000009a2' 2024-08-31T04:31:05.352 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13483 fp=#0x30000000899' 2024-08-31T04:31:05.353 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13515 fp=#0x300000009aa' 2024-08-31T04:31:05.353 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13547 fp=#0x300000008ea' 2024-08-31T04:31:05.353 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13579 fp=#0x300000032a2' 2024-08-31T04:31:05.354 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13611 fp=#0x300000032b3' 2024-08-31T04:31:05.354 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13643 fp=#0x30000003296' 2024-08-31T04:31:05.354 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13675 fp=#0x30000002a43' 2024-08-31T04:31:05.355 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13707 fp=#0x300000028ef' 2024-08-31T04:31:05.355 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13739 fp=#0x3000000296c' 2024-08-31T04:31:05.355 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13771 fp=#0x3000000292c' 2024-08-31T04:31:05.355 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13803 fp=#0x30000002a24' 2024-08-31T04:31:05.356 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13835 fp=#0x300000028f4' 2024-08-31T04:31:05.356 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13867 fp=#0x10000003ee3' 2024-08-31T04:31:05.356 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13899 fp=#0x10000003db5' 2024-08-31T04:31:05.357 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13931 fp=#0x10000003f02' 2024-08-31T04:31:05.357 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13963 fp=#0x10000003ee7' 2024-08-31T04:31:05.357 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13995 fp=#0x10000003d44' 2024-08-31T04:31:05.358 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14027 fp=#0x10000003bcf' 2024-08-31T04:31:05.358 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14059 fp=#0x30000000c7d' 2024-08-31T04:31:05.358 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14091 fp=#0x30000000c70' 2024-08-31T04:31:05.359 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14123 fp=#0x3000000244e' 2024-08-31T04:31:05.359 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14155 fp=#0x30000002433' 2024-08-31T04:31:05.359 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14187 fp=#0x30000002481' 2024-08-31T04:31:05.360 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14219 fp=#0x3000000244a' 2024-08-31T04:31:05.360 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14251 fp=#0x300000017a3' 2024-08-31T04:31:05.362 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14411 fp=#0x30000002399' 2024-08-31T04:31:05.362 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14443 fp=#0x30000002395' 2024-08-31T04:31:05.362 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14475 fp=#0x30000000d3b' 2024-08-31T04:31:05.363 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14507 fp=#0x30000000cee' 2024-08-31T04:31:05.363 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14539 fp=#0x30000000d73' 2024-08-31T04:31:05.363 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14571 fp=#0x30000000cde' 2024-08-31T04:31:05.364 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14603 fp=#0x30000000659' 2024-08-31T04:31:05.364 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14635 fp=#0x100000023f6' 2024-08-31T04:31:05.364 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14667 fp=#0x30000002fce' 2024-08-31T04:31:05.365 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14699 fp=#0x10000002487' 2024-08-31T04:31:05.365 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14731 fp=#0x10000002432' 2024-08-31T04:31:05.365 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14763 fp=#0x30000002fc2' 2024-08-31T04:31:05.366 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14794 fp=#0x300000006cb' 2024-08-31T04:31:05.366 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14858 fp=#0x30000000a17' 2024-08-31T04:31:05.367 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14890 fp=#0x300000009ea' 2024-08-31T04:31:05.367 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14922 fp=#0x30000000a23' 2024-08-31T04:31:05.367 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14954 fp=#0x30000000a19' 2024-08-31T04:31:05.368 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14986 fp=#0x30000001527' 2024-08-31T04:31:05.368 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15018 fp=#0x300000016a6' 2024-08-31T04:31:05.368 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15050 fp=#0x300000015d0' 2024-08-31T04:31:05.369 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15082 fp=#0x30000001681' 2024-08-31T04:31:05.369 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15114 fp=#0x30000003441' 2024-08-31T04:31:05.369 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15146 fp=#0x3000000343e' 2024-08-31T04:31:05.370 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15178 fp=#0x3000000338d' 2024-08-31T04:31:05.370 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15210 fp=#0x30000002eed' 2024-08-31T04:31:05.370 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15242 fp=#0x30000002eef' 2024-08-31T04:31:05.371 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15274 fp=#0x30000002ed6' 2024-08-31T04:31:05.371 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15306 fp=#0x30000002ed4' 2024-08-31T04:31:05.371 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15338 fp=#0x30000002ee5' 2024-08-31T04:31:05.372 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15370 fp=#0x300000032e9' 2024-08-31T04:31:05.372 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15402 fp=#0x300000032c5' 2024-08-31T04:31:05.372 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15434 fp=#0x30000000f34' 2024-08-31T04:31:05.373 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15466 fp=#0x30000001da4' 2024-08-31T04:31:05.373 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15498 fp=#0x30000001dc2' 2024-08-31T04:31:05.373 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15530 fp=#0x30000000f0f' 2024-08-31T04:31:05.374 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15562 fp=#0x30000001daa' 2024-08-31T04:31:05.374 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15594 fp=#0x30000000ed7' 2024-08-31T04:31:05.374 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15626 fp=#0x300000005ee' 2024-08-31T04:31:05.375 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15690 fp=#0x300000004ec' 2024-08-31T04:31:05.375 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15722 fp=#0x300000004e9' 2024-08-31T04:31:05.375 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15754 fp=#0x300000004fc' 2024-08-31T04:31:05.376 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15786 fp=#0x300000005b1' 2024-08-31T04:31:05.376 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15818 fp=#0x30000000535' 2024-08-31T04:31:05.376 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15849 fp=#0x300000014dc' 2024-08-31T04:31:05.377 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15881 fp=#0x30000001308' 2024-08-31T04:31:05.377 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15913 fp=#0x300000012db' 2024-08-31T04:31:05.377 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15945 fp=#0x300000012cd' 2024-08-31T04:31:05.378 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15977 fp=#0x300000012b3' 2024-08-31T04:31:05.378 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16009 fp=#0x30000001084' 2024-08-31T04:31:05.378 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16041 fp=#0x30000001015' 2024-08-31T04:31:05.379 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16073 fp=#0x30000001830' 2024-08-31T04:31:05.379 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16105 fp=#0x3000000182b' 2024-08-31T04:31:05.380 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16201 fp=#0x30000003568' 2024-08-31T04:31:05.380 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16233 fp=#0x300000034d6' 2024-08-31T04:31:05.380 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16265 fp=#0x3000000341b' 2024-08-31T04:31:05.380 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16297 fp=#0x300000005d0' 2024-08-31T04:31:05.381 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16326 fp=#0x10000002813' 2024-08-31T04:31:05.381 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16358 fp=#0x1000000286d' 2024-08-31T04:31:05.381 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16390 fp=#0x10000002859' 2024-08-31T04:31:05.382 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16422 fp=#0x300000020ae' 2024-08-31T04:31:05.382 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16454 fp=#0x1000000253f' 2024-08-31T04:31:05.382 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16486 fp=#0x10000002543' 2024-08-31T04:31:05.383 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16518 fp=#0x30000001d15' 2024-08-31T04:31:05.383 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16582 fp=#0x100000024e1' 2024-08-31T04:31:05.384 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16614 fp=#0x300000031d6' 2024-08-31T04:31:05.384 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16645 fp=#0x30000002127' 2024-08-31T04:31:05.384 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16677 fp=#0x30000002129' 2024-08-31T04:31:05.385 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16709 fp=#0x300000021a0' 2024-08-31T04:31:05.385 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16741 fp=#0x30000002624' 2024-08-31T04:31:05.386 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16805 fp=#0x30000001a1c' 2024-08-31T04:31:05.386 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16869 fp=#0x30000001a22' 2024-08-31T04:31:05.386 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16901 fp=#0x3000000195e' 2024-08-31T04:31:05.387 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16932 fp=#0x30000001a9b' 2024-08-31T04:31:05.387 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16964 fp=#0x30000002b65' 2024-08-31T04:31:05.387 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16996 fp=#0x30000002b79' 2024-08-31T04:31:05.388 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17021 fp=#0x100000036cc' 2024-08-31T04:31:05.388 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17053 fp=#0x100000035fc' 2024-08-31T04:31:05.389 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17117 fp=#0x10000003672' 2024-08-31T04:31:05.389 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17149 fp=#0x30000001738' 2024-08-31T04:31:05.389 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17181 fp=#0x300000017ee' 2024-08-31T04:31:05.390 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17213 fp=#0x30000001709' 2024-08-31T04:31:05.390 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17245 fp=#0x30000001744' 2024-08-31T04:31:05.390 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17277 fp=#0x300000017dd' 2024-08-31T04:31:05.391 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17309 fp=#0x300000017d1' 2024-08-31T04:31:05.391 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17341 fp=#0x30000003340' 2024-08-31T04:31:05.391 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17373 fp=#0x30000003348' 2024-08-31T04:31:05.392 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17405 fp=#0x30000001f28' 2024-08-31T04:31:05.393 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17533 fp=#0x30000000dda' 2024-08-31T04:31:05.393 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17565 fp=#0x300000031fe' 2024-08-31T04:31:05.393 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17597 fp=#0x30000003231' 2024-08-31T04:31:05.394 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17629 fp=#0x300000031b6' 2024-08-31T04:31:05.394 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17661 fp=#0x30000000da4' 2024-08-31T04:31:05.395 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17789 fp=#0x30000001fa6' 2024-08-31T04:31:05.395 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17821 fp=#0x30000001fbd' 2024-08-31T04:31:05.396 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17853 fp=#0x30000001ff0' 2024-08-31T04:31:05.396 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17885 fp=#0x30000001f98' 2024-08-31T04:31:05.396 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17917 fp=#0x30000003141' 2024-08-31T04:31:05.397 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17949 fp=#0x300000030c6' 2024-08-31T04:31:05.397 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17981 fp=#0x3000000308b' 2024-08-31T04:31:05.397 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18013 fp=#0x30000001c3e' 2024-08-31T04:31:05.398 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18045 fp=#0x30000001bfa' 2024-08-31T04:31:05.398 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18077 fp=#0x30000001bff' 2024-08-31T04:31:05.398 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18109 fp=#0x30000002543' 2024-08-31T04:31:05.399 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18141 fp=#0x30000002589' 2024-08-31T04:31:05.399 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18173 fp=#0x30000002577' 2024-08-31T04:31:05.400 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18205 fp=#0x30000002572' 2024-08-31T04:31:05.400 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18237 fp=#0x30000002565' 2024-08-31T04:31:05.400 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18269 fp=#0x300000027c3' 2024-08-31T04:31:05.400 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18301 fp=#0x300000027d6' 2024-08-31T04:31:05.401 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18333 fp=#0x300000027f6' 2024-08-31T04:31:05.401 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18365 fp=#0x300000027da' 2024-08-31T04:31:05.401 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18397 fp=#0x30000002f63' 2024-08-31T04:31:05.402 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18429 fp=#0x30000002ff0' 2024-08-31T04:31:05.402 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18461 fp=#0x30000003031' 2024-08-31T04:31:05.402 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18493 fp=#0x30000002f42' 2024-08-31T04:31:05.403 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18525 fp=#0x3000000300f' 2024-08-31T04:31:05.403 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18589 fp=#0x10000001d4d' 2024-08-31T04:31:05.404 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18653 fp=#0x10000001d70' 2024-08-31T04:31:05.404 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18717 fp=#0x3000000150d' 2024-08-31T04:31:05.404 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18749 fp=#0x30000001355' 2024-08-31T04:31:05.405 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18781 fp=#0x30000001375' 2024-08-31T04:31:05.405 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18813 fp=#0x300000013bd' 2024-08-31T04:31:05.405 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18845 fp=#0x300000013e9' 2024-08-31T04:31:05.406 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18877 fp=#0x30000001d64' 2024-08-31T04:31:05.406 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18909 fp=#0x300000010d0' 2024-08-31T04:31:05.406 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18941 fp=#0x300000010a9' 2024-08-31T04:31:05.407 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18973 fp=#0x300000010ca' 2024-08-31T04:31:05.407 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19005 fp=#0x30000001d60' 2024-08-31T04:31:05.407 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19037 fp=#0x30000001d72' 2024-08-31T04:31:05.408 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19069 fp=#0x300000011d0' 2024-08-31T04:31:05.408 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19101 fp=#0x30000001150' 2024-08-31T04:31:05.408 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19133 fp=#0x300000011ca' 2024-08-31T04:31:05.409 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19197 fp=#0x300000015fb' 2024-08-31T04:31:05.409 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19229 fp=#0x30000001621' 2024-08-31T04:31:05.410 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19293 fp=#0x30000002bba' 2024-08-31T04:31:05.410 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19325 fp=#0x300000014d9' 2024-08-31T04:31:05.410 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19357 fp=#0x100000008e9' 2024-08-31T04:31:05.410 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19389 fp=#0x100000008aa' 2024-08-31T04:31:05.411 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19421 fp=#0x30000001540' 2024-08-31T04:31:05.411 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19452 fp=#0x30000000bad' 2024-08-31T04:31:05.411 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19484 fp=#0x30000000b6b' 2024-08-31T04:31:05.412 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19516 fp=#0x30000000b7d' 2024-08-31T04:31:05.412 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19548 fp=#0x30000000bd7' 2024-08-31T04:31:05.412 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19580 fp=#0x30000000a9f' 2024-08-31T04:31:05.413 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19612 fp=#0x30000001ca1' 2024-08-31T04:31:05.413 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19644 fp=#0x30000002c61' 2024-08-31T04:31:05.413 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19676 fp=#0x30000002c5a' 2024-08-31T04:31:05.414 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19708 fp=#0x30000002c72' 2024-08-31T04:31:05.414 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19740 fp=#0x30000002c60' 2024-08-31T04:31:05.414 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19772 fp=#0x30000002c8c' 2024-08-31T04:31:05.414 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19804 fp=#0x30000002dda' 2024-08-31T04:31:05.415 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19836 fp=#0x300000011fd' 2024-08-31T04:31:05.415 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19868 fp=#0x30000001458' 2024-08-31T04:31:05.415 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19900 fp=#0x30000001168' 2024-08-31T04:31:05.416 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19932 fp=#0x3000000118a' 2024-08-31T04:31:05.416 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19964 fp=#0x3000000143d' 2024-08-31T04:31:05.416 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19996 fp=#0x30000001411' 2024-08-31T04:31:05.417 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20028 fp=#0x3000000142e' 2024-08-31T04:31:05.417 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20060 fp=#0x30000000fdb' 2024-08-31T04:31:05.417 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20092 fp=#0x30000001dda' 2024-08-31T04:31:05.417 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20124 fp=#0x30000001734' 2024-08-31T04:31:05.418 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20156 fp=#0x300000016ba' 2024-08-31T04:31:05.418 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20188 fp=#0x300000016b5' 2024-08-31T04:31:05.418 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20220 fp=#0x300000016cf' 2024-08-31T04:31:05.419 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20252 fp=#0x30000003263' 2024-08-31T04:31:05.419 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20284 fp=#0x30000003170' 2024-08-31T04:31:05.419 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20316 fp=#0x30000003235' 2024-08-31T04:31:05.420 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20348 fp=#0x30000003070' 2024-08-31T04:31:05.420 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20380 fp=#0x30000001cdf' 2024-08-31T04:31:05.420 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20412 fp=#0x30000001cb3' 2024-08-31T04:31:05.421 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20444 fp=#0x30000001ce1' 2024-08-31T04:31:05.421 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20476 fp=#0x30000001c8f' 2024-08-31T04:31:05.421 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20508 fp=#0x30000001263' 2024-08-31T04:31:05.422 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20540 fp=#0x30000001244' 2024-08-31T04:31:05.422 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20572 fp=#0x30000001226' 2024-08-31T04:31:05.422 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20604 fp=#0x30000001265' 2024-08-31T04:31:05.423 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20796 fp=#0x1000000375a' 2024-08-31T04:31:05.424 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20828 fp=#0x300000030c5' 2024-08-31T04:31:05.424 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20860 fp=#0x3000000304e' 2024-08-31T04:31:05.424 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20892 fp=#0x30000001cdc' 2024-08-31T04:31:05.425 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20956 fp=#0x3000000118d' 2024-08-31T04:31:05.425 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20988 fp=#0x300000020aa' 2024-08-31T04:31:05.426 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21019 fp=#0x30000002bf7' 2024-08-31T04:31:05.426 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21051 fp=#0x30000001528' 2024-08-31T04:31:05.426 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21083 fp=#0x3000000155d' 2024-08-31T04:31:05.426 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21115 fp=#0x300000015ff' 2024-08-31T04:31:05.427 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21211 fp=#0x30000002c3f' 2024-08-31T04:31:05.428 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21243 fp=#0x30000001dde' 2024-08-31T04:31:05.428 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21275 fp=#0x30000002bf6' 2024-08-31T04:31:05.428 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21307 fp=#0x10000003219' 2024-08-31T04:31:05.428 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21339 fp=#0x1000000323c' 2024-08-31T04:31:05.429 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21371 fp=#0x10000003334' 2024-08-31T04:31:05.429 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21403 fp=#0x1000000333d' 2024-08-31T04:31:05.429 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21435 fp=#0x10000003331' 2024-08-31T04:31:05.430 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21467 fp=#0x3000000273c' 2024-08-31T04:31:05.430 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21499 fp=#0x3000000260c' 2024-08-31T04:31:05.430 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21531 fp=#0x3000000267b' 2024-08-31T04:31:05.431 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21563 fp=#0x30000002711' 2024-08-31T04:31:05.431 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21595 fp=#0x30000000cb2' 2024-08-31T04:31:05.431 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21627 fp=#0x30000000ca2' 2024-08-31T04:31:05.431 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21659 fp=#0x30000000cf1' 2024-08-31T04:31:05.432 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21691 fp=#0x300000036b3' 2024-08-31T04:31:05.432 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21723 fp=#0x30000003712' 2024-08-31T04:31:05.432 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21755 fp=#0x30000003676' 2024-08-31T04:31:05.433 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21787 fp=#0x30000000ad8' 2024-08-31T04:31:05.433 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21819 fp=#0x30000000abf' 2024-08-31T04:31:05.433 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21851 fp=#0x30000000afd' 2024-08-31T04:31:05.434 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21883 fp=#0x30000000500' 2024-08-31T04:31:05.434 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21915 fp=#0x3000000051f' 2024-08-31T04:31:05.434 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21979 fp=#0x3000000051a' 2024-08-31T04:31:05.435 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22011 fp=#0x30000000903' 2024-08-31T04:31:05.435 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22042 fp=#0x30000002f70' 2024-08-31T04:31:05.435 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22074 fp=#0x3000000193b' 2024-08-31T04:31:05.436 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22106 fp=#0x30000002f72' 2024-08-31T04:31:05.436 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22138 fp=#0x300000029a8' 2024-08-31T04:31:05.436 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22170 fp=#0x300000028ff' 2024-08-31T04:31:05.437 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22202 fp=#0x30000002963' 2024-08-31T04:31:05.437 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22234 fp=#0x30000002996' 2024-08-31T04:31:05.437 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22266 fp=#0x30000001feb' 2024-08-31T04:31:05.437 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22298 fp=#0x30000002023' 2024-08-31T04:31:05.438 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22330 fp=#0x30000001fe2' 2024-08-31T04:31:05.438 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22362 fp=#0x30000002025' 2024-08-31T04:31:05.438 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22394 fp=#0x300000004a3' 2024-08-31T04:31:05.439 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22426 fp=#0x3000000043a' 2024-08-31T04:31:05.439 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22458 fp=#0x30000000426' 2024-08-31T04:31:05.439 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22490 fp=#0x30000000414' 2024-08-31T04:31:05.440 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22547 fp=#0x30000002c20' 2024-08-31T04:31:05.440 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22579 fp=#0x30000002c6a' 2024-08-31T04:31:05.440 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22610 fp=#0x30000001488' 2024-08-31T04:31:05.441 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22642 fp=#0x10000001052' 2024-08-31T04:31:05.441 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22674 fp=#0x30000001496' 2024-08-31T04:31:05.442 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:9900 fp=#0x30000001e8d' 2024-08-31T04:31:05.443 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:9932 fp=#0x300000016b4' 2024-08-31T04:31:05.446 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:10380 fp=#0x30000002519' 2024-08-31T04:31:05.448 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:10636 fp=#0x30000000a6e' 2024-08-31T04:31:05.457 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:11756 fp=#0x30000000c37' 2024-08-31T04:31:05.457 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:11788 fp=#0x30000000bdc' 2024-08-31T04:31:05.457 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:11820 fp=#0x30000000c3f' 2024-08-31T04:31:05.458 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:11852 fp=#0x30000000bc6' 2024-08-31T04:31:05.458 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:11884 fp=#0x300000023b1' 2024-08-31T04:31:05.458 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:11916 fp=#0x30000001183' 2024-08-31T04:31:05.459 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:11980 fp=#0x30000001100' 2024-08-31T04:31:05.459 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12012 fp=#0x300000010a2' 2024-08-31T04:31:05.460 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12044 fp=#0x300000010e1' 2024-08-31T04:31:05.460 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12076 fp=#0x30000001068' 2024-08-31T04:31:05.461 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12236 fp=#0x300000009e3' 2024-08-31T04:31:05.462 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12268 fp=#0x30000000998' 2024-08-31T04:31:05.462 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12364 fp=#0x3000000094d' 2024-08-31T04:31:05.463 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12460 fp=#0x30000002e12' 2024-08-31T04:31:05.463 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12492 fp=#0x30000000f8f' 2024-08-31T04:31:05.464 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12524 fp=#0x30000002a5b' 2024-08-31T04:31:05.464 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12556 fp=#0x30000000f72' 2024-08-31T04:31:05.464 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12588 fp=#0x30000000e74' 2024-08-31T04:31:05.465 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12620 fp=#0x30000000ea8' 2024-08-31T04:31:05.465 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12652 fp=#0x3000000228b' 2024-08-31T04:31:05.465 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12684 fp=#0x30000000e81' 2024-08-31T04:31:05.466 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12716 fp=#0x30000000e25' 2024-08-31T04:31:05.466 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12748 fp=#0x30000000e59' 2024-08-31T04:31:05.466 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12780 fp=#0x30000003379' 2024-08-31T04:31:05.466 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12812 fp=#0x300000033d2' 2024-08-31T04:31:05.467 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12844 fp=#0x10000004312' 2024-08-31T04:31:05.467 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12876 fp=#0x3000000284a' 2024-08-31T04:31:05.468 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12908 fp=#0x100000043e8' 2024-08-31T04:31:05.468 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12940 fp=#0x10000004204' 2024-08-31T04:31:05.468 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12972 fp=#0x100000041d5' 2024-08-31T04:31:05.469 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13004 fp=#0x1000000424c' 2024-08-31T04:31:05.469 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13036 fp=#0x1000000424f' 2024-08-31T04:31:05.469 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13068 fp=#0x10000004349' 2024-08-31T04:31:05.470 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13100 fp=#0x300000030e1' 2024-08-31T04:31:05.470 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13132 fp=#0x300000031cf' 2024-08-31T04:31:05.470 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13164 fp=#0x300000030f7' 2024-08-31T04:31:05.471 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13292 fp=#0x3000000228c' 2024-08-31T04:31:05.472 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13324 fp=#0x300000008d8' 2024-08-31T04:31:05.472 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13356 fp=#0x3000000224d' 2024-08-31T04:31:05.472 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13388 fp=#0x300000008a9' 2024-08-31T04:31:05.473 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13420 fp=#0x3000000220f' 2024-08-31T04:31:05.473 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13452 fp=#0x3000000088d' 2024-08-31T04:31:05.473 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13484 fp=#0x300000008ee' 2024-08-31T04:31:05.474 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13516 fp=#0x300000008a1' 2024-08-31T04:31:05.474 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13548 fp=#0x300000009b8' 2024-08-31T04:31:05.474 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13580 fp=#0x30000003324' 2024-08-31T04:31:05.475 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13612 fp=#0x300000032f2' 2024-08-31T04:31:05.475 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13644 fp=#0x30000003317' 2024-08-31T04:31:05.475 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13676 fp=#0x30000002999' 2024-08-31T04:31:05.476 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13708 fp=#0x300000029fe' 2024-08-31T04:31:05.476 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13740 fp=#0x300000029c2' 2024-08-31T04:31:05.476 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13772 fp=#0x300000028d3' 2024-08-31T04:31:05.477 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13804 fp=#0x300000028bb' 2024-08-31T04:31:05.477 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13836 fp=#0x300000028c7' 2024-08-31T04:31:05.478 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13932 fp=#0x10000003efa' 2024-08-31T04:31:05.478 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13996 fp=#0x10000003b9f' 2024-08-31T04:31:05.479 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14028 fp=#0x10000003d81' 2024-08-31T04:31:05.479 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14060 fp=#0x30000000c86' 2024-08-31T04:31:05.479 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14092 fp=#0x30000000c59' 2024-08-31T04:31:05.479 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14124 fp=#0x3000000179f' 2024-08-31T04:31:05.480 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14156 fp=#0x30000002435' 2024-08-31T04:31:05.480 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14188 fp=#0x30000001785' 2024-08-31T04:31:05.480 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14220 fp=#0x30000001759' 2024-08-31T04:31:05.481 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14252 fp=#0x300000017ab' 2024-08-31T04:31:05.482 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14412 fp=#0x30000000d5b' 2024-08-31T04:31:05.482 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14444 fp=#0x30000000cb9' 2024-08-31T04:31:05.483 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14476 fp=#0x30000000d9d' 2024-08-31T04:31:05.483 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14508 fp=#0x30000000caf' 2024-08-31T04:31:05.483 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14540 fp=#0x30000000cc7' 2024-08-31T04:31:05.484 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14572 fp=#0x30000000d85' 2024-08-31T04:31:05.484 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14604 fp=#0x30000002fbf' 2024-08-31T04:31:05.484 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14636 fp=#0x30000002fb0' 2024-08-31T04:31:05.485 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14668 fp=#0x30000002f96' 2024-08-31T04:31:05.485 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14700 fp=#0x1000000244d' 2024-08-31T04:31:05.485 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14732 fp=#0x30000002fa9' 2024-08-31T04:31:05.485 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14764 fp=#0x10000002409' 2024-08-31T04:31:05.486 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14795 fp=#0x10000003c39' 2024-08-31T04:31:05.486 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14827 fp=#0x10000003bf1' 2024-08-31T04:31:05.486 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14859 fp=#0x30000000a09' 2024-08-31T04:31:05.487 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14891 fp=#0x3000000091d' 2024-08-31T04:31:05.487 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14923 fp=#0x300000009a1' 2024-08-31T04:31:05.487 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14955 fp=#0x30000000955' 2024-08-31T04:31:05.488 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14987 fp=#0x3000000151c' 2024-08-31T04:31:05.488 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15019 fp=#0x3000000168b' 2024-08-31T04:31:05.488 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15051 fp=#0x3000000164b' 2024-08-31T04:31:05.489 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15083 fp=#0x3000000158a' 2024-08-31T04:31:05.489 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15115 fp=#0x300000033a0' 2024-08-31T04:31:05.489 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15147 fp=#0x300000033e4' 2024-08-31T04:31:05.490 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15179 fp=#0x300000033b3' 2024-08-31T04:31:05.490 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15211 fp=#0x30000002f0e' 2024-08-31T04:31:05.490 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15243 fp=#0x30000002ed7' 2024-08-31T04:31:05.491 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15275 fp=#0x30000002e6d' 2024-08-31T04:31:05.491 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15307 fp=#0x30000002e79' 2024-08-31T04:31:05.491 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15339 fp=#0x30000002e9a' 2024-08-31T04:31:05.491 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15371 fp=#0x300000032ed' 2024-08-31T04:31:05.492 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15403 fp=#0x300000032e0' 2024-08-31T04:31:05.492 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15435 fp=#0x30000001dc8' 2024-08-31T04:31:05.492 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15467 fp=#0x30000000f1d' 2024-08-31T04:31:05.493 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15499 fp=#0x30000000ecc' 2024-08-31T04:31:05.493 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15531 fp=#0x30000000f13' 2024-08-31T04:31:05.493 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15563 fp=#0x30000001db2' 2024-08-31T04:31:05.494 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15595 fp=#0x30000000ef0' 2024-08-31T04:31:05.494 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15627 fp=#0x30000000607' 2024-08-31T04:31:05.494 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15659 fp=#0x300000005c1' 2024-08-31T04:31:05.495 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15755 fp=#0x300000005e4' 2024-08-31T04:31:05.495 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15787 fp=#0x30000000530' 2024-08-31T04:31:05.496 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15850 fp=#0x300000014fd' 2024-08-31T04:31:05.496 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15882 fp=#0x300000012b7' 2024-08-31T04:31:05.496 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15914 fp=#0x300000012d2' 2024-08-31T04:31:05.497 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15946 fp=#0x300000014d5' 2024-08-31T04:31:05.497 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15978 fp=#0x300000012cb' 2024-08-31T04:31:05.497 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16010 fp=#0x30000001023' 2024-08-31T04:31:05.498 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16042 fp=#0x30000001095' 2024-08-31T04:31:05.498 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16074 fp=#0x30000001821' 2024-08-31T04:31:05.498 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16106 fp=#0x30000001c5d' 2024-08-31T04:31:05.499 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16202 fp=#0x300000034a4' 2024-08-31T04:31:05.499 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16234 fp=#0x30000003409' 2024-08-31T04:31:05.500 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16266 fp=#0x3000000090b' 2024-08-31T04:31:05.500 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16298 fp=#0x3000000063b' 2024-08-31T04:31:05.500 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16327 fp=#0x30000002083' 2024-08-31T04:31:05.501 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16359 fp=#0x10000002877' 2024-08-31T04:31:05.501 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16391 fp=#0x10000002846' 2024-08-31T04:31:05.501 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16423 fp=#0x1000000284c' 2024-08-31T04:31:05.502 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16455 fp=#0x30000001cce' 2024-08-31T04:31:05.502 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16487 fp=#0x30000001cbe' 2024-08-31T04:31:05.502 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16519 fp=#0x30000001d06' 2024-08-31T04:31:05.502 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16551 fp=#0x100000024cf' 2024-08-31T04:31:05.503 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16583 fp=#0x30000001ce7' 2024-08-31T04:31:05.503 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16615 fp=#0x30000001d43' 2024-08-31T04:31:05.503 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16646 fp=#0x3000000210f' 2024-08-31T04:31:05.504 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16678 fp=#0x30000002133' 2024-08-31T04:31:05.504 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16710 fp=#0x300000021b9' 2024-08-31T04:31:05.504 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16742 fp=#0x30000002610' 2024-08-31T04:31:05.505 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16870 fp=#0x30000001978' 2024-08-31T04:31:05.506 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16902 fp=#0x30000001a1d' 2024-08-31T04:31:05.506 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16933 fp=#0x30000002b4d' 2024-08-31T04:31:05.506 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16965 fp=#0x30000001ab4' 2024-08-31T04:31:05.507 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16997 fp=#0x30000002b4a' 2024-08-31T04:31:05.507 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17022 fp=#0x10000003717' 2024-08-31T04:31:05.507 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17054 fp=#0x10000003709' 2024-08-31T04:31:05.507 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17086 fp=#0x10000003652' 2024-08-31T04:31:05.508 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17118 fp=#0x100000036b2' 2024-08-31T04:31:05.508 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17150 fp=#0x300000017db' 2024-08-31T04:31:05.508 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17182 fp=#0x300000017d4' 2024-08-31T04:31:05.509 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17214 fp=#0x30000001765' 2024-08-31T04:31:05.509 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17246 fp=#0x300000017d9' 2024-08-31T04:31:05.509 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17278 fp=#0x3000000176c' 2024-08-31T04:31:05.510 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17310 fp=#0x300000017f6' 2024-08-31T04:31:05.510 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17342 fp=#0x30000003330' 2024-08-31T04:31:05.510 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17374 fp=#0x30000003323' 2024-08-31T04:31:05.511 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17534 fp=#0x30000000e13' 2024-08-31T04:31:05.512 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17566 fp=#0x30000000dee' 2024-08-31T04:31:05.512 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17598 fp=#0x3000000321e' 2024-08-31T04:31:05.512 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17630 fp=#0x3000000319a' 2024-08-31T04:31:05.513 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17662 fp=#0x300000031f1' 2024-08-31T04:31:05.514 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17790 fp=#0x30000002036' 2024-08-31T04:31:05.514 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17822 fp=#0x30000001ff8' 2024-08-31T04:31:05.514 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17854 fp=#0x30000002055' 2024-08-31T04:31:05.514 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17886 fp=#0x30000001fcb' 2024-08-31T04:31:05.515 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17918 fp=#0x3000000308e' 2024-08-31T04:31:05.515 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17950 fp=#0x300000030d6' 2024-08-31T04:31:05.515 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17982 fp=#0x3000000313b' 2024-08-31T04:31:05.516 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18046 fp=#0x30000001c04' 2024-08-31T04:31:05.516 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18078 fp=#0x30000001bdd' 2024-08-31T04:31:05.517 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18110 fp=#0x3000000255b' 2024-08-31T04:31:05.517 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18142 fp=#0x3000000256f' 2024-08-31T04:31:05.517 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18174 fp=#0x3000000257c' 2024-08-31T04:31:05.517 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18206 fp=#0x3000000255d' 2024-08-31T04:31:05.518 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18238 fp=#0x3000000258a' 2024-08-31T04:31:05.518 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18270 fp=#0x300000027e9' 2024-08-31T04:31:05.519 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18302 fp=#0x300000027e0' 2024-08-31T04:31:05.519 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18334 fp=#0x300000027f1' 2024-08-31T04:31:05.519 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18366 fp=#0x300000027dd' 2024-08-31T04:31:05.519 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18398 fp=#0x30000002f31' 2024-08-31T04:31:05.520 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18430 fp=#0x30000002f62' 2024-08-31T04:31:05.520 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18462 fp=#0x30000003029' 2024-08-31T04:31:05.520 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18494 fp=#0x30000002ff8' 2024-08-31T04:31:05.521 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18526 fp=#0x30000002f3d' 2024-08-31T04:31:05.521 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18558 fp=#0x10000001d04' 2024-08-31T04:31:05.522 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18622 fp=#0x10000001d49' 2024-08-31T04:31:05.522 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18654 fp=#0x10000001d4b' 2024-08-31T04:31:05.522 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18686 fp=#0x10000001d08' 2024-08-31T04:31:05.523 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18718 fp=#0x300000013cd' 2024-08-31T04:31:05.523 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18750 fp=#0x30000001fb4' 2024-08-31T04:31:05.523 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18782 fp=#0x300000013c0' 2024-08-31T04:31:05.523 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18814 fp=#0x3000000137d' 2024-08-31T04:31:05.524 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18846 fp=#0x300000013e2' 2024-08-31T04:31:05.524 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18878 fp=#0x300000010f3' 2024-08-31T04:31:05.524 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18910 fp=#0x300000010f5' 2024-08-31T04:31:05.525 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18942 fp=#0x300000010e0' 2024-08-31T04:31:05.525 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18974 fp=#0x30000001d5f' 2024-08-31T04:31:05.525 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19006 fp=#0x300000021fa' 2024-08-31T04:31:05.526 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19038 fp=#0x30000001d5b' 2024-08-31T04:31:05.526 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19070 fp=#0x300000011be' 2024-08-31T04:31:05.526 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19102 fp=#0x30000001111' 2024-08-31T04:31:05.526 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19134 fp=#0x30000001182' 2024-08-31T04:31:05.527 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19166 fp=#0x30000001590' 2024-08-31T04:31:05.527 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19230 fp=#0x3000000161f' 2024-08-31T04:31:05.528 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19294 fp=#0x100000008cf' 2024-08-31T04:31:05.528 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19326 fp=#0x30000002bd5' 2024-08-31T04:31:05.528 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19358 fp=#0x100000008d3' 2024-08-31T04:31:05.529 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19390 fp=#0x30000002baa' 2024-08-31T04:31:05.529 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19422 fp=#0x300000014d4' 2024-08-31T04:31:05.529 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19453 fp=#0x30000000bd5' 2024-08-31T04:31:05.530 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19485 fp=#0x30000000b8d' 2024-08-31T04:31:05.530 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19517 fp=#0x30000000be0' 2024-08-31T04:31:05.530 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19549 fp=#0x30000000b88' 2024-08-31T04:31:05.530 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19581 fp=#0x30000000af0' 2024-08-31T04:31:05.531 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19613 fp=#0x30000000b17' 2024-08-31T04:31:05.531 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19645 fp=#0x30000002ddd' 2024-08-31T04:31:05.531 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19677 fp=#0x30000002cda' 2024-08-31T04:31:05.532 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19709 fp=#0x30000002d15' 2024-08-31T04:31:05.532 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19741 fp=#0x30000002d3d' 2024-08-31T04:31:05.532 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19773 fp=#0x30000002c3e' 2024-08-31T04:31:05.533 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19805 fp=#0x30000002c30' 2024-08-31T04:31:05.533 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19837 fp=#0x3000000120b' 2024-08-31T04:31:05.533 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19869 fp=#0x30000001153' 2024-08-31T04:31:05.534 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19901 fp=#0x30000001463' 2024-08-31T04:31:05.534 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19933 fp=#0x30000001184' 2024-08-31T04:31:05.534 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19965 fp=#0x3000000141e' 2024-08-31T04:31:05.535 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19997 fp=#0x300000013f6' 2024-08-31T04:31:05.535 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20029 fp=#0x30000001410' 2024-08-31T04:31:05.535 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20061 fp=#0x30000000f98' 2024-08-31T04:31:05.536 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20093 fp=#0x30000000fcf' 2024-08-31T04:31:05.536 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20125 fp=#0x300000016f8' 2024-08-31T04:31:05.536 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20157 fp=#0x300000016c2' 2024-08-31T04:31:05.537 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20189 fp=#0x30000001714' 2024-08-31T04:31:05.537 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20221 fp=#0x300000016fb' 2024-08-31T04:31:05.537 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20253 fp=#0x300000030a3' 2024-08-31T04:31:05.537 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20285 fp=#0x300000030e6' 2024-08-31T04:31:05.538 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20317 fp=#0x3000000316e' 2024-08-31T04:31:05.538 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20349 fp=#0x3000000316b' 2024-08-31T04:31:05.538 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20381 fp=#0x30000001cd5' 2024-08-31T04:31:05.539 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20413 fp=#0x30000001c95' 2024-08-31T04:31:05.539 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20445 fp=#0x30000001c93' 2024-08-31T04:31:05.539 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20477 fp=#0x30000001ccf' 2024-08-31T04:31:05.540 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20509 fp=#0x30000001262' 2024-08-31T04:31:05.540 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20541 fp=#0x3000000126d' 2024-08-31T04:31:05.540 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20573 fp=#0x30000001248' 2024-08-31T04:31:05.541 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20605 fp=#0x3000000122b' 2024-08-31T04:31:05.541 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20637 fp=#0x3000000217a' 2024-08-31T04:31:05.541 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20669 fp=#0x3000000219b' 2024-08-31T04:31:05.542 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20733 fp=#0x300000021b0' 2024-08-31T04:31:05.542 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20797 fp=#0x10000003827' 2024-08-31T04:31:05.543 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20829 fp=#0x30000003040' 2024-08-31T04:31:05.543 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20861 fp=#0x300000030e8' 2024-08-31T04:31:05.543 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20893 fp=#0x30000003048' 2024-08-31T04:31:05.544 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20957 fp=#0x30000003050' 2024-08-31T04:31:05.544 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20989 fp=#0x300000020ea' 2024-08-31T04:31:05.544 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21020 fp=#0x30000001683' 2024-08-31T04:31:05.545 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21052 fp=#0x3000000165e' 2024-08-31T04:31:05.545 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21084 fp=#0x30000001566' 2024-08-31T04:31:05.545 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21116 fp=#0x300000015a2' 2024-08-31T04:31:05.547 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21308 fp=#0x10000003296' 2024-08-31T04:31:05.547 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21340 fp=#0x10000003367' 2024-08-31T04:31:05.547 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21372 fp=#0x1000000330f' 2024-08-31T04:31:05.548 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21404 fp=#0x100000032af' 2024-08-31T04:31:05.548 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21436 fp=#0x100000032c9' 2024-08-31T04:31:05.548 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21468 fp=#0x300000026cf' 2024-08-31T04:31:05.549 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21500 fp=#0x30000002639' 2024-08-31T04:31:05.549 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21532 fp=#0x3000000272e' 2024-08-31T04:31:05.549 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21564 fp=#0x30000002703' 2024-08-31T04:31:05.550 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21596 fp=#0x30000000d56' 2024-08-31T04:31:05.550 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21628 fp=#0x30000000d01' 2024-08-31T04:31:05.550 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21660 fp=#0x30000000ce1' 2024-08-31T04:31:05.550 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21692 fp=#0x30000003670' 2024-08-31T04:31:05.551 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21724 fp=#0x30000000d19' 2024-08-31T04:31:05.551 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21756 fp=#0x30000000c8d' 2024-08-31T04:31:05.551 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21788 fp=#0x30000000b4d' 2024-08-31T04:31:05.552 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21820 fp=#0x30000000ac6' 2024-08-31T04:31:05.552 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21852 fp=#0x30000000ae3' 2024-08-31T04:31:05.552 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21916 fp=#0x3000000053e' 2024-08-31T04:31:05.553 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21948 fp=#0x3000000058b' 2024-08-31T04:31:05.553 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21980 fp=#0x300000008e9' 2024-08-31T04:31:05.553 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22043 fp=#0x3000000192d' 2024-08-31T04:31:05.554 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22075 fp=#0x30000001900' 2024-08-31T04:31:05.554 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22107 fp=#0x3000000192b' 2024-08-31T04:31:05.554 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22139 fp=#0x3000000293c' 2024-08-31T04:31:05.555 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22171 fp=#0x30000002950' 2024-08-31T04:31:05.555 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22203 fp=#0x3000000296b' 2024-08-31T04:31:05.555 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22235 fp=#0x300000028a8' 2024-08-31T04:31:05.556 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22267 fp=#0x30000001fe4' 2024-08-31T04:31:05.556 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22299 fp=#0x30000001fdb' 2024-08-31T04:31:05.556 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22331 fp=#0x30000001fe1' 2024-08-31T04:31:05.557 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22363 fp=#0x30000002059' 2024-08-31T04:31:05.557 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22395 fp=#0x300000004b5' 2024-08-31T04:31:05.558 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22491 fp=#0x30000000486' 2024-08-31T04:31:05.558 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22548 fp=#0x30000002c2c' 2024-08-31T04:31:05.558 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22580 fp=#0x30000003014' 2024-08-31T04:31:05.558 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22611 fp=#0x30000001489' 2024-08-31T04:31:05.559 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22643 fp=#0x30000001482' 2024-08-31T04:31:05.559 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22675 fp=#0x30000001490' 2024-08-31T04:31:05.559 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22705 fp=#0x500000011a6' 2024-08-31T04:31:05.560 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:9805 fp=#0x30000001747' 2024-08-31T04:31:05.561 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:9901 fp=#0x30000000da2' 2024-08-31T04:31:05.565 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:10541 fp=#0x30000001cd4' 2024-08-31T04:31:05.566 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:10701 fp=#0x30000000a5c' 2024-08-31T04:31:05.567 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:10733 fp=#0x30000000a7f' 2024-08-31T04:31:05.574 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:11757 fp=#0x30000000c32' 2024-08-31T04:31:05.575 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:11789 fp=#0x30000000c2c' 2024-08-31T04:31:05.575 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:11821 fp=#0x300000023b6' 2024-08-31T04:31:05.576 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:11917 fp=#0x30000001071' 2024-08-31T04:31:05.576 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:11949 fp=#0x30000001051' 2024-08-31T04:31:05.576 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:11981 fp=#0x30000001030' 2024-08-31T04:31:05.576 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12013 fp=#0x300000031c9' 2024-08-31T04:31:05.577 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12045 fp=#0x3000000109f' 2024-08-31T04:31:05.577 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12077 fp=#0x300000010b7' 2024-08-31T04:31:05.582 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12429 fp=#0x30000002e14' 2024-08-31T04:31:05.583 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12461 fp=#0x30000002e48' 2024-08-31T04:31:05.583 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12493 fp=#0x30000000f46' 2024-08-31T04:31:05.583 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12557 fp=#0x30000000f6a' 2024-08-31T04:31:05.584 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12589 fp=#0x30000000e2d' 2024-08-31T04:31:05.584 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12621 fp=#0x30000000e1e' 2024-08-31T04:31:05.584 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12653 fp=#0x30000000e5e' 2024-08-31T04:31:05.585 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12685 fp=#0x300000033ca' 2024-08-31T04:31:05.585 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12749 fp=#0x30000000fda' 2024-08-31T04:31:05.585 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12781 fp=#0x30000003383' 2024-08-31T04:31:05.586 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12813 fp=#0x300000033ab' 2024-08-31T04:31:05.586 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12845 fp=#0x100000041ea' 2024-08-31T04:31:05.586 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12877 fp=#0x30000002862' 2024-08-31T04:31:05.587 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12909 fp=#0x1000000422b' 2024-08-31T04:31:05.587 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12941 fp=#0x30000002829' 2024-08-31T04:31:05.587 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12973 fp=#0x100000041dc' 2024-08-31T04:31:05.588 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13005 fp=#0x300000027fd' 2024-08-31T04:31:05.588 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13037 fp=#0x300000027fb' 2024-08-31T04:31:05.589 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13101 fp=#0x300000031bd' 2024-08-31T04:31:05.589 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13133 fp=#0x300000030b0' 2024-08-31T04:31:05.589 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13165 fp=#0x30000003136' 2024-08-31T04:31:05.590 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13293 fp=#0x30000000a48' 2024-08-31T04:31:05.590 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13325 fp=#0x300000008b5' 2024-08-31T04:31:05.591 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13357 fp=#0x3000000224e' 2024-08-31T04:31:05.591 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13389 fp=#0x30000002266' 2024-08-31T04:31:05.591 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13421 fp=#0x30000002280' 2024-08-31T04:31:05.592 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13453 fp=#0x30000002232' 2024-08-31T04:31:05.592 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13485 fp=#0x300000009da' 2024-08-31T04:31:05.592 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13517 fp=#0x3000000088a' 2024-08-31T04:31:05.593 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13549 fp=#0x300000008a2' 2024-08-31T04:31:05.593 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13581 fp=#0x30000003322' 2024-08-31T04:31:05.593 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13613 fp=#0x30000003346' 2024-08-31T04:31:05.593 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13645 fp=#0x300000032f1' 2024-08-31T04:31:05.594 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13677 fp=#0x300000028ea' 2024-08-31T04:31:05.594 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13709 fp=#0x30000002a20' 2024-08-31T04:31:05.594 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13741 fp=#0x300000028c3' 2024-08-31T04:31:05.595 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13773 fp=#0x300000028da' 2024-08-31T04:31:05.595 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13805 fp=#0x300000029c0' 2024-08-31T04:31:05.595 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13837 fp=#0x300000028e0' 2024-08-31T04:31:05.596 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13869 fp=#0x10000003bf8' 2024-08-31T04:31:05.596 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13901 fp=#0x10000003c4c' 2024-08-31T04:31:05.597 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13997 fp=#0x10000003c4a' 2024-08-31T04:31:05.597 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14029 fp=#0x30000001fc6' 2024-08-31T04:31:05.597 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14061 fp=#0x30000000c81' 2024-08-31T04:31:05.598 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14093 fp=#0x30000000c5e' 2024-08-31T04:31:05.598 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14125 fp=#0x3000000175d' 2024-08-31T04:31:05.598 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14157 fp=#0x30000001760' 2024-08-31T04:31:05.599 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14189 fp=#0x30000002437' 2024-08-31T04:31:05.599 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14221 fp=#0x30000001796' 2024-08-31T04:31:05.599 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14253 fp=#0x3000000176d' 2024-08-31T04:31:05.600 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14413 fp=#0x30000002388' 2024-08-31T04:31:05.601 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14445 fp=#0x30000000d87' 2024-08-31T04:31:05.601 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14477 fp=#0x30000002392' 2024-08-31T04:31:05.601 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14509 fp=#0x30000000d5d' 2024-08-31T04:31:05.602 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14541 fp=#0x30000000d20' 2024-08-31T04:31:05.602 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14573 fp=#0x30000000c95' 2024-08-31T04:31:05.602 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14605 fp=#0x1000000245b' 2024-08-31T04:31:05.603 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14637 fp=#0x10000002415' 2024-08-31T04:31:05.603 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14669 fp=#0x100000023f3' 2024-08-31T04:31:05.603 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14701 fp=#0x30000002fb9' 2024-08-31T04:31:05.603 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14733 fp=#0x10000002489' 2024-08-31T04:31:05.604 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14765 fp=#0x10000002447' 2024-08-31T04:31:05.604 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14796 fp=#0x10000003bbc' 2024-08-31T04:31:05.604 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14828 fp=#0x10000003c1b' 2024-08-31T04:31:05.605 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14860 fp=#0x30000000a2a' 2024-08-31T04:31:05.605 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14892 fp=#0x300000009dd' 2024-08-31T04:31:05.605 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14924 fp=#0x30000000995' 2024-08-31T04:31:05.606 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14956 fp=#0x3000000095f' 2024-08-31T04:31:05.606 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14988 fp=#0x300000014cf' 2024-08-31T04:31:05.606 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15020 fp=#0x30000001544' 2024-08-31T04:31:05.606 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15052 fp=#0x3000000156c' 2024-08-31T04:31:05.607 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15084 fp=#0x3000000166e' 2024-08-31T04:31:05.607 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15116 fp=#0x30000003427' 2024-08-31T04:31:05.607 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15148 fp=#0x300000033dc' 2024-08-31T04:31:05.608 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15180 fp=#0x300000033db' 2024-08-31T04:31:05.608 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15212 fp=#0x30000002ec2' 2024-08-31T04:31:05.608 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15244 fp=#0x30000002eab' 2024-08-31T04:31:05.609 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15276 fp=#0x30000002ecf' 2024-08-31T04:31:05.609 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15308 fp=#0x30000002ece' 2024-08-31T04:31:05.609 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15340 fp=#0x30000002efc' 2024-08-31T04:31:05.610 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15372 fp=#0x300000032de' 2024-08-31T04:31:05.610 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15404 fp=#0x300000032cb' 2024-08-31T04:31:05.610 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15436 fp=#0x30000001dbf' 2024-08-31T04:31:05.610 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15468 fp=#0x30000000f0b' 2024-08-31T04:31:05.611 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15500 fp=#0x30000001dca' 2024-08-31T04:31:05.611 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15532 fp=#0x30000000f00' 2024-08-31T04:31:05.611 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15564 fp=#0x30000001dac' 2024-08-31T04:31:05.612 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15596 fp=#0x30000000f1c' 2024-08-31T04:31:05.612 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15692 fp=#0x300000005f9' 2024-08-31T04:31:05.613 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15788 fp=#0x300000005d8' 2024-08-31T04:31:05.613 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15820 fp=#0x300000005bf' 2024-08-31T04:31:05.614 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15851 fp=#0x300000012ce' 2024-08-31T04:31:05.614 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15883 fp=#0x300000012c2' 2024-08-31T04:31:05.614 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15915 fp=#0x300000012b5' 2024-08-31T04:31:05.615 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15947 fp=#0x300000012f6' 2024-08-31T04:31:05.615 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15979 fp=#0x300000012ee' 2024-08-31T04:31:05.615 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16011 fp=#0x30000001062' 2024-08-31T04:31:05.615 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16043 fp=#0x3000000102f' 2024-08-31T04:31:05.616 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16075 fp=#0x30000002dec' 2024-08-31T04:31:05.616 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16107 fp=#0x3000000182e' 2024-08-31T04:31:05.617 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16139 fp=#0x300000005c7' 2024-08-31T04:31:05.617 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16171 fp=#0x3000000062c' 2024-08-31T04:31:05.617 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16203 fp=#0x300000005c3' 2024-08-31T04:31:05.618 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16267 fp=#0x30000003424' 2024-08-31T04:31:05.618 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16299 fp=#0x300000005cc' 2024-08-31T04:31:05.618 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16328 fp=#0x10000002844' 2024-08-31T04:31:05.619 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16360 fp=#0x300000020a9' 2024-08-31T04:31:05.619 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16392 fp=#0x10000002866' 2024-08-31T04:31:05.619 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16424 fp=#0x10000002857' 2024-08-31T04:31:05.619 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16456 fp=#0x10000002552' 2024-08-31T04:31:05.620 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16488 fp=#0x100000024f1' 2024-08-31T04:31:05.620 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16520 fp=#0x30000001d48' 2024-08-31T04:31:05.620 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16552 fp=#0x30000001d47' 2024-08-31T04:31:05.621 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16584 fp=#0x10000002514' 2024-08-31T04:31:05.621 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16616 fp=#0x30000001d18' 2024-08-31T04:31:05.621 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16647 fp=#0x30000002221' 2024-08-31T04:31:05.622 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16679 fp=#0x300000021d1' 2024-08-31T04:31:05.622 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16711 fp=#0x30000002123' 2024-08-31T04:31:05.622 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16743 fp=#0x300000026cd' 2024-08-31T04:31:05.623 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16775 fp=#0x30000001948' 2024-08-31T04:31:05.623 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16807 fp=#0x30000001a0d' 2024-08-31T04:31:05.624 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16903 fp=#0x3000000195c' 2024-08-31T04:31:05.624 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16934 fp=#0x30000002b5b' 2024-08-31T04:31:05.624 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16966 fp=#0x30000002b53' 2024-08-31T04:31:05.625 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16998 fp=#0x30000001ae4' 2024-08-31T04:31:05.625 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17023 fp=#0x1000000360d' 2024-08-31T04:31:05.625 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17055 fp=#0x100000036e1' 2024-08-31T04:31:05.626 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17087 fp=#0x1000000360b' 2024-08-31T04:31:05.626 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17119 fp=#0x100000036c9' 2024-08-31T04:31:05.626 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17151 fp=#0x30000001811' 2024-08-31T04:31:05.626 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17183 fp=#0x300000017f1' 2024-08-31T04:31:05.627 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17215 fp=#0x30000001775' 2024-08-31T04:31:05.627 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17247 fp=#0x300000017f0' 2024-08-31T04:31:05.627 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17279 fp=#0x30000001735' 2024-08-31T04:31:05.628 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17311 fp=#0x300000017e3' 2024-08-31T04:31:05.628 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17343 fp=#0x30000003316' 2024-08-31T04:31:05.628 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17375 fp=#0x3000000333c' 2024-08-31T04:31:05.629 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17535 fp=#0x30000000e04' 2024-08-31T04:31:05.630 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17567 fp=#0x300000031c8' 2024-08-31T04:31:05.630 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17599 fp=#0x300000031d0' 2024-08-31T04:31:05.630 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17631 fp=#0x30000000e02' 2024-08-31T04:31:05.631 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17663 fp=#0x30000000ddb' 2024-08-31T04:31:05.631 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17791 fp=#0x30000001f61' 2024-08-31T04:31:05.632 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17823 fp=#0x30000001fff' 2024-08-31T04:31:05.632 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17855 fp=#0x30000001fd7' 2024-08-31T04:31:05.632 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17887 fp=#0x30000001f79' 2024-08-31T04:31:05.633 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17919 fp=#0x3000000313e' 2024-08-31T04:31:05.633 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17951 fp=#0x30000003126' 2024-08-31T04:31:05.633 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17983 fp=#0x30000003102' 2024-08-31T04:31:05.634 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18015 fp=#0x30000001c1c' 2024-08-31T04:31:05.634 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18047 fp=#0x30000001c43' 2024-08-31T04:31:05.634 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18079 fp=#0x30000001c33' 2024-08-31T04:31:05.635 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18111 fp=#0x300000025a6' 2024-08-31T04:31:05.635 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18143 fp=#0x30000002580' 2024-08-31T04:31:05.635 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18175 fp=#0x300000025a7' 2024-08-31T04:31:05.635 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18207 fp=#0x30000002550' 2024-08-31T04:31:05.636 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18239 fp=#0x30000002536' 2024-08-31T04:31:05.636 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18271 fp=#0x30000002854' 2024-08-31T04:31:05.636 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18303 fp=#0x30000002896' 2024-08-31T04:31:05.637 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18335 fp=#0x300000027cb' 2024-08-31T04:31:05.637 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18367 fp=#0x300000027f5' 2024-08-31T04:31:05.637 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18399 fp=#0x30000002f61' 2024-08-31T04:31:05.638 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18431 fp=#0x30000002f50' 2024-08-31T04:31:05.638 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18463 fp=#0x30000002f16' 2024-08-31T04:31:05.638 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18495 fp=#0x30000002f22' 2024-08-31T04:31:05.638 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18527 fp=#0x30000002f56' 2024-08-31T04:31:05.639 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18559 fp=#0x10000001d7f' 2024-08-31T04:31:05.639 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18591 fp=#0x10000001d50' 2024-08-31T04:31:05.639 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18623 fp=#0x10000001d82' 2024-08-31T04:31:05.640 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18655 fp=#0x10000001d1b' 2024-08-31T04:31:05.640 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18687 fp=#0x10000001d0e' 2024-08-31T04:31:05.640 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18719 fp=#0x3000000133d' 2024-08-31T04:31:05.641 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18751 fp=#0x30000001345' 2024-08-31T04:31:05.641 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18783 fp=#0x300000013c8' 2024-08-31T04:31:05.641 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18815 fp=#0x3000000134f' 2024-08-31T04:31:05.642 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18847 fp=#0x30000001399' 2024-08-31T04:31:05.642 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18879 fp=#0x30000001061' 2024-08-31T04:31:05.642 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18911 fp=#0x30000001086' 2024-08-31T04:31:05.643 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18943 fp=#0x30000001d8a' 2024-08-31T04:31:05.643 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18975 fp=#0x30000001055' 2024-08-31T04:31:05.643 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19007 fp=#0x300000010de' 2024-08-31T04:31:05.644 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19039 fp=#0x30000001053' 2024-08-31T04:31:05.644 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19071 fp=#0x30000001174' 2024-08-31T04:31:05.644 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19103 fp=#0x3000000114d' 2024-08-31T04:31:05.644 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19135 fp=#0x30000001117' 2024-08-31T04:31:05.645 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19167 fp=#0x3000000167e' 2024-08-31T04:31:05.645 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19231 fp=#0x300000015bf' 2024-08-31T04:31:05.646 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19295 fp=#0x100000008a4' 2024-08-31T04:31:05.648 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19327 fp=#0x1000000089e' 2024-08-31T04:31:05.648 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19359 fp=#0x100000008ae' 2024-08-31T04:31:05.648 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19391 fp=#0x100000008df' 2024-08-31T04:31:05.648 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19423 fp=#0x100000008b9' 2024-08-31T04:31:05.649 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19454 fp=#0x30000000b84' 2024-08-31T04:31:05.649 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19486 fp=#0x30000000b9f' 2024-08-31T04:31:05.649 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19518 fp=#0x30000000ba6' 2024-08-31T04:31:05.650 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19550 fp=#0x30000000b70' 2024-08-31T04:31:05.650 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19582 fp=#0x30000000af6' 2024-08-31T04:31:05.650 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19614 fp=#0x30000000a96' 2024-08-31T04:31:05.650 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19646 fp=#0x30000002c04' 2024-08-31T04:31:05.651 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19678 fp=#0x30000002d83' 2024-08-31T04:31:05.651 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19710 fp=#0x30000002d1e' 2024-08-31T04:31:05.651 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19742 fp=#0x30000002d67' 2024-08-31T04:31:05.652 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19774 fp=#0x30000002d92' 2024-08-31T04:31:05.652 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19806 fp=#0x30000002cdb' 2024-08-31T04:31:05.652 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19838 fp=#0x3000000145b' 2024-08-31T04:31:05.653 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19870 fp=#0x30000001455' 2024-08-31T04:31:05.653 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19902 fp=#0x300000011cb' 2024-08-31T04:31:05.653 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19934 fp=#0x3000000118c' 2024-08-31T04:31:05.654 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19966 fp=#0x300000013fb' 2024-08-31T04:31:05.654 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19998 fp=#0x30000001427' 2024-08-31T04:31:05.654 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20030 fp=#0x30000001416' 2024-08-31T04:31:05.654 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20062 fp=#0x30000001c59' 2024-08-31T04:31:05.655 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20094 fp=#0x30000000fa6' 2024-08-31T04:31:05.655 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20126 fp=#0x3000000173e' 2024-08-31T04:31:05.655 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20158 fp=#0x300000016c9' 2024-08-31T04:31:05.656 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20190 fp=#0x300000016e3' 2024-08-31T04:31:05.656 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20222 fp=#0x3000000348a' 2024-08-31T04:31:05.656 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20254 fp=#0x300000030ad' 2024-08-31T04:31:05.657 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20286 fp=#0x30000003181' 2024-08-31T04:31:05.657 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20318 fp=#0x30000003195' 2024-08-31T04:31:05.657 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20350 fp=#0x300000031be' 2024-08-31T04:31:05.657 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20382 fp=#0x30000001c72' 2024-08-31T04:31:05.658 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20414 fp=#0x30000001cb6' 2024-08-31T04:31:05.658 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20446 fp=#0x30000001c7f' 2024-08-31T04:31:05.658 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20478 fp=#0x30000001c61' 2024-08-31T04:31:05.659 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20510 fp=#0x30000001223' 2024-08-31T04:31:05.659 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20542 fp=#0x3000000121d' 2024-08-31T04:31:05.659 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20574 fp=#0x3000000124c' 2024-08-31T04:31:05.659 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20606 fp=#0x30000001229' 2024-08-31T04:31:05.660 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20638 fp=#0x30000002191' 2024-08-31T04:31:05.660 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20670 fp=#0x30000002198' 2024-08-31T04:31:05.660 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20702 fp=#0x300000032ba' 2024-08-31T04:31:05.661 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20734 fp=#0x30000002199' 2024-08-31T04:31:05.661 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20766 fp=#0x10000003730' 2024-08-31T04:31:05.662 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20926 fp=#0x10000003732' 2024-08-31T04:31:05.663 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20958 fp=#0x300000020e2' 2024-08-31T04:31:05.663 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20990 fp=#0x300000020b2' 2024-08-31T04:31:05.663 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21021 fp=#0x30000001533' 2024-08-31T04:31:05.664 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21053 fp=#0x30000001656' 2024-08-31T04:31:05.664 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21085 fp=#0x30000001622' 2024-08-31T04:31:05.664 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21117 fp=#0x30000001545' 2024-08-31T04:31:05.665 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21309 fp=#0x1000000337d' 2024-08-31T04:31:05.666 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21341 fp=#0x100000032b4' 2024-08-31T04:31:05.666 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21373 fp=#0x1000000333e' 2024-08-31T04:31:05.666 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21405 fp=#0x10000003382' 2024-08-31T04:31:05.667 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21437 fp=#0x10000003355' 2024-08-31T04:31:05.667 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21469 fp=#0x3000000273b' 2024-08-31T04:31:05.667 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21501 fp=#0x3000000264c' 2024-08-31T04:31:05.668 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21533 fp=#0x3000000268b' 2024-08-31T04:31:05.668 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21565 fp=#0x3000000262c' 2024-08-31T04:31:05.668 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21597 fp=#0x30000000d0f' 2024-08-31T04:31:05.669 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21629 fp=#0x30000000cce' 2024-08-31T04:31:05.669 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21661 fp=#0x3000000368e' 2024-08-31T04:31:05.669 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21693 fp=#0x30000003703' 2024-08-31T04:31:05.670 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21725 fp=#0x30000000c92' 2024-08-31T04:31:05.670 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21757 fp=#0x30000000cbe' 2024-08-31T04:31:05.670 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21789 fp=#0x30000000ab6' 2024-08-31T04:31:05.671 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21821 fp=#0x30000000af7' 2024-08-31T04:31:05.671 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21853 fp=#0x30000000aae' 2024-08-31T04:31:05.671 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21885 fp=#0x3000000052d' 2024-08-31T04:31:05.671 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21917 fp=#0x30000000523' 2024-08-31T04:31:05.672 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21949 fp=#0x300000008fd' 2024-08-31T04:31:05.672 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22012 fp=#0x30000001939' 2024-08-31T04:31:05.673 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22044 fp=#0x30000001927' 2024-08-31T04:31:05.673 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22076 fp=#0x300000018f2' 2024-08-31T04:31:05.673 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22108 fp=#0x30000001912' 2024-08-31T04:31:05.674 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22140 fp=#0x300000029a6' 2024-08-31T04:31:05.674 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22172 fp=#0x30000002983' 2024-08-31T04:31:05.674 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22204 fp=#0x30000002944' 2024-08-31T04:31:05.675 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22236 fp=#0x30000002971' 2024-08-31T04:31:05.675 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22268 fp=#0x30000002040' 2024-08-31T04:31:05.675 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22300 fp=#0x30000002032' 2024-08-31T04:31:05.676 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22332 fp=#0x30000002081' 2024-08-31T04:31:05.676 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22364 fp=#0x3000000203a' 2024-08-31T04:31:05.676 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22396 fp=#0x30000000433' 2024-08-31T04:31:05.676 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22428 fp=#0x30000000487' 2024-08-31T04:31:05.677 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22492 fp=#0x3000000042d' 2024-08-31T04:31:05.677 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22549 fp=#0x30000003750' 2024-08-31T04:31:05.678 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22581 fp=#0x30000002bec' 2024-08-31T04:31:05.678 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22612 fp=#0x30000001471' 2024-08-31T04:31:05.678 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22644 fp=#0x300000033c7' 2024-08-31T04:31:05.679 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22676 fp=#0x30000001497' 2024-08-31T04:31:05.679 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:9806 fp=#0x300000020ef' 2024-08-31T04:31:05.680 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:9902 fp=#0x3000000075c' 2024-08-31T04:31:05.680 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:9934 fp=#0x30000003051' 2024-08-31T04:31:05.685 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:10638 fp=#0x30000000a5e' 2024-08-31T04:31:05.686 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:10670 fp=#0x30000000a63' 2024-08-31T04:31:05.686 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:10702 fp=#0x30000000a76' 2024-08-31T04:31:05.693 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:11758 fp=#0x30000000bbe' 2024-08-31T04:31:05.694 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:11886 fp=#0x300000023c4' 2024-08-31T04:31:05.695 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:11982 fp=#0x300000011ab' 2024-08-31T04:31:05.695 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12014 fp=#0x300000011b7' 2024-08-31T04:31:05.696 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12078 fp=#0x30000001196' 2024-08-31T04:31:05.696 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12110 fp=#0x300000031e2' 2024-08-31T04:31:05.697 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12142 fp=#0x30000001044' 2024-08-31T04:31:05.699 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12494 fp=#0x30000000f8d' 2024-08-31T04:31:05.700 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12526 fp=#0x30000000f49' 2024-08-31T04:31:05.700 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12558 fp=#0x30000000f52' 2024-08-31T04:31:05.700 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12590 fp=#0x30000000e5f' 2024-08-31T04:31:05.701 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12622 fp=#0x30000000e1b' 2024-08-31T04:31:05.701 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12654 fp=#0x30000000e55' 2024-08-31T04:31:05.701 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12686 fp=#0x30000000e24' 2024-08-31T04:31:05.702 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12718 fp=#0x30000000e56' 2024-08-31T04:31:05.702 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12750 fp=#0x30000000e16' 2024-08-31T04:31:05.702 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12782 fp=#0x3000000337a' 2024-08-31T04:31:05.702 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12814 fp=#0x30000000e31' 2024-08-31T04:31:05.703 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12846 fp=#0x10000004242' 2024-08-31T04:31:05.703 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12878 fp=#0x100000043de' 2024-08-31T04:31:05.703 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12910 fp=#0x30000002810' 2024-08-31T04:31:05.704 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12942 fp=#0x30000002815' 2024-08-31T04:31:05.704 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12974 fp=#0x1000000433a' 2024-08-31T04:31:05.704 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13006 fp=#0x10000004207' 2024-08-31T04:31:05.704 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13038 fp=#0x3000000283c' 2024-08-31T04:31:05.705 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13070 fp=#0x300000028b3' 2024-08-31T04:31:05.705 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13102 fp=#0x30000003112' 2024-08-31T04:31:05.705 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13134 fp=#0x300000030ae' 2024-08-31T04:31:05.706 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13166 fp=#0x3000000312b' 2024-08-31T04:31:05.707 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13294 fp=#0x300000008ae' 2024-08-31T04:31:05.707 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13326 fp=#0x30000000a55' 2024-08-31T04:31:05.707 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13358 fp=#0x300000009bc' 2024-08-31T04:31:05.708 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13390 fp=#0x30000002291' 2024-08-31T04:31:05.708 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13422 fp=#0x30000000a58' 2024-08-31T04:31:05.708 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13454 fp=#0x3000000090f' 2024-08-31T04:31:05.708 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13486 fp=#0x300000008be' 2024-08-31T04:31:05.709 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13518 fp=#0x30000002279' 2024-08-31T04:31:05.709 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13550 fp=#0x3000000096f' 2024-08-31T04:31:05.709 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13582 fp=#0x300000032a1' 2024-08-31T04:31:05.710 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13614 fp=#0x300000032ab' 2024-08-31T04:31:05.710 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13646 fp=#0x30000003335' 2024-08-31T04:31:05.710 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13678 fp=#0x3000000297a' 2024-08-31T04:31:05.711 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13710 fp=#0x30000002989' 2024-08-31T04:31:05.711 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13742 fp=#0x30000002a09' 2024-08-31T04:31:05.711 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13774 fp=#0x300000029a9' 2024-08-31T04:31:05.711 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13806 fp=#0x300000029e7' 2024-08-31T04:31:05.712 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13838 fp=#0x30000002926' 2024-08-31T04:31:05.712 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13870 fp=#0x10000003df9' 2024-08-31T04:31:05.712 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13902 fp=#0x10000003d90' 2024-08-31T04:31:05.713 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13966 fp=#0x10000003bf0' 2024-08-31T04:31:05.713 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13998 fp=#0x10000003c00' 2024-08-31T04:31:05.714 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14030 fp=#0x10000003bd4' 2024-08-31T04:31:05.714 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14062 fp=#0x30000000c6b' 2024-08-31T04:31:05.714 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14094 fp=#0x30000000c4a' 2024-08-31T04:31:05.714 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14126 fp=#0x300000017a6' 2024-08-31T04:31:05.715 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14158 fp=#0x30000001751' 2024-08-31T04:31:05.715 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14190 fp=#0x3000000247f' 2024-08-31T04:31:05.715 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14222 fp=#0x30000002493' 2024-08-31T04:31:05.716 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14254 fp=#0x3000000242f' 2024-08-31T04:31:05.717 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14382 fp=#0x30000000cb1' 2024-08-31T04:31:05.717 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14414 fp=#0x30000000d98' 2024-08-31T04:31:05.717 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14446 fp=#0x30000000d18' 2024-08-31T04:31:05.718 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14478 fp=#0x30000000d6a' 2024-08-31T04:31:05.718 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14510 fp=#0x30000000d78' 2024-08-31T04:31:05.718 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14542 fp=#0x30000000cf6' 2024-08-31T04:31:05.718 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14574 fp=#0x30000000cda' 2024-08-31T04:31:05.719 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14606 fp=#0x10000002498' 2024-08-31T04:31:05.719 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14638 fp=#0x30000002f8e' 2024-08-31T04:31:05.719 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14670 fp=#0x30000002fc9' 2024-08-31T04:31:05.720 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14702 fp=#0x30000002fc0' 2024-08-31T04:31:05.720 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14734 fp=#0x1000000245f' 2024-08-31T04:31:05.720 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14766 fp=#0x1000000240c' 2024-08-31T04:31:05.721 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14797 fp=#0x300000011b6' 2024-08-31T04:31:05.721 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14829 fp=#0x10000003bc0' 2024-08-31T04:31:05.721 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14861 fp=#0x300000009ba' 2024-08-31T04:31:05.722 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14893 fp=#0x3000000091a' 2024-08-31T04:31:05.722 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14925 fp=#0x30000000926' 2024-08-31T04:31:05.722 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14957 fp=#0x3000000099f' 2024-08-31T04:31:05.723 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14989 fp=#0x300000015d6' 2024-08-31T04:31:05.723 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15021 fp=#0x30000001572' 2024-08-31T04:31:05.723 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15053 fp=#0x30000001511' 2024-08-31T04:31:05.723 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15085 fp=#0x30000001634' 2024-08-31T04:31:05.724 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15117 fp=#0x300000033d9' 2024-08-31T04:31:05.724 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15149 fp=#0x300000033d3' 2024-08-31T04:31:05.724 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15181 fp=#0x300000033b0' 2024-08-31T04:31:05.725 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15213 fp=#0x30000002e60' 2024-08-31T04:31:05.725 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15245 fp=#0x30000002ee6' 2024-08-31T04:31:05.725 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15277 fp=#0x30000002e6c' 2024-08-31T04:31:05.726 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15309 fp=#0x30000002ec0' 2024-08-31T04:31:05.726 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15341 fp=#0x30000002e7d' 2024-08-31T04:31:05.726 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15373 fp=#0x300000032e5' 2024-08-31T04:31:05.726 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15405 fp=#0x300000032d7' 2024-08-31T04:31:05.727 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15437 fp=#0x30000000efc' 2024-08-31T04:31:05.727 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15469 fp=#0x30000000f35' 2024-08-31T04:31:05.727 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15501 fp=#0x30000000eef' 2024-08-31T04:31:05.728 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15533 fp=#0x30000000eba' 2024-08-31T04:31:05.728 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15565 fp=#0x30000000f18' 2024-08-31T04:31:05.728 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15597 fp=#0x30000000f0c' 2024-08-31T04:31:05.729 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15629 fp=#0x30000000552' 2024-08-31T04:31:05.730 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15852 fp=#0x300000012ab' 2024-08-31T04:31:05.730 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15884 fp=#0x300000012b9' 2024-08-31T04:31:05.731 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15916 fp=#0x30000001285' 2024-08-31T04:31:05.731 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15948 fp=#0x300000012a7' 2024-08-31T04:31:05.731 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15980 fp=#0x300000012d6' 2024-08-31T04:31:05.732 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16012 fp=#0x30000001046' 2024-08-31T04:31:05.732 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16044 fp=#0x30000001021' 2024-08-31T04:31:05.732 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16076 fp=#0x30000001836' 2024-08-31T04:31:05.732 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16108 fp=#0x30000001829' 2024-08-31T04:31:05.733 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16140 fp=#0x300000005c0' 2024-08-31T04:31:05.733 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16204 fp=#0x300000005d7' 2024-08-31T04:31:05.734 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16236 fp=#0x300000005e0' 2024-08-31T04:31:05.734 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16300 fp=#0x300000005d2' 2024-08-31T04:31:05.735 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16329 fp=#0x1000000287f' 2024-08-31T04:31:05.735 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16361 fp=#0x3000000209c' 2024-08-31T04:31:05.735 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16393 fp=#0x1000000281b' 2024-08-31T04:31:05.736 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16457 fp=#0x30000001d3f' 2024-08-31T04:31:05.736 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16489 fp=#0x30000001cf2' 2024-08-31T04:31:05.736 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16521 fp=#0x30000001d40' 2024-08-31T04:31:05.737 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16553 fp=#0x30000001cf5' 2024-08-31T04:31:05.737 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16585 fp=#0x30000001cf6' 2024-08-31T04:31:05.737 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16617 fp=#0x30000001ced' 2024-08-31T04:31:05.738 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16648 fp=#0x30000002346' 2024-08-31T04:31:05.738 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16680 fp=#0x3000000234e' 2024-08-31T04:31:05.738 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16712 fp=#0x3000000210c' 2024-08-31T04:31:05.739 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16744 fp=#0x300000003e6' 2024-08-31T04:31:05.739 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16776 fp=#0x30000001a2b' 2024-08-31T04:31:05.739 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16808 fp=#0x30000001a27' 2024-08-31T04:31:05.739 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16840 fp=#0x30000001958' 2024-08-31T04:31:05.740 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16872 fp=#0x30000001973' 2024-08-31T04:31:05.740 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16904 fp=#0x3000000195f' 2024-08-31T04:31:05.740 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16935 fp=#0x30000001aaa' 2024-08-31T04:31:05.741 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16967 fp=#0x30000001a6a' 2024-08-31T04:31:05.741 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16999 fp=#0x30000001add' 2024-08-31T04:31:05.741 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17024 fp=#0x1000000369f' 2024-08-31T04:31:05.742 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17056 fp=#0x1000000367c' 2024-08-31T04:31:05.742 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17088 fp=#0x100000036ea' 2024-08-31T04:31:05.742 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17120 fp=#0x100000036cf' 2024-08-31T04:31:05.743 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17152 fp=#0x30000001777' 2024-08-31T04:31:05.743 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17184 fp=#0x30000002cab' 2024-08-31T04:31:05.743 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17216 fp=#0x30000001813' 2024-08-31T04:31:05.744 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17248 fp=#0x300000017aa' 2024-08-31T04:31:05.744 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17280 fp=#0x30000001803' 2024-08-31T04:31:05.744 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17312 fp=#0x300000017d5' 2024-08-31T04:31:05.744 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17344 fp=#0x3000000331e' 2024-08-31T04:31:05.745 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17376 fp=#0x30000003305' 2024-08-31T04:31:05.746 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17536 fp=#0x30000000dad' 2024-08-31T04:31:05.746 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17568 fp=#0x300000031ca' 2024-08-31T04:31:05.747 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17600 fp=#0x30000003218' 2024-08-31T04:31:05.747 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17632 fp=#0x30000000db2' 2024-08-31T04:31:05.747 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17664 fp=#0x30000000db5' 2024-08-31T04:31:05.748 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17696 fp=#0x30000002bf1' 2024-08-31T04:31:05.748 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17792 fp=#0x30000001f91' 2024-08-31T04:31:05.749 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17824 fp=#0x30000001f5a' 2024-08-31T04:31:05.749 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17856 fp=#0x3000000204a' 2024-08-31T04:31:05.749 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17888 fp=#0x3000000202e' 2024-08-31T04:31:05.749 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17920 fp=#0x3000000316c' 2024-08-31T04:31:05.750 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17952 fp=#0x30000003169' 2024-08-31T04:31:05.750 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17984 fp=#0x3000000312a' 2024-08-31T04:31:05.750 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18016 fp=#0x30000001c9b' 2024-08-31T04:31:05.751 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18048 fp=#0x30000001bec' 2024-08-31T04:31:05.751 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18080 fp=#0x30000001c02' 2024-08-31T04:31:05.751 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18112 fp=#0x30000002587' 2024-08-31T04:31:05.752 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18144 fp=#0x30000002583' 2024-08-31T04:31:05.752 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18176 fp=#0x3000000259f' 2024-08-31T04:31:05.752 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18208 fp=#0x3000000252c' 2024-08-31T04:31:05.752 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18240 fp=#0x3000000257a' 2024-08-31T04:31:05.753 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18272 fp=#0x300000027be' 2024-08-31T04:31:05.753 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18304 fp=#0x3000000281b' 2024-08-31T04:31:05.753 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18336 fp=#0x300000027e7' 2024-08-31T04:31:05.754 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18368 fp=#0x30000002814' 2024-08-31T04:31:05.754 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18400 fp=#0x3000000302d' 2024-08-31T04:31:05.754 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18432 fp=#0x30000002f30' 2024-08-31T04:31:05.755 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18464 fp=#0x30000002f1b' 2024-08-31T04:31:05.755 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18496 fp=#0x30000002f21' 2024-08-31T04:31:05.755 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18528 fp=#0x30000002fe4' 2024-08-31T04:31:05.755 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18560 fp=#0x10000001d54' 2024-08-31T04:31:05.756 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18592 fp=#0x10000001d5e' 2024-08-31T04:31:05.756 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18656 fp=#0x10000001d06' 2024-08-31T04:31:05.757 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18720 fp=#0x3000000150b' 2024-08-31T04:31:05.757 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18752 fp=#0x30000001510' 2024-08-31T04:31:05.757 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18784 fp=#0x300000013da' 2024-08-31T04:31:05.758 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18816 fp=#0x300000013b2' 2024-08-31T04:31:05.758 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18848 fp=#0x300000014e9' 2024-08-31T04:31:05.758 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18880 fp=#0x300000021f5' 2024-08-31T04:31:05.759 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18912 fp=#0x300000010ea' 2024-08-31T04:31:05.759 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18944 fp=#0x30000001d87' 2024-08-31T04:31:05.759 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18976 fp=#0x30000001d76' 2024-08-31T04:31:05.760 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19008 fp=#0x30000001069' 2024-08-31T04:31:05.760 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19040 fp=#0x30000001064' 2024-08-31T04:31:05.760 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19072 fp=#0x300000011a1' 2024-08-31T04:31:05.760 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19104 fp=#0x30000001163' 2024-08-31T04:31:05.761 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19136 fp=#0x300000011bc' 2024-08-31T04:31:05.761 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19168 fp=#0x30000001692' 2024-08-31T04:31:05.761 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19200 fp=#0x30000001c4b' 2024-08-31T04:31:05.762 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19232 fp=#0x3000000166c' 2024-08-31T04:31:05.762 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19264 fp=#0x300000015d4' 2024-08-31T04:31:05.762 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19296 fp=#0x100000008ee' 2024-08-31T04:31:05.763 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19328 fp=#0x100000008d2' 2024-08-31T04:31:05.763 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19360 fp=#0x30000002ba6' 2024-08-31T04:31:05.763 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19392 fp=#0x100000008ad' 2024-08-31T04:31:05.764 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19424 fp=#0x100000008c1' 2024-08-31T04:31:05.764 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19455 fp=#0x30000000bc7' 2024-08-31T04:31:05.764 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19487 fp=#0x30000000b94' 2024-08-31T04:31:05.764 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19519 fp=#0x30000000b57' 2024-08-31T04:31:05.765 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19551 fp=#0x30000000b76' 2024-08-31T04:31:05.765 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19583 fp=#0x30000000b11' 2024-08-31T04:31:05.765 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19615 fp=#0x30000000a8a' 2024-08-31T04:31:05.766 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19647 fp=#0x30000002d9a' 2024-08-31T04:31:05.766 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19679 fp=#0x30000002c18' 2024-08-31T04:31:05.766 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19711 fp=#0x30000002d4f' 2024-08-31T04:31:05.766 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19743 fp=#0x30000002cdc' 2024-08-31T04:31:05.767 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19775 fp=#0x30000002c96' 2024-08-31T04:31:05.767 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19807 fp=#0x30000002cf2' 2024-08-31T04:31:05.767 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19839 fp=#0x300000011d5' 2024-08-31T04:31:05.768 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19871 fp=#0x30000001469' 2024-08-31T04:31:05.768 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19903 fp=#0x30000001171' 2024-08-31T04:31:05.768 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19935 fp=#0x300000011cf' 2024-08-31T04:31:05.769 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19967 fp=#0x30000001438' 2024-08-31T04:31:05.769 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19999 fp=#0x30000001419' 2024-08-31T04:31:05.769 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20031 fp=#0x30000000fa1' 2024-08-31T04:31:05.770 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20063 fp=#0x30000000fbc' 2024-08-31T04:31:05.770 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20095 fp=#0x30000000fc2' 2024-08-31T04:31:05.770 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20127 fp=#0x300000016bb' 2024-08-31T04:31:05.771 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20159 fp=#0x300000016cd' 2024-08-31T04:31:05.771 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20191 fp=#0x300000016ec' 2024-08-31T04:31:05.771 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20223 fp=#0x300000016eb' 2024-08-31T04:31:05.772 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20255 fp=#0x3000000314e' 2024-08-31T04:31:05.772 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20287 fp=#0x30000003185' 2024-08-31T04:31:05.772 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20319 fp=#0x300000031a5' 2024-08-31T04:31:05.773 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20351 fp=#0x30000003198' 2024-08-31T04:31:05.773 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20383 fp=#0x30000001cd2' 2024-08-31T04:31:05.773 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20415 fp=#0x30000001cc8' 2024-08-31T04:31:05.773 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20447 fp=#0x30000001c62' 2024-08-31T04:31:05.774 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20479 fp=#0x30000001c8c' 2024-08-31T04:31:05.774 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20511 fp=#0x30000001271' 2024-08-31T04:31:05.774 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20543 fp=#0x3000000125b' 2024-08-31T04:31:05.775 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20575 fp=#0x30000001239' 2024-08-31T04:31:05.775 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20607 fp=#0x30000001255' 2024-08-31T04:31:05.776 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20671 fp=#0x300000021c6' 2024-08-31T04:31:05.776 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20735 fp=#0x3000000218f' 2024-08-31T04:31:05.776 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20767 fp=#0x1000000384c' 2024-08-31T04:31:05.777 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20863 fp=#0x10000003854' 2024-08-31T04:31:05.778 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20895 fp=#0x10000003739' 2024-08-31T04:31:05.778 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20927 fp=#0x1000000383b' 2024-08-31T04:31:05.778 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20959 fp=#0x300000020dd' 2024-08-31T04:31:05.779 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20991 fp=#0x300000020ec' 2024-08-31T04:31:05.779 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21022 fp=#0x30000001574' 2024-08-31T04:31:05.779 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21054 fp=#0x300000015ce' 2024-08-31T04:31:05.779 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21086 fp=#0x300000015b5' 2024-08-31T04:31:05.780 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21118 fp=#0x3000000156f' 2024-08-31T04:31:05.780 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21150 fp=#0x30000002c38' 2024-08-31T04:31:05.780 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21214 fp=#0x30000002bbd' 2024-08-31T04:31:05.781 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21310 fp=#0x10000003230' 2024-08-31T04:31:05.781 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21342 fp=#0x1000000335b' 2024-08-31T04:31:05.782 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21374 fp=#0x10000003416' 2024-08-31T04:31:05.782 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21406 fp=#0x10000003341' 2024-08-31T04:31:05.782 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21438 fp=#0x1000000332e' 2024-08-31T04:31:05.783 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21470 fp=#0x30000002744' 2024-08-31T04:31:05.783 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21502 fp=#0x30000002659' 2024-08-31T04:31:05.783 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21534 fp=#0x30000002637' 2024-08-31T04:31:05.784 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21566 fp=#0x30000002731' 2024-08-31T04:31:05.784 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21598 fp=#0x30000000d5a' 2024-08-31T04:31:05.784 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21630 fp=#0x30000000d07' 2024-08-31T04:31:05.785 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21662 fp=#0x30000003675' 2024-08-31T04:31:05.785 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21694 fp=#0x30000000d28' 2024-08-31T04:31:05.785 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21726 fp=#0x300000036ab' 2024-08-31T04:31:05.786 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21758 fp=#0x30000000d15' 2024-08-31T04:31:05.786 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21790 fp=#0x30000000aba' 2024-08-31T04:31:05.786 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21822 fp=#0x30000000ac8' 2024-08-31T04:31:05.787 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21854 fp=#0x30000000b38' 2024-08-31T04:31:05.787 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21886 fp=#0x3000000058a' 2024-08-31T04:31:05.787 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21918 fp=#0x30000001de1' 2024-08-31T04:31:05.788 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21982 fp=#0x3000000050f' 2024-08-31T04:31:05.788 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22013 fp=#0x30000001934' 2024-08-31T04:31:05.788 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22045 fp=#0x30000001915' 2024-08-31T04:31:05.789 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22077 fp=#0x300000018ff' 2024-08-31T04:31:05.789 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22109 fp=#0x300000018f6' 2024-08-31T04:31:05.789 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22141 fp=#0x300000029ba' 2024-08-31T04:31:05.790 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22173 fp=#0x3000000290f' 2024-08-31T04:31:05.790 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22205 fp=#0x3000000317a' 2024-08-31T04:31:05.790 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22237 fp=#0x300000028b8' 2024-08-31T04:31:05.791 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22269 fp=#0x3000000209b' 2024-08-31T04:31:05.791 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22301 fp=#0x30000002039' 2024-08-31T04:31:05.791 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22333 fp=#0x3000000202a' 2024-08-31T04:31:05.792 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22365 fp=#0x3000000206b' 2024-08-31T04:31:05.792 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22493 fp=#0x30000000479' 2024-08-31T04:31:05.793 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22550 fp=#0x30000002bd6' 2024-08-31T04:31:05.793 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22582 fp=#0x30000002c00' 2024-08-31T04:31:05.794 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22677 fp=#0x30000001478' 2024-08-31T04:31:05.795 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:9807 fp=#0x300000007a6' 2024-08-31T04:31:05.795 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:9903 fp=#0x30000001f42' 2024-08-31T04:31:05.796 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:9935 fp=#0x1000000095d' 2024-08-31T04:31:05.809 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:11759 fp=#0x300000023cc' 2024-08-31T04:31:05.809 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:11887 fp=#0x300000023bc' 2024-08-31T04:31:05.810 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:11919 fp=#0x300000010b4' 2024-08-31T04:31:05.810 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:11951 fp=#0x300000010bb' 2024-08-31T04:31:05.810 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:11983 fp=#0x3000000115b' 2024-08-31T04:31:05.811 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12079 fp=#0x3000000100e' 2024-08-31T04:31:05.811 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12111 fp=#0x30000001128' 2024-08-31T04:31:05.812 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12143 fp=#0x30000001192' 2024-08-31T04:31:05.813 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12271 fp=#0x300000009e5' 2024-08-31T04:31:05.813 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12335 fp=#0x300000009b9' 2024-08-31T04:31:05.814 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12399 fp=#0x30000000935' 2024-08-31T04:31:05.814 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12463 fp=#0x30000002e18' 2024-08-31T04:31:05.815 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12495 fp=#0x30000000f8c' 2024-08-31T04:31:05.815 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12527 fp=#0x300000011e0' 2024-08-31T04:31:05.815 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12559 fp=#0x30000000f82' 2024-08-31T04:31:05.816 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12591 fp=#0x30000000fdd' 2024-08-31T04:31:05.816 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12623 fp=#0x30000003378' 2024-08-31T04:31:05.816 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12655 fp=#0x3000000227a' 2024-08-31T04:31:05.817 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12687 fp=#0x300000033b4' 2024-08-31T04:31:05.817 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12719 fp=#0x30000000e37' 2024-08-31T04:31:05.817 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12751 fp=#0x30000000e8a' 2024-08-31T04:31:05.818 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12783 fp=#0x30000000e9e' 2024-08-31T04:31:05.818 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12815 fp=#0x30000000fd7' 2024-08-31T04:31:05.818 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12847 fp=#0x10000004404' 2024-08-31T04:31:05.818 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12879 fp=#0x100000041cf' 2024-08-31T04:31:05.819 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12911 fp=#0x10000004240' 2024-08-31T04:31:05.819 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12943 fp=#0x10000004357' 2024-08-31T04:31:05.819 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12975 fp=#0x10000004230' 2024-08-31T04:31:05.820 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13007 fp=#0x10000004237' 2024-08-31T04:31:05.820 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13039 fp=#0x3000000284d' 2024-08-31T04:31:05.820 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13071 fp=#0x30000002874' 2024-08-31T04:31:05.821 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13103 fp=#0x300000031b4' 2024-08-31T04:31:05.821 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13135 fp=#0x300000030bd' 2024-08-31T04:31:05.821 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13167 fp=#0x30000003179' 2024-08-31T04:31:05.822 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13295 fp=#0x3000000225f' 2024-08-31T04:31:05.823 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13327 fp=#0x300000008a0' 2024-08-31T04:31:05.823 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13359 fp=#0x3000000089d' 2024-08-31T04:31:05.823 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13391 fp=#0x30000002250' 2024-08-31T04:31:05.823 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13423 fp=#0x30000002244' 2024-08-31T04:31:05.824 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13455 fp=#0x300000008b3' 2024-08-31T04:31:05.824 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13487 fp=#0x3000000221f' 2024-08-31T04:31:05.824 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13519 fp=#0x30000002267' 2024-08-31T04:31:05.825 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13551 fp=#0x30000002247' 2024-08-31T04:31:05.825 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13583 fp=#0x300000032fa' 2024-08-31T04:31:05.825 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13615 fp=#0x300000032a4' 2024-08-31T04:31:05.825 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13647 fp=#0x30000003327' 2024-08-31T04:31:05.826 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13679 fp=#0x30000002949' 2024-08-31T04:31:05.826 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13711 fp=#0x300000028b0' 2024-08-31T04:31:05.826 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13743 fp=#0x30000002903' 2024-08-31T04:31:05.827 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13775 fp=#0x30000002937' 2024-08-31T04:31:05.827 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13807 fp=#0x3000000295d' 2024-08-31T04:31:05.827 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13839 fp=#0x30000002a0b' 2024-08-31T04:31:05.828 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13871 fp=#0x10000003d62' 2024-08-31T04:31:05.828 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13903 fp=#0x10000003d68' 2024-08-31T04:31:05.828 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13935 fp=#0x10000003bb5' 2024-08-31T04:31:05.829 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14031 fp=#0x10000003c35' 2024-08-31T04:31:05.829 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14063 fp=#0x30000000c62' 2024-08-31T04:31:05.830 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14095 fp=#0x30000000c71' 2024-08-31T04:31:05.830 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14127 fp=#0x30000002e56' 2024-08-31T04:31:05.830 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14159 fp=#0x3000000179a' 2024-08-31T04:31:05.830 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14191 fp=#0x3000000242d' 2024-08-31T04:31:05.831 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14223 fp=#0x30000001791' 2024-08-31T04:31:05.832 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14383 fp=#0x30000000d95' 2024-08-31T04:31:05.832 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14415 fp=#0x30000000da1' 2024-08-31T04:31:05.832 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14447 fp=#0x30000000d81' 2024-08-31T04:31:05.833 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14479 fp=#0x30000000d62' 2024-08-31T04:31:05.833 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14511 fp=#0x30000000cfc' 2024-08-31T04:31:05.833 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14543 fp=#0x30000000d4b' 2024-08-31T04:31:05.834 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14575 fp=#0x30000000ce0' 2024-08-31T04:31:05.834 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14607 fp=#0x1000000249c' 2024-08-31T04:31:05.834 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14639 fp=#0x100000023e7' 2024-08-31T04:31:05.835 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14671 fp=#0x10000002426' 2024-08-31T04:31:05.835 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14703 fp=#0x30000002fa0' 2024-08-31T04:31:05.835 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14735 fp=#0x10000002445' 2024-08-31T04:31:05.836 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14767 fp=#0x10000002443' 2024-08-31T04:31:05.836 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14798 fp=#0x10000003c14' 2024-08-31T04:31:05.836 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14830 fp=#0x10000003bde' 2024-08-31T04:31:05.837 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14862 fp=#0x30000000a20' 2024-08-31T04:31:05.837 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14894 fp=#0x30000000929' 2024-08-31T04:31:05.837 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14926 fp=#0x3000000097b' 2024-08-31T04:31:05.838 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14958 fp=#0x300000009f4' 2024-08-31T04:31:05.838 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14990 fp=#0x300000016a7' 2024-08-31T04:31:05.838 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15022 fp=#0x3000000154c' 2024-08-31T04:31:05.838 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15054 fp=#0x30000001691' 2024-08-31T04:31:05.839 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15086 fp=#0x3000000157a' 2024-08-31T04:31:05.839 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15118 fp=#0x3000000343b' 2024-08-31T04:31:05.839 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15150 fp=#0x300000033a4' 2024-08-31T04:31:05.840 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15182 fp=#0x30000003415' 2024-08-31T04:31:05.840 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15214 fp=#0x30000002e98' 2024-08-31T04:31:05.840 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15246 fp=#0x30000002ecc' 2024-08-31T04:31:05.840 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15278 fp=#0x30000002e71' 2024-08-31T04:31:05.841 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15310 fp=#0x30000002e78' 2024-08-31T04:31:05.841 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15342 fp=#0x30000002eea' 2024-08-31T04:31:05.841 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15374 fp=#0x300000032e3' 2024-08-31T04:31:05.842 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15406 fp=#0x300000032c0' 2024-08-31T04:31:05.842 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15438 fp=#0x30000001dae' 2024-08-31T04:31:05.842 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15470 fp=#0x30000000f22' 2024-08-31T04:31:05.843 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15502 fp=#0x30000000ef7' 2024-08-31T04:31:05.843 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15534 fp=#0x30000000efa' 2024-08-31T04:31:05.843 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15566 fp=#0x30000000f11' 2024-08-31T04:31:05.844 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15598 fp=#0x30000001d9f' 2024-08-31T04:31:05.844 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15662 fp=#0x300000005f2' 2024-08-31T04:31:05.845 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15758 fp=#0x30000000550' 2024-08-31T04:31:05.846 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15853 fp=#0x300000014eb' 2024-08-31T04:31:05.846 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15885 fp=#0x30000001278' 2024-08-31T04:31:05.846 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15917 fp=#0x30000001288' 2024-08-31T04:31:05.846 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15949 fp=#0x300000012d3' 2024-08-31T04:31:05.847 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15981 fp=#0x30000001300' 2024-08-31T04:31:05.847 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16013 fp=#0x3000000101b' 2024-08-31T04:31:05.847 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16045 fp=#0x3000000106f' 2024-08-31T04:31:05.848 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16077 fp=#0x30000001832' 2024-08-31T04:31:05.848 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16109 fp=#0x3000000181f' 2024-08-31T04:31:05.848 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16173 fp=#0x3000000062f' 2024-08-31T04:31:05.849 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16237 fp=#0x300000036d2' 2024-08-31T04:31:05.849 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16269 fp=#0x300000005e7' 2024-08-31T04:31:05.850 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16330 fp=#0x1000000288c' 2024-08-31T04:31:05.850 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16362 fp=#0x30000002096' 2024-08-31T04:31:05.852 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16394 fp=#0x10000002872' 2024-08-31T04:31:05.852 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16458 fp=#0x1000000251f' 2024-08-31T04:31:05.852 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16490 fp=#0x30000001d02' 2024-08-31T04:31:05.853 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16522 fp=#0x100000024c1' 2024-08-31T04:31:05.853 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16554 fp=#0x10000002516' 2024-08-31T04:31:05.853 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16586 fp=#0x30000001d24' 2024-08-31T04:31:05.854 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16618 fp=#0x30000001d21' 2024-08-31T04:31:05.854 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16649 fp=#0x30000002135' 2024-08-31T04:31:05.854 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16681 fp=#0x30000002239' 2024-08-31T04:31:05.854 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16713 fp=#0x500000018a4' 2024-08-31T04:31:05.855 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16745 fp=#0x300000003ea' 2024-08-31T04:31:05.855 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16777 fp=#0x30000001a26' 2024-08-31T04:31:05.856 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16841 fp=#0x30000001962' 2024-08-31T04:31:05.856 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16873 fp=#0x3000000194d' 2024-08-31T04:31:05.856 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16905 fp=#0x30000001977' 2024-08-31T04:31:05.856 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16936 fp=#0x30000001a9d' 2024-08-31T04:31:05.857 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16968 fp=#0x30000001aa2' 2024-08-31T04:31:05.857 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17000 fp=#0x30000001aae' 2024-08-31T04:31:05.857 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17025 fp=#0x100000036fc' 2024-08-31T04:31:05.858 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17057 fp=#0x1000000369c' 2024-08-31T04:31:05.858 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17089 fp=#0x100000036b4' 2024-08-31T04:31:05.858 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17121 fp=#0x10000003930' 2024-08-31T04:31:05.859 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17153 fp=#0x3000000180f' 2024-08-31T04:31:05.859 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17185 fp=#0x30000002caa' 2024-08-31T04:31:05.859 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17217 fp=#0x300000017e6' 2024-08-31T04:31:05.859 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17249 fp=#0x30000001758' 2024-08-31T04:31:05.860 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17281 fp=#0x30000001772' 2024-08-31T04:31:05.860 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17313 fp=#0x30000002cef' 2024-08-31T04:31:05.860 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17345 fp=#0x3000000333e' 2024-08-31T04:31:05.861 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17377 fp=#0x3000000332e' 2024-08-31T04:31:05.862 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17537 fp=#0x30000000e0e' 2024-08-31T04:31:05.862 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17569 fp=#0x30000000de1' 2024-08-31T04:31:05.863 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17601 fp=#0x3000000322f' 2024-08-31T04:31:05.863 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17633 fp=#0x30000000dbf' 2024-08-31T04:31:05.863 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17665 fp=#0x30000000da7' 2024-08-31T04:31:05.864 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17793 fp=#0x30000002053' 2024-08-31T04:31:05.864 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17825 fp=#0x30000002024' 2024-08-31T04:31:05.865 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17857 fp=#0x30000001fc2' 2024-08-31T04:31:05.868 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17889 fp=#0x30000001f7e' 2024-08-31T04:31:05.868 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17921 fp=#0x30000003105' 2024-08-31T04:31:05.868 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17953 fp=#0x300000030de' 2024-08-31T04:31:05.868 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17985 fp=#0x30000003099' 2024-08-31T04:31:05.869 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18017 fp=#0x30000001c42' 2024-08-31T04:31:05.869 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18049 fp=#0x30000001beb' 2024-08-31T04:31:05.869 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18081 fp=#0x30000001bfd' 2024-08-31T04:31:05.870 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18113 fp=#0x300000025a8' 2024-08-31T04:31:05.870 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18145 fp=#0x3000000253f' 2024-08-31T04:31:05.870 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18177 fp=#0x30000002571' 2024-08-31T04:31:05.871 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18209 fp=#0x30000002595' 2024-08-31T04:31:05.871 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18241 fp=#0x300000027c6' 2024-08-31T04:31:05.871 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18273 fp=#0x30000002842' 2024-08-31T04:31:05.872 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18305 fp=#0x300000027c8' 2024-08-31T04:31:05.872 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18337 fp=#0x3000000287c' 2024-08-31T04:31:05.872 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18369 fp=#0x3000000280a' 2024-08-31T04:31:05.873 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18401 fp=#0x30000003024' 2024-08-31T04:31:05.873 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18433 fp=#0x30000002fe3' 2024-08-31T04:31:05.873 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18465 fp=#0x3000000300b' 2024-08-31T04:31:05.873 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18497 fp=#0x30000002f54' 2024-08-31T04:31:05.874 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18529 fp=#0x30000003018' 2024-08-31T04:31:05.874 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18561 fp=#0x10000001d84' 2024-08-31T04:31:05.875 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18625 fp=#0x10000001d71' 2024-08-31T04:31:05.875 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18689 fp=#0x10000001d57' 2024-08-31T04:31:05.876 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18721 fp=#0x30000001522' 2024-08-31T04:31:05.876 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18753 fp=#0x300000013b5' 2024-08-31T04:31:05.876 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18785 fp=#0x300000013cf' 2024-08-31T04:31:05.876 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18817 fp=#0x300000014e2' 2024-08-31T04:31:05.877 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18849 fp=#0x30000001382' 2024-08-31T04:31:05.877 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18881 fp=#0x300000010f2' 2024-08-31T04:31:05.877 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18913 fp=#0x300000010d8' 2024-08-31T04:31:05.878 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18945 fp=#0x300000021f9' 2024-08-31T04:31:05.878 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18977 fp=#0x30000001d58' 2024-08-31T04:31:05.878 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19009 fp=#0x30000001d74' 2024-08-31T04:31:05.879 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19041 fp=#0x300000010da' 2024-08-31T04:31:05.879 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19073 fp=#0x30000001154' 2024-08-31T04:31:05.879 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19105 fp=#0x300000011a7' 2024-08-31T04:31:05.879 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19137 fp=#0x30000001180' 2024-08-31T04:31:05.880 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19201 fp=#0x30000001628' 2024-08-31T04:31:05.880 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19233 fp=#0x30000001664' 2024-08-31T04:31:05.881 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19265 fp=#0x300000015a3' 2024-08-31T04:31:05.881 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19297 fp=#0x300000014fa' 2024-08-31T04:31:05.881 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19329 fp=#0x100000008d6' 2024-08-31T04:31:05.882 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19361 fp=#0x30000002bad' 2024-08-31T04:31:05.882 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19393 fp=#0x300000014ef' 2024-08-31T04:31:05.882 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19425 fp=#0x30000001516' 2024-08-31T04:31:05.882 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19456 fp=#0x30000000bb5' 2024-08-31T04:31:05.883 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19488 fp=#0x30000000ba4' 2024-08-31T04:31:05.883 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19520 fp=#0x30000000b83' 2024-08-31T04:31:05.883 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19552 fp=#0x30000000bb7' 2024-08-31T04:31:05.884 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19584 fp=#0x30000000a9d' 2024-08-31T04:31:05.884 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19616 fp=#0x30000002fe1' 2024-08-31T04:31:05.884 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19648 fp=#0x30000002c3a' 2024-08-31T04:31:05.885 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19680 fp=#0x30000002c10' 2024-08-31T04:31:05.885 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19712 fp=#0x30000002c0b' 2024-08-31T04:31:05.885 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19744 fp=#0x30000002c73' 2024-08-31T04:31:05.885 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19776 fp=#0x30000002c17' 2024-08-31T04:31:05.886 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19808 fp=#0x30000002d77' 2024-08-31T04:31:05.886 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19840 fp=#0x30000001176' 2024-08-31T04:31:05.886 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19872 fp=#0x3000000143f' 2024-08-31T04:31:05.887 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19904 fp=#0x3000000116e' 2024-08-31T04:31:05.887 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19936 fp=#0x300000011e6' 2024-08-31T04:31:05.887 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19968 fp=#0x3000000140f' 2024-08-31T04:31:05.888 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20000 fp=#0x300000013f9' 2024-08-31T04:31:05.888 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20032 fp=#0x30000000feb' 2024-08-31T04:31:05.888 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20064 fp=#0x30000000fc7' 2024-08-31T04:31:05.889 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20096 fp=#0x30000000fe8' 2024-08-31T04:31:05.889 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20128 fp=#0x30000001716' 2024-08-31T04:31:05.889 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20160 fp=#0x300000016e5' 2024-08-31T04:31:05.890 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20192 fp=#0x300000016c5' 2024-08-31T04:31:05.890 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20224 fp=#0x300000030b9' 2024-08-31T04:31:05.890 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20256 fp=#0x30000003211' 2024-08-31T04:31:05.890 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20288 fp=#0x3000000318b' 2024-08-31T04:31:05.891 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20320 fp=#0x3000000306b' 2024-08-31T04:31:05.891 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20352 fp=#0x30000003159' 2024-08-31T04:31:05.891 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20384 fp=#0x30000001c84' 2024-08-31T04:31:05.892 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20416 fp=#0x30000001c7c' 2024-08-31T04:31:05.892 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20448 fp=#0x30000001c91' 2024-08-31T04:31:05.892 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20480 fp=#0x30000001c5a' 2024-08-31T04:31:05.893 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20512 fp=#0x30000001252' 2024-08-31T04:31:05.893 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20544 fp=#0x30000001216' 2024-08-31T04:31:05.893 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20576 fp=#0x30000001233' 2024-08-31T04:31:05.894 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20608 fp=#0x30000001245' 2024-08-31T04:31:05.894 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20640 fp=#0x30000002157' 2024-08-31T04:31:05.894 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20672 fp=#0x3000000214d' 2024-08-31T04:31:05.895 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20800 fp=#0x1000000374d' 2024-08-31T04:31:05.896 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20832 fp=#0x300000030aa' 2024-08-31T04:31:05.896 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20864 fp=#0x300000027a8' 2024-08-31T04:31:05.896 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20896 fp=#0x30000001193' 2024-08-31T04:31:05.896 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20928 fp=#0x3000000307c' 2024-08-31T04:31:05.897 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20960 fp=#0x300000020c4' 2024-08-31T04:31:05.897 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20992 fp=#0x300000020e4' 2024-08-31T04:31:05.897 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21023 fp=#0x3000000163b' 2024-08-31T04:31:05.898 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21055 fp=#0x3000000152a' 2024-08-31T04:31:05.898 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21087 fp=#0x30000001632' 2024-08-31T04:31:05.898 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21119 fp=#0x30000001611' 2024-08-31T04:31:05.899 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21151 fp=#0x30000002c0e' 2024-08-31T04:31:05.900 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21311 fp=#0x10000003265' 2024-08-31T04:31:05.900 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21343 fp=#0x1000000321f' 2024-08-31T04:31:05.900 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21375 fp=#0x10000003327' 2024-08-31T04:31:05.901 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21407 fp=#0x1000000324d' 2024-08-31T04:31:05.901 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21439 fp=#0x100000032f8' 2024-08-31T04:31:05.901 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21471 fp=#0x30000002642' 2024-08-31T04:31:05.902 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21503 fp=#0x300000026e8' 2024-08-31T04:31:05.902 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21535 fp=#0x300000026ff' 2024-08-31T04:31:05.902 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21567 fp=#0x300000025f0' 2024-08-31T04:31:05.903 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21599 fp=#0x30000000cba' 2024-08-31T04:31:05.903 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21631 fp=#0x300000036df' 2024-08-31T04:31:05.903 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21663 fp=#0x30000000cd4' 2024-08-31T04:31:05.904 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21695 fp=#0x30000000cb8' 2024-08-31T04:31:05.904 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21727 fp=#0x300000036c2' 2024-08-31T04:31:05.904 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21759 fp=#0x30000000cf5' 2024-08-31T04:31:05.904 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21791 fp=#0x30000000aff' 2024-08-31T04:31:05.905 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21823 fp=#0x30000000b50' 2024-08-31T04:31:05.905 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21855 fp=#0x30000000ae9' 2024-08-31T04:31:05.905 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21887 fp=#0x3000000058c' 2024-08-31T04:31:05.906 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21919 fp=#0x3000000094c' 2024-08-31T04:31:05.906 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21951 fp=#0x3000000056b' 2024-08-31T04:31:05.906 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21983 fp=#0x3000000054f' 2024-08-31T04:31:05.906 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22014 fp=#0x30000002f82' 2024-08-31T04:31:05.907 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22046 fp=#0x3000000193e' 2024-08-31T04:31:05.907 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22078 fp=#0x30000001907' 2024-08-31T04:31:05.907 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22110 fp=#0x30000001924' 2024-08-31T04:31:05.908 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22142 fp=#0x300000028f0' 2024-08-31T04:31:05.908 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22174 fp=#0x300000028bf' 2024-08-31T04:31:05.908 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22206 fp=#0x30000002938' 2024-08-31T04:31:05.909 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22238 fp=#0x30000002988' 2024-08-31T04:31:05.909 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22270 fp=#0x30000002000' 2024-08-31T04:31:05.909 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22302 fp=#0x30000002054' 2024-08-31T04:31:05.910 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22334 fp=#0x3000000201b' 2024-08-31T04:31:05.910 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22366 fp=#0x30000002057' 2024-08-31T04:31:05.910 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22398 fp=#0x30000000410' 2024-08-31T04:31:05.911 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22462 fp=#0x30000000492' 2024-08-31T04:31:05.911 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22494 fp=#0x3000000046b' 2024-08-31T04:31:05.911 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22551 fp=#0x30000002c90' 2024-08-31T04:31:05.912 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22614 fp=#0x30000001472' 2024-08-31T04:31:05.912 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22646 fp=#0x300000025af' 2024-08-31T04:31:05.913 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22678 fp=#0x30000001481' 2024-08-31T04:31:05.913 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:9808 fp=#0x300000003d2' 2024-08-31T04:31:05.914 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:9904 fp=#0x300000034df' 2024-08-31T04:31:05.914 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:9936 fp=#0x30000001c55' 2024-08-31T04:31:05.920 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:10704 fp=#0x30000000a7e' 2024-08-31T04:31:05.920 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:10768 fp=#0x30000000a86' 2024-08-31T04:31:05.927 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:11760 fp=#0x30000000c31' 2024-08-31T04:31:05.928 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:11792 fp=#0x30000000bd4' 2024-08-31T04:31:05.928 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:11888 fp=#0x300000023b7' 2024-08-31T04:31:05.929 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:11920 fp=#0x30000002a42' 2024-08-31T04:31:05.929 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:11984 fp=#0x300000010a5' 2024-08-31T04:31:05.930 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12016 fp=#0x300000010fd' 2024-08-31T04:31:05.930 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12080 fp=#0x300000010eb' 2024-08-31T04:31:05.930 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12112 fp=#0x30000001112' 2024-08-31T04:31:05.931 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12144 fp=#0x3000000102e' 2024-08-31T04:31:05.932 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12272 fp=#0x300000009a9' 2024-08-31T04:31:05.932 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12336 fp=#0x3000000094f' 2024-08-31T04:31:05.933 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12400 fp=#0x30000000948' 2024-08-31T04:31:05.933 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12432 fp=#0x30000002e4c' 2024-08-31T04:31:05.933 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12464 fp=#0x30000002e3f' 2024-08-31T04:31:05.934 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12496 fp=#0x30000000f95' 2024-08-31T04:31:05.934 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12528 fp=#0x30000000f93' 2024-08-31T04:31:05.934 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12560 fp=#0x30000000f70' 2024-08-31T04:31:05.935 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12592 fp=#0x300000032b7' 2024-08-31T04:31:05.935 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12624 fp=#0x30000000e30' 2024-08-31T04:31:05.935 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12656 fp=#0x3000000337d' 2024-08-31T04:31:05.935 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12688 fp=#0x30000000e39' 2024-08-31T04:31:05.936 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12720 fp=#0x30000000e83' 2024-08-31T04:31:05.936 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12752 fp=#0x30000000e93' 2024-08-31T04:31:05.936 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12784 fp=#0x30000000e97' 2024-08-31T04:31:05.937 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12816 fp=#0x30000000e26' 2024-08-31T04:31:05.937 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12880 fp=#0x3000000283b' 2024-08-31T04:31:05.938 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12912 fp=#0x1000000422e' 2024-08-31T04:31:05.938 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12944 fp=#0x300000028a9' 2024-08-31T04:31:05.938 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12976 fp=#0x10000004200' 2024-08-31T04:31:05.938 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13008 fp=#0x10000004402' 2024-08-31T04:31:05.939 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13072 fp=#0x100000041f2' 2024-08-31T04:31:05.939 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13104 fp=#0x300000031ae' 2024-08-31T04:31:05.940 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13136 fp=#0x30000003117' 2024-08-31T04:31:05.940 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13168 fp=#0x300000030f0' 2024-08-31T04:31:05.941 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13296 fp=#0x300000008c6' 2024-08-31T04:31:05.941 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13328 fp=#0x3000000223a' 2024-08-31T04:31:05.942 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13360 fp=#0x30000002224' 2024-08-31T04:31:05.942 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13392 fp=#0x300000008b6' 2024-08-31T04:31:05.942 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13424 fp=#0x30000002288' 2024-08-31T04:31:05.942 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13456 fp=#0x30000000886' 2024-08-31T04:31:05.943 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13488 fp=#0x30000002236' 2024-08-31T04:31:05.943 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13520 fp=#0x30000002262' 2024-08-31T04:31:05.943 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13552 fp=#0x300000032a9' 2024-08-31T04:31:05.944 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13584 fp=#0x300000032fd' 2024-08-31T04:31:05.944 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13616 fp=#0x30000003287' 2024-08-31T04:31:05.944 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13648 fp=#0x30000003320' 2024-08-31T04:31:05.945 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13680 fp=#0x30000002a25' 2024-08-31T04:31:05.945 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13712 fp=#0x3000000296a' 2024-08-31T04:31:05.945 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13744 fp=#0x30000002987' 2024-08-31T04:31:05.946 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13776 fp=#0x300000028fc' 2024-08-31T04:31:05.946 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13808 fp=#0x30000002a2b' 2024-08-31T04:31:05.946 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13840 fp=#0x300000028e3' 2024-08-31T04:31:05.946 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13872 fp=#0x10000003e03' 2024-08-31T04:31:05.947 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13936 fp=#0x10000003be0' 2024-08-31T04:31:05.947 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13968 fp=#0x10000003d51' 2024-08-31T04:31:05.948 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14032 fp=#0x10000003d28' 2024-08-31T04:31:05.948 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14064 fp=#0x30000000c76' 2024-08-31T04:31:05.949 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14096 fp=#0x30000000c78' 2024-08-31T04:31:05.949 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14128 fp=#0x30000001771' 2024-08-31T04:31:05.949 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14160 fp=#0x300000017a5' 2024-08-31T04:31:05.949 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14192 fp=#0x30000002488' 2024-08-31T04:31:05.950 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14224 fp=#0x300000017ae' 2024-08-31T04:31:05.950 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14256 fp=#0x30000001f60' 2024-08-31T04:31:05.951 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14384 fp=#0x30000000d90' 2024-08-31T04:31:05.951 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14416 fp=#0x3000000239d' 2024-08-31T04:31:05.952 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14448 fp=#0x30000000c9f' 2024-08-31T04:31:05.952 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14480 fp=#0x30000000cb5' 2024-08-31T04:31:05.952 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14512 fp=#0x30000002387' 2024-08-31T04:31:05.952 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14544 fp=#0x30000000d61' 2024-08-31T04:31:05.953 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14576 fp=#0x30000000d10' 2024-08-31T04:31:05.953 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14608 fp=#0x10000002411' 2024-08-31T04:31:05.953 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14640 fp=#0x1000000248b' 2024-08-31T04:31:05.954 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14672 fp=#0x30000002fc6' 2024-08-31T04:31:05.954 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14704 fp=#0x10000002400' 2024-08-31T04:31:05.954 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14736 fp=#0x30000002fbd' 2024-08-31T04:31:05.955 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14768 fp=#0x10000002449' 2024-08-31T04:31:06.182 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14799 fp=#0x10000003c05' 2024-08-31T04:31:06.182 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14831 fp=#0x30000000916' 2024-08-31T04:31:06.183 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14863 fp=#0x30000000a0f' 2024-08-31T04:31:06.183 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14895 fp=#0x30000000974' 2024-08-31T04:31:06.183 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14927 fp=#0x30000000a2e' 2024-08-31T04:31:06.184 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14959 fp=#0x300000009c0' 2024-08-31T04:31:06.184 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14991 fp=#0x30000001548' 2024-08-31T04:31:06.184 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15023 fp=#0x30000001592' 2024-08-31T04:31:06.185 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15055 fp=#0x3000000158d' 2024-08-31T04:31:06.185 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15087 fp=#0x30000001695' 2024-08-31T04:31:06.185 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15119 fp=#0x30000003432' 2024-08-31T04:31:06.186 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15151 fp=#0x300000033bb' 2024-08-31T04:31:06.186 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15183 fp=#0x300000033aa' 2024-08-31T04:31:06.186 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15215 fp=#0x30000002f02' 2024-08-31T04:31:06.186 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15247 fp=#0x30000002ee9' 2024-08-31T04:31:06.187 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15279 fp=#0x30000002e8e' 2024-08-31T04:31:06.187 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15311 fp=#0x30000002e5f' 2024-08-31T04:31:06.187 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15343 fp=#0x30000002e66' 2024-08-31T04:31:06.188 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15375 fp=#0x300000032e2' 2024-08-31T04:31:06.188 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15407 fp=#0x300000032bc' 2024-08-31T04:31:06.188 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15439 fp=#0x30000000f33' 2024-08-31T04:31:06.189 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15471 fp=#0x30000000ec8' 2024-08-31T04:31:06.189 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15503 fp=#0x30000000f09' 2024-08-31T04:31:06.189 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15535 fp=#0x30000000eec' 2024-08-31T04:31:06.190 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15567 fp=#0x30000000ed5' 2024-08-31T04:31:06.190 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15599 fp=#0x300000005e8' 2024-08-31T04:31:06.190 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15631 fp=#0x300000005f7' 2024-08-31T04:31:06.191 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15727 fp=#0x300000004f4' 2024-08-31T04:31:06.191 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15759 fp=#0x300000005ea' 2024-08-31T04:31:06.192 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15854 fp=#0x30000001295' 2024-08-31T04:31:06.192 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15886 fp=#0x300000012ca' 2024-08-31T04:31:06.192 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15918 fp=#0x300000012da' 2024-08-31T04:31:06.193 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15950 fp=#0x300000012be' 2024-08-31T04:31:06.193 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15982 fp=#0x300000012ed' 2024-08-31T04:31:06.193 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16014 fp=#0x30000001033' 2024-08-31T04:31:06.194 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16046 fp=#0x300000023f6' 2024-08-31T04:31:06.194 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16078 fp=#0x30000002dee' 2024-08-31T04:31:06.194 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16110 fp=#0x3000000182f' 2024-08-31T04:31:06.195 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16174 fp=#0x300000034e5' 2024-08-31T04:31:06.195 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16206 fp=#0x300000034d8' 2024-08-31T04:31:06.196 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16331 fp=#0x10000002851' 2024-08-31T04:31:06.196 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16363 fp=#0x300000020c7' 2024-08-31T04:31:06.197 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16395 fp=#0x10000002848' 2024-08-31T04:31:06.197 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16427 fp=#0x100000024c0' 2024-08-31T04:31:06.198 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16491 fp=#0x10000002507' 2024-08-31T04:31:06.198 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16523 fp=#0x100000024c8' 2024-08-31T04:31:06.198 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16555 fp=#0x30000001d0b' 2024-08-31T04:31:06.198 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16587 fp=#0x30000001d2e' 2024-08-31T04:31:06.199 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16619 fp=#0x30000001d08' 2024-08-31T04:31:06.199 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16650 fp=#0x30000002342' 2024-08-31T04:31:06.199 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16682 fp=#0x30000002229' 2024-08-31T04:31:06.200 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16714 fp=#0x30000002312' 2024-08-31T04:31:06.200 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16746 fp=#0x300000026b8' 2024-08-31T04:31:06.200 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16778 fp=#0x30000001971' 2024-08-31T04:31:06.201 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16810 fp=#0x30000001980' 2024-08-31T04:31:06.201 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16874 fp=#0x30000001969' 2024-08-31T04:31:06.201 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16906 fp=#0x300000019d3' 2024-08-31T04:31:06.202 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16937 fp=#0x30000002b56' 2024-08-31T04:31:06.202 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16969 fp=#0x30000001af9' 2024-08-31T04:31:06.202 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17001 fp=#0x30000001af4' 2024-08-31T04:31:06.203 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17026 fp=#0x10000003627' 2024-08-31T04:31:06.203 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17058 fp=#0x10000003683' 2024-08-31T04:31:06.203 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17090 fp=#0x100000036aa' 2024-08-31T04:31:06.204 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17122 fp=#0x10000003618' 2024-08-31T04:31:06.204 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17154 fp=#0x30000002ccd' 2024-08-31T04:31:06.204 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17186 fp=#0x3000000174d' 2024-08-31T04:31:06.205 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17218 fp=#0x300000017de' 2024-08-31T04:31:06.205 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17250 fp=#0x30000002cd6' 2024-08-31T04:31:06.205 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17282 fp=#0x3000000171f' 2024-08-31T04:31:06.205 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17314 fp=#0x30000002cba' 2024-08-31T04:31:06.206 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17346 fp=#0x30000003334' 2024-08-31T04:31:06.206 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17378 fp=#0x30000003350' 2024-08-31T04:31:06.206 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17442 fp=#0x30000002fde' 2024-08-31T04:31:06.207 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17538 fp=#0x30000000e0c' 2024-08-31T04:31:06.207 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17570 fp=#0x300000031a6' 2024-08-31T04:31:06.208 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17602 fp=#0x30000000da5' 2024-08-31T04:31:06.208 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17634 fp=#0x30000000e08' 2024-08-31T04:31:06.208 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17666 fp=#0x3000000323e' 2024-08-31T04:31:06.209 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17794 fp=#0x3000000200a' 2024-08-31T04:31:06.210 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17826 fp=#0x30000001fbb' 2024-08-31T04:31:06.210 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17858 fp=#0x30000001f80' 2024-08-31T04:31:06.210 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17890 fp=#0x30000001f76' 2024-08-31T04:31:06.211 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17922 fp=#0x30000003174' 2024-08-31T04:31:06.211 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17954 fp=#0x300000030c8' 2024-08-31T04:31:06.211 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17986 fp=#0x300000030da' 2024-08-31T04:31:06.212 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18018 fp=#0x30000002e89' 2024-08-31T04:31:06.212 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18050 fp=#0x30000001bf0' 2024-08-31T04:31:06.212 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18082 fp=#0x30000001c29' 2024-08-31T04:31:06.212 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18114 fp=#0x3000000252f' 2024-08-31T04:31:06.213 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18146 fp=#0x30000002591' 2024-08-31T04:31:06.213 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18178 fp=#0x30000002554' 2024-08-31T04:31:06.213 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18210 fp=#0x30000002553' 2024-08-31T04:31:06.214 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18242 fp=#0x30000002882' 2024-08-31T04:31:06.214 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18274 fp=#0x30000002877' 2024-08-31T04:31:06.214 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18306 fp=#0x300000027b2' 2024-08-31T04:31:06.215 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18338 fp=#0x3000000280d' 2024-08-31T04:31:06.215 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18370 fp=#0x30000002847' 2024-08-31T04:31:06.215 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18402 fp=#0x30000003011' 2024-08-31T04:31:06.216 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18434 fp=#0x30000002ff1' 2024-08-31T04:31:06.216 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18466 fp=#0x30000003027' 2024-08-31T04:31:06.216 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18498 fp=#0x30000002f45' 2024-08-31T04:31:06.217 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18530 fp=#0x30000002ff7' 2024-08-31T04:31:06.217 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18594 fp=#0x10000001d17' 2024-08-31T04:31:06.218 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18722 fp=#0x300000013a3' 2024-08-31T04:31:06.219 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18754 fp=#0x300000014d3' 2024-08-31T04:31:06.219 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18786 fp=#0x300000013df' 2024-08-31T04:31:06.219 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18818 fp=#0x300000013a1' 2024-08-31T04:31:06.220 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18850 fp=#0x300000013e7' 2024-08-31T04:31:06.220 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18882 fp=#0x30000001d7f' 2024-08-31T04:31:06.220 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18914 fp=#0x300000010a0' 2024-08-31T04:31:06.221 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18946 fp=#0x30000001d70' 2024-08-31T04:31:06.221 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18978 fp=#0x300000021f2' 2024-08-31T04:31:06.221 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19010 fp=#0x30000001d7b' 2024-08-31T04:31:06.222 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19042 fp=#0x300000010ba' 2024-08-31T04:31:06.222 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19074 fp=#0x300000011aa' 2024-08-31T04:31:06.222 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19106 fp=#0x30000001125' 2024-08-31T04:31:06.223 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19138 fp=#0x30000001157' 2024-08-31T04:31:06.223 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19170 fp=#0x3000000166f' 2024-08-31T04:31:06.223 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19202 fp=#0x3000000163f' 2024-08-31T04:31:06.223 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19234 fp=#0x3000000160c' 2024-08-31T04:31:06.224 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19298 fp=#0x30000001506' 2024-08-31T04:31:06.224 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19330 fp=#0x30000002bbc' 2024-08-31T04:31:06.225 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19362 fp=#0x300000014ff' 2024-08-31T04:31:06.225 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19394 fp=#0x30000002bdc' 2024-08-31T04:31:06.225 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19457 fp=#0x30000000b99' 2024-08-31T04:31:06.226 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19489 fp=#0x30000000bf6' 2024-08-31T04:31:06.226 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19521 fp=#0x30000000b6e' 2024-08-31T04:31:06.226 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19553 fp=#0x30000000ba2' 2024-08-31T04:31:06.227 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19585 fp=#0x30000000b06' 2024-08-31T04:31:06.227 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19617 fp=#0x30000000b26' 2024-08-31T04:31:06.227 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19649 fp=#0x30000002ce1' 2024-08-31T04:31:06.227 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19681 fp=#0x30000002c4d' 2024-08-31T04:31:06.228 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19713 fp=#0x30000002d81' 2024-08-31T04:31:06.228 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19745 fp=#0x30000002d8e' 2024-08-31T04:31:06.228 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19777 fp=#0x30000002bf5' 2024-08-31T04:31:06.229 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19809 fp=#0x30000002c59' 2024-08-31T04:31:06.229 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19841 fp=#0x30000001206' 2024-08-31T04:31:06.229 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19873 fp=#0x3000000117a' 2024-08-31T04:31:06.230 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19905 fp=#0x3000000112d' 2024-08-31T04:31:06.230 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19937 fp=#0x3000000144d' 2024-08-31T04:31:06.230 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19969 fp=#0x3000000142d' 2024-08-31T04:31:06.231 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20001 fp=#0x300000013f8' 2024-08-31T04:31:06.231 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20033 fp=#0x30000001c5b' 2024-08-31T04:31:06.231 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20065 fp=#0x30000000fbe' 2024-08-31T04:31:06.231 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20097 fp=#0x30000000fd8' 2024-08-31T04:31:06.232 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20129 fp=#0x30000001a72' 2024-08-31T04:31:06.232 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20161 fp=#0x300000016fe' 2024-08-31T04:31:06.232 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20193 fp=#0x3000000171e' 2024-08-31T04:31:06.233 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20225 fp=#0x30000003250' 2024-08-31T04:31:06.233 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20257 fp=#0x30000003069' 2024-08-31T04:31:06.233 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20289 fp=#0x30000003061' 2024-08-31T04:31:06.234 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20321 fp=#0x300000030f6' 2024-08-31T04:31:06.234 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20353 fp=#0x3000000323d' 2024-08-31T04:31:06.234 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20385 fp=#0x30000001c69' 2024-08-31T04:31:06.235 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20417 fp=#0x30000001cc1' 2024-08-31T04:31:06.235 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20449 fp=#0x30000001c67' 2024-08-31T04:31:06.235 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20481 fp=#0x30000001cc2' 2024-08-31T04:31:06.235 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20513 fp=#0x30000001273' 2024-08-31T04:31:06.236 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20545 fp=#0x30000001210' 2024-08-31T04:31:06.236 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20577 fp=#0x30000001225' 2024-08-31T04:31:06.238 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20833 fp=#0x300000030a1' 2024-08-31T04:31:06.238 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20865 fp=#0x10000003755' 2024-08-31T04:31:06.239 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20897 fp=#0x10000003720' 2024-08-31T04:31:06.239 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20929 fp=#0x30000003044' 2024-08-31T04:31:06.239 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20961 fp=#0x300000020dc' 2024-08-31T04:31:06.239 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20993 fp=#0x300000025b0' 2024-08-31T04:31:06.240 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21024 fp=#0x300000015de' 2024-08-31T04:31:06.240 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21056 fp=#0x30000001654' 2024-08-31T04:31:06.240 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21088 fp=#0x300000015e6' 2024-08-31T04:31:06.241 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21120 fp=#0x30000001578' 2024-08-31T04:31:06.241 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21152 fp=#0x30000002bce' 2024-08-31T04:31:06.242 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21216 fp=#0x30000002c3b' 2024-08-31T04:31:06.242 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21312 fp=#0x10000003253' 2024-08-31T04:31:06.243 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21344 fp=#0x10000003339' 2024-08-31T04:31:06.243 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21376 fp=#0x10000003384' 2024-08-31T04:31:06.243 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21408 fp=#0x100000032c0' 2024-08-31T04:31:06.243 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21440 fp=#0x10000003223' 2024-08-31T04:31:06.244 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21472 fp=#0x3000000267e' 2024-08-31T04:31:06.244 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21504 fp=#0x30000002721' 2024-08-31T04:31:06.245 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21536 fp=#0x30000002707' 2024-08-31T04:31:06.245 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21568 fp=#0x3000000270e' 2024-08-31T04:31:06.245 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21600 fp=#0x30000000c8a' 2024-08-31T04:31:06.246 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21632 fp=#0x300000036dc' 2024-08-31T04:31:06.246 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21664 fp=#0x30000003707' 2024-08-31T04:31:06.246 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21696 fp=#0x30000000c94' 2024-08-31T04:31:06.247 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21728 fp=#0x300000036ad' 2024-08-31T04:31:06.247 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21760 fp=#0x30000003692' 2024-08-31T04:31:06.247 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21792 fp=#0x30000000a97' 2024-08-31T04:31:06.247 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21824 fp=#0x30000000b48' 2024-08-31T04:31:06.248 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21856 fp=#0x30000000a95' 2024-08-31T04:31:06.248 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21888 fp=#0x30000000541' 2024-08-31T04:31:06.248 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21920 fp=#0x30000002c05' 2024-08-31T04:31:06.249 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21952 fp=#0x3000000051c' 2024-08-31T04:31:06.249 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21984 fp=#0x30000000938' 2024-08-31T04:31:06.249 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22015 fp=#0x30000001933' 2024-08-31T04:31:06.250 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22047 fp=#0x3000000192c' 2024-08-31T04:31:06.250 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22079 fp=#0x3000000191e' 2024-08-31T04:31:06.250 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22111 fp=#0x30000001911' 2024-08-31T04:31:06.250 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22143 fp=#0x30000002919' 2024-08-31T04:31:06.251 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22175 fp=#0x3000000291b' 2024-08-31T04:31:06.251 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22207 fp=#0x3000000291d' 2024-08-31T04:31:06.251 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22239 fp=#0x300000028b2' 2024-08-31T04:31:06.252 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22271 fp=#0x30000002097' 2024-08-31T04:31:06.252 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22303 fp=#0x30000002072' 2024-08-31T04:31:06.252 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22335 fp=#0x30000002007' 2024-08-31T04:31:06.253 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22367 fp=#0x3000000208b' 2024-08-31T04:31:06.253 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22399 fp=#0x300000004ab' 2024-08-31T04:31:06.253 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22431 fp=#0x30000000411' 2024-08-31T04:31:06.254 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22495 fp=#0x30000000429' 2024-08-31T04:31:06.254 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22552 fp=#0x30000002be4' 2024-08-31T04:31:06.255 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22615 fp=#0x3000000146d' 2024-08-31T04:31:06.255 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22647 fp=#0x30000001494' 2024-08-31T04:31:06.256 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:9809 fp=#0x30000000c8e' 2024-08-31T04:31:06.257 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:9937 fp=#0x3000000120f' 2024-08-31T04:31:06.270 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:11761 fp=#0x300000023b4' 2024-08-31T04:31:06.270 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:11825 fp=#0x300000023ca' 2024-08-31T04:31:06.271 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:11921 fp=#0x3000000112c' 2024-08-31T04:31:06.272 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:11985 fp=#0x300000031ea' 2024-08-31T04:31:06.272 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12017 fp=#0x300000031f8' 2024-08-31T04:31:06.272 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12049 fp=#0x30000001026' 2024-08-31T04:31:06.273 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12081 fp=#0x30000001106' 2024-08-31T04:31:06.273 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12113 fp=#0x300000010c5' 2024-08-31T04:31:06.274 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12241 fp=#0x300000009e2' 2024-08-31T04:31:06.274 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12273 fp=#0x30000000919' 2024-08-31T04:31:06.275 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12401 fp=#0x30000000997' 2024-08-31T04:31:06.276 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12497 fp=#0x30000000f5c' 2024-08-31T04:31:06.276 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12529 fp=#0x30000000f8b' 2024-08-31T04:31:06.277 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12561 fp=#0x30000000f40' 2024-08-31T04:31:06.277 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12593 fp=#0x30000000e36' 2024-08-31T04:31:06.277 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12625 fp=#0x30000002278' 2024-08-31T04:31:06.278 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12657 fp=#0x30000000e66' 2024-08-31T04:31:06.278 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12689 fp=#0x30000000e3e' 2024-08-31T04:31:06.278 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12721 fp=#0x30000000e9a' 2024-08-31T04:31:06.279 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12753 fp=#0x30000000e69' 2024-08-31T04:31:06.279 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12785 fp=#0x30000000e60' 2024-08-31T04:31:06.279 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12817 fp=#0x300000033bc' 2024-08-31T04:31:06.280 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12849 fp=#0x100000041d2' 2024-08-31T04:31:06.280 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12881 fp=#0x100000041f1' 2024-08-31T04:31:06.280 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12913 fp=#0x30000002804' 2024-08-31T04:31:06.281 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12945 fp=#0x100000041d9' 2024-08-31T04:31:06.281 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12977 fp=#0x10000004360' 2024-08-31T04:31:06.281 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13009 fp=#0x10000004380' 2024-08-31T04:31:06.281 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13041 fp=#0x3000000283f' 2024-08-31T04:31:06.282 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13073 fp=#0x100000043ff' 2024-08-31T04:31:06.282 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13105 fp=#0x300000031e3' 2024-08-31T04:31:06.282 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13137 fp=#0x300000030c0' 2024-08-31T04:31:06.283 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13169 fp=#0x30000003101' 2024-08-31T04:31:06.284 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13297 fp=#0x30000000a57' 2024-08-31T04:31:06.284 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13329 fp=#0x300000008a3' 2024-08-31T04:31:06.284 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13361 fp=#0x30000000965' 2024-08-31T04:31:06.285 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13393 fp=#0x300000008c0' 2024-08-31T04:31:06.285 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13425 fp=#0x30000000924' 2024-08-31T04:31:06.285 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13457 fp=#0x300000008fa' 2024-08-31T04:31:06.285 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13489 fp=#0x300000008eb' 2024-08-31T04:31:06.286 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13521 fp=#0x30000000896' 2024-08-31T04:31:06.286 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13553 fp=#0x300000032ee' 2024-08-31T04:31:06.286 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13585 fp=#0x300000032ae' 2024-08-31T04:31:06.287 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13617 fp=#0x30000003310' 2024-08-31T04:31:06.287 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13649 fp=#0x30000003284' 2024-08-31T04:31:06.287 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13681 fp=#0x30000002982' 2024-08-31T04:31:06.288 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13713 fp=#0x30000002a11' 2024-08-31T04:31:06.288 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13745 fp=#0x30000002974' 2024-08-31T04:31:06.288 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13777 fp=#0x300000029b6' 2024-08-31T04:31:06.289 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13809 fp=#0x300000029ee' 2024-08-31T04:31:06.289 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13841 fp=#0x30000002922' 2024-08-31T04:31:06.289 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13905 fp=#0x30000001d82' 2024-08-31T04:31:06.290 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13969 fp=#0x10000003c0c' 2024-08-31T04:31:06.290 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14001 fp=#0x10000003bca' 2024-08-31T04:31:06.291 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14033 fp=#0x10000003c4e' 2024-08-31T04:31:06.291 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14065 fp=#0x30000000c47' 2024-08-31T04:31:06.291 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14097 fp=#0x30000000c4e' 2024-08-31T04:31:06.292 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14129 fp=#0x30000001790' 2024-08-31T04:31:06.292 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14161 fp=#0x3000000179c' 2024-08-31T04:31:06.292 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14193 fp=#0x300000017c4' 2024-08-31T04:31:06.292 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14225 fp=#0x3000000243e' 2024-08-31T04:31:06.294 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14385 fp=#0x30000000c93' 2024-08-31T04:31:06.294 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14417 fp=#0x30000000d16' 2024-08-31T04:31:06.294 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14449 fp=#0x30000000d6b' 2024-08-31T04:31:06.294 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14481 fp=#0x30000000d59' 2024-08-31T04:31:06.295 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14513 fp=#0x30000000d32' 2024-08-31T04:31:06.295 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14545 fp=#0x30000000cdc' 2024-08-31T04:31:06.295 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14577 fp=#0x30000000d68' 2024-08-31T04:31:06.296 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14609 fp=#0x10000002469' 2024-08-31T04:31:06.296 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14641 fp=#0x10000002483' 2024-08-31T04:31:06.296 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14673 fp=#0x30000002fda' 2024-08-31T04:31:06.297 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14705 fp=#0x10000002405' 2024-08-31T04:31:06.297 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14737 fp=#0x1000000240e' 2024-08-31T04:31:06.297 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14769 fp=#0x30000002a39' 2024-08-31T04:31:06.298 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14800 fp=#0x10000003c01' 2024-08-31T04:31:06.298 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14832 fp=#0x30000000a31' 2024-08-31T04:31:06.298 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14864 fp=#0x300000009ec' 2024-08-31T04:31:06.299 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14896 fp=#0x3000000092d' 2024-08-31T04:31:06.299 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14928 fp=#0x300000009ee' 2024-08-31T04:31:06.299 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14960 fp=#0x30000000a0d' 2024-08-31T04:31:06.299 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14992 fp=#0x300000016a4' 2024-08-31T04:31:06.300 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15024 fp=#0x3000000150f' 2024-08-31T04:31:06.300 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15056 fp=#0x30000001627' 2024-08-31T04:31:06.300 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15088 fp=#0x30000001524' 2024-08-31T04:31:06.301 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15120 fp=#0x300000033d6' 2024-08-31T04:31:06.301 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15152 fp=#0x300000033e3' 2024-08-31T04:31:06.301 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15184 fp=#0x30000003404' 2024-08-31T04:31:06.302 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15216 fp=#0x30000002eb3' 2024-08-31T04:31:06.302 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15248 fp=#0x30000002e6f' 2024-08-31T04:31:06.302 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15280 fp=#0x30000002e72' 2024-08-31T04:31:06.303 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15312 fp=#0x30000002efa' 2024-08-31T04:31:06.303 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15344 fp=#0x30000002e5b' 2024-08-31T04:31:06.303 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15376 fp=#0x300000032f0' 2024-08-31T04:31:06.303 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15408 fp=#0x300000032d8' 2024-08-31T04:31:06.304 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15440 fp=#0x30000000f3c' 2024-08-31T04:31:06.304 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15472 fp=#0x30000000ed3' 2024-08-31T04:31:06.304 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15504 fp=#0x30000001da5' 2024-08-31T04:31:06.305 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15536 fp=#0x30000000f27' 2024-08-31T04:31:06.305 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15568 fp=#0x30000000f29' 2024-08-31T04:31:06.306 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15664 fp=#0x300000005cb' 2024-08-31T04:31:06.306 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15760 fp=#0x300000005b0' 2024-08-31T04:31:06.307 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15792 fp=#0x300000004dd' 2024-08-31T04:31:06.307 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15823 fp=#0x3000000129b' 2024-08-31T04:31:06.307 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15855 fp=#0x30000001298' 2024-08-31T04:31:06.308 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15887 fp=#0x300000012a5' 2024-08-31T04:31:06.308 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15919 fp=#0x300000012ba' 2024-08-31T04:31:06.308 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15951 fp=#0x300000012d9' 2024-08-31T04:31:06.309 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15983 fp=#0x300000012df' 2024-08-31T04:31:06.309 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16015 fp=#0x30000001039' 2024-08-31T04:31:06.309 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16047 fp=#0x3000000104f' 2024-08-31T04:31:06.309 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16079 fp=#0x30000002ded' 2024-08-31T04:31:06.310 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16111 fp=#0x30000001835' 2024-08-31T04:31:06.310 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16143 fp=#0x300000005da' 2024-08-31T04:31:06.310 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16175 fp=#0x300000034e1' 2024-08-31T04:31:06.311 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16239 fp=#0x3000000062e' 2024-08-31T04:31:06.312 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16332 fp=#0x10000002829' 2024-08-31T04:31:06.312 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16364 fp=#0x10000002824' 2024-08-31T04:31:06.312 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16396 fp=#0x1000000282f' 2024-08-31T04:31:06.313 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16428 fp=#0x10000002539' 2024-08-31T04:31:06.313 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16460 fp=#0x100000024d9' 2024-08-31T04:31:06.313 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16492 fp=#0x100000024f5' 2024-08-31T04:31:06.314 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16524 fp=#0x30000001d20' 2024-08-31T04:31:06.314 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16556 fp=#0x300000002a1' 2024-08-31T04:31:06.314 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16588 fp=#0x30000001d25' 2024-08-31T04:31:06.315 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16620 fp=#0x10000002503' 2024-08-31T04:31:06.315 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16683 fp=#0x3000000211b' 2024-08-31T04:31:06.315 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16715 fp=#0x30000002131' 2024-08-31T04:31:06.316 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16747 fp=#0x3000000261b' 2024-08-31T04:31:06.316 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16779 fp=#0x30000001a25' 2024-08-31T04:31:06.316 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16811 fp=#0x30000001a20' 2024-08-31T04:31:06.317 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16843 fp=#0x30000001a34' 2024-08-31T04:31:06.317 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16875 fp=#0x30000001a29' 2024-08-31T04:31:06.317 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16907 fp=#0x30000001982' 2024-08-31T04:31:06.317 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16938 fp=#0x30000002b7c' 2024-08-31T04:31:06.318 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16970 fp=#0x30000001ad0' 2024-08-31T04:31:06.318 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17002 fp=#0x30000002b4e' 2024-08-31T04:31:06.318 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17027 fp=#0x10000003663' 2024-08-31T04:31:06.319 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17059 fp=#0x100000036b0' 2024-08-31T04:31:06.319 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17091 fp=#0x1000000363c' 2024-08-31T04:31:06.319 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17123 fp=#0x100000036f8' 2024-08-31T04:31:06.320 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17155 fp=#0x30000002cb3' 2024-08-31T04:31:06.320 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17187 fp=#0x300000017ff' 2024-08-31T04:31:06.320 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17219 fp=#0x30000001749' 2024-08-31T04:31:06.321 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17251 fp=#0x30000001801' 2024-08-31T04:31:06.321 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17283 fp=#0x30000002cfb' 2024-08-31T04:31:06.321 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17315 fp=#0x3000000173b' 2024-08-31T04:31:06.322 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17347 fp=#0x30000003308' 2024-08-31T04:31:06.322 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17379 fp=#0x30000003332' 2024-08-31T04:31:06.323 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17539 fp=#0x3000000322b' 2024-08-31T04:31:06.323 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17571 fp=#0x30000000dbb' 2024-08-31T04:31:06.324 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17603 fp=#0x30000000db7' 2024-08-31T04:31:06.324 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17635 fp=#0x30000000dc5' 2024-08-31T04:31:06.324 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17667 fp=#0x30000003215' 2024-08-31T04:31:06.325 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17763 fp=#0x3000000084c' 2024-08-31T04:31:06.325 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17795 fp=#0x30000002056' 2024-08-31T04:31:06.326 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17827 fp=#0x30000002018' 2024-08-31T04:31:06.326 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17859 fp=#0x30000002825' 2024-08-31T04:31:06.326 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17891 fp=#0x30000002019' 2024-08-31T04:31:06.327 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17923 fp=#0x30000003088' 2024-08-31T04:31:06.327 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17955 fp=#0x300000030dc' 2024-08-31T04:31:06.327 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17987 fp=#0x300000030c7' 2024-08-31T04:31:06.328 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18019 fp=#0x30000001be4' 2024-08-31T04:31:06.328 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18051 fp=#0x30000001c09' 2024-08-31T04:31:06.328 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18083 fp=#0x30000001c16' 2024-08-31T04:31:06.328 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18115 fp=#0x30000002562' 2024-08-31T04:31:06.329 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18147 fp=#0x300000036d6' 2024-08-31T04:31:06.329 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18179 fp=#0x30000002521' 2024-08-31T04:31:06.329 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18211 fp=#0x3000000251b' 2024-08-31T04:31:06.330 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18243 fp=#0x30000002871' 2024-08-31T04:31:06.330 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18275 fp=#0x30000002805' 2024-08-31T04:31:06.330 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18307 fp=#0x300000027c7' 2024-08-31T04:31:06.331 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18339 fp=#0x30000002827' 2024-08-31T04:31:06.331 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18371 fp=#0x30000002812' 2024-08-31T04:31:06.331 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18403 fp=#0x30000002fef' 2024-08-31T04:31:06.331 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18435 fp=#0x30000002f3b' 2024-08-31T04:31:06.332 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18467 fp=#0x30000002f34' 2024-08-31T04:31:06.332 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18499 fp=#0x30000002ffb' 2024-08-31T04:31:06.332 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18531 fp=#0x30000003000' 2024-08-31T04:31:06.333 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18563 fp=#0x10000001d0b' 2024-08-31T04:31:06.333 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18595 fp=#0x10000001d58' 2024-08-31T04:31:06.334 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18627 fp=#0x10000001d1a' 2024-08-31T04:31:06.334 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18659 fp=#0x10000001cf9' 2024-08-31T04:31:06.334 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18691 fp=#0x30000001367' 2024-08-31T04:31:06.334 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18723 fp=#0x300000013ba' 2024-08-31T04:31:06.335 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18755 fp=#0x3000000138c' 2024-08-31T04:31:06.335 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18787 fp=#0x3000000151d' 2024-08-31T04:31:06.335 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18819 fp=#0x300000013ac' 2024-08-31T04:31:06.336 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18851 fp=#0x3000000135d' 2024-08-31T04:31:06.336 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18883 fp=#0x30000001047' 2024-08-31T04:31:06.336 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18915 fp=#0x3000000107c' 2024-08-31T04:31:06.337 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18947 fp=#0x30000001107' 2024-08-31T04:31:06.337 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18979 fp=#0x300000010ec' 2024-08-31T04:31:06.337 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19011 fp=#0x30000001d75' 2024-08-31T04:31:06.338 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19043 fp=#0x30000001d69' 2024-08-31T04:31:06.338 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19075 fp=#0x300000011ce' 2024-08-31T04:31:06.338 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19107 fp=#0x3000000112a' 2024-08-31T04:31:06.338 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19139 fp=#0x30000001120' 2024-08-31T04:31:06.339 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19171 fp=#0x30000001625' 2024-08-31T04:31:06.339 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19203 fp=#0x30000001686' 2024-08-31T04:31:06.339 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19235 fp=#0x3000000164f' 2024-08-31T04:31:06.340 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19267 fp=#0x30000001653' 2024-08-31T04:31:06.340 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19299 fp=#0x100000008b8' 2024-08-31T04:31:06.340 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19331 fp=#0x300000014ca' 2024-08-31T04:31:06.341 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19363 fp=#0x100000008b3' 2024-08-31T04:31:06.341 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19395 fp=#0x100000008a8' 2024-08-31T04:31:06.341 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19426 fp=#0x30000000bdd' 2024-08-31T04:31:06.342 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19458 fp=#0x30000000b80' 2024-08-31T04:31:06.342 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19490 fp=#0x30000000b9b' 2024-08-31T04:31:06.342 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19522 fp=#0x30000000b8a' 2024-08-31T04:31:06.343 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19554 fp=#0x30000000b2b' 2024-08-31T04:31:06.343 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19586 fp=#0x30000000ae2' 2024-08-31T04:31:06.343 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19618 fp=#0x30000000ad3' 2024-08-31T04:31:06.344 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19650 fp=#0x30000002d96' 2024-08-31T04:31:06.344 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19682 fp=#0x30000002d6d' 2024-08-31T04:31:06.344 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19714 fp=#0x30000002c66' 2024-08-31T04:31:06.345 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19746 fp=#0x30000002cfa' 2024-08-31T04:31:06.345 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19778 fp=#0x30000002c87' 2024-08-31T04:31:06.345 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19810 fp=#0x30000002d57' 2024-08-31T04:31:06.346 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19842 fp=#0x3000000113c' 2024-08-31T04:31:06.346 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19874 fp=#0x30000001197' 2024-08-31T04:31:06.346 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19906 fp=#0x300000011d1' 2024-08-31T04:31:06.347 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19938 fp=#0x30000001468' 2024-08-31T04:31:06.347 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19970 fp=#0x30000001424' 2024-08-31T04:31:06.347 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20002 fp=#0x30000001428' 2024-08-31T04:31:06.347 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20034 fp=#0x30000000fcc' 2024-08-31T04:31:06.348 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20066 fp=#0x30000000fd3' 2024-08-31T04:31:06.348 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20098 fp=#0x30000000fed' 2024-08-31T04:31:06.348 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20130 fp=#0x300000016de' 2024-08-31T04:31:06.349 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20162 fp=#0x30000001731' 2024-08-31T04:31:06.349 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20194 fp=#0x300000016ef' 2024-08-31T04:31:06.350 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20226 fp=#0x3000000305e' 2024-08-31T04:31:06.350 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20258 fp=#0x30000003065' 2024-08-31T04:31:06.350 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20290 fp=#0x30000003209' 2024-08-31T04:31:06.350 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20322 fp=#0x30000003060' 2024-08-31T04:31:06.351 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20354 fp=#0x30000003064' 2024-08-31T04:31:06.351 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20386 fp=#0x30000001cea' 2024-08-31T04:31:06.351 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20418 fp=#0x30000001cac' 2024-08-31T04:31:06.352 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20450 fp=#0x30000001c9c' 2024-08-31T04:31:06.352 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20482 fp=#0x30000001c75' 2024-08-31T04:31:06.352 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20514 fp=#0x30000001227' 2024-08-31T04:31:06.353 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20546 fp=#0x30000001214' 2024-08-31T04:31:06.353 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20578 fp=#0x3000000121a' 2024-08-31T04:31:06.354 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20770 fp=#0x10000003864' 2024-08-31T04:31:06.355 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20834 fp=#0x300000030f9' 2024-08-31T04:31:06.355 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20866 fp=#0x30000003074' 2024-08-31T04:31:06.355 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20898 fp=#0x10000003849' 2024-08-31T04:31:06.356 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20930 fp=#0x3000000304d' 2024-08-31T04:31:06.356 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20962 fp=#0x300000020b3' 2024-08-31T04:31:06.356 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20994 fp=#0x300000020a8' 2024-08-31T04:31:06.357 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21025 fp=#0x30000001626' 2024-08-31T04:31:06.357 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21057 fp=#0x30000001591' 2024-08-31T04:31:06.357 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21089 fp=#0x30000001645' 2024-08-31T04:31:06.358 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21121 fp=#0x3000000160a' 2024-08-31T04:31:06.359 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21313 fp=#0x1000000321c' 2024-08-31T04:31:06.359 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21345 fp=#0x1000000320b' 2024-08-31T04:31:06.360 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21377 fp=#0x100000032e4' 2024-08-31T04:31:06.360 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21409 fp=#0x1000000328b' 2024-08-31T04:31:06.360 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21441 fp=#0x10000003379' 2024-08-31T04:31:06.360 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21473 fp=#0x300000025ec' 2024-08-31T04:31:06.361 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21505 fp=#0x30000002675' 2024-08-31T04:31:06.361 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21537 fp=#0x300000026db' 2024-08-31T04:31:06.361 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21569 fp=#0x300000025fa' 2024-08-31T04:31:06.362 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21601 fp=#0x30000000d42' 2024-08-31T04:31:06.362 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21633 fp=#0x30000000d23' 2024-08-31T04:31:06.362 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21665 fp=#0x300000036f3' 2024-08-31T04:31:06.363 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21697 fp=#0x30000000cfb' 2024-08-31T04:31:06.363 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21729 fp=#0x30000000d0d' 2024-08-31T04:31:06.363 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21761 fp=#0x30000000abd' 2024-08-31T04:31:06.364 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21793 fp=#0x30000000a91' 2024-08-31T04:31:06.364 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21825 fp=#0x30000000b25' 2024-08-31T04:31:06.364 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21857 fp=#0x30000000adf' 2024-08-31T04:31:06.365 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21889 fp=#0x3000000050d' 2024-08-31T04:31:06.365 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21921 fp=#0x300000008e1' 2024-08-31T04:31:06.366 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22016 fp=#0x30000001942' 2024-08-31T04:31:06.366 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22048 fp=#0x30000002f83' 2024-08-31T04:31:06.366 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22080 fp=#0x30000002f7f' 2024-08-31T04:31:06.367 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22112 fp=#0x30000001903' 2024-08-31T04:31:06.367 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22144 fp=#0x300000029ac' 2024-08-31T04:31:06.367 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22176 fp=#0x300000029ae' 2024-08-31T04:31:06.368 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22208 fp=#0x30000002904' 2024-08-31T04:31:06.368 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22240 fp=#0x300000028ba' 2024-08-31T04:31:06.368 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22272 fp=#0x3000000203d' 2024-08-31T04:31:06.369 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22304 fp=#0x30000001fe7' 2024-08-31T04:31:06.369 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22336 fp=#0x3000000208e' 2024-08-31T04:31:06.369 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22368 fp=#0x3000000200d' 2024-08-31T04:31:06.369 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22400 fp=#0x30000000424' 2024-08-31T04:31:06.370 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22432 fp=#0x3000000041b' 2024-08-31T04:31:06.370 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22464 fp=#0x3000000042e' 2024-08-31T04:31:06.371 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22496 fp=#0x30000000495' 2024-08-31T04:31:06.371 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22521 fp=#0x30000002c7d' 2024-08-31T04:31:06.371 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22553 fp=#0x30000002c95' 2024-08-31T04:31:06.371 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22584 fp=#0x3000000147f' 2024-08-31T04:31:06.372 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22616 fp=#0x30000001493' 2024-08-31T04:31:06.372 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22648 fp=#0x3000000149b' 2024-08-31T04:31:06.372 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22680 fp=#0x300000033b2' 2024-08-31T04:31:06.374 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:9906 fp=#0x30000003086' 2024-08-31T04:31:06.374 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:9938 fp=#0x10000004166' 2024-08-31T04:31:06.378 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:10482 fp=#0x30000002e58' 2024-08-31T04:31:06.380 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:10674 fp=#0x30000000a83' 2024-08-31T04:31:06.383 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:10802 fp=#0x30000000a69' 2024-08-31T04:31:06.391 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:11826 fp=#0x300000023c2' 2024-08-31T04:31:06.392 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:11922 fp=#0x3000000120d' 2024-08-31T04:31:06.392 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:11954 fp=#0x3000000114f' 2024-08-31T04:31:06.393 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:11986 fp=#0x30000003207' 2024-08-31T04:31:06.393 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12018 fp=#0x30000001060' 2024-08-31T04:31:06.393 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12050 fp=#0x3000000102c' 2024-08-31T04:31:06.394 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12082 fp=#0x300000010d7' 2024-08-31T04:31:06.394 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12114 fp=#0x3000000117e' 2024-08-31T04:31:06.395 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12242 fp=#0x300000009fa' 2024-08-31T04:31:06.396 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12370 fp=#0x30000000990' 2024-08-31T04:31:06.397 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12434 fp=#0x30000002e07' 2024-08-31T04:31:06.397 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12466 fp=#0x30000002e0d' 2024-08-31T04:31:06.397 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12498 fp=#0x30000000f90' 2024-08-31T04:31:06.398 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12530 fp=#0x30000000f60' 2024-08-31T04:31:06.398 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12562 fp=#0x30000000f7b' 2024-08-31T04:31:06.398 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12594 fp=#0x30000000e4a' 2024-08-31T04:31:06.399 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12626 fp=#0x30000000e9d' 2024-08-31T04:31:06.399 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12658 fp=#0x30000003359' 2024-08-31T04:31:06.399 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12690 fp=#0x30000003376' 2024-08-31T04:31:06.400 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12722 fp=#0x3000000335f' 2024-08-31T04:31:06.400 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12754 fp=#0x30000000fe2' 2024-08-31T04:31:06.400 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12786 fp=#0x30000000fcb' 2024-08-31T04:31:06.401 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12818 fp=#0x30000000e78' 2024-08-31T04:31:06.401 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12850 fp=#0x100000041fe' 2024-08-31T04:31:06.401 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12882 fp=#0x30000002802' 2024-08-31T04:31:06.402 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12914 fp=#0x30000002848' 2024-08-31T04:31:06.402 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12946 fp=#0x3000000287f' 2024-08-31T04:31:06.402 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12978 fp=#0x100000043b6' 2024-08-31T04:31:06.403 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13010 fp=#0x100000043a2' 2024-08-31T04:31:06.403 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13042 fp=#0x100000043c3' 2024-08-31T04:31:06.403 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13074 fp=#0x100000041de' 2024-08-31T04:31:06.404 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13106 fp=#0x30000003147' 2024-08-31T04:31:06.404 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13138 fp=#0x300000031dc' 2024-08-31T04:31:06.404 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13170 fp=#0x30000003163' 2024-08-31T04:31:06.405 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13298 fp=#0x300000009b2' 2024-08-31T04:31:06.406 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13330 fp=#0x30000002240' 2024-08-31T04:31:06.406 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13362 fp=#0x30000000895' 2024-08-31T04:31:06.406 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13394 fp=#0x300000021fe' 2024-08-31T04:31:06.407 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13426 fp=#0x30000002207' 2024-08-31T04:31:06.407 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13458 fp=#0x300000008b2' 2024-08-31T04:31:06.407 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13490 fp=#0x30000002215' 2024-08-31T04:31:06.408 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13522 fp=#0x300000008bc' 2024-08-31T04:31:06.408 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13554 fp=#0x30000003297' 2024-08-31T04:31:06.408 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13586 fp=#0x30000003289' 2024-08-31T04:31:06.409 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13618 fp=#0x3000000331d' 2024-08-31T04:31:06.409 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13650 fp=#0x30000003282' 2024-08-31T04:31:06.409 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13682 fp=#0x300000028d0' 2024-08-31T04:31:06.410 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13714 fp=#0x30000002a04' 2024-08-31T04:31:06.410 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13746 fp=#0x30000002978' 2024-08-31T04:31:06.410 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13778 fp=#0x300000029f6' 2024-08-31T04:31:06.411 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13810 fp=#0x30000002911' 2024-08-31T04:31:06.411 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13842 fp=#0x30000002928' 2024-08-31T04:31:06.411 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13874 fp=#0x10000003c12' 2024-08-31T04:31:06.412 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13906 fp=#0x10000003d4b' 2024-08-31T04:31:06.412 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13938 fp=#0x10000003df5' 2024-08-31T04:31:06.412 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13970 fp=#0x10000003eaa' 2024-08-31T04:31:06.412 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14002 fp=#0x10000003ec6' 2024-08-31T04:31:06.413 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14034 fp=#0x10000003ecb' 2024-08-31T04:31:06.413 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14066 fp=#0x30000000c6f' 2024-08-31T04:31:06.413 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14098 fp=#0x30000000c57' 2024-08-31T04:31:06.414 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14130 fp=#0x3000000178c' 2024-08-31T04:31:06.414 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14162 fp=#0x30000002443' 2024-08-31T04:31:06.414 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14194 fp=#0x30000001798' 2024-08-31T04:31:06.415 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14226 fp=#0x30000002446' 2024-08-31T04:31:06.416 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14386 fp=#0x30000000d6f' 2024-08-31T04:31:06.416 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14418 fp=#0x30000000d38' 2024-08-31T04:31:06.416 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14450 fp=#0x30000000c8f' 2024-08-31T04:31:06.417 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14482 fp=#0x300000023a6' 2024-08-31T04:31:06.417 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14514 fp=#0x30000000d36' 2024-08-31T04:31:06.417 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14546 fp=#0x3000000238e' 2024-08-31T04:31:06.418 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14578 fp=#0x30000000d26' 2024-08-31T04:31:06.418 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14610 fp=#0x100000023fd' 2024-08-31T04:31:06.418 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14642 fp=#0x30000002fc5' 2024-08-31T04:31:06.419 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14674 fp=#0x30000002fad' 2024-08-31T04:31:06.419 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14706 fp=#0x10000002457' 2024-08-31T04:31:06.419 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14738 fp=#0x1000000244b' 2024-08-31T04:31:06.419 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14770 fp=#0x10000002490' 2024-08-31T04:31:06.420 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14801 fp=#0x10000003c23' 2024-08-31T04:31:06.420 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14833 fp=#0x30000000a29' 2024-08-31T04:31:06.421 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14865 fp=#0x300000009af' 2024-08-31T04:31:06.421 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14897 fp=#0x300000009d3' 2024-08-31T04:31:06.421 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14929 fp=#0x300000009fb' 2024-08-31T04:31:06.422 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14961 fp=#0x300000009f3' 2024-08-31T04:31:06.422 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14993 fp=#0x300000016a3' 2024-08-31T04:31:06.422 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15025 fp=#0x300000015b3' 2024-08-31T04:31:06.422 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15057 fp=#0x30000001644' 2024-08-31T04:31:06.423 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15089 fp=#0x30000001661' 2024-08-31T04:31:06.423 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15121 fp=#0x30000003430' 2024-08-31T04:31:06.423 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15153 fp=#0x300000033d8' 2024-08-31T04:31:06.424 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15185 fp=#0x300000033f9' 2024-08-31T04:31:06.424 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15217 fp=#0x30000002e69' 2024-08-31T04:31:06.424 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15249 fp=#0x30000002ef7' 2024-08-31T04:31:06.425 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15281 fp=#0x30000002ec3' 2024-08-31T04:31:06.425 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15313 fp=#0x30000002ea7' 2024-08-31T04:31:06.425 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15345 fp=#0x30000002e82' 2024-08-31T04:31:06.426 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15377 fp=#0x300000032c6' 2024-08-31T04:31:06.426 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15409 fp=#0x300000032d1' 2024-08-31T04:31:06.426 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15441 fp=#0x30000001dc3' 2024-08-31T04:31:06.427 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15473 fp=#0x30000000eca' 2024-08-31T04:31:06.427 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15505 fp=#0x30000000efe' 2024-08-31T04:31:06.427 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15537 fp=#0x30000000edd' 2024-08-31T04:31:06.427 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15569 fp=#0x30000001db3' 2024-08-31T04:31:06.428 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15601 fp=#0x300000005dd' 2024-08-31T04:31:06.428 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15665 fp=#0x300000004ee' 2024-08-31T04:31:06.429 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15729 fp=#0x300000005b4' 2024-08-31T04:31:06.429 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15793 fp=#0x300000005b6' 2024-08-31T04:31:06.430 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15824 fp=#0x300000014d1' 2024-08-31T04:31:06.430 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15856 fp=#0x300000012bf' 2024-08-31T04:31:06.430 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15888 fp=#0x300000012d1' 2024-08-31T04:31:06.431 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15920 fp=#0x3000000129a' 2024-08-31T04:31:06.431 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15952 fp=#0x300000012e7' 2024-08-31T04:31:06.431 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15984 fp=#0x30000001294' 2024-08-31T04:31:06.431 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16016 fp=#0x3000000105f' 2024-08-31T04:31:06.432 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16048 fp=#0x3000000100a' 2024-08-31T04:31:06.432 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16080 fp=#0x30000001831' 2024-08-31T04:31:06.432 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16112 fp=#0x30000001820' 2024-08-31T04:31:06.433 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16176 fp=#0x3000000063d' 2024-08-31T04:31:06.433 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16240 fp=#0x300000033fe' 2024-08-31T04:31:06.434 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16272 fp=#0x300000005ce' 2024-08-31T04:31:06.434 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16304 fp=#0x300000034d2' 2024-08-31T04:31:06.434 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16333 fp=#0x10000002820' 2024-08-31T04:31:06.434 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16365 fp=#0x10000002839' 2024-08-31T04:31:06.435 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16397 fp=#0x30000002080' 2024-08-31T04:31:06.435 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16429 fp=#0x30000001d11' 2024-08-31T04:31:06.436 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16461 fp=#0x10000002547' 2024-08-31T04:31:06.436 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16493 fp=#0x30000001ce6' 2024-08-31T04:31:06.436 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16525 fp=#0x30000001d3e' 2024-08-31T04:31:06.436 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16557 fp=#0x100000024d3' 2024-08-31T04:31:06.437 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16589 fp=#0x30000001cef' 2024-08-31T04:31:06.437 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16621 fp=#0x10000002510' 2024-08-31T04:31:06.437 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16652 fp=#0x3000000211d' 2024-08-31T04:31:06.438 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16684 fp=#0x30000002218' 2024-08-31T04:31:06.438 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16716 fp=#0x300000021f6' 2024-08-31T04:31:06.438 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16748 fp=#0x300000026ac' 2024-08-31T04:31:06.438 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16780 fp=#0x30000001950' 2024-08-31T04:31:06.439 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16812 fp=#0x30000001a14' 2024-08-31T04:31:06.439 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16844 fp=#0x300000019d6' 2024-08-31T04:31:06.439 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16876 fp=#0x300000019c0' 2024-08-31T04:31:06.440 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16908 fp=#0x30000001a13' 2024-08-31T04:31:06.440 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16939 fp=#0x30000001ab9' 2024-08-31T04:31:06.440 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16971 fp=#0x30000001ad9' 2024-08-31T04:31:06.440 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17003 fp=#0x30000002b80' 2024-08-31T04:31:06.441 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17028 fp=#0x10000003657' 2024-08-31T04:31:06.441 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17060 fp=#0x10000003648' 2024-08-31T04:31:06.441 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17092 fp=#0x1000000368f' 2024-08-31T04:31:06.442 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17124 fp=#0x100000035f9' 2024-08-31T04:31:06.442 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17156 fp=#0x300000017d8' 2024-08-31T04:31:06.443 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17188 fp=#0x30000001712' 2024-08-31T04:31:06.443 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17220 fp=#0x300000017d7' 2024-08-31T04:31:06.443 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17252 fp=#0x300000017b9' 2024-08-31T04:31:06.443 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17284 fp=#0x3000000170f' 2024-08-31T04:31:06.444 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17316 fp=#0x30000001808' 2024-08-31T04:31:06.444 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17348 fp=#0x3000000335a' 2024-08-31T04:31:06.444 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17380 fp=#0x3000000330b' 2024-08-31T04:31:06.446 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17540 fp=#0x30000003208' 2024-08-31T04:31:06.446 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17572 fp=#0x30000000e0d' 2024-08-31T04:31:06.446 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17604 fp=#0x300000031cb' 2024-08-31T04:31:06.447 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17636 fp=#0x300000031c4' 2024-08-31T04:31:06.447 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17668 fp=#0x30000000e00' 2024-08-31T04:31:06.448 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17796 fp=#0x30000001fa2' 2024-08-31T04:31:06.448 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17828 fp=#0x30000001f43' 2024-08-31T04:31:06.449 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17860 fp=#0x30000001f89' 2024-08-31T04:31:06.449 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17892 fp=#0x30000001fad' 2024-08-31T04:31:06.449 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17924 fp=#0x3000000314b' 2024-08-31T04:31:06.450 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17956 fp=#0x300000030eb' 2024-08-31T04:31:06.450 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17988 fp=#0x30000003107' 2024-08-31T04:31:06.450 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18020 fp=#0x30000001be7' 2024-08-31T04:31:06.451 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18052 fp=#0x30000001bf1' 2024-08-31T04:31:06.451 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18084 fp=#0x30000001c12' 2024-08-31T04:31:06.451 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18116 fp=#0x3000000259c' 2024-08-31T04:31:06.451 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18148 fp=#0x3000000258b' 2024-08-31T04:31:06.452 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18180 fp=#0x30000002524' 2024-08-31T04:31:06.452 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18212 fp=#0x3000000254e' 2024-08-31T04:31:06.452 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18244 fp=#0x300000027b7' 2024-08-31T04:31:06.453 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18276 fp=#0x3000000285f' 2024-08-31T04:31:06.453 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18308 fp=#0x300000027cc' 2024-08-31T04:31:06.453 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18340 fp=#0x300000027f7' 2024-08-31T04:31:06.454 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18372 fp=#0x300000027bf' 2024-08-31T04:31:06.454 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18404 fp=#0x30000002f60' 2024-08-31T04:31:06.454 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18436 fp=#0x30000002f32' 2024-08-31T04:31:06.455 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18468 fp=#0x3000000302f' 2024-08-31T04:31:06.455 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18500 fp=#0x30000002f40' 2024-08-31T04:31:06.455 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18532 fp=#0x30000002f26' 2024-08-31T04:31:06.456 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18564 fp=#0x10000001d6c' 2024-08-31T04:31:06.456 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18628 fp=#0x10000001cfd' 2024-08-31T04:31:06.457 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18692 fp=#0x30000001502' 2024-08-31T04:31:06.457 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18724 fp=#0x30000001380' 2024-08-31T04:31:06.458 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18756 fp=#0x300000013ae' 2024-08-31T04:31:06.458 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18788 fp=#0x300000013d6' 2024-08-31T04:31:06.458 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18820 fp=#0x3000000139c' 2024-08-31T04:31:06.458 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18852 fp=#0x3000000132f' 2024-08-31T04:31:06.459 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18884 fp=#0x30000001108' 2024-08-31T04:31:06.459 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18916 fp=#0x300000010c6' 2024-08-31T04:31:06.459 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18948 fp=#0x30000001d81' 2024-08-31T04:31:06.460 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18980 fp=#0x3000000106b' 2024-08-31T04:31:06.460 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19012 fp=#0x300000010d2' 2024-08-31T04:31:06.460 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19044 fp=#0x300000011ea' 2024-08-31T04:31:06.461 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19076 fp=#0x300000011c2' 2024-08-31T04:31:06.461 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19108 fp=#0x300000011d2' 2024-08-31T04:31:06.461 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19140 fp=#0x300000011e2' 2024-08-31T04:31:06.462 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19172 fp=#0x30000001685' 2024-08-31T04:31:06.462 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19236 fp=#0x3000000166d' 2024-08-31T04:31:06.462 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19268 fp=#0x30000001663' 2024-08-31T04:31:06.463 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19300 fp=#0x30000002ba7' 2024-08-31T04:31:06.463 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19332 fp=#0x30000002bb7' 2024-08-31T04:31:06.463 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19364 fp=#0x300000014ea' 2024-08-31T04:31:06.464 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19396 fp=#0x100000008c4' 2024-08-31T04:31:06.464 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19427 fp=#0x30000000bd3' 2024-08-31T04:31:06.464 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19459 fp=#0x30000000ba8' 2024-08-31T04:31:06.465 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19491 fp=#0x30000000be3' 2024-08-31T04:31:06.465 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19523 fp=#0x30000000b97' 2024-08-31T04:31:06.465 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19555 fp=#0x30000000b20' 2024-08-31T04:31:06.466 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19587 fp=#0x30000000b35' 2024-08-31T04:31:06.466 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19651 fp=#0x30000002c6f' 2024-08-31T04:31:06.467 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19683 fp=#0x30000002d9c' 2024-08-31T04:31:06.467 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19715 fp=#0x30000002c80' 2024-08-31T04:31:06.467 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19747 fp=#0x30000002d5c' 2024-08-31T04:31:06.467 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19779 fp=#0x30000002d7f' 2024-08-31T04:31:06.468 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19811 fp=#0x3000000114c' 2024-08-31T04:31:06.468 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19843 fp=#0x30000001143' 2024-08-31T04:31:06.468 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19875 fp=#0x30000001207' 2024-08-31T04:31:06.469 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19907 fp=#0x300000011c7' 2024-08-31T04:31:06.469 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19939 fp=#0x30000001459' 2024-08-31T04:31:06.469 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19971 fp=#0x30000001420' 2024-08-31T04:31:06.470 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20003 fp=#0x3000000141c' 2024-08-31T04:31:06.470 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20035 fp=#0x30000000fa9' 2024-08-31T04:31:06.470 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20067 fp=#0x30000000faa' 2024-08-31T04:31:06.471 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20099 fp=#0x30000000fac' 2024-08-31T04:31:06.471 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20131 fp=#0x3000000172b' 2024-08-31T04:31:06.471 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20163 fp=#0x300000016e9' 2024-08-31T04:31:06.472 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20195 fp=#0x300000016cb' 2024-08-31T04:31:06.472 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20227 fp=#0x30000003244' 2024-08-31T04:31:06.472 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20259 fp=#0x3000000309b' 2024-08-31T04:31:06.473 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20291 fp=#0x300000030c3' 2024-08-31T04:31:06.473 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20323 fp=#0x300000030f1' 2024-08-31T04:31:06.473 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20355 fp=#0x3000000310e' 2024-08-31T04:31:06.474 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20387 fp=#0x30000001cba' 2024-08-31T04:31:06.474 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20419 fp=#0x30000001ce4' 2024-08-31T04:31:06.474 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20451 fp=#0x30000001cb5' 2024-08-31T04:31:06.474 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20483 fp=#0x30000001cb9' 2024-08-31T04:31:06.475 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20515 fp=#0x30000001218' 2024-08-31T04:31:06.475 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20547 fp=#0x3000000123f' 2024-08-31T04:31:06.475 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20579 fp=#0x3000000125f' 2024-08-31T04:31:06.477 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20771 fp=#0x1000000385a' 2024-08-31T04:31:06.478 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20867 fp=#0x30000003085' 2024-08-31T04:31:06.478 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20963 fp=#0x300000020eb' 2024-08-31T04:31:06.479 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20995 fp=#0x300000020b0' 2024-08-31T04:31:06.479 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21026 fp=#0x300000016ac' 2024-08-31T04:31:06.479 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21058 fp=#0x3000000156e' 2024-08-31T04:31:06.480 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21090 fp=#0x30000001550' 2024-08-31T04:31:06.480 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21122 fp=#0x30000001613' 2024-08-31T04:31:06.481 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21186 fp=#0x30000002bd2' 2024-08-31T04:31:06.481 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21218 fp=#0x30000002c48' 2024-08-31T04:31:06.482 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21314 fp=#0x10000003312' 2024-08-31T04:31:06.482 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21346 fp=#0x1000000338c' 2024-08-31T04:31:06.482 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21378 fp=#0x100000032bd' 2024-08-31T04:31:06.483 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21410 fp=#0x100000032dd' 2024-08-31T04:31:06.483 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21442 fp=#0x100000032d8' 2024-08-31T04:31:06.483 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21474 fp=#0x3000000273f' 2024-08-31T04:31:06.484 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21506 fp=#0x300000025ee' 2024-08-31T04:31:06.484 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21538 fp=#0x300000026c7' 2024-08-31T04:31:06.484 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21570 fp=#0x30000002726' 2024-08-31T04:31:06.485 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21602 fp=#0x30000000cdb' 2024-08-31T04:31:06.485 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21634 fp=#0x30000000ca0' 2024-08-31T04:31:06.485 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21666 fp=#0x300000036a6' 2024-08-31T04:31:06.486 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21698 fp=#0x30000000d03' 2024-08-31T04:31:06.486 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21730 fp=#0x30000000cff' 2024-08-31T04:31:06.486 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21762 fp=#0x30000000b46' 2024-08-31T04:31:06.487 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21794 fp=#0x30000000ab4' 2024-08-31T04:31:06.487 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21826 fp=#0x30000000aea' 2024-08-31T04:31:06.487 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21858 fp=#0x30000000a9c' 2024-08-31T04:31:06.488 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21986 fp=#0x3000000093c' 2024-08-31T04:31:06.489 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22017 fp=#0x30000001923' 2024-08-31T04:31:06.489 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22049 fp=#0x300000018f1' 2024-08-31T04:31:06.489 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22081 fp=#0x3000000192f' 2024-08-31T04:31:06.490 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22113 fp=#0x30000002f84' 2024-08-31T04:31:06.490 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22145 fp=#0x300000028d1' 2024-08-31T04:31:06.490 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22177 fp=#0x30000002958' 2024-08-31T04:31:06.490 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22209 fp=#0x30000002993' 2024-08-31T04:31:06.491 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22241 fp=#0x300000028e9' 2024-08-31T04:31:06.491 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22273 fp=#0x30000002095' 2024-08-31T04:31:06.491 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22305 fp=#0x30000001ffd' 2024-08-31T04:31:06.492 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22337 fp=#0x3000000204b' 2024-08-31T04:31:06.492 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22369 fp=#0x30000002017' 2024-08-31T04:31:06.492 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22401 fp=#0x30000000489' 2024-08-31T04:31:06.493 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22465 fp=#0x30000000468' 2024-08-31T04:31:06.493 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22497 fp=#0x30000000412' 2024-08-31T04:31:06.493 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22522 fp=#0x30000002c51' 2024-08-31T04:31:06.494 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22554 fp=#0x30000002c83' 2024-08-31T04:31:06.494 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22585 fp=#0x300000033c9' 2024-08-31T04:31:06.495 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22649 fp=#0x3000000147e' 2024-08-31T04:31:06.495 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22681 fp=#0x3000000339a' 2024-08-31T04:31:06.495 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22711 fp=#0x500000011b7' 2024-08-31T04:31:06.495 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:9779 fp=#0x30000000baf' 2024-08-31T04:31:06.496 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:9811 fp=#0x100000023e2' 2024-08-31T04:31:06.497 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:9907 fp=#0x30000001bdb' 2024-08-31T04:31:06.497 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:9939 fp=#0x1000000371c' 2024-08-31T04:31:06.510 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:11763 fp=#0x30000000c40' 2024-08-31T04:31:06.510 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:11827 fp=#0x300000023c0' 2024-08-31T04:31:06.511 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:11859 fp=#0x30000000c2e' 2024-08-31T04:31:06.511 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:11891 fp=#0x30000000bca' 2024-08-31T04:31:06.511 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:11923 fp=#0x3000000103c' 2024-08-31T04:31:06.512 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:11955 fp=#0x3000000101e' 2024-08-31T04:31:06.512 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:11987 fp=#0x300000010c1' 2024-08-31T04:31:06.513 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12051 fp=#0x300000010ae' 2024-08-31T04:31:06.513 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12083 fp=#0x3000000119f' 2024-08-31T04:31:06.513 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12115 fp=#0x30000001016' 2024-08-31T04:31:06.513 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12147 fp=#0x300000031de' 2024-08-31T04:31:06.515 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12435 fp=#0x30000002e0f' 2024-08-31T04:31:06.516 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12499 fp=#0x30000000f4d' 2024-08-31T04:31:06.516 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12531 fp=#0x30000000f43' 2024-08-31T04:31:06.517 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12563 fp=#0x30000000f3e' 2024-08-31T04:31:06.517 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12595 fp=#0x30000000e46' 2024-08-31T04:31:06.517 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12627 fp=#0x30000000fd4' 2024-08-31T04:31:06.518 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12659 fp=#0x30000002283' 2024-08-31T04:31:06.518 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12691 fp=#0x300000033ae' 2024-08-31T04:31:06.518 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12723 fp=#0x30000000e5d' 2024-08-31T04:31:06.519 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12755 fp=#0x30000000e96' 2024-08-31T04:31:06.519 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12787 fp=#0x30000000e1a' 2024-08-31T04:31:06.519 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12819 fp=#0x30000003370' 2024-08-31T04:31:06.520 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12851 fp=#0x1000000421d' 2024-08-31T04:31:06.520 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12883 fp=#0x100000043bf' 2024-08-31T04:31:06.520 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12915 fp=#0x10000004255' 2024-08-31T04:31:06.521 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12947 fp=#0x10000004202' 2024-08-31T04:31:06.521 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12979 fp=#0x3000000281c' 2024-08-31T04:31:06.521 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13011 fp=#0x30000000867' 2024-08-31T04:31:06.522 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13043 fp=#0x100000043af' 2024-08-31T04:31:06.522 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13075 fp=#0x30000002890' 2024-08-31T04:31:06.522 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13107 fp=#0x300000030e4' 2024-08-31T04:31:06.522 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13139 fp=#0x300000031aa' 2024-08-31T04:31:06.523 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13171 fp=#0x300000030fb' 2024-08-31T04:31:06.524 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13299 fp=#0x30000000a59' 2024-08-31T04:31:06.524 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13331 fp=#0x300000008c9' 2024-08-31T04:31:06.524 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13363 fp=#0x30000000a53' 2024-08-31T04:31:06.525 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13395 fp=#0x30000000a56' 2024-08-31T04:31:06.525 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13427 fp=#0x30000000a50' 2024-08-31T04:31:06.525 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13459 fp=#0x3000000089a' 2024-08-31T04:31:06.526 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13491 fp=#0x3000000088b' 2024-08-31T04:31:06.526 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13523 fp=#0x300000009c6' 2024-08-31T04:31:06.526 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13555 fp=#0x30000003347' 2024-08-31T04:31:06.527 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13587 fp=#0x30000003294' 2024-08-31T04:31:06.527 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13619 fp=#0x300000032ec' 2024-08-31T04:31:06.527 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13651 fp=#0x30000003285' 2024-08-31T04:31:06.528 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13683 fp=#0x300000028f9' 2024-08-31T04:31:06.528 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13715 fp=#0x300000029bf' 2024-08-31T04:31:06.528 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13747 fp=#0x300000028a3' 2024-08-31T04:31:06.528 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13779 fp=#0x30000002945' 2024-08-31T04:31:06.529 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13811 fp=#0x30000002968' 2024-08-31T04:31:06.529 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13843 fp=#0x30000002959' 2024-08-31T04:31:06.529 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13875 fp=#0x10000003dc7' 2024-08-31T04:31:06.530 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13939 fp=#0x10000003eeb' 2024-08-31T04:31:06.531 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14035 fp=#0x10000003d65' 2024-08-31T04:31:06.531 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14067 fp=#0x30000000c66' 2024-08-31T04:31:06.531 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14099 fp=#0x30000000c7b' 2024-08-31T04:31:06.531 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14131 fp=#0x3000000175e' 2024-08-31T04:31:06.532 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14163 fp=#0x300000017b5' 2024-08-31T04:31:06.532 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14195 fp=#0x30000002444' 2024-08-31T04:31:06.532 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14227 fp=#0x3000000243f' 2024-08-31T04:31:06.534 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14387 fp=#0x300000023a8' 2024-08-31T04:31:06.534 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14419 fp=#0x30000000ccf' 2024-08-31T04:31:06.534 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14451 fp=#0x30000000d9a' 2024-08-31T04:31:06.535 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14483 fp=#0x3000000239e' 2024-08-31T04:31:06.535 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14515 fp=#0x30000000cc5' 2024-08-31T04:31:06.535 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14547 fp=#0x30000000c97' 2024-08-31T04:31:06.535 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14579 fp=#0x3000000238f' 2024-08-31T04:31:06.536 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14611 fp=#0x1000000241e' 2024-08-31T04:31:06.536 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14643 fp=#0x30000002fc4' 2024-08-31T04:31:06.536 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14675 fp=#0x1000000243b' 2024-08-31T04:31:06.537 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14707 fp=#0x10000002420' 2024-08-31T04:31:06.537 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14739 fp=#0x30000002f90' 2024-08-31T04:31:06.537 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14771 fp=#0x30000002fbe' 2024-08-31T04:31:06.538 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14802 fp=#0x10000003b9d' 2024-08-31T04:31:06.538 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14834 fp=#0x3000000098f' 2024-08-31T04:31:06.538 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14866 fp=#0x30000000a02' 2024-08-31T04:31:06.539 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14898 fp=#0x300000009f6' 2024-08-31T04:31:06.539 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14930 fp=#0x300000009a4' 2024-08-31T04:31:06.539 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14962 fp=#0x300000009d9' 2024-08-31T04:31:06.540 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14994 fp=#0x300000016af' 2024-08-31T04:31:06.540 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15026 fp=#0x300000015c7' 2024-08-31T04:31:06.540 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15058 fp=#0x300000015dc' 2024-08-31T04:31:06.540 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15090 fp=#0x300000014e1' 2024-08-31T04:31:06.541 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15122 fp=#0x30000003443' 2024-08-31T04:31:06.541 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15154 fp=#0x300000033e9' 2024-08-31T04:31:06.541 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15186 fp=#0x300000033ec' 2024-08-31T04:31:06.542 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15218 fp=#0x30000002e7e' 2024-08-31T04:31:06.542 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15250 fp=#0x30000002eaa' 2024-08-31T04:31:06.542 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15282 fp=#0x30000002ecb' 2024-08-31T04:31:06.543 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15314 fp=#0x30000002e9e' 2024-08-31T04:31:06.543 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15346 fp=#0x30000002ef5' 2024-08-31T04:31:06.543 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15378 fp=#0x300000032e6' 2024-08-31T04:31:06.544 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15410 fp=#0x300000032c3' 2024-08-31T04:31:06.544 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15442 fp=#0x30000000edf' 2024-08-31T04:31:06.544 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15474 fp=#0x30000001daf' 2024-08-31T04:31:06.545 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15506 fp=#0x30000000f0e' 2024-08-31T04:31:06.545 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15538 fp=#0x30000000ed8' 2024-08-31T04:31:06.545 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15570 fp=#0x30000000ebe' 2024-08-31T04:31:06.546 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15602 fp=#0x30000000533' 2024-08-31T04:31:06.546 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15634 fp=#0x30000000502' 2024-08-31T04:31:06.548 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15825 fp=#0x3000000127a' 2024-08-31T04:31:06.548 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15857 fp=#0x30000001306' 2024-08-31T04:31:06.548 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15889 fp=#0x300000012d5' 2024-08-31T04:31:06.549 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15921 fp=#0x300000012e3' 2024-08-31T04:31:06.549 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15953 fp=#0x300000012b1' 2024-08-31T04:31:06.549 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15985 fp=#0x300000014c6' 2024-08-31T04:31:06.550 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16017 fp=#0x30000001019' 2024-08-31T04:31:06.550 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16049 fp=#0x3000000103f' 2024-08-31T04:31:06.550 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16081 fp=#0x30000002a23' 2024-08-31T04:31:06.550 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16113 fp=#0x30000002e04' 2024-08-31T04:31:06.551 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16145 fp=#0x3000000350a' 2024-08-31T04:31:06.551 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16209 fp=#0x30000003413' 2024-08-31T04:31:06.552 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16273 fp=#0x300000034d0' 2024-08-31T04:31:06.552 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16305 fp=#0x30000000634' 2024-08-31T04:31:06.552 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16334 fp=#0x30000000277' 2024-08-31T04:31:06.553 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16366 fp=#0x1000000287e' 2024-08-31T04:31:06.553 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16430 fp=#0x100000024a5' 2024-08-31T04:31:06.554 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16462 fp=#0x100000024b7' 2024-08-31T04:31:06.554 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16494 fp=#0x30000001cfb' 2024-08-31T04:31:06.554 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16526 fp=#0x100000024f9' 2024-08-31T04:31:06.555 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16558 fp=#0x100000024ab' 2024-08-31T04:31:06.555 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16590 fp=#0x1000000250c' 2024-08-31T04:31:06.555 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16622 fp=#0x100000024ba' 2024-08-31T04:31:06.556 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16653 fp=#0x30000002304' 2024-08-31T04:31:06.556 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16685 fp=#0x30000002105' 2024-08-31T04:31:06.556 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16717 fp=#0x300000020fe' 2024-08-31T04:31:06.557 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16749 fp=#0x300000003de' 2024-08-31T04:31:06.557 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16813 fp=#0x300000019be' 2024-08-31T04:31:06.557 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16845 fp=#0x300000019bb' 2024-08-31T04:31:06.558 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16877 fp=#0x300000019e0' 2024-08-31T04:31:06.558 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16909 fp=#0x300000019d0' 2024-08-31T04:31:06.558 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16940 fp=#0x30000002b60' 2024-08-31T04:31:06.559 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16972 fp=#0x30000001abf' 2024-08-31T04:31:06.559 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17004 fp=#0x30000002b61' 2024-08-31T04:31:06.559 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17029 fp=#0x10000003610' 2024-08-31T04:31:06.559 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17061 fp=#0x100000036bf' 2024-08-31T04:31:06.560 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17093 fp=#0x100000036fa' 2024-08-31T04:31:06.560 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17125 fp=#0x10000003697' 2024-08-31T04:31:06.560 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17157 fp=#0x30000001728' 2024-08-31T04:31:06.561 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17189 fp=#0x300000017c5' 2024-08-31T04:31:06.561 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17221 fp=#0x30000002cd9' 2024-08-31T04:31:06.562 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17253 fp=#0x300000017eb' 2024-08-31T04:31:06.562 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17285 fp=#0x30000001769' 2024-08-31T04:31:06.562 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17317 fp=#0x3000000172e' 2024-08-31T04:31:06.562 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17349 fp=#0x3000000333d' 2024-08-31T04:31:06.564 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17541 fp=#0x30000000daa' 2024-08-31T04:31:06.564 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17573 fp=#0x30000000dec' 2024-08-31T04:31:06.565 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17605 fp=#0x30000000dac' 2024-08-31T04:31:06.565 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17637 fp=#0x300000031c6' 2024-08-31T04:31:06.565 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17669 fp=#0x30000003227' 2024-08-31T04:31:06.566 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17797 fp=#0x30000002043' 2024-08-31T04:31:06.567 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17829 fp=#0x30000001fea' 2024-08-31T04:31:06.567 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17861 fp=#0x30000001f51' 2024-08-31T04:31:06.567 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17893 fp=#0x30000002008' 2024-08-31T04:31:06.567 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17925 fp=#0x30000003160' 2024-08-31T04:31:06.568 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17957 fp=#0x30000003171' 2024-08-31T04:31:06.568 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17989 fp=#0x300000030d8' 2024-08-31T04:31:06.569 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18021 fp=#0x30000001c0d' 2024-08-31T04:31:06.569 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18053 fp=#0x30000001c45' 2024-08-31T04:31:06.569 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18085 fp=#0x30000001c34' 2024-08-31T04:31:06.570 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18117 fp=#0x3000000251f' 2024-08-31T04:31:06.570 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18149 fp=#0x30000002531' 2024-08-31T04:31:06.570 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18181 fp=#0x30000002559' 2024-08-31T04:31:06.570 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18213 fp=#0x3000000258c' 2024-08-31T04:31:06.571 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18245 fp=#0x300000027ef' 2024-08-31T04:31:06.571 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18277 fp=#0x3000000284b' 2024-08-31T04:31:06.571 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18309 fp=#0x300000027e5' 2024-08-31T04:31:06.572 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18341 fp=#0x30000002885' 2024-08-31T04:31:06.572 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18373 fp=#0x30000002879' 2024-08-31T04:31:06.572 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18405 fp=#0x30000002f6b' 2024-08-31T04:31:06.573 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18437 fp=#0x30000002fec' 2024-08-31T04:31:06.573 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18469 fp=#0x30000002f1c' 2024-08-31T04:31:06.573 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18501 fp=#0x30000002fe9' 2024-08-31T04:31:06.574 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18533 fp=#0x3000000302b' 2024-08-31T04:31:06.574 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18565 fp=#0x30000000259' 2024-08-31T04:31:06.574 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18597 fp=#0x10000001d78' 2024-08-31T04:31:06.575 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18661 fp=#0x10000001d62' 2024-08-31T04:31:06.575 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18693 fp=#0x30000002f6e' 2024-08-31T04:31:06.575 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18725 fp=#0x30000001515' 2024-08-31T04:31:06.576 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18757 fp=#0x30000001397' 2024-08-31T04:31:06.576 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18789 fp=#0x30000001508' 2024-08-31T04:31:06.576 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18821 fp=#0x30000001371' 2024-08-31T04:31:06.577 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18853 fp=#0x30000001347' 2024-08-31T04:31:06.577 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18885 fp=#0x300000010d4' 2024-08-31T04:31:06.577 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18917 fp=#0x300000010cc' 2024-08-31T04:31:06.577 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18949 fp=#0x300000010b5' 2024-08-31T04:31:06.578 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18981 fp=#0x300000010c0' 2024-08-31T04:31:06.578 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19013 fp=#0x300000010c4' 2024-08-31T04:31:06.578 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19045 fp=#0x300000011dd' 2024-08-31T04:31:06.579 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19077 fp=#0x3000000118b' 2024-08-31T04:31:06.579 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19109 fp=#0x30000001138' 2024-08-31T04:31:06.579 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19141 fp=#0x30000001144' 2024-08-31T04:31:06.579 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19173 fp=#0x300000015d7' 2024-08-31T04:31:06.580 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19237 fp=#0x3000000161b' 2024-08-31T04:31:06.580 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19269 fp=#0x300000015e0' 2024-08-31T04:31:06.581 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19301 fp=#0x30000002bb0' 2024-08-31T04:31:06.581 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19333 fp=#0x30000002bb3' 2024-08-31T04:31:06.581 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19365 fp=#0x100000008ba' 2024-08-31T04:31:06.582 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19397 fp=#0x30000002ba1' 2024-08-31T04:31:06.582 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19428 fp=#0x30000000b75' 2024-08-31T04:31:06.582 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19460 fp=#0x30000000b8e' 2024-08-31T04:31:06.583 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19492 fp=#0x30000000b8c' 2024-08-31T04:31:06.583 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19524 fp=#0x30000000b61' 2024-08-31T04:31:06.583 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19588 fp=#0x30000001d28' 2024-08-31T04:31:06.584 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19620 fp=#0x30000000a98' 2024-08-31T04:31:06.584 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19652 fp=#0x30000002cbc' 2024-08-31T04:31:06.584 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19684 fp=#0x30000002bf9' 2024-08-31T04:31:06.585 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19716 fp=#0x30000002c9a' 2024-08-31T04:31:06.585 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19748 fp=#0x30000002d63' 2024-08-31T04:31:06.585 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19780 fp=#0x30000002c21' 2024-08-31T04:31:06.586 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19812 fp=#0x300000011f6' 2024-08-31T04:31:06.586 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19844 fp=#0x300000011b4' 2024-08-31T04:31:06.586 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19876 fp=#0x30000001450' 2024-08-31T04:31:06.586 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19908 fp=#0x30000001158' 2024-08-31T04:31:06.587 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19940 fp=#0x30000001139' 2024-08-31T04:31:06.587 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19972 fp=#0x300000013f0' 2024-08-31T04:31:06.587 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20004 fp=#0x30000001417' 2024-08-31T04:31:06.588 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20036 fp=#0x30000000fc1' 2024-08-31T04:31:06.588 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20068 fp=#0x30000000fde' 2024-08-31T04:31:06.588 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20100 fp=#0x30000000fe1' 2024-08-31T04:31:06.589 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20132 fp=#0x30000001727' 2024-08-31T04:31:06.589 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20164 fp=#0x300000016e1' 2024-08-31T04:31:06.589 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20196 fp=#0x300000016b6' 2024-08-31T04:31:06.590 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20228 fp=#0x30000003083' 2024-08-31T04:31:06.590 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20260 fp=#0x300000031ba' 2024-08-31T04:31:06.590 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20292 fp=#0x3000000310c' 2024-08-31T04:31:06.591 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20324 fp=#0x3000000308a' 2024-08-31T04:31:06.591 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20356 fp=#0x300000031b7' 2024-08-31T04:31:06.591 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20388 fp=#0x30000001cec' 2024-08-31T04:31:06.591 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20420 fp=#0x30000001cc7' 2024-08-31T04:31:06.592 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20452 fp=#0x30000001c6e' 2024-08-31T04:31:06.592 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20484 fp=#0x30000001cb2' 2024-08-31T04:31:06.592 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20516 fp=#0x30000001267' 2024-08-31T04:31:06.593 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20548 fp=#0x30000001258' 2024-08-31T04:31:06.593 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20580 fp=#0x30000001266' 2024-08-31T04:31:06.594 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20676 fp=#0x3000000218c' 2024-08-31T04:31:06.594 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20708 fp=#0x30000000d6c' 2024-08-31T04:31:06.594 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20772 fp=#0x300000030d4' 2024-08-31T04:31:06.595 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20804 fp=#0x3000000309e' 2024-08-31T04:31:06.595 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20836 fp=#0x3000000305f' 2024-08-31T04:31:06.595 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20868 fp=#0x3000000304a' 2024-08-31T04:31:06.596 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20932 fp=#0x300000030cd' 2024-08-31T04:31:06.596 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20964 fp=#0x300000020ed' 2024-08-31T04:31:06.596 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20996 fp=#0x300000020bb' 2024-08-31T04:31:06.597 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21027 fp=#0x300000016b2' 2024-08-31T04:31:06.597 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21059 fp=#0x3000000169c' 2024-08-31T04:31:06.597 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21091 fp=#0x300000015f0' 2024-08-31T04:31:06.598 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21123 fp=#0x30000001648' 2024-08-31T04:31:06.598 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21155 fp=#0x30000002c1d' 2024-08-31T04:31:06.599 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21283 fp=#0x30000002be8' 2024-08-31T04:31:06.599 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21315 fp=#0x1000000338e' 2024-08-31T04:31:06.600 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21347 fp=#0x10000003365' 2024-08-31T04:31:06.600 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21379 fp=#0x10000003276' 2024-08-31T04:31:06.600 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21411 fp=#0x10000003319' 2024-08-31T04:31:06.601 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21443 fp=#0x1000000328f' 2024-08-31T04:31:06.601 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21475 fp=#0x3000000261e' 2024-08-31T04:31:06.601 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21507 fp=#0x30000002602' 2024-08-31T04:31:06.602 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21539 fp=#0x30000002688' 2024-08-31T04:31:06.602 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21571 fp=#0x300000025f7' 2024-08-31T04:31:06.602 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21603 fp=#0x30000000d50' 2024-08-31T04:31:06.603 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21635 fp=#0x3000000369e' 2024-08-31T04:31:06.603 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21667 fp=#0x300000036ee' 2024-08-31T04:31:06.603 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21699 fp=#0x3000000367e' 2024-08-31T04:31:06.603 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21731 fp=#0x30000000c8b' 2024-08-31T04:31:06.604 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21763 fp=#0x3000000323f' 2024-08-31T04:31:06.604 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21795 fp=#0x30000000b40' 2024-08-31T04:31:06.605 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21827 fp=#0x30000000a9e' 2024-08-31T04:31:06.605 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21859 fp=#0x30000000b12' 2024-08-31T04:31:06.605 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21891 fp=#0x30000000582' 2024-08-31T04:31:06.605 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21923 fp=#0x30000000503' 2024-08-31T04:31:06.606 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21955 fp=#0x300000008f3' 2024-08-31T04:31:06.606 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22018 fp=#0x30000001944' 2024-08-31T04:31:06.607 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22050 fp=#0x300000018f5' 2024-08-31T04:31:06.607 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22082 fp=#0x300000018f7' 2024-08-31T04:31:06.607 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22114 fp=#0x30000002f75' 2024-08-31T04:31:06.607 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22146 fp=#0x30000002986' 2024-08-31T04:31:06.608 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22178 fp=#0x30000002948' 2024-08-31T04:31:06.608 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22210 fp=#0x300000028ec' 2024-08-31T04:31:06.608 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22242 fp=#0x30000002954' 2024-08-31T04:31:06.609 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22274 fp=#0x300000020a5' 2024-08-31T04:31:06.609 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22306 fp=#0x3000000209e' 2024-08-31T04:31:06.609 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22338 fp=#0x3000000205e' 2024-08-31T04:31:06.610 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22370 fp=#0x3000000206d' 2024-08-31T04:31:06.610 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22402 fp=#0x30000000477' 2024-08-31T04:31:06.610 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22434 fp=#0x300000004ad' 2024-08-31T04:31:06.611 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22466 fp=#0x3000000046f' 2024-08-31T04:31:06.611 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22498 fp=#0x30000000475' 2024-08-31T04:31:06.611 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22523 fp=#0x30000002bff' 2024-08-31T04:31:06.611 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22555 fp=#0x30000002c22' 2024-08-31T04:31:06.612 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22586 fp=#0x3000000149a' 2024-08-31T04:31:06.612 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22618 fp=#0x30000001477' 2024-08-31T04:31:06.613 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22682 fp=#0x3000000149d' 2024-08-31T04:31:06.614 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:9908 fp=#0x3000000251a' 2024-08-31T04:31:06.614 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:9940 fp=#0x300000020a7' 2024-08-31T04:31:06.627 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:11796 fp=#0x300000023ba' 2024-08-31T04:31:06.627 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:11828 fp=#0x300000023c8' 2024-08-31T04:31:06.628 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:11860 fp=#0x30000000bcc' 2024-08-31T04:31:06.628 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:11924 fp=#0x300000010c3' 2024-08-31T04:31:06.629 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:11956 fp=#0x30000001018' 2024-08-31T04:31:06.629 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:11988 fp=#0x300000010ab' 2024-08-31T04:31:06.629 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12020 fp=#0x3000000320d' 2024-08-31T04:31:06.630 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12052 fp=#0x30000001057' 2024-08-31T04:31:06.630 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12084 fp=#0x3000000110f' 2024-08-31T04:31:06.630 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12116 fp=#0x300000031eb' 2024-08-31T04:31:06.631 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12244 fp=#0x3000000095c' 2024-08-31T04:31:06.632 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12276 fp=#0x3000000093e' 2024-08-31T04:31:06.632 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12308 fp=#0x30000000925' 2024-08-31T04:31:06.632 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12340 fp=#0x300000009bb' 2024-08-31T04:31:06.633 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12372 fp=#0x30000000942' 2024-08-31T04:31:06.633 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12404 fp=#0x30000002e47' 2024-08-31T04:31:06.633 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12436 fp=#0x30000002e16' 2024-08-31T04:31:06.634 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12500 fp=#0x30000000f7a' 2024-08-31T04:31:06.634 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12532 fp=#0x30000000f48' 2024-08-31T04:31:06.634 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12564 fp=#0x30000000f41' 2024-08-31T04:31:06.635 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12596 fp=#0x30000000e2e' 2024-08-31T04:31:06.635 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12628 fp=#0x30000000e70' 2024-08-31T04:31:06.635 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12660 fp=#0x300000033d0' 2024-08-31T04:31:06.635 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12692 fp=#0x30000000e57' 2024-08-31T04:31:06.636 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12724 fp=#0x3000000337b' 2024-08-31T04:31:06.636 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12756 fp=#0x3000000336f' 2024-08-31T04:31:06.636 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12788 fp=#0x3000000226c' 2024-08-31T04:31:06.637 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12820 fp=#0x30000003377' 2024-08-31T04:31:06.637 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12852 fp=#0x3000000202f' 2024-08-31T04:31:06.637 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12884 fp=#0x100000043fd' 2024-08-31T04:31:06.638 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12916 fp=#0x30000002817' 2024-08-31T04:31:06.638 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12948 fp=#0x10000004208' 2024-08-31T04:31:06.638 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12980 fp=#0x1000000423e' 2024-08-31T04:31:06.638 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13012 fp=#0x10000004409' 2024-08-31T04:31:06.639 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13044 fp=#0x10000004243' 2024-08-31T04:31:06.639 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13076 fp=#0x1000000432e' 2024-08-31T04:31:06.639 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13108 fp=#0x300000031ce' 2024-08-31T04:31:06.640 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13140 fp=#0x30000003152' 2024-08-31T04:31:06.640 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13172 fp=#0x30000003106' 2024-08-31T04:31:06.641 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13300 fp=#0x3000000089b' 2024-08-31T04:31:06.641 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13332 fp=#0x3000000225a' 2024-08-31T04:31:06.642 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13364 fp=#0x300000009c9' 2024-08-31T04:31:06.642 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13396 fp=#0x30000002261' 2024-08-31T04:31:06.642 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13428 fp=#0x300000008f4' 2024-08-31T04:31:06.643 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13460 fp=#0x300000009d7' 2024-08-31T04:31:06.643 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13492 fp=#0x30000002292' 2024-08-31T04:31:06.643 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13524 fp=#0x30000000898' 2024-08-31T04:31:06.644 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13556 fp=#0x3000000331c' 2024-08-31T04:31:06.644 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13588 fp=#0x3000000328b' 2024-08-31T04:31:06.644 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13620 fp=#0x3000000328c' 2024-08-31T04:31:06.645 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13652 fp=#0x3000000329d' 2024-08-31T04:31:06.645 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13684 fp=#0x3000000291e' 2024-08-31T04:31:06.645 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13716 fp=#0x30000002962' 2024-08-31T04:31:06.646 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13748 fp=#0x30000002917' 2024-08-31T04:31:06.646 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13780 fp=#0x30000002985' 2024-08-31T04:31:06.646 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13812 fp=#0x3000000293f' 2024-08-31T04:31:06.647 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13844 fp=#0x300000029c4' 2024-08-31T04:31:06.647 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13908 fp=#0x10000003d55' 2024-08-31T04:31:06.647 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13940 fp=#0x10000003d30' 2024-08-31T04:31:06.648 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14068 fp=#0x30000000c4d' 2024-08-31T04:31:06.649 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14100 fp=#0x30000000c5b' 2024-08-31T04:31:06.649 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14132 fp=#0x3000000179b' 2024-08-31T04:31:06.649 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14164 fp=#0x3000000248d' 2024-08-31T04:31:06.650 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14196 fp=#0x30000002451' 2024-08-31T04:31:06.650 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14228 fp=#0x300000017a7' 2024-08-31T04:31:06.651 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14388 fp=#0x30000000d8f' 2024-08-31T04:31:06.651 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14420 fp=#0x30000000d9c' 2024-08-31T04:31:06.652 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14452 fp=#0x30000000d30' 2024-08-31T04:31:06.652 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14484 fp=#0x30000000cb3' 2024-08-31T04:31:06.652 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14516 fp=#0x300000023a5' 2024-08-31T04:31:06.652 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14548 fp=#0x30000000d49' 2024-08-31T04:31:06.653 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14580 fp=#0x30000000d7e' 2024-08-31T04:31:06.653 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14612 fp=#0x1000000243f' 2024-08-31T04:31:06.653 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14644 fp=#0x10000002427' 2024-08-31T04:31:06.654 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14676 fp=#0x1000000244f' 2024-08-31T04:31:06.654 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14708 fp=#0x30000002f9c' 2024-08-31T04:31:06.654 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14740 fp=#0x30000002f9d' 2024-08-31T04:31:06.655 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14772 fp=#0x30000002fd9' 2024-08-31T04:31:06.655 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14803 fp=#0x10000003bc9' 2024-08-31T04:31:06.655 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14835 fp=#0x30000000a28' 2024-08-31T04:31:06.655 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14867 fp=#0x300000009d6' 2024-08-31T04:31:06.656 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14899 fp=#0x300000009e4' 2024-08-31T04:31:06.656 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14931 fp=#0x30000000a33' 2024-08-31T04:31:06.656 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14963 fp=#0x30000000a2b' 2024-08-31T04:31:06.657 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14995 fp=#0x300000015a5' 2024-08-31T04:31:06.657 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15027 fp=#0x300000015f6' 2024-08-31T04:31:06.657 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15059 fp=#0x30000001519' 2024-08-31T04:31:06.658 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15091 fp=#0x300000014b8' 2024-08-31T04:31:06.658 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15123 fp=#0x30000003384' 2024-08-31T04:31:06.658 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15155 fp=#0x30000003440' 2024-08-31T04:31:06.659 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15187 fp=#0x30000003419' 2024-08-31T04:31:06.659 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15219 fp=#0x30000002e7a' 2024-08-31T04:31:06.659 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15251 fp=#0x30000002ef1' 2024-08-31T04:31:06.659 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15283 fp=#0x30000002edd' 2024-08-31T04:31:06.660 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15315 fp=#0x30000002e70' 2024-08-31T04:31:06.660 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15347 fp=#0x30000002e5d' 2024-08-31T04:31:06.660 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15379 fp=#0x300000032d0' 2024-08-31T04:31:06.661 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15411 fp=#0x300000032ce' 2024-08-31T04:31:06.661 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15443 fp=#0x30000000ee9' 2024-08-31T04:31:06.661 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15475 fp=#0x30000000edb' 2024-08-31T04:31:06.662 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15507 fp=#0x30000001dc9' 2024-08-31T04:31:06.662 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15539 fp=#0x30000000ece' 2024-08-31T04:31:06.662 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15571 fp=#0x30000000f16' 2024-08-31T04:31:06.663 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15731 fp=#0x30000000526' 2024-08-31T04:31:06.664 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15763 fp=#0x30000000563' 2024-08-31T04:31:06.664 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15826 fp=#0x300000014be' 2024-08-31T04:31:06.664 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15858 fp=#0x30000001281' 2024-08-31T04:31:06.665 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15890 fp=#0x300000012ec' 2024-08-31T04:31:06.665 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15922 fp=#0x300000012fa' 2024-08-31T04:31:06.665 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15954 fp=#0x3000000128e' 2024-08-31T04:31:06.666 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15986 fp=#0x30000001289' 2024-08-31T04:31:06.666 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16018 fp=#0x3000000104c' 2024-08-31T04:31:06.666 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16050 fp=#0x30000001031' 2024-08-31T04:31:06.667 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16082 fp=#0x30000001824' 2024-08-31T04:31:06.667 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16114 fp=#0x3000000182a' 2024-08-31T04:31:06.667 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16146 fp=#0x300000034f0' 2024-08-31T04:31:06.667 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16178 fp=#0x3000000342c' 2024-08-31T04:31:06.668 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16210 fp=#0x300000033f3' 2024-08-31T04:31:06.668 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16242 fp=#0x300000034bb' 2024-08-31T04:31:06.673 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16335 fp=#0x300000020b1' 2024-08-31T04:31:06.673 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16367 fp=#0x3000000208a' 2024-08-31T04:31:06.673 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16399 fp=#0x3000000022d' 2024-08-31T04:31:06.674 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16431 fp=#0x1000000250e' 2024-08-31T04:31:06.674 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16463 fp=#0x30000001d0f' 2024-08-31T04:31:06.674 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16495 fp=#0x30000001cde' 2024-08-31T04:31:06.675 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16527 fp=#0x30000001d46' 2024-08-31T04:31:06.675 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16559 fp=#0x30000000257' 2024-08-31T04:31:06.675 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16591 fp=#0x30000001cf3' 2024-08-31T04:31:06.676 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16623 fp=#0x30000001d16' 2024-08-31T04:31:06.676 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16654 fp=#0x300000020f5' 2024-08-31T04:31:06.676 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16686 fp=#0x3000000211a' 2024-08-31T04:31:06.676 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16718 fp=#0x300000020f3' 2024-08-31T04:31:06.677 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16750 fp=#0x3000000262d' 2024-08-31T04:31:06.677 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16782 fp=#0x30000001968' 2024-08-31T04:31:06.677 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16814 fp=#0x3000000197c' 2024-08-31T04:31:06.678 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16846 fp=#0x3000000194a' 2024-08-31T04:31:06.678 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16878 fp=#0x30000002436' 2024-08-31T04:31:06.679 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16941 fp=#0x30000002b58' 2024-08-31T04:31:06.679 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16973 fp=#0x30000001afc' 2024-08-31T04:31:06.679 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17005 fp=#0x30000002b6a' 2024-08-31T04:31:06.679 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17030 fp=#0x1000000370b' 2024-08-31T04:31:06.680 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17062 fp=#0x100000036c8' 2024-08-31T04:31:06.680 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17094 fp=#0x100000036b6' 2024-08-31T04:31:06.680 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17126 fp=#0x100000036a8' 2024-08-31T04:31:06.681 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17158 fp=#0x3000000180e' 2024-08-31T04:31:06.681 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17190 fp=#0x300000017f9' 2024-08-31T04:31:06.681 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17222 fp=#0x3000000172a' 2024-08-31T04:31:06.682 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17254 fp=#0x300000017ef' 2024-08-31T04:31:06.682 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17286 fp=#0x300000017fa' 2024-08-31T04:31:06.682 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17318 fp=#0x30000002cca' 2024-08-31T04:31:06.683 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17350 fp=#0x300000032f9' 2024-08-31T04:31:06.684 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17542 fp=#0x300000031dd' 2024-08-31T04:31:06.684 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17574 fp=#0x300000031a7' 2024-08-31T04:31:06.685 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17606 fp=#0x30000000dc1' 2024-08-31T04:31:06.685 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17638 fp=#0x30000000daf' 2024-08-31T04:31:06.685 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17670 fp=#0x300000031c5' 2024-08-31T04:31:06.686 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17798 fp=#0x30000002477' 2024-08-31T04:31:06.687 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17830 fp=#0x3000000204f' 2024-08-31T04:31:06.687 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17862 fp=#0x30000001ffc' 2024-08-31T04:31:06.687 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17894 fp=#0x30000001ff7' 2024-08-31T04:31:06.687 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17926 fp=#0x3000000315b' 2024-08-31T04:31:06.688 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17958 fp=#0x300000030d1' 2024-08-31T04:31:06.688 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17990 fp=#0x30000003144' 2024-08-31T04:31:06.688 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18022 fp=#0x30000001c2b' 2024-08-31T04:31:06.689 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18054 fp=#0x30000001c3d' 2024-08-31T04:31:06.689 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18086 fp=#0x30000001bfb' 2024-08-31T04:31:06.690 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18118 fp=#0x30000002539' 2024-08-31T04:31:06.690 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18150 fp=#0x30000002579' 2024-08-31T04:31:06.690 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18182 fp=#0x3000000253a' 2024-08-31T04:31:06.690 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18214 fp=#0x30000002520' 2024-08-31T04:31:06.691 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18246 fp=#0x3000000286e' 2024-08-31T04:31:06.691 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18278 fp=#0x3000000280b' 2024-08-31T04:31:06.691 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18310 fp=#0x300000027cd' 2024-08-31T04:31:06.692 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18342 fp=#0x30000002830' 2024-08-31T04:31:06.692 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18374 fp=#0x300000027b4' 2024-08-31T04:31:06.692 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18406 fp=#0x30000003028' 2024-08-31T04:31:06.692 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18438 fp=#0x30000003012' 2024-08-31T04:31:06.693 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18470 fp=#0x30000003009' 2024-08-31T04:31:06.693 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18502 fp=#0x30000002f1a' 2024-08-31T04:31:06.693 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18534 fp=#0x30000003023' 2024-08-31T04:31:06.694 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18566 fp=#0x10000001cf2' 2024-08-31T04:31:06.694 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18630 fp=#0x10000001d02' 2024-08-31T04:31:06.695 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18662 fp=#0x10000001cfc' 2024-08-31T04:31:06.695 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18694 fp=#0x30000001349' 2024-08-31T04:31:06.695 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18726 fp=#0x3000000135b' 2024-08-31T04:31:06.695 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18758 fp=#0x3000000138e' 2024-08-31T04:31:06.696 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18790 fp=#0x300000013c7' 2024-08-31T04:31:06.696 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18822 fp=#0x30000001392' 2024-08-31T04:31:06.696 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18854 fp=#0x30000001387' 2024-08-31T04:31:06.697 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18886 fp=#0x3000000110b' 2024-08-31T04:31:06.697 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18918 fp=#0x30000001d86' 2024-08-31T04:31:06.697 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18950 fp=#0x3000000109d' 2024-08-31T04:31:06.698 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18982 fp=#0x300000010c8' 2024-08-31T04:31:06.698 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19014 fp=#0x3000000105e' 2024-08-31T04:31:06.698 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19046 fp=#0x300000011db' 2024-08-31T04:31:06.699 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19078 fp=#0x300000011f5' 2024-08-31T04:31:06.699 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19110 fp=#0x30000001198' 2024-08-31T04:31:06.699 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19142 fp=#0x30000001cfc' 2024-08-31T04:31:06.699 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19174 fp=#0x300000015e3' 2024-08-31T04:31:06.700 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19238 fp=#0x30000001676' 2024-08-31T04:31:06.700 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19270 fp=#0x100000008e7' 2024-08-31T04:31:06.701 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19302 fp=#0x100000008d8' 2024-08-31T04:31:06.701 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19334 fp=#0x30000002bda' 2024-08-31T04:31:06.701 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19366 fp=#0x30000002ba3' 2024-08-31T04:31:06.702 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19398 fp=#0x30000002ba8' 2024-08-31T04:31:06.702 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19429 fp=#0x30000000bd1' 2024-08-31T04:31:06.702 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19461 fp=#0x30000000bab' 2024-08-31T04:31:06.703 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19493 fp=#0x30000000b82' 2024-08-31T04:31:06.703 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19525 fp=#0x30000000b89' 2024-08-31T04:31:06.703 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19557 fp=#0x30000000a88' 2024-08-31T04:31:06.704 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19589 fp=#0x30000000a92' 2024-08-31T04:31:06.704 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19621 fp=#0x30000000b2d' 2024-08-31T04:31:06.704 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19653 fp=#0x30000002de6' 2024-08-31T04:31:06.705 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19685 fp=#0x30000002d1d' 2024-08-31T04:31:06.705 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19717 fp=#0x30000002de5' 2024-08-31T04:31:06.705 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19749 fp=#0x30000002c1c' 2024-08-31T04:31:06.705 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19781 fp=#0x30000002cf6' 2024-08-31T04:31:06.706 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19813 fp=#0x300000011eb' 2024-08-31T04:31:06.706 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19845 fp=#0x30000001449' 2024-08-31T04:31:06.706 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19877 fp=#0x30000001151' 2024-08-31T04:31:06.707 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19909 fp=#0x300000011ac' 2024-08-31T04:31:06.707 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19941 fp=#0x30000002f6c' 2024-08-31T04:31:06.707 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19973 fp=#0x3000000141f' 2024-08-31T04:31:06.708 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20005 fp=#0x300000013f1' 2024-08-31T04:31:06.708 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20037 fp=#0x30000000ffa' 2024-08-31T04:31:06.708 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20069 fp=#0x30000000fe4' 2024-08-31T04:31:06.708 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20101 fp=#0x30000000fc3' 2024-08-31T04:31:06.709 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20133 fp=#0x300000016db' 2024-08-31T04:31:06.709 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20165 fp=#0x300000016da' 2024-08-31T04:31:06.710 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20197 fp=#0x300000016d3' 2024-08-31T04:31:06.710 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20229 fp=#0x3000000315f' 2024-08-31T04:31:06.710 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20261 fp=#0x30000003247' 2024-08-31T04:31:06.710 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20293 fp=#0x30000003129' 2024-08-31T04:31:06.711 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20325 fp=#0x30000003237' 2024-08-31T04:31:06.711 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20357 fp=#0x300000030a6' 2024-08-31T04:31:06.711 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20389 fp=#0x30000001c88' 2024-08-31T04:31:06.712 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20421 fp=#0x30000001c64' 2024-08-31T04:31:06.712 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20453 fp=#0x30000001ccb' 2024-08-31T04:31:06.712 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20485 fp=#0x30000001c71' 2024-08-31T04:31:06.713 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20517 fp=#0x3000000121c' 2024-08-31T04:31:06.713 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20549 fp=#0x3000000121f' 2024-08-31T04:31:06.713 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20581 fp=#0x3000000123d' 2024-08-31T04:31:06.713 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20613 fp=#0x300000021c1' 2024-08-31T04:31:06.714 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20677 fp=#0x300000021bc' 2024-08-31T04:31:06.715 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20773 fp=#0x300000030a8' 2024-08-31T04:31:06.715 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20805 fp=#0x30000003094' 2024-08-31T04:31:06.716 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20901 fp=#0x10000003748' 2024-08-31T04:31:06.716 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20933 fp=#0x300000030a5' 2024-08-31T04:31:06.716 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20965 fp=#0x300000027ab' 2024-08-31T04:31:06.717 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20997 fp=#0x300000020d8' 2024-08-31T04:31:06.717 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21028 fp=#0x30000001589' 2024-08-31T04:31:06.717 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21060 fp=#0x3000000161c' 2024-08-31T04:31:06.718 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21092 fp=#0x30000001537' 2024-08-31T04:31:06.718 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21124 fp=#0x30000001662' 2024-08-31T04:31:06.718 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21188 fp=#0x30000002c52' 2024-08-31T04:31:06.719 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21316 fp=#0x1000000327d' 2024-08-31T04:31:06.720 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21348 fp=#0x1000000327a' 2024-08-31T04:31:06.720 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21380 fp=#0x100000032e1' 2024-08-31T04:31:06.720 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21412 fp=#0x1000000326b' 2024-08-31T04:31:06.721 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21444 fp=#0x1000000329e' 2024-08-31T04:31:06.721 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21476 fp=#0x30000002725' 2024-08-31T04:31:06.721 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21508 fp=#0x30000002685' 2024-08-31T04:31:06.722 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21540 fp=#0x30000002664' 2024-08-31T04:31:06.722 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21572 fp=#0x300000025fd' 2024-08-31T04:31:06.722 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21604 fp=#0x30000000d4c' 2024-08-31T04:31:06.723 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21636 fp=#0x300000036a1' 2024-08-31T04:31:06.723 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21668 fp=#0x300000036ff' 2024-08-31T04:31:06.723 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21700 fp=#0x30000000cdd' 2024-08-31T04:31:06.724 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21732 fp=#0x30000000d31' 2024-08-31T04:31:06.724 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21764 fp=#0x30000000b3e' 2024-08-31T04:31:06.724 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21796 fp=#0x30000000b2a' 2024-08-31T04:31:06.725 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21828 fp=#0x30000000aa4' 2024-08-31T04:31:06.725 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21860 fp=#0x30000000b0a' 2024-08-31T04:31:06.725 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21892 fp=#0x30000000521' 2024-08-31T04:31:06.726 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21924 fp=#0x30000000567' 2024-08-31T04:31:06.726 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21956 fp=#0x30000000529' 2024-08-31T04:31:06.726 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21988 fp=#0x30000000542' 2024-08-31T04:31:06.727 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22019 fp=#0x300000018f8' 2024-08-31T04:31:06.727 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22051 fp=#0x30000002f79' 2024-08-31T04:31:06.727 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22083 fp=#0x30000001919' 2024-08-31T04:31:06.727 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22115 fp=#0x30000001936' 2024-08-31T04:31:06.728 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22147 fp=#0x30000002973' 2024-08-31T04:31:06.728 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22179 fp=#0x3000000293a' 2024-08-31T04:31:06.728 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22211 fp=#0x300000028e2' 2024-08-31T04:31:06.729 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22243 fp=#0x30000002902' 2024-08-31T04:31:06.729 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22275 fp=#0x3000000202d' 2024-08-31T04:31:06.729 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22307 fp=#0x3000000205b' 2024-08-31T04:31:06.730 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22339 fp=#0x3000000202b' 2024-08-31T04:31:06.730 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22371 fp=#0x3000000205d' 2024-08-31T04:31:06.730 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22403 fp=#0x30000000498' 2024-08-31T04:31:06.731 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22499 fp=#0x30000000417' 2024-08-31T04:31:06.731 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22524 fp=#0x30000002c49' 2024-08-31T04:31:06.732 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22556 fp=#0x30000002bd4' 2024-08-31T04:31:06.732 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22587 fp=#0x1000000104b' 2024-08-31T04:31:06.732 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22619 fp=#0x3000000146f' 2024-08-31T04:31:06.733 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22651 fp=#0x3000000147a' 2024-08-31T04:31:06.733 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22683 fp=#0x10000000ffc' 2024-08-31T04:31:06.733 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22713 fp=#0x40000000f97' 2024-08-31T04:31:06.734 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:9813 fp=#0x3000000130f' 2024-08-31T04:31:06.735 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:9941 fp=#0x100000011a5' 2024-08-31T04:31:06.738 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:10389 fp=#0x30000001cd1' 2024-08-31T04:31:06.741 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:10773 fp=#0x30000001840' 2024-08-31T04:31:06.741 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:10805 fp=#0x30000000a84' 2024-08-31T04:31:06.748 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:11765 fp=#0x30000000c42' 2024-08-31T04:31:06.748 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:11797 fp=#0x300000023b9' 2024-08-31T04:31:06.749 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:11861 fp=#0x30000000bc2' 2024-08-31T04:31:06.749 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:11893 fp=#0x30000000bdf' 2024-08-31T04:31:06.750 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:11925 fp=#0x30000001199' 2024-08-31T04:31:06.750 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:11989 fp=#0x3000000100d' 2024-08-31T04:31:06.751 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12053 fp=#0x3000000111b' 2024-08-31T04:31:06.751 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12149 fp=#0x30000001005' 2024-08-31T04:31:06.752 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12245 fp=#0x300000009eb' 2024-08-31T04:31:06.752 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12277 fp=#0x3000000091f' 2024-08-31T04:31:06.753 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12341 fp=#0x30000000956' 2024-08-31T04:31:06.753 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12373 fp=#0x300000009c2' 2024-08-31T04:31:06.754 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12405 fp=#0x30000002e42' 2024-08-31T04:31:06.754 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12437 fp=#0x30000002e1a' 2024-08-31T04:31:06.754 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12469 fp=#0x30000002e09' 2024-08-31T04:31:06.755 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12501 fp=#0x30000000f71' 2024-08-31T04:31:06.755 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12533 fp=#0x30000002ebb' 2024-08-31T04:31:06.755 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12565 fp=#0x30000000f59' 2024-08-31T04:31:06.755 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12597 fp=#0x30000000e85' 2024-08-31T04:31:06.756 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12629 fp=#0x30000000eaf' 2024-08-31T04:31:06.756 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12661 fp=#0x30000000e41' 2024-08-31T04:31:06.756 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12693 fp=#0x300000033c6' 2024-08-31T04:31:06.757 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12725 fp=#0x3000000228e' 2024-08-31T04:31:06.757 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12757 fp=#0x30000000e43' 2024-08-31T04:31:06.757 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12789 fp=#0x30000003385' 2024-08-31T04:31:06.758 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12821 fp=#0x30000003357' 2024-08-31T04:31:06.758 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12853 fp=#0x100000041eb' 2024-08-31T04:31:06.758 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12885 fp=#0x30000000866' 2024-08-31T04:31:06.758 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12917 fp=#0x30000002807' 2024-08-31T04:31:06.759 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12949 fp=#0x30000002838' 2024-08-31T04:31:06.759 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12981 fp=#0x30000002844' 2024-08-31T04:31:06.759 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13013 fp=#0x100000043a9' 2024-08-31T04:31:06.760 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13045 fp=#0x100000043f6' 2024-08-31T04:31:06.760 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13077 fp=#0x3000000282f' 2024-08-31T04:31:06.760 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13109 fp=#0x3000000309d' 2024-08-31T04:31:06.761 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13141 fp=#0x3000000310b' 2024-08-31T04:31:06.761 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13173 fp=#0x30000003140' 2024-08-31T04:31:06.761 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13237 fp=#0x300000006f4' 2024-08-31T04:31:06.762 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13301 fp=#0x300000008cd' 2024-08-31T04:31:06.762 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13333 fp=#0x30000002263' 2024-08-31T04:31:06.763 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13365 fp=#0x300000008c1' 2024-08-31T04:31:06.763 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13397 fp=#0x3000000095d' 2024-08-31T04:31:06.763 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13429 fp=#0x300000008df' 2024-08-31T04:31:06.763 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13461 fp=#0x300000008d6' 2024-08-31T04:31:06.764 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13493 fp=#0x300000021fb' 2024-08-31T04:31:06.764 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13525 fp=#0x300000008ba' 2024-08-31T04:31:06.764 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13557 fp=#0x3000000328e' 2024-08-31T04:31:06.765 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13589 fp=#0x3000000330e' 2024-08-31T04:31:06.765 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13621 fp=#0x30000003293' 2024-08-31T04:31:06.765 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13653 fp=#0x300000032a8' 2024-08-31T04:31:06.766 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13685 fp=#0x30000002914' 2024-08-31T04:31:06.766 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13717 fp=#0x300000029f2' 2024-08-31T04:31:06.766 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13749 fp=#0x3000000292f' 2024-08-31T04:31:06.767 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13781 fp=#0x3000000298b' 2024-08-31T04:31:06.767 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13813 fp=#0x300000029a7' 2024-08-31T04:31:06.767 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13845 fp=#0x3000000296e' 2024-08-31T04:31:06.767 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13877 fp=#0x10000003bbd' 2024-08-31T04:31:06.768 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13909 fp=#0x10000003ef8' 2024-08-31T04:31:06.768 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13973 fp=#0x10000003b9c' 2024-08-31T04:31:06.769 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14005 fp=#0x10000003da0' 2024-08-31T04:31:06.769 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14069 fp=#0x30000000c5d' 2024-08-31T04:31:06.769 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14101 fp=#0x30000000c4b' 2024-08-31T04:31:06.770 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14133 fp=#0x3000000247d' 2024-08-31T04:31:06.770 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14165 fp=#0x30000001787' 2024-08-31T04:31:06.770 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14197 fp=#0x3000000174c' 2024-08-31T04:31:06.771 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14229 fp=#0x30000002447' 2024-08-31T04:31:06.772 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14389 fp=#0x30000000cc1' 2024-08-31T04:31:06.772 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14421 fp=#0x30000000ca5' 2024-08-31T04:31:06.773 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14453 fp=#0x30000000d86' 2024-08-31T04:31:06.773 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14485 fp=#0x30000000cbd' 2024-08-31T04:31:06.773 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14517 fp=#0x30000000d8a' 2024-08-31T04:31:06.774 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14549 fp=#0x30000000d8c' 2024-08-31T04:31:06.774 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14581 fp=#0x30000000d67' 2024-08-31T04:31:06.774 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14613 fp=#0x10000002437' 2024-08-31T04:31:06.775 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14645 fp=#0x100000023e9' 2024-08-31T04:31:06.775 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14677 fp=#0x10000002496' 2024-08-31T04:31:06.775 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14709 fp=#0x10000002465' 2024-08-31T04:31:06.775 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14741 fp=#0x30000002f8b' 2024-08-31T04:31:06.776 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14773 fp=#0x30000002fca' 2024-08-31T04:31:06.776 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14804 fp=#0x10000003ba4' 2024-08-31T04:31:06.776 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14836 fp=#0x30000000930' 2024-08-31T04:31:06.777 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14868 fp=#0x30000000a07' 2024-08-31T04:31:06.777 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14900 fp=#0x300000009fc' 2024-08-31T04:31:06.777 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14932 fp=#0x300000009ff' 2024-08-31T04:31:06.778 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14964 fp=#0x300000009c7' 2024-08-31T04:31:06.778 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14996 fp=#0x3000000151f' 2024-08-31T04:31:06.778 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15028 fp=#0x30000001684' 2024-08-31T04:31:06.779 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15060 fp=#0x30000001517' 2024-08-31T04:31:06.779 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15092 fp=#0x30000001532' 2024-08-31T04:31:06.779 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15124 fp=#0x3000000343d' 2024-08-31T04:31:06.780 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15156 fp=#0x300000033df' 2024-08-31T04:31:06.780 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15188 fp=#0x300000033f5' 2024-08-31T04:31:06.780 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15220 fp=#0x30000002e61' 2024-08-31T04:31:06.780 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15252 fp=#0x30000002e62' 2024-08-31T04:31:06.781 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15284 fp=#0x30000002ed2' 2024-08-31T04:31:06.781 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15316 fp=#0x30000002e90' 2024-08-31T04:31:06.781 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15348 fp=#0x30000002e80' 2024-08-31T04:31:06.782 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15380 fp=#0x300000032db' 2024-08-31T04:31:06.782 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15412 fp=#0x300000032dc' 2024-08-31T04:31:06.782 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15444 fp=#0x30000000ebc' 2024-08-31T04:31:06.783 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15476 fp=#0x30000001dcf' 2024-08-31T04:31:06.783 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15508 fp=#0x30000000f3a' 2024-08-31T04:31:06.783 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15540 fp=#0x30000000f2e' 2024-08-31T04:31:06.784 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15572 fp=#0x30000001dc6' 2024-08-31T04:31:06.784 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15604 fp=#0x300000005db' 2024-08-31T04:31:06.784 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15668 fp=#0x30000000527' 2024-08-31T04:31:06.785 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15764 fp=#0x300000004ff' 2024-08-31T04:31:06.786 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15827 fp=#0x3000000128c' 2024-08-31T04:31:06.786 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15859 fp=#0x3000000127e' 2024-08-31T04:31:06.786 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15891 fp=#0x3000000127c' 2024-08-31T04:31:06.787 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15923 fp=#0x300000012c1' 2024-08-31T04:31:06.787 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15955 fp=#0x300000012d8' 2024-08-31T04:31:06.787 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15987 fp=#0x300000012d7' 2024-08-31T04:31:06.787 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16019 fp=#0x300000010a1' 2024-08-31T04:31:06.788 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16051 fp=#0x30000001002' 2024-08-31T04:31:06.788 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16083 fp=#0x3000000181b' 2024-08-31T04:31:06.788 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16115 fp=#0x30000001826' 2024-08-31T04:31:06.789 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16179 fp=#0x300000034a0' 2024-08-31T04:31:06.789 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16243 fp=#0x300000033ef' 2024-08-31T04:31:06.790 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16336 fp=#0x3000000209a' 2024-08-31T04:31:06.791 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16368 fp=#0x300000020bc' 2024-08-31T04:31:06.791 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16400 fp=#0x300000020ca' 2024-08-31T04:31:06.791 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16432 fp=#0x30000001d4a' 2024-08-31T04:31:06.791 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16464 fp=#0x100000024bc' 2024-08-31T04:31:06.792 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16496 fp=#0x30000001d2b' 2024-08-31T04:31:06.792 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16528 fp=#0x100000024c9' 2024-08-31T04:31:06.792 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16560 fp=#0x30000001d0e' 2024-08-31T04:31:06.793 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16592 fp=#0x30000001d2f' 2024-08-31T04:31:06.793 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16655 fp=#0x30000002165' 2024-08-31T04:31:06.793 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16687 fp=#0x3000000211f' 2024-08-31T04:31:06.794 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16719 fp=#0x300000027a7' 2024-08-31T04:31:06.794 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16751 fp=#0x300000003e1' 2024-08-31T04:31:06.794 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16783 fp=#0x30000001a37' 2024-08-31T04:31:06.795 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16815 fp=#0x300000019fb' 2024-08-31T04:31:06.795 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16879 fp=#0x30000001a2c' 2024-08-31T04:31:06.796 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16942 fp=#0x30000002b9c' 2024-08-31T04:31:06.796 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16974 fp=#0x30000001adc' 2024-08-31T04:31:06.796 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17006 fp=#0x30000001a82' 2024-08-31T04:31:06.796 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17031 fp=#0x10000003680' 2024-08-31T04:31:06.797 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17063 fp=#0x100000036db' 2024-08-31T04:31:06.797 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17095 fp=#0x10000003701' 2024-08-31T04:31:06.797 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17127 fp=#0x100000036d3' 2024-08-31T04:31:06.798 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17159 fp=#0x30000001817' 2024-08-31T04:31:06.798 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17191 fp=#0x30000001739' 2024-08-31T04:31:06.798 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17223 fp=#0x30000002cc3' 2024-08-31T04:31:06.799 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17255 fp=#0x30000001723' 2024-08-31T04:31:06.799 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17287 fp=#0x30000001725' 2024-08-31T04:31:06.799 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17319 fp=#0x3000000170d' 2024-08-31T04:31:06.799 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17351 fp=#0x30000003303' 2024-08-31T04:31:06.801 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17543 fp=#0x300000031a3' 2024-08-31T04:31:06.801 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17575 fp=#0x3000000319f' 2024-08-31T04:31:06.802 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17607 fp=#0x3000000322e' 2024-08-31T04:31:06.802 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17639 fp=#0x300000031ee' 2024-08-31T04:31:06.802 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17671 fp=#0x300000031d2' 2024-08-31T04:31:06.803 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17799 fp=#0x3000000282c' 2024-08-31T04:31:06.803 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17831 fp=#0x30000002020' 2024-08-31T04:31:06.804 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17863 fp=#0x30000001f9c' 2024-08-31T04:31:06.804 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17895 fp=#0x30000001fa4' 2024-08-31T04:31:06.804 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17927 fp=#0x30000003157' 2024-08-31T04:31:06.805 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17959 fp=#0x30000003154' 2024-08-31T04:31:06.805 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17991 fp=#0x3000000308f' 2024-08-31T04:31:06.805 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18023 fp=#0x30000001be2' 2024-08-31T04:31:06.806 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18055 fp=#0x30000001c20' 2024-08-31T04:31:06.806 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18087 fp=#0x30000001be5' 2024-08-31T04:31:06.806 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18119 fp=#0x3000000254d' 2024-08-31T04:31:06.807 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18151 fp=#0x30000002526' 2024-08-31T04:31:06.807 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18183 fp=#0x30000002582' 2024-08-31T04:31:06.807 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18215 fp=#0x30000002567' 2024-08-31T04:31:06.808 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18247 fp=#0x300000027ce' 2024-08-31T04:31:06.808 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18279 fp=#0x300000027fe' 2024-08-31T04:31:06.808 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18311 fp=#0x30000002818' 2024-08-31T04:31:06.808 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18343 fp=#0x300000027d1' 2024-08-31T04:31:06.809 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18375 fp=#0x300000027ea' 2024-08-31T04:31:06.809 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18407 fp=#0x30000002f47' 2024-08-31T04:31:06.809 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18439 fp=#0x30000002f43' 2024-08-31T04:31:06.810 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18471 fp=#0x30000002fe2' 2024-08-31T04:31:06.810 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18503 fp=#0x30000002f36' 2024-08-31T04:31:06.810 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18535 fp=#0x3000000301e' 2024-08-31T04:31:06.811 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18599 fp=#0x10000001d5d' 2024-08-31T04:31:06.812 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18695 fp=#0x3000000139a' 2024-08-31T04:31:06.812 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18727 fp=#0x30000002f6f' 2024-08-31T04:31:06.812 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18759 fp=#0x3000000139f' 2024-08-31T04:31:06.812 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18791 fp=#0x300000013a7' 2024-08-31T04:31:06.813 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18823 fp=#0x300000014fc' 2024-08-31T04:31:06.813 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18855 fp=#0x300000014d0' 2024-08-31T04:31:06.813 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18887 fp=#0x3000000105b' 2024-08-31T04:31:06.814 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18919 fp=#0x30000001d85' 2024-08-31T04:31:06.814 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18951 fp=#0x30000001d68' 2024-08-31T04:31:06.814 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18983 fp=#0x30000001d5e' 2024-08-31T04:31:06.815 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19015 fp=#0x300000010f0' 2024-08-31T04:31:06.815 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19047 fp=#0x30000001130' 2024-08-31T04:31:06.815 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19079 fp=#0x30000001123' 2024-08-31T04:31:06.816 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19111 fp=#0x300000011a4' 2024-08-31T04:31:06.816 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19143 fp=#0x3000000113f' 2024-08-31T04:31:06.816 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19175 fp=#0x30000001652' 2024-08-31T04:31:06.817 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19207 fp=#0x30000001594' 2024-08-31T04:31:06.817 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19239 fp=#0x30000001650' 2024-08-31T04:31:06.817 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19271 fp=#0x30000001503' 2024-08-31T04:31:06.818 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19303 fp=#0x30000002ba0' 2024-08-31T04:31:06.818 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19335 fp=#0x30000001534' 2024-08-31T04:31:06.818 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19367 fp=#0x300000014c3' 2024-08-31T04:31:06.819 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19399 fp=#0x30000002ba2' 2024-08-31T04:31:06.819 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19430 fp=#0x30000000b54' 2024-08-31T04:31:06.819 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19462 fp=#0x30000000bc5' 2024-08-31T04:31:06.819 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19494 fp=#0x30000000b65' 2024-08-31T04:31:06.820 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19526 fp=#0x30000000bcd' 2024-08-31T04:31:06.820 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19558 fp=#0x30000000b1e' 2024-08-31T04:31:06.820 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19590 fp=#0x30000000aa1' 2024-08-31T04:31:06.821 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19622 fp=#0x30000000aec' 2024-08-31T04:31:06.821 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19654 fp=#0x30000002d73' 2024-08-31T04:31:06.821 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19686 fp=#0x30000002d8c' 2024-08-31T04:31:06.822 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19718 fp=#0x30000002d54' 2024-08-31T04:31:06.822 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19750 fp=#0x30000002d41' 2024-08-31T04:31:06.822 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19782 fp=#0x30000002d71' 2024-08-31T04:31:06.823 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19814 fp=#0x300000011c3' 2024-08-31T04:31:06.823 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19846 fp=#0x30000001452' 2024-08-31T04:31:06.823 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19878 fp=#0x30000001464' 2024-08-31T04:31:06.823 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19910 fp=#0x300000011f2' 2024-08-31T04:31:06.824 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19942 fp=#0x3000000145f' 2024-08-31T04:31:06.824 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19974 fp=#0x30000001436' 2024-08-31T04:31:06.824 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20006 fp=#0x3000000140d' 2024-08-31T04:31:06.825 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20038 fp=#0x30000000ffe' 2024-08-31T04:31:06.825 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20070 fp=#0x30000000fa4' 2024-08-31T04:31:06.825 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20102 fp=#0x30000000fb6' 2024-08-31T04:31:06.826 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20134 fp=#0x30000001722' 2024-08-31T04:31:06.826 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20166 fp=#0x300000016d6' 2024-08-31T04:31:06.826 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20198 fp=#0x300000016e0' 2024-08-31T04:31:06.826 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20230 fp=#0x30000003241' 2024-08-31T04:31:06.827 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20262 fp=#0x30000003056' 2024-08-31T04:31:06.827 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20294 fp=#0x30000003265' 2024-08-31T04:31:06.827 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20326 fp=#0x30000003175' 2024-08-31T04:31:06.828 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20358 fp=#0x30000003066' 2024-08-31T04:31:06.828 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20390 fp=#0x30000001c70' 2024-08-31T04:31:06.828 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20422 fp=#0x30000001c6f' 2024-08-31T04:31:06.829 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20454 fp=#0x30000001c87' 2024-08-31T04:31:06.829 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20486 fp=#0x30000001cd0' 2024-08-31T04:31:06.829 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20518 fp=#0x30000001238' 2024-08-31T04:31:06.830 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20550 fp=#0x30000001217' 2024-08-31T04:31:06.830 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20582 fp=#0x30000001246' 2024-08-31T04:31:06.831 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20678 fp=#0x300000021ad' 2024-08-31T04:31:06.831 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20742 fp=#0x30000002182' 2024-08-31T04:31:06.832 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20806 fp=#0x10000003824' 2024-08-31T04:31:06.832 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20902 fp=#0x10000003851' 2024-08-31T04:31:06.833 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20934 fp=#0x3000000308c' 2024-08-31T04:31:06.833 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20966 fp=#0x300000020be' 2024-08-31T04:31:06.833 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20998 fp=#0x300000020c9' 2024-08-31T04:31:06.834 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21029 fp=#0x30000001637' 2024-08-31T04:31:06.834 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21061 fp=#0x30000001636' 2024-08-31T04:31:06.834 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21093 fp=#0x300000015eb' 2024-08-31T04:31:06.835 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21125 fp=#0x3000000159a' 2024-08-31T04:31:06.836 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21317 fp=#0x10000003388' 2024-08-31T04:31:06.836 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21349 fp=#0x10000003294' 2024-08-31T04:31:06.837 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21381 fp=#0x10000003282' 2024-08-31T04:31:06.837 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21413 fp=#0x10000003214' 2024-08-31T04:31:06.837 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21445 fp=#0x100000032d2' 2024-08-31T04:31:06.838 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21477 fp=#0x3000000307a' 2024-08-31T04:31:06.838 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21509 fp=#0x30000002740' 2024-08-31T04:31:06.838 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21541 fp=#0x3000000272f' 2024-08-31T04:31:06.839 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21573 fp=#0x3000000263b' 2024-08-31T04:31:06.839 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21605 fp=#0x300000036fb' 2024-08-31T04:31:06.839 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21637 fp=#0x30000000d17' 2024-08-31T04:31:06.840 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21669 fp=#0x30000000cbc' 2024-08-31T04:31:06.840 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21701 fp=#0x30000000cd2' 2024-08-31T04:31:06.840 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21733 fp=#0x300000036c5' 2024-08-31T04:31:06.841 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21765 fp=#0x30000000aab' 2024-08-31T04:31:06.841 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21797 fp=#0x30000000b32' 2024-08-31T04:31:06.841 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21829 fp=#0x30000000af5' 2024-08-31T04:31:06.842 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21861 fp=#0x30000000b3a' 2024-08-31T04:31:06.842 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21925 fp=#0x30000000572' 2024-08-31T04:31:06.842 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21957 fp=#0x300000008e8' 2024-08-31T04:31:06.843 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22020 fp=#0x30000001938' 2024-08-31T04:31:06.843 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22052 fp=#0x30000001910' 2024-08-31T04:31:06.844 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22084 fp=#0x3000000191d' 2024-08-31T04:31:06.844 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22116 fp=#0x30000002f7b' 2024-08-31T04:31:06.844 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22148 fp=#0x3000000299a' 2024-08-31T04:31:06.845 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22180 fp=#0x300000028ca' 2024-08-31T04:31:06.845 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22212 fp=#0x300000028cd' 2024-08-31T04:31:06.845 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22244 fp=#0x30000002979' 2024-08-31T04:31:06.846 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22276 fp=#0x30000001fe5' 2024-08-31T04:31:06.846 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22308 fp=#0x30000002047' 2024-08-31T04:31:06.846 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22340 fp=#0x30000002092' 2024-08-31T04:31:06.847 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22372 fp=#0x3000000049d' 2024-08-31T04:31:06.848 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22500 fp=#0x3000000048b' 2024-08-31T04:31:06.848 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22525 fp=#0x30000002be5' 2024-08-31T04:31:06.848 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22557 fp=#0x30000002be2' 2024-08-31T04:31:06.849 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22588 fp=#0x10000001057' 2024-08-31T04:31:06.849 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22620 fp=#0x300000033cb' 2024-08-31T04:31:06.849 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22652 fp=#0x30000001491' 2024-08-31T04:31:06.850 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22684 fp=#0x30000001499' 2024-08-31T04:31:06.850 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:9782 fp=#0x30000001003' 2024-08-31T04:31:06.851 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:9814 fp=#0x10000003b90' 2024-08-31T04:31:06.852 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:9942 fp=#0x30000001525' 2024-08-31T04:31:06.857 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:10678 fp=#0x30000000a79' 2024-08-31T04:31:06.858 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:10806 fp=#0x30000000a75' 2024-08-31T04:31:06.865 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:11798 fp=#0x30000000c2b' 2024-08-31T04:31:06.865 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:11862 fp=#0x30000001c4f' 2024-08-31T04:31:06.866 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:11894 fp=#0x300000023b3' 2024-08-31T04:31:06.866 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:11926 fp=#0x300000031cc' 2024-08-31T04:31:06.866 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:11958 fp=#0x30000001042' 2024-08-31T04:31:06.867 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:11990 fp=#0x300000031d8' 2024-08-31T04:31:06.867 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12022 fp=#0x3000000102a' 2024-08-31T04:31:06.867 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12054 fp=#0x30000003213' 2024-08-31T04:31:06.868 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12086 fp=#0x30000001078' 2024-08-31T04:31:06.868 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12118 fp=#0x30000003210' 2024-08-31T04:31:06.868 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12150 fp=#0x3000000320e' 2024-08-31T04:31:06.870 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12406 fp=#0x30000002e0a' 2024-08-31T04:31:06.871 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12470 fp=#0x30000002e40' 2024-08-31T04:31:06.871 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12502 fp=#0x30000000f85' 2024-08-31T04:31:06.871 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12534 fp=#0x30000000f6d' 2024-08-31T04:31:06.872 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12566 fp=#0x30000000f64' 2024-08-31T04:31:06.872 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12598 fp=#0x30000000ff2' 2024-08-31T04:31:06.872 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12630 fp=#0x30000000ea1' 2024-08-31T04:31:06.873 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12662 fp=#0x30000000e6d' 2024-08-31T04:31:06.873 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12694 fp=#0x30000000e3f' 2024-08-31T04:31:06.873 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12726 fp=#0x30000000e42' 2024-08-31T04:31:06.874 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12758 fp=#0x30000003371' 2024-08-31T04:31:06.875 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12790 fp=#0x3000000335b' 2024-08-31T04:31:06.876 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12822 fp=#0x30000000e5c' 2024-08-31T04:31:06.876 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12854 fp=#0x1000000436a' 2024-08-31T04:31:06.877 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12886 fp=#0x10000004281' 2024-08-31T04:31:06.877 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12918 fp=#0x300000028b1' 2024-08-31T04:31:06.877 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12950 fp=#0x30000002876' 2024-08-31T04:31:06.878 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12982 fp=#0x30000002811' 2024-08-31T04:31:06.878 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13014 fp=#0x3000000282e' 2024-08-31T04:31:06.878 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13046 fp=#0x3000000284f' 2024-08-31T04:31:06.879 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13078 fp=#0x3000000283a' 2024-08-31T04:31:06.879 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13110 fp=#0x3000000311e' 2024-08-31T04:31:06.879 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13142 fp=#0x30000003116' 2024-08-31T04:31:06.879 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13174 fp=#0x3000000315e' 2024-08-31T04:31:06.880 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13302 fp=#0x30000000a4d' 2024-08-31T04:31:06.881 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13334 fp=#0x300000009c4' 2024-08-31T04:31:06.881 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13366 fp=#0x3000000220b' 2024-08-31T04:31:06.881 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13398 fp=#0x30000002219' 2024-08-31T04:31:06.882 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13430 fp=#0x300000008bf' 2024-08-31T04:31:06.882 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13462 fp=#0x30000002238' 2024-08-31T04:31:06.882 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13494 fp=#0x300000008b9' 2024-08-31T04:31:06.883 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13526 fp=#0x300000008bd' 2024-08-31T04:31:06.883 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13558 fp=#0x300000032b2' 2024-08-31T04:31:06.883 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13590 fp=#0x3000000329c' 2024-08-31T04:31:06.884 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13622 fp=#0x3000000330a' 2024-08-31T04:31:06.884 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13654 fp=#0x3000000331a' 2024-08-31T04:31:06.884 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13686 fp=#0x300000028eb' 2024-08-31T04:31:06.885 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13718 fp=#0x300000029b0' 2024-08-31T04:31:06.885 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13750 fp=#0x30000002990' 2024-08-31T04:31:06.885 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13782 fp=#0x30000002910' 2024-08-31T04:31:06.886 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13814 fp=#0x300000029bd' 2024-08-31T04:31:06.886 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13846 fp=#0x30000002a03' 2024-08-31T04:31:06.886 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13878 fp=#0x10000003bad' 2024-08-31T04:31:06.887 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13910 fp=#0x10000003ef7' 2024-08-31T04:31:06.887 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14006 fp=#0x10000003bd9' 2024-08-31T04:31:06.888 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14070 fp=#0x30000000c60' 2024-08-31T04:31:06.888 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14102 fp=#0x30000000c72' 2024-08-31T04:31:06.889 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14134 fp=#0x30000002464' 2024-08-31T04:31:06.889 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14166 fp=#0x300000017c2' 2024-08-31T04:31:06.889 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14198 fp=#0x3000000179d' 2024-08-31T04:31:06.890 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14230 fp=#0x3000000178f' 2024-08-31T04:31:06.891 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14358 fp=#0x30000002380' 2024-08-31T04:31:06.891 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14390 fp=#0x30000002390' 2024-08-31T04:31:06.891 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14422 fp=#0x30000000cab' 2024-08-31T04:31:06.892 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14454 fp=#0x30000000ce8' 2024-08-31T04:31:06.892 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14486 fp=#0x30000002382' 2024-08-31T04:31:06.892 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14518 fp=#0x30000000d3e' 2024-08-31T04:31:06.893 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14550 fp=#0x30000000ce2' 2024-08-31T04:31:06.893 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14582 fp=#0x30000000d55' 2024-08-31T04:31:06.893 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14614 fp=#0x10000002412' 2024-08-31T04:31:06.894 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14646 fp=#0x10000002481' 2024-08-31T04:31:06.894 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14678 fp=#0x30000002fc1' 2024-08-31T04:31:06.894 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14710 fp=#0x30000002fb3' 2024-08-31T04:31:06.895 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14742 fp=#0x100000023f9' 2024-08-31T04:31:06.895 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14774 fp=#0x10000002417' 2024-08-31T04:31:06.895 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14805 fp=#0x10000003bee' 2024-08-31T04:31:06.896 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14837 fp=#0x30000000977' 2024-08-31T04:31:06.896 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14869 fp=#0x30000000923' 2024-08-31T04:31:06.896 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14901 fp=#0x30000000a42' 2024-08-31T04:31:06.897 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14933 fp=#0x30000000937' 2024-08-31T04:31:06.897 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14965 fp=#0x30000000982' 2024-08-31T04:31:06.897 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14997 fp=#0x300000016a9' 2024-08-31T04:31:06.898 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15029 fp=#0x300000014fe' 2024-08-31T04:31:06.898 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15061 fp=#0x300000014c7' 2024-08-31T04:31:06.898 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15093 fp=#0x30000001689' 2024-08-31T04:31:06.899 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15125 fp=#0x30000003406' 2024-08-31T04:31:06.899 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15157 fp=#0x3000000342e' 2024-08-31T04:31:06.899 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15189 fp=#0x30000003408' 2024-08-31T04:31:06.900 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15221 fp=#0x30000002ed3' 2024-08-31T04:31:06.900 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15253 fp=#0x30000002edf' 2024-08-31T04:31:06.900 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15285 fp=#0x30000002ee2' 2024-08-31T04:31:06.901 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15317 fp=#0x30000002f01' 2024-08-31T04:31:06.901 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15349 fp=#0x30000002e83' 2024-08-31T04:31:06.901 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15381 fp=#0x300000032cc' 2024-08-31T04:31:06.902 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15413 fp=#0x300000032be' 2024-08-31T04:31:06.902 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15445 fp=#0x30000000f37' 2024-08-31T04:31:06.902 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15477 fp=#0x30000000ee2' 2024-08-31T04:31:06.902 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15509 fp=#0x30000001d9d' 2024-08-31T04:31:06.903 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15541 fp=#0x30000000f04' 2024-08-31T04:31:06.903 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15573 fp=#0x30000001dbe' 2024-08-31T04:31:06.904 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15637 fp=#0x300000005c8' 2024-08-31T04:31:06.904 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15669 fp=#0x300000004f2' 2024-08-31T04:31:06.905 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15797 fp=#0x300000004e4' 2024-08-31T04:31:06.905 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15828 fp=#0x300000012c5' 2024-08-31T04:31:06.905 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15860 fp=#0x30000001293' 2024-08-31T04:31:06.906 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15892 fp=#0x30000001305' 2024-08-31T04:31:06.906 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15924 fp=#0x300000012a6' 2024-08-31T04:31:06.906 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15956 fp=#0x3000000130d' 2024-08-31T04:31:06.907 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15988 fp=#0x300000012c0' 2024-08-31T04:31:06.907 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16020 fp=#0x3000000105c' 2024-08-31T04:31:06.907 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16052 fp=#0x30000001074' 2024-08-31T04:31:06.908 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16084 fp=#0x3000000182c' 2024-08-31T04:31:06.908 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16116 fp=#0x30000002df8' 2024-08-31T04:31:06.908 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16148 fp=#0x300000034c0' 2024-08-31T04:31:06.908 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16180 fp=#0x30000000637' 2024-08-31T04:31:06.909 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16212 fp=#0x30000003515' 2024-08-31T04:31:06.909 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16244 fp=#0x30000003511' 2024-08-31T04:31:06.909 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16276 fp=#0x300000005d4' 2024-08-31T04:31:06.910 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16308 fp=#0x30000003564' 2024-08-31T04:31:06.910 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16337 fp=#0x30000002075' 2024-08-31T04:31:06.910 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16369 fp=#0x300000020a6' 2024-08-31T04:31:06.911 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16433 fp=#0x100000024cb' 2024-08-31T04:31:06.911 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16465 fp=#0x30000001d12' 2024-08-31T04:31:06.911 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16497 fp=#0x10000002518' 2024-08-31T04:31:06.912 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16529 fp=#0x30000001cbd' 2024-08-31T04:31:06.912 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16561 fp=#0x10000002512' 2024-08-31T04:31:06.912 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16593 fp=#0x30000001d0a' 2024-08-31T04:31:06.913 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16624 fp=#0x30000002119' 2024-08-31T04:31:06.913 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16656 fp=#0x300000022e9' 2024-08-31T04:31:06.913 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16688 fp=#0x30000002138' 2024-08-31T04:31:06.914 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16720 fp=#0x300000022ed' 2024-08-31T04:31:06.914 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16752 fp=#0x30000002638' 2024-08-31T04:31:06.914 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16784 fp=#0x30000001a10' 2024-08-31T04:31:06.915 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16848 fp=#0x30000001949' 2024-08-31T04:31:06.915 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16880 fp=#0x300000019f4' 2024-08-31T04:31:06.915 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16912 fp=#0x30000001a28' 2024-08-31T04:31:06.916 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16943 fp=#0x30000001a71' 2024-08-31T04:31:06.916 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16975 fp=#0x30000002b6e' 2024-08-31T04:31:06.916 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17007 fp=#0x30000001ae2' 2024-08-31T04:31:06.917 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17032 fp=#0x10000003707' 2024-08-31T04:31:06.917 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17064 fp=#0x10000003636' 2024-08-31T04:31:06.917 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17096 fp=#0x1000000364f' 2024-08-31T04:31:06.918 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17128 fp=#0x10000003621' 2024-08-31T04:31:06.918 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17160 fp=#0x30000002cc0' 2024-08-31T04:31:06.918 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17192 fp=#0x300000017e7' 2024-08-31T04:31:06.919 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17224 fp=#0x30000001746' 2024-08-31T04:31:06.919 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17256 fp=#0x300000017dc' 2024-08-31T04:31:06.919 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17288 fp=#0x300000017b7' 2024-08-31T04:31:06.920 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17320 fp=#0x300000017a8' 2024-08-31T04:31:06.920 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17352 fp=#0x30000003337' 2024-08-31T04:31:06.921 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17544 fp=#0x30000000e0b' 2024-08-31T04:31:06.922 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17576 fp=#0x300000031e1' 2024-08-31T04:31:06.922 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17608 fp=#0x30000000e12' 2024-08-31T04:31:06.922 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17640 fp=#0x30000000df6' 2024-08-31T04:31:06.923 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17672 fp=#0x300000031ad' 2024-08-31T04:31:06.924 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17800 fp=#0x30000001f75' 2024-08-31T04:31:06.924 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17832 fp=#0x30000001f83' 2024-08-31T04:31:06.924 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17864 fp=#0x30000001f67' 2024-08-31T04:31:06.925 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17896 fp=#0x30000002034' 2024-08-31T04:31:06.925 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17928 fp=#0x30000003177' 2024-08-31T04:31:06.925 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17960 fp=#0x300000030bb' 2024-08-31T04:31:06.925 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17992 fp=#0x3000000311d' 2024-08-31T04:31:06.926 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18024 fp=#0x30000001c37' 2024-08-31T04:31:06.926 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18056 fp=#0x30000001c03' 2024-08-31T04:31:06.926 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18088 fp=#0x30000001c00' 2024-08-31T04:31:06.927 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18120 fp=#0x30000002549' 2024-08-31T04:31:06.927 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18152 fp=#0x300000025a2' 2024-08-31T04:31:06.927 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18184 fp=#0x30000002560' 2024-08-31T04:31:06.928 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18216 fp=#0x30000002586' 2024-08-31T04:31:06.928 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18248 fp=#0x300000027e6' 2024-08-31T04:31:06.928 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18280 fp=#0x30000002839' 2024-08-31T04:31:06.929 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18312 fp=#0x3000000282a' 2024-08-31T04:31:06.929 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18344 fp=#0x30000002803' 2024-08-31T04:31:06.929 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18376 fp=#0x300000027f0' 2024-08-31T04:31:06.929 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18408 fp=#0x30000002f24' 2024-08-31T04:31:06.930 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18440 fp=#0x30000002ff6' 2024-08-31T04:31:06.930 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18472 fp=#0x30000002fe5' 2024-08-31T04:31:06.930 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18504 fp=#0x30000002f5b' 2024-08-31T04:31:06.931 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18536 fp=#0x30000002f2b' 2024-08-31T04:31:06.931 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18568 fp=#0x10000001d7a' 2024-08-31T04:31:06.931 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18600 fp=#0x10000001cff' 2024-08-31T04:31:06.932 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18632 fp=#0x10000001d4f' 2024-08-31T04:31:06.932 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18664 fp=#0x10000001cf7' 2024-08-31T04:31:06.932 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18696 fp=#0x300000014ed' 2024-08-31T04:31:06.932 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18728 fp=#0x30000001394' 2024-08-31T04:31:06.933 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18760 fp=#0x30000001379' 2024-08-31T04:31:06.933 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18792 fp=#0x3000000138a' 2024-08-31T04:31:06.933 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18824 fp=#0x300000013d5' 2024-08-31T04:31:06.934 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18856 fp=#0x3000000134b' 2024-08-31T04:31:06.934 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18888 fp=#0x300000010f9' 2024-08-31T04:31:06.934 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18920 fp=#0x300000010e8' 2024-08-31T04:31:06.935 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18952 fp=#0x30000001d5a' 2024-08-31T04:31:06.935 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18984 fp=#0x30000001097' 2024-08-31T04:31:06.935 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19016 fp=#0x30000001d7c' 2024-08-31T04:31:06.936 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19048 fp=#0x300000011fe' 2024-08-31T04:31:06.936 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19080 fp=#0x300000011cc' 2024-08-31T04:31:06.936 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19112 fp=#0x3000000116c' 2024-08-31T04:31:06.936 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19144 fp=#0x300000011c0' 2024-08-31T04:31:06.937 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19240 fp=#0x30000001633' 2024-08-31T04:31:06.938 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19272 fp=#0x100000008e2' 2024-08-31T04:31:06.938 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19304 fp=#0x100000008e3' 2024-08-31T04:31:06.938 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19336 fp=#0x30000002a3a' 2024-08-31T04:31:06.938 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19368 fp=#0x1000000089f' 2024-08-31T04:31:06.939 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19400 fp=#0x100000008bd' 2024-08-31T04:31:06.939 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19431 fp=#0x30000001845' 2024-08-31T04:31:06.939 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19463 fp=#0x30000000b7f' 2024-08-31T04:31:06.940 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19495 fp=#0x30000000b8b' 2024-08-31T04:31:06.940 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19527 fp=#0x30000000b64' 2024-08-31T04:31:06.940 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19559 fp=#0x300000036dd' 2024-08-31T04:31:06.941 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19591 fp=#0x30000000aaa' 2024-08-31T04:31:06.941 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19623 fp=#0x30000000aa5' 2024-08-31T04:31:06.941 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19655 fp=#0x30000002de8' 2024-08-31T04:31:06.941 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19687 fp=#0x30000002d76' 2024-08-31T04:31:06.942 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19719 fp=#0x30000002d44' 2024-08-31T04:31:06.942 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19751 fp=#0x30000002c7a' 2024-08-31T04:31:06.943 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19783 fp=#0x30000002d5f' 2024-08-31T04:31:06.943 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19815 fp=#0x30000001466' 2024-08-31T04:31:06.943 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19847 fp=#0x30000001442' 2024-08-31T04:31:06.943 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19879 fp=#0x3000000145c' 2024-08-31T04:31:06.944 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19911 fp=#0x300000011d3' 2024-08-31T04:31:06.944 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19943 fp=#0x30000001441' 2024-08-31T04:31:06.944 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19975 fp=#0x30000001407' 2024-08-31T04:31:06.945 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20007 fp=#0x3000000142f' 2024-08-31T04:31:06.945 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20039 fp=#0x30000000fc9' 2024-08-31T04:31:06.945 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20071 fp=#0x30000000fb1' 2024-08-31T04:31:06.946 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20103 fp=#0x30000000fb9' 2024-08-31T04:31:06.946 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20135 fp=#0x30000001740' 2024-08-31T04:31:06.946 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20167 fp=#0x300000016e8' 2024-08-31T04:31:06.946 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20199 fp=#0x30000001c51' 2024-08-31T04:31:06.947 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20231 fp=#0x300000030e0' 2024-08-31T04:31:06.947 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20263 fp=#0x30000003184' 2024-08-31T04:31:06.947 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20295 fp=#0x3000000318f' 2024-08-31T04:31:06.948 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20327 fp=#0x30000003168' 2024-08-31T04:31:06.948 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20359 fp=#0x30000003081' 2024-08-31T04:31:06.948 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20391 fp=#0x30000001cda' 2024-08-31T04:31:06.949 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20423 fp=#0x30000001c66' 2024-08-31T04:31:06.949 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20455 fp=#0x30000001c76' 2024-08-31T04:31:06.949 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20487 fp=#0x30000001c57' 2024-08-31T04:31:06.950 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20519 fp=#0x3000000126e' 2024-08-31T04:31:06.950 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20551 fp=#0x30000001224' 2024-08-31T04:31:06.950 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20583 fp=#0x30000001269' 2024-08-31T04:31:06.951 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20615 fp=#0x30000002185' 2024-08-31T04:31:06.951 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20679 fp=#0x30000002150' 2024-08-31T04:31:06.952 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20775 fp=#0x30000003071' 2024-08-31T04:31:06.952 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20807 fp=#0x300000027a9' 2024-08-31T04:31:06.953 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20935 fp=#0x1000000381e' 2024-08-31T04:31:06.953 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20967 fp=#0x300000020e1' 2024-08-31T04:31:06.954 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20999 fp=#0x30000002bdd' 2024-08-31T04:31:06.954 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21030 fp=#0x3000000167a' 2024-08-31T04:31:06.954 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21062 fp=#0x30000001620' 2024-08-31T04:31:06.954 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21094 fp=#0x30000001580' 2024-08-31T04:31:06.955 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21126 fp=#0x30000001665' 2024-08-31T04:31:06.956 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21286 fp=#0x30000002c54' 2024-08-31T04:31:06.956 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21318 fp=#0x10000003309' 2024-08-31T04:31:06.957 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21350 fp=#0x1000000327f' 2024-08-31T04:31:06.957 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21382 fp=#0x10000003232' 2024-08-31T04:31:06.957 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21414 fp=#0x100000032da' 2024-08-31T04:31:06.958 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21446 fp=#0x10000003359' 2024-08-31T04:31:06.958 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21478 fp=#0x30000002663' 2024-08-31T04:31:06.958 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21510 fp=#0x300000026f1' 2024-08-31T04:31:06.959 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21542 fp=#0x3000000263f' 2024-08-31T04:31:06.959 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21574 fp=#0x300000026eb' 2024-08-31T04:31:06.959 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21606 fp=#0x300000036e6' 2024-08-31T04:31:06.959 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21638 fp=#0x30000000cf3' 2024-08-31T04:31:06.960 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21670 fp=#0x30000000ccc' 2024-08-31T04:31:06.960 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21702 fp=#0x30000000cb6' 2024-08-31T04:31:06.960 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21734 fp=#0x3000000367b' 2024-08-31T04:31:06.961 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21766 fp=#0x30000000b0c' 2024-08-31T04:31:06.961 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21798 fp=#0x30000000b21' 2024-08-31T04:31:06.961 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21830 fp=#0x30000000abc' 2024-08-31T04:31:06.961 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21862 fp=#0x30000000a8f' 2024-08-31T04:31:06.962 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21958 fp=#0x3000000053d' 2024-08-31T04:31:06.962 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21990 fp=#0x300000008e4' 2024-08-31T04:31:06.963 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22021 fp=#0x30000001909' 2024-08-31T04:31:06.966 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22053 fp=#0x30000001929' 2024-08-31T04:31:06.966 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22085 fp=#0x3000000190a' 2024-08-31T04:31:06.966 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22117 fp=#0x300000018fc' 2024-08-31T04:31:06.967 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22149 fp=#0x30000002915' 2024-08-31T04:31:06.967 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22181 fp=#0x30000002923' 2024-08-31T04:31:06.967 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22213 fp=#0x3000000299e' 2024-08-31T04:31:06.968 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22245 fp=#0x30000002952' 2024-08-31T04:31:06.968 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22277 fp=#0x3000000209d' 2024-08-31T04:31:06.968 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22309 fp=#0x3000000203b' 2024-08-31T04:31:06.969 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22341 fp=#0x30000002061' 2024-08-31T04:31:06.969 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22373 fp=#0x30000002e57' 2024-08-31T04:31:06.969 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22405 fp=#0x30000000439' 2024-08-31T04:31:06.970 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22501 fp=#0x30000000415' 2024-08-31T04:31:06.970 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22526 fp=#0x30000002c92' 2024-08-31T04:31:06.970 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22558 fp=#0x30000002bef' 2024-08-31T04:31:06.971 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22621 fp=#0x10000000ff5' 2024-08-31T04:31:06.971 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22653 fp=#0x30000001473' 2024-08-31T04:31:06.972 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22685 fp=#0x300000033cd' 2024-08-31T04:31:06.972 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_path:mds.2:9751 fp=#0x1' 2024-08-31T04:31:06.973 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:9911 fp=#0x3000000372f' 2024-08-31T04:31:06.973 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:9943 fp=#0x3000000046a' 2024-08-31T04:31:06.979 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:10775 fp=#0x30000000a5f' 2024-08-31T04:31:06.986 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:11767 fp=#0x30000000bba' 2024-08-31T04:31:06.987 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:11927 fp=#0x30000002a45' 2024-08-31T04:31:06.987 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:11959 fp=#0x300000031fa' 2024-08-31T04:31:06.988 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:11991 fp=#0x300000031fc' 2024-08-31T04:31:06.988 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12055 fp=#0x300000010bf' 2024-08-31T04:31:06.989 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12151 fp=#0x300000010bd' 2024-08-31T04:31:06.991 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12343 fp=#0x3000000094a' 2024-08-31T04:31:06.991 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12407 fp=#0x30000002e41' 2024-08-31T04:31:06.992 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12503 fp=#0x30000000f62' 2024-08-31T04:31:06.992 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12535 fp=#0x30000000f4f' 2024-08-31T04:31:06.993 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12567 fp=#0x30000000f74' 2024-08-31T04:31:06.993 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12599 fp=#0x30000000e54' 2024-08-31T04:31:06.993 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12631 fp=#0x30000000e89' 2024-08-31T04:31:06.994 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12663 fp=#0x30000000e71' 2024-08-31T04:31:06.994 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12695 fp=#0x30000000e75' 2024-08-31T04:31:06.994 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12727 fp=#0x300000033c8' 2024-08-31T04:31:06.994 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12759 fp=#0x300000031a0' 2024-08-31T04:31:06.995 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12791 fp=#0x3000000336b' 2024-08-31T04:31:06.995 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12823 fp=#0x30000000e62' 2024-08-31T04:31:06.995 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12855 fp=#0x10000004415' 2024-08-31T04:31:06.996 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12887 fp=#0x100000043ed' 2024-08-31T04:31:06.996 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12919 fp=#0x1000000420d' 2024-08-31T04:31:06.996 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12951 fp=#0x10000004232' 2024-08-31T04:31:06.997 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12983 fp=#0x1000000429c' 2024-08-31T04:31:06.997 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13015 fp=#0x10000004211' 2024-08-31T04:31:06.997 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13047 fp=#0x30000002819' 2024-08-31T04:31:06.998 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13079 fp=#0x30000002816' 2024-08-31T04:31:06.998 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13111 fp=#0x30000003162' 2024-08-31T04:31:06.998 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13143 fp=#0x300000030a2' 2024-08-31T04:31:06.998 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13175 fp=#0x30000003189' 2024-08-31T04:31:06.999 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13303 fp=#0x300000021ff' 2024-08-31T04:31:07.000 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13335 fp=#0x3000000088c' 2024-08-31T04:31:07.000 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13367 fp=#0x30000002225' 2024-08-31T04:31:07.000 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13399 fp=#0x30000000915' 2024-08-31T04:31:07.001 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13431 fp=#0x30000002259' 2024-08-31T04:31:07.001 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13463 fp=#0x300000008d1' 2024-08-31T04:31:07.001 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13495 fp=#0x300000009bf' 2024-08-31T04:31:07.001 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13527 fp=#0x300000008d5' 2024-08-31T04:31:07.002 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13559 fp=#0x300000032b4' 2024-08-31T04:31:07.002 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13591 fp=#0x30000003349' 2024-08-31T04:31:07.002 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13623 fp=#0x30000003341' 2024-08-31T04:31:07.003 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13655 fp=#0x3000000334a' 2024-08-31T04:31:07.003 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13687 fp=#0x300000029bb' 2024-08-31T04:31:07.003 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13719 fp=#0x300000029f9' 2024-08-31T04:31:07.004 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13751 fp=#0x30000002a3d' 2024-08-31T04:31:07.004 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13783 fp=#0x30000002a13' 2024-08-31T04:31:07.004 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13815 fp=#0x30000002924' 2024-08-31T04:31:07.005 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13847 fp=#0x300000029c3' 2024-08-31T04:31:07.005 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13911 fp=#0x10000003d8b' 2024-08-31T04:31:07.006 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13975 fp=#0x10000003d95' 2024-08-31T04:31:07.006 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14039 fp=#0x10000003f05' 2024-08-31T04:31:07.006 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14071 fp=#0x30000000c6e' 2024-08-31T04:31:07.007 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14103 fp=#0x30000000c69' 2024-08-31T04:31:07.007 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14135 fp=#0x30000001748' 2024-08-31T04:31:07.008 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14167 fp=#0x300000017c9' 2024-08-31T04:31:07.008 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14199 fp=#0x30000001774' 2024-08-31T04:31:07.008 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14231 fp=#0x30000002027' 2024-08-31T04:31:07.009 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14391 fp=#0x30000000d39' 2024-08-31T04:31:07.010 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14423 fp=#0x30000000cf8' 2024-08-31T04:31:07.010 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14455 fp=#0x30000000cfe' 2024-08-31T04:31:07.011 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14487 fp=#0x3000000239c' 2024-08-31T04:31:07.011 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14519 fp=#0x30000000d0c' 2024-08-31T04:31:07.011 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14551 fp=#0x30000000d45' 2024-08-31T04:31:07.011 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14583 fp=#0x30000000d2d' 2024-08-31T04:31:07.012 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14615 fp=#0x10000002492' 2024-08-31T04:31:07.012 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14647 fp=#0x30000002faa' 2024-08-31T04:31:07.012 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14679 fp=#0x30000002f8d' 2024-08-31T04:31:07.013 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14711 fp=#0x30000002f95' 2024-08-31T04:31:07.013 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14743 fp=#0x30000002fdb' 2024-08-31T04:31:07.013 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14775 fp=#0x10000002406' 2024-08-31T04:31:07.014 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14806 fp=#0x10000003c09' 2024-08-31T04:31:07.014 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14838 fp=#0x30000000a40' 2024-08-31T04:31:07.014 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14870 fp=#0x30000000a1e' 2024-08-31T04:31:07.015 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14902 fp=#0x300000009ef' 2024-08-31T04:31:07.015 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14934 fp=#0x300000009b6' 2024-08-31T04:31:07.015 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14966 fp=#0x30000000991' 2024-08-31T04:31:07.015 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14998 fp=#0x300000014dd' 2024-08-31T04:31:07.016 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15030 fp=#0x30000001521' 2024-08-31T04:31:07.016 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15062 fp=#0x30000001693' 2024-08-31T04:31:07.016 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15094 fp=#0x300000014c0' 2024-08-31T04:31:07.017 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15126 fp=#0x300000033f7' 2024-08-31T04:31:07.017 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15158 fp=#0x300000033b8' 2024-08-31T04:31:07.017 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15190 fp=#0x300000033e2' 2024-08-31T04:31:07.018 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15222 fp=#0x30000002f09' 2024-08-31T04:31:07.018 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15254 fp=#0x30000002e5a' 2024-08-31T04:31:07.018 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15286 fp=#0x30000002f0d' 2024-08-31T04:31:07.019 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15318 fp=#0x30000002ed8' 2024-08-31T04:31:07.019 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15350 fp=#0x30000002ea6' 2024-08-31T04:31:07.019 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15382 fp=#0x300000032d4' 2024-08-31T04:31:07.020 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15414 fp=#0x3000000348b' 2024-08-31T04:31:07.020 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15446 fp=#0x30000000ed0' 2024-08-31T04:31:07.020 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15478 fp=#0x30000002c31' 2024-08-31T04:31:07.021 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15510 fp=#0x30000001dcd' 2024-08-31T04:31:07.021 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15542 fp=#0x30000000f0d' 2024-08-31T04:31:07.021 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15574 fp=#0x30000001db9' 2024-08-31T04:31:07.022 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15638 fp=#0x30000000869' 2024-08-31T04:31:07.022 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15702 fp=#0x30000002e85' 2024-08-31T04:31:07.023 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15798 fp=#0x300000005ca' 2024-08-31T04:31:07.023 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15829 fp=#0x300000014ba' 2024-08-31T04:31:07.024 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15861 fp=#0x300000012fd' 2024-08-31T04:31:07.024 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15893 fp=#0x3000000129e' 2024-08-31T04:31:07.024 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15925 fp=#0x3000000130b' 2024-08-31T04:31:07.025 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15957 fp=#0x300000012b4' 2024-08-31T04:31:07.025 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15989 fp=#0x300000012c6' 2024-08-31T04:31:07.026 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16021 fp=#0x3000000100f' 2024-08-31T04:31:07.026 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16053 fp=#0x3000000103b' 2024-08-31T04:31:07.026 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16085 fp=#0x30000002e01' 2024-08-31T04:31:07.027 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16117 fp=#0x30000002df0' 2024-08-31T04:31:07.027 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16181 fp=#0x300000033e6' 2024-08-31T04:31:07.027 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16213 fp=#0x30000003504' 2024-08-31T04:31:07.028 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16245 fp=#0x3000000063f' 2024-08-31T04:31:07.028 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16277 fp=#0x30000003400' 2024-08-31T04:31:07.028 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16309 fp=#0x300000034f8' 2024-08-31T04:31:07.029 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16338 fp=#0x10000002892' 2024-08-31T04:31:07.029 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16370 fp=#0x300000020a3' 2024-08-31T04:31:07.029 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16402 fp=#0x1000000282b' 2024-08-31T04:31:07.030 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16434 fp=#0x30000001d32' 2024-08-31T04:31:07.030 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16466 fp=#0x10000002501' 2024-08-31T04:31:07.030 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16498 fp=#0x30000001d09' 2024-08-31T04:31:07.030 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16530 fp=#0x30000001d1e' 2024-08-31T04:31:07.031 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16562 fp=#0x30000001cf8' 2024-08-31T04:31:07.031 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16594 fp=#0x30000001d13' 2024-08-31T04:31:07.031 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16625 fp=#0x30000002331' 2024-08-31T04:31:07.032 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16657 fp=#0x30000002110' 2024-08-31T04:31:07.032 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16689 fp=#0x30000002120' 2024-08-31T04:31:07.032 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16721 fp=#0x30000002102' 2024-08-31T04:31:07.033 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16753 fp=#0x300000003dc' 2024-08-31T04:31:07.033 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16785 fp=#0x30000001a3a' 2024-08-31T04:31:07.033 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16817 fp=#0x30000001a06' 2024-08-31T04:31:07.034 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16849 fp=#0x3000000194e' 2024-08-31T04:31:07.034 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16881 fp=#0x30000001953' 2024-08-31T04:31:07.034 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16944 fp=#0x30000001ac7' 2024-08-31T04:31:07.035 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16976 fp=#0x30000001a76' 2024-08-31T04:31:07.035 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17033 fp=#0x10000003705' 2024-08-31T04:31:07.035 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17065 fp=#0x1000000382e' 2024-08-31T04:31:07.036 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17097 fp=#0x100000036c5' 2024-08-31T04:31:07.036 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17129 fp=#0x30000001745' 2024-08-31T04:31:07.036 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17161 fp=#0x300000017c3' 2024-08-31T04:31:07.037 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17193 fp=#0x3000000172f' 2024-08-31T04:31:07.037 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17225 fp=#0x30000001750' 2024-08-31T04:31:07.037 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17257 fp=#0x3000000175f' 2024-08-31T04:31:07.038 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17289 fp=#0x300000017f4' 2024-08-31T04:31:07.038 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17321 fp=#0x300000017b3' 2024-08-31T04:31:07.038 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17353 fp=#0x30000003361' 2024-08-31T04:31:07.040 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17545 fp=#0x30000002012' 2024-08-31T04:31:07.040 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17577 fp=#0x300000031af' 2024-08-31T04:31:07.040 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17609 fp=#0x300000031c1' 2024-08-31T04:31:07.041 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17641 fp=#0x300000031a1' 2024-08-31T04:31:07.041 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17673 fp=#0x30000000ddf' 2024-08-31T04:31:07.042 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17801 fp=#0x30000001f6d' 2024-08-31T04:31:07.042 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17833 fp=#0x30000001f9e' 2024-08-31T04:31:07.043 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17865 fp=#0x30000002029' 2024-08-31T04:31:07.043 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17897 fp=#0x30000001f73' 2024-08-31T04:31:07.043 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17929 fp=#0x300000030ab' 2024-08-31T04:31:07.043 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17961 fp=#0x300000030fd' 2024-08-31T04:31:07.044 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17993 fp=#0x300000030e5' 2024-08-31T04:31:07.044 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18025 fp=#0x30000001c22' 2024-08-31T04:31:07.044 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18057 fp=#0x30000001c08' 2024-08-31T04:31:07.045 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18089 fp=#0x30000001c2c' 2024-08-31T04:31:07.045 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18121 fp=#0x30000002530' 2024-08-31T04:31:07.045 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18153 fp=#0x30000002590' 2024-08-31T04:31:07.046 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18185 fp=#0x30000002545' 2024-08-31T04:31:07.046 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18217 fp=#0x3000000257f' 2024-08-31T04:31:07.046 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18249 fp=#0x30000002898' 2024-08-31T04:31:07.047 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18281 fp=#0x30000002840' 2024-08-31T04:31:07.047 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18313 fp=#0x3000000289a' 2024-08-31T04:31:07.047 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18345 fp=#0x300000027e8' 2024-08-31T04:31:07.048 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18377 fp=#0x3000000284c' 2024-08-31T04:31:07.048 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18409 fp=#0x30000002f64' 2024-08-31T04:31:07.048 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18441 fp=#0x30000002fee' 2024-08-31T04:31:07.049 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18473 fp=#0x3000000302e' 2024-08-31T04:31:07.049 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18505 fp=#0x30000002f46' 2024-08-31T04:31:07.049 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18537 fp=#0x30000002f29' 2024-08-31T04:31:07.050 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18569 fp=#0x10000001d00' 2024-08-31T04:31:07.050 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18601 fp=#0x10000001d0a' 2024-08-31T04:31:07.050 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18633 fp=#0x10000001d09' 2024-08-31T04:31:07.051 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18665 fp=#0x10000001d59' 2024-08-31T04:31:07.051 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18697 fp=#0x30000001377' 2024-08-31T04:31:07.051 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18729 fp=#0x300000014cc' 2024-08-31T04:31:07.051 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18761 fp=#0x300000013a6' 2024-08-31T04:31:07.052 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18793 fp=#0x3000000133b' 2024-08-31T04:31:07.052 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18825 fp=#0x300000013de' 2024-08-31T04:31:07.052 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18857 fp=#0x30000001385' 2024-08-31T04:31:07.053 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18889 fp=#0x30000001094' 2024-08-31T04:31:07.053 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18921 fp=#0x3000000107a' 2024-08-31T04:31:07.053 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18953 fp=#0x300000021f3' 2024-08-31T04:31:07.054 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18985 fp=#0x30000002e54' 2024-08-31T04:31:07.054 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19017 fp=#0x30000001d5d' 2024-08-31T04:31:07.054 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19049 fp=#0x300000011b9' 2024-08-31T04:31:07.055 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19081 fp=#0x30000001119' 2024-08-31T04:31:07.055 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19113 fp=#0x30000001159' 2024-08-31T04:31:07.055 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19145 fp=#0x3000000118e' 2024-08-31T04:31:07.055 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19177 fp=#0x300000015d1' 2024-08-31T04:31:07.056 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19209 fp=#0x300000015f3' 2024-08-31T04:31:07.056 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19241 fp=#0x300000015b9' 2024-08-31T04:31:07.056 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19273 fp=#0x100000008bf' 2024-08-31T04:31:07.057 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19305 fp=#0x100000008d5' 2024-08-31T04:31:07.057 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19337 fp=#0x100000008a5' 2024-08-31T04:31:07.057 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19369 fp=#0x30000002bc7' 2024-08-31T04:31:07.058 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19401 fp=#0x100000008e0' 2024-08-31T04:31:07.058 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19432 fp=#0x30000000bf4' 2024-08-31T04:31:07.058 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19464 fp=#0x30000000bb9' 2024-08-31T04:31:07.059 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19496 fp=#0x30000000b6a' 2024-08-31T04:31:07.059 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19528 fp=#0x30000000b87' 2024-08-31T04:31:07.059 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19560 fp=#0x30000000b3d' 2024-08-31T04:31:07.059 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19592 fp=#0x30000000ad7' 2024-08-31T04:31:07.060 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19624 fp=#0x30000000acd' 2024-08-31T04:31:07.060 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19656 fp=#0x30000002c44' 2024-08-31T04:31:07.060 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19688 fp=#0x30000002d46' 2024-08-31T04:31:07.061 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19720 fp=#0x30000002c64' 2024-08-31T04:31:07.061 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19752 fp=#0x30000002c08' 2024-08-31T04:31:07.061 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19784 fp=#0x30000002cdf' 2024-08-31T04:31:07.062 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19816 fp=#0x300000011e9' 2024-08-31T04:31:07.062 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19848 fp=#0x30000001137' 2024-08-31T04:31:07.062 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19880 fp=#0x3000000114e' 2024-08-31T04:31:07.063 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19912 fp=#0x300000011f8' 2024-08-31T04:31:07.063 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19944 fp=#0x300000011b8' 2024-08-31T04:31:07.063 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19976 fp=#0x30000001412' 2024-08-31T04:31:07.064 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20008 fp=#0x3000000141d' 2024-08-31T04:31:07.064 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20040 fp=#0x30000000fea' 2024-08-31T04:31:07.064 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20072 fp=#0x30000000fbb' 2024-08-31T04:31:07.065 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20104 fp=#0x30000000fb4' 2024-08-31T04:31:07.065 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20136 fp=#0x300000016c6' 2024-08-31T04:31:07.065 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20168 fp=#0x300000016dd' 2024-08-31T04:31:07.066 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20200 fp=#0x30000001706' 2024-08-31T04:31:07.066 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20232 fp=#0x3000000313f' 2024-08-31T04:31:07.066 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20264 fp=#0x3000000322d' 2024-08-31T04:31:07.066 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20296 fp=#0x300000030bf' 2024-08-31T04:31:07.067 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20328 fp=#0x300000030cf' 2024-08-31T04:31:07.067 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20360 fp=#0x30000003118' 2024-08-31T04:31:07.067 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20392 fp=#0x30000001c58' 2024-08-31T04:31:07.068 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20424 fp=#0x30000001c77' 2024-08-31T04:31:07.068 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20456 fp=#0x30000001cb0' 2024-08-31T04:31:07.068 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20488 fp=#0x30000001cb7' 2024-08-31T04:31:07.069 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20520 fp=#0x3000000126c' 2024-08-31T04:31:07.069 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20552 fp=#0x30000001270' 2024-08-31T04:31:07.069 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20584 fp=#0x30000001249' 2024-08-31T04:31:07.070 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20680 fp=#0x300000021a7' 2024-08-31T04:31:07.071 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20744 fp=#0x300000021c4' 2024-08-31T04:31:07.071 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20776 fp=#0x3000000303c' 2024-08-31T04:31:07.071 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20808 fp=#0x1000000374c' 2024-08-31T04:31:07.071 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20840 fp=#0x10000003869' 2024-08-31T04:31:07.072 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20904 fp=#0x30000003053' 2024-08-31T04:31:07.072 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20936 fp=#0x10000003743' 2024-08-31T04:31:07.073 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20968 fp=#0x30000002a64' 2024-08-31T04:31:07.073 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21000 fp=#0x300000020d9' 2024-08-31T04:31:07.073 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21031 fp=#0x30000001554' 2024-08-31T04:31:07.073 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21063 fp=#0x3000000152d' 2024-08-31T04:31:07.074 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21095 fp=#0x3000000164a' 2024-08-31T04:31:07.074 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21127 fp=#0x3000000156a' 2024-08-31T04:31:07.075 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21191 fp=#0x30000001de3' 2024-08-31T04:31:07.075 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21223 fp=#0x30000002bd8' 2024-08-31T04:31:07.075 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21255 fp=#0x30000002be6' 2024-08-31T04:31:07.076 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21287 fp=#0x30000002c15' 2024-08-31T04:31:07.076 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21319 fp=#0x10000003386' 2024-08-31T04:31:07.076 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21351 fp=#0x100000032a7' 2024-08-31T04:31:07.077 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21383 fp=#0x1000000330c' 2024-08-31T04:31:07.077 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21415 fp=#0x1000000336f' 2024-08-31T04:31:07.077 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21447 fp=#0x1000000322b' 2024-08-31T04:31:07.078 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21479 fp=#0x3000000270f' 2024-08-31T04:31:07.078 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21511 fp=#0x300000026df' 2024-08-31T04:31:07.078 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21543 fp=#0x30000002633' 2024-08-31T04:31:07.079 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21575 fp=#0x3000000265c' 2024-08-31T04:31:07.079 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21607 fp=#0x30000000cd6' 2024-08-31T04:31:07.079 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21639 fp=#0x30000000d4e' 2024-08-31T04:31:07.079 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21671 fp=#0x30000000cef' 2024-08-31T04:31:07.080 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21703 fp=#0x30000000d2b' 2024-08-31T04:31:07.080 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21735 fp=#0x3000000368a' 2024-08-31T04:31:07.080 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21767 fp=#0x30000000b3c' 2024-08-31T04:31:07.081 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21799 fp=#0x30000000ac2' 2024-08-31T04:31:07.081 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21831 fp=#0x30000000b03' 2024-08-31T04:31:07.081 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21863 fp=#0x30000000adb' 2024-08-31T04:31:07.082 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21895 fp=#0x30000000947' 2024-08-31T04:31:07.082 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21927 fp=#0x300000008dd' 2024-08-31T04:31:07.082 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21959 fp=#0x3000000093f' 2024-08-31T04:31:07.083 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21991 fp=#0x300000008fb' 2024-08-31T04:31:07.083 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22022 fp=#0x3000000193f' 2024-08-31T04:31:07.083 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22054 fp=#0x30000002f74' 2024-08-31T04:31:07.084 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22086 fp=#0x30000001904' 2024-08-31T04:31:07.084 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22118 fp=#0x300000018fa' 2024-08-31T04:31:07.084 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22150 fp=#0x300000028fe' 2024-08-31T04:31:07.085 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22182 fp=#0x30000002932' 2024-08-31T04:31:07.085 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22214 fp=#0x3000000294c' 2024-08-31T04:31:07.085 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22246 fp=#0x30000002936' 2024-08-31T04:31:07.086 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22278 fp=#0x3000000200b' 2024-08-31T04:31:07.086 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22310 fp=#0x30000002005' 2024-08-31T04:31:07.086 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22342 fp=#0x30000001fe0' 2024-08-31T04:31:07.086 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22374 fp=#0x30000000497' 2024-08-31T04:31:07.087 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22406 fp=#0x30000000491' 2024-08-31T04:31:07.087 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22470 fp=#0x30000000493' 2024-08-31T04:31:07.088 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22502 fp=#0x30000000418' 2024-08-31T04:31:07.088 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22527 fp=#0x30000002c98' 2024-08-31T04:31:07.088 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22559 fp=#0x30000002c09' 2024-08-31T04:31:07.089 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22622 fp=#0x300000033af' 2024-08-31T04:31:07.089 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22686 fp=#0x300000033a3' 2024-08-31T04:31:07.090 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:9752 fp=#0x1' 2024-08-31T04:31:07.090 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:9784 fp=#0x30000000907' 2024-08-31T04:31:07.091 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:9912 fp=#0x300000027ae' 2024-08-31T04:31:07.097 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:10712 fp=#0x30000000a7d' 2024-08-31T04:31:07.098 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:10776 fp=#0x30000000a66' 2024-08-31T04:31:07.105 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:11768 fp=#0x30000000c36' 2024-08-31T04:31:07.105 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:11800 fp=#0x30000000bd2' 2024-08-31T04:31:07.106 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:11928 fp=#0x30000001054' 2024-08-31T04:31:07.106 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:11960 fp=#0x30000001124' 2024-08-31T04:31:07.107 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:11992 fp=#0x300000031d5' 2024-08-31T04:31:07.107 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12024 fp=#0x3000000105d' 2024-08-31T04:31:07.108 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12088 fp=#0x300000010e3' 2024-08-31T04:31:07.108 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12120 fp=#0x30000001087' 2024-08-31T04:31:07.108 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12152 fp=#0x300000010c9' 2024-08-31T04:31:07.109 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12248 fp=#0x30000000932' 2024-08-31T04:31:07.110 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12408 fp=#0x30000002e50' 2024-08-31T04:31:07.111 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12440 fp=#0x30000002e4f' 2024-08-31T04:31:07.111 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12504 fp=#0x30000000f7e' 2024-08-31T04:31:07.112 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12536 fp=#0x30000000f7f' 2024-08-31T04:31:07.112 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12568 fp=#0x30000000f86' 2024-08-31T04:31:07.112 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12600 fp=#0x30000001fbc' 2024-08-31T04:31:07.112 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12632 fp=#0x30000000e6c' 2024-08-31T04:31:07.113 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12664 fp=#0x300000033b6' 2024-08-31T04:31:07.113 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12696 fp=#0x30000000e7d' 2024-08-31T04:31:07.113 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12728 fp=#0x30000002270' 2024-08-31T04:31:07.114 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12760 fp=#0x30000000e5a' 2024-08-31T04:31:07.114 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12792 fp=#0x30000000e49' 2024-08-31T04:31:07.114 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12824 fp=#0x30000000e76' 2024-08-31T04:31:07.114 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12856 fp=#0x1000000422c' 2024-08-31T04:31:07.115 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12888 fp=#0x100000043cf' 2024-08-31T04:31:07.115 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12920 fp=#0x1000000426a' 2024-08-31T04:31:07.115 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12952 fp=#0x300000028a0' 2024-08-31T04:31:07.116 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12984 fp=#0x100000042c0' 2024-08-31T04:31:07.116 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13016 fp=#0x30000002831' 2024-08-31T04:31:07.116 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13048 fp=#0x30000002826' 2024-08-31T04:31:07.117 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13080 fp=#0x1000000423b' 2024-08-31T04:31:07.117 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13112 fp=#0x30000003180' 2024-08-31T04:31:07.117 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13144 fp=#0x30000003121' 2024-08-31T04:31:07.118 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13176 fp=#0x30000003120' 2024-08-31T04:31:07.119 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13304 fp=#0x3000000088e' 2024-08-31T04:31:07.119 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13336 fp=#0x30000000889' 2024-08-31T04:31:07.119 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13368 fp=#0x300000008cc' 2024-08-31T04:31:07.120 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13432 fp=#0x30000002260' 2024-08-31T04:31:07.120 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13464 fp=#0x30000002217' 2024-08-31T04:31:07.120 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13496 fp=#0x3000000088f' 2024-08-31T04:31:07.121 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13528 fp=#0x30000000946' 2024-08-31T04:31:07.121 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13560 fp=#0x30000003295' 2024-08-31T04:31:07.121 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13592 fp=#0x300000032a3' 2024-08-31T04:31:07.122 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13624 fp=#0x3000000329b' 2024-08-31T04:31:07.122 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13656 fp=#0x3000000332c' 2024-08-31T04:31:07.122 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13688 fp=#0x30000002a36' 2024-08-31T04:31:07.123 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13720 fp=#0x30000002905' 2024-08-31T04:31:07.123 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13752 fp=#0x300000029c6' 2024-08-31T04:31:07.123 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13784 fp=#0x30000002994' 2024-08-31T04:31:07.124 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13816 fp=#0x300000028e5' 2024-08-31T04:31:07.124 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13848 fp=#0x300000029b1' 2024-08-31T04:31:07.124 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13880 fp=#0x10000003deb' 2024-08-31T04:31:07.124 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13912 fp=#0x10000003c43' 2024-08-31T04:31:07.125 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14040 fp=#0x10000003dba' 2024-08-31T04:31:07.126 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14072 fp=#0x30000000c68' 2024-08-31T04:31:07.126 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14104 fp=#0x30000000c63' 2024-08-31T04:31:07.126 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14136 fp=#0x30000002442' 2024-08-31T04:31:07.127 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14168 fp=#0x30000002470' 2024-08-31T04:31:07.127 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14200 fp=#0x300000017a4' 2024-08-31T04:31:07.127 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14232 fp=#0x3000000176b' 2024-08-31T04:31:07.128 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14392 fp=#0x30000000cf2' 2024-08-31T04:31:07.129 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14424 fp=#0x3000000238b' 2024-08-31T04:31:07.129 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14456 fp=#0x30000000cec' 2024-08-31T04:31:07.129 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14488 fp=#0x30000000cf0' 2024-08-31T04:31:07.130 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14520 fp=#0x30000000d71' 2024-08-31T04:31:07.130 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14552 fp=#0x300000023ac' 2024-08-31T04:31:07.130 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14584 fp=#0x300000023aa' 2024-08-31T04:31:07.131 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14616 fp=#0x10000002453' 2024-08-31T04:31:07.131 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14648 fp=#0x30000002fab' 2024-08-31T04:31:07.131 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14680 fp=#0x10000002424' 2024-08-31T04:31:07.131 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14712 fp=#0x10000002430' 2024-08-31T04:31:07.132 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14744 fp=#0x100000023e5' 2024-08-31T04:31:07.132 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14776 fp=#0x30000002fd0' 2024-08-31T04:31:07.132 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14807 fp=#0x10000003c18' 2024-08-31T04:31:07.133 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14839 fp=#0x30000000a0c' 2024-08-31T04:31:07.133 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14871 fp=#0x300000009ab' 2024-08-31T04:31:07.133 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14903 fp=#0x30000000a34' 2024-08-31T04:31:07.134 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14935 fp=#0x3000000097f' 2024-08-31T04:31:07.134 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14967 fp=#0x300000009c3' 2024-08-31T04:31:07.134 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14999 fp=#0x300000014e8' 2024-08-31T04:31:07.135 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15031 fp=#0x30000001541' 2024-08-31T04:31:07.135 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15063 fp=#0x3000000159b' 2024-08-31T04:31:07.135 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15095 fp=#0x3000000152c' 2024-08-31T04:31:07.135 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15127 fp=#0x30000003420' 2024-08-31T04:31:07.136 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15159 fp=#0x3000000338b' 2024-08-31T04:31:07.136 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15191 fp=#0x30000003395' 2024-08-31T04:31:07.136 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15223 fp=#0x30000002e8b' 2024-08-31T04:31:07.137 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15255 fp=#0x30000002f08' 2024-08-31T04:31:07.137 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15287 fp=#0x30000002ed9' 2024-08-31T04:31:07.137 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15319 fp=#0x30000002ee1' 2024-08-31T04:31:07.138 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15351 fp=#0x30000002edc' 2024-08-31T04:31:07.138 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15383 fp=#0x300000032c8' 2024-08-31T04:31:07.138 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15415 fp=#0x30000000f30' 2024-08-31T04:31:07.139 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15447 fp=#0x30000001db1' 2024-08-31T04:31:07.139 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15479 fp=#0x30000001dc5' 2024-08-31T04:31:07.139 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15511 fp=#0x30000000f05' 2024-08-31T04:31:07.139 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15543 fp=#0x30000000ede' 2024-08-31T04:31:07.140 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15575 fp=#0x30000000ec3' 2024-08-31T04:31:07.140 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15607 fp=#0x300000004fa' 2024-08-31T04:31:07.141 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15767 fp=#0x300000004e3' 2024-08-31T04:31:07.141 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15799 fp=#0x300000004e1' 2024-08-31T04:31:07.142 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15830 fp=#0x300000012a4' 2024-08-31T04:31:07.142 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15862 fp=#0x300000014c2' 2024-08-31T04:31:07.142 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15894 fp=#0x300000012ac' 2024-08-31T04:31:07.143 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15926 fp=#0x300000012c9' 2024-08-31T04:31:07.143 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15958 fp=#0x30000001280' 2024-08-31T04:31:07.143 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15990 fp=#0x30000001302' 2024-08-31T04:31:07.144 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16022 fp=#0x3000000101d' 2024-08-31T04:31:07.144 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16054 fp=#0x30000001059' 2024-08-31T04:31:07.144 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16086 fp=#0x30000001833' 2024-08-31T04:31:07.144 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16118 fp=#0x30000002deb' 2024-08-31T04:31:07.145 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16182 fp=#0x30000000625' 2024-08-31T04:31:07.145 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16214 fp=#0x300000034a6' 2024-08-31T04:31:07.146 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16278 fp=#0x3000000356c' 2024-08-31T04:31:07.146 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16339 fp=#0x300000020a4' 2024-08-31T04:31:07.147 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16371 fp=#0x10000002842' 2024-08-31T04:31:07.147 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16403 fp=#0x1000000285b' 2024-08-31T04:31:07.147 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16435 fp=#0x100000024fb' 2024-08-31T04:31:07.148 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16467 fp=#0x30000001d2d' 2024-08-31T04:31:07.148 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16499 fp=#0x30000001cfe' 2024-08-31T04:31:07.148 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16531 fp=#0x30000001cf1' 2024-08-31T04:31:07.149 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16563 fp=#0x100000024c6' 2024-08-31T04:31:07.149 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16595 fp=#0x100000024dd' 2024-08-31T04:31:07.149 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16626 fp=#0x300000020f8' 2024-08-31T04:31:07.150 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16658 fp=#0x3000000223b' 2024-08-31T04:31:07.150 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16690 fp=#0x300000021e4' 2024-08-31T04:31:07.150 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16722 fp=#0x30000002152' 2024-08-31T04:31:07.151 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16754 fp=#0x30000001f32' 2024-08-31T04:31:07.151 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16818 fp=#0x3000000194c' 2024-08-31T04:31:07.151 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16850 fp=#0x30000001967' 2024-08-31T04:31:07.152 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16882 fp=#0x3000000197f' 2024-08-31T04:31:07.152 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16914 fp=#0x3000000196c' 2024-08-31T04:31:07.152 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16945 fp=#0x30000001ace' 2024-08-31T04:31:07.153 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16977 fp=#0x30000002b70' 2024-08-31T04:31:07.153 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17034 fp=#0x1000000371a' 2024-08-31T04:31:07.153 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17066 fp=#0x1000000365d' 2024-08-31T04:31:07.154 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17098 fp=#0x10000003694' 2024-08-31T04:31:07.154 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17130 fp=#0x3000000180b' 2024-08-31T04:31:07.154 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17162 fp=#0x30000001764' 2024-08-31T04:31:07.154 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17194 fp=#0x30000001810' 2024-08-31T04:31:07.155 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17226 fp=#0x30000002cbe' 2024-08-31T04:31:07.155 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17258 fp=#0x30000001719' 2024-08-31T04:31:07.155 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17290 fp=#0x300000017ed' 2024-08-31T04:31:07.156 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17322 fp=#0x300000017f8' 2024-08-31T04:31:07.156 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17354 fp=#0x30000003306' 2024-08-31T04:31:07.157 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17546 fp=#0x3000000321b' 2024-08-31T04:31:07.158 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17578 fp=#0x300000031a2' 2024-08-31T04:31:07.158 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17610 fp=#0x30000003234' 2024-08-31T04:31:07.158 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17642 fp=#0x300000031b5' 2024-08-31T04:31:07.159 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17674 fp=#0x30000000dbd' 2024-08-31T04:31:07.160 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17802 fp=#0x30000002050' 2024-08-31T04:31:07.160 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17834 fp=#0x30000001f86' 2024-08-31T04:31:07.160 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17866 fp=#0x30000001fae' 2024-08-31T04:31:07.161 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17898 fp=#0x30000002001' 2024-08-31T04:31:07.161 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17930 fp=#0x30000003167' 2024-08-31T04:31:07.161 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17962 fp=#0x30000003132' 2024-08-31T04:31:07.161 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17994 fp=#0x30000001bea' 2024-08-31T04:31:07.162 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18026 fp=#0x30000001c2f' 2024-08-31T04:31:07.162 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18058 fp=#0x30000001be9' 2024-08-31T04:31:07.162 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18090 fp=#0x30000001bdc' 2024-08-31T04:31:07.163 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18122 fp=#0x300000025a3' 2024-08-31T04:31:07.163 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18154 fp=#0x30000002556' 2024-08-31T04:31:07.163 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18186 fp=#0x30000002593' 2024-08-31T04:31:07.163 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18218 fp=#0x30000002563' 2024-08-31T04:31:07.164 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18250 fp=#0x30000002845' 2024-08-31T04:31:07.164 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18282 fp=#0x300000027ca' 2024-08-31T04:31:07.164 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18314 fp=#0x3000000280e' 2024-08-31T04:31:07.165 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18346 fp=#0x300000027db' 2024-08-31T04:31:07.165 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18378 fp=#0x300000027c2' 2024-08-31T04:31:07.165 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18410 fp=#0x30000002ffc' 2024-08-31T04:31:07.166 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18442 fp=#0x30000003034' 2024-08-31T04:31:07.166 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18474 fp=#0x30000002f67' 2024-08-31T04:31:07.166 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18506 fp=#0x30000002f5e' 2024-08-31T04:31:07.167 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18538 fp=#0x30000002f2c' 2024-08-31T04:31:07.167 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18570 fp=#0x10000001d75' 2024-08-31T04:31:07.167 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18602 fp=#0x10000001d01' 2024-08-31T04:31:07.168 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18666 fp=#0x10000001d10' 2024-08-31T04:31:07.168 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18698 fp=#0x300000013bb' 2024-08-31T04:31:07.168 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18730 fp=#0x30000001333' 2024-08-31T04:31:07.169 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18762 fp=#0x300000013aa' 2024-08-31T04:31:07.169 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18794 fp=#0x30000001341' 2024-08-31T04:31:07.169 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18826 fp=#0x300000013a2' 2024-08-31T04:31:07.170 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18858 fp=#0x30000001388' 2024-08-31T04:31:07.170 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18890 fp=#0x30000001104' 2024-08-31T04:31:07.170 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18922 fp=#0x30000001d6d' 2024-08-31T04:31:07.170 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18954 fp=#0x30000001d8e' 2024-08-31T04:31:07.171 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18986 fp=#0x300000010ed' 2024-08-31T04:31:07.171 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19018 fp=#0x30000001d66' 2024-08-31T04:31:07.171 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19050 fp=#0x30000001203' 2024-08-31T04:31:07.172 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19082 fp=#0x30000001110' 2024-08-31T04:31:07.172 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19114 fp=#0x30000001135' 2024-08-31T04:31:07.172 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19146 fp=#0x300000015ef' 2024-08-31T04:31:07.173 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19178 fp=#0x30000001678' 2024-08-31T04:31:07.173 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19210 fp=#0x30000001610' 2024-08-31T04:31:07.173 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19242 fp=#0x30000002a61' 2024-08-31T04:31:07.174 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19274 fp=#0x30000002bd1' 2024-08-31T04:31:07.174 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19306 fp=#0x100000008dc' 2024-08-31T04:31:07.174 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19338 fp=#0x100000008af' 2024-08-31T04:31:07.175 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19370 fp=#0x100000008dd' 2024-08-31T04:31:07.175 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19402 fp=#0x30000002ba9' 2024-08-31T04:31:07.175 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19433 fp=#0x30000000bb1' 2024-08-31T04:31:07.176 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19465 fp=#0x30000000ba1' 2024-08-31T04:31:07.176 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19497 fp=#0x30000000b93' 2024-08-31T04:31:07.176 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19529 fp=#0x30000000b5f' 2024-08-31T04:31:07.176 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19561 fp=#0x30000000afe' 2024-08-31T04:31:07.177 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19593 fp=#0x30000000b09' 2024-08-31T04:31:07.177 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19625 fp=#0x30000000b19' 2024-08-31T04:31:07.177 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19657 fp=#0x30000002cde' 2024-08-31T04:31:07.178 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19689 fp=#0x30000002d0f' 2024-08-31T04:31:07.178 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19721 fp=#0x30000002d38' 2024-08-31T04:31:07.178 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19753 fp=#0x30000002d35' 2024-08-31T04:31:07.179 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19785 fp=#0x30000002d94' 2024-08-31T04:31:07.179 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19817 fp=#0x30000001162' 2024-08-31T04:31:07.179 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19849 fp=#0x300000011ed' 2024-08-31T04:31:07.180 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19881 fp=#0x3000000115c' 2024-08-31T04:31:07.180 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19913 fp=#0x3000000116b' 2024-08-31T04:31:07.180 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19945 fp=#0x300000011c5' 2024-08-31T04:31:07.181 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19977 fp=#0x30000001409' 2024-08-31T04:31:07.181 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20009 fp=#0x30000001432' 2024-08-31T04:31:07.181 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20041 fp=#0x30000000f9f' 2024-08-31T04:31:07.181 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20073 fp=#0x30000002fdf' 2024-08-31T04:31:07.182 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20105 fp=#0x30000000fd0' 2024-08-31T04:31:07.182 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20137 fp=#0x3000000172d' 2024-08-31T04:31:07.182 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20169 fp=#0x300000016ed' 2024-08-31T04:31:07.183 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20201 fp=#0x300000016d0' 2024-08-31T04:31:07.183 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20233 fp=#0x3000000327d' 2024-08-31T04:31:07.183 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20265 fp=#0x300000031e8' 2024-08-31T04:31:07.184 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20297 fp=#0x30000003079' 2024-08-31T04:31:07.184 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20329 fp=#0x30000003145' 2024-08-31T04:31:07.184 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20361 fp=#0x3000000321a' 2024-08-31T04:31:07.185 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20393 fp=#0x30000001c9e' 2024-08-31T04:31:07.185 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20425 fp=#0x30000001c7e' 2024-08-31T04:31:07.185 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20457 fp=#0x30000001cb4' 2024-08-31T04:31:07.186 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20489 fp=#0x30000001c5f' 2024-08-31T04:31:07.186 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20521 fp=#0x30000001235' 2024-08-31T04:31:07.186 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20553 fp=#0x30000001243' 2024-08-31T04:31:07.186 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20585 fp=#0x30000001212' 2024-08-31T04:31:07.187 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20649 fp=#0x30000002195' 2024-08-31T04:31:07.188 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20745 fp=#0x3000000219c' 2024-08-31T04:31:07.188 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20777 fp=#0x10000003857' 2024-08-31T04:31:07.188 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20809 fp=#0x3000000305a' 2024-08-31T04:31:07.189 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20841 fp=#0x30000003089' 2024-08-31T04:31:07.189 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20905 fp=#0x30000003057' 2024-08-31T04:31:07.190 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20969 fp=#0x300000020e8' 2024-08-31T04:31:07.190 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21001 fp=#0x300000020cd' 2024-08-31T04:31:07.190 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21032 fp=#0x300000015b1' 2024-08-31T04:31:07.191 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21064 fp=#0x30000001647' 2024-08-31T04:31:07.191 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21096 fp=#0x30000001640' 2024-08-31T04:31:07.191 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21128 fp=#0x30000001630' 2024-08-31T04:31:07.192 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21160 fp=#0x30000002bdb' 2024-08-31T04:31:07.192 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21192 fp=#0x30000002c27' 2024-08-31T04:31:07.192 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21224 fp=#0x30000002bee' 2024-08-31T04:31:07.193 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21320 fp=#0x1000000341b' 2024-08-31T04:31:07.193 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21352 fp=#0x10000003246' 2024-08-31T04:31:07.194 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21384 fp=#0x10000003349' 2024-08-31T04:31:07.194 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21416 fp=#0x10000003272' 2024-08-31T04:31:07.194 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21448 fp=#0x1000000333b' 2024-08-31T04:31:07.195 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21480 fp=#0x30000002734' 2024-08-31T04:31:07.195 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21512 fp=#0x300000026ca' 2024-08-31T04:31:07.195 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21544 fp=#0x30000002619' 2024-08-31T04:31:07.195 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21576 fp=#0x30000002718' 2024-08-31T04:31:07.196 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21608 fp=#0x300000036b4' 2024-08-31T04:31:07.196 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21640 fp=#0x30000000d21' 2024-08-31T04:31:07.196 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21672 fp=#0x300000036a3' 2024-08-31T04:31:07.197 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21704 fp=#0x30000000c9a' 2024-08-31T04:31:07.197 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21736 fp=#0x30000000d09' 2024-08-31T04:31:07.197 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21768 fp=#0x30000000aca' 2024-08-31T04:31:07.198 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21800 fp=#0x30000000b30' 2024-08-31T04:31:07.198 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21832 fp=#0x30000000ace' 2024-08-31T04:31:07.198 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21864 fp=#0x30000000ab7' 2024-08-31T04:31:07.199 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21896 fp=#0x3000000058d' 2024-08-31T04:31:07.199 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21960 fp=#0x300000008d9' 2024-08-31T04:31:07.200 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21992 fp=#0x3000000050b' 2024-08-31T04:31:07.200 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22023 fp=#0x3000000193d' 2024-08-31T04:31:07.200 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22055 fp=#0x30000002f71' 2024-08-31T04:31:07.200 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22087 fp=#0x30000001930' 2024-08-31T04:31:07.201 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22119 fp=#0x30000001926' 2024-08-31T04:31:07.201 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22151 fp=#0x3000000298f' 2024-08-31T04:31:07.201 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22183 fp=#0x30000002956' 2024-08-31T04:31:07.202 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22215 fp=#0x3000000295e' 2024-08-31T04:31:07.202 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22247 fp=#0x30000002907' 2024-08-31T04:31:07.202 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22279 fp=#0x30000002074' 2024-08-31T04:31:07.203 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22311 fp=#0x30000001fd3' 2024-08-31T04:31:07.203 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22343 fp=#0x30000002035' 2024-08-31T04:31:07.203 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22375 fp=#0x3000000042a' 2024-08-31T04:31:07.204 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22407 fp=#0x3000000047f' 2024-08-31T04:31:07.204 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22439 fp=#0x30000000420' 2024-08-31T04:31:07.204 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22471 fp=#0x30000000431' 2024-08-31T04:31:07.204 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22503 fp=#0x30000000880' 2024-08-31T04:31:07.205 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22528 fp=#0x30000002bf8' 2024-08-31T04:31:07.205 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22560 fp=#0x30000002c32' 2024-08-31T04:31:07.206 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22623 fp=#0x30000001474' 2024-08-31T04:31:07.206 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22655 fp=#0x300000033c2' 2024-08-31T04:31:07.206 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22687 fp=#0x300000033b7' 2024-08-31T04:31:07.207 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:9753 fp=#0x10000000000' 2024-08-31T04:31:07.207 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:9785 fp=#0x30000002e05' 2024-08-31T04:31:07.208 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:9849 fp=#0x100000037ad' 2024-08-31T04:31:07.208 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:9913 fp=#0x30000002f10' 2024-08-31T04:31:07.213 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:10649 fp=#0x30000000a70' 2024-08-31T04:31:07.215 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:10809 fp=#0x30000000a7b' 2024-08-31T04:31:07.222 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:11865 fp=#0x30000000bce' 2024-08-31T04:31:07.223 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:11929 fp=#0x3000000108a' 2024-08-31T04:31:07.223 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:11961 fp=#0x3000000118f' 2024-08-31T04:31:07.223 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12025 fp=#0x3000000106c' 2024-08-31T04:31:07.224 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12057 fp=#0x3000000320a' 2024-08-31T04:31:07.224 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12089 fp=#0x300000010b9' 2024-08-31T04:31:07.224 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12121 fp=#0x300000031d3' 2024-08-31T04:31:07.225 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12153 fp=#0x3000000113b' 2024-08-31T04:31:07.226 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12345 fp=#0x3000000092c' 2024-08-31T04:31:07.227 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12473 fp=#0x30000002e10' 2024-08-31T04:31:07.228 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12505 fp=#0x30000000f75' 2024-08-31T04:31:07.228 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12537 fp=#0x300000011e3' 2024-08-31T04:31:07.228 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12569 fp=#0x30000000f4e' 2024-08-31T04:31:07.228 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12601 fp=#0x300000033c0' 2024-08-31T04:31:07.229 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12633 fp=#0x30000000e98' 2024-08-31T04:31:07.229 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12665 fp=#0x30000002293' 2024-08-31T04:31:07.229 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12697 fp=#0x30000000e8f' 2024-08-31T04:31:07.230 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12729 fp=#0x30000000eb1' 2024-08-31T04:31:07.230 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12761 fp=#0x30000000e7a' 2024-08-31T04:31:07.230 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12793 fp=#0x30000000e9c' 2024-08-31T04:31:07.231 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12825 fp=#0x30000000ea2' 2024-08-31T04:31:07.231 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12857 fp=#0x10000004410' 2024-08-31T04:31:07.231 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12889 fp=#0x1000000437d' 2024-08-31T04:31:07.231 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12921 fp=#0x10000004282' 2024-08-31T04:31:07.232 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12953 fp=#0x300000003d7' 2024-08-31T04:31:07.232 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12985 fp=#0x1000000420f' 2024-08-31T04:31:07.232 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13017 fp=#0x10000004270' 2024-08-31T04:31:07.233 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13049 fp=#0x1000000421b' 2024-08-31T04:31:07.233 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13081 fp=#0x1000000424b' 2024-08-31T04:31:07.233 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13113 fp=#0x3000000315a' 2024-08-31T04:31:07.234 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13145 fp=#0x300000030ce' 2024-08-31T04:31:07.234 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13177 fp=#0x30000003130' 2024-08-31T04:31:07.235 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13305 fp=#0x300000008a4' 2024-08-31T04:31:07.235 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13337 fp=#0x30000002253' 2024-08-31T04:31:07.235 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13369 fp=#0x300000008c3' 2024-08-31T04:31:07.236 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13401 fp=#0x30000002246' 2024-08-31T04:31:07.236 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13433 fp=#0x3000000223c' 2024-08-31T04:31:07.236 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13465 fp=#0x300000008ab' 2024-08-31T04:31:07.237 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13497 fp=#0x30000002204' 2024-08-31T04:31:07.237 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13529 fp=#0x300000008e7' 2024-08-31T04:31:07.237 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13561 fp=#0x300000032af' 2024-08-31T04:31:07.238 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13593 fp=#0x300000032a7' 2024-08-31T04:31:07.238 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13625 fp=#0x3000000329e' 2024-08-31T04:31:07.238 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13657 fp=#0x30000003338' 2024-08-31T04:31:07.238 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13689 fp=#0x30000002933' 2024-08-31T04:31:07.239 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13721 fp=#0x30000002a0f' 2024-08-31T04:31:07.239 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13753 fp=#0x300000029be' 2024-08-31T04:31:07.239 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13785 fp=#0x30000002955' 2024-08-31T04:31:07.240 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13817 fp=#0x300000029a3' 2024-08-31T04:31:07.240 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13849 fp=#0x30000002980' 2024-08-31T04:31:07.240 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13881 fp=#0x10000003be6' 2024-08-31T04:31:07.241 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13913 fp=#0x10000003d6f' 2024-08-31T04:31:07.241 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13945 fp=#0x10000003f0f' 2024-08-31T04:31:07.241 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13977 fp=#0x10000003c2f' 2024-08-31T04:31:07.242 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14009 fp=#0x300000032b8' 2024-08-31T04:31:07.242 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14041 fp=#0x10000003f18' 2024-08-31T04:31:07.242 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14073 fp=#0x30000000c55' 2024-08-31T04:31:07.242 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14105 fp=#0x30000000c5c' 2024-08-31T04:31:07.243 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14137 fp=#0x300000017cd' 2024-08-31T04:31:07.243 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14169 fp=#0x30000002467' 2024-08-31T04:31:07.243 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14201 fp=#0x30000002441' 2024-08-31T04:31:07.244 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14233 fp=#0x30000002473' 2024-08-31T04:31:07.245 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14393 fp=#0x30000000d9e' 2024-08-31T04:31:07.245 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14425 fp=#0x30000002394' 2024-08-31T04:31:07.245 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14457 fp=#0x30000002389' 2024-08-31T04:31:07.246 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14489 fp=#0x300000023a4' 2024-08-31T04:31:07.246 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14521 fp=#0x30000000d77' 2024-08-31T04:31:07.246 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14553 fp=#0x30000000cd7' 2024-08-31T04:31:07.247 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14585 fp=#0x3000000239b' 2024-08-31T04:31:07.247 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14617 fp=#0x30000002fd1' 2024-08-31T04:31:07.247 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14649 fp=#0x3000000306c' 2024-08-31T04:31:07.250 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14681 fp=#0x30000002fa5' 2024-08-31T04:31:07.250 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14713 fp=#0x30000002fd4' 2024-08-31T04:31:07.251 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14745 fp=#0x10000002441' 2024-08-31T04:31:07.251 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14777 fp=#0x30000002fa8' 2024-08-31T04:31:07.251 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14808 fp=#0x10000003b98' 2024-08-31T04:31:07.251 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14840 fp=#0x30000000a44' 2024-08-31T04:31:07.252 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14872 fp=#0x30000002798' 2024-08-31T04:31:07.252 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14904 fp=#0x300000009d1' 2024-08-31T04:31:07.252 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14936 fp=#0x300000009cc' 2024-08-31T04:31:07.253 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14968 fp=#0x30000000a10' 2024-08-31T04:31:07.253 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15000 fp=#0x30000001561' 2024-08-31T04:31:07.253 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15032 fp=#0x300000016aa' 2024-08-31T04:31:07.254 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15064 fp=#0x30000001585' 2024-08-31T04:31:07.254 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15096 fp=#0x30000001536' 2024-08-31T04:31:07.254 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15128 fp=#0x30000003390' 2024-08-31T04:31:07.255 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15160 fp=#0x300000033b5' 2024-08-31T04:31:07.255 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15192 fp=#0x300000033fd' 2024-08-31T04:31:07.255 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15224 fp=#0x30000002f07' 2024-08-31T04:31:07.255 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15256 fp=#0x30000002eb4' 2024-08-31T04:31:07.256 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15288 fp=#0x30000002f05' 2024-08-31T04:31:07.256 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15320 fp=#0x30000002ea8' 2024-08-31T04:31:07.257 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15352 fp=#0x30000002eb1' 2024-08-31T04:31:07.257 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15384 fp=#0x300000032d3' 2024-08-31T04:31:07.257 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15416 fp=#0x30000000f2b' 2024-08-31T04:31:07.258 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15448 fp=#0x30000001dba' 2024-08-31T04:31:07.258 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15480 fp=#0x30000000f06' 2024-08-31T04:31:07.258 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15512 fp=#0x30000000f32' 2024-08-31T04:31:07.258 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15544 fp=#0x30000000f31' 2024-08-31T04:31:07.259 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15576 fp=#0x30000000f21' 2024-08-31T04:31:07.259 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15608 fp=#0x300000005fb' 2024-08-31T04:31:07.260 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15672 fp=#0x30000000548' 2024-08-31T04:31:07.261 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15800 fp=#0x300000004e5' 2024-08-31T04:31:07.261 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15831 fp=#0x300000012bc' 2024-08-31T04:31:07.261 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15863 fp=#0x30000001276' 2024-08-31T04:31:07.261 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15895 fp=#0x300000012b6' 2024-08-31T04:31:07.262 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15927 fp=#0x300000012f5' 2024-08-31T04:31:07.262 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15959 fp=#0x300000012af' 2024-08-31T04:31:07.262 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15991 fp=#0x30000001297' 2024-08-31T04:31:07.263 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16023 fp=#0x30000001025' 2024-08-31T04:31:07.263 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16087 fp=#0x30000001837' 2024-08-31T04:31:07.263 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16119 fp=#0x3000000182d' 2024-08-31T04:31:07.264 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16151 fp=#0x30000003500' 2024-08-31T04:31:07.264 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16215 fp=#0x300000034fc' 2024-08-31T04:31:07.265 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16247 fp=#0x30000000629' 2024-08-31T04:31:07.265 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16279 fp=#0x300000005c9' 2024-08-31T04:31:07.265 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16311 fp=#0x30000003508' 2024-08-31T04:31:07.266 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16340 fp=#0x10000002868' 2024-08-31T04:31:07.266 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16372 fp=#0x300000020b7' 2024-08-31T04:31:07.266 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16404 fp=#0x3000000206e' 2024-08-31T04:31:07.266 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16436 fp=#0x1000000254c' 2024-08-31T04:31:07.267 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16468 fp=#0x30000001d36' 2024-08-31T04:31:07.267 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16500 fp=#0x30000001d4b' 2024-08-31T04:31:07.267 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16532 fp=#0x30000001cf4' 2024-08-31T04:31:07.268 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16564 fp=#0x30000000206' 2024-08-31T04:31:07.268 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16596 fp=#0x30000001cdd' 2024-08-31T04:31:07.268 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16627 fp=#0x3000000231f' 2024-08-31T04:31:07.269 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16659 fp=#0x30000002108' 2024-08-31T04:31:07.269 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16691 fp=#0x30000002210' 2024-08-31T04:31:07.269 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16723 fp=#0x300000022d9' 2024-08-31T04:31:07.270 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16755 fp=#0x300000003f0' 2024-08-31T04:31:07.270 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16819 fp=#0x30000001a1f' 2024-08-31T04:31:07.270 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16851 fp=#0x3000000194f' 2024-08-31T04:31:07.271 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16883 fp=#0x3000000196a' 2024-08-31T04:31:07.271 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16915 fp=#0x30000001972' 2024-08-31T04:31:07.271 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16946 fp=#0x30000002b92' 2024-08-31T04:31:07.272 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16978 fp=#0x30000001aca' 2024-08-31T04:31:07.272 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17035 fp=#0x100000036b9' 2024-08-31T04:31:07.272 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17067 fp=#0x1000000367b' 2024-08-31T04:31:07.273 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17099 fp=#0x1000000366c' 2024-08-31T04:31:07.273 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17131 fp=#0x30000001717' 2024-08-31T04:31:07.273 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17163 fp=#0x30000001812' 2024-08-31T04:31:07.274 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17195 fp=#0x300000017fe' 2024-08-31T04:31:07.274 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17227 fp=#0x3000000177c' 2024-08-31T04:31:07.274 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17259 fp=#0x300000017d6' 2024-08-31T04:31:07.275 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17291 fp=#0x300000017b1' 2024-08-31T04:31:07.275 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17323 fp=#0x30000001741' 2024-08-31T04:31:07.275 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17355 fp=#0x3000000330f' 2024-08-31T04:31:07.277 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17547 fp=#0x30000000e0f' 2024-08-31T04:31:07.277 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17579 fp=#0x3000000323b' 2024-08-31T04:31:07.277 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17611 fp=#0x30000000db3' 2024-08-31T04:31:07.278 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17643 fp=#0x30000003245' 2024-08-31T04:31:07.278 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17675 fp=#0x300000031c3' 2024-08-31T04:31:07.279 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17771 fp=#0x3000000087e' 2024-08-31T04:31:07.279 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17803 fp=#0x30000001f84' 2024-08-31T04:31:07.279 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17835 fp=#0x30000001faf' 2024-08-31T04:31:07.280 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17867 fp=#0x30000001ff3' 2024-08-31T04:31:07.280 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17899 fp=#0x30000001f49' 2024-08-31T04:31:07.280 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17931 fp=#0x30000003128' 2024-08-31T04:31:07.281 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17963 fp=#0x30000003095' 2024-08-31T04:31:07.281 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17995 fp=#0x30000001c3b' 2024-08-31T04:31:07.281 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18027 fp=#0x30000001c26' 2024-08-31T04:31:07.282 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18059 fp=#0x30000001c0f' 2024-08-31T04:31:07.282 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18091 fp=#0x30000001bfe' 2024-08-31T04:31:07.283 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18123 fp=#0x30000002557' 2024-08-31T04:31:07.284 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18155 fp=#0x30000002561' 2024-08-31T04:31:07.284 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18187 fp=#0x30000002568' 2024-08-31T04:31:07.284 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18219 fp=#0x30000002596' 2024-08-31T04:31:07.285 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18251 fp=#0x3000000289c' 2024-08-31T04:31:07.285 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18283 fp=#0x3000000285c' 2024-08-31T04:31:07.285 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18315 fp=#0x30000002886' 2024-08-31T04:31:07.286 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18347 fp=#0x300000027b9' 2024-08-31T04:31:07.286 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18379 fp=#0x30000002821' 2024-08-31T04:31:07.286 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18411 fp=#0x30000002f12' 2024-08-31T04:31:07.287 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18443 fp=#0x30000002f1e' 2024-08-31T04:31:07.287 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18475 fp=#0x30000003001' 2024-08-31T04:31:07.287 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18507 fp=#0x30000003004' 2024-08-31T04:31:07.288 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18539 fp=#0x30000002f44' 2024-08-31T04:31:07.288 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18603 fp=#0x10000001d12' 2024-08-31T04:31:07.289 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18667 fp=#0x10000001d53' 2024-08-31T04:31:07.289 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18699 fp=#0x30000001391' 2024-08-31T04:31:07.289 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18731 fp=#0x300000013b1' 2024-08-31T04:31:07.290 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18763 fp=#0x300000013d7' 2024-08-31T04:31:07.290 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18795 fp=#0x300000013c6' 2024-08-31T04:31:07.290 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18827 fp=#0x30000001505' 2024-08-31T04:31:07.291 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18859 fp=#0x300000013a0' 2024-08-31T04:31:07.291 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18891 fp=#0x30000001101' 2024-08-31T04:31:07.291 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18923 fp=#0x30000001d6e' 2024-08-31T04:31:07.292 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18955 fp=#0x30000001d71' 2024-08-31T04:31:07.292 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18987 fp=#0x30000001072' 2024-08-31T04:31:07.292 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19019 fp=#0x30000002e55' 2024-08-31T04:31:07.293 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19051 fp=#0x3000000113a' 2024-08-31T04:31:07.293 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19083 fp=#0x30000001116' 2024-08-31T04:31:07.293 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19115 fp=#0x3000000111f' 2024-08-31T04:31:07.294 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19147 fp=#0x300000015b0' 2024-08-31T04:31:07.294 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19179 fp=#0x30000001672' 2024-08-31T04:31:07.295 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19275 fp=#0x100000008e1' 2024-08-31T04:31:07.295 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19307 fp=#0x100000008d1' 2024-08-31T04:31:07.296 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19339 fp=#0x100000008ef' 2024-08-31T04:31:07.296 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19371 fp=#0x100000008c6' 2024-08-31T04:31:07.296 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19403 fp=#0x300000014de' 2024-08-31T04:31:07.297 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19434 fp=#0x30000000bf8' 2024-08-31T04:31:07.297 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19466 fp=#0x30000000bec' 2024-08-31T04:31:07.297 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19498 fp=#0x30000000baa' 2024-08-31T04:31:07.298 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19530 fp=#0x30000000bbb' 2024-08-31T04:31:07.298 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19562 fp=#0x30000000b41' 2024-08-31T04:31:07.298 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19594 fp=#0x30000000b3b' 2024-08-31T04:31:07.298 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19626 fp=#0x30000000b08' 2024-08-31T04:31:07.299 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19658 fp=#0x30000002ddc' 2024-08-31T04:31:07.299 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19690 fp=#0x30000002d61' 2024-08-31T04:31:07.299 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19722 fp=#0x30000002c2a' 2024-08-31T04:31:07.300 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19754 fp=#0x30000002c78' 2024-08-31T04:31:07.300 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19786 fp=#0x30000002c0c' 2024-08-31T04:31:07.300 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19818 fp=#0x3000000144e' 2024-08-31T04:31:07.301 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19850 fp=#0x300000011e1' 2024-08-31T04:31:07.301 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19882 fp=#0x30000001440' 2024-08-31T04:31:07.301 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19914 fp=#0x300000011de' 2024-08-31T04:31:07.302 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19946 fp=#0x30000001141' 2024-08-31T04:31:07.302 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19978 fp=#0x3000000141a' 2024-08-31T04:31:07.302 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20010 fp=#0x300000013f7' 2024-08-31T04:31:07.303 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20042 fp=#0x30000000fb3' 2024-08-31T04:31:07.303 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20074 fp=#0x30000000fa3' 2024-08-31T04:31:07.303 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20106 fp=#0x30000000fca' 2024-08-31T04:31:07.303 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20138 fp=#0x300000016b7' 2024-08-31T04:31:07.304 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20170 fp=#0x3000000173c' 2024-08-31T04:31:07.304 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20202 fp=#0x300000016fd' 2024-08-31T04:31:07.304 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20234 fp=#0x300000031c7' 2024-08-31T04:31:07.305 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20266 fp=#0x30000003187' 2024-08-31T04:31:07.305 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20298 fp=#0x300000030bc' 2024-08-31T04:31:07.305 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20330 fp=#0x3000000324b' 2024-08-31T04:31:07.306 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20362 fp=#0x30000003084' 2024-08-31T04:31:07.306 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20394 fp=#0x30000001ce5' 2024-08-31T04:31:07.306 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20426 fp=#0x30000001c82' 2024-08-31T04:31:07.307 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20458 fp=#0x30000001c9f' 2024-08-31T04:31:07.307 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20490 fp=#0x30000001cc5' 2024-08-31T04:31:07.307 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20522 fp=#0x3000000126b' 2024-08-31T04:31:07.307 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20554 fp=#0x3000000123b' 2024-08-31T04:31:07.308 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20586 fp=#0x3000000122d' 2024-08-31T04:31:07.308 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20650 fp=#0x30000002194' 2024-08-31T04:31:07.309 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20682 fp=#0x300000021b7' 2024-08-31T04:31:07.309 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20778 fp=#0x10000003875' 2024-08-31T04:31:07.310 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20810 fp=#0x3000000305c' 2024-08-31T04:31:07.310 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20874 fp=#0x30000003046' 2024-08-31T04:31:07.311 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20906 fp=#0x10000003757' 2024-08-31T04:31:07.311 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20938 fp=#0x10000003761' 2024-08-31T04:31:07.311 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20970 fp=#0x300000020ad' 2024-08-31T04:31:07.312 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21002 fp=#0x300000020c6' 2024-08-31T04:31:07.312 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21033 fp=#0x30000001602' 2024-08-31T04:31:07.312 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21065 fp=#0x300000015e2' 2024-08-31T04:31:07.313 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21097 fp=#0x300000015d2' 2024-08-31T04:31:07.313 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21129 fp=#0x3000000163e' 2024-08-31T04:31:07.313 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21161 fp=#0x30000002bfb' 2024-08-31T04:31:07.314 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21289 fp=#0x30000002c34' 2024-08-31T04:31:07.314 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21321 fp=#0x100000032b1' 2024-08-31T04:31:07.315 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21353 fp=#0x100000032ba' 2024-08-31T04:31:07.315 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21385 fp=#0x10000003292' 2024-08-31T04:31:07.315 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21417 fp=#0x100000032d5' 2024-08-31T04:31:07.316 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21449 fp=#0x30000002738' 2024-08-31T04:31:07.316 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21481 fp=#0x30000002677' 2024-08-31T04:31:07.316 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21513 fp=#0x30000002613' 2024-08-31T04:31:07.317 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21545 fp=#0x30000002736' 2024-08-31T04:31:07.317 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21577 fp=#0x300000026e9' 2024-08-31T04:31:07.317 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21609 fp=#0x30000000d4a' 2024-08-31T04:31:07.317 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21641 fp=#0x30000000c89' 2024-08-31T04:31:07.318 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21673 fp=#0x30000000cd9' 2024-08-31T04:31:07.318 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21705 fp=#0x30000003682' 2024-08-31T04:31:07.318 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21737 fp=#0x300000036f8' 2024-08-31T04:31:07.319 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21769 fp=#0x30000000af9' 2024-08-31T04:31:07.319 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21801 fp=#0x30000000b1f' 2024-08-31T04:31:07.319 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21833 fp=#0x30000000b34' 2024-08-31T04:31:07.320 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21865 fp=#0x30000000a93' 2024-08-31T04:31:07.320 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21961 fp=#0x30000000504' 2024-08-31T04:31:07.321 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22024 fp=#0x30000002f7c' 2024-08-31T04:31:07.321 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22056 fp=#0x30000002f85' 2024-08-31T04:31:07.321 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22088 fp=#0x30000001937' 2024-08-31T04:31:07.322 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22120 fp=#0x30000001916' 2024-08-31T04:31:07.322 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22152 fp=#0x3000000297b' 2024-08-31T04:31:07.322 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22184 fp=#0x30000002940' 2024-08-31T04:31:07.323 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22216 fp=#0x300000028ee' 2024-08-31T04:31:07.323 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22248 fp=#0x3000000299c' 2024-08-31T04:31:07.323 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22280 fp=#0x30000002068' 2024-08-31T04:31:07.324 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22312 fp=#0x3000000205a' 2024-08-31T04:31:07.324 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22344 fp=#0x30000002009' 2024-08-31T04:31:07.325 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22472 fp=#0x3000000042c' 2024-08-31T04:31:07.326 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22529 fp=#0x30000002c75' 2024-08-31T04:31:07.326 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22561 fp=#0x30000002c13' 2024-08-31T04:31:07.326 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22592 fp=#0x300000033ba' 2024-08-31T04:31:07.327 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22624 fp=#0x3000000339f' 2024-08-31T04:31:07.327 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22688 fp=#0x30000001486' 2024-08-31T04:31:07.328 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:9754 fp=#0x10000000001' 2024-08-31T04:31:07.329 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:9914 fp=#0x10000001cf0' 2024-08-31T04:31:07.329 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:9946 fp=#0x10000003209' 2024-08-31T04:31:07.334 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:10650 fp=#0x30000000a6f' 2024-08-31T04:31:07.335 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:10682 fp=#0x30000000a74' 2024-08-31T04:31:07.336 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:10778 fp=#0x30000000a60' 2024-08-31T04:31:07.343 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:11770 fp=#0x30000000c3d' 2024-08-31T04:31:07.343 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:11834 fp=#0x300000023c7' 2024-08-31T04:31:07.344 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:11866 fp=#0x30000000c38' 2024-08-31T04:31:07.344 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:11898 fp=#0x300000023ce' 2024-08-31T04:31:07.344 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:11930 fp=#0x30000001080' 2024-08-31T04:31:07.345 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:11962 fp=#0x30000001009' 2024-08-31T04:31:07.345 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:11994 fp=#0x300000010d1' 2024-08-31T04:31:07.346 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12058 fp=#0x30000001076' 2024-08-31T04:31:07.346 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12090 fp=#0x30000001093' 2024-08-31T04:31:07.346 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12122 fp=#0x30000001121' 2024-08-31T04:31:07.347 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12154 fp=#0x3000000104e' 2024-08-31T04:31:07.348 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12282 fp=#0x30000000951' 2024-08-31T04:31:07.348 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12346 fp=#0x300000009d4' 2024-08-31T04:31:07.349 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12410 fp=#0x30000002e52' 2024-08-31T04:31:07.350 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12506 fp=#0x30000000f5e' 2024-08-31T04:31:07.350 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12538 fp=#0x30000000f68' 2024-08-31T04:31:07.350 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12570 fp=#0x30000000f54' 2024-08-31T04:31:07.351 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12602 fp=#0x300000033a6' 2024-08-31T04:31:07.351 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12634 fp=#0x30000000e7e' 2024-08-31T04:31:07.351 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12666 fp=#0x30000000e8c' 2024-08-31T04:31:07.352 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12698 fp=#0x30000003374' 2024-08-31T04:31:07.352 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12730 fp=#0x30000000e73' 2024-08-31T04:31:07.352 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12762 fp=#0x30000000e87' 2024-08-31T04:31:07.352 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12794 fp=#0x30000000e33' 2024-08-31T04:31:07.353 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12826 fp=#0x30000000e34' 2024-08-31T04:31:07.353 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12858 fp=#0x30000002891' 2024-08-31T04:31:07.353 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12890 fp=#0x10000004267' 2024-08-31T04:31:07.354 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12922 fp=#0x30000002883' 2024-08-31T04:31:07.354 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12954 fp=#0x10000004319' 2024-08-31T04:31:07.354 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12986 fp=#0x300000028a4' 2024-08-31T04:31:07.355 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13018 fp=#0x10000004238' 2024-08-31T04:31:07.355 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13050 fp=#0x100000043bc' 2024-08-31T04:31:07.355 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13082 fp=#0x10000004324' 2024-08-31T04:31:07.356 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13114 fp=#0x3000000316d' 2024-08-31T04:31:07.356 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13146 fp=#0x3000000316f' 2024-08-31T04:31:07.356 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13178 fp=#0x3000000309a' 2024-08-31T04:31:07.357 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13210 fp=#0x30000001f92' 2024-08-31T04:31:07.357 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13306 fp=#0x300000008b8' 2024-08-31T04:31:07.358 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13338 fp=#0x3000000089e' 2024-08-31T04:31:07.358 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13370 fp=#0x30000000883' 2024-08-31T04:31:07.358 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13402 fp=#0x3000000222a' 2024-08-31T04:31:07.359 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13434 fp=#0x30000000890' 2024-08-31T04:31:07.359 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13466 fp=#0x300000008c7' 2024-08-31T04:31:07.359 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13498 fp=#0x300000008d2' 2024-08-31T04:31:07.360 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13530 fp=#0x3000000225e' 2024-08-31T04:31:07.360 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13562 fp=#0x3000000328a' 2024-08-31T04:31:07.360 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13594 fp=#0x30000003333' 2024-08-31T04:31:07.361 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13626 fp=#0x300000032e8' 2024-08-31T04:31:07.361 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13658 fp=#0x300000032f6' 2024-08-31T04:31:07.361 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13690 fp=#0x30000002a30' 2024-08-31T04:31:07.362 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13722 fp=#0x300000028b4' 2024-08-31T04:31:07.362 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13754 fp=#0x30000002901' 2024-08-31T04:31:07.362 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13786 fp=#0x300000029ec' 2024-08-31T04:31:07.363 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13818 fp=#0x30000002a17' 2024-08-31T04:31:07.363 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13850 fp=#0x300000028f1' 2024-08-31T04:31:07.363 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13882 fp=#0x10000003de3' 2024-08-31T04:31:07.363 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13914 fp=#0x10000003d33' 2024-08-31T04:31:07.364 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13946 fp=#0x10000003f07' 2024-08-31T04:31:07.364 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13978 fp=#0x10000003d41' 2024-08-31T04:31:07.365 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14074 fp=#0x30000000c7f' 2024-08-31T04:31:07.365 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14106 fp=#0x30000000c73' 2024-08-31T04:31:07.366 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14138 fp=#0x3000000246b' 2024-08-31T04:31:07.366 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14170 fp=#0x30000001780' 2024-08-31T04:31:07.366 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14202 fp=#0x30000001788' 2024-08-31T04:31:07.367 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14234 fp=#0x30000002461' 2024-08-31T04:31:07.368 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14394 fp=#0x30000000d7d' 2024-08-31T04:31:07.368 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14426 fp=#0x30000000d84' 2024-08-31T04:31:07.368 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14458 fp=#0x30000000d0e' 2024-08-31T04:31:07.369 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14490 fp=#0x30000000cbf' 2024-08-31T04:31:07.369 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14522 fp=#0x30000000d60' 2024-08-31T04:31:07.369 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14554 fp=#0x30000000d82' 2024-08-31T04:31:07.370 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14586 fp=#0x30000000ca3' 2024-08-31T04:31:07.370 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14618 fp=#0x30000002fc8' 2024-08-31T04:31:07.370 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14650 fp=#0x30000002f93' 2024-08-31T04:31:07.371 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14682 fp=#0x30000002f97' 2024-08-31T04:31:07.371 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14714 fp=#0x30000002f89' 2024-08-31T04:31:07.371 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14746 fp=#0x100000023ff' 2024-08-31T04:31:07.371 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14778 fp=#0x30000002faf' 2024-08-31T04:31:07.372 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14809 fp=#0x10000003c3d' 2024-08-31T04:31:07.372 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14841 fp=#0x3000000098a' 2024-08-31T04:31:07.372 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14873 fp=#0x300000009f8' 2024-08-31T04:31:07.373 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14905 fp=#0x3000000279a' 2024-08-31T04:31:07.373 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14937 fp=#0x300000009e9' 2024-08-31T04:31:07.373 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14969 fp=#0x30000000905' 2024-08-31T04:31:07.374 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15001 fp=#0x30000001688' 2024-08-31T04:31:07.374 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15033 fp=#0x30000001605' 2024-08-31T04:31:07.374 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15065 fp=#0x30000001504' 2024-08-31T04:31:07.374 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15097 fp=#0x30000001597' 2024-08-31T04:31:07.375 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15129 fp=#0x3000000340c' 2024-08-31T04:31:07.375 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15161 fp=#0x300000033d7' 2024-08-31T04:31:07.375 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15193 fp=#0x300000033e1' 2024-08-31T04:31:07.376 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15225 fp=#0x30000002ed0' 2024-08-31T04:31:07.376 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15257 fp=#0x30000002ef6' 2024-08-31T04:31:07.376 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15289 fp=#0x30000002eca' 2024-08-31T04:31:07.377 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15321 fp=#0x30000002f04' 2024-08-31T04:31:07.377 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15353 fp=#0x30000002eee' 2024-08-31T04:31:07.377 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15385 fp=#0x300000032c7' 2024-08-31T04:31:07.378 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15417 fp=#0x30000000ed6' 2024-08-31T04:31:07.378 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15449 fp=#0x30000000f20' 2024-08-31T04:31:07.378 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15481 fp=#0x30000000f1f' 2024-08-31T04:31:07.379 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15513 fp=#0x30000000ef6' 2024-08-31T04:31:07.379 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15545 fp=#0x30000000f10' 2024-08-31T04:31:07.379 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15577 fp=#0x30000000ec1' 2024-08-31T04:31:07.379 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15609 fp=#0x300000005b9' 2024-08-31T04:31:07.380 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15705 fp=#0x300000004f6' 2024-08-31T04:31:07.381 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15801 fp=#0x3000000054b' 2024-08-31T04:31:07.381 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15832 fp=#0x300000014f2' 2024-08-31T04:31:07.382 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15864 fp=#0x300000012d4' 2024-08-31T04:31:07.382 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15896 fp=#0x300000014ee' 2024-08-31T04:31:07.382 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15928 fp=#0x300000012f9' 2024-08-31T04:31:07.382 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15960 fp=#0x30000001304' 2024-08-31T04:31:07.383 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15992 fp=#0x300000012f2' 2024-08-31T04:31:07.383 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16024 fp=#0x30000001052' 2024-08-31T04:31:07.383 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16056 fp=#0x30000001011' 2024-08-31T04:31:07.384 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16088 fp=#0x30000002df7' 2024-08-31T04:31:07.384 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16120 fp=#0x30000001838' 2024-08-31T04:31:07.385 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16184 fp=#0x3000000063c' 2024-08-31T04:31:07.385 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16216 fp=#0x300000005e1' 2024-08-31T04:31:07.385 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16248 fp=#0x3000000062d' 2024-08-31T04:31:07.386 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16280 fp=#0x30000000638' 2024-08-31T04:31:07.386 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16312 fp=#0x30000003421' 2024-08-31T04:31:07.386 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16341 fp=#0x10000002822' 2024-08-31T04:31:07.387 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16405 fp=#0x3000000207d' 2024-08-31T04:31:07.387 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16437 fp=#0x10000002550' 2024-08-31T04:31:07.387 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16469 fp=#0x30000001d22' 2024-08-31T04:31:07.388 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16501 fp=#0x100000024cd' 2024-08-31T04:31:07.388 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16533 fp=#0x30000001d45' 2024-08-31T04:31:07.388 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16565 fp=#0x10000002535' 2024-08-31T04:31:07.389 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16597 fp=#0x100000024b9' 2024-08-31T04:31:07.389 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16628 fp=#0x3000000210a' 2024-08-31T04:31:07.389 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16660 fp=#0x30000002344' 2024-08-31T04:31:07.390 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16692 fp=#0x30000002237' 2024-08-31T04:31:07.390 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16724 fp=#0x30000002248' 2024-08-31T04:31:07.390 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16756 fp=#0x300000003e2' 2024-08-31T04:31:07.391 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16788 fp=#0x3000000196f' 2024-08-31T04:31:07.391 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16820 fp=#0x3000000197b' 2024-08-31T04:31:07.392 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16947 fp=#0x30000002b5d' 2024-08-31T04:31:07.392 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16979 fp=#0x30000001aa4' 2024-08-31T04:31:07.393 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17068 fp=#0x10000003710' 2024-08-31T04:31:07.393 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17100 fp=#0x10000003608' 2024-08-31T04:31:07.394 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17132 fp=#0x30000001806' 2024-08-31T04:31:07.394 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17164 fp=#0x3000000170b' 2024-08-31T04:31:07.394 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17196 fp=#0x30000001776' 2024-08-31T04:31:07.394 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17228 fp=#0x30000002cd4' 2024-08-31T04:31:07.395 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17260 fp=#0x3000000175c' 2024-08-31T04:31:07.395 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17292 fp=#0x30000001804' 2024-08-31T04:31:07.395 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17324 fp=#0x300000017e8' 2024-08-31T04:31:07.396 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17356 fp=#0x30000003365' 2024-08-31T04:31:07.397 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17548 fp=#0x300000031b8' 2024-08-31T04:31:07.397 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17580 fp=#0x30000000da3' 2024-08-31T04:31:07.398 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17612 fp=#0x30000000e0a' 2024-08-31T04:31:07.398 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17644 fp=#0x30000000de3' 2024-08-31T04:31:07.399 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17804 fp=#0x3000000204e' 2024-08-31T04:31:07.399 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17836 fp=#0x30000001f65' 2024-08-31T04:31:07.400 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17868 fp=#0x30000001ffb' 2024-08-31T04:31:07.400 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17900 fp=#0x30000001f7a' 2024-08-31T04:31:07.401 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17932 fp=#0x30000003103' 2024-08-31T04:31:07.401 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17964 fp=#0x300000030ee' 2024-08-31T04:31:07.401 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17996 fp=#0x30000001c36' 2024-08-31T04:31:07.401 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18028 fp=#0x30000001c1e' 2024-08-31T04:31:07.402 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18060 fp=#0x30000001bf4' 2024-08-31T04:31:07.402 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18092 fp=#0x30000001c01' 2024-08-31T04:31:07.402 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18124 fp=#0x300000025a1' 2024-08-31T04:31:07.403 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18156 fp=#0x30000002558' 2024-08-31T04:31:07.403 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18188 fp=#0x3000000257d' 2024-08-31T04:31:07.403 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18220 fp=#0x3000000254c' 2024-08-31T04:31:07.403 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18252 fp=#0x300000027bb' 2024-08-31T04:31:07.404 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18284 fp=#0x300000027f9' 2024-08-31T04:31:07.404 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18316 fp=#0x30000002801' 2024-08-31T04:31:07.404 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18348 fp=#0x30000002867' 2024-08-31T04:31:07.405 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18380 fp=#0x30000002f15' 2024-08-31T04:31:07.405 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18412 fp=#0x30000002fff' 2024-08-31T04:31:07.406 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18444 fp=#0x30000002f4a' 2024-08-31T04:31:07.406 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18476 fp=#0x30000003032' 2024-08-31T04:31:07.406 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18508 fp=#0x30000002f20' 2024-08-31T04:31:07.407 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18540 fp=#0x30000002f4f' 2024-08-31T04:31:07.407 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18572 fp=#0x10000001d74' 2024-08-31T04:31:07.407 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18604 fp=#0x10000001d19' 2024-08-31T04:31:07.408 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18636 fp=#0x10000001d60' 2024-08-31T04:31:07.408 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18668 fp=#0x10000001d4c' 2024-08-31T04:31:07.408 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18700 fp=#0x3000000151b' 2024-08-31T04:31:07.409 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18732 fp=#0x30000001357' 2024-08-31T04:31:07.409 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18764 fp=#0x300000014c8' 2024-08-31T04:31:07.409 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18796 fp=#0x3000000138f' 2024-08-31T04:31:07.409 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18828 fp=#0x300000013e1' 2024-08-31T04:31:07.410 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18860 fp=#0x300000013d9' 2024-08-31T04:31:07.410 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18892 fp=#0x30000001d92' 2024-08-31T04:31:07.410 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18924 fp=#0x300000010dc' 2024-08-31T04:31:07.411 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18956 fp=#0x30000001d8c' 2024-08-31T04:31:07.411 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18988 fp=#0x30000001d61' 2024-08-31T04:31:07.411 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19020 fp=#0x300000010ce' 2024-08-31T04:31:07.412 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19052 fp=#0x3000000111c' 2024-08-31T04:31:07.412 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19084 fp=#0x3000000117d' 2024-08-31T04:31:07.412 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19116 fp=#0x300000011d4' 2024-08-31T04:31:07.412 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19148 fp=#0x3000000165f' 2024-08-31T04:31:07.413 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19212 fp=#0x3000000164c' 2024-08-31T04:31:07.413 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19244 fp=#0x3000000162f' 2024-08-31T04:31:07.414 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19276 fp=#0x1000000089d' 2024-08-31T04:31:07.414 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19308 fp=#0x30000002bb2' 2024-08-31T04:31:07.414 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19340 fp=#0x30000002bae' 2024-08-31T04:31:07.415 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19372 fp=#0x300000014e4' 2024-08-31T04:31:07.415 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19404 fp=#0x3000000150a' 2024-08-31T04:31:07.415 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19435 fp=#0x30000000b73' 2024-08-31T04:31:07.416 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19467 fp=#0x30000000bc3' 2024-08-31T04:31:07.416 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19499 fp=#0x30000000b71' 2024-08-31T04:31:07.416 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19531 fp=#0x30000000b78' 2024-08-31T04:31:07.416 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19563 fp=#0x30000000b29' 2024-08-31T04:31:07.417 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19595 fp=#0x30000000ae0' 2024-08-31T04:31:07.417 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19627 fp=#0x30000000a8c' 2024-08-31T04:31:07.417 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19659 fp=#0x30000002c1f' 2024-08-31T04:31:07.418 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19691 fp=#0x30000002d2d' 2024-08-31T04:31:07.418 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19723 fp=#0x30000002c63' 2024-08-31T04:31:07.418 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19755 fp=#0x30000002c41' 2024-08-31T04:31:07.419 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19787 fp=#0x30000002c82' 2024-08-31T04:31:07.419 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19819 fp=#0x300000011a9' 2024-08-31T04:31:07.419 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19851 fp=#0x300000011d9' 2024-08-31T04:31:07.419 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19883 fp=#0x3000000145a' 2024-08-31T04:31:07.420 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19915 fp=#0x300000011b0' 2024-08-31T04:31:07.420 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19947 fp=#0x30000001431' 2024-08-31T04:31:07.421 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19979 fp=#0x300000013f5' 2024-08-31T04:31:07.421 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20011 fp=#0x30000001423' 2024-08-31T04:31:07.421 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20043 fp=#0x30000000faf' 2024-08-31T04:31:07.422 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20075 fp=#0x30000000fa2' 2024-08-31T04:31:07.422 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20107 fp=#0x30000000fb2' 2024-08-31T04:31:07.422 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20139 fp=#0x300000016ff' 2024-08-31T04:31:07.422 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20171 fp=#0x300000016e4' 2024-08-31T04:31:07.423 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20203 fp=#0x300000016c0' 2024-08-31T04:31:07.423 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20235 fp=#0x3000000327f' 2024-08-31T04:31:07.423 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20267 fp=#0x3000000317f' 2024-08-31T04:31:07.424 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20299 fp=#0x300000030d5' 2024-08-31T04:31:07.424 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20331 fp=#0x3000000305b' 2024-08-31T04:31:07.424 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20363 fp=#0x30000003113' 2024-08-31T04:31:07.425 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20395 fp=#0x30000001c65' 2024-08-31T04:31:07.425 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20427 fp=#0x30000001ca7' 2024-08-31T04:31:07.425 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20459 fp=#0x30000001c97' 2024-08-31T04:31:07.426 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20491 fp=#0x30000001c5c' 2024-08-31T04:31:07.426 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20523 fp=#0x30000001274' 2024-08-31T04:31:07.426 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20555 fp=#0x30000001234' 2024-08-31T04:31:07.426 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20587 fp=#0x3000000123a' 2024-08-31T04:31:07.427 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20683 fp=#0x3000000214c' 2024-08-31T04:31:07.428 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20747 fp=#0x300000021b2' 2024-08-31T04:31:07.428 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20779 fp=#0x300000030b8' 2024-08-31T04:31:07.429 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20875 fp=#0x1000000372a' 2024-08-31T04:31:07.429 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20907 fp=#0x10000003722' 2024-08-31T04:31:07.429 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20939 fp=#0x30000003080' 2024-08-31T04:31:07.430 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20971 fp=#0x300000020e6' 2024-08-31T04:31:07.430 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21003 fp=#0x300000020b5' 2024-08-31T04:31:07.430 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21034 fp=#0x300000015f4' 2024-08-31T04:31:07.431 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21066 fp=#0x30000001658' 2024-08-31T04:31:07.431 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21098 fp=#0x30000001629' 2024-08-31T04:31:07.431 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21130 fp=#0x300000015a7' 2024-08-31T04:31:07.432 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21258 fp=#0x3000000183d' 2024-08-31T04:31:07.433 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21290 fp=#0x30000002bc2' 2024-08-31T04:31:07.433 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21322 fp=#0x10000003257' 2024-08-31T04:31:07.433 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21354 fp=#0x100000032c6' 2024-08-31T04:31:07.433 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21386 fp=#0x1000000324a' 2024-08-31T04:31:07.434 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21418 fp=#0x10000003267' 2024-08-31T04:31:07.434 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21450 fp=#0x30000002733' 2024-08-31T04:31:07.434 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21482 fp=#0x30000002655' 2024-08-31T04:31:07.435 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21514 fp=#0x30000002691' 2024-08-31T04:31:07.435 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21546 fp=#0x300000026e3' 2024-08-31T04:31:07.435 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21578 fp=#0x300000026c4' 2024-08-31T04:31:07.436 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21610 fp=#0x30000000d5c' 2024-08-31T04:31:07.436 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21642 fp=#0x300000036ba' 2024-08-31T04:31:07.436 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21674 fp=#0x30000000cf9' 2024-08-31T04:31:07.436 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21706 fp=#0x30000000c90' 2024-08-31T04:31:07.437 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21738 fp=#0x300000036e4' 2024-08-31T04:31:07.437 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21770 fp=#0x30000000b4f' 2024-08-31T04:31:07.437 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21802 fp=#0x30000000ab2' 2024-08-31T04:31:07.438 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21834 fp=#0x30000000b14' 2024-08-31T04:31:07.438 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21866 fp=#0x30000000aa9' 2024-08-31T04:31:07.438 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21898 fp=#0x30000000560' 2024-08-31T04:31:07.439 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22025 fp=#0x30000002f73' 2024-08-31T04:31:07.439 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22057 fp=#0x30000001941' 2024-08-31T04:31:07.440 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22089 fp=#0x3000000190e' 2024-08-31T04:31:07.440 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22121 fp=#0x300000029a2' 2024-08-31T04:31:07.440 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22153 fp=#0x3000000294a' 2024-08-31T04:31:07.441 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22185 fp=#0x30000002960' 2024-08-31T04:31:07.441 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22217 fp=#0x300000029a4' 2024-08-31T04:31:07.441 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22249 fp=#0x30000002929' 2024-08-31T04:31:07.442 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22281 fp=#0x30000002089' 2024-08-31T04:31:07.442 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22313 fp=#0x3000000203f' 2024-08-31T04:31:07.442 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22345 fp=#0x30000002046' 2024-08-31T04:31:07.442 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22377 fp=#0x30000000496' 2024-08-31T04:31:07.443 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22409 fp=#0x30000000435' 2024-08-31T04:31:07.443 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22473 fp=#0x30000000422' 2024-08-31T04:31:07.444 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22505 fp=#0x3000000043b' 2024-08-31T04:31:07.444 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22530 fp=#0x30000002c8b' 2024-08-31T04:31:07.444 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22562 fp=#0x30000002c03' 2024-08-31T04:31:07.444 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22593 fp=#0x3000000339d' 2024-08-31T04:31:07.445 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22625 fp=#0x30000003397' 2024-08-31T04:31:07.445 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22657 fp=#0x30000001479' 2024-08-31T04:31:07.445 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22689 fp=#0x3000000148d' 2024-08-31T04:31:07.446 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:9755 fp=#0x100000001fa' 2024-08-31T04:31:07.446 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:9787 fp=#0x30000000f3d' 2024-08-31T04:31:07.447 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:9819 fp=#0x30000000901' 2024-08-31T04:31:07.447 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:9915 fp=#0x3000000132e' 2024-08-31T04:31:07.448 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:9947 fp=#0x300000025eb' 2024-08-31T04:31:07.451 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:10427 fp=#0x30000000d74' 2024-08-31T04:31:07.453 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:10619 fp=#0x30000000a7c' 2024-08-31T04:31:07.453 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:10715 fp=#0x30000000a81' 2024-08-31T04:31:07.462 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:11771 fp=#0x30000000c3b' 2024-08-31T04:31:07.462 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:11803 fp=#0x30000000c3c' 2024-08-31T04:31:07.462 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:11835 fp=#0x30000000c41' 2024-08-31T04:31:07.463 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:11899 fp=#0x300000023bf' 2024-08-31T04:31:07.463 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:11931 fp=#0x3000000103e' 2024-08-31T04:31:07.464 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:11963 fp=#0x300000010e5' 2024-08-31T04:31:07.464 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:11995 fp=#0x3000000320f' 2024-08-31T04:31:07.465 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12123 fp=#0x3000000104b' 2024-08-31T04:31:07.465 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12155 fp=#0x30000001103' 2024-08-31T04:31:07.466 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12251 fp=#0x300000009a3' 2024-08-31T04:31:07.467 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12411 fp=#0x30000002e08' 2024-08-31T04:31:07.468 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12475 fp=#0x30000002e1b' 2024-08-31T04:31:07.469 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12539 fp=#0x30000000f6c' 2024-08-31T04:31:07.469 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12571 fp=#0x30000000f76' 2024-08-31T04:31:07.469 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12603 fp=#0x30000000e82' 2024-08-31T04:31:07.470 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12635 fp=#0x30000000e9b' 2024-08-31T04:31:07.470 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12667 fp=#0x30000000e19' 2024-08-31T04:31:07.470 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12699 fp=#0x30000000e84' 2024-08-31T04:31:07.470 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12731 fp=#0x30000000e65' 2024-08-31T04:31:07.471 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12763 fp=#0x30000000e4d' 2024-08-31T04:31:07.471 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12795 fp=#0x30000000e1c' 2024-08-31T04:31:07.471 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12827 fp=#0x30000000e92' 2024-08-31T04:31:07.472 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12859 fp=#0x30000002872' 2024-08-31T04:31:07.472 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12891 fp=#0x100000043b2' 2024-08-31T04:31:07.472 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12923 fp=#0x30000002813' 2024-08-31T04:31:07.473 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12955 fp=#0x10000004341' 2024-08-31T04:31:07.473 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12987 fp=#0x300000027fa' 2024-08-31T04:31:07.473 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13019 fp=#0x10000004337' 2024-08-31T04:31:07.474 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13051 fp=#0x100000041f8' 2024-08-31T04:31:07.474 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13083 fp=#0x100000043d2' 2024-08-31T04:31:07.475 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13115 fp=#0x3000000314c' 2024-08-31T04:31:07.475 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13147 fp=#0x30000003139' 2024-08-31T04:31:07.476 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13307 fp=#0x300000008b4' 2024-08-31T04:31:07.476 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13339 fp=#0x3000000221b' 2024-08-31T04:31:07.477 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13371 fp=#0x30000002203' 2024-08-31T04:31:07.477 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13403 fp=#0x300000008fc' 2024-08-31T04:31:07.477 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13435 fp=#0x30000000893' 2024-08-31T04:31:07.478 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13467 fp=#0x30000000a4c' 2024-08-31T04:31:07.478 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13499 fp=#0x30000002213' 2024-08-31T04:31:07.478 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13531 fp=#0x300000009b4' 2024-08-31T04:31:07.479 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13563 fp=#0x300000032ad' 2024-08-31T04:31:07.479 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13595 fp=#0x3000000332a' 2024-08-31T04:31:07.479 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13627 fp=#0x30000003299' 2024-08-31T04:31:07.480 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13659 fp=#0x30000003302' 2024-08-31T04:31:07.480 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13691 fp=#0x300000029b4' 2024-08-31T04:31:07.480 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13723 fp=#0x30000002961' 2024-08-31T04:31:07.481 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13755 fp=#0x300000029b3' 2024-08-31T04:31:07.481 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13787 fp=#0x300000029f4' 2024-08-31T04:31:07.481 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13819 fp=#0x3000000292a' 2024-08-31T04:31:07.481 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13851 fp=#0x30000002a21' 2024-08-31T04:31:07.482 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13883 fp=#0x10000003f1a' 2024-08-31T04:31:07.482 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13915 fp=#0x10000003de7' 2024-08-31T04:31:07.482 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13947 fp=#0x3000000278d' 2024-08-31T04:31:07.483 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14011 fp=#0x10000003bc1' 2024-08-31T04:31:07.483 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14075 fp=#0x30000000c6d' 2024-08-31T04:31:07.484 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14107 fp=#0x30000000c61' 2024-08-31T04:31:07.484 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14139 fp=#0x300000017bc' 2024-08-31T04:31:07.484 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14171 fp=#0x30000002460' 2024-08-31T04:31:07.485 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14203 fp=#0x30000002485' 2024-08-31T04:31:07.485 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14235 fp=#0x30000002457' 2024-08-31T04:31:07.486 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14395 fp=#0x30000000da0' 2024-08-31T04:31:07.487 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14427 fp=#0x300000027aa' 2024-08-31T04:31:07.487 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14459 fp=#0x300000023a9' 2024-08-31T04:31:07.487 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14491 fp=#0x30000000d41' 2024-08-31T04:31:07.488 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14523 fp=#0x30000000ccb' 2024-08-31T04:31:07.488 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14555 fp=#0x30000000d0a' 2024-08-31T04:31:07.488 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14587 fp=#0x30000000d92' 2024-08-31T04:31:07.489 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14619 fp=#0x10000002402' 2024-08-31T04:31:07.489 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14651 fp=#0x10000002408' 2024-08-31T04:31:07.489 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14683 fp=#0x30000002fd5' 2024-08-31T04:31:07.490 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14715 fp=#0x10000002475' 2024-08-31T04:31:07.490 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14747 fp=#0x10000002473' 2024-08-31T04:31:07.490 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14779 fp=#0x100000023e3' 2024-08-31T04:31:07.491 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14810 fp=#0x10000003bac' 2024-08-31T04:31:07.491 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14842 fp=#0x30000000a2f' 2024-08-31T04:31:07.491 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14874 fp=#0x30000000a39' 2024-08-31T04:31:07.492 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14906 fp=#0x30000000963' 2024-08-31T04:31:07.492 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14938 fp=#0x30000000958' 2024-08-31T04:31:07.492 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14970 fp=#0x300000009f9' 2024-08-31T04:31:07.493 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15002 fp=#0x300000014d6' 2024-08-31T04:31:07.493 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15034 fp=#0x300000015e4' 2024-08-31T04:31:07.493 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15066 fp=#0x3000000155a' 2024-08-31T04:31:07.493 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15098 fp=#0x300000015fe' 2024-08-31T04:31:07.494 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15130 fp=#0x300000033ff' 2024-08-31T04:31:07.494 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15162 fp=#0x300000033f2' 2024-08-31T04:31:07.494 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15194 fp=#0x300000033c1' 2024-08-31T04:31:07.495 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15226 fp=#0x30000002f06' 2024-08-31T04:31:07.495 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15258 fp=#0x30000002e8a' 2024-08-31T04:31:07.495 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15290 fp=#0x30000002ead' 2024-08-31T04:31:07.496 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15322 fp=#0x30000002ee4' 2024-08-31T04:31:07.496 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15354 fp=#0x30000002edb' 2024-08-31T04:31:07.496 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15386 fp=#0x300000032e4' 2024-08-31T04:31:07.497 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15418 fp=#0x30000001dce' 2024-08-31T04:31:07.497 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15450 fp=#0x30000001da9' 2024-08-31T04:31:07.497 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15482 fp=#0x30000001dc0' 2024-08-31T04:31:07.498 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15514 fp=#0x30000000ee3' 2024-08-31T04:31:07.498 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15546 fp=#0x30000001da0' 2024-08-31T04:31:07.498 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15578 fp=#0x30000000ec4' 2024-08-31T04:31:07.499 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15610 fp=#0x300000005ff' 2024-08-31T04:31:07.499 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15642 fp=#0x300000005b7' 2024-08-31T04:31:07.500 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15738 fp=#0x300000005d1' 2024-08-31T04:31:07.500 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15770 fp=#0x300000005d5' 2024-08-31T04:31:07.500 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15833 fp=#0x300000012ff' 2024-08-31T04:31:07.501 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15865 fp=#0x3000000130a' 2024-08-31T04:31:07.501 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15897 fp=#0x300000012f0' 2024-08-31T04:31:07.501 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15929 fp=#0x30000001282' 2024-08-31T04:31:07.502 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15961 fp=#0x30000001284' 2024-08-31T04:31:07.502 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15993 fp=#0x30000001092' 2024-08-31T04:31:07.502 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16025 fp=#0x300000010aa' 2024-08-31T04:31:07.503 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16057 fp=#0x30000001027' 2024-08-31T04:31:07.503 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16089 fp=#0x30000002df2' 2024-08-31T04:31:07.503 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16121 fp=#0x30000002e02' 2024-08-31T04:31:07.504 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16153 fp=#0x300000005c2' 2024-08-31T04:31:07.504 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16185 fp=#0x300000005d9' 2024-08-31T04:31:07.504 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16217 fp=#0x30000003510' 2024-08-31T04:31:07.505 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16249 fp=#0x300000033fc' 2024-08-31T04:31:07.505 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16313 fp=#0x300000034a7' 2024-08-31T04:31:07.506 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16342 fp=#0x1000000287c' 2024-08-31T04:31:07.506 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16374 fp=#0x300000020b4' 2024-08-31T04:31:07.506 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16406 fp=#0x30000002071' 2024-08-31T04:31:07.507 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16438 fp=#0x100000024ad' 2024-08-31T04:31:07.507 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16470 fp=#0x100000024b3' 2024-08-31T04:31:07.507 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16502 fp=#0x10000002525' 2024-08-31T04:31:07.508 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16534 fp=#0x1000000254e' 2024-08-31T04:31:07.508 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16566 fp=#0x1000000251d' 2024-08-31T04:31:07.509 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16629 fp=#0x3000000214b' 2024-08-31T04:31:07.509 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16661 fp=#0x30000002187' 2024-08-31T04:31:07.509 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16693 fp=#0x3000000221e' 2024-08-31T04:31:07.510 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16725 fp=#0x30000002145' 2024-08-31T04:31:07.510 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16757 fp=#0x300000003f3' 2024-08-31T04:31:07.510 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16789 fp=#0x30000001a2a' 2024-08-31T04:31:07.511 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16821 fp=#0x30000001a19' 2024-08-31T04:31:07.511 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16885 fp=#0x300000019b9' 2024-08-31T04:31:07.512 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16917 fp=#0x30000001a16' 2024-08-31T04:31:07.512 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16948 fp=#0x30000001ad2' 2024-08-31T04:31:07.512 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16980 fp=#0x30000001a8b' 2024-08-31T04:31:07.513 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17037 fp=#0x1000000370e' 2024-08-31T04:31:07.513 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17069 fp=#0x10000003633' 2024-08-31T04:31:07.513 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17101 fp=#0x100000036eb' 2024-08-31T04:31:07.514 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17133 fp=#0x30000001732' 2024-08-31T04:31:07.514 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17165 fp=#0x3000000173d' 2024-08-31T04:31:07.514 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17197 fp=#0x300000017ad' 2024-08-31T04:31:07.515 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17229 fp=#0x30000001752' 2024-08-31T04:31:07.515 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17261 fp=#0x30000001736' 2024-08-31T04:31:07.515 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17293 fp=#0x3000000171b' 2024-08-31T04:31:07.516 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17325 fp=#0x30000003353' 2024-08-31T04:31:07.516 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17357 fp=#0x30000003355' 2024-08-31T04:31:07.517 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17549 fp=#0x300000031bf' 2024-08-31T04:31:07.518 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17581 fp=#0x30000003220' 2024-08-31T04:31:07.518 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17613 fp=#0x300000031e4' 2024-08-31T04:31:07.518 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17645 fp=#0x30000002013' 2024-08-31T04:31:07.520 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17805 fp=#0x3000000204d' 2024-08-31T04:31:07.520 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17837 fp=#0x30000001fc0' 2024-08-31T04:31:07.520 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17869 fp=#0x30000001fca' 2024-08-31T04:31:07.521 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17901 fp=#0x3000000201e' 2024-08-31T04:31:07.521 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17933 fp=#0x30000003143' 2024-08-31T04:31:07.521 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17965 fp=#0x300000030fa' 2024-08-31T04:31:07.522 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17997 fp=#0x30000001c13' 2024-08-31T04:31:07.522 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18029 fp=#0x30000001bee' 2024-08-31T04:31:07.522 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18061 fp=#0x30000001c31' 2024-08-31T04:31:07.523 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18093 fp=#0x30000001c19' 2024-08-31T04:31:07.523 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18125 fp=#0x30000002522' 2024-08-31T04:31:07.523 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18157 fp=#0x30000002569' 2024-08-31T04:31:07.524 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18189 fp=#0x30000002581' 2024-08-31T04:31:07.524 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18221 fp=#0x30000002584' 2024-08-31T04:31:07.524 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18253 fp=#0x300000027ed' 2024-08-31T04:31:07.525 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18285 fp=#0x3000000284e' 2024-08-31T04:31:07.525 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18317 fp=#0x300000027df' 2024-08-31T04:31:07.525 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18349 fp=#0x300000027de' 2024-08-31T04:31:07.526 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18381 fp=#0x30000002f5d' 2024-08-31T04:31:07.526 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18413 fp=#0x30000002f38' 2024-08-31T04:31:07.526 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18445 fp=#0x30000002f4e' 2024-08-31T04:31:07.527 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18477 fp=#0x30000002f5f' 2024-08-31T04:31:07.527 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18509 fp=#0x30000003006' 2024-08-31T04:31:07.527 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18541 fp=#0x3000000301a' 2024-08-31T04:31:07.528 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18573 fp=#0x10000001d86' 2024-08-31T04:31:07.528 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18605 fp=#0x10000001d1d' 2024-08-31T04:31:07.528 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18669 fp=#0x10000001d0c' 2024-08-31T04:31:07.529 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18701 fp=#0x300000013ea' 2024-08-31T04:31:07.529 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18733 fp=#0x300000013e8' 2024-08-31T04:31:07.529 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18765 fp=#0x3000000136d' 2024-08-31T04:31:07.530 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18797 fp=#0x30000001365' 2024-08-31T04:31:07.530 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18829 fp=#0x3000000137c' 2024-08-31T04:31:07.530 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18861 fp=#0x300000013ab' 2024-08-31T04:31:07.531 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18893 fp=#0x30000001d89' 2024-08-31T04:31:07.531 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18925 fp=#0x30000001d56' 2024-08-31T04:31:07.531 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18957 fp=#0x300000021f1' 2024-08-31T04:31:07.531 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18989 fp=#0x30000001067' 2024-08-31T04:31:07.532 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19021 fp=#0x30000001d90' 2024-08-31T04:31:07.532 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19053 fp=#0x300000011e7' 2024-08-31T04:31:07.532 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19085 fp=#0x300000011c6' 2024-08-31T04:31:07.533 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19117 fp=#0x300000011e5' 2024-08-31T04:31:07.534 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19245 fp=#0x30000001586' 2024-08-31T04:31:07.534 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19277 fp=#0x30000002bac' 2024-08-31T04:31:07.534 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19309 fp=#0x30000002bb1' 2024-08-31T04:31:07.535 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19341 fp=#0x30000001512' 2024-08-31T04:31:07.535 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19373 fp=#0x100000008a2' 2024-08-31T04:31:07.535 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19405 fp=#0x100000008a6' 2024-08-31T04:31:07.536 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19436 fp=#0x30000000bdb' 2024-08-31T04:31:07.536 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19468 fp=#0x30000000b67' 2024-08-31T04:31:07.536 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19500 fp=#0x30000001d23' 2024-08-31T04:31:07.536 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19532 fp=#0x30000000bae' 2024-08-31T04:31:07.537 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19564 fp=#0x30000000ac9' 2024-08-31T04:31:07.537 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19596 fp=#0x30000000acf' 2024-08-31T04:31:07.537 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19628 fp=#0x30000000afc' 2024-08-31T04:31:07.538 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19660 fp=#0x30000002c5d' 2024-08-31T04:31:07.538 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19692 fp=#0x30000002d69' 2024-08-31T04:31:07.538 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19724 fp=#0x30000002c6c' 2024-08-31T04:31:07.539 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19756 fp=#0x30000002d90' 2024-08-31T04:31:07.539 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19788 fp=#0x30000002d6b' 2024-08-31T04:31:07.539 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19820 fp=#0x30000001208' 2024-08-31T04:31:07.539 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19852 fp=#0x30000001454' 2024-08-31T04:31:07.540 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19884 fp=#0x300000011a6' 2024-08-31T04:31:07.540 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19916 fp=#0x30000001186' 2024-08-31T04:31:07.540 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19948 fp=#0x3000000142c' 2024-08-31T04:31:07.541 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19980 fp=#0x30000001421' 2024-08-31T04:31:07.541 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20012 fp=#0x3000000140e' 2024-08-31T04:31:07.541 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20044 fp=#0x30000000f97' 2024-08-31T04:31:07.542 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20076 fp=#0x30000000fa7' 2024-08-31T04:31:07.542 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20108 fp=#0x30000000f9c' 2024-08-31T04:31:07.542 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20140 fp=#0x300000016f6' 2024-08-31T04:31:07.543 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20172 fp=#0x30000001720' 2024-08-31T04:31:07.543 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20204 fp=#0x300000016f7' 2024-08-31T04:31:07.543 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20236 fp=#0x3000000308d' 2024-08-31T04:31:07.543 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20268 fp=#0x30000003199' 2024-08-31T04:31:07.544 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20300 fp=#0x3000000313d' 2024-08-31T04:31:07.547 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20332 fp=#0x30000003188' 2024-08-31T04:31:07.547 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20364 fp=#0x3000000311b' 2024-08-31T04:31:07.547 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20396 fp=#0x30000001ce3' 2024-08-31T04:31:07.547 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20428 fp=#0x30000001cc3' 2024-08-31T04:31:07.548 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20460 fp=#0x30000001c86' 2024-08-31T04:31:07.548 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20492 fp=#0x30000001c60' 2024-08-31T04:31:07.548 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20524 fp=#0x30000001222' 2024-08-31T04:31:07.549 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20556 fp=#0x30000001228' 2024-08-31T04:31:07.549 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20588 fp=#0x3000000122c' 2024-08-31T04:31:07.550 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20684 fp=#0x300000021b5' 2024-08-31T04:31:07.550 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20716 fp=#0x3000000217f' 2024-08-31T04:31:07.551 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20748 fp=#0x30000002154' 2024-08-31T04:31:07.551 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20780 fp=#0x1000000374a' 2024-08-31T04:31:07.551 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20812 fp=#0x3000000303d' 2024-08-31T04:31:07.552 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20844 fp=#0x3000000304f' 2024-08-31T04:31:07.552 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20876 fp=#0x3000000306f' 2024-08-31T04:31:07.553 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20972 fp=#0x300000020e5' 2024-08-31T04:31:07.553 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21004 fp=#0x300000020e0' 2024-08-31T04:31:07.554 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21035 fp=#0x3000000158e' 2024-08-31T04:31:07.554 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21067 fp=#0x30000001660' 2024-08-31T04:31:07.554 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21099 fp=#0x30000001667' 2024-08-31T04:31:07.555 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21163 fp=#0x30000002bc4' 2024-08-31T04:31:07.555 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21195 fp=#0x30000002c11' 2024-08-31T04:31:07.556 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21259 fp=#0x30000002c58' 2024-08-31T04:31:07.556 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21323 fp=#0x10000003390' 2024-08-31T04:31:07.556 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21355 fp=#0x300000011fc' 2024-08-31T04:31:07.557 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21387 fp=#0x1000000336d' 2024-08-31T04:31:07.557 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21419 fp=#0x1000000335d' 2024-08-31T04:31:07.557 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21451 fp=#0x3000000262f' 2024-08-31T04:31:07.558 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21483 fp=#0x3000000272c' 2024-08-31T04:31:07.558 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21515 fp=#0x300000026b2' 2024-08-31T04:31:07.559 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21547 fp=#0x300000026fa' 2024-08-31T04:31:07.559 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21579 fp=#0x30000002668' 2024-08-31T04:31:07.559 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21611 fp=#0x300000036f1' 2024-08-31T04:31:07.560 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21643 fp=#0x30000000c96' 2024-08-31T04:31:07.560 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21675 fp=#0x300000036fd' 2024-08-31T04:31:07.560 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21707 fp=#0x30000000d40' 2024-08-31T04:31:07.561 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21739 fp=#0x300000036d5' 2024-08-31T04:31:07.561 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21771 fp=#0x30000000b51' 2024-08-31T04:31:07.561 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21803 fp=#0x30000000aa7' 2024-08-31T04:31:07.562 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21835 fp=#0x30000000a99' 2024-08-31T04:31:07.562 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21867 fp=#0x30000000ae5' 2024-08-31T04:31:07.562 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21899 fp=#0x30000000509' 2024-08-31T04:31:07.562 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21931 fp=#0x30000000927' 2024-08-31T04:31:07.563 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21963 fp=#0x30000000551' 2024-08-31T04:31:07.563 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22026 fp=#0x30000001906' 2024-08-31T04:31:07.564 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22058 fp=#0x30000001914' 2024-08-31T04:31:07.564 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22090 fp=#0x30000001917' 2024-08-31T04:31:07.564 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22122 fp=#0x30000002998' 2024-08-31T04:31:07.565 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22154 fp=#0x300000028f5' 2024-08-31T04:31:07.565 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22186 fp=#0x300000029b7' 2024-08-31T04:31:07.565 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22218 fp=#0x30000002965' 2024-08-31T04:31:07.566 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22250 fp=#0x300000028d4' 2024-08-31T04:31:07.566 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22282 fp=#0x30000002037' 2024-08-31T04:31:07.567 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22314 fp=#0x3000000205f' 2024-08-31T04:31:07.567 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22346 fp=#0x30000001ff2' 2024-08-31T04:31:07.567 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22410 fp=#0x3000000046d' 2024-08-31T04:31:07.568 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22474 fp=#0x3000000049b' 2024-08-31T04:31:07.568 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22506 fp=#0x3000000047c' 2024-08-31T04:31:07.569 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22531 fp=#0x30000002bde' 2024-08-31T04:31:07.569 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22563 fp=#0x30000002be7' 2024-08-31T04:31:07.569 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22594 fp=#0x30000001492' 2024-08-31T04:31:07.570 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22626 fp=#0x300000033cf' 2024-08-31T04:31:07.570 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22690 fp=#0x30000001476' 2024-08-31T04:31:07.571 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:9756 fp=#0x100000001fb' 2024-08-31T04:31:07.571 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:9820 fp=#0x30000001946' 2024-08-31T04:31:07.572 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:9948 fp=#0x30000000c87' 2024-08-31T04:31:07.578 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:10620 fp=#0x30000000a73' 2024-08-31T04:31:07.578 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:10684 fp=#0x30000000a71' 2024-08-31T04:31:07.580 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:10812 fp=#0x30000000a5d' 2024-08-31T04:31:07.587 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:11772 fp=#0x300000023c6' 2024-08-31T04:31:07.587 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:11836 fp=#0x300000023cb' 2024-08-31T04:31:07.587 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:11868 fp=#0x30000000bda' 2024-08-31T04:31:07.588 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:11900 fp=#0x30000000c34' 2024-08-31T04:31:07.588 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:11932 fp=#0x300000011af' 2024-08-31T04:31:07.588 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:11964 fp=#0x30000001166' 2024-08-31T04:31:07.589 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:11996 fp=#0x30000003202' 2024-08-31T04:31:07.589 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12028 fp=#0x300000010b1' 2024-08-31T04:31:07.590 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12060 fp=#0x300000031ef' 2024-08-31T04:31:07.590 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12092 fp=#0x30000001038' 2024-08-31T04:31:07.590 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12124 fp=#0x3000000101a' 2024-08-31T04:31:07.591 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12220 fp=#0x300000009db' 2024-08-31T04:31:07.592 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12316 fp=#0x300000009f2' 2024-08-31T04:31:07.592 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12348 fp=#0x30000000959' 2024-08-31T04:31:07.593 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12412 fp=#0x30000002e46' 2024-08-31T04:31:07.593 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12444 fp=#0x30000002e51' 2024-08-31T04:31:07.594 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12508 fp=#0x30000000f6e' 2024-08-31T04:31:07.594 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12540 fp=#0x30000000f80' 2024-08-31T04:31:07.594 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12572 fp=#0x30000000f65' 2024-08-31T04:31:07.595 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12604 fp=#0x30000000e23' 2024-08-31T04:31:07.595 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12636 fp=#0x3000000339e' 2024-08-31T04:31:07.595 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12668 fp=#0x30000000ea6' 2024-08-31T04:31:07.596 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12700 fp=#0x30000002269' 2024-08-31T04:31:07.596 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12732 fp=#0x30000000e95' 2024-08-31T04:31:07.596 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12764 fp=#0x30000003387' 2024-08-31T04:31:07.597 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12796 fp=#0x300000033b9' 2024-08-31T04:31:07.597 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12828 fp=#0x3000000336e' 2024-08-31T04:31:07.597 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12860 fp=#0x1000000435b' 2024-08-31T04:31:07.598 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12892 fp=#0x10000004346' 2024-08-31T04:31:07.598 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12924 fp=#0x10000004387' 2024-08-31T04:31:07.598 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12956 fp=#0x10000004393' 2024-08-31T04:31:07.598 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12988 fp=#0x100000043ef' 2024-08-31T04:31:07.599 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13020 fp=#0x10000004371' 2024-08-31T04:31:07.599 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13084 fp=#0x100000041fb' 2024-08-31T04:31:07.600 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13116 fp=#0x300000030b7' 2024-08-31T04:31:07.600 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13148 fp=#0x300000030d7' 2024-08-31T04:31:07.601 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13308 fp=#0x3000000089c' 2024-08-31T04:31:07.602 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13340 fp=#0x300000009ad' 2024-08-31T04:31:07.602 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13372 fp=#0x3000000221d' 2024-08-31T04:31:07.602 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13404 fp=#0x30000002286' 2024-08-31T04:31:07.603 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13436 fp=#0x300000008f2' 2024-08-31T04:31:07.603 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13468 fp=#0x30000000884' 2024-08-31T04:31:07.603 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13500 fp=#0x30000002254' 2024-08-31T04:31:07.603 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13532 fp=#0x3000000093a' 2024-08-31T04:31:07.604 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13564 fp=#0x30000003339' 2024-08-31T04:31:07.604 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13596 fp=#0x30000003326' 2024-08-31T04:31:07.604 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13628 fp=#0x3000000328f' 2024-08-31T04:31:07.605 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13660 fp=#0x30000003292' 2024-08-31T04:31:07.605 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13692 fp=#0x300000028d6' 2024-08-31T04:31:07.605 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13724 fp=#0x30000002a06' 2024-08-31T04:31:07.606 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13756 fp=#0x300000028d7' 2024-08-31T04:31:07.606 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13788 fp=#0x300000028ce' 2024-08-31T04:31:07.606 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13820 fp=#0x3000000299f' 2024-08-31T04:31:07.607 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13852 fp=#0x300000028dc' 2024-08-31T04:31:07.607 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13884 fp=#0x10000003eff' 2024-08-31T04:31:07.608 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13948 fp=#0x10000003f20' 2024-08-31T04:31:07.608 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14012 fp=#0x10000003d72' 2024-08-31T04:31:07.608 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14044 fp=#0x10000003c08' 2024-08-31T04:31:07.609 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14076 fp=#0x30000000c48' 2024-08-31T04:31:07.609 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14140 fp=#0x3000000178d' 2024-08-31T04:31:07.610 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14172 fp=#0x30000002490' 2024-08-31T04:31:07.610 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14204 fp=#0x300000017b0' 2024-08-31T04:31:07.610 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14236 fp=#0x30000001753' 2024-08-31T04:31:07.611 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14396 fp=#0x30000000d3f' 2024-08-31T04:31:07.612 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14428 fp=#0x30000000d2a' 2024-08-31T04:31:07.612 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14460 fp=#0x30000000cc3' 2024-08-31T04:31:07.612 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14492 fp=#0x30000000d51' 2024-08-31T04:31:07.613 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14524 fp=#0x30000000d57' 2024-08-31T04:31:07.613 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14556 fp=#0x30000002385' 2024-08-31T04:31:07.613 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14588 fp=#0x300000023a1' 2024-08-31T04:31:07.614 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14620 fp=#0x30000002fb4' 2024-08-31T04:31:07.614 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14652 fp=#0x30000002a37' 2024-08-31T04:31:07.614 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14684 fp=#0x10000002403' 2024-08-31T04:31:07.615 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14716 fp=#0x100000023fc' 2024-08-31T04:31:07.615 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14748 fp=#0x30000002f8a' 2024-08-31T04:31:07.615 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14780 fp=#0x30000002f98' 2024-08-31T04:31:07.615 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14811 fp=#0x10000003c42' 2024-08-31T04:31:07.616 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14843 fp=#0x3000000090c' 2024-08-31T04:31:07.616 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14875 fp=#0x30000000a1c' 2024-08-31T04:31:07.616 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14907 fp=#0x300000009ce' 2024-08-31T04:31:07.617 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14939 fp=#0x300000009ca' 2024-08-31T04:31:07.617 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14971 fp=#0x300000014f3' 2024-08-31T04:31:07.617 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15003 fp=#0x3000000166a' 2024-08-31T04:31:07.617 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15035 fp=#0x300000014fb' 2024-08-31T04:31:07.618 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15067 fp=#0x3000000169d' 2024-08-31T04:31:07.618 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15099 fp=#0x300000015cc' 2024-08-31T04:31:07.618 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15131 fp=#0x300000033dd' 2024-08-31T04:31:07.619 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15163 fp=#0x3000000340e' 2024-08-31T04:31:07.619 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15195 fp=#0x30000003425' 2024-08-31T04:31:07.619 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15227 fp=#0x30000002f0f' 2024-08-31T04:31:07.620 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15259 fp=#0x30000002e97' 2024-08-31T04:31:07.620 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15291 fp=#0x30000002e86' 2024-08-31T04:31:07.620 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15323 fp=#0x30000002e77' 2024-08-31T04:31:07.621 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15355 fp=#0x30000002ecd' 2024-08-31T04:31:07.621 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15387 fp=#0x300000032d2' 2024-08-31T04:31:07.621 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15419 fp=#0x30000000f2a' 2024-08-31T04:31:07.622 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15451 fp=#0x30000000f17' 2024-08-31T04:31:07.622 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15483 fp=#0x30000001dbd' 2024-08-31T04:31:07.622 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15515 fp=#0x30000000ec6' 2024-08-31T04:31:07.623 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15547 fp=#0x30000001da2' 2024-08-31T04:31:07.623 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15579 fp=#0x30000000edc' 2024-08-31T04:31:07.623 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15643 fp=#0x300000005df' 2024-08-31T04:31:07.624 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15771 fp=#0x300000004e7' 2024-08-31T04:31:07.625 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15803 fp=#0x3000000056c' 2024-08-31T04:31:07.625 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15834 fp=#0x300000014f9' 2024-08-31T04:31:07.625 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15866 fp=#0x30000001301' 2024-08-31T04:31:07.626 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15898 fp=#0x300000012e8' 2024-08-31T04:31:07.626 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15930 fp=#0x300000012e6' 2024-08-31T04:31:07.626 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15962 fp=#0x300000012c8' 2024-08-31T04:31:07.627 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15994 fp=#0x3000000107e' 2024-08-31T04:31:07.627 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16026 fp=#0x30000002465' 2024-08-31T04:31:07.627 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16058 fp=#0x30000001043' 2024-08-31T04:31:07.628 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16090 fp=#0x30000002def' 2024-08-31T04:31:07.628 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16122 fp=#0x30000002df3' 2024-08-31T04:31:07.629 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16186 fp=#0x300000033ed' 2024-08-31T04:31:07.629 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16282 fp=#0x300000034b0' 2024-08-31T04:31:07.630 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16314 fp=#0x300000033f6' 2024-08-31T04:31:07.630 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16343 fp=#0x1000000284a' 2024-08-31T04:31:07.630 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16375 fp=#0x10000002881' 2024-08-31T04:31:07.631 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16407 fp=#0x10000002854' 2024-08-31T04:31:07.631 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16439 fp=#0x10000002509' 2024-08-31T04:31:07.631 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16471 fp=#0x30000001cfa' 2024-08-31T04:31:07.632 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16503 fp=#0x1000000252d' 2024-08-31T04:31:07.632 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16535 fp=#0x30000001d14' 2024-08-31T04:31:07.632 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16567 fp=#0x1000000253b' 2024-08-31T04:31:07.633 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16599 fp=#0x30000001d42' 2024-08-31T04:31:07.633 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16630 fp=#0x3000000231a' 2024-08-31T04:31:07.633 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16662 fp=#0x300000022fe' 2024-08-31T04:31:07.634 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16694 fp=#0x30000002241' 2024-08-31T04:31:07.634 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16726 fp=#0x30000002316' 2024-08-31T04:31:07.634 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16758 fp=#0x30000002650' 2024-08-31T04:31:07.635 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16822 fp=#0x300000019d8' 2024-08-31T04:31:07.635 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16854 fp=#0x300000019d4' 2024-08-31T04:31:07.636 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16886 fp=#0x3000000195d' 2024-08-31T04:31:07.636 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16918 fp=#0x300000019dc' 2024-08-31T04:31:07.636 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16949 fp=#0x30000001aeb' 2024-08-31T04:31:07.637 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16981 fp=#0x30000002b81' 2024-08-31T04:31:07.637 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17038 fp=#0x1000000361b' 2024-08-31T04:31:07.638 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17070 fp=#0x10000003630' 2024-08-31T04:31:07.638 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17102 fp=#0x10000003675' 2024-08-31T04:31:07.638 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17134 fp=#0x300000017b2' 2024-08-31T04:31:07.639 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17166 fp=#0x30000001742' 2024-08-31T04:31:07.639 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17198 fp=#0x30000001778' 2024-08-31T04:31:07.639 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17230 fp=#0x300000017d3' 2024-08-31T04:31:07.639 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17262 fp=#0x30000001802' 2024-08-31T04:31:07.640 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17294 fp=#0x30000001767' 2024-08-31T04:31:07.640 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17326 fp=#0x3000000334e' 2024-08-31T04:31:07.640 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17358 fp=#0x300000032fb' 2024-08-31T04:31:07.642 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17550 fp=#0x300000031e7' 2024-08-31T04:31:07.642 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17582 fp=#0x300000031ab' 2024-08-31T04:31:07.643 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17614 fp=#0x300000031f5' 2024-08-31T04:31:07.643 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17646 fp=#0x300000031d7' 2024-08-31T04:31:07.644 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17806 fp=#0x30000002058' 2024-08-31T04:31:07.645 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17838 fp=#0x30000001fc7' 2024-08-31T04:31:07.645 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17870 fp=#0x30000001f6b' 2024-08-31T04:31:07.645 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17902 fp=#0x30000001f77' 2024-08-31T04:31:07.646 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17934 fp=#0x300000030c2' 2024-08-31T04:31:07.646 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17966 fp=#0x30000003135' 2024-08-31T04:31:07.646 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17998 fp=#0x30000001c35' 2024-08-31T04:31:07.647 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18030 fp=#0x30000001c2e' 2024-08-31T04:31:07.647 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18062 fp=#0x30000001c17' 2024-08-31T04:31:07.647 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18094 fp=#0x30000001c24' 2024-08-31T04:31:07.648 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18126 fp=#0x300000025a0' 2024-08-31T04:31:07.648 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18158 fp=#0x30000002544' 2024-08-31T04:31:07.648 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18190 fp=#0x3000000251d' 2024-08-31T04:31:07.649 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18222 fp=#0x30000002535' 2024-08-31T04:31:07.649 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18254 fp=#0x3000000287e' 2024-08-31T04:31:07.649 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18286 fp=#0x300000027bd' 2024-08-31T04:31:07.650 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18318 fp=#0x300000027b0' 2024-08-31T04:31:07.650 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18350 fp=#0x300000027d9' 2024-08-31T04:31:07.650 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18382 fp=#0x30000002ffe' 2024-08-31T04:31:07.651 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18414 fp=#0x30000003015' 2024-08-31T04:31:07.651 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18446 fp=#0x3000000302a' 2024-08-31T04:31:07.651 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18478 fp=#0x30000002f4b' 2024-08-31T04:31:07.652 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18510 fp=#0x30000002f4c' 2024-08-31T04:31:07.652 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18542 fp=#0x30000003035' 2024-08-31T04:31:07.653 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18574 fp=#0x10000001d16' 2024-08-31T04:31:07.653 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18638 fp=#0x10000001d11' 2024-08-31T04:31:07.653 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18670 fp=#0x10000001d63' 2024-08-31T04:31:07.654 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18702 fp=#0x30000001520' 2024-08-31T04:31:07.654 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18734 fp=#0x300000014f5' 2024-08-31T04:31:07.654 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18766 fp=#0x300000013b7' 2024-08-31T04:31:07.655 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18798 fp=#0x300000013ce' 2024-08-31T04:31:07.655 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18830 fp=#0x300000013a8' 2024-08-31T04:31:07.655 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18862 fp=#0x300000013eb' 2024-08-31T04:31:07.656 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18894 fp=#0x30000001d77' 2024-08-31T04:31:07.656 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18926 fp=#0x300000010b8' 2024-08-31T04:31:07.656 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18958 fp=#0x300000010b2' 2024-08-31T04:31:07.657 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18990 fp=#0x3000000104a' 2024-08-31T04:31:07.657 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19022 fp=#0x30000001d88' 2024-08-31T04:31:07.657 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19054 fp=#0x30000001122' 2024-08-31T04:31:07.657 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19086 fp=#0x30000001126' 2024-08-31T04:31:07.658 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19118 fp=#0x30000001177' 2024-08-31T04:31:07.658 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19150 fp=#0x30000001614' 2024-08-31T04:31:07.658 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19182 fp=#0x30000001608' 2024-08-31T04:31:07.659 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19214 fp=#0x30000001612' 2024-08-31T04:31:07.659 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19246 fp=#0x30000001666' 2024-08-31T04:31:07.659 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19278 fp=#0x100000008b5' 2024-08-31T04:31:07.660 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19310 fp=#0x10000000899' 2024-08-31T04:31:07.660 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19342 fp=#0x300000014ce' 2024-08-31T04:31:07.660 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19374 fp=#0x100000008a1' 2024-08-31T04:31:07.661 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19406 fp=#0x30000002bbe' 2024-08-31T04:31:07.661 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19437 fp=#0x30000000b5e' 2024-08-31T04:31:07.661 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19469 fp=#0x30000000b72' 2024-08-31T04:31:07.662 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19501 fp=#0x30000000bc9' 2024-08-31T04:31:07.662 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19533 fp=#0x30000000ba7' 2024-08-31T04:31:07.662 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19565 fp=#0x30000000b37' 2024-08-31T04:31:07.662 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19597 fp=#0x30000000abe' 2024-08-31T04:31:07.663 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19629 fp=#0x30000000aee' 2024-08-31T04:31:07.663 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19661 fp=#0x30000002c84' 2024-08-31T04:31:07.663 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19693 fp=#0x30000002c67' 2024-08-31T04:31:07.664 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19725 fp=#0x30000002cb8' 2024-08-31T04:31:07.664 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19757 fp=#0x30000002d05' 2024-08-31T04:31:07.664 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19789 fp=#0x30000002c55' 2024-08-31T04:31:07.665 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19821 fp=#0x3000000120a' 2024-08-31T04:31:07.665 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19853 fp=#0x30000001453' 2024-08-31T04:31:07.665 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19885 fp=#0x30000001462' 2024-08-31T04:31:07.665 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19917 fp=#0x3000000144c' 2024-08-31T04:31:07.666 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19949 fp=#0x30000001415' 2024-08-31T04:31:07.666 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19981 fp=#0x30000001425' 2024-08-31T04:31:07.666 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20013 fp=#0x30000001401' 2024-08-31T04:31:07.667 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20045 fp=#0x30000000ff4' 2024-08-31T04:31:07.667 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20077 fp=#0x30000000fc0' 2024-08-31T04:31:07.668 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20109 fp=#0x30000000fb7' 2024-08-31T04:31:07.668 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20141 fp=#0x3000000170e' 2024-08-31T04:31:07.668 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20173 fp=#0x300000016d5' 2024-08-31T04:31:07.668 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20205 fp=#0x300000016f0' 2024-08-31T04:31:07.669 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20237 fp=#0x30000003158' 2024-08-31T04:31:07.669 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20269 fp=#0x300000031b0' 2024-08-31T04:31:07.669 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20301 fp=#0x300000030dd' 2024-08-31T04:31:07.670 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20333 fp=#0x30000003193' 2024-08-31T04:31:07.670 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20365 fp=#0x30000003173' 2024-08-31T04:31:07.670 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20397 fp=#0x30000001c99' 2024-08-31T04:31:07.671 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20429 fp=#0x30000001c56' 2024-08-31T04:31:07.671 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20461 fp=#0x30000001ccd' 2024-08-31T04:31:07.671 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20493 fp=#0x30000001c78' 2024-08-31T04:31:07.671 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20525 fp=#0x3000000126f' 2024-08-31T04:31:07.672 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20557 fp=#0x30000001230' 2024-08-31T04:31:07.672 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20589 fp=#0x30000001260' 2024-08-31T04:31:07.673 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20653 fp=#0x30000002146' 2024-08-31T04:31:07.674 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20845 fp=#0x30000003041' 2024-08-31T04:31:07.675 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20877 fp=#0x3000000303f' 2024-08-31T04:31:07.675 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20973 fp=#0x300000020ee' 2024-08-31T04:31:07.676 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21005 fp=#0x300000020ce' 2024-08-31T04:31:07.676 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21036 fp=#0x300000016a1' 2024-08-31T04:31:07.676 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21068 fp=#0x3000000153b' 2024-08-31T04:31:07.677 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21100 fp=#0x30000001530' 2024-08-31T04:31:07.678 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21196 fp=#0x30000002c07' 2024-08-31T04:31:07.678 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21228 fp=#0x30000002bcc' 2024-08-31T04:31:07.679 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21324 fp=#0x10000003226' 2024-08-31T04:31:07.679 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21356 fp=#0x1000000335f' 2024-08-31T04:31:07.679 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21388 fp=#0x100000032a5' 2024-08-31T04:31:07.680 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21420 fp=#0x100000032a2' 2024-08-31T04:31:07.680 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21452 fp=#0x30000002732' 2024-08-31T04:31:07.680 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21484 fp=#0x30000002719' 2024-08-31T04:31:07.681 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21516 fp=#0x300000026ee' 2024-08-31T04:31:07.681 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21548 fp=#0x30000002640' 2024-08-31T04:31:07.682 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21580 fp=#0x30000002735' 2024-08-31T04:31:07.682 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21612 fp=#0x30000000c9e' 2024-08-31T04:31:07.682 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21644 fp=#0x30000003678' 2024-08-31T04:31:07.683 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21676 fp=#0x30000000d58' 2024-08-31T04:31:07.683 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21708 fp=#0x30000000ce5' 2024-08-31T04:31:07.683 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21740 fp=#0x30000000d1f' 2024-08-31T04:31:07.684 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21772 fp=#0x30000000ab0' 2024-08-31T04:31:07.684 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21804 fp=#0x30000000b4b' 2024-08-31T04:31:07.684 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21836 fp=#0x30000000ad4' 2024-08-31T04:31:07.685 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21868 fp=#0x30000000aad' 2024-08-31T04:31:07.685 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21900 fp=#0x30000000588' 2024-08-31T04:31:07.685 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21932 fp=#0x3000000050a' 2024-08-31T04:31:07.686 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21964 fp=#0x300000008e6' 2024-08-31T04:31:07.686 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21996 fp=#0x30000000516' 2024-08-31T04:31:07.686 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22027 fp=#0x3000000193c' 2024-08-31T04:31:07.687 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22059 fp=#0x3000000190c' 2024-08-31T04:31:07.687 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22091 fp=#0x3000000193a' 2024-08-31T04:31:07.687 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22123 fp=#0x300000028dd' 2024-08-31T04:31:07.688 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22155 fp=#0x30000002969' 2024-08-31T04:31:07.688 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22187 fp=#0x3000000294e' 2024-08-31T04:31:07.688 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22219 fp=#0x300000028fb' 2024-08-31T04:31:07.689 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22251 fp=#0x300000028df' 2024-08-31T04:31:07.689 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22283 fp=#0x3000000207c' 2024-08-31T04:31:07.689 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22315 fp=#0x300000020a1' 2024-08-31T04:31:07.690 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22347 fp=#0x30000002084' 2024-08-31T04:31:07.690 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22379 fp=#0x30000000421' 2024-08-31T04:31:07.691 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22532 fp=#0x30000002c88' 2024-08-31T04:31:07.691 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22564 fp=#0x30000002c70' 2024-08-31T04:31:07.692 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22595 fp=#0x30000001470' 2024-08-31T04:31:07.692 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22627 fp=#0x3000000148b' 2024-08-31T04:31:07.692 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22659 fp=#0x3000000147c' 2024-08-31T04:31:07.693 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22691 fp=#0x30000001484' 2024-08-31T04:31:07.693 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22721 fp=#0x500000011c5' 2024-08-31T04:31:07.694 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:9757 fp=#0x10000000005' 2024-08-31T04:31:07.695 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:9917 fp=#0x30000001045' 2024-08-31T04:31:07.696 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:9949 fp=#0x300000035eb' 2024-08-31T04:31:07.701 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:10621 fp=#0x30000000a62' 2024-08-31T04:31:07.701 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:10685 fp=#0x30000000a85' 2024-08-31T04:31:07.710 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:11773 fp=#0x300000023bd' 2024-08-31T04:31:07.710 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:11805 fp=#0x30000000c2a' 2024-08-31T04:31:07.711 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:11869 fp=#0x30000000bb0' 2024-08-31T04:31:07.711 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:11901 fp=#0x300000023c5' 2024-08-31T04:31:07.711 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:11933 fp=#0x300000010a8' 2024-08-31T04:31:07.712 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:11965 fp=#0x30000001136' 2024-08-31T04:31:07.713 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12061 fp=#0x3000000116d' 2024-08-31T04:31:07.713 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12093 fp=#0x30000001178' 2024-08-31T04:31:07.715 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12349 fp=#0x300000009de' 2024-08-31T04:31:07.715 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12413 fp=#0x30000002e4d' 2024-08-31T04:31:07.716 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12509 fp=#0x30000000f7d' 2024-08-31T04:31:07.717 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12541 fp=#0x30000000f5a' 2024-08-31T04:31:07.717 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12573 fp=#0x30000000e38' 2024-08-31T04:31:07.717 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12605 fp=#0x3000000337c' 2024-08-31T04:31:07.718 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12637 fp=#0x3000000339c' 2024-08-31T04:31:07.718 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12669 fp=#0x300000033a8' 2024-08-31T04:31:07.718 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12701 fp=#0x30000000e94' 2024-08-31T04:31:07.719 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12733 fp=#0x30000000e99' 2024-08-31T04:31:07.719 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12765 fp=#0x30000000e2b' 2024-08-31T04:31:07.719 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12797 fp=#0x300000033a2' 2024-08-31T04:31:07.720 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12829 fp=#0x10000004201' 2024-08-31T04:31:07.720 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12861 fp=#0x100000041d7' 2024-08-31T04:31:07.720 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12893 fp=#0x100000043b9' 2024-08-31T04:31:07.721 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12925 fp=#0x100000043db' 2024-08-31T04:31:07.721 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12957 fp=#0x30000002836' 2024-08-31T04:31:07.721 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12989 fp=#0x10000004301' 2024-08-31T04:31:07.722 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13021 fp=#0x10000004220' 2024-08-31T04:31:07.722 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13053 fp=#0x3000000288d' 2024-08-31T04:31:07.722 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13085 fp=#0x1000000439f' 2024-08-31T04:31:07.723 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13117 fp=#0x3000000316a' 2024-08-31T04:31:07.723 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13149 fp=#0x300000030d3' 2024-08-31T04:31:07.723 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13181 fp=#0x30000003164' 2024-08-31T04:31:07.724 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13309 fp=#0x300000021fd' 2024-08-31T04:31:07.725 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13341 fp=#0x30000000a4a' 2024-08-31T04:31:07.725 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13373 fp=#0x30000002201' 2024-08-31T04:31:07.725 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13405 fp=#0x30000000892' 2024-08-31T04:31:07.726 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13437 fp=#0x300000008c4' 2024-08-31T04:31:07.726 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13469 fp=#0x3000000091b' 2024-08-31T04:31:07.726 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13501 fp=#0x3000000225b' 2024-08-31T04:31:07.727 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13533 fp=#0x300000008f9' 2024-08-31T04:31:07.727 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13565 fp=#0x30000003328' 2024-08-31T04:31:07.727 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13597 fp=#0x3000000334b' 2024-08-31T04:31:07.728 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13629 fp=#0x3000000329f' 2024-08-31T04:31:07.728 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13661 fp=#0x30000003298' 2024-08-31T04:31:07.728 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13693 fp=#0x30000002a2e' 2024-08-31T04:31:07.729 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13725 fp=#0x300000028ed' 2024-08-31T04:31:07.729 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13757 fp=#0x30000002900' 2024-08-31T04:31:07.729 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13789 fp=#0x300000029bc' 2024-08-31T04:31:07.730 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13821 fp=#0x300000028c9' 2024-08-31T04:31:07.730 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13853 fp=#0x300000029a1' 2024-08-31T04:31:07.730 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13917 fp=#0x10000003d86' 2024-08-31T04:31:07.731 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13981 fp=#0x10000003ba9' 2024-08-31T04:31:07.731 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14013 fp=#0x10000003c2b' 2024-08-31T04:31:07.732 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14045 fp=#0x10000003c1e' 2024-08-31T04:31:07.732 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14077 fp=#0x30000001c53' 2024-08-31T04:31:07.732 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14109 fp=#0x30000000c6c' 2024-08-31T04:31:07.733 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14141 fp=#0x30000001766' 2024-08-31T04:31:07.733 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14173 fp=#0x30000002438' 2024-08-31T04:31:07.733 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14205 fp=#0x3000000178b' 2024-08-31T04:31:07.734 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14237 fp=#0x30000001794' 2024-08-31T04:31:07.735 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14397 fp=#0x30000000c9b' 2024-08-31T04:31:07.735 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14429 fp=#0x30000002384' 2024-08-31T04:31:07.735 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14461 fp=#0x30000000d1c' 2024-08-31T04:31:07.736 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14493 fp=#0x30000000d69' 2024-08-31T04:31:07.736 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14525 fp=#0x30000000d3c' 2024-08-31T04:31:07.736 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14557 fp=#0x3000000238c' 2024-08-31T04:31:07.737 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14589 fp=#0x30000000d47' 2024-08-31T04:31:07.737 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14621 fp=#0x30000002f92' 2024-08-31T04:31:07.737 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14653 fp=#0x10000002451' 2024-08-31T04:31:07.738 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14685 fp=#0x30000002fcd' 2024-08-31T04:31:07.738 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14717 fp=#0x30000002f9b' 2024-08-31T04:31:07.738 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14749 fp=#0x30000002fb1' 2024-08-31T04:31:07.739 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14781 fp=#0x10000002463' 2024-08-31T04:31:07.739 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14812 fp=#0x10000003c0d' 2024-08-31T04:31:07.739 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14844 fp=#0x3000000094b' 2024-08-31T04:31:07.740 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14876 fp=#0x30000000968' 2024-08-31T04:31:07.740 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14908 fp=#0x3000000096e' 2024-08-31T04:31:07.740 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14940 fp=#0x30000000a24' 2024-08-31T04:31:07.741 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14972 fp=#0x3000000169f' 2024-08-31T04:31:07.741 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15004 fp=#0x3000000169a' 2024-08-31T04:31:07.741 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15036 fp=#0x300000014f7' 2024-08-31T04:31:07.742 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15068 fp=#0x300000015ee' 2024-08-31T04:31:07.742 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15100 fp=#0x30000001673' 2024-08-31T04:31:07.742 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15132 fp=#0x30000003388' 2024-08-31T04:31:07.743 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15164 fp=#0x3000000339b' 2024-08-31T04:31:07.743 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15196 fp=#0x300000033ad' 2024-08-31T04:31:07.743 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15228 fp=#0x30000002ea9' 2024-08-31T04:31:07.743 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15260 fp=#0x30000002e8c' 2024-08-31T04:31:07.744 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15292 fp=#0x30000002ec9' 2024-08-31T04:31:07.744 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15324 fp=#0x30000002eae' 2024-08-31T04:31:07.744 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15356 fp=#0x30000002eb2' 2024-08-31T04:31:07.745 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15388 fp=#0x300000032c2' 2024-08-31T04:31:07.745 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15420 fp=#0x30000001db6' 2024-08-31T04:31:07.745 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15452 fp=#0x30000000f2c' 2024-08-31T04:31:07.746 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15484 fp=#0x30000001dd1' 2024-08-31T04:31:07.746 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15516 fp=#0x30000001db0' 2024-08-31T04:31:07.746 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15548 fp=#0x30000000ee4' 2024-08-31T04:31:07.747 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15580 fp=#0x30000000f08' 2024-08-31T04:31:07.748 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15676 fp=#0x3000000055c' 2024-08-31T04:31:07.748 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15740 fp=#0x30000000545' 2024-08-31T04:31:07.749 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15835 fp=#0x30000001290' 2024-08-31T04:31:07.749 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15867 fp=#0x300000012e9' 2024-08-31T04:31:07.750 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15899 fp=#0x3000000129d' 2024-08-31T04:31:07.750 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15931 fp=#0x300000012a9' 2024-08-31T04:31:07.750 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15963 fp=#0x300000012fe' 2024-08-31T04:31:07.751 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15995 fp=#0x30000001004' 2024-08-31T04:31:07.751 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16027 fp=#0x3000000102b' 2024-08-31T04:31:07.751 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16059 fp=#0x30000002440' 2024-08-31T04:31:07.752 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16091 fp=#0x30000002e03' 2024-08-31T04:31:07.752 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16123 fp=#0x30000002df9' 2024-08-31T04:31:07.752 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16155 fp=#0x30000003407' 2024-08-31T04:31:07.753 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16251 fp=#0x300000005bd' 2024-08-31T04:31:07.753 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16283 fp=#0x300000034cb' 2024-08-31T04:31:07.754 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16315 fp=#0x300000005eb' 2024-08-31T04:31:07.754 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16344 fp=#0x30000002079' 2024-08-31T04:31:07.754 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16376 fp=#0x300000020bf' 2024-08-31T04:31:07.755 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16440 fp=#0x10000002537' 2024-08-31T04:31:07.755 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16472 fp=#0x10000002531' 2024-08-31T04:31:07.755 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16504 fp=#0x30000001d41' 2024-08-31T04:31:07.756 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16536 fp=#0x30000001d49' 2024-08-31T04:31:07.756 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16568 fp=#0x30000001d17' 2024-08-31T04:31:07.756 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16600 fp=#0x30000001d3a' 2024-08-31T04:31:07.757 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16631 fp=#0x30000002121' 2024-08-31T04:31:07.757 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16663 fp=#0x30000002134' 2024-08-31T04:31:07.757 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16695 fp=#0x30000002352' 2024-08-31T04:31:07.758 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16727 fp=#0x300000020fb' 2024-08-31T04:31:07.758 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16759 fp=#0x30000002657' 2024-08-31T04:31:07.758 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16791 fp=#0x3000000195a' 2024-08-31T04:31:07.758 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16823 fp=#0x30000001a30' 2024-08-31T04:31:07.759 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16950 fp=#0x30000002b8d' 2024-08-31T04:31:07.760 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16982 fp=#0x30000001a48' 2024-08-31T04:31:07.761 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17071 fp=#0x1000000363f' 2024-08-31T04:31:07.761 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17103 fp=#0x1000000382f' 2024-08-31T04:31:07.761 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17135 fp=#0x30000002cea' 2024-08-31T04:31:07.762 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17167 fp=#0x30000001797' 2024-08-31T04:31:07.762 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17199 fp=#0x30000001713' 2024-08-31T04:31:07.762 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17231 fp=#0x300000017e5' 2024-08-31T04:31:07.763 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17263 fp=#0x300000017be' 2024-08-31T04:31:07.763 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17295 fp=#0x300000017f2' 2024-08-31T04:31:07.763 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17327 fp=#0x3000000334c' 2024-08-31T04:31:07.763 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17359 fp=#0x3000000331b' 2024-08-31T04:31:07.765 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17551 fp=#0x300000031fd' 2024-08-31T04:31:07.765 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17583 fp=#0x30000000db4' 2024-08-31T04:31:07.765 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17615 fp=#0x300000031bb' 2024-08-31T04:31:07.766 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17647 fp=#0x300000031e9' 2024-08-31T04:31:07.767 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17807 fp=#0x30000001fba' 2024-08-31T04:31:07.767 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17839 fp=#0x30000001fd9' 2024-08-31T04:31:07.768 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17871 fp=#0x30000001f6a' 2024-08-31T04:31:07.768 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17903 fp=#0x30000001f7c' 2024-08-31T04:31:07.768 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17935 fp=#0x30000003131' 2024-08-31T04:31:07.769 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17967 fp=#0x3000000309c' 2024-08-31T04:31:07.769 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17999 fp=#0x30000001bf2' 2024-08-31T04:31:07.769 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18031 fp=#0x30000001c1d' 2024-08-31T04:31:07.770 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18063 fp=#0x30000001bf7' 2024-08-31T04:31:07.770 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18095 fp=#0x30000001c25' 2024-08-31T04:31:07.770 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18127 fp=#0x300000025a9' 2024-08-31T04:31:07.771 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18159 fp=#0x30000002570' 2024-08-31T04:31:07.771 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18191 fp=#0x30000002548' 2024-08-31T04:31:07.771 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18223 fp=#0x30000002527' 2024-08-31T04:31:07.771 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18255 fp=#0x300000027c4' 2024-08-31T04:31:07.772 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18287 fp=#0x3000000281e' 2024-08-31T04:31:07.772 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18319 fp=#0x300000027b3' 2024-08-31T04:31:07.772 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18351 fp=#0x30000002851' 2024-08-31T04:31:07.773 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18383 fp=#0x30000002f58' 2024-08-31T04:31:07.773 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18415 fp=#0x3000000301f' 2024-08-31T04:31:07.773 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18447 fp=#0x30000002ff3' 2024-08-31T04:31:07.774 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18479 fp=#0x30000002f2e' 2024-08-31T04:31:07.774 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18511 fp=#0x30000002f37' 2024-08-31T04:31:07.774 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18543 fp=#0x30000003026' 2024-08-31T04:31:07.775 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18607 fp=#0x10000001d5a' 2024-08-31T04:31:07.775 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18639 fp=#0x10000001d4a' 2024-08-31T04:31:07.776 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18703 fp=#0x300000013bf' 2024-08-31T04:31:07.776 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18735 fp=#0x300000013b8' 2024-08-31T04:31:07.776 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18767 fp=#0x300000013ad' 2024-08-31T04:31:07.776 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18799 fp=#0x300000013e5' 2024-08-31T04:31:07.777 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18831 fp=#0x30000001393' 2024-08-31T04:31:07.777 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18863 fp=#0x300000013d8' 2024-08-31T04:31:07.777 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18895 fp=#0x30000001d55' 2024-08-31T04:31:07.778 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18927 fp=#0x30000001102' 2024-08-31T04:31:07.778 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18959 fp=#0x30000001d6f' 2024-08-31T04:31:07.778 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18991 fp=#0x300000010f8' 2024-08-31T04:31:07.779 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19023 fp=#0x30000001d83' 2024-08-31T04:31:07.779 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19055 fp=#0x30000001169' 2024-08-31T04:31:07.779 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19087 fp=#0x3000000111a' 2024-08-31T04:31:07.780 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19119 fp=#0x30000001191' 2024-08-31T04:31:07.780 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19183 fp=#0x30000001670' 2024-08-31T04:31:07.781 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19247 fp=#0x3000000165d' 2024-08-31T04:31:07.781 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19279 fp=#0x100000008f0' 2024-08-31T04:31:07.782 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19311 fp=#0x100000008db' 2024-08-31T04:31:07.782 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19343 fp=#0x30000002bcd' 2024-08-31T04:31:07.782 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19375 fp=#0x100000008de' 2024-08-31T04:31:07.782 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19407 fp=#0x30000002bb4' 2024-08-31T04:31:07.783 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19438 fp=#0x30000000b5a' 2024-08-31T04:31:07.783 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19470 fp=#0x30000000b69' 2024-08-31T04:31:07.783 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19502 fp=#0x30000000b79' 2024-08-31T04:31:07.784 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19534 fp=#0x30000000b74' 2024-08-31T04:31:07.784 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19566 fp=#0x30000000b33' 2024-08-31T04:31:07.784 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19598 fp=#0x30000000ade' 2024-08-31T04:31:07.785 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19630 fp=#0x30000000b1b' 2024-08-31T04:31:07.785 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19662 fp=#0x30000002c7c' 2024-08-31T04:31:07.785 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19694 fp=#0x30000002d89' 2024-08-31T04:31:07.786 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19726 fp=#0x30000002c6d' 2024-08-31T04:31:07.786 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19758 fp=#0x30000002cf4' 2024-08-31T04:31:07.786 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19790 fp=#0x30000002c14' 2024-08-31T04:31:07.787 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19822 fp=#0x3000000112f' 2024-08-31T04:31:07.787 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19854 fp=#0x30000001156' 2024-08-31T04:31:07.787 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19886 fp=#0x3000000115f' 2024-08-31T04:31:07.788 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19918 fp=#0x30000001190' 2024-08-31T04:31:07.788 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19950 fp=#0x3000000142b' 2024-08-31T04:31:07.788 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19982 fp=#0x300000013ef' 2024-08-31T04:31:07.789 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20014 fp=#0x30000001429' 2024-08-31T04:31:07.789 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20046 fp=#0x30000000fbd' 2024-08-31T04:31:07.789 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20078 fp=#0x30000000fa8' 2024-08-31T04:31:07.790 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20110 fp=#0x30000000fb5' 2024-08-31T04:31:07.790 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20142 fp=#0x300000016cc' 2024-08-31T04:31:07.790 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20174 fp=#0x300000016ca' 2024-08-31T04:31:07.791 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20206 fp=#0x300000016bc' 2024-08-31T04:31:07.791 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20238 fp=#0x3000000324e' 2024-08-31T04:31:07.791 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20270 fp=#0x300000030cc' 2024-08-31T04:31:07.792 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20302 fp=#0x3000000318e' 2024-08-31T04:31:07.792 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20334 fp=#0x30000003178' 2024-08-31T04:31:07.792 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20366 fp=#0x3000000318d' 2024-08-31T04:31:07.793 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20398 fp=#0x30000001ce2' 2024-08-31T04:31:07.793 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20430 fp=#0x30000001c63' 2024-08-31T04:31:07.793 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20462 fp=#0x30000001c79' 2024-08-31T04:31:07.794 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20494 fp=#0x30000001ca9' 2024-08-31T04:31:07.794 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20526 fp=#0x30000001259' 2024-08-31T04:31:07.794 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20558 fp=#0x30000001242' 2024-08-31T04:31:07.794 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20590 fp=#0x3000000122a' 2024-08-31T04:31:07.795 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20654 fp=#0x30000002149' 2024-08-31T04:31:07.795 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20686 fp=#0x300000021bf' 2024-08-31T04:31:07.796 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20782 fp=#0x10000003867' 2024-08-31T04:31:07.796 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20814 fp=#0x10000003861' 2024-08-31T04:31:07.797 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20910 fp=#0x3000000307d' 2024-08-31T04:31:07.798 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20974 fp=#0x300000020cf' 2024-08-31T04:31:07.798 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21006 fp=#0x300000020e3' 2024-08-31T04:31:07.798 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21037 fp=#0x3000000161e' 2024-08-31T04:31:07.799 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21069 fp=#0x300000015c6' 2024-08-31T04:31:07.799 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21101 fp=#0x3000000164d' 2024-08-31T04:31:07.800 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21197 fp=#0x30000002c57' 2024-08-31T04:31:07.801 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21325 fp=#0x1000000322d' 2024-08-31T04:31:07.801 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21357 fp=#0x1000000323a' 2024-08-31T04:31:07.801 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21389 fp=#0x1000000333f' 2024-08-31T04:31:07.802 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21421 fp=#0x10000003351' 2024-08-31T04:31:07.802 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21453 fp=#0x30000002681' 2024-08-31T04:31:07.802 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21485 fp=#0x300000026e1' 2024-08-31T04:31:07.803 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21517 fp=#0x300000026d6' 2024-08-31T04:31:07.803 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21549 fp=#0x30000002739' 2024-08-31T04:31:07.803 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21581 fp=#0x30000002699' 2024-08-31T04:31:07.804 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21613 fp=#0x30000000cb0' 2024-08-31T04:31:07.804 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21645 fp=#0x3000000370c' 2024-08-31T04:31:07.804 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21677 fp=#0x3000000368c' 2024-08-31T04:31:07.805 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21709 fp=#0x30000000cf7' 2024-08-31T04:31:07.805 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21741 fp=#0x30000000c98' 2024-08-31T04:31:07.805 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21773 fp=#0x30000000b07' 2024-08-31T04:31:07.805 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21805 fp=#0x30000000aef' 2024-08-31T04:31:07.806 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21837 fp=#0x30000000a8d' 2024-08-31T04:31:07.806 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21869 fp=#0x30000000ae1' 2024-08-31T04:31:07.806 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21901 fp=#0x300000008f0' 2024-08-31T04:31:07.807 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21933 fp=#0x3000000051d' 2024-08-31T04:31:07.807 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21965 fp=#0x30000000507' 2024-08-31T04:31:07.807 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21997 fp=#0x30000000511' 2024-08-31T04:31:07.808 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22028 fp=#0x30000001945' 2024-08-31T04:31:07.808 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22060 fp=#0x30000001905' 2024-08-31T04:31:07.808 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22092 fp=#0x3000000191a' 2024-08-31T04:31:07.809 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22124 fp=#0x30000002997' 2024-08-31T04:31:07.809 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22156 fp=#0x30000002934' 2024-08-31T04:31:07.809 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22188 fp=#0x300000029a5' 2024-08-31T04:31:07.809 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22220 fp=#0x300000028cf' 2024-08-31T04:31:07.810 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22252 fp=#0x30000002925' 2024-08-31T04:31:07.810 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22284 fp=#0x3000000206c' 2024-08-31T04:31:07.810 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22316 fp=#0x3000000204c' 2024-08-31T04:31:07.811 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22348 fp=#0x30000001ff9' 2024-08-31T04:31:07.811 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22380 fp=#0x300000004af' 2024-08-31T04:31:07.811 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22412 fp=#0x30000000473' 2024-08-31T04:31:07.812 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22533 fp=#0x30000002c86' 2024-08-31T04:31:07.813 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22565 fp=#0x30000002c16' 2024-08-31T04:31:07.813 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22596 fp=#0x1000000105e' 2024-08-31T04:31:07.814 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:9758 fp=#0x10000000006' 2024-08-31T04:31:07.814 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:9790 fp=#0x30000000e15' 2024-08-31T04:31:07.815 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:9822 fp=#0x300000014b7' 2024-08-31T04:31:07.815 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:9918 fp=#0x3000000110e' 2024-08-31T04:31:07.816 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:9950 fp=#0x30000000a8b' 2024-08-31T04:31:07.821 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:10686 fp=#0x30000000a5b' 2024-08-31T04:31:07.829 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:11806 fp=#0x30000000bb8' 2024-08-31T04:31:07.830 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:11838 fp=#0x30000000c39' 2024-08-31T04:31:07.830 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:11934 fp=#0x300000011a8' 2024-08-31T04:31:07.831 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:11966 fp=#0x300000010dd' 2024-08-31T04:31:07.831 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:11998 fp=#0x30000001073' 2024-08-31T04:31:07.831 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12030 fp=#0x3000000106e' 2024-08-31T04:31:07.832 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12062 fp=#0x300000010cf' 2024-08-31T04:31:07.832 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12094 fp=#0x3000000109c' 2024-08-31T04:31:07.833 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12222 fp=#0x300000009cb' 2024-08-31T04:31:07.833 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12254 fp=#0x3000000098e' 2024-08-31T04:31:07.834 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12286 fp=#0x30000000961' 2024-08-31T04:31:07.835 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12414 fp=#0x30000002e4b' 2024-08-31T04:31:07.835 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12446 fp=#0x30000002e49' 2024-08-31T04:31:07.835 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12478 fp=#0x30000002e44' 2024-08-31T04:31:07.836 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12510 fp=#0x30000002a5e' 2024-08-31T04:31:07.836 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12542 fp=#0x30000000f55' 2024-08-31T04:31:07.836 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12574 fp=#0x30000000fdf' 2024-08-31T04:31:07.837 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12606 fp=#0x30000002287' 2024-08-31T04:31:07.837 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12638 fp=#0x30000000e3c' 2024-08-31T04:31:07.837 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12670 fp=#0x30000000e3b' 2024-08-31T04:31:07.838 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12702 fp=#0x3000000226e' 2024-08-31T04:31:07.838 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12734 fp=#0x30000000e1f' 2024-08-31T04:31:07.838 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12766 fp=#0x30000000e79' 2024-08-31T04:31:07.839 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12798 fp=#0x30000003396' 2024-08-31T04:31:07.839 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12830 fp=#0x10000004406' 2024-08-31T04:31:07.841 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12862 fp=#0x30000002846' 2024-08-31T04:31:07.842 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12894 fp=#0x30000002868' 2024-08-31T04:31:07.842 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12926 fp=#0x30000002873' 2024-08-31T04:31:07.842 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12958 fp=#0x10000004365' 2024-08-31T04:31:07.843 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12990 fp=#0x10000004252' 2024-08-31T04:31:07.843 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13022 fp=#0x30000002850' 2024-08-31T04:31:07.843 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13054 fp=#0x3000000286f' 2024-08-31T04:31:07.844 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13086 fp=#0x3000000282b' 2024-08-31T04:31:07.844 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13118 fp=#0x3000000314a' 2024-08-31T04:31:07.844 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13150 fp=#0x30000003172' 2024-08-31T04:31:07.846 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13310 fp=#0x30000000909' 2024-08-31T04:31:07.846 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13342 fp=#0x300000008e3' 2024-08-31T04:31:07.846 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13374 fp=#0x30000002258' 2024-08-31T04:31:07.847 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13406 fp=#0x30000002275' 2024-08-31T04:31:07.847 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13438 fp=#0x300000008a5' 2024-08-31T04:31:07.847 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13470 fp=#0x30000000979' 2024-08-31T04:31:07.848 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13502 fp=#0x30000002255' 2024-08-31T04:31:07.848 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13534 fp=#0x30000002290' 2024-08-31T04:31:07.848 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13566 fp=#0x3000000330c' 2024-08-31T04:31:07.848 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13598 fp=#0x30000003300' 2024-08-31T04:31:07.849 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13630 fp=#0x300000032aa' 2024-08-31T04:31:07.849 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13662 fp=#0x300000032f4' 2024-08-31T04:31:07.849 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13694 fp=#0x30000002a47' 2024-08-31T04:31:07.850 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13726 fp=#0x300000029c7' 2024-08-31T04:31:07.850 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13758 fp=#0x30000002908' 2024-08-31T04:31:07.850 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13790 fp=#0x30000002913' 2024-08-31T04:31:07.851 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13822 fp=#0x300000028ad' 2024-08-31T04:31:07.851 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13854 fp=#0x300000028aa' 2024-08-31T04:31:07.851 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13886 fp=#0x10000003eab' 2024-08-31T04:31:07.852 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13918 fp=#0x10000003be1' 2024-08-31T04:31:07.853 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14014 fp=#0x10000003ea5' 2024-08-31T04:31:07.853 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14078 fp=#0x30000000c6a' 2024-08-31T04:31:07.854 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14110 fp=#0x30000000c52' 2024-08-31T04:31:07.854 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14142 fp=#0x3000000176f' 2024-08-31T04:31:07.854 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14174 fp=#0x3000000178e' 2024-08-31T04:31:07.855 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14206 fp=#0x3000000178a' 2024-08-31T04:31:07.855 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14238 fp=#0x30000001757' 2024-08-31T04:31:07.856 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14398 fp=#0x30000000d29' 2024-08-31T04:31:07.857 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14430 fp=#0x30000000ca1' 2024-08-31T04:31:07.857 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14462 fp=#0x30000000d24' 2024-08-31T04:31:07.857 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14494 fp=#0x30000000d5e' 2024-08-31T04:31:07.857 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14526 fp=#0x30000000cc9' 2024-08-31T04:31:07.858 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14558 fp=#0x30000002386' 2024-08-31T04:31:07.858 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14590 fp=#0x30000002383' 2024-08-31T04:31:07.858 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14622 fp=#0x1000000249e' 2024-08-31T04:31:07.859 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14654 fp=#0x30000002f94' 2024-08-31T04:31:07.859 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14686 fp=#0x10000002423' 2024-08-31T04:31:07.859 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14718 fp=#0x10000002435' 2024-08-31T04:31:07.860 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14750 fp=#0x30000002fbb' 2024-08-31T04:31:07.860 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14782 fp=#0x1000000246f' 2024-08-31T04:31:07.860 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14813 fp=#0x10000003b95' 2024-08-31T04:31:07.861 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14845 fp=#0x30000000940' 2024-08-31T04:31:07.861 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14877 fp=#0x30000000989' 2024-08-31T04:31:07.861 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14909 fp=#0x30000000912' 2024-08-31T04:31:07.862 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14941 fp=#0x30000000962' 2024-08-31T04:31:07.862 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14973 fp=#0x30000001698' 2024-08-31T04:31:07.862 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15005 fp=#0x300000015c1' 2024-08-31T04:31:07.863 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15037 fp=#0x30000001507' 2024-08-31T04:31:07.863 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15069 fp=#0x30000001617' 2024-08-31T04:31:07.863 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15101 fp=#0x300000015fa' 2024-08-31T04:31:07.864 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15133 fp=#0x300000033ee' 2024-08-31T04:31:07.864 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15165 fp=#0x300000033ea' 2024-08-31T04:31:07.864 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15197 fp=#0x300000033a7' 2024-08-31T04:31:07.864 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15229 fp=#0x30000002ebd' 2024-08-31T04:31:07.865 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15261 fp=#0x30000002ea5' 2024-08-31T04:31:07.865 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15293 fp=#0x30000002e8d' 2024-08-31T04:31:07.865 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15325 fp=#0x30000002e91' 2024-08-31T04:31:07.866 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15357 fp=#0x30000002e64' 2024-08-31T04:31:07.866 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15389 fp=#0x300000032c9' 2024-08-31T04:31:07.866 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15421 fp=#0x30000000eea' 2024-08-31T04:31:07.867 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15453 fp=#0x30000000ee5' 2024-08-31T04:31:07.867 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15485 fp=#0x30000001da6' 2024-08-31T04:31:07.867 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15517 fp=#0x30000001db7' 2024-08-31T04:31:07.868 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15549 fp=#0x30000000ecf' 2024-08-31T04:31:07.868 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15581 fp=#0x30000000ee7' 2024-08-31T04:31:07.868 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15613 fp=#0x3000000052e' 2024-08-31T04:31:07.869 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15645 fp=#0x30000000566' 2024-08-31T04:31:07.869 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15677 fp=#0x30000000568' 2024-08-31T04:31:07.870 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15805 fp=#0x300000005bc' 2024-08-31T04:31:07.870 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15836 fp=#0x300000012c3' 2024-08-31T04:31:07.871 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15868 fp=#0x300000012d0' 2024-08-31T04:31:07.871 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15900 fp=#0x300000012e1' 2024-08-31T04:31:07.871 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15932 fp=#0x3000000127b' 2024-08-31T04:31:07.872 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15964 fp=#0x300000012f7' 2024-08-31T04:31:07.872 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15996 fp=#0x30000001079' 2024-08-31T04:31:07.872 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16028 fp=#0x300000010b0' 2024-08-31T04:31:07.872 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16060 fp=#0x30000001089' 2024-08-31T04:31:07.873 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16092 fp=#0x30000002dfe' 2024-08-31T04:31:07.873 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16124 fp=#0x30000001822' 2024-08-31T04:31:07.873 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16156 fp=#0x30000001189' 2024-08-31T04:31:07.874 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16188 fp=#0x300000005dc' 2024-08-31T04:31:07.874 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16220 fp=#0x300000034a2' 2024-08-31T04:31:07.875 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16284 fp=#0x300000034b4' 2024-08-31T04:31:07.875 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16345 fp=#0x3000000208d' 2024-08-31T04:31:07.876 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16377 fp=#0x1000000286e' 2024-08-31T04:31:07.876 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16409 fp=#0x3000000207f' 2024-08-31T04:31:07.876 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16441 fp=#0x30000001cdb' 2024-08-31T04:31:07.876 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16473 fp=#0x1000000252b' 2024-08-31T04:31:07.877 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16505 fp=#0x30000001d04' 2024-08-31T04:31:07.877 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16537 fp=#0x30000001cf0' 2024-08-31T04:31:07.877 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16569 fp=#0x100000024d1' 2024-08-31T04:31:07.878 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16601 fp=#0x30000001d35' 2024-08-31T04:31:07.878 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16632 fp=#0x300000021cc' 2024-08-31T04:31:07.878 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16664 fp=#0x30000002142' 2024-08-31T04:31:07.879 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16696 fp=#0x3000000222f' 2024-08-31T04:31:07.879 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16728 fp=#0x3000000212a' 2024-08-31T04:31:07.879 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16760 fp=#0x300000003e8' 2024-08-31T04:31:07.880 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16792 fp=#0x30000001956' 2024-08-31T04:31:07.880 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16856 fp=#0x300000019e2' 2024-08-31T04:31:07.881 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16888 fp=#0x30000001a23' 2024-08-31T04:31:07.881 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16951 fp=#0x30000001a66' 2024-08-31T04:31:07.882 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16983 fp=#0x30000001af3' 2024-08-31T04:31:07.882 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17040 fp=#0x10000003696' 2024-08-31T04:31:07.882 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17072 fp=#0x10000003689' 2024-08-31T04:31:07.883 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17104 fp=#0x10000003666' 2024-08-31T04:31:07.883 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17136 fp=#0x30000001805' 2024-08-31T04:31:07.883 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17168 fp=#0x30000002ca8' 2024-08-31T04:31:07.884 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17200 fp=#0x300000017bb' 2024-08-31T04:31:07.884 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17232 fp=#0x300000017da' 2024-08-31T04:31:07.884 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17264 fp=#0x300000017b4' 2024-08-31T04:31:07.885 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17296 fp=#0x3000000173f' 2024-08-31T04:31:07.885 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17328 fp=#0x30000003363' 2024-08-31T04:31:07.885 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17360 fp=#0x30000003342' 2024-08-31T04:31:07.885 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17392 fp=#0x30000002427' 2024-08-31T04:31:07.887 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17552 fp=#0x30000000de7' 2024-08-31T04:31:07.887 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17584 fp=#0x30000000de5' 2024-08-31T04:31:07.887 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17616 fp=#0x30000000dab' 2024-08-31T04:31:07.888 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17648 fp=#0x300000031d9' 2024-08-31T04:31:07.889 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17808 fp=#0x30000001f6f' 2024-08-31T04:31:07.889 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17840 fp=#0x3000000201a' 2024-08-31T04:31:07.890 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17872 fp=#0x3000000202c' 2024-08-31T04:31:07.890 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17904 fp=#0x30000001fb1' 2024-08-31T04:31:07.890 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17936 fp=#0x30000003108' 2024-08-31T04:31:07.890 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17968 fp=#0x30000003092' 2024-08-31T04:31:07.891 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18000 fp=#0x30000001c0a' 2024-08-31T04:31:07.891 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18032 fp=#0x30000001c28' 2024-08-31T04:31:07.891 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18064 fp=#0x30000001bf6' 2024-08-31T04:31:07.892 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18096 fp=#0x30000001be3' 2024-08-31T04:31:07.892 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18128 fp=#0x3000000256d' 2024-08-31T04:31:07.892 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18160 fp=#0x30000002574' 2024-08-31T04:31:07.893 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18192 fp=#0x30000002547' 2024-08-31T04:31:07.893 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18224 fp=#0x30000002551' 2024-08-31T04:31:07.894 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18256 fp=#0x300000027d8' 2024-08-31T04:31:07.894 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18288 fp=#0x300000027b5' 2024-08-31T04:31:07.894 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18320 fp=#0x300000027e4' 2024-08-31T04:31:07.894 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18352 fp=#0x300000027af' 2024-08-31T04:31:07.895 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18384 fp=#0x30000002f3e' 2024-08-31T04:31:07.895 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18416 fp=#0x3000000300d' 2024-08-31T04:31:07.895 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18448 fp=#0x30000003025' 2024-08-31T04:31:07.896 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18480 fp=#0x30000003013' 2024-08-31T04:31:07.896 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18512 fp=#0x30000002f2a' 2024-08-31T04:31:07.896 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18544 fp=#0x30000002f5a' 2024-08-31T04:31:07.897 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18576 fp=#0x10000001cf3' 2024-08-31T04:31:07.897 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18640 fp=#0x10000001d4e' 2024-08-31T04:31:07.898 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18672 fp=#0x10000001cf5' 2024-08-31T04:31:07.898 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18704 fp=#0x30000001351' 2024-08-31T04:31:07.898 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18736 fp=#0x30000002eba' 2024-08-31T04:31:07.899 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18768 fp=#0x300000013af' 2024-08-31T04:31:07.899 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18800 fp=#0x30000001396' 2024-08-31T04:31:07.899 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18832 fp=#0x300000013c5' 2024-08-31T04:31:07.900 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18864 fp=#0x300000013ca' 2024-08-31T04:31:07.900 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18896 fp=#0x300000010ff' 2024-08-31T04:31:07.900 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18928 fp=#0x300000010e6' 2024-08-31T04:31:07.900 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18960 fp=#0x30000001091' 2024-08-31T04:31:07.901 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18992 fp=#0x300000010a3' 2024-08-31T04:31:07.901 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19024 fp=#0x300000010e4' 2024-08-31T04:31:07.901 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19056 fp=#0x300000011f7' 2024-08-31T04:31:07.902 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19088 fp=#0x30000001133' 2024-08-31T04:31:07.902 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19120 fp=#0x300000011ec' 2024-08-31T04:31:07.902 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19152 fp=#0x3000000164e' 2024-08-31T04:31:07.903 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19184 fp=#0x300000015cd' 2024-08-31T04:31:07.903 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19216 fp=#0x3000000168e' 2024-08-31T04:31:07.903 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19248 fp=#0x3000000162a' 2024-08-31T04:31:07.903 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19280 fp=#0x100000008f2' 2024-08-31T04:31:07.904 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19312 fp=#0x3000000092a' 2024-08-31T04:31:07.904 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19344 fp=#0x30000002a40' 2024-08-31T04:31:07.904 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19376 fp=#0x100000008cd' 2024-08-31T04:31:07.905 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19408 fp=#0x30000002baf' 2024-08-31T04:31:07.905 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19439 fp=#0x30000000b95' 2024-08-31T04:31:07.905 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19471 fp=#0x30000000b7a' 2024-08-31T04:31:07.906 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19503 fp=#0x30000000ba5' 2024-08-31T04:31:07.906 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19535 fp=#0x30000000bcf' 2024-08-31T04:31:07.906 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19567 fp=#0x30000000ac3' 2024-08-31T04:31:07.907 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19599 fp=#0x30000000ac7' 2024-08-31T04:31:07.907 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19631 fp=#0x30000000af8' 2024-08-31T04:31:07.907 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19663 fp=#0x30000002c47' 2024-08-31T04:31:07.907 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19695 fp=#0x30000002bfa' 2024-08-31T04:31:07.908 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19727 fp=#0x30000002d28' 2024-08-31T04:31:07.908 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19759 fp=#0x30000002c69' 2024-08-31T04:31:07.908 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19791 fp=#0x30000002c36' 2024-08-31T04:31:07.909 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19823 fp=#0x300000011bf' 2024-08-31T04:31:07.909 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19855 fp=#0x300000011d7' 2024-08-31T04:31:07.909 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19887 fp=#0x3000000143e' 2024-08-31T04:31:07.910 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19919 fp=#0x3000000146a' 2024-08-31T04:31:07.910 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19951 fp=#0x300000013f4' 2024-08-31T04:31:07.910 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19983 fp=#0x300000013fc' 2024-08-31T04:31:07.911 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20015 fp=#0x30000001404' 2024-08-31T04:31:07.911 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20047 fp=#0x30000000ff1' 2024-08-31T04:31:07.911 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20079 fp=#0x30000000ffc' 2024-08-31T04:31:07.912 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20111 fp=#0x30000000fb8' 2024-08-31T04:31:07.912 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20143 fp=#0x30000001703' 2024-08-31T04:31:07.912 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20175 fp=#0x300000016d4' 2024-08-31T04:31:07.913 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20207 fp=#0x30000001707' 2024-08-31T04:31:07.913 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20239 fp=#0x3000000306e' 2024-08-31T04:31:07.913 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20271 fp=#0x3000000322a' 2024-08-31T04:31:07.914 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20303 fp=#0x30000003194' 2024-08-31T04:31:07.914 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20335 fp=#0x30000003252' 2024-08-31T04:31:07.914 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20367 fp=#0x30000003186' 2024-08-31T04:31:07.915 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20399 fp=#0x30000001cee' 2024-08-31T04:31:07.915 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20431 fp=#0x30000001c85' 2024-08-31T04:31:07.915 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20463 fp=#0x30000001c74' 2024-08-31T04:31:07.916 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20495 fp=#0x30000001c83' 2024-08-31T04:31:07.916 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20527 fp=#0x30000001219' 2024-08-31T04:31:07.916 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20559 fp=#0x30000001237' 2024-08-31T04:31:07.917 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20591 fp=#0x30000001257' 2024-08-31T04:31:07.918 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20719 fp=#0x300000021c7' 2024-08-31T04:31:07.918 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20783 fp=#0x3000000369c' 2024-08-31T04:31:07.919 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20847 fp=#0x300000030e3' 2024-08-31T04:31:07.919 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20911 fp=#0x30000001c48' 2024-08-31T04:31:07.920 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20975 fp=#0x300000020e9' 2024-08-31T04:31:07.920 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21007 fp=#0x300000020d4' 2024-08-31T04:31:07.921 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21038 fp=#0x30000001699' 2024-08-31T04:31:07.921 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21070 fp=#0x300000015fc' 2024-08-31T04:31:07.921 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21102 fp=#0x30000001687' 2024-08-31T04:31:07.921 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21134 fp=#0x30000002c4f' 2024-08-31T04:31:07.922 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21198 fp=#0x30000002bbf' 2024-08-31T04:31:07.922 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21230 fp=#0x30000002c42' 2024-08-31T04:31:07.923 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21326 fp=#0x1000000328d' 2024-08-31T04:31:07.923 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21358 fp=#0x1000000325f' 2024-08-31T04:31:07.924 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21390 fp=#0x10000003347' 2024-08-31T04:31:07.924 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21422 fp=#0x10000003343' 2024-08-31T04:31:07.924 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21454 fp=#0x30000002615' 2024-08-31T04:31:07.925 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21486 fp=#0x30000002648' 2024-08-31T04:31:07.925 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21518 fp=#0x300000026fc' 2024-08-31T04:31:07.925 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21550 fp=#0x30000002702' 2024-08-31T04:31:07.925 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21582 fp=#0x30000002622' 2024-08-31T04:31:07.926 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21614 fp=#0x30000000d52' 2024-08-31T04:31:07.926 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21646 fp=#0x30000000ca4' 2024-08-31T04:31:07.926 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21678 fp=#0x30000003709' 2024-08-31T04:31:07.927 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21710 fp=#0x30000000c9c' 2024-08-31T04:31:07.927 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21742 fp=#0x30000000ced' 2024-08-31T04:31:07.927 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21774 fp=#0x30000000b45' 2024-08-31T04:31:07.928 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21806 fp=#0x30000000b05' 2024-08-31T04:31:07.928 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21838 fp=#0x30000003017' 2024-08-31T04:31:07.928 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21870 fp=#0x30000000ae7' 2024-08-31T04:31:07.929 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21902 fp=#0x300000008f8' 2024-08-31T04:31:07.929 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21934 fp=#0x30000000589' 2024-08-31T04:31:07.929 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21966 fp=#0x30000000506' 2024-08-31T04:31:07.929 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21998 fp=#0x30000000518' 2024-08-31T04:31:07.930 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22029 fp=#0x30000002f77' 2024-08-31T04:31:07.930 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22061 fp=#0x30000002f80' 2024-08-31T04:31:07.930 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22093 fp=#0x300000018f3' 2024-08-31T04:31:07.931 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22125 fp=#0x3000000291a' 2024-08-31T04:31:07.931 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22157 fp=#0x3000000296f' 2024-08-31T04:31:07.931 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22189 fp=#0x30000002930' 2024-08-31T04:31:07.932 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22221 fp=#0x3000000292d' 2024-08-31T04:31:07.932 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22253 fp=#0x3000000297d' 2024-08-31T04:31:07.932 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22285 fp=#0x30000002049' 2024-08-31T04:31:07.933 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22317 fp=#0x30000002094' 2024-08-31T04:31:07.933 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22349 fp=#0x30000001fee' 2024-08-31T04:31:07.933 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22381 fp=#0x3000000047b' 2024-08-31T04:31:07.933 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22413 fp=#0x30000000490' 2024-08-31T04:31:07.934 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22477 fp=#0x30000000432' 2024-08-31T04:31:07.935 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22534 fp=#0x30000002c9c' 2024-08-31T04:31:07.935 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22566 fp=#0x30000002c7e' 2024-08-31T04:31:07.935 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22597 fp=#0x300000033a9' 2024-08-31T04:31:07.935 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22629 fp=#0x10000001045' 2024-08-31T04:31:07.936 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22661 fp=#0x100000010eb' 2024-08-31T04:31:07.936 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22723 fp=#0x500000011f0' 2024-08-31T04:31:07.936 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:9759 fp=#0x10000000201' 2024-08-31T04:31:07.937 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:9823 fp=#0x30000003380' 2024-08-31T04:31:07.938 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:9919 fp=#0x30000001584' 2024-08-31T04:31:07.951 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:11775 fp=#0x30000000c3a' 2024-08-31T04:31:07.951 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:11807 fp=#0x300000023ad' 2024-08-31T04:31:07.952 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:11903 fp=#0x30000000bb4' 2024-08-31T04:31:07.953 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:11967 fp=#0x30000001115' 2024-08-31T04:31:07.953 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:11999 fp=#0x300000010df' 2024-08-31T04:31:07.953 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12031 fp=#0x300000023f8' 2024-08-31T04:31:07.954 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12063 fp=#0x3000000110c' 2024-08-31T04:31:07.954 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12095 fp=#0x300000031ff' 2024-08-31T04:31:07.955 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12223 fp=#0x30000000944' 2024-08-31T04:31:07.955 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12255 fp=#0x300000009cd' 2024-08-31T04:31:07.956 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12287 fp=#0x3000000096b' 2024-08-31T04:31:07.956 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12383 fp=#0x300000009a6' 2024-08-31T04:31:07.957 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12415 fp=#0x30000002e4a' 2024-08-31T04:31:07.957 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12447 fp=#0x30000002e17' 2024-08-31T04:31:07.957 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12479 fp=#0x30000002e0b' 2024-08-31T04:31:07.958 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12511 fp=#0x30000000f77' 2024-08-31T04:31:07.958 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12543 fp=#0x30000000f4b' 2024-08-31T04:31:07.958 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12575 fp=#0x30000003369' 2024-08-31T04:31:07.959 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12607 fp=#0x30000000fe9' 2024-08-31T04:31:07.959 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12639 fp=#0x30000000eae' 2024-08-31T04:31:07.959 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12671 fp=#0x300000033a1' 2024-08-31T04:31:07.960 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12703 fp=#0x300000033c3' 2024-08-31T04:31:07.960 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12735 fp=#0x3000000335c' 2024-08-31T04:31:07.960 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12767 fp=#0x30000000fc8' 2024-08-31T04:31:07.961 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12799 fp=#0x30000000e28' 2024-08-31T04:31:07.961 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12831 fp=#0x30000002823' 2024-08-31T04:31:07.961 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12863 fp=#0x30000002808' 2024-08-31T04:31:07.962 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12895 fp=#0x30000002865' 2024-08-31T04:31:07.962 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12927 fp=#0x10000004205' 2024-08-31T04:31:07.962 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12959 fp=#0x100000043a4' 2024-08-31T04:31:07.963 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12991 fp=#0x100000043a6' 2024-08-31T04:31:07.963 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13023 fp=#0x100000041e6' 2024-08-31T04:31:07.963 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13055 fp=#0x30000002861' 2024-08-31T04:31:07.964 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13087 fp=#0x300000030a4' 2024-08-31T04:31:07.964 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13119 fp=#0x300000031b9' 2024-08-31T04:31:07.964 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13151 fp=#0x30000003142' 2024-08-31T04:31:07.965 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13311 fp=#0x30000000a54' 2024-08-31T04:31:07.966 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13343 fp=#0x300000009d2' 2024-08-31T04:31:07.966 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13375 fp=#0x300000008d4' 2024-08-31T04:31:07.966 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13407 fp=#0x30000001d1c' 2024-08-31T04:31:07.967 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13439 fp=#0x30000000900' 2024-08-31T04:31:07.967 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13471 fp=#0x300000008d7' 2024-08-31T04:31:07.967 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13503 fp=#0x30000002206' 2024-08-31T04:31:07.968 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13535 fp=#0x3000000226d' 2024-08-31T04:31:07.968 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13567 fp=#0x300000032ac' 2024-08-31T04:31:07.968 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13599 fp=#0x30000003288' 2024-08-31T04:31:07.969 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13631 fp=#0x300000032f5' 2024-08-31T04:31:07.969 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13663 fp=#0x300000028fd' 2024-08-31T04:31:07.969 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13695 fp=#0x3000000295f' 2024-08-31T04:31:07.970 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13727 fp=#0x300000028de' 2024-08-31T04:31:07.970 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13759 fp=#0x30000002939' 2024-08-31T04:31:07.970 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13791 fp=#0x300000028c0' 2024-08-31T04:31:07.970 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13823 fp=#0x30000002920' 2024-08-31T04:31:07.971 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13855 fp=#0x30000002943' 2024-08-31T04:31:07.971 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13887 fp=#0x10000003de0' 2024-08-31T04:31:07.971 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13919 fp=#0x10000003c0f' 2024-08-31T04:31:07.972 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13951 fp=#0x10000003d2d' 2024-08-31T04:31:07.972 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14015 fp=#0x10000003ebb' 2024-08-31T04:31:07.972 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14047 fp=#0x10000003d6b' 2024-08-31T04:31:07.973 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14079 fp=#0x30000001cbf' 2024-08-31T04:31:07.973 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14111 fp=#0x30000000c49' 2024-08-31T04:31:07.974 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14143 fp=#0x300000017a2' 2024-08-31T04:31:07.974 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14175 fp=#0x30000001799' 2024-08-31T04:31:07.974 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14207 fp=#0x3000000175b' 2024-08-31T04:31:07.974 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14239 fp=#0x30000001792' 2024-08-31T04:31:07.975 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14303 fp=#0x3000000237d' 2024-08-31T04:31:07.976 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14399 fp=#0x30000000d00' 2024-08-31T04:31:07.976 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14431 fp=#0x30000000d7b' 2024-08-31T04:31:07.976 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14463 fp=#0x3000000239f' 2024-08-31T04:31:07.977 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14495 fp=#0x30000000d70' 2024-08-31T04:31:07.977 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14527 fp=#0x30000000c99' 2024-08-31T04:31:07.977 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14559 fp=#0x30000000d7c' 2024-08-31T04:31:07.978 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14591 fp=#0x30000000cfa' 2024-08-31T04:31:07.978 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14623 fp=#0x30000002fcc' 2024-08-31T04:31:07.978 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14655 fp=#0x10000002467' 2024-08-31T04:31:07.979 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14687 fp=#0x1000000242a' 2024-08-31T04:31:07.979 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14719 fp=#0x100000023f1' 2024-08-31T04:31:07.979 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14751 fp=#0x30000002fb2' 2024-08-31T04:31:07.979 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14783 fp=#0x1000000241b' 2024-08-31T04:31:07.980 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14814 fp=#0x10000003ba7' 2024-08-31T04:31:07.980 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14846 fp=#0x300000009e6' 2024-08-31T04:31:07.981 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14878 fp=#0x3000000096c' 2024-08-31T04:31:07.981 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14910 fp=#0x300000009e1' 2024-08-31T04:31:07.981 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14942 fp=#0x300000009c5' 2024-08-31T04:31:07.982 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14974 fp=#0x300000014bc' 2024-08-31T04:31:07.982 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15006 fp=#0x3000000168f' 2024-08-31T04:31:07.982 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15038 fp=#0x30000001553' 2024-08-31T04:31:07.982 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15070 fp=#0x3000000159f' 2024-08-31T04:31:07.983 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15102 fp=#0x300000014da' 2024-08-31T04:31:07.983 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15134 fp=#0x300000033be' 2024-08-31T04:31:07.983 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15166 fp=#0x300000033f0' 2024-08-31T04:31:07.984 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15198 fp=#0x30000003401' 2024-08-31T04:31:07.984 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15230 fp=#0x30000002e7b' 2024-08-31T04:31:07.984 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15262 fp=#0x30000002e75' 2024-08-31T04:31:07.985 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15294 fp=#0x30000002e6a' 2024-08-31T04:31:07.985 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15326 fp=#0x30000002ec8' 2024-08-31T04:31:07.985 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15358 fp=#0x30000002f00' 2024-08-31T04:31:07.986 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15390 fp=#0x300000032cd' 2024-08-31T04:31:07.986 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15422 fp=#0x30000000ecd' 2024-08-31T04:31:07.986 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15454 fp=#0x30000000f24' 2024-08-31T04:31:07.986 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15486 fp=#0x30000000ebd' 2024-08-31T04:31:07.987 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15518 fp=#0x300000036b5' 2024-08-31T04:31:07.987 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15550 fp=#0x30000000ef4' 2024-08-31T04:31:07.987 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15582 fp=#0x30000001db5' 2024-08-31T04:31:07.988 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15614 fp=#0x300000005e6' 2024-08-31T04:31:07.988 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15646 fp=#0x300000005cf' 2024-08-31T04:31:07.989 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15742 fp=#0x300000005b3' 2024-08-31T04:31:07.990 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15837 fp=#0x300000014cd' 2024-08-31T04:31:07.990 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15869 fp=#0x300000012f8' 2024-08-31T04:31:07.990 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15901 fp=#0x30000001287' 2024-08-31T04:31:07.991 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15933 fp=#0x300000012e0' 2024-08-31T04:31:07.991 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15965 fp=#0x300000012c4' 2024-08-31T04:31:07.991 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15997 fp=#0x300000010ad' 2024-08-31T04:31:07.992 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16029 fp=#0x30000001098' 2024-08-31T04:31:07.992 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16061 fp=#0x30000001006' 2024-08-31T04:31:07.992 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16093 fp=#0x30000002df6' 2024-08-31T04:31:07.993 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16125 fp=#0x30000001828' 2024-08-31T04:31:07.993 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16157 fp=#0x3000000340f' 2024-08-31T04:31:07.993 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16189 fp=#0x300000034c3' 2024-08-31T04:31:07.994 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16253 fp=#0x300000005bb' 2024-08-31T04:31:07.994 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16285 fp=#0x30000000632' 2024-08-31T04:31:07.994 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16317 fp=#0x30000000636' 2024-08-31T04:31:07.995 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16346 fp=#0x10000002875' 2024-08-31T04:31:07.995 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16378 fp=#0x10000002837' 2024-08-31T04:31:07.996 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16410 fp=#0x10000002827' 2024-08-31T04:31:07.996 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16442 fp=#0x100000024bd' 2024-08-31T04:31:07.996 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16474 fp=#0x10000002523' 2024-08-31T04:31:07.997 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16506 fp=#0x30000001d3c' 2024-08-31T04:31:07.997 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16538 fp=#0x1000000253d' 2024-08-31T04:31:07.997 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16570 fp=#0x30000001d19' 2024-08-31T04:31:07.998 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16602 fp=#0x100000024a3' 2024-08-31T04:31:07.998 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16633 fp=#0x30000002139' 2024-08-31T04:31:07.998 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16665 fp=#0x30000002136' 2024-08-31T04:31:07.998 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16697 fp=#0x30000002338' 2024-08-31T04:31:07.999 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16729 fp=#0x300000022d2' 2024-08-31T04:31:07.999 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16761 fp=#0x30000002687' 2024-08-31T04:31:07.999 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16793 fp=#0x300000019b5' 2024-08-31T04:31:08.000 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16825 fp=#0x30000001a1e' 2024-08-31T04:31:08.000 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16889 fp=#0x30000001960' 2024-08-31T04:31:08.001 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16984 fp=#0x30000001a95' 2024-08-31T04:31:08.001 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17041 fp=#0x100000036dd' 2024-08-31T04:31:08.002 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17073 fp=#0x10000003642' 2024-08-31T04:31:08.002 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17105 fp=#0x100000036d7' 2024-08-31T04:31:08.002 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17137 fp=#0x30000001754' 2024-08-31T04:31:08.003 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17169 fp=#0x300000017fc' 2024-08-31T04:31:08.003 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17201 fp=#0x30000002cec' 2024-08-31T04:31:08.003 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17233 fp=#0x300000017ea' 2024-08-31T04:31:08.004 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17265 fp=#0x3000000174e' 2024-08-31T04:31:08.004 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17297 fp=#0x3000000171d' 2024-08-31T04:31:08.004 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17329 fp=#0x3000000332b' 2024-08-31T04:31:08.004 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17361 fp=#0x30000003311' 2024-08-31T04:31:08.006 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17553 fp=#0x30000003216' 2024-08-31T04:31:08.006 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17585 fp=#0x3000000320b' 2024-08-31T04:31:08.007 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17617 fp=#0x30000000dcd' 2024-08-31T04:31:08.007 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17649 fp=#0x30000000dd7' 2024-08-31T04:31:08.008 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17809 fp=#0x30000002051' 2024-08-31T04:31:08.008 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17841 fp=#0x30000001f58' 2024-08-31T04:31:08.009 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17873 fp=#0x30000001fb5' 2024-08-31T04:31:08.009 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17905 fp=#0x30000001fdd' 2024-08-31T04:31:08.009 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17937 fp=#0x300000030c9' 2024-08-31T04:31:08.010 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17969 fp=#0x30000003148' 2024-08-31T04:31:08.010 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18001 fp=#0x30000001c44' 2024-08-31T04:31:08.010 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18033 fp=#0x30000001be1' 2024-08-31T04:31:08.011 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18065 fp=#0x30000001bde' 2024-08-31T04:31:08.011 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18097 fp=#0x30000001c38' 2024-08-31T04:31:08.011 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18129 fp=#0x3000000254a' 2024-08-31T04:31:08.011 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18161 fp=#0x3000000258d' 2024-08-31T04:31:08.012 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18193 fp=#0x3000000252e' 2024-08-31T04:31:08.012 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18225 fp=#0x3000000258f' 2024-08-31T04:31:08.012 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18257 fp=#0x300000027d4' 2024-08-31T04:31:08.013 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18289 fp=#0x3000000288b' 2024-08-31T04:31:08.013 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18321 fp=#0x300000027c5' 2024-08-31T04:31:08.013 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18353 fp=#0x300000027f2' 2024-08-31T04:31:08.014 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18385 fp=#0x30000003033' 2024-08-31T04:31:08.014 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18417 fp=#0x30000002feb' 2024-08-31T04:31:08.014 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18449 fp=#0x30000002f18' 2024-08-31T04:31:08.014 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18481 fp=#0x3000000301c' 2024-08-31T04:31:08.015 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18513 fp=#0x30000003019' 2024-08-31T04:31:08.015 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18545 fp=#0x3000000302c' 2024-08-31T04:31:08.015 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18577 fp=#0x10000001d7b' 2024-08-31T04:31:08.016 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18609 fp=#0x30000003217' 2024-08-31T04:31:08.016 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18673 fp=#0x10000001d51' 2024-08-31T04:31:08.017 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18705 fp=#0x300000013b0' 2024-08-31T04:31:08.017 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18737 fp=#0x300000014db' 2024-08-31T04:31:08.017 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18769 fp=#0x30000001381' 2024-08-31T04:31:08.018 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18801 fp=#0x300000013b6' 2024-08-31T04:31:08.018 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18833 fp=#0x300000013d2' 2024-08-31T04:31:08.018 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18865 fp=#0x300000013b3' 2024-08-31T04:31:08.018 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18897 fp=#0x3000000110d' 2024-08-31T04:31:08.019 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18929 fp=#0x30000001d57' 2024-08-31T04:31:08.019 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18961 fp=#0x300000010be' 2024-08-31T04:31:08.019 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18993 fp=#0x300000010bc' 2024-08-31T04:31:08.020 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19025 fp=#0x300000023e0' 2024-08-31T04:31:08.020 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19057 fp=#0x300000011f3' 2024-08-31T04:31:08.020 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19089 fp=#0x300000011fb' 2024-08-31T04:31:08.021 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19121 fp=#0x3000000119b' 2024-08-31T04:31:08.021 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19153 fp=#0x3000000168a' 2024-08-31T04:31:08.021 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19185 fp=#0x300000015a6' 2024-08-31T04:31:08.022 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19249 fp=#0x30000001c4a' 2024-08-31T04:31:08.022 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19281 fp=#0x100000008bc' 2024-08-31T04:31:08.022 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19313 fp=#0x100000008d0' 2024-08-31T04:31:08.023 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19345 fp=#0x30000002bbb' 2024-08-31T04:31:08.023 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19377 fp=#0x300000014f4' 2024-08-31T04:31:08.023 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19409 fp=#0x100000008ab' 2024-08-31T04:31:08.024 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19440 fp=#0x30000000bee' 2024-08-31T04:31:08.024 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19472 fp=#0x30000000b55' 2024-08-31T04:31:08.024 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19504 fp=#0x30000000ba9' 2024-08-31T04:31:08.024 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19536 fp=#0x30000000b5d' 2024-08-31T04:31:08.025 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19568 fp=#0x30000000b31' 2024-08-31T04:31:08.025 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19600 fp=#0x30000000ae8' 2024-08-31T04:31:08.026 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19632 fp=#0x30000000b0d' 2024-08-31T04:31:08.026 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19664 fp=#0x30000002d3f' 2024-08-31T04:31:08.026 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19696 fp=#0x30000002d0c' 2024-08-31T04:31:08.027 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19728 fp=#0x30000002d53' 2024-08-31T04:31:08.027 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19760 fp=#0x30000002cd2' 2024-08-31T04:31:08.027 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19792 fp=#0x30000002c8f' 2024-08-31T04:31:08.028 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19824 fp=#0x300000011f4' 2024-08-31T04:31:08.028 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19856 fp=#0x30000001134' 2024-08-31T04:31:08.028 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19888 fp=#0x30000001461' 2024-08-31T04:31:08.028 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19920 fp=#0x30000002a1d' 2024-08-31T04:31:08.029 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19952 fp=#0x3000000140c' 2024-08-31T04:31:08.029 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19984 fp=#0x30000001406' 2024-08-31T04:31:08.029 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20016 fp=#0x3000000251e' 2024-08-31T04:31:08.030 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20048 fp=#0x30000000ff0' 2024-08-31T04:31:08.030 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20080 fp=#0x30000000fee' 2024-08-31T04:31:08.030 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20112 fp=#0x30000000fd5' 2024-08-31T04:31:08.031 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20144 fp=#0x300000016fa' 2024-08-31T04:31:08.031 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20176 fp=#0x300000016dc' 2024-08-31T04:31:08.031 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20208 fp=#0x300000016f5' 2024-08-31T04:31:08.031 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20240 fp=#0x300000030b2' 2024-08-31T04:31:08.032 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20272 fp=#0x30000003058' 2024-08-31T04:31:08.032 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20304 fp=#0x3000000327e' 2024-08-31T04:31:08.032 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20336 fp=#0x30000003197' 2024-08-31T04:31:08.033 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20368 fp=#0x300000031df' 2024-08-31T04:31:08.033 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20400 fp=#0x30000001c7b' 2024-08-31T04:31:08.033 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20432 fp=#0x30000001ce9' 2024-08-31T04:31:08.034 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20464 fp=#0x30000001c6a' 2024-08-31T04:31:08.034 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20496 fp=#0x30000001cbb' 2024-08-31T04:31:08.034 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20528 fp=#0x30000001250' 2024-08-31T04:31:08.035 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20560 fp=#0x30000001247' 2024-08-31T04:31:08.035 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20592 fp=#0x30000001251' 2024-08-31T04:31:08.036 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20752 fp=#0x1000000384e' 2024-08-31T04:31:08.036 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20784 fp=#0x30000003049' 2024-08-31T04:31:08.037 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20816 fp=#0x30000003698' 2024-08-31T04:31:08.037 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20848 fp=#0x300000030c1' 2024-08-31T04:31:08.037 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20880 fp=#0x300000030df' 2024-08-31T04:31:08.038 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20944 fp=#0x300000030f5' 2024-08-31T04:31:08.038 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20976 fp=#0x300000020b8' 2024-08-31T04:31:08.038 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21008 fp=#0x300000020b6' 2024-08-31T04:31:08.039 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21039 fp=#0x30000001563' 2024-08-31T04:31:08.039 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21071 fp=#0x3000000161a' 2024-08-31T04:31:08.040 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21103 fp=#0x300000015e9' 2024-08-31T04:31:08.041 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21263 fp=#0x30000002bc8' 2024-08-31T04:31:08.041 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21327 fp=#0x10000003361' 2024-08-31T04:31:08.042 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21359 fp=#0x10000003278' 2024-08-31T04:31:08.042 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21391 fp=#0x10000003316' 2024-08-31T04:31:08.042 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21423 fp=#0x10000003299' 2024-08-31T04:31:08.043 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21455 fp=#0x30000002741' 2024-08-31T04:31:08.043 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21487 fp=#0x30000002704' 2024-08-31T04:31:08.043 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21519 fp=#0x30000002742' 2024-08-31T04:31:08.044 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21551 fp=#0x30000002652' 2024-08-31T04:31:08.044 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21583 fp=#0x30000002631' 2024-08-31T04:31:08.044 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21615 fp=#0x30000003683' 2024-08-31T04:31:08.045 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21647 fp=#0x30000000cac' 2024-08-31T04:31:08.045 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21679 fp=#0x30000000ce7' 2024-08-31T04:31:08.045 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21711 fp=#0x30000000d46' 2024-08-31T04:31:08.046 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21743 fp=#0x30000000cae' 2024-08-31T04:31:08.046 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21775 fp=#0x30000000a9b' 2024-08-31T04:31:08.046 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21807 fp=#0x30000000af3' 2024-08-31T04:31:08.047 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21839 fp=#0x30000000aaf' 2024-08-31T04:31:08.047 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21871 fp=#0x30000000b18' 2024-08-31T04:31:08.047 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21903 fp=#0x30000000537' 2024-08-31T04:31:08.048 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21967 fp=#0x3000000055a' 2024-08-31T04:31:08.048 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21999 fp=#0x30000000557' 2024-08-31T04:31:08.049 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22030 fp=#0x30000001940' 2024-08-31T04:31:08.049 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22062 fp=#0x30000002f78' 2024-08-31T04:31:08.049 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22094 fp=#0x300000018fe' 2024-08-31T04:31:08.050 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22126 fp=#0x300000028cb' 2024-08-31T04:31:08.050 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22158 fp=#0x3000000298c' 2024-08-31T04:31:08.050 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22190 fp=#0x300000028fa' 2024-08-31T04:31:08.050 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22222 fp=#0x30000002946' 2024-08-31T04:31:08.051 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22254 fp=#0x3000000295c' 2024-08-31T04:31:08.051 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22286 fp=#0x30000002031' 2024-08-31T04:31:08.051 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22318 fp=#0x30000002033' 2024-08-31T04:31:08.052 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22350 fp=#0x30000002070' 2024-08-31T04:31:08.052 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22382 fp=#0x300000004b3' 2024-08-31T04:31:08.052 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22414 fp=#0x30000000434' 2024-08-31T04:31:08.053 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22478 fp=#0x3000000049f' 2024-08-31T04:31:08.053 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22510 fp=#0x3000000049a' 2024-08-31T04:31:08.054 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22535 fp=#0x30000002c19' 2024-08-31T04:31:08.054 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22567 fp=#0x30000002c25' 2024-08-31T04:31:08.055 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22630 fp=#0x3000000149c' 2024-08-31T04:31:08.055 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:9760 fp=#0x10000000208' 2024-08-31T04:31:08.056 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:9792 fp=#0x100000041c7' 2024-08-31T04:31:08.056 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:9824 fp=#0x30000002e59' 2024-08-31T04:31:08.057 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:9920 fp=#0x10000000898' 2024-08-31T04:31:08.057 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:9952 fp=#0x300000004f8' 2024-08-31T04:31:08.070 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:11776 fp=#0x30000000c43' 2024-08-31T04:31:08.071 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:11808 fp=#0x30000000bc8' 2024-08-31T04:31:08.071 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:11840 fp=#0x30000001c50' 2024-08-31T04:31:08.071 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:11872 fp=#0x300000023b2' 2024-08-31T04:31:08.072 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:11904 fp=#0x30000000bc0' 2024-08-31T04:31:08.072 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:11968 fp=#0x3000000111e' 2024-08-31T04:31:08.073 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12000 fp=#0x300000010e7' 2024-08-31T04:31:08.073 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12032 fp=#0x300000010fa' 2024-08-31T04:31:08.073 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12064 fp=#0x30000001118' 2024-08-31T04:31:08.074 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12096 fp=#0x30000003214' 2024-08-31T04:31:08.074 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12128 fp=#0x30000001032' 2024-08-31T04:31:08.075 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12256 fp=#0x30000000969' 2024-08-31T04:31:08.075 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12320 fp=#0x300000009e0' 2024-08-31T04:31:08.076 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12384 fp=#0x3000000090a' 2024-08-31T04:31:08.076 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12416 fp=#0x30000002e53' 2024-08-31T04:31:08.077 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12512 fp=#0x30000000f8e' 2024-08-31T04:31:08.077 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12544 fp=#0x30000000f87' 2024-08-31T04:31:08.078 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12576 fp=#0x30000000e17' 2024-08-31T04:31:08.078 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12608 fp=#0x30000000fff' 2024-08-31T04:31:08.078 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12640 fp=#0x30000000e6b' 2024-08-31T04:31:08.079 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12672 fp=#0x300000033d4' 2024-08-31T04:31:08.079 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12704 fp=#0x30000000ffb' 2024-08-31T04:31:08.079 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12736 fp=#0x30000000e86' 2024-08-31T04:31:08.080 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12768 fp=#0x30000000e50' 2024-08-31T04:31:08.080 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12800 fp=#0x30000000e4e' 2024-08-31T04:31:08.080 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12832 fp=#0x100000043fb' 2024-08-31T04:31:08.081 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12864 fp=#0x1000000440d' 2024-08-31T04:31:08.081 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12896 fp=#0x10000004206' 2024-08-31T04:31:08.081 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12928 fp=#0x3000000286c' 2024-08-31T04:31:08.082 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12960 fp=#0x30000002892' 2024-08-31T04:31:08.082 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:12992 fp=#0x100000043b4' 2024-08-31T04:31:08.082 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13024 fp=#0x10000004333' 2024-08-31T04:31:08.083 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13056 fp=#0x100000041e3' 2024-08-31T04:31:08.083 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13088 fp=#0x3000000319e' 2024-08-31T04:31:08.083 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13120 fp=#0x30000003165' 2024-08-31T04:31:08.084 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13152 fp=#0x30000003134' 2024-08-31T04:31:08.085 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13312 fp=#0x300000008c2' 2024-08-31T04:31:08.085 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13344 fp=#0x300000009b7' 2024-08-31T04:31:08.085 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13376 fp=#0x3000000222e' 2024-08-31T04:31:08.086 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13408 fp=#0x300000008ac' 2024-08-31T04:31:08.086 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13440 fp=#0x300000009a5' 2024-08-31T04:31:08.087 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13472 fp=#0x30000000a4f' 2024-08-31T04:31:08.087 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13504 fp=#0x300000009b0' 2024-08-31T04:31:08.087 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13536 fp=#0x3000000089f' 2024-08-31T04:31:08.087 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13568 fp=#0x300000032b5' 2024-08-31T04:31:08.088 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13600 fp=#0x300000032b1' 2024-08-31T04:31:08.088 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13632 fp=#0x300000032f7' 2024-08-31T04:31:08.088 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13664 fp=#0x30000002a29' 2024-08-31T04:31:08.089 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13696 fp=#0x3000000298d' 2024-08-31T04:31:08.089 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13728 fp=#0x30000002a31' 2024-08-31T04:31:08.089 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13760 fp=#0x3000000290a' 2024-08-31T04:31:08.090 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13792 fp=#0x300000029b2' 2024-08-31T04:31:08.090 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13824 fp=#0x30000002a08' 2024-08-31T04:31:08.090 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13856 fp=#0x3000000294f' 2024-08-31T04:31:08.091 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13888 fp=#0x10000003e07' 2024-08-31T04:31:08.091 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:13920 fp=#0x10000003be9' 2024-08-31T04:31:08.092 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14016 fp=#0x10000003ea9' 2024-08-31T04:31:08.092 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14048 fp=#0x10000003d37' 2024-08-31T04:31:08.092 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14080 fp=#0x30000000c82' 2024-08-31T04:31:08.093 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14112 fp=#0x30000000c65' 2024-08-31T04:31:08.093 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14144 fp=#0x30000002445' 2024-08-31T04:31:08.093 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14176 fp=#0x30000002453' 2024-08-31T04:31:08.094 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14208 fp=#0x300000017b8' 2024-08-31T04:31:08.094 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14240 fp=#0x30000001795' 2024-08-31T04:31:08.095 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14400 fp=#0x30000000d94' 2024-08-31T04:31:08.096 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14432 fp=#0x30000000d91' 2024-08-31T04:31:08.096 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14464 fp=#0x30000000d66' 2024-08-31T04:31:08.096 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14496 fp=#0x300000023a3' 2024-08-31T04:31:08.097 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14528 fp=#0x30000000d2c' 2024-08-31T04:31:08.097 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14560 fp=#0x30000000d75' 2024-08-31T04:31:08.097 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14592 fp=#0x30000000d06' 2024-08-31T04:31:08.098 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14624 fp=#0x1000000247f' 2024-08-31T04:31:08.098 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14656 fp=#0x10000002455' 2024-08-31T04:31:08.098 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14688 fp=#0x30000002fae' 2024-08-31T04:31:08.098 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14720 fp=#0x10000002433' 2024-08-31T04:31:08.099 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14752 fp=#0x1000000246b' 2024-08-31T04:31:08.099 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14784 fp=#0x30000002fa6' 2024-08-31T04:31:08.099 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14815 fp=#0x10000003bc4' 2024-08-31T04:31:08.100 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14847 fp=#0x30000000a3b' 2024-08-31T04:31:08.100 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14879 fp=#0x3000000099d' 2024-08-31T04:31:08.100 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14911 fp=#0x30000000a06' 2024-08-31T04:31:08.101 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14943 fp=#0x30000000952' 2024-08-31T04:31:08.101 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:14975 fp=#0x3000000157e' 2024-08-31T04:31:08.102 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15007 fp=#0x30000001677' 2024-08-31T04:31:08.102 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15039 fp=#0x30000001509' 2024-08-31T04:31:08.102 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15071 fp=#0x300000016a0' 2024-08-31T04:31:08.102 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15103 fp=#0x3000000169b' 2024-08-31T04:31:08.103 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15135 fp=#0x300000033f4' 2024-08-31T04:31:08.103 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15167 fp=#0x300000033da' 2024-08-31T04:31:08.103 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15199 fp=#0x300000033e7' 2024-08-31T04:31:08.104 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15231 fp=#0x30000002f0a' 2024-08-31T04:31:08.104 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15263 fp=#0x30000002eac' 2024-08-31T04:31:08.104 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15295 fp=#0x30000002ed1' 2024-08-31T04:31:08.105 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15327 fp=#0x30000002ed5' 2024-08-31T04:31:08.105 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15359 fp=#0x30000002ec6' 2024-08-31T04:31:08.105 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15391 fp=#0x300000032cf' 2024-08-31T04:31:08.106 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15423 fp=#0x30000000f39' 2024-08-31T04:31:08.106 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15455 fp=#0x30000000f1b' 2024-08-31T04:31:08.106 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15487 fp=#0x30000000ec7' 2024-08-31T04:31:08.107 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15519 fp=#0x30000000ef5' 2024-08-31T04:31:08.107 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15551 fp=#0x30000000f01' 2024-08-31T04:31:08.107 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15583 fp=#0x30000000f1a' 2024-08-31T04:31:08.108 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15647 fp=#0x300000005be' 2024-08-31T04:31:08.110 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15870 fp=#0x300000012de' 2024-08-31T04:31:08.110 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15902 fp=#0x3000000129c' 2024-08-31T04:31:08.111 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15934 fp=#0x300000012a8' 2024-08-31T04:31:08.111 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15966 fp=#0x3000000130e' 2024-08-31T04:31:08.111 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:15998 fp=#0x30000001041' 2024-08-31T04:31:08.111 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16030 fp=#0x3000000101f' 2024-08-31T04:31:08.112 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16062 fp=#0x30000002462' 2024-08-31T04:31:08.112 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16094 fp=#0x30000002df4' 2024-08-31T04:31:08.113 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16158 fp=#0x300000005e9' 2024-08-31T04:31:08.113 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16222 fp=#0x30000000628' 2024-08-31T04:31:08.114 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16286 fp=#0x3000000062b' 2024-08-31T04:31:08.114 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16318 fp=#0x30000000626' 2024-08-31T04:31:08.114 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16347 fp=#0x1000000286b' 2024-08-31T04:31:08.115 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16379 fp=#0x30000002078' 2024-08-31T04:31:08.115 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16411 fp=#0x300000020ac' 2024-08-31T04:31:08.115 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16443 fp=#0x100000024df' 2024-08-31T04:31:08.116 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16475 fp=#0x30000000205' 2024-08-31T04:31:08.116 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16507 fp=#0x100000024c4' 2024-08-31T04:31:08.117 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16539 fp=#0x10000002527' 2024-08-31T04:31:08.117 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16571 fp=#0x10000002529' 2024-08-31T04:31:08.117 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16603 fp=#0x100000024e7' 2024-08-31T04:31:08.118 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16634 fp=#0x30000002351' 2024-08-31T04:31:08.118 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16666 fp=#0x300000020f6' 2024-08-31T04:31:08.118 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16698 fp=#0x3000000220e' 2024-08-31T04:31:08.119 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16730 fp=#0x300000003e4' 2024-08-31T04:31:08.119 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16794 fp=#0x30000001a31' 2024-08-31T04:31:08.119 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16826 fp=#0x30000001963' 2024-08-31T04:31:08.120 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16858 fp=#0x30000001a21' 2024-08-31T04:31:08.120 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16921 fp=#0x30000001a68' 2024-08-31T04:31:08.121 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:16985 fp=#0x30000002b57' 2024-08-31T04:31:08.121 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17042 fp=#0x10000003615' 2024-08-31T04:31:08.121 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17074 fp=#0x10000003715' 2024-08-31T04:31:08.122 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17106 fp=#0x100000036ab' 2024-08-31T04:31:08.122 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17138 fp=#0x3000000177e' 2024-08-31T04:31:08.122 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17170 fp=#0x30000001721' 2024-08-31T04:31:08.123 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17202 fp=#0x30000001756' 2024-08-31T04:31:08.123 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17234 fp=#0x30000002cd0' 2024-08-31T04:31:08.123 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17266 fp=#0x3000000177f' 2024-08-31T04:31:08.124 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17298 fp=#0x30000002cc7' 2024-08-31T04:31:08.124 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17330 fp=#0x30000003366' 2024-08-31T04:31:08.124 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17362 fp=#0x30000003319' 2024-08-31T04:31:08.126 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17554 fp=#0x300000031d4' 2024-08-31T04:31:08.126 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17586 fp=#0x30000003203' 2024-08-31T04:31:08.126 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17618 fp=#0x300000031b3' 2024-08-31T04:31:08.127 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17650 fp=#0x30000000dc7' 2024-08-31T04:31:08.128 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17810 fp=#0x30000001f47' 2024-08-31T04:31:08.128 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17842 fp=#0x30000001f71' 2024-08-31T04:31:08.129 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17874 fp=#0x30000001fac' 2024-08-31T04:31:08.129 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17906 fp=#0x30000001fc9' 2024-08-31T04:31:08.129 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17938 fp=#0x300000030b1' 2024-08-31T04:31:08.130 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:17970 fp=#0x300000030cb' 2024-08-31T04:31:08.130 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18002 fp=#0x30000001c46' 2024-08-31T04:31:08.130 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18034 fp=#0x30000001c40' 2024-08-31T04:31:08.131 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18066 fp=#0x30000001c32' 2024-08-31T04:31:08.131 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18098 fp=#0x30000001c0e' 2024-08-31T04:31:08.131 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18130 fp=#0x300000025a4' 2024-08-31T04:31:08.132 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18162 fp=#0x3000000253e' 2024-08-31T04:31:08.132 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18194 fp=#0x30000002594' 2024-08-31T04:31:08.132 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18226 fp=#0x3000000252a' 2024-08-31T04:31:08.133 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18258 fp=#0x300000027bc' 2024-08-31T04:31:08.133 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18290 fp=#0x3000000285a' 2024-08-31T04:31:08.133 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18322 fp=#0x3000000283e' 2024-08-31T04:31:08.133 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18354 fp=#0x30000002843' 2024-08-31T04:31:08.134 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18386 fp=#0x30000002f57' 2024-08-31T04:31:08.134 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18418 fp=#0x30000002f59' 2024-08-31T04:31:08.134 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18450 fp=#0x30000003022' 2024-08-31T04:31:08.135 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18482 fp=#0x30000002ffd' 2024-08-31T04:31:08.135 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18514 fp=#0x30000002f55' 2024-08-31T04:31:08.135 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18546 fp=#0x30000003005' 2024-08-31T04:31:08.136 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18578 fp=#0x3000000321c' 2024-08-31T04:31:08.136 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18610 fp=#0x30000001ddd' 2024-08-31T04:31:08.136 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18642 fp=#0x10000001cf1' 2024-08-31T04:31:08.137 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18674 fp=#0x10000001cfa' 2024-08-31T04:31:08.139 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18706 fp=#0x30000001398' 2024-08-31T04:31:08.140 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18738 fp=#0x300000014b9' 2024-08-31T04:31:08.140 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18770 fp=#0x3000000138b' 2024-08-31T04:31:08.140 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18802 fp=#0x300000013b9' 2024-08-31T04:31:08.141 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18834 fp=#0x30000001386' 2024-08-31T04:31:08.141 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18866 fp=#0x30000001359' 2024-08-31T04:31:08.142 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18898 fp=#0x30000001d8d' 2024-08-31T04:31:08.142 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18930 fp=#0x30000001058' 2024-08-31T04:31:08.142 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18962 fp=#0x300000021f0' 2024-08-31T04:31:08.142 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:18994 fp=#0x30000001075' 2024-08-31T04:31:08.143 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19026 fp=#0x30000001070' 2024-08-31T04:31:08.143 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19058 fp=#0x30000001160' 2024-08-31T04:31:08.143 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19090 fp=#0x30000001187' 2024-08-31T04:31:08.144 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19122 fp=#0x30000001113' 2024-08-31T04:31:08.144 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19154 fp=#0x30000001690' 2024-08-31T04:31:08.144 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19186 fp=#0x30000001680' 2024-08-31T04:31:08.145 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19218 fp=#0x30000001675' 2024-08-31T04:31:08.145 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19250 fp=#0x300000015da' 2024-08-31T04:31:08.145 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19282 fp=#0x100000008e6' 2024-08-31T04:31:08.146 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19314 fp=#0x30000001526' 2024-08-31T04:31:08.146 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19346 fp=#0x1000000089b' 2024-08-31T04:31:08.146 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19378 fp=#0x30000002f69' 2024-08-31T04:31:08.146 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19410 fp=#0x100000008d9' 2024-08-31T04:31:08.147 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19441 fp=#0x30000000b68' 2024-08-31T04:31:08.147 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19473 fp=#0x30000000b81' 2024-08-31T04:31:08.148 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19505 fp=#0x30000000b96' 2024-08-31T04:31:08.148 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19537 fp=#0x30000000bac' 2024-08-31T04:31:08.148 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19569 fp=#0x30000000b43' 2024-08-31T04:31:08.149 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19601 fp=#0x30000000b3f' 2024-08-31T04:31:08.149 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19633 fp=#0x30000001ca2' 2024-08-31T04:31:08.149 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19665 fp=#0x30000002de3' 2024-08-31T04:31:08.150 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19697 fp=#0x30000002d7a' 2024-08-31T04:31:08.150 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19729 fp=#0x30000002d3e' 2024-08-31T04:31:08.150 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19761 fp=#0x30000002ddb' 2024-08-31T04:31:08.151 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19793 fp=#0x30000002d85' 2024-08-31T04:31:08.151 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19825 fp=#0x30000002f6d' 2024-08-31T04:31:08.151 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19857 fp=#0x30000001202' 2024-08-31T04:31:08.152 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19889 fp=#0x30000001209' 2024-08-31T04:31:08.152 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19921 fp=#0x300000011c9' 2024-08-31T04:31:08.152 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19953 fp=#0x3000000143a' 2024-08-31T04:31:08.153 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:19985 fp=#0x30000001439' 2024-08-31T04:31:08.153 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20017 fp=#0x30000002e74' 2024-08-31T04:31:08.153 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20049 fp=#0x30000001000' 2024-08-31T04:31:08.154 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20081 fp=#0x30000000fe0' 2024-08-31T04:31:08.154 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20113 fp=#0x30000000fe6' 2024-08-31T04:31:08.154 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20145 fp=#0x300000016e2' 2024-08-31T04:31:08.155 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20177 fp=#0x300000016f3' 2024-08-31T04:31:08.155 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20209 fp=#0x30000001700' 2024-08-31T04:31:08.155 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20241 fp=#0x30000003110' 2024-08-31T04:31:08.156 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20273 fp=#0x3000000317d' 2024-08-31T04:31:08.156 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20305 fp=#0x3000000318a' 2024-08-31T04:31:08.156 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20337 fp=#0x300000030ed' 2024-08-31T04:31:08.157 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20369 fp=#0x3000000318c' 2024-08-31T04:31:08.157 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20401 fp=#0x30000001ce8' 2024-08-31T04:31:08.157 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20433 fp=#0x30000001cab' 2024-08-31T04:31:08.158 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20465 fp=#0x30000001cd9' 2024-08-31T04:31:08.158 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20497 fp=#0x30000001ca8' 2024-08-31T04:31:08.158 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20529 fp=#0x30000001264' 2024-08-31T04:31:08.158 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20561 fp=#0x30000001272' 2024-08-31T04:31:08.159 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20593 fp=#0x3000000124a' 2024-08-31T04:31:08.160 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20753 fp=#0x3000000304b' 2024-08-31T04:31:08.160 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20785 fp=#0x3000000304c' 2024-08-31T04:31:08.161 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20817 fp=#0x3000000303e' 2024-08-31T04:31:08.161 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20849 fp=#0x30000003062' 2024-08-31T04:31:08.161 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20881 fp=#0x1000000382c' 2024-08-31T04:31:08.162 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20913 fp=#0x10000003837' 2024-08-31T04:31:08.162 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20945 fp=#0x300000030ac' 2024-08-31T04:31:08.162 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:20977 fp=#0x300000020de' 2024-08-31T04:31:08.163 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21009 fp=#0x300000020da' 2024-08-31T04:31:08.163 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21040 fp=#0x30000001696' 2024-08-31T04:31:08.163 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21072 fp=#0x300000016a8' 2024-08-31T04:31:08.164 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21104 fp=#0x3000000165c' 2024-08-31T04:31:08.165 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21264 fp=#0x30000002be0' 2024-08-31T04:31:08.165 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21296 fp=#0x10000003233' 2024-08-31T04:31:08.166 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21328 fp=#0x10000003221' 2024-08-31T04:31:08.166 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21360 fp=#0x10000003392' 2024-08-31T04:31:08.166 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21392 fp=#0x10000003252' 2024-08-31T04:31:08.167 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21424 fp=#0x10000003371' 2024-08-31T04:31:08.167 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21456 fp=#0x30000002715' 2024-08-31T04:31:08.167 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21488 fp=#0x300000026be' 2024-08-31T04:31:08.168 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21520 fp=#0x300000026e7' 2024-08-31T04:31:08.168 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21552 fp=#0x3000000261c' 2024-08-31T04:31:08.168 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21584 fp=#0x30000002693' 2024-08-31T04:31:08.169 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21616 fp=#0x30000003689' 2024-08-31T04:31:08.169 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21648 fp=#0x300000036f5' 2024-08-31T04:31:08.169 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21680 fp=#0x30000000d48' 2024-08-31T04:31:08.170 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21712 fp=#0x30000000cfd' 2024-08-31T04:31:08.170 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21744 fp=#0x300000036ca' 2024-08-31T04:31:08.170 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21776 fp=#0x30000000abb' 2024-08-31T04:31:08.170 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21808 fp=#0x30000000b16' 2024-08-31T04:31:08.171 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21840 fp=#0x30000000b36' 2024-08-31T04:31:08.171 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21872 fp=#0x30000000b2e' 2024-08-31T04:31:08.172 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21936 fp=#0x300000008ff' 2024-08-31T04:31:08.172 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:21968 fp=#0x300000008ec' 2024-08-31T04:31:08.173 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22000 fp=#0x3000000057e' 2024-08-31T04:31:08.173 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22031 fp=#0x3000000192a' 2024-08-31T04:31:08.173 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22063 fp=#0x30000002f76' 2024-08-31T04:31:08.174 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22095 fp=#0x3000000190b' 2024-08-31T04:31:08.174 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22127 fp=#0x300000029b5' 2024-08-31T04:31:08.174 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22159 fp=#0x300000028f3' 2024-08-31T04:31:08.175 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22191 fp=#0x300000028be' 2024-08-31T04:31:08.175 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22223 fp=#0x300000028b5' 2024-08-31T04:31:08.175 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22255 fp=#0x30000002090' 2024-08-31T04:31:08.175 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22287 fp=#0x30000002063' 2024-08-31T04:31:08.176 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22319 fp=#0x30000001ffa' 2024-08-31T04:31:08.176 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22351 fp=#0x3000000201f' 2024-08-31T04:31:08.177 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22415 fp=#0x30000000483' 2024-08-31T04:31:08.177 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22447 fp=#0x300000004b1' 2024-08-31T04:31:08.177 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22479 fp=#0x30000000469' 2024-08-31T04:31:08.178 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22536 fp=#0x30000002c8d' 2024-08-31T04:31:08.178 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22568 fp=#0x30000002be9' 2024-08-31T04:31:08.179 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22599 fp=#0x1000000103d' 2024-08-31T04:31:08.179 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22631 fp=#0x3000000146b' 2024-08-31T04:31:08.179 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (i) for 9d491f02-1: 'internal op quiesce_inode:mds.2:22663 fp=#0x30000001485' 2024-08-31T04:31:08.181 INFO:tasks.quiescer.fs.[cephfs]:Pulled 12979 ops from rank 2 (i) into home/teuthworker/archive/mchangir-2024-08-30_08:30:37-fs-wip-mchangir-testing-20240828.085847-main-debug-distro-default-smithi/7881274/ops-9d491f02-1-mds.i.json 2024-08-31T04:31:08.181 DEBUG:teuthology.orchestra.run.smithi177:> sudo rm -- /var/run/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/ops-9d491f02-1-mds.i.json 2024-08-31T04:31:08.183 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:31:03 smithi133 ceph-mon[22177]: pgmap v613: 97 pgs: 97 active+clean; 1.5 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.5 MiB/s wr, 130 op/s 2024-08-31T04:31:08.183 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:31:05 smithi133 ceph-mon[22177]: pgmap v614: 97 pgs: 97 active+clean; 1.5 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 948 KiB/s rd, 1.1 MiB/s wr, 125 op/s 2024-08-31T04:31:08.183 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:31:07 smithi133 ceph-mon[22177]: pgmap v615: 97 pgs: 97 active+clean; 1.5 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 948 KiB/s rd, 1.1 MiB/s wr, 127 op/s 2024-08-31T04:31:08.183 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:31:03 smithi050 ceph-mon[17259]: pgmap v613: 97 pgs: 97 active+clean; 1.5 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.5 MiB/s wr, 130 op/s 2024-08-31T04:31:08.183 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:31:05 smithi050 ceph-mon[17259]: pgmap v614: 97 pgs: 97 active+clean; 1.5 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 948 KiB/s rd, 1.1 MiB/s wr, 125 op/s 2024-08-31T04:31:08.183 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:31:07 smithi050 ceph-mon[17259]: pgmap v615: 97 pgs: 97 active+clean; 1.5 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 948 KiB/s rd, 1.1 MiB/s wr, 127 op/s 2024-08-31T04:31:08.183 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:31:03 smithi177 ceph-mon[22025]: pgmap v613: 97 pgs: 97 active+clean; 1.5 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.5 MiB/s wr, 130 op/s 2024-08-31T04:31:08.183 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:31:05 smithi177 ceph-mon[22025]: pgmap v614: 97 pgs: 97 active+clean; 1.5 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 948 KiB/s rd, 1.1 MiB/s wr, 125 op/s 2024-08-31T04:31:08.183 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:31:07 smithi177 ceph-mon[22025]: pgmap v615: 97 pgs: 97 active+clean; 1.5 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 948 KiB/s rd, 1.1 MiB/s wr, 127 op/s 2024-08-31T04:31:08.220 DEBUG:teuthology.orchestra.run.smithi050:> mktemp 2024-08-31T04:31:08.255 INFO:teuthology.orchestra.run.smithi050.stdout:/tmp/tmp.OVyVAcNEZk 2024-08-31T04:31:08.256 DEBUG:teuthology.orchestra.run.smithi050:> sudo cp /var/run/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/ops-9d491f02-1-mds.a.json /tmp/tmp.OVyVAcNEZk 2024-08-31T04:31:08.424 DEBUG:teuthology.orchestra.run.smithi050:> sudo chmod 0666 /tmp/tmp.OVyVAcNEZk 2024-08-31T04:31:08.520 DEBUG:teuthology.orchestra.remote:smithi050:/tmp/tmp.OVyVAcNEZk is 30MB 2024-08-31T04:31:09.160 DEBUG:teuthology.orchestra.run.smithi050:> rm -fr /tmp/tmp.OVyVAcNEZk 2024-08-31T04:31:09.252 DEBUG:tasks.quiescer.fs.[cephfs]:read 31256984B of ops from '/var/run/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/ops-9d491f02-1-mds.a.json' on mds.1 (a) 2024-08-31T04:31:10.353 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:7199 fp=#0x10000004590' 2024-08-31T04:31:10.355 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:7391 fp=#0x20000001fac' 2024-08-31T04:31:10.356 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:7455 fp=#0x2000000201b' 2024-08-31T04:31:10.356 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:7487 fp=#0x20000001f7d' 2024-08-31T04:31:10.356 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:7519 fp=#0x20000001fa4' 2024-08-31T04:31:10.367 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:8918 fp=#0x2000000062b' 2024-08-31T04:31:10.368 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:8982 fp=#0x200000018d7' 2024-08-31T04:31:10.368 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9046 fp=#0x20000000fd7' 2024-08-31T04:31:10.369 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9078 fp=#0x20000000f65' 2024-08-31T04:31:10.370 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9174 fp=#0x20000001cab' 2024-08-31T04:31:10.370 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9206 fp=#0x20000001ce7' 2024-08-31T04:31:10.370 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9238 fp=#0x20000001d89' 2024-08-31T04:31:10.371 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9270 fp=#0x20000001ad8' 2024-08-31T04:31:10.372 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9398 fp=#0x20000001547' 2024-08-31T04:31:10.372 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9430 fp=#0x2000000155f' 2024-08-31T04:31:10.372 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9462 fp=#0x20000001573' 2024-08-31T04:31:10.373 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9494 fp=#0x20000001568' 2024-08-31T04:31:10.373 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9526 fp=#0x20000000980' 2024-08-31T04:31:10.373 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9558 fp=#0x200000009b3' 2024-08-31T04:31:10.374 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9590 fp=#0x200000014af' 2024-08-31T04:31:10.374 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9622 fp=#0x20000001833' 2024-08-31T04:31:10.375 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9686 fp=#0x20000000b53' 2024-08-31T04:31:10.375 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9718 fp=#0x20000000aff' 2024-08-31T04:31:10.375 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9750 fp=#0x20000000b1b' 2024-08-31T04:31:10.375 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9782 fp=#0x20000000b4c' 2024-08-31T04:31:10.376 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9814 fp=#0x20000000b41' 2024-08-31T04:31:10.376 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9846 fp=#0x20000001ef4' 2024-08-31T04:31:10.376 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9878 fp=#0x20000001ec7' 2024-08-31T04:31:10.377 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9910 fp=#0x20000001e3c' 2024-08-31T04:31:10.378 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10069 fp=#0x20000000d37' 2024-08-31T04:31:10.378 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10101 fp=#0x20000000dc7' 2024-08-31T04:31:10.379 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10133 fp=#0x20000000e07' 2024-08-31T04:31:10.379 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10165 fp=#0x20000000d95' 2024-08-31T04:31:10.379 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10197 fp=#0x200000006f8' 2024-08-31T04:31:10.380 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10229 fp=#0x20000000ffd' 2024-08-31T04:31:10.380 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10261 fp=#0x200000006f0' 2024-08-31T04:31:10.380 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10293 fp=#0x200000006e6' 2024-08-31T04:31:10.381 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10325 fp=#0x20000000941' 2024-08-31T04:31:10.381 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10357 fp=#0x200000014bc' 2024-08-31T04:31:10.381 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10389 fp=#0x200000014c6' 2024-08-31T04:31:10.382 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10421 fp=#0x200000014ba' 2024-08-31T04:31:10.382 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10453 fp=#0x20000001515' 2024-08-31T04:31:10.382 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10485 fp=#0x10000000cd7' 2024-08-31T04:31:10.383 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10517 fp=#0x10000000c52' 2024-08-31T04:31:10.383 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10549 fp=#0x20000000957' 2024-08-31T04:31:10.383 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10581 fp=#0x10000000c0e' 2024-08-31T04:31:10.384 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10613 fp=#0x2000000212d' 2024-08-31T04:31:10.384 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10645 fp=#0x200000020d2' 2024-08-31T04:31:10.384 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10677 fp=#0x20000002057' 2024-08-31T04:31:10.385 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10709 fp=#0x20000002049' 2024-08-31T04:31:10.386 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10837 fp=#0x10000003495' 2024-08-31T04:31:10.386 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10869 fp=#0x100000033fb' 2024-08-31T04:31:10.387 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10901 fp=#0x1000000343d' 2024-08-31T04:31:10.387 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10933 fp=#0x10000003483' 2024-08-31T04:31:10.387 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10965 fp=#0x20000000603' 2024-08-31T04:31:10.388 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10997 fp=#0x10000003d66' 2024-08-31T04:31:10.388 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11029 fp=#0x10000003b97' 2024-08-31T04:31:10.388 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11061 fp=#0x10000003be5' 2024-08-31T04:31:10.389 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11093 fp=#0x100000039b6' 2024-08-31T04:31:10.389 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11189 fp=#0x10000003d8c' 2024-08-31T04:31:10.390 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11217 fp=#0x20000000e47' 2024-08-31T04:31:10.390 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11249 fp=#0x20000000e86' 2024-08-31T04:31:10.390 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11281 fp=#0x20000000e87' 2024-08-31T04:31:10.391 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11313 fp=#0x20000000e6b' 2024-08-31T04:31:10.391 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11345 fp=#0x20000001ea1' 2024-08-31T04:31:10.391 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11377 fp=#0x200000018e6' 2024-08-31T04:31:10.392 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11409 fp=#0x200000019b6' 2024-08-31T04:31:10.392 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11441 fp=#0x20000001956' 2024-08-31T04:31:10.392 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11473 fp=#0x20000001eb1' 2024-08-31T04:31:10.393 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11505 fp=#0x200000018d5' 2024-08-31T04:31:10.393 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11537 fp=#0x100000045a8' 2024-08-31T04:31:10.393 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11569 fp=#0x100000045f6' 2024-08-31T04:31:10.394 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11601 fp=#0x10000004652' 2024-08-31T04:31:10.394 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11633 fp=#0x200000006c5' 2024-08-31T04:31:10.394 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11665 fp=#0x200000006b0' 2024-08-31T04:31:10.395 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11697 fp=#0x200000006cf' 2024-08-31T04:31:10.395 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11729 fp=#0x20000000671' 2024-08-31T04:31:10.396 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11793 fp=#0x200000006c2' 2024-08-31T04:31:10.396 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11825 fp=#0x20000000692' 2024-08-31T04:31:10.396 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11857 fp=#0x200000022cd' 2024-08-31T04:31:10.397 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11889 fp=#0x20000000aba' 2024-08-31T04:31:10.397 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11921 fp=#0x20000000aa6' 2024-08-31T04:31:10.397 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11953 fp=#0x20000000ab4' 2024-08-31T04:31:10.398 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11985 fp=#0x20000001a68' 2024-08-31T04:31:10.398 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12017 fp=#0x200000016e7' 2024-08-31T04:31:10.398 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12049 fp=#0x2000000175e' 2024-08-31T04:31:10.399 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12081 fp=#0x200000016d8' 2024-08-31T04:31:10.399 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12145 fp=#0x20000001f87' 2024-08-31T04:31:10.401 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12337 fp=#0x20000001517' 2024-08-31T04:31:10.401 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12369 fp=#0x200000010c1' 2024-08-31T04:31:10.401 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12401 fp=#0x20000001071' 2024-08-31T04:31:10.402 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12433 fp=#0x200000010aa' 2024-08-31T04:31:10.402 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12465 fp=#0x20000001ef5' 2024-08-31T04:31:10.403 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12497 fp=#0x20000001ed2' 2024-08-31T04:31:10.403 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12529 fp=#0x20000000a1d' 2024-08-31T04:31:10.403 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12561 fp=#0x200000009d8' 2024-08-31T04:31:10.404 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12593 fp=#0x20000000ac9' 2024-08-31T04:31:10.404 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12625 fp=#0x200000009dd' 2024-08-31T04:31:10.404 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12657 fp=#0x20000000a64' 2024-08-31T04:31:10.405 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12689 fp=#0x200000003c7' 2024-08-31T04:31:10.405 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12721 fp=#0x200000001f6' 2024-08-31T04:31:10.405 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12753 fp=#0x10000000e3a' 2024-08-31T04:31:10.406 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12785 fp=#0x2000000020f' 2024-08-31T04:31:10.406 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12817 fp=#0x10000000cf7' 2024-08-31T04:31:10.406 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12849 fp=#0x10000000d82' 2024-08-31T04:31:10.407 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12881 fp=#0x20000002141' 2024-08-31T04:31:10.407 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12913 fp=#0x200000020e5' 2024-08-31T04:31:10.407 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12945 fp=#0x2000000215f' 2024-08-31T04:31:10.408 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12977 fp=#0x10000002ece' 2024-08-31T04:31:10.408 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13009 fp=#0x10000002e7a' 2024-08-31T04:31:10.408 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13040 fp=#0x200000007b2' 2024-08-31T04:31:10.409 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13072 fp=#0x2000000079b' 2024-08-31T04:31:10.409 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13104 fp=#0x20000000776' 2024-08-31T04:31:10.409 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13136 fp=#0x2000000074a' 2024-08-31T04:31:10.410 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13168 fp=#0x200000014ff' 2024-08-31T04:31:10.411 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13200 fp=#0x20000000718' 2024-08-31T04:31:10.411 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13232 fp=#0x20000001fd8' 2024-08-31T04:31:10.411 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13264 fp=#0x2000000204c' 2024-08-31T04:31:10.412 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13296 fp=#0x20000000b89' 2024-08-31T04:31:10.412 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13328 fp=#0x20000000bdd' 2024-08-31T04:31:10.412 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13360 fp=#0x20000001d02' 2024-08-31T04:31:10.413 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13392 fp=#0x20000001c85' 2024-08-31T04:31:10.413 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13424 fp=#0x20000001c97' 2024-08-31T04:31:10.414 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13456 fp=#0x20000001c6f' 2024-08-31T04:31:10.414 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13488 fp=#0x10000003b2d' 2024-08-31T04:31:10.414 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13515 fp=#0x20000002139' 2024-08-31T04:31:10.415 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13643 fp=#0x2000000210f' 2024-08-31T04:31:10.416 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13675 fp=#0x10000002f4c' 2024-08-31T04:31:10.416 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13707 fp=#0x10000002f58' 2024-08-31T04:31:10.416 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13739 fp=#0x10000002e1a' 2024-08-31T04:31:10.417 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13771 fp=#0x10000002e4b' 2024-08-31T04:31:10.417 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13803 fp=#0x200000015c2' 2024-08-31T04:31:10.417 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13835 fp=#0x20000000815' 2024-08-31T04:31:10.418 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13867 fp=#0x20000000ce1' 2024-08-31T04:31:10.418 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13899 fp=#0x20000000d88' 2024-08-31T04:31:10.418 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13931 fp=#0x20000000dc8' 2024-08-31T04:31:10.419 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13963 fp=#0x20000002211' 2024-08-31T04:31:10.419 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13995 fp=#0x200000021f2' 2024-08-31T04:31:10.419 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14027 fp=#0x200000019be' 2024-08-31T04:31:10.420 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14059 fp=#0x200000019cc' 2024-08-31T04:31:10.420 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14091 fp=#0x200000019eb' 2024-08-31T04:31:10.420 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14123 fp=#0x200000008a9' 2024-08-31T04:31:10.421 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14155 fp=#0x20000000942' 2024-08-31T04:31:10.421 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14187 fp=#0x200000008bf' 2024-08-31T04:31:10.421 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14219 fp=#0x200000008ef' 2024-08-31T04:31:10.422 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14251 fp=#0x20000000916' 2024-08-31T04:31:10.422 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14283 fp=#0x20000001dcb' 2024-08-31T04:31:10.422 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14315 fp=#0x20000001da5' 2024-08-31T04:31:10.423 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14347 fp=#0x20000001e35' 2024-08-31T04:31:10.423 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14411 fp=#0x20000001e00' 2024-08-31T04:31:10.423 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14443 fp=#0x2000000186c' 2024-08-31T04:31:10.424 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14475 fp=#0x20000001882' 2024-08-31T04:31:10.424 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14507 fp=#0x20000001885' 2024-08-31T04:31:10.424 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14539 fp=#0x2000000191c' 2024-08-31T04:31:10.425 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14571 fp=#0x2000000104b' 2024-08-31T04:31:10.425 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14603 fp=#0x20000000f48' 2024-08-31T04:31:10.425 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14635 fp=#0x20000000f3b' 2024-08-31T04:31:10.426 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14667 fp=#0x20000000fcd' 2024-08-31T04:31:10.426 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14699 fp=#0x20000000fb7' 2024-08-31T04:31:10.426 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14731 fp=#0x100000046e6' 2024-08-31T04:31:10.427 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14763 fp=#0x20000000bff' 2024-08-31T04:31:10.427 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14827 fp=#0x200000010ac' 2024-08-31T04:31:10.428 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14873 fp=#0x100000030f8' 2024-08-31T04:31:10.428 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14905 fp=#0x10000003161' 2024-08-31T04:31:10.429 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14937 fp=#0x10000003124' 2024-08-31T04:31:10.429 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14969 fp=#0x100000058b4' 2024-08-31T04:31:10.429 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15001 fp=#0x20000001701' 2024-08-31T04:31:10.430 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15033 fp=#0x20000001723' 2024-08-31T04:31:10.430 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15065 fp=#0x200000017b9' 2024-08-31T04:31:10.430 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15097 fp=#0x200000017bb' 2024-08-31T04:31:10.431 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15129 fp=#0x200000017ed' 2024-08-31T04:31:10.431 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15160 fp=#0x100000057ad' 2024-08-31T04:31:10.431 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15224 fp=#0x10000001730' 2024-08-31T04:31:10.432 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15256 fp=#0x2000000227b' 2024-08-31T04:31:10.432 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15288 fp=#0x2000000225e' 2024-08-31T04:31:10.432 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15320 fp=#0x20000002270' 2024-08-31T04:31:10.433 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15352 fp=#0x20000002053' 2024-08-31T04:31:10.433 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15384 fp=#0x20000002060' 2024-08-31T04:31:10.433 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15416 fp=#0x20000002071' 2024-08-31T04:31:10.434 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15448 fp=#0x2000000204e' 2024-08-31T04:31:10.434 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15480 fp=#0x1000000532a' 2024-08-31T04:31:10.434 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15512 fp=#0x20000001656' 2024-08-31T04:31:10.435 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15544 fp=#0x20000001a35' 2024-08-31T04:31:10.435 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15576 fp=#0x1000000531f' 2024-08-31T04:31:10.435 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15608 fp=#0x10000005336' 2024-08-31T04:31:10.436 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15640 fp=#0x10000004eb2' 2024-08-31T04:31:10.436 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15672 fp=#0x10000004df5' 2024-08-31T04:31:10.436 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15704 fp=#0x10000004e5d' 2024-08-31T04:31:10.437 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15736 fp=#0x10000004e2f' 2024-08-31T04:31:10.437 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15800 fp=#0x20000001ff2' 2024-08-31T04:31:10.437 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15832 fp=#0x20000001ffc' 2024-08-31T04:31:10.438 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15864 fp=#0x20000002026' 2024-08-31T04:31:10.438 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15928 fp=#0x20000001fe2' 2024-08-31T04:31:10.439 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15960 fp=#0x2000000202a' 2024-08-31T04:31:10.439 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15992 fp=#0x20000000eb5' 2024-08-31T04:31:10.439 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16024 fp=#0x20000000ea2' 2024-08-31T04:31:10.440 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16056 fp=#0x20000000eb3' 2024-08-31T04:31:10.440 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16088 fp=#0x2000000118d' 2024-08-31T04:31:10.440 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16120 fp=#0x2000000111d' 2024-08-31T04:31:10.441 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16152 fp=#0x20000001185' 2024-08-31T04:31:10.441 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16184 fp=#0x200000015a5' 2024-08-31T04:31:10.441 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16216 fp=#0x200000015dc' 2024-08-31T04:31:10.442 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16248 fp=#0x200000015d4' 2024-08-31T04:31:10.442 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16279 fp=#0x10000004521' 2024-08-31T04:31:10.442 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16311 fp=#0x1000000488a' 2024-08-31T04:31:10.443 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16343 fp=#0x10000004888' 2024-08-31T04:31:10.443 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16375 fp=#0x10000004530' 2024-08-31T04:31:10.443 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16407 fp=#0x10000004527' 2024-08-31T04:31:10.444 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16439 fp=#0x1000000450d' 2024-08-31T04:31:10.444 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16471 fp=#0x10000004987' 2024-08-31T04:31:10.444 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16503 fp=#0x10000004970' 2024-08-31T04:31:10.445 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16567 fp=#0x10000004958' 2024-08-31T04:31:10.445 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16631 fp=#0x200000022c4' 2024-08-31T04:31:10.446 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16663 fp=#0x20000002292' 2024-08-31T04:31:10.446 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16695 fp=#0x20000000416' 2024-08-31T04:31:10.446 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16727 fp=#0x10000002a73' 2024-08-31T04:31:10.447 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16759 fp=#0x200000003fc' 2024-08-31T04:31:10.447 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16791 fp=#0x20000000415' 2024-08-31T04:31:10.447 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16823 fp=#0x10000002ae4' 2024-08-31T04:31:10.448 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16855 fp=#0x10000004599' 2024-08-31T04:31:10.448 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16887 fp=#0x1000000458d' 2024-08-31T04:31:10.448 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16919 fp=#0x10000005d4d' 2024-08-31T04:31:10.448 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16951 fp=#0x1000000456f' 2024-08-31T04:31:10.449 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16983 fp=#0x10000004581' 2024-08-31T04:31:10.451 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17239 fp=#0x100000054d2' 2024-08-31T04:31:10.451 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17271 fp=#0x100000054e6' 2024-08-31T04:31:10.452 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17303 fp=#0x10000005489' 2024-08-31T04:31:10.452 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17367 fp=#0x20000001aa7' 2024-08-31T04:31:10.452 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17399 fp=#0x20000001abc' 2024-08-31T04:31:10.453 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17431 fp=#0x20000001aaf' 2024-08-31T04:31:10.453 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17463 fp=#0x10000004d6d' 2024-08-31T04:31:10.453 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17495 fp=#0x10000004e05' 2024-08-31T04:31:10.454 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17527 fp=#0x20000001b8d' 2024-08-31T04:31:10.454 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17559 fp=#0x20000001b29' 2024-08-31T04:31:10.454 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17591 fp=#0x20000001ae2' 2024-08-31T04:31:10.455 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17623 fp=#0x20000001f52' 2024-08-31T04:31:10.455 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17655 fp=#0x100000029cb' 2024-08-31T04:31:10.455 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17687 fp=#0x10000002a04' 2024-08-31T04:31:10.456 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17719 fp=#0x20000001efe' 2024-08-31T04:31:10.456 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17751 fp=#0x10000004f44' 2024-08-31T04:31:10.456 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17783 fp=#0x10000004f29' 2024-08-31T04:31:10.457 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17815 fp=#0x10000004f34' 2024-08-31T04:31:10.457 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17847 fp=#0x10000004f14' 2024-08-31T04:31:10.457 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17911 fp=#0x10000000834' 2024-08-31T04:31:10.458 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17975 fp=#0x20000001d40' 2024-08-31T04:31:10.458 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18007 fp=#0x20000001c02' 2024-08-31T04:31:10.459 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18039 fp=#0x20000001c87' 2024-08-31T04:31:10.459 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18071 fp=#0x2000000172e' 2024-08-31T04:31:10.459 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18103 fp=#0x20000001774' 2024-08-31T04:31:10.460 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18135 fp=#0x2000000177c' 2024-08-31T04:31:10.460 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18167 fp=#0x20000000d2a' 2024-08-31T04:31:10.460 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18199 fp=#0x20000000c63' 2024-08-31T04:31:10.461 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18231 fp=#0x20000000ced' 2024-08-31T04:31:10.462 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18324 fp=#0x20000000852' 2024-08-31T04:31:10.462 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18356 fp=#0x10000004957' 2024-08-31T04:31:10.462 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18415 fp=#0x20000002196' 2024-08-31T04:31:10.463 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18447 fp=#0x200000021a6' 2024-08-31T04:31:10.463 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18479 fp=#0x200000021c0' 2024-08-31T04:31:10.463 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18511 fp=#0x200000021a8' 2024-08-31T04:31:10.463 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18541 fp=#0x40000000c30' 2024-08-31T04:31:10.464 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18573 fp=#0x10000003619' 2024-08-31T04:31:10.464 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:7168 fp=#0x10000000208' 2024-08-31T04:31:10.465 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:7200 fp=#0x2000000063c' 2024-08-31T04:31:10.465 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:7264 fp=#0x100000030ea' 2024-08-31T04:31:10.466 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:7296 fp=#0x10000000823' 2024-08-31T04:31:10.468 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:7520 fp=#0x20000001f82' 2024-08-31T04:31:10.478 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:8855 fp=#0x2000000064f' 2024-08-31T04:31:10.479 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:8919 fp=#0x2000000068a' 2024-08-31T04:31:10.479 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:8951 fp=#0x20000000638' 2024-08-31T04:31:10.480 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9015 fp=#0x20000000fc5' 2024-08-31T04:31:10.480 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9079 fp=#0x20000000fc6' 2024-08-31T04:31:10.481 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9111 fp=#0x2000000089b' 2024-08-31T04:31:10.481 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9143 fp=#0x20000000871' 2024-08-31T04:31:10.481 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9175 fp=#0x20000001cf9' 2024-08-31T04:31:10.482 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9207 fp=#0x20000001dab' 2024-08-31T04:31:10.482 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9239 fp=#0x20000001d6c' 2024-08-31T04:31:10.483 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9399 fp=#0x200000009cb' 2024-08-31T04:31:10.484 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9431 fp=#0x20000001560' 2024-08-31T04:31:10.484 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9463 fp=#0x200000021d2' 2024-08-31T04:31:10.484 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9495 fp=#0x2000000154a' 2024-08-31T04:31:10.485 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9527 fp=#0x20000001545' 2024-08-31T04:31:10.485 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9559 fp=#0x2000000158b' 2024-08-31T04:31:10.485 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9591 fp=#0x2000000189b' 2024-08-31T04:31:10.486 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9623 fp=#0x200000018c5' 2024-08-31T04:31:10.486 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9655 fp=#0x20000001850' 2024-08-31T04:31:10.486 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9687 fp=#0x20000000b24' 2024-08-31T04:31:10.487 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9719 fp=#0x20000000af6' 2024-08-31T04:31:10.487 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9751 fp=#0x20000000b0f' 2024-08-31T04:31:10.487 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9783 fp=#0x20000000af1' 2024-08-31T04:31:10.488 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9815 fp=#0x20000000b31' 2024-08-31T04:31:10.488 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9847 fp=#0x20000001e6a' 2024-08-31T04:31:10.488 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9879 fp=#0x20000001e7b' 2024-08-31T04:31:10.489 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9911 fp=#0x20000001e97' 2024-08-31T04:31:10.490 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10070 fp=#0x20000000d85' 2024-08-31T04:31:10.490 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10102 fp=#0x20000000e32' 2024-08-31T04:31:10.491 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10134 fp=#0x20000000deb' 2024-08-31T04:31:10.491 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10166 fp=#0x20000000e23' 2024-08-31T04:31:10.491 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10198 fp=#0x2000000106a' 2024-08-31T04:31:10.492 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10230 fp=#0x20000000fea' 2024-08-31T04:31:10.492 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10262 fp=#0x2000000102f' 2024-08-31T04:31:10.493 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10294 fp=#0x20000000fd2' 2024-08-31T04:31:10.493 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10326 fp=#0x20000000913' 2024-08-31T04:31:10.493 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10358 fp=#0x200000014bd' 2024-08-31T04:31:10.494 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10390 fp=#0x200000014f6' 2024-08-31T04:31:10.494 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10422 fp=#0x2000000090c' 2024-08-31T04:31:10.494 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10454 fp=#0x200000014f4' 2024-08-31T04:31:10.495 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10486 fp=#0x10000003c91' 2024-08-31T04:31:10.495 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10518 fp=#0x10000003c98' 2024-08-31T04:31:10.495 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10550 fp=#0x10000000bee' 2024-08-31T04:31:10.495 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10582 fp=#0x10000001149' 2024-08-31T04:31:10.496 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10614 fp=#0x20000002058' 2024-08-31T04:31:10.496 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10646 fp=#0x2000000209f' 2024-08-31T04:31:10.496 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10678 fp=#0x200000020dd' 2024-08-31T04:31:10.497 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10710 fp=#0x200000020a8' 2024-08-31T04:31:10.498 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10870 fp=#0x200000005f4' 2024-08-31T04:31:10.498 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10902 fp=#0x2000000060e' 2024-08-31T04:31:10.499 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10934 fp=#0x1000000343a' 2024-08-31T04:31:10.499 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10966 fp=#0x200000005fe' 2024-08-31T04:31:10.500 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11030 fp=#0x10000003d3c' 2024-08-31T04:31:10.500 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11062 fp=#0x10000003d4d' 2024-08-31T04:31:10.501 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11094 fp=#0x10000003dc4' 2024-08-31T04:31:10.501 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11126 fp=#0x1000000397e' 2024-08-31T04:31:10.501 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11158 fp=#0x100000039a2' 2024-08-31T04:31:10.502 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11190 fp=#0x10000003d73' 2024-08-31T04:31:10.502 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11218 fp=#0x20000000e91' 2024-08-31T04:31:10.502 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11250 fp=#0x20000000e7b' 2024-08-31T04:31:10.502 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11282 fp=#0x20000000e74' 2024-08-31T04:31:10.503 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11314 fp=#0x20000000e71' 2024-08-31T04:31:10.503 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11346 fp=#0x20000001e37' 2024-08-31T04:31:10.504 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11378 fp=#0x20000001e3b' 2024-08-31T04:31:10.504 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11410 fp=#0x20000001eb8' 2024-08-31T04:31:10.504 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11442 fp=#0x20000001900' 2024-08-31T04:31:10.504 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11474 fp=#0x200000018d8' 2024-08-31T04:31:10.505 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11506 fp=#0x20000001939' 2024-08-31T04:31:10.505 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11538 fp=#0x100000045a0' 2024-08-31T04:31:10.505 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11570 fp=#0x1000000462e' 2024-08-31T04:31:10.506 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11602 fp=#0x10000004604' 2024-08-31T04:31:10.506 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11634 fp=#0x20000000655' 2024-08-31T04:31:10.506 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11666 fp=#0x20000000686' 2024-08-31T04:31:10.507 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11698 fp=#0x200000006bd' 2024-08-31T04:31:10.507 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11762 fp=#0x200000006a3' 2024-08-31T04:31:10.508 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11794 fp=#0x20000000695' 2024-08-31T04:31:10.508 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11826 fp=#0x200000006bc' 2024-08-31T04:31:10.508 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11858 fp=#0x200000022f5' 2024-08-31T04:31:10.508 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11890 fp=#0x20000001640' 2024-08-31T04:31:10.509 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11922 fp=#0x2000000162f' 2024-08-31T04:31:10.509 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11954 fp=#0x20000000a95' 2024-08-31T04:31:10.509 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11986 fp=#0x20000000ab3' 2024-08-31T04:31:10.510 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12018 fp=#0x200000016de' 2024-08-31T04:31:10.510 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12050 fp=#0x2000000173f' 2024-08-31T04:31:10.510 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12082 fp=#0x200000016c4' 2024-08-31T04:31:10.511 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12146 fp=#0x20000001f9b' 2024-08-31T04:31:10.511 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12178 fp=#0x200000014b6' 2024-08-31T04:31:10.511 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12210 fp=#0x20000001500' 2024-08-31T04:31:10.512 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12338 fp=#0x200000014e2' 2024-08-31T04:31:10.513 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12370 fp=#0x20000001098' 2024-08-31T04:31:10.513 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12402 fp=#0x2000000108a' 2024-08-31T04:31:10.513 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12434 fp=#0x2000000104a' 2024-08-31T04:31:10.514 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12466 fp=#0x20000001ed6' 2024-08-31T04:31:10.514 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12498 fp=#0x20000001e83' 2024-08-31T04:31:10.515 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12530 fp=#0x20000000aca' 2024-08-31T04:31:10.515 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12562 fp=#0x20000000a35' 2024-08-31T04:31:10.515 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12594 fp=#0x20000000a46' 2024-08-31T04:31:10.516 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12626 fp=#0x20000000a09' 2024-08-31T04:31:10.516 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12658 fp=#0x200000009df' 2024-08-31T04:31:10.516 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12690 fp=#0x10000000ebe' 2024-08-31T04:31:10.516 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12722 fp=#0x10000000f7d' 2024-08-31T04:31:10.517 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12754 fp=#0x10000000e8f' 2024-08-31T04:31:10.517 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12786 fp=#0x10000000ee7' 2024-08-31T04:31:10.517 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12818 fp=#0x10000000f1d' 2024-08-31T04:31:10.518 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12850 fp=#0x20000000222' 2024-08-31T04:31:10.518 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12882 fp=#0x10000002f2a' 2024-08-31T04:31:10.518 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12914 fp=#0x200000020d5' 2024-08-31T04:31:10.519 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12946 fp=#0x200000020bf' 2024-08-31T04:31:10.519 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12978 fp=#0x10000002e98' 2024-08-31T04:31:10.519 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13010 fp=#0x10000002f2c' 2024-08-31T04:31:10.520 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13041 fp=#0x20000000762' 2024-08-31T04:31:10.520 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13073 fp=#0x20000000792' 2024-08-31T04:31:10.520 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13105 fp=#0x2000000071e' 2024-08-31T04:31:10.521 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13137 fp=#0x20000000786' 2024-08-31T04:31:10.521 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13169 fp=#0x2000000072f' 2024-08-31T04:31:10.521 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13201 fp=#0x20000000783' 2024-08-31T04:31:10.522 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13233 fp=#0x20000000bd6' 2024-08-31T04:31:10.522 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13265 fp=#0x20000000b6c' 2024-08-31T04:31:10.522 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13297 fp=#0x20000000bce' 2024-08-31T04:31:10.523 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13329 fp=#0x20000000b88' 2024-08-31T04:31:10.523 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13361 fp=#0x20000001d52' 2024-08-31T04:31:10.523 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13393 fp=#0x20000001d25' 2024-08-31T04:31:10.524 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13425 fp=#0x20000001d43' 2024-08-31T04:31:10.524 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13457 fp=#0x20000001c3b' 2024-08-31T04:31:10.524 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13489 fp=#0x10000003b4a' 2024-08-31T04:31:10.526 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13644 fp=#0x20000002104' 2024-08-31T04:31:10.526 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13676 fp=#0x10000002e1b' 2024-08-31T04:31:10.526 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13708 fp=#0x10000002ed8' 2024-08-31T04:31:10.526 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13740 fp=#0x10000002e41' 2024-08-31T04:31:10.527 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13772 fp=#0x10000002e8d' 2024-08-31T04:31:10.527 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13804 fp=#0x200000015c0' 2024-08-31T04:31:10.527 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13836 fp=#0x200000015ee' 2024-08-31T04:31:10.528 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13868 fp=#0x20000000db8' 2024-08-31T04:31:10.528 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13900 fp=#0x20000000cdf' 2024-08-31T04:31:10.528 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13932 fp=#0x2000000225a' 2024-08-31T04:31:10.529 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13964 fp=#0x20000000d93' 2024-08-31T04:31:10.529 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13996 fp=#0x20000000cf0' 2024-08-31T04:31:10.530 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14028 fp=#0x20000001a2d' 2024-08-31T04:31:10.530 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14060 fp=#0x200000019e7' 2024-08-31T04:31:10.530 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14092 fp=#0x200000019db' 2024-08-31T04:31:10.531 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14124 fp=#0x200000008e1' 2024-08-31T04:31:10.531 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14156 fp=#0x200000008f0' 2024-08-31T04:31:10.531 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14188 fp=#0x200000008f4' 2024-08-31T04:31:10.532 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14220 fp=#0x200000008da' 2024-08-31T04:31:10.532 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14252 fp=#0x200000008b4' 2024-08-31T04:31:10.532 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14316 fp=#0x20000001dde' 2024-08-31T04:31:10.533 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14444 fp=#0x20000001922' 2024-08-31T04:31:10.534 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14476 fp=#0x20000001817' 2024-08-31T04:31:10.534 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14508 fp=#0x20000001b9d' 2024-08-31T04:31:10.534 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14540 fp=#0x20000001865' 2024-08-31T04:31:10.535 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14572 fp=#0x20000000f64' 2024-08-31T04:31:10.535 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14604 fp=#0x20000000f3f' 2024-08-31T04:31:10.535 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14636 fp=#0x20000000f0c' 2024-08-31T04:31:10.536 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14668 fp=#0x20000000f2d' 2024-08-31T04:31:10.536 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14700 fp=#0x20000000f74' 2024-08-31T04:31:10.536 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14732 fp=#0x200000014a6' 2024-08-31T04:31:10.537 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14764 fp=#0x20000000bfd' 2024-08-31T04:31:10.537 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14796 fp=#0x10000004643' 2024-08-31T04:31:10.538 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14874 fp=#0x100000030ef' 2024-08-31T04:31:10.538 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14906 fp=#0x20000001181' 2024-08-31T04:31:10.538 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14938 fp=#0x100000030f1' 2024-08-31T04:31:10.539 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14970 fp=#0x100000058ba' 2024-08-31T04:31:10.539 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15002 fp=#0x20000001776' 2024-08-31T04:31:10.539 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15034 fp=#0x200000017d9' 2024-08-31T04:31:10.540 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15066 fp=#0x2000000180c' 2024-08-31T04:31:10.540 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15098 fp=#0x20000001735' 2024-08-31T04:31:10.540 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15130 fp=#0x2000000179d' 2024-08-31T04:31:10.540 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15161 fp=#0x200000010cb' 2024-08-31T04:31:10.541 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15193 fp=#0x10000004eeb' 2024-08-31T04:31:10.541 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15225 fp=#0x1000000174c' 2024-08-31T04:31:10.541 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15257 fp=#0x2000000227d' 2024-08-31T04:31:10.542 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15289 fp=#0x200000021ea' 2024-08-31T04:31:10.542 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15321 fp=#0x20000002264' 2024-08-31T04:31:10.543 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15481 fp=#0x1000000534e' 2024-08-31T04:31:10.543 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15513 fp=#0x20000001626' 2024-08-31T04:31:10.544 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15545 fp=#0x20000001657' 2024-08-31T04:31:10.544 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15577 fp=#0x20000001a03' 2024-08-31T04:31:10.544 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15609 fp=#0x2000000164c' 2024-08-31T04:31:10.545 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15641 fp=#0x10000004e9a' 2024-08-31T04:31:10.545 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15673 fp=#0x10000004e43' 2024-08-31T04:31:10.545 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15705 fp=#0x10000004df1' 2024-08-31T04:31:10.546 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15737 fp=#0x10000004e66' 2024-08-31T04:31:10.546 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15833 fp=#0x2000000211c' 2024-08-31T04:31:10.547 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15897 fp=#0x20000001ff8' 2024-08-31T04:31:10.547 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15961 fp=#0x2000000201a' 2024-08-31T04:31:10.548 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15993 fp=#0x20000000eb0' 2024-08-31T04:31:10.548 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16025 fp=#0x2000000194f' 2024-08-31T04:31:10.548 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16057 fp=#0x20000000ea5' 2024-08-31T04:31:10.549 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16089 fp=#0x200000011c6' 2024-08-31T04:31:10.549 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16121 fp=#0x20000001125' 2024-08-31T04:31:10.549 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16153 fp=#0x20000001165' 2024-08-31T04:31:10.550 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16185 fp=#0x200000015a1' 2024-08-31T04:31:10.550 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16217 fp=#0x200000015e2' 2024-08-31T04:31:10.550 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16249 fp=#0x20000001609' 2024-08-31T04:31:10.551 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16280 fp=#0x100000044f9' 2024-08-31T04:31:10.551 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16312 fp=#0x10000004893' 2024-08-31T04:31:10.551 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16344 fp=#0x100000044fe' 2024-08-31T04:31:10.552 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16376 fp=#0x10000004830' 2024-08-31T04:31:10.552 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16408 fp=#0x10000004833' 2024-08-31T04:31:10.553 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16536 fp=#0x100000048ef' 2024-08-31T04:31:10.553 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16568 fp=#0x100000048f5' 2024-08-31T04:31:10.554 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16600 fp=#0x20000001140' 2024-08-31T04:31:10.554 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16632 fp=#0x200000022b1' 2024-08-31T04:31:10.554 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16664 fp=#0x200000022a7' 2024-08-31T04:31:10.555 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16696 fp=#0x20000000419' 2024-08-31T04:31:10.555 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16728 fp=#0x20000000406' 2024-08-31T04:31:10.555 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16792 fp=#0x10000002a87' 2024-08-31T04:31:10.556 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16824 fp=#0x200000003fe' 2024-08-31T04:31:10.556 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16856 fp=#0x10000004558' 2024-08-31T04:31:10.556 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16888 fp=#0x10000004582' 2024-08-31T04:31:10.557 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16920 fp=#0x10000005d4b' 2024-08-31T04:31:10.557 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16952 fp=#0x10000004560' 2024-08-31T04:31:10.557 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16984 fp=#0x10000005d59' 2024-08-31T04:31:10.558 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17112 fp=#0x10000005737' 2024-08-31T04:31:10.559 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17144 fp=#0x10000005739' 2024-08-31T04:31:10.560 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17304 fp=#0x10000005474' 2024-08-31T04:31:10.560 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17336 fp=#0x10000005476' 2024-08-31T04:31:10.561 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17368 fp=#0x20000001a8d' 2024-08-31T04:31:10.561 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17400 fp=#0x20000001a72' 2024-08-31T04:31:10.561 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17432 fp=#0x20000001a9c' 2024-08-31T04:31:10.562 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17464 fp=#0x10000004d58' 2024-08-31T04:31:10.562 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17496 fp=#0x10000004d92' 2024-08-31T04:31:10.562 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17528 fp=#0x20000001b52' 2024-08-31T04:31:10.563 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17560 fp=#0x20000001b5f' 2024-08-31T04:31:10.563 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17592 fp=#0x20000001b50' 2024-08-31T04:31:10.563 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17624 fp=#0x20000001f3a' 2024-08-31T04:31:10.563 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17656 fp=#0x20000001f3c' 2024-08-31T04:31:10.564 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17688 fp=#0x100000029c4' 2024-08-31T04:31:10.564 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17720 fp=#0x20000001f67' 2024-08-31T04:31:10.564 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17752 fp=#0x10000004f3b' 2024-08-31T04:31:10.565 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17784 fp=#0x10000004f13' 2024-08-31T04:31:10.565 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17816 fp=#0x10000004ee8' 2024-08-31T04:31:10.566 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17880 fp=#0x1000000082b' 2024-08-31T04:31:10.566 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17976 fp=#0x20000001d3d' 2024-08-31T04:31:10.567 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18008 fp=#0x20000001c1a' 2024-08-31T04:31:10.567 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18040 fp=#0x20000001c4d' 2024-08-31T04:31:10.567 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18072 fp=#0x20000001794' 2024-08-31T04:31:10.568 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18104 fp=#0x200000016f4' 2024-08-31T04:31:10.568 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18136 fp=#0x20000001763' 2024-08-31T04:31:10.568 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18168 fp=#0x20000000c14' 2024-08-31T04:31:10.569 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18200 fp=#0x20000000c83' 2024-08-31T04:31:10.569 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18232 fp=#0x20000000c8a' 2024-08-31T04:31:10.570 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18293 fp=#0x10000004a0f' 2024-08-31T04:31:10.570 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18325 fp=#0x200000022eb' 2024-08-31T04:31:10.571 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18357 fp=#0x10000004910' 2024-08-31T04:31:10.572 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18416 fp=#0x20000002218' 2024-08-31T04:31:10.572 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18448 fp=#0x200000021b8' 2024-08-31T04:31:10.572 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18480 fp=#0x2000000218f' 2024-08-31T04:31:10.573 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18512 fp=#0x2000000222e' 2024-08-31T04:31:10.573 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18542 fp=#0x10000003640' 2024-08-31T04:31:10.574 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18574 fp=#0x10000003706' 2024-08-31T04:31:10.574 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:7201 fp=#0x200000022cc' 2024-08-31T04:31:10.575 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:7265 fp=#0x10000005892' 2024-08-31T04:31:10.576 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:7393 fp=#0x20000001fb3' 2024-08-31T04:31:10.576 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:7425 fp=#0x20000001f86' 2024-08-31T04:31:10.577 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:7521 fp=#0x20000002036' 2024-08-31T04:31:10.578 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:7553 fp=#0x20000002031' 2024-08-31T04:31:10.586 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:8673 fp=#0x20000000ad4' 2024-08-31T04:31:10.588 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:8888 fp=#0x20000000631' 2024-08-31T04:31:10.589 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:8952 fp=#0x20000000644' 2024-08-31T04:31:10.589 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:8984 fp=#0x200000018ba' 2024-08-31T04:31:10.589 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9016 fp=#0x20000000fbc' 2024-08-31T04:31:10.590 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9048 fp=#0x20000000f53' 2024-08-31T04:31:10.590 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9112 fp=#0x20000000865' 2024-08-31T04:31:10.591 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9144 fp=#0x20000001d0e' 2024-08-31T04:31:10.591 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9176 fp=#0x20000001cd2' 2024-08-31T04:31:10.591 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9208 fp=#0x20000001ca6' 2024-08-31T04:31:10.592 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9240 fp=#0x20000001d5a' 2024-08-31T04:31:10.593 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9400 fp=#0x200000009d4' 2024-08-31T04:31:10.594 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9464 fp=#0x20000001542' 2024-08-31T04:31:10.594 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9496 fp=#0x20000000972' 2024-08-31T04:31:10.594 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9528 fp=#0x20000001552' 2024-08-31T04:31:10.595 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9560 fp=#0x2000000157c' 2024-08-31T04:31:10.595 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9624 fp=#0x2000000189f' 2024-08-31T04:31:10.595 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9656 fp=#0x20000001864' 2024-08-31T04:31:10.596 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9688 fp=#0x20000000b5c' 2024-08-31T04:31:10.596 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9720 fp=#0x20000000b07' 2024-08-31T04:31:10.596 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9752 fp=#0x20000000af2' 2024-08-31T04:31:10.597 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9784 fp=#0x20000000b16' 2024-08-31T04:31:10.597 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9816 fp=#0x20000001e5f' 2024-08-31T04:31:10.597 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9848 fp=#0x20000001de9' 2024-08-31T04:31:10.598 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9880 fp=#0x20000001ee0' 2024-08-31T04:31:10.598 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9912 fp=#0x20000001ea2' 2024-08-31T04:31:10.599 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10071 fp=#0x20000000e1b' 2024-08-31T04:31:10.599 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10103 fp=#0x20000000df7' 2024-08-31T04:31:10.600 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10135 fp=#0x20000000d58' 2024-08-31T04:31:10.600 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10167 fp=#0x20000000d61' 2024-08-31T04:31:10.600 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10199 fp=#0x20000001059' 2024-08-31T04:31:10.601 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10231 fp=#0x2000000107a' 2024-08-31T04:31:10.601 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10263 fp=#0x20000001043' 2024-08-31T04:31:10.601 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10295 fp=#0x20000001027' 2024-08-31T04:31:10.602 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10327 fp=#0x20000000945' 2024-08-31T04:31:10.602 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10359 fp=#0x20000000918' 2024-08-31T04:31:10.602 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10391 fp=#0x20000001509' 2024-08-31T04:31:10.603 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10423 fp=#0x200000014d9' 2024-08-31T04:31:10.603 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10455 fp=#0x2000000092b' 2024-08-31T04:31:10.603 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10487 fp=#0x10000000c2f' 2024-08-31T04:31:10.604 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10519 fp=#0x100000017c6' 2024-08-31T04:31:10.604 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10551 fp=#0x10000000b7d' 2024-08-31T04:31:10.604 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10583 fp=#0x10000000bbe' 2024-08-31T04:31:10.605 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10615 fp=#0x200000020ab' 2024-08-31T04:31:10.605 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10679 fp=#0x200000020b5' 2024-08-31T04:31:10.606 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10711 fp=#0x200000020ae' 2024-08-31T04:31:10.607 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10839 fp=#0x200000005de' 2024-08-31T04:31:10.607 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10871 fp=#0x20000001def' 2024-08-31T04:31:10.607 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10903 fp=#0x1000000349b' 2024-08-31T04:31:10.608 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10935 fp=#0x10000003411' 2024-08-31T04:31:10.608 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10967 fp=#0x100000033f4' 2024-08-31T04:31:10.609 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10999 fp=#0x100000039b9' 2024-08-31T04:31:10.609 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11031 fp=#0x10000003ccd' 2024-08-31T04:31:10.609 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11063 fp=#0x100000039ed' 2024-08-31T04:31:10.610 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11127 fp=#0x10000003dca' 2024-08-31T04:31:10.610 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11159 fp=#0x10000003d61' 2024-08-31T04:31:10.611 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11191 fp=#0x100000039a5' 2024-08-31T04:31:10.611 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11219 fp=#0x20000000e8c' 2024-08-31T04:31:10.611 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11251 fp=#0x20000000e4b' 2024-08-31T04:31:10.612 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11283 fp=#0x20000000e54' 2024-08-31T04:31:10.612 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11315 fp=#0x20000000e40' 2024-08-31T04:31:10.612 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11347 fp=#0x200000019b1' 2024-08-31T04:31:10.613 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11379 fp=#0x200000018ca' 2024-08-31T04:31:10.613 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11411 fp=#0x20000001e28' 2024-08-31T04:31:10.613 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11443 fp=#0x20000001e55' 2024-08-31T04:31:10.614 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11475 fp=#0x2000000199e' 2024-08-31T04:31:10.614 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11507 fp=#0x20000001941' 2024-08-31T04:31:10.614 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11539 fp=#0x1000000465c' 2024-08-31T04:31:10.615 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11571 fp=#0x100000045a4' 2024-08-31T04:31:10.615 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11635 fp=#0x200000006a7' 2024-08-31T04:31:10.616 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11667 fp=#0x200000006d1' 2024-08-31T04:31:10.616 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11699 fp=#0x20000000699' 2024-08-31T04:31:10.617 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11763 fp=#0x20000001972' 2024-08-31T04:31:10.617 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11827 fp=#0x20000000656' 2024-08-31T04:31:10.618 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11859 fp=#0x200000022ce' 2024-08-31T04:31:10.618 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11891 fp=#0x2000000162c' 2024-08-31T04:31:10.618 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11923 fp=#0x20000001628' 2024-08-31T04:31:10.619 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11955 fp=#0x20000000ab7' 2024-08-31T04:31:10.619 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11987 fp=#0x2000000163e' 2024-08-31T04:31:10.619 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12019 fp=#0x20000001724' 2024-08-31T04:31:10.620 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12051 fp=#0x200000016d2' 2024-08-31T04:31:10.620 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12083 fp=#0x2000000170c' 2024-08-31T04:31:10.621 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12179 fp=#0x200000014db' 2024-08-31T04:31:10.621 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12211 fp=#0x200000014e1' 2024-08-31T04:31:10.622 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12307 fp=#0x200000014b9' 2024-08-31T04:31:10.623 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12371 fp=#0x2000000106b' 2024-08-31T04:31:10.623 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12403 fp=#0x20000001092' 2024-08-31T04:31:10.623 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12435 fp=#0x200000010d2' 2024-08-31T04:31:10.624 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12467 fp=#0x20000001f24' 2024-08-31T04:31:10.624 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12499 fp=#0x20000001f15' 2024-08-31T04:31:10.624 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12531 fp=#0x20000000a55' 2024-08-31T04:31:10.625 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12563 fp=#0x20000000a60' 2024-08-31T04:31:10.625 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12595 fp=#0x20000000a3e' 2024-08-31T04:31:10.625 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12627 fp=#0x200000009f1' 2024-08-31T04:31:10.626 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12659 fp=#0x20000000a0e' 2024-08-31T04:31:10.626 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12691 fp=#0x10000000f97' 2024-08-31T04:31:10.626 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12723 fp=#0x10000000f59' 2024-08-31T04:31:10.627 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12755 fp=#0x200000003ca' 2024-08-31T04:31:10.627 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12787 fp=#0x200000003b5' 2024-08-31T04:31:10.627 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12819 fp=#0x20000000235' 2024-08-31T04:31:10.628 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12851 fp=#0x10000002f41' 2024-08-31T04:31:10.628 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12883 fp=#0x20000002111' 2024-08-31T04:31:10.628 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12915 fp=#0x20000002161' 2024-08-31T04:31:10.629 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12947 fp=#0x10000002f43' 2024-08-31T04:31:10.629 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12979 fp=#0x10000002e79' 2024-08-31T04:31:10.630 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13011 fp=#0x10000002e78' 2024-08-31T04:31:10.630 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13042 fp=#0x20000000711' 2024-08-31T04:31:10.630 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13074 fp=#0x20000000779' 2024-08-31T04:31:10.631 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13106 fp=#0x2000000076f' 2024-08-31T04:31:10.631 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13138 fp=#0x2000000078a' 2024-08-31T04:31:10.631 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13170 fp=#0x20000000795' 2024-08-31T04:31:10.632 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13202 fp=#0x20000000bee' 2024-08-31T04:31:10.632 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13234 fp=#0x20000000bea' 2024-08-31T04:31:10.632 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13266 fp=#0x20000000b76' 2024-08-31T04:31:10.633 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13298 fp=#0x20000002039' 2024-08-31T04:31:10.633 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13330 fp=#0x20000000b99' 2024-08-31T04:31:10.633 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13362 fp=#0x20000001c92' 2024-08-31T04:31:10.634 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13394 fp=#0x20000001c64' 2024-08-31T04:31:10.634 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13426 fp=#0x20000001d14' 2024-08-31T04:31:10.634 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13458 fp=#0x20000001c59' 2024-08-31T04:31:10.635 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13490 fp=#0x10000003b5c' 2024-08-31T04:31:10.635 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13517 fp=#0x2000000119d' 2024-08-31T04:31:10.636 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13549 fp=#0x20000001172' 2024-08-31T04:31:10.636 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13581 fp=#0x20000002133' 2024-08-31T04:31:10.637 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13677 fp=#0x10000002e32' 2024-08-31T04:31:10.637 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13709 fp=#0x10000002e4f' 2024-08-31T04:31:10.637 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13741 fp=#0x10000002e40' 2024-08-31T04:31:10.638 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13805 fp=#0x2000000080d' 2024-08-31T04:31:10.638 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13837 fp=#0x20000000800' 2024-08-31T04:31:10.639 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13869 fp=#0x2000000224b' 2024-08-31T04:31:10.639 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13901 fp=#0x20000000cf3' 2024-08-31T04:31:10.639 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13933 fp=#0x20000000db3' 2024-08-31T04:31:10.640 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13965 fp=#0x20000000cd9' 2024-08-31T04:31:10.640 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13997 fp=#0x20000000cfd' 2024-08-31T04:31:10.640 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14029 fp=#0x20000001a4e' 2024-08-31T04:31:10.641 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14061 fp=#0x200000019cd' 2024-08-31T04:31:10.641 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14093 fp=#0x20000001a4a' 2024-08-31T04:31:10.642 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14125 fp=#0x2000000093e' 2024-08-31T04:31:10.642 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14157 fp=#0x20000000933' 2024-08-31T04:31:10.642 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14189 fp=#0x20000000953' 2024-08-31T04:31:10.643 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14221 fp=#0x200000008cd' 2024-08-31T04:31:10.643 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14285 fp=#0x20000001de2' 2024-08-31T04:31:10.644 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14349 fp=#0x20000001dcd' 2024-08-31T04:31:10.644 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14381 fp=#0x20000001873' 2024-08-31T04:31:10.645 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14445 fp=#0x20000001828' 2024-08-31T04:31:10.645 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14477 fp=#0x20000001895' 2024-08-31T04:31:10.646 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14509 fp=#0x2000000180d' 2024-08-31T04:31:10.646 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14541 fp=#0x20000001875' 2024-08-31T04:31:10.646 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14573 fp=#0x20000000f31' 2024-08-31T04:31:10.647 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14605 fp=#0x20000000eff' 2024-08-31T04:31:10.647 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14637 fp=#0x20000000f0f' 2024-08-31T04:31:10.647 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14669 fp=#0x20000000f6f' 2024-08-31T04:31:10.648 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14701 fp=#0x20000000fe8' 2024-08-31T04:31:10.648 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14797 fp=#0x100000046da' 2024-08-31T04:31:10.649 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14875 fp=#0x1000000311d' 2024-08-31T04:31:10.650 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14907 fp=#0x10000003107' 2024-08-31T04:31:10.650 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14939 fp=#0x1000000310c' 2024-08-31T04:31:10.650 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14971 fp=#0x200000018b4' 2024-08-31T04:31:10.651 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15003 fp=#0x200000017f2' 2024-08-31T04:31:10.651 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15035 fp=#0x2000000178b' 2024-08-31T04:31:10.651 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15067 fp=#0x200000017b0' 2024-08-31T04:31:10.652 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15099 fp=#0x20000001793' 2024-08-31T04:31:10.652 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15131 fp=#0x2000000176f' 2024-08-31T04:31:10.652 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15162 fp=#0x1000000579f' 2024-08-31T04:31:10.653 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15226 fp=#0x20000001fb7' 2024-08-31T04:31:10.653 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15258 fp=#0x200000021ce' 2024-08-31T04:31:10.654 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15290 fp=#0x20000002269' 2024-08-31T04:31:10.654 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15322 fp=#0x20000002273' 2024-08-31T04:31:10.655 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15418 fp=#0x20000002081' 2024-08-31T04:31:10.655 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15450 fp=#0x20000002099' 2024-08-31T04:31:10.655 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15482 fp=#0x10000005350' 2024-08-31T04:31:10.656 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15514 fp=#0x1000000534a' 2024-08-31T04:31:10.656 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15546 fp=#0x20000001a33' 2024-08-31T04:31:10.656 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15578 fp=#0x10000005322' 2024-08-31T04:31:10.657 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15610 fp=#0x10000004ec6' 2024-08-31T04:31:10.657 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15642 fp=#0x10000004e70' 2024-08-31T04:31:10.658 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15674 fp=#0x200000018aa' 2024-08-31T04:31:10.658 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15706 fp=#0x10000004e47' 2024-08-31T04:31:10.658 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15738 fp=#0x10000004e9f' 2024-08-31T04:31:10.659 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15834 fp=#0x20000001fb5' 2024-08-31T04:31:10.660 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15898 fp=#0x20000001fa6' 2024-08-31T04:31:10.660 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15930 fp=#0x20000001fe6' 2024-08-31T04:31:10.660 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15962 fp=#0x20000002013' 2024-08-31T04:31:10.661 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15994 fp=#0x2000000194b' 2024-08-31T04:31:10.661 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16026 fp=#0x20000000ea9' 2024-08-31T04:31:10.661 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16058 fp=#0x20000000eb6' 2024-08-31T04:31:10.662 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16090 fp=#0x20000001141' 2024-08-31T04:31:10.662 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16122 fp=#0x20000001168' 2024-08-31T04:31:10.665 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16154 fp=#0x20000001110' 2024-08-31T04:31:10.666 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16186 fp=#0x2000000160e' 2024-08-31T04:31:10.666 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16218 fp=#0x200000015f8' 2024-08-31T04:31:10.666 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16250 fp=#0x2000000159e' 2024-08-31T04:31:10.667 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16281 fp=#0x100000048a7' 2024-08-31T04:31:10.667 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16313 fp=#0x10000004517' 2024-08-31T04:31:10.667 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16345 fp=#0x1000000481d' 2024-08-31T04:31:10.668 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16377 fp=#0x100000048a6' 2024-08-31T04:31:10.668 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16409 fp=#0x10000004835' 2024-08-31T04:31:10.669 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16441 fp=#0x1000000489f' 2024-08-31T04:31:10.669 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16473 fp=#0x10000004905' 2024-08-31T04:31:10.669 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16505 fp=#0x100000048e2' 2024-08-31T04:31:10.670 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16569 fp=#0x100000048d2' 2024-08-31T04:31:10.670 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16601 fp=#0x20000001166' 2024-08-31T04:31:10.671 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16633 fp=#0x20000002281' 2024-08-31T04:31:10.671 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16665 fp=#0x200000022bb' 2024-08-31T04:31:10.671 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16697 fp=#0x10000002a7c' 2024-08-31T04:31:10.672 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16729 fp=#0x2000000042c' 2024-08-31T04:31:10.672 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16761 fp=#0x200000003ff' 2024-08-31T04:31:10.672 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16793 fp=#0x20000000403' 2024-08-31T04:31:10.673 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16825 fp=#0x20000000430' 2024-08-31T04:31:10.673 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16857 fp=#0x10000005d57' 2024-08-31T04:31:10.673 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16889 fp=#0x10000004564' 2024-08-31T04:31:10.674 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16921 fp=#0x1000000454d' 2024-08-31T04:31:10.674 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16953 fp=#0x100000045a5' 2024-08-31T04:31:10.674 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16985 fp=#0x10000005d4a' 2024-08-31T04:31:10.675 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17081 fp=#0x1000000578d' 2024-08-31T04:31:10.676 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17177 fp=#0x1000000572f' 2024-08-31T04:31:10.676 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17209 fp=#0x10000005479' 2024-08-31T04:31:10.677 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17241 fp=#0x100000054e9' 2024-08-31T04:31:10.677 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17273 fp=#0x10000005488' 2024-08-31T04:31:10.678 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17337 fp=#0x1000000547c' 2024-08-31T04:31:10.678 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17369 fp=#0x20000001aaa' 2024-08-31T04:31:10.678 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17401 fp=#0x20000001aa4' 2024-08-31T04:31:10.679 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17433 fp=#0x20000001a8e' 2024-08-31T04:31:10.679 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17465 fp=#0x10000004dcb' 2024-08-31T04:31:10.679 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17497 fp=#0x10000004dde' 2024-08-31T04:31:10.679 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17529 fp=#0x20000001b93' 2024-08-31T04:31:10.680 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17561 fp=#0x20000001b8b' 2024-08-31T04:31:10.680 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17593 fp=#0x20000001b43' 2024-08-31T04:31:10.680 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17625 fp=#0x10000002a49' 2024-08-31T04:31:10.681 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17657 fp=#0x100000029f2' 2024-08-31T04:31:10.681 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17689 fp=#0x20000001f3d' 2024-08-31T04:31:10.682 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17721 fp=#0x10000002a14' 2024-08-31T04:31:10.682 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17753 fp=#0x10000004ee0' 2024-08-31T04:31:10.682 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17785 fp=#0x10000004f49' 2024-08-31T04:31:10.682 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17817 fp=#0x10000004ee2' 2024-08-31T04:31:10.684 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17977 fp=#0x20000001d63' 2024-08-31T04:31:10.684 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18009 fp=#0x20000001c32' 2024-08-31T04:31:10.684 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18041 fp=#0x20000001c23' 2024-08-31T04:31:10.685 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18073 fp=#0x20000001797' 2024-08-31T04:31:10.685 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18105 fp=#0x20000001d86' 2024-08-31T04:31:10.685 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18137 fp=#0x20000001784' 2024-08-31T04:31:10.686 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18169 fp=#0x20000000c77' 2024-08-31T04:31:10.686 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18201 fp=#0x20000000c3c' 2024-08-31T04:31:10.686 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18233 fp=#0x20000000d00' 2024-08-31T04:31:10.687 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18294 fp=#0x20000000adf' 2024-08-31T04:31:10.687 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18326 fp=#0x20000000850' 2024-08-31T04:31:10.687 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18358 fp=#0x10000004a00' 2024-08-31T04:31:10.688 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18417 fp=#0x200000021fd' 2024-08-31T04:31:10.688 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18449 fp=#0x200000021ad' 2024-08-31T04:31:10.688 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18481 fp=#0x2000000223b' 2024-08-31T04:31:10.689 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18513 fp=#0x200000021a1' 2024-08-31T04:31:10.689 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18543 fp=#0x400000006fd' 2024-08-31T04:31:10.689 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18575 fp=#0x1000000367a' 2024-08-31T04:31:10.690 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:7170 fp=#0x10000000399' 2024-08-31T04:31:10.690 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:7202 fp=#0x20000000a6d' 2024-08-31T04:31:10.691 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:7298 fp=#0x20000001bf2' 2024-08-31T04:31:10.691 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:7362 fp=#0x20000001fb0' 2024-08-31T04:31:10.692 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:7426 fp=#0x20000001ff1' 2024-08-31T04:31:10.692 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:7458 fp=#0x20000001fe0' 2024-08-31T04:31:10.693 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:7554 fp=#0x20000002012' 2024-08-31T04:31:10.702 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:8674 fp=#0x20000000ad2' 2024-08-31T04:31:10.703 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:8793 fp=#0x2000000083c' 2024-08-31T04:31:10.704 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:8889 fp=#0x20000000632' 2024-08-31T04:31:10.704 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:8953 fp=#0x20000000639' 2024-08-31T04:31:10.705 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:8985 fp=#0x200000018b1' 2024-08-31T04:31:10.705 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9017 fp=#0x20000000f56' 2024-08-31T04:31:10.705 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9049 fp=#0x20000000f5e' 2024-08-31T04:31:10.705 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9081 fp=#0x20000000f70' 2024-08-31T04:31:10.706 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9113 fp=#0x2000000088f' 2024-08-31T04:31:10.706 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9145 fp=#0x20000001d11' 2024-08-31T04:31:10.707 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9177 fp=#0x20000001d94' 2024-08-31T04:31:10.707 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9209 fp=#0x2000000088e' 2024-08-31T04:31:10.709 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9401 fp=#0x2000000157e' 2024-08-31T04:31:10.709 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9433 fp=#0x20000000ae4' 2024-08-31T04:31:10.709 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9465 fp=#0x2000000096a' 2024-08-31T04:31:10.710 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9497 fp=#0x20000001586' 2024-08-31T04:31:10.710 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9529 fp=#0x2000000119b' 2024-08-31T04:31:10.710 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9561 fp=#0x20000000961' 2024-08-31T04:31:10.711 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9593 fp=#0x2000000149d' 2024-08-31T04:31:10.711 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9625 fp=#0x20000001847' 2024-08-31T04:31:10.711 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9657 fp=#0x20000001853' 2024-08-31T04:31:10.712 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9689 fp=#0x20000000af5' 2024-08-31T04:31:10.712 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9721 fp=#0x20000001f7c' 2024-08-31T04:31:10.712 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9753 fp=#0x20000000b1a' 2024-08-31T04:31:10.713 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9785 fp=#0x20000001f80' 2024-08-31T04:31:10.713 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9817 fp=#0x20000001df9' 2024-08-31T04:31:10.713 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9849 fp=#0x20000001ef2' 2024-08-31T04:31:10.714 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9881 fp=#0x20000001e19' 2024-08-31T04:31:10.714 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9913 fp=#0x20000001ee6' 2024-08-31T04:31:10.715 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10072 fp=#0x20000000e0f' 2024-08-31T04:31:10.716 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10104 fp=#0x20000000ded' 2024-08-31T04:31:10.716 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10136 fp=#0x20000000de5' 2024-08-31T04:31:10.716 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10168 fp=#0x20000000e0d' 2024-08-31T04:31:10.717 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10200 fp=#0x2000000102c' 2024-08-31T04:31:10.717 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10232 fp=#0x200000006ef' 2024-08-31T04:31:10.717 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10264 fp=#0x2000000100a' 2024-08-31T04:31:10.718 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10296 fp=#0x20000001033' 2024-08-31T04:31:10.718 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10328 fp=#0x2000000092e' 2024-08-31T04:31:10.718 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10360 fp=#0x20000001499' 2024-08-31T04:31:10.719 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10392 fp=#0x200000014c0' 2024-08-31T04:31:10.719 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10424 fp=#0x20000000925' 2024-08-31T04:31:10.719 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10456 fp=#0x20000001504' 2024-08-31T04:31:10.720 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10488 fp=#0x10000000bba' 2024-08-31T04:31:10.720 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10520 fp=#0x10000003c87' 2024-08-31T04:31:10.720 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10552 fp=#0x10000000c05' 2024-08-31T04:31:10.721 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10584 fp=#0x10000000b6d' 2024-08-31T04:31:10.721 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10616 fp=#0x200000020ed' 2024-08-31T04:31:10.721 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10648 fp=#0x200000020a1' 2024-08-31T04:31:10.722 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10680 fp=#0x200000020af' 2024-08-31T04:31:10.722 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10712 fp=#0x20000002066' 2024-08-31T04:31:10.723 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10840 fp=#0x200000005e1' 2024-08-31T04:31:10.723 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10872 fp=#0x200000005d8' 2024-08-31T04:31:10.724 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10904 fp=#0x200000005e3' 2024-08-31T04:31:10.724 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10936 fp=#0x10000003489' 2024-08-31T04:31:10.724 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10968 fp=#0x1000000346b' 2024-08-31T04:31:10.725 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11000 fp=#0x10000003c20' 2024-08-31T04:31:10.725 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11032 fp=#0x10000003b7d' 2024-08-31T04:31:10.725 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11064 fp=#0x10000003cf6' 2024-08-31T04:31:10.726 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11128 fp=#0x10000003c3c' 2024-08-31T04:31:10.726 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11192 fp=#0x10000003b9b' 2024-08-31T04:31:10.727 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11220 fp=#0x20000000e70' 2024-08-31T04:31:10.727 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11252 fp=#0x20000000e85' 2024-08-31T04:31:10.727 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11284 fp=#0x20000000e53' 2024-08-31T04:31:10.728 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11316 fp=#0x20000001903' 2024-08-31T04:31:10.728 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11348 fp=#0x20000001deb' 2024-08-31T04:31:10.728 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11380 fp=#0x200000019b3' 2024-08-31T04:31:10.728 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11412 fp=#0x2000000190a' 2024-08-31T04:31:10.729 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11444 fp=#0x2000000195d' 2024-08-31T04:31:10.729 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11476 fp=#0x20000001942' 2024-08-31T04:31:10.729 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11508 fp=#0x20000001967' 2024-08-31T04:31:10.730 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11540 fp=#0x100000045ba' 2024-08-31T04:31:10.730 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11572 fp=#0x100000045b6' 2024-08-31T04:31:10.730 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11604 fp=#0x100000045f2' 2024-08-31T04:31:10.731 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11636 fp=#0x2000000214c' 2024-08-31T04:31:10.731 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11668 fp=#0x200000009ae' 2024-08-31T04:31:10.732 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11732 fp=#0x20000002149' 2024-08-31T04:31:10.732 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11828 fp=#0x2000000068e' 2024-08-31T04:31:10.733 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11860 fp=#0x200000022ea' 2024-08-31T04:31:10.733 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11892 fp=#0x20000000ab9' 2024-08-31T04:31:10.733 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11924 fp=#0x20000001653' 2024-08-31T04:31:10.734 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11956 fp=#0x20000000a6f' 2024-08-31T04:31:10.734 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11988 fp=#0x20000000a88' 2024-08-31T04:31:10.734 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12020 fp=#0x200000016d5' 2024-08-31T04:31:10.735 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12052 fp=#0x200000016b2' 2024-08-31T04:31:10.735 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12084 fp=#0x20000002085' 2024-08-31T04:31:10.737 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12308 fp=#0x20000001f8d' 2024-08-31T04:31:10.737 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12372 fp=#0x200000010ad' 2024-08-31T04:31:10.737 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12404 fp=#0x200000010b0' 2024-08-31T04:31:10.738 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12436 fp=#0x200000010b6' 2024-08-31T04:31:10.738 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12468 fp=#0x20000001e76' 2024-08-31T04:31:10.738 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12500 fp=#0x20000001f29' 2024-08-31T04:31:10.739 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12532 fp=#0x20000000acc' 2024-08-31T04:31:10.739 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12564 fp=#0x20000000a57' 2024-08-31T04:31:10.739 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12596 fp=#0x200000009ff' 2024-08-31T04:31:10.740 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12628 fp=#0x20000000a62' 2024-08-31T04:31:10.740 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12660 fp=#0x20000000a52' 2024-08-31T04:31:10.740 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12692 fp=#0x100000011b0' 2024-08-31T04:31:10.741 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12724 fp=#0x200000003ce' 2024-08-31T04:31:10.741 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12756 fp=#0x20000000499' 2024-08-31T04:31:10.741 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12788 fp=#0x20000000203' 2024-08-31T04:31:10.742 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12820 fp=#0x200000003be' 2024-08-31T04:31:10.742 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12852 fp=#0x200000020f3' 2024-08-31T04:31:10.742 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12884 fp=#0x200000020d1' 2024-08-31T04:31:10.742 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12916 fp=#0x10000002eca' 2024-08-31T04:31:10.743 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12948 fp=#0x10000002ecb' 2024-08-31T04:31:10.743 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12980 fp=#0x2000000212f' 2024-08-31T04:31:10.744 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13012 fp=#0x10000002e7c' 2024-08-31T04:31:10.744 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13043 fp=#0x20000000744' 2024-08-31T04:31:10.744 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13075 fp=#0x20000000751' 2024-08-31T04:31:10.744 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13107 fp=#0x20000000708' 2024-08-31T04:31:10.745 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13139 fp=#0x20000000701' 2024-08-31T04:31:10.745 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13171 fp=#0x20000000705' 2024-08-31T04:31:10.746 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13203 fp=#0x20000000be9' 2024-08-31T04:31:10.746 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13235 fp=#0x20000000ba6' 2024-08-31T04:31:10.746 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13267 fp=#0x20000000baa' 2024-08-31T04:31:10.746 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13299 fp=#0x20000000bbf' 2024-08-31T04:31:10.747 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13331 fp=#0x20000000bd7' 2024-08-31T04:31:10.747 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13363 fp=#0x20000001ce5' 2024-08-31T04:31:10.747 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13395 fp=#0x20000001c57' 2024-08-31T04:31:10.748 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13427 fp=#0x20000001c46' 2024-08-31T04:31:10.748 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13459 fp=#0x20000001cc4' 2024-08-31T04:31:10.748 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13491 fp=#0x10000003b78' 2024-08-31T04:31:10.749 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13518 fp=#0x20000001151' 2024-08-31T04:31:10.749 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13582 fp=#0x2000000211f' 2024-08-31T04:31:10.750 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13646 fp=#0x20000001139' 2024-08-31T04:31:10.750 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13678 fp=#0x10000002e46' 2024-08-31T04:31:10.751 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13710 fp=#0x10000002e64' 2024-08-31T04:31:10.751 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13742 fp=#0x10000002e27' 2024-08-31T04:31:10.751 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13774 fp=#0x1000000391f' 2024-08-31T04:31:10.752 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13806 fp=#0x20000000839' 2024-08-31T04:31:10.752 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13838 fp=#0x200000007f9' 2024-08-31T04:31:10.752 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13870 fp=#0x20000002233' 2024-08-31T04:31:10.753 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13902 fp=#0x20000000ce2' 2024-08-31T04:31:10.753 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13934 fp=#0x20000000d17' 2024-08-31T04:31:10.753 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13966 fp=#0x20000002265' 2024-08-31T04:31:10.753 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13998 fp=#0x20000000d67' 2024-08-31T04:31:10.754 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14030 fp=#0x2000000229d' 2024-08-31T04:31:10.754 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14062 fp=#0x20000001a1d' 2024-08-31T04:31:10.754 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14094 fp=#0x200000019de' 2024-08-31T04:31:10.755 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14126 fp=#0x200000008c0' 2024-08-31T04:31:10.755 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14158 fp=#0x20000000911' 2024-08-31T04:31:10.755 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14190 fp=#0x2000000094b' 2024-08-31T04:31:10.756 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14222 fp=#0x200000008ab' 2024-08-31T04:31:10.756 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14254 fp=#0x20000001dca' 2024-08-31T04:31:10.756 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14286 fp=#0x20000001e04' 2024-08-31T04:31:10.757 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14318 fp=#0x20000001dc2' 2024-08-31T04:31:10.757 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14350 fp=#0x20000001e42' 2024-08-31T04:31:10.758 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14446 fp=#0x2000000181f' 2024-08-31T04:31:10.758 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14478 fp=#0x200000018a8' 2024-08-31T04:31:10.758 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14510 fp=#0x2000000185e' 2024-08-31T04:31:10.759 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14542 fp=#0x200000018ed' 2024-08-31T04:31:10.759 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14574 fp=#0x2000000103c' 2024-08-31T04:31:10.759 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14606 fp=#0x20000000f5a' 2024-08-31T04:31:10.760 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14638 fp=#0x20000000f7e' 2024-08-31T04:31:10.760 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14670 fp=#0x20000000f44' 2024-08-31T04:31:10.760 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14702 fp=#0x20000000fb3' 2024-08-31T04:31:10.761 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14766 fp=#0x2000000182f' 2024-08-31T04:31:10.761 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14830 fp=#0x20000000ae9' 2024-08-31T04:31:10.762 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14876 fp=#0x100000031c0' 2024-08-31T04:31:10.762 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14908 fp=#0x1000000316c' 2024-08-31T04:31:10.762 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14940 fp=#0x1000000315a' 2024-08-31T04:31:10.763 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14972 fp=#0x100000058c4' 2024-08-31T04:31:10.763 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15004 fp=#0x20000001717' 2024-08-31T04:31:10.764 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15036 fp=#0x200000017cb' 2024-08-31T04:31:10.764 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15068 fp=#0x200000017f9' 2024-08-31T04:31:10.764 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15100 fp=#0x2000000176c' 2024-08-31T04:31:10.765 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15132 fp=#0x2000000177b' 2024-08-31T04:31:10.765 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15163 fp=#0x100000057aa' 2024-08-31T04:31:10.765 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15195 fp=#0x1000000179f' 2024-08-31T04:31:10.766 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15227 fp=#0x10000001756' 2024-08-31T04:31:10.766 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15259 fp=#0x20000002249' 2024-08-31T04:31:10.766 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15291 fp=#0x2000000226d' 2024-08-31T04:31:10.766 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15323 fp=#0x200000021f0' 2024-08-31T04:31:10.767 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15387 fp=#0x20000001ca8' 2024-08-31T04:31:10.768 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15483 fp=#0x10000005331' 2024-08-31T04:31:10.768 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15515 fp=#0x10000005325' 2024-08-31T04:31:10.768 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15547 fp=#0x1000000534f' 2024-08-31T04:31:10.769 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15579 fp=#0x2000000161d' 2024-08-31T04:31:10.769 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15611 fp=#0x10000004ec1' 2024-08-31T04:31:10.769 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15643 fp=#0x10000004ea9' 2024-08-31T04:31:10.770 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15707 fp=#0x10000004ec4' 2024-08-31T04:31:10.770 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15739 fp=#0x10000004e7c' 2024-08-31T04:31:10.771 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15835 fp=#0x20000001f93' 2024-08-31T04:31:10.772 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15867 fp=#0x20000001fef' 2024-08-31T04:31:10.773 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15995 fp=#0x20000000eaf' 2024-08-31T04:31:10.773 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16027 fp=#0x20000000ead' 2024-08-31T04:31:10.773 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16059 fp=#0x200000017cf' 2024-08-31T04:31:10.774 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16123 fp=#0x200000011c3' 2024-08-31T04:31:10.774 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16155 fp=#0x2000000113c' 2024-08-31T04:31:10.774 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16187 fp=#0x200000015af' 2024-08-31T04:31:10.775 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16219 fp=#0x20000001596' 2024-08-31T04:31:10.775 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16251 fp=#0x200000015df' 2024-08-31T04:31:10.775 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16282 fp=#0x10000004520' 2024-08-31T04:31:10.776 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16314 fp=#0x1000000483d' 2024-08-31T04:31:10.776 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16346 fp=#0x1000000480d' 2024-08-31T04:31:10.776 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16378 fp=#0x100000047fe' 2024-08-31T04:31:10.777 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16410 fp=#0x10000004507' 2024-08-31T04:31:10.777 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16442 fp=#0x10000004897' 2024-08-31T04:31:10.777 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16474 fp=#0x10000004974' 2024-08-31T04:31:10.777 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16506 fp=#0x10000004e10' 2024-08-31T04:31:10.778 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16538 fp=#0x20000001145' 2024-08-31T04:31:10.778 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16570 fp=#0x20000001192' 2024-08-31T04:31:10.778 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16602 fp=#0x10000004e5a' 2024-08-31T04:31:10.779 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16634 fp=#0x2000000228c' 2024-08-31T04:31:10.779 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16666 fp=#0x200000022aa' 2024-08-31T04:31:10.779 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16698 fp=#0x2000000042e' 2024-08-31T04:31:10.780 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16730 fp=#0x10000002a8a' 2024-08-31T04:31:10.780 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16762 fp=#0x20000000446' 2024-08-31T04:31:10.780 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16794 fp=#0x10000002a79' 2024-08-31T04:31:10.781 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16826 fp=#0x20000000411' 2024-08-31T04:31:10.781 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16858 fp=#0x10000004597' 2024-08-31T04:31:10.781 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16890 fp=#0x10000004577' 2024-08-31T04:31:10.782 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16922 fp=#0x10000005d53' 2024-08-31T04:31:10.782 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16954 fp=#0x10000004574' 2024-08-31T04:31:10.782 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16986 fp=#0x1000000459d' 2024-08-31T04:31:10.783 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17082 fp=#0x10000005788' 2024-08-31T04:31:10.784 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17210 fp=#0x100000054e3' 2024-08-31T04:31:10.785 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17274 fp=#0x1000000546b' 2024-08-31T04:31:10.786 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17370 fp=#0x20000001aba' 2024-08-31T04:31:10.786 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17402 fp=#0x20000001aa8' 2024-08-31T04:31:10.786 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17434 fp=#0x20000001ac3' 2024-08-31T04:31:10.787 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17466 fp=#0x10000004df2' 2024-08-31T04:31:10.787 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17498 fp=#0x10000004e1e' 2024-08-31T04:31:10.787 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17530 fp=#0x20000001b7d' 2024-08-31T04:31:10.788 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17562 fp=#0x20000001b36' 2024-08-31T04:31:10.788 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17594 fp=#0x20000001ad6' 2024-08-31T04:31:10.788 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17626 fp=#0x10000002a5c' 2024-08-31T04:31:10.789 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17658 fp=#0x200000004a0' 2024-08-31T04:31:10.789 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17690 fp=#0x20000001f49' 2024-08-31T04:31:10.789 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17722 fp=#0x100000029ee' 2024-08-31T04:31:10.790 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17754 fp=#0x10000004f39' 2024-08-31T04:31:10.790 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17786 fp=#0x10000004f30' 2024-08-31T04:31:10.790 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17818 fp=#0x10000004ed7' 2024-08-31T04:31:10.791 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17850 fp=#0x10000001152' 2024-08-31T04:31:10.792 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17946 fp=#0x1000000083c' 2024-08-31T04:31:10.792 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17978 fp=#0x20000001c78' 2024-08-31T04:31:10.792 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18010 fp=#0x20000001d4f' 2024-08-31T04:31:10.793 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18042 fp=#0x20000001cef' 2024-08-31T04:31:10.793 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18074 fp=#0x2000000173e' 2024-08-31T04:31:10.793 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18106 fp=#0x20000001707' 2024-08-31T04:31:10.794 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18138 fp=#0x200000016fe' 2024-08-31T04:31:10.794 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18170 fp=#0x20000000cf4' 2024-08-31T04:31:10.794 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18202 fp=#0x20000000c92' 2024-08-31T04:31:10.795 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18234 fp=#0x20000000c40' 2024-08-31T04:31:10.795 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18295 fp=#0x100000049f5' 2024-08-31T04:31:10.795 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18327 fp=#0x10000004908' 2024-08-31T04:31:10.796 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18359 fp=#0x20000000860' 2024-08-31T04:31:10.796 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18386 fp=#0x20000002238' 2024-08-31T04:31:10.796 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18418 fp=#0x200000021b2' 2024-08-31T04:31:10.797 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18450 fp=#0x200000021c6' 2024-08-31T04:31:10.797 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18482 fp=#0x200000021d5' 2024-08-31T04:31:10.798 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18514 fp=#0x20000002182' 2024-08-31T04:31:10.798 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18544 fp=#0x5000000077f' 2024-08-31T04:31:10.798 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18576 fp=#0x10000003649' 2024-08-31T04:31:10.799 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:7171 fp=#0x200000007bc' 2024-08-31T04:31:10.799 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:7203 fp=#0x2000000168e' 2024-08-31T04:31:10.799 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:7267 fp=#0x20000001700' 2024-08-31T04:31:10.800 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:7299 fp=#0x200000016eb' 2024-08-31T04:31:10.801 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:7395 fp=#0x20000001ff4' 2024-08-31T04:31:10.801 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:7459 fp=#0x20000002017' 2024-08-31T04:31:10.811 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:8762 fp=#0x20000000838' 2024-08-31T04:31:10.812 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:8826 fp=#0x200000007bf' 2024-08-31T04:31:10.812 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:8922 fp=#0x20000000640' 2024-08-31T04:31:10.813 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:8986 fp=#0x200000018ac' 2024-08-31T04:31:10.813 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9018 fp=#0x20000000fba' 2024-08-31T04:31:10.814 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9050 fp=#0x20000000f6d' 2024-08-31T04:31:10.814 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9114 fp=#0x20000001c76' 2024-08-31T04:31:10.815 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9178 fp=#0x20000001d81' 2024-08-31T04:31:10.815 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9210 fp=#0x2000000086f' 2024-08-31T04:31:10.816 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9242 fp=#0x2000000086d' 2024-08-31T04:31:10.817 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9402 fp=#0x2000000099a' 2024-08-31T04:31:10.817 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9434 fp=#0x20000001548' 2024-08-31T04:31:10.818 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9466 fp=#0x2000000155a' 2024-08-31T04:31:10.818 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9498 fp=#0x200000009be' 2024-08-31T04:31:10.818 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9530 fp=#0x2000000158d' 2024-08-31T04:31:10.819 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9562 fp=#0x200000009c5' 2024-08-31T04:31:10.819 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9626 fp=#0x20000001896' 2024-08-31T04:31:10.820 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9690 fp=#0x20000000b5a' 2024-08-31T04:31:10.820 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9722 fp=#0x20000000b0e' 2024-08-31T04:31:10.821 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9754 fp=#0x20000000af7' 2024-08-31T04:31:10.821 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9786 fp=#0x20000000aec' 2024-08-31T04:31:10.821 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9818 fp=#0x20000001e39' 2024-08-31T04:31:10.822 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9850 fp=#0x20000001e4b' 2024-08-31T04:31:10.822 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9882 fp=#0x20000001e84' 2024-08-31T04:31:10.822 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9914 fp=#0x20000001f0b' 2024-08-31T04:31:10.823 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10041 fp=#0x20000000d3e' 2024-08-31T04:31:10.824 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10073 fp=#0x20000000e26' 2024-08-31T04:31:10.824 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10105 fp=#0x20000000d42' 2024-08-31T04:31:10.824 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10137 fp=#0x20000000dca' 2024-08-31T04:31:10.825 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10169 fp=#0x20000000d32' 2024-08-31T04:31:10.825 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10201 fp=#0x20000000fed' 2024-08-31T04:31:10.825 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10233 fp=#0x200000006f3' 2024-08-31T04:31:10.826 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10265 fp=#0x200000006d8' 2024-08-31T04:31:10.826 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10297 fp=#0x20000001028' 2024-08-31T04:31:10.826 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10329 fp=#0x2000000093b' 2024-08-31T04:31:10.827 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10361 fp=#0x2000000093a' 2024-08-31T04:31:10.827 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10457 fp=#0x200000014b8' 2024-08-31T04:31:10.828 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10489 fp=#0x10000000c9a' 2024-08-31T04:31:10.828 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10521 fp=#0x10000000b8d' 2024-08-31T04:31:10.829 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10553 fp=#0x10000001124' 2024-08-31T04:31:10.829 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10585 fp=#0x10000003c9d' 2024-08-31T04:31:10.829 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10617 fp=#0x20000002069' 2024-08-31T04:31:10.830 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10649 fp=#0x200000020b2' 2024-08-31T04:31:10.830 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10681 fp=#0x20000002075' 2024-08-31T04:31:10.831 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10809 fp=#0x10000003487' 2024-08-31T04:31:10.831 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10841 fp=#0x10000003402' 2024-08-31T04:31:10.832 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10873 fp=#0x20000000614' 2024-08-31T04:31:10.832 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10905 fp=#0x20000000612' 2024-08-31T04:31:10.832 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10937 fp=#0x10000003444' 2024-08-31T04:31:10.832 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10969 fp=#0x100000033f2' 2024-08-31T04:31:10.833 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11001 fp=#0x10000003b84' 2024-08-31T04:31:10.833 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11033 fp=#0x10000003bc2' 2024-08-31T04:31:10.834 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11065 fp=#0x10000003cd9' 2024-08-31T04:31:10.834 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11097 fp=#0x10000003b45' 2024-08-31T04:31:10.834 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11129 fp=#0x10000003bab' 2024-08-31T04:31:10.834 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11161 fp=#0x10000003bb3' 2024-08-31T04:31:10.835 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11193 fp=#0x1000000399f' 2024-08-31T04:31:10.835 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11221 fp=#0x20000000e8b' 2024-08-31T04:31:10.835 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11253 fp=#0x20000000e7a' 2024-08-31T04:31:10.836 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11285 fp=#0x20000000e88' 2024-08-31T04:31:10.836 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11317 fp=#0x200000019ae' 2024-08-31T04:31:10.837 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11349 fp=#0x200000019ba' 2024-08-31T04:31:10.837 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11381 fp=#0x20000001989' 2024-08-31T04:31:10.837 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11413 fp=#0x20000001e6b' 2024-08-31T04:31:10.838 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11445 fp=#0x20000001ea0' 2024-08-31T04:31:10.838 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11477 fp=#0x20000001e30' 2024-08-31T04:31:10.838 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11509 fp=#0x2000000197c' 2024-08-31T04:31:10.838 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11541 fp=#0x10000004658' 2024-08-31T04:31:10.839 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11573 fp=#0x10000004660' 2024-08-31T04:31:10.839 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11605 fp=#0x100000045cb' 2024-08-31T04:31:10.839 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11637 fp=#0x200000006c4' 2024-08-31T04:31:10.840 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11733 fp=#0x2000000064d' 2024-08-31T04:31:10.841 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11765 fp=#0x2000000067e' 2024-08-31T04:31:10.841 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11829 fp=#0x20000000693' 2024-08-31T04:31:10.841 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11861 fp=#0x200000022f3' 2024-08-31T04:31:10.842 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11893 fp=#0x20000000ac2' 2024-08-31T04:31:10.842 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11925 fp=#0x20000000a74' 2024-08-31T04:31:10.842 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11957 fp=#0x20000000a9b' 2024-08-31T04:31:10.843 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11989 fp=#0x20000000a8e' 2024-08-31T04:31:10.843 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12021 fp=#0x200000016f3' 2024-08-31T04:31:10.843 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12053 fp=#0x200000016b9' 2024-08-31T04:31:10.844 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12085 fp=#0x200000016a7' 2024-08-31T04:31:10.845 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12213 fp=#0x20000001fcb' 2024-08-31T04:31:10.845 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12245 fp=#0x200000014eb' 2024-08-31T04:31:10.845 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12309 fp=#0x200000014e6' 2024-08-31T04:31:10.846 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12373 fp=#0x2000000108d' 2024-08-31T04:31:10.846 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12405 fp=#0x20000001040' 2024-08-31T04:31:10.847 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12469 fp=#0x20000001f08' 2024-08-31T04:31:10.847 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12501 fp=#0x20000001e90' 2024-08-31T04:31:10.848 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12533 fp=#0x200000009f2' 2024-08-31T04:31:10.848 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12565 fp=#0x20000000a3f' 2024-08-31T04:31:10.848 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12597 fp=#0x200000009e9' 2024-08-31T04:31:10.849 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12629 fp=#0x20000000a2d' 2024-08-31T04:31:10.849 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12661 fp=#0x200000009f8' 2024-08-31T04:31:10.849 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12693 fp=#0x2000000077d' 2024-08-31T04:31:10.850 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12725 fp=#0x200000003cd' 2024-08-31T04:31:10.850 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12757 fp=#0x20000000001' 2024-08-31T04:31:10.850 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12789 fp=#0x10000000e08' 2024-08-31T04:31:10.851 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12821 fp=#0x200000003b4' 2024-08-31T04:31:10.851 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12853 fp=#0x10000002f39' 2024-08-31T04:31:10.851 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12885 fp=#0x10000002f19' 2024-08-31T04:31:10.852 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12949 fp=#0x10000002e80' 2024-08-31T04:31:10.852 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12981 fp=#0x10000002f35' 2024-08-31T04:31:10.853 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13013 fp=#0x10000002ebc' 2024-08-31T04:31:10.853 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13044 fp=#0x200000007a6' 2024-08-31T04:31:10.853 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13076 fp=#0x20000000789' 2024-08-31T04:31:10.854 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13108 fp=#0x2000000071d' 2024-08-31T04:31:10.854 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13140 fp=#0x20000000774' 2024-08-31T04:31:10.854 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13172 fp=#0x20000000749' 2024-08-31T04:31:10.855 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13204 fp=#0x20000000b85' 2024-08-31T04:31:10.855 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13236 fp=#0x20000000b94' 2024-08-31T04:31:10.855 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13268 fp=#0x20000000bf6' 2024-08-31T04:31:10.855 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13300 fp=#0x20000001fdb' 2024-08-31T04:31:10.856 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13332 fp=#0x20000000bd0' 2024-08-31T04:31:10.856 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13364 fp=#0x20000001d87' 2024-08-31T04:31:10.856 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13396 fp=#0x20000001d7c' 2024-08-31T04:31:10.857 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13428 fp=#0x20000001ca0' 2024-08-31T04:31:10.857 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13460 fp=#0x20000001c5d' 2024-08-31T04:31:10.858 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13583 fp=#0x20000001a77' 2024-08-31T04:31:10.859 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13615 fp=#0x200000011a5' 2024-08-31T04:31:10.859 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13647 fp=#0x20000001162' 2024-08-31T04:31:10.859 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13679 fp=#0x10000002e42' 2024-08-31T04:31:10.860 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13711 fp=#0x10000002e52' 2024-08-31T04:31:10.860 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13743 fp=#0x10000002f12' 2024-08-31T04:31:10.860 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13775 fp=#0x10000002e2c' 2024-08-31T04:31:10.860 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13807 fp=#0x20000000804' 2024-08-31T04:31:10.861 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13839 fp=#0x2000000081e' 2024-08-31T04:31:10.861 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13871 fp=#0x20000002201' 2024-08-31T04:31:10.861 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13903 fp=#0x20000002204' 2024-08-31T04:31:10.862 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13935 fp=#0x20000000cdb' 2024-08-31T04:31:10.862 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13967 fp=#0x20000000cd0' 2024-08-31T04:31:10.862 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13999 fp=#0x200000019c6' 2024-08-31T04:31:10.863 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14031 fp=#0x20000001a47' 2024-08-31T04:31:10.863 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14063 fp=#0x20000001a5c' 2024-08-31T04:31:10.864 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14095 fp=#0x200000019d9' 2024-08-31T04:31:10.864 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14127 fp=#0x200000008d8' 2024-08-31T04:31:10.864 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14159 fp=#0x200000008ec' 2024-08-31T04:31:10.865 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14191 fp=#0x200000008ee' 2024-08-31T04:31:10.865 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14223 fp=#0x20000000939' 2024-08-31T04:31:10.866 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14319 fp=#0x20000001dba' 2024-08-31T04:31:10.866 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14351 fp=#0x20000001dac' 2024-08-31T04:31:10.866 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14383 fp=#0x20000001dea' 2024-08-31T04:31:10.867 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14447 fp=#0x20000001940' 2024-08-31T04:31:10.867 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14479 fp=#0x200000018f5' 2024-08-31T04:31:10.868 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14511 fp=#0x2000000191f' 2024-08-31T04:31:10.868 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14543 fp=#0x200000018c4' 2024-08-31T04:31:10.868 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14575 fp=#0x20000000f1c' 2024-08-31T04:31:10.869 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14607 fp=#0x20000000f2b' 2024-08-31T04:31:10.869 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14639 fp=#0x20000000f40' 2024-08-31T04:31:10.869 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14671 fp=#0x20000000f7d' 2024-08-31T04:31:10.870 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14703 fp=#0x20000001df5' 2024-08-31T04:31:10.870 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14735 fp=#0x100000046d0' 2024-08-31T04:31:10.871 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14799 fp=#0x1000000464f' 2024-08-31T04:31:10.871 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14831 fp=#0x2000000107b' 2024-08-31T04:31:10.871 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14845 fp=#0x10000003130' 2024-08-31T04:31:10.872 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14877 fp=#0x200000022a4' 2024-08-31T04:31:10.872 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14909 fp=#0x1000000312e' 2024-08-31T04:31:10.872 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14941 fp=#0x10000003110' 2024-08-31T04:31:10.873 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14973 fp=#0x100000058c7' 2024-08-31T04:31:10.873 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15005 fp=#0x20000001748' 2024-08-31T04:31:10.873 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15037 fp=#0x20000001708' 2024-08-31T04:31:10.874 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15069 fp=#0x200000017a1' 2024-08-31T04:31:10.874 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15101 fp=#0x2000000179f' 2024-08-31T04:31:10.874 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15133 fp=#0x2000000179b' 2024-08-31T04:31:10.875 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15164 fp=#0x100000057c2' 2024-08-31T04:31:10.875 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15196 fp=#0x10000001711' 2024-08-31T04:31:10.875 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15228 fp=#0x10000001745' 2024-08-31T04:31:10.876 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15260 fp=#0x20000002271' 2024-08-31T04:31:10.876 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15292 fp=#0x200000021e2' 2024-08-31T04:31:10.876 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15324 fp=#0x2000000226b' 2024-08-31T04:31:10.877 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15420 fp=#0x20000001cac' 2024-08-31T04:31:10.878 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15484 fp=#0x1000000531c' 2024-08-31T04:31:10.878 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15516 fp=#0x20000001629' 2024-08-31T04:31:10.878 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15548 fp=#0x20000001648' 2024-08-31T04:31:10.879 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15580 fp=#0x2000000163b' 2024-08-31T04:31:10.879 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15612 fp=#0x10000004e58' 2024-08-31T04:31:10.880 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15708 fp=#0x10000004e9b' 2024-08-31T04:31:10.880 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15740 fp=#0x10000004eb1' 2024-08-31T04:31:10.881 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15836 fp=#0x2000000203c' 2024-08-31T04:31:10.881 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15868 fp=#0x20000002022' 2024-08-31T04:31:10.882 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15996 fp=#0x20000001906' 2024-08-31T04:31:10.883 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16028 fp=#0x20000001931' 2024-08-31T04:31:10.883 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16060 fp=#0x200000017d3' 2024-08-31T04:31:10.883 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16092 fp=#0x2000000110b' 2024-08-31T04:31:10.884 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16124 fp=#0x20000001129' 2024-08-31T04:31:10.884 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16156 fp=#0x20000001130' 2024-08-31T04:31:10.884 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16188 fp=#0x2000000160c' 2024-08-31T04:31:10.885 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16220 fp=#0x200000015a3' 2024-08-31T04:31:10.885 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16252 fp=#0x200000015b5' 2024-08-31T04:31:10.885 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16283 fp=#0x1000000488f' 2024-08-31T04:31:10.886 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16315 fp=#0x10000004808' 2024-08-31T04:31:10.886 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16347 fp=#0x100000048a8' 2024-08-31T04:31:10.886 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16379 fp=#0x10000004528' 2024-08-31T04:31:10.887 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16411 fp=#0x100000044f2' 2024-08-31T04:31:10.887 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16443 fp=#0x10000004892' 2024-08-31T04:31:10.887 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16475 fp=#0x100000048e5' 2024-08-31T04:31:10.888 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16507 fp=#0x10000004903' 2024-08-31T04:31:10.888 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16571 fp=#0x100000048db' 2024-08-31T04:31:10.889 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16603 fp=#0x100000048fc' 2024-08-31T04:31:10.889 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16635 fp=#0x20000002290' 2024-08-31T04:31:10.889 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16667 fp=#0x20000002293' 2024-08-31T04:31:10.890 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16699 fp=#0x20000000437' 2024-08-31T04:31:10.890 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16731 fp=#0x20000000410' 2024-08-31T04:31:10.890 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16763 fp=#0x10000002b07' 2024-08-31T04:31:10.891 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16795 fp=#0x10000002aee' 2024-08-31T04:31:10.891 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16827 fp=#0x2000000041a' 2024-08-31T04:31:10.891 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16859 fp=#0x10000004536' 2024-08-31T04:31:10.892 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16891 fp=#0x1000000457c' 2024-08-31T04:31:10.892 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16923 fp=#0x10000004535' 2024-08-31T04:31:10.892 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16955 fp=#0x10000004539' 2024-08-31T04:31:10.893 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16987 fp=#0x10000005d50' 2024-08-31T04:31:10.893 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17019 fp=#0x20000001049' 2024-08-31T04:31:10.894 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17083 fp=#0x1000000572c' 2024-08-31T04:31:10.895 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17243 fp=#0x100000054d7' 2024-08-31T04:31:10.896 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17307 fp=#0x10000005467' 2024-08-31T04:31:10.896 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17339 fp=#0x100000054d1' 2024-08-31T04:31:10.896 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17371 fp=#0x20000001a7d' 2024-08-31T04:31:10.897 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17403 fp=#0x20000001a95' 2024-08-31T04:31:10.897 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17435 fp=#0x20000001a64' 2024-08-31T04:31:10.897 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17467 fp=#0x10000004dd1' 2024-08-31T04:31:10.898 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17499 fp=#0x10000004da2' 2024-08-31T04:31:10.898 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17531 fp=#0x20000001fc1' 2024-08-31T04:31:10.898 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17563 fp=#0x20000001b1d' 2024-08-31T04:31:10.898 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17595 fp=#0x20000001b71' 2024-08-31T04:31:10.899 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17627 fp=#0x20000001f56' 2024-08-31T04:31:10.899 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17659 fp=#0x20000001f63' 2024-08-31T04:31:10.899 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17691 fp=#0x20000001f0c' 2024-08-31T04:31:10.900 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17723 fp=#0x20000001f34' 2024-08-31T04:31:10.900 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17755 fp=#0x10000004ed6' 2024-08-31T04:31:10.900 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17787 fp=#0x10000004edd' 2024-08-31T04:31:10.901 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17819 fp=#0x10000004f41' 2024-08-31T04:31:10.901 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17883 fp=#0x10000001abc' 2024-08-31T04:31:10.902 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17915 fp=#0x1000000113d' 2024-08-31T04:31:10.902 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17979 fp=#0x20000001c18' 2024-08-31T04:31:10.903 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18011 fp=#0x20000001c00' 2024-08-31T04:31:10.903 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18043 fp=#0x20000001c2c' 2024-08-31T04:31:10.903 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18075 fp=#0x2000000177f' 2024-08-31T04:31:10.904 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18107 fp=#0x2000000171f' 2024-08-31T04:31:10.904 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18139 fp=#0x20000001770' 2024-08-31T04:31:10.904 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18171 fp=#0x20000000c28' 2024-08-31T04:31:10.905 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18203 fp=#0x20000000c9a' 2024-08-31T04:31:10.905 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18235 fp=#0x200000018d1' 2024-08-31T04:31:10.906 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18328 fp=#0x20000000858' 2024-08-31T04:31:10.906 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18387 fp=#0x20000002228' 2024-08-31T04:31:10.907 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18419 fp=#0x20000002192' 2024-08-31T04:31:10.907 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18451 fp=#0x20000002256' 2024-08-31T04:31:10.907 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18483 fp=#0x20000002169' 2024-08-31T04:31:10.908 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18515 fp=#0x20000002188' 2024-08-31T04:31:10.908 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18545 fp=#0x40000001a01' 2024-08-31T04:31:10.908 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18577 fp=#0x1000000370d' 2024-08-31T04:31:10.909 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:7172 fp=#0x100000045c0' 2024-08-31T04:31:10.909 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:7204 fp=#0x20000001201' 2024-08-31T04:31:10.909 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:7236 fp=#0x10000003082' 2024-08-31T04:31:10.910 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:7268 fp=#0x1000000579a' 2024-08-31T04:31:10.910 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:7300 fp=#0x20000000c0a' 2024-08-31T04:31:10.911 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:7396 fp=#0x20000002008' 2024-08-31T04:31:10.911 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:7428 fp=#0x20000001f9c' 2024-08-31T04:31:10.912 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:7492 fp=#0x20000001fa1' 2024-08-31T04:31:10.921 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:8740 fp=#0x20000000ad8' 2024-08-31T04:31:10.923 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:8923 fp=#0x20000000652' 2024-08-31T04:31:10.924 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:8987 fp=#0x200000018db' 2024-08-31T04:31:10.924 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9019 fp=#0x20000000fe3' 2024-08-31T04:31:10.924 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9051 fp=#0x20000000f76' 2024-08-31T04:31:10.925 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9083 fp=#0x20000000fb8' 2024-08-31T04:31:10.925 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9115 fp=#0x20000001c6e' 2024-08-31T04:31:10.925 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9147 fp=#0x20000001cbf' 2024-08-31T04:31:10.926 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9179 fp=#0x20000001d1b' 2024-08-31T04:31:10.926 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9211 fp=#0x20000000891' 2024-08-31T04:31:10.926 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9243 fp=#0x20000000878' 2024-08-31T04:31:10.927 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9275 fp=#0x20000001adb' 2024-08-31T04:31:10.928 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9403 fp=#0x20000000977' 2024-08-31T04:31:10.928 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9435 fp=#0x200000009cd' 2024-08-31T04:31:10.928 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9467 fp=#0x2000000154c' 2024-08-31T04:31:10.929 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9499 fp=#0x20000000995' 2024-08-31T04:31:10.929 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9531 fp=#0x2000000097b' 2024-08-31T04:31:10.929 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9563 fp=#0x20000001582' 2024-08-31T04:31:10.930 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9595 fp=#0x20000001861' 2024-08-31T04:31:10.930 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9691 fp=#0x20000001f73' 2024-08-31T04:31:10.931 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9723 fp=#0x20000000b12' 2024-08-31T04:31:10.931 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9755 fp=#0x20000000b22' 2024-08-31T04:31:10.932 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9787 fp=#0x20000000b43' 2024-08-31T04:31:10.932 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9819 fp=#0x20000001ed1' 2024-08-31T04:31:10.932 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9851 fp=#0x20000001e33' 2024-08-31T04:31:10.932 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9883 fp=#0x20000001dfc' 2024-08-31T04:31:10.933 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9915 fp=#0x20000001e50' 2024-08-31T04:31:10.934 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10042 fp=#0x20000000e2a' 2024-08-31T04:31:10.934 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10074 fp=#0x20000000dbc' 2024-08-31T04:31:10.934 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10106 fp=#0x20000000de6' 2024-08-31T04:31:10.935 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10138 fp=#0x20000000d56' 2024-08-31T04:31:10.935 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10170 fp=#0x20000000d6a' 2024-08-31T04:31:10.935 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10202 fp=#0x200000006f7' 2024-08-31T04:31:10.935 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10234 fp=#0x20000001064' 2024-08-31T04:31:10.936 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10266 fp=#0x20000001003' 2024-08-31T04:31:10.936 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10298 fp=#0x20000000ae1' 2024-08-31T04:31:10.936 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10330 fp=#0x20000000938' 2024-08-31T04:31:10.937 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10362 fp=#0x2000000091e' 2024-08-31T04:31:10.937 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10426 fp=#0x200000014aa' 2024-08-31T04:31:10.938 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10490 fp=#0x10000000b69' 2024-08-31T04:31:10.938 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10522 fp=#0x10000003c7c' 2024-08-31T04:31:10.939 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10554 fp=#0x10000000ba9' 2024-08-31T04:31:10.939 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10586 fp=#0x10000003c7f' 2024-08-31T04:31:10.939 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10618 fp=#0x20000002091' 2024-08-31T04:31:10.939 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10650 fp=#0x2000000207d' 2024-08-31T04:31:10.940 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10682 fp=#0x200000020a5' 2024-08-31T04:31:10.941 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10810 fp=#0x200000005e0' 2024-08-31T04:31:10.941 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10842 fp=#0x200000005f6' 2024-08-31T04:31:10.941 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10874 fp=#0x100000033e7' 2024-08-31T04:31:10.942 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10906 fp=#0x1000000348b' 2024-08-31T04:31:10.942 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10938 fp=#0x200000005e6' 2024-08-31T04:31:10.942 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10970 fp=#0x100000033f5' 2024-08-31T04:31:10.943 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11002 fp=#0x10000003c26' 2024-08-31T04:31:10.943 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11066 fp=#0x10000003dd5' 2024-08-31T04:31:10.943 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11098 fp=#0x10000003d2f' 2024-08-31T04:31:10.944 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11162 fp=#0x100000039a8' 2024-08-31T04:31:10.944 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11194 fp=#0x100000039a6' 2024-08-31T04:31:10.945 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11222 fp=#0x20000000e4f' 2024-08-31T04:31:10.945 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11254 fp=#0x20000000e3b' 2024-08-31T04:31:10.945 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11286 fp=#0x20000000e77' 2024-08-31T04:31:10.946 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11318 fp=#0x20000001e60' 2024-08-31T04:31:10.946 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11350 fp=#0x20000001eda' 2024-08-31T04:31:10.946 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11382 fp=#0x2000000194d' 2024-08-31T04:31:10.947 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11414 fp=#0x20000001e46' 2024-08-31T04:31:10.947 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11446 fp=#0x20000001e40' 2024-08-31T04:31:10.947 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11478 fp=#0x20000001e57' 2024-08-31T04:31:10.948 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11510 fp=#0x20000001eb2' 2024-08-31T04:31:10.948 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11542 fp=#0x10000004656' 2024-08-31T04:31:10.948 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11574 fp=#0x100000045fb' 2024-08-31T04:31:10.949 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11606 fp=#0x100000045ad' 2024-08-31T04:31:10.949 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11638 fp=#0x2000000067b' 2024-08-31T04:31:10.949 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11670 fp=#0x2000000212c' 2024-08-31T04:31:10.949 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11702 fp=#0x200000006a4' 2024-08-31T04:31:10.950 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11734 fp=#0x20000001996' 2024-08-31T04:31:10.950 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11766 fp=#0x20000002147' 2024-08-31T04:31:10.950 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11798 fp=#0x20000000641' 2024-08-31T04:31:10.951 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11830 fp=#0x200000006ad' 2024-08-31T04:31:10.951 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11862 fp=#0x200000022d2' 2024-08-31T04:31:10.951 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11894 fp=#0x20000001635' 2024-08-31T04:31:10.952 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11926 fp=#0x200000011be' 2024-08-31T04:31:10.952 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11958 fp=#0x20000000a86' 2024-08-31T04:31:10.952 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11990 fp=#0x20000000aa3' 2024-08-31T04:31:10.953 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12022 fp=#0x200000016e2' 2024-08-31T04:31:10.953 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12054 fp=#0x20000001695' 2024-08-31T04:31:10.953 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12086 fp=#0x200000016dd' 2024-08-31T04:31:10.954 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12150 fp=#0x20000001519' 2024-08-31T04:31:10.955 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12278 fp=#0x20000001505' 2024-08-31T04:31:10.955 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12310 fp=#0x200000014fa' 2024-08-31T04:31:10.956 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12374 fp=#0x200000010b2' 2024-08-31T04:31:10.956 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12406 fp=#0x200000010cf' 2024-08-31T04:31:10.956 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12438 fp=#0x200000010ca' 2024-08-31T04:31:10.957 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12470 fp=#0x20000001ee4' 2024-08-31T04:31:10.957 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12502 fp=#0x20000001ebc' 2024-08-31T04:31:10.957 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12534 fp=#0x20000000a24' 2024-08-31T04:31:10.958 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12566 fp=#0x20000000a31' 2024-08-31T04:31:10.958 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12598 fp=#0x200000009fe' 2024-08-31T04:31:10.958 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12630 fp=#0x20000000a28' 2024-08-31T04:31:10.958 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12662 fp=#0x200000009e1' 2024-08-31T04:31:10.959 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12694 fp=#0x10000000ef7' 2024-08-31T04:31:10.959 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12726 fp=#0x10000000dd9' 2024-08-31T04:31:10.959 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12758 fp=#0x10000000dca' 2024-08-31T04:31:10.960 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12790 fp=#0x200000003ee' 2024-08-31T04:31:10.960 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12822 fp=#0x10000000eff' 2024-08-31T04:31:10.960 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12854 fp=#0x10000002ead' 2024-08-31T04:31:10.961 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12886 fp=#0x10000002f3a' 2024-08-31T04:31:10.961 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12918 fp=#0x20000002157' 2024-08-31T04:31:10.961 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12950 fp=#0x20000002122' 2024-08-31T04:31:10.962 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12982 fp=#0x10000002e7e' 2024-08-31T04:31:10.962 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13045 fp=#0x20000000703' 2024-08-31T04:31:10.963 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13077 fp=#0x2000000076c' 2024-08-31T04:31:10.963 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13109 fp=#0x20000000722' 2024-08-31T04:31:10.963 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13141 fp=#0x20000000729' 2024-08-31T04:31:10.964 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13173 fp=#0x2000000078f' 2024-08-31T04:31:10.964 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13205 fp=#0x20000000be8' 2024-08-31T04:31:10.964 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13237 fp=#0x20000000be3' 2024-08-31T04:31:10.965 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13269 fp=#0x20000000bc9' 2024-08-31T04:31:10.965 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13301 fp=#0x20000000bb9' 2024-08-31T04:31:10.965 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13333 fp=#0x20000000b84' 2024-08-31T04:31:10.966 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13365 fp=#0x20000001d8f' 2024-08-31T04:31:10.966 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13397 fp=#0x20000001cd4' 2024-08-31T04:31:10.966 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13429 fp=#0x20000001c31' 2024-08-31T04:31:10.967 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13461 fp=#0x20000001cbb' 2024-08-31T04:31:10.967 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13493 fp=#0x10000003aed' 2024-08-31T04:31:10.970 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13584 fp=#0x2000000211a' 2024-08-31T04:31:10.971 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13680 fp=#0x10000002e29' 2024-08-31T04:31:10.971 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13712 fp=#0x10000002e8a' 2024-08-31T04:31:10.971 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13744 fp=#0x10000002e90' 2024-08-31T04:31:10.972 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13776 fp=#0x10000002f3e' 2024-08-31T04:31:10.972 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13808 fp=#0x200000015e8' 2024-08-31T04:31:10.972 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13840 fp=#0x200000015d5' 2024-08-31T04:31:10.973 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13872 fp=#0x20000000db5' 2024-08-31T04:31:10.973 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13904 fp=#0x20000000d08' 2024-08-31T04:31:10.973 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13936 fp=#0x20000002206' 2024-08-31T04:31:10.974 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13968 fp=#0x20000000d72' 2024-08-31T04:31:10.974 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14000 fp=#0x20000001a52' 2024-08-31T04:31:10.974 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14032 fp=#0x20000001a37' 2024-08-31T04:31:10.975 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14064 fp=#0x20000001a54' 2024-08-31T04:31:10.975 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14096 fp=#0x20000001a41' 2024-08-31T04:31:10.975 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14128 fp=#0x20000000952' 2024-08-31T04:31:10.976 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14160 fp=#0x200000008f8' 2024-08-31T04:31:10.976 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14192 fp=#0x200000008d1' 2024-08-31T04:31:10.976 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14224 fp=#0x200000008d0' 2024-08-31T04:31:10.977 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14288 fp=#0x20000001dd9' 2024-08-31T04:31:10.977 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14320 fp=#0x20000001e48' 2024-08-31T04:31:10.978 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14448 fp=#0x2000000184f' 2024-08-31T04:31:10.980 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14480 fp=#0x20000001806' 2024-08-31T04:31:10.980 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14512 fp=#0x200000018c6' 2024-08-31T04:31:10.980 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14544 fp=#0x20000000f22' 2024-08-31T04:31:10.981 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14576 fp=#0x20000000f1f' 2024-08-31T04:31:10.981 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14608 fp=#0x20000000f6a' 2024-08-31T04:31:10.981 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14640 fp=#0x20000000f21' 2024-08-31T04:31:10.981 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14672 fp=#0x20000000f96' 2024-08-31T04:31:10.982 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14704 fp=#0x20000000f1b' 2024-08-31T04:31:10.982 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14736 fp=#0x10000004651' 2024-08-31T04:31:10.983 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14846 fp=#0x100000031df' 2024-08-31T04:31:10.983 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14878 fp=#0x100000031b8' 2024-08-31T04:31:10.984 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14910 fp=#0x1000000317b' 2024-08-31T04:31:10.984 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14942 fp=#0x10000003156' 2024-08-31T04:31:10.984 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14974 fp=#0x100000058b6' 2024-08-31T04:31:10.985 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15006 fp=#0x20000001740' 2024-08-31T04:31:10.985 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15038 fp=#0x200000017b6' 2024-08-31T04:31:10.985 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15070 fp=#0x20000001792' 2024-08-31T04:31:10.986 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15102 fp=#0x200000017ac' 2024-08-31T04:31:10.986 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15134 fp=#0x200000017c9' 2024-08-31T04:31:10.986 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15165 fp=#0x200000010c9' 2024-08-31T04:31:10.987 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15197 fp=#0x10000001797' 2024-08-31T04:31:10.987 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15229 fp=#0x1000000171f' 2024-08-31T04:31:10.987 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15261 fp=#0x200000021dc' 2024-08-31T04:31:10.988 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15293 fp=#0x200000021ff' 2024-08-31T04:31:10.988 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15325 fp=#0x2000000223a' 2024-08-31T04:31:10.988 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15357 fp=#0x20000002284' 2024-08-31T04:31:10.989 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15421 fp=#0x20000002080' 2024-08-31T04:31:10.989 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15453 fp=#0x20000001cc1' 2024-08-31T04:31:10.990 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15485 fp=#0x10000005318' 2024-08-31T04:31:10.990 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15517 fp=#0x10000005330' 2024-08-31T04:31:10.990 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15549 fp=#0x20000001a3a' 2024-08-31T04:31:10.991 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15581 fp=#0x20000001a40' 2024-08-31T04:31:10.991 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15613 fp=#0x10000004ec0' 2024-08-31T04:31:10.991 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15645 fp=#0x10000004eac' 2024-08-31T04:31:10.992 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15677 fp=#0x10000004ea0' 2024-08-31T04:31:10.992 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15709 fp=#0x10000004ea4' 2024-08-31T04:31:10.992 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15741 fp=#0x10000004e9e' 2024-08-31T04:31:10.993 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15869 fp=#0x100000034e8' 2024-08-31T04:31:10.994 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15965 fp=#0x10000001773' 2024-08-31T04:31:10.995 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15997 fp=#0x20000000ebe' 2024-08-31T04:31:10.995 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16029 fp=#0x20000001a7c' 2024-08-31T04:31:10.995 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16061 fp=#0x20000000eab' 2024-08-31T04:31:10.995 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16093 fp=#0x200000011a2' 2024-08-31T04:31:10.996 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16125 fp=#0x20000001121' 2024-08-31T04:31:10.996 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16157 fp=#0x2000000110c' 2024-08-31T04:31:10.996 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16189 fp=#0x2000000160b' 2024-08-31T04:31:10.997 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16221 fp=#0x200000015ad' 2024-08-31T04:31:10.997 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16253 fp=#0x200000015a8' 2024-08-31T04:31:10.997 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16284 fp=#0x100000044f0' 2024-08-31T04:31:10.998 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16316 fp=#0x1000000450e' 2024-08-31T04:31:10.998 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16348 fp=#0x10000004505' 2024-08-31T04:31:10.998 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16380 fp=#0x10000004506' 2024-08-31T04:31:10.999 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16412 fp=#0x100000044e5' 2024-08-31T04:31:10.999 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16444 fp=#0x100000044e6' 2024-08-31T04:31:10.999 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16508 fp=#0x100000048e9' 2024-08-31T04:31:11.000 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16540 fp=#0x10000004981' 2024-08-31T04:31:11.000 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16572 fp=#0x10000004dfa' 2024-08-31T04:31:11.000 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16604 fp=#0x10000004911' 2024-08-31T04:31:11.001 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16636 fp=#0x200000022ae' 2024-08-31T04:31:11.001 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16668 fp=#0x10000002af2' 2024-08-31T04:31:11.001 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16700 fp=#0x10000002ad2' 2024-08-31T04:31:11.002 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16732 fp=#0x20000000408' 2024-08-31T04:31:11.002 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16764 fp=#0x2000000041b' 2024-08-31T04:31:11.002 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16796 fp=#0x10000002a8e' 2024-08-31T04:31:11.003 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16828 fp=#0x10000002a62' 2024-08-31T04:31:11.003 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16860 fp=#0x10000005d3f' 2024-08-31T04:31:11.003 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16892 fp=#0x10000005d45' 2024-08-31T04:31:11.004 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16924 fp=#0x200000011ad' 2024-08-31T04:31:11.004 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16956 fp=#0x10000004567' 2024-08-31T04:31:11.004 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16988 fp=#0x10000004553' 2024-08-31T04:31:11.005 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17084 fp=#0x10000005787' 2024-08-31T04:31:11.005 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17116 fp=#0x10000005781' 2024-08-31T04:31:11.006 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17148 fp=#0x10000005728' 2024-08-31T04:31:11.006 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17180 fp=#0x1000000572b' 2024-08-31T04:31:11.006 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17212 fp=#0x10000005464' 2024-08-31T04:31:11.007 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17244 fp=#0x1000000546d' 2024-08-31T04:31:11.008 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17372 fp=#0x20000001ab4' 2024-08-31T04:31:11.008 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17404 fp=#0x20000001a8f' 2024-08-31T04:31:11.008 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17436 fp=#0x20000001a6e' 2024-08-31T04:31:11.009 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17468 fp=#0x10000004e13' 2024-08-31T04:31:11.009 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17500 fp=#0x10000004e30' 2024-08-31T04:31:11.009 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17532 fp=#0x20000001b14' 2024-08-31T04:31:11.010 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17564 fp=#0x20000001b33' 2024-08-31T04:31:11.010 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17596 fp=#0x20000001b4d' 2024-08-31T04:31:11.010 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17628 fp=#0x100000029fc' 2024-08-31T04:31:11.011 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17660 fp=#0x10000002a03' 2024-08-31T04:31:11.011 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17692 fp=#0x100000029cd' 2024-08-31T04:31:11.011 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17724 fp=#0x20000001f40' 2024-08-31T04:31:11.012 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17756 fp=#0x10000004f4e' 2024-08-31T04:31:11.012 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17788 fp=#0x10000004ee6' 2024-08-31T04:31:11.012 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17820 fp=#0x10000004f0a' 2024-08-31T04:31:11.013 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17852 fp=#0x1000000530c' 2024-08-31T04:31:11.013 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17948 fp=#0x1000000530b' 2024-08-31T04:31:11.014 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17980 fp=#0x20000001d4c' 2024-08-31T04:31:11.014 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18012 fp=#0x20000001bff' 2024-08-31T04:31:11.014 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18044 fp=#0x20000001c20' 2024-08-31T04:31:11.015 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18076 fp=#0x200000016ee' 2024-08-31T04:31:11.015 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18108 fp=#0x20000001791' 2024-08-31T04:31:11.015 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18140 fp=#0x20000001733' 2024-08-31T04:31:11.016 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18172 fp=#0x20000000c4d' 2024-08-31T04:31:11.016 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18204 fp=#0x20000000c31' 2024-08-31T04:31:11.016 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18236 fp=#0x20000000c6c' 2024-08-31T04:31:11.017 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18297 fp=#0x1000000494d' 2024-08-31T04:31:11.017 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18329 fp=#0x20000000ade' 2024-08-31T04:31:11.018 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18361 fp=#0x10000004934' 2024-08-31T04:31:11.018 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18388 fp=#0x20000002187' 2024-08-31T04:31:11.018 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18420 fp=#0x200000021e0' 2024-08-31T04:31:11.019 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18452 fp=#0x200000021b4' 2024-08-31T04:31:11.019 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18484 fp=#0x20000002195' 2024-08-31T04:31:11.019 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18516 fp=#0x2000000219f' 2024-08-31T04:31:11.020 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18546 fp=#0x50000000399' 2024-08-31T04:31:11.020 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18578 fp=#0x10000003684' 2024-08-31T04:31:11.020 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:7173 fp=#0x2000000183b' 2024-08-31T04:31:11.021 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:7205 fp=#0x20000001035' 2024-08-31T04:31:11.021 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:7269 fp=#0x100000016f7' 2024-08-31T04:31:11.022 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:7365 fp=#0x2000000202e' 2024-08-31T04:31:11.023 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:7429 fp=#0x20000001f89' 2024-08-31T04:31:11.023 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:7461 fp=#0x20000002027' 2024-08-31T04:31:11.024 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:7525 fp=#0x20000001f81' 2024-08-31T04:31:11.024 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:7557 fp=#0x20000002020' 2024-08-31T04:31:11.032 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:8613 fp=#0x20000000ad6' 2024-08-31T04:31:11.034 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:8924 fp=#0x20000000627' 2024-08-31T04:31:11.034 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:8956 fp=#0x20000000647' 2024-08-31T04:31:11.035 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:8988 fp=#0x20000001845' 2024-08-31T04:31:11.036 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9116 fp=#0x20000000896' 2024-08-31T04:31:11.036 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9148 fp=#0x20000000895' 2024-08-31T04:31:11.036 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9180 fp=#0x20000001d7b' 2024-08-31T04:31:11.037 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9212 fp=#0x20000001d00' 2024-08-31T04:31:11.037 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9244 fp=#0x20000001d4a' 2024-08-31T04:31:11.038 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9372 fp=#0x20000000968' 2024-08-31T04:31:11.038 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9404 fp=#0x200000009cf' 2024-08-31T04:31:11.039 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9436 fp=#0x200000009bb' 2024-08-31T04:31:11.039 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9468 fp=#0x20000001587' 2024-08-31T04:31:11.039 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9500 fp=#0x200000009a5' 2024-08-31T04:31:11.040 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9532 fp=#0x200000009b7' 2024-08-31T04:31:11.040 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9564 fp=#0x2000000155d' 2024-08-31T04:31:11.040 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9596 fp=#0x2000000187a' 2024-08-31T04:31:11.041 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9628 fp=#0x200000018bb' 2024-08-31T04:31:11.041 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9660 fp=#0x20000001866' 2024-08-31T04:31:11.041 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9692 fp=#0x20000001f6a' 2024-08-31T04:31:11.041 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9724 fp=#0x20000001f70' 2024-08-31T04:31:11.042 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9756 fp=#0x20000000b39' 2024-08-31T04:31:11.042 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9788 fp=#0x20000000b05' 2024-08-31T04:31:11.042 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9820 fp=#0x20000001e75' 2024-08-31T04:31:11.043 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9852 fp=#0x20000001eac' 2024-08-31T04:31:11.043 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9884 fp=#0x20000001e80' 2024-08-31T04:31:11.043 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9916 fp=#0x20000001e31' 2024-08-31T04:31:11.044 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10043 fp=#0x20000000e25' 2024-08-31T04:31:11.045 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10075 fp=#0x20000000e1f' 2024-08-31T04:31:11.045 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10107 fp=#0x20000000d41' 2024-08-31T04:31:11.045 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10139 fp=#0x20000000e21' 2024-08-31T04:31:11.046 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10171 fp=#0x20000000e1c' 2024-08-31T04:31:11.046 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10203 fp=#0x20000000704' 2024-08-31T04:31:11.046 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10235 fp=#0x20000000ff6' 2024-08-31T04:31:11.047 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10267 fp=#0x200000006df' 2024-08-31T04:31:11.047 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10299 fp=#0x20000000fcc' 2024-08-31T04:31:11.047 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10331 fp=#0x20000001506' 2024-08-31T04:31:11.048 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10395 fp=#0x20000001507' 2024-08-31T04:31:11.048 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10459 fp=#0x200000014c7' 2024-08-31T04:31:11.049 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10491 fp=#0x10000000b75' 2024-08-31T04:31:11.049 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10523 fp=#0x10000003cce' 2024-08-31T04:31:11.049 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10555 fp=#0x10000003cb0' 2024-08-31T04:31:11.050 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10587 fp=#0x1000000116c' 2024-08-31T04:31:11.050 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10619 fp=#0x20000002089' 2024-08-31T04:31:11.050 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10651 fp=#0x200000020be' 2024-08-31T04:31:11.051 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10683 fp=#0x200000020eb' 2024-08-31T04:31:11.052 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10811 fp=#0x20000000743' 2024-08-31T04:31:11.052 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10843 fp=#0x200000005ff' 2024-08-31T04:31:11.052 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10875 fp=#0x10000003415' 2024-08-31T04:31:11.053 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10907 fp=#0x10000003417' 2024-08-31T04:31:11.053 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10939 fp=#0x100000033e9' 2024-08-31T04:31:11.053 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10971 fp=#0x1000000340f' 2024-08-31T04:31:11.054 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11003 fp=#0x100000039d1' 2024-08-31T04:31:11.054 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11035 fp=#0x2000000061a' 2024-08-31T04:31:11.055 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11067 fp=#0x1000000397b' 2024-08-31T04:31:11.055 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11131 fp=#0x100000039e9' 2024-08-31T04:31:11.055 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11163 fp=#0x10000003cd5' 2024-08-31T04:31:11.056 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11195 fp=#0x100000039f1' 2024-08-31T04:31:11.056 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11223 fp=#0x20000000e67' 2024-08-31T04:31:11.057 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11255 fp=#0x20000000e96' 2024-08-31T04:31:11.057 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11287 fp=#0x20000000e72' 2024-08-31T04:31:11.057 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11319 fp=#0x200000019a8' 2024-08-31T04:31:11.058 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11351 fp=#0x2000000196d' 2024-08-31T04:31:11.058 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11383 fp=#0x20000001e11' 2024-08-31T04:31:11.058 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11415 fp=#0x20000001ef3' 2024-08-31T04:31:11.059 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11447 fp=#0x20000001921' 2024-08-31T04:31:11.059 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11479 fp=#0x20000001e20' 2024-08-31T04:31:11.059 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11511 fp=#0x20000001f00' 2024-08-31T04:31:11.060 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11543 fp=#0x10000004666' 2024-08-31T04:31:11.060 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11575 fp=#0x10000004591' 2024-08-31T04:31:11.060 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11607 fp=#0x1000000463f' 2024-08-31T04:31:11.061 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11639 fp=#0x20000001982' 2024-08-31T04:31:11.061 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11703 fp=#0x2000000069b' 2024-08-31T04:31:11.062 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11735 fp=#0x2000000066f' 2024-08-31T04:31:11.062 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11799 fp=#0x20000002153' 2024-08-31T04:31:11.062 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11831 fp=#0x200000006b8' 2024-08-31T04:31:11.063 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11863 fp=#0x200000022d7' 2024-08-31T04:31:11.063 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11895 fp=#0x20000000a96' 2024-08-31T04:31:11.063 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11927 fp=#0x20000000abe' 2024-08-31T04:31:11.064 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11959 fp=#0x20000000a79' 2024-08-31T04:31:11.064 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11991 fp=#0x20000001696' 2024-08-31T04:31:11.064 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12023 fp=#0x200000016d0' 2024-08-31T04:31:11.065 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12055 fp=#0x200000016db' 2024-08-31T04:31:11.065 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12087 fp=#0x20000001691' 2024-08-31T04:31:11.066 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12183 fp=#0x200000014cc' 2024-08-31T04:31:11.066 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12215 fp=#0x20000001fb8' 2024-08-31T04:31:11.067 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12247 fp=#0x2000000151c' 2024-08-31T04:31:11.068 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12375 fp=#0x200000010cd' 2024-08-31T04:31:11.068 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12407 fp=#0x2000000107e' 2024-08-31T04:31:11.069 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12439 fp=#0x2000000105e' 2024-08-31T04:31:11.069 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12471 fp=#0x20000001e8e' 2024-08-31T04:31:11.069 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12503 fp=#0x20000001f2f' 2024-08-31T04:31:11.070 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12535 fp=#0x20000000a6a' 2024-08-31T04:31:11.070 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12567 fp=#0x20000000a4e' 2024-08-31T04:31:11.070 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12599 fp=#0x20000000a03' 2024-08-31T04:31:11.071 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12631 fp=#0x20000000a02' 2024-08-31T04:31:11.071 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12663 fp=#0x200000009ed' 2024-08-31T04:31:11.071 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12695 fp=#0x10000000cf1' 2024-08-31T04:31:11.072 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12727 fp=#0x10000000f52' 2024-08-31T04:31:11.072 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12759 fp=#0x20000000221' 2024-08-31T04:31:11.072 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12791 fp=#0x20000000589' 2024-08-31T04:31:11.073 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12823 fp=#0x200000003bf' 2024-08-31T04:31:11.073 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12855 fp=#0x20000002160' 2024-08-31T04:31:11.073 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12887 fp=#0x10000003404' 2024-08-31T04:31:11.074 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12919 fp=#0x200000020de' 2024-08-31T04:31:11.074 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12951 fp=#0x20000002137' 2024-08-31T04:31:11.074 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12983 fp=#0x200000020d4' 2024-08-31T04:31:11.075 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13015 fp=#0x20000002132' 2024-08-31T04:31:11.075 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13046 fp=#0x2000000071a' 2024-08-31T04:31:11.075 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13078 fp=#0x2000000078c' 2024-08-31T04:31:11.076 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13110 fp=#0x2000000073b' 2024-08-31T04:31:11.076 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13142 fp=#0x2000000076e' 2024-08-31T04:31:11.076 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13174 fp=#0x20000000788' 2024-08-31T04:31:11.077 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13206 fp=#0x20000000b64' 2024-08-31T04:31:11.077 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13238 fp=#0x20000000bda' 2024-08-31T04:31:11.077 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13270 fp=#0x20000000bc1' 2024-08-31T04:31:11.078 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13302 fp=#0x20000000bab' 2024-08-31T04:31:11.078 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13334 fp=#0x20000000be7' 2024-08-31T04:31:11.078 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13366 fp=#0x20000001c61' 2024-08-31T04:31:11.079 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13398 fp=#0x20000001cfb' 2024-08-31T04:31:11.079 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13430 fp=#0x20000001c9d' 2024-08-31T04:31:11.079 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13462 fp=#0x20000001cc7' 2024-08-31T04:31:11.080 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13494 fp=#0x10000003b7f' 2024-08-31T04:31:11.080 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13553 fp=#0x2000000210b' 2024-08-31T04:31:11.081 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13585 fp=#0x20000001150' 2024-08-31T04:31:11.081 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13617 fp=#0x20000001164' 2024-08-31T04:31:11.081 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13649 fp=#0x20000001189' 2024-08-31T04:31:11.082 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13713 fp=#0x10000002e3d' 2024-08-31T04:31:11.082 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13745 fp=#0x10000002e74' 2024-08-31T04:31:11.083 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13777 fp=#0x10000002e21' 2024-08-31T04:31:11.083 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13809 fp=#0x20000000811' 2024-08-31T04:31:11.083 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13841 fp=#0x200000015c6' 2024-08-31T04:31:11.083 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13873 fp=#0x20000000dcd' 2024-08-31T04:31:11.084 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13905 fp=#0x2000000225f' 2024-08-31T04:31:11.084 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13937 fp=#0x2000000221a' 2024-08-31T04:31:11.084 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13969 fp=#0x20000000d04' 2024-08-31T04:31:11.085 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14001 fp=#0x20000001a4d' 2024-08-31T04:31:11.085 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14033 fp=#0x20000001a0b' 2024-08-31T04:31:11.085 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14065 fp=#0x20000001a0e' 2024-08-31T04:31:11.086 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14097 fp=#0x200000019fd' 2024-08-31T04:31:11.086 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14129 fp=#0x2000000090b' 2024-08-31T04:31:11.086 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14161 fp=#0x200000008fe' 2024-08-31T04:31:11.087 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14193 fp=#0x200000008a2' 2024-08-31T04:31:11.087 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14225 fp=#0x200000008cb' 2024-08-31T04:31:11.087 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14257 fp=#0x20000001e45' 2024-08-31T04:31:11.088 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14289 fp=#0x20000001db7' 2024-08-31T04:31:11.088 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14353 fp=#0x2000000162e' 2024-08-31T04:31:11.089 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14449 fp=#0x20000001938' 2024-08-31T04:31:11.090 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14481 fp=#0x20000001823' 2024-08-31T04:31:11.090 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14513 fp=#0x2000000188b' 2024-08-31T04:31:11.090 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14545 fp=#0x20000001029' 2024-08-31T04:31:11.091 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14577 fp=#0x20000000f45' 2024-08-31T04:31:11.091 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14609 fp=#0x20000000f72' 2024-08-31T04:31:11.091 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14641 fp=#0x20000000f89' 2024-08-31T04:31:11.092 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14673 fp=#0x20000000f37' 2024-08-31T04:31:11.092 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14705 fp=#0x20000001022' 2024-08-31T04:31:11.092 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14737 fp=#0x100000046c2' 2024-08-31T04:31:11.093 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14833 fp=#0x20000001d71' 2024-08-31T04:31:11.093 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14847 fp=#0x1000000310e' 2024-08-31T04:31:11.094 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14879 fp=#0x100000031ac' 2024-08-31T04:31:11.094 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14911 fp=#0x10000003141' 2024-08-31T04:31:11.094 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14943 fp=#0x1000000315d' 2024-08-31T04:31:11.095 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14975 fp=#0x1000000589a' 2024-08-31T04:31:11.095 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15007 fp=#0x20000001e1f' 2024-08-31T04:31:11.095 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15039 fp=#0x200000017fe' 2024-08-31T04:31:11.096 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15071 fp=#0x20000001753' 2024-08-31T04:31:11.096 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15103 fp=#0x2000000174c' 2024-08-31T04:31:11.096 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15135 fp=#0x20000001712' 2024-08-31T04:31:11.097 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15166 fp=#0x100000057c4' 2024-08-31T04:31:11.097 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15198 fp=#0x10000001793' 2024-08-31T04:31:11.097 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15230 fp=#0x10000001759' 2024-08-31T04:31:11.098 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15262 fp=#0x20000002207' 2024-08-31T04:31:11.098 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15294 fp=#0x2000000221f' 2024-08-31T04:31:11.098 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15326 fp=#0x20000002212' 2024-08-31T04:31:11.099 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15454 fp=#0x2000000204a' 2024-08-31T04:31:11.100 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15486 fp=#0x1000000534b' 2024-08-31T04:31:11.100 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15518 fp=#0x10000005327' 2024-08-31T04:31:11.100 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15550 fp=#0x10000005347' 2024-08-31T04:31:11.101 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15582 fp=#0x1000000531d' 2024-08-31T04:31:11.101 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15614 fp=#0x10000004dfd' 2024-08-31T04:31:11.101 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15646 fp=#0x10000004dec' 2024-08-31T04:31:11.102 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15710 fp=#0x10000004e6a' 2024-08-31T04:31:11.103 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15870 fp=#0x20000002033' 2024-08-31T04:31:11.104 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15902 fp=#0x20000002035' 2024-08-31T04:31:11.104 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15966 fp=#0x10000003c45' 2024-08-31T04:31:11.105 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15998 fp=#0x20000000ec0' 2024-08-31T04:31:11.105 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16030 fp=#0x20000001923' 2024-08-31T04:31:11.105 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16062 fp=#0x20000001901' 2024-08-31T04:31:11.106 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16094 fp=#0x200000011bc' 2024-08-31T04:31:11.106 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16126 fp=#0x20000001128' 2024-08-31T04:31:11.106 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16158 fp=#0x2000000118a' 2024-08-31T04:31:11.107 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16190 fp=#0x20000001614' 2024-08-31T04:31:11.107 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16222 fp=#0x20000001610' 2024-08-31T04:31:11.107 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16254 fp=#0x20000001600' 2024-08-31T04:31:11.107 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16285 fp=#0x1000000452f' 2024-08-31T04:31:11.108 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16317 fp=#0x10000004522' 2024-08-31T04:31:11.108 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16349 fp=#0x10000004509' 2024-08-31T04:31:11.109 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16381 fp=#0x100000044e9' 2024-08-31T04:31:11.109 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16413 fp=#0x1000000488d' 2024-08-31T04:31:11.109 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16445 fp=#0x10000004518' 2024-08-31T04:31:11.109 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16477 fp=#0x200000011bf' 2024-08-31T04:31:11.110 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16509 fp=#0x10000004df3' 2024-08-31T04:31:11.110 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16541 fp=#0x20000001137' 2024-08-31T04:31:11.110 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16573 fp=#0x10000004eee' 2024-08-31T04:31:11.111 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16605 fp=#0x2000000113d' 2024-08-31T04:31:11.111 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16637 fp=#0x200000022c7' 2024-08-31T04:31:11.111 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16669 fp=#0x20000000418' 2024-08-31T04:31:11.112 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16733 fp=#0x2000000044c' 2024-08-31T04:31:11.112 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16765 fp=#0x2000000044a' 2024-08-31T04:31:11.113 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16797 fp=#0x10000002af4' 2024-08-31T04:31:11.113 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16829 fp=#0x10000002ab1' 2024-08-31T04:31:11.113 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16861 fp=#0x1000000454e' 2024-08-31T04:31:11.114 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16893 fp=#0x10000005d44' 2024-08-31T04:31:11.114 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16925 fp=#0x20000002136' 2024-08-31T04:31:11.114 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16957 fp=#0x10000004550' 2024-08-31T04:31:11.115 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16989 fp=#0x20000002138' 2024-08-31T04:31:11.116 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17117 fp=#0x10000005736' 2024-08-31T04:31:11.116 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17181 fp=#0x10000005786' 2024-08-31T04:31:11.117 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17277 fp=#0x10000005470' 2024-08-31T04:31:11.118 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17309 fp=#0x100000054dc' 2024-08-31T04:31:11.118 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17341 fp=#0x20000001ac6' 2024-08-31T04:31:11.118 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17373 fp=#0x20000001aa0' 2024-08-31T04:31:11.119 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17405 fp=#0x20000001abd' 2024-08-31T04:31:11.119 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17437 fp=#0x20000001ab3' 2024-08-31T04:31:11.119 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17469 fp=#0x10000004d9d' 2024-08-31T04:31:11.120 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17501 fp=#0x10000004de3' 2024-08-31T04:31:11.120 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17533 fp=#0x20000001b88' 2024-08-31T04:31:11.120 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17565 fp=#0x20000001b11' 2024-08-31T04:31:11.121 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17597 fp=#0x20000001b64' 2024-08-31T04:31:11.121 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17629 fp=#0x10000002a52' 2024-08-31T04:31:11.121 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17661 fp=#0x10000002a09' 2024-08-31T04:31:11.122 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17693 fp=#0x20000001ef8' 2024-08-31T04:31:11.122 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17725 fp=#0x20000001f36' 2024-08-31T04:31:11.122 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17757 fp=#0x10000004f25' 2024-08-31T04:31:11.123 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17789 fp=#0x10000004ef0' 2024-08-31T04:31:11.123 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17821 fp=#0x10000004f15' 2024-08-31T04:31:11.123 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17853 fp=#0x10000000894' 2024-08-31T04:31:11.124 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17885 fp=#0x10000001158' 2024-08-31T04:31:11.124 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17981 fp=#0x20000001bf3' 2024-08-31T04:31:11.125 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18013 fp=#0x20000001c07' 2024-08-31T04:31:11.125 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18045 fp=#0x20000001cbe' 2024-08-31T04:31:11.125 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18077 fp=#0x2000000170b' 2024-08-31T04:31:11.126 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18109 fp=#0x200000018c1' 2024-08-31T04:31:11.126 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18141 fp=#0x20000001713' 2024-08-31T04:31:11.126 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18173 fp=#0x2000000161e' 2024-08-31T04:31:11.127 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18205 fp=#0x20000000c49' 2024-08-31T04:31:11.127 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18237 fp=#0x20000000c53' 2024-08-31T04:31:11.127 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18266 fp=#0x10000004a1c' 2024-08-31T04:31:11.128 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18330 fp=#0x200000022e5' 2024-08-31T04:31:11.128 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18362 fp=#0x200000022f2' 2024-08-31T04:31:11.128 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18389 fp=#0x20000002225' 2024-08-31T04:31:11.129 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18421 fp=#0x200000021a7' 2024-08-31T04:31:11.129 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18453 fp=#0x2000000223e' 2024-08-31T04:31:11.129 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18485 fp=#0x20000002180' 2024-08-31T04:31:11.130 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18517 fp=#0x20000002200' 2024-08-31T04:31:11.130 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18547 fp=#0x10000003653' 2024-08-31T04:31:11.130 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18579 fp=#0x50000000a95' 2024-08-31T04:31:11.131 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:7174 fp=#0x20000000f4f' 2024-08-31T04:31:11.131 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:7206 fp=#0x20000001e61' 2024-08-31T04:31:11.131 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:7270 fp=#0x200000021bc' 2024-08-31T04:31:11.133 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:7398 fp=#0x20000001fe5' 2024-08-31T04:31:11.133 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:7430 fp=#0x2000000202f' 2024-08-31T04:31:11.134 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:7526 fp=#0x20000001fe7' 2024-08-31T04:31:11.134 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:7558 fp=#0x20000001fca' 2024-08-31T04:31:11.143 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:8742 fp=#0x20000000acf' 2024-08-31T04:31:11.145 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:8893 fp=#0x2000000063d' 2024-08-31T04:31:11.145 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:8957 fp=#0x20000000621' 2024-08-31T04:31:11.145 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:8989 fp=#0x200000018be' 2024-08-31T04:31:11.146 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9021 fp=#0x20000000fe9' 2024-08-31T04:31:11.146 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9085 fp=#0x20000000f5b' 2024-08-31T04:31:11.147 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9117 fp=#0x20000000894' 2024-08-31T04:31:11.147 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9181 fp=#0x20000001d92' 2024-08-31T04:31:11.148 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9213 fp=#0x20000001d05' 2024-08-31T04:31:11.149 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9373 fp=#0x200000009c8' 2024-08-31T04:31:11.149 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9405 fp=#0x20000000962' 2024-08-31T04:31:11.150 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9437 fp=#0x20000000983' 2024-08-31T04:31:11.150 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9469 fp=#0x2000000157f' 2024-08-31T04:31:11.150 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9501 fp=#0x200000009aa' 2024-08-31T04:31:11.151 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9533 fp=#0x20000000994' 2024-08-31T04:31:11.151 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9565 fp=#0x20000001564' 2024-08-31T04:31:11.151 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9597 fp=#0x2000000184d' 2024-08-31T04:31:11.152 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9629 fp=#0x20000001842' 2024-08-31T04:31:11.152 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9661 fp=#0x200000018a9' 2024-08-31T04:31:11.152 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9693 fp=#0x20000000b21' 2024-08-31T04:31:11.153 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9725 fp=#0x20000000b2b' 2024-08-31T04:31:11.153 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9757 fp=#0x20000000afe' 2024-08-31T04:31:11.154 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9789 fp=#0x20000000b3d' 2024-08-31T04:31:11.154 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9821 fp=#0x20000001eb7' 2024-08-31T04:31:11.154 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9853 fp=#0x20000001eca' 2024-08-31T04:31:11.155 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9885 fp=#0x20000001e41' 2024-08-31T04:31:11.155 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9917 fp=#0x20000001de1' 2024-08-31T04:31:11.156 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10044 fp=#0x20000000d97' 2024-08-31T04:31:11.157 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10076 fp=#0x20000000e15' 2024-08-31T04:31:11.157 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10108 fp=#0x20000000d4a' 2024-08-31T04:31:11.157 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10140 fp=#0x20000000daa' 2024-08-31T04:31:11.158 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10172 fp=#0x20000000d66' 2024-08-31T04:31:11.158 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10204 fp=#0x2000000105f' 2024-08-31T04:31:11.158 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10236 fp=#0x200000022a1' 2024-08-31T04:31:11.159 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10268 fp=#0x2000000102a' 2024-08-31T04:31:11.159 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10300 fp=#0x20000001036' 2024-08-31T04:31:11.159 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10332 fp=#0x200000014f0' 2024-08-31T04:31:11.160 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10364 fp=#0x2000000149b' 2024-08-31T04:31:11.160 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10396 fp=#0x20000000943' 2024-08-31T04:31:11.160 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10428 fp=#0x20000001518' 2024-08-31T04:31:11.161 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10460 fp=#0x200000014a1' 2024-08-31T04:31:11.161 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10492 fp=#0x10000000bfe' 2024-08-31T04:31:11.161 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10524 fp=#0x10000001100' 2024-08-31T04:31:11.162 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10556 fp=#0x10000000c1e' 2024-08-31T04:31:11.162 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10588 fp=#0x10000000bd6' 2024-08-31T04:31:11.162 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10620 fp=#0x2000000205a' 2024-08-31T04:31:11.163 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10652 fp=#0x200000020c5' 2024-08-31T04:31:11.163 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10684 fp=#0x200000020b7' 2024-08-31T04:31:11.164 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10812 fp=#0x1000000347d' 2024-08-31T04:31:11.165 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10844 fp=#0x10000003469' 2024-08-31T04:31:11.165 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10876 fp=#0x1000000341d' 2024-08-31T04:31:11.165 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10908 fp=#0x100000033f7' 2024-08-31T04:31:11.166 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10940 fp=#0x200000005e8' 2024-08-31T04:31:11.166 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10972 fp=#0x10000003428' 2024-08-31T04:31:11.166 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11004 fp=#0x10000003bd1' 2024-08-31T04:31:11.166 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11036 fp=#0x10000003ba8' 2024-08-31T04:31:11.167 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11068 fp=#0x10000003a0b' 2024-08-31T04:31:11.167 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11100 fp=#0x10000003c2c' 2024-08-31T04:31:11.167 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11132 fp=#0x10000003b60' 2024-08-31T04:31:11.168 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11164 fp=#0x10000003d00' 2024-08-31T04:31:11.168 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11224 fp=#0x20000000e9a' 2024-08-31T04:31:11.169 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11256 fp=#0x20000000e84' 2024-08-31T04:31:11.169 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11288 fp=#0x20000000e4c' 2024-08-31T04:31:11.169 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11320 fp=#0x200000018cf' 2024-08-31T04:31:11.170 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11352 fp=#0x2000000192d' 2024-08-31T04:31:11.170 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11384 fp=#0x20000001e3d' 2024-08-31T04:31:11.170 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11416 fp=#0x200000018b9' 2024-08-31T04:31:11.171 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11448 fp=#0x20000001ef0' 2024-08-31T04:31:11.171 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11480 fp=#0x20000001f07' 2024-08-31T04:31:11.171 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11512 fp=#0x20000001ed0' 2024-08-31T04:31:11.171 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11544 fp=#0x100000045eb' 2024-08-31T04:31:11.172 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11576 fp=#0x100000045bf' 2024-08-31T04:31:11.172 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11608 fp=#0x100000045b3' 2024-08-31T04:31:11.173 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11640 fp=#0x2000000069e' 2024-08-31T04:31:11.173 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11672 fp=#0x200000006a1' 2024-08-31T04:31:11.173 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11736 fp=#0x20000000678' 2024-08-31T04:31:11.174 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11768 fp=#0x200000006c0' 2024-08-31T04:31:11.174 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11832 fp=#0x20000001981' 2024-08-31T04:31:11.175 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11864 fp=#0x200000022d5' 2024-08-31T04:31:11.175 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11896 fp=#0x20000000a73' 2024-08-31T04:31:11.175 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11928 fp=#0x2000000161c' 2024-08-31T04:31:11.176 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11960 fp=#0x20000001615' 2024-08-31T04:31:11.176 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11992 fp=#0x20000001739' 2024-08-31T04:31:11.176 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12024 fp=#0x200000016d9' 2024-08-31T04:31:11.177 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12056 fp=#0x200000016c0' 2024-08-31T04:31:11.177 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12088 fp=#0x200000016ad' 2024-08-31T04:31:11.177 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12152 fp=#0x200000014ca' 2024-08-31T04:31:11.178 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12184 fp=#0x2000000151e' 2024-08-31T04:31:11.178 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12248 fp=#0x200000014dd' 2024-08-31T04:31:11.179 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12280 fp=#0x2000000150a' 2024-08-31T04:31:11.179 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12344 fp=#0x20000001503' 2024-08-31T04:31:11.180 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12376 fp=#0x20000001069' 2024-08-31T04:31:11.180 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12408 fp=#0x20000001058' 2024-08-31T04:31:11.180 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12440 fp=#0x2000000109d' 2024-08-31T04:31:11.181 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12472 fp=#0x20000001e68' 2024-08-31T04:31:11.181 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12504 fp=#0x20000001ec4' 2024-08-31T04:31:11.181 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12536 fp=#0x200000009e5' 2024-08-31T04:31:11.182 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12568 fp=#0x20000000a51' 2024-08-31T04:31:11.182 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12600 fp=#0x20000000a1c' 2024-08-31T04:31:11.184 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12632 fp=#0x20000000a1e' 2024-08-31T04:31:11.184 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12664 fp=#0x20000000a13' 2024-08-31T04:31:11.184 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12696 fp=#0x10000000daa' 2024-08-31T04:31:11.185 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12728 fp=#0x2000000022a' 2024-08-31T04:31:11.185 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12760 fp=#0x20000000207' 2024-08-31T04:31:11.185 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12792 fp=#0x10000000cea' 2024-08-31T04:31:11.186 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12824 fp=#0x2000000020b' 2024-08-31T04:31:11.186 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12856 fp=#0x10000002f38' 2024-08-31T04:31:11.186 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12888 fp=#0x10000003401' 2024-08-31T04:31:11.187 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12920 fp=#0x10000002f29' 2024-08-31T04:31:11.187 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12952 fp=#0x200000020f2' 2024-08-31T04:31:11.188 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12984 fp=#0x200000020ec' 2024-08-31T04:31:11.188 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13016 fp=#0x10000002f20' 2024-08-31T04:31:11.188 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13047 fp=#0x2000000072e' 2024-08-31T04:31:11.189 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13079 fp=#0x20000000720' 2024-08-31T04:31:11.189 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13111 fp=#0x20000000723' 2024-08-31T04:31:11.189 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13143 fp=#0x20000000760' 2024-08-31T04:31:11.190 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13175 fp=#0x20000000745' 2024-08-31T04:31:11.190 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13207 fp=#0x20000000ba9' 2024-08-31T04:31:11.190 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13239 fp=#0x20000000bc2' 2024-08-31T04:31:11.191 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13271 fp=#0x20000000bba' 2024-08-31T04:31:11.191 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13303 fp=#0x20000000b68' 2024-08-31T04:31:11.191 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13335 fp=#0x20000000b6d' 2024-08-31T04:31:11.192 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13367 fp=#0x20000001cfd' 2024-08-31T04:31:11.192 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13399 fp=#0x20000001cd9' 2024-08-31T04:31:11.192 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13431 fp=#0x20000001c5f' 2024-08-31T04:31:11.193 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13463 fp=#0x20000001d1a' 2024-08-31T04:31:11.193 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13495 fp=#0x10000003b61' 2024-08-31T04:31:11.193 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13522 fp=#0x200000011b3' 2024-08-31T04:31:11.194 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13554 fp=#0x20000002109' 2024-08-31T04:31:11.194 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13586 fp=#0x20000002130' 2024-08-31T04:31:11.194 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13618 fp=#0x2000000115d' 2024-08-31T04:31:11.195 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13682 fp=#0x10000002e50' 2024-08-31T04:31:11.195 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13746 fp=#0x10000003920' 2024-08-31T04:31:11.196 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13778 fp=#0x10000002e61' 2024-08-31T04:31:11.196 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13810 fp=#0x20000000819' 2024-08-31T04:31:11.196 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13842 fp=#0x200000015bc' 2024-08-31T04:31:11.197 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13874 fp=#0x2000000223c' 2024-08-31T04:31:11.197 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13906 fp=#0x20000000cbd' 2024-08-31T04:31:11.197 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13938 fp=#0x20000000ce5' 2024-08-31T04:31:11.198 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13970 fp=#0x200000021f8' 2024-08-31T04:31:11.198 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14002 fp=#0x200000019f8' 2024-08-31T04:31:11.198 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14034 fp=#0x20000001a24' 2024-08-31T04:31:11.199 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14066 fp=#0x200000019df' 2024-08-31T04:31:11.199 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14098 fp=#0x20000001a2e' 2024-08-31T04:31:11.199 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14130 fp=#0x20000000954' 2024-08-31T04:31:11.199 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14162 fp=#0x200000008bc' 2024-08-31T04:31:11.200 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14194 fp=#0x200000008a5' 2024-08-31T04:31:11.200 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14226 fp=#0x2000000091f' 2024-08-31T04:31:11.201 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14386 fp=#0x20000001db9' 2024-08-31T04:31:11.202 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14418 fp=#0x20000001ded' 2024-08-31T04:31:11.202 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14450 fp=#0x20000001935' 2024-08-31T04:31:11.202 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14482 fp=#0x20000001849' 2024-08-31T04:31:11.203 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14514 fp=#0x2000000192a' 2024-08-31T04:31:11.203 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14546 fp=#0x20000000f01' 2024-08-31T04:31:11.203 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14578 fp=#0x20000000ff7' 2024-08-31T04:31:11.204 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14610 fp=#0x20000000fae' 2024-08-31T04:31:11.204 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14642 fp=#0x20000000fd9' 2024-08-31T04:31:11.204 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14674 fp=#0x20000000f15' 2024-08-31T04:31:11.204 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14706 fp=#0x20000000f10' 2024-08-31T04:31:11.205 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14770 fp=#0x20000000bfc' 2024-08-31T04:31:11.206 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14834 fp=#0x20000001d75' 2024-08-31T04:31:11.206 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14848 fp=#0x10000003183' 2024-08-31T04:31:11.206 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14880 fp=#0x10000003138' 2024-08-31T04:31:11.207 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14912 fp=#0x1000000318e' 2024-08-31T04:31:11.207 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14944 fp=#0x10000003191' 2024-08-31T04:31:11.207 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14976 fp=#0x100000058a7' 2024-08-31T04:31:11.208 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15008 fp=#0x200000017aa' 2024-08-31T04:31:11.208 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15040 fp=#0x200000017d6' 2024-08-31T04:31:11.208 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15072 fp=#0x200000017a0' 2024-08-31T04:31:11.209 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15104 fp=#0x2000000179e' 2024-08-31T04:31:11.209 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15136 fp=#0x200000017b7' 2024-08-31T04:31:11.209 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15167 fp=#0x100000057bc' 2024-08-31T04:31:11.210 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15199 fp=#0x100000017b4' 2024-08-31T04:31:11.210 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15231 fp=#0x1000000178b' 2024-08-31T04:31:11.210 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15263 fp=#0x200000021f9' 2024-08-31T04:31:11.211 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15295 fp=#0x2000000227a' 2024-08-31T04:31:11.211 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15327 fp=#0x200000021ca' 2024-08-31T04:31:11.212 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15423 fp=#0x2000000208b' 2024-08-31T04:31:11.212 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15455 fp=#0x20000001cc8' 2024-08-31T04:31:11.212 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15487 fp=#0x10000005326' 2024-08-31T04:31:11.213 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15519 fp=#0x2000000161b' 2024-08-31T04:31:11.213 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15551 fp=#0x10000005342' 2024-08-31T04:31:11.213 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15583 fp=#0x10000005338' 2024-08-31T04:31:11.214 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15615 fp=#0x10000004e45' 2024-08-31T04:31:11.214 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15647 fp=#0x10000004eba' 2024-08-31T04:31:11.214 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15679 fp=#0x10000004ea5' 2024-08-31T04:31:11.214 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15711 fp=#0x10000004ec7' 2024-08-31T04:31:11.215 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15743 fp=#0x10000004ec3' 2024-08-31T04:31:11.217 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15967 fp=#0x200000021cf' 2024-08-31T04:31:11.217 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15999 fp=#0x20000000eb4' 2024-08-31T04:31:11.217 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16031 fp=#0x2000000191a' 2024-08-31T04:31:11.218 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16063 fp=#0x20000001955' 2024-08-31T04:31:11.218 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16095 fp=#0x200000011b5' 2024-08-31T04:31:11.218 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16127 fp=#0x2000000112d' 2024-08-31T04:31:11.219 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16159 fp=#0x20000001135' 2024-08-31T04:31:11.219 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16191 fp=#0x200000015d6' 2024-08-31T04:31:11.219 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16223 fp=#0x20000001595' 2024-08-31T04:31:11.220 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16255 fp=#0x200000015ab' 2024-08-31T04:31:11.220 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16286 fp=#0x10000004510' 2024-08-31T04:31:11.220 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16318 fp=#0x10000004508' 2024-08-31T04:31:11.221 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16350 fp=#0x1000000489e' 2024-08-31T04:31:11.221 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16382 fp=#0x10000004889' 2024-08-31T04:31:11.221 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16414 fp=#0x1000000451e' 2024-08-31T04:31:11.222 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16446 fp=#0x100000044e4' 2024-08-31T04:31:11.222 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16478 fp=#0x20000001e7a' 2024-08-31T04:31:11.222 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16510 fp=#0x2000000117e' 2024-08-31T04:31:11.223 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16574 fp=#0x10000004dda' 2024-08-31T04:31:11.223 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16606 fp=#0x200000022bf' 2024-08-31T04:31:11.223 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16638 fp=#0x20000002295' 2024-08-31T04:31:11.224 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16670 fp=#0x10000002ae8' 2024-08-31T04:31:11.224 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16702 fp=#0x20000000427' 2024-08-31T04:31:11.225 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16734 fp=#0x10000002a96' 2024-08-31T04:31:11.225 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16766 fp=#0x200000003fb' 2024-08-31T04:31:11.225 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16798 fp=#0x10000002aa6' 2024-08-31T04:31:11.226 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16830 fp=#0x20000000443' 2024-08-31T04:31:11.226 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16862 fp=#0x100000045b7' 2024-08-31T04:31:11.226 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16894 fp=#0x1000000458c' 2024-08-31T04:31:11.226 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16926 fp=#0x10000004570' 2024-08-31T04:31:11.227 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16958 fp=#0x10000004543' 2024-08-31T04:31:11.227 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16990 fp=#0x10000004583' 2024-08-31T04:31:11.228 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17086 fp=#0x10000005796' 2024-08-31T04:31:11.229 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17214 fp=#0x100000054ea' 2024-08-31T04:31:11.229 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17246 fp=#0x10000005478' 2024-08-31T04:31:11.230 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17310 fp=#0x1000000546a' 2024-08-31T04:31:11.230 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17342 fp=#0x20000001ac1' 2024-08-31T04:31:11.231 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17374 fp=#0x20000001acb' 2024-08-31T04:31:11.231 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17406 fp=#0x20000001a78' 2024-08-31T04:31:11.231 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17438 fp=#0x20000001aa1' 2024-08-31T04:31:11.231 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17470 fp=#0x10000004e2a' 2024-08-31T04:31:11.232 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17502 fp=#0x10000004dbb' 2024-08-31T04:31:11.232 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17534 fp=#0x20000001b82' 2024-08-31T04:31:11.232 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17566 fp=#0x20000001b3e' 2024-08-31T04:31:11.233 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17598 fp=#0x20000001aeb' 2024-08-31T04:31:11.233 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17630 fp=#0x20000001f0a' 2024-08-31T04:31:11.234 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17662 fp=#0x20000001f58' 2024-08-31T04:31:11.234 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17694 fp=#0x100000029db' 2024-08-31T04:31:11.234 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17726 fp=#0x100000029e1' 2024-08-31T04:31:11.234 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17758 fp=#0x10000004f50' 2024-08-31T04:31:11.235 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17790 fp=#0x10000004ef5' 2024-08-31T04:31:11.235 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17822 fp=#0x10000004eea' 2024-08-31T04:31:11.236 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17886 fp=#0x10000000831' 2024-08-31T04:31:11.236 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17950 fp=#0x1000000115e' 2024-08-31T04:31:11.236 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17982 fp=#0x20000001bf8' 2024-08-31T04:31:11.237 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18014 fp=#0x20000001c45' 2024-08-31T04:31:11.237 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18046 fp=#0x20000001c65' 2024-08-31T04:31:11.237 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18078 fp=#0x20000001703' 2024-08-31T04:31:11.238 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18110 fp=#0x200000016f2' 2024-08-31T04:31:11.238 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18142 fp=#0x2000000171b' 2024-08-31T04:31:11.238 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18174 fp=#0x20000000c16' 2024-08-31T04:31:11.239 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18206 fp=#0x20000000c5c' 2024-08-31T04:31:11.239 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18238 fp=#0x20000000c10' 2024-08-31T04:31:11.239 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18267 fp=#0x10000004a0b' 2024-08-31T04:31:11.240 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18331 fp=#0x20000000857' 2024-08-31T04:31:11.240 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18363 fp=#0x200000022f4' 2024-08-31T04:31:11.241 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18390 fp=#0x20000002166' 2024-08-31T04:31:11.241 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18422 fp=#0x200000021eb' 2024-08-31T04:31:11.241 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18454 fp=#0x200000021a5' 2024-08-31T04:31:11.242 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18486 fp=#0x200000021a3' 2024-08-31T04:31:11.242 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18518 fp=#0x200000021bb' 2024-08-31T04:31:11.242 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18548 fp=#0x1000000365f' 2024-08-31T04:31:11.243 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18580 fp=#0x100000035da' 2024-08-31T04:31:11.243 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:7207 fp=#0x200000009d5' 2024-08-31T04:31:11.244 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:7271 fp=#0x10000004b51' 2024-08-31T04:31:11.245 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:7399 fp=#0x20000001f85' 2024-08-31T04:31:11.246 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:7527 fp=#0x20000001ff7' 2024-08-31T04:31:11.246 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:7559 fp=#0x20000001fe3' 2024-08-31T04:31:11.255 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:8766 fp=#0x20000000844' 2024-08-31T04:31:11.256 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:8926 fp=#0x20000000623' 2024-08-31T04:31:11.256 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:8958 fp=#0x2000000062a' 2024-08-31T04:31:11.257 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9022 fp=#0x20000000f54' 2024-08-31T04:31:11.257 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9054 fp=#0x20000000fdf' 2024-08-31T04:31:11.258 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9118 fp=#0x20000001d8e' 2024-08-31T04:31:11.258 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9150 fp=#0x20000001c91' 2024-08-31T04:31:11.259 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9182 fp=#0x20000001d13' 2024-08-31T04:31:11.259 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9214 fp=#0x20000000875' 2024-08-31T04:31:11.260 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9278 fp=#0x20000001b31' 2024-08-31T04:31:11.260 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9374 fp=#0x20000001556' 2024-08-31T04:31:11.261 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9406 fp=#0x20000001554' 2024-08-31T04:31:11.261 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9438 fp=#0x20000001549' 2024-08-31T04:31:11.261 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9470 fp=#0x20000000969' 2024-08-31T04:31:11.262 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9502 fp=#0x20000001550' 2024-08-31T04:31:11.262 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9534 fp=#0x20000001566' 2024-08-31T04:31:11.262 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9566 fp=#0x2000000154d' 2024-08-31T04:31:11.263 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9630 fp=#0x200000018b7' 2024-08-31T04:31:11.263 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9662 fp=#0x20000001888' 2024-08-31T04:31:11.263 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9694 fp=#0x20000000b59' 2024-08-31T04:31:11.264 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9726 fp=#0x20000000b44' 2024-08-31T04:31:11.264 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9758 fp=#0x20000001f76' 2024-08-31T04:31:11.265 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9790 fp=#0x20000000b36' 2024-08-31T04:31:11.265 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9822 fp=#0x20000001f16' 2024-08-31T04:31:11.265 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9854 fp=#0x20000001eb0' 2024-08-31T04:31:11.266 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9886 fp=#0x20000001ee8' 2024-08-31T04:31:11.266 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9918 fp=#0x20000001ec3' 2024-08-31T04:31:11.267 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10045 fp=#0x20000000e24' 2024-08-31T04:31:11.267 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10077 fp=#0x20000000dee' 2024-08-31T04:31:11.268 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10109 fp=#0x20000000d7c' 2024-08-31T04:31:11.268 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10141 fp=#0x20000000d9d' 2024-08-31T04:31:11.268 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10173 fp=#0x20000000d6c' 2024-08-31T04:31:11.269 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10237 fp=#0x2000000105b' 2024-08-31T04:31:11.269 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10269 fp=#0x20000000ff4' 2024-08-31T04:31:11.270 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10301 fp=#0x20000000fff' 2024-08-31T04:31:11.270 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10333 fp=#0x200000014d0' 2024-08-31T04:31:11.271 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10397 fp=#0x200000014b3' 2024-08-31T04:31:11.271 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10429 fp=#0x20000000919' 2024-08-31T04:31:11.271 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10461 fp=#0x20000000917' 2024-08-31T04:31:11.272 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10493 fp=#0x1000000113c' 2024-08-31T04:31:11.272 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10525 fp=#0x10000000bbd' 2024-08-31T04:31:11.272 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10557 fp=#0x200000010c7' 2024-08-31T04:31:11.273 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10589 fp=#0x10000000bcd' 2024-08-31T04:31:11.273 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10621 fp=#0x20000002108' 2024-08-31T04:31:11.273 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10653 fp=#0x200000020cc' 2024-08-31T04:31:11.274 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10685 fp=#0x200000020f1' 2024-08-31T04:31:11.275 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10813 fp=#0x10000003409' 2024-08-31T04:31:11.275 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10845 fp=#0x200000005ef' 2024-08-31T04:31:11.276 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10877 fp=#0x2000000060a' 2024-08-31T04:31:11.278 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10909 fp=#0x200000005f5' 2024-08-31T04:31:11.279 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10941 fp=#0x10000003419' 2024-08-31T04:31:11.279 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10973 fp=#0x1000000341f' 2024-08-31T04:31:11.280 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11037 fp=#0x10000003b89' 2024-08-31T04:31:11.280 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11069 fp=#0x10000003a1f' 2024-08-31T04:31:11.280 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11101 fp=#0x10000003b55' 2024-08-31T04:31:11.281 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11133 fp=#0x10000003b6c' 2024-08-31T04:31:11.281 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11197 fp=#0x10000003a27' 2024-08-31T04:31:11.282 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11225 fp=#0x20000000e9c' 2024-08-31T04:31:11.282 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11257 fp=#0x20000000e62' 2024-08-31T04:31:11.282 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11289 fp=#0x20000000e68' 2024-08-31T04:31:11.283 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11321 fp=#0x20000001961' 2024-08-31T04:31:11.283 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11353 fp=#0x200000019b5' 2024-08-31T04:31:11.283 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11385 fp=#0x2000000195e' 2024-08-31T04:31:11.284 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11417 fp=#0x20000001edc' 2024-08-31T04:31:11.284 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11449 fp=#0x20000001e1a' 2024-08-31T04:31:11.284 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11481 fp=#0x20000001937' 2024-08-31T04:31:11.285 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11513 fp=#0x200000018eb' 2024-08-31T04:31:11.285 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11545 fp=#0x100000045a2' 2024-08-31T04:31:11.286 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11577 fp=#0x10000004593' 2024-08-31T04:31:11.286 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11609 fp=#0x100000045aa' 2024-08-31T04:31:11.286 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11641 fp=#0x200000006d3' 2024-08-31T04:31:11.287 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11673 fp=#0x2000000197a' 2024-08-31T04:31:11.287 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11737 fp=#0x20000001969' 2024-08-31T04:31:11.287 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11769 fp=#0x200000006ab' 2024-08-31T04:31:11.288 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11801 fp=#0x2000000068d' 2024-08-31T04:31:11.288 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11833 fp=#0x2000000214f' 2024-08-31T04:31:11.288 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11865 fp=#0x200000022d3' 2024-08-31T04:31:11.289 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11897 fp=#0x20000000abd' 2024-08-31T04:31:11.289 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11929 fp=#0x20000001649' 2024-08-31T04:31:11.290 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11961 fp=#0x20000000aae' 2024-08-31T04:31:11.290 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11993 fp=#0x2000000171a' 2024-08-31T04:31:11.290 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12025 fp=#0x200000016dc' 2024-08-31T04:31:11.291 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12057 fp=#0x200000016a0' 2024-08-31T04:31:11.291 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12089 fp=#0x200000016e8' 2024-08-31T04:31:11.293 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12345 fp=#0x200000010d9' 2024-08-31T04:31:11.293 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12377 fp=#0x200000010c3' 2024-08-31T04:31:11.294 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12409 fp=#0x200000010a4' 2024-08-31T04:31:11.294 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12441 fp=#0x20000001078' 2024-08-31T04:31:11.294 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12473 fp=#0x20000001ecb' 2024-08-31T04:31:11.295 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12505 fp=#0x20000001e73' 2024-08-31T04:31:11.295 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12537 fp=#0x200000009fb' 2024-08-31T04:31:11.295 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12569 fp=#0x20000000a01' 2024-08-31T04:31:11.296 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12601 fp=#0x20000000a04' 2024-08-31T04:31:11.296 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12633 fp=#0x20000000a69' 2024-08-31T04:31:11.296 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12665 fp=#0x20000000a5d' 2024-08-31T04:31:11.297 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12697 fp=#0x10000000e49' 2024-08-31T04:31:11.297 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12729 fp=#0x2000000022c' 2024-08-31T04:31:11.297 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12761 fp=#0x200000003ef' 2024-08-31T04:31:11.298 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12793 fp=#0x2000000020e' 2024-08-31T04:31:11.298 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12825 fp=#0x2000000021d' 2024-08-31T04:31:11.298 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12857 fp=#0x20000002134' 2024-08-31T04:31:11.299 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12889 fp=#0x10000002f21' 2024-08-31T04:31:11.299 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12921 fp=#0x20000002150' 2024-08-31T04:31:11.299 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12953 fp=#0x10000002e8c' 2024-08-31T04:31:11.300 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12985 fp=#0x200000020cb' 2024-08-31T04:31:11.300 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13017 fp=#0x20000002162' 2024-08-31T04:31:11.301 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13048 fp=#0x2000000072a' 2024-08-31T04:31:11.301 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13080 fp=#0x2000000079a' 2024-08-31T04:31:11.301 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13112 fp=#0x20000000763' 2024-08-31T04:31:11.302 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13144 fp=#0x20000000728' 2024-08-31T04:31:11.302 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13176 fp=#0x200000007a0' 2024-08-31T04:31:11.302 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13208 fp=#0x20000000b7c' 2024-08-31T04:31:11.303 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13240 fp=#0x20000000b90' 2024-08-31T04:31:11.303 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13272 fp=#0x20000000b7b' 2024-08-31T04:31:11.303 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13304 fp=#0x20000000ba0' 2024-08-31T04:31:11.304 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13336 fp=#0x20000000bd5' 2024-08-31T04:31:11.304 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13368 fp=#0x20000001d67' 2024-08-31T04:31:11.304 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13400 fp=#0x20000001d17' 2024-08-31T04:31:11.305 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13432 fp=#0x20000001d47' 2024-08-31T04:31:11.305 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13464 fp=#0x20000001d3f' 2024-08-31T04:31:11.305 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13496 fp=#0x10000003b4f' 2024-08-31T04:31:11.306 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13523 fp=#0x20000001159' 2024-08-31T04:31:11.306 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13587 fp=#0x200000011bb' 2024-08-31T04:31:11.307 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13619 fp=#0x20000001152' 2024-08-31T04:31:11.307 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13683 fp=#0x10000002f55' 2024-08-31T04:31:11.308 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13747 fp=#0x10000002e57' 2024-08-31T04:31:11.308 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13779 fp=#0x10000002e72' 2024-08-31T04:31:11.309 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13811 fp=#0x200000015d3' 2024-08-31T04:31:11.309 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13843 fp=#0x20000000805' 2024-08-31T04:31:11.309 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13875 fp=#0x20000000d10' 2024-08-31T04:31:11.310 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13907 fp=#0x20000000d16' 2024-08-31T04:31:11.310 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13939 fp=#0x20000000ca7' 2024-08-31T04:31:11.310 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13971 fp=#0x2000000220b' 2024-08-31T04:31:11.311 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14003 fp=#0x20000001a4c' 2024-08-31T04:31:11.311 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14035 fp=#0x20000001a29' 2024-08-31T04:31:11.311 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14067 fp=#0x2000000229c' 2024-08-31T04:31:11.312 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14099 fp=#0x20000001a22' 2024-08-31T04:31:11.312 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14131 fp=#0x200000008ad' 2024-08-31T04:31:11.312 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14163 fp=#0x20000000931' 2024-08-31T04:31:11.313 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14195 fp=#0x200000008d6' 2024-08-31T04:31:11.313 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14227 fp=#0x200000008a1' 2024-08-31T04:31:11.313 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14259 fp=#0x20000001df2' 2024-08-31T04:31:11.314 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14323 fp=#0x20000001e27' 2024-08-31T04:31:11.314 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14355 fp=#0x20000001ddf' 2024-08-31T04:31:11.314 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14387 fp=#0x20000001dc6' 2024-08-31T04:31:11.315 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14451 fp=#0x20000001951' 2024-08-31T04:31:11.316 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14483 fp=#0x20000001947' 2024-08-31T04:31:11.316 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14515 fp=#0x200000018d2' 2024-08-31T04:31:11.316 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14547 fp=#0x2000000101c' 2024-08-31T04:31:11.317 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14611 fp=#0x20000000f03' 2024-08-31T04:31:11.317 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14643 fp=#0x20000000f47' 2024-08-31T04:31:11.318 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14675 fp=#0x20000000f7a' 2024-08-31T04:31:11.318 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14707 fp=#0x20000000f75' 2024-08-31T04:31:11.318 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14771 fp=#0x100000046ec' 2024-08-31T04:31:11.319 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14803 fp=#0x100000046c8' 2024-08-31T04:31:11.319 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14849 fp=#0x1000000313d' 2024-08-31T04:31:11.320 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14881 fp=#0x100000031a7' 2024-08-31T04:31:11.320 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14913 fp=#0x100000030fa' 2024-08-31T04:31:11.320 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14945 fp=#0x100000031be' 2024-08-31T04:31:11.321 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14977 fp=#0x20000001a89' 2024-08-31T04:31:11.321 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15009 fp=#0x20000001800' 2024-08-31T04:31:11.321 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15041 fp=#0x20000001759' 2024-08-31T04:31:11.322 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15073 fp=#0x20000001762' 2024-08-31T04:31:11.322 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15105 fp=#0x200000017e1' 2024-08-31T04:31:11.322 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15168 fp=#0x1000000579c' 2024-08-31T04:31:11.323 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15200 fp=#0x1000000175e' 2024-08-31T04:31:11.323 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15232 fp=#0x10000001777' 2024-08-31T04:31:11.323 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15264 fp=#0x200000021d0' 2024-08-31T04:31:11.324 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15296 fp=#0x200000021e1' 2024-08-31T04:31:11.324 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15328 fp=#0x20000002219' 2024-08-31T04:31:11.325 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15392 fp=#0x20000001cd5' 2024-08-31T04:31:11.325 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15488 fp=#0x10000005349' 2024-08-31T04:31:11.326 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15520 fp=#0x200000019f7' 2024-08-31T04:31:11.326 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15552 fp=#0x10000005323' 2024-08-31T04:31:11.326 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15584 fp=#0x200000019ee' 2024-08-31T04:31:11.327 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15616 fp=#0x10000004ecf' 2024-08-31T04:31:11.327 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15648 fp=#0x10000004e6e' 2024-08-31T04:31:11.327 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15680 fp=#0x10000004ed0' 2024-08-31T04:31:11.327 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15712 fp=#0x10000004ea7' 2024-08-31T04:31:11.328 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15840 fp=#0x20000002028' 2024-08-31T04:31:11.329 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15936 fp=#0x20000002005' 2024-08-31T04:31:11.330 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16000 fp=#0x20000000ebb' 2024-08-31T04:31:11.330 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16032 fp=#0x20000001954' 2024-08-31T04:31:11.331 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16064 fp=#0x200000022be' 2024-08-31T04:31:11.331 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16096 fp=#0x200000011b0' 2024-08-31T04:31:11.331 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16160 fp=#0x2000000116c' 2024-08-31T04:31:11.332 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16192 fp=#0x200000015a2' 2024-08-31T04:31:11.332 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16224 fp=#0x20000001594' 2024-08-31T04:31:11.332 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16256 fp=#0x200000015a6' 2024-08-31T04:31:11.333 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16287 fp=#0x10000004531' 2024-08-31T04:31:11.333 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16319 fp=#0x1000000451b' 2024-08-31T04:31:11.333 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16351 fp=#0x10000004817' 2024-08-31T04:31:11.334 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16383 fp=#0x10000004890' 2024-08-31T04:31:11.334 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16415 fp=#0x100000044e8' 2024-08-31T04:31:11.334 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16447 fp=#0x100000044e7' 2024-08-31T04:31:11.335 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16479 fp=#0x2000000117c' 2024-08-31T04:31:11.335 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16511 fp=#0x10000004925' 2024-08-31T04:31:11.335 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16543 fp=#0x10000004952' 2024-08-31T04:31:11.336 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16575 fp=#0x20000001659' 2024-08-31T04:31:11.336 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16607 fp=#0x200000022b9' 2024-08-31T04:31:11.336 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16639 fp=#0x200000022c9' 2024-08-31T04:31:11.336 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16671 fp=#0x10000002a84' 2024-08-31T04:31:11.337 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16703 fp=#0x20000000405' 2024-08-31T04:31:11.337 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16735 fp=#0x10000002a9e' 2024-08-31T04:31:11.337 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16767 fp=#0x10000002af6' 2024-08-31T04:31:11.338 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16799 fp=#0x2000000041e' 2024-08-31T04:31:11.338 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16831 fp=#0x2000000043b' 2024-08-31T04:31:11.338 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16863 fp=#0x10000004580' 2024-08-31T04:31:11.339 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16895 fp=#0x10000004563' 2024-08-31T04:31:11.339 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16927 fp=#0x10000005d52' 2024-08-31T04:31:11.339 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16959 fp=#0x10000005d3d' 2024-08-31T04:31:11.340 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16991 fp=#0x1000000456e' 2024-08-31T04:31:11.341 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17151 fp=#0x10000005783' 2024-08-31T04:31:11.341 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17183 fp=#0x1000000577f' 2024-08-31T04:31:11.342 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17215 fp=#0x1000000546e' 2024-08-31T04:31:11.342 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17247 fp=#0x1000000546f' 2024-08-31T04:31:11.342 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17279 fp=#0x100000054c9' 2024-08-31T04:31:11.343 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17343 fp=#0x20000001a6d' 2024-08-31T04:31:11.343 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17375 fp=#0x20000001ab9' 2024-08-31T04:31:11.343 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17407 fp=#0x20000001a70' 2024-08-31T04:31:11.344 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17439 fp=#0x10000004d85' 2024-08-31T04:31:11.344 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17471 fp=#0x10000004e36' 2024-08-31T04:31:11.344 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17503 fp=#0x10000004d62' 2024-08-31T04:31:11.345 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17535 fp=#0x20000001b0b' 2024-08-31T04:31:11.345 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17567 fp=#0x20000001b90' 2024-08-31T04:31:11.345 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17599 fp=#0x20000001b2f' 2024-08-31T04:31:11.346 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17631 fp=#0x20000001f10' 2024-08-31T04:31:11.346 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17663 fp=#0x2000000049d' 2024-08-31T04:31:11.346 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17695 fp=#0x20000001f38' 2024-08-31T04:31:11.347 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17727 fp=#0x10000002a35' 2024-08-31T04:31:11.347 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17759 fp=#0x10000004ede' 2024-08-31T04:31:11.347 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17791 fp=#0x10000004f0e' 2024-08-31T04:31:11.348 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17823 fp=#0x10000004f45' 2024-08-31T04:31:11.348 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17855 fp=#0x10000000896' 2024-08-31T04:31:11.349 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17887 fp=#0x1000000083a' 2024-08-31T04:31:11.349 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17951 fp=#0x100000010fe' 2024-08-31T04:31:11.349 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17983 fp=#0x20000001c50' 2024-08-31T04:31:11.350 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18015 fp=#0x20000001c08' 2024-08-31T04:31:11.350 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18047 fp=#0x20000001ca4' 2024-08-31T04:31:11.350 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18079 fp=#0x2000000178e' 2024-08-31T04:31:11.351 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18111 fp=#0x20000001d77' 2024-08-31T04:31:11.351 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18143 fp=#0x20000001d88' 2024-08-31T04:31:11.351 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18175 fp=#0x20000000d1c' 2024-08-31T04:31:11.352 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18207 fp=#0x20000000d22' 2024-08-31T04:31:11.352 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18239 fp=#0x20000000cb1' 2024-08-31T04:31:11.352 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18268 fp=#0x1000000492c' 2024-08-31T04:31:11.353 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18300 fp=#0x2000000084a' 2024-08-31T04:31:11.353 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18332 fp=#0x10000004a36' 2024-08-31T04:31:11.354 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18391 fp=#0x20000002199' 2024-08-31T04:31:11.354 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18423 fp=#0x20000002215' 2024-08-31T04:31:11.355 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18455 fp=#0x20000002194' 2024-08-31T04:31:11.355 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18487 fp=#0x200000021b0' 2024-08-31T04:31:11.355 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'client_request(client.15282:310901 mkdir owner_uid=1000, owner_gid=1333 #0x10000000399/blog-432 2024-08-31T04:29:48.618910+0000 caller_uid=1000, caller_gid=1333{6,36,1000,1333,})' 2024-08-31T04:31:11.355 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18549 fp=#0x400000017de' 2024-08-31T04:31:11.356 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18581 fp=#0x20000000958' 2024-08-31T04:31:11.356 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:7176 fp=#0x20000000861' 2024-08-31T04:31:11.357 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:7208 fp=#0x10000000ce1' 2024-08-31T04:31:11.357 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:7272 fp=#0x10000005316' 2024-08-31T04:31:11.358 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:7368 fp=#0x20000001fff' 2024-08-31T04:31:11.359 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:7464 fp=#0x20000001fdc' 2024-08-31T04:31:11.360 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:7528 fp=#0x20000001fe9' 2024-08-31T04:31:11.360 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:7560 fp=#0x20000001f9a' 2024-08-31T04:31:11.368 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:8680 fp=#0x20000000ad1' 2024-08-31T04:31:11.370 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:8863 fp=#0x2000000067c' 2024-08-31T04:31:11.370 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:8895 fp=#0x20000000620' 2024-08-31T04:31:11.370 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:8927 fp=#0x2000000063a' 2024-08-31T04:31:11.371 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:8991 fp=#0x20000001856' 2024-08-31T04:31:11.371 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9023 fp=#0x20000000fc4' 2024-08-31T04:31:11.372 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9119 fp=#0x20000001d70' 2024-08-31T04:31:11.373 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9151 fp=#0x20000001cc3' 2024-08-31T04:31:11.373 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9183 fp=#0x20000001c8f' 2024-08-31T04:31:11.373 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9215 fp=#0x20000001d46' 2024-08-31T04:31:11.374 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9247 fp=#0x20000001d78' 2024-08-31T04:31:11.375 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9375 fp=#0x200000009c3' 2024-08-31T04:31:11.375 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9407 fp=#0x20000000965' 2024-08-31T04:31:11.376 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9439 fp=#0x2000000098e' 2024-08-31T04:31:11.376 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9471 fp=#0x2000000096e' 2024-08-31T04:31:11.376 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9503 fp=#0x20000000975' 2024-08-31T04:31:11.377 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9535 fp=#0x2000000156d' 2024-08-31T04:31:11.377 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9567 fp=#0x200000021d4' 2024-08-31T04:31:11.378 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9631 fp=#0x200000014a5' 2024-08-31T04:31:11.378 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9663 fp=#0x20000001878' 2024-08-31T04:31:11.378 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9695 fp=#0x20000000b62' 2024-08-31T04:31:11.378 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9727 fp=#0x20000001f6b' 2024-08-31T04:31:11.379 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9759 fp=#0x20000000b4a' 2024-08-31T04:31:11.379 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9791 fp=#0x20000000b01' 2024-08-31T04:31:11.379 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9823 fp=#0x20000001f20' 2024-08-31T04:31:11.380 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9855 fp=#0x20000001df1' 2024-08-31T04:31:11.380 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9887 fp=#0x20000001edb' 2024-08-31T04:31:11.381 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9919 fp=#0x20000001ed7' 2024-08-31T04:31:11.382 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10046 fp=#0x20000000d4e' 2024-08-31T04:31:11.382 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10078 fp=#0x20000000db2' 2024-08-31T04:31:11.382 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10110 fp=#0x20000000d4d' 2024-08-31T04:31:11.383 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10142 fp=#0x20000000d48' 2024-08-31T04:31:11.383 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10174 fp=#0x20000000da6' 2024-08-31T04:31:11.383 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10206 fp=#0x200000006fb' 2024-08-31T04:31:11.384 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10238 fp=#0x20000002043' 2024-08-31T04:31:11.384 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10270 fp=#0x2000000106f' 2024-08-31T04:31:11.384 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10302 fp=#0x2000000100d' 2024-08-31T04:31:11.385 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10334 fp=#0x20000001497' 2024-08-31T04:31:11.387 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10398 fp=#0x2000000150f' 2024-08-31T04:31:11.388 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10462 fp=#0x200000014b5' 2024-08-31T04:31:11.388 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10494 fp=#0x10000001174' 2024-08-31T04:31:11.389 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10526 fp=#0x10000000be2' 2024-08-31T04:31:11.389 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10590 fp=#0x10000000bd9' 2024-08-31T04:31:11.390 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10622 fp=#0x200000020a0' 2024-08-31T04:31:11.390 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10654 fp=#0x20000002072' 2024-08-31T04:31:11.390 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10686 fp=#0x20000002082' 2024-08-31T04:31:11.391 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10814 fp=#0x20000000613' 2024-08-31T04:31:11.392 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10878 fp=#0x200000005d5' 2024-08-31T04:31:11.392 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10910 fp=#0x200000005fc' 2024-08-31T04:31:11.393 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10942 fp=#0x10000003400' 2024-08-31T04:31:11.393 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10974 fp=#0x200000005fa' 2024-08-31T04:31:11.393 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11006 fp=#0x10000003998' 2024-08-31T04:31:11.394 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11070 fp=#0x10000003daf' 2024-08-31T04:31:11.394 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11102 fp=#0x10000003c3a' 2024-08-31T04:31:11.395 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11134 fp=#0x10000003cfa' 2024-08-31T04:31:11.395 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11166 fp=#0x10000003cbd' 2024-08-31T04:31:11.395 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11198 fp=#0x10000003d64' 2024-08-31T04:31:11.395 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11226 fp=#0x20000000e39' 2024-08-31T04:31:11.396 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11258 fp=#0x20000000e6d' 2024-08-31T04:31:11.396 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11290 fp=#0x20000000e8f' 2024-08-31T04:31:11.396 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11322 fp=#0x20000001ef9' 2024-08-31T04:31:11.397 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11354 fp=#0x200000018ee' 2024-08-31T04:31:11.397 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11386 fp=#0x20000001953' 2024-08-31T04:31:11.397 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11418 fp=#0x20000001907' 2024-08-31T04:31:11.398 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11450 fp=#0x20000001994' 2024-08-31T04:31:11.398 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11482 fp=#0x200000018ab' 2024-08-31T04:31:11.398 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11514 fp=#0x200000019ab' 2024-08-31T04:31:11.399 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11546 fp=#0x1000000465e' 2024-08-31T04:31:11.399 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11578 fp=#0x100000045fa' 2024-08-31T04:31:11.400 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11610 fp=#0x1000000462c' 2024-08-31T04:31:11.400 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11642 fp=#0x20000002129' 2024-08-31T04:31:11.400 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11674 fp=#0x20000001988' 2024-08-31T04:31:11.401 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11738 fp=#0x20000001993' 2024-08-31T04:31:11.401 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11770 fp=#0x20000000645' 2024-08-31T04:31:11.402 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11802 fp=#0x200000006b9' 2024-08-31T04:31:11.402 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11834 fp=#0x20000001992' 2024-08-31T04:31:11.402 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11866 fp=#0x200000022e4' 2024-08-31T04:31:11.403 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11898 fp=#0x20000000a87' 2024-08-31T04:31:11.403 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11930 fp=#0x20000001637' 2024-08-31T04:31:11.403 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11962 fp=#0x20000000a7c' 2024-08-31T04:31:11.404 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11994 fp=#0x200000016c5' 2024-08-31T04:31:11.404 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12026 fp=#0x2000000169a' 2024-08-31T04:31:11.404 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12058 fp=#0x200000016f9' 2024-08-31T04:31:11.405 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12090 fp=#0x200000016aa' 2024-08-31T04:31:11.405 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12186 fp=#0x200000014e4' 2024-08-31T04:31:11.406 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12218 fp=#0x20000001514' 2024-08-31T04:31:11.406 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12250 fp=#0x20000001fc9' 2024-08-31T04:31:11.407 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12346 fp=#0x200000010d4' 2024-08-31T04:31:11.407 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12378 fp=#0x200000010a0' 2024-08-31T04:31:11.408 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12410 fp=#0x200000010ae' 2024-08-31T04:31:11.408 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12442 fp=#0x200000010c0' 2024-08-31T04:31:11.408 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12474 fp=#0x20000001ed4' 2024-08-31T04:31:11.409 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12506 fp=#0x20000001e86' 2024-08-31T04:31:11.409 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12538 fp=#0x20000000a0f' 2024-08-31T04:31:11.409 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12570 fp=#0x20000000a5f' 2024-08-31T04:31:11.410 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12602 fp=#0x20000000a45' 2024-08-31T04:31:11.410 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12634 fp=#0x200000009db' 2024-08-31T04:31:11.410 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12666 fp=#0x200000009ef' 2024-08-31T04:31:11.411 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12698 fp=#0x10000000e29' 2024-08-31T04:31:11.411 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12730 fp=#0x10000000d5a' 2024-08-31T04:31:11.411 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12762 fp=#0x10000000d0a' 2024-08-31T04:31:11.412 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12794 fp=#0x10000000e21' 2024-08-31T04:31:11.412 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12826 fp=#0x10000000e42' 2024-08-31T04:31:11.412 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12858 fp=#0x10000002e92' 2024-08-31T04:31:11.413 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12890 fp=#0x10000002ec7' 2024-08-31T04:31:11.413 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12922 fp=#0x20000002148' 2024-08-31T04:31:11.413 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12954 fp=#0x10000002f14' 2024-08-31T04:31:11.414 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12986 fp=#0x20000002164' 2024-08-31T04:31:11.414 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13018 fp=#0x20000002152' 2024-08-31T04:31:11.414 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13049 fp=#0x20000000712' 2024-08-31T04:31:11.415 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13081 fp=#0x20000000750' 2024-08-31T04:31:11.415 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13113 fp=#0x2000000076b' 2024-08-31T04:31:11.415 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13145 fp=#0x20000000710' 2024-08-31T04:31:11.416 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13177 fp=#0x20000001502' 2024-08-31T04:31:11.416 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13209 fp=#0x20000000bf7' 2024-08-31T04:31:11.416 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13241 fp=#0x20000000bd1' 2024-08-31T04:31:11.417 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13273 fp=#0x20000000bae' 2024-08-31T04:31:11.417 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13305 fp=#0x20000000be5' 2024-08-31T04:31:11.417 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13337 fp=#0x20000000b72' 2024-08-31T04:31:11.418 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13369 fp=#0x20000001c48' 2024-08-31T04:31:11.418 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13401 fp=#0x20000001c94' 2024-08-31T04:31:11.418 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13433 fp=#0x20000001d1c' 2024-08-31T04:31:11.419 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13465 fp=#0x20000001c68' 2024-08-31T04:31:11.419 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13497 fp=#0x10000003b09' 2024-08-31T04:31:11.420 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13556 fp=#0x20000001170' 2024-08-31T04:31:11.421 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13684 fp=#0x10000002e1e' 2024-08-31T04:31:11.421 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13716 fp=#0x10000002eba' 2024-08-31T04:31:11.421 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13748 fp=#0x10000002f47' 2024-08-31T04:31:11.422 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13780 fp=#0x10000002e30' 2024-08-31T04:31:11.422 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13812 fp=#0x200000015ca' 2024-08-31T04:31:11.423 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13844 fp=#0x2000000081c' 2024-08-31T04:31:11.423 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13876 fp=#0x20000000cc8' 2024-08-31T04:31:11.423 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13908 fp=#0x20000000d1e' 2024-08-31T04:31:11.424 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13940 fp=#0x20000000d36' 2024-08-31T04:31:11.424 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13972 fp=#0x200000021fb' 2024-08-31T04:31:11.424 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14004 fp=#0x200000019ce' 2024-08-31T04:31:11.425 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14036 fp=#0x200000019ca' 2024-08-31T04:31:11.425 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14068 fp=#0x200000019e5' 2024-08-31T04:31:11.425 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14100 fp=#0x200000019f6' 2024-08-31T04:31:11.426 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14132 fp=#0x200000008df' 2024-08-31T04:31:11.426 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14164 fp=#0x200000008eb' 2024-08-31T04:31:11.426 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14196 fp=#0x200000008b7' 2024-08-31T04:31:11.426 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14228 fp=#0x200000008e4' 2024-08-31T04:31:11.427 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14324 fp=#0x20000001dbf' 2024-08-31T04:31:11.428 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14356 fp=#0x20000001df6' 2024-08-31T04:31:11.428 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14388 fp=#0x20000001db3' 2024-08-31T04:31:11.428 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14420 fp=#0x20000001e4d' 2024-08-31T04:31:11.429 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14452 fp=#0x2000000188d' 2024-08-31T04:31:11.429 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14484 fp=#0x200000018bc' 2024-08-31T04:31:11.429 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14516 fp=#0x2000000181b' 2024-08-31T04:31:11.430 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14548 fp=#0x20000000f13' 2024-08-31T04:31:11.430 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14580 fp=#0x20000000f05' 2024-08-31T04:31:11.430 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14612 fp=#0x20000000ff5' 2024-08-31T04:31:11.431 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14644 fp=#0x20000000f2c' 2024-08-31T04:31:11.431 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14676 fp=#0x20000001004' 2024-08-31T04:31:11.431 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14708 fp=#0x20000000f46' 2024-08-31T04:31:11.432 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14740 fp=#0x10000004649' 2024-08-31T04:31:11.432 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14772 fp=#0x20000000c00' 2024-08-31T04:31:11.433 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14850 fp=#0x10000003170' 2024-08-31T04:31:11.433 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14882 fp=#0x1000000311b' 2024-08-31T04:31:11.434 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14914 fp=#0x10000003147' 2024-08-31T04:31:11.434 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14946 fp=#0x1000000311f' 2024-08-31T04:31:11.434 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14978 fp=#0x20000001a8c' 2024-08-31T04:31:11.435 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15010 fp=#0x2000000175c' 2024-08-31T04:31:11.435 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15042 fp=#0x20000001773' 2024-08-31T04:31:11.435 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15074 fp=#0x20000001719' 2024-08-31T04:31:11.436 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15106 fp=#0x20000001751' 2024-08-31T04:31:11.436 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15137 fp=#0x100000057ba' 2024-08-31T04:31:11.437 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15169 fp=#0x20000001618' 2024-08-31T04:31:11.437 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15201 fp=#0x100000017a3' 2024-08-31T04:31:11.437 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15233 fp=#0x10000001723' 2024-08-31T04:31:11.438 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15265 fp=#0x20000002278' 2024-08-31T04:31:11.438 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15297 fp=#0x200000021c1' 2024-08-31T04:31:11.438 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15329 fp=#0x2000000220c' 2024-08-31T04:31:11.439 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15425 fp=#0x20000001018' 2024-08-31T04:31:11.440 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15457 fp=#0x2000000204b' 2024-08-31T04:31:11.440 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15489 fp=#0x20000001a32' 2024-08-31T04:31:11.440 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15521 fp=#0x1000000533a' 2024-08-31T04:31:11.441 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15553 fp=#0x200000019f9' 2024-08-31T04:31:11.441 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15585 fp=#0x200000019fe' 2024-08-31T04:31:11.441 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15617 fp=#0x10000004eb0' 2024-08-31T04:31:11.442 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15649 fp=#0x10000004eb4' 2024-08-31T04:31:11.442 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15681 fp=#0x10000004e9c' 2024-08-31T04:31:11.442 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15713 fp=#0x10000004e08' 2024-08-31T04:31:11.443 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15745 fp=#0x10000004e4d' 2024-08-31T04:31:11.443 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15777 fp=#0x20000002288' 2024-08-31T04:31:11.444 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15841 fp=#0x20000001fa9' 2024-08-31T04:31:11.444 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15937 fp=#0x10000001778' 2024-08-31T04:31:11.445 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16001 fp=#0x20000000eb9' 2024-08-31T04:31:11.445 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16033 fp=#0x200000017da' 2024-08-31T04:31:11.446 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16065 fp=#0x200000017e2' 2024-08-31T04:31:11.446 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16129 fp=#0x20000001124' 2024-08-31T04:31:11.447 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16161 fp=#0x20000001113' 2024-08-31T04:31:11.447 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16193 fp=#0x2000000160f' 2024-08-31T04:31:11.448 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16225 fp=#0x20000001599' 2024-08-31T04:31:11.448 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16257 fp=#0x200000015f7' 2024-08-31T04:31:11.448 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16288 fp=#0x100000044f7' 2024-08-31T04:31:11.449 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16320 fp=#0x10000004512' 2024-08-31T04:31:11.449 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16352 fp=#0x10000004516' 2024-08-31T04:31:11.449 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16384 fp=#0x1000000482a' 2024-08-31T04:31:11.450 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16416 fp=#0x1000000480a' 2024-08-31T04:31:11.450 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16448 fp=#0x100000044ff' 2024-08-31T04:31:11.450 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16480 fp=#0x10000004e06' 2024-08-31T04:31:11.451 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16512 fp=#0x10000004e5f' 2024-08-31T04:31:11.451 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16544 fp=#0x100000048de' 2024-08-31T04:31:11.452 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16608 fp=#0x200000022b8' 2024-08-31T04:31:11.452 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16640 fp=#0x200000022c1' 2024-08-31T04:31:11.452 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16672 fp=#0x2000000044b' 2024-08-31T04:31:11.453 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16704 fp=#0x10000002ab6' 2024-08-31T04:31:11.453 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16736 fp=#0x20000000442' 2024-08-31T04:31:11.453 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16768 fp=#0x10000002a98' 2024-08-31T04:31:11.454 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16800 fp=#0x20000000420' 2024-08-31T04:31:11.454 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16832 fp=#0x20000000436' 2024-08-31T04:31:11.455 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16864 fp=#0x100000045bb' 2024-08-31T04:31:11.455 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16896 fp=#0x10000004584' 2024-08-31T04:31:11.455 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16928 fp=#0x100000045b9' 2024-08-31T04:31:11.455 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16960 fp=#0x10000004592' 2024-08-31T04:31:11.456 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17088 fp=#0x10000005798' 2024-08-31T04:31:11.457 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17120 fp=#0x10000005792' 2024-08-31T04:31:11.457 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17184 fp=#0x10000005732' 2024-08-31T04:31:11.458 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17216 fp=#0x100000054e8' 2024-08-31T04:31:11.458 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17248 fp=#0x10000005480' 2024-08-31T04:31:11.458 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17280 fp=#0x10000005477' 2024-08-31T04:31:11.459 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17344 fp=#0x20000001ac0' 2024-08-31T04:31:11.459 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17376 fp=#0x20000001a69' 2024-08-31T04:31:11.459 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17408 fp=#0x20000001ac4' 2024-08-31T04:31:11.460 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17440 fp=#0x10000004d5d' 2024-08-31T04:31:11.460 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17472 fp=#0x10000004d8d' 2024-08-31T04:31:11.460 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17504 fp=#0x10000004dc2' 2024-08-31T04:31:11.461 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17536 fp=#0x20000001b81' 2024-08-31T04:31:11.461 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17568 fp=#0x20000001b26' 2024-08-31T04:31:11.461 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17600 fp=#0x20000001b08' 2024-08-31T04:31:11.462 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17632 fp=#0x100000029d7' 2024-08-31T04:31:11.462 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17664 fp=#0x10000002a16' 2024-08-31T04:31:11.462 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17696 fp=#0x2000000049c' 2024-08-31T04:31:11.463 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17728 fp=#0x20000001f42' 2024-08-31T04:31:11.463 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17760 fp=#0x10000004f42' 2024-08-31T04:31:11.463 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17792 fp=#0x10000004f2c' 2024-08-31T04:31:11.464 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17824 fp=#0x10000004f19' 2024-08-31T04:31:11.464 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17888 fp=#0x10000001119' 2024-08-31T04:31:11.465 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17984 fp=#0x20000001cc5' 2024-08-31T04:31:11.465 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18016 fp=#0x20000001d5b' 2024-08-31T04:31:11.466 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18048 fp=#0x20000001c93' 2024-08-31T04:31:11.466 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18080 fp=#0x20000001725' 2024-08-31T04:31:11.466 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18112 fp=#0x200000016f1' 2024-08-31T04:31:11.467 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18144 fp=#0x2000000170e' 2024-08-31T04:31:11.467 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18176 fp=#0x20000000c61' 2024-08-31T04:31:11.467 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18208 fp=#0x20000000c2f' 2024-08-31T04:31:11.468 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18240 fp=#0x20000000c59' 2024-08-31T04:31:11.468 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18269 fp=#0x2000000085c' 2024-08-31T04:31:11.468 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18301 fp=#0x20000000849' 2024-08-31T04:31:11.469 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18333 fp=#0x200000022d1' 2024-08-31T04:31:11.469 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18392 fp=#0x2000000217e' 2024-08-31T04:31:11.470 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18424 fp=#0x20000002191' 2024-08-31T04:31:11.470 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18456 fp=#0x20000002177' 2024-08-31T04:31:11.471 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18488 fp=#0x20000002173' 2024-08-31T04:31:11.471 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18550 fp=#0x400000006c0' 2024-08-31T04:31:11.471 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18582 fp=#0x10000003659' 2024-08-31T04:31:11.472 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:7177 fp=#0x20000001ad7' 2024-08-31T04:31:11.472 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:7273 fp=#0x10000004ddd' 2024-08-31T04:31:11.474 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:7497 fp=#0x20000001fa8' 2024-08-31T04:31:11.484 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:8768 fp=#0x2000000083a' 2024-08-31T04:31:11.485 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:8864 fp=#0x20000000666' 2024-08-31T04:31:11.485 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:8896 fp=#0x2000000068f' 2024-08-31T04:31:11.486 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:8928 fp=#0x2000000061c' 2024-08-31T04:31:11.486 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:8960 fp=#0x20000000677' 2024-08-31T04:31:11.487 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9088 fp=#0x20000000f55' 2024-08-31T04:31:11.488 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9120 fp=#0x20000001d2e' 2024-08-31T04:31:11.488 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9152 fp=#0x20000000864' 2024-08-31T04:31:11.488 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9184 fp=#0x20000001c99' 2024-08-31T04:31:11.489 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9216 fp=#0x20000000888' 2024-08-31T04:31:11.489 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9248 fp=#0x2000000088d' 2024-08-31T04:31:11.490 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9376 fp=#0x20000000991' 2024-08-31T04:31:11.491 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9408 fp=#0x20000001557' 2024-08-31T04:31:11.491 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9440 fp=#0x20000000985' 2024-08-31T04:31:11.491 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9472 fp=#0x20000001563' 2024-08-31T04:31:11.492 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9504 fp=#0x20000000974' 2024-08-31T04:31:11.492 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9536 fp=#0x20000001567' 2024-08-31T04:31:11.492 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9568 fp=#0x20000000992' 2024-08-31T04:31:11.493 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9632 fp=#0x200000018c9' 2024-08-31T04:31:11.494 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9696 fp=#0x20000001f6e' 2024-08-31T04:31:11.494 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9728 fp=#0x20000001f68' 2024-08-31T04:31:11.494 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9760 fp=#0x20000000b06' 2024-08-31T04:31:11.495 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9792 fp=#0x20000000b4d' 2024-08-31T04:31:11.495 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9824 fp=#0x20000001e44' 2024-08-31T04:31:11.495 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9856 fp=#0x20000001ee3' 2024-08-31T04:31:11.495 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9888 fp=#0x20000001e6d' 2024-08-31T04:31:11.496 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9920 fp=#0x20000001e58' 2024-08-31T04:31:11.497 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10047 fp=#0x20000000dc4' 2024-08-31T04:31:11.497 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10079 fp=#0x20000000e05' 2024-08-31T04:31:11.498 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10111 fp=#0x20000000dd0' 2024-08-31T04:31:11.498 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10143 fp=#0x20000000d82' 2024-08-31T04:31:11.498 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10175 fp=#0x20000000df4' 2024-08-31T04:31:11.499 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10207 fp=#0x20000001009' 2024-08-31T04:31:11.499 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10239 fp=#0x20000001053' 2024-08-31T04:31:11.499 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10271 fp=#0x20000000fcf' 2024-08-31T04:31:11.500 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10303 fp=#0x20000001065' 2024-08-31T04:31:11.500 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10335 fp=#0x20000000936' 2024-08-31T04:31:11.501 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10431 fp=#0x200000008fc' 2024-08-31T04:31:11.501 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10463 fp=#0x1000000184d' 2024-08-31T04:31:11.501 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10495 fp=#0x10000001112' 2024-08-31T04:31:11.502 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10527 fp=#0x10000000ca7' 2024-08-31T04:31:11.502 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10559 fp=#0x10000000b4f' 2024-08-31T04:31:11.502 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10591 fp=#0x10000000c23' 2024-08-31T04:31:11.503 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10623 fp=#0x200000020fd' 2024-08-31T04:31:11.503 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10655 fp=#0x2000000208c' 2024-08-31T04:31:11.503 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10687 fp=#0x200000020c2' 2024-08-31T04:31:11.504 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10719 fp=#0x10000002870' 2024-08-31T04:31:11.505 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10815 fp=#0x100000038fb' 2024-08-31T04:31:11.505 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10847 fp=#0x10000003457' 2024-08-31T04:31:11.505 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10879 fp=#0x10000003467' 2024-08-31T04:31:11.506 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10911 fp=#0x200000005df' 2024-08-31T04:31:11.506 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10943 fp=#0x100000033f3' 2024-08-31T04:31:11.506 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10975 fp=#0x1000000345d' 2024-08-31T04:31:11.507 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11007 fp=#0x1000000398a' 2024-08-31T04:31:11.507 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11039 fp=#0x10000003a07' 2024-08-31T04:31:11.507 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11071 fp=#0x10000003cea' 2024-08-31T04:31:11.508 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11103 fp=#0x10000003dbf' 2024-08-31T04:31:11.508 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11167 fp=#0x10000003de2' 2024-08-31T04:31:11.509 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11199 fp=#0x10000003b85' 2024-08-31T04:31:11.509 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11227 fp=#0x20000000e6e' 2024-08-31T04:31:11.510 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11259 fp=#0x20000000e64' 2024-08-31T04:31:11.510 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11291 fp=#0x20000000e78' 2024-08-31T04:31:11.510 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11323 fp=#0x200000019a5' 2024-08-31T04:31:11.511 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11355 fp=#0x20000001e5b' 2024-08-31T04:31:11.511 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11387 fp=#0x20000001dfe' 2024-08-31T04:31:11.511 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11419 fp=#0x20000001915' 2024-08-31T04:31:11.512 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11451 fp=#0x20000001965' 2024-08-31T04:31:11.512 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11483 fp=#0x20000001e02' 2024-08-31T04:31:11.512 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11515 fp=#0x200000018c2' 2024-08-31T04:31:11.513 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11547 fp=#0x100000045cc' 2024-08-31T04:31:11.513 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11579 fp=#0x10000004600' 2024-08-31T04:31:11.513 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11611 fp=#0x100000045de' 2024-08-31T04:31:11.514 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11643 fp=#0x2000000065b' 2024-08-31T04:31:11.514 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11675 fp=#0x200000006bb' 2024-08-31T04:31:11.514 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11707 fp=#0x20000001976' 2024-08-31T04:31:11.515 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11739 fp=#0x2000000069d' 2024-08-31T04:31:11.515 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11803 fp=#0x20000000648' 2024-08-31T04:31:11.516 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11835 fp=#0x20000000662' 2024-08-31T04:31:11.516 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11867 fp=#0x200000022e8' 2024-08-31T04:31:11.516 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11899 fp=#0x20000001621' 2024-08-31T04:31:11.517 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11931 fp=#0x20000001633' 2024-08-31T04:31:11.517 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11963 fp=#0x20000001655' 2024-08-31T04:31:11.517 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11995 fp=#0x20000001714' 2024-08-31T04:31:11.518 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12027 fp=#0x200000016ea' 2024-08-31T04:31:11.518 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12059 fp=#0x200000016c9' 2024-08-31T04:31:11.518 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12091 fp=#0x200000016ae' 2024-08-31T04:31:11.519 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12187 fp=#0x200000014d3' 2024-08-31T04:31:11.519 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12219 fp=#0x20000001fb2' 2024-08-31T04:31:11.520 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12251 fp=#0x200000014be' 2024-08-31T04:31:11.520 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12315 fp=#0x20000001fbc' 2024-08-31T04:31:11.521 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12347 fp=#0x2000000104d' 2024-08-31T04:31:11.521 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12379 fp=#0x200000010de' 2024-08-31T04:31:11.522 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12411 fp=#0x20000001095' 2024-08-31T04:31:11.522 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12443 fp=#0x2000000109c' 2024-08-31T04:31:11.522 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12475 fp=#0x20000001f04' 2024-08-31T04:31:11.523 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12507 fp=#0x20000001f19' 2024-08-31T04:31:11.523 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12539 fp=#0x20000000a0b' 2024-08-31T04:31:11.523 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12571 fp=#0x200000009d9' 2024-08-31T04:31:11.524 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12603 fp=#0x20000000a3a' 2024-08-31T04:31:11.524 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12635 fp=#0x20000000a40' 2024-08-31T04:31:11.524 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12667 fp=#0x20000000a11' 2024-08-31T04:31:11.524 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12699 fp=#0x10000000d52' 2024-08-31T04:31:11.525 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12731 fp=#0x200000001ff' 2024-08-31T04:31:11.525 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12763 fp=#0x200000003df' 2024-08-31T04:31:11.525 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12795 fp=#0x10000000e19' 2024-08-31T04:31:11.526 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12827 fp=#0x10000000d7a' 2024-08-31T04:31:11.526 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12859 fp=#0x10000002f50' 2024-08-31T04:31:11.526 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12891 fp=#0x10000002f0e' 2024-08-31T04:31:11.527 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12923 fp=#0x20000002163' 2024-08-31T04:31:11.527 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12955 fp=#0x200000020ea' 2024-08-31T04:31:11.527 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12987 fp=#0x10000002e77' 2024-08-31T04:31:11.528 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13019 fp=#0x10000002f3c' 2024-08-31T04:31:11.528 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13050 fp=#0x20000000773' 2024-08-31T04:31:11.528 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13082 fp=#0x20000000794' 2024-08-31T04:31:11.529 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13114 fp=#0x20000000780' 2024-08-31T04:31:11.529 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13146 fp=#0x2000000079d' 2024-08-31T04:31:11.529 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13178 fp=#0x2000000078d' 2024-08-31T04:31:11.530 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13210 fp=#0x20000000bd8' 2024-08-31T04:31:11.530 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13242 fp=#0x20000000bb7' 2024-08-31T04:31:11.530 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13274 fp=#0x20000000bb6' 2024-08-31T04:31:11.531 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13306 fp=#0x20000000b8c' 2024-08-31T04:31:11.531 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13338 fp=#0x20000000be0' 2024-08-31T04:31:11.531 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13370 fp=#0x20000001c75' 2024-08-31T04:31:11.532 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13402 fp=#0x20000001d2a' 2024-08-31T04:31:11.532 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13434 fp=#0x20000001d0f' 2024-08-31T04:31:11.532 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13466 fp=#0x20000001d60' 2024-08-31T04:31:11.533 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13498 fp=#0x10000003b2a' 2024-08-31T04:31:11.534 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13653 fp=#0x2000000213d' 2024-08-31T04:31:11.534 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13685 fp=#0x10000002f53' 2024-08-31T04:31:11.535 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13717 fp=#0x10000002e37' 2024-08-31T04:31:11.535 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13749 fp=#0x10000002e93' 2024-08-31T04:31:11.535 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13781 fp=#0x2000000082c' 2024-08-31T04:31:11.536 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13813 fp=#0x200000015c4' 2024-08-31T04:31:11.536 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13845 fp=#0x200000015e9' 2024-08-31T04:31:11.536 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13877 fp=#0x20000000dc0' 2024-08-31T04:31:11.537 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13909 fp=#0x20000002242' 2024-08-31T04:31:11.537 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13941 fp=#0x20000000cf2' 2024-08-31T04:31:11.537 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13973 fp=#0x20000000d4c' 2024-08-31T04:31:11.538 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14005 fp=#0x200000019e8' 2024-08-31T04:31:11.538 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14037 fp=#0x20000001a46' 2024-08-31T04:31:11.538 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14069 fp=#0x200000019c5' 2024-08-31T04:31:11.539 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14101 fp=#0x20000001a4b' 2024-08-31T04:31:11.539 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14133 fp=#0x20000000948' 2024-08-31T04:31:11.539 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14165 fp=#0x2000000091b' 2024-08-31T04:31:11.540 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14197 fp=#0x200000008fa' 2024-08-31T04:31:11.540 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14229 fp=#0x20000000909' 2024-08-31T04:31:11.541 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14357 fp=#0x20000001dc9' 2024-08-31T04:31:11.541 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14389 fp=#0x20000001e54' 2024-08-31T04:31:11.542 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14421 fp=#0x20000001e18' 2024-08-31T04:31:11.542 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14453 fp=#0x20000001821' 2024-08-31T04:31:11.542 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14485 fp=#0x20000001805' 2024-08-31T04:31:11.542 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14517 fp=#0x2000000189e' 2024-08-31T04:31:11.543 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14549 fp=#0x20000000f4b' 2024-08-31T04:31:11.543 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14581 fp=#0x20000000f1a' 2024-08-31T04:31:11.544 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14613 fp=#0x20000000f25' 2024-08-31T04:31:11.544 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14645 fp=#0x20000001000' 2024-08-31T04:31:11.544 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14677 fp=#0x20000000f3a' 2024-08-31T04:31:11.545 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14709 fp=#0x20000000f4c' 2024-08-31T04:31:11.545 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14805 fp=#0x20000000c05' 2024-08-31T04:31:11.546 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14851 fp=#0x10000003227' 2024-08-31T04:31:11.546 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14883 fp=#0x200000022a6' 2024-08-31T04:31:11.546 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14915 fp=#0x10000003145' 2024-08-31T04:31:11.547 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14947 fp=#0x100000031c3' 2024-08-31T04:31:11.547 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14979 fp=#0x100000058ac' 2024-08-31T04:31:11.547 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15011 fp=#0x200000017fc' 2024-08-31T04:31:11.548 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15043 fp=#0x2000000175f' 2024-08-31T04:31:11.548 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15075 fp=#0x200000017a8' 2024-08-31T04:31:11.548 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15107 fp=#0x2000000179c' 2024-08-31T04:31:11.549 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15138 fp=#0x100000057b5' 2024-08-31T04:31:11.549 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15170 fp=#0x100000057b0' 2024-08-31T04:31:11.550 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15202 fp=#0x10000001726' 2024-08-31T04:31:11.550 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15234 fp=#0x100000016ff' 2024-08-31T04:31:11.550 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15266 fp=#0x20000002226' 2024-08-31T04:31:11.550 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15298 fp=#0x200000021df' 2024-08-31T04:31:11.551 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15330 fp=#0x20000002258' 2024-08-31T04:31:11.552 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15394 fp=#0x20000002090' 2024-08-31T04:31:11.552 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15490 fp=#0x20000001a1e' 2024-08-31T04:31:11.553 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15522 fp=#0x20000001634' 2024-08-31T04:31:11.553 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15554 fp=#0x20000001a0a' 2024-08-31T04:31:11.553 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15586 fp=#0x200000019f0' 2024-08-31T04:31:11.554 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15618 fp=#0x20000001d69' 2024-08-31T04:31:11.554 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15650 fp=#0x10000004ea2' 2024-08-31T04:31:11.554 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15682 fp=#0x10000004ec8' 2024-08-31T04:31:11.555 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15714 fp=#0x10000004e76' 2024-08-31T04:31:11.555 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15746 fp=#0x10000004e5b' 2024-08-31T04:31:11.556 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15938 fp=#0x100000018c7' 2024-08-31T04:31:11.557 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16002 fp=#0x2000000193b' 2024-08-31T04:31:11.557 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16034 fp=#0x20000000ebd' 2024-08-31T04:31:11.558 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16066 fp=#0x200000018fb' 2024-08-31T04:31:11.558 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16098 fp=#0x20000001116' 2024-08-31T04:31:11.558 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16130 fp=#0x200000011ae' 2024-08-31T04:31:11.559 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16162 fp=#0x20000001127' 2024-08-31T04:31:11.559 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16194 fp=#0x20000001590' 2024-08-31T04:31:11.559 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16226 fp=#0x200000015b2' 2024-08-31T04:31:11.560 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16258 fp=#0x200000015c9' 2024-08-31T04:31:11.560 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16289 fp=#0x10000004525' 2024-08-31T04:31:11.560 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16321 fp=#0x10000004504' 2024-08-31T04:31:11.561 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16353 fp=#0x10000004899' 2024-08-31T04:31:11.561 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16417 fp=#0x10000004825' 2024-08-31T04:31:11.561 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16449 fp=#0x1000000450a' 2024-08-31T04:31:11.562 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16481 fp=#0x1000000498a' 2024-08-31T04:31:11.562 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16513 fp=#0x10000004e01' 2024-08-31T04:31:11.562 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16545 fp=#0x20000001184' 2024-08-31T04:31:11.563 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16577 fp=#0x100000048cd' 2024-08-31T04:31:11.563 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16609 fp=#0x200000022c8' 2024-08-31T04:31:11.563 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16641 fp=#0x2000000228d' 2024-08-31T04:31:11.564 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16673 fp=#0x200000014bf' 2024-08-31T04:31:11.564 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16705 fp=#0x10000002aea' 2024-08-31T04:31:11.564 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16737 fp=#0x2000000040d' 2024-08-31T04:31:11.565 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16769 fp=#0x20000000ae0' 2024-08-31T04:31:11.565 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16801 fp=#0x10000002a9a' 2024-08-31T04:31:11.566 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16833 fp=#0x10000002a69' 2024-08-31T04:31:11.566 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16865 fp=#0x10000004556' 2024-08-31T04:31:11.566 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16897 fp=#0x1000000456d' 2024-08-31T04:31:11.567 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16929 fp=#0x10000005d56' 2024-08-31T04:31:11.568 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17153 fp=#0x10000005730' 2024-08-31T04:31:11.569 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17249 fp=#0x10000005487' 2024-08-31T04:31:11.570 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17313 fp=#0x10000005465' 2024-08-31T04:31:11.570 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17345 fp=#0x20000001acf' 2024-08-31T04:31:11.570 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17377 fp=#0x20000001a73' 2024-08-31T04:31:11.571 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17409 fp=#0x20000001a99' 2024-08-31T04:31:11.571 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17441 fp=#0x10000004dfe' 2024-08-31T04:31:11.571 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17473 fp=#0x2000000165c' 2024-08-31T04:31:11.571 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17505 fp=#0x10000004db6' 2024-08-31T04:31:11.572 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17537 fp=#0x20000001b95' 2024-08-31T04:31:11.572 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17569 fp=#0x20000001b80' 2024-08-31T04:31:11.572 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17601 fp=#0x20000001b54' 2024-08-31T04:31:11.573 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17633 fp=#0x20000001f3f' 2024-08-31T04:31:11.573 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17665 fp=#0x20000001f53' 2024-08-31T04:31:11.573 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17697 fp=#0x20000001f5e' 2024-08-31T04:31:11.574 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17729 fp=#0x200000004a1' 2024-08-31T04:31:11.574 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17761 fp=#0x10000005c13' 2024-08-31T04:31:11.574 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17793 fp=#0x10000004f4d' 2024-08-31T04:31:11.575 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17825 fp=#0x10000004ef2' 2024-08-31T04:31:11.576 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17953 fp=#0x10000001126' 2024-08-31T04:31:11.576 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17985 fp=#0x20000001ca3' 2024-08-31T04:31:11.576 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18017 fp=#0x20000001d39' 2024-08-31T04:31:11.577 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18049 fp=#0x20000001c5a' 2024-08-31T04:31:11.577 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18081 fp=#0x2000000178a' 2024-08-31T04:31:11.577 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18113 fp=#0x200000016f7' 2024-08-31T04:31:11.577 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18145 fp=#0x20000001754' 2024-08-31T04:31:11.578 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18177 fp=#0x20000000d14' 2024-08-31T04:31:11.578 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18209 fp=#0x20000000c2d' 2024-08-31T04:31:11.578 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18241 fp=#0x20000000c4f' 2024-08-31T04:31:11.579 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18270 fp=#0x10000004a08' 2024-08-31T04:31:11.579 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18302 fp=#0x100000049f1' 2024-08-31T04:31:11.579 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18334 fp=#0x2000000085b' 2024-08-31T04:31:11.580 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18366 fp=#0x10000004926' 2024-08-31T04:31:11.580 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18393 fp=#0x20000002253' 2024-08-31T04:31:11.580 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18425 fp=#0x20000002203' 2024-08-31T04:31:11.581 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18457 fp=#0x200000021a4' 2024-08-31T04:31:11.581 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18489 fp=#0x200000021a2' 2024-08-31T04:31:11.582 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18551 fp=#0x10000003665' 2024-08-31T04:31:11.582 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18583 fp=#0x1000000361c' 2024-08-31T04:31:11.583 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:7210 fp=#0x10000002e6a' 2024-08-31T04:31:11.583 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:7274 fp=#0x1000000176e' 2024-08-31T04:31:11.584 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:7434 fp=#0x2000000201d' 2024-08-31T04:31:11.585 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:7466 fp=#0x20000001f7b' 2024-08-31T04:31:11.596 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:8650 fp=#0x200000016d3' 2024-08-31T04:31:11.596 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:8682 fp=#0x20000000ad5' 2024-08-31T04:31:11.598 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:8865 fp=#0x2000000063b' 2024-08-31T04:31:11.599 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:8929 fp=#0x20000000684' 2024-08-31T04:31:11.599 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:8961 fp=#0x20000000663' 2024-08-31T04:31:11.599 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:8993 fp=#0x2000000184b' 2024-08-31T04:31:11.600 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9025 fp=#0x20000000fda' 2024-08-31T04:31:11.600 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9089 fp=#0x20000000fb9' 2024-08-31T04:31:11.601 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9121 fp=#0x20000001cbc' 2024-08-31T04:31:11.601 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9153 fp=#0x20000001c7f' 2024-08-31T04:31:11.601 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9185 fp=#0x20000001d91' 2024-08-31T04:31:11.602 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9217 fp=#0x20000001cb5' 2024-08-31T04:31:11.602 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9249 fp=#0x20000001d8b' 2024-08-31T04:31:11.603 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9377 fp=#0x20000001589' 2024-08-31T04:31:11.603 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9409 fp=#0x2000000098b' 2024-08-31T04:31:11.604 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9441 fp=#0x20000001544' 2024-08-31T04:31:11.604 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9473 fp=#0x2000000157d' 2024-08-31T04:31:11.604 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9505 fp=#0x2000000095c' 2024-08-31T04:31:11.605 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9537 fp=#0x200000009b1' 2024-08-31T04:31:11.605 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9569 fp=#0x200000009b5' 2024-08-31T04:31:11.605 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9601 fp=#0x20000001881' 2024-08-31T04:31:11.606 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9697 fp=#0x20000000b0b' 2024-08-31T04:31:11.606 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9729 fp=#0x20000001f7f' 2024-08-31T04:31:11.607 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9761 fp=#0x20000000b34' 2024-08-31T04:31:11.607 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9793 fp=#0x20000000b3b' 2024-08-31T04:31:11.607 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9825 fp=#0x20000001ecd' 2024-08-31T04:31:11.608 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9857 fp=#0x20000001e78' 2024-08-31T04:31:11.608 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9889 fp=#0x20000001ebb' 2024-08-31T04:31:11.609 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10048 fp=#0x20000000d81' 2024-08-31T04:31:11.609 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10080 fp=#0x20000000de3' 2024-08-31T04:31:11.610 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10112 fp=#0x20000000de2' 2024-08-31T04:31:11.610 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10144 fp=#0x20000000e28' 2024-08-31T04:31:11.610 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10176 fp=#0x20000000dc1' 2024-08-31T04:31:11.611 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10208 fp=#0x2000000100c' 2024-08-31T04:31:11.611 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10240 fp=#0x2000000107f' 2024-08-31T04:31:11.611 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10272 fp=#0x200000006e7' 2024-08-31T04:31:11.611 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10304 fp=#0x20000001056' 2024-08-31T04:31:11.612 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10336 fp=#0x20000000947' 2024-08-31T04:31:11.612 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10368 fp=#0x200000014d1' 2024-08-31T04:31:11.612 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10400 fp=#0x20000000934' 2024-08-31T04:31:11.613 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10464 fp=#0x10000000c11' 2024-08-31T04:31:11.613 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10496 fp=#0x10000000b61' 2024-08-31T04:31:11.614 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10528 fp=#0x10000001167' 2024-08-31T04:31:11.614 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10560 fp=#0x10000000c27' 2024-08-31T04:31:11.614 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10592 fp=#0x10000000c58' 2024-08-31T04:31:11.614 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10624 fp=#0x2000000203e' 2024-08-31T04:31:11.615 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10656 fp=#0x2000000209e' 2024-08-31T04:31:11.615 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10688 fp=#0x200000020a6' 2024-08-31T04:31:11.616 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10816 fp=#0x100000033e6' 2024-08-31T04:31:11.617 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10848 fp=#0x1000000347f' 2024-08-31T04:31:11.617 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10880 fp=#0x20000000605' 2024-08-31T04:31:11.617 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10912 fp=#0x100000033fc' 2024-08-31T04:31:11.618 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10944 fp=#0x200000005f9' 2024-08-31T04:31:11.618 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10976 fp=#0x10000003425' 2024-08-31T04:31:11.619 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11040 fp=#0x10000003b69' 2024-08-31T04:31:11.619 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11104 fp=#0x10000003c25' 2024-08-31T04:31:11.620 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11136 fp=#0x10000003988' 2024-08-31T04:31:11.620 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11168 fp=#0x1000000399b' 2024-08-31T04:31:11.621 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11228 fp=#0x20000000e90' 2024-08-31T04:31:11.621 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11260 fp=#0x20000000e75' 2024-08-31T04:31:11.621 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11292 fp=#0x20000000e92' 2024-08-31T04:31:11.622 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11324 fp=#0x2000000191b' 2024-08-31T04:31:11.622 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11356 fp=#0x200000018f8' 2024-08-31T04:31:11.622 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11388 fp=#0x20000001e2d' 2024-08-31T04:31:11.623 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11420 fp=#0x20000001e8c' 2024-08-31T04:31:11.623 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11452 fp=#0x200000018a1' 2024-08-31T04:31:11.623 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11484 fp=#0x20000001964' 2024-08-31T04:31:11.623 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11516 fp=#0x20000001ee5' 2024-08-31T04:31:11.624 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11548 fp=#0x10000004630' 2024-08-31T04:31:11.624 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11580 fp=#0x10000004664' 2024-08-31T04:31:11.624 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11612 fp=#0x10000004620' 2024-08-31T04:31:11.625 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11644 fp=#0x20000000ae3' 2024-08-31T04:31:11.625 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11676 fp=#0x20000000643' 2024-08-31T04:31:11.625 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11708 fp=#0x200000006ac' 2024-08-31T04:31:11.626 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11740 fp=#0x20000002145' 2024-08-31T04:31:11.626 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11772 fp=#0x20000000683' 2024-08-31T04:31:11.627 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11836 fp=#0x200000006c7' 2024-08-31T04:31:11.627 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11868 fp=#0x200000022e0' 2024-08-31T04:31:11.627 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11900 fp=#0x20000000aa7' 2024-08-31T04:31:11.627 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11932 fp=#0x20000000a83' 2024-08-31T04:31:11.628 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11964 fp=#0x20000000a77' 2024-08-31T04:31:11.628 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11996 fp=#0x2000000169e' 2024-08-31T04:31:11.628 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12028 fp=#0x200000016cf' 2024-08-31T04:31:11.629 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12060 fp=#0x200000016da' 2024-08-31T04:31:11.629 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12092 fp=#0x200000016cb' 2024-08-31T04:31:11.630 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12188 fp=#0x20000001fd1' 2024-08-31T04:31:11.631 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12316 fp=#0x20000001fa7' 2024-08-31T04:31:11.631 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12348 fp=#0x200000010d3' 2024-08-31T04:31:11.632 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12380 fp=#0x200000010cc' 2024-08-31T04:31:11.632 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12412 fp=#0x2000000108f' 2024-08-31T04:31:11.632 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12444 fp=#0x2000000108e' 2024-08-31T04:31:11.633 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12476 fp=#0x20000001e65' 2024-08-31T04:31:11.633 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12508 fp=#0x20000001eef' 2024-08-31T04:31:11.633 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12540 fp=#0x200000009f3' 2024-08-31T04:31:11.634 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12572 fp=#0x20000000a30' 2024-08-31T04:31:11.634 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12604 fp=#0x20000000a4a' 2024-08-31T04:31:11.634 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12636 fp=#0x20000000a49' 2024-08-31T04:31:11.635 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12668 fp=#0x20000000a14' 2024-08-31T04:31:11.635 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12700 fp=#0x10000000e9f' 2024-08-31T04:31:11.635 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12732 fp=#0x10000000d1f' 2024-08-31T04:31:11.636 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12764 fp=#0x10000000dc3' 2024-08-31T04:31:11.636 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12796 fp=#0x10000000d42' 2024-08-31T04:31:11.636 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12828 fp=#0x200000003e2' 2024-08-31T04:31:11.637 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12860 fp=#0x10000002f1f' 2024-08-31T04:31:11.637 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12892 fp=#0x10000002f15' 2024-08-31T04:31:11.637 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12924 fp=#0x2000000210a' 2024-08-31T04:31:11.638 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12956 fp=#0x10000002ea0' 2024-08-31T04:31:11.638 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12988 fp=#0x10000002f28' 2024-08-31T04:31:11.638 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13020 fp=#0x20000002159' 2024-08-31T04:31:11.639 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13051 fp=#0x200000007ad' 2024-08-31T04:31:11.639 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13083 fp=#0x20000000713' 2024-08-31T04:31:11.639 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13115 fp=#0x20000000772' 2024-08-31T04:31:11.640 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13147 fp=#0x2000000074d' 2024-08-31T04:31:11.640 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13179 fp=#0x20000000717' 2024-08-31T04:31:11.640 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13211 fp=#0x20000000bf9' 2024-08-31T04:31:11.641 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13243 fp=#0x20000000bd4' 2024-08-31T04:31:11.641 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13275 fp=#0x20000000bc8' 2024-08-31T04:31:11.641 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13307 fp=#0x20000000b9a' 2024-08-31T04:31:11.641 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13339 fp=#0x20000000b70' 2024-08-31T04:31:11.642 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13371 fp=#0x20000001cb3' 2024-08-31T04:31:11.642 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13403 fp=#0x20000001d3b' 2024-08-31T04:31:11.642 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13435 fp=#0x20000001c89' 2024-08-31T04:31:11.643 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13467 fp=#0x20000001c55' 2024-08-31T04:31:11.643 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13499 fp=#0x10000003b37' 2024-08-31T04:31:11.644 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13654 fp=#0x20000002116' 2024-08-31T04:31:11.645 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13718 fp=#0x10000002e44' 2024-08-31T04:31:11.645 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13750 fp=#0x10000002f4f' 2024-08-31T04:31:11.646 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13782 fp=#0x20000000822' 2024-08-31T04:31:11.646 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13814 fp=#0x200000015eb' 2024-08-31T04:31:11.646 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13846 fp=#0x200000015cb' 2024-08-31T04:31:11.646 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13878 fp=#0x20000000cee' 2024-08-31T04:31:11.647 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13910 fp=#0x20000000d77' 2024-08-31T04:31:11.647 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13942 fp=#0x200000021fe' 2024-08-31T04:31:11.647 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13974 fp=#0x20000000d27' 2024-08-31T04:31:11.648 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14006 fp=#0x20000001a5b' 2024-08-31T04:31:11.648 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14038 fp=#0x20000001a09' 2024-08-31T04:31:11.648 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14070 fp=#0x20000001a27' 2024-08-31T04:31:11.649 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14102 fp=#0x200000019d7' 2024-08-31T04:31:11.649 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14134 fp=#0x200000008a0' 2024-08-31T04:31:11.649 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14166 fp=#0x200000008af' 2024-08-31T04:31:11.650 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14198 fp=#0x200000008dd' 2024-08-31T04:31:11.650 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14230 fp=#0x200000008f7' 2024-08-31T04:31:11.651 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14326 fp=#0x20000001e14' 2024-08-31T04:31:11.651 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14390 fp=#0x20000001d9f' 2024-08-31T04:31:11.652 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14454 fp=#0x20000001945' 2024-08-31T04:31:11.652 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14486 fp=#0x20000001810' 2024-08-31T04:31:11.653 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14518 fp=#0x20000001860' 2024-08-31T04:31:11.653 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14550 fp=#0x20000001008' 2024-08-31T04:31:11.653 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14582 fp=#0x20000000fe0' 2024-08-31T04:31:11.653 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14614 fp=#0x20000000f32' 2024-08-31T04:31:11.654 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14646 fp=#0x20000000f58' 2024-08-31T04:31:11.654 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14678 fp=#0x20000000f07' 2024-08-31T04:31:11.654 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14710 fp=#0x20000000fee' 2024-08-31T04:31:11.655 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14774 fp=#0x100000046dc' 2024-08-31T04:31:11.655 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14806 fp=#0x200000010ab' 2024-08-31T04:31:11.656 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14838 fp=#0x20000001e03' 2024-08-31T04:31:11.656 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14852 fp=#0x10000003235' 2024-08-31T04:31:11.656 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14884 fp=#0x10000003204' 2024-08-31T04:31:11.657 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14916 fp=#0x10000003114' 2024-08-31T04:31:11.657 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14948 fp=#0x10000003108' 2024-08-31T04:31:11.657 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14980 fp=#0x200000016b8' 2024-08-31T04:31:11.657 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15012 fp=#0x200000017a7' 2024-08-31T04:31:11.658 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15044 fp=#0x20000001781' 2024-08-31T04:31:11.658 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15076 fp=#0x200000017bf' 2024-08-31T04:31:11.658 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15108 fp=#0x20000001749' 2024-08-31T04:31:11.659 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15139 fp=#0x100000057b4' 2024-08-31T04:31:11.659 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15171 fp=#0x100000057b1' 2024-08-31T04:31:11.659 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15203 fp=#0x1000000177b' 2024-08-31T04:31:11.660 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15235 fp=#0x20000002123' 2024-08-31T04:31:11.660 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15267 fp=#0x20000002276' 2024-08-31T04:31:11.660 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15299 fp=#0x200000021e5' 2024-08-31T04:31:11.661 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15331 fp=#0x2000000224c' 2024-08-31T04:31:11.662 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15427 fp=#0x20000001cda' 2024-08-31T04:31:11.662 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15491 fp=#0x20000001010' 2024-08-31T04:31:11.662 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15523 fp=#0x20000001620' 2024-08-31T04:31:11.663 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15555 fp=#0x20000001641' 2024-08-31T04:31:11.663 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15587 fp=#0x10000005332' 2024-08-31T04:31:11.664 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15651 fp=#0x10000004ecb' 2024-08-31T04:31:11.664 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15715 fp=#0x10000004e49' 2024-08-31T04:31:11.665 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15779 fp=#0x20000002030' 2024-08-31T04:31:11.666 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15875 fp=#0x20000001fec' 2024-08-31T04:31:11.667 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15971 fp=#0x20000002006' 2024-08-31T04:31:11.667 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16003 fp=#0x20000001920' 2024-08-31T04:31:11.667 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16035 fp=#0x2000000190b' 2024-08-31T04:31:11.668 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16067 fp=#0x200000017e3' 2024-08-31T04:31:11.668 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16099 fp=#0x200000011c0' 2024-08-31T04:31:11.668 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16131 fp=#0x2000000111a' 2024-08-31T04:31:11.669 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16163 fp=#0x2000000111e' 2024-08-31T04:31:11.669 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16195 fp=#0x200000015b6' 2024-08-31T04:31:11.669 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16227 fp=#0x2000000159a' 2024-08-31T04:31:11.670 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16259 fp=#0x200000015f1' 2024-08-31T04:31:11.670 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16290 fp=#0x100000047e9' 2024-08-31T04:31:11.670 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16322 fp=#0x1000000450c' 2024-08-31T04:31:11.670 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16354 fp=#0x10000004896' 2024-08-31T04:31:11.671 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16386 fp=#0x100000044ee' 2024-08-31T04:31:11.671 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16418 fp=#0x10000004805' 2024-08-31T04:31:11.671 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16450 fp=#0x1000000488e' 2024-08-31T04:31:11.672 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16546 fp=#0x200000011a0' 2024-08-31T04:31:11.672 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16578 fp=#0x1000000491a' 2024-08-31T04:31:11.673 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16610 fp=#0x200000022a5' 2024-08-31T04:31:11.673 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16642 fp=#0x2000000229b' 2024-08-31T04:31:11.673 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16674 fp=#0x20000000433' 2024-08-31T04:31:11.674 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16706 fp=#0x10000002a9c' 2024-08-31T04:31:11.674 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16738 fp=#0x10000002acf' 2024-08-31T04:31:11.674 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16770 fp=#0x2000000042d' 2024-08-31T04:31:11.675 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16802 fp=#0x10000002a7a' 2024-08-31T04:31:11.675 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16834 fp=#0x10000002ad5' 2024-08-31T04:31:11.676 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16866 fp=#0x100000045a1' 2024-08-31T04:31:11.676 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16898 fp=#0x100000045ae' 2024-08-31T04:31:11.676 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16930 fp=#0x100000045a7' 2024-08-31T04:31:11.677 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16962 fp=#0x10000005d5b' 2024-08-31T04:31:11.678 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17090 fp=#0x1000000572a' 2024-08-31T04:31:11.678 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17122 fp=#0x10000005780' 2024-08-31T04:31:11.678 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17186 fp=#0x1000000573d' 2024-08-31T04:31:11.679 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17218 fp=#0x100000054e7' 2024-08-31T04:31:11.679 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17250 fp=#0x1000000548b' 2024-08-31T04:31:11.680 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17314 fp=#0x100000054d3' 2024-08-31T04:31:11.680 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17346 fp=#0x20000001aae' 2024-08-31T04:31:11.680 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17378 fp=#0x20000001a7f' 2024-08-31T04:31:11.681 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17410 fp=#0x20000001aa2' 2024-08-31T04:31:11.681 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17442 fp=#0x10000004d9a' 2024-08-31T04:31:11.681 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17474 fp=#0x10000004daf' 2024-08-31T04:31:11.682 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17506 fp=#0x10000004d47' 2024-08-31T04:31:11.682 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17538 fp=#0x20000001af3' 2024-08-31T04:31:11.682 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17570 fp=#0x20000001afc' 2024-08-31T04:31:11.683 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17602 fp=#0x20000001b2c' 2024-08-31T04:31:11.683 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17634 fp=#0x20000001f4d' 2024-08-31T04:31:11.683 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17666 fp=#0x20000001f50' 2024-08-31T04:31:11.683 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17698 fp=#0x10000002a2c' 2024-08-31T04:31:11.684 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17730 fp=#0x20000001f12' 2024-08-31T04:31:11.684 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17762 fp=#0x10000004f01' 2024-08-31T04:31:11.684 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17794 fp=#0x10000004f12' 2024-08-31T04:31:11.685 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17826 fp=#0x10000004ed8' 2024-08-31T04:31:11.686 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17986 fp=#0x20000001d0c' 2024-08-31T04:31:11.686 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18018 fp=#0x20000001c84' 2024-08-31T04:31:11.687 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18050 fp=#0x20000001cf8' 2024-08-31T04:31:11.687 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18082 fp=#0x20000001d66' 2024-08-31T04:31:11.687 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18114 fp=#0x2000000172d' 2024-08-31T04:31:11.688 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18146 fp=#0x20000001741' 2024-08-31T04:31:11.688 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18178 fp=#0x20000000d0d' 2024-08-31T04:31:11.688 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18210 fp=#0x20000000c36' 2024-08-31T04:31:11.689 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18242 fp=#0x20000000c7f' 2024-08-31T04:31:11.689 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18271 fp=#0x1000000490b' 2024-08-31T04:31:11.689 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18303 fp=#0x10000004b0c' 2024-08-31T04:31:11.690 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18335 fp=#0x10000004a24' 2024-08-31T04:31:11.690 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18367 fp=#0x10000004a04' 2024-08-31T04:31:11.690 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18394 fp=#0x200000021f7' 2024-08-31T04:31:11.691 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18426 fp=#0x200000021ba' 2024-08-31T04:31:11.691 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18458 fp=#0x2000000217c' 2024-08-31T04:31:11.691 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18490 fp=#0x20000002222' 2024-08-31T04:31:11.692 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18552 fp=#0x100000036c4' 2024-08-31T04:31:11.692 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18584 fp=#0x100000035f2' 2024-08-31T04:31:11.693 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:7179 fp=#0x20000000959' 2024-08-31T04:31:11.693 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:7211 fp=#0x200000006fd' 2024-08-31T04:31:11.694 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:7275 fp=#0x20000000e9e' 2024-08-31T04:31:11.695 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:7435 fp=#0x20000001f94' 2024-08-31T04:31:11.695 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:7467 fp=#0x20000002025' 2024-08-31T04:31:11.696 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:7499 fp=#0x20000001f83' 2024-08-31T04:31:11.706 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:8802 fp=#0x2000000083f' 2024-08-31T04:31:11.707 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:8962 fp=#0x20000000657' 2024-08-31T04:31:11.708 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9026 fp=#0x20000000fd3' 2024-08-31T04:31:11.709 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9122 fp=#0x20000000893' 2024-08-31T04:31:11.709 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9154 fp=#0x20000001cb2' 2024-08-31T04:31:11.709 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9186 fp=#0x2000000089a' 2024-08-31T04:31:11.710 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9218 fp=#0x20000001ce3' 2024-08-31T04:31:11.710 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9250 fp=#0x20000001d04' 2024-08-31T04:31:11.711 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9378 fp=#0x200000009c2' 2024-08-31T04:31:11.712 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9410 fp=#0x2000000156c' 2024-08-31T04:31:11.712 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9442 fp=#0x2000000156a' 2024-08-31T04:31:11.712 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9474 fp=#0x20000000987' 2024-08-31T04:31:11.713 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9538 fp=#0x200000009a8' 2024-08-31T04:31:11.713 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9570 fp=#0x20000000964' 2024-08-31T04:31:11.713 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9602 fp=#0x2000000187d' 2024-08-31T04:31:11.714 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9666 fp=#0x2000000186b' 2024-08-31T04:31:11.714 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9698 fp=#0x20000000b5d' 2024-08-31T04:31:11.715 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9730 fp=#0x20000000af3' 2024-08-31T04:31:11.715 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9762 fp=#0x20000000b38' 2024-08-31T04:31:11.715 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9794 fp=#0x20000001f71' 2024-08-31T04:31:11.716 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9826 fp=#0x20000001e1e' 2024-08-31T04:31:11.716 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9858 fp=#0x20000001efa' 2024-08-31T04:31:11.716 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9890 fp=#0x20000001df4' 2024-08-31T04:31:11.717 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9921 fp=#0x200000014a2' 2024-08-31T04:31:11.718 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10049 fp=#0x20000000e33' 2024-08-31T04:31:11.718 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10081 fp=#0x20000000e0b' 2024-08-31T04:31:11.718 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10113 fp=#0x20000000df5' 2024-08-31T04:31:11.719 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10145 fp=#0x20000000def' 2024-08-31T04:31:11.719 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10177 fp=#0x20000000e13' 2024-08-31T04:31:11.719 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10209 fp=#0x200000006dd' 2024-08-31T04:31:11.720 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10241 fp=#0x2000000101e' 2024-08-31T04:31:11.720 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10273 fp=#0x20000001001' 2024-08-31T04:31:11.721 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10305 fp=#0x20000001047' 2024-08-31T04:31:11.721 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10337 fp=#0x200000014f8' 2024-08-31T04:31:11.721 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10369 fp=#0x200000008ff' 2024-08-31T04:31:11.722 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10401 fp=#0x2000000090a' 2024-08-31T04:31:11.722 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10433 fp=#0x200000014cb' 2024-08-31T04:31:11.722 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10465 fp=#0x10000003cc1' 2024-08-31T04:31:11.723 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10497 fp=#0x20000000956' 2024-08-31T04:31:11.723 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10529 fp=#0x10000000b89' 2024-08-31T04:31:11.723 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10561 fp=#0x10000000c17' 2024-08-31T04:31:11.724 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10593 fp=#0x10000001156' 2024-08-31T04:31:11.724 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10625 fp=#0x200000020f7' 2024-08-31T04:31:11.724 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10657 fp=#0x20000002118' 2024-08-31T04:31:11.724 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10689 fp=#0x20000002098' 2024-08-31T04:31:11.726 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10817 fp=#0x200000005fb' 2024-08-31T04:31:11.726 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10849 fp=#0x1000000341a' 2024-08-31T04:31:11.726 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10881 fp=#0x20000000602' 2024-08-31T04:31:11.727 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10913 fp=#0x10000003450' 2024-08-31T04:31:11.727 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10945 fp=#0x10000003477' 2024-08-31T04:31:11.727 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10977 fp=#0x20000000615' 2024-08-31T04:31:11.728 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11009 fp=#0x10000003c07' 2024-08-31T04:31:11.728 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11073 fp=#0x10000003b94' 2024-08-31T04:31:11.729 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11105 fp=#0x10000003d13' 2024-08-31T04:31:11.729 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11169 fp=#0x10000003b91' 2024-08-31T04:31:11.730 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11229 fp=#0x20000000e43' 2024-08-31T04:31:11.730 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11261 fp=#0x20000000e50' 2024-08-31T04:31:11.730 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11293 fp=#0x20000000e52' 2024-08-31T04:31:11.731 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11325 fp=#0x20000001eb4' 2024-08-31T04:31:11.731 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11357 fp=#0x20000001e63' 2024-08-31T04:31:11.731 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11389 fp=#0x20000001dfb' 2024-08-31T04:31:11.732 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11421 fp=#0x20000001ed9' 2024-08-31T04:31:11.732 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11453 fp=#0x20000001e53' 2024-08-31T04:31:11.732 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11485 fp=#0x20000001e1c' 2024-08-31T04:31:11.733 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11517 fp=#0x20000001e74' 2024-08-31T04:31:11.733 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11549 fp=#0x1000000461e' 2024-08-31T04:31:11.733 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11581 fp=#0x10000004654' 2024-08-31T04:31:11.734 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11613 fp=#0x10000004606' 2024-08-31T04:31:11.734 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11645 fp=#0x200000006c9' 2024-08-31T04:31:11.735 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11677 fp=#0x2000000063e' 2024-08-31T04:31:11.735 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11741 fp=#0x20000000679' 2024-08-31T04:31:11.736 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11773 fp=#0x20000000682' 2024-08-31T04:31:11.736 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11805 fp=#0x200000006aa' 2024-08-31T04:31:11.736 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11837 fp=#0x20000000650' 2024-08-31T04:31:11.737 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11869 fp=#0x200000022dd' 2024-08-31T04:31:11.737 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11901 fp=#0x20000000ab2' 2024-08-31T04:31:11.737 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11933 fp=#0x20000001644' 2024-08-31T04:31:11.738 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11965 fp=#0x20000000aa5' 2024-08-31T04:31:11.738 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11997 fp=#0x200000016bb' 2024-08-31T04:31:11.738 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12029 fp=#0x200000016e4' 2024-08-31T04:31:11.739 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12061 fp=#0x200000016a3' 2024-08-31T04:31:11.739 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12093 fp=#0x200000016d7' 2024-08-31T04:31:11.740 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12221 fp=#0x20000001fc7' 2024-08-31T04:31:11.741 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12285 fp=#0x20000001f8e' 2024-08-31T04:31:11.741 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12317 fp=#0x20000001f99' 2024-08-31T04:31:11.741 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12349 fp=#0x200000010e2' 2024-08-31T04:31:11.742 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12381 fp=#0x20000001042' 2024-08-31T04:31:11.744 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12413 fp=#0x2000000107d' 2024-08-31T04:31:11.744 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12445 fp=#0x200000010d6' 2024-08-31T04:31:11.745 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12477 fp=#0x20000001eeb' 2024-08-31T04:31:11.745 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12509 fp=#0x20000001ed8' 2024-08-31T04:31:11.745 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12541 fp=#0x20000000a3b' 2024-08-31T04:31:11.746 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12573 fp=#0x20000000a59' 2024-08-31T04:31:11.746 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12605 fp=#0x20000000acb' 2024-08-31T04:31:11.746 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12637 fp=#0x20000000a2e' 2024-08-31T04:31:11.746 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12669 fp=#0x20000000a2c' 2024-08-31T04:31:11.747 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12701 fp=#0x200000003e7' 2024-08-31T04:31:11.747 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12733 fp=#0x10000000e96' 2024-08-31T04:31:11.747 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12765 fp=#0x10000000de8' 2024-08-31T04:31:11.748 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12797 fp=#0x10000000f3b' 2024-08-31T04:31:11.748 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12829 fp=#0x200000003d3' 2024-08-31T04:31:11.749 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12893 fp=#0x20000002146' 2024-08-31T04:31:11.749 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12925 fp=#0x10000002e6f' 2024-08-31T04:31:11.749 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12957 fp=#0x20000002117' 2024-08-31T04:31:11.750 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12989 fp=#0x200000020b9' 2024-08-31T04:31:11.750 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13021 fp=#0x200000020ff' 2024-08-31T04:31:11.750 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13052 fp=#0x20000000738' 2024-08-31T04:31:11.751 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13084 fp=#0x20000000782' 2024-08-31T04:31:11.751 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13116 fp=#0x20000000785' 2024-08-31T04:31:11.751 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13148 fp=#0x20000000748' 2024-08-31T04:31:11.752 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13180 fp=#0x2000000070c' 2024-08-31T04:31:11.752 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13212 fp=#0x20000000bad' 2024-08-31T04:31:11.752 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13244 fp=#0x20000000be2' 2024-08-31T04:31:11.753 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13276 fp=#0x20000000bbd' 2024-08-31T04:31:11.753 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13308 fp=#0x20000000b87' 2024-08-31T04:31:11.753 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13340 fp=#0x2000000203b' 2024-08-31T04:31:11.754 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13372 fp=#0x20000001ca5' 2024-08-31T04:31:11.754 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13404 fp=#0x20000001c34' 2024-08-31T04:31:11.754 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13436 fp=#0x20000001ce8' 2024-08-31T04:31:11.755 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13468 fp=#0x20000001cf4' 2024-08-31T04:31:11.755 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13500 fp=#0x10000003b21' 2024-08-31T04:31:11.756 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13623 fp=#0x20000001167' 2024-08-31T04:31:11.756 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13687 fp=#0x10000002e96' 2024-08-31T04:31:11.757 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13719 fp=#0x10000002e4e' 2024-08-31T04:31:11.757 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13751 fp=#0x10000002e3f' 2024-08-31T04:31:11.757 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13783 fp=#0x200000007fa' 2024-08-31T04:31:11.758 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13815 fp=#0x20000000840' 2024-08-31T04:31:11.758 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13847 fp=#0x20000000825' 2024-08-31T04:31:11.758 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13879 fp=#0x20000002209' 2024-08-31T04:31:11.759 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13911 fp=#0x20000002235' 2024-08-31T04:31:11.759 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13943 fp=#0x20000000cbf' 2024-08-31T04:31:11.759 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13975 fp=#0x20000000cf9' 2024-08-31T04:31:11.760 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14007 fp=#0x20000001a31' 2024-08-31T04:31:11.760 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14039 fp=#0x20000001a3d' 2024-08-31T04:31:11.760 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14071 fp=#0x200000019f1' 2024-08-31T04:31:11.761 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14103 fp=#0x20000001a2b' 2024-08-31T04:31:11.761 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14135 fp=#0x200000008b6' 2024-08-31T04:31:11.761 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14167 fp=#0x200000008a7' 2024-08-31T04:31:11.762 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14199 fp=#0x200000008c2' 2024-08-31T04:31:11.762 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14231 fp=#0x200000008e0' 2024-08-31T04:31:11.763 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14327 fp=#0x20000001e0c' 2024-08-31T04:31:11.763 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14359 fp=#0x20000001dc5' 2024-08-31T04:31:11.764 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14423 fp=#0x20000001e2f' 2024-08-31T04:31:11.764 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14455 fp=#0x20000001863' 2024-08-31T04:31:11.764 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14487 fp=#0x20000001858' 2024-08-31T04:31:11.765 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14519 fp=#0x20000001837' 2024-08-31T04:31:11.765 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14551 fp=#0x20000000f2a' 2024-08-31T04:31:11.765 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14583 fp=#0x20000001d09' 2024-08-31T04:31:11.766 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14615 fp=#0x20000000f3c' 2024-08-31T04:31:11.766 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14647 fp=#0x20000000fc9' 2024-08-31T04:31:11.767 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14679 fp=#0x20000000f35' 2024-08-31T04:31:11.767 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14711 fp=#0x20000000f1e' 2024-08-31T04:31:11.768 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14807 fp=#0x1000000463a' 2024-08-31T04:31:11.768 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14853 fp=#0x10000003115' 2024-08-31T04:31:11.769 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14885 fp=#0x10000003166' 2024-08-31T04:31:11.769 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14917 fp=#0x10000003194' 2024-08-31T04:31:11.769 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14949 fp=#0x1000000317a' 2024-08-31T04:31:11.770 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14981 fp=#0x10000005894' 2024-08-31T04:31:11.770 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15013 fp=#0x200000017fb' 2024-08-31T04:31:11.770 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15045 fp=#0x2000000172f' 2024-08-31T04:31:11.771 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15077 fp=#0x20000001771' 2024-08-31T04:31:11.771 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15109 fp=#0x200000017cd' 2024-08-31T04:31:11.771 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15140 fp=#0x100000057c3' 2024-08-31T04:31:11.772 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15172 fp=#0x100000057b8' 2024-08-31T04:31:11.772 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15204 fp=#0x10000001765' 2024-08-31T04:31:11.772 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15236 fp=#0x10000001707' 2024-08-31T04:31:11.773 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15268 fp=#0x200000021bf' 2024-08-31T04:31:11.773 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15300 fp=#0x2000000222f' 2024-08-31T04:31:11.773 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15332 fp=#0x20000002202' 2024-08-31T04:31:11.774 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15428 fp=#0x20000002056' 2024-08-31T04:31:11.774 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15460 fp=#0x2000000207a' 2024-08-31T04:31:11.775 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15492 fp=#0x200000019f5' 2024-08-31T04:31:11.775 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15524 fp=#0x20000001a3c' 2024-08-31T04:31:11.775 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15556 fp=#0x10000005328' 2024-08-31T04:31:11.776 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15588 fp=#0x20000001a00' 2024-08-31T04:31:11.776 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15620 fp=#0x10000004e53' 2024-08-31T04:31:11.776 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15652 fp=#0x10000004eb9' 2024-08-31T04:31:11.777 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15684 fp=#0x10000004e74' 2024-08-31T04:31:11.777 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15748 fp=#0x10000004eb3' 2024-08-31T04:31:11.778 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15780 fp=#0x2000000201c' 2024-08-31T04:31:11.778 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15844 fp=#0x2000000201e' 2024-08-31T04:31:11.779 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15908 fp=#0x20000001fbe' 2024-08-31T04:31:11.779 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16004 fp=#0x200000018f2' 2024-08-31T04:31:11.780 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16036 fp=#0x200000017cc' 2024-08-31T04:31:11.780 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16068 fp=#0x200000018fe' 2024-08-31T04:31:11.780 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16100 fp=#0x20000001107' 2024-08-31T04:31:11.781 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16132 fp=#0x20000001133' 2024-08-31T04:31:11.781 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16164 fp=#0x2000000114c' 2024-08-31T04:31:11.781 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16196 fp=#0x200000015f9' 2024-08-31T04:31:11.782 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16228 fp=#0x20000001612' 2024-08-31T04:31:11.782 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16260 fp=#0x200000015c1' 2024-08-31T04:31:11.783 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16291 fp=#0x100000044e2' 2024-08-31T04:31:11.783 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16323 fp=#0x10000004895' 2024-08-31T04:31:11.783 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16355 fp=#0x100000048aa' 2024-08-31T04:31:11.783 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16387 fp=#0x1000000450b' 2024-08-31T04:31:11.784 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16419 fp=#0x100000048ab' 2024-08-31T04:31:11.784 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16451 fp=#0x10000004511' 2024-08-31T04:31:11.784 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16483 fp=#0x10000004932' 2024-08-31T04:31:11.785 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16515 fp=#0x2000000113b' 2024-08-31T04:31:11.785 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16547 fp=#0x10000004efe' 2024-08-31T04:31:11.785 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16579 fp=#0x20000001173' 2024-08-31T04:31:11.786 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16611 fp=#0x200000022ca' 2024-08-31T04:31:11.786 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16643 fp=#0x200000022b4' 2024-08-31T04:31:11.786 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16675 fp=#0x200000014c2' 2024-08-31T04:31:11.787 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16707 fp=#0x10000002adc' 2024-08-31T04:31:11.787 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16739 fp=#0x2000000043d' 2024-08-31T04:31:11.787 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16771 fp=#0x20000000434' 2024-08-31T04:31:11.787 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16803 fp=#0x10000002a68' 2024-08-31T04:31:11.788 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16835 fp=#0x10000002a67' 2024-08-31T04:31:11.788 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16867 fp=#0x10000004540' 2024-08-31T04:31:11.788 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16899 fp=#0x1000000458b' 2024-08-31T04:31:11.789 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16931 fp=#0x10000004566' 2024-08-31T04:31:11.789 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16963 fp=#0x10000004541' 2024-08-31T04:31:11.790 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17091 fp=#0x1000000578c' 2024-08-31T04:31:11.790 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17123 fp=#0x10000005729' 2024-08-31T04:31:11.791 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17219 fp=#0x100000054f0' 2024-08-31T04:31:11.792 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17283 fp=#0x100000054da' 2024-08-31T04:31:11.792 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17315 fp=#0x1000000547e' 2024-08-31T04:31:11.793 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17347 fp=#0x20000001ad1' 2024-08-31T04:31:11.793 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17379 fp=#0x20000001a83' 2024-08-31T04:31:11.793 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17411 fp=#0x20000001a79' 2024-08-31T04:31:11.794 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17443 fp=#0x10000004ddb' 2024-08-31T04:31:11.794 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17475 fp=#0x10000004dc8' 2024-08-31T04:31:11.794 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17507 fp=#0x10000004e09' 2024-08-31T04:31:11.795 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17539 fp=#0x20000001b89' 2024-08-31T04:31:11.795 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17571 fp=#0x20000001b0d' 2024-08-31T04:31:11.795 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17603 fp=#0x20000001b7a' 2024-08-31T04:31:11.796 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17635 fp=#0x10000002a1b' 2024-08-31T04:31:11.796 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17667 fp=#0x20000001f66' 2024-08-31T04:31:11.796 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17699 fp=#0x100000029f0' 2024-08-31T04:31:11.797 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17731 fp=#0x20000001f59' 2024-08-31T04:31:11.797 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17763 fp=#0x10000004f4a' 2024-08-31T04:31:11.797 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17795 fp=#0x10000004f07' 2024-08-31T04:31:11.798 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17827 fp=#0x10000004f05' 2024-08-31T04:31:11.799 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17923 fp=#0x10000000a6c' 2024-08-31T04:31:11.799 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17987 fp=#0x20000001c8a' 2024-08-31T04:31:11.799 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18019 fp=#0x20000001c2f' 2024-08-31T04:31:11.800 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18051 fp=#0x20000001c1c' 2024-08-31T04:31:11.800 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18083 fp=#0x20000001788' 2024-08-31T04:31:11.800 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18115 fp=#0x20000001d72' 2024-08-31T04:31:11.801 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18147 fp=#0x20000001f64' 2024-08-31T04:31:11.801 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18179 fp=#0x20000000d2c' 2024-08-31T04:31:11.801 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18211 fp=#0x20000000c67' 2024-08-31T04:31:11.802 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18243 fp=#0x20000000c78' 2024-08-31T04:31:11.802 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18272 fp=#0x10000004a33' 2024-08-31T04:31:11.803 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18304 fp=#0x200000022e1' 2024-08-31T04:31:11.803 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18336 fp=#0x10000004954' 2024-08-31T04:31:11.803 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18395 fp=#0x20000002259' 2024-08-31T04:31:11.804 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18427 fp=#0x20000002247' 2024-08-31T04:31:11.804 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18459 fp=#0x200000021ac' 2024-08-31T04:31:11.804 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18491 fp=#0x20000002176' 2024-08-31T04:31:11.805 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18521 fp=#0x100000035c8' 2024-08-31T04:31:11.805 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18553 fp=#0x40000001779' 2024-08-31T04:31:11.806 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18585 fp=#0x50000000c1a' 2024-08-31T04:31:11.806 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:7180 fp=#0x20000001433' 2024-08-31T04:31:11.806 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:7212 fp=#0x20000000b63' 2024-08-31T04:31:11.807 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:7276 fp=#0x20000001104' 2024-08-31T04:31:11.818 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:8684 fp=#0x200000011d5' 2024-08-31T04:31:11.819 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:8899 fp=#0x20000000675' 2024-08-31T04:31:11.820 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:8995 fp=#0x20000001848' 2024-08-31T04:31:11.821 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9027 fp=#0x20000000fd1' 2024-08-31T04:31:11.821 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9123 fp=#0x20000001c6b' 2024-08-31T04:31:11.822 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9155 fp=#0x20000001c7d' 2024-08-31T04:31:11.822 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9187 fp=#0x20000001cf6' 2024-08-31T04:31:11.823 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9219 fp=#0x20000001ca2' 2024-08-31T04:31:11.823 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9251 fp=#0x20000001c86' 2024-08-31T04:31:11.824 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9379 fp=#0x20000000970' 2024-08-31T04:31:11.824 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9411 fp=#0x20000001575' 2024-08-31T04:31:11.825 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9443 fp=#0x20000000996' 2024-08-31T04:31:11.825 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9475 fp=#0x20000001585' 2024-08-31T04:31:11.825 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9507 fp=#0x20000000998' 2024-08-31T04:31:11.826 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9539 fp=#0x20000000990' 2024-08-31T04:31:11.826 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9571 fp=#0x2000000155b' 2024-08-31T04:31:11.826 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9635 fp=#0x2000000185f' 2024-08-31T04:31:11.827 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9667 fp=#0x200000018d6' 2024-08-31T04:31:11.827 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9699 fp=#0x20000000afc' 2024-08-31T04:31:11.827 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9731 fp=#0x20000000b5e' 2024-08-31T04:31:11.828 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9763 fp=#0x20000000b25' 2024-08-31T04:31:11.828 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9795 fp=#0x20000001f69' 2024-08-31T04:31:11.828 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9827 fp=#0x20000001e5c' 2024-08-31T04:31:11.829 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9859 fp=#0x20000001f09' 2024-08-31T04:31:11.829 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9891 fp=#0x20000001eec' 2024-08-31T04:31:11.830 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10050 fp=#0x20000000e12' 2024-08-31T04:31:11.831 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10082 fp=#0x20000000d47' 2024-08-31T04:31:11.831 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10114 fp=#0x20000000de9' 2024-08-31T04:31:11.831 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10146 fp=#0x20000000dfd' 2024-08-31T04:31:11.832 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10178 fp=#0x20000000df2' 2024-08-31T04:31:11.832 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10210 fp=#0x20000001031' 2024-08-31T04:31:11.832 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10242 fp=#0x200000006fc' 2024-08-31T04:31:11.833 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10274 fp=#0x200000006ea' 2024-08-31T04:31:11.833 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10306 fp=#0x200000006e9' 2024-08-31T04:31:11.833 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10338 fp=#0x20000000904' 2024-08-31T04:31:11.834 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10370 fp=#0x200000014a3' 2024-08-31T04:31:11.834 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10402 fp=#0x200000014d2' 2024-08-31T04:31:11.834 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10434 fp=#0x200000014d5' 2024-08-31T04:31:11.835 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10466 fp=#0x10000000b9f' 2024-08-31T04:31:11.835 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10498 fp=#0x10000000c4c' 2024-08-31T04:31:11.835 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10530 fp=#0x100000010d8' 2024-08-31T04:31:11.835 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10562 fp=#0x10000000b95' 2024-08-31T04:31:11.836 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10594 fp=#0x10000003cc9' 2024-08-31T04:31:11.836 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10626 fp=#0x2000000213f' 2024-08-31T04:31:11.836 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10658 fp=#0x20000002070' 2024-08-31T04:31:11.837 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10690 fp=#0x20000002055' 2024-08-31T04:31:11.838 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10818 fp=#0x100000033fe' 2024-08-31T04:31:11.838 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10850 fp=#0x10000003471' 2024-08-31T04:31:11.839 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10882 fp=#0x20000000616' 2024-08-31T04:31:11.839 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10914 fp=#0x200000005db' 2024-08-31T04:31:11.839 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10946 fp=#0x100000033f6' 2024-08-31T04:31:11.840 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10978 fp=#0x20000000606' 2024-08-31T04:31:11.840 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11010 fp=#0x100000039ac' 2024-08-31T04:31:11.840 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11042 fp=#0x10000003b77' 2024-08-31T04:31:11.840 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11074 fp=#0x10000003d96' 2024-08-31T04:31:11.841 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11106 fp=#0x10000003dd0' 2024-08-31T04:31:11.841 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11170 fp=#0x10000003bfb' 2024-08-31T04:31:11.842 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11202 fp=#0x10000003dda' 2024-08-31T04:31:11.842 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11230 fp=#0x20000000e59' 2024-08-31T04:31:11.842 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11262 fp=#0x20000000e7c' 2024-08-31T04:31:11.843 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11294 fp=#0x20000000e7e' 2024-08-31T04:31:11.843 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11326 fp=#0x20000001958' 2024-08-31T04:31:11.843 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11358 fp=#0x2000000195b' 2024-08-31T04:31:11.843 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11390 fp=#0x20000001ea5' 2024-08-31T04:31:11.844 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11422 fp=#0x20000001957' 2024-08-31T04:31:11.844 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11454 fp=#0x20000001929' 2024-08-31T04:31:11.844 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11486 fp=#0x20000001e99' 2024-08-31T04:31:11.845 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11518 fp=#0x20000001e07' 2024-08-31T04:31:11.845 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11550 fp=#0x10000004648' 2024-08-31T04:31:11.845 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11582 fp=#0x100000045f1' 2024-08-31T04:31:11.846 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11614 fp=#0x100000045d3' 2024-08-31T04:31:11.846 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11678 fp=#0x2000000196c' 2024-08-31T04:31:11.847 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11774 fp=#0x2000000065a' 2024-08-31T04:31:11.848 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11838 fp=#0x2000000199a' 2024-08-31T04:31:11.848 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11870 fp=#0x200000022e6' 2024-08-31T04:31:11.848 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11902 fp=#0x20000000a9c' 2024-08-31T04:31:11.849 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11934 fp=#0x20000001642' 2024-08-31T04:31:11.849 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11966 fp=#0x20000000a90' 2024-08-31T04:31:11.849 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11998 fp=#0x2000000175d' 2024-08-31T04:31:11.850 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12030 fp=#0x2000000174b' 2024-08-31T04:31:11.850 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12062 fp=#0x200000016a2' 2024-08-31T04:31:11.850 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12094 fp=#0x200000016e1' 2024-08-31T04:31:11.852 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12350 fp=#0x200000010bf' 2024-08-31T04:31:11.853 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12382 fp=#0x2000000105a' 2024-08-31T04:31:11.853 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12414 fp=#0x200000010d0' 2024-08-31T04:31:11.853 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12446 fp=#0x20000001087' 2024-08-31T04:31:11.854 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12478 fp=#0x20000001eaa' 2024-08-31T04:31:11.854 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12510 fp=#0x20000001ec8' 2024-08-31T04:31:11.854 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12542 fp=#0x20000000ac7' 2024-08-31T04:31:11.855 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12574 fp=#0x200000009f4' 2024-08-31T04:31:11.855 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12606 fp=#0x20000000a41' 2024-08-31T04:31:11.855 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12638 fp=#0x20000000a6c' 2024-08-31T04:31:11.856 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12670 fp=#0x20000000a44' 2024-08-31T04:31:11.856 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12702 fp=#0x200000003d5' 2024-08-31T04:31:11.856 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12734 fp=#0x20000000201' 2024-08-31T04:31:11.857 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12766 fp=#0x20000000231' 2024-08-31T04:31:11.857 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12798 fp=#0x20000000213' 2024-08-31T04:31:11.857 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12830 fp=#0x200000003cb' 2024-08-31T04:31:11.858 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12862 fp=#0x10000002ea9' 2024-08-31T04:31:11.858 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12894 fp=#0x20000002144' 2024-08-31T04:31:11.858 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12926 fp=#0x10000002e82' 2024-08-31T04:31:11.859 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12958 fp=#0x200000020dc' 2024-08-31T04:31:11.859 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12990 fp=#0x10000002eb5' 2024-08-31T04:31:11.859 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13022 fp=#0x200000020bb' 2024-08-31T04:31:11.859 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13053 fp=#0x200000007ab' 2024-08-31T04:31:11.860 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13085 fp=#0x2000000070b' 2024-08-31T04:31:11.860 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13149 fp=#0x20000000721' 2024-08-31T04:31:11.861 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13181 fp=#0x200000010f0' 2024-08-31T04:31:11.861 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13213 fp=#0x20000000b9e' 2024-08-31T04:31:11.861 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13245 fp=#0x20000000b8f' 2024-08-31T04:31:11.862 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13277 fp=#0x20000000bcd' 2024-08-31T04:31:11.862 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13309 fp=#0x20000000b7d' 2024-08-31T04:31:11.862 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13341 fp=#0x20000000b8b' 2024-08-31T04:31:11.863 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13373 fp=#0x20000001c62' 2024-08-31T04:31:11.863 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13405 fp=#0x20000001c82' 2024-08-31T04:31:11.863 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13437 fp=#0x20000001d64' 2024-08-31T04:31:11.864 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13469 fp=#0x20000001d06' 2024-08-31T04:31:11.864 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13501 fp=#0x10000003af7' 2024-08-31T04:31:11.865 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13592 fp=#0x2000000212e' 2024-08-31T04:31:11.865 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13656 fp=#0x20000002126' 2024-08-31T04:31:11.866 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13688 fp=#0x10000002e43' 2024-08-31T04:31:11.867 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13784 fp=#0x200000015e6' 2024-08-31T04:31:11.867 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13816 fp=#0x200000015ba' 2024-08-31T04:31:11.867 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13848 fp=#0x200000015d7' 2024-08-31T04:31:11.868 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13880 fp=#0x20000002224' 2024-08-31T04:31:11.868 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13912 fp=#0x20000000cb0' 2024-08-31T04:31:11.868 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13944 fp=#0x20000002254' 2024-08-31T04:31:11.869 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13976 fp=#0x20000000d96' 2024-08-31T04:31:11.869 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14008 fp=#0x20000001a5d' 2024-08-31T04:31:11.869 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14040 fp=#0x200000019bd' 2024-08-31T04:31:11.870 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14072 fp=#0x200000019d0' 2024-08-31T04:31:11.870 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14104 fp=#0x200000019c1' 2024-08-31T04:31:11.870 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14136 fp=#0x200000008ca' 2024-08-31T04:31:11.871 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14168 fp=#0x2000000094e' 2024-08-31T04:31:11.871 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14200 fp=#0x20000000935' 2024-08-31T04:31:11.871 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14232 fp=#0x2000000093c' 2024-08-31T04:31:11.872 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14296 fp=#0x20000001e09' 2024-08-31T04:31:11.872 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14328 fp=#0x20000001e51' 2024-08-31T04:31:11.873 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14424 fp=#0x20000001dd1' 2024-08-31T04:31:11.873 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14456 fp=#0x200000018f7' 2024-08-31T04:31:11.874 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14488 fp=#0x20000001813' 2024-08-31T04:31:11.874 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14520 fp=#0x2000000190c' 2024-08-31T04:31:11.874 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14552 fp=#0x20000000f42' 2024-08-31T04:31:11.875 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14584 fp=#0x20000000f71' 2024-08-31T04:31:11.875 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14616 fp=#0x2000000103e' 2024-08-31T04:31:11.875 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14648 fp=#0x20000000fd6' 2024-08-31T04:31:11.876 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14680 fp=#0x20000000ff3' 2024-08-31T04:31:11.876 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14712 fp=#0x20000000fc2' 2024-08-31T04:31:11.877 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14776 fp=#0x1000000464d' 2024-08-31T04:31:11.877 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14840 fp=#0x20000000ae8' 2024-08-31T04:31:11.878 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14854 fp=#0x1000000317f' 2024-08-31T04:31:11.878 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14886 fp=#0x1000000317d' 2024-08-31T04:31:11.878 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14918 fp=#0x10000003187' 2024-08-31T04:31:11.879 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14950 fp=#0x10000003184' 2024-08-31T04:31:11.879 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14982 fp=#0x100000058ad' 2024-08-31T04:31:11.879 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15014 fp=#0x20000001811' 2024-08-31T04:31:11.880 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15046 fp=#0x20000001790' 2024-08-31T04:31:11.880 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15078 fp=#0x20000001732' 2024-08-31T04:31:11.881 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15110 fp=#0x2000000177e' 2024-08-31T04:31:11.881 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15141 fp=#0x100000057a4' 2024-08-31T04:31:11.881 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15173 fp=#0x2000000161a' 2024-08-31T04:31:11.882 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15205 fp=#0x10000001762' 2024-08-31T04:31:11.882 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15237 fp=#0x20000001a61' 2024-08-31T04:31:11.882 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15269 fp=#0x20000002275' 2024-08-31T04:31:11.883 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15301 fp=#0x200000021e7' 2024-08-31T04:31:11.883 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15333 fp=#0x200000021d8' 2024-08-31T04:31:11.883 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15365 fp=#0x2000000207e' 2024-08-31T04:31:11.884 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15429 fp=#0x10000005c0c' 2024-08-31T04:31:11.884 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15461 fp=#0x20000002067' 2024-08-31T04:31:11.885 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15493 fp=#0x20000001623' 2024-08-31T04:31:11.885 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15525 fp=#0x10000005341' 2024-08-31T04:31:11.885 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15557 fp=#0x2000000163a' 2024-08-31T04:31:11.886 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15589 fp=#0x20000001636' 2024-08-31T04:31:11.886 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15621 fp=#0x10000004ec5' 2024-08-31T04:31:11.886 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15653 fp=#0x10000004e3a' 2024-08-31T04:31:11.887 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15685 fp=#0x10000004e34' 2024-08-31T04:31:11.887 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15717 fp=#0x10000004e98' 2024-08-31T04:31:11.887 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15749 fp=#0x10000004ea3' 2024-08-31T04:31:11.888 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15813 fp=#0x20000002016' 2024-08-31T04:31:11.889 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15941 fp=#0x20000001fc5' 2024-08-31T04:31:11.890 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16005 fp=#0x20000000eb8' 2024-08-31T04:31:11.890 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16037 fp=#0x20000001946' 2024-08-31T04:31:11.890 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16069 fp=#0x200000017c8' 2024-08-31T04:31:11.891 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16101 fp=#0x2000000116b' 2024-08-31T04:31:11.891 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16133 fp=#0x20000001109' 2024-08-31T04:31:11.891 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16165 fp=#0x20000001126' 2024-08-31T04:31:11.892 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16197 fp=#0x200000015f0' 2024-08-31T04:31:11.892 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16229 fp=#0x2000000160a' 2024-08-31T04:31:11.892 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16261 fp=#0x20000001601' 2024-08-31T04:31:11.893 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16292 fp=#0x100000044de' 2024-08-31T04:31:11.893 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16324 fp=#0x10000004894' 2024-08-31T04:31:11.893 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16356 fp=#0x1000000483a' 2024-08-31T04:31:11.894 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16388 fp=#0x10000004823' 2024-08-31T04:31:11.894 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16420 fp=#0x100000047dd' 2024-08-31T04:31:11.894 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16452 fp=#0x100000048a9' 2024-08-31T04:31:11.895 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16484 fp=#0x10000004976' 2024-08-31T04:31:11.895 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16516 fp=#0x10000004942' 2024-08-31T04:31:11.895 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16548 fp=#0x100000048eb' 2024-08-31T04:31:11.896 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16580 fp=#0x2000000118b' 2024-08-31T04:31:11.896 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16612 fp=#0x200000022bd' 2024-08-31T04:31:11.896 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16644 fp=#0x20000002280' 2024-08-31T04:31:11.897 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16676 fp=#0x10000002b05' 2024-08-31T04:31:11.897 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16708 fp=#0x10000002ac2' 2024-08-31T04:31:11.898 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16740 fp=#0x2000000043a' 2024-08-31T04:31:11.898 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16772 fp=#0x20000000417' 2024-08-31T04:31:11.898 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16804 fp=#0x20000000431' 2024-08-31T04:31:11.899 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16836 fp=#0x10000002a6b' 2024-08-31T04:31:11.899 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16868 fp=#0x1000000453c' 2024-08-31T04:31:11.899 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16900 fp=#0x10000004549' 2024-08-31T04:31:11.900 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16932 fp=#0x10000004547' 2024-08-31T04:31:11.900 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16964 fp=#0x10000004585' 2024-08-31T04:31:11.901 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17124 fp=#0x10000005731' 2024-08-31T04:31:11.905 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17220 fp=#0x10000005484' 2024-08-31T04:31:11.905 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17252 fp=#0x100000054d4' 2024-08-31T04:31:11.906 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17348 fp=#0x20000001a6b' 2024-08-31T04:31:11.906 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17380 fp=#0x20000001a9b' 2024-08-31T04:31:11.906 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17412 fp=#0x20000001ac7' 2024-08-31T04:31:11.907 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17444 fp=#0x10000004d68' 2024-08-31T04:31:11.907 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17476 fp=#0x10000004d8a' 2024-08-31T04:31:11.907 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17508 fp=#0x10000004dfb' 2024-08-31T04:31:11.908 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17540 fp=#0x20000001b61' 2024-08-31T04:31:11.908 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17572 fp=#0x20000001b47' 2024-08-31T04:31:11.908 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17604 fp=#0x20000001adc' 2024-08-31T04:31:11.909 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17636 fp=#0x20000001f30' 2024-08-31T04:31:11.909 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17668 fp=#0x20000001f2a' 2024-08-31T04:31:11.909 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17700 fp=#0x200000004a2' 2024-08-31T04:31:11.910 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17732 fp=#0x20000001f51' 2024-08-31T04:31:11.910 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17764 fp=#0x10000004f48' 2024-08-31T04:31:11.910 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17796 fp=#0x10000004efb' 2024-08-31T04:31:11.911 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17828 fp=#0x10000004f36' 2024-08-31T04:31:11.911 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17860 fp=#0x10000000891' 2024-08-31T04:31:11.911 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17892 fp=#0x10000001164' 2024-08-31T04:31:11.912 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17988 fp=#0x20000001cd3' 2024-08-31T04:31:11.912 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18020 fp=#0x20000001c3e' 2024-08-31T04:31:11.913 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18052 fp=#0x20000001ca1' 2024-08-31T04:31:11.913 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18084 fp=#0x20000001799' 2024-08-31T04:31:11.913 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18116 fp=#0x200000016f8' 2024-08-31T04:31:11.914 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18148 fp=#0x20000001716' 2024-08-31T04:31:11.914 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18180 fp=#0x20000000c8c' 2024-08-31T04:31:11.914 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18212 fp=#0x20000000c38' 2024-08-31T04:31:11.915 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18244 fp=#0x20000000cba' 2024-08-31T04:31:11.915 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18305 fp=#0x200000022e3' 2024-08-31T04:31:11.916 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18337 fp=#0x200000022f9' 2024-08-31T04:31:11.916 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18369 fp=#0x20000000854' 2024-08-31T04:31:11.917 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18396 fp=#0x2000000219d' 2024-08-31T04:31:11.917 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18428 fp=#0x20000002210' 2024-08-31T04:31:11.917 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18460 fp=#0x200000021e8' 2024-08-31T04:31:11.918 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18492 fp=#0x200000021a0' 2024-08-31T04:31:11.918 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18522 fp=#0x100000036e8' 2024-08-31T04:31:11.918 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18554 fp=#0x100000035c6' 2024-08-31T04:31:11.919 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:7181 fp=#0x20000000aeb' 2024-08-31T04:31:11.919 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:7213 fp=#0x20000001c27' 2024-08-31T04:31:11.920 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:7277 fp=#0x2000000158e' 2024-08-31T04:31:11.921 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:7469 fp=#0x20000001fba' 2024-08-31T04:31:11.922 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:7533 fp=#0x20000001f79' 2024-08-31T04:31:11.932 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:8868 fp=#0x20000000670' 2024-08-31T04:31:11.932 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:8900 fp=#0x2000000061d' 2024-08-31T04:31:11.933 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:8996 fp=#0x200000018b6' 2024-08-31T04:31:11.933 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9028 fp=#0x20000000fec' 2024-08-31T04:31:11.933 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9060 fp=#0x20000000fe6' 2024-08-31T04:31:11.934 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9092 fp=#0x20000000f60' 2024-08-31T04:31:11.934 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9124 fp=#0x2000000089c' 2024-08-31T04:31:11.934 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9156 fp=#0x20000001d32' 2024-08-31T04:31:11.935 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9188 fp=#0x20000001d95' 2024-08-31T04:31:11.935 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9220 fp=#0x20000001d9a' 2024-08-31T04:31:11.935 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9252 fp=#0x20000001d1d' 2024-08-31T04:31:11.937 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9380 fp=#0x20000001571' 2024-08-31T04:31:11.937 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9412 fp=#0x200000009b9' 2024-08-31T04:31:11.937 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9444 fp=#0x2000000154e' 2024-08-31T04:31:11.938 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9476 fp=#0x2000000096f' 2024-08-31T04:31:11.938 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9508 fp=#0x20000001553' 2024-08-31T04:31:11.938 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9540 fp=#0x200000009c1' 2024-08-31T04:31:11.939 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9604 fp=#0x2000000183e' 2024-08-31T04:31:11.939 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9636 fp=#0x20000001871' 2024-08-31T04:31:11.939 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9668 fp=#0x20000001891' 2024-08-31T04:31:11.940 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9700 fp=#0x20000000b45' 2024-08-31T04:31:11.940 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9732 fp=#0x20000000b2f' 2024-08-31T04:31:11.940 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9764 fp=#0x20000000b1f' 2024-08-31T04:31:11.941 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9796 fp=#0x20000000aef' 2024-08-31T04:31:11.941 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9828 fp=#0x20000001e91' 2024-08-31T04:31:11.941 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9860 fp=#0x20000001e01' 2024-08-31T04:31:11.942 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9892 fp=#0x20000001e7e' 2024-08-31T04:31:11.943 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10051 fp=#0x20000000e36' 2024-08-31T04:31:11.943 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10083 fp=#0x20000000e1e' 2024-08-31T04:31:11.943 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10115 fp=#0x20000000dfe' 2024-08-31T04:31:11.944 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10147 fp=#0x20000000dac' 2024-08-31T04:31:11.944 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10179 fp=#0x20000000de4' 2024-08-31T04:31:11.944 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10211 fp=#0x2000000104c' 2024-08-31T04:31:11.945 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10243 fp=#0x20000001045' 2024-08-31T04:31:11.945 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10275 fp=#0x20000001007' 2024-08-31T04:31:11.945 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10307 fp=#0x200000006f4' 2024-08-31T04:31:11.946 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10339 fp=#0x2000000093d' 2024-08-31T04:31:11.946 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10371 fp=#0x20000001495' 2024-08-31T04:31:11.946 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10403 fp=#0x200000014de' 2024-08-31T04:31:11.947 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10435 fp=#0x200000014cd' 2024-08-31T04:31:11.947 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10467 fp=#0x1000000115c' 2024-08-31T04:31:11.947 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10499 fp=#0x10000001849' 2024-08-31T04:31:11.948 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10531 fp=#0x10000003cb6' 2024-08-31T04:31:11.948 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10563 fp=#0x10000000bf9' 2024-08-31T04:31:11.948 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10595 fp=#0x10000003c8a' 2024-08-31T04:31:11.949 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10627 fp=#0x200000020b8' 2024-08-31T04:31:11.949 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10659 fp=#0x20000002040' 2024-08-31T04:31:11.949 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10691 fp=#0x200000020df' 2024-08-31T04:31:11.950 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10819 fp=#0x10000003499' 2024-08-31T04:31:11.951 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10851 fp=#0x1000000345f' 2024-08-31T04:31:11.951 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10883 fp=#0x200000005ec' 2024-08-31T04:31:11.951 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10915 fp=#0x10000003906' 2024-08-31T04:31:11.952 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10947 fp=#0x200000005dc' 2024-08-31T04:31:11.952 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10979 fp=#0x10000003481' 2024-08-31T04:31:11.952 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11011 fp=#0x10000003bf6' 2024-08-31T04:31:11.953 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11043 fp=#0x10000003d82' 2024-08-31T04:31:11.953 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11075 fp=#0x10000003d87' 2024-08-31T04:31:11.954 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11139 fp=#0x10000003984' 2024-08-31T04:31:11.954 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11171 fp=#0x100000039e6' 2024-08-31T04:31:11.954 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11203 fp=#0x10000003d9b' 2024-08-31T04:31:11.955 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11231 fp=#0x20000000e55' 2024-08-31T04:31:11.955 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11263 fp=#0x20000000e80' 2024-08-31T04:31:11.955 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11295 fp=#0x20000000e69' 2024-08-31T04:31:11.956 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11327 fp=#0x200000019b7' 2024-08-31T04:31:11.956 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11359 fp=#0x20000001eab' 2024-08-31T04:31:11.956 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11391 fp=#0x20000001966' 2024-08-31T04:31:11.957 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11423 fp=#0x20000001eed' 2024-08-31T04:31:11.957 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11455 fp=#0x20000001927' 2024-08-31T04:31:11.957 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11487 fp=#0x20000001ead' 2024-08-31T04:31:11.958 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11519 fp=#0x20000001e92' 2024-08-31T04:31:11.958 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11551 fp=#0x100000045f4' 2024-08-31T04:31:11.958 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11583 fp=#0x100000045b5' 2024-08-31T04:31:11.959 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11615 fp=#0x10000004642' 2024-08-31T04:31:11.959 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11647 fp=#0x20000000646' 2024-08-31T04:31:11.959 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11679 fp=#0x20000000660' 2024-08-31T04:31:11.960 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11711 fp=#0x2000000214e' 2024-08-31T04:31:11.960 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11775 fp=#0x200000006c1' 2024-08-31T04:31:11.961 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11807 fp=#0x2000000196e' 2024-08-31T04:31:11.961 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11871 fp=#0x200000022e2' 2024-08-31T04:31:11.962 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11903 fp=#0x20000000aab' 2024-08-31T04:31:11.962 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11935 fp=#0x20000000ac0' 2024-08-31T04:31:11.962 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11967 fp=#0x20000000a9f' 2024-08-31T04:31:11.963 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11999 fp=#0x200000016e0' 2024-08-31T04:31:11.963 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12031 fp=#0x200000016e9' 2024-08-31T04:31:11.963 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12063 fp=#0x200000016fd' 2024-08-31T04:31:11.964 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12095 fp=#0x2000000168f' 2024-08-31T04:31:11.966 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12351 fp=#0x200000010e4' 2024-08-31T04:31:11.966 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12383 fp=#0x2000000106d' 2024-08-31T04:31:11.966 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12415 fp=#0x20000001060' 2024-08-31T04:31:11.967 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12447 fp=#0x2000000103b' 2024-08-31T04:31:11.967 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12479 fp=#0x20000001f35' 2024-08-31T04:31:11.967 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12511 fp=#0x20000001f1b' 2024-08-31T04:31:11.968 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12543 fp=#0x20000000a19' 2024-08-31T04:31:11.968 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12575 fp=#0x20000000a47' 2024-08-31T04:31:11.968 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12607 fp=#0x20000000ac3' 2024-08-31T04:31:11.969 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12639 fp=#0x20000000a4c' 2024-08-31T04:31:11.969 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12671 fp=#0x20000000a37' 2024-08-31T04:31:11.969 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12703 fp=#0x10000000d03' 2024-08-31T04:31:11.970 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12735 fp=#0x10000000ef0' 2024-08-31T04:31:11.970 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12767 fp=#0x200000003db' 2024-08-31T04:31:11.970 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12799 fp=#0x10000000f16' 2024-08-31T04:31:11.971 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12831 fp=#0x10000000d26' 2024-08-31T04:31:11.971 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12863 fp=#0x10000002f3f' 2024-08-31T04:31:11.971 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12895 fp=#0x10000002f30' 2024-08-31T04:31:11.972 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12927 fp=#0x10000002f4e' 2024-08-31T04:31:11.972 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12959 fp=#0x2000000215d' 2024-08-31T04:31:11.972 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12991 fp=#0x200000020ca' 2024-08-31T04:31:11.972 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13023 fp=#0x2000000210e' 2024-08-31T04:31:11.973 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13086 fp=#0x200000007ac' 2024-08-31T04:31:11.973 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13118 fp=#0x2000000077b' 2024-08-31T04:31:11.974 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13150 fp=#0x2000000073d' 2024-08-31T04:31:11.974 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13182 fp=#0x200000010ef' 2024-08-31T04:31:11.974 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13214 fp=#0x20000000b83' 2024-08-31T04:31:11.975 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13246 fp=#0x20000000bdc' 2024-08-31T04:31:11.975 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13278 fp=#0x20000000bf8' 2024-08-31T04:31:11.975 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13310 fp=#0x20000000bec' 2024-08-31T04:31:11.976 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13342 fp=#0x20000000bc7' 2024-08-31T04:31:11.976 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13374 fp=#0x20000001d7f' 2024-08-31T04:31:11.976 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13406 fp=#0x20000001ca9' 2024-08-31T04:31:11.977 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13438 fp=#0x20000001c29' 2024-08-31T04:31:11.977 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13470 fp=#0x20000001c70' 2024-08-31T04:31:11.977 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13502 fp=#0x10000003b38' 2024-08-31T04:31:11.978 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13561 fp=#0x2000000114b' 2024-08-31T04:31:11.979 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13721 fp=#0x10000002e36' 2024-08-31T04:31:11.979 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13753 fp=#0x10000002e58' 2024-08-31T04:31:11.980 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13785 fp=#0x20000000820' 2024-08-31T04:31:11.980 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13817 fp=#0x200000015e3' 2024-08-31T04:31:11.980 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13849 fp=#0x200000007fc' 2024-08-31T04:31:11.981 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13881 fp=#0x20000000d7e' 2024-08-31T04:31:11.981 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13913 fp=#0x2000000222d' 2024-08-31T04:31:11.981 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13945 fp=#0x20000000d8e' 2024-08-31T04:31:11.982 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13977 fp=#0x2000000220e' 2024-08-31T04:31:11.982 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14009 fp=#0x200000019f4' 2024-08-31T04:31:11.982 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14041 fp=#0x20000001a18' 2024-08-31T04:31:11.983 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14073 fp=#0x20000001a48' 2024-08-31T04:31:11.983 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14105 fp=#0x200000019dc' 2024-08-31T04:31:11.983 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14137 fp=#0x20000000e41' 2024-08-31T04:31:11.984 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14169 fp=#0x2000000092f' 2024-08-31T04:31:11.984 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14201 fp=#0x200000008e5' 2024-08-31T04:31:11.984 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14233 fp=#0x20000001a84' 2024-08-31T04:31:11.985 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14297 fp=#0x20000001e06' 2024-08-31T04:31:11.985 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14329 fp=#0x20000001dd6' 2024-08-31T04:31:11.986 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14361 fp=#0x20000001ddc' 2024-08-31T04:31:11.986 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14393 fp=#0x20000001da7' 2024-08-31T04:31:11.986 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14425 fp=#0x20000001da8' 2024-08-31T04:31:11.987 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14457 fp=#0x200000018e3' 2024-08-31T04:31:11.987 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14489 fp=#0x20000001b9b' 2024-08-31T04:31:11.987 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14521 fp=#0x2000000183f' 2024-08-31T04:31:11.988 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14553 fp=#0x20000001041' 2024-08-31T04:31:11.988 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14585 fp=#0x20000000ffe' 2024-08-31T04:31:11.988 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14617 fp=#0x20000000fbd' 2024-08-31T04:31:11.988 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14649 fp=#0x20000000f09' 2024-08-31T04:31:11.989 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14681 fp=#0x20000000f0b' 2024-08-31T04:31:11.989 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14713 fp=#0x100000046d8' 2024-08-31T04:31:11.990 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14855 fp=#0x100000031d3' 2024-08-31T04:31:11.991 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14887 fp=#0x1000000316a' 2024-08-31T04:31:11.991 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14919 fp=#0x1000000313a' 2024-08-31T04:31:11.991 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14951 fp=#0x10000003127' 2024-08-31T04:31:11.992 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14983 fp=#0x100000058b7' 2024-08-31T04:31:11.992 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15015 fp=#0x20000001789' 2024-08-31T04:31:11.992 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15047 fp=#0x20000001798' 2024-08-31T04:31:11.992 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15079 fp=#0x200000017dd' 2024-08-31T04:31:11.993 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15111 fp=#0x200000017c3' 2024-08-31T04:31:11.993 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15142 fp=#0x100000057c5' 2024-08-31T04:31:11.994 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15174 fp=#0x100000057bb' 2024-08-31T04:31:11.994 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15238 fp=#0x100000016fa' 2024-08-31T04:31:11.994 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15270 fp=#0x2000000227e' 2024-08-31T04:31:11.995 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15302 fp=#0x2000000227c' 2024-08-31T04:31:11.995 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15334 fp=#0x200000021c7' 2024-08-31T04:31:11.995 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15366 fp=#0x2000000206a' 2024-08-31T04:31:11.996 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15398 fp=#0x20000002078' 2024-08-31T04:31:11.996 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15462 fp=#0x2000000205c' 2024-08-31T04:31:11.997 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15494 fp=#0x10000005348' 2024-08-31T04:31:11.997 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15526 fp=#0x10000005345' 2024-08-31T04:31:12.000 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15558 fp=#0x1000000532f' 2024-08-31T04:31:12.000 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15590 fp=#0x20000001647' 2024-08-31T04:31:12.000 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15622 fp=#0x10000004e1f' 2024-08-31T04:31:12.001 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15654 fp=#0x10000004e51' 2024-08-31T04:31:12.001 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15718 fp=#0x10000004e28' 2024-08-31T04:31:12.002 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15782 fp=#0x20000001ffa' 2024-08-31T04:31:12.002 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15814 fp=#0x20000002015' 2024-08-31T04:31:12.003 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15846 fp=#0x20000002018' 2024-08-31T04:31:12.003 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15878 fp=#0x20000002032' 2024-08-31T04:31:12.004 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15942 fp=#0x100000018b9' 2024-08-31T04:31:12.004 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16006 fp=#0x20000000ec1' 2024-08-31T04:31:12.004 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16038 fp=#0x2000000192e' 2024-08-31T04:31:12.005 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16070 fp=#0x20000001933' 2024-08-31T04:31:12.005 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16102 fp=#0x20000001136' 2024-08-31T04:31:12.005 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16134 fp=#0x2000000117b' 2024-08-31T04:31:12.006 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16166 fp=#0x2000000119a' 2024-08-31T04:31:12.006 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16198 fp=#0x20000001604' 2024-08-31T04:31:12.006 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16230 fp=#0x200000015dd' 2024-08-31T04:31:12.007 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16262 fp=#0x200000015a4' 2024-08-31T04:31:12.007 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16293 fp=#0x100000047e3' 2024-08-31T04:31:12.007 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16325 fp=#0x1000000451a' 2024-08-31T04:31:12.008 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16357 fp=#0x100000044e0' 2024-08-31T04:31:12.008 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16389 fp=#0x100000044f5' 2024-08-31T04:31:12.008 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16421 fp=#0x100000044e3' 2024-08-31T04:31:12.009 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16453 fp=#0x1000000489a' 2024-08-31T04:31:12.009 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16485 fp=#0x20000001070' 2024-08-31T04:31:12.009 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16517 fp=#0x10000004960' 2024-08-31T04:31:12.010 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16549 fp=#0x20000001ea3' 2024-08-31T04:31:12.010 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16581 fp=#0x20000001175' 2024-08-31T04:31:12.010 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16613 fp=#0x200000022c5' 2024-08-31T04:31:12.011 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16645 fp=#0x20000002296' 2024-08-31T04:31:12.011 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16677 fp=#0x10000002abc' 2024-08-31T04:31:12.011 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16709 fp=#0x10000002a94' 2024-08-31T04:31:12.011 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16741 fp=#0x2000000044e' 2024-08-31T04:31:12.012 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16805 fp=#0x10000002ae2' 2024-08-31T04:31:12.012 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16837 fp=#0x10000002a8c' 2024-08-31T04:31:12.013 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16869 fp=#0x100000045b0' 2024-08-31T04:31:12.013 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16901 fp=#0x10000004555' 2024-08-31T04:31:12.013 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16933 fp=#0x10000005d40' 2024-08-31T04:31:12.013 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16965 fp=#0x1000000455b' 2024-08-31T04:31:12.015 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17093 fp=#0x200000010a7' 2024-08-31T04:31:12.015 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17125 fp=#0x10000005738' 2024-08-31T04:31:12.016 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17285 fp=#0x1000000547f' 2024-08-31T04:31:12.016 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17317 fp=#0x100000054cd' 2024-08-31T04:31:12.017 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17349 fp=#0x20000001ac5' 2024-08-31T04:31:12.017 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17381 fp=#0x20000001ab6' 2024-08-31T04:31:12.017 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17413 fp=#0x20000001aa5' 2024-08-31T04:31:12.018 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17445 fp=#0x10000004df6' 2024-08-31T04:31:12.018 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17477 fp=#0x10000004d4e' 2024-08-31T04:31:12.018 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17509 fp=#0x10000004db2' 2024-08-31T04:31:12.019 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17541 fp=#0x20000001b4f' 2024-08-31T04:31:12.019 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17573 fp=#0x20000001b6c' 2024-08-31T04:31:12.019 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17605 fp=#0x20000001b58' 2024-08-31T04:31:12.020 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17637 fp=#0x10000002a3c' 2024-08-31T04:31:12.020 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17669 fp=#0x100000029c5' 2024-08-31T04:31:12.020 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17701 fp=#0x20000000cfe' 2024-08-31T04:31:12.021 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17733 fp=#0x20000001f4b' 2024-08-31T04:31:12.021 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17765 fp=#0x10000004efd' 2024-08-31T04:31:12.021 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17797 fp=#0x10000004ed5' 2024-08-31T04:31:12.022 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17829 fp=#0x10000004f2b' 2024-08-31T04:31:12.022 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17861 fp=#0x1000000088f' 2024-08-31T04:31:12.023 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17893 fp=#0x10000000893' 2024-08-31T04:31:12.023 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17989 fp=#0x20000001cb1' 2024-08-31T04:31:12.024 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18021 fp=#0x20000001bfb' 2024-08-31T04:31:12.024 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18053 fp=#0x20000001bf5' 2024-08-31T04:31:12.024 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18085 fp=#0x20000001765' 2024-08-31T04:31:12.025 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18117 fp=#0x20000001d6a' 2024-08-31T04:31:12.025 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18149 fp=#0x20000001711' 2024-08-31T04:31:12.025 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18181 fp=#0x20000000c47' 2024-08-31T04:31:12.026 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18213 fp=#0x20000000d28' 2024-08-31T04:31:12.026 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18245 fp=#0x20000000c4b' 2024-08-31T04:31:12.026 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18274 fp=#0x10000004a38' 2024-08-31T04:31:12.027 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18370 fp=#0x2000000084c' 2024-08-31T04:31:12.028 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18397 fp=#0x20000002185' 2024-08-31T04:31:12.028 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18429 fp=#0x20000002179' 2024-08-31T04:31:12.028 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18461 fp=#0x20000002183' 2024-08-31T04:31:12.029 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18493 fp=#0x20000002171' 2024-08-31T04:31:12.029 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18523 fp=#0x1000000364e' 2024-08-31T04:31:12.030 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:7182 fp=#0x20000001de0' 2024-08-31T04:31:12.030 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:7214 fp=#0x10000003aeb' 2024-08-31T04:31:12.032 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:7438 fp=#0x20000002011' 2024-08-31T04:31:12.033 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:7470 fp=#0x2000000202d' 2024-08-31T04:31:12.033 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:7534 fp=#0x20000001ff9' 2024-08-31T04:31:12.034 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:7566 fp=#0x20000001fc3' 2024-08-31T04:31:12.044 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:8933 fp=#0x20000000622' 2024-08-31T04:31:12.044 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:8997 fp=#0x2000000184e' 2024-08-31T04:31:12.045 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9029 fp=#0x20000000f67' 2024-08-31T04:31:12.045 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9125 fp=#0x20000001d7e' 2024-08-31T04:31:12.046 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9157 fp=#0x2000000086c' 2024-08-31T04:31:12.046 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9189 fp=#0x20000001c8c' 2024-08-31T04:31:12.047 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9221 fp=#0x20000001c69' 2024-08-31T04:31:12.047 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9253 fp=#0x20000001cd6' 2024-08-31T04:31:12.048 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9381 fp=#0x20000001a65' 2024-08-31T04:31:12.049 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9445 fp=#0x20000001546' 2024-08-31T04:31:12.049 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9477 fp=#0x20000001561' 2024-08-31T04:31:12.049 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9509 fp=#0x20000000993' 2024-08-31T04:31:12.050 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9541 fp=#0x2000000156e' 2024-08-31T04:31:12.050 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9605 fp=#0x20000001841' 2024-08-31T04:31:12.051 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9701 fp=#0x20000000b3c' 2024-08-31T04:31:12.052 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9733 fp=#0x20000000b27' 2024-08-31T04:31:12.052 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9765 fp=#0x20000000b4b' 2024-08-31T04:31:12.052 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9797 fp=#0x20000000b46' 2024-08-31T04:31:12.053 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9829 fp=#0x20000001e87' 2024-08-31T04:31:12.053 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9861 fp=#0x20000001e67' 2024-08-31T04:31:12.053 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9893 fp=#0x20000001f02' 2024-08-31T04:31:12.055 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10052 fp=#0x20000000dce' 2024-08-31T04:31:12.055 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10084 fp=#0x20000000db0' 2024-08-31T04:31:12.055 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10116 fp=#0x20000000e35' 2024-08-31T04:31:12.056 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10148 fp=#0x20000000e2b' 2024-08-31T04:31:12.056 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10180 fp=#0x20000000e27' 2024-08-31T04:31:12.056 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10212 fp=#0x20000001025' 2024-08-31T04:31:12.057 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10244 fp=#0x20000000fdb' 2024-08-31T04:31:12.057 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10276 fp=#0x200000006e5' 2024-08-31T04:31:12.057 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10308 fp=#0x2000000103d' 2024-08-31T04:31:12.058 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10340 fp=#0x200000014ad' 2024-08-31T04:31:12.058 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10372 fp=#0x20000001513' 2024-08-31T04:31:12.058 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10404 fp=#0x200000014ae' 2024-08-31T04:31:12.059 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10468 fp=#0x10000000bf4' 2024-08-31T04:31:12.059 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10500 fp=#0x10000000c37' 2024-08-31T04:31:12.060 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10532 fp=#0x10000003c94' 2024-08-31T04:31:12.060 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10564 fp=#0x10000000c2b' 2024-08-31T04:31:12.060 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10596 fp=#0x10000000b65' 2024-08-31T04:31:12.061 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10628 fp=#0x2000000208a' 2024-08-31T04:31:12.061 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10660 fp=#0x2000000206e' 2024-08-31T04:31:12.061 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10692 fp=#0x2000000209c' 2024-08-31T04:31:12.062 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10820 fp=#0x1000000345b' 2024-08-31T04:31:12.063 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10852 fp=#0x10000003414' 2024-08-31T04:31:12.063 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10884 fp=#0x100000033ee' 2024-08-31T04:31:12.063 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10916 fp=#0x200000005f2' 2024-08-31T04:31:12.064 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10948 fp=#0x20000000617' 2024-08-31T04:31:12.064 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10980 fp=#0x2000000060c' 2024-08-31T04:31:12.064 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11012 fp=#0x10000003dbc' 2024-08-31T04:31:12.065 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11044 fp=#0x10000003d7d' 2024-08-31T04:31:12.065 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11076 fp=#0x10000003ddf' 2024-08-31T04:31:12.066 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11108 fp=#0x10000003c1c' 2024-08-31T04:31:12.066 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11140 fp=#0x10000003baf' 2024-08-31T04:31:12.066 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11172 fp=#0x10000003cb9' 2024-08-31T04:31:12.067 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11204 fp=#0x10000003bc7' 2024-08-31T04:31:12.067 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11232 fp=#0x20000000e3a' 2024-08-31T04:31:12.067 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11264 fp=#0x20000000e4a' 2024-08-31T04:31:12.068 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11296 fp=#0x20000000e5c' 2024-08-31T04:31:12.068 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11328 fp=#0x200000019b9' 2024-08-31T04:31:12.068 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11360 fp=#0x20000001ebf' 2024-08-31T04:31:12.069 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11392 fp=#0x20000001e4c' 2024-08-31T04:31:12.069 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11424 fp=#0x20000001918' 2024-08-31T04:31:12.069 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11456 fp=#0x200000018dc' 2024-08-31T04:31:12.070 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11488 fp=#0x20000001e9d' 2024-08-31T04:31:12.070 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11520 fp=#0x20000001e49' 2024-08-31T04:31:12.070 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11552 fp=#0x10000004639' 2024-08-31T04:31:12.071 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11584 fp=#0x100000045be' 2024-08-31T04:31:12.071 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11616 fp=#0x100000045a6' 2024-08-31T04:31:12.071 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11648 fp=#0x2000000066a' 2024-08-31T04:31:12.072 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11712 fp=#0x20000001f01' 2024-08-31T04:31:12.072 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11776 fp=#0x200000006ae' 2024-08-31T04:31:12.073 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11808 fp=#0x2000000197d' 2024-08-31T04:31:12.073 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11872 fp=#0x200000022e7' 2024-08-31T04:31:12.074 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11904 fp=#0x20000000aa2' 2024-08-31T04:31:12.074 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11936 fp=#0x2000000164b' 2024-08-31T04:31:12.074 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11968 fp=#0x20000000a8c' 2024-08-31T04:31:12.075 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12000 fp=#0x20000001761' 2024-08-31T04:31:12.075 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12032 fp=#0x200000016b4' 2024-08-31T04:31:12.075 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12064 fp=#0x200000016cc' 2024-08-31T04:31:12.076 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12096 fp=#0x2000000172c' 2024-08-31T04:31:12.076 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12128 fp=#0x20000001fc2' 2024-08-31T04:31:12.077 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12192 fp=#0x20000001fbb' 2024-08-31T04:31:12.077 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12224 fp=#0x20000001510' 2024-08-31T04:31:12.078 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12352 fp=#0x20000001080' 2024-08-31T04:31:12.078 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12384 fp=#0x20000001077' 2024-08-31T04:31:12.079 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12416 fp=#0x20000001052' 2024-08-31T04:31:12.079 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12448 fp=#0x20000001050' 2024-08-31T04:31:12.079 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12480 fp=#0x20000001eff' 2024-08-31T04:31:12.080 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12512 fp=#0x20000001ed5' 2024-08-31T04:31:12.080 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12544 fp=#0x20000000ac5' 2024-08-31T04:31:12.080 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12576 fp=#0x200000009ec' 2024-08-31T04:31:12.081 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12608 fp=#0x20000000a33' 2024-08-31T04:31:12.081 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12640 fp=#0x20000000a08' 2024-08-31T04:31:12.082 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12672 fp=#0x20000000a56' 2024-08-31T04:31:12.082 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12704 fp=#0x200000003b6' 2024-08-31T04:31:12.082 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12736 fp=#0x10000000ea7' 2024-08-31T04:31:12.083 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12768 fp=#0x10000000eb8' 2024-08-31T04:31:12.083 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12800 fp=#0x20000000000' 2024-08-31T04:31:12.083 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12832 fp=#0x10000000e6d' 2024-08-31T04:31:12.084 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12864 fp=#0x10000002e73' 2024-08-31T04:31:12.084 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12896 fp=#0x10000002ec5' 2024-08-31T04:31:12.084 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12928 fp=#0x2000000213b' 2024-08-31T04:31:12.085 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12960 fp=#0x200000020c8' 2024-08-31T04:31:12.085 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12992 fp=#0x20000002114' 2024-08-31T04:31:12.085 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13024 fp=#0x200000020e3' 2024-08-31T04:31:12.086 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13055 fp=#0x20000000707' 2024-08-31T04:31:12.086 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13087 fp=#0x20000000799' 2024-08-31T04:31:12.086 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13119 fp=#0x200000007a9' 2024-08-31T04:31:12.087 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13151 fp=#0x200000007a5' 2024-08-31T04:31:12.087 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13183 fp=#0x2000000070e' 2024-08-31T04:31:12.087 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13215 fp=#0x20000000bed' 2024-08-31T04:31:12.087 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13247 fp=#0x20000000bca' 2024-08-31T04:31:12.088 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13279 fp=#0x20000000bc4' 2024-08-31T04:31:12.088 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13311 fp=#0x20000000bc3' 2024-08-31T04:31:12.089 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13343 fp=#0x20000000b96' 2024-08-31T04:31:12.089 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13375 fp=#0x20000001cd7' 2024-08-31T04:31:12.089 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13407 fp=#0x20000001cd1' 2024-08-31T04:31:12.090 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13439 fp=#0x20000001d1e' 2024-08-31T04:31:12.090 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13471 fp=#0x10000003b19' 2024-08-31T04:31:12.090 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13503 fp=#0x10000003b57' 2024-08-31T04:31:12.091 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13530 fp=#0x2000000212a' 2024-08-31T04:31:12.091 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13562 fp=#0x20000001158' 2024-08-31T04:31:12.091 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13594 fp=#0x20000002135' 2024-08-31T04:31:12.092 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13626 fp=#0x2000000117f' 2024-08-31T04:31:12.092 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13658 fp=#0x20000001156' 2024-08-31T04:31:12.092 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13690 fp=#0x10000002e2e' 2024-08-31T04:31:12.093 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13722 fp=#0x10000002e1f' 2024-08-31T04:31:12.093 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13754 fp=#0x10000002e49' 2024-08-31T04:31:12.093 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13786 fp=#0x200000015b7' 2024-08-31T04:31:12.094 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13818 fp=#0x200000015d1' 2024-08-31T04:31:12.094 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13850 fp=#0x20000000ca9' 2024-08-31T04:31:12.094 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13882 fp=#0x200000021f6' 2024-08-31T04:31:12.095 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13914 fp=#0x20000002263' 2024-08-31T04:31:12.095 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13946 fp=#0x20000000d05' 2024-08-31T04:31:12.095 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13978 fp=#0x20000000ccc' 2024-08-31T04:31:12.096 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14010 fp=#0x20000001a51' 2024-08-31T04:31:12.096 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14042 fp=#0x20000001a57' 2024-08-31T04:31:12.096 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14074 fp=#0x200000019ff' 2024-08-31T04:31:12.097 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14106 fp=#0x20000001a44' 2024-08-31T04:31:12.097 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14138 fp=#0x200000008ae' 2024-08-31T04:31:12.097 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14170 fp=#0x200000008d3' 2024-08-31T04:31:12.098 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14202 fp=#0x200000008f5' 2024-08-31T04:31:12.098 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14234 fp=#0x200000008c9' 2024-08-31T04:31:12.098 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14266 fp=#0x20000001da3' 2024-08-31T04:31:12.099 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14362 fp=#0x20000001dbe' 2024-08-31T04:31:12.100 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14426 fp=#0x20000001dd8' 2024-08-31T04:31:12.100 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14458 fp=#0x20000001919' 2024-08-31T04:31:12.100 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14490 fp=#0x200000018b8' 2024-08-31T04:31:12.101 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14522 fp=#0x20000001831' 2024-08-31T04:31:12.101 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14554 fp=#0x20000000fe5' 2024-08-31T04:31:12.101 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14586 fp=#0x20000000feb' 2024-08-31T04:31:12.102 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14618 fp=#0x20000000f9a' 2024-08-31T04:31:12.102 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14650 fp=#0x20000000f93' 2024-08-31T04:31:12.102 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14682 fp=#0x20000000f4e' 2024-08-31T04:31:12.103 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14714 fp=#0x100000046ce' 2024-08-31T04:31:12.103 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14778 fp=#0x20000001832' 2024-08-31T04:31:12.103 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14810 fp=#0x10000004633' 2024-08-31T04:31:12.104 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14856 fp=#0x10000003100' 2024-08-31T04:31:12.104 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14888 fp=#0x10000003190' 2024-08-31T04:31:12.105 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14920 fp=#0x10000003172' 2024-08-31T04:31:12.105 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14952 fp=#0x100000058a1' 2024-08-31T04:31:12.105 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14984 fp=#0x10000005896' 2024-08-31T04:31:12.106 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15016 fp=#0x20000001743' 2024-08-31T04:31:12.106 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15048 fp=#0x200000017b1' 2024-08-31T04:31:12.106 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15080 fp=#0x20000001780' 2024-08-31T04:31:12.107 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15112 fp=#0x200000017bc' 2024-08-31T04:31:12.107 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15143 fp=#0x100000057b9' 2024-08-31T04:31:12.107 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15175 fp=#0x1000000579d' 2024-08-31T04:31:12.108 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15207 fp=#0x1000000179b' 2024-08-31T04:31:12.108 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15239 fp=#0x10000001748' 2024-08-31T04:31:12.108 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15271 fp=#0x20000002266' 2024-08-31T04:31:12.109 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15303 fp=#0x20000002274' 2024-08-31T04:31:12.109 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15335 fp=#0x20000002213' 2024-08-31T04:31:12.109 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15367 fp=#0x20000001ccf' 2024-08-31T04:31:12.110 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15399 fp=#0x2000000206d' 2024-08-31T04:31:12.110 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15495 fp=#0x10000005351' 2024-08-31T04:31:12.111 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15527 fp=#0x20000001a2c' 2024-08-31T04:31:12.111 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15559 fp=#0x200000019f2' 2024-08-31T04:31:12.111 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15591 fp=#0x1000000531b' 2024-08-31T04:31:12.112 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15623 fp=#0x10000004e11' 2024-08-31T04:31:12.112 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15655 fp=#0x10000004e3f' 2024-08-31T04:31:12.112 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15687 fp=#0x10000004e41' 2024-08-31T04:31:12.113 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15783 fp=#0x20000001f97' 2024-08-31T04:31:12.114 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15847 fp=#0x20000002042' 2024-08-31T04:31:12.115 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16007 fp=#0x2000000192b' 2024-08-31T04:31:12.115 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16039 fp=#0x200000017db' 2024-08-31T04:31:12.115 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16071 fp=#0x2000000191d' 2024-08-31T04:31:12.116 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16103 fp=#0x20000001196' 2024-08-31T04:31:12.116 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16135 fp=#0x20000001111' 2024-08-31T04:31:12.116 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16167 fp=#0x20000001108' 2024-08-31T04:31:12.117 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16199 fp=#0x200000015e1' 2024-08-31T04:31:12.117 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16231 fp=#0x200000015ac' 2024-08-31T04:31:12.117 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16263 fp=#0x200000015ef' 2024-08-31T04:31:12.118 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16294 fp=#0x1000000452c' 2024-08-31T04:31:12.118 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16326 fp=#0x100000047db' 2024-08-31T04:31:12.118 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16358 fp=#0x100000044ea' 2024-08-31T04:31:12.119 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16390 fp=#0x10000004841' 2024-08-31T04:31:12.119 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16422 fp=#0x10000004515' 2024-08-31T04:31:12.120 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16550 fp=#0x10000004ee9' 2024-08-31T04:31:12.120 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16582 fp=#0x1000000490a' 2024-08-31T04:31:12.121 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16614 fp=#0x200000022c3' 2024-08-31T04:31:12.121 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16646 fp=#0x2000000229a' 2024-08-31T04:31:12.121 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16678 fp=#0x10000002b09' 2024-08-31T04:31:12.122 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16710 fp=#0x10000002aaa' 2024-08-31T04:31:12.122 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16742 fp=#0x20000000424' 2024-08-31T04:31:12.122 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16774 fp=#0x10000002a74' 2024-08-31T04:31:12.123 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16806 fp=#0x10000002a6c' 2024-08-31T04:31:12.123 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16838 fp=#0x10000002aa0' 2024-08-31T04:31:12.124 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16870 fp=#0x1000000454a' 2024-08-31T04:31:12.124 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16934 fp=#0x1000000454c' 2024-08-31T04:31:12.124 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16966 fp=#0x1000000457f' 2024-08-31T04:31:12.126 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17126 fp=#0x1000000573c' 2024-08-31T04:31:12.127 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17222 fp=#0x100000054eb' 2024-08-31T04:31:12.127 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17318 fp=#0x100000054c6' 2024-08-31T04:31:12.128 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17350 fp=#0x20000001a94' 2024-08-31T04:31:12.128 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17382 fp=#0x20000001ace' 2024-08-31T04:31:12.128 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17414 fp=#0x20000001a81' 2024-08-31T04:31:12.129 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17446 fp=#0x10000004d80' 2024-08-31T04:31:12.129 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17478 fp=#0x20000001661' 2024-08-31T04:31:12.129 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17510 fp=#0x10000004d78' 2024-08-31T04:31:12.130 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17542 fp=#0x20000001b78' 2024-08-31T04:31:12.130 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17574 fp=#0x20000001ae5' 2024-08-31T04:31:12.130 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17606 fp=#0x20000001b3b' 2024-08-31T04:31:12.131 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17638 fp=#0x2000000168b' 2024-08-31T04:31:12.131 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17670 fp=#0x10000002a54' 2024-08-31T04:31:12.131 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17702 fp=#0x10000002a2f' 2024-08-31T04:31:12.131 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17734 fp=#0x10000002a1e' 2024-08-31T04:31:12.132 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17766 fp=#0x10000004f47' 2024-08-31T04:31:12.132 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17798 fp=#0x10000004f11' 2024-08-31T04:31:12.132 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17830 fp=#0x10000004ee4' 2024-08-31T04:31:12.133 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17862 fp=#0x1000000112c' 2024-08-31T04:31:12.134 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17958 fp=#0x20000001bfd' 2024-08-31T04:31:12.134 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17990 fp=#0x20000001c7e' 2024-08-31T04:31:12.134 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18022 fp=#0x20000001c9a' 2024-08-31T04:31:12.135 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18054 fp=#0x20000001c24' 2024-08-31T04:31:12.135 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18086 fp=#0x20000001706' 2024-08-31T04:31:12.135 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18118 fp=#0x20000001796' 2024-08-31T04:31:12.136 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18150 fp=#0x20000001718' 2024-08-31T04:31:12.136 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18182 fp=#0x20000000d1f' 2024-08-31T04:31:12.136 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18214 fp=#0x20000000d07' 2024-08-31T04:31:12.137 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18246 fp=#0x20000000c22' 2024-08-31T04:31:12.137 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18275 fp=#0x10000004922' 2024-08-31T04:31:12.137 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18307 fp=#0x10000004a2b' 2024-08-31T04:31:12.138 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18339 fp=#0x1000000491b' 2024-08-31T04:31:12.138 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18371 fp=#0x20000002291' 2024-08-31T04:31:12.138 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18398 fp=#0x20000002234' 2024-08-31T04:31:12.139 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18430 fp=#0x20000002184' 2024-08-31T04:31:12.139 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18462 fp=#0x20000002168' 2024-08-31T04:31:12.139 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18494 fp=#0x20000002205' 2024-08-31T04:31:12.140 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18524 fp=#0x50000000b5c' 2024-08-31T04:31:12.140 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:7183 fp=#0x20000002165' 2024-08-31T04:31:12.141 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:7215 fp=#0x20000001138' 2024-08-31T04:31:12.141 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:7279 fp=#0x100000044db' 2024-08-31T04:31:12.143 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:7535 fp=#0x20000001f9f' 2024-08-31T04:31:12.152 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:8774 fp=#0x200000007c0' 2024-08-31T04:31:12.152 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:8806 fp=#0x200000007be' 2024-08-31T04:31:12.153 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:8902 fp=#0x20000000668' 2024-08-31T04:31:12.154 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:8998 fp=#0x20000001859' 2024-08-31T04:31:12.154 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9030 fp=#0x20000000fdd' 2024-08-31T04:31:12.155 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9062 fp=#0x20000000fca' 2024-08-31T04:31:12.155 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9094 fp=#0x20000000f77' 2024-08-31T04:31:12.155 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9126 fp=#0x20000000870' 2024-08-31T04:31:12.156 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9158 fp=#0x20000001cd8' 2024-08-31T04:31:12.156 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9190 fp=#0x20000000892' 2024-08-31T04:31:12.157 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9254 fp=#0x20000000862' 2024-08-31T04:31:12.158 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9382 fp=#0x200000009d1' 2024-08-31T04:31:12.158 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9414 fp=#0x20000001565' 2024-08-31T04:31:12.158 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9446 fp=#0x2000000158a' 2024-08-31T04:31:12.159 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9478 fp=#0x200000009a4' 2024-08-31T04:31:12.159 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9510 fp=#0x2000000096d' 2024-08-31T04:31:12.159 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9542 fp=#0x2000000154f' 2024-08-31T04:31:12.160 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9606 fp=#0x20000001498' 2024-08-31T04:31:12.161 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9670 fp=#0x200000018ad' 2024-08-31T04:31:12.161 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9702 fp=#0x20000000b50' 2024-08-31T04:31:12.161 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9734 fp=#0x20000000b20' 2024-08-31T04:31:12.162 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9766 fp=#0x20000000b09' 2024-08-31T04:31:12.162 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9798 fp=#0x20000000aed' 2024-08-31T04:31:12.162 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9830 fp=#0x20000001e47' 2024-08-31T04:31:12.163 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9862 fp=#0x20000001e8d' 2024-08-31T04:31:12.163 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9894 fp=#0x20000001ebd' 2024-08-31T04:31:12.164 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10053 fp=#0x20000000d92' 2024-08-31T04:31:12.164 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10085 fp=#0x20000000e18' 2024-08-31T04:31:12.165 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10117 fp=#0x20000000df0' 2024-08-31T04:31:12.165 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10149 fp=#0x20000000e02' 2024-08-31T04:31:12.165 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10181 fp=#0x2000000101d' 2024-08-31T04:31:12.166 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10213 fp=#0x20000000fe1' 2024-08-31T04:31:12.166 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10245 fp=#0x20000001012' 2024-08-31T04:31:12.166 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10277 fp=#0x20000000fd8' 2024-08-31T04:31:12.167 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10309 fp=#0x2000000107c' 2024-08-31T04:31:12.167 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10341 fp=#0x200000014b1' 2024-08-31T04:31:12.168 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10373 fp=#0x20000000908' 2024-08-31T04:31:12.168 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10405 fp=#0x200000014a9' 2024-08-31T04:31:12.168 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10437 fp=#0x20000000912' 2024-08-31T04:31:12.169 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10469 fp=#0x10000000cb2' 2024-08-31T04:31:12.169 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10501 fp=#0x10000003c7a' 2024-08-31T04:31:12.169 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10533 fp=#0x10000000b85' 2024-08-31T04:31:12.170 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10565 fp=#0x10000001838' 2024-08-31T04:31:12.170 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10597 fp=#0x10000003ca1' 2024-08-31T04:31:12.170 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10629 fp=#0x20000002110' 2024-08-31T04:31:12.171 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10661 fp=#0x20000002077' 2024-08-31T04:31:12.171 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10693 fp=#0x20000002094' 2024-08-31T04:31:12.172 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10821 fp=#0x1000000349d' 2024-08-31T04:31:12.172 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10853 fp=#0x1000000344a' 2024-08-31T04:31:12.172 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10885 fp=#0x100000033f8' 2024-08-31T04:31:12.173 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10917 fp=#0x200000005d4' 2024-08-31T04:31:12.173 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10949 fp=#0x100000033f1' 2024-08-31T04:31:12.173 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10981 fp=#0x200000005e7' 2024-08-31T04:31:12.174 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11013 fp=#0x10000003d91' 2024-08-31T04:31:12.174 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11045 fp=#0x20000000619' 2024-08-31T04:31:12.175 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11109 fp=#0x10000003be2' 2024-08-31T04:31:12.175 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11141 fp=#0x100000039f5' 2024-08-31T04:31:12.175 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11173 fp=#0x10000003d40' 2024-08-31T04:31:12.176 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11205 fp=#0x10000003db7' 2024-08-31T04:31:12.176 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11233 fp=#0x20000000e97' 2024-08-31T04:31:12.176 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11265 fp=#0x200000010f1' 2024-08-31T04:31:12.177 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11297 fp=#0x20000000e89' 2024-08-31T04:31:12.177 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11329 fp=#0x200000018de' 2024-08-31T04:31:12.177 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11361 fp=#0x20000001984' 2024-08-31T04:31:12.178 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11393 fp=#0x20000001e34' 2024-08-31T04:31:12.178 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11425 fp=#0x20000001e85' 2024-08-31T04:31:12.178 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11457 fp=#0x20000001998' 2024-08-31T04:31:12.179 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11489 fp=#0x20000001e0a' 2024-08-31T04:31:12.179 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11521 fp=#0x2000000195c' 2024-08-31T04:31:12.179 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11553 fp=#0x10000004626' 2024-08-31T04:31:12.179 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11585 fp=#0x10000004611' 2024-08-31T04:31:12.180 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11617 fp=#0x1000000461b' 2024-08-31T04:31:12.180 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11649 fp=#0x2000000068b' 2024-08-31T04:31:12.180 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11681 fp=#0x200000006c6' 2024-08-31T04:31:12.181 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11713 fp=#0x200000006b3' 2024-08-31T04:31:12.181 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11745 fp=#0x20000002143' 2024-08-31T04:31:12.181 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11809 fp=#0x20000001970' 2024-08-31T04:31:12.182 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11841 fp=#0x2000000196b' 2024-08-31T04:31:12.182 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11873 fp=#0x20000000ab6' 2024-08-31T04:31:12.183 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11905 fp=#0x20000000a98' 2024-08-31T04:31:12.183 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11937 fp=#0x20000000ab8' 2024-08-31T04:31:12.183 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11969 fp=#0x20000000aaf' 2024-08-31T04:31:12.184 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12001 fp=#0x200000016c3' 2024-08-31T04:31:12.184 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12033 fp=#0x200000016c1' 2024-08-31T04:31:12.184 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12065 fp=#0x200000016c7' 2024-08-31T04:31:12.185 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12097 fp=#0x200000016bf' 2024-08-31T04:31:12.185 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12129 fp=#0x20000001faa' 2024-08-31T04:31:12.186 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12193 fp=#0x200000014df' 2024-08-31T04:31:12.186 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12257 fp=#0x200000014e9' 2024-08-31T04:31:12.187 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12289 fp=#0x200000014ce' 2024-08-31T04:31:12.187 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12353 fp=#0x20000001046' 2024-08-31T04:31:12.187 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12385 fp=#0x2000000109b' 2024-08-31T04:31:12.188 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12417 fp=#0x200000010d7' 2024-08-31T04:31:12.188 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12449 fp=#0x20000001085' 2024-08-31T04:31:12.188 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12481 fp=#0x20000001e6c' 2024-08-31T04:31:12.189 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12513 fp=#0x20000001efb' 2024-08-31T04:31:12.189 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12545 fp=#0x20000000a38' 2024-08-31T04:31:12.189 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12577 fp=#0x20000000ac6' 2024-08-31T04:31:12.190 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12609 fp=#0x20000000a16' 2024-08-31T04:31:12.190 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12641 fp=#0x20000000a34' 2024-08-31T04:31:12.191 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12673 fp=#0x20000000a43' 2024-08-31T04:31:12.191 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12705 fp=#0x200000001fd' 2024-08-31T04:31:12.191 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12737 fp=#0x200000001f7' 2024-08-31T04:31:12.191 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12769 fp=#0x200000003ec' 2024-08-31T04:31:12.192 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12801 fp=#0x10000000de0' 2024-08-31T04:31:12.192 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12833 fp=#0x10000000d34' 2024-08-31T04:31:12.193 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12865 fp=#0x10000002f49' 2024-08-31T04:31:12.193 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12897 fp=#0x20000002103' 2024-08-31T04:31:12.193 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12929 fp=#0x200000020cf' 2024-08-31T04:31:12.194 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12961 fp=#0x10000002f32' 2024-08-31T04:31:12.194 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12993 fp=#0x20000002128' 2024-08-31T04:31:12.194 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13025 fp=#0x10000002e9e' 2024-08-31T04:31:12.195 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13056 fp=#0x200000007aa' 2024-08-31T04:31:12.195 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13088 fp=#0x20000000737' 2024-08-31T04:31:12.195 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13120 fp=#0x2000000076a' 2024-08-31T04:31:12.196 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13152 fp=#0x2000000077a' 2024-08-31T04:31:12.196 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13184 fp=#0x20000000730' 2024-08-31T04:31:12.196 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13216 fp=#0x20000000ba2' 2024-08-31T04:31:12.197 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13248 fp=#0x20000000bf3' 2024-08-31T04:31:12.197 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13280 fp=#0x20000000bf0' 2024-08-31T04:31:12.197 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13312 fp=#0x20000000bcc' 2024-08-31T04:31:12.198 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13344 fp=#0x20000000bd9' 2024-08-31T04:31:12.198 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13376 fp=#0x20000001d79' 2024-08-31T04:31:12.198 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13408 fp=#0x20000001d85' 2024-08-31T04:31:12.199 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13440 fp=#0x20000001d6e' 2024-08-31T04:31:12.199 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13472 fp=#0x10000003af1' 2024-08-31T04:31:12.200 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13504 fp=#0x10000003afa' 2024-08-31T04:31:12.200 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13531 fp=#0x20000002112' 2024-08-31T04:31:12.200 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13563 fp=#0x2000000114e' 2024-08-31T04:31:12.201 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13627 fp=#0x20000001153' 2024-08-31T04:31:12.201 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13659 fp=#0x2000000115c' 2024-08-31T04:31:12.202 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13691 fp=#0x10000002e31' 2024-08-31T04:31:12.202 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13723 fp=#0x10000002e35' 2024-08-31T04:31:12.202 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13755 fp=#0x2000000061b' 2024-08-31T04:31:12.204 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13787 fp=#0x20000000842' 2024-08-31T04:31:12.204 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13819 fp=#0x200000015cd' 2024-08-31T04:31:12.205 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13851 fp=#0x20000000dab' 2024-08-31T04:31:12.205 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13883 fp=#0x20000000d46' 2024-08-31T04:31:12.205 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13915 fp=#0x200000021ec' 2024-08-31T04:31:12.206 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13947 fp=#0x20000000d31' 2024-08-31T04:31:12.206 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13979 fp=#0x20000000d40' 2024-08-31T04:31:12.206 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14011 fp=#0x200000019c4' 2024-08-31T04:31:12.207 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14043 fp=#0x20000001a45' 2024-08-31T04:31:12.207 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14075 fp=#0x20000001a1f' 2024-08-31T04:31:12.207 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14107 fp=#0x200000019da' 2024-08-31T04:31:12.208 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14139 fp=#0x2000000094f' 2024-08-31T04:31:12.208 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14171 fp=#0x200000008de' 2024-08-31T04:31:12.208 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14203 fp=#0x200000008f9' 2024-08-31T04:31:12.209 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14235 fp=#0x20000000902' 2024-08-31T04:31:12.209 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14299 fp=#0x20000001d9e' 2024-08-31T04:31:12.210 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14331 fp=#0x20000001da2' 2024-08-31T04:31:12.210 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14363 fp=#0x20000001e3a' 2024-08-31T04:31:12.210 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14395 fp=#0x20000001db2' 2024-08-31T04:31:12.211 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14427 fp=#0x20000001dc1' 2024-08-31T04:31:12.211 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14459 fp=#0x200000018a3' 2024-08-31T04:31:12.211 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14491 fp=#0x200000018c7' 2024-08-31T04:31:12.212 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14523 fp=#0x200000018f1' 2024-08-31T04:31:12.212 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14555 fp=#0x20000001048' 2024-08-31T04:31:12.212 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14587 fp=#0x20000000f9f' 2024-08-31T04:31:12.213 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14619 fp=#0x20000000f24' 2024-08-31T04:31:12.215 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14651 fp=#0x20000000f2f' 2024-08-31T04:31:12.216 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14683 fp=#0x20000000fe2' 2024-08-31T04:31:12.216 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14715 fp=#0x10000004635' 2024-08-31T04:31:12.217 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14811 fp=#0x100000046ca' 2024-08-31T04:31:12.217 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14857 fp=#0x1000000312b' 2024-08-31T04:31:12.218 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14889 fp=#0x1000000313e' 2024-08-31T04:31:12.218 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14921 fp=#0x100000031cc' 2024-08-31T04:31:12.218 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14953 fp=#0x100000058c5' 2024-08-31T04:31:12.219 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14985 fp=#0x100000058a6' 2024-08-31T04:31:12.219 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15017 fp=#0x20000001802' 2024-08-31T04:31:12.219 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15049 fp=#0x200000017d0' 2024-08-31T04:31:12.220 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15081 fp=#0x200000017ba' 2024-08-31T04:31:12.220 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15113 fp=#0x20000001777' 2024-08-31T04:31:12.221 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15144 fp=#0x100000057c0' 2024-08-31T04:31:12.221 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15176 fp=#0x100000057b2' 2024-08-31T04:31:12.221 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15208 fp=#0x1000000170e' 2024-08-31T04:31:12.222 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15240 fp=#0x1000000173b' 2024-08-31T04:31:12.222 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15272 fp=#0x200000021fc' 2024-08-31T04:31:12.222 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15304 fp=#0x2000000226a' 2024-08-31T04:31:12.223 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15336 fp=#0x200000021c9' 2024-08-31T04:31:12.223 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15432 fp=#0x20000001ccd' 2024-08-31T04:31:12.224 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15496 fp=#0x20000001a28' 2024-08-31T04:31:12.224 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15528 fp=#0x2000000162d' 2024-08-31T04:31:12.225 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15560 fp=#0x2000000162b' 2024-08-31T04:31:12.225 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15592 fp=#0x20000001a2f' 2024-08-31T04:31:12.226 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15656 fp=#0x10000004e64' 2024-08-31T04:31:12.226 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15720 fp=#0x10000004ebe' 2024-08-31T04:31:12.226 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15752 fp=#0x20000001fd2' 2024-08-31T04:31:12.227 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15848 fp=#0x20000002119' 2024-08-31T04:31:12.227 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15880 fp=#0x20000001fdd' 2024-08-31T04:31:12.228 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15976 fp=#0x2000000203f' 2024-08-31T04:31:12.229 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16008 fp=#0x20000000ea6' 2024-08-31T04:31:12.229 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16040 fp=#0x20000001928' 2024-08-31T04:31:12.229 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16072 fp=#0x2000000190e' 2024-08-31T04:31:12.230 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16104 fp=#0x2000000111c' 2024-08-31T04:31:12.230 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16136 fp=#0x2000000112e' 2024-08-31T04:31:12.230 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16168 fp=#0x2000000110e' 2024-08-31T04:31:12.230 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16200 fp=#0x200000015fd' 2024-08-31T04:31:12.231 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16232 fp=#0x200000015b1' 2024-08-31T04:31:12.231 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16264 fp=#0x200000015a9' 2024-08-31T04:31:12.231 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16295 fp=#0x100000044ec' 2024-08-31T04:31:12.232 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16327 fp=#0x10000004503' 2024-08-31T04:31:12.232 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16359 fp=#0x100000047e7' 2024-08-31T04:31:12.232 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16391 fp=#0x10000004816' 2024-08-31T04:31:12.233 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16423 fp=#0x100000047f6' 2024-08-31T04:31:12.233 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16455 fp=#0x10000004523' 2024-08-31T04:31:12.233 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16487 fp=#0x10000004ef7' 2024-08-31T04:31:12.234 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16519 fp=#0x10000004e1b' 2024-08-31T04:31:12.234 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16551 fp=#0x10000004900' 2024-08-31T04:31:12.234 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16583 fp=#0x2000000118f' 2024-08-31T04:31:12.235 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16615 fp=#0x200000022c2' 2024-08-31T04:31:12.235 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16647 fp=#0x200000022b5' 2024-08-31T04:31:12.235 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16679 fp=#0x20000001689' 2024-08-31T04:31:12.235 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16711 fp=#0x10000002aaf' 2024-08-31T04:31:12.236 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16743 fp=#0x200000010a9' 2024-08-31T04:31:12.236 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16775 fp=#0x10000002aad' 2024-08-31T04:31:12.236 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16807 fp=#0x20000000407' 2024-08-31T04:31:12.237 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16839 fp=#0x20000000432' 2024-08-31T04:31:12.237 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16871 fp=#0x100000045ac' 2024-08-31T04:31:12.237 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16903 fp=#0x2000000213c' 2024-08-31T04:31:12.238 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16935 fp=#0x1000000457b' 2024-08-31T04:31:12.238 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16967 fp=#0x10000004575' 2024-08-31T04:31:12.239 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17095 fp=#0x10000005793' 2024-08-31T04:31:12.240 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17159 fp=#0x10000005784' 2024-08-31T04:31:12.240 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17191 fp=#0x1000000578a' 2024-08-31T04:31:12.240 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17223 fp=#0x10000005475' 2024-08-31T04:31:12.241 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17287 fp=#0x100000054c8' 2024-08-31T04:31:12.241 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17319 fp=#0x1000000547a' 2024-08-31T04:31:12.242 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17351 fp=#0x20000001acc' 2024-08-31T04:31:12.242 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17383 fp=#0x20000001a9f' 2024-08-31T04:31:12.242 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17415 fp=#0x20000001a60' 2024-08-31T04:31:12.243 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17447 fp=#0x10000004db4' 2024-08-31T04:31:12.243 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17479 fp=#0x10000004d95' 2024-08-31T04:31:12.243 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17511 fp=#0x10000004d5a' 2024-08-31T04:31:12.244 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17543 fp=#0x20000001b02' 2024-08-31T04:31:12.244 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17575 fp=#0x20000001b40' 2024-08-31T04:31:12.244 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17607 fp=#0x10000002a43' 2024-08-31T04:31:12.244 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17639 fp=#0x10000002a07' 2024-08-31T04:31:12.245 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17671 fp=#0x20000001f4a' 2024-08-31T04:31:12.245 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17703 fp=#0x100000029f7' 2024-08-31T04:31:12.245 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17735 fp=#0x20000002061' 2024-08-31T04:31:12.246 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17767 fp=#0x10000004f51' 2024-08-31T04:31:12.246 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17799 fp=#0x10000004f00' 2024-08-31T04:31:12.246 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17831 fp=#0x10000004f23' 2024-08-31T04:31:12.247 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17959 fp=#0x20000001d31' 2024-08-31T04:31:12.248 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17991 fp=#0x20000001c95' 2024-08-31T04:31:12.248 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18023 fp=#0x20000001c54' 2024-08-31T04:31:12.248 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18055 fp=#0x20000001cc9' 2024-08-31T04:31:12.249 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18087 fp=#0x2000000178f' 2024-08-31T04:31:12.249 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18119 fp=#0x20000001d7a' 2024-08-31T04:31:12.249 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18151 fp=#0x2000000175b' 2024-08-31T04:31:12.250 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18183 fp=#0x20000000c20' 2024-08-31T04:31:12.250 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18215 fp=#0x20000000c94' 2024-08-31T04:31:12.250 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18247 fp=#0x20000000c55' 2024-08-31T04:31:12.251 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18276 fp=#0x10000004a19' 2024-08-31T04:31:12.251 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18308 fp=#0x100000049ed' 2024-08-31T04:31:12.252 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18340 fp=#0x200000022f6' 2024-08-31T04:31:12.252 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18372 fp=#0x100000049ea' 2024-08-31T04:31:12.252 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18399 fp=#0x20000002170' 2024-08-31T04:31:12.252 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18431 fp=#0x2000000217b' 2024-08-31T04:31:12.253 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18463 fp=#0x2000000221b' 2024-08-31T04:31:12.253 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18495 fp=#0x2000000218a' 2024-08-31T04:31:12.253 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18525 fp=#0x40000000bad' 2024-08-31T04:31:12.254 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'peer_request:mds.0:11502' 2024-08-31T04:31:12.254 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:7216 fp=#0x10000002e18' 2024-08-31T04:31:12.256 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:7440 fp=#0x2000000200d' 2024-08-31T04:31:12.257 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:7536 fp=#0x20000001fb6' 2024-08-31T04:31:12.267 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:8871 fp=#0x20000000626' 2024-08-31T04:31:12.267 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:8903 fp=#0x20000000661' 2024-08-31T04:31:12.268 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:8967 fp=#0x2000000064c' 2024-08-31T04:31:12.269 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:8999 fp=#0x200000018c3' 2024-08-31T04:31:12.269 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9031 fp=#0x20000000f50' 2024-08-31T04:31:12.269 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9063 fp=#0x20000000f6e' 2024-08-31T04:31:12.270 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9127 fp=#0x20000000897' 2024-08-31T04:31:12.270 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9159 fp=#0x20000001cb9' 2024-08-31T04:31:12.271 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9191 fp=#0x20000000874' 2024-08-31T04:31:12.271 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9223 fp=#0x20000001c83' 2024-08-31T04:31:12.271 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9255 fp=#0x20000000868' 2024-08-31T04:31:12.272 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9383 fp=#0x200000009b2' 2024-08-31T04:31:12.272 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9415 fp=#0x20000000960' 2024-08-31T04:31:12.273 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9447 fp=#0x20000000971' 2024-08-31T04:31:12.273 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9479 fp=#0x20000001584' 2024-08-31T04:31:12.273 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9511 fp=#0x20000000989' 2024-08-31T04:31:12.274 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9543 fp=#0x20000001558' 2024-08-31T04:31:12.274 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9575 fp=#0x200000018cc' 2024-08-31T04:31:12.275 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9639 fp=#0x20000001857' 2024-08-31T04:31:12.275 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9671 fp=#0x20000001838' 2024-08-31T04:31:12.275 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9703 fp=#0x20000000b11' 2024-08-31T04:31:12.276 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9735 fp=#0x20000001f77' 2024-08-31T04:31:12.276 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9767 fp=#0x20000000b04' 2024-08-31T04:31:12.276 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9799 fp=#0x20000000af0' 2024-08-31T04:31:12.277 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9831 fp=#0x20000001f0f' 2024-08-31T04:31:12.277 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9863 fp=#0x20000001ea9' 2024-08-31T04:31:12.277 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9895 fp=#0x20000001e9b' 2024-08-31T04:31:12.278 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10054 fp=#0x20000000e29' 2024-08-31T04:31:12.279 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10086 fp=#0x20000000df9' 2024-08-31T04:31:12.279 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10118 fp=#0x20000000e2c' 2024-08-31T04:31:12.279 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10150 fp=#0x20000000d53' 2024-08-31T04:31:12.280 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10182 fp=#0x20000000d87' 2024-08-31T04:31:12.280 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10214 fp=#0x200000006f2' 2024-08-31T04:31:12.280 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10246 fp=#0x20000000ff8' 2024-08-31T04:31:12.281 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10278 fp=#0x200000006db' 2024-08-31T04:31:12.281 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10310 fp=#0x2000000105c' 2024-08-31T04:31:12.281 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10342 fp=#0x200000014d4' 2024-08-31T04:31:12.282 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10374 fp=#0x2000000090e' 2024-08-31T04:31:12.282 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10406 fp=#0x200000014cf' 2024-08-31T04:31:12.282 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10438 fp=#0x20000001dfd' 2024-08-31T04:31:12.283 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10470 fp=#0x10000000cc8' 2024-08-31T04:31:12.283 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10502 fp=#0x10000003c78' 2024-08-31T04:31:12.283 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10534 fp=#0x10000000b99' 2024-08-31T04:31:12.284 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10566 fp=#0x100000010e0' 2024-08-31T04:31:12.284 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10598 fp=#0x100000010e5' 2024-08-31T04:31:12.284 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10630 fp=#0x20000002062' 2024-08-31T04:31:12.285 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10662 fp=#0x200000020a3' 2024-08-31T04:31:12.285 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10694 fp=#0x200000020b0' 2024-08-31T04:31:12.286 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10822 fp=#0x10000003407' 2024-08-31T04:31:12.286 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10854 fp=#0x20000001dec' 2024-08-31T04:31:12.287 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10886 fp=#0x10000003497' 2024-08-31T04:31:12.287 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10918 fp=#0x100000033e8' 2024-08-31T04:31:12.287 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10950 fp=#0x10000003465' 2024-08-31T04:31:12.288 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10982 fp=#0x200000005ee' 2024-08-31T04:31:12.288 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11046 fp=#0x10000003a01' 2024-08-31T04:31:12.289 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11078 fp=#0x10000003d32' 2024-08-31T04:31:12.289 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11142 fp=#0x10000003d02' 2024-08-31T04:31:12.290 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11174 fp=#0x10000003d57' 2024-08-31T04:31:12.290 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11234 fp=#0x20000000e63' 2024-08-31T04:31:12.291 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11266 fp=#0x20000000e61' 2024-08-31T04:31:12.291 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11298 fp=#0x20000000e5f' 2024-08-31T04:31:12.291 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11330 fp=#0x2000000195f' 2024-08-31T04:31:12.292 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11362 fp=#0x2000000189c' 2024-08-31T04:31:12.292 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11394 fp=#0x20000001efc' 2024-08-31T04:31:12.292 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11426 fp=#0x20000001e0f' 2024-08-31T04:31:12.293 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11458 fp=#0x20000001968' 2024-08-31T04:31:12.293 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11490 fp=#0x20000001960' 2024-08-31T04:31:12.293 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11522 fp=#0x20000001962' 2024-08-31T04:31:12.294 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11554 fp=#0x100000045ee' 2024-08-31T04:31:12.294 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11586 fp=#0x100000045ce' 2024-08-31T04:31:12.294 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11618 fp=#0x100000045af' 2024-08-31T04:31:12.295 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11650 fp=#0x20000000685' 2024-08-31T04:31:12.295 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11682 fp=#0x200000006b6' 2024-08-31T04:31:12.296 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11714 fp=#0x200000006b7' 2024-08-31T04:31:12.296 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11746 fp=#0x200000006d4' 2024-08-31T04:31:12.296 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11778 fp=#0x200000006a9' 2024-08-31T04:31:12.297 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11874 fp=#0x20000000ab1' 2024-08-31T04:31:12.297 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11906 fp=#0x20000001625' 2024-08-31T04:31:12.298 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11938 fp=#0x20000000a9a' 2024-08-31T04:31:12.298 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11970 fp=#0x20000000a75' 2024-08-31T04:31:12.299 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12002 fp=#0x20000001734' 2024-08-31T04:31:12.299 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12034 fp=#0x200000016b7' 2024-08-31T04:31:12.299 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12066 fp=#0x2000000169b' 2024-08-31T04:31:12.300 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12098 fp=#0x200000016c6' 2024-08-31T04:31:12.300 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12162 fp=#0x20000001fa0' 2024-08-31T04:31:12.301 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12290 fp=#0x200000014ee' 2024-08-31T04:31:12.302 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12354 fp=#0x200000010d8' 2024-08-31T04:31:12.302 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12386 fp=#0x200000010c6' 2024-08-31T04:31:12.302 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12418 fp=#0x20000001099' 2024-08-31T04:31:12.303 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12450 fp=#0x200000010c2' 2024-08-31T04:31:12.303 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12482 fp=#0x20000001e79' 2024-08-31T04:31:12.303 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12514 fp=#0x20000001e9c' 2024-08-31T04:31:12.304 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12546 fp=#0x200000009e8' 2024-08-31T04:31:12.304 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12578 fp=#0x20000000a5e' 2024-08-31T04:31:12.305 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12610 fp=#0x200000009e7' 2024-08-31T04:31:12.305 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12642 fp=#0x20000000a1f' 2024-08-31T04:31:12.305 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12674 fp=#0x200000009f6' 2024-08-31T04:31:12.306 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12706 fp=#0x20000000588' 2024-08-31T04:31:12.306 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12738 fp=#0x200000003b7' 2024-08-31T04:31:12.306 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12770 fp=#0x10000000df0' 2024-08-31T04:31:12.307 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12802 fp=#0x10000000ec6' 2024-08-31T04:31:12.307 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12834 fp=#0x10000000e59' 2024-08-31T04:31:12.307 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12866 fp=#0x10000002e85' 2024-08-31T04:31:12.308 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12898 fp=#0x20000002105' 2024-08-31T04:31:12.308 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12930 fp=#0x200000020f9' 2024-08-31T04:31:12.308 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12962 fp=#0x10000002eb7' 2024-08-31T04:31:12.309 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12994 fp=#0x20000002115' 2024-08-31T04:31:12.309 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13026 fp=#0x10000002eae' 2024-08-31T04:31:12.309 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13057 fp=#0x200000007b3' 2024-08-31T04:31:12.310 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13089 fp=#0x20000000742' 2024-08-31T04:31:12.310 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13121 fp=#0x20000000753' 2024-08-31T04:31:12.310 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13153 fp=#0x20000000784' 2024-08-31T04:31:12.311 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13185 fp=#0x20000000733' 2024-08-31T04:31:12.311 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13217 fp=#0x20000000b6e' 2024-08-31T04:31:12.311 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13249 fp=#0x20000000ba3' 2024-08-31T04:31:12.312 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13281 fp=#0x20000000bb5' 2024-08-31T04:31:12.312 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13313 fp=#0x20000000b8d' 2024-08-31T04:31:12.312 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13345 fp=#0x20000000bc6' 2024-08-31T04:31:12.313 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13377 fp=#0x20000001c4f' 2024-08-31T04:31:12.313 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13409 fp=#0x20000001c80' 2024-08-31T04:31:12.313 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13441 fp=#0x20000001c9b' 2024-08-31T04:31:12.314 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13473 fp=#0x10000003b7c' 2024-08-31T04:31:12.314 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13505 fp=#0x2000000228a' 2024-08-31T04:31:12.315 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13564 fp=#0x20000001160' 2024-08-31T04:31:12.315 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13660 fp=#0x200000011c5' 2024-08-31T04:31:12.316 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13692 fp=#0x10000002e60' 2024-08-31T04:31:12.316 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13724 fp=#0x10000002e3a' 2024-08-31T04:31:12.316 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13756 fp=#0x10000002f1a' 2024-08-31T04:31:12.317 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13788 fp=#0x20000000845' 2024-08-31T04:31:12.317 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13820 fp=#0x200000015de' 2024-08-31T04:31:12.317 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13852 fp=#0x20000000d9c' 2024-08-31T04:31:12.318 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13884 fp=#0x20000000d9e' 2024-08-31T04:31:12.318 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13916 fp=#0x20000000cca' 2024-08-31T04:31:12.318 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13948 fp=#0x20000000cc4' 2024-08-31T04:31:12.319 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13980 fp=#0x20000002245' 2024-08-31T04:31:12.319 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14012 fp=#0x200000019d8' 2024-08-31T04:31:12.319 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14044 fp=#0x200000019e1' 2024-08-31T04:31:12.320 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14076 fp=#0x20000001a25' 2024-08-31T04:31:12.320 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14108 fp=#0x200000019dd' 2024-08-31T04:31:12.320 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14140 fp=#0x200000008d4' 2024-08-31T04:31:12.321 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14172 fp=#0x200000008d5' 2024-08-31T04:31:12.321 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14204 fp=#0x2000000089f' 2024-08-31T04:31:12.321 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14236 fp=#0x200000008b3' 2024-08-31T04:31:12.322 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14268 fp=#0x20000001da1' 2024-08-31T04:31:12.323 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14364 fp=#0x20000001db1' 2024-08-31T04:31:12.323 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14396 fp=#0x20000001dda' 2024-08-31T04:31:12.324 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14460 fp=#0x20000001902' 2024-08-31T04:31:12.324 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14492 fp=#0x2000000194c' 2024-08-31T04:31:12.324 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14524 fp=#0x20000001879' 2024-08-31T04:31:12.325 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14556 fp=#0x20000000f17' 2024-08-31T04:31:12.325 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14588 fp=#0x20000000f68' 2024-08-31T04:31:12.325 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14620 fp=#0x20000000f84' 2024-08-31T04:31:12.326 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14652 fp=#0x20000000f02' 2024-08-31T04:31:12.326 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14684 fp=#0x20000000fd0' 2024-08-31T04:31:12.326 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14716 fp=#0x20000000c01' 2024-08-31T04:31:12.327 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14748 fp=#0x100000046e2' 2024-08-31T04:31:12.328 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14858 fp=#0x10000003152' 2024-08-31T04:31:12.328 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14890 fp=#0x100000031af' 2024-08-31T04:31:12.328 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14922 fp=#0x1000000319e' 2024-08-31T04:31:12.329 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14954 fp=#0x100000058c9' 2024-08-31T04:31:12.329 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14986 fp=#0x1000000589f' 2024-08-31T04:31:12.329 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15018 fp=#0x2000000170f' 2024-08-31T04:31:12.330 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15050 fp=#0x20000001722' 2024-08-31T04:31:12.330 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15082 fp=#0x200000017be' 2024-08-31T04:31:12.331 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15114 fp=#0x200000017e4' 2024-08-31T04:31:12.331 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15145 fp=#0x100000057be' 2024-08-31T04:31:12.331 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15177 fp=#0x100000057a9' 2024-08-31T04:31:12.332 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15209 fp=#0x10000001735' 2024-08-31T04:31:12.332 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15241 fp=#0x10000001702' 2024-08-31T04:31:12.332 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15273 fp=#0x20000002279' 2024-08-31T04:31:12.333 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15305 fp=#0x2000000221c' 2024-08-31T04:31:12.333 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15337 fp=#0x2000000220f' 2024-08-31T04:31:12.333 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15401 fp=#0x20000002065' 2024-08-31T04:31:12.334 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15497 fp=#0x1000000533e' 2024-08-31T04:31:12.335 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15529 fp=#0x20000001a21' 2024-08-31T04:31:12.335 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15593 fp=#0x20000001a1c' 2024-08-31T04:31:12.336 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15625 fp=#0x10000004ecc' 2024-08-31T04:31:12.336 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15657 fp=#0x10000004e00' 2024-08-31T04:31:12.336 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15689 fp=#0x10000004eab' 2024-08-31T04:31:12.337 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15721 fp=#0x10000004e31' 2024-08-31T04:31:12.338 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15849 fp=#0x20000001fed' 2024-08-31T04:31:12.338 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15881 fp=#0x20000002038' 2024-08-31T04:31:12.339 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15977 fp=#0x20000002021' 2024-08-31T04:31:12.339 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16009 fp=#0x20000000ebc' 2024-08-31T04:31:12.340 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16041 fp=#0x2000000193f' 2024-08-31T04:31:12.340 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16073 fp=#0x20000000ea3' 2024-08-31T04:31:12.340 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16105 fp=#0x20000001176' 2024-08-31T04:31:12.341 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16137 fp=#0x20000001132' 2024-08-31T04:31:12.341 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16169 fp=#0x20000001161' 2024-08-31T04:31:12.341 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16201 fp=#0x200000015f4' 2024-08-31T04:31:12.342 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16233 fp=#0x20000001592' 2024-08-31T04:31:12.342 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16265 fp=#0x200000015fa' 2024-08-31T04:31:12.342 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16296 fp=#0x1000000452a' 2024-08-31T04:31:12.343 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16328 fp=#0x10000004836' 2024-08-31T04:31:12.343 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16360 fp=#0x1000000452e' 2024-08-31T04:31:12.343 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16392 fp=#0x100000048a4' 2024-08-31T04:31:12.344 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16424 fp=#0x100000044fc' 2024-08-31T04:31:12.344 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16456 fp=#0x100000048a0' 2024-08-31T04:31:12.344 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16488 fp=#0x10000004f06' 2024-08-31T04:31:12.345 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16520 fp=#0x200000011c2' 2024-08-31T04:31:12.345 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16552 fp=#0x20000001178' 2024-08-31T04:31:12.345 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16584 fp=#0x10000004edc' 2024-08-31T04:31:12.346 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16616 fp=#0x200000022cb' 2024-08-31T04:31:12.346 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16648 fp=#0x20000002283' 2024-08-31T04:31:12.346 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16680 fp=#0x10000002a81' 2024-08-31T04:31:12.347 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16712 fp=#0x20000000439' 2024-08-31T04:31:12.347 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16744 fp=#0x10000002a60' 2024-08-31T04:31:12.347 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16776 fp=#0x20000000413' 2024-08-31T04:31:12.348 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16808 fp=#0x20000000414' 2024-08-31T04:31:12.348 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16840 fp=#0x10000002abf' 2024-08-31T04:31:12.349 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16872 fp=#0x10000005d51' 2024-08-31T04:31:12.349 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16904 fp=#0x10000005d58' 2024-08-31T04:31:12.349 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16936 fp=#0x10000004554' 2024-08-31T04:31:12.350 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16968 fp=#0x10000004557' 2024-08-31T04:31:12.351 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17096 fp=#0x10000005791' 2024-08-31T04:31:12.351 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17160 fp=#0x10000005733' 2024-08-31T04:31:12.352 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17224 fp=#0x100000054d5' 2024-08-31T04:31:12.352 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17256 fp=#0x10000005462' 2024-08-31T04:31:12.353 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17320 fp=#0x100000054dd' 2024-08-31T04:31:12.353 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17352 fp=#0x20000001aca' 2024-08-31T04:31:12.354 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17384 fp=#0x20000001a97' 2024-08-31T04:31:12.354 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17416 fp=#0x20000001a87' 2024-08-31T04:31:12.354 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17448 fp=#0x10000004daa' 2024-08-31T04:31:12.355 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17480 fp=#0x10000004dd7' 2024-08-31T04:31:12.355 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17512 fp=#0x10000004dbd' 2024-08-31T04:31:12.355 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17544 fp=#0x20000001b6a' 2024-08-31T04:31:12.356 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17576 fp=#0x20000001b46' 2024-08-31T04:31:12.356 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17608 fp=#0x20000001f0e' 2024-08-31T04:31:12.356 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17640 fp=#0x10000002a29' 2024-08-31T04:31:12.356 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17672 fp=#0x20000001f17' 2024-08-31T04:31:12.357 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17704 fp=#0x20000001f03' 2024-08-31T04:31:12.357 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17736 fp=#0x100000029f6' 2024-08-31T04:31:12.358 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17768 fp=#0x10000004eec' 2024-08-31T04:31:12.358 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17800 fp=#0x10000004f16' 2024-08-31T04:31:12.358 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17832 fp=#0x10000005c11' 2024-08-31T04:31:12.358 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17864 fp=#0x1000000088e' 2024-08-31T04:31:12.359 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17928 fp=#0x10000000826' 2024-08-31T04:31:12.359 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17960 fp=#0x20000001d08' 2024-08-31T04:31:12.360 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17992 fp=#0x20000001c9e' 2024-08-31T04:31:12.360 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18024 fp=#0x20000001c0e' 2024-08-31T04:31:12.360 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18056 fp=#0x20000001c21' 2024-08-31T04:31:12.361 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18088 fp=#0x200000016ed' 2024-08-31T04:31:12.361 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18120 fp=#0x20000001786' 2024-08-31T04:31:12.362 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18152 fp=#0x20000001775' 2024-08-31T04:31:12.362 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18184 fp=#0x20000000c26' 2024-08-31T04:31:12.362 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18216 fp=#0x20000000c5b' 2024-08-31T04:31:12.363 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18248 fp=#0x20000000c0e' 2024-08-31T04:31:12.363 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18277 fp=#0x10000004a2e' 2024-08-31T04:31:12.363 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18309 fp=#0x1000000491e' 2024-08-31T04:31:12.364 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18341 fp=#0x20000000859' 2024-08-31T04:31:12.364 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18373 fp=#0x1000000493c' 2024-08-31T04:31:12.364 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18400 fp=#0x2000000216c' 2024-08-31T04:31:12.365 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18432 fp=#0x2000000218c' 2024-08-31T04:31:12.365 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18464 fp=#0x2000000219c' 2024-08-31T04:31:12.365 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18496 fp=#0x200000021f4' 2024-08-31T04:31:12.366 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18526 fp=#0x100000036b7' 2024-08-31T04:31:12.366 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18558 fp=#0x100000036f1' 2024-08-31T04:31:12.367 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'peer_request:mds.0:11503' 2024-08-31T04:31:12.367 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:7217 fp=#0x200000007f8' 2024-08-31T04:31:12.368 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:7281 fp=#0x100000048cc' 2024-08-31T04:31:12.369 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:7409 fp=#0x2000000200b' 2024-08-31T04:31:12.369 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:7441 fp=#0x20000002034' 2024-08-31T04:31:12.380 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:8840 fp=#0x20000001ab2' 2024-08-31T04:31:12.380 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:8872 fp=#0x20000000629' 2024-08-31T04:31:12.380 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:8904 fp=#0x20000000694' 2024-08-31T04:31:12.381 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:8936 fp=#0x20000000625' 2024-08-31T04:31:12.381 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9000 fp=#0x200000018d0' 2024-08-31T04:31:12.382 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9128 fp=#0x20000001ce9' 2024-08-31T04:31:12.383 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9160 fp=#0x20000001d97' 2024-08-31T04:31:12.383 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9192 fp=#0x20000001d36' 2024-08-31T04:31:12.383 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9224 fp=#0x2000000086a' 2024-08-31T04:31:12.385 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9384 fp=#0x200000009d3' 2024-08-31T04:31:12.385 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9416 fp=#0x20000001543' 2024-08-31T04:31:12.386 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9448 fp=#0x2000000099d' 2024-08-31T04:31:12.386 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9480 fp=#0x200000009d2' 2024-08-31T04:31:12.386 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9512 fp=#0x200000009c6' 2024-08-31T04:31:12.387 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9544 fp=#0x20000000979' 2024-08-31T04:31:12.387 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9640 fp=#0x200000018bf' 2024-08-31T04:31:12.388 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9672 fp=#0x2000000184a' 2024-08-31T04:31:12.388 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9704 fp=#0x20000000b49' 2024-08-31T04:31:12.388 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9736 fp=#0x20000001f6f' 2024-08-31T04:31:12.389 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9768 fp=#0x20000000afa' 2024-08-31T04:31:12.389 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9800 fp=#0x20000000b08' 2024-08-31T04:31:12.390 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9832 fp=#0x20000001eae' 2024-08-31T04:31:12.390 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9864 fp=#0x20000001f13' 2024-08-31T04:31:12.390 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9896 fp=#0x20000001e3e' 2024-08-31T04:31:12.392 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10055 fp=#0x20000000d38' 2024-08-31T04:31:12.392 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10087 fp=#0x20000000e2f' 2024-08-31T04:31:12.392 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10119 fp=#0x20000000de1' 2024-08-31T04:31:12.393 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10151 fp=#0x20000000db9' 2024-08-31T04:31:12.393 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10183 fp=#0x20000000d9a' 2024-08-31T04:31:12.393 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10215 fp=#0x200000006ee' 2024-08-31T04:31:12.394 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10247 fp=#0x20000001072' 2024-08-31T04:31:12.394 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10279 fp=#0x200000006eb' 2024-08-31T04:31:12.394 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10311 fp=#0x20000001067' 2024-08-31T04:31:12.395 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10343 fp=#0x200000014e5' 2024-08-31T04:31:12.395 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10375 fp=#0x200000014fe' 2024-08-31T04:31:12.395 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10407 fp=#0x2000000149c' 2024-08-31T04:31:12.396 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10439 fp=#0x20000000926' 2024-08-31T04:31:12.396 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10471 fp=#0x10000000b54' 2024-08-31T04:31:12.397 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10503 fp=#0x10000000b91' 2024-08-31T04:31:12.397 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10535 fp=#0x10000001106' 2024-08-31T04:31:12.397 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10567 fp=#0x10000000bab' 2024-08-31T04:31:12.398 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10599 fp=#0x1000000110b' 2024-08-31T04:31:12.398 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10631 fp=#0x20000002068' 2024-08-31T04:31:12.398 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10663 fp=#0x20000002079' 2024-08-31T04:31:12.399 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10695 fp=#0x200000020ac' 2024-08-31T04:31:12.400 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10823 fp=#0x10000003485' 2024-08-31T04:31:12.400 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10855 fp=#0x10000003453' 2024-08-31T04:31:12.400 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10887 fp=#0x200000005fd' 2024-08-31T04:31:12.401 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10919 fp=#0x20000000610' 2024-08-31T04:31:12.401 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10951 fp=#0x1000000340c' 2024-08-31T04:31:12.401 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10983 fp=#0x200000005d7' 2024-08-31T04:31:12.402 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11015 fp=#0x10000003d4a' 2024-08-31T04:31:12.402 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11047 fp=#0x10000003d27' 2024-08-31T04:31:12.402 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11079 fp=#0x10000003992' 2024-08-31T04:31:12.403 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11111 fp=#0x10000003a0e' 2024-08-31T04:31:12.403 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11143 fp=#0x100000039e2' 2024-08-31T04:31:12.403 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11175 fp=#0x10000003d43' 2024-08-31T04:31:12.404 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11207 fp=#0x10000003d1f' 2024-08-31T04:31:12.404 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11235 fp=#0x20000000e95' 2024-08-31T04:31:12.404 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11267 fp=#0x20000000e99' 2024-08-31T04:31:12.405 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11299 fp=#0x20000000e5a' 2024-08-31T04:31:12.405 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11331 fp=#0x200000019ad' 2024-08-31T04:31:12.406 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11363 fp=#0x20000001e94' 2024-08-31T04:31:12.406 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11395 fp=#0x2000000191e' 2024-08-31T04:31:12.406 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11427 fp=#0x20000001e16' 2024-08-31T04:31:12.407 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11459 fp=#0x20000001e59' 2024-08-31T04:31:12.407 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11491 fp=#0x200000019a2' 2024-08-31T04:31:12.407 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11523 fp=#0x200000018f3' 2024-08-31T04:31:12.408 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11555 fp=#0x1000000460b' 2024-08-31T04:31:12.408 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11587 fp=#0x10000004598' 2024-08-31T04:31:12.408 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11619 fp=#0x10000004632' 2024-08-31T04:31:12.409 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11651 fp=#0x2000000065d' 2024-08-31T04:31:12.409 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11683 fp=#0x200000006bf' 2024-08-31T04:31:12.409 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11715 fp=#0x20000001997' 2024-08-31T04:31:12.410 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11811 fp=#0x200000006a6' 2024-08-31T04:31:12.411 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11843 fp=#0x200000006a2' 2024-08-31T04:31:12.411 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11875 fp=#0x20000000a8d' 2024-08-31T04:31:12.411 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11907 fp=#0x20000001622' 2024-08-31T04:31:12.412 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11939 fp=#0x20000000a7d' 2024-08-31T04:31:12.412 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11971 fp=#0x2000000163c' 2024-08-31T04:31:12.412 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12003 fp=#0x20000001694' 2024-08-31T04:31:12.413 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12035 fp=#0x200000016ca' 2024-08-31T04:31:12.413 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12067 fp=#0x200000016bc' 2024-08-31T04:31:12.414 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12099 fp=#0x200000016e3' 2024-08-31T04:31:12.414 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12163 fp=#0x20000001f9d' 2024-08-31T04:31:12.415 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12227 fp=#0x200000014bb' 2024-08-31T04:31:12.415 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12291 fp=#0x200000014c4' 2024-08-31T04:31:12.416 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12355 fp=#0x20000001094' 2024-08-31T04:31:12.416 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12387 fp=#0x20000001079' 2024-08-31T04:31:12.417 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12419 fp=#0x200000010a2' 2024-08-31T04:31:12.417 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12451 fp=#0x200000010a1' 2024-08-31T04:31:12.417 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12483 fp=#0x20000001e96' 2024-08-31T04:31:12.418 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12515 fp=#0x20000001e7d' 2024-08-31T04:31:12.418 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12547 fp=#0x20000000ac4' 2024-08-31T04:31:12.418 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12579 fp=#0x20000000a18' 2024-08-31T04:31:12.418 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12611 fp=#0x200000009ea' 2024-08-31T04:31:12.419 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12643 fp=#0x20000000a3d' 2024-08-31T04:31:12.419 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12675 fp=#0x20000000a68' 2024-08-31T04:31:12.420 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12739 fp=#0x10000000f2c' 2024-08-31T04:31:12.420 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12771 fp=#0x2000000022f' 2024-08-31T04:31:12.420 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12803 fp=#0x10000000f43' 2024-08-31T04:31:12.421 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12835 fp=#0x10000000e75' 2024-08-31T04:31:12.421 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12867 fp=#0x10000002f46' 2024-08-31T04:31:12.422 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12899 fp=#0x10000002f26' 2024-08-31T04:31:12.422 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12931 fp=#0x200000020e1' 2024-08-31T04:31:12.422 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12963 fp=#0x10000002f10' 2024-08-31T04:31:12.422 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12995 fp=#0x200000020bd' 2024-08-31T04:31:12.423 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13027 fp=#0x10000002f24' 2024-08-31T04:31:12.423 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13058 fp=#0x2000000074f' 2024-08-31T04:31:12.424 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13090 fp=#0x20000000739' 2024-08-31T04:31:12.424 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13122 fp=#0x20000000735' 2024-08-31T04:31:12.424 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13154 fp=#0x2000000074e' 2024-08-31T04:31:12.424 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13186 fp=#0x2000000074c' 2024-08-31T04:31:12.425 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13218 fp=#0x20000000b6a' 2024-08-31T04:31:12.425 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13250 fp=#0x20000000be1' 2024-08-31T04:31:12.426 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13282 fp=#0x20000000b92' 2024-08-31T04:31:12.426 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13314 fp=#0x20000000bef' 2024-08-31T04:31:12.426 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13346 fp=#0x20000000bb8' 2024-08-31T04:31:12.427 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13378 fp=#0x20000001d76' 2024-08-31T04:31:12.427 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13410 fp=#0x20000001c51' 2024-08-31T04:31:12.427 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13442 fp=#0x20000001d34' 2024-08-31T04:31:12.428 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13474 fp=#0x10000003b82' 2024-08-31T04:31:12.428 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13506 fp=#0x10000003b24' 2024-08-31T04:31:12.428 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13565 fp=#0x2000000213a' 2024-08-31T04:31:12.430 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13693 fp=#0x10000002ec3' 2024-08-31T04:31:12.430 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13725 fp=#0x10000002e54' 2024-08-31T04:31:12.430 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13757 fp=#0x10000002e4c' 2024-08-31T04:31:12.431 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13789 fp=#0x20000000829' 2024-08-31T04:31:12.431 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13821 fp=#0x200000015da' 2024-08-31T04:31:12.431 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13853 fp=#0x20000000cfb' 2024-08-31T04:31:12.431 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13885 fp=#0x20000000d1b' 2024-08-31T04:31:12.432 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13917 fp=#0x20000002047' 2024-08-31T04:31:12.432 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13949 fp=#0x20000000cc3' 2024-08-31T04:31:12.432 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13981 fp=#0x20000002230' 2024-08-31T04:31:12.433 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14013 fp=#0x200000019d4' 2024-08-31T04:31:12.433 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14045 fp=#0x200000019f3' 2024-08-31T04:31:12.433 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14077 fp=#0x200000019d3' 2024-08-31T04:31:12.434 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14109 fp=#0x20000001a02' 2024-08-31T04:31:12.434 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14141 fp=#0x2000000094d' 2024-08-31T04:31:12.434 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14173 fp=#0x200000008e6' 2024-08-31T04:31:12.435 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14205 fp=#0x200000008c5' 2024-08-31T04:31:12.435 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14237 fp=#0x200000008a8' 2024-08-31T04:31:12.435 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14301 fp=#0x20000001dd3' 2024-08-31T04:31:12.436 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14333 fp=#0x20000001dfa' 2024-08-31T04:31:12.436 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14397 fp=#0x20000001de4' 2024-08-31T04:31:12.437 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14429 fp=#0x20000001d9b' 2024-08-31T04:31:12.437 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14461 fp=#0x200000018ea' 2024-08-31T04:31:12.437 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14493 fp=#0x2000000192f' 2024-08-31T04:31:12.438 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14525 fp=#0x200000018e5' 2024-08-31T04:31:12.438 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14557 fp=#0x20000000f49' 2024-08-31T04:31:12.438 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14589 fp=#0x20000000fd4' 2024-08-31T04:31:12.439 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14621 fp=#0x20000000f0e' 2024-08-31T04:31:12.439 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14653 fp=#0x20000000f83' 2024-08-31T04:31:12.439 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14685 fp=#0x20000000f4a' 2024-08-31T04:31:12.440 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14717 fp=#0x100000046cc' 2024-08-31T04:31:12.440 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14781 fp=#0x1000000462d' 2024-08-31T04:31:12.441 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14859 fp=#0x1000000314a' 2024-08-31T04:31:12.441 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14891 fp=#0x100000031bb' 2024-08-31T04:31:12.441 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14923 fp=#0x100000031eb' 2024-08-31T04:31:12.442 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14955 fp=#0x1000000589e' 2024-08-31T04:31:12.442 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14987 fp=#0x100000058ab' 2024-08-31T04:31:12.442 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15019 fp=#0x20000001715' 2024-08-31T04:31:12.443 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15051 fp=#0x20000001746' 2024-08-31T04:31:12.443 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15083 fp=#0x200000017ab' 2024-08-31T04:31:12.444 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15115 fp=#0x20000001747' 2024-08-31T04:31:12.444 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15146 fp=#0x100000057bd' 2024-08-31T04:31:12.444 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15178 fp=#0x100000057a3' 2024-08-31T04:31:12.445 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15210 fp=#0x10000001713' 2024-08-31T04:31:12.445 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15242 fp=#0x100000016fd' 2024-08-31T04:31:12.445 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15274 fp=#0x200000021d7' 2024-08-31T04:31:12.446 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15306 fp=#0x200000021bd' 2024-08-31T04:31:12.446 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15338 fp=#0x20000002216' 2024-08-31T04:31:12.446 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15370 fp=#0x20000002074' 2024-08-31T04:31:12.447 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15402 fp=#0x20000002095' 2024-08-31T04:31:12.447 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15434 fp=#0x20000002083' 2024-08-31T04:31:12.448 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15498 fp=#0x10000005319' 2024-08-31T04:31:12.448 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15530 fp=#0x20000001a19' 2024-08-31T04:31:12.448 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15562 fp=#0x20000001a36' 2024-08-31T04:31:12.449 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15594 fp=#0x20000001a0f' 2024-08-31T04:31:12.449 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15626 fp=#0x10000004e3d' 2024-08-31T04:31:12.450 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15658 fp=#0x10000004e72' 2024-08-31T04:31:12.450 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15690 fp=#0x10000004e4f' 2024-08-31T04:31:12.450 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15754 fp=#0x10000001771' 2024-08-31T04:31:12.451 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15786 fp=#0x20000002024' 2024-08-31T04:31:12.451 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15818 fp=#0x20000001fe8' 2024-08-31T04:31:12.453 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16010 fp=#0x200000017c6' 2024-08-31T04:31:12.453 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16042 fp=#0x200000017d8' 2024-08-31T04:31:12.453 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16074 fp=#0x20000000eae' 2024-08-31T04:31:12.454 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16106 fp=#0x20000001154' 2024-08-31T04:31:12.454 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16138 fp=#0x2000000111f' 2024-08-31T04:31:12.454 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16170 fp=#0x2000000112b' 2024-08-31T04:31:12.455 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16202 fp=#0x200000015db' 2024-08-31T04:31:12.455 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16234 fp=#0x200000015ec' 2024-08-31T04:31:12.455 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16266 fp=#0x200000015a7' 2024-08-31T04:31:12.455 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16297 fp=#0x100000048a1' 2024-08-31T04:31:12.456 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16329 fp=#0x10000004837' 2024-08-31T04:31:12.456 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16361 fp=#0x10000004891' 2024-08-31T04:31:12.456 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16393 fp=#0x10000004803' 2024-08-31T04:31:12.457 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16425 fp=#0x10000004804' 2024-08-31T04:31:12.457 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16457 fp=#0x10000004834' 2024-08-31T04:31:12.457 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16489 fp=#0x20000001e1b' 2024-08-31T04:31:12.458 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16521 fp=#0x200000011b8' 2024-08-31T04:31:12.458 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16553 fp=#0x10000004e17' 2024-08-31T04:31:12.458 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16585 fp=#0x10000004f09' 2024-08-31T04:31:12.459 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16617 fp=#0x20000002287' 2024-08-31T04:31:12.459 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16649 fp=#0x200000022bc' 2024-08-31T04:31:12.459 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16681 fp=#0x10000002af0' 2024-08-31T04:31:12.460 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16713 fp=#0x20000000438' 2024-08-31T04:31:12.460 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16745 fp=#0x10000002a6f' 2024-08-31T04:31:12.460 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16777 fp=#0x10000002a7f' 2024-08-31T04:31:12.461 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16809 fp=#0x20000000402' 2024-08-31T04:31:12.461 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16841 fp=#0x2000000044d' 2024-08-31T04:31:12.461 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16873 fp=#0x10000005d48' 2024-08-31T04:31:12.462 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16905 fp=#0x10000004537' 2024-08-31T04:31:12.462 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16969 fp=#0x10000004595' 2024-08-31T04:31:12.464 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17161 fp=#0x1000000572e' 2024-08-31T04:31:12.464 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17193 fp=#0x10000005727' 2024-08-31T04:31:12.465 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17257 fp=#0x1000000546c' 2024-08-31T04:31:12.465 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17321 fp=#0x10000005463' 2024-08-31T04:31:12.466 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17353 fp=#0x20000001a91' 2024-08-31T04:31:12.466 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17385 fp=#0x20000001a90' 2024-08-31T04:31:12.466 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17417 fp=#0x20000001a96' 2024-08-31T04:31:12.467 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17449 fp=#0x10000004d6a' 2024-08-31T04:31:12.467 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17481 fp=#0x10000004d98' 2024-08-31T04:31:12.467 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17513 fp=#0x10000004d60' 2024-08-31T04:31:12.468 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17545 fp=#0x20000001b56' 2024-08-31T04:31:12.468 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17577 fp=#0x20000001b17' 2024-08-31T04:31:12.468 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17609 fp=#0x10000002a3a' 2024-08-31T04:31:12.469 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17641 fp=#0x10000002a0f' 2024-08-31T04:31:12.469 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17673 fp=#0x2000000049e' 2024-08-31T04:31:12.469 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17705 fp=#0x100000029e7' 2024-08-31T04:31:12.470 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17737 fp=#0x10000002a0a' 2024-08-31T04:31:12.470 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17769 fp=#0x10000004f4c' 2024-08-31T04:31:12.470 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17801 fp=#0x10000004f4f' 2024-08-31T04:31:12.471 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17833 fp=#0x10000004edf' 2024-08-31T04:31:12.471 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17865 fp=#0x10000000897' 2024-08-31T04:31:12.471 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17897 fp=#0x10000001144' 2024-08-31T04:31:12.472 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17929 fp=#0x1000000088c' 2024-08-31T04:31:12.472 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17961 fp=#0x20000001c5c' 2024-08-31T04:31:12.472 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17993 fp=#0x20000001c04' 2024-08-31T04:31:12.473 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18025 fp=#0x20000001cdd' 2024-08-31T04:31:12.473 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18057 fp=#0x20000001c2a' 2024-08-31T04:31:12.473 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18089 fp=#0x20000001736' 2024-08-31T04:31:12.474 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18121 fp=#0x2000000176e' 2024-08-31T04:31:12.474 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18153 fp=#0x20000001d83' 2024-08-31T04:31:12.475 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18185 fp=#0x20000000c6e' 2024-08-31T04:31:12.475 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18217 fp=#0x20000000c66' 2024-08-31T04:31:12.475 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18249 fp=#0x20000000c51' 2024-08-31T04:31:12.476 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18278 fp=#0x10000004a29' 2024-08-31T04:31:12.476 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18310 fp=#0x200000022f8' 2024-08-31T04:31:12.476 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18342 fp=#0x100000049fa' 2024-08-31T04:31:12.477 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18374 fp=#0x10000004967' 2024-08-31T04:31:12.477 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18401 fp=#0x200000021ae' 2024-08-31T04:31:12.477 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18433 fp=#0x20000002167' 2024-08-31T04:31:12.478 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18465 fp=#0x2000000218b' 2024-08-31T04:31:12.478 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18497 fp=#0x200000021da' 2024-08-31T04:31:12.478 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18527 fp=#0x40000000e2f' 2024-08-31T04:31:12.479 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18559 fp=#0x1000000363d' 2024-08-31T04:31:12.479 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:7186 fp=#0x200000012d6' 2024-08-31T04:31:12.479 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:7218 fp=#0x20000000ca5' 2024-08-31T04:31:12.480 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:7282 fp=#0x2000000227f' 2024-08-31T04:31:12.481 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:7410 fp=#0x2000000200a' 2024-08-31T04:31:12.482 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:7442 fp=#0x20000001fdf' 2024-08-31T04:31:12.492 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:8722 fp=#0x20000000ada' 2024-08-31T04:31:12.493 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:8873 fp=#0x20000000642' 2024-08-31T04:31:12.493 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:8905 fp=#0x20000000634' 2024-08-31T04:31:12.494 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:8969 fp=#0x20000000691' 2024-08-31T04:31:12.494 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9001 fp=#0x200000018a7' 2024-08-31T04:31:12.495 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9097 fp=#0x20000000fbf' 2024-08-31T04:31:12.496 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9129 fp=#0x20000001cf0' 2024-08-31T04:31:12.496 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9161 fp=#0x20000000873' 2024-08-31T04:31:12.496 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9193 fp=#0x20000001d54' 2024-08-31T04:31:12.497 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9225 fp=#0x20000001c9f' 2024-08-31T04:31:12.497 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9257 fp=#0x20000001cfc' 2024-08-31T04:31:12.498 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9385 fp=#0x2000000095d' 2024-08-31T04:31:12.499 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9417 fp=#0x200000009b0' 2024-08-31T04:31:12.499 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9449 fp=#0x200000009a1' 2024-08-31T04:31:12.499 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9481 fp=#0x20000001559' 2024-08-31T04:31:12.500 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9513 fp=#0x200000009a3' 2024-08-31T04:31:12.500 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9545 fp=#0x200000009af' 2024-08-31T04:31:12.500 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9577 fp=#0x2000000186d' 2024-08-31T04:31:12.501 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9705 fp=#0x20000000b40' 2024-08-31T04:31:12.502 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9737 fp=#0x20000001f6d' 2024-08-31T04:31:12.502 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9769 fp=#0x20000000b52' 2024-08-31T04:31:12.503 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9801 fp=#0x20000000b2d' 2024-08-31T04:31:12.503 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9833 fp=#0x20000001e29' 2024-08-31T04:31:12.503 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9865 fp=#0x20000001e64' 2024-08-31T04:31:12.504 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9897 fp=#0x20000001ea4' 2024-08-31T04:31:12.505 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10056 fp=#0x20000000d63' 2024-08-31T04:31:12.505 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10088 fp=#0x20000000e1d' 2024-08-31T04:31:12.506 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10120 fp=#0x20000000db7' 2024-08-31T04:31:12.506 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10152 fp=#0x20000000d84' 2024-08-31T04:31:12.506 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10184 fp=#0x20000000dda' 2024-08-31T04:31:12.507 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10216 fp=#0x20000001051' 2024-08-31T04:31:12.507 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10248 fp=#0x20000001061' 2024-08-31T04:31:12.508 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10280 fp=#0x200000006f5' 2024-08-31T04:31:12.508 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10312 fp=#0x20000001016' 2024-08-31T04:31:12.508 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10344 fp=#0x2000000091c' 2024-08-31T04:31:12.508 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10376 fp=#0x2000000149f' 2024-08-31T04:31:12.509 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10408 fp=#0x2000000150b' 2024-08-31T04:31:12.510 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10504 fp=#0x10000000c33' 2024-08-31T04:31:12.510 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10536 fp=#0x10000003c8d' 2024-08-31T04:31:12.510 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10568 fp=#0x100000010e9' 2024-08-31T04:31:12.511 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10600 fp=#0x10000000c01' 2024-08-31T04:31:12.511 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10632 fp=#0x200000020a7' 2024-08-31T04:31:12.511 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10664 fp=#0x20000002127' 2024-08-31T04:31:12.512 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10696 fp=#0x200000020e0' 2024-08-31T04:31:12.512 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10728 fp=#0x10000002871' 2024-08-31T04:31:12.513 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10824 fp=#0x100000033f0' 2024-08-31T04:31:12.513 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10856 fp=#0x20000000601' 2024-08-31T04:31:12.514 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10888 fp=#0x10000003430' 2024-08-31T04:31:12.514 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10920 fp=#0x10000003473' 2024-08-31T04:31:12.514 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10952 fp=#0x200000005f0' 2024-08-31T04:31:12.515 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10984 fp=#0x10000003403' 2024-08-31T04:31:12.515 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11016 fp=#0x10000003cdc' 2024-08-31T04:31:12.515 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11048 fp=#0x10000003d2c' 2024-08-31T04:31:12.516 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11080 fp=#0x100000039aa' 2024-08-31T04:31:12.516 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11112 fp=#0x100000039a9' 2024-08-31T04:31:12.516 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11144 fp=#0x10000003cc4' 2024-08-31T04:31:12.517 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11176 fp=#0x10000003c0b' 2024-08-31T04:31:12.517 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11208 fp=#0x10000003c03' 2024-08-31T04:31:12.517 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11236 fp=#0x20000000e94' 2024-08-31T04:31:12.518 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11268 fp=#0x20000000e49' 2024-08-31T04:31:12.518 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11300 fp=#0x20000000e73' 2024-08-31T04:31:12.519 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11332 fp=#0x20000001df3' 2024-08-31T04:31:12.519 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11364 fp=#0x200000018e9' 2024-08-31T04:31:12.519 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11396 fp=#0x20000001973' 2024-08-31T04:31:12.520 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11428 fp=#0x20000001eea' 2024-08-31T04:31:12.520 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11460 fp=#0x20000001963' 2024-08-31T04:31:12.520 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11492 fp=#0x20000001e13' 2024-08-31T04:31:12.521 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11524 fp=#0x20000001e6e' 2024-08-31T04:31:12.521 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11556 fp=#0x10000004615' 2024-08-31T04:31:12.521 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11588 fp=#0x1000000463b' 2024-08-31T04:31:12.522 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11620 fp=#0x100000045ab' 2024-08-31T04:31:12.522 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11684 fp=#0x200000006b2' 2024-08-31T04:31:12.523 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11748 fp=#0x2000000214b' 2024-08-31T04:31:12.523 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11780 fp=#0x20000000676' 2024-08-31T04:31:12.524 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11812 fp=#0x200000006c3' 2024-08-31T04:31:12.524 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11844 fp=#0x200000006a8' 2024-08-31T04:31:12.524 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11876 fp=#0x2000000164d' 2024-08-31T04:31:12.525 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11908 fp=#0x20000000aaa' 2024-08-31T04:31:12.525 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11940 fp=#0x20000001619' 2024-08-31T04:31:12.525 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11972 fp=#0x2000000162a' 2024-08-31T04:31:12.526 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12004 fp=#0x200000016a8' 2024-08-31T04:31:12.526 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12036 fp=#0x2000000169f' 2024-08-31T04:31:12.526 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12068 fp=#0x20000001731' 2024-08-31T04:31:12.527 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12100 fp=#0x20000001692' 2024-08-31T04:31:12.527 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12132 fp=#0x2000000151d' 2024-08-31T04:31:12.531 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12228 fp=#0x20000001fc4' 2024-08-31T04:31:12.532 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12356 fp=#0x200000010df' 2024-08-31T04:31:12.532 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12388 fp=#0x200000010e1' 2024-08-31T04:31:12.533 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12420 fp=#0x20000001063' 2024-08-31T04:31:12.533 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12452 fp=#0x20000001f2d' 2024-08-31T04:31:12.533 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12484 fp=#0x20000001ef1' 2024-08-31T04:31:12.534 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12516 fp=#0x20000001ee1' 2024-08-31T04:31:12.534 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12548 fp=#0x20000000acd' 2024-08-31T04:31:12.534 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12580 fp=#0x20000000a23' 2024-08-31T04:31:12.535 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12612 fp=#0x20000000a1b' 2024-08-31T04:31:12.535 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12644 fp=#0x20000000a12' 2024-08-31T04:31:12.535 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12676 fp=#0x200000009eb' 2024-08-31T04:31:12.536 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12708 fp=#0x200000003dd' 2024-08-31T04:31:12.536 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12740 fp=#0x20000000209' 2024-08-31T04:31:12.536 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12772 fp=#0x200000003e9' 2024-08-31T04:31:12.537 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12804 fp=#0x20000000224' 2024-08-31T04:31:12.537 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12836 fp=#0x10000000f34' 2024-08-31T04:31:12.537 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12868 fp=#0x2000000215a' 2024-08-31T04:31:12.538 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12900 fp=#0x200000020d8' 2024-08-31T04:31:12.538 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12932 fp=#0x2000000215e' 2024-08-31T04:31:12.538 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12964 fp=#0x200000020e8' 2024-08-31T04:31:12.539 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12996 fp=#0x10000002f1b' 2024-08-31T04:31:12.539 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13028 fp=#0x200000020fb' 2024-08-31T04:31:12.539 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13059 fp=#0x2000000075c' 2024-08-31T04:31:12.540 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13091 fp=#0x2000000074b' 2024-08-31T04:31:12.540 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13123 fp=#0x20000000706' 2024-08-31T04:31:12.540 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13155 fp=#0x200000007a8' 2024-08-31T04:31:12.541 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13187 fp=#0x2000000077f' 2024-08-31T04:31:12.541 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13219 fp=#0x20000000bbe' 2024-08-31T04:31:12.541 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13251 fp=#0x20000000b77' 2024-08-31T04:31:12.542 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13283 fp=#0x20000000b75' 2024-08-31T04:31:12.542 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13315 fp=#0x20000000bcf' 2024-08-31T04:31:12.542 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13347 fp=#0x20000000ba1' 2024-08-31T04:31:12.543 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13379 fp=#0x20000001d90' 2024-08-31T04:31:12.543 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13411 fp=#0x20000001c7c' 2024-08-31T04:31:12.543 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13443 fp=#0x20000001cea' 2024-08-31T04:31:12.544 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13475 fp=#0x10000003b11' 2024-08-31T04:31:12.544 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13507 fp=#0x10000003b15' 2024-08-31T04:31:12.544 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13566 fp=#0x20000001177' 2024-08-31T04:31:12.545 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13598 fp=#0x2000000117a' 2024-08-31T04:31:12.546 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13694 fp=#0x10000002e19' 2024-08-31T04:31:12.546 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13726 fp=#0x10000002e3b' 2024-08-31T04:31:12.546 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13758 fp=#0x10000002e47' 2024-08-31T04:31:12.547 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13790 fp=#0x2000000083b' 2024-08-31T04:31:12.547 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13822 fp=#0x20000000843' 2024-08-31T04:31:12.547 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13854 fp=#0x2000000225d' 2024-08-31T04:31:12.548 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13886 fp=#0x20000000d8c' 2024-08-31T04:31:12.548 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13918 fp=#0x20000000dc3' 2024-08-31T04:31:12.548 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13950 fp=#0x20000000d91' 2024-08-31T04:31:12.549 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13982 fp=#0x20000002220' 2024-08-31T04:31:12.549 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14014 fp=#0x200000019bc' 2024-08-31T04:31:12.549 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14046 fp=#0x200000019e3' 2024-08-31T04:31:12.550 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14078 fp=#0x200000019d2' 2024-08-31T04:31:12.550 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14110 fp=#0x20000001a15' 2024-08-31T04:31:12.550 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14142 fp=#0x200000008a3' 2024-08-31T04:31:12.551 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14174 fp=#0x200000008c1' 2024-08-31T04:31:12.551 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14206 fp=#0x200000008c4' 2024-08-31T04:31:12.551 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14238 fp=#0x200000008ce' 2024-08-31T04:31:12.552 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14302 fp=#0x20000001dd4' 2024-08-31T04:31:12.552 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14334 fp=#0x20000001db6' 2024-08-31T04:31:12.553 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14398 fp=#0x20000001ddb' 2024-08-31T04:31:12.553 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14462 fp=#0x20000001892' 2024-08-31T04:31:12.554 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14494 fp=#0x2000000189a' 2024-08-31T04:31:12.554 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14526 fp=#0x200000018d3' 2024-08-31T04:31:12.554 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14558 fp=#0x20000001026' 2024-08-31T04:31:12.555 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14590 fp=#0x20000000f81' 2024-08-31T04:31:12.555 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14622 fp=#0x20000000f23' 2024-08-31T04:31:12.555 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14654 fp=#0x20000000f2e' 2024-08-31T04:31:12.556 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14686 fp=#0x20000001006' 2024-08-31T04:31:12.556 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14718 fp=#0x100000046ea' 2024-08-31T04:31:12.556 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14750 fp=#0x1000000462f' 2024-08-31T04:31:12.556 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14782 fp=#0x20000000bfe' 2024-08-31T04:31:12.557 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14814 fp=#0x10000004640' 2024-08-31T04:31:12.557 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14860 fp=#0x10000003119' 2024-08-31T04:31:12.558 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14892 fp=#0x10000003137' 2024-08-31T04:31:12.558 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14924 fp=#0x10000003143' 2024-08-31T04:31:12.558 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14956 fp=#0x200000016b6' 2024-08-31T04:31:12.559 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14988 fp=#0x100000058bb' 2024-08-31T04:31:12.559 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15020 fp=#0x2000000176d' 2024-08-31T04:31:12.559 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15052 fp=#0x20000001755' 2024-08-31T04:31:12.560 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15084 fp=#0x2000000173d' 2024-08-31T04:31:12.560 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15116 fp=#0x200000017c1' 2024-08-31T04:31:12.560 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15147 fp=#0x100000057c6' 2024-08-31T04:31:12.561 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15179 fp=#0x100000057b3' 2024-08-31T04:31:12.561 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15211 fp=#0x1000000174f' 2024-08-31T04:31:12.561 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15243 fp=#0x10000001704' 2024-08-31T04:31:12.562 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15275 fp=#0x200000021db' 2024-08-31T04:31:12.562 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15307 fp=#0x200000021c3' 2024-08-31T04:31:12.562 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15339 fp=#0x20000002260' 2024-08-31T04:31:12.563 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15403 fp=#0x20000001cb0' 2024-08-31T04:31:12.564 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15499 fp=#0x1000000534c' 2024-08-31T04:31:12.564 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15531 fp=#0x20000001a3f' 2024-08-31T04:31:12.564 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15563 fp=#0x2000000100f' 2024-08-31T04:31:12.565 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15595 fp=#0x10000005320' 2024-08-31T04:31:12.565 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15627 fp=#0x10000004eca' 2024-08-31T04:31:12.565 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15659 fp=#0x10000004e7a' 2024-08-31T04:31:12.566 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15691 fp=#0x10000004e04' 2024-08-31T04:31:12.566 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15723 fp=#0x10000004e22' 2024-08-31T04:31:12.567 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15819 fp=#0x20000001fea' 2024-08-31T04:31:12.568 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15947 fp=#0x20000001ff5' 2024-08-31T04:31:12.569 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16011 fp=#0x200000018f9' 2024-08-31T04:31:12.569 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16043 fp=#0x2000000193d' 2024-08-31T04:31:12.569 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16075 fp=#0x20000001904' 2024-08-31T04:31:12.570 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16107 fp=#0x20000001122' 2024-08-31T04:31:12.570 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16139 fp=#0x20000001180' 2024-08-31T04:31:12.570 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16171 fp=#0x20000001593' 2024-08-31T04:31:12.571 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16203 fp=#0x200000015e7' 2024-08-31T04:31:12.571 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16235 fp=#0x200000015bb' 2024-08-31T04:31:12.571 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16267 fp=#0x200000015aa' 2024-08-31T04:31:12.572 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16298 fp=#0x10000004898' 2024-08-31T04:31:12.572 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16330 fp=#0x10000004514' 2024-08-31T04:31:12.572 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16362 fp=#0x10000004807' 2024-08-31T04:31:12.573 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16394 fp=#0x1000000451c' 2024-08-31T04:31:12.573 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16426 fp=#0x1000000483f' 2024-08-31T04:31:12.573 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16458 fp=#0x100000047fa' 2024-08-31T04:31:12.574 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16490 fp=#0x20000001188' 2024-08-31T04:31:12.575 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16618 fp=#0x200000022c6' 2024-08-31T04:31:12.575 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16650 fp=#0x20000002294' 2024-08-31T04:31:12.575 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16682 fp=#0x10000002a64' 2024-08-31T04:31:12.576 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16714 fp=#0x10000002ada' 2024-08-31T04:31:12.576 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16746 fp=#0x10000002b02' 2024-08-31T04:31:12.576 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16778 fp=#0x2000000042a' 2024-08-31T04:31:12.577 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16810 fp=#0x2000000044f' 2024-08-31T04:31:12.577 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16842 fp=#0x2000000043e' 2024-08-31T04:31:12.578 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16874 fp=#0x100000045a9' 2024-08-31T04:31:12.578 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16906 fp=#0x10000004565' 2024-08-31T04:31:12.578 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16938 fp=#0x10000004764' 2024-08-31T04:31:12.579 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16970 fp=#0x1000000453f' 2024-08-31T04:31:12.580 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17098 fp=#0x10000005790' 2024-08-31T04:31:12.580 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17162 fp=#0x10000005724' 2024-08-31T04:31:12.581 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17194 fp=#0x1000000572d' 2024-08-31T04:31:12.581 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17226 fp=#0x100000054cc' 2024-08-31T04:31:12.582 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17322 fp=#0x100000054cb' 2024-08-31T04:31:12.582 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17354 fp=#0x20000001ac9' 2024-08-31T04:31:12.582 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17386 fp=#0x20000001a8b' 2024-08-31T04:31:12.583 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17418 fp=#0x20000001a86' 2024-08-31T04:31:12.583 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17450 fp=#0x10000004dce' 2024-08-31T04:31:12.583 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17482 fp=#0x10000004e2d' 2024-08-31T04:31:12.584 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17514 fp=#0x10000004db9' 2024-08-31T04:31:12.584 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17546 fp=#0x20000001b20' 2024-08-31T04:31:12.584 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17578 fp=#0x20000001b6e' 2024-08-31T04:31:12.585 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17610 fp=#0x100000029e3' 2024-08-31T04:31:12.585 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17642 fp=#0x10000002a00' 2024-08-31T04:31:12.585 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17674 fp=#0x20000001f5f' 2024-08-31T04:31:12.586 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17706 fp=#0x100000029d3' 2024-08-31T04:31:12.586 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17738 fp=#0x20000001f47' 2024-08-31T04:31:12.586 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17770 fp=#0x10000004ed9' 2024-08-31T04:31:12.587 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17802 fp=#0x10000004f0c' 2024-08-31T04:31:12.587 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17834 fp=#0x10000004f37' 2024-08-31T04:31:12.587 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17866 fp=#0x1000000110c' 2024-08-31T04:31:12.588 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17898 fp=#0x10000001113' 2024-08-31T04:31:12.588 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17962 fp=#0x20000001cfe' 2024-08-31T04:31:12.588 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17994 fp=#0x20000001cd0' 2024-08-31T04:31:12.589 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18026 fp=#0x20000001c67' 2024-08-31T04:31:12.589 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18058 fp=#0x20000001c6d' 2024-08-31T04:31:12.589 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18090 fp=#0x20000001778' 2024-08-31T04:31:12.590 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18122 fp=#0x2000000171d' 2024-08-31T04:31:12.590 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18154 fp=#0x2000000177a' 2024-08-31T04:31:12.590 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18186 fp=#0x20000000c1c' 2024-08-31T04:31:12.591 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18218 fp=#0x20000000c29' 2024-08-31T04:31:12.591 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18250 fp=#0x20000000c57' 2024-08-31T04:31:12.591 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18279 fp=#0x20000000856' 2024-08-31T04:31:12.592 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18311 fp=#0x1000000493a' 2024-08-31T04:31:12.592 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18343 fp=#0x10000004937' 2024-08-31T04:31:12.593 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18402 fp=#0x2000000224a' 2024-08-31T04:31:12.593 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18434 fp=#0x20000002193' 2024-08-31T04:31:12.593 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18466 fp=#0x200000021cd' 2024-08-31T04:31:12.594 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18498 fp=#0x20000002186' 2024-08-31T04:31:12.594 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18528 fp=#0x40000000614' 2024-08-31T04:31:12.594 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18560 fp=#0x10000003681' 2024-08-31T04:31:12.595 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:7187 fp=#0x20000000d2e' 2024-08-31T04:31:12.595 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:7219 fp=#0x200000019bb' 2024-08-31T04:31:12.596 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:7283 fp=#0x10000002a5e' 2024-08-31T04:31:12.597 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:7475 fp=#0x20000001ff3' 2024-08-31T04:31:12.606 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:8627 fp=#0x20000000ad0' 2024-08-31T04:31:12.607 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:8659 fp=#0x20000000ad7' 2024-08-31T04:31:12.608 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'client_request(client.15282:310818 create owner_uid=1000, owner_gid=1333 #0x200000022cc/article-27.xml.tmp 2024-08-31T04:29:46.362966+0000 caller_uid=1000, caller_gid=1333{6,36,1000,1333,})' 2024-08-31T04:31:12.609 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:8874 fp=#0x20000000659' 2024-08-31T04:31:12.609 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:8970 fp=#0x2000000066b' 2024-08-31T04:31:12.610 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9002 fp=#0x20000001851' 2024-08-31T04:31:12.610 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9034 fp=#0x20000000fbe' 2024-08-31T04:31:12.610 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9066 fp=#0x20000000f52' 2024-08-31T04:31:12.611 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9098 fp=#0x20000000f51' 2024-08-31T04:31:12.611 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9130 fp=#0x20000001d3a' 2024-08-31T04:31:12.611 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9162 fp=#0x20000000877' 2024-08-31T04:31:12.612 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9194 fp=#0x20000001cec' 2024-08-31T04:31:12.612 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9226 fp=#0x20000001d24' 2024-08-31T04:31:12.613 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9290 fp=#0x20000001ade' 2024-08-31T04:31:12.614 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9386 fp=#0x20000000b58' 2024-08-31T04:31:12.614 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9418 fp=#0x200000009c4' 2024-08-31T04:31:12.614 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9450 fp=#0x20000001580' 2024-08-31T04:31:12.615 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9482 fp=#0x20000001588' 2024-08-31T04:31:12.615 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9514 fp=#0x20000000999' 2024-08-31T04:31:12.615 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9546 fp=#0x20000000963' 2024-08-31T04:31:12.616 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9610 fp=#0x2000000185d' 2024-08-31T04:31:12.617 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9706 fp=#0x20000000b28' 2024-08-31T04:31:12.617 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9738 fp=#0x20000000af8' 2024-08-31T04:31:12.618 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9770 fp=#0x20000000b29' 2024-08-31T04:31:12.618 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9802 fp=#0x20000000b13' 2024-08-31T04:31:12.618 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9834 fp=#0x20000001f22' 2024-08-31T04:31:12.619 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9866 fp=#0x20000001e2b' 2024-08-31T04:31:12.619 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9898 fp=#0x20000001e0e' 2024-08-31T04:31:12.620 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10057 fp=#0x20000000d59' 2024-08-31T04:31:12.621 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10089 fp=#0x20000000d75' 2024-08-31T04:31:12.621 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10121 fp=#0x20000000d70' 2024-08-31T04:31:12.621 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10153 fp=#0x20000000ddf' 2024-08-31T04:31:12.622 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10185 fp=#0x20000000e17' 2024-08-31T04:31:12.622 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10217 fp=#0x2000000104f' 2024-08-31T04:31:12.622 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10249 fp=#0x20000001021' 2024-08-31T04:31:12.623 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10281 fp=#0x20000001014' 2024-08-31T04:31:12.623 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10313 fp=#0x20000001023' 2024-08-31T04:31:12.623 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10345 fp=#0x200000014c9' 2024-08-31T04:31:12.624 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10377 fp=#0x2000000091a' 2024-08-31T04:31:12.624 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10441 fp=#0x200000014d7' 2024-08-31T04:31:12.625 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10473 fp=#0x10000000c0a' 2024-08-31T04:31:12.625 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10505 fp=#0x100000010f0' 2024-08-31T04:31:12.625 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10537 fp=#0x10000000bf0' 2024-08-31T04:31:12.626 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10569 fp=#0x10000000c47' 2024-08-31T04:31:12.626 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10601 fp=#0x10000000c14' 2024-08-31T04:31:12.626 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10633 fp=#0x200000020ce' 2024-08-31T04:31:12.627 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10665 fp=#0x200000020f4' 2024-08-31T04:31:12.627 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10697 fp=#0x2000000208f' 2024-08-31T04:31:12.628 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10793 fp=#0x200000010b1' 2024-08-31T04:31:12.629 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10825 fp=#0x100000033ec' 2024-08-31T04:31:12.629 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10857 fp=#0x20000000600' 2024-08-31T04:31:12.629 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10889 fp=#0x200000005e4' 2024-08-31T04:31:12.630 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10921 fp=#0x1000000340d' 2024-08-31T04:31:12.630 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10953 fp=#0x200000005f7' 2024-08-31T04:31:12.630 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10985 fp=#0x1000000340a' 2024-08-31T04:31:12.631 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11017 fp=#0x10000003bec' 2024-08-31T04:31:12.631 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11049 fp=#0x10000003b8d' 2024-08-31T04:31:12.632 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11113 fp=#0x10000003d50' 2024-08-31T04:31:12.632 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11145 fp=#0x100000039be' 2024-08-31T04:31:12.632 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11177 fp=#0x10000003b80' 2024-08-31T04:31:12.633 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11209 fp=#0x10000003d39' 2024-08-31T04:31:12.633 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11237 fp=#0x20000000e9d' 2024-08-31T04:31:12.633 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11269 fp=#0x20000000e48' 2024-08-31T04:31:12.634 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11301 fp=#0x20000000e6f' 2024-08-31T04:31:12.634 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11333 fp=#0x200000018a6' 2024-08-31T04:31:12.634 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11365 fp=#0x20000001e2a' 2024-08-31T04:31:12.635 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11397 fp=#0x2000000197b' 2024-08-31T04:31:12.635 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11429 fp=#0x200000019b8' 2024-08-31T04:31:12.635 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11461 fp=#0x20000001e24' 2024-08-31T04:31:12.636 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11493 fp=#0x20000001eaf' 2024-08-31T04:31:12.636 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11525 fp=#0x10000004650' 2024-08-31T04:31:12.636 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11557 fp=#0x10000004637' 2024-08-31T04:31:12.637 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11589 fp=#0x100000045e3' 2024-08-31T04:31:12.637 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11621 fp=#0x100000045b1' 2024-08-31T04:31:12.638 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11653 fp=#0x200000006d0' 2024-08-31T04:31:12.638 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11685 fp=#0x20000000ae2' 2024-08-31T04:31:12.638 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11717 fp=#0x200000006ba' 2024-08-31T04:31:12.639 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11781 fp=#0x2000000069f' 2024-08-31T04:31:12.639 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11845 fp=#0x20000000667' 2024-08-31T04:31:12.640 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11877 fp=#0x20000000ab0' 2024-08-31T04:31:12.640 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11909 fp=#0x20000000a97' 2024-08-31T04:31:12.640 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11941 fp=#0x20000000a82' 2024-08-31T04:31:12.641 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11973 fp=#0x2000000161f' 2024-08-31T04:31:12.641 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12005 fp=#0x200000016a4' 2024-08-31T04:31:12.641 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12037 fp=#0x200000016d1' 2024-08-31T04:31:12.642 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12069 fp=#0x200000016cd' 2024-08-31T04:31:12.642 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12133 fp=#0x200000014d6' 2024-08-31T04:31:12.644 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12293 fp=#0x20000001fda' 2024-08-31T04:31:12.645 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12357 fp=#0x200000010dd' 2024-08-31T04:31:12.645 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12389 fp=#0x2000000109f' 2024-08-31T04:31:12.645 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12421 fp=#0x200000010da' 2024-08-31T04:31:12.646 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12453 fp=#0x20000001f21' 2024-08-31T04:31:12.646 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12485 fp=#0x20000001f3b' 2024-08-31T04:31:12.646 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12517 fp=#0x20000001e98' 2024-08-31T04:31:12.646 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12549 fp=#0x20000000a2f' 2024-08-31T04:31:12.647 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12581 fp=#0x20000000a1a' 2024-08-31T04:31:12.647 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12613 fp=#0x200000009fc' 2024-08-31T04:31:12.647 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12645 fp=#0x200000009f0' 2024-08-31T04:31:12.648 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12677 fp=#0x200000009d6' 2024-08-31T04:31:12.648 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12709 fp=#0x10000000f4a' 2024-08-31T04:31:12.648 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12741 fp=#0x200000001f9' 2024-08-31T04:31:12.649 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12773 fp=#0x10000000fa0' 2024-08-31T04:31:12.649 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12805 fp=#0x10000000e11' 2024-08-31T04:31:12.649 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12837 fp=#0x10000000f8f' 2024-08-31T04:31:12.650 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12869 fp=#0x2000000214d' 2024-08-31T04:31:12.650 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12901 fp=#0x10000002f48' 2024-08-31T04:31:12.650 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12933 fp=#0x20000002156' 2024-08-31T04:31:12.650 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12965 fp=#0x10000002f34' 2024-08-31T04:31:12.651 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12997 fp=#0x10000002f0c' 2024-08-31T04:31:12.651 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13060 fp=#0x2000000072b' 2024-08-31T04:31:12.651 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13092 fp=#0x20000000725' 2024-08-31T04:31:12.652 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13124 fp=#0x20000000709' 2024-08-31T04:31:12.652 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13156 fp=#0x20000000787' 2024-08-31T04:31:12.652 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13188 fp=#0x20000000757' 2024-08-31T04:31:12.653 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13220 fp=#0x20000000bf4' 2024-08-31T04:31:12.653 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13252 fp=#0x20000000b9c' 2024-08-31T04:31:12.653 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13284 fp=#0x20000000b98' 2024-08-31T04:31:12.654 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13316 fp=#0x20000000b67' 2024-08-31T04:31:12.654 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13348 fp=#0x20000000beb' 2024-08-31T04:31:12.654 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13380 fp=#0x20000001d22' 2024-08-31T04:31:12.655 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13412 fp=#0x20000001c8b' 2024-08-31T04:31:12.655 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13444 fp=#0x20000001cc0' 2024-08-31T04:31:12.655 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13476 fp=#0x10000003b6d' 2024-08-31T04:31:12.656 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13508 fp=#0x10000003b33' 2024-08-31T04:31:12.656 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13535 fp=#0x2000000211d' 2024-08-31T04:31:12.656 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13567 fp=#0x20000001186' 2024-08-31T04:31:12.657 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13599 fp=#0x20000001148' 2024-08-31T04:31:12.657 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13663 fp=#0x10000002e34' 2024-08-31T04:31:12.658 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13759 fp=#0x10000002eb2' 2024-08-31T04:31:12.658 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13791 fp=#0x20000000837' 2024-08-31T04:31:12.659 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13823 fp=#0x200000015e5' 2024-08-31T04:31:12.659 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13855 fp=#0x20000000d99' 2024-08-31T04:31:12.659 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13887 fp=#0x20000000d60' 2024-08-31T04:31:12.660 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13919 fp=#0x2000000221d' 2024-08-31T04:31:12.660 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13951 fp=#0x20000000d0b' 2024-08-31T04:31:12.660 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13983 fp=#0x20000000cd5' 2024-08-31T04:31:12.661 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14015 fp=#0x20000001a58' 2024-08-31T04:31:12.661 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14047 fp=#0x20000001a01' 2024-08-31T04:31:12.661 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14079 fp=#0x20000001a49' 2024-08-31T04:31:12.662 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14111 fp=#0x20000001a34' 2024-08-31T04:31:12.662 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14143 fp=#0x2000000094c' 2024-08-31T04:31:12.662 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14175 fp=#0x200000008ed' 2024-08-31T04:31:12.663 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14207 fp=#0x200000008ac' 2024-08-31T04:31:12.663 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14239 fp=#0x2000000092c' 2024-08-31T04:31:12.664 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14335 fp=#0x20000001dce' 2024-08-31T04:31:12.664 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14367 fp=#0x20000001dc4' 2024-08-31T04:31:12.665 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14399 fp=#0x20000001da9' 2024-08-31T04:31:12.665 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14463 fp=#0x200000018da' 2024-08-31T04:31:12.665 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14495 fp=#0x20000001846' 2024-08-31T04:31:12.666 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14527 fp=#0x20000001a6f' 2024-08-31T04:31:12.666 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14559 fp=#0x20000000f0a' 2024-08-31T04:31:12.667 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14591 fp=#0x20000000fdc' 2024-08-31T04:31:12.667 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14623 fp=#0x20000000f28' 2024-08-31T04:31:12.667 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14655 fp=#0x20000001df8' 2024-08-31T04:31:12.668 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14687 fp=#0x20000000f04' 2024-08-31T04:31:12.668 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14751 fp=#0x20000000ae7' 2024-08-31T04:31:12.669 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14783 fp=#0x100000046c4' 2024-08-31T04:31:12.669 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14861 fp=#0x1000000320c' 2024-08-31T04:31:12.670 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14893 fp=#0x1000000314e' 2024-08-31T04:31:12.670 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14925 fp=#0x100000031b4' 2024-08-31T04:31:12.670 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14957 fp=#0x100000058bd' 2024-08-31T04:31:12.671 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14989 fp=#0x10000005899' 2024-08-31T04:31:12.671 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15021 fp=#0x200000017d2' 2024-08-31T04:31:12.671 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15053 fp=#0x20000001807' 2024-08-31T04:31:12.672 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15085 fp=#0x200000017a5' 2024-08-31T04:31:12.672 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15117 fp=#0x20000001710' 2024-08-31T04:31:12.672 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15148 fp=#0x100000057c1' 2024-08-31T04:31:12.673 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15180 fp=#0x100000057a1' 2024-08-31T04:31:12.673 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15212 fp=#0x1000000269c' 2024-08-31T04:31:12.673 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15244 fp=#0x10000001753' 2024-08-31T04:31:12.674 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15276 fp=#0x2000000223d' 2024-08-31T04:31:12.674 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15308 fp=#0x2000000222c' 2024-08-31T04:31:12.675 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15340 fp=#0x2000000226e' 2024-08-31T04:31:12.676 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15468 fp=#0x2000000204f' 2024-08-31T04:31:12.676 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15500 fp=#0x2000000163f' 2024-08-31T04:31:12.676 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15532 fp=#0x200000019e4' 2024-08-31T04:31:12.677 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15564 fp=#0x10000005339' 2024-08-31T04:31:12.677 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15596 fp=#0x1000000531e' 2024-08-31T04:31:12.678 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15660 fp=#0x10000004e9d' 2024-08-31T04:31:12.678 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15692 fp=#0x10000004ebc' 2024-08-31T04:31:12.678 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15724 fp=#0x10000004eb5' 2024-08-31T04:31:12.679 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15756 fp=#0x2000000203a' 2024-08-31T04:31:12.679 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15788 fp=#0x20000002285' 2024-08-31T04:31:12.680 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15948 fp=#0x20000002001' 2024-08-31T04:31:12.681 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15980 fp=#0x2000000202c' 2024-08-31T04:31:12.681 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16012 fp=#0x20000001911' 2024-08-31T04:31:12.681 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16044 fp=#0x20000000ebf' 2024-08-31T04:31:12.682 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16076 fp=#0x20000001952' 2024-08-31T04:31:12.682 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16108 fp=#0x20000001118' 2024-08-31T04:31:12.682 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16140 fp=#0x20000001114' 2024-08-31T04:31:12.683 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16172 fp=#0x20000001608' 2024-08-31T04:31:12.683 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16204 fp=#0x200000015ed' 2024-08-31T04:31:12.683 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16236 fp=#0x2000000159d' 2024-08-31T04:31:12.684 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16268 fp=#0x200000015d0' 2024-08-31T04:31:12.684 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16299 fp=#0x10000004842' 2024-08-31T04:31:12.684 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16331 fp=#0x10000004811' 2024-08-31T04:31:12.685 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16363 fp=#0x10000004831' 2024-08-31T04:31:12.685 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16395 fp=#0x100000044fd' 2024-08-31T04:31:12.685 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16427 fp=#0x1000000488b' 2024-08-31T04:31:12.686 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16459 fp=#0x1000000483c' 2024-08-31T04:31:12.686 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16491 fp=#0x200000011ac' 2024-08-31T04:31:12.686 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16523 fp=#0x20000001146' 2024-08-31T04:31:12.686 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16555 fp=#0x10000004920' 2024-08-31T04:31:12.687 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16587 fp=#0x200000011ba' 2024-08-31T04:31:12.687 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16619 fp=#0x200000022af' 2024-08-31T04:31:12.687 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16651 fp=#0x20000002286' 2024-08-31T04:31:12.688 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16683 fp=#0x10000002afe' 2024-08-31T04:31:12.688 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16715 fp=#0x10000002a92' 2024-08-31T04:31:12.688 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16747 fp=#0x20000000435' 2024-08-31T04:31:12.689 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16779 fp=#0x2000000040c' 2024-08-31T04:31:12.689 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16811 fp=#0x10000002a66' 2024-08-31T04:31:12.690 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16875 fp=#0x100000045bd' 2024-08-31T04:31:12.690 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16907 fp=#0x10000004569' 2024-08-31T04:31:12.690 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16939 fp=#0x10000005d54' 2024-08-31T04:31:12.691 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16971 fp=#0x1000000457d' 2024-08-31T04:31:12.692 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17099 fp=#0x10000005799' 2024-08-31T04:31:12.692 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17131 fp=#0x10000005795' 2024-08-31T04:31:12.692 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17163 fp=#0x1000000578b' 2024-08-31T04:31:12.693 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17195 fp=#0x200000010a6' 2024-08-31T04:31:12.693 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17227 fp=#0x100000054e0' 2024-08-31T04:31:12.693 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17259 fp=#0x100000054ec' 2024-08-31T04:31:12.694 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17323 fp=#0x10000005468' 2024-08-31T04:31:12.694 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17355 fp=#0x20000001ad2' 2024-08-31T04:31:12.695 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17387 fp=#0x20000001a9e' 2024-08-31T04:31:12.695 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17419 fp=#0x20000001abe' 2024-08-31T04:31:12.695 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17451 fp=#0x10000004d4c' 2024-08-31T04:31:12.696 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17483 fp=#0x20000001a74' 2024-08-31T04:31:12.696 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17515 fp=#0x10000004dc0' 2024-08-31T04:31:12.696 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17547 fp=#0x20000001af6' 2024-08-31T04:31:12.697 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17579 fp=#0x20000001aed' 2024-08-31T04:31:12.697 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17611 fp=#0x20000001f62' 2024-08-31T04:31:12.697 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17643 fp=#0x20000001f4f' 2024-08-31T04:31:12.698 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17675 fp=#0x20000001f57' 2024-08-31T04:31:12.698 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17707 fp=#0x10000002a3f' 2024-08-31T04:31:12.699 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17739 fp=#0x10000002a0c' 2024-08-31T04:31:12.699 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17771 fp=#0x10000004f2d' 2024-08-31T04:31:12.699 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17803 fp=#0x10000004f46' 2024-08-31T04:31:12.700 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17835 fp=#0x10000004f21' 2024-08-31T04:31:12.700 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17867 fp=#0x10000000829' 2024-08-31T04:31:12.701 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17931 fp=#0x10000000836' 2024-08-31T04:31:12.701 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17963 fp=#0x20000001c0a' 2024-08-31T04:31:12.701 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17995 fp=#0x20000001c7b' 2024-08-31T04:31:12.701 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18027 fp=#0x20000001c98' 2024-08-31T04:31:12.702 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18059 fp=#0x20000001c90' 2024-08-31T04:31:12.702 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18091 fp=#0x20000001772' 2024-08-31T04:31:12.702 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18123 fp=#0x2000000172b' 2024-08-31T04:31:12.703 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18155 fp=#0x20000001737' 2024-08-31T04:31:12.703 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18187 fp=#0x20000000cde' 2024-08-31T04:31:12.703 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18219 fp=#0x20000000c74' 2024-08-31T04:31:12.704 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18251 fp=#0x20000000c85' 2024-08-31T04:31:12.704 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18280 fp=#0x2000000084d' 2024-08-31T04:31:12.704 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18312 fp=#0x2000000085d' 2024-08-31T04:31:12.705 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18376 fp=#0x2000000085e' 2024-08-31T04:31:12.705 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18403 fp=#0x2000000217a' 2024-08-31T04:31:12.706 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18435 fp=#0x20000002197' 2024-08-31T04:31:12.706 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18467 fp=#0x200000021e6' 2024-08-31T04:31:12.706 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18499 fp=#0x20000002223' 2024-08-31T04:31:12.707 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18529 fp=#0x10000003674' 2024-08-31T04:31:12.707 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18561 fp=#0x1000000368d' 2024-08-31T04:31:12.707 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:7188 fp=#0x200000006d7' 2024-08-31T04:31:12.708 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:7284 fp=#0x10000004534' 2024-08-31T04:31:12.710 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:7476 fp=#0x20000002002' 2024-08-31T04:31:12.710 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:7508 fp=#0x20000001fc6' 2024-08-31T04:31:12.710 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:7540 fp=#0x2000000201f' 2024-08-31T04:31:12.721 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:8907 fp=#0x20000000654' 2024-08-31T04:31:12.722 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9035 fp=#0x20000000f73' 2024-08-31T04:31:12.722 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9067 fp=#0x20000000fb5' 2024-08-31T04:31:12.723 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9099 fp=#0x20000000f57' 2024-08-31T04:31:12.723 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9131 fp=#0x20000001d5d' 2024-08-31T04:31:12.723 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9163 fp=#0x20000001d84' 2024-08-31T04:31:12.724 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9195 fp=#0x20000001ce1' 2024-08-31T04:31:12.724 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9227 fp=#0x20000001d3e' 2024-08-31T04:31:12.725 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9387 fp=#0x200000009c7' 2024-08-31T04:31:12.726 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9451 fp=#0x2000000154b' 2024-08-31T04:31:12.726 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9483 fp=#0x200000009ca' 2024-08-31T04:31:12.727 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9515 fp=#0x200000009c9' 2024-08-31T04:31:12.727 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9547 fp=#0x20000001581' 2024-08-31T04:31:12.727 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9579 fp=#0x200000014a4' 2024-08-31T04:31:12.728 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9675 fp=#0x20000001835' 2024-08-31T04:31:12.729 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9707 fp=#0x20000000b0d' 2024-08-31T04:31:12.729 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9739 fp=#0x20000001f75' 2024-08-31T04:31:12.729 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9771 fp=#0x20000000b32' 2024-08-31T04:31:12.730 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9803 fp=#0x20000000b3f' 2024-08-31T04:31:12.730 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9835 fp=#0x20000001eee' 2024-08-31T04:31:12.730 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9867 fp=#0x20000001e62' 2024-08-31T04:31:12.730 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9899 fp=#0x20000001de3' 2024-08-31T04:31:12.732 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10058 fp=#0x20000000dea' 2024-08-31T04:31:12.732 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10090 fp=#0x20000000d8f' 2024-08-31T04:31:12.732 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10122 fp=#0x20000000de0' 2024-08-31T04:31:12.733 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10154 fp=#0x20000000dec' 2024-08-31T04:31:12.733 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10186 fp=#0x20000000d34' 2024-08-31T04:31:12.733 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10218 fp=#0x200000006ed' 2024-08-31T04:31:12.734 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10250 fp=#0x2000000105d' 2024-08-31T04:31:12.734 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10282 fp=#0x20000001017' 2024-08-31T04:31:12.734 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10314 fp=#0x20000000ffa' 2024-08-31T04:31:12.735 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10378 fp=#0x200000014f2' 2024-08-31T04:31:12.735 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10410 fp=#0x20000000922' 2024-08-31T04:31:12.736 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10442 fp=#0x200000014a7' 2024-08-31T04:31:12.736 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10474 fp=#0x200000010c5' 2024-08-31T04:31:12.736 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10506 fp=#0x100000010f5' 2024-08-31T04:31:12.737 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10538 fp=#0x10000003cad' 2024-08-31T04:31:12.737 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10570 fp=#0x10000000bfc' 2024-08-31T04:31:12.737 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10602 fp=#0x10000000b72' 2024-08-31T04:31:12.738 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10634 fp=#0x2000000205d' 2024-08-31T04:31:12.738 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10666 fp=#0x200000020c0' 2024-08-31T04:31:12.738 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10698 fp=#0x20000002064' 2024-08-31T04:31:12.739 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10826 fp=#0x10000003493' 2024-08-31T04:31:12.740 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10858 fp=#0x1000000346f' 2024-08-31T04:31:12.740 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10890 fp=#0x200000005d6' 2024-08-31T04:31:12.740 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10922 fp=#0x10000003441' 2024-08-31T04:31:12.741 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10954 fp=#0x200000005f1' 2024-08-31T04:31:12.741 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10986 fp=#0x10000003461' 2024-08-31T04:31:12.742 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11018 fp=#0x10000003c2a' 2024-08-31T04:31:12.742 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11050 fp=#0x10000003ce0' 2024-08-31T04:31:12.742 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11082 fp=#0x10000003c15' 2024-08-31T04:31:12.743 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11114 fp=#0x10000003d69' 2024-08-31T04:31:12.743 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11146 fp=#0x10000003bcc' 2024-08-31T04:31:12.743 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11178 fp=#0x10000003b65' 2024-08-31T04:31:12.744 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11210 fp=#0x10000003cf2' 2024-08-31T04:31:12.744 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11238 fp=#0x20000000e79' 2024-08-31T04:31:12.744 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11270 fp=#0x20000000e4d' 2024-08-31T04:31:12.745 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11302 fp=#0x20000000e8a' 2024-08-31T04:31:12.745 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11334 fp=#0x200000018fd' 2024-08-31T04:31:12.745 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11366 fp=#0x200000019aa' 2024-08-31T04:31:12.746 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11398 fp=#0x20000001edf' 2024-08-31T04:31:12.746 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11430 fp=#0x20000001e69' 2024-08-31T04:31:12.746 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11462 fp=#0x20000001913' 2024-08-31T04:31:12.747 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11494 fp=#0x20000001e4f' 2024-08-31T04:31:12.747 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11526 fp=#0x10000004646' 2024-08-31T04:31:12.747 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11558 fp=#0x100000045ec' 2024-08-31T04:31:12.748 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11590 fp=#0x10000004602' 2024-08-31T04:31:12.748 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11622 fp=#0x100000045e6' 2024-08-31T04:31:12.748 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11654 fp=#0x2000000069a' 2024-08-31T04:31:12.749 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11686 fp=#0x2000000198b' 2024-08-31T04:31:12.749 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11718 fp=#0x20000001990' 2024-08-31T04:31:12.749 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11750 fp=#0x200000006cc' 2024-08-31T04:31:12.750 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11782 fp=#0x200000006c8' 2024-08-31T04:31:12.750 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11814 fp=#0x2000000197f' 2024-08-31T04:31:12.751 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11878 fp=#0x20000001617' 2024-08-31T04:31:12.751 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11910 fp=#0x20000000aa4' 2024-08-31T04:31:12.751 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11942 fp=#0x20000000a89' 2024-08-31T04:31:12.751 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11974 fp=#0x20000000a7a' 2024-08-31T04:31:12.752 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12006 fp=#0x20000001750' 2024-08-31T04:31:12.752 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12038 fp=#0x200000016d6' 2024-08-31T04:31:12.752 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12070 fp=#0x2000000173c' 2024-08-31T04:31:12.754 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12230 fp=#0x200000014fd' 2024-08-31T04:31:12.755 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12358 fp=#0x20000001091' 2024-08-31T04:31:12.755 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12390 fp=#0x20000001097' 2024-08-31T04:31:12.755 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12422 fp=#0x200000010a5' 2024-08-31T04:31:12.756 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12454 fp=#0x20000001f1e' 2024-08-31T04:31:12.756 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12486 fp=#0x20000001ea8' 2024-08-31T04:31:12.756 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12518 fp=#0x20000001f26' 2024-08-31T04:31:12.757 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12550 fp=#0x20000000a0c' 2024-08-31T04:31:12.757 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12582 fp=#0x200000009da' 2024-08-31T04:31:12.757 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12614 fp=#0x20000000a39' 2024-08-31T04:31:12.758 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12646 fp=#0x20000000a63' 2024-08-31T04:31:12.758 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12678 fp=#0x20000000a21' 2024-08-31T04:31:12.758 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12710 fp=#0x10000000e31' 2024-08-31T04:31:12.759 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12742 fp=#0x200000003f3' 2024-08-31T04:31:12.759 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12774 fp=#0x2000000021f' 2024-08-31T04:31:12.759 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12806 fp=#0x20000000228' 2024-08-31T04:31:12.759 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12838 fp=#0x200000003c3' 2024-08-31T04:31:12.760 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12870 fp=#0x2000000211b' 2024-08-31T04:31:12.760 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12902 fp=#0x10000002f2e' 2024-08-31T04:31:12.760 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12934 fp=#0x20000000add' 2024-08-31T04:31:12.761 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12966 fp=#0x10000002ebe' 2024-08-31T04:31:12.761 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12998 fp=#0x10000002eab' 2024-08-31T04:31:12.761 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13029 fp=#0x2000000071c' 2024-08-31T04:31:12.762 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13061 fp=#0x200000007ae' 2024-08-31T04:31:12.762 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13093 fp=#0x20000000752' 2024-08-31T04:31:12.762 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13125 fp=#0x20000000769' 2024-08-31T04:31:12.763 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13157 fp=#0x20000000727' 2024-08-31T04:31:12.763 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13189 fp=#0x20000000791' 2024-08-31T04:31:12.763 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13221 fp=#0x20000000b78' 2024-08-31T04:31:12.764 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13253 fp=#0x20000000b82' 2024-08-31T04:31:12.764 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13285 fp=#0x20000000bb4' 2024-08-31T04:31:12.764 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13317 fp=#0x20000000b93' 2024-08-31T04:31:12.765 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13349 fp=#0x20000000bb1' 2024-08-31T04:31:12.765 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13381 fp=#0x20000001ca7' 2024-08-31T04:31:12.765 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13413 fp=#0x20000001ce0' 2024-08-31T04:31:12.766 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13445 fp=#0x20000001f46' 2024-08-31T04:31:12.766 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13477 fp=#0x10000003b67' 2024-08-31T04:31:12.766 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13509 fp=#0x10000003b5e' 2024-08-31T04:31:12.767 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13536 fp=#0x2000000116a' 2024-08-31T04:31:12.767 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13568 fp=#0x20000002121' 2024-08-31T04:31:12.767 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13600 fp=#0x200000020fe' 2024-08-31T04:31:12.768 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13632 fp=#0x2000000113f' 2024-08-31T04:31:12.768 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13664 fp=#0x10000002f4d' 2024-08-31T04:31:12.768 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13696 fp=#0x10000002e2b' 2024-08-31T04:31:12.769 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13728 fp=#0x10000002f51' 2024-08-31T04:31:12.769 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13760 fp=#0x10000002e1c' 2024-08-31T04:31:12.770 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13792 fp=#0x200000015d9' 2024-08-31T04:31:12.770 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13824 fp=#0x20000000833' 2024-08-31T04:31:12.770 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13856 fp=#0x20000000cbb' 2024-08-31T04:31:12.771 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13888 fp=#0x20000000d13' 2024-08-31T04:31:12.771 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13920 fp=#0x20000000cae' 2024-08-31T04:31:12.771 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13952 fp=#0x20000000d01' 2024-08-31T04:31:12.771 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13984 fp=#0x20000000d7f' 2024-08-31T04:31:12.772 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14016 fp=#0x200000019e2' 2024-08-31T04:31:12.772 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14048 fp=#0x200000019cf' 2024-08-31T04:31:12.773 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14080 fp=#0x20000001a04' 2024-08-31T04:31:12.773 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14112 fp=#0x200000019bf' 2024-08-31T04:31:12.773 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14144 fp=#0x20000000955' 2024-08-31T04:31:12.774 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14176 fp=#0x200000008f1' 2024-08-31T04:31:12.774 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14208 fp=#0x20000000937' 2024-08-31T04:31:12.774 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14240 fp=#0x200000008aa' 2024-08-31T04:31:12.775 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14272 fp=#0x20000001e32' 2024-08-31T04:31:12.775 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14304 fp=#0x20000001dbc' 2024-08-31T04:31:12.775 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14336 fp=#0x20000001dc0' 2024-08-31T04:31:12.776 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14432 fp=#0x20000001dcf' 2024-08-31T04:31:12.776 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14464 fp=#0x200000018e1' 2024-08-31T04:31:12.777 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14496 fp=#0x20000001855' 2024-08-31T04:31:12.777 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14528 fp=#0x2000000190f' 2024-08-31T04:31:12.777 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14560 fp=#0x20000000f20' 2024-08-31T04:31:12.778 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14592 fp=#0x20000000f26' 2024-08-31T04:31:12.778 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14624 fp=#0x20000000f41' 2024-08-31T04:31:12.778 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14656 fp=#0x20000001002' 2024-08-31T04:31:12.779 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14688 fp=#0x20000000f33' 2024-08-31T04:31:12.779 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14720 fp=#0x100000046ee' 2024-08-31T04:31:12.779 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14752 fp=#0x1000000463e' 2024-08-31T04:31:12.780 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14784 fp=#0x20000000ae6' 2024-08-31T04:31:12.780 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14816 fp=#0x10000004655' 2024-08-31T04:31:12.781 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14862 fp=#0x10000003167' 2024-08-31T04:31:12.781 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14894 fp=#0x10000003164' 2024-08-31T04:31:12.782 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14926 fp=#0x10000003175' 2024-08-31T04:31:12.782 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14958 fp=#0x100000058ca' 2024-08-31T04:31:12.782 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14990 fp=#0x100000058a2' 2024-08-31T04:31:12.782 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15022 fp=#0x2000000170a' 2024-08-31T04:31:12.783 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15054 fp=#0x200000017b5' 2024-08-31T04:31:12.783 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15086 fp=#0x2000000173a' 2024-08-31T04:31:12.783 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15118 fp=#0x2000000174d' 2024-08-31T04:31:12.784 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15149 fp=#0x20000001d8a' 2024-08-31T04:31:12.784 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15181 fp=#0x100000057ac' 2024-08-31T04:31:12.784 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15213 fp=#0x20000001a63' 2024-08-31T04:31:12.785 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15245 fp=#0x10000001783' 2024-08-31T04:31:12.785 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15277 fp=#0x200000021d3' 2024-08-31T04:31:12.785 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15309 fp=#0x200000021dd' 2024-08-31T04:31:12.786 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15341 fp=#0x200000021d6' 2024-08-31T04:31:12.787 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15469 fp=#0x20000002092' 2024-08-31T04:31:12.787 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15501 fp=#0x20000001645' 2024-08-31T04:31:12.787 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15533 fp=#0x1000000531a' 2024-08-31T04:31:12.788 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15565 fp=#0x20000001638' 2024-08-31T04:31:12.788 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15597 fp=#0x10000005321' 2024-08-31T04:31:12.789 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15629 fp=#0x10000004ec9' 2024-08-31T04:31:12.789 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15661 fp=#0x10000004eb6' 2024-08-31T04:31:12.789 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15725 fp=#0x20000001d6d' 2024-08-31T04:31:12.791 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15949 fp=#0x20000001ff6' 2024-08-31T04:31:12.791 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15981 fp=#0x100000018be' 2024-08-31T04:31:12.792 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16013 fp=#0x200000017e0' 2024-08-31T04:31:12.792 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16045 fp=#0x200000017ca' 2024-08-31T04:31:12.792 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16077 fp=#0x20000001926' 2024-08-31T04:31:12.793 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16109 fp=#0x20000001131' 2024-08-31T04:31:12.793 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16141 fp=#0x2000000110f' 2024-08-31T04:31:12.793 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16173 fp=#0x20000001603' 2024-08-31T04:31:12.794 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16205 fp=#0x20000001597' 2024-08-31T04:31:12.794 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16237 fp=#0x200000015fe' 2024-08-31T04:31:12.794 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16269 fp=#0x200000015e4' 2024-08-31T04:31:12.795 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16300 fp=#0x1000000480f' 2024-08-31T04:31:12.795 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16332 fp=#0x1000000452b' 2024-08-31T04:31:12.795 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16364 fp=#0x10000004819' 2024-08-31T04:31:12.796 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16396 fp=#0x10000004821' 2024-08-31T04:31:12.796 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16428 fp=#0x10000004840' 2024-08-31T04:31:12.796 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16460 fp=#0x1000000481b' 2024-08-31T04:31:12.797 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16492 fp=#0x2000000187f' 2024-08-31T04:31:12.797 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16524 fp=#0x100000048e1' 2024-08-31T04:31:12.797 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16556 fp=#0x10000004ee3' 2024-08-31T04:31:12.798 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16588 fp=#0x200000011a8' 2024-08-31T04:31:12.798 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16620 fp=#0x200000022a0' 2024-08-31T04:31:12.798 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16652 fp=#0x200000022c0' 2024-08-31T04:31:12.799 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16684 fp=#0x10000002a71' 2024-08-31T04:31:12.799 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16716 fp=#0x20000000421' 2024-08-31T04:31:12.799 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16748 fp=#0x20000000404' 2024-08-31T04:31:12.800 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16812 fp=#0x10000002acc' 2024-08-31T04:31:12.800 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16844 fp=#0x20000001893' 2024-08-31T04:31:12.801 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16876 fp=#0x10000005d4c' 2024-08-31T04:31:12.801 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16908 fp=#0x10000005d4e' 2024-08-31T04:31:12.801 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16940 fp=#0x1000000458e' 2024-08-31T04:31:12.803 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17100 fp=#0x20000001bac' 2024-08-31T04:31:12.804 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17292 fp=#0x100000054db' 2024-08-31T04:31:12.805 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17324 fp=#0x100000054d6' 2024-08-31T04:31:12.805 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17356 fp=#0x20000001a7b' 2024-08-31T04:31:12.805 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17388 fp=#0x20000001a93' 2024-08-31T04:31:12.806 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17420 fp=#0x20000001ab5' 2024-08-31T04:31:12.806 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17452 fp=#0x10000004e3c' 2024-08-31T04:31:12.806 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17484 fp=#0x10000004d49' 2024-08-31T04:31:12.807 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17516 fp=#0x10000004e16' 2024-08-31T04:31:12.807 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17548 fp=#0x20000001b44' 2024-08-31T04:31:12.807 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17580 fp=#0x20000001adf' 2024-08-31T04:31:12.808 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17612 fp=#0x10000002a38' 2024-08-31T04:31:12.808 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17644 fp=#0x20000001f4e' 2024-08-31T04:31:12.808 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17676 fp=#0x20000001f2c' 2024-08-31T04:31:12.809 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17708 fp=#0x100000029f9' 2024-08-31T04:31:12.809 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17740 fp=#0x20000001f65' 2024-08-31T04:31:12.809 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17772 fp=#0x10000004f22' 2024-08-31T04:31:12.810 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17804 fp=#0x10000004ef1' 2024-08-31T04:31:12.810 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17836 fp=#0x10000004f2f' 2024-08-31T04:31:12.811 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17868 fp=#0x10000000892' 2024-08-31T04:31:12.811 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17900 fp=#0x10000001107' 2024-08-31T04:31:12.811 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17964 fp=#0x20000001c47' 2024-08-31T04:31:12.812 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17996 fp=#0x20000001cba' 2024-08-31T04:31:12.812 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18028 fp=#0x20000001c15' 2024-08-31T04:31:12.813 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18060 fp=#0x20000001cad' 2024-08-31T04:31:12.813 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18092 fp=#0x20000001769' 2024-08-31T04:31:12.813 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18124 fp=#0x200000016ef' 2024-08-31T04:31:12.814 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18156 fp=#0x2000000174e' 2024-08-31T04:31:12.814 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18188 fp=#0x20000000c98' 2024-08-31T04:31:12.814 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18220 fp=#0x20000000c3e' 2024-08-31T04:31:12.815 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18252 fp=#0x20000000c9c' 2024-08-31T04:31:12.815 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18281 fp=#0x200000022f7' 2024-08-31T04:31:12.815 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18313 fp=#0x10000004950' 2024-08-31T04:31:12.816 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18377 fp=#0x2000000084f' 2024-08-31T04:31:12.816 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18404 fp=#0x20000002244' 2024-08-31T04:31:12.816 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18436 fp=#0x200000021b5' 2024-08-31T04:31:12.817 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18468 fp=#0x200000021af' 2024-08-31T04:31:12.817 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18500 fp=#0x2000000216f' 2024-08-31T04:31:12.820 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18530 fp=#0x10000003590' 2024-08-31T04:31:12.820 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18562 fp=#0x1000000357b' 2024-08-31T04:31:12.821 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:7189 fp=#0x200000008fb' 2024-08-31T04:31:12.821 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:7221 fp=#0x2000000089d' 2024-08-31T04:31:12.822 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:7285 fp=#0x10000004990' 2024-08-31T04:31:12.823 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:7381 fp=#0x20000002023' 2024-08-31T04:31:12.823 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:7477 fp=#0x20000001fae' 2024-08-31T04:31:12.824 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:7541 fp=#0x2000000200f' 2024-08-31T04:31:12.832 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:8693 fp=#0x20000000ad3' 2024-08-31T04:31:12.833 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'client_request(client.15282:310823 rename #0x10000004906/comment-34.xml #0x10000004906/comment-34.xml.tmp 2024-08-31T04:29:46.479963+0000 caller_uid=1000, caller_gid=1333{6,36,1000,1333,})' 2024-08-31T04:31:12.834 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:8876 fp=#0x20000000637' 2024-08-31T04:31:12.834 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:8908 fp=#0x2000000062c' 2024-08-31T04:31:12.835 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:8972 fp=#0x2000000067a' 2024-08-31T04:31:12.835 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9036 fp=#0x20000000fb4' 2024-08-31T04:31:12.836 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9068 fp=#0x20000000f5c' 2024-08-31T04:31:12.836 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9164 fp=#0x20000001cca' 2024-08-31T04:31:12.837 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9196 fp=#0x20000000863' 2024-08-31T04:31:12.837 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9228 fp=#0x20000001d28' 2024-08-31T04:31:12.839 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9388 fp=#0x20000000966' 2024-08-31T04:31:12.839 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9420 fp=#0x200000009bd' 2024-08-31T04:31:12.839 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9452 fp=#0x200000009b8' 2024-08-31T04:31:12.840 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9484 fp=#0x2000000099e' 2024-08-31T04:31:12.840 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9516 fp=#0x200000009a6' 2024-08-31T04:31:12.840 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9548 fp=#0x20000001579' 2024-08-31T04:31:12.841 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9580 fp=#0x200000014ab' 2024-08-31T04:31:12.841 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9612 fp=#0x200000018d4' 2024-08-31T04:31:12.842 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9676 fp=#0x20000000b54' 2024-08-31T04:31:12.842 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9708 fp=#0x20000000b37' 2024-08-31T04:31:12.842 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9740 fp=#0x20000000b14' 2024-08-31T04:31:12.845 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9772 fp=#0x20000000b0a' 2024-08-31T04:31:12.845 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9804 fp=#0x20000000b2c' 2024-08-31T04:31:12.846 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9836 fp=#0x20000001e8a' 2024-08-31T04:31:12.846 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9868 fp=#0x20000001e6f' 2024-08-31T04:31:12.846 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9900 fp=#0x20000001e95' 2024-08-31T04:31:12.847 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10059 fp=#0x20000000e30' 2024-08-31T04:31:12.848 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10123 fp=#0x20000000d7b' 2024-08-31T04:31:12.848 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10155 fp=#0x20000001020' 2024-08-31T04:31:12.849 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10187 fp=#0x20000000dfb' 2024-08-31T04:31:12.849 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10219 fp=#0x20000001019' 2024-08-31T04:31:12.849 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10251 fp=#0x200000006d9' 2024-08-31T04:31:12.850 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10283 fp=#0x200000006f1' 2024-08-31T04:31:12.850 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10315 fp=#0x200000006de' 2024-08-31T04:31:12.850 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10347 fp=#0x2000000092a' 2024-08-31T04:31:12.851 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10379 fp=#0x200000014ec' 2024-08-31T04:31:12.851 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10411 fp=#0x200000008fd' 2024-08-31T04:31:12.851 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10443 fp=#0x200000014b2' 2024-08-31T04:31:12.852 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10475 fp=#0x1000000476b' 2024-08-31T04:31:12.852 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10507 fp=#0x10000000b5d' 2024-08-31T04:31:12.852 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10539 fp=#0x10000000b9d' 2024-08-31T04:31:12.853 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10571 fp=#0x10000000bd3' 2024-08-31T04:31:12.853 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10603 fp=#0x100000010db' 2024-08-31T04:31:12.853 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10635 fp=#0x200000020e6' 2024-08-31T04:31:12.853 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10667 fp=#0x2000000209d' 2024-08-31T04:31:12.854 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10699 fp=#0x20000002050' 2024-08-31T04:31:12.854 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10731 fp=#0x200000010af' 2024-08-31T04:31:12.855 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10827 fp=#0x100000033fa' 2024-08-31T04:31:12.855 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10859 fp=#0x10000003413' 2024-08-31T04:31:12.856 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10891 fp=#0x20000000611' 2024-08-31T04:31:12.856 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10923 fp=#0x1000000344d' 2024-08-31T04:31:12.856 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10955 fp=#0x10000003459' 2024-08-31T04:31:12.857 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10987 fp=#0x10000003436' 2024-08-31T04:31:12.857 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11019 fp=#0x10000003da7' 2024-08-31T04:31:12.857 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11051 fp=#0x10000003b4c' 2024-08-31T04:31:12.858 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11083 fp=#0x10000003d6d' 2024-08-31T04:31:12.858 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11115 fp=#0x10000003d06' 2024-08-31T04:31:12.858 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11147 fp=#0x10000003b52' 2024-08-31T04:31:12.859 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11179 fp=#0x100000039d3' 2024-08-31T04:31:12.859 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11211 fp=#0x100000039c9' 2024-08-31T04:31:12.859 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11239 fp=#0x200000014e8' 2024-08-31T04:31:12.860 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11271 fp=#0x20000000e66' 2024-08-31T04:31:12.860 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11303 fp=#0x20000000e58' 2024-08-31T04:31:12.860 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11335 fp=#0x20000001934' 2024-08-31T04:31:12.860 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11367 fp=#0x20000001979' 2024-08-31T04:31:12.861 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11399 fp=#0x20000001e43' 2024-08-31T04:31:12.861 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11431 fp=#0x20000001ef6' 2024-08-31T04:31:12.861 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11463 fp=#0x20000001959' 2024-08-31T04:31:12.862 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11495 fp=#0x20000001e66' 2024-08-31T04:31:12.862 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11527 fp=#0x100000045d4' 2024-08-31T04:31:12.862 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11559 fp=#0x1000000462a' 2024-08-31T04:31:12.863 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11591 fp=#0x1000000460f' 2024-08-31T04:31:12.863 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11623 fp=#0x100000045f8' 2024-08-31T04:31:12.864 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11655 fp=#0x200000006ce' 2024-08-31T04:31:12.864 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11687 fp=#0x2000000198a' 2024-08-31T04:31:12.864 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11719 fp=#0x200000011b6' 2024-08-31T04:31:12.864 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11751 fp=#0x200000009ac' 2024-08-31T04:31:12.865 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11783 fp=#0x200000006af' 2024-08-31T04:31:12.865 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11847 fp=#0x200000022cf' 2024-08-31T04:31:12.866 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11879 fp=#0x20000000a84' 2024-08-31T04:31:12.866 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11911 fp=#0x20000000abb' 2024-08-31T04:31:12.866 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11943 fp=#0x20000000a6e' 2024-08-31T04:31:12.867 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11975 fp=#0x20000000aa8' 2024-08-31T04:31:12.867 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12007 fp=#0x200000016b5' 2024-08-31T04:31:12.867 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12039 fp=#0x200000016e6' 2024-08-31T04:31:12.868 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12071 fp=#0x200000016a1' 2024-08-31T04:31:12.868 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12103 fp=#0x200000014f7' 2024-08-31T04:31:12.869 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12199 fp=#0x20000001fa5' 2024-08-31T04:31:12.869 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12231 fp=#0x20000001fcd' 2024-08-31T04:31:12.870 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12327 fp=#0x20000001f90' 2024-08-31T04:31:12.870 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12359 fp=#0x200000010dc' 2024-08-31T04:31:12.871 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12391 fp=#0x20000001090' 2024-08-31T04:31:12.871 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12423 fp=#0x20000001073' 2024-08-31T04:31:12.871 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12455 fp=#0x20000001f3e' 2024-08-31T04:31:12.872 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12487 fp=#0x20000001e8b' 2024-08-31T04:31:12.872 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12519 fp=#0x20000001ee9' 2024-08-31T04:31:12.872 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12551 fp=#0x20000000ac8' 2024-08-31T04:31:12.873 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12583 fp=#0x20000000a2b' 2024-08-31T04:31:12.873 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12615 fp=#0x20000000a50' 2024-08-31T04:31:12.873 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12647 fp=#0x20000000a15' 2024-08-31T04:31:12.874 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12679 fp=#0x20000000a27' 2024-08-31T04:31:12.874 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12711 fp=#0x10000000d72' 2024-08-31T04:31:12.874 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12743 fp=#0x10000000e00' 2024-08-31T04:31:12.875 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12775 fp=#0x200000003f0' 2024-08-31T04:31:12.875 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12807 fp=#0x10000000f73' 2024-08-31T04:31:12.875 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12839 fp=#0x200000003f4' 2024-08-31T04:31:12.876 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12871 fp=#0x200000020d6' 2024-08-31T04:31:12.876 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12903 fp=#0x10000002e83' 2024-08-31T04:31:12.876 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12935 fp=#0x2000000210c' 2024-08-31T04:31:12.877 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12967 fp=#0x200000020ee' 2024-08-31T04:31:12.877 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12999 fp=#0x20000000adc' 2024-08-31T04:31:12.877 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13030 fp=#0x200000007a7' 2024-08-31T04:31:12.878 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13062 fp=#0x20000000716' 2024-08-31T04:31:12.878 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13094 fp=#0x20000000756' 2024-08-31T04:31:12.878 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13126 fp=#0x2000000073a' 2024-08-31T04:31:12.879 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13158 fp=#0x20000000754' 2024-08-31T04:31:12.879 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13190 fp=#0x2000000077e' 2024-08-31T04:31:12.879 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13222 fp=#0x20000000bf2' 2024-08-31T04:31:12.880 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13254 fp=#0x20000000b79' 2024-08-31T04:31:12.880 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13286 fp=#0x20000000b7a' 2024-08-31T04:31:12.880 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13318 fp=#0x20000000b7e' 2024-08-31T04:31:12.881 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13350 fp=#0x20000000b80' 2024-08-31T04:31:12.881 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13382 fp=#0x20000001d82' 2024-08-31T04:31:12.881 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13414 fp=#0x20000001c8d' 2024-08-31T04:31:12.882 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13446 fp=#0x20000001d4b' 2024-08-31T04:31:12.882 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13478 fp=#0x10000003b63' 2024-08-31T04:31:12.882 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13510 fp=#0x10000003b05' 2024-08-31T04:31:12.883 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13537 fp=#0x20000001198' 2024-08-31T04:31:12.883 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13665 fp=#0x10000002f2b' 2024-08-31T04:31:12.884 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13697 fp=#0x10000002f33' 2024-08-31T04:31:12.884 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13761 fp=#0x10000002e76' 2024-08-31T04:31:12.885 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13793 fp=#0x200000015c8' 2024-08-31T04:31:12.885 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13825 fp=#0x20000000813' 2024-08-31T04:31:12.885 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13857 fp=#0x20000002217' 2024-08-31T04:31:12.886 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13889 fp=#0x20000000d2b' 2024-08-31T04:31:12.886 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13921 fp=#0x20000002257' 2024-08-31T04:31:12.886 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13953 fp=#0x20000000cb5' 2024-08-31T04:31:12.887 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13985 fp=#0x20000000cd1' 2024-08-31T04:31:12.887 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14017 fp=#0x20000001a56' 2024-08-31T04:31:12.887 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14049 fp=#0x20000001a0c' 2024-08-31T04:31:12.888 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14081 fp=#0x200000019fc' 2024-08-31T04:31:12.888 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14113 fp=#0x20000001a4f' 2024-08-31T04:31:12.888 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14145 fp=#0x200000008ea' 2024-08-31T04:31:12.889 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14177 fp=#0x20000000924' 2024-08-31T04:31:12.889 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14209 fp=#0x200000008e8' 2024-08-31T04:31:12.889 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14241 fp=#0x200000008cc' 2024-08-31T04:31:12.890 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14273 fp=#0x20000001e12' 2024-08-31T04:31:12.890 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14305 fp=#0x20000001627' 2024-08-31T04:31:12.890 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14337 fp=#0x20000001e3f' 2024-08-31T04:31:12.891 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14369 fp=#0x20000001876' 2024-08-31T04:31:12.891 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14433 fp=#0x20000001924' 2024-08-31T04:31:12.891 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14465 fp=#0x20000001809' 2024-08-31T04:31:12.892 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14497 fp=#0x200000018e0' 2024-08-31T04:31:12.892 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14529 fp=#0x20000001826' 2024-08-31T04:31:12.892 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14561 fp=#0x20000000f34' 2024-08-31T04:31:12.893 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14593 fp=#0x20000000ffc' 2024-08-31T04:31:12.893 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14625 fp=#0x20000000f29' 2024-08-31T04:31:12.893 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14657 fp=#0x20000000f5f' 2024-08-31T04:31:12.894 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14689 fp=#0x20000000fde' 2024-08-31T04:31:12.894 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14721 fp=#0x10000004631' 2024-08-31T04:31:12.894 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14753 fp=#0x20000000c02' 2024-08-31T04:31:12.895 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14785 fp=#0x1000000463c' 2024-08-31T04:31:12.896 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14863 fp=#0x100000031fe' 2024-08-31T04:31:12.896 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14895 fp=#0x1000000321e' 2024-08-31T04:31:12.896 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14927 fp=#0x10000003158' 2024-08-31T04:31:12.897 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14959 fp=#0x100000058af' 2024-08-31T04:31:12.897 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14991 fp=#0x2000000171c' 2024-08-31T04:31:12.897 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15023 fp=#0x200000017c2' 2024-08-31T04:31:12.898 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15055 fp=#0x200000017ad' 2024-08-31T04:31:12.898 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15087 fp=#0x200000017df' 2024-08-31T04:31:12.898 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15119 fp=#0x200000017d4' 2024-08-31T04:31:12.899 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15150 fp=#0x100000057ab' 2024-08-31T04:31:12.899 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15182 fp=#0x100000057a0' 2024-08-31T04:31:12.899 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15214 fp=#0x1000000170c' 2024-08-31T04:31:12.900 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15246 fp=#0x200000022ab' 2024-08-31T04:31:12.900 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15278 fp=#0x2000000226c' 2024-08-31T04:31:12.900 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15310 fp=#0x20000002243' 2024-08-31T04:31:12.901 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15342 fp=#0x2000000226f' 2024-08-31T04:31:12.902 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15470 fp=#0x2000000206f' 2024-08-31T04:31:12.902 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15502 fp=#0x1000000532d' 2024-08-31T04:31:12.902 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15534 fp=#0x10000005324' 2024-08-31T04:31:12.903 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15566 fp=#0x10000005317' 2024-08-31T04:31:12.903 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15598 fp=#0x1000000533b' 2024-08-31T04:31:12.904 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15630 fp=#0x10000004ed2' 2024-08-31T04:31:12.904 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15662 fp=#0x10000004de9' 2024-08-31T04:31:12.904 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15694 fp=#0x10000004e62' 2024-08-31T04:31:12.904 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15726 fp=#0x10000004e60' 2024-08-31T04:31:12.905 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15790 fp=#0x200000021cc' 2024-08-31T04:31:12.905 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15822 fp=#0x20000001f9e' 2024-08-31T04:31:12.906 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15918 fp=#0x20000001fc8' 2024-08-31T04:31:12.907 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15982 fp=#0x20000001fe4' 2024-08-31T04:31:12.907 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16014 fp=#0x20000000eb1' 2024-08-31T04:31:12.907 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16046 fp=#0x20000001948' 2024-08-31T04:31:12.908 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16078 fp=#0x20000000eb2' 2024-08-31T04:31:12.908 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16110 fp=#0x20000001134' 2024-08-31T04:31:12.908 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16142 fp=#0x20000001105' 2024-08-31T04:31:12.909 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16174 fp=#0x200000015c3' 2024-08-31T04:31:12.909 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16206 fp=#0x200000015fc' 2024-08-31T04:31:12.909 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16238 fp=#0x200000015cc' 2024-08-31T04:31:12.910 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16270 fp=#0x200000015f3' 2024-08-31T04:31:12.910 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16301 fp=#0x10000004529' 2024-08-31T04:31:12.910 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16333 fp=#0x20000001e25' 2024-08-31T04:31:12.911 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16365 fp=#0x100000048a5' 2024-08-31T04:31:12.911 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16397 fp=#0x100000044dd' 2024-08-31T04:31:12.911 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16429 fp=#0x100000047fc' 2024-08-31T04:31:12.912 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16461 fp=#0x100000044f4' 2024-08-31T04:31:12.912 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16493 fp=#0x20000001169' 2024-08-31T04:31:12.912 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16525 fp=#0x1000000497a' 2024-08-31T04:31:12.913 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16557 fp=#0x20000001e7c' 2024-08-31T04:31:12.913 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16589 fp=#0x100000048d6' 2024-08-31T04:31:12.913 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16621 fp=#0x200000022ba' 2024-08-31T04:31:12.914 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16653 fp=#0x20000002297' 2024-08-31T04:31:12.914 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16685 fp=#0x10000002afa' 2024-08-31T04:31:12.915 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16717 fp=#0x20000000422' 2024-08-31T04:31:12.915 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16749 fp=#0x20000001688' 2024-08-31T04:31:12.915 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16781 fp=#0x20000000448' 2024-08-31T04:31:12.916 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16813 fp=#0x200000003f8' 2024-08-31T04:31:12.916 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16845 fp=#0x20000000444' 2024-08-31T04:31:12.916 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16877 fp=#0x10000004561' 2024-08-31T04:31:12.917 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16909 fp=#0x10000004588' 2024-08-31T04:31:12.917 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16941 fp=#0x1000000455c' 2024-08-31T04:31:12.917 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16973 fp=#0x10000005d4f' 2024-08-31T04:31:12.918 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17037 fp=#0x10000005c08' 2024-08-31T04:31:12.920 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17229 fp=#0x1000000548a' 2024-08-31T04:31:12.920 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17293 fp=#0x10000005482' 2024-08-31T04:31:12.921 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17325 fp=#0x10000005466' 2024-08-31T04:31:12.921 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17357 fp=#0x20000001acd' 2024-08-31T04:31:12.921 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17389 fp=#0x20000001aa3' 2024-08-31T04:31:12.922 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17421 fp=#0x20000001a71' 2024-08-31T04:31:12.922 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17453 fp=#0x10000004e21' 2024-08-31T04:31:12.922 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17485 fp=#0x10000004d4f' 2024-08-31T04:31:12.923 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17517 fp=#0x10000004e39' 2024-08-31T04:31:12.923 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17549 fp=#0x20000001b4b' 2024-08-31T04:31:12.923 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17581 fp=#0x20000001b7c' 2024-08-31T04:31:12.924 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17613 fp=#0x20000001f48' 2024-08-31T04:31:12.924 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17645 fp=#0x10000002a26' 2024-08-31T04:31:12.924 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17677 fp=#0x20000001f55' 2024-08-31T04:31:12.925 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17709 fp=#0x10000002a45' 2024-08-31T04:31:12.925 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17741 fp=#0x20000001f54' 2024-08-31T04:31:12.925 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17773 fp=#0x10000004f3c' 2024-08-31T04:31:12.926 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17805 fp=#0x10000004ed4' 2024-08-31T04:31:12.926 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17837 fp=#0x10000004ee7' 2024-08-31T04:31:12.927 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17901 fp=#0x10000001137' 2024-08-31T04:31:12.927 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17965 fp=#0x20000001d57' 2024-08-31T04:31:12.927 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17997 fp=#0x20000001d44' 2024-08-31T04:31:12.928 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18029 fp=#0x20000001c13' 2024-08-31T04:31:12.928 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18061 fp=#0x20000001d15' 2024-08-31T04:31:12.928 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18093 fp=#0x200000016f5' 2024-08-31T04:31:12.929 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18125 fp=#0x20000001738' 2024-08-31T04:31:12.929 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18157 fp=#0x200000016ec' 2024-08-31T04:31:12.929 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18189 fp=#0x20000000ca2' 2024-08-31T04:31:12.930 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18221 fp=#0x20000000ca4' 2024-08-31T04:31:12.930 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18253 fp=#0x20000000c1e' 2024-08-31T04:31:12.930 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18282 fp=#0x10000004a27' 2024-08-31T04:31:12.931 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18314 fp=#0x10000004962' 2024-08-31T04:31:12.931 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18346 fp=#0x100000049fd' 2024-08-31T04:31:12.931 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18378 fp=#0x10000004a12' 2024-08-31T04:31:12.932 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18405 fp=#0x200000021ab' 2024-08-31T04:31:12.932 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18437 fp=#0x20000002208' 2024-08-31T04:31:12.932 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18469 fp=#0x2000000216b' 2024-08-31T04:31:12.933 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18501 fp=#0x200000021ee' 2024-08-31T04:31:12.933 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18531 fp=#0x10000003716' 2024-08-31T04:31:12.933 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18563 fp=#0x40000000775' 2024-08-31T04:31:12.934 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_path:mds.1:7158 fp=#0x1' 2024-08-31T04:31:12.934 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:7190 fp=#0x10000000b4c' 2024-08-31T04:31:12.934 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:7222 fp=#0x200000012a0' 2024-08-31T04:31:12.935 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:7286 fp=#0x10000005723' 2024-08-31T04:31:12.935 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:7382 fp=#0x20000002010' 2024-08-31T04:31:12.936 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:7414 fp=#0x20000001fd3' 2024-08-31T04:31:12.936 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:7446 fp=#0x20000002004' 2024-08-31T04:31:12.937 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:7510 fp=#0x20000001fd0' 2024-08-31T04:31:12.937 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:7542 fp=#0x20000002007' 2024-08-31T04:31:12.946 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'client_request(client.15282:310831 create owner_uid=1000, owner_gid=1333 #0x100000011a5/article-81.xml.tmp 2024-08-31T04:29:47.255944+0000 caller_uid=1000, caller_gid=1333{6,36,1000,1333,})' 2024-08-31T04:31:12.947 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:8909 fp=#0x2000000061e' 2024-08-31T04:31:12.948 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:8941 fp=#0x2000000062e' 2024-08-31T04:31:12.948 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:8973 fp=#0x2000000062f' 2024-08-31T04:31:12.948 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9005 fp=#0x20000001840' 2024-08-31T04:31:12.950 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9133 fp=#0x20000001d21' 2024-08-31T04:31:12.950 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9197 fp=#0x20000001d2c' 2024-08-31T04:31:12.951 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9229 fp=#0x20000001c88' 2024-08-31T04:31:12.951 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9261 fp=#0x20000001b2e' 2024-08-31T04:31:12.952 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9389 fp=#0x2000000097a' 2024-08-31T04:31:12.952 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9421 fp=#0x200000009b4' 2024-08-31T04:31:12.953 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9453 fp=#0x2000000157b' 2024-08-31T04:31:12.953 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9485 fp=#0x20000000981' 2024-08-31T04:31:12.953 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9517 fp=#0x2000000155c' 2024-08-31T04:31:12.954 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9549 fp=#0x20000001574' 2024-08-31T04:31:12.955 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9677 fp=#0x20000000b4f' 2024-08-31T04:31:12.955 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9709 fp=#0x20000000b1d' 2024-08-31T04:31:12.956 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9741 fp=#0x20000000b1c' 2024-08-31T04:31:12.956 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9773 fp=#0x20000000b55' 2024-08-31T04:31:12.956 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9805 fp=#0x20000000b1e' 2024-08-31T04:31:12.957 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9837 fp=#0x20000001f11' 2024-08-31T04:31:12.957 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9869 fp=#0x20000001eb5' 2024-08-31T04:31:12.957 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9901 fp=#0x20000001e22' 2024-08-31T04:31:12.959 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10060 fp=#0x20000000d76' 2024-08-31T04:31:12.959 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10092 fp=#0x20000000da4' 2024-08-31T04:31:12.959 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10124 fp=#0x20000000d3a' 2024-08-31T04:31:12.960 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10156 fp=#0x20000000dde' 2024-08-31T04:31:12.960 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10188 fp=#0x2000000100b' 2024-08-31T04:31:12.960 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10220 fp=#0x2000000101a' 2024-08-31T04:31:12.961 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10252 fp=#0x2000000106e' 2024-08-31T04:31:12.961 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10284 fp=#0x200000006dc' 2024-08-31T04:31:12.962 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10316 fp=#0x200000006e4' 2024-08-31T04:31:12.962 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10348 fp=#0x2000000090d' 2024-08-31T04:31:12.962 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10380 fp=#0x20000001516' 2024-08-31T04:31:12.963 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10412 fp=#0x200000014a8' 2024-08-31T04:31:12.963 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10476 fp=#0x10000000bc2' 2024-08-31T04:31:12.964 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10508 fp=#0x10000000c71' 2024-08-31T04:31:12.964 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10540 fp=#0x100000010fb' 2024-08-31T04:31:12.964 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10572 fp=#0x1000000114f' 2024-08-31T04:31:12.965 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10604 fp=#0x2000000206c' 2024-08-31T04:31:12.965 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10636 fp=#0x200000020c4' 2024-08-31T04:31:12.965 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10668 fp=#0x20000002048' 2024-08-31T04:31:12.966 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10700 fp=#0x2000000209a' 2024-08-31T04:31:12.967 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10828 fp=#0x1000000348f' 2024-08-31T04:31:12.967 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10860 fp=#0x200000005e9' 2024-08-31T04:31:12.967 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10892 fp=#0x20000000609' 2024-08-31T04:31:12.968 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10924 fp=#0x200000005da' 2024-08-31T04:31:12.968 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10956 fp=#0x10000003447' 2024-08-31T04:31:12.968 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10988 fp=#0x200000005e5' 2024-08-31T04:31:12.969 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11020 fp=#0x100000039fd' 2024-08-31T04:31:12.969 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11052 fp=#0x10000003bff' 2024-08-31T04:31:12.969 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11084 fp=#0x10000003b49' 2024-08-31T04:31:12.970 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11148 fp=#0x100000039f9' 2024-08-31T04:31:12.970 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11180 fp=#0x10000003bb6' 2024-08-31T04:31:12.971 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11212 fp=#0x100000039df' 2024-08-31T04:31:12.971 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11240 fp=#0x20000000e56' 2024-08-31T04:31:12.971 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11272 fp=#0x20000000e4e' 2024-08-31T04:31:12.972 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11304 fp=#0x20000000e3f' 2024-08-31T04:31:12.972 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11336 fp=#0x2000000192c' 2024-08-31T04:31:12.972 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11368 fp=#0x20000001991' 2024-08-31T04:31:12.973 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11400 fp=#0x2000000197e' 2024-08-31T04:31:12.973 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11432 fp=#0x20000001e0d' 2024-08-31T04:31:12.973 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11464 fp=#0x200000019ac' 2024-08-31T04:31:12.974 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11496 fp=#0x20000001932' 2024-08-31T04:31:12.974 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11528 fp=#0x10000004644' 2024-08-31T04:31:12.974 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11560 fp=#0x100000045fd' 2024-08-31T04:31:12.975 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11592 fp=#0x1000000459e' 2024-08-31T04:31:12.975 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11624 fp=#0x10000004624' 2024-08-31T04:31:12.975 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11656 fp=#0x2000000199b' 2024-08-31T04:31:12.976 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11688 fp=#0x20000000674' 2024-08-31T04:31:12.976 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11720 fp=#0x2000000198d' 2024-08-31T04:31:12.976 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11752 fp=#0x200000006b4' 2024-08-31T04:31:12.977 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11784 fp=#0x200000006cb' 2024-08-31T04:31:12.977 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11848 fp=#0x200000022df' 2024-08-31T04:31:12.978 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11880 fp=#0x20000000abf' 2024-08-31T04:31:12.978 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11912 fp=#0x20000000aa9' 2024-08-31T04:31:12.978 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11944 fp=#0x20000001646' 2024-08-31T04:31:12.979 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11976 fp=#0x20000000a78' 2024-08-31T04:31:12.979 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12008 fp=#0x20000001745' 2024-08-31T04:31:12.979 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12040 fp=#0x20000001699' 2024-08-31T04:31:12.980 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12072 fp=#0x200000016d4' 2024-08-31T04:31:12.980 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12136 fp=#0x20000001fb4' 2024-08-31T04:31:12.981 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12168 fp=#0x2000000150c' 2024-08-31T04:31:12.981 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12200 fp=#0x20000001fd7' 2024-08-31T04:31:12.982 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12360 fp=#0x200000010e5' 2024-08-31T04:31:12.982 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12392 fp=#0x20000001082' 2024-08-31T04:31:12.983 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12424 fp=#0x20000001038' 2024-08-31T04:31:12.983 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12456 fp=#0x20000001edd' 2024-08-31T04:31:12.983 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12488 fp=#0x20000001e9f' 2024-08-31T04:31:12.984 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12520 fp=#0x20000001eb9' 2024-08-31T04:31:12.984 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12552 fp=#0x200000009f7' 2024-08-31T04:31:12.984 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12584 fp=#0x20000000a06' 2024-08-31T04:31:12.985 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12616 fp=#0x20000000a22' 2024-08-31T04:31:12.985 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12648 fp=#0x200000009e2' 2024-08-31T04:31:12.985 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12680 fp=#0x20000000a58' 2024-08-31T04:31:12.986 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12712 fp=#0x20000000215' 2024-08-31T04:31:12.986 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12744 fp=#0x10000000f60' 2024-08-31T04:31:12.986 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12776 fp=#0x10000000f68' 2024-08-31T04:31:12.987 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12808 fp=#0x10000000ecd' 2024-08-31T04:31:12.987 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12840 fp=#0x200000003d9' 2024-08-31T04:31:12.987 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12872 fp=#0x10000002f45' 2024-08-31T04:31:12.988 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12904 fp=#0x200000020c3' 2024-08-31T04:31:12.988 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12936 fp=#0x20000002154' 2024-08-31T04:31:12.988 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12968 fp=#0x10000002eb3' 2024-08-31T04:31:12.989 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13000 fp=#0x200000020c6' 2024-08-31T04:31:12.989 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13031 fp=#0x200000007a2' 2024-08-31T04:31:12.989 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13063 fp=#0x20000000719' 2024-08-31T04:31:12.990 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13095 fp=#0x2000000077c' 2024-08-31T04:31:12.990 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13127 fp=#0x2000000071b' 2024-08-31T04:31:12.990 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13159 fp=#0x2000000073e' 2024-08-31T04:31:12.991 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13191 fp=#0x2000000076d' 2024-08-31T04:31:12.991 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13223 fp=#0x20000000bbb' 2024-08-31T04:31:12.991 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13255 fp=#0x20000000b8a' 2024-08-31T04:31:12.992 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13319 fp=#0x20000000bb3' 2024-08-31T04:31:12.992 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13351 fp=#0x20000000b86' 2024-08-31T04:31:12.993 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13383 fp=#0x20000001c6c' 2024-08-31T04:31:12.993 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13415 fp=#0x20000001d8c' 2024-08-31T04:31:12.993 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13447 fp=#0x20000001ccb' 2024-08-31T04:31:12.994 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13511 fp=#0x10000003b1a' 2024-08-31T04:31:12.995 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13602 fp=#0x2000000114f' 2024-08-31T04:31:12.995 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13634 fp=#0x20000002142' 2024-08-31T04:31:12.995 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13666 fp=#0x10000002e24' 2024-08-31T04:31:12.996 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13730 fp=#0x10000002e4d' 2024-08-31T04:31:12.996 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13762 fp=#0x10000002e6d' 2024-08-31T04:31:12.997 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13794 fp=#0x20000000835' 2024-08-31T04:31:12.997 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13826 fp=#0x200000015b9' 2024-08-31T04:31:12.997 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13858 fp=#0x20000000ce8' 2024-08-31T04:31:12.998 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13890 fp=#0x20000000d3b' 2024-08-31T04:31:12.998 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13922 fp=#0x2000000223f' 2024-08-31T04:31:12.998 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13954 fp=#0x20000000cea' 2024-08-31T04:31:12.999 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13986 fp=#0x20000000cd6' 2024-08-31T04:31:12.999 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14018 fp=#0x20000001a55' 2024-08-31T04:31:12.999 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14050 fp=#0x20000001a13' 2024-08-31T04:31:12.999 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14082 fp=#0x200000019cb' 2024-08-31T04:31:13.000 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14114 fp=#0x200000019ef' 2024-08-31T04:31:13.000 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14146 fp=#0x200000008c7' 2024-08-31T04:31:13.001 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14178 fp=#0x200000008bb' 2024-08-31T04:31:13.001 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14210 fp=#0x200000008e3' 2024-08-31T04:31:13.001 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14242 fp=#0x200000008cf' 2024-08-31T04:31:13.002 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14274 fp=#0x20000001ddd' 2024-08-31T04:31:13.002 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14338 fp=#0x20000001e23' 2024-08-31T04:31:13.003 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14370 fp=#0x20000001dc7' 2024-08-31T04:31:13.003 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14434 fp=#0x20000001916' 2024-08-31T04:31:13.004 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14466 fp=#0x200000018ff' 2024-08-31T04:31:13.004 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14498 fp=#0x20000001867' 2024-08-31T04:31:13.004 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14530 fp=#0x200000018e2' 2024-08-31T04:31:13.005 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14562 fp=#0x20000000f30' 2024-08-31T04:31:13.005 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14594 fp=#0x20000000efe' 2024-08-31T04:31:13.005 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14626 fp=#0x20000000f80' 2024-08-31T04:31:13.006 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14658 fp=#0x20000000f4d' 2024-08-31T04:31:13.006 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14690 fp=#0x20000000f1d' 2024-08-31T04:31:13.006 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14722 fp=#0x100000046d6' 2024-08-31T04:31:13.007 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14754 fp=#0x1000000464b' 2024-08-31T04:31:13.008 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14864 fp=#0x10000003105' 2024-08-31T04:31:13.008 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14896 fp=#0x10000003135' 2024-08-31T04:31:13.009 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14928 fp=#0x10000003113' 2024-08-31T04:31:13.009 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14960 fp=#0x100000058c2' 2024-08-31T04:31:13.009 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14992 fp=#0x200000017f4' 2024-08-31T04:31:13.010 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15024 fp=#0x200000017eb' 2024-08-31T04:31:13.010 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15056 fp=#0x20000001720' 2024-08-31T04:31:13.010 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15088 fp=#0x20000001785' 2024-08-31T04:31:13.010 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15120 fp=#0x2000000174a' 2024-08-31T04:31:13.011 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15151 fp=#0x200000021c2' 2024-08-31T04:31:13.011 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15183 fp=#0x100000057a5' 2024-08-31T04:31:13.012 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15215 fp=#0x100000017a7' 2024-08-31T04:31:13.012 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15247 fp=#0x1000000172d' 2024-08-31T04:31:13.012 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15279 fp=#0x20000002268' 2024-08-31T04:31:13.012 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15311 fp=#0x200000021ed' 2024-08-31T04:31:13.013 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15343 fp=#0x200000021c4' 2024-08-31T04:31:13.014 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15471 fp=#0x2000000207c' 2024-08-31T04:31:13.014 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15503 fp=#0x200000019fb' 2024-08-31T04:31:13.014 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15535 fp=#0x1000000534d' 2024-08-31T04:31:13.015 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15567 fp=#0x1000000533c' 2024-08-31T04:31:13.015 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15599 fp=#0x10000005346' 2024-08-31T04:31:13.015 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15631 fp=#0x10000004e6c' 2024-08-31T04:31:13.016 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15663 fp=#0x10000004e18' 2024-08-31T04:31:13.016 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15695 fp=#0x10000004ea6' 2024-08-31T04:31:13.017 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15727 fp=#0x10000004eaf' 2024-08-31T04:31:13.017 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15759 fp=#0x20000002009' 2024-08-31T04:31:13.018 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15887 fp=#0x20000001ffe' 2024-08-31T04:31:13.019 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15983 fp=#0x20000001ff0' 2024-08-31T04:31:13.019 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16015 fp=#0x20000000eac' 2024-08-31T04:31:13.019 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16047 fp=#0x20000000eb7' 2024-08-31T04:31:13.020 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16079 fp=#0x20000001936' 2024-08-31T04:31:13.020 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16111 fp=#0x2000000116f' 2024-08-31T04:31:13.020 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16143 fp=#0x2000000119e' 2024-08-31T04:31:13.020 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16175 fp=#0x20000001602' 2024-08-31T04:31:13.021 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16207 fp=#0x200000015d8' 2024-08-31T04:31:13.021 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16239 fp=#0x200000015ea' 2024-08-31T04:31:13.021 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16271 fp=#0x20000001605' 2024-08-31T04:31:13.022 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16302 fp=#0x100000047df' 2024-08-31T04:31:13.022 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16334 fp=#0x10000004519' 2024-08-31T04:31:13.024 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16366 fp=#0x1000000489d' 2024-08-31T04:31:13.024 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16398 fp=#0x100000044dc' 2024-08-31T04:31:13.025 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16430 fp=#0x1000000450f' 2024-08-31T04:31:13.025 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16462 fp=#0x100000044fa' 2024-08-31T04:31:13.026 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16494 fp=#0x10000004ded' 2024-08-31T04:31:13.026 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16526 fp=#0x200000011a3' 2024-08-31T04:31:13.026 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16558 fp=#0x2000000187c' 2024-08-31T04:31:13.026 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16590 fp=#0x1000000582b' 2024-08-31T04:31:13.027 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16622 fp=#0x2000000228f' 2024-08-31T04:31:13.027 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16654 fp=#0x2000000228e' 2024-08-31T04:31:13.027 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16686 fp=#0x20000000445' 2024-08-31T04:31:13.028 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16718 fp=#0x10000002ac9' 2024-08-31T04:31:13.028 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16750 fp=#0x2000000041c' 2024-08-31T04:31:13.028 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16782 fp=#0x20000000400' 2024-08-31T04:31:13.029 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16814 fp=#0x10000002a88' 2024-08-31T04:31:13.029 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16846 fp=#0x2000000041f' 2024-08-31T04:31:13.029 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16878 fp=#0x200000011b2' 2024-08-31T04:31:13.030 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16910 fp=#0x10000005d49' 2024-08-31T04:31:13.030 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16942 fp=#0x10000004572' 2024-08-31T04:31:13.030 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16974 fp=#0x10000005d47' 2024-08-31T04:31:13.031 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17102 fp=#0x10000005794' 2024-08-31T04:31:13.032 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17166 fp=#0x10000005734' 2024-08-31T04:31:13.032 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17198 fp=#0x100000054e4' 2024-08-31T04:31:13.033 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17230 fp=#0x100000054d9' 2024-08-31T04:31:13.034 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17326 fp=#0x10000005469' 2024-08-31T04:31:13.034 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17358 fp=#0x20000001a62' 2024-08-31T04:31:13.034 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17390 fp=#0x20000001ad0' 2024-08-31T04:31:13.035 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17422 fp=#0x20000001aad' 2024-08-31T04:31:13.035 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17454 fp=#0x10000004dad' 2024-08-31T04:31:13.035 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17486 fp=#0x10000004dd4' 2024-08-31T04:31:13.036 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17518 fp=#0x10000004d72' 2024-08-31T04:31:13.036 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17550 fp=#0x20000001b68' 2024-08-31T04:31:13.036 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17582 fp=#0x20000001b23' 2024-08-31T04:31:13.036 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17614 fp=#0x100000029d1' 2024-08-31T04:31:13.037 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17646 fp=#0x100000029fe' 2024-08-31T04:31:13.037 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17678 fp=#0x100000029cf' 2024-08-31T04:31:13.037 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17710 fp=#0x20000001f1a' 2024-08-31T04:31:13.038 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17742 fp=#0x10000002a3e' 2024-08-31T04:31:13.038 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17774 fp=#0x10000004ef4' 2024-08-31T04:31:13.038 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17806 fp=#0x10000004eff' 2024-08-31T04:31:13.039 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17838 fp=#0x10000004f10' 2024-08-31T04:31:13.040 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17966 fp=#0x20000001caa' 2024-08-31T04:31:13.040 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17998 fp=#0x20000001ccc' 2024-08-31T04:31:13.040 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18030 fp=#0x20000001ce4' 2024-08-31T04:31:13.041 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18062 fp=#0x20000001c52' 2024-08-31T04:31:13.041 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18094 fp=#0x20000001767' 2024-08-31T04:31:13.042 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18126 fp=#0x200000016fc' 2024-08-31T04:31:13.042 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18158 fp=#0x20000000c2b' 2024-08-31T04:31:13.042 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18190 fp=#0x20000000c90' 2024-08-31T04:31:13.042 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18222 fp=#0x20000000c82' 2024-08-31T04:31:13.043 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18254 fp=#0x20000000ce3' 2024-08-31T04:31:13.043 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18283 fp=#0x10000004a3a' 2024-08-31T04:31:13.043 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18315 fp=#0x20000000853' 2024-08-31T04:31:13.044 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18347 fp=#0x10000004941' 2024-08-31T04:31:13.044 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18379 fp=#0x20000000855' 2024-08-31T04:31:13.044 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18406 fp=#0x20000002241' 2024-08-31T04:31:13.045 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18438 fp=#0x2000000216e' 2024-08-31T04:31:13.045 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18470 fp=#0x200000021a9' 2024-08-31T04:31:13.045 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18502 fp=#0x20000002174' 2024-08-31T04:31:13.046 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18532 fp=#0x100000036e0' 2024-08-31T04:31:13.046 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18564 fp=#0x100000035df' 2024-08-31T04:31:13.046 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:7159 fp=#0x1' 2024-08-31T04:31:13.047 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:7191 fp=#0x10000004906' 2024-08-31T04:31:13.047 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:7223 fp=#0x20000001804' 2024-08-31T04:31:13.048 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:7287 fp=#0x10000005461' 2024-08-31T04:31:13.049 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:7383 fp=#0x20000001fee' 2024-08-31T04:31:13.049 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:7415 fp=#0x20000001fd6' 2024-08-31T04:31:13.060 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:8910 fp=#0x20000000687' 2024-08-31T04:31:13.060 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:8942 fp=#0x20000000630' 2024-08-31T04:31:13.061 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:8974 fp=#0x20000000636' 2024-08-31T04:31:13.062 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9102 fp=#0x20000000890' 2024-08-31T04:31:13.062 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9134 fp=#0x20000001caf' 2024-08-31T04:31:13.062 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9166 fp=#0x20000001d74' 2024-08-31T04:31:13.063 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9198 fp=#0x20000001cc6' 2024-08-31T04:31:13.063 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9262 fp=#0x20000001b34' 2024-08-31T04:31:13.064 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9390 fp=#0x20000001068' 2024-08-31T04:31:13.065 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9422 fp=#0x2000000099c' 2024-08-31T04:31:13.065 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9454 fp=#0x2000000096b' 2024-08-31T04:31:13.065 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9486 fp=#0x2000000156b' 2024-08-31T04:31:13.066 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9518 fp=#0x20000000973' 2024-08-31T04:31:13.066 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9550 fp=#0x2000000097e' 2024-08-31T04:31:13.067 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9678 fp=#0x20000000b02' 2024-08-31T04:31:13.067 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9710 fp=#0x20000000b3a' 2024-08-31T04:31:13.068 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9742 fp=#0x20000000b2e' 2024-08-31T04:31:13.068 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9774 fp=#0x20000000b35' 2024-08-31T04:31:13.068 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9806 fp=#0x20000001f7e' 2024-08-31T04:31:13.069 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9838 fp=#0x20000001e52' 2024-08-31T04:31:13.069 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9870 fp=#0x20000001e72' 2024-08-31T04:31:13.069 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9902 fp=#0x20000001ede' 2024-08-31T04:31:13.071 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10061 fp=#0x20000000e2e' 2024-08-31T04:31:13.071 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10093 fp=#0x20000000d50' 2024-08-31T04:31:13.071 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10125 fp=#0x20000000de8' 2024-08-31T04:31:13.072 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10157 fp=#0x20000000e22' 2024-08-31T04:31:13.072 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10189 fp=#0x200000006e3' 2024-08-31T04:31:13.072 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10221 fp=#0x20000000fef' 2024-08-31T04:31:13.073 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10253 fp=#0x2000000101b' 2024-08-31T04:31:13.073 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10285 fp=#0x20000001c25' 2024-08-31T04:31:13.073 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10317 fp=#0x20000002041' 2024-08-31T04:31:13.074 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10349 fp=#0x20000000921' 2024-08-31T04:31:13.074 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10381 fp=#0x200000014c3' 2024-08-31T04:31:13.074 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10413 fp=#0x20000000923' 2024-08-31T04:31:13.075 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10445 fp=#0x20000001501' 2024-08-31T04:31:13.075 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10477 fp=#0x10000000bb6' 2024-08-31T04:31:13.075 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10509 fp=#0x10000000be5' 2024-08-31T04:31:13.076 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10541 fp=#0x1000000476a' 2024-08-31T04:31:13.076 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10573 fp=#0x10000000bdc' 2024-08-31T04:31:13.076 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10605 fp=#0x200000020ef' 2024-08-31T04:31:13.076 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10637 fp=#0x200000020d9' 2024-08-31T04:31:13.077 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10669 fp=#0x200000020a2' 2024-08-31T04:31:13.077 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10701 fp=#0x200000020d0' 2024-08-31T04:31:13.078 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10829 fp=#0x2000000060d' 2024-08-31T04:31:13.078 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10861 fp=#0x200000005ea' 2024-08-31T04:31:13.079 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10893 fp=#0x200000005ed' 2024-08-31T04:31:13.079 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10925 fp=#0x100000033eb' 2024-08-31T04:31:13.080 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11053 fp=#0x10000003b9e' 2024-08-31T04:31:13.080 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11085 fp=#0x10000003cc8' 2024-08-31T04:31:13.081 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11117 fp=#0x100000039b3' 2024-08-31T04:31:13.081 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11149 fp=#0x10000003bdb' 2024-08-31T04:31:13.082 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11181 fp=#0x10000003c36' 2024-08-31T04:31:13.082 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11241 fp=#0x20000000e98' 2024-08-31T04:31:13.082 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11273 fp=#0x20000000e9b' 2024-08-31T04:31:13.083 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11305 fp=#0x20000000e5d' 2024-08-31T04:31:13.083 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11337 fp=#0x200000018e4' 2024-08-31T04:31:13.083 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11369 fp=#0x20000001971' 2024-08-31T04:31:13.084 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11401 fp=#0x20000001ece' 2024-08-31T04:31:13.084 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11433 fp=#0x200000019b0' 2024-08-31T04:31:13.084 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11465 fp=#0x2000000196a' 2024-08-31T04:31:13.085 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11497 fp=#0x20000001df7' 2024-08-31T04:31:13.085 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11529 fp=#0x10000004594' 2024-08-31T04:31:13.085 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11561 fp=#0x1000000465a' 2024-08-31T04:31:13.086 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11593 fp=#0x1000000459c' 2024-08-31T04:31:13.086 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11625 fp=#0x1000000464a' 2024-08-31T04:31:13.086 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11657 fp=#0x2000000198f' 2024-08-31T04:31:13.087 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11689 fp=#0x200000006be' 2024-08-31T04:31:13.087 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11721 fp=#0x20000002151' 2024-08-31T04:31:13.087 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11753 fp=#0x20000000697' 2024-08-31T04:31:13.088 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11817 fp=#0x20000000689' 2024-08-31T04:31:13.088 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11849 fp=#0x200000022d8' 2024-08-31T04:31:13.089 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11881 fp=#0x20000000aa0' 2024-08-31T04:31:13.089 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11913 fp=#0x20000000a7f' 2024-08-31T04:31:13.089 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11945 fp=#0x20000000aac' 2024-08-31T04:31:13.090 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11977 fp=#0x20000000a7b' 2024-08-31T04:31:13.090 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12009 fp=#0x20000001742' 2024-08-31T04:31:13.090 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12041 fp=#0x200000016a6' 2024-08-31T04:31:13.090 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12073 fp=#0x200000016bd' 2024-08-31T04:31:13.091 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12137 fp=#0x200000012e3' 2024-08-31T04:31:13.091 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12169 fp=#0x2000000150e' 2024-08-31T04:31:13.092 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12201 fp=#0x20000001512' 2024-08-31T04:31:13.093 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12361 fp=#0x20000001066' 2024-08-31T04:31:13.093 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12393 fp=#0x2000000108c' 2024-08-31T04:31:13.093 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12425 fp=#0x20000001089' 2024-08-31T04:31:13.094 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12457 fp=#0x20000001f43' 2024-08-31T04:31:13.094 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12489 fp=#0x20000001ebe' 2024-08-31T04:31:13.094 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12521 fp=#0x200000009fd' 2024-08-31T04:31:13.095 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12553 fp=#0x200000009fa' 2024-08-31T04:31:13.095 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12585 fp=#0x20000000a32' 2024-08-31T04:31:13.095 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12617 fp=#0x20000000a07' 2024-08-31T04:31:13.096 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12649 fp=#0x200000009d7' 2024-08-31T04:31:13.096 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12681 fp=#0x200000009f9' 2024-08-31T04:31:13.097 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12713 fp=#0x10000000d8a' 2024-08-31T04:31:13.097 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12745 fp=#0x10000000f86' 2024-08-31T04:31:13.097 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12777 fp=#0x10000000e87' 2024-08-31T04:31:13.098 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12809 fp=#0x10000000e63' 2024-08-31T04:31:13.098 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12841 fp=#0x10000000d6a' 2024-08-31T04:31:13.099 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12905 fp=#0x200000020db' 2024-08-31T04:31:13.099 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12937 fp=#0x10000002e8f' 2024-08-31T04:31:13.099 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12969 fp=#0x200000020cd' 2024-08-31T04:31:13.099 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13001 fp=#0x2000000212b' 2024-08-31T04:31:13.100 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13032 fp=#0x2000000070d' 2024-08-31T04:31:13.100 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13064 fp=#0x2000000073f' 2024-08-31T04:31:13.101 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13096 fp=#0x20000000796' 2024-08-31T04:31:13.101 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13128 fp=#0x20000000771' 2024-08-31T04:31:13.101 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13160 fp=#0x20000000768' 2024-08-31T04:31:13.102 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13192 fp=#0x20000000715' 2024-08-31T04:31:13.102 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13224 fp=#0x20000000bf1' 2024-08-31T04:31:13.102 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13256 fp=#0x20000000b65' 2024-08-31T04:31:13.103 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13288 fp=#0x20000000bbc' 2024-08-31T04:31:13.103 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13320 fp=#0x20000000bc0' 2024-08-31T04:31:13.103 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13352 fp=#0x20000000baf' 2024-08-31T04:31:13.103 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13384 fp=#0x20000001c73' 2024-08-31T04:31:13.104 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13416 fp=#0x20000001d6f' 2024-08-31T04:31:13.104 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13448 fp=#0x20000001c3d' 2024-08-31T04:31:13.105 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13480 fp=#0x10000003b3b' 2024-08-31T04:31:13.105 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13539 fp=#0x20000001155' 2024-08-31T04:31:13.105 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13571 fp=#0x20000002113' 2024-08-31T04:31:13.106 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13667 fp=#0x10000002e70' 2024-08-31T04:31:13.106 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13699 fp=#0x10000002eee' 2024-08-31T04:31:13.107 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13731 fp=#0x10000002e1d' 2024-08-31T04:31:13.107 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13763 fp=#0x10000002f22' 2024-08-31T04:31:13.107 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13795 fp=#0x20000000846' 2024-08-31T04:31:13.108 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13827 fp=#0x200000015e0' 2024-08-31T04:31:13.108 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13859 fp=#0x20000000dc5' 2024-08-31T04:31:13.108 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13891 fp=#0x2000000222a' 2024-08-31T04:31:13.108 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13923 fp=#0x20000000cab' 2024-08-31T04:31:13.109 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13955 fp=#0x20000000da5' 2024-08-31T04:31:13.109 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13987 fp=#0x20000000d0a' 2024-08-31T04:31:13.109 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14019 fp=#0x20000001a5e' 2024-08-31T04:31:13.110 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14051 fp=#0x20000001a42' 2024-08-31T04:31:13.110 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14083 fp=#0x200000019e9' 2024-08-31T04:31:13.110 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14115 fp=#0x200000019fa' 2024-08-31T04:31:13.111 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14147 fp=#0x20000000950' 2024-08-31T04:31:13.111 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14179 fp=#0x200000008c8' 2024-08-31T04:31:13.111 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14211 fp=#0x200000008bd' 2024-08-31T04:31:13.112 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14243 fp=#0x200000008e7' 2024-08-31T04:31:13.112 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14275 fp=#0x20000001dbb' 2024-08-31T04:31:13.113 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14307 fp=#0x20000001d9d' 2024-08-31T04:31:13.113 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14339 fp=#0x20000001dd7' 2024-08-31T04:31:13.113 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14403 fp=#0x20000001daf' 2024-08-31T04:31:13.114 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14435 fp=#0x20000001870' 2024-08-31T04:31:13.114 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14467 fp=#0x20000001890' 2024-08-31T04:31:13.114 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14499 fp=#0x20000001819' 2024-08-31T04:31:13.115 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14531 fp=#0x20000001839' 2024-08-31T04:31:13.115 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14563 fp=#0x20000000f18' 2024-08-31T04:31:13.115 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14595 fp=#0x20000000f66' 2024-08-31T04:31:13.116 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14627 fp=#0x20000000fbb' 2024-08-31T04:31:13.116 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14659 fp=#0x20000000f27' 2024-08-31T04:31:13.116 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14691 fp=#0x20000000f06' 2024-08-31T04:31:13.117 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14755 fp=#0x10000004653' 2024-08-31T04:31:13.118 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14865 fp=#0x100000031f5' 2024-08-31T04:31:13.118 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14897 fp=#0x10000003106' 2024-08-31T04:31:13.118 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14929 fp=#0x1000000315f' 2024-08-31T04:31:13.119 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14961 fp=#0x10000005897' 2024-08-31T04:31:13.119 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14993 fp=#0x200000017e9' 2024-08-31T04:31:13.119 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15025 fp=#0x20000001795' 2024-08-31T04:31:13.120 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15057 fp=#0x200000017a6' 2024-08-31T04:31:13.120 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15089 fp=#0x2000000177d' 2024-08-31T04:31:13.120 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15121 fp=#0x2000000174f' 2024-08-31T04:31:13.121 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15152 fp=#0x100000057a2' 2024-08-31T04:31:13.121 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15184 fp=#0x100000057b7' 2024-08-31T04:31:13.122 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15216 fp=#0x10000001719' 2024-08-31T04:31:13.122 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15248 fp=#0x10000001742' 2024-08-31T04:31:13.122 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15280 fp=#0x200000021e3' 2024-08-31T04:31:13.122 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15312 fp=#0x2000000225b' 2024-08-31T04:31:13.123 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15344 fp=#0x20000002240' 2024-08-31T04:31:13.123 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15408 fp=#0x20000002059' 2024-08-31T04:31:13.124 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15472 fp=#0x20000001cb8' 2024-08-31T04:31:13.124 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15504 fp=#0x20000001a12' 2024-08-31T04:31:13.125 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15536 fp=#0x20000001a0d' 2024-08-31T04:31:13.125 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15568 fp=#0x2000000163d' 2024-08-31T04:31:13.125 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15600 fp=#0x20000001a05' 2024-08-31T04:31:13.126 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15632 fp=#0x10000004e14' 2024-08-31T04:31:13.126 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15664 fp=#0x10000004e37' 2024-08-31T04:31:13.126 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15696 fp=#0x10000004eaa' 2024-08-31T04:31:13.127 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15728 fp=#0x10000004ea8' 2024-08-31T04:31:13.127 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15792 fp=#0x20000001fcc' 2024-08-31T04:31:13.128 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15856 fp=#0x2000000200e' 2024-08-31T04:31:13.128 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15888 fp=#0x2000000200c' 2024-08-31T04:31:13.129 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15984 fp=#0x20000001fb1' 2024-08-31T04:31:13.129 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16016 fp=#0x20000000ea8' 2024-08-31T04:31:13.130 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16048 fp=#0x20000000eaa' 2024-08-31T04:31:13.130 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16080 fp=#0x200000017d1' 2024-08-31T04:31:13.130 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16112 fp=#0x20000001117' 2024-08-31T04:31:13.131 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16144 fp=#0x20000001123' 2024-08-31T04:31:13.131 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16176 fp=#0x2000000159b' 2024-08-31T04:31:13.131 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16208 fp=#0x200000015f6' 2024-08-31T04:31:13.132 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16240 fp=#0x200000015a0' 2024-08-31T04:31:13.132 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16272 fp=#0x200000015b8' 2024-08-31T04:31:13.132 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16303 fp=#0x10000004532' 2024-08-31T04:31:13.133 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16335 fp=#0x100000044eb' 2024-08-31T04:31:13.133 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16367 fp=#0x1000000483b' 2024-08-31T04:31:13.133 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16399 fp=#0x1000000451d' 2024-08-31T04:31:13.134 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16431 fp=#0x100000044f8' 2024-08-31T04:31:13.134 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16463 fp=#0x10000004513' 2024-08-31T04:31:13.134 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16495 fp=#0x1000000495a' 2024-08-31T04:31:13.135 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16527 fp=#0x10000004de6' 2024-08-31T04:31:13.135 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16559 fp=#0x1000000492d' 2024-08-31T04:31:13.135 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16591 fp=#0x100000048d8' 2024-08-31T04:31:13.136 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16623 fp=#0x200000022b3' 2024-08-31T04:31:13.136 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16655 fp=#0x200000022b6' 2024-08-31T04:31:13.136 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16687 fp=#0x2000000043c' 2024-08-31T04:31:13.137 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16719 fp=#0x2000000040a' 2024-08-31T04:31:13.137 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16751 fp=#0x2000000040e' 2024-08-31T04:31:13.137 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16783 fp=#0x10000002ade' 2024-08-31T04:31:13.138 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16815 fp=#0x20000000401' 2024-08-31T04:31:13.138 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16847 fp=#0x200000003f9' 2024-08-31T04:31:13.138 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16879 fp=#0x100000045b2' 2024-08-31T04:31:13.138 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16911 fp=#0x10000005d46' 2024-08-31T04:31:13.139 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16943 fp=#0x10000004579' 2024-08-31T04:31:13.139 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16975 fp=#0x10000005d42' 2024-08-31T04:31:13.140 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17103 fp=#0x10000005726' 2024-08-31T04:31:13.141 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17167 fp=#0x1000000578e' 2024-08-31T04:31:13.141 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17199 fp=#0x100000054df' 2024-08-31T04:31:13.141 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17231 fp=#0x100000054d0' 2024-08-31T04:31:13.142 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17263 fp=#0x10000005471' 2024-08-31T04:31:13.142 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17295 fp=#0x1000000547d' 2024-08-31T04:31:13.142 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17327 fp=#0x10000005481' 2024-08-31T04:31:13.143 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17359 fp=#0x20000001ab7' 2024-08-31T04:31:13.143 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17391 fp=#0x20000001a9a' 2024-08-31T04:31:13.143 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17423 fp=#0x20000001aa6' 2024-08-31T04:31:13.144 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17455 fp=#0x10000004d75' 2024-08-31T04:31:13.144 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17487 fp=#0x10000004d82' 2024-08-31T04:31:13.144 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17519 fp=#0x10000004d53' 2024-08-31T04:31:13.145 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17551 fp=#0x20000001af4' 2024-08-31T04:31:13.145 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17583 fp=#0x20000001b3d' 2024-08-31T04:31:13.145 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17615 fp=#0x10000002a56' 2024-08-31T04:31:13.146 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17647 fp=#0x20000001f23' 2024-08-31T04:31:13.146 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17679 fp=#0x20000001f5d' 2024-08-31T04:31:13.146 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17711 fp=#0x20000001f1f' 2024-08-31T04:31:13.147 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17743 fp=#0x20000001f5a' 2024-08-31T04:31:13.147 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17775 fp=#0x10000004f32' 2024-08-31T04:31:13.147 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17807 fp=#0x10000004f1f' 2024-08-31T04:31:13.148 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17839 fp=#0x10000004ef6' 2024-08-31T04:31:13.148 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17935 fp=#0x1000000116b' 2024-08-31T04:31:13.149 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17967 fp=#0x20000001d5f' 2024-08-31T04:31:13.149 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17999 fp=#0x20000001c35' 2024-08-31T04:31:13.149 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18031 fp=#0x20000001c71' 2024-08-31T04:31:13.150 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18063 fp=#0x20000001c60' 2024-08-31T04:31:13.150 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18095 fp=#0x2000000178c' 2024-08-31T04:31:13.150 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18127 fp=#0x20000001d73' 2024-08-31T04:31:13.151 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18159 fp=#0x20000000cfa' 2024-08-31T04:31:13.151 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18191 fp=#0x20000000c33' 2024-08-31T04:31:13.151 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18223 fp=#0x20000000c43' 2024-08-31T04:31:13.151 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18255 fp=#0x20000000c72' 2024-08-31T04:31:13.152 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18284 fp=#0x20000000851' 2024-08-31T04:31:13.152 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18316 fp=#0x100000049e4' 2024-08-31T04:31:13.152 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18348 fp=#0x10000004931' 2024-08-31T04:31:13.153 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18380 fp=#0x200000022dc' 2024-08-31T04:31:13.153 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18407 fp=#0x2000000225c' 2024-08-31T04:31:13.153 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18439 fp=#0x20000002178' 2024-08-31T04:31:13.154 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18471 fp=#0x2000000219b' 2024-08-31T04:31:13.154 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18503 fp=#0x2000000220d' 2024-08-31T04:31:13.154 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18533 fp=#0x10000003604' 2024-08-31T04:31:13.155 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18565 fp=#0x100000035dc' 2024-08-31T04:31:13.155 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:7160 fp=#0x10000000000' 2024-08-31T04:31:13.155 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:7192 fp=#0x2000000203d' 2024-08-31T04:31:13.155 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:7224 fp=#0x20000000efd' 2024-08-31T04:31:13.158 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:7288 fp=#0x20000001a5f' 2024-08-31T04:31:13.159 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:7384 fp=#0x20000001f8b' 2024-08-31T04:31:13.160 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:7448 fp=#0x20000001f84' 2024-08-31T04:31:13.169 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:8664 fp=#0x20000000ad9' 2024-08-31T04:31:13.171 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:8911 fp=#0x20000000672' 2024-08-31T04:31:13.172 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:8975 fp=#0x2000000061f' 2024-08-31T04:31:13.172 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9007 fp=#0x20000001843' 2024-08-31T04:31:13.173 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9039 fp=#0x20000000f6b' 2024-08-31T04:31:13.173 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9103 fp=#0x20000001cee' 2024-08-31T04:31:13.174 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9135 fp=#0x2000000088c' 2024-08-31T04:31:13.174 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9167 fp=#0x20000001d68' 2024-08-31T04:31:13.174 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9199 fp=#0x20000001d93' 2024-08-31T04:31:13.174 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9231 fp=#0x20000000866' 2024-08-31T04:31:13.176 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9391 fp=#0x2000000095e' 2024-08-31T04:31:13.176 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9423 fp=#0x200000009a9' 2024-08-31T04:31:13.176 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9455 fp=#0x20000001578' 2024-08-31T04:31:13.177 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9487 fp=#0x20000001572' 2024-08-31T04:31:13.177 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9519 fp=#0x2000000155e' 2024-08-31T04:31:13.177 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9551 fp=#0x200000009ba' 2024-08-31T04:31:13.178 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9583 fp=#0x2000000149a' 2024-08-31T04:31:13.178 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9615 fp=#0x200000018a4' 2024-08-31T04:31:13.179 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9679 fp=#0x20000001f7a' 2024-08-31T04:31:13.179 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9711 fp=#0x20000000b48' 2024-08-31T04:31:13.179 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9743 fp=#0x20000000b23' 2024-08-31T04:31:13.180 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9775 fp=#0x20000000b10' 2024-08-31T04:31:13.180 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9807 fp=#0x20000001f6c' 2024-08-31T04:31:13.180 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9839 fp=#0x20000001e5a' 2024-08-31T04:31:13.181 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9871 fp=#0x20000001f1c' 2024-08-31T04:31:13.181 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9903 fp=#0x20000001ecf' 2024-08-31T04:31:13.182 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10062 fp=#0x20000000de7' 2024-08-31T04:31:13.182 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10094 fp=#0x20000000db4' 2024-08-31T04:31:13.183 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10126 fp=#0x20000000e09' 2024-08-31T04:31:13.183 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10158 fp=#0x20000000d6f' 2024-08-31T04:31:13.183 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10190 fp=#0x20000001076' 2024-08-31T04:31:13.184 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10222 fp=#0x200000006f9' 2024-08-31T04:31:13.184 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10254 fp=#0x20000000fc8' 2024-08-31T04:31:13.184 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10286 fp=#0x20000001039' 2024-08-31T04:31:13.185 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10318 fp=#0x20000001013' 2024-08-31T04:31:13.185 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10350 fp=#0x20000000915' 2024-08-31T04:31:13.185 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10382 fp=#0x2000000093f' 2024-08-31T04:31:13.186 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10414 fp=#0x20000000901' 2024-08-31T04:31:13.186 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10446 fp=#0x200000014ed' 2024-08-31T04:31:13.186 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10478 fp=#0x10000000b59' 2024-08-31T04:31:13.187 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10510 fp=#0x10000000c07' 2024-08-31T04:31:13.187 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10542 fp=#0x10000003ca9' 2024-08-31T04:31:13.187 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10574 fp=#0x200000020fa' 2024-08-31T04:31:13.188 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10606 fp=#0x200000020e4' 2024-08-31T04:31:13.188 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10638 fp=#0x200000020bc' 2024-08-31T04:31:13.188 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10670 fp=#0x2000000206b' 2024-08-31T04:31:13.189 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10702 fp=#0x20000002054' 2024-08-31T04:31:13.190 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10830 fp=#0x20000000604' 2024-08-31T04:31:13.190 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10862 fp=#0x10000003463' 2024-08-31T04:31:13.190 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10894 fp=#0x20000000607' 2024-08-31T04:31:13.191 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10926 fp=#0x100000033ea' 2024-08-31T04:31:13.191 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10958 fp=#0x10000003479' 2024-08-31T04:31:13.191 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10990 fp=#0x10000003bd6' 2024-08-31T04:31:13.192 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11022 fp=#0x1000000398e' 2024-08-31T04:31:13.192 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11054 fp=#0x100000039ab' 2024-08-31T04:31:13.192 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11086 fp=#0x10000003d16' 2024-08-31T04:31:13.193 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11150 fp=#0x10000003b62' 2024-08-31T04:31:13.193 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11182 fp=#0x10000003d5b' 2024-08-31T04:31:13.194 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11214 fp=#0x10000003b8c' 2024-08-31T04:31:13.194 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11242 fp=#0x20000000e3e' 2024-08-31T04:31:13.194 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11274 fp=#0x20000000e93' 2024-08-31T04:31:13.195 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11306 fp=#0x20000000e83' 2024-08-31T04:31:13.195 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11338 fp=#0x20000001dee' 2024-08-31T04:31:13.195 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11370 fp=#0x20000001ec5' 2024-08-31T04:31:13.195 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11402 fp=#0x2000000190d' 2024-08-31T04:31:13.196 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11434 fp=#0x20000001975' 2024-08-31T04:31:13.196 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11466 fp=#0x200000019af' 2024-08-31T04:31:13.196 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11498 fp=#0x200000018f0' 2024-08-31T04:31:13.197 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11530 fp=#0x100000045c2' 2024-08-31T04:31:13.197 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11562 fp=#0x10000004634' 2024-08-31T04:31:13.197 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11594 fp=#0x1000000463d' 2024-08-31T04:31:13.198 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11626 fp=#0x100000045cd' 2024-08-31T04:31:13.198 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11658 fp=#0x2000000064b' 2024-08-31T04:31:13.199 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11754 fp=#0x20000001977' 2024-08-31T04:31:13.199 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11786 fp=#0x20000000680' 2024-08-31T04:31:13.200 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11850 fp=#0x200000022ef' 2024-08-31T04:31:13.200 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11882 fp=#0x20000000ac1' 2024-08-31T04:31:13.200 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11914 fp=#0x20000000a8a' 2024-08-31T04:31:13.201 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11946 fp=#0x20000000a91' 2024-08-31T04:31:13.201 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11978 fp=#0x20000000a93' 2024-08-31T04:31:13.201 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12010 fp=#0x20000001764' 2024-08-31T04:31:13.202 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12042 fp=#0x200000016b3' 2024-08-31T04:31:13.202 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12074 fp=#0x200000016ab' 2024-08-31T04:31:13.204 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12266 fp=#0x200000014f1' 2024-08-31T04:31:13.204 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12298 fp=#0x200000014c1' 2024-08-31T04:31:13.204 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12330 fp=#0x20000001fd4' 2024-08-31T04:31:13.205 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12362 fp=#0x200000010e0' 2024-08-31T04:31:13.205 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12394 fp=#0x2000000109e' 2024-08-31T04:31:13.205 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12426 fp=#0x20000001096' 2024-08-31T04:31:13.205 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12458 fp=#0x20000001f2b' 2024-08-31T04:31:13.206 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12490 fp=#0x20000001f41' 2024-08-31T04:31:13.206 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12522 fp=#0x20000000a6b' 2024-08-31T04:31:13.206 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12554 fp=#0x20000000a20' 2024-08-31T04:31:13.207 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12586 fp=#0x20000000a36' 2024-08-31T04:31:13.207 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12618 fp=#0x20000000a61' 2024-08-31T04:31:13.207 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12650 fp=#0x20000000a10' 2024-08-31T04:31:13.208 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12682 fp=#0x20000000a48' 2024-08-31T04:31:13.208 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12714 fp=#0x2000000021b' 2024-08-31T04:31:13.208 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12746 fp=#0x200000003e1' 2024-08-31T04:31:13.209 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12778 fp=#0x200000003b9' 2024-08-31T04:31:13.209 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12810 fp=#0x200000003c1' 2024-08-31T04:31:13.209 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12842 fp=#0x10000000d18' 2024-08-31T04:31:13.210 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12874 fp=#0x20000002155' 2024-08-31T04:31:13.210 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12906 fp=#0x10000002ea6' 2024-08-31T04:31:13.210 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12938 fp=#0x2000000215c' 2024-08-31T04:31:13.211 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12970 fp=#0x10000002e95' 2024-08-31T04:31:13.211 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13002 fp=#0x200000020e7' 2024-08-31T04:31:13.211 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13033 fp=#0x20000000746' 2024-08-31T04:31:13.212 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13065 fp=#0x20000000797' 2024-08-31T04:31:13.212 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13097 fp=#0x2000000071f' 2024-08-31T04:31:13.212 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13129 fp=#0x2000000078b' 2024-08-31T04:31:13.213 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13161 fp=#0x20000000775' 2024-08-31T04:31:13.213 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13193 fp=#0x200000007a4' 2024-08-31T04:31:13.213 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13225 fp=#0x20000000bfa' 2024-08-31T04:31:13.214 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13257 fp=#0x20000000b91' 2024-08-31T04:31:13.214 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13289 fp=#0x20000000bd3' 2024-08-31T04:31:13.214 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13321 fp=#0x20000000b71' 2024-08-31T04:31:13.214 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13353 fp=#0x20000000bdb' 2024-08-31T04:31:13.215 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13385 fp=#0x20000001cf2' 2024-08-31T04:31:13.215 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13417 fp=#0x20000001d30' 2024-08-31T04:31:13.215 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13449 fp=#0x20000001cb7' 2024-08-31T04:31:13.216 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13481 fp=#0x10000003b73' 2024-08-31T04:31:13.216 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13540 fp=#0x20000002106' 2024-08-31T04:31:13.217 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13572 fp=#0x2000000210d' 2024-08-31T04:31:13.217 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13636 fp=#0x2000000115e' 2024-08-31T04:31:13.217 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13668 fp=#0x10000002f25' 2024-08-31T04:31:13.218 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13700 fp=#0x10000002e9c' 2024-08-31T04:31:13.218 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13732 fp=#0x10000002e20' 2024-08-31T04:31:13.218 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13764 fp=#0x10000002e45' 2024-08-31T04:31:13.219 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13796 fp=#0x200000015cf' 2024-08-31T04:31:13.219 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13828 fp=#0x20000000802' 2024-08-31T04:31:13.219 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13860 fp=#0x20000000d54' 2024-08-31T04:31:13.220 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13892 fp=#0x20000002227' 2024-08-31T04:31:13.220 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13924 fp=#0x20000000cb7' 2024-08-31T04:31:13.220 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13956 fp=#0x20000000d0e' 2024-08-31T04:31:13.221 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13988 fp=#0x20000000d21' 2024-08-31T04:31:13.221 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14020 fp=#0x20000001a07' 2024-08-31T04:31:13.221 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14052 fp=#0x200000019c9' 2024-08-31T04:31:13.221 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14084 fp=#0x20000001a50' 2024-08-31T04:31:13.222 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14116 fp=#0x20000001a39' 2024-08-31T04:31:13.222 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14148 fp=#0x200000008b2' 2024-08-31T04:31:13.222 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14180 fp=#0x200000008d2' 2024-08-31T04:31:13.223 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14212 fp=#0x200000008d9' 2024-08-31T04:31:13.223 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14244 fp=#0x200000008f2' 2024-08-31T04:31:13.224 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14340 fp=#0x20000001e1d' 2024-08-31T04:31:13.224 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14372 fp=#0x20000001db5' 2024-08-31T04:31:13.224 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14404 fp=#0x20000001de6' 2024-08-31T04:31:13.225 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14436 fp=#0x20000001912' 2024-08-31T04:31:13.225 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14468 fp=#0x200000018ef' 2024-08-31T04:31:13.225 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14500 fp=#0x20000001905' 2024-08-31T04:31:13.226 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14532 fp=#0x200000018fa' 2024-08-31T04:31:13.226 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14564 fp=#0x20000000f8f' 2024-08-31T04:31:13.226 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14596 fp=#0x20000000ff1' 2024-08-31T04:31:13.227 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14628 fp=#0x20000000f8a' 2024-08-31T04:31:13.227 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14660 fp=#0x20000000f43' 2024-08-31T04:31:13.227 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14692 fp=#0x20000000f12' 2024-08-31T04:31:13.228 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14724 fp=#0x100000046e4' 2024-08-31T04:31:13.228 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14820 fp=#0x20000000c03' 2024-08-31T04:31:13.229 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14866 fp=#0x1000000323f' 2024-08-31T04:31:13.229 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14898 fp=#0x10000003132' 2024-08-31T04:31:13.230 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14930 fp=#0x100000030f3' 2024-08-31T04:31:13.230 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14962 fp=#0x200000018af' 2024-08-31T04:31:13.230 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14994 fp=#0x20000001779' 2024-08-31T04:31:13.231 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15026 fp=#0x200000017dc' 2024-08-31T04:31:13.231 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15058 fp=#0x2000000171e' 2024-08-31T04:31:13.231 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15090 fp=#0x20000001726' 2024-08-31T04:31:13.232 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15122 fp=#0x20000001783' 2024-08-31T04:31:13.232 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15153 fp=#0x100000057b6' 2024-08-31T04:31:13.232 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15185 fp=#0x100000057a7' 2024-08-31T04:31:13.233 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15217 fp=#0x100000017ae' 2024-08-31T04:31:13.233 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15249 fp=#0x200000022a8' 2024-08-31T04:31:13.233 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15281 fp=#0x20000002267' 2024-08-31T04:31:13.234 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15313 fp=#0x200000021f5' 2024-08-31T04:31:13.234 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15345 fp=#0x20000002252' 2024-08-31T04:31:13.234 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15377 fp=#0x20000002046' 2024-08-31T04:31:13.235 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15409 fp=#0x20000001015' 2024-08-31T04:31:13.235 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15505 fp=#0x200000019ec' 2024-08-31T04:31:13.236 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15537 fp=#0x2000000164a' 2024-08-31T04:31:13.236 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15569 fp=#0x10000005337' 2024-08-31T04:31:13.236 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15601 fp=#0x20000001a3e' 2024-08-31T04:31:13.237 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15633 fp=#0x10000004ecd' 2024-08-31T04:31:13.237 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15729 fp=#0x10000004e56' 2024-08-31T04:31:13.239 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15889 fp=#0x20000001fce' 2024-08-31T04:31:13.240 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16017 fp=#0x20000001917' 2024-08-31T04:31:13.240 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16049 fp=#0x200000018f6' 2024-08-31T04:31:13.240 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16081 fp=#0x200000017de' 2024-08-31T04:31:13.241 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16113 fp=#0x20000001163' 2024-08-31T04:31:13.241 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16145 fp=#0x2000000112c' 2024-08-31T04:31:13.241 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16177 fp=#0x200000015b3' 2024-08-31T04:31:13.242 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16209 fp=#0x2000000160d' 2024-08-31T04:31:13.242 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16241 fp=#0x2000000159f' 2024-08-31T04:31:13.242 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16273 fp=#0x200000015c5' 2024-08-31T04:31:13.242 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16304 fp=#0x1000000489c' 2024-08-31T04:31:13.243 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16336 fp=#0x10000004800' 2024-08-31T04:31:13.243 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16368 fp=#0x1000000489b' 2024-08-31T04:31:13.243 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16400 fp=#0x10000004500' 2024-08-31T04:31:13.244 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16432 fp=#0x1000000451f' 2024-08-31T04:31:13.244 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16464 fp=#0x10000004832' 2024-08-31T04:31:13.244 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16496 fp=#0x1000000493e' 2024-08-31T04:31:13.245 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16528 fp=#0x2000000113a' 2024-08-31T04:31:13.245 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16560 fp=#0x10000004ef3' 2024-08-31T04:31:13.245 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16592 fp=#0x10000004929' 2024-08-31T04:31:13.246 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16624 fp=#0x200000022a9' 2024-08-31T04:31:13.246 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16656 fp=#0x200000022ad' 2024-08-31T04:31:13.246 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16688 fp=#0x2000000042b' 2024-08-31T04:31:13.247 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16720 fp=#0x10000002afc' 2024-08-31T04:31:13.247 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16752 fp=#0x20000000449' 2024-08-31T04:31:13.247 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16784 fp=#0x10000002a89' 2024-08-31T04:31:13.248 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16816 fp=#0x20000000428' 2024-08-31T04:31:13.248 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16848 fp=#0x20000000426' 2024-08-31T04:31:13.248 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16880 fp=#0x10000004551' 2024-08-31T04:31:13.249 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16912 fp=#0x10000005d5a' 2024-08-31T04:31:13.249 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16944 fp=#0x1000000453b' 2024-08-31T04:31:13.249 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16976 fp=#0x10000004544' 2024-08-31T04:31:13.249 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17008 fp=#0x2000000186f' 2024-08-31T04:31:13.251 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17200 fp=#0x1000000547b' 2024-08-31T04:31:13.251 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17296 fp=#0x10000005473' 2024-08-31T04:31:13.252 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17360 fp=#0x20000001aac' 2024-08-31T04:31:13.253 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17392 fp=#0x20000001ac8' 2024-08-31T04:31:13.253 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17424 fp=#0x20000001a6c' 2024-08-31T04:31:13.253 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17456 fp=#0x10000004d7d' 2024-08-31T04:31:13.253 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17488 fp=#0x10000004def' 2024-08-31T04:31:13.254 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17520 fp=#0x20000002087' 2024-08-31T04:31:13.254 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17552 fp=#0x20000001b5b' 2024-08-31T04:31:13.254 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17584 fp=#0x20000001af0' 2024-08-31T04:31:13.255 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17616 fp=#0x10000002a5a' 2024-08-31T04:31:13.255 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17648 fp=#0x20000001f25' 2024-08-31T04:31:13.255 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17680 fp=#0x20000001f28' 2024-08-31T04:31:13.256 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17712 fp=#0x10000002a05' 2024-08-31T04:31:13.256 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17744 fp=#0x20000001f1d' 2024-08-31T04:31:13.256 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17776 fp=#0x10000004f27' 2024-08-31T04:31:13.257 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17808 fp=#0x10000004edb' 2024-08-31T04:31:13.257 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17840 fp=#0x10000004f26' 2024-08-31T04:31:13.257 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17872 fp=#0x10000000838' 2024-08-31T04:31:13.258 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17968 fp=#0x20000001c58' 2024-08-31T04:31:13.258 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18000 fp=#0x20000001c56' 2024-08-31T04:31:13.259 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18032 fp=#0x20000001c63' 2024-08-31T04:31:13.259 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18064 fp=#0x20000001cb6' 2024-08-31T04:31:13.259 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18096 fp=#0x20000001721' 2024-08-31T04:31:13.260 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18128 fp=#0x200000018c8' 2024-08-31T04:31:13.260 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18160 fp=#0x20000000ccf' 2024-08-31T04:31:13.260 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18192 fp=#0x20000000ca0' 2024-08-31T04:31:13.261 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18224 fp=#0x20000000c42' 2024-08-31T04:31:13.261 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18256 fp=#0x20000000c7c' 2024-08-31T04:31:13.261 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18285 fp=#0x10000004947' 2024-08-31T04:31:13.262 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18317 fp=#0x2000000084e' 2024-08-31T04:31:13.262 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18349 fp=#0x1000000490d' 2024-08-31T04:31:13.262 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18381 fp=#0x200000022ed' 2024-08-31T04:31:13.263 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18408 fp=#0x20000002190' 2024-08-31T04:31:13.263 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18440 fp=#0x2000000219a' 2024-08-31T04:31:13.263 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18472 fp=#0x2000000216a' 2024-08-31T04:31:13.263 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18504 fp=#0x20000002172' 2024-08-31T04:31:13.264 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18534 fp=#0x1000000399a' 2024-08-31T04:31:13.264 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18566 fp=#0x1000000359e' 2024-08-31T04:31:13.264 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:7161 fp=#0x10000000001' 2024-08-31T04:31:13.265 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:7193 fp=#0x100000027bf' 2024-08-31T04:31:13.265 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:7225 fp=#0x10000001f9f' 2024-08-31T04:31:13.267 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:7417 fp=#0x20000001f8c' 2024-08-31T04:31:13.267 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:7481 fp=#0x20000001fa3' 2024-08-31T04:31:13.278 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:8912 fp=#0x20000000635' 2024-08-31T04:31:13.278 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:8944 fp=#0x20000000649' 2024-08-31T04:31:13.279 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9008 fp=#0x200000018a2' 2024-08-31T04:31:13.280 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9072 fp=#0x20000000fb6' 2024-08-31T04:31:13.280 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9104 fp=#0x2000000088b' 2024-08-31T04:31:13.280 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9136 fp=#0x20000000876' 2024-08-31T04:31:13.281 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9168 fp=#0x20000001d99' 2024-08-31T04:31:13.281 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9200 fp=#0x20000001c9c' 2024-08-31T04:31:13.281 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9232 fp=#0x20000000889' 2024-08-31T04:31:13.282 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9392 fp=#0x200000009ce' 2024-08-31T04:31:13.283 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9424 fp=#0x200000009ad' 2024-08-31T04:31:13.283 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9456 fp=#0x2000000158c' 2024-08-31T04:31:13.283 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9488 fp=#0x20000001555' 2024-08-31T04:31:13.284 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9520 fp=#0x2000000099f' 2024-08-31T04:31:13.284 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9552 fp=#0x2000000095a' 2024-08-31T04:31:13.284 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9616 fp=#0x2000000188e' 2024-08-31T04:31:13.285 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9648 fp=#0x20000001836' 2024-08-31T04:31:13.285 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9680 fp=#0x20000000b4e' 2024-08-31T04:31:13.285 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9712 fp=#0x20000000b0c' 2024-08-31T04:31:13.286 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9744 fp=#0x20000000b33' 2024-08-31T04:31:13.286 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9776 fp=#0x20000000afb' 2024-08-31T04:31:13.287 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9808 fp=#0x20000000b51' 2024-08-31T04:31:13.287 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9840 fp=#0x20000001ec0' 2024-08-31T04:31:13.287 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9872 fp=#0x20000001efd' 2024-08-31T04:31:13.288 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9904 fp=#0x20000001e05' 2024-08-31T04:31:13.289 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10063 fp=#0x20000000e2d' 2024-08-31T04:31:13.289 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10095 fp=#0x20000000dbf' 2024-08-31T04:31:13.290 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10127 fp=#0x20000000ff0' 2024-08-31T04:31:13.290 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10159 fp=#0x20000000ddc' 2024-08-31T04:31:13.290 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10191 fp=#0x2000000103f' 2024-08-31T04:31:13.291 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10223 fp=#0x20000000fcb' 2024-08-31T04:31:13.291 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10255 fp=#0x20000000fce' 2024-08-31T04:31:13.291 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10287 fp=#0x20000000fe7' 2024-08-31T04:31:13.292 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10319 fp=#0x20000000930' 2024-08-31T04:31:13.292 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10351 fp=#0x20000000907' 2024-08-31T04:31:13.292 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10383 fp=#0x200000014e0' 2024-08-31T04:31:13.293 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10415 fp=#0x200000014ac' 2024-08-31T04:31:13.293 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10447 fp=#0x200000014e3' 2024-08-31T04:31:13.293 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10479 fp=#0x10000000c87' 2024-08-31T04:31:13.294 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10511 fp=#0x10000000beb' 2024-08-31T04:31:13.294 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10543 fp=#0x10000000cbd' 2024-08-31T04:31:13.295 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10575 fp=#0x10000003cd4' 2024-08-31T04:31:13.295 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10607 fp=#0x20000002051' 2024-08-31T04:31:13.295 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10639 fp=#0x20000002073' 2024-08-31T04:31:13.295 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10671 fp=#0x200000020a9' 2024-08-31T04:31:13.296 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10703 fp=#0x20000002096' 2024-08-31T04:31:13.297 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10831 fp=#0x200000005f3' 2024-08-31T04:31:13.297 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10863 fp=#0x10000003433' 2024-08-31T04:31:13.298 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10895 fp=#0x100000033fd' 2024-08-31T04:31:13.298 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10927 fp=#0x10000003475' 2024-08-31T04:31:13.298 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10959 fp=#0x200000005f8' 2024-08-31T04:31:13.299 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10991 fp=#0x10000003d08' 2024-08-31T04:31:13.299 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11023 fp=#0x10000003c11' 2024-08-31T04:31:13.299 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11055 fp=#0x10000003c31' 2024-08-31T04:31:13.300 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11087 fp=#0x10000003ced' 2024-08-31T04:31:13.300 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11119 fp=#0x10000003b70' 2024-08-31T04:31:13.300 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11151 fp=#0x10000003d1d' 2024-08-31T04:31:13.301 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11183 fp=#0x10000003cf8' 2024-08-31T04:31:13.301 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11215 fp=#0x10000003b4e' 2024-08-31T04:31:13.301 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11243 fp=#0x20000000e42' 2024-08-31T04:31:13.302 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11275 fp=#0x20000000e7d' 2024-08-31T04:31:13.302 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11307 fp=#0x20000000e5b' 2024-08-31T04:31:13.302 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11339 fp=#0x200000019b4' 2024-08-31T04:31:13.303 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11371 fp=#0x20000001ec1' 2024-08-31T04:31:13.303 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11403 fp=#0x20000001ec6' 2024-08-31T04:31:13.303 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11435 fp=#0x20000001944' 2024-08-31T04:31:13.304 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11467 fp=#0x20000001e71' 2024-08-31T04:31:13.304 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11499 fp=#0x20000001ee2' 2024-08-31T04:31:13.304 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11531 fp=#0x10000004662' 2024-08-31T04:31:13.305 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11563 fp=#0x100000045b8' 2024-08-31T04:31:13.305 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11595 fp=#0x100000045e7' 2024-08-31T04:31:13.305 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11627 fp=#0x100000045d6' 2024-08-31T04:31:13.306 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11659 fp=#0x20000001974' 2024-08-31T04:31:13.306 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11691 fp=#0x200000006b1' 2024-08-31T04:31:13.306 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11723 fp=#0x20000000688' 2024-08-31T04:31:13.307 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11755 fp=#0x20000001983' 2024-08-31T04:31:13.307 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11819 fp=#0x20000000665' 2024-08-31T04:31:13.308 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11851 fp=#0x200000022da' 2024-08-31T04:31:13.308 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11883 fp=#0x20000000a8b' 2024-08-31T04:31:13.308 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11915 fp=#0x20000000a81' 2024-08-31T04:31:13.308 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11947 fp=#0x20000000a71' 2024-08-31T04:31:13.309 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11979 fp=#0x20000001a67' 2024-08-31T04:31:13.309 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12011 fp=#0x200000016ce' 2024-08-31T04:31:13.309 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12043 fp=#0x2000000175a' 2024-08-31T04:31:13.310 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12075 fp=#0x20000001704' 2024-08-31T04:31:13.311 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12299 fp=#0x2000000151a' 2024-08-31T04:31:13.312 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12331 fp=#0x20000001faf' 2024-08-31T04:31:13.312 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12363 fp=#0x2000000103a' 2024-08-31T04:31:13.313 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12395 fp=#0x20000001093' 2024-08-31T04:31:13.313 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12427 fp=#0x20000001088' 2024-08-31T04:31:13.313 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12459 fp=#0x20000001e81' 2024-08-31T04:31:13.314 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12491 fp=#0x20000001e93' 2024-08-31T04:31:13.314 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12523 fp=#0x200000009dc' 2024-08-31T04:31:13.314 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12555 fp=#0x20000000a5c' 2024-08-31T04:31:13.315 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12619 fp=#0x20000000a2a' 2024-08-31T04:31:13.315 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12651 fp=#0x20000000a5a' 2024-08-31T04:31:13.316 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12683 fp=#0x10000000db9' 2024-08-31T04:31:13.316 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12715 fp=#0x10000000ed6' 2024-08-31T04:31:13.316 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12747 fp=#0x20000000205' 2024-08-31T04:31:13.317 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12779 fp=#0x200000003c9' 2024-08-31T04:31:13.317 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12811 fp=#0x10000000d3b' 2024-08-31T04:31:13.317 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12843 fp=#0x200000003e4' 2024-08-31T04:31:13.318 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12875 fp=#0x10000002ec2' 2024-08-31T04:31:13.318 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12907 fp=#0x10000002e88' 2024-08-31T04:31:13.318 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12939 fp=#0x20000002107' 2024-08-31T04:31:13.319 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12971 fp=#0x10000002f3d' 2024-08-31T04:31:13.319 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13003 fp=#0x200000020f6' 2024-08-31T04:31:13.319 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13034 fp=#0x200000007a1' 2024-08-31T04:31:13.320 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13066 fp=#0x200000006ff' 2024-08-31T04:31:13.320 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13098 fp=#0x20000000759' 2024-08-31T04:31:13.320 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13130 fp=#0x200000011a6' 2024-08-31T04:31:13.321 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13162 fp=#0x20000000731' 2024-08-31T04:31:13.321 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13194 fp=#0x2000000070a' 2024-08-31T04:31:13.321 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13226 fp=#0x20000000b8e' 2024-08-31T04:31:13.322 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13258 fp=#0x20000000b95' 2024-08-31T04:31:13.322 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13290 fp=#0x20000000b81' 2024-08-31T04:31:13.322 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13322 fp=#0x20000000bb2' 2024-08-31T04:31:13.323 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13354 fp=#0x20000000bcb' 2024-08-31T04:31:13.323 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13386 fp=#0x20000001c43' 2024-08-31T04:31:13.323 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13418 fp=#0x20000001cce' 2024-08-31T04:31:13.323 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13450 fp=#0x20000001c4a' 2024-08-31T04:31:13.324 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13482 fp=#0x10000003b02' 2024-08-31T04:31:13.324 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13573 fp=#0x20000002140' 2024-08-31T04:31:13.325 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13605 fp=#0x20000001157' 2024-08-31T04:31:13.325 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13669 fp=#0x10000002e3c' 2024-08-31T04:31:13.326 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13701 fp=#0x10000002e38' 2024-08-31T04:31:13.326 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13733 fp=#0x10000002e53' 2024-08-31T04:31:13.326 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13765 fp=#0x10000002e2f' 2024-08-31T04:31:13.327 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13797 fp=#0x2000000080b' 2024-08-31T04:31:13.327 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13829 fp=#0x20000001d8d' 2024-08-31T04:31:13.327 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13861 fp=#0x20000000dcb' 2024-08-31T04:31:13.328 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13893 fp=#0x20000000cb3' 2024-08-31T04:31:13.328 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13925 fp=#0x200000021ef' 2024-08-31T04:31:13.328 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13957 fp=#0x20000000dad' 2024-08-31T04:31:13.329 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13989 fp=#0x20000002214' 2024-08-31T04:31:13.329 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14021 fp=#0x200000019d5' 2024-08-31T04:31:13.329 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14053 fp=#0x200000019d6' 2024-08-31T04:31:13.330 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14085 fp=#0x20000001a1b' 2024-08-31T04:31:13.330 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14117 fp=#0x2000000208d' 2024-08-31T04:31:13.330 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14149 fp=#0x200000008b5' 2024-08-31T04:31:13.331 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14181 fp=#0x20000000951' 2024-08-31T04:31:13.331 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14213 fp=#0x20000000946' 2024-08-31T04:31:13.331 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14245 fp=#0x2000000090f' 2024-08-31T04:31:13.332 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14277 fp=#0x20000001da0' 2024-08-31T04:31:13.332 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14309 fp=#0x20000001dae' 2024-08-31T04:31:13.333 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14405 fp=#0x20000001dc3' 2024-08-31T04:31:13.333 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14437 fp=#0x20000001815' 2024-08-31T04:31:13.334 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14469 fp=#0x200000018c0' 2024-08-31T04:31:13.334 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14501 fp=#0x20000001880' 2024-08-31T04:31:13.334 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14533 fp=#0x20000001834' 2024-08-31T04:31:13.335 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14565 fp=#0x20000001037' 2024-08-31T04:31:13.335 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14597 fp=#0x20000000f19' 2024-08-31T04:31:13.335 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14629 fp=#0x20000000fc7' 2024-08-31T04:31:13.335 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14661 fp=#0x20000001024' 2024-08-31T04:31:13.336 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14693 fp=#0x20000000f38' 2024-08-31T04:31:13.336 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14725 fp=#0x100000046e0' 2024-08-31T04:31:13.337 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14821 fp=#0x100000046d2' 2024-08-31T04:31:13.337 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14867 fp=#0x100000031a5' 2024-08-31T04:31:13.338 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14899 fp=#0x2000000100e' 2024-08-31T04:31:13.338 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14931 fp=#0x10000003154' 2024-08-31T04:31:13.338 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14963 fp=#0x100000058b8' 2024-08-31T04:31:13.339 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14995 fp=#0x200000017e7' 2024-08-31T04:31:13.339 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15027 fp=#0x200000017c7' 2024-08-31T04:31:13.339 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15059 fp=#0x20000001727' 2024-08-31T04:31:13.339 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15091 fp=#0x2000000176a' 2024-08-31T04:31:13.340 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15123 fp=#0x200000017b3' 2024-08-31T04:31:13.340 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15154 fp=#0x1000000579e' 2024-08-31T04:31:13.340 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15186 fp=#0x10000001786' 2024-08-31T04:31:13.341 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15218 fp=#0x1000000178f' 2024-08-31T04:31:13.341 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15250 fp=#0x200000021de' 2024-08-31T04:31:13.341 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15282 fp=#0x200000021d1' 2024-08-31T04:31:13.342 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15314 fp=#0x200000021f3' 2024-08-31T04:31:13.342 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15346 fp=#0x200000021d9' 2024-08-31T04:31:13.342 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15378 fp=#0x2000000205e' 2024-08-31T04:31:13.343 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15506 fp=#0x10000005344' 2024-08-31T04:31:13.344 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15538 fp=#0x20000001630' 2024-08-31T04:31:13.344 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15570 fp=#0x1000000532b' 2024-08-31T04:31:13.344 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15602 fp=#0x20000001a23' 2024-08-31T04:31:13.345 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15634 fp=#0x10000004e4b' 2024-08-31T04:31:13.345 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15666 fp=#0x10000004ece' 2024-08-31T04:31:13.345 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15698 fp=#0x10000004e0d' 2024-08-31T04:31:13.346 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15730 fp=#0x10000004ebf' 2024-08-31T04:31:13.346 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15794 fp=#0x20000001fd5' 2024-08-31T04:31:13.347 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15954 fp=#0x20000002003' 2024-08-31T04:31:13.348 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16018 fp=#0x20000001914' 2024-08-31T04:31:13.348 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16050 fp=#0x20000001909' 2024-08-31T04:31:13.349 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16082 fp=#0x200000010eb' 2024-08-31T04:31:13.349 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16114 fp=#0x2000000112a' 2024-08-31T04:31:13.349 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16146 fp=#0x20000001115' 2024-08-31T04:31:13.350 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16178 fp=#0x20000001611' 2024-08-31T04:31:13.350 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16210 fp=#0x200000015fb' 2024-08-31T04:31:13.350 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16242 fp=#0x200000015ff' 2024-08-31T04:31:13.351 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16274 fp=#0x200000015f5' 2024-08-31T04:31:13.351 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16305 fp=#0x10000004502' 2024-08-31T04:31:13.351 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16337 fp=#0x10000004813' 2024-08-31T04:31:13.351 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16369 fp=#0x100000044ef' 2024-08-31T04:31:13.352 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16401 fp=#0x10000004827' 2024-08-31T04:31:13.352 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16433 fp=#0x10000004801' 2024-08-31T04:31:13.352 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16465 fp=#0x10000004f02' 2024-08-31T04:31:13.353 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16497 fp=#0x200000011b4' 2024-08-31T04:31:13.353 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16529 fp=#0x10000004e55' 2024-08-31T04:31:13.353 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16561 fp=#0x10000004915' 2024-08-31T04:31:13.354 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16593 fp=#0x10000004969' 2024-08-31T04:31:13.354 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16625 fp=#0x2000000228b' 2024-08-31T04:31:13.354 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16657 fp=#0x200000022a2' 2024-08-31T04:31:13.355 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16689 fp=#0x20000000409' 2024-08-31T04:31:13.355 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16721 fp=#0x20000001687' 2024-08-31T04:31:13.355 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16753 fp=#0x20000000441' 2024-08-31T04:31:13.356 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16817 fp=#0x2000000042f' 2024-08-31T04:31:13.356 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16849 fp=#0x2000000040f' 2024-08-31T04:31:13.357 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16881 fp=#0x10000005d43' 2024-08-31T04:31:13.357 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16913 fp=#0x1000000453e' 2024-08-31T04:31:13.357 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16945 fp=#0x1000000453a' 2024-08-31T04:31:13.358 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16977 fp=#0x1000000458a' 2024-08-31T04:31:13.359 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17169 fp=#0x1000000573a' 2024-08-31T04:31:13.359 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17201 fp=#0x100000054de' 2024-08-31T04:31:13.360 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17233 fp=#0x10000005486' 2024-08-31T04:31:13.360 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17297 fp=#0x100000054e2' 2024-08-31T04:31:13.361 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17329 fp=#0x1000000548c' 2024-08-31T04:31:13.361 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17361 fp=#0x20000001ac2' 2024-08-31T04:31:13.361 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17393 fp=#0x20000001a8a' 2024-08-31T04:31:13.362 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17425 fp=#0x20000001abf' 2024-08-31T04:31:13.362 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17457 fp=#0x10000004de7' 2024-08-31T04:31:13.362 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17489 fp=#0x10000004da0' 2024-08-31T04:31:13.363 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17521 fp=#0x10000004e02' 2024-08-31T04:31:13.363 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17553 fp=#0x20000001b39' 2024-08-31T04:31:13.363 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17585 fp=#0x20000001b7f' 2024-08-31T04:31:13.364 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17617 fp=#0x100000029df' 2024-08-31T04:31:13.364 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17649 fp=#0x10000002a13' 2024-08-31T04:31:13.364 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17713 fp=#0x2000000034e' 2024-08-31T04:31:13.365 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17745 fp=#0x20000001f2e' 2024-08-31T04:31:13.365 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17777 fp=#0x10000004f08' 2024-08-31T04:31:13.365 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17809 fp=#0x10000004f33' 2024-08-31T04:31:13.366 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17841 fp=#0x10000004f0f' 2024-08-31T04:31:13.367 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17969 fp=#0x20000001d2b' 2024-08-31T04:31:13.367 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18001 fp=#0x20000001c3c' 2024-08-31T04:31:13.367 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18033 fp=#0x20000001c05' 2024-08-31T04:31:13.368 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18065 fp=#0x20000001bf6' 2024-08-31T04:31:13.368 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18097 fp=#0x2000000173b' 2024-08-31T04:31:13.368 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18129 fp=#0x20000001702' 2024-08-31T04:31:13.369 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18161 fp=#0x20000000c0c' 2024-08-31T04:31:13.369 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18193 fp=#0x20000000c8e' 2024-08-31T04:31:13.369 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18225 fp=#0x20000000c12' 2024-08-31T04:31:13.370 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18257 fp=#0x20000000c24' 2024-08-31T04:31:13.370 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18286 fp=#0x200000022fa' 2024-08-31T04:31:13.370 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18318 fp=#0x2000000084b' 2024-08-31T04:31:13.371 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18350 fp=#0x10000004a15' 2024-08-31T04:31:13.371 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18382 fp=#0x10000004918' 2024-08-31T04:31:13.371 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18409 fp=#0x2000000216d' 2024-08-31T04:31:13.372 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18441 fp=#0x20000002250' 2024-08-31T04:31:13.372 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18473 fp=#0x2000000221e' 2024-08-31T04:31:13.372 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18505 fp=#0x20000002175' 2024-08-31T04:31:13.373 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18535 fp=#0x4000000061c' 2024-08-31T04:31:13.373 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18567 fp=#0x100000036f4' 2024-08-31T04:31:13.374 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:7162 fp=#0x100000001fa' 2024-08-31T04:31:13.374 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:7194 fp=#0x100000033e5' 2024-08-31T04:31:13.375 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:7354 fp=#0x100000011a5' 2024-08-31T04:31:13.387 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:8913 fp=#0x2000000066d' 2024-08-31T04:31:13.387 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:8977 fp=#0x2000000062d' 2024-08-31T04:31:13.388 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9009 fp=#0x20000001854' 2024-08-31T04:31:13.388 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9073 fp=#0x20000000f63' 2024-08-31T04:31:13.389 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9105 fp=#0x20000000867' 2024-08-31T04:31:13.389 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9137 fp=#0x20000000885' 2024-08-31T04:31:13.389 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9169 fp=#0x20000001d18' 2024-08-31T04:31:13.390 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9201 fp=#0x20000000886' 2024-08-31T04:31:13.390 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9233 fp=#0x20000001c96' 2024-08-31T04:31:13.391 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9393 fp=#0x20000000984' 2024-08-31T04:31:13.392 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9425 fp=#0x20000001577' 2024-08-31T04:31:13.392 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9457 fp=#0x20000001062' 2024-08-31T04:31:13.392 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9489 fp=#0x20000000986' 2024-08-31T04:31:13.393 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9521 fp=#0x2000000098a' 2024-08-31T04:31:13.393 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9553 fp=#0x2000000097c' 2024-08-31T04:31:13.393 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9585 fp=#0x20000001496' 2024-08-31T04:31:13.394 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9617 fp=#0x20000001886' 2024-08-31T04:31:13.394 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9649 fp=#0x2000000183a' 2024-08-31T04:31:13.394 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9681 fp=#0x20000000af9' 2024-08-31T04:31:13.395 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9713 fp=#0x20000000b42' 2024-08-31T04:31:13.395 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9745 fp=#0x20000001f74' 2024-08-31T04:31:13.395 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9777 fp=#0x20000000b19' 2024-08-31T04:31:13.395 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9809 fp=#0x20000001f72' 2024-08-31T04:31:13.396 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9841 fp=#0x20000001e15' 2024-08-31T04:31:13.396 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9873 fp=#0x20000001ea6' 2024-08-31T04:31:13.397 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9905 fp=#0x20000001e8f' 2024-08-31T04:31:13.398 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10064 fp=#0x20000000e37' 2024-08-31T04:31:13.398 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10096 fp=#0x20000000df1' 2024-08-31T04:31:13.399 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10128 fp=#0x20000000d52' 2024-08-31T04:31:13.399 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10160 fp=#0x20000000d64' 2024-08-31T04:31:13.399 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10192 fp=#0x200000006da' 2024-08-31T04:31:13.400 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10224 fp=#0x20000000ff2' 2024-08-31T04:31:13.400 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10256 fp=#0x2000000106c' 2024-08-31T04:31:13.400 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10288 fp=#0x20000001005' 2024-08-31T04:31:13.401 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10320 fp=#0x200000014b0' 2024-08-31T04:31:13.401 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10352 fp=#0x200000014ea' 2024-08-31T04:31:13.402 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10448 fp=#0x2000000091d' 2024-08-31T04:31:13.402 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10480 fp=#0x10000000be7' 2024-08-31T04:31:13.402 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10512 fp=#0x1000000112d' 2024-08-31T04:31:13.403 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10544 fp=#0x10000003cba' 2024-08-31T04:31:13.403 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10576 fp=#0x10000000bc9' 2024-08-31T04:31:13.403 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10608 fp=#0x200000020ad' 2024-08-31T04:31:13.404 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10640 fp=#0x200000020d7' 2024-08-31T04:31:13.404 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10672 fp=#0x2000000207f' 2024-08-31T04:31:13.405 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10704 fp=#0x2000000209b' 2024-08-31T04:31:13.405 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10800 fp=#0x100000027c1' 2024-08-31T04:31:13.406 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10832 fp=#0x1000000348d' 2024-08-31T04:31:13.406 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10864 fp=#0x10000003491' 2024-08-31T04:31:13.406 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10896 fp=#0x2000000060f' 2024-08-31T04:31:13.407 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10928 fp=#0x10000003410' 2024-08-31T04:31:13.407 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10960 fp=#0x200000005d9' 2024-08-31T04:31:13.407 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10992 fp=#0x10000003bbe' 2024-08-31T04:31:13.408 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11024 fp=#0x10000003d04' 2024-08-31T04:31:13.408 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11056 fp=#0x10000003ce3' 2024-08-31T04:31:13.408 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11120 fp=#0x10000003cfc' 2024-08-31T04:31:13.409 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11152 fp=#0x10000003980' 2024-08-31T04:31:13.409 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11184 fp=#0x10000003d0f' 2024-08-31T04:31:13.409 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11216 fp=#0x10000003d1a' 2024-08-31T04:31:13.410 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11244 fp=#0x20000000e6a' 2024-08-31T04:31:13.410 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11276 fp=#0x20000000e60' 2024-08-31T04:31:13.410 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11308 fp=#0x20000000e5e' 2024-08-31T04:31:13.411 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11340 fp=#0x20000001950' 2024-08-31T04:31:13.411 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11372 fp=#0x20000001910' 2024-08-31T04:31:13.412 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11404 fp=#0x20000001f05' 2024-08-31T04:31:13.412 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11436 fp=#0x20000001ea7' 2024-08-31T04:31:13.412 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11468 fp=#0x20000001925' 2024-08-31T04:31:13.413 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11500 fp=#0x20000001ec9' 2024-08-31T04:31:13.413 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11532 fp=#0x10000004622' 2024-08-31T04:31:13.413 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11564 fp=#0x100000045cf' 2024-08-31T04:31:13.414 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11596 fp=#0x100000045d8' 2024-08-31T04:31:13.414 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11628 fp=#0x10000004628' 2024-08-31T04:31:13.415 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11724 fp=#0x20000000698' 2024-08-31T04:31:13.415 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11788 fp=#0x200000006b5' 2024-08-31T04:31:13.415 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11820 fp=#0x2000000063f' 2024-08-31T04:31:13.416 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11852 fp=#0x200000022ee' 2024-08-31T04:31:13.416 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11884 fp=#0x20000000ab5' 2024-08-31T04:31:13.416 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11916 fp=#0x20000000a92' 2024-08-31T04:31:13.417 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11948 fp=#0x20000000a70' 2024-08-31T04:31:13.417 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11980 fp=#0x20000000a9e' 2024-08-31T04:31:13.417 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12012 fp=#0x200000016a5' 2024-08-31T04:31:13.418 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12044 fp=#0x20000001698' 2024-08-31T04:31:13.418 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12076 fp=#0x200000016b1' 2024-08-31T04:31:13.418 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12108 fp=#0x20000001fcf' 2024-08-31T04:31:13.419 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12172 fp=#0x200000014d8' 2024-08-31T04:31:13.419 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12236 fp=#0x2000000151f' 2024-08-31T04:31:13.420 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12268 fp=#0x200000014c5' 2024-08-31T04:31:13.420 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12300 fp=#0x20000001f8a' 2024-08-31T04:31:13.421 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12364 fp=#0x200000010c8' 2024-08-31T04:31:13.421 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12396 fp=#0x200000010a3' 2024-08-31T04:31:13.421 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12428 fp=#0x200000010d1' 2024-08-31T04:31:13.422 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12460 fp=#0x20000001f37' 2024-08-31T04:31:13.422 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12492 fp=#0x20000001f31' 2024-08-31T04:31:13.422 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12524 fp=#0x20000000a66' 2024-08-31T04:31:13.423 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12556 fp=#0x200000009e3' 2024-08-31T04:31:13.423 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12588 fp=#0x200000009de' 2024-08-31T04:31:13.423 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12620 fp=#0x20000000a4b' 2024-08-31T04:31:13.424 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12652 fp=#0x200000009e6' 2024-08-31T04:31:13.424 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12684 fp=#0x20000000219' 2024-08-31T04:31:13.424 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12716 fp=#0x200000003bb' 2024-08-31T04:31:13.425 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12748 fp=#0x200000003d7' 2024-08-31T04:31:13.425 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12780 fp=#0x20000000217' 2024-08-31T04:31:13.425 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12812 fp=#0x10000000e7f' 2024-08-31T04:31:13.426 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12844 fp=#0x20000000226' 2024-08-31T04:31:13.426 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12876 fp=#0x10000002f4a' 2024-08-31T04:31:13.426 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12908 fp=#0x200000020b6' 2024-08-31T04:31:13.427 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12940 fp=#0x200000020c1' 2024-08-31T04:31:13.427 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12972 fp=#0x10000002ec0' 2024-08-31T04:31:13.428 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13004 fp=#0x10000002e71' 2024-08-31T04:31:13.428 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13035 fp=#0x20000000724' 2024-08-31T04:31:13.428 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13099 fp=#0x2000000072c' 2024-08-31T04:31:13.429 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13131 fp=#0x20000000758' 2024-08-31T04:31:13.429 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13163 fp=#0x2000000070f' 2024-08-31T04:31:13.429 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13195 fp=#0x20000000766' 2024-08-31T04:31:13.430 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13227 fp=#0x20000000ba8' 2024-08-31T04:31:13.430 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13259 fp=#0x20000000bc5' 2024-08-31T04:31:13.430 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13291 fp=#0x20000000ba4' 2024-08-31T04:31:13.431 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13323 fp=#0x20000000be6' 2024-08-31T04:31:13.431 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13355 fp=#0x20000001c7a' 2024-08-31T04:31:13.431 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13387 fp=#0x20000001c3a' 2024-08-31T04:31:13.432 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13419 fp=#0x20000001c4e' 2024-08-31T04:31:13.432 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13451 fp=#0x20000001d10' 2024-08-31T04:31:13.432 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13483 fp=#0x10000003b59' 2024-08-31T04:31:13.433 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13574 fp=#0x20000001149' 2024-08-31T04:31:13.433 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13606 fp=#0x20000001194' 2024-08-31T04:31:13.434 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13670 fp=#0x10000002e56' 2024-08-31T04:31:13.434 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13702 fp=#0x10000002ede' 2024-08-31T04:31:13.435 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13734 fp=#0x10000002e33' 2024-08-31T04:31:13.435 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13766 fp=#0x10000002e23' 2024-08-31T04:31:13.435 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13798 fp=#0x2000000083e' 2024-08-31T04:31:13.436 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13830 fp=#0x20000000808' 2024-08-31T04:31:13.436 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13862 fp=#0x20000000cf7' 2024-08-31T04:31:13.436 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13894 fp=#0x20000000d8b' 2024-08-31T04:31:13.437 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13926 fp=#0x20000002239' 2024-08-31T04:31:13.437 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13958 fp=#0x20000000d24' 2024-08-31T04:31:13.437 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13990 fp=#0x20000000d5b' 2024-08-31T04:31:13.438 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14022 fp=#0x20000001a59' 2024-08-31T04:31:13.438 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14054 fp=#0x200000019e0' 2024-08-31T04:31:13.438 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14086 fp=#0x20000001a06' 2024-08-31T04:31:13.438 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14118 fp=#0x20000001a1a' 2024-08-31T04:31:13.439 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14150 fp=#0x200000008db' 2024-08-31T04:31:13.439 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14182 fp=#0x200000008ba' 2024-08-31T04:31:13.439 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14214 fp=#0x200000008f3' 2024-08-31T04:31:13.440 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14246 fp=#0x200000008b1' 2024-08-31T04:31:13.440 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14310 fp=#0x20000001dbd' 2024-08-31T04:31:13.441 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14342 fp=#0x20000001e38' 2024-08-31T04:31:13.441 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14406 fp=#0x20000001dcc' 2024-08-31T04:31:13.441 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14438 fp=#0x2000000185b' 2024-08-31T04:31:13.442 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14470 fp=#0x2000000193a' 2024-08-31T04:31:13.442 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14502 fp=#0x200000018ce' 2024-08-31T04:31:13.442 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14534 fp=#0x2000000183c' 2024-08-31T04:31:13.443 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14566 fp=#0x20000000f3e' 2024-08-31T04:31:13.443 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14598 fp=#0x20000000fc0' 2024-08-31T04:31:13.443 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14630 fp=#0x20000001044' 2024-08-31T04:31:13.444 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14662 fp=#0x20000000f00' 2024-08-31T04:31:13.444 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14694 fp=#0x20000000ff9' 2024-08-31T04:31:13.444 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14726 fp=#0x20000000bfb' 2024-08-31T04:31:13.445 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14758 fp=#0x20000000c04' 2024-08-31T04:31:13.445 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14790 fp=#0x100000046c6' 2024-08-31T04:31:13.446 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14868 fp=#0x1000000314c' 2024-08-31T04:31:13.446 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14900 fp=#0x1000000316e' 2024-08-31T04:31:13.446 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14932 fp=#0x10000003102' 2024-08-31T04:31:13.447 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14964 fp=#0x100000058b2' 2024-08-31T04:31:13.447 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14996 fp=#0x2000000172a' 2024-08-31T04:31:13.447 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15028 fp=#0x200000017ae' 2024-08-31T04:31:13.448 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15060 fp=#0x20000001766' 2024-08-31T04:31:13.448 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15092 fp=#0x200000017f0' 2024-08-31T04:31:13.448 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15124 fp=#0x2000000179a' 2024-08-31T04:31:13.449 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15155 fp=#0x100000057af' 2024-08-31T04:31:13.449 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15187 fp=#0x1000000173e' 2024-08-31T04:31:13.449 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15251 fp=#0x20000002272' 2024-08-31T04:31:13.450 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15283 fp=#0x200000021c5' 2024-08-31T04:31:13.450 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15315 fp=#0x200000021cb' 2024-08-31T04:31:13.451 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15379 fp=#0x20000001cbd' 2024-08-31T04:31:13.451 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15411 fp=#0x20000002088' 2024-08-31T04:31:13.452 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15507 fp=#0x10000005340' 2024-08-31T04:31:13.452 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15539 fp=#0x20000001a38' 2024-08-31T04:31:13.452 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15571 fp=#0x1000000533d' 2024-08-31T04:31:13.453 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15603 fp=#0x20000001a30' 2024-08-31T04:31:13.453 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15635 fp=#0x10000004eb7' 2024-08-31T04:31:13.453 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15667 fp=#0x10000004ea1' 2024-08-31T04:31:13.454 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15731 fp=#0x10000004e1c' 2024-08-31T04:31:13.455 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15859 fp=#0x10000002686' 2024-08-31T04:31:13.455 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15955 fp=#0x20000001fb9' 2024-08-31T04:31:13.456 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16019 fp=#0x20000000ea7' 2024-08-31T04:31:13.456 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16051 fp=#0x200000018ec' 2024-08-31T04:31:13.457 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16083 fp=#0x20000001a7a' 2024-08-31T04:31:13.457 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16115 fp=#0x200000011b9' 2024-08-31T04:31:13.457 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16147 fp=#0x200000011aa' 2024-08-31T04:31:13.458 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16179 fp=#0x200000015f2' 2024-08-31T04:31:13.458 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16211 fp=#0x200000015ae' 2024-08-31T04:31:13.461 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16243 fp=#0x200000015d2' 2024-08-31T04:31:13.461 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16275 fp=#0x2000000158f' 2024-08-31T04:31:13.462 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16306 fp=#0x100000044df' 2024-08-31T04:31:13.462 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16338 fp=#0x100000044f6' 2024-08-31T04:31:13.462 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16370 fp=#0x100000048a3' 2024-08-31T04:31:13.463 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16402 fp=#0x20000001e4a' 2024-08-31T04:31:13.463 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16434 fp=#0x1000000488c' 2024-08-31T04:31:13.463 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16466 fp=#0x1000000490e' 2024-08-31T04:31:13.463 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16498 fp=#0x200000011af' 2024-08-31T04:31:13.464 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16562 fp=#0x10000004de2' 2024-08-31T04:31:13.464 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16594 fp=#0x20000001197' 2024-08-31T04:31:13.465 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16626 fp=#0x20000002299' 2024-08-31T04:31:13.465 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16658 fp=#0x20000002298' 2024-08-31T04:31:13.465 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16690 fp=#0x10000002af8' 2024-08-31T04:31:13.466 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16722 fp=#0x10000002ad9' 2024-08-31T04:31:13.466 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16754 fp=#0x20000000425' 2024-08-31T04:31:13.466 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16786 fp=#0x10000002aac' 2024-08-31T04:31:13.467 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16818 fp=#0x20000000429' 2024-08-31T04:31:13.467 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16850 fp=#0x10000002a7d' 2024-08-31T04:31:13.467 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16882 fp=#0x10000004589' 2024-08-31T04:31:13.468 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16914 fp=#0x10000004548' 2024-08-31T04:31:13.468 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16946 fp=#0x1000000458f' 2024-08-31T04:31:13.468 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16978 fp=#0x10000004542' 2024-08-31T04:31:13.469 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17106 fp=#0x10000005789' 2024-08-31T04:31:13.470 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17170 fp=#0x10000005725' 2024-08-31T04:31:13.471 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17234 fp=#0x100000054c7' 2024-08-31T04:31:13.471 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17330 fp=#0x100000054cf' 2024-08-31T04:31:13.472 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17362 fp=#0x20000001a82' 2024-08-31T04:31:13.472 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17394 fp=#0x20000001a80' 2024-08-31T04:31:13.473 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17426 fp=#0x20000001aab' 2024-08-31T04:31:13.473 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17458 fp=#0x10000004d70' 2024-08-31T04:31:13.473 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17490 fp=#0x10000004e0f' 2024-08-31T04:31:13.474 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17522 fp=#0x10000004d7a' 2024-08-31T04:31:13.474 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17554 fp=#0x20000001b86' 2024-08-31T04:31:13.475 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17586 fp=#0x20000001b42' 2024-08-31T04:31:13.475 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17618 fp=#0x10000002a41' 2024-08-31T04:31:13.475 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17650 fp=#0x10000002a4e' 2024-08-31T04:31:13.476 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17682 fp=#0x20000001f5c' 2024-08-31T04:31:13.476 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17714 fp=#0x2000000168a' 2024-08-31T04:31:13.476 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17746 fp=#0x2000000049f' 2024-08-31T04:31:13.477 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17778 fp=#0x10000004eef' 2024-08-31T04:31:13.477 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17810 fp=#0x10000004ee5' 2024-08-31T04:31:13.477 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17842 fp=#0x10000004ef8' 2024-08-31T04:31:13.478 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17906 fp=#0x10000001131' 2024-08-31T04:31:13.478 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17938 fp=#0x20000001db4' 2024-08-31T04:31:13.479 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17970 fp=#0x20000001bfa' 2024-08-31T04:31:13.479 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18002 fp=#0x20000001c6a' 2024-08-31T04:31:13.479 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18034 fp=#0x20000001c49' 2024-08-31T04:31:13.480 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18066 fp=#0x200000016f0' 2024-08-31T04:31:13.480 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18098 fp=#0x20000001728' 2024-08-31T04:31:13.480 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18130 fp=#0x200000016ff' 2024-08-31T04:31:13.481 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18162 fp=#0x20000000c7a' 2024-08-31T04:31:13.481 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18194 fp=#0x20000000c18' 2024-08-31T04:31:13.481 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18226 fp=#0x20000000caa' 2024-08-31T04:31:13.482 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18287 fp=#0x10000004a2f' 2024-08-31T04:31:13.482 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18319 fp=#0x2000000085f' 2024-08-31T04:31:13.483 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18351 fp=#0x10000004945' 2024-08-31T04:31:13.483 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18383 fp=#0x1000000492f' 2024-08-31T04:31:13.483 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18410 fp=#0x2000000224d' 2024-08-31T04:31:13.484 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18442 fp=#0x200000021b9' 2024-08-31T04:31:13.484 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18474 fp=#0x2000000218e' 2024-08-31T04:31:13.484 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18506 fp=#0x2000000218d' 2024-08-31T04:31:13.485 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18536 fp=#0x10000003628' 2024-08-31T04:31:13.485 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18568 fp=#0x10000003646' 2024-08-31T04:31:13.485 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:7163 fp=#0x100000001fb' 2024-08-31T04:31:13.486 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:7227 fp=#0x10000004629' 2024-08-31T04:31:13.487 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:7291 fp=#0x10000004d45' 2024-08-31T04:31:13.488 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:7387 fp=#0x20000002019' 2024-08-31T04:31:13.488 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:7451 fp=#0x20000001fbd' 2024-08-31T04:31:13.488 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:7483 fp=#0x20000001feb' 2024-08-31T04:31:13.489 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:7515 fp=#0x20000001ffb' 2024-08-31T04:31:13.498 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:8731 fp=#0x20000000ace' 2024-08-31T04:31:13.499 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:8754 fp=#0x2000000083d' 2024-08-31T04:31:13.500 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:8914 fp=#0x20000000681' 2024-08-31T04:31:13.501 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:8978 fp=#0x2000000189d' 2024-08-31T04:31:13.501 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9042 fp=#0x20000000fb2' 2024-08-31T04:31:13.502 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9074 fp=#0x20000000f59' 2024-08-31T04:31:13.502 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9106 fp=#0x20000001d96' 2024-08-31T04:31:13.503 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9202 fp=#0x2000000086b' 2024-08-31T04:31:13.503 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9234 fp=#0x20000001d42' 2024-08-31T04:31:13.505 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9394 fp=#0x200000009cc' 2024-08-31T04:31:13.505 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9426 fp=#0x20000001576' 2024-08-31T04:31:13.506 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9458 fp=#0x20000001562' 2024-08-31T04:31:13.506 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9490 fp=#0x20000000967' 2024-08-31T04:31:13.506 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9522 fp=#0x2000000097d' 2024-08-31T04:31:13.506 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9554 fp=#0x2000000097f' 2024-08-31T04:31:13.507 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9586 fp=#0x200000018b2' 2024-08-31T04:31:13.507 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9618 fp=#0x200000018d9' 2024-08-31T04:31:13.508 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9682 fp=#0x20000000b5f' 2024-08-31T04:31:13.508 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9714 fp=#0x20000000b30' 2024-08-31T04:31:13.508 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9746 fp=#0x20000000b60' 2024-08-31T04:31:13.509 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9778 fp=#0x20000000b26' 2024-08-31T04:31:13.509 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9810 fp=#0x20000000b17' 2024-08-31T04:31:13.509 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9842 fp=#0x20000001e08' 2024-08-31T04:31:13.510 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9874 fp=#0x20000001e26' 2024-08-31T04:31:13.510 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9906 fp=#0x20000001e56' 2024-08-31T04:31:13.511 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10065 fp=#0x20000001624' 2024-08-31T04:31:13.512 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10097 fp=#0x20000000e1a' 2024-08-31T04:31:13.512 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10129 fp=#0x20000000e20' 2024-08-31T04:31:13.512 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10161 fp=#0x20000000e19' 2024-08-31T04:31:13.513 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10193 fp=#0x200000006fe' 2024-08-31T04:31:13.513 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10225 fp=#0x200000006e0' 2024-08-31T04:31:13.513 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10257 fp=#0x20000000700' 2024-08-31T04:31:13.514 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10289 fp=#0x20000000fd5' 2024-08-31T04:31:13.514 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10321 fp=#0x20000000929' 2024-08-31T04:31:13.514 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10353 fp=#0x200000014e7' 2024-08-31T04:31:13.514 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10385 fp=#0x200000014b4' 2024-08-31T04:31:13.515 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10417 fp=#0x2000000092d' 2024-08-31T04:31:13.515 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10449 fp=#0x20000000900' 2024-08-31T04:31:13.515 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10481 fp=#0x10000000c5d' 2024-08-31T04:31:13.516 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10513 fp=#0x10000001841' 2024-08-31T04:31:13.516 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10545 fp=#0x10000000c42' 2024-08-31T04:31:13.516 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10577 fp=#0x10000000c1a' 2024-08-31T04:31:13.517 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10609 fp=#0x200000020e2' 2024-08-31T04:31:13.517 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10641 fp=#0x200000020ba' 2024-08-31T04:31:13.517 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10673 fp=#0x200000020da' 2024-08-31T04:31:13.518 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10705 fp=#0x200000020b4' 2024-08-31T04:31:13.519 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10833 fp=#0x2000000168c' 2024-08-31T04:31:13.519 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10865 fp=#0x1000000346d' 2024-08-31T04:31:13.519 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10897 fp=#0x20000001e9a' 2024-08-31T04:31:13.520 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10929 fp=#0x200000005dd' 2024-08-31T04:31:13.520 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10961 fp=#0x200000005e2' 2024-08-31T04:31:13.520 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10993 fp=#0x20000002052' 2024-08-31T04:31:13.521 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11025 fp=#0x10000003d0c' 2024-08-31T04:31:13.521 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11057 fp=#0x100000039cf' 2024-08-31T04:31:13.521 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11089 fp=#0x10000003dce' 2024-08-31T04:31:13.522 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11121 fp=#0x100000039cc' 2024-08-31T04:31:13.522 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11153 fp=#0x10000003d22' 2024-08-31T04:31:13.522 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11185 fp=#0x10000003996' 2024-08-31T04:31:13.523 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11245 fp=#0x20000000e82' 2024-08-31T04:31:13.523 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11277 fp=#0x20000000e65' 2024-08-31T04:31:13.523 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11309 fp=#0x20000000e76' 2024-08-31T04:31:13.524 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11341 fp=#0x200000019b2' 2024-08-31T04:31:13.524 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11373 fp=#0x2000000198c' 2024-08-31T04:31:13.524 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11405 fp=#0x20000001e88' 2024-08-31T04:31:13.525 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11437 fp=#0x20000001eb6' 2024-08-31T04:31:13.525 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11469 fp=#0x20000001e77' 2024-08-31T04:31:13.525 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11501 fp=#0x20000001eba' 2024-08-31T04:31:13.526 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11533 fp=#0x10000004665' 2024-08-31T04:31:13.526 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11565 fp=#0x100000045bc' 2024-08-31T04:31:13.526 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11597 fp=#0x100000045c4' 2024-08-31T04:31:13.527 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11629 fp=#0x100000045fe' 2024-08-31T04:31:13.527 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11661 fp=#0x200000006cd' 2024-08-31T04:31:13.528 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11757 fp=#0x2000000064a' 2024-08-31T04:31:13.528 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11789 fp=#0x200000006a0' 2024-08-31T04:31:13.528 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11821 fp=#0x20000001999' 2024-08-31T04:31:13.529 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11853 fp=#0x200000022f1' 2024-08-31T04:31:13.529 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11885 fp=#0x20000000a76' 2024-08-31T04:31:13.529 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11917 fp=#0x2000000164f' 2024-08-31T04:31:13.530 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11949 fp=#0x20000000aad' 2024-08-31T04:31:13.530 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11981 fp=#0x20000001616' 2024-08-31T04:31:13.530 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12013 fp=#0x20000001757' 2024-08-31T04:31:13.531 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12045 fp=#0x20000001697' 2024-08-31T04:31:13.531 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12077 fp=#0x200000016a9' 2024-08-31T04:31:13.532 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12141 fp=#0x200000014f3' 2024-08-31T04:31:13.532 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12205 fp=#0x20000001f96' 2024-08-31T04:31:13.532 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12237 fp=#0x20000001f95' 2024-08-31T04:31:13.533 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12301 fp=#0x2000000151b' 2024-08-31T04:31:13.534 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12365 fp=#0x200000010bc' 2024-08-31T04:31:13.534 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12397 fp=#0x200000010e3' 2024-08-31T04:31:13.534 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12429 fp=#0x20000001086' 2024-08-31T04:31:13.535 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12461 fp=#0x20000001f33' 2024-08-31T04:31:13.535 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12493 fp=#0x20000001e70' 2024-08-31T04:31:13.535 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12525 fp=#0x200000009ee' 2024-08-31T04:31:13.536 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12557 fp=#0x200000009e0' 2024-08-31T04:31:13.536 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12589 fp=#0x20000000a5b' 2024-08-31T04:31:13.536 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12621 fp=#0x20000000a4f' 2024-08-31T04:31:13.537 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12653 fp=#0x20000000a29' 2024-08-31T04:31:13.537 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12685 fp=#0x10000000d2c' 2024-08-31T04:31:13.537 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12717 fp=#0x200000003cc' 2024-08-31T04:31:13.538 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12749 fp=#0x10000000dd2' 2024-08-31T04:31:13.538 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12781 fp=#0x10000000cfe' 2024-08-31T04:31:13.538 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12813 fp=#0x200000001f8' 2024-08-31T04:31:13.539 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12845 fp=#0x20000000233' 2024-08-31T04:31:13.539 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12877 fp=#0x200000020f0' 2024-08-31T04:31:13.539 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12909 fp=#0x200000020d3' 2024-08-31T04:31:13.539 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12941 fp=#0x200000020c7' 2024-08-31T04:31:13.540 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12973 fp=#0x10000002f42' 2024-08-31T04:31:13.540 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13005 fp=#0x10000002f17' 2024-08-31T04:31:13.540 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13036 fp=#0x2000000075d' 2024-08-31T04:31:13.541 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13068 fp=#0x2000000078e' 2024-08-31T04:31:13.541 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13100 fp=#0x20000000736' 2024-08-31T04:31:13.541 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13132 fp=#0x2000000075b' 2024-08-31T04:31:13.542 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13164 fp=#0x20000000767' 2024-08-31T04:31:13.542 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13228 fp=#0x20000000b6b' 2024-08-31T04:31:13.543 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13260 fp=#0x20000000bde' 2024-08-31T04:31:13.543 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13292 fp=#0x20000000ba7' 2024-08-31T04:31:13.543 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13324 fp=#0x20000000b74' 2024-08-31T04:31:13.543 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13356 fp=#0x20000001d6b' 2024-08-31T04:31:13.544 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13388 fp=#0x20000001c66' 2024-08-31T04:31:13.544 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13420 fp=#0x20000001c53' 2024-08-31T04:31:13.544 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13452 fp=#0x20000001d01' 2024-08-31T04:31:13.545 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13484 fp=#0x10000003b46' 2024-08-31T04:31:13.545 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13543 fp=#0x20000001a76' 2024-08-31T04:31:13.545 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13575 fp=#0x200000011a1' 2024-08-31T04:31:13.546 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13607 fp=#0x20000002131' 2024-08-31T04:31:13.546 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13639 fp=#0x2000000115a' 2024-08-31T04:31:13.547 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13703 fp=#0x10000002e99' 2024-08-31T04:31:13.547 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13735 fp=#0x10000002e63' 2024-08-31T04:31:13.547 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13767 fp=#0x10000002e4a' 2024-08-31T04:31:13.547 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13799 fp=#0x200000015be' 2024-08-31T04:31:13.548 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13831 fp=#0x200000007fe' 2024-08-31T04:31:13.548 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13863 fp=#0x20000000da8' 2024-08-31T04:31:13.549 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13895 fp=#0x20000000d11' 2024-08-31T04:31:13.549 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13927 fp=#0x20000000ce6' 2024-08-31T04:31:13.549 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13959 fp=#0x20000000cc1' 2024-08-31T04:31:13.550 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13991 fp=#0x20000002261' 2024-08-31T04:31:13.550 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14023 fp=#0x200000019c0' 2024-08-31T04:31:13.550 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14055 fp=#0x20000001a5a' 2024-08-31T04:31:13.550 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14087 fp=#0x20000001a53' 2024-08-31T04:31:13.551 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14119 fp=#0x200000008b8' 2024-08-31T04:31:13.551 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14151 fp=#0x20000000928' 2024-08-31T04:31:13.551 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14183 fp=#0x200000008a4' 2024-08-31T04:31:13.552 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14215 fp=#0x200000008e9' 2024-08-31T04:31:13.552 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14247 fp=#0x20000000944' 2024-08-31T04:31:13.552 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14279 fp=#0x20000001e21' 2024-08-31T04:31:13.553 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14343 fp=#0x20000001d9c' 2024-08-31T04:31:13.554 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14439 fp=#0x20000001949' 2024-08-31T04:31:13.554 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14471 fp=#0x200000018fc' 2024-08-31T04:31:13.554 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14503 fp=#0x200000018df' 2024-08-31T04:31:13.554 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14535 fp=#0x20000001883' 2024-08-31T04:31:13.555 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14567 fp=#0x20000001032' 2024-08-31T04:31:13.555 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14599 fp=#0x20000000f11' 2024-08-31T04:31:13.555 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14631 fp=#0x20000000fa8' 2024-08-31T04:31:13.556 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14663 fp=#0x20000000fa3' 2024-08-31T04:31:13.556 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14695 fp=#0x20000001d0b' 2024-08-31T04:31:13.557 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14759 fp=#0x100000046e8' 2024-08-31T04:31:13.557 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14791 fp=#0x10000004641' 2024-08-31T04:31:13.557 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14823 fp=#0x1000000462b' 2024-08-31T04:31:13.558 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14869 fp=#0x10000003217' 2024-08-31T04:31:13.558 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14901 fp=#0x1000000313c' 2024-08-31T04:31:13.558 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14933 fp=#0x10000003189' 2024-08-31T04:31:13.559 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14965 fp=#0x100000058b1' 2024-08-31T04:31:13.559 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14997 fp=#0x20000001768' 2024-08-31T04:31:13.559 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15029 fp=#0x2000000178d' 2024-08-31T04:31:13.560 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15061 fp=#0x20000001729' 2024-08-31T04:31:13.560 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15093 fp=#0x200000017af' 2024-08-31T04:31:13.560 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15125 fp=#0x200000017c5' 2024-08-31T04:31:13.561 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15156 fp=#0x200000021be' 2024-08-31T04:31:13.561 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15188 fp=#0x1000000171d' 2024-08-31T04:31:13.561 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15220 fp=#0x1000000176d' 2024-08-31T04:31:13.562 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15252 fp=#0x200000021c8' 2024-08-31T04:31:13.562 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15284 fp=#0x20000002277' 2024-08-31T04:31:13.562 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15316 fp=#0x20000002262' 2024-08-31T04:31:13.563 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15380 fp=#0x10000005c0b' 2024-08-31T04:31:13.563 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15412 fp=#0x20000002076' 2024-08-31T04:31:13.564 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15476 fp=#0x20000001643' 2024-08-31T04:31:13.564 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15508 fp=#0x20000001a17' 2024-08-31T04:31:13.564 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15540 fp=#0x20000001a2a' 2024-08-31T04:31:13.565 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15572 fp=#0x2000000164e' 2024-08-31T04:31:13.565 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15604 fp=#0x20000001650' 2024-08-31T04:31:13.565 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15636 fp=#0x10000004eae' 2024-08-31T04:31:13.566 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15668 fp=#0x200000018a5' 2024-08-31T04:31:13.566 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15732 fp=#0x10000004ead' 2024-08-31T04:31:13.567 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15796 fp=#0x20000002000' 2024-08-31T04:31:13.567 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15828 fp=#0x20000001fa2' 2024-08-31T04:31:13.567 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15860 fp=#0x20000001fde' 2024-08-31T04:31:13.568 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15956 fp=#0x20000001fd9' 2024-08-31T04:31:13.569 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16020 fp=#0x200000017d5' 2024-08-31T04:31:13.569 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16052 fp=#0x20000001943' 2024-08-31T04:31:13.569 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16084 fp=#0x200000017ce' 2024-08-31T04:31:13.570 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16116 fp=#0x2000000116e' 2024-08-31T04:31:13.570 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16148 fp=#0x2000000112f' 2024-08-31T04:31:13.570 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16180 fp=#0x20000001613' 2024-08-31T04:31:13.571 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16212 fp=#0x200000015bd' 2024-08-31T04:31:13.571 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16244 fp=#0x200000015c7' 2024-08-31T04:31:13.572 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16307 fp=#0x1000000452d' 2024-08-31T04:31:13.572 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16339 fp=#0x100000044ed' 2024-08-31T04:31:13.572 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16371 fp=#0x10000004839' 2024-08-31T04:31:13.573 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16403 fp=#0x10000004806' 2024-08-31T04:31:13.573 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16435 fp=#0x10000004820' 2024-08-31T04:31:13.574 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16499 fp=#0x10000004935' 2024-08-31T04:31:13.574 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16531 fp=#0x2000000114a' 2024-08-31T04:31:13.574 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16563 fp=#0x100000048f3' 2024-08-31T04:31:13.575 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16627 fp=#0x2000000229e' 2024-08-31T04:31:13.575 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16659 fp=#0x200000022b7' 2024-08-31T04:31:13.575 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16691 fp=#0x10000002b0b' 2024-08-31T04:31:13.576 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16723 fp=#0x10000002a70' 2024-08-31T04:31:13.576 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16755 fp=#0x2000000043f' 2024-08-31T04:31:13.576 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16787 fp=#0x20000000412' 2024-08-31T04:31:13.577 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16819 fp=#0x200000003fa' 2024-08-31T04:31:13.577 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16851 fp=#0x10000002a85' 2024-08-31T04:31:13.577 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16883 fp=#0x1000000457e' 2024-08-31T04:31:13.578 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16915 fp=#0x100000045b4' 2024-08-31T04:31:13.578 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16947 fp=#0x1000000455f' 2024-08-31T04:31:13.578 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16979 fp=#0x10000004545' 2024-08-31T04:31:13.580 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17203 fp=#0x10000005472' 2024-08-31T04:31:13.581 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17363 fp=#0x20000001abb' 2024-08-31T04:31:13.582 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17395 fp=#0x20000001a88' 2024-08-31T04:31:13.582 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17427 fp=#0x20000001ab8' 2024-08-31T04:31:13.582 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17459 fp=#0x10000004e33' 2024-08-31T04:31:13.582 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17491 fp=#0x10000004da8' 2024-08-31T04:31:13.583 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17523 fp=#0x20000001b7e' 2024-08-31T04:31:13.583 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17555 fp=#0x20000001b66' 2024-08-31T04:31:13.583 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17587 fp=#0x20000001aff' 2024-08-31T04:31:13.584 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17619 fp=#0x10000002a50' 2024-08-31T04:31:13.584 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17651 fp=#0x10000002a22' 2024-08-31T04:31:13.584 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17683 fp=#0x10000002a58' 2024-08-31T04:31:13.585 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17715 fp=#0x20000001f44' 2024-08-31T04:31:13.585 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17747 fp=#0x100000029d9' 2024-08-31T04:31:13.585 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17779 fp=#0x10000004f1c' 2024-08-31T04:31:13.586 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17811 fp=#0x10000004f17' 2024-08-31T04:31:13.586 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17843 fp=#0x10000004f3f' 2024-08-31T04:31:13.587 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17907 fp=#0x10000000895' 2024-08-31T04:31:13.587 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17939 fp=#0x20000001de7' 2024-08-31T04:31:13.587 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17971 fp=#0x20000001c1e' 2024-08-31T04:31:13.588 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18003 fp=#0x20000001c0c' 2024-08-31T04:31:13.588 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18035 fp=#0x20000001d1f' 2024-08-31T04:31:13.588 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18067 fp=#0x20000001782' 2024-08-31T04:31:13.589 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18099 fp=#0x20000001758' 2024-08-31T04:31:13.589 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18131 fp=#0x20000001760' 2024-08-31T04:31:13.589 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18163 fp=#0x20000000cc2' 2024-08-31T04:31:13.590 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18195 fp=#0x20000000d19' 2024-08-31T04:31:13.590 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18227 fp=#0x20000000c88' 2024-08-31T04:31:13.590 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18288 fp=#0x10000004914' 2024-08-31T04:31:13.591 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18320 fp=#0x200000022e9' 2024-08-31T04:31:13.591 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18352 fp=#0x10000004a1f' 2024-08-31T04:31:13.591 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18411 fp=#0x20000002181' 2024-08-31T04:31:13.592 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18443 fp=#0x200000021b1' 2024-08-31T04:31:13.592 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18475 fp=#0x20000002189' 2024-08-31T04:31:13.592 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18507 fp=#0x200000021b7' 2024-08-31T04:31:13.593 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18537 fp=#0x1000000360a' 2024-08-31T04:31:13.593 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18569 fp=#0x400000007a6' 2024-08-31T04:31:13.593 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:7164 fp=#0x10000000005' 2024-08-31T04:31:13.594 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:7196 fp=#0x1000000397a' 2024-08-31T04:31:13.594 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:7228 fp=#0x1000000476c' 2024-08-31T04:31:13.595 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:7292 fp=#0x20000001ad5' 2024-08-31T04:31:13.596 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:7452 fp=#0x20000001f98' 2024-08-31T04:31:13.596 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:7484 fp=#0x20000001f91' 2024-08-31T04:31:13.606 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:8787 fp=#0x200000018a0' 2024-08-31T04:31:13.606 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:8851 fp=#0x20000000628' 2024-08-31T04:31:13.607 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:8915 fp=#0x20000000633' 2024-08-31T04:31:13.607 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:8947 fp=#0x20000000624' 2024-08-31T04:31:13.608 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9043 fp=#0x20000000f69' 2024-08-31T04:31:13.608 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9075 fp=#0x20000000fc1' 2024-08-31T04:31:13.609 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9107 fp=#0x2000000088a' 2024-08-31T04:31:13.609 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9139 fp=#0x200000014fc' 2024-08-31T04:31:13.609 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9171 fp=#0x20000001c72' 2024-08-31T04:31:13.610 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9203 fp=#0x20000001cde' 2024-08-31T04:31:13.610 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9235 fp=#0x20000001cdb' 2024-08-31T04:31:13.610 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9267 fp=#0x20000001b37' 2024-08-31T04:31:13.611 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9395 fp=#0x20000001583' 2024-08-31T04:31:13.612 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9427 fp=#0x2000000096c' 2024-08-31T04:31:13.612 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9459 fp=#0x20000000978' 2024-08-31T04:31:13.612 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9491 fp=#0x200000009ab' 2024-08-31T04:31:13.613 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9523 fp=#0x2000000156f' 2024-08-31T04:31:13.613 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9555 fp=#0x20000000997' 2024-08-31T04:31:13.613 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9587 fp=#0x2000000188a' 2024-08-31T04:31:13.614 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9619 fp=#0x20000001844' 2024-08-31T04:31:13.614 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9683 fp=#0x20000000b3e' 2024-08-31T04:31:13.614 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9715 fp=#0x20000000b5b' 2024-08-31T04:31:13.615 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9747 fp=#0x20000001f78' 2024-08-31T04:31:13.615 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9779 fp=#0x20000000aee' 2024-08-31T04:31:13.615 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9811 fp=#0x20000000afd' 2024-08-31T04:31:13.616 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9843 fp=#0x20000001e4e' 2024-08-31T04:31:13.616 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9875 fp=#0x20000001e2e' 2024-08-31T04:31:13.616 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9907 fp=#0x20000001e0b' 2024-08-31T04:31:13.618 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10066 fp=#0x20000000d5c' 2024-08-31T04:31:13.618 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10098 fp=#0x20000000d44' 2024-08-31T04:31:13.618 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10130 fp=#0x20000000dcc' 2024-08-31T04:31:13.619 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10162 fp=#0x20000000d9f' 2024-08-31T04:31:13.619 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10194 fp=#0x20000000702' 2024-08-31T04:31:13.619 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10226 fp=#0x20000000fe4' 2024-08-31T04:31:13.620 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10258 fp=#0x20000001011' 2024-08-31T04:31:13.620 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10290 fp=#0x20000001083' 2024-08-31T04:31:13.620 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10322 fp=#0x20000001511' 2024-08-31T04:31:13.621 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10354 fp=#0x20000001dff' 2024-08-31T04:31:13.621 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10386 fp=#0x200000014a0' 2024-08-31T04:31:13.621 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10418 fp=#0x20000000903' 2024-08-31T04:31:13.622 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10450 fp=#0x20000000910' 2024-08-31T04:31:13.622 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10482 fp=#0x10000003ca5' 2024-08-31T04:31:13.622 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10514 fp=#0x10000003cc5' 2024-08-31T04:31:13.623 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10546 fp=#0x10000000bdf' 2024-08-31T04:31:13.623 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10578 fp=#0x10000001118' 2024-08-31T04:31:13.623 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10610 fp=#0x2000000207b' 2024-08-31T04:31:13.624 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10642 fp=#0x2000000205b' 2024-08-31T04:31:13.624 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10674 fp=#0x200000020b1' 2024-08-31T04:31:13.624 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10706 fp=#0x200000020c9' 2024-08-31T04:31:13.625 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10834 fp=#0x20000000608' 2024-08-31T04:31:13.625 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10866 fp=#0x100000033f9' 2024-08-31T04:31:13.626 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10898 fp=#0x1000000342c' 2024-08-31T04:31:13.626 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10930 fp=#0x1000000340b' 2024-08-31T04:31:13.627 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10962 fp=#0x100000033ef' 2024-08-31T04:31:13.627 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10994 fp=#0x100000039d9' 2024-08-31T04:31:13.627 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11026 fp=#0x100000039c5' 2024-08-31T04:31:13.628 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11058 fp=#0x100000039af' 2024-08-31T04:31:13.628 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11090 fp=#0x10000003dac' 2024-08-31T04:31:13.628 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11122 fp=#0x10000003d46' 2024-08-31T04:31:13.629 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11154 fp=#0x10000003a12' 2024-08-31T04:31:13.629 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11186 fp=#0x10000003bdd' 2024-08-31T04:31:13.630 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11246 fp=#0x20000000e3c' 2024-08-31T04:31:13.630 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11278 fp=#0x20000000e44' 2024-08-31T04:31:13.630 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11310 fp=#0x200000014ef' 2024-08-31T04:31:13.631 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11342 fp=#0x20000001ee7' 2024-08-31T04:31:13.631 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11374 fp=#0x2000000196f' 2024-08-31T04:31:13.631 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11406 fp=#0x20000001930' 2024-08-31T04:31:13.632 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11438 fp=#0x20000001e5d' 2024-08-31T04:31:13.632 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11470 fp=#0x20000001978' 2024-08-31T04:31:13.632 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11502 fp=#0x200000018cd' 2024-08-31T04:31:13.633 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11534 fp=#0x100000045d0' 2024-08-31T04:31:13.633 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11566 fp=#0x100000045e5' 2024-08-31T04:31:13.633 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11598 fp=#0x1000000464c' 2024-08-31T04:31:13.634 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11630 fp=#0x2000000066e' 2024-08-31T04:31:13.634 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11694 fp=#0x2000000065f' 2024-08-31T04:31:13.635 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11726 fp=#0x200000006d2' 2024-08-31T04:31:13.635 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11758 fp=#0x2000000064e' 2024-08-31T04:31:13.635 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11790 fp=#0x20000000690' 2024-08-31T04:31:13.636 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11822 fp=#0x2000000198e' 2024-08-31T04:31:13.636 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11854 fp=#0x200000022d0' 2024-08-31T04:31:13.636 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11886 fp=#0x20000000a72' 2024-08-31T04:31:13.636 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11918 fp=#0x20000000a99' 2024-08-31T04:31:13.637 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11950 fp=#0x20000000a94' 2024-08-31T04:31:13.640 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11982 fp=#0x20000000aa1' 2024-08-31T04:31:13.640 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12046 fp=#0x2000000169c' 2024-08-31T04:31:13.641 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12078 fp=#0x200000016e5' 2024-08-31T04:31:13.642 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12238 fp=#0x200000014f5' 2024-08-31T04:31:13.643 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12366 fp=#0x200000010d5' 2024-08-31T04:31:13.643 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12398 fp=#0x2000000109a' 2024-08-31T04:31:13.644 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12430 fp=#0x200000010c4' 2024-08-31T04:31:13.644 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12462 fp=#0x20000001f32' 2024-08-31T04:31:13.645 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12494 fp=#0x20000001ed3' 2024-08-31T04:31:13.645 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12526 fp=#0x20000000a26' 2024-08-31T04:31:13.645 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12558 fp=#0x200000009f5' 2024-08-31T04:31:13.646 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12590 fp=#0x20000000a00' 2024-08-31T04:31:13.646 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12622 fp=#0x200000009e4' 2024-08-31T04:31:13.646 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12654 fp=#0x20000000a54' 2024-08-31T04:31:13.647 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12686 fp=#0x10000000f07' 2024-08-31T04:31:13.647 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12718 fp=#0x2000000049a' 2024-08-31T04:31:13.647 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12750 fp=#0x200000003d1' 2024-08-31T04:31:13.648 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12782 fp=#0x10000000d10' 2024-08-31T04:31:13.648 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12814 fp=#0x20000000211' 2024-08-31T04:31:13.648 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12846 fp=#0x20000000208' 2024-08-31T04:31:13.649 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12878 fp=#0x200000020f5' 2024-08-31T04:31:13.649 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12910 fp=#0x200000020b3' 2024-08-31T04:31:13.649 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12942 fp=#0x2000000215b' 2024-08-31T04:31:13.650 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12974 fp=#0x10000002f0a' 2024-08-31T04:31:13.650 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13006 fp=#0x20000002158' 2024-08-31T04:31:13.650 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13037 fp=#0x2000000073c' 2024-08-31T04:31:13.651 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13069 fp=#0x200000007a3' 2024-08-31T04:31:13.651 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13101 fp=#0x2000000075e' 2024-08-31T04:31:13.651 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13133 fp=#0x20000000726' 2024-08-31T04:31:13.652 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13165 fp=#0x2000000079e' 2024-08-31T04:31:13.652 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13197 fp=#0x20000000747' 2024-08-31T04:31:13.652 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13229 fp=#0x20000000bf5' 2024-08-31T04:31:13.653 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13261 fp=#0x20000000ba5' 2024-08-31T04:31:13.653 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13293 fp=#0x20000000b66' 2024-08-31T04:31:13.653 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13325 fp=#0x20000000bb0' 2024-08-31T04:31:13.654 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13357 fp=#0x20000001c2d' 2024-08-31T04:31:13.654 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13389 fp=#0x20000001d5c' 2024-08-31T04:31:13.654 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13421 fp=#0x20000001cdc' 2024-08-31T04:31:13.655 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13453 fp=#0x20000001d4e' 2024-08-31T04:31:13.655 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13485 fp=#0x10000003b3e' 2024-08-31T04:31:13.656 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13544 fp=#0x20000001190' 2024-08-31T04:31:13.657 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13704 fp=#0x10000002eb0' 2024-08-31T04:31:13.657 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13736 fp=#0x10000002e3e' 2024-08-31T04:31:13.657 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13768 fp=#0x10000002ecc' 2024-08-31T04:31:13.658 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13800 fp=#0x20000000824' 2024-08-31T04:31:13.658 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13832 fp=#0x20000000827' 2024-08-31T04:31:13.658 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13864 fp=#0x20000000ccd' 2024-08-31T04:31:13.659 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13896 fp=#0x20000000d6d' 2024-08-31T04:31:13.659 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13928 fp=#0x20000002251' 2024-08-31T04:31:13.659 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13960 fp=#0x20000000d1a' 2024-08-31T04:31:13.660 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13992 fp=#0x20000002236' 2024-08-31T04:31:13.660 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14024 fp=#0x200000019c3' 2024-08-31T04:31:13.660 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14056 fp=#0x20000001a16' 2024-08-31T04:31:13.661 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14088 fp=#0x20000001a20' 2024-08-31T04:31:13.661 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14120 fp=#0x20000000949' 2024-08-31T04:31:13.661 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14184 fp=#0x200000008b9' 2024-08-31T04:31:13.662 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14216 fp=#0x2000000094a' 2024-08-31T04:31:13.662 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14248 fp=#0x200000008a6' 2024-08-31T04:31:13.663 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14344 fp=#0x20000001dd5' 2024-08-31T04:31:13.664 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14408 fp=#0x20000001da4' 2024-08-31T04:31:13.664 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14440 fp=#0x200000018e7' 2024-08-31T04:31:13.664 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14472 fp=#0x2000000184c' 2024-08-31T04:31:13.664 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14504 fp=#0x2000000181d' 2024-08-31T04:31:13.665 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14536 fp=#0x200000018b3' 2024-08-31T04:31:13.665 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14568 fp=#0x20000000f87' 2024-08-31T04:31:13.665 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14600 fp=#0x20000001034' 2024-08-31T04:31:13.666 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14632 fp=#0x2000000102d' 2024-08-31T04:31:13.666 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14664 fp=#0x20000000fc3' 2024-08-31T04:31:13.666 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14696 fp=#0x20000000f36' 2024-08-31T04:31:13.667 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14728 fp=#0x100000046de' 2024-08-31T04:31:13.667 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14792 fp=#0x10000004638' 2024-08-31T04:31:13.668 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14824 fp=#0x10000004636' 2024-08-31T04:31:13.668 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14870 fp=#0x10000003121' 2024-08-31T04:31:13.669 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14902 fp=#0x1000000322f' 2024-08-31T04:31:13.669 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14934 fp=#0x10000003181' 2024-08-31T04:31:13.669 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14966 fp=#0x100000058bf' 2024-08-31T04:31:13.670 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14998 fp=#0x2000000180a' 2024-08-31T04:31:13.670 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15030 fp=#0x200000017bd' 2024-08-31T04:31:13.670 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15062 fp=#0x200000017a2' 2024-08-31T04:31:13.670 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15094 fp=#0x200000017b8' 2024-08-31T04:31:13.671 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15126 fp=#0x200000017b2' 2024-08-31T04:31:13.671 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15157 fp=#0x100000057ae' 2024-08-31T04:31:13.672 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15189 fp=#0x100000017ab' 2024-08-31T04:31:13.672 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15221 fp=#0x10000001709' 2024-08-31T04:31:13.672 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15253 fp=#0x2000000224f' 2024-08-31T04:31:13.672 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15285 fp=#0x20000002221' 2024-08-31T04:31:13.673 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15317 fp=#0x20000002255' 2024-08-31T04:31:13.674 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15477 fp=#0x10000005335' 2024-08-31T04:31:13.675 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15509 fp=#0x20000001a14' 2024-08-31T04:31:13.675 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15541 fp=#0x200000019e6' 2024-08-31T04:31:13.675 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15573 fp=#0x20000001652' 2024-08-31T04:31:13.676 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15605 fp=#0x200000019ea' 2024-08-31T04:31:13.676 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15637 fp=#0x10000004ec2' 2024-08-31T04:31:13.676 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15669 fp=#0x10000004de5' 2024-08-31T04:31:13.677 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15701 fp=#0x10000004e0a' 2024-08-31T04:31:13.677 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15733 fp=#0x10000004e2b' 2024-08-31T04:31:13.677 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15797 fp=#0x20000002014' 2024-08-31T04:31:13.678 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15861 fp=#0x20000001fad' 2024-08-31T04:31:13.679 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16021 fp=#0x200000017d7' 2024-08-31T04:31:13.679 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16053 fp=#0x20000000ea1' 2024-08-31T04:31:13.680 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16085 fp=#0x200000011a7' 2024-08-31T04:31:13.680 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16117 fp=#0x2000000110a' 2024-08-31T04:31:13.680 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16149 fp=#0x2000000111b' 2024-08-31T04:31:13.681 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16181 fp=#0x200000015bf' 2024-08-31T04:31:13.681 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16213 fp=#0x200000015b0' 2024-08-31T04:31:13.681 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16245 fp=#0x20000001598' 2024-08-31T04:31:13.682 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16308 fp=#0x10000004829' 2024-08-31T04:31:13.682 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16340 fp=#0x100000047f5' 2024-08-31T04:31:13.682 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16372 fp=#0x100000047ff' 2024-08-31T04:31:13.683 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16404 fp=#0x100000044f1' 2024-08-31T04:31:13.683 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16436 fp=#0x1000000482e' 2024-08-31T04:31:13.683 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16468 fp=#0x2000000119c' 2024-08-31T04:31:13.684 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16500 fp=#0x20000001143' 2024-08-31T04:31:13.684 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16564 fp=#0x10000004930' 2024-08-31T04:31:13.684 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16596 fp=#0x20000001e17' 2024-08-31T04:31:13.685 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16628 fp=#0x200000022b2' 2024-08-31T04:31:13.685 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16660 fp=#0x2000000229f' 2024-08-31T04:31:13.685 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16692 fp=#0x20000000440' 2024-08-31T04:31:13.686 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16724 fp=#0x200000003fd' 2024-08-31T04:31:13.686 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16756 fp=#0x10000002a76' 2024-08-31T04:31:13.686 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16788 fp=#0x20000001897' 2024-08-31T04:31:13.687 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16820 fp=#0x10000002ab9' 2024-08-31T04:31:13.687 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16852 fp=#0x10000002ac6' 2024-08-31T04:31:13.687 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16884 fp=#0x1000000459b' 2024-08-31T04:31:13.688 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16916 fp=#0x10000005d41' 2024-08-31T04:31:13.688 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16948 fp=#0x1000000455a' 2024-08-31T04:31:13.689 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16980 fp=#0x1000000455e' 2024-08-31T04:31:13.689 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17044 fp=#0x2000000104e' 2024-08-31T04:31:13.690 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17108 fp=#0x1000000573b' 2024-08-31T04:31:13.690 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17140 fp=#0x10000005797' 2024-08-31T04:31:13.690 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17204 fp=#0x100000054ed' 2024-08-31T04:31:13.691 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17236 fp=#0x100000054ca' 2024-08-31T04:31:13.691 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17300 fp=#0x10000005483' 2024-08-31T04:31:13.692 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17364 fp=#0x20000001ab1' 2024-08-31T04:31:13.692 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17396 fp=#0x20000001a92' 2024-08-31T04:31:13.693 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17428 fp=#0x20000001a75' 2024-08-31T04:31:13.693 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17460 fp=#0x10000004e27' 2024-08-31T04:31:13.693 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17492 fp=#0x10000004da5' 2024-08-31T04:31:13.694 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17524 fp=#0x20000001b76' 2024-08-31T04:31:13.694 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17556 fp=#0x20000001ae8' 2024-08-31T04:31:13.694 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17588 fp=#0x20000001b1a' 2024-08-31T04:31:13.695 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17620 fp=#0x2000000056c' 2024-08-31T04:31:13.695 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17652 fp=#0x100000029c7' 2024-08-31T04:31:13.695 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17684 fp=#0x20000001f14' 2024-08-31T04:31:13.696 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17748 fp=#0x100000029e5' 2024-08-31T04:31:13.696 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17780 fp=#0x10000004f20' 2024-08-31T04:31:13.696 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17812 fp=#0x10000004f1e' 2024-08-31T04:31:13.697 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17844 fp=#0x10000004eda' 2024-08-31T04:31:13.697 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17876 fp=#0x1000000082e' 2024-08-31T04:31:13.698 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17908 fp=#0x1000000114a' 2024-08-31T04:31:13.698 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17972 fp=#0x20000001c17' 2024-08-31T04:31:13.698 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18004 fp=#0x20000001c81' 2024-08-31T04:31:13.699 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18036 fp=#0x20000001c74' 2024-08-31T04:31:13.699 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18068 fp=#0x20000001744' 2024-08-31T04:31:13.699 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18100 fp=#0x20000001d80' 2024-08-31T04:31:13.700 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18132 fp=#0x20000001752' 2024-08-31T04:31:13.700 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18164 fp=#0x20000000c3a' 2024-08-31T04:31:13.700 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18196 fp=#0x20000000c9e' 2024-08-31T04:31:13.701 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18228 fp=#0x20000000c7d' 2024-08-31T04:31:13.701 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18289 fp=#0x20000000848' 2024-08-31T04:31:13.702 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18321 fp=#0x10000004a31' 2024-08-31T04:31:13.702 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18385 fp=#0x200000022d6' 2024-08-31T04:31:13.703 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18412 fp=#0x2000000220a' 2024-08-31T04:31:13.703 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18444 fp=#0x200000021aa' 2024-08-31T04:31:13.703 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18476 fp=#0x2000000217f' 2024-08-31T04:31:13.704 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18508 fp=#0x20000002198' 2024-08-31T04:31:13.704 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18538 fp=#0x10000003986' 2024-08-31T04:31:13.704 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18570 fp=#0x10000003637' 2024-08-31T04:31:13.705 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:7165 fp=#0x10000000006' 2024-08-31T04:31:13.705 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:7197 fp=#0x20000000e38' 2024-08-31T04:31:13.706 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:7229 fp=#0x10000003578' 2024-08-31T04:31:13.706 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:7293 fp=#0x100000029c0' 2024-08-31T04:31:13.707 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:7453 fp=#0x2000000202b' 2024-08-31T04:31:13.717 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:8733 fp=#0x200000011d7' 2024-08-31T04:31:13.717 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:8756 fp=#0x20000000841' 2024-08-31T04:31:13.718 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:8788 fp=#0x200000007c1' 2024-08-31T04:31:13.718 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:8884 fp=#0x2000000065e' 2024-08-31T04:31:13.719 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:8916 fp=#0x2000000067f' 2024-08-31T04:31:13.719 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:8948 fp=#0x20000000696' 2024-08-31T04:31:13.720 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9012 fp=#0x2000000183d' 2024-08-31T04:31:13.721 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9108 fp=#0x20000001d50' 2024-08-31T04:31:13.721 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9140 fp=#0x20000001d65' 2024-08-31T04:31:13.721 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9172 fp=#0x20000000898' 2024-08-31T04:31:13.722 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9204 fp=#0x20000000887' 2024-08-31T04:31:13.722 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9236 fp=#0x20000001cf3' 2024-08-31T04:31:13.723 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9396 fp=#0x2000000157a' 2024-08-31T04:31:13.724 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9428 fp=#0x200000009bc' 2024-08-31T04:31:13.724 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9460 fp=#0x20000000982' 2024-08-31T04:31:13.724 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9492 fp=#0x20000001551' 2024-08-31T04:31:13.725 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9524 fp=#0x2000000095b' 2024-08-31T04:31:13.725 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9556 fp=#0x200000009a2' 2024-08-31T04:31:13.725 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9588 fp=#0x2000000185a' 2024-08-31T04:31:13.726 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9620 fp=#0x2000000149e' 2024-08-31T04:31:13.726 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9652 fp=#0x20000001868' 2024-08-31T04:31:13.726 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9684 fp=#0x20000000b61' 2024-08-31T04:31:13.727 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9716 fp=#0x20000000b47' 2024-08-31T04:31:13.727 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9748 fp=#0x20000000b2a' 2024-08-31T04:31:13.727 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9780 fp=#0x20000001103' 2024-08-31T04:31:13.728 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9812 fp=#0x20000000b03' 2024-08-31T04:31:13.728 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9844 fp=#0x20000001de5' 2024-08-31T04:31:13.728 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9876 fp=#0x20000001eb3' 2024-08-31T04:31:13.729 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9908 fp=#0x20000001e36' 2024-08-31T04:31:13.730 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10067 fp=#0x20000000e31' 2024-08-31T04:31:13.730 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10099 fp=#0x20000000d5e' 2024-08-31T04:31:13.731 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10131 fp=#0x20000000da1' 2024-08-31T04:31:13.731 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10163 fp=#0x20000000e10' 2024-08-31T04:31:13.731 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10195 fp=#0x200000006e1' 2024-08-31T04:31:13.732 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10227 fp=#0x2000000102e' 2024-08-31T04:31:13.732 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10259 fp=#0x20000001074' 2024-08-31T04:31:13.733 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10291 fp=#0x200000022a3' 2024-08-31T04:31:13.733 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10323 fp=#0x20000000927' 2024-08-31T04:31:13.733 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10355 fp=#0x20000000920' 2024-08-31T04:31:13.734 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10387 fp=#0x2000000150d' 2024-08-31T04:31:13.734 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10419 fp=#0x20000000932' 2024-08-31T04:31:13.734 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10451 fp=#0x200000014da' 2024-08-31T04:31:13.735 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10483 fp=#0x10000003c83' 2024-08-31T04:31:13.735 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10515 fp=#0x10000000ba4' 2024-08-31T04:31:13.735 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10547 fp=#0x10000001136' 2024-08-31T04:31:13.736 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10579 fp=#0x10000001142' 2024-08-31T04:31:13.736 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10611 fp=#0x200000020a4' 2024-08-31T04:31:13.736 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10643 fp=#0x2000000204d' 2024-08-31T04:31:13.737 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10675 fp=#0x20000002086' 2024-08-31T04:31:13.737 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10707 fp=#0x2000000205f' 2024-08-31T04:31:13.738 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10835 fp=#0x10000003412' 2024-08-31T04:31:13.739 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10867 fp=#0x200000005d3' 2024-08-31T04:31:13.739 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10899 fp=#0x200000005eb' 2024-08-31T04:31:13.739 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10931 fp=#0x20000001f4c' 2024-08-31T04:31:13.739 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10963 fp=#0x10000003455' 2024-08-31T04:31:13.740 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10995 fp=#0x10000003dd2' 2024-08-31T04:31:13.740 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11027 fp=#0x10000003d54' 2024-08-31T04:31:13.741 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11059 fp=#0x10000003bf2' 2024-08-31T04:31:13.741 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11091 fp=#0x10000003d35' 2024-08-31T04:31:13.741 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11123 fp=#0x10000003ce6' 2024-08-31T04:31:13.742 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11155 fp=#0x100000039c1' 2024-08-31T04:31:13.742 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11187 fp=#0x10000003b7a' 2024-08-31T04:31:13.742 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11247 fp=#0x20000000e8d' 2024-08-31T04:31:13.743 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11279 fp=#0x20000000e6c' 2024-08-31T04:31:13.743 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11311 fp=#0x20000000e3d' 2024-08-31T04:31:13.743 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11343 fp=#0x20000001ecc' 2024-08-31T04:31:13.744 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11375 fp=#0x20000001e7f' 2024-08-31T04:31:13.744 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11407 fp=#0x2000000194a' 2024-08-31T04:31:13.744 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11439 fp=#0x200000018b0' 2024-08-31T04:31:13.745 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11471 fp=#0x2000000195a' 2024-08-31T04:31:13.745 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11503 fp=#0x2000000193e' 2024-08-31T04:31:13.745 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11535 fp=#0x1000000464e' 2024-08-31T04:31:13.746 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11567 fp=#0x10000004596' 2024-08-31T04:31:13.746 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11599 fp=#0x100000045ff' 2024-08-31T04:31:13.747 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11631 fp=#0x200000006ca' 2024-08-31T04:31:13.747 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11663 fp=#0x200000006d6' 2024-08-31T04:31:13.747 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11727 fp=#0x20000001985' 2024-08-31T04:31:13.748 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11759 fp=#0x2000000069c' 2024-08-31T04:31:13.748 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11791 fp=#0x20000001980' 2024-08-31T04:31:13.749 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11823 fp=#0x20000001986' 2024-08-31T04:31:13.749 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11855 fp=#0x200000022db' 2024-08-31T04:31:13.749 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11887 fp=#0x20000000abc' 2024-08-31T04:31:13.750 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11919 fp=#0x20000000a9d' 2024-08-31T04:31:13.750 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11951 fp=#0x20000000a8f' 2024-08-31T04:31:13.750 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11983 fp=#0x20000001651' 2024-08-31T04:31:13.751 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12015 fp=#0x20000001693' 2024-08-31T04:31:13.751 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12047 fp=#0x200000016ba' 2024-08-31T04:31:13.751 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12079 fp=#0x200000016c8' 2024-08-31T04:31:13.752 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12111 fp=#0x20000001f92' 2024-08-31T04:31:13.752 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12143 fp=#0x200000014f9' 2024-08-31T04:31:13.753 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12207 fp=#0x200000014c8' 2024-08-31T04:31:13.754 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12335 fp=#0x20000001fbf' 2024-08-31T04:31:13.754 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12367 fp=#0x20000001075' 2024-08-31T04:31:13.754 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12399 fp=#0x200000010db' 2024-08-31T04:31:13.755 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12431 fp=#0x20000001055' 2024-08-31T04:31:13.755 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12463 fp=#0x20000001f45' 2024-08-31T04:31:13.755 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12495 fp=#0x20000001f0d' 2024-08-31T04:31:13.756 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12527 fp=#0x20000000a65' 2024-08-31T04:31:13.756 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12559 fp=#0x20000000a53' 2024-08-31T04:31:13.756 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12591 fp=#0x20000000a0d' 2024-08-31T04:31:13.757 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12623 fp=#0x20000000a3c' 2024-08-31T04:31:13.757 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12655 fp=#0x20000000a4d' 2024-08-31T04:31:13.757 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12687 fp=#0x200000003f2' 2024-08-31T04:31:13.758 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12719 fp=#0x20000000234' 2024-08-31T04:31:13.758 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12751 fp=#0x200000003f6' 2024-08-31T04:31:13.758 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12783 fp=#0x10000000eaf' 2024-08-31T04:31:13.759 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12815 fp=#0x200000003f7' 2024-08-31T04:31:13.759 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12847 fp=#0x10000000edf' 2024-08-31T04:31:13.759 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12879 fp=#0x10000002e9b' 2024-08-31T04:31:13.760 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12911 fp=#0x2000000211e' 2024-08-31T04:31:13.760 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12975 fp=#0x200000020fc' 2024-08-31T04:31:13.761 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13007 fp=#0x2000000214a' 2024-08-31T04:31:13.761 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13038 fp=#0x200000007b0' 2024-08-31T04:31:13.761 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13070 fp=#0x2000000075a' 2024-08-31T04:31:13.762 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13102 fp=#0x200000007af' 2024-08-31T04:31:13.762 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13134 fp=#0x2000000079c' 2024-08-31T04:31:13.764 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13166 fp=#0x20000000734' 2024-08-31T04:31:13.765 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13198 fp=#0x20000000764' 2024-08-31T04:31:13.765 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13230 fp=#0x20000000b7f' 2024-08-31T04:31:13.765 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13262 fp=#0x20000000b9b' 2024-08-31T04:31:13.766 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13294 fp=#0x20000000be4' 2024-08-31T04:31:13.766 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13326 fp=#0x20000000b97' 2024-08-31T04:31:13.766 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13358 fp=#0x20000001d55' 2024-08-31T04:31:13.767 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13390 fp=#0x20000001d38' 2024-08-31T04:31:13.767 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13422 fp=#0x20000001c77' 2024-08-31T04:31:13.767 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13454 fp=#0x20000001c37' 2024-08-31T04:31:13.768 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13486 fp=#0x10000003b6a' 2024-08-31T04:31:13.768 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13545 fp=#0x20000001183' 2024-08-31T04:31:13.768 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13577 fp=#0x20000002100' 2024-08-31T04:31:13.769 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13609 fp=#0x200000011a9' 2024-08-31T04:31:13.769 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13673 fp=#0x200000007b4' 2024-08-31T04:31:13.770 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13705 fp=#0x10000002e2a' 2024-08-31T04:31:13.772 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13737 fp=#0x10000002eff' 2024-08-31T04:31:13.773 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13769 fp=#0x10000002e25' 2024-08-31T04:31:13.773 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13801 fp=#0x200000010ea' 2024-08-31T04:31:13.773 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13833 fp=#0x20000000809' 2024-08-31T04:31:13.774 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13865 fp=#0x20000000cc6' 2024-08-31T04:31:13.774 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13897 fp=#0x20000002045' 2024-08-31T04:31:13.775 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13929 fp=#0x20000000cb8' 2024-08-31T04:31:13.775 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13961 fp=#0x20000000cec' 2024-08-31T04:31:13.775 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13993 fp=#0x20000000da3' 2024-08-31T04:31:13.775 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14025 fp=#0x200000019ed' 2024-08-31T04:31:13.776 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14057 fp=#0x200000019c8' 2024-08-31T04:31:13.776 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14089 fp=#0x200000019d1' 2024-08-31T04:31:13.777 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14121 fp=#0x200000010a8' 2024-08-31T04:31:13.777 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14153 fp=#0x200000008b0' 2024-08-31T04:31:13.777 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14185 fp=#0x200000008be' 2024-08-31T04:31:13.778 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14217 fp=#0x200000008f6' 2024-08-31T04:31:13.778 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14249 fp=#0x200000008dc' 2024-08-31T04:31:13.778 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14313 fp=#0x20000001da6' 2024-08-31T04:31:13.779 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14345 fp=#0x20000001dad' 2024-08-31T04:31:13.779 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14377 fp=#0x20000001dd0' 2024-08-31T04:31:13.779 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14409 fp=#0x20000001e2c' 2024-08-31T04:31:13.780 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14441 fp=#0x2000000194e' 2024-08-31T04:31:13.780 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14473 fp=#0x20000001869' 2024-08-31T04:31:13.780 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14505 fp=#0x2000000181c' 2024-08-31T04:31:13.781 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14537 fp=#0x200000018ae' 2024-08-31T04:31:13.781 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14569 fp=#0x20000000f0d' 2024-08-31T04:31:13.781 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14601 fp=#0x20000000ffb' 2024-08-31T04:31:13.782 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14633 fp=#0x20000000f7f' 2024-08-31T04:31:13.782 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14665 fp=#0x20000000f62' 2024-08-31T04:31:13.782 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14697 fp=#0x20000000f39' 2024-08-31T04:31:13.782 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14729 fp=#0x100000046f3' 2024-08-31T04:31:13.783 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14793 fp=#0x100000046d4' 2024-08-31T04:31:13.784 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14871 fp=#0x10000003129' 2024-08-31T04:31:13.784 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14903 fp=#0x100000031f1' 2024-08-31T04:31:13.784 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14935 fp=#0x100000030ed' 2024-08-31T04:31:13.785 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14967 fp=#0x1000000589c' 2024-08-31T04:31:13.785 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14999 fp=#0x200000017c4' 2024-08-31T04:31:13.785 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15031 fp=#0x200000017a3' 2024-08-31T04:31:13.786 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15063 fp=#0x200000017b4' 2024-08-31T04:31:13.786 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15095 fp=#0x20000001787' 2024-08-31T04:31:13.786 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15127 fp=#0x200000017a4' 2024-08-31T04:31:13.787 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15158 fp=#0x100000057a8' 2024-08-31T04:31:13.787 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15190 fp=#0x10000004472' 2024-08-31T04:31:13.787 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15254 fp=#0x200000021e9' 2024-08-31T04:31:13.788 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15286 fp=#0x20000002246' 2024-08-31T04:31:13.788 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15318 fp=#0x200000021e4' 2024-08-31T04:31:13.789 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15350 fp=#0x2000000208e' 2024-08-31T04:31:13.789 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15478 fp=#0x20000001a3b' 2024-08-31T04:31:13.790 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15510 fp=#0x1000000533f' 2024-08-31T04:31:13.790 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15542 fp=#0x20000001a26' 2024-08-31T04:31:13.790 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15574 fp=#0x10000005343' 2024-08-31T04:31:13.791 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15606 fp=#0x20000001632' 2024-08-31T04:31:13.791 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15638 fp=#0x10000004e78' 2024-08-31T04:31:13.792 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15702 fp=#0x10000004ebd' 2024-08-31T04:31:13.792 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15734 fp=#0x10000004eb8' 2024-08-31T04:31:13.794 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16022 fp=#0x20000000eba' 2024-08-31T04:31:13.794 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16054 fp=#0x20000000ea4' 2024-08-31T04:31:13.795 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16086 fp=#0x20000001191' 2024-08-31T04:31:13.795 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16118 fp=#0x20000001112' 2024-08-31T04:31:13.795 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16150 fp=#0x20000001106' 2024-08-31T04:31:13.796 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16182 fp=#0x20000001607' 2024-08-31T04:31:13.796 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16214 fp=#0x200000015ce' 2024-08-31T04:31:13.796 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16246 fp=#0x200000015b4' 2024-08-31T04:31:13.797 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16277 fp=#0x10000004526' 2024-08-31T04:31:13.797 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16309 fp=#0x1000000482d' 2024-08-31T04:31:13.797 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16341 fp=#0x10000004809' 2024-08-31T04:31:13.798 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16373 fp=#0x10000004802' 2024-08-31T04:31:13.798 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16405 fp=#0x10000004524' 2024-08-31T04:31:13.798 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16437 fp=#0x100000044e1' 2024-08-31T04:31:13.799 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16469 fp=#0x10000004b1c' 2024-08-31T04:31:13.799 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16501 fp=#0x20000001144' 2024-08-31T04:31:13.799 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16565 fp=#0x2000000113e' 2024-08-31T04:31:13.800 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16629 fp=#0x20000002289' 2024-08-31T04:31:13.800 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16661 fp=#0x200000022b0' 2024-08-31T04:31:13.801 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16693 fp=#0x10000002a90' 2024-08-31T04:31:13.801 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16725 fp=#0x2000000040b' 2024-08-31T04:31:13.801 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16757 fp=#0x20000000447' 2024-08-31T04:31:13.802 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16789 fp=#0x10000002ae0' 2024-08-31T04:31:13.802 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16821 fp=#0x10000002aa8' 2024-08-31T04:31:13.802 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16853 fp=#0x2000000041d' 2024-08-31T04:31:13.803 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16917 fp=#0x1000000456c' 2024-08-31T04:31:13.803 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16949 fp=#0x1000000454f' 2024-08-31T04:31:13.803 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16981 fp=#0x1000000456a' 2024-08-31T04:31:13.804 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17109 fp=#0x10000005782' 2024-08-31T04:31:13.805 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17205 fp=#0x100000054ce' 2024-08-31T04:31:13.806 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17237 fp=#0x100000054d8' 2024-08-31T04:31:13.806 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17269 fp=#0x100000054ee' 2024-08-31T04:31:13.806 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17301 fp=#0x100000054e5' 2024-08-31T04:31:13.807 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17365 fp=#0x20000001a98' 2024-08-31T04:31:13.807 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17397 fp=#0x20000001aa9' 2024-08-31T04:31:13.807 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17429 fp=#0x20000001a9d' 2024-08-31T04:31:13.808 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17461 fp=#0x10000004d90' 2024-08-31T04:31:13.808 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17493 fp=#0x10000004d65' 2024-08-31T04:31:13.808 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17525 fp=#0x20000001ada' 2024-08-31T04:31:13.809 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17557 fp=#0x20000001af9' 2024-08-31T04:31:13.809 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17589 fp=#0x20000001b70' 2024-08-31T04:31:13.809 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17621 fp=#0x10000002a4b' 2024-08-31T04:31:13.810 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17653 fp=#0x2000000049b' 2024-08-31T04:31:13.810 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17685 fp=#0x20000001f60' 2024-08-31T04:31:13.810 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17717 fp=#0x10000002a31' 2024-08-31T04:31:13.811 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17749 fp=#0x10000002a11' 2024-08-31T04:31:13.811 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17781 fp=#0x10000004f31' 2024-08-31T04:31:13.811 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17813 fp=#0x10000004f04' 2024-08-31T04:31:13.812 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17845 fp=#0x10000004ee1' 2024-08-31T04:31:13.813 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17973 fp=#0x20000001d48' 2024-08-31T04:31:13.813 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18005 fp=#0x20000001c8e' 2024-08-31T04:31:13.813 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18037 fp=#0x20000001d35' 2024-08-31T04:31:13.814 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18069 fp=#0x20000001d7d' 2024-08-31T04:31:13.814 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18101 fp=#0x200000016fb' 2024-08-31T04:31:13.814 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18133 fp=#0x200000016f6' 2024-08-31T04:31:13.815 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18165 fp=#0x20000000c69' 2024-08-31T04:31:13.815 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18197 fp=#0x20000000c5e' 2024-08-31T04:31:13.815 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18229 fp=#0x20000000c34' 2024-08-31T04:31:13.816 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18290 fp=#0x100000049e7' 2024-08-31T04:31:13.816 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18322 fp=#0x200000022d4' 2024-08-31T04:31:13.816 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18354 fp=#0x200000022d9' 2024-08-31T04:31:13.817 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18413 fp=#0x200000021f1' 2024-08-31T04:31:13.817 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18445 fp=#0x2000000217d' 2024-08-31T04:31:13.817 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18477 fp=#0x20000002231' 2024-08-31T04:31:13.818 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18509 fp=#0x200000021fa' 2024-08-31T04:31:13.818 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18539 fp=#0x10000003a04' 2024-08-31T04:31:13.818 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18571 fp=#0x100000039f8' 2024-08-31T04:31:13.819 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:7166 fp=#0x10000000201' 2024-08-31T04:31:13.819 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:7198 fp=#0x20000001899' 2024-08-31T04:31:13.820 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:7294 fp=#0x10000004ed3' 2024-08-31T04:31:13.821 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:7422 fp=#0x20000001f8f' 2024-08-31T04:31:13.822 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:7486 fp=#0x20000002029' 2024-08-31T04:31:13.822 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:7518 fp=#0x20000001f88' 2024-08-31T04:31:13.822 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:7550 fp=#0x20000001ffd' 2024-08-31T04:31:13.832 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:8853 fp=#0x2000000068c' 2024-08-31T04:31:13.833 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:8885 fp=#0x2000000065c' 2024-08-31T04:31:13.833 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:8981 fp=#0x200000018cb' 2024-08-31T04:31:13.834 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9013 fp=#0x2000000185c' 2024-08-31T04:31:13.835 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9109 fp=#0x20000000899' 2024-08-31T04:31:13.835 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9141 fp=#0x20000001d61' 2024-08-31T04:31:13.835 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9173 fp=#0x20000001d58' 2024-08-31T04:31:13.835 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9205 fp=#0x2000000086e' 2024-08-31T04:31:13.836 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9237 fp=#0x20000001c79' 2024-08-31T04:31:13.837 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9397 fp=#0x20000001569' 2024-08-31T04:31:13.837 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9429 fp=#0x2000000099b' 2024-08-31T04:31:13.838 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9461 fp=#0x200000009d0' 2024-08-31T04:31:13.838 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9493 fp=#0x2000000098d' 2024-08-31T04:31:13.838 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9525 fp=#0x200000009c0' 2024-08-31T04:31:13.839 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9557 fp=#0x20000001570' 2024-08-31T04:31:13.839 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9621 fp=#0x20000001874' 2024-08-31T04:31:13.840 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9653 fp=#0x200000018dd' 2024-08-31T04:31:13.840 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9685 fp=#0x20000000b00' 2024-08-31T04:31:13.840 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9717 fp=#0x20000000af4' 2024-08-31T04:31:13.841 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9749 fp=#0x20000000b57' 2024-08-31T04:31:13.841 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9781 fp=#0x20000000b18' 2024-08-31T04:31:13.841 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9813 fp=#0x20000000b15' 2024-08-31T04:31:13.842 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9845 fp=#0x20000001f06' 2024-08-31T04:31:13.842 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9877 fp=#0x20000001e5e' 2024-08-31T04:31:13.842 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:9909 fp=#0x20000001e9e' 2024-08-31T04:31:13.843 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10068 fp=#0x20000000d30' 2024-08-31T04:31:13.844 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10100 fp=#0x20000000d73' 2024-08-31T04:31:13.844 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10132 fp=#0x20000000e00' 2024-08-31T04:31:13.844 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10164 fp=#0x20000000e03' 2024-08-31T04:31:13.845 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10196 fp=#0x200000006fa' 2024-08-31T04:31:13.845 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10228 fp=#0x200000006e8' 2024-08-31T04:31:13.845 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10260 fp=#0x200000006f6' 2024-08-31T04:31:13.846 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10292 fp=#0x20000001c2b' 2024-08-31T04:31:13.846 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10324 fp=#0x200000014dc' 2024-08-31T04:31:13.846 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10356 fp=#0x20000000905' 2024-08-31T04:31:13.847 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10388 fp=#0x200000014fb' 2024-08-31T04:31:13.847 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10420 fp=#0x200000014b7' 2024-08-31T04:31:13.847 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10452 fp=#0x20000000914' 2024-08-31T04:31:13.848 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10484 fp=#0x1000000112a' 2024-08-31T04:31:13.848 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10516 fp=#0x20000000778' 2024-08-31T04:31:13.848 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10548 fp=#0x10000001163' 2024-08-31T04:31:13.849 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10580 fp=#0x1000000111d' 2024-08-31T04:31:13.849 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10612 fp=#0x20000002120' 2024-08-31T04:31:13.849 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10644 fp=#0x20000002102' 2024-08-31T04:31:13.850 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10676 fp=#0x20000002084' 2024-08-31T04:31:13.850 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10708 fp=#0x200000020e9' 2024-08-31T04:31:13.851 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10836 fp=#0x100000033ed' 2024-08-31T04:31:13.851 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10868 fp=#0x10000003406' 2024-08-31T04:31:13.852 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10900 fp=#0x20000001e89' 2024-08-31T04:31:13.852 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10932 fp=#0x2000000168d' 2024-08-31T04:31:13.852 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10964 fp=#0x2000000060b' 2024-08-31T04:31:13.853 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:10996 fp=#0x10000003bba' 2024-08-31T04:31:13.853 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11028 fp=#0x10000003d78' 2024-08-31T04:31:13.853 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11060 fp=#0x10000003cd1' 2024-08-31T04:31:13.854 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11092 fp=#0x10000003da1' 2024-08-31T04:31:13.854 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11188 fp=#0x10000003db2' 2024-08-31T04:31:13.855 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11248 fp=#0x20000000e7f' 2024-08-31T04:31:13.855 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11280 fp=#0x20000000e51' 2024-08-31T04:31:13.855 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11312 fp=#0x20000000e8e' 2024-08-31T04:31:13.856 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11344 fp=#0x200000018b5' 2024-08-31T04:31:13.856 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11376 fp=#0x20000001e82' 2024-08-31T04:31:13.856 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11408 fp=#0x20000001df0' 2024-08-31T04:31:13.857 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11440 fp=#0x200000018bd' 2024-08-31T04:31:13.857 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11472 fp=#0x2000000193c' 2024-08-31T04:31:13.857 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11504 fp=#0x20000001987' 2024-08-31T04:31:13.858 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11536 fp=#0x200000016ac' 2024-08-31T04:31:13.858 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11568 fp=#0x100000045f0' 2024-08-31T04:31:13.858 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11600 fp=#0x100000045e9' 2024-08-31T04:31:13.859 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11664 fp=#0x20000001995' 2024-08-31T04:31:13.859 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11696 fp=#0x20000000651' 2024-08-31T04:31:13.860 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11760 fp=#0x2000000066c' 2024-08-31T04:31:13.860 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11792 fp=#0x20000000658' 2024-08-31T04:31:13.860 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11824 fp=#0x20000000653' 2024-08-31T04:31:13.861 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11856 fp=#0x200000022ec' 2024-08-31T04:31:13.861 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11888 fp=#0x20000000a80' 2024-08-31T04:31:13.862 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11920 fp=#0x20000001639' 2024-08-31T04:31:13.862 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11952 fp=#0x20000000a85' 2024-08-31T04:31:13.862 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:11984 fp=#0x20000001631' 2024-08-31T04:31:13.862 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12016 fp=#0x200000016be' 2024-08-31T04:31:13.863 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12048 fp=#0x2000000169d' 2024-08-31T04:31:13.863 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12080 fp=#0x200000016df' 2024-08-31T04:31:13.865 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12336 fp=#0x20000001508' 2024-08-31T04:31:13.865 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12368 fp=#0x200000010ce' 2024-08-31T04:31:13.866 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12400 fp=#0x2000000108b' 2024-08-31T04:31:13.866 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12432 fp=#0x200000010be' 2024-08-31T04:31:13.866 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12464 fp=#0x20000001f39' 2024-08-31T04:31:13.867 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12496 fp=#0x20000001ec2' 2024-08-31T04:31:13.867 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12528 fp=#0x20000000a05' 2024-08-31T04:31:13.867 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12560 fp=#0x20000000a67' 2024-08-31T04:31:13.868 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12592 fp=#0x20000000a17' 2024-08-31T04:31:13.868 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12624 fp=#0x20000000a0a' 2024-08-31T04:31:13.868 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12656 fp=#0x20000000a25' 2024-08-31T04:31:13.869 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12688 fp=#0x10000000df8' 2024-08-31T04:31:13.869 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12720 fp=#0x10000000d62' 2024-08-31T04:31:13.869 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12752 fp=#0x20000000230' 2024-08-31T04:31:13.869 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12784 fp=#0x10000000db1' 2024-08-31T04:31:13.870 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12816 fp=#0x10000000e51' 2024-08-31T04:31:13.870 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12848 fp=#0x10000000f0e' 2024-08-31T04:31:13.871 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12880 fp=#0x20000002125' 2024-08-31T04:31:13.871 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12912 fp=#0x10000002eb9' 2024-08-31T04:31:13.871 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12944 fp=#0x200000020f8' 2024-08-31T04:31:13.871 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:12976 fp=#0x20000002101' 2024-08-31T04:31:13.872 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13008 fp=#0x2000000213e' 2024-08-31T04:31:13.872 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13039 fp=#0x20000000790' 2024-08-31T04:31:13.872 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13071 fp=#0x20000000755' 2024-08-31T04:31:13.873 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13103 fp=#0x20000000781' 2024-08-31T04:31:13.873 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13135 fp=#0x20000000761' 2024-08-31T04:31:13.873 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13167 fp=#0x20000000765' 2024-08-31T04:31:13.874 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13199 fp=#0x20000000793' 2024-08-31T04:31:13.874 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13231 fp=#0x20000000bdf' 2024-08-31T04:31:13.874 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13263 fp=#0x20000000b9d' 2024-08-31T04:31:13.875 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13295 fp=#0x20000000bac' 2024-08-31T04:31:13.875 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13327 fp=#0x20000000b6f' 2024-08-31T04:31:13.875 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13359 fp=#0x20000001c5b' 2024-08-31T04:31:13.876 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13391 fp=#0x20000001d27' 2024-08-31T04:31:13.876 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13423 fp=#0x20000001cf7' 2024-08-31T04:31:13.876 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13455 fp=#0x20000001cae' 2024-08-31T04:31:13.877 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13487 fp=#0x10000003b0b' 2024-08-31T04:31:13.877 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13514 fp=#0x2000000115b' 2024-08-31T04:31:13.878 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13610 fp=#0x2000000115f' 2024-08-31T04:31:13.878 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13642 fp=#0x20000002124' 2024-08-31T04:31:13.878 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13674 fp=#0x10000002e67' 2024-08-31T04:31:13.879 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13706 fp=#0x10000002e22' 2024-08-31T04:31:13.879 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13738 fp=#0x10000002e86' 2024-08-31T04:31:13.879 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13770 fp=#0x10000002e48' 2024-08-31T04:31:13.880 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13802 fp=#0x2000000080f' 2024-08-31T04:31:13.880 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13834 fp=#0x20000000830' 2024-08-31T04:31:13.880 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13866 fp=#0x20000000dbd' 2024-08-31T04:31:13.881 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13898 fp=#0x20000000dba' 2024-08-31T04:31:13.881 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13930 fp=#0x2000000224e' 2024-08-31T04:31:13.881 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13962 fp=#0x20000000cd3' 2024-08-31T04:31:13.882 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:13994 fp=#0x20000002248' 2024-08-31T04:31:13.882 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14026 fp=#0x20000001a43' 2024-08-31T04:31:13.882 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14058 fp=#0x200000019c7' 2024-08-31T04:31:13.883 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14090 fp=#0x20000001a10' 2024-08-31T04:31:13.883 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14122 fp=#0x20000000940' 2024-08-31T04:31:13.883 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14154 fp=#0x20000000906' 2024-08-31T04:31:13.884 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14186 fp=#0x200000008d7' 2024-08-31T04:31:13.884 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14218 fp=#0x200000008c3' 2024-08-31T04:31:13.884 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14250 fp=#0x200000008e2' 2024-08-31T04:31:13.885 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14282 fp=#0x20000001dc8' 2024-08-31T04:31:13.885 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14314 fp=#0x20000001db8' 2024-08-31T04:31:13.886 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14346 fp=#0x20000001db0' 2024-08-31T04:31:13.886 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14378 fp=#0x20000001dd2' 2024-08-31T04:31:13.886 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14410 fp=#0x20000001e10' 2024-08-31T04:31:13.886 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14442 fp=#0x20000001a6a' 2024-08-31T04:31:13.887 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14474 fp=#0x20000001852' 2024-08-31T04:31:13.887 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14506 fp=#0x20000001908' 2024-08-31T04:31:13.887 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14538 fp=#0x200000018e8' 2024-08-31T04:31:13.888 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14570 fp=#0x20000001030' 2024-08-31T04:31:13.888 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14602 fp=#0x20000000f3d' 2024-08-31T04:31:13.888 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14634 fp=#0x20000000f6c' 2024-08-31T04:31:13.889 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14666 fp=#0x2000000102b' 2024-08-31T04:31:13.889 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14698 fp=#0x20000000f5d' 2024-08-31T04:31:13.889 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14730 fp=#0x10000004645' 2024-08-31T04:31:13.890 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14872 fp=#0x10000003177' 2024-08-31T04:31:13.891 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14904 fp=#0x100000031b0' 2024-08-31T04:31:13.891 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14936 fp=#0x10000003150' 2024-08-31T04:31:13.891 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:14968 fp=#0x100000058a9' 2024-08-31T04:31:13.892 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15000 fp=#0x2000000180e' 2024-08-31T04:31:13.892 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15032 fp=#0x200000017c0' 2024-08-31T04:31:13.892 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15064 fp=#0x200000017a9' 2024-08-31T04:31:13.893 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15096 fp=#0x200000017f6' 2024-08-31T04:31:13.893 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15128 fp=#0x2000000170d' 2024-08-31T04:31:13.893 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15159 fp=#0x100000057bf' 2024-08-31T04:31:13.894 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15191 fp=#0x100000017b1' 2024-08-31T04:31:13.894 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15223 fp=#0x10000001716' 2024-08-31T04:31:13.894 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15255 fp=#0x20000002232' 2024-08-31T04:31:13.895 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15287 fp=#0x20000002229' 2024-08-31T04:31:13.895 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15319 fp=#0x20000002237' 2024-08-31T04:31:13.895 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15383 fp=#0x20000002063' 2024-08-31T04:31:13.896 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15415 fp=#0x20000001cb4' 2024-08-31T04:31:13.896 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15479 fp=#0x20000001a08' 2024-08-31T04:31:13.897 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15511 fp=#0x20000001654' 2024-08-31T04:31:13.897 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15543 fp=#0x10000005329' 2024-08-31T04:31:13.897 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15575 fp=#0x1000000532c' 2024-08-31T04:31:13.898 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15607 fp=#0x1000000532e' 2024-08-31T04:31:13.898 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15639 fp=#0x10000004ebb' 2024-08-31T04:31:13.898 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15671 fp=#0x10000004de1' 2024-08-31T04:31:13.899 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15703 fp=#0x10000004e68' 2024-08-31T04:31:13.899 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15735 fp=#0x10000004e25' 2024-08-31T04:31:13.900 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15863 fp=#0x20000002037' 2024-08-31T04:31:13.900 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15895 fp=#0x20000001fc0' 2024-08-31T04:31:13.901 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:15991 fp=#0x20000001fe1' 2024-08-31T04:31:13.902 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16023 fp=#0x200000018f4' 2024-08-31T04:31:13.902 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16055 fp=#0x20000000e9f' 2024-08-31T04:31:13.902 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16087 fp=#0x2000000110d' 2024-08-31T04:31:13.903 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16119 fp=#0x20000001119' 2024-08-31T04:31:13.903 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16151 fp=#0x20000001120' 2024-08-31T04:31:13.903 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16183 fp=#0x20000001591' 2024-08-31T04:31:13.904 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16215 fp=#0x20000001f27' 2024-08-31T04:31:13.904 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16247 fp=#0x20000001606' 2024-08-31T04:31:13.904 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16278 fp=#0x1000000482c' 2024-08-31T04:31:13.905 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16310 fp=#0x100000044f3' 2024-08-31T04:31:13.905 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16342 fp=#0x100000047f0' 2024-08-31T04:31:13.905 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16374 fp=#0x100000048a2' 2024-08-31T04:31:13.906 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16406 fp=#0x10000004501' 2024-08-31T04:31:13.906 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16438 fp=#0x100000047ed' 2024-08-31T04:31:13.906 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16470 fp=#0x1000000497d' 2024-08-31T04:31:13.906 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16502 fp=#0x10000004e0c' 2024-08-31T04:31:13.907 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16534 fp=#0x20000001147' 2024-08-31T04:31:13.907 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16566 fp=#0x20000001142' 2024-08-31T04:31:13.907 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16598 fp=#0x200000011c4' 2024-08-31T04:31:13.908 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16630 fp=#0x200000022ac' 2024-08-31T04:31:13.908 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16662 fp=#0x20000002282' 2024-08-31T04:31:13.908 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16694 fp=#0x10000002b00' 2024-08-31T04:31:13.909 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16726 fp=#0x10000002a80' 2024-08-31T04:31:13.909 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16758 fp=#0x20000000423' 2024-08-31T04:31:13.909 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16790 fp=#0x10000002a8d' 2024-08-31T04:31:13.910 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16822 fp=#0x10000002a83' 2024-08-31T04:31:13.910 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16854 fp=#0x100000045a3' 2024-08-31T04:31:13.910 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16886 fp=#0x10000004568' 2024-08-31T04:31:13.911 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16918 fp=#0x10000005d55' 2024-08-31T04:31:13.911 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16950 fp=#0x1000000459f' 2024-08-31T04:31:13.911 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:16982 fp=#0x10000005d3e' 2024-08-31T04:31:13.912 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17142 fp=#0x1000000578f' 2024-08-31T04:31:13.913 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17174 fp=#0x10000005785' 2024-08-31T04:31:13.913 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17206 fp=#0x100000054ef' 2024-08-31T04:31:13.913 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17238 fp=#0x10000005485' 2024-08-31T04:31:13.914 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17302 fp=#0x100000054c5' 2024-08-31T04:31:13.914 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17334 fp=#0x100000054e1' 2024-08-31T04:31:13.915 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17366 fp=#0x20000001a7e' 2024-08-31T04:31:13.915 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17398 fp=#0x20000001a66' 2024-08-31T04:31:13.915 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17430 fp=#0x20000001a85' 2024-08-31T04:31:13.916 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17462 fp=#0x10000004e24' 2024-08-31T04:31:13.916 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17494 fp=#0x10000004e1a' 2024-08-31T04:31:13.916 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17526 fp=#0x20000001b74' 2024-08-31T04:31:13.917 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17558 fp=#0x20000001b05' 2024-08-31T04:31:13.917 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17590 fp=#0x20000001b5d' 2024-08-31T04:31:13.917 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17622 fp=#0x20000001f5b' 2024-08-31T04:31:13.918 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17654 fp=#0x100000029dd' 2024-08-31T04:31:13.918 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17686 fp=#0x10000002a47' 2024-08-31T04:31:13.918 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17718 fp=#0x100000029c2' 2024-08-31T04:31:13.918 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17750 fp=#0x20000001f18' 2024-08-31T04:31:13.919 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17782 fp=#0x10000004eed' 2024-08-31T04:31:13.919 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17814 fp=#0x10000004efa' 2024-08-31T04:31:13.919 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17846 fp=#0x10000004f28' 2024-08-31T04:31:13.920 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17910 fp=#0x1000000088d' 2024-08-31T04:31:13.920 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17942 fp=#0x1000000111f' 2024-08-31T04:31:13.921 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:17974 fp=#0x20000001c39' 2024-08-31T04:31:13.921 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18006 fp=#0x20000001cc2' 2024-08-31T04:31:13.921 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18038 fp=#0x20000001c0f' 2024-08-31T04:31:13.922 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18070 fp=#0x200000016fa' 2024-08-31T04:31:13.922 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18102 fp=#0x2000000176b' 2024-08-31T04:31:13.922 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18134 fp=#0x20000001730' 2024-08-31T04:31:13.923 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18166 fp=#0x20000000d25' 2024-08-31T04:31:13.923 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18198 fp=#0x20000000c75' 2024-08-31T04:31:13.923 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18230 fp=#0x20000000c6a' 2024-08-31T04:31:13.924 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18291 fp=#0x200000022f0' 2024-08-31T04:31:13.924 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18323 fp=#0x2000000085a' 2024-08-31T04:31:13.924 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18355 fp=#0x200000022de' 2024-08-31T04:31:13.925 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18414 fp=#0x2000000222b' 2024-08-31T04:31:13.925 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18446 fp=#0x2000000219e' 2024-08-31T04:31:13.925 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18478 fp=#0x200000021b3' 2024-08-31T04:31:13.926 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18510 fp=#0x200000021b6' 2024-08-31T04:31:13.926 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18540 fp=#0x10000003985' 2024-08-31T04:31:13.926 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (a) for 9d491f02-1: 'internal op quiesce_inode:mds.1:18572 fp=#0x100000035cb' 2024-08-31T04:31:13.928 INFO:tasks.quiescer.fs.[cephfs]:Pulled 11437 ops from rank 1 (a) into home/teuthworker/archive/mchangir-2024-08-30_08:30:37-fs-wip-mchangir-testing-20240828.085847-main-debug-distro-default-smithi/7881274/ops-9d491f02-1-mds.a.json 2024-08-31T04:31:13.928 DEBUG:teuthology.orchestra.run.smithi050:> sudo rm -- /var/run/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/ops-9d491f02-1-mds.a.json 2024-08-31T04:31:13.930 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:31:09 smithi177 ceph-mon[22025]: pgmap v616: 97 pgs: 97 active+clean; 1.5 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 607 KiB/s rd, 803 KiB/s wr, 126 op/s 2024-08-31T04:31:13.930 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:31:11 smithi177 ceph-mon[22025]: pgmap v617: 97 pgs: 97 active+clean; 1.5 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 301 KiB/s wr, 102 op/s 2024-08-31T04:31:13.930 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:31:09 smithi133 ceph-mon[22177]: pgmap v616: 97 pgs: 97 active+clean; 1.5 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 607 KiB/s rd, 803 KiB/s wr, 126 op/s 2024-08-31T04:31:13.930 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:31:11 smithi133 ceph-mon[22177]: pgmap v617: 97 pgs: 97 active+clean; 1.5 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 301 KiB/s wr, 102 op/s 2024-08-31T04:31:13.930 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:31:13 smithi133 ceph-mon[22177]: pgmap v618: 97 pgs: 97 active+clean; 1.5 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 673 KiB/s rd, 1.1 MiB/s wr, 246 op/s 2024-08-31T04:31:13.941 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:09.751+0000 7f7501800640 1 -- 172.21.15.50:0/201507320 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f74fc104300 msgr2=0x7f74fc104710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:31:13.941 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:09.751+0000 7f7501800640 1 --2- 172.21.15.50:0/201507320 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f74fc104300 0x7f74fc104710 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f74e8009900 tx=0x7f74e802a3f0 comp rx=0 tx=0).stop 2024-08-31T04:31:13.941 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:09.752+0000 7f7501800640 1 -- 172.21.15.50:0/201507320 shutdown_connections 2024-08-31T04:31:13.942 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:09.752+0000 7f7501800640 1 --2- 172.21.15.50:0/201507320 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f74fc104ca0 0x7f74fc10b640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:13.942 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:09.752+0000 7f7501800640 1 --2- 172.21.15.50:0/201507320 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f74fc104300 0x7f74fc104710 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:13.942 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:09.752+0000 7f7501800640 1 --2- 172.21.15.50:0/201507320 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f74fc103280 0x7f74fc1036f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:13.942 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:09.752+0000 7f7501800640 1 -- 172.21.15.50:0/201507320 >> 172.21.15.50:0/201507320 conn(0x7f74fc0febc0 msgr2=0x7f74fc101070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:31:13.942 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:09.752+0000 7f7501800640 1 -- 172.21.15.50:0/201507320 shutdown_connections 2024-08-31T04:31:13.942 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:09.752+0000 7f7501800640 1 -- 172.21.15.50:0/201507320 wait complete. 2024-08-31T04:31:13.942 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:09.754+0000 7f7501800640 1 Processor -- start 2024-08-31T04:31:13.942 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:09.754+0000 7f7501800640 1 -- start start 2024-08-31T04:31:13.942 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:09.754+0000 7f7501800640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f74fc103280 0x7f74fc076bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:31:13.942 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:09.754+0000 7f7501800640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f74fc104300 0x7f74fc0754b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:31:13.942 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:09.754+0000 7f7501800640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f74fc104ca0 0x7f74fc0759f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:31:13.942 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:09.754+0000 7f7501800640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f74fc10ef50 con 0x7f74fc104ca0 2024-08-31T04:31:13.942 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:09.754+0000 7f7501800640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f74fc10edd0 con 0x7f74fc104300 2024-08-31T04:31:13.943 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:09.754+0000 7f7501800640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f74fc10f0d0 con 0x7f74fc103280 2024-08-31T04:31:13.943 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:09.754+0000 7f74fbe00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f74fc103280 0x7f74fc076bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:31:13.943 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:09.754+0000 7f7500e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f74fc104ca0 0x7f74fc0759f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:31:13.943 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:09.755+0000 7f74fb400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f74fc104300 0x7f74fc0754b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:31:13.943 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:09.755+0000 7f74fb400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f74fc104300 0x7f74fc0754b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.50:49318/0 (socket says 172.21.15.50:49318) 2024-08-31T04:31:13.943 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:09.755+0000 7f7500e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f74fc104ca0 0x7f74fc0759f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:41376/0 (socket says 172.21.15.50:41376) 2024-08-31T04:31:13.943 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:09.755+0000 7f74fb400640 1 -- 172.21.15.50:0/2424928830 learned_addr learned my addr 172.21.15.50:0/2424928830 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:31:13.943 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:09.755+0000 7f74fbe00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f74fc103280 0x7f74fc076bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.50:52982/0 (socket says 172.21.15.50:52982) 2024-08-31T04:31:13.943 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:09.755+0000 7f74fb400640 1 -- 172.21.15.50:0/2424928830 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f74fc103280 msgr2=0x7f74fc076bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:31:13.943 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:09.755+0000 7f74fb400640 1 --2- 172.21.15.50:0/2424928830 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f74fc103280 0x7f74fc076bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:13.943 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:09.755+0000 7f74fb400640 1 -- 172.21.15.50:0/2424928830 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f74fc104ca0 msgr2=0x7f74fc0759f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:31:13.943 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:09.755+0000 7f74fb400640 1 --2- 172.21.15.50:0/2424928830 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f74fc104ca0 0x7f74fc0759f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:13.944 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:09.755+0000 7f74fb400640 1 -- 172.21.15.50:0/2424928830 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74fc076120 con 0x7f74fc104300 2024-08-31T04:31:13.944 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:09.755+0000 7f74fbe00640 1 --2- 172.21.15.50:0/2424928830 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f74fc103280 0x7f74fc076bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:31:13.944 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:09.755+0000 7f7500e00640 1 --2- 172.21.15.50:0/2424928830 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f74fc104ca0 0x7f74fc0759f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:31:13.944 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:09.756+0000 7f74fb400640 1 --2- 172.21.15.50:0/2424928830 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f74fc104300 0x7f74fc0754b0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f74e8031440 tx=0x7f74e8003c10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:31:13.944 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:09.756+0000 7f74f8c00640 1 -- 172.21.15.50:0/2424928830 <== mon.2 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74e803f070 con 0x7f74fc104300 2024-08-31T04:31:13.944 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:09.756+0000 7f7501800640 1 -- 172.21.15.50:0/2424928830 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f74fc1a3bb0 con 0x7f74fc104300 2024-08-31T04:31:13.944 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:09.756+0000 7f74f8c00640 1 -- 172.21.15.50:0/2424928830 <== mon.2 v2:172.21.15.133:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f74e8031c50 con 0x7f74fc104300 2024-08-31T04:31:13.944 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:09.756+0000 7f74f8c00640 1 -- 172.21.15.50:0/2424928830 <== mon.2 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74e8035030 con 0x7f74fc104300 2024-08-31T04:31:13.944 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:09.756+0000 7f7501800640 1 -- 172.21.15.50:0/2424928830 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f74fc1a4010 con 0x7f74fc104300 2024-08-31T04:31:13.944 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:09.760+0000 7f7509b22740 1 Processor -- start 2024-08-31T04:31:13.944 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:09.760+0000 7f74f8c00640 1 -- 172.21.15.50:0/2424928830 <== mon.2 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 18) ==== 152577+0+0 (secure 0 0 0) 0x7f74e8042070 con 0x7f74fc104300 2024-08-31T04:31:13.944 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:09.761+0000 7f7509b22740 1 -- start start 2024-08-31T04:31:13.944 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:09.761+0000 7f7509b22740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55a357fd31b0 0x55a358381550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:31:13.945 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:09.761+0000 7f7509b22740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55a357faa2f0 0x55a358381bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:31:13.945 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:09.761+0000 7f7509b22740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a357fb24d0 0x55a358382710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:31:13.945 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:09.761+0000 7f7509b22740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55a3582ebf70 con 0x55a357fb24d0 2024-08-31T04:31:13.945 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:09.761+0000 7f7509b22740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x55a3582db500 con 0x55a357fd31b0 2024-08-31T04:31:13.945 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:09.761+0000 7f7509b22740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x55a3582df4b0 con 0x55a357faa2f0 2024-08-31T04:31:13.945 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:09.761+0000 7f74fbe00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55a357faa2f0 0x55a358381bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:31:13.945 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:09.761+0000 7f7500e00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55a357fd31b0 0x55a358381550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:31:13.945 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:09.761+0000 7f74fbe00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55a357faa2f0 0x55a358381bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.50:52988/0 (socket says 172.21.15.50:52988) 2024-08-31T04:31:13.945 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:09.761+0000 7f74fbe00640 1 -- 172.21.15.50:0/2664720907 learned_addr learned my addr 172.21.15.50:0/2664720907 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:31:13.945 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:09.762+0000 7f74fb400640 1 --2- 172.21.15.50:0/2664720907 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a357fb24d0 0x55a358382710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:31:13.945 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:09.762+0000 7f7500e00640 1 -- 172.21.15.50:0/2664720907 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55a357faa2f0 msgr2=0x55a358381bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:31:13.945 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:09.762+0000 7f7500e00640 1 --2- 172.21.15.50:0/2664720907 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55a357faa2f0 0x55a358381bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:13.945 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:09.762+0000 7f7500e00640 1 -- 172.21.15.50:0/2664720907 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a357fb24d0 msgr2=0x55a358382710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:31:13.946 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:09.762+0000 7f7500e00640 1 --2- 172.21.15.50:0/2664720907 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a357fb24d0 0x55a358382710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:13.946 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:09.763+0000 7f7500e00640 1 -- 172.21.15.50:0/2664720907 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a358295c10 con 0x55a357fd31b0 2024-08-31T04:31:13.946 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:09.763+0000 7f74fb400640 1 --2- 172.21.15.50:0/2664720907 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a357fb24d0 0x55a358382710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:31:13.946 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:09.763+0000 7f74f8c00640 1 --2- 172.21.15.50:0/2424928830 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f74e00b4bb0 0x7f74e00b70c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:31:13.946 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:09.763+0000 7f74f8c00640 1 -- 172.21.15.50:0/2424928830 <== mon.2 v2:172.21.15.133:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8219+0+0 (secure 0 0 0) 0x7f74e81057d0 con 0x7f74fc104300 2024-08-31T04:31:13.946 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:09.763+0000 7f7500e00640 1 --2- 172.21.15.50:0/2664720907 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55a357fd31b0 0x55a358381550 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f74f4005fd0 tx=0x7f74f4011bf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8f1e4507dc156aa9 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:31:13.946 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:09.763+0000 7f74fbe00640 1 --2- 172.21.15.50:0/2424928830 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f74e00b4bb0 0x7f74e00b70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:31:13.946 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:09.763+0000 7f74f1600640 1 -- 172.21.15.50:0/2664720907 <== mon.2 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74f4004d20 con 0x55a357fd31b0 2024-08-31T04:31:13.946 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:09.763+0000 7f74f1600640 1 -- 172.21.15.50:0/2664720907 <== mon.2 v2:172.21.15.133:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f74f400f9a0 con 0x55a357fd31b0 2024-08-31T04:31:13.946 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:09.763+0000 7f74f1600640 1 -- 172.21.15.50:0/2664720907 <== mon.2 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74f4004470 con 0x55a357fd31b0 2024-08-31T04:31:13.946 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:09.764+0000 7f7509b22740 1 -- 172.21.15.50:0/2664720907 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55a357fd31b0 msgr2=0x55a358381550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:31:13.946 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:09.764+0000 7f74fbe00640 1 --2- 172.21.15.50:0/2424928830 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f74e00b4bb0 0x7f74e00b70c0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f74ec012720 tx=0x7f74ec005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:31:13.946 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:09.764+0000 7f7509b22740 1 --2- 172.21.15.50:0/2664720907 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55a357fd31b0 0x55a358381550 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f74f4005fd0 tx=0x7f74f4011bf0 comp rx=0 tx=0).stop 2024-08-31T04:31:13.947 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:09.765+0000 7f7509b22740 1 -- 172.21.15.50:0/2664720907 shutdown_connections 2024-08-31T04:31:13.947 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:09.765+0000 7f7509b22740 1 --2- 172.21.15.50:0/2664720907 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55a357faa2f0 0x55a358381bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:13.947 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:09.765+0000 7f7509b22740 1 --2- 172.21.15.50:0/2664720907 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a357fb24d0 0x55a358382710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:13.947 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:09.765+0000 7f7509b22740 1 --2- 172.21.15.50:0/2664720907 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55a357fd31b0 0x55a358381550 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:13.947 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:09.765+0000 7f7509b22740 1 -- 172.21.15.50:0/2664720907 >> 172.21.15.50:0/2664720907 conn(0x55a357fc7300 msgr2=0x55a3583747d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:31:13.947 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:09.765+0000 7f7509b22740 1 -- 172.21.15.50:0/2664720907 shutdown_connections 2024-08-31T04:31:13.947 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:09.765+0000 7f7509b22740 1 -- 172.21.15.50:0/2664720907 wait complete. 2024-08-31T04:31:13.947 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:09.765+0000 7f7509b22740 1 -- start start 2024-08-31T04:31:13.947 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:09.766+0000 7f7509b22740 1 Processor -- start 2024-08-31T04:31:13.947 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:09.766+0000 7f7509b22740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a357faa2f0 0x55a35838abf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:31:13.947 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:09.766+0000 7f7509b22740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55a357fb24d0 0x55a35838b2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:31:13.947 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:09.766+0000 7f7509b22740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55a357fd31b0 0x55a35838be20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:31:13.948 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:09.766+0000 7f7509b22740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55a358214ab0 con 0x55a357faa2f0 2024-08-31T04:31:13.948 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:09.766+0000 7f7509b22740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x55a358282320 con 0x55a357fb24d0 2024-08-31T04:31:13.948 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:09.766+0000 7f7509b22740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x55a358383230 con 0x55a357fd31b0 2024-08-31T04:31:13.948 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:09.766+0000 7f7509b22740 10 client.0 _ll_register_callbacks cb 0x55a3582bbe80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:31:13.948 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:09.767+0000 7f7500e00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55a357fd31b0 0x55a35838be20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:31:13.948 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:09.767+0000 7f74fbe00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a357faa2f0 0x55a35838abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:31:13.948 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:09.767+0000 7f7500e00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55a357fd31b0 0x55a35838be20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.50:52994/0 (socket says 172.21.15.50:52994) 2024-08-31T04:31:13.948 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:09.767+0000 7f7500e00640 1 -- 172.21.15.50:0/915498715 learned_addr learned my addr 172.21.15.50:0/915498715 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:31:13.948 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:09.767+0000 7f74fb400640 1 --2- 172.21.15.50:0/915498715 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55a357fb24d0 0x55a35838b2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:31:13.948 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:09.767+0000 7f7500e00640 1 -- 172.21.15.50:0/915498715 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55a357fb24d0 msgr2=0x55a35838b2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:31:13.948 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:09.767+0000 7f7500e00640 1 --2- 172.21.15.50:0/915498715 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55a357fb24d0 0x55a35838b2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:13.948 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:09.767+0000 7f7500e00640 1 -- 172.21.15.50:0/915498715 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a357faa2f0 msgr2=0x55a35838abf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:31:13.948 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:09.767+0000 7f7500e00640 1 --2- 172.21.15.50:0/915498715 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a357faa2f0 0x55a35838abf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:13.949 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:09.767+0000 7f7500e00640 1 -- 172.21.15.50:0/915498715 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a35803e790 con 0x55a357fd31b0 2024-08-31T04:31:13.949 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:09.767+0000 7f7500e00640 1 --2- 172.21.15.50:0/915498715 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55a357fd31b0 0x55a35838be20 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f74f4005c10 tx=0x7f74f4004e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=960d051c89637532 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:31:13.949 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:09.767+0000 7f74e6000640 10 client.0 ms_handle_connect on v2:172.21.15.177:3300/0 2024-08-31T04:31:13.949 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:09.768+0000 7f74e6000640 1 -- 172.21.15.50:0/915498715 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74f4003b30 con 0x55a357fd31b0 2024-08-31T04:31:13.949 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:09.768+0000 7f74e6000640 1 -- 172.21.15.50:0/915498715 <== mon.1 v2:172.21.15.177:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8219+0+0 (secure 0 0 0) 0x7f74f4003cd0 con 0x55a357fd31b0 2024-08-31T04:31:13.949 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:09.768+0000 7f7509b22740 1 -- 172.21.15.50:0/915498715 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f74f400f9a0 con 0x55a357fd31b0 2024-08-31T04:31:13.949 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:09.768+0000 7f74e6000640 1 -- 172.21.15.50:0/915498715 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7f74f40041f0 con 0x55a357fd31b0 2024-08-31T04:31:13.949 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:09.768+0000 7f7509b22740 10 client.26173 fetch_fsmap learned FSMap version 42 2024-08-31T04:31:13.949 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:09.768+0000 7f7509b22740 1 -- 172.21.15.50:0/915498715 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x55a3580b7620 con 0x55a357fd31b0 2024-08-31T04:31:13.949 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:09.768+0000 7f74e6000640 1 -- 172.21.15.50:0/915498715 <== mon.1 v2:172.21.15.177:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f74f400f9a0 con 0x55a357fd31b0 2024-08-31T04:31:13.949 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:09.769+0000 7f74e6000640 1 -- 172.21.15.50:0/915498715 <== mon.1 v2:172.21.15.177:3300/0 5 ==== fsmap(e 42) ==== 8398+0+0 (secure 0 0 0) 0x7f74f4018070 con 0x55a357fd31b0 2024-08-31T04:31:13.949 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:09.769+0000 7f7509b22740 10 client.26173 fetch_fsmap finished waiting for FSMap version 42 2024-08-31T04:31:13.949 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:09.769+0000 7f7509b22740 10 client.26173 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T04:31:13.950 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:09.769+0000 7f7509b22740 20 client.26173 populate_metadata read hostname 'smithi050' 2024-08-31T04:31:13.950 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:09.769+0000 7f7509b22740 1 --2- 172.21.15.50:0/915498715 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x55a357f91d80 0x55a3583981d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:31:13.950 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:09.769+0000 7f7509b22740 4 client.26173 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T04:31:13.950 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:09.769+0000 7f7509b22740 1 -- 172.21.15.50:0/915498715 --> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a3582edec0 con 0x55a357f91d80 2024-08-31T04:31:13.950 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:09.769+0000 7f74fbe00640 1 --2- 172.21.15.50:0/915498715 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x55a357f91d80 0x55a3583981d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:31:13.950 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:09.770+0000 7f74fbe00640 1 --2- 172.21.15.50:0/915498715 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x55a357f91d80 0x55a3583981d0 crc :-1 s=READY pgs=116 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=60ba29893912c810 server_cookie=163cc98d88b603dd in_seq=0 out_seq=0 2024-08-31T04:31:13.950 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:09.770+0000 7f74e6000640 10 client.26173 ms_handle_connect on v2:172.21.15.133:6838/2526402262 2024-08-31T04:31:13.950 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:09.771+0000 7f74e6000640 1 -- 172.21.15.50:0/915498715 <== mds.0 v2:172.21.15.133:6838/2526402262 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55a3582edec0 con 0x55a357f91d80 2024-08-31T04:31:13.950 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:09.771+0000 7f74e6000640 10 client.26173 handle_command_reply: tid=0 2024-08-31T04:31:13.950 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:09.771+0000 7f7509b22740 1 client.26173 shutdown 2024-08-31T04:31:13.950 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:09.771+0000 7f7509b22740 1 -- 172.21.15.50:0/915498715 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55a357fd31b0 msgr2=0x55a35838be20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:31:13.950 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:09.771+0000 7f7509b22740 1 --2- 172.21.15.50:0/915498715 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55a357fd31b0 0x55a35838be20 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f74f4005c10 tx=0x7f74f4004e30 comp rx=0 tx=0).stop 2024-08-31T04:31:13.950 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:09.771+0000 7f7509b22740 1 -- 172.21.15.50:0/915498715 shutdown_connections 2024-08-31T04:31:13.950 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:09.771+0000 7f7509b22740 1 --2- 172.21.15.50:0/915498715 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x55a357f91d80 0x55a3583981d0 crc :-1 s=READY pgs=116 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:13.951 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:09.771+0000 7f7509b22740 1 --2- 172.21.15.50:0/915498715 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55a357fd31b0 0x55a35838be20 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:13.951 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:09.771+0000 7f7509b22740 1 --2- 172.21.15.50:0/915498715 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55a357fb24d0 0x55a35838b2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:13.951 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:09.771+0000 7f74e6000640 0 client.26173 ms_handle_reset on v2:172.21.15.133:6838/2526402262 2024-08-31T04:31:13.951 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:09.771+0000 7f7509b22740 1 --2- 172.21.15.50:0/915498715 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a357faa2f0 0x55a35838abf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:13.951 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:09.771+0000 7f7509b22740 1 -- 172.21.15.50:0/915498715 >> 172.21.15.50:0/915498715 conn(0x55a357fc7300 msgr2=0x55a358372d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:31:13.951 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:09.772+0000 7f7509b22740 1 -- 172.21.15.50:0/915498715 shutdown_connections 2024-08-31T04:31:13.951 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:09.772+0000 7f7509b22740 1 -- 172.21.15.50:0/915498715 wait complete. 2024-08-31T04:31:13.951 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:09.772+0000 7f7509b22740 20 client.26173 trim_cache size 0 max 16384 2024-08-31T04:31:13.951 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:09.787+0000 7f7509b22740 1 Processor -- start 2024-08-31T04:31:13.951 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:09.788+0000 7f7509b22740 1 -- start start 2024-08-31T04:31:13.951 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:09.788+0000 7f7509b22740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55a357faa2f0 0x55a35838c470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:31:13.951 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:09.788+0000 7f7509b22740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a357fb24d0 0x55a358392d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:31:13.951 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:09.788+0000 7f7509b22740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55a357fd31b0 0x55a358375c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:31:13.952 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:09.788+0000 7f7509b22740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f74fc1a88c0 con 0x55a357fb24d0 2024-08-31T04:31:13.952 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:09.788+0000 7f7509b22740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f74fc1aa4f0 con 0x55a357faa2f0 2024-08-31T04:31:13.952 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:09.788+0000 7f7509b22740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f74fc1a8f90 con 0x55a357fd31b0 2024-08-31T04:31:13.952 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:09.788+0000 7f74fb400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a357fb24d0 0x55a358392d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:31:13.952 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:09.788+0000 7f74fb400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a357fb24d0 0x55a358392d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:41394/0 (socket says 172.21.15.50:41394) 2024-08-31T04:31:13.952 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:09.788+0000 7f74fb400640 1 -- 172.21.15.50:0/4210486756 learned_addr learned my addr 172.21.15.50:0/4210486756 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:31:13.952 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:09.788+0000 7f7500e00640 1 --2- 172.21.15.50:0/4210486756 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55a357fd31b0 0x55a358375c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:31:13.952 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:09.788+0000 7f74fbe00640 1 --2- 172.21.15.50:0/4210486756 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55a357faa2f0 0x55a35838c470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:31:13.952 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:09.789+0000 7f7500e00640 1 -- 172.21.15.50:0/4210486756 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55a357faa2f0 msgr2=0x55a35838c470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:31:13.952 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:09.789+0000 7f7500e00640 1 --2- 172.21.15.50:0/4210486756 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55a357faa2f0 0x55a35838c470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:13.952 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:09.789+0000 7f7500e00640 1 -- 172.21.15.50:0/4210486756 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a357fb24d0 msgr2=0x55a358392d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:31:13.952 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:09.789+0000 7f7500e00640 1 --2- 172.21.15.50:0/4210486756 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a357fb24d0 0x55a358392d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:13.952 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:09.789+0000 7f7500e00640 1 -- 172.21.15.50:0/4210486756 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a358388d80 con 0x55a357fd31b0 2024-08-31T04:31:13.953 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:09.789+0000 7f7500e00640 1 --2- 172.21.15.50:0/4210486756 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55a357fd31b0 0x55a358375c20 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f74f4005c40 tx=0x7f74f4011660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=10242333a875d998 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:31:13.953 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:09.789+0000 7f74f0c00640 1 -- 172.21.15.50:0/4210486756 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74f400f8c0 con 0x55a357fd31b0 2024-08-31T04:31:13.953 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:09.789+0000 7f74f0c00640 1 -- 172.21.15.50:0/4210486756 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f74f4029070 con 0x55a357fd31b0 2024-08-31T04:31:13.953 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:09.789+0000 7f74f0c00640 1 -- 172.21.15.50:0/4210486756 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74f4005100 con 0x55a357fd31b0 2024-08-31T04:31:13.953 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:09.790+0000 7f7509b22740 1 -- 172.21.15.50:0/4210486756 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55a357fd31b0 msgr2=0x55a358375c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:31:13.953 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:09.790+0000 7f7509b22740 1 --2- 172.21.15.50:0/4210486756 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55a357fd31b0 0x55a358375c20 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f74f4005c40 tx=0x7f74f4011660 comp rx=0 tx=0).stop 2024-08-31T04:31:13.953 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:09.791+0000 7f7509b22740 1 -- 172.21.15.50:0/4210486756 shutdown_connections 2024-08-31T04:31:13.953 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:09.791+0000 7f7509b22740 1 --2- 172.21.15.50:0/4210486756 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55a357fd31b0 0x55a358375c20 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:13.953 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:09.791+0000 7f7509b22740 1 --2- 172.21.15.50:0/4210486756 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a357fb24d0 0x55a358392d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:13.953 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:09.791+0000 7f7509b22740 1 --2- 172.21.15.50:0/4210486756 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55a357faa2f0 0x55a35838c470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:13.953 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:09.791+0000 7f7509b22740 1 -- 172.21.15.50:0/4210486756 >> 172.21.15.50:0/4210486756 conn(0x55a357fc7300 msgr2=0x55a35838bd60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:31:13.953 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:09.791+0000 7f7509b22740 1 -- 172.21.15.50:0/4210486756 shutdown_connections 2024-08-31T04:31:13.953 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:09.791+0000 7f7509b22740 1 -- 172.21.15.50:0/4210486756 wait complete. 2024-08-31T04:31:13.953 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:09.791+0000 7f7509b22740 1 -- start start 2024-08-31T04:31:13.954 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:09.791+0000 7f7509b22740 1 Processor -- start 2024-08-31T04:31:13.954 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:09.792+0000 7f7509b22740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55a357faa2f0 0x55a358392a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:31:13.954 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:09.792+0000 7f7509b22740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55a357fb24d0 0x55a3583916f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:31:13.954 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:09.792+0000 7f7509b22740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a357fd31b0 0x55a358391cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:31:13.954 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:09.792+0000 7f7509b22740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f74fc1a9e20 con 0x55a357fd31b0 2024-08-31T04:31:13.954 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:09.792+0000 7f7509b22740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f74fc1a9720 con 0x55a357fb24d0 2024-08-31T04:31:13.954 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:09.792+0000 7f7509b22740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f74fc1a68a0 con 0x55a357faa2f0 2024-08-31T04:31:13.954 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:09.792+0000 7f7509b22740 10 client.0 _ll_register_callbacks cb 0x7f74ec009b50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:31:13.954 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:09.792+0000 7f74fbe00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55a357faa2f0 0x55a358392a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:31:13.954 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:09.792+0000 7f74fbe00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55a357faa2f0 0x55a358392a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.50:53012/0 (socket says 172.21.15.50:53012) 2024-08-31T04:31:13.954 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:09.792+0000 7f74fbe00640 1 -- 172.21.15.50:0/3288270822 learned_addr learned my addr 172.21.15.50:0/3288270822 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:31:13.954 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:09.792+0000 7f74fb400640 1 --2- 172.21.15.50:0/3288270822 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55a357fb24d0 0x55a3583916f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:31:13.954 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:09.792+0000 7f7500e00640 1 --2- 172.21.15.50:0/3288270822 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a357fd31b0 0x55a358391cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:31:13.954 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:09.793+0000 7f74fb400640 1 -- 172.21.15.50:0/3288270822 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55a357faa2f0 msgr2=0x55a358392a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:31:13.955 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:09.793+0000 7f74fb400640 1 --2- 172.21.15.50:0/3288270822 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55a357faa2f0 0x55a358392a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:13.955 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:09.793+0000 7f74fb400640 1 -- 172.21.15.50:0/3288270822 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a357fd31b0 msgr2=0x55a358391cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:31:13.955 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:09.793+0000 7f74fb400640 1 --2- 172.21.15.50:0/3288270822 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a357fd31b0 0x55a358391cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:13.955 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:09.793+0000 7f74fb400640 1 -- 172.21.15.50:0/3288270822 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a358392440 con 0x55a357fb24d0 2024-08-31T04:31:13.955 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:09.793+0000 7f74fb400640 1 --2- 172.21.15.50:0/3288270822 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55a357fb24d0 0x55a3583916f0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f74e80cbfc0 tx=0x7f74e8005e50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3a1849b0b8bb9f0e server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:31:13.955 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:09.793+0000 7f74e6000640 10 client.0 ms_handle_connect on v2:172.21.15.133:3300/0 2024-08-31T04:31:13.955 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:09.793+0000 7f74e6000640 1 -- 172.21.15.50:0/3288270822 <== mon.2 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74e8049040 con 0x55a357fb24d0 2024-08-31T04:31:13.955 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:09.793+0000 7f74e6000640 1 -- 172.21.15.50:0/3288270822 <== mon.2 v2:172.21.15.133:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8219+0+0 (secure 0 0 0) 0x7f74e80c88b0 con 0x55a357fb24d0 2024-08-31T04:31:13.955 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:09.793+0000 7f7509b22740 1 -- 172.21.15.50:0/3288270822 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f74f4029070 con 0x55a357fb24d0 2024-08-31T04:31:13.955 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:09.794+0000 7f74e6000640 1 -- 172.21.15.50:0/3288270822 <== mon.2 v2:172.21.15.133:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7f74e80cba30 con 0x55a357fb24d0 2024-08-31T04:31:13.955 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:09.794+0000 7f7509b22740 10 client.26192 fetch_fsmap learned FSMap version 42 2024-08-31T04:31:13.955 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:09.794+0000 7f7509b22740 1 -- 172.21.15.50:0/3288270822 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x55a358402cc0 con 0x55a357fb24d0 2024-08-31T04:31:13.955 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:09.794+0000 7f74e6000640 1 -- 172.21.15.50:0/3288270822 <== mon.2 v2:172.21.15.133:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f74f4029070 con 0x55a357fb24d0 2024-08-31T04:31:13.955 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:09.794+0000 7f74e6000640 1 -- 172.21.15.50:0/3288270822 <== mon.2 v2:172.21.15.133:3300/0 5 ==== fsmap(e 42) ==== 8398+0+0 (secure 0 0 0) 0x7f74e80f0030 con 0x55a357fb24d0 2024-08-31T04:31:13.955 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:09.795+0000 7f7509b22740 10 client.26192 fetch_fsmap finished waiting for FSMap version 42 2024-08-31T04:31:13.956 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:09.795+0000 7f7509b22740 10 client.26192 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T04:31:13.956 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:09.795+0000 7f7509b22740 20 client.26192 populate_metadata read hostname 'smithi050' 2024-08-31T04:31:13.956 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:09.795+0000 7f7509b22740 1 --2- 172.21.15.50:0/3288270822 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x55a357f671c0 0x55a3584055f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:31:13.956 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:09.795+0000 7f7509b22740 4 client.26192 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-31T04:31:13.956 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:09.795+0000 7f7509b22740 1 -- 172.21.15.50:0/3288270822 --> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55a3582e9960 con 0x55a357f671c0 2024-08-31T04:31:13.956 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:09.795+0000 7f74fbe00640 1 --2- 172.21.15.50:0/3288270822 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x55a357f671c0 0x55a3584055f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:31:13.956 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:09.796+0000 7f74fbe00640 1 --2- 172.21.15.50:0/3288270822 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x55a357f671c0 0x55a3584055f0 crc :-1 s=READY pgs=117 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=27c886f71d081481 server_cookie=5641c17595026b8a in_seq=0 out_seq=0 2024-08-31T04:31:13.956 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:09.796+0000 7f74e6000640 10 client.26192 ms_handle_connect on v2:172.21.15.133:6838/2526402262 2024-08-31T04:31:13.956 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:09.821+0000 7f74e6000640 1 -- 172.21.15.50:0/3288270822 <== mds.0 v2:172.21.15.133:6838/2526402262 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55a3582e9960 con 0x55a357f671c0 2024-08-31T04:31:13.956 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:09.821+0000 7f74e6000640 10 client.26192 handle_command_reply: tid=0 2024-08-31T04:31:13.956 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:09.821+0000 7f7509b22740 1 client.26192 shutdown 2024-08-31T04:31:13.956 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:09.821+0000 7f7509b22740 1 -- 172.21.15.50:0/3288270822 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55a357fb24d0 msgr2=0x55a3583916f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:31:13.956 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:09.821+0000 7f7509b22740 1 --2- 172.21.15.50:0/3288270822 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55a357fb24d0 0x55a3583916f0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f74e80cbfc0 tx=0x7f74e8005e50 comp rx=0 tx=0).stop 2024-08-31T04:31:13.957 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:09.821+0000 7f7509b22740 1 -- 172.21.15.50:0/3288270822 shutdown_connections 2024-08-31T04:31:13.957 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:09.821+0000 7f7509b22740 1 --2- 172.21.15.50:0/3288270822 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x55a357f671c0 0x55a3584055f0 crc :-1 s=READY pgs=117 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:13.957 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:09.821+0000 7f7509b22740 1 --2- 172.21.15.50:0/3288270822 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a357fd31b0 0x55a358391cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:13.957 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:09.821+0000 7f7509b22740 1 --2- 172.21.15.50:0/3288270822 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55a357fb24d0 0x55a3583916f0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:13.957 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:09.821+0000 7f7509b22740 1 --2- 172.21.15.50:0/3288270822 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55a357faa2f0 0x55a358392a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:13.957 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:09.821+0000 7f74e6000640 0 client.26192 ms_handle_reset on v2:172.21.15.133:6838/2526402262 2024-08-31T04:31:13.957 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:09.821+0000 7f7509b22740 1 -- 172.21.15.50:0/3288270822 >> 172.21.15.50:0/3288270822 conn(0x55a357fc7300 msgr2=0x55a358374c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:31:13.957 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:09.821+0000 7f7509b22740 1 -- 172.21.15.50:0/3288270822 shutdown_connections 2024-08-31T04:31:13.957 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:09.822+0000 7f7509b22740 1 -- 172.21.15.50:0/3288270822 wait complete. 2024-08-31T04:31:13.957 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:09.822+0000 7f7509b22740 20 client.26192 trim_cache size 0 max 16384 2024-08-31T04:31:13.957 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout:{ 2024-08-31T04:31:13.958 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout: "message": "", 2024-08-31T04:31:13.958 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout: "return_code": 0 2024-08-31T04:31:13.958 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout:} 2024-08-31T04:31:13.958 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:09.822+0000 7f7501800640 1 -- 172.21.15.50:0/2424928830 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f74e00b4bb0 msgr2=0x7f74e00b70c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:31:13.958 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:09.822+0000 7f7501800640 1 --2- 172.21.15.50:0/2424928830 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f74e00b4bb0 0x7f74e00b70c0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f74ec012720 tx=0x7f74ec005f90 comp rx=0 tx=0).stop 2024-08-31T04:31:13.959 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:09.822+0000 7f7501800640 1 -- 172.21.15.50:0/2424928830 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f74fc104300 msgr2=0x7f74fc0754b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:31:13.959 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:09.822+0000 7f7501800640 1 --2- 172.21.15.50:0/2424928830 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f74fc104300 0x7f74fc0754b0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f74e8031440 tx=0x7f74e8003c10 comp rx=0 tx=0).stop 2024-08-31T04:31:13.959 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:09.823+0000 7f7501800640 1 -- 172.21.15.50:0/2424928830 shutdown_connections 2024-08-31T04:31:13.959 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:09.823+0000 7f7501800640 1 --2- 172.21.15.50:0/2424928830 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f74e00b4bb0 0x7f74e00b70c0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:13.959 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:09.823+0000 7f7501800640 1 --2- 172.21.15.50:0/2424928830 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f74fc104ca0 0x7f74fc0759f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:13.959 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:09.823+0000 7f7501800640 1 --2- 172.21.15.50:0/2424928830 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f74fc104300 0x7f74fc0754b0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:13.959 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:09.823+0000 7f7501800640 1 --2- 172.21.15.50:0/2424928830 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f74fc103280 0x7f74fc076bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:13.959 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:09.823+0000 7f7501800640 1 -- 172.21.15.50:0/2424928830 >> 172.21.15.50:0/2424928830 conn(0x7f74fc0febc0 msgr2=0x7f74fc107620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:31:13.959 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:09.823+0000 7f7501800640 1 -- 172.21.15.50:0/2424928830 shutdown_connections 2024-08-31T04:31:13.959 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:09.823+0000 7f7501800640 1 -- 172.21.15.50:0/2424928830 wait complete. 2024-08-31T04:31:13.960 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:31:09 smithi050 ceph-mon[17259]: pgmap v616: 97 pgs: 97 active+clean; 1.5 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 607 KiB/s rd, 803 KiB/s wr, 126 op/s 2024-08-31T04:31:13.960 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:31:11 smithi050 ceph-mon[17259]: pgmap v617: 97 pgs: 97 active+clean; 1.5 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 301 KiB/s wr, 102 op/s 2024-08-31T04:31:13.960 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:31:13 smithi050 ceph-mon[17259]: pgmap v618: 97 pgs: 97 active+clean; 1.5 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 673 KiB/s rd, 1.1 MiB/s wr, 246 op/s 2024-08-31T04:31:13.996 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:31:13 smithi177 ceph-mon[22025]: pgmap v618: 97 pgs: 97 active+clean; 1.5 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 673 KiB/s rd, 1.1 MiB/s wr, 246 op/s 2024-08-31T04:31:14.158 DEBUG:teuthology.orchestra.run.smithi133:> mktemp 2024-08-31T04:31:14.174 INFO:teuthology.orchestra.run.smithi133.stdout:/tmp/tmp.iS5sITKAkk 2024-08-31T04:31:14.174 DEBUG:teuthology.orchestra.run.smithi133:> sudo cp /var/run/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/ops-9d491f02-1-mds.b.json /tmp/tmp.iS5sITKAkk 2024-08-31T04:31:14.239 DEBUG:teuthology.orchestra.run.smithi133:> sudo chmod 0666 /tmp/tmp.iS5sITKAkk 2024-08-31T04:31:14.364 DEBUG:teuthology.orchestra.remote:smithi133:/tmp/tmp.iS5sITKAkk is 231KB 2024-08-31T04:31:14.429 DEBUG:teuthology.orchestra.run.smithi133:> rm -fr /tmp/tmp.iS5sITKAkk 2024-08-31T04:31:14.444 DEBUG:tasks.quiescer.fs.[cephfs]:read 236772B of ops from '/var/run/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/ops-9d491f02-1-mds.b.json' on mds.0 (b) 2024-08-31T04:31:14.515 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 9d491f02-1: 'internal op quiesce_path:mds.0:11411 fp=#0x1' 2024-08-31T04:31:14.516 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 9d491f02-1: 'internal op quiesce_inode:mds.0:11412 fp=#0x1' 2024-08-31T04:31:14.517 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 9d491f02-1: 'internal op exportdir:mds.0:11502' 2024-08-31T04:31:14.517 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 9d491f02-1: 'internal op exportdir:mds.0:11503' 2024-08-31T04:31:14.519 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 9d491f02-1: 'internal op quiesce_inode:mds.0:11475 fp=#0x10000000399' 2024-08-31T04:31:14.520 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 9d491f02-1: 'internal op quiesce_inode:mds.0:11413 fp=#0x10000000000' 2024-08-31T04:31:14.520 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 9d491f02-1: 'internal op quiesce_inode:mds.0:11414 fp=#0x10000000001' 2024-08-31T04:31:14.521 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 9d491f02-1: 'internal op quiesce_inode:mds.0:11415 fp=#0x100000001fa' 2024-08-31T04:31:14.523 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 9d491f02-1: 'internal op quiesce_inode:mds.0:11418 fp=#0x100000001fb' 2024-08-31T04:31:14.524 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 9d491f02-1: 'internal op quiesce_inode:mds.0:11419 fp=#0x10000000005' 2024-08-31T04:31:14.525 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 9d491f02-1: 'internal op quiesce_inode:mds.0:11420 fp=#0x10000000006' 2024-08-31T04:31:14.526 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 9d491f02-1: 'internal op quiesce_inode:mds.0:11421 fp=#0x10000000201' 2024-08-31T04:31:14.528 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 9d491f02-1: 'internal op quiesce_inode:mds.0:11424 fp=#0x10000000208' 2024-08-31T04:31:14.534 INFO:tasks.quiescer.fs.[cephfs]:Pulled 92 ops from rank 0 (b) into home/teuthworker/archive/mchangir-2024-08-30_08:30:37-fs-wip-mchangir-testing-20240828.085847-main-debug-distro-default-smithi/7881274/ops-9d491f02-1-mds.b.json 2024-08-31T04:31:14.534 DEBUG:teuthology.orchestra.run.smithi133:> sudo rm -- /var/run/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/ops-9d491f02-1-mds.b.json 2024-08-31T04:31:14.559 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 058d9fc6-674f-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-31T04:31:14.956 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:31:15.633 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:31:15.630+0000 7fb3ef000640 1 -- 172.21.15.50:0/3955952508 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb3e8103900 msgr2=0x7fb3e8103d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:31:15.633 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:31:15.630+0000 7fb3ef000640 1 --2- 172.21.15.50:0/3955952508 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb3e8103900 0x7fb3e8103d10 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fb3d8009860 tx=0x7fb3d802a340 comp rx=0 tx=0).stop 2024-08-31T04:31:15.633 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:31:15.630+0000 7fb3ef000640 1 -- 172.21.15.50:0/3955952508 shutdown_connections 2024-08-31T04:31:15.633 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:31:15.630+0000 7fb3ef000640 1 --2- 172.21.15.50:0/3955952508 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb3e8109240 0x7fb3e8109650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:15.633 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:31:15.630+0000 7fb3ef000640 1 --2- 172.21.15.50:0/3955952508 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb3e8109b90 0x7fb3e81103c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:15.633 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:31:15.630+0000 7fb3ef000640 1 --2- 172.21.15.50:0/3955952508 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb3e8103900 0x7fb3e8103d10 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:15.633 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:31:15.630+0000 7fb3ef000640 1 -- 172.21.15.50:0/3955952508 >> 172.21.15.50:0/3955952508 conn(0x7fb3e807b5f0 msgr2=0x7fb3e807ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:31:15.633 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:31:15.630+0000 7fb3ef000640 1 -- 172.21.15.50:0/3955952508 shutdown_connections 2024-08-31T04:31:15.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:31:15.630+0000 7fb3ef000640 1 -- 172.21.15.50:0/3955952508 wait complete. 2024-08-31T04:31:15.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:31:15.632+0000 7fb3ef000640 1 Processor -- start 2024-08-31T04:31:15.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:31:15.632+0000 7fb3ef000640 1 -- start start 2024-08-31T04:31:15.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:31:15.632+0000 7fb3ef000640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb3e8103900 0x7fb3e819a200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:31:15.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:31:15.632+0000 7fb3ef000640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb3e8109240 0x7fb3e819a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:31:15.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:31:15.632+0000 7fb3ef000640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb3e8109b90 0x7fb3e819fa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:31:15.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:31:15.632+0000 7fb3ef000640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fb3e8113850 con 0x7fb3e8103900 2024-08-31T04:31:15.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:31:15.632+0000 7fb3ef000640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7fb3e81136d0 con 0x7fb3e8109b90 2024-08-31T04:31:15.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:31:15.632+0000 7fb3ef000640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fb3e81139d0 con 0x7fb3e8109240 2024-08-31T04:31:15.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:31:15.633+0000 7fb3e7e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb3e8103900 0x7fb3e819a200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:31:15.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:31:15.633+0000 7fb3e7e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb3e8103900 0x7fb3e819a200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:46700/0 (socket says 172.21.15.50:46700) 2024-08-31T04:31:15.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:31:15.633+0000 7fb3ed000640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb3e8109b90 0x7fb3e819fa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:31:15.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:31:15.633+0000 7fb3e7e00640 1 -- 172.21.15.50:0/132091576 learned_addr learned my addr 172.21.15.50:0/132091576 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:31:15.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:31:15.633+0000 7fb3e7400640 1 --2- 172.21.15.50:0/132091576 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb3e8109240 0x7fb3e819a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:31:15.637 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:31:15.634+0000 7fb3e7e00640 1 -- 172.21.15.50:0/132091576 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb3e8109240 msgr2=0x7fb3e819a7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:31:15.637 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:31:15.634+0000 7fb3e7e00640 1 --2- 172.21.15.50:0/132091576 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb3e8109240 0x7fb3e819a7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:15.637 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:31:15.634+0000 7fb3e7e00640 1 -- 172.21.15.50:0/132091576 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb3e8109b90 msgr2=0x7fb3e819fa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:31:15.637 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:31:15.634+0000 7fb3e7e00640 1 --2- 172.21.15.50:0/132091576 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb3e8109b90 0x7fb3e819fa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:15.637 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:31:15.634+0000 7fb3e7e00640 1 -- 172.21.15.50:0/132091576 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3e81a0170 con 0x7fb3e8103900 2024-08-31T04:31:15.637 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:31:15.634+0000 7fb3ed000640 1 --2- 172.21.15.50:0/132091576 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb3e8109b90 0x7fb3e819fa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:31:15.637 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:31:15.634+0000 7fb3e7e00640 1 --2- 172.21.15.50:0/132091576 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb3e8103900 0x7fb3e819a200 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fb3d80303f0 tx=0x7fb3d8032da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:31:15.637 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:31:15.635+0000 7fb3e4c00640 1 -- 172.21.15.50:0/132091576 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3d8040020 con 0x7fb3e8103900 2024-08-31T04:31:15.637 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:31:15.635+0000 7fb3ef000640 1 -- 172.21.15.50:0/132091576 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb3e81a0400 con 0x7fb3e8103900 2024-08-31T04:31:15.638 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:31:15.635+0000 7fb3ef000640 1 -- 172.21.15.50:0/132091576 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb3e8075390 con 0x7fb3e8103900 2024-08-31T04:31:15.638 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:31:15.635+0000 7fb3e4c00640 1 -- 172.21.15.50:0/132091576 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb3d8030dd0 con 0x7fb3e8103900 2024-08-31T04:31:15.638 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:31:15.635+0000 7fb3e4c00640 1 -- 172.21.15.50:0/132091576 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3d8037040 con 0x7fb3e8103900 2024-08-31T04:31:15.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:31:15.636+0000 7fb3ef000640 1 -- 172.21.15.50:0/132091576 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb3c80052c0 con 0x7fb3e8103900 2024-08-31T04:31:15.641 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:31:15.639+0000 7fb3e4c00640 1 -- 172.21.15.50:0/132091576 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 18) ==== 152577+0+0 (secure 0 0 0) 0x7fb3d8043020 con 0x7fb3e8103900 2024-08-31T04:31:15.643 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:31:15.640+0000 7fb3e4c00640 1 --2- 172.21.15.50:0/132091576 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fb3cc0b4bb0 0x7fb3cc0b70c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:31:15.643 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:31:15.641+0000 7fb3e4c00640 1 -- 172.21.15.50:0/132091576 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8219+0+0 (secure 0 0 0) 0x7fb3d81048a0 con 0x7fb3e8103900 2024-08-31T04:31:15.643 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:31:15.641+0000 7fb3e7400640 1 --2- 172.21.15.50:0/132091576 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fb3cc0b4bb0 0x7fb3cc0b70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:31:15.644 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:31:15.642+0000 7fb3e7400640 1 --2- 172.21.15.50:0/132091576 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fb3cc0b4bb0 0x7fb3cc0b70c0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fb3e8108fa0 tx=0x7fb3d4005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:31:15.645 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:31:15.643+0000 7fb3e4c00640 1 -- 172.21.15.50:0/132091576 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fb3d804a030 con 0x7fb3e8103900 2024-08-31T04:31:15.806 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:31:15 smithi050 ceph-mon[17259]: pgmap v619: 97 pgs: 97 active+clean; 1.5 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 671 KiB/s rd, 847 KiB/s wr, 173 op/s 2024-08-31T04:31:15.905 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:31:15.904+0000 7fb3ef000640 1 -- 172.21.15.50:0/132091576 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb3c80055b0 con 0x7fb3e8103900 2024-08-31T04:31:15.906 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:31:15.905+0000 7fb3e4c00640 1 -- 172.21.15.50:0/132091576 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 42 v42) ==== 94+0+12002 (secure 0 0 0) 0x7fb3d80328c0 con 0x7fb3e8103900 2024-08-31T04:31:15.906 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-08-31T04:31:15.907 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":42,"btime":"2024-08-31T04:30:06:367307+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14622,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/1565557530","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":1565557530},{"type":"v1","addr":"172.21.15.50:6835","nonce":1565557530}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":25924,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6835/4060379633","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6834","nonce":4060379633},{"type":"v1","addr":"172.21.15.177:6835","nonce":4060379633}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":39}],"filesystems":[{"mdsmap":{"epoch":42,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-31T04:20:44.140709+0000","modified":"2024-08-31T04:30:06.030224+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24695,"mds_1":24691,"mds_2":24667,"mds_3":24656,"mds_4":24652},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14676":{"gid":14676,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.50:6839/2105228685","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6838","nonce":2105228685},{"type":"v1","addr":"172.21.15.50:6839","nonce":2105228685}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24590":{"gid":24590,"name":"k","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.133:6833/4283603962","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6832","nonce":4283603962},{"type":"v1","addr":"172.21.15.133:6833","nonce":4283603962}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24601":{"gid":24601,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.177:6833/1237129793","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":1237129793},{"type":"v1","addr":"172.21.15.177:6833","nonce":1237129793}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24626":{"gid":24626,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.133:6835/3637799701","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":3637799701},{"type":"v1","addr":"172.21.15.133:6835","nonce":3637799701}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24652":{"gid":24652,"name":"c","rank":4,"incarnation":26,"state":"up:active","state_seq":13,"addr":"172.21.15.177:6837/2159859285","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6836","nonce":2159859285},{"type":"v1","addr":"172.21.15.177:6837","nonce":2159859285}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24656":{"gid":24656,"name":"h","rank":3,"incarnation":22,"state":"up:active","state_seq":12,"addr":"172.21.15.133:6837/4014853202","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6836","nonce":4014853202},{"type":"v1","addr":"172.21.15.133:6837","nonce":4014853202}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24667":{"gid":24667,"name":"i","rank":2,"incarnation":20,"state":"up:active","state_seq":10,"addr":"172.21.15.177:6839/3600081752","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6838","nonce":3600081752},{"type":"v1","addr":"172.21.15.177:6839","nonce":3600081752}]},"join_fscid":-1,"export_targets":[0,1,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24691":{"gid":24691,"name":"a","rank":1,"incarnation":18,"state":"up:active","state_seq":8,"addr":"172.21.15.50:6841/575209862","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6840","nonce":575209862},{"type":"v1","addr":"172.21.15.50:6841","nonce":575209862}]},"join_fscid":-1,"export_targets":[0,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24695":{"gid":24695,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.133:6839/2526402262","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6838","nonce":2526402262},{"type":"v1","addr":"172.21.15.133:6839","nonce":2526402262}]},"join_fscid":-1,"export_targets":[1],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_26036":{"gid":26036,"name":"d","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.50:6837/2788697263","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6836","nonce":2788697263},{"type":"v1","addr":"172.21.15.50:6837","nonce":2788697263}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24695,"qdb_cluster":[24667,24695,24656,24691,24652]},"id":1}]} 2024-08-31T04:31:15.907 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 42 2024-08-31T04:31:15.909 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:31:15.907+0000 7fb3ef000640 1 -- 172.21.15.50:0/132091576 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fb3cc0b4bb0 msgr2=0x7fb3cc0b70c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:31:15.909 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:31:15.907+0000 7fb3ef000640 1 --2- 172.21.15.50:0/132091576 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fb3cc0b4bb0 0x7fb3cc0b70c0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fb3e8108fa0 tx=0x7fb3d4005f90 comp rx=0 tx=0).stop 2024-08-31T04:31:15.909 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:31:15.907+0000 7fb3ef000640 1 -- 172.21.15.50:0/132091576 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb3e8103900 msgr2=0x7fb3e819a200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:31:15.909 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:31:15.907+0000 7fb3ef000640 1 --2- 172.21.15.50:0/132091576 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb3e8103900 0x7fb3e819a200 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fb3d80303f0 tx=0x7fb3d8032da0 comp rx=0 tx=0).stop 2024-08-31T04:31:15.909 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:31:15.907+0000 7fb3ef000640 1 -- 172.21.15.50:0/132091576 shutdown_connections 2024-08-31T04:31:15.909 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:31:15.907+0000 7fb3ef000640 1 --2- 172.21.15.50:0/132091576 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fb3cc0b4bb0 0x7fb3cc0b70c0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:15.909 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:31:15.907+0000 7fb3ef000640 1 --2- 172.21.15.50:0/132091576 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb3e8109240 0x7fb3e819a7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:15.910 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:31:15.907+0000 7fb3ef000640 1 --2- 172.21.15.50:0/132091576 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb3e8109b90 0x7fb3e819fa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:15.910 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:31:15.907+0000 7fb3ef000640 1 --2- 172.21.15.50:0/132091576 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb3e8103900 0x7fb3e819a200 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:15.910 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:31:15.907+0000 7fb3ef000640 1 -- 172.21.15.50:0/132091576 >> 172.21.15.50:0/132091576 conn(0x7fb3e807b5f0 msgr2=0x7fb3e81072d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:31:15.910 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:31:15.908+0000 7fb3ef000640 1 -- 172.21.15.50:0/132091576 shutdown_connections 2024-08-31T04:31:15.910 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:31:15.908+0000 7fb3ef000640 1 -- 172.21.15.50:0/132091576 wait complete. 2024-08-31T04:31:15.996 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:31:15 smithi177 ceph-mon[22025]: pgmap v619: 97 pgs: 97 active+clean; 1.5 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 671 KiB/s rd, 847 KiB/s wr, 173 op/s 2024-08-31T04:31:16.043 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:31:15 smithi133 ceph-mon[22177]: pgmap v619: 97 pgs: 97 active+clean; 1.5 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 671 KiB/s rd, 847 KiB/s wr, 173 op/s 2024-08-31T04:31:16.638 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:31:16 smithi050 ceph-mon[17259]: from='client.? 172.21.15.50:0/132091576' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T04:31:16.709 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24695 quiesce db --set-id 9d491f02 --await-for 45.0' 2024-08-31T04:31:16.709 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 058d9fc6-674f-11ef-bcd4-c7b262605968 -- timeout 105 ceph tell mds.24695 quiesce db --set-id 9d491f02 --await-for 45.0 2024-08-31T04:31:16.996 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:31:16 smithi177 ceph-mon[22025]: from='client.? 172.21.15.50:0/132091576' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T04:31:17.042 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:31:16 smithi133 ceph-mon[22177]: from='client.? 172.21.15.50:0/132091576' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T04:31:17.090 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:31:17.753 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:31:17 smithi050 ceph-mon[17259]: pgmap v620: 97 pgs: 97 active+clean; 1.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.7 MiB/s wr, 300 op/s 2024-08-31T04:31:17.996 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:31:17 smithi177 ceph-mon[22025]: pgmap v620: 97 pgs: 97 active+clean; 1.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.7 MiB/s wr, 300 op/s 2024-08-31T04:31:18.010 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:31:18.008+0000 7effece00640 1 -- 172.21.15.50:0/1066201142 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7effe8102ca0 msgr2=0x7effe81071d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:31:18.010 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:31:18.008+0000 7effece00640 1 --2- 172.21.15.50:0/1066201142 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7effe8102ca0 0x7effe81071d0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7effd4009930 tx=0x7effd402a440 comp rx=0 tx=0).stop 2024-08-31T04:31:18.010 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:31:18.008+0000 7effece00640 1 -- 172.21.15.50:0/1066201142 shutdown_connections 2024-08-31T04:31:18.010 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:31:18.008+0000 7effece00640 1 --2- 172.21.15.50:0/1066201142 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7effe8107790 0x7effe8107c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:18.010 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:31:18.008+0000 7effece00640 1 --2- 172.21.15.50:0/1066201142 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7effe8102ca0 0x7effe81071d0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:18.010 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:31:18.008+0000 7effece00640 1 --2- 172.21.15.50:0/1066201142 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7effe8102350 0x7effe8102760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:18.010 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:31:18.008+0000 7effece00640 1 -- 172.21.15.50:0/1066201142 >> 172.21.15.50:0/1066201142 conn(0x7effe80fe060 msgr2=0x7effe81004b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:31:18.010 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:31:18.008+0000 7effece00640 1 -- 172.21.15.50:0/1066201142 shutdown_connections 2024-08-31T04:31:18.011 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:31:18.009+0000 7effece00640 1 -- 172.21.15.50:0/1066201142 wait complete. 2024-08-31T04:31:18.012 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:31:18.010+0000 7effece00640 1 Processor -- start 2024-08-31T04:31:18.012 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:31:18.011+0000 7effece00640 1 -- start start 2024-08-31T04:31:18.013 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:31:18.011+0000 7effece00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7effe8102350 0x7effe81a0690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:31:18.013 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:31:18.011+0000 7effece00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7effe8102ca0 0x7effe81a0c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:31:18.013 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:31:18.011+0000 7effece00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7effe8107790 0x7effe81a5ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:31:18.013 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:31:18.011+0000 7effece00640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7effe8119c80 con 0x7effe8102350 2024-08-31T04:31:18.013 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:31:18.011+0000 7effece00640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7effe8119b00 con 0x7effe8107790 2024-08-31T04:31:18.013 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:31:18.011+0000 7effece00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7effe8119e00 con 0x7effe8102ca0 2024-08-31T04:31:18.014 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:31:18.012+0000 7effe7e00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7effe8107790 0x7effe81a5ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:31:18.014 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:31:18.012+0000 7effe6a00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7effe8102ca0 0x7effe81a0c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:31:18.014 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:31:18.012+0000 7effe7e00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7effe8107790 0x7effe81a5ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.50:53580/0 (socket says 172.21.15.50:53580) 2024-08-31T04:31:18.014 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:31:18.012+0000 7effe7e00640 1 -- 172.21.15.50:0/2478485648 learned_addr learned my addr 172.21.15.50:0/2478485648 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:31:18.014 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:31:18.012+0000 7effe7400640 1 --2- 172.21.15.50:0/2478485648 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7effe8102350 0x7effe81a0690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:31:18.014 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:31:18.012+0000 7effe6a00640 1 -- 172.21.15.50:0/2478485648 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7effe8107790 msgr2=0x7effe81a5ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:31:18.014 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:31:18.012+0000 7effe6a00640 1 --2- 172.21.15.50:0/2478485648 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7effe8107790 0x7effe81a5ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:18.014 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:31:18.012+0000 7effe6a00640 1 -- 172.21.15.50:0/2478485648 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7effe8102350 msgr2=0x7effe81a0690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:31:18.015 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:31:18.012+0000 7effe6a00640 1 --2- 172.21.15.50:0/2478485648 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7effe8102350 0x7effe81a0690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:18.015 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:31:18.012+0000 7effe6a00640 1 -- 172.21.15.50:0/2478485648 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7effe81a6600 con 0x7effe8102ca0 2024-08-31T04:31:18.015 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:31:18.012+0000 7effe7400640 1 --2- 172.21.15.50:0/2478485648 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7effe8102350 0x7effe81a0690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:31:18.015 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:31:18.013+0000 7effe6a00640 1 --2- 172.21.15.50:0/2478485648 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7effe8102ca0 0x7effe81a0c30 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7effd402aa30 tx=0x7effd4003ba0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:31:18.015 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:31:18.013+0000 7effdfe00640 1 -- 172.21.15.50:0/2478485648 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effd403f070 con 0x7effe8102ca0 2024-08-31T04:31:18.015 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:31:18.014+0000 7effece00640 1 -- 172.21.15.50:0/2478485648 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7effe81a6890 con 0x7effe8102ca0 2024-08-31T04:31:18.016 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:31:18.014+0000 7effdfe00640 1 -- 172.21.15.50:0/2478485648 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7effd4031b50 con 0x7effe8102ca0 2024-08-31T04:31:18.016 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:31:18.014+0000 7effdfe00640 1 -- 172.21.15.50:0/2478485648 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effd4035030 con 0x7effe8102ca0 2024-08-31T04:31:18.016 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:31:18.014+0000 7effece00640 1 -- 172.21.15.50:0/2478485648 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7effe81ad050 con 0x7effe8102ca0 2024-08-31T04:31:18.020 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:31:18.019+0000 7efff51bf740 1 Processor -- start 2024-08-31T04:31:18.021 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:31:18.020+0000 7efff51bf740 1 -- start start 2024-08-31T04:31:18.021 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:31:18.020+0000 7efff51bf740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55edca0ec520 0x55edca491d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:31:18.023 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:31:18.020+0000 7efff51bf740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55edca0c3660 0x55edca492250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:31:18.023 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:31:18.020+0000 7efff51bf740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55edca0cb840 0x55edca492790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:31:18.023 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:31:18.020+0000 7efff51bf740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55edca408870 con 0x55edca0c3660 2024-08-31T04:31:18.024 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:31:18.020+0000 7efff51bf740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x55edca3f7e00 con 0x55edca0cb840 2024-08-31T04:31:18.024 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:31:18.020+0000 7efff51bf740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x55edca3fbdb0 con 0x55edca0ec520 2024-08-31T04:31:18.024 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:31:18.020+0000 7effdfe00640 1 -- 172.21.15.50:0/2478485648 <== mon.1 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 18) ==== 152577+0+0 (secure 0 0 0) 0x7effd4042070 con 0x7effe8102ca0 2024-08-31T04:31:18.024 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:31:18.021+0000 7effe7400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55edca0c3660 0x55edca492250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:31:18.024 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:31:18.021+0000 7effe7e00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55edca0ec520 0x55edca491d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:31:18.024 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:31:18.021+0000 7effe7400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55edca0c3660 0x55edca492250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:46728/0 (socket says 172.21.15.50:46728) 2024-08-31T04:31:18.024 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:31:18.021+0000 7effe7400640 1 -- 172.21.15.50:0/2646842326 learned_addr learned my addr 172.21.15.50:0/2646842326 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:31:18.024 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:31:18.021+0000 7effe6a00640 1 --2- 172.21.15.50:0/2646842326 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55edca0cb840 0x55edca492790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:31:18.024 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:31:18.021+0000 7effe6a00640 1 -- 172.21.15.50:0/2646842326 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55edca0ec520 msgr2=0x55edca491d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:31:18.024 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:31:18.021+0000 7effe6a00640 1 --2- 172.21.15.50:0/2646842326 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55edca0ec520 0x55edca491d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:18.024 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:31:18.021+0000 7effe6a00640 1 -- 172.21.15.50:0/2646842326 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55edca0c3660 msgr2=0x55edca492250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:31:18.024 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:31:18.021+0000 7effe6a00640 1 --2- 172.21.15.50:0/2646842326 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55edca0c3660 0x55edca492250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:18.024 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:31:18.021+0000 7effe6a00640 1 -- 172.21.15.50:0/2646842326 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55edca38b3a0 con 0x55edca0cb840 2024-08-31T04:31:18.025 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:31:18.022+0000 7effe6a00640 1 --2- 172.21.15.50:0/2646842326 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55edca0cb840 0x55edca492790 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7effd4102ea0 tx=0x7effd410d520 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3b94cebbdeceb6c2 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:31:18.026 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:31:18.023+0000 7effdcc00640 1 -- 172.21.15.50:0/2646842326 <== mon.2 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effd4107310 con 0x55edca0cb840 2024-08-31T04:31:18.026 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:31:18.023+0000 7effdcc00640 1 -- 172.21.15.50:0/2646842326 <== mon.2 v2:172.21.15.133:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7effd4105cb0 con 0x55edca0cb840 2024-08-31T04:31:18.026 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:31:18.023+0000 7effdcc00640 1 -- 172.21.15.50:0/2646842326 <== mon.2 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effd4116990 con 0x55edca0cb840 2024-08-31T04:31:18.027 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:31:18.024+0000 7efff51bf740 1 -- 172.21.15.50:0/2646842326 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55edca0cb840 msgr2=0x55edca492790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:31:18.027 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:31:18.024+0000 7efff51bf740 1 --2- 172.21.15.50:0/2646842326 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55edca0cb840 0x55edca492790 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7effd4102ea0 tx=0x7effd410d520 comp rx=0 tx=0).stop 2024-08-31T04:31:18.027 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:31:18.025+0000 7efff51bf740 1 -- 172.21.15.50:0/2646842326 shutdown_connections 2024-08-31T04:31:18.027 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:31:18.025+0000 7efff51bf740 1 --2- 172.21.15.50:0/2646842326 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55edca0cb840 0x55edca492790 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:18.027 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:31:18.025+0000 7efff51bf740 1 --2- 172.21.15.50:0/2646842326 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55edca0c3660 0x55edca492250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:18.027 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:31:18.025+0000 7efff51bf740 1 --2- 172.21.15.50:0/2646842326 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55edca0ec520 0x55edca491d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:18.027 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:31:18.025+0000 7efff51bf740 1 -- 172.21.15.50:0/2646842326 >> 172.21.15.50:0/2646842326 conn(0x55edca0e0910 msgr2=0x55edca48fc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:31:18.028 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:31:18.025+0000 7efff51bf740 1 -- 172.21.15.50:0/2646842326 shutdown_connections 2024-08-31T04:31:18.028 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:31:18.025+0000 7efff51bf740 1 -- 172.21.15.50:0/2646842326 wait complete. 2024-08-31T04:31:18.028 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:31:18.025+0000 7effdfe00640 1 --2- 172.21.15.50:0/2478485648 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7effcc0b4b40 0x7effcc0b7050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:31:18.028 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:31:18.026+0000 7efff51bf740 1 -- start start 2024-08-31T04:31:18.028 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:31:18.026+0000 7efff51bf740 1 Processor -- start 2024-08-31T04:31:18.029 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:31:18.027+0000 7efff51bf740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55edca0c3660 0x55edca49d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:31:18.029 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:31:18.027+0000 7efff51bf740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55edca0cb840 0x55edca49d9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:31:18.029 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:31:18.027+0000 7efff51bf740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55edca0ec520 0x55edca4a9510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:31:18.029 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:31:18.027+0000 7efff51bf740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55edca25abb0 con 0x55edca0cb840 2024-08-31T04:31:18.029 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:31:18.027+0000 7efff51bf740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x55edca37eda0 con 0x55edca0c3660 2024-08-31T04:31:18.029 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:31:18.027+0000 7efff51bf740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x55edca4a02b0 con 0x55edca0ec520 2024-08-31T04:31:18.029 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:31:18.027+0000 7efff51bf740 10 client.0 _ll_register_callbacks cb 0x55edca3af440 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:31:18.029 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:31:18.027+0000 7effe7e00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55edca0ec520 0x55edca4a9510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:31:18.030 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:31:18.028+0000 7effe7e00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55edca0ec520 0x55edca4a9510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.50:43676/0 (socket says 172.21.15.50:43676) 2024-08-31T04:31:18.030 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:31:18.028+0000 7effe7e00640 1 -- 172.21.15.50:0/1056215346 learned_addr learned my addr 172.21.15.50:0/1056215346 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:31:18.030 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:31:18.028+0000 7effe6a00640 1 --2- 172.21.15.50:0/1056215346 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55edca0cb840 0x55edca49d9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:31:18.030 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:31:18.028+0000 7effdfe00640 1 -- 172.21.15.50:0/2478485648 <== mon.1 v2:172.21.15.177:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8219+0+0 (secure 0 0 0) 0x7effd4105450 con 0x7effe8102ca0 2024-08-31T04:31:18.031 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:31:18.029+0000 7effe7e00640 1 -- 172.21.15.50:0/1056215346 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55edca0c3660 msgr2=0x55edca49d4b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-31T04:31:18.031 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:31:18.029+0000 7effe7e00640 1 --2- 172.21.15.50:0/1056215346 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55edca0c3660 0x55edca49d4b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:18.031 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:31:18.029+0000 7effe7e00640 1 -- 172.21.15.50:0/1056215346 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55edca0cb840 msgr2=0x55edca49d9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:31:18.031 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:31:18.029+0000 7effe7e00640 1 --2- 172.21.15.50:0/1056215346 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55edca0cb840 0x55edca49d9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:18.031 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:31:18.029+0000 7effe7e00640 1 -- 172.21.15.50:0/1056215346 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55edca157b00 con 0x55edca0ec520 2024-08-31T04:31:18.031 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:31:18.029+0000 7effe7e00640 1 --2- 172.21.15.50:0/1056215346 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55edca0ec520 0x55edca4a9510 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7effe0023d30 tx=0x7effe000f790 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a5f54fee80d2dddd server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:31:18.031 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:31:18.029+0000 7effd1600640 10 client.0 ms_handle_connect on v2:172.21.15.177:3300/0 2024-08-31T04:31:18.032 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:31:18.029+0000 7effe7400640 1 --2- 172.21.15.50:0/2478485648 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7effcc0b4b40 0x7effcc0b7050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:31:18.032 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:31:18.029+0000 7effd1600640 1 -- 172.21.15.50:0/1056215346 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effe000fe20 con 0x55edca0ec520 2024-08-31T04:31:18.032 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:31:18.030+0000 7effd1600640 1 -- 172.21.15.50:0/1056215346 <== mon.1 v2:172.21.15.177:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8219+0+0 (secure 0 0 0) 0x7effe0004b20 con 0x55edca0ec520 2024-08-31T04:31:18.032 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:31:18.030+0000 7efff51bf740 1 -- 172.21.15.50:0/1056215346 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7effd4105cb0 con 0x55edca0ec520 2024-08-31T04:31:18.032 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:31:18.030+0000 7effd1600640 1 -- 172.21.15.50:0/1056215346 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7effe0004d20 con 0x55edca0ec520 2024-08-31T04:31:18.032 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:31:18.030+0000 7efff51bf740 10 client.26197 fetch_fsmap learned FSMap version 42 2024-08-31T04:31:18.032 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:31:18.030+0000 7efff51bf740 1 -- 172.21.15.50:0/1056215346 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x55edca4ac080 con 0x55edca0ec520 2024-08-31T04:31:18.033 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:31:18.031+0000 7effd1600640 1 -- 172.21.15.50:0/1056215346 <== mon.1 v2:172.21.15.177:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7effd4105cb0 con 0x55edca0ec520 2024-08-31T04:31:18.033 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:31:18.031+0000 7effd1600640 1 -- 172.21.15.50:0/1056215346 <== mon.1 v2:172.21.15.177:3300/0 5 ==== fsmap(e 42) ==== 8398+0+0 (secure 0 0 0) 0x7effe0005020 con 0x55edca0ec520 2024-08-31T04:31:18.033 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:31:18.031+0000 7efff51bf740 10 client.26197 fetch_fsmap finished waiting for FSMap version 42 2024-08-31T04:31:18.033 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:31:18.031+0000 7efff51bf740 10 client.26197 resolve_mds: validated gid 24695 aka daemon mds.b 2024-08-31T04:31:18.033 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:31:18.031+0000 7efff51bf740 20 client.26197 populate_metadata read hostname 'smithi050' 2024-08-31T04:31:18.033 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:31:18.031+0000 7efff51bf740 1 --2- 172.21.15.50:0/1056215346 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x55edca0aaea0 0x55edca4af580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:31:18.033 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:31:18.031+0000 7efff51bf740 4 client.26197 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T04:31:18.034 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:31:18.031+0000 7efff51bf740 1 -- 172.21.15.50:0/1056215346 --> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55edca40a7c0 con 0x55edca0aaea0 2024-08-31T04:31:18.034 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:31:18.032+0000 7effe7400640 1 --2- 172.21.15.50:0/2478485648 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7effcc0b4b40 0x7effcc0b7050 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x55edca49fd00 tx=0x7effd800b660 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:31:18.034 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:31:18.033+0000 7effe7400640 1 --2- 172.21.15.50:0/1056215346 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x55edca0aaea0 0x55edca4af580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:31:18.035 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:31:18.033+0000 7effe7400640 1 --2- 172.21.15.50:0/1056215346 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x55edca0aaea0 0x55edca4af580 crc :-1 s=READY pgs=118 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a7d577b5bff9344f server_cookie=6952dfdfda85c962 in_seq=0 out_seq=0 2024-08-31T04:31:18.035 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:31:18.033+0000 7effd1600640 10 client.26197 ms_handle_connect on v2:172.21.15.133:6838/2526402262 2024-08-31T04:31:18.036 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:31:18.034+0000 7effd1600640 1 -- 172.21.15.50:0/1056215346 <== mds.0 v2:172.21.15.133:6838/2526402262 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55edca40a7c0 con 0x55edca0aaea0 2024-08-31T04:31:18.036 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:31:18.034+0000 7effd1600640 10 client.26197 handle_command_reply: tid=0 2024-08-31T04:31:18.036 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:31:18.034+0000 7efff51bf740 1 client.26197 shutdown 2024-08-31T04:31:18.036 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:31:18.035+0000 7efff51bf740 1 -- 172.21.15.50:0/1056215346 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55edca0ec520 msgr2=0x55edca4a9510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:31:18.037 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:31:18.035+0000 7efff51bf740 1 --2- 172.21.15.50:0/1056215346 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55edca0ec520 0x55edca4a9510 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7effe0023d30 tx=0x7effe000f790 comp rx=0 tx=0).stop 2024-08-31T04:31:18.037 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:31:18.035+0000 7efff51bf740 1 -- 172.21.15.50:0/1056215346 shutdown_connections 2024-08-31T04:31:18.037 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:31:18.035+0000 7efff51bf740 1 --2- 172.21.15.50:0/1056215346 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x55edca0aaea0 0x55edca4af580 crc :-1 s=READY pgs=118 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:18.037 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:31:18.035+0000 7efff51bf740 1 --2- 172.21.15.50:0/1056215346 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55edca0ec520 0x55edca4a9510 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:18.037 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:31:18.035+0000 7efff51bf740 1 --2- 172.21.15.50:0/1056215346 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55edca0cb840 0x55edca49d9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:18.037 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:31:18.035+0000 7efff51bf740 1 --2- 172.21.15.50:0/1056215346 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55edca0c3660 0x55edca49d4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:18.037 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:31:18.035+0000 7efff51bf740 1 -- 172.21.15.50:0/1056215346 >> 172.21.15.50:0/1056215346 conn(0x55edca0e0910 msgr2=0x55edca494ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:31:18.037 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:31:18.035+0000 7effd1600640 0 client.26197 ms_handle_reset on v2:172.21.15.133:6838/2526402262 2024-08-31T04:31:18.038 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:31:18.036+0000 7efff51bf740 1 -- 172.21.15.50:0/1056215346 shutdown_connections 2024-08-31T04:31:18.038 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:31:18.036+0000 7efff51bf740 1 -- 172.21.15.50:0/1056215346 wait complete. 2024-08-31T04:31:18.038 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:31:18.036+0000 7efff51bf740 20 client.26197 trim_cache size 0 max 16384 2024-08-31T04:31:18.043 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:31:17 smithi133 ceph-mon[22177]: pgmap v620: 97 pgs: 97 active+clean; 1.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.7 MiB/s wr, 300 op/s 2024-08-31T04:31:18.074 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:31:18.073+0000 7efff51bf740 1 Processor -- start 2024-08-31T04:31:18.074 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:31:18.073+0000 7efff51bf740 1 -- start start 2024-08-31T04:31:18.075 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:31:18.073+0000 7efff51bf740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55edca0c3660 0x55edca4a93f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:31:18.075 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:31:18.073+0000 7efff51bf740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55edca0cb840 0x55edca4a9930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:31:18.075 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:31:18.073+0000 7efff51bf740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55edca0ec520 0x55edca49a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:31:18.075 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:31:18.073+0000 7efff51bf740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7effe81af3c0 con 0x55edca0ec520 2024-08-31T04:31:18.075 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:31:18.073+0000 7efff51bf740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7effe8111f00 con 0x55edca0cb840 2024-08-31T04:31:18.075 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:31:18.073+0000 7efff51bf740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7effe81aec30 con 0x55edca0c3660 2024-08-31T04:31:18.076 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:31:18.074+0000 7effe6a00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55edca0cb840 0x55edca4a9930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:31:18.076 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:31:18.074+0000 7effe6a00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55edca0cb840 0x55edca4a9930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.50:53592/0 (socket says 172.21.15.50:53592) 2024-08-31T04:31:18.076 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:31:18.074+0000 7effe6a00640 1 -- 172.21.15.50:0/2766037469 learned_addr learned my addr 172.21.15.50:0/2766037469 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:31:18.076 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:31:18.074+0000 7effe7e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55edca0ec520 0x55edca49a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:31:18.076 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:31:18.074+0000 7effe7400640 1 --2- 172.21.15.50:0/2766037469 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55edca0c3660 0x55edca4a93f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:31:18.076 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:31:18.075+0000 7effe7e00640 1 -- 172.21.15.50:0/2766037469 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55edca0c3660 msgr2=0x55edca4a93f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:31:18.077 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:31:18.075+0000 7effe7e00640 1 --2- 172.21.15.50:0/2766037469 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55edca0c3660 0x55edca4a93f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:18.077 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:31:18.075+0000 7effe7e00640 1 -- 172.21.15.50:0/2766037469 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55edca0cb840 msgr2=0x55edca4a9930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:31:18.077 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:31:18.075+0000 7effe7e00640 1 --2- 172.21.15.50:0/2766037469 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55edca0cb840 0x55edca4a9930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:18.077 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:31:18.075+0000 7effe7e00640 1 -- 172.21.15.50:0/2766037469 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55edca489e20 con 0x55edca0ec520 2024-08-31T04:31:18.077 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:31:18.075+0000 7effe7400640 1 --2- 172.21.15.50:0/2766037469 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55edca0c3660 0x55edca4a93f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:31:18.078 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:31:18.075+0000 7effe7e00640 1 --2- 172.21.15.50:0/2766037469 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55edca0ec520 0x55edca49a6a0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7effe0005470 tx=0x7effe0009fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7c0831360bc4bef server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:31:18.078 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:31:18.076+0000 7effd3e00640 1 -- 172.21.15.50:0/2766037469 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effe0023800 con 0x55edca0ec520 2024-08-31T04:31:18.078 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:31:18.076+0000 7effd3e00640 1 -- 172.21.15.50:0/2766037469 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7effe00049d0 con 0x55edca0ec520 2024-08-31T04:31:18.079 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:31:18.076+0000 7effd3e00640 1 -- 172.21.15.50:0/2766037469 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effe002d710 con 0x55edca0ec520 2024-08-31T04:31:18.079 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:31:18.077+0000 7efff51bf740 1 -- 172.21.15.50:0/2766037469 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55edca0ec520 msgr2=0x55edca49a6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:31:18.079 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:31:18.077+0000 7efff51bf740 1 --2- 172.21.15.50:0/2766037469 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55edca0ec520 0x55edca49a6a0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7effe0005470 tx=0x7effe0009fd0 comp rx=0 tx=0).stop 2024-08-31T04:31:18.079 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:31:18.078+0000 7efff51bf740 1 -- 172.21.15.50:0/2766037469 shutdown_connections 2024-08-31T04:31:18.079 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:31:18.078+0000 7efff51bf740 1 --2- 172.21.15.50:0/2766037469 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55edca0ec520 0x55edca49a6a0 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:18.080 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:31:18.078+0000 7efff51bf740 1 --2- 172.21.15.50:0/2766037469 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55edca0cb840 0x55edca4a9930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:18.080 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:31:18.078+0000 7efff51bf740 1 --2- 172.21.15.50:0/2766037469 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55edca0c3660 0x55edca4a93f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:18.080 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:31:18.078+0000 7efff51bf740 1 -- 172.21.15.50:0/2766037469 >> 172.21.15.50:0/2766037469 conn(0x55edca0e0910 msgr2=0x55edca495480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:31:18.080 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:31:18.078+0000 7efff51bf740 1 -- 172.21.15.50:0/2766037469 shutdown_connections 2024-08-31T04:31:18.080 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:31:18.078+0000 7efff51bf740 1 -- 172.21.15.50:0/2766037469 wait complete. 2024-08-31T04:31:18.080 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:31:18.079+0000 7efff51bf740 1 -- start start 2024-08-31T04:31:18.081 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:31:18.079+0000 7efff51bf740 1 Processor -- start 2024-08-31T04:31:18.082 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:31:18.080+0000 7efff51bf740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55edca0c3660 0x55edca4a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:31:18.082 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:31:18.080+0000 7efff51bf740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55edca0cb840 0x55edca4a1db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:31:18.082 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:31:18.080+0000 7efff51bf740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55edca0ec520 0x55edca4a22f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:31:18.082 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:31:18.080+0000 7efff51bf740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7effe81ade60 con 0x55edca0cb840 2024-08-31T04:31:18.082 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:31:18.080+0000 7efff51bf740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7effe81ad6d0 con 0x55edca0ec520 2024-08-31T04:31:18.082 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:31:18.080+0000 7efff51bf740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7effe81ae560 con 0x55edca0c3660 2024-08-31T04:31:18.082 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:31:18.080+0000 7efff51bf740 10 client.0 _ll_register_callbacks cb 0x7effe0009cd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:31:18.082 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:31:18.081+0000 7effe7400640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55edca0c3660 0x55edca4a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:31:18.082 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:31:18.081+0000 7effe7400640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55edca0c3660 0x55edca4a58f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.50:43694/0 (socket says 172.21.15.50:43694) 2024-08-31T04:31:18.083 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:31:18.081+0000 7effe7400640 1 -- 172.21.15.50:0/3078734134 learned_addr learned my addr 172.21.15.50:0/3078734134 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:31:18.083 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:31:18.081+0000 7effe6a00640 1 --2- 172.21.15.50:0/3078734134 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55edca0cb840 0x55edca4a1db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:31:18.083 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:31:18.081+0000 7effe7e00640 1 --2- 172.21.15.50:0/3078734134 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55edca0ec520 0x55edca4a22f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:31:18.084 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:31:18.081+0000 7effe7400640 1 -- 172.21.15.50:0/3078734134 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55edca0ec520 msgr2=0x55edca4a22f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:31:18.084 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:31:18.081+0000 7effe7400640 1 --2- 172.21.15.50:0/3078734134 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55edca0ec520 0x55edca4a22f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:18.084 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:31:18.081+0000 7effe7400640 1 -- 172.21.15.50:0/3078734134 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55edca0cb840 msgr2=0x55edca4a1db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:31:18.084 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:31:18.081+0000 7effe7400640 1 --2- 172.21.15.50:0/3078734134 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55edca0cb840 0x55edca4a1db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:18.084 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:31:18.081+0000 7effe7400640 1 -- 172.21.15.50:0/3078734134 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55edca4a2830 con 0x55edca0c3660 2024-08-31T04:31:18.084 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:31:18.081+0000 7effe6a00640 1 --2- 172.21.15.50:0/3078734134 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55edca0cb840 0x55edca4a1db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T04:31:18.084 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:31:18.082+0000 7effe7e00640 1 --2- 172.21.15.50:0/3078734134 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55edca0ec520 0x55edca4a22f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:31:18.084 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:31:18.082+0000 7effd1600640 10 client.0 ms_handle_connect on v2:172.21.15.177:3300/0 2024-08-31T04:31:18.084 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:31:18.082+0000 7effe7400640 1 --2- 172.21.15.50:0/3078734134 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55edca0c3660 0x55edca4a58f0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x55edca490990 tx=0x7effd80046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a3d22ef768ccada0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:31:18.085 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:31:18.082+0000 7effd1600640 1 -- 172.21.15.50:0/3078734134 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effd802a070 con 0x55edca0c3660 2024-08-31T04:31:18.085 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:31:18.082+0000 7effd1600640 1 -- 172.21.15.50:0/3078734134 <== mon.1 v2:172.21.15.177:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8219+0+0 (secure 0 0 0) 0x7effd8005220 con 0x55edca0c3660 2024-08-31T04:31:18.085 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:31:18.082+0000 7efff51bf740 1 -- 172.21.15.50:0/3078734134 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7effe00049d0 con 0x55edca0c3660 2024-08-31T04:31:18.086 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:31:18.083+0000 7effd1600640 1 -- 172.21.15.50:0/3078734134 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7effd8035050 con 0x55edca0c3660 2024-08-31T04:31:18.086 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:31:18.083+0000 7efff51bf740 10 client.26203 fetch_fsmap learned FSMap version 42 2024-08-31T04:31:18.086 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:31:18.083+0000 7efff51bf740 1 -- 172.21.15.50:0/3078734134 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x55edca51abf0 con 0x55edca0c3660 2024-08-31T04:31:18.086 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:31:18.083+0000 7effd1600640 1 -- 172.21.15.50:0/3078734134 <== mon.1 v2:172.21.15.177:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7effd8004c50 con 0x55edca0c3660 2024-08-31T04:31:18.086 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:31:18.084+0000 7effd1600640 1 -- 172.21.15.50:0/3078734134 <== mon.1 v2:172.21.15.177:3300/0 5 ==== fsmap(e 42) ==== 8398+0+0 (secure 0 0 0) 0x7effd8019040 con 0x55edca0c3660 2024-08-31T04:31:18.086 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:31:18.084+0000 7efff51bf740 10 client.26203 fetch_fsmap finished waiting for FSMap version 42 2024-08-31T04:31:18.086 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:31:18.084+0000 7efff51bf740 10 client.26203 resolve_mds: validated gid 24695 aka daemon mds.b 2024-08-31T04:31:18.086 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:31:18.084+0000 7efff51bf740 20 client.26203 populate_metadata read hostname 'smithi050' 2024-08-31T04:31:18.086 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:31:18.084+0000 7efff51bf740 1 --2- 172.21.15.50:0/3078734134 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x55edca080250 0x55edca51d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:31:18.086 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:31:18.084+0000 7efff51bf740 4 client.26203 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "9d491f02", "await_for": 45.0}] 2024-08-31T04:31:18.086 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:31:18.084+0000 7efff51bf740 1 -- 172.21.15.50:0/3078734134 --> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] -- command(tid 0: {"prefix": "quiesce db", "set_id": "9d491f02", "await_for": 45.0}) -- 0x7effe00049d0 con 0x55edca080250 2024-08-31T04:31:18.087 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:31:18.084+0000 7effe6a00640 1 --2- 172.21.15.50:0/3078734134 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x55edca080250 0x55edca51d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:31:18.087 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:31:18.085+0000 7effe6a00640 1 --2- 172.21.15.50:0/3078734134 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x55edca080250 0x55edca51d3f0 crc :-1 s=READY pgs=119 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=33273f73ded2f54 server_cookie=fcee93173240ead in_seq=0 out_seq=0 2024-08-31T04:31:18.087 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:31:18.085+0000 7effd1600640 10 client.26203 ms_handle_connect on v2:172.21.15.133:6838/2526402262 2024-08-31T04:31:18.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:31:18.085+0000 7effd1600640 1 -- 172.21.15.50:0/3078734134 <== mds.0 v2:172.21.15.133:6838/2526402262 1 ==== command_reply(tid 0: -1 ) ==== 8+0+593 (crc 0 0 0) 0x7effe00049d0 con 0x55edca080250 2024-08-31T04:31:18.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:31:18.085+0000 7effd1600640 10 client.26203 handle_command_reply: tid=0 2024-08-31T04:31:18.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:31:18.085+0000 7efff51bf740 1 client.26203 shutdown 2024-08-31T04:31:18.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:31:18.085+0000 7efff51bf740 1 -- 172.21.15.50:0/3078734134 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55edca0c3660 msgr2=0x55edca4a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:31:18.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:31:18.085+0000 7efff51bf740 1 --2- 172.21.15.50:0/3078734134 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55edca0c3660 0x55edca4a58f0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x55edca490990 tx=0x7effd80046c0 comp rx=0 tx=0).stop 2024-08-31T04:31:18.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:31:18.086+0000 7efff51bf740 1 -- 172.21.15.50:0/3078734134 shutdown_connections 2024-08-31T04:31:18.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:31:18.086+0000 7efff51bf740 1 --2- 172.21.15.50:0/3078734134 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x55edca080250 0x55edca51d3f0 crc :-1 s=READY pgs=119 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:18.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:31:18.086+0000 7efff51bf740 1 --2- 172.21.15.50:0/3078734134 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55edca0ec520 0x55edca4a22f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:18.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:31:18.086+0000 7efff51bf740 1 --2- 172.21.15.50:0/3078734134 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55edca0cb840 0x55edca4a1db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:18.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:31:18.086+0000 7efff51bf740 1 --2- 172.21.15.50:0/3078734134 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55edca0c3660 0x55edca4a58f0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:18.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:31:18.086+0000 7efff51bf740 1 -- 172.21.15.50:0/3078734134 >> 172.21.15.50:0/3078734134 conn(0x55edca0e0910 msgr2=0x55edca495480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:31:18.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:31:18.086+0000 7effd1600640 0 client.26203 ms_handle_reset on v2:172.21.15.133:6838/2526402262 2024-08-31T04:31:18.088 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:31:18.086+0000 7efff51bf740 1 -- 172.21.15.50:0/3078734134 shutdown_connections 2024-08-31T04:31:18.089 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:31:18.086+0000 7efff51bf740 1 -- 172.21.15.50:0/3078734134 wait complete. 2024-08-31T04:31:18.089 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:31:18.086+0000 7efff51bf740 20 client.26203 trim_cache size 0 max 16384 2024-08-31T04:31:18.089 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-08-31T04:31:18.089 INFO:teuthology.orchestra.run.smithi050.stdout: "epoch": 42, 2024-08-31T04:31:18.090 INFO:teuthology.orchestra.run.smithi050.stdout: "leader": 24695, 2024-08-31T04:31:18.090 INFO:teuthology.orchestra.run.smithi050.stdout: "set_version": 18, 2024-08-31T04:31:18.090 INFO:teuthology.orchestra.run.smithi050.stdout: "sets": { 2024-08-31T04:31:18.090 INFO:teuthology.orchestra.run.smithi050.stdout: "9d491f02": { 2024-08-31T04:31:18.090 INFO:teuthology.orchestra.run.smithi050.stdout: "version": 18, 2024-08-31T04:31:18.090 INFO:teuthology.orchestra.run.smithi050.stdout: "age_ref": 0.7, 2024-08-31T04:31:18.090 INFO:teuthology.orchestra.run.smithi050.stdout: "state": { 2024-08-31T04:31:18.090 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "TIMEDOUT", 2024-08-31T04:31:18.090 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 0.0 2024-08-31T04:31:18.090 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:31:18.090 INFO:teuthology.orchestra.run.smithi050.stdout: "timeout": 90.0, 2024-08-31T04:31:18.090 INFO:teuthology.orchestra.run.smithi050.stdout: "expiration": 152.7, 2024-08-31T04:31:18.090 INFO:teuthology.orchestra.run.smithi050.stdout: "members": { 2024-08-31T04:31:18.091 INFO:teuthology.orchestra.run.smithi050.stdout: "file:/": { 2024-08-31T04:31:18.091 INFO:teuthology.orchestra.run.smithi050.stdout: "excluded": false, 2024-08-31T04:31:18.091 INFO:teuthology.orchestra.run.smithi050.stdout: "state": { 2024-08-31T04:31:18.091 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "QUIESCING", 2024-08-31T04:31:18.091 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 90.0 2024-08-31T04:31:18.091 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T04:31:18.091 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T04:31:18.091 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T04:31:18.091 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T04:31:18.091 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T04:31:18.091 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-08-31T04:31:18.091 INFO:teuthology.orchestra.run.smithi050.stderr:Error EPERM: 2024-08-31T04:31:18.845 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-31T04:31:18.846 ERROR:tasks.quiescer.fs.[cephfs]:Couldn't quiesce root with rc: 1 (EPERM), stdout: { "epoch": 42, "leader": 24695, "set_version": 18, "sets": { "9d491f02": { "version": 18, "age_ref": 0.7, "state": { "name": "TIMEDOUT", "age": 0.0 }, "timeout": 90.0, "expiration": 152.7, "members": { "file:/": { "excluded": false, "state": { "name": "QUIESCING", "age": 90.0 } } } } } } 2024-08-31T04:31:18.846 ERROR:tasks.quiescer.fs.[cephfs]:exception: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_ceph-c_d19e6118f7015f0047264006cb0c873528eb3ae6/qa/tasks/quiescer.py", line 357, in _run self.do_quiesce(d) File "/home/teuthworker/src/git.ceph.com_ceph-c_d19e6118f7015f0047264006cb0c873528eb3ae6/qa/tasks/quiescer.py", line 313, in do_quiesce raise RuntimeError(f"Error quiescing set '{set_id}': {rcinfo(rc)}") RuntimeError: Error quiescing set '9d491f02': 1 (EPERM) 2024-08-31T04:31:19.689 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:31:19 smithi050 ceph-mon[17259]: pgmap v621: 97 pgs: 97 active+clean; 1.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.7 MiB/s wr, 303 op/s 2024-08-31T04:31:19.996 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:31:19 smithi177 ceph-mon[22025]: pgmap v621: 97 pgs: 97 active+clean; 1.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.7 MiB/s wr, 303 op/s 2024-08-31T04:31:20.043 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:31:19 smithi133 ceph-mon[22177]: pgmap v621: 97 pgs: 97 active+clean; 1.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.7 MiB/s wr, 303 op/s 2024-08-31T04:31:20.815 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:31:20 smithi050 ceph-mon[17259]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-31T04:31:20.996 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:31:20 smithi177 ceph-mon[22025]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-31T04:31:21.043 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:31:20 smithi133 ceph-mon[22177]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-31T04:31:21.683 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:31:21 smithi050 ceph-mon[17259]: pgmap v622: 97 pgs: 97 active+clean; 1.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.7 MiB/s wr, 302 op/s 2024-08-31T04:31:21.996 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:31:21 smithi177 ceph-mon[22025]: pgmap v622: 97 pgs: 97 active+clean; 1.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.7 MiB/s wr, 302 op/s 2024-08-31T04:31:22.043 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:31:21 smithi133 ceph-mon[22177]: pgmap v622: 97 pgs: 97 active+clean; 1.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.7 MiB/s wr, 302 op/s 2024-08-31T04:31:23.026 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:23.025+0000 7fcb16600640 1 -- 172.21.15.50:0/1685135897 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcb101044d0 msgr2=0x7fcb101048e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:31:23.027 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:23.025+0000 7fcb16600640 1 --2- 172.21.15.50:0/1685135897 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcb101044d0 0x7fcb101048e0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fcafc009900 tx=0x7fcafc02a3f0 comp rx=0 tx=0).stop 2024-08-31T04:31:23.027 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:23.025+0000 7fcb16600640 1 -- 172.21.15.50:0/1685135897 shutdown_connections 2024-08-31T04:31:23.027 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:23.025+0000 7fcb16600640 1 --2- 172.21.15.50:0/1685135897 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcb101044d0 0x7fcb101048e0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:23.027 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:23.025+0000 7fcb16600640 1 --2- 172.21.15.50:0/1685135897 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcb10104e70 0x7fcb1010b810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:23.027 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:23.025+0000 7fcb16600640 1 --2- 172.21.15.50:0/1685135897 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcb10103450 0x7fcb101038c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:23.027 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:23.025+0000 7fcb16600640 1 -- 172.21.15.50:0/1685135897 >> 172.21.15.50:0/1685135897 conn(0x7fcb100fed90 msgr2=0x7fcb10101240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:31:23.027 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:23.025+0000 7fcb16600640 1 -- 172.21.15.50:0/1685135897 shutdown_connections 2024-08-31T04:31:23.027 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:23.025+0000 7fcb16600640 1 -- 172.21.15.50:0/1685135897 wait complete. 2024-08-31T04:31:23.028 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:23.026+0000 7fcb16600640 1 Processor -- start 2024-08-31T04:31:23.028 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:23.026+0000 7fcb16600640 1 -- start start 2024-08-31T04:31:23.029 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:23.027+0000 7fcb16600640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcb10103450 0x7fcb10076bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:31:23.029 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:23.027+0000 7fcb16600640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcb101044d0 0x7fcb100754b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:31:23.029 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:23.027+0000 7fcb16600640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcb10104e70 0x7fcb100759f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:31:23.029 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:23.027+0000 7fcb16600640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fcb1010f0e0 con 0x7fcb10103450 2024-08-31T04:31:23.029 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:23.027+0000 7fcb16600640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7fcb1010ef60 con 0x7fcb10104e70 2024-08-31T04:31:23.029 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:23.027+0000 7fcb16600640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fcb1010f260 con 0x7fcb101044d0 2024-08-31T04:31:23.030 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:23.027+0000 7fcb0f400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcb10103450 0x7fcb10076bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:31:23.030 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:23.027+0000 7fcb0f400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcb10103450 0x7fcb10076bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49032/0 (socket says 172.21.15.50:49032) 2024-08-31T04:31:23.030 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:23.027+0000 7fcb0f400640 1 -- 172.21.15.50:0/2422974374 learned_addr learned my addr 172.21.15.50:0/2422974374 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:31:23.030 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:23.027+0000 7fcb0ea00640 1 --2- 172.21.15.50:0/2422974374 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcb101044d0 0x7fcb100754b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:31:23.030 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:23.027+0000 7fcb0fe00640 1 --2- 172.21.15.50:0/2422974374 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcb10104e70 0x7fcb100759f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:31:23.030 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:23.028+0000 7fcb0f400640 1 -- 172.21.15.50:0/2422974374 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcb101044d0 msgr2=0x7fcb100754b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:31:23.030 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:23.028+0000 7fcb0f400640 1 --2- 172.21.15.50:0/2422974374 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcb101044d0 0x7fcb100754b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:23.030 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:23.028+0000 7fcb0f400640 1 -- 172.21.15.50:0/2422974374 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcb10104e70 msgr2=0x7fcb100759f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:31:23.031 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:23.028+0000 7fcb0f400640 1 --2- 172.21.15.50:0/2422974374 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcb10104e70 0x7fcb100759f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:23.031 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:23.028+0000 7fcb0f400640 1 -- 172.21.15.50:0/2422974374 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb10076120 con 0x7fcb10103450 2024-08-31T04:31:23.031 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:23.028+0000 7fcb0fe00640 1 --2- 172.21.15.50:0/2422974374 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcb10104e70 0x7fcb100759f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:31:23.031 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:23.028+0000 7fcb0ea00640 1 --2- 172.21.15.50:0/2422974374 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcb101044d0 0x7fcb100754b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:31:23.031 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:23.028+0000 7fcb0f400640 1 --2- 172.21.15.50:0/2422974374 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcb10103450 0x7fcb10076bf0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fcb0000ea60 tx=0x7fcb0000ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:31:23.032 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:23.028+0000 7fcb07e00640 1 -- 172.21.15.50:0/2422974374 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb0000cde0 con 0x7fcb10103450 2024-08-31T04:31:23.032 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:23.029+0000 7fcb16600640 1 -- 172.21.15.50:0/2422974374 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcb101a3d20 con 0x7fcb10103450 2024-08-31T04:31:23.032 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:23.029+0000 7fcb07e00640 1 -- 172.21.15.50:0/2422974374 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcb000035f0 con 0x7fcb10103450 2024-08-31T04:31:23.032 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:23.029+0000 7fcb16600640 1 -- 172.21.15.50:0/2422974374 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcb101a41c0 con 0x7fcb10103450 2024-08-31T04:31:23.032 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:23.029+0000 7fcb07e00640 1 -- 172.21.15.50:0/2422974374 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb00005220 con 0x7fcb10103450 2024-08-31T04:31:23.033 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:23.032+0000 7fcb1d662740 1 Processor -- start 2024-08-31T04:31:23.033 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:23.032+0000 7fcb1d662740 1 -- start start 2024-08-31T04:31:23.034 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:23.032+0000 7fcb1d662740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55efac75f1b0 0x55efacb04b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:31:23.034 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:23.032+0000 7fcb1d662740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55efac7362f0 0x55efacb051a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:31:23.035 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:23.032+0000 7fcb1d662740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55efac73e4d0 0x55efacb05cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:31:23.035 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:23.032+0000 7fcb1d662740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55efaca77f70 con 0x55efac75f1b0 2024-08-31T04:31:23.035 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:23.032+0000 7fcb1d662740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x55efaca67500 con 0x55efac73e4d0 2024-08-31T04:31:23.035 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:23.032+0000 7fcb1d662740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x55efaca6b4b0 con 0x55efac7362f0 2024-08-31T04:31:23.035 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:23.033+0000 7fcb0fe00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55efac75f1b0 0x55efacb04b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:31:23.035 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:23.033+0000 7fcb0fe00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55efac75f1b0 0x55efacb04b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49038/0 (socket says 172.21.15.50:49038) 2024-08-31T04:31:23.035 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:23.033+0000 7fcb0fe00640 1 -- 172.21.15.50:0/539834917 learned_addr learned my addr 172.21.15.50:0/539834917 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:31:23.035 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:23.033+0000 7fcb0ea00640 1 --2- 172.21.15.50:0/539834917 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55efac73e4d0 0x55efacb05cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:31:23.035 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:23.033+0000 7fcb0fe00640 1 -- 172.21.15.50:0/539834917 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55efac7362f0 msgr2=0x55efacb051a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-31T04:31:23.035 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:23.033+0000 7fcb0fe00640 1 --2- 172.21.15.50:0/539834917 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55efac7362f0 0x55efacb051a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:23.035 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:23.033+0000 7fcb0fe00640 1 -- 172.21.15.50:0/539834917 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55efac73e4d0 msgr2=0x55efacb05cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:31:23.035 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:23.033+0000 7fcb0fe00640 1 --2- 172.21.15.50:0/539834917 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55efac73e4d0 0x55efacb05cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:23.036 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:23.033+0000 7fcb0fe00640 1 -- 172.21.15.50:0/539834917 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55efaca21c10 con 0x55efac75f1b0 2024-08-31T04:31:23.036 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:23.033+0000 7fcb0ea00640 1 --2- 172.21.15.50:0/539834917 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55efac73e4d0 0x55efacb05cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:31:23.037 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:23.033+0000 7fcb07e00640 1 -- 172.21.15.50:0/2422974374 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 18) ==== 152577+0+0 (secure 0 0 0) 0x7fcb000037a0 con 0x7fcb10103450 2024-08-31T04:31:23.037 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:23.034+0000 7fcb0fe00640 1 --2- 172.21.15.50:0/539834917 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55efac75f1b0 0x55efacb04b30 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fcb08009fd0 tx=0x7fcb080108e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57e7e21b91bccf37 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:31:23.037 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:23.034+0000 7fcb04c00640 1 -- 172.21.15.50:0/539834917 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb08011760 con 0x55efac75f1b0 2024-08-31T04:31:23.037 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:23.034+0000 7fcb04c00640 1 -- 172.21.15.50:0/539834917 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcb08011db0 con 0x55efac75f1b0 2024-08-31T04:31:23.038 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:23.034+0000 7fcb04c00640 1 -- 172.21.15.50:0/539834917 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb0800e3c0 con 0x55efac75f1b0 2024-08-31T04:31:23.038 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:23.035+0000 7fcb1d662740 1 -- 172.21.15.50:0/539834917 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55efac75f1b0 msgr2=0x55efacb04b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:31:23.038 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:23.035+0000 7fcb1d662740 1 --2- 172.21.15.50:0/539834917 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55efac75f1b0 0x55efacb04b30 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fcb08009fd0 tx=0x7fcb080108e0 comp rx=0 tx=0).stop 2024-08-31T04:31:23.038 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:23.035+0000 7fcb1d662740 1 -- 172.21.15.50:0/539834917 shutdown_connections 2024-08-31T04:31:23.038 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:23.035+0000 7fcb1d662740 1 --2- 172.21.15.50:0/539834917 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55efac7362f0 0x55efacb051a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:23.038 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:23.035+0000 7fcb1d662740 1 --2- 172.21.15.50:0/539834917 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55efac73e4d0 0x55efacb05cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:23.038 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:23.035+0000 7fcb1d662740 1 --2- 172.21.15.50:0/539834917 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55efac75f1b0 0x55efacb04b30 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:23.038 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:23.035+0000 7fcb1d662740 1 -- 172.21.15.50:0/539834917 >> 172.21.15.50:0/539834917 conn(0x55efac753300 msgr2=0x55efacb005c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:31:23.038 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:23.035+0000 7fcb1d662740 1 -- 172.21.15.50:0/539834917 shutdown_connections 2024-08-31T04:31:23.038 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:23.035+0000 7fcb1d662740 1 -- 172.21.15.50:0/539834917 wait complete. 2024-08-31T04:31:23.038 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:23.036+0000 7fcb07e00640 1 --2- 172.21.15.50:0/2422974374 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fcaf40b4a50 0x7fcaf40b6f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:31:23.038 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:23.036+0000 7fcb1d662740 1 -- start start 2024-08-31T04:31:23.039 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:23.036+0000 7fcb07e00640 1 -- 172.21.15.50:0/2422974374 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8219+0+0 (secure 0 0 0) 0x7fcb000e54f0 con 0x7fcb10103450 2024-08-31T04:31:23.039 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:23.036+0000 7fcb1d662740 1 Processor -- start 2024-08-31T04:31:23.039 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:23.036+0000 7fcb0fe00640 1 --2- 172.21.15.50:0/2422974374 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fcaf40b4a50 0x7fcaf40b6f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:31:23.041 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:23.037+0000 7fcb1d662740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55efac7362f0 0x55efacb0e260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:31:23.042 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:23.037+0000 7fcb1d662740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55efac73e4d0 0x55efacb0e920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:31:23.042 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:23.037+0000 7fcb1d662740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55efac75f1b0 0x55efacb0f490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:31:23.042 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:23.037+0000 7fcb1d662740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55efac9a0ab0 con 0x55efac75f1b0 2024-08-31T04:31:23.042 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:23.037+0000 7fcb1d662740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x55efaca0e320 con 0x55efac7362f0 2024-08-31T04:31:23.042 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:23.037+0000 7fcb1d662740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x55efacb06810 con 0x55efac73e4d0 2024-08-31T04:31:23.042 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:23.037+0000 7fcb1d662740 10 client.0 _ll_register_callbacks cb 0x55efaca47e80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:31:23.042 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:23.037+0000 7fcb0ea00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55efac73e4d0 0x55efacb0e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:31:23.042 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:23.037+0000 7fcb0ea00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55efac73e4d0 0x55efacb0e920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.50:33400/0 (socket says 172.21.15.50:33400) 2024-08-31T04:31:23.042 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:23.037+0000 7fcb0ea00640 1 -- 172.21.15.50:0/1366462524 learned_addr learned my addr 172.21.15.50:0/1366462524 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:31:23.042 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:23.037+0000 7fcb0fe00640 1 --2- 172.21.15.50:0/1366462524 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55efac75f1b0 0x55efacb0f490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:31:23.042 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:23.037+0000 7fcb0f400640 1 --2- 172.21.15.50:0/1366462524 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55efac7362f0 0x55efacb0e260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:31:23.042 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:23.037+0000 7fcb0fe00640 1 --2- 172.21.15.50:0/2422974374 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fcaf40b4a50 0x7fcaf40b6f60 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fcb08009e10 tx=0x7fcb08010f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:31:23.043 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:23.037+0000 7fcb0ea00640 1 -- 172.21.15.50:0/1366462524 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55efac7362f0 msgr2=0x55efacb0e260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:31:23.043 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:23.037+0000 7fcb0ea00640 1 --2- 172.21.15.50:0/1366462524 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55efac7362f0 0x55efacb0e260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:23.043 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:23.037+0000 7fcb0ea00640 1 -- 172.21.15.50:0/1366462524 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55efac75f1b0 msgr2=0x55efacb0f490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:31:23.043 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:23.038+0000 7fcb0ea00640 1 --2- 172.21.15.50:0/1366462524 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55efac75f1b0 0x55efacb0f490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:23.043 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:23.038+0000 7fcb0ea00640 1 -- 172.21.15.50:0/1366462524 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55efac7ca790 con 0x55efac73e4d0 2024-08-31T04:31:23.043 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:23.038+0000 7fcb0fe00640 1 --2- 172.21.15.50:0/1366462524 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55efac75f1b0 0x55efacb0f490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:31:23.043 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:23.038+0000 7fcb0ea00640 1 --2- 172.21.15.50:0/1366462524 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55efac73e4d0 0x55efacb0e920 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fcafc009230 tx=0x7fcafc0038a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4c05f01083912ad9 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:31:23.043 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:23.038+0000 7fcaf9600640 10 client.0 ms_handle_connect on v2:172.21.15.177:3300/0 2024-08-31T04:31:23.043 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:23.038+0000 7fcaf9600640 1 -- 172.21.15.50:0/1366462524 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcafc035070 con 0x55efac73e4d0 2024-08-31T04:31:23.043 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:23.038+0000 7fcaf9600640 1 -- 172.21.15.50:0/1366462524 <== mon.1 v2:172.21.15.177:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8219+0+0 (secure 0 0 0) 0x7fcafc0315a0 con 0x55efac73e4d0 2024-08-31T04:31:23.043 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:23.038+0000 7fcb1d662740 1 -- 172.21.15.50:0/1366462524 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcb08011db0 con 0x55efac73e4d0 2024-08-31T04:31:23.043 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:23.038+0000 7fcaf9600640 1 -- 172.21.15.50:0/1366462524 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) ==== 24+0+0 (secure 0 0 0) 0x7fcafc003ea0 con 0x55efac73e4d0 2024-08-31T04:31:23.044 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:23.039+0000 7fcb1d662740 10 client.26212 fetch_fsmap learned FSMap version 43 2024-08-31T04:31:23.044 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:23.039+0000 7fcb1d662740 1 -- 172.21.15.50:0/1366462524 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) -- 0x55efac843620 con 0x55efac73e4d0 2024-08-31T04:31:23.044 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:23.039+0000 7fcaf9600640 1 -- 172.21.15.50:0/1366462524 <== mon.1 v2:172.21.15.177:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcb08011db0 con 0x55efac73e4d0 2024-08-31T04:31:23.044 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:23.039+0000 7fcaf9600640 1 -- 172.21.15.50:0/1366462524 <== mon.1 v2:172.21.15.177:3300/0 5 ==== fsmap(e 43) ==== 8394+0+0 (secure 0 0 0) 0x7fcafc03c850 con 0x55efac73e4d0 2024-08-31T04:31:23.044 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:23.039+0000 7fcb1d662740 10 client.26212 fetch_fsmap finished waiting for FSMap version 43 2024-08-31T04:31:23.044 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:23.039+0000 7fcb1d662740 10 client.26212 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T04:31:23.044 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:23.039+0000 7fcb1d662740 20 client.26212 populate_metadata read hostname 'smithi050' 2024-08-31T04:31:23.044 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:23.039+0000 7fcb1d662740 1 --2- 172.21.15.50:0/1366462524 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x55efac71dd80 0x55efacb1ba20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:31:23.044 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:23.040+0000 7fcb1d662740 4 client.26212 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T04:31:23.044 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:23.040+0000 7fcb1d662740 1 -- 172.21.15.50:0/1366462524 --> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55efaca79ec0 con 0x55efac71dd80 2024-08-31T04:31:23.044 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:23.040+0000 7fcb0f400640 1 --2- 172.21.15.50:0/1366462524 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x55efac71dd80 0x55efacb1ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:31:23.045 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:23.041+0000 7fcb0f400640 1 --2- 172.21.15.50:0/1366462524 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x55efac71dd80 0x55efacb1ba20 crc :-1 s=READY pgs=120 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8e4a23bf91bbb15a server_cookie=69c1216e65f0ea2a in_seq=0 out_seq=0 2024-08-31T04:31:23.046 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:23.041+0000 7fcaf9600640 10 client.26212 ms_handle_connect on v2:172.21.15.133:6838/2526402262 2024-08-31T04:31:23.046 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:23.041+0000 7fcaf9600640 1 -- 172.21.15.50:0/1366462524 <== mds.0 v2:172.21.15.133:6838/2526402262 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55efaca79ec0 con 0x55efac71dd80 2024-08-31T04:31:23.046 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:23.041+0000 7fcaf9600640 10 client.26212 handle_command_reply: tid=0 2024-08-31T04:31:23.046 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:23.041+0000 7fcb1d662740 1 client.26212 shutdown 2024-08-31T04:31:23.046 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:23.042+0000 7fcb1d662740 1 -- 172.21.15.50:0/1366462524 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55efac73e4d0 msgr2=0x55efacb0e920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:31:23.046 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:23.042+0000 7fcb1d662740 1 --2- 172.21.15.50:0/1366462524 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55efac73e4d0 0x55efacb0e920 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fcafc009230 tx=0x7fcafc0038a0 comp rx=0 tx=0).stop 2024-08-31T04:31:23.046 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:23.042+0000 7fcb1d662740 1 -- 172.21.15.50:0/1366462524 shutdown_connections 2024-08-31T04:31:23.046 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:23.042+0000 7fcb1d662740 1 --2- 172.21.15.50:0/1366462524 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x55efac71dd80 0x55efacb1ba20 crc :-1 s=READY pgs=120 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:23.046 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:23.042+0000 7fcb1d662740 1 --2- 172.21.15.50:0/1366462524 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55efac73e4d0 0x55efacb0e920 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:23.046 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:23.042+0000 7fcb1d662740 1 --2- 172.21.15.50:0/1366462524 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55efac75f1b0 0x55efacb0f490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:23.046 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:23.042+0000 7fcb1d662740 1 --2- 172.21.15.50:0/1366462524 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55efac7362f0 0x55efacb0e260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:23.046 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:23.042+0000 7fcaf9600640 0 client.26212 ms_handle_reset on v2:172.21.15.133:6838/2526402262 2024-08-31T04:31:23.046 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:23.042+0000 7fcb1d662740 1 -- 172.21.15.50:0/1366462524 >> 172.21.15.50:0/1366462524 conn(0x55efac753300 msgr2=0x55efacafeb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:31:23.047 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:23.042+0000 7fcb1d662740 1 -- 172.21.15.50:0/1366462524 shutdown_connections 2024-08-31T04:31:23.047 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:23.042+0000 7fcb1d662740 1 -- 172.21.15.50:0/1366462524 wait complete. 2024-08-31T04:31:23.047 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:23.042+0000 7fcb1d662740 20 client.26212 trim_cache size 0 max 16384 2024-08-31T04:31:23.059 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:23.058+0000 7fcb1d662740 1 Processor -- start 2024-08-31T04:31:23.059 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:23.058+0000 7fcb1d662740 1 -- start start 2024-08-31T04:31:23.059 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:23.058+0000 7fcb1d662740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55efac7362f0 0x55efacb0db90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:31:23.059 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:23.058+0000 7fcb1d662740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55efac73e4d0 0x55efacb16370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:31:23.059 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:23.058+0000 7fcb1d662740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55efac75f1b0 0x55efacb00a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:31:23.059 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:23.058+0000 7fcb1d662740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fcb101acef0 con 0x55efac7362f0 2024-08-31T04:31:23.060 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:23.058+0000 7fcb1d662740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7fcb101aeaf0 con 0x55efac73e4d0 2024-08-31T04:31:23.060 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:23.058+0000 7fcb1d662740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fcb101ad5c0 con 0x55efac75f1b0 2024-08-31T04:31:23.061 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:23.058+0000 7fcb0f400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55efac7362f0 0x55efacb0db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:31:23.061 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:23.058+0000 7fcb0f400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55efac7362f0 0x55efacb0db90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49052/0 (socket says 172.21.15.50:49052) 2024-08-31T04:31:23.061 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:23.058+0000 7fcb0f400640 1 -- 172.21.15.50:0/4206604795 learned_addr learned my addr 172.21.15.50:0/4206604795 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:31:23.061 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:23.058+0000 7fcb0ea00640 1 --2- 172.21.15.50:0/4206604795 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55efac73e4d0 0x55efacb16370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:31:23.061 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:23.058+0000 7fcb0fe00640 1 --2- 172.21.15.50:0/4206604795 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55efac75f1b0 0x55efacb00a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:31:23.061 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:23.059+0000 7fcb0f400640 1 -- 172.21.15.50:0/4206604795 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55efac75f1b0 msgr2=0x55efacb00a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:31:23.061 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:23.059+0000 7fcb0f400640 1 --2- 172.21.15.50:0/4206604795 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55efac75f1b0 0x55efacb00a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:23.061 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:23.059+0000 7fcb0f400640 1 -- 172.21.15.50:0/4206604795 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55efac73e4d0 msgr2=0x55efacb16370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:31:23.062 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:23.059+0000 7fcb0f400640 1 --2- 172.21.15.50:0/4206604795 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55efac73e4d0 0x55efacb16370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:23.062 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:23.059+0000 7fcb0f400640 1 -- 172.21.15.50:0/4206604795 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55efacb0f800 con 0x55efac7362f0 2024-08-31T04:31:23.062 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:23.059+0000 7fcb0f400640 1 --2- 172.21.15.50:0/4206604795 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55efac7362f0 0x55efacb0db90 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fcb000a7f50 tx=0x7fcb000a7d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d619d4d29b62a873 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:31:23.062 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:23.059+0000 7fcafbe00640 1 -- 172.21.15.50:0/4206604795 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb000d2070 con 0x55efac7362f0 2024-08-31T04:31:23.062 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:23.059+0000 7fcafbe00640 1 -- 172.21.15.50:0/4206604795 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcb000abed0 con 0x55efac7362f0 2024-08-31T04:31:23.062 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:23.059+0000 7fcafbe00640 1 -- 172.21.15.50:0/4206604795 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb000b02f0 con 0x55efac7362f0 2024-08-31T04:31:23.064 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:23.060+0000 7fcb1d662740 1 -- 172.21.15.50:0/4206604795 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55efac7362f0 msgr2=0x55efacb0db90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:31:23.064 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:23.060+0000 7fcb1d662740 1 --2- 172.21.15.50:0/4206604795 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55efac7362f0 0x55efacb0db90 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fcb000a7f50 tx=0x7fcb000a7d90 comp rx=0 tx=0).stop 2024-08-31T04:31:23.065 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:23.060+0000 7fcb1d662740 1 -- 172.21.15.50:0/4206604795 shutdown_connections 2024-08-31T04:31:23.065 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:23.060+0000 7fcb1d662740 1 --2- 172.21.15.50:0/4206604795 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55efac75f1b0 0x55efacb00a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:23.065 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:23.060+0000 7fcb1d662740 1 --2- 172.21.15.50:0/4206604795 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55efac73e4d0 0x55efacb16370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:23.065 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:23.060+0000 7fcb1d662740 1 --2- 172.21.15.50:0/4206604795 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55efac7362f0 0x55efacb0db90 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:23.065 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:23.060+0000 7fcb1d662740 1 -- 172.21.15.50:0/4206604795 >> 172.21.15.50:0/4206604795 conn(0x55efac753300 msgr2=0x55efacb0d480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:31:23.065 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:23.060+0000 7fcb1d662740 1 -- 172.21.15.50:0/4206604795 shutdown_connections 2024-08-31T04:31:23.065 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:23.060+0000 7fcb1d662740 1 -- 172.21.15.50:0/4206604795 wait complete. 2024-08-31T04:31:23.065 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:23.061+0000 7fcb1d662740 1 -- start start 2024-08-31T04:31:23.065 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:23.061+0000 7fcb1d662740 1 Processor -- start 2024-08-31T04:31:23.065 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:23.061+0000 7fcb1d662740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55efac7362f0 0x55efacb15040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:31:23.065 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:23.061+0000 7fcb1d662740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55efac73e4d0 0x55efacb15580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:31:23.065 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:23.061+0000 7fcb1d662740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55efac75f1b0 0x55efacb15ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:31:23.066 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:23.061+0000 7fcb1d662740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fcb101ae420 con 0x55efac75f1b0 2024-08-31T04:31:23.066 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:23.061+0000 7fcb1d662740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7fcb101add20 con 0x55efac73e4d0 2024-08-31T04:31:23.066 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:23.061+0000 7fcb1d662740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fcb101aaed0 con 0x55efac7362f0 2024-08-31T04:31:23.066 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:23.061+0000 7fcb1d662740 10 client.0 _ll_register_callbacks cb 0x7fcb080093a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:31:23.066 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:23.062+0000 7fcb0fe00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55efac75f1b0 0x55efacb15ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:31:23.066 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:23.062+0000 7fcb0ea00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55efac73e4d0 0x55efacb15580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:31:23.066 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:23.062+0000 7fcb0f400640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55efac7362f0 0x55efacb15040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:31:23.066 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:23.062+0000 7fcb0f400640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55efac7362f0 0x55efacb15040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.50:33424/0 (socket says 172.21.15.50:33424) 2024-08-31T04:31:23.066 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:23.062+0000 7fcb0f400640 1 -- 172.21.15.50:0/394942532 learned_addr learned my addr 172.21.15.50:0/394942532 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:31:23.066 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:23.062+0000 7fcb0ea00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55efac73e4d0 0x55efacb15580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.50:57814/0 (socket says 172.21.15.50:57814) 2024-08-31T04:31:23.066 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:23.062+0000 7fcb0fe00640 1 -- 172.21.15.50:0/394942532 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55efac7362f0 msgr2=0x55efacb15040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:31:23.066 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:23.062+0000 7fcb0fe00640 1 --2- 172.21.15.50:0/394942532 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55efac7362f0 0x55efacb15040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:23.066 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:23.062+0000 7fcb0fe00640 1 -- 172.21.15.50:0/394942532 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55efac73e4d0 msgr2=0x55efacb15580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:31:23.067 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:23.062+0000 7fcb0fe00640 1 --2- 172.21.15.50:0/394942532 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55efac73e4d0 0x55efacb15580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:23.067 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:23.062+0000 7fcb0fe00640 1 -- 172.21.15.50:0/394942532 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55efacb13c30 con 0x55efac75f1b0 2024-08-31T04:31:23.067 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:23.062+0000 7fcb0ea00640 1 --2- 172.21.15.50:0/394942532 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55efac73e4d0 0x55efacb15580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:31:23.067 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:23.062+0000 7fcb0f400640 1 --2- 172.21.15.50:0/394942532 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55efac7362f0 0x55efacb15040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:31:23.067 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:23.063+0000 7fcb0fe00640 1 --2- 172.21.15.50:0/394942532 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55efac75f1b0 0x55efacb15ac0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fcb08005bf0 tx=0x7fcb080108e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1aeae6d07c03c708 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:31:23.067 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:23.063+0000 7fcaf9600640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-08-31T04:31:23.067 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:23.063+0000 7fcaf9600640 1 -- 172.21.15.50:0/394942532 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb08038060 con 0x55efac75f1b0 2024-08-31T04:31:23.067 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:23.063+0000 7fcaf9600640 1 -- 172.21.15.50:0/394942532 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8219+0+0 (secure 0 0 0) 0x7fcb08011cc0 con 0x55efac75f1b0 2024-08-31T04:31:23.067 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:23.063+0000 7fcb1d662740 1 -- 172.21.15.50:0/394942532 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcb000abed0 con 0x55efac75f1b0 2024-08-31T04:31:23.067 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:23.063+0000 7fcaf9600640 1 -- 172.21.15.50:0/394942532 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) ==== 24+0+0 (secure 0 0 0) 0x7fcb0801be60 con 0x55efac75f1b0 2024-08-31T04:31:23.067 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:23.063+0000 7fcb1d662740 10 client.16239 fetch_fsmap learned FSMap version 43 2024-08-31T04:31:23.067 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:23.063+0000 7fcb1d662740 1 -- 172.21.15.50:0/394942532 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) -- 0x55efacb866d0 con 0x55efac75f1b0 2024-08-31T04:31:23.068 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:23.064+0000 7fcaf9600640 1 -- 172.21.15.50:0/394942532 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcb000abed0 con 0x55efac75f1b0 2024-08-31T04:31:23.069 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:23.064+0000 7fcaf9600640 1 -- 172.21.15.50:0/394942532 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 43) ==== 8394+0+0 (secure 0 0 0) 0x7fcb0801c0f0 con 0x55efac75f1b0 2024-08-31T04:31:23.069 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:23.064+0000 7fcb1d662740 10 client.16239 fetch_fsmap finished waiting for FSMap version 43 2024-08-31T04:31:23.069 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:23.064+0000 7fcb1d662740 10 client.16239 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T04:31:23.069 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:23.064+0000 7fcb1d662740 20 client.16239 populate_metadata read hostname 'smithi050' 2024-08-31T04:31:23.069 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:23.064+0000 7fcb1d662740 1 --2- 172.21.15.50:0/394942532 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x55efac6f31c0 0x55efacb88e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:31:23.069 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:23.064+0000 7fcb1d662740 4 client.16239 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-31T04:31:23.069 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:23.064+0000 7fcb1d662740 1 -- 172.21.15.50:0/394942532 --> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55efaca75960 con 0x55efac6f31c0 2024-08-31T04:31:23.069 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:23.064+0000 7fcb0f400640 1 --2- 172.21.15.50:0/394942532 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x55efac6f31c0 0x55efacb88e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:31:23.069 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:23.065+0000 7fcb0f400640 1 --2- 172.21.15.50:0/394942532 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x55efac6f31c0 0x55efacb88e70 crc :-1 s=READY pgs=121 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=815be90fecd69d36 server_cookie=bedcdec531da468f in_seq=0 out_seq=0 2024-08-31T04:31:23.069 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:23.065+0000 7fcaf9600640 10 client.16239 ms_handle_connect on v2:172.21.15.133:6838/2526402262 2024-08-31T04:31:23.082 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:23.080+0000 7fcaf9600640 1 -- 172.21.15.50:0/394942532 <== mds.0 v2:172.21.15.133:6838/2526402262 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55efaca75960 con 0x55efac6f31c0 2024-08-31T04:31:23.082 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:23.080+0000 7fcaf9600640 10 client.16239 handle_command_reply: tid=0 2024-08-31T04:31:23.083 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:23.080+0000 7fcb1d662740 1 client.16239 shutdown 2024-08-31T04:31:23.083 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:23.081+0000 7fcb1d662740 1 -- 172.21.15.50:0/394942532 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55efac75f1b0 msgr2=0x55efacb15ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:31:23.083 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:23.081+0000 7fcb1d662740 1 --2- 172.21.15.50:0/394942532 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55efac75f1b0 0x55efacb15ac0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fcb08005bf0 tx=0x7fcb080108e0 comp rx=0 tx=0).stop 2024-08-31T04:31:23.083 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:23.081+0000 7fcb1d662740 1 -- 172.21.15.50:0/394942532 shutdown_connections 2024-08-31T04:31:23.083 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:23.081+0000 7fcb1d662740 1 --2- 172.21.15.50:0/394942532 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x55efac6f31c0 0x55efacb88e70 crc :-1 s=READY pgs=121 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:23.083 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:23.081+0000 7fcb1d662740 1 --2- 172.21.15.50:0/394942532 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55efac75f1b0 0x55efacb15ac0 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:23.083 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:23.081+0000 7fcb1d662740 1 --2- 172.21.15.50:0/394942532 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55efac73e4d0 0x55efacb15580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:23.083 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:23.081+0000 7fcb1d662740 1 --2- 172.21.15.50:0/394942532 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55efac7362f0 0x55efacb15040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:23.083 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:23.081+0000 7fcaf9600640 0 client.16239 ms_handle_reset on v2:172.21.15.133:6838/2526402262 2024-08-31T04:31:23.083 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:23.081+0000 7fcb1d662740 1 -- 172.21.15.50:0/394942532 >> 172.21.15.50:0/394942532 conn(0x55efac753300 msgr2=0x55efacb08c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:31:23.083 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:23.081+0000 7fcb1d662740 1 -- 172.21.15.50:0/394942532 shutdown_connections 2024-08-31T04:31:23.083 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:23.081+0000 7fcb1d662740 1 -- 172.21.15.50:0/394942532 wait complete. 2024-08-31T04:31:23.083 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:23.081+0000 7fcb1d662740 20 client.16239 trim_cache size 0 max 16384 2024-08-31T04:31:23.084 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout:{ 2024-08-31T04:31:23.084 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout: "message": "", 2024-08-31T04:31:23.084 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout: "return_code": 0 2024-08-31T04:31:23.084 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout:} 2024-08-31T04:31:23.085 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:23.082+0000 7fcb16600640 1 -- 172.21.15.50:0/2422974374 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fcaf40b4a50 msgr2=0x7fcaf40b6f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:31:23.085 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:23.082+0000 7fcb16600640 1 --2- 172.21.15.50:0/2422974374 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fcaf40b4a50 0x7fcaf40b6f60 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fcb08009e10 tx=0x7fcb08010f90 comp rx=0 tx=0).stop 2024-08-31T04:31:23.085 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:23.082+0000 7fcb16600640 1 -- 172.21.15.50:0/2422974374 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcb10103450 msgr2=0x7fcb10076bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:31:23.085 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:23.082+0000 7fcb16600640 1 --2- 172.21.15.50:0/2422974374 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcb10103450 0x7fcb10076bf0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fcb0000ea60 tx=0x7fcb0000ef20 comp rx=0 tx=0).stop 2024-08-31T04:31:23.085 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:23.082+0000 7fcb16600640 1 -- 172.21.15.50:0/2422974374 shutdown_connections 2024-08-31T04:31:23.085 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:23.082+0000 7fcb16600640 1 --2- 172.21.15.50:0/2422974374 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fcaf40b4a50 0x7fcaf40b6f60 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:23.085 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:23.082+0000 7fcb16600640 1 --2- 172.21.15.50:0/2422974374 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcb101044d0 0x7fcb100754b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:23.085 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:23.082+0000 7fcb16600640 1 --2- 172.21.15.50:0/2422974374 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcb10104e70 0x7fcb100759f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:23.085 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:23.082+0000 7fcb16600640 1 --2- 172.21.15.50:0/2422974374 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcb10103450 0x7fcb10076bf0 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:23.085 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:23.082+0000 7fcb16600640 1 -- 172.21.15.50:0/2422974374 >> 172.21.15.50:0/2422974374 conn(0x7fcb100fed90 msgr2=0x7fcb101077d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:31:23.085 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:23.082+0000 7fcb16600640 1 -- 172.21.15.50:0/2422974374 shutdown_connections 2024-08-31T04:31:23.085 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:23.082+0000 7fcb16600640 1 -- 172.21.15.50:0/2422974374 wait complete. 2024-08-31T04:31:23.950 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:31:23 smithi050 ceph-mon[17259]: pgmap v623: 97 pgs: 97 active+clean; 1.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.8 MiB/s wr, 308 op/s 2024-08-31T04:31:23.996 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:31:23 smithi177 ceph-mon[22025]: pgmap v623: 97 pgs: 97 active+clean; 1.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.8 MiB/s wr, 308 op/s 2024-08-31T04:31:24.043 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:31:23 smithi133 ceph-mon[22177]: pgmap v623: 97 pgs: 97 active+clean; 1.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.8 MiB/s wr, 308 op/s 2024-08-31T04:31:25.719 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:31:25 smithi050 ceph-mon[17259]: pgmap v624: 97 pgs: 97 active+clean; 1.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 909 KiB/s rd, 979 KiB/s wr, 142 op/s 2024-08-31T04:31:25.996 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:31:25 smithi177 ceph-mon[22025]: pgmap v624: 97 pgs: 97 active+clean; 1.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 909 KiB/s rd, 979 KiB/s wr, 142 op/s 2024-08-31T04:31:26.043 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:31:25 smithi133 ceph-mon[22177]: pgmap v624: 97 pgs: 97 active+clean; 1.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 909 KiB/s rd, 979 KiB/s wr, 142 op/s 2024-08-31T04:31:27.694 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:31:27 smithi050 ceph-mon[17259]: pgmap v625: 97 pgs: 97 active+clean; 1.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 909 KiB/s rd, 980 KiB/s wr, 144 op/s 2024-08-31T04:31:27.996 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:31:27 smithi177 ceph-mon[22025]: pgmap v625: 97 pgs: 97 active+clean; 1.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 909 KiB/s rd, 980 KiB/s wr, 144 op/s 2024-08-31T04:31:28.043 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:31:27 smithi133 ceph-mon[22177]: pgmap v625: 97 pgs: 97 active+clean; 1.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 909 KiB/s rd, 980 KiB/s wr, 144 op/s 2024-08-31T04:31:29.668 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:31:29 smithi050 ceph-mon[17259]: pgmap v626: 97 pgs: 97 active+clean; 1.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 49 KiB/s wr, 21 op/s 2024-08-31T04:31:29.996 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:31:29 smithi177 ceph-mon[22025]: pgmap v626: 97 pgs: 97 active+clean; 1.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 49 KiB/s wr, 21 op/s 2024-08-31T04:31:30.043 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:31:29 smithi133 ceph-mon[22177]: pgmap v626: 97 pgs: 97 active+clean; 1.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 49 KiB/s wr, 21 op/s 2024-08-31T04:31:31.901 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:31:31 smithi050 ceph-mon[17259]: pgmap v627: 97 pgs: 97 active+clean; 1.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 56 KiB/s wr, 16 op/s 2024-08-31T04:31:31.996 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:31:31 smithi177 ceph-mon[22025]: pgmap v627: 97 pgs: 97 active+clean; 1.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 56 KiB/s wr, 16 op/s 2024-08-31T04:31:32.043 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:31:31 smithi133 ceph-mon[22177]: pgmap v627: 97 pgs: 97 active+clean; 1.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 56 KiB/s wr, 16 op/s 2024-08-31T04:31:33.896 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:31:33 smithi050 ceph-mon[17259]: pgmap v628: 97 pgs: 97 active+clean; 1.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 70 KiB/s wr, 20 op/s 2024-08-31T04:31:33.996 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:31:33 smithi177 ceph-mon[22025]: pgmap v628: 97 pgs: 97 active+clean; 1.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 70 KiB/s wr, 20 op/s 2024-08-31T04:31:34.043 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:31:33 smithi133 ceph-mon[22177]: pgmap v628: 97 pgs: 97 active+clean; 1.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 70 KiB/s wr, 20 op/s 2024-08-31T04:31:35.869 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:31:35 smithi050 ceph-mon[17259]: pgmap v629: 97 pgs: 97 active+clean; 1.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 39 KiB/s wr, 14 op/s 2024-08-31T04:31:35.996 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:31:35 smithi177 ceph-mon[22025]: pgmap v629: 97 pgs: 97 active+clean; 1.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 39 KiB/s wr, 14 op/s 2024-08-31T04:31:36.042 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:31:35 smithi133 ceph-mon[22177]: pgmap v629: 97 pgs: 97 active+clean; 1.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 39 KiB/s wr, 14 op/s 2024-08-31T04:31:36.274 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:36.272+0000 7f13eac00640 1 -- 172.21.15.50:0/1736240900 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f13e4103470 msgr2=0x7f13e41038e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:31:36.274 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:36.272+0000 7f13eac00640 1 --2- 172.21.15.50:0/1736240900 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f13e4103470 0x7f13e41038e0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f13d4009900 tx=0x7f13d402a410 comp rx=0 tx=0).stop 2024-08-31T04:31:36.274 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:36.272+0000 7f13eac00640 1 -- 172.21.15.50:0/1736240900 shutdown_connections 2024-08-31T04:31:36.274 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:36.272+0000 7f13eac00640 1 --2- 172.21.15.50:0/1736240900 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f13e41044f0 0x7f13e4104900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:36.274 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:36.272+0000 7f13eac00640 1 --2- 172.21.15.50:0/1736240900 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f13e4104e90 0x7f13e410b830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:36.274 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:36.272+0000 7f13eac00640 1 --2- 172.21.15.50:0/1736240900 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f13e4103470 0x7f13e41038e0 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:36.274 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:36.272+0000 7f13eac00640 1 -- 172.21.15.50:0/1736240900 >> 172.21.15.50:0/1736240900 conn(0x7f13e40fedd0 msgr2=0x7f13e4101260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:31:36.274 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:36.273+0000 7f13eac00640 1 -- 172.21.15.50:0/1736240900 shutdown_connections 2024-08-31T04:31:36.274 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:36.273+0000 7f13eac00640 1 -- 172.21.15.50:0/1736240900 wait complete. 2024-08-31T04:31:36.275 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:36.274+0000 7f13eac00640 1 Processor -- start 2024-08-31T04:31:36.275 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:36.274+0000 7f13eac00640 1 -- start start 2024-08-31T04:31:36.275 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:36.274+0000 7f13eac00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f13e4103470 0x7f13e419c020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:31:36.276 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:36.274+0000 7f13eac00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f13e41044f0 0x7f13e419c690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:31:36.276 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:36.274+0000 7f13eac00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f13e4104e90 0x7f13e419d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:31:36.276 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:36.274+0000 7f13eac00640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f13e410f180 con 0x7f13e4104e90 2024-08-31T04:31:36.276 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:36.274+0000 7f13eac00640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f13e410f000 con 0x7f13e41044f0 2024-08-31T04:31:36.276 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:36.274+0000 7f13eac00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f13e410f300 con 0x7f13e4103470 2024-08-31T04:31:36.277 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:36.274+0000 7f13e8c00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f13e4104e90 0x7f13e419d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:31:36.277 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:36.274+0000 7f13e3e00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f13e4103470 0x7f13e419c020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:31:36.277 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:36.274+0000 7f13e3e00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f13e4103470 0x7f13e419c020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.50:58870/0 (socket says 172.21.15.50:58870) 2024-08-31T04:31:36.277 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:36.274+0000 7f13e3e00640 1 -- 172.21.15.50:0/207535497 learned_addr learned my addr 172.21.15.50:0/207535497 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:31:36.278 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:36.275+0000 7f13e3400640 1 --2- 172.21.15.50:0/207535497 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f13e41044f0 0x7f13e419c690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:31:36.278 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:36.275+0000 7f13e3e00640 1 -- 172.21.15.50:0/207535497 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f13e41044f0 msgr2=0x7f13e419c690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:31:36.278 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:36.275+0000 7f13e3e00640 1 --2- 172.21.15.50:0/207535497 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f13e41044f0 0x7f13e419c690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:36.278 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:36.275+0000 7f13e3e00640 1 -- 172.21.15.50:0/207535497 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f13e4104e90 msgr2=0x7f13e419d1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:31:36.278 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:36.275+0000 7f13e3e00640 1 --2- 172.21.15.50:0/207535497 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f13e4104e90 0x7f13e419d1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:36.278 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:36.275+0000 7f13e3e00640 1 -- 172.21.15.50:0/207535497 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13e419d9f0 con 0x7f13e4103470 2024-08-31T04:31:36.278 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:36.275+0000 7f13e8c00640 1 --2- 172.21.15.50:0/207535497 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f13e4104e90 0x7f13e419d1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:31:36.278 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:36.275+0000 7f13e3e00640 1 --2- 172.21.15.50:0/207535497 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f13e4103470 0x7f13e419c020 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f13d4031500 tx=0x7f13d4003c80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:31:36.278 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:36.276+0000 7f13e0c00640 1 -- 172.21.15.50:0/207535497 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13d403f070 con 0x7f13e4103470 2024-08-31T04:31:36.278 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:36.276+0000 7f13eac00640 1 -- 172.21.15.50:0/207535497 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f13e419dc80 con 0x7f13e4103470 2024-08-31T04:31:36.278 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:36.276+0000 7f13e0c00640 1 -- 172.21.15.50:0/207535497 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f13d4003e70 con 0x7f13e4103470 2024-08-31T04:31:36.278 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:36.276+0000 7f13e0c00640 1 -- 172.21.15.50:0/207535497 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13d4035030 con 0x7f13e4103470 2024-08-31T04:31:36.278 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:36.276+0000 7f13eac00640 1 -- 172.21.15.50:0/207535497 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f13e41a43d0 con 0x7f13e4103470 2024-08-31T04:31:36.280 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:36.279+0000 7f13f1c20740 1 Processor -- start 2024-08-31T04:31:36.280 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:36.279+0000 7f13f1c20740 1 -- start start 2024-08-31T04:31:36.281 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:36.279+0000 7f13f1c20740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b6645be1b0 0x55b664963dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:31:36.281 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:36.279+0000 7f13f1c20740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b6645952f0 0x55b664964430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:31:36.281 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:36.279+0000 7f13f1c20740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b66459d4d0 0x55b664964f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:31:36.282 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:36.279+0000 7f13f1c20740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55b6648d6f70 con 0x55b6645952f0 2024-08-31T04:31:36.282 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:36.279+0000 7f13f1c20740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x55b6648c6500 con 0x55b6645be1b0 2024-08-31T04:31:36.282 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:36.279+0000 7f13f1c20740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x55b6648ca4b0 con 0x55b66459d4d0 2024-08-31T04:31:36.282 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:36.280+0000 7f13e8c00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b6645be1b0 0x55b664963dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:31:36.282 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:36.280+0000 7f13e3400640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b66459d4d0 0x55b664964f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:31:36.282 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:36.280+0000 7f13e8c00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b6645be1b0 0x55b664963dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.50:39354/0 (socket says 172.21.15.50:39354) 2024-08-31T04:31:36.282 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:36.280+0000 7f13e8c00640 1 -- 172.21.15.50:0/4118559121 learned_addr learned my addr 172.21.15.50:0/4118559121 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:31:36.282 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:36.280+0000 7f13e8c00640 1 -- 172.21.15.50:0/4118559121 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b66459d4d0 msgr2=0x55b664964f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:31:36.282 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:36.280+0000 7f13e8c00640 1 --2- 172.21.15.50:0/4118559121 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b66459d4d0 0x55b664964f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:36.282 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:36.280+0000 7f13e8c00640 1 -- 172.21.15.50:0/4118559121 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b6645952f0 msgr2=0x55b664964430 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-31T04:31:36.282 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:36.280+0000 7f13e8c00640 1 --2- 172.21.15.50:0/4118559121 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b6645952f0 0x55b664964430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:36.282 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:36.280+0000 7f13e8c00640 1 -- 172.21.15.50:0/4118559121 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b664880c10 con 0x55b6645be1b0 2024-08-31T04:31:36.282 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:36.280+0000 7f13e0c00640 1 -- 172.21.15.50:0/207535497 <== mon.1 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 18) ==== 152577+0+0 (secure 0 0 0) 0x7f13d4042070 con 0x7f13e4103470 2024-08-31T04:31:36.284 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:36.280+0000 7f13e8c00640 1 --2- 172.21.15.50:0/4118559121 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b6645be1b0 0x55b664963dc0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f13dc00a870 tx=0x7f13dc009650 comp rx=0 tx=0).ready entity=mon.2 client_cookie=97accf82c6266bfe server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:31:36.284 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:36.281+0000 7f13d9200640 1 -- 172.21.15.50:0/4118559121 <== mon.2 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13dc018020 con 0x55b6645be1b0 2024-08-31T04:31:36.284 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:36.281+0000 7f13d9200640 1 -- 172.21.15.50:0/4118559121 <== mon.2 v2:172.21.15.133:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f13dc014400 con 0x55b6645be1b0 2024-08-31T04:31:36.284 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:36.281+0000 7f13d9200640 1 -- 172.21.15.50:0/4118559121 <== mon.2 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13dc0135c0 con 0x55b6645be1b0 2024-08-31T04:31:36.284 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:36.281+0000 7f13f1c20740 1 -- 172.21.15.50:0/4118559121 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b6645be1b0 msgr2=0x55b664963dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:31:36.284 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:36.281+0000 7f13f1c20740 1 --2- 172.21.15.50:0/4118559121 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b6645be1b0 0x55b664963dc0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f13dc00a870 tx=0x7f13dc009650 comp rx=0 tx=0).stop 2024-08-31T04:31:36.284 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:36.282+0000 7f13e0c00640 1 --2- 172.21.15.50:0/207535497 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f13c80b4b30 0x7f13c80b7040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:31:36.284 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:36.282+0000 7f13f1c20740 1 -- 172.21.15.50:0/4118559121 shutdown_connections 2024-08-31T04:31:36.284 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:36.282+0000 7f13f1c20740 1 --2- 172.21.15.50:0/4118559121 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b66459d4d0 0x55b664964f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:36.284 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:36.282+0000 7f13e0c00640 1 -- 172.21.15.50:0/207535497 <== mon.1 v2:172.21.15.177:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8219+0+0 (secure 0 0 0) 0x7f13d4105c70 con 0x7f13e4103470 2024-08-31T04:31:36.284 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:36.282+0000 7f13f1c20740 1 --2- 172.21.15.50:0/4118559121 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b6645952f0 0x55b664964430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:36.284 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:36.282+0000 7f13f1c20740 1 --2- 172.21.15.50:0/4118559121 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b6645be1b0 0x55b664963dc0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:36.285 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:36.282+0000 7f13f1c20740 1 -- 172.21.15.50:0/4118559121 >> 172.21.15.50:0/4118559121 conn(0x55b6645b2300 msgr2=0x55b66495f850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:31:36.285 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:36.282+0000 7f13e8c00640 1 --2- 172.21.15.50:0/207535497 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f13c80b4b30 0x7f13c80b7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:31:36.285 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:36.282+0000 7f13f1c20740 1 -- 172.21.15.50:0/4118559121 shutdown_connections 2024-08-31T04:31:36.287 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:36.282+0000 7f13f1c20740 1 -- 172.21.15.50:0/4118559121 wait complete. 2024-08-31T04:31:36.287 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:36.283+0000 7f13f1c20740 1 -- start start 2024-08-31T04:31:36.288 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:36.283+0000 7f13e8c00640 1 --2- 172.21.15.50:0/207535497 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f13c80b4b30 0x7f13c80b7040 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f13dc00a600 tx=0x7f13dc000f40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:31:36.288 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:36.283+0000 7f13f1c20740 1 Processor -- start 2024-08-31T04:31:36.288 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:36.283+0000 7f13f1c20740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b6645952f0 0x55b66496d4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:31:36.288 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:36.283+0000 7f13f1c20740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b66459d4d0 0x55b66496db80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:31:36.288 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:36.283+0000 7f13f1c20740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b6645be1b0 0x55b66496e6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:31:36.288 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:36.283+0000 7f13f1c20740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55b6647ffab0 con 0x55b6645952f0 2024-08-31T04:31:36.288 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:36.283+0000 7f13f1c20740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x55b66486d320 con 0x55b6645be1b0 2024-08-31T04:31:36.288 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:36.283+0000 7f13f1c20740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x55b664965aa0 con 0x55b66459d4d0 2024-08-31T04:31:36.288 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:36.283+0000 7f13f1c20740 10 client.0 _ll_register_callbacks cb 0x55b6648736a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:31:36.288 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:36.284+0000 7f13e3e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b6645952f0 0x55b66496d4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:31:36.288 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:36.284+0000 7f13e3e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b6645952f0 0x55b66496d4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48794/0 (socket says 172.21.15.50:48794) 2024-08-31T04:31:36.289 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:36.284+0000 7f13e3e00640 1 -- 172.21.15.50:0/2195487255 learned_addr learned my addr 172.21.15.50:0/2195487255 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:31:36.289 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:36.284+0000 7f13e3400640 1 --2- 172.21.15.50:0/2195487255 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b66459d4d0 0x55b66496db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:31:36.289 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:36.284+0000 7f13e8c00640 1 --2- 172.21.15.50:0/2195487255 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b6645be1b0 0x55b66496e6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:31:36.289 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:36.284+0000 7f13e3e00640 1 -- 172.21.15.50:0/2195487255 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b66459d4d0 msgr2=0x55b66496db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:31:36.289 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:36.284+0000 7f13e3e00640 1 --2- 172.21.15.50:0/2195487255 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b66459d4d0 0x55b66496db80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:36.289 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:36.284+0000 7f13e3e00640 1 -- 172.21.15.50:0/2195487255 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b6645be1b0 msgr2=0x55b66496e6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:31:36.289 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:36.284+0000 7f13e3e00640 1 --2- 172.21.15.50:0/2195487255 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b6645be1b0 0x55b66496e6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:36.289 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:36.284+0000 7f13e3e00640 1 -- 172.21.15.50:0/2195487255 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b664629790 con 0x55b6645952f0 2024-08-31T04:31:36.289 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:36.284+0000 7f13e3e00640 1 --2- 172.21.15.50:0/2195487255 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b6645952f0 0x55b66496d4c0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f13d4031fd0 tx=0x7f13d40cbf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d8438893127142d server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:31:36.289 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:36.284+0000 7f13cd600640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-08-31T04:31:36.289 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:36.285+0000 7f13cd600640 1 -- 172.21.15.50:0/2195487255 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13d4049040 con 0x55b6645952f0 2024-08-31T04:31:36.289 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:36.285+0000 7f13cd600640 1 -- 172.21.15.50:0/2195487255 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8219+0+0 (secure 0 0 0) 0x7f13d40cc9c0 con 0x55b6645952f0 2024-08-31T04:31:36.289 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:36.285+0000 7f13f1c20740 1 -- 172.21.15.50:0/2195487255 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f13dc014400 con 0x55b6645952f0 2024-08-31T04:31:36.290 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:36.285+0000 7f13cd600640 1 -- 172.21.15.50:0/2195487255 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) ==== 24+0+0 (secure 0 0 0) 0x7f13d40cc760 con 0x55b6645952f0 2024-08-31T04:31:36.290 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:36.285+0000 7f13f1c20740 10 client.16248 fetch_fsmap learned FSMap version 43 2024-08-31T04:31:36.290 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:36.285+0000 7f13f1c20740 1 -- 172.21.15.50:0/2195487255 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) -- 0x55b6646a2620 con 0x55b6645952f0 2024-08-31T04:31:36.290 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:36.285+0000 7f13cd600640 1 -- 172.21.15.50:0/2195487255 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f13dc014400 con 0x55b6645952f0 2024-08-31T04:31:36.290 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:36.285+0000 7f13cd600640 1 -- 172.21.15.50:0/2195487255 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 43) ==== 8394+0+0 (secure 0 0 0) 0x7f13d40d5540 con 0x55b6645952f0 2024-08-31T04:31:36.290 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:36.286+0000 7f13f1c20740 10 client.16248 fetch_fsmap finished waiting for FSMap version 43 2024-08-31T04:31:36.290 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:36.286+0000 7f13f1c20740 10 client.16248 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T04:31:36.290 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:36.286+0000 7f13f1c20740 20 client.16248 populate_metadata read hostname 'smithi050' 2024-08-31T04:31:36.290 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:36.286+0000 7f13f1c20740 1 --2- 172.21.15.50:0/2195487255 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x55b66457cd80 0x55b66497ab80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:31:36.290 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:36.286+0000 7f13f1c20740 4 client.16248 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T04:31:36.290 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:36.286+0000 7f13f1c20740 1 -- 172.21.15.50:0/2195487255 --> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b6648d8ec0 con 0x55b66457cd80 2024-08-31T04:31:36.290 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:36.286+0000 7f13e3400640 1 --2- 172.21.15.50:0/2195487255 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x55b66457cd80 0x55b66497ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:31:36.291 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:36.287+0000 7f13e3400640 1 --2- 172.21.15.50:0/2195487255 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x55b66457cd80 0x55b66497ab80 crc :-1 s=READY pgs=122 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=af9ff17f9cd2ceb1 server_cookie=912a436416b6075a in_seq=0 out_seq=0 2024-08-31T04:31:36.291 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:36.287+0000 7f13cd600640 10 client.16248 ms_handle_connect on v2:172.21.15.133:6838/2526402262 2024-08-31T04:31:36.291 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:36.288+0000 7f13cd600640 1 -- 172.21.15.50:0/2195487255 <== mds.0 v2:172.21.15.133:6838/2526402262 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55b6648d8ec0 con 0x55b66457cd80 2024-08-31T04:31:36.291 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:36.288+0000 7f13cd600640 10 client.16248 handle_command_reply: tid=0 2024-08-31T04:31:36.291 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:36.288+0000 7f13f1c20740 1 client.16248 shutdown 2024-08-31T04:31:36.291 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:36.288+0000 7f13f1c20740 1 -- 172.21.15.50:0/2195487255 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b6645952f0 msgr2=0x55b66496d4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:31:36.292 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:36.288+0000 7f13f1c20740 1 --2- 172.21.15.50:0/2195487255 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b6645952f0 0x55b66496d4c0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f13d4031fd0 tx=0x7f13d40cbf90 comp rx=0 tx=0).stop 2024-08-31T04:31:36.292 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:36.288+0000 7f13f1c20740 1 -- 172.21.15.50:0/2195487255 shutdown_connections 2024-08-31T04:31:36.292 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:36.288+0000 7f13f1c20740 1 --2- 172.21.15.50:0/2195487255 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x55b66457cd80 0x55b66497ab80 crc :-1 s=READY pgs=122 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:36.292 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:36.288+0000 7f13f1c20740 1 --2- 172.21.15.50:0/2195487255 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b66459d4d0 0x55b66496db80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:36.292 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:36.288+0000 7f13f1c20740 1 --2- 172.21.15.50:0/2195487255 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b6645be1b0 0x55b66496e6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:36.292 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:36.288+0000 7f13f1c20740 1 --2- 172.21.15.50:0/2195487255 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b6645952f0 0x55b66496d4c0 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:36.292 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:36.288+0000 7f13cd600640 0 client.16248 ms_handle_reset on v2:172.21.15.133:6838/2526402262 2024-08-31T04:31:36.292 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:36.288+0000 7f13f1c20740 1 -- 172.21.15.50:0/2195487255 >> 172.21.15.50:0/2195487255 conn(0x55b6645b2300 msgr2=0x55b66495dcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:31:36.293 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:36.288+0000 7f13f1c20740 1 -- 172.21.15.50:0/2195487255 shutdown_connections 2024-08-31T04:31:36.293 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:36.288+0000 7f13f1c20740 1 -- 172.21.15.50:0/2195487255 wait complete. 2024-08-31T04:31:36.293 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:36.288+0000 7f13f1c20740 20 client.16248 trim_cache size 0 max 16384 2024-08-31T04:31:36.305 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:36.303+0000 7f13f1c20740 1 Processor -- start 2024-08-31T04:31:36.305 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:36.304+0000 7f13f1c20740 1 -- start start 2024-08-31T04:31:36.306 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:36.304+0000 7f13f1c20740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b6645952f0 0x55b66495ec10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:31:36.306 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:36.304+0000 7f13f1c20740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b66459d4d0 0x55b66496b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:31:36.306 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:36.304+0000 7f13f1c20740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b6645be1b0 0x55b66496bf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:31:36.306 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:36.304+0000 7f13f1c20740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f13e41acf50 con 0x55b6645be1b0 2024-08-31T04:31:36.306 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:36.304+0000 7f13f1c20740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f13e41aeb50 con 0x55b66459d4d0 2024-08-31T04:31:36.306 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:36.304+0000 7f13f1c20740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f13e41ad620 con 0x55b6645952f0 2024-08-31T04:31:36.306 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:36.304+0000 7f13e8c00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b6645be1b0 0x55b66496bf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:31:36.306 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:36.304+0000 7f13e3e00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b6645952f0 0x55b66495ec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:31:36.306 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:36.304+0000 7f13e8c00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b6645be1b0 0x55b66496bf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:48808/0 (socket says 172.21.15.50:48808) 2024-08-31T04:31:36.306 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:36.304+0000 7f13e8c00640 1 -- 172.21.15.50:0/3006749463 learned_addr learned my addr 172.21.15.50:0/3006749463 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:31:36.306 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:36.304+0000 7f13e3400640 1 --2- 172.21.15.50:0/3006749463 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b66459d4d0 0x55b66496b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:31:36.307 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:36.305+0000 7f13e8c00640 1 -- 172.21.15.50:0/3006749463 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b6645952f0 msgr2=0x55b66495ec10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:31:36.307 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:36.305+0000 7f13e8c00640 1 --2- 172.21.15.50:0/3006749463 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b6645952f0 0x55b66495ec10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:36.308 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:36.305+0000 7f13e8c00640 1 -- 172.21.15.50:0/3006749463 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b66459d4d0 msgr2=0x55b66496b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:31:36.308 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:36.305+0000 7f13e8c00640 1 --2- 172.21.15.50:0/3006749463 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b66459d4d0 0x55b66496b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:36.308 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:36.305+0000 7f13e8c00640 1 -- 172.21.15.50:0/3006749463 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b66496ea60 con 0x55b6645be1b0 2024-08-31T04:31:36.308 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:36.305+0000 7f13e8c00640 1 --2- 172.21.15.50:0/3006749463 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b6645be1b0 0x55b66496bf10 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f13dc009ec0 tx=0x7f13dc01f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f07c733b32ff4fc server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:31:36.308 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:36.305+0000 7f13cfe00640 1 -- 172.21.15.50:0/3006749463 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13dc023070 con 0x55b6645be1b0 2024-08-31T04:31:36.308 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:36.305+0000 7f13cfe00640 1 -- 172.21.15.50:0/3006749463 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f13dc00ed60 con 0x55b6645be1b0 2024-08-31T04:31:36.308 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:36.305+0000 7f13cfe00640 1 -- 172.21.15.50:0/3006749463 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13dc018040 con 0x55b6645be1b0 2024-08-31T04:31:36.308 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:36.306+0000 7f13f1c20740 1 -- 172.21.15.50:0/3006749463 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b6645be1b0 msgr2=0x55b66496bf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:31:36.308 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:36.306+0000 7f13f1c20740 1 --2- 172.21.15.50:0/3006749463 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b6645be1b0 0x55b66496bf10 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f13dc009ec0 tx=0x7f13dc01f000 comp rx=0 tx=0).stop 2024-08-31T04:31:36.308 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:36.306+0000 7f13f1c20740 1 -- 172.21.15.50:0/3006749463 shutdown_connections 2024-08-31T04:31:36.308 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:36.306+0000 7f13f1c20740 1 --2- 172.21.15.50:0/3006749463 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b6645be1b0 0x55b66496bf10 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:36.308 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:36.306+0000 7f13f1c20740 1 --2- 172.21.15.50:0/3006749463 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b66459d4d0 0x55b66496b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:36.308 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:36.306+0000 7f13f1c20740 1 --2- 172.21.15.50:0/3006749463 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b6645952f0 0x55b66495ec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:36.309 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:36.306+0000 7f13f1c20740 1 -- 172.21.15.50:0/3006749463 >> 172.21.15.50:0/3006749463 conn(0x55b6645b2300 msgr2=0x55b66495e500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:31:36.309 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:36.306+0000 7f13f1c20740 1 -- 172.21.15.50:0/3006749463 shutdown_connections 2024-08-31T04:31:36.309 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:36.306+0000 7f13f1c20740 1 -- 172.21.15.50:0/3006749463 wait complete. 2024-08-31T04:31:36.310 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:36.307+0000 7f13f1c20740 1 -- start start 2024-08-31T04:31:36.310 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:36.307+0000 7f13f1c20740 1 Processor -- start 2024-08-31T04:31:36.310 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:36.307+0000 7f13f1c20740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b6645952f0 0x55b664974780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:31:36.310 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:36.307+0000 7f13f1c20740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b66459d4d0 0x55b664974dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:31:36.311 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:36.307+0000 7f13f1c20740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b6645be1b0 0x55b6649730b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:31:36.311 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:36.307+0000 7f13f1c20740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f13e41ae480 con 0x55b66459d4d0 2024-08-31T04:31:36.311 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:36.307+0000 7f13f1c20740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f13e41add80 con 0x55b6645952f0 2024-08-31T04:31:36.311 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:36.307+0000 7f13f1c20740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f13e41aaf30 con 0x55b6645be1b0 2024-08-31T04:31:36.311 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:36.307+0000 7f13f1c20740 10 client.0 _ll_register_callbacks cb 0x7f13d40cc5c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:31:36.311 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:36.307+0000 7f13e3400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b66459d4d0 0x55b664974dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:31:36.311 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:36.308+0000 7f13e3e00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b6645952f0 0x55b664974780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:31:36.311 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:36.308+0000 7f13e3e00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b6645952f0 0x55b664974780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.50:39376/0 (socket says 172.21.15.50:39376) 2024-08-31T04:31:36.311 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:36.308+0000 7f13e3e00640 1 -- 172.21.15.50:0/2150758039 learned_addr learned my addr 172.21.15.50:0/2150758039 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:31:36.311 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:36.308+0000 7f13e8c00640 1 --2- 172.21.15.50:0/2150758039 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b6645be1b0 0x55b6649730b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:31:36.311 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:36.308+0000 7f13e3e00640 1 -- 172.21.15.50:0/2150758039 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b6645be1b0 msgr2=0x55b6649730b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:31:36.311 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:36.308+0000 7f13e3e00640 1 --2- 172.21.15.50:0/2150758039 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b6645be1b0 0x55b6649730b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:36.311 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:36.308+0000 7f13e3e00640 1 -- 172.21.15.50:0/2150758039 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b66459d4d0 msgr2=0x55b664974dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:31:36.312 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:36.308+0000 7f13e3e00640 1 --2- 172.21.15.50:0/2150758039 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b66459d4d0 0x55b664974dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:36.312 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:36.308+0000 7f13e3e00640 1 -- 172.21.15.50:0/2150758039 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b664973820 con 0x55b6645952f0 2024-08-31T04:31:36.312 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:36.308+0000 7f13e8c00640 1 --2- 172.21.15.50:0/2150758039 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b6645be1b0 0x55b6649730b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:31:36.316 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:36.315+0000 7f13e3e00640 1 --2- 172.21.15.50:0/2150758039 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b6645952f0 0x55b664974780 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f13d4005ab0 tx=0x7f13d40d5450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=192430d34972b314 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:31:36.316 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:36.315+0000 7f13cd600640 10 client.0 ms_handle_connect on v2:172.21.15.133:3300/0 2024-08-31T04:31:36.316 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:36.315+0000 7f13cd600640 1 -- 172.21.15.50:0/2150758039 <== mon.2 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13d4049070 con 0x55b6645952f0 2024-08-31T04:31:36.317 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:36.315+0000 7f13cd600640 1 -- 172.21.15.50:0/2150758039 <== mon.2 v2:172.21.15.133:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8219+0+0 (secure 0 0 0) 0x7f13d40cc9c0 con 0x55b6645952f0 2024-08-31T04:31:36.317 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:36.315+0000 7f13f1c20740 1 -- 172.21.15.50:0/2150758039 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f13dc00ed60 con 0x55b6645952f0 2024-08-31T04:31:36.318 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:36.316+0000 7f13cd600640 1 -- 172.21.15.50:0/2150758039 <== mon.2 v2:172.21.15.133:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) ==== 24+0+0 (secure 0 0 0) 0x7f13d40ccbc0 con 0x55b6645952f0 2024-08-31T04:31:36.318 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:36.316+0000 7f13f1c20740 10 client.26246 fetch_fsmap learned FSMap version 43 2024-08-31T04:31:36.318 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:36.316+0000 7f13f1c20740 1 -- 172.21.15.50:0/2150758039 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) -- 0x55b6649e5f70 con 0x55b6645952f0 2024-08-31T04:31:36.318 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:36.316+0000 7f13cd600640 1 -- 172.21.15.50:0/2150758039 <== mon.2 v2:172.21.15.133:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f13dc00ed60 con 0x55b6645952f0 2024-08-31T04:31:36.318 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:36.316+0000 7f13cd600640 1 -- 172.21.15.50:0/2150758039 <== mon.2 v2:172.21.15.133:3300/0 5 ==== fsmap(e 43) ==== 8394+0+0 (secure 0 0 0) 0x7f13d407c1c0 con 0x55b6645952f0 2024-08-31T04:31:36.318 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:36.316+0000 7f13f1c20740 10 client.26246 fetch_fsmap finished waiting for FSMap version 43 2024-08-31T04:31:36.318 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:36.316+0000 7f13f1c20740 10 client.26246 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T04:31:36.318 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:36.316+0000 7f13f1c20740 20 client.26246 populate_metadata read hostname 'smithi050' 2024-08-31T04:31:36.318 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:36.316+0000 7f13f1c20740 1 --2- 172.21.15.50:0/2150758039 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x55b6645521c0 0x55b6649e8800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:31:36.318 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:36.316+0000 7f13f1c20740 4 client.26246 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-31T04:31:36.319 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:36.316+0000 7f13f1c20740 1 -- 172.21.15.50:0/2150758039 --> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55b6648d4960 con 0x55b6645521c0 2024-08-31T04:31:36.319 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:36.317+0000 7f13e3400640 1 --2- 172.21.15.50:0/2150758039 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x55b6645521c0 0x55b6649e8800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:31:36.319 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:36.317+0000 7f13e3400640 1 --2- 172.21.15.50:0/2150758039 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x55b6645521c0 0x55b6649e8800 crc :-1 s=READY pgs=123 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7852faa93e42f52a server_cookie=9ec92db8588f0f40 in_seq=0 out_seq=0 2024-08-31T04:31:36.319 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:36.317+0000 7f13cd600640 10 client.26246 ms_handle_connect on v2:172.21.15.133:6838/2526402262 2024-08-31T04:31:36.334 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:36.332+0000 7f13cd600640 1 -- 172.21.15.50:0/2150758039 <== mds.0 v2:172.21.15.133:6838/2526402262 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55b6648d4960 con 0x55b6645521c0 2024-08-31T04:31:36.334 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:36.332+0000 7f13cd600640 10 client.26246 handle_command_reply: tid=0 2024-08-31T04:31:36.334 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:36.332+0000 7f13f1c20740 1 client.26246 shutdown 2024-08-31T04:31:36.334 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:36.332+0000 7f13f1c20740 1 -- 172.21.15.50:0/2150758039 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b6645952f0 msgr2=0x55b664974780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:31:36.334 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:36.332+0000 7f13f1c20740 1 --2- 172.21.15.50:0/2150758039 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b6645952f0 0x55b664974780 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f13d4005ab0 tx=0x7f13d40d5450 comp rx=0 tx=0).stop 2024-08-31T04:31:36.334 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:36.333+0000 7f13f1c20740 1 -- 172.21.15.50:0/2150758039 shutdown_connections 2024-08-31T04:31:36.335 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:36.333+0000 7f13f1c20740 1 --2- 172.21.15.50:0/2150758039 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x55b6645521c0 0x55b6649e8800 crc :-1 s=READY pgs=123 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:36.335 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:36.333+0000 7f13f1c20740 1 --2- 172.21.15.50:0/2150758039 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b6645be1b0 0x55b6649730b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:36.335 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:36.333+0000 7f13f1c20740 1 --2- 172.21.15.50:0/2150758039 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b66459d4d0 0x55b664974dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:36.335 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:36.333+0000 7f13cd600640 0 client.26246 ms_handle_reset on v2:172.21.15.133:6838/2526402262 2024-08-31T04:31:36.335 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:36.333+0000 7f13f1c20740 1 --2- 172.21.15.50:0/2150758039 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b6645952f0 0x55b664974780 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:36.335 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:36.333+0000 7f13f1c20740 1 -- 172.21.15.50:0/2150758039 >> 172.21.15.50:0/2150758039 conn(0x55b6645b2300 msgr2=0x55b664967ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:31:36.335 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:36.333+0000 7f13f1c20740 1 -- 172.21.15.50:0/2150758039 shutdown_connections 2024-08-31T04:31:36.335 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:36.333+0000 7f13f1c20740 1 -- 172.21.15.50:0/2150758039 wait complete. 2024-08-31T04:31:36.335 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:36.333+0000 7f13f1c20740 20 client.26246 trim_cache size 0 max 16384 2024-08-31T04:31:36.336 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout:{ 2024-08-31T04:31:36.336 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout: "message": "", 2024-08-31T04:31:36.336 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout: "return_code": 0 2024-08-31T04:31:36.336 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout:} 2024-08-31T04:31:36.337 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:36.334+0000 7f13eac00640 1 -- 172.21.15.50:0/207535497 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f13c80b4b30 msgr2=0x7f13c80b7040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:31:36.337 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:36.334+0000 7f13eac00640 1 --2- 172.21.15.50:0/207535497 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f13c80b4b30 0x7f13c80b7040 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f13dc00a600 tx=0x7f13dc000f40 comp rx=0 tx=0).stop 2024-08-31T04:31:36.337 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:36.334+0000 7f13eac00640 1 -- 172.21.15.50:0/207535497 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f13e4103470 msgr2=0x7f13e419c020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:31:36.337 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:36.334+0000 7f13eac00640 1 --2- 172.21.15.50:0/207535497 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f13e4103470 0x7f13e419c020 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f13d4031500 tx=0x7f13d4003c80 comp rx=0 tx=0).stop 2024-08-31T04:31:36.337 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:36.334+0000 7f13eac00640 1 -- 172.21.15.50:0/207535497 shutdown_connections 2024-08-31T04:31:36.337 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:36.334+0000 7f13eac00640 1 --2- 172.21.15.50:0/207535497 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f13c80b4b30 0x7f13c80b7040 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:36.337 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:36.334+0000 7f13eac00640 1 --2- 172.21.15.50:0/207535497 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f13e4104e90 0x7f13e419d1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:36.337 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:36.334+0000 7f13eac00640 1 --2- 172.21.15.50:0/207535497 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f13e41044f0 0x7f13e419c690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:36.337 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:36.334+0000 7f13eac00640 1 --2- 172.21.15.50:0/207535497 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f13e4103470 0x7f13e419c020 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:36.337 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:36.334+0000 7f13eac00640 1 -- 172.21.15.50:0/207535497 >> 172.21.15.50:0/207535497 conn(0x7f13e40fedd0 msgr2=0x7f13e4075390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:31:36.337 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:36.334+0000 7f13eac00640 1 -- 172.21.15.50:0/207535497 shutdown_connections 2024-08-31T04:31:36.337 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:36.334+0000 7f13eac00640 1 -- 172.21.15.50:0/207535497 wait complete. 2024-08-31T04:31:37.761 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:31:37 smithi050 ceph-mon[17259]: pgmap v630: 97 pgs: 97 active+clean; 1.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 39 KiB/s wr, 15 op/s 2024-08-31T04:31:37.996 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:31:37 smithi177 ceph-mon[22025]: pgmap v630: 97 pgs: 97 active+clean; 1.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 39 KiB/s wr, 15 op/s 2024-08-31T04:31:38.043 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:31:37 smithi133 ceph-mon[22177]: pgmap v630: 97 pgs: 97 active+clean; 1.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 39 KiB/s wr, 15 op/s 2024-08-31T04:31:39.747 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:31:39 smithi050 ceph-mon[17259]: pgmap v631: 97 pgs: 97 active+clean; 1.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 39 KiB/s wr, 15 op/s 2024-08-31T04:31:39.996 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:31:39 smithi177 ceph-mon[22025]: pgmap v631: 97 pgs: 97 active+clean; 1.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 39 KiB/s wr, 15 op/s 2024-08-31T04:31:40.043 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:31:39 smithi133 ceph-mon[22177]: pgmap v631: 97 pgs: 97 active+clean; 1.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 39 KiB/s wr, 15 op/s 2024-08-31T04:31:41.743 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:31:41 smithi050 ceph-mon[17259]: pgmap v632: 97 pgs: 97 active+clean; 1.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 30 KiB/s wr, 12 op/s 2024-08-31T04:31:41.996 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:31:41 smithi177 ceph-mon[22025]: pgmap v632: 97 pgs: 97 active+clean; 1.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 30 KiB/s wr, 12 op/s 2024-08-31T04:31:42.043 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:31:41 smithi133 ceph-mon[22177]: pgmap v632: 97 pgs: 97 active+clean; 1.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 30 KiB/s wr, 12 op/s 2024-08-31T04:31:43.969 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:31:43 smithi050 ceph-mon[17259]: pgmap v633: 97 pgs: 97 active+clean; 1.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 31 KiB/s wr, 17 op/s 2024-08-31T04:31:43.996 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:31:43 smithi177 ceph-mon[22025]: pgmap v633: 97 pgs: 97 active+clean; 1.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 31 KiB/s wr, 17 op/s 2024-08-31T04:31:44.043 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:31:43 smithi133 ceph-mon[22177]: pgmap v633: 97 pgs: 97 active+clean; 1.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 31 KiB/s wr, 17 op/s 2024-08-31T04:31:45.970 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:31:45 smithi050 ceph-mon[17259]: pgmap v634: 97 pgs: 97 active+clean; 1.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 16 KiB/s wr, 13 op/s 2024-08-31T04:31:45.970 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:31:45 smithi050 ceph-mon[17259]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-31T04:31:45.996 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:31:45 smithi177 ceph-mon[22025]: pgmap v634: 97 pgs: 97 active+clean; 1.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 16 KiB/s wr, 13 op/s 2024-08-31T04:31:45.996 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:31:45 smithi177 ceph-mon[22025]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-31T04:31:46.043 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:31:45 smithi133 ceph-mon[22177]: pgmap v634: 97 pgs: 97 active+clean; 1.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 16 KiB/s wr, 13 op/s 2024-08-31T04:31:46.043 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:31:45 smithi133 ceph-mon[22177]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-31T04:31:47.944 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:31:47 smithi050 ceph-mon[17259]: pgmap v635: 97 pgs: 97 active+clean; 1.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 11 KiB/s wr, 14 op/s 2024-08-31T04:31:47.996 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:31:47 smithi177 ceph-mon[22025]: pgmap v635: 97 pgs: 97 active+clean; 1.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 11 KiB/s wr, 14 op/s 2024-08-31T04:31:48.043 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:31:47 smithi133 ceph-mon[22177]: pgmap v635: 97 pgs: 97 active+clean; 1.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 11 KiB/s wr, 14 op/s 2024-08-31T04:31:49.531 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:49.526+0000 7fe333200640 1 -- 172.21.15.50:0/640089309 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe33406b4b0 msgr2=0x7fe334105f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:31:49.531 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:49.526+0000 7fe333200640 1 --2- 172.21.15.50:0/640089309 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe33406b4b0 0x7fe334105f20 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fe324009900 tx=0x7fe32402a410 comp rx=0 tx=0).stop 2024-08-31T04:31:49.531 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:49.526+0000 7fe333200640 1 -- 172.21.15.50:0/640089309 shutdown_connections 2024-08-31T04:31:49.531 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:49.526+0000 7fe333200640 1 --2- 172.21.15.50:0/640089309 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe334106460 0x7fe3341088e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:49.531 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:49.526+0000 7fe333200640 1 --2- 172.21.15.50:0/640089309 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe334109020 0x7fe33410b530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:49.531 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:49.526+0000 7fe333200640 1 --2- 172.21.15.50:0/640089309 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe33406b4b0 0x7fe334105f20 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:49.531 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:49.526+0000 7fe333200640 1 -- 172.21.15.50:0/640089309 >> 172.21.15.50:0/640089309 conn(0x7fe3340fdb20 msgr2=0x7fe3340fffd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:31:49.531 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:49.526+0000 7fe333200640 1 -- 172.21.15.50:0/640089309 shutdown_connections 2024-08-31T04:31:49.532 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:49.526+0000 7fe333200640 1 -- 172.21.15.50:0/640089309 wait complete. 2024-08-31T04:31:49.533 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:49.526+0000 7fe333200640 1 Processor -- start 2024-08-31T04:31:49.533 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:49.526+0000 7fe333200640 1 -- start start 2024-08-31T04:31:49.533 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:49.526+0000 7fe333200640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe33406b4b0 0x7fe334103560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:31:49.533 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:49.526+0000 7fe333200640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe334106460 0x7fe334101e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:31:49.533 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:49.526+0000 7fe333200640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe334109020 0x7fe334102360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:31:49.533 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:49.526+0000 7fe333200640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fe33410eed0 con 0x7fe334109020 2024-08-31T04:31:49.533 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:49.526+0000 7fe333200640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7fe33410ed50 con 0x7fe334106460 2024-08-31T04:31:49.534 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:49.526+0000 7fe333200640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fe33410f050 con 0x7fe33406b4b0 2024-08-31T04:31:49.534 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:49.526+0000 7fe331e00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe33406b4b0 0x7fe334103560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:31:49.534 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:49.526+0000 7fe331400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe334106460 0x7fe334101e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:31:49.534 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:49.526+0000 7fe331e00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe33406b4b0 0x7fe334103560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.50:45616/0 (socket says 172.21.15.50:45616) 2024-08-31T04:31:49.534 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:49.526+0000 7fe331e00640 1 -- 172.21.15.50:0/1632287904 learned_addr learned my addr 172.21.15.50:0/1632287904 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:31:49.534 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:49.526+0000 7fe332800640 1 --2- 172.21.15.50:0/1632287904 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe334109020 0x7fe334102360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:31:49.534 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:49.526+0000 7fe331e00640 1 -- 172.21.15.50:0/1632287904 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe334106460 msgr2=0x7fe334101e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:31:49.534 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:49.526+0000 7fe331e00640 1 --2- 172.21.15.50:0/1632287904 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe334106460 0x7fe334101e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:49.534 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:49.526+0000 7fe331e00640 1 -- 172.21.15.50:0/1632287904 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe334109020 msgr2=0x7fe334102360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:31:49.534 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:49.526+0000 7fe331e00640 1 --2- 172.21.15.50:0/1632287904 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe334109020 0x7fe334102360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:49.534 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:49.531+0000 7fe331e00640 1 -- 172.21.15.50:0/1632287904 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe334102a90 con 0x7fe33406b4b0 2024-08-31T04:31:49.534 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:49.531+0000 7fe331e00640 1 --2- 172.21.15.50:0/1632287904 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe33406b4b0 0x7fe334103560 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fe324006010 tx=0x7fe3240042f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:31:49.535 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:49.531+0000 7fe32aa00640 1 -- 172.21.15.50:0/1632287904 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe32403f030 con 0x7fe33406b4b0 2024-08-31T04:31:49.535 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:49.531+0000 7fe32aa00640 1 -- 172.21.15.50:0/1632287904 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe324031910 con 0x7fe33406b4b0 2024-08-31T04:31:49.535 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:49.531+0000 7fe333200640 1 -- 172.21.15.50:0/1632287904 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe3341a3b80 con 0x7fe33406b4b0 2024-08-31T04:31:49.535 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:49.531+0000 7fe32aa00640 1 -- 172.21.15.50:0/1632287904 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe324035070 con 0x7fe33406b4b0 2024-08-31T04:31:49.535 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:49.531+0000 7fe333200640 1 -- 172.21.15.50:0/1632287904 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe3341a3fe0 con 0x7fe33406b4b0 2024-08-31T04:31:49.537 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:49.531+0000 7fe32aa00640 1 -- 172.21.15.50:0/1632287904 <== mon.1 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 18) ==== 152577+0+0 (secure 0 0 0) 0x7fe324042030 con 0x7fe33406b4b0 2024-08-31T04:31:49.538 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:49.531+0000 7fe33f9f1740 1 Processor -- start 2024-08-31T04:31:49.538 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:49.531+0000 7fe33f9f1740 1 -- start start 2024-08-31T04:31:49.538 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:49.536+0000 7fe33f9f1740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55fd72ae31b0 0x55fd72e88fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:31:49.538 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:49.536+0000 7fe33f9f1740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55fd72aba2f0 0x55fd72e89610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:31:49.538 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:49.536+0000 7fe33f9f1740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fd72ac24d0 0x55fd72e8a160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:31:49.538 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:49.536+0000 7fe33f9f1740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55fd72dfbf70 con 0x55fd72ac24d0 2024-08-31T04:31:49.538 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:49.536+0000 7fe33f9f1740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x55fd72deb500 con 0x55fd72ae31b0 2024-08-31T04:31:49.539 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:49.536+0000 7fe33f9f1740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x55fd72def4b0 con 0x55fd72aba2f0 2024-08-31T04:31:49.540 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:49.536+0000 7fe331e00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55fd72aba2f0 0x55fd72e89610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:31:49.540 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:49.536+0000 7fe331400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fd72ac24d0 0x55fd72e8a160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:31:49.540 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:49.536+0000 7fe331e00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55fd72aba2f0 0x55fd72e89610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.50:45628/0 (socket says 172.21.15.50:45628) 2024-08-31T04:31:49.540 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:49.536+0000 7fe331e00640 1 -- 172.21.15.50:0/251316467 learned_addr learned my addr 172.21.15.50:0/251316467 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:31:49.540 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:49.536+0000 7fe332800640 1 --2- 172.21.15.50:0/251316467 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55fd72ae31b0 0x55fd72e88fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:31:49.541 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:49.536+0000 7fe331e00640 1 -- 172.21.15.50:0/251316467 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55fd72ae31b0 msgr2=0x55fd72e88fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:31:49.541 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:49.536+0000 7fe331e00640 1 --2- 172.21.15.50:0/251316467 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55fd72ae31b0 0x55fd72e88fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:49.541 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:49.536+0000 7fe331e00640 1 -- 172.21.15.50:0/251316467 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fd72ac24d0 msgr2=0x55fd72e8a160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:31:49.541 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:49.536+0000 7fe331e00640 1 --2- 172.21.15.50:0/251316467 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fd72ac24d0 0x55fd72e8a160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:49.541 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:49.536+0000 7fe331e00640 1 -- 172.21.15.50:0/251316467 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fd72da5c10 con 0x55fd72aba2f0 2024-08-31T04:31:49.541 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:49.536+0000 7fe331400640 1 --2- 172.21.15.50:0/251316467 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fd72ac24d0 0x55fd72e8a160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:31:49.541 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:49.536+0000 7fe331e00640 1 --2- 172.21.15.50:0/251316467 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55fd72aba2f0 0x55fd72e89610 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fe32410b750 tx=0x7fe32410b840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=db4d5531f6f6a7e4 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:31:49.541 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:49.536+0000 7fe32aa00640 1 --2- 172.21.15.50:0/1632287904 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fe3180b4bb0 0x7fe3180b70c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:31:49.541 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:49.536+0000 7fe31f000640 1 -- 172.21.15.50:0/251316467 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3240c8730 con 0x55fd72aba2f0 2024-08-31T04:31:49.541 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:49.536+0000 7fe31f000640 1 -- 172.21.15.50:0/251316467 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe324112030 con 0x55fd72aba2f0 2024-08-31T04:31:49.541 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:49.536+0000 7fe31f000640 1 -- 172.21.15.50:0/251316467 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3240cb850 con 0x55fd72aba2f0 2024-08-31T04:31:49.541 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:49.536+0000 7fe32aa00640 1 -- 172.21.15.50:0/1632287904 <== mon.1 v2:172.21.15.177:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8219+0+0 (secure 0 0 0) 0x7fe324105650 con 0x7fe33406b4b0 2024-08-31T04:31:49.542 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:49.536+0000 7fe332800640 1 --2- 172.21.15.50:0/1632287904 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fe3180b4bb0 0x7fe3180b70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:31:49.543 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:49.536+0000 7fe33f9f1740 1 -- 172.21.15.50:0/251316467 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55fd72aba2f0 msgr2=0x55fd72e89610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:31:49.543 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:49.536+0000 7fe332800640 1 --2- 172.21.15.50:0/1632287904 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fe3180b4bb0 0x7fe3180b70c0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fe32c005fd0 tx=0x7fe32c009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:31:49.543 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:49.536+0000 7fe33f9f1740 1 --2- 172.21.15.50:0/251316467 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55fd72aba2f0 0x55fd72e89610 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fe32410b750 tx=0x7fe32410b840 comp rx=0 tx=0).stop 2024-08-31T04:31:49.543 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:49.536+0000 7fe33f9f1740 1 -- 172.21.15.50:0/251316467 shutdown_connections 2024-08-31T04:31:49.543 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:49.536+0000 7fe33f9f1740 1 --2- 172.21.15.50:0/251316467 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55fd72aba2f0 0x55fd72e89610 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:49.543 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:49.536+0000 7fe33f9f1740 1 --2- 172.21.15.50:0/251316467 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fd72ac24d0 0x55fd72e8a160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:49.543 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:49.536+0000 7fe33f9f1740 1 --2- 172.21.15.50:0/251316467 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55fd72ae31b0 0x55fd72e88fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:49.543 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:49.536+0000 7fe33f9f1740 1 -- 172.21.15.50:0/251316467 >> 172.21.15.50:0/251316467 conn(0x55fd72ad7300 msgr2=0x55fd72e84a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:31:49.543 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:49.536+0000 7fe33f9f1740 1 -- 172.21.15.50:0/251316467 shutdown_connections 2024-08-31T04:31:49.543 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:49.536+0000 7fe33f9f1740 1 -- 172.21.15.50:0/251316467 wait complete. 2024-08-31T04:31:49.544 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:49.536+0000 7fe33f9f1740 1 -- start start 2024-08-31T04:31:49.544 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:49.541+0000 7fe33f9f1740 1 Processor -- start 2024-08-31T04:31:49.546 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:49.541+0000 7fe33f9f1740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55fd72aba2f0 0x55fd72e92280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:31:49.547 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:49.541+0000 7fe33f9f1740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55fd72ac24d0 0x55fd72e92940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:31:49.547 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:49.541+0000 7fe33f9f1740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fd72ae31b0 0x55fd72e934b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:31:49.547 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:49.541+0000 7fe33f9f1740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55fd72d24ab0 con 0x55fd72ae31b0 2024-08-31T04:31:49.547 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:49.541+0000 7fe33f9f1740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x55fd72d92320 con 0x55fd72ac24d0 2024-08-31T04:31:49.547 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:49.541+0000 7fe33f9f1740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x55fd72e8aa40 con 0x55fd72aba2f0 2024-08-31T04:31:49.547 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:49.541+0000 7fe33f9f1740 10 client.0 _ll_register_callbacks cb 0x55fd72d986a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:31:49.547 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:49.541+0000 7fe331e00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55fd72aba2f0 0x55fd72e92280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:31:49.547 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:49.541+0000 7fe331400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55fd72ac24d0 0x55fd72e92940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:31:49.547 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:49.541+0000 7fe331e00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55fd72aba2f0 0x55fd72e92280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.50:45642/0 (socket says 172.21.15.50:45642) 2024-08-31T04:31:49.547 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:49.541+0000 7fe331e00640 1 -- 172.21.15.50:0/3528687520 learned_addr learned my addr 172.21.15.50:0/3528687520 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:31:49.548 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:49.541+0000 7fe332800640 1 --2- 172.21.15.50:0/3528687520 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fd72ae31b0 0x55fd72e934b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:31:49.548 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:49.541+0000 7fe331400640 1 -- 172.21.15.50:0/3528687520 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55fd72aba2f0 msgr2=0x55fd72e92280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:31:49.548 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:49.541+0000 7fe331400640 1 --2- 172.21.15.50:0/3528687520 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55fd72aba2f0 0x55fd72e92280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:49.548 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:49.541+0000 7fe331400640 1 -- 172.21.15.50:0/3528687520 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fd72ae31b0 msgr2=0x55fd72e934b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:31:49.548 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:49.541+0000 7fe331400640 1 --2- 172.21.15.50:0/3528687520 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fd72ae31b0 0x55fd72e934b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:49.548 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:49.541+0000 7fe331400640 1 -- 172.21.15.50:0/3528687520 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fd72b4e790 con 0x55fd72ac24d0 2024-08-31T04:31:49.548 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:49.541+0000 7fe331400640 1 --2- 172.21.15.50:0/3528687520 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55fd72ac24d0 0x55fd72e92940 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fe3200126d0 tx=0x7fe320012b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6638ec44ad5d0a66 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:31:49.548 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:49.541+0000 7fe313400640 10 client.0 ms_handle_connect on v2:172.21.15.133:3300/0 2024-08-31T04:31:49.548 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:49.541+0000 7fe313400640 1 -- 172.21.15.50:0/3528687520 <== mon.2 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe32000f8c0 con 0x55fd72ac24d0 2024-08-31T04:31:49.548 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:49.541+0000 7fe33f9f1740 1 -- 172.21.15.50:0/3528687520 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe324112030 con 0x55fd72ac24d0 2024-08-31T04:31:49.549 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:49.541+0000 7fe313400640 1 -- 172.21.15.50:0/3528687520 <== mon.2 v2:172.21.15.133:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8219+0+0 (secure 0 0 0) 0x7fe32000fa60 con 0x55fd72ac24d0 2024-08-31T04:31:49.549 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:49.541+0000 7fe313400640 1 -- 172.21.15.50:0/3528687520 <== mon.2 v2:172.21.15.133:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) ==== 24+0+0 (secure 0 0 0) 0x7fe32000fc60 con 0x55fd72ac24d0 2024-08-31T04:31:49.549 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:49.541+0000 7fe33f9f1740 10 client.26258 fetch_fsmap learned FSMap version 44 2024-08-31T04:31:49.549 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:49.541+0000 7fe33f9f1740 1 -- 172.21.15.50:0/3528687520 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,fsmap=44,monmap=4+}) -- 0x55fd72bc7620 con 0x55fd72ac24d0 2024-08-31T04:31:49.549 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:49.541+0000 7fe313400640 1 -- 172.21.15.50:0/3528687520 <== mon.2 v2:172.21.15.133:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe324112030 con 0x55fd72ac24d0 2024-08-31T04:31:49.549 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:49.541+0000 7fe313400640 1 -- 172.21.15.50:0/3528687520 <== mon.2 v2:172.21.15.133:3300/0 5 ==== fsmap(e 44) ==== 8390+0+0 (secure 0 0 0) 0x7fe320005380 con 0x55fd72ac24d0 2024-08-31T04:31:49.549 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:49.541+0000 7fe33f9f1740 10 client.26258 fetch_fsmap finished waiting for FSMap version 44 2024-08-31T04:31:49.549 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:49.541+0000 7fe33f9f1740 10 client.26258 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T04:31:49.549 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:49.541+0000 7fe33f9f1740 20 client.26258 populate_metadata read hostname 'smithi050' 2024-08-31T04:31:49.549 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:49.541+0000 7fe33f9f1740 1 --2- 172.21.15.50:0/3528687520 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x55fd72aa1d80 0x55fd72e9fb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:31:49.549 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:49.541+0000 7fe33f9f1740 4 client.26258 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T04:31:49.549 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:49.541+0000 7fe33f9f1740 1 -- 172.21.15.50:0/3528687520 --> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55fd72dfdec0 con 0x55fd72aa1d80 2024-08-31T04:31:49.550 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:49.541+0000 7fe331e00640 1 --2- 172.21.15.50:0/3528687520 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x55fd72aa1d80 0x55fd72e9fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:31:49.551 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:49.541+0000 7fe331e00640 1 --2- 172.21.15.50:0/3528687520 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x55fd72aa1d80 0x55fd72e9fb70 crc :-1 s=READY pgs=124 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=224a1211d0a8d407 server_cookie=aca0d0afb148df7e in_seq=0 out_seq=0 2024-08-31T04:31:49.551 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:49.541+0000 7fe313400640 10 client.26258 ms_handle_connect on v2:172.21.15.133:6838/2526402262 2024-08-31T04:31:49.551 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:49.546+0000 7fe313400640 1 -- 172.21.15.50:0/3528687520 <== mds.0 v2:172.21.15.133:6838/2526402262 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55fd72dfdec0 con 0x55fd72aa1d80 2024-08-31T04:31:49.551 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:49.546+0000 7fe313400640 10 client.26258 handle_command_reply: tid=0 2024-08-31T04:31:49.551 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:49.546+0000 7fe33f9f1740 1 client.26258 shutdown 2024-08-31T04:31:49.551 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:49.546+0000 7fe33f9f1740 1 -- 172.21.15.50:0/3528687520 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55fd72ac24d0 msgr2=0x55fd72e92940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:31:49.551 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:49.546+0000 7fe33f9f1740 1 --2- 172.21.15.50:0/3528687520 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55fd72ac24d0 0x55fd72e92940 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fe3200126d0 tx=0x7fe320012b90 comp rx=0 tx=0).stop 2024-08-31T04:31:49.551 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:49.546+0000 7fe33f9f1740 1 -- 172.21.15.50:0/3528687520 shutdown_connections 2024-08-31T04:31:49.551 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:49.546+0000 7fe33f9f1740 1 --2- 172.21.15.50:0/3528687520 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x55fd72aa1d80 0x55fd72e9fb70 crc :-1 s=READY pgs=124 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:49.551 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:49.546+0000 7fe33f9f1740 1 --2- 172.21.15.50:0/3528687520 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fd72ae31b0 0x55fd72e934b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:49.551 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:49.546+0000 7fe33f9f1740 1 --2- 172.21.15.50:0/3528687520 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55fd72ac24d0 0x55fd72e92940 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:49.551 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:49.546+0000 7fe33f9f1740 1 --2- 172.21.15.50:0/3528687520 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55fd72aba2f0 0x55fd72e92280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:49.552 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:49.546+0000 7fe33f9f1740 1 -- 172.21.15.50:0/3528687520 >> 172.21.15.50:0/3528687520 conn(0x55fd72ad7300 msgr2=0x55fd72e82f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:31:49.552 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:49.546+0000 7fe313400640 0 client.26258 ms_handle_reset on v2:172.21.15.133:6838/2526402262 2024-08-31T04:31:49.552 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:49.546+0000 7fe33f9f1740 1 -- 172.21.15.50:0/3528687520 shutdown_connections 2024-08-31T04:31:49.552 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:49.546+0000 7fe33f9f1740 1 -- 172.21.15.50:0/3528687520 wait complete. 2024-08-31T04:31:49.552 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:49.546+0000 7fe33f9f1740 20 client.26258 trim_cache size 0 max 16384 2024-08-31T04:31:49.577 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:49.572+0000 7fe33f9f1740 1 Processor -- start 2024-08-31T04:31:49.577 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:49.572+0000 7fe33f9f1740 1 -- start start 2024-08-31T04:31:49.578 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:49.572+0000 7fe33f9f1740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55fd72aba2f0 0x55fd72e84370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:31:49.578 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:49.572+0000 7fe33f9f1740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55fd72ac24d0 0x55fd72e92280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:31:49.578 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:49.572+0000 7fe33f9f1740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fd72ae31b0 0x55fd72e927c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:31:49.579 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:49.572+0000 7fe33f9f1740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fe3341acc20 con 0x55fd72ae31b0 2024-08-31T04:31:49.579 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:49.572+0000 7fe33f9f1740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7fe3341ae7f0 con 0x55fd72ac24d0 2024-08-31T04:31:49.579 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:49.572+0000 7fe33f9f1740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fe3341ad2f0 con 0x55fd72aba2f0 2024-08-31T04:31:49.579 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:49.572+0000 7fe331400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55fd72ac24d0 0x55fd72e92280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:31:49.579 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:49.572+0000 7fe332800640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fd72ae31b0 0x55fd72e927c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:31:49.579 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:49.572+0000 7fe331400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55fd72ac24d0 0x55fd72e92280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.50:53072/0 (socket says 172.21.15.50:53072) 2024-08-31T04:31:49.579 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:49.572+0000 7fe331400640 1 -- 172.21.15.50:0/2450521350 learned_addr learned my addr 172.21.15.50:0/2450521350 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:31:49.579 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:49.572+0000 7fe331e00640 1 --2- 172.21.15.50:0/2450521350 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55fd72aba2f0 0x55fd72e84370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:31:49.579 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:49.572+0000 7fe331400640 1 -- 172.21.15.50:0/2450521350 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55fd72aba2f0 msgr2=0x55fd72e84370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:31:49.579 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:49.572+0000 7fe331400640 1 --2- 172.21.15.50:0/2450521350 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55fd72aba2f0 0x55fd72e84370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:49.579 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:49.572+0000 7fe331400640 1 -- 172.21.15.50:0/2450521350 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fd72ae31b0 msgr2=0x55fd72e927c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:31:49.580 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:49.572+0000 7fe331400640 1 --2- 172.21.15.50:0/2450521350 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fd72ae31b0 0x55fd72e927c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:49.580 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:49.572+0000 7fe331400640 1 -- 172.21.15.50:0/2450521350 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fd72e92010 con 0x55fd72ac24d0 2024-08-31T04:31:49.581 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:49.572+0000 7fe331400640 1 --2- 172.21.15.50:0/2450521350 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55fd72ac24d0 0x55fd72e92280 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fe320005770 tx=0x7fe32000ff90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b9b8fa85d7adc86e server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:31:49.581 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:49.572+0000 7fe31e600640 1 -- 172.21.15.50:0/2450521350 <== mon.2 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe32000f790 con 0x55fd72ac24d0 2024-08-31T04:31:49.581 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:49.572+0000 7fe31e600640 1 -- 172.21.15.50:0/2450521350 <== mon.2 v2:172.21.15.133:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe3200054b0 con 0x55fd72ac24d0 2024-08-31T04:31:49.581 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:49.572+0000 7fe31e600640 1 -- 172.21.15.50:0/2450521350 <== mon.2 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3200035f0 con 0x55fd72ac24d0 2024-08-31T04:31:49.581 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:49.578+0000 7fe33f9f1740 1 -- 172.21.15.50:0/2450521350 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55fd72ac24d0 msgr2=0x55fd72e92280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:31:49.581 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:49.578+0000 7fe33f9f1740 1 --2- 172.21.15.50:0/2450521350 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55fd72ac24d0 0x55fd72e92280 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fe320005770 tx=0x7fe32000ff90 comp rx=0 tx=0).stop 2024-08-31T04:31:49.581 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:49.578+0000 7fe33f9f1740 1 -- 172.21.15.50:0/2450521350 shutdown_connections 2024-08-31T04:31:49.581 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:49.578+0000 7fe33f9f1740 1 --2- 172.21.15.50:0/2450521350 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fd72ae31b0 0x55fd72e927c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:49.581 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:49.578+0000 7fe33f9f1740 1 --2- 172.21.15.50:0/2450521350 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55fd72ac24d0 0x55fd72e92280 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:49.582 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:49.578+0000 7fe33f9f1740 1 --2- 172.21.15.50:0/2450521350 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55fd72aba2f0 0x55fd72e84370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:49.582 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:49.578+0000 7fe33f9f1740 1 -- 172.21.15.50:0/2450521350 >> 172.21.15.50:0/2450521350 conn(0x55fd72ad7300 msgr2=0x55fd72e91480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:31:49.582 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:49.578+0000 7fe33f9f1740 1 -- 172.21.15.50:0/2450521350 shutdown_connections 2024-08-31T04:31:49.582 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:49.578+0000 7fe33f9f1740 1 -- 172.21.15.50:0/2450521350 wait complete. 2024-08-31T04:31:49.584 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:49.578+0000 7fe33f9f1740 1 -- start start 2024-08-31T04:31:49.584 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:49.578+0000 7fe33f9f1740 1 Processor -- start 2024-08-31T04:31:49.584 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:49.578+0000 7fe33f9f1740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55fd72aba2f0 0x55fd72e9a030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:31:49.584 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:49.578+0000 7fe33f9f1740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55fd72ac24d0 0x55fd72e98cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:31:49.585 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:49.578+0000 7fe33f9f1740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fd72ae31b0 0x55fd72e99230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:31:49.585 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:49.578+0000 7fe33f9f1740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fe3341ae120 con 0x55fd72ae31b0 2024-08-31T04:31:49.585 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:49.578+0000 7fe33f9f1740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7fe3341ada20 con 0x55fd72ac24d0 2024-08-31T04:31:49.585 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:49.578+0000 7fe33f9f1740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fe3341aac00 con 0x55fd72aba2f0 2024-08-31T04:31:49.585 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:49.578+0000 7fe33f9f1740 10 client.0 _ll_register_callbacks cb 0x7fe320009ec0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:31:49.585 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:49.578+0000 7fe331400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55fd72ac24d0 0x55fd72e98cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:31:49.585 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:49.578+0000 7fe332800640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fd72ae31b0 0x55fd72e99230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:31:49.585 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:49.578+0000 7fe331400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55fd72ac24d0 0x55fd72e98cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.50:53078/0 (socket says 172.21.15.50:53078) 2024-08-31T04:31:49.585 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:49.578+0000 7fe331400640 1 -- 172.21.15.50:0/2144476772 learned_addr learned my addr 172.21.15.50:0/2144476772 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:31:49.585 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:49.578+0000 7fe331e00640 1 --2- 172.21.15.50:0/2144476772 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55fd72aba2f0 0x55fd72e9a030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:31:49.585 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:49.578+0000 7fe331400640 1 -- 172.21.15.50:0/2144476772 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55fd72aba2f0 msgr2=0x55fd72e9a030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:31:49.585 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:49.578+0000 7fe331400640 1 --2- 172.21.15.50:0/2144476772 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55fd72aba2f0 0x55fd72e9a030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:49.586 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:49.578+0000 7fe331400640 1 -- 172.21.15.50:0/2144476772 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fd72ae31b0 msgr2=0x55fd72e99230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:31:49.586 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:49.578+0000 7fe331400640 1 --2- 172.21.15.50:0/2144476772 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fd72ae31b0 0x55fd72e99230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:49.586 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:49.578+0000 7fe331400640 1 -- 172.21.15.50:0/2144476772 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fd72e99970 con 0x55fd72ac24d0 2024-08-31T04:31:49.586 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:49.578+0000 7fe331400640 1 --2- 172.21.15.50:0/2144476772 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55fd72ac24d0 0x55fd72e98cf0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fe320010600 tx=0x7fe32000fbc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3dc3a8b9f9e6b66b server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:31:49.586 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:49.578+0000 7fe313400640 10 client.0 ms_handle_connect on v2:172.21.15.133:3300/0 2024-08-31T04:31:49.586 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:49.578+0000 7fe313400640 1 -- 172.21.15.50:0/2144476772 <== mon.2 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe320005000 con 0x55fd72ac24d0 2024-08-31T04:31:49.586 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:49.578+0000 7fe33f9f1740 1 -- 172.21.15.50:0/2144476772 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe3200054b0 con 0x55fd72ac24d0 2024-08-31T04:31:49.586 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:49.578+0000 7fe313400640 1 -- 172.21.15.50:0/2144476772 <== mon.2 v2:172.21.15.133:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8219+0+0 (secure 0 0 0) 0x7fe3200051a0 con 0x55fd72ac24d0 2024-08-31T04:31:49.586 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:49.578+0000 7fe313400640 1 -- 172.21.15.50:0/2144476772 <== mon.2 v2:172.21.15.133:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) ==== 24+0+0 (secure 0 0 0) 0x7fe3200035f0 con 0x55fd72ac24d0 2024-08-31T04:31:49.586 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:49.578+0000 7fe33f9f1740 10 client.26264 fetch_fsmap learned FSMap version 44 2024-08-31T04:31:49.586 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:49.578+0000 7fe33f9f1740 1 -- 172.21.15.50:0/2144476772 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,fsmap=44,monmap=4+}) -- 0x55fd72f0a530 con 0x55fd72ac24d0 2024-08-31T04:31:49.586 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:49.578+0000 7fe313400640 1 -- 172.21.15.50:0/2144476772 <== mon.2 v2:172.21.15.133:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe3200054b0 con 0x55fd72ac24d0 2024-08-31T04:31:49.587 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:49.578+0000 7fe313400640 1 -- 172.21.15.50:0/2144476772 <== mon.2 v2:172.21.15.133:3300/0 5 ==== fsmap(e 44) ==== 8390+0+0 (secure 0 0 0) 0x7fe320037060 con 0x55fd72ac24d0 2024-08-31T04:31:49.587 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:49.583+0000 7fe33f9f1740 10 client.26264 fetch_fsmap finished waiting for FSMap version 44 2024-08-31T04:31:49.587 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:49.583+0000 7fe33f9f1740 10 client.26264 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T04:31:49.587 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:49.583+0000 7fe33f9f1740 20 client.26264 populate_metadata read hostname 'smithi050' 2024-08-31T04:31:49.587 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:49.583+0000 7fe33f9f1740 1 --2- 172.21.15.50:0/2144476772 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x55fd72a771c0 0x55fd72f0ce00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:31:49.588 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:49.583+0000 7fe33f9f1740 4 client.26264 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-31T04:31:49.588 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:49.583+0000 7fe33f9f1740 1 -- 172.21.15.50:0/2144476772 --> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55fd72df9960 con 0x55fd72a771c0 2024-08-31T04:31:49.588 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:49.583+0000 7fe331e00640 1 --2- 172.21.15.50:0/2144476772 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x55fd72a771c0 0x55fd72f0ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:31:49.588 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:49.583+0000 7fe331e00640 1 --2- 172.21.15.50:0/2144476772 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x55fd72a771c0 0x55fd72f0ce00 crc :-1 s=READY pgs=125 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=488e89c0e9b2e5d0 server_cookie=9b2e478f8a0188b3 in_seq=0 out_seq=0 2024-08-31T04:31:49.588 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:49.583+0000 7fe313400640 10 client.26264 ms_handle_connect on v2:172.21.15.133:6838/2526402262 2024-08-31T04:31:49.595 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:49.593+0000 7fe313400640 1 -- 172.21.15.50:0/2144476772 <== mds.0 v2:172.21.15.133:6838/2526402262 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55fd72df9960 con 0x55fd72a771c0 2024-08-31T04:31:49.596 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:49.593+0000 7fe313400640 10 client.26264 handle_command_reply: tid=0 2024-08-31T04:31:49.596 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:49.593+0000 7fe33f9f1740 1 client.26264 shutdown 2024-08-31T04:31:49.596 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:49.593+0000 7fe33f9f1740 1 -- 172.21.15.50:0/2144476772 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55fd72ac24d0 msgr2=0x55fd72e98cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:31:49.596 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:49.593+0000 7fe33f9f1740 1 --2- 172.21.15.50:0/2144476772 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55fd72ac24d0 0x55fd72e98cf0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fe320010600 tx=0x7fe32000fbc0 comp rx=0 tx=0).stop 2024-08-31T04:31:49.596 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:49.593+0000 7fe33f9f1740 1 -- 172.21.15.50:0/2144476772 shutdown_connections 2024-08-31T04:31:49.596 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:49.593+0000 7fe33f9f1740 1 --2- 172.21.15.50:0/2144476772 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x55fd72a771c0 0x55fd72f0ce00 crc :-1 s=READY pgs=125 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:49.596 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:49.593+0000 7fe33f9f1740 1 --2- 172.21.15.50:0/2144476772 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fd72ae31b0 0x55fd72e99230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:49.596 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:49.593+0000 7fe33f9f1740 1 --2- 172.21.15.50:0/2144476772 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55fd72ac24d0 0x55fd72e98cf0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:49.596 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:49.593+0000 7fe33f9f1740 1 --2- 172.21.15.50:0/2144476772 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55fd72aba2f0 0x55fd72e9a030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:49.596 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:49.593+0000 7fe313400640 0 client.26264 ms_handle_reset on v2:172.21.15.133:6838/2526402262 2024-08-31T04:31:49.596 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:49.593+0000 7fe33f9f1740 1 -- 172.21.15.50:0/2144476772 >> 172.21.15.50:0/2144476772 conn(0x55fd72ad7300 msgr2=0x55fd72e905a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:31:49.597 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:49.593+0000 7fe33f9f1740 1 -- 172.21.15.50:0/2144476772 shutdown_connections 2024-08-31T04:31:49.597 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:49.593+0000 7fe33f9f1740 1 -- 172.21.15.50:0/2144476772 wait complete. 2024-08-31T04:31:49.597 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:49.593+0000 7fe33f9f1740 20 client.26264 trim_cache size 0 max 16384 2024-08-31T04:31:49.597 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout:{ 2024-08-31T04:31:49.597 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout: "message": "", 2024-08-31T04:31:49.597 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout: "return_code": 0 2024-08-31T04:31:49.597 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout:} 2024-08-31T04:31:49.598 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:49.593+0000 7fe333200640 1 -- 172.21.15.50:0/1632287904 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fe3180b4bb0 msgr2=0x7fe3180b70c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:31:49.598 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:49.593+0000 7fe333200640 1 --2- 172.21.15.50:0/1632287904 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fe3180b4bb0 0x7fe3180b70c0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fe32c005fd0 tx=0x7fe32c009500 comp rx=0 tx=0).stop 2024-08-31T04:31:49.598 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:49.593+0000 7fe333200640 1 -- 172.21.15.50:0/1632287904 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe33406b4b0 msgr2=0x7fe334103560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:31:49.598 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:49.593+0000 7fe333200640 1 --2- 172.21.15.50:0/1632287904 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe33406b4b0 0x7fe334103560 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fe324006010 tx=0x7fe3240042f0 comp rx=0 tx=0).stop 2024-08-31T04:31:49.598 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:49.593+0000 7fe333200640 1 -- 172.21.15.50:0/1632287904 shutdown_connections 2024-08-31T04:31:49.598 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:49.593+0000 7fe333200640 1 --2- 172.21.15.50:0/1632287904 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fe3180b4bb0 0x7fe3180b70c0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:49.598 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:49.593+0000 7fe333200640 1 --2- 172.21.15.50:0/1632287904 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe334109020 0x7fe334102360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:49.598 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:49.593+0000 7fe333200640 1 --2- 172.21.15.50:0/1632287904 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe334106460 0x7fe334101e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:49.598 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:49.593+0000 7fe333200640 1 --2- 172.21.15.50:0/1632287904 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe33406b4b0 0x7fe334103560 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:31:49.599 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:49.593+0000 7fe333200640 1 -- 172.21.15.50:0/1632287904 >> 172.21.15.50:0/1632287904 conn(0x7fe3340fdb20 msgr2=0x7fe334104970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:31:49.599 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:49.593+0000 7fe333200640 1 -- 172.21.15.50:0/1632287904 shutdown_connections 2024-08-31T04:31:49.599 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:31:49.593+0000 7fe333200640 1 -- 172.21.15.50:0/1632287904 wait complete. 2024-08-31T04:31:49.985 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:31:49 smithi050 ceph-mon[17259]: pgmap v636: 97 pgs: 97 active+clean; 1.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 11 KiB/s wr, 14 op/s 2024-08-31T04:31:49.985 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:31:49 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T04:31:49.996 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:31:49 smithi177 ceph-mon[22025]: pgmap v636: 97 pgs: 97 active+clean; 1.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 11 KiB/s wr, 14 op/s 2024-08-31T04:31:49.996 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:31:49 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T04:31:50.042 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:31:49 smithi133 ceph-mon[22177]: pgmap v636: 97 pgs: 97 active+clean; 1.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 11 KiB/s wr, 14 op/s 2024-08-31T04:31:50.043 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:31:49 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T04:31:50.819 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:31:50 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:31:50.819 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:31:50 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T04:31:50.819 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:31:50 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:31:50.996 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:31:50 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:31:50.996 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:31:50 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T04:31:50.996 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:31:50 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:31:51.043 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:31:50 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:31:51.043 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:31:50 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T04:31:51.043 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:31:50 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:31:51.970 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:31:51 smithi050 ceph-mon[17259]: pgmap v637: 97 pgs: 97 active+clean; 1.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 9.3 KiB/s wr, 11 op/s 2024-08-31T04:31:52.043 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:31:51 smithi133 ceph-mon[22177]: pgmap v637: 97 pgs: 97 active+clean; 1.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 9.3 KiB/s wr, 11 op/s 2024-08-31T04:31:52.246 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:31:51 smithi177 ceph-mon[22025]: pgmap v637: 97 pgs: 97 active+clean; 1.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 9.3 KiB/s wr, 11 op/s 2024-08-31T04:31:53.942 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:31:53 smithi050 ceph-mon[17259]: pgmap v638: 97 pgs: 97 active+clean; 1.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 17 KiB/s wr, 15 op/s 2024-08-31T04:31:54.043 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:31:53 smithi133 ceph-mon[22177]: pgmap v638: 97 pgs: 97 active+clean; 1.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 17 KiB/s wr, 15 op/s 2024-08-31T04:31:54.246 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:31:53 smithi177 ceph-mon[22025]: pgmap v638: 97 pgs: 97 active+clean; 1.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 17 KiB/s wr, 15 op/s 2024-08-31T04:31:54.811 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:31:54 smithi050 ceph-mon[17259]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-31T04:31:54.811 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:31:54 smithi050 ceph-mon[17259]: pgmap v639: 97 pgs: 97 active+clean; 1.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 8.2 KiB/s wr, 9 op/s 2024-08-31T04:31:55.043 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:31:54 smithi133 ceph-mon[22177]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-31T04:31:55.043 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:31:54 smithi133 ceph-mon[22177]: pgmap v639: 97 pgs: 97 active+clean; 1.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 8.2 KiB/s wr, 9 op/s 2024-08-31T04:31:55.246 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:31:54 smithi177 ceph-mon[22025]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-31T04:31:55.246 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:31:54 smithi177 ceph-mon[22025]: pgmap v639: 97 pgs: 97 active+clean; 1.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 8.2 KiB/s wr, 9 op/s 2024-08-31T04:31:57.418 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:31:57 smithi050 ceph-mon[17259]: pgmap v640: 97 pgs: 97 active+clean; 1.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 8.2 KiB/s wr, 10 op/s 2024-08-31T04:31:57.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:31:57 smithi177 ceph-mon[22025]: pgmap v640: 97 pgs: 97 active+clean; 1.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 8.2 KiB/s wr, 10 op/s 2024-08-31T04:31:57.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:31:57 smithi133 ceph-mon[22177]: pgmap v640: 97 pgs: 97 active+clean; 1.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 8.2 KiB/s wr, 10 op/s 2024-08-31T04:31:59.391 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:31:59 smithi050 ceph-mon[17259]: pgmap v641: 97 pgs: 97 active+clean; 1.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 8.2 KiB/s wr, 11 op/s 2024-08-31T04:31:59.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:31:59 smithi177 ceph-mon[22025]: pgmap v641: 97 pgs: 97 active+clean; 1.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 8.2 KiB/s wr, 11 op/s 2024-08-31T04:31:59.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:31:59 smithi133 ceph-mon[22177]: pgmap v641: 97 pgs: 97 active+clean; 1.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 8.2 KiB/s wr, 11 op/s 2024-08-31T04:32:01.327 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:32:01 smithi050 ceph-mon[17259]: pgmap v642: 97 pgs: 97 active+clean; 1.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 8.2 KiB/s wr, 9 op/s 2024-08-31T04:32:01.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:32:01 smithi177 ceph-mon[22025]: pgmap v642: 97 pgs: 97 active+clean; 1.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 8.2 KiB/s wr, 9 op/s 2024-08-31T04:32:01.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:32:01 smithi133 ceph-mon[22177]: pgmap v642: 97 pgs: 97 active+clean; 1.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 8.2 KiB/s wr, 9 op/s 2024-08-31T04:32:02.785 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:02.783+0000 7fe352e00640 1 -- 172.21.15.50:0/2783765021 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe34c076e90 msgr2=0x7fe34c075550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:32:02.785 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:02.783+0000 7fe352e00640 1 --2- 172.21.15.50:0/2783765021 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe34c076e90 0x7fe34c075550 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fe340009900 tx=0x7fe34002a3f0 comp rx=0 tx=0).stop 2024-08-31T04:32:02.786 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:02.783+0000 7fe352e00640 1 -- 172.21.15.50:0/2783765021 shutdown_connections 2024-08-31T04:32:02.786 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:02.783+0000 7fe352e00640 1 --2- 172.21.15.50:0/2783765021 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe34c075a90 0x7fe34c075ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:02.786 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:02.783+0000 7fe352e00640 1 --2- 172.21.15.50:0/2783765021 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe34c10fa00 0x7fe34c111e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:02.786 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:02.783+0000 7fe352e00640 1 --2- 172.21.15.50:0/2783765021 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe34c076e90 0x7fe34c075550 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:02.786 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:02.783+0000 7fe352e00640 1 -- 172.21.15.50:0/2783765021 >> 172.21.15.50:0/2783765021 conn(0x7fe34c0febc0 msgr2=0x7fe34c101070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:32:02.786 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:02.784+0000 7fe352e00640 1 -- 172.21.15.50:0/2783765021 shutdown_connections 2024-08-31T04:32:02.786 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:02.784+0000 7fe352e00640 1 -- 172.21.15.50:0/2783765021 wait complete. 2024-08-31T04:32:02.788 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:02.784+0000 7fe352e00640 1 Processor -- start 2024-08-31T04:32:02.788 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:02.784+0000 7fe352e00640 1 -- start start 2024-08-31T04:32:02.788 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:02.784+0000 7fe352e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe34c075a90 0x7fe34c1a0170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:32:02.788 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:02.784+0000 7fe352e00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe34c076e90 0x7fe34c1a07e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:32:02.788 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:02.784+0000 7fe352e00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe34c10fa00 0x7fe34c1a1390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:32:02.788 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:02.784+0000 7fe352e00640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fe34c1154c0 con 0x7fe34c075a90 2024-08-31T04:32:02.788 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:02.784+0000 7fe352e00640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7fe34c115340 con 0x7fe34c10fa00 2024-08-31T04:32:02.788 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:02.784+0000 7fe352e00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fe34c115640 con 0x7fe34c076e90 2024-08-31T04:32:02.789 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:02.784+0000 7fe351a00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe34c075a90 0x7fe34c1a0170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:32:02.789 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:02.784+0000 7fe351000640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe34c076e90 0x7fe34c1a07e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:32:02.789 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:02.784+0000 7fe351a00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe34c075a90 0x7fe34c1a0170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:51462/0 (socket says 172.21.15.50:51462) 2024-08-31T04:32:02.789 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:02.784+0000 7fe351a00640 1 -- 172.21.15.50:0/2210821387 learned_addr learned my addr 172.21.15.50:0/2210821387 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:32:02.789 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:02.784+0000 7fe352400640 1 --2- 172.21.15.50:0/2210821387 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe34c10fa00 0x7fe34c1a1390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:32:02.789 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:02.784+0000 7fe351a00640 1 -- 172.21.15.50:0/2210821387 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe34c076e90 msgr2=0x7fe34c1a07e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:32:02.789 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:02.784+0000 7fe351a00640 1 --2- 172.21.15.50:0/2210821387 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe34c076e90 0x7fe34c1a07e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:02.789 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:02.784+0000 7fe351a00640 1 -- 172.21.15.50:0/2210821387 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe34c10fa00 msgr2=0x7fe34c1a1390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:32:02.789 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:02.784+0000 7fe351a00640 1 --2- 172.21.15.50:0/2210821387 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe34c10fa00 0x7fe34c1a1390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:02.789 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:02.784+0000 7fe351a00640 1 -- 172.21.15.50:0/2210821387 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe34c1a1bb0 con 0x7fe34c075a90 2024-08-31T04:32:02.789 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:02.784+0000 7fe351a00640 1 --2- 172.21.15.50:0/2210821387 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe34c075a90 0x7fe34c1a0170 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fe340006010 tx=0x7fe3400042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:32:02.789 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:02.784+0000 7fe34a000640 1 -- 172.21.15.50:0/2210821387 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe34003f030 con 0x7fe34c075a90 2024-08-31T04:32:02.790 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:02.784+0000 7fe34a000640 1 -- 172.21.15.50:0/2210821387 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe340031910 con 0x7fe34c075a90 2024-08-31T04:32:02.790 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:02.784+0000 7fe34a000640 1 -- 172.21.15.50:0/2210821387 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe340035070 con 0x7fe34c075a90 2024-08-31T04:32:02.790 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:02.784+0000 7fe352e00640 1 -- 172.21.15.50:0/2210821387 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe34c1a1e40 con 0x7fe34c075a90 2024-08-31T04:32:02.790 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:02.784+0000 7fe352e00640 1 -- 172.21.15.50:0/2210821387 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe34c1a2150 con 0x7fe34c075a90 2024-08-31T04:32:02.791 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:02.790+0000 7fe35b60e740 1 Processor -- start 2024-08-31T04:32:02.791 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:02.790+0000 7fe35b60e740 1 -- start start 2024-08-31T04:32:02.792 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:02.790+0000 7fe35b60e740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5597c28451b0 0x5597c2beafa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:32:02.792 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:02.790+0000 7fe35b60e740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5597c281c2f0 0x5597c2beb610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:32:02.792 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:02.790+0000 7fe35b60e740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5597c28244d0 0x5597c2bec160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:32:02.793 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:02.790+0000 7fe35b60e740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x5597c2b5df70 con 0x5597c28244d0 2024-08-31T04:32:02.793 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:02.790+0000 7fe35b60e740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x5597c2b4d500 con 0x5597c28451b0 2024-08-31T04:32:02.793 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:02.790+0000 7fe35b60e740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x5597c2b514b0 con 0x5597c281c2f0 2024-08-31T04:32:02.793 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:02.790+0000 7fe34a000640 1 -- 172.21.15.50:0/2210821387 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 18) ==== 152577+0+0 (secure 0 0 0) 0x7fe340042030 con 0x7fe34c075a90 2024-08-31T04:32:02.793 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:02.790+0000 7fe351000640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5597c28244d0 0x5597c2bec160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:32:02.793 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:02.790+0000 7fe351000640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5597c28244d0 0x5597c2bec160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:51464/0 (socket says 172.21.15.50:51464) 2024-08-31T04:32:02.793 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:02.790+0000 7fe351000640 1 -- 172.21.15.50:0/612093091 learned_addr learned my addr 172.21.15.50:0/612093091 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:32:02.793 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:02.790+0000 7fe352400640 1 --2- 172.21.15.50:0/612093091 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5597c28451b0 0x5597c2beafa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:32:02.793 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:02.790+0000 7fe351000640 1 -- 172.21.15.50:0/612093091 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5597c281c2f0 msgr2=0x5597c2beb610 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-08-31T04:32:02.793 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:02.790+0000 7fe351000640 1 --2- 172.21.15.50:0/612093091 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5597c281c2f0 0x5597c2beb610 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:02.793 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:02.790+0000 7fe351000640 1 -- 172.21.15.50:0/612093091 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5597c28451b0 msgr2=0x5597c2beafa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:32:02.794 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:02.790+0000 7fe351000640 1 --2- 172.21.15.50:0/612093091 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5597c28451b0 0x5597c2beafa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:02.794 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:02.790+0000 7fe351000640 1 -- 172.21.15.50:0/612093091 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5597c2b07c10 con 0x5597c28244d0 2024-08-31T04:32:02.794 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:02.790+0000 7fe351000640 1 --2- 172.21.15.50:0/612093091 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5597c28244d0 0x5597c2bec160 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7fe338009d20 tx=0x7fe338011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4dfe21dd96f7d65 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:32:02.795 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:02.790+0000 7fe33ea00640 1 -- 172.21.15.50:0/612093091 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe33801e070 con 0x5597c28244d0 2024-08-31T04:32:02.795 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:02.790+0000 7fe33ea00640 1 -- 172.21.15.50:0/612093091 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe338019ae0 con 0x5597c28244d0 2024-08-31T04:32:02.795 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:02.790+0000 7fe33ea00640 1 -- 172.21.15.50:0/612093091 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe33800ea60 con 0x5597c28244d0 2024-08-31T04:32:02.795 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:02.790+0000 7fe34a000640 1 --2- 172.21.15.50:0/2210821387 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fe3340b4b30 0x7fe3340b7040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:32:02.796 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:02.792+0000 7fe34a000640 1 -- 172.21.15.50:0/2210821387 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8219+0+0 (secure 0 0 0) 0x7fe340105660 con 0x7fe34c075a90 2024-08-31T04:32:02.796 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:02.792+0000 7fe352400640 1 --2- 172.21.15.50:0/2210821387 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fe3340b4b30 0x7fe3340b7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:32:02.796 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:02.792+0000 7fe35b60e740 1 -- 172.21.15.50:0/612093091 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5597c28244d0 msgr2=0x5597c2bec160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:32:02.796 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:02.792+0000 7fe35b60e740 1 --2- 172.21.15.50:0/612093091 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5597c28244d0 0x5597c2bec160 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7fe338009d20 tx=0x7fe338011810 comp rx=0 tx=0).stop 2024-08-31T04:32:02.796 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:02.792+0000 7fe35b60e740 1 -- 172.21.15.50:0/612093091 shutdown_connections 2024-08-31T04:32:02.796 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:02.792+0000 7fe35b60e740 1 --2- 172.21.15.50:0/612093091 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5597c281c2f0 0x5597c2beb610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:02.796 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:02.792+0000 7fe35b60e740 1 --2- 172.21.15.50:0/612093091 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5597c28244d0 0x5597c2bec160 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:02.796 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:02.792+0000 7fe35b60e740 1 --2- 172.21.15.50:0/612093091 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5597c28451b0 0x5597c2beafa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:02.796 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:02.792+0000 7fe35b60e740 1 -- 172.21.15.50:0/612093091 >> 172.21.15.50:0/612093091 conn(0x5597c2839300 msgr2=0x5597c2be6a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:32:02.796 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:02.792+0000 7fe35b60e740 1 -- 172.21.15.50:0/612093091 shutdown_connections 2024-08-31T04:32:02.796 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:02.792+0000 7fe35b60e740 1 -- 172.21.15.50:0/612093091 wait complete. 2024-08-31T04:32:02.796 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:02.792+0000 7fe352400640 1 --2- 172.21.15.50:0/2210821387 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fe3340b4b30 0x7fe3340b7040 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fe344005fd0 tx=0x7fe344009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:32:02.796 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:02.792+0000 7fe35b60e740 1 -- start start 2024-08-31T04:32:02.799 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:02.792+0000 7fe35b60e740 1 Processor -- start 2024-08-31T04:32:02.799 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:02.792+0000 7fe35b60e740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5597c281c2f0 0x5597c2bf4690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:32:02.799 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:02.792+0000 7fe35b60e740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5597c28244d0 0x5597c2bf4d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:32:02.799 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:02.792+0000 7fe35b60e740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5597c28451b0 0x5597c2bf58c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:32:02.799 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:02.792+0000 7fe35b60e740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x5597c2a86ab0 con 0x5597c28451b0 2024-08-31T04:32:02.799 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:02.792+0000 7fe35b60e740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x5597c2af4320 con 0x5597c281c2f0 2024-08-31T04:32:02.800 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:02.792+0000 7fe35b60e740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x5597c2becc80 con 0x5597c28244d0 2024-08-31T04:32:02.800 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:02.792+0000 7fe35b60e740 10 client.0 _ll_register_callbacks cb 0x5597c2afa6a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:32:02.800 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:02.792+0000 7fe351000640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5597c28244d0 0x5597c2bf4d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:32:02.800 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:02.792+0000 7fe351000640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5597c28244d0 0x5597c2bf4d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.50:33368/0 (socket says 172.21.15.50:33368) 2024-08-31T04:32:02.800 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:02.792+0000 7fe351000640 1 -- 172.21.15.50:0/3709129791 learned_addr learned my addr 172.21.15.50:0/3709129791 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:32:02.800 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:02.792+0000 7fe351a00640 1 --2- 172.21.15.50:0/3709129791 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5597c281c2f0 0x5597c2bf4690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:32:02.800 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:02.792+0000 7fe352400640 1 --2- 172.21.15.50:0/3709129791 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5597c28451b0 0x5597c2bf58c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:32:02.800 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:02.792+0000 7fe351a00640 1 -- 172.21.15.50:0/3709129791 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5597c28244d0 msgr2=0x5597c2bf4d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:32:02.800 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:02.792+0000 7fe351a00640 1 --2- 172.21.15.50:0/3709129791 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5597c28244d0 0x5597c2bf4d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:02.800 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:02.792+0000 7fe351a00640 1 -- 172.21.15.50:0/3709129791 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5597c28451b0 msgr2=0x5597c2bf58c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:32:02.800 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:02.792+0000 7fe351a00640 1 --2- 172.21.15.50:0/3709129791 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5597c28451b0 0x5597c2bf58c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:02.800 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:02.792+0000 7fe351a00640 1 -- 172.21.15.50:0/3709129791 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5597c28b0790 con 0x5597c281c2f0 2024-08-31T04:32:02.801 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:02.792+0000 7fe351a00640 1 --2- 172.21.15.50:0/3709129791 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5597c281c2f0 0x5597c2bf4690 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fe340103110 tx=0x7fe3400cb860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=84ffdef2e10edd90 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:32:02.801 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:02.792+0000 7fe333400640 10 client.0 ms_handle_connect on v2:172.21.15.133:3300/0 2024-08-31T04:32:02.801 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:02.792+0000 7fe333400640 1 -- 172.21.15.50:0/3709129791 <== mon.2 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe340049040 con 0x5597c281c2f0 2024-08-31T04:32:02.801 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:02.792+0000 7fe333400640 1 -- 172.21.15.50:0/3709129791 <== mon.2 v2:172.21.15.133:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8219+0+0 (secure 0 0 0) 0x7fe3400c8380 con 0x5597c281c2f0 2024-08-31T04:32:02.801 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:02.792+0000 7fe35b60e740 1 -- 172.21.15.50:0/3709129791 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe338019ae0 con 0x5597c281c2f0 2024-08-31T04:32:02.801 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:02.792+0000 7fe333400640 1 -- 172.21.15.50:0/3709129791 <== mon.2 v2:172.21.15.133:3300/0 3 ==== mon_get_version_reply(handle=1 version=45) ==== 24+0+0 (secure 0 0 0) 0x7fe3400cc0f0 con 0x5597c281c2f0 2024-08-31T04:32:02.801 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:02.792+0000 7fe35b60e740 10 client.26276 fetch_fsmap learned FSMap version 45 2024-08-31T04:32:02.801 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:02.792+0000 7fe35b60e740 1 -- 172.21.15.50:0/3709129791 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,fsmap=45,monmap=4+}) -- 0x5597c2929620 con 0x5597c281c2f0 2024-08-31T04:32:02.801 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:02.792+0000 7fe333400640 1 -- 172.21.15.50:0/3709129791 <== mon.2 v2:172.21.15.133:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe338019ae0 con 0x5597c281c2f0 2024-08-31T04:32:02.802 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:02.792+0000 7fe333400640 1 -- 172.21.15.50:0/3709129791 <== mon.2 v2:172.21.15.133:3300/0 5 ==== fsmap(e 45) ==== 8386+0+0 (secure 0 0 0) 0x7fe3400cb350 con 0x5597c281c2f0 2024-08-31T04:32:02.802 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:02.792+0000 7fe35b60e740 10 client.26276 fetch_fsmap finished waiting for FSMap version 45 2024-08-31T04:32:02.802 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:02.792+0000 7fe35b60e740 10 client.26276 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T04:32:02.802 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:02.792+0000 7fe35b60e740 20 client.26276 populate_metadata read hostname 'smithi050' 2024-08-31T04:32:02.802 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:02.792+0000 7fe35b60e740 1 --2- 172.21.15.50:0/3709129791 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x5597c2803d80 0x5597c2c01d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:32:02.802 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:02.792+0000 7fe35b60e740 4 client.26276 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T04:32:02.802 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:02.792+0000 7fe35b60e740 1 -- 172.21.15.50:0/3709129791 --> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5597c2b5fec0 con 0x5597c2803d80 2024-08-31T04:32:02.802 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:02.792+0000 7fe351000640 1 --2- 172.21.15.50:0/3709129791 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x5597c2803d80 0x5597c2c01d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:32:02.802 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:02.798+0000 7fe351000640 1 --2- 172.21.15.50:0/3709129791 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x5597c2803d80 0x5597c2c01d70 crc :-1 s=READY pgs=126 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2caefcbff5ec00a2 server_cookie=e1a7d2fa9b7ce583 in_seq=0 out_seq=0 2024-08-31T04:32:02.802 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:02.798+0000 7fe333400640 10 client.26276 ms_handle_connect on v2:172.21.15.133:6838/2526402262 2024-08-31T04:32:02.803 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:02.798+0000 7fe333400640 1 -- 172.21.15.50:0/3709129791 <== mds.0 v2:172.21.15.133:6838/2526402262 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5597c2b5fec0 con 0x5597c2803d80 2024-08-31T04:32:02.803 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:02.798+0000 7fe333400640 10 client.26276 handle_command_reply: tid=0 2024-08-31T04:32:02.803 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:02.798+0000 7fe35b60e740 1 client.26276 shutdown 2024-08-31T04:32:02.804 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:02.798+0000 7fe35b60e740 1 -- 172.21.15.50:0/3709129791 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5597c281c2f0 msgr2=0x5597c2bf4690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:32:02.804 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:02.798+0000 7fe35b60e740 1 --2- 172.21.15.50:0/3709129791 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5597c281c2f0 0x5597c2bf4690 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fe340103110 tx=0x7fe3400cb860 comp rx=0 tx=0).stop 2024-08-31T04:32:02.804 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:02.798+0000 7fe35b60e740 1 -- 172.21.15.50:0/3709129791 shutdown_connections 2024-08-31T04:32:02.804 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:02.798+0000 7fe35b60e740 1 --2- 172.21.15.50:0/3709129791 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x5597c2803d80 0x5597c2c01d70 crc :-1 s=READY pgs=126 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:02.804 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:02.798+0000 7fe35b60e740 1 --2- 172.21.15.50:0/3709129791 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5597c28244d0 0x5597c2bf4d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:02.804 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:02.798+0000 7fe35b60e740 1 --2- 172.21.15.50:0/3709129791 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5597c28451b0 0x5597c2bf58c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:02.804 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:02.798+0000 7fe333400640 0 client.26276 ms_handle_reset on v2:172.21.15.133:6838/2526402262 2024-08-31T04:32:02.804 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:02.798+0000 7fe35b60e740 1 --2- 172.21.15.50:0/3709129791 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5597c281c2f0 0x5597c2bf4690 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:02.804 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:02.798+0000 7fe35b60e740 1 -- 172.21.15.50:0/3709129791 >> 172.21.15.50:0/3709129791 conn(0x5597c2839300 msgr2=0x5597c2be4f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:32:02.804 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:02.798+0000 7fe35b60e740 1 -- 172.21.15.50:0/3709129791 shutdown_connections 2024-08-31T04:32:02.804 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:02.798+0000 7fe35b60e740 1 -- 172.21.15.50:0/3709129791 wait complete. 2024-08-31T04:32:02.804 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:02.798+0000 7fe35b60e740 20 client.26276 trim_cache size 0 max 16384 2024-08-31T04:32:02.818 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:02.816+0000 7fe35b60e740 1 Processor -- start 2024-08-31T04:32:02.818 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:02.816+0000 7fe35b60e740 1 -- start start 2024-08-31T04:32:02.820 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:02.816+0000 7fe35b60e740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5597c281c2f0 0x5597c2be4f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:32:02.820 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:02.816+0000 7fe35b60e740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5597c28244d0 0x5597c2be5480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:32:02.820 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:02.816+0000 7fe35b60e740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5597c28451b0 0x5597c2be59c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:32:02.820 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:02.816+0000 7fe35b60e740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fe34c1b1010 con 0x5597c28244d0 2024-08-31T04:32:02.820 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:02.816+0000 7fe35b60e740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7fe34c1b2bb0 con 0x5597c28451b0 2024-08-31T04:32:02.820 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:02.816+0000 7fe35b60e740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fe34c1b16e0 con 0x5597c281c2f0 2024-08-31T04:32:02.820 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:02.816+0000 7fe351000640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5597c28244d0 0x5597c2be5480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:32:02.820 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:02.816+0000 7fe351a00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5597c281c2f0 0x5597c2be4f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:32:02.820 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:02.816+0000 7fe351a00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5597c281c2f0 0x5597c2be4f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.50:33370/0 (socket says 172.21.15.50:33370) 2024-08-31T04:32:02.820 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:02.816+0000 7fe351a00640 1 -- 172.21.15.50:0/1555824826 learned_addr learned my addr 172.21.15.50:0/1555824826 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:32:02.820 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:02.816+0000 7fe352400640 1 --2- 172.21.15.50:0/1555824826 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5597c28451b0 0x5597c2be59c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:32:02.820 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:02.816+0000 7fe351a00640 1 -- 172.21.15.50:0/1555824826 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5597c28451b0 msgr2=0x5597c2be59c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:32:02.821 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:02.816+0000 7fe351a00640 1 --2- 172.21.15.50:0/1555824826 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5597c28451b0 0x5597c2be59c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:02.821 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:02.816+0000 7fe351a00640 1 -- 172.21.15.50:0/1555824826 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5597c28244d0 msgr2=0x5597c2be5480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:32:02.821 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:02.816+0000 7fe351a00640 1 --2- 172.21.15.50:0/1555824826 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5597c28244d0 0x5597c2be5480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:02.821 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:02.816+0000 7fe351a00640 1 -- 172.21.15.50:0/1555824826 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5597c2bf2810 con 0x5597c281c2f0 2024-08-31T04:32:02.821 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:02.816+0000 7fe351a00640 1 --2- 172.21.15.50:0/1555824826 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5597c281c2f0 0x5597c2be4f40 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fe3400cb770 tx=0x7fe3400cb990 comp rx=0 tx=0).ready entity=mon.1 client_cookie=250dc407c14b29f9 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:32:02.822 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:02.816+0000 7fe33e000640 1 -- 172.21.15.50:0/1555824826 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe340049070 con 0x5597c281c2f0 2024-08-31T04:32:02.822 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:02.816+0000 7fe33e000640 1 -- 172.21.15.50:0/1555824826 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe3400d08b0 con 0x5597c281c2f0 2024-08-31T04:32:02.822 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:02.816+0000 7fe33e000640 1 -- 172.21.15.50:0/1555824826 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3400cb350 con 0x5597c281c2f0 2024-08-31T04:32:02.822 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:02.816+0000 7fe35b60e740 1 -- 172.21.15.50:0/1555824826 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5597c281c2f0 msgr2=0x5597c2be4f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:32:02.822 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:02.816+0000 7fe35b60e740 1 --2- 172.21.15.50:0/1555824826 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5597c281c2f0 0x5597c2be4f40 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fe3400cb770 tx=0x7fe3400cb990 comp rx=0 tx=0).stop 2024-08-31T04:32:02.822 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:02.816+0000 7fe35b60e740 1 -- 172.21.15.50:0/1555824826 shutdown_connections 2024-08-31T04:32:02.823 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:02.816+0000 7fe35b60e740 1 --2- 172.21.15.50:0/1555824826 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5597c28451b0 0x5597c2be59c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:02.823 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:02.816+0000 7fe35b60e740 1 --2- 172.21.15.50:0/1555824826 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5597c28244d0 0x5597c2be5480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:02.823 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:02.816+0000 7fe35b60e740 1 --2- 172.21.15.50:0/1555824826 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5597c281c2f0 0x5597c2be4f40 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:02.823 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:02.816+0000 7fe35b60e740 1 -- 172.21.15.50:0/1555824826 >> 172.21.15.50:0/1555824826 conn(0x5597c2839300 msgr2=0x5597c2bebe30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:32:02.823 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:02.816+0000 7fe35b60e740 1 -- 172.21.15.50:0/1555824826 shutdown_connections 2024-08-31T04:32:02.823 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:02.816+0000 7fe35b60e740 1 -- 172.21.15.50:0/1555824826 wait complete. 2024-08-31T04:32:02.823 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:02.816+0000 7fe35b60e740 1 -- start start 2024-08-31T04:32:02.823 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:02.816+0000 7fe35b60e740 1 Processor -- start 2024-08-31T04:32:02.823 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:02.816+0000 7fe35b60e740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5597c281c2f0 0x5597c2bfc170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:32:02.823 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:02.816+0000 7fe35b60e740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5597c28244d0 0x5597c2bfae70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:32:02.825 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:02.816+0000 7fe35b60e740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5597c28451b0 0x5597c2bfb580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:32:02.825 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:02.816+0000 7fe35b60e740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fe34c1b24e0 con 0x5597c281c2f0 2024-08-31T04:32:02.825 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:02.816+0000 7fe35b60e740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7fe34c1b1de0 con 0x5597c28244d0 2024-08-31T04:32:02.825 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:02.816+0000 7fe35b60e740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fe34c1aeff0 con 0x5597c28451b0 2024-08-31T04:32:02.825 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:02.816+0000 7fe35b60e740 10 client.0 _ll_register_callbacks cb 0x7fe3400cbec0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:32:02.825 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:02.816+0000 7fe351a00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5597c281c2f0 0x5597c2bfc170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:32:02.826 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:02.816+0000 7fe351a00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5597c281c2f0 0x5597c2bfc170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:51504/0 (socket says 172.21.15.50:51504) 2024-08-31T04:32:02.826 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:02.816+0000 7fe351a00640 1 -- 172.21.15.50:0/534047937 learned_addr learned my addr 172.21.15.50:0/534047937 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:32:02.826 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:02.816+0000 7fe352400640 1 --2- 172.21.15.50:0/534047937 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5597c28451b0 0x5597c2bfb580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:32:02.826 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:02.816+0000 7fe351000640 1 --2- 172.21.15.50:0/534047937 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5597c28244d0 0x5597c2bfae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:32:02.826 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:02.822+0000 7fe351a00640 1 -- 172.21.15.50:0/534047937 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5597c28451b0 msgr2=0x5597c2bfb580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:32:02.826 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:02.822+0000 7fe351a00640 1 --2- 172.21.15.50:0/534047937 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5597c28451b0 0x5597c2bfb580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:02.826 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:02.822+0000 7fe351a00640 1 -- 172.21.15.50:0/534047937 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5597c28244d0 msgr2=0x5597c2bfae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:32:02.826 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:02.822+0000 7fe351a00640 1 --2- 172.21.15.50:0/534047937 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5597c28244d0 0x5597c2bfae70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:02.826 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:02.822+0000 7fe351a00640 1 -- 172.21.15.50:0/534047937 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5597c2bf9a40 con 0x5597c281c2f0 2024-08-31T04:32:02.826 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:02.822+0000 7fe351a00640 1 --2- 172.21.15.50:0/534047937 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5597c281c2f0 0x5597c2bfc170 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fe34003d040 tx=0x7fe340105270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a00627ef6843481 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:32:02.826 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:02.822+0000 7fe333400640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-08-31T04:32:02.826 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:02.822+0000 7fe333400640 1 -- 172.21.15.50:0/534047937 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe340049070 con 0x5597c281c2f0 2024-08-31T04:32:02.826 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:02.822+0000 7fe333400640 1 -- 172.21.15.50:0/534047937 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8219+0+0 (secure 0 0 0) 0x7fe3400c83f0 con 0x5597c281c2f0 2024-08-31T04:32:02.827 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:02.822+0000 7fe35b60e740 1 -- 172.21.15.50:0/534047937 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe3400d08b0 con 0x5597c281c2f0 2024-08-31T04:32:02.827 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:02.822+0000 7fe333400640 1 -- 172.21.15.50:0/534047937 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=45) ==== 24+0+0 (secure 0 0 0) 0x7fe34003bb40 con 0x5597c281c2f0 2024-08-31T04:32:02.827 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:02.822+0000 7fe35b60e740 10 client.16290 fetch_fsmap learned FSMap version 45 2024-08-31T04:32:02.827 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:02.822+0000 7fe35b60e740 1 -- 172.21.15.50:0/534047937 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=45,monmap=4+}) -- 0x5597c2bf9a40 con 0x5597c281c2f0 2024-08-31T04:32:02.827 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:02.822+0000 7fe333400640 1 -- 172.21.15.50:0/534047937 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe3400d08b0 con 0x5597c281c2f0 2024-08-31T04:32:02.827 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:02.822+0000 7fe333400640 1 -- 172.21.15.50:0/534047937 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 45) ==== 8386+0+0 (secure 0 0 0) 0x7fe3400c7ad0 con 0x5597c281c2f0 2024-08-31T04:32:02.828 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:02.822+0000 7fe35b60e740 10 client.16290 fetch_fsmap finished waiting for FSMap version 45 2024-08-31T04:32:02.828 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:02.822+0000 7fe35b60e740 10 client.16290 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T04:32:02.828 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:02.822+0000 7fe35b60e740 20 client.16290 populate_metadata read hostname 'smithi050' 2024-08-31T04:32:02.828 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:02.822+0000 7fe35b60e740 1 --2- 172.21.15.50:0/534047937 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x5597c27d91c0 0x5597c2c6ef50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:32:02.828 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:02.822+0000 7fe35b60e740 4 client.16290 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-31T04:32:02.828 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:02.822+0000 7fe35b60e740 1 -- 172.21.15.50:0/534047937 --> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5597c2b5b960 con 0x5597c27d91c0 2024-08-31T04:32:02.828 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:02.822+0000 7fe351000640 1 --2- 172.21.15.50:0/534047937 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x5597c27d91c0 0x5597c2c6ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:32:02.828 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:02.822+0000 7fe351000640 1 --2- 172.21.15.50:0/534047937 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x5597c27d91c0 0x5597c2c6ef50 crc :-1 s=READY pgs=127 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3e407ca47e6cf834 server_cookie=6641b2422d36fe36 in_seq=0 out_seq=0 2024-08-31T04:32:02.828 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:02.822+0000 7fe333400640 10 client.16290 ms_handle_connect on v2:172.21.15.133:6838/2526402262 2024-08-31T04:32:02.833 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:02.827+0000 7fe333400640 1 -- 172.21.15.50:0/534047937 <== mds.0 v2:172.21.15.133:6838/2526402262 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5597c2b5b960 con 0x5597c27d91c0 2024-08-31T04:32:02.833 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:02.827+0000 7fe333400640 10 client.16290 handle_command_reply: tid=0 2024-08-31T04:32:02.833 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:02.827+0000 7fe35b60e740 1 client.16290 shutdown 2024-08-31T04:32:02.833 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:02.832+0000 7fe35b60e740 1 -- 172.21.15.50:0/534047937 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5597c281c2f0 msgr2=0x5597c2bfc170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:32:02.834 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:02.832+0000 7fe35b60e740 1 --2- 172.21.15.50:0/534047937 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5597c281c2f0 0x5597c2bfc170 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fe34003d040 tx=0x7fe340105270 comp rx=0 tx=0).stop 2024-08-31T04:32:02.834 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:02.832+0000 7fe35b60e740 1 -- 172.21.15.50:0/534047937 shutdown_connections 2024-08-31T04:32:02.834 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:02.832+0000 7fe35b60e740 1 --2- 172.21.15.50:0/534047937 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x5597c27d91c0 0x5597c2c6ef50 crc :-1 s=READY pgs=127 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:02.834 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:02.832+0000 7fe333400640 0 client.16290 ms_handle_reset on v2:172.21.15.133:6838/2526402262 2024-08-31T04:32:02.834 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:02.832+0000 7fe35b60e740 1 --2- 172.21.15.50:0/534047937 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5597c28451b0 0x5597c2bfb580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:02.834 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:02.832+0000 7fe35b60e740 1 --2- 172.21.15.50:0/534047937 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5597c28244d0 0x5597c2bfae70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:02.834 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:02.832+0000 7fe35b60e740 1 --2- 172.21.15.50:0/534047937 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5597c281c2f0 0x5597c2bfc170 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:02.834 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:02.832+0000 7fe35b60e740 1 -- 172.21.15.50:0/534047937 >> 172.21.15.50:0/534047937 conn(0x5597c2839300 msgr2=0x5597c2bef090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:32:02.834 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:02.832+0000 7fe35b60e740 1 -- 172.21.15.50:0/534047937 shutdown_connections 2024-08-31T04:32:02.834 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:02.832+0000 7fe35b60e740 1 -- 172.21.15.50:0/534047937 wait complete. 2024-08-31T04:32:02.834 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:02.832+0000 7fe35b60e740 20 client.16290 trim_cache size 0 max 16384 2024-08-31T04:32:02.835 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout:{ 2024-08-31T04:32:02.835 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout: "message": "", 2024-08-31T04:32:02.835 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout: "return_code": 0 2024-08-31T04:32:02.835 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout:} 2024-08-31T04:32:02.835 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:02.832+0000 7fe352e00640 1 -- 172.21.15.50:0/2210821387 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fe3340b4b30 msgr2=0x7fe3340b7040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:32:02.835 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:02.832+0000 7fe352e00640 1 --2- 172.21.15.50:0/2210821387 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fe3340b4b30 0x7fe3340b7040 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fe344005fd0 tx=0x7fe344009500 comp rx=0 tx=0).stop 2024-08-31T04:32:02.836 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:02.832+0000 7fe352e00640 1 -- 172.21.15.50:0/2210821387 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe34c075a90 msgr2=0x7fe34c1a0170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:32:02.836 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:02.832+0000 7fe352e00640 1 --2- 172.21.15.50:0/2210821387 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe34c075a90 0x7fe34c1a0170 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fe340006010 tx=0x7fe3400042f0 comp rx=0 tx=0).stop 2024-08-31T04:32:02.836 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:02.832+0000 7fe352e00640 1 -- 172.21.15.50:0/2210821387 shutdown_connections 2024-08-31T04:32:02.836 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:02.832+0000 7fe352e00640 1 --2- 172.21.15.50:0/2210821387 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fe3340b4b30 0x7fe3340b7040 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:02.836 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:02.832+0000 7fe352e00640 1 --2- 172.21.15.50:0/2210821387 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe34c076e90 0x7fe34c1a07e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:02.836 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:02.832+0000 7fe352e00640 1 --2- 172.21.15.50:0/2210821387 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe34c10fa00 0x7fe34c1a1390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:02.837 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:02.832+0000 7fe352e00640 1 --2- 172.21.15.50:0/2210821387 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe34c075a90 0x7fe34c1a0170 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:02.837 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:02.832+0000 7fe352e00640 1 -- 172.21.15.50:0/2210821387 >> 172.21.15.50:0/2210821387 conn(0x7fe34c0febc0 msgr2=0x7fe34c102c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:32:02.837 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:02.832+0000 7fe352e00640 1 -- 172.21.15.50:0/2210821387 shutdown_connections 2024-08-31T04:32:02.837 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:02.832+0000 7fe352e00640 1 -- 172.21.15.50:0/2210821387 wait complete. 2024-08-31T04:32:03.450 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:32:03 smithi050 ceph-mon[17259]: pgmap v643: 97 pgs: 97 active+clean; 1.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 8.2 KiB/s wr, 12 op/s 2024-08-31T04:32:03.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:32:03 smithi177 ceph-mon[22025]: pgmap v643: 97 pgs: 97 active+clean; 1.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 8.2 KiB/s wr, 12 op/s 2024-08-31T04:32:03.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:32:03 smithi133 ceph-mon[22177]: pgmap v643: 97 pgs: 97 active+clean; 1.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 8.2 KiB/s wr, 12 op/s 2024-08-31T04:32:05.411 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:32:05 smithi050 ceph-mon[17259]: pgmap v644: 97 pgs: 97 active+clean; 1.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-08-31T04:32:05.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:32:05 smithi177 ceph-mon[22025]: pgmap v644: 97 pgs: 97 active+clean; 1.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-08-31T04:32:05.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:32:05 smithi133 ceph-mon[22177]: pgmap v644: 97 pgs: 97 active+clean; 1.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-08-31T04:32:07.405 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:32:07 smithi050 ceph-mon[17259]: pgmap v645: 97 pgs: 97 active+clean; 1.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-08-31T04:32:07.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:32:07 smithi177 ceph-mon[22025]: pgmap v645: 97 pgs: 97 active+clean; 1.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-08-31T04:32:07.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:32:07 smithi133 ceph-mon[22177]: pgmap v645: 97 pgs: 97 active+clean; 1.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-08-31T04:32:09.424 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:32:09 smithi050 ceph-mon[17259]: pgmap v646: 97 pgs: 97 active+clean; 1.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 8.1 KiB/s wr, 10 op/s 2024-08-31T04:32:09.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:32:09 smithi177 ceph-mon[22025]: pgmap v646: 97 pgs: 97 active+clean; 1.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 8.1 KiB/s wr, 10 op/s 2024-08-31T04:32:09.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:32:09 smithi133 ceph-mon[22177]: pgmap v646: 97 pgs: 97 active+clean; 1.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 8.1 KiB/s wr, 10 op/s 2024-08-31T04:32:11.359 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:32:11 smithi050 ceph-mon[17259]: pgmap v647: 97 pgs: 97 active+clean; 1.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 8.1 KiB/s wr, 9 op/s 2024-08-31T04:32:11.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:32:11 smithi133 ceph-mon[22177]: pgmap v647: 97 pgs: 97 active+clean; 1.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 8.1 KiB/s wr, 9 op/s 2024-08-31T04:32:11.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:32:11 smithi177 ceph-mon[22025]: pgmap v647: 97 pgs: 97 active+clean; 1.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 8.1 KiB/s wr, 9 op/s 2024-08-31T04:32:12.497 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:32:12 smithi050 ceph-mon[17259]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-31T04:32:12.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:32:12 smithi177 ceph-mon[22025]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-31T04:32:12.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:32:12 smithi133 ceph-mon[22177]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-31T04:32:13.577 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:32:13 smithi050 ceph-mon[17259]: pgmap v648: 97 pgs: 97 active+clean; 1.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 8.1 KiB/s wr, 12 op/s 2024-08-31T04:32:13.647 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:32:13 smithi177 ceph-mon[22025]: pgmap v648: 97 pgs: 97 active+clean; 1.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 8.1 KiB/s wr, 12 op/s 2024-08-31T04:32:13.694 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:32:13 smithi133 ceph-mon[22177]: pgmap v648: 97 pgs: 97 active+clean; 1.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 8.1 KiB/s wr, 12 op/s 2024-08-31T04:32:15.691 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:32:15 smithi050 ceph-mon[17259]: pgmap v649: 97 pgs: 97 active+clean; 1.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 8.1 KiB/s wr, 9 op/s 2024-08-31T04:32:15.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:32:15 smithi177 ceph-mon[22025]: pgmap v649: 97 pgs: 97 active+clean; 1.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 8.1 KiB/s wr, 9 op/s 2024-08-31T04:32:15.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:32:15 smithi133 ceph-mon[22177]: pgmap v649: 97 pgs: 97 active+clean; 1.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 8.1 KiB/s wr, 9 op/s 2024-08-31T04:32:16.031 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:16.029+0000 7fcc35c00640 1 -- 172.21.15.50:0/1929160592 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcc30104ca0 msgr2=0x7fcc3010b640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:32:16.031 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:16.029+0000 7fcc35c00640 1 --2- 172.21.15.50:0/1929160592 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcc30104ca0 0x7fcc3010b640 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fcc28009ca0 tx=0x7fcc2802a8e0 comp rx=0 tx=0).stop 2024-08-31T04:32:16.031 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:16.029+0000 7fcc35c00640 1 -- 172.21.15.50:0/1929160592 shutdown_connections 2024-08-31T04:32:16.031 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:16.029+0000 7fcc35c00640 1 --2- 172.21.15.50:0/1929160592 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcc30104ca0 0x7fcc3010b640 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:16.031 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:16.029+0000 7fcc35c00640 1 --2- 172.21.15.50:0/1929160592 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcc30104300 0x7fcc30104710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:16.031 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:16.029+0000 7fcc35c00640 1 --2- 172.21.15.50:0/1929160592 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcc30103280 0x7fcc301036f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:16.031 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:16.029+0000 7fcc35c00640 1 -- 172.21.15.50:0/1929160592 >> 172.21.15.50:0/1929160592 conn(0x7fcc300febc0 msgr2=0x7fcc30101070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:32:16.031 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:16.029+0000 7fcc35c00640 1 -- 172.21.15.50:0/1929160592 shutdown_connections 2024-08-31T04:32:16.032 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:16.029+0000 7fcc35c00640 1 -- 172.21.15.50:0/1929160592 wait complete. 2024-08-31T04:32:16.033 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:16.030+0000 7fcc35c00640 1 Processor -- start 2024-08-31T04:32:16.033 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:16.030+0000 7fcc35c00640 1 -- start start 2024-08-31T04:32:16.033 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:16.031+0000 7fcc35c00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcc30103280 0x7fcc30076bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:32:16.033 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:16.031+0000 7fcc35c00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcc30104300 0x7fcc300754b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:32:16.033 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:16.031+0000 7fcc35c00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcc30104ca0 0x7fcc300759f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:32:16.033 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:16.031+0000 7fcc35c00640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fcc3010efb0 con 0x7fcc30104ca0 2024-08-31T04:32:16.034 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:16.031+0000 7fcc35c00640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7fcc3010ee30 con 0x7fcc30103280 2024-08-31T04:32:16.034 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:16.031+0000 7fcc35c00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fcc3010f130 con 0x7fcc30104300 2024-08-31T04:32:16.034 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:16.031+0000 7fcc2f400640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcc30104300 0x7fcc300754b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:32:16.034 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:16.031+0000 7fcc35200640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcc30104ca0 0x7fcc300759f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:32:16.034 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:16.031+0000 7fcc2f400640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcc30104300 0x7fcc300754b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.50:48964/0 (socket says 172.21.15.50:48964) 2024-08-31T04:32:16.034 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:16.031+0000 7fcc2f400640 1 -- 172.21.15.50:0/799857130 learned_addr learned my addr 172.21.15.50:0/799857130 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:32:16.034 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:16.031+0000 7fcc2fe00640 1 --2- 172.21.15.50:0/799857130 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcc30103280 0x7fcc30076bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:32:16.034 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:16.031+0000 7fcc2f400640 1 -- 172.21.15.50:0/799857130 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcc30103280 msgr2=0x7fcc30076bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:32:16.034 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:16.031+0000 7fcc2f400640 1 --2- 172.21.15.50:0/799857130 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcc30103280 0x7fcc30076bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:16.034 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:16.031+0000 7fcc2f400640 1 -- 172.21.15.50:0/799857130 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcc30104ca0 msgr2=0x7fcc300759f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:32:16.034 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:16.031+0000 7fcc2f400640 1 --2- 172.21.15.50:0/799857130 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcc30104ca0 0x7fcc300759f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:16.034 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:16.031+0000 7fcc2f400640 1 -- 172.21.15.50:0/799857130 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc30076120 con 0x7fcc30104300 2024-08-31T04:32:16.035 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:16.031+0000 7fcc2f400640 1 --2- 172.21.15.50:0/799857130 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcc30104300 0x7fcc300754b0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fcc1c00b450 tx=0x7fcc1c00b910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:32:16.035 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:16.031+0000 7fcc2cc00640 1 -- 172.21.15.50:0/799857130 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc1c015020 con 0x7fcc30104300 2024-08-31T04:32:16.035 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:16.031+0000 7fcc35c00640 1 -- 172.21.15.50:0/799857130 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcc301a3c00 con 0x7fcc30104300 2024-08-31T04:32:16.035 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:16.031+0000 7fcc2cc00640 1 -- 172.21.15.50:0/799857130 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcc1c011d40 con 0x7fcc30104300 2024-08-31T04:32:16.035 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:16.031+0000 7fcc2cc00640 1 -- 172.21.15.50:0/799857130 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc1c00f340 con 0x7fcc30104300 2024-08-31T04:32:16.035 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:16.031+0000 7fcc35c00640 1 -- 172.21.15.50:0/799857130 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcc301a40f0 con 0x7fcc30104300 2024-08-31T04:32:16.038 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:16.037+0000 7fcc3ddfd740 1 Processor -- start 2024-08-31T04:32:16.038 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:16.037+0000 7fcc3ddfd740 1 -- start start 2024-08-31T04:32:16.040 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:16.037+0000 7fcc3ddfd740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55de808ba1b0 0x55de80c5ffa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:32:16.040 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:16.037+0000 7fcc3ddfd740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55de808912f0 0x55de80c60610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:32:16.040 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:16.037+0000 7fcc3ddfd740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55de808994d0 0x55de80c61160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:32:16.040 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:16.037+0000 7fcc3ddfd740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55de80bd2f70 con 0x55de808ba1b0 2024-08-31T04:32:16.040 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:16.037+0000 7fcc3ddfd740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x55de80bc2500 con 0x55de808912f0 2024-08-31T04:32:16.040 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:16.037+0000 7fcc3ddfd740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x55de80bc64b0 con 0x55de808994d0 2024-08-31T04:32:16.040 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:16.037+0000 7fcc35200640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55de808ba1b0 0x55de80c5ffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:32:16.040 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:16.037+0000 7fcc35200640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55de808ba1b0 0x55de80c5ffa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50728/0 (socket says 172.21.15.50:50728) 2024-08-31T04:32:16.040 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:16.037+0000 7fcc35200640 1 -- 172.21.15.50:0/3617645261 learned_addr learned my addr 172.21.15.50:0/3617645261 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:32:16.040 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:16.037+0000 7fcc2fe00640 1 --2- 172.21.15.50:0/3617645261 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55de808912f0 0x55de80c60610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:32:16.040 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:16.037+0000 7fcc35200640 1 -- 172.21.15.50:0/3617645261 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55de808994d0 msgr2=0x55de80c61160 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-31T04:32:16.040 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:16.037+0000 7fcc35200640 1 --2- 172.21.15.50:0/3617645261 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55de808994d0 0x55de80c61160 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:16.040 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:16.037+0000 7fcc35200640 1 -- 172.21.15.50:0/3617645261 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55de808912f0 msgr2=0x55de80c60610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:32:16.041 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:16.037+0000 7fcc35200640 1 --2- 172.21.15.50:0/3617645261 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55de808912f0 0x55de80c60610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:16.041 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:16.037+0000 7fcc35200640 1 -- 172.21.15.50:0/3617645261 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55de80b7cc10 con 0x55de808ba1b0 2024-08-31T04:32:16.041 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:16.037+0000 7fcc2fe00640 1 --2- 172.21.15.50:0/3617645261 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55de808912f0 0x55de80c60610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:32:16.042 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:16.037+0000 7fcc35200640 1 --2- 172.21.15.50:0/3617645261 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55de808ba1b0 0x55de80c5ffa0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fcc2802aed0 tx=0x7fcc28009a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2d97398d90527d0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:32:16.042 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:16.037+0000 7fcc2cc00640 1 -- 172.21.15.50:0/799857130 <== mon.1 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 18) ==== 152577+0+0 (secure 0 0 0) 0x7fcc1c018020 con 0x7fcc30104300 2024-08-31T04:32:16.042 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:16.037+0000 7fcc25600640 1 -- 172.21.15.50:0/3617645261 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc280319d0 con 0x55de808ba1b0 2024-08-31T04:32:16.042 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:16.037+0000 7fcc25600640 1 -- 172.21.15.50:0/3617645261 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcc28036040 con 0x55de808ba1b0 2024-08-31T04:32:16.042 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:16.037+0000 7fcc25600640 1 -- 172.21.15.50:0/3617645261 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc28004600 con 0x55de808ba1b0 2024-08-31T04:32:16.042 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:16.037+0000 7fcc3ddfd740 1 -- 172.21.15.50:0/3617645261 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55de808ba1b0 msgr2=0x55de80c5ffa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:32:16.042 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:16.037+0000 7fcc3ddfd740 1 --2- 172.21.15.50:0/3617645261 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55de808ba1b0 0x55de80c5ffa0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fcc2802aed0 tx=0x7fcc28009a20 comp rx=0 tx=0).stop 2024-08-31T04:32:16.042 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:16.037+0000 7fcc3ddfd740 1 -- 172.21.15.50:0/3617645261 shutdown_connections 2024-08-31T04:32:16.042 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:16.037+0000 7fcc3ddfd740 1 --2- 172.21.15.50:0/3617645261 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55de808994d0 0x55de80c61160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:16.042 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:16.037+0000 7fcc3ddfd740 1 --2- 172.21.15.50:0/3617645261 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55de808912f0 0x55de80c60610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:16.043 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:16.037+0000 7fcc3ddfd740 1 --2- 172.21.15.50:0/3617645261 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55de808ba1b0 0x55de80c5ffa0 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:16.043 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:16.037+0000 7fcc3ddfd740 1 -- 172.21.15.50:0/3617645261 >> 172.21.15.50:0/3617645261 conn(0x55de808ae300 msgr2=0x55de80c5ba30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:32:16.043 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:16.037+0000 7fcc3ddfd740 1 -- 172.21.15.50:0/3617645261 shutdown_connections 2024-08-31T04:32:16.043 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:16.037+0000 7fcc3ddfd740 1 -- 172.21.15.50:0/3617645261 wait complete. 2024-08-31T04:32:16.043 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:16.037+0000 7fcc3ddfd740 1 -- start start 2024-08-31T04:32:16.045 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:16.037+0000 7fcc3ddfd740 1 Processor -- start 2024-08-31T04:32:16.045 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:16.037+0000 7fcc2cc00640 1 --2- 172.21.15.50:0/799857130 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fcc140b4a40 0x7fcc140b6f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:32:16.045 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:16.037+0000 7fcc2cc00640 1 -- 172.21.15.50:0/799857130 <== mon.1 v2:172.21.15.177:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8219+0+0 (secure 0 0 0) 0x7fcc1c0e4ad0 con 0x7fcc30104300 2024-08-31T04:32:16.045 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:16.042+0000 7fcc3ddfd740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55de808912f0 0x55de80c69630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:32:16.045 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:16.042+0000 7fcc3ddfd740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55de808994d0 0x55de80c69cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:32:16.045 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:16.042+0000 7fcc3ddfd740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55de808ba1b0 0x55de80c6a860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:32:16.045 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:16.042+0000 7fcc3ddfd740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55de80afbab0 con 0x55de808ba1b0 2024-08-31T04:32:16.045 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:16.042+0000 7fcc3ddfd740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x55de80b69320 con 0x55de808994d0 2024-08-31T04:32:16.045 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:16.042+0000 7fcc3ddfd740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x55de80c61c70 con 0x55de808912f0 2024-08-31T04:32:16.045 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:16.042+0000 7fcc3ddfd740 10 client.0 _ll_register_callbacks cb 0x55de80b6f6a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:32:16.045 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:16.042+0000 7fcc35200640 1 --2- 172.21.15.50:0/799857130 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fcc140b4a40 0x7fcc140b6f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:32:16.046 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:16.042+0000 7fcc2f400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55de808994d0 0x55de80c69cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:32:16.046 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:16.042+0000 7fcc2f400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55de808994d0 0x55de80c69cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.50:50918/0 (socket says 172.21.15.50:50918) 2024-08-31T04:32:16.046 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:16.042+0000 7fcc2f400640 1 -- 172.21.15.50:0/3106905394 learned_addr learned my addr 172.21.15.50:0/3106905394 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:32:16.046 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:16.042+0000 7fcc2fe00640 1 --2- 172.21.15.50:0/3106905394 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55de808912f0 0x55de80c69630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:32:16.046 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:16.042+0000 7fcc2f400640 1 -- 172.21.15.50:0/3106905394 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55de808912f0 msgr2=0x55de80c69630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:32:16.046 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:16.042+0000 7fcc2f400640 1 --2- 172.21.15.50:0/3106905394 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55de808912f0 0x55de80c69630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:16.046 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:16.042+0000 7fcc2f400640 1 -- 172.21.15.50:0/3106905394 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55de808ba1b0 msgr2=0x55de80c6a860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:32:16.046 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:16.042+0000 7fcc2f400640 1 --2- 172.21.15.50:0/3106905394 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55de808ba1b0 0x55de80c6a860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:16.046 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:16.042+0000 7fcc2f400640 1 -- 172.21.15.50:0/3106905394 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55de80925790 con 0x55de808994d0 2024-08-31T04:32:16.046 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:16.042+0000 7fcc2fe00640 1 --2- 172.21.15.50:0/3106905394 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55de808912f0 0x55de80c69630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:32:16.046 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:16.042+0000 7fcc35200640 1 --2- 172.21.15.50:0/799857130 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fcc140b4a40 0x7fcc140b6f50 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fcc28009960 tx=0x7fcc2802a8e0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:32:16.046 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:16.042+0000 7fcc2f400640 1 --2- 172.21.15.50:0/3106905394 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55de808994d0 0x55de80c69cf0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fcc1c0a8780 tx=0x7fcc1c0aaf20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=617c64805564393d server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:32:16.046 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:16.042+0000 7fcc1a000640 10 client.0 ms_handle_connect on v2:172.21.15.133:3300/0 2024-08-31T04:32:16.046 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:16.042+0000 7fcc1a000640 1 -- 172.21.15.50:0/3106905394 <== mon.2 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc1c0ab510 con 0x55de808994d0 2024-08-31T04:32:16.047 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:16.042+0000 7fcc3ddfd740 1 -- 172.21.15.50:0/3106905394 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcc28036040 con 0x55de808994d0 2024-08-31T04:32:16.047 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:16.042+0000 7fcc1a000640 1 -- 172.21.15.50:0/3106905394 <== mon.2 v2:172.21.15.133:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8219+0+0 (secure 0 0 0) 0x7fcc1c0ce0b0 con 0x55de808994d0 2024-08-31T04:32:16.047 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:16.042+0000 7fcc1a000640 1 -- 172.21.15.50:0/3106905394 <== mon.2 v2:172.21.15.133:3300/0 3 ==== mon_get_version_reply(handle=1 version=46) ==== 24+0+0 (secure 0 0 0) 0x7fcc1c0afd80 con 0x55de808994d0 2024-08-31T04:32:16.047 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:16.042+0000 7fcc3ddfd740 10 client.26288 fetch_fsmap learned FSMap version 46 2024-08-31T04:32:16.047 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:16.042+0000 7fcc3ddfd740 1 -- 172.21.15.50:0/3106905394 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,fsmap=46,monmap=4+}) -- 0x55de8099e620 con 0x55de808994d0 2024-08-31T04:32:16.049 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:16.042+0000 7fcc1a000640 1 -- 172.21.15.50:0/3106905394 <== mon.2 v2:172.21.15.133:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcc28036040 con 0x55de808994d0 2024-08-31T04:32:16.049 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:16.042+0000 7fcc1a000640 1 -- 172.21.15.50:0/3106905394 <== mon.2 v2:172.21.15.133:3300/0 5 ==== fsmap(e 46) ==== 8382+0+0 (secure 0 0 0) 0x7fcc1c0b43a0 con 0x55de808994d0 2024-08-31T04:32:16.049 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:16.042+0000 7fcc3ddfd740 10 client.26288 fetch_fsmap finished waiting for FSMap version 46 2024-08-31T04:32:16.049 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:16.042+0000 7fcc3ddfd740 10 client.26288 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T04:32:16.049 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:16.042+0000 7fcc3ddfd740 20 client.26288 populate_metadata read hostname 'smithi050' 2024-08-31T04:32:16.049 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:16.042+0000 7fcc3ddfd740 1 --2- 172.21.15.50:0/3106905394 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x55de80878d80 0x55de80c76d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:32:16.049 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:16.042+0000 7fcc3ddfd740 4 client.26288 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T04:32:16.049 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:16.042+0000 7fcc3ddfd740 1 -- 172.21.15.50:0/3106905394 --> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55de80bd4ec0 con 0x55de80878d80 2024-08-31T04:32:16.049 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:16.042+0000 7fcc2fe00640 1 --2- 172.21.15.50:0/3106905394 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x55de80878d80 0x55de80c76d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:32:16.049 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:16.042+0000 7fcc2fe00640 1 --2- 172.21.15.50:0/3106905394 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x55de80878d80 0x55de80c76d50 crc :-1 s=READY pgs=128 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f462e1c6be21e557 server_cookie=3db1a3c53c282a2c in_seq=0 out_seq=0 2024-08-31T04:32:16.049 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:16.042+0000 7fcc1a000640 10 client.26288 ms_handle_connect on v2:172.21.15.133:6838/2526402262 2024-08-31T04:32:16.050 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:16.042+0000 7fcc1a000640 1 -- 172.21.15.50:0/3106905394 <== mds.0 v2:172.21.15.133:6838/2526402262 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55de80bd4ec0 con 0x55de80878d80 2024-08-31T04:32:16.050 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:16.042+0000 7fcc1a000640 10 client.26288 handle_command_reply: tid=0 2024-08-31T04:32:16.050 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:16.042+0000 7fcc3ddfd740 1 client.26288 shutdown 2024-08-31T04:32:16.050 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:16.042+0000 7fcc3ddfd740 1 -- 172.21.15.50:0/3106905394 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55de808994d0 msgr2=0x55de80c69cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:32:16.050 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:16.042+0000 7fcc3ddfd740 1 --2- 172.21.15.50:0/3106905394 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55de808994d0 0x55de80c69cf0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fcc1c0a8780 tx=0x7fcc1c0aaf20 comp rx=0 tx=0).stop 2024-08-31T04:32:16.050 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:16.042+0000 7fcc3ddfd740 1 -- 172.21.15.50:0/3106905394 shutdown_connections 2024-08-31T04:32:16.050 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:16.042+0000 7fcc3ddfd740 1 --2- 172.21.15.50:0/3106905394 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x55de80878d80 0x55de80c76d50 crc :-1 s=READY pgs=128 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:16.050 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:16.042+0000 7fcc3ddfd740 1 --2- 172.21.15.50:0/3106905394 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55de808ba1b0 0x55de80c6a860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:16.050 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:16.042+0000 7fcc3ddfd740 1 --2- 172.21.15.50:0/3106905394 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55de808994d0 0x55de80c69cf0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:16.050 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:16.042+0000 7fcc3ddfd740 1 --2- 172.21.15.50:0/3106905394 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55de808912f0 0x55de80c69630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:16.050 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:16.042+0000 7fcc1a000640 0 client.26288 ms_handle_reset on v2:172.21.15.133:6838/2526402262 2024-08-31T04:32:16.050 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:16.042+0000 7fcc3ddfd740 1 -- 172.21.15.50:0/3106905394 >> 172.21.15.50:0/3106905394 conn(0x55de808ae300 msgr2=0x55de80c59f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:32:16.050 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:16.042+0000 7fcc3ddfd740 1 -- 172.21.15.50:0/3106905394 shutdown_connections 2024-08-31T04:32:16.050 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:16.042+0000 7fcc3ddfd740 1 -- 172.21.15.50:0/3106905394 wait complete. 2024-08-31T04:32:16.051 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:16.047+0000 7fcc3ddfd740 20 client.26288 trim_cache size 0 max 16384 2024-08-31T04:32:16.064 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:16.060+0000 7fcc3ddfd740 1 Processor -- start 2024-08-31T04:32:16.064 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:16.060+0000 7fcc3ddfd740 1 -- start start 2024-08-31T04:32:16.064 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:16.060+0000 7fcc3ddfd740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55de808912f0 0x55de80c64ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:32:16.065 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:16.060+0000 7fcc3ddfd740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55de808994d0 0x55de80c59f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:32:16.065 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:16.060+0000 7fcc3ddfd740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55de808ba1b0 0x55de80c5a480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:32:16.065 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:16.060+0000 7fcc3ddfd740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fcc301accb0 con 0x55de808994d0 2024-08-31T04:32:16.065 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:16.060+0000 7fcc3ddfd740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7fcc301ae850 con 0x55de808912f0 2024-08-31T04:32:16.065 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:16.060+0000 7fcc3ddfd740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fcc301ad380 con 0x55de808ba1b0 2024-08-31T04:32:16.065 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:16.060+0000 7fcc2f400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55de808994d0 0x55de80c59f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:32:16.065 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:16.060+0000 7fcc2fe00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55de808912f0 0x55de80c64ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:32:16.065 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:16.060+0000 7fcc2fe00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55de808912f0 0x55de80c64ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.50:50926/0 (socket says 172.21.15.50:50926) 2024-08-31T04:32:16.065 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:16.060+0000 7fcc2fe00640 1 -- 172.21.15.50:0/1517848817 learned_addr learned my addr 172.21.15.50:0/1517848817 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:32:16.065 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:16.060+0000 7fcc35200640 1 --2- 172.21.15.50:0/1517848817 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55de808ba1b0 0x55de80c5a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:32:16.066 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:16.060+0000 7fcc2fe00640 1 -- 172.21.15.50:0/1517848817 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55de808ba1b0 msgr2=0x55de80c5a480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:32:16.067 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:16.060+0000 7fcc2fe00640 1 --2- 172.21.15.50:0/1517848817 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55de808ba1b0 0x55de80c5a480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:16.067 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:16.060+0000 7fcc2fe00640 1 -- 172.21.15.50:0/1517848817 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55de808994d0 msgr2=0x55de80c59f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:32:16.067 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:16.060+0000 7fcc2fe00640 1 --2- 172.21.15.50:0/1517848817 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55de808994d0 0x55de80c59f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:16.067 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:16.060+0000 7fcc2fe00640 1 -- 172.21.15.50:0/1517848817 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55de80c57190 con 0x55de808912f0 2024-08-31T04:32:16.067 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:16.060+0000 7fcc2fe00640 1 --2- 172.21.15.50:0/1517848817 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55de808912f0 0x55de80c64ab0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x55de80c77460 tx=0x7fcc20005f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7fd6447e18fe5371 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:32:16.067 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:16.060+0000 7fcc24c00640 1 -- 172.21.15.50:0/1517848817 <== mon.2 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc20005020 con 0x55de808912f0 2024-08-31T04:32:16.067 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:16.060+0000 7fcc24c00640 1 -- 172.21.15.50:0/1517848817 <== mon.2 v2:172.21.15.133:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcc2000f840 con 0x55de808912f0 2024-08-31T04:32:16.067 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:16.060+0000 7fcc24c00640 1 -- 172.21.15.50:0/1517848817 <== mon.2 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc20004a00 con 0x55de808912f0 2024-08-31T04:32:16.067 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:16.065+0000 7fcc3ddfd740 1 -- 172.21.15.50:0/1517848817 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55de808912f0 msgr2=0x55de80c64ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:32:16.067 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:16.065+0000 7fcc3ddfd740 1 --2- 172.21.15.50:0/1517848817 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55de808912f0 0x55de80c64ab0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x55de80c77460 tx=0x7fcc20005f90 comp rx=0 tx=0).stop 2024-08-31T04:32:16.068 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:16.065+0000 7fcc3ddfd740 1 -- 172.21.15.50:0/1517848817 shutdown_connections 2024-08-31T04:32:16.068 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:16.065+0000 7fcc3ddfd740 1 --2- 172.21.15.50:0/1517848817 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55de808ba1b0 0x55de80c5a480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:16.068 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:16.065+0000 7fcc3ddfd740 1 --2- 172.21.15.50:0/1517848817 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55de808994d0 0x55de80c59f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:16.068 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:16.065+0000 7fcc3ddfd740 1 --2- 172.21.15.50:0/1517848817 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55de808912f0 0x55de80c64ab0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:16.068 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:16.065+0000 7fcc3ddfd740 1 -- 172.21.15.50:0/1517848817 >> 172.21.15.50:0/1517848817 conn(0x55de808ae300 msgr2=0x55de80c67a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:32:16.068 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:16.065+0000 7fcc3ddfd740 1 -- 172.21.15.50:0/1517848817 shutdown_connections 2024-08-31T04:32:16.068 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:16.065+0000 7fcc3ddfd740 1 -- 172.21.15.50:0/1517848817 wait complete. 2024-08-31T04:32:16.068 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:16.065+0000 7fcc3ddfd740 1 -- start start 2024-08-31T04:32:16.070 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:16.065+0000 7fcc3ddfd740 1 Processor -- start 2024-08-31T04:32:16.070 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:16.065+0000 7fcc3ddfd740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55de808912f0 0x55de80c70e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:32:16.070 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:16.065+0000 7fcc3ddfd740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55de808994d0 0x55de80c6fb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:32:16.070 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:16.065+0000 7fcc3ddfd740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55de808ba1b0 0x55de80c700b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:32:16.070 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:16.065+0000 7fcc3ddfd740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fcc301ae180 con 0x55de808ba1b0 2024-08-31T04:32:16.070 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:16.065+0000 7fcc3ddfd740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7fcc301ada80 con 0x55de808994d0 2024-08-31T04:32:16.071 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:16.065+0000 7fcc3ddfd740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fcc301aac90 con 0x55de808912f0 2024-08-31T04:32:16.071 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:16.065+0000 7fcc3ddfd740 10 client.0 _ll_register_callbacks cb 0x7fcc1c010fa0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:32:16.071 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:16.065+0000 7fcc35200640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55de808ba1b0 0x55de80c700b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:32:16.071 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:16.065+0000 7fcc35200640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55de808ba1b0 0x55de80c700b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50770/0 (socket says 172.21.15.50:50770) 2024-08-31T04:32:16.071 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:16.065+0000 7fcc35200640 1 -- 172.21.15.50:0/1887644772 learned_addr learned my addr 172.21.15.50:0/1887644772 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:32:16.071 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:16.065+0000 7fcc2fe00640 1 --2- 172.21.15.50:0/1887644772 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55de808912f0 0x55de80c70e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:32:16.071 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:16.065+0000 7fcc2f400640 1 --2- 172.21.15.50:0/1887644772 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55de808994d0 0x55de80c6fb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:32:16.071 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:16.065+0000 7fcc35200640 1 -- 172.21.15.50:0/1887644772 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55de808912f0 msgr2=0x55de80c70e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:32:16.071 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:16.065+0000 7fcc35200640 1 --2- 172.21.15.50:0/1887644772 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55de808912f0 0x55de80c70e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:16.071 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:16.065+0000 7fcc35200640 1 -- 172.21.15.50:0/1887644772 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55de808994d0 msgr2=0x55de80c6fb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:32:16.071 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:16.065+0000 7fcc35200640 1 --2- 172.21.15.50:0/1887644772 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55de808994d0 0x55de80c6fb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:16.071 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:16.065+0000 7fcc35200640 1 -- 172.21.15.50:0/1887644772 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55de80c70840 con 0x55de808ba1b0 2024-08-31T04:32:16.071 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:16.065+0000 7fcc35200640 1 --2- 172.21.15.50:0/1887644772 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55de808ba1b0 0x55de80c700b0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fcc2802aed0 tx=0x7fcc28009a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a4ffc11691e2afa server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:32:16.071 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:16.065+0000 7fcc1a000640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-08-31T04:32:16.072 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:16.065+0000 7fcc1a000640 1 -- 172.21.15.50:0/1887644772 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc28060060 con 0x55de808ba1b0 2024-08-31T04:32:16.072 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:16.065+0000 7fcc1a000640 1 -- 172.21.15.50:0/1887644772 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8219+0+0 (secure 0 0 0) 0x7fcc28004720 con 0x55de808ba1b0 2024-08-31T04:32:16.072 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:16.065+0000 7fcc3ddfd740 1 -- 172.21.15.50:0/1887644772 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcc2000f840 con 0x55de808ba1b0 2024-08-31T04:32:16.072 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:16.065+0000 7fcc1a000640 1 -- 172.21.15.50:0/1887644772 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=46) ==== 24+0+0 (secure 0 0 0) 0x7fcc28003e20 con 0x55de808ba1b0 2024-08-31T04:32:16.072 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:16.065+0000 7fcc3ddfd740 10 client.16305 fetch_fsmap learned FSMap version 46 2024-08-31T04:32:16.072 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:16.065+0000 7fcc3ddfd740 1 -- 172.21.15.50:0/1887644772 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=46,monmap=4+}) -- 0x55de80ce16c0 con 0x55de808ba1b0 2024-08-31T04:32:16.072 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:16.065+0000 7fcc1a000640 1 -- 172.21.15.50:0/1887644772 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcc2000f840 con 0x55de808ba1b0 2024-08-31T04:32:16.072 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:16.065+0000 7fcc1a000640 1 -- 172.21.15.50:0/1887644772 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 46) ==== 8382+0+0 (secure 0 0 0) 0x7fcc28043070 con 0x55de808ba1b0 2024-08-31T04:32:16.072 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:16.065+0000 7fcc3ddfd740 10 client.16305 fetch_fsmap finished waiting for FSMap version 46 2024-08-31T04:32:16.072 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:16.065+0000 7fcc3ddfd740 10 client.16305 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T04:32:16.072 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:16.065+0000 7fcc3ddfd740 20 client.16305 populate_metadata read hostname 'smithi050' 2024-08-31T04:32:16.072 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:16.065+0000 7fcc3ddfd740 1 --2- 172.21.15.50:0/1887644772 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x55de8084e1c0 0x55de80ce3bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:32:16.072 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:16.065+0000 7fcc3ddfd740 4 client.16305 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-31T04:32:16.072 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:16.065+0000 7fcc3ddfd740 1 -- 172.21.15.50:0/1887644772 --> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55de80bd0960 con 0x55de8084e1c0 2024-08-31T04:32:16.072 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:16.065+0000 7fcc2fe00640 1 --2- 172.21.15.50:0/1887644772 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x55de8084e1c0 0x55de80ce3bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:32:16.073 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:16.065+0000 7fcc1a000640 10 client.16305 ms_handle_connect on v2:172.21.15.133:6838/2526402262 2024-08-31T04:32:16.073 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:16.065+0000 7fcc2fe00640 1 --2- 172.21.15.50:0/1887644772 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x55de8084e1c0 0x55de80ce3bb0 crc :-1 s=READY pgs=129 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=532e3654312a0c33 server_cookie=d72073584a6b0e3d in_seq=0 out_seq=0 2024-08-31T04:32:16.082 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:16.078+0000 7fcc1a000640 1 -- 172.21.15.50:0/1887644772 <== mds.0 v2:172.21.15.133:6838/2526402262 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55de80bd0960 con 0x55de8084e1c0 2024-08-31T04:32:16.082 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:16.078+0000 7fcc1a000640 10 client.16305 handle_command_reply: tid=0 2024-08-31T04:32:16.082 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:16.078+0000 7fcc3ddfd740 1 client.16305 shutdown 2024-08-31T04:32:16.082 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:16.078+0000 7fcc3ddfd740 1 -- 172.21.15.50:0/1887644772 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55de808ba1b0 msgr2=0x55de80c700b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:32:16.082 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:16.078+0000 7fcc3ddfd740 1 --2- 172.21.15.50:0/1887644772 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55de808ba1b0 0x55de80c700b0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fcc2802aed0 tx=0x7fcc28009a20 comp rx=0 tx=0).stop 2024-08-31T04:32:16.082 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:16.078+0000 7fcc3ddfd740 1 -- 172.21.15.50:0/1887644772 shutdown_connections 2024-08-31T04:32:16.082 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:16.078+0000 7fcc3ddfd740 1 --2- 172.21.15.50:0/1887644772 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x55de8084e1c0 0x55de80ce3bb0 crc :-1 s=READY pgs=129 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:16.082 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:16.078+0000 7fcc3ddfd740 1 --2- 172.21.15.50:0/1887644772 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55de808ba1b0 0x55de80c700b0 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:16.082 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:16.078+0000 7fcc3ddfd740 1 --2- 172.21.15.50:0/1887644772 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55de808994d0 0x55de80c6fb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:16.082 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:16.078+0000 7fcc3ddfd740 1 --2- 172.21.15.50:0/1887644772 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55de808912f0 0x55de80c70e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:16.082 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:16.078+0000 7fcc3ddfd740 1 -- 172.21.15.50:0/1887644772 >> 172.21.15.50:0/1887644772 conn(0x55de808ae300 msgr2=0x55de80c64880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:32:16.083 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:16.078+0000 7fcc1a000640 0 client.16305 ms_handle_reset on v2:172.21.15.133:6838/2526402262 2024-08-31T04:32:16.083 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:16.078+0000 7fcc3ddfd740 1 -- 172.21.15.50:0/1887644772 shutdown_connections 2024-08-31T04:32:16.083 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:16.078+0000 7fcc3ddfd740 1 -- 172.21.15.50:0/1887644772 wait complete. 2024-08-31T04:32:16.083 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:16.078+0000 7fcc3ddfd740 20 client.16305 trim_cache size 0 max 16384 2024-08-31T04:32:16.083 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout:{ 2024-08-31T04:32:16.083 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout: "message": "", 2024-08-31T04:32:16.083 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout: "return_code": 0 2024-08-31T04:32:16.083 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout:} 2024-08-31T04:32:16.084 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:16.078+0000 7fcc35c00640 1 -- 172.21.15.50:0/799857130 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fcc140b4a40 msgr2=0x7fcc140b6f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:32:16.084 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:16.078+0000 7fcc35c00640 1 --2- 172.21.15.50:0/799857130 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fcc140b4a40 0x7fcc140b6f50 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fcc28009960 tx=0x7fcc2802a8e0 comp rx=0 tx=0).stop 2024-08-31T04:32:16.084 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:16.078+0000 7fcc35c00640 1 -- 172.21.15.50:0/799857130 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcc30104300 msgr2=0x7fcc300754b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:32:16.084 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:16.078+0000 7fcc35c00640 1 --2- 172.21.15.50:0/799857130 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcc30104300 0x7fcc300754b0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fcc1c00b450 tx=0x7fcc1c00b910 comp rx=0 tx=0).stop 2024-08-31T04:32:16.084 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:16.078+0000 7fcc35c00640 1 -- 172.21.15.50:0/799857130 shutdown_connections 2024-08-31T04:32:16.085 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:16.078+0000 7fcc35c00640 1 --2- 172.21.15.50:0/799857130 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fcc140b4a40 0x7fcc140b6f50 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:16.085 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:16.078+0000 7fcc35c00640 1 --2- 172.21.15.50:0/799857130 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcc30104300 0x7fcc300754b0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:16.085 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:16.078+0000 7fcc35c00640 1 --2- 172.21.15.50:0/799857130 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcc30104ca0 0x7fcc300759f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:16.085 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:16.078+0000 7fcc35c00640 1 --2- 172.21.15.50:0/799857130 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcc30103280 0x7fcc30076bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:16.085 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:16.078+0000 7fcc35c00640 1 -- 172.21.15.50:0/799857130 >> 172.21.15.50:0/799857130 conn(0x7fcc300febc0 msgr2=0x7fcc30107620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:32:16.085 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:16.078+0000 7fcc35c00640 1 -- 172.21.15.50:0/799857130 shutdown_connections 2024-08-31T04:32:16.085 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:16.078+0000 7fcc35c00640 1 -- 172.21.15.50:0/799857130 wait complete. 2024-08-31T04:32:17.374 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:32:17 smithi050 ceph-mon[17259]: pgmap v650: 97 pgs: 97 active+clean; 1.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 8.1 KiB/s wr, 10 op/s 2024-08-31T04:32:17.374 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:32:17 smithi050 ceph-mon[17259]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-31T04:32:17.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:32:17 smithi177 ceph-mon[22025]: pgmap v650: 97 pgs: 97 active+clean; 1.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 8.1 KiB/s wr, 10 op/s 2024-08-31T04:32:17.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:32:17 smithi177 ceph-mon[22025]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-31T04:32:17.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:32:17 smithi133 ceph-mon[22177]: pgmap v650: 97 pgs: 97 active+clean; 1.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 8.1 KiB/s wr, 10 op/s 2024-08-31T04:32:17.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:32:17 smithi133 ceph-mon[22177]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-31T04:32:19.607 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:32:19 smithi050 ceph-mon[17259]: pgmap v651: 97 pgs: 97 active+clean; 1.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 16 KiB/s wr, 11 op/s 2024-08-31T04:32:19.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:32:19 smithi177 ceph-mon[22025]: pgmap v651: 97 pgs: 97 active+clean; 1.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 16 KiB/s wr, 11 op/s 2024-08-31T04:32:19.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:32:19 smithi133 ceph-mon[22177]: pgmap v651: 97 pgs: 97 active+clean; 1.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 16 KiB/s wr, 11 op/s 2024-08-31T04:32:20.464 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:32:20 smithi050 ceph-mon[17259]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-31T04:32:20.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:32:20 smithi177 ceph-mon[22025]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-31T04:32:20.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:32:20 smithi133 ceph-mon[22177]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-31T04:32:21.625 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:32:21 smithi050 ceph-mon[17259]: pgmap v652: 97 pgs: 97 active+clean; 1.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8.1 KiB/s wr, 9 op/s 2024-08-31T04:32:21.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:32:21 smithi177 ceph-mon[22025]: pgmap v652: 97 pgs: 97 active+clean; 1.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8.1 KiB/s wr, 9 op/s 2024-08-31T04:32:21.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:32:21 smithi133 ceph-mon[22177]: pgmap v652: 97 pgs: 97 active+clean; 1.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8.1 KiB/s wr, 9 op/s 2024-08-31T04:32:22.450 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:32:22 smithi050 ceph-mon[17259]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-31T04:32:22.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:32:22 smithi177 ceph-mon[22025]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-31T04:32:22.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:32:22 smithi133 ceph-mon[22177]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-31T04:32:23.549 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:32:23 smithi050 ceph-mon[17259]: pgmap v653: 97 pgs: 97 active+clean; 1.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 8.7 KiB/s wr, 12 op/s 2024-08-31T04:32:23.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:32:23 smithi177 ceph-mon[22025]: pgmap v653: 97 pgs: 97 active+clean; 1.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 8.7 KiB/s wr, 12 op/s 2024-08-31T04:32:23.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:32:23 smithi133 ceph-mon[22177]: pgmap v653: 97 pgs: 97 active+clean; 1.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 8.7 KiB/s wr, 12 op/s 2024-08-31T04:32:25.555 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:32:25 smithi050 ceph-mon[17259]: pgmap v654: 97 pgs: 97 active+clean; 1.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 8.7 KiB/s wr, 9 op/s 2024-08-31T04:32:25.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:32:25 smithi177 ceph-mon[22025]: pgmap v654: 97 pgs: 97 active+clean; 1.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 8.7 KiB/s wr, 9 op/s 2024-08-31T04:32:25.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:32:25 smithi133 ceph-mon[22177]: pgmap v654: 97 pgs: 97 active+clean; 1.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 8.7 KiB/s wr, 9 op/s 2024-08-31T04:32:27.505 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:32:27 smithi050 ceph-mon[17259]: pgmap v655: 97 pgs: 97 active+clean; 1.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 8.7 KiB/s wr, 10 op/s 2024-08-31T04:32:27.505 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:32:27 smithi050 ceph-mon[17259]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-31T04:32:27.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:32:27 smithi177 ceph-mon[22025]: pgmap v655: 97 pgs: 97 active+clean; 1.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 8.7 KiB/s wr, 10 op/s 2024-08-31T04:32:27.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:32:27 smithi177 ceph-mon[22025]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-31T04:32:27.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:32:27 smithi133 ceph-mon[22177]: pgmap v655: 97 pgs: 97 active+clean; 1.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 8.7 KiB/s wr, 10 op/s 2024-08-31T04:32:27.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:32:27 smithi133 ceph-mon[22177]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-31T04:32:29.275 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:29.272+0000 7fb401400640 1 -- 172.21.15.50:0/2069395338 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb3fc075a90 msgr2=0x7fb3fc075ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:32:29.275 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:29.272+0000 7fb401400640 1 --2- 172.21.15.50:0/2069395338 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb3fc075a90 0x7fb3fc075ea0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fb3e4009900 tx=0x7fb3e402a3f0 comp rx=0 tx=0).stop 2024-08-31T04:32:29.276 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:29.272+0000 7fb401400640 1 -- 172.21.15.50:0/2069395338 shutdown_connections 2024-08-31T04:32:29.276 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:29.272+0000 7fb401400640 1 --2- 172.21.15.50:0/2069395338 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb3fc10b3e0 0x7fb3fc10d890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:29.276 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:29.272+0000 7fb401400640 1 --2- 172.21.15.50:0/2069395338 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb3fc075a90 0x7fb3fc075ea0 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:29.276 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:29.272+0000 7fb401400640 1 --2- 172.21.15.50:0/2069395338 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb3fc076e90 0x7fb3fc075550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:29.276 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:29.272+0000 7fb401400640 1 -- 172.21.15.50:0/2069395338 >> 172.21.15.50:0/2069395338 conn(0x7fb3fc0fed90 msgr2=0x7fb3fc101240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:32:29.276 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:29.272+0000 7fb401400640 1 -- 172.21.15.50:0/2069395338 shutdown_connections 2024-08-31T04:32:29.276 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:29.272+0000 7fb401400640 1 -- 172.21.15.50:0/2069395338 wait complete. 2024-08-31T04:32:29.278 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:29.272+0000 7fb401400640 1 Processor -- start 2024-08-31T04:32:29.278 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:29.272+0000 7fb401400640 1 -- start start 2024-08-31T04:32:29.278 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:29.275+0000 7fb401400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb3fc075a90 0x7fb3fc19bf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:32:29.279 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:29.275+0000 7fb401400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb3fc076e90 0x7fb3fc19c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:32:29.279 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:29.275+0000 7fb401400640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb3fc10b3e0 0x7fb3fc19d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:32:29.279 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:29.275+0000 7fb401400640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fb3fc111280 con 0x7fb3fc076e90 2024-08-31T04:32:29.279 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:29.275+0000 7fb401400640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7fb3fc111100 con 0x7fb3fc075a90 2024-08-31T04:32:29.279 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:29.275+0000 7fb401400640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fb3fc111400 con 0x7fb3fc10b3e0 2024-08-31T04:32:29.279 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:29.275+0000 7fb3f3e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb3fc076e90 0x7fb3fc19c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:32:29.279 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:29.275+0000 7fb3fb200640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb3fc10b3e0 0x7fb3fc19d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:32:29.280 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:29.275+0000 7fb3f3e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb3fc076e90 0x7fb3fc19c5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:46970/0 (socket says 172.21.15.50:46970) 2024-08-31T04:32:29.280 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:29.275+0000 7fb3f3e00640 1 -- 172.21.15.50:0/3879925600 learned_addr learned my addr 172.21.15.50:0/3879925600 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:32:29.280 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:29.275+0000 7fb3f3e00640 1 -- 172.21.15.50:0/3879925600 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb3fc10b3e0 msgr2=0x7fb3fc19d110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:32:29.280 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:29.275+0000 7fb3f3e00640 1 --2- 172.21.15.50:0/3879925600 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb3fc10b3e0 0x7fb3fc19d110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:29.280 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:29.275+0000 7fb3f3e00640 1 -- 172.21.15.50:0/3879925600 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb3fc075a90 msgr2=0x7fb3fc19bf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:32:29.280 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:29.275+0000 7fb3f3e00640 1 --2- 172.21.15.50:0/3879925600 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb3fc075a90 0x7fb3fc19bf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:29.280 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:29.275+0000 7fb3f3e00640 1 -- 172.21.15.50:0/3879925600 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3fc19d930 con 0x7fb3fc076e90 2024-08-31T04:32:29.280 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:29.276+0000 7fb3f3e00640 1 --2- 172.21.15.50:0/3879925600 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb3fc076e90 0x7fb3fc19c5d0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fb3e4006010 tx=0x7fb3e4004340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:32:29.280 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:29.276+0000 7fb3f3400640 1 -- 172.21.15.50:0/3879925600 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3e403f030 con 0x7fb3fc076e90 2024-08-31T04:32:29.280 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:29.276+0000 7fb401400640 1 -- 172.21.15.50:0/3879925600 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb3fc19dbc0 con 0x7fb3fc076e90 2024-08-31T04:32:29.280 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:29.276+0000 7fb401400640 1 -- 172.21.15.50:0/3879925600 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb3fc1a4310 con 0x7fb3fc076e90 2024-08-31T04:32:29.281 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:29.276+0000 7fb3f3400640 1 -- 172.21.15.50:0/3879925600 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb3e4003cb0 con 0x7fb3fc076e90 2024-08-31T04:32:29.281 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:29.276+0000 7fb3f3400640 1 -- 172.21.15.50:0/3879925600 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3e4035070 con 0x7fb3fc076e90 2024-08-31T04:32:29.282 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:29.280+0000 7fb3f3400640 1 -- 172.21.15.50:0/3879925600 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 18) ==== 152577+0+0 (secure 0 0 0) 0x7fb3e4042030 con 0x7fb3fc076e90 2024-08-31T04:32:29.282 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:29.280+0000 7fb40842e740 1 Processor -- start 2024-08-31T04:32:29.282 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:29.280+0000 7fb40842e740 1 -- start start 2024-08-31T04:32:29.284 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:29.280+0000 7fb40842e740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5583fdf461b0 0x5583fe2ebb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:32:29.284 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:29.280+0000 7fb40842e740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5583fdf1d2f0 0x5583fe2ec1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:32:29.284 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:29.280+0000 7fb40842e740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5583fdf254d0 0x5583fe2eccf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:32:29.284 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:29.280+0000 7fb40842e740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x5583fe25ef70 con 0x5583fdf461b0 2024-08-31T04:32:29.284 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:29.280+0000 7fb40842e740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x5583fe24e500 con 0x5583fdf254d0 2024-08-31T04:32:29.285 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:29.280+0000 7fb40842e740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x5583fe2524b0 con 0x5583fdf1d2f0 2024-08-31T04:32:29.285 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:29.280+0000 7fb3fb200640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5583fdf461b0 0x5583fe2ebb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:32:29.285 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:29.280+0000 7fb3fb200640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5583fdf461b0 0x5583fe2ebb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:46978/0 (socket says 172.21.15.50:46978) 2024-08-31T04:32:29.285 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:29.280+0000 7fb3fb200640 1 -- 172.21.15.50:0/3012338658 learned_addr learned my addr 172.21.15.50:0/3012338658 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:32:29.285 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:29.282+0000 7fb3fa800640 1 --2- 172.21.15.50:0/3012338658 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5583fdf1d2f0 0x5583fe2ec1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:32:29.285 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:29.282+0000 7fb3fb200640 1 -- 172.21.15.50:0/3012338658 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5583fdf1d2f0 msgr2=0x5583fe2ec1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:32:29.285 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:29.282+0000 7fb3fb200640 1 --2- 172.21.15.50:0/3012338658 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5583fdf1d2f0 0x5583fe2ec1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:29.285 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:29.282+0000 7fb3fb200640 1 -- 172.21.15.50:0/3012338658 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5583fdf254d0 msgr2=0x5583fe2eccf0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-08-31T04:32:29.285 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:29.282+0000 7fb3fb200640 1 --2- 172.21.15.50:0/3012338658 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5583fdf254d0 0x5583fe2eccf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:29.285 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:29.282+0000 7fb3fb200640 1 -- 172.21.15.50:0/3012338658 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5583fe208c10 con 0x5583fdf461b0 2024-08-31T04:32:29.285 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:29.282+0000 7fb3f3400640 1 --2- 172.21.15.50:0/3879925600 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fb3e00b4bb0 0x7fb3e00b70c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:32:29.285 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:29.282+0000 7fb3fb200640 1 --2- 172.21.15.50:0/3012338658 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5583fdf461b0 0x5583fe2ebb30 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fb3f40039f0 tx=0x7fb3f4003eb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c79f408a3228b0f server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:32:29.286 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:29.282+0000 7fb3f3400640 1 -- 172.21.15.50:0/3879925600 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8219+0+0 (secure 0 0 0) 0x7fb3e41057b0 con 0x7fb3fc076e90 2024-08-31T04:32:29.290 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:29.282+0000 7fb3fa800640 1 --2- 172.21.15.50:0/3879925600 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fb3e00b4bb0 0x7fb3e00b70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:32:29.290 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:29.282+0000 7fb3eb400640 1 -- 172.21.15.50:0/3012338658 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3f401a470 con 0x5583fdf461b0 2024-08-31T04:32:29.290 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:29.282+0000 7fb3eb400640 1 -- 172.21.15.50:0/3012338658 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb3f4015070 con 0x5583fdf461b0 2024-08-31T04:32:29.290 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:29.282+0000 7fb3eb400640 1 -- 172.21.15.50:0/3012338658 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3f40107e0 con 0x5583fdf461b0 2024-08-31T04:32:29.290 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:29.282+0000 7fb40842e740 1 -- 172.21.15.50:0/3012338658 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5583fdf461b0 msgr2=0x5583fe2ebb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:32:29.290 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:29.282+0000 7fb40842e740 1 --2- 172.21.15.50:0/3012338658 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5583fdf461b0 0x5583fe2ebb30 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fb3f40039f0 tx=0x7fb3f4003eb0 comp rx=0 tx=0).stop 2024-08-31T04:32:29.290 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:29.282+0000 7fb3fa800640 1 --2- 172.21.15.50:0/3879925600 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fb3e00b4bb0 0x7fb3e00b70c0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fb3ec005d00 tx=0x7fb3ec005f30 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:32:29.290 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:29.284+0000 7fb40842e740 1 -- 172.21.15.50:0/3012338658 shutdown_connections 2024-08-31T04:32:29.290 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:29.284+0000 7fb40842e740 1 --2- 172.21.15.50:0/3012338658 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5583fdf1d2f0 0x5583fe2ec1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:29.290 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:29.284+0000 7fb40842e740 1 --2- 172.21.15.50:0/3012338658 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5583fdf254d0 0x5583fe2eccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:29.291 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:29.284+0000 7fb40842e740 1 --2- 172.21.15.50:0/3012338658 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5583fdf461b0 0x5583fe2ebb30 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:29.291 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:29.284+0000 7fb40842e740 1 -- 172.21.15.50:0/3012338658 >> 172.21.15.50:0/3012338658 conn(0x5583fdf3a300 msgr2=0x5583fe2e75c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:32:29.291 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:29.284+0000 7fb40842e740 1 -- 172.21.15.50:0/3012338658 shutdown_connections 2024-08-31T04:32:29.291 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:29.284+0000 7fb40842e740 1 -- 172.21.15.50:0/3012338658 wait complete. 2024-08-31T04:32:29.291 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:29.284+0000 7fb40842e740 1 -- start start 2024-08-31T04:32:29.291 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:29.284+0000 7fb40842e740 1 Processor -- start 2024-08-31T04:32:29.291 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:29.284+0000 7fb40842e740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5583fdf1d2f0 0x5583fe2f52d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:32:29.291 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:29.284+0000 7fb40842e740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5583fdf254d0 0x5583fe2f5990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:32:29.291 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:29.284+0000 7fb40842e740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5583fdf461b0 0x5583fe2f6500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:32:29.291 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:29.284+0000 7fb40842e740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x5583fe187ab0 con 0x5583fdf461b0 2024-08-31T04:32:29.291 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:29.284+0000 7fb40842e740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x5583fe1f5320 con 0x5583fdf1d2f0 2024-08-31T04:32:29.291 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:29.284+0000 7fb40842e740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x5583fe2ed860 con 0x5583fdf254d0 2024-08-31T04:32:29.291 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:29.284+0000 7fb40842e740 10 client.0 _ll_register_callbacks cb 0x5583fe22ee80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:32:29.292 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:29.284+0000 7fb3fb200640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5583fdf461b0 0x5583fe2f6500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:32:29.292 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:29.284+0000 7fb3fb200640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5583fdf461b0 0x5583fe2f6500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:46986/0 (socket says 172.21.15.50:46986) 2024-08-31T04:32:29.292 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:29.284+0000 7fb3fb200640 1 -- 172.21.15.50:0/4234468472 learned_addr learned my addr 172.21.15.50:0/4234468472 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:32:29.292 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:29.284+0000 7fb3fa800640 1 --2- 172.21.15.50:0/4234468472 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5583fdf1d2f0 0x5583fe2f52d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:32:29.292 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:29.284+0000 7fb3fb200640 1 -- 172.21.15.50:0/4234468472 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5583fdf254d0 msgr2=0x5583fe2f5990 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-08-31T04:32:29.292 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:29.284+0000 7fb3fb200640 1 --2- 172.21.15.50:0/4234468472 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5583fdf254d0 0x5583fe2f5990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:29.292 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:29.284+0000 7fb3fb200640 1 -- 172.21.15.50:0/4234468472 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5583fdf1d2f0 msgr2=0x5583fe2f52d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:32:29.292 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:29.284+0000 7fb3fb200640 1 --2- 172.21.15.50:0/4234468472 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5583fdf1d2f0 0x5583fe2f52d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:29.292 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:29.284+0000 7fb3fb200640 1 -- 172.21.15.50:0/4234468472 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5583fdfb1790 con 0x5583fdf461b0 2024-08-31T04:32:29.292 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:29.284+0000 7fb3fa800640 1 --2- 172.21.15.50:0/4234468472 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5583fdf1d2f0 0x5583fe2f52d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T04:32:29.292 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:29.284+0000 7fb3fb200640 1 --2- 172.21.15.50:0/4234468472 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5583fdf461b0 0x5583fe2f6500 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fb3f4005c00 tx=0x7fb3f4004970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2fa738785871428 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:32:29.292 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:29.284+0000 7fb3dfe00640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-08-31T04:32:29.292 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:29.284+0000 7fb3dfe00640 1 -- 172.21.15.50:0/4234468472 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3f4004c50 con 0x5583fdf461b0 2024-08-31T04:32:29.293 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:29.284+0000 7fb3dfe00640 1 -- 172.21.15.50:0/4234468472 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8219+0+0 (secure 0 0 0) 0x7fb3f4004df0 con 0x5583fdf461b0 2024-08-31T04:32:29.293 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:29.284+0000 7fb40842e740 1 -- 172.21.15.50:0/4234468472 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb3f4015070 con 0x5583fdf461b0 2024-08-31T04:32:29.293 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:29.284+0000 7fb3dfe00640 1 -- 172.21.15.50:0/4234468472 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) ==== 24+0+0 (secure 0 0 0) 0x7fb3f40115c0 con 0x5583fdf461b0 2024-08-31T04:32:29.293 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:29.284+0000 7fb40842e740 10 client.16317 fetch_fsmap learned FSMap version 50 2024-08-31T04:32:29.293 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:29.284+0000 7fb40842e740 1 -- 172.21.15.50:0/4234468472 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=4+}) -- 0x5583fe02a620 con 0x5583fdf461b0 2024-08-31T04:32:29.293 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:29.284+0000 7fb3dfe00640 1 -- 172.21.15.50:0/4234468472 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb3f4015070 con 0x5583fdf461b0 2024-08-31T04:32:29.293 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:29.287+0000 7fb3dfe00640 1 -- 172.21.15.50:0/4234468472 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 50) ==== 8366+0+0 (secure 0 0 0) 0x7fb3f4010520 con 0x5583fdf461b0 2024-08-31T04:32:29.293 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:29.287+0000 7fb40842e740 10 client.16317 fetch_fsmap finished waiting for FSMap version 50 2024-08-31T04:32:29.293 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:29.287+0000 7fb40842e740 10 client.16317 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T04:32:29.293 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:29.287+0000 7fb40842e740 20 client.16317 populate_metadata read hostname 'smithi050' 2024-08-31T04:32:29.293 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:29.287+0000 7fb40842e740 1 --2- 172.21.15.50:0/4234468472 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x5583fdf04d80 0x5583fe302720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:32:29.293 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:29.287+0000 7fb40842e740 4 client.16317 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T04:32:29.294 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:29.287+0000 7fb40842e740 1 -- 172.21.15.50:0/4234468472 --> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5583fe260ec0 con 0x5583fdf04d80 2024-08-31T04:32:29.294 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:29.287+0000 7fb3fa800640 1 --2- 172.21.15.50:0/4234468472 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x5583fdf04d80 0x5583fe302720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:32:29.295 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:29.287+0000 7fb3fa800640 1 --2- 172.21.15.50:0/4234468472 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x5583fdf04d80 0x5583fe302720 crc :-1 s=READY pgs=130 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=93c0b0564ff4b37 server_cookie=126825ad9d63012f in_seq=0 out_seq=0 2024-08-31T04:32:29.295 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:29.287+0000 7fb3dfe00640 10 client.16317 ms_handle_connect on v2:172.21.15.133:6838/2526402262 2024-08-31T04:32:29.295 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:29.287+0000 7fb3dfe00640 1 -- 172.21.15.50:0/4234468472 <== mds.0 v2:172.21.15.133:6838/2526402262 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5583fe260ec0 con 0x5583fdf04d80 2024-08-31T04:32:29.295 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:29.287+0000 7fb3dfe00640 10 client.16317 handle_command_reply: tid=0 2024-08-31T04:32:29.295 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:29.287+0000 7fb40842e740 1 client.16317 shutdown 2024-08-31T04:32:29.295 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:29.287+0000 7fb40842e740 1 -- 172.21.15.50:0/4234468472 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5583fdf461b0 msgr2=0x5583fe2f6500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:32:29.295 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:29.287+0000 7fb40842e740 1 --2- 172.21.15.50:0/4234468472 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5583fdf461b0 0x5583fe2f6500 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fb3f4005c00 tx=0x7fb3f4004970 comp rx=0 tx=0).stop 2024-08-31T04:32:29.296 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:29.287+0000 7fb40842e740 1 -- 172.21.15.50:0/4234468472 shutdown_connections 2024-08-31T04:32:29.296 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:29.287+0000 7fb40842e740 1 --2- 172.21.15.50:0/4234468472 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x5583fdf04d80 0x5583fe302720 crc :-1 s=READY pgs=130 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:29.296 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:29.287+0000 7fb40842e740 1 --2- 172.21.15.50:0/4234468472 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5583fdf254d0 0x5583fe2f5990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:29.296 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:29.287+0000 7fb40842e740 1 --2- 172.21.15.50:0/4234468472 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5583fdf461b0 0x5583fe2f6500 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:29.296 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:29.287+0000 7fb40842e740 1 --2- 172.21.15.50:0/4234468472 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5583fdf1d2f0 0x5583fe2f52d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:29.296 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:29.287+0000 7fb40842e740 1 -- 172.21.15.50:0/4234468472 >> 172.21.15.50:0/4234468472 conn(0x5583fdf3a300 msgr2=0x5583fe2e5b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:32:29.296 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:29.287+0000 7fb3dfe00640 0 client.16317 ms_handle_reset on v2:172.21.15.133:6838/2526402262 2024-08-31T04:32:29.296 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:29.287+0000 7fb40842e740 1 -- 172.21.15.50:0/4234468472 shutdown_connections 2024-08-31T04:32:29.296 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:29.287+0000 7fb40842e740 1 -- 172.21.15.50:0/4234468472 wait complete. 2024-08-31T04:32:29.296 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:29.287+0000 7fb40842e740 20 client.16317 trim_cache size 0 max 16384 2024-08-31T04:32:29.307 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:29.304+0000 7fb40842e740 1 Processor -- start 2024-08-31T04:32:29.307 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:29.304+0000 7fb40842e740 1 -- start start 2024-08-31T04:32:29.308 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:29.304+0000 7fb40842e740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5583fdf1d2f0 0x5583fe2f0600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:32:29.308 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:29.304+0000 7fb40842e740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5583fdf254d0 0x5583fe2fd3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:32:29.308 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:29.304+0000 7fb40842e740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5583fdf461b0 0x5583fe2e2240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:32:29.308 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:29.304+0000 7fb40842e740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fb3d800e430 con 0x5583fdf254d0 2024-08-31T04:32:29.308 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:29.304+0000 7fb40842e740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7fb3d800ff70 con 0x5583fdf1d2f0 2024-08-31T04:32:29.308 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:29.304+0000 7fb40842e740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fb3d800eb00 con 0x5583fdf461b0 2024-08-31T04:32:29.310 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:29.304+0000 7fb3f3e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5583fdf254d0 0x5583fe2fd3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:32:29.310 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:29.304+0000 7fb3f3e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5583fdf254d0 0x5583fe2fd3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:46988/0 (socket says 172.21.15.50:46988) 2024-08-31T04:32:29.310 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:29.304+0000 7fb3f3e00640 1 -- 172.21.15.50:0/1811303827 learned_addr learned my addr 172.21.15.50:0/1811303827 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:32:29.310 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:29.304+0000 7fb3fa800640 1 --2- 172.21.15.50:0/1811303827 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5583fdf1d2f0 0x5583fe2f0600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:32:29.310 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:29.307+0000 7fb3f3e00640 1 -- 172.21.15.50:0/1811303827 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5583fdf461b0 msgr2=0x5583fe2e2240 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-08-31T04:32:29.310 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:29.307+0000 7fb3f3e00640 1 --2- 172.21.15.50:0/1811303827 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5583fdf461b0 0x5583fe2e2240 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:29.310 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:29.307+0000 7fb3f3e00640 1 -- 172.21.15.50:0/1811303827 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5583fdf1d2f0 msgr2=0x5583fe2f0600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:32:29.310 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:29.307+0000 7fb3f3e00640 1 --2- 172.21.15.50:0/1811303827 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5583fdf1d2f0 0x5583fe2f0600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:29.310 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:29.307+0000 7fb3f3e00640 1 -- 172.21.15.50:0/1811303827 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5583fe2f5d00 con 0x5583fdf254d0 2024-08-31T04:32:29.311 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:29.307+0000 7fb3f3e00640 1 --2- 172.21.15.50:0/1811303827 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5583fdf254d0 0x5583fe2fd3e0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fb3e40cbf70 tx=0x7fb3e40cc100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3887ddd3ddca5891 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:32:29.311 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:29.307+0000 7fb3eaa00640 1 -- 172.21.15.50:0/1811303827 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3e4049070 con 0x5583fdf254d0 2024-08-31T04:32:29.311 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:29.307+0000 7fb3eaa00640 1 -- 172.21.15.50:0/1811303827 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb3e4003e60 con 0x5583fdf254d0 2024-08-31T04:32:29.311 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:29.307+0000 7fb3eaa00640 1 -- 172.21.15.50:0/1811303827 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3e40d5020 con 0x5583fdf254d0 2024-08-31T04:32:29.311 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:29.307+0000 7fb40842e740 1 -- 172.21.15.50:0/1811303827 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5583fdf254d0 msgr2=0x5583fe2fd3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:32:29.311 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:29.307+0000 7fb40842e740 1 --2- 172.21.15.50:0/1811303827 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5583fdf254d0 0x5583fe2fd3e0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fb3e40cbf70 tx=0x7fb3e40cc100 comp rx=0 tx=0).stop 2024-08-31T04:32:29.311 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:29.307+0000 7fb40842e740 1 -- 172.21.15.50:0/1811303827 shutdown_connections 2024-08-31T04:32:29.311 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:29.307+0000 7fb40842e740 1 --2- 172.21.15.50:0/1811303827 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5583fdf461b0 0x5583fe2e2240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:29.311 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:29.307+0000 7fb40842e740 1 --2- 172.21.15.50:0/1811303827 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5583fdf254d0 0x5583fe2fd3e0 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:29.311 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:29.307+0000 7fb40842e740 1 --2- 172.21.15.50:0/1811303827 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5583fdf1d2f0 0x5583fe2f0600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:29.311 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:29.307+0000 7fb40842e740 1 -- 172.21.15.50:0/1811303827 >> 172.21.15.50:0/1811303827 conn(0x5583fdf3a300 msgr2=0x5583fe2f44f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:32:29.312 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:29.307+0000 7fb40842e740 1 -- 172.21.15.50:0/1811303827 shutdown_connections 2024-08-31T04:32:29.312 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:29.307+0000 7fb40842e740 1 -- 172.21.15.50:0/1811303827 wait complete. 2024-08-31T04:32:29.314 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:29.307+0000 7fb40842e740 1 -- start start 2024-08-31T04:32:29.314 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:29.309+0000 7fb40842e740 1 Processor -- start 2024-08-31T04:32:29.314 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:29.309+0000 7fb40842e740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5583fdf1d2f0 0x5583fe2fc510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:32:29.314 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:29.309+0000 7fb40842e740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5583fdf254d0 0x5583fe2fcab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:32:29.314 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:29.309+0000 7fb40842e740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5583fdf461b0 0x5583fe2fb0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:32:29.315 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:29.309+0000 7fb40842e740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fb3d800f8a0 con 0x5583fdf254d0 2024-08-31T04:32:29.315 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:29.309+0000 7fb40842e740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7fb3d800f1d0 con 0x5583fdf461b0 2024-08-31T04:32:29.315 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:29.309+0000 7fb40842e740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fb3d800c410 con 0x5583fdf1d2f0 2024-08-31T04:32:29.315 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:29.309+0000 7fb40842e740 10 client.0 _ll_register_callbacks cb 0x7fb3f4009eb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:32:29.315 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:29.309+0000 7fb3f3e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5583fdf254d0 0x5583fe2fcab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:32:29.315 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:29.309+0000 7fb3f3e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5583fdf254d0 0x5583fe2fcab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:46998/0 (socket says 172.21.15.50:46998) 2024-08-31T04:32:29.315 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:29.309+0000 7fb3f3e00640 1 -- 172.21.15.50:0/3230233033 learned_addr learned my addr 172.21.15.50:0/3230233033 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:32:29.315 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:29.309+0000 7fb3fb200640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5583fdf461b0 0x5583fe2fb0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:32:29.315 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:29.309+0000 7fb3fa800640 1 --2- 172.21.15.50:0/3230233033 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5583fdf1d2f0 0x5583fe2fc510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:32:29.315 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:29.309+0000 7fb3f3e00640 1 -- 172.21.15.50:0/3230233033 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5583fdf1d2f0 msgr2=0x5583fe2fc510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:32:29.315 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:29.309+0000 7fb3f3e00640 1 --2- 172.21.15.50:0/3230233033 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5583fdf1d2f0 0x5583fe2fc510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:29.315 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:29.309+0000 7fb3f3e00640 1 -- 172.21.15.50:0/3230233033 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5583fdf461b0 msgr2=0x5583fe2fb0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:32:29.315 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:29.309+0000 7fb3f3e00640 1 --2- 172.21.15.50:0/3230233033 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5583fdf461b0 0x5583fe2fb0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:29.316 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:29.309+0000 7fb3f3e00640 1 -- 172.21.15.50:0/3230233033 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5583fe2fb610 con 0x5583fdf254d0 2024-08-31T04:32:29.316 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:29.309+0000 7fb3fb200640 1 --2- 172.21.15.50:0/3230233033 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5583fdf461b0 0x5583fe2fb0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:32:29.316 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:29.309+0000 7fb3f3e00640 1 --2- 172.21.15.50:0/3230233033 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5583fdf254d0 0x5583fe2fcab0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fb3e40cc200 tx=0x7fb3e40c8730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=818406d97fad97c4 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:32:29.316 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:29.309+0000 7fb3dfe00640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-08-31T04:32:29.316 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:29.309+0000 7fb3dfe00640 1 -- 172.21.15.50:0/3230233033 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3e40b7070 con 0x5583fdf254d0 2024-08-31T04:32:29.316 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:29.309+0000 7fb3dfe00640 1 -- 172.21.15.50:0/3230233033 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8219+0+0 (secure 0 0 0) 0x7fb3e4003a10 con 0x5583fdf254d0 2024-08-31T04:32:29.316 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:29.309+0000 7fb40842e740 1 -- 172.21.15.50:0/3230233033 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb3e4003e60 con 0x5583fdf254d0 2024-08-31T04:32:29.316 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:29.309+0000 7fb3dfe00640 1 -- 172.21.15.50:0/3230233033 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) ==== 24+0+0 (secure 0 0 0) 0x7fb3e4049040 con 0x5583fdf254d0 2024-08-31T04:32:29.316 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:29.309+0000 7fb40842e740 10 client.16323 fetch_fsmap learned FSMap version 50 2024-08-31T04:32:29.316 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:29.309+0000 7fb40842e740 1 -- 172.21.15.50:0/3230233033 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=4+}) -- 0x5583fe36d7d0 con 0x5583fdf254d0 2024-08-31T04:32:29.316 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:29.309+0000 7fb3dfe00640 1 -- 172.21.15.50:0/3230233033 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb3e4003e60 con 0x5583fdf254d0 2024-08-31T04:32:29.316 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:29.309+0000 7fb3dfe00640 1 -- 172.21.15.50:0/3230233033 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 50) ==== 8366+0+0 (secure 0 0 0) 0x7fb3e40c7be0 con 0x5583fdf254d0 2024-08-31T04:32:29.317 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:29.309+0000 7fb40842e740 10 client.16323 fetch_fsmap finished waiting for FSMap version 50 2024-08-31T04:32:29.317 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:29.309+0000 7fb40842e740 10 client.16323 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T04:32:29.317 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:29.309+0000 7fb40842e740 20 client.16323 populate_metadata read hostname 'smithi050' 2024-08-31T04:32:29.317 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:29.309+0000 7fb40842e740 1 --2- 172.21.15.50:0/3230233033 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x5583fdeda1c0 0x5583fe370150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:32:29.317 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:29.309+0000 7fb40842e740 4 client.16323 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-31T04:32:29.317 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:29.309+0000 7fb40842e740 1 -- 172.21.15.50:0/3230233033 --> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5583fe25c960 con 0x5583fdeda1c0 2024-08-31T04:32:29.317 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:29.309+0000 7fb3fa800640 1 --2- 172.21.15.50:0/3230233033 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x5583fdeda1c0 0x5583fe370150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:32:29.317 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:29.312+0000 7fb3dfe00640 10 client.16323 ms_handle_connect on v2:172.21.15.133:6838/2526402262 2024-08-31T04:32:29.317 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:29.312+0000 7fb3fa800640 1 --2- 172.21.15.50:0/3230233033 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x5583fdeda1c0 0x5583fe370150 crc :-1 s=READY pgs=131 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f1b4df586c96a326 server_cookie=50e35e7f3b15a747 in_seq=0 out_seq=0 2024-08-31T04:32:29.323 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:29.319+0000 7fb3dfe00640 1 -- 172.21.15.50:0/3230233033 <== mds.0 v2:172.21.15.133:6838/2526402262 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5583fe25c960 con 0x5583fdeda1c0 2024-08-31T04:32:29.323 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:29.319+0000 7fb3dfe00640 10 client.16323 handle_command_reply: tid=0 2024-08-31T04:32:29.323 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:29.319+0000 7fb40842e740 1 client.16323 shutdown 2024-08-31T04:32:29.323 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:29.319+0000 7fb40842e740 1 -- 172.21.15.50:0/3230233033 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5583fdf254d0 msgr2=0x5583fe2fcab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:32:29.323 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:29.319+0000 7fb40842e740 1 --2- 172.21.15.50:0/3230233033 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5583fdf254d0 0x5583fe2fcab0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fb3e40cc200 tx=0x7fb3e40c8730 comp rx=0 tx=0).stop 2024-08-31T04:32:29.323 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:29.319+0000 7fb40842e740 1 -- 172.21.15.50:0/3230233033 shutdown_connections 2024-08-31T04:32:29.323 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:29.319+0000 7fb40842e740 1 --2- 172.21.15.50:0/3230233033 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x5583fdeda1c0 0x5583fe370150 crc :-1 s=READY pgs=131 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:29.323 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:29.319+0000 7fb40842e740 1 --2- 172.21.15.50:0/3230233033 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5583fdf461b0 0x5583fe2fb0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:29.323 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:29.319+0000 7fb40842e740 1 --2- 172.21.15.50:0/3230233033 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5583fdf254d0 0x5583fe2fcab0 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:29.323 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:29.319+0000 7fb3dfe00640 0 client.16323 ms_handle_reset on v2:172.21.15.133:6838/2526402262 2024-08-31T04:32:29.324 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:29.319+0000 7fb40842e740 1 --2- 172.21.15.50:0/3230233033 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5583fdf1d2f0 0x5583fe2fc510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:29.324 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:29.319+0000 7fb40842e740 1 -- 172.21.15.50:0/3230233033 >> 172.21.15.50:0/3230233033 conn(0x5583fdf3a300 msgr2=0x5583fe2e2240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:32:29.324 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:29.319+0000 7fb40842e740 1 -- 172.21.15.50:0/3230233033 shutdown_connections 2024-08-31T04:32:29.324 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:29.319+0000 7fb40842e740 1 -- 172.21.15.50:0/3230233033 wait complete. 2024-08-31T04:32:29.324 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:29.319+0000 7fb40842e740 20 client.16323 trim_cache size 0 max 16384 2024-08-31T04:32:29.324 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout:{ 2024-08-31T04:32:29.324 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout: "message": "", 2024-08-31T04:32:29.324 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout: "return_code": 0 2024-08-31T04:32:29.324 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout:} 2024-08-31T04:32:29.325 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:29.319+0000 7fb401400640 1 -- 172.21.15.50:0/3879925600 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fb3e00b4bb0 msgr2=0x7fb3e00b70c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:32:29.325 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:29.319+0000 7fb401400640 1 --2- 172.21.15.50:0/3879925600 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fb3e00b4bb0 0x7fb3e00b70c0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fb3ec005d00 tx=0x7fb3ec005f30 comp rx=0 tx=0).stop 2024-08-31T04:32:29.325 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:29.319+0000 7fb401400640 1 -- 172.21.15.50:0/3879925600 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb3fc076e90 msgr2=0x7fb3fc19c5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:32:29.325 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:29.319+0000 7fb401400640 1 --2- 172.21.15.50:0/3879925600 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb3fc076e90 0x7fb3fc19c5d0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fb3e4006010 tx=0x7fb3e4004340 comp rx=0 tx=0).stop 2024-08-31T04:32:29.326 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:29.319+0000 7fb401400640 1 -- 172.21.15.50:0/3879925600 shutdown_connections 2024-08-31T04:32:29.326 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:29.319+0000 7fb401400640 1 --2- 172.21.15.50:0/3879925600 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fb3e00b4bb0 0x7fb3e00b70c0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:29.326 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:29.319+0000 7fb401400640 1 --2- 172.21.15.50:0/3879925600 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb3fc10b3e0 0x7fb3fc19d110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:29.326 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:29.319+0000 7fb401400640 1 --2- 172.21.15.50:0/3879925600 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb3fc076e90 0x7fb3fc19c5d0 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:29.326 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:29.319+0000 7fb401400640 1 --2- 172.21.15.50:0/3879925600 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb3fc075a90 0x7fb3fc19bf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:29.326 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:29.319+0000 7fb401400640 1 -- 172.21.15.50:0/3879925600 >> 172.21.15.50:0/3879925600 conn(0x7fb3fc0fed90 msgr2=0x7fb3fc1073c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:32:29.326 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:29.319+0000 7fb401400640 1 -- 172.21.15.50:0/3879925600 shutdown_connections 2024-08-31T04:32:29.326 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:29.319+0000 7fb401400640 1 -- 172.21.15.50:0/3879925600 wait complete. 2024-08-31T04:32:29.467 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:32:29 smithi050 ceph-mon[17259]: pgmap v656: 97 pgs: 97 active+clean; 1.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 8.7 KiB/s wr, 11 op/s 2024-08-31T04:32:29.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:32:29 smithi177 ceph-mon[22025]: pgmap v656: 97 pgs: 97 active+clean; 1.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 8.7 KiB/s wr, 11 op/s 2024-08-31T04:32:29.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:32:29 smithi133 ceph-mon[22177]: pgmap v656: 97 pgs: 97 active+clean; 1.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 8.7 KiB/s wr, 11 op/s 2024-08-31T04:32:31.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:32:31 smithi050 ceph-mon[17259]: pgmap v657: 97 pgs: 97 active+clean; 1.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 682 B/s wr, 9 op/s 2024-08-31T04:32:31.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:32:31 smithi177 ceph-mon[22025]: pgmap v657: 97 pgs: 97 active+clean; 1.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 682 B/s wr, 9 op/s 2024-08-31T04:32:31.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:32:31 smithi133 ceph-mon[22177]: pgmap v657: 97 pgs: 97 active+clean; 1.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 682 B/s wr, 9 op/s 2024-08-31T04:32:33.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:32:33 smithi050 ceph-mon[17259]: pgmap v658: 97 pgs: 97 active+clean; 1.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 9.0 KiB/s wr, 13 op/s 2024-08-31T04:32:33.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:32:33 smithi177 ceph-mon[22025]: pgmap v658: 97 pgs: 97 active+clean; 1.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 9.0 KiB/s wr, 13 op/s 2024-08-31T04:32:33.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:32:33 smithi133 ceph-mon[22177]: pgmap v658: 97 pgs: 97 active+clean; 1.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 9.0 KiB/s wr, 13 op/s 2024-08-31T04:32:35.728 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:32:35 smithi050 ceph-mon[17259]: pgmap v659: 97 pgs: 97 active+clean; 1.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 8.5 KiB/s wr, 9 op/s 2024-08-31T04:32:35.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:32:35 smithi177 ceph-mon[22025]: pgmap v659: 97 pgs: 97 active+clean; 1.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 8.5 KiB/s wr, 9 op/s 2024-08-31T04:32:35.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:32:35 smithi133 ceph-mon[22177]: pgmap v659: 97 pgs: 97 active+clean; 1.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 8.5 KiB/s wr, 9 op/s 2024-08-31T04:32:37.717 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:32:37 smithi050 ceph-mon[17259]: pgmap v660: 97 pgs: 97 active+clean; 1.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 8.8 KiB/s wr, 11 op/s 2024-08-31T04:32:37.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:32:37 smithi177 ceph-mon[22025]: pgmap v660: 97 pgs: 97 active+clean; 1.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 8.8 KiB/s wr, 11 op/s 2024-08-31T04:32:37.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:32:37 smithi133 ceph-mon[22177]: pgmap v660: 97 pgs: 97 active+clean; 1.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 8.8 KiB/s wr, 11 op/s 2024-08-31T04:32:39.693 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:32:39 smithi050 ceph-mon[17259]: pgmap v661: 97 pgs: 97 active+clean; 1.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 121 KiB/s rd, 11 KiB/s wr, 16 op/s 2024-08-31T04:32:39.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:32:39 smithi133 ceph-mon[22177]: pgmap v661: 97 pgs: 97 active+clean; 1.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 121 KiB/s rd, 11 KiB/s wr, 16 op/s 2024-08-31T04:32:39.996 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:32:39 smithi177 ceph-mon[22025]: pgmap v661: 97 pgs: 97 active+clean; 1.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 121 KiB/s rd, 11 KiB/s wr, 16 op/s 2024-08-31T04:32:41.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:32:41 smithi050 ceph-mon[17259]: pgmap v662: 97 pgs: 97 active+clean; 1.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 186 KiB/s rd, 14 KiB/s wr, 18 op/s 2024-08-31T04:32:41.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:32:41 smithi133 ceph-mon[22177]: pgmap v662: 97 pgs: 97 active+clean; 1.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 186 KiB/s rd, 14 KiB/s wr, 18 op/s 2024-08-31T04:32:41.996 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:32:41 smithi177 ceph-mon[22025]: pgmap v662: 97 pgs: 97 active+clean; 1.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 186 KiB/s rd, 14 KiB/s wr, 18 op/s 2024-08-31T04:32:42.516 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:42.511+0000 7fc9d7000640 1 -- 172.21.15.50:0/1310229775 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc9d0075a90 msgr2=0x7fc9d0075ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:32:42.516 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:42.511+0000 7fc9d7000640 1 --2- 172.21.15.50:0/1310229775 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc9d0075a90 0x7fc9d0075ea0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fc9bc009860 tx=0x7fc9bc02a340 comp rx=0 tx=0).stop 2024-08-31T04:32:42.516 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:42.511+0000 7fc9d7000640 1 -- 172.21.15.50:0/1310229775 shutdown_connections 2024-08-31T04:32:42.516 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:42.511+0000 7fc9d7000640 1 --2- 172.21.15.50:0/1310229775 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc9d0075a90 0x7fc9d0075ea0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:42.516 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:42.511+0000 7fc9d7000640 1 --2- 172.21.15.50:0/1310229775 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc9d010fa00 0x7fc9d0111e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:42.516 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:42.511+0000 7fc9d7000640 1 --2- 172.21.15.50:0/1310229775 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc9d0076e90 0x7fc9d0075550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:42.516 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:42.511+0000 7fc9d7000640 1 -- 172.21.15.50:0/1310229775 >> 172.21.15.50:0/1310229775 conn(0x7fc9d00febc0 msgr2=0x7fc9d0101070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:32:42.516 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:42.511+0000 7fc9d7000640 1 -- 172.21.15.50:0/1310229775 shutdown_connections 2024-08-31T04:32:42.516 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:42.511+0000 7fc9d7000640 1 -- 172.21.15.50:0/1310229775 wait complete. 2024-08-31T04:32:42.517 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:42.515+0000 7fc9d7000640 1 Processor -- start 2024-08-31T04:32:42.517 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:42.515+0000 7fc9d7000640 1 -- start start 2024-08-31T04:32:42.517 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:42.515+0000 7fc9d7000640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc9d0075a90 0x7fc9d01a01d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:32:42.517 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:42.515+0000 7fc9d7000640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc9d0076e90 0x7fc9d01a0840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:32:42.517 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:42.515+0000 7fc9d7000640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc9d010fa00 0x7fc9d01a13f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:32:42.517 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:42.515+0000 7fc9d7000640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fc9d0115520 con 0x7fc9d010fa00 2024-08-31T04:32:42.518 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:42.515+0000 7fc9d7000640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7fc9d01153a0 con 0x7fc9d0076e90 2024-08-31T04:32:42.518 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:42.515+0000 7fc9d7000640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fc9d01156a0 con 0x7fc9d0075a90 2024-08-31T04:32:42.533 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:42.515+0000 7fc9d6600640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc9d010fa00 0x7fc9d01a13f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:32:42.533 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:42.515+0000 7fc9d5c00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc9d0075a90 0x7fc9d01a01d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:32:42.533 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:42.515+0000 7fc9d6600640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc9d010fa00 0x7fc9d01a13f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:40210/0 (socket says 172.21.15.50:40210) 2024-08-31T04:32:42.533 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:42.515+0000 7fc9d5c00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc9d0075a90 0x7fc9d01a01d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.50:49936/0 (socket says 172.21.15.50:49936) 2024-08-31T04:32:42.533 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:42.515+0000 7fc9d6600640 1 -- 172.21.15.50:0/960400542 learned_addr learned my addr 172.21.15.50:0/960400542 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:32:42.533 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:42.516+0000 7fc9d5200640 1 --2- 172.21.15.50:0/960400542 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc9d0076e90 0x7fc9d01a0840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:32:42.533 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:42.516+0000 7fc9d5c00640 1 -- 172.21.15.50:0/960400542 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc9d0076e90 msgr2=0x7fc9d01a0840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:32:42.533 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:42.516+0000 7fc9d5c00640 1 --2- 172.21.15.50:0/960400542 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc9d0076e90 0x7fc9d01a0840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:42.533 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:42.516+0000 7fc9d5c00640 1 -- 172.21.15.50:0/960400542 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc9d010fa00 msgr2=0x7fc9d01a13f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:32:42.533 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:42.516+0000 7fc9d5c00640 1 --2- 172.21.15.50:0/960400542 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc9d010fa00 0x7fc9d01a13f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:42.533 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:42.516+0000 7fc9d5c00640 1 -- 172.21.15.50:0/960400542 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9d01a1c10 con 0x7fc9d0075a90 2024-08-31T04:32:42.534 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:42.516+0000 7fc9d6600640 1 --2- 172.21.15.50:0/960400542 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc9d010fa00 0x7fc9d01a13f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:32:42.534 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:42.516+0000 7fc9d5c00640 1 --2- 172.21.15.50:0/960400542 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc9d0075a90 0x7fc9d01a01d0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fc9c400b3f0 tx=0x7fc9c400b8b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:32:42.534 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:42.517+0000 7fc9ce000640 1 -- 172.21.15.50:0/960400542 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9c4015020 con 0x7fc9d0075a90 2024-08-31T04:32:42.534 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:42.517+0000 7fc9ce000640 1 -- 172.21.15.50:0/960400542 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc9c4011ce0 con 0x7fc9d0075a90 2024-08-31T04:32:42.534 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:42.517+0000 7fc9d7000640 1 -- 172.21.15.50:0/960400542 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc9d01a1f00 con 0x7fc9d0075a90 2024-08-31T04:32:42.534 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:42.517+0000 7fc9ce000640 1 -- 172.21.15.50:0/960400542 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9c4010d80 con 0x7fc9d0075a90 2024-08-31T04:32:42.534 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:42.517+0000 7fc9d7000640 1 -- 172.21.15.50:0/960400542 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9d01a85f0 con 0x7fc9d0075a90 2024-08-31T04:32:42.534 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:42.517+0000 7fc9df7c8740 1 Processor -- start 2024-08-31T04:32:42.534 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:42.517+0000 7fc9ce000640 1 -- 172.21.15.50:0/960400542 <== mon.1 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 18) ==== 152577+0+0 (secure 0 0 0) 0x7fc9c4018020 con 0x7fc9d0075a90 2024-08-31T04:32:42.534 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:42.517+0000 7fc9df7c8740 1 -- start start 2024-08-31T04:32:42.534 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:42.517+0000 7fc9df7c8740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b1eda2e1b0 0x55b1eddd3fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:32:42.534 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:42.517+0000 7fc9df7c8740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b1eda052f0 0x55b1eddd4610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:32:42.535 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:42.517+0000 7fc9df7c8740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b1eda0d4d0 0x55b1eddd5160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:32:42.535 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:42.517+0000 7fc9df7c8740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55b1edd46f70 con 0x55b1eda0d4d0 2024-08-31T04:32:42.535 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:42.517+0000 7fc9df7c8740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x55b1edd36500 con 0x55b1eda2e1b0 2024-08-31T04:32:42.535 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:42.517+0000 7fc9df7c8740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x55b1edd3a4b0 con 0x55b1eda052f0 2024-08-31T04:32:42.535 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:42.522+0000 7fc9d5200640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b1eda0d4d0 0x55b1eddd5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:32:42.535 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:42.522+0000 7fc9d5c00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b1eda052f0 0x55b1eddd4610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:32:42.535 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:42.522+0000 7fc9d6600640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b1eda2e1b0 0x55b1eddd3fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:32:42.535 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:42.522+0000 7fc9d5c00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b1eda052f0 0x55b1eddd4610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.50:49952/0 (socket says 172.21.15.50:49952) 2024-08-31T04:32:42.535 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:42.522+0000 7fc9d5200640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b1eda0d4d0 0x55b1eddd5160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:40214/0 (socket says 172.21.15.50:40214) 2024-08-31T04:32:42.535 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:42.522+0000 7fc9d5c00640 1 -- 172.21.15.50:0/1032511618 learned_addr learned my addr 172.21.15.50:0/1032511618 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:32:42.535 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:42.522+0000 7fc9d5c00640 1 -- 172.21.15.50:0/1032511618 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b1eda2e1b0 msgr2=0x55b1eddd3fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:32:42.535 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:42.522+0000 7fc9d5c00640 1 --2- 172.21.15.50:0/1032511618 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b1eda2e1b0 0x55b1eddd3fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:42.535 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:42.522+0000 7fc9d5c00640 1 -- 172.21.15.50:0/1032511618 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b1eda0d4d0 msgr2=0x55b1eddd5160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:32:42.536 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:42.522+0000 7fc9d5c00640 1 --2- 172.21.15.50:0/1032511618 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b1eda0d4d0 0x55b1eddd5160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:42.536 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:42.522+0000 7fc9d5c00640 1 -- 172.21.15.50:0/1032511618 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b1edcf0c10 con 0x55b1eda052f0 2024-08-31T04:32:42.536 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:42.522+0000 7fc9ce000640 1 --2- 172.21.15.50:0/960400542 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fc9b80b4b30 0x7fc9b80b7040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:32:42.536 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:42.522+0000 7fc9d5c00640 1 --2- 172.21.15.50:0/1032511618 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b1eda052f0 0x55b1eddd4610 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fc9c40eac10 tx=0x7fc9c40ec690 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1595321c15c527e2 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:32:42.536 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:42.522+0000 7fc9ce000640 1 -- 172.21.15.50:0/960400542 <== mon.1 v2:172.21.15.177:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8219+0+0 (secure 0 0 0) 0x7fc9c40e4810 con 0x7fc9d0075a90 2024-08-31T04:32:42.536 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:42.522+0000 7fc9c2a00640 1 -- 172.21.15.50:0/1032511618 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9c40a7110 con 0x55b1eda052f0 2024-08-31T04:32:42.536 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:42.522+0000 7fc9d6600640 1 --2- 172.21.15.50:0/960400542 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fc9b80b4b30 0x7fc9b80b7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:32:42.536 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:42.522+0000 7fc9c2a00640 1 -- 172.21.15.50:0/1032511618 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc9c40aad60 con 0x55b1eda052f0 2024-08-31T04:32:42.536 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:42.522+0000 7fc9c2a00640 1 -- 172.21.15.50:0/1032511618 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9c40aa9c0 con 0x55b1eda052f0 2024-08-31T04:32:42.536 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:42.522+0000 7fc9df7c8740 1 -- 172.21.15.50:0/1032511618 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b1eda052f0 msgr2=0x55b1eddd4610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:32:42.536 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:42.522+0000 7fc9df7c8740 1 --2- 172.21.15.50:0/1032511618 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b1eda052f0 0x55b1eddd4610 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fc9c40eac10 tx=0x7fc9c40ec690 comp rx=0 tx=0).stop 2024-08-31T04:32:42.536 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:42.522+0000 7fc9d6600640 1 --2- 172.21.15.50:0/960400542 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fc9b80b4b30 0x7fc9b80b7040 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fc9c8005c40 tx=0x7fc9c80095c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:32:42.537 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:42.522+0000 7fc9df7c8740 1 -- 172.21.15.50:0/1032511618 shutdown_connections 2024-08-31T04:32:42.537 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:42.522+0000 7fc9df7c8740 1 --2- 172.21.15.50:0/1032511618 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b1eda052f0 0x55b1eddd4610 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:42.537 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:42.522+0000 7fc9df7c8740 1 --2- 172.21.15.50:0/1032511618 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b1eda0d4d0 0x55b1eddd5160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:42.537 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:42.522+0000 7fc9df7c8740 1 --2- 172.21.15.50:0/1032511618 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b1eda2e1b0 0x55b1eddd3fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:42.537 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:42.522+0000 7fc9df7c8740 1 -- 172.21.15.50:0/1032511618 >> 172.21.15.50:0/1032511618 conn(0x55b1eda22300 msgr2=0x55b1eddcfa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:32:42.537 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:42.522+0000 7fc9df7c8740 1 -- 172.21.15.50:0/1032511618 shutdown_connections 2024-08-31T04:32:42.537 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:42.522+0000 7fc9df7c8740 1 -- 172.21.15.50:0/1032511618 wait complete. 2024-08-31T04:32:42.537 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:42.522+0000 7fc9df7c8740 1 -- start start 2024-08-31T04:32:42.537 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:42.522+0000 7fc9df7c8740 1 Processor -- start 2024-08-31T04:32:42.537 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:42.522+0000 7fc9df7c8740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b1eda052f0 0x55b1edddd680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:32:42.537 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:42.522+0000 7fc9df7c8740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b1eda0d4d0 0x55b1eddddd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:32:42.537 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:42.522+0000 7fc9df7c8740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b1eda2e1b0 0x55b1eddde840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:32:42.537 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:42.522+0000 7fc9df7c8740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55b1edc6fab0 con 0x55b1eda0d4d0 2024-08-31T04:32:42.537 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:42.522+0000 7fc9df7c8740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x55b1edcdd320 con 0x55b1eda052f0 2024-08-31T04:32:42.538 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:42.522+0000 7fc9df7c8740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x55b1eddd5c80 con 0x55b1eda2e1b0 2024-08-31T04:32:42.538 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:42.522+0000 7fc9df7c8740 10 client.0 _ll_register_callbacks cb 0x55b1edce36a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:32:42.538 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:42.526+0000 7fc9d5200640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b1eda0d4d0 0x55b1eddddd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:32:42.538 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:42.526+0000 7fc9d5200640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b1eda0d4d0 0x55b1eddddd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:40226/0 (socket says 172.21.15.50:40226) 2024-08-31T04:32:42.538 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:42.526+0000 7fc9d5200640 1 -- 172.21.15.50:0/1025093862 learned_addr learned my addr 172.21.15.50:0/1025093862 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:32:42.538 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:42.526+0000 7fc9d5c00640 1 --2- 172.21.15.50:0/1025093862 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b1eda052f0 0x55b1edddd680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:32:42.538 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:42.526+0000 7fc9d6600640 1 --2- 172.21.15.50:0/1025093862 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b1eda2e1b0 0x55b1eddde840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:32:42.538 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:42.526+0000 7fc9d5200640 1 -- 172.21.15.50:0/1025093862 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b1eda2e1b0 msgr2=0x55b1eddde840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:32:42.538 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:42.526+0000 7fc9d5200640 1 --2- 172.21.15.50:0/1025093862 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b1eda2e1b0 0x55b1eddde840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:42.538 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:42.526+0000 7fc9d5200640 1 -- 172.21.15.50:0/1025093862 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b1eda052f0 msgr2=0x55b1edddd680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:32:42.538 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:42.526+0000 7fc9d5200640 1 --2- 172.21.15.50:0/1025093862 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b1eda052f0 0x55b1edddd680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:42.538 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:42.526+0000 7fc9d5200640 1 -- 172.21.15.50:0/1025093862 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b1eda99790 con 0x55b1eda0d4d0 2024-08-31T04:32:42.538 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:42.526+0000 7fc9d6600640 1 --2- 172.21.15.50:0/1025093862 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b1eda2e1b0 0x55b1eddde840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:32:42.539 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:42.526+0000 7fc9d5200640 1 --2- 172.21.15.50:0/1025093862 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b1eda0d4d0 0x55b1eddddd40 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fc9bc0303f0 tx=0x7fc9bc005e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dbc4c7d9b929c4ef server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:32:42.539 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:42.526+0000 7fc9b7400640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-08-31T04:32:42.539 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:42.526+0000 7fc9b7400640 1 -- 172.21.15.50:0/1025093862 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9bc045070 con 0x55b1eda0d4d0 2024-08-31T04:32:42.539 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:42.526+0000 7fc9b7400640 1 -- 172.21.15.50:0/1025093862 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8219+0+0 (secure 0 0 0) 0x7fc9bc004240 con 0x55b1eda0d4d0 2024-08-31T04:32:42.539 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:42.526+0000 7fc9df7c8740 1 -- 172.21.15.50:0/1025093862 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc9c40aad60 con 0x55b1eda0d4d0 2024-08-31T04:32:42.539 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:42.526+0000 7fc9b7400640 1 -- 172.21.15.50:0/1025093862 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) ==== 24+0+0 (secure 0 0 0) 0x7fc9bc051050 con 0x55b1eda0d4d0 2024-08-31T04:32:42.539 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:42.526+0000 7fc9df7c8740 10 client.16335 fetch_fsmap learned FSMap version 50 2024-08-31T04:32:42.539 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:42.526+0000 7fc9df7c8740 1 -- 172.21.15.50:0/1025093862 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=4+}) -- 0x55b1edb12620 con 0x55b1eda0d4d0 2024-08-31T04:32:42.539 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:42.526+0000 7fc9b7400640 1 -- 172.21.15.50:0/1025093862 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc9c40aad60 con 0x55b1eda0d4d0 2024-08-31T04:32:42.539 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:42.526+0000 7fc9b7400640 1 -- 172.21.15.50:0/1025093862 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 50) ==== 8366+0+0 (secure 0 0 0) 0x7fc9bc03d040 con 0x55b1eda0d4d0 2024-08-31T04:32:42.539 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:42.526+0000 7fc9df7c8740 10 client.16335 fetch_fsmap finished waiting for FSMap version 50 2024-08-31T04:32:42.539 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:42.526+0000 7fc9df7c8740 10 client.16335 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T04:32:42.539 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:42.526+0000 7fc9df7c8740 20 client.16335 populate_metadata read hostname 'smithi050' 2024-08-31T04:32:42.540 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:42.526+0000 7fc9df7c8740 1 --2- 172.21.15.50:0/1025093862 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x55b1ed9ecd80 0x55b1eddead70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:32:42.540 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:42.526+0000 7fc9df7c8740 4 client.16335 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T04:32:42.540 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:42.526+0000 7fc9df7c8740 1 -- 172.21.15.50:0/1025093862 --> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b1edd48ec0 con 0x55b1ed9ecd80 2024-08-31T04:32:42.540 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:42.526+0000 7fc9d5c00640 1 --2- 172.21.15.50:0/1025093862 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x55b1ed9ecd80 0x55b1eddead70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:32:42.540 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:42.526+0000 7fc9d5c00640 1 --2- 172.21.15.50:0/1025093862 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x55b1ed9ecd80 0x55b1eddead70 crc :-1 s=READY pgs=132 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=78a03618da003234 server_cookie=3f8f60843dd6784c in_seq=0 out_seq=0 2024-08-31T04:32:42.540 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:42.526+0000 7fc9b7400640 10 client.16335 ms_handle_connect on v2:172.21.15.133:6838/2526402262 2024-08-31T04:32:42.541 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:42.526+0000 7fc9b7400640 1 -- 172.21.15.50:0/1025093862 <== mds.0 v2:172.21.15.133:6838/2526402262 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55b1edd48ec0 con 0x55b1ed9ecd80 2024-08-31T04:32:42.541 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:42.526+0000 7fc9b7400640 10 client.16335 handle_command_reply: tid=0 2024-08-31T04:32:42.541 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:42.526+0000 7fc9df7c8740 1 client.16335 shutdown 2024-08-31T04:32:42.541 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:42.526+0000 7fc9df7c8740 1 -- 172.21.15.50:0/1025093862 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b1eda0d4d0 msgr2=0x55b1eddddd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:32:42.541 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:42.526+0000 7fc9df7c8740 1 --2- 172.21.15.50:0/1025093862 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b1eda0d4d0 0x55b1eddddd40 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fc9bc0303f0 tx=0x7fc9bc005e60 comp rx=0 tx=0).stop 2024-08-31T04:32:42.541 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:42.526+0000 7fc9df7c8740 1 -- 172.21.15.50:0/1025093862 shutdown_connections 2024-08-31T04:32:42.541 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:42.526+0000 7fc9df7c8740 1 --2- 172.21.15.50:0/1025093862 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x55b1ed9ecd80 0x55b1eddead70 crc :-1 s=READY pgs=132 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:42.542 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:42.526+0000 7fc9df7c8740 1 --2- 172.21.15.50:0/1025093862 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b1eda2e1b0 0x55b1eddde840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:42.542 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:42.526+0000 7fc9df7c8740 1 --2- 172.21.15.50:0/1025093862 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b1eda0d4d0 0x55b1eddddd40 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:42.542 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:42.526+0000 7fc9b7400640 0 client.16335 ms_handle_reset on v2:172.21.15.133:6838/2526402262 2024-08-31T04:32:42.542 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:42.526+0000 7fc9df7c8740 1 --2- 172.21.15.50:0/1025093862 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b1eda052f0 0x55b1edddd680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:42.542 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:42.526+0000 7fc9df7c8740 1 -- 172.21.15.50:0/1025093862 >> 172.21.15.50:0/1025093862 conn(0x55b1eda22300 msgr2=0x55b1eddcdf40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:32:42.542 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:42.526+0000 7fc9df7c8740 1 -- 172.21.15.50:0/1025093862 shutdown_connections 2024-08-31T04:32:42.542 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:42.526+0000 7fc9df7c8740 1 -- 172.21.15.50:0/1025093862 wait complete. 2024-08-31T04:32:42.542 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:42.526+0000 7fc9df7c8740 20 client.16335 trim_cache size 0 max 16384 2024-08-31T04:32:42.550 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:42.544+0000 7fc9df7c8740 1 Processor -- start 2024-08-31T04:32:42.550 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:42.544+0000 7fc9df7c8740 1 -- start start 2024-08-31T04:32:42.550 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:42.549+0000 7fc9df7c8740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b1eda052f0 0x55b1eddddd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:32:42.550 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:42.549+0000 7fc9df7c8740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b1eda0d4d0 0x55b1edddbc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:32:42.550 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:42.549+0000 7fc9df7c8740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b1eda2e1b0 0x55b1edddc150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:32:42.550 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:42.549+0000 7fc9df7c8740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fc9d01b10f0 con 0x55b1eda0d4d0 2024-08-31T04:32:42.550 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:42.549+0000 7fc9df7c8740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7fc9d01b2c30 con 0x55b1eda052f0 2024-08-31T04:32:42.550 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:42.549+0000 7fc9df7c8740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fc9d01b17c0 con 0x55b1eda2e1b0 2024-08-31T04:32:42.551 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:42.549+0000 7fc9d5200640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b1eda0d4d0 0x55b1edddbc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:32:42.552 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:42.549+0000 7fc9d5200640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b1eda0d4d0 0x55b1edddbc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:40234/0 (socket says 172.21.15.50:40234) 2024-08-31T04:32:42.552 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:42.549+0000 7fc9d5200640 1 -- 172.21.15.50:0/2884132808 learned_addr learned my addr 172.21.15.50:0/2884132808 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:32:42.552 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:42.549+0000 7fc9d6600640 1 --2- 172.21.15.50:0/2884132808 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b1eda2e1b0 0x55b1edddc150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:32:42.552 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:42.549+0000 7fc9d5200640 1 -- 172.21.15.50:0/2884132808 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b1eda2e1b0 msgr2=0x55b1edddc150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:32:42.552 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:42.549+0000 7fc9d5200640 1 --2- 172.21.15.50:0/2884132808 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b1eda2e1b0 0x55b1edddc150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:42.552 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:42.549+0000 7fc9d5200640 1 -- 172.21.15.50:0/2884132808 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b1eda052f0 msgr2=0x55b1eddddd90 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-08-31T04:32:42.552 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:42.549+0000 7fc9d5200640 1 --2- 172.21.15.50:0/2884132808 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b1eda052f0 0x55b1eddddd90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:42.552 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:42.549+0000 7fc9d5200640 1 -- 172.21.15.50:0/2884132808 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b1eddde500 con 0x55b1eda0d4d0 2024-08-31T04:32:42.552 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:42.550+0000 7fc9d5200640 1 --2- 172.21.15.50:0/2884132808 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b1eda0d4d0 0x55b1edddbc10 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fc9bc0057c0 tx=0x7fc9bc0056f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f19bc2328b8fb9 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:32:42.552 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:42.550+0000 7fc9c2000640 1 -- 172.21.15.50:0/2884132808 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9bc04e030 con 0x55b1eda0d4d0 2024-08-31T04:32:42.552 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:42.550+0000 7fc9c2000640 1 -- 172.21.15.50:0/2884132808 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc9bc032910 con 0x55b1eda0d4d0 2024-08-31T04:32:42.552 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:42.550+0000 7fc9c2000640 1 -- 172.21.15.50:0/2884132808 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9bc045050 con 0x55b1eda0d4d0 2024-08-31T04:32:42.554 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:42.550+0000 7fc9df7c8740 1 -- 172.21.15.50:0/2884132808 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b1eda0d4d0 msgr2=0x55b1edddbc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:32:42.554 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:42.550+0000 7fc9df7c8740 1 --2- 172.21.15.50:0/2884132808 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b1eda0d4d0 0x55b1edddbc10 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fc9bc0057c0 tx=0x7fc9bc0056f0 comp rx=0 tx=0).stop 2024-08-31T04:32:42.554 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:42.550+0000 7fc9df7c8740 1 -- 172.21.15.50:0/2884132808 shutdown_connections 2024-08-31T04:32:42.554 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:42.550+0000 7fc9df7c8740 1 --2- 172.21.15.50:0/2884132808 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b1eda2e1b0 0x55b1edddc150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:42.554 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:42.550+0000 7fc9df7c8740 1 --2- 172.21.15.50:0/2884132808 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b1eda0d4d0 0x55b1edddbc10 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:42.555 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:42.550+0000 7fc9df7c8740 1 --2- 172.21.15.50:0/2884132808 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b1eda052f0 0x55b1eddddd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:42.555 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:42.550+0000 7fc9df7c8740 1 -- 172.21.15.50:0/2884132808 >> 172.21.15.50:0/2884132808 conn(0x55b1eda22300 msgr2=0x55b1edddd680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:32:42.555 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:42.550+0000 7fc9df7c8740 1 -- 172.21.15.50:0/2884132808 shutdown_connections 2024-08-31T04:32:42.555 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:42.550+0000 7fc9df7c8740 1 -- 172.21.15.50:0/2884132808 wait complete. 2024-08-31T04:32:42.555 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:42.550+0000 7fc9df7c8740 1 -- start start 2024-08-31T04:32:42.555 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:42.550+0000 7fc9df7c8740 1 Processor -- start 2024-08-31T04:32:42.555 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:42.550+0000 7fc9df7c8740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b1eda052f0 0x55b1edde5200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:32:42.555 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:42.550+0000 7fc9df7c8740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b1eda0d4d0 0x55b1edde4020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:32:42.555 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:42.550+0000 7fc9df7c8740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b1eda2e1b0 0x55b1edde4730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:32:42.555 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:42.550+0000 7fc9df7c8740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fc9d01b2560 con 0x55b1eda2e1b0 2024-08-31T04:32:42.555 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:42.550+0000 7fc9df7c8740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7fc9d01b1e90 con 0x55b1eda0d4d0 2024-08-31T04:32:42.555 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:42.550+0000 7fc9df7c8740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fc9d01af0d0 con 0x55b1eda052f0 2024-08-31T04:32:42.555 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:42.550+0000 7fc9df7c8740 10 client.0 _ll_register_callbacks cb 0x7fc9bc030f80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:32:42.555 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:42.550+0000 7fc9d6600640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b1eda2e1b0 0x55b1edde4730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:32:42.556 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:42.550+0000 7fc9d6600640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b1eda2e1b0 0x55b1edde4730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:40246/0 (socket says 172.21.15.50:40246) 2024-08-31T04:32:42.556 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:42.550+0000 7fc9d6600640 1 -- 172.21.15.50:0/1330762586 learned_addr learned my addr 172.21.15.50:0/1330762586 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:32:42.556 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:42.550+0000 7fc9d5200640 1 --2- 172.21.15.50:0/1330762586 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b1eda0d4d0 0x55b1edde4020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:32:42.556 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:42.550+0000 7fc9d6600640 1 -- 172.21.15.50:0/1330762586 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b1eda052f0 msgr2=0x55b1edde5200 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-08-31T04:32:42.556 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:42.550+0000 7fc9d6600640 1 --2- 172.21.15.50:0/1330762586 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b1eda052f0 0x55b1edde5200 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:42.556 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:42.550+0000 7fc9d6600640 1 -- 172.21.15.50:0/1330762586 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b1eda0d4d0 msgr2=0x55b1edde4020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:32:42.556 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:42.550+0000 7fc9d6600640 1 --2- 172.21.15.50:0/1330762586 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b1eda0d4d0 0x55b1edde4020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:42.556 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:42.550+0000 7fc9d6600640 1 -- 172.21.15.50:0/1330762586 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b1edde2af0 con 0x55b1eda2e1b0 2024-08-31T04:32:42.557 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:42.550+0000 7fc9d6600640 1 --2- 172.21.15.50:0/1330762586 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b1eda2e1b0 0x55b1edde4730 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fc9c800f780 tx=0x7fc9c8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66a04f04b2c7d650 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:32:42.557 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:42.550+0000 7fc9b7400640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-08-31T04:32:42.557 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:42.550+0000 7fc9b7400640 1 -- 172.21.15.50:0/1330762586 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9c802c020 con 0x55b1eda2e1b0 2024-08-31T04:32:42.558 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:42.550+0000 7fc9b7400640 1 -- 172.21.15.50:0/1330762586 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8219+0+0 (secure 0 0 0) 0x7fc9c801a7c0 con 0x55b1eda2e1b0 2024-08-31T04:32:42.558 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:42.550+0000 7fc9df7c8740 1 -- 172.21.15.50:0/1330762586 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc9bc032910 con 0x55b1eda2e1b0 2024-08-31T04:32:42.558 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:42.550+0000 7fc9b7400640 1 -- 172.21.15.50:0/1330762586 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) ==== 24+0+0 (secure 0 0 0) 0x7fc9c801a9c0 con 0x55b1eda2e1b0 2024-08-31T04:32:42.558 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:42.550+0000 7fc9df7c8740 10 client.16341 fetch_fsmap learned FSMap version 50 2024-08-31T04:32:42.558 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:42.550+0000 7fc9df7c8740 1 -- 172.21.15.50:0/1330762586 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=4+}) -- 0x55b1ede55ac0 con 0x55b1eda2e1b0 2024-08-31T04:32:42.558 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:42.550+0000 7fc9b7400640 1 -- 172.21.15.50:0/1330762586 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc9bc032910 con 0x55b1eda2e1b0 2024-08-31T04:32:42.558 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:42.550+0000 7fc9b7400640 1 -- 172.21.15.50:0/1330762586 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 50) ==== 8366+0+0 (secure 0 0 0) 0x7fc9c800b040 con 0x55b1eda2e1b0 2024-08-31T04:32:42.558 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:42.550+0000 7fc9df7c8740 10 client.16341 fetch_fsmap finished waiting for FSMap version 50 2024-08-31T04:32:42.558 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:42.550+0000 7fc9df7c8740 10 client.16341 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T04:32:42.558 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:42.550+0000 7fc9df7c8740 20 client.16341 populate_metadata read hostname 'smithi050' 2024-08-31T04:32:42.558 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:42.550+0000 7fc9df7c8740 1 --2- 172.21.15.50:0/1330762586 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x55b1ed9c21c0 0x55b1ede58560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:32:42.558 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:42.550+0000 7fc9df7c8740 4 client.16341 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-31T04:32:42.558 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:42.550+0000 7fc9df7c8740 1 -- 172.21.15.50:0/1330762586 --> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55b1edd44960 con 0x55b1ed9c21c0 2024-08-31T04:32:42.575 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:42.573+0000 7fc9d5c00640 1 --2- 172.21.15.50:0/1330762586 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x55b1ed9c21c0 0x55b1ede58560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:32:42.634 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:42.632+0000 7fc9b7400640 10 client.16341 ms_handle_connect on v2:172.21.15.133:6838/2526402262 2024-08-31T04:32:42.634 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:42.632+0000 7fc9d5c00640 1 --2- 172.21.15.50:0/1330762586 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x55b1ed9c21c0 0x55b1ede58560 crc :-1 s=READY pgs=133 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bcf617d00d5562ca server_cookie=b4d7c058adcdeb6b in_seq=0 out_seq=0 2024-08-31T04:32:42.670 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:42.668+0000 7fc9b7400640 1 -- 172.21.15.50:0/1330762586 <== mds.0 v2:172.21.15.133:6838/2526402262 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55b1edd44960 con 0x55b1ed9c21c0 2024-08-31T04:32:42.670 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:42.668+0000 7fc9b7400640 10 client.16341 handle_command_reply: tid=0 2024-08-31T04:32:42.670 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:42.668+0000 7fc9df7c8740 1 client.16341 shutdown 2024-08-31T04:32:42.670 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:42.668+0000 7fc9df7c8740 1 -- 172.21.15.50:0/1330762586 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b1eda2e1b0 msgr2=0x55b1edde4730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:32:42.670 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:42.668+0000 7fc9df7c8740 1 --2- 172.21.15.50:0/1330762586 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b1eda2e1b0 0x55b1edde4730 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fc9c800f780 tx=0x7fc9c8004a40 comp rx=0 tx=0).stop 2024-08-31T04:32:42.670 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:42.668+0000 7fc9df7c8740 1 -- 172.21.15.50:0/1330762586 shutdown_connections 2024-08-31T04:32:42.670 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:42.668+0000 7fc9df7c8740 1 --2- 172.21.15.50:0/1330762586 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x55b1ed9c21c0 0x55b1ede58560 crc :-1 s=READY pgs=133 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:42.671 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:42.668+0000 7fc9df7c8740 1 --2- 172.21.15.50:0/1330762586 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b1eda2e1b0 0x55b1edde4730 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:42.671 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:42.668+0000 7fc9df7c8740 1 --2- 172.21.15.50:0/1330762586 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b1eda0d4d0 0x55b1edde4020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:42.671 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:42.668+0000 7fc9b7400640 0 client.16341 ms_handle_reset on v2:172.21.15.133:6838/2526402262 2024-08-31T04:32:42.671 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:42.668+0000 7fc9df7c8740 1 --2- 172.21.15.50:0/1330762586 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b1eda052f0 0x55b1edde5200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:42.671 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:42.668+0000 7fc9df7c8740 1 -- 172.21.15.50:0/1330762586 >> 172.21.15.50:0/1330762586 conn(0x55b1eda22300 msgr2=0x55b1eddd7ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:32:42.671 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:42.668+0000 7fc9df7c8740 1 -- 172.21.15.50:0/1330762586 shutdown_connections 2024-08-31T04:32:42.671 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:42.668+0000 7fc9df7c8740 1 -- 172.21.15.50:0/1330762586 wait complete. 2024-08-31T04:32:42.671 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:42.669+0000 7fc9df7c8740 20 client.16341 trim_cache size 0 max 16384 2024-08-31T04:32:42.672 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout:{ 2024-08-31T04:32:42.672 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout: "message": "", 2024-08-31T04:32:42.672 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout: "return_code": 0 2024-08-31T04:32:42.672 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout:} 2024-08-31T04:32:42.672 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:42.669+0000 7fc9d7000640 1 -- 172.21.15.50:0/960400542 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fc9b80b4b30 msgr2=0x7fc9b80b7040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:32:42.673 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:42.669+0000 7fc9d7000640 1 --2- 172.21.15.50:0/960400542 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fc9b80b4b30 0x7fc9b80b7040 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fc9c8005c40 tx=0x7fc9c80095c0 comp rx=0 tx=0).stop 2024-08-31T04:32:42.673 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:42.669+0000 7fc9d7000640 1 -- 172.21.15.50:0/960400542 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc9d0075a90 msgr2=0x7fc9d01a01d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:32:42.673 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:42.669+0000 7fc9d7000640 1 --2- 172.21.15.50:0/960400542 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc9d0075a90 0x7fc9d01a01d0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fc9c400b3f0 tx=0x7fc9c400b8b0 comp rx=0 tx=0).stop 2024-08-31T04:32:42.673 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:42.669+0000 7fc9d7000640 1 -- 172.21.15.50:0/960400542 shutdown_connections 2024-08-31T04:32:42.673 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:42.669+0000 7fc9d7000640 1 --2- 172.21.15.50:0/960400542 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fc9b80b4b30 0x7fc9b80b7040 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:42.673 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:42.669+0000 7fc9d7000640 1 --2- 172.21.15.50:0/960400542 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc9d010fa00 0x7fc9d01a13f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:42.673 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:42.669+0000 7fc9d7000640 1 --2- 172.21.15.50:0/960400542 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc9d0076e90 0x7fc9d01a0840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:42.673 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:42.669+0000 7fc9d7000640 1 --2- 172.21.15.50:0/960400542 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc9d0075a90 0x7fc9d01a01d0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:42.673 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:42.669+0000 7fc9d7000640 1 -- 172.21.15.50:0/960400542 >> 172.21.15.50:0/960400542 conn(0x7fc9d00febc0 msgr2=0x7fc9d0102c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:32:42.673 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:42.669+0000 7fc9d7000640 1 -- 172.21.15.50:0/960400542 shutdown_connections 2024-08-31T04:32:42.673 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:42.669+0000 7fc9d7000640 1 -- 172.21.15.50:0/960400542 wait complete. 2024-08-31T04:32:43.671 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:32:43 smithi050 ceph-mon[17259]: pgmap v663: 97 pgs: 97 active+clean; 1.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 401 KiB/s rd, 104 KiB/s wr, 29 op/s 2024-08-31T04:32:43.996 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:32:43 smithi177 ceph-mon[22025]: pgmap v663: 97 pgs: 97 active+clean; 1.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 401 KiB/s rd, 104 KiB/s wr, 29 op/s 2024-08-31T04:32:44.043 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:32:43 smithi133 ceph-mon[22177]: pgmap v663: 97 pgs: 97 active+clean; 1.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 401 KiB/s rd, 104 KiB/s wr, 29 op/s 2024-08-31T04:32:45.649 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:32:45 smithi050 ceph-mon[17259]: pgmap v664: 97 pgs: 97 active+clean; 1.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 391 KiB/s rd, 96 KiB/s wr, 25 op/s 2024-08-31T04:32:45.996 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:32:45 smithi177 ceph-mon[22025]: pgmap v664: 97 pgs: 97 active+clean; 1.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 391 KiB/s rd, 96 KiB/s wr, 25 op/s 2024-08-31T04:32:46.043 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:32:45 smithi133 ceph-mon[22177]: pgmap v664: 97 pgs: 97 active+clean; 1.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 391 KiB/s rd, 96 KiB/s wr, 25 op/s 2024-08-31T04:32:47.665 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:32:47 smithi050 ceph-mon[17259]: pgmap v665: 97 pgs: 97 active+clean; 1.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 404 KiB/s rd, 109 KiB/s wr, 29 op/s 2024-08-31T04:32:47.996 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:32:47 smithi177 ceph-mon[22025]: pgmap v665: 97 pgs: 97 active+clean; 1.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 404 KiB/s rd, 109 KiB/s wr, 29 op/s 2024-08-31T04:32:48.043 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:32:47 smithi133 ceph-mon[22177]: pgmap v665: 97 pgs: 97 active+clean; 1.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 404 KiB/s rd, 109 KiB/s wr, 29 op/s 2024-08-31T04:32:49.637 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:32:49 smithi050 ceph-mon[17259]: pgmap v666: 97 pgs: 97 active+clean; 1.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 413 KiB/s rd, 117 KiB/s wr, 30 op/s 2024-08-31T04:32:49.996 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:32:49 smithi177 ceph-mon[22025]: pgmap v666: 97 pgs: 97 active+clean; 1.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 413 KiB/s rd, 117 KiB/s wr, 30 op/s 2024-08-31T04:32:50.043 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:32:49 smithi133 ceph-mon[22177]: pgmap v666: 97 pgs: 97 active+clean; 1.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 413 KiB/s rd, 117 KiB/s wr, 30 op/s 2024-08-31T04:32:51.617 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:32:51 smithi050 ceph-mon[17259]: pgmap v667: 97 pgs: 97 active+clean; 1.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 305 KiB/s rd, 114 KiB/s wr, 24 op/s 2024-08-31T04:32:51.617 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:32:51 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T04:32:51.618 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:32:51 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:32:51.618 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:32:51 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T04:32:51.618 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:32:51 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:32:51.996 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:32:51 smithi177 ceph-mon[22025]: pgmap v667: 97 pgs: 97 active+clean; 1.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 305 KiB/s rd, 114 KiB/s wr, 24 op/s 2024-08-31T04:32:51.996 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:32:51 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T04:32:51.996 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:32:51 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:32:51.996 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:32:51 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T04:32:51.996 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:32:51 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:32:52.043 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:32:51 smithi133 ceph-mon[22177]: pgmap v667: 97 pgs: 97 active+clean; 1.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 305 KiB/s rd, 114 KiB/s wr, 24 op/s 2024-08-31T04:32:52.043 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:32:51 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T04:32:52.043 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:32:51 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:32:52.043 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:32:51 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T04:32:52.043 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:32:51 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:32:53.630 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:32:53 smithi050 ceph-mon[17259]: pgmap v668: 97 pgs: 97 active+clean; 1.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 241 KiB/s rd, 112 KiB/s wr, 24 op/s 2024-08-31T04:32:53.996 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:32:53 smithi177 ceph-mon[22025]: pgmap v668: 97 pgs: 97 active+clean; 1.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 241 KiB/s rd, 112 KiB/s wr, 24 op/s 2024-08-31T04:32:54.043 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:32:53 smithi133 ceph-mon[22177]: pgmap v668: 97 pgs: 97 active+clean; 1.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 241 KiB/s rd, 112 KiB/s wr, 24 op/s 2024-08-31T04:32:54.760 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:32:54 smithi050 ceph-mon[17259]: 1 slow requests, 1 included below; oldest blocked for > 185.003465 secs 2024-08-31T04:32:54.760 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:32:54 smithi050 ceph-mon[17259]: slow request 185.003465 seconds old, received at 2024-08-31T04:29:48.639299+0000: peer_request(client.15282:310817.0 authpin) currently failed to wrlock, waiting 2024-08-31T04:32:54.760 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:32:54 smithi050 ceph-mon[17259]: 1 slow requests, 1 included below; oldest blocked for > 187.349967 secs 2024-08-31T04:32:54.760 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:32:54 smithi050 ceph-mon[17259]: slow request 185.093353 seconds old, received at 2024-08-31T04:29:48.620614+0000: client_request(client.15282:310901 mkdir owner_uid=1000, owner_gid=1333 #0x10000000399/blog-432 2024-08-31T04:29:48.618910+0000 caller_uid=1000, caller_gid=1333{6,36,1000,1333,}) currently failed to wrlock, waiting 2024-08-31T04:32:54.996 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:32:54 smithi177 ceph-mon[22025]: 1 slow requests, 1 included below; oldest blocked for > 185.003465 secs 2024-08-31T04:32:54.996 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:32:54 smithi177 ceph-mon[22025]: slow request 185.003465 seconds old, received at 2024-08-31T04:29:48.639299+0000: peer_request(client.15282:310817.0 authpin) currently failed to wrlock, waiting 2024-08-31T04:32:54.996 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:32:54 smithi177 ceph-mon[22025]: 1 slow requests, 1 included below; oldest blocked for > 187.349967 secs 2024-08-31T04:32:54.996 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:32:54 smithi177 ceph-mon[22025]: slow request 185.093353 seconds old, received at 2024-08-31T04:29:48.620614+0000: client_request(client.15282:310901 mkdir owner_uid=1000, owner_gid=1333 #0x10000000399/blog-432 2024-08-31T04:29:48.618910+0000 caller_uid=1000, caller_gid=1333{6,36,1000,1333,}) currently failed to wrlock, waiting 2024-08-31T04:32:55.043 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:32:54 smithi133 ceph-mon[22177]: 1 slow requests, 1 included below; oldest blocked for > 185.003465 secs 2024-08-31T04:32:55.043 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:32:54 smithi133 ceph-mon[22177]: slow request 185.003465 seconds old, received at 2024-08-31T04:29:48.639299+0000: peer_request(client.15282:310817.0 authpin) currently failed to wrlock, waiting 2024-08-31T04:32:55.043 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:32:54 smithi133 ceph-mon[22177]: 1 slow requests, 1 included below; oldest blocked for > 187.349967 secs 2024-08-31T04:32:55.043 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:32:54 smithi133 ceph-mon[22177]: slow request 185.093353 seconds old, received at 2024-08-31T04:29:48.620614+0000: client_request(client.15282:310901 mkdir owner_uid=1000, owner_gid=1333 #0x10000000399/blog-432 2024-08-31T04:29:48.618910+0000 caller_uid=1000, caller_gid=1333{6,36,1000,1333,}) currently failed to wrlock, waiting 2024-08-31T04:32:55.854 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:32:55 smithi050 ceph-mon[17259]: pgmap v669: 97 pgs: 97 active+clean; 1.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 21 KiB/s wr, 12 op/s 2024-08-31T04:32:55.854 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:32:55 smithi050 ceph-mon[17259]: Health check failed: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2024-08-31T04:32:55.855 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:32:55 smithi050 ceph-mon[17259]: mds.? [v2:172.21.15.50:6840/575209862,v1:172.21.15.50:6841/575209862] up:active 2024-08-31T04:32:55.855 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:32:55 smithi050 ceph-mon[17259]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-31T04:32:55.855 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:32:55 smithi050 ceph-mon[17259]: 1 slow requests, 1 included below; oldest blocked for > 189.059122 secs 2024-08-31T04:32:55.855 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:32:55 smithi050 ceph-mon[17259]: slow request 189.059121 seconds old, received at 2024-08-31T04:29:46.423971+0000: client_request(client.15282:310817 rename #0x10000000461/comment-3.xml #0x10000000461/comment-3.xml.tmp 2024-08-31T04:29:46.325967+0000 caller_uid=1000, caller_gid=1333{6,36,1000,1333,}) currently failed to wrlock, dropping remote wrlock and waiting 2024-08-31T04:32:55.862 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:55.858+0000 7ff6aaa00640 1 -- 172.21.15.50:0/3738028687 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff6a4104ca0 msgr2=0x7ff6a410b640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:32:55.863 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:55.858+0000 7ff6aaa00640 1 --2- 172.21.15.50:0/3738028687 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff6a4104ca0 0x7ff6a410b640 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7ff69c009900 tx=0x7ff69c02a410 comp rx=0 tx=0).stop 2024-08-31T04:32:55.863 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:55.858+0000 7ff6aaa00640 1 -- 172.21.15.50:0/3738028687 shutdown_connections 2024-08-31T04:32:55.863 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:55.858+0000 7ff6aaa00640 1 --2- 172.21.15.50:0/3738028687 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff6a4104300 0x7ff6a4104710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:55.863 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:55.858+0000 7ff6aaa00640 1 --2- 172.21.15.50:0/3738028687 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff6a4104ca0 0x7ff6a410b640 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:55.863 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:55.858+0000 7ff6aaa00640 1 --2- 172.21.15.50:0/3738028687 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff6a4103280 0x7ff6a41036f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:55.863 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:55.858+0000 7ff6aaa00640 1 -- 172.21.15.50:0/3738028687 >> 172.21.15.50:0/3738028687 conn(0x7ff6a40febc0 msgr2=0x7ff6a4101070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:32:55.863 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:55.858+0000 7ff6aaa00640 1 -- 172.21.15.50:0/3738028687 shutdown_connections 2024-08-31T04:32:55.863 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:55.858+0000 7ff6aaa00640 1 -- 172.21.15.50:0/3738028687 wait complete. 2024-08-31T04:32:55.864 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:55.858+0000 7ff6aaa00640 1 Processor -- start 2024-08-31T04:32:55.864 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:55.858+0000 7ff6aaa00640 1 -- start start 2024-08-31T04:32:55.866 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:55.858+0000 7ff6aaa00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff6a4103280 0x7ff6a419bd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:32:55.866 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:55.858+0000 7ff6aaa00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff6a4104300 0x7ff6a419c370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:32:55.866 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:55.858+0000 7ff6aaa00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff6a4104ca0 0x7ff6a419cf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:32:55.866 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:55.858+0000 7ff6aaa00640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7ff6a410ef50 con 0x7ff6a4104ca0 2024-08-31T04:32:55.866 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:55.858+0000 7ff6aaa00640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7ff6a410edd0 con 0x7ff6a4103280 2024-08-31T04:32:55.866 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:55.858+0000 7ff6aaa00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7ff6a410f0d0 con 0x7ff6a4104300 2024-08-31T04:32:55.866 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:55.858+0000 7ff6a9600640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff6a4103280 0x7ff6a419bd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:32:55.866 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:55.858+0000 7ff6aa000640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff6a4104ca0 0x7ff6a419cf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:32:55.866 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:55.858+0000 7ff6a9600640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff6a4103280 0x7ff6a419bd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.50:49212/0 (socket says 172.21.15.50:49212) 2024-08-31T04:32:55.867 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:55.858+0000 7ff6a9600640 1 -- 172.21.15.50:0/2845903015 learned_addr learned my addr 172.21.15.50:0/2845903015 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:32:55.867 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:55.858+0000 7ff6a8c00640 1 --2- 172.21.15.50:0/2845903015 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff6a4104300 0x7ff6a419c370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:32:55.867 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:55.864+0000 7ff6aa000640 1 -- 172.21.15.50:0/2845903015 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff6a4104300 msgr2=0x7ff6a419c370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:32:55.867 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:55.864+0000 7ff6aa000640 1 --2- 172.21.15.50:0/2845903015 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff6a4104300 0x7ff6a419c370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:55.867 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:55.864+0000 7ff6aa000640 1 -- 172.21.15.50:0/2845903015 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff6a4103280 msgr2=0x7ff6a419bd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:32:55.867 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:55.864+0000 7ff6aa000640 1 --2- 172.21.15.50:0/2845903015 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff6a4103280 0x7ff6a419bd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:55.867 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:55.864+0000 7ff6aa000640 1 -- 172.21.15.50:0/2845903015 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6a419d740 con 0x7ff6a4104ca0 2024-08-31T04:32:55.867 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:55.864+0000 7ff6a9600640 1 --2- 172.21.15.50:0/2845903015 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff6a4103280 0x7ff6a419bd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:32:55.867 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:55.864+0000 7ff6a8c00640 1 --2- 172.21.15.50:0/2845903015 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff6a4104300 0x7ff6a419c370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:32:55.867 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:55.864+0000 7ff6aa000640 1 --2- 172.21.15.50:0/2845903015 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff6a4104ca0 0x7ff6a419cf20 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7ff69c02a930 tx=0x7ff69c003b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:32:55.867 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:55.864+0000 7ff6a2000640 1 -- 172.21.15.50:0/2845903015 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff69c03f070 con 0x7ff6a4104ca0 2024-08-31T04:32:55.867 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:55.864+0000 7ff6a2000640 1 -- 172.21.15.50:0/2845903015 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff69c031c50 con 0x7ff6a4104ca0 2024-08-31T04:32:55.867 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:55.864+0000 7ff6a2000640 1 -- 172.21.15.50:0/2845903015 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff69c035030 con 0x7ff6a4104ca0 2024-08-31T04:32:55.868 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:55.864+0000 7ff6aaa00640 1 -- 172.21.15.50:0/2845903015 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff6a419d9d0 con 0x7ff6a4104ca0 2024-08-31T04:32:55.868 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:55.864+0000 7ff6aaa00640 1 -- 172.21.15.50:0/2845903015 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff6a41a4120 con 0x7ff6a4104ca0 2024-08-31T04:32:55.869 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:55.864+0000 7ff6b30c7740 1 Processor -- start 2024-08-31T04:32:55.869 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:55.864+0000 7ff6a2000640 1 -- 172.21.15.50:0/2845903015 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 18) ==== 152577+0+0 (secure 0 0 0) 0x7ff69c042070 con 0x7ff6a4104ca0 2024-08-31T04:32:55.870 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:55.869+0000 7ff6b30c7740 1 -- start start 2024-08-31T04:32:55.871 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:55.869+0000 7ff6b30c7740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557513b5d1b0 0x557513f02fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:32:55.871 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:55.869+0000 7ff6b30c7740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557513b342f0 0x557513f03610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:32:55.871 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:55.869+0000 7ff6b30c7740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x557513b3c4d0 0x557513f04160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:32:55.871 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:55.869+0000 7ff6b30c7740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x557513e75f70 con 0x557513b5d1b0 2024-08-31T04:32:55.871 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:55.869+0000 7ff6b30c7740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x557513e65500 con 0x557513b3c4d0 2024-08-31T04:32:55.871 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:55.869+0000 7ff6b30c7740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x557513e694b0 con 0x557513b342f0 2024-08-31T04:32:55.871 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:55.869+0000 7ff6a8c00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557513b5d1b0 0x557513f02fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:32:55.872 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:55.869+0000 7ff6a8c00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557513b5d1b0 0x557513f02fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:60834/0 (socket says 172.21.15.50:60834) 2024-08-31T04:32:55.872 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:55.869+0000 7ff6a8c00640 1 -- 172.21.15.50:0/1107778526 learned_addr learned my addr 172.21.15.50:0/1107778526 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:32:55.872 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:55.869+0000 7ff6a9600640 1 --2- 172.21.15.50:0/1107778526 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557513b342f0 0x557513f03610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:32:55.873 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:55.869+0000 7ff6a8c00640 1 --2- 172.21.15.50:0/1107778526 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x557513b3c4d0 0x557513f04160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:32:55.874 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:55.869+0000 7ff6a8c00640 1 -- 172.21.15.50:0/1107778526 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557513b342f0 msgr2=0x557513f03610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:32:55.874 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:55.869+0000 7ff6a8c00640 1 --2- 172.21.15.50:0/1107778526 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557513b342f0 0x557513f03610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:55.874 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:55.869+0000 7ff6a8c00640 1 -- 172.21.15.50:0/1107778526 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x557513b3c4d0 msgr2=0x557513f04160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:32:55.874 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:55.869+0000 7ff6a8c00640 1 --2- 172.21.15.50:0/1107778526 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x557513b3c4d0 0x557513f04160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:55.874 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:55.869+0000 7ff6a8c00640 1 -- 172.21.15.50:0/1107778526 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557513e1fc10 con 0x557513b5d1b0 2024-08-31T04:32:55.874 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:55.869+0000 7ff6a2000640 1 --2- 172.21.15.50:0/2845903015 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7ff68c0b4bb0 0x7ff68c0b70c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:32:55.874 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:55.869+0000 7ff6a8c00640 1 --2- 172.21.15.50:0/1107778526 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557513b5d1b0 0x557513f02fa0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7ff690013a80 tx=0x7ff690009c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=157db6810abb1bfc server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:32:55.874 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:55.869+0000 7ff6a2000640 1 -- 172.21.15.50:0/2845903015 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8219+0+0 (secure 0 0 0) 0x7ff69c1056f0 con 0x7ff6a4104ca0 2024-08-31T04:32:55.874 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:55.869+0000 7ff6a9600640 1 --2- 172.21.15.50:0/2845903015 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7ff68c0b4bb0 0x7ff68c0b70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:32:55.874 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:55.869+0000 7ff696600640 1 -- 172.21.15.50:0/1107778526 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff690004030 con 0x557513b5d1b0 2024-08-31T04:32:55.874 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:55.869+0000 7ff696600640 1 -- 172.21.15.50:0/1107778526 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff69000f980 con 0x557513b5d1b0 2024-08-31T04:32:55.875 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:55.869+0000 7ff696600640 1 -- 172.21.15.50:0/1107778526 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff690003a90 con 0x557513b5d1b0 2024-08-31T04:32:55.875 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:55.869+0000 7ff6b30c7740 1 -- 172.21.15.50:0/1107778526 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557513b5d1b0 msgr2=0x557513f02fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:32:55.875 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:55.869+0000 7ff6b30c7740 1 --2- 172.21.15.50:0/1107778526 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557513b5d1b0 0x557513f02fa0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7ff690013a80 tx=0x7ff690009c60 comp rx=0 tx=0).stop 2024-08-31T04:32:55.875 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:55.869+0000 7ff6a9600640 1 --2- 172.21.15.50:0/2845903015 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7ff68c0b4bb0 0x7ff68c0b70c0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7ff6980119d0 tx=0x7ff698009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:32:55.876 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:55.869+0000 7ff6b30c7740 1 -- 172.21.15.50:0/1107778526 shutdown_connections 2024-08-31T04:32:55.876 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:55.869+0000 7ff6b30c7740 1 --2- 172.21.15.50:0/1107778526 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557513b342f0 0x557513f03610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:55.876 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:55.869+0000 7ff6b30c7740 1 --2- 172.21.15.50:0/1107778526 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x557513b3c4d0 0x557513f04160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:55.876 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:55.869+0000 7ff6b30c7740 1 --2- 172.21.15.50:0/1107778526 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557513b5d1b0 0x557513f02fa0 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:55.876 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:55.869+0000 7ff6b30c7740 1 -- 172.21.15.50:0/1107778526 >> 172.21.15.50:0/1107778526 conn(0x557513b51300 msgr2=0x557513efea30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:32:55.876 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:55.869+0000 7ff6b30c7740 1 -- 172.21.15.50:0/1107778526 shutdown_connections 2024-08-31T04:32:55.876 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:55.869+0000 7ff6b30c7740 1 -- 172.21.15.50:0/1107778526 wait complete. 2024-08-31T04:32:55.876 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:55.869+0000 7ff6b30c7740 1 -- start start 2024-08-31T04:32:55.876 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:55.869+0000 7ff6b30c7740 1 Processor -- start 2024-08-31T04:32:55.876 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:55.869+0000 7ff6b30c7740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557513b342f0 0x557513f0c670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:32:55.877 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:55.869+0000 7ff6b30c7740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557513b3c4d0 0x557513f0cd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:32:55.877 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:55.869+0000 7ff6b30c7740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x557513b5d1b0 0x557513f0d8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:32:55.877 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:55.869+0000 7ff6b30c7740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x557513d9eab0 con 0x557513b342f0 2024-08-31T04:32:55.880 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:55.869+0000 7ff6b30c7740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x557513e0c320 con 0x557513b5d1b0 2024-08-31T04:32:55.880 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:55.869+0000 7ff6b30c7740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x557513f04c80 con 0x557513b3c4d0 2024-08-31T04:32:55.880 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:55.869+0000 7ff6b30c7740 10 client.0 _ll_register_callbacks cb 0x557513e126a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:32:55.880 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:55.869+0000 7ff6a9600640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557513b342f0 0x557513f0c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:32:55.880 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:55.869+0000 7ff6aa000640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x557513b5d1b0 0x557513f0d8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:32:55.881 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:55.869+0000 7ff6a9600640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557513b342f0 0x557513f0c670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:60844/0 (socket says 172.21.15.50:60844) 2024-08-31T04:32:55.881 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:55.869+0000 7ff6a9600640 1 -- 172.21.15.50:0/3323785750 learned_addr learned my addr 172.21.15.50:0/3323785750 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:32:55.881 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:55.869+0000 7ff6a8c00640 1 --2- 172.21.15.50:0/3323785750 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557513b3c4d0 0x557513f0cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:32:55.881 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:55.874+0000 7ff6aa000640 1 -- 172.21.15.50:0/3323785750 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557513b3c4d0 msgr2=0x557513f0cd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:32:55.881 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:55.874+0000 7ff6aa000640 1 --2- 172.21.15.50:0/3323785750 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557513b3c4d0 0x557513f0cd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:55.881 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:55.874+0000 7ff6aa000640 1 -- 172.21.15.50:0/3323785750 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557513b342f0 msgr2=0x557513f0c670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:32:55.881 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:55.874+0000 7ff6aa000640 1 --2- 172.21.15.50:0/3323785750 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557513b342f0 0x557513f0c670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:55.881 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:55.874+0000 7ff6aa000640 1 -- 172.21.15.50:0/3323785750 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557513bc8790 con 0x557513b5d1b0 2024-08-31T04:32:55.881 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:55.874+0000 7ff6a9600640 1 --2- 172.21.15.50:0/3323785750 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557513b342f0 0x557513f0c670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:32:55.881 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:55.874+0000 7ff6aa000640 1 --2- 172.21.15.50:0/3323785750 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x557513b5d1b0 0x557513f0d8a0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7ff69c031440 tx=0x7ff69c0cb8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=73363d438f08fe6f server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:32:55.881 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:55.874+0000 7ff68aa00640 10 client.0 ms_handle_connect on v2:172.21.15.133:3300/0 2024-08-31T04:32:55.881 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:55.874+0000 7ff68aa00640 1 -- 172.21.15.50:0/3323785750 <== mon.2 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff69c049070 con 0x557513b5d1b0 2024-08-31T04:32:55.881 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:55.874+0000 7ff68aa00640 1 -- 172.21.15.50:0/3323785750 <== mon.2 v2:172.21.15.133:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8219+0+0 (secure 0 0 0) 0x7ff69c0c8410 con 0x557513b5d1b0 2024-08-31T04:32:55.882 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:55.874+0000 7ff6b30c7740 1 -- 172.21.15.50:0/3323785750 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff69000f980 con 0x557513b5d1b0 2024-08-31T04:32:55.882 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:55.874+0000 7ff68aa00640 1 -- 172.21.15.50:0/3323785750 <== mon.2 v2:172.21.15.133:3300/0 3 ==== mon_get_version_reply(handle=1 version=51) ==== 24+0+0 (secure 0 0 0) 0x7ff69c0cc180 con 0x557513b5d1b0 2024-08-31T04:32:55.882 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:55.874+0000 7ff6b30c7740 10 client.26327 fetch_fsmap learned FSMap version 51 2024-08-31T04:32:55.882 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:55.874+0000 7ff6b30c7740 1 -- 172.21.15.50:0/3323785750 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,fsmap=51,monmap=4+}) -- 0x557513c41620 con 0x557513b5d1b0 2024-08-31T04:32:55.882 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:55.874+0000 7ff68aa00640 1 -- 172.21.15.50:0/3323785750 <== mon.2 v2:172.21.15.133:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff69000f980 con 0x557513b5d1b0 2024-08-31T04:32:55.882 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:55.874+0000 7ff68aa00640 1 -- 172.21.15.50:0/3323785750 <== mon.2 v2:172.21.15.133:3300/0 5 ==== fsmap(e 51) ==== 8366+0+0 (secure 0 0 0) 0x7ff69c0d4f60 con 0x557513b5d1b0 2024-08-31T04:32:55.882 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:55.874+0000 7ff6b30c7740 10 client.26327 fetch_fsmap finished waiting for FSMap version 51 2024-08-31T04:32:55.882 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:55.874+0000 7ff6b30c7740 10 client.26327 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T04:32:55.882 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:55.874+0000 7ff6b30c7740 20 client.26327 populate_metadata read hostname 'smithi050' 2024-08-31T04:32:55.882 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:55.874+0000 7ff6b30c7740 1 --2- 172.21.15.50:0/3323785750 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x557513b1bd80 0x557513f19ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:32:55.882 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:55.874+0000 7ff6b30c7740 4 client.26327 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T04:32:55.882 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:55.874+0000 7ff6b30c7740 1 -- 172.21.15.50:0/3323785750 --> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557513e77ec0 con 0x557513b1bd80 2024-08-31T04:32:55.882 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:55.874+0000 7ff6a9600640 1 --2- 172.21.15.50:0/3323785750 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x557513b1bd80 0x557513f19ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:32:55.883 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:55.877+0000 7ff6a9600640 1 --2- 172.21.15.50:0/3323785750 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x557513b1bd80 0x557513f19ea0 crc :-1 s=READY pgs=134 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7e6fcc8241f9af29 server_cookie=6b40dbc231358256 in_seq=0 out_seq=0 2024-08-31T04:32:55.883 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:55.877+0000 7ff68aa00640 10 client.26327 ms_handle_connect on v2:172.21.15.133:6838/2526402262 2024-08-31T04:32:55.883 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:55.877+0000 7ff68aa00640 1 -- 172.21.15.50:0/3323785750 <== mds.0 v2:172.21.15.133:6838/2526402262 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x557513e77ec0 con 0x557513b1bd80 2024-08-31T04:32:55.883 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:55.877+0000 7ff68aa00640 10 client.26327 handle_command_reply: tid=0 2024-08-31T04:32:55.883 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:55.877+0000 7ff6b30c7740 1 client.26327 shutdown 2024-08-31T04:32:55.883 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:55.877+0000 7ff6b30c7740 1 -- 172.21.15.50:0/3323785750 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x557513b5d1b0 msgr2=0x557513f0d8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:32:55.883 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:55.877+0000 7ff6b30c7740 1 --2- 172.21.15.50:0/3323785750 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x557513b5d1b0 0x557513f0d8a0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7ff69c031440 tx=0x7ff69c0cb8f0 comp rx=0 tx=0).stop 2024-08-31T04:32:55.883 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:55.877+0000 7ff6b30c7740 1 -- 172.21.15.50:0/3323785750 shutdown_connections 2024-08-31T04:32:55.883 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:55.877+0000 7ff6b30c7740 1 --2- 172.21.15.50:0/3323785750 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x557513b1bd80 0x557513f19ea0 crc :-1 s=READY pgs=134 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:55.883 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:55.877+0000 7ff6b30c7740 1 --2- 172.21.15.50:0/3323785750 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557513b3c4d0 0x557513f0cd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:55.883 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:55.877+0000 7ff6b30c7740 1 --2- 172.21.15.50:0/3323785750 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x557513b5d1b0 0x557513f0d8a0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:55.884 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:55.877+0000 7ff6b30c7740 1 --2- 172.21.15.50:0/3323785750 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557513b342f0 0x557513f0c670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:55.884 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:55.877+0000 7ff68aa00640 0 client.26327 ms_handle_reset on v2:172.21.15.133:6838/2526402262 2024-08-31T04:32:55.884 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:55.877+0000 7ff6b30c7740 1 -- 172.21.15.50:0/3323785750 >> 172.21.15.50:0/3323785750 conn(0x557513b51300 msgr2=0x557513efcf40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:32:55.884 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:55.877+0000 7ff6b30c7740 1 -- 172.21.15.50:0/3323785750 shutdown_connections 2024-08-31T04:32:55.884 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:55.877+0000 7ff6b30c7740 1 -- 172.21.15.50:0/3323785750 wait complete. 2024-08-31T04:32:55.884 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:55.877+0000 7ff6b30c7740 20 client.26327 trim_cache size 0 max 16384 2024-08-31T04:32:55.907 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:55.906+0000 7ff6b30c7740 1 Processor -- start 2024-08-31T04:32:55.907 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:55.906+0000 7ff6b30c7740 1 -- start start 2024-08-31T04:32:55.908 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:55.906+0000 7ff6b30c7740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557513b342f0 0x557513efe3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:32:55.909 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:55.906+0000 7ff6b30c7740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557513b3c4d0 0x557513ef9660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:32:55.909 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:55.906+0000 7ff6b30c7740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x557513b5d1b0 0x557513f03e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:32:55.909 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:55.906+0000 7ff6b30c7740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7ff6a41acca0 con 0x557513b3c4d0 2024-08-31T04:32:55.909 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:55.906+0000 7ff6b30c7740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7ff6a41ae7e0 con 0x557513b5d1b0 2024-08-31T04:32:55.909 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:55.906+0000 7ff6b30c7740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7ff6a41ad370 con 0x557513b342f0 2024-08-31T04:32:55.909 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:55.906+0000 7ff6a8c00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557513b3c4d0 0x557513ef9660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:32:55.909 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:55.906+0000 7ff6a8c00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557513b3c4d0 0x557513ef9660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:60860/0 (socket says 172.21.15.50:60860) 2024-08-31T04:32:55.909 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:55.906+0000 7ff6a8c00640 1 -- 172.21.15.50:0/529940789 learned_addr learned my addr 172.21.15.50:0/529940789 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:32:55.909 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:55.906+0000 7ff6a9600640 1 --2- 172.21.15.50:0/529940789 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557513b342f0 0x557513efe3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:32:55.909 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:55.906+0000 7ff6aa000640 1 --2- 172.21.15.50:0/529940789 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x557513b5d1b0 0x557513f03e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:32:55.909 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:55.906+0000 7ff6a8c00640 1 -- 172.21.15.50:0/529940789 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557513b342f0 msgr2=0x557513efe3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:32:55.909 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:55.906+0000 7ff6a8c00640 1 --2- 172.21.15.50:0/529940789 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557513b342f0 0x557513efe3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:55.909 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:55.906+0000 7ff6a8c00640 1 -- 172.21.15.50:0/529940789 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x557513b5d1b0 msgr2=0x557513f03e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:32:55.910 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:55.906+0000 7ff6a8c00640 1 --2- 172.21.15.50:0/529940789 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x557513b5d1b0 0x557513f03e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:55.910 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:55.906+0000 7ff6a8c00640 1 -- 172.21.15.50:0/529940789 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557513f0d190 con 0x557513b3c4d0 2024-08-31T04:32:55.912 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:55.906+0000 7ff6aa000640 1 --2- 172.21.15.50:0/529940789 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x557513b5d1b0 0x557513f03e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:32:55.912 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:55.906+0000 7ff6a8c00640 1 --2- 172.21.15.50:0/529940789 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557513b3c4d0 0x557513ef9660 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7ff6900058c0 tx=0x7ff690013600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40ee55993ab3526d server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:32:55.912 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:55.906+0000 7ff695c00640 1 -- 172.21.15.50:0/529940789 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff69000f980 con 0x557513b3c4d0 2024-08-31T04:32:55.912 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:55.906+0000 7ff695c00640 1 -- 172.21.15.50:0/529940789 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff690005070 con 0x557513b3c4d0 2024-08-31T04:32:55.912 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:55.906+0000 7ff695c00640 1 -- 172.21.15.50:0/529940789 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff690003a60 con 0x557513b3c4d0 2024-08-31T04:32:55.912 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:55.906+0000 7ff6b30c7740 1 -- 172.21.15.50:0/529940789 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557513b3c4d0 msgr2=0x557513ef9660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:32:55.913 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:55.906+0000 7ff6b30c7740 1 --2- 172.21.15.50:0/529940789 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557513b3c4d0 0x557513ef9660 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7ff6900058c0 tx=0x7ff690013600 comp rx=0 tx=0).stop 2024-08-31T04:32:55.913 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:55.906+0000 7ff6b30c7740 1 -- 172.21.15.50:0/529940789 shutdown_connections 2024-08-31T04:32:55.913 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:55.906+0000 7ff6b30c7740 1 --2- 172.21.15.50:0/529940789 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x557513b5d1b0 0x557513f03e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:55.913 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:55.906+0000 7ff6b30c7740 1 --2- 172.21.15.50:0/529940789 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557513b3c4d0 0x557513ef9660 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:55.913 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:55.906+0000 7ff6b30c7740 1 --2- 172.21.15.50:0/529940789 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557513b342f0 0x557513efe3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:55.913 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:55.906+0000 7ff6b30c7740 1 -- 172.21.15.50:0/529940789 >> 172.21.15.50:0/529940789 conn(0x557513b51300 msgr2=0x557513f0b890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:32:55.913 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:55.906+0000 7ff6b30c7740 1 -- 172.21.15.50:0/529940789 shutdown_connections 2024-08-31T04:32:55.913 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:55.906+0000 7ff6b30c7740 1 -- 172.21.15.50:0/529940789 wait complete. 2024-08-31T04:32:55.913 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:55.906+0000 7ff6b30c7740 1 -- start start 2024-08-31T04:32:55.913 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:55.906+0000 7ff6b30c7740 1 Processor -- start 2024-08-31T04:32:55.913 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:55.906+0000 7ff6b30c7740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557513b342f0 0x557513f14020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:32:55.913 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:55.906+0000 7ff6b30c7740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x557513b3c4d0 0x557513f12ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:32:55.914 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:55.906+0000 7ff6b30c7740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557513b5d1b0 0x557513f13330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:32:55.914 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:55.906+0000 7ff6b30c7740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7ff6a41ae110 con 0x557513b342f0 2024-08-31T04:32:55.914 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:55.906+0000 7ff6b30c7740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7ff6a41ada40 con 0x557513b3c4d0 2024-08-31T04:32:55.916 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:55.906+0000 7ff6b30c7740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7ff6a41aac80 con 0x557513b5d1b0 2024-08-31T04:32:55.916 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:55.906+0000 7ff6b30c7740 10 client.0 _ll_register_callbacks cb 0x7ff69c0cc040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:32:55.916 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:55.906+0000 7ff6a9600640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557513b342f0 0x557513f14020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:32:55.916 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:55.906+0000 7ff6a9600640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557513b342f0 0x557513f14020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:60872/0 (socket says 172.21.15.50:60872) 2024-08-31T04:32:55.916 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:55.906+0000 7ff6a9600640 1 -- 172.21.15.50:0/3900232364 learned_addr learned my addr 172.21.15.50:0/3900232364 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:32:55.916 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:55.906+0000 7ff6a8c00640 1 --2- 172.21.15.50:0/3900232364 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x557513b3c4d0 0x557513f12ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:32:55.916 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:55.906+0000 7ff6aa000640 1 --2- 172.21.15.50:0/3900232364 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557513b5d1b0 0x557513f13330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:32:55.917 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:55.906+0000 7ff6a9600640 1 -- 172.21.15.50:0/3900232364 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557513b5d1b0 msgr2=0x557513f13330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:32:55.917 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:55.906+0000 7ff6a9600640 1 --2- 172.21.15.50:0/3900232364 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557513b5d1b0 0x557513f13330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:55.917 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:55.906+0000 7ff6a9600640 1 -- 172.21.15.50:0/3900232364 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x557513b3c4d0 msgr2=0x557513f12ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:32:55.917 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:55.906+0000 7ff6a9600640 1 --2- 172.21.15.50:0/3900232364 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x557513b3c4d0 0x557513f12ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:55.917 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:55.906+0000 7ff6a9600640 1 -- 172.21.15.50:0/3900232364 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557513f13aa0 con 0x557513b342f0 2024-08-31T04:32:55.917 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:55.911+0000 7ff6a9600640 1 --2- 172.21.15.50:0/3900232364 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557513b342f0 0x557513f14020 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7ff69800f790 tx=0x7ff698004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6cbb8531e35ece3b server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:32:55.917 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:55.911+0000 7ff68aa00640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-08-31T04:32:55.917 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:55.911+0000 7ff68aa00640 1 -- 172.21.15.50:0/3900232364 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff69801eb30 con 0x557513b342f0 2024-08-31T04:32:55.917 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:55.911+0000 7ff68aa00640 1 -- 172.21.15.50:0/3900232364 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8219+0+0 (secure 0 0 0) 0x7ff69801ecd0 con 0x557513b342f0 2024-08-31T04:32:55.917 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:55.911+0000 7ff6b30c7740 1 -- 172.21.15.50:0/3900232364 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff690005070 con 0x557513b342f0 2024-08-31T04:32:55.917 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:55.911+0000 7ff68aa00640 1 -- 172.21.15.50:0/3900232364 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=51) ==== 24+0+0 (secure 0 0 0) 0x7ff698003970 con 0x557513b342f0 2024-08-31T04:32:55.917 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:55.911+0000 7ff6b30c7740 10 client.16359 fetch_fsmap learned FSMap version 51 2024-08-31T04:32:55.917 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:55.911+0000 7ff6b30c7740 1 -- 172.21.15.50:0/3900232364 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=51,monmap=4+}) -- 0x557513f84990 con 0x557513b342f0 2024-08-31T04:32:55.917 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:55.911+0000 7ff68aa00640 1 -- 172.21.15.50:0/3900232364 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff690005070 con 0x557513b342f0 2024-08-31T04:32:55.918 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:55.912+0000 7ff68aa00640 1 -- 172.21.15.50:0/3900232364 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 51) ==== 8366+0+0 (secure 0 0 0) 0x7ff698030430 con 0x557513b342f0 2024-08-31T04:32:55.918 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:55.912+0000 7ff6b30c7740 10 client.16359 fetch_fsmap finished waiting for FSMap version 51 2024-08-31T04:32:55.918 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:55.912+0000 7ff6b30c7740 10 client.16359 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T04:32:55.918 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:55.912+0000 7ff6b30c7740 20 client.16359 populate_metadata read hostname 'smithi050' 2024-08-31T04:32:55.918 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:55.912+0000 7ff6b30c7740 1 --2- 172.21.15.50:0/3900232364 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x557513af11c0 0x557513f87360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:32:55.918 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:55.912+0000 7ff6b30c7740 4 client.16359 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-31T04:32:55.918 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:55.912+0000 7ff6b30c7740 1 -- 172.21.15.50:0/3900232364 --> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] -- command(tid 0: {"prefix": "flush journal"}) -- 0x557513e73960 con 0x557513af11c0 2024-08-31T04:32:55.918 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:55.912+0000 7ff6a8c00640 1 --2- 172.21.15.50:0/3900232364 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x557513af11c0 0x557513f87360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:32:55.918 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:55.912+0000 7ff6a8c00640 1 --2- 172.21.15.50:0/3900232364 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x557513af11c0 0x557513f87360 crc :-1 s=READY pgs=135 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=32f27bf7cf88753f server_cookie=23829f519b4969c8 in_seq=0 out_seq=0 2024-08-31T04:32:55.918 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:55.912+0000 7ff68aa00640 10 client.16359 ms_handle_connect on v2:172.21.15.133:6838/2526402262 2024-08-31T04:32:55.922 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:55.918+0000 7ff68aa00640 1 -- 172.21.15.50:0/3900232364 <== mds.0 v2:172.21.15.133:6838/2526402262 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x557513e73960 con 0x557513af11c0 2024-08-31T04:32:55.922 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:55.918+0000 7ff68aa00640 10 client.16359 handle_command_reply: tid=0 2024-08-31T04:32:55.922 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:55.918+0000 7ff6b30c7740 1 client.16359 shutdown 2024-08-31T04:32:55.922 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:55.918+0000 7ff6b30c7740 1 -- 172.21.15.50:0/3900232364 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557513b342f0 msgr2=0x557513f14020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:32:55.922 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:55.918+0000 7ff6b30c7740 1 --2- 172.21.15.50:0/3900232364 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557513b342f0 0x557513f14020 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7ff69800f790 tx=0x7ff698004a40 comp rx=0 tx=0).stop 2024-08-31T04:32:55.922 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:55.918+0000 7ff6b30c7740 1 -- 172.21.15.50:0/3900232364 shutdown_connections 2024-08-31T04:32:55.923 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:55.918+0000 7ff6b30c7740 1 --2- 172.21.15.50:0/3900232364 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x557513af11c0 0x557513f87360 crc :-1 s=READY pgs=135 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:55.923 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:55.918+0000 7ff6b30c7740 1 --2- 172.21.15.50:0/3900232364 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557513b5d1b0 0x557513f13330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:55.923 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:55.918+0000 7ff6b30c7740 1 --2- 172.21.15.50:0/3900232364 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x557513b3c4d0 0x557513f12ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:55.923 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:55.918+0000 7ff68aa00640 0 client.16359 ms_handle_reset on v2:172.21.15.133:6838/2526402262 2024-08-31T04:32:55.923 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:55.918+0000 7ff6b30c7740 1 --2- 172.21.15.50:0/3900232364 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557513b342f0 0x557513f14020 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:55.923 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:55.918+0000 7ff6b30c7740 1 -- 172.21.15.50:0/3900232364 >> 172.21.15.50:0/3900232364 conn(0x557513b51300 msgr2=0x557513ef9660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:32:55.923 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:55.918+0000 7ff6b30c7740 1 -- 172.21.15.50:0/3900232364 shutdown_connections 2024-08-31T04:32:55.923 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:55.918+0000 7ff6b30c7740 1 -- 172.21.15.50:0/3900232364 wait complete. 2024-08-31T04:32:55.923 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:55.918+0000 7ff6b30c7740 20 client.16359 trim_cache size 0 max 16384 2024-08-31T04:32:55.923 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout:{ 2024-08-31T04:32:55.923 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout: "message": "", 2024-08-31T04:32:55.924 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout: "return_code": 0 2024-08-31T04:32:55.924 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout:} 2024-08-31T04:32:55.924 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:55.918+0000 7ff6aaa00640 1 -- 172.21.15.50:0/2845903015 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7ff68c0b4bb0 msgr2=0x7ff68c0b70c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:32:55.924 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:55.918+0000 7ff6aaa00640 1 --2- 172.21.15.50:0/2845903015 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7ff68c0b4bb0 0x7ff68c0b70c0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7ff6980119d0 tx=0x7ff698009500 comp rx=0 tx=0).stop 2024-08-31T04:32:55.925 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:55.918+0000 7ff6aaa00640 1 -- 172.21.15.50:0/2845903015 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff6a4104ca0 msgr2=0x7ff6a419cf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:32:55.925 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:55.918+0000 7ff6aaa00640 1 --2- 172.21.15.50:0/2845903015 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff6a4104ca0 0x7ff6a419cf20 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7ff69c02a930 tx=0x7ff69c003b90 comp rx=0 tx=0).stop 2024-08-31T04:32:55.925 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:55.918+0000 7ff6aaa00640 1 -- 172.21.15.50:0/2845903015 shutdown_connections 2024-08-31T04:32:55.925 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:55.918+0000 7ff6aaa00640 1 --2- 172.21.15.50:0/2845903015 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7ff68c0b4bb0 0x7ff68c0b70c0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:55.925 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:55.918+0000 7ff6aaa00640 1 --2- 172.21.15.50:0/2845903015 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff6a4104300 0x7ff6a419c370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:55.925 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:55.918+0000 7ff6aaa00640 1 --2- 172.21.15.50:0/2845903015 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff6a4104ca0 0x7ff6a419cf20 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:55.925 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:55.918+0000 7ff6aaa00640 1 --2- 172.21.15.50:0/2845903015 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff6a4103280 0x7ff6a419bd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:32:55.925 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:55.918+0000 7ff6aaa00640 1 -- 172.21.15.50:0/2845903015 >> 172.21.15.50:0/2845903015 conn(0x7ff6a40febc0 msgr2=0x7ff6a4075390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:32:55.925 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:55.918+0000 7ff6aaa00640 1 -- 172.21.15.50:0/2845903015 shutdown_connections 2024-08-31T04:32:55.925 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:32:55.918+0000 7ff6aaa00640 1 -- 172.21.15.50:0/2845903015 wait complete. 2024-08-31T04:32:55.996 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:32:55 smithi177 ceph-mon[22025]: pgmap v669: 97 pgs: 97 active+clean; 1.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 21 KiB/s wr, 12 op/s 2024-08-31T04:32:55.996 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:32:55 smithi177 ceph-mon[22025]: Health check failed: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2024-08-31T04:32:55.996 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:32:55 smithi177 ceph-mon[22025]: mds.? [v2:172.21.15.50:6840/575209862,v1:172.21.15.50:6841/575209862] up:active 2024-08-31T04:32:55.996 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:32:55 smithi177 ceph-mon[22025]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-31T04:32:55.996 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:32:55 smithi177 ceph-mon[22025]: 1 slow requests, 1 included below; oldest blocked for > 189.059122 secs 2024-08-31T04:32:55.997 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:32:55 smithi177 ceph-mon[22025]: slow request 189.059121 seconds old, received at 2024-08-31T04:29:46.423971+0000: client_request(client.15282:310817 rename #0x10000000461/comment-3.xml #0x10000000461/comment-3.xml.tmp 2024-08-31T04:29:46.325967+0000 caller_uid=1000, caller_gid=1333{6,36,1000,1333,}) currently failed to wrlock, dropping remote wrlock and waiting 2024-08-31T04:32:56.043 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:32:55 smithi133 ceph-mon[22177]: pgmap v669: 97 pgs: 97 active+clean; 1.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 21 KiB/s wr, 12 op/s 2024-08-31T04:32:56.043 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:32:55 smithi133 ceph-mon[22177]: Health check failed: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2024-08-31T04:32:56.043 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:32:55 smithi133 ceph-mon[22177]: mds.? [v2:172.21.15.50:6840/575209862,v1:172.21.15.50:6841/575209862] up:active 2024-08-31T04:32:56.043 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:32:55 smithi133 ceph-mon[22177]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-31T04:32:56.043 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:32:55 smithi133 ceph-mon[22177]: 1 slow requests, 1 included below; oldest blocked for > 189.059122 secs 2024-08-31T04:32:56.043 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:32:55 smithi133 ceph-mon[22177]: slow request 189.059121 seconds old, received at 2024-08-31T04:29:46.423971+0000: client_request(client.15282:310817 rename #0x10000000461/comment-3.xml #0x10000000461/comment-3.xml.tmp 2024-08-31T04:29:46.325967+0000 caller_uid=1000, caller_gid=1333{6,36,1000,1333,}) currently failed to wrlock, dropping remote wrlock and waiting 2024-08-31T04:32:57.869 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:32:57 smithi050 ceph-mon[17259]: pgmap v670: 97 pgs: 97 active+clean; 1.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 21 KiB/s wr, 14 op/s 2024-08-31T04:32:57.996 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:32:57 smithi177 ceph-mon[22025]: pgmap v670: 97 pgs: 97 active+clean; 1.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 21 KiB/s wr, 14 op/s 2024-08-31T04:32:58.043 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:32:57 smithi133 ceph-mon[22177]: pgmap v670: 97 pgs: 97 active+clean; 1.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 21 KiB/s wr, 14 op/s 2024-08-31T04:32:58.717 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:32:58 smithi050 ceph-mon[17259]: mds.? [v2:172.21.15.133:6836/4014853202,v1:172.21.15.133:6837/4014853202] up:active 2024-08-31T04:32:58.717 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:32:58 smithi050 ceph-mon[17259]: mds.? [v2:172.21.15.177:6836/2159859285,v1:172.21.15.177:6837/2159859285] up:active 2024-08-31T04:32:58.718 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:32:58 smithi050 ceph-mon[17259]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-31T04:32:58.997 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:32:58 smithi177 ceph-mon[22025]: mds.? [v2:172.21.15.133:6836/4014853202,v1:172.21.15.133:6837/4014853202] up:active 2024-08-31T04:32:58.997 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:32:58 smithi177 ceph-mon[22025]: mds.? [v2:172.21.15.177:6836/2159859285,v1:172.21.15.177:6837/2159859285] up:active 2024-08-31T04:32:58.997 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:32:58 smithi177 ceph-mon[22025]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-31T04:32:59.043 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:32:58 smithi133 ceph-mon[22177]: mds.? [v2:172.21.15.133:6836/4014853202,v1:172.21.15.133:6837/4014853202] up:active 2024-08-31T04:32:59.043 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:32:58 smithi133 ceph-mon[22177]: mds.? [v2:172.21.15.177:6836/2159859285,v1:172.21.15.177:6837/2159859285] up:active 2024-08-31T04:32:59.043 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:32:58 smithi133 ceph-mon[22177]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-31T04:32:59.836 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:32:59 smithi050 ceph-mon[17259]: pgmap v671: 97 pgs: 97 active+clean; 1.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 17 KiB/s wr, 12 op/s 2024-08-31T04:32:59.836 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:32:59 smithi050 ceph-mon[17259]: 1 slow requests, 0 included below; oldest blocked for > 190.003599 secs 2024-08-31T04:32:59.836 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:32:59 smithi050 ceph-mon[17259]: 1 slow requests, 0 included below; oldest blocked for > 192.350038 secs 2024-08-31T04:32:59.996 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:32:59 smithi177 ceph-mon[22025]: pgmap v671: 97 pgs: 97 active+clean; 1.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 17 KiB/s wr, 12 op/s 2024-08-31T04:32:59.996 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:32:59 smithi177 ceph-mon[22025]: 1 slow requests, 0 included below; oldest blocked for > 190.003599 secs 2024-08-31T04:32:59.996 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:32:59 smithi177 ceph-mon[22025]: 1 slow requests, 0 included below; oldest blocked for > 192.350038 secs 2024-08-31T04:33:00.043 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:32:59 smithi133 ceph-mon[22177]: pgmap v671: 97 pgs: 97 active+clean; 1.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 17 KiB/s wr, 12 op/s 2024-08-31T04:33:00.043 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:32:59 smithi133 ceph-mon[22177]: 1 slow requests, 0 included below; oldest blocked for > 190.003599 secs 2024-08-31T04:33:00.043 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:32:59 smithi133 ceph-mon[22177]: 1 slow requests, 0 included below; oldest blocked for > 192.350038 secs 2024-08-31T04:33:00.695 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:33:00 smithi050 ceph-mon[17259]: 1 slow requests, 0 included below; oldest blocked for > 194.059253 secs 2024-08-31T04:33:00.996 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:33:00 smithi177 ceph-mon[22025]: 1 slow requests, 0 included below; oldest blocked for > 194.059253 secs 2024-08-31T04:33:01.043 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:33:00 smithi133 ceph-mon[22177]: 1 slow requests, 0 included below; oldest blocked for > 194.059253 secs 2024-08-31T04:33:01.813 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:33:01 smithi050 ceph-mon[17259]: pgmap v672: 97 pgs: 97 active+clean; 1.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 8.2 KiB/s wr, 9 op/s 2024-08-31T04:33:01.813 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:33:01 smithi050 ceph-mon[17259]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2024-08-31T04:33:01.996 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:33:01 smithi177 ceph-mon[22025]: pgmap v672: 97 pgs: 97 active+clean; 1.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 8.2 KiB/s wr, 9 op/s 2024-08-31T04:33:01.996 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:33:01 smithi177 ceph-mon[22025]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2024-08-31T04:33:02.043 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:33:01 smithi133 ceph-mon[22177]: pgmap v672: 97 pgs: 97 active+clean; 1.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 8.2 KiB/s wr, 9 op/s 2024-08-31T04:33:02.043 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:33:01 smithi133 ceph-mon[22177]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2024-08-31T04:33:03.754 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:33:03 smithi050 ceph-mon[17259]: pgmap v673: 97 pgs: 97 active+clean; 1.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 8.2 KiB/s wr, 12 op/s 2024-08-31T04:33:03.996 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:33:03 smithi177 ceph-mon[22025]: pgmap v673: 97 pgs: 97 active+clean; 1.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 8.2 KiB/s wr, 12 op/s 2024-08-31T04:33:04.043 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:33:03 smithi133 ceph-mon[22177]: pgmap v673: 97 pgs: 97 active+clean; 1.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 8.2 KiB/s wr, 12 op/s 2024-08-31T04:33:04.886 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:33:04 smithi050 ceph-mon[17259]: 1 slow requests, 0 included below; oldest blocked for > 195.003632 secs 2024-08-31T04:33:04.887 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:33:04 smithi050 ceph-mon[17259]: 1 slow requests, 0 included below; oldest blocked for > 197.350130 secs 2024-08-31T04:33:04.996 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:33:04 smithi177 ceph-mon[22025]: 1 slow requests, 0 included below; oldest blocked for > 195.003632 secs 2024-08-31T04:33:04.996 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:33:04 smithi177 ceph-mon[22025]: 1 slow requests, 0 included below; oldest blocked for > 197.350130 secs 2024-08-31T04:33:05.043 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:33:04 smithi133 ceph-mon[22177]: 1 slow requests, 0 included below; oldest blocked for > 195.003632 secs 2024-08-31T04:33:05.043 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:33:04 smithi133 ceph-mon[22177]: 1 slow requests, 0 included below; oldest blocked for > 197.350130 secs 2024-08-31T04:33:05.714 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:33:05 smithi050 ceph-mon[17259]: pgmap v674: 97 pgs: 97 active+clean; 1.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 8.1 KiB/s wr, 8 op/s 2024-08-31T04:33:05.714 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:33:05 smithi050 ceph-mon[17259]: 1 slow requests, 0 included below; oldest blocked for > 199.059375 secs 2024-08-31T04:33:05.996 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:33:05 smithi177 ceph-mon[22025]: pgmap v674: 97 pgs: 97 active+clean; 1.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 8.1 KiB/s wr, 8 op/s 2024-08-31T04:33:05.996 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:33:05 smithi177 ceph-mon[22025]: 1 slow requests, 0 included below; oldest blocked for > 199.059375 secs 2024-08-31T04:33:06.043 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:33:05 smithi133 ceph-mon[22177]: pgmap v674: 97 pgs: 97 active+clean; 1.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 8.1 KiB/s wr, 8 op/s 2024-08-31T04:33:06.043 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:33:05 smithi133 ceph-mon[22177]: 1 slow requests, 0 included below; oldest blocked for > 199.059375 secs 2024-08-31T04:33:07.934 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:33:07 smithi050 ceph-mon[17259]: pgmap v675: 97 pgs: 97 active+clean; 1.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 8.1 KiB/s wr, 10 op/s 2024-08-31T04:33:07.996 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:33:07 smithi177 ceph-mon[22025]: pgmap v675: 97 pgs: 97 active+clean; 1.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 8.1 KiB/s wr, 10 op/s 2024-08-31T04:33:08.043 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:33:07 smithi133 ceph-mon[22177]: pgmap v675: 97 pgs: 97 active+clean; 1.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 8.1 KiB/s wr, 10 op/s 2024-08-31T04:33:09.115 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:09.112+0000 7f9177e00640 1 -- 172.21.15.50:0/3848502200 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9178104300 msgr2=0x7f9178104710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:33:09.115 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:09.112+0000 7f9177e00640 1 --2- 172.21.15.50:0/3848502200 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9178104300 0x7f9178104710 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f9160009900 tx=0x7f916002a410 comp rx=0 tx=0).stop 2024-08-31T04:33:09.115 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:09.112+0000 7f9177e00640 1 -- 172.21.15.50:0/3848502200 shutdown_connections 2024-08-31T04:33:09.115 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:09.112+0000 7f9177e00640 1 --2- 172.21.15.50:0/3848502200 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9178104ca0 0x7f917810b640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:09.115 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:09.112+0000 7f9177e00640 1 --2- 172.21.15.50:0/3848502200 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9178104300 0x7f9178104710 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:09.115 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:09.112+0000 7f9177e00640 1 --2- 172.21.15.50:0/3848502200 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9178103280 0x7f91781036f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:09.115 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:09.112+0000 7f9177e00640 1 -- 172.21.15.50:0/3848502200 >> 172.21.15.50:0/3848502200 conn(0x7f91780febc0 msgr2=0x7f9178101070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:33:09.115 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:09.112+0000 7f9177e00640 1 -- 172.21.15.50:0/3848502200 shutdown_connections 2024-08-31T04:33:09.115 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:09.112+0000 7f9177e00640 1 -- 172.21.15.50:0/3848502200 wait complete. 2024-08-31T04:33:09.118 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:09.112+0000 7f9177e00640 1 Processor -- start 2024-08-31T04:33:09.118 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:09.112+0000 7f9177e00640 1 -- start start 2024-08-31T04:33:09.118 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:09.112+0000 7f9177e00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9178103280 0x7f9178076bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:33:09.118 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:09.112+0000 7f9177e00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9178104300 0x7f91780754b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:33:09.118 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:09.112+0000 7f9177e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9178104ca0 0x7f91780759f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:33:09.118 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:09.112+0000 7f9177e00640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f917810ef50 con 0x7f9178104ca0 2024-08-31T04:33:09.118 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:09.112+0000 7f9177e00640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f917810edd0 con 0x7f9178103280 2024-08-31T04:33:09.118 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:09.112+0000 7f9177e00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f917810f0d0 con 0x7f9178104300 2024-08-31T04:33:09.118 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:09.112+0000 7f916e000640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9178104300 0x7f91780754b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:33:09.118 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:09.112+0000 7f9177400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9178104ca0 0x7f91780759f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:33:09.119 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:09.112+0000 7f916e000640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9178104300 0x7f91780754b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.50:36530/0 (socket says 172.21.15.50:36530) 2024-08-31T04:33:09.119 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:09.112+0000 7f916e000640 1 -- 172.21.15.50:0/3024120708 learned_addr learned my addr 172.21.15.50:0/3024120708 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:33:09.119 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:09.112+0000 7f916e000640 1 -- 172.21.15.50:0/3024120708 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9178103280 msgr2=0x7f9178076bf0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-08-31T04:33:09.119 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:09.112+0000 7f916e000640 1 --2- 172.21.15.50:0/3024120708 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9178103280 0x7f9178076bf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:09.119 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:09.112+0000 7f916e000640 1 -- 172.21.15.50:0/3024120708 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9178104ca0 msgr2=0x7f91780759f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:33:09.119 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:09.112+0000 7f916e000640 1 --2- 172.21.15.50:0/3024120708 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9178104ca0 0x7f91780759f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:09.119 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:09.112+0000 7f916e000640 1 -- 172.21.15.50:0/3024120708 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9178076120 con 0x7f9178104300 2024-08-31T04:33:09.119 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:09.112+0000 7f9177400640 1 --2- 172.21.15.50:0/3024120708 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9178104ca0 0x7f91780759f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:33:09.119 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:09.112+0000 7f916e000640 1 --2- 172.21.15.50:0/3024120708 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9178104300 0x7f91780754b0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f9160031440 tx=0x7f9160003c10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:33:09.119 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:09.112+0000 7f916fe00640 1 -- 172.21.15.50:0/3024120708 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f916003f070 con 0x7f9178104300 2024-08-31T04:33:09.119 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:09.112+0000 7f9177e00640 1 -- 172.21.15.50:0/3024120708 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f91781a3bb0 con 0x7f9178104300 2024-08-31T04:33:09.119 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:09.112+0000 7f916fe00640 1 -- 172.21.15.50:0/3024120708 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9160031c50 con 0x7f9178104300 2024-08-31T04:33:09.119 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:09.112+0000 7f916fe00640 1 -- 172.21.15.50:0/3024120708 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9160035030 con 0x7f9178104300 2024-08-31T04:33:09.119 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:09.112+0000 7f9177e00640 1 -- 172.21.15.50:0/3024120708 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f91781a3fb0 con 0x7f9178104300 2024-08-31T04:33:09.120 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:09.118+0000 7f9184bba740 1 Processor -- start 2024-08-31T04:33:09.120 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:09.118+0000 7f9184bba740 1 -- start start 2024-08-31T04:33:09.121 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:09.118+0000 7f9184bba740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ef378ef1b0 0x55ef37c94fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:33:09.122 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:09.118+0000 7f9184bba740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ef378c62f0 0x55ef37c95610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:33:09.122 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:09.118+0000 7f9184bba740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ef378ce4d0 0x55ef37c96160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:33:09.122 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:09.118+0000 7f9184bba740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55ef37c07f70 con 0x55ef378ef1b0 2024-08-31T04:33:09.122 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:09.118+0000 7f9184bba740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x55ef37bf7500 con 0x55ef378ce4d0 2024-08-31T04:33:09.122 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:09.118+0000 7f9184bba740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x55ef37bfb4b0 con 0x55ef378c62f0 2024-08-31T04:33:09.122 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:09.118+0000 7f9177400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ef378ef1b0 0x55ef37c94fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:33:09.122 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:09.118+0000 7f9176a00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ef378c62f0 0x55ef37c95610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:33:09.122 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:09.118+0000 7f9176a00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ef378c62f0 0x55ef37c95610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.50:36544/0 (socket says 172.21.15.50:36544) 2024-08-31T04:33:09.122 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:09.118+0000 7f9176a00640 1 -- 172.21.15.50:0/4167163258 learned_addr learned my addr 172.21.15.50:0/4167163258 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:33:09.122 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:09.118+0000 7f9177400640 1 -- 172.21.15.50:0/4167163258 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ef378c62f0 msgr2=0x55ef37c95610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:33:09.123 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:09.118+0000 7f9177400640 1 --2- 172.21.15.50:0/4167163258 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ef378c62f0 0x55ef37c95610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:09.123 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:09.118+0000 7f916fe00640 1 -- 172.21.15.50:0/3024120708 <== mon.1 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 18) ==== 152577+0+0 (secure 0 0 0) 0x7f9160042070 con 0x7f9178104300 2024-08-31T04:33:09.123 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:09.118+0000 7f9177400640 1 -- 172.21.15.50:0/4167163258 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ef378ce4d0 msgr2=0x55ef37c96160 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-31T04:33:09.123 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:09.118+0000 7f9177400640 1 --2- 172.21.15.50:0/4167163258 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ef378ce4d0 0x55ef37c96160 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:09.123 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:09.118+0000 7f9177400640 1 -- 172.21.15.50:0/4167163258 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ef37bb1c10 con 0x55ef378ef1b0 2024-08-31T04:33:09.125 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:09.118+0000 7f9177400640 1 --2- 172.21.15.50:0/4167163258 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ef378ef1b0 0x55ef37c94fa0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f9170005fd0 tx=0x7f9170011bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33d3fc8ff5856a16 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:33:09.125 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:09.118+0000 7f9167e00640 1 -- 172.21.15.50:0/4167163258 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9170004d20 con 0x55ef378ef1b0 2024-08-31T04:33:09.126 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:09.118+0000 7f9167e00640 1 -- 172.21.15.50:0/4167163258 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f917000f9a0 con 0x55ef378ef1b0 2024-08-31T04:33:09.126 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:09.118+0000 7f9167e00640 1 -- 172.21.15.50:0/4167163258 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91700043d0 con 0x55ef378ef1b0 2024-08-31T04:33:09.126 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:09.118+0000 7f9184bba740 1 -- 172.21.15.50:0/4167163258 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ef378ef1b0 msgr2=0x55ef37c94fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:33:09.126 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:09.118+0000 7f9184bba740 1 --2- 172.21.15.50:0/4167163258 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ef378ef1b0 0x55ef37c94fa0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f9170005fd0 tx=0x7f9170011bf0 comp rx=0 tx=0).stop 2024-08-31T04:33:09.126 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:09.118+0000 7f9184bba740 1 -- 172.21.15.50:0/4167163258 shutdown_connections 2024-08-31T04:33:09.126 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:09.118+0000 7f9184bba740 1 --2- 172.21.15.50:0/4167163258 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ef378c62f0 0x55ef37c95610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:09.126 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:09.118+0000 7f9184bba740 1 --2- 172.21.15.50:0/4167163258 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ef378ce4d0 0x55ef37c96160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:09.126 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:09.118+0000 7f9184bba740 1 --2- 172.21.15.50:0/4167163258 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ef378ef1b0 0x55ef37c94fa0 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:09.126 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:09.118+0000 7f9184bba740 1 -- 172.21.15.50:0/4167163258 >> 172.21.15.50:0/4167163258 conn(0x55ef378e3300 msgr2=0x55ef37c90a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:33:09.126 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:09.118+0000 7f9184bba740 1 -- 172.21.15.50:0/4167163258 shutdown_connections 2024-08-31T04:33:09.126 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:09.118+0000 7f916fe00640 1 --2- 172.21.15.50:0/3024120708 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f915c0b4ae0 0x7f915c0b6ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:33:09.126 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:09.118+0000 7f9184bba740 1 -- 172.21.15.50:0/4167163258 wait complete. 2024-08-31T04:33:09.127 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:09.118+0000 7f9176a00640 1 --2- 172.21.15.50:0/3024120708 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f915c0b4ae0 0x7f915c0b6ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:33:09.127 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:09.118+0000 7f916fe00640 1 -- 172.21.15.50:0/3024120708 <== mon.1 v2:172.21.15.177:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8219+0+0 (secure 0 0 0) 0x7f9160105960 con 0x7f9178104300 2024-08-31T04:33:09.127 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:09.118+0000 7f9184bba740 1 -- start start 2024-08-31T04:33:09.127 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:09.118+0000 7f9176a00640 1 --2- 172.21.15.50:0/3024120708 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f915c0b4ae0 0x7f915c0b6ff0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f9168009b30 tx=0x7f9168005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:33:09.127 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:09.118+0000 7f9184bba740 1 Processor -- start 2024-08-31T04:33:09.127 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:09.123+0000 7f9184bba740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ef378c62f0 0x55ef37c9e670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:33:09.127 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:09.123+0000 7f9184bba740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ef378ce4d0 0x55ef37c9ed30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:33:09.127 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:09.123+0000 7f9184bba740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ef378ef1b0 0x55ef37c9f8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:33:09.127 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:09.123+0000 7f9184bba740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55ef37b30ab0 con 0x55ef378c62f0 2024-08-31T04:33:09.127 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:09.123+0000 7f9184bba740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x55ef37b9e320 con 0x55ef378ef1b0 2024-08-31T04:33:09.127 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:09.123+0000 7f9184bba740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x55ef37c96c80 con 0x55ef378ce4d0 2024-08-31T04:33:09.127 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:09.123+0000 7f9184bba740 10 client.0 _ll_register_callbacks cb 0x55ef37ba46a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:33:09.127 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:09.123+0000 7f9177400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ef378ef1b0 0x55ef37c9f8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:33:09.128 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:09.123+0000 7f9176a00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ef378c62f0 0x55ef37c9e670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:33:09.128 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:09.123+0000 7f916e000640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ef378ce4d0 0x55ef37c9ed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:33:09.128 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:09.123+0000 7f9177400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ef378ef1b0 0x55ef37c9f8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.50:53910/0 (socket says 172.21.15.50:53910) 2024-08-31T04:33:09.128 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:09.123+0000 7f9176a00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ef378c62f0 0x55ef37c9e670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:34198/0 (socket says 172.21.15.50:34198) 2024-08-31T04:33:09.128 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:09.123+0000 7f9177400640 1 -- 172.21.15.50:0/2529677945 learned_addr learned my addr 172.21.15.50:0/2529677945 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:33:09.128 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:09.123+0000 7f916e000640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ef378ce4d0 0x55ef37c9ed30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.50:36552/0 (socket says 172.21.15.50:36552) 2024-08-31T04:33:09.128 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:09.123+0000 7f916e000640 1 -- 172.21.15.50:0/2529677945 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ef378ef1b0 msgr2=0x55ef37c9f8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:33:09.128 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:09.123+0000 7f916e000640 1 --2- 172.21.15.50:0/2529677945 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ef378ef1b0 0x55ef37c9f8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:09.128 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:09.123+0000 7f916e000640 1 -- 172.21.15.50:0/2529677945 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ef378c62f0 msgr2=0x55ef37c9e670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:33:09.128 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:09.123+0000 7f916e000640 1 --2- 172.21.15.50:0/2529677945 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ef378c62f0 0x55ef37c9e670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:09.128 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:09.123+0000 7f916e000640 1 -- 172.21.15.50:0/2529677945 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ef3795a790 con 0x55ef378ce4d0 2024-08-31T04:33:09.128 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:09.123+0000 7f9176a00640 1 --2- 172.21.15.50:0/2529677945 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ef378c62f0 0x55ef37c9e670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:33:09.131 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:09.124+0000 7f916e000640 1 --2- 172.21.15.50:0/2529677945 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ef378ce4d0 0x55ef37c9ed30 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f91600c9610 tx=0x7f91600cbb10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=72d338f04733450c server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:33:09.131 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:09.124+0000 7f9164c00640 10 client.0 ms_handle_connect on v2:172.21.15.177:3300/0 2024-08-31T04:33:09.131 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:09.124+0000 7f9164c00640 1 -- 172.21.15.50:0/2529677945 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9160049040 con 0x55ef378ce4d0 2024-08-31T04:33:09.131 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:09.124+0000 7f9164c00640 1 -- 172.21.15.50:0/2529677945 <== mon.1 v2:172.21.15.177:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8219+0+0 (secure 0 0 0) 0x7f916003b460 con 0x55ef378ce4d0 2024-08-31T04:33:09.131 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:09.124+0000 7f9184bba740 1 -- 172.21.15.50:0/2529677945 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f917000f9a0 con 0x55ef378ce4d0 2024-08-31T04:33:09.131 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:09.124+0000 7f9164c00640 1 -- 172.21.15.50:0/2529677945 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_get_version_reply(handle=1 version=52) ==== 24+0+0 (secure 0 0 0) 0x7f91600ccaa0 con 0x55ef378ce4d0 2024-08-31T04:33:09.131 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:09.124+0000 7f9184bba740 10 client.26341 fetch_fsmap learned FSMap version 52 2024-08-31T04:33:09.131 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:09.124+0000 7f9184bba740 1 -- 172.21.15.50:0/2529677945 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,fsmap=52,monmap=4+}) -- 0x55ef379d3620 con 0x55ef378ce4d0 2024-08-31T04:33:09.132 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:09.124+0000 7f9164c00640 1 -- 172.21.15.50:0/2529677945 <== mon.1 v2:172.21.15.177:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f917000f9a0 con 0x55ef378ce4d0 2024-08-31T04:33:09.132 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:09.124+0000 7f9164c00640 1 -- 172.21.15.50:0/2529677945 <== mon.1 v2:172.21.15.177:3300/0 5 ==== fsmap(e 52) ==== 8366+0+0 (secure 0 0 0) 0x7f91600c8630 con 0x55ef378ce4d0 2024-08-31T04:33:09.132 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:09.124+0000 7f9184bba740 10 client.26341 fetch_fsmap finished waiting for FSMap version 52 2024-08-31T04:33:09.132 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:09.124+0000 7f9184bba740 10 client.26341 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T04:33:09.132 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:09.124+0000 7f9184bba740 20 client.26341 populate_metadata read hostname 'smithi050' 2024-08-31T04:33:09.132 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:09.124+0000 7f9184bba740 1 --2- 172.21.15.50:0/2529677945 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x55ef378add80 0x55ef37cabd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:33:09.132 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:09.124+0000 7f9184bba740 4 client.26341 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T04:33:09.132 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:09.124+0000 7f9184bba740 1 -- 172.21.15.50:0/2529677945 --> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ef37c09ec0 con 0x55ef378add80 2024-08-31T04:33:09.132 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:09.124+0000 7f9176a00640 1 --2- 172.21.15.50:0/2529677945 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x55ef378add80 0x55ef37cabd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:33:09.132 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:09.124+0000 7f9164c00640 10 client.26341 ms_handle_connect on v2:172.21.15.133:6838/2526402262 2024-08-31T04:33:09.132 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:09.124+0000 7f9176a00640 1 --2- 172.21.15.50:0/2529677945 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x55ef378add80 0x55ef37cabd00 crc :-1 s=READY pgs=136 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=41080eb46bdba555 server_cookie=8b92e71b84bc3b29 in_seq=0 out_seq=0 2024-08-31T04:33:09.132 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:09.124+0000 7f9164c00640 1 -- 172.21.15.50:0/2529677945 <== mds.0 v2:172.21.15.133:6838/2526402262 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55ef37c09ec0 con 0x55ef378add80 2024-08-31T04:33:09.133 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:09.124+0000 7f9164c00640 10 client.26341 handle_command_reply: tid=0 2024-08-31T04:33:09.133 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:09.124+0000 7f9184bba740 1 client.26341 shutdown 2024-08-31T04:33:09.133 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:09.124+0000 7f9184bba740 1 -- 172.21.15.50:0/2529677945 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ef378ce4d0 msgr2=0x55ef37c9ed30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:33:09.133 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:09.124+0000 7f9184bba740 1 --2- 172.21.15.50:0/2529677945 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ef378ce4d0 0x55ef37c9ed30 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f91600c9610 tx=0x7f91600cbb10 comp rx=0 tx=0).stop 2024-08-31T04:33:09.133 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:09.124+0000 7f9184bba740 1 -- 172.21.15.50:0/2529677945 shutdown_connections 2024-08-31T04:33:09.133 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:09.124+0000 7f9184bba740 1 --2- 172.21.15.50:0/2529677945 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x55ef378add80 0x55ef37cabd00 crc :-1 s=READY pgs=136 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:09.133 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:09.124+0000 7f9184bba740 1 --2- 172.21.15.50:0/2529677945 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ef378ce4d0 0x55ef37c9ed30 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:09.133 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:09.124+0000 7f9184bba740 1 --2- 172.21.15.50:0/2529677945 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ef378ef1b0 0x55ef37c9f8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:09.133 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:09.124+0000 7f9164c00640 0 client.26341 ms_handle_reset on v2:172.21.15.133:6838/2526402262 2024-08-31T04:33:09.133 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:09.124+0000 7f9184bba740 1 --2- 172.21.15.50:0/2529677945 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ef378c62f0 0x55ef37c9e670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:09.133 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:09.124+0000 7f9184bba740 1 -- 172.21.15.50:0/2529677945 >> 172.21.15.50:0/2529677945 conn(0x55ef378e3300 msgr2=0x55ef37c8ef40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:33:09.133 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:09.124+0000 7f9184bba740 1 -- 172.21.15.50:0/2529677945 shutdown_connections 2024-08-31T04:33:09.134 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:09.124+0000 7f9184bba740 1 -- 172.21.15.50:0/2529677945 wait complete. 2024-08-31T04:33:09.134 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:09.124+0000 7f9184bba740 20 client.26341 trim_cache size 0 max 16384 2024-08-31T04:33:09.145 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:09.142+0000 7f9184bba740 1 Processor -- start 2024-08-31T04:33:09.145 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:09.142+0000 7f9184bba740 1 -- start start 2024-08-31T04:33:09.146 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:09.142+0000 7f9184bba740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ef378c62f0 0x55ef37c8fdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:33:09.146 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:09.142+0000 7f9184bba740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ef378ce4d0 0x55ef37c9cb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:33:09.146 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:09.142+0000 7f9184bba740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ef378ef1b0 0x55ef37c9d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:33:09.146 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:09.142+0000 7f9184bba740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f91781acc30 con 0x55ef378ef1b0 2024-08-31T04:33:09.146 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:09.142+0000 7f9184bba740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f91781ae770 con 0x55ef378c62f0 2024-08-31T04:33:09.146 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:09.142+0000 7f9184bba740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f91781ad300 con 0x55ef378ce4d0 2024-08-31T04:33:09.146 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:09.142+0000 7f9176a00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ef378c62f0 0x55ef37c8fdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:33:09.146 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:09.142+0000 7f9177400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ef378ef1b0 0x55ef37c9d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:33:09.146 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:09.142+0000 7f916e000640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ef378ce4d0 0x55ef37c9cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:33:09.146 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:09.142+0000 7f9176a00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ef378c62f0 0x55ef37c8fdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.50:53922/0 (socket says 172.21.15.50:53922) 2024-08-31T04:33:09.147 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:09.142+0000 7f9176a00640 1 -- 172.21.15.50:0/2989635024 learned_addr learned my addr 172.21.15.50:0/2989635024 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:33:09.148 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:09.142+0000 7f916e000640 1 -- 172.21.15.50:0/2989635024 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ef378c62f0 msgr2=0x55ef37c8fdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:33:09.148 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:09.142+0000 7f916e000640 1 --2- 172.21.15.50:0/2989635024 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ef378c62f0 0x55ef37c8fdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:09.148 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:09.142+0000 7f916e000640 1 -- 172.21.15.50:0/2989635024 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ef378ef1b0 msgr2=0x55ef37c9d0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:33:09.148 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:09.142+0000 7f916e000640 1 --2- 172.21.15.50:0/2989635024 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ef378ef1b0 0x55ef37c9d0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:09.149 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:09.142+0000 7f916e000640 1 -- 172.21.15.50:0/2989635024 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ef37ca6b40 con 0x55ef378ce4d0 2024-08-31T04:33:09.149 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:09.142+0000 7f9177400640 1 --2- 172.21.15.50:0/2989635024 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ef378ef1b0 0x55ef37c9d0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:33:09.149 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:09.142+0000 7f916e000640 1 --2- 172.21.15.50:0/2989635024 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ef378ce4d0 0x55ef37c9cb80 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f91601034c0 tx=0x7f91600cbc40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bbe56d32b73577ab server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:33:09.149 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:09.142+0000 7f9167400640 1 -- 172.21.15.50:0/2989635024 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9160049070 con 0x55ef378ce4d0 2024-08-31T04:33:09.149 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:09.142+0000 7f9167400640 1 -- 172.21.15.50:0/2989635024 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9160031e00 con 0x55ef378ce4d0 2024-08-31T04:33:09.149 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:09.142+0000 7f9167400640 1 -- 172.21.15.50:0/2989635024 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f916003b460 con 0x55ef378ce4d0 2024-08-31T04:33:09.149 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:09.142+0000 7f9184bba740 1 -- 172.21.15.50:0/2989635024 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ef378ce4d0 msgr2=0x55ef37c9cb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:33:09.149 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:09.142+0000 7f9184bba740 1 --2- 172.21.15.50:0/2989635024 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ef378ce4d0 0x55ef37c9cb80 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f91601034c0 tx=0x7f91600cbc40 comp rx=0 tx=0).stop 2024-08-31T04:33:09.149 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:09.142+0000 7f9184bba740 1 -- 172.21.15.50:0/2989635024 shutdown_connections 2024-08-31T04:33:09.149 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:09.142+0000 7f9184bba740 1 --2- 172.21.15.50:0/2989635024 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ef378ce4d0 0x55ef37c9cb80 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:09.149 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:09.142+0000 7f9184bba740 1 --2- 172.21.15.50:0/2989635024 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ef378ef1b0 0x55ef37c9d0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:09.149 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:09.142+0000 7f9184bba740 1 --2- 172.21.15.50:0/2989635024 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ef378c62f0 0x55ef37c8fdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:09.149 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:09.142+0000 7f9184bba740 1 -- 172.21.15.50:0/2989635024 >> 172.21.15.50:0/2989635024 conn(0x55ef378e3300 msgr2=0x55ef37c8f6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:33:09.150 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:09.142+0000 7f9184bba740 1 -- 172.21.15.50:0/2989635024 shutdown_connections 2024-08-31T04:33:09.150 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:09.142+0000 7f9184bba740 1 -- 172.21.15.50:0/2989635024 wait complete. 2024-08-31T04:33:09.150 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:09.142+0000 7f9184bba740 1 -- start start 2024-08-31T04:33:09.150 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:09.142+0000 7f9184bba740 1 Processor -- start 2024-08-31T04:33:09.152 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:09.147+0000 7f9184bba740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ef378c62f0 0x55ef37ca5e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:33:09.152 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:09.147+0000 7f9184bba740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ef378ce4d0 0x55ef37ca4b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:33:09.152 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:09.147+0000 7f9184bba740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ef378ef1b0 0x55ef37ca5090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:33:09.153 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:09.147+0000 7f9184bba740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f91781ae0a0 con 0x55ef378c62f0 2024-08-31T04:33:09.153 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:09.147+0000 7f9184bba740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f91781ad9d0 con 0x55ef378ce4d0 2024-08-31T04:33:09.153 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:09.147+0000 7f9184bba740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f91781aac10 con 0x55ef378ef1b0 2024-08-31T04:33:09.153 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:09.147+0000 7f9184bba740 10 client.0 _ll_register_callbacks cb 0x7f91600cc170 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:33:09.153 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:09.147+0000 7f9176a00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ef378c62f0 0x55ef37ca5e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:33:09.153 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:09.147+0000 7f9177400640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ef378ef1b0 0x55ef37ca5090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:33:09.153 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:09.147+0000 7f9176a00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ef378c62f0 0x55ef37ca5e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:34208/0 (socket says 172.21.15.50:34208) 2024-08-31T04:33:09.153 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:09.147+0000 7f9176a00640 1 -- 172.21.15.50:0/2097235513 learned_addr learned my addr 172.21.15.50:0/2097235513 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:33:09.153 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:09.147+0000 7f916e000640 1 --2- 172.21.15.50:0/2097235513 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ef378ce4d0 0x55ef37ca4b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:33:09.153 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:09.147+0000 7f9177400640 1 -- 172.21.15.50:0/2097235513 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ef378ce4d0 msgr2=0x55ef37ca4b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:33:09.153 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:09.147+0000 7f9177400640 1 --2- 172.21.15.50:0/2097235513 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ef378ce4d0 0x55ef37ca4b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:09.153 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:09.147+0000 7f9177400640 1 -- 172.21.15.50:0/2097235513 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ef378c62f0 msgr2=0x55ef37ca5e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:33:09.153 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:09.147+0000 7f9177400640 1 --2- 172.21.15.50:0/2097235513 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ef378c62f0 0x55ef37ca5e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:09.154 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:09.147+0000 7f9177400640 1 -- 172.21.15.50:0/2097235513 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ef37ca5780 con 0x55ef378ef1b0 2024-08-31T04:33:09.154 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:09.147+0000 7f9176a00640 1 --2- 172.21.15.50:0/2097235513 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ef378c62f0 0x55ef37ca5e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:33:09.154 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:09.147+0000 7f9177400640 1 --2- 172.21.15.50:0/2097235513 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ef378ef1b0 0x55ef37ca5090 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f9170011730 tx=0x7f9170003c60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f7bc74230beb4b5e server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:33:09.154 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:09.147+0000 7f9164c00640 10 client.0 ms_handle_connect on v2:172.21.15.177:3300/0 2024-08-31T04:33:09.154 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:09.147+0000 7f9164c00640 1 -- 172.21.15.50:0/2097235513 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9170005050 con 0x55ef378ef1b0 2024-08-31T04:33:09.154 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:09.147+0000 7f9184bba740 1 -- 172.21.15.50:0/2097235513 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55ef37c05960 con 0x55ef378ef1b0 2024-08-31T04:33:09.154 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:09.147+0000 7f9164c00640 1 -- 172.21.15.50:0/2097235513 <== mon.1 v2:172.21.15.177:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8219+0+0 (secure 0 0 0) 0x7f91700051f0 con 0x55ef378ef1b0 2024-08-31T04:33:09.154 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:09.147+0000 7f9164c00640 1 -- 172.21.15.50:0/2097235513 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_get_version_reply(handle=1 version=52) ==== 24+0+0 (secure 0 0 0) 0x7f91700053f0 con 0x55ef378ef1b0 2024-08-31T04:33:09.154 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:09.147+0000 7f9184bba740 10 client.26347 fetch_fsmap learned FSMap version 52 2024-08-31T04:33:09.154 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:09.147+0000 7f9184bba740 1 -- 172.21.15.50:0/2097235513 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,fsmap=52,monmap=4+}) -- 0x55ef37d16700 con 0x55ef378ef1b0 2024-08-31T04:33:09.154 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:09.147+0000 7f9164c00640 1 -- 172.21.15.50:0/2097235513 <== mon.1 v2:172.21.15.177:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x55ef37c05960 con 0x55ef378ef1b0 2024-08-31T04:33:09.155 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:09.147+0000 7f9164c00640 1 -- 172.21.15.50:0/2097235513 <== mon.1 v2:172.21.15.177:3300/0 5 ==== fsmap(e 52) ==== 8366+0+0 (secure 0 0 0) 0x7f9170024040 con 0x55ef378ef1b0 2024-08-31T04:33:09.155 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:09.147+0000 7f9184bba740 10 client.26347 fetch_fsmap finished waiting for FSMap version 52 2024-08-31T04:33:09.155 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:09.147+0000 7f9184bba740 10 client.26347 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T04:33:09.155 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:09.147+0000 7f9184bba740 20 client.26347 populate_metadata read hostname 'smithi050' 2024-08-31T04:33:09.155 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:09.147+0000 7f9184bba740 1 --2- 172.21.15.50:0/2097235513 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x55ef378831c0 0x55ef37d18e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:33:09.155 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:09.147+0000 7f9184bba740 4 client.26347 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-31T04:33:09.155 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:09.147+0000 7f9184bba740 1 -- 172.21.15.50:0/2097235513 --> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55ef37c030a0 con 0x55ef378831c0 2024-08-31T04:33:09.155 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:09.147+0000 7f9176a00640 1 --2- 172.21.15.50:0/2097235513 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x55ef378831c0 0x55ef37d18e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:33:09.155 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:09.147+0000 7f9176a00640 1 --2- 172.21.15.50:0/2097235513 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x55ef378831c0 0x55ef37d18e70 crc :-1 s=READY pgs=137 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6be3ad34b17428f server_cookie=836e331b6203e929 in_seq=0 out_seq=0 2024-08-31T04:33:09.155 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:09.147+0000 7f9164c00640 10 client.26347 ms_handle_connect on v2:172.21.15.133:6838/2526402262 2024-08-31T04:33:09.160 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:09.157+0000 7f9164c00640 1 -- 172.21.15.50:0/2097235513 <== mds.0 v2:172.21.15.133:6838/2526402262 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55ef37c030a0 con 0x55ef378831c0 2024-08-31T04:33:09.160 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:09.157+0000 7f9164c00640 10 client.26347 handle_command_reply: tid=0 2024-08-31T04:33:09.160 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:09.158+0000 7f9184bba740 1 client.26347 shutdown 2024-08-31T04:33:09.161 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:09.158+0000 7f9184bba740 1 -- 172.21.15.50:0/2097235513 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ef378ef1b0 msgr2=0x55ef37ca5090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:33:09.161 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:09.158+0000 7f9184bba740 1 --2- 172.21.15.50:0/2097235513 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ef378ef1b0 0x55ef37ca5090 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f9170011730 tx=0x7f9170003c60 comp rx=0 tx=0).stop 2024-08-31T04:33:09.161 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:09.158+0000 7f9184bba740 1 -- 172.21.15.50:0/2097235513 shutdown_connections 2024-08-31T04:33:09.161 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:09.158+0000 7f9184bba740 1 --2- 172.21.15.50:0/2097235513 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x55ef378831c0 0x55ef37d18e70 crc :-1 s=READY pgs=137 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:09.161 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:09.158+0000 7f9184bba740 1 --2- 172.21.15.50:0/2097235513 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ef378ef1b0 0x55ef37ca5090 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:09.161 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:09.158+0000 7f9184bba740 1 --2- 172.21.15.50:0/2097235513 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ef378ce4d0 0x55ef37ca4b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:09.161 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:09.158+0000 7f9184bba740 1 --2- 172.21.15.50:0/2097235513 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ef378c62f0 0x55ef37ca5e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:09.161 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:09.158+0000 7f9164c00640 0 client.26347 ms_handle_reset on v2:172.21.15.133:6838/2526402262 2024-08-31T04:33:09.161 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:09.158+0000 7f9184bba740 1 -- 172.21.15.50:0/2097235513 >> 172.21.15.50:0/2097235513 conn(0x55ef378e3300 msgr2=0x55ef37c94f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:33:09.161 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:09.158+0000 7f9184bba740 1 -- 172.21.15.50:0/2097235513 shutdown_connections 2024-08-31T04:33:09.161 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:09.158+0000 7f9184bba740 1 -- 172.21.15.50:0/2097235513 wait complete. 2024-08-31T04:33:09.161 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:09.158+0000 7f9184bba740 20 client.26347 trim_cache size 0 max 16384 2024-08-31T04:33:09.162 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout:{ 2024-08-31T04:33:09.162 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout: "message": "", 2024-08-31T04:33:09.162 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout: "return_code": 0 2024-08-31T04:33:09.162 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout:} 2024-08-31T04:33:09.163 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:09.158+0000 7f9177e00640 1 -- 172.21.15.50:0/3024120708 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f915c0b4ae0 msgr2=0x7f915c0b6ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:33:09.163 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:09.158+0000 7f9177e00640 1 --2- 172.21.15.50:0/3024120708 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f915c0b4ae0 0x7f915c0b6ff0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f9168009b30 tx=0x7f9168005f90 comp rx=0 tx=0).stop 2024-08-31T04:33:09.163 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:09.158+0000 7f9177e00640 1 -- 172.21.15.50:0/3024120708 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9178104300 msgr2=0x7f91780754b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:33:09.163 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:09.158+0000 7f9177e00640 1 --2- 172.21.15.50:0/3024120708 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9178104300 0x7f91780754b0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f9160031440 tx=0x7f9160003c10 comp rx=0 tx=0).stop 2024-08-31T04:33:09.163 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:09.158+0000 7f9177e00640 1 -- 172.21.15.50:0/3024120708 shutdown_connections 2024-08-31T04:33:09.163 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:09.158+0000 7f9177e00640 1 --2- 172.21.15.50:0/3024120708 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f915c0b4ae0 0x7f915c0b6ff0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:09.163 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:09.158+0000 7f9177e00640 1 --2- 172.21.15.50:0/3024120708 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9178104300 0x7f91780754b0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:09.163 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:09.158+0000 7f9177e00640 1 --2- 172.21.15.50:0/3024120708 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9178104ca0 0x7f91780759f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:09.163 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:09.158+0000 7f9177e00640 1 --2- 172.21.15.50:0/3024120708 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9178103280 0x7f9178076bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:09.163 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:09.158+0000 7f9177e00640 1 -- 172.21.15.50:0/3024120708 >> 172.21.15.50:0/3024120708 conn(0x7f91780febc0 msgr2=0x7f9178107620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:33:09.163 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:09.160+0000 7f9177e00640 1 -- 172.21.15.50:0/3024120708 shutdown_connections 2024-08-31T04:33:09.163 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:09.160+0000 7f9177e00640 1 -- 172.21.15.50:0/3024120708 wait complete. 2024-08-31T04:33:09.928 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:33:09 smithi050 ceph-mon[17259]: pgmap v676: 97 pgs: 97 active+clean; 1.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 8.1 KiB/s wr, 10 op/s 2024-08-31T04:33:09.928 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:33:09 smithi050 ceph-mon[17259]: 1 slow requests, 0 included below; oldest blocked for > 200.003745 secs 2024-08-31T04:33:09.928 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:33:09 smithi050 ceph-mon[17259]: 1 slow requests, 0 included below; oldest blocked for > 202.350216 secs 2024-08-31T04:33:09.996 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:33:09 smithi177 ceph-mon[22025]: pgmap v676: 97 pgs: 97 active+clean; 1.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 8.1 KiB/s wr, 10 op/s 2024-08-31T04:33:09.996 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:33:09 smithi177 ceph-mon[22025]: 1 slow requests, 0 included below; oldest blocked for > 200.003745 secs 2024-08-31T04:33:09.996 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:33:09 smithi177 ceph-mon[22025]: 1 slow requests, 0 included below; oldest blocked for > 202.350216 secs 2024-08-31T04:33:10.044 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:33:09 smithi133 ceph-mon[22177]: pgmap v676: 97 pgs: 97 active+clean; 1.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 8.1 KiB/s wr, 10 op/s 2024-08-31T04:33:10.044 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:33:09 smithi133 ceph-mon[22177]: 1 slow requests, 0 included below; oldest blocked for > 200.003745 secs 2024-08-31T04:33:10.045 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:33:09 smithi133 ceph-mon[22177]: 1 slow requests, 0 included below; oldest blocked for > 202.350216 secs 2024-08-31T04:33:10.741 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:33:10 smithi050 ceph-mon[17259]: 1 slow requests, 0 included below; oldest blocked for > 204.059497 secs 2024-08-31T04:33:10.996 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:33:10 smithi177 ceph-mon[22025]: 1 slow requests, 0 included below; oldest blocked for > 204.059497 secs 2024-08-31T04:33:11.043 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:33:10 smithi133 ceph-mon[22177]: 1 slow requests, 0 included below; oldest blocked for > 204.059497 secs 2024-08-31T04:33:11.870 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:33:11 smithi050 ceph-mon[17259]: pgmap v677: 97 pgs: 97 active+clean; 1.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 2.1 KiB/s wr, 8 op/s 2024-08-31T04:33:11.996 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:33:11 smithi177 ceph-mon[22025]: pgmap v677: 97 pgs: 97 active+clean; 1.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 2.1 KiB/s wr, 8 op/s 2024-08-31T04:33:12.043 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:33:11 smithi133 ceph-mon[22177]: pgmap v677: 97 pgs: 97 active+clean; 1.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 2.1 KiB/s wr, 8 op/s 2024-08-31T04:33:12.846 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:33:12 smithi050 ceph-mon[17259]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-31T04:33:13.043 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:33:12 smithi133 ceph-mon[22177]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-31T04:33:13.246 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:33:12 smithi177 ceph-mon[22025]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-31T04:33:13.975 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:33:13 smithi050 ceph-mon[17259]: pgmap v678: 97 pgs: 97 active+clean; 1.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 8.2 KiB/s wr, 12 op/s 2024-08-31T04:33:14.043 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:33:13 smithi133 ceph-mon[22177]: pgmap v678: 97 pgs: 97 active+clean; 1.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 8.2 KiB/s wr, 12 op/s 2024-08-31T04:33:14.147 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:33:13 smithi177 ceph-mon[22025]: pgmap v678: 97 pgs: 97 active+clean; 1.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 8.2 KiB/s wr, 12 op/s 2024-08-31T04:33:14.834 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:33:14 smithi050 ceph-mon[17259]: 1 slow requests, 0 included below; oldest blocked for > 205.003865 secs 2024-08-31T04:33:14.834 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:33:14 smithi050 ceph-mon[17259]: 1 slow requests, 0 included below; oldest blocked for > 207.350294 secs 2024-08-31T04:33:15.246 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:33:14 smithi177 ceph-mon[22025]: 1 slow requests, 0 included below; oldest blocked for > 205.003865 secs 2024-08-31T04:33:15.246 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:33:14 smithi177 ceph-mon[22025]: 1 slow requests, 0 included below; oldest blocked for > 207.350294 secs 2024-08-31T04:33:15.293 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:33:14 smithi133 ceph-mon[22177]: 1 slow requests, 0 included below; oldest blocked for > 205.003865 secs 2024-08-31T04:33:15.293 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:33:14 smithi133 ceph-mon[22177]: 1 slow requests, 0 included below; oldest blocked for > 207.350294 secs 2024-08-31T04:33:15.976 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:33:15 smithi050 ceph-mon[17259]: pgmap v679: 97 pgs: 97 active+clean; 1.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 8.2 KiB/s wr, 8 op/s 2024-08-31T04:33:15.976 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:33:15 smithi050 ceph-mon[17259]: 1 slow requests, 0 included below; oldest blocked for > 209.059616 secs 2024-08-31T04:33:16.246 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:33:15 smithi177 ceph-mon[22025]: pgmap v679: 97 pgs: 97 active+clean; 1.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 8.2 KiB/s wr, 8 op/s 2024-08-31T04:33:16.246 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:33:15 smithi177 ceph-mon[22025]: 1 slow requests, 0 included below; oldest blocked for > 209.059616 secs 2024-08-31T04:33:16.293 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:33:15 smithi133 ceph-mon[22177]: pgmap v679: 97 pgs: 97 active+clean; 1.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 8.2 KiB/s wr, 8 op/s 2024-08-31T04:33:16.293 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:33:15 smithi133 ceph-mon[22177]: 1 slow requests, 0 included below; oldest blocked for > 209.059616 secs 2024-08-31T04:33:17.105 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:33:16 smithi050 ceph-mon[17259]: pgmap v680: 97 pgs: 97 active+clean; 1.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 8.2 KiB/s wr, 11 op/s 2024-08-31T04:33:17.246 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:33:16 smithi177 ceph-mon[22025]: pgmap v680: 97 pgs: 97 active+clean; 1.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 8.2 KiB/s wr, 11 op/s 2024-08-31T04:33:17.293 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:33:16 smithi133 ceph-mon[22177]: pgmap v680: 97 pgs: 97 active+clean; 1.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 8.2 KiB/s wr, 11 op/s 2024-08-31T04:33:19.352 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:33:19 smithi050 ceph-mon[17259]: pgmap v681: 97 pgs: 97 active+clean; 1.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 8.2 KiB/s wr, 10 op/s 2024-08-31T04:33:19.352 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:33:19 smithi050 ceph-mon[17259]: 1 slow requests, 0 included below; oldest blocked for > 210.003965 secs 2024-08-31T04:33:19.352 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:33:19 smithi050 ceph-mon[17259]: 1 slow requests, 0 included below; oldest blocked for > 212.350384 secs 2024-08-31T04:33:19.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:33:19 smithi177 ceph-mon[22025]: pgmap v681: 97 pgs: 97 active+clean; 1.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 8.2 KiB/s wr, 10 op/s 2024-08-31T04:33:19.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:33:19 smithi177 ceph-mon[22025]: 1 slow requests, 0 included below; oldest blocked for > 210.003965 secs 2024-08-31T04:33:19.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:33:19 smithi177 ceph-mon[22025]: 1 slow requests, 0 included below; oldest blocked for > 212.350384 secs 2024-08-31T04:33:19.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:33:19 smithi133 ceph-mon[22177]: pgmap v681: 97 pgs: 97 active+clean; 1.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 8.2 KiB/s wr, 10 op/s 2024-08-31T04:33:19.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:33:19 smithi133 ceph-mon[22177]: 1 slow requests, 0 included below; oldest blocked for > 210.003965 secs 2024-08-31T04:33:19.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:33:19 smithi133 ceph-mon[22177]: 1 slow requests, 0 included below; oldest blocked for > 212.350384 secs 2024-08-31T04:33:21.332 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:33:21 smithi050 ceph-mon[17259]: pgmap v682: 97 pgs: 97 active+clean; 1.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 8.2 KiB/s wr, 9 op/s 2024-08-31T04:33:21.332 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:33:21 smithi050 ceph-mon[17259]: 1 slow requests, 0 included below; oldest blocked for > 214.059746 secs 2024-08-31T04:33:21.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:33:21 smithi177 ceph-mon[22025]: pgmap v682: 97 pgs: 97 active+clean; 1.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 8.2 KiB/s wr, 9 op/s 2024-08-31T04:33:21.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:33:21 smithi177 ceph-mon[22025]: 1 slow requests, 0 included below; oldest blocked for > 214.059746 secs 2024-08-31T04:33:21.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:33:21 smithi133 ceph-mon[22177]: pgmap v682: 97 pgs: 97 active+clean; 1.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 8.2 KiB/s wr, 9 op/s 2024-08-31T04:33:21.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:33:21 smithi133 ceph-mon[22177]: 1 slow requests, 0 included below; oldest blocked for > 214.059746 secs 2024-08-31T04:33:22.357 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:22.354+0000 7efe96e00640 1 -- 172.21.15.50:0/3738411587 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efe9010b210 msgr2=0x7efe9010d6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:33:22.357 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:22.354+0000 7efe96e00640 1 --2- 172.21.15.50:0/3738411587 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efe9010b210 0x7efe9010d6c0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7efe88009ca0 tx=0x7efe8802a8c0 comp rx=0 tx=0).stop 2024-08-31T04:33:22.357 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:22.354+0000 7efe96e00640 1 -- 172.21.15.50:0/3738411587 shutdown_connections 2024-08-31T04:33:22.357 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:22.354+0000 7efe96e00640 1 --2- 172.21.15.50:0/3738411587 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7efe90075a90 0x7efe90075ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:22.357 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:22.354+0000 7efe96e00640 1 --2- 172.21.15.50:0/3738411587 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efe9010b210 0x7efe9010d6c0 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:22.358 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:22.354+0000 7efe96e00640 1 --2- 172.21.15.50:0/3738411587 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efe90076e90 0x7efe90075550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:22.358 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:22.354+0000 7efe96e00640 1 -- 172.21.15.50:0/3738411587 >> 172.21.15.50:0/3738411587 conn(0x7efe900febc0 msgr2=0x7efe90101070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:33:22.358 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:22.354+0000 7efe96e00640 1 -- 172.21.15.50:0/3738411587 shutdown_connections 2024-08-31T04:33:22.358 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:22.354+0000 7efe96e00640 1 -- 172.21.15.50:0/3738411587 wait complete. 2024-08-31T04:33:22.361 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:22.356+0000 7efe96e00640 1 Processor -- start 2024-08-31T04:33:22.361 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:22.357+0000 7efe96e00640 1 -- start start 2024-08-31T04:33:22.361 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:22.357+0000 7efe96e00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7efe90075a90 0x7efe9019bcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:33:22.361 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:22.357+0000 7efe96e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efe90076e90 0x7efe9019c360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:33:22.361 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:22.357+0000 7efe96e00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efe9010b210 0x7efe9019cf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:33:22.361 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:22.357+0000 7efe96e00640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7efe90111100 con 0x7efe90076e90 2024-08-31T04:33:22.361 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:22.357+0000 7efe96e00640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7efe90110f80 con 0x7efe9010b210 2024-08-31T04:33:22.361 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:22.357+0000 7efe96e00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7efe90111280 con 0x7efe90075a90 2024-08-31T04:33:22.361 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:22.357+0000 7efe95000640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efe90076e90 0x7efe9019c360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:33:22.361 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:22.357+0000 7efe95000640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efe90076e90 0x7efe9019c360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:34748/0 (socket says 172.21.15.50:34748) 2024-08-31T04:33:22.362 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:22.357+0000 7efe95000640 1 -- 172.21.15.50:0/825845686 learned_addr learned my addr 172.21.15.50:0/825845686 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:33:22.362 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:22.357+0000 7efe95a00640 1 --2- 172.21.15.50:0/825845686 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7efe90075a90 0x7efe9019bcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:33:22.362 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:22.357+0000 7efe96400640 1 --2- 172.21.15.50:0/825845686 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efe9010b210 0x7efe9019cf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:33:22.362 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:22.357+0000 7efe95000640 1 -- 172.21.15.50:0/825845686 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7efe90075a90 msgr2=0x7efe9019bcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:33:22.362 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:22.357+0000 7efe95000640 1 --2- 172.21.15.50:0/825845686 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7efe90075a90 0x7efe9019bcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:22.362 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:22.357+0000 7efe95000640 1 -- 172.21.15.50:0/825845686 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efe9010b210 msgr2=0x7efe9019cf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:33:22.362 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:22.357+0000 7efe95000640 1 --2- 172.21.15.50:0/825845686 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efe9010b210 0x7efe9019cf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:22.362 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:22.357+0000 7efe95000640 1 -- 172.21.15.50:0/825845686 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe9019d730 con 0x7efe90076e90 2024-08-31T04:33:22.362 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:22.357+0000 7efe95000640 1 --2- 172.21.15.50:0/825845686 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efe90076e90 0x7efe9019c360 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7efe7c00e9f0 tx=0x7efe7c00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:33:22.362 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:22.357+0000 7efe8e000640 1 -- 172.21.15.50:0/825845686 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe7c00cd80 con 0x7efe90076e90 2024-08-31T04:33:22.362 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:22.357+0000 7efe8e000640 1 -- 172.21.15.50:0/825845686 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efe7c0054d0 con 0x7efe90076e90 2024-08-31T04:33:22.362 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:22.357+0000 7efe96e00640 1 -- 172.21.15.50:0/825845686 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efe9019da20 con 0x7efe90076e90 2024-08-31T04:33:22.363 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:22.357+0000 7efe8e000640 1 -- 172.21.15.50:0/825845686 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe7c010690 con 0x7efe90076e90 2024-08-31T04:33:22.363 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:22.357+0000 7efe96e00640 1 -- 172.21.15.50:0/825845686 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efe901a4110 con 0x7efe90076e90 2024-08-31T04:33:22.364 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:22.357+0000 7efe9f3db740 1 Processor -- start 2024-08-31T04:33:22.364 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:22.357+0000 7efe9f3db740 1 -- start start 2024-08-31T04:33:22.364 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:22.357+0000 7efe9f3db740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55edf10761b0 0x55edf141bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:33:22.364 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:22.357+0000 7efe9f3db740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55edf104d2f0 0x55edf141c610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:33:22.364 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:22.357+0000 7efe9f3db740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55edf10554d0 0x55edf141d160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:33:22.364 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:22.357+0000 7efe9f3db740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55edf138ef70 con 0x55edf104d2f0 2024-08-31T04:33:22.364 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:22.357+0000 7efe9f3db740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x55edf137e500 con 0x55edf10554d0 2024-08-31T04:33:22.364 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:22.357+0000 7efe9f3db740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x55edf13824b0 con 0x55edf10761b0 2024-08-31T04:33:22.364 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:22.357+0000 7efe8e000640 1 -- 172.21.15.50:0/825845686 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 18) ==== 152577+0+0 (secure 0 0 0) 0x7efe7c004e90 con 0x7efe90076e90 2024-08-31T04:33:22.365 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:22.357+0000 7efe95a00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55edf104d2f0 0x55edf141c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:33:22.366 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:22.363+0000 7efe95a00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55edf104d2f0 0x55edf141c610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:34750/0 (socket says 172.21.15.50:34750) 2024-08-31T04:33:22.366 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:22.363+0000 7efe96400640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55edf10761b0 0x55edf141bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:33:22.366 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:22.363+0000 7efe95a00640 1 -- 172.21.15.50:0/1429669543 learned_addr learned my addr 172.21.15.50:0/1429669543 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:33:22.366 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:22.363+0000 7efe95000640 1 --2- 172.21.15.50:0/1429669543 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55edf10554d0 0x55edf141d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:33:22.366 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:22.363+0000 7efe95a00640 1 -- 172.21.15.50:0/1429669543 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55edf10761b0 msgr2=0x55edf141bfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:33:22.366 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:22.363+0000 7efe95a00640 1 --2- 172.21.15.50:0/1429669543 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55edf10761b0 0x55edf141bfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:22.366 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:22.363+0000 7efe95a00640 1 -- 172.21.15.50:0/1429669543 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55edf10554d0 msgr2=0x55edf141d160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:33:22.366 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:22.363+0000 7efe95a00640 1 --2- 172.21.15.50:0/1429669543 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55edf10554d0 0x55edf141d160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:22.368 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:22.363+0000 7efe95a00640 1 -- 172.21.15.50:0/1429669543 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55edf1338c10 con 0x55edf104d2f0 2024-08-31T04:33:22.368 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:22.363+0000 7efe95a00640 1 --2- 172.21.15.50:0/1429669543 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55edf104d2f0 0x55edf141c610 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7efe84009cf0 tx=0x7efe84011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa5dea48ce0b8e66 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:33:22.368 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:22.363+0000 7efe82a00640 1 -- 172.21.15.50:0/1429669543 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe8401e070 con 0x55edf104d2f0 2024-08-31T04:33:22.368 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:22.363+0000 7efe82a00640 1 -- 172.21.15.50:0/1429669543 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efe84019ae0 con 0x55edf104d2f0 2024-08-31T04:33:22.368 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:22.363+0000 7efe82a00640 1 -- 172.21.15.50:0/1429669543 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe8400e970 con 0x55edf104d2f0 2024-08-31T04:33:22.368 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:22.363+0000 7efe8e000640 1 --2- 172.21.15.50:0/825845686 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7efe780b4b30 0x7efe780b7040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:33:22.368 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:22.363+0000 7efe8e000640 1 -- 172.21.15.50:0/825845686 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8219+0+0 (secure 0 0 0) 0x7efe7c0e55d0 con 0x7efe90076e90 2024-08-31T04:33:22.368 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:22.363+0000 7efe96400640 1 --2- 172.21.15.50:0/825845686 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7efe780b4b30 0x7efe780b7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:33:22.368 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:22.363+0000 7efe9f3db740 1 -- 172.21.15.50:0/1429669543 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55edf104d2f0 msgr2=0x55edf141c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:33:22.368 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:22.363+0000 7efe9f3db740 1 --2- 172.21.15.50:0/1429669543 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55edf104d2f0 0x55edf141c610 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7efe84009cf0 tx=0x7efe84011810 comp rx=0 tx=0).stop 2024-08-31T04:33:22.369 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:22.363+0000 7efe9f3db740 1 -- 172.21.15.50:0/1429669543 shutdown_connections 2024-08-31T04:33:22.369 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:22.363+0000 7efe9f3db740 1 --2- 172.21.15.50:0/1429669543 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55edf10554d0 0x55edf141d160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:22.369 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:22.363+0000 7efe9f3db740 1 --2- 172.21.15.50:0/1429669543 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55edf104d2f0 0x55edf141c610 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:22.369 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:22.363+0000 7efe9f3db740 1 --2- 172.21.15.50:0/1429669543 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55edf10761b0 0x55edf141bfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:22.369 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:22.363+0000 7efe9f3db740 1 -- 172.21.15.50:0/1429669543 >> 172.21.15.50:0/1429669543 conn(0x55edf106a300 msgr2=0x55edf1417a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:33:22.369 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:22.363+0000 7efe9f3db740 1 -- 172.21.15.50:0/1429669543 shutdown_connections 2024-08-31T04:33:22.369 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:22.363+0000 7efe9f3db740 1 -- 172.21.15.50:0/1429669543 wait complete. 2024-08-31T04:33:22.369 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:22.363+0000 7efe96400640 1 --2- 172.21.15.50:0/825845686 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7efe780b4b30 0x7efe780b7040 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7efe88005e30 tx=0x7efe88031af0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:33:22.372 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:22.363+0000 7efe9f3db740 1 -- start start 2024-08-31T04:33:22.372 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:22.363+0000 7efe9f3db740 1 Processor -- start 2024-08-31T04:33:22.372 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:22.363+0000 7efe9f3db740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55edf104d2f0 0x55edf1425660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:33:22.372 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:22.363+0000 7efe9f3db740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55edf10554d0 0x55edf1425d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:33:22.372 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:22.363+0000 7efe9f3db740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55edf10761b0 0x55edf1426820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:33:22.372 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:22.363+0000 7efe9f3db740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55edf12b7ab0 con 0x55edf10554d0 2024-08-31T04:33:22.372 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:22.363+0000 7efe9f3db740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x55edf1325320 con 0x55edf104d2f0 2024-08-31T04:33:22.372 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:22.363+0000 7efe9f3db740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x55edf141dc80 con 0x55edf10761b0 2024-08-31T04:33:22.372 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:22.363+0000 7efe9f3db740 10 client.0 _ll_register_callbacks cb 0x55edf132b6a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:33:22.372 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:22.363+0000 7efe95000640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55edf10554d0 0x55edf1425d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:33:22.373 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:22.363+0000 7efe95000640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55edf10554d0 0x55edf1425d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:34764/0 (socket says 172.21.15.50:34764) 2024-08-31T04:33:22.373 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:22.363+0000 7efe95000640 1 -- 172.21.15.50:0/1917518868 learned_addr learned my addr 172.21.15.50:0/1917518868 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:33:22.373 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:22.363+0000 7efe96400640 1 --2- 172.21.15.50:0/1917518868 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55edf10761b0 0x55edf1426820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:33:22.373 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:22.363+0000 7efe95000640 1 -- 172.21.15.50:0/1917518868 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55edf10761b0 msgr2=0x55edf1426820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:33:22.373 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:22.363+0000 7efe95000640 1 --2- 172.21.15.50:0/1917518868 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55edf10761b0 0x55edf1426820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:22.373 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:22.363+0000 7efe95000640 1 -- 172.21.15.50:0/1917518868 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55edf104d2f0 msgr2=0x55edf1425660 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-08-31T04:33:22.373 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:22.363+0000 7efe95000640 1 --2- 172.21.15.50:0/1917518868 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55edf104d2f0 0x55edf1425660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:22.373 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:22.363+0000 7efe95000640 1 -- 172.21.15.50:0/1917518868 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55edf10e1790 con 0x55edf10554d0 2024-08-31T04:33:22.373 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:22.363+0000 7efe95000640 1 --2- 172.21.15.50:0/1917518868 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55edf10554d0 0x55edf1425d20 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7efe7c0a9220 tx=0x7efe7c0048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df059992d53812bf server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:33:22.373 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:22.363+0000 7efe77400640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-08-31T04:33:22.373 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:22.363+0000 7efe77400640 1 -- 172.21.15.50:0/1917518868 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe7c0abac0 con 0x55edf10554d0 2024-08-31T04:33:22.373 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:22.368+0000 7efe77400640 1 -- 172.21.15.50:0/1917518868 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8219+0+0 (secure 0 0 0) 0x7efe7c0e8d00 con 0x55edf10554d0 2024-08-31T04:33:22.373 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:22.368+0000 7efe9f3db740 1 -- 172.21.15.50:0/1917518868 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efe84019ae0 con 0x55edf10554d0 2024-08-31T04:33:22.374 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:22.368+0000 7efe77400640 1 -- 172.21.15.50:0/1917518868 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=53) ==== 24+0+0 (secure 0 0 0) 0x7efe7c005680 con 0x55edf10554d0 2024-08-31T04:33:22.374 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:22.368+0000 7efe9f3db740 10 client.16389 fetch_fsmap learned FSMap version 53 2024-08-31T04:33:22.374 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:22.368+0000 7efe9f3db740 1 -- 172.21.15.50:0/1917518868 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=53,monmap=4+}) -- 0x55edf115a620 con 0x55edf10554d0 2024-08-31T04:33:22.374 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:22.368+0000 7efe77400640 1 -- 172.21.15.50:0/1917518868 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efe84019ae0 con 0x55edf10554d0 2024-08-31T04:33:22.374 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:22.368+0000 7efe77400640 1 -- 172.21.15.50:0/1917518868 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 53) ==== 8362+0+0 (secure 0 0 0) 0x7efe7c0b4e40 con 0x55edf10554d0 2024-08-31T04:33:22.374 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:22.368+0000 7efe9f3db740 10 client.16389 fetch_fsmap finished waiting for FSMap version 53 2024-08-31T04:33:22.374 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:22.368+0000 7efe9f3db740 10 client.16389 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T04:33:22.379 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:22.368+0000 7efe9f3db740 20 client.16389 populate_metadata read hostname 'smithi050' 2024-08-31T04:33:22.379 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:22.368+0000 7efe9f3db740 1 --2- 172.21.15.50:0/1917518868 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x55edf1034d80 0x55edf1432dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:33:22.379 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:22.368+0000 7efe9f3db740 4 client.16389 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T04:33:22.379 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:22.368+0000 7efe9f3db740 1 -- 172.21.15.50:0/1917518868 --> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55edf1390ec0 con 0x55edf1034d80 2024-08-31T04:33:22.393 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:22.392+0000 7efe95a00640 1 --2- 172.21.15.50:0/1917518868 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x55edf1034d80 0x55edf1432dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:33:22.405 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:22.404+0000 7efe95a00640 1 --2- 172.21.15.50:0/1917518868 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x55edf1034d80 0x55edf1432dc0 crc :-1 s=READY pgs=138 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b07168e1897677dc server_cookie=d0de9233452a0420 in_seq=0 out_seq=0 2024-08-31T04:33:22.405 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:22.404+0000 7efe77400640 10 client.16389 ms_handle_connect on v2:172.21.15.133:6838/2526402262 2024-08-31T04:33:22.406 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:22.404+0000 7efe77400640 1 -- 172.21.15.50:0/1917518868 <== mds.0 v2:172.21.15.133:6838/2526402262 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55edf1390ec0 con 0x55edf1034d80 2024-08-31T04:33:22.406 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:22.404+0000 7efe77400640 10 client.16389 handle_command_reply: tid=0 2024-08-31T04:33:22.407 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:22.404+0000 7efe9f3db740 1 client.16389 shutdown 2024-08-31T04:33:22.407 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:22.404+0000 7efe9f3db740 1 -- 172.21.15.50:0/1917518868 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55edf10554d0 msgr2=0x55edf1425d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:33:22.407 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:22.404+0000 7efe9f3db740 1 --2- 172.21.15.50:0/1917518868 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55edf10554d0 0x55edf1425d20 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7efe7c0a9220 tx=0x7efe7c0048f0 comp rx=0 tx=0).stop 2024-08-31T04:33:22.407 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:22.404+0000 7efe9f3db740 1 -- 172.21.15.50:0/1917518868 shutdown_connections 2024-08-31T04:33:22.407 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:22.404+0000 7efe9f3db740 1 --2- 172.21.15.50:0/1917518868 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x55edf1034d80 0x55edf1432dc0 crc :-1 s=READY pgs=138 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:22.407 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:22.404+0000 7efe9f3db740 1 --2- 172.21.15.50:0/1917518868 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55edf10761b0 0x55edf1426820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:22.407 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:22.404+0000 7efe9f3db740 1 --2- 172.21.15.50:0/1917518868 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55edf10554d0 0x55edf1425d20 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:22.407 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:22.404+0000 7efe9f3db740 1 --2- 172.21.15.50:0/1917518868 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55edf104d2f0 0x55edf1425660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:22.407 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:22.404+0000 7efe77400640 0 client.16389 ms_handle_reset on v2:172.21.15.133:6838/2526402262 2024-08-31T04:33:22.407 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:22.404+0000 7efe9f3db740 1 -- 172.21.15.50:0/1917518868 >> 172.21.15.50:0/1917518868 conn(0x55edf106a300 msgr2=0x55edf1418630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:33:22.416 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:22.404+0000 7efe9f3db740 1 -- 172.21.15.50:0/1917518868 shutdown_connections 2024-08-31T04:33:22.416 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:22.404+0000 7efe9f3db740 1 -- 172.21.15.50:0/1917518868 wait complete. 2024-08-31T04:33:22.416 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:22.404+0000 7efe9f3db740 20 client.16389 trim_cache size 0 max 16384 2024-08-31T04:33:22.423 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:22.416+0000 7efe9f3db740 1 Processor -- start 2024-08-31T04:33:22.423 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:22.416+0000 7efe9f3db740 1 -- start start 2024-08-31T04:33:22.423 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:22.422+0000 7efe9f3db740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55edf104d2f0 0x55edf1424280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:33:22.423 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:22.422+0000 7efe9f3db740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55edf10554d0 0x55edf142d700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:33:22.424 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:22.422+0000 7efe9f3db740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55edf10761b0 0x55edf14247c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:33:22.424 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:22.422+0000 7efe9f3db740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7efe901accd0 con 0x55edf10761b0 2024-08-31T04:33:22.424 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:22.422+0000 7efe9f3db740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7efe901ae810 con 0x55edf104d2f0 2024-08-31T04:33:22.424 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:22.422+0000 7efe9f3db740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7efe901ad3a0 con 0x55edf10554d0 2024-08-31T04:33:22.424 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:22.422+0000 7efe96400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55edf10761b0 0x55edf14247c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:33:22.424 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:22.422+0000 7efe95000640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55edf10554d0 0x55edf142d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:33:22.424 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:22.422+0000 7efe96400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55edf10761b0 0x55edf14247c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:34778/0 (socket says 172.21.15.50:34778) 2024-08-31T04:33:22.424 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:22.422+0000 7efe96400640 1 -- 172.21.15.50:0/3776429125 learned_addr learned my addr 172.21.15.50:0/3776429125 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:33:22.429 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:22.422+0000 7efe95000640 1 -- 172.21.15.50:0/3776429125 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55edf104d2f0 msgr2=0x55edf1424280 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-08-31T04:33:22.429 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:22.422+0000 7efe95000640 1 --2- 172.21.15.50:0/3776429125 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55edf104d2f0 0x55edf1424280 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:22.429 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:22.422+0000 7efe95000640 1 -- 172.21.15.50:0/3776429125 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55edf10761b0 msgr2=0x55edf14247c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:33:22.430 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:22.422+0000 7efe95000640 1 --2- 172.21.15.50:0/3776429125 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55edf10761b0 0x55edf14247c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:22.430 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:22.422+0000 7efe95000640 1 -- 172.21.15.50:0/3776429125 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55edf14253e0 con 0x55edf10554d0 2024-08-31T04:33:22.430 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:22.422+0000 7efe96400640 1 --2- 172.21.15.50:0/3776429125 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55edf10761b0 0x55edf14247c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:33:22.430 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:22.422+0000 7efe95000640 1 --2- 172.21.15.50:0/3776429125 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55edf10554d0 0x55edf142d700 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7efe7c00e9c0 tx=0x7efe7c0b0720 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8653916c9794e431 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:33:22.430 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:22.422+0000 7efe82000640 1 -- 172.21.15.50:0/3776429125 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe7c0ab720 con 0x55edf10554d0 2024-08-31T04:33:22.430 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:22.422+0000 7efe82000640 1 -- 172.21.15.50:0/3776429125 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efe7c097050 con 0x55edf10554d0 2024-08-31T04:33:22.430 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:22.422+0000 7efe82000640 1 -- 172.21.15.50:0/3776429125 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe7c097200 con 0x55edf10554d0 2024-08-31T04:33:22.430 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:22.422+0000 7efe9f3db740 1 -- 172.21.15.50:0/3776429125 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55edf10554d0 msgr2=0x55edf142d700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:33:22.430 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:22.422+0000 7efe9f3db740 1 --2- 172.21.15.50:0/3776429125 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55edf10554d0 0x55edf142d700 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7efe7c00e9c0 tx=0x7efe7c0b0720 comp rx=0 tx=0).stop 2024-08-31T04:33:22.431 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:22.422+0000 7efe9f3db740 1 -- 172.21.15.50:0/3776429125 shutdown_connections 2024-08-31T04:33:22.431 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:22.422+0000 7efe9f3db740 1 --2- 172.21.15.50:0/3776429125 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55edf10554d0 0x55edf142d700 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:22.431 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:22.422+0000 7efe9f3db740 1 --2- 172.21.15.50:0/3776429125 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55edf10761b0 0x55edf14247c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:22.431 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:22.422+0000 7efe9f3db740 1 --2- 172.21.15.50:0/3776429125 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55edf104d2f0 0x55edf1424280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:22.431 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:22.422+0000 7efe9f3db740 1 -- 172.21.15.50:0/3776429125 >> 172.21.15.50:0/3776429125 conn(0x55edf106a300 msgr2=0x55edf1423b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:33:22.431 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:22.422+0000 7efe9f3db740 1 -- 172.21.15.50:0/3776429125 shutdown_connections 2024-08-31T04:33:22.431 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:22.422+0000 7efe9f3db740 1 -- 172.21.15.50:0/3776429125 wait complete. 2024-08-31T04:33:22.431 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:22.422+0000 7efe9f3db740 1 -- start start 2024-08-31T04:33:22.431 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:22.422+0000 7efe9f3db740 1 Processor -- start 2024-08-31T04:33:22.431 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:22.422+0000 7efe9f3db740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55edf104d2f0 0x55edf142d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:33:22.431 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:22.422+0000 7efe9f3db740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55edf10554d0 0x55edf142c2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:33:22.432 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:22.422+0000 7efe9f3db740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55edf10761b0 0x55edf142c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:33:22.432 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:22.422+0000 7efe9f3db740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7efe901ae140 con 0x55edf10554d0 2024-08-31T04:33:22.432 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:22.422+0000 7efe9f3db740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7efe901ada70 con 0x55edf10761b0 2024-08-31T04:33:22.432 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:22.422+0000 7efe9f3db740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7efe901aacb0 con 0x55edf104d2f0 2024-08-31T04:33:22.432 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:22.422+0000 7efe9f3db740 10 client.0 _ll_register_callbacks cb 0x7efe7c0abd80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:33:22.432 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:22.422+0000 7efe95000640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55edf10554d0 0x55edf142c2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:33:22.432 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:22.422+0000 7efe95000640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55edf10554d0 0x55edf142c2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:34792/0 (socket says 172.21.15.50:34792) 2024-08-31T04:33:22.432 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:22.422+0000 7efe95000640 1 -- 172.21.15.50:0/1497848010 learned_addr learned my addr 172.21.15.50:0/1497848010 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:33:22.432 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:22.422+0000 7efe96400640 1 --2- 172.21.15.50:0/1497848010 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55edf10761b0 0x55edf142c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:33:22.432 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:22.422+0000 7efe95000640 1 -- 172.21.15.50:0/1497848010 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55edf104d2f0 msgr2=0x55edf142d5b0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-08-31T04:33:22.433 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:22.422+0000 7efe95000640 1 --2- 172.21.15.50:0/1497848010 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55edf104d2f0 0x55edf142d5b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:22.433 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:22.422+0000 7efe95000640 1 -- 172.21.15.50:0/1497848010 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55edf10761b0 msgr2=0x55edf142c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:33:22.433 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:22.422+0000 7efe95000640 1 --2- 172.21.15.50:0/1497848010 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55edf10761b0 0x55edf142c9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:22.433 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:22.422+0000 7efe95000640 1 -- 172.21.15.50:0/1497848010 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55edf142ae30 con 0x55edf10554d0 2024-08-31T04:33:22.433 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:22.422+0000 7efe95000640 1 --2- 172.21.15.50:0/1497848010 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55edf10554d0 0x55edf142c2b0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7efe7c005820 tx=0x7efe7c0b5070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=612c78d0d8af49b0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:33:22.433 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:22.422+0000 7efe77400640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-08-31T04:33:22.433 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:22.422+0000 7efe77400640 1 -- 172.21.15.50:0/1497848010 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe7c0c6060 con 0x55edf10554d0 2024-08-31T04:33:22.433 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:22.422+0000 7efe77400640 1 -- 172.21.15.50:0/1497848010 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8219+0+0 (secure 0 0 0) 0x7efe7c0b3c70 con 0x55edf10554d0 2024-08-31T04:33:22.433 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:22.422+0000 7efe9f3db740 1 -- 172.21.15.50:0/1497848010 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efe7c097050 con 0x55edf10554d0 2024-08-31T04:33:22.433 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:22.422+0000 7efe77400640 1 -- 172.21.15.50:0/1497848010 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=53) ==== 24+0+0 (secure 0 0 0) 0x7efe7c0ab720 con 0x55edf10554d0 2024-08-31T04:33:22.434 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:22.422+0000 7efe9f3db740 10 client.16395 fetch_fsmap learned FSMap version 53 2024-08-31T04:33:22.434 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:22.422+0000 7efe9f3db740 1 -- 172.21.15.50:0/1497848010 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=53,monmap=4+}) -- 0x55edf149d930 con 0x55edf10554d0 2024-08-31T04:33:22.434 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:22.422+0000 7efe77400640 1 -- 172.21.15.50:0/1497848010 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efe7c097050 con 0x55edf10554d0 2024-08-31T04:33:22.434 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:22.427+0000 7efe77400640 1 -- 172.21.15.50:0/1497848010 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 53) ==== 8362+0+0 (secure 0 0 0) 0x7efe7c0ab2a0 con 0x55edf10554d0 2024-08-31T04:33:22.434 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:22.427+0000 7efe9f3db740 10 client.16395 fetch_fsmap finished waiting for FSMap version 53 2024-08-31T04:33:22.434 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:22.427+0000 7efe9f3db740 10 client.16395 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T04:33:22.434 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:22.427+0000 7efe9f3db740 20 client.16395 populate_metadata read hostname 'smithi050' 2024-08-31T04:33:22.434 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:22.427+0000 7efe9f3db740 1 --2- 172.21.15.50:0/1497848010 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x55edf100a1c0 0x55edf14a0110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:33:22.434 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:22.427+0000 7efe9f3db740 4 client.16395 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-31T04:33:22.434 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:22.427+0000 7efe9f3db740 1 -- 172.21.15.50:0/1497848010 --> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55edf138c960 con 0x55edf100a1c0 2024-08-31T04:33:22.434 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:22.428+0000 7efe95a00640 1 --2- 172.21.15.50:0/1497848010 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x55edf100a1c0 0x55edf14a0110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:33:22.441 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:22.440+0000 7efe95a00640 1 --2- 172.21.15.50:0/1497848010 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x55edf100a1c0 0x55edf14a0110 crc :-1 s=READY pgs=139 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d3fcdb97ab796a3a server_cookie=eb1e0dcad7c2a0fd in_seq=0 out_seq=0 2024-08-31T04:33:22.441 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:22.440+0000 7efe77400640 10 client.16395 ms_handle_connect on v2:172.21.15.133:6838/2526402262 2024-08-31T04:33:22.451 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:22.445+0000 7efe77400640 1 -- 172.21.15.50:0/1497848010 <== mds.0 v2:172.21.15.133:6838/2526402262 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55edf138c960 con 0x55edf100a1c0 2024-08-31T04:33:22.451 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:22.445+0000 7efe77400640 10 client.16395 handle_command_reply: tid=0 2024-08-31T04:33:22.451 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:22.445+0000 7efe9f3db740 1 client.16395 shutdown 2024-08-31T04:33:22.451 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:22.445+0000 7efe9f3db740 1 -- 172.21.15.50:0/1497848010 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55edf10554d0 msgr2=0x55edf142c2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:33:22.451 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:22.445+0000 7efe9f3db740 1 --2- 172.21.15.50:0/1497848010 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55edf10554d0 0x55edf142c2b0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7efe7c005820 tx=0x7efe7c0b5070 comp rx=0 tx=0).stop 2024-08-31T04:33:22.451 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:22.445+0000 7efe9f3db740 1 -- 172.21.15.50:0/1497848010 shutdown_connections 2024-08-31T04:33:22.451 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:22.445+0000 7efe9f3db740 1 --2- 172.21.15.50:0/1497848010 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x55edf100a1c0 0x55edf14a0110 crc :-1 s=READY pgs=139 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:22.451 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:22.445+0000 7efe9f3db740 1 --2- 172.21.15.50:0/1497848010 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55edf10761b0 0x55edf142c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:22.451 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:22.445+0000 7efe9f3db740 1 --2- 172.21.15.50:0/1497848010 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55edf10554d0 0x55edf142c2b0 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:22.451 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:22.445+0000 7efe77400640 0 client.16395 ms_handle_reset on v2:172.21.15.133:6838/2526402262 2024-08-31T04:33:22.452 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:22.445+0000 7efe9f3db740 1 --2- 172.21.15.50:0/1497848010 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55edf104d2f0 0x55edf142d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:22.452 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:22.445+0000 7efe9f3db740 1 -- 172.21.15.50:0/1497848010 >> 172.21.15.50:0/1497848010 conn(0x55edf106a300 msgr2=0x55edf1424530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:33:22.452 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:22.445+0000 7efe9f3db740 1 -- 172.21.15.50:0/1497848010 shutdown_connections 2024-08-31T04:33:22.452 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:22.445+0000 7efe9f3db740 1 -- 172.21.15.50:0/1497848010 wait complete. 2024-08-31T04:33:22.452 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:22.445+0000 7efe9f3db740 20 client.16395 trim_cache size 0 max 16384 2024-08-31T04:33:22.452 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout:{ 2024-08-31T04:33:22.452 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout: "message": "", 2024-08-31T04:33:22.452 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout: "return_code": 0 2024-08-31T04:33:22.452 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout:} 2024-08-31T04:33:22.453 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:22.450+0000 7efe96e00640 1 -- 172.21.15.50:0/825845686 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7efe780b4b30 msgr2=0x7efe780b7040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:33:22.453 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:22.450+0000 7efe96e00640 1 --2- 172.21.15.50:0/825845686 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7efe780b4b30 0x7efe780b7040 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7efe88005e30 tx=0x7efe88031af0 comp rx=0 tx=0).stop 2024-08-31T04:33:22.453 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:22.450+0000 7efe96e00640 1 -- 172.21.15.50:0/825845686 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efe90076e90 msgr2=0x7efe9019c360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:33:22.453 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:22.450+0000 7efe96e00640 1 --2- 172.21.15.50:0/825845686 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efe90076e90 0x7efe9019c360 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7efe7c00e9f0 tx=0x7efe7c00edf0 comp rx=0 tx=0).stop 2024-08-31T04:33:22.453 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:22.450+0000 7efe96e00640 1 -- 172.21.15.50:0/825845686 shutdown_connections 2024-08-31T04:33:22.454 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:22.450+0000 7efe96e00640 1 --2- 172.21.15.50:0/825845686 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7efe780b4b30 0x7efe780b7040 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:22.454 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:22.450+0000 7efe96e00640 1 --2- 172.21.15.50:0/825845686 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efe9010b210 0x7efe9019cf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:22.454 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:22.450+0000 7efe96e00640 1 --2- 172.21.15.50:0/825845686 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efe90076e90 0x7efe9019c360 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:22.454 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:22.450+0000 7efe96e00640 1 --2- 172.21.15.50:0/825845686 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7efe90075a90 0x7efe9019bcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:22.454 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:22.450+0000 7efe96e00640 1 -- 172.21.15.50:0/825845686 >> 172.21.15.50:0/825845686 conn(0x7efe900febc0 msgr2=0x7efe90100fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:33:22.454 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:22.450+0000 7efe96e00640 1 -- 172.21.15.50:0/825845686 shutdown_connections 2024-08-31T04:33:22.454 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:22.450+0000 7efe96e00640 1 -- 172.21.15.50:0/825845686 wait complete. 2024-08-31T04:33:23.348 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:33:23 smithi050 ceph-mon[17259]: pgmap v683: 97 pgs: 97 active+clean; 1.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 6.1 KiB/s wr, 12 op/s 2024-08-31T04:33:23.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:33:23 smithi177 ceph-mon[22025]: pgmap v683: 97 pgs: 97 active+clean; 1.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 6.1 KiB/s wr, 12 op/s 2024-08-31T04:33:23.544 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:33:23 smithi133 ceph-mon[22177]: pgmap v683: 97 pgs: 97 active+clean; 1.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 6.1 KiB/s wr, 12 op/s 2024-08-31T04:33:24.490 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:33:24 smithi050 ceph-mon[17259]: 1 slow requests, 0 included below; oldest blocked for > 215.004121 secs 2024-08-31T04:33:24.490 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:33:24 smithi050 ceph-mon[17259]: 1 slow requests, 0 included below; oldest blocked for > 217.350474 secs 2024-08-31T04:33:24.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:33:24 smithi133 ceph-mon[22177]: 1 slow requests, 0 included below; oldest blocked for > 215.004121 secs 2024-08-31T04:33:24.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:33:24 smithi133 ceph-mon[22177]: 1 slow requests, 0 included below; oldest blocked for > 217.350474 secs 2024-08-31T04:33:24.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:33:24 smithi177 ceph-mon[22025]: 1 slow requests, 0 included below; oldest blocked for > 215.004121 secs 2024-08-31T04:33:24.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:33:24 smithi177 ceph-mon[22025]: 1 slow requests, 0 included below; oldest blocked for > 217.350474 secs 2024-08-31T04:33:25.338 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:33:25 smithi050 ceph-mon[17259]: pgmap v684: 97 pgs: 97 active+clean; 1.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 0 B/s wr, 8 op/s 2024-08-31T04:33:25.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:33:25 smithi133 ceph-mon[22177]: pgmap v684: 97 pgs: 97 active+clean; 1.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 0 B/s wr, 8 op/s 2024-08-31T04:33:25.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:33:25 smithi177 ceph-mon[22025]: pgmap v684: 97 pgs: 97 active+clean; 1.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 0 B/s wr, 8 op/s 2024-08-31T04:33:26.470 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:33:26 smithi050 ceph-mon[17259]: 1 slow requests, 0 included below; oldest blocked for > 219.059847 secs 2024-08-31T04:33:26.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:33:26 smithi133 ceph-mon[22177]: 1 slow requests, 0 included below; oldest blocked for > 219.059847 secs 2024-08-31T04:33:26.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:33:26 smithi177 ceph-mon[22025]: 1 slow requests, 0 included below; oldest blocked for > 219.059847 secs 2024-08-31T04:33:27.319 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:33:27 smithi050 ceph-mon[17259]: pgmap v685: 97 pgs: 97 active+clean; 1.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 7.9 KiB/s wr, 11 op/s 2024-08-31T04:33:27.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:33:27 smithi133 ceph-mon[22177]: pgmap v685: 97 pgs: 97 active+clean; 1.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 7.9 KiB/s wr, 11 op/s 2024-08-31T04:33:27.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:33:27 smithi177 ceph-mon[22025]: pgmap v685: 97 pgs: 97 active+clean; 1.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 7.9 KiB/s wr, 11 op/s 2024-08-31T04:33:29.330 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:33:29 smithi050 ceph-mon[17259]: pgmap v686: 97 pgs: 97 active+clean; 1.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 8.1 KiB/s wr, 10 op/s 2024-08-31T04:33:29.331 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:33:29 smithi050 ceph-mon[17259]: 1 slow requests, 0 included below; oldest blocked for > 220.004236 secs 2024-08-31T04:33:29.331 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:33:29 smithi050 ceph-mon[17259]: 1 slow requests, 0 included below; oldest blocked for > 222.350566 secs 2024-08-31T04:33:29.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:33:29 smithi133 ceph-mon[22177]: pgmap v686: 97 pgs: 97 active+clean; 1.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 8.1 KiB/s wr, 10 op/s 2024-08-31T04:33:29.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:33:29 smithi133 ceph-mon[22177]: 1 slow requests, 0 included below; oldest blocked for > 220.004236 secs 2024-08-31T04:33:29.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:33:29 smithi133 ceph-mon[22177]: 1 slow requests, 0 included below; oldest blocked for > 222.350566 secs 2024-08-31T04:33:29.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:33:29 smithi177 ceph-mon[22025]: pgmap v686: 97 pgs: 97 active+clean; 1.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 8.1 KiB/s wr, 10 op/s 2024-08-31T04:33:29.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:33:29 smithi177 ceph-mon[22025]: 1 slow requests, 0 included below; oldest blocked for > 220.004236 secs 2024-08-31T04:33:29.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:33:29 smithi177 ceph-mon[22025]: 1 slow requests, 0 included below; oldest blocked for > 222.350566 secs 2024-08-31T04:33:31.334 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:33:31 smithi050 ceph-mon[17259]: pgmap v687: 97 pgs: 97 active+clean; 1.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 8.1 KiB/s wr, 10 op/s 2024-08-31T04:33:31.334 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:33:31 smithi050 ceph-mon[17259]: 1 slow requests, 0 included below; oldest blocked for > 224.059943 secs 2024-08-31T04:33:31.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:33:31 smithi133 ceph-mon[22177]: pgmap v687: 97 pgs: 97 active+clean; 1.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 8.1 KiB/s wr, 10 op/s 2024-08-31T04:33:31.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:33:31 smithi133 ceph-mon[22177]: 1 slow requests, 0 included below; oldest blocked for > 224.059943 secs 2024-08-31T04:33:31.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:33:31 smithi177 ceph-mon[22025]: pgmap v687: 97 pgs: 97 active+clean; 1.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 8.1 KiB/s wr, 10 op/s 2024-08-31T04:33:31.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:33:31 smithi177 ceph-mon[22025]: 1 slow requests, 0 included below; oldest blocked for > 224.059943 secs 2024-08-31T04:33:33.345 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:33:33 smithi050 ceph-mon[17259]: pgmap v688: 97 pgs: 97 active+clean; 1.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 8.1 KiB/s wr, 12 op/s 2024-08-31T04:33:33.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:33:33 smithi177 ceph-mon[22025]: pgmap v688: 97 pgs: 97 active+clean; 1.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 8.1 KiB/s wr, 12 op/s 2024-08-31T04:33:33.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:33:33 smithi133 ceph-mon[22177]: pgmap v688: 97 pgs: 97 active+clean; 1.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 8.1 KiB/s wr, 12 op/s 2024-08-31T04:33:34.475 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:33:34 smithi050 ceph-mon[17259]: 1 slow requests, 0 included below; oldest blocked for > 225.004314 secs 2024-08-31T04:33:34.475 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:33:34 smithi050 ceph-mon[17259]: 1 slow requests, 0 included below; oldest blocked for > 227.350656 secs 2024-08-31T04:33:34.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:33:34 smithi177 ceph-mon[22025]: 1 slow requests, 0 included below; oldest blocked for > 225.004314 secs 2024-08-31T04:33:34.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:33:34 smithi177 ceph-mon[22025]: 1 slow requests, 0 included below; oldest blocked for > 227.350656 secs 2024-08-31T04:33:34.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:33:34 smithi133 ceph-mon[22177]: 1 slow requests, 0 included below; oldest blocked for > 225.004314 secs 2024-08-31T04:33:34.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:33:34 smithi133 ceph-mon[22177]: 1 slow requests, 0 included below; oldest blocked for > 227.350656 secs 2024-08-31T04:33:35.604 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:33:35 smithi050 ceph-mon[17259]: pgmap v689: 97 pgs: 97 active+clean; 1.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 8.1 KiB/s wr, 9 op/s 2024-08-31T04:33:35.641 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:35.638+0000 7fa78c600640 1 -- 172.21.15.50:0/2577759871 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa7841044d0 msgr2=0x7fa7841048e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:33:35.641 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:35.638+0000 7fa78c600640 1 --2- 172.21.15.50:0/2577759871 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa7841044d0 0x7fa7841048e0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fa770009900 tx=0x7fa77002a410 comp rx=0 tx=0).stop 2024-08-31T04:33:35.641 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:35.639+0000 7fa78c600640 1 -- 172.21.15.50:0/2577759871 shutdown_connections 2024-08-31T04:33:35.641 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:35.639+0000 7fa78c600640 1 --2- 172.21.15.50:0/2577759871 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa784104e70 0x7fa78410b810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:35.641 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:35.639+0000 7fa78c600640 1 --2- 172.21.15.50:0/2577759871 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa7841044d0 0x7fa7841048e0 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:35.641 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:35.639+0000 7fa78c600640 1 --2- 172.21.15.50:0/2577759871 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa784103450 0x7fa7841038c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:35.641 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:35.639+0000 7fa78c600640 1 -- 172.21.15.50:0/2577759871 >> 172.21.15.50:0/2577759871 conn(0x7fa7840fed90 msgr2=0x7fa784101240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:33:35.641 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:35.639+0000 7fa78c600640 1 -- 172.21.15.50:0/2577759871 shutdown_connections 2024-08-31T04:33:35.641 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:35.639+0000 7fa78c600640 1 -- 172.21.15.50:0/2577759871 wait complete. 2024-08-31T04:33:35.643 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:35.639+0000 7fa78c600640 1 Processor -- start 2024-08-31T04:33:35.644 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:35.639+0000 7fa78c600640 1 -- start start 2024-08-31T04:33:35.644 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:35.639+0000 7fa78c600640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa784103450 0x7fa784076bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:33:35.644 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:35.639+0000 7fa78c600640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa7841044d0 0x7fa7840754b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:33:35.644 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:35.639+0000 7fa78c600640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa784104e70 0x7fa7840759f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:33:35.644 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:35.639+0000 7fa78c600640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fa78410f0d0 con 0x7fa784104e70 2024-08-31T04:33:35.644 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:35.639+0000 7fa78c600640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7fa78410ef50 con 0x7fa784103450 2024-08-31T04:33:35.644 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:35.639+0000 7fa78c600640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fa78410f250 con 0x7fa7841044d0 2024-08-31T04:33:35.644 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:35.639+0000 7fa78a600640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa784104e70 0x7fa7840759f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:33:35.644 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:35.639+0000 7fa78a600640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa784104e70 0x7fa7840759f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:43574/0 (socket says 172.21.15.50:43574) 2024-08-31T04:33:35.644 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:35.639+0000 7fa78a600640 1 -- 172.21.15.50:0/3439337489 learned_addr learned my addr 172.21.15.50:0/3439337489 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:33:35.644 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:35.639+0000 7fa789c00640 1 --2- 172.21.15.50:0/3439337489 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa784103450 0x7fa784076bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:33:35.645 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:35.639+0000 7fa78a600640 1 -- 172.21.15.50:0/3439337489 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa7841044d0 msgr2=0x7fa7840754b0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-08-31T04:33:35.645 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:35.639+0000 7fa78a600640 1 --2- 172.21.15.50:0/3439337489 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa7841044d0 0x7fa7840754b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:35.645 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:35.639+0000 7fa78a600640 1 -- 172.21.15.50:0/3439337489 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa784103450 msgr2=0x7fa784076bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:33:35.645 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:35.639+0000 7fa78a600640 1 --2- 172.21.15.50:0/3439337489 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa784103450 0x7fa784076bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:35.645 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:35.639+0000 7fa78a600640 1 -- 172.21.15.50:0/3439337489 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa784076120 con 0x7fa784104e70 2024-08-31T04:33:35.645 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:35.639+0000 7fa78a600640 1 --2- 172.21.15.50:0/3439337489 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa784104e70 0x7fa7840759f0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7fa77c00eb10 tx=0x7fa77c00c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:33:35.645 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:35.639+0000 7fa782000640 1 -- 172.21.15.50:0/3439337489 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa77c004b20 con 0x7fa784104e70 2024-08-31T04:33:35.645 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:35.639+0000 7fa782000640 1 -- 172.21.15.50:0/3439337489 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa77c004cc0 con 0x7fa784104e70 2024-08-31T04:33:35.645 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:35.639+0000 7fa78c600640 1 -- 172.21.15.50:0/3439337489 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa7841a3d60 con 0x7fa784104e70 2024-08-31T04:33:35.645 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:35.639+0000 7fa782000640 1 -- 172.21.15.50:0/3439337489 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa77c010670 con 0x7fa784104e70 2024-08-31T04:33:35.645 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:35.639+0000 7fa78c600640 1 -- 172.21.15.50:0/3439337489 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa7841a41a0 con 0x7fa784104e70 2024-08-31T04:33:35.646 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:35.645+0000 7fa793687740 1 Processor -- start 2024-08-31T04:33:35.647 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:35.645+0000 7fa782000640 1 -- 172.21.15.50:0/3439337489 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 18) ==== 152577+0+0 (secure 0 0 0) 0x7fa77c005020 con 0x7fa784104e70 2024-08-31T04:33:35.647 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:35.645+0000 7fa793687740 1 -- start start 2024-08-31T04:33:35.648 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:35.645+0000 7fa793687740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563e5c04c1b0 0x563e5c3f1dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:33:35.649 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:35.645+0000 7fa793687740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x563e5c0232f0 0x563e5c3f2430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:33:35.649 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:35.645+0000 7fa793687740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x563e5c02b4d0 0x563e5c3f2f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:33:35.649 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:35.645+0000 7fa793687740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x563e5c364f70 con 0x563e5c04c1b0 2024-08-31T04:33:35.649 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:35.645+0000 7fa793687740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x563e5c354500 con 0x563e5c0232f0 2024-08-31T04:33:35.649 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:35.645+0000 7fa793687740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x563e5c3584b0 con 0x563e5c02b4d0 2024-08-31T04:33:35.649 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:35.645+0000 7fa789200640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563e5c04c1b0 0x563e5c3f1dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:33:35.649 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:35.645+0000 7fa789200640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563e5c04c1b0 0x563e5c3f1dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:43576/0 (socket says 172.21.15.50:43576) 2024-08-31T04:33:35.649 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:35.645+0000 7fa789200640 1 -- 172.21.15.50:0/1163475551 learned_addr learned my addr 172.21.15.50:0/1163475551 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:33:35.650 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:35.645+0000 7fa789c00640 1 --2- 172.21.15.50:0/1163475551 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x563e5c0232f0 0x563e5c3f2430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:33:35.650 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:35.645+0000 7fa789200640 1 -- 172.21.15.50:0/1163475551 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x563e5c02b4d0 msgr2=0x563e5c3f2f80 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-08-31T04:33:35.650 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:35.645+0000 7fa789200640 1 --2- 172.21.15.50:0/1163475551 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x563e5c02b4d0 0x563e5c3f2f80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:35.650 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:35.645+0000 7fa789200640 1 -- 172.21.15.50:0/1163475551 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x563e5c0232f0 msgr2=0x563e5c3f2430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:33:35.650 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:35.645+0000 7fa789200640 1 --2- 172.21.15.50:0/1163475551 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x563e5c0232f0 0x563e5c3f2430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:35.650 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:35.645+0000 7fa789200640 1 -- 172.21.15.50:0/1163475551 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563e5c30ec10 con 0x563e5c04c1b0 2024-08-31T04:33:35.653 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:35.645+0000 7fa789200640 1 --2- 172.21.15.50:0/1163475551 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563e5c04c1b0 0x563e5c3f1dc0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7fa770031500 tx=0x7fa7700315a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e42df3f8f924ad2b server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:33:35.654 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:35.645+0000 7fa782000640 1 --2- 172.21.15.50:0/3439337489 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fa76c0b4bb0 0x7fa76c0b70c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:33:35.654 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:35.645+0000 7fa776a00640 1 -- 172.21.15.50:0/1163475551 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa77003e030 con 0x563e5c04c1b0 2024-08-31T04:33:35.654 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:35.645+0000 7fa782000640 1 -- 172.21.15.50:0/3439337489 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8219+0+0 (secure 0 0 0) 0x7fa77c0e56b0 con 0x7fa784104e70 2024-08-31T04:33:35.654 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:35.645+0000 7fa776a00640 1 -- 172.21.15.50:0/1163475551 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa770031710 con 0x563e5c04c1b0 2024-08-31T04:33:35.654 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:35.645+0000 7fa776a00640 1 -- 172.21.15.50:0/1163475551 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa770035040 con 0x563e5c04c1b0 2024-08-31T04:33:35.654 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:35.645+0000 7fa789c00640 1 --2- 172.21.15.50:0/3439337489 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fa76c0b4bb0 0x7fa76c0b70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:33:35.654 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:35.645+0000 7fa793687740 1 -- 172.21.15.50:0/1163475551 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563e5c04c1b0 msgr2=0x563e5c3f1dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:33:35.654 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:35.645+0000 7fa793687740 1 --2- 172.21.15.50:0/1163475551 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563e5c04c1b0 0x563e5c3f1dc0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7fa770031500 tx=0x7fa7700315a0 comp rx=0 tx=0).stop 2024-08-31T04:33:35.654 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:35.645+0000 7fa789c00640 1 --2- 172.21.15.50:0/3439337489 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fa76c0b4bb0 0x7fa76c0b70c0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fa778004610 tx=0x7fa77800b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:33:35.654 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:35.645+0000 7fa793687740 1 -- 172.21.15.50:0/1163475551 shutdown_connections 2024-08-31T04:33:35.654 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:35.645+0000 7fa793687740 1 --2- 172.21.15.50:0/1163475551 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x563e5c02b4d0 0x563e5c3f2f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:35.654 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:35.645+0000 7fa793687740 1 --2- 172.21.15.50:0/1163475551 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x563e5c0232f0 0x563e5c3f2430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:35.655 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:35.645+0000 7fa793687740 1 --2- 172.21.15.50:0/1163475551 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563e5c04c1b0 0x563e5c3f1dc0 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:35.655 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:35.645+0000 7fa793687740 1 -- 172.21.15.50:0/1163475551 >> 172.21.15.50:0/1163475551 conn(0x563e5c040300 msgr2=0x563e5c3ed850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:33:35.655 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:35.650+0000 7fa793687740 1 -- 172.21.15.50:0/1163475551 shutdown_connections 2024-08-31T04:33:35.655 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:35.650+0000 7fa793687740 1 -- 172.21.15.50:0/1163475551 wait complete. 2024-08-31T04:33:35.655 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:35.650+0000 7fa793687740 1 -- start start 2024-08-31T04:33:35.655 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:35.650+0000 7fa793687740 1 Processor -- start 2024-08-31T04:33:35.655 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:35.650+0000 7fa793687740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x563e5c0232f0 0x563e5c3fb470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:33:35.655 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:35.650+0000 7fa793687740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563e5c02b4d0 0x563e5c3fbb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:33:35.655 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:35.650+0000 7fa793687740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x563e5c04c1b0 0x563e5c3fc6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:33:35.655 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:35.650+0000 7fa793687740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x563e5c28dab0 con 0x563e5c02b4d0 2024-08-31T04:33:35.655 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:35.650+0000 7fa793687740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x563e5c2fb320 con 0x563e5c04c1b0 2024-08-31T04:33:35.655 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:35.650+0000 7fa793687740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x563e5c3f3a40 con 0x563e5c0232f0 2024-08-31T04:33:35.655 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:35.650+0000 7fa793687740 10 client.0 _ll_register_callbacks cb 0x563e5c3016a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:33:35.656 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:35.650+0000 7fa789200640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563e5c02b4d0 0x563e5c3fbb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:33:35.656 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:35.650+0000 7fa78a600640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x563e5c04c1b0 0x563e5c3fc6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:33:35.656 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:35.650+0000 7fa789c00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x563e5c0232f0 0x563e5c3fb470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:33:35.656 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:35.650+0000 7fa789200640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563e5c02b4d0 0x563e5c3fbb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:43580/0 (socket says 172.21.15.50:43580) 2024-08-31T04:33:35.656 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:35.650+0000 7fa789200640 1 -- 172.21.15.50:0/1455228446 learned_addr learned my addr 172.21.15.50:0/1455228446 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:33:35.656 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:35.650+0000 7fa789200640 1 -- 172.21.15.50:0/1455228446 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x563e5c0232f0 msgr2=0x563e5c3fb470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:33:35.656 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:35.650+0000 7fa789200640 1 --2- 172.21.15.50:0/1455228446 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x563e5c0232f0 0x563e5c3fb470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:35.656 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:35.650+0000 7fa789200640 1 -- 172.21.15.50:0/1455228446 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x563e5c04c1b0 msgr2=0x563e5c3fc6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:33:35.656 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:35.650+0000 7fa789200640 1 --2- 172.21.15.50:0/1455228446 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x563e5c04c1b0 0x563e5c3fc6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:35.656 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:35.650+0000 7fa789200640 1 -- 172.21.15.50:0/1455228446 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563e5c0b7790 con 0x563e5c02b4d0 2024-08-31T04:33:35.656 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:35.650+0000 7fa78a600640 1 --2- 172.21.15.50:0/1455228446 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x563e5c04c1b0 0x563e5c3fc6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:33:35.656 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:35.650+0000 7fa789200640 1 --2- 172.21.15.50:0/1455228446 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563e5c02b4d0 0x563e5c3fbb30 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fa7700099f0 tx=0x7fa770031d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1fbbb4f8b9de1d2e server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:33:35.656 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:35.650+0000 7fa76b400640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-08-31T04:33:35.657 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:35.650+0000 7fa76b400640 1 -- 172.21.15.50:0/1455228446 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa770043820 con 0x563e5c02b4d0 2024-08-31T04:33:35.657 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:35.650+0000 7fa76b400640 1 -- 172.21.15.50:0/1455228446 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8219+0+0 (secure 0 0 0) 0x7fa7700439c0 con 0x563e5c02b4d0 2024-08-31T04:33:35.657 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:35.650+0000 7fa793687740 1 -- 172.21.15.50:0/1455228446 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa770031710 con 0x563e5c02b4d0 2024-08-31T04:33:35.657 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:35.650+0000 7fa76b400640 1 -- 172.21.15.50:0/1455228446 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=53) ==== 24+0+0 (secure 0 0 0) 0x7fa7700318c0 con 0x563e5c02b4d0 2024-08-31T04:33:35.657 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:35.650+0000 7fa793687740 10 client.16407 fetch_fsmap learned FSMap version 53 2024-08-31T04:33:35.657 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:35.650+0000 7fa793687740 1 -- 172.21.15.50:0/1455228446 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=53,monmap=4+}) -- 0x563e5c130620 con 0x563e5c02b4d0 2024-08-31T04:33:35.658 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:35.650+0000 7fa76b400640 1 -- 172.21.15.50:0/1455228446 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa770031710 con 0x563e5c02b4d0 2024-08-31T04:33:35.658 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:35.650+0000 7fa76b400640 1 -- 172.21.15.50:0/1455228446 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 53) ==== 8362+0+0 (secure 0 0 0) 0x7fa77003ab40 con 0x563e5c02b4d0 2024-08-31T04:33:35.658 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:35.650+0000 7fa793687740 10 client.16407 fetch_fsmap finished waiting for FSMap version 53 2024-08-31T04:33:35.658 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:35.650+0000 7fa793687740 10 client.16407 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T04:33:35.658 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:35.650+0000 7fa793687740 20 client.16407 populate_metadata read hostname 'smithi050' 2024-08-31T04:33:35.658 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:35.650+0000 7fa793687740 1 --2- 172.21.15.50:0/1455228446 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x563e5c00ad80 0x563e5c408780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:33:35.658 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:35.650+0000 7fa793687740 4 client.16407 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T04:33:35.659 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:35.650+0000 7fa793687740 1 -- 172.21.15.50:0/1455228446 --> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563e5c366ec0 con 0x563e5c00ad80 2024-08-31T04:33:35.674 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:35.673+0000 7fa789c00640 1 --2- 172.21.15.50:0/1455228446 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x563e5c00ad80 0x563e5c408780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:33:35.733 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:35.732+0000 7fa789c00640 1 --2- 172.21.15.50:0/1455228446 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x563e5c00ad80 0x563e5c408780 crc :-1 s=READY pgs=140 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5992ebbf931c8655 server_cookie=bf75388b53d48c67 in_seq=0 out_seq=0 2024-08-31T04:33:35.734 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:35.732+0000 7fa76b400640 10 client.16407 ms_handle_connect on v2:172.21.15.133:6838/2526402262 2024-08-31T04:33:35.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:33:35 smithi177 ceph-mon[22025]: pgmap v689: 97 pgs: 97 active+clean; 1.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 8.1 KiB/s wr, 9 op/s 2024-08-31T04:33:35.758 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:35.756+0000 7fa76b400640 1 -- 172.21.15.50:0/1455228446 <== mds.0 v2:172.21.15.133:6838/2526402262 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x563e5c366ec0 con 0x563e5c00ad80 2024-08-31T04:33:35.758 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:35.756+0000 7fa76b400640 10 client.16407 handle_command_reply: tid=0 2024-08-31T04:33:35.758 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:35.756+0000 7fa793687740 1 client.16407 shutdown 2024-08-31T04:33:35.758 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:35.756+0000 7fa793687740 1 -- 172.21.15.50:0/1455228446 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563e5c02b4d0 msgr2=0x563e5c3fbb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:33:35.758 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:35.756+0000 7fa793687740 1 --2- 172.21.15.50:0/1455228446 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563e5c02b4d0 0x563e5c3fbb30 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fa7700099f0 tx=0x7fa770031d00 comp rx=0 tx=0).stop 2024-08-31T04:33:35.758 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:35.756+0000 7fa793687740 1 -- 172.21.15.50:0/1455228446 shutdown_connections 2024-08-31T04:33:35.758 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:35.756+0000 7fa793687740 1 --2- 172.21.15.50:0/1455228446 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x563e5c00ad80 0x563e5c408780 crc :-1 s=READY pgs=140 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:35.758 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:35.756+0000 7fa793687740 1 --2- 172.21.15.50:0/1455228446 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x563e5c04c1b0 0x563e5c3fc6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:35.758 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:35.756+0000 7fa76b400640 0 client.16407 ms_handle_reset on v2:172.21.15.133:6838/2526402262 2024-08-31T04:33:35.759 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:35.756+0000 7fa793687740 1 --2- 172.21.15.50:0/1455228446 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563e5c02b4d0 0x563e5c3fbb30 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:35.759 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:35.756+0000 7fa793687740 1 --2- 172.21.15.50:0/1455228446 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x563e5c0232f0 0x563e5c3fb470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:35.759 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:35.756+0000 7fa793687740 1 -- 172.21.15.50:0/1455228446 >> 172.21.15.50:0/1455228446 conn(0x563e5c040300 msgr2=0x563e5c3ebcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:33:35.759 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:35.756+0000 7fa793687740 1 -- 172.21.15.50:0/1455228446 shutdown_connections 2024-08-31T04:33:35.759 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:35.756+0000 7fa793687740 1 -- 172.21.15.50:0/1455228446 wait complete. 2024-08-31T04:33:35.759 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:35.756+0000 7fa793687740 20 client.16407 trim_cache size 0 max 16384 2024-08-31T04:33:35.774 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:35.768+0000 7fa793687740 1 Processor -- start 2024-08-31T04:33:35.774 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:35.768+0000 7fa793687740 1 -- start start 2024-08-31T04:33:35.775 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:35.773+0000 7fa793687740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563e5c0232f0 0x563e5c3fbb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:33:35.775 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:35.773+0000 7fa793687740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x563e5c02b4d0 0x563e5c3fa030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:33:35.775 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:35.773+0000 7fa793687740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x563e5c04c1b0 0x563e5c403580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:33:35.775 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:35.773+0000 7fa793687740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fa7841ace00 con 0x563e5c0232f0 2024-08-31T04:33:35.775 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:35.773+0000 7fa793687740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7fa7841ae940 con 0x563e5c02b4d0 2024-08-31T04:33:35.775 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:35.773+0000 7fa793687740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fa7841ad4d0 con 0x563e5c04c1b0 2024-08-31T04:33:35.775 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:35.773+0000 7fa789c00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563e5c0232f0 0x563e5c3fbb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:33:35.775 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:35.773+0000 7fa789c00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563e5c0232f0 0x563e5c3fbb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:43596/0 (socket says 172.21.15.50:43596) 2024-08-31T04:33:35.775 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:35.773+0000 7fa789c00640 1 -- 172.21.15.50:0/2686833381 learned_addr learned my addr 172.21.15.50:0/2686833381 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:33:35.775 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:35.773+0000 7fa78a600640 1 --2- 172.21.15.50:0/2686833381 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x563e5c04c1b0 0x563e5c403580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:33:35.775 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:35.773+0000 7fa789200640 1 --2- 172.21.15.50:0/2686833381 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x563e5c02b4d0 0x563e5c3fa030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:33:35.777 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:35.773+0000 7fa78a600640 1 -- 172.21.15.50:0/2686833381 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x563e5c02b4d0 msgr2=0x563e5c3fa030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:33:35.777 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:35.773+0000 7fa78a600640 1 --2- 172.21.15.50:0/2686833381 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x563e5c02b4d0 0x563e5c3fa030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:35.777 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:35.773+0000 7fa78a600640 1 -- 172.21.15.50:0/2686833381 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563e5c0232f0 msgr2=0x563e5c3fbb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:33:35.777 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:35.773+0000 7fa78a600640 1 --2- 172.21.15.50:0/2686833381 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563e5c0232f0 0x563e5c3fbb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:35.777 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:35.773+0000 7fa78a600640 1 -- 172.21.15.50:0/2686833381 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563e5c3fca10 con 0x563e5c04c1b0 2024-08-31T04:33:35.777 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:35.773+0000 7fa789c00640 1 --2- 172.21.15.50:0/2686833381 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563e5c0232f0 0x563e5c3fbb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:33:35.778 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:35.773+0000 7fa78a600640 1 --2- 172.21.15.50:0/2686833381 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x563e5c04c1b0 0x563e5c403580 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fa77c0e3210 tx=0x7fa77c000f40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bdb65b48a76f8de4 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:33:35.778 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:35.773+0000 7fa776000640 1 -- 172.21.15.50:0/2686833381 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa77c0ac7f0 con 0x563e5c04c1b0 2024-08-31T04:33:35.778 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:35.773+0000 7fa776000640 1 -- 172.21.15.50:0/2686833381 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa77c0ac0f0 con 0x563e5c04c1b0 2024-08-31T04:33:35.778 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:35.773+0000 7fa776000640 1 -- 172.21.15.50:0/2686833381 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa77c0b4f80 con 0x563e5c04c1b0 2024-08-31T04:33:35.778 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:35.773+0000 7fa793687740 1 -- 172.21.15.50:0/2686833381 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x563e5c04c1b0 msgr2=0x563e5c403580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:33:35.778 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:35.773+0000 7fa793687740 1 --2- 172.21.15.50:0/2686833381 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x563e5c04c1b0 0x563e5c403580 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fa77c0e3210 tx=0x7fa77c000f40 comp rx=0 tx=0).stop 2024-08-31T04:33:35.778 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:35.773+0000 7fa793687740 1 -- 172.21.15.50:0/2686833381 shutdown_connections 2024-08-31T04:33:35.778 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:35.773+0000 7fa793687740 1 --2- 172.21.15.50:0/2686833381 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x563e5c04c1b0 0x563e5c403580 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:35.778 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:35.773+0000 7fa793687740 1 --2- 172.21.15.50:0/2686833381 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x563e5c02b4d0 0x563e5c3fa030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:35.778 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:35.773+0000 7fa793687740 1 --2- 172.21.15.50:0/2686833381 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563e5c0232f0 0x563e5c3fbb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:35.778 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:35.773+0000 7fa793687740 1 -- 172.21.15.50:0/2686833381 >> 172.21.15.50:0/2686833381 conn(0x563e5c040300 msgr2=0x563e5c3fb470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:33:35.778 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:35.773+0000 7fa793687740 1 -- 172.21.15.50:0/2686833381 shutdown_connections 2024-08-31T04:33:35.778 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:35.773+0000 7fa793687740 1 -- 172.21.15.50:0/2686833381 wait complete. 2024-08-31T04:33:35.778 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:35.773+0000 7fa793687740 1 -- start start 2024-08-31T04:33:35.779 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:35.773+0000 7fa793687740 1 Processor -- start 2024-08-31T04:33:35.781 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:35.773+0000 7fa793687740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x563e5c0232f0 0x563e5c403180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:33:35.781 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:35.773+0000 7fa793687740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x563e5c02b4d0 0x563e5c3fef90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:33:35.781 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:35.773+0000 7fa793687740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563e5c04c1b0 0x563e5c3ff4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:33:35.781 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:35.773+0000 7fa793687740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fa7841ae270 con 0x563e5c04c1b0 2024-08-31T04:33:35.781 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:35.773+0000 7fa793687740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7fa7841adba0 con 0x563e5c0232f0 2024-08-31T04:33:35.781 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:35.773+0000 7fa793687740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fa7841aade0 con 0x563e5c02b4d0 2024-08-31T04:33:35.781 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:35.773+0000 7fa793687740 10 client.0 _ll_register_callbacks cb 0x7fa770005de0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:33:35.781 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:35.773+0000 7fa78a600640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563e5c04c1b0 0x563e5c3ff4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:33:35.782 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:35.773+0000 7fa78a600640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563e5c04c1b0 0x563e5c3ff4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:43608/0 (socket says 172.21.15.50:43608) 2024-08-31T04:33:35.782 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:35.773+0000 7fa789200640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x563e5c02b4d0 0x563e5c3fef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:33:35.782 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:35.773+0000 7fa78a600640 1 -- 172.21.15.50:0/2723137044 learned_addr learned my addr 172.21.15.50:0/2723137044 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:33:35.782 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:35.773+0000 7fa789c00640 1 --2- 172.21.15.50:0/2723137044 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x563e5c0232f0 0x563e5c403180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:33:35.782 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:35.773+0000 7fa78a600640 1 -- 172.21.15.50:0/2723137044 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x563e5c02b4d0 msgr2=0x563e5c3fef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:33:35.782 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:35.773+0000 7fa78a600640 1 --2- 172.21.15.50:0/2723137044 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x563e5c02b4d0 0x563e5c3fef90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:35.782 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:35.773+0000 7fa78a600640 1 -- 172.21.15.50:0/2723137044 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x563e5c0232f0 msgr2=0x563e5c403180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:33:35.782 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:35.773+0000 7fa78a600640 1 --2- 172.21.15.50:0/2723137044 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x563e5c0232f0 0x563e5c403180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:35.782 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:35.773+0000 7fa78a600640 1 -- 172.21.15.50:0/2723137044 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563e5c400100 con 0x563e5c04c1b0 2024-08-31T04:33:35.782 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:35.773+0000 7fa78a600640 1 --2- 172.21.15.50:0/2723137044 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563e5c04c1b0 0x563e5c3ff4d0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fa77c0e31c0 tx=0x7fa77c0abd00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=398ef2eec9a3446d server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:33:35.782 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:35.773+0000 7fa76b400640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-08-31T04:33:35.782 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:35.773+0000 7fa76b400640 1 -- 172.21.15.50:0/2723137044 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa77c0ac7f0 con 0x563e5c04c1b0 2024-08-31T04:33:35.782 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:35.778+0000 7fa76b400640 1 -- 172.21.15.50:0/2723137044 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8219+0+0 (secure 0 0 0) 0x7fa77c0ab560 con 0x563e5c04c1b0 2024-08-31T04:33:35.783 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:35.778+0000 7fa793687740 1 -- 172.21.15.50:0/2723137044 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa77c0ac0f0 con 0x563e5c04c1b0 2024-08-31T04:33:35.783 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:35.778+0000 7fa76b400640 1 -- 172.21.15.50:0/2723137044 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=53) ==== 24+0+0 (secure 0 0 0) 0x7fa77c0b5410 con 0x563e5c04c1b0 2024-08-31T04:33:35.783 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:35.778+0000 7fa793687740 10 client.16413 fetch_fsmap learned FSMap version 53 2024-08-31T04:33:35.783 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:35.778+0000 7fa793687740 1 -- 172.21.15.50:0/2723137044 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=53,monmap=4+}) -- 0x563e5c4732b0 con 0x563e5c04c1b0 2024-08-31T04:33:35.783 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:35.778+0000 7fa76b400640 1 -- 172.21.15.50:0/2723137044 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa77c0ac0f0 con 0x563e5c04c1b0 2024-08-31T04:33:35.783 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:35.778+0000 7fa76b400640 1 -- 172.21.15.50:0/2723137044 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 53) ==== 8362+0+0 (secure 0 0 0) 0x7fa77c0b3ce0 con 0x563e5c04c1b0 2024-08-31T04:33:35.783 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:35.778+0000 7fa793687740 10 client.16413 fetch_fsmap finished waiting for FSMap version 53 2024-08-31T04:33:35.783 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:35.778+0000 7fa793687740 10 client.16413 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T04:33:35.783 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:35.778+0000 7fa793687740 20 client.16413 populate_metadata read hostname 'smithi050' 2024-08-31T04:33:35.783 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:35.778+0000 7fa793687740 1 --2- 172.21.15.50:0/2723137044 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x563e5bfe01c0 0x563e5c475c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:33:35.783 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:35.778+0000 7fa793687740 4 client.16413 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-31T04:33:35.783 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:35.778+0000 7fa793687740 1 -- 172.21.15.50:0/2723137044 --> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] -- command(tid 0: {"prefix": "flush journal"}) -- 0x563e5c362960 con 0x563e5bfe01c0 2024-08-31T04:33:35.783 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:35.778+0000 7fa789c00640 1 --2- 172.21.15.50:0/2723137044 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x563e5bfe01c0 0x563e5c475c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:33:35.784 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:35.780+0000 7fa789c00640 1 --2- 172.21.15.50:0/2723137044 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x563e5bfe01c0 0x563e5c475c40 crc :-1 s=READY pgs=141 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dfa6d5c1859f85fb server_cookie=9b9c822c11dcd187 in_seq=0 out_seq=0 2024-08-31T04:33:35.784 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:35.780+0000 7fa76b400640 10 client.16413 ms_handle_connect on v2:172.21.15.133:6838/2526402262 2024-08-31T04:33:35.790 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:35.785+0000 7fa76b400640 1 -- 172.21.15.50:0/2723137044 <== mds.0 v2:172.21.15.133:6838/2526402262 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x563e5c362960 con 0x563e5bfe01c0 2024-08-31T04:33:35.790 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:35.785+0000 7fa76b400640 10 client.16413 handle_command_reply: tid=0 2024-08-31T04:33:35.790 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:35.785+0000 7fa793687740 1 client.16413 shutdown 2024-08-31T04:33:35.791 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:35.785+0000 7fa793687740 1 -- 172.21.15.50:0/2723137044 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563e5c04c1b0 msgr2=0x563e5c3ff4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:33:35.791 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:35.785+0000 7fa793687740 1 --2- 172.21.15.50:0/2723137044 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563e5c04c1b0 0x563e5c3ff4d0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fa77c0e31c0 tx=0x7fa77c0abd00 comp rx=0 tx=0).stop 2024-08-31T04:33:35.791 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:35.785+0000 7fa793687740 1 -- 172.21.15.50:0/2723137044 shutdown_connections 2024-08-31T04:33:35.791 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:35.785+0000 7fa793687740 1 --2- 172.21.15.50:0/2723137044 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x563e5bfe01c0 0x563e5c475c40 crc :-1 s=READY pgs=141 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:35.791 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:35.785+0000 7fa793687740 1 --2- 172.21.15.50:0/2723137044 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x563e5c02b4d0 0x563e5c3fef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:35.791 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:35.785+0000 7fa793687740 1 --2- 172.21.15.50:0/2723137044 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563e5c04c1b0 0x563e5c3ff4d0 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:35.791 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:35.785+0000 7fa793687740 1 --2- 172.21.15.50:0/2723137044 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x563e5c0232f0 0x563e5c403180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:35.791 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:35.785+0000 7fa793687740 1 -- 172.21.15.50:0/2723137044 >> 172.21.15.50:0/2723137044 conn(0x563e5c040300 msgr2=0x563e5c3f8540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:33:35.791 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:35.785+0000 7fa76b400640 0 client.16413 ms_handle_reset on v2:172.21.15.133:6838/2526402262 2024-08-31T04:33:35.791 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:35.785+0000 7fa793687740 1 -- 172.21.15.50:0/2723137044 shutdown_connections 2024-08-31T04:33:35.791 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:35.785+0000 7fa793687740 1 -- 172.21.15.50:0/2723137044 wait complete. 2024-08-31T04:33:35.791 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:35.785+0000 7fa793687740 20 client.16413 trim_cache size 0 max 16384 2024-08-31T04:33:35.792 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout:{ 2024-08-31T04:33:35.792 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout: "message": "", 2024-08-31T04:33:35.792 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout: "return_code": 0 2024-08-31T04:33:35.792 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout:} 2024-08-31T04:33:35.793 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:35.790+0000 7fa78c600640 1 -- 172.21.15.50:0/3439337489 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fa76c0b4bb0 msgr2=0x7fa76c0b70c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:33:35.793 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:35.790+0000 7fa78c600640 1 --2- 172.21.15.50:0/3439337489 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fa76c0b4bb0 0x7fa76c0b70c0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fa778004610 tx=0x7fa77800b390 comp rx=0 tx=0).stop 2024-08-31T04:33:35.793 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:35.790+0000 7fa78c600640 1 -- 172.21.15.50:0/3439337489 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa784104e70 msgr2=0x7fa7840759f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:33:35.793 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:35.790+0000 7fa78c600640 1 --2- 172.21.15.50:0/3439337489 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa784104e70 0x7fa7840759f0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7fa77c00eb10 tx=0x7fa77c00c2d0 comp rx=0 tx=0).stop 2024-08-31T04:33:35.793 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:35.790+0000 7fa78c600640 1 -- 172.21.15.50:0/3439337489 shutdown_connections 2024-08-31T04:33:35.793 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:35.790+0000 7fa78c600640 1 --2- 172.21.15.50:0/3439337489 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fa76c0b4bb0 0x7fa76c0b70c0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:35.793 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:35.790+0000 7fa78c600640 1 --2- 172.21.15.50:0/3439337489 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa7841044d0 0x7fa7840754b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:35.793 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:35.790+0000 7fa78c600640 1 --2- 172.21.15.50:0/3439337489 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa784104e70 0x7fa7840759f0 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:35.793 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:35.790+0000 7fa78c600640 1 --2- 172.21.15.50:0/3439337489 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa784103450 0x7fa784076bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:35.793 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:35.790+0000 7fa78c600640 1 -- 172.21.15.50:0/3439337489 >> 172.21.15.50:0/3439337489 conn(0x7fa7840fed90 msgr2=0x7fa7841077d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:33:35.794 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:35.790+0000 7fa78c600640 1 -- 172.21.15.50:0/3439337489 shutdown_connections 2024-08-31T04:33:35.794 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:35.790+0000 7fa78c600640 1 -- 172.21.15.50:0/3439337489 wait complete. 2024-08-31T04:33:35.794 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:33:35 smithi133 ceph-mon[22177]: pgmap v689: 97 pgs: 97 active+clean; 1.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 8.1 KiB/s wr, 9 op/s 2024-08-31T04:33:36.475 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:33:36 smithi050 ceph-mon[17259]: 1 slow requests, 0 included below; oldest blocked for > 229.060085 secs 2024-08-31T04:33:36.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:33:36 smithi177 ceph-mon[22025]: 1 slow requests, 0 included below; oldest blocked for > 229.060085 secs 2024-08-31T04:33:36.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:33:36 smithi133 ceph-mon[22177]: 1 slow requests, 0 included below; oldest blocked for > 229.060085 secs 2024-08-31T04:33:37.604 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:33:37 smithi050 ceph-mon[17259]: pgmap v690: 97 pgs: 97 active+clean; 1.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 8.1 KiB/s wr, 11 op/s 2024-08-31T04:33:37.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:33:37 smithi177 ceph-mon[22025]: pgmap v690: 97 pgs: 97 active+clean; 1.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 8.1 KiB/s wr, 11 op/s 2024-08-31T04:33:37.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:33:37 smithi133 ceph-mon[22177]: pgmap v690: 97 pgs: 97 active+clean; 1.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 8.1 KiB/s wr, 11 op/s 2024-08-31T04:33:39.582 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:33:39 smithi050 ceph-mon[17259]: pgmap v691: 97 pgs: 97 active+clean; 1.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 341 B/s wr, 10 op/s 2024-08-31T04:33:39.582 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:33:39 smithi050 ceph-mon[17259]: 1 slow requests, 0 included below; oldest blocked for > 230.004438 secs 2024-08-31T04:33:39.582 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:33:39 smithi050 ceph-mon[17259]: 4 slow requests, 3 included below; oldest blocked for > 232.350745 secs 2024-08-31T04:33:39.582 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:33:39 smithi050 ceph-mon[17259]: slow request 182.676314 seconds old, received at 2024-08-31T04:30:36.038432+0000: peer_request:mds.0:11502 currently dispatched 2024-08-31T04:33:39.582 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:33:39 smithi050 ceph-mon[17259]: slow request 182.676198 seconds old, received at 2024-08-31T04:30:36.038547+0000: peer_request:mds.0:11503 currently dispatched 2024-08-31T04:33:39.582 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:33:39 smithi050 ceph-mon[17259]: slow request 232.350744 seconds old, received at 2024-08-31T04:29:46.364001+0000: client_request(client.15282:310818 create owner_uid=1000, owner_gid=1333 #0x200000022cc/article-27.xml.tmp 2024-08-31T04:29:46.362966+0000 caller_uid=1000, caller_gid=1333{6,36,1000,1333,}) currently failed to wrlock, waiting 2024-08-31T04:33:39.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:33:39 smithi177 ceph-mon[22025]: pgmap v691: 97 pgs: 97 active+clean; 1.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 341 B/s wr, 10 op/s 2024-08-31T04:33:39.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:33:39 smithi177 ceph-mon[22025]: 1 slow requests, 0 included below; oldest blocked for > 230.004438 secs 2024-08-31T04:33:39.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:33:39 smithi177 ceph-mon[22025]: 4 slow requests, 3 included below; oldest blocked for > 232.350745 secs 2024-08-31T04:33:39.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:33:39 smithi177 ceph-mon[22025]: slow request 182.676314 seconds old, received at 2024-08-31T04:30:36.038432+0000: peer_request:mds.0:11502 currently dispatched 2024-08-31T04:33:39.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:33:39 smithi177 ceph-mon[22025]: slow request 182.676198 seconds old, received at 2024-08-31T04:30:36.038547+0000: peer_request:mds.0:11503 currently dispatched 2024-08-31T04:33:39.747 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:33:39 smithi177 ceph-mon[22025]: slow request 232.350744 seconds old, received at 2024-08-31T04:29:46.364001+0000: client_request(client.15282:310818 create owner_uid=1000, owner_gid=1333 #0x200000022cc/article-27.xml.tmp 2024-08-31T04:29:46.362966+0000 caller_uid=1000, caller_gid=1333{6,36,1000,1333,}) currently failed to wrlock, waiting 2024-08-31T04:33:39.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:33:39 smithi133 ceph-mon[22177]: pgmap v691: 97 pgs: 97 active+clean; 1.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 341 B/s wr, 10 op/s 2024-08-31T04:33:39.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:33:39 smithi133 ceph-mon[22177]: 1 slow requests, 0 included below; oldest blocked for > 230.004438 secs 2024-08-31T04:33:39.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:33:39 smithi133 ceph-mon[22177]: 4 slow requests, 3 included below; oldest blocked for > 232.350745 secs 2024-08-31T04:33:39.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:33:39 smithi133 ceph-mon[22177]: slow request 182.676314 seconds old, received at 2024-08-31T04:30:36.038432+0000: peer_request:mds.0:11502 currently dispatched 2024-08-31T04:33:39.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:33:39 smithi133 ceph-mon[22177]: slow request 182.676198 seconds old, received at 2024-08-31T04:30:36.038547+0000: peer_request:mds.0:11503 currently dispatched 2024-08-31T04:33:39.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:33:39 smithi133 ceph-mon[22177]: slow request 232.350744 seconds old, received at 2024-08-31T04:29:46.364001+0000: client_request(client.15282:310818 create owner_uid=1000, owner_gid=1333 #0x200000022cc/article-27.xml.tmp 2024-08-31T04:29:46.362966+0000 caller_uid=1000, caller_gid=1333{6,36,1000,1333,}) currently failed to wrlock, waiting 2024-08-31T04:33:41.593 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:33:41 smithi050 ceph-mon[17259]: pgmap v692: 97 pgs: 97 active+clean; 1.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 8.1 KiB/s wr, 9 op/s 2024-08-31T04:33:41.593 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:33:41 smithi050 ceph-mon[17259]: 1 slow requests, 0 included below; oldest blocked for > 234.060152 secs 2024-08-31T04:33:41.593 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:33:41 smithi050 ceph-mon[17259]: 2 slow requests, 2 included below; oldest blocked for > 184.998867 secs 2024-08-31T04:33:41.593 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:33:41 smithi050 ceph-mon[17259]: slow request 184.998867 seconds old, received at 2024-08-31T04:30:36.038287+0000: internal op exportdir:mds.0:11502 currently failed to wrlock, waiting 2024-08-31T04:33:41.593 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:33:41 smithi050 ceph-mon[17259]: slow request 184.998721 seconds old, received at 2024-08-31T04:30:36.038433+0000: internal op exportdir:mds.0:11503 currently failed to wrlock, waiting 2024-08-31T04:33:41.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:33:41 smithi177 ceph-mon[22025]: pgmap v692: 97 pgs: 97 active+clean; 1.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 8.1 KiB/s wr, 9 op/s 2024-08-31T04:33:41.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:33:41 smithi177 ceph-mon[22025]: 1 slow requests, 0 included below; oldest blocked for > 234.060152 secs 2024-08-31T04:33:41.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:33:41 smithi177 ceph-mon[22025]: 2 slow requests, 2 included below; oldest blocked for > 184.998867 secs 2024-08-31T04:33:41.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:33:41 smithi177 ceph-mon[22025]: slow request 184.998867 seconds old, received at 2024-08-31T04:30:36.038287+0000: internal op exportdir:mds.0:11502 currently failed to wrlock, waiting 2024-08-31T04:33:41.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:33:41 smithi177 ceph-mon[22025]: slow request 184.998721 seconds old, received at 2024-08-31T04:30:36.038433+0000: internal op exportdir:mds.0:11503 currently failed to wrlock, waiting 2024-08-31T04:33:41.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:33:41 smithi133 ceph-mon[22177]: pgmap v692: 97 pgs: 97 active+clean; 1.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 8.1 KiB/s wr, 9 op/s 2024-08-31T04:33:41.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:33:41 smithi133 ceph-mon[22177]: 1 slow requests, 0 included below; oldest blocked for > 234.060152 secs 2024-08-31T04:33:41.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:33:41 smithi133 ceph-mon[22177]: 2 slow requests, 2 included below; oldest blocked for > 184.998867 secs 2024-08-31T04:33:41.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:33:41 smithi133 ceph-mon[22177]: slow request 184.998867 seconds old, received at 2024-08-31T04:30:36.038287+0000: internal op exportdir:mds.0:11502 currently failed to wrlock, waiting 2024-08-31T04:33:41.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:33:41 smithi133 ceph-mon[22177]: slow request 184.998721 seconds old, received at 2024-08-31T04:30:36.038433+0000: internal op exportdir:mds.0:11503 currently failed to wrlock, waiting 2024-08-31T04:33:43.585 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:33:43 smithi050 ceph-mon[17259]: pgmap v693: 97 pgs: 97 active+clean; 1.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 8.1 KiB/s wr, 12 op/s 2024-08-31T04:33:43.586 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:33:43 smithi050 ceph-mon[17259]: mds.? [v2:172.21.15.50:6840/575209862,v1:172.21.15.50:6841/575209862] up:active 2024-08-31T04:33:43.586 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:33:43 smithi050 ceph-mon[17259]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-31T04:33:43.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:33:43 smithi177 ceph-mon[22025]: pgmap v693: 97 pgs: 97 active+clean; 1.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 8.1 KiB/s wr, 12 op/s 2024-08-31T04:33:43.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:33:43 smithi177 ceph-mon[22025]: mds.? [v2:172.21.15.50:6840/575209862,v1:172.21.15.50:6841/575209862] up:active 2024-08-31T04:33:43.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:33:43 smithi177 ceph-mon[22025]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-31T04:33:43.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:33:43 smithi133 ceph-mon[22177]: pgmap v693: 97 pgs: 97 active+clean; 1.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 8.1 KiB/s wr, 12 op/s 2024-08-31T04:33:43.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:33:43 smithi133 ceph-mon[22177]: mds.? [v2:172.21.15.50:6840/575209862,v1:172.21.15.50:6841/575209862] up:active 2024-08-31T04:33:43.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:33:43 smithi133 ceph-mon[22177]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-31T04:33:44.436 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:33:44 smithi050 ceph-mon[17259]: 1 slow requests, 0 included below; oldest blocked for > 235.004561 secs 2024-08-31T04:33:44.436 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:33:44 smithi050 ceph-mon[17259]: 4 slow requests, 0 included below; oldest blocked for > 237.351406 secs 2024-08-31T04:33:44.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:33:44 smithi177 ceph-mon[22025]: 1 slow requests, 0 included below; oldest blocked for > 235.004561 secs 2024-08-31T04:33:44.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:33:44 smithi177 ceph-mon[22025]: 4 slow requests, 0 included below; oldest blocked for > 237.351406 secs 2024-08-31T04:33:44.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:33:44 smithi133 ceph-mon[22177]: 1 slow requests, 0 included below; oldest blocked for > 235.004561 secs 2024-08-31T04:33:44.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:33:44 smithi133 ceph-mon[22177]: 4 slow requests, 0 included below; oldest blocked for > 237.351406 secs 2024-08-31T04:33:45.592 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:33:45 smithi050 ceph-mon[17259]: pgmap v694: 97 pgs: 97 active+clean; 1.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 8.1 KiB/s wr, 8 op/s 2024-08-31T04:33:45.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:33:45 smithi177 ceph-mon[22025]: pgmap v694: 97 pgs: 97 active+clean; 1.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 8.1 KiB/s wr, 8 op/s 2024-08-31T04:33:45.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:33:45 smithi133 ceph-mon[22177]: pgmap v694: 97 pgs: 97 active+clean; 1.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 8.1 KiB/s wr, 8 op/s 2024-08-31T04:33:46.477 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:33:46 smithi050 ceph-mon[17259]: Health check update: 4 MDSs report slow requests (MDS_SLOW_REQUEST) 2024-08-31T04:33:46.477 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:33:46 smithi050 ceph-mon[17259]: mds.? [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] up:active 2024-08-31T04:33:46.478 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:33:46 smithi050 ceph-mon[17259]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-31T04:33:46.478 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:33:46 smithi050 ceph-mon[17259]: 1 slow requests, 0 included below; oldest blocked for > 239.060280 secs 2024-08-31T04:33:46.478 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:33:46 smithi050 ceph-mon[17259]: 2 slow requests, 0 included below; oldest blocked for > 189.998968 secs 2024-08-31T04:33:46.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:33:46 smithi177 ceph-mon[22025]: Health check update: 4 MDSs report slow requests (MDS_SLOW_REQUEST) 2024-08-31T04:33:46.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:33:46 smithi177 ceph-mon[22025]: mds.? [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] up:active 2024-08-31T04:33:46.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:33:46 smithi177 ceph-mon[22025]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-31T04:33:46.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:33:46 smithi177 ceph-mon[22025]: 1 slow requests, 0 included below; oldest blocked for > 239.060280 secs 2024-08-31T04:33:46.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:33:46 smithi177 ceph-mon[22025]: 2 slow requests, 0 included below; oldest blocked for > 189.998968 secs 2024-08-31T04:33:46.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:33:46 smithi133 ceph-mon[22177]: Health check update: 4 MDSs report slow requests (MDS_SLOW_REQUEST) 2024-08-31T04:33:46.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:33:46 smithi133 ceph-mon[22177]: mds.? [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] up:active 2024-08-31T04:33:46.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:33:46 smithi133 ceph-mon[22177]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-31T04:33:46.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:33:46 smithi133 ceph-mon[22177]: 1 slow requests, 0 included below; oldest blocked for > 239.060280 secs 2024-08-31T04:33:46.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:33:46 smithi133 ceph-mon[22177]: 2 slow requests, 0 included below; oldest blocked for > 189.998968 secs 2024-08-31T04:33:47.645 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:33:47 smithi050 ceph-mon[17259]: pgmap v695: 97 pgs: 97 active+clean; 1.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 225 KiB/s rd, 221 KiB/s wr, 11 op/s 2024-08-31T04:33:47.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:33:47 smithi177 ceph-mon[22025]: pgmap v695: 97 pgs: 97 active+clean; 1.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 225 KiB/s rd, 221 KiB/s wr, 11 op/s 2024-08-31T04:33:47.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:33:47 smithi133 ceph-mon[22177]: pgmap v695: 97 pgs: 97 active+clean; 1.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 225 KiB/s rd, 221 KiB/s wr, 11 op/s 2024-08-31T04:33:48.991 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:48.986+0000 7f8ff1000640 1 -- 172.21.15.50:0/1370374234 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8fec075a90 msgr2=0x7f8fec075ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:33:48.991 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:48.986+0000 7f8ff1000640 1 --2- 172.21.15.50:0/1370374234 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8fec075a90 0x7f8fec075ea0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f8fd8009900 tx=0x7f8fd802a3f0 comp rx=0 tx=0).stop 2024-08-31T04:33:48.991 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:48.986+0000 7f8ff1000640 1 -- 172.21.15.50:0/1370374234 shutdown_connections 2024-08-31T04:33:48.991 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:48.986+0000 7f8ff1000640 1 --2- 172.21.15.50:0/1370374234 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8fec075a90 0x7f8fec075ea0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:48.991 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:48.986+0000 7f8ff1000640 1 --2- 172.21.15.50:0/1370374234 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8fec10b210 0x7f8fec10d6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:48.991 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:48.986+0000 7f8ff1000640 1 --2- 172.21.15.50:0/1370374234 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8fec076e90 0x7f8fec075550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:48.991 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:48.986+0000 7f8ff1000640 1 -- 172.21.15.50:0/1370374234 >> 172.21.15.50:0/1370374234 conn(0x7f8fec0febc0 msgr2=0x7f8fec101070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:33:48.992 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:48.986+0000 7f8ff1000640 1 -- 172.21.15.50:0/1370374234 shutdown_connections 2024-08-31T04:33:48.992 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:48.986+0000 7f8ff1000640 1 -- 172.21.15.50:0/1370374234 wait complete. 2024-08-31T04:33:48.994 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:48.986+0000 7f8ff1000640 1 Processor -- start 2024-08-31T04:33:48.994 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:48.991+0000 7f8ff1000640 1 -- start start 2024-08-31T04:33:48.994 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:48.991+0000 7f8ff1000640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8fec075a90 0x7f8fec19bd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:33:48.994 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:48.991+0000 7f8ff1000640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8fec076e90 0x7f8fec19c3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:33:48.994 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:48.991+0000 7f8ff1000640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8fec10b210 0x7f8fec19cfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:33:48.994 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:48.991+0000 7f8ff1000640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f8fec1110d0 con 0x7f8fec076e90 2024-08-31T04:33:48.994 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:48.991+0000 7f8ff1000640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f8fec110f50 con 0x7f8fec10b210 2024-08-31T04:33:48.995 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:48.991+0000 7f8ff1000640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f8fec111250 con 0x7f8fec075a90 2024-08-31T04:33:48.995 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:48.991+0000 7f8feaa00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8fec076e90 0x7f8fec19c3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:33:48.995 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:48.991+0000 7f8feaa00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8fec076e90 0x7f8fec19c3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35246/0 (socket says 172.21.15.50:35246) 2024-08-31T04:33:48.995 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:48.991+0000 7f8feb400640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8fec075a90 0x7f8fec19bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:33:48.995 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:48.991+0000 7f8feaa00640 1 -- 172.21.15.50:0/2261920131 learned_addr learned my addr 172.21.15.50:0/2261920131 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:33:48.995 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:48.991+0000 7f8febe00640 1 --2- 172.21.15.50:0/2261920131 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8fec10b210 0x7f8fec19cfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:33:48.995 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:48.991+0000 7f8feb400640 1 -- 172.21.15.50:0/2261920131 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8fec10b210 msgr2=0x7f8fec19cfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:33:48.995 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:48.991+0000 7f8feb400640 1 --2- 172.21.15.50:0/2261920131 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8fec10b210 0x7f8fec19cfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:48.995 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:48.991+0000 7f8feb400640 1 -- 172.21.15.50:0/2261920131 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8fec076e90 msgr2=0x7f8fec19c3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:33:48.995 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:48.991+0000 7f8feb400640 1 --2- 172.21.15.50:0/2261920131 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8fec076e90 0x7f8fec19c3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:48.996 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:48.991+0000 7f8feb400640 1 -- 172.21.15.50:0/2261920131 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8fec19d7c0 con 0x7f8fec075a90 2024-08-31T04:33:48.996 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:48.991+0000 7f8feaa00640 1 --2- 172.21.15.50:0/2261920131 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8fec076e90 0x7f8fec19c3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:33:48.996 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:48.991+0000 7f8feb400640 1 --2- 172.21.15.50:0/2261920131 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8fec075a90 0x7f8fec19bd80 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f8fdc00e9f0 tx=0x7f8fdc00edf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:33:48.996 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:48.991+0000 7f8fe3e00640 1 -- 172.21.15.50:0/2261920131 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fdc00ccc0 con 0x7f8fec075a90 2024-08-31T04:33:48.996 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:48.991+0000 7f8fe3e00640 1 -- 172.21.15.50:0/2261920131 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8fdc005020 con 0x7f8fec075a90 2024-08-31T04:33:48.996 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:48.991+0000 7f8ff1000640 1 -- 172.21.15.50:0/2261920131 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8fec19dab0 con 0x7f8fec075a90 2024-08-31T04:33:48.996 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:48.991+0000 7f8fe3e00640 1 -- 172.21.15.50:0/2261920131 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fdc00ce60 con 0x7f8fec075a90 2024-08-31T04:33:48.996 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:48.991+0000 7f8ff1000640 1 -- 172.21.15.50:0/2261920131 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8fec1a41a0 con 0x7f8fec075a90 2024-08-31T04:33:48.998 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:48.996+0000 7f8ff9663740 1 Processor -- start 2024-08-31T04:33:48.998 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:48.997+0000 7f8fe3e00640 1 -- 172.21.15.50:0/2261920131 <== mon.1 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 18) ==== 152577+0+0 (secure 0 0 0) 0x7f8fdc0051d0 con 0x7f8fec075a90 2024-08-31T04:33:48.998 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:48.997+0000 7f8ff9663740 1 -- start start 2024-08-31T04:33:48.998 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:48.997+0000 7f8ff9663740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5582d77981b0 0x5582d7b3dfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:33:48.999 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:48.997+0000 7f8ff9663740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5582d776f2f0 0x5582d7b3e610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:33:48.999 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:48.997+0000 7f8ff9663740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5582d77774d0 0x5582d7b3f160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:33:48.999 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:48.997+0000 7f8ff9663740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x5582d7ab0f70 con 0x5582d77774d0 2024-08-31T04:33:49.000 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:48.997+0000 7f8ff9663740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x5582d7aa0500 con 0x5582d77981b0 2024-08-31T04:33:49.000 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:48.997+0000 7f8ff9663740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x5582d7aa44b0 con 0x5582d776f2f0 2024-08-31T04:33:49.000 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:48.997+0000 7f8feb400640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5582d776f2f0 0x5582d7b3e610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:33:49.000 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:48.997+0000 7f8febe00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5582d77981b0 0x5582d7b3dfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:33:49.000 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:48.997+0000 7f8feaa00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5582d77774d0 0x5582d7b3f160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:33:49.000 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:48.997+0000 7f8feb400640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5582d776f2f0 0x5582d7b3e610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.50:58138/0 (socket says 172.21.15.50:58138) 2024-08-31T04:33:49.000 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:48.997+0000 7f8febe00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5582d77981b0 0x5582d7b3dfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.50:36466/0 (socket says 172.21.15.50:36466) 2024-08-31T04:33:49.000 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:48.997+0000 7f8feaa00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5582d77774d0 0x5582d7b3f160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35248/0 (socket says 172.21.15.50:35248) 2024-08-31T04:33:49.000 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:48.997+0000 7f8feb400640 1 -- 172.21.15.50:0/841946529 learned_addr learned my addr 172.21.15.50:0/841946529 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:33:49.001 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:48.997+0000 7f8feb400640 1 -- 172.21.15.50:0/841946529 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5582d77981b0 msgr2=0x5582d7b3dfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:33:49.002 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:48.997+0000 7f8feb400640 1 --2- 172.21.15.50:0/841946529 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5582d77981b0 0x5582d7b3dfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:49.002 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:48.997+0000 7f8feb400640 1 -- 172.21.15.50:0/841946529 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5582d77774d0 msgr2=0x5582d7b3f160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:33:49.002 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:48.997+0000 7f8feb400640 1 --2- 172.21.15.50:0/841946529 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5582d77774d0 0x5582d7b3f160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:49.002 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:48.997+0000 7f8feb400640 1 -- 172.21.15.50:0/841946529 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5582d7a5ac10 con 0x5582d776f2f0 2024-08-31T04:33:49.002 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:48.997+0000 7f8feb400640 1 --2- 172.21.15.50:0/841946529 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5582d776f2f0 0x5582d7b3e610 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f8fdc0ed2f0 tx=0x7f8fdc0ed3e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=922c706efe63ae91 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:33:49.002 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:48.997+0000 7f8fe0c00640 1 -- 172.21.15.50:0/841946529 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fdc0f8070 con 0x5582d776f2f0 2024-08-31T04:33:49.002 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:48.997+0000 7f8fe0c00640 1 -- 172.21.15.50:0/841946529 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8fdc0e70d0 con 0x5582d776f2f0 2024-08-31T04:33:49.002 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:48.997+0000 7f8fe0c00640 1 -- 172.21.15.50:0/841946529 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fdc0f3660 con 0x5582d776f2f0 2024-08-31T04:33:49.002 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:48.997+0000 7f8fe3e00640 1 --2- 172.21.15.50:0/2261920131 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f8fd00b4b30 0x7f8fd00b7040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:33:49.002 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:48.997+0000 7f8fe3e00640 1 -- 172.21.15.50:0/2261920131 <== mon.1 v2:172.21.15.177:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8219+0+0 (secure 0 0 0) 0x7f8fdc0e50b0 con 0x7f8fec075a90 2024-08-31T04:33:49.002 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:48.997+0000 7f8febe00640 1 --2- 172.21.15.50:0/2261920131 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f8fd00b4b30 0x7f8fd00b7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:33:49.004 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:48.997+0000 7f8ff9663740 1 -- 172.21.15.50:0/841946529 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5582d776f2f0 msgr2=0x5582d7b3e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:33:49.005 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:48.997+0000 7f8ff9663740 1 --2- 172.21.15.50:0/841946529 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5582d776f2f0 0x5582d7b3e610 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f8fdc0ed2f0 tx=0x7f8fdc0ed3e0 comp rx=0 tx=0).stop 2024-08-31T04:33:49.005 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:48.997+0000 7f8ff9663740 1 -- 172.21.15.50:0/841946529 shutdown_connections 2024-08-31T04:33:49.005 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:48.997+0000 7f8ff9663740 1 --2- 172.21.15.50:0/841946529 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5582d776f2f0 0x5582d7b3e610 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:49.005 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:48.997+0000 7f8ff9663740 1 --2- 172.21.15.50:0/841946529 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5582d77774d0 0x5582d7b3f160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:49.005 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:48.997+0000 7f8ff9663740 1 --2- 172.21.15.50:0/841946529 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5582d77981b0 0x5582d7b3dfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:49.005 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:48.997+0000 7f8febe00640 1 --2- 172.21.15.50:0/2261920131 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f8fd00b4b30 0x7f8fd00b7040 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f8fe4005fd0 tx=0x7f8fe4009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:33:49.005 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:48.997+0000 7f8ff9663740 1 -- 172.21.15.50:0/841946529 >> 172.21.15.50:0/841946529 conn(0x5582d778c300 msgr2=0x5582d7b39a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:33:49.005 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:48.997+0000 7f8ff9663740 1 -- 172.21.15.50:0/841946529 shutdown_connections 2024-08-31T04:33:49.005 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:48.997+0000 7f8ff9663740 1 -- 172.21.15.50:0/841946529 wait complete. 2024-08-31T04:33:49.005 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:48.997+0000 7f8ff9663740 1 -- start start 2024-08-31T04:33:49.005 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:48.997+0000 7f8ff9663740 1 Processor -- start 2024-08-31T04:33:49.006 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:49.002+0000 7f8ff9663740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5582d776f2f0 0x5582d7b47720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:33:49.006 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:49.002+0000 7f8ff9663740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5582d77774d0 0x5582d7b47de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:33:49.006 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:49.002+0000 7f8ff9663740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5582d77981b0 0x5582d7b488e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:33:49.006 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:49.002+0000 7f8ff9663740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x5582d79d9ab0 con 0x5582d77981b0 2024-08-31T04:33:49.006 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:49.002+0000 7f8ff9663740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x5582d7a47320 con 0x5582d77774d0 2024-08-31T04:33:49.006 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:49.002+0000 7f8ff9663740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x5582d7b3fc80 con 0x5582d776f2f0 2024-08-31T04:33:49.006 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:49.002+0000 7f8ff9663740 10 client.0 _ll_register_callbacks cb 0x5582d7a4d6a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:33:49.006 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:49.002+0000 7f8febe00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5582d77981b0 0x5582d7b488e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:33:49.006 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:49.002+0000 7f8febe00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5582d77981b0 0x5582d7b488e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35254/0 (socket says 172.21.15.50:35254) 2024-08-31T04:33:49.006 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:49.002+0000 7f8febe00640 1 -- 172.21.15.50:0/1728346910 learned_addr learned my addr 172.21.15.50:0/1728346910 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:33:49.006 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:49.002+0000 7f8feb400640 1 --2- 172.21.15.50:0/1728346910 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5582d776f2f0 0x5582d7b47720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:33:49.006 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:49.002+0000 7f8feaa00640 1 --2- 172.21.15.50:0/1728346910 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5582d77774d0 0x5582d7b47de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:33:49.006 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:49.002+0000 7f8febe00640 1 -- 172.21.15.50:0/1728346910 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5582d776f2f0 msgr2=0x5582d7b47720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:33:49.007 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:49.002+0000 7f8febe00640 1 --2- 172.21.15.50:0/1728346910 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5582d776f2f0 0x5582d7b47720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:49.007 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:49.002+0000 7f8febe00640 1 -- 172.21.15.50:0/1728346910 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5582d77774d0 msgr2=0x5582d7b47de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:33:49.007 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:49.002+0000 7f8febe00640 1 --2- 172.21.15.50:0/1728346910 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5582d77774d0 0x5582d7b47de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:49.007 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:49.002+0000 7f8febe00640 1 -- 172.21.15.50:0/1728346910 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5582d7803790 con 0x5582d77981b0 2024-08-31T04:33:49.007 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:49.002+0000 7f8feaa00640 1 --2- 172.21.15.50:0/1728346910 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5582d77774d0 0x5582d7b47de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:33:49.007 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:49.002+0000 7f8febe00640 1 --2- 172.21.15.50:0/1728346910 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5582d77981b0 0x5582d7b488e0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f8fe40040b0 tx=0x7f8fe4004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a7107bcfba25068 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:33:49.007 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:49.002+0000 7f8fd5600640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-08-31T04:33:49.008 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:49.002+0000 7f8fd5600640 1 -- 172.21.15.50:0/1728346910 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fe400f910 con 0x5582d77981b0 2024-08-31T04:33:49.010 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:49.002+0000 7f8fd5600640 1 -- 172.21.15.50:0/1728346910 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8219+0+0 (secure 0 0 0) 0x7f8fe400fab0 con 0x5582d77981b0 2024-08-31T04:33:49.010 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:49.002+0000 7f8ff9663740 1 -- 172.21.15.50:0/1728346910 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8fdc0e70d0 con 0x5582d77981b0 2024-08-31T04:33:49.010 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:49.002+0000 7f8fd5600640 1 -- 172.21.15.50:0/1728346910 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=55) ==== 24+0+0 (secure 0 0 0) 0x7f8fe400fcb0 con 0x5582d77981b0 2024-08-31T04:33:49.010 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:49.002+0000 7f8ff9663740 10 client.16425 fetch_fsmap learned FSMap version 55 2024-08-31T04:33:49.010 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:49.002+0000 7f8ff9663740 1 -- 172.21.15.50:0/1728346910 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=55,monmap=4+}) -- 0x5582d787c620 con 0x5582d77981b0 2024-08-31T04:33:49.010 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:49.002+0000 7f8fd5600640 1 -- 172.21.15.50:0/1728346910 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8fdc0e70d0 con 0x5582d77981b0 2024-08-31T04:33:49.010 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:49.002+0000 7f8fd5600640 1 -- 172.21.15.50:0/1728346910 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 55) ==== 8362+0+0 (secure 0 0 0) 0x7f8fe4027070 con 0x5582d77981b0 2024-08-31T04:33:49.010 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:49.002+0000 7f8ff9663740 10 client.16425 fetch_fsmap finished waiting for FSMap version 55 2024-08-31T04:33:49.011 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:49.002+0000 7f8ff9663740 10 client.16425 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T04:33:49.011 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:49.002+0000 7f8ff9663740 20 client.16425 populate_metadata read hostname 'smithi050' 2024-08-31T04:33:49.011 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:49.002+0000 7f8ff9663740 1 --2- 172.21.15.50:0/1728346910 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x5582d7756d80 0x5582d7b54f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:33:49.011 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:49.002+0000 7f8ff9663740 4 client.16425 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T04:33:49.011 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:49.002+0000 7f8ff9663740 1 -- 172.21.15.50:0/1728346910 --> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5582d7ab2ec0 con 0x5582d7756d80 2024-08-31T04:33:49.011 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:49.002+0000 7f8feb400640 1 --2- 172.21.15.50:0/1728346910 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x5582d7756d80 0x5582d7b54f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:33:49.011 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:49.002+0000 7f8feb400640 1 --2- 172.21.15.50:0/1728346910 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x5582d7756d80 0x5582d7b54f00 crc :-1 s=READY pgs=142 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=88b3828e5fb50075 server_cookie=950748344e102116 in_seq=0 out_seq=0 2024-08-31T04:33:49.011 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:49.002+0000 7f8fd5600640 10 client.16425 ms_handle_connect on v2:172.21.15.133:6838/2526402262 2024-08-31T04:33:49.011 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:49.002+0000 7f8fd5600640 1 -- 172.21.15.50:0/1728346910 <== mds.0 v2:172.21.15.133:6838/2526402262 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5582d7ab2ec0 con 0x5582d7756d80 2024-08-31T04:33:49.011 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:49.002+0000 7f8fd5600640 10 client.16425 handle_command_reply: tid=0 2024-08-31T04:33:49.011 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:49.002+0000 7f8ff9663740 1 client.16425 shutdown 2024-08-31T04:33:49.011 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:49.002+0000 7f8ff9663740 1 -- 172.21.15.50:0/1728346910 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5582d77981b0 msgr2=0x5582d7b488e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:33:49.012 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:49.002+0000 7f8ff9663740 1 --2- 172.21.15.50:0/1728346910 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5582d77981b0 0x5582d7b488e0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f8fe40040b0 tx=0x7f8fe4004ab0 comp rx=0 tx=0).stop 2024-08-31T04:33:49.012 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:49.002+0000 7f8ff9663740 1 -- 172.21.15.50:0/1728346910 shutdown_connections 2024-08-31T04:33:49.012 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:49.002+0000 7f8ff9663740 1 --2- 172.21.15.50:0/1728346910 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x5582d7756d80 0x5582d7b54f00 crc :-1 s=READY pgs=142 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:49.012 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:49.002+0000 7f8ff9663740 1 --2- 172.21.15.50:0/1728346910 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5582d77981b0 0x5582d7b488e0 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:49.012 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:49.002+0000 7f8ff9663740 1 --2- 172.21.15.50:0/1728346910 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5582d77774d0 0x5582d7b47de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:49.012 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:49.002+0000 7f8fd5600640 0 client.16425 ms_handle_reset on v2:172.21.15.133:6838/2526402262 2024-08-31T04:33:49.012 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:49.002+0000 7f8ff9663740 1 --2- 172.21.15.50:0/1728346910 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5582d776f2f0 0x5582d7b47720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:49.012 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:49.002+0000 7f8ff9663740 1 -- 172.21.15.50:0/1728346910 >> 172.21.15.50:0/1728346910 conn(0x5582d778c300 msgr2=0x5582d7b37f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:33:49.012 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:49.002+0000 7f8ff9663740 1 -- 172.21.15.50:0/1728346910 shutdown_connections 2024-08-31T04:33:49.012 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:49.002+0000 7f8ff9663740 1 -- 172.21.15.50:0/1728346910 wait complete. 2024-08-31T04:33:49.012 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:49.002+0000 7f8ff9663740 20 client.16425 trim_cache size 0 max 16384 2024-08-31T04:33:49.024 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:49.021+0000 7f8ff9663740 1 Processor -- start 2024-08-31T04:33:49.024 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:49.023+0000 7f8ff9663740 1 -- start start 2024-08-31T04:33:49.024 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:49.023+0000 7f8ff9663740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5582d776f2f0 0x5582d7b48e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:33:49.024 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:49.023+0000 7f8ff9663740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5582d77774d0 0x5582d7b39370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:33:49.024 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:49.023+0000 7f8ff9663740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5582d77981b0 0x5582d7b46920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:33:49.024 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:49.023+0000 7f8ff9663740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f8fec1acd70 con 0x5582d77981b0 2024-08-31T04:33:49.024 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:49.023+0000 7f8ff9663740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f8fec1ae8b0 con 0x5582d776f2f0 2024-08-31T04:33:49.024 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:49.023+0000 7f8ff9663740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f8fec1ad440 con 0x5582d77774d0 2024-08-31T04:33:49.026 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:49.023+0000 7f8febe00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5582d77981b0 0x5582d7b46920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:33:49.026 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:49.023+0000 7f8febe00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5582d77981b0 0x5582d7b46920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35264/0 (socket says 172.21.15.50:35264) 2024-08-31T04:33:49.026 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:49.023+0000 7f8febe00640 1 -- 172.21.15.50:0/3186181879 learned_addr learned my addr 172.21.15.50:0/3186181879 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:33:49.026 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:49.023+0000 7f8feaa00640 1 --2- 172.21.15.50:0/3186181879 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5582d77774d0 0x5582d7b39370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:33:49.027 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:49.023+0000 7f8feb400640 1 --2- 172.21.15.50:0/3186181879 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5582d776f2f0 0x5582d7b48e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:33:49.027 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:49.023+0000 7f8febe00640 1 -- 172.21.15.50:0/3186181879 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5582d77774d0 msgr2=0x5582d7b39370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:33:49.027 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:49.023+0000 7f8febe00640 1 --2- 172.21.15.50:0/3186181879 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5582d77774d0 0x5582d7b39370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:49.027 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:49.023+0000 7f8febe00640 1 -- 172.21.15.50:0/3186181879 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5582d776f2f0 msgr2=0x5582d7b48e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:33:49.027 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:49.023+0000 7f8febe00640 1 --2- 172.21.15.50:0/3186181879 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5582d776f2f0 0x5582d7b48e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:49.027 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:49.023+0000 7f8febe00640 1 -- 172.21.15.50:0/3186181879 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5582d7b3ea10 con 0x5582d77981b0 2024-08-31T04:33:49.027 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:49.023+0000 7f8feb400640 1 --2- 172.21.15.50:0/3186181879 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5582d776f2f0 0x5582d7b48e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:33:49.027 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:49.023+0000 7f8febe00640 1 --2- 172.21.15.50:0/3186181879 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5582d77981b0 0x5582d7b46920 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f8fe4012f40 tx=0x7f8fe4009570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57208f38d8b4f172 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:33:49.027 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:49.023+0000 7f8fd7e00640 1 -- 172.21.15.50:0/3186181879 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fe400f910 con 0x5582d77981b0 2024-08-31T04:33:49.027 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:49.023+0000 7f8fd7e00640 1 -- 172.21.15.50:0/3186181879 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8fe4038020 con 0x5582d77981b0 2024-08-31T04:33:49.027 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:49.023+0000 7f8fd7e00640 1 -- 172.21.15.50:0/3186181879 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fe401e670 con 0x5582d77981b0 2024-08-31T04:33:49.027 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:49.023+0000 7f8ff9663740 1 -- 172.21.15.50:0/3186181879 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5582d77981b0 msgr2=0x5582d7b46920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:33:49.027 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:49.023+0000 7f8ff9663740 1 --2- 172.21.15.50:0/3186181879 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5582d77981b0 0x5582d7b46920 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f8fe4012f40 tx=0x7f8fe4009570 comp rx=0 tx=0).stop 2024-08-31T04:33:49.028 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:49.023+0000 7f8ff9663740 1 -- 172.21.15.50:0/3186181879 shutdown_connections 2024-08-31T04:33:49.028 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:49.023+0000 7f8ff9663740 1 --2- 172.21.15.50:0/3186181879 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5582d77774d0 0x5582d7b39370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:49.028 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:49.023+0000 7f8ff9663740 1 --2- 172.21.15.50:0/3186181879 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5582d77981b0 0x5582d7b46920 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:49.028 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:49.023+0000 7f8ff9663740 1 --2- 172.21.15.50:0/3186181879 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5582d776f2f0 0x5582d7b48e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:49.028 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:49.023+0000 7f8ff9663740 1 -- 172.21.15.50:0/3186181879 >> 172.21.15.50:0/3186181879 conn(0x5582d778c300 msgr2=0x5582d7b46110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:33:49.028 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:49.023+0000 7f8ff9663740 1 -- 172.21.15.50:0/3186181879 shutdown_connections 2024-08-31T04:33:49.028 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:49.023+0000 7f8ff9663740 1 -- 172.21.15.50:0/3186181879 wait complete. 2024-08-31T04:33:49.028 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:49.023+0000 7f8ff9663740 1 -- start start 2024-08-31T04:33:49.030 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:49.023+0000 7f8ff9663740 1 Processor -- start 2024-08-31T04:33:49.030 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:49.023+0000 7f8ff9663740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5582d776f2f0 0x5582d7b4cae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:33:49.030 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:49.023+0000 7f8ff9663740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5582d77774d0 0x5582d7b4d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:33:49.030 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:49.023+0000 7f8ff9663740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5582d77981b0 0x5582d7b4dd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:33:49.030 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:49.023+0000 7f8ff9663740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f8fec1ae1e0 con 0x5582d77981b0 2024-08-31T04:33:49.031 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:49.023+0000 7f8ff9663740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f8fec1adb10 con 0x5582d77774d0 2024-08-31T04:33:49.031 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:49.023+0000 7f8ff9663740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f8fec1aad50 con 0x5582d776f2f0 2024-08-31T04:33:49.031 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:49.023+0000 7f8ff9663740 10 client.0 _ll_register_callbacks cb 0x7f8fe4003e50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:33:49.031 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:49.023+0000 7f8febe00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5582d77981b0 0x5582d7b4dd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:33:49.031 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:49.023+0000 7f8febe00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5582d77981b0 0x5582d7b4dd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35266/0 (socket says 172.21.15.50:35266) 2024-08-31T04:33:49.031 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:49.023+0000 7f8febe00640 1 -- 172.21.15.50:0/2662604964 learned_addr learned my addr 172.21.15.50:0/2662604964 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:33:49.031 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:49.023+0000 7f8feaa00640 1 --2- 172.21.15.50:0/2662604964 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5582d77774d0 0x5582d7b4d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:33:49.031 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:49.023+0000 7f8febe00640 1 -- 172.21.15.50:0/2662604964 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5582d776f2f0 msgr2=0x5582d7b4cae0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-08-31T04:33:49.031 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:49.023+0000 7f8febe00640 1 --2- 172.21.15.50:0/2662604964 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5582d776f2f0 0x5582d7b4cae0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:49.031 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:49.023+0000 7f8febe00640 1 -- 172.21.15.50:0/2662604964 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5582d77774d0 msgr2=0x5582d7b4d1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:33:49.031 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:49.023+0000 7f8febe00640 1 --2- 172.21.15.50:0/2662604964 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5582d77774d0 0x5582d7b4d1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:49.031 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:49.023+0000 7f8febe00640 1 -- 172.21.15.50:0/2662604964 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5582d7b4e470 con 0x5582d77981b0 2024-08-31T04:33:49.032 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:49.023+0000 7f8febe00640 1 --2- 172.21.15.50:0/2662604964 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5582d77981b0 0x5582d7b4dd10 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f8fe4029540 tx=0x7f8fe4005bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2dddedddd2e00e85 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:33:49.032 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:49.023+0000 7f8fd5600640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-08-31T04:33:49.032 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:49.023+0000 7f8fd5600640 1 -- 172.21.15.50:0/2662604964 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fe4004c50 con 0x5582d77981b0 2024-08-31T04:33:49.032 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:49.023+0000 7f8fd5600640 1 -- 172.21.15.50:0/2662604964 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8219+0+0 (secure 0 0 0) 0x7f8fe4039040 con 0x5582d77981b0 2024-08-31T04:33:49.032 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:49.023+0000 7f8ff9663740 1 -- 172.21.15.50:0/2662604964 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8fe4038020 con 0x5582d77981b0 2024-08-31T04:33:49.032 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:49.023+0000 7f8fd5600640 1 -- 172.21.15.50:0/2662604964 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=55) ==== 24+0+0 (secure 0 0 0) 0x7f8fe4004df0 con 0x5582d77981b0 2024-08-31T04:33:49.032 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:49.023+0000 7f8ff9663740 10 client.16431 fetch_fsmap learned FSMap version 55 2024-08-31T04:33:49.032 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:49.023+0000 7f8ff9663740 1 -- 172.21.15.50:0/2662604964 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=55,monmap=4+}) -- 0x5582d7b4f800 con 0x5582d77981b0 2024-08-31T04:33:49.032 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:49.023+0000 7f8fd5600640 1 -- 172.21.15.50:0/2662604964 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8fe4038020 con 0x5582d77981b0 2024-08-31T04:33:49.032 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:49.023+0000 7f8fd5600640 1 -- 172.21.15.50:0/2662604964 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 55) ==== 8362+0+0 (secure 0 0 0) 0x7f8fe4027030 con 0x5582d77981b0 2024-08-31T04:33:49.032 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:49.023+0000 7f8ff9663740 10 client.16431 fetch_fsmap finished waiting for FSMap version 55 2024-08-31T04:33:49.032 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:49.023+0000 7f8ff9663740 10 client.16431 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T04:33:49.033 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:49.023+0000 7f8ff9663740 20 client.16431 populate_metadata read hostname 'smithi050' 2024-08-31T04:33:49.033 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:49.023+0000 7f8ff9663740 1 --2- 172.21.15.50:0/2662604964 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x5582d772c1c0 0x5582d7bc1d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:33:49.033 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:49.023+0000 7f8ff9663740 4 client.16431 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-31T04:33:49.033 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:49.023+0000 7f8ff9663740 1 -- 172.21.15.50:0/2662604964 --> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5582d7aae960 con 0x5582d772c1c0 2024-08-31T04:33:49.045 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:49.045+0000 7f8feb400640 1 --2- 172.21.15.50:0/2662604964 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x5582d772c1c0 0x5582d7bc1d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:33:49.104 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:49.104+0000 7f8fd5600640 10 client.16431 ms_handle_connect on v2:172.21.15.133:6838/2526402262 2024-08-31T04:33:49.105 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:49.104+0000 7f8feb400640 1 --2- 172.21.15.50:0/2662604964 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x5582d772c1c0 0x5582d7bc1d00 crc :-1 s=READY pgs=143 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=692b80dca985c95c server_cookie=88552745fbb8839f in_seq=0 out_seq=0 2024-08-31T04:33:49.165 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:49.163+0000 7f8fd5600640 1 -- 172.21.15.50:0/2662604964 <== mds.0 v2:172.21.15.133:6838/2526402262 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5582d7aae960 con 0x5582d772c1c0 2024-08-31T04:33:49.165 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:49.163+0000 7f8fd5600640 10 client.16431 handle_command_reply: tid=0 2024-08-31T04:33:49.165 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:49.163+0000 7f8ff9663740 1 client.16431 shutdown 2024-08-31T04:33:49.166 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:49.163+0000 7f8ff9663740 1 -- 172.21.15.50:0/2662604964 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5582d77981b0 msgr2=0x5582d7b4dd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:33:49.166 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:49.163+0000 7f8ff9663740 1 --2- 172.21.15.50:0/2662604964 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5582d77981b0 0x5582d7b4dd10 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f8fe4029540 tx=0x7f8fe4005bd0 comp rx=0 tx=0).stop 2024-08-31T04:33:49.166 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:49.163+0000 7f8ff9663740 1 -- 172.21.15.50:0/2662604964 shutdown_connections 2024-08-31T04:33:49.166 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:49.163+0000 7f8ff9663740 1 --2- 172.21.15.50:0/2662604964 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x5582d772c1c0 0x5582d7bc1d00 crc :-1 s=READY pgs=143 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:49.166 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:49.163+0000 7f8ff9663740 1 --2- 172.21.15.50:0/2662604964 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5582d77981b0 0x5582d7b4dd10 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:49.166 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:49.163+0000 7f8fd5600640 0 client.16431 ms_handle_reset on v2:172.21.15.133:6838/2526402262 2024-08-31T04:33:49.167 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:49.163+0000 7f8ff9663740 1 --2- 172.21.15.50:0/2662604964 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5582d77774d0 0x5582d7b4d1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:49.167 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:49.163+0000 7f8ff9663740 1 --2- 172.21.15.50:0/2662604964 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5582d776f2f0 0x5582d7b4cae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:49.167 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:49.163+0000 7f8ff9663740 1 -- 172.21.15.50:0/2662604964 >> 172.21.15.50:0/2662604964 conn(0x5582d778c300 msgr2=0x5582d7b46920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:33:49.167 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:49.163+0000 7f8ff9663740 1 -- 172.21.15.50:0/2662604964 shutdown_connections 2024-08-31T04:33:49.167 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:49.163+0000 7f8ff9663740 1 -- 172.21.15.50:0/2662604964 wait complete. 2024-08-31T04:33:49.167 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:49.163+0000 7f8ff9663740 20 client.16431 trim_cache size 0 max 16384 2024-08-31T04:33:49.168 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout:{ 2024-08-31T04:33:49.168 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout: "message": "", 2024-08-31T04:33:49.168 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout: "return_code": 0 2024-08-31T04:33:49.168 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout:} 2024-08-31T04:33:49.169 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:49.163+0000 7f8ff1000640 1 -- 172.21.15.50:0/2261920131 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f8fd00b4b30 msgr2=0x7f8fd00b7040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:33:49.169 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:49.163+0000 7f8ff1000640 1 --2- 172.21.15.50:0/2261920131 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f8fd00b4b30 0x7f8fd00b7040 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f8fe4005fd0 tx=0x7f8fe4009500 comp rx=0 tx=0).stop 2024-08-31T04:33:49.170 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:49.163+0000 7f8ff1000640 1 -- 172.21.15.50:0/2261920131 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8fec075a90 msgr2=0x7f8fec19bd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:33:49.170 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:49.163+0000 7f8ff1000640 1 --2- 172.21.15.50:0/2261920131 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8fec075a90 0x7f8fec19bd80 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f8fdc00e9f0 tx=0x7f8fdc00edf0 comp rx=0 tx=0).stop 2024-08-31T04:33:49.170 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:49.163+0000 7f8ff1000640 1 -- 172.21.15.50:0/2261920131 shutdown_connections 2024-08-31T04:33:49.170 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:49.163+0000 7f8ff1000640 1 --2- 172.21.15.50:0/2261920131 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f8fd00b4b30 0x7f8fd00b7040 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:49.170 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:49.163+0000 7f8ff1000640 1 --2- 172.21.15.50:0/2261920131 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8fec10b210 0x7f8fec19cfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:49.171 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:49.163+0000 7f8ff1000640 1 --2- 172.21.15.50:0/2261920131 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8fec076e90 0x7f8fec19c3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:49.171 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:49.163+0000 7f8ff1000640 1 --2- 172.21.15.50:0/2261920131 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8fec075a90 0x7f8fec19bd80 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:33:49.171 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:49.163+0000 7f8ff1000640 1 -- 172.21.15.50:0/2261920131 >> 172.21.15.50:0/2261920131 conn(0x7f8fec0febc0 msgr2=0x7f8fec0ff0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:33:49.171 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:49.163+0000 7f8ff1000640 1 -- 172.21.15.50:0/2261920131 shutdown_connections 2024-08-31T04:33:49.171 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:33:49.163+0000 7f8ff1000640 1 -- 172.21.15.50:0/2261920131 wait complete. 2024-08-31T04:33:49.610 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:33:49 smithi050 ceph-mon[17259]: pgmap v696: 97 pgs: 97 active+clean; 1.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 568 KiB/s rd, 564 KiB/s wr, 14 op/s 2024-08-31T04:33:49.611 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:33:49 smithi050 ceph-mon[17259]: 1 slow requests, 0 included below; oldest blocked for > 240.004687 secs 2024-08-31T04:33:49.611 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:33:49 smithi050 ceph-mon[17259]: 4 slow requests, 0 included below; oldest blocked for > 242.351497 secs 2024-08-31T04:33:49.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:33:49 smithi177 ceph-mon[22025]: pgmap v696: 97 pgs: 97 active+clean; 1.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 568 KiB/s rd, 564 KiB/s wr, 14 op/s 2024-08-31T04:33:49.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:33:49 smithi177 ceph-mon[22025]: 1 slow requests, 0 included below; oldest blocked for > 240.004687 secs 2024-08-31T04:33:49.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:33:49 smithi177 ceph-mon[22025]: 4 slow requests, 0 included below; oldest blocked for > 242.351497 secs 2024-08-31T04:33:49.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:33:49 smithi133 ceph-mon[22177]: pgmap v696: 97 pgs: 97 active+clean; 1.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 568 KiB/s rd, 564 KiB/s wr, 14 op/s 2024-08-31T04:33:49.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:33:49 smithi133 ceph-mon[22177]: 1 slow requests, 0 included below; oldest blocked for > 240.004687 secs 2024-08-31T04:33:49.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:33:49 smithi133 ceph-mon[22177]: 4 slow requests, 0 included below; oldest blocked for > 242.351497 secs 2024-08-31T04:33:51.598 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:33:51 smithi050 ceph-mon[17259]: pgmap v697: 97 pgs: 97 active+clean; 1.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 908 KiB/s rd, 937 KiB/s wr, 38 op/s 2024-08-31T04:33:51.598 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:33:51 smithi050 ceph-mon[17259]: 1 slow requests, 0 included below; oldest blocked for > 244.060399 secs 2024-08-31T04:33:51.598 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:33:51 smithi050 ceph-mon[17259]: 2 slow requests, 0 included below; oldest blocked for > 194.999092 secs 2024-08-31T04:33:51.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:33:51 smithi177 ceph-mon[22025]: pgmap v697: 97 pgs: 97 active+clean; 1.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 908 KiB/s rd, 937 KiB/s wr, 38 op/s 2024-08-31T04:33:51.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:33:51 smithi177 ceph-mon[22025]: 1 slow requests, 0 included below; oldest blocked for > 244.060399 secs 2024-08-31T04:33:51.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:33:51 smithi177 ceph-mon[22025]: 2 slow requests, 0 included below; oldest blocked for > 194.999092 secs 2024-08-31T04:33:51.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:33:51 smithi133 ceph-mon[22177]: pgmap v697: 97 pgs: 97 active+clean; 1.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 908 KiB/s rd, 937 KiB/s wr, 38 op/s 2024-08-31T04:33:51.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:33:51 smithi133 ceph-mon[22177]: 1 slow requests, 0 included below; oldest blocked for > 244.060399 secs 2024-08-31T04:33:51.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:33:51 smithi133 ceph-mon[22177]: 2 slow requests, 0 included below; oldest blocked for > 194.999092 secs 2024-08-31T04:33:52.470 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:33:52 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T04:33:52.470 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:33:52 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:33:52.470 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:33:52 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:33:52.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:33:52 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T04:33:52.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:33:52 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:33:52.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:33:52 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:33:52.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:33:52 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T04:33:52.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:33:52 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:33:52.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:33:52 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:33:53.603 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:33:53 smithi050 ceph-mon[17259]: pgmap v698: 97 pgs: 97 active+clean; 1.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 44 op/s 2024-08-31T04:33:53.603 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:33:53 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:33:53.603 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:33:53 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:33:53.603 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:33:53 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:33:53.603 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:33:53 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:33:53.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:33:53 smithi177 ceph-mon[22025]: pgmap v698: 97 pgs: 97 active+clean; 1.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 44 op/s 2024-08-31T04:33:53.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:33:53 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:33:53.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:33:53 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:33:53.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:33:53 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:33:53.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:33:53 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:33:53.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:33:53 smithi133 ceph-mon[22177]: pgmap v698: 97 pgs: 97 active+clean; 1.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 44 op/s 2024-08-31T04:33:53.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:33:53 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:33:53.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:33:53 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:33:53.794 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:33:53 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:33:53.794 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:33:53 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:33:54.464 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:33:54 smithi050 ceph-mon[17259]: 1 slow requests, 0 included below; oldest blocked for > 245.004753 secs 2024-08-31T04:33:54.464 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:33:54 smithi050 ceph-mon[17259]: 3 slow requests, 0 included below; oldest blocked for > 247.233962 secs 2024-08-31T04:33:54.464 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:33:54 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:33:54.464 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:33:54 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:33:54.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:33:54 smithi177 ceph-mon[22025]: 1 slow requests, 0 included below; oldest blocked for > 245.004753 secs 2024-08-31T04:33:54.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:33:54 smithi177 ceph-mon[22025]: 3 slow requests, 0 included below; oldest blocked for > 247.233962 secs 2024-08-31T04:33:54.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:33:54 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:33:54.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:33:54 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:33:54.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:33:54 smithi133 ceph-mon[22177]: 1 slow requests, 0 included below; oldest blocked for > 245.004753 secs 2024-08-31T04:33:54.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:33:54 smithi133 ceph-mon[22177]: 3 slow requests, 0 included below; oldest blocked for > 247.233962 secs 2024-08-31T04:33:54.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:33:54 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:33:54.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:33:54 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:33:55.618 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:33:55 smithi050 ceph-mon[17259]: pgmap v699: 97 pgs: 97 active+clean; 1.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 41 op/s 2024-08-31T04:33:55.618 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:33:55 smithi050 ceph-mon[17259]: mds.? [v2:172.21.15.50:6840/575209862,v1:172.21.15.50:6841/575209862] up:active 2024-08-31T04:33:55.618 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:33:55 smithi050 ceph-mon[17259]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-31T04:33:55.618 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:33:55 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:33:55.618 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:33:55 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T04:33:55.618 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:33:55 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:33:55.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:33:55 smithi177 ceph-mon[22025]: pgmap v699: 97 pgs: 97 active+clean; 1.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 41 op/s 2024-08-31T04:33:55.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:33:55 smithi177 ceph-mon[22025]: mds.? [v2:172.21.15.50:6840/575209862,v1:172.21.15.50:6841/575209862] up:active 2024-08-31T04:33:55.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:33:55 smithi177 ceph-mon[22025]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-31T04:33:55.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:33:55 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:33:55.747 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:33:55 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T04:33:55.747 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:33:55 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:33:55.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:33:55 smithi133 ceph-mon[22177]: pgmap v699: 97 pgs: 97 active+clean; 1.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 41 op/s 2024-08-31T04:33:55.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:33:55 smithi133 ceph-mon[22177]: mds.? [v2:172.21.15.50:6840/575209862,v1:172.21.15.50:6841/575209862] up:active 2024-08-31T04:33:55.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:33:55 smithi133 ceph-mon[22177]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-31T04:33:55.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:33:55 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:33:55.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:33:55 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T04:33:55.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:33:55 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:33:56.712 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:33:56 smithi050 ceph-mon[17259]: 1 slow requests, 0 included below; oldest blocked for > 249.060527 secs 2024-08-31T04:33:56.712 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:33:56 smithi050 ceph-mon[17259]: 2 slow requests, 0 included below; oldest blocked for > 199.999168 secs 2024-08-31T04:33:56.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:33:56 smithi177 ceph-mon[22025]: 1 slow requests, 0 included below; oldest blocked for > 249.060527 secs 2024-08-31T04:33:56.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:33:56 smithi177 ceph-mon[22025]: 2 slow requests, 0 included below; oldest blocked for > 199.999168 secs 2024-08-31T04:33:56.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:33:56 smithi133 ceph-mon[22177]: 1 slow requests, 0 included below; oldest blocked for > 249.060527 secs 2024-08-31T04:33:56.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:33:56 smithi133 ceph-mon[22177]: 2 slow requests, 0 included below; oldest blocked for > 199.999168 secs 2024-08-31T04:33:57.534 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:33:57 smithi050 ceph-mon[17259]: pgmap v700: 97 pgs: 97 active+clean; 1.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.2 MiB/s wr, 47 op/s 2024-08-31T04:33:57.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:33:57 smithi177 ceph-mon[22025]: pgmap v700: 97 pgs: 97 active+clean; 1.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.2 MiB/s wr, 47 op/s 2024-08-31T04:33:57.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:33:57 smithi133 ceph-mon[22177]: pgmap v700: 97 pgs: 97 active+clean; 1.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.2 MiB/s wr, 47 op/s 2024-08-31T04:33:59.496 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:33:59 smithi050 ceph-mon[17259]: pgmap v701: 97 pgs: 97 active+clean; 1.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 945 KiB/s rd, 966 KiB/s wr, 45 op/s 2024-08-31T04:33:59.496 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:33:59 smithi050 ceph-mon[17259]: 1 slow requests, 0 included below; oldest blocked for > 250.004877 secs 2024-08-31T04:33:59.496 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:33:59 smithi050 ceph-mon[17259]: 3 slow requests, 0 included below; oldest blocked for > 252.234049 secs 2024-08-31T04:33:59.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:33:59 smithi177 ceph-mon[22025]: pgmap v701: 97 pgs: 97 active+clean; 1.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 945 KiB/s rd, 966 KiB/s wr, 45 op/s 2024-08-31T04:33:59.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:33:59 smithi177 ceph-mon[22025]: 1 slow requests, 0 included below; oldest blocked for > 250.004877 secs 2024-08-31T04:33:59.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:33:59 smithi177 ceph-mon[22025]: 3 slow requests, 0 included below; oldest blocked for > 252.234049 secs 2024-08-31T04:33:59.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:33:59 smithi133 ceph-mon[22177]: pgmap v701: 97 pgs: 97 active+clean; 1.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 945 KiB/s rd, 966 KiB/s wr, 45 op/s 2024-08-31T04:33:59.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:33:59 smithi133 ceph-mon[22177]: 1 slow requests, 0 included below; oldest blocked for > 250.004877 secs 2024-08-31T04:33:59.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:33:59 smithi133 ceph-mon[22177]: 3 slow requests, 0 included below; oldest blocked for > 252.234049 secs 2024-08-31T04:34:01.728 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:34:01 smithi050 ceph-mon[17259]: pgmap v702: 97 pgs: 97 active+clean; 1.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 602 KiB/s rd, 623 KiB/s wr, 42 op/s 2024-08-31T04:34:01.729 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:34:01 smithi050 ceph-mon[17259]: 1 slow requests, 0 included below; oldest blocked for > 254.060656 secs 2024-08-31T04:34:01.729 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:34:01 smithi050 ceph-mon[17259]: 2 slow requests, 0 included below; oldest blocked for > 204.999261 secs 2024-08-31T04:34:01.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:34:01 smithi177 ceph-mon[22025]: pgmap v702: 97 pgs: 97 active+clean; 1.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 602 KiB/s rd, 623 KiB/s wr, 42 op/s 2024-08-31T04:34:01.747 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:34:01 smithi177 ceph-mon[22025]: 1 slow requests, 0 included below; oldest blocked for > 254.060656 secs 2024-08-31T04:34:01.747 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:34:01 smithi177 ceph-mon[22025]: 2 slow requests, 0 included below; oldest blocked for > 204.999261 secs 2024-08-31T04:34:01.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:34:01 smithi133 ceph-mon[22177]: pgmap v702: 97 pgs: 97 active+clean; 1.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 602 KiB/s rd, 623 KiB/s wr, 42 op/s 2024-08-31T04:34:01.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:34:01 smithi133 ceph-mon[22177]: 1 slow requests, 0 included below; oldest blocked for > 254.060656 secs 2024-08-31T04:34:01.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:34:01 smithi133 ceph-mon[22177]: 2 slow requests, 0 included below; oldest blocked for > 204.999261 secs 2024-08-31T04:34:02.352 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:02.349+0000 7fbc62e00640 1 -- 172.21.15.50:0/3655548983 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbc5c104ca0 msgr2=0x7fbc5c10b640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:34:02.352 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:02.349+0000 7fbc62e00640 1 --2- 172.21.15.50:0/3655548983 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbc5c104ca0 0x7fbc5c10b640 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fbc54009ca0 tx=0x7fbc5402a8b0 comp rx=0 tx=0).stop 2024-08-31T04:34:02.352 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:02.349+0000 7fbc62e00640 1 -- 172.21.15.50:0/3655548983 shutdown_connections 2024-08-31T04:34:02.353 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:02.349+0000 7fbc62e00640 1 --2- 172.21.15.50:0/3655548983 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbc5c104ca0 0x7fbc5c10b640 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:02.353 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:02.349+0000 7fbc62e00640 1 --2- 172.21.15.50:0/3655548983 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbc5c104300 0x7fbc5c104710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:02.353 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:02.349+0000 7fbc62e00640 1 --2- 172.21.15.50:0/3655548983 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbc5c103280 0x7fbc5c1036f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:02.353 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:02.349+0000 7fbc62e00640 1 -- 172.21.15.50:0/3655548983 >> 172.21.15.50:0/3655548983 conn(0x7fbc5c0febc0 msgr2=0x7fbc5c101070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:34:02.353 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:02.349+0000 7fbc62e00640 1 -- 172.21.15.50:0/3655548983 shutdown_connections 2024-08-31T04:34:02.353 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:02.349+0000 7fbc62e00640 1 -- 172.21.15.50:0/3655548983 wait complete. 2024-08-31T04:34:02.355 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:02.349+0000 7fbc62e00640 1 Processor -- start 2024-08-31T04:34:02.355 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:02.349+0000 7fbc62e00640 1 -- start start 2024-08-31T04:34:02.355 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:02.349+0000 7fbc62e00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbc5c103280 0x7fbc5c19bcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:34:02.355 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:02.349+0000 7fbc62e00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbc5c104300 0x7fbc5c19c330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:34:02.355 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:02.349+0000 7fbc62e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbc5c104ca0 0x7fbc5c19cee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:34:02.355 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:02.349+0000 7fbc62e00640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fbc5c10ef50 con 0x7fbc5c104ca0 2024-08-31T04:34:02.355 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:02.349+0000 7fbc62e00640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7fbc5c10edd0 con 0x7fbc5c104300 2024-08-31T04:34:02.355 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:02.349+0000 7fbc62e00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fbc5c10f0d0 con 0x7fbc5c103280 2024-08-31T04:34:02.355 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:02.349+0000 7fbc62400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbc5c104ca0 0x7fbc5c19cee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:34:02.356 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:02.349+0000 7fbc62400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbc5c104ca0 0x7fbc5c19cee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:59316/0 (socket says 172.21.15.50:59316) 2024-08-31T04:34:02.356 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:02.349+0000 7fbc61a00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbc5c103280 0x7fbc5c19bcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:34:02.356 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:02.349+0000 7fbc62400640 1 -- 172.21.15.50:0/117249318 learned_addr learned my addr 172.21.15.50:0/117249318 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:34:02.356 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:02.349+0000 7fbc61000640 1 --2- 172.21.15.50:0/117249318 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbc5c104300 0x7fbc5c19c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:34:02.356 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:02.353+0000 7fbc62400640 1 -- 172.21.15.50:0/117249318 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbc5c103280 msgr2=0x7fbc5c19bcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:34:02.356 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:02.353+0000 7fbc62400640 1 --2- 172.21.15.50:0/117249318 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbc5c103280 0x7fbc5c19bcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:02.356 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:02.353+0000 7fbc62400640 1 -- 172.21.15.50:0/117249318 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbc5c104300 msgr2=0x7fbc5c19c330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:34:02.356 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:02.353+0000 7fbc62400640 1 --2- 172.21.15.50:0/117249318 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbc5c104300 0x7fbc5c19c330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:02.356 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:02.353+0000 7fbc62400640 1 -- 172.21.15.50:0/117249318 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc5c19d700 con 0x7fbc5c104ca0 2024-08-31T04:34:02.356 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:02.353+0000 7fbc62400640 1 --2- 172.21.15.50:0/117249318 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbc5c104ca0 0x7fbc5c19cee0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7fbc540307a0 tx=0x7fbc54003ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:34:02.356 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:02.353+0000 7fbc5a000640 1 -- 172.21.15.50:0/117249318 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc54004240 con 0x7fbc5c104ca0 2024-08-31T04:34:02.356 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:02.353+0000 7fbc5a000640 1 -- 172.21.15.50:0/117249318 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbc54040070 con 0x7fbc5c104ca0 2024-08-31T04:34:02.357 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:02.353+0000 7fbc62e00640 1 -- 172.21.15.50:0/117249318 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbc5c19d990 con 0x7fbc5c104ca0 2024-08-31T04:34:02.357 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:02.353+0000 7fbc5a000640 1 -- 172.21.15.50:0/117249318 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc54045cb0 con 0x7fbc5c104ca0 2024-08-31T04:34:02.357 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:02.353+0000 7fbc62e00640 1 -- 172.21.15.50:0/117249318 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbc5c1a40e0 con 0x7fbc5c104ca0 2024-08-31T04:34:02.358 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:02.353+0000 7fbc6b42a740 1 Processor -- start 2024-08-31T04:34:02.359 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:02.353+0000 7fbc5a000640 1 -- 172.21.15.50:0/117249318 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 18) ==== 152577+0+0 (secure 0 0 0) 0x7fbc54045470 con 0x7fbc5c104ca0 2024-08-31T04:34:02.359 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:02.353+0000 7fbc6b42a740 1 -- start start 2024-08-31T04:34:02.361 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:02.353+0000 7fbc6b42a740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x558112a521b0 0x558112df7d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:34:02.361 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:02.353+0000 7fbc6b42a740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558112a292f0 0x558112df83b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:34:02.361 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:02.353+0000 7fbc6b42a740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x558112a314d0 0x558112df8f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:34:02.361 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:02.353+0000 7fbc6b42a740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x558112d6af70 con 0x558112a292f0 2024-08-31T04:34:02.361 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:02.353+0000 7fbc6b42a740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x558112d5a500 con 0x558112a314d0 2024-08-31T04:34:02.361 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:02.353+0000 7fbc6b42a740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x558112d5e4b0 con 0x558112a521b0 2024-08-31T04:34:02.361 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:02.353+0000 7fbc61a00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558112a292f0 0x558112df83b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:34:02.361 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:02.353+0000 7fbc61a00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558112a292f0 0x558112df83b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:59324/0 (socket says 172.21.15.50:59324) 2024-08-31T04:34:02.361 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:02.353+0000 7fbc61a00640 1 -- 172.21.15.50:0/2892206371 learned_addr learned my addr 172.21.15.50:0/2892206371 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:34:02.361 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:02.353+0000 7fbc61000640 1 --2- 172.21.15.50:0/2892206371 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x558112a521b0 0x558112df7d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:34:02.361 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:02.353+0000 7fbc61000640 1 --2- 172.21.15.50:0/2892206371 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x558112a314d0 0x558112df8f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:34:02.362 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:02.359+0000 7fbc61a00640 1 -- 172.21.15.50:0/2892206371 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x558112a521b0 msgr2=0x558112df7d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:34:02.362 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:02.359+0000 7fbc61a00640 1 --2- 172.21.15.50:0/2892206371 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x558112a521b0 0x558112df7d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:02.362 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:02.359+0000 7fbc61a00640 1 -- 172.21.15.50:0/2892206371 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x558112a314d0 msgr2=0x558112df8f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:34:02.362 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:02.359+0000 7fbc61a00640 1 --2- 172.21.15.50:0/2892206371 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x558112a314d0 0x558112df8f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:02.362 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:02.359+0000 7fbc61a00640 1 -- 172.21.15.50:0/2892206371 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558112d14c10 con 0x558112a292f0 2024-08-31T04:34:02.362 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:02.359+0000 7fbc61a00640 1 --2- 172.21.15.50:0/2892206371 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558112a292f0 0x558112df83b0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7fbc5000bd10 tx=0x7fbc500107a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8a3e72fbeb12e76 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:34:02.362 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:02.359+0000 7fbc5a000640 1 --2- 172.21.15.50:0/117249318 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fbc440b4b30 0x7fbc440b7040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:34:02.362 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:02.359+0000 7fbc4ea00640 1 -- 172.21.15.50:0/2892206371 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc50004030 con 0x558112a292f0 2024-08-31T04:34:02.362 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:02.359+0000 7fbc4ea00640 1 -- 172.21.15.50:0/2892206371 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbc500035f0 con 0x558112a292f0 2024-08-31T04:34:02.362 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:02.359+0000 7fbc4ea00640 1 -- 172.21.15.50:0/2892206371 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc50011770 con 0x558112a292f0 2024-08-31T04:34:02.362 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:02.359+0000 7fbc5a000640 1 -- 172.21.15.50:0/117249318 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8219+0+0 (secure 0 0 0) 0x7fbc54106460 con 0x7fbc5c104ca0 2024-08-31T04:34:02.362 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:02.359+0000 7fbc61000640 1 --2- 172.21.15.50:0/117249318 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fbc440b4b30 0x7fbc440b7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:34:02.366 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:02.359+0000 7fbc6b42a740 1 -- 172.21.15.50:0/2892206371 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558112a292f0 msgr2=0x558112df83b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:34:02.366 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:02.359+0000 7fbc61000640 1 --2- 172.21.15.50:0/117249318 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fbc440b4b30 0x7fbc440b7040 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fbc48005d00 tx=0x7fbc4800b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:34:02.366 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:02.359+0000 7fbc6b42a740 1 --2- 172.21.15.50:0/2892206371 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558112a292f0 0x558112df83b0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7fbc5000bd10 tx=0x7fbc500107a0 comp rx=0 tx=0).stop 2024-08-31T04:34:02.366 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:02.359+0000 7fbc6b42a740 1 -- 172.21.15.50:0/2892206371 shutdown_connections 2024-08-31T04:34:02.366 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:02.359+0000 7fbc6b42a740 1 --2- 172.21.15.50:0/2892206371 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x558112a314d0 0x558112df8f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:02.366 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:02.359+0000 7fbc6b42a740 1 --2- 172.21.15.50:0/2892206371 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558112a292f0 0x558112df83b0 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:02.367 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:02.359+0000 7fbc6b42a740 1 --2- 172.21.15.50:0/2892206371 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x558112a521b0 0x558112df7d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:02.367 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:02.359+0000 7fbc6b42a740 1 -- 172.21.15.50:0/2892206371 >> 172.21.15.50:0/2892206371 conn(0x558112a46300 msgr2=0x558112df37d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:34:02.367 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:02.359+0000 7fbc6b42a740 1 -- 172.21.15.50:0/2892206371 shutdown_connections 2024-08-31T04:34:02.367 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:02.359+0000 7fbc6b42a740 1 -- 172.21.15.50:0/2892206371 wait complete. 2024-08-31T04:34:02.367 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:02.359+0000 7fbc6b42a740 1 -- start start 2024-08-31T04:34:02.367 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:02.359+0000 7fbc6b42a740 1 Processor -- start 2024-08-31T04:34:02.367 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:02.359+0000 7fbc6b42a740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x558112a292f0 0x558112e01400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:34:02.367 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:02.359+0000 7fbc6b42a740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x558112a314d0 0x558112e01ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:34:02.367 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:02.359+0000 7fbc6b42a740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558112a521b0 0x558112e025c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:34:02.367 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:02.359+0000 7fbc6b42a740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x558112c93ab0 con 0x558112a521b0 2024-08-31T04:34:02.368 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:02.359+0000 7fbc6b42a740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x558112d01320 con 0x558112a314d0 2024-08-31T04:34:02.368 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:02.359+0000 7fbc6b42a740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x558112df9a20 con 0x558112a292f0 2024-08-31T04:34:02.368 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:02.359+0000 7fbc6b42a740 10 client.0 _ll_register_callbacks cb 0x558112d3ae80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:34:02.368 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:02.359+0000 7fbc62400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558112a521b0 0x558112e025c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:34:02.368 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:02.359+0000 7fbc62400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558112a521b0 0x558112e025c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:59326/0 (socket says 172.21.15.50:59326) 2024-08-31T04:34:02.368 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:02.359+0000 7fbc62400640 1 -- 172.21.15.50:0/3322515494 learned_addr learned my addr 172.21.15.50:0/3322515494 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:34:02.368 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:02.359+0000 7fbc61000640 1 --2- 172.21.15.50:0/3322515494 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x558112a314d0 0x558112e01ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:34:02.368 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:02.359+0000 7fbc62400640 1 -- 172.21.15.50:0/3322515494 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x558112a292f0 msgr2=0x558112e01400 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-08-31T04:34:02.368 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:02.359+0000 7fbc62400640 1 --2- 172.21.15.50:0/3322515494 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x558112a292f0 0x558112e01400 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:02.368 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:02.359+0000 7fbc62400640 1 -- 172.21.15.50:0/3322515494 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x558112a314d0 msgr2=0x558112e01ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:34:02.369 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:02.359+0000 7fbc62400640 1 --2- 172.21.15.50:0/3322515494 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x558112a314d0 0x558112e01ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:02.369 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:02.359+0000 7fbc62400640 1 -- 172.21.15.50:0/3322515494 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558112abd790 con 0x558112a521b0 2024-08-31T04:34:02.369 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:02.359+0000 7fbc61000640 1 --2- 172.21.15.50:0/3322515494 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x558112a314d0 0x558112e01ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:34:02.369 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:02.359+0000 7fbc62400640 1 --2- 172.21.15.50:0/3322515494 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558112a521b0 0x558112e025c0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fbc5402ae70 tx=0x7fbc540cc850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68cf05e53bdd96f2 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:34:02.369 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:02.359+0000 7fbc43400640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-08-31T04:34:02.369 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:02.359+0000 7fbc43400640 1 -- 172.21.15.50:0/3322515494 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc540cf070 con 0x558112a521b0 2024-08-31T04:34:02.369 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:02.359+0000 7fbc43400640 1 -- 172.21.15.50:0/3322515494 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8219+0+0 (secure 0 0 0) 0x7fbc540cd0a0 con 0x558112a521b0 2024-08-31T04:34:02.369 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:02.359+0000 7fbc6b42a740 1 -- 172.21.15.50:0/3322515494 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbc500035f0 con 0x558112a521b0 2024-08-31T04:34:02.369 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:02.364+0000 7fbc43400640 1 -- 172.21.15.50:0/3322515494 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=56) ==== 24+0+0 (secure 0 0 0) 0x7fbc540cce40 con 0x558112a521b0 2024-08-31T04:34:02.369 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:02.364+0000 7fbc6b42a740 10 client.16443 fetch_fsmap learned FSMap version 56 2024-08-31T04:34:02.370 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:02.364+0000 7fbc6b42a740 1 -- 172.21.15.50:0/3322515494 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=56,monmap=4+}) -- 0x558112b36620 con 0x558112a521b0 2024-08-31T04:34:02.370 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:02.364+0000 7fbc43400640 1 -- 172.21.15.50:0/3322515494 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbc500035f0 con 0x558112a521b0 2024-08-31T04:34:02.370 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:02.364+0000 7fbc43400640 1 -- 172.21.15.50:0/3322515494 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 56) ==== 8362+0+0 (secure 0 0 0) 0x7fbc540d1220 con 0x558112a521b0 2024-08-31T04:34:02.370 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:02.364+0000 7fbc6b42a740 10 client.16443 fetch_fsmap finished waiting for FSMap version 56 2024-08-31T04:34:02.370 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:02.364+0000 7fbc6b42a740 10 client.16443 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T04:34:02.370 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:02.364+0000 7fbc6b42a740 20 client.16443 populate_metadata read hostname 'smithi050' 2024-08-31T04:34:02.370 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:02.364+0000 7fbc6b42a740 1 --2- 172.21.15.50:0/3322515494 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x558112a10d80 0x558112e0eb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:34:02.370 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:02.364+0000 7fbc6b42a740 4 client.16443 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T04:34:02.370 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:02.364+0000 7fbc6b42a740 1 -- 172.21.15.50:0/3322515494 --> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558112d6cec0 con 0x558112a10d80 2024-08-31T04:34:02.370 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:02.365+0000 7fbc61a00640 1 --2- 172.21.15.50:0/3322515494 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x558112a10d80 0x558112e0eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:34:02.371 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:02.365+0000 7fbc61a00640 1 --2- 172.21.15.50:0/3322515494 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x558112a10d80 0x558112e0eb80 crc :-1 s=READY pgs=144 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=73f5cc224c8468aa server_cookie=9321ae984416e40c in_seq=0 out_seq=0 2024-08-31T04:34:02.372 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:02.365+0000 7fbc43400640 10 client.16443 ms_handle_connect on v2:172.21.15.133:6838/2526402262 2024-08-31T04:34:02.372 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:02.365+0000 7fbc43400640 1 -- 172.21.15.50:0/3322515494 <== mds.0 v2:172.21.15.133:6838/2526402262 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x558112d6cec0 con 0x558112a10d80 2024-08-31T04:34:02.372 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:02.365+0000 7fbc43400640 10 client.16443 handle_command_reply: tid=0 2024-08-31T04:34:02.372 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:02.365+0000 7fbc6b42a740 1 client.16443 shutdown 2024-08-31T04:34:02.372 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:02.365+0000 7fbc6b42a740 1 -- 172.21.15.50:0/3322515494 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558112a521b0 msgr2=0x558112e025c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:34:02.372 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:02.365+0000 7fbc6b42a740 1 --2- 172.21.15.50:0/3322515494 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558112a521b0 0x558112e025c0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fbc5402ae70 tx=0x7fbc540cc850 comp rx=0 tx=0).stop 2024-08-31T04:34:02.372 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:02.365+0000 7fbc6b42a740 1 -- 172.21.15.50:0/3322515494 shutdown_connections 2024-08-31T04:34:02.372 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:02.365+0000 7fbc6b42a740 1 --2- 172.21.15.50:0/3322515494 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x558112a10d80 0x558112e0eb80 crc :-1 s=READY pgs=144 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:02.372 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:02.365+0000 7fbc6b42a740 1 --2- 172.21.15.50:0/3322515494 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558112a521b0 0x558112e025c0 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:02.372 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:02.365+0000 7fbc6b42a740 1 --2- 172.21.15.50:0/3322515494 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x558112a314d0 0x558112e01ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:02.372 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:02.365+0000 7fbc6b42a740 1 --2- 172.21.15.50:0/3322515494 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x558112a292f0 0x558112e01400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:02.372 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:02.365+0000 7fbc6b42a740 1 -- 172.21.15.50:0/3322515494 >> 172.21.15.50:0/3322515494 conn(0x558112a46300 msgr2=0x558112df43d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:34:02.372 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:02.365+0000 7fbc43400640 0 client.16443 ms_handle_reset on v2:172.21.15.133:6838/2526402262 2024-08-31T04:34:02.373 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:02.365+0000 7fbc6b42a740 1 -- 172.21.15.50:0/3322515494 shutdown_connections 2024-08-31T04:34:02.373 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:02.365+0000 7fbc6b42a740 1 -- 172.21.15.50:0/3322515494 wait complete. 2024-08-31T04:34:02.373 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:02.365+0000 7fbc6b42a740 20 client.16443 trim_cache size 0 max 16384 2024-08-31T04:34:02.396 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:02.394+0000 7fbc6b42a740 1 Processor -- start 2024-08-31T04:34:02.397 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:02.394+0000 7fbc6b42a740 1 -- start start 2024-08-31T04:34:02.398 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:02.394+0000 7fbc6b42a740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558112a292f0 0x558112dfc7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:34:02.399 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:02.394+0000 7fbc6b42a740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x558112a314d0 0x558112e094a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:34:02.399 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:02.394+0000 7fbc6b42a740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x558112a521b0 0x558112df3ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:34:02.399 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:02.394+0000 7fbc6b42a740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fbc5c1acba0 con 0x558112a292f0 2024-08-31T04:34:02.399 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:02.394+0000 7fbc6b42a740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7fbc5c1ae6e0 con 0x558112a521b0 2024-08-31T04:34:02.399 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:02.394+0000 7fbc6b42a740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fbc5c1ad270 con 0x558112a314d0 2024-08-31T04:34:02.399 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:02.394+0000 7fbc61a00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558112a292f0 0x558112dfc7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:34:02.399 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:02.394+0000 7fbc61000640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x558112a314d0 0x558112e094a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:34:02.399 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:02.394+0000 7fbc61a00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558112a292f0 0x558112dfc7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:59330/0 (socket says 172.21.15.50:59330) 2024-08-31T04:34:02.399 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:02.394+0000 7fbc61a00640 1 -- 172.21.15.50:0/64857107 learned_addr learned my addr 172.21.15.50:0/64857107 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:34:02.399 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:02.394+0000 7fbc62400640 1 --2- 172.21.15.50:0/64857107 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x558112a521b0 0x558112df3ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:34:02.399 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:02.394+0000 7fbc61000640 1 -- 172.21.15.50:0/64857107 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x558112a521b0 msgr2=0x558112df3ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:34:02.399 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:02.394+0000 7fbc61000640 1 --2- 172.21.15.50:0/64857107 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x558112a521b0 0x558112df3ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:02.400 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:02.394+0000 7fbc61000640 1 -- 172.21.15.50:0/64857107 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558112a292f0 msgr2=0x558112dfc7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:34:02.400 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:02.394+0000 7fbc61000640 1 --2- 172.21.15.50:0/64857107 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558112a292f0 0x558112dfc7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:02.400 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:02.394+0000 7fbc61000640 1 -- 172.21.15.50:0/64857107 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558112e01e30 con 0x558112a314d0 2024-08-31T04:34:02.400 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:02.394+0000 7fbc61a00640 1 --2- 172.21.15.50:0/64857107 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558112a292f0 0x558112dfc7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:34:02.400 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:02.394+0000 7fbc61000640 1 --2- 172.21.15.50:0/64857107 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x558112a314d0 0x558112e094a0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fbc4800bb90 tx=0x7fbc48014040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=efe201a27e2e68ab server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:34:02.400 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:02.394+0000 7fbc4e000640 1 -- 172.21.15.50:0/64857107 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc4802c070 con 0x558112a314d0 2024-08-31T04:34:02.400 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:02.394+0000 7fbc4e000640 1 -- 172.21.15.50:0/64857107 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbc4801c920 con 0x558112a314d0 2024-08-31T04:34:02.400 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:02.394+0000 7fbc4e000640 1 -- 172.21.15.50:0/64857107 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc48027960 con 0x558112a314d0 2024-08-31T04:34:02.404 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:02.394+0000 7fbc6b42a740 1 -- 172.21.15.50:0/64857107 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x558112a314d0 msgr2=0x558112e094a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:34:02.404 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:02.394+0000 7fbc6b42a740 1 --2- 172.21.15.50:0/64857107 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x558112a314d0 0x558112e094a0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fbc4800bb90 tx=0x7fbc48014040 comp rx=0 tx=0).stop 2024-08-31T04:34:02.404 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:02.394+0000 7fbc6b42a740 1 -- 172.21.15.50:0/64857107 shutdown_connections 2024-08-31T04:34:02.404 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:02.394+0000 7fbc6b42a740 1 --2- 172.21.15.50:0/64857107 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x558112a314d0 0x558112e094a0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:02.404 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:02.394+0000 7fbc6b42a740 1 --2- 172.21.15.50:0/64857107 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x558112a521b0 0x558112df3ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:02.405 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:02.394+0000 7fbc6b42a740 1 --2- 172.21.15.50:0/64857107 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558112a292f0 0x558112dfc7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:02.405 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:02.394+0000 7fbc6b42a740 1 -- 172.21.15.50:0/64857107 >> 172.21.15.50:0/64857107 conn(0x558112a46300 msgr2=0x558112df3780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:34:02.405 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:02.394+0000 7fbc6b42a740 1 -- 172.21.15.50:0/64857107 shutdown_connections 2024-08-31T04:34:02.405 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:02.394+0000 7fbc6b42a740 1 -- 172.21.15.50:0/64857107 wait complete. 2024-08-31T04:34:02.405 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:02.399+0000 7fbc6b42a740 1 -- start start 2024-08-31T04:34:02.405 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:02.399+0000 7fbc6b42a740 1 Processor -- start 2024-08-31T04:34:02.405 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:02.399+0000 7fbc6b42a740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x558112a292f0 0x558112e09020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:34:02.405 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:02.399+0000 7fbc6b42a740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x558112a314d0 0x558112e07ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:34:02.405 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:02.399+0000 7fbc6b42a740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558112a521b0 0x558112e08220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:34:02.405 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:02.399+0000 7fbc6b42a740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fbc5c1ae010 con 0x558112a521b0 2024-08-31T04:34:02.405 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:02.399+0000 7fbc6b42a740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7fbc5c1ad940 con 0x558112a314d0 2024-08-31T04:34:02.406 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:02.399+0000 7fbc6b42a740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fbc5c1aab80 con 0x558112a292f0 2024-08-31T04:34:02.406 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:02.399+0000 7fbc6b42a740 10 client.0 _ll_register_callbacks cb 0x7fbc54009460 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:34:02.406 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:02.399+0000 7fbc62400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558112a521b0 0x558112e08220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:34:02.406 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:02.400+0000 7fbc61a00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x558112a292f0 0x558112e09020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:34:02.406 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:02.400+0000 7fbc61000640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x558112a314d0 0x558112e07ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:34:02.406 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:02.400+0000 7fbc62400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558112a521b0 0x558112e08220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:59336/0 (socket says 172.21.15.50:59336) 2024-08-31T04:34:02.406 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:02.400+0000 7fbc61000640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x558112a314d0 0x558112e07ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.50:40562/0 (socket says 172.21.15.50:40562) 2024-08-31T04:34:02.406 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:02.400+0000 7fbc61000640 1 -- 172.21.15.50:0/1546536344 learned_addr learned my addr 172.21.15.50:0/1546536344 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:34:02.406 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:02.400+0000 7fbc61a00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x558112a292f0 0x558112e09020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.50:48678/0 (socket says 172.21.15.50:48678) 2024-08-31T04:34:02.406 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:02.400+0000 7fbc62400640 1 -- 172.21.15.50:0/1546536344 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x558112a292f0 msgr2=0x558112e09020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:34:02.406 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:02.400+0000 7fbc62400640 1 --2- 172.21.15.50:0/1546536344 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x558112a292f0 0x558112e09020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:02.406 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:02.400+0000 7fbc62400640 1 -- 172.21.15.50:0/1546536344 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x558112a314d0 msgr2=0x558112e07ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:34:02.407 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:02.400+0000 7fbc62400640 1 --2- 172.21.15.50:0/1546536344 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x558112a314d0 0x558112e07ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:02.407 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:02.400+0000 7fbc62400640 1 -- 172.21.15.50:0/1546536344 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558112e08890 con 0x558112a521b0 2024-08-31T04:34:02.407 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:02.400+0000 7fbc61a00640 1 --2- 172.21.15.50:0/1546536344 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x558112a292f0 0x558112e09020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:34:02.407 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:02.400+0000 7fbc61000640 1 --2- 172.21.15.50:0/1546536344 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x558112a314d0 0x558112e07ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:34:02.407 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:02.400+0000 7fbc62400640 1 --2- 172.21.15.50:0/1546536344 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558112a521b0 0x558112e08220 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7fbc540ccb40 tx=0x7fbc540cd350 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5734c3c3b56f42b5 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:34:02.407 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:02.400+0000 7fbc43400640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-08-31T04:34:02.407 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:02.400+0000 7fbc43400640 1 -- 172.21.15.50:0/1546536344 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc540ec060 con 0x558112a521b0 2024-08-31T04:34:02.407 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:02.400+0000 7fbc43400640 1 -- 172.21.15.50:0/1546536344 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8219+0+0 (secure 0 0 0) 0x7fbc540ee230 con 0x558112a521b0 2024-08-31T04:34:02.407 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:02.400+0000 7fbc6b42a740 1 -- 172.21.15.50:0/1546536344 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbc4801c920 con 0x558112a521b0 2024-08-31T04:34:02.407 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:02.400+0000 7fbc43400640 1 -- 172.21.15.50:0/1546536344 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=56) ==== 24+0+0 (secure 0 0 0) 0x7fbc540ab050 con 0x558112a521b0 2024-08-31T04:34:02.407 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:02.400+0000 7fbc6b42a740 10 client.16449 fetch_fsmap learned FSMap version 56 2024-08-31T04:34:02.407 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:02.400+0000 7fbc6b42a740 1 -- 172.21.15.50:0/1546536344 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=56,monmap=4+}) -- 0x558112e08890 con 0x558112a521b0 2024-08-31T04:34:02.408 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:02.400+0000 7fbc43400640 1 -- 172.21.15.50:0/1546536344 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbc4801c920 con 0x558112a521b0 2024-08-31T04:34:02.408 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:02.400+0000 7fbc43400640 1 -- 172.21.15.50:0/1546536344 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 56) ==== 8362+0+0 (secure 0 0 0) 0x7fbc540ae020 con 0x558112a521b0 2024-08-31T04:34:02.408 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:02.400+0000 7fbc6b42a740 10 client.16449 fetch_fsmap finished waiting for FSMap version 56 2024-08-31T04:34:02.408 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:02.400+0000 7fbc6b42a740 10 client.16449 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T04:34:02.408 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:02.400+0000 7fbc6b42a740 20 client.16449 populate_metadata read hostname 'smithi050' 2024-08-31T04:34:02.408 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:02.400+0000 7fbc6b42a740 1 --2- 172.21.15.50:0/1546536344 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x5581129e61c0 0x558112e7bae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:34:02.408 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:02.400+0000 7fbc6b42a740 4 client.16449 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-31T04:34:02.408 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:02.400+0000 7fbc6b42a740 1 -- 172.21.15.50:0/1546536344 --> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] -- command(tid 0: {"prefix": "flush journal"}) -- 0x558112d68960 con 0x5581129e61c0 2024-08-31T04:34:02.408 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:02.400+0000 7fbc61a00640 1 --2- 172.21.15.50:0/1546536344 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x5581129e61c0 0x558112e7bae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:34:02.408 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:02.400+0000 7fbc61a00640 1 --2- 172.21.15.50:0/1546536344 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x5581129e61c0 0x558112e7bae0 crc :-1 s=READY pgs=145 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=97cdbe962a028243 server_cookie=d98e360128c1d095 in_seq=0 out_seq=0 2024-08-31T04:34:02.409 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:02.400+0000 7fbc43400640 10 client.16449 ms_handle_connect on v2:172.21.15.133:6838/2526402262 2024-08-31T04:34:02.449 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:02.444+0000 7fbc43400640 1 -- 172.21.15.50:0/1546536344 <== mds.0 v2:172.21.15.133:6838/2526402262 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x558112d68960 con 0x5581129e61c0 2024-08-31T04:34:02.449 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:02.444+0000 7fbc43400640 10 client.16449 handle_command_reply: tid=0 2024-08-31T04:34:02.450 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:02.444+0000 7fbc6b42a740 1 client.16449 shutdown 2024-08-31T04:34:02.450 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:02.444+0000 7fbc6b42a740 1 -- 172.21.15.50:0/1546536344 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558112a521b0 msgr2=0x558112e08220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:34:02.450 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:02.444+0000 7fbc6b42a740 1 --2- 172.21.15.50:0/1546536344 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558112a521b0 0x558112e08220 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7fbc540ccb40 tx=0x7fbc540cd350 comp rx=0 tx=0).stop 2024-08-31T04:34:02.450 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:02.447+0000 7fbc6b42a740 1 -- 172.21.15.50:0/1546536344 shutdown_connections 2024-08-31T04:34:02.450 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:02.447+0000 7fbc6b42a740 1 --2- 172.21.15.50:0/1546536344 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x5581129e61c0 0x558112e7bae0 crc :-1 s=READY pgs=145 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:02.450 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:02.447+0000 7fbc6b42a740 1 --2- 172.21.15.50:0/1546536344 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558112a521b0 0x558112e08220 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:02.451 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:02.447+0000 7fbc6b42a740 1 --2- 172.21.15.50:0/1546536344 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x558112a314d0 0x558112e07ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:02.451 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:02.447+0000 7fbc6b42a740 1 --2- 172.21.15.50:0/1546536344 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x558112a292f0 0x558112e09020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:02.451 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:02.447+0000 7fbc6b42a740 1 -- 172.21.15.50:0/1546536344 >> 172.21.15.50:0/1546536344 conn(0x558112a46300 msgr2=0x558112df3780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:34:02.451 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:02.447+0000 7fbc43400640 0 client.16449 ms_handle_reset on v2:172.21.15.133:6838/2526402262 2024-08-31T04:34:02.451 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:02.447+0000 7fbc6b42a740 1 -- 172.21.15.50:0/1546536344 shutdown_connections 2024-08-31T04:34:02.451 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:02.447+0000 7fbc6b42a740 1 -- 172.21.15.50:0/1546536344 wait complete. 2024-08-31T04:34:02.451 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:02.447+0000 7fbc6b42a740 20 client.16449 trim_cache size 0 max 16384 2024-08-31T04:34:02.452 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout:{ 2024-08-31T04:34:02.452 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout: "message": "", 2024-08-31T04:34:02.452 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout: "return_code": 0 2024-08-31T04:34:02.452 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout:} 2024-08-31T04:34:02.453 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:02.447+0000 7fbc62e00640 1 -- 172.21.15.50:0/117249318 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fbc440b4b30 msgr2=0x7fbc440b7040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:34:02.453 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:02.447+0000 7fbc62e00640 1 --2- 172.21.15.50:0/117249318 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fbc440b4b30 0x7fbc440b7040 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fbc48005d00 tx=0x7fbc4800b390 comp rx=0 tx=0).stop 2024-08-31T04:34:02.453 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:02.447+0000 7fbc62e00640 1 -- 172.21.15.50:0/117249318 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbc5c104ca0 msgr2=0x7fbc5c19cee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:34:02.454 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:02.447+0000 7fbc62e00640 1 --2- 172.21.15.50:0/117249318 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbc5c104ca0 0x7fbc5c19cee0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7fbc540307a0 tx=0x7fbc54003ba0 comp rx=0 tx=0).stop 2024-08-31T04:34:02.454 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:02.447+0000 7fbc62e00640 1 -- 172.21.15.50:0/117249318 shutdown_connections 2024-08-31T04:34:02.454 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:02.447+0000 7fbc62e00640 1 --2- 172.21.15.50:0/117249318 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fbc440b4b30 0x7fbc440b7040 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:02.454 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:02.447+0000 7fbc62e00640 1 --2- 172.21.15.50:0/117249318 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbc5c104ca0 0x7fbc5c19cee0 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:02.454 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:02.447+0000 7fbc62e00640 1 --2- 172.21.15.50:0/117249318 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbc5c104300 0x7fbc5c19c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:02.454 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:02.447+0000 7fbc62e00640 1 --2- 172.21.15.50:0/117249318 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbc5c103280 0x7fbc5c19bcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:02.454 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:02.447+0000 7fbc62e00640 1 -- 172.21.15.50:0/117249318 >> 172.21.15.50:0/117249318 conn(0x7fbc5c0febc0 msgr2=0x7fbc5c075390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:34:02.454 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:02.447+0000 7fbc62e00640 1 -- 172.21.15.50:0/117249318 shutdown_connections 2024-08-31T04:34:02.455 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:02.447+0000 7fbc62e00640 1 -- 172.21.15.50:0/117249318 wait complete. 2024-08-31T04:34:03.722 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:34:03 smithi050 ceph-mon[17259]: pgmap v703: 97 pgs: 97 active+clean; 1.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 267 KiB/s rd, 252 KiB/s wr, 20 op/s 2024-08-31T04:34:03.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:34:03 smithi177 ceph-mon[22025]: pgmap v703: 97 pgs: 97 active+clean; 1.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 267 KiB/s rd, 252 KiB/s wr, 20 op/s 2024-08-31T04:34:03.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:34:03 smithi133 ceph-mon[22177]: pgmap v703: 97 pgs: 97 active+clean; 1.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 267 KiB/s rd, 252 KiB/s wr, 20 op/s 2024-08-31T04:34:04.568 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:34:04 smithi050 ceph-mon[17259]: 1 slow requests, 0 included below; oldest blocked for > 255.005016 secs 2024-08-31T04:34:04.568 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:34:04 smithi050 ceph-mon[17259]: 3 slow requests, 0 included below; oldest blocked for > 257.234141 secs 2024-08-31T04:34:04.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:34:04 smithi177 ceph-mon[22025]: 1 slow requests, 0 included below; oldest blocked for > 255.005016 secs 2024-08-31T04:34:04.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:34:04 smithi177 ceph-mon[22025]: 3 slow requests, 0 included below; oldest blocked for > 257.234141 secs 2024-08-31T04:34:04.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:34:04 smithi133 ceph-mon[22177]: 1 slow requests, 0 included below; oldest blocked for > 255.005016 secs 2024-08-31T04:34:04.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:34:04 smithi133 ceph-mon[22177]: 3 slow requests, 0 included below; oldest blocked for > 257.234141 secs 2024-08-31T04:34:05.698 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:34:05 smithi050 ceph-mon[17259]: pgmap v704: 97 pgs: 97 active+clean; 1.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 4.5 KiB/s wr, 16 op/s 2024-08-31T04:34:05.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:34:05 smithi177 ceph-mon[22025]: pgmap v704: 97 pgs: 97 active+clean; 1.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 4.5 KiB/s wr, 16 op/s 2024-08-31T04:34:05.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:34:05 smithi133 ceph-mon[22177]: pgmap v704: 97 pgs: 97 active+clean; 1.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 4.5 KiB/s wr, 16 op/s 2024-08-31T04:34:06.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:34:06 smithi177 ceph-mon[22025]: 1 slow requests, 0 included below; oldest blocked for > 259.060721 secs 2024-08-31T04:34:06.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:34:06 smithi177 ceph-mon[22025]: 2 slow requests, 0 included below; oldest blocked for > 209.999668 secs 2024-08-31T04:34:06.765 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:34:06 smithi050 ceph-mon[17259]: 1 slow requests, 0 included below; oldest blocked for > 259.060721 secs 2024-08-31T04:34:06.765 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:34:06 smithi050 ceph-mon[17259]: 2 slow requests, 0 included below; oldest blocked for > 209.999668 secs 2024-08-31T04:34:06.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:34:06 smithi133 ceph-mon[22177]: 1 slow requests, 0 included below; oldest blocked for > 259.060721 secs 2024-08-31T04:34:06.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:34:06 smithi133 ceph-mon[22177]: 2 slow requests, 0 included below; oldest blocked for > 209.999668 secs 2024-08-31T04:34:07.584 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:34:07 smithi050 ceph-mon[17259]: pgmap v705: 97 pgs: 97 active+clean; 1.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 158 KiB/s rd, 88 KiB/s wr, 26 op/s 2024-08-31T04:34:07.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:34:07 smithi177 ceph-mon[22025]: pgmap v705: 97 pgs: 97 active+clean; 1.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 158 KiB/s rd, 88 KiB/s wr, 26 op/s 2024-08-31T04:34:07.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:34:07 smithi133 ceph-mon[22177]: pgmap v705: 97 pgs: 97 active+clean; 1.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 158 KiB/s rd, 88 KiB/s wr, 26 op/s 2024-08-31T04:34:09.571 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:34:09 smithi050 ceph-mon[17259]: pgmap v706: 97 pgs: 97 active+clean; 1.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 100 KiB/s wr, 80 op/s 2024-08-31T04:34:09.571 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:34:09 smithi050 ceph-mon[17259]: 1 slow requests, 0 included below; oldest blocked for > 260.005095 secs 2024-08-31T04:34:09.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:34:09 smithi133 ceph-mon[22177]: pgmap v706: 97 pgs: 97 active+clean; 1.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 100 KiB/s wr, 80 op/s 2024-08-31T04:34:09.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:34:09 smithi133 ceph-mon[22177]: 1 slow requests, 0 included below; oldest blocked for > 260.005095 secs 2024-08-31T04:34:09.996 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:34:09 smithi177 ceph-mon[22025]: pgmap v706: 97 pgs: 97 active+clean; 1.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 100 KiB/s wr, 80 op/s 2024-08-31T04:34:09.996 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:34:09 smithi177 ceph-mon[22025]: 1 slow requests, 0 included below; oldest blocked for > 260.005095 secs 2024-08-31T04:34:10.725 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:34:10 smithi050 ceph-mon[17259]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-31T04:34:10.725 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:34:10 smithi050 ceph-mon[17259]: MDS health message cleared (mds.?): 3 slow requests are blocked > 180 secs 2024-08-31T04:34:10.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:34:10 smithi133 ceph-mon[22177]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-31T04:34:10.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:34:10 smithi133 ceph-mon[22177]: MDS health message cleared (mds.?): 3 slow requests are blocked > 180 secs 2024-08-31T04:34:10.996 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:34:10 smithi177 ceph-mon[22025]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-31T04:34:10.996 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:34:10 smithi177 ceph-mon[22025]: MDS health message cleared (mds.?): 3 slow requests are blocked > 180 secs 2024-08-31T04:34:11.595 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:34:11 smithi050 ceph-mon[17259]: pgmap v707: 97 pgs: 97 active+clean; 1.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 142 KiB/s wr, 177 op/s 2024-08-31T04:34:11.595 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:34:11 smithi050 ceph-mon[17259]: 1 slow requests, 0 included below; oldest blocked for > 264.060863 secs 2024-08-31T04:34:11.595 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:34:11 smithi050 ceph-mon[17259]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2024-08-31T04:34:11.595 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:34:11 smithi050 ceph-mon[17259]: mds.? [v2:172.21.15.50:6840/575209862,v1:172.21.15.50:6841/575209862] up:active 2024-08-31T04:34:11.595 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:34:11 smithi050 ceph-mon[17259]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-31T04:34:11.595 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:34:11 smithi050 ceph-mon[17259]: 2 slow requests, 0 included below; oldest blocked for > 214.999742 secs 2024-08-31T04:34:11.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:34:11 smithi133 ceph-mon[22177]: pgmap v707: 97 pgs: 97 active+clean; 1.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 142 KiB/s wr, 177 op/s 2024-08-31T04:34:11.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:34:11 smithi133 ceph-mon[22177]: 1 slow requests, 0 included below; oldest blocked for > 264.060863 secs 2024-08-31T04:34:11.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:34:11 smithi133 ceph-mon[22177]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2024-08-31T04:34:11.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:34:11 smithi133 ceph-mon[22177]: mds.? [v2:172.21.15.50:6840/575209862,v1:172.21.15.50:6841/575209862] up:active 2024-08-31T04:34:11.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:34:11 smithi133 ceph-mon[22177]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-31T04:34:11.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:34:11 smithi133 ceph-mon[22177]: 2 slow requests, 0 included below; oldest blocked for > 214.999742 secs 2024-08-31T04:34:11.996 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:34:11 smithi177 ceph-mon[22025]: pgmap v707: 97 pgs: 97 active+clean; 1.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 142 KiB/s wr, 177 op/s 2024-08-31T04:34:11.996 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:34:11 smithi177 ceph-mon[22025]: 1 slow requests, 0 included below; oldest blocked for > 264.060863 secs 2024-08-31T04:34:11.996 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:34:11 smithi177 ceph-mon[22025]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2024-08-31T04:34:11.996 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:34:11 smithi177 ceph-mon[22025]: mds.? [v2:172.21.15.50:6840/575209862,v1:172.21.15.50:6841/575209862] up:active 2024-08-31T04:34:11.996 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:34:11 smithi177 ceph-mon[22025]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-31T04:34:11.996 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:34:11 smithi177 ceph-mon[22025]: 2 slow requests, 0 included below; oldest blocked for > 214.999742 secs 2024-08-31T04:34:13.593 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:34:13 smithi050 ceph-mon[17259]: pgmap v708: 97 pgs: 97 active+clean; 1.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 MiB/s rd, 544 KiB/s wr, 298 op/s 2024-08-31T04:34:13.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:34:13 smithi133 ceph-mon[22177]: pgmap v708: 97 pgs: 97 active+clean; 1.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 MiB/s rd, 544 KiB/s wr, 298 op/s 2024-08-31T04:34:13.996 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:34:13 smithi177 ceph-mon[22025]: pgmap v708: 97 pgs: 97 active+clean; 1.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 MiB/s rd, 544 KiB/s wr, 298 op/s 2024-08-31T04:34:14.759 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:34:14 smithi050 ceph-mon[17259]: 1 slow requests, 0 included below; oldest blocked for > 265.005235 secs 2024-08-31T04:34:14.760 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:34:14 smithi050 ceph-mon[17259]: 1 slow requests, 0 included below; oldest blocked for > 265.095306 secs 2024-08-31T04:34:14.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:34:14 smithi133 ceph-mon[22177]: 1 slow requests, 0 included below; oldest blocked for > 265.005235 secs 2024-08-31T04:34:14.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:34:14 smithi133 ceph-mon[22177]: 1 slow requests, 0 included below; oldest blocked for > 265.095306 secs 2024-08-31T04:34:14.897 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:34:14 smithi177 ceph-mon[22025]: 1 slow requests, 0 included below; oldest blocked for > 265.005235 secs 2024-08-31T04:34:14.897 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:34:14 smithi177 ceph-mon[22025]: 1 slow requests, 0 included below; oldest blocked for > 265.095306 secs 2024-08-31T04:34:15.603 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:34:15 smithi050 ceph-mon[17259]: pgmap v709: 97 pgs: 97 active+clean; 1.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 MiB/s rd, 547 KiB/s wr, 295 op/s 2024-08-31T04:34:15.603 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:34:15 smithi050 ceph-mon[17259]: mds.? [v2:172.21.15.50:6840/575209862,v1:172.21.15.50:6841/575209862] up:active 2024-08-31T04:34:15.603 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:34:15 smithi050 ceph-mon[17259]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-31T04:34:15.651 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:15.649+0000 7fb457e00640 1 -- 172.21.15.50:0/1706136144 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb458075a90 msgr2=0x7fb458075ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:34:15.651 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:15.649+0000 7fb457e00640 1 --2- 172.21.15.50:0/1706136144 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb458075a90 0x7fb458075ea0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fb444009900 tx=0x7fb44402a3f0 comp rx=0 tx=0).stop 2024-08-31T04:34:15.651 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:15.649+0000 7fb457e00640 1 -- 172.21.15.50:0/1706136144 shutdown_connections 2024-08-31T04:34:15.651 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:15.649+0000 7fb457e00640 1 --2- 172.21.15.50:0/1706136144 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb458075a90 0x7fb458075ea0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:15.652 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:15.649+0000 7fb457e00640 1 --2- 172.21.15.50:0/1706136144 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb45810fa00 0x7fb458111e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:15.652 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:15.649+0000 7fb457e00640 1 --2- 172.21.15.50:0/1706136144 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb458076e90 0x7fb458075550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:15.652 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:15.649+0000 7fb457e00640 1 -- 172.21.15.50:0/1706136144 >> 172.21.15.50:0/1706136144 conn(0x7fb4580febc0 msgr2=0x7fb458101070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:34:15.652 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:15.649+0000 7fb457e00640 1 -- 172.21.15.50:0/1706136144 shutdown_connections 2024-08-31T04:34:15.652 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:15.649+0000 7fb457e00640 1 -- 172.21.15.50:0/1706136144 wait complete. 2024-08-31T04:34:15.653 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:15.650+0000 7fb457e00640 1 Processor -- start 2024-08-31T04:34:15.653 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:15.651+0000 7fb457e00640 1 -- start start 2024-08-31T04:34:15.653 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:15.651+0000 7fb457e00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb458075a90 0x7fb4581a0110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:34:15.653 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:15.651+0000 7fb457e00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb458076e90 0x7fb4581a0780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:34:15.653 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:15.651+0000 7fb457e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb45810fa00 0x7fb4581a1330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:34:15.653 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:15.651+0000 7fb457e00640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fb458115520 con 0x7fb45810fa00 2024-08-31T04:34:15.654 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:15.651+0000 7fb457e00640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7fb4581153a0 con 0x7fb458075a90 2024-08-31T04:34:15.654 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:15.651+0000 7fb457e00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fb4581156a0 con 0x7fb458076e90 2024-08-31T04:34:15.654 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:15.651+0000 7fb456a00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb458075a90 0x7fb4581a0110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:34:15.654 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:15.651+0000 7fb456000640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb458076e90 0x7fb4581a0780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:34:15.654 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:15.651+0000 7fb456a00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb458075a90 0x7fb4581a0110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.50:51702/0 (socket says 172.21.15.50:51702) 2024-08-31T04:34:15.654 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:15.652+0000 7fb456a00640 1 -- 172.21.15.50:0/562811818 learned_addr learned my addr 172.21.15.50:0/562811818 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:34:15.654 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:15.652+0000 7fb457400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb45810fa00 0x7fb4581a1330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:34:15.654 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:15.652+0000 7fb456000640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb458076e90 0x7fb4581a0780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.50:48650/0 (socket says 172.21.15.50:48650) 2024-08-31T04:34:15.655 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:15.652+0000 7fb456a00640 1 -- 172.21.15.50:0/562811818 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb458076e90 msgr2=0x7fb4581a0780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:34:15.655 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:15.652+0000 7fb456a00640 1 --2- 172.21.15.50:0/562811818 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb458076e90 0x7fb4581a0780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:15.656 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:15.652+0000 7fb456a00640 1 -- 172.21.15.50:0/562811818 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb45810fa00 msgr2=0x7fb4581a1330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:34:15.656 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:15.652+0000 7fb456a00640 1 --2- 172.21.15.50:0/562811818 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb45810fa00 0x7fb4581a1330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:15.656 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:15.652+0000 7fb456a00640 1 -- 172.21.15.50:0/562811818 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4581a1b50 con 0x7fb458075a90 2024-08-31T04:34:15.656 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:15.653+0000 7fb456000640 1 --2- 172.21.15.50:0/562811818 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb458076e90 0x7fb4581a0780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:34:15.656 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:15.653+0000 7fb457400640 1 --2- 172.21.15.50:0/562811818 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb45810fa00 0x7fb4581a1330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:34:15.656 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:15.654+0000 7fb456a00640 1 --2- 172.21.15.50:0/562811818 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb458075a90 0x7fb4581a0110 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fb44800ea60 tx=0x7fb44800ef20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:34:15.656 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:15.654+0000 7fb44f400640 1 -- 172.21.15.50:0/562811818 <== mon.2 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb44800cde0 con 0x7fb458075a90 2024-08-31T04:34:15.656 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:15.654+0000 7fb44f400640 1 -- 172.21.15.50:0/562811818 <== mon.2 v2:172.21.15.133:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb4480035f0 con 0x7fb458075a90 2024-08-31T04:34:15.656 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:15.654+0000 7fb457e00640 1 -- 172.21.15.50:0/562811818 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb4581a1e40 con 0x7fb458075a90 2024-08-31T04:34:15.656 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:15.654+0000 7fb44f400640 1 -- 172.21.15.50:0/562811818 <== mon.2 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb448010690 con 0x7fb458075a90 2024-08-31T04:34:15.656 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:15.654+0000 7fb457e00640 1 -- 172.21.15.50:0/562811818 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb4581a8530 con 0x7fb458075a90 2024-08-31T04:34:15.660 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:15.658+0000 7fb44f400640 1 -- 172.21.15.50:0/562811818 <== mon.2 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 18) ==== 152577+0+0 (secure 0 0 0) 0x7fb4480037a0 con 0x7fb458075a90 2024-08-31T04:34:15.660 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:15.659+0000 7fb464dd4740 1 Processor -- start 2024-08-31T04:34:15.660 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:15.659+0000 7fb464dd4740 1 -- start start 2024-08-31T04:34:15.661 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:15.659+0000 7fb464dd4740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c589d061b0 0x55c58a0abfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:34:15.661 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:15.659+0000 7fb464dd4740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55c589cdd2f0 0x55c58a0ac610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:34:15.661 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:15.659+0000 7fb464dd4740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c589ce54d0 0x55c58a0ad160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:34:15.662 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:15.660+0000 7fb464dd4740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55c58a01ef70 con 0x55c589ce54d0 2024-08-31T04:34:15.662 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:15.660+0000 7fb464dd4740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x55c58a00e500 con 0x55c589cdd2f0 2024-08-31T04:34:15.662 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:15.660+0000 7fb464dd4740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x55c58a0124b0 con 0x55c589d061b0 2024-08-31T04:34:15.662 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:15.660+0000 7fb456a00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55c589cdd2f0 0x55c58a0ac610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:34:15.662 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:15.660+0000 7fb456a00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55c589cdd2f0 0x55c58a0ac610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.50:51716/0 (socket says 172.21.15.50:51716) 2024-08-31T04:34:15.662 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:15.660+0000 7fb456a00640 1 -- 172.21.15.50:0/2012557127 learned_addr learned my addr 172.21.15.50:0/2012557127 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:34:15.662 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:15.660+0000 7fb457400640 1 --2- 172.21.15.50:0/2012557127 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c589d061b0 0x55c58a0abfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:34:15.662 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:15.660+0000 7fb456000640 1 --2- 172.21.15.50:0/2012557127 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c589ce54d0 0x55c58a0ad160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:34:15.663 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:15.660+0000 7fb456a00640 1 -- 172.21.15.50:0/2012557127 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c589d061b0 msgr2=0x55c58a0abfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:34:15.664 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:15.660+0000 7fb456a00640 1 --2- 172.21.15.50:0/2012557127 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c589d061b0 0x55c58a0abfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:15.664 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:15.660+0000 7fb456a00640 1 -- 172.21.15.50:0/2012557127 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c589ce54d0 msgr2=0x55c58a0ad160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:34:15.664 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:15.661+0000 7fb456a00640 1 --2- 172.21.15.50:0/2012557127 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c589ce54d0 0x55c58a0ad160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:15.664 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:15.661+0000 7fb456a00640 1 -- 172.21.15.50:0/2012557127 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c589fc8c10 con 0x55c589cdd2f0 2024-08-31T04:34:15.664 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:15.661+0000 7fb456000640 1 --2- 172.21.15.50:0/2012557127 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c589ce54d0 0x55c58a0ad160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:34:15.664 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:15.661+0000 7fb456a00640 1 --2- 172.21.15.50:0/2012557127 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55c589cdd2f0 0x55c58a0ac610 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fb4480ed3f0 tx=0x7fb4480ed8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=15b0e253c8f2c02f server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:34:15.664 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:15.661+0000 7fb443e00640 1 -- 172.21.15.50:0/2012557127 <== mon.2 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4480f9070 con 0x55c589cdd2f0 2024-08-31T04:34:15.664 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:15.661+0000 7fb443e00640 1 -- 172.21.15.50:0/2012557127 <== mon.2 v2:172.21.15.133:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb4480e7580 con 0x55c589cdd2f0 2024-08-31T04:34:15.664 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:15.661+0000 7fb44f400640 1 --2- 172.21.15.50:0/562811818 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fb43c0b4b30 0x7fb43c0b7040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:34:15.664 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:15.661+0000 7fb443e00640 1 -- 172.21.15.50:0/2012557127 <== mon.2 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4480f19b0 con 0x55c589cdd2f0 2024-08-31T04:34:15.665 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:15.662+0000 7fb457400640 1 --2- 172.21.15.50:0/562811818 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fb43c0b4b30 0x7fb43c0b7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:34:15.665 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:15.662+0000 7fb44f400640 1 -- 172.21.15.50:0/562811818 <== mon.2 v2:172.21.15.133:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8219+0+0 (secure 0 0 0) 0x7fb4480e5480 con 0x7fb458075a90 2024-08-31T04:34:15.665 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:15.662+0000 7fb464dd4740 1 -- 172.21.15.50:0/2012557127 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55c589cdd2f0 msgr2=0x55c58a0ac610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:34:15.665 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:15.662+0000 7fb464dd4740 1 --2- 172.21.15.50:0/2012557127 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55c589cdd2f0 0x55c58a0ac610 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fb4480ed3f0 tx=0x7fb4480ed8b0 comp rx=0 tx=0).stop 2024-08-31T04:34:15.667 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:15.663+0000 7fb464dd4740 1 -- 172.21.15.50:0/2012557127 shutdown_connections 2024-08-31T04:34:15.667 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:15.663+0000 7fb464dd4740 1 --2- 172.21.15.50:0/2012557127 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c589ce54d0 0x55c58a0ad160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:15.667 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:15.663+0000 7fb464dd4740 1 --2- 172.21.15.50:0/2012557127 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55c589cdd2f0 0x55c58a0ac610 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:15.667 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:15.663+0000 7fb464dd4740 1 --2- 172.21.15.50:0/2012557127 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c589d061b0 0x55c58a0abfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:15.667 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:15.663+0000 7fb464dd4740 1 -- 172.21.15.50:0/2012557127 >> 172.21.15.50:0/2012557127 conn(0x55c589cfa300 msgr2=0x55c58a0a7a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:34:15.668 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:15.663+0000 7fb457400640 1 --2- 172.21.15.50:0/562811818 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fb43c0b4b30 0x7fb43c0b7040 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fb450009fd0 tx=0x7fb450009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:34:15.668 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:15.663+0000 7fb464dd4740 1 -- 172.21.15.50:0/2012557127 shutdown_connections 2024-08-31T04:34:15.668 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:15.663+0000 7fb464dd4740 1 -- 172.21.15.50:0/2012557127 wait complete. 2024-08-31T04:34:15.668 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:15.664+0000 7fb464dd4740 1 -- start start 2024-08-31T04:34:15.668 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:15.664+0000 7fb464dd4740 1 Processor -- start 2024-08-31T04:34:15.668 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:15.664+0000 7fb464dd4740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c589cdd2f0 0x55c58a0b5660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:34:15.668 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:15.664+0000 7fb464dd4740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55c589ce54d0 0x55c58a0b5d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:34:15.668 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:15.665+0000 7fb464dd4740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c589d061b0 0x55c58a0b6890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:34:15.668 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:15.665+0000 7fb464dd4740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55c589f47ab0 con 0x55c589cdd2f0 2024-08-31T04:34:15.668 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:15.665+0000 7fb464dd4740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x55c589fb5320 con 0x55c589ce54d0 2024-08-31T04:34:15.668 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:15.665+0000 7fb464dd4740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x55c58a0adc80 con 0x55c589d061b0 2024-08-31T04:34:15.669 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:15.665+0000 7fb464dd4740 10 client.0 _ll_register_callbacks cb 0x55c589fbb6a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:34:15.669 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:15.665+0000 7fb456000640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55c589ce54d0 0x55c58a0b5d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:34:15.669 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:15.665+0000 7fb456a00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c589cdd2f0 0x55c58a0b5660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:34:15.669 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:15.665+0000 7fb456000640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55c589ce54d0 0x55c58a0b5d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.50:51724/0 (socket says 172.21.15.50:51724) 2024-08-31T04:34:15.669 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:15.665+0000 7fb456000640 1 -- 172.21.15.50:0/1823457310 learned_addr learned my addr 172.21.15.50:0/1823457310 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:34:15.669 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:15.665+0000 7fb456000640 1 -- 172.21.15.50:0/1823457310 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c589d061b0 msgr2=0x55c58a0b6890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:34:15.669 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:15.665+0000 7fb456000640 1 --2- 172.21.15.50:0/1823457310 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c589d061b0 0x55c58a0b6890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:15.669 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:15.665+0000 7fb456000640 1 -- 172.21.15.50:0/1823457310 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c589cdd2f0 msgr2=0x55c58a0b5660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:34:15.669 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:15.665+0000 7fb456000640 1 --2- 172.21.15.50:0/1823457310 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c589cdd2f0 0x55c58a0b5660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:15.669 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:15.665+0000 7fb456000640 1 -- 172.21.15.50:0/1823457310 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c589d71790 con 0x55c589ce54d0 2024-08-31T04:34:15.669 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:15.665+0000 7fb456a00640 1 --2- 172.21.15.50:0/1823457310 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c589cdd2f0 0x55c58a0b5660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:34:15.670 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:15.666+0000 7fb456000640 1 --2- 172.21.15.50:0/1823457310 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55c589ce54d0 0x55c58a0b5d20 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fb444009900 tx=0x7fb444003670 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2b8ffad4c4f9eee8 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:34:15.670 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:15.666+0000 7fb440c00640 10 client.0 ms_handle_connect on v2:172.21.15.133:3300/0 2024-08-31T04:34:15.672 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:15.666+0000 7fb440c00640 1 -- 172.21.15.50:0/1823457310 <== mon.2 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb444035070 con 0x55c589ce54d0 2024-08-31T04:34:15.672 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:15.666+0000 7fb440c00640 1 -- 172.21.15.50:0/1823457310 <== mon.2 v2:172.21.15.133:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8219+0+0 (secure 0 0 0) 0x7fb444003d30 con 0x55c589ce54d0 2024-08-31T04:34:15.672 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:15.666+0000 7fb464dd4740 1 -- 172.21.15.50:0/1823457310 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb4480e7580 con 0x55c589ce54d0 2024-08-31T04:34:15.672 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:15.667+0000 7fb440c00640 1 -- 172.21.15.50:0/1823457310 <== mon.2 v2:172.21.15.133:3300/0 3 ==== mon_get_version_reply(handle=1 version=59) ==== 24+0+0 (secure 0 0 0) 0x7fb4440315a0 con 0x55c589ce54d0 2024-08-31T04:34:15.672 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:15.667+0000 7fb464dd4740 10 client.26420 fetch_fsmap learned FSMap version 59 2024-08-31T04:34:15.672 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:15.667+0000 7fb464dd4740 1 -- 172.21.15.50:0/1823457310 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,fsmap=59,monmap=4+}) -- 0x55c589dea620 con 0x55c589ce54d0 2024-08-31T04:34:15.673 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:15.667+0000 7fb440c00640 1 -- 172.21.15.50:0/1823457310 <== mon.2 v2:172.21.15.133:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb4480e7580 con 0x55c589ce54d0 2024-08-31T04:34:15.673 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:15.667+0000 7fb440c00640 1 -- 172.21.15.50:0/1823457310 <== mon.2 v2:172.21.15.133:3300/0 5 ==== fsmap(e 59) ==== 8378+0+0 (secure 0 0 0) 0x7fb44403c6e0 con 0x55c589ce54d0 2024-08-31T04:34:15.673 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:15.667+0000 7fb464dd4740 10 client.26420 fetch_fsmap finished waiting for FSMap version 59 2024-08-31T04:34:15.673 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:15.667+0000 7fb464dd4740 10 client.26420 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T04:34:15.673 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:15.668+0000 7fb464dd4740 20 client.26420 populate_metadata read hostname 'smithi050' 2024-08-31T04:34:15.673 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:15.668+0000 7fb464dd4740 1 --2- 172.21.15.50:0/1823457310 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x55c589cc4d80 0x55c58a0c2e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:34:15.673 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:15.668+0000 7fb464dd4740 4 client.26420 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T04:34:15.673 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:15.668+0000 7fb464dd4740 1 -- 172.21.15.50:0/1823457310 --> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c58a020ec0 con 0x55c589cc4d80 2024-08-31T04:34:15.673 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:15.668+0000 7fb456a00640 1 --2- 172.21.15.50:0/1823457310 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x55c589cc4d80 0x55c58a0c2e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:34:15.673 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:15.668+0000 7fb456a00640 1 --2- 172.21.15.50:0/1823457310 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x55c589cc4d80 0x55c58a0c2e60 crc :-1 s=READY pgs=146 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=64c5b08b4a7dd8ca server_cookie=e7fca1d155d87982 in_seq=0 out_seq=0 2024-08-31T04:34:15.673 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:15.668+0000 7fb440c00640 10 client.26420 ms_handle_connect on v2:172.21.15.133:6838/2526402262 2024-08-31T04:34:15.674 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:15.669+0000 7fb440c00640 1 -- 172.21.15.50:0/1823457310 <== mds.0 v2:172.21.15.133:6838/2526402262 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55c58a020ec0 con 0x55c589cc4d80 2024-08-31T04:34:15.674 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:15.669+0000 7fb440c00640 10 client.26420 handle_command_reply: tid=0 2024-08-31T04:34:15.674 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:15.669+0000 7fb464dd4740 1 client.26420 shutdown 2024-08-31T04:34:15.674 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:15.670+0000 7fb464dd4740 1 -- 172.21.15.50:0/1823457310 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55c589ce54d0 msgr2=0x55c58a0b5d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:34:15.674 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:15.670+0000 7fb464dd4740 1 --2- 172.21.15.50:0/1823457310 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55c589ce54d0 0x55c58a0b5d20 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fb444009900 tx=0x7fb444003670 comp rx=0 tx=0).stop 2024-08-31T04:34:15.674 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:15.670+0000 7fb464dd4740 1 -- 172.21.15.50:0/1823457310 shutdown_connections 2024-08-31T04:34:15.674 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:15.670+0000 7fb464dd4740 1 --2- 172.21.15.50:0/1823457310 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x55c589cc4d80 0x55c58a0c2e60 crc :-1 s=READY pgs=146 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:15.674 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:15.670+0000 7fb464dd4740 1 --2- 172.21.15.50:0/1823457310 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c589d061b0 0x55c58a0b6890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:15.674 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:15.670+0000 7fb464dd4740 1 --2- 172.21.15.50:0/1823457310 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55c589ce54d0 0x55c58a0b5d20 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:15.674 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:15.670+0000 7fb440c00640 0 client.26420 ms_handle_reset on v2:172.21.15.133:6838/2526402262 2024-08-31T04:34:15.674 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:15.670+0000 7fb464dd4740 1 --2- 172.21.15.50:0/1823457310 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c589cdd2f0 0x55c58a0b5660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:15.674 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:15.670+0000 7fb464dd4740 1 -- 172.21.15.50:0/1823457310 >> 172.21.15.50:0/1823457310 conn(0x55c589cfa300 msgr2=0x55c58a0a5f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:34:15.675 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:15.670+0000 7fb464dd4740 1 -- 172.21.15.50:0/1823457310 shutdown_connections 2024-08-31T04:34:15.675 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:15.670+0000 7fb464dd4740 1 -- 172.21.15.50:0/1823457310 wait complete. 2024-08-31T04:34:15.675 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:15.670+0000 7fb464dd4740 20 client.26420 trim_cache size 0 max 16384 2024-08-31T04:34:15.692 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:15.690+0000 7fb464dd4740 1 Processor -- start 2024-08-31T04:34:15.692 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:15.690+0000 7fb464dd4740 1 -- start start 2024-08-31T04:34:15.692 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:15.690+0000 7fb464dd4740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c589cdd2f0 0x55c58a0acf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:34:15.692 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:15.690+0000 7fb464dd4740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55c589ce54d0 0x55c58a0b5660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:34:15.692 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:15.690+0000 7fb464dd4740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c589d061b0 0x55c58a0b5ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:34:15.692 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:15.690+0000 7fb464dd4740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fb4581b1160 con 0x55c589d061b0 2024-08-31T04:34:15.692 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:15.690+0000 7fb464dd4740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7fb4581b2d60 con 0x55c589ce54d0 2024-08-31T04:34:15.692 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:15.690+0000 7fb464dd4740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fb4581b1830 con 0x55c589cdd2f0 2024-08-31T04:34:15.693 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:15.691+0000 7fb456a00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c589cdd2f0 0x55c58a0acf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:34:15.693 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:15.691+0000 7fb456000640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55c589ce54d0 0x55c58a0b5660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:34:15.694 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:15.691+0000 7fb457400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c589d061b0 0x55c58a0b5ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:34:15.694 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:15.691+0000 7fb456a00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c589cdd2f0 0x55c58a0acf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.50:48682/0 (socket says 172.21.15.50:48682) 2024-08-31T04:34:15.694 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:15.691+0000 7fb456000640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55c589ce54d0 0x55c58a0b5660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.50:51726/0 (socket says 172.21.15.50:51726) 2024-08-31T04:34:15.694 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:15.691+0000 7fb456a00640 1 -- 172.21.15.50:0/1402229679 learned_addr learned my addr 172.21.15.50:0/1402229679 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:34:15.694 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:15.691+0000 7fb456000640 1 -- 172.21.15.50:0/1402229679 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c589cdd2f0 msgr2=0x55c58a0acf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:34:15.694 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:15.691+0000 7fb456000640 1 --2- 172.21.15.50:0/1402229679 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c589cdd2f0 0x55c58a0acf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:15.694 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:15.691+0000 7fb456000640 1 -- 172.21.15.50:0/1402229679 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c589d061b0 msgr2=0x55c58a0b5ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:34:15.694 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:15.691+0000 7fb456000640 1 --2- 172.21.15.50:0/1402229679 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c589d061b0 0x55c58a0b5ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:15.694 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:15.691+0000 7fb456000640 1 -- 172.21.15.50:0/1402229679 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c58a0b6c00 con 0x55c589ce54d0 2024-08-31T04:34:15.694 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:15.691+0000 7fb456000640 1 --2- 172.21.15.50:0/1402229679 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55c589ce54d0 0x55c58a0b5660 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fb44403cb00 tx=0x7fb44402a3f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a8a099da6d2a02d2 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:34:15.694 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:15.692+0000 7fb443400640 1 -- 172.21.15.50:0/1402229679 <== mon.2 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb444035070 con 0x55c589ce54d0 2024-08-31T04:34:15.695 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:15.692+0000 7fb443400640 1 -- 172.21.15.50:0/1402229679 <== mon.2 v2:172.21.15.133:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb444005850 con 0x55c589ce54d0 2024-08-31T04:34:15.695 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:15.692+0000 7fb443400640 1 -- 172.21.15.50:0/1402229679 <== mon.2 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb444031ac0 con 0x55c589ce54d0 2024-08-31T04:34:15.697 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:15.693+0000 7fb464dd4740 1 -- 172.21.15.50:0/1402229679 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55c589ce54d0 msgr2=0x55c58a0b5660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:34:15.697 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:15.693+0000 7fb464dd4740 1 --2- 172.21.15.50:0/1402229679 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55c589ce54d0 0x55c58a0b5660 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fb44403cb00 tx=0x7fb44402a3f0 comp rx=0 tx=0).stop 2024-08-31T04:34:15.698 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:15.693+0000 7fb464dd4740 1 -- 172.21.15.50:0/1402229679 shutdown_connections 2024-08-31T04:34:15.698 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:15.693+0000 7fb464dd4740 1 --2- 172.21.15.50:0/1402229679 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c589d061b0 0x55c58a0b5ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:15.698 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:15.693+0000 7fb464dd4740 1 --2- 172.21.15.50:0/1402229679 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55c589ce54d0 0x55c58a0b5660 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:15.698 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:15.693+0000 7fb464dd4740 1 --2- 172.21.15.50:0/1402229679 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c589cdd2f0 0x55c58a0acf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:15.698 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:15.693+0000 7fb464dd4740 1 -- 172.21.15.50:0/1402229679 >> 172.21.15.50:0/1402229679 conn(0x55c589cfa300 msgr2=0x55c58a0a2660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:34:15.698 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:15.693+0000 7fb464dd4740 1 -- 172.21.15.50:0/1402229679 shutdown_connections 2024-08-31T04:34:15.698 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:15.693+0000 7fb464dd4740 1 -- 172.21.15.50:0/1402229679 wait complete. 2024-08-31T04:34:15.698 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:15.694+0000 7fb464dd4740 1 -- start start 2024-08-31T04:34:15.698 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:15.694+0000 7fb464dd4740 1 Processor -- start 2024-08-31T04:34:15.698 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:15.694+0000 7fb464dd4740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55c589cdd2f0 0x55c58a0bd060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:34:15.698 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:15.694+0000 7fb464dd4740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c589ce54d0 0x55c58a0bd720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:34:15.699 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:15.694+0000 7fb464dd4740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c589d061b0 0x55c58a0bbe80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:34:15.699 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:15.694+0000 7fb464dd4740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fb4581b2690 con 0x55c589d061b0 2024-08-31T04:34:15.699 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:15.694+0000 7fb464dd4740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7fb4581b1fc0 con 0x55c589cdd2f0 2024-08-31T04:34:15.699 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:15.694+0000 7fb464dd4740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fb4581af140 con 0x55c589ce54d0 2024-08-31T04:34:15.699 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:15.694+0000 7fb464dd4740 10 client.0 _ll_register_callbacks cb 0x7fb444009560 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:34:15.699 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:15.695+0000 7fb456a00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55c589cdd2f0 0x55c58a0bd060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:34:15.699 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:15.695+0000 7fb456a00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55c589cdd2f0 0x55c58a0bd060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.50:51730/0 (socket says 172.21.15.50:51730) 2024-08-31T04:34:15.699 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:15.695+0000 7fb456a00640 1 -- 172.21.15.50:0/1795682439 learned_addr learned my addr 172.21.15.50:0/1795682439 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:34:15.699 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:15.695+0000 7fb457400640 1 --2- 172.21.15.50:0/1795682439 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c589d061b0 0x55c58a0bbe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:34:15.699 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:15.695+0000 7fb456a00640 1 -- 172.21.15.50:0/1795682439 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c589ce54d0 msgr2=0x55c58a0bd720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:34:15.700 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:15.695+0000 7fb456a00640 1 --2- 172.21.15.50:0/1795682439 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c589ce54d0 0x55c58a0bd720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:15.700 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:15.695+0000 7fb456a00640 1 -- 172.21.15.50:0/1795682439 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c589d061b0 msgr2=0x55c58a0bbe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:34:15.700 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:15.695+0000 7fb456a00640 1 --2- 172.21.15.50:0/1795682439 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c589d061b0 0x55c58a0bbe80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:15.700 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:15.695+0000 7fb456a00640 1 -- 172.21.15.50:0/1795682439 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c58a0bc5f0 con 0x55c589cdd2f0 2024-08-31T04:34:15.700 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:15.695+0000 7fb456a00640 1 --2- 172.21.15.50:0/1795682439 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55c589cdd2f0 0x55c58a0bd060 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fb448009920 tx=0x7fb448003d90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ceebf6a40f6e9c25 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:34:15.700 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:15.695+0000 7fb440c00640 10 client.0 ms_handle_connect on v2:172.21.15.133:3300/0 2024-08-31T04:34:15.700 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:15.696+0000 7fb440c00640 1 -- 172.21.15.50:0/1795682439 <== mon.2 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4480a7d20 con 0x55c589cdd2f0 2024-08-31T04:34:15.700 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:15.696+0000 7fb440c00640 1 -- 172.21.15.50:0/1795682439 <== mon.2 v2:172.21.15.133:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8219+0+0 (secure 0 0 0) 0x7fb4480e2fb0 con 0x55c589cdd2f0 2024-08-31T04:34:15.700 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:15.696+0000 7fb464dd4740 1 -- 172.21.15.50:0/1795682439 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb444005850 con 0x55c589cdd2f0 2024-08-31T04:34:15.700 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:15.696+0000 7fb440c00640 1 -- 172.21.15.50:0/1795682439 <== mon.2 v2:172.21.15.133:3300/0 3 ==== mon_get_version_reply(handle=1 version=59) ==== 24+0+0 (secure 0 0 0) 0x7fb4480ab5d0 con 0x55c589cdd2f0 2024-08-31T04:34:15.701 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:15.696+0000 7fb464dd4740 10 client.26426 fetch_fsmap learned FSMap version 59 2024-08-31T04:34:15.701 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:15.696+0000 7fb464dd4740 1 -- 172.21.15.50:0/1795682439 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,fsmap=59,monmap=4+}) -- 0x55c58a0bb4a0 con 0x55c589cdd2f0 2024-08-31T04:34:15.701 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:15.696+0000 7fb440c00640 1 -- 172.21.15.50:0/1795682439 <== mon.2 v2:172.21.15.133:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb444005850 con 0x55c589cdd2f0 2024-08-31T04:34:15.702 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:15.697+0000 7fb440c00640 1 -- 172.21.15.50:0/1795682439 <== mon.2 v2:172.21.15.133:3300/0 5 ==== fsmap(e 59) ==== 8378+0+0 (secure 0 0 0) 0x7fb4480a80f0 con 0x55c589cdd2f0 2024-08-31T04:34:15.702 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:15.697+0000 7fb464dd4740 10 client.26426 fetch_fsmap finished waiting for FSMap version 59 2024-08-31T04:34:15.702 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:15.697+0000 7fb464dd4740 10 client.26426 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T04:34:15.702 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:15.697+0000 7fb464dd4740 20 client.26426 populate_metadata read hostname 'smithi050' 2024-08-31T04:34:15.702 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:15.697+0000 7fb464dd4740 1 --2- 172.21.15.50:0/1795682439 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x55c589c9a1c0 0x55c58a12f940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:34:15.702 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:15.697+0000 7fb464dd4740 4 client.26426 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-31T04:34:15.702 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:15.697+0000 7fb464dd4740 1 -- 172.21.15.50:0/1795682439 --> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55c58a01c960 con 0x55c589c9a1c0 2024-08-31T04:34:15.702 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:15.697+0000 7fb456000640 1 --2- 172.21.15.50:0/1795682439 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x55c589c9a1c0 0x55c58a12f940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:34:15.702 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:15.698+0000 7fb456000640 1 --2- 172.21.15.50:0/1795682439 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x55c589c9a1c0 0x55c58a12f940 crc :-1 s=READY pgs=147 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4fbd853d07f8966 server_cookie=f1812aa1682ac10b in_seq=0 out_seq=0 2024-08-31T04:34:15.702 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:15.698+0000 7fb440c00640 10 client.26426 ms_handle_connect on v2:172.21.15.133:6838/2526402262 2024-08-31T04:34:15.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:34:15 smithi133 ceph-mon[22177]: pgmap v709: 97 pgs: 97 active+clean; 1.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 MiB/s rd, 547 KiB/s wr, 295 op/s 2024-08-31T04:34:15.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:34:15 smithi133 ceph-mon[22177]: mds.? [v2:172.21.15.50:6840/575209862,v1:172.21.15.50:6841/575209862] up:active 2024-08-31T04:34:15.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:34:15 smithi133 ceph-mon[22177]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-31T04:34:15.996 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:34:15 smithi177 ceph-mon[22025]: pgmap v709: 97 pgs: 97 active+clean; 1.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 MiB/s rd, 547 KiB/s wr, 295 op/s 2024-08-31T04:34:15.996 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:34:15 smithi177 ceph-mon[22025]: mds.? [v2:172.21.15.50:6840/575209862,v1:172.21.15.50:6841/575209862] up:active 2024-08-31T04:34:15.996 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:34:15 smithi177 ceph-mon[22025]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-31T04:34:16.008 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:16.006+0000 7fb440c00640 1 -- 172.21.15.50:0/1795682439 <== mds.0 v2:172.21.15.133:6838/2526402262 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55c58a01c960 con 0x55c589c9a1c0 2024-08-31T04:34:16.009 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:16.006+0000 7fb440c00640 10 client.26426 handle_command_reply: tid=0 2024-08-31T04:34:16.009 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:16.007+0000 7fb464dd4740 1 client.26426 shutdown 2024-08-31T04:34:16.009 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:16.007+0000 7fb464dd4740 1 -- 172.21.15.50:0/1795682439 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55c589cdd2f0 msgr2=0x55c58a0bd060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:34:16.009 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:16.007+0000 7fb464dd4740 1 --2- 172.21.15.50:0/1795682439 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55c589cdd2f0 0x55c58a0bd060 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fb448009920 tx=0x7fb448003d90 comp rx=0 tx=0).stop 2024-08-31T04:34:16.009 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:16.007+0000 7fb464dd4740 1 -- 172.21.15.50:0/1795682439 shutdown_connections 2024-08-31T04:34:16.009 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:16.007+0000 7fb464dd4740 1 --2- 172.21.15.50:0/1795682439 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x55c589c9a1c0 0x55c58a12f940 crc :-1 s=READY pgs=147 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:16.009 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:16.007+0000 7fb464dd4740 1 --2- 172.21.15.50:0/1795682439 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c589ce54d0 0x55c58a0bd720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:16.009 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:16.007+0000 7fb464dd4740 1 --2- 172.21.15.50:0/1795682439 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c589d061b0 0x55c58a0bbe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:16.009 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:16.007+0000 7fb440c00640 0 client.26426 ms_handle_reset on v2:172.21.15.133:6838/2526402262 2024-08-31T04:34:16.009 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:16.007+0000 7fb464dd4740 1 --2- 172.21.15.50:0/1795682439 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55c589cdd2f0 0x55c58a0bd060 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:16.009 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:16.007+0000 7fb464dd4740 1 -- 172.21.15.50:0/1795682439 >> 172.21.15.50:0/1795682439 conn(0x55c589cfa300 msgr2=0x55c58a0b5640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:34:16.010 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:16.007+0000 7fb464dd4740 1 -- 172.21.15.50:0/1795682439 shutdown_connections 2024-08-31T04:34:16.010 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:16.007+0000 7fb464dd4740 1 -- 172.21.15.50:0/1795682439 wait complete. 2024-08-31T04:34:16.010 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:16.007+0000 7fb464dd4740 20 client.26426 trim_cache size 0 max 16384 2024-08-31T04:34:16.010 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout:{ 2024-08-31T04:34:16.010 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout: "message": "", 2024-08-31T04:34:16.010 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout: "return_code": 0 2024-08-31T04:34:16.010 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout:} 2024-08-31T04:34:16.011 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:16.007+0000 7fb457e00640 1 -- 172.21.15.50:0/562811818 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fb43c0b4b30 msgr2=0x7fb43c0b7040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:34:16.011 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:16.007+0000 7fb457e00640 1 --2- 172.21.15.50:0/562811818 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fb43c0b4b30 0x7fb43c0b7040 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fb450009fd0 tx=0x7fb450009500 comp rx=0 tx=0).stop 2024-08-31T04:34:16.011 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:16.007+0000 7fb457e00640 1 -- 172.21.15.50:0/562811818 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb458075a90 msgr2=0x7fb4581a0110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:34:16.011 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:16.007+0000 7fb457e00640 1 --2- 172.21.15.50:0/562811818 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb458075a90 0x7fb4581a0110 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fb44800ea60 tx=0x7fb44800ef20 comp rx=0 tx=0).stop 2024-08-31T04:34:16.011 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:16.007+0000 7fb457e00640 1 -- 172.21.15.50:0/562811818 shutdown_connections 2024-08-31T04:34:16.011 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:16.007+0000 7fb457e00640 1 --2- 172.21.15.50:0/562811818 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fb43c0b4b30 0x7fb43c0b7040 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:16.011 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:16.007+0000 7fb457e00640 1 --2- 172.21.15.50:0/562811818 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb458076e90 0x7fb4581a0780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:16.012 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:16.007+0000 7fb457e00640 1 --2- 172.21.15.50:0/562811818 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb45810fa00 0x7fb4581a1330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:16.012 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:16.007+0000 7fb457e00640 1 --2- 172.21.15.50:0/562811818 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb458075a90 0x7fb4581a0110 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:16.012 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:16.007+0000 7fb457e00640 1 -- 172.21.15.50:0/562811818 >> 172.21.15.50:0/562811818 conn(0x7fb4580febc0 msgr2=0x7fb4580ff190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:34:16.012 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:16.007+0000 7fb457e00640 1 -- 172.21.15.50:0/562811818 shutdown_connections 2024-08-31T04:34:16.012 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:16.007+0000 7fb457e00640 1 -- 172.21.15.50:0/562811818 wait complete. 2024-08-31T04:34:16.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:34:16 smithi177 ceph-mon[22025]: 1 slow requests, 0 included below; oldest blocked for > 269.060920 secs 2024-08-31T04:34:16.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:34:16 smithi177 ceph-mon[22025]: Health check update: 4 MDSs report slow requests (MDS_SLOW_REQUEST) 2024-08-31T04:34:16.779 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:34:16 smithi050 ceph-mon[17259]: 1 slow requests, 0 included below; oldest blocked for > 269.060920 secs 2024-08-31T04:34:16.779 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:34:16 smithi050 ceph-mon[17259]: Health check update: 4 MDSs report slow requests (MDS_SLOW_REQUEST) 2024-08-31T04:34:17.043 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:34:16 smithi133 ceph-mon[22177]: 1 slow requests, 0 included below; oldest blocked for > 269.060920 secs 2024-08-31T04:34:17.043 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:34:16 smithi133 ceph-mon[22177]: Health check update: 4 MDSs report slow requests (MDS_SLOW_REQUEST) 2024-08-31T04:34:17.771 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:34:17 smithi050 ceph-mon[17259]: pgmap v710: 97 pgs: 97 active+clean; 1.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 MiB/s rd, 636 KiB/s wr, 303 op/s 2024-08-31T04:34:17.771 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:34:17 smithi050 ceph-mon[17259]: MDS health message cleared (mds.?): 2 slow requests are blocked > 180 secs 2024-08-31T04:34:17.996 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:34:17 smithi177 ceph-mon[22025]: pgmap v710: 97 pgs: 97 active+clean; 1.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 MiB/s rd, 636 KiB/s wr, 303 op/s 2024-08-31T04:34:17.996 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:34:17 smithi177 ceph-mon[22025]: MDS health message cleared (mds.?): 2 slow requests are blocked > 180 secs 2024-08-31T04:34:18.043 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:34:17 smithi133 ceph-mon[22177]: pgmap v710: 97 pgs: 97 active+clean; 1.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 MiB/s rd, 636 KiB/s wr, 303 op/s 2024-08-31T04:34:18.043 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:34:17 smithi133 ceph-mon[22177]: MDS health message cleared (mds.?): 2 slow requests are blocked > 180 secs 2024-08-31T04:34:18.635 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:34:18 smithi050 ceph-mon[17259]: mds.? [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] up:active 2024-08-31T04:34:18.635 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:34:18 smithi050 ceph-mon[17259]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-31T04:34:18.996 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:34:18 smithi177 ceph-mon[22025]: mds.? [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] up:active 2024-08-31T04:34:18.996 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:34:18 smithi177 ceph-mon[22025]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-31T04:34:19.043 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:34:18 smithi133 ceph-mon[22177]: mds.? [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] up:active 2024-08-31T04:34:19.043 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:34:18 smithi133 ceph-mon[22177]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-31T04:34:19.758 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:34:19 smithi050 ceph-mon[17259]: pgmap v711: 97 pgs: 97 active+clean; 1.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 MiB/s rd, 558 KiB/s wr, 327 op/s 2024-08-31T04:34:19.758 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:34:19 smithi050 ceph-mon[17259]: 1 slow requests, 0 included below; oldest blocked for > 270.005349 secs 2024-08-31T04:34:19.996 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:34:19 smithi177 ceph-mon[22025]: pgmap v711: 97 pgs: 97 active+clean; 1.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 MiB/s rd, 558 KiB/s wr, 327 op/s 2024-08-31T04:34:19.997 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:34:19 smithi177 ceph-mon[22025]: 1 slow requests, 0 included below; oldest blocked for > 270.005349 secs 2024-08-31T04:34:20.043 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:34:19 smithi133 ceph-mon[22177]: pgmap v711: 97 pgs: 97 active+clean; 1.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 MiB/s rd, 558 KiB/s wr, 327 op/s 2024-08-31T04:34:20.043 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:34:19 smithi133 ceph-mon[22177]: 1 slow requests, 0 included below; oldest blocked for > 270.005349 secs 2024-08-31T04:34:21.950 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:34:21 smithi050 ceph-mon[17259]: pgmap v712: 97 pgs: 97 active+clean; 1.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 MiB/s rd, 1.2 MiB/s wr, 332 op/s 2024-08-31T04:34:21.950 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:34:21 smithi050 ceph-mon[17259]: 1 slow requests, 0 included below; oldest blocked for > 274.061010 secs 2024-08-31T04:34:21.950 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:34:21 smithi050 ceph-mon[17259]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2024-08-31T04:34:21.996 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:34:21 smithi177 ceph-mon[22025]: pgmap v712: 97 pgs: 97 active+clean; 1.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 MiB/s rd, 1.2 MiB/s wr, 332 op/s 2024-08-31T04:34:21.996 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:34:21 smithi177 ceph-mon[22025]: 1 slow requests, 0 included below; oldest blocked for > 274.061010 secs 2024-08-31T04:34:21.996 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:34:21 smithi177 ceph-mon[22025]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2024-08-31T04:34:22.043 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:34:21 smithi133 ceph-mon[22177]: pgmap v712: 97 pgs: 97 active+clean; 1.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 MiB/s rd, 1.2 MiB/s wr, 332 op/s 2024-08-31T04:34:22.043 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:34:21 smithi133 ceph-mon[22177]: 1 slow requests, 0 included below; oldest blocked for > 274.061010 secs 2024-08-31T04:34:22.043 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:34:21 smithi133 ceph-mon[22177]: Health check update: 3 MDSs report slow requests (MDS_SLOW_REQUEST) 2024-08-31T04:34:22.950 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:34:22 smithi050 ceph-mon[17259]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2024-08-31T04:34:22.996 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:34:22 smithi177 ceph-mon[22025]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2024-08-31T04:34:23.043 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:34:22 smithi133 ceph-mon[22177]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2024-08-31T04:34:23.950 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:34:23 smithi050 ceph-mon[17259]: pgmap v713: 97 pgs: 97 active+clean; 1.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 1.7 MiB/s wr, 336 op/s 2024-08-31T04:34:23.950 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:34:23 smithi050 ceph-mon[17259]: mds.? [v2:172.21.15.50:6840/575209862,v1:172.21.15.50:6841/575209862] up:active 2024-08-31T04:34:23.950 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:34:23 smithi050 ceph-mon[17259]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-31T04:34:23.996 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:34:23 smithi177 ceph-mon[22025]: pgmap v713: 97 pgs: 97 active+clean; 1.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 1.7 MiB/s wr, 336 op/s 2024-08-31T04:34:23.996 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:34:23 smithi177 ceph-mon[22025]: mds.? [v2:172.21.15.50:6840/575209862,v1:172.21.15.50:6841/575209862] up:active 2024-08-31T04:34:23.996 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:34:23 smithi177 ceph-mon[22025]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-31T04:34:24.043 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:34:23 smithi133 ceph-mon[22177]: pgmap v713: 97 pgs: 97 active+clean; 1.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 1.7 MiB/s wr, 336 op/s 2024-08-31T04:34:24.043 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:34:23 smithi133 ceph-mon[22177]: mds.? [v2:172.21.15.50:6840/575209862,v1:172.21.15.50:6841/575209862] up:active 2024-08-31T04:34:24.043 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:34:23 smithi133 ceph-mon[22177]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-31T04:34:25.950 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:34:25 smithi050 ceph-mon[17259]: pgmap v714: 97 pgs: 97 active+clean; 1.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 1.3 MiB/s wr, 286 op/s 2024-08-31T04:34:25.950 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:34:25 smithi050 ceph-mon[17259]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2024-08-31T04:34:25.996 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:34:25 smithi177 ceph-mon[22025]: pgmap v714: 97 pgs: 97 active+clean; 1.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 1.3 MiB/s wr, 286 op/s 2024-08-31T04:34:25.996 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:34:25 smithi177 ceph-mon[22025]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2024-08-31T04:34:26.043 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:34:25 smithi133 ceph-mon[22177]: pgmap v714: 97 pgs: 97 active+clean; 1.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 1.3 MiB/s wr, 286 op/s 2024-08-31T04:34:26.043 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:34:25 smithi133 ceph-mon[22177]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2024-08-31T04:34:26.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:34:26 smithi177 ceph-mon[22025]: mds.? [v2:172.21.15.133:6836/4014853202,v1:172.21.15.133:6837/4014853202] up:active 2024-08-31T04:34:26.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:34:26 smithi177 ceph-mon[22025]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-31T04:34:26.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:34:26 smithi177 ceph-mon[22025]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2024-08-31T04:34:26.950 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:34:26 smithi050 ceph-mon[17259]: mds.? [v2:172.21.15.133:6836/4014853202,v1:172.21.15.133:6837/4014853202] up:active 2024-08-31T04:34:26.950 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:34:26 smithi050 ceph-mon[17259]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-31T04:34:26.950 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:34:26 smithi050 ceph-mon[17259]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2024-08-31T04:34:27.043 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:34:26 smithi133 ceph-mon[22177]: mds.? [v2:172.21.15.133:6836/4014853202,v1:172.21.15.133:6837/4014853202] up:active 2024-08-31T04:34:27.043 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:34:26 smithi133 ceph-mon[22177]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-31T04:34:27.043 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:34:26 smithi133 ceph-mon[22177]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2024-08-31T04:34:27.950 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:34:27 smithi050 ceph-mon[17259]: pgmap v715: 97 pgs: 97 active+clean; 1.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 MiB/s rd, 1.8 MiB/s wr, 443 op/s 2024-08-31T04:34:27.996 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:34:27 smithi177 ceph-mon[22025]: pgmap v715: 97 pgs: 97 active+clean; 1.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 MiB/s rd, 1.8 MiB/s wr, 443 op/s 2024-08-31T04:34:28.043 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:34:27 smithi133 ceph-mon[22177]: pgmap v715: 97 pgs: 97 active+clean; 1.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 MiB/s rd, 1.8 MiB/s wr, 443 op/s 2024-08-31T04:34:29.220 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:29.218+0000 7fbb31200640 1 -- 172.21.15.50:0/2176738747 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbb2c103280 msgr2=0x7fbb2c1036f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:34:29.220 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:29.218+0000 7fbb31200640 1 --2- 172.21.15.50:0/2176738747 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbb2c103280 0x7fbb2c1036f0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7fbb1c009900 tx=0x7fbb1c02a3f0 comp rx=0 tx=0).stop 2024-08-31T04:34:29.220 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:29.218+0000 7fbb31200640 1 -- 172.21.15.50:0/2176738747 shutdown_connections 2024-08-31T04:34:29.220 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:29.218+0000 7fbb31200640 1 --2- 172.21.15.50:0/2176738747 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbb2c104300 0x7fbb2c104710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:29.221 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:29.218+0000 7fbb31200640 1 --2- 172.21.15.50:0/2176738747 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbb2c104ca0 0x7fbb2c10b640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:29.221 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:29.218+0000 7fbb31200640 1 --2- 172.21.15.50:0/2176738747 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbb2c103280 0x7fbb2c1036f0 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:29.221 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:29.218+0000 7fbb31200640 1 -- 172.21.15.50:0/2176738747 >> 172.21.15.50:0/2176738747 conn(0x7fbb2c0febc0 msgr2=0x7fbb2c101070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:34:29.221 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:29.218+0000 7fbb31200640 1 -- 172.21.15.50:0/2176738747 shutdown_connections 2024-08-31T04:34:29.221 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:29.218+0000 7fbb31200640 1 -- 172.21.15.50:0/2176738747 wait complete. 2024-08-31T04:34:29.223 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:29.219+0000 7fbb31200640 1 Processor -- start 2024-08-31T04:34:29.223 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:29.219+0000 7fbb31200640 1 -- start start 2024-08-31T04:34:29.223 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:29.220+0000 7fbb31200640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbb2c103280 0x7fbb2c199ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:34:29.223 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:29.220+0000 7fbb31200640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbb2c104300 0x7fbb2c19a210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:34:29.223 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:29.220+0000 7fbb31200640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbb2c104ca0 0x7fbb2c19ad50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:34:29.224 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:29.220+0000 7fbb31200640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fbb2c10ef00 con 0x7fbb2c103280 2024-08-31T04:34:29.224 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:29.220+0000 7fbb31200640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7fbb2c10ed80 con 0x7fbb2c104ca0 2024-08-31T04:34:29.224 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:29.220+0000 7fbb31200640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fbb2c10f080 con 0x7fbb2c104300 2024-08-31T04:34:29.224 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:29.220+0000 7fbb2b400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbb2c103280 0x7fbb2c199ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:34:29.224 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:29.220+0000 7fbb22a00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbb2c104300 0x7fbb2c19a210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:34:29.224 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:29.220+0000 7fbb22a00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbb2c104300 0x7fbb2c19a210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.50:53924/0 (socket says 172.21.15.50:53924) 2024-08-31T04:34:29.224 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:29.220+0000 7fbb22a00640 1 -- 172.21.15.50:0/2314656867 learned_addr learned my addr 172.21.15.50:0/2314656867 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:34:29.224 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:29.220+0000 7fbb2be00640 1 --2- 172.21.15.50:0/2314656867 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbb2c104ca0 0x7fbb2c19ad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:34:29.224 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:29.221+0000 7fbb2b400640 1 -- 172.21.15.50:0/2314656867 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbb2c104300 msgr2=0x7fbb2c19a210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:34:29.224 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:29.221+0000 7fbb2b400640 1 --2- 172.21.15.50:0/2314656867 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbb2c104300 0x7fbb2c19a210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:29.224 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:29.221+0000 7fbb2b400640 1 -- 172.21.15.50:0/2314656867 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbb2c104ca0 msgr2=0x7fbb2c19ad50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:34:29.224 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:29.221+0000 7fbb2b400640 1 --2- 172.21.15.50:0/2314656867 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbb2c104ca0 0x7fbb2c19ad50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:29.224 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:29.221+0000 7fbb2b400640 1 -- 172.21.15.50:0/2314656867 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb2c19b570 con 0x7fbb2c103280 2024-08-31T04:34:29.225 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:29.221+0000 7fbb2b400640 1 --2- 172.21.15.50:0/2314656867 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbb2c103280 0x7fbb2c199ba0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7fbb1c006010 tx=0x7fbb1c004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:34:29.225 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:29.221+0000 7fbb28c00640 1 -- 172.21.15.50:0/2314656867 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb1c03f070 con 0x7fbb2c103280 2024-08-31T04:34:29.225 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:29.221+0000 7fbb31200640 1 -- 172.21.15.50:0/2314656867 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbb2c19b800 con 0x7fbb2c103280 2024-08-31T04:34:29.225 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:29.221+0000 7fbb28c00640 1 -- 172.21.15.50:0/2314656867 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbb1c032e50 con 0x7fbb2c103280 2024-08-31T04:34:29.225 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:29.221+0000 7fbb28c00640 1 -- 172.21.15.50:0/2314656867 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb1c035070 con 0x7fbb2c103280 2024-08-31T04:34:29.225 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:29.221+0000 7fbb31200640 1 -- 172.21.15.50:0/2314656867 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbb2c19bb10 con 0x7fbb2c103280 2024-08-31T04:34:29.225 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:29.224+0000 7fbb397f2740 1 Processor -- start 2024-08-31T04:34:29.226 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:29.224+0000 7fbb397f2740 1 -- start start 2024-08-31T04:34:29.227 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:29.225+0000 7fbb397f2740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5624804051b0 0x5624807aafa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:34:29.227 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:29.225+0000 7fbb397f2740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5624803dc2f0 0x5624807ab610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:34:29.228 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:29.225+0000 7fbb397f2740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5624803e44d0 0x5624807ac160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:34:29.228 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:29.225+0000 7fbb397f2740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x56248071df70 con 0x5624803dc2f0 2024-08-31T04:34:29.228 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:29.225+0000 7fbb397f2740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x56248070d500 con 0x5624803e44d0 2024-08-31T04:34:29.228 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:29.225+0000 7fbb397f2740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x5624807114b0 con 0x5624804051b0 2024-08-31T04:34:29.228 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:29.225+0000 7fbb28c00640 1 -- 172.21.15.50:0/2314656867 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 18) ==== 152577+0+0 (secure 0 0 0) 0x7fbb1c0037f0 con 0x7fbb2c103280 2024-08-31T04:34:29.228 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:29.225+0000 7fbb22a00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5624803e44d0 0x5624807ac160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:34:29.228 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:29.225+0000 7fbb2be00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5624804051b0 0x5624807aafa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:34:29.228 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:29.225+0000 7fbb22a00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5624803e44d0 0x5624807ac160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.50:54182/0 (socket says 172.21.15.50:54182) 2024-08-31T04:34:29.228 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:29.225+0000 7fbb22a00640 1 -- 172.21.15.50:0/3042399771 learned_addr learned my addr 172.21.15.50:0/3042399771 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:34:29.228 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:29.225+0000 7fbb2b400640 1 --2- 172.21.15.50:0/3042399771 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5624803dc2f0 0x5624807ab610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:34:29.229 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:29.226+0000 7fbb22a00640 1 -- 172.21.15.50:0/3042399771 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5624804051b0 msgr2=0x5624807aafa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:34:29.229 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:29.226+0000 7fbb22a00640 1 --2- 172.21.15.50:0/3042399771 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5624804051b0 0x5624807aafa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:29.229 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:29.226+0000 7fbb22a00640 1 -- 172.21.15.50:0/3042399771 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5624803dc2f0 msgr2=0x5624807ab610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:34:29.229 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:29.226+0000 7fbb22a00640 1 --2- 172.21.15.50:0/3042399771 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5624803dc2f0 0x5624807ab610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:29.229 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:29.226+0000 7fbb22a00640 1 -- 172.21.15.50:0/3042399771 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5624806c7c10 con 0x5624803e44d0 2024-08-31T04:34:29.229 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:29.226+0000 7fbb2be00640 1 --2- 172.21.15.50:0/3042399771 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5624804051b0 0x5624807aafa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:34:29.229 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:29.226+0000 7fbb22a00640 1 --2- 172.21.15.50:0/3042399771 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5624803e44d0 0x5624807ac160 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fbb14009e10 tx=0x7fbb14011810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3f211d7031a3d813 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:34:29.229 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:29.226+0000 7fbb20c00640 1 -- 172.21.15.50:0/3042399771 <== mon.2 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb1401e070 con 0x5624803e44d0 2024-08-31T04:34:29.229 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:29.226+0000 7fbb20c00640 1 -- 172.21.15.50:0/3042399771 <== mon.2 v2:172.21.15.133:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbb14019ae0 con 0x5624803e44d0 2024-08-31T04:34:29.229 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:29.226+0000 7fbb20c00640 1 -- 172.21.15.50:0/3042399771 <== mon.2 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb1400fb30 con 0x5624803e44d0 2024-08-31T04:34:29.233 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:29.227+0000 7fbb28c00640 1 --2- 172.21.15.50:0/2314656867 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fbb100b4b30 0x7fbb100b7040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:34:29.233 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:29.227+0000 7fbb28c00640 1 -- 172.21.15.50:0/2314656867 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8219+0+0 (secure 0 0 0) 0x7fbb1c1052f0 con 0x7fbb2c103280 2024-08-31T04:34:29.233 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:29.227+0000 7fbb2be00640 1 --2- 172.21.15.50:0/2314656867 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fbb100b4b30 0x7fbb100b7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:34:29.234 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:29.227+0000 7fbb397f2740 1 -- 172.21.15.50:0/3042399771 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5624803e44d0 msgr2=0x5624807ac160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:34:29.234 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:29.227+0000 7fbb397f2740 1 --2- 172.21.15.50:0/3042399771 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5624803e44d0 0x5624807ac160 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fbb14009e10 tx=0x7fbb14011810 comp rx=0 tx=0).stop 2024-08-31T04:34:29.234 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:29.227+0000 7fbb397f2740 1 -- 172.21.15.50:0/3042399771 shutdown_connections 2024-08-31T04:34:29.234 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:29.227+0000 7fbb397f2740 1 --2- 172.21.15.50:0/3042399771 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5624803e44d0 0x5624807ac160 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:29.234 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:29.227+0000 7fbb397f2740 1 --2- 172.21.15.50:0/3042399771 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5624803dc2f0 0x5624807ab610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:29.234 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:29.227+0000 7fbb397f2740 1 --2- 172.21.15.50:0/3042399771 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5624804051b0 0x5624807aafa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:29.234 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:29.227+0000 7fbb397f2740 1 -- 172.21.15.50:0/3042399771 >> 172.21.15.50:0/3042399771 conn(0x5624803f9300 msgr2=0x5624807a6a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:34:29.234 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:29.228+0000 7fbb397f2740 1 -- 172.21.15.50:0/3042399771 shutdown_connections 2024-08-31T04:34:29.234 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:29.228+0000 7fbb2be00640 1 --2- 172.21.15.50:0/2314656867 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fbb100b4b30 0x7fbb100b7040 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fbb24005fd0 tx=0x7fbb24009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:34:29.235 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:29.228+0000 7fbb397f2740 1 -- 172.21.15.50:0/3042399771 wait complete. 2024-08-31T04:34:29.235 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:29.228+0000 7fbb397f2740 1 -- start start 2024-08-31T04:34:29.235 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:29.228+0000 7fbb397f2740 1 Processor -- start 2024-08-31T04:34:29.235 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:29.229+0000 7fbb397f2740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5624803dc2f0 0x5624807b4610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:34:29.235 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:29.229+0000 7fbb397f2740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5624803e44d0 0x5624807b4cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:34:29.235 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:29.229+0000 7fbb397f2740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5624804051b0 0x5624807b5840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:34:29.235 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:29.229+0000 7fbb397f2740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x562480646ab0 con 0x5624803dc2f0 2024-08-31T04:34:29.235 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:29.229+0000 7fbb397f2740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x5624806b4320 con 0x5624803e44d0 2024-08-31T04:34:29.235 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:29.229+0000 7fbb397f2740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x5624807acc80 con 0x5624804051b0 2024-08-31T04:34:29.235 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:29.229+0000 7fbb397f2740 10 client.0 _ll_register_callbacks cb 0x5624806ba6a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:34:29.235 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:29.229+0000 7fbb2b400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5624803dc2f0 0x5624807b4610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:34:29.235 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:29.229+0000 7fbb2b400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5624803dc2f0 0x5624807b4610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50592/0 (socket says 172.21.15.50:50592) 2024-08-31T04:34:29.235 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:29.229+0000 7fbb2b400640 1 -- 172.21.15.50:0/3605449761 learned_addr learned my addr 172.21.15.50:0/3605449761 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:34:29.235 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:29.229+0000 7fbb22a00640 1 --2- 172.21.15.50:0/3605449761 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5624803e44d0 0x5624807b4cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:34:29.236 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:29.229+0000 7fbb2be00640 1 --2- 172.21.15.50:0/3605449761 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5624804051b0 0x5624807b5840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:34:29.236 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:29.229+0000 7fbb2b400640 1 -- 172.21.15.50:0/3605449761 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5624804051b0 msgr2=0x5624807b5840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:34:29.236 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:29.229+0000 7fbb2b400640 1 --2- 172.21.15.50:0/3605449761 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5624804051b0 0x5624807b5840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:29.236 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:29.229+0000 7fbb2b400640 1 -- 172.21.15.50:0/3605449761 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5624803e44d0 msgr2=0x5624807b4cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:34:29.236 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:29.229+0000 7fbb2b400640 1 --2- 172.21.15.50:0/3605449761 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5624803e44d0 0x5624807b4cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:29.236 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:29.230+0000 7fbb2b400640 1 -- 172.21.15.50:0/3605449761 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562480470790 con 0x5624803dc2f0 2024-08-31T04:34:29.236 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:29.230+0000 7fbb2b400640 1 --2- 172.21.15.50:0/3605449761 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5624803dc2f0 0x5624807b4610 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fbb1c0c8f40 tx=0x7fbb1c0cbb60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d56b63c9a51e6026 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:34:29.236 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:29.230+0000 7fbb19600640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-08-31T04:34:29.236 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:29.230+0000 7fbb19600640 1 -- 172.21.15.50:0/3605449761 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb1c048070 con 0x5624803dc2f0 2024-08-31T04:34:29.236 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:29.230+0000 7fbb19600640 1 -- 172.21.15.50:0/3605449761 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8219+0+0 (secure 0 0 0) 0x7fbb1c102eb0 con 0x5624803dc2f0 2024-08-31T04:34:29.236 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:29.230+0000 7fbb397f2740 1 -- 172.21.15.50:0/3605449761 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbb14019ae0 con 0x5624803dc2f0 2024-08-31T04:34:29.236 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:29.230+0000 7fbb19600640 1 -- 172.21.15.50:0/3605449761 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=62) ==== 24+0+0 (secure 0 0 0) 0x7fbb1c0cc3d0 con 0x5624803dc2f0 2024-08-31T04:34:29.236 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:29.230+0000 7fbb397f2740 10 client.16479 fetch_fsmap learned FSMap version 62 2024-08-31T04:34:29.237 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:29.230+0000 7fbb397f2740 1 -- 172.21.15.50:0/3605449761 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=62,monmap=4+}) -- 0x5624804e9620 con 0x5624803dc2f0 2024-08-31T04:34:29.237 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:29.231+0000 7fbb19600640 1 -- 172.21.15.50:0/3605449761 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbb14019ae0 con 0x5624803dc2f0 2024-08-31T04:34:29.237 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:29.231+0000 7fbb19600640 1 -- 172.21.15.50:0/3605449761 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 62) ==== 8378+0+0 (secure 0 0 0) 0x7fbb1c04b060 con 0x5624803dc2f0 2024-08-31T04:34:29.237 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:29.231+0000 7fbb397f2740 10 client.16479 fetch_fsmap finished waiting for FSMap version 62 2024-08-31T04:34:29.237 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:29.231+0000 7fbb397f2740 10 client.16479 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T04:34:29.237 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:29.231+0000 7fbb397f2740 20 client.16479 populate_metadata read hostname 'smithi050' 2024-08-31T04:34:29.237 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:29.231+0000 7fbb397f2740 1 --2- 172.21.15.50:0/3605449761 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x5624803c3d80 0x5624807c1da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:34:29.237 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:29.231+0000 7fbb397f2740 4 client.16479 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T04:34:29.237 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:29.231+0000 7fbb397f2740 1 -- 172.21.15.50:0/3605449761 --> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56248071fec0 con 0x5624803c3d80 2024-08-31T04:34:29.237 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:29.231+0000 7fbb22a00640 1 --2- 172.21.15.50:0/3605449761 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x5624803c3d80 0x5624807c1da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:34:29.237 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:29.232+0000 7fbb22a00640 1 --2- 172.21.15.50:0/3605449761 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x5624803c3d80 0x5624807c1da0 crc :-1 s=READY pgs=148 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ad6d478c0d36118d server_cookie=5301c854e808c350 in_seq=0 out_seq=0 2024-08-31T04:34:29.237 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:29.232+0000 7fbb19600640 10 client.16479 ms_handle_connect on v2:172.21.15.133:6838/2526402262 2024-08-31T04:34:29.238 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:29.233+0000 7fbb19600640 1 -- 172.21.15.50:0/3605449761 <== mds.0 v2:172.21.15.133:6838/2526402262 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56248071fec0 con 0x5624803c3d80 2024-08-31T04:34:29.239 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:29.233+0000 7fbb19600640 10 client.16479 handle_command_reply: tid=0 2024-08-31T04:34:29.239 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:29.233+0000 7fbb397f2740 1 client.16479 shutdown 2024-08-31T04:34:29.239 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:29.233+0000 7fbb397f2740 1 -- 172.21.15.50:0/3605449761 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5624803dc2f0 msgr2=0x5624807b4610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:34:29.239 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:29.233+0000 7fbb397f2740 1 --2- 172.21.15.50:0/3605449761 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5624803dc2f0 0x5624807b4610 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fbb1c0c8f40 tx=0x7fbb1c0cbb60 comp rx=0 tx=0).stop 2024-08-31T04:34:29.239 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:29.233+0000 7fbb397f2740 1 -- 172.21.15.50:0/3605449761 shutdown_connections 2024-08-31T04:34:29.239 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:29.233+0000 7fbb397f2740 1 --2- 172.21.15.50:0/3605449761 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x5624803c3d80 0x5624807c1da0 crc :-1 s=READY pgs=148 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:29.239 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:29.233+0000 7fbb397f2740 1 --2- 172.21.15.50:0/3605449761 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5624804051b0 0x5624807b5840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:29.239 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:29.233+0000 7fbb397f2740 1 --2- 172.21.15.50:0/3605449761 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5624803e44d0 0x5624807b4cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:29.239 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:29.233+0000 7fbb397f2740 1 --2- 172.21.15.50:0/3605449761 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5624803dc2f0 0x5624807b4610 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:29.239 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:29.233+0000 7fbb397f2740 1 -- 172.21.15.50:0/3605449761 >> 172.21.15.50:0/3605449761 conn(0x5624803f9300 msgr2=0x5624807a4f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:34:29.239 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:29.233+0000 7fbb19600640 0 client.16479 ms_handle_reset on v2:172.21.15.133:6838/2526402262 2024-08-31T04:34:29.239 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:29.233+0000 7fbb397f2740 1 -- 172.21.15.50:0/3605449761 shutdown_connections 2024-08-31T04:34:29.239 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:29.233+0000 7fbb397f2740 1 -- 172.21.15.50:0/3605449761 wait complete. 2024-08-31T04:34:29.240 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:29.234+0000 7fbb397f2740 20 client.16479 trim_cache size 0 max 16384 2024-08-31T04:34:29.252 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:29.249+0000 7fbb397f2740 1 Processor -- start 2024-08-31T04:34:29.252 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:29.249+0000 7fbb397f2740 1 -- start start 2024-08-31T04:34:29.252 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:29.249+0000 7fbb397f2740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5624803dc2f0 0x5624807b3230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:34:29.252 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:29.249+0000 7fbb397f2740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5624803e44d0 0x5624807a7e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:34:29.252 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:29.249+0000 7fbb397f2740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5624804051b0 0x5624807af090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:34:29.252 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:29.249+0000 7fbb397f2740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fbb2c1aab00 con 0x5624804051b0 2024-08-31T04:34:29.252 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:29.249+0000 7fbb397f2740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7fbb2c1ac700 con 0x5624803e44d0 2024-08-31T04:34:29.252 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:29.249+0000 7fbb397f2740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fbb2c1ab1d0 con 0x5624803dc2f0 2024-08-31T04:34:29.252 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:29.249+0000 7fbb2be00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5624804051b0 0x5624807af090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:34:29.253 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:29.249+0000 7fbb2be00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5624804051b0 0x5624807af090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50604/0 (socket says 172.21.15.50:50604) 2024-08-31T04:34:29.253 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:29.249+0000 7fbb2be00640 1 -- 172.21.15.50:0/143806499 learned_addr learned my addr 172.21.15.50:0/143806499 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:34:29.253 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:29.249+0000 7fbb2b400640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5624803dc2f0 0x5624807b3230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:34:29.253 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:29.250+0000 7fbb22a00640 1 --2- 172.21.15.50:0/143806499 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5624803e44d0 0x5624807a7e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:34:29.253 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:29.250+0000 7fbb2b400640 1 -- 172.21.15.50:0/143806499 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5624803e44d0 msgr2=0x5624807a7e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:34:29.253 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:29.250+0000 7fbb2b400640 1 --2- 172.21.15.50:0/143806499 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5624803e44d0 0x5624807a7e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:29.253 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:29.250+0000 7fbb2b400640 1 -- 172.21.15.50:0/143806499 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5624804051b0 msgr2=0x5624807af090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:34:29.253 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:29.250+0000 7fbb2b400640 1 --2- 172.21.15.50:0/143806499 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5624804051b0 0x5624807af090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:29.253 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:29.250+0000 7fbb2b400640 1 -- 172.21.15.50:0/143806499 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5624807a0c40 con 0x5624803dc2f0 2024-08-31T04:34:29.253 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:29.250+0000 7fbb2b400640 1 --2- 172.21.15.50:0/143806499 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5624803dc2f0 0x5624807b3230 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fbb1c02a910 tx=0x7fbb1c0b32f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a75bdfa464024a5 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:34:29.253 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:29.250+0000 7fbb1be00640 1 -- 172.21.15.50:0/143806499 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb1c048070 con 0x5624803dc2f0 2024-08-31T04:34:29.254 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:29.250+0000 7fbb1be00640 1 -- 172.21.15.50:0/143806499 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbb1c0cbcd0 con 0x5624803dc2f0 2024-08-31T04:34:29.254 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:29.250+0000 7fbb1be00640 1 -- 172.21.15.50:0/143806499 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb1c102f90 con 0x5624803dc2f0 2024-08-31T04:34:29.257 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:29.251+0000 7fbb397f2740 1 -- 172.21.15.50:0/143806499 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5624803dc2f0 msgr2=0x5624807b3230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:34:29.257 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:29.251+0000 7fbb397f2740 1 --2- 172.21.15.50:0/143806499 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5624803dc2f0 0x5624807b3230 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fbb1c02a910 tx=0x7fbb1c0b32f0 comp rx=0 tx=0).stop 2024-08-31T04:34:29.257 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:29.251+0000 7fbb397f2740 1 -- 172.21.15.50:0/143806499 shutdown_connections 2024-08-31T04:34:29.257 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:29.251+0000 7fbb397f2740 1 --2- 172.21.15.50:0/143806499 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5624804051b0 0x5624807af090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:29.257 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:29.251+0000 7fbb397f2740 1 --2- 172.21.15.50:0/143806499 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5624803e44d0 0x5624807a7e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:29.257 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:29.251+0000 7fbb397f2740 1 --2- 172.21.15.50:0/143806499 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5624803dc2f0 0x5624807b3230 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:29.257 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:29.251+0000 7fbb397f2740 1 -- 172.21.15.50:0/143806499 >> 172.21.15.50:0/143806499 conn(0x5624803f9300 msgr2=0x5624807b2b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:34:29.257 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:29.251+0000 7fbb397f2740 1 -- 172.21.15.50:0/143806499 shutdown_connections 2024-08-31T04:34:29.257 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:29.251+0000 7fbb397f2740 1 -- 172.21.15.50:0/143806499 wait complete. 2024-08-31T04:34:29.257 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:29.251+0000 7fbb397f2740 1 -- start start 2024-08-31T04:34:29.257 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:29.252+0000 7fbb397f2740 1 Processor -- start 2024-08-31T04:34:29.258 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:29.252+0000 7fbb397f2740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5624803dc2f0 0x5624807bb240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:34:29.258 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:29.252+0000 7fbb397f2740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5624803e44d0 0x5624807bb780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:34:29.258 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:29.252+0000 7fbb397f2740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5624804051b0 0x5624807b9e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:34:29.258 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:29.252+0000 7fbb397f2740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fbb2c1ac030 con 0x5624804051b0 2024-08-31T04:34:29.258 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:29.252+0000 7fbb397f2740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7fbb2c1ab960 con 0x5624803e44d0 2024-08-31T04:34:29.258 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:29.252+0000 7fbb397f2740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fbb2c1a8ae0 con 0x5624803dc2f0 2024-08-31T04:34:29.258 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:29.252+0000 7fbb397f2740 10 client.0 _ll_register_callbacks cb 0x7fbb1c0095f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:34:29.258 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:29.252+0000 7fbb22a00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5624803e44d0 0x5624807bb780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:34:29.258 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:29.252+0000 7fbb2b400640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5624803dc2f0 0x5624807bb240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:34:29.258 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:29.252+0000 7fbb2be00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5624804051b0 0x5624807b9e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:34:29.258 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:29.252+0000 7fbb22a00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5624803e44d0 0x5624807bb780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.50:54206/0 (socket says 172.21.15.50:54206) 2024-08-31T04:34:29.258 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:29.252+0000 7fbb22a00640 1 -- 172.21.15.50:0/3075540639 learned_addr learned my addr 172.21.15.50:0/3075540639 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:34:29.258 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:29.253+0000 7fbb2b400640 1 -- 172.21.15.50:0/3075540639 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5624803e44d0 msgr2=0x5624807bb780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:34:29.259 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:29.253+0000 7fbb2b400640 1 --2- 172.21.15.50:0/3075540639 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5624803e44d0 0x5624807bb780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:29.259 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:29.253+0000 7fbb2b400640 1 -- 172.21.15.50:0/3075540639 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5624804051b0 msgr2=0x5624807b9e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:34:29.259 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:29.253+0000 7fbb2b400640 1 --2- 172.21.15.50:0/3075540639 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5624804051b0 0x5624807b9e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:29.259 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:29.253+0000 7fbb2b400640 1 -- 172.21.15.50:0/3075540639 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5624807bc070 con 0x5624803dc2f0 2024-08-31T04:34:29.259 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:29.253+0000 7fbb2b400640 1 --2- 172.21.15.50:0/3075540639 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5624803dc2f0 0x5624807bb240 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fbb1c031440 tx=0x7fbb1c0d0540 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ac22ec27a0f337ad server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:34:29.259 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:29.253+0000 7fbb19600640 10 client.0 ms_handle_connect on v2:172.21.15.177:3300/0 2024-08-31T04:34:29.259 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:29.253+0000 7fbb19600640 1 -- 172.21.15.50:0/3075540639 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb1c048070 con 0x5624803dc2f0 2024-08-31T04:34:29.259 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:29.253+0000 7fbb19600640 1 -- 172.21.15.50:0/3075540639 <== mon.1 v2:172.21.15.177:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8219+0+0 (secure 0 0 0) 0x7fbb1c0d4d70 con 0x5624803dc2f0 2024-08-31T04:34:29.259 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:29.253+0000 7fbb397f2740 1 -- 172.21.15.50:0/3075540639 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbb1c0cbcd0 con 0x5624803dc2f0 2024-08-31T04:34:29.259 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:29.253+0000 7fbb19600640 1 -- 172.21.15.50:0/3075540639 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_get_version_reply(handle=1 version=62) ==== 24+0+0 (secure 0 0 0) 0x7fbb1c0d4ff0 con 0x5624803dc2f0 2024-08-31T04:34:29.259 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:29.254+0000 7fbb397f2740 10 client.26434 fetch_fsmap learned FSMap version 62 2024-08-31T04:34:29.259 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:29.254+0000 7fbb397f2740 1 -- 172.21.15.50:0/3075540639 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,fsmap=62,monmap=4+}) -- 0x56248082cce0 con 0x5624803dc2f0 2024-08-31T04:34:29.259 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:29.254+0000 7fbb19600640 1 -- 172.21.15.50:0/3075540639 <== mon.1 v2:172.21.15.177:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbb1c0cbcd0 con 0x5624803dc2f0 2024-08-31T04:34:29.260 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:29.254+0000 7fbb19600640 1 -- 172.21.15.50:0/3075540639 <== mon.1 v2:172.21.15.177:3300/0 5 ==== fsmap(e 62) ==== 8378+0+0 (secure 0 0 0) 0x7fbb1c0b1b10 con 0x5624803dc2f0 2024-08-31T04:34:29.260 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:29.254+0000 7fbb397f2740 10 client.26434 fetch_fsmap finished waiting for FSMap version 62 2024-08-31T04:34:29.260 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:29.254+0000 7fbb397f2740 10 client.26434 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T04:34:29.260 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:29.254+0000 7fbb397f2740 20 client.26434 populate_metadata read hostname 'smithi050' 2024-08-31T04:34:29.260 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:29.254+0000 7fbb397f2740 1 --2- 172.21.15.50:0/3075540639 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x5624803991c0 0x56248082f550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:34:29.260 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:29.254+0000 7fbb397f2740 4 client.26434 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-31T04:34:29.260 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:29.254+0000 7fbb397f2740 1 -- 172.21.15.50:0/3075540639 --> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] -- command(tid 0: {"prefix": "flush journal"}) -- 0x56248071b960 con 0x5624803991c0 2024-08-31T04:34:29.260 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:29.254+0000 7fbb22a00640 1 --2- 172.21.15.50:0/3075540639 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x5624803991c0 0x56248082f550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:34:29.260 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:29.255+0000 7fbb22a00640 1 --2- 172.21.15.50:0/3075540639 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x5624803991c0 0x56248082f550 crc :-1 s=READY pgs=149 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=55e32f5014e2fbd2 server_cookie=be3bfb7a2f09313c in_seq=0 out_seq=0 2024-08-31T04:34:29.260 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:29.255+0000 7fbb19600640 10 client.26434 ms_handle_connect on v2:172.21.15.133:6838/2526402262 2024-08-31T04:34:29.283 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:29.281+0000 7fbb19600640 1 -- 172.21.15.50:0/3075540639 <== mds.0 v2:172.21.15.133:6838/2526402262 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x56248071b960 con 0x5624803991c0 2024-08-31T04:34:29.284 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:29.281+0000 7fbb19600640 10 client.26434 handle_command_reply: tid=0 2024-08-31T04:34:29.284 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:29.281+0000 7fbb397f2740 1 client.26434 shutdown 2024-08-31T04:34:29.284 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:29.282+0000 7fbb397f2740 1 -- 172.21.15.50:0/3075540639 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5624803dc2f0 msgr2=0x5624807bb240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:34:29.284 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:29.282+0000 7fbb397f2740 1 --2- 172.21.15.50:0/3075540639 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5624803dc2f0 0x5624807bb240 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fbb1c031440 tx=0x7fbb1c0d0540 comp rx=0 tx=0).stop 2024-08-31T04:34:29.284 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:29.282+0000 7fbb397f2740 1 -- 172.21.15.50:0/3075540639 shutdown_connections 2024-08-31T04:34:29.284 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:29.282+0000 7fbb397f2740 1 --2- 172.21.15.50:0/3075540639 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x5624803991c0 0x56248082f550 crc :-1 s=READY pgs=149 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:29.284 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:29.282+0000 7fbb397f2740 1 --2- 172.21.15.50:0/3075540639 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5624804051b0 0x5624807b9e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:29.284 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:29.282+0000 7fbb397f2740 1 --2- 172.21.15.50:0/3075540639 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5624803e44d0 0x5624807bb780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:29.284 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:29.282+0000 7fbb397f2740 1 --2- 172.21.15.50:0/3075540639 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5624803dc2f0 0x5624807bb240 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:29.284 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:29.282+0000 7fbb19600640 0 client.26434 ms_handle_reset on v2:172.21.15.133:6838/2526402262 2024-08-31T04:34:29.284 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:29.282+0000 7fbb397f2740 1 -- 172.21.15.50:0/3075540639 >> 172.21.15.50:0/3075540639 conn(0x5624803f9300 msgr2=0x5624807b26e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:34:29.285 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:29.282+0000 7fbb397f2740 1 -- 172.21.15.50:0/3075540639 shutdown_connections 2024-08-31T04:34:29.285 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:29.282+0000 7fbb397f2740 1 -- 172.21.15.50:0/3075540639 wait complete. 2024-08-31T04:34:29.285 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:29.282+0000 7fbb397f2740 20 client.26434 trim_cache size 0 max 16384 2024-08-31T04:34:29.285 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout:{ 2024-08-31T04:34:29.285 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout: "message": "", 2024-08-31T04:34:29.285 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout: "return_code": 0 2024-08-31T04:34:29.285 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout:} 2024-08-31T04:34:29.286 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:29.283+0000 7fbb31200640 1 -- 172.21.15.50:0/2314656867 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fbb100b4b30 msgr2=0x7fbb100b7040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:34:29.286 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:29.283+0000 7fbb31200640 1 --2- 172.21.15.50:0/2314656867 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fbb100b4b30 0x7fbb100b7040 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fbb24005fd0 tx=0x7fbb24009500 comp rx=0 tx=0).stop 2024-08-31T04:34:29.286 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:29.283+0000 7fbb31200640 1 -- 172.21.15.50:0/2314656867 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbb2c103280 msgr2=0x7fbb2c199ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:34:29.286 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:29.283+0000 7fbb31200640 1 --2- 172.21.15.50:0/2314656867 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbb2c103280 0x7fbb2c199ba0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7fbb1c006010 tx=0x7fbb1c004270 comp rx=0 tx=0).stop 2024-08-31T04:34:29.286 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:29.283+0000 7fbb31200640 1 -- 172.21.15.50:0/2314656867 shutdown_connections 2024-08-31T04:34:29.286 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:29.283+0000 7fbb31200640 1 --2- 172.21.15.50:0/2314656867 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fbb100b4b30 0x7fbb100b7040 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:29.286 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:29.283+0000 7fbb31200640 1 --2- 172.21.15.50:0/2314656867 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbb2c104300 0x7fbb2c19a210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:29.286 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:29.283+0000 7fbb31200640 1 --2- 172.21.15.50:0/2314656867 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbb2c104ca0 0x7fbb2c19ad50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:29.287 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:29.283+0000 7fbb31200640 1 --2- 172.21.15.50:0/2314656867 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbb2c103280 0x7fbb2c199ba0 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:29.287 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:29.283+0000 7fbb31200640 1 -- 172.21.15.50:0/2314656867 >> 172.21.15.50:0/2314656867 conn(0x7fbb2c0febc0 msgr2=0x7fbb2c107620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:34:29.287 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:29.283+0000 7fbb31200640 1 -- 172.21.15.50:0/2314656867 shutdown_connections 2024-08-31T04:34:29.287 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:29.283+0000 7fbb31200640 1 -- 172.21.15.50:0/2314656867 wait complete. 2024-08-31T04:34:29.950 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:34:29 smithi050 ceph-mon[17259]: pgmap v716: 97 pgs: 97 active+clean; 1.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 MiB/s rd, 1.8 MiB/s wr, 485 op/s 2024-08-31T04:34:29.950 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:34:29 smithi050 ceph-mon[17259]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2024-08-31T04:34:29.996 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:34:29 smithi177 ceph-mon[22025]: pgmap v716: 97 pgs: 97 active+clean; 1.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 MiB/s rd, 1.8 MiB/s wr, 485 op/s 2024-08-31T04:34:29.996 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:34:29 smithi177 ceph-mon[22025]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2024-08-31T04:34:30.043 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:34:29 smithi133 ceph-mon[22177]: pgmap v716: 97 pgs: 97 active+clean; 1.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 MiB/s rd, 1.8 MiB/s wr, 485 op/s 2024-08-31T04:34:30.043 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:34:29 smithi133 ceph-mon[22177]: MDS health message cleared (mds.?): 1 slow requests are blocked > 180 secs 2024-08-31T04:34:30.950 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:34:30 smithi050 ceph-mon[17259]: Health check cleared: MDS_SLOW_REQUEST (was: 1 MDSs report slow requests) 2024-08-31T04:34:30.950 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:34:30 smithi050 ceph-mon[17259]: Cluster is now healthy 2024-08-31T04:34:30.950 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:34:30 smithi050 ceph-mon[17259]: mds.? [v2:172.21.15.177:6836/2159859285,v1:172.21.15.177:6837/2159859285] up:active 2024-08-31T04:34:30.951 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:34:30 smithi050 ceph-mon[17259]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-31T04:34:30.996 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:34:30 smithi177 ceph-mon[22025]: Health check cleared: MDS_SLOW_REQUEST (was: 1 MDSs report slow requests) 2024-08-31T04:34:30.996 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:34:30 smithi177 ceph-mon[22025]: Cluster is now healthy 2024-08-31T04:34:30.996 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:34:30 smithi177 ceph-mon[22025]: mds.? [v2:172.21.15.177:6836/2159859285,v1:172.21.15.177:6837/2159859285] up:active 2024-08-31T04:34:30.996 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:34:30 smithi177 ceph-mon[22025]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-31T04:34:31.043 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:34:30 smithi133 ceph-mon[22177]: Health check cleared: MDS_SLOW_REQUEST (was: 1 MDSs report slow requests) 2024-08-31T04:34:31.043 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:34:30 smithi133 ceph-mon[22177]: Cluster is now healthy 2024-08-31T04:34:31.043 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:34:30 smithi133 ceph-mon[22177]: mds.? [v2:172.21.15.177:6836/2159859285,v1:172.21.15.177:6837/2159859285] up:active 2024-08-31T04:34:31.043 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:34:30 smithi133 ceph-mon[22177]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-31T04:34:31.950 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:34:31 smithi050 ceph-mon[17259]: pgmap v717: 97 pgs: 97 active+clean; 1.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 MiB/s rd, 1.9 MiB/s wr, 464 op/s 2024-08-31T04:34:31.996 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:34:31 smithi177 ceph-mon[22025]: pgmap v717: 97 pgs: 97 active+clean; 1.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 MiB/s rd, 1.9 MiB/s wr, 464 op/s 2024-08-31T04:34:32.043 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:34:31 smithi133 ceph-mon[22177]: pgmap v717: 97 pgs: 97 active+clean; 1.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 MiB/s rd, 1.9 MiB/s wr, 464 op/s 2024-08-31T04:34:33.950 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:34:33 smithi050 ceph-mon[17259]: pgmap v718: 97 pgs: 97 active+clean; 1.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 MiB/s rd, 1.3 MiB/s wr, 427 op/s 2024-08-31T04:34:33.996 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:34:33 smithi177 ceph-mon[22025]: pgmap v718: 97 pgs: 97 active+clean; 1.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 MiB/s rd, 1.3 MiB/s wr, 427 op/s 2024-08-31T04:34:34.043 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:34:33 smithi133 ceph-mon[22177]: pgmap v718: 97 pgs: 97 active+clean; 1.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 MiB/s rd, 1.3 MiB/s wr, 427 op/s 2024-08-31T04:34:35.950 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:34:35 smithi050 ceph-mon[17259]: pgmap v719: 97 pgs: 97 active+clean; 1.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 MiB/s rd, 770 KiB/s wr, 325 op/s 2024-08-31T04:34:35.996 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:34:35 smithi177 ceph-mon[22025]: pgmap v719: 97 pgs: 97 active+clean; 1.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 MiB/s rd, 770 KiB/s wr, 325 op/s 2024-08-31T04:34:36.043 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:34:35 smithi133 ceph-mon[22177]: pgmap v719: 97 pgs: 97 active+clean; 1.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 MiB/s rd, 770 KiB/s wr, 325 op/s 2024-08-31T04:34:37.950 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:34:37 smithi050 ceph-mon[17259]: pgmap v720: 97 pgs: 97 active+clean; 1.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 794 KiB/s wr, 259 op/s 2024-08-31T04:34:37.996 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:34:37 smithi177 ceph-mon[22025]: pgmap v720: 97 pgs: 97 active+clean; 1.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 794 KiB/s wr, 259 op/s 2024-08-31T04:34:38.043 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:34:37 smithi133 ceph-mon[22177]: pgmap v720: 97 pgs: 97 active+clean; 1.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 794 KiB/s wr, 259 op/s 2024-08-31T04:34:39.950 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:34:39 smithi050 ceph-mon[17259]: pgmap v721: 97 pgs: 97 active+clean; 1.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 233 KiB/s wr, 102 op/s 2024-08-31T04:34:39.996 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:34:39 smithi177 ceph-mon[22025]: pgmap v721: 97 pgs: 97 active+clean; 1.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 233 KiB/s wr, 102 op/s 2024-08-31T04:34:40.043 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:34:39 smithi133 ceph-mon[22177]: pgmap v721: 97 pgs: 97 active+clean; 1.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 233 KiB/s wr, 102 op/s 2024-08-31T04:34:41.950 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:34:41 smithi050 ceph-mon[17259]: pgmap v722: 97 pgs: 97 active+clean; 1.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 381 KiB/s rd, 138 KiB/s wr, 52 op/s 2024-08-31T04:34:41.950 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:34:41 smithi050 ceph-mon[17259]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-31T04:34:41.996 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:34:41 smithi177 ceph-mon[22025]: pgmap v722: 97 pgs: 97 active+clean; 1.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 381 KiB/s rd, 138 KiB/s wr, 52 op/s 2024-08-31T04:34:41.996 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:34:41 smithi177 ceph-mon[22025]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-31T04:34:42.043 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:34:41 smithi133 ceph-mon[22177]: pgmap v722: 97 pgs: 97 active+clean; 1.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 381 KiB/s rd, 138 KiB/s wr, 52 op/s 2024-08-31T04:34:42.043 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:34:41 smithi133 ceph-mon[22177]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-31T04:34:42.484 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:42.482+0000 7f7eaf200640 1 -- 172.21.15.50:0/2527659342 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7eb010b290 msgr2=0x7f7eb010d6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:34:42.484 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:42.482+0000 7f7eaf200640 1 --2- 172.21.15.50:0/2527659342 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7eb010b290 0x7f7eb010d6d0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f7ea8009be0 tx=0x7f7ea802a6c0 comp rx=0 tx=0).stop 2024-08-31T04:34:42.485 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:42.483+0000 7f7eaf200640 1 -- 172.21.15.50:0/2527659342 shutdown_connections 2024-08-31T04:34:42.485 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:42.483+0000 7f7eaf200640 1 --2- 172.21.15.50:0/2527659342 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7eb010b290 0x7f7eb010d6d0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:42.485 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:42.483+0000 7f7eaf200640 1 --2- 172.21.15.50:0/2527659342 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7eb0075a10 0x7f7eb0075e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:42.485 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:42.483+0000 7f7eaf200640 1 --2- 172.21.15.50:0/2527659342 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7eb0076e10 0x7f7eb00754d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:42.485 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:42.483+0000 7f7eaf200640 1 -- 172.21.15.50:0/2527659342 >> 172.21.15.50:0/2527659342 conn(0x7f7eb00febc0 msgr2=0x7f7eb0101070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:34:42.485 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:42.483+0000 7f7eaf200640 1 -- 172.21.15.50:0/2527659342 shutdown_connections 2024-08-31T04:34:42.485 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:42.483+0000 7f7eaf200640 1 -- 172.21.15.50:0/2527659342 wait complete. 2024-08-31T04:34:42.487 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:42.484+0000 7f7eaf200640 1 Processor -- start 2024-08-31T04:34:42.487 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:42.484+0000 7f7eaf200640 1 -- start start 2024-08-31T04:34:42.487 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:42.484+0000 7f7eaf200640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7eb0075a10 0x7f7eb019bcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:34:42.487 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:42.484+0000 7f7eaf200640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7eb0076e10 0x7f7eb019c360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:34:42.487 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:42.484+0000 7f7eaf200640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7eb010b290 0x7f7eb019cf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:34:42.487 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:42.484+0000 7f7eaf200640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f7eb01110e0 con 0x7f7eb010b290 2024-08-31T04:34:42.487 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:42.484+0000 7f7eaf200640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f7eb0110f60 con 0x7f7eb0075a10 2024-08-31T04:34:42.487 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:42.484+0000 7f7eaf200640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f7eb0111260 con 0x7f7eb0076e10 2024-08-31T04:34:42.488 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:42.485+0000 7f7eae800640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7eb010b290 0x7f7eb019cf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:34:42.488 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:42.485+0000 7f7ea5400640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7eb0076e10 0x7f7eb019c360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:34:42.488 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:42.485+0000 7f7eae800640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7eb010b290 0x7f7eb019cf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:57126/0 (socket says 172.21.15.50:57126) 2024-08-31T04:34:42.488 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:42.485+0000 7f7eae800640 1 -- 172.21.15.50:0/380353400 learned_addr learned my addr 172.21.15.50:0/380353400 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:34:42.488 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:42.485+0000 7f7eade00640 1 --2- 172.21.15.50:0/380353400 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7eb0075a10 0x7f7eb019bcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:34:42.488 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:42.485+0000 7f7ea5400640 1 -- 172.21.15.50:0/380353400 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7eb0075a10 msgr2=0x7f7eb019bcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:34:42.488 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:42.485+0000 7f7ea5400640 1 --2- 172.21.15.50:0/380353400 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7eb0075a10 0x7f7eb019bcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:42.488 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:42.485+0000 7f7ea5400640 1 -- 172.21.15.50:0/380353400 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7eb010b290 msgr2=0x7f7eb019cf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:34:42.489 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:42.485+0000 7f7ea5400640 1 --2- 172.21.15.50:0/380353400 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7eb010b290 0x7f7eb019cf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:42.489 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:42.485+0000 7f7ea5400640 1 -- 172.21.15.50:0/380353400 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7eb019d730 con 0x7f7eb0076e10 2024-08-31T04:34:42.489 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:42.485+0000 7f7ea5400640 1 --2- 172.21.15.50:0/380353400 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7eb0076e10 0x7f7eb019c360 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f7e9800e9f0 tx=0x7f7e9800eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:34:42.489 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:42.485+0000 7f7ea7400640 1 -- 172.21.15.50:0/380353400 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e9800cd80 con 0x7f7eb0076e10 2024-08-31T04:34:42.489 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:42.486+0000 7f7ea7400640 1 -- 172.21.15.50:0/380353400 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7e980035f0 con 0x7f7eb0076e10 2024-08-31T04:34:42.489 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:42.486+0000 7f7eaf200640 1 -- 172.21.15.50:0/380353400 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7eb019da20 con 0x7f7eb0076e10 2024-08-31T04:34:42.489 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:42.486+0000 7f7ea7400640 1 -- 172.21.15.50:0/380353400 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e98010670 con 0x7f7eb0076e10 2024-08-31T04:34:42.489 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:42.486+0000 7f7eaf200640 1 -- 172.21.15.50:0/380353400 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7eb01a4110 con 0x7f7eb0076e10 2024-08-31T04:34:42.490 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:42.489+0000 7f7ebc211740 1 Processor -- start 2024-08-31T04:34:42.490 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:42.489+0000 7f7ebc211740 1 -- start start 2024-08-31T04:34:42.492 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:42.489+0000 7f7ebc211740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55e42b2ef1b0 0x55e42b694d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:34:42.492 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:42.489+0000 7f7ebc211740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e42b2c62f0 0x55e42b6953b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:34:42.492 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:42.489+0000 7f7ebc211740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e42b2ce4d0 0x55e42b695f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:34:42.492 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:42.489+0000 7f7ebc211740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55e42b607f70 con 0x55e42b2ce4d0 2024-08-31T04:34:42.492 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:42.489+0000 7f7ebc211740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x55e42b5f7500 con 0x55e42b2ef1b0 2024-08-31T04:34:42.492 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:42.489+0000 7f7ebc211740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x55e42b5fb4b0 con 0x55e42b2c62f0 2024-08-31T04:34:42.492 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:42.490+0000 7f7ea7400640 1 -- 172.21.15.50:0/380353400 <== mon.1 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 18) ==== 152577+0+0 (secure 0 0 0) 0x7f7e980037a0 con 0x7f7eb0076e10 2024-08-31T04:34:42.492 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:42.490+0000 7f7eade00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e42b2c62f0 0x55e42b6953b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:34:42.492 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:42.490+0000 7f7eae800640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55e42b2ef1b0 0x55e42b694d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:34:42.492 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:42.490+0000 7f7ea5400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e42b2ce4d0 0x55e42b695f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:34:42.492 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:42.490+0000 7f7eade00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e42b2c62f0 0x55e42b6953b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.50:51332/0 (socket says 172.21.15.50:51332) 2024-08-31T04:34:42.493 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:42.490+0000 7f7eade00640 1 -- 172.21.15.50:0/1959368167 learned_addr learned my addr 172.21.15.50:0/1959368167 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:34:42.493 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:42.490+0000 7f7eae800640 1 -- 172.21.15.50:0/1959368167 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e42b2c62f0 msgr2=0x55e42b6953b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:34:42.493 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:42.490+0000 7f7eae800640 1 --2- 172.21.15.50:0/1959368167 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e42b2c62f0 0x55e42b6953b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:42.493 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:42.490+0000 7f7eae800640 1 -- 172.21.15.50:0/1959368167 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e42b2ce4d0 msgr2=0x55e42b695f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:34:42.493 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:42.490+0000 7f7eae800640 1 --2- 172.21.15.50:0/1959368167 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e42b2ce4d0 0x55e42b695f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:42.493 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:42.490+0000 7f7eae800640 1 -- 172.21.15.50:0/1959368167 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e42b5b1c10 con 0x55e42b2ef1b0 2024-08-31T04:34:42.493 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:42.491+0000 7f7eae800640 1 --2- 172.21.15.50:0/1959368167 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55e42b2ef1b0 0x55e42b694d40 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f7ea8004af0 tx=0x7f7ea80093a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d05fbee53a5fc36c server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:34:42.498 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:42.491+0000 7f7e9f400640 1 -- 172.21.15.50:0/1959368167 <== mon.2 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ea8041030 con 0x55e42b2ef1b0 2024-08-31T04:34:42.498 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:42.491+0000 7f7e9f400640 1 -- 172.21.15.50:0/1959368167 <== mon.2 v2:172.21.15.133:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7ea80305e0 con 0x55e42b2ef1b0 2024-08-31T04:34:42.498 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:42.491+0000 7f7e9f400640 1 -- 172.21.15.50:0/1959368167 <== mon.2 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ea8036040 con 0x55e42b2ef1b0 2024-08-31T04:34:42.498 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:42.491+0000 7f7ea7400640 1 --2- 172.21.15.50:0/380353400 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f7e940b4bb0 0x7f7e940b70c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:34:42.498 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:42.491+0000 7f7ea7400640 1 -- 172.21.15.50:0/380353400 <== mon.1 v2:172.21.15.177:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8219+0+0 (secure 0 0 0) 0x7f7e980e5380 con 0x7f7eb0076e10 2024-08-31T04:34:42.498 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:42.492+0000 7f7eade00640 1 --2- 172.21.15.50:0/380353400 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f7e940b4bb0 0x7f7e940b70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:34:42.498 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:42.492+0000 7f7ebc211740 1 -- 172.21.15.50:0/1959368167 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55e42b2ef1b0 msgr2=0x55e42b694d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:34:42.498 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:42.492+0000 7f7ebc211740 1 --2- 172.21.15.50:0/1959368167 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55e42b2ef1b0 0x55e42b694d40 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f7ea8004af0 tx=0x7f7ea80093a0 comp rx=0 tx=0).stop 2024-08-31T04:34:42.498 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:42.492+0000 7f7ebc211740 1 -- 172.21.15.50:0/1959368167 shutdown_connections 2024-08-31T04:34:42.498 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:42.492+0000 7f7ebc211740 1 --2- 172.21.15.50:0/1959368167 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e42b2c62f0 0x55e42b6953b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:42.498 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:42.492+0000 7f7ebc211740 1 --2- 172.21.15.50:0/1959368167 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e42b2ce4d0 0x55e42b695f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:42.499 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:42.492+0000 7f7ebc211740 1 --2- 172.21.15.50:0/1959368167 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55e42b2ef1b0 0x55e42b694d40 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:42.499 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:42.492+0000 7f7ebc211740 1 -- 172.21.15.50:0/1959368167 >> 172.21.15.50:0/1959368167 conn(0x55e42b2e3300 msgr2=0x55e42b6907d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:34:42.499 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:42.492+0000 7f7ebc211740 1 -- 172.21.15.50:0/1959368167 shutdown_connections 2024-08-31T04:34:42.499 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:42.492+0000 7f7ebc211740 1 -- 172.21.15.50:0/1959368167 wait complete. 2024-08-31T04:34:42.499 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:42.492+0000 7f7eade00640 1 --2- 172.21.15.50:0/380353400 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f7e940b4bb0 0x7f7e940b70c0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f7ea0009f20 tx=0x7f7ea0009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:34:42.499 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:42.493+0000 7f7ebc211740 1 -- start start 2024-08-31T04:34:42.499 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:42.493+0000 7f7ebc211740 1 Processor -- start 2024-08-31T04:34:42.499 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:42.493+0000 7f7ebc211740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55e42b2c62f0 0x55e42b69e2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:34:42.499 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:42.493+0000 7f7ebc211740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e42b2ce4d0 0x55e42b69e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:34:42.499 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:42.493+0000 7f7ebc211740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e42b2ef1b0 0x55e42b69f510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:34:42.499 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:42.493+0000 7f7ebc211740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55e42b530ab0 con 0x55e42b2ce4d0 2024-08-31T04:34:42.500 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:42.493+0000 7f7ebc211740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x55e42b59e320 con 0x55e42b2c62f0 2024-08-31T04:34:42.500 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:42.493+0000 7f7ebc211740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x55e42b6969c0 con 0x55e42b2ef1b0 2024-08-31T04:34:42.500 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:42.493+0000 7f7ebc211740 10 client.0 _ll_register_callbacks cb 0x55e42b5d7e80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:34:42.500 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:42.494+0000 7f7ea5400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e42b2ce4d0 0x55e42b69e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:34:42.500 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:42.494+0000 7f7eade00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55e42b2c62f0 0x55e42b69e2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:34:42.500 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:42.494+0000 7f7ea5400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e42b2ce4d0 0x55e42b69e9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:57134/0 (socket says 172.21.15.50:57134) 2024-08-31T04:34:42.500 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:42.494+0000 7f7eade00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55e42b2c62f0 0x55e42b69e2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.50:58954/0 (socket says 172.21.15.50:58954) 2024-08-31T04:34:42.500 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:42.494+0000 7f7ea5400640 1 -- 172.21.15.50:0/1746050513 learned_addr learned my addr 172.21.15.50:0/1746050513 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:34:42.500 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:42.494+0000 7f7eae800640 1 --2- 172.21.15.50:0/1746050513 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e42b2ef1b0 0x55e42b69f510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:34:42.500 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:42.494+0000 7f7ea5400640 1 -- 172.21.15.50:0/1746050513 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e42b2ef1b0 msgr2=0x55e42b69f510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:34:42.501 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:42.494+0000 7f7ea5400640 1 --2- 172.21.15.50:0/1746050513 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e42b2ef1b0 0x55e42b69f510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:42.501 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:42.494+0000 7f7ea5400640 1 -- 172.21.15.50:0/1746050513 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55e42b2c62f0 msgr2=0x55e42b69e2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:34:42.501 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:42.494+0000 7f7ea5400640 1 --2- 172.21.15.50:0/1746050513 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55e42b2c62f0 0x55e42b69e2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:42.501 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:42.494+0000 7f7ea5400640 1 -- 172.21.15.50:0/1746050513 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e42b35a790 con 0x55e42b2ce4d0 2024-08-31T04:34:42.501 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:42.494+0000 7f7eade00640 1 --2- 172.21.15.50:0/1746050513 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55e42b2c62f0 0x55e42b69e2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:34:42.501 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:42.494+0000 7f7ea5400640 1 --2- 172.21.15.50:0/1746050513 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e42b2ce4d0 0x55e42b69e9a0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f7e980a7de0 tx=0x7f7e980a7d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=787b586871e6cb89 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:34:42.501 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:42.494+0000 7f7e93e00640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-08-31T04:34:42.501 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:42.494+0000 7f7e93e00640 1 -- 172.21.15.50:0/1746050513 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e980ab870 con 0x55e42b2ce4d0 2024-08-31T04:34:42.502 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:42.495+0000 7f7ebc211740 1 -- 172.21.15.50:0/1746050513 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7ea80305e0 con 0x55e42b2ce4d0 2024-08-31T04:34:42.502 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:42.495+0000 7f7e93e00640 1 -- 172.21.15.50:0/1746050513 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8219+0+0 (secure 0 0 0) 0x7f7e98009310 con 0x55e42b2ce4d0 2024-08-31T04:34:42.502 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:42.495+0000 7f7e93e00640 1 -- 172.21.15.50:0/1746050513 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=64) ==== 24+0+0 (secure 0 0 0) 0x7f7e980ac460 con 0x55e42b2ce4d0 2024-08-31T04:34:42.502 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:42.495+0000 7f7ebc211740 10 client.16497 fetch_fsmap learned FSMap version 64 2024-08-31T04:34:42.502 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:42.495+0000 7f7ebc211740 1 -- 172.21.15.50:0/1746050513 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=64,monmap=4+}) -- 0x55e42b3d3620 con 0x55e42b2ce4d0 2024-08-31T04:34:42.502 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:42.495+0000 7f7e93e00640 1 -- 172.21.15.50:0/1746050513 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7ea80305e0 con 0x55e42b2ce4d0 2024-08-31T04:34:42.502 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:42.495+0000 7f7e93e00640 1 -- 172.21.15.50:0/1746050513 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 64) ==== 8382+0+0 (secure 0 0 0) 0x7f7e980e4030 con 0x55e42b2ce4d0 2024-08-31T04:34:42.502 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:42.495+0000 7f7ebc211740 10 client.16497 fetch_fsmap finished waiting for FSMap version 64 2024-08-31T04:34:42.502 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:42.495+0000 7f7ebc211740 10 client.16497 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T04:34:42.502 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:42.495+0000 7f7ebc211740 20 client.16497 populate_metadata read hostname 'smithi050' 2024-08-31T04:34:42.502 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:42.495+0000 7f7ebc211740 1 --2- 172.21.15.50:0/1746050513 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x55e42b2add80 0x55e42b6aba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:34:42.502 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:42.495+0000 7f7ebc211740 4 client.16497 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T04:34:42.502 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:42.495+0000 7f7ebc211740 1 -- 172.21.15.50:0/1746050513 --> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e42b609ec0 con 0x55e42b2add80 2024-08-31T04:34:42.503 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:42.496+0000 7f7eade00640 1 --2- 172.21.15.50:0/1746050513 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x55e42b2add80 0x55e42b6aba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:34:42.503 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:42.496+0000 7f7eade00640 1 --2- 172.21.15.50:0/1746050513 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x55e42b2add80 0x55e42b6aba30 crc :-1 s=READY pgs=150 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ca1b157347d16c0a server_cookie=d4fca37858b1554b in_seq=0 out_seq=0 2024-08-31T04:34:42.503 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:42.496+0000 7f7e93e00640 10 client.16497 ms_handle_connect on v2:172.21.15.133:6838/2526402262 2024-08-31T04:34:42.504 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:42.497+0000 7f7e93e00640 1 -- 172.21.15.50:0/1746050513 <== mds.0 v2:172.21.15.133:6838/2526402262 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55e42b609ec0 con 0x55e42b2add80 2024-08-31T04:34:42.504 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:42.497+0000 7f7e93e00640 10 client.16497 handle_command_reply: tid=0 2024-08-31T04:34:42.504 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:42.497+0000 7f7ebc211740 1 client.16497 shutdown 2024-08-31T04:34:42.504 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:42.497+0000 7f7ebc211740 1 -- 172.21.15.50:0/1746050513 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e42b2ce4d0 msgr2=0x55e42b69e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:34:42.504 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:42.497+0000 7f7ebc211740 1 --2- 172.21.15.50:0/1746050513 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e42b2ce4d0 0x55e42b69e9a0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f7e980a7de0 tx=0x7f7e980a7d10 comp rx=0 tx=0).stop 2024-08-31T04:34:42.504 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:42.498+0000 7f7ebc211740 1 -- 172.21.15.50:0/1746050513 shutdown_connections 2024-08-31T04:34:42.504 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:42.498+0000 7f7ebc211740 1 --2- 172.21.15.50:0/1746050513 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x55e42b2add80 0x55e42b6aba30 crc :-1 s=READY pgs=150 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:42.505 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:42.498+0000 7f7ebc211740 1 --2- 172.21.15.50:0/1746050513 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e42b2ef1b0 0x55e42b69f510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:42.505 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:42.498+0000 7f7ebc211740 1 --2- 172.21.15.50:0/1746050513 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e42b2ce4d0 0x55e42b69e9a0 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:42.505 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:42.498+0000 7f7ebc211740 1 --2- 172.21.15.50:0/1746050513 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55e42b2c62f0 0x55e42b69e2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:42.505 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:42.498+0000 7f7e93e00640 0 client.16497 ms_handle_reset on v2:172.21.15.133:6838/2526402262 2024-08-31T04:34:42.505 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:42.498+0000 7f7ebc211740 1 -- 172.21.15.50:0/1746050513 >> 172.21.15.50:0/1746050513 conn(0x55e42b2e3300 msgr2=0x55e42b68ed70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:34:42.505 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:42.498+0000 7f7ebc211740 1 -- 172.21.15.50:0/1746050513 shutdown_connections 2024-08-31T04:34:42.505 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:42.498+0000 7f7ebc211740 1 -- 172.21.15.50:0/1746050513 wait complete. 2024-08-31T04:34:42.505 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:42.498+0000 7f7ebc211740 20 client.16497 trim_cache size 0 max 16384 2024-08-31T04:34:42.514 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:42.513+0000 7f7ebc211740 1 Processor -- start 2024-08-31T04:34:42.514 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:42.513+0000 7f7ebc211740 1 -- start start 2024-08-31T04:34:42.515 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:42.513+0000 7f7ebc211740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e42b2c62f0 0x55e42b690110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:34:42.516 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:42.513+0000 7f7ebc211740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55e42b2ce4d0 0x55e42b69c870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:34:42.516 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:42.513+0000 7f7ebc211740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e42b2ef1b0 0x55e42b69cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:34:42.516 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:42.513+0000 7f7ebc211740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f7eb01acca0 con 0x55e42b2c62f0 2024-08-31T04:34:42.516 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:42.513+0000 7f7ebc211740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f7eb01ae8a0 con 0x55e42b2ce4d0 2024-08-31T04:34:42.516 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:42.513+0000 7f7ebc211740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f7eb01ad370 con 0x55e42b2ef1b0 2024-08-31T04:34:42.516 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:42.514+0000 7f7eade00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e42b2c62f0 0x55e42b690110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:34:42.516 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:42.514+0000 7f7eade00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e42b2c62f0 0x55e42b690110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:57150/0 (socket says 172.21.15.50:57150) 2024-08-31T04:34:42.516 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:42.514+0000 7f7eade00640 1 -- 172.21.15.50:0/332711366 learned_addr learned my addr 172.21.15.50:0/332711366 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:34:42.516 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:42.514+0000 7f7ea5400640 1 --2- 172.21.15.50:0/332711366 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55e42b2ce4d0 0x55e42b69c870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:34:42.516 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:42.514+0000 7f7eae800640 1 --2- 172.21.15.50:0/332711366 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e42b2ef1b0 0x55e42b69cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:34:42.516 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:42.514+0000 7f7eade00640 1 -- 172.21.15.50:0/332711366 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e42b2ef1b0 msgr2=0x55e42b69cdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:34:42.517 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:42.514+0000 7f7eade00640 1 --2- 172.21.15.50:0/332711366 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e42b2ef1b0 0x55e42b69cdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:42.517 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:42.514+0000 7f7eade00640 1 -- 172.21.15.50:0/332711366 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55e42b2ce4d0 msgr2=0x55e42b69c870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:34:42.517 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:42.514+0000 7f7eade00640 1 --2- 172.21.15.50:0/332711366 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55e42b2ce4d0 0x55e42b69c870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:42.517 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:42.514+0000 7f7eade00640 1 -- 172.21.15.50:0/332711366 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e42b69c4f0 con 0x55e42b2c62f0 2024-08-31T04:34:42.517 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:42.514+0000 7f7ea5400640 1 --2- 172.21.15.50:0/332711366 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55e42b2ce4d0 0x55e42b69c870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:34:42.517 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:42.514+0000 7f7eade00640 1 --2- 172.21.15.50:0/332711366 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e42b2c62f0 0x55e42b690110 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f7ea0009fd0 tx=0x7f7ea0017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=482c5bb68fc236e2 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:34:42.519 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:42.515+0000 7f7e9ea00640 1 -- 172.21.15.50:0/332711366 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ea0004020 con 0x55e42b2c62f0 2024-08-31T04:34:42.519 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:42.515+0000 7f7e9ea00640 1 -- 172.21.15.50:0/332711366 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7ea000fcc0 con 0x55e42b2c62f0 2024-08-31T04:34:42.520 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:42.515+0000 7f7e9ea00640 1 -- 172.21.15.50:0/332711366 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ea0003b20 con 0x55e42b2c62f0 2024-08-31T04:34:42.520 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:42.515+0000 7f7ebc211740 1 -- 172.21.15.50:0/332711366 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e42b2c62f0 msgr2=0x55e42b690110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:34:42.520 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:42.515+0000 7f7ebc211740 1 --2- 172.21.15.50:0/332711366 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e42b2c62f0 0x55e42b690110 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f7ea0009fd0 tx=0x7f7ea0017000 comp rx=0 tx=0).stop 2024-08-31T04:34:42.520 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:42.516+0000 7f7ebc211740 1 -- 172.21.15.50:0/332711366 shutdown_connections 2024-08-31T04:34:42.520 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:42.516+0000 7f7ebc211740 1 --2- 172.21.15.50:0/332711366 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e42b2ef1b0 0x55e42b69cdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:42.520 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:42.516+0000 7f7ebc211740 1 --2- 172.21.15.50:0/332711366 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55e42b2ce4d0 0x55e42b69c870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:42.520 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:42.516+0000 7f7ebc211740 1 --2- 172.21.15.50:0/332711366 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e42b2c62f0 0x55e42b690110 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:42.520 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:42.516+0000 7f7ebc211740 1 -- 172.21.15.50:0/332711366 >> 172.21.15.50:0/332711366 conn(0x55e42b2e3300 msgr2=0x55e42b69d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:34:42.520 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:42.516+0000 7f7ebc211740 1 -- 172.21.15.50:0/332711366 shutdown_connections 2024-08-31T04:34:42.520 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:42.516+0000 7f7ebc211740 1 -- 172.21.15.50:0/332711366 wait complete. 2024-08-31T04:34:42.520 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:42.516+0000 7f7ebc211740 1 -- start start 2024-08-31T04:34:42.520 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:42.516+0000 7f7ebc211740 1 Processor -- start 2024-08-31T04:34:42.521 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:42.517+0000 7f7ebc211740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e42b2c62f0 0x55e42b6a5f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:34:42.521 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:42.517+0000 7f7ebc211740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55e42b2ce4d0 0x55e42b6a4c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:34:42.521 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:42.517+0000 7f7ebc211740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e42b2ef1b0 0x55e42b6a5190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:34:42.521 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:42.517+0000 7f7ebc211740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f7eb01ae1d0 con 0x55e42b2c62f0 2024-08-31T04:34:42.521 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:42.517+0000 7f7ebc211740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f7eb01adb00 con 0x55e42b2ce4d0 2024-08-31T04:34:42.521 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:42.517+0000 7f7ebc211740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f7eb01aac80 con 0x55e42b2ef1b0 2024-08-31T04:34:42.521 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:42.517+0000 7f7ebc211740 10 client.0 _ll_register_callbacks cb 0x7f7e9800e940 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:34:42.521 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:42.517+0000 7f7eade00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e42b2c62f0 0x55e42b6a5f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:34:42.521 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:42.517+0000 7f7eae800640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e42b2ef1b0 0x55e42b6a5190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:34:42.521 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:42.517+0000 7f7ea5400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55e42b2ce4d0 0x55e42b6a4c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:34:42.521 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:42.517+0000 7f7eade00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e42b2c62f0 0x55e42b6a5f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:57160/0 (socket says 172.21.15.50:57160) 2024-08-31T04:34:42.521 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:42.517+0000 7f7eade00640 1 -- 172.21.15.50:0/175042331 learned_addr learned my addr 172.21.15.50:0/175042331 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:34:42.521 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:42.517+0000 7f7eade00640 1 -- 172.21.15.50:0/175042331 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e42b2ef1b0 msgr2=0x55e42b6a5190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:34:42.522 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:42.517+0000 7f7eade00640 1 --2- 172.21.15.50:0/175042331 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e42b2ef1b0 0x55e42b6a5190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:42.522 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:42.517+0000 7f7eade00640 1 -- 172.21.15.50:0/175042331 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55e42b2ce4d0 msgr2=0x55e42b6a4c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:34:42.522 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:42.517+0000 7f7eade00640 1 --2- 172.21.15.50:0/175042331 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55e42b2ce4d0 0x55e42b6a4c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:42.522 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:42.517+0000 7f7eade00640 1 -- 172.21.15.50:0/175042331 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e42b6a57d0 con 0x55e42b2c62f0 2024-08-31T04:34:42.522 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:42.518+0000 7f7eade00640 1 --2- 172.21.15.50:0/175042331 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e42b2c62f0 0x55e42b6a5f90 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f7ea0034040 tx=0x7f7ea000ff00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a345f0287c1ed9e0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:34:42.522 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:42.518+0000 7f7e93e00640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-08-31T04:34:42.522 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:42.518+0000 7f7e93e00640 1 -- 172.21.15.50:0/175042331 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ea0041060 con 0x55e42b2c62f0 2024-08-31T04:34:42.522 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:42.518+0000 7f7e93e00640 1 -- 172.21.15.50:0/175042331 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8219+0+0 (secure 0 0 0) 0x7f7ea0005040 con 0x55e42b2c62f0 2024-08-31T04:34:42.522 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:42.518+0000 7f7ebc211740 1 -- 172.21.15.50:0/175042331 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7ea000fcc0 con 0x55e42b2c62f0 2024-08-31T04:34:42.522 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:42.518+0000 7f7e93e00640 1 -- 172.21.15.50:0/175042331 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=64) ==== 24+0+0 (secure 0 0 0) 0x7f7ea0005240 con 0x55e42b2c62f0 2024-08-31T04:34:42.522 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:42.518+0000 7f7ebc211740 10 client.16503 fetch_fsmap learned FSMap version 64 2024-08-31T04:34:42.522 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:42.518+0000 7f7ebc211740 1 -- 172.21.15.50:0/175042331 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=64,monmap=4+}) -- 0x55e42b6a4640 con 0x55e42b2c62f0 2024-08-31T04:34:42.523 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:42.518+0000 7f7e93e00640 1 -- 172.21.15.50:0/175042331 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7ea000fcc0 con 0x55e42b2c62f0 2024-08-31T04:34:42.523 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:42.519+0000 7f7e93e00640 1 -- 172.21.15.50:0/175042331 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 64) ==== 8382+0+0 (secure 0 0 0) 0x7f7ea002c430 con 0x55e42b2c62f0 2024-08-31T04:34:42.523 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:42.519+0000 7f7ebc211740 10 client.16503 fetch_fsmap finished waiting for FSMap version 64 2024-08-31T04:34:42.523 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:42.519+0000 7f7ebc211740 10 client.16503 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T04:34:42.523 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:42.519+0000 7f7ebc211740 20 client.16503 populate_metadata read hostname 'smithi050' 2024-08-31T04:34:42.524 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:42.519+0000 7f7ebc211740 1 --2- 172.21.15.50:0/175042331 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x55e42b2831c0 0x55e42b718c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:34:42.524 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:42.519+0000 7f7ebc211740 4 client.16503 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-31T04:34:42.524 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:42.519+0000 7f7ebc211740 1 -- 172.21.15.50:0/175042331 --> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55e42b605960 con 0x55e42b2831c0 2024-08-31T04:34:42.524 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:42.519+0000 7f7ea5400640 1 --2- 172.21.15.50:0/175042331 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x55e42b2831c0 0x55e42b718c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:34:42.524 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:42.520+0000 7f7ea5400640 1 --2- 172.21.15.50:0/175042331 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x55e42b2831c0 0x55e42b718c80 crc :-1 s=READY pgs=151 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=60a8a0cdbb094f4b server_cookie=97a482ca847dd520 in_seq=0 out_seq=0 2024-08-31T04:34:42.524 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:42.520+0000 7f7e93e00640 10 client.16503 ms_handle_connect on v2:172.21.15.133:6838/2526402262 2024-08-31T04:34:42.660 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:42.658+0000 7f7e93e00640 1 -- 172.21.15.50:0/175042331 <== mds.0 v2:172.21.15.133:6838/2526402262 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55e42b605960 con 0x55e42b2831c0 2024-08-31T04:34:42.660 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:42.658+0000 7f7e93e00640 10 client.16503 handle_command_reply: tid=0 2024-08-31T04:34:42.660 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:42.658+0000 7f7ebc211740 1 client.16503 shutdown 2024-08-31T04:34:42.660 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:42.658+0000 7f7ebc211740 1 -- 172.21.15.50:0/175042331 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e42b2c62f0 msgr2=0x55e42b6a5f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:34:42.660 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:42.658+0000 7f7ebc211740 1 --2- 172.21.15.50:0/175042331 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e42b2c62f0 0x55e42b6a5f90 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f7ea0034040 tx=0x7f7ea000ff00 comp rx=0 tx=0).stop 2024-08-31T04:34:42.661 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:42.658+0000 7f7ebc211740 1 -- 172.21.15.50:0/175042331 shutdown_connections 2024-08-31T04:34:42.661 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:42.658+0000 7f7ebc211740 1 --2- 172.21.15.50:0/175042331 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x55e42b2831c0 0x55e42b718c80 crc :-1 s=READY pgs=151 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:42.661 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:42.658+0000 7f7ebc211740 1 --2- 172.21.15.50:0/175042331 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e42b2ef1b0 0x55e42b6a5190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:42.661 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:42.658+0000 7f7ebc211740 1 --2- 172.21.15.50:0/175042331 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55e42b2ce4d0 0x55e42b6a4c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:42.661 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:42.658+0000 7f7ebc211740 1 --2- 172.21.15.50:0/175042331 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e42b2c62f0 0x55e42b6a5f90 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:42.661 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:42.658+0000 7f7ebc211740 1 -- 172.21.15.50:0/175042331 >> 172.21.15.50:0/175042331 conn(0x55e42b2e3300 msgr2=0x55e42b69c700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:34:42.661 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:42.658+0000 7f7e93e00640 0 client.16503 ms_handle_reset on v2:172.21.15.133:6838/2526402262 2024-08-31T04:34:42.661 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:42.658+0000 7f7ebc211740 1 -- 172.21.15.50:0/175042331 shutdown_connections 2024-08-31T04:34:42.661 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:42.659+0000 7f7ebc211740 1 -- 172.21.15.50:0/175042331 wait complete. 2024-08-31T04:34:42.661 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:42.659+0000 7f7ebc211740 20 client.16503 trim_cache size 0 max 16384 2024-08-31T04:34:42.662 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout:{ 2024-08-31T04:34:42.662 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout: "message": "", 2024-08-31T04:34:42.662 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout: "return_code": 0 2024-08-31T04:34:42.662 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout:} 2024-08-31T04:34:42.663 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:42.659+0000 7f7eaf200640 1 -- 172.21.15.50:0/380353400 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f7e940b4bb0 msgr2=0x7f7e940b70c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:34:42.663 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:42.659+0000 7f7eaf200640 1 --2- 172.21.15.50:0/380353400 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f7e940b4bb0 0x7f7e940b70c0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f7ea0009f20 tx=0x7f7ea0009260 comp rx=0 tx=0).stop 2024-08-31T04:34:42.663 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:42.659+0000 7f7eaf200640 1 -- 172.21.15.50:0/380353400 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7eb0076e10 msgr2=0x7f7eb019c360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:34:42.663 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:42.659+0000 7f7eaf200640 1 --2- 172.21.15.50:0/380353400 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7eb0076e10 0x7f7eb019c360 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f7e9800e9f0 tx=0x7f7e9800eeb0 comp rx=0 tx=0).stop 2024-08-31T04:34:42.663 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:42.659+0000 7f7eaf200640 1 -- 172.21.15.50:0/380353400 shutdown_connections 2024-08-31T04:34:42.663 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:42.659+0000 7f7eaf200640 1 --2- 172.21.15.50:0/380353400 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f7e940b4bb0 0x7f7e940b70c0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:42.663 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:42.659+0000 7f7eaf200640 1 --2- 172.21.15.50:0/380353400 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7eb0076e10 0x7f7eb019c360 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:42.663 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:42.659+0000 7f7eaf200640 1 --2- 172.21.15.50:0/380353400 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7eb010b290 0x7f7eb019cf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:42.663 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:42.659+0000 7f7eaf200640 1 --2- 172.21.15.50:0/380353400 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7eb0075a10 0x7f7eb019bcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:42.663 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:42.659+0000 7f7eaf200640 1 -- 172.21.15.50:0/380353400 >> 172.21.15.50:0/380353400 conn(0x7f7eb00febc0 msgr2=0x7f7eb0107270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:34:42.663 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:42.660+0000 7f7eaf200640 1 -- 172.21.15.50:0/380353400 shutdown_connections 2024-08-31T04:34:42.664 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:42.660+0000 7f7eaf200640 1 -- 172.21.15.50:0/380353400 wait complete. 2024-08-31T04:34:43.950 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:34:43 smithi050 ceph-mon[17259]: pgmap v723: 97 pgs: 97 active+clean; 1.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 230 KiB/s rd, 72 KiB/s wr, 44 op/s 2024-08-31T04:34:43.996 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:34:43 smithi177 ceph-mon[22025]: pgmap v723: 97 pgs: 97 active+clean; 1.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 230 KiB/s rd, 72 KiB/s wr, 44 op/s 2024-08-31T04:34:44.043 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:34:43 smithi133 ceph-mon[22177]: pgmap v723: 97 pgs: 97 active+clean; 1.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 230 KiB/s rd, 72 KiB/s wr, 44 op/s 2024-08-31T04:34:45.950 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:34:45 smithi050 ceph-mon[17259]: pgmap v724: 97 pgs: 97 active+clean; 1.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 38 KiB/s wr, 35 op/s 2024-08-31T04:34:45.996 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:34:45 smithi177 ceph-mon[22025]: pgmap v724: 97 pgs: 97 active+clean; 1.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 38 KiB/s wr, 35 op/s 2024-08-31T04:34:46.043 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:34:45 smithi133 ceph-mon[22177]: pgmap v724: 97 pgs: 97 active+clean; 1.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 38 KiB/s wr, 35 op/s 2024-08-31T04:34:46.950 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:34:46 smithi050 ceph-mon[17259]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-31T04:34:46.996 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:34:46 smithi177 ceph-mon[22025]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-31T04:34:47.043 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:34:46 smithi133 ceph-mon[22177]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-31T04:34:47.950 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:34:47 smithi050 ceph-mon[17259]: pgmap v725: 97 pgs: 97 active+clean; 1.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 106 KiB/s rd, 146 KiB/s wr, 88 op/s 2024-08-31T04:34:47.996 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:34:47 smithi177 ceph-mon[22025]: pgmap v725: 97 pgs: 97 active+clean; 1.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 106 KiB/s rd, 146 KiB/s wr, 88 op/s 2024-08-31T04:34:48.043 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:34:47 smithi133 ceph-mon[22177]: pgmap v725: 97 pgs: 97 active+clean; 1.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 106 KiB/s rd, 146 KiB/s wr, 88 op/s 2024-08-31T04:34:49.436 INFO:tasks.workunit.client.0.smithi050.stdout: 2024-08-31T04:34:49.436 INFO:tasks.workunit.client.0.smithi050.stdout:Final score for writes: 430 2024-08-31T04:34:49.436 INFO:tasks.workunit.client.0.smithi050.stdout:Final score for reads : 196132 2024-08-31T04:34:49.436 INFO:tasks.workunit.client.0.smithi050.stdout: 2024-08-31T04:34:49.437 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-08-31T04:34:49.438 DEBUG:teuthology.orchestra.run.smithi050:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-08-31T04:34:49.950 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:34:49 smithi050 ceph-mon[17259]: pgmap v726: 97 pgs: 97 active+clean; 1.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 127 KiB/s wr, 100 op/s 2024-08-31T04:34:49.996 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:34:49 smithi177 ceph-mon[22025]: pgmap v726: 97 pgs: 97 active+clean; 1.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 127 KiB/s wr, 100 op/s 2024-08-31T04:34:50.043 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:34:49 smithi133 ceph-mon[22177]: pgmap v726: 97 pgs: 97 active+clean; 1.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 127 KiB/s wr, 100 op/s 2024-08-31T04:34:51.950 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:34:51 smithi050 ceph-mon[17259]: pgmap v727: 97 pgs: 97 active+clean; 1.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 106 KiB/s rd, 156 KiB/s wr, 103 op/s 2024-08-31T04:34:51.996 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:34:51 smithi177 ceph-mon[22025]: pgmap v727: 97 pgs: 97 active+clean; 1.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 106 KiB/s rd, 156 KiB/s wr, 103 op/s 2024-08-31T04:34:52.043 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:34:51 smithi133 ceph-mon[22177]: pgmap v727: 97 pgs: 97 active+clean; 1.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 106 KiB/s rd, 156 KiB/s wr, 103 op/s 2024-08-31T04:34:52.950 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:34:52 smithi050 ceph-mon[17259]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-31T04:34:52.996 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:34:52 smithi177 ceph-mon[22025]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-31T04:34:53.043 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:34:52 smithi133 ceph-mon[22177]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-31T04:34:53.950 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:34:53 smithi050 ceph-mon[17259]: pgmap v728: 97 pgs: 97 active+clean; 1.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 373 KiB/s rd, 508 KiB/s wr, 137 op/s 2024-08-31T04:34:53.996 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:34:53 smithi177 ceph-mon[22025]: pgmap v728: 97 pgs: 97 active+clean; 1.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 373 KiB/s rd, 508 KiB/s wr, 137 op/s 2024-08-31T04:34:54.043 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:34:53 smithi133 ceph-mon[22177]: pgmap v728: 97 pgs: 97 active+clean; 1.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 373 KiB/s rd, 508 KiB/s wr, 137 op/s 2024-08-31T04:34:55.872 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:55.870+0000 7fe0eb200640 1 -- 172.21.15.50:0/905433819 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe0ec06b4b0 msgr2=0x7fe0ec105f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:34:55.872 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:55.870+0000 7fe0eb200640 1 --2- 172.21.15.50:0/905433819 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe0ec06b4b0 0x7fe0ec105f20 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fe0dc009900 tx=0x7fe0dc02a3f0 comp rx=0 tx=0).stop 2024-08-31T04:34:55.872 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:55.870+0000 7fe0eb200640 1 -- 172.21.15.50:0/905433819 shutdown_connections 2024-08-31T04:34:55.872 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:55.870+0000 7fe0eb200640 1 --2- 172.21.15.50:0/905433819 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe0ec109020 0x7fe0ec10b530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:55.872 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:55.870+0000 7fe0eb200640 1 --2- 172.21.15.50:0/905433819 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe0ec106460 0x7fe0ec1088e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:55.872 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:55.870+0000 7fe0eb200640 1 --2- 172.21.15.50:0/905433819 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe0ec06b4b0 0x7fe0ec105f20 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:55.872 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:55.870+0000 7fe0eb200640 1 -- 172.21.15.50:0/905433819 >> 172.21.15.50:0/905433819 conn(0x7fe0ec0fdb20 msgr2=0x7fe0ec0fffd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:34:55.872 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:55.870+0000 7fe0eb200640 1 -- 172.21.15.50:0/905433819 shutdown_connections 2024-08-31T04:34:55.873 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:55.870+0000 7fe0eb200640 1 -- 172.21.15.50:0/905433819 wait complete. 2024-08-31T04:34:55.874 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:55.871+0000 7fe0eb200640 1 Processor -- start 2024-08-31T04:34:55.874 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:55.871+0000 7fe0eb200640 1 -- start start 2024-08-31T04:34:55.874 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:55.872+0000 7fe0eb200640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe0ec06b4b0 0x7fe0ec19bd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:34:55.874 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:55.872+0000 7fe0eb200640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe0ec106460 0x7fe0ec19c3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:34:55.874 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:55.872+0000 7fe0eb200640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe0ec109020 0x7fe0ec19cf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:34:55.874 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:55.872+0000 7fe0eb200640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fe0ec10eed0 con 0x7fe0ec109020 2024-08-31T04:34:55.874 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:55.872+0000 7fe0eb200640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7fe0ec10ed50 con 0x7fe0ec06b4b0 2024-08-31T04:34:55.874 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:55.872+0000 7fe0eb200640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fe0ec10f050 con 0x7fe0ec106460 2024-08-31T04:34:55.874 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:55.872+0000 7fe0e9400640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe0ec106460 0x7fe0ec19c3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:34:55.874 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:55.872+0000 7fe0e9400640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe0ec106460 0x7fe0ec19c3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.50:39108/0 (socket says 172.21.15.50:39108) 2024-08-31T04:34:55.874 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:55.872+0000 7fe0e9400640 1 -- 172.21.15.50:0/2668328205 learned_addr learned my addr 172.21.15.50:0/2668328205 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:34:55.874 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:55.872+0000 7fe0ea800640 1 --2- 172.21.15.50:0/2668328205 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe0ec109020 0x7fe0ec19cf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:34:55.875 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:55.873+0000 7fe0e9e00640 1 --2- 172.21.15.50:0/2668328205 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe0ec06b4b0 0x7fe0ec19bd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:34:55.875 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:55.873+0000 7fe0e9400640 1 -- 172.21.15.50:0/2668328205 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe0ec06b4b0 msgr2=0x7fe0ec19bd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:34:55.875 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:55.873+0000 7fe0e9400640 1 --2- 172.21.15.50:0/2668328205 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe0ec06b4b0 0x7fe0ec19bd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:55.876 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:55.873+0000 7fe0e9400640 1 -- 172.21.15.50:0/2668328205 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe0ec109020 msgr2=0x7fe0ec19cf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:34:55.876 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:55.873+0000 7fe0e9400640 1 --2- 172.21.15.50:0/2668328205 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe0ec109020 0x7fe0ec19cf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:55.876 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:55.873+0000 7fe0e9400640 1 -- 172.21.15.50:0/2668328205 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0ec19d790 con 0x7fe0ec106460 2024-08-31T04:34:55.876 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:55.873+0000 7fe0e9400640 1 --2- 172.21.15.50:0/2668328205 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe0ec106460 0x7fe0ec19c3c0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fe0d800e9f0 tx=0x7fe0d800eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:34:55.876 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:55.874+0000 7fe0e2a00640 1 -- 172.21.15.50:0/2668328205 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0d800ccc0 con 0x7fe0ec106460 2024-08-31T04:34:55.876 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:55.874+0000 7fe0eb200640 1 -- 172.21.15.50:0/2668328205 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe0ec19da80 con 0x7fe0ec106460 2024-08-31T04:34:55.876 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:55.874+0000 7fe0e2a00640 1 -- 172.21.15.50:0/2668328205 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe0d80054d0 con 0x7fe0ec106460 2024-08-31T04:34:55.876 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:55.874+0000 7fe0e2a00640 1 -- 172.21.15.50:0/2668328205 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0d8010430 con 0x7fe0ec106460 2024-08-31T04:34:55.876 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:55.874+0000 7fe0eb200640 1 -- 172.21.15.50:0/2668328205 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe0ec1a4170 con 0x7fe0ec106460 2024-08-31T04:34:55.880 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:55.879+0000 7fe0f7ed8740 1 Processor -- start 2024-08-31T04:34:55.880 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:55.879+0000 7fe0f7ed8740 1 -- start start 2024-08-31T04:34:55.880 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:55.879+0000 7fe0f7ed8740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5567015e61b0 0x55670198bd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:34:55.880 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:55.879+0000 7fe0f7ed8740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5567015bd2f0 0x55670198c3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:34:55.881 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:55.879+0000 7fe0f7ed8740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5567015c54d0 0x55670198cf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:34:55.881 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:55.879+0000 7fe0f7ed8740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x5567018fef70 con 0x5567015e61b0 2024-08-31T04:34:55.881 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:55.879+0000 7fe0f7ed8740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x5567018ee500 con 0x5567015bd2f0 2024-08-31T04:34:55.881 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:55.879+0000 7fe0f7ed8740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x5567018f24b0 con 0x5567015c54d0 2024-08-31T04:34:55.882 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:55.880+0000 7fe0ea800640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5567015e61b0 0x55670198bd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:34:55.882 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:55.880+0000 7fe0e9e00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5567015bd2f0 0x55670198c3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:34:55.882 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:55.880+0000 7fe0ea800640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5567015e61b0 0x55670198bd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:47314/0 (socket says 172.21.15.50:47314) 2024-08-31T04:34:55.882 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:55.880+0000 7fe0ea800640 1 -- 172.21.15.50:0/388085026 learned_addr learned my addr 172.21.15.50:0/388085026 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:34:55.882 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:55.880+0000 7fe0ea800640 1 -- 172.21.15.50:0/388085026 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5567015c54d0 msgr2=0x55670198cf00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-31T04:34:55.882 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:55.880+0000 7fe0ea800640 1 --2- 172.21.15.50:0/388085026 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5567015c54d0 0x55670198cf00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:55.882 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:55.880+0000 7fe0e2a00640 1 -- 172.21.15.50:0/2668328205 <== mon.1 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 18) ==== 152577+0+0 (secure 0 0 0) 0x7fe0d80046c0 con 0x7fe0ec106460 2024-08-31T04:34:55.882 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:55.880+0000 7fe0ea800640 1 -- 172.21.15.50:0/388085026 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5567015bd2f0 msgr2=0x55670198c3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:34:55.882 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:55.880+0000 7fe0ea800640 1 --2- 172.21.15.50:0/388085026 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5567015bd2f0 0x55670198c3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:55.883 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:55.880+0000 7fe0ea800640 1 -- 172.21.15.50:0/388085026 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5567018a8c10 con 0x5567015e61b0 2024-08-31T04:34:55.883 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:55.881+0000 7fe0e9e00640 1 --2- 172.21.15.50:0/388085026 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5567015bd2f0 0x55670198c3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:34:55.883 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:55.881+0000 7fe0ea800640 1 --2- 172.21.15.50:0/388085026 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5567015e61b0 0x55670198bd40 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7fe0e4009fd0 tx=0x7fe0e40118d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e001929d8eb48d server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:34:55.883 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:55.881+0000 7fe0d7400640 1 -- 172.21.15.50:0/388085026 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0e4004d20 con 0x5567015e61b0 2024-08-31T04:34:55.883 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:55.881+0000 7fe0d7400640 1 -- 172.21.15.50:0/388085026 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe0e4004050 con 0x5567015e61b0 2024-08-31T04:34:55.883 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:55.881+0000 7fe0d7400640 1 -- 172.21.15.50:0/388085026 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0e4005240 con 0x5567015e61b0 2024-08-31T04:34:55.883 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:55.882+0000 7fe0f7ed8740 1 -- 172.21.15.50:0/388085026 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5567015e61b0 msgr2=0x55670198bd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:34:55.884 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:55.882+0000 7fe0f7ed8740 1 --2- 172.21.15.50:0/388085026 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5567015e61b0 0x55670198bd40 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7fe0e4009fd0 tx=0x7fe0e40118d0 comp rx=0 tx=0).stop 2024-08-31T04:34:55.884 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:55.882+0000 7fe0f7ed8740 1 -- 172.21.15.50:0/388085026 shutdown_connections 2024-08-31T04:34:55.884 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:55.882+0000 7fe0f7ed8740 1 --2- 172.21.15.50:0/388085026 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5567015c54d0 0x55670198cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:55.884 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:55.882+0000 7fe0f7ed8740 1 --2- 172.21.15.50:0/388085026 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5567015bd2f0 0x55670198c3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:55.884 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:55.882+0000 7fe0f7ed8740 1 --2- 172.21.15.50:0/388085026 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5567015e61b0 0x55670198bd40 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:55.884 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:55.882+0000 7fe0f7ed8740 1 -- 172.21.15.50:0/388085026 >> 172.21.15.50:0/388085026 conn(0x5567015da300 msgr2=0x5567019877d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:34:55.884 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:55.883+0000 7fe0f7ed8740 1 -- 172.21.15.50:0/388085026 shutdown_connections 2024-08-31T04:34:55.885 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:55.883+0000 7fe0f7ed8740 1 -- 172.21.15.50:0/388085026 wait complete. 2024-08-31T04:34:55.885 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:55.883+0000 7fe0e2a00640 1 --2- 172.21.15.50:0/2668328205 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fe0d00b4b40 0x7fe0d00b7050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:34:55.885 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:55.883+0000 7fe0e2a00640 1 -- 172.21.15.50:0/2668328205 <== mon.1 v2:172.21.15.177:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8219+0+0 (secure 0 0 0) 0x7fe0d80e5450 con 0x7fe0ec106460 2024-08-31T04:34:55.885 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:55.883+0000 7fe0e9e00640 1 --2- 172.21.15.50:0/2668328205 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fe0d00b4b40 0x7fe0d00b7050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:34:55.885 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:55.883+0000 7fe0f7ed8740 1 -- start start 2024-08-31T04:34:55.885 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:55.884+0000 7fe0f7ed8740 1 Processor -- start 2024-08-31T04:34:55.886 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:55.884+0000 7fe0e9e00640 1 --2- 172.21.15.50:0/2668328205 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fe0d00b4b40 0x7fe0d00b7050 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fe0dc000c00 tx=0x7fe0dc031400 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:34:55.886 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:55.885+0000 7fe0f7ed8740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5567015bd2f0 0x55670199dca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:34:55.886 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:55.885+0000 7fe0f7ed8740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5567015c54d0 0x55670199e360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:34:55.886 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:55.885+0000 7fe0f7ed8740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5567015e61b0 0x55670199eed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:34:55.887 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:55.885+0000 7fe0f7ed8740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x556701827ab0 con 0x5567015e61b0 2024-08-31T04:34:55.887 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:55.885+0000 7fe0f7ed8740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x556701895320 con 0x5567015bd2f0 2024-08-31T04:34:55.887 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:55.885+0000 7fe0f7ed8740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x55670198da20 con 0x5567015c54d0 2024-08-31T04:34:55.887 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:55.885+0000 7fe0f7ed8740 10 client.0 _ll_register_callbacks cb 0x5567018cee80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:34:55.887 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:55.885+0000 7fe0e9e00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5567015bd2f0 0x55670199dca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:34:55.887 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:55.885+0000 7fe0e9e00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5567015bd2f0 0x55670199dca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.50:40238/0 (socket says 172.21.15.50:40238) 2024-08-31T04:34:55.887 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:55.885+0000 7fe0e9e00640 1 -- 172.21.15.50:0/664323966 learned_addr learned my addr 172.21.15.50:0/664323966 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:34:55.887 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:55.885+0000 7fe0e9400640 1 --2- 172.21.15.50:0/664323966 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5567015c54d0 0x55670199e360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:34:55.887 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:55.885+0000 7fe0ea800640 1 --2- 172.21.15.50:0/664323966 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5567015e61b0 0x55670199eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:34:55.889 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:55.886+0000 7fe0e9400640 1 -- 172.21.15.50:0/664323966 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5567015bd2f0 msgr2=0x55670199dca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:34:55.889 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:55.886+0000 7fe0e9400640 1 --2- 172.21.15.50:0/664323966 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5567015bd2f0 0x55670199dca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:55.889 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:55.886+0000 7fe0e9400640 1 -- 172.21.15.50:0/664323966 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5567015e61b0 msgr2=0x55670199eed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:34:55.889 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:55.886+0000 7fe0e9400640 1 --2- 172.21.15.50:0/664323966 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5567015e61b0 0x55670199eed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:55.889 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:55.886+0000 7fe0e9400640 1 -- 172.21.15.50:0/664323966 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556701651790 con 0x5567015c54d0 2024-08-31T04:34:55.889 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:55.886+0000 7fe0e9e00640 1 --2- 172.21.15.50:0/664323966 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5567015bd2f0 0x55670199dca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:34:55.889 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:55.886+0000 7fe0ea800640 1 --2- 172.21.15.50:0/664323966 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5567015e61b0 0x55670199eed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:34:55.889 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:55.886+0000 7fe0e9400640 1 --2- 172.21.15.50:0/664323966 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5567015c54d0 0x55670199e360 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fe0d80a90a0 tx=0x7fe0d80ab660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e670d6f65aa1c39e server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:34:55.890 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:55.886+0000 7fe0cbe00640 10 client.0 ms_handle_connect on v2:172.21.15.177:3300/0 2024-08-31T04:34:55.890 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:55.886+0000 7fe0cbe00640 1 -- 172.21.15.50:0/664323966 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0d80b0070 con 0x5567015c54d0 2024-08-31T04:34:55.890 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:55.886+0000 7fe0f7ed8740 1 -- 172.21.15.50:0/664323966 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe0e4004050 con 0x5567015c54d0 2024-08-31T04:34:55.890 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:55.886+0000 7fe0cbe00640 1 -- 172.21.15.50:0/664323966 <== mon.1 v2:172.21.15.177:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8219+0+0 (secure 0 0 0) 0x7fe0d80b0210 con 0x5567015c54d0 2024-08-31T04:34:55.890 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:55.887+0000 7fe0cbe00640 1 -- 172.21.15.50:0/664323966 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_get_version_reply(handle=1 version=66) ==== 24+0+0 (secure 0 0 0) 0x7fe0d80abe30 con 0x5567015c54d0 2024-08-31T04:34:55.890 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:55.887+0000 7fe0f7ed8740 10 client.26461 fetch_fsmap learned FSMap version 66 2024-08-31T04:34:55.890 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:55.887+0000 7fe0f7ed8740 1 -- 172.21.15.50:0/664323966 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,fsmap=66,monmap=4+}) -- 0x5567016ca620 con 0x5567015c54d0 2024-08-31T04:34:55.890 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:55.887+0000 7fe0cbe00640 1 -- 172.21.15.50:0/664323966 <== mon.1 v2:172.21.15.177:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe0e4004050 con 0x5567015c54d0 2024-08-31T04:34:55.890 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:55.887+0000 7fe0cbe00640 1 -- 172.21.15.50:0/664323966 <== mon.1 v2:172.21.15.177:3300/0 5 ==== fsmap(e 66) ==== 8398+0+0 (secure 0 0 0) 0x7fe0d80b4cc0 con 0x5567015c54d0 2024-08-31T04:34:55.890 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:55.887+0000 7fe0f7ed8740 10 client.26461 fetch_fsmap finished waiting for FSMap version 66 2024-08-31T04:34:55.890 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:55.887+0000 7fe0f7ed8740 10 client.26461 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T04:34:55.890 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:55.887+0000 7fe0f7ed8740 20 client.26461 populate_metadata read hostname 'smithi050' 2024-08-31T04:34:55.890 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:55.887+0000 7fe0f7ed8740 1 --2- 172.21.15.50:0/664323966 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x5567015a4d80 0x5567019ab3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:34:55.890 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:55.887+0000 7fe0f7ed8740 4 client.26461 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T04:34:55.890 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:55.887+0000 7fe0f7ed8740 1 -- 172.21.15.50:0/664323966 --> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556701900ec0 con 0x5567015a4d80 2024-08-31T04:34:55.891 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:55.888+0000 7fe0e9e00640 1 --2- 172.21.15.50:0/664323966 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x5567015a4d80 0x5567019ab3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:34:55.891 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:55.888+0000 7fe0e9e00640 1 --2- 172.21.15.50:0/664323966 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x5567015a4d80 0x5567019ab3c0 crc :-1 s=READY pgs=152 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=879d4ecb32ccfe54 server_cookie=462c44afeff33974 in_seq=0 out_seq=0 2024-08-31T04:34:55.892 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:55.888+0000 7fe0cbe00640 10 client.26461 ms_handle_connect on v2:172.21.15.133:6838/2526402262 2024-08-31T04:34:55.892 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:55.889+0000 7fe0cbe00640 1 -- 172.21.15.50:0/664323966 <== mds.0 v2:172.21.15.133:6838/2526402262 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x556701900ec0 con 0x5567015a4d80 2024-08-31T04:34:55.892 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:55.889+0000 7fe0cbe00640 10 client.26461 handle_command_reply: tid=0 2024-08-31T04:34:55.892 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:55.889+0000 7fe0f7ed8740 1 client.26461 shutdown 2024-08-31T04:34:55.892 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:55.889+0000 7fe0f7ed8740 1 -- 172.21.15.50:0/664323966 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5567015c54d0 msgr2=0x55670199e360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:34:55.892 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:55.889+0000 7fe0f7ed8740 1 --2- 172.21.15.50:0/664323966 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5567015c54d0 0x55670199e360 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fe0d80a90a0 tx=0x7fe0d80ab660 comp rx=0 tx=0).stop 2024-08-31T04:34:55.892 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:55.890+0000 7fe0f7ed8740 1 -- 172.21.15.50:0/664323966 shutdown_connections 2024-08-31T04:34:55.892 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:55.890+0000 7fe0f7ed8740 1 --2- 172.21.15.50:0/664323966 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x5567015a4d80 0x5567019ab3c0 crc :-1 s=READY pgs=152 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:55.892 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:55.890+0000 7fe0f7ed8740 1 --2- 172.21.15.50:0/664323966 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5567015c54d0 0x55670199e360 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:55.892 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:55.890+0000 7fe0f7ed8740 1 --2- 172.21.15.50:0/664323966 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5567015e61b0 0x55670199eed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:55.892 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:55.890+0000 7fe0cbe00640 0 client.26461 ms_handle_reset on v2:172.21.15.133:6838/2526402262 2024-08-31T04:34:55.892 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:55.890+0000 7fe0f7ed8740 1 --2- 172.21.15.50:0/664323966 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5567015bd2f0 0x55670199dca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:55.893 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:55.890+0000 7fe0f7ed8740 1 -- 172.21.15.50:0/664323966 >> 172.21.15.50:0/664323966 conn(0x5567015da300 msgr2=0x556701985d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:34:55.893 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:55.890+0000 7fe0f7ed8740 1 -- 172.21.15.50:0/664323966 shutdown_connections 2024-08-31T04:34:55.893 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:55.890+0000 7fe0f7ed8740 1 -- 172.21.15.50:0/664323966 wait complete. 2024-08-31T04:34:55.893 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:55.891+0000 7fe0f7ed8740 20 client.26461 trim_cache size 0 max 16384 2024-08-31T04:34:55.909 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:55.908+0000 7fe0f7ed8740 1 Processor -- start 2024-08-31T04:34:55.909 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:55.908+0000 7fe0f7ed8740 1 -- start start 2024-08-31T04:34:55.909 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:55.908+0000 7fe0f7ed8740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5567015bd2f0 0x556701988c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:34:55.909 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:55.908+0000 7fe0f7ed8740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5567015c54d0 0x5567019a5db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:34:55.910 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:55.908+0000 7fe0f7ed8740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5567015e61b0 0x5567019905a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:34:55.910 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:55.908+0000 7fe0f7ed8740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fe0ec1a88b0 con 0x5567015c54d0 2024-08-31T04:34:55.910 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:55.908+0000 7fe0f7ed8740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7fe0ec1aa4e0 con 0x5567015bd2f0 2024-08-31T04:34:55.910 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:55.908+0000 7fe0f7ed8740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fe0ec1a8f80 con 0x5567015e61b0 2024-08-31T04:34:55.911 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:55.909+0000 7fe0e9e00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5567015bd2f0 0x556701988c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:34:55.911 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:55.909+0000 7fe0e9e00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5567015bd2f0 0x556701988c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.50:40248/0 (socket says 172.21.15.50:40248) 2024-08-31T04:34:55.911 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:55.909+0000 7fe0e9e00640 1 -- 172.21.15.50:0/3325256269 learned_addr learned my addr 172.21.15.50:0/3325256269 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:34:55.911 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:55.909+0000 7fe0e9400640 1 --2- 172.21.15.50:0/3325256269 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5567015c54d0 0x5567019a5db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:34:55.911 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:55.909+0000 7fe0ea800640 1 --2- 172.21.15.50:0/3325256269 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5567015e61b0 0x5567019905a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:34:55.911 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:55.909+0000 7fe0e9e00640 1 -- 172.21.15.50:0/3325256269 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5567015e61b0 msgr2=0x5567019905a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:34:55.912 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:55.909+0000 7fe0e9e00640 1 --2- 172.21.15.50:0/3325256269 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5567015e61b0 0x5567019905a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:55.912 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:55.909+0000 7fe0e9e00640 1 -- 172.21.15.50:0/3325256269 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5567015c54d0 msgr2=0x5567019a5db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:34:55.912 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:55.909+0000 7fe0e9e00640 1 --2- 172.21.15.50:0/3325256269 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5567015c54d0 0x5567019a5db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:55.912 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:55.909+0000 7fe0e9e00640 1 -- 172.21.15.50:0/3325256269 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5567019ab730 con 0x5567015bd2f0 2024-08-31T04:34:55.912 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:55.909+0000 7fe0e9e00640 1 --2- 172.21.15.50:0/3325256269 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5567015bd2f0 0x556701988c20 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fe0dc005ab0 tx=0x7fe0dc040000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=348a16bb598d3de4 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:34:55.912 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:55.910+0000 7fe0d6a00640 1 -- 172.21.15.50:0/3325256269 <== mon.2 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0dc035040 con 0x5567015bd2f0 2024-08-31T04:34:55.912 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:55.910+0000 7fe0d6a00640 1 -- 172.21.15.50:0/3325256269 <== mon.2 v2:172.21.15.133:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe0dc003b60 con 0x5567015bd2f0 2024-08-31T04:34:55.912 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:55.910+0000 7fe0d6a00640 1 -- 172.21.15.50:0/3325256269 <== mon.2 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0dc03dc10 con 0x5567015bd2f0 2024-08-31T04:34:55.913 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:55.911+0000 7fe0f7ed8740 1 -- 172.21.15.50:0/3325256269 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5567015bd2f0 msgr2=0x556701988c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:34:55.913 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:55.911+0000 7fe0f7ed8740 1 --2- 172.21.15.50:0/3325256269 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5567015bd2f0 0x556701988c20 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fe0dc005ab0 tx=0x7fe0dc040000 comp rx=0 tx=0).stop 2024-08-31T04:34:55.913 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:55.911+0000 7fe0f7ed8740 1 -- 172.21.15.50:0/3325256269 shutdown_connections 2024-08-31T04:34:55.913 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:55.911+0000 7fe0f7ed8740 1 --2- 172.21.15.50:0/3325256269 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5567015e61b0 0x5567019905a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:55.913 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:55.911+0000 7fe0f7ed8740 1 --2- 172.21.15.50:0/3325256269 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5567015c54d0 0x5567019a5db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:55.913 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:55.911+0000 7fe0f7ed8740 1 --2- 172.21.15.50:0/3325256269 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5567015bd2f0 0x556701988c20 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:55.913 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:55.911+0000 7fe0f7ed8740 1 -- 172.21.15.50:0/3325256269 >> 172.21.15.50:0/3325256269 conn(0x5567015da300 msgr2=0x55670198fe90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:34:55.913 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:55.911+0000 7fe0f7ed8740 1 -- 172.21.15.50:0/3325256269 shutdown_connections 2024-08-31T04:34:55.913 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:55.911+0000 7fe0f7ed8740 1 -- 172.21.15.50:0/3325256269 wait complete. 2024-08-31T04:34:55.914 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:55.912+0000 7fe0f7ed8740 1 -- start start 2024-08-31T04:34:55.914 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:55.912+0000 7fe0f7ed8740 1 Processor -- start 2024-08-31T04:34:55.914 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:55.912+0000 7fe0f7ed8740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5567015bd2f0 0x5567019a4e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:34:55.914 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:55.912+0000 7fe0f7ed8740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5567015c54d0 0x5567019a53f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:34:55.914 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:55.912+0000 7fe0f7ed8740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5567015e61b0 0x5567019a3a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:34:55.915 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:55.913+0000 7fe0f7ed8740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fe0ec1a9e10 con 0x5567015c54d0 2024-08-31T04:34:55.915 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:55.913+0000 7fe0f7ed8740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7fe0ec1a9710 con 0x5567015e61b0 2024-08-31T04:34:55.915 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:55.913+0000 7fe0f7ed8740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fe0ec1a68f0 con 0x5567015bd2f0 2024-08-31T04:34:55.915 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:55.913+0000 7fe0f7ed8740 10 client.0 _ll_register_callbacks cb 0x7fe0d80abc70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:34:55.915 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:55.913+0000 7fe0ea800640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5567015e61b0 0x5567019a3a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:34:55.915 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:55.913+0000 7fe0ea800640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5567015e61b0 0x5567019a3a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.50:40254/0 (socket says 172.21.15.50:40254) 2024-08-31T04:34:55.915 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:55.913+0000 7fe0ea800640 1 -- 172.21.15.50:0/444830913 learned_addr learned my addr 172.21.15.50:0/444830913 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:34:55.915 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:55.913+0000 7fe0e9e00640 1 --2- 172.21.15.50:0/444830913 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5567015bd2f0 0x5567019a4e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:34:55.916 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:55.913+0000 7fe0e9400640 1 --2- 172.21.15.50:0/444830913 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5567015c54d0 0x5567019a53f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:34:55.916 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:55.914+0000 7fe0e9e00640 1 -- 172.21.15.50:0/444830913 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5567015e61b0 msgr2=0x5567019a3a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:34:55.916 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:55.914+0000 7fe0e9e00640 1 --2- 172.21.15.50:0/444830913 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5567015e61b0 0x5567019a3a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:55.916 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:55.914+0000 7fe0e9e00640 1 -- 172.21.15.50:0/444830913 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5567015c54d0 msgr2=0x5567019a53f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:34:55.917 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:55.914+0000 7fe0e9e00640 1 --2- 172.21.15.50:0/444830913 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5567015c54d0 0x5567019a53f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:55.917 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:55.914+0000 7fe0e9e00640 1 -- 172.21.15.50:0/444830913 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5567019a3f70 con 0x5567015bd2f0 2024-08-31T04:34:55.917 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:55.914+0000 7fe0e9400640 1 --2- 172.21.15.50:0/444830913 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5567015c54d0 0x5567019a53f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T04:34:55.917 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:55.914+0000 7fe0e9e00640 1 --2- 172.21.15.50:0/444830913 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5567015bd2f0 0x5567019a4e70 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fe0dc006010 tx=0x7fe0dc02ab70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d52a4d7cc3e4c847 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:34:55.917 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:55.914+0000 7fe0cbe00640 10 client.0 ms_handle_connect on v2:172.21.15.177:3300/0 2024-08-31T04:34:55.917 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:55.914+0000 7fe0cbe00640 1 -- 172.21.15.50:0/444830913 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0dc062060 con 0x5567015bd2f0 2024-08-31T04:34:55.917 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:55.914+0000 7fe0cbe00640 1 -- 172.21.15.50:0/444830913 <== mon.1 v2:172.21.15.177:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8219+0+0 (secure 0 0 0) 0x7fe0dc0038c0 con 0x5567015bd2f0 2024-08-31T04:34:55.917 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:55.915+0000 7fe0f7ed8740 1 -- 172.21.15.50:0/444830913 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe0dc003b60 con 0x5567015bd2f0 2024-08-31T04:34:55.917 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:55.915+0000 7fe0cbe00640 1 -- 172.21.15.50:0/444830913 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_get_version_reply(handle=1 version=66) ==== 24+0+0 (secure 0 0 0) 0x7fe0dc035070 con 0x5567015bd2f0 2024-08-31T04:34:55.917 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:55.915+0000 7fe0f7ed8740 10 client.26467 fetch_fsmap learned FSMap version 66 2024-08-31T04:34:55.917 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:55.915+0000 7fe0f7ed8740 1 -- 172.21.15.50:0/444830913 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,fsmap=66,monmap=4+}) -- 0x556701a16450 con 0x5567015bd2f0 2024-08-31T04:34:55.917 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:55.915+0000 7fe0cbe00640 1 -- 172.21.15.50:0/444830913 <== mon.1 v2:172.21.15.177:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe0dc003b60 con 0x5567015bd2f0 2024-08-31T04:34:55.918 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:55.915+0000 7fe0cbe00640 1 -- 172.21.15.50:0/444830913 <== mon.1 v2:172.21.15.177:3300/0 5 ==== fsmap(e 66) ==== 8398+0+0 (secure 0 0 0) 0x7fe0dc058070 con 0x5567015bd2f0 2024-08-31T04:34:55.918 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:55.916+0000 7fe0f7ed8740 10 client.26467 fetch_fsmap finished waiting for FSMap version 66 2024-08-31T04:34:55.918 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:55.916+0000 7fe0f7ed8740 10 client.26467 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T04:34:55.918 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:55.916+0000 7fe0f7ed8740 20 client.26467 populate_metadata read hostname 'smithi050' 2024-08-31T04:34:55.918 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:55.916+0000 7fe0f7ed8740 1 --2- 172.21.15.50:0/444830913 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x55670157a1c0 0x556701a18ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:34:55.919 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:55.916+0000 7fe0f7ed8740 4 client.26467 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-31T04:34:55.919 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:55.916+0000 7fe0f7ed8740 1 -- 172.21.15.50:0/444830913 --> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5567018fc960 con 0x55670157a1c0 2024-08-31T04:34:55.919 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:55.916+0000 7fe0e9400640 1 --2- 172.21.15.50:0/444830913 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x55670157a1c0 0x556701a18ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:34:55.919 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:55.917+0000 7fe0e9400640 1 --2- 172.21.15.50:0/444830913 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x55670157a1c0 0x556701a18ea0 crc :-1 s=READY pgs=153 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9d9425a8dc1acb08 server_cookie=c9f1b86e1142f96e in_seq=0 out_seq=0 2024-08-31T04:34:55.919 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:55.917+0000 7fe0cbe00640 10 client.26467 ms_handle_connect on v2:172.21.15.133:6838/2526402262 2024-08-31T04:34:55.952 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:34:55 smithi050 ceph-mon[17259]: pgmap v729: 97 pgs: 97 active+clean; 1.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 367 KiB/s rd, 500 KiB/s wr, 154 op/s 2024-08-31T04:34:55.952 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:34:55 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T04:34:55.952 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:34:55 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:34:55.952 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:34:55 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:34:55.952 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:34:55 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:34:55.952 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:34:55 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:34:55.996 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:34:55 smithi177 ceph-mon[22025]: pgmap v729: 97 pgs: 97 active+clean; 1.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 367 KiB/s rd, 500 KiB/s wr, 154 op/s 2024-08-31T04:34:55.996 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:34:55 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T04:34:55.996 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:34:55 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:34:55.996 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:34:55 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:34:55.996 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:34:55 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:34:55.996 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:34:55 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:34:56.043 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:34:55 smithi133 ceph-mon[22177]: pgmap v729: 97 pgs: 97 active+clean; 1.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 367 KiB/s rd, 500 KiB/s wr, 154 op/s 2024-08-31T04:34:56.043 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:34:55 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T04:34:56.043 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:34:55 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:34:56.043 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:34:55 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:34:56.043 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:34:55 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:34:56.043 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:34:55 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:34:56.107 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:56.106+0000 7fe0cbe00640 1 -- 172.21.15.50:0/444830913 <== mds.0 v2:172.21.15.133:6838/2526402262 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5567018fc960 con 0x55670157a1c0 2024-08-31T04:34:56.107 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:56.106+0000 7fe0cbe00640 10 client.26467 handle_command_reply: tid=0 2024-08-31T04:34:56.107 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:56.106+0000 7fe0f7ed8740 1 client.26467 shutdown 2024-08-31T04:34:56.108 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:56.106+0000 7fe0f7ed8740 1 -- 172.21.15.50:0/444830913 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5567015bd2f0 msgr2=0x5567019a4e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:34:56.108 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:56.106+0000 7fe0f7ed8740 1 --2- 172.21.15.50:0/444830913 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5567015bd2f0 0x5567019a4e70 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fe0dc006010 tx=0x7fe0dc02ab70 comp rx=0 tx=0).stop 2024-08-31T04:34:56.108 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:56.106+0000 7fe0f7ed8740 1 -- 172.21.15.50:0/444830913 shutdown_connections 2024-08-31T04:34:56.108 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:56.106+0000 7fe0f7ed8740 1 --2- 172.21.15.50:0/444830913 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x55670157a1c0 0x556701a18ea0 crc :-1 s=READY pgs=153 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:56.108 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:56.106+0000 7fe0f7ed8740 1 --2- 172.21.15.50:0/444830913 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5567015e61b0 0x5567019a3a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:56.108 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:56.106+0000 7fe0f7ed8740 1 --2- 172.21.15.50:0/444830913 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5567015c54d0 0x5567019a53f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:56.108 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:56.106+0000 7fe0f7ed8740 1 --2- 172.21.15.50:0/444830913 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5567015bd2f0 0x5567019a4e70 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:56.108 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:56.106+0000 7fe0f7ed8740 1 -- 172.21.15.50:0/444830913 >> 172.21.15.50:0/444830913 conn(0x5567015da300 msgr2=0x556701987c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:34:56.109 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:56.107+0000 7fe0cbe00640 0 client.26467 ms_handle_reset on v2:172.21.15.133:6838/2526402262 2024-08-31T04:34:56.109 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:56.107+0000 7fe0f7ed8740 1 -- 172.21.15.50:0/444830913 shutdown_connections 2024-08-31T04:34:56.109 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:56.107+0000 7fe0f7ed8740 1 -- 172.21.15.50:0/444830913 wait complete. 2024-08-31T04:34:56.109 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout:{ 2024-08-31T04:34:56.110 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout: "message": "", 2024-08-31T04:34:56.110 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout: "return_code": 0 2024-08-31T04:34:56.110 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout:} 2024-08-31T04:34:56.110 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:56.107+0000 7fe0f7ed8740 20 client.26467 trim_cache size 0 max 16384 2024-08-31T04:34:56.111 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:56.110+0000 7fe0eb200640 1 -- 172.21.15.50:0/2668328205 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fe0d00b4b40 msgr2=0x7fe0d00b7050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:34:56.111 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:56.110+0000 7fe0eb200640 1 --2- 172.21.15.50:0/2668328205 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fe0d00b4b40 0x7fe0d00b7050 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fe0dc000c00 tx=0x7fe0dc031400 comp rx=0 tx=0).stop 2024-08-31T04:34:56.111 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:56.110+0000 7fe0eb200640 1 -- 172.21.15.50:0/2668328205 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe0ec106460 msgr2=0x7fe0ec19c3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:34:56.111 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:56.110+0000 7fe0eb200640 1 --2- 172.21.15.50:0/2668328205 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe0ec106460 0x7fe0ec19c3c0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fe0d800e9f0 tx=0x7fe0d800eeb0 comp rx=0 tx=0).stop 2024-08-31T04:34:56.113 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:56.112+0000 7fe0eb200640 1 -- 172.21.15.50:0/2668328205 shutdown_connections 2024-08-31T04:34:56.113 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:56.112+0000 7fe0eb200640 1 --2- 172.21.15.50:0/2668328205 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fe0d00b4b40 0x7fe0d00b7050 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:56.113 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:56.112+0000 7fe0eb200640 1 --2- 172.21.15.50:0/2668328205 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe0ec106460 0x7fe0ec19c3c0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:56.113 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:56.112+0000 7fe0eb200640 1 --2- 172.21.15.50:0/2668328205 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe0ec109020 0x7fe0ec19cf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:56.113 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:56.112+0000 7fe0eb200640 1 --2- 172.21.15.50:0/2668328205 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe0ec06b4b0 0x7fe0ec19bd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:34:56.113 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:56.112+0000 7fe0eb200640 1 -- 172.21.15.50:0/2668328205 >> 172.21.15.50:0/2668328205 conn(0x7fe0ec0fdb20 msgr2=0x7fe0ec0fff40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:34:56.114 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:56.112+0000 7fe0eb200640 1 -- 172.21.15.50:0/2668328205 shutdown_connections 2024-08-31T04:34:56.114 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:34:56.112+0000 7fe0eb200640 1 -- 172.21.15.50:0/2668328205 wait complete. 2024-08-31T04:34:56.950 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:34:56 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:34:56.950 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:34:56 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T04:34:56.950 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:34:56 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:34:56.996 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:34:56 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:34:56.996 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:34:56 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T04:34:56.996 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:34:56 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:34:57.043 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:34:56 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:34:57.043 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:34:56 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T04:34:57.043 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:34:56 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:34:57.950 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:34:57 smithi050 ceph-mon[17259]: pgmap v730: 97 pgs: 97 active+clean; 1.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 936 KiB/s rd, 1.0 MiB/s wr, 237 op/s 2024-08-31T04:34:57.950 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:34:57 smithi050 ceph-mon[17259]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-31T04:34:57.996 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:34:57 smithi177 ceph-mon[22025]: pgmap v730: 97 pgs: 97 active+clean; 1.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 936 KiB/s rd, 1.0 MiB/s wr, 237 op/s 2024-08-31T04:34:57.996 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:34:57 smithi177 ceph-mon[22025]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-31T04:34:58.043 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:34:57 smithi133 ceph-mon[22177]: pgmap v730: 97 pgs: 97 active+clean; 1.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 936 KiB/s rd, 1.0 MiB/s wr, 237 op/s 2024-08-31T04:34:58.043 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:34:57 smithi133 ceph-mon[22177]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-31T04:34:59.996 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:34:59 smithi177 ceph-mon[22025]: pgmap v731: 97 pgs: 97 active+clean; 1.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 869 KiB/s rd, 930 KiB/s wr, 235 op/s 2024-08-31T04:34:59.996 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:34:59 smithi177 ceph-mon[22025]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-31T04:35:00.043 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:34:59 smithi133 ceph-mon[22177]: pgmap v731: 97 pgs: 97 active+clean; 1.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 869 KiB/s rd, 930 KiB/s wr, 235 op/s 2024-08-31T04:35:00.043 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:34:59 smithi133 ceph-mon[22177]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-31T04:35:00.095 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:34:59 smithi050 ceph-mon[17259]: pgmap v731: 97 pgs: 97 active+clean; 1.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 869 KiB/s rd, 930 KiB/s wr, 235 op/s 2024-08-31T04:35:00.095 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:34:59 smithi050 ceph-mon[17259]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-31T04:35:01.731 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:35:01 smithi050 ceph-mon[17259]: pgmap v732: 97 pgs: 97 active+clean; 1.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1004 KiB/s rd, 1.0 MiB/s wr, 309 op/s 2024-08-31T04:35:01.996 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:35:01 smithi177 ceph-mon[22025]: pgmap v732: 97 pgs: 97 active+clean; 1.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1004 KiB/s rd, 1.0 MiB/s wr, 309 op/s 2024-08-31T04:35:02.043 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:35:01 smithi133 ceph-mon[22177]: pgmap v732: 97 pgs: 97 active+clean; 1.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1004 KiB/s rd, 1.0 MiB/s wr, 309 op/s 2024-08-31T04:35:02.856 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:35:02 smithi050 ceph-mon[17259]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-31T04:35:02.996 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:35:02 smithi177 ceph-mon[22025]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-31T04:35:03.042 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:35:02 smithi133 ceph-mon[22177]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-31T04:35:03.996 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:35:03 smithi177 ceph-mon[22025]: pgmap v733: 97 pgs: 97 active+clean; 1.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 419 op/s 2024-08-31T04:35:04.043 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:35:03 smithi133 ceph-mon[22177]: pgmap v733: 97 pgs: 97 active+clean; 1.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 419 op/s 2024-08-31T04:35:04.200 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:35:03 smithi050 ceph-mon[17259]: pgmap v733: 97 pgs: 97 active+clean; 1.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 419 op/s 2024-08-31T04:35:05.996 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:35:05 smithi177 ceph-mon[22025]: pgmap v734: 97 pgs: 97 active+clean; 1.5 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 423 op/s 2024-08-31T04:35:06.043 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:35:05 smithi133 ceph-mon[22177]: pgmap v734: 97 pgs: 97 active+clean; 1.5 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 423 op/s 2024-08-31T04:35:06.189 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:35:05 smithi050 ceph-mon[17259]: pgmap v734: 97 pgs: 97 active+clean; 1.5 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 423 op/s 2024-08-31T04:35:08.043 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:35:07 smithi133 ceph-mon[22177]: pgmap v735: 97 pgs: 97 active+clean; 1.5 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 490 op/s 2024-08-31T04:35:08.043 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:35:07 smithi133 ceph-mon[22177]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-31T04:35:08.200 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:35:07 smithi050 ceph-mon[17259]: pgmap v735: 97 pgs: 97 active+clean; 1.5 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 490 op/s 2024-08-31T04:35:08.201 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:35:07 smithi050 ceph-mon[17259]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-31T04:35:08.246 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:35:07 smithi177 ceph-mon[22025]: pgmap v735: 97 pgs: 97 active+clean; 1.5 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 490 op/s 2024-08-31T04:35:08.246 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:35:07 smithi177 ceph-mon[22025]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-31T04:35:09.342 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:09.340+0000 7f813aa00640 1 -- 172.21.15.50:0/3308433702 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f81341044f0 msgr2=0x7f8134104900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:35:09.343 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:09.340+0000 7f813aa00640 1 --2- 172.21.15.50:0/3308433702 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f81341044f0 0x7f8134104900 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f8120009860 tx=0x7f812002a340 comp rx=0 tx=0).stop 2024-08-31T04:35:09.343 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:09.341+0000 7f813aa00640 1 -- 172.21.15.50:0/3308433702 shutdown_connections 2024-08-31T04:35:09.343 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:09.341+0000 7f813aa00640 1 --2- 172.21.15.50:0/3308433702 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f81341044f0 0x7f8134104900 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:09.343 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:09.341+0000 7f813aa00640 1 --2- 172.21.15.50:0/3308433702 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8134104e90 0x7f813410b830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:09.343 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:09.341+0000 7f813aa00640 1 --2- 172.21.15.50:0/3308433702 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8134103470 0x7f81341038e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:09.343 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:09.341+0000 7f813aa00640 1 -- 172.21.15.50:0/3308433702 >> 172.21.15.50:0/3308433702 conn(0x7f81340fedd0 msgr2=0x7f8134101260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:35:09.343 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:09.341+0000 7f813aa00640 1 -- 172.21.15.50:0/3308433702 shutdown_connections 2024-08-31T04:35:09.343 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:09.341+0000 7f813aa00640 1 -- 172.21.15.50:0/3308433702 wait complete. 2024-08-31T04:35:09.344 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:09.342+0000 7f813aa00640 1 Processor -- start 2024-08-31T04:35:09.344 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:09.343+0000 7f813aa00640 1 -- start start 2024-08-31T04:35:09.345 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:09.343+0000 7f813aa00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8134103470 0x7f813419beb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:35:09.345 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:09.343+0000 7f813aa00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f81341044f0 0x7f813419c520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:35:09.345 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:09.343+0000 7f813aa00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8134104e90 0x7f813419d0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:35:09.346 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:09.343+0000 7f813aa00640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f8134075fe0 con 0x7f81341044f0 2024-08-31T04:35:09.346 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:09.343+0000 7f813aa00640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f8134075e60 con 0x7f8134103470 2024-08-31T04:35:09.346 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:09.343+0000 7f813aa00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f8134076160 con 0x7f8134104e90 2024-08-31T04:35:09.346 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:09.343+0000 7f8133e00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8134103470 0x7f813419beb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:35:09.346 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:09.343+0000 7f8133e00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8134103470 0x7f813419beb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.50:55054/0 (socket says 172.21.15.50:55054) 2024-08-31T04:35:09.346 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:09.343+0000 7f8133e00640 1 -- 172.21.15.50:0/1824085297 learned_addr learned my addr 172.21.15.50:0/1824085297 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:35:09.346 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:09.344+0000 7f8138a00640 1 --2- 172.21.15.50:0/1824085297 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8134104e90 0x7f813419d0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:35:09.346 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:09.344+0000 7f8133400640 1 --2- 172.21.15.50:0/1824085297 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f81341044f0 0x7f813419c520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:35:09.346 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:09.344+0000 7f8133e00640 1 -- 172.21.15.50:0/1824085297 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8134104e90 msgr2=0x7f813419d0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:35:09.346 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:09.344+0000 7f8133e00640 1 --2- 172.21.15.50:0/1824085297 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8134104e90 0x7f813419d0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:09.346 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:09.344+0000 7f8133e00640 1 -- 172.21.15.50:0/1824085297 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f81341044f0 msgr2=0x7f813419c520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:35:09.346 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:09.344+0000 7f8133e00640 1 --2- 172.21.15.50:0/1824085297 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f81341044f0 0x7f813419c520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:09.347 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:09.344+0000 7f8133e00640 1 -- 172.21.15.50:0/1824085297 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f813419d8f0 con 0x7f8134103470 2024-08-31T04:35:09.347 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:09.344+0000 7f8133e00640 1 --2- 172.21.15.50:0/1824085297 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8134103470 0x7f813419beb0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f812400e9c0 tx=0x7f812400ee80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:35:09.347 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:09.345+0000 7f8130c00640 1 -- 172.21.15.50:0/1824085297 <== mon.2 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f812400ccc0 con 0x7f8134103470 2024-08-31T04:35:09.347 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:09.345+0000 7f8130c00640 1 -- 172.21.15.50:0/1824085297 <== mon.2 v2:172.21.15.133:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f81240054d0 con 0x7f8134103470 2024-08-31T04:35:09.348 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:09.345+0000 7f813aa00640 1 -- 172.21.15.50:0/1824085297 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f813419dbe0 con 0x7f8134103470 2024-08-31T04:35:09.348 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:09.345+0000 7f8130c00640 1 -- 172.21.15.50:0/1824085297 <== mon.2 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8124010430 con 0x7f8134103470 2024-08-31T04:35:09.348 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:09.345+0000 7f813aa00640 1 -- 172.21.15.50:0/1824085297 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f81341a42d0 con 0x7f8134103470 2024-08-31T04:35:09.350 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:09.349+0000 7f8130c00640 1 -- 172.21.15.50:0/1824085297 <== mon.2 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 18) ==== 152577+0+0 (secure 0 0 0) 0x7f8124004f80 con 0x7f8134103470 2024-08-31T04:35:09.350 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:09.349+0000 7f8141a8a740 1 Processor -- start 2024-08-31T04:35:09.351 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:09.350+0000 7f8141a8a740 1 -- start start 2024-08-31T04:35:09.352 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:09.350+0000 7f8141a8a740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b0dd2f51b0 0x55b0dd69ab30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:35:09.352 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:09.350+0000 7f8141a8a740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b0dd2cc2f0 0x55b0dd69b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:35:09.352 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:09.350+0000 7f8141a8a740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b0dd2d44d0 0x55b0dd69bcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:35:09.352 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:09.350+0000 7f8141a8a740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55b0dd60df70 con 0x55b0dd2cc2f0 2024-08-31T04:35:09.352 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:09.350+0000 7f8141a8a740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x55b0dd5fd500 con 0x55b0dd2f51b0 2024-08-31T04:35:09.352 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:09.350+0000 7f8141a8a740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x55b0dd6014b0 con 0x55b0dd2d44d0 2024-08-31T04:35:09.352 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:09.350+0000 7f8133e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b0dd2cc2f0 0x55b0dd69b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:35:09.352 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:09.350+0000 7f8138a00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b0dd2f51b0 0x55b0dd69ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:35:09.352 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:09.350+0000 7f8138a00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b0dd2f51b0 0x55b0dd69ab30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.50:55070/0 (socket says 172.21.15.50:55070) 2024-08-31T04:35:09.352 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:09.351+0000 7f8138a00640 1 -- 172.21.15.50:0/1047119978 learned_addr learned my addr 172.21.15.50:0/1047119978 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:35:09.352 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:09.351+0000 7f8133400640 1 --2- 172.21.15.50:0/1047119978 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b0dd2d44d0 0x55b0dd69bcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:35:09.353 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:09.351+0000 7f8130c00640 1 --2- 172.21.15.50:0/1824085297 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f81180b4bb0 0x7f81180b70c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:35:09.354 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:09.351+0000 7f8130c00640 1 -- 172.21.15.50:0/1824085297 <== mon.2 v2:172.21.15.133:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8219+0+0 (secure 0 0 0) 0x7f81240e54e0 con 0x7f8134103470 2024-08-31T04:35:09.354 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:09.351+0000 7f8133400640 1 -- 172.21.15.50:0/1047119978 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b0dd2f51b0 msgr2=0x55b0dd69ab30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:35:09.354 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:09.351+0000 7f8133400640 1 --2- 172.21.15.50:0/1047119978 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b0dd2f51b0 0x55b0dd69ab30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:09.354 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:09.351+0000 7f8133400640 1 -- 172.21.15.50:0/1047119978 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b0dd2cc2f0 msgr2=0x55b0dd69b1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:35:09.354 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:09.351+0000 7f8138a00640 1 --2- 172.21.15.50:0/1824085297 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f81180b4bb0 0x7f81180b70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:35:09.354 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:09.351+0000 7f8133400640 1 --2- 172.21.15.50:0/1047119978 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b0dd2cc2f0 0x55b0dd69b1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:09.354 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:09.351+0000 7f8133400640 1 -- 172.21.15.50:0/1047119978 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b0dd5b7c10 con 0x55b0dd2d44d0 2024-08-31T04:35:09.355 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:09.351+0000 7f8133e00640 1 --2- 172.21.15.50:0/1047119978 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b0dd2cc2f0 0x55b0dd69b1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:35:09.355 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:09.352+0000 7f8133400640 1 --2- 172.21.15.50:0/1047119978 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b0dd2d44d0 0x55b0dd69bcf0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f8120009830 tx=0x7f8120005cf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=39a6f9239bc22ed8 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:35:09.355 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:09.352+0000 7f8129200640 1 -- 172.21.15.50:0/1047119978 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8120041070 con 0x55b0dd2d44d0 2024-08-31T04:35:09.355 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:09.352+0000 7f8138a00640 1 --2- 172.21.15.50:0/1824085297 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f81180b4bb0 0x7f81180b70c0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f812c003bd0 tx=0x7f812c015040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:35:09.355 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:09.352+0000 7f8129200640 1 -- 172.21.15.50:0/1047119978 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8120030810 con 0x55b0dd2d44d0 2024-08-31T04:35:09.355 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:09.352+0000 7f8129200640 1 -- 172.21.15.50:0/1047119978 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8120037040 con 0x55b0dd2d44d0 2024-08-31T04:35:09.356 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:09.353+0000 7f8141a8a740 1 -- 172.21.15.50:0/1047119978 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b0dd2d44d0 msgr2=0x55b0dd69bcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:35:09.356 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:09.353+0000 7f8141a8a740 1 --2- 172.21.15.50:0/1047119978 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b0dd2d44d0 0x55b0dd69bcf0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f8120009830 tx=0x7f8120005cf0 comp rx=0 tx=0).stop 2024-08-31T04:35:09.356 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:09.354+0000 7f8141a8a740 1 -- 172.21.15.50:0/1047119978 shutdown_connections 2024-08-31T04:35:09.356 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:09.354+0000 7f8141a8a740 1 --2- 172.21.15.50:0/1047119978 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b0dd2d44d0 0x55b0dd69bcf0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:09.356 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:09.354+0000 7f8141a8a740 1 --2- 172.21.15.50:0/1047119978 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b0dd2cc2f0 0x55b0dd69b1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:09.356 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:09.354+0000 7f8141a8a740 1 --2- 172.21.15.50:0/1047119978 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b0dd2f51b0 0x55b0dd69ab30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:09.357 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:09.354+0000 7f8141a8a740 1 -- 172.21.15.50:0/1047119978 >> 172.21.15.50:0/1047119978 conn(0x55b0dd2e9300 msgr2=0x55b0dd6965c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:35:09.357 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:09.354+0000 7f8141a8a740 1 -- 172.21.15.50:0/1047119978 shutdown_connections 2024-08-31T04:35:09.357 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:09.354+0000 7f8141a8a740 1 -- 172.21.15.50:0/1047119978 wait complete. 2024-08-31T04:35:09.357 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:09.355+0000 7f8141a8a740 1 -- start start 2024-08-31T04:35:09.357 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:09.355+0000 7f8141a8a740 1 Processor -- start 2024-08-31T04:35:09.360 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:09.356+0000 7f8141a8a740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b0dd2cc2f0 0x55b0dd6a4170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:35:09.360 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:09.356+0000 7f8141a8a740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b0dd2d44d0 0x55b0dd6a4830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:35:09.360 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:09.356+0000 7f8141a8a740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b0dd2f51b0 0x55b0dd6a53a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:35:09.360 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:09.356+0000 7f8141a8a740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55b0dd536ab0 con 0x55b0dd2cc2f0 2024-08-31T04:35:09.360 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:09.356+0000 7f8141a8a740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x55b0dd5a4320 con 0x55b0dd2f51b0 2024-08-31T04:35:09.360 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:09.356+0000 7f8141a8a740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x55b0dd69c7b0 con 0x55b0dd2d44d0 2024-08-31T04:35:09.361 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:09.356+0000 7f8141a8a740 10 client.0 _ll_register_callbacks cb 0x55b0dd5dde80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:35:09.361 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:09.356+0000 7f8133e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b0dd2cc2f0 0x55b0dd6a4170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:35:09.361 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:09.356+0000 7f8133e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b0dd2cc2f0 0x55b0dd6a4170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:45638/0 (socket says 172.21.15.50:45638) 2024-08-31T04:35:09.361 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:09.356+0000 7f8133e00640 1 -- 172.21.15.50:0/1187769356 learned_addr learned my addr 172.21.15.50:0/1187769356 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:35:09.361 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:09.356+0000 7f8133400640 1 --2- 172.21.15.50:0/1187769356 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b0dd2d44d0 0x55b0dd6a4830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:35:09.361 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:09.356+0000 7f8138a00640 1 --2- 172.21.15.50:0/1187769356 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b0dd2f51b0 0x55b0dd6a53a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:35:09.361 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:09.356+0000 7f8133e00640 1 -- 172.21.15.50:0/1187769356 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b0dd2d44d0 msgr2=0x55b0dd6a4830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:35:09.361 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:09.356+0000 7f8133e00640 1 --2- 172.21.15.50:0/1187769356 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b0dd2d44d0 0x55b0dd6a4830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:09.361 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:09.356+0000 7f8133e00640 1 -- 172.21.15.50:0/1187769356 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b0dd2f51b0 msgr2=0x55b0dd6a53a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:35:09.361 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:09.356+0000 7f8133e00640 1 --2- 172.21.15.50:0/1187769356 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b0dd2f51b0 0x55b0dd6a53a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:09.361 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:09.356+0000 7f8133e00640 1 -- 172.21.15.50:0/1187769356 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b0dd360790 con 0x55b0dd2cc2f0 2024-08-31T04:35:09.361 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:09.356+0000 7f8138a00640 1 --2- 172.21.15.50:0/1187769356 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b0dd2f51b0 0x55b0dd6a53a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:35:09.362 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:09.357+0000 7f8133e00640 1 --2- 172.21.15.50:0/1187769356 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b0dd2cc2f0 0x55b0dd6a4170 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f81240058c0 tx=0x7f81240ab810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9cc41b9baaff98a server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:35:09.362 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:09.357+0000 7f811d600640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-08-31T04:35:09.362 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:09.357+0000 7f811d600640 1 -- 172.21.15.50:0/1187769356 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81240e52d0 con 0x55b0dd2cc2f0 2024-08-31T04:35:09.362 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:09.357+0000 7f811d600640 1 -- 172.21.15.50:0/1187769356 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8219+0+0 (secure 0 0 0) 0x7f81240930c0 con 0x55b0dd2cc2f0 2024-08-31T04:35:09.362 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:09.357+0000 7f8141a8a740 1 -- 172.21.15.50:0/1187769356 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8120030810 con 0x55b0dd2cc2f0 2024-08-31T04:35:09.362 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:09.357+0000 7f811d600640 1 -- 172.21.15.50:0/1187769356 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=71) ==== 24+0+0 (secure 0 0 0) 0x7f81240ab9d0 con 0x55b0dd2cc2f0 2024-08-31T04:35:09.362 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:09.357+0000 7f8141a8a740 10 client.16530 fetch_fsmap learned FSMap version 71 2024-08-31T04:35:09.362 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:09.357+0000 7f8141a8a740 1 -- 172.21.15.50:0/1187769356 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=71,monmap=4+}) -- 0x55b0dd3d9620 con 0x55b0dd2cc2f0 2024-08-31T04:35:09.362 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:09.358+0000 7f811d600640 1 -- 172.21.15.50:0/1187769356 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8120030810 con 0x55b0dd2cc2f0 2024-08-31T04:35:09.362 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:09.358+0000 7f811d600640 1 -- 172.21.15.50:0/1187769356 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 71) ==== 8442+0+0 (secure 0 0 0) 0x7f81240b0280 con 0x55b0dd2cc2f0 2024-08-31T04:35:09.362 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:09.358+0000 7f8141a8a740 10 client.16530 fetch_fsmap finished waiting for FSMap version 71 2024-08-31T04:35:09.362 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:09.358+0000 7f8141a8a740 10 client.16530 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T04:35:09.363 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:09.358+0000 7f8141a8a740 20 client.16530 populate_metadata read hostname 'smithi050' 2024-08-31T04:35:09.363 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:09.358+0000 7f8141a8a740 1 --2- 172.21.15.50:0/1187769356 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x55b0dd2b3d80 0x55b0dd6b19d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:35:09.363 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:09.358+0000 7f8141a8a740 4 client.16530 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T04:35:09.363 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:09.358+0000 7f8141a8a740 1 -- 172.21.15.50:0/1187769356 --> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b0dd60fec0 con 0x55b0dd2b3d80 2024-08-31T04:35:09.363 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:09.359+0000 7f8133400640 1 --2- 172.21.15.50:0/1187769356 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x55b0dd2b3d80 0x55b0dd6b19d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:35:09.364 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:09.359+0000 7f811d600640 10 client.16530 ms_handle_connect on v2:172.21.15.133:6838/2526402262 2024-08-31T04:35:09.364 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:09.359+0000 7f8133400640 1 --2- 172.21.15.50:0/1187769356 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x55b0dd2b3d80 0x55b0dd6b19d0 crc :-1 s=READY pgs=154 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5a9d8548ccc0d63 server_cookie=a89eb015f1fce283 in_seq=0 out_seq=0 2024-08-31T04:35:09.364 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:09.360+0000 7f811d600640 1 -- 172.21.15.50:0/1187769356 <== mds.0 v2:172.21.15.133:6838/2526402262 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55b0dd60fec0 con 0x55b0dd2b3d80 2024-08-31T04:35:09.364 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:09.360+0000 7f811d600640 10 client.16530 handle_command_reply: tid=0 2024-08-31T04:35:09.365 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:09.360+0000 7f8141a8a740 1 client.16530 shutdown 2024-08-31T04:35:09.365 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:09.360+0000 7f8141a8a740 1 -- 172.21.15.50:0/1187769356 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b0dd2cc2f0 msgr2=0x55b0dd6a4170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:35:09.365 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:09.360+0000 7f8141a8a740 1 --2- 172.21.15.50:0/1187769356 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b0dd2cc2f0 0x55b0dd6a4170 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f81240058c0 tx=0x7f81240ab810 comp rx=0 tx=0).stop 2024-08-31T04:35:09.365 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:09.361+0000 7f8141a8a740 1 -- 172.21.15.50:0/1187769356 shutdown_connections 2024-08-31T04:35:09.365 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:09.361+0000 7f8141a8a740 1 --2- 172.21.15.50:0/1187769356 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x55b0dd2b3d80 0x55b0dd6b19d0 crc :-1 s=READY pgs=154 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:09.365 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:09.361+0000 7f8141a8a740 1 --2- 172.21.15.50:0/1187769356 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b0dd2d44d0 0x55b0dd6a4830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:09.365 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:09.361+0000 7f8141a8a740 1 --2- 172.21.15.50:0/1187769356 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b0dd2f51b0 0x55b0dd6a53a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:09.365 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:09.361+0000 7f8141a8a740 1 --2- 172.21.15.50:0/1187769356 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b0dd2cc2f0 0x55b0dd6a4170 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:09.365 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:09.361+0000 7f8141a8a740 1 -- 172.21.15.50:0/1187769356 >> 172.21.15.50:0/1187769356 conn(0x55b0dd2e9300 msgr2=0x55b0dd694b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:35:09.365 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:09.361+0000 7f811d600640 0 client.16530 ms_handle_reset on v2:172.21.15.133:6838/2526402262 2024-08-31T04:35:09.365 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:09.361+0000 7f8141a8a740 1 -- 172.21.15.50:0/1187769356 shutdown_connections 2024-08-31T04:35:09.365 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:09.361+0000 7f8141a8a740 1 -- 172.21.15.50:0/1187769356 wait complete. 2024-08-31T04:35:09.365 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:09.361+0000 7f8141a8a740 20 client.16530 trim_cache size 0 max 16384 2024-08-31T04:35:09.382 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:09.379+0000 7f8141a8a740 1 Processor -- start 2024-08-31T04:35:09.382 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:09.379+0000 7f8141a8a740 1 -- start start 2024-08-31T04:35:09.382 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:09.379+0000 7f8141a8a740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b0dd2cc2f0 0x55b0dd6a3370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:35:09.383 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:09.379+0000 7f8141a8a740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b0dd2d44d0 0x55b0dd69aad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:35:09.383 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:09.379+0000 7f8141a8a740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b0dd2f51b0 0x55b0dd69b010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:35:09.383 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:09.379+0000 7f8141a8a740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f81341acee0 con 0x55b0dd2cc2f0 2024-08-31T04:35:09.383 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:09.379+0000 7f8141a8a740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f81341aec60 con 0x55b0dd2f51b0 2024-08-31T04:35:09.383 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:09.379+0000 7f8141a8a740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f81341ad670 con 0x55b0dd2d44d0 2024-08-31T04:35:09.383 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:09.379+0000 7f8133e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b0dd2cc2f0 0x55b0dd6a3370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:35:09.383 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:09.380+0000 7f8133e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b0dd2cc2f0 0x55b0dd6a3370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:45650/0 (socket says 172.21.15.50:45650) 2024-08-31T04:35:09.383 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:09.380+0000 7f8138a00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b0dd2f51b0 0x55b0dd69b010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:35:09.383 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:09.380+0000 7f8133e00640 1 -- 172.21.15.50:0/2753821192 learned_addr learned my addr 172.21.15.50:0/2753821192 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:35:09.383 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:09.380+0000 7f8133400640 1 --2- 172.21.15.50:0/2753821192 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b0dd2d44d0 0x55b0dd69aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:35:09.383 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:09.380+0000 7f8133e00640 1 -- 172.21.15.50:0/2753821192 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b0dd2d44d0 msgr2=0x55b0dd69aad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:35:09.383 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:09.380+0000 7f8133e00640 1 --2- 172.21.15.50:0/2753821192 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b0dd2d44d0 0x55b0dd69aad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:09.384 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:09.380+0000 7f8133e00640 1 -- 172.21.15.50:0/2753821192 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b0dd2f51b0 msgr2=0x55b0dd69b010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:35:09.384 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:09.380+0000 7f8133e00640 1 --2- 172.21.15.50:0/2753821192 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b0dd2f51b0 0x55b0dd69b010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:09.384 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:09.380+0000 7f8133e00640 1 -- 172.21.15.50:0/2753821192 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b0dd2b3fb0 con 0x55b0dd2cc2f0 2024-08-31T04:35:09.384 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:09.380+0000 7f8138a00640 1 --2- 172.21.15.50:0/2753821192 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b0dd2f51b0 0x55b0dd69b010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:35:09.384 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:09.380+0000 7f8133e00640 1 --2- 172.21.15.50:0/2753821192 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b0dd2cc2f0 0x55b0dd6a3370 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f81240abe50 tx=0x7f81240b0640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52b1c9f461bdd999 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:35:09.384 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:09.381+0000 7f811fe00640 1 -- 172.21.15.50:0/2753821192 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81240ac5c0 con 0x55b0dd2cc2f0 2024-08-31T04:35:09.384 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:09.381+0000 7f811fe00640 1 -- 172.21.15.50:0/2753821192 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f81240abec0 con 0x55b0dd2cc2f0 2024-08-31T04:35:09.384 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:09.381+0000 7f811fe00640 1 -- 172.21.15.50:0/2753821192 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81240e5040 con 0x55b0dd2cc2f0 2024-08-31T04:35:09.389 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:09.382+0000 7f8141a8a740 1 -- 172.21.15.50:0/2753821192 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b0dd2cc2f0 msgr2=0x55b0dd6a3370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:35:09.389 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:09.382+0000 7f8141a8a740 1 --2- 172.21.15.50:0/2753821192 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b0dd2cc2f0 0x55b0dd6a3370 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f81240abe50 tx=0x7f81240b0640 comp rx=0 tx=0).stop 2024-08-31T04:35:09.390 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:09.382+0000 7f8141a8a740 1 -- 172.21.15.50:0/2753821192 shutdown_connections 2024-08-31T04:35:09.390 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:09.382+0000 7f8141a8a740 1 --2- 172.21.15.50:0/2753821192 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b0dd2d44d0 0x55b0dd69aad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:09.390 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:09.382+0000 7f8141a8a740 1 --2- 172.21.15.50:0/2753821192 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b0dd2f51b0 0x55b0dd69b010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:09.390 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:09.382+0000 7f8141a8a740 1 --2- 172.21.15.50:0/2753821192 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b0dd2cc2f0 0x55b0dd6a3370 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:09.390 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:09.382+0000 7f8141a8a740 1 -- 172.21.15.50:0/2753821192 >> 172.21.15.50:0/2753821192 conn(0x55b0dd2e9300 msgr2=0x55b0dd6a2700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:35:09.390 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:09.382+0000 7f8141a8a740 1 -- 172.21.15.50:0/2753821192 shutdown_connections 2024-08-31T04:35:09.390 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:09.382+0000 7f8141a8a740 1 -- 172.21.15.50:0/2753821192 wait complete. 2024-08-31T04:35:09.391 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:09.382+0000 7f8141a8a740 1 -- start start 2024-08-31T04:35:09.391 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:09.382+0000 7f8141a8a740 1 Processor -- start 2024-08-31T04:35:09.391 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:09.382+0000 7f8141a8a740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b0dd2cc2f0 0x55b0dd6abef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:35:09.391 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:09.382+0000 7f8141a8a740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b0dd2d44d0 0x55b0dd6aabb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:35:09.391 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:09.382+0000 7f8141a8a740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b0dd2f51b0 0x55b0dd6ab0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:35:09.391 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:09.382+0000 7f8141a8a740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f81341ae590 con 0x55b0dd2cc2f0 2024-08-31T04:35:09.391 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:09.382+0000 7f8141a8a740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f81341ade00 con 0x55b0dd2d44d0 2024-08-31T04:35:09.391 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:09.382+0000 7f8141a8a740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f81341aaec0 con 0x55b0dd2f51b0 2024-08-31T04:35:09.392 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:09.382+0000 7f8141a8a740 10 client.0 _ll_register_callbacks cb 0x7f8124004920 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:35:09.392 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:09.382+0000 7f8133400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b0dd2d44d0 0x55b0dd6aabb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:35:09.392 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:09.382+0000 7f8133e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b0dd2cc2f0 0x55b0dd6abef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:35:09.392 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:09.382+0000 7f8138a00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b0dd2f51b0 0x55b0dd6ab0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:35:09.392 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:09.382+0000 7f8133400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b0dd2d44d0 0x55b0dd6aabb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.50:55104/0 (socket says 172.21.15.50:55104) 2024-08-31T04:35:09.392 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:09.382+0000 7f8133400640 1 -- 172.21.15.50:0/3205371109 learned_addr learned my addr 172.21.15.50:0/3205371109 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:35:09.392 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:09.382+0000 7f8133400640 1 -- 172.21.15.50:0/3205371109 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b0dd2f51b0 msgr2=0x55b0dd6ab0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:35:09.392 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:09.382+0000 7f8133400640 1 --2- 172.21.15.50:0/3205371109 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b0dd2f51b0 0x55b0dd6ab0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:09.393 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:09.382+0000 7f8133400640 1 -- 172.21.15.50:0/3205371109 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b0dd2cc2f0 msgr2=0x55b0dd6abef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:35:09.393 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:09.382+0000 7f8133400640 1 --2- 172.21.15.50:0/3205371109 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b0dd2cc2f0 0x55b0dd6abef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:09.393 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:09.382+0000 7f8133400640 1 -- 172.21.15.50:0/3205371109 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b0dd6ab830 con 0x55b0dd2d44d0 2024-08-31T04:35:09.393 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:09.382+0000 7f8138a00640 1 --2- 172.21.15.50:0/3205371109 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b0dd2f51b0 0x55b0dd6ab0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:35:09.393 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:09.382+0000 7f8133400640 1 --2- 172.21.15.50:0/3205371109 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b0dd2d44d0 0x55b0dd6aabb0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f8120000c00 tx=0x7f812002a340 comp rx=0 tx=0).ready entity=mon.2 client_cookie=97ae0dd6e9676c47 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:35:09.394 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:09.382+0000 7f811d600640 10 client.0 ms_handle_connect on v2:172.21.15.133:3300/0 2024-08-31T04:35:09.394 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:09.382+0000 7f811d600640 1 -- 172.21.15.50:0/3205371109 <== mon.2 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8120052060 con 0x55b0dd2d44d0 2024-08-31T04:35:09.394 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:09.382+0000 7f8141a8a740 1 -- 172.21.15.50:0/3205371109 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f81240abec0 con 0x55b0dd2d44d0 2024-08-31T04:35:09.394 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:09.382+0000 7f811d600640 1 -- 172.21.15.50:0/3205371109 <== mon.2 v2:172.21.15.133:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8219+0+0 (secure 0 0 0) 0x7f8120030c10 con 0x55b0dd2d44d0 2024-08-31T04:35:09.394 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:09.382+0000 7f811d600640 1 -- 172.21.15.50:0/3205371109 <== mon.2 v2:172.21.15.133:3300/0 3 ==== mon_get_version_reply(handle=1 version=71) ==== 24+0+0 (secure 0 0 0) 0x7f8120037040 con 0x55b0dd2d44d0 2024-08-31T04:35:09.394 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:09.382+0000 7f8141a8a740 10 client.26498 fetch_fsmap learned FSMap version 71 2024-08-31T04:35:09.394 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:09.382+0000 7f8141a8a740 1 -- 172.21.15.50:0/3205371109 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,fsmap=71,monmap=4+}) -- 0x55b0dd71c380 con 0x55b0dd2d44d0 2024-08-31T04:35:09.394 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:09.382+0000 7f811d600640 1 -- 172.21.15.50:0/3205371109 <== mon.2 v2:172.21.15.133:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f81240abec0 con 0x55b0dd2d44d0 2024-08-31T04:35:09.395 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:09.382+0000 7f811d600640 1 -- 172.21.15.50:0/3205371109 <== mon.2 v2:172.21.15.133:3300/0 5 ==== fsmap(e 71) ==== 8442+0+0 (secure 0 0 0) 0x7f81200046c0 con 0x55b0dd2d44d0 2024-08-31T04:35:09.395 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:09.382+0000 7f8141a8a740 10 client.26498 fetch_fsmap finished waiting for FSMap version 71 2024-08-31T04:35:09.395 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:09.382+0000 7f8141a8a740 10 client.26498 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T04:35:09.395 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:09.382+0000 7f8141a8a740 20 client.26498 populate_metadata read hostname 'smithi050' 2024-08-31T04:35:09.395 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:09.382+0000 7f8141a8a740 1 --2- 172.21.15.50:0/3205371109 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x55b0dd2891c0 0x55b0dd71ea20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:35:09.395 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:09.382+0000 7f8141a8a740 4 client.26498 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-31T04:35:09.395 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:09.382+0000 7f8141a8a740 1 -- 172.21.15.50:0/3205371109 --> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55b0dd60b960 con 0x55b0dd2891c0 2024-08-31T04:35:09.395 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:09.382+0000 7f8133e00640 1 --2- 172.21.15.50:0/3205371109 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x55b0dd2891c0 0x55b0dd71ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:35:09.396 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:09.382+0000 7f8133e00640 1 --2- 172.21.15.50:0/3205371109 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x55b0dd2891c0 0x55b0dd71ea20 crc :-1 s=READY pgs=155 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=84c4036b2e6b11a8 server_cookie=aed3b8abe0b6263d in_seq=0 out_seq=0 2024-08-31T04:35:09.396 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:09.382+0000 7f811d600640 10 client.26498 ms_handle_connect on v2:172.21.15.133:6838/2526402262 2024-08-31T04:35:10.043 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:35:09 smithi133 ceph-mon[22177]: pgmap v736: 97 pgs: 97 active+clean; 1.5 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 420 op/s 2024-08-31T04:35:10.043 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:35:09 smithi133 ceph-mon[22177]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-31T04:35:10.200 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:35:09 smithi050 ceph-mon[17259]: pgmap v736: 97 pgs: 97 active+clean; 1.5 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 420 op/s 2024-08-31T04:35:10.200 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:35:09 smithi050 ceph-mon[17259]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-31T04:35:10.246 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:35:09 smithi177 ceph-mon[22025]: pgmap v736: 97 pgs: 97 active+clean; 1.5 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 420 op/s 2024-08-31T04:35:10.246 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:35:09 smithi177 ceph-mon[22025]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-31T04:35:10.436 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:10.434+0000 7f811d600640 1 -- 172.21.15.50:0/3205371109 <== mds.0 v2:172.21.15.133:6838/2526402262 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55b0dd60b960 con 0x55b0dd2891c0 2024-08-31T04:35:10.436 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:10.434+0000 7f811d600640 10 client.26498 handle_command_reply: tid=0 2024-08-31T04:35:10.436 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:10.435+0000 7f8141a8a740 1 client.26498 shutdown 2024-08-31T04:35:10.437 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:10.435+0000 7f8141a8a740 1 -- 172.21.15.50:0/3205371109 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b0dd2d44d0 msgr2=0x55b0dd6aabb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:35:10.437 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:10.435+0000 7f8141a8a740 1 --2- 172.21.15.50:0/3205371109 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b0dd2d44d0 0x55b0dd6aabb0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f8120000c00 tx=0x7f812002a340 comp rx=0 tx=0).stop 2024-08-31T04:35:10.437 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:10.435+0000 7f8141a8a740 1 -- 172.21.15.50:0/3205371109 shutdown_connections 2024-08-31T04:35:10.437 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:10.436+0000 7f8141a8a740 1 --2- 172.21.15.50:0/3205371109 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x55b0dd2891c0 0x55b0dd71ea20 crc :-1 s=READY pgs=155 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:10.437 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:10.436+0000 7f8141a8a740 1 --2- 172.21.15.50:0/3205371109 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b0dd2f51b0 0x55b0dd6ab0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:10.437 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:10.436+0000 7f8141a8a740 1 --2- 172.21.15.50:0/3205371109 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b0dd2d44d0 0x55b0dd6aabb0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:10.437 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:10.436+0000 7f8141a8a740 1 --2- 172.21.15.50:0/3205371109 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b0dd2cc2f0 0x55b0dd6abef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:10.438 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:10.436+0000 7f8141a8a740 1 -- 172.21.15.50:0/3205371109 >> 172.21.15.50:0/3205371109 conn(0x55b0dd2e9300 msgr2=0x55b0dd6a2570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:35:10.438 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:10.436+0000 7f811d600640 0 client.26498 ms_handle_reset on v2:172.21.15.133:6838/2526402262 2024-08-31T04:35:10.438 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:10.436+0000 7f8141a8a740 1 -- 172.21.15.50:0/3205371109 shutdown_connections 2024-08-31T04:35:10.438 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:10.436+0000 7f8141a8a740 1 -- 172.21.15.50:0/3205371109 wait complete. 2024-08-31T04:35:10.438 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:10.437+0000 7f8141a8a740 20 client.26498 trim_cache size 0 max 16384 2024-08-31T04:35:10.439 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout:{ 2024-08-31T04:35:10.439 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout: "message": "", 2024-08-31T04:35:10.439 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout: "return_code": 0 2024-08-31T04:35:10.439 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout:} 2024-08-31T04:35:10.440 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:10.438+0000 7f813aa00640 1 -- 172.21.15.50:0/1824085297 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f81180b4bb0 msgr2=0x7f81180b70c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:35:10.440 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:10.438+0000 7f813aa00640 1 --2- 172.21.15.50:0/1824085297 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f81180b4bb0 0x7f81180b70c0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f812c003bd0 tx=0x7f812c015040 comp rx=0 tx=0).stop 2024-08-31T04:35:10.440 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:10.438+0000 7f813aa00640 1 -- 172.21.15.50:0/1824085297 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8134103470 msgr2=0x7f813419beb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:35:10.440 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:10.438+0000 7f813aa00640 1 --2- 172.21.15.50:0/1824085297 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8134103470 0x7f813419beb0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f812400e9c0 tx=0x7f812400ee80 comp rx=0 tx=0).stop 2024-08-31T04:35:10.440 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:10.438+0000 7f813aa00640 1 -- 172.21.15.50:0/1824085297 shutdown_connections 2024-08-31T04:35:10.440 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:10.438+0000 7f813aa00640 1 --2- 172.21.15.50:0/1824085297 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f81180b4bb0 0x7f81180b70c0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:10.440 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:10.438+0000 7f813aa00640 1 --2- 172.21.15.50:0/1824085297 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8134104e90 0x7f813419d0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:10.440 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:10.438+0000 7f813aa00640 1 --2- 172.21.15.50:0/1824085297 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f81341044f0 0x7f813419c520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:10.440 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:10.438+0000 7f813aa00640 1 --2- 172.21.15.50:0/1824085297 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8134103470 0x7f813419beb0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:10.440 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:10.438+0000 7f813aa00640 1 -- 172.21.15.50:0/1824085297 >> 172.21.15.50:0/1824085297 conn(0x7f81340fedd0 msgr2=0x7f81340ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:35:10.440 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:10.438+0000 7f813aa00640 1 -- 172.21.15.50:0/1824085297 shutdown_connections 2024-08-31T04:35:10.441 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:10.438+0000 7f813aa00640 1 -- 172.21.15.50:0/1824085297 wait complete. 2024-08-31T04:35:12.043 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:35:11 smithi133 ceph-mon[22177]: pgmap v737: 97 pgs: 97 active+clean; 1.5 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 459 op/s 2024-08-31T04:35:12.195 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:35:11 smithi050 ceph-mon[17259]: pgmap v737: 97 pgs: 97 active+clean; 1.5 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 459 op/s 2024-08-31T04:35:12.246 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:35:11 smithi177 ceph-mon[22025]: pgmap v737: 97 pgs: 97 active+clean; 1.5 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 459 op/s 2024-08-31T04:35:14.043 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:35:13 smithi133 ceph-mon[22177]: pgmap v738: 97 pgs: 97 active+clean; 1.5 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.7 MiB/s wr, 635 op/s 2024-08-31T04:35:14.198 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:35:13 smithi050 ceph-mon[17259]: pgmap v738: 97 pgs: 97 active+clean; 1.5 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.7 MiB/s wr, 635 op/s 2024-08-31T04:35:14.246 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:35:13 smithi177 ceph-mon[22025]: pgmap v738: 97 pgs: 97 active+clean; 1.5 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.7 MiB/s wr, 635 op/s 2024-08-31T04:35:16.044 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:35:15 smithi133 ceph-mon[22177]: pgmap v739: 97 pgs: 97 active+clean; 1.5 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.3 MiB/s wr, 669 op/s 2024-08-31T04:35:16.047 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:35:15 smithi177 ceph-mon[22025]: pgmap v739: 97 pgs: 97 active+clean; 1.5 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.3 MiB/s wr, 669 op/s 2024-08-31T04:35:16.109 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:35:15 smithi050 ceph-mon[17259]: pgmap v739: 97 pgs: 97 active+clean; 1.5 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.3 MiB/s wr, 669 op/s 2024-08-31T04:35:18.043 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:35:17 smithi133 ceph-mon[22177]: pgmap v740: 97 pgs: 97 active+clean; 1.5 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.8 MiB/s wr, 766 op/s 2024-08-31T04:35:18.200 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:35:17 smithi050 ceph-mon[17259]: pgmap v740: 97 pgs: 97 active+clean; 1.5 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.8 MiB/s wr, 766 op/s 2024-08-31T04:35:18.246 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:35:17 smithi177 ceph-mon[22025]: pgmap v740: 97 pgs: 97 active+clean; 1.5 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.8 MiB/s wr, 766 op/s 2024-08-31T04:35:20.043 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:35:19 smithi133 ceph-mon[22177]: pgmap v741: 97 pgs: 97 active+clean; 1.5 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.2 MiB/s wr, 715 op/s 2024-08-31T04:35:20.140 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:35:19 smithi050 ceph-mon[17259]: pgmap v741: 97 pgs: 97 active+clean; 1.5 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.2 MiB/s wr, 715 op/s 2024-08-31T04:35:20.246 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:35:19 smithi177 ceph-mon[22025]: pgmap v741: 97 pgs: 97 active+clean; 1.5 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.2 MiB/s wr, 715 op/s 2024-08-31T04:35:22.043 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:35:21 smithi133 ceph-mon[22177]: pgmap v742: 97 pgs: 97 active+clean; 1.5 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.2 MiB/s wr, 743 op/s 2024-08-31T04:35:22.200 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:35:21 smithi050 ceph-mon[17259]: pgmap v742: 97 pgs: 97 active+clean; 1.5 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.2 MiB/s wr, 743 op/s 2024-08-31T04:35:22.246 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:35:21 smithi177 ceph-mon[22025]: pgmap v742: 97 pgs: 97 active+clean; 1.5 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.2 MiB/s wr, 743 op/s 2024-08-31T04:35:23.689 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:23.687+0000 7f39a3200640 1 -- 172.21.15.50:0/2534900719 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f399c104e90 msgr2=0x7f399c10b830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:35:23.689 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:23.687+0000 7f39a3200640 1 --2- 172.21.15.50:0/2534900719 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f399c104e90 0x7f399c10b830 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f3994009900 tx=0x7f399402a410 comp rx=0 tx=0).stop 2024-08-31T04:35:23.689 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:23.687+0000 7f39a3200640 1 -- 172.21.15.50:0/2534900719 shutdown_connections 2024-08-31T04:35:23.690 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:23.687+0000 7f39a3200640 1 --2- 172.21.15.50:0/2534900719 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f399c104e90 0x7f399c10b830 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:23.690 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:23.687+0000 7f39a3200640 1 --2- 172.21.15.50:0/2534900719 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f399c1044f0 0x7f399c104900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:23.690 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:23.687+0000 7f39a3200640 1 --2- 172.21.15.50:0/2534900719 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f399c103470 0x7f399c1038e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:23.690 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:23.687+0000 7f39a3200640 1 -- 172.21.15.50:0/2534900719 >> 172.21.15.50:0/2534900719 conn(0x7f399c0fedd0 msgr2=0x7f399c101260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:35:23.690 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:23.687+0000 7f39a3200640 1 -- 172.21.15.50:0/2534900719 shutdown_connections 2024-08-31T04:35:23.690 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:23.687+0000 7f39a3200640 1 -- 172.21.15.50:0/2534900719 wait complete. 2024-08-31T04:35:23.692 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:23.688+0000 7f39a3200640 1 Processor -- start 2024-08-31T04:35:23.692 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:23.689+0000 7f39a3200640 1 -- start start 2024-08-31T04:35:23.692 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:23.689+0000 7f39a3200640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f399c103470 0x7f399c199c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:35:23.692 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:23.689+0000 7f39a3200640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f399c1044f0 0x7f399c19a2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:35:23.692 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:23.689+0000 7f39a3200640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f399c104e90 0x7f399c19ae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:35:23.692 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:23.689+0000 7f39a3200640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f399c10f0e0 con 0x7f399c1044f0 2024-08-31T04:35:23.693 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:23.689+0000 7f39a3200640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f399c10ef60 con 0x7f399c104e90 2024-08-31T04:35:23.693 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:23.689+0000 7f39a3200640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f399c10f260 con 0x7f399c103470 2024-08-31T04:35:23.693 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:23.689+0000 7f399be00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f399c103470 0x7f399c199c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:35:23.693 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:23.689+0000 7f399be00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f399c103470 0x7f399c199c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.50:48652/0 (socket says 172.21.15.50:48652) 2024-08-31T04:35:23.693 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:23.689+0000 7f399be00640 1 -- 172.21.15.50:0/4201257918 learned_addr learned my addr 172.21.15.50:0/4201257918 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:35:23.693 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:23.689+0000 7f399b400640 1 --2- 172.21.15.50:0/4201257918 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f399c1044f0 0x7f399c19a2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:35:23.693 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:23.689+0000 7f39a1200640 1 --2- 172.21.15.50:0/4201257918 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f399c104e90 0x7f399c19ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:35:23.693 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:23.690+0000 7f399be00640 1 -- 172.21.15.50:0/4201257918 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f399c104e90 msgr2=0x7f399c19ae90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:35:23.693 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:23.690+0000 7f399be00640 1 --2- 172.21.15.50:0/4201257918 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f399c104e90 0x7f399c19ae90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:23.693 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:23.690+0000 7f399be00640 1 -- 172.21.15.50:0/4201257918 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f399c1044f0 msgr2=0x7f399c19a2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:35:23.693 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:23.690+0000 7f399be00640 1 --2- 172.21.15.50:0/4201257918 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f399c1044f0 0x7f399c19a2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:23.693 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:23.690+0000 7f399be00640 1 -- 172.21.15.50:0/4201257918 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f399c19b6b0 con 0x7f399c103470 2024-08-31T04:35:23.693 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:23.690+0000 7f399b400640 1 --2- 172.21.15.50:0/4201257918 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f399c1044f0 0x7f399c19a2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:35:23.694 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:23.690+0000 7f399be00640 1 --2- 172.21.15.50:0/4201257918 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f399c103470 0x7f399c199c70 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f398c00ea60 tx=0x7f398c00ef20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:35:23.694 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:23.690+0000 7f3998c00640 1 -- 172.21.15.50:0/4201257918 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f398c00cde0 con 0x7f399c103470 2024-08-31T04:35:23.694 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:23.690+0000 7f3998c00640 1 -- 172.21.15.50:0/4201257918 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f398c0035f0 con 0x7f399c103470 2024-08-31T04:35:23.694 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:23.690+0000 7f39a3200640 1 -- 172.21.15.50:0/4201257918 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f399c19b9a0 con 0x7f399c103470 2024-08-31T04:35:23.694 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:23.690+0000 7f3998c00640 1 -- 172.21.15.50:0/4201257918 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f398c010690 con 0x7f399c103470 2024-08-31T04:35:23.694 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:23.690+0000 7f39a3200640 1 -- 172.21.15.50:0/4201257918 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f399c1a2090 con 0x7f399c103470 2024-08-31T04:35:23.695 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:23.694+0000 7f39aa24e740 1 Processor -- start 2024-08-31T04:35:23.696 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:23.694+0000 7f39aa24e740 1 -- start start 2024-08-31T04:35:23.696 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:23.694+0000 7f39aa24e740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5579d24951b0 0x5579d283ab30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:35:23.696 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:23.694+0000 7f39aa24e740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5579d246c2f0 0x5579d283b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:35:23.696 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:23.694+0000 7f39aa24e740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5579d24744d0 0x5579d283bcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:35:23.696 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:23.694+0000 7f39aa24e740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x5579d27adf70 con 0x5579d24951b0 2024-08-31T04:35:23.696 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:23.694+0000 7f39aa24e740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x5579d279d500 con 0x5579d24744d0 2024-08-31T04:35:23.696 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:23.694+0000 7f39aa24e740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x5579d27a14b0 con 0x5579d246c2f0 2024-08-31T04:35:23.696 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:23.694+0000 7f3998c00640 1 -- 172.21.15.50:0/4201257918 <== mon.1 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 18) ==== 152577+0+0 (secure 0 0 0) 0x7f398c0037a0 con 0x7f399c103470 2024-08-31T04:35:23.696 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:23.694+0000 7f399b400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5579d24744d0 0x5579d283bcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:35:23.697 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:23.694+0000 7f39a1200640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5579d24951b0 0x5579d283ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:35:23.697 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:23.694+0000 7f399b400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5579d24744d0 0x5579d283bcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.50:47146/0 (socket says 172.21.15.50:47146) 2024-08-31T04:35:23.697 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:23.694+0000 7f399b400640 1 -- 172.21.15.50:0/833912482 learned_addr learned my addr 172.21.15.50:0/833912482 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:35:23.697 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:23.695+0000 7f399be00640 1 --2- 172.21.15.50:0/833912482 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5579d246c2f0 0x5579d283b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:35:23.697 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:23.695+0000 7f39a1200640 1 -- 172.21.15.50:0/833912482 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5579d246c2f0 msgr2=0x5579d283b1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:35:23.697 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:23.695+0000 7f39a1200640 1 --2- 172.21.15.50:0/833912482 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5579d246c2f0 0x5579d283b1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:23.697 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:23.695+0000 7f39a1200640 1 -- 172.21.15.50:0/833912482 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5579d24744d0 msgr2=0x5579d283bcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:35:23.697 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:23.695+0000 7f39a1200640 1 --2- 172.21.15.50:0/833912482 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5579d24744d0 0x5579d283bcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:23.699 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:23.695+0000 7f39a1200640 1 -- 172.21.15.50:0/833912482 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5579d2757c10 con 0x5579d24951b0 2024-08-31T04:35:23.699 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:23.695+0000 7f39a1200640 1 --2- 172.21.15.50:0/833912482 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5579d24951b0 0x5579d283ab30 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f399402a930 tx=0x7f3994009610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c965267df9f2f97e server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:35:23.699 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:23.696+0000 7f3991600640 1 -- 172.21.15.50:0/833912482 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3994035030 con 0x5579d24951b0 2024-08-31T04:35:23.699 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:23.696+0000 7f3991600640 1 -- 172.21.15.50:0/833912482 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3994040070 con 0x5579d24951b0 2024-08-31T04:35:23.699 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:23.696+0000 7f3991600640 1 -- 172.21.15.50:0/833912482 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3994031800 con 0x5579d24951b0 2024-08-31T04:35:23.699 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:23.696+0000 7f3998c00640 1 --2- 172.21.15.50:0/4201257918 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f39800b4b30 0x7f39800b7040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:35:23.699 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:23.696+0000 7f399be00640 1 --2- 172.21.15.50:0/4201257918 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f39800b4b30 0x7f39800b7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:35:23.699 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:23.696+0000 7f3998c00640 1 -- 172.21.15.50:0/4201257918 <== mon.1 v2:172.21.15.177:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8219+0+0 (secure 0 0 0) 0x7f398c0e5400 con 0x7f399c103470 2024-08-31T04:35:23.699 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:23.697+0000 7f39aa24e740 1 -- 172.21.15.50:0/833912482 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5579d24951b0 msgr2=0x5579d283ab30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:35:23.699 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:23.697+0000 7f39aa24e740 1 --2- 172.21.15.50:0/833912482 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5579d24951b0 0x5579d283ab30 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f399402a930 tx=0x7f3994009610 comp rx=0 tx=0).stop 2024-08-31T04:35:23.699 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:23.697+0000 7f39aa24e740 1 -- 172.21.15.50:0/833912482 shutdown_connections 2024-08-31T04:35:23.699 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:23.697+0000 7f39aa24e740 1 --2- 172.21.15.50:0/833912482 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5579d246c2f0 0x5579d283b1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:23.700 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:23.697+0000 7f39aa24e740 1 --2- 172.21.15.50:0/833912482 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5579d24744d0 0x5579d283bcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:23.700 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:23.697+0000 7f39aa24e740 1 --2- 172.21.15.50:0/833912482 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5579d24951b0 0x5579d283ab30 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:23.700 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:23.697+0000 7f39aa24e740 1 -- 172.21.15.50:0/833912482 >> 172.21.15.50:0/833912482 conn(0x5579d2489300 msgr2=0x5579d28365c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:35:23.700 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:23.697+0000 7f39aa24e740 1 -- 172.21.15.50:0/833912482 shutdown_connections 2024-08-31T04:35:23.700 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:23.697+0000 7f39aa24e740 1 -- 172.21.15.50:0/833912482 wait complete. 2024-08-31T04:35:23.700 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:23.697+0000 7f399be00640 1 --2- 172.21.15.50:0/4201257918 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f39800b4b30 0x7f39800b7040 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f398c00c760 tx=0x7f398c0e2de0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:35:23.700 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:23.698+0000 7f39aa24e740 1 -- start start 2024-08-31T04:35:23.703 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:23.698+0000 7f39aa24e740 1 Processor -- start 2024-08-31T04:35:23.703 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:23.698+0000 7f39aa24e740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5579d246c2f0 0x5579d2844130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:35:23.703 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:23.698+0000 7f39aa24e740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5579d24744d0 0x5579d28447f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:35:23.703 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:23.698+0000 7f39aa24e740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5579d24951b0 0x5579d2845360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:35:23.703 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:23.698+0000 7f39aa24e740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x5579d26d6ab0 con 0x5579d24744d0 2024-08-31T04:35:23.703 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:23.698+0000 7f39aa24e740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x5579d2744320 con 0x5579d246c2f0 2024-08-31T04:35:23.703 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:23.698+0000 7f39aa24e740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x5579d283c7b0 con 0x5579d24951b0 2024-08-31T04:35:23.703 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:23.698+0000 7f39aa24e740 10 client.0 _ll_register_callbacks cb 0x5579d277de80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:35:23.703 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:23.699+0000 7f399b400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5579d24744d0 0x5579d28447f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:35:23.703 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:23.699+0000 7f399b400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5579d24744d0 0x5579d28447f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:45140/0 (socket says 172.21.15.50:45140) 2024-08-31T04:35:23.703 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:23.699+0000 7f399b400640 1 -- 172.21.15.50:0/3910998638 learned_addr learned my addr 172.21.15.50:0/3910998638 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:35:23.704 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:23.699+0000 7f39a1200640 1 --2- 172.21.15.50:0/3910998638 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5579d24951b0 0x5579d2845360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:35:23.704 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:23.699+0000 7f39a1200640 1 --2- 172.21.15.50:0/3910998638 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5579d246c2f0 0x5579d2844130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:35:23.704 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:23.699+0000 7f399b400640 1 -- 172.21.15.50:0/3910998638 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5579d24951b0 msgr2=0x5579d2845360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:35:23.704 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:23.699+0000 7f399b400640 1 --2- 172.21.15.50:0/3910998638 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5579d24951b0 0x5579d2845360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:23.704 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:23.699+0000 7f399b400640 1 -- 172.21.15.50:0/3910998638 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5579d246c2f0 msgr2=0x5579d2844130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:35:23.704 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:23.699+0000 7f399b400640 1 --2- 172.21.15.50:0/3910998638 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5579d246c2f0 0x5579d2844130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:23.704 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:23.699+0000 7f399b400640 1 -- 172.21.15.50:0/3910998638 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5579d2500790 con 0x5579d24744d0 2024-08-31T04:35:23.704 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:23.699+0000 7f39a1200640 1 --2- 172.21.15.50:0/3910998638 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5579d246c2f0 0x5579d2844130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:35:23.704 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:23.699+0000 7f399b400640 1 --2- 172.21.15.50:0/3910998638 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5579d24744d0 0x5579d28447f0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f398800e660 tx=0x7f398800eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3fac3dc70b67b6c8 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:35:23.704 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:23.699+0000 7f3986000640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-08-31T04:35:23.704 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:23.700+0000 7f3986000640 1 -- 172.21.15.50:0/3910998638 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3988003e40 con 0x5579d24744d0 2024-08-31T04:35:23.704 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:23.700+0000 7f39aa24e740 1 -- 172.21.15.50:0/3910998638 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3994040070 con 0x5579d24744d0 2024-08-31T04:35:23.704 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:23.700+0000 7f3986000640 1 -- 172.21.15.50:0/3910998638 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8219+0+0 (secure 0 0 0) 0x7f3988004050 con 0x5579d24744d0 2024-08-31T04:35:23.705 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:23.700+0000 7f3986000640 1 -- 172.21.15.50:0/3910998638 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=71) ==== 24+0+0 (secure 0 0 0) 0x7f3988004250 con 0x5579d24744d0 2024-08-31T04:35:23.705 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:23.700+0000 7f39aa24e740 10 client.16548 fetch_fsmap learned FSMap version 71 2024-08-31T04:35:23.705 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:23.700+0000 7f39aa24e740 1 -- 172.21.15.50:0/3910998638 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=71,monmap=4+}) -- 0x5579d2579620 con 0x5579d24744d0 2024-08-31T04:35:23.705 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:23.700+0000 7f3986000640 1 -- 172.21.15.50:0/3910998638 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3994040070 con 0x5579d24744d0 2024-08-31T04:35:23.705 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:23.701+0000 7f3986000640 1 -- 172.21.15.50:0/3910998638 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 71) ==== 8442+0+0 (secure 0 0 0) 0x7f398800dd20 con 0x5579d24744d0 2024-08-31T04:35:23.705 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:23.701+0000 7f39aa24e740 10 client.16548 fetch_fsmap finished waiting for FSMap version 71 2024-08-31T04:35:23.705 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:23.701+0000 7f39aa24e740 10 client.16548 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T04:35:23.705 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:23.701+0000 7f39aa24e740 20 client.16548 populate_metadata read hostname 'smithi050' 2024-08-31T04:35:23.705 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:23.701+0000 7f39aa24e740 1 --2- 172.21.15.50:0/3910998638 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x5579d2453d80 0x5579d2851aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:35:23.705 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:23.701+0000 7f39aa24e740 4 client.16548 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T04:35:23.705 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:23.701+0000 7f39aa24e740 1 -- 172.21.15.50:0/3910998638 --> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5579d27afec0 con 0x5579d2453d80 2024-08-31T04:35:23.705 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:23.701+0000 7f39a1200640 1 --2- 172.21.15.50:0/3910998638 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x5579d2453d80 0x5579d2851aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:35:23.705 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:23.701+0000 7f39a1200640 1 --2- 172.21.15.50:0/3910998638 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x5579d2453d80 0x5579d2851aa0 crc :-1 s=READY pgs=156 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9e9e2585c6ecd8fb server_cookie=3b77767a5229af35 in_seq=0 out_seq=0 2024-08-31T04:35:23.705 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:23.701+0000 7f3986000640 10 client.16548 ms_handle_connect on v2:172.21.15.133:6838/2526402262 2024-08-31T04:35:23.706 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:23.702+0000 7f3986000640 1 -- 172.21.15.50:0/3910998638 <== mds.0 v2:172.21.15.133:6838/2526402262 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5579d27afec0 con 0x5579d2453d80 2024-08-31T04:35:23.707 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:23.702+0000 7f3986000640 10 client.16548 handle_command_reply: tid=0 2024-08-31T04:35:23.707 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:23.702+0000 7f39aa24e740 1 client.16548 shutdown 2024-08-31T04:35:23.707 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:23.703+0000 7f39aa24e740 1 -- 172.21.15.50:0/3910998638 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5579d24744d0 msgr2=0x5579d28447f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:35:23.707 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:23.703+0000 7f39aa24e740 1 --2- 172.21.15.50:0/3910998638 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5579d24744d0 0x5579d28447f0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f398800e660 tx=0x7f398800eb20 comp rx=0 tx=0).stop 2024-08-31T04:35:23.707 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:23.703+0000 7f39aa24e740 1 -- 172.21.15.50:0/3910998638 shutdown_connections 2024-08-31T04:35:23.707 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:23.703+0000 7f39aa24e740 1 --2- 172.21.15.50:0/3910998638 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x5579d2453d80 0x5579d2851aa0 crc :-1 s=READY pgs=156 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:23.707 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:23.703+0000 7f39aa24e740 1 --2- 172.21.15.50:0/3910998638 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5579d24951b0 0x5579d2845360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:23.707 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:23.703+0000 7f39aa24e740 1 --2- 172.21.15.50:0/3910998638 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5579d24744d0 0x5579d28447f0 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:23.707 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:23.703+0000 7f39aa24e740 1 --2- 172.21.15.50:0/3910998638 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5579d246c2f0 0x5579d2844130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:23.707 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:23.703+0000 7f39aa24e740 1 -- 172.21.15.50:0/3910998638 >> 172.21.15.50:0/3910998638 conn(0x5579d2489300 msgr2=0x5579d2834b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:35:23.707 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:23.703+0000 7f3986000640 0 client.16548 ms_handle_reset on v2:172.21.15.133:6838/2526402262 2024-08-31T04:35:23.707 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:23.703+0000 7f39aa24e740 1 -- 172.21.15.50:0/3910998638 shutdown_connections 2024-08-31T04:35:23.707 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:23.703+0000 7f39aa24e740 1 -- 172.21.15.50:0/3910998638 wait complete. 2024-08-31T04:35:23.707 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:23.703+0000 7f39aa24e740 20 client.16548 trim_cache size 0 max 16384 2024-08-31T04:35:23.724 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:23.722+0000 7f39aa24e740 1 Processor -- start 2024-08-31T04:35:23.724 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:23.722+0000 7f39aa24e740 1 -- start start 2024-08-31T04:35:23.725 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:23.723+0000 7f39aa24e740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5579d246c2f0 0x5579d2844840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:35:23.725 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:23.723+0000 7f39aa24e740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5579d24744d0 0x5579d283ec80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:35:23.725 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:23.723+0000 7f39aa24e740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5579d24951b0 0x5579d283f1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:35:23.725 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:23.723+0000 7f39aa24e740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f399c1a8ad0 con 0x5579d24951b0 2024-08-31T04:35:23.725 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:23.723+0000 7f39aa24e740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f399c1aa850 con 0x5579d246c2f0 2024-08-31T04:35:23.725 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:23.723+0000 7f39aa24e740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f399c1a9260 con 0x5579d24744d0 2024-08-31T04:35:23.725 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:23.723+0000 7f399b400640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5579d24744d0 0x5579d283ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:35:23.725 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:23.723+0000 7f39a1200640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5579d246c2f0 0x5579d2844840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:35:23.725 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:23.723+0000 7f399b400640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5579d24744d0 0x5579d283ec80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.50:48686/0 (socket says 172.21.15.50:48686) 2024-08-31T04:35:23.725 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:23.723+0000 7f399b400640 1 -- 172.21.15.50:0/1462627205 learned_addr learned my addr 172.21.15.50:0/1462627205 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:35:23.725 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:23.723+0000 7f39a1200640 1 --2- 172.21.15.50:0/1462627205 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5579d24951b0 0x5579d283f1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:35:23.727 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:23.724+0000 7f399b400640 1 -- 172.21.15.50:0/1462627205 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5579d246c2f0 msgr2=0x5579d2844840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:35:23.727 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:23.724+0000 7f399b400640 1 --2- 172.21.15.50:0/1462627205 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5579d246c2f0 0x5579d2844840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:23.727 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:23.724+0000 7f399b400640 1 -- 172.21.15.50:0/1462627205 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5579d24951b0 msgr2=0x5579d283f1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:35:23.727 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:23.724+0000 7f399b400640 1 --2- 172.21.15.50:0/1462627205 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5579d24951b0 0x5579d283f1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:23.728 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:23.724+0000 7f399b400640 1 -- 172.21.15.50:0/1462627205 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5579d2842340 con 0x5579d24744d0 2024-08-31T04:35:23.728 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:23.724+0000 7f39a1200640 1 --2- 172.21.15.50:0/1462627205 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5579d246c2f0 0x5579d2844840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:35:23.728 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:23.724+0000 7f399b400640 1 --2- 172.21.15.50:0/1462627205 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5579d24744d0 0x5579d283ec80 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f3988013f30 tx=0x7f3988013f60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d9d11808f5c0fd84 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:35:23.728 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:23.724+0000 7f3990c00640 1 -- 172.21.15.50:0/1462627205 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f398803a070 con 0x5579d24744d0 2024-08-31T04:35:23.728 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:23.724+0000 7f3990c00640 1 -- 172.21.15.50:0/1462627205 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3988022070 con 0x5579d24744d0 2024-08-31T04:35:23.728 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:23.724+0000 7f3990c00640 1 -- 172.21.15.50:0/1462627205 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f398800d830 con 0x5579d24744d0 2024-08-31T04:35:23.728 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:23.725+0000 7f39aa24e740 1 -- 172.21.15.50:0/1462627205 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5579d24744d0 msgr2=0x5579d283ec80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:35:23.728 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:23.725+0000 7f39aa24e740 1 --2- 172.21.15.50:0/1462627205 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5579d24744d0 0x5579d283ec80 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f3988013f30 tx=0x7f3988013f60 comp rx=0 tx=0).stop 2024-08-31T04:35:23.728 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:23.725+0000 7f39aa24e740 1 -- 172.21.15.50:0/1462627205 shutdown_connections 2024-08-31T04:35:23.728 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:23.725+0000 7f39aa24e740 1 --2- 172.21.15.50:0/1462627205 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5579d24744d0 0x5579d283ec80 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:23.729 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:23.725+0000 7f39aa24e740 1 --2- 172.21.15.50:0/1462627205 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5579d24951b0 0x5579d283f1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:23.729 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:23.725+0000 7f39aa24e740 1 --2- 172.21.15.50:0/1462627205 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5579d246c2f0 0x5579d2844840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:23.729 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:23.725+0000 7f39aa24e740 1 -- 172.21.15.50:0/1462627205 >> 172.21.15.50:0/1462627205 conn(0x5579d2489300 msgr2=0x5579d2844130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:35:23.729 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:23.725+0000 7f39aa24e740 1 -- 172.21.15.50:0/1462627205 shutdown_connections 2024-08-31T04:35:23.729 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:23.725+0000 7f39aa24e740 1 -- 172.21.15.50:0/1462627205 wait complete. 2024-08-31T04:35:23.729 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:23.726+0000 7f39aa24e740 1 -- start start 2024-08-31T04:35:23.729 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:23.726+0000 7f39aa24e740 1 Processor -- start 2024-08-31T04:35:23.732 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:23.726+0000 7f39aa24e740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5579d246c2f0 0x5579d284c070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:35:23.732 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:23.726+0000 7f39aa24e740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5579d24744d0 0x5579d284ad30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:35:23.733 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:23.726+0000 7f39aa24e740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5579d24951b0 0x5579d284b3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:35:23.733 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:23.726+0000 7f39aa24e740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f399c1aa180 con 0x5579d24744d0 2024-08-31T04:35:23.733 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:23.726+0000 7f39aa24e740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f399c1a99f0 con 0x5579d24951b0 2024-08-31T04:35:23.733 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:23.726+0000 7f39aa24e740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f399c1a6ab0 con 0x5579d246c2f0 2024-08-31T04:35:23.733 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:23.726+0000 7f39aa24e740 10 client.0 _ll_register_callbacks cb 0x7f39880138b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:35:23.733 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:23.727+0000 7f39a1200640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5579d246c2f0 0x5579d284c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:35:23.733 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:23.727+0000 7f39a1200640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5579d246c2f0 0x5579d284c070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.50:48688/0 (socket says 172.21.15.50:48688) 2024-08-31T04:35:23.733 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:23.727+0000 7f39a1200640 1 -- 172.21.15.50:0/4239208475 learned_addr learned my addr 172.21.15.50:0/4239208475 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:35:23.733 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:23.727+0000 7f399b400640 1 --2- 172.21.15.50:0/4239208475 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5579d24744d0 0x5579d284ad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:35:23.734 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:23.727+0000 7f39a1200640 1 --2- 172.21.15.50:0/4239208475 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5579d24951b0 0x5579d284b3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:35:23.734 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:23.727+0000 7f39a1200640 1 -- 172.21.15.50:0/4239208475 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5579d24951b0 msgr2=0x5579d284b3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:35:23.734 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:23.727+0000 7f39a1200640 1 --2- 172.21.15.50:0/4239208475 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5579d24951b0 0x5579d284b3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:23.734 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:23.727+0000 7f39a1200640 1 -- 172.21.15.50:0/4239208475 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5579d24744d0 msgr2=0x5579d284ad30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:35:23.734 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:23.727+0000 7f39a1200640 1 --2- 172.21.15.50:0/4239208475 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5579d24744d0 0x5579d284ad30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:23.734 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:23.727+0000 7f39a1200640 1 -- 172.21.15.50:0/4239208475 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5579d284bb40 con 0x5579d246c2f0 2024-08-31T04:35:23.734 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:23.727+0000 7f39a1200640 1 --2- 172.21.15.50:0/4239208475 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5579d246c2f0 0x5579d284c070 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f3994009650 tx=0x7f399403e040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d78d890a3c0d6a21 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:35:23.735 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:23.727+0000 7f3986000640 10 client.0 ms_handle_connect on v2:172.21.15.177:3300/0 2024-08-31T04:35:23.735 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:23.728+0000 7f3986000640 1 -- 172.21.15.50:0/4239208475 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3994035070 con 0x5579d246c2f0 2024-08-31T04:35:23.735 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:23.728+0000 7f3986000640 1 -- 172.21.15.50:0/4239208475 <== mon.1 v2:172.21.15.177:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8219+0+0 (secure 0 0 0) 0x7f3994003cc0 con 0x5579d246c2f0 2024-08-31T04:35:23.735 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:23.728+0000 7f39aa24e740 1 -- 172.21.15.50:0/4239208475 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3988022070 con 0x5579d246c2f0 2024-08-31T04:35:23.735 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:23.728+0000 7f3986000640 1 -- 172.21.15.50:0/4239208475 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_get_version_reply(handle=1 version=71) ==== 24+0+0 (secure 0 0 0) 0x7f39940315a0 con 0x5579d246c2f0 2024-08-31T04:35:23.735 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:23.728+0000 7f39aa24e740 10 client.26503 fetch_fsmap learned FSMap version 71 2024-08-31T04:35:23.735 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:23.728+0000 7f39aa24e740 1 -- 172.21.15.50:0/4239208475 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,fsmap=71,monmap=4+}) -- 0x5579d28bc580 con 0x5579d246c2f0 2024-08-31T04:35:23.735 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:23.728+0000 7f3986000640 1 -- 172.21.15.50:0/4239208475 <== mon.1 v2:172.21.15.177:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3988022070 con 0x5579d246c2f0 2024-08-31T04:35:23.735 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:23.728+0000 7f3986000640 1 -- 172.21.15.50:0/4239208475 <== mon.1 v2:172.21.15.177:3300/0 5 ==== fsmap(e 71) ==== 8442+0+0 (secure 0 0 0) 0x7f39940456a0 con 0x5579d246c2f0 2024-08-31T04:35:23.735 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:23.728+0000 7f39aa24e740 10 client.26503 fetch_fsmap finished waiting for FSMap version 71 2024-08-31T04:35:23.735 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:23.728+0000 7f39aa24e740 10 client.26503 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T04:35:23.736 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:23.728+0000 7f39aa24e740 20 client.26503 populate_metadata read hostname 'smithi050' 2024-08-31T04:35:23.736 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:23.729+0000 7f39aa24e740 1 --2- 172.21.15.50:0/4239208475 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x5579d24291c0 0x5579d28bebb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:35:23.736 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:23.729+0000 7f39aa24e740 4 client.26503 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-31T04:35:23.736 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:23.729+0000 7f39aa24e740 1 -- 172.21.15.50:0/4239208475 --> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5579d27ab960 con 0x5579d24291c0 2024-08-31T04:35:23.736 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:23.729+0000 7f399b400640 1 --2- 172.21.15.50:0/4239208475 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x5579d24291c0 0x5579d28bebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:35:23.736 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:23.729+0000 7f399b400640 1 --2- 172.21.15.50:0/4239208475 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x5579d24291c0 0x5579d28bebb0 crc :-1 s=READY pgs=157 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=81dc1e48ad222b34 server_cookie=5b15d6a281269680 in_seq=0 out_seq=0 2024-08-31T04:35:23.736 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:23.729+0000 7f3986000640 10 client.26503 ms_handle_connect on v2:172.21.15.133:6838/2526402262 2024-08-31T04:35:23.765 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:23.763+0000 7f3986000640 1 -- 172.21.15.50:0/4239208475 <== mds.0 v2:172.21.15.133:6838/2526402262 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5579d27ab960 con 0x5579d24291c0 2024-08-31T04:35:23.765 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:23.763+0000 7f3986000640 10 client.26503 handle_command_reply: tid=0 2024-08-31T04:35:23.765 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:23.763+0000 7f39aa24e740 1 client.26503 shutdown 2024-08-31T04:35:23.765 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:23.763+0000 7f39aa24e740 1 -- 172.21.15.50:0/4239208475 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5579d246c2f0 msgr2=0x5579d284c070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:35:23.765 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:23.763+0000 7f39aa24e740 1 --2- 172.21.15.50:0/4239208475 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5579d246c2f0 0x5579d284c070 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f3994009650 tx=0x7f399403e040 comp rx=0 tx=0).stop 2024-08-31T04:35:23.765 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:23.763+0000 7f39aa24e740 1 -- 172.21.15.50:0/4239208475 shutdown_connections 2024-08-31T04:35:23.766 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:23.763+0000 7f39aa24e740 1 --2- 172.21.15.50:0/4239208475 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x5579d24291c0 0x5579d28bebb0 crc :-1 s=READY pgs=157 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:23.766 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:23.763+0000 7f39aa24e740 1 --2- 172.21.15.50:0/4239208475 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5579d24951b0 0x5579d284b3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:23.766 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:23.763+0000 7f3986000640 0 client.26503 ms_handle_reset on v2:172.21.15.133:6838/2526402262 2024-08-31T04:35:23.766 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:23.763+0000 7f39aa24e740 1 --2- 172.21.15.50:0/4239208475 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5579d24744d0 0x5579d284ad30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:23.766 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:23.763+0000 7f39aa24e740 1 --2- 172.21.15.50:0/4239208475 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5579d246c2f0 0x5579d284c070 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:23.766 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:23.763+0000 7f39aa24e740 1 -- 172.21.15.50:0/4239208475 >> 172.21.15.50:0/4239208475 conn(0x5579d2489300 msgr2=0x5579d283ec80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:35:23.766 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:23.763+0000 7f39aa24e740 1 -- 172.21.15.50:0/4239208475 shutdown_connections 2024-08-31T04:35:23.766 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:23.763+0000 7f39aa24e740 1 -- 172.21.15.50:0/4239208475 wait complete. 2024-08-31T04:35:23.767 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:23.763+0000 7f39aa24e740 20 client.26503 trim_cache size 0 max 16384 2024-08-31T04:35:23.767 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout:{ 2024-08-31T04:35:23.767 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout: "message": "", 2024-08-31T04:35:23.767 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout: "return_code": 0 2024-08-31T04:35:23.767 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout:} 2024-08-31T04:35:23.768 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:23.764+0000 7f39a3200640 1 -- 172.21.15.50:0/4201257918 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f39800b4b30 msgr2=0x7f39800b7040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:35:23.768 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:23.764+0000 7f39a3200640 1 --2- 172.21.15.50:0/4201257918 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f39800b4b30 0x7f39800b7040 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f398c00c760 tx=0x7f398c0e2de0 comp rx=0 tx=0).stop 2024-08-31T04:35:23.769 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:23.764+0000 7f39a3200640 1 -- 172.21.15.50:0/4201257918 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f399c103470 msgr2=0x7f399c199c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:35:23.769 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:23.764+0000 7f39a3200640 1 --2- 172.21.15.50:0/4201257918 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f399c103470 0x7f399c199c70 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f398c00ea60 tx=0x7f398c00ef20 comp rx=0 tx=0).stop 2024-08-31T04:35:23.769 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:23.764+0000 7f39a3200640 1 -- 172.21.15.50:0/4201257918 shutdown_connections 2024-08-31T04:35:23.769 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:23.764+0000 7f39a3200640 1 --2- 172.21.15.50:0/4201257918 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f39800b4b30 0x7f39800b7040 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:23.769 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:23.764+0000 7f39a3200640 1 --2- 172.21.15.50:0/4201257918 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f399c104e90 0x7f399c19ae90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:23.769 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:23.764+0000 7f39a3200640 1 --2- 172.21.15.50:0/4201257918 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f399c1044f0 0x7f399c19a2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:23.769 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:23.764+0000 7f39a3200640 1 --2- 172.21.15.50:0/4201257918 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f399c103470 0x7f399c199c70 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:23.769 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:23.764+0000 7f39a3200640 1 -- 172.21.15.50:0/4201257918 >> 172.21.15.50:0/4201257918 conn(0x7f399c0fedd0 msgr2=0x7f399c1077f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:35:23.769 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:23.764+0000 7f39a3200640 1 -- 172.21.15.50:0/4201257918 shutdown_connections 2024-08-31T04:35:23.769 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:23.764+0000 7f39a3200640 1 -- 172.21.15.50:0/4201257918 wait complete. 2024-08-31T04:35:24.043 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:35:23 smithi133 ceph-mon[22177]: pgmap v743: 97 pgs: 97 active+clean; 1.5 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 749 op/s 2024-08-31T04:35:24.200 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:35:23 smithi050 ceph-mon[17259]: pgmap v743: 97 pgs: 97 active+clean; 1.5 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 749 op/s 2024-08-31T04:35:24.248 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:35:23 smithi177 ceph-mon[22025]: pgmap v743: 97 pgs: 97 active+clean; 1.5 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 749 op/s 2024-08-31T04:35:26.043 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:35:25 smithi133 ceph-mon[22177]: pgmap v744: 97 pgs: 97 active+clean; 1.5 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 521 op/s 2024-08-31T04:35:26.200 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:35:25 smithi050 ceph-mon[17259]: pgmap v744: 97 pgs: 97 active+clean; 1.5 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 521 op/s 2024-08-31T04:35:26.246 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:35:25 smithi177 ceph-mon[22025]: pgmap v744: 97 pgs: 97 active+clean; 1.5 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 521 op/s 2024-08-31T04:35:28.043 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:35:27 smithi133 ceph-mon[22177]: pgmap v745: 97 pgs: 97 active+clean; 1.4 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 466 op/s 2024-08-31T04:35:28.151 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:35:27 smithi050 ceph-mon[17259]: pgmap v745: 97 pgs: 97 active+clean; 1.4 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 466 op/s 2024-08-31T04:35:28.246 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:35:27 smithi177 ceph-mon[22025]: pgmap v745: 97 pgs: 97 active+clean; 1.4 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 466 op/s 2024-08-31T04:35:30.043 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:35:29 smithi133 ceph-mon[22177]: pgmap v746: 97 pgs: 97 active+clean; 1.4 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.2 MiB/s wr, 367 op/s 2024-08-31T04:35:30.152 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:35:29 smithi050 ceph-mon[17259]: pgmap v746: 97 pgs: 97 active+clean; 1.4 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.2 MiB/s wr, 367 op/s 2024-08-31T04:35:30.246 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:35:29 smithi177 ceph-mon[22025]: pgmap v746: 97 pgs: 97 active+clean; 1.4 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.2 MiB/s wr, 367 op/s 2024-08-31T04:35:32.043 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:35:31 smithi133 ceph-mon[22177]: pgmap v747: 97 pgs: 97 active+clean; 1.4 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 383 op/s 2024-08-31T04:35:32.143 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:35:31 smithi050 ceph-mon[17259]: pgmap v747: 97 pgs: 97 active+clean; 1.4 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 383 op/s 2024-08-31T04:35:32.246 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:35:31 smithi177 ceph-mon[22025]: pgmap v747: 97 pgs: 97 active+clean; 1.4 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 383 op/s 2024-08-31T04:35:34.043 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:35:33 smithi133 ceph-mon[22177]: pgmap v748: 97 pgs: 97 active+clean; 1.4 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 413 op/s 2024-08-31T04:35:34.140 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:35:33 smithi050 ceph-mon[17259]: pgmap v748: 97 pgs: 97 active+clean; 1.4 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 413 op/s 2024-08-31T04:35:34.246 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:35:33 smithi177 ceph-mon[22025]: pgmap v748: 97 pgs: 97 active+clean; 1.4 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 413 op/s 2024-08-31T04:35:35.950 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:35:35 smithi050 ceph-mon[17259]: pgmap v749: 97 pgs: 97 active+clean; 1.4 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.1 MiB/s wr, 360 op/s 2024-08-31T04:35:36.042 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:35:35 smithi133 ceph-mon[22177]: pgmap v749: 97 pgs: 97 active+clean; 1.4 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.1 MiB/s wr, 360 op/s 2024-08-31T04:35:36.246 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:35:35 smithi177 ceph-mon[22025]: pgmap v749: 97 pgs: 97 active+clean; 1.4 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.1 MiB/s wr, 360 op/s 2024-08-31T04:35:36.989 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:36.987+0000 7fd6dd600640 1 -- 172.21.15.50:0/2566309076 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd6d8106500 msgr2=0x7fd6d8106910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:35:36.989 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:36.987+0000 7fd6dd600640 1 --2- 172.21.15.50:0/2566309076 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd6d8106500 0x7fd6d8106910 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fd6c0009900 tx=0x7fd6c002a410 comp rx=0 tx=0).stop 2024-08-31T04:35:36.989 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:36.987+0000 7fd6dd600640 1 -- 172.21.15.50:0/2566309076 shutdown_connections 2024-08-31T04:35:36.989 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:36.987+0000 7fd6dd600640 1 --2- 172.21.15.50:0/2566309076 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd6d8106ea0 0x7fd6d810d840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:36.989 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:36.987+0000 7fd6dd600640 1 --2- 172.21.15.50:0/2566309076 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd6d8106500 0x7fd6d8106910 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:36.989 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:36.987+0000 7fd6dd600640 1 --2- 172.21.15.50:0/2566309076 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd6d8105480 0x7fd6d81058f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:36.989 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:36.987+0000 7fd6dd600640 1 -- 172.21.15.50:0/2566309076 >> 172.21.15.50:0/2566309076 conn(0x7fd6d8100da0 msgr2=0x7fd6d8103270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:35:36.989 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:36.987+0000 7fd6dd600640 1 -- 172.21.15.50:0/2566309076 shutdown_connections 2024-08-31T04:35:36.989 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:36.987+0000 7fd6dd600640 1 -- 172.21.15.50:0/2566309076 wait complete. 2024-08-31T04:35:36.991 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:36.988+0000 7fd6dd600640 1 Processor -- start 2024-08-31T04:35:36.991 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:36.988+0000 7fd6dd600640 1 -- start start 2024-08-31T04:35:36.992 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:36.988+0000 7fd6dd600640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd6d8105480 0x7fd6d819bd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:35:36.992 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:36.988+0000 7fd6dd600640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd6d8106500 0x7fd6d819c380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:35:36.992 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:36.989+0000 7fd6dd600640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd6d8106ea0 0x7fd6d819cf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:35:36.992 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:36.989+0000 7fd6dd600640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fd6d8111100 con 0x7fd6d8106ea0 2024-08-31T04:35:36.992 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:36.989+0000 7fd6dd600640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7fd6d8110f80 con 0x7fd6d8105480 2024-08-31T04:35:36.992 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:36.989+0000 7fd6dd600640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fd6d8111280 con 0x7fd6d8106500 2024-08-31T04:35:36.992 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:36.989+0000 7fd6d7e00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd6d8105480 0x7fd6d819bd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:35:36.992 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:36.989+0000 7fd6d7e00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd6d8105480 0x7fd6d819bd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.50:46536/0 (socket says 172.21.15.50:46536) 2024-08-31T04:35:36.992 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:36.989+0000 7fd6d7e00640 1 -- 172.21.15.50:0/3627928994 learned_addr learned my addr 172.21.15.50:0/3627928994 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:35:36.992 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:36.989+0000 7fd6dcc00640 1 --2- 172.21.15.50:0/3627928994 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd6d8106ea0 0x7fd6d819cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:35:36.992 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:36.989+0000 7fd6cf400640 1 --2- 172.21.15.50:0/3627928994 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd6d8106500 0x7fd6d819c380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:35:36.993 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:36.989+0000 7fd6d7e00640 1 -- 172.21.15.50:0/3627928994 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd6d8106500 msgr2=0x7fd6d819c380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:35:36.993 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:36.989+0000 7fd6d7e00640 1 --2- 172.21.15.50:0/3627928994 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd6d8106500 0x7fd6d819c380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:36.993 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:36.989+0000 7fd6d7e00640 1 -- 172.21.15.50:0/3627928994 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd6d8106ea0 msgr2=0x7fd6d819cf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:35:36.993 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:36.989+0000 7fd6d7e00640 1 --2- 172.21.15.50:0/3627928994 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd6d8106ea0 0x7fd6d819cf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:36.993 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:36.989+0000 7fd6d7e00640 1 -- 172.21.15.50:0/3627928994 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6d819d750 con 0x7fd6d8105480 2024-08-31T04:35:36.993 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:36.989+0000 7fd6cf400640 1 --2- 172.21.15.50:0/3627928994 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd6d8106500 0x7fd6d819c380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T04:35:36.993 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:36.990+0000 7fd6d7e00640 1 --2- 172.21.15.50:0/3627928994 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd6d8105480 0x7fd6d819bd10 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fd6c800eb90 tx=0x7fd6c800c6a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:35:36.993 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:36.990+0000 7fd6d5600640 1 -- 172.21.15.50:0/3627928994 <== mon.2 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6c8004d20 con 0x7fd6d8105480 2024-08-31T04:35:36.993 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:36.990+0000 7fd6d5600640 1 -- 172.21.15.50:0/3627928994 <== mon.2 v2:172.21.15.133:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd6c800ee90 con 0x7fd6d8105480 2024-08-31T04:35:36.993 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:36.990+0000 7fd6dd600640 1 -- 172.21.15.50:0/3627928994 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd6d819da40 con 0x7fd6d8105480 2024-08-31T04:35:36.993 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:36.990+0000 7fd6d5600640 1 -- 172.21.15.50:0/3627928994 <== mon.2 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6c8010670 con 0x7fd6d8105480 2024-08-31T04:35:36.993 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:36.990+0000 7fd6dd600640 1 -- 172.21.15.50:0/3627928994 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd6d81a4130 con 0x7fd6d8105480 2024-08-31T04:35:36.994 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:36.993+0000 7fd6e5e3e740 1 Processor -- start 2024-08-31T04:35:36.994 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:36.993+0000 7fd6e5e3e740 1 -- start start 2024-08-31T04:35:36.996 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:36.994+0000 7fd6e5e3e740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560d0a2c51b0 0x560d0a66ad40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:35:36.996 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:36.994+0000 7fd6e5e3e740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x560d0a29c2f0 0x560d0a66b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:35:36.996 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:36.994+0000 7fd6e5e3e740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x560d0a2a44d0 0x560d0a66bf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:35:36.996 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:36.994+0000 7fd6e5e3e740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x560d0a5ddf70 con 0x560d0a2c51b0 2024-08-31T04:35:36.996 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:36.994+0000 7fd6e5e3e740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x560d0a5cd500 con 0x560d0a29c2f0 2024-08-31T04:35:36.996 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:36.994+0000 7fd6e5e3e740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x560d0a5d14b0 con 0x560d0a2a44d0 2024-08-31T04:35:36.996 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:36.994+0000 7fd6cf400640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x560d0a2a44d0 0x560d0a66bf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:35:36.996 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:36.994+0000 7fd6dcc00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560d0a2c51b0 0x560d0a66ad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:35:36.996 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:36.994+0000 7fd6cf400640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x560d0a2a44d0 0x560d0a66bf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.50:52044/0 (socket says 172.21.15.50:52044) 2024-08-31T04:35:36.997 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:36.994+0000 7fd6cf400640 1 -- 172.21.15.50:0/3252010862 learned_addr learned my addr 172.21.15.50:0/3252010862 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:35:36.997 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:36.994+0000 7fd6cf400640 1 -- 172.21.15.50:0/3252010862 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x560d0a29c2f0 msgr2=0x560d0a66b3b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-31T04:35:36.997 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:36.994+0000 7fd6cf400640 1 --2- 172.21.15.50:0/3252010862 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x560d0a29c2f0 0x560d0a66b3b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:36.997 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:36.994+0000 7fd6cf400640 1 -- 172.21.15.50:0/3252010862 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560d0a2c51b0 msgr2=0x560d0a66ad40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:35:36.997 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:36.994+0000 7fd6cf400640 1 --2- 172.21.15.50:0/3252010862 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560d0a2c51b0 0x560d0a66ad40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:36.997 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:36.994+0000 7fd6cf400640 1 -- 172.21.15.50:0/3252010862 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560d0a587c10 con 0x560d0a2a44d0 2024-08-31T04:35:36.997 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:36.994+0000 7fd6dcc00640 1 --2- 172.21.15.50:0/3252010862 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560d0a2c51b0 0x560d0a66ad40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:35:36.997 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:36.995+0000 7fd6d5600640 1 -- 172.21.15.50:0/3627928994 <== mon.2 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 18) ==== 152577+0+0 (secure 0 0 0) 0x7fd6c8005020 con 0x7fd6d8105480 2024-08-31T04:35:36.997 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:36.995+0000 7fd6cf400640 1 --2- 172.21.15.50:0/3252010862 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x560d0a2a44d0 0x560d0a66bf00 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fd6c0006010 tx=0x7fd6c0031620 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f3ab74f72df9c server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:35:36.999 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:36.995+0000 7fd6cd200640 1 -- 172.21.15.50:0/3252010862 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6c003f070 con 0x560d0a2a44d0 2024-08-31T04:35:36.999 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:36.995+0000 7fd6cd200640 1 -- 172.21.15.50:0/3252010862 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd6c0004040 con 0x560d0a2a44d0 2024-08-31T04:35:36.999 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:36.995+0000 7fd6cd200640 1 -- 172.21.15.50:0/3252010862 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6c0035030 con 0x560d0a2a44d0 2024-08-31T04:35:36.999 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:36.996+0000 7fd6e5e3e740 1 -- 172.21.15.50:0/3252010862 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x560d0a2a44d0 msgr2=0x560d0a66bf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:35:36.999 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:36.996+0000 7fd6e5e3e740 1 --2- 172.21.15.50:0/3252010862 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x560d0a2a44d0 0x560d0a66bf00 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fd6c0006010 tx=0x7fd6c0031620 comp rx=0 tx=0).stop 2024-08-31T04:35:36.999 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:36.996+0000 7fd6d5600640 1 --2- 172.21.15.50:0/3627928994 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fd6bc0b4c30 0x7fd6bc0b7140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:35:36.999 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:36.996+0000 7fd6e5e3e740 1 -- 172.21.15.50:0/3252010862 shutdown_connections 2024-08-31T04:35:36.999 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:36.996+0000 7fd6e5e3e740 1 --2- 172.21.15.50:0/3252010862 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x560d0a2a44d0 0x560d0a66bf00 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:36.999 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:36.996+0000 7fd6e5e3e740 1 --2- 172.21.15.50:0/3252010862 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x560d0a29c2f0 0x560d0a66b3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:36.999 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:36.996+0000 7fd6e5e3e740 1 --2- 172.21.15.50:0/3252010862 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560d0a2c51b0 0x560d0a66ad40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:36.999 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:36.996+0000 7fd6e5e3e740 1 -- 172.21.15.50:0/3252010862 >> 172.21.15.50:0/3252010862 conn(0x560d0a2b9300 msgr2=0x560d0a6667d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:35:37.000 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:36.996+0000 7fd6d5600640 1 -- 172.21.15.50:0/3627928994 <== mon.2 v2:172.21.15.133:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8219+0+0 (secure 0 0 0) 0x7fd6c80e5800 con 0x7fd6d8105480 2024-08-31T04:35:37.000 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:36.997+0000 7fd6e5e3e740 1 -- 172.21.15.50:0/3252010862 shutdown_connections 2024-08-31T04:35:37.000 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:36.997+0000 7fd6e5e3e740 1 -- 172.21.15.50:0/3252010862 wait complete. 2024-08-31T04:35:37.000 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:36.997+0000 7fd6dcc00640 1 --2- 172.21.15.50:0/3627928994 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fd6bc0b4c30 0x7fd6bc0b7140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:35:37.000 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:36.997+0000 7fd6e5e3e740 1 -- start start 2024-08-31T04:35:37.000 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:36.997+0000 7fd6dcc00640 1 --2- 172.21.15.50:0/3627928994 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fd6bc0b4c30 0x7fd6bc0b7140 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fd6d0009d60 tx=0x7fd6d0005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:35:37.000 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:36.998+0000 7fd6e5e3e740 1 Processor -- start 2024-08-31T04:35:37.002 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:36.998+0000 7fd6e5e3e740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560d0a29c2f0 0x560d0a6743d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:35:37.002 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:36.998+0000 7fd6e5e3e740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x560d0a2a44d0 0x560d0a674a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:35:37.002 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:36.998+0000 7fd6e5e3e740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x560d0a2c51b0 0x560d0a675600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:35:37.003 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:36.998+0000 7fd6e5e3e740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x560d0a506ab0 con 0x560d0a29c2f0 2024-08-31T04:35:37.003 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:36.998+0000 7fd6e5e3e740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x560d0a574320 con 0x560d0a2c51b0 2024-08-31T04:35:37.003 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:36.998+0000 7fd6e5e3e740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x560d0a66c9c0 con 0x560d0a2a44d0 2024-08-31T04:35:37.003 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:36.998+0000 7fd6e5e3e740 10 client.0 _ll_register_callbacks cb 0x560d0a5ade80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:35:37.003 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:36.998+0000 7fd6d7e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560d0a29c2f0 0x560d0a6743d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:35:37.003 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:36.998+0000 7fd6cf400640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x560d0a2a44d0 0x560d0a674a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:35:37.003 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:36.998+0000 7fd6cf400640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x560d0a2a44d0 0x560d0a674a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.50:52052/0 (socket says 172.21.15.50:52052) 2024-08-31T04:35:37.003 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:36.998+0000 7fd6cf400640 1 -- 172.21.15.50:0/3547744122 learned_addr learned my addr 172.21.15.50:0/3547744122 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:35:37.003 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:36.998+0000 7fd6dcc00640 1 --2- 172.21.15.50:0/3547744122 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x560d0a2c51b0 0x560d0a675600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:35:37.003 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:36.999+0000 7fd6d7e00640 1 -- 172.21.15.50:0/3547744122 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x560d0a2a44d0 msgr2=0x560d0a674a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:35:37.003 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:36.999+0000 7fd6d7e00640 1 --2- 172.21.15.50:0/3547744122 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x560d0a2a44d0 0x560d0a674a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:37.003 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:36.999+0000 7fd6d7e00640 1 -- 172.21.15.50:0/3547744122 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x560d0a2c51b0 msgr2=0x560d0a675600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:35:37.004 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:36.999+0000 7fd6d7e00640 1 --2- 172.21.15.50:0/3547744122 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x560d0a2c51b0 0x560d0a675600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:37.004 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:36.999+0000 7fd6d7e00640 1 -- 172.21.15.50:0/3547744122 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560d0a330790 con 0x560d0a29c2f0 2024-08-31T04:35:37.004 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:36.999+0000 7fd6d7e00640 1 --2- 172.21.15.50:0/3547744122 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560d0a29c2f0 0x560d0a6743d0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7fd6c80e32b0 tx=0x7fd6c80abbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c449b26673b43ee server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:35:37.004 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:36.999+0000 7fd6c5600640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-08-31T04:35:37.004 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:36.999+0000 7fd6c5600640 1 -- 172.21.15.50:0/3547744122 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6c80ac1e0 con 0x560d0a29c2f0 2024-08-31T04:35:37.004 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:36.999+0000 7fd6c5600640 1 -- 172.21.15.50:0/3547744122 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8219+0+0 (secure 0 0 0) 0x7fd6c80b5280 con 0x560d0a29c2f0 2024-08-31T04:35:37.004 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:36.999+0000 7fd6e5e3e740 1 -- 172.21.15.50:0/3547744122 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd6c0004040 con 0x560d0a29c2f0 2024-08-31T04:35:37.004 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:36.999+0000 7fd6c5600640 1 -- 172.21.15.50:0/3547744122 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=71) ==== 24+0+0 (secure 0 0 0) 0x7fd6c80b0a50 con 0x560d0a29c2f0 2024-08-31T04:35:37.004 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:36.999+0000 7fd6e5e3e740 10 client.16566 fetch_fsmap learned FSMap version 71 2024-08-31T04:35:37.004 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:37.000+0000 7fd6e5e3e740 1 -- 172.21.15.50:0/3547744122 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=71,monmap=4+}) -- 0x560d0a3a9620 con 0x560d0a29c2f0 2024-08-31T04:35:37.004 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:37.000+0000 7fd6c5600640 1 -- 172.21.15.50:0/3547744122 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd6c0004040 con 0x560d0a29c2f0 2024-08-31T04:35:37.004 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:37.000+0000 7fd6c5600640 1 -- 172.21.15.50:0/3547744122 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 71) ==== 8442+0+0 (secure 0 0 0) 0x7fd6c8005310 con 0x560d0a29c2f0 2024-08-31T04:35:37.004 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:37.000+0000 7fd6e5e3e740 10 client.16566 fetch_fsmap finished waiting for FSMap version 71 2024-08-31T04:35:37.005 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:37.000+0000 7fd6e5e3e740 10 client.16566 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T04:35:37.005 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:37.000+0000 7fd6e5e3e740 20 client.16566 populate_metadata read hostname 'smithi050' 2024-08-31T04:35:37.005 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:37.000+0000 7fd6e5e3e740 1 --2- 172.21.15.50:0/3547744122 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x560d0a283d80 0x560d0a681c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:35:37.005 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:37.000+0000 7fd6e5e3e740 4 client.16566 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T04:35:37.005 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:37.000+0000 7fd6e5e3e740 1 -- 172.21.15.50:0/3547744122 --> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560d0a5dfec0 con 0x560d0a283d80 2024-08-31T04:35:37.005 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:37.000+0000 7fd6cf400640 1 --2- 172.21.15.50:0/3547744122 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x560d0a283d80 0x560d0a681c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:35:37.005 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:37.001+0000 7fd6cf400640 1 --2- 172.21.15.50:0/3547744122 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x560d0a283d80 0x560d0a681c60 crc :-1 s=READY pgs=159 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b63677ff8b293673 server_cookie=d58a11fbe120925f in_seq=0 out_seq=0 2024-08-31T04:35:37.005 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:37.001+0000 7fd6c5600640 10 client.16566 ms_handle_connect on v2:172.21.15.133:6838/2526402262 2024-08-31T04:35:37.006 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:37.002+0000 7fd6c5600640 1 -- 172.21.15.50:0/3547744122 <== mds.0 v2:172.21.15.133:6838/2526402262 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x560d0a5dfec0 con 0x560d0a283d80 2024-08-31T04:35:37.006 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:37.002+0000 7fd6c5600640 10 client.16566 handle_command_reply: tid=0 2024-08-31T04:35:37.006 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:37.002+0000 7fd6e5e3e740 1 client.16566 shutdown 2024-08-31T04:35:37.006 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:37.002+0000 7fd6e5e3e740 1 -- 172.21.15.50:0/3547744122 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560d0a29c2f0 msgr2=0x560d0a6743d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:35:37.006 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:37.002+0000 7fd6e5e3e740 1 --2- 172.21.15.50:0/3547744122 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560d0a29c2f0 0x560d0a6743d0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7fd6c80e32b0 tx=0x7fd6c80abbf0 comp rx=0 tx=0).stop 2024-08-31T04:35:37.007 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:37.002+0000 7fd6e5e3e740 1 -- 172.21.15.50:0/3547744122 shutdown_connections 2024-08-31T04:35:37.007 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:37.002+0000 7fd6e5e3e740 1 --2- 172.21.15.50:0/3547744122 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x560d0a283d80 0x560d0a681c60 crc :-1 s=READY pgs=159 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:37.007 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:37.002+0000 7fd6e5e3e740 1 --2- 172.21.15.50:0/3547744122 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x560d0a2a44d0 0x560d0a674a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:37.007 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:37.002+0000 7fd6e5e3e740 1 --2- 172.21.15.50:0/3547744122 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x560d0a2c51b0 0x560d0a675600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:37.007 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:37.002+0000 7fd6c5600640 0 client.16566 ms_handle_reset on v2:172.21.15.133:6838/2526402262 2024-08-31T04:35:37.007 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:37.002+0000 7fd6e5e3e740 1 --2- 172.21.15.50:0/3547744122 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560d0a29c2f0 0x560d0a6743d0 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:37.007 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:37.002+0000 7fd6e5e3e740 1 -- 172.21.15.50:0/3547744122 >> 172.21.15.50:0/3547744122 conn(0x560d0a2b9300 msgr2=0x560d0a664d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:35:37.007 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:37.002+0000 7fd6e5e3e740 1 -- 172.21.15.50:0/3547744122 shutdown_connections 2024-08-31T04:35:37.007 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:37.002+0000 7fd6e5e3e740 1 -- 172.21.15.50:0/3547744122 wait complete. 2024-08-31T04:35:37.007 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:37.003+0000 7fd6e5e3e740 20 client.16566 trim_cache size 0 max 16384 2024-08-31T04:35:37.021 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:37.019+0000 7fd6e5e3e740 1 Processor -- start 2024-08-31T04:35:37.021 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:37.019+0000 7fd6e5e3e740 1 -- start start 2024-08-31T04:35:37.021 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:37.019+0000 7fd6e5e3e740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x560d0a29c2f0 0x560d0a673030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:35:37.021 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:37.019+0000 7fd6e5e3e740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560d0a2a44d0 0x560d0a666c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:35:37.021 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:37.019+0000 7fd6e5e3e740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x560d0a2c51b0 0x560d0a667150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:35:37.021 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:37.019+0000 7fd6e5e3e740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fd6d81acc40 con 0x560d0a2a44d0 2024-08-31T04:35:37.021 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:37.019+0000 7fd6e5e3e740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7fd6d81ae9c0 con 0x560d0a2c51b0 2024-08-31T04:35:37.021 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:37.019+0000 7fd6e5e3e740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fd6d81ad3d0 con 0x560d0a29c2f0 2024-08-31T04:35:37.022 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:37.020+0000 7fd6d7e00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x560d0a29c2f0 0x560d0a673030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:35:37.022 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:37.020+0000 7fd6dcc00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x560d0a2c51b0 0x560d0a667150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:35:37.022 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:37.020+0000 7fd6d7e00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x560d0a29c2f0 0x560d0a673030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.50:52056/0 (socket says 172.21.15.50:52056) 2024-08-31T04:35:37.022 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:37.020+0000 7fd6d7e00640 1 -- 172.21.15.50:0/3942164382 learned_addr learned my addr 172.21.15.50:0/3942164382 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:35:37.022 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:37.020+0000 7fd6cf400640 1 --2- 172.21.15.50:0/3942164382 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560d0a2a44d0 0x560d0a666c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:35:37.023 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:37.020+0000 7fd6d7e00640 1 -- 172.21.15.50:0/3942164382 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x560d0a2c51b0 msgr2=0x560d0a667150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:35:37.023 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:37.020+0000 7fd6d7e00640 1 --2- 172.21.15.50:0/3942164382 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x560d0a2c51b0 0x560d0a667150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:37.023 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:37.020+0000 7fd6d7e00640 1 -- 172.21.15.50:0/3942164382 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560d0a2a44d0 msgr2=0x560d0a666c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:35:37.023 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:37.020+0000 7fd6d7e00640 1 --2- 172.21.15.50:0/3942164382 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560d0a2a44d0 0x560d0a666c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:37.024 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:37.020+0000 7fd6d7e00640 1 -- 172.21.15.50:0/3942164382 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560d0a67c8a0 con 0x560d0a29c2f0 2024-08-31T04:35:37.024 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:37.020+0000 7fd6cf400640 1 --2- 172.21.15.50:0/3942164382 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560d0a2a44d0 0x560d0a666c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:35:37.024 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:37.021+0000 7fd6d7e00640 1 --2- 172.21.15.50:0/3942164382 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x560d0a29c2f0 0x560d0a673030 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fd6c80e3300 tx=0x7fd6c8009a10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7864f03af41d65cb server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:35:37.024 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:37.021+0000 7fd6c7e00640 1 -- 172.21.15.50:0/3942164382 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6c80ac1e0 con 0x560d0a29c2f0 2024-08-31T04:35:37.024 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:37.021+0000 7fd6c7e00640 1 -- 172.21.15.50:0/3942164382 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd6c80b5500 con 0x560d0a29c2f0 2024-08-31T04:35:37.024 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:37.021+0000 7fd6c7e00640 1 -- 172.21.15.50:0/3942164382 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6c80c1af0 con 0x560d0a29c2f0 2024-08-31T04:35:37.024 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:37.022+0000 7fd6e5e3e740 1 -- 172.21.15.50:0/3942164382 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x560d0a29c2f0 msgr2=0x560d0a673030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:35:37.024 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:37.022+0000 7fd6e5e3e740 1 --2- 172.21.15.50:0/3942164382 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x560d0a29c2f0 0x560d0a673030 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fd6c80e3300 tx=0x7fd6c8009a10 comp rx=0 tx=0).stop 2024-08-31T04:35:37.024 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:37.022+0000 7fd6e5e3e740 1 -- 172.21.15.50:0/3942164382 shutdown_connections 2024-08-31T04:35:37.024 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:37.022+0000 7fd6e5e3e740 1 --2- 172.21.15.50:0/3942164382 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x560d0a2c51b0 0x560d0a667150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:37.024 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:37.022+0000 7fd6e5e3e740 1 --2- 172.21.15.50:0/3942164382 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560d0a2a44d0 0x560d0a666c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:37.024 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:37.022+0000 7fd6e5e3e740 1 --2- 172.21.15.50:0/3942164382 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x560d0a29c2f0 0x560d0a673030 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:37.024 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:37.022+0000 7fd6e5e3e740 1 -- 172.21.15.50:0/3942164382 >> 172.21.15.50:0/3942164382 conn(0x560d0a2b9300 msgr2=0x560d0a672920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:35:37.025 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:37.022+0000 7fd6e5e3e740 1 -- 172.21.15.50:0/3942164382 shutdown_connections 2024-08-31T04:35:37.025 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:37.022+0000 7fd6e5e3e740 1 -- 172.21.15.50:0/3942164382 wait complete. 2024-08-31T04:35:37.027 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:37.022+0000 7fd6e5e3e740 1 -- start start 2024-08-31T04:35:37.027 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:37.023+0000 7fd6e5e3e740 1 Processor -- start 2024-08-31T04:35:37.027 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:37.023+0000 7fd6e5e3e740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x560d0a29c2f0 0x560d0a67bf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:35:37.027 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:37.023+0000 7fd6e5e3e740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x560d0a2a44d0 0x560d0a67abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:35:37.027 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:37.023+0000 7fd6e5e3e740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560d0a2c51b0 0x560d0a67b110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:35:37.027 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:37.023+0000 7fd6e5e3e740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fd6d81ae2f0 con 0x560d0a2c51b0 2024-08-31T04:35:37.028 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:37.023+0000 7fd6e5e3e740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7fd6d81adb60 con 0x560d0a29c2f0 2024-08-31T04:35:37.028 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:37.023+0000 7fd6e5e3e740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fd6d81aac20 con 0x560d0a2a44d0 2024-08-31T04:35:37.028 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:37.023+0000 7fd6e5e3e740 10 client.0 _ll_register_callbacks cb 0x7fd6c80a8190 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:35:37.028 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:37.023+0000 7fd6d7e00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x560d0a29c2f0 0x560d0a67bf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:35:37.028 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:37.023+0000 7fd6d7e00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x560d0a29c2f0 0x560d0a67bf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.50:46574/0 (socket says 172.21.15.50:46574) 2024-08-31T04:35:37.028 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:37.023+0000 7fd6cf400640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x560d0a2a44d0 0x560d0a67abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:35:37.028 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:37.023+0000 7fd6d7e00640 1 -- 172.21.15.50:0/2017840450 learned_addr learned my addr 172.21.15.50:0/2017840450 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:35:37.028 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:37.023+0000 7fd6dcc00640 1 --2- 172.21.15.50:0/2017840450 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560d0a2c51b0 0x560d0a67b110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:35:37.028 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:37.024+0000 7fd6d7e00640 1 -- 172.21.15.50:0/2017840450 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x560d0a2a44d0 msgr2=0x560d0a67abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:35:37.028 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:37.024+0000 7fd6d7e00640 1 --2- 172.21.15.50:0/2017840450 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x560d0a2a44d0 0x560d0a67abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:37.028 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:37.024+0000 7fd6d7e00640 1 -- 172.21.15.50:0/2017840450 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560d0a2c51b0 msgr2=0x560d0a67b110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:35:37.028 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:37.024+0000 7fd6d7e00640 1 --2- 172.21.15.50:0/2017840450 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560d0a2c51b0 0x560d0a67b110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:37.028 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:37.024+0000 7fd6d7e00640 1 -- 172.21.15.50:0/2017840450 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560d0a67b7b0 con 0x560d0a29c2f0 2024-08-31T04:35:37.029 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:37.024+0000 7fd6d7e00640 1 --2- 172.21.15.50:0/2017840450 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x560d0a29c2f0 0x560d0a67bf10 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fd6c80a9450 tx=0x7fd6c80e3330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b93d96178f9e347e server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:35:37.029 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:37.024+0000 7fd6c5600640 10 client.0 ms_handle_connect on v2:172.21.15.133:3300/0 2024-08-31T04:35:37.029 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:37.024+0000 7fd6c5600640 1 -- 172.21.15.50:0/2017840450 <== mon.2 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6c80ac1e0 con 0x560d0a29c2f0 2024-08-31T04:35:37.029 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:37.024+0000 7fd6e5e3e740 1 -- 172.21.15.50:0/2017840450 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd6c80b5500 con 0x560d0a29c2f0 2024-08-31T04:35:37.029 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:37.024+0000 7fd6c5600640 1 -- 172.21.15.50:0/2017840450 <== mon.2 v2:172.21.15.133:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8219+0+0 (secure 0 0 0) 0x7fd6c80ab650 con 0x560d0a29c2f0 2024-08-31T04:35:37.029 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:37.024+0000 7fd6c5600640 1 -- 172.21.15.50:0/2017840450 <== mon.2 v2:172.21.15.133:3300/0 3 ==== mon_get_version_reply(handle=1 version=71) ==== 24+0+0 (secure 0 0 0) 0x7fd6c80c1af0 con 0x560d0a29c2f0 2024-08-31T04:35:37.029 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:37.024+0000 7fd6e5e3e740 10 client.26531 fetch_fsmap learned FSMap version 71 2024-08-31T04:35:37.029 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:37.024+0000 7fd6e5e3e740 1 -- 172.21.15.50:0/2017840450 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,fsmap=71,monmap=4+}) -- 0x560d0a6ec620 con 0x560d0a29c2f0 2024-08-31T04:35:37.029 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:37.025+0000 7fd6c5600640 1 -- 172.21.15.50:0/2017840450 <== mon.2 v2:172.21.15.133:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd6c80b5500 con 0x560d0a29c2f0 2024-08-31T04:35:37.029 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:37.025+0000 7fd6c5600640 1 -- 172.21.15.50:0/2017840450 <== mon.2 v2:172.21.15.133:3300/0 5 ==== fsmap(e 71) ==== 8442+0+0 (secure 0 0 0) 0x7fd6c80cd030 con 0x560d0a29c2f0 2024-08-31T04:35:37.029 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:37.025+0000 7fd6e5e3e740 10 client.26531 fetch_fsmap finished waiting for FSMap version 71 2024-08-31T04:35:37.029 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:37.025+0000 7fd6e5e3e740 10 client.26531 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T04:35:37.029 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:37.025+0000 7fd6e5e3e740 20 client.26531 populate_metadata read hostname 'smithi050' 2024-08-31T04:35:37.030 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:37.025+0000 7fd6e5e3e740 1 --2- 172.21.15.50:0/2017840450 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x560d0a2591c0 0x560d0a6eec10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:35:37.030 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:37.025+0000 7fd6e5e3e740 4 client.26531 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-31T04:35:37.030 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:37.025+0000 7fd6e5e3e740 1 -- 172.21.15.50:0/2017840450 --> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] -- command(tid 0: {"prefix": "flush journal"}) -- 0x560d0a5db960 con 0x560d0a2591c0 2024-08-31T04:35:37.030 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:37.025+0000 7fd6cf400640 1 --2- 172.21.15.50:0/2017840450 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x560d0a2591c0 0x560d0a6eec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:35:37.030 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:37.026+0000 7fd6cf400640 1 --2- 172.21.15.50:0/2017840450 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x560d0a2591c0 0x560d0a6eec10 crc :-1 s=READY pgs=160 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=49475a9931fdccfd server_cookie=2632e81b177d9349 in_seq=0 out_seq=0 2024-08-31T04:35:37.030 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:37.026+0000 7fd6c5600640 10 client.26531 ms_handle_connect on v2:172.21.15.133:6838/2526402262 2024-08-31T04:35:37.203 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:35:36 smithi050 ceph-mon[17259]: pgmap v750: 97 pgs: 97 active+clean; 1.4 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 418 op/s 2024-08-31T04:35:37.246 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:35:36 smithi177 ceph-mon[22025]: pgmap v750: 97 pgs: 97 active+clean; 1.4 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 418 op/s 2024-08-31T04:35:37.293 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:35:36 smithi133 ceph-mon[22177]: pgmap v750: 97 pgs: 97 active+clean; 1.4 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 418 op/s 2024-08-31T04:35:39.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:35:39 smithi177 ceph-mon[22025]: pgmap v751: 97 pgs: 97 active+clean; 1.4 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.2 MiB/s wr, 379 op/s 2024-08-31T04:35:39.542 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:35:39 smithi133 ceph-mon[22177]: pgmap v751: 97 pgs: 97 active+clean; 1.4 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.2 MiB/s wr, 379 op/s 2024-08-31T04:35:39.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:35:39 smithi050 ceph-mon[17259]: pgmap v751: 97 pgs: 97 active+clean; 1.4 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.2 MiB/s wr, 379 op/s 2024-08-31T04:35:39.752 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:39.750+0000 7fd6c5600640 1 -- 172.21.15.50:0/2017840450 <== mds.0 v2:172.21.15.133:6838/2526402262 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x560d0a5db960 con 0x560d0a2591c0 2024-08-31T04:35:39.752 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:39.750+0000 7fd6c5600640 10 client.26531 handle_command_reply: tid=0 2024-08-31T04:35:39.752 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:39.750+0000 7fd6e5e3e740 1 client.26531 shutdown 2024-08-31T04:35:39.752 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:39.750+0000 7fd6e5e3e740 1 -- 172.21.15.50:0/2017840450 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x560d0a29c2f0 msgr2=0x560d0a67bf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:35:39.752 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:39.750+0000 7fd6e5e3e740 1 --2- 172.21.15.50:0/2017840450 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x560d0a29c2f0 0x560d0a67bf10 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fd6c80a9450 tx=0x7fd6c80e3330 comp rx=0 tx=0).stop 2024-08-31T04:35:39.752 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:39.750+0000 7fd6e5e3e740 1 -- 172.21.15.50:0/2017840450 shutdown_connections 2024-08-31T04:35:39.752 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:39.750+0000 7fd6e5e3e740 1 --2- 172.21.15.50:0/2017840450 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x560d0a2591c0 0x560d0a6eec10 crc :-1 s=READY pgs=160 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:39.752 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:39.750+0000 7fd6e5e3e740 1 --2- 172.21.15.50:0/2017840450 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x560d0a2a44d0 0x560d0a67abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:39.753 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:39.750+0000 7fd6e5e3e740 1 --2- 172.21.15.50:0/2017840450 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560d0a2c51b0 0x560d0a67b110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:39.753 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:39.750+0000 7fd6c5600640 0 client.26531 ms_handle_reset on v2:172.21.15.133:6838/2526402262 2024-08-31T04:35:39.753 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:39.750+0000 7fd6e5e3e740 1 --2- 172.21.15.50:0/2017840450 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x560d0a29c2f0 0x560d0a67bf10 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:39.753 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:39.750+0000 7fd6e5e3e740 1 -- 172.21.15.50:0/2017840450 >> 172.21.15.50:0/2017840450 conn(0x560d0a2b9300 msgr2=0x560d0a66edd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:35:39.753 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:39.750+0000 7fd6e5e3e740 1 -- 172.21.15.50:0/2017840450 shutdown_connections 2024-08-31T04:35:39.753 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:39.750+0000 7fd6e5e3e740 1 -- 172.21.15.50:0/2017840450 wait complete. 2024-08-31T04:35:39.753 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:39.751+0000 7fd6e5e3e740 20 client.26531 trim_cache size 0 max 16384 2024-08-31T04:35:39.753 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout:{ 2024-08-31T04:35:39.753 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout: "message": "", 2024-08-31T04:35:39.754 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout: "return_code": 0 2024-08-31T04:35:39.754 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout:} 2024-08-31T04:35:39.754 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:39.751+0000 7fd6dd600640 1 -- 172.21.15.50:0/3627928994 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fd6bc0b4c30 msgr2=0x7fd6bc0b7140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:35:39.754 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:39.751+0000 7fd6dd600640 1 --2- 172.21.15.50:0/3627928994 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fd6bc0b4c30 0x7fd6bc0b7140 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fd6d0009d60 tx=0x7fd6d0005f90 comp rx=0 tx=0).stop 2024-08-31T04:35:39.754 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:39.751+0000 7fd6dd600640 1 -- 172.21.15.50:0/3627928994 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd6d8105480 msgr2=0x7fd6d819bd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:35:39.754 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:39.751+0000 7fd6dd600640 1 --2- 172.21.15.50:0/3627928994 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd6d8105480 0x7fd6d819bd10 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fd6c800eb90 tx=0x7fd6c800c6a0 comp rx=0 tx=0).stop 2024-08-31T04:35:39.755 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:39.751+0000 7fd6dd600640 1 -- 172.21.15.50:0/3627928994 shutdown_connections 2024-08-31T04:35:39.755 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:39.751+0000 7fd6dd600640 1 --2- 172.21.15.50:0/3627928994 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fd6bc0b4c30 0x7fd6bc0b7140 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:39.755 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:39.751+0000 7fd6dd600640 1 --2- 172.21.15.50:0/3627928994 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd6d8106500 0x7fd6d819c380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:39.755 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:39.751+0000 7fd6dd600640 1 --2- 172.21.15.50:0/3627928994 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd6d8106ea0 0x7fd6d819cf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:39.755 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:39.751+0000 7fd6dd600640 1 --2- 172.21.15.50:0/3627928994 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd6d8105480 0x7fd6d819bd10 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:39.755 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:39.751+0000 7fd6dd600640 1 -- 172.21.15.50:0/3627928994 >> 172.21.15.50:0/3627928994 conn(0x7fd6d8100da0 msgr2=0x7fd6d8109820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:35:39.755 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:39.752+0000 7fd6dd600640 1 -- 172.21.15.50:0/3627928994 shutdown_connections 2024-08-31T04:35:39.755 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:39.752+0000 7fd6dd600640 1 -- 172.21.15.50:0/3627928994 wait complete. 2024-08-31T04:35:41.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:35:41 smithi177 ceph-mon[22025]: pgmap v752: 97 pgs: 97 active+clean; 1.4 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.0 MiB/s wr, 661 op/s 2024-08-31T04:35:41.542 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:35:41 smithi133 ceph-mon[22177]: pgmap v752: 97 pgs: 97 active+clean; 1.4 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.0 MiB/s wr, 661 op/s 2024-08-31T04:35:41.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:35:41 smithi050 ceph-mon[17259]: pgmap v752: 97 pgs: 97 active+clean; 1.4 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.0 MiB/s wr, 661 op/s 2024-08-31T04:35:43.450 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:35:43 smithi050 ceph-mon[17259]: pgmap v753: 97 pgs: 97 active+clean; 1.4 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.1 MiB/s wr, 1.32k op/s 2024-08-31T04:35:43.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:35:43 smithi177 ceph-mon[22025]: pgmap v753: 97 pgs: 97 active+clean; 1.4 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.1 MiB/s wr, 1.32k op/s 2024-08-31T04:35:43.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:35:43 smithi133 ceph-mon[22177]: pgmap v753: 97 pgs: 97 active+clean; 1.4 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.1 MiB/s wr, 1.32k op/s 2024-08-31T04:35:45.450 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:35:45 smithi050 ceph-mon[17259]: pgmap v754: 97 pgs: 97 active+clean; 1.4 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.7 MiB/s wr, 1.52k op/s 2024-08-31T04:35:45.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:35:45 smithi177 ceph-mon[22025]: pgmap v754: 97 pgs: 97 active+clean; 1.4 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.7 MiB/s wr, 1.52k op/s 2024-08-31T04:35:45.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:35:45 smithi133 ceph-mon[22177]: pgmap v754: 97 pgs: 97 active+clean; 1.4 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.7 MiB/s wr, 1.52k op/s 2024-08-31T04:35:47.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:35:47 smithi177 ceph-mon[22025]: pgmap v755: 97 pgs: 97 active+clean; 1.3 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.1 MiB/s wr, 1.60k op/s 2024-08-31T04:35:47.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:35:47 smithi133 ceph-mon[22177]: pgmap v755: 97 pgs: 97 active+clean; 1.3 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.1 MiB/s wr, 1.60k op/s 2024-08-31T04:35:47.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:35:47 smithi050 ceph-mon[17259]: pgmap v755: 97 pgs: 97 active+clean; 1.3 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.1 MiB/s wr, 1.60k op/s 2024-08-31T04:35:49.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:35:49 smithi133 ceph-mon[22177]: pgmap v756: 97 pgs: 97 active+clean; 1.3 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.8 MiB/s wr, 1.54k op/s 2024-08-31T04:35:49.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:35:49 smithi050 ceph-mon[17259]: pgmap v756: 97 pgs: 97 active+clean; 1.3 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.8 MiB/s wr, 1.54k op/s 2024-08-31T04:35:49.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:35:49 smithi177 ceph-mon[22025]: pgmap v756: 97 pgs: 97 active+clean; 1.3 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.8 MiB/s wr, 1.54k op/s 2024-08-31T04:35:51.450 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:35:51 smithi050 ceph-mon[17259]: pgmap v757: 97 pgs: 97 active+clean; 1.3 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.0 MiB/s wr, 1.55k op/s 2024-08-31T04:35:51.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:35:51 smithi133 ceph-mon[22177]: pgmap v757: 97 pgs: 97 active+clean; 1.3 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.0 MiB/s wr, 1.55k op/s 2024-08-31T04:35:51.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:35:51 smithi177 ceph-mon[22025]: pgmap v757: 97 pgs: 97 active+clean; 1.3 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.0 MiB/s wr, 1.55k op/s 2024-08-31T04:35:52.953 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:52.950+0000 7fdb43200640 1 -- 172.21.15.50:0/3224053973 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdb44104310 msgr2=0x7fdb44104720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:35:52.953 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:52.950+0000 7fdb43200640 1 --2- 172.21.15.50:0/3224053973 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdb44104310 0x7fdb44104720 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fdb30009900 tx=0x7fdb3002a410 comp rx=0 tx=0).stop 2024-08-31T04:35:52.953 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:52.950+0000 7fdb43200640 1 -- 172.21.15.50:0/3224053973 shutdown_connections 2024-08-31T04:35:52.953 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:52.950+0000 7fdb43200640 1 --2- 172.21.15.50:0/3224053973 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdb44104cb0 0x7fdb4410b650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:52.954 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:52.950+0000 7fdb43200640 1 --2- 172.21.15.50:0/3224053973 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdb44104310 0x7fdb44104720 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:52.954 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:52.950+0000 7fdb43200640 1 --2- 172.21.15.50:0/3224053973 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdb44103290 0x7fdb44103700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:52.954 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:52.950+0000 7fdb43200640 1 -- 172.21.15.50:0/3224053973 >> 172.21.15.50:0/3224053973 conn(0x7fdb440febd0 msgr2=0x7fdb44101080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:35:52.954 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:52.950+0000 7fdb43200640 1 -- 172.21.15.50:0/3224053973 shutdown_connections 2024-08-31T04:35:52.954 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:52.950+0000 7fdb43200640 1 -- 172.21.15.50:0/3224053973 wait complete. 2024-08-31T04:35:52.956 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:52.951+0000 7fdb43200640 1 Processor -- start 2024-08-31T04:35:52.956 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:52.951+0000 7fdb43200640 1 -- start start 2024-08-31T04:35:52.956 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:52.952+0000 7fdb43200640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdb44103290 0x7fdb44076bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:35:52.956 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:52.952+0000 7fdb43200640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdb44104310 0x7fdb440754b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:35:52.956 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:52.952+0000 7fdb43200640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdb44104cb0 0x7fdb440759f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:35:52.956 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:52.952+0000 7fdb43200640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fdb4410ef60 con 0x7fdb44104cb0 2024-08-31T04:35:52.957 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:52.952+0000 7fdb43200640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7fdb4410ede0 con 0x7fdb44103290 2024-08-31T04:35:52.957 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:52.952+0000 7fdb43200640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fdb4410f0e0 con 0x7fdb44104310 2024-08-31T04:35:52.957 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:52.952+0000 7fdb41e00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdb44103290 0x7fdb44076bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:35:52.957 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:52.952+0000 7fdb41e00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdb44103290 0x7fdb44076bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.50:37676/0 (socket says 172.21.15.50:37676) 2024-08-31T04:35:52.957 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:52.952+0000 7fdb41e00640 1 -- 172.21.15.50:0/1666503130 learned_addr learned my addr 172.21.15.50:0/1666503130 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:35:52.957 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:52.952+0000 7fdb41400640 1 --2- 172.21.15.50:0/1666503130 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdb44104310 0x7fdb440754b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:35:52.957 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:52.952+0000 7fdb42800640 1 --2- 172.21.15.50:0/1666503130 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdb44104cb0 0x7fdb440759f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:35:52.957 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:52.953+0000 7fdb41e00640 1 -- 172.21.15.50:0/1666503130 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdb44104310 msgr2=0x7fdb440754b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:35:52.957 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:52.953+0000 7fdb41e00640 1 --2- 172.21.15.50:0/1666503130 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdb44104310 0x7fdb440754b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:52.957 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:52.953+0000 7fdb41e00640 1 -- 172.21.15.50:0/1666503130 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdb44104cb0 msgr2=0x7fdb440759f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:35:52.957 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:52.953+0000 7fdb41e00640 1 --2- 172.21.15.50:0/1666503130 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdb44104cb0 0x7fdb440759f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:52.957 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:52.953+0000 7fdb41e00640 1 -- 172.21.15.50:0/1666503130 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb44076120 con 0x7fdb44103290 2024-08-31T04:35:52.958 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:52.953+0000 7fdb41e00640 1 --2- 172.21.15.50:0/1666503130 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdb44103290 0x7fdb44076bf0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fdb3400ea60 tx=0x7fdb3400ef20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:35:52.958 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:52.953+0000 7fdb3aa00640 1 -- 172.21.15.50:0/1666503130 <== mon.2 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb3400cde0 con 0x7fdb44103290 2024-08-31T04:35:52.958 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:52.953+0000 7fdb3aa00640 1 -- 172.21.15.50:0/1666503130 <== mon.2 v2:172.21.15.133:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdb340035f0 con 0x7fdb44103290 2024-08-31T04:35:52.958 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:52.953+0000 7fdb43200640 1 -- 172.21.15.50:0/1666503130 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdb441a3b60 con 0x7fdb44103290 2024-08-31T04:35:52.958 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:52.953+0000 7fdb3aa00640 1 -- 172.21.15.50:0/1666503130 <== mon.2 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb34010690 con 0x7fdb44103290 2024-08-31T04:35:52.958 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:52.953+0000 7fdb43200640 1 -- 172.21.15.50:0/1666503130 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdb441a4020 con 0x7fdb44103290 2024-08-31T04:35:52.960 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:52.956+0000 7fdb4fa26740 1 Processor -- start 2024-08-31T04:35:52.960 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:52.957+0000 7fdb4fa26740 1 -- start start 2024-08-31T04:35:52.960 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:52.957+0000 7fdb4fa26740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56052c1a91b0 0x56052c54ed40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:35:52.960 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:52.957+0000 7fdb4fa26740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56052c1802f0 0x56052c54f3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:35:52.960 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:52.957+0000 7fdb4fa26740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56052c1884d0 0x56052c54ff00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:35:52.960 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:52.957+0000 7fdb4fa26740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x56052c4c1f70 con 0x56052c1a91b0 2024-08-31T04:35:52.961 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:52.957+0000 7fdb4fa26740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x56052c4b1500 con 0x56052c1884d0 2024-08-31T04:35:52.961 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:52.957+0000 7fdb4fa26740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x56052c4b54b0 con 0x56052c1802f0 2024-08-31T04:35:52.961 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:52.957+0000 7fdb41400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56052c1884d0 0x56052c54ff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:35:52.961 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:52.958+0000 7fdb41400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56052c1884d0 0x56052c54ff00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.50:37684/0 (socket says 172.21.15.50:37684) 2024-08-31T04:35:52.961 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:52.958+0000 7fdb41400640 1 -- 172.21.15.50:0/1334275125 learned_addr learned my addr 172.21.15.50:0/1334275125 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:35:52.961 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:52.958+0000 7fdb42800640 1 --2- 172.21.15.50:0/1334275125 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56052c1a91b0 0x56052c54ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:35:52.961 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:52.958+0000 7fdb41400640 1 -- 172.21.15.50:0/1334275125 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56052c1802f0 msgr2=0x56052c54f3b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-31T04:35:52.961 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:52.958+0000 7fdb41400640 1 --2- 172.21.15.50:0/1334275125 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56052c1802f0 0x56052c54f3b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:52.961 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:52.958+0000 7fdb41400640 1 -- 172.21.15.50:0/1334275125 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56052c1a91b0 msgr2=0x56052c54ed40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:35:52.961 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:52.958+0000 7fdb41400640 1 --2- 172.21.15.50:0/1334275125 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56052c1a91b0 0x56052c54ed40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:52.961 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:52.958+0000 7fdb41400640 1 -- 172.21.15.50:0/1334275125 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56052c46bc10 con 0x56052c1884d0 2024-08-31T04:35:52.962 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:52.958+0000 7fdb41400640 1 --2- 172.21.15.50:0/1334275125 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56052c1884d0 0x56052c54ff00 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fdb30009230 tx=0x7fdb30004040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b81dc4cff4541e2c server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:35:52.963 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:52.959+0000 7fdb3aa00640 1 -- 172.21.15.50:0/1666503130 <== mon.2 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 18) ==== 152577+0+0 (secure 0 0 0) 0x7fdb340037a0 con 0x7fdb44103290 2024-08-31T04:35:52.963 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:52.959+0000 7fdb2f000640 1 -- 172.21.15.50:0/1334275125 <== mon.2 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb30035030 con 0x56052c1884d0 2024-08-31T04:35:52.963 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:52.959+0000 7fdb2f000640 1 -- 172.21.15.50:0/1334275125 <== mon.2 v2:172.21.15.133:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdb30040070 con 0x56052c1884d0 2024-08-31T04:35:52.963 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:52.959+0000 7fdb2f000640 1 -- 172.21.15.50:0/1334275125 <== mon.2 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb30031900 con 0x56052c1884d0 2024-08-31T04:35:52.963 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:52.960+0000 7fdb4fa26740 1 -- 172.21.15.50:0/1334275125 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56052c1884d0 msgr2=0x56052c54ff00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:35:52.963 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:52.960+0000 7fdb4fa26740 1 --2- 172.21.15.50:0/1334275125 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56052c1884d0 0x56052c54ff00 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fdb30009230 tx=0x7fdb30004040 comp rx=0 tx=0).stop 2024-08-31T04:35:52.963 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:52.960+0000 7fdb4fa26740 1 -- 172.21.15.50:0/1334275125 shutdown_connections 2024-08-31T04:35:52.963 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:52.960+0000 7fdb4fa26740 1 --2- 172.21.15.50:0/1334275125 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56052c1802f0 0x56052c54f3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:52.963 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:52.960+0000 7fdb4fa26740 1 --2- 172.21.15.50:0/1334275125 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56052c1884d0 0x56052c54ff00 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:52.963 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:52.960+0000 7fdb4fa26740 1 --2- 172.21.15.50:0/1334275125 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56052c1a91b0 0x56052c54ed40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:52.963 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:52.960+0000 7fdb4fa26740 1 -- 172.21.15.50:0/1334275125 >> 172.21.15.50:0/1334275125 conn(0x56052c19d300 msgr2=0x56052c54a7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:35:52.963 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:52.960+0000 7fdb4fa26740 1 -- 172.21.15.50:0/1334275125 shutdown_connections 2024-08-31T04:35:52.964 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:52.960+0000 7fdb4fa26740 1 -- 172.21.15.50:0/1334275125 wait complete. 2024-08-31T04:35:52.965 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:52.961+0000 7fdb3aa00640 1 --2- 172.21.15.50:0/1666503130 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fdb280b4a40 0x7fdb280b6f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:35:52.966 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:52.961+0000 7fdb3aa00640 1 -- 172.21.15.50:0/1666503130 <== mon.2 v2:172.21.15.133:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8219+0+0 (secure 0 0 0) 0x7fdb340e5480 con 0x7fdb44103290 2024-08-31T04:35:52.966 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:52.961+0000 7fdb4fa26740 1 -- start start 2024-08-31T04:35:52.966 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:52.961+0000 7fdb42800640 1 --2- 172.21.15.50:0/1666503130 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fdb280b4a40 0x7fdb280b6f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:35:52.966 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:52.962+0000 7fdb4fa26740 1 Processor -- start 2024-08-31T04:35:52.966 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:52.962+0000 7fdb42800640 1 --2- 172.21.15.50:0/1666503130 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fdb280b4a40 0x7fdb280b6f50 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fdb3c005fd0 tx=0x7fdb3c009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:35:52.966 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:52.962+0000 7fdb4fa26740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56052c1802f0 0x56052c560bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:35:52.966 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:52.962+0000 7fdb4fa26740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56052c1884d0 0x56052c5612b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:35:52.966 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:52.962+0000 7fdb4fa26740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56052c1a91b0 0x56052c561e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:35:52.966 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:52.962+0000 7fdb4fa26740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x56052c3eaab0 con 0x56052c1a91b0 2024-08-31T04:35:52.966 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:52.962+0000 7fdb4fa26740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x56052c458320 con 0x56052c1802f0 2024-08-31T04:35:52.966 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:52.962+0000 7fdb4fa26740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x56052c5509c0 con 0x56052c1884d0 2024-08-31T04:35:52.967 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:52.962+0000 7fdb4fa26740 10 client.0 _ll_register_callbacks cb 0x56052c491e80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:35:52.967 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:52.962+0000 7fdb41e00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56052c1802f0 0x56052c560bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:35:52.967 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:52.963+0000 7fdb41400640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56052c1884d0 0x56052c5612b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:35:52.967 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:52.963+0000 7fdb41e00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56052c1802f0 0x56052c560bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.50:37698/0 (socket says 172.21.15.50:37698) 2024-08-31T04:35:52.967 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:52.963+0000 7fdb41e00640 1 -- 172.21.15.50:0/2356698684 learned_addr learned my addr 172.21.15.50:0/2356698684 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:35:52.967 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:52.963+0000 7fdb42800640 1 --2- 172.21.15.50:0/2356698684 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56052c1a91b0 0x56052c561e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:35:52.967 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:52.963+0000 7fdb41e00640 1 -- 172.21.15.50:0/2356698684 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56052c1884d0 msgr2=0x56052c5612b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:35:52.967 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:52.963+0000 7fdb41e00640 1 --2- 172.21.15.50:0/2356698684 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56052c1884d0 0x56052c5612b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:52.967 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:52.963+0000 7fdb41e00640 1 -- 172.21.15.50:0/2356698684 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56052c1a91b0 msgr2=0x56052c561e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:35:52.967 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:52.963+0000 7fdb41e00640 1 --2- 172.21.15.50:0/2356698684 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56052c1a91b0 0x56052c561e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:52.967 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:52.963+0000 7fdb41e00640 1 -- 172.21.15.50:0/2356698684 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56052c214790 con 0x56052c1802f0 2024-08-31T04:35:52.967 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:52.963+0000 7fdb41400640 1 --2- 172.21.15.50:0/2356698684 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56052c1884d0 0x56052c5612b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:35:52.967 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:52.963+0000 7fdb41e00640 1 --2- 172.21.15.50:0/2356698684 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56052c1802f0 0x56052c560bf0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fdb340a90d0 tx=0x7fdb340ab690 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5561552d7cba45d4 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:35:52.968 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:52.963+0000 7fdb23400640 10 client.0 ms_handle_connect on v2:172.21.15.133:3300/0 2024-08-31T04:35:52.968 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:52.963+0000 7fdb23400640 1 -- 172.21.15.50:0/2356698684 <== mon.2 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb340abe60 con 0x56052c1802f0 2024-08-31T04:35:52.968 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:52.964+0000 7fdb4fa26740 1 -- 172.21.15.50:0/2356698684 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdb30040070 con 0x56052c1802f0 2024-08-31T04:35:52.968 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:52.964+0000 7fdb23400640 1 -- 172.21.15.50:0/2356698684 <== mon.2 v2:172.21.15.133:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8219+0+0 (secure 0 0 0) 0x7fdb340a80f0 con 0x56052c1802f0 2024-08-31T04:35:52.970 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:52.964+0000 7fdb23400640 1 -- 172.21.15.50:0/2356698684 <== mon.2 v2:172.21.15.133:3300/0 3 ==== mon_get_version_reply(handle=1 version=71) ==== 24+0+0 (secure 0 0 0) 0x7fdb340b06d0 con 0x56052c1802f0 2024-08-31T04:35:52.970 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:52.964+0000 7fdb4fa26740 10 client.26543 fetch_fsmap learned FSMap version 71 2024-08-31T04:35:52.970 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:52.964+0000 7fdb4fa26740 1 -- 172.21.15.50:0/2356698684 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,fsmap=71,monmap=4+}) -- 0x56052c28d620 con 0x56052c1802f0 2024-08-31T04:35:52.970 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:52.964+0000 7fdb23400640 1 -- 172.21.15.50:0/2356698684 <== mon.2 v2:172.21.15.133:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdb30040070 con 0x56052c1802f0 2024-08-31T04:35:52.970 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:52.964+0000 7fdb23400640 1 -- 172.21.15.50:0/2356698684 <== mon.2 v2:172.21.15.133:3300/0 5 ==== fsmap(e 71) ==== 8442+0+0 (secure 0 0 0) 0x7fdb340930d0 con 0x56052c1802f0 2024-08-31T04:35:52.970 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:52.964+0000 7fdb4fa26740 10 client.26543 fetch_fsmap finished waiting for FSMap version 71 2024-08-31T04:35:52.970 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:52.964+0000 7fdb4fa26740 10 client.26543 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T04:35:52.970 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:52.964+0000 7fdb4fa26740 20 client.26543 populate_metadata read hostname 'smithi050' 2024-08-31T04:35:52.970 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:52.964+0000 7fdb4fa26740 1 --2- 172.21.15.50:0/2356698684 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x56052c167d80 0x56052c56e410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:35:52.970 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:52.964+0000 7fdb4fa26740 4 client.26543 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T04:35:52.970 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:52.964+0000 7fdb4fa26740 1 -- 172.21.15.50:0/2356698684 --> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56052c4c3ec0 con 0x56052c167d80 2024-08-31T04:35:52.971 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:52.965+0000 7fdb41400640 1 --2- 172.21.15.50:0/2356698684 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x56052c167d80 0x56052c56e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:35:52.971 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:52.965+0000 7fdb41400640 1 --2- 172.21.15.50:0/2356698684 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x56052c167d80 0x56052c56e410 crc :-1 s=READY pgs=161 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e7ef1d0ee700d361 server_cookie=1dfa8e2d612ec20e in_seq=0 out_seq=0 2024-08-31T04:35:52.971 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:52.965+0000 7fdb23400640 10 client.26543 ms_handle_connect on v2:172.21.15.133:6838/2526402262 2024-08-31T04:35:52.971 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:52.967+0000 7fdb23400640 1 -- 172.21.15.50:0/2356698684 <== mds.0 v2:172.21.15.133:6838/2526402262 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56052c4c3ec0 con 0x56052c167d80 2024-08-31T04:35:52.971 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:52.967+0000 7fdb23400640 10 client.26543 handle_command_reply: tid=0 2024-08-31T04:35:52.971 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:52.967+0000 7fdb4fa26740 1 client.26543 shutdown 2024-08-31T04:35:52.971 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:52.967+0000 7fdb4fa26740 1 -- 172.21.15.50:0/2356698684 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56052c1802f0 msgr2=0x56052c560bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:35:52.971 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:52.967+0000 7fdb4fa26740 1 --2- 172.21.15.50:0/2356698684 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56052c1802f0 0x56052c560bf0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fdb340a90d0 tx=0x7fdb340ab690 comp rx=0 tx=0).stop 2024-08-31T04:35:52.971 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:52.967+0000 7fdb4fa26740 1 -- 172.21.15.50:0/2356698684 shutdown_connections 2024-08-31T04:35:52.971 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:52.967+0000 7fdb4fa26740 1 --2- 172.21.15.50:0/2356698684 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x56052c167d80 0x56052c56e410 crc :-1 s=READY pgs=161 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:52.971 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:52.967+0000 7fdb4fa26740 1 --2- 172.21.15.50:0/2356698684 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56052c1884d0 0x56052c5612b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:52.971 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:52.967+0000 7fdb4fa26740 1 --2- 172.21.15.50:0/2356698684 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56052c1a91b0 0x56052c561e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:52.971 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:52.967+0000 7fdb4fa26740 1 --2- 172.21.15.50:0/2356698684 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56052c1802f0 0x56052c560bf0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:52.972 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:52.967+0000 7fdb23400640 0 client.26543 ms_handle_reset on v2:172.21.15.133:6838/2526402262 2024-08-31T04:35:52.972 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:52.967+0000 7fdb4fa26740 1 -- 172.21.15.50:0/2356698684 >> 172.21.15.50:0/2356698684 conn(0x56052c19d300 msgr2=0x56052c548d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:35:52.972 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:52.967+0000 7fdb4fa26740 1 -- 172.21.15.50:0/2356698684 shutdown_connections 2024-08-31T04:35:52.972 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:52.967+0000 7fdb4fa26740 1 -- 172.21.15.50:0/2356698684 wait complete. 2024-08-31T04:35:52.972 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:52.967+0000 7fdb4fa26740 20 client.26543 trim_cache size 0 max 16384 2024-08-31T04:35:52.988 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:52.985+0000 7fdb4fa26740 1 Processor -- start 2024-08-31T04:35:52.988 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:52.985+0000 7fdb4fa26740 1 -- start start 2024-08-31T04:35:52.988 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:52.985+0000 7fdb4fa26740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56052c1802f0 0x56052c54fbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:35:52.988 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:52.985+0000 7fdb4fa26740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56052c1884d0 0x56052c5494e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:35:52.988 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:52.985+0000 7fdb4fa26740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56052c1a91b0 0x56052c549a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:35:52.988 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:52.985+0000 7fdb4fa26740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fdb441a8820 con 0x56052c1884d0 2024-08-31T04:35:52.988 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:52.985+0000 7fdb4fa26740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7fdb441aa5a0 con 0x56052c1a91b0 2024-08-31T04:35:52.988 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:52.985+0000 7fdb4fa26740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fdb441a8fb0 con 0x56052c1802f0 2024-08-31T04:35:52.988 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:52.986+0000 7fdb41400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56052c1884d0 0x56052c5494e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:35:52.988 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:52.986+0000 7fdb41400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56052c1884d0 0x56052c5494e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:39572/0 (socket says 172.21.15.50:39572) 2024-08-31T04:35:52.989 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:52.986+0000 7fdb41400640 1 -- 172.21.15.50:0/4046670036 learned_addr learned my addr 172.21.15.50:0/4046670036 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:35:52.989 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:52.986+0000 7fdb41e00640 1 --2- 172.21.15.50:0/4046670036 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56052c1802f0 0x56052c54fbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:35:52.989 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:52.986+0000 7fdb42800640 1 --2- 172.21.15.50:0/4046670036 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56052c1a91b0 0x56052c549a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:35:52.990 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:52.986+0000 7fdb41e00640 1 -- 172.21.15.50:0/4046670036 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56052c1a91b0 msgr2=0x56052c549a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:35:52.990 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:52.986+0000 7fdb41e00640 1 --2- 172.21.15.50:0/4046670036 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56052c1a91b0 0x56052c549a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:52.990 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:52.986+0000 7fdb41e00640 1 -- 172.21.15.50:0/4046670036 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56052c1884d0 msgr2=0x56052c5494e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:35:52.990 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:52.986+0000 7fdb41e00640 1 --2- 172.21.15.50:0/4046670036 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56052c1884d0 0x56052c5494e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:52.990 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:52.986+0000 7fdb41e00640 1 -- 172.21.15.50:0/4046670036 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56052c556ce0 con 0x56052c1802f0 2024-08-31T04:35:52.990 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:52.986+0000 7fdb41e00640 1 --2- 172.21.15.50:0/4046670036 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56052c1802f0 0x56052c54fbd0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fdb3400c760 tx=0x7fdb340095b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1a63dd3cbb14875b server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:35:52.990 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:52.986+0000 7fdb2e600640 1 -- 172.21.15.50:0/4046670036 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb340b5180 con 0x56052c1802f0 2024-08-31T04:35:52.990 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:52.987+0000 7fdb2e600640 1 -- 172.21.15.50:0/4046670036 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdb340970e0 con 0x56052c1802f0 2024-08-31T04:35:52.991 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:52.987+0000 7fdb2e600640 1 -- 172.21.15.50:0/4046670036 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb340b0220 con 0x56052c1802f0 2024-08-31T04:35:52.991 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:52.987+0000 7fdb4fa26740 1 -- 172.21.15.50:0/4046670036 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56052c1802f0 msgr2=0x56052c54fbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:35:52.991 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:52.987+0000 7fdb4fa26740 1 --2- 172.21.15.50:0/4046670036 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56052c1802f0 0x56052c54fbd0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fdb3400c760 tx=0x7fdb340095b0 comp rx=0 tx=0).stop 2024-08-31T04:35:52.991 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:52.987+0000 7fdb4fa26740 1 -- 172.21.15.50:0/4046670036 shutdown_connections 2024-08-31T04:35:52.991 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:52.987+0000 7fdb4fa26740 1 --2- 172.21.15.50:0/4046670036 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56052c1a91b0 0x56052c549a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:52.991 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:52.987+0000 7fdb4fa26740 1 --2- 172.21.15.50:0/4046670036 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56052c1884d0 0x56052c5494e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:52.991 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:52.987+0000 7fdb4fa26740 1 --2- 172.21.15.50:0/4046670036 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56052c1802f0 0x56052c54fbd0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:52.991 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:52.987+0000 7fdb4fa26740 1 -- 172.21.15.50:0/4046670036 >> 172.21.15.50:0/4046670036 conn(0x56052c19d300 msgr2=0x56052c545490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:35:52.991 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:52.988+0000 7fdb4fa26740 1 -- 172.21.15.50:0/4046670036 shutdown_connections 2024-08-31T04:35:52.991 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:52.988+0000 7fdb4fa26740 1 -- 172.21.15.50:0/4046670036 wait complete. 2024-08-31T04:35:52.991 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:52.988+0000 7fdb4fa26740 1 -- start start 2024-08-31T04:35:52.993 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:52.988+0000 7fdb4fa26740 1 Processor -- start 2024-08-31T04:35:52.993 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:52.989+0000 7fdb4fa26740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56052c1802f0 0x56052c568110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:35:52.993 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:52.989+0000 7fdb4fa26740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56052c1884d0 0x56052c5687d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:35:52.994 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:52.989+0000 7fdb4fa26740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56052c1a91b0 0x56052c564120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:35:52.994 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:52.989+0000 7fdb4fa26740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fdb441a9ed0 con 0x56052c1802f0 2024-08-31T04:35:52.994 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:52.989+0000 7fdb4fa26740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7fdb441a9740 con 0x56052c1a91b0 2024-08-31T04:35:52.994 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:52.989+0000 7fdb4fa26740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fdb441a6800 con 0x56052c1884d0 2024-08-31T04:35:52.994 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:52.989+0000 7fdb4fa26740 10 client.0 _ll_register_callbacks cb 0x7fdb340abca0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:35:52.994 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:52.989+0000 7fdb42800640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56052c1a91b0 0x56052c564120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:35:52.994 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:52.989+0000 7fdb41e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56052c1802f0 0x56052c568110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:35:52.994 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:52.989+0000 7fdb42800640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56052c1a91b0 0x56052c564120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.50:37718/0 (socket says 172.21.15.50:37718) 2024-08-31T04:35:52.994 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:52.989+0000 7fdb41400640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56052c1884d0 0x56052c5687d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:35:52.994 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:52.989+0000 7fdb42800640 1 -- 172.21.15.50:0/148074811 learned_addr learned my addr 172.21.15.50:0/148074811 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:35:52.994 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:52.989+0000 7fdb42800640 1 -- 172.21.15.50:0/148074811 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56052c1884d0 msgr2=0x56052c5687d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:35:52.994 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:52.989+0000 7fdb42800640 1 --2- 172.21.15.50:0/148074811 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56052c1884d0 0x56052c5687d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:52.995 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:52.989+0000 7fdb42800640 1 -- 172.21.15.50:0/148074811 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56052c1802f0 msgr2=0x56052c568110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:35:52.995 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:52.989+0000 7fdb42800640 1 --2- 172.21.15.50:0/148074811 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56052c1802f0 0x56052c568110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:52.995 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:52.989+0000 7fdb42800640 1 -- 172.21.15.50:0/148074811 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56052c5648b0 con 0x56052c1a91b0 2024-08-31T04:35:52.995 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:52.990+0000 7fdb42800640 1 --2- 172.21.15.50:0/148074811 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56052c1a91b0 0x56052c564120 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fdb3c004280 tx=0x7fdb3c004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=99cc339bf3722865 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:35:52.995 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:52.990+0000 7fdb23400640 10 client.0 ms_handle_connect on v2:172.21.15.133:3300/0 2024-08-31T04:35:52.995 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:52.990+0000 7fdb23400640 1 -- 172.21.15.50:0/148074811 <== mon.2 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb3c02e060 con 0x56052c1a91b0 2024-08-31T04:35:52.995 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:52.990+0000 7fdb23400640 1 -- 172.21.15.50:0/148074811 <== mon.2 v2:172.21.15.133:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8219+0+0 (secure 0 0 0) 0x7fdb3c00fbf0 con 0x56052c1a91b0 2024-08-31T04:35:52.995 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:52.990+0000 7fdb4fa26740 1 -- 172.21.15.50:0/148074811 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdb340970e0 con 0x56052c1a91b0 2024-08-31T04:35:52.995 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:52.990+0000 7fdb23400640 1 -- 172.21.15.50:0/148074811 <== mon.2 v2:172.21.15.133:3300/0 3 ==== mon_get_version_reply(handle=1 version=71) ==== 24+0+0 (secure 0 0 0) 0x7fdb3c00fe30 con 0x56052c1a91b0 2024-08-31T04:35:52.995 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:52.990+0000 7fdb4fa26740 10 client.26549 fetch_fsmap learned FSMap version 71 2024-08-31T04:35:52.995 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:52.990+0000 7fdb4fa26740 1 -- 172.21.15.50:0/148074811 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,fsmap=71,monmap=4+}) -- 0x56052c5d8dd0 con 0x56052c1a91b0 2024-08-31T04:35:52.995 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:52.990+0000 7fdb23400640 1 -- 172.21.15.50:0/148074811 <== mon.2 v2:172.21.15.133:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdb340970e0 con 0x56052c1a91b0 2024-08-31T04:35:52.995 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:52.991+0000 7fdb23400640 1 -- 172.21.15.50:0/148074811 <== mon.2 v2:172.21.15.133:3300/0 5 ==== fsmap(e 71) ==== 8442+0+0 (secure 0 0 0) 0x7fdb3c01d420 con 0x56052c1a91b0 2024-08-31T04:35:52.996 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:52.991+0000 7fdb4fa26740 10 client.26549 fetch_fsmap finished waiting for FSMap version 71 2024-08-31T04:35:52.996 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:52.991+0000 7fdb4fa26740 10 client.26549 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T04:35:52.996 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:52.991+0000 7fdb4fa26740 20 client.26549 populate_metadata read hostname 'smithi050' 2024-08-31T04:35:52.996 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:52.991+0000 7fdb4fa26740 1 --2- 172.21.15.50:0/148074811 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x56052c13d1c0 0x56052c5db880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:35:52.996 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:52.991+0000 7fdb4fa26740 4 client.26549 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-31T04:35:52.996 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:52.991+0000 7fdb4fa26740 1 -- 172.21.15.50:0/148074811 --> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] -- command(tid 0: {"prefix": "flush journal"}) -- 0x56052c4bf960 con 0x56052c13d1c0 2024-08-31T04:35:52.996 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:52.991+0000 7fdb41e00640 1 --2- 172.21.15.50:0/148074811 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x56052c13d1c0 0x56052c5db880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:35:52.997 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:52.992+0000 7fdb41e00640 1 --2- 172.21.15.50:0/148074811 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x56052c13d1c0 0x56052c5db880 crc :-1 s=READY pgs=162 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=17a3793a7c4a544f server_cookie=d3a5d5c30a55fcf4 in_seq=0 out_seq=0 2024-08-31T04:35:52.997 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:52.992+0000 7fdb23400640 10 client.26549 ms_handle_connect on v2:172.21.15.133:6838/2526402262 2024-08-31T04:35:53.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:35:53 smithi133 ceph-mon[22177]: pgmap v758: 97 pgs: 97 active+clean; 1.3 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.3 MiB/s wr, 1.31k op/s 2024-08-31T04:35:53.606 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:53.604+0000 7fdb23400640 1 -- 172.21.15.50:0/148074811 <== mds.0 v2:172.21.15.133:6838/2526402262 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x56052c4bf960 con 0x56052c13d1c0 2024-08-31T04:35:53.607 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:53.604+0000 7fdb23400640 10 client.26549 handle_command_reply: tid=0 2024-08-31T04:35:53.607 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:53.604+0000 7fdb4fa26740 1 client.26549 shutdown 2024-08-31T04:35:53.607 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:53.604+0000 7fdb4fa26740 1 -- 172.21.15.50:0/148074811 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56052c1a91b0 msgr2=0x56052c564120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:35:53.607 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:53.604+0000 7fdb4fa26740 1 --2- 172.21.15.50:0/148074811 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56052c1a91b0 0x56052c564120 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fdb3c004280 tx=0x7fdb3c004a40 comp rx=0 tx=0).stop 2024-08-31T04:35:53.607 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:53.605+0000 7fdb4fa26740 1 -- 172.21.15.50:0/148074811 shutdown_connections 2024-08-31T04:35:53.608 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:53.605+0000 7fdb4fa26740 1 --2- 172.21.15.50:0/148074811 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x56052c13d1c0 0x56052c5db880 crc :-1 s=READY pgs=162 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:53.608 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:53.605+0000 7fdb4fa26740 1 --2- 172.21.15.50:0/148074811 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56052c1884d0 0x56052c5687d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:53.608 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:53.605+0000 7fdb4fa26740 1 --2- 172.21.15.50:0/148074811 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56052c1a91b0 0x56052c564120 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:53.608 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:53.605+0000 7fdb4fa26740 1 --2- 172.21.15.50:0/148074811 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56052c1802f0 0x56052c568110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:53.608 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:53.605+0000 7fdb4fa26740 1 -- 172.21.15.50:0/148074811 >> 172.21.15.50:0/148074811 conn(0x56052c19d300 msgr2=0x56052c54fbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:35:53.608 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:53.605+0000 7fdb23400640 0 client.26549 ms_handle_reset on v2:172.21.15.133:6838/2526402262 2024-08-31T04:35:53.608 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:53.605+0000 7fdb4fa26740 1 -- 172.21.15.50:0/148074811 shutdown_connections 2024-08-31T04:35:53.608 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:53.605+0000 7fdb4fa26740 1 -- 172.21.15.50:0/148074811 wait complete. 2024-08-31T04:35:53.609 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout:{ 2024-08-31T04:35:53.609 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout: "message": "", 2024-08-31T04:35:53.609 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout: "return_code": 0 2024-08-31T04:35:53.609 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout:} 2024-08-31T04:35:53.610 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:53.605+0000 7fdb4fa26740 20 client.26549 trim_cache size 0 max 16384 2024-08-31T04:35:53.610 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:53.607+0000 7fdb43200640 1 -- 172.21.15.50:0/1666503130 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fdb280b4a40 msgr2=0x7fdb280b6f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:35:53.610 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:53.607+0000 7fdb43200640 1 --2- 172.21.15.50:0/1666503130 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fdb280b4a40 0x7fdb280b6f50 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fdb3c005fd0 tx=0x7fdb3c009500 comp rx=0 tx=0).stop 2024-08-31T04:35:53.610 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:53.607+0000 7fdb43200640 1 -- 172.21.15.50:0/1666503130 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdb44103290 msgr2=0x7fdb44076bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:35:53.610 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:53.607+0000 7fdb43200640 1 --2- 172.21.15.50:0/1666503130 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdb44103290 0x7fdb44076bf0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fdb3400ea60 tx=0x7fdb3400ef20 comp rx=0 tx=0).stop 2024-08-31T04:35:53.610 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:53.607+0000 7fdb43200640 1 -- 172.21.15.50:0/1666503130 shutdown_connections 2024-08-31T04:35:53.610 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:53.607+0000 7fdb43200640 1 --2- 172.21.15.50:0/1666503130 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fdb280b4a40 0x7fdb280b6f50 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:53.610 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:53.607+0000 7fdb43200640 1 --2- 172.21.15.50:0/1666503130 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdb44104310 0x7fdb440754b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:53.610 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:53.607+0000 7fdb43200640 1 --2- 172.21.15.50:0/1666503130 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdb44104cb0 0x7fdb440759f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:53.610 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:53.607+0000 7fdb43200640 1 --2- 172.21.15.50:0/1666503130 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdb44103290 0x7fdb44076bf0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:35:53.610 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:53.607+0000 7fdb43200640 1 -- 172.21.15.50:0/1666503130 >> 172.21.15.50:0/1666503130 conn(0x7fdb440febd0 msgr2=0x7fdb44107630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:35:53.610 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:53.607+0000 7fdb43200640 1 -- 172.21.15.50:0/1666503130 shutdown_connections 2024-08-31T04:35:53.611 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:35:53.607+0000 7fdb43200640 1 -- 172.21.15.50:0/1666503130 wait complete. 2024-08-31T04:35:53.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:35:53 smithi050 ceph-mon[17259]: pgmap v758: 97 pgs: 97 active+clean; 1.3 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.3 MiB/s wr, 1.31k op/s 2024-08-31T04:35:53.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:35:53 smithi177 ceph-mon[22025]: pgmap v758: 97 pgs: 97 active+clean; 1.3 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.3 MiB/s wr, 1.31k op/s 2024-08-31T04:35:55.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:35:55 smithi133 ceph-mon[22177]: pgmap v759: 97 pgs: 97 active+clean; 1.3 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.2 MiB/s wr, 643 op/s 2024-08-31T04:35:55.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:35:55 smithi050 ceph-mon[17259]: pgmap v759: 97 pgs: 97 active+clean; 1.3 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.2 MiB/s wr, 643 op/s 2024-08-31T04:35:55.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:35:55 smithi177 ceph-mon[22025]: pgmap v759: 97 pgs: 97 active+clean; 1.3 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.2 MiB/s wr, 643 op/s 2024-08-31T04:35:57.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:35:57 smithi133 ceph-mon[22177]: pgmap v760: 97 pgs: 97 active+clean; 1.3 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.7 MiB/s wr, 468 op/s 2024-08-31T04:35:57.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:35:57 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T04:35:57.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:35:57 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:35:57.544 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:35:57 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T04:35:57.544 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:35:57 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:35:57.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:35:57 smithi050 ceph-mon[17259]: pgmap v760: 97 pgs: 97 active+clean; 1.3 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.7 MiB/s wr, 468 op/s 2024-08-31T04:35:57.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:35:57 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T04:35:57.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:35:57 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:35:57.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:35:57 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T04:35:57.701 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:35:57 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:35:57.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:35:57 smithi177 ceph-mon[22025]: pgmap v760: 97 pgs: 97 active+clean; 1.3 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.7 MiB/s wr, 468 op/s 2024-08-31T04:35:57.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:35:57 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T04:35:57.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:35:57 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:35:57.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:35:57 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T04:35:57.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:35:57 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:35:59.542 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:35:59 smithi133 ceph-mon[22177]: pgmap v761: 97 pgs: 97 active+clean; 1.3 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 393 op/s 2024-08-31T04:35:59.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:35:59 smithi050 ceph-mon[17259]: pgmap v761: 97 pgs: 97 active+clean; 1.3 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 393 op/s 2024-08-31T04:35:59.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:35:59 smithi177 ceph-mon[22025]: pgmap v761: 97 pgs: 97 active+clean; 1.3 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 393 op/s 2024-08-31T04:36:01.542 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:36:01 smithi133 ceph-mon[22177]: pgmap v762: 97 pgs: 97 active+clean; 1.3 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 406 op/s 2024-08-31T04:36:01.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:36:01 smithi050 ceph-mon[17259]: pgmap v762: 97 pgs: 97 active+clean; 1.3 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 406 op/s 2024-08-31T04:36:01.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:36:01 smithi177 ceph-mon[22025]: pgmap v762: 97 pgs: 97 active+clean; 1.3 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 406 op/s 2024-08-31T04:36:03.542 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:36:03 smithi133 ceph-mon[22177]: pgmap v763: 97 pgs: 97 active+clean; 1.2 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 421 op/s 2024-08-31T04:36:03.695 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:36:03 smithi050 ceph-mon[17259]: pgmap v763: 97 pgs: 97 active+clean; 1.2 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 421 op/s 2024-08-31T04:36:03.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:36:03 smithi177 ceph-mon[22025]: pgmap v763: 97 pgs: 97 active+clean; 1.2 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 421 op/s 2024-08-31T04:36:05.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:36:05 smithi133 ceph-mon[22177]: pgmap v764: 97 pgs: 97 active+clean; 1.2 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 378 op/s 2024-08-31T04:36:05.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:36:05 smithi050 ceph-mon[17259]: pgmap v764: 97 pgs: 97 active+clean; 1.2 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 378 op/s 2024-08-31T04:36:05.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:36:05 smithi177 ceph-mon[22025]: pgmap v764: 97 pgs: 97 active+clean; 1.2 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 378 op/s 2024-08-31T04:36:06.815 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:06.814+0000 7fc467e00640 1 -- 172.21.15.50:0/1320780980 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc460075a90 msgr2=0x7fc460075ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:36:06.816 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:06.814+0000 7fc467e00640 1 --2- 172.21.15.50:0/1320780980 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc460075a90 0x7fc460075ea0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7fc44c009900 tx=0x7fc44c02a3f0 comp rx=0 tx=0).stop 2024-08-31T04:36:06.816 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:06.814+0000 7fc467e00640 1 -- 172.21.15.50:0/1320780980 shutdown_connections 2024-08-31T04:36:06.816 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:06.814+0000 7fc467e00640 1 --2- 172.21.15.50:0/1320780980 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc46010fbe0 0x7fc460112000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:06.816 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:06.814+0000 7fc467e00640 1 --2- 172.21.15.50:0/1320780980 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc460075a90 0x7fc460075ea0 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:06.816 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:06.814+0000 7fc467e00640 1 --2- 172.21.15.50:0/1320780980 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc460076e90 0x7fc460075550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:06.816 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:06.814+0000 7fc467e00640 1 -- 172.21.15.50:0/1320780980 >> 172.21.15.50:0/1320780980 conn(0x7fc4600fedc0 msgr2=0x7fc460101250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:36:06.816 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:06.814+0000 7fc467e00640 1 -- 172.21.15.50:0/1320780980 shutdown_connections 2024-08-31T04:36:06.816 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:06.814+0000 7fc467e00640 1 -- 172.21.15.50:0/1320780980 wait complete. 2024-08-31T04:36:06.817 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:06.815+0000 7fc467e00640 1 Processor -- start 2024-08-31T04:36:06.817 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:06.816+0000 7fc467e00640 1 -- start start 2024-08-31T04:36:06.818 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:06.816+0000 7fc467e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc460075a90 0x7fc4601a02e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:36:06.818 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:06.816+0000 7fc467e00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc460076e90 0x7fc4601a0950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:36:06.818 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:06.816+0000 7fc467e00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc46010fbe0 0x7fc4601a1500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:36:06.818 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:06.816+0000 7fc467e00640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fc460115690 con 0x7fc460075a90 2024-08-31T04:36:06.818 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:06.816+0000 7fc467e00640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7fc460115510 con 0x7fc46010fbe0 2024-08-31T04:36:06.819 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:06.816+0000 7fc467e00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fc460115810 con 0x7fc460076e90 2024-08-31T04:36:06.819 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:06.816+0000 7fc465400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc460075a90 0x7fc4601a02e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:36:06.819 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:06.817+0000 7fc465400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc460075a90 0x7fc4601a02e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:41208/0 (socket says 172.21.15.50:41208) 2024-08-31T04:36:06.819 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:06.817+0000 7fc465400640 1 -- 172.21.15.50:0/173297464 learned_addr learned my addr 172.21.15.50:0/173297464 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:36:06.819 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:06.817+0000 7fc465e00640 1 --2- 172.21.15.50:0/173297464 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc46010fbe0 0x7fc4601a1500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:36:06.819 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:06.817+0000 7fc464a00640 1 --2- 172.21.15.50:0/173297464 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc460076e90 0x7fc4601a0950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:36:06.819 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:06.817+0000 7fc465400640 1 -- 172.21.15.50:0/173297464 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc460076e90 msgr2=0x7fc4601a0950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:36:06.819 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:06.817+0000 7fc465400640 1 --2- 172.21.15.50:0/173297464 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc460076e90 0x7fc4601a0950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:06.819 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:06.817+0000 7fc465400640 1 -- 172.21.15.50:0/173297464 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc46010fbe0 msgr2=0x7fc4601a1500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:36:06.819 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:06.817+0000 7fc465400640 1 --2- 172.21.15.50:0/173297464 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc46010fbe0 0x7fc4601a1500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:06.819 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:06.817+0000 7fc465400640 1 -- 172.21.15.50:0/173297464 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4601a1d20 con 0x7fc460075a90 2024-08-31T04:36:06.820 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:06.817+0000 7fc465400640 1 --2- 172.21.15.50:0/173297464 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc460075a90 0x7fc4601a02e0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7fc45400ea60 tx=0x7fc45400ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:36:06.820 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:06.818+0000 7fc45e000640 1 -- 172.21.15.50:0/173297464 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc45400cde0 con 0x7fc460075a90 2024-08-31T04:36:06.820 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:06.818+0000 7fc45e000640 1 -- 172.21.15.50:0/173297464 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc4540035f0 con 0x7fc460075a90 2024-08-31T04:36:06.820 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:06.818+0000 7fc467e00640 1 -- 172.21.15.50:0/173297464 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc4601a2010 con 0x7fc460075a90 2024-08-31T04:36:06.820 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:06.818+0000 7fc45e000640 1 -- 172.21.15.50:0/173297464 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc454010690 con 0x7fc460075a90 2024-08-31T04:36:06.821 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:06.818+0000 7fc467e00640 1 -- 172.21.15.50:0/173297464 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc4601a8700 con 0x7fc460075a90 2024-08-31T04:36:06.823 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:06.822+0000 7fc45e000640 1 -- 172.21.15.50:0/173297464 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 18) ==== 152577+0+0 (secure 0 0 0) 0x7fc4540037a0 con 0x7fc460075a90 2024-08-31T04:36:06.823 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:06.822+0000 7fc46ede5740 1 Processor -- start 2024-08-31T04:36:06.823 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:06.822+0000 7fc46ede5740 1 -- start start 2024-08-31T04:36:06.824 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:06.823+0000 7fc46ede5740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557394e3e1b0 0x5573951e3dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:36:06.824 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:06.823+0000 7fc46ede5740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x557394e152f0 0x5573951e4430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:36:06.824 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:06.823+0000 7fc46ede5740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557394e1d4d0 0x5573951e4f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:36:06.825 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:06.823+0000 7fc46ede5740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x557395156f70 con 0x557394e3e1b0 2024-08-31T04:36:06.825 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:06.823+0000 7fc46ede5740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x557395146500 con 0x557394e152f0 2024-08-31T04:36:06.825 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:06.823+0000 7fc46ede5740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x55739514a4b0 con 0x557394e1d4d0 2024-08-31T04:36:06.825 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:06.823+0000 7fc465e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557394e3e1b0 0x5573951e3dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:36:06.825 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:06.823+0000 7fc465e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557394e3e1b0 0x5573951e3dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:41214/0 (socket says 172.21.15.50:41214) 2024-08-31T04:36:06.825 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:06.823+0000 7fc465e00640 1 -- 172.21.15.50:0/2518029511 learned_addr learned my addr 172.21.15.50:0/2518029511 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:36:06.826 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:06.823+0000 7fc464a00640 1 --2- 172.21.15.50:0/2518029511 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557394e1d4d0 0x5573951e4f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:36:06.826 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:06.823+0000 7fc465400640 1 --2- 172.21.15.50:0/2518029511 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x557394e152f0 0x5573951e4430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:36:06.826 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:06.824+0000 7fc465e00640 1 -- 172.21.15.50:0/2518029511 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557394e1d4d0 msgr2=0x5573951e4f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:36:06.826 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:06.824+0000 7fc465e00640 1 --2- 172.21.15.50:0/2518029511 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557394e1d4d0 0x5573951e4f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:06.826 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:06.824+0000 7fc465e00640 1 -- 172.21.15.50:0/2518029511 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x557394e152f0 msgr2=0x5573951e4430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:36:06.827 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:06.824+0000 7fc465e00640 1 --2- 172.21.15.50:0/2518029511 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x557394e152f0 0x5573951e4430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:06.827 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:06.824+0000 7fc465e00640 1 -- 172.21.15.50:0/2518029511 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557395100c10 con 0x557394e3e1b0 2024-08-31T04:36:06.827 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:06.824+0000 7fc464a00640 1 --2- 172.21.15.50:0/2518029511 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557394e1d4d0 0x5573951e4f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:36:06.827 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:06.824+0000 7fc45e000640 1 --2- 172.21.15.50:0/173297464 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fc4480b4bb0 0x7fc4480b70c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:36:06.827 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:06.824+0000 7fc45e000640 1 -- 172.21.15.50:0/173297464 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8219+0+0 (secure 0 0 0) 0x7fc4540e5420 con 0x7fc460075a90 2024-08-31T04:36:06.827 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:06.824+0000 7fc465e00640 1 --2- 172.21.15.50:0/2518029511 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557394e3e1b0 0x5573951e3dc0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7fc458009fd0 tx=0x7fc4580118d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7bc79a386b9f450b server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:36:06.827 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:06.824+0000 7fc465400640 1 --2- 172.21.15.50:0/173297464 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fc4480b4bb0 0x7fc4480b70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:36:06.827 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:06.825+0000 7fc452600640 1 -- 172.21.15.50:0/2518029511 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc458004d20 con 0x557394e3e1b0 2024-08-31T04:36:06.827 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:06.825+0000 7fc452600640 1 -- 172.21.15.50:0/2518029511 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc458004050 con 0x557394e3e1b0 2024-08-31T04:36:06.827 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:06.825+0000 7fc452600640 1 -- 172.21.15.50:0/2518029511 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc458005280 con 0x557394e3e1b0 2024-08-31T04:36:06.834 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:06.826+0000 7fc46ede5740 1 -- 172.21.15.50:0/2518029511 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557394e3e1b0 msgr2=0x5573951e3dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:36:06.834 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:06.826+0000 7fc46ede5740 1 --2- 172.21.15.50:0/2518029511 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557394e3e1b0 0x5573951e3dc0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7fc458009fd0 tx=0x7fc4580118d0 comp rx=0 tx=0).stop 2024-08-31T04:36:06.834 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:06.826+0000 7fc465400640 1 --2- 172.21.15.50:0/173297464 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fc4480b4bb0 0x7fc4480b70c0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fc4540a7e80 tx=0x7fc4540e8e60 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:36:06.835 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:06.826+0000 7fc46ede5740 1 -- 172.21.15.50:0/2518029511 shutdown_connections 2024-08-31T04:36:06.835 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:06.826+0000 7fc46ede5740 1 --2- 172.21.15.50:0/2518029511 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557394e1d4d0 0x5573951e4f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:06.835 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:06.826+0000 7fc46ede5740 1 --2- 172.21.15.50:0/2518029511 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x557394e152f0 0x5573951e4430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:06.835 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:06.826+0000 7fc46ede5740 1 --2- 172.21.15.50:0/2518029511 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557394e3e1b0 0x5573951e3dc0 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:06.835 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:06.826+0000 7fc46ede5740 1 -- 172.21.15.50:0/2518029511 >> 172.21.15.50:0/2518029511 conn(0x557394e32300 msgr2=0x5573951df850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:36:06.835 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:06.826+0000 7fc46ede5740 1 -- 172.21.15.50:0/2518029511 shutdown_connections 2024-08-31T04:36:06.835 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:06.826+0000 7fc46ede5740 1 -- 172.21.15.50:0/2518029511 wait complete. 2024-08-31T04:36:06.835 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:06.827+0000 7fc46ede5740 1 -- start start 2024-08-31T04:36:06.835 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:06.827+0000 7fc46ede5740 1 Processor -- start 2024-08-31T04:36:06.835 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:06.827+0000 7fc46ede5740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557394e152f0 0x5573951ed480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:36:06.835 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:06.827+0000 7fc46ede5740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557394e1d4d0 0x5573951edb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:36:06.835 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:06.827+0000 7fc46ede5740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x557394e3e1b0 0x5573951ee6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:36:06.836 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:06.827+0000 7fc46ede5740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55739507fab0 con 0x557394e152f0 2024-08-31T04:36:06.836 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:06.827+0000 7fc46ede5740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x5573950ed320 con 0x557394e3e1b0 2024-08-31T04:36:06.836 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:06.827+0000 7fc46ede5740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x5573951e5aa0 con 0x557394e1d4d0 2024-08-31T04:36:06.836 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:06.828+0000 7fc46ede5740 10 client.0 _ll_register_callbacks cb 0x5573950f36a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:36:06.836 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:06.828+0000 7fc465e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557394e152f0 0x5573951ed480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:36:06.836 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:06.828+0000 7fc464a00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557394e1d4d0 0x5573951edb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:36:06.836 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:06.828+0000 7fc464a00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557394e1d4d0 0x5573951edb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.50:58500/0 (socket says 172.21.15.50:58500) 2024-08-31T04:36:06.836 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:06.828+0000 7fc464a00640 1 -- 172.21.15.50:0/906506605 learned_addr learned my addr 172.21.15.50:0/906506605 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:36:06.836 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:06.828+0000 7fc465e00640 1 --2- 172.21.15.50:0/906506605 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x557394e3e1b0 0x5573951ee6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:36:06.836 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:06.828+0000 7fc464a00640 1 -- 172.21.15.50:0/906506605 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x557394e3e1b0 msgr2=0x5573951ee6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:36:06.836 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:06.828+0000 7fc464a00640 1 --2- 172.21.15.50:0/906506605 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x557394e3e1b0 0x5573951ee6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:06.836 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:06.828+0000 7fc464a00640 1 -- 172.21.15.50:0/906506605 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557394e152f0 msgr2=0x5573951ed480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:36:06.837 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:06.828+0000 7fc464a00640 1 --2- 172.21.15.50:0/906506605 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557394e152f0 0x5573951ed480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:06.837 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:06.828+0000 7fc464a00640 1 -- 172.21.15.50:0/906506605 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557394ea9790 con 0x557394e1d4d0 2024-08-31T04:36:06.837 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:06.828+0000 7fc465e00640 1 --2- 172.21.15.50:0/906506605 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x557394e3e1b0 0x5573951ee6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T04:36:06.837 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:06.829+0000 7fc464a00640 1 --2- 172.21.15.50:0/906506605 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557394e1d4d0 0x5573951edb40 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fc44c009900 tx=0x7fc44c031d40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e8776a1fcdd68c31 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:36:06.837 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:06.829+0000 7fc446a00640 10 client.0 ms_handle_connect on v2:172.21.15.177:3300/0 2024-08-31T04:36:06.837 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:06.829+0000 7fc446a00640 1 -- 172.21.15.50:0/906506605 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc44c035040 con 0x557394e1d4d0 2024-08-31T04:36:06.837 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:06.829+0000 7fc46ede5740 1 -- 172.21.15.50:0/906506605 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc458004050 con 0x557394e1d4d0 2024-08-31T04:36:06.837 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:06.829+0000 7fc446a00640 1 -- 172.21.15.50:0/906506605 <== mon.1 v2:172.21.15.177:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8219+0+0 (secure 0 0 0) 0x7fc44c004040 con 0x557394e1d4d0 2024-08-31T04:36:06.837 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:06.829+0000 7fc446a00640 1 -- 172.21.15.50:0/906506605 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_get_version_reply(handle=1 version=71) ==== 24+0+0 (secure 0 0 0) 0x7fc44c004240 con 0x557394e1d4d0 2024-08-31T04:36:06.837 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:06.829+0000 7fc46ede5740 10 client.26545 fetch_fsmap learned FSMap version 71 2024-08-31T04:36:06.837 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:06.829+0000 7fc46ede5740 1 -- 172.21.15.50:0/906506605 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,fsmap=71,monmap=4+}) -- 0x557394f22620 con 0x557394e1d4d0 2024-08-31T04:36:06.837 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:06.830+0000 7fc446a00640 1 -- 172.21.15.50:0/906506605 <== mon.1 v2:172.21.15.177:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc458004050 con 0x557394e1d4d0 2024-08-31T04:36:06.837 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:06.830+0000 7fc446a00640 1 -- 172.21.15.50:0/906506605 <== mon.1 v2:172.21.15.177:3300/0 5 ==== fsmap(e 71) ==== 8442+0+0 (secure 0 0 0) 0x7fc44c048540 con 0x557394e1d4d0 2024-08-31T04:36:06.838 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:06.830+0000 7fc46ede5740 10 client.26545 fetch_fsmap finished waiting for FSMap version 71 2024-08-31T04:36:06.838 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:06.830+0000 7fc46ede5740 10 client.26545 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T04:36:06.838 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:06.830+0000 7fc46ede5740 20 client.26545 populate_metadata read hostname 'smithi050' 2024-08-31T04:36:06.838 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:06.830+0000 7fc46ede5740 1 --2- 172.21.15.50:0/906506605 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x557394dfcd80 0x5573951fac30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:36:06.838 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:06.830+0000 7fc46ede5740 4 client.26545 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T04:36:06.838 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:06.830+0000 7fc46ede5740 1 -- 172.21.15.50:0/906506605 --> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557395158ec0 con 0x557394dfcd80 2024-08-31T04:36:06.838 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:06.830+0000 7fc465e00640 1 --2- 172.21.15.50:0/906506605 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x557394dfcd80 0x5573951fac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:36:06.838 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:06.831+0000 7fc465e00640 1 --2- 172.21.15.50:0/906506605 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x557394dfcd80 0x5573951fac30 crc :-1 s=READY pgs=163 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7145b1ea683229b8 server_cookie=8518abc019073991 in_seq=0 out_seq=0 2024-08-31T04:36:06.838 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:06.831+0000 7fc446a00640 10 client.26545 ms_handle_connect on v2:172.21.15.133:6838/2526402262 2024-08-31T04:36:06.838 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:06.832+0000 7fc446a00640 1 -- 172.21.15.50:0/906506605 <== mds.0 v2:172.21.15.133:6838/2526402262 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x557395158ec0 con 0x557394dfcd80 2024-08-31T04:36:06.838 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:06.832+0000 7fc446a00640 10 client.26545 handle_command_reply: tid=0 2024-08-31T04:36:06.838 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:06.832+0000 7fc46ede5740 1 client.26545 shutdown 2024-08-31T04:36:06.838 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:06.832+0000 7fc46ede5740 1 -- 172.21.15.50:0/906506605 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557394e1d4d0 msgr2=0x5573951edb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:36:06.839 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:06.832+0000 7fc46ede5740 1 --2- 172.21.15.50:0/906506605 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557394e1d4d0 0x5573951edb40 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fc44c009900 tx=0x7fc44c031d40 comp rx=0 tx=0).stop 2024-08-31T04:36:06.839 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:06.832+0000 7fc46ede5740 1 -- 172.21.15.50:0/906506605 shutdown_connections 2024-08-31T04:36:06.839 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:06.832+0000 7fc46ede5740 1 --2- 172.21.15.50:0/906506605 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x557394dfcd80 0x5573951fac30 crc :-1 s=READY pgs=163 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:06.839 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:06.832+0000 7fc46ede5740 1 --2- 172.21.15.50:0/906506605 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557394e1d4d0 0x5573951edb40 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:06.839 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:06.832+0000 7fc46ede5740 1 --2- 172.21.15.50:0/906506605 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x557394e3e1b0 0x5573951ee6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:06.839 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:06.832+0000 7fc46ede5740 1 --2- 172.21.15.50:0/906506605 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557394e152f0 0x5573951ed480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:06.839 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:06.832+0000 7fc446a00640 0 client.26545 ms_handle_reset on v2:172.21.15.133:6838/2526402262 2024-08-31T04:36:06.839 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:06.832+0000 7fc46ede5740 1 -- 172.21.15.50:0/906506605 >> 172.21.15.50:0/906506605 conn(0x557394e32300 msgr2=0x5573951ddcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:36:06.839 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:06.832+0000 7fc46ede5740 1 -- 172.21.15.50:0/906506605 shutdown_connections 2024-08-31T04:36:06.839 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:06.832+0000 7fc46ede5740 1 -- 172.21.15.50:0/906506605 wait complete. 2024-08-31T04:36:06.839 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:06.832+0000 7fc46ede5740 20 client.26545 trim_cache size 0 max 16384 2024-08-31T04:36:06.862 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:06.861+0000 7fc46ede5740 1 Processor -- start 2024-08-31T04:36:06.862 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:06.861+0000 7fc46ede5740 1 -- start start 2024-08-31T04:36:06.862 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:06.861+0000 7fc46ede5740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557394e152f0 0x5573951ec9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:36:06.863 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:06.861+0000 7fc46ede5740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557394e1d4d0 0x5573951edb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:36:06.863 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:06.861+0000 7fc46ede5740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x557394e3e1b0 0x5573951ee6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:36:06.863 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:06.861+0000 7fc46ede5740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fc4601b1340 con 0x557394e152f0 2024-08-31T04:36:06.863 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:06.861+0000 7fc46ede5740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7fc4601b30c0 con 0x557394e3e1b0 2024-08-31T04:36:06.863 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:06.861+0000 7fc46ede5740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fc4601b1ad0 con 0x557394e1d4d0 2024-08-31T04:36:06.864 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:06.861+0000 7fc464a00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557394e1d4d0 0x5573951edb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:36:06.864 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:06.861+0000 7fc465e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557394e152f0 0x5573951ec9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:36:06.864 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:06.862+0000 7fc464a00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557394e1d4d0 0x5573951edb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.50:58512/0 (socket says 172.21.15.50:58512) 2024-08-31T04:36:06.864 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:06.862+0000 7fc464a00640 1 -- 172.21.15.50:0/1213165297 learned_addr learned my addr 172.21.15.50:0/1213165297 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:36:06.864 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:06.862+0000 7fc465e00640 1 --2- 172.21.15.50:0/1213165297 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x557394e3e1b0 0x5573951ee6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:36:06.864 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:06.862+0000 7fc464a00640 1 -- 172.21.15.50:0/1213165297 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x557394e3e1b0 msgr2=0x5573951ee6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:36:06.864 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:06.862+0000 7fc464a00640 1 --2- 172.21.15.50:0/1213165297 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x557394e3e1b0 0x5573951ee6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:06.865 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:06.862+0000 7fc464a00640 1 -- 172.21.15.50:0/1213165297 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557394e152f0 msgr2=0x5573951ec9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:36:06.865 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:06.862+0000 7fc464a00640 1 --2- 172.21.15.50:0/1213165297 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557394e152f0 0x5573951ec9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:06.865 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:06.862+0000 7fc464a00640 1 -- 172.21.15.50:0/1213165297 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5573951e4cd0 con 0x557394e1d4d0 2024-08-31T04:36:06.865 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:06.862+0000 7fc464a00640 1 --2- 172.21.15.50:0/1213165297 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557394e1d4d0 0x5573951edb90 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fc44c009850 tx=0x7fc44c02a3f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=973010f94c98853 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:36:06.865 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:06.863+0000 7fc451c00640 1 -- 172.21.15.50:0/1213165297 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc44c056070 con 0x557394e1d4d0 2024-08-31T04:36:06.865 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:06.863+0000 7fc451c00640 1 -- 172.21.15.50:0/1213165297 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc44c048580 con 0x557394e1d4d0 2024-08-31T04:36:06.865 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:06.863+0000 7fc451c00640 1 -- 172.21.15.50:0/1213165297 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc44c035070 con 0x557394e1d4d0 2024-08-31T04:36:06.866 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:06.864+0000 7fc46ede5740 1 -- 172.21.15.50:0/1213165297 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557394e1d4d0 msgr2=0x5573951edb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:36:06.866 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:06.864+0000 7fc46ede5740 1 --2- 172.21.15.50:0/1213165297 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557394e1d4d0 0x5573951edb90 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fc44c009850 tx=0x7fc44c02a3f0 comp rx=0 tx=0).stop 2024-08-31T04:36:06.866 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:06.864+0000 7fc46ede5740 1 -- 172.21.15.50:0/1213165297 shutdown_connections 2024-08-31T04:36:06.866 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:06.864+0000 7fc46ede5740 1 --2- 172.21.15.50:0/1213165297 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557394e1d4d0 0x5573951edb90 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:06.866 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:06.864+0000 7fc46ede5740 1 --2- 172.21.15.50:0/1213165297 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x557394e3e1b0 0x5573951ee6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:06.866 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:06.864+0000 7fc46ede5740 1 --2- 172.21.15.50:0/1213165297 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557394e152f0 0x5573951ec9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:06.866 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:06.864+0000 7fc46ede5740 1 -- 172.21.15.50:0/1213165297 >> 172.21.15.50:0/1213165297 conn(0x557394e32300 msgr2=0x5573951ed480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:36:06.866 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:06.864+0000 7fc46ede5740 1 -- 172.21.15.50:0/1213165297 shutdown_connections 2024-08-31T04:36:06.866 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:06.864+0000 7fc46ede5740 1 -- 172.21.15.50:0/1213165297 wait complete. 2024-08-31T04:36:06.866 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:06.864+0000 7fc46ede5740 1 -- start start 2024-08-31T04:36:06.867 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:06.865+0000 7fc46ede5740 1 Processor -- start 2024-08-31T04:36:06.868 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:06.865+0000 7fc46ede5740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x557394e152f0 0x5573951f5270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:36:06.868 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:06.865+0000 7fc46ede5740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557394e1d4d0 0x5573951f3f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:36:06.869 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:06.865+0000 7fc46ede5740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557394e3e1b0 0x5573951f44b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:36:06.869 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:06.865+0000 7fc46ede5740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fc4601b29f0 con 0x557394e1d4d0 2024-08-31T04:36:06.869 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:06.865+0000 7fc46ede5740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7fc4601b2260 con 0x557394e152f0 2024-08-31T04:36:06.869 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:06.865+0000 7fc46ede5740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fc4601af320 con 0x557394e3e1b0 2024-08-31T04:36:06.869 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:06.865+0000 7fc46ede5740 10 client.0 _ll_register_callbacks cb 0x7fc44c005e70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:36:06.869 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:06.865+0000 7fc464a00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557394e1d4d0 0x5573951f3f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:36:06.869 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:06.866+0000 7fc464a00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557394e1d4d0 0x5573951f3f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:41222/0 (socket says 172.21.15.50:41222) 2024-08-31T04:36:06.869 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:06.866+0000 7fc464a00640 1 -- 172.21.15.50:0/3300776145 learned_addr learned my addr 172.21.15.50:0/3300776145 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:36:06.869 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:06.866+0000 7fc465e00640 1 --2- 172.21.15.50:0/3300776145 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557394e3e1b0 0x5573951f44b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:36:06.869 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:06.866+0000 7fc465e00640 1 --2- 172.21.15.50:0/3300776145 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x557394e152f0 0x5573951f5270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:36:06.869 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:06.866+0000 7fc464a00640 1 -- 172.21.15.50:0/3300776145 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557394e3e1b0 msgr2=0x5573951f44b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:36:06.869 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:06.866+0000 7fc464a00640 1 --2- 172.21.15.50:0/3300776145 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557394e3e1b0 0x5573951f44b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:06.869 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:06.866+0000 7fc464a00640 1 -- 172.21.15.50:0/3300776145 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x557394e152f0 msgr2=0x5573951f5270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:36:06.870 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:06.866+0000 7fc464a00640 1 --2- 172.21.15.50:0/3300776145 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x557394e152f0 0x5573951f5270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:06.870 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:06.866+0000 7fc464a00640 1 -- 172.21.15.50:0/3300776145 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5573951f4c40 con 0x557394e1d4d0 2024-08-31T04:36:06.870 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:06.866+0000 7fc464a00640 1 --2- 172.21.15.50:0/3300776145 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557394e1d4d0 0x5573951f3f30 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7fc44c02a910 tx=0x7fc44c005d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4decb0d6a51b32f server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:36:06.870 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:06.866+0000 7fc446a00640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-08-31T04:36:06.870 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:06.867+0000 7fc446a00640 1 -- 172.21.15.50:0/3300776145 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc44c035070 con 0x557394e1d4d0 2024-08-31T04:36:06.870 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:06.867+0000 7fc446a00640 1 -- 172.21.15.50:0/3300776145 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8219+0+0 (secure 0 0 0) 0x7fc44c0480d0 con 0x557394e1d4d0 2024-08-31T04:36:06.870 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:06.867+0000 7fc46ede5740 1 -- 172.21.15.50:0/3300776145 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc44c048580 con 0x557394e1d4d0 2024-08-31T04:36:06.870 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:06.867+0000 7fc446a00640 1 -- 172.21.15.50:0/3300776145 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=71) ==== 24+0+0 (secure 0 0 0) 0x7fc44c056040 con 0x557394e1d4d0 2024-08-31T04:36:06.870 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:06.867+0000 7fc46ede5740 10 client.16608 fetch_fsmap learned FSMap version 71 2024-08-31T04:36:06.870 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:06.867+0000 7fc46ede5740 1 -- 172.21.15.50:0/3300776145 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=71,monmap=4+}) -- 0x557395265630 con 0x557394e1d4d0 2024-08-31T04:36:06.870 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:06.867+0000 7fc446a00640 1 -- 172.21.15.50:0/3300776145 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc44c048580 con 0x557394e1d4d0 2024-08-31T04:36:06.871 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:06.868+0000 7fc446a00640 1 -- 172.21.15.50:0/3300776145 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 71) ==== 8442+0+0 (secure 0 0 0) 0x7fc44c03cad0 con 0x557394e1d4d0 2024-08-31T04:36:06.871 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:06.868+0000 7fc46ede5740 10 client.16608 fetch_fsmap finished waiting for FSMap version 71 2024-08-31T04:36:06.871 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:06.868+0000 7fc46ede5740 10 client.16608 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T04:36:06.871 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:06.868+0000 7fc46ede5740 20 client.16608 populate_metadata read hostname 'smithi050' 2024-08-31T04:36:06.871 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:06.868+0000 7fc46ede5740 1 --2- 172.21.15.50:0/3300776145 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x557394dd21c0 0x557395267fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:36:06.871 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:06.868+0000 7fc46ede5740 4 client.16608 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-31T04:36:06.872 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:06.868+0000 7fc46ede5740 1 -- 172.21.15.50:0/3300776145 --> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5573951de290 con 0x557394dd21c0 2024-08-31T04:36:06.872 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:06.868+0000 7fc465e00640 1 --2- 172.21.15.50:0/3300776145 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x557394dd21c0 0x557395267fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:36:06.872 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:06.869+0000 7fc465e00640 1 --2- 172.21.15.50:0/3300776145 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x557394dd21c0 0x557395267fc0 crc :-1 s=READY pgs=164 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=94ee573f838d1b2a server_cookie=22a2f08a6430ccb7 in_seq=0 out_seq=0 2024-08-31T04:36:06.872 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:06.869+0000 7fc446a00640 10 client.16608 ms_handle_connect on v2:172.21.15.133:6838/2526402262 2024-08-31T04:36:07.063 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:07.062+0000 7fc446a00640 1 -- 172.21.15.50:0/3300776145 <== mds.0 v2:172.21.15.133:6838/2526402262 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5573951de290 con 0x557394dd21c0 2024-08-31T04:36:07.063 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:07.062+0000 7fc446a00640 10 client.16608 handle_command_reply: tid=0 2024-08-31T04:36:07.063 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:07.062+0000 7fc46ede5740 1 client.16608 shutdown 2024-08-31T04:36:07.064 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:07.062+0000 7fc46ede5740 1 -- 172.21.15.50:0/3300776145 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557394e1d4d0 msgr2=0x5573951f3f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:36:07.065 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:07.062+0000 7fc46ede5740 1 --2- 172.21.15.50:0/3300776145 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557394e1d4d0 0x5573951f3f30 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7fc44c02a910 tx=0x7fc44c005d90 comp rx=0 tx=0).stop 2024-08-31T04:36:07.065 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:07.063+0000 7fc46ede5740 1 -- 172.21.15.50:0/3300776145 shutdown_connections 2024-08-31T04:36:07.065 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:07.063+0000 7fc46ede5740 1 --2- 172.21.15.50:0/3300776145 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x557394dd21c0 0x557395267fc0 crc :-1 s=READY pgs=164 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:07.065 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:07.063+0000 7fc46ede5740 1 --2- 172.21.15.50:0/3300776145 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557394e3e1b0 0x5573951f44b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:07.065 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:07.063+0000 7fc46ede5740 1 --2- 172.21.15.50:0/3300776145 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557394e1d4d0 0x5573951f3f30 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:07.065 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:07.063+0000 7fc46ede5740 1 --2- 172.21.15.50:0/3300776145 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x557394e152f0 0x5573951f5270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:07.065 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:07.063+0000 7fc46ede5740 1 -- 172.21.15.50:0/3300776145 >> 172.21.15.50:0/3300776145 conn(0x557394e32300 msgr2=0x5573951ee640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:36:07.065 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:07.063+0000 7fc446a00640 0 client.16608 ms_handle_reset on v2:172.21.15.133:6838/2526402262 2024-08-31T04:36:07.065 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:07.063+0000 7fc46ede5740 1 -- 172.21.15.50:0/3300776145 shutdown_connections 2024-08-31T04:36:07.065 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:07.063+0000 7fc46ede5740 1 -- 172.21.15.50:0/3300776145 wait complete. 2024-08-31T04:36:07.065 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:07.063+0000 7fc46ede5740 20 client.16608 trim_cache size 0 max 16384 2024-08-31T04:36:07.066 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout:{ 2024-08-31T04:36:07.066 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout: "message": "", 2024-08-31T04:36:07.066 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout: "return_code": 0 2024-08-31T04:36:07.066 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout:} 2024-08-31T04:36:07.067 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:07.065+0000 7fc467e00640 1 -- 172.21.15.50:0/173297464 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fc4480b4bb0 msgr2=0x7fc4480b70c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:36:07.067 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:07.065+0000 7fc467e00640 1 --2- 172.21.15.50:0/173297464 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fc4480b4bb0 0x7fc4480b70c0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fc4540a7e80 tx=0x7fc4540e8e60 comp rx=0 tx=0).stop 2024-08-31T04:36:07.067 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:07.065+0000 7fc467e00640 1 -- 172.21.15.50:0/173297464 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc460075a90 msgr2=0x7fc4601a02e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:36:07.067 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:07.065+0000 7fc467e00640 1 --2- 172.21.15.50:0/173297464 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc460075a90 0x7fc4601a02e0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7fc45400ea60 tx=0x7fc45400ef20 comp rx=0 tx=0).stop 2024-08-31T04:36:07.067 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:07.065+0000 7fc467e00640 1 -- 172.21.15.50:0/173297464 shutdown_connections 2024-08-31T04:36:07.067 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:07.065+0000 7fc467e00640 1 --2- 172.21.15.50:0/173297464 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fc4480b4bb0 0x7fc4480b70c0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:07.067 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:07.065+0000 7fc467e00640 1 --2- 172.21.15.50:0/173297464 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc460076e90 0x7fc4601a0950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:07.067 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:07.065+0000 7fc467e00640 1 --2- 172.21.15.50:0/173297464 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc46010fbe0 0x7fc4601a1500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:07.067 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:07.065+0000 7fc467e00640 1 --2- 172.21.15.50:0/173297464 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc460075a90 0x7fc4601a02e0 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:07.067 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:07.065+0000 7fc467e00640 1 -- 172.21.15.50:0/173297464 >> 172.21.15.50:0/173297464 conn(0x7fc4600fedc0 msgr2=0x7fc460102e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:36:07.068 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:07.065+0000 7fc467e00640 1 -- 172.21.15.50:0/173297464 shutdown_connections 2024-08-31T04:36:07.068 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:07.065+0000 7fc467e00640 1 -- 172.21.15.50:0/173297464 wait complete. 2024-08-31T04:36:07.450 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:36:07 smithi050 ceph-mon[17259]: pgmap v765: 97 pgs: 97 active+clean; 1.2 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.0 MiB/s wr, 399 op/s 2024-08-31T04:36:07.542 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:36:07 smithi133 ceph-mon[22177]: pgmap v765: 97 pgs: 97 active+clean; 1.2 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.0 MiB/s wr, 399 op/s 2024-08-31T04:36:07.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:36:07 smithi177 ceph-mon[22025]: pgmap v765: 97 pgs: 97 active+clean; 1.2 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.0 MiB/s wr, 399 op/s 2024-08-31T04:36:09.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:36:09 smithi133 ceph-mon[22177]: pgmap v766: 97 pgs: 97 active+clean; 1.2 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.5 MiB/s wr, 319 op/s 2024-08-31T04:36:09.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:36:09 smithi050 ceph-mon[17259]: pgmap v766: 97 pgs: 97 active+clean; 1.2 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.5 MiB/s wr, 319 op/s 2024-08-31T04:36:09.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:36:09 smithi177 ceph-mon[22025]: pgmap v766: 97 pgs: 97 active+clean; 1.2 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.5 MiB/s wr, 319 op/s 2024-08-31T04:36:11.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:36:11 smithi050 ceph-mon[17259]: pgmap v767: 97 pgs: 97 active+clean; 1.2 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.8 MiB/s wr, 335 op/s 2024-08-31T04:36:11.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:36:11 smithi177 ceph-mon[22025]: pgmap v767: 97 pgs: 97 active+clean; 1.2 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.8 MiB/s wr, 335 op/s 2024-08-31T04:36:11.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:36:11 smithi133 ceph-mon[22177]: pgmap v767: 97 pgs: 97 active+clean; 1.2 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.8 MiB/s wr, 335 op/s 2024-08-31T04:36:13.594 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:36:13 smithi133 ceph-mon[22177]: pgmap v768: 97 pgs: 97 active+clean; 1.2 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.1 MiB/s wr, 374 op/s 2024-08-31T04:36:13.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:36:13 smithi050 ceph-mon[17259]: pgmap v768: 97 pgs: 97 active+clean; 1.2 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.1 MiB/s wr, 374 op/s 2024-08-31T04:36:13.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:36:13 smithi177 ceph-mon[22025]: pgmap v768: 97 pgs: 97 active+clean; 1.2 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.1 MiB/s wr, 374 op/s 2024-08-31T04:36:15.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:36:15 smithi050 ceph-mon[17259]: pgmap v769: 97 pgs: 97 active+clean; 1.2 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 350 op/s 2024-08-31T04:36:15.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:36:15 smithi177 ceph-mon[22025]: pgmap v769: 97 pgs: 97 active+clean; 1.2 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 350 op/s 2024-08-31T04:36:15.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:36:15 smithi133 ceph-mon[22177]: pgmap v769: 97 pgs: 97 active+clean; 1.2 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 350 op/s 2024-08-31T04:36:17.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:36:17 smithi050 ceph-mon[17259]: pgmap v770: 97 pgs: 97 active+clean; 1.2 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 401 op/s 2024-08-31T04:36:17.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:36:17 smithi177 ceph-mon[22025]: pgmap v770: 97 pgs: 97 active+clean; 1.2 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 401 op/s 2024-08-31T04:36:17.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:36:17 smithi133 ceph-mon[22177]: pgmap v770: 97 pgs: 97 active+clean; 1.2 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 401 op/s 2024-08-31T04:36:19.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:36:19 smithi050 ceph-mon[17259]: pgmap v771: 97 pgs: 97 active+clean; 1.2 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 359 op/s 2024-08-31T04:36:19.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:36:19 smithi177 ceph-mon[22025]: pgmap v771: 97 pgs: 97 active+clean; 1.2 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 359 op/s 2024-08-31T04:36:19.792 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:36:19 smithi133 ceph-mon[22177]: pgmap v771: 97 pgs: 97 active+clean; 1.2 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 359 op/s 2024-08-31T04:36:20.269 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:20.267+0000 7f846fc00640 1 -- 172.21.15.50:0/456391207 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8468104e90 msgr2=0x7f846810b830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:36:20.269 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:20.267+0000 7f846fc00640 1 --2- 172.21.15.50:0/456391207 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8468104e90 0x7f846810b830 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f8460009ca0 tx=0x7f846002a8c0 comp rx=0 tx=0).stop 2024-08-31T04:36:20.269 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:20.267+0000 7f846fc00640 1 -- 172.21.15.50:0/456391207 shutdown_connections 2024-08-31T04:36:20.269 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:20.267+0000 7f846fc00640 1 --2- 172.21.15.50:0/456391207 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8468104e90 0x7f846810b830 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:20.269 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:20.267+0000 7f846fc00640 1 --2- 172.21.15.50:0/456391207 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f84681044f0 0x7f8468104900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:20.269 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:20.267+0000 7f846fc00640 1 --2- 172.21.15.50:0/456391207 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8468103470 0x7f84681038e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:20.270 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:20.267+0000 7f846fc00640 1 -- 172.21.15.50:0/456391207 >> 172.21.15.50:0/456391207 conn(0x7f84680fedd0 msgr2=0x7f8468101260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:36:20.270 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:20.267+0000 7f846fc00640 1 -- 172.21.15.50:0/456391207 shutdown_connections 2024-08-31T04:36:20.270 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:20.267+0000 7f846fc00640 1 -- 172.21.15.50:0/456391207 wait complete. 2024-08-31T04:36:20.271 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:20.268+0000 7f846fc00640 1 Processor -- start 2024-08-31T04:36:20.271 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:20.269+0000 7f846fc00640 1 -- start start 2024-08-31T04:36:20.271 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:20.269+0000 7f846fc00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8468103470 0x7f846819be90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:36:20.271 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:20.269+0000 7f846fc00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f84681044f0 0x7f846819c500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:36:20.271 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:20.269+0000 7f846fc00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8468104e90 0x7f846819d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:36:20.271 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:20.269+0000 7f846fc00640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f846810f0f0 con 0x7f8468104e90 2024-08-31T04:36:20.271 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:20.269+0000 7f846fc00640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f846810ef70 con 0x7f84681044f0 2024-08-31T04:36:20.271 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:20.269+0000 7f846fc00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f846810f270 con 0x7f8468103470 2024-08-31T04:36:20.271 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:20.269+0000 7f8467e00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f84681044f0 0x7f846819c500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:36:20.271 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:20.270+0000 7f8467e00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f84681044f0 0x7f846819c500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.50:56806/0 (socket says 172.21.15.50:56806) 2024-08-31T04:36:20.271 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:20.270+0000 7f8467e00640 1 -- 172.21.15.50:0/158600566 learned_addr learned my addr 172.21.15.50:0/158600566 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:36:20.272 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:20.270+0000 7f846d200640 1 --2- 172.21.15.50:0/158600566 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8468103470 0x7f846819be90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:36:20.272 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:20.270+0000 7f846dc00640 1 --2- 172.21.15.50:0/158600566 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8468104e90 0x7f846819d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:36:20.272 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:20.270+0000 7f8467e00640 1 -- 172.21.15.50:0/158600566 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8468103470 msgr2=0x7f846819be90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:36:20.272 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:20.270+0000 7f8467e00640 1 --2- 172.21.15.50:0/158600566 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8468103470 0x7f846819be90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:20.272 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:20.270+0000 7f8467e00640 1 -- 172.21.15.50:0/158600566 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8468104e90 msgr2=0x7f846819d0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:36:20.272 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:20.270+0000 7f8467e00640 1 --2- 172.21.15.50:0/158600566 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8468104e90 0x7f846819d0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:20.272 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:20.270+0000 7f8467e00640 1 -- 172.21.15.50:0/158600566 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f846819d8d0 con 0x7f84681044f0 2024-08-31T04:36:20.273 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:20.272+0000 7f8467e00640 1 --2- 172.21.15.50:0/158600566 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f84681044f0 0x7f846819c500 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f845400e9f0 tx=0x7f845400eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:36:20.274 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:20.273+0000 7f8465600640 1 -- 172.21.15.50:0/158600566 <== mon.2 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f845400cd80 con 0x7f84681044f0 2024-08-31T04:36:20.274 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:20.273+0000 7f8465600640 1 -- 172.21.15.50:0/158600566 <== mon.2 v2:172.21.15.133:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f84540108e0 con 0x7f84681044f0 2024-08-31T04:36:20.274 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:20.273+0000 7f8465600640 1 -- 172.21.15.50:0/158600566 <== mon.2 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8454018980 con 0x7f84681044f0 2024-08-31T04:36:20.274 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:20.273+0000 7f846fc00640 1 -- 172.21.15.50:0/158600566 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f846819dbc0 con 0x7f84681044f0 2024-08-31T04:36:20.275 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:20.273+0000 7f846fc00640 1 -- 172.21.15.50:0/158600566 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f84681a42b0 con 0x7f84681044f0 2024-08-31T04:36:20.280 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:20.279+0000 7f8476ca7740 1 Processor -- start 2024-08-31T04:36:20.281 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:20.279+0000 7f8465600640 1 -- 172.21.15.50:0/158600566 <== mon.2 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 18) ==== 152577+0+0 (secure 0 0 0) 0x7f8454010430 con 0x7f84681044f0 2024-08-31T04:36:20.281 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:20.279+0000 7f8476ca7740 1 -- start start 2024-08-31T04:36:20.281 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:20.279+0000 7f8476ca7740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55bd8e6641b0 0x55bd8ea125d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:36:20.281 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:20.279+0000 7f8476ca7740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55bd8e63b2f0 0x55bd8ea12c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:36:20.281 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:20.279+0000 7f8476ca7740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55bd8e6434d0 0x55bd8ea13790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:36:20.281 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:20.279+0000 7f8476ca7740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55bd8e97cf70 con 0x55bd8e63b2f0 2024-08-31T04:36:20.281 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:20.279+0000 7f8476ca7740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x55bd8e96c500 con 0x55bd8e6434d0 2024-08-31T04:36:20.281 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:20.279+0000 7f8476ca7740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x55bd8e9704b0 con 0x55bd8e6641b0 2024-08-31T04:36:20.283 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:20.280+0000 7f846dc00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55bd8e6641b0 0x55bd8ea125d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:36:20.283 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:20.280+0000 7f846dc00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55bd8e6641b0 0x55bd8ea125d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.50:49184/0 (socket says 172.21.15.50:49184) 2024-08-31T04:36:20.283 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:20.280+0000 7f846dc00640 1 -- 172.21.15.50:0/2192211001 learned_addr learned my addr 172.21.15.50:0/2192211001 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:36:20.283 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:20.281+0000 7f846dc00640 1 -- 172.21.15.50:0/2192211001 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55bd8e6434d0 msgr2=0x55bd8ea13790 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-31T04:36:20.283 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:20.281+0000 7f846dc00640 1 --2- 172.21.15.50:0/2192211001 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55bd8e6434d0 0x55bd8ea13790 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:20.283 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:20.281+0000 7f846dc00640 1 -- 172.21.15.50:0/2192211001 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55bd8e63b2f0 msgr2=0x55bd8ea12c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:36:20.283 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:20.281+0000 7f846dc00640 1 --2- 172.21.15.50:0/2192211001 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55bd8e63b2f0 0x55bd8ea12c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:20.283 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:20.281+0000 7f846dc00640 1 -- 172.21.15.50:0/2192211001 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bd8e926c10 con 0x55bd8e6641b0 2024-08-31T04:36:20.283 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:20.281+0000 7f846dc00640 1 --2- 172.21.15.50:0/2192211001 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55bd8e6641b0 0x55bd8ea125d0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f8460035000 tx=0x7f846002f410 comp rx=0 tx=0).ready entity=mon.1 client_cookie=21cf19ff402ba6b0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:36:20.284 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:20.282+0000 7f845a000640 1 -- 172.21.15.50:0/2192211001 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8460031650 con 0x55bd8e6641b0 2024-08-31T04:36:20.284 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:20.282+0000 7f845a000640 1 -- 172.21.15.50:0/2192211001 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8460036030 con 0x55bd8e6641b0 2024-08-31T04:36:20.284 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:20.282+0000 7f845a000640 1 -- 172.21.15.50:0/2192211001 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84600047f0 con 0x55bd8e6641b0 2024-08-31T04:36:20.285 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:20.283+0000 7f8465600640 1 --2- 172.21.15.50:0/158600566 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f84500b4c30 0x7f84500b7140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:36:20.285 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:20.283+0000 7f8476ca7740 1 -- 172.21.15.50:0/2192211001 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55bd8e6641b0 msgr2=0x55bd8ea125d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:36:20.285 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:20.283+0000 7f8476ca7740 1 --2- 172.21.15.50:0/2192211001 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55bd8e6641b0 0x55bd8ea125d0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f8460035000 tx=0x7f846002f410 comp rx=0 tx=0).stop 2024-08-31T04:36:20.285 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:20.283+0000 7f8465600640 1 -- 172.21.15.50:0/158600566 <== mon.2 v2:172.21.15.133:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8219+0+0 (secure 0 0 0) 0x7f84540e5410 con 0x7f84681044f0 2024-08-31T04:36:20.285 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:20.283+0000 7f8476ca7740 1 -- 172.21.15.50:0/2192211001 shutdown_connections 2024-08-31T04:36:20.285 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:20.283+0000 7f8476ca7740 1 --2- 172.21.15.50:0/2192211001 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55bd8e6434d0 0x55bd8ea13790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:20.285 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:20.283+0000 7f8476ca7740 1 --2- 172.21.15.50:0/2192211001 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55bd8e63b2f0 0x55bd8ea12c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:20.286 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:20.283+0000 7f8476ca7740 1 --2- 172.21.15.50:0/2192211001 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55bd8e6641b0 0x55bd8ea125d0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:20.286 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:20.283+0000 7f8476ca7740 1 -- 172.21.15.50:0/2192211001 >> 172.21.15.50:0/2192211001 conn(0x55bd8e658300 msgr2=0x55bd8ea05850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:36:20.286 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:20.283+0000 7f846d200640 1 --2- 172.21.15.50:0/158600566 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f84500b4c30 0x7f84500b7140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:36:20.286 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:20.284+0000 7f8476ca7740 1 -- 172.21.15.50:0/2192211001 shutdown_connections 2024-08-31T04:36:20.286 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:20.284+0000 7f8476ca7740 1 -- 172.21.15.50:0/2192211001 wait complete. 2024-08-31T04:36:20.287 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:20.284+0000 7f8476ca7740 1 -- start start 2024-08-31T04:36:20.287 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:20.285+0000 7f846d200640 1 --2- 172.21.15.50:0/158600566 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f84500b4c30 0x7f84500b7140 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f845c009ad0 tx=0x7f845c0046c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:36:20.287 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:20.285+0000 7f8476ca7740 1 Processor -- start 2024-08-31T04:36:20.288 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:20.285+0000 7f8476ca7740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55bd8e63b2f0 0x55bd8ea1bb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:36:20.288 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:20.285+0000 7f8476ca7740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55bd8e6434d0 0x55bd8ea1c220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:36:20.288 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:20.286+0000 7f8476ca7740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55bd8e6641b0 0x55bd8ea1cd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:36:20.288 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:20.286+0000 7f8476ca7740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55bd8e8a5ab0 con 0x55bd8e6434d0 2024-08-31T04:36:20.288 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:20.286+0000 7f8476ca7740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x55bd8e913320 con 0x55bd8e6641b0 2024-08-31T04:36:20.288 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:20.286+0000 7f8476ca7740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x55bd8ea140d0 con 0x55bd8e63b2f0 2024-08-31T04:36:20.288 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:20.286+0000 7f8476ca7740 10 client.0 _ll_register_callbacks cb 0x55bd8e9196a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:36:20.288 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:20.286+0000 7f846d200640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55bd8e63b2f0 0x55bd8ea1bb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:36:20.288 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:20.286+0000 7f846d200640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55bd8e63b2f0 0x55bd8ea1bb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.50:49188/0 (socket says 172.21.15.50:49188) 2024-08-31T04:36:20.288 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:20.286+0000 7f846d200640 1 -- 172.21.15.50:0/470064122 learned_addr learned my addr 172.21.15.50:0/470064122 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:36:20.288 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:20.286+0000 7f8467e00640 1 --2- 172.21.15.50:0/470064122 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55bd8e6434d0 0x55bd8ea1c220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:36:20.288 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:20.286+0000 7f846dc00640 1 --2- 172.21.15.50:0/470064122 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55bd8e6641b0 0x55bd8ea1cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:36:20.289 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:20.287+0000 7f846dc00640 1 -- 172.21.15.50:0/470064122 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55bd8e63b2f0 msgr2=0x55bd8ea1bb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:36:20.289 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:20.287+0000 7f846dc00640 1 --2- 172.21.15.50:0/470064122 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55bd8e63b2f0 0x55bd8ea1bb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:20.289 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:20.287+0000 7f846dc00640 1 -- 172.21.15.50:0/470064122 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55bd8e6434d0 msgr2=0x55bd8ea1c220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:36:20.289 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:20.287+0000 7f846dc00640 1 --2- 172.21.15.50:0/470064122 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55bd8e6434d0 0x55bd8ea1c220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:20.289 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:20.287+0000 7f846dc00640 1 -- 172.21.15.50:0/470064122 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bd8e6cf790 con 0x55bd8e6641b0 2024-08-31T04:36:20.290 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:20.288+0000 7f846dc00640 1 --2- 172.21.15.50:0/470064122 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55bd8e6641b0 0x55bd8ea1cd90 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f8460009ca0 tx=0x7f8460031660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=29576d2db024855b server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:36:20.290 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:20.288+0000 7f844ea00640 10 client.0 ms_handle_connect on v2:172.21.15.133:3300/0 2024-08-31T04:36:20.290 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:20.289+0000 7f844ea00640 1 -- 172.21.15.50:0/470064122 <== mon.2 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f846004a040 con 0x55bd8e6641b0 2024-08-31T04:36:20.291 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:20.289+0000 7f844ea00640 1 -- 172.21.15.50:0/470064122 <== mon.2 v2:172.21.15.133:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8219+0+0 (secure 0 0 0) 0x7f8460003970 con 0x55bd8e6641b0 2024-08-31T04:36:20.291 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:20.289+0000 7f8476ca7740 1 -- 172.21.15.50:0/470064122 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8460036030 con 0x55bd8e6641b0 2024-08-31T04:36:20.291 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:20.290+0000 7f844ea00640 1 -- 172.21.15.50:0/470064122 <== mon.2 v2:172.21.15.133:3300/0 3 ==== mon_get_version_reply(handle=1 version=71) ==== 24+0+0 (secure 0 0 0) 0x7f8460009360 con 0x55bd8e6641b0 2024-08-31T04:36:20.291 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:20.290+0000 7f8476ca7740 10 client.26573 fetch_fsmap learned FSMap version 71 2024-08-31T04:36:20.291 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:20.290+0000 7f8476ca7740 1 -- 172.21.15.50:0/470064122 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,fsmap=71,monmap=4+}) -- 0x55bd8e748620 con 0x55bd8e6641b0 2024-08-31T04:36:20.292 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:20.290+0000 7f844ea00640 1 -- 172.21.15.50:0/470064122 <== mon.2 v2:172.21.15.133:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8460036030 con 0x55bd8e6641b0 2024-08-31T04:36:20.292 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:20.290+0000 7f844ea00640 1 -- 172.21.15.50:0/470064122 <== mon.2 v2:172.21.15.133:3300/0 5 ==== fsmap(e 71) ==== 8442+0+0 (secure 0 0 0) 0x7f846004d030 con 0x55bd8e6641b0 2024-08-31T04:36:20.292 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:20.291+0000 7f8476ca7740 10 client.26573 fetch_fsmap finished waiting for FSMap version 71 2024-08-31T04:36:20.293 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:20.291+0000 7f8476ca7740 10 client.26573 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T04:36:20.293 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:20.291+0000 7f8476ca7740 20 client.26573 populate_metadata read hostname 'smithi050' 2024-08-31T04:36:20.293 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:20.291+0000 7f8476ca7740 1 --2- 172.21.15.50:0/470064122 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x55bd8e622d80 0x55bd8ea28f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:36:20.293 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:20.291+0000 7f8476ca7740 4 client.26573 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T04:36:20.293 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:20.291+0000 7f8476ca7740 1 -- 172.21.15.50:0/470064122 --> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55bd8e97eec0 con 0x55bd8e622d80 2024-08-31T04:36:20.294 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:20.291+0000 7f846d200640 1 --2- 172.21.15.50:0/470064122 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x55bd8e622d80 0x55bd8ea28f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:36:20.294 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:20.293+0000 7f846d200640 1 --2- 172.21.15.50:0/470064122 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x55bd8e622d80 0x55bd8ea28f00 crc :-1 s=READY pgs=165 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c2f246a4d431f181 server_cookie=434431f2d746d331 in_seq=0 out_seq=0 2024-08-31T04:36:20.295 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:20.294+0000 7f844ea00640 10 client.26573 ms_handle_connect on v2:172.21.15.133:6838/2526402262 2024-08-31T04:36:20.296 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:20.294+0000 7f844ea00640 1 -- 172.21.15.50:0/470064122 <== mds.0 v2:172.21.15.133:6838/2526402262 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55bd8e97eec0 con 0x55bd8e622d80 2024-08-31T04:36:20.296 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:20.295+0000 7f844ea00640 10 client.26573 handle_command_reply: tid=0 2024-08-31T04:36:20.296 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:20.295+0000 7f8476ca7740 1 client.26573 shutdown 2024-08-31T04:36:20.296 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:20.295+0000 7f8476ca7740 1 -- 172.21.15.50:0/470064122 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55bd8e6641b0 msgr2=0x55bd8ea1cd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:36:20.297 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:20.295+0000 7f8476ca7740 1 --2- 172.21.15.50:0/470064122 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55bd8e6641b0 0x55bd8ea1cd90 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f8460009ca0 tx=0x7f8460031660 comp rx=0 tx=0).stop 2024-08-31T04:36:20.297 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:20.296+0000 7f8476ca7740 1 -- 172.21.15.50:0/470064122 shutdown_connections 2024-08-31T04:36:20.297 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:20.296+0000 7f8476ca7740 1 --2- 172.21.15.50:0/470064122 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x55bd8e622d80 0x55bd8ea28f00 crc :-1 s=READY pgs=165 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:20.297 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:20.296+0000 7f8476ca7740 1 --2- 172.21.15.50:0/470064122 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55bd8e6641b0 0x55bd8ea1cd90 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:20.297 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:20.296+0000 7f8476ca7740 1 --2- 172.21.15.50:0/470064122 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55bd8e6434d0 0x55bd8ea1c220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:20.297 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:20.296+0000 7f8476ca7740 1 --2- 172.21.15.50:0/470064122 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55bd8e63b2f0 0x55bd8ea1bb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:20.297 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:20.296+0000 7f8476ca7740 1 -- 172.21.15.50:0/470064122 >> 172.21.15.50:0/470064122 conn(0x55bd8e658300 msgr2=0x55bd8ea05830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:36:20.297 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:20.296+0000 7f844ea00640 0 client.26573 ms_handle_reset on v2:172.21.15.133:6838/2526402262 2024-08-31T04:36:20.298 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:20.296+0000 7f8476ca7740 1 -- 172.21.15.50:0/470064122 shutdown_connections 2024-08-31T04:36:20.298 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:20.296+0000 7f8476ca7740 1 -- 172.21.15.50:0/470064122 wait complete. 2024-08-31T04:36:20.298 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:20.297+0000 7f8476ca7740 20 client.26573 trim_cache size 0 max 16384 2024-08-31T04:36:20.326 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:20.325+0000 7f8476ca7740 1 Processor -- start 2024-08-31T04:36:20.326 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:20.325+0000 7f8476ca7740 1 -- start start 2024-08-31T04:36:20.328 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:20.325+0000 7f8476ca7740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55bd8e658300 0x55bd8ea1ad60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:36:20.328 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:20.325+0000 7f8476ca7740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55bd8e63b2f0 0x55bd8ea1b2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:36:20.328 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:20.325+0000 7f8476ca7740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55bd8e6434d0 0x55bd8ea166e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:36:20.328 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:20.325+0000 7f8476ca7740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f84681a8ae0 con 0x55bd8e63b2f0 2024-08-31T04:36:20.328 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:20.325+0000 7f8476ca7740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f84681aa860 con 0x55bd8e6434d0 2024-08-31T04:36:20.328 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:20.325+0000 7f8476ca7740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f84681a9270 con 0x55bd8e658300 2024-08-31T04:36:20.328 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:20.326+0000 7f846d200640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55bd8e658300 0x55bd8ea1ad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:36:20.328 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:20.326+0000 7f846d200640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55bd8e658300 0x55bd8ea1ad60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.50:49198/0 (socket says 172.21.15.50:49198) 2024-08-31T04:36:20.329 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:20.326+0000 7f846d200640 1 -- 172.21.15.50:0/1289628542 learned_addr learned my addr 172.21.15.50:0/1289628542 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:36:20.329 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:20.326+0000 7f846dc00640 1 --2- 172.21.15.50:0/1289628542 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55bd8e6434d0 0x55bd8ea166e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:36:20.329 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:20.326+0000 7f8467e00640 1 --2- 172.21.15.50:0/1289628542 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55bd8e63b2f0 0x55bd8ea1b2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:36:20.329 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:20.326+0000 7f846d200640 1 -- 172.21.15.50:0/1289628542 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55bd8e6434d0 msgr2=0x55bd8ea166e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:36:20.329 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:20.326+0000 7f846d200640 1 --2- 172.21.15.50:0/1289628542 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55bd8e6434d0 0x55bd8ea166e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:20.329 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:20.326+0000 7f846d200640 1 -- 172.21.15.50:0/1289628542 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55bd8e63b2f0 msgr2=0x55bd8ea1b2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:36:20.329 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:20.326+0000 7f846d200640 1 --2- 172.21.15.50:0/1289628542 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55bd8e63b2f0 0x55bd8ea1b2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:20.329 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:20.326+0000 7f846d200640 1 -- 172.21.15.50:0/1289628542 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bd8ea1d270 con 0x55bd8e658300 2024-08-31T04:36:20.330 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:20.327+0000 7f846d200640 1 --2- 172.21.15.50:0/1289628542 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55bd8e658300 0x55bd8ea1ad60 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f845c004150 tx=0x7f845c014000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ba1bfb6c1dc1fef5 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:36:20.330 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:20.327+0000 7f8459600640 1 -- 172.21.15.50:0/1289628542 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f845c0043f0 con 0x55bd8e658300 2024-08-31T04:36:20.330 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:20.327+0000 7f8459600640 1 -- 172.21.15.50:0/1289628542 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f845c0054d0 con 0x55bd8e658300 2024-08-31T04:36:20.330 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:20.328+0000 7f8459600640 1 -- 172.21.15.50:0/1289628542 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f845c01e680 con 0x55bd8e658300 2024-08-31T04:36:20.331 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:20.329+0000 7f8476ca7740 1 -- 172.21.15.50:0/1289628542 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55bd8e658300 msgr2=0x55bd8ea1ad60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:36:20.331 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:20.329+0000 7f8476ca7740 1 --2- 172.21.15.50:0/1289628542 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55bd8e658300 0x55bd8ea1ad60 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f845c004150 tx=0x7f845c014000 comp rx=0 tx=0).stop 2024-08-31T04:36:20.331 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:20.329+0000 7f8476ca7740 1 -- 172.21.15.50:0/1289628542 shutdown_connections 2024-08-31T04:36:20.331 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:20.329+0000 7f8476ca7740 1 --2- 172.21.15.50:0/1289628542 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55bd8e6434d0 0x55bd8ea166e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:20.331 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:20.329+0000 7f8476ca7740 1 --2- 172.21.15.50:0/1289628542 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55bd8e63b2f0 0x55bd8ea1b2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:20.331 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:20.329+0000 7f8476ca7740 1 --2- 172.21.15.50:0/1289628542 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55bd8e658300 0x55bd8ea1ad60 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:20.331 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:20.329+0000 7f8476ca7740 1 -- 172.21.15.50:0/1289628542 >> 172.21.15.50:0/1289628542 conn(0x55bd8ea12ea0 msgr2=0x55bd8ea1a0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:36:20.331 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:20.329+0000 7f8476ca7740 1 -- 172.21.15.50:0/1289628542 shutdown_connections 2024-08-31T04:36:20.332 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:20.329+0000 7f8476ca7740 1 -- 172.21.15.50:0/1289628542 wait complete. 2024-08-31T04:36:20.332 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:20.330+0000 7f8476ca7740 1 -- start start 2024-08-31T04:36:20.332 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:20.330+0000 7f8476ca7740 1 Processor -- start 2024-08-31T04:36:20.333 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:20.331+0000 7f8476ca7740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55bd8e63b2f0 0x55bd8ea236f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:36:20.333 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:20.332+0000 7f8476ca7740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55bd8e6434d0 0x55bd8ea223b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:36:20.334 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:20.332+0000 7f8476ca7740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55bd8e658300 0x55bd8ea228f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:36:20.334 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:20.332+0000 7f8476ca7740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f84681aa190 con 0x55bd8e63b2f0 2024-08-31T04:36:20.334 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:20.332+0000 7f8476ca7740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f84681a9a00 con 0x55bd8e6434d0 2024-08-31T04:36:20.334 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:20.332+0000 7f8476ca7740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f84681a6b00 con 0x55bd8e658300 2024-08-31T04:36:20.334 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:20.332+0000 7f8476ca7740 10 client.0 _ll_register_callbacks cb 0x7f84600099c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:36:20.334 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:20.332+0000 7f846dc00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55bd8e658300 0x55bd8ea228f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:36:20.334 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:20.332+0000 7f846dc00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55bd8e658300 0x55bd8ea228f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.50:49210/0 (socket says 172.21.15.50:49210) 2024-08-31T04:36:20.334 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:20.332+0000 7f846dc00640 1 -- 172.21.15.50:0/3127142090 learned_addr learned my addr 172.21.15.50:0/3127142090 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:36:20.335 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:20.332+0000 7f846d200640 1 --2- 172.21.15.50:0/3127142090 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55bd8e63b2f0 0x55bd8ea236f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:36:20.335 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:20.332+0000 7f8467e00640 1 --2- 172.21.15.50:0/3127142090 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55bd8e6434d0 0x55bd8ea223b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:36:20.335 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:20.332+0000 7f846dc00640 1 -- 172.21.15.50:0/3127142090 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55bd8e6434d0 msgr2=0x55bd8ea223b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:36:20.335 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:20.332+0000 7f846dc00640 1 --2- 172.21.15.50:0/3127142090 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55bd8e6434d0 0x55bd8ea223b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:20.335 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:20.332+0000 7f846dc00640 1 -- 172.21.15.50:0/3127142090 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55bd8e63b2f0 msgr2=0x55bd8ea236f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:36:20.335 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:20.332+0000 7f846dc00640 1 --2- 172.21.15.50:0/3127142090 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55bd8e63b2f0 0x55bd8ea236f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:20.335 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:20.333+0000 7f846dc00640 1 -- 172.21.15.50:0/3127142090 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bd8ea22f60 con 0x55bd8e658300 2024-08-31T04:36:20.336 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:20.333+0000 7f846dc00640 1 --2- 172.21.15.50:0/3127142090 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55bd8e658300 0x55bd8ea228f0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f846002ade0 tx=0x7f846002f850 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d1633b724e1e6f9 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:36:20.336 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:20.333+0000 7f844ea00640 10 client.0 ms_handle_connect on v2:172.21.15.177:3300/0 2024-08-31T04:36:20.336 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:20.333+0000 7f844ea00640 1 -- 172.21.15.50:0/3127142090 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8460009360 con 0x55bd8e658300 2024-08-31T04:36:20.336 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:20.333+0000 7f844ea00640 1 -- 172.21.15.50:0/3127142090 <== mon.1 v2:172.21.15.177:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8219+0+0 (secure 0 0 0) 0x7f84600307d0 con 0x55bd8e658300 2024-08-31T04:36:20.336 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:20.334+0000 7f8476ca7740 1 -- 172.21.15.50:0/3127142090 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f845c0054d0 con 0x55bd8e658300 2024-08-31T04:36:20.336 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:20.334+0000 7f844ea00640 1 -- 172.21.15.50:0/3127142090 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_get_version_reply(handle=1 version=71) ==== 24+0+0 (secure 0 0 0) 0x7f8460069050 con 0x55bd8e658300 2024-08-31T04:36:20.336 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:20.334+0000 7f8476ca7740 10 client.26569 fetch_fsmap learned FSMap version 71 2024-08-31T04:36:20.336 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:20.334+0000 7f8476ca7740 1 -- 172.21.15.50:0/3127142090 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,fsmap=71,monmap=4+}) -- 0x55bd8ea21db0 con 0x55bd8e658300 2024-08-31T04:36:20.337 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:20.335+0000 7f844ea00640 1 -- 172.21.15.50:0/3127142090 <== mon.1 v2:172.21.15.177:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8460036040 con 0x55bd8e658300 2024-08-31T04:36:20.337 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:20.335+0000 7f844ea00640 1 -- 172.21.15.50:0/3127142090 <== mon.1 v2:172.21.15.177:3300/0 5 ==== fsmap(e 71) ==== 8442+0+0 (secure 0 0 0) 0x7f846004d070 con 0x55bd8e658300 2024-08-31T04:36:20.337 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:20.336+0000 7f8476ca7740 10 client.26569 fetch_fsmap finished waiting for FSMap version 71 2024-08-31T04:36:20.337 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:20.336+0000 7f8476ca7740 10 client.26569 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T04:36:20.337 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:20.336+0000 7f8476ca7740 20 client.26569 populate_metadata read hostname 'smithi050' 2024-08-31T04:36:20.337 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:20.336+0000 7f8476ca7740 1 --2- 172.21.15.50:0/3127142090 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x55bd8e6641b0 0x55bd8ea9e8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:36:20.337 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:20.336+0000 7f8476ca7740 4 client.26569 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-31T04:36:20.337 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:20.336+0000 7f8476ca7740 1 -- 172.21.15.50:0/3127142090 --> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] -- command(tid 0: {"prefix": "flush journal"}) -- 0x7f845c0054d0 con 0x55bd8e6641b0 2024-08-31T04:36:20.338 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:20.336+0000 7f846d200640 1 --2- 172.21.15.50:0/3127142090 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x55bd8e6641b0 0x55bd8ea9e8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:36:20.338 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:20.337+0000 7f844ea00640 10 client.26569 ms_handle_connect on v2:172.21.15.133:6838/2526402262 2024-08-31T04:36:20.339 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:20.338+0000 7f846d200640 1 --2- 172.21.15.50:0/3127142090 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x55bd8e6641b0 0x55bd8ea9e8a0 crc :-1 s=READY pgs=166 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d55d53486e9b97ce server_cookie=aef9ca07e6993efc in_seq=0 out_seq=0 2024-08-31T04:36:20.365 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:20.364+0000 7f844ea00640 1 -- 172.21.15.50:0/3127142090 <== mds.0 v2:172.21.15.133:6838/2526402262 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x7f845c0054d0 con 0x55bd8e6641b0 2024-08-31T04:36:20.365 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:20.364+0000 7f844ea00640 10 client.26569 handle_command_reply: tid=0 2024-08-31T04:36:20.366 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:20.364+0000 7f8476ca7740 1 client.26569 shutdown 2024-08-31T04:36:20.367 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:20.365+0000 7f8476ca7740 1 -- 172.21.15.50:0/3127142090 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55bd8e658300 msgr2=0x55bd8ea228f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:36:20.367 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:20.365+0000 7f8476ca7740 1 --2- 172.21.15.50:0/3127142090 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55bd8e658300 0x55bd8ea228f0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f846002ade0 tx=0x7f846002f850 comp rx=0 tx=0).stop 2024-08-31T04:36:20.367 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:20.365+0000 7f8476ca7740 1 -- 172.21.15.50:0/3127142090 shutdown_connections 2024-08-31T04:36:20.367 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:20.365+0000 7f8476ca7740 1 --2- 172.21.15.50:0/3127142090 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x55bd8e6641b0 0x55bd8ea9e8a0 crc :-1 s=READY pgs=166 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:20.367 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:20.365+0000 7f8476ca7740 1 --2- 172.21.15.50:0/3127142090 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55bd8e658300 0x55bd8ea228f0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:20.367 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:20.365+0000 7f8476ca7740 1 --2- 172.21.15.50:0/3127142090 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55bd8e6434d0 0x55bd8ea223b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:20.367 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:20.365+0000 7f8476ca7740 1 --2- 172.21.15.50:0/3127142090 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55bd8e63b2f0 0x55bd8ea236f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:20.368 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:20.365+0000 7f8476ca7740 1 -- 172.21.15.50:0/3127142090 >> 172.21.15.50:0/3127142090 conn(0x55bd8ea12ea0 msgr2=0x55bd8ea1a0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:36:20.368 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:20.365+0000 7f844ea00640 0 client.26569 ms_handle_reset on v2:172.21.15.133:6838/2526402262 2024-08-31T04:36:20.368 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:20.365+0000 7f8476ca7740 1 -- 172.21.15.50:0/3127142090 shutdown_connections 2024-08-31T04:36:20.369 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:20.366+0000 7f8476ca7740 1 -- 172.21.15.50:0/3127142090 wait complete. 2024-08-31T04:36:20.369 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:20.367+0000 7f8476ca7740 20 client.26569 trim_cache size 0 max 16384 2024-08-31T04:36:20.369 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout:{ 2024-08-31T04:36:20.369 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout: "message": "", 2024-08-31T04:36:20.369 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout: "return_code": 0 2024-08-31T04:36:20.369 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout:} 2024-08-31T04:36:20.369 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:20.368+0000 7f846fc00640 1 -- 172.21.15.50:0/158600566 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f84500b4c30 msgr2=0x7f84500b7140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:36:20.370 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:20.368+0000 7f846fc00640 1 --2- 172.21.15.50:0/158600566 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f84500b4c30 0x7f84500b7140 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f845c009ad0 tx=0x7f845c0046c0 comp rx=0 tx=0).stop 2024-08-31T04:36:20.370 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:20.368+0000 7f846fc00640 1 -- 172.21.15.50:0/158600566 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f84681044f0 msgr2=0x7f846819c500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:36:20.370 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:20.368+0000 7f846fc00640 1 --2- 172.21.15.50:0/158600566 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f84681044f0 0x7f846819c500 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f845400e9f0 tx=0x7f845400eeb0 comp rx=0 tx=0).stop 2024-08-31T04:36:20.371 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:20.370+0000 7f846fc00640 1 -- 172.21.15.50:0/158600566 shutdown_connections 2024-08-31T04:36:20.371 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:20.370+0000 7f846fc00640 1 --2- 172.21.15.50:0/158600566 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f84500b4c30 0x7f84500b7140 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:20.371 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:20.370+0000 7f846fc00640 1 --2- 172.21.15.50:0/158600566 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8468104e90 0x7f846819d0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:20.371 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:20.370+0000 7f846fc00640 1 --2- 172.21.15.50:0/158600566 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f84681044f0 0x7f846819c500 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:20.371 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:20.370+0000 7f846fc00640 1 --2- 172.21.15.50:0/158600566 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8468103470 0x7f846819be90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:20.371 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:20.370+0000 7f846fc00640 1 -- 172.21.15.50:0/158600566 >> 172.21.15.50:0/158600566 conn(0x7f84680fedd0 msgr2=0x7f8468075390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:36:20.372 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:20.370+0000 7f846fc00640 1 -- 172.21.15.50:0/158600566 shutdown_connections 2024-08-31T04:36:20.372 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:20.370+0000 7f846fc00640 1 -- 172.21.15.50:0/158600566 wait complete. 2024-08-31T04:36:21.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:36:21 smithi050 ceph-mon[17259]: pgmap v772: 97 pgs: 97 active+clean; 1.2 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.2 MiB/s wr, 366 op/s 2024-08-31T04:36:21.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:36:21 smithi177 ceph-mon[22025]: pgmap v772: 97 pgs: 97 active+clean; 1.2 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.2 MiB/s wr, 366 op/s 2024-08-31T04:36:21.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:36:21 smithi133 ceph-mon[22177]: pgmap v772: 97 pgs: 97 active+clean; 1.2 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.2 MiB/s wr, 366 op/s 2024-08-31T04:36:23.607 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:36:23 smithi050 ceph-mon[17259]: pgmap v773: 97 pgs: 97 active+clean; 1.2 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.5 MiB/s wr, 376 op/s 2024-08-31T04:36:23.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:36:23 smithi177 ceph-mon[22025]: pgmap v773: 97 pgs: 97 active+clean; 1.2 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.5 MiB/s wr, 376 op/s 2024-08-31T04:36:23.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:36:23 smithi133 ceph-mon[22177]: pgmap v773: 97 pgs: 97 active+clean; 1.2 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.5 MiB/s wr, 376 op/s 2024-08-31T04:36:25.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:36:25 smithi050 ceph-mon[17259]: pgmap v774: 97 pgs: 97 active+clean; 1.1 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 965 KiB/s rd, 1.0 MiB/s wr, 326 op/s 2024-08-31T04:36:25.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:36:25 smithi177 ceph-mon[22025]: pgmap v774: 97 pgs: 97 active+clean; 1.1 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 965 KiB/s rd, 1.0 MiB/s wr, 326 op/s 2024-08-31T04:36:25.792 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:36:25 smithi133 ceph-mon[22177]: pgmap v774: 97 pgs: 97 active+clean; 1.1 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 965 KiB/s rd, 1.0 MiB/s wr, 326 op/s 2024-08-31T04:36:27.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:36:27 smithi050 ceph-mon[17259]: pgmap v775: 97 pgs: 97 active+clean; 1.1 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.1 MiB/s wr, 374 op/s 2024-08-31T04:36:27.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:36:27 smithi177 ceph-mon[22025]: pgmap v775: 97 pgs: 97 active+clean; 1.1 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.1 MiB/s wr, 374 op/s 2024-08-31T04:36:27.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:36:27 smithi133 ceph-mon[22177]: pgmap v775: 97 pgs: 97 active+clean; 1.1 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.1 MiB/s wr, 374 op/s 2024-08-31T04:36:29.450 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:36:29 smithi050 ceph-mon[17259]: pgmap v776: 97 pgs: 97 active+clean; 1.1 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 330 op/s 2024-08-31T04:36:29.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:36:29 smithi177 ceph-mon[22025]: pgmap v776: 97 pgs: 97 active+clean; 1.1 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 330 op/s 2024-08-31T04:36:29.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:36:29 smithi133 ceph-mon[22177]: pgmap v776: 97 pgs: 97 active+clean; 1.1 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 330 op/s 2024-08-31T04:36:31.701 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:36:31 smithi050 ceph-mon[17259]: pgmap v777: 97 pgs: 97 active+clean; 1.1 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 356 op/s 2024-08-31T04:36:31.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:36:31 smithi177 ceph-mon[22025]: pgmap v777: 97 pgs: 97 active+clean; 1.1 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 356 op/s 2024-08-31T04:36:31.795 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:36:31 smithi133 ceph-mon[22177]: pgmap v777: 97 pgs: 97 active+clean; 1.1 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 356 op/s 2024-08-31T04:36:33.585 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:33.582+0000 7facf5e00640 1 -- 172.21.15.50:0/37515320 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7facf010b220 msgr2=0x7facf010d730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:36:33.585 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:33.582+0000 7facf5e00640 1 --2- 172.21.15.50:0/37515320 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7facf010b220 0x7facf010d730 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7face8009ca0 tx=0x7face802a8c0 comp rx=0 tx=0).stop 2024-08-31T04:36:33.585 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:33.582+0000 7facf5e00640 1 -- 172.21.15.50:0/37515320 shutdown_connections 2024-08-31T04:36:33.585 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:33.582+0000 7facf5e00640 1 --2- 172.21.15.50:0/37515320 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7facf010b220 0x7facf010d730 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:33.585 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:33.582+0000 7facf5e00640 1 --2- 172.21.15.50:0/37515320 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7facf01088c0 0x7facf010ace0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:33.585 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:33.582+0000 7facf5e00640 1 --2- 172.21.15.50:0/37515320 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7facf006b280 0x7facf0108380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:33.585 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:33.582+0000 7facf5e00640 1 -- 172.21.15.50:0/37515320 >> 172.21.15.50:0/37515320 conn(0x7facf00fdb20 msgr2=0x7facf00fffd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:36:33.585 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:33.582+0000 7facf5e00640 1 -- 172.21.15.50:0/37515320 shutdown_connections 2024-08-31T04:36:33.585 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:33.582+0000 7facf5e00640 1 -- 172.21.15.50:0/37515320 wait complete. 2024-08-31T04:36:33.588 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:33.583+0000 7facf5e00640 1 Processor -- start 2024-08-31T04:36:33.588 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:33.583+0000 7facf5e00640 1 -- start start 2024-08-31T04:36:33.588 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:33.584+0000 7facf5e00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7facf006b280 0x7facf019bcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:36:33.588 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:33.584+0000 7facf5e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7facf01088c0 0x7facf019c330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:36:33.588 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:33.584+0000 7facf5e00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7facf010b220 0x7facf019cee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:36:33.588 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:33.584+0000 7facf5e00640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7facf0111100 con 0x7facf01088c0 2024-08-31T04:36:33.588 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:33.584+0000 7facf5e00640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7facf0110f80 con 0x7facf006b280 2024-08-31T04:36:33.588 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:33.584+0000 7facf5e00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7facf0111280 con 0x7facf010b220 2024-08-31T04:36:33.588 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:33.584+0000 7facf4a00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7facf006b280 0x7facf019bcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:36:33.588 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:33.584+0000 7facf4a00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7facf006b280 0x7facf019bcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.50:49498/0 (socket says 172.21.15.50:49498) 2024-08-31T04:36:33.588 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:33.584+0000 7facf4a00640 1 -- 172.21.15.50:0/2577903963 learned_addr learned my addr 172.21.15.50:0/2577903963 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:36:33.589 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:33.584+0000 7facefe00640 1 --2- 172.21.15.50:0/2577903963 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7facf01088c0 0x7facf019c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:36:33.589 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:33.584+0000 7facf5400640 1 --2- 172.21.15.50:0/2577903963 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7facf010b220 0x7facf019cee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:36:33.589 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:33.584+0000 7facf4a00640 1 -- 172.21.15.50:0/2577903963 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7facf010b220 msgr2=0x7facf019cee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:36:33.589 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:33.584+0000 7facf4a00640 1 --2- 172.21.15.50:0/2577903963 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7facf010b220 0x7facf019cee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:33.589 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:33.584+0000 7facf4a00640 1 -- 172.21.15.50:0/2577903963 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7facf01088c0 msgr2=0x7facf019c330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:36:33.589 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:33.584+0000 7facf4a00640 1 --2- 172.21.15.50:0/2577903963 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7facf01088c0 0x7facf019c330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:33.589 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:33.584+0000 7facf4a00640 1 -- 172.21.15.50:0/2577903963 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7facf019d700 con 0x7facf006b280 2024-08-31T04:36:33.589 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:33.584+0000 7facf5400640 1 --2- 172.21.15.50:0/2577903963 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7facf010b220 0x7facf019cee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:36:33.589 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:33.585+0000 7facf4a00640 1 --2- 172.21.15.50:0/2577903963 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7facf006b280 0x7facf019bcc0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7face400e9f0 tx=0x7face400edf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:36:33.589 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:33.585+0000 7faced600640 1 -- 172.21.15.50:0/2577903963 <== mon.2 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7face400cd80 con 0x7facf006b280 2024-08-31T04:36:33.589 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:33.585+0000 7facf5e00640 1 -- 172.21.15.50:0/2577903963 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7facf019d9f0 con 0x7facf006b280 2024-08-31T04:36:33.589 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:33.585+0000 7faced600640 1 -- 172.21.15.50:0/2577903963 <== mon.2 v2:172.21.15.133:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7face40054d0 con 0x7facf006b280 2024-08-31T04:36:33.589 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:33.585+0000 7faced600640 1 -- 172.21.15.50:0/2577903963 <== mon.2 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7face4010690 con 0x7facf006b280 2024-08-31T04:36:33.590 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:33.585+0000 7facf5e00640 1 -- 172.21.15.50:0/2577903963 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7facf01a40e0 con 0x7facf006b280 2024-08-31T04:36:33.592 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:33.588+0000 7facfe46a740 1 Processor -- start 2024-08-31T04:36:33.592 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:33.589+0000 7facfe46a740 1 -- start start 2024-08-31T04:36:33.593 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:33.589+0000 7facfe46a740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a0e7c5b1b0 0x55a0e8000fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:36:33.593 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:33.589+0000 7facfe46a740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55a0e7c322f0 0x55a0e8001610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:36:33.593 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:33.589+0000 7facfe46a740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55a0e7c3a4d0 0x55a0e8002160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:36:33.593 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:33.589+0000 7facfe46a740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55a0e7f73f70 con 0x55a0e7c5b1b0 2024-08-31T04:36:33.593 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:33.589+0000 7facfe46a740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x55a0e7f63500 con 0x55a0e7c3a4d0 2024-08-31T04:36:33.593 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:33.589+0000 7facfe46a740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x55a0e7f674b0 con 0x55a0e7c322f0 2024-08-31T04:36:33.593 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:33.589+0000 7faced600640 1 -- 172.21.15.50:0/2577903963 <== mon.2 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 18) ==== 152577+0+0 (secure 0 0 0) 0x7face4004e90 con 0x7facf006b280 2024-08-31T04:36:33.593 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:33.589+0000 7facf5400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a0e7c5b1b0 0x55a0e8000fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:36:33.593 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:33.589+0000 7facf5400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a0e7c5b1b0 0x55a0e8000fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:42338/0 (socket says 172.21.15.50:42338) 2024-08-31T04:36:33.593 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:33.590+0000 7facf5400640 1 -- 172.21.15.50:0/2778621682 learned_addr learned my addr 172.21.15.50:0/2778621682 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:36:33.593 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:33.590+0000 7facefe00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55a0e7c3a4d0 0x55a0e8002160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:36:33.593 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:33.590+0000 7facf4a00640 1 --2- 172.21.15.50:0/2778621682 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55a0e7c322f0 0x55a0e8001610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:36:33.594 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:33.590+0000 7facf5400640 1 -- 172.21.15.50:0/2778621682 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55a0e7c322f0 msgr2=0x55a0e8001610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:36:33.594 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:33.590+0000 7facf5400640 1 --2- 172.21.15.50:0/2778621682 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55a0e7c322f0 0x55a0e8001610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:33.594 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:33.590+0000 7facf5400640 1 -- 172.21.15.50:0/2778621682 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55a0e7c3a4d0 msgr2=0x55a0e8002160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:36:33.594 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:33.590+0000 7facf5400640 1 --2- 172.21.15.50:0/2778621682 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55a0e7c3a4d0 0x55a0e8002160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:33.594 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:33.590+0000 7facf5400640 1 -- 172.21.15.50:0/2778621682 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a0e7f1dc10 con 0x55a0e7c5b1b0 2024-08-31T04:36:33.594 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:33.590+0000 7facf4a00640 1 --2- 172.21.15.50:0/2778621682 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55a0e7c322f0 0x55a0e8001610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T04:36:33.594 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:33.590+0000 7facf5400640 1 --2- 172.21.15.50:0/2778621682 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a0e7c5b1b0 0x55a0e8000fa0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7face8031a90 tx=0x7face8009420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a63f189a57e8126 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:36:33.595 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:33.591+0000 7face1c00640 1 -- 172.21.15.50:0/2778621682 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7face8031650 con 0x55a0e7c5b1b0 2024-08-31T04:36:33.596 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:33.591+0000 7face1c00640 1 -- 172.21.15.50:0/2778621682 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7face8036040 con 0x55a0e7c5b1b0 2024-08-31T04:36:33.596 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:33.591+0000 7face1c00640 1 -- 172.21.15.50:0/2778621682 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7face8004760 con 0x55a0e7c5b1b0 2024-08-31T04:36:33.596 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:33.591+0000 7faced600640 1 --2- 172.21.15.50:0/2577903963 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7facd80b4b30 0x7facd80b7040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:36:33.596 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:33.592+0000 7faced600640 1 -- 172.21.15.50:0/2577903963 <== mon.2 v2:172.21.15.133:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8219+0+0 (secure 0 0 0) 0x7face40e5620 con 0x7facf006b280 2024-08-31T04:36:33.596 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:33.592+0000 7facf4a00640 1 --2- 172.21.15.50:0/2577903963 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7facd80b4b30 0x7facd80b7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:36:33.596 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:33.592+0000 7facfe46a740 1 -- 172.21.15.50:0/2778621682 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a0e7c5b1b0 msgr2=0x55a0e8000fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:36:33.596 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:33.592+0000 7facfe46a740 1 --2- 172.21.15.50:0/2778621682 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a0e7c5b1b0 0x55a0e8000fa0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7face8031a90 tx=0x7face8009420 comp rx=0 tx=0).stop 2024-08-31T04:36:33.596 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:33.592+0000 7facfe46a740 1 -- 172.21.15.50:0/2778621682 shutdown_connections 2024-08-31T04:36:33.596 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:33.592+0000 7facfe46a740 1 --2- 172.21.15.50:0/2778621682 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55a0e7c322f0 0x55a0e8001610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:33.596 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:33.592+0000 7facfe46a740 1 --2- 172.21.15.50:0/2778621682 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55a0e7c3a4d0 0x55a0e8002160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:33.596 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:33.592+0000 7facfe46a740 1 --2- 172.21.15.50:0/2778621682 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a0e7c5b1b0 0x55a0e8000fa0 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:33.596 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:33.592+0000 7facfe46a740 1 -- 172.21.15.50:0/2778621682 >> 172.21.15.50:0/2778621682 conn(0x55a0e7c4f300 msgr2=0x55a0e7ffca30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:36:33.597 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:33.592+0000 7facfe46a740 1 -- 172.21.15.50:0/2778621682 shutdown_connections 2024-08-31T04:36:33.597 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:33.592+0000 7facfe46a740 1 -- 172.21.15.50:0/2778621682 wait complete. 2024-08-31T04:36:33.597 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:33.593+0000 7facf4a00640 1 --2- 172.21.15.50:0/2577903963 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7facd80b4b30 0x7facd80b7040 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7face400c6a0 tx=0x7face4004a90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:36:33.597 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:33.593+0000 7facfe46a740 1 -- start start 2024-08-31T04:36:33.597 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:33.594+0000 7facfe46a740 1 Processor -- start 2024-08-31T04:36:33.599 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:33.594+0000 7facfe46a740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55a0e7c322f0 0x55a0e800a590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:36:33.599 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:33.594+0000 7facfe46a740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55a0e7c3a4d0 0x55a0e800ac50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:36:33.599 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:33.594+0000 7facfe46a740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a0e7c5b1b0 0x55a0e800b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:36:33.599 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:33.594+0000 7facfe46a740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55a0e7e9cab0 con 0x55a0e7c5b1b0 2024-08-31T04:36:33.599 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:33.594+0000 7facfe46a740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x55a0e7f0a320 con 0x55a0e7c322f0 2024-08-31T04:36:33.599 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:33.594+0000 7facfe46a740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x55a0e8002c20 con 0x55a0e7c3a4d0 2024-08-31T04:36:33.599 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:33.594+0000 7facfe46a740 10 client.0 _ll_register_callbacks cb 0x55a0e7f106a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:36:33.600 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:33.594+0000 7facf5400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55a0e7c322f0 0x55a0e800a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:36:33.600 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:33.595+0000 7facf5400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55a0e7c322f0 0x55a0e800a590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.50:49526/0 (socket says 172.21.15.50:49526) 2024-08-31T04:36:33.600 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:33.595+0000 7facf5400640 1 -- 172.21.15.50:0/2091770652 learned_addr learned my addr 172.21.15.50:0/2091770652 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:36:33.600 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:33.595+0000 7facf5400640 1 --2- 172.21.15.50:0/2091770652 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a0e7c5b1b0 0x55a0e800b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:36:33.600 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:33.595+0000 7facefe00640 1 --2- 172.21.15.50:0/2091770652 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55a0e7c3a4d0 0x55a0e800ac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:36:33.600 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:33.595+0000 7facf5400640 1 -- 172.21.15.50:0/2091770652 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55a0e7c3a4d0 msgr2=0x55a0e800ac50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:36:33.600 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:33.595+0000 7facf5400640 1 --2- 172.21.15.50:0/2091770652 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55a0e7c3a4d0 0x55a0e800ac50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:33.600 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:33.595+0000 7facf5400640 1 -- 172.21.15.50:0/2091770652 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a0e7c5b1b0 msgr2=0x55a0e800b7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:36:33.600 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:33.595+0000 7facf5400640 1 --2- 172.21.15.50:0/2091770652 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a0e7c5b1b0 0x55a0e800b7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:33.600 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:33.595+0000 7facf5400640 1 -- 172.21.15.50:0/2091770652 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a0e7cc6790 con 0x55a0e7c322f0 2024-08-31T04:36:33.600 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:33.595+0000 7facf5400640 1 --2- 172.21.15.50:0/2091770652 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55a0e7c322f0 0x55a0e800a590 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7face802f470 tx=0x7face803e040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=14c6a327a6e8b6e1 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:36:33.600 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:33.595+0000 7facd6000640 10 client.0 ms_handle_connect on v2:172.21.15.133:3300/0 2024-08-31T04:36:33.600 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:33.596+0000 7facd6000640 1 -- 172.21.15.50:0/2091770652 <== mon.2 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7face8059060 con 0x55a0e7c322f0 2024-08-31T04:36:33.601 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:33.596+0000 7facd6000640 1 -- 172.21.15.50:0/2091770652 <== mon.2 v2:172.21.15.133:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8219+0+0 (secure 0 0 0) 0x7face8031650 con 0x55a0e7c322f0 2024-08-31T04:36:33.601 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:33.596+0000 7facfe46a740 1 -- 172.21.15.50:0/2091770652 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7face8036040 con 0x55a0e7c322f0 2024-08-31T04:36:33.601 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:33.596+0000 7facd6000640 1 -- 172.21.15.50:0/2091770652 <== mon.2 v2:172.21.15.133:3300/0 3 ==== mon_get_version_reply(handle=1 version=71) ==== 24+0+0 (secure 0 0 0) 0x7face8004b40 con 0x55a0e7c322f0 2024-08-31T04:36:33.601 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:33.596+0000 7facfe46a740 10 client.26591 fetch_fsmap learned FSMap version 71 2024-08-31T04:36:33.601 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:33.596+0000 7facfe46a740 1 -- 172.21.15.50:0/2091770652 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,fsmap=71,monmap=4+}) -- 0x55a0e7d3f620 con 0x55a0e7c322f0 2024-08-31T04:36:33.601 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:33.596+0000 7facd6000640 1 -- 172.21.15.50:0/2091770652 <== mon.2 v2:172.21.15.133:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7face8036040 con 0x55a0e7c322f0 2024-08-31T04:36:33.601 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:33.596+0000 7facd6000640 1 -- 172.21.15.50:0/2091770652 <== mon.2 v2:172.21.15.133:3300/0 5 ==== fsmap(e 71) ==== 8442+0+0 (secure 0 0 0) 0x7face802f6a0 con 0x55a0e7c322f0 2024-08-31T04:36:33.601 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:33.597+0000 7facfe46a740 10 client.26591 fetch_fsmap finished waiting for FSMap version 71 2024-08-31T04:36:33.601 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:33.597+0000 7facfe46a740 10 client.26591 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T04:36:33.601 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:33.597+0000 7facfe46a740 20 client.26591 populate_metadata read hostname 'smithi050' 2024-08-31T04:36:33.601 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:33.597+0000 7facfe46a740 1 --2- 172.21.15.50:0/2091770652 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x55a0e7c19d80 0x55a0e8017810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:36:33.601 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:33.597+0000 7facfe46a740 4 client.26591 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T04:36:33.601 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:33.597+0000 7facfe46a740 1 -- 172.21.15.50:0/2091770652 --> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a0e7f75ec0 con 0x55a0e7c19d80 2024-08-31T04:36:33.603 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:33.597+0000 7facefe00640 1 --2- 172.21.15.50:0/2091770652 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x55a0e7c19d80 0x55a0e8017810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:36:33.603 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:33.598+0000 7facefe00640 1 --2- 172.21.15.50:0/2091770652 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x55a0e7c19d80 0x55a0e8017810 crc :-1 s=READY pgs=167 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b4155448f84e7e03 server_cookie=5846c11a3945c24f in_seq=0 out_seq=0 2024-08-31T04:36:33.603 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:33.598+0000 7facd6000640 10 client.26591 ms_handle_connect on v2:172.21.15.133:6838/2526402262 2024-08-31T04:36:33.603 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:33.599+0000 7facd6000640 1 -- 172.21.15.50:0/2091770652 <== mds.0 v2:172.21.15.133:6838/2526402262 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55a0e7f75ec0 con 0x55a0e7c19d80 2024-08-31T04:36:33.603 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:33.599+0000 7facd6000640 10 client.26591 handle_command_reply: tid=0 2024-08-31T04:36:33.603 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:33.599+0000 7facfe46a740 1 client.26591 shutdown 2024-08-31T04:36:33.603 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:33.599+0000 7facfe46a740 1 -- 172.21.15.50:0/2091770652 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55a0e7c322f0 msgr2=0x55a0e800a590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:36:33.603 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:33.599+0000 7facfe46a740 1 --2- 172.21.15.50:0/2091770652 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55a0e7c322f0 0x55a0e800a590 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7face802f470 tx=0x7face803e040 comp rx=0 tx=0).stop 2024-08-31T04:36:33.603 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:33.599+0000 7facfe46a740 1 -- 172.21.15.50:0/2091770652 shutdown_connections 2024-08-31T04:36:33.603 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:33.599+0000 7facfe46a740 1 --2- 172.21.15.50:0/2091770652 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x55a0e7c19d80 0x55a0e8017810 crc :-1 s=READY pgs=167 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:33.603 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:33.599+0000 7facd6000640 0 client.26591 ms_handle_reset on v2:172.21.15.133:6838/2526402262 2024-08-31T04:36:33.604 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:33.599+0000 7facfe46a740 1 --2- 172.21.15.50:0/2091770652 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55a0e7c3a4d0 0x55a0e800ac50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:33.604 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:33.599+0000 7facfe46a740 1 --2- 172.21.15.50:0/2091770652 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a0e7c5b1b0 0x55a0e800b7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:33.604 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:33.599+0000 7facfe46a740 1 --2- 172.21.15.50:0/2091770652 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55a0e7c322f0 0x55a0e800a590 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:33.604 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:33.599+0000 7facfe46a740 1 -- 172.21.15.50:0/2091770652 >> 172.21.15.50:0/2091770652 conn(0x55a0e7c4f300 msgr2=0x55a0e7ffaf40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:36:33.604 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:33.599+0000 7facfe46a740 1 -- 172.21.15.50:0/2091770652 shutdown_connections 2024-08-31T04:36:33.604 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:33.599+0000 7facfe46a740 1 -- 172.21.15.50:0/2091770652 wait complete. 2024-08-31T04:36:33.604 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:33.600+0000 7facfe46a740 20 client.26591 trim_cache size 0 max 16384 2024-08-31T04:36:33.622 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:33.616+0000 7facfe46a740 1 Processor -- start 2024-08-31T04:36:33.623 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:33.616+0000 7facfe46a740 1 -- start start 2024-08-31T04:36:33.623 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:33.617+0000 7facfe46a740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55a0e7c19d80 0x55a0e7ffbf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:36:33.623 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:33.617+0000 7facfe46a740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a0e7c322f0 0x55a0e7ffc490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:36:33.623 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:33.617+0000 7facfe46a740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55a0e7c3a4d0 0x55a0e800b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:36:33.623 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:33.617+0000 7facfe46a740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7facf01acd00 con 0x55a0e7c322f0 2024-08-31T04:36:33.623 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:33.617+0000 7facfe46a740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7facf01aea80 con 0x55a0e7c3a4d0 2024-08-31T04:36:33.623 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:33.617+0000 7facfe46a740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7facf01ad490 con 0x55a0e7c19d80 2024-08-31T04:36:33.623 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:33.617+0000 7facf5400640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55a0e7c19d80 0x55a0e7ffbf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:36:33.623 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:33.617+0000 7facefe00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a0e7c322f0 0x55a0e7ffc490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:36:33.623 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:33.617+0000 7facf5400640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55a0e7c19d80 0x55a0e7ffbf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.50:40480/0 (socket says 172.21.15.50:40480) 2024-08-31T04:36:33.623 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:33.617+0000 7facefe00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a0e7c322f0 0x55a0e7ffc490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:42370/0 (socket says 172.21.15.50:42370) 2024-08-31T04:36:33.624 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:33.617+0000 7facf5400640 1 -- 172.21.15.50:0/2567872385 learned_addr learned my addr 172.21.15.50:0/2567872385 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:36:33.624 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:33.617+0000 7facf5400640 1 --2- 172.21.15.50:0/2567872385 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55a0e7c3a4d0 0x55a0e800b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:36:33.624 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:33.618+0000 7facf5400640 1 -- 172.21.15.50:0/2567872385 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55a0e7c3a4d0 msgr2=0x55a0e800b7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:36:33.624 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:33.618+0000 7facf5400640 1 --2- 172.21.15.50:0/2567872385 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55a0e7c3a4d0 0x55a0e800b7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:33.624 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:33.618+0000 7facf5400640 1 -- 172.21.15.50:0/2567872385 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a0e7c322f0 msgr2=0x55a0e7ffc490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:36:33.624 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:33.618+0000 7facf5400640 1 --2- 172.21.15.50:0/2567872385 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a0e7c322f0 0x55a0e7ffc490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:33.624 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:33.618+0000 7facf5400640 1 -- 172.21.15.50:0/2567872385 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a0e8001960 con 0x55a0e7c19d80 2024-08-31T04:36:33.624 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:33.618+0000 7facefe00640 1 --2- 172.21.15.50:0/2567872385 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a0e7c322f0 0x55a0e7ffc490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:36:33.624 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:33.618+0000 7facf5400640 1 --2- 172.21.15.50:0/2567872385 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55a0e7c19d80 0x55a0e7ffbf50 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7face8031b50 tx=0x7face8009420 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3c38551c3bd6f0cf server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:36:33.624 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:33.618+0000 7face1200640 1 -- 172.21.15.50:0/2567872385 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7face8059070 con 0x55a0e7c19d80 2024-08-31T04:36:33.624 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:33.618+0000 7face1200640 1 -- 172.21.15.50:0/2567872385 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7face8036040 con 0x55a0e7c19d80 2024-08-31T04:36:33.624 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:33.618+0000 7face1200640 1 -- 172.21.15.50:0/2567872385 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7face802f870 con 0x55a0e7c19d80 2024-08-31T04:36:33.624 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:33.619+0000 7facfe46a740 1 -- 172.21.15.50:0/2567872385 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55a0e7c19d80 msgr2=0x55a0e7ffbf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:36:33.625 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:33.619+0000 7facfe46a740 1 --2- 172.21.15.50:0/2567872385 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55a0e7c19d80 0x55a0e7ffbf50 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7face8031b50 tx=0x7face8009420 comp rx=0 tx=0).stop 2024-08-31T04:36:33.625 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:33.620+0000 7facfe46a740 1 -- 172.21.15.50:0/2567872385 shutdown_connections 2024-08-31T04:36:33.625 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:33.620+0000 7facfe46a740 1 --2- 172.21.15.50:0/2567872385 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55a0e7c3a4d0 0x55a0e800b7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:33.625 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:33.620+0000 7facfe46a740 1 --2- 172.21.15.50:0/2567872385 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a0e7c322f0 0x55a0e7ffc490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:33.625 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:33.620+0000 7facfe46a740 1 --2- 172.21.15.50:0/2567872385 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55a0e7c19d80 0x55a0e7ffbf50 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:33.625 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:33.620+0000 7facfe46a740 1 -- 172.21.15.50:0/2567872385 >> 172.21.15.50:0/2567872385 conn(0x55a0e7c4f300 msgr2=0x55a0e8008b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:36:33.625 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:33.620+0000 7facfe46a740 1 -- 172.21.15.50:0/2567872385 shutdown_connections 2024-08-31T04:36:33.625 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:33.620+0000 7facfe46a740 1 -- 172.21.15.50:0/2567872385 wait complete. 2024-08-31T04:36:33.625 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:33.620+0000 7facfe46a740 1 -- start start 2024-08-31T04:36:33.625 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:33.620+0000 7facfe46a740 1 Processor -- start 2024-08-31T04:36:33.627 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:33.621+0000 7facfe46a740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55a0e7c19d80 0x55a0e8011fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:36:33.628 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:33.621+0000 7facfe46a740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a0e7c322f0 0x55a0e8012690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:36:33.628 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:33.621+0000 7facfe46a740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55a0e7c3a4d0 0x55a0e8010df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:36:33.628 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:33.621+0000 7facfe46a740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7facf01ae3b0 con 0x55a0e7c322f0 2024-08-31T04:36:33.628 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:33.621+0000 7facfe46a740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7facf01adc20 con 0x55a0e7c19d80 2024-08-31T04:36:33.628 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:33.621+0000 7facfe46a740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7facf01aace0 con 0x55a0e7c3a4d0 2024-08-31T04:36:33.628 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:33.621+0000 7facfe46a740 10 client.0 _ll_register_callbacks cb 0x7face8004670 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:36:33.628 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:33.621+0000 7facf5400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55a0e7c19d80 0x55a0e8011fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:36:33.629 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:33.621+0000 7facf5400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55a0e7c19d80 0x55a0e8011fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.50:49554/0 (socket says 172.21.15.50:49554) 2024-08-31T04:36:33.629 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:33.621+0000 7facf5400640 1 -- 172.21.15.50:0/2770300024 learned_addr learned my addr 172.21.15.50:0/2770300024 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:36:33.629 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:33.621+0000 7facefe00640 1 --2- 172.21.15.50:0/2770300024 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a0e7c322f0 0x55a0e8012690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:36:33.629 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:33.621+0000 7facf5400640 1 --2- 172.21.15.50:0/2770300024 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55a0e7c3a4d0 0x55a0e8010df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:36:33.629 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:33.622+0000 7facefe00640 1 -- 172.21.15.50:0/2770300024 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55a0e7c3a4d0 msgr2=0x55a0e8010df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:36:33.629 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:33.622+0000 7facefe00640 1 --2- 172.21.15.50:0/2770300024 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55a0e7c3a4d0 0x55a0e8010df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:33.629 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:33.622+0000 7facefe00640 1 -- 172.21.15.50:0/2770300024 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55a0e7c19d80 msgr2=0x55a0e8011fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:36:33.630 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:33.622+0000 7facefe00640 1 --2- 172.21.15.50:0/2770300024 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55a0e7c19d80 0x55a0e8011fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:33.630 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:33.622+0000 7facefe00640 1 -- 172.21.15.50:0/2770300024 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a0e8011580 con 0x55a0e7c322f0 2024-08-31T04:36:33.630 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:33.622+0000 7facf5400640 1 --2- 172.21.15.50:0/2770300024 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55a0e7c19d80 0x55a0e8011fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:36:33.630 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:33.622+0000 7facefe00640 1 --2- 172.21.15.50:0/2770300024 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a0e7c322f0 0x55a0e8012690 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7facdc009fd0 tx=0x7facdc010ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53351f813c7bbbe2 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:36:33.630 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:33.622+0000 7facd6000640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-08-31T04:36:33.630 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:33.622+0000 7facd6000640 1 -- 172.21.15.50:0/2770300024 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facdc028020 con 0x55a0e7c322f0 2024-08-31T04:36:33.630 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:33.623+0000 7facd6000640 1 -- 172.21.15.50:0/2770300024 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8219+0+0 (secure 0 0 0) 0x7facdc004310 con 0x55a0e7c322f0 2024-08-31T04:36:33.630 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:33.623+0000 7facfe46a740 1 -- 172.21.15.50:0/2770300024 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7face8036040 con 0x55a0e7c322f0 2024-08-31T04:36:33.630 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:33.623+0000 7facd6000640 1 -- 172.21.15.50:0/2770300024 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=71) ==== 24+0+0 (secure 0 0 0) 0x7facdc0035f0 con 0x55a0e7c322f0 2024-08-31T04:36:33.631 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:33.623+0000 7facfe46a740 10 client.16641 fetch_fsmap learned FSMap version 71 2024-08-31T04:36:33.631 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:33.623+0000 7facfe46a740 1 -- 172.21.15.50:0/2770300024 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=71,monmap=4+}) -- 0x55a0e8010490 con 0x55a0e7c322f0 2024-08-31T04:36:33.631 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:33.623+0000 7facd6000640 1 -- 172.21.15.50:0/2770300024 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7face8036040 con 0x55a0e7c322f0 2024-08-31T04:36:33.631 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:33.623+0000 7facd6000640 1 -- 172.21.15.50:0/2770300024 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 71) ==== 8442+0+0 (secure 0 0 0) 0x7facdc023070 con 0x55a0e7c322f0 2024-08-31T04:36:33.631 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:33.624+0000 7facfe46a740 10 client.16641 fetch_fsmap finished waiting for FSMap version 71 2024-08-31T04:36:33.631 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:33.624+0000 7facfe46a740 10 client.16641 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T04:36:33.631 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:33.624+0000 7facfe46a740 20 client.16641 populate_metadata read hostname 'smithi050' 2024-08-31T04:36:33.632 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:33.624+0000 7facfe46a740 1 --2- 172.21.15.50:0/2770300024 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x55a0e7c5b1b0 0x55a0e808d110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:36:33.632 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:33.624+0000 7facfe46a740 4 client.16641 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-31T04:36:33.632 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:33.624+0000 7facfe46a740 1 -- 172.21.15.50:0/2770300024 --> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55a0e7f71960 con 0x55a0e7c5b1b0 2024-08-31T04:36:33.633 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:33.624+0000 7facf5400640 1 --2- 172.21.15.50:0/2770300024 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x55a0e7c5b1b0 0x55a0e808d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:36:33.633 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:33.624+0000 7facf5400640 1 --2- 172.21.15.50:0/2770300024 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x55a0e7c5b1b0 0x55a0e808d110 crc :-1 s=READY pgs=168 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4aa9e0a0030e216f server_cookie=9bcc145677688fdb in_seq=0 out_seq=0 2024-08-31T04:36:33.633 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:33.624+0000 7facd6000640 10 client.16641 ms_handle_connect on v2:172.21.15.133:6838/2526402262 2024-08-31T04:36:33.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:36:33 smithi050 ceph-mon[17259]: pgmap v778: 97 pgs: 97 active+clean; 1.1 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.8 MiB/s wr, 395 op/s 2024-08-31T04:36:33.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:36:33 smithi177 ceph-mon[22025]: pgmap v778: 97 pgs: 97 active+clean; 1.1 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.8 MiB/s wr, 395 op/s 2024-08-31T04:36:33.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:36:33 smithi133 ceph-mon[22177]: pgmap v778: 97 pgs: 97 active+clean; 1.1 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.8 MiB/s wr, 395 op/s 2024-08-31T04:36:33.863 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:33.861+0000 7facd6000640 1 -- 172.21.15.50:0/2770300024 <== mds.0 v2:172.21.15.133:6838/2526402262 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55a0e7f71960 con 0x55a0e7c5b1b0 2024-08-31T04:36:33.863 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:33.861+0000 7facd6000640 10 client.16641 handle_command_reply: tid=0 2024-08-31T04:36:33.864 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:33.861+0000 7facfe46a740 1 client.16641 shutdown 2024-08-31T04:36:33.864 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:33.862+0000 7facfe46a740 1 -- 172.21.15.50:0/2770300024 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a0e7c322f0 msgr2=0x55a0e8012690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:36:33.864 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:33.862+0000 7facfe46a740 1 --2- 172.21.15.50:0/2770300024 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a0e7c322f0 0x55a0e8012690 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7facdc009fd0 tx=0x7facdc010ab0 comp rx=0 tx=0).stop 2024-08-31T04:36:33.865 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:33.862+0000 7facfe46a740 1 -- 172.21.15.50:0/2770300024 shutdown_connections 2024-08-31T04:36:33.865 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:33.862+0000 7facfe46a740 1 --2- 172.21.15.50:0/2770300024 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x55a0e7c5b1b0 0x55a0e808d110 crc :-1 s=READY pgs=168 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:33.865 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:33.862+0000 7facfe46a740 1 --2- 172.21.15.50:0/2770300024 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55a0e7c3a4d0 0x55a0e8010df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:33.865 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:33.862+0000 7facfe46a740 1 --2- 172.21.15.50:0/2770300024 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a0e7c322f0 0x55a0e8012690 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:33.865 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:33.862+0000 7facfe46a740 1 --2- 172.21.15.50:0/2770300024 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55a0e7c19d80 0x55a0e8011fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:33.865 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:33.862+0000 7facfe46a740 1 -- 172.21.15.50:0/2770300024 >> 172.21.15.50:0/2770300024 conn(0x55a0e7c4f300 msgr2=0x55a0e8008ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:36:33.865 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:33.862+0000 7facd6000640 0 client.16641 ms_handle_reset on v2:172.21.15.133:6838/2526402262 2024-08-31T04:36:33.866 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:33.863+0000 7facfe46a740 1 -- 172.21.15.50:0/2770300024 shutdown_connections 2024-08-31T04:36:33.866 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:33.863+0000 7facfe46a740 1 -- 172.21.15.50:0/2770300024 wait complete. 2024-08-31T04:36:33.866 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:33.863+0000 7facfe46a740 20 client.16641 trim_cache size 0 max 16384 2024-08-31T04:36:33.866 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout:{ 2024-08-31T04:36:33.866 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout: "message": "", 2024-08-31T04:36:33.866 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout: "return_code": 0 2024-08-31T04:36:33.866 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout:} 2024-08-31T04:36:33.867 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:33.864+0000 7facf5e00640 1 -- 172.21.15.50:0/2577903963 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7facd80b4b30 msgr2=0x7facd80b7040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:36:33.867 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:33.864+0000 7facf5e00640 1 --2- 172.21.15.50:0/2577903963 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7facd80b4b30 0x7facd80b7040 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7face400c6a0 tx=0x7face4004a90 comp rx=0 tx=0).stop 2024-08-31T04:36:33.867 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:33.864+0000 7facf5e00640 1 -- 172.21.15.50:0/2577903963 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7facf006b280 msgr2=0x7facf019bcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:36:33.867 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:33.864+0000 7facf5e00640 1 --2- 172.21.15.50:0/2577903963 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7facf006b280 0x7facf019bcc0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7face400e9f0 tx=0x7face400edf0 comp rx=0 tx=0).stop 2024-08-31T04:36:33.867 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:33.864+0000 7facf5e00640 1 -- 172.21.15.50:0/2577903963 shutdown_connections 2024-08-31T04:36:33.867 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:33.864+0000 7facf5e00640 1 --2- 172.21.15.50:0/2577903963 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7facd80b4b30 0x7facd80b7040 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:33.867 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:33.864+0000 7facf5e00640 1 --2- 172.21.15.50:0/2577903963 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7facf010b220 0x7facf019cee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:33.868 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:33.864+0000 7facf5e00640 1 --2- 172.21.15.50:0/2577903963 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7facf01088c0 0x7facf019c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:33.868 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:33.864+0000 7facf5e00640 1 --2- 172.21.15.50:0/2577903963 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7facf006b280 0x7facf019bcc0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:33.868 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:33.864+0000 7facf5e00640 1 -- 172.21.15.50:0/2577903963 >> 172.21.15.50:0/2577903963 conn(0x7facf00fdb20 msgr2=0x7facf01096d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:36:33.868 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:33.864+0000 7facf5e00640 1 -- 172.21.15.50:0/2577903963 shutdown_connections 2024-08-31T04:36:33.868 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:33.865+0000 7facf5e00640 1 -- 172.21.15.50:0/2577903963 wait complete. 2024-08-31T04:36:35.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:36:35 smithi050 ceph-mon[17259]: pgmap v779: 97 pgs: 97 active+clean; 1.1 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.2 MiB/s wr, 364 op/s 2024-08-31T04:36:35.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:36:35 smithi177 ceph-mon[22025]: pgmap v779: 97 pgs: 97 active+clean; 1.1 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.2 MiB/s wr, 364 op/s 2024-08-31T04:36:35.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:36:35 smithi133 ceph-mon[22177]: pgmap v779: 97 pgs: 97 active+clean; 1.1 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.2 MiB/s wr, 364 op/s 2024-08-31T04:36:37.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:36:37 smithi050 ceph-mon[17259]: pgmap v780: 97 pgs: 97 active+clean; 1.1 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.6 MiB/s wr, 392 op/s 2024-08-31T04:36:37.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:36:37 smithi177 ceph-mon[22025]: pgmap v780: 97 pgs: 97 active+clean; 1.1 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.6 MiB/s wr, 392 op/s 2024-08-31T04:36:37.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:36:37 smithi133 ceph-mon[22177]: pgmap v780: 97 pgs: 97 active+clean; 1.1 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.6 MiB/s wr, 392 op/s 2024-08-31T04:36:39.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:36:39 smithi050 ceph-mon[17259]: pgmap v781: 97 pgs: 97 active+clean; 1.1 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.5 MiB/s wr, 319 op/s 2024-08-31T04:36:39.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:36:39 smithi177 ceph-mon[22025]: pgmap v781: 97 pgs: 97 active+clean; 1.1 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.5 MiB/s wr, 319 op/s 2024-08-31T04:36:39.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:36:39 smithi133 ceph-mon[22177]: pgmap v781: 97 pgs: 97 active+clean; 1.1 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.5 MiB/s wr, 319 op/s 2024-08-31T04:36:41.450 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:36:41 smithi050 ceph-mon[17259]: pgmap v782: 97 pgs: 97 active+clean; 1.1 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 288 op/s 2024-08-31T04:36:41.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:36:41 smithi177 ceph-mon[22025]: pgmap v782: 97 pgs: 97 active+clean; 1.1 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 288 op/s 2024-08-31T04:36:41.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:36:41 smithi133 ceph-mon[22177]: pgmap v782: 97 pgs: 97 active+clean; 1.1 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 288 op/s 2024-08-31T04:36:43.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:36:43 smithi050 ceph-mon[17259]: pgmap v783: 97 pgs: 97 active+clean; 1.1 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 258 op/s 2024-08-31T04:36:43.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:36:43 smithi177 ceph-mon[22025]: pgmap v783: 97 pgs: 97 active+clean; 1.1 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 258 op/s 2024-08-31T04:36:43.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:36:43 smithi133 ceph-mon[22177]: pgmap v783: 97 pgs: 97 active+clean; 1.1 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 258 op/s 2024-08-31T04:36:45.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:36:45 smithi050 ceph-mon[17259]: pgmap v784: 97 pgs: 97 active+clean; 1.1 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 528 KiB/s rd, 615 KiB/s wr, 211 op/s 2024-08-31T04:36:45.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:36:45 smithi177 ceph-mon[22025]: pgmap v784: 97 pgs: 97 active+clean; 1.1 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 528 KiB/s rd, 615 KiB/s wr, 211 op/s 2024-08-31T04:36:45.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:36:45 smithi133 ceph-mon[22177]: pgmap v784: 97 pgs: 97 active+clean; 1.1 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 528 KiB/s rd, 615 KiB/s wr, 211 op/s 2024-08-31T04:36:47.080 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:47.078+0000 7f93c3e00640 1 -- 172.21.15.50:0/1829690868 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f93c4075a90 msgr2=0x7f93c4075ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:36:47.080 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:47.078+0000 7f93c3e00640 1 --2- 172.21.15.50:0/1829690868 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f93c4075a90 0x7f93c4075ea0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f93b0009860 tx=0x7f93b002a340 comp rx=0 tx=0).stop 2024-08-31T04:36:47.080 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:47.078+0000 7f93c3e00640 1 -- 172.21.15.50:0/1829690868 shutdown_connections 2024-08-31T04:36:47.080 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:47.078+0000 7f93c3e00640 1 --2- 172.21.15.50:0/1829690868 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f93c4075a90 0x7f93c4075ea0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:47.080 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:47.078+0000 7f93c3e00640 1 --2- 172.21.15.50:0/1829690868 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f93c410fa00 0x7f93c4111e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:47.080 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:47.078+0000 7f93c3e00640 1 --2- 172.21.15.50:0/1829690868 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f93c4076e90 0x7f93c4075550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:47.080 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:47.078+0000 7f93c3e00640 1 -- 172.21.15.50:0/1829690868 >> 172.21.15.50:0/1829690868 conn(0x7f93c40febc0 msgr2=0x7f93c4101070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:36:47.081 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:47.078+0000 7f93c3e00640 1 -- 172.21.15.50:0/1829690868 shutdown_connections 2024-08-31T04:36:47.081 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:47.079+0000 7f93c3e00640 1 -- 172.21.15.50:0/1829690868 wait complete. 2024-08-31T04:36:47.082 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:47.079+0000 7f93c3e00640 1 Processor -- start 2024-08-31T04:36:47.082 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:47.080+0000 7f93c3e00640 1 -- start start 2024-08-31T04:36:47.082 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:47.080+0000 7f93c3e00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f93c4075a90 0x7f93c41a0130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:36:47.082 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:47.080+0000 7f93c3e00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f93c4076e90 0x7f93c41a07a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:36:47.082 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:47.080+0000 7f93c3e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f93c410fa00 0x7f93c41a1350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:36:47.082 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:47.080+0000 7f93c3e00640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f93c41154b0 con 0x7f93c410fa00 2024-08-31T04:36:47.082 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:47.080+0000 7f93c3e00640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f93c4115330 con 0x7f93c4075a90 2024-08-31T04:36:47.082 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:47.080+0000 7f93c3e00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f93c4115630 con 0x7f93c4076e90 2024-08-31T04:36:47.082 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:47.081+0000 7f93c2a00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f93c4075a90 0x7f93c41a0130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:36:47.082 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:47.081+0000 7f93c2000640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f93c4076e90 0x7f93c41a07a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:36:47.082 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:47.081+0000 7f93c2a00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f93c4075a90 0x7f93c41a0130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.50:52884/0 (socket says 172.21.15.50:52884) 2024-08-31T04:36:47.083 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:47.081+0000 7f93c2a00640 1 -- 172.21.15.50:0/2741041246 learned_addr learned my addr 172.21.15.50:0/2741041246 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:36:47.083 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:47.081+0000 7f93c3400640 1 --2- 172.21.15.50:0/2741041246 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f93c410fa00 0x7f93c41a1350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:36:47.084 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:47.081+0000 7f93c2000640 1 -- 172.21.15.50:0/2741041246 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f93c4075a90 msgr2=0x7f93c41a0130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:36:47.084 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:47.081+0000 7f93c2000640 1 --2- 172.21.15.50:0/2741041246 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f93c4075a90 0x7f93c41a0130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:47.084 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:47.081+0000 7f93c2000640 1 -- 172.21.15.50:0/2741041246 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f93c410fa00 msgr2=0x7f93c41a1350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:36:47.084 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:47.081+0000 7f93c2000640 1 --2- 172.21.15.50:0/2741041246 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f93c410fa00 0x7f93c41a1350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:47.084 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:47.081+0000 7f93c2000640 1 -- 172.21.15.50:0/2741041246 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93c41a1b70 con 0x7f93c4076e90 2024-08-31T04:36:47.084 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:47.081+0000 7f93c2000640 1 --2- 172.21.15.50:0/2741041246 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f93c4076e90 0x7f93c41a07a0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f93b0035040 tx=0x7f93b0032d20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:36:47.084 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:47.082+0000 7f93bb400640 1 -- 172.21.15.50:0/2741041246 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93b0037040 con 0x7f93c4076e90 2024-08-31T04:36:47.085 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:47.082+0000 7f93bb400640 1 -- 172.21.15.50:0/2741041246 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f93b0030c10 con 0x7f93c4076e90 2024-08-31T04:36:47.085 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:47.082+0000 7f93c3e00640 1 -- 172.21.15.50:0/2741041246 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f93c41a1e00 con 0x7f93c4076e90 2024-08-31T04:36:47.085 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:47.082+0000 7f93bb400640 1 -- 172.21.15.50:0/2741041246 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93b0003850 con 0x7f93c4076e90 2024-08-31T04:36:47.085 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:47.082+0000 7f93c3e00640 1 -- 172.21.15.50:0/2741041246 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f93c41a8370 con 0x7f93c4076e90 2024-08-31T04:36:47.088 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:47.086+0000 7f93bb400640 1 -- 172.21.15.50:0/2741041246 <== mon.1 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 18) ==== 152577+0+0 (secure 0 0 0) 0x7f93b0043020 con 0x7f93c4076e90 2024-08-31T04:36:47.088 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:47.087+0000 7f93d0cbe740 1 Processor -- start 2024-08-31T04:36:47.088 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:47.087+0000 7f93d0cbe740 1 -- start start 2024-08-31T04:36:47.089 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:47.087+0000 7f93d0cbe740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556bf90111b0 0x556bf93b6d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:36:47.089 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:47.087+0000 7f93d0cbe740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x556bf8fe82f0 0x556bf93b73b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:36:47.089 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:47.087+0000 7f93d0cbe740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x556bf8ff04d0 0x556bf93b7f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:36:47.089 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:47.087+0000 7f93d0cbe740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x556bf9329f70 con 0x556bf90111b0 2024-08-31T04:36:47.089 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:47.087+0000 7f93d0cbe740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x556bf9319500 con 0x556bf8ff04d0 2024-08-31T04:36:47.089 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:47.087+0000 7f93d0cbe740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x556bf931d4b0 con 0x556bf8fe82f0 2024-08-31T04:36:47.090 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:47.088+0000 7f93c3400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556bf90111b0 0x556bf93b6d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:36:47.090 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:47.088+0000 7f93c3400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556bf90111b0 0x556bf93b6d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53642/0 (socket says 172.21.15.50:53642) 2024-08-31T04:36:47.090 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:47.088+0000 7f93c3400640 1 -- 172.21.15.50:0/2261738023 learned_addr learned my addr 172.21.15.50:0/2261738023 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:36:47.090 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:47.088+0000 7f93c2000640 1 --2- 172.21.15.50:0/2261738023 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x556bf8ff04d0 0x556bf93b7f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:36:47.090 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:47.088+0000 7f93c2a00640 1 --2- 172.21.15.50:0/2261738023 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x556bf8fe82f0 0x556bf93b73b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:36:47.090 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:47.088+0000 7f93c3400640 1 -- 172.21.15.50:0/2261738023 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x556bf8fe82f0 msgr2=0x556bf93b73b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:36:47.090 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:47.088+0000 7f93c3400640 1 --2- 172.21.15.50:0/2261738023 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x556bf8fe82f0 0x556bf93b73b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:47.090 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:47.088+0000 7f93c3400640 1 -- 172.21.15.50:0/2261738023 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x556bf8ff04d0 msgr2=0x556bf93b7f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:36:47.090 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:47.088+0000 7f93c3400640 1 --2- 172.21.15.50:0/2261738023 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x556bf8ff04d0 0x556bf93b7f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:47.090 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:47.088+0000 7f93c3400640 1 -- 172.21.15.50:0/2261738023 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556bf92d3c10 con 0x556bf90111b0 2024-08-31T04:36:47.092 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:47.088+0000 7f93bb400640 1 --2- 172.21.15.50:0/2741041246 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f93a80b4b30 0x7f93a80b7040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:36:47.092 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:47.088+0000 7f93c3400640 1 --2- 172.21.15.50:0/2261738023 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556bf90111b0 0x556bf93b6d40 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f93bc009fd0 tx=0x7f93bc0118d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe71ab3db7825ff server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:36:47.092 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:47.089+0000 7f93bb400640 1 -- 172.21.15.50:0/2741041246 <== mon.1 v2:172.21.15.177:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8219+0+0 (secure 0 0 0) 0x7f93b0104240 con 0x7f93c4076e90 2024-08-31T04:36:47.092 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:47.089+0000 7f93afe00640 1 -- 172.21.15.50:0/2261738023 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93bc004d20 con 0x556bf90111b0 2024-08-31T04:36:47.092 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:47.089+0000 7f93c2a00640 1 --2- 172.21.15.50:0/2741041246 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f93a80b4b30 0x7f93a80b7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:36:47.092 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:47.089+0000 7f93afe00640 1 -- 172.21.15.50:0/2261738023 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f93bc004050 con 0x556bf90111b0 2024-08-31T04:36:47.092 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:47.089+0000 7f93afe00640 1 -- 172.21.15.50:0/2261738023 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93bc005240 con 0x556bf90111b0 2024-08-31T04:36:47.092 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:47.090+0000 7f93c2a00640 1 --2- 172.21.15.50:0/2741041246 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f93a80b4b30 0x7f93a80b7040 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f93b40058c0 tx=0x7f93b4009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:36:47.092 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:47.090+0000 7f93d0cbe740 1 -- 172.21.15.50:0/2261738023 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556bf90111b0 msgr2=0x556bf93b6d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:36:47.093 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:47.090+0000 7f93d0cbe740 1 --2- 172.21.15.50:0/2261738023 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556bf90111b0 0x556bf93b6d40 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f93bc009fd0 tx=0x7f93bc0118d0 comp rx=0 tx=0).stop 2024-08-31T04:36:47.093 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:47.090+0000 7f93d0cbe740 1 -- 172.21.15.50:0/2261738023 shutdown_connections 2024-08-31T04:36:47.093 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:47.090+0000 7f93d0cbe740 1 --2- 172.21.15.50:0/2261738023 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x556bf8fe82f0 0x556bf93b73b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:47.093 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:47.090+0000 7f93d0cbe740 1 --2- 172.21.15.50:0/2261738023 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x556bf8ff04d0 0x556bf93b7f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:47.093 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:47.090+0000 7f93d0cbe740 1 --2- 172.21.15.50:0/2261738023 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556bf90111b0 0x556bf93b6d40 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:47.093 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:47.090+0000 7f93d0cbe740 1 -- 172.21.15.50:0/2261738023 >> 172.21.15.50:0/2261738023 conn(0x556bf9005300 msgr2=0x556bf93b27d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:36:47.093 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:47.091+0000 7f93d0cbe740 1 -- 172.21.15.50:0/2261738023 shutdown_connections 2024-08-31T04:36:47.093 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:47.091+0000 7f93d0cbe740 1 -- 172.21.15.50:0/2261738023 wait complete. 2024-08-31T04:36:47.095 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:47.091+0000 7f93d0cbe740 1 -- start start 2024-08-31T04:36:47.095 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:47.092+0000 7f93d0cbe740 1 Processor -- start 2024-08-31T04:36:47.095 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:47.092+0000 7f93d0cbe740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x556bf8fe82f0 0x556bf93c03e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:36:47.095 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:47.092+0000 7f93d0cbe740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556bf8ff04d0 0x556bf93c0aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:36:47.095 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:47.092+0000 7f93d0cbe740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x556bf90111b0 0x556bf93c1610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:36:47.096 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:47.093+0000 7f93d0cbe740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x556bf9252ab0 con 0x556bf8ff04d0 2024-08-31T04:36:47.096 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:47.093+0000 7f93d0cbe740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x556bf92c0320 con 0x556bf90111b0 2024-08-31T04:36:47.096 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:47.093+0000 7f93d0cbe740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x556bf93b8a20 con 0x556bf8fe82f0 2024-08-31T04:36:47.096 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:47.093+0000 7f93d0cbe740 10 client.0 _ll_register_callbacks cb 0x556bf92f9e80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:36:47.096 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:47.093+0000 7f93c2a00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x556bf8fe82f0 0x556bf93c03e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:36:47.096 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:47.093+0000 7f93c2a00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x556bf8fe82f0 0x556bf93c03e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.50:56246/0 (socket says 172.21.15.50:56246) 2024-08-31T04:36:47.096 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:47.093+0000 7f93c2a00640 1 -- 172.21.15.50:0/2267829798 learned_addr learned my addr 172.21.15.50:0/2267829798 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:36:47.096 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:47.093+0000 7f93c2000640 1 --2- 172.21.15.50:0/2267829798 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556bf8ff04d0 0x556bf93c0aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:36:47.096 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:47.093+0000 7f93c3400640 1 --2- 172.21.15.50:0/2267829798 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x556bf90111b0 0x556bf93c1610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:36:47.096 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:47.093+0000 7f93c2a00640 1 -- 172.21.15.50:0/2267829798 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x556bf90111b0 msgr2=0x556bf93c1610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:36:47.096 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:47.093+0000 7f93c2a00640 1 --2- 172.21.15.50:0/2267829798 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x556bf90111b0 0x556bf93c1610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:47.096 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:47.093+0000 7f93c2a00640 1 -- 172.21.15.50:0/2267829798 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556bf8ff04d0 msgr2=0x556bf93c0aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:36:47.097 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:47.093+0000 7f93c2a00640 1 --2- 172.21.15.50:0/2267829798 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556bf8ff04d0 0x556bf93c0aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:47.097 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:47.093+0000 7f93c2a00640 1 -- 172.21.15.50:0/2267829798 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556bf907c790 con 0x556bf8fe82f0 2024-08-31T04:36:47.097 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:47.094+0000 7f93c2a00640 1 --2- 172.21.15.50:0/2267829798 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x556bf8fe82f0 0x556bf93c03e0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f93b4005ab0 tx=0x7f93b4004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=de7434df44a91bc7 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:36:47.097 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:47.094+0000 7f93acc00640 10 client.0 ms_handle_connect on v2:172.21.15.177:3300/0 2024-08-31T04:36:47.097 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:47.094+0000 7f93acc00640 1 -- 172.21.15.50:0/2267829798 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93b402d060 con 0x556bf8fe82f0 2024-08-31T04:36:47.097 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:47.094+0000 7f93acc00640 1 -- 172.21.15.50:0/2267829798 <== mon.1 v2:172.21.15.177:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8219+0+0 (secure 0 0 0) 0x7f93b4018030 con 0x556bf8fe82f0 2024-08-31T04:36:47.097 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:47.094+0000 7f93d0cbe740 1 -- 172.21.15.50:0/2267829798 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f93bc004050 con 0x556bf8fe82f0 2024-08-31T04:36:47.099 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:47.094+0000 7f93acc00640 1 -- 172.21.15.50:0/2267829798 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_get_version_reply(handle=1 version=71) ==== 24+0+0 (secure 0 0 0) 0x7f93b4028420 con 0x556bf8fe82f0 2024-08-31T04:36:47.099 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:47.094+0000 7f93d0cbe740 10 client.26596 fetch_fsmap learned FSMap version 71 2024-08-31T04:36:47.099 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:47.094+0000 7f93d0cbe740 1 -- 172.21.15.50:0/2267829798 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,fsmap=71,monmap=4+}) -- 0x556bf90f5620 con 0x556bf8fe82f0 2024-08-31T04:36:47.099 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:47.095+0000 7f93acc00640 1 -- 172.21.15.50:0/2267829798 <== mon.1 v2:172.21.15.177:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f93bc004050 con 0x556bf8fe82f0 2024-08-31T04:36:47.099 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:47.095+0000 7f93acc00640 1 -- 172.21.15.50:0/2267829798 <== mon.1 v2:172.21.15.177:3300/0 5 ==== fsmap(e 71) ==== 8442+0+0 (secure 0 0 0) 0x7f93b400f470 con 0x556bf8fe82f0 2024-08-31T04:36:47.099 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:47.095+0000 7f93d0cbe740 10 client.26596 fetch_fsmap finished waiting for FSMap version 71 2024-08-31T04:36:47.099 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:47.095+0000 7f93d0cbe740 10 client.26596 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T04:36:47.100 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:47.095+0000 7f93d0cbe740 20 client.26596 populate_metadata read hostname 'smithi050' 2024-08-31T04:36:47.100 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:47.095+0000 7f93d0cbe740 1 --2- 172.21.15.50:0/2267829798 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x556bf8fcfd80 0x556bf93cdc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:36:47.100 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:47.095+0000 7f93d0cbe740 4 client.26596 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T04:36:47.100 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:47.095+0000 7f93d0cbe740 1 -- 172.21.15.50:0/2267829798 --> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556bf932bec0 con 0x556bf8fcfd80 2024-08-31T04:36:47.100 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:47.095+0000 7f93c2000640 1 --2- 172.21.15.50:0/2267829798 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x556bf8fcfd80 0x556bf93cdc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:36:47.100 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:47.096+0000 7f93acc00640 10 client.26596 ms_handle_connect on v2:172.21.15.133:6838/2526402262 2024-08-31T04:36:47.100 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:47.096+0000 7f93c2000640 1 --2- 172.21.15.50:0/2267829798 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x556bf8fcfd80 0x556bf93cdc70 crc :-1 s=READY pgs=169 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ba8c86e755aa41f6 server_cookie=afb857b0a02b6bf4 in_seq=0 out_seq=0 2024-08-31T04:36:47.100 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:47.097+0000 7f93acc00640 1 -- 172.21.15.50:0/2267829798 <== mds.0 v2:172.21.15.133:6838/2526402262 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x556bf932bec0 con 0x556bf8fcfd80 2024-08-31T04:36:47.100 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:47.097+0000 7f93acc00640 10 client.26596 handle_command_reply: tid=0 2024-08-31T04:36:47.100 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:47.097+0000 7f93d0cbe740 1 client.26596 shutdown 2024-08-31T04:36:47.100 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:47.097+0000 7f93d0cbe740 1 -- 172.21.15.50:0/2267829798 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x556bf8fe82f0 msgr2=0x556bf93c03e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:36:47.100 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:47.097+0000 7f93d0cbe740 1 --2- 172.21.15.50:0/2267829798 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x556bf8fe82f0 0x556bf93c03e0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f93b4005ab0 tx=0x7f93b4004730 comp rx=0 tx=0).stop 2024-08-31T04:36:47.101 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:47.097+0000 7f93d0cbe740 1 -- 172.21.15.50:0/2267829798 shutdown_connections 2024-08-31T04:36:47.101 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:47.097+0000 7f93d0cbe740 1 --2- 172.21.15.50:0/2267829798 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x556bf8fcfd80 0x556bf93cdc70 crc :-1 s=READY pgs=169 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:47.101 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:47.097+0000 7f93d0cbe740 1 --2- 172.21.15.50:0/2267829798 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x556bf90111b0 0x556bf93c1610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:47.101 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:47.097+0000 7f93d0cbe740 1 --2- 172.21.15.50:0/2267829798 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556bf8ff04d0 0x556bf93c0aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:47.101 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:47.097+0000 7f93d0cbe740 1 --2- 172.21.15.50:0/2267829798 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x556bf8fe82f0 0x556bf93c03e0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:47.101 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:47.097+0000 7f93acc00640 0 client.26596 ms_handle_reset on v2:172.21.15.133:6838/2526402262 2024-08-31T04:36:47.101 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:47.097+0000 7f93d0cbe740 1 -- 172.21.15.50:0/2267829798 >> 172.21.15.50:0/2267829798 conn(0x556bf9005300 msgr2=0x556bf93b0d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:36:47.101 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:47.097+0000 7f93d0cbe740 1 -- 172.21.15.50:0/2267829798 shutdown_connections 2024-08-31T04:36:47.101 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:47.097+0000 7f93d0cbe740 1 -- 172.21.15.50:0/2267829798 wait complete. 2024-08-31T04:36:47.101 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:47.097+0000 7f93d0cbe740 20 client.26596 trim_cache size 0 max 16384 2024-08-31T04:36:47.118 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:47.113+0000 7f93d0cbe740 1 Processor -- start 2024-08-31T04:36:47.119 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:47.114+0000 7f93d0cbe740 1 -- start start 2024-08-31T04:36:47.119 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:47.114+0000 7f93d0cbe740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x556bf8fe82f0 0x556bf93be8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:36:47.119 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:47.114+0000 7f93d0cbe740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x556bf8ff04d0 0x556bf93bee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:36:47.119 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:47.114+0000 7f93d0cbe740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556bf90111b0 0x556bf93bae50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:36:47.119 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:47.114+0000 7f93d0cbe740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f93c41b1140 con 0x556bf90111b0 2024-08-31T04:36:47.119 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:47.114+0000 7f93d0cbe740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f93c41b2ec0 con 0x556bf8fe82f0 2024-08-31T04:36:47.119 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:47.114+0000 7f93d0cbe740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f93c41b18d0 con 0x556bf8ff04d0 2024-08-31T04:36:47.119 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:47.114+0000 7f93c2a00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x556bf8fe82f0 0x556bf93be8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:36:47.119 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:47.114+0000 7f93c3400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556bf90111b0 0x556bf93bae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:36:47.119 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:47.114+0000 7f93c3400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556bf90111b0 0x556bf93bae50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53654/0 (socket says 172.21.15.50:53654) 2024-08-31T04:36:47.119 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:47.114+0000 7f93c3400640 1 -- 172.21.15.50:0/1910462833 learned_addr learned my addr 172.21.15.50:0/1910462833 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:36:47.119 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:47.114+0000 7f93c2a00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x556bf8fe82f0 0x556bf93be8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.50:52908/0 (socket says 172.21.15.50:52908) 2024-08-31T04:36:47.120 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:47.114+0000 7f93c2000640 1 --2- 172.21.15.50:0/1910462833 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x556bf8ff04d0 0x556bf93bee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:36:47.120 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:47.115+0000 7f93c2a00640 1 -- 172.21.15.50:0/1910462833 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x556bf8ff04d0 msgr2=0x556bf93bee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:36:47.120 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:47.115+0000 7f93c2a00640 1 --2- 172.21.15.50:0/1910462833 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x556bf8ff04d0 0x556bf93bee30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:47.120 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:47.115+0000 7f93c2a00640 1 -- 172.21.15.50:0/1910462833 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556bf90111b0 msgr2=0x556bf93bae50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:36:47.120 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:47.115+0000 7f93c2a00640 1 --2- 172.21.15.50:0/1910462833 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556bf90111b0 0x556bf93bae50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:47.120 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:47.115+0000 7f93c2a00640 1 -- 172.21.15.50:0/1910462833 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556bf93bf370 con 0x556bf8fe82f0 2024-08-31T04:36:47.120 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:47.115+0000 7f93c2a00640 1 --2- 172.21.15.50:0/1910462833 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x556bf8fe82f0 0x556bf93be8f0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f93b400f890 tx=0x7f93b4012d30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6be43cbefb110320 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:36:47.120 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:47.115+0000 7f93af400640 1 -- 172.21.15.50:0/1910462833 <== mon.2 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93b4038030 con 0x556bf8fe82f0 2024-08-31T04:36:47.120 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:47.115+0000 7f93af400640 1 -- 172.21.15.50:0/1910462833 <== mon.2 v2:172.21.15.133:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f93b403a070 con 0x556bf8fe82f0 2024-08-31T04:36:47.120 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:47.115+0000 7f93af400640 1 -- 172.21.15.50:0/1910462833 <== mon.2 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93b40035f0 con 0x556bf8fe82f0 2024-08-31T04:36:47.120 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:47.117+0000 7f93d0cbe740 1 -- 172.21.15.50:0/1910462833 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x556bf8fe82f0 msgr2=0x556bf93be8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:36:47.121 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:47.117+0000 7f93d0cbe740 1 --2- 172.21.15.50:0/1910462833 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x556bf8fe82f0 0x556bf93be8f0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f93b400f890 tx=0x7f93b4012d30 comp rx=0 tx=0).stop 2024-08-31T04:36:47.121 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:47.117+0000 7f93d0cbe740 1 -- 172.21.15.50:0/1910462833 shutdown_connections 2024-08-31T04:36:47.121 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:47.117+0000 7f93d0cbe740 1 --2- 172.21.15.50:0/1910462833 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x556bf8ff04d0 0x556bf93bee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:47.121 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:47.117+0000 7f93d0cbe740 1 --2- 172.21.15.50:0/1910462833 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556bf90111b0 0x556bf93bae50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:47.121 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:47.117+0000 7f93d0cbe740 1 --2- 172.21.15.50:0/1910462833 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x556bf8fe82f0 0x556bf93be8f0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:47.121 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:47.117+0000 7f93d0cbe740 1 -- 172.21.15.50:0/1910462833 >> 172.21.15.50:0/1910462833 conn(0x556bf9005300 msgr2=0x556bf93bf600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:36:47.121 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:47.117+0000 7f93d0cbe740 1 -- 172.21.15.50:0/1910462833 shutdown_connections 2024-08-31T04:36:47.121 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:47.117+0000 7f93d0cbe740 1 -- 172.21.15.50:0/1910462833 wait complete. 2024-08-31T04:36:47.121 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:47.117+0000 7f93d0cbe740 1 -- start start 2024-08-31T04:36:47.124 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:47.118+0000 7f93d0cbe740 1 Processor -- start 2024-08-31T04:36:47.124 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:47.118+0000 7f93d0cbe740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x556bf8fe82f0 0x556bf93c72c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:36:47.124 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:47.118+0000 7f93d0cbe740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556bf8ff04d0 0x556bf93c7800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:36:47.124 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:47.118+0000 7f93d0cbe740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x556bf90111b0 0x556bf93c7d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:36:47.124 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:47.118+0000 7f93d0cbe740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f93c41b27f0 con 0x556bf8ff04d0 2024-08-31T04:36:47.124 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:47.118+0000 7f93d0cbe740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f93c41b2060 con 0x556bf8fe82f0 2024-08-31T04:36:47.124 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:47.118+0000 7f93d0cbe740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f93c41af120 con 0x556bf90111b0 2024-08-31T04:36:47.124 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:47.119+0000 7f93d0cbe740 10 client.0 _ll_register_callbacks cb 0x7f93b4005a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:36:47.124 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:47.119+0000 7f93c2a00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x556bf8fe82f0 0x556bf93c72c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:36:47.125 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:47.119+0000 7f93c2a00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x556bf8fe82f0 0x556bf93c72c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.50:52922/0 (socket says 172.21.15.50:52922) 2024-08-31T04:36:47.125 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:47.119+0000 7f93c2000640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556bf8ff04d0 0x556bf93c7800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:36:47.125 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:47.119+0000 7f93c2a00640 1 -- 172.21.15.50:0/552536974 learned_addr learned my addr 172.21.15.50:0/552536974 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:36:47.125 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:47.119+0000 7f93c3400640 1 --2- 172.21.15.50:0/552536974 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x556bf90111b0 0x556bf93c7d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:36:47.125 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:47.119+0000 7f93c2a00640 1 -- 172.21.15.50:0/552536974 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x556bf90111b0 msgr2=0x556bf93c7d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:36:47.125 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:47.119+0000 7f93c2a00640 1 --2- 172.21.15.50:0/552536974 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x556bf90111b0 0x556bf93c7d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:47.125 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:47.119+0000 7f93c2a00640 1 -- 172.21.15.50:0/552536974 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556bf8ff04d0 msgr2=0x556bf93c7800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:36:47.125 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:47.119+0000 7f93c2a00640 1 --2- 172.21.15.50:0/552536974 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556bf8ff04d0 0x556bf93c7800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:47.125 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:47.119+0000 7f93c2a00640 1 -- 172.21.15.50:0/552536974 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556bf93c5f50 con 0x556bf8fe82f0 2024-08-31T04:36:47.125 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:47.119+0000 7f93c2000640 1 --2- 172.21.15.50:0/552536974 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556bf8ff04d0 0x556bf93c7800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:36:47.125 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:47.119+0000 7f93c3400640 1 --2- 172.21.15.50:0/552536974 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x556bf90111b0 0x556bf93c7d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:36:47.125 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:47.120+0000 7f93c2a00640 1 --2- 172.21.15.50:0/552536974 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x556bf8fe82f0 0x556bf93c72c0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f93b4012cb0 tx=0x7f93b401d830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b5ecfd0adc008dfb server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:36:47.125 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:47.120+0000 7f93acc00640 10 client.0 ms_handle_connect on v2:172.21.15.133:3300/0 2024-08-31T04:36:47.126 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:47.120+0000 7f93acc00640 1 -- 172.21.15.50:0/552536974 <== mon.2 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93b4038030 con 0x556bf8fe82f0 2024-08-31T04:36:47.126 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:47.120+0000 7f93d0cbe740 1 -- 172.21.15.50:0/552536974 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f93b403a070 con 0x556bf8fe82f0 2024-08-31T04:36:47.126 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:47.120+0000 7f93acc00640 1 -- 172.21.15.50:0/552536974 <== mon.2 v2:172.21.15.133:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8219+0+0 (secure 0 0 0) 0x7f93b4023040 con 0x556bf8fe82f0 2024-08-31T04:36:47.126 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:47.120+0000 7f93acc00640 1 -- 172.21.15.50:0/552536974 <== mon.2 v2:172.21.15.133:3300/0 3 ==== mon_get_version_reply(handle=1 version=71) ==== 24+0+0 (secure 0 0 0) 0x7f93b402d050 con 0x556bf8fe82f0 2024-08-31T04:36:47.126 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:47.120+0000 7f93d0cbe740 10 client.26615 fetch_fsmap learned FSMap version 71 2024-08-31T04:36:47.126 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:47.120+0000 7f93d0cbe740 1 -- 172.21.15.50:0/552536974 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,fsmap=71,monmap=4+}) -- 0x556bf9438980 con 0x556bf8fe82f0 2024-08-31T04:36:47.126 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:47.121+0000 7f93acc00640 1 -- 172.21.15.50:0/552536974 <== mon.2 v2:172.21.15.133:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f93b403a070 con 0x556bf8fe82f0 2024-08-31T04:36:47.126 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:47.121+0000 7f93acc00640 1 -- 172.21.15.50:0/552536974 <== mon.2 v2:172.21.15.133:3300/0 5 ==== fsmap(e 71) ==== 8442+0+0 (secure 0 0 0) 0x7f93b40285c0 con 0x556bf8fe82f0 2024-08-31T04:36:47.126 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:47.121+0000 7f93d0cbe740 10 client.26615 fetch_fsmap finished waiting for FSMap version 71 2024-08-31T04:36:47.126 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:47.121+0000 7f93d0cbe740 10 client.26615 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T04:36:47.126 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:47.121+0000 7f93d0cbe740 20 client.26615 populate_metadata read hostname 'smithi050' 2024-08-31T04:36:47.126 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:47.121+0000 7f93d0cbe740 1 --2- 172.21.15.50:0/552536974 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x556bf8fa51c0 0x556bf943b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:36:47.126 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:47.121+0000 7f93d0cbe740 4 client.26615 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-31T04:36:47.127 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:47.121+0000 7f93d0cbe740 1 -- 172.21.15.50:0/552536974 --> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] -- command(tid 0: {"prefix": "flush journal"}) -- 0x556bf9327960 con 0x556bf8fa51c0 2024-08-31T04:36:47.127 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:47.121+0000 7f93c2000640 1 --2- 172.21.15.50:0/552536974 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x556bf8fa51c0 0x556bf943b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:36:47.127 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:47.122+0000 7f93c2000640 1 --2- 172.21.15.50:0/552536974 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x556bf8fa51c0 0x556bf943b3b0 crc :-1 s=READY pgs=170 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a6d3aa0109305f9a server_cookie=b4fd869a8d2cbf00 in_seq=0 out_seq=0 2024-08-31T04:36:47.127 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:47.122+0000 7f93acc00640 10 client.26615 ms_handle_connect on v2:172.21.15.133:6838/2526402262 2024-08-31T04:36:47.140 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:47.138+0000 7f93acc00640 1 -- 172.21.15.50:0/552536974 <== mds.0 v2:172.21.15.133:6838/2526402262 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x556bf9327960 con 0x556bf8fa51c0 2024-08-31T04:36:47.140 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:47.138+0000 7f93acc00640 10 client.26615 handle_command_reply: tid=0 2024-08-31T04:36:47.140 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:47.138+0000 7f93d0cbe740 1 client.26615 shutdown 2024-08-31T04:36:47.140 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:47.138+0000 7f93d0cbe740 1 -- 172.21.15.50:0/552536974 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x556bf8fe82f0 msgr2=0x556bf93c72c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:36:47.140 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:47.138+0000 7f93d0cbe740 1 --2- 172.21.15.50:0/552536974 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x556bf8fe82f0 0x556bf93c72c0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f93b4012cb0 tx=0x7f93b401d830 comp rx=0 tx=0).stop 2024-08-31T04:36:47.140 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:47.138+0000 7f93d0cbe740 1 -- 172.21.15.50:0/552536974 shutdown_connections 2024-08-31T04:36:47.141 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:47.139+0000 7f93d0cbe740 1 --2- 172.21.15.50:0/552536974 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x556bf8fa51c0 0x556bf943b3b0 crc :-1 s=READY pgs=170 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:47.141 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:47.139+0000 7f93d0cbe740 1 --2- 172.21.15.50:0/552536974 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x556bf90111b0 0x556bf93c7d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:47.141 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:47.139+0000 7f93d0cbe740 1 --2- 172.21.15.50:0/552536974 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556bf8ff04d0 0x556bf93c7800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:47.141 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:47.139+0000 7f93d0cbe740 1 --2- 172.21.15.50:0/552536974 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x556bf8fe82f0 0x556bf93c72c0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:47.141 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:47.139+0000 7f93acc00640 0 client.26615 ms_handle_reset on v2:172.21.15.133:6838/2526402262 2024-08-31T04:36:47.141 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:47.139+0000 7f93d0cbe740 1 -- 172.21.15.50:0/552536974 >> 172.21.15.50:0/552536974 conn(0x556bf9005300 msgr2=0x556bf93be880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:36:47.141 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:47.139+0000 7f93d0cbe740 1 -- 172.21.15.50:0/552536974 shutdown_connections 2024-08-31T04:36:47.142 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:47.139+0000 7f93d0cbe740 1 -- 172.21.15.50:0/552536974 wait complete. 2024-08-31T04:36:47.142 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:47.139+0000 7f93d0cbe740 20 client.26615 trim_cache size 0 max 16384 2024-08-31T04:36:47.142 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout:{ 2024-08-31T04:36:47.142 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout: "message": "", 2024-08-31T04:36:47.142 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout: "return_code": 0 2024-08-31T04:36:47.142 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout:} 2024-08-31T04:36:47.143 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:47.140+0000 7f93c3e00640 1 -- 172.21.15.50:0/2741041246 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f93a80b4b30 msgr2=0x7f93a80b7040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:36:47.143 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:47.140+0000 7f93c3e00640 1 --2- 172.21.15.50:0/2741041246 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f93a80b4b30 0x7f93a80b7040 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f93b40058c0 tx=0x7f93b4009260 comp rx=0 tx=0).stop 2024-08-31T04:36:47.143 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:47.140+0000 7f93c3e00640 1 -- 172.21.15.50:0/2741041246 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f93c4076e90 msgr2=0x7f93c41a07a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:36:47.143 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:47.140+0000 7f93c3e00640 1 --2- 172.21.15.50:0/2741041246 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f93c4076e90 0x7f93c41a07a0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f93b0035040 tx=0x7f93b0032d20 comp rx=0 tx=0).stop 2024-08-31T04:36:47.143 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:47.140+0000 7f93c3e00640 1 -- 172.21.15.50:0/2741041246 shutdown_connections 2024-08-31T04:36:47.143 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:47.140+0000 7f93c3e00640 1 --2- 172.21.15.50:0/2741041246 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f93a80b4b30 0x7f93a80b7040 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:47.143 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:47.140+0000 7f93c3e00640 1 --2- 172.21.15.50:0/2741041246 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f93c4076e90 0x7f93c41a07a0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:47.143 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:47.140+0000 7f93c3e00640 1 --2- 172.21.15.50:0/2741041246 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f93c410fa00 0x7f93c41a1350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:47.144 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:47.140+0000 7f93c3e00640 1 --2- 172.21.15.50:0/2741041246 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f93c4075a90 0x7f93c41a0130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:36:47.144 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:47.140+0000 7f93c3e00640 1 -- 172.21.15.50:0/2741041246 >> 172.21.15.50:0/2741041246 conn(0x7f93c40febc0 msgr2=0x7f93c40ff230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:36:47.144 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:47.140+0000 7f93c3e00640 1 -- 172.21.15.50:0/2741041246 shutdown_connections 2024-08-31T04:36:47.144 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:36:47.140+0000 7f93c3e00640 1 -- 172.21.15.50:0/2741041246 wait complete. 2024-08-31T04:36:47.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:36:47 smithi050 ceph-mon[17259]: pgmap v785: 97 pgs: 97 active+clean; 1.1 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 264 op/s 2024-08-31T04:36:47.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:36:47 smithi177 ceph-mon[22025]: pgmap v785: 97 pgs: 97 active+clean; 1.1 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 264 op/s 2024-08-31T04:36:47.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:36:47 smithi133 ceph-mon[22177]: pgmap v785: 97 pgs: 97 active+clean; 1.1 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 264 op/s 2024-08-31T04:36:49.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:36:49 smithi050 ceph-mon[17259]: pgmap v786: 97 pgs: 97 active+clean; 1.0 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 867 KiB/s rd, 995 KiB/s wr, 223 op/s 2024-08-31T04:36:49.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:36:49 smithi177 ceph-mon[22025]: pgmap v786: 97 pgs: 97 active+clean; 1.0 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 867 KiB/s rd, 995 KiB/s wr, 223 op/s 2024-08-31T04:36:49.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:36:49 smithi133 ceph-mon[22177]: pgmap v786: 97 pgs: 97 active+clean; 1.0 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 867 KiB/s rd, 995 KiB/s wr, 223 op/s 2024-08-31T04:36:51.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:36:51 smithi050 ceph-mon[17259]: pgmap v787: 97 pgs: 97 active+clean; 1.0 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 963 KiB/s rd, 1.3 MiB/s wr, 261 op/s 2024-08-31T04:36:51.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:36:51 smithi177 ceph-mon[22025]: pgmap v787: 97 pgs: 97 active+clean; 1.0 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 963 KiB/s rd, 1.3 MiB/s wr, 261 op/s 2024-08-31T04:36:51.792 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:36:51 smithi133 ceph-mon[22177]: pgmap v787: 97 pgs: 97 active+clean; 1.0 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 963 KiB/s rd, 1.3 MiB/s wr, 261 op/s 2024-08-31T04:36:53.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:36:53 smithi050 ceph-mon[17259]: pgmap v788: 97 pgs: 97 active+clean; 1.0 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.2 MiB/s wr, 333 op/s 2024-08-31T04:36:53.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:36:53 smithi177 ceph-mon[22025]: pgmap v788: 97 pgs: 97 active+clean; 1.0 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.2 MiB/s wr, 333 op/s 2024-08-31T04:36:53.792 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:36:53 smithi133 ceph-mon[22177]: pgmap v788: 97 pgs: 97 active+clean; 1.0 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.2 MiB/s wr, 333 op/s 2024-08-31T04:36:55.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:36:55 smithi050 ceph-mon[17259]: pgmap v789: 97 pgs: 97 active+clean; 1.0 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 355 op/s 2024-08-31T04:36:55.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:36:55 smithi177 ceph-mon[22025]: pgmap v789: 97 pgs: 97 active+clean; 1.0 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 355 op/s 2024-08-31T04:36:55.792 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:36:55 smithi133 ceph-mon[22177]: pgmap v789: 97 pgs: 97 active+clean; 1.0 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 355 op/s 2024-08-31T04:36:57.626 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:36:57 smithi050 ceph-mon[17259]: pgmap v790: 97 pgs: 97 active+clean; 1024 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.7 MiB/s wr, 402 op/s 2024-08-31T04:36:57.626 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:36:57 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T04:36:57.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:36:57 smithi177 ceph-mon[22025]: pgmap v790: 97 pgs: 97 active+clean; 1024 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.7 MiB/s wr, 402 op/s 2024-08-31T04:36:57.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:36:57 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T04:36:57.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:36:57 smithi133 ceph-mon[22177]: pgmap v790: 97 pgs: 97 active+clean; 1024 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.7 MiB/s wr, 402 op/s 2024-08-31T04:36:57.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:36:57 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T04:36:58.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:36:58 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:36:58.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:36:58 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T04:36:58.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:36:58 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:36:58.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:36:58 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:36:58.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:36:58 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T04:36:58.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:36:58 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:36:58.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:36:58 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:36:58.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:36:58 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T04:36:58.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:36:58 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:36:59.646 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:36:59 smithi050 ceph-mon[17259]: pgmap v791: 97 pgs: 97 active+clean; 1015 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 352 op/s 2024-08-31T04:36:59.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:36:59 smithi177 ceph-mon[22025]: pgmap v791: 97 pgs: 97 active+clean; 1015 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 352 op/s 2024-08-31T04:36:59.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:36:59 smithi133 ceph-mon[22177]: pgmap v791: 97 pgs: 97 active+clean; 1015 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 352 op/s 2024-08-31T04:37:00.339 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:00.337+0000 7f9684c00640 1 -- 172.21.15.50:0/161959603 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9680106510 msgr2=0x7f9680106920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:37:00.340 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:00.337+0000 7f9684c00640 1 --2- 172.21.15.50:0/161959603 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9680106510 0x7f9680106920 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f9668009860 tx=0x7f966802a340 comp rx=0 tx=0).stop 2024-08-31T04:37:00.340 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:00.337+0000 7f9684c00640 1 -- 172.21.15.50:0/161959603 shutdown_connections 2024-08-31T04:37:00.340 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:00.337+0000 7f9684c00640 1 --2- 172.21.15.50:0/161959603 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9680106eb0 0x7f968010d850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:00.340 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:00.337+0000 7f9684c00640 1 --2- 172.21.15.50:0/161959603 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9680106510 0x7f9680106920 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:00.340 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:00.337+0000 7f9684c00640 1 --2- 172.21.15.50:0/161959603 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9680105490 0x7f9680105900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:00.340 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:00.337+0000 7f9684c00640 1 -- 172.21.15.50:0/161959603 >> 172.21.15.50:0/161959603 conn(0x7f9680100df0 msgr2=0x7f9680103280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:37:00.340 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:00.338+0000 7f9684c00640 1 -- 172.21.15.50:0/161959603 shutdown_connections 2024-08-31T04:37:00.340 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:00.338+0000 7f9684c00640 1 -- 172.21.15.50:0/161959603 wait complete. 2024-08-31T04:37:00.342 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:00.339+0000 7f9684c00640 1 Processor -- start 2024-08-31T04:37:00.343 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:00.339+0000 7f9684c00640 1 -- start start 2024-08-31T04:37:00.343 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:00.339+0000 7f9684c00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9680105490 0x7f968019bd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:37:00.343 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:00.339+0000 7f9684c00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9680106510 0x7f968019c390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:37:00.343 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:00.339+0000 7f9684c00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9680106eb0 0x7f968019cf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:37:00.343 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:00.339+0000 7f9684c00640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f9680111110 con 0x7f9680105490 2024-08-31T04:37:00.343 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:00.339+0000 7f9684c00640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f9680110f90 con 0x7f9680106510 2024-08-31T04:37:00.343 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:00.339+0000 7f9684c00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f9680111290 con 0x7f9680106eb0 2024-08-31T04:37:00.343 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:00.339+0000 7f967f400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9680105490 0x7f968019bd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:37:00.343 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:00.339+0000 7f967f400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9680105490 0x7f968019bd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49496/0 (socket says 172.21.15.50:49496) 2024-08-31T04:37:00.343 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:00.339+0000 7f967f400640 1 -- 172.21.15.50:0/969248389 learned_addr learned my addr 172.21.15.50:0/969248389 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:37:00.344 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:00.339+0000 7f9676a00640 1 --2- 172.21.15.50:0/969248389 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9680106510 0x7f968019c390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:37:00.344 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:00.339+0000 7f967fe00640 1 --2- 172.21.15.50:0/969248389 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9680106eb0 0x7f968019cf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:37:00.344 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:00.340+0000 7f9676a00640 1 -- 172.21.15.50:0/969248389 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9680106eb0 msgr2=0x7f968019cf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:37:00.344 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:00.340+0000 7f9676a00640 1 --2- 172.21.15.50:0/969248389 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9680106eb0 0x7f968019cf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:00.344 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:00.340+0000 7f9676a00640 1 -- 172.21.15.50:0/969248389 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9680105490 msgr2=0x7f968019bd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:37:00.344 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:00.340+0000 7f9676a00640 1 --2- 172.21.15.50:0/969248389 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9680105490 0x7f968019bd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:00.344 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:00.340+0000 7f9676a00640 1 -- 172.21.15.50:0/969248389 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f968019d760 con 0x7f9680106510 2024-08-31T04:37:00.344 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:00.340+0000 7f967f400640 1 --2- 172.21.15.50:0/969248389 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9680105490 0x7f968019bd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:37:00.344 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:00.340+0000 7f9676a00640 1 --2- 172.21.15.50:0/969248389 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9680106510 0x7f968019c390 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f966802a860 tx=0x7f9668032d50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:37:00.344 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:00.340+0000 7f967cc00640 1 -- 172.21.15.50:0/969248389 <== mon.2 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9668040020 con 0x7f9680106510 2024-08-31T04:37:00.345 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:00.340+0000 7f967cc00640 1 -- 172.21.15.50:0/969248389 <== mon.2 v2:172.21.15.133:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9668030810 con 0x7f9680106510 2024-08-31T04:37:00.345 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:00.341+0000 7f9684c00640 1 -- 172.21.15.50:0/969248389 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f968019d9f0 con 0x7f9680106510 2024-08-31T04:37:00.345 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:00.341+0000 7f967cc00640 1 -- 172.21.15.50:0/969248389 <== mon.2 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9668037040 con 0x7f9680106510 2024-08-31T04:37:00.345 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:00.341+0000 7f9684c00640 1 -- 172.21.15.50:0/969248389 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f96801a4140 con 0x7f9680106510 2024-08-31T04:37:00.347 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:00.343+0000 7f968d258740 1 Processor -- start 2024-08-31T04:37:00.347 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:00.344+0000 7f968d258740 1 -- start start 2024-08-31T04:37:00.347 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:00.344+0000 7f968d258740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ab769621b0 0x55ab76d07d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:37:00.347 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:00.344+0000 7f968d258740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ab769392f0 0x55ab76d083b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:37:00.347 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:00.344+0000 7f968d258740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ab769414d0 0x55ab76d08f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:37:00.347 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:00.344+0000 7f968d258740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55ab76c7af70 con 0x55ab769392f0 2024-08-31T04:37:00.347 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:00.344+0000 7f968d258740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x55ab76c6a500 con 0x55ab769621b0 2024-08-31T04:37:00.347 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:00.344+0000 7f968d258740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x55ab76c6e4b0 con 0x55ab769414d0 2024-08-31T04:37:00.347 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:00.344+0000 7f967fe00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ab769621b0 0x55ab76d07d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:37:00.347 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:00.344+0000 7f967cc00640 1 -- 172.21.15.50:0/969248389 <== mon.2 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 18) ==== 152577+0+0 (secure 0 0 0) 0x7f9668043020 con 0x7f9680106510 2024-08-31T04:37:00.348 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:00.344+0000 7f967fe00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ab769621b0 0x55ab76d07d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.50:38120/0 (socket says 172.21.15.50:38120) 2024-08-31T04:37:00.348 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:00.344+0000 7f967fe00640 1 -- 172.21.15.50:0/3567133865 learned_addr learned my addr 172.21.15.50:0/3567133865 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:37:00.348 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:00.344+0000 7f967f400640 1 --2- 172.21.15.50:0/3567133865 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ab769392f0 0x55ab76d083b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:37:00.348 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:00.345+0000 7f967fe00640 1 -- 172.21.15.50:0/3567133865 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ab769414d0 msgr2=0x55ab76d08f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:37:00.348 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:00.345+0000 7f967fe00640 1 --2- 172.21.15.50:0/3567133865 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ab769414d0 0x55ab76d08f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:00.348 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:00.345+0000 7f967fe00640 1 -- 172.21.15.50:0/3567133865 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ab769392f0 msgr2=0x55ab76d083b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:37:00.348 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:00.345+0000 7f967fe00640 1 --2- 172.21.15.50:0/3567133865 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ab769392f0 0x55ab76d083b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:00.348 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:00.345+0000 7f967fe00640 1 -- 172.21.15.50:0/3567133865 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ab76c24c10 con 0x55ab769621b0 2024-08-31T04:37:00.348 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:00.345+0000 7f967fe00640 1 --2- 172.21.15.50:0/3567133865 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ab769621b0 0x55ab76d07d40 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f9678009c40 tx=0x7f9678011810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7dd20e9a5c331177 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:37:00.348 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:00.345+0000 7f966fe00640 1 -- 172.21.15.50:0/3567133865 <== mon.2 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9678004030 con 0x55ab769621b0 2024-08-31T04:37:00.348 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:00.345+0000 7f966fe00640 1 -- 172.21.15.50:0/3567133865 <== mon.2 v2:172.21.15.133:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f96780041d0 con 0x55ab769621b0 2024-08-31T04:37:00.348 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:00.345+0000 7f966fe00640 1 -- 172.21.15.50:0/3567133865 <== mon.2 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9678019680 con 0x55ab769621b0 2024-08-31T04:37:00.350 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:00.346+0000 7f967cc00640 1 --2- 172.21.15.50:0/969248389 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f96640b4bb0 0x7f96640b70c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:37:00.350 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:00.346+0000 7f967cc00640 1 -- 172.21.15.50:0/969248389 <== mon.2 v2:172.21.15.133:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8219+0+0 (secure 0 0 0) 0x7f9668104cd0 con 0x7f9680106510 2024-08-31T04:37:00.350 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:00.347+0000 7f968d258740 1 -- 172.21.15.50:0/3567133865 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ab769621b0 msgr2=0x55ab76d07d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:37:00.350 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:00.347+0000 7f968d258740 1 --2- 172.21.15.50:0/3567133865 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ab769621b0 0x55ab76d07d40 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f9678009c40 tx=0x7f9678011810 comp rx=0 tx=0).stop 2024-08-31T04:37:00.350 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:00.347+0000 7f967f400640 1 --2- 172.21.15.50:0/969248389 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f96640b4bb0 0x7f96640b70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:37:00.351 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:00.347+0000 7f968d258740 1 -- 172.21.15.50:0/3567133865 shutdown_connections 2024-08-31T04:37:00.351 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:00.347+0000 7f968d258740 1 --2- 172.21.15.50:0/3567133865 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ab769414d0 0x55ab76d08f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:00.351 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:00.347+0000 7f968d258740 1 --2- 172.21.15.50:0/3567133865 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ab769392f0 0x55ab76d083b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:00.351 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:00.347+0000 7f968d258740 1 --2- 172.21.15.50:0/3567133865 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ab769621b0 0x55ab76d07d40 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:00.351 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:00.347+0000 7f968d258740 1 -- 172.21.15.50:0/3567133865 >> 172.21.15.50:0/3567133865 conn(0x55ab76956300 msgr2=0x55ab76d037d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:37:00.351 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:00.347+0000 7f968d258740 1 -- 172.21.15.50:0/3567133865 shutdown_connections 2024-08-31T04:37:00.351 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:00.347+0000 7f968d258740 1 -- 172.21.15.50:0/3567133865 wait complete. 2024-08-31T04:37:00.351 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:00.347+0000 7f967f400640 1 --2- 172.21.15.50:0/969248389 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f96640b4bb0 0x7f96640b70c0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f96700049d0 tx=0x7f9670009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:37:00.351 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:00.348+0000 7f968d258740 1 -- start start 2024-08-31T04:37:00.351 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:00.348+0000 7f968d258740 1 Processor -- start 2024-08-31T04:37:00.351 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:00.349+0000 7f968d258740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ab769392f0 0x55ab76d11470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:37:00.351 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:00.349+0000 7f968d258740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ab769414d0 0x55ab76d11b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:37:00.351 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:00.349+0000 7f968d258740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ab769621b0 0x55ab76d126a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:37:00.352 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:00.349+0000 7f968d258740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55ab76ba3ab0 con 0x55ab769414d0 2024-08-31T04:37:00.352 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:00.349+0000 7f968d258740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x55ab76c11320 con 0x55ab769392f0 2024-08-31T04:37:00.352 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:00.349+0000 7f968d258740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x55ab76d09a20 con 0x55ab769621b0 2024-08-31T04:37:00.352 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:00.349+0000 7f968d258740 10 client.0 _ll_register_callbacks cb 0x55ab76c4ae80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:37:00.352 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:00.349+0000 7f967f400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ab769392f0 0x55ab76d11470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:37:00.352 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:00.349+0000 7f967fe00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ab769621b0 0x55ab76d126a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:37:00.352 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:00.349+0000 7f967f400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ab769392f0 0x55ab76d11470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.50:38132/0 (socket says 172.21.15.50:38132) 2024-08-31T04:37:00.352 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:00.349+0000 7f967f400640 1 -- 172.21.15.50:0/2766527244 learned_addr learned my addr 172.21.15.50:0/2766527244 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:37:00.352 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:00.349+0000 7f9676a00640 1 --2- 172.21.15.50:0/2766527244 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ab769414d0 0x55ab76d11b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:37:00.354 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:00.349+0000 7f967fe00640 1 -- 172.21.15.50:0/2766527244 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ab769392f0 msgr2=0x55ab76d11470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:37:00.354 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:00.349+0000 7f967fe00640 1 --2- 172.21.15.50:0/2766527244 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ab769392f0 0x55ab76d11470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:00.354 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:00.349+0000 7f967fe00640 1 -- 172.21.15.50:0/2766527244 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ab769414d0 msgr2=0x55ab76d11b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:37:00.354 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:00.349+0000 7f967fe00640 1 --2- 172.21.15.50:0/2766527244 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ab769414d0 0x55ab76d11b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:00.354 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:00.349+0000 7f967fe00640 1 -- 172.21.15.50:0/2766527244 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ab769cd790 con 0x55ab769621b0 2024-08-31T04:37:00.354 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:00.350+0000 7f967fe00640 1 --2- 172.21.15.50:0/2766527244 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ab769621b0 0x55ab76d126a0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f9678006010 tx=0x7f9678003c90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4bc7ccbf2588408a server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:37:00.355 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:00.350+0000 7f966cc00640 10 client.0 ms_handle_connect on v2:172.21.15.177:3300/0 2024-08-31T04:37:00.355 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:00.350+0000 7f966cc00640 1 -- 172.21.15.50:0/2766527244 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9678028070 con 0x55ab769621b0 2024-08-31T04:37:00.355 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:00.350+0000 7f966cc00640 1 -- 172.21.15.50:0/2766527244 <== mon.1 v2:172.21.15.177:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8219+0+0 (secure 0 0 0) 0x7f9678004380 con 0x55ab769621b0 2024-08-31T04:37:00.355 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:00.350+0000 7f968d258740 1 -- 172.21.15.50:0/2766527244 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f96780041d0 con 0x55ab769621b0 2024-08-31T04:37:00.355 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:00.350+0000 7f966cc00640 1 -- 172.21.15.50:0/2766527244 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_get_version_reply(handle=1 version=71) ==== 24+0+0 (secure 0 0 0) 0x7f9678034050 con 0x55ab769621b0 2024-08-31T04:37:00.355 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:00.350+0000 7f968d258740 10 client.26611 fetch_fsmap learned FSMap version 71 2024-08-31T04:37:00.355 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:00.351+0000 7f968d258740 1 -- 172.21.15.50:0/2766527244 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,fsmap=71,monmap=4+}) -- 0x55ab76a46620 con 0x55ab769621b0 2024-08-31T04:37:00.355 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:00.351+0000 7f966cc00640 1 -- 172.21.15.50:0/2766527244 <== mon.1 v2:172.21.15.177:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f96780041d0 con 0x55ab769621b0 2024-08-31T04:37:00.355 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:00.351+0000 7f966cc00640 1 -- 172.21.15.50:0/2766527244 <== mon.1 v2:172.21.15.177:3300/0 5 ==== fsmap(e 71) ==== 8442+0+0 (secure 0 0 0) 0x7f9678004b00 con 0x55ab769621b0 2024-08-31T04:37:00.355 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:00.351+0000 7f968d258740 10 client.26611 fetch_fsmap finished waiting for FSMap version 71 2024-08-31T04:37:00.355 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:00.351+0000 7f968d258740 10 client.26611 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T04:37:00.355 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:00.351+0000 7f968d258740 20 client.26611 populate_metadata read hostname 'smithi050' 2024-08-31T04:37:00.355 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:00.351+0000 7f968d258740 1 --2- 172.21.15.50:0/2766527244 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x55ab76920d80 0x55ab76d1e9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:37:00.356 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:00.351+0000 7f968d258740 4 client.26611 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T04:37:00.356 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:00.351+0000 7f968d258740 1 -- 172.21.15.50:0/2766527244 --> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ab76c7cec0 con 0x55ab76920d80 2024-08-31T04:37:00.356 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:00.352+0000 7f967f400640 1 --2- 172.21.15.50:0/2766527244 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x55ab76920d80 0x55ab76d1e9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:37:00.356 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:00.352+0000 7f967f400640 1 --2- 172.21.15.50:0/2766527244 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x55ab76920d80 0x55ab76d1e9d0 crc :-1 s=READY pgs=171 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=63250cf81e5a55a1 server_cookie=b568f62b2651f0b3 in_seq=0 out_seq=0 2024-08-31T04:37:00.356 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:00.352+0000 7f966cc00640 10 client.26611 ms_handle_connect on v2:172.21.15.133:6838/2526402262 2024-08-31T04:37:00.357 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:00.353+0000 7f966cc00640 1 -- 172.21.15.50:0/2766527244 <== mds.0 v2:172.21.15.133:6838/2526402262 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55ab76c7cec0 con 0x55ab76920d80 2024-08-31T04:37:00.357 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:00.353+0000 7f966cc00640 10 client.26611 handle_command_reply: tid=0 2024-08-31T04:37:00.357 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:00.353+0000 7f968d258740 1 client.26611 shutdown 2024-08-31T04:37:00.357 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:00.354+0000 7f968d258740 1 -- 172.21.15.50:0/2766527244 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ab769621b0 msgr2=0x55ab76d126a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:37:00.357 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:00.354+0000 7f968d258740 1 --2- 172.21.15.50:0/2766527244 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ab769621b0 0x55ab76d126a0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f9678006010 tx=0x7f9678003c90 comp rx=0 tx=0).stop 2024-08-31T04:37:00.357 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:00.354+0000 7f968d258740 1 -- 172.21.15.50:0/2766527244 shutdown_connections 2024-08-31T04:37:00.357 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:00.354+0000 7f968d258740 1 --2- 172.21.15.50:0/2766527244 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x55ab76920d80 0x55ab76d1e9d0 crc :-1 s=READY pgs=171 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:00.358 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:00.354+0000 7f968d258740 1 --2- 172.21.15.50:0/2766527244 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ab769621b0 0x55ab76d126a0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:00.358 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:00.354+0000 7f968d258740 1 --2- 172.21.15.50:0/2766527244 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ab769414d0 0x55ab76d11b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:00.358 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:00.354+0000 7f966cc00640 0 client.26611 ms_handle_reset on v2:172.21.15.133:6838/2526402262 2024-08-31T04:37:00.358 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:00.354+0000 7f968d258740 1 --2- 172.21.15.50:0/2766527244 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ab769392f0 0x55ab76d11470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:00.358 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:00.354+0000 7f968d258740 1 -- 172.21.15.50:0/2766527244 >> 172.21.15.50:0/2766527244 conn(0x55ab76956300 msgr2=0x55ab76d01d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:37:00.358 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:00.354+0000 7f968d258740 1 -- 172.21.15.50:0/2766527244 shutdown_connections 2024-08-31T04:37:00.358 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:00.354+0000 7f968d258740 1 -- 172.21.15.50:0/2766527244 wait complete. 2024-08-31T04:37:00.358 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:00.354+0000 7f968d258740 20 client.26611 trim_cache size 0 max 16384 2024-08-31T04:37:00.371 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:00.369+0000 7f968d258740 1 Processor -- start 2024-08-31T04:37:00.371 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:00.370+0000 7f968d258740 1 -- start start 2024-08-31T04:37:00.372 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:00.370+0000 7f968d258740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ab769392f0 0x55ab76d10da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:37:00.372 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:00.370+0000 7f968d258740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ab769414d0 0x55ab76d02d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:37:00.372 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:00.370+0000 7f968d258740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ab769621b0 0x55ab76d032c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:37:00.372 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:00.370+0000 7f968d258740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f96801accc0 con 0x55ab769414d0 2024-08-31T04:37:00.373 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:00.370+0000 7f968d258740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f96801aea40 con 0x55ab769621b0 2024-08-31T04:37:00.373 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:00.370+0000 7f968d258740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f96801ad450 con 0x55ab769392f0 2024-08-31T04:37:00.373 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:00.370+0000 7f9676a00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ab769414d0 0x55ab76d02d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:37:00.373 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:00.370+0000 7f967f400640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ab769392f0 0x55ab76d10da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:37:00.373 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:00.370+0000 7f967fe00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ab769621b0 0x55ab76d032c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:37:00.373 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:00.370+0000 7f967f400640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ab769392f0 0x55ab76d10da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.50:51962/0 (socket says 172.21.15.50:51962) 2024-08-31T04:37:00.373 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:00.370+0000 7f967f400640 1 -- 172.21.15.50:0/2164457545 learned_addr learned my addr 172.21.15.50:0/2164457545 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:37:00.373 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:00.371+0000 7f967f400640 1 -- 172.21.15.50:0/2164457545 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ab769621b0 msgr2=0x55ab76d032c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:37:00.373 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:00.371+0000 7f967f400640 1 --2- 172.21.15.50:0/2164457545 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ab769621b0 0x55ab76d032c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:00.373 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:00.371+0000 7f967f400640 1 -- 172.21.15.50:0/2164457545 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ab769414d0 msgr2=0x55ab76d02d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:37:00.373 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:00.371+0000 7f967f400640 1 --2- 172.21.15.50:0/2164457545 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ab769414d0 0x55ab76d02d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:00.374 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:00.371+0000 7f967f400640 1 -- 172.21.15.50:0/2164457545 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ab76d1ed40 con 0x55ab769392f0 2024-08-31T04:37:00.374 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:00.371+0000 7f967f400640 1 --2- 172.21.15.50:0/2164457545 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ab769392f0 0x55ab76d10da0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f967000f9a0 tx=0x7f967001a000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4b93debb03b9672d server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:37:00.374 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:00.371+0000 7f966f400640 1 -- 172.21.15.50:0/2164457545 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9670004b20 con 0x55ab769392f0 2024-08-31T04:37:00.374 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:00.371+0000 7f966f400640 1 -- 172.21.15.50:0/2164457545 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9670004cc0 con 0x55ab769392f0 2024-08-31T04:37:00.374 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:00.371+0000 7f966f400640 1 -- 172.21.15.50:0/2164457545 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f967002b860 con 0x55ab769392f0 2024-08-31T04:37:00.378 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:00.372+0000 7f968d258740 1 -- 172.21.15.50:0/2164457545 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ab769392f0 msgr2=0x55ab76d10da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:37:00.378 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:00.372+0000 7f968d258740 1 --2- 172.21.15.50:0/2164457545 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ab769392f0 0x55ab76d10da0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f967000f9a0 tx=0x7f967001a000 comp rx=0 tx=0).stop 2024-08-31T04:37:00.378 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:00.372+0000 7f968d258740 1 -- 172.21.15.50:0/2164457545 shutdown_connections 2024-08-31T04:37:00.378 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:00.372+0000 7f968d258740 1 --2- 172.21.15.50:0/2164457545 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ab769621b0 0x55ab76d032c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:00.378 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:00.372+0000 7f968d258740 1 --2- 172.21.15.50:0/2164457545 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ab769414d0 0x55ab76d02d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:00.378 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:00.372+0000 7f968d258740 1 --2- 172.21.15.50:0/2164457545 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ab769392f0 0x55ab76d10da0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:00.378 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:00.372+0000 7f968d258740 1 -- 172.21.15.50:0/2164457545 >> 172.21.15.50:0/2164457545 conn(0x55ab76956300 msgr2=0x55ab76d10690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:37:00.378 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:00.372+0000 7f968d258740 1 -- 172.21.15.50:0/2164457545 shutdown_connections 2024-08-31T04:37:00.378 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:00.372+0000 7f968d258740 1 -- 172.21.15.50:0/2164457545 wait complete. 2024-08-31T04:37:00.379 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:00.373+0000 7f968d258740 1 -- start start 2024-08-31T04:37:00.379 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:00.373+0000 7f968d258740 1 Processor -- start 2024-08-31T04:37:00.379 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:00.373+0000 7f968d258740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ab769392f0 0x55ab76d18c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:37:00.379 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:00.373+0000 7f968d258740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ab769414d0 0x55ab76d178c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:37:00.379 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:00.373+0000 7f968d258740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ab769621b0 0x55ab76d17e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:37:00.379 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:00.373+0000 7f968d258740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f96801ae370 con 0x55ab769621b0 2024-08-31T04:37:00.379 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:00.373+0000 7f968d258740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f96801adbe0 con 0x55ab769392f0 2024-08-31T04:37:00.379 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:00.373+0000 7f968d258740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f96801aaca0 con 0x55ab769414d0 2024-08-31T04:37:00.379 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:00.373+0000 7f968d258740 10 client.0 _ll_register_callbacks cb 0x7f9678009b10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:37:00.380 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:00.373+0000 7f967f400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ab769392f0 0x55ab76d18c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:37:00.380 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:00.373+0000 7f967f400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ab769392f0 0x55ab76d18c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.50:38140/0 (socket says 172.21.15.50:38140) 2024-08-31T04:37:00.380 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:00.373+0000 7f967f400640 1 -- 172.21.15.50:0/2386160157 learned_addr learned my addr 172.21.15.50:0/2386160157 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:37:00.380 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:00.374+0000 7f967fe00640 1 --2- 172.21.15.50:0/2386160157 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ab769621b0 0x55ab76d17e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:37:00.380 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:00.374+0000 7f9676a00640 1 --2- 172.21.15.50:0/2386160157 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ab769414d0 0x55ab76d178c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:37:00.380 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:00.374+0000 7f967f400640 1 -- 172.21.15.50:0/2386160157 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ab769414d0 msgr2=0x55ab76d178c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:37:00.380 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:00.374+0000 7f967f400640 1 --2- 172.21.15.50:0/2386160157 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ab769414d0 0x55ab76d178c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:00.380 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:00.374+0000 7f967f400640 1 -- 172.21.15.50:0/2386160157 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ab769621b0 msgr2=0x55ab76d17e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:37:00.380 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:00.374+0000 7f967f400640 1 --2- 172.21.15.50:0/2386160157 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ab769621b0 0x55ab76d17e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:00.380 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:00.374+0000 7f967f400640 1 -- 172.21.15.50:0/2386160157 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ab76d18510 con 0x55ab769392f0 2024-08-31T04:37:00.381 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:00.374+0000 7f967f400640 1 --2- 172.21.15.50:0/2386160157 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ab769392f0 0x55ab76d18c00 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f967000fb00 tx=0x7f967000fb30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6c2d5a7a7a6a8e1e server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:37:00.381 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:00.374+0000 7f966cc00640 10 client.0 ms_handle_connect on v2:172.21.15.133:3300/0 2024-08-31T04:37:00.381 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:00.374+0000 7f966cc00640 1 -- 172.21.15.50:0/2386160157 <== mon.2 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9670040060 con 0x55ab769392f0 2024-08-31T04:37:00.381 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:00.375+0000 7f968d258740 1 -- 172.21.15.50:0/2386160157 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9670004cc0 con 0x55ab769392f0 2024-08-31T04:37:00.381 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:00.375+0000 7f966cc00640 1 -- 172.21.15.50:0/2386160157 <== mon.2 v2:172.21.15.133:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8219+0+0 (secure 0 0 0) 0x7f9670011810 con 0x55ab769392f0 2024-08-31T04:37:00.381 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:00.375+0000 7f966cc00640 1 -- 172.21.15.50:0/2386160157 <== mon.2 v2:172.21.15.133:3300/0 3 ==== mon_get_version_reply(handle=1 version=71) ==== 24+0+0 (secure 0 0 0) 0x7f9670011a10 con 0x55ab769392f0 2024-08-31T04:37:00.381 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:00.375+0000 7f968d258740 10 client.26633 fetch_fsmap learned FSMap version 71 2024-08-31T04:37:00.381 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:00.375+0000 7f968d258740 1 -- 172.21.15.50:0/2386160157 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,fsmap=71,monmap=4+}) -- 0x55ab76d893b0 con 0x55ab769392f0 2024-08-31T04:37:00.381 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:00.375+0000 7f966cc00640 1 -- 172.21.15.50:0/2386160157 <== mon.2 v2:172.21.15.133:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9670004cc0 con 0x55ab769392f0 2024-08-31T04:37:00.381 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:00.375+0000 7f966cc00640 1 -- 172.21.15.50:0/2386160157 <== mon.2 v2:172.21.15.133:3300/0 5 ==== fsmap(e 71) ==== 8442+0+0 (secure 0 0 0) 0x7f9670032450 con 0x55ab769392f0 2024-08-31T04:37:00.382 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:00.375+0000 7f968d258740 10 client.26633 fetch_fsmap finished waiting for FSMap version 71 2024-08-31T04:37:00.382 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:00.375+0000 7f968d258740 10 client.26633 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T04:37:00.382 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:00.375+0000 7f968d258740 20 client.26633 populate_metadata read hostname 'smithi050' 2024-08-31T04:37:00.382 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:00.375+0000 7f968d258740 1 --2- 172.21.15.50:0/2386160157 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x55ab768f61c0 0x55ab76d8bd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:37:00.382 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:00.375+0000 7f968d258740 4 client.26633 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-31T04:37:00.382 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:00.375+0000 7f968d258740 1 -- 172.21.15.50:0/2386160157 --> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55ab76c78960 con 0x55ab768f61c0 2024-08-31T04:37:00.382 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:00.376+0000 7f9676a00640 1 --2- 172.21.15.50:0/2386160157 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x55ab768f61c0 0x55ab76d8bd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:37:00.382 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:00.376+0000 7f9676a00640 1 --2- 172.21.15.50:0/2386160157 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x55ab768f61c0 0x55ab76d8bd20 crc :-1 s=READY pgs=172 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=379309934e67fb71 server_cookie=b00c4b7eae324fd6 in_seq=0 out_seq=0 2024-08-31T04:37:00.382 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:00.376+0000 7f966cc00640 10 client.26633 ms_handle_connect on v2:172.21.15.133:6838/2526402262 2024-08-31T04:37:00.711 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:00.708+0000 7f966cc00640 1 -- 172.21.15.50:0/2386160157 <== mds.0 v2:172.21.15.133:6838/2526402262 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55ab76c78960 con 0x55ab768f61c0 2024-08-31T04:37:00.711 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:00.709+0000 7f966cc00640 10 client.26633 handle_command_reply: tid=0 2024-08-31T04:37:00.711 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:00.709+0000 7f968d258740 1 client.26633 shutdown 2024-08-31T04:37:00.711 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:00.709+0000 7f968d258740 1 -- 172.21.15.50:0/2386160157 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ab769392f0 msgr2=0x55ab76d18c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:37:00.711 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:00.709+0000 7f968d258740 1 --2- 172.21.15.50:0/2386160157 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ab769392f0 0x55ab76d18c00 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f967000fb00 tx=0x7f967000fb30 comp rx=0 tx=0).stop 2024-08-31T04:37:00.711 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:00.709+0000 7f968d258740 1 -- 172.21.15.50:0/2386160157 shutdown_connections 2024-08-31T04:37:00.711 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:00.709+0000 7f968d258740 1 --2- 172.21.15.50:0/2386160157 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x55ab768f61c0 0x55ab76d8bd20 crc :-1 s=READY pgs=172 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:00.711 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:00.709+0000 7f968d258740 1 --2- 172.21.15.50:0/2386160157 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ab769414d0 0x55ab76d178c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:00.711 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:00.709+0000 7f968d258740 1 --2- 172.21.15.50:0/2386160157 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ab769621b0 0x55ab76d17e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:00.711 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:00.709+0000 7f968d258740 1 --2- 172.21.15.50:0/2386160157 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ab769392f0 0x55ab76d18c00 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:00.711 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:00.709+0000 7f968d258740 1 -- 172.21.15.50:0/2386160157 >> 172.21.15.50:0/2386160157 conn(0x55ab76956300 msgr2=0x55ab76d0be90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:37:00.712 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:00.709+0000 7f966cc00640 0 client.26633 ms_handle_reset on v2:172.21.15.133:6838/2526402262 2024-08-31T04:37:00.712 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:00.709+0000 7f968d258740 1 -- 172.21.15.50:0/2386160157 shutdown_connections 2024-08-31T04:37:00.712 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:00.709+0000 7f968d258740 1 -- 172.21.15.50:0/2386160157 wait complete. 2024-08-31T04:37:00.712 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:00.710+0000 7f968d258740 20 client.26633 trim_cache size 0 max 16384 2024-08-31T04:37:00.712 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout:{ 2024-08-31T04:37:00.713 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout: "message": "", 2024-08-31T04:37:00.713 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout: "return_code": 0 2024-08-31T04:37:00.713 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout:} 2024-08-31T04:37:00.713 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:00.711+0000 7f9684c00640 1 -- 172.21.15.50:0/969248389 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f96640b4bb0 msgr2=0x7f96640b70c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:37:00.713 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:00.711+0000 7f9684c00640 1 --2- 172.21.15.50:0/969248389 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f96640b4bb0 0x7f96640b70c0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f96700049d0 tx=0x7f9670009500 comp rx=0 tx=0).stop 2024-08-31T04:37:00.714 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:00.711+0000 7f9684c00640 1 -- 172.21.15.50:0/969248389 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9680106510 msgr2=0x7f968019c390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:37:00.714 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:00.711+0000 7f9684c00640 1 --2- 172.21.15.50:0/969248389 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9680106510 0x7f968019c390 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f966802a860 tx=0x7f9668032d50 comp rx=0 tx=0).stop 2024-08-31T04:37:00.714 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:00.711+0000 7f9684c00640 1 -- 172.21.15.50:0/969248389 shutdown_connections 2024-08-31T04:37:00.714 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:00.711+0000 7f9684c00640 1 --2- 172.21.15.50:0/969248389 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f96640b4bb0 0x7f96640b70c0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:00.714 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:00.711+0000 7f9684c00640 1 --2- 172.21.15.50:0/969248389 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9680106eb0 0x7f968019cf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:00.714 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:00.711+0000 7f9684c00640 1 --2- 172.21.15.50:0/969248389 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9680106510 0x7f968019c390 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:00.714 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:00.711+0000 7f9684c00640 1 --2- 172.21.15.50:0/969248389 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9680105490 0x7f968019bd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:00.714 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:00.711+0000 7f9684c00640 1 -- 172.21.15.50:0/969248389 >> 172.21.15.50:0/969248389 conn(0x7f9680100df0 msgr2=0x7f9680109830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:37:00.714 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:00.711+0000 7f9684c00640 1 -- 172.21.15.50:0/969248389 shutdown_connections 2024-08-31T04:37:00.714 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:00.711+0000 7f9684c00640 1 -- 172.21.15.50:0/969248389 wait complete. 2024-08-31T04:37:01.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:37:01 smithi050 ceph-mon[17259]: pgmap v792: 97 pgs: 97 active+clean; 1005 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.1 MiB/s wr, 376 op/s 2024-08-31T04:37:01.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:37:01 smithi177 ceph-mon[22025]: pgmap v792: 97 pgs: 97 active+clean; 1005 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.1 MiB/s wr, 376 op/s 2024-08-31T04:37:01.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:37:01 smithi133 ceph-mon[22177]: pgmap v792: 97 pgs: 97 active+clean; 1005 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.1 MiB/s wr, 376 op/s 2024-08-31T04:37:03.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:37:03 smithi050 ceph-mon[17259]: pgmap v793: 97 pgs: 97 active+clean; 998 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.3 MiB/s wr, 423 op/s 2024-08-31T04:37:03.748 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:37:03 smithi177 ceph-mon[22025]: pgmap v793: 97 pgs: 97 active+clean; 998 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.3 MiB/s wr, 423 op/s 2024-08-31T04:37:03.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:37:03 smithi133 ceph-mon[22177]: pgmap v793: 97 pgs: 97 active+clean; 998 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.3 MiB/s wr, 423 op/s 2024-08-31T04:37:05.683 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:37:05 smithi050 ceph-mon[17259]: pgmap v794: 97 pgs: 97 active+clean; 990 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.1 MiB/s wr, 415 op/s 2024-08-31T04:37:05.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:37:05 smithi177 ceph-mon[22025]: pgmap v794: 97 pgs: 97 active+clean; 990 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.1 MiB/s wr, 415 op/s 2024-08-31T04:37:05.792 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:37:05 smithi133 ceph-mon[22177]: pgmap v794: 97 pgs: 97 active+clean; 990 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.1 MiB/s wr, 415 op/s 2024-08-31T04:37:07.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:37:07 smithi050 ceph-mon[17259]: pgmap v795: 97 pgs: 97 active+clean; 972 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 516 op/s 2024-08-31T04:37:07.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:37:07 smithi177 ceph-mon[22025]: pgmap v795: 97 pgs: 97 active+clean; 972 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 516 op/s 2024-08-31T04:37:07.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:37:07 smithi133 ceph-mon[22177]: pgmap v795: 97 pgs: 97 active+clean; 972 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 516 op/s 2024-08-31T04:37:09.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:37:09 smithi050 ceph-mon[17259]: pgmap v796: 97 pgs: 97 active+clean; 969 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.1 MiB/s wr, 476 op/s 2024-08-31T04:37:09.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:37:09 smithi177 ceph-mon[22025]: pgmap v796: 97 pgs: 97 active+clean; 969 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.1 MiB/s wr, 476 op/s 2024-08-31T04:37:09.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:37:09 smithi133 ceph-mon[22177]: pgmap v796: 97 pgs: 97 active+clean; 969 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.1 MiB/s wr, 476 op/s 2024-08-31T04:37:11.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:37:11 smithi050 ceph-mon[17259]: pgmap v797: 97 pgs: 97 active+clean; 958 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.1 MiB/s wr, 476 op/s 2024-08-31T04:37:11.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:37:11 smithi177 ceph-mon[22025]: pgmap v797: 97 pgs: 97 active+clean; 958 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.1 MiB/s wr, 476 op/s 2024-08-31T04:37:11.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:37:11 smithi133 ceph-mon[22177]: pgmap v797: 97 pgs: 97 active+clean; 958 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.1 MiB/s wr, 476 op/s 2024-08-31T04:37:13.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:37:13 smithi050 ceph-mon[17259]: pgmap v798: 97 pgs: 97 active+clean; 950 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 482 op/s 2024-08-31T04:37:13.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:37:13 smithi177 ceph-mon[22025]: pgmap v798: 97 pgs: 97 active+clean; 950 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 482 op/s 2024-08-31T04:37:13.792 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:37:13 smithi133 ceph-mon[22177]: pgmap v798: 97 pgs: 97 active+clean; 950 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 482 op/s 2024-08-31T04:37:13.918 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:13.915+0000 7f0d67e00640 1 -- 172.21.15.50:0/1210930501 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0d68104300 msgr2=0x7f0d68104710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:37:13.918 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:13.915+0000 7f0d67e00640 1 --2- 172.21.15.50:0/1210930501 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0d68104300 0x7f0d68104710 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f0d50009860 tx=0x7f0d5002a340 comp rx=0 tx=0).stop 2024-08-31T04:37:13.918 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:13.915+0000 7f0d67e00640 1 -- 172.21.15.50:0/1210930501 shutdown_connections 2024-08-31T04:37:13.918 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:13.915+0000 7f0d67e00640 1 --2- 172.21.15.50:0/1210930501 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0d68104300 0x7f0d68104710 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:13.919 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:13.915+0000 7f0d67e00640 1 --2- 172.21.15.50:0/1210930501 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0d68104ca0 0x7f0d6810b640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:13.919 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:13.915+0000 7f0d67e00640 1 --2- 172.21.15.50:0/1210930501 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0d68103280 0x7f0d681036f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:13.919 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:13.915+0000 7f0d67e00640 1 -- 172.21.15.50:0/1210930501 >> 172.21.15.50:0/1210930501 conn(0x7f0d680febc0 msgr2=0x7f0d68101070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:37:13.919 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:13.915+0000 7f0d67e00640 1 -- 172.21.15.50:0/1210930501 shutdown_connections 2024-08-31T04:37:13.919 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:13.916+0000 7f0d67e00640 1 -- 172.21.15.50:0/1210930501 wait complete. 2024-08-31T04:37:13.921 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:13.916+0000 7f0d67e00640 1 Processor -- start 2024-08-31T04:37:13.921 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:13.917+0000 7f0d67e00640 1 -- start start 2024-08-31T04:37:13.921 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:13.917+0000 7f0d67e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0d68103280 0x7f0d68199b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:37:13.921 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:13.917+0000 7f0d67e00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0d68104300 0x7f0d6819a180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:37:13.922 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:13.917+0000 7f0d67e00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0d68104ca0 0x7f0d6819ad30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:37:13.922 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:13.917+0000 7f0d67e00640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f0d6810ef00 con 0x7f0d68103280 2024-08-31T04:37:13.922 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:13.917+0000 7f0d67e00640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f0d6810ed80 con 0x7f0d68104ca0 2024-08-31T04:37:13.922 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:13.917+0000 7f0d67e00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f0d6810f080 con 0x7f0d68104300 2024-08-31T04:37:13.922 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:13.917+0000 7f0d66a00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0d68103280 0x7f0d68199b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:37:13.923 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:13.917+0000 7f0d66a00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0d68103280 0x7f0d68199b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:59568/0 (socket says 172.21.15.50:59568) 2024-08-31T04:37:13.923 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:13.917+0000 7f0d66a00640 1 -- 172.21.15.50:0/112183391 learned_addr learned my addr 172.21.15.50:0/112183391 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:37:13.923 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:13.917+0000 7f0d5e000640 1 --2- 172.21.15.50:0/112183391 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0d68104300 0x7f0d6819a180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:37:13.923 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:13.917+0000 7f0d67400640 1 --2- 172.21.15.50:0/112183391 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0d68104ca0 0x7f0d6819ad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:37:13.923 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:13.918+0000 7f0d5e000640 1 -- 172.21.15.50:0/112183391 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0d68104ca0 msgr2=0x7f0d6819ad30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:37:13.923 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:13.918+0000 7f0d5e000640 1 --2- 172.21.15.50:0/112183391 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0d68104ca0 0x7f0d6819ad30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:13.924 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:13.918+0000 7f0d5e000640 1 -- 172.21.15.50:0/112183391 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0d68103280 msgr2=0x7f0d68199b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:37:13.924 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:13.918+0000 7f0d5e000640 1 --2- 172.21.15.50:0/112183391 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0d68103280 0x7f0d68199b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:13.924 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:13.918+0000 7f0d5e000640 1 -- 172.21.15.50:0/112183391 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d6819b550 con 0x7f0d68104300 2024-08-31T04:37:13.924 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:13.918+0000 7f0d66a00640 1 --2- 172.21.15.50:0/112183391 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0d68103280 0x7f0d68199b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:37:13.924 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:13.918+0000 7f0d5e000640 1 --2- 172.21.15.50:0/112183391 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0d68104300 0x7f0d6819a180 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f0d5002a860 tx=0x7f0d50032d50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:37:13.924 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:13.918+0000 7f0d5fe00640 1 -- 172.21.15.50:0/112183391 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d50040020 con 0x7f0d68104300 2024-08-31T04:37:13.924 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:13.918+0000 7f0d67e00640 1 -- 172.21.15.50:0/112183391 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0d6819b7e0 con 0x7f0d68104300 2024-08-31T04:37:13.924 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:13.918+0000 7f0d5fe00640 1 -- 172.21.15.50:0/112183391 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0d50030810 con 0x7f0d68104300 2024-08-31T04:37:13.924 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:13.918+0000 7f0d5fe00640 1 -- 172.21.15.50:0/112183391 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d50037040 con 0x7f0d68104300 2024-08-31T04:37:13.924 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:13.919+0000 7f0d67e00640 1 -- 172.21.15.50:0/112183391 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0d681a1f30 con 0x7f0d68104300 2024-08-31T04:37:13.927 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:13.921+0000 7f0d749c0740 1 Processor -- start 2024-08-31T04:37:13.927 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:13.921+0000 7f0d749c0740 1 -- start start 2024-08-31T04:37:13.928 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:13.922+0000 7f0d749c0740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5571320381b0 0x5571323ddfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:37:13.928 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:13.922+0000 7f0d749c0740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55713200f2f0 0x5571323de610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:37:13.928 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:13.922+0000 7f0d749c0740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5571320174d0 0x5571323df160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:37:13.928 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:13.922+0000 7f0d749c0740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x557132350f70 con 0x55713200f2f0 2024-08-31T04:37:13.928 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:13.922+0000 7f0d749c0740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x557132340500 con 0x5571320381b0 2024-08-31T04:37:13.928 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:13.922+0000 7f0d749c0740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x5571323444b0 con 0x5571320174d0 2024-08-31T04:37:13.928 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:13.922+0000 7f0d67400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5571320381b0 0x5571323ddfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:37:13.928 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:13.922+0000 7f0d67400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5571320381b0 0x5571323ddfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.50:41600/0 (socket says 172.21.15.50:41600) 2024-08-31T04:37:13.928 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:13.922+0000 7f0d66a00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55713200f2f0 0x5571323de610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:37:13.928 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:13.922+0000 7f0d67400640 1 -- 172.21.15.50:0/1511742974 learned_addr learned my addr 172.21.15.50:0/1511742974 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:37:13.928 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:13.922+0000 7f0d5fe00640 1 -- 172.21.15.50:0/112183391 <== mon.1 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 18) ==== 152577+0+0 (secure 0 0 0) 0x7f0d50043020 con 0x7f0d68104300 2024-08-31T04:37:13.929 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:13.922+0000 7f0d67400640 1 -- 172.21.15.50:0/1511742974 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5571320174d0 msgr2=0x5571323df160 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-31T04:37:13.929 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:13.922+0000 7f0d67400640 1 --2- 172.21.15.50:0/1511742974 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5571320174d0 0x5571323df160 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:13.929 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:13.922+0000 7f0d67400640 1 -- 172.21.15.50:0/1511742974 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55713200f2f0 msgr2=0x5571323de610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:37:13.929 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:13.922+0000 7f0d67400640 1 --2- 172.21.15.50:0/1511742974 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55713200f2f0 0x5571323de610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:13.929 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:13.922+0000 7f0d67400640 1 -- 172.21.15.50:0/1511742974 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5571322fac10 con 0x5571320381b0 2024-08-31T04:37:13.929 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:13.922+0000 7f0d66a00640 1 --2- 172.21.15.50:0/1511742974 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55713200f2f0 0x5571323de610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:37:13.929 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:13.923+0000 7f0d67400640 1 --2- 172.21.15.50:0/1511742974 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5571320381b0 0x5571323ddfa0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f0d6000e580 tx=0x7f0d600095c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bf9b1d35c2cbe557 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:37:13.929 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:13.923+0000 7f0d57e00640 1 -- 172.21.15.50:0/1511742974 <== mon.2 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d60003970 con 0x5571320381b0 2024-08-31T04:37:13.929 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:13.923+0000 7f0d57e00640 1 -- 172.21.15.50:0/1511742974 <== mon.2 v2:172.21.15.133:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0d6000d830 con 0x5571320381b0 2024-08-31T04:37:13.929 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:13.923+0000 7f0d57e00640 1 -- 172.21.15.50:0/1511742974 <== mon.2 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d600043a0 con 0x5571320381b0 2024-08-31T04:37:13.929 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:13.924+0000 7f0d5fe00640 1 --2- 172.21.15.50:0/112183391 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f0d4c0b4b30 0x7f0d4c0b7040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:37:13.929 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:13.924+0000 7f0d749c0740 1 -- 172.21.15.50:0/1511742974 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5571320381b0 msgr2=0x5571323ddfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:37:13.930 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:13.924+0000 7f0d749c0740 1 --2- 172.21.15.50:0/1511742974 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5571320381b0 0x5571323ddfa0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f0d6000e580 tx=0x7f0d600095c0 comp rx=0 tx=0).stop 2024-08-31T04:37:13.930 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:13.924+0000 7f0d749c0740 1 -- 172.21.15.50:0/1511742974 shutdown_connections 2024-08-31T04:37:13.930 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:13.924+0000 7f0d749c0740 1 --2- 172.21.15.50:0/1511742974 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5571320174d0 0x5571323df160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:13.930 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:13.924+0000 7f0d749c0740 1 --2- 172.21.15.50:0/1511742974 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55713200f2f0 0x5571323de610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:13.930 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:13.924+0000 7f0d749c0740 1 --2- 172.21.15.50:0/1511742974 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5571320381b0 0x5571323ddfa0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:13.930 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:13.924+0000 7f0d749c0740 1 -- 172.21.15.50:0/1511742974 >> 172.21.15.50:0/1511742974 conn(0x55713202c300 msgr2=0x5571323d9a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:37:13.930 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:13.924+0000 7f0d5fe00640 1 -- 172.21.15.50:0/112183391 <== mon.1 v2:172.21.15.177:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8219+0+0 (secure 0 0 0) 0x7f0d50104d40 con 0x7f0d68104300 2024-08-31T04:37:13.931 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:13.924+0000 7f0d749c0740 1 -- 172.21.15.50:0/1511742974 shutdown_connections 2024-08-31T04:37:13.931 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:13.925+0000 7f0d66a00640 1 --2- 172.21.15.50:0/112183391 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f0d4c0b4b30 0x7f0d4c0b7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:37:13.931 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:13.925+0000 7f0d749c0740 1 -- 172.21.15.50:0/1511742974 wait complete. 2024-08-31T04:37:13.931 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:13.925+0000 7f0d749c0740 1 -- start start 2024-08-31T04:37:13.931 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:13.925+0000 7f0d66a00640 1 --2- 172.21.15.50:0/112183391 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f0d4c0b4b30 0x7f0d4c0b7040 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f0d58009640 tx=0x7f0d58005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:37:13.931 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:13.925+0000 7f0d749c0740 1 Processor -- start 2024-08-31T04:37:13.934 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:13.926+0000 7f0d749c0740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55713200f2f0 0x5571323e7690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:37:13.934 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:13.926+0000 7f0d749c0740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5571320174d0 0x5571323e7d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:37:13.934 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:13.926+0000 7f0d749c0740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5571320381b0 0x5571323e88c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:37:13.934 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:13.926+0000 7f0d749c0740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x557132279ab0 con 0x5571320381b0 2024-08-31T04:37:13.934 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:13.926+0000 7f0d749c0740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x5571322e7320 con 0x55713200f2f0 2024-08-31T04:37:13.934 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:13.926+0000 7f0d749c0740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x5571323dfc80 con 0x5571320174d0 2024-08-31T04:37:13.935 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:13.926+0000 7f0d749c0740 10 client.0 _ll_register_callbacks cb 0x5571322ed6a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:37:13.935 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:13.926+0000 7f0d66a00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55713200f2f0 0x5571323e7690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:37:13.935 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:13.926+0000 7f0d66a00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55713200f2f0 0x5571323e7690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.50:41614/0 (socket says 172.21.15.50:41614) 2024-08-31T04:37:13.935 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:13.926+0000 7f0d66a00640 1 -- 172.21.15.50:0/1408986548 learned_addr learned my addr 172.21.15.50:0/1408986548 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:37:13.935 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:13.926+0000 7f0d5e000640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5571320174d0 0x5571323e7d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:37:13.935 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:13.926+0000 7f0d67400640 1 --2- 172.21.15.50:0/1408986548 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5571320381b0 0x5571323e88c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:37:13.935 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:13.927+0000 7f0d66a00640 1 -- 172.21.15.50:0/1408986548 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5571320174d0 msgr2=0x5571323e7d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:37:13.935 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:13.927+0000 7f0d66a00640 1 --2- 172.21.15.50:0/1408986548 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5571320174d0 0x5571323e7d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:13.935 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:13.927+0000 7f0d66a00640 1 -- 172.21.15.50:0/1408986548 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5571320381b0 msgr2=0x5571323e88c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:37:13.935 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:13.927+0000 7f0d66a00640 1 --2- 172.21.15.50:0/1408986548 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5571320381b0 0x5571323e88c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:13.935 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:13.927+0000 7f0d66a00640 1 -- 172.21.15.50:0/1408986548 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5571320a3790 con 0x55713200f2f0 2024-08-31T04:37:13.936 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:13.927+0000 7f0d67400640 1 --2- 172.21.15.50:0/1408986548 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5571320381b0 0x5571323e88c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:37:13.936 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:13.927+0000 7f0d66a00640 1 --2- 172.21.15.50:0/1408986548 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55713200f2f0 0x5571323e7690 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f0d5800fb80 tx=0x7f0d58004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6b5e4346c5ae3c41 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:37:13.936 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:13.927+0000 7f0d54c00640 10 client.0 ms_handle_connect on v2:172.21.15.133:3300/0 2024-08-31T04:37:13.936 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:13.927+0000 7f0d54c00640 1 -- 172.21.15.50:0/1408986548 <== mon.2 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d5802e060 con 0x55713200f2f0 2024-08-31T04:37:13.936 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:13.927+0000 7f0d749c0740 1 -- 172.21.15.50:0/1408986548 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0d6000d830 con 0x55713200f2f0 2024-08-31T04:37:13.936 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:13.927+0000 7f0d54c00640 1 -- 172.21.15.50:0/1408986548 <== mon.2 v2:172.21.15.133:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8219+0+0 (secure 0 0 0) 0x7f0d58018030 con 0x55713200f2f0 2024-08-31T04:37:13.936 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:13.928+0000 7f0d54c00640 1 -- 172.21.15.50:0/1408986548 <== mon.2 v2:172.21.15.133:3300/0 3 ==== mon_get_version_reply(handle=1 version=71) ==== 24+0+0 (secure 0 0 0) 0x7f0d5800fd30 con 0x55713200f2f0 2024-08-31T04:37:13.936 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:13.928+0000 7f0d749c0740 10 client.26645 fetch_fsmap learned FSMap version 71 2024-08-31T04:37:13.936 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:13.928+0000 7f0d749c0740 1 -- 172.21.15.50:0/1408986548 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,fsmap=71,monmap=4+}) -- 0x55713211c620 con 0x55713200f2f0 2024-08-31T04:37:13.936 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:13.928+0000 7f0d54c00640 1 -- 172.21.15.50:0/1408986548 <== mon.2 v2:172.21.15.133:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0d6000d830 con 0x55713200f2f0 2024-08-31T04:37:13.936 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:13.928+0000 7f0d54c00640 1 -- 172.21.15.50:0/1408986548 <== mon.2 v2:172.21.15.133:3300/0 5 ==== fsmap(e 71) ==== 8442+0+0 (secure 0 0 0) 0x7f0d58034a40 con 0x55713200f2f0 2024-08-31T04:37:13.936 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:13.928+0000 7f0d749c0740 10 client.26645 fetch_fsmap finished waiting for FSMap version 71 2024-08-31T04:37:13.937 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:13.928+0000 7f0d749c0740 10 client.26645 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T04:37:13.937 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:13.928+0000 7f0d749c0740 20 client.26645 populate_metadata read hostname 'smithi050' 2024-08-31T04:37:13.937 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:13.928+0000 7f0d749c0740 1 --2- 172.21.15.50:0/1408986548 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x557131ff6d80 0x5571323f4fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:37:13.937 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:13.928+0000 7f0d749c0740 4 client.26645 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T04:37:13.937 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:13.928+0000 7f0d749c0740 1 -- 172.21.15.50:0/1408986548 --> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557132352ec0 con 0x557131ff6d80 2024-08-31T04:37:13.937 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:13.929+0000 7f0d5e000640 1 --2- 172.21.15.50:0/1408986548 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x557131ff6d80 0x5571323f4fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:37:13.937 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:13.929+0000 7f0d5e000640 1 --2- 172.21.15.50:0/1408986548 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x557131ff6d80 0x5571323f4fe0 crc :-1 s=READY pgs=173 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8b2411822d64efd8 server_cookie=ac77078b43470d46 in_seq=0 out_seq=0 2024-08-31T04:37:13.937 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:13.929+0000 7f0d54c00640 10 client.26645 ms_handle_connect on v2:172.21.15.133:6838/2526402262 2024-08-31T04:37:13.937 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:13.930+0000 7f0d54c00640 1 -- 172.21.15.50:0/1408986548 <== mds.0 v2:172.21.15.133:6838/2526402262 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x557132352ec0 con 0x557131ff6d80 2024-08-31T04:37:13.938 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:13.930+0000 7f0d54c00640 10 client.26645 handle_command_reply: tid=0 2024-08-31T04:37:13.938 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:13.931+0000 7f0d749c0740 1 client.26645 shutdown 2024-08-31T04:37:13.938 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:13.931+0000 7f0d749c0740 1 -- 172.21.15.50:0/1408986548 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55713200f2f0 msgr2=0x5571323e7690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:37:13.938 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:13.931+0000 7f0d749c0740 1 --2- 172.21.15.50:0/1408986548 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55713200f2f0 0x5571323e7690 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f0d5800fb80 tx=0x7f0d58004730 comp rx=0 tx=0).stop 2024-08-31T04:37:13.938 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:13.931+0000 7f0d749c0740 1 -- 172.21.15.50:0/1408986548 shutdown_connections 2024-08-31T04:37:13.938 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:13.931+0000 7f0d749c0740 1 --2- 172.21.15.50:0/1408986548 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x557131ff6d80 0x5571323f4fe0 crc :-1 s=READY pgs=173 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:13.938 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:13.931+0000 7f0d749c0740 1 --2- 172.21.15.50:0/1408986548 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5571320174d0 0x5571323e7d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:13.938 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:13.931+0000 7f0d749c0740 1 --2- 172.21.15.50:0/1408986548 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5571320381b0 0x5571323e88c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:13.938 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:13.931+0000 7f0d749c0740 1 --2- 172.21.15.50:0/1408986548 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55713200f2f0 0x5571323e7690 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:13.938 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:13.931+0000 7f0d749c0740 1 -- 172.21.15.50:0/1408986548 >> 172.21.15.50:0/1408986548 conn(0x55713202c300 msgr2=0x5571323d9a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:37:13.938 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:13.931+0000 7f0d54c00640 0 client.26645 ms_handle_reset on v2:172.21.15.133:6838/2526402262 2024-08-31T04:37:13.939 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:13.931+0000 7f0d749c0740 1 -- 172.21.15.50:0/1408986548 shutdown_connections 2024-08-31T04:37:13.939 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:13.931+0000 7f0d749c0740 1 -- 172.21.15.50:0/1408986548 wait complete. 2024-08-31T04:37:13.939 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:13.931+0000 7f0d749c0740 20 client.26645 trim_cache size 0 max 16384 2024-08-31T04:37:13.951 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:13.947+0000 7f0d749c0740 1 Processor -- start 2024-08-31T04:37:13.951 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:13.947+0000 7f0d749c0740 1 -- start start 2024-08-31T04:37:13.951 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:13.948+0000 7f0d749c0740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55713200f2f0 0x5571323e27c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:37:13.951 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:13.948+0000 7f0d749c0740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5571320174d0 0x5571323d8f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:37:13.951 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:13.948+0000 7f0d749c0740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5571320381b0 0x5571323d9490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:37:13.951 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:13.948+0000 7f0d749c0740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f0d681aab10 con 0x5571320174d0 2024-08-31T04:37:13.951 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:13.948+0000 7f0d749c0740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f0d681ac890 con 0x55713200f2f0 2024-08-31T04:37:13.951 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:13.948+0000 7f0d749c0740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f0d681ab2a0 con 0x5571320381b0 2024-08-31T04:37:13.951 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:13.948+0000 7f0d66a00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55713200f2f0 0x5571323e27c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:37:13.952 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:13.948+0000 7f0d5e000640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5571320174d0 0x5571323d8f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:37:13.952 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:13.948+0000 7f0d66a00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55713200f2f0 0x5571323e27c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.50:41622/0 (socket says 172.21.15.50:41622) 2024-08-31T04:37:13.952 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:13.948+0000 7f0d66a00640 1 -- 172.21.15.50:0/2129301203 learned_addr learned my addr 172.21.15.50:0/2129301203 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:37:13.952 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:13.948+0000 7f0d67400640 1 --2- 172.21.15.50:0/2129301203 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5571320381b0 0x5571323d9490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:37:13.952 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:13.948+0000 7f0d66a00640 1 -- 172.21.15.50:0/2129301203 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5571320381b0 msgr2=0x5571323d9490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:37:13.952 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:13.948+0000 7f0d66a00640 1 --2- 172.21.15.50:0/2129301203 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5571320381b0 0x5571323d9490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:13.952 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:13.948+0000 7f0d66a00640 1 -- 172.21.15.50:0/2129301203 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5571320174d0 msgr2=0x5571323d8f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:37:13.952 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:13.948+0000 7f0d66a00640 1 --2- 172.21.15.50:0/2129301203 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5571320174d0 0x5571323d8f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:13.952 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:13.948+0000 7f0d66a00640 1 -- 172.21.15.50:0/2129301203 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5571323e6ff0 con 0x55713200f2f0 2024-08-31T04:37:13.952 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:13.948+0000 7f0d5e000640 1 --2- 172.21.15.50:0/2129301203 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5571320174d0 0x5571323d8f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:37:13.953 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:13.949+0000 7f0d66a00640 1 --2- 172.21.15.50:0/2129301203 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55713200f2f0 0x5571323e27c0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f0d580092e0 tx=0x7f0d580097a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8e2919ab200649cb server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:37:13.953 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:13.949+0000 7f0d57400640 1 -- 172.21.15.50:0/2129301203 <== mon.2 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d58039070 con 0x55713200f2f0 2024-08-31T04:37:13.956 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:13.949+0000 7f0d57400640 1 -- 172.21.15.50:0/2129301203 <== mon.2 v2:172.21.15.133:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0d5801eca0 con 0x55713200f2f0 2024-08-31T04:37:13.957 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:13.949+0000 7f0d57400640 1 -- 172.21.15.50:0/2129301203 <== mon.2 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d580343d0 con 0x55713200f2f0 2024-08-31T04:37:13.957 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:13.950+0000 7f0d749c0740 1 -- 172.21.15.50:0/2129301203 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55713200f2f0 msgr2=0x5571323e27c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:37:13.957 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:13.950+0000 7f0d749c0740 1 --2- 172.21.15.50:0/2129301203 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55713200f2f0 0x5571323e27c0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f0d580092e0 tx=0x7f0d580097a0 comp rx=0 tx=0).stop 2024-08-31T04:37:13.957 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:13.950+0000 7f0d749c0740 1 -- 172.21.15.50:0/2129301203 shutdown_connections 2024-08-31T04:37:13.957 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:13.950+0000 7f0d749c0740 1 --2- 172.21.15.50:0/2129301203 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5571320381b0 0x5571323d9490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:13.957 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:13.950+0000 7f0d749c0740 1 --2- 172.21.15.50:0/2129301203 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5571320174d0 0x5571323d8f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:13.957 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:13.950+0000 7f0d749c0740 1 --2- 172.21.15.50:0/2129301203 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55713200f2f0 0x5571323e27c0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:13.957 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:13.950+0000 7f0d749c0740 1 -- 172.21.15.50:0/2129301203 >> 172.21.15.50:0/2129301203 conn(0x55713202c300 msgr2=0x5571323e20b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:37:13.957 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:13.950+0000 7f0d749c0740 1 -- 172.21.15.50:0/2129301203 shutdown_connections 2024-08-31T04:37:13.957 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:13.950+0000 7f0d749c0740 1 -- 172.21.15.50:0/2129301203 wait complete. 2024-08-31T04:37:13.957 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:13.950+0000 7f0d749c0740 1 -- start start 2024-08-31T04:37:13.958 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:13.950+0000 7f0d749c0740 1 Processor -- start 2024-08-31T04:37:13.958 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:13.951+0000 7f0d749c0740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55713200f2f0 0x5571323ee670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:37:13.958 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:13.951+0000 7f0d749c0740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5571320174d0 0x5571323eebb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:37:13.958 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:13.951+0000 7f0d749c0740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5571320381b0 0x5571323ef0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:37:13.958 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:13.951+0000 7f0d749c0740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f0d681ac1c0 con 0x5571320381b0 2024-08-31T04:37:13.958 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:13.951+0000 7f0d749c0740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f0d681aba30 con 0x5571320174d0 2024-08-31T04:37:13.958 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:13.951+0000 7f0d749c0740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f0d681a8af0 con 0x55713200f2f0 2024-08-31T04:37:13.958 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:13.951+0000 7f0d749c0740 10 client.0 _ll_register_callbacks cb 0x7f0d5800fa40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:37:13.958 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:13.951+0000 7f0d5e000640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5571320174d0 0x5571323eebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:37:13.958 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:13.951+0000 7f0d66a00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55713200f2f0 0x5571323ee670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:37:13.958 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:13.951+0000 7f0d5e000640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5571320174d0 0x5571323eebb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.50:41624/0 (socket says 172.21.15.50:41624) 2024-08-31T04:37:13.958 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:13.951+0000 7f0d5e000640 1 -- 172.21.15.50:0/2215937287 learned_addr learned my addr 172.21.15.50:0/2215937287 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:37:13.958 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:13.951+0000 7f0d67400640 1 --2- 172.21.15.50:0/2215937287 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5571320381b0 0x5571323ef0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:37:13.959 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:13.951+0000 7f0d5e000640 1 -- 172.21.15.50:0/2215937287 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55713200f2f0 msgr2=0x5571323ee670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:37:13.959 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:13.951+0000 7f0d5e000640 1 --2- 172.21.15.50:0/2215937287 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55713200f2f0 0x5571323ee670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:13.959 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:13.951+0000 7f0d5e000640 1 -- 172.21.15.50:0/2215937287 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5571320381b0 msgr2=0x5571323ef0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:37:13.959 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:13.952+0000 7f0d5e000640 1 --2- 172.21.15.50:0/2215937287 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5571320381b0 0x5571323ef0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:13.959 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:13.952+0000 7f0d5e000640 1 -- 172.21.15.50:0/2215937287 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5571323ed4a0 con 0x5571320174d0 2024-08-31T04:37:13.959 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:13.952+0000 7f0d66a00640 1 --2- 172.21.15.50:0/2215937287 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55713200f2f0 0x5571323ee670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:37:13.959 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:13.952+0000 7f0d5e000640 1 --2- 172.21.15.50:0/2215937287 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5571320174d0 0x5571323eebb0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f0d501027f0 tx=0x7f0d50004500 comp rx=0 tx=0).ready entity=mon.2 client_cookie=791382dffb9e3930 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:37:13.959 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:13.952+0000 7f0d54c00640 10 client.0 ms_handle_connect on v2:172.21.15.133:3300/0 2024-08-31T04:37:13.959 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:13.952+0000 7f0d54c00640 1 -- 172.21.15.50:0/2215937287 <== mon.2 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d500cbe20 con 0x5571320174d0 2024-08-31T04:37:13.959 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:13.952+0000 7f0d749c0740 1 -- 172.21.15.50:0/2215937287 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0d5801eca0 con 0x5571320174d0 2024-08-31T04:37:13.959 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:13.952+0000 7f0d54c00640 1 -- 172.21.15.50:0/2215937287 <== mon.2 v2:172.21.15.133:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8219+0+0 (secure 0 0 0) 0x7f0d50004160 con 0x5571320174d0 2024-08-31T04:37:13.959 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:13.952+0000 7f0d54c00640 1 -- 172.21.15.50:0/2215937287 <== mon.2 v2:172.21.15.133:3300/0 3 ==== mon_get_version_reply(handle=1 version=71) ==== 24+0+0 (secure 0 0 0) 0x7f0d500cb720 con 0x5571320174d0 2024-08-31T04:37:13.959 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:13.952+0000 7f0d749c0740 10 client.26651 fetch_fsmap learned FSMap version 71 2024-08-31T04:37:13.960 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:13.952+0000 7f0d749c0740 1 -- 172.21.15.50:0/2215937287 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,fsmap=71,monmap=4+}) -- 0x55713245ff20 con 0x5571320174d0 2024-08-31T04:37:13.960 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:13.952+0000 7f0d54c00640 1 -- 172.21.15.50:0/2215937287 <== mon.2 v2:172.21.15.133:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0d5801eca0 con 0x5571320174d0 2024-08-31T04:37:13.960 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:13.953+0000 7f0d54c00640 1 -- 172.21.15.50:0/2215937287 <== mon.2 v2:172.21.15.133:3300/0 5 ==== fsmap(e 71) ==== 8442+0+0 (secure 0 0 0) 0x7f0d5004d060 con 0x5571320174d0 2024-08-31T04:37:13.960 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:13.953+0000 7f0d749c0740 10 client.26651 fetch_fsmap finished waiting for FSMap version 71 2024-08-31T04:37:13.960 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:13.953+0000 7f0d749c0740 10 client.26651 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T04:37:13.960 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:13.953+0000 7f0d749c0740 20 client.26651 populate_metadata read hostname 'smithi050' 2024-08-31T04:37:13.960 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:13.953+0000 7f0d749c0740 1 --2- 172.21.15.50:0/2215937287 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x557131fcc1c0 0x557132462900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:37:13.960 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:13.953+0000 7f0d749c0740 4 client.26651 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-31T04:37:13.960 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:13.953+0000 7f0d749c0740 1 -- 172.21.15.50:0/2215937287 --> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55713234e960 con 0x557131fcc1c0 2024-08-31T04:37:13.960 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:13.953+0000 7f0d66a00640 1 --2- 172.21.15.50:0/2215937287 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x557131fcc1c0 0x557132462900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:37:13.960 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:13.954+0000 7f0d66a00640 1 --2- 172.21.15.50:0/2215937287 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x557131fcc1c0 0x557132462900 crc :-1 s=READY pgs=174 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9f3243d6bd410ffd server_cookie=f3833ced0c20af6d in_seq=0 out_seq=0 2024-08-31T04:37:13.960 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:13.954+0000 7f0d54c00640 10 client.26651 ms_handle_connect on v2:172.21.15.133:6838/2526402262 2024-08-31T04:37:13.970 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:13.967+0000 7f0d54c00640 1 -- 172.21.15.50:0/2215937287 <== mds.0 v2:172.21.15.133:6838/2526402262 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55713234e960 con 0x557131fcc1c0 2024-08-31T04:37:13.970 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:13.967+0000 7f0d54c00640 10 client.26651 handle_command_reply: tid=0 2024-08-31T04:37:13.970 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:13.967+0000 7f0d749c0740 1 client.26651 shutdown 2024-08-31T04:37:13.970 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:13.967+0000 7f0d749c0740 1 -- 172.21.15.50:0/2215937287 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5571320174d0 msgr2=0x5571323eebb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:37:13.971 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:13.967+0000 7f0d749c0740 1 --2- 172.21.15.50:0/2215937287 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5571320174d0 0x5571323eebb0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f0d501027f0 tx=0x7f0d50004500 comp rx=0 tx=0).stop 2024-08-31T04:37:13.971 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:13.968+0000 7f0d749c0740 1 -- 172.21.15.50:0/2215937287 shutdown_connections 2024-08-31T04:37:13.971 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:13.968+0000 7f0d749c0740 1 --2- 172.21.15.50:0/2215937287 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x557131fcc1c0 0x557132462900 crc :-1 s=READY pgs=174 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:13.971 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:13.968+0000 7f0d749c0740 1 --2- 172.21.15.50:0/2215937287 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5571320381b0 0x5571323ef0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:13.971 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:13.968+0000 7f0d749c0740 1 --2- 172.21.15.50:0/2215937287 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5571320174d0 0x5571323eebb0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:13.971 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:13.968+0000 7f0d749c0740 1 --2- 172.21.15.50:0/2215937287 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55713200f2f0 0x5571323ee670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:13.971 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:13.968+0000 7f0d54c00640 0 client.26651 ms_handle_reset on v2:172.21.15.133:6838/2526402262 2024-08-31T04:37:13.971 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:13.968+0000 7f0d749c0740 1 -- 172.21.15.50:0/2215937287 >> 172.21.15.50:0/2215937287 conn(0x55713202c300 msgr2=0x5571323d7f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:37:13.971 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:13.968+0000 7f0d749c0740 1 -- 172.21.15.50:0/2215937287 shutdown_connections 2024-08-31T04:37:13.972 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:13.968+0000 7f0d749c0740 1 -- 172.21.15.50:0/2215937287 wait complete. 2024-08-31T04:37:13.972 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:13.968+0000 7f0d749c0740 20 client.26651 trim_cache size 0 max 16384 2024-08-31T04:37:13.972 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout:{ 2024-08-31T04:37:13.972 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout: "message": "", 2024-08-31T04:37:13.972 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout: "return_code": 0 2024-08-31T04:37:13.972 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout:} 2024-08-31T04:37:13.973 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:13.969+0000 7f0d67e00640 1 -- 172.21.15.50:0/112183391 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f0d4c0b4b30 msgr2=0x7f0d4c0b7040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:37:13.973 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:13.969+0000 7f0d67e00640 1 --2- 172.21.15.50:0/112183391 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f0d4c0b4b30 0x7f0d4c0b7040 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f0d58009640 tx=0x7f0d58005f90 comp rx=0 tx=0).stop 2024-08-31T04:37:13.973 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:13.969+0000 7f0d67e00640 1 -- 172.21.15.50:0/112183391 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0d68104300 msgr2=0x7f0d6819a180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:37:13.973 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:13.969+0000 7f0d67e00640 1 --2- 172.21.15.50:0/112183391 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0d68104300 0x7f0d6819a180 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f0d5002a860 tx=0x7f0d50032d50 comp rx=0 tx=0).stop 2024-08-31T04:37:13.973 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:13.969+0000 7f0d67e00640 1 -- 172.21.15.50:0/112183391 shutdown_connections 2024-08-31T04:37:13.974 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:13.969+0000 7f0d67e00640 1 --2- 172.21.15.50:0/112183391 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f0d4c0b4b30 0x7f0d4c0b7040 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:13.974 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:13.969+0000 7f0d67e00640 1 --2- 172.21.15.50:0/112183391 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0d68104300 0x7f0d6819a180 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:13.974 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:13.969+0000 7f0d67e00640 1 --2- 172.21.15.50:0/112183391 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0d68104ca0 0x7f0d6819ad30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:13.974 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:13.969+0000 7f0d67e00640 1 --2- 172.21.15.50:0/112183391 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0d68103280 0x7f0d68199b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:13.974 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:13.969+0000 7f0d67e00640 1 -- 172.21.15.50:0/112183391 >> 172.21.15.50:0/112183391 conn(0x7f0d680febc0 msgr2=0x7f0d68107620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:37:13.974 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:13.969+0000 7f0d67e00640 1 -- 172.21.15.50:0/112183391 shutdown_connections 2024-08-31T04:37:13.974 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:13.969+0000 7f0d67e00640 1 -- 172.21.15.50:0/112183391 wait complete. 2024-08-31T04:37:15.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:37:15 smithi050 ceph-mon[17259]: pgmap v799: 97 pgs: 97 active+clean; 947 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 829 KiB/s rd, 794 KiB/s wr, 386 op/s 2024-08-31T04:37:15.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:37:15 smithi177 ceph-mon[22025]: pgmap v799: 97 pgs: 97 active+clean; 947 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 829 KiB/s rd, 794 KiB/s wr, 386 op/s 2024-08-31T04:37:15.792 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:37:15 smithi133 ceph-mon[22177]: pgmap v799: 97 pgs: 97 active+clean; 947 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 829 KiB/s rd, 794 KiB/s wr, 386 op/s 2024-08-31T04:37:17.701 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:37:17 smithi050 ceph-mon[17259]: pgmap v800: 97 pgs: 97 active+clean; 945 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1003 KiB/s rd, 1004 KiB/s wr, 335 op/s 2024-08-31T04:37:17.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:37:17 smithi177 ceph-mon[22025]: pgmap v800: 97 pgs: 97 active+clean; 945 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1003 KiB/s rd, 1004 KiB/s wr, 335 op/s 2024-08-31T04:37:17.792 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:37:17 smithi133 ceph-mon[22177]: pgmap v800: 97 pgs: 97 active+clean; 945 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1003 KiB/s rd, 1004 KiB/s wr, 335 op/s 2024-08-31T04:37:19.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:37:19 smithi050 ceph-mon[17259]: pgmap v801: 97 pgs: 97 active+clean; 941 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 977 KiB/s rd, 888 KiB/s wr, 214 op/s 2024-08-31T04:37:19.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:37:19 smithi177 ceph-mon[22025]: pgmap v801: 97 pgs: 97 active+clean; 941 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 977 KiB/s rd, 888 KiB/s wr, 214 op/s 2024-08-31T04:37:19.792 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:37:19 smithi133 ceph-mon[22177]: pgmap v801: 97 pgs: 97 active+clean; 941 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 977 KiB/s rd, 888 KiB/s wr, 214 op/s 2024-08-31T04:37:21.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:37:21 smithi050 ceph-mon[17259]: pgmap v802: 97 pgs: 97 active+clean; 931 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 616 KiB/s rd, 585 KiB/s wr, 217 op/s 2024-08-31T04:37:21.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:37:21 smithi177 ceph-mon[22025]: pgmap v802: 97 pgs: 97 active+clean; 931 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 616 KiB/s rd, 585 KiB/s wr, 217 op/s 2024-08-31T04:37:21.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:37:21 smithi133 ceph-mon[22177]: pgmap v802: 97 pgs: 97 active+clean; 931 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 616 KiB/s rd, 585 KiB/s wr, 217 op/s 2024-08-31T04:37:23.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:37:23 smithi050 ceph-mon[17259]: pgmap v803: 97 pgs: 97 active+clean; 919 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 260 op/s 2024-08-31T04:37:23.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:37:23 smithi177 ceph-mon[22025]: pgmap v803: 97 pgs: 97 active+clean; 919 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 260 op/s 2024-08-31T04:37:23.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:37:23 smithi133 ceph-mon[22177]: pgmap v803: 97 pgs: 97 active+clean; 919 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 260 op/s 2024-08-31T04:37:25.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:37:25 smithi050 ceph-mon[17259]: pgmap v804: 97 pgs: 97 active+clean; 911 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 737 KiB/s rd, 734 KiB/s wr, 230 op/s 2024-08-31T04:37:25.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:37:25 smithi177 ceph-mon[22025]: pgmap v804: 97 pgs: 97 active+clean; 911 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 737 KiB/s rd, 734 KiB/s wr, 230 op/s 2024-08-31T04:37:25.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:37:25 smithi133 ceph-mon[22177]: pgmap v804: 97 pgs: 97 active+clean; 911 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 737 KiB/s rd, 734 KiB/s wr, 230 op/s 2024-08-31T04:37:27.181 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:27.180+0000 7f95c3e00640 1 -- 172.21.15.50:0/2776453998 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f95c4103290 msgr2=0x7f95c4103700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:37:27.182 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:27.180+0000 7f95c3e00640 1 --2- 172.21.15.50:0/2776453998 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f95c4103290 0x7f95c4103700 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f95b4009900 tx=0x7f95b402a3f0 comp rx=0 tx=0).stop 2024-08-31T04:37:27.182 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:27.180+0000 7f95c3e00640 1 -- 172.21.15.50:0/2776453998 shutdown_connections 2024-08-31T04:37:27.182 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:27.180+0000 7f95c3e00640 1 --2- 172.21.15.50:0/2776453998 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f95c4104310 0x7f95c4104720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:27.182 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:27.180+0000 7f95c3e00640 1 --2- 172.21.15.50:0/2776453998 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f95c4104cb0 0x7f95c410b650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:27.182 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:27.180+0000 7f95c3e00640 1 --2- 172.21.15.50:0/2776453998 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f95c4103290 0x7f95c4103700 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:27.182 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:27.180+0000 7f95c3e00640 1 -- 172.21.15.50:0/2776453998 >> 172.21.15.50:0/2776453998 conn(0x7f95c40febd0 msgr2=0x7f95c4101080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:37:27.182 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:27.180+0000 7f95c3e00640 1 -- 172.21.15.50:0/2776453998 shutdown_connections 2024-08-31T04:37:27.182 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:27.180+0000 7f95c3e00640 1 -- 172.21.15.50:0/2776453998 wait complete. 2024-08-31T04:37:27.184 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:27.181+0000 7f95c3e00640 1 Processor -- start 2024-08-31T04:37:27.185 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:27.181+0000 7f95c3e00640 1 -- start start 2024-08-31T04:37:27.185 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:27.182+0000 7f95c3e00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f95c4103290 0x7f95c4199b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:37:27.185 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:27.182+0000 7f95c3e00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f95c4104310 0x7f95c419a1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:37:27.185 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:27.182+0000 7f95c3e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f95c4104cb0 0x7f95c419ad70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:37:27.185 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:27.182+0000 7f95c3e00640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f95c410ef10 con 0x7f95c4104cb0 2024-08-31T04:37:27.185 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:27.182+0000 7f95c3e00640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f95c410ed90 con 0x7f95c4104310 2024-08-31T04:37:27.185 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:27.182+0000 7f95c3e00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f95c410f090 con 0x7f95c4103290 2024-08-31T04:37:27.185 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:27.182+0000 7f95c2a00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f95c4103290 0x7f95c4199b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:37:27.185 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:27.182+0000 7f95c2000640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f95c4104310 0x7f95c419a1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:37:27.185 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:27.182+0000 7f95c2a00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f95c4103290 0x7f95c4199b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.50:58140/0 (socket says 172.21.15.50:58140) 2024-08-31T04:37:27.185 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:27.182+0000 7f95c2a00640 1 -- 172.21.15.50:0/969937135 learned_addr learned my addr 172.21.15.50:0/969937135 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:37:27.186 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:27.182+0000 7f95c2000640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f95c4104310 0x7f95c419a1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.50:33906/0 (socket says 172.21.15.50:33906) 2024-08-31T04:37:27.186 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:27.182+0000 7f95c3400640 1 --2- 172.21.15.50:0/969937135 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f95c4104cb0 0x7f95c419ad70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:37:27.186 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:27.182+0000 7f95c2000640 1 -- 172.21.15.50:0/969937135 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f95c4103290 msgr2=0x7f95c4199b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:37:27.186 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:27.182+0000 7f95c2000640 1 --2- 172.21.15.50:0/969937135 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f95c4103290 0x7f95c4199b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:27.186 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:27.182+0000 7f95c2000640 1 -- 172.21.15.50:0/969937135 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f95c4104cb0 msgr2=0x7f95c419ad70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:37:27.186 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:27.182+0000 7f95c2000640 1 --2- 172.21.15.50:0/969937135 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f95c4104cb0 0x7f95c419ad70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:27.186 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:27.182+0000 7f95c2000640 1 -- 172.21.15.50:0/969937135 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95c419b590 con 0x7f95c4104310 2024-08-31T04:37:27.186 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:27.183+0000 7f95c2000640 1 --2- 172.21.15.50:0/969937135 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f95c4104310 0x7f95c419a1c0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f95b000e9f0 tx=0x7f95b000eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:37:27.186 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:27.183+0000 7f95bb400640 1 -- 172.21.15.50:0/969937135 <== mon.2 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95b000ccc0 con 0x7f95c4104310 2024-08-31T04:37:27.186 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:27.183+0000 7f95c3e00640 1 -- 172.21.15.50:0/969937135 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f95c419b880 con 0x7f95c4104310 2024-08-31T04:37:27.186 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:27.183+0000 7f95bb400640 1 -- 172.21.15.50:0/969937135 <== mon.2 v2:172.21.15.133:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f95b0005020 con 0x7f95c4104310 2024-08-31T04:37:27.186 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:27.183+0000 7f95bb400640 1 -- 172.21.15.50:0/969937135 <== mon.2 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95b0004a00 con 0x7f95c4104310 2024-08-31T04:37:27.186 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:27.183+0000 7f95c3e00640 1 -- 172.21.15.50:0/969937135 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f95c41a1f70 con 0x7f95c4104310 2024-08-31T04:37:27.187 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:27.186+0000 7f95d0c02740 1 Processor -- start 2024-08-31T04:37:27.187 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:27.186+0000 7f95d0c02740 1 -- start start 2024-08-31T04:37:27.188 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:27.186+0000 7f95d0c02740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55eb528871b0 0x55eb52c313b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:37:27.189 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:27.186+0000 7f95d0c02740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55eb5285e2f0 0x55eb52c31a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:37:27.189 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:27.186+0000 7f95d0c02740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55eb528664d0 0x55eb52c32570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:37:27.189 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:27.186+0000 7f95d0c02740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55eb52b9ff70 con 0x55eb528664d0 2024-08-31T04:37:27.189 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:27.186+0000 7f95d0c02740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x55eb52b8f500 con 0x55eb5285e2f0 2024-08-31T04:37:27.189 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:27.186+0000 7f95d0c02740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x55eb52b934b0 con 0x55eb528871b0 2024-08-31T04:37:27.189 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:27.187+0000 7f95c3400640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55eb528871b0 0x55eb52c313b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:37:27.189 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:27.187+0000 7f95c3400640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55eb528871b0 0x55eb52c313b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.50:58154/0 (socket says 172.21.15.50:58154) 2024-08-31T04:37:27.189 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:27.187+0000 7f95c3400640 1 -- 172.21.15.50:0/249571603 learned_addr learned my addr 172.21.15.50:0/249571603 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:37:27.189 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:27.187+0000 7f95c2a00640 1 --2- 172.21.15.50:0/249571603 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55eb5285e2f0 0x55eb52c31a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:37:27.189 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:27.187+0000 7f95bb400640 1 -- 172.21.15.50:0/969937135 <== mon.2 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 18) ==== 152577+0+0 (secure 0 0 0) 0x7f95b0004ba0 con 0x7f95c4104310 2024-08-31T04:37:27.190 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:27.187+0000 7f95c3400640 1 -- 172.21.15.50:0/249571603 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55eb5285e2f0 msgr2=0x55eb52c31a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:37:27.190 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:27.187+0000 7f95c3400640 1 --2- 172.21.15.50:0/249571603 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55eb5285e2f0 0x55eb52c31a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:27.190 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:27.187+0000 7f95c3400640 1 -- 172.21.15.50:0/249571603 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55eb528664d0 msgr2=0x55eb52c32570 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-31T04:37:27.190 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:27.187+0000 7f95c3400640 1 --2- 172.21.15.50:0/249571603 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55eb528664d0 0x55eb52c32570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:27.190 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:27.187+0000 7f95c3400640 1 -- 172.21.15.50:0/249571603 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eb52b49c10 con 0x55eb528871b0 2024-08-31T04:37:27.190 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:27.187+0000 7f95c3400640 1 --2- 172.21.15.50:0/249571603 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55eb528871b0 0x55eb52c313b0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f95bc009fd0 tx=0x7f95bc0118d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4d1903f71643e014 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:37:27.194 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:27.188+0000 7f95afe00640 1 -- 172.21.15.50:0/249571603 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95bc004d20 con 0x55eb528871b0 2024-08-31T04:37:27.194 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:27.188+0000 7f95afe00640 1 -- 172.21.15.50:0/249571603 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f95bc004050 con 0x55eb528871b0 2024-08-31T04:37:27.194 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:27.188+0000 7f95afe00640 1 -- 172.21.15.50:0/249571603 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95bc005280 con 0x55eb528871b0 2024-08-31T04:37:27.194 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:27.188+0000 7f95d0c02740 1 -- 172.21.15.50:0/249571603 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55eb528871b0 msgr2=0x55eb52c313b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:37:27.194 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:27.188+0000 7f95d0c02740 1 --2- 172.21.15.50:0/249571603 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55eb528871b0 0x55eb52c313b0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f95bc009fd0 tx=0x7f95bc0118d0 comp rx=0 tx=0).stop 2024-08-31T04:37:27.194 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:27.189+0000 7f95d0c02740 1 -- 172.21.15.50:0/249571603 shutdown_connections 2024-08-31T04:37:27.194 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:27.189+0000 7f95d0c02740 1 --2- 172.21.15.50:0/249571603 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55eb528664d0 0x55eb52c32570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:27.194 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:27.189+0000 7f95d0c02740 1 --2- 172.21.15.50:0/249571603 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55eb5285e2f0 0x55eb52c31a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:27.194 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:27.189+0000 7f95d0c02740 1 --2- 172.21.15.50:0/249571603 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55eb528871b0 0x55eb52c313b0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:27.195 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:27.189+0000 7f95d0c02740 1 -- 172.21.15.50:0/249571603 >> 172.21.15.50:0/249571603 conn(0x55eb5287b300 msgr2=0x55eb52c28a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:37:27.195 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:27.189+0000 7f95bb400640 1 --2- 172.21.15.50:0/969937135 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f95a80b4bb0 0x7f95a80b70c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:37:27.195 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:27.189+0000 7f95d0c02740 1 -- 172.21.15.50:0/249571603 shutdown_connections 2024-08-31T04:37:27.195 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:27.189+0000 7f95d0c02740 1 -- 172.21.15.50:0/249571603 wait complete. 2024-08-31T04:37:27.195 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:27.189+0000 7f95bb400640 1 -- 172.21.15.50:0/969937135 <== mon.2 v2:172.21.15.133:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8219+0+0 (secure 0 0 0) 0x7f95b00e5060 con 0x7f95c4104310 2024-08-31T04:37:27.195 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:27.189+0000 7f95c2a00640 1 --2- 172.21.15.50:0/969937135 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f95a80b4bb0 0x7f95a80b70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:37:27.195 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:27.189+0000 7f95d0c02740 1 -- start start 2024-08-31T04:37:27.195 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:27.190+0000 7f95c2a00640 1 --2- 172.21.15.50:0/969937135 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f95a80b4bb0 0x7f95a80b70c0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f95b40096c0 tx=0x7f95b40314a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:37:27.195 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:27.190+0000 7f95d0c02740 1 Processor -- start 2024-08-31T04:37:27.195 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:27.190+0000 7f95d0c02740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55eb5285e2f0 0x55eb52c3aae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:37:27.195 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:27.190+0000 7f95d0c02740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55eb528664d0 0x55eb52c3b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:37:27.195 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:27.190+0000 7f95d0c02740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55eb528871b0 0x55eb52c3bd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:37:27.195 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:27.190+0000 7f95d0c02740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55eb52ac8ab0 con 0x55eb5285e2f0 2024-08-31T04:37:27.196 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:27.190+0000 7f95d0c02740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x55eb52b36320 con 0x55eb528871b0 2024-08-31T04:37:27.196 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:27.190+0000 7f95d0c02740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x55eb52c33090 con 0x55eb528664d0 2024-08-31T04:37:27.196 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:27.190+0000 7f95d0c02740 10 client.0 _ll_register_callbacks cb 0x55eb52b3c6a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:37:27.196 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:27.190+0000 7f95c2000640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55eb528664d0 0x55eb52c3b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:37:27.196 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:27.190+0000 7f95c2a00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55eb5285e2f0 0x55eb52c3aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:37:27.196 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:27.190+0000 7f95c2a00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55eb5285e2f0 0x55eb52c3aae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:51014/0 (socket says 172.21.15.50:51014) 2024-08-31T04:37:27.196 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:27.190+0000 7f95c2a00640 1 -- 172.21.15.50:0/2017545223 learned_addr learned my addr 172.21.15.50:0/2017545223 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:37:27.196 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:27.190+0000 7f95c2000640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55eb528664d0 0x55eb52c3b1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.50:58158/0 (socket says 172.21.15.50:58158) 2024-08-31T04:37:27.196 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:27.191+0000 7f95c3400640 1 --2- 172.21.15.50:0/2017545223 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55eb528871b0 0x55eb52c3bd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:37:27.196 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:27.191+0000 7f95c2000640 1 -- 172.21.15.50:0/2017545223 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55eb528871b0 msgr2=0x55eb52c3bd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:37:27.196 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:27.191+0000 7f95c2000640 1 --2- 172.21.15.50:0/2017545223 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55eb528871b0 0x55eb52c3bd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:27.197 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:27.191+0000 7f95c2000640 1 -- 172.21.15.50:0/2017545223 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55eb5285e2f0 msgr2=0x55eb52c3aae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:37:27.197 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:27.191+0000 7f95c2000640 1 --2- 172.21.15.50:0/2017545223 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55eb5285e2f0 0x55eb52c3aae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:27.197 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:27.191+0000 7f95c2000640 1 -- 172.21.15.50:0/2017545223 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55eb528f2790 con 0x55eb528664d0 2024-08-31T04:37:27.197 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:27.191+0000 7f95c2000640 1 --2- 172.21.15.50:0/2017545223 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55eb528664d0 0x55eb52c3b1a0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f95b00e2ee0 tx=0x7f95b00ab210 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6b198737859432a5 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:37:27.197 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:27.191+0000 7f95acc00640 10 client.0 ms_handle_connect on v2:172.21.15.177:3300/0 2024-08-31T04:37:27.197 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:27.191+0000 7f95acc00640 1 -- 172.21.15.50:0/2017545223 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95b00b0070 con 0x55eb528664d0 2024-08-31T04:37:27.197 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:27.191+0000 7f95d0c02740 1 -- 172.21.15.50:0/2017545223 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f95bc004050 con 0x55eb528664d0 2024-08-31T04:37:27.197 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:27.191+0000 7f95acc00640 1 -- 172.21.15.50:0/2017545223 <== mon.1 v2:172.21.15.177:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8219+0+0 (secure 0 0 0) 0x7f95b00054f0 con 0x55eb528664d0 2024-08-31T04:37:27.197 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:27.192+0000 7f95acc00640 1 -- 172.21.15.50:0/2017545223 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_get_version_reply(handle=1 version=71) ==== 24+0+0 (secure 0 0 0) 0x7f95b00ac1a0 con 0x55eb528664d0 2024-08-31T04:37:27.197 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:27.192+0000 7f95d0c02740 10 client.26644 fetch_fsmap learned FSMap version 71 2024-08-31T04:37:27.197 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:27.192+0000 7f95d0c02740 1 -- 172.21.15.50:0/2017545223 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,fsmap=71,monmap=4+}) -- 0x55eb5296b620 con 0x55eb528664d0 2024-08-31T04:37:27.197 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:27.192+0000 7f95acc00640 1 -- 172.21.15.50:0/2017545223 <== mon.1 v2:172.21.15.177:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f95bc004050 con 0x55eb528664d0 2024-08-31T04:37:27.197 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:27.192+0000 7f95acc00640 1 -- 172.21.15.50:0/2017545223 <== mon.1 v2:172.21.15.177:3300/0 5 ==== fsmap(e 71) ==== 8442+0+0 (secure 0 0 0) 0x7f95b00e70f0 con 0x55eb528664d0 2024-08-31T04:37:27.197 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:27.192+0000 7f95d0c02740 10 client.26644 fetch_fsmap finished waiting for FSMap version 71 2024-08-31T04:37:27.198 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:27.192+0000 7f95d0c02740 10 client.26644 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T04:37:27.198 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:27.192+0000 7f95d0c02740 20 client.26644 populate_metadata read hostname 'smithi050' 2024-08-31T04:37:27.198 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:27.192+0000 7f95d0c02740 1 --2- 172.21.15.50:0/2017545223 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x55eb52845d80 0x55eb52c48250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:37:27.198 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:27.192+0000 7f95d0c02740 4 client.26644 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T04:37:27.198 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:27.192+0000 7f95d0c02740 1 -- 172.21.15.50:0/2017545223 --> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55eb52ba1ec0 con 0x55eb52845d80 2024-08-31T04:37:27.198 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:27.193+0000 7f95c2a00640 1 --2- 172.21.15.50:0/2017545223 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x55eb52845d80 0x55eb52c48250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:37:27.199 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:27.193+0000 7f95c2a00640 1 --2- 172.21.15.50:0/2017545223 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x55eb52845d80 0x55eb52c48250 crc :-1 s=READY pgs=175 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3af29f9131ca5453 server_cookie=4f5d1a5e956952d2 in_seq=0 out_seq=0 2024-08-31T04:37:27.199 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:27.193+0000 7f95acc00640 10 client.26644 ms_handle_connect on v2:172.21.15.133:6838/2526402262 2024-08-31T04:37:27.199 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:27.194+0000 7f95acc00640 1 -- 172.21.15.50:0/2017545223 <== mds.0 v2:172.21.15.133:6838/2526402262 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55eb52ba1ec0 con 0x55eb52845d80 2024-08-31T04:37:27.199 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:27.194+0000 7f95acc00640 10 client.26644 handle_command_reply: tid=0 2024-08-31T04:37:27.199 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:27.194+0000 7f95d0c02740 1 client.26644 shutdown 2024-08-31T04:37:27.200 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:27.194+0000 7f95d0c02740 1 -- 172.21.15.50:0/2017545223 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55eb528664d0 msgr2=0x55eb52c3b1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:37:27.200 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:27.194+0000 7f95d0c02740 1 --2- 172.21.15.50:0/2017545223 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55eb528664d0 0x55eb52c3b1a0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f95b00e2ee0 tx=0x7f95b00ab210 comp rx=0 tx=0).stop 2024-08-31T04:37:27.200 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:27.194+0000 7f95d0c02740 1 -- 172.21.15.50:0/2017545223 shutdown_connections 2024-08-31T04:37:27.200 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:27.194+0000 7f95d0c02740 1 --2- 172.21.15.50:0/2017545223 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x55eb52845d80 0x55eb52c48250 crc :-1 s=READY pgs=175 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:27.200 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:27.194+0000 7f95d0c02740 1 --2- 172.21.15.50:0/2017545223 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55eb528664d0 0x55eb52c3b1a0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:27.200 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:27.194+0000 7f95acc00640 0 client.26644 ms_handle_reset on v2:172.21.15.133:6838/2526402262 2024-08-31T04:37:27.200 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:27.194+0000 7f95d0c02740 1 --2- 172.21.15.50:0/2017545223 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55eb528871b0 0x55eb52c3bd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:27.200 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:27.194+0000 7f95d0c02740 1 --2- 172.21.15.50:0/2017545223 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55eb5285e2f0 0x55eb52c3aae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:27.200 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:27.194+0000 7f95d0c02740 1 -- 172.21.15.50:0/2017545223 >> 172.21.15.50:0/2017545223 conn(0x55eb5287b300 msgr2=0x55eb52c26f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:37:27.200 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:27.194+0000 7f95d0c02740 1 -- 172.21.15.50:0/2017545223 shutdown_connections 2024-08-31T04:37:27.200 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:27.194+0000 7f95d0c02740 1 -- 172.21.15.50:0/2017545223 wait complete. 2024-08-31T04:37:27.200 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:27.194+0000 7f95d0c02740 20 client.26644 trim_cache size 0 max 16384 2024-08-31T04:37:27.211 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:27.210+0000 7f95d0c02740 1 Processor -- start 2024-08-31T04:37:27.211 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:27.210+0000 7f95d0c02740 1 -- start start 2024-08-31T04:37:27.212 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:27.210+0000 7f95d0c02740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55eb5285e2f0 0x55eb52c39700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:37:27.212 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:27.210+0000 7f95d0c02740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55eb528664d0 0x55eb52c42bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:37:27.212 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:27.210+0000 7f95d0c02740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55eb528871b0 0x55eb52c31350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:37:27.212 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:27.210+0000 7f95d0c02740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f95c41a88b0 con 0x55eb5285e2f0 2024-08-31T04:37:27.212 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:27.210+0000 7f95d0c02740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f95c41aa630 con 0x55eb528871b0 2024-08-31T04:37:27.212 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:27.210+0000 7f95d0c02740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f95c41a9040 con 0x55eb528664d0 2024-08-31T04:37:27.212 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:27.210+0000 7f95c2a00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55eb5285e2f0 0x55eb52c39700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:37:27.212 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:27.210+0000 7f95c2a00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55eb5285e2f0 0x55eb52c39700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:51028/0 (socket says 172.21.15.50:51028) 2024-08-31T04:37:27.212 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:27.210+0000 7f95c2a00640 1 -- 172.21.15.50:0/4152987130 learned_addr learned my addr 172.21.15.50:0/4152987130 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:37:27.213 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:27.211+0000 7f95c3400640 1 --2- 172.21.15.50:0/4152987130 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55eb528871b0 0x55eb52c31350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:37:27.213 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:27.211+0000 7f95c2a00640 1 -- 172.21.15.50:0/4152987130 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55eb528664d0 msgr2=0x55eb52c42bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:37:27.214 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:27.211+0000 7f95c2a00640 1 --2- 172.21.15.50:0/4152987130 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55eb528664d0 0x55eb52c42bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:27.214 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:27.211+0000 7f95c2a00640 1 -- 172.21.15.50:0/4152987130 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55eb528871b0 msgr2=0x55eb52c31350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:37:27.214 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:27.211+0000 7f95c2a00640 1 --2- 172.21.15.50:0/4152987130 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55eb528871b0 0x55eb52c31350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:27.214 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:27.211+0000 7f95c2a00640 1 -- 172.21.15.50:0/4152987130 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eb52c38c70 con 0x55eb5285e2f0 2024-08-31T04:37:27.214 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:27.211+0000 7f95c2a00640 1 --2- 172.21.15.50:0/4152987130 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55eb5285e2f0 0x55eb52c39700 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f95b4031a50 tx=0x7f95b4040000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a16777b81a2e75f0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:37:27.214 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:27.211+0000 7f95af400640 1 -- 172.21.15.50:0/4152987130 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95b4035040 con 0x55eb5285e2f0 2024-08-31T04:37:27.214 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:27.212+0000 7f95af400640 1 -- 172.21.15.50:0/4152987130 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f95b4004490 con 0x55eb5285e2f0 2024-08-31T04:37:27.214 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:27.212+0000 7f95af400640 1 -- 172.21.15.50:0/4152987130 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95b403d450 con 0x55eb5285e2f0 2024-08-31T04:37:27.214 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:27.212+0000 7f95d0c02740 1 -- 172.21.15.50:0/4152987130 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55eb5285e2f0 msgr2=0x55eb52c39700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:37:27.214 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:27.212+0000 7f95d0c02740 1 --2- 172.21.15.50:0/4152987130 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55eb5285e2f0 0x55eb52c39700 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f95b4031a50 tx=0x7f95b4040000 comp rx=0 tx=0).stop 2024-08-31T04:37:27.214 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:27.212+0000 7f95d0c02740 1 -- 172.21.15.50:0/4152987130 shutdown_connections 2024-08-31T04:37:27.214 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:27.212+0000 7f95d0c02740 1 --2- 172.21.15.50:0/4152987130 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55eb528664d0 0x55eb52c42bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:27.214 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:27.212+0000 7f95d0c02740 1 --2- 172.21.15.50:0/4152987130 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55eb528871b0 0x55eb52c31350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:27.214 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:27.212+0000 7f95d0c02740 1 --2- 172.21.15.50:0/4152987130 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55eb5285e2f0 0x55eb52c39700 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:27.215 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:27.212+0000 7f95d0c02740 1 -- 172.21.15.50:0/4152987130 >> 172.21.15.50:0/4152987130 conn(0x55eb5287b300 msgr2=0x55eb52c38ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:37:27.216 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:27.213+0000 7f95d0c02740 1 -- 172.21.15.50:0/4152987130 shutdown_connections 2024-08-31T04:37:27.216 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:27.213+0000 7f95d0c02740 1 -- 172.21.15.50:0/4152987130 wait complete. 2024-08-31T04:37:27.217 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:27.213+0000 7f95d0c02740 1 -- start start 2024-08-31T04:37:27.217 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:27.213+0000 7f95d0c02740 1 Processor -- start 2024-08-31T04:37:27.217 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:27.214+0000 7f95d0c02740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55eb5285e2f0 0x55eb52c41b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:37:27.217 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:27.214+0000 7f95d0c02740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55eb528664d0 0x55eb52c420a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:37:27.217 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:27.214+0000 7f95d0c02740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55eb528871b0 0x55eb52c40720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:37:27.217 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:27.214+0000 7f95d0c02740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f95c41a9f60 con 0x55eb528871b0 2024-08-31T04:37:27.217 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:27.214+0000 7f95d0c02740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f95c41a97d0 con 0x55eb528664d0 2024-08-31T04:37:27.217 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:27.214+0000 7f95d0c02740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f95c41a68b0 con 0x55eb5285e2f0 2024-08-31T04:37:27.217 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:27.214+0000 7f95d0c02740 10 client.0 _ll_register_callbacks cb 0x7f95b00ab870 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:37:27.218 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:27.214+0000 7f95c2a00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55eb5285e2f0 0x55eb52c41b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:37:27.218 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:27.214+0000 7f95c3400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55eb528871b0 0x55eb52c40720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:37:27.218 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:27.214+0000 7f95c2a00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55eb5285e2f0 0x55eb52c41b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.50:58168/0 (socket says 172.21.15.50:58168) 2024-08-31T04:37:27.218 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:27.214+0000 7f95c2a00640 1 -- 172.21.15.50:0/2413380358 learned_addr learned my addr 172.21.15.50:0/2413380358 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:37:27.218 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:27.214+0000 7f95c2000640 1 --2- 172.21.15.50:0/2413380358 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55eb528664d0 0x55eb52c420a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:37:27.218 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:27.214+0000 7f95c2a00640 1 -- 172.21.15.50:0/2413380358 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55eb528664d0 msgr2=0x55eb52c420a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:37:27.218 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:27.214+0000 7f95c2a00640 1 --2- 172.21.15.50:0/2413380358 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55eb528664d0 0x55eb52c420a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:27.218 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:27.214+0000 7f95c2a00640 1 -- 172.21.15.50:0/2413380358 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55eb528871b0 msgr2=0x55eb52c40720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:37:27.218 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:27.214+0000 7f95c2a00640 1 --2- 172.21.15.50:0/2413380358 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55eb528871b0 0x55eb52c40720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:27.218 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:27.214+0000 7f95c2a00640 1 -- 172.21.15.50:0/2413380358 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55eb52c428f0 con 0x55eb5285e2f0 2024-08-31T04:37:27.219 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:27.215+0000 7f95c2a00640 1 --2- 172.21.15.50:0/2413380358 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55eb5285e2f0 0x55eb52c41b60 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f95b40092a0 tx=0x7f95b4004160 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b68ae9c5d9caadab server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:37:27.219 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:27.215+0000 7f95acc00640 10 client.0 ms_handle_connect on v2:172.21.15.177:3300/0 2024-08-31T04:37:27.219 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:27.215+0000 7f95acc00640 1 -- 172.21.15.50:0/2413380358 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95b4061020 con 0x55eb5285e2f0 2024-08-31T04:37:27.219 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:27.215+0000 7f95acc00640 1 -- 172.21.15.50:0/2413380358 <== mon.1 v2:172.21.15.177:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8219+0+0 (secure 0 0 0) 0x7f95b4052430 con 0x55eb5285e2f0 2024-08-31T04:37:27.219 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:27.215+0000 7f95d0c02740 1 -- 172.21.15.50:0/2413380358 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f95b4004490 con 0x55eb5285e2f0 2024-08-31T04:37:27.219 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:27.215+0000 7f95acc00640 1 -- 172.21.15.50:0/2413380358 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_get_version_reply(handle=1 version=71) ==== 24+0+0 (secure 0 0 0) 0x7f95b4035070 con 0x55eb5285e2f0 2024-08-31T04:37:27.219 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:27.215+0000 7f95d0c02740 10 client.26647 fetch_fsmap learned FSMap version 71 2024-08-31T04:37:27.219 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:27.215+0000 7f95d0c02740 1 -- 172.21.15.50:0/2413380358 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,fsmap=71,monmap=4+}) -- 0x55eb52cb31d0 con 0x55eb5285e2f0 2024-08-31T04:37:27.219 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:27.215+0000 7f95acc00640 1 -- 172.21.15.50:0/2413380358 <== mon.1 v2:172.21.15.177:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f95b4004490 con 0x55eb5285e2f0 2024-08-31T04:37:27.220 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:27.216+0000 7f95acc00640 1 -- 172.21.15.50:0/2413380358 <== mon.1 v2:172.21.15.177:3300/0 5 ==== fsmap(e 71) ==== 8442+0+0 (secure 0 0 0) 0x7f95b4044040 con 0x55eb5285e2f0 2024-08-31T04:37:27.220 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:27.216+0000 7f95d0c02740 10 client.26647 fetch_fsmap finished waiting for FSMap version 71 2024-08-31T04:37:27.220 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:27.216+0000 7f95d0c02740 10 client.26647 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T04:37:27.220 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:27.216+0000 7f95d0c02740 20 client.26647 populate_metadata read hostname 'smithi050' 2024-08-31T04:37:27.220 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:27.216+0000 7f95d0c02740 1 --2- 172.21.15.50:0/2413380358 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x55eb5281b1c0 0x55eb52cb5cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:37:27.221 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:27.216+0000 7f95d0c02740 4 client.26647 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-31T04:37:27.221 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:27.216+0000 7f95d0c02740 1 -- 172.21.15.50:0/2413380358 --> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55eb52b9d960 con 0x55eb5281b1c0 2024-08-31T04:37:27.221 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:27.216+0000 7f95c2000640 1 --2- 172.21.15.50:0/2413380358 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x55eb5281b1c0 0x55eb52cb5cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:37:27.221 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:27.217+0000 7f95c2000640 1 --2- 172.21.15.50:0/2413380358 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x55eb5281b1c0 0x55eb52cb5cb0 crc :-1 s=READY pgs=176 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=83e85b2187cecf08 server_cookie=da9767d5a9e9f692 in_seq=0 out_seq=0 2024-08-31T04:37:27.221 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:27.217+0000 7f95acc00640 10 client.26647 ms_handle_connect on v2:172.21.15.133:6838/2526402262 2024-08-31T04:37:27.371 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:27.369+0000 7f95acc00640 1 -- 172.21.15.50:0/2413380358 <== mds.0 v2:172.21.15.133:6838/2526402262 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55eb52b9d960 con 0x55eb5281b1c0 2024-08-31T04:37:27.371 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:27.369+0000 7f95acc00640 10 client.26647 handle_command_reply: tid=0 2024-08-31T04:37:27.371 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:27.369+0000 7f95d0c02740 1 client.26647 shutdown 2024-08-31T04:37:27.371 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:27.369+0000 7f95d0c02740 1 -- 172.21.15.50:0/2413380358 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55eb5285e2f0 msgr2=0x55eb52c41b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:37:27.371 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:27.369+0000 7f95d0c02740 1 --2- 172.21.15.50:0/2413380358 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55eb5285e2f0 0x55eb52c41b60 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f95b40092a0 tx=0x7f95b4004160 comp rx=0 tx=0).stop 2024-08-31T04:37:27.371 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:27.369+0000 7f95d0c02740 1 -- 172.21.15.50:0/2413380358 shutdown_connections 2024-08-31T04:37:27.371 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:27.369+0000 7f95d0c02740 1 --2- 172.21.15.50:0/2413380358 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x55eb5281b1c0 0x55eb52cb5cb0 crc :-1 s=READY pgs=176 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:27.371 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:27.369+0000 7f95d0c02740 1 --2- 172.21.15.50:0/2413380358 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55eb528871b0 0x55eb52c40720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:27.371 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:27.369+0000 7f95d0c02740 1 --2- 172.21.15.50:0/2413380358 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55eb528664d0 0x55eb52c420a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:27.371 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:27.369+0000 7f95d0c02740 1 --2- 172.21.15.50:0/2413380358 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55eb5285e2f0 0x55eb52c41b60 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:27.372 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:27.369+0000 7f95acc00640 0 client.26647 ms_handle_reset on v2:172.21.15.133:6838/2526402262 2024-08-31T04:37:27.372 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:27.369+0000 7f95d0c02740 1 -- 172.21.15.50:0/2413380358 >> 172.21.15.50:0/2413380358 conn(0x55eb5287b300 msgr2=0x55eb52c39d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:37:27.372 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:27.369+0000 7f95d0c02740 1 -- 172.21.15.50:0/2413380358 shutdown_connections 2024-08-31T04:37:27.372 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:27.369+0000 7f95d0c02740 1 -- 172.21.15.50:0/2413380358 wait complete. 2024-08-31T04:37:27.372 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:27.369+0000 7f95d0c02740 20 client.26647 trim_cache size 0 max 16384 2024-08-31T04:37:27.372 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout:{ 2024-08-31T04:37:27.372 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout: "message": "", 2024-08-31T04:37:27.372 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout: "return_code": 0 2024-08-31T04:37:27.373 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout:} 2024-08-31T04:37:27.373 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:27.370+0000 7f95c3e00640 1 -- 172.21.15.50:0/969937135 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f95a80b4bb0 msgr2=0x7f95a80b70c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:37:27.373 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:27.370+0000 7f95c3e00640 1 --2- 172.21.15.50:0/969937135 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f95a80b4bb0 0x7f95a80b70c0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f95b40096c0 tx=0x7f95b40314a0 comp rx=0 tx=0).stop 2024-08-31T04:37:27.373 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:27.370+0000 7f95c3e00640 1 -- 172.21.15.50:0/969937135 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f95c4104310 msgr2=0x7f95c419a1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:37:27.374 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:27.370+0000 7f95c3e00640 1 --2- 172.21.15.50:0/969937135 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f95c4104310 0x7f95c419a1c0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f95b000e9f0 tx=0x7f95b000eeb0 comp rx=0 tx=0).stop 2024-08-31T04:37:27.374 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:27.370+0000 7f95c3e00640 1 -- 172.21.15.50:0/969937135 shutdown_connections 2024-08-31T04:37:27.374 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:27.370+0000 7f95c3e00640 1 --2- 172.21.15.50:0/969937135 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f95a80b4bb0 0x7f95a80b70c0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:27.374 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:27.370+0000 7f95c3e00640 1 --2- 172.21.15.50:0/969937135 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f95c4104cb0 0x7f95c419ad70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:27.374 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:27.370+0000 7f95c3e00640 1 --2- 172.21.15.50:0/969937135 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f95c4104310 0x7f95c419a1c0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:27.374 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:27.370+0000 7f95c3e00640 1 --2- 172.21.15.50:0/969937135 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f95c4103290 0x7f95c4199b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:27.374 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:27.370+0000 7f95c3e00640 1 -- 172.21.15.50:0/969937135 >> 172.21.15.50:0/969937135 conn(0x7f95c40febd0 msgr2=0x7f95c4107630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:37:27.374 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:27.370+0000 7f95c3e00640 1 -- 172.21.15.50:0/969937135 shutdown_connections 2024-08-31T04:37:27.374 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:27.370+0000 7f95c3e00640 1 -- 172.21.15.50:0/969937135 wait complete. 2024-08-31T04:37:27.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:37:27 smithi050 ceph-mon[17259]: pgmap v805: 97 pgs: 97 active+clean; 901 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 299 op/s 2024-08-31T04:37:27.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:37:27 smithi177 ceph-mon[22025]: pgmap v805: 97 pgs: 97 active+clean; 901 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 299 op/s 2024-08-31T04:37:27.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:37:27 smithi133 ceph-mon[22177]: pgmap v805: 97 pgs: 97 active+clean; 901 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 299 op/s 2024-08-31T04:37:29.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:37:29 smithi050 ceph-mon[17259]: pgmap v806: 97 pgs: 97 active+clean; 897 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.1 MiB/s wr, 307 op/s 2024-08-31T04:37:29.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:37:29 smithi177 ceph-mon[22025]: pgmap v806: 97 pgs: 97 active+clean; 897 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.1 MiB/s wr, 307 op/s 2024-08-31T04:37:29.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:37:29 smithi133 ceph-mon[22177]: pgmap v806: 97 pgs: 97 active+clean; 897 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.1 MiB/s wr, 307 op/s 2024-08-31T04:37:31.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:37:31 smithi050 ceph-mon[17259]: pgmap v807: 97 pgs: 97 active+clean; 885 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.1 MiB/s wr, 337 op/s 2024-08-31T04:37:31.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:37:31 smithi177 ceph-mon[22025]: pgmap v807: 97 pgs: 97 active+clean; 885 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.1 MiB/s wr, 337 op/s 2024-08-31T04:37:31.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:37:31 smithi133 ceph-mon[22177]: pgmap v807: 97 pgs: 97 active+clean; 885 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.1 MiB/s wr, 337 op/s 2024-08-31T04:37:33.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:37:33 smithi050 ceph-mon[17259]: pgmap v808: 97 pgs: 97 active+clean; 874 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 373 op/s 2024-08-31T04:37:33.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:37:33 smithi177 ceph-mon[22025]: pgmap v808: 97 pgs: 97 active+clean; 874 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 373 op/s 2024-08-31T04:37:33.792 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:37:33 smithi133 ceph-mon[22177]: pgmap v808: 97 pgs: 97 active+clean; 874 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 373 op/s 2024-08-31T04:37:35.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:37:35 smithi050 ceph-mon[17259]: pgmap v809: 97 pgs: 97 active+clean; 864 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 942 KiB/s rd, 1005 KiB/s wr, 328 op/s 2024-08-31T04:37:35.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:37:35 smithi177 ceph-mon[22025]: pgmap v809: 97 pgs: 97 active+clean; 864 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 942 KiB/s rd, 1005 KiB/s wr, 328 op/s 2024-08-31T04:37:35.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:37:35 smithi133 ceph-mon[22177]: pgmap v809: 97 pgs: 97 active+clean; 864 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 942 KiB/s rd, 1005 KiB/s wr, 328 op/s 2024-08-31T04:37:37.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:37:37 smithi050 ceph-mon[17259]: pgmap v810: 97 pgs: 97 active+clean; 850 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 386 op/s 2024-08-31T04:37:37.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:37:37 smithi177 ceph-mon[22025]: pgmap v810: 97 pgs: 97 active+clean; 850 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 386 op/s 2024-08-31T04:37:37.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:37:37 smithi133 ceph-mon[22177]: pgmap v810: 97 pgs: 97 active+clean; 850 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 386 op/s 2024-08-31T04:37:39.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:37:39 smithi050 ceph-mon[17259]: pgmap v811: 97 pgs: 97 active+clean; 843 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 341 op/s 2024-08-31T04:37:39.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:37:39 smithi177 ceph-mon[22025]: pgmap v811: 97 pgs: 97 active+clean; 843 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 341 op/s 2024-08-31T04:37:39.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:37:39 smithi133 ceph-mon[22177]: pgmap v811: 97 pgs: 97 active+clean; 843 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 341 op/s 2024-08-31T04:37:40.569 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:40.567+0000 7fbc37200640 1 -- 172.21.15.50:0/2821802318 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbc38103280 msgr2=0x7fbc381036f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:37:40.569 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:40.567+0000 7fbc37200640 1 --2- 172.21.15.50:0/2821802318 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbc38103280 0x7fbc381036f0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fbc28009900 tx=0x7fbc2802a3f0 comp rx=0 tx=0).stop 2024-08-31T04:37:40.569 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:40.567+0000 7fbc37200640 1 -- 172.21.15.50:0/2821802318 shutdown_connections 2024-08-31T04:37:40.569 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:40.567+0000 7fbc37200640 1 --2- 172.21.15.50:0/2821802318 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbc38104ca0 0x7fbc3810b640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:40.570 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:40.567+0000 7fbc37200640 1 --2- 172.21.15.50:0/2821802318 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbc38104300 0x7fbc38104710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:40.570 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:40.567+0000 7fbc37200640 1 --2- 172.21.15.50:0/2821802318 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbc38103280 0x7fbc381036f0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:40.570 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:40.567+0000 7fbc37200640 1 -- 172.21.15.50:0/2821802318 >> 172.21.15.50:0/2821802318 conn(0x7fbc380febc0 msgr2=0x7fbc38101070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:37:40.570 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:40.567+0000 7fbc37200640 1 -- 172.21.15.50:0/2821802318 shutdown_connections 2024-08-31T04:37:40.570 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:40.568+0000 7fbc37200640 1 -- 172.21.15.50:0/2821802318 wait complete. 2024-08-31T04:37:40.572 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:40.568+0000 7fbc37200640 1 Processor -- start 2024-08-31T04:37:40.572 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:40.569+0000 7fbc37200640 1 -- start start 2024-08-31T04:37:40.572 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:40.569+0000 7fbc37200640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbc38103280 0x7fbc38076b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:37:40.572 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:40.569+0000 7fbc37200640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbc38104300 0x7fbc380754b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:37:40.572 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:40.569+0000 7fbc37200640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbc38104ca0 0x7fbc380759f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:37:40.572 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:40.569+0000 7fbc37200640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fbc3810ef00 con 0x7fbc38104ca0 2024-08-31T04:37:40.572 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:40.569+0000 7fbc37200640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7fbc3810ed80 con 0x7fbc38103280 2024-08-31T04:37:40.572 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:40.569+0000 7fbc37200640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fbc3810f080 con 0x7fbc38104300 2024-08-31T04:37:40.572 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:40.569+0000 7fbc35400640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbc38104300 0x7fbc380754b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:37:40.573 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:40.569+0000 7fbc36800640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbc38104ca0 0x7fbc380759f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:37:40.573 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:40.569+0000 7fbc35400640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbc38104300 0x7fbc380754b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.50:43666/0 (socket says 172.21.15.50:43666) 2024-08-31T04:37:40.573 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:40.569+0000 7fbc35400640 1 -- 172.21.15.50:0/706525935 learned_addr learned my addr 172.21.15.50:0/706525935 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:37:40.573 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:40.570+0000 7fbc35e00640 1 --2- 172.21.15.50:0/706525935 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbc38103280 0x7fbc38076b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:37:40.573 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:40.570+0000 7fbc35400640 1 -- 172.21.15.50:0/706525935 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbc38103280 msgr2=0x7fbc38076b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:37:40.573 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:40.570+0000 7fbc35400640 1 --2- 172.21.15.50:0/706525935 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbc38103280 0x7fbc38076b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:40.573 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:40.570+0000 7fbc35400640 1 -- 172.21.15.50:0/706525935 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbc38104ca0 msgr2=0x7fbc380759f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:37:40.573 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:40.570+0000 7fbc35400640 1 --2- 172.21.15.50:0/706525935 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbc38104ca0 0x7fbc380759f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:40.573 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:40.570+0000 7fbc35400640 1 -- 172.21.15.50:0/706525935 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc38076090 con 0x7fbc38104300 2024-08-31T04:37:40.573 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:40.570+0000 7fbc36800640 1 --2- 172.21.15.50:0/706525935 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbc38104ca0 0x7fbc380759f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:37:40.573 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:40.570+0000 7fbc35400640 1 --2- 172.21.15.50:0/706525935 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbc38104300 0x7fbc380754b0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fbc2400d950 tx=0x7fbc2400dd50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:37:40.573 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:40.570+0000 7fbc2ea00640 1 -- 172.21.15.50:0/706525935 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc24017030 con 0x7fbc38104300 2024-08-31T04:37:40.573 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:40.570+0000 7fbc2ea00640 1 -- 172.21.15.50:0/706525935 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbc24004020 con 0x7fbc38104300 2024-08-31T04:37:40.574 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:40.570+0000 7fbc2ea00640 1 -- 172.21.15.50:0/706525935 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc24005560 con 0x7fbc38104300 2024-08-31T04:37:40.574 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:40.570+0000 7fbc37200640 1 -- 172.21.15.50:0/706525935 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbc381a3c00 con 0x7fbc38104300 2024-08-31T04:37:40.574 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:40.571+0000 7fbc37200640 1 -- 172.21.15.50:0/706525935 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbc381a4010 con 0x7fbc38104300 2024-08-31T04:37:40.575 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:40.573+0000 7fbc43e8a740 1 Processor -- start 2024-08-31T04:37:40.575 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:40.574+0000 7fbc43e8a740 1 -- start start 2024-08-31T04:37:40.576 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:40.574+0000 7fbc43e8a740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x560c8fbfa1b0 0x560c8ff9ffa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:37:40.577 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:40.574+0000 7fbc43e8a740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x560c8fbd12f0 0x560c8ffa0610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:37:40.577 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:40.574+0000 7fbc43e8a740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560c8fbd94d0 0x560c8ffa1160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:37:40.577 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:40.574+0000 7fbc43e8a740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x560c8ff12f70 con 0x560c8fbd94d0 2024-08-31T04:37:40.577 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:40.574+0000 7fbc43e8a740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x560c8ff02500 con 0x560c8fbd12f0 2024-08-31T04:37:40.577 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:40.574+0000 7fbc43e8a740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x560c8ff064b0 con 0x560c8fbfa1b0 2024-08-31T04:37:40.577 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:40.574+0000 7fbc36800640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x560c8fbfa1b0 0x560c8ff9ffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:37:40.577 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:40.574+0000 7fbc36800640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x560c8fbfa1b0 0x560c8ff9ffa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.50:43670/0 (socket says 172.21.15.50:43670) 2024-08-31T04:37:40.577 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:40.574+0000 7fbc36800640 1 -- 172.21.15.50:0/395237784 learned_addr learned my addr 172.21.15.50:0/395237784 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:37:40.577 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:40.574+0000 7fbc35e00640 1 --2- 172.21.15.50:0/395237784 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x560c8fbd12f0 0x560c8ffa0610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:37:40.577 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:40.575+0000 7fbc36800640 1 -- 172.21.15.50:0/395237784 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x560c8fbd12f0 msgr2=0x560c8ffa0610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:37:40.577 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:40.575+0000 7fbc36800640 1 --2- 172.21.15.50:0/395237784 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x560c8fbd12f0 0x560c8ffa0610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:40.577 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:40.575+0000 7fbc36800640 1 -- 172.21.15.50:0/395237784 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560c8fbd94d0 msgr2=0x560c8ffa1160 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-31T04:37:40.578 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:40.575+0000 7fbc36800640 1 --2- 172.21.15.50:0/395237784 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560c8fbd94d0 0x560c8ffa1160 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:40.578 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:40.575+0000 7fbc36800640 1 -- 172.21.15.50:0/395237784 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560c8febcc10 con 0x560c8fbfa1b0 2024-08-31T04:37:40.578 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:40.575+0000 7fbc2ea00640 1 -- 172.21.15.50:0/706525935 <== mon.1 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 18) ==== 152577+0+0 (secure 0 0 0) 0x7fbc24009a30 con 0x7fbc38104300 2024-08-31T04:37:40.578 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:40.575+0000 7fbc36800640 1 --2- 172.21.15.50:0/395237784 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x560c8fbfa1b0 0x560c8ff9ffa0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fbc30011790 tx=0x7fbc30011c50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1a4373ce9bc2c36e server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:37:40.578 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:40.575+0000 7fbc23400640 1 -- 172.21.15.50:0/395237784 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc30004d20 con 0x560c8fbfa1b0 2024-08-31T04:37:40.578 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:40.575+0000 7fbc23400640 1 -- 172.21.15.50:0/395237784 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbc30003970 con 0x560c8fbfa1b0 2024-08-31T04:37:40.578 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:40.575+0000 7fbc23400640 1 -- 172.21.15.50:0/395237784 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc300044a0 con 0x560c8fbfa1b0 2024-08-31T04:37:40.582 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:40.576+0000 7fbc43e8a740 1 -- 172.21.15.50:0/395237784 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x560c8fbfa1b0 msgr2=0x560c8ff9ffa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:37:40.582 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:40.576+0000 7fbc43e8a740 1 --2- 172.21.15.50:0/395237784 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x560c8fbfa1b0 0x560c8ff9ffa0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fbc30011790 tx=0x7fbc30011c50 comp rx=0 tx=0).stop 2024-08-31T04:37:40.582 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:40.576+0000 7fbc43e8a740 1 -- 172.21.15.50:0/395237784 shutdown_connections 2024-08-31T04:37:40.582 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:40.576+0000 7fbc43e8a740 1 --2- 172.21.15.50:0/395237784 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560c8fbd94d0 0x560c8ffa1160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:40.582 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:40.576+0000 7fbc43e8a740 1 --2- 172.21.15.50:0/395237784 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x560c8fbd12f0 0x560c8ffa0610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:40.582 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:40.576+0000 7fbc43e8a740 1 --2- 172.21.15.50:0/395237784 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x560c8fbfa1b0 0x560c8ff9ffa0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:40.582 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:40.576+0000 7fbc43e8a740 1 -- 172.21.15.50:0/395237784 >> 172.21.15.50:0/395237784 conn(0x560c8fbee300 msgr2=0x560c8ff9ba30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:37:40.582 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:40.576+0000 7fbc43e8a740 1 -- 172.21.15.50:0/395237784 shutdown_connections 2024-08-31T04:37:40.583 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:40.576+0000 7fbc43e8a740 1 -- 172.21.15.50:0/395237784 wait complete. 2024-08-31T04:37:40.583 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:40.577+0000 7fbc2ea00640 1 --2- 172.21.15.50:0/706525935 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fbc1c0b4a40 0x7fbc1c0b6f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:37:40.583 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:40.577+0000 7fbc43e8a740 1 -- start start 2024-08-31T04:37:40.583 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:40.577+0000 7fbc2ea00640 1 -- 172.21.15.50:0/706525935 <== mon.1 v2:172.21.15.177:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8219+0+0 (secure 0 0 0) 0x7fbc240e4b30 con 0x7fbc38104300 2024-08-31T04:37:40.583 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:40.577+0000 7fbc36800640 1 --2- 172.21.15.50:0/706525935 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fbc1c0b4a40 0x7fbc1c0b6f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:37:40.583 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:40.577+0000 7fbc43e8a740 1 Processor -- start 2024-08-31T04:37:40.583 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:40.578+0000 7fbc43e8a740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560c8fbd12f0 0x560c8ffa9620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:37:40.583 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:40.578+0000 7fbc43e8a740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x560c8fbd94d0 0x560c8ffa9ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:37:40.583 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:40.578+0000 7fbc43e8a740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x560c8fbfa1b0 0x560c8ffaa850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:37:40.583 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:40.578+0000 7fbc43e8a740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x560c8fe3bab0 con 0x560c8fbd12f0 2024-08-31T04:37:40.583 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:40.578+0000 7fbc43e8a740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x560c8fea9320 con 0x560c8fbd94d0 2024-08-31T04:37:40.583 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:40.578+0000 7fbc43e8a740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x560c8ffa1c80 con 0x560c8fbfa1b0 2024-08-31T04:37:40.584 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:40.578+0000 7fbc43e8a740 10 client.0 _ll_register_callbacks cb 0x560c8feaf6a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:37:40.584 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:40.578+0000 7fbc36800640 1 --2- 172.21.15.50:0/706525935 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fbc1c0b4a40 0x7fbc1c0b6f50 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fbc30011790 tx=0x7fbc30005fd0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:37:40.584 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:40.578+0000 7fbc35e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560c8fbd12f0 0x560c8ffa9620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:37:40.584 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:40.578+0000 7fbc36800640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x560c8fbfa1b0 0x560c8ffaa850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:37:40.584 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:40.578+0000 7fbc35400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x560c8fbd94d0 0x560c8ffa9ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:37:40.584 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:40.578+0000 7fbc36800640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x560c8fbfa1b0 0x560c8ffaa850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.50:43674/0 (socket says 172.21.15.50:43674) 2024-08-31T04:37:40.584 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:40.578+0000 7fbc36800640 1 -- 172.21.15.50:0/1265595905 learned_addr learned my addr 172.21.15.50:0/1265595905 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:37:40.584 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:40.578+0000 7fbc35400640 1 -- 172.21.15.50:0/1265595905 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x560c8fbfa1b0 msgr2=0x560c8ffaa850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:37:40.584 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:40.578+0000 7fbc35400640 1 --2- 172.21.15.50:0/1265595905 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x560c8fbfa1b0 0x560c8ffaa850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:40.584 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:40.578+0000 7fbc35400640 1 -- 172.21.15.50:0/1265595905 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560c8fbd12f0 msgr2=0x560c8ffa9620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:37:40.584 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:40.579+0000 7fbc35400640 1 --2- 172.21.15.50:0/1265595905 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560c8fbd12f0 0x560c8ffa9620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:40.584 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:40.579+0000 7fbc35400640 1 -- 172.21.15.50:0/1265595905 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560c8fc65790 con 0x560c8fbd94d0 2024-08-31T04:37:40.584 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:40.579+0000 7fbc35400640 1 --2- 172.21.15.50:0/1265595905 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x560c8fbd94d0 0x560c8ffa9ce0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fbc240ab4a0 tx=0x7fbc240aaf90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=99e09a2f69d5499d server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:37:40.585 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:40.579+0000 7fbc17e00640 10 client.0 ms_handle_connect on v2:172.21.15.133:3300/0 2024-08-31T04:37:40.585 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:40.579+0000 7fbc17e00640 1 -- 172.21.15.50:0/1265595905 <== mon.2 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc240ab510 con 0x560c8fbd94d0 2024-08-31T04:37:40.585 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:40.579+0000 7fbc43e8a740 1 -- 172.21.15.50:0/1265595905 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbc30003970 con 0x560c8fbd94d0 2024-08-31T04:37:40.585 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:40.579+0000 7fbc17e00640 1 -- 172.21.15.50:0/1265595905 <== mon.2 v2:172.21.15.133:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8219+0+0 (secure 0 0 0) 0x7fbc240041d0 con 0x560c8fbd94d0 2024-08-31T04:37:40.585 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:40.579+0000 7fbc17e00640 1 -- 172.21.15.50:0/1265595905 <== mon.2 v2:172.21.15.133:3300/0 3 ==== mon_get_version_reply(handle=1 version=71) ==== 24+0+0 (secure 0 0 0) 0x7fbc240afd80 con 0x560c8fbd94d0 2024-08-31T04:37:40.585 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:40.579+0000 7fbc43e8a740 10 client.26681 fetch_fsmap learned FSMap version 71 2024-08-31T04:37:40.585 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:40.579+0000 7fbc43e8a740 1 -- 172.21.15.50:0/1265595905 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,fsmap=71,monmap=4+}) -- 0x560c8fcde620 con 0x560c8fbd94d0 2024-08-31T04:37:40.585 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:40.580+0000 7fbc17e00640 1 -- 172.21.15.50:0/1265595905 <== mon.2 v2:172.21.15.133:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbc30003970 con 0x560c8fbd94d0 2024-08-31T04:37:40.585 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:40.580+0000 7fbc17e00640 1 -- 172.21.15.50:0/1265595905 <== mon.2 v2:172.21.15.133:3300/0 5 ==== fsmap(e 71) ==== 8442+0+0 (secure 0 0 0) 0x7fbc240ce160 con 0x560c8fbd94d0 2024-08-31T04:37:40.585 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:40.580+0000 7fbc43e8a740 10 client.26681 fetch_fsmap finished waiting for FSMap version 71 2024-08-31T04:37:40.585 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:40.580+0000 7fbc43e8a740 10 client.26681 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T04:37:40.585 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:40.580+0000 7fbc43e8a740 20 client.26681 populate_metadata read hostname 'smithi050' 2024-08-31T04:37:40.585 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:40.580+0000 7fbc43e8a740 1 --2- 172.21.15.50:0/1265595905 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x560c8fbb8d80 0x560c8ffb6df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:37:40.586 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:40.580+0000 7fbc43e8a740 4 client.26681 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T04:37:40.586 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:40.580+0000 7fbc43e8a740 1 -- 172.21.15.50:0/1265595905 --> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560c8ff14ec0 con 0x560c8fbb8d80 2024-08-31T04:37:40.586 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:40.580+0000 7fbc35e00640 1 --2- 172.21.15.50:0/1265595905 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x560c8fbb8d80 0x560c8ffb6df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:37:40.586 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:40.581+0000 7fbc35e00640 1 --2- 172.21.15.50:0/1265595905 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x560c8fbb8d80 0x560c8ffb6df0 crc :-1 s=READY pgs=177 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=69aaacb961ba8ec1 server_cookie=bd80a0b5996e662f in_seq=0 out_seq=0 2024-08-31T04:37:40.586 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:40.581+0000 7fbc17e00640 10 client.26681 ms_handle_connect on v2:172.21.15.133:6838/2526402262 2024-08-31T04:37:40.587 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:40.582+0000 7fbc17e00640 1 -- 172.21.15.50:0/1265595905 <== mds.0 v2:172.21.15.133:6838/2526402262 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x560c8ff14ec0 con 0x560c8fbb8d80 2024-08-31T04:37:40.587 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:40.582+0000 7fbc17e00640 10 client.26681 handle_command_reply: tid=0 2024-08-31T04:37:40.587 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:40.582+0000 7fbc43e8a740 1 client.26681 shutdown 2024-08-31T04:37:40.587 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:40.582+0000 7fbc43e8a740 1 -- 172.21.15.50:0/1265595905 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x560c8fbd94d0 msgr2=0x560c8ffa9ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:37:40.588 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:40.582+0000 7fbc43e8a740 1 --2- 172.21.15.50:0/1265595905 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x560c8fbd94d0 0x560c8ffa9ce0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fbc240ab4a0 tx=0x7fbc240aaf90 comp rx=0 tx=0).stop 2024-08-31T04:37:40.588 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:40.582+0000 7fbc43e8a740 1 -- 172.21.15.50:0/1265595905 shutdown_connections 2024-08-31T04:37:40.588 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:40.582+0000 7fbc43e8a740 1 --2- 172.21.15.50:0/1265595905 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x560c8fbb8d80 0x560c8ffb6df0 crc :-1 s=READY pgs=177 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:40.588 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:40.582+0000 7fbc43e8a740 1 --2- 172.21.15.50:0/1265595905 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x560c8fbfa1b0 0x560c8ffaa850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:40.588 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:40.582+0000 7fbc17e00640 0 client.26681 ms_handle_reset on v2:172.21.15.133:6838/2526402262 2024-08-31T04:37:40.588 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:40.582+0000 7fbc43e8a740 1 --2- 172.21.15.50:0/1265595905 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x560c8fbd94d0 0x560c8ffa9ce0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:40.588 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:40.582+0000 7fbc43e8a740 1 --2- 172.21.15.50:0/1265595905 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560c8fbd12f0 0x560c8ffa9620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:40.588 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:40.582+0000 7fbc43e8a740 1 -- 172.21.15.50:0/1265595905 >> 172.21.15.50:0/1265595905 conn(0x560c8fbee300 msgr2=0x560c8ff99f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:37:40.588 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:40.582+0000 7fbc43e8a740 1 -- 172.21.15.50:0/1265595905 shutdown_connections 2024-08-31T04:37:40.588 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:40.582+0000 7fbc43e8a740 1 -- 172.21.15.50:0/1265595905 wait complete. 2024-08-31T04:37:40.588 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:40.583+0000 7fbc43e8a740 20 client.26681 trim_cache size 0 max 16384 2024-08-31T04:37:40.601 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:40.598+0000 7fbc43e8a740 1 Processor -- start 2024-08-31T04:37:40.601 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:40.598+0000 7fbc43e8a740 1 -- start start 2024-08-31T04:37:40.601 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:40.599+0000 7fbc43e8a740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560c8fbd12f0 0x560c8ffa8260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:37:40.601 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:40.599+0000 7fbc43e8a740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x560c8fbd94d0 0x560c8ff96660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:37:40.601 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:40.599+0000 7fbc43e8a740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x560c8fbfa1b0 0x560c8ffa8860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:37:40.601 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:40.599+0000 7fbc43e8a740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fbc381acbd0 con 0x560c8fbd12f0 2024-08-31T04:37:40.601 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:40.599+0000 7fbc43e8a740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7fbc381ae950 con 0x560c8fbd94d0 2024-08-31T04:37:40.601 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:40.599+0000 7fbc43e8a740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fbc381ad360 con 0x560c8fbfa1b0 2024-08-31T04:37:40.601 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:40.599+0000 7fbc35e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560c8fbd12f0 0x560c8ffa8260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:37:40.602 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:40.599+0000 7fbc36800640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x560c8fbfa1b0 0x560c8ffa8860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:37:40.602 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:40.599+0000 7fbc36800640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x560c8fbfa1b0 0x560c8ffa8860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.50:43678/0 (socket says 172.21.15.50:43678) 2024-08-31T04:37:40.602 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:40.599+0000 7fbc35e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560c8fbd12f0 0x560c8ffa8260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:44164/0 (socket says 172.21.15.50:44164) 2024-08-31T04:37:40.602 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:40.599+0000 7fbc36800640 1 -- 172.21.15.50:0/2742341799 learned_addr learned my addr 172.21.15.50:0/2742341799 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:37:40.602 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:40.599+0000 7fbc35400640 1 --2- 172.21.15.50:0/2742341799 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x560c8fbd94d0 0x560c8ff96660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:37:40.602 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:40.599+0000 7fbc35e00640 1 -- 172.21.15.50:0/2742341799 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x560c8fbfa1b0 msgr2=0x560c8ffa8860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:37:40.602 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:40.599+0000 7fbc35e00640 1 --2- 172.21.15.50:0/2742341799 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x560c8fbfa1b0 0x560c8ffa8860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:40.602 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:40.599+0000 7fbc35e00640 1 -- 172.21.15.50:0/2742341799 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x560c8fbd94d0 msgr2=0x560c8ff96660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:37:40.602 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:40.599+0000 7fbc35e00640 1 --2- 172.21.15.50:0/2742341799 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x560c8fbd94d0 0x560c8ff96660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:40.602 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:40.600+0000 7fbc35e00640 1 -- 172.21.15.50:0/2742341799 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560c8ffaabc0 con 0x560c8fbd12f0 2024-08-31T04:37:40.602 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:40.600+0000 7fbc35e00640 1 --2- 172.21.15.50:0/2742341799 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560c8fbd12f0 0x560c8ffa8260 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7fbc28005ab0 tx=0x7fbc28009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97fa094061051594 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:37:40.604 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:40.600+0000 7fbc22a00640 1 -- 172.21.15.50:0/2742341799 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc28035040 con 0x560c8fbd12f0 2024-08-31T04:37:40.605 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:40.600+0000 7fbc22a00640 1 -- 172.21.15.50:0/2742341799 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbc28031c70 con 0x560c8fbd12f0 2024-08-31T04:37:40.605 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:40.600+0000 7fbc22a00640 1 -- 172.21.15.50:0/2742341799 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc28003de0 con 0x560c8fbd12f0 2024-08-31T04:37:40.605 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:40.601+0000 7fbc43e8a740 1 -- 172.21.15.50:0/2742341799 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560c8fbd12f0 msgr2=0x560c8ffa8260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:37:40.605 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:40.601+0000 7fbc43e8a740 1 --2- 172.21.15.50:0/2742341799 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560c8fbd12f0 0x560c8ffa8260 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7fbc28005ab0 tx=0x7fbc28009260 comp rx=0 tx=0).stop 2024-08-31T04:37:40.605 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:40.601+0000 7fbc43e8a740 1 -- 172.21.15.50:0/2742341799 shutdown_connections 2024-08-31T04:37:40.605 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:40.601+0000 7fbc43e8a740 1 --2- 172.21.15.50:0/2742341799 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x560c8fbfa1b0 0x560c8ffa8860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:40.605 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:40.601+0000 7fbc43e8a740 1 --2- 172.21.15.50:0/2742341799 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x560c8fbd94d0 0x560c8ff96660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:40.605 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:40.601+0000 7fbc43e8a740 1 --2- 172.21.15.50:0/2742341799 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560c8fbd12f0 0x560c8ffa8260 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:40.605 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:40.601+0000 7fbc43e8a740 1 -- 172.21.15.50:0/2742341799 >> 172.21.15.50:0/2742341799 conn(0x560c8fbee300 msgr2=0x560c8ffa7b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:37:40.605 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:40.601+0000 7fbc43e8a740 1 -- 172.21.15.50:0/2742341799 shutdown_connections 2024-08-31T04:37:40.605 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:40.601+0000 7fbc43e8a740 1 -- 172.21.15.50:0/2742341799 wait complete. 2024-08-31T04:37:40.606 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:40.601+0000 7fbc43e8a740 1 -- start start 2024-08-31T04:37:40.606 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:40.602+0000 7fbc43e8a740 1 Processor -- start 2024-08-31T04:37:40.606 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:40.602+0000 7fbc43e8a740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560c8fbd12f0 0x560c8ffb0c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:37:40.606 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:40.602+0000 7fbc43e8a740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x560c8fbd94d0 0x560c8ffaf920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:37:40.606 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:40.602+0000 7fbc43e8a740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x560c8fbfa1b0 0x560c8ffafe60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:37:40.606 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:40.602+0000 7fbc43e8a740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fbc381ae280 con 0x560c8fbd12f0 2024-08-31T04:37:40.606 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:40.602+0000 7fbc43e8a740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7fbc381adaf0 con 0x560c8fbd94d0 2024-08-31T04:37:40.606 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:40.602+0000 7fbc43e8a740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fbc381aabb0 con 0x560c8fbfa1b0 2024-08-31T04:37:40.606 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:40.602+0000 7fbc43e8a740 10 client.0 _ll_register_callbacks cb 0x7fbc240ab3d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:37:40.606 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:40.602+0000 7fbc35e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560c8fbd12f0 0x560c8ffb0c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:37:40.606 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:40.602+0000 7fbc36800640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x560c8fbfa1b0 0x560c8ffafe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:37:40.606 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:40.602+0000 7fbc35e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560c8fbd12f0 0x560c8ffb0c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:44178/0 (socket says 172.21.15.50:44178) 2024-08-31T04:37:40.606 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:40.602+0000 7fbc35e00640 1 -- 172.21.15.50:0/99318605 learned_addr learned my addr 172.21.15.50:0/99318605 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:37:40.607 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:40.602+0000 7fbc36800640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x560c8fbfa1b0 0x560c8ffafe60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.50:43680/0 (socket says 172.21.15.50:43680) 2024-08-31T04:37:40.607 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:40.602+0000 7fbc35400640 1 --2- 172.21.15.50:0/99318605 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x560c8fbd94d0 0x560c8ffaf920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:37:40.607 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:40.603+0000 7fbc35e00640 1 -- 172.21.15.50:0/99318605 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x560c8fbfa1b0 msgr2=0x560c8ffafe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:37:40.607 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:40.603+0000 7fbc35e00640 1 --2- 172.21.15.50:0/99318605 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x560c8fbfa1b0 0x560c8ffafe60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:40.607 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:40.603+0000 7fbc35e00640 1 -- 172.21.15.50:0/99318605 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x560c8fbd94d0 msgr2=0x560c8ffaf920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:37:40.607 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:40.603+0000 7fbc35e00640 1 --2- 172.21.15.50:0/99318605 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x560c8fbd94d0 0x560c8ffaf920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:40.607 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:40.603+0000 7fbc35e00640 1 -- 172.21.15.50:0/99318605 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560c8ffb03a0 con 0x560c8fbd12f0 2024-08-31T04:37:40.607 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:40.603+0000 7fbc35e00640 1 --2- 172.21.15.50:0/99318605 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560c8fbd12f0 0x560c8ffb0c60 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7fbc280044a0 tx=0x7fbc2802a3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7019fa9fb2c3cbd6 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:37:40.607 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:40.603+0000 7fbc17e00640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-08-31T04:37:40.607 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:40.603+0000 7fbc17e00640 1 -- 172.21.15.50:0/99318605 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc28035030 con 0x560c8fbd12f0 2024-08-31T04:37:40.607 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:40.603+0000 7fbc43e8a740 1 -- 172.21.15.50:0/99318605 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbc28031c70 con 0x560c8fbd12f0 2024-08-31T04:37:40.607 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:40.604+0000 7fbc17e00640 1 -- 172.21.15.50:0/99318605 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8219+0+0 (secure 0 0 0) 0x7fbc280317c0 con 0x560c8fbd12f0 2024-08-31T04:37:40.609 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:40.604+0000 7fbc17e00640 1 -- 172.21.15.50:0/99318605 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=71) ==== 24+0+0 (secure 0 0 0) 0x7fbc280319c0 con 0x560c8fbd12f0 2024-08-31T04:37:40.609 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:40.604+0000 7fbc43e8a740 10 client.16725 fetch_fsmap learned FSMap version 71 2024-08-31T04:37:40.609 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:40.604+0000 7fbc43e8a740 1 -- 172.21.15.50:0/99318605 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=71,monmap=4+}) -- 0x560c8ffaf240 con 0x560c8fbd12f0 2024-08-31T04:37:40.609 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:40.604+0000 7fbc17e00640 1 -- 172.21.15.50:0/99318605 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbc28031c70 con 0x560c8fbd12f0 2024-08-31T04:37:40.609 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:40.604+0000 7fbc17e00640 1 -- 172.21.15.50:0/99318605 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 71) ==== 8442+0+0 (secure 0 0 0) 0x7fbc28058a30 con 0x560c8fbd12f0 2024-08-31T04:37:40.609 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:40.604+0000 7fbc43e8a740 10 client.16725 fetch_fsmap finished waiting for FSMap version 71 2024-08-31T04:37:40.609 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:40.604+0000 7fbc43e8a740 10 client.16725 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T04:37:40.609 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:40.604+0000 7fbc43e8a740 20 client.16725 populate_metadata read hostname 'smithi050' 2024-08-31T04:37:40.609 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:40.604+0000 7fbc43e8a740 1 --2- 172.21.15.50:0/99318605 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x560c8fb8e1c0 0x560c90023fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:37:40.609 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:40.604+0000 7fbc43e8a740 4 client.16725 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-31T04:37:40.609 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:40.604+0000 7fbc43e8a740 1 -- 172.21.15.50:0/99318605 --> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] -- command(tid 0: {"prefix": "flush journal"}) -- 0x560c8ffb1af0 con 0x560c8fb8e1c0 2024-08-31T04:37:40.609 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:40.605+0000 7fbc35400640 1 --2- 172.21.15.50:0/99318605 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x560c8fb8e1c0 0x560c90023fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:37:40.610 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:40.605+0000 7fbc35400640 1 --2- 172.21.15.50:0/99318605 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x560c8fb8e1c0 0x560c90023fe0 crc :-1 s=READY pgs=178 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2b07f92884ce6ea5 server_cookie=822b9bfe7170627c in_seq=0 out_seq=0 2024-08-31T04:37:40.610 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:40.605+0000 7fbc17e00640 10 client.16725 ms_handle_connect on v2:172.21.15.133:6838/2526402262 2024-08-31T04:37:40.621 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:40.619+0000 7fbc17e00640 1 -- 172.21.15.50:0/99318605 <== mds.0 v2:172.21.15.133:6838/2526402262 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x560c8ffb1af0 con 0x560c8fb8e1c0 2024-08-31T04:37:40.621 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:40.619+0000 7fbc17e00640 10 client.16725 handle_command_reply: tid=0 2024-08-31T04:37:40.621 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:40.619+0000 7fbc43e8a740 1 client.16725 shutdown 2024-08-31T04:37:40.621 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:40.619+0000 7fbc43e8a740 1 -- 172.21.15.50:0/99318605 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560c8fbd12f0 msgr2=0x560c8ffb0c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:37:40.621 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:40.619+0000 7fbc43e8a740 1 --2- 172.21.15.50:0/99318605 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560c8fbd12f0 0x560c8ffb0c60 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7fbc280044a0 tx=0x7fbc2802a3f0 comp rx=0 tx=0).stop 2024-08-31T04:37:40.621 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:40.619+0000 7fbc43e8a740 1 -- 172.21.15.50:0/99318605 shutdown_connections 2024-08-31T04:37:40.622 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:40.619+0000 7fbc43e8a740 1 --2- 172.21.15.50:0/99318605 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x560c8fb8e1c0 0x560c90023fe0 crc :-1 s=READY pgs=178 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:40.622 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:40.619+0000 7fbc43e8a740 1 --2- 172.21.15.50:0/99318605 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x560c8fbfa1b0 0x560c8ffafe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:40.622 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:40.619+0000 7fbc43e8a740 1 --2- 172.21.15.50:0/99318605 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x560c8fbd94d0 0x560c8ffaf920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:40.622 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:40.619+0000 7fbc43e8a740 1 --2- 172.21.15.50:0/99318605 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560c8fbd12f0 0x560c8ffb0c60 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:40.622 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:40.619+0000 7fbc43e8a740 1 -- 172.21.15.50:0/99318605 >> 172.21.15.50:0/99318605 conn(0x560c8fbee300 msgr2=0x560c8ffa4060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:37:40.622 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:40.619+0000 7fbc17e00640 0 client.16725 ms_handle_reset on v2:172.21.15.133:6838/2526402262 2024-08-31T04:37:40.622 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:40.620+0000 7fbc43e8a740 1 -- 172.21.15.50:0/99318605 shutdown_connections 2024-08-31T04:37:40.622 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:40.620+0000 7fbc43e8a740 1 -- 172.21.15.50:0/99318605 wait complete. 2024-08-31T04:37:40.622 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:40.620+0000 7fbc43e8a740 20 client.16725 trim_cache size 0 max 16384 2024-08-31T04:37:40.623 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout:{ 2024-08-31T04:37:40.623 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout: "message": "", 2024-08-31T04:37:40.623 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout: "return_code": 0 2024-08-31T04:37:40.623 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout:} 2024-08-31T04:37:40.623 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:40.620+0000 7fbc37200640 1 -- 172.21.15.50:0/706525935 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fbc1c0b4a40 msgr2=0x7fbc1c0b6f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:37:40.624 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:40.620+0000 7fbc37200640 1 --2- 172.21.15.50:0/706525935 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fbc1c0b4a40 0x7fbc1c0b6f50 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fbc30011790 tx=0x7fbc30005fd0 comp rx=0 tx=0).stop 2024-08-31T04:37:40.624 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:40.620+0000 7fbc37200640 1 -- 172.21.15.50:0/706525935 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbc38104300 msgr2=0x7fbc380754b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:37:40.624 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:40.620+0000 7fbc37200640 1 --2- 172.21.15.50:0/706525935 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbc38104300 0x7fbc380754b0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fbc2400d950 tx=0x7fbc2400dd50 comp rx=0 tx=0).stop 2024-08-31T04:37:40.624 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:40.620+0000 7fbc37200640 1 -- 172.21.15.50:0/706525935 shutdown_connections 2024-08-31T04:37:40.624 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:40.620+0000 7fbc37200640 1 --2- 172.21.15.50:0/706525935 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fbc1c0b4a40 0x7fbc1c0b6f50 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:40.624 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:40.620+0000 7fbc37200640 1 --2- 172.21.15.50:0/706525935 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbc38104300 0x7fbc380754b0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:40.624 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:40.620+0000 7fbc37200640 1 --2- 172.21.15.50:0/706525935 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbc38104ca0 0x7fbc380759f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:40.624 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:40.620+0000 7fbc37200640 1 --2- 172.21.15.50:0/706525935 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbc38103280 0x7fbc38076b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:40.624 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:40.620+0000 7fbc37200640 1 -- 172.21.15.50:0/706525935 >> 172.21.15.50:0/706525935 conn(0x7fbc380febc0 msgr2=0x7fbc38107620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:37:40.624 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:40.621+0000 7fbc37200640 1 -- 172.21.15.50:0/706525935 shutdown_connections 2024-08-31T04:37:40.624 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:40.621+0000 7fbc37200640 1 -- 172.21.15.50:0/706525935 wait complete. 2024-08-31T04:37:41.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:37:41 smithi050 ceph-mon[17259]: pgmap v812: 97 pgs: 97 active+clean; 838 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 939 KiB/s rd, 935 KiB/s wr, 327 op/s 2024-08-31T04:37:41.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:37:41 smithi177 ceph-mon[22025]: pgmap v812: 97 pgs: 97 active+clean; 838 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 939 KiB/s rd, 935 KiB/s wr, 327 op/s 2024-08-31T04:37:41.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:37:41 smithi133 ceph-mon[22177]: pgmap v812: 97 pgs: 97 active+clean; 838 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 939 KiB/s rd, 935 KiB/s wr, 327 op/s 2024-08-31T04:37:43.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:37:43 smithi177 ceph-mon[22025]: pgmap v813: 97 pgs: 97 active+clean; 834 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.0 MiB/s wr, 295 op/s 2024-08-31T04:37:43.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:37:43 smithi133 ceph-mon[22177]: pgmap v813: 97 pgs: 97 active+clean; 834 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.0 MiB/s wr, 295 op/s 2024-08-31T04:37:43.950 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:37:43 smithi050 ceph-mon[17259]: pgmap v813: 97 pgs: 97 active+clean; 834 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.0 MiB/s wr, 295 op/s 2024-08-31T04:37:45.725 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:37:45 smithi050 ceph-mon[17259]: pgmap v814: 97 pgs: 97 active+clean; 832 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 725 KiB/s rd, 648 KiB/s wr, 224 op/s 2024-08-31T04:37:45.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:37:45 smithi177 ceph-mon[22025]: pgmap v814: 97 pgs: 97 active+clean; 832 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 725 KiB/s rd, 648 KiB/s wr, 224 op/s 2024-08-31T04:37:45.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:37:45 smithi133 ceph-mon[22177]: pgmap v814: 97 pgs: 97 active+clean; 832 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 725 KiB/s rd, 648 KiB/s wr, 224 op/s 2024-08-31T04:37:47.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:37:47 smithi177 ceph-mon[22025]: pgmap v815: 97 pgs: 97 active+clean; 827 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 732 KiB/s rd, 663 KiB/s wr, 207 op/s 2024-08-31T04:37:47.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:37:47 smithi133 ceph-mon[22177]: pgmap v815: 97 pgs: 97 active+clean; 827 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 732 KiB/s rd, 663 KiB/s wr, 207 op/s 2024-08-31T04:37:47.950 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:37:47 smithi050 ceph-mon[17259]: pgmap v815: 97 pgs: 97 active+clean; 827 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 732 KiB/s rd, 663 KiB/s wr, 207 op/s 2024-08-31T04:37:49.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:37:49 smithi177 ceph-mon[22025]: pgmap v816: 97 pgs: 97 active+clean; 827 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 262 KiB/s rd, 271 KiB/s wr, 127 op/s 2024-08-31T04:37:49.792 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:37:49 smithi133 ceph-mon[22177]: pgmap v816: 97 pgs: 97 active+clean; 827 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 262 KiB/s rd, 271 KiB/s wr, 127 op/s 2024-08-31T04:37:49.960 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:37:49 smithi050 ceph-mon[17259]: pgmap v816: 97 pgs: 97 active+clean; 827 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 262 KiB/s rd, 271 KiB/s wr, 127 op/s 2024-08-31T04:37:51.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:37:51 smithi050 ceph-mon[17259]: pgmap v817: 97 pgs: 97 active+clean; 824 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 213 KiB/s rd, 216 KiB/s wr, 115 op/s 2024-08-31T04:37:51.745 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:37:51 smithi177 ceph-mon[22025]: pgmap v817: 97 pgs: 97 active+clean; 824 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 213 KiB/s rd, 216 KiB/s wr, 115 op/s 2024-08-31T04:37:51.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:37:51 smithi133 ceph-mon[22177]: pgmap v817: 97 pgs: 97 active+clean; 824 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 213 KiB/s rd, 216 KiB/s wr, 115 op/s 2024-08-31T04:37:53.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:37:53 smithi177 ceph-mon[22025]: pgmap v818: 97 pgs: 97 active+clean; 817 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 655 KiB/s rd, 645 KiB/s wr, 163 op/s 2024-08-31T04:37:53.792 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:37:53 smithi133 ceph-mon[22177]: pgmap v818: 97 pgs: 97 active+clean; 817 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 655 KiB/s rd, 645 KiB/s wr, 163 op/s 2024-08-31T04:37:53.837 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:53.835+0000 7ff6eb200640 1 -- 172.21.15.50:0/179946418 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff6ec103c00 msgr2=0x7ff6ec10a5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:37:53.837 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:53.835+0000 7ff6eb200640 1 --2- 172.21.15.50:0/179946418 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff6ec103c00 0x7ff6ec10a5a0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7ff6e4009be0 tx=0x7ff6e402a6c0 comp rx=0 tx=0).stop 2024-08-31T04:37:53.837 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:53.836+0000 7ff6eb200640 1 -- 172.21.15.50:0/179946418 shutdown_connections 2024-08-31T04:37:53.837 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:53.836+0000 7ff6eb200640 1 --2- 172.21.15.50:0/179946418 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff6ec103c00 0x7ff6ec10a5a0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:53.837 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:53.836+0000 7ff6eb200640 1 --2- 172.21.15.50:0/179946418 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff6ec103260 0x7ff6ec103670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:53.838 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:53.836+0000 7ff6eb200640 1 --2- 172.21.15.50:0/179946418 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff6ec1021e0 0x7ff6ec102650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:53.838 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:53.836+0000 7ff6eb200640 1 -- 172.21.15.50:0/179946418 >> 172.21.15.50:0/179946418 conn(0x7ff6ec0fdb20 msgr2=0x7ff6ec0fffd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:37:53.838 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:53.836+0000 7ff6eb200640 1 -- 172.21.15.50:0/179946418 shutdown_connections 2024-08-31T04:37:53.838 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:53.836+0000 7ff6eb200640 1 -- 172.21.15.50:0/179946418 wait complete. 2024-08-31T04:37:53.839 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:53.838+0000 7ff6eb200640 1 Processor -- start 2024-08-31T04:37:53.839 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:53.838+0000 7ff6eb200640 1 -- start start 2024-08-31T04:37:53.840 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:53.838+0000 7ff6eb200640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff6ec1021e0 0x7ff6ec197870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:37:53.840 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:53.838+0000 7ff6eb200640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff6ec103260 0x7ff6ec197ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:37:53.840 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:53.839+0000 7ff6eb200640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff6ec103c00 0x7ff6ec198a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:37:53.840 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:53.839+0000 7ff6eb200640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7ff6ec10cce0 con 0x7ff6ec103c00 2024-08-31T04:37:53.840 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:53.839+0000 7ff6eb200640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7ff6ec10cb60 con 0x7ff6ec103260 2024-08-31T04:37:53.840 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:53.839+0000 7ff6eb200640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7ff6ec10ce60 con 0x7ff6ec1021e0 2024-08-31T04:37:53.840 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:53.839+0000 7ff6e9e00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff6ec1021e0 0x7ff6ec197870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:37:53.841 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:53.839+0000 7ff6e9e00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff6ec1021e0 0x7ff6ec197870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.50:44994/0 (socket says 172.21.15.50:44994) 2024-08-31T04:37:53.841 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:53.839+0000 7ff6e9e00640 1 -- 172.21.15.50:0/752229652 learned_addr learned my addr 172.21.15.50:0/752229652 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:37:53.841 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:53.839+0000 7ff6e9400640 1 --2- 172.21.15.50:0/752229652 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff6ec103260 0x7ff6ec197ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:37:53.841 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:53.839+0000 7ff6ea800640 1 --2- 172.21.15.50:0/752229652 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff6ec103c00 0x7ff6ec198a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:37:53.841 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:53.840+0000 7ff6e9400640 1 -- 172.21.15.50:0/752229652 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff6ec1021e0 msgr2=0x7ff6ec197870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:37:53.841 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:53.840+0000 7ff6e9400640 1 --2- 172.21.15.50:0/752229652 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff6ec1021e0 0x7ff6ec197870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:53.841 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:53.840+0000 7ff6e9400640 1 -- 172.21.15.50:0/752229652 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff6ec103c00 msgr2=0x7ff6ec198a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:37:53.842 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:53.840+0000 7ff6e9400640 1 --2- 172.21.15.50:0/752229652 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff6ec103c00 0x7ff6ec198a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:53.842 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:53.840+0000 7ff6e9400640 1 -- 172.21.15.50:0/752229652 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6ec1992b0 con 0x7ff6ec103260 2024-08-31T04:37:53.842 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:53.840+0000 7ff6ea800640 1 --2- 172.21.15.50:0/752229652 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff6ec103c00 0x7ff6ec198a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:37:53.842 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:53.840+0000 7ff6e9400640 1 --2- 172.21.15.50:0/752229652 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff6ec103260 0x7ff6ec197ee0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7ff6d800e9f0 tx=0x7ff6d800eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:37:53.842 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:53.841+0000 7ff6e2a00640 1 -- 172.21.15.50:0/752229652 <== mon.2 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6d800ccc0 con 0x7ff6ec103260 2024-08-31T04:37:53.843 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:53.841+0000 7ff6eb200640 1 -- 172.21.15.50:0/752229652 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff6ec1995a0 con 0x7ff6ec103260 2024-08-31T04:37:53.843 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:53.841+0000 7ff6e2a00640 1 -- 172.21.15.50:0/752229652 <== mon.2 v2:172.21.15.133:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff6d80108e0 con 0x7ff6ec103260 2024-08-31T04:37:53.843 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:53.841+0000 7ff6e2a00640 1 -- 172.21.15.50:0/752229652 <== mon.2 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6d80188c0 con 0x7ff6ec103260 2024-08-31T04:37:53.843 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:53.841+0000 7ff6eb200640 1 -- 172.21.15.50:0/752229652 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff6ec19fc90 con 0x7ff6ec103260 2024-08-31T04:37:53.847 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:53.845+0000 7ff6f7a77740 1 Processor -- start 2024-08-31T04:37:53.847 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:53.845+0000 7ff6f7a77740 1 -- start start 2024-08-31T04:37:53.847 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:53.846+0000 7ff6e2a00640 1 -- 172.21.15.50:0/752229652 <== mon.2 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 18) ==== 152577+0+0 (secure 0 0 0) 0x7ff6d8018a60 con 0x7ff6ec103260 2024-08-31T04:37:53.847 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:53.846+0000 7ff6f7a77740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56486d4cc1b0 0x56486d871fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:37:53.847 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:53.846+0000 7ff6f7a77740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56486d4a32f0 0x56486d872610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:37:53.847 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:53.846+0000 7ff6f7a77740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56486d4ab4d0 0x56486d873160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:37:53.848 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:53.846+0000 7ff6f7a77740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x56486d7e4f70 con 0x56486d4a32f0 2024-08-31T04:37:53.848 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:53.846+0000 7ff6f7a77740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x56486d7d4500 con 0x56486d4cc1b0 2024-08-31T04:37:53.848 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:53.846+0000 7ff6f7a77740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x56486d7d84b0 con 0x56486d4ab4d0 2024-08-31T04:37:53.848 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:53.846+0000 7ff6ea800640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56486d4cc1b0 0x56486d871fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:37:53.848 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:53.846+0000 7ff6ea800640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56486d4cc1b0 0x56486d871fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.50:49722/0 (socket says 172.21.15.50:49722) 2024-08-31T04:37:53.848 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:53.846+0000 7ff6ea800640 1 -- 172.21.15.50:0/1281880333 learned_addr learned my addr 172.21.15.50:0/1281880333 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:37:53.849 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:53.847+0000 7ff6e9400640 1 --2- 172.21.15.50:0/1281880333 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56486d4ab4d0 0x56486d873160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:37:53.849 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:53.847+0000 7ff6e9e00640 1 --2- 172.21.15.50:0/1281880333 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56486d4a32f0 0x56486d872610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:37:53.849 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:53.847+0000 7ff6ea800640 1 -- 172.21.15.50:0/1281880333 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56486d4ab4d0 msgr2=0x56486d873160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:37:53.849 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:53.847+0000 7ff6ea800640 1 --2- 172.21.15.50:0/1281880333 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56486d4ab4d0 0x56486d873160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:53.849 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:53.847+0000 7ff6ea800640 1 -- 172.21.15.50:0/1281880333 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56486d4a32f0 msgr2=0x56486d872610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:37:53.849 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:53.847+0000 7ff6ea800640 1 --2- 172.21.15.50:0/1281880333 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56486d4a32f0 0x56486d872610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:53.849 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:53.847+0000 7ff6ea800640 1 -- 172.21.15.50:0/1281880333 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56486d78ec10 con 0x56486d4cc1b0 2024-08-31T04:37:53.850 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:53.848+0000 7ff6ea800640 1 --2- 172.21.15.50:0/1281880333 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56486d4cc1b0 0x56486d871fa0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7ff6e4033000 tx=0x7ff6e40314c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b36ecd7e1131a5aa server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:37:53.850 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:53.848+0000 7ff6d7000640 1 -- 172.21.15.50:0/1281880333 <== mon.2 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6e4041070 con 0x56486d4cc1b0 2024-08-31T04:37:53.850 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:53.848+0000 7ff6d7000640 1 -- 172.21.15.50:0/1281880333 <== mon.2 v2:172.21.15.133:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff6e4037040 con 0x56486d4cc1b0 2024-08-31T04:37:53.850 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:53.848+0000 7ff6d7000640 1 -- 172.21.15.50:0/1281880333 <== mon.2 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6e4036030 con 0x56486d4cc1b0 2024-08-31T04:37:53.851 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:53.848+0000 7ff6e2a00640 1 --2- 172.21.15.50:0/752229652 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7ff6d00b4c30 0x7ff6d00b7140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:37:53.851 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:53.849+0000 7ff6e2a00640 1 -- 172.21.15.50:0/752229652 <== mon.2 v2:172.21.15.133:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8219+0+0 (secure 0 0 0) 0x7ff6d80e5630 con 0x7ff6ec103260 2024-08-31T04:37:53.851 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:53.849+0000 7ff6f7a77740 1 -- 172.21.15.50:0/1281880333 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56486d4cc1b0 msgr2=0x56486d871fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:37:53.851 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:53.849+0000 7ff6f7a77740 1 --2- 172.21.15.50:0/1281880333 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56486d4cc1b0 0x56486d871fa0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7ff6e4033000 tx=0x7ff6e40314c0 comp rx=0 tx=0).stop 2024-08-31T04:37:53.851 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:53.849+0000 7ff6e9e00640 1 --2- 172.21.15.50:0/752229652 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7ff6d00b4c30 0x7ff6d00b7140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:37:53.851 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:53.849+0000 7ff6f7a77740 1 -- 172.21.15.50:0/1281880333 shutdown_connections 2024-08-31T04:37:53.851 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:53.849+0000 7ff6f7a77740 1 --2- 172.21.15.50:0/1281880333 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56486d4ab4d0 0x56486d873160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:53.851 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:53.849+0000 7ff6f7a77740 1 --2- 172.21.15.50:0/1281880333 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56486d4a32f0 0x56486d872610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:53.851 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:53.849+0000 7ff6f7a77740 1 --2- 172.21.15.50:0/1281880333 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56486d4cc1b0 0x56486d871fa0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:53.851 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:53.849+0000 7ff6f7a77740 1 -- 172.21.15.50:0/1281880333 >> 172.21.15.50:0/1281880333 conn(0x56486d4c0300 msgr2=0x56486d86da30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:37:53.851 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:53.850+0000 7ff6f7a77740 1 -- 172.21.15.50:0/1281880333 shutdown_connections 2024-08-31T04:37:53.851 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:53.850+0000 7ff6f7a77740 1 -- 172.21.15.50:0/1281880333 wait complete. 2024-08-31T04:37:53.853 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:53.850+0000 7ff6e9e00640 1 --2- 172.21.15.50:0/752229652 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7ff6d00b4c30 0x7ff6d00b7140 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7ff6dc00d240 tx=0x7ff6dc00f040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:37:53.854 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:53.850+0000 7ff6f7a77740 1 -- start start 2024-08-31T04:37:53.854 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:53.850+0000 7ff6f7a77740 1 Processor -- start 2024-08-31T04:37:53.854 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:53.851+0000 7ff6f7a77740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56486d4a32f0 0x56486d87b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:37:53.854 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:53.851+0000 7ff6f7a77740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56486d4ab4d0 0x56486d87bc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:37:53.854 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:53.851+0000 7ff6f7a77740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56486d4cc1b0 0x56486d87c7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:37:53.854 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:53.851+0000 7ff6f7a77740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x56486d70dab0 con 0x56486d4a32f0 2024-08-31T04:37:53.854 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:53.851+0000 7ff6f7a77740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x56486d77b320 con 0x56486d4cc1b0 2024-08-31T04:37:53.854 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:53.851+0000 7ff6f7a77740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x56486d873c20 con 0x56486d4ab4d0 2024-08-31T04:37:53.854 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:53.851+0000 7ff6f7a77740 10 client.0 _ll_register_callbacks cb 0x56486d7816a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:37:53.854 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:53.851+0000 7ff6e9400640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56486d4ab4d0 0x56486d87bc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:37:53.854 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:53.851+0000 7ff6e9e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56486d4a32f0 0x56486d87b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:37:53.854 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:53.851+0000 7ff6ea800640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56486d4cc1b0 0x56486d87c7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:37:53.854 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:53.851+0000 7ff6e9400640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56486d4ab4d0 0x56486d87bc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.50:45014/0 (socket says 172.21.15.50:45014) 2024-08-31T04:37:53.854 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:53.851+0000 7ff6e9400640 1 -- 172.21.15.50:0/1070111621 learned_addr learned my addr 172.21.15.50:0/1070111621 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:37:53.855 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:53.851+0000 7ff6e9400640 1 -- 172.21.15.50:0/1070111621 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56486d4cc1b0 msgr2=0x56486d87c7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:37:53.855 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:53.851+0000 7ff6e9400640 1 --2- 172.21.15.50:0/1070111621 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56486d4cc1b0 0x56486d87c7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:53.855 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:53.851+0000 7ff6e9400640 1 -- 172.21.15.50:0/1070111621 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56486d4a32f0 msgr2=0x56486d87b5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:37:53.855 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:53.851+0000 7ff6e9400640 1 --2- 172.21.15.50:0/1070111621 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56486d4a32f0 0x56486d87b5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:53.855 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:53.852+0000 7ff6e9400640 1 -- 172.21.15.50:0/1070111621 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56486d537790 con 0x56486d4ab4d0 2024-08-31T04:37:53.855 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:53.852+0000 7ff6e9400640 1 --2- 172.21.15.50:0/1070111621 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56486d4ab4d0 0x56486d87bc80 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7ff6d800c6a0 tx=0x7ff6d80a7ed0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e12e0bbca754931a server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:37:53.855 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:53.852+0000 7ff6cb400640 10 client.0 ms_handle_connect on v2:172.21.15.177:3300/0 2024-08-31T04:37:53.855 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:53.852+0000 7ff6cb400640 1 -- 172.21.15.50:0/1070111621 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6d80ab780 con 0x56486d4ab4d0 2024-08-31T04:37:53.855 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:53.852+0000 7ff6cb400640 1 -- 172.21.15.50:0/1070111621 <== mon.1 v2:172.21.15.177:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8219+0+0 (secure 0 0 0) 0x7ff6d8010430 con 0x56486d4ab4d0 2024-08-31T04:37:53.855 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:53.852+0000 7ff6f7a77740 1 -- 172.21.15.50:0/1070111621 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff6e4037040 con 0x56486d4ab4d0 2024-08-31T04:37:53.855 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:53.852+0000 7ff6cb400640 1 -- 172.21.15.50:0/1070111621 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_get_version_reply(handle=1 version=71) ==== 24+0+0 (secure 0 0 0) 0x7ff6d80abb20 con 0x56486d4ab4d0 2024-08-31T04:37:53.855 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:53.852+0000 7ff6f7a77740 10 client.26677 fetch_fsmap learned FSMap version 71 2024-08-31T04:37:53.855 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:53.852+0000 7ff6f7a77740 1 -- 172.21.15.50:0/1070111621 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,fsmap=71,monmap=4+}) -- 0x56486d5b0620 con 0x56486d4ab4d0 2024-08-31T04:37:53.855 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:53.852+0000 7ff6cb400640 1 -- 172.21.15.50:0/1070111621 <== mon.1 v2:172.21.15.177:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff6e4037040 con 0x56486d4ab4d0 2024-08-31T04:37:53.857 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:53.853+0000 7ff6cb400640 1 -- 172.21.15.50:0/1070111621 <== mon.1 v2:172.21.15.177:3300/0 5 ==== fsmap(e 71) ==== 8442+0+0 (secure 0 0 0) 0x7ff6d80e50d0 con 0x56486d4ab4d0 2024-08-31T04:37:53.857 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:53.853+0000 7ff6f7a77740 10 client.26677 fetch_fsmap finished waiting for FSMap version 71 2024-08-31T04:37:53.857 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:53.853+0000 7ff6f7a77740 10 client.26677 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T04:37:53.857 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:53.853+0000 7ff6f7a77740 20 client.26677 populate_metadata read hostname 'smithi050' 2024-08-31T04:37:53.857 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:53.853+0000 7ff6f7a77740 1 --2- 172.21.15.50:0/1070111621 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x56486d48ad80 0x56486d888e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:37:53.857 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:53.853+0000 7ff6f7a77740 4 client.26677 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T04:37:53.857 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:53.853+0000 7ff6f7a77740 1 -- 172.21.15.50:0/1070111621 --> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56486d7e6ec0 con 0x56486d48ad80 2024-08-31T04:37:53.857 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:53.853+0000 7ff6e9e00640 1 --2- 172.21.15.50:0/1070111621 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x56486d48ad80 0x56486d888e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:37:53.857 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:53.854+0000 7ff6e9e00640 1 --2- 172.21.15.50:0/1070111621 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x56486d48ad80 0x56486d888e00 crc :-1 s=READY pgs=179 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=98dd67ac7c0fa5b5 server_cookie=e4d8573cdb33fdb in_seq=0 out_seq=0 2024-08-31T04:37:53.858 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:53.854+0000 7ff6cb400640 10 client.26677 ms_handle_connect on v2:172.21.15.133:6838/2526402262 2024-08-31T04:37:53.858 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:53.855+0000 7ff6cb400640 1 -- 172.21.15.50:0/1070111621 <== mds.0 v2:172.21.15.133:6838/2526402262 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56486d7e6ec0 con 0x56486d48ad80 2024-08-31T04:37:53.858 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:53.855+0000 7ff6cb400640 10 client.26677 handle_command_reply: tid=0 2024-08-31T04:37:53.858 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:53.855+0000 7ff6f7a77740 1 client.26677 shutdown 2024-08-31T04:37:53.858 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:53.855+0000 7ff6f7a77740 1 -- 172.21.15.50:0/1070111621 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56486d4ab4d0 msgr2=0x56486d87bc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:37:53.858 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:53.855+0000 7ff6f7a77740 1 --2- 172.21.15.50:0/1070111621 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56486d4ab4d0 0x56486d87bc80 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7ff6d800c6a0 tx=0x7ff6d80a7ed0 comp rx=0 tx=0).stop 2024-08-31T04:37:53.858 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:53.855+0000 7ff6f7a77740 1 -- 172.21.15.50:0/1070111621 shutdown_connections 2024-08-31T04:37:53.858 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:53.855+0000 7ff6f7a77740 1 --2- 172.21.15.50:0/1070111621 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x56486d48ad80 0x56486d888e00 crc :-1 s=READY pgs=179 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:53.858 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:53.855+0000 7ff6f7a77740 1 --2- 172.21.15.50:0/1070111621 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56486d4ab4d0 0x56486d87bc80 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:53.858 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:53.855+0000 7ff6f7a77740 1 --2- 172.21.15.50:0/1070111621 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56486d4cc1b0 0x56486d87c7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:53.858 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:53.855+0000 7ff6f7a77740 1 --2- 172.21.15.50:0/1070111621 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56486d4a32f0 0x56486d87b5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:53.858 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:53.855+0000 7ff6cb400640 0 client.26677 ms_handle_reset on v2:172.21.15.133:6838/2526402262 2024-08-31T04:37:53.858 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:53.855+0000 7ff6f7a77740 1 -- 172.21.15.50:0/1070111621 >> 172.21.15.50:0/1070111621 conn(0x56486d4c0300 msgr2=0x56486d86bf40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:37:53.858 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:53.855+0000 7ff6f7a77740 1 -- 172.21.15.50:0/1070111621 shutdown_connections 2024-08-31T04:37:53.858 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:53.855+0000 7ff6f7a77740 1 -- 172.21.15.50:0/1070111621 wait complete. 2024-08-31T04:37:53.859 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:53.855+0000 7ff6f7a77740 20 client.26677 trim_cache size 0 max 16384 2024-08-31T04:37:53.874 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:53.872+0000 7ff6f7a77740 1 Processor -- start 2024-08-31T04:37:53.874 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:53.872+0000 7ff6f7a77740 1 -- start start 2024-08-31T04:37:53.874 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:53.873+0000 7ff6f7a77740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56486d4a32f0 0x56486d86d370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:37:53.874 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:53.873+0000 7ff6f7a77740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56486d4ab4d0 0x56486d86ef00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:37:53.874 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:53.873+0000 7ff6f7a77740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56486d4cc1b0 0x56486d872e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:37:53.874 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:53.873+0000 7ff6f7a77740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7ff6ec1a8860 con 0x56486d4a32f0 2024-08-31T04:37:53.874 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:53.873+0000 7ff6f7a77740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7ff6ec1aa5e0 con 0x56486d4ab4d0 2024-08-31T04:37:53.875 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:53.873+0000 7ff6f7a77740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7ff6ec1a8ff0 con 0x56486d4cc1b0 2024-08-31T04:37:53.875 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:53.873+0000 7ff6ea800640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56486d4cc1b0 0x56486d872e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:37:53.875 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:53.873+0000 7ff6e9400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56486d4ab4d0 0x56486d86ef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:37:53.875 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:53.873+0000 7ff6e9e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56486d4a32f0 0x56486d86d370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:37:53.875 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:53.873+0000 7ff6ea800640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56486d4cc1b0 0x56486d872e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.50:45028/0 (socket says 172.21.15.50:45028) 2024-08-31T04:37:53.875 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:53.873+0000 7ff6ea800640 1 -- 172.21.15.50:0/794367918 learned_addr learned my addr 172.21.15.50:0/794367918 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:37:53.876 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:53.873+0000 7ff6e9400640 1 -- 172.21.15.50:0/794367918 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56486d4cc1b0 msgr2=0x56486d872e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:37:53.876 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:53.873+0000 7ff6e9400640 1 --2- 172.21.15.50:0/794367918 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56486d4cc1b0 0x56486d872e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:53.877 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:53.873+0000 7ff6e9400640 1 -- 172.21.15.50:0/794367918 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56486d4a32f0 msgr2=0x56486d86d370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:37:53.877 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:53.873+0000 7ff6e9400640 1 --2- 172.21.15.50:0/794367918 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56486d4a32f0 0x56486d86d370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:53.877 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:53.873+0000 7ff6e9400640 1 -- 172.21.15.50:0/794367918 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56486d87b350 con 0x56486d4ab4d0 2024-08-31T04:37:53.877 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:53.873+0000 7ff6ea800640 1 --2- 172.21.15.50:0/794367918 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56486d4cc1b0 0x56486d872e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:37:53.877 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:53.874+0000 7ff6e9400640 1 --2- 172.21.15.50:0/794367918 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56486d4ab4d0 0x56486d86ef00 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7ff6d80e8d90 tx=0x7ff6d80e8bc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=93815a53d49f7b21 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:37:53.877 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:53.874+0000 7ff6d6600640 1 -- 172.21.15.50:0/794367918 <== mon.2 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6d80ac710 con 0x56486d4ab4d0 2024-08-31T04:37:53.877 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:53.874+0000 7ff6d6600640 1 -- 172.21.15.50:0/794367918 <== mon.2 v2:172.21.15.133:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff6d8091e50 con 0x56486d4ab4d0 2024-08-31T04:37:53.877 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:53.874+0000 7ff6d6600640 1 -- 172.21.15.50:0/794367918 <== mon.2 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6d80a7ac0 con 0x56486d4ab4d0 2024-08-31T04:37:53.877 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:53.875+0000 7ff6f7a77740 1 -- 172.21.15.50:0/794367918 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56486d4ab4d0 msgr2=0x56486d86ef00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:37:53.877 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:53.875+0000 7ff6f7a77740 1 --2- 172.21.15.50:0/794367918 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56486d4ab4d0 0x56486d86ef00 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7ff6d80e8d90 tx=0x7ff6d80e8bc0 comp rx=0 tx=0).stop 2024-08-31T04:37:53.877 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:53.875+0000 7ff6f7a77740 1 -- 172.21.15.50:0/794367918 shutdown_connections 2024-08-31T04:37:53.877 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:53.875+0000 7ff6f7a77740 1 --2- 172.21.15.50:0/794367918 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56486d4cc1b0 0x56486d872e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:53.877 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:53.875+0000 7ff6f7a77740 1 --2- 172.21.15.50:0/794367918 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56486d4ab4d0 0x56486d86ef00 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:53.877 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:53.875+0000 7ff6f7a77740 1 --2- 172.21.15.50:0/794367918 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56486d4a32f0 0x56486d86d370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:53.878 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:53.875+0000 7ff6f7a77740 1 -- 172.21.15.50:0/794367918 >> 172.21.15.50:0/794367918 conn(0x56486d4c0300 msgr2=0x56486d87a7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:37:53.878 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:53.875+0000 7ff6f7a77740 1 -- 172.21.15.50:0/794367918 shutdown_connections 2024-08-31T04:37:53.878 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:53.875+0000 7ff6f7a77740 1 -- 172.21.15.50:0/794367918 wait complete. 2024-08-31T04:37:53.878 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:53.875+0000 7ff6f7a77740 1 -- start start 2024-08-31T04:37:53.878 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:53.875+0000 7ff6f7a77740 1 Processor -- start 2024-08-31T04:37:53.880 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:53.876+0000 7ff6f7a77740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56486d4a32f0 0x56486d8835d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:37:53.880 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:53.876+0000 7ff6f7a77740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56486d4ab4d0 0x56486d8822d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:37:53.880 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:53.876+0000 7ff6f7a77740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56486d4cc1b0 0x56486d8829e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:37:53.880 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:53.876+0000 7ff6f7a77740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7ff6ec1a9f10 con 0x56486d4ab4d0 2024-08-31T04:37:53.881 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:53.876+0000 7ff6f7a77740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7ff6ec1a9780 con 0x56486d4cc1b0 2024-08-31T04:37:53.881 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:53.876+0000 7ff6f7a77740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7ff6ec1a6840 con 0x56486d4a32f0 2024-08-31T04:37:53.881 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:53.876+0000 7ff6f7a77740 10 client.0 _ll_register_callbacks cb 0x7ff6d80e8ce0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:37:53.881 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:53.876+0000 7ff6e9400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56486d4ab4d0 0x56486d8822d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:37:53.881 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:53.876+0000 7ff6e9e00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56486d4a32f0 0x56486d8835d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:37:53.881 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:53.876+0000 7ff6ea800640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56486d4cc1b0 0x56486d8829e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:37:53.881 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:53.876+0000 7ff6e9e00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56486d4a32f0 0x56486d8835d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.50:45032/0 (socket says 172.21.15.50:45032) 2024-08-31T04:37:53.881 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:53.876+0000 7ff6e9e00640 1 -- 172.21.15.50:0/3959446878 learned_addr learned my addr 172.21.15.50:0/3959446878 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:37:53.881 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:53.876+0000 7ff6e9e00640 1 -- 172.21.15.50:0/3959446878 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56486d4cc1b0 msgr2=0x56486d8829e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:37:53.881 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:53.876+0000 7ff6e9e00640 1 --2- 172.21.15.50:0/3959446878 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56486d4cc1b0 0x56486d8829e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:53.881 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:53.877+0000 7ff6e9e00640 1 -- 172.21.15.50:0/3959446878 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56486d4ab4d0 msgr2=0x56486d8822d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:37:53.881 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:53.877+0000 7ff6e9e00640 1 --2- 172.21.15.50:0/3959446878 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56486d4ab4d0 0x56486d8822d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:53.881 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:53.877+0000 7ff6e9e00640 1 -- 172.21.15.50:0/3959446878 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56486d880ea0 con 0x56486d4a32f0 2024-08-31T04:37:53.882 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:53.877+0000 7ff6e9e00640 1 --2- 172.21.15.50:0/3959446878 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56486d4a32f0 0x56486d8835d0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x56486d889530 tx=0x7ff6dc004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7455951eec0db789 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:37:53.882 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:53.877+0000 7ff6cb400640 10 client.0 ms_handle_connect on v2:172.21.15.177:3300/0 2024-08-31T04:37:53.882 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:53.877+0000 7ff6cb400640 1 -- 172.21.15.50:0/3959446878 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6dc028cd0 con 0x56486d4a32f0 2024-08-31T04:37:53.882 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:53.877+0000 7ff6f7a77740 1 -- 172.21.15.50:0/3959446878 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff6d8091e50 con 0x56486d4a32f0 2024-08-31T04:37:53.882 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:53.877+0000 7ff6cb400640 1 -- 172.21.15.50:0/3959446878 <== mon.1 v2:172.21.15.177:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8219+0+0 (secure 0 0 0) 0x7ff6dc005020 con 0x56486d4a32f0 2024-08-31T04:37:53.882 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:53.877+0000 7ff6cb400640 1 -- 172.21.15.50:0/3959446878 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_get_version_reply(handle=1 version=71) ==== 24+0+0 (secure 0 0 0) 0x7ff6dc005220 con 0x56486d4a32f0 2024-08-31T04:37:53.882 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:53.877+0000 7ff6f7a77740 10 client.26683 fetch_fsmap learned FSMap version 71 2024-08-31T04:37:53.882 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:53.878+0000 7ff6f7a77740 1 -- 172.21.15.50:0/3959446878 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,fsmap=71,monmap=4+}) -- 0x56486d8f3a40 con 0x56486d4a32f0 2024-08-31T04:37:53.882 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:53.878+0000 7ff6cb400640 1 -- 172.21.15.50:0/3959446878 <== mon.1 v2:172.21.15.177:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff6d8091e50 con 0x56486d4a32f0 2024-08-31T04:37:53.882 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:53.878+0000 7ff6cb400640 1 -- 172.21.15.50:0/3959446878 <== mon.1 v2:172.21.15.177:3300/0 5 ==== fsmap(e 71) ==== 8442+0+0 (secure 0 0 0) 0x7ff6dc038420 con 0x56486d4a32f0 2024-08-31T04:37:53.882 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:53.878+0000 7ff6f7a77740 10 client.26683 fetch_fsmap finished waiting for FSMap version 71 2024-08-31T04:37:53.882 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:53.878+0000 7ff6f7a77740 10 client.26683 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T04:37:53.882 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:53.878+0000 7ff6f7a77740 20 client.26683 populate_metadata read hostname 'smithi050' 2024-08-31T04:37:53.882 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:53.878+0000 7ff6f7a77740 1 --2- 172.21.15.50:0/3959446878 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x56486d4601c0 0x56486d8f64d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:37:53.883 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:53.878+0000 7ff6f7a77740 4 client.26683 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-31T04:37:53.883 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:53.878+0000 7ff6f7a77740 1 -- 172.21.15.50:0/3959446878 --> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] -- command(tid 0: {"prefix": "flush journal"}) -- 0x56486d7e2960 con 0x56486d4601c0 2024-08-31T04:37:53.883 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:53.879+0000 7ff6e9400640 1 --2- 172.21.15.50:0/3959446878 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x56486d4601c0 0x56486d8f64d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:37:53.883 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:53.879+0000 7ff6e9400640 1 --2- 172.21.15.50:0/3959446878 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x56486d4601c0 0x56486d8f64d0 crc :-1 s=READY pgs=180 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=92cbe8efc726877f server_cookie=96768ff829f42d37 in_seq=0 out_seq=0 2024-08-31T04:37:53.883 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:53.879+0000 7ff6cb400640 10 client.26683 ms_handle_connect on v2:172.21.15.133:6838/2526402262 2024-08-31T04:37:53.893 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:53.892+0000 7ff6cb400640 1 -- 172.21.15.50:0/3959446878 <== mds.0 v2:172.21.15.133:6838/2526402262 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x56486d7e2960 con 0x56486d4601c0 2024-08-31T04:37:53.894 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:53.892+0000 7ff6cb400640 10 client.26683 handle_command_reply: tid=0 2024-08-31T04:37:53.894 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:53.892+0000 7ff6f7a77740 1 client.26683 shutdown 2024-08-31T04:37:53.894 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:53.892+0000 7ff6f7a77740 1 -- 172.21.15.50:0/3959446878 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56486d4a32f0 msgr2=0x56486d8835d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:37:53.894 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:53.892+0000 7ff6f7a77740 1 --2- 172.21.15.50:0/3959446878 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56486d4a32f0 0x56486d8835d0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x56486d889530 tx=0x7ff6dc004730 comp rx=0 tx=0).stop 2024-08-31T04:37:53.894 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:53.892+0000 7ff6f7a77740 1 -- 172.21.15.50:0/3959446878 shutdown_connections 2024-08-31T04:37:53.894 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:53.892+0000 7ff6f7a77740 1 --2- 172.21.15.50:0/3959446878 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x56486d4601c0 0x56486d8f64d0 crc :-1 s=READY pgs=180 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:53.894 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:53.892+0000 7ff6f7a77740 1 --2- 172.21.15.50:0/3959446878 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56486d4cc1b0 0x56486d8829e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:53.894 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:53.892+0000 7ff6f7a77740 1 --2- 172.21.15.50:0/3959446878 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56486d4ab4d0 0x56486d8822d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:53.894 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:53.892+0000 7ff6f7a77740 1 --2- 172.21.15.50:0/3959446878 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56486d4a32f0 0x56486d8835d0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:53.894 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:53.892+0000 7ff6cb400640 0 client.26683 ms_handle_reset on v2:172.21.15.133:6838/2526402262 2024-08-31T04:37:53.894 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:53.892+0000 7ff6f7a77740 1 -- 172.21.15.50:0/3959446878 >> 172.21.15.50:0/3959446878 conn(0x56486d4c0300 msgr2=0x56486d872e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:37:53.894 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:53.892+0000 7ff6f7a77740 1 -- 172.21.15.50:0/3959446878 shutdown_connections 2024-08-31T04:37:53.895 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:53.892+0000 7ff6f7a77740 1 -- 172.21.15.50:0/3959446878 wait complete. 2024-08-31T04:37:53.895 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:53.892+0000 7ff6f7a77740 20 client.26683 trim_cache size 0 max 16384 2024-08-31T04:37:53.895 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout:{ 2024-08-31T04:37:53.895 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout: "message": "", 2024-08-31T04:37:53.895 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout: "return_code": 0 2024-08-31T04:37:53.895 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout:} 2024-08-31T04:37:53.896 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:53.893+0000 7ff6eb200640 1 -- 172.21.15.50:0/752229652 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7ff6d00b4c30 msgr2=0x7ff6d00b7140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:37:53.896 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:53.893+0000 7ff6eb200640 1 --2- 172.21.15.50:0/752229652 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7ff6d00b4c30 0x7ff6d00b7140 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7ff6dc00d240 tx=0x7ff6dc00f040 comp rx=0 tx=0).stop 2024-08-31T04:37:53.896 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:53.893+0000 7ff6eb200640 1 -- 172.21.15.50:0/752229652 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff6ec103260 msgr2=0x7ff6ec197ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:37:53.896 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:53.893+0000 7ff6eb200640 1 --2- 172.21.15.50:0/752229652 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff6ec103260 0x7ff6ec197ee0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7ff6d800e9f0 tx=0x7ff6d800eeb0 comp rx=0 tx=0).stop 2024-08-31T04:37:53.896 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:53.893+0000 7ff6eb200640 1 -- 172.21.15.50:0/752229652 shutdown_connections 2024-08-31T04:37:53.896 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:53.893+0000 7ff6eb200640 1 --2- 172.21.15.50:0/752229652 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7ff6d00b4c30 0x7ff6d00b7140 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:53.896 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:53.893+0000 7ff6eb200640 1 --2- 172.21.15.50:0/752229652 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff6ec103c00 0x7ff6ec198a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:53.896 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:53.893+0000 7ff6eb200640 1 --2- 172.21.15.50:0/752229652 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff6ec103260 0x7ff6ec197ee0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:53.897 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:53.893+0000 7ff6eb200640 1 --2- 172.21.15.50:0/752229652 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff6ec1021e0 0x7ff6ec197870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:37:53.897 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:53.893+0000 7ff6eb200640 1 -- 172.21.15.50:0/752229652 >> 172.21.15.50:0/752229652 conn(0x7ff6ec0fdb20 msgr2=0x7ff6ec106580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:37:53.897 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:53.893+0000 7ff6eb200640 1 -- 172.21.15.50:0/752229652 shutdown_connections 2024-08-31T04:37:53.897 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:37:53.893+0000 7ff6eb200640 1 -- 172.21.15.50:0/752229652 wait complete. 2024-08-31T04:37:53.949 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:37:53 smithi050 ceph-mon[17259]: pgmap v818: 97 pgs: 97 active+clean; 817 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 655 KiB/s rd, 645 KiB/s wr, 163 op/s 2024-08-31T04:37:55.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:37:55 smithi177 ceph-mon[22025]: pgmap v819: 97 pgs: 97 active+clean; 808 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 555 KiB/s rd, 547 KiB/s wr, 184 op/s 2024-08-31T04:37:55.792 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:37:55 smithi133 ceph-mon[22177]: pgmap v819: 97 pgs: 97 active+clean; 808 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 555 KiB/s rd, 547 KiB/s wr, 184 op/s 2024-08-31T04:37:55.851 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:37:55 smithi050 ceph-mon[17259]: pgmap v819: 97 pgs: 97 active+clean; 808 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 555 KiB/s rd, 547 KiB/s wr, 184 op/s 2024-08-31T04:37:57.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:37:57 smithi177 ceph-mon[22025]: pgmap v820: 97 pgs: 97 active+clean; 794 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 658 KiB/s rd, 672 KiB/s wr, 256 op/s 2024-08-31T04:37:57.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:37:57 smithi133 ceph-mon[22177]: pgmap v820: 97 pgs: 97 active+clean; 794 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 658 KiB/s rd, 672 KiB/s wr, 256 op/s 2024-08-31T04:37:57.950 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:37:57 smithi050 ceph-mon[17259]: pgmap v820: 97 pgs: 97 active+clean; 794 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 658 KiB/s rd, 672 KiB/s wr, 256 op/s 2024-08-31T04:37:58.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:37:58 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T04:37:58.792 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:37:58 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T04:37:58.950 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:37:58 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T04:37:59.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:37:59 smithi177 ceph-mon[22025]: pgmap v821: 97 pgs: 97 active+clean; 792 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 959 KiB/s rd, 965 KiB/s wr, 260 op/s 2024-08-31T04:37:59.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:37:59 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:37:59.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:37:59 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T04:37:59.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:37:59 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:37:59.794 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:37:59 smithi133 ceph-mon[22177]: pgmap v821: 97 pgs: 97 active+clean; 792 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 959 KiB/s rd, 965 KiB/s wr, 260 op/s 2024-08-31T04:37:59.794 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:37:59 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:37:59.794 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:37:59 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T04:37:59.794 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:37:59 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:37:59.950 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:37:59 smithi050 ceph-mon[17259]: pgmap v821: 97 pgs: 97 active+clean; 792 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 959 KiB/s rd, 965 KiB/s wr, 260 op/s 2024-08-31T04:37:59.950 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:37:59 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:37:59.950 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:37:59 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T04:37:59.950 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:37:59 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:38:01.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:38:01 smithi177 ceph-mon[22025]: pgmap v822: 97 pgs: 97 active+clean; 787 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 864 KiB/s rd, 867 KiB/s wr, 270 op/s 2024-08-31T04:38:01.751 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:38:01 smithi050 ceph-mon[17259]: pgmap v822: 97 pgs: 97 active+clean; 787 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 864 KiB/s rd, 867 KiB/s wr, 270 op/s 2024-08-31T04:38:01.792 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:38:01 smithi133 ceph-mon[22177]: pgmap v822: 97 pgs: 97 active+clean; 787 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 864 KiB/s rd, 867 KiB/s wr, 270 op/s 2024-08-31T04:38:03.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:38:03 smithi177 ceph-mon[22025]: pgmap v823: 97 pgs: 97 active+clean; 783 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 946 KiB/s rd, 985 KiB/s wr, 280 op/s 2024-08-31T04:38:03.792 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:38:03 smithi133 ceph-mon[22177]: pgmap v823: 97 pgs: 97 active+clean; 783 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 946 KiB/s rd, 985 KiB/s wr, 280 op/s 2024-08-31T04:38:03.950 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:38:03 smithi050 ceph-mon[17259]: pgmap v823: 97 pgs: 97 active+clean; 783 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 946 KiB/s rd, 985 KiB/s wr, 280 op/s 2024-08-31T04:38:05.748 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:38:05 smithi177 ceph-mon[22025]: pgmap v824: 97 pgs: 97 active+clean; 779 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 508 KiB/s rd, 554 KiB/s wr, 230 op/s 2024-08-31T04:38:05.792 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:38:05 smithi133 ceph-mon[22177]: pgmap v824: 97 pgs: 97 active+clean; 779 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 508 KiB/s rd, 554 KiB/s wr, 230 op/s 2024-08-31T04:38:05.950 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:38:05 smithi050 ceph-mon[17259]: pgmap v824: 97 pgs: 97 active+clean; 779 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 508 KiB/s rd, 554 KiB/s wr, 230 op/s 2024-08-31T04:38:07.171 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:07.170+0000 7fc4a0a00640 1 -- 172.21.15.50:0/1510372903 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc49c103280 msgr2=0x7fc49c1036f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:38:07.172 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:07.170+0000 7fc4a0a00640 1 --2- 172.21.15.50:0/1510372903 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc49c103280 0x7fc49c1036f0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fc48c009900 tx=0x7fc48c02a3f0 comp rx=0 tx=0).stop 2024-08-31T04:38:07.172 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:07.170+0000 7fc4a0a00640 1 -- 172.21.15.50:0/1510372903 shutdown_connections 2024-08-31T04:38:07.172 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:07.170+0000 7fc4a0a00640 1 --2- 172.21.15.50:0/1510372903 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc49c104ca0 0x7fc49c10b640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:38:07.172 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:07.170+0000 7fc4a0a00640 1 --2- 172.21.15.50:0/1510372903 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc49c104300 0x7fc49c104710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:38:07.172 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:07.170+0000 7fc4a0a00640 1 --2- 172.21.15.50:0/1510372903 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc49c103280 0x7fc49c1036f0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:38:07.172 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:07.170+0000 7fc4a0a00640 1 -- 172.21.15.50:0/1510372903 >> 172.21.15.50:0/1510372903 conn(0x7fc49c0febc0 msgr2=0x7fc49c101070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:38:07.172 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:07.170+0000 7fc4a0a00640 1 -- 172.21.15.50:0/1510372903 shutdown_connections 2024-08-31T04:38:07.172 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:07.170+0000 7fc4a0a00640 1 -- 172.21.15.50:0/1510372903 wait complete. 2024-08-31T04:38:07.173 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:07.172+0000 7fc4a0a00640 1 Processor -- start 2024-08-31T04:38:07.173 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:07.172+0000 7fc4a0a00640 1 -- start start 2024-08-31T04:38:07.174 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:07.172+0000 7fc4a0a00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc49c103280 0x7fc49c1a00e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:38:07.174 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:07.173+0000 7fc4a0a00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc49c104300 0x7fc49c1a0750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:38:07.174 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:07.173+0000 7fc4a0a00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc49c104ca0 0x7fc49c1a1300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:38:07.174 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:07.173+0000 7fc4a0a00640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fc49c076f00 con 0x7fc49c104ca0 2024-08-31T04:38:07.174 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:07.173+0000 7fc4a0a00640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7fc49c076d80 con 0x7fc49c104300 2024-08-31T04:38:07.174 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:07.173+0000 7fc4a0a00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fc49c077080 con 0x7fc49c103280 2024-08-31T04:38:07.174 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:07.173+0000 7fc49a800640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc49c103280 0x7fc49c1a00e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:38:07.175 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:07.173+0000 7fc49a800640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc49c103280 0x7fc49c1a00e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.50:39912/0 (socket says 172.21.15.50:39912) 2024-08-31T04:38:07.175 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:07.173+0000 7fc49a800640 1 -- 172.21.15.50:0/1062471882 learned_addr learned my addr 172.21.15.50:0/1062471882 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:38:07.175 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:07.173+0000 7fc499e00640 1 --2- 172.21.15.50:0/1062471882 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc49c104300 0x7fc49c1a0750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:38:07.176 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:07.173+0000 7fc49b200640 1 --2- 172.21.15.50:0/1062471882 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc49c104ca0 0x7fc49c1a1300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:38:07.176 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:07.174+0000 7fc49a800640 1 -- 172.21.15.50:0/1062471882 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc49c104300 msgr2=0x7fc49c1a0750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:38:07.176 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:07.174+0000 7fc49a800640 1 --2- 172.21.15.50:0/1062471882 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc49c104300 0x7fc49c1a0750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:38:07.176 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:07.174+0000 7fc49a800640 1 -- 172.21.15.50:0/1062471882 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc49c104ca0 msgr2=0x7fc49c1a1300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:38:07.176 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:07.174+0000 7fc49a800640 1 --2- 172.21.15.50:0/1062471882 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc49c104ca0 0x7fc49c1a1300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:38:07.176 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:07.174+0000 7fc49a800640 1 -- 172.21.15.50:0/1062471882 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc49c1a1b20 con 0x7fc49c103280 2024-08-31T04:38:07.176 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:07.174+0000 7fc499e00640 1 --2- 172.21.15.50:0/1062471882 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc49c104300 0x7fc49c1a0750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:38:07.176 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:07.174+0000 7fc49b200640 1 --2- 172.21.15.50:0/1062471882 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc49c104ca0 0x7fc49c1a1300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T04:38:07.176 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:07.175+0000 7fc49a800640 1 --2- 172.21.15.50:0/1062471882 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc49c103280 0x7fc49c1a00e0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fc48c031440 tx=0x7fc48c003c10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:38:07.177 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:07.175+0000 7fc493400640 1 -- 172.21.15.50:0/1062471882 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc48c03f070 con 0x7fc49c103280 2024-08-31T04:38:07.177 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:07.175+0000 7fc4a0a00640 1 -- 172.21.15.50:0/1062471882 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc49c1a1db0 con 0x7fc49c103280 2024-08-31T04:38:07.177 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:07.175+0000 7fc4a0a00640 1 -- 172.21.15.50:0/1062471882 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc49c1a8500 con 0x7fc49c103280 2024-08-31T04:38:07.177 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:07.175+0000 7fc493400640 1 -- 172.21.15.50:0/1062471882 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc48c031c50 con 0x7fc49c103280 2024-08-31T04:38:07.177 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:07.175+0000 7fc493400640 1 -- 172.21.15.50:0/1062471882 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc48c035030 con 0x7fc49c103280 2024-08-31T04:38:07.181 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:07.180+0000 7fc4a83c8740 1 Processor -- start 2024-08-31T04:38:07.182 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:07.180+0000 7fc4a83c8740 1 -- start start 2024-08-31T04:38:07.182 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:07.181+0000 7fc4a83c8740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559a8f1d21b0 0x559a8f577d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:38:07.182 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:07.181+0000 7fc4a83c8740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559a8f1a92f0 0x559a8f5783b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:38:07.182 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:07.181+0000 7fc4a83c8740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559a8f1b14d0 0x559a8f578f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:38:07.183 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:07.181+0000 7fc4a83c8740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x559a8f4eaf70 con 0x559a8f1d21b0 2024-08-31T04:38:07.183 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:07.181+0000 7fc4a83c8740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x559a8f4da500 con 0x559a8f1b14d0 2024-08-31T04:38:07.183 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:07.181+0000 7fc4a83c8740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x559a8f4de4b0 con 0x559a8f1a92f0 2024-08-31T04:38:07.183 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:07.181+0000 7fc49b200640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559a8f1d21b0 0x559a8f577d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:38:07.183 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:07.181+0000 7fc493400640 1 -- 172.21.15.50:0/1062471882 <== mon.1 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 18) ==== 152577+0+0 (secure 0 0 0) 0x7fc48c042070 con 0x7fc49c103280 2024-08-31T04:38:07.183 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:07.181+0000 7fc49b200640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559a8f1d21b0 0x559a8f577d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53500/0 (socket says 172.21.15.50:53500) 2024-08-31T04:38:07.184 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:07.181+0000 7fc49b200640 1 -- 172.21.15.50:0/2784349240 learned_addr learned my addr 172.21.15.50:0/2784349240 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:38:07.184 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:07.181+0000 7fc49a800640 1 --2- 172.21.15.50:0/2784349240 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559a8f1a92f0 0x559a8f5783b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:38:07.184 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:07.182+0000 7fc49b200640 1 -- 172.21.15.50:0/2784349240 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559a8f1a92f0 msgr2=0x559a8f5783b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:38:07.184 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:07.182+0000 7fc499e00640 1 --2- 172.21.15.50:0/2784349240 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559a8f1b14d0 0x559a8f578f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:38:07.184 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:07.182+0000 7fc49b200640 1 --2- 172.21.15.50:0/2784349240 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559a8f1a92f0 0x559a8f5783b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:38:07.184 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:07.182+0000 7fc49b200640 1 -- 172.21.15.50:0/2784349240 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559a8f1b14d0 msgr2=0x559a8f578f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:38:07.184 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:07.182+0000 7fc49b200640 1 --2- 172.21.15.50:0/2784349240 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559a8f1b14d0 0x559a8f578f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:38:07.185 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:07.182+0000 7fc49b200640 1 -- 172.21.15.50:0/2784349240 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559a8f494c10 con 0x559a8f1d21b0 2024-08-31T04:38:07.185 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:07.182+0000 7fc499e00640 1 --2- 172.21.15.50:0/2784349240 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559a8f1b14d0 0x559a8f578f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T04:38:07.185 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:07.182+0000 7fc49a800640 1 --2- 172.21.15.50:0/2784349240 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559a8f1a92f0 0x559a8f5783b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:38:07.185 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:07.182+0000 7fc49b200640 1 --2- 172.21.15.50:0/2784349240 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559a8f1d21b0 0x559a8f577d40 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7fc494009f90 tx=0x7fc49400f7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab6e422879bc963e server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:38:07.185 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:07.183+0000 7fc487400640 1 -- 172.21.15.50:0/2784349240 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc494003b70 con 0x559a8f1d21b0 2024-08-31T04:38:07.186 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:07.184+0000 7fc487400640 1 -- 172.21.15.50:0/2784349240 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc494003d10 con 0x559a8f1d21b0 2024-08-31T04:38:07.186 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:07.184+0000 7fc487400640 1 -- 172.21.15.50:0/2784349240 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4940119c0 con 0x559a8f1d21b0 2024-08-31T04:38:07.186 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:07.184+0000 7fc493400640 1 --2- 172.21.15.50:0/1062471882 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fc4800b4c30 0x7fc4800b7140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:38:07.186 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:07.184+0000 7fc493400640 1 -- 172.21.15.50:0/1062471882 <== mon.1 v2:172.21.15.177:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8219+0+0 (secure 0 0 0) 0x7fc48c105920 con 0x7fc49c103280 2024-08-31T04:38:07.186 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:07.184+0000 7fc49a800640 1 --2- 172.21.15.50:0/1062471882 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fc4800b4c30 0x7fc4800b7140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:38:07.187 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:07.185+0000 7fc4a83c8740 1 -- 172.21.15.50:0/2784349240 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559a8f1d21b0 msgr2=0x559a8f577d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:38:07.187 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:07.185+0000 7fc4a83c8740 1 --2- 172.21.15.50:0/2784349240 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559a8f1d21b0 0x559a8f577d40 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7fc494009f90 tx=0x7fc49400f7f0 comp rx=0 tx=0).stop 2024-08-31T04:38:07.187 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:07.185+0000 7fc4a83c8740 1 -- 172.21.15.50:0/2784349240 shutdown_connections 2024-08-31T04:38:07.187 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:07.185+0000 7fc4a83c8740 1 --2- 172.21.15.50:0/2784349240 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559a8f1a92f0 0x559a8f5783b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:38:07.187 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:07.185+0000 7fc4a83c8740 1 --2- 172.21.15.50:0/2784349240 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559a8f1b14d0 0x559a8f578f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:38:07.187 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:07.185+0000 7fc4a83c8740 1 --2- 172.21.15.50:0/2784349240 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559a8f1d21b0 0x559a8f577d40 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:38:07.187 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:07.185+0000 7fc4a83c8740 1 -- 172.21.15.50:0/2784349240 >> 172.21.15.50:0/2784349240 conn(0x559a8f1c6300 msgr2=0x559a8f5737d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:38:07.187 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:07.185+0000 7fc49a800640 1 --2- 172.21.15.50:0/1062471882 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fc4800b4c30 0x7fc4800b7140 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fc48c0cc000 tx=0x7fc48c03b790 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:38:07.187 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:07.185+0000 7fc4a83c8740 1 -- 172.21.15.50:0/2784349240 shutdown_connections 2024-08-31T04:38:07.187 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:07.185+0000 7fc4a83c8740 1 -- 172.21.15.50:0/2784349240 wait complete. 2024-08-31T04:38:07.188 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:07.186+0000 7fc4a83c8740 1 -- start start 2024-08-31T04:38:07.188 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:07.186+0000 7fc4a83c8740 1 Processor -- start 2024-08-31T04:38:07.188 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:07.187+0000 7fc4a83c8740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559a8f1a92f0 0x559a8f5924a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:38:07.189 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:07.187+0000 7fc4a83c8740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559a8f1b14d0 0x559a8f592b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:38:07.189 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:07.187+0000 7fc4a83c8740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559a8f1d21b0 0x559a8f5936d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:38:07.189 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:07.187+0000 7fc4a83c8740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x559a8f413ab0 con 0x559a8f1a92f0 2024-08-31T04:38:07.189 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:07.187+0000 7fc4a83c8740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x559a8f481320 con 0x559a8f1d21b0 2024-08-31T04:38:07.189 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:07.187+0000 7fc4a83c8740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x559a8f579a20 con 0x559a8f1b14d0 2024-08-31T04:38:07.189 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:07.187+0000 7fc4a83c8740 10 client.0 _ll_register_callbacks cb 0x559a8f4bae80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:38:07.189 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:07.187+0000 7fc499e00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559a8f1b14d0 0x559a8f592b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:38:07.190 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:07.187+0000 7fc499e00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559a8f1b14d0 0x559a8f592b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.50:39932/0 (socket says 172.21.15.50:39932) 2024-08-31T04:38:07.190 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:07.187+0000 7fc499e00640 1 -- 172.21.15.50:0/653819961 learned_addr learned my addr 172.21.15.50:0/653819961 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:38:07.191 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:07.188+0000 7fc49b200640 1 --2- 172.21.15.50:0/653819961 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559a8f1a92f0 0x559a8f5924a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:38:07.191 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:07.188+0000 7fc49b200640 1 --2- 172.21.15.50:0/653819961 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559a8f1d21b0 0x559a8f5936d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:38:07.191 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:07.188+0000 7fc499e00640 1 -- 172.21.15.50:0/653819961 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559a8f1d21b0 msgr2=0x559a8f5936d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:38:07.191 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:07.188+0000 7fc499e00640 1 --2- 172.21.15.50:0/653819961 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559a8f1d21b0 0x559a8f5936d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:38:07.191 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:07.188+0000 7fc499e00640 1 -- 172.21.15.50:0/653819961 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559a8f1a92f0 msgr2=0x559a8f5924a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:38:07.191 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:07.188+0000 7fc499e00640 1 --2- 172.21.15.50:0/653819961 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559a8f1a92f0 0x559a8f5924a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:38:07.191 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:07.188+0000 7fc499e00640 1 -- 172.21.15.50:0/653819961 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559a8f23d790 con 0x559a8f1b14d0 2024-08-31T04:38:07.191 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:07.188+0000 7fc49b200640 1 --2- 172.21.15.50:0/653819961 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559a8f1d21b0 0x559a8f5936d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T04:38:07.191 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:07.188+0000 7fc499e00640 1 --2- 172.21.15.50:0/653819961 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559a8f1b14d0 0x559a8f592b60 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fc488012700 tx=0x7fc488012bc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=68ccf743adc8b7c1 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:38:07.191 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:07.188+0000 7fc47be00640 10 client.0 ms_handle_connect on v2:172.21.15.177:3300/0 2024-08-31T04:38:07.191 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:07.189+0000 7fc47be00640 1 -- 172.21.15.50:0/653819961 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc48801f060 con 0x559a8f1b14d0 2024-08-31T04:38:07.191 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:07.189+0000 7fc47be00640 1 -- 172.21.15.50:0/653819961 <== mon.1 v2:172.21.15.177:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8219+0+0 (secure 0 0 0) 0x7fc488010dc0 con 0x559a8f1b14d0 2024-08-31T04:38:07.192 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:07.189+0000 7fc4a83c8740 1 -- 172.21.15.50:0/653819961 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc494003d10 con 0x559a8f1b14d0 2024-08-31T04:38:07.192 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:07.189+0000 7fc47be00640 1 -- 172.21.15.50:0/653819961 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_get_version_reply(handle=1 version=71) ==== 24+0+0 (secure 0 0 0) 0x7fc48801a430 con 0x559a8f1b14d0 2024-08-31T04:38:07.192 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:07.189+0000 7fc4a83c8740 10 client.26695 fetch_fsmap learned FSMap version 71 2024-08-31T04:38:07.192 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:07.189+0000 7fc4a83c8740 1 -- 172.21.15.50:0/653819961 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,fsmap=71,monmap=4+}) -- 0x559a8f2b6620 con 0x559a8f1b14d0 2024-08-31T04:38:07.192 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:07.189+0000 7fc47be00640 1 -- 172.21.15.50:0/653819961 <== mon.1 v2:172.21.15.177:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc494003d10 con 0x559a8f1b14d0 2024-08-31T04:38:07.192 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:07.190+0000 7fc47be00640 1 -- 172.21.15.50:0/653819961 <== mon.1 v2:172.21.15.177:3300/0 5 ==== fsmap(e 71) ==== 8442+0+0 (secure 0 0 0) 0x7fc48800e570 con 0x559a8f1b14d0 2024-08-31T04:38:07.193 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:07.190+0000 7fc4a83c8740 10 client.26695 fetch_fsmap finished waiting for FSMap version 71 2024-08-31T04:38:07.193 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:07.190+0000 7fc4a83c8740 10 client.26695 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T04:38:07.193 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:07.190+0000 7fc4a83c8740 20 client.26695 populate_metadata read hostname 'smithi050' 2024-08-31T04:38:07.193 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:07.190+0000 7fc4a83c8740 1 --2- 172.21.15.50:0/653819961 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x559a8f190d80 0x559a8f59fd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:38:07.193 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:07.190+0000 7fc4a83c8740 4 client.26695 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T04:38:07.193 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:07.190+0000 7fc4a83c8740 1 -- 172.21.15.50:0/653819961 --> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559a8f4ecec0 con 0x559a8f190d80 2024-08-31T04:38:07.193 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:07.190+0000 7fc49b200640 1 --2- 172.21.15.50:0/653819961 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x559a8f190d80 0x559a8f59fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:38:07.194 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:07.193+0000 7fc49b200640 1 --2- 172.21.15.50:0/653819961 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x559a8f190d80 0x559a8f59fd40 crc :-1 s=READY pgs=181 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=64442e795f7f0911 server_cookie=d2123143887b2ffb in_seq=0 out_seq=0 2024-08-31T04:38:07.194 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:07.193+0000 7fc47be00640 10 client.26695 ms_handle_connect on v2:172.21.15.133:6838/2526402262 2024-08-31T04:38:07.195 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:07.194+0000 7fc47be00640 1 -- 172.21.15.50:0/653819961 <== mds.0 v2:172.21.15.133:6838/2526402262 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x559a8f4ecec0 con 0x559a8f190d80 2024-08-31T04:38:07.195 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:07.194+0000 7fc47be00640 10 client.26695 handle_command_reply: tid=0 2024-08-31T04:38:07.195 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:07.194+0000 7fc4a83c8740 1 client.26695 shutdown 2024-08-31T04:38:07.196 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:07.194+0000 7fc4a83c8740 1 -- 172.21.15.50:0/653819961 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559a8f1b14d0 msgr2=0x559a8f592b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:38:07.196 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:07.194+0000 7fc4a83c8740 1 --2- 172.21.15.50:0/653819961 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559a8f1b14d0 0x559a8f592b60 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fc488012700 tx=0x7fc488012bc0 comp rx=0 tx=0).stop 2024-08-31T04:38:07.196 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:07.194+0000 7fc4a83c8740 1 -- 172.21.15.50:0/653819961 shutdown_connections 2024-08-31T04:38:07.196 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:07.194+0000 7fc4a83c8740 1 --2- 172.21.15.50:0/653819961 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x559a8f190d80 0x559a8f59fd40 crc :-1 s=READY pgs=181 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:38:07.196 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:07.194+0000 7fc4a83c8740 1 --2- 172.21.15.50:0/653819961 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559a8f1b14d0 0x559a8f592b60 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:38:07.196 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:07.194+0000 7fc4a83c8740 1 --2- 172.21.15.50:0/653819961 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559a8f1d21b0 0x559a8f5936d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:38:07.197 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:07.194+0000 7fc4a83c8740 1 --2- 172.21.15.50:0/653819961 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559a8f1a92f0 0x559a8f5924a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:38:07.197 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:07.194+0000 7fc4a83c8740 1 -- 172.21.15.50:0/653819961 >> 172.21.15.50:0/653819961 conn(0x559a8f1c6300 msgr2=0x559a8f571d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:38:07.197 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:07.194+0000 7fc47be00640 0 client.26695 ms_handle_reset on v2:172.21.15.133:6838/2526402262 2024-08-31T04:38:07.197 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:07.194+0000 7fc4a83c8740 1 -- 172.21.15.50:0/653819961 shutdown_connections 2024-08-31T04:38:07.197 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:07.194+0000 7fc4a83c8740 1 -- 172.21.15.50:0/653819961 wait complete. 2024-08-31T04:38:07.197 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:07.195+0000 7fc4a83c8740 20 client.26695 trim_cache size 0 max 16384 2024-08-31T04:38:07.212 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:07.210+0000 7fc4a83c8740 1 Processor -- start 2024-08-31T04:38:07.212 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:07.210+0000 7fc4a83c8740 1 -- start start 2024-08-31T04:38:07.212 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:07.211+0000 7fc4a83c8740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559a8f1a92f0 0x559a8f573110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:38:07.212 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:07.211+0000 7fc4a83c8740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559a8f1b14d0 0x559a8f56e490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:38:07.212 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:07.211+0000 7fc4a83c8740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559a8f1d21b0 0x559a8f57be50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:38:07.212 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:07.211+0000 7fc4a83c8740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fc47c00e420 con 0x559a8f1b14d0 2024-08-31T04:38:07.212 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:07.211+0000 7fc4a83c8740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7fc47c0101a0 con 0x559a8f1a92f0 2024-08-31T04:38:07.212 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:07.211+0000 7fc4a83c8740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fc47c00ebb0 con 0x559a8f1d21b0 2024-08-31T04:38:07.213 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:07.211+0000 7fc499e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559a8f1b14d0 0x559a8f56e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:38:07.213 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:07.211+0000 7fc49b200640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559a8f1a92f0 0x559a8f573110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:38:07.214 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:07.211+0000 7fc499e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559a8f1b14d0 0x559a8f56e490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53522/0 (socket says 172.21.15.50:53522) 2024-08-31T04:38:07.214 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:07.211+0000 7fc499e00640 1 -- 172.21.15.50:0/1097197616 learned_addr learned my addr 172.21.15.50:0/1097197616 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:38:07.214 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:07.211+0000 7fc49b200640 1 --2- 172.21.15.50:0/1097197616 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559a8f1d21b0 0x559a8f57be50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:38:07.214 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:07.211+0000 7fc499e00640 1 -- 172.21.15.50:0/1097197616 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559a8f1d21b0 msgr2=0x559a8f57be50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:38:07.214 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:07.211+0000 7fc499e00640 1 --2- 172.21.15.50:0/1097197616 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559a8f1d21b0 0x559a8f57be50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:38:07.214 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:07.211+0000 7fc499e00640 1 -- 172.21.15.50:0/1097197616 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559a8f1a92f0 msgr2=0x559a8f573110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:38:07.214 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:07.211+0000 7fc499e00640 1 --2- 172.21.15.50:0/1097197616 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559a8f1a92f0 0x559a8f573110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:38:07.214 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:07.211+0000 7fc499e00640 1 -- 172.21.15.50:0/1097197616 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559a8f573650 con 0x559a8f1b14d0 2024-08-31T04:38:07.214 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:07.212+0000 7fc499e00640 1 --2- 172.21.15.50:0/1097197616 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559a8f1b14d0 0x559a8f56e490 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7fc488000c00 tx=0x7fc488009ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=acd20a72f0129cb4 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:38:07.214 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:07.212+0000 7fc486a00640 1 -- 172.21.15.50:0/1097197616 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc48802a070 con 0x559a8f1b14d0 2024-08-31T04:38:07.214 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:07.212+0000 7fc486a00640 1 -- 172.21.15.50:0/1097197616 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc488010bc0 con 0x559a8f1b14d0 2024-08-31T04:38:07.214 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:07.212+0000 7fc486a00640 1 -- 172.21.15.50:0/1097197616 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc488003850 con 0x559a8f1b14d0 2024-08-31T04:38:07.217 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:07.213+0000 7fc4a83c8740 1 -- 172.21.15.50:0/1097197616 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559a8f1b14d0 msgr2=0x559a8f56e490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:38:07.217 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:07.213+0000 7fc4a83c8740 1 --2- 172.21.15.50:0/1097197616 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559a8f1b14d0 0x559a8f56e490 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7fc488000c00 tx=0x7fc488009ea0 comp rx=0 tx=0).stop 2024-08-31T04:38:07.217 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:07.213+0000 7fc4a83c8740 1 -- 172.21.15.50:0/1097197616 shutdown_connections 2024-08-31T04:38:07.217 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:07.213+0000 7fc4a83c8740 1 --2- 172.21.15.50:0/1097197616 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559a8f1d21b0 0x559a8f57be50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:38:07.217 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:07.213+0000 7fc4a83c8740 1 --2- 172.21.15.50:0/1097197616 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559a8f1b14d0 0x559a8f56e490 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:38:07.217 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:07.213+0000 7fc4a83c8740 1 --2- 172.21.15.50:0/1097197616 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559a8f1a92f0 0x559a8f573110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:38:07.217 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:07.213+0000 7fc4a83c8740 1 -- 172.21.15.50:0/1097197616 >> 172.21.15.50:0/1097197616 conn(0x559a8f1c6300 msgr2=0x559a8f578c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:38:07.217 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:07.213+0000 7fc4a83c8740 1 -- 172.21.15.50:0/1097197616 shutdown_connections 2024-08-31T04:38:07.217 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:07.213+0000 7fc4a83c8740 1 -- 172.21.15.50:0/1097197616 wait complete. 2024-08-31T04:38:07.218 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:07.213+0000 7fc4a83c8740 1 -- start start 2024-08-31T04:38:07.218 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:07.214+0000 7fc4a83c8740 1 Processor -- start 2024-08-31T04:38:07.218 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:07.214+0000 7fc4a83c8740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559a8f1a92f0 0x559a8f597650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:38:07.218 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:07.214+0000 7fc4a83c8740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559a8f1b14d0 0x559a8f597d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:38:07.218 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:07.214+0000 7fc4a83c8740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559a8f1d21b0 0x559a8f598880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:38:07.218 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:07.214+0000 7fc4a83c8740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fc47c00fad0 con 0x559a8f1d21b0 2024-08-31T04:38:07.218 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:07.214+0000 7fc4a83c8740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7fc47c00f340 con 0x559a8f1a92f0 2024-08-31T04:38:07.218 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:07.214+0000 7fc4a83c8740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fc47c00c400 con 0x559a8f1b14d0 2024-08-31T04:38:07.218 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:07.214+0000 7fc4a83c8740 10 client.0 _ll_register_callbacks cb 0x7fc4880096c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:38:07.218 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:07.214+0000 7fc49b200640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559a8f1a92f0 0x559a8f597650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:38:07.218 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:07.214+0000 7fc49b200640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559a8f1d21b0 0x559a8f598880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:38:07.218 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:07.214+0000 7fc49b200640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559a8f1d21b0 0x559a8f598880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53526/0 (socket says 172.21.15.50:53526) 2024-08-31T04:38:07.219 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:07.214+0000 7fc49b200640 1 -- 172.21.15.50:0/1225843443 learned_addr learned my addr 172.21.15.50:0/1225843443 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:38:07.219 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:07.215+0000 7fc499e00640 1 --2- 172.21.15.50:0/1225843443 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559a8f1b14d0 0x559a8f597d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:38:07.219 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:07.215+0000 7fc49b200640 1 -- 172.21.15.50:0/1225843443 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559a8f1b14d0 msgr2=0x559a8f597d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:38:07.219 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:07.215+0000 7fc49b200640 1 --2- 172.21.15.50:0/1225843443 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559a8f1b14d0 0x559a8f597d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:38:07.219 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:07.215+0000 7fc49b200640 1 -- 172.21.15.50:0/1225843443 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559a8f1a92f0 msgr2=0x559a8f597650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:38:07.219 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:07.215+0000 7fc49b200640 1 --2- 172.21.15.50:0/1225843443 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559a8f1a92f0 0x559a8f597650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:38:07.219 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:07.215+0000 7fc49b200640 1 -- 172.21.15.50:0/1225843443 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559a8f598fe0 con 0x559a8f1d21b0 2024-08-31T04:38:07.219 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:07.215+0000 7fc499e00640 1 --2- 172.21.15.50:0/1225843443 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559a8f1b14d0 0x559a8f597d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:38:07.219 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:07.215+0000 7fc49b200640 1 --2- 172.21.15.50:0/1225843443 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559a8f1d21b0 0x559a8f598880 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7fc49400fdf0 tx=0x7fc494009500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a42d4c08a30c034 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:38:07.219 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:07.215+0000 7fc47be00640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-08-31T04:38:07.219 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:07.215+0000 7fc47be00640 1 -- 172.21.15.50:0/1225843443 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc494005560 con 0x559a8f1d21b0 2024-08-31T04:38:07.219 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:07.215+0000 7fc47be00640 1 -- 172.21.15.50:0/1225843443 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8219+0+0 (secure 0 0 0) 0x7fc494005700 con 0x559a8f1d21b0 2024-08-31T04:38:07.219 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:07.215+0000 7fc4a83c8740 1 -- 172.21.15.50:0/1225843443 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc488010bc0 con 0x559a8f1d21b0 2024-08-31T04:38:07.220 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:07.216+0000 7fc47be00640 1 -- 172.21.15.50:0/1225843443 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=71) ==== 24+0+0 (secure 0 0 0) 0x7fc494005900 con 0x559a8f1d21b0 2024-08-31T04:38:07.220 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:07.216+0000 7fc4a83c8740 10 client.16758 fetch_fsmap learned FSMap version 71 2024-08-31T04:38:07.220 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:07.216+0000 7fc4a83c8740 1 -- 172.21.15.50:0/1225843443 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=71,monmap=4+}) -- 0x559a8f59a330 con 0x559a8f1d21b0 2024-08-31T04:38:07.220 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:07.216+0000 7fc47be00640 1 -- 172.21.15.50:0/1225843443 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc488010bc0 con 0x559a8f1d21b0 2024-08-31T04:38:07.221 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:07.216+0000 7fc47be00640 1 -- 172.21.15.50:0/1225843443 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 71) ==== 8442+0+0 (secure 0 0 0) 0x7fc49403d070 con 0x559a8f1d21b0 2024-08-31T04:38:07.221 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:07.216+0000 7fc4a83c8740 10 client.16758 fetch_fsmap finished waiting for FSMap version 71 2024-08-31T04:38:07.221 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:07.216+0000 7fc4a83c8740 10 client.16758 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T04:38:07.221 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:07.216+0000 7fc4a83c8740 20 client.16758 populate_metadata read hostname 'smithi050' 2024-08-31T04:38:07.221 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:07.216+0000 7fc4a83c8740 1 --2- 172.21.15.50:0/1225843443 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x559a8f1661c0 0x559a8f60c7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:38:07.221 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:07.216+0000 7fc4a83c8740 4 client.16758 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-31T04:38:07.221 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:07.216+0000 7fc4a83c8740 1 -- 172.21.15.50:0/1225843443 --> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] -- command(tid 0: {"prefix": "flush journal"}) -- 0x559a8f4e8960 con 0x559a8f1661c0 2024-08-31T04:38:07.221 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:07.217+0000 7fc499e00640 1 --2- 172.21.15.50:0/1225843443 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x559a8f1661c0 0x559a8f60c7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:38:07.221 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:07.217+0000 7fc499e00640 1 --2- 172.21.15.50:0/1225843443 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x559a8f1661c0 0x559a8f60c7b0 crc :-1 s=READY pgs=182 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7ab9585fd1ce71e1 server_cookie=89fc459b7a8d0a88 in_seq=0 out_seq=0 2024-08-31T04:38:07.221 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:07.217+0000 7fc47be00640 10 client.16758 ms_handle_connect on v2:172.21.15.133:6838/2526402262 2024-08-31T04:38:07.347 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:07.345+0000 7fc47be00640 1 -- 172.21.15.50:0/1225843443 <== mds.0 v2:172.21.15.133:6838/2526402262 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x559a8f4e8960 con 0x559a8f1661c0 2024-08-31T04:38:07.347 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:07.345+0000 7fc47be00640 10 client.16758 handle_command_reply: tid=0 2024-08-31T04:38:07.347 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:07.345+0000 7fc4a83c8740 1 client.16758 shutdown 2024-08-31T04:38:07.347 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:07.346+0000 7fc4a83c8740 1 -- 172.21.15.50:0/1225843443 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559a8f1d21b0 msgr2=0x559a8f598880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:38:07.347 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:07.346+0000 7fc4a83c8740 1 --2- 172.21.15.50:0/1225843443 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559a8f1d21b0 0x559a8f598880 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7fc49400fdf0 tx=0x7fc494009500 comp rx=0 tx=0).stop 2024-08-31T04:38:07.347 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:07.346+0000 7fc4a83c8740 1 -- 172.21.15.50:0/1225843443 shutdown_connections 2024-08-31T04:38:07.348 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:07.346+0000 7fc4a83c8740 1 --2- 172.21.15.50:0/1225843443 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x559a8f1661c0 0x559a8f60c7b0 crc :-1 s=READY pgs=182 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:38:07.348 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:07.346+0000 7fc4a83c8740 1 --2- 172.21.15.50:0/1225843443 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559a8f1b14d0 0x559a8f597d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:38:07.348 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:07.346+0000 7fc4a83c8740 1 --2- 172.21.15.50:0/1225843443 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559a8f1d21b0 0x559a8f598880 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:38:07.348 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:07.346+0000 7fc4a83c8740 1 --2- 172.21.15.50:0/1225843443 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559a8f1a92f0 0x559a8f597650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:38:07.348 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:07.346+0000 7fc4a83c8740 1 -- 172.21.15.50:0/1225843443 >> 172.21.15.50:0/1225843443 conn(0x559a8f1c6300 msgr2=0x559a8f57be50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:38:07.348 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:07.346+0000 7fc47be00640 0 client.16758 ms_handle_reset on v2:172.21.15.133:6838/2526402262 2024-08-31T04:38:07.349 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:07.346+0000 7fc4a83c8740 1 -- 172.21.15.50:0/1225843443 shutdown_connections 2024-08-31T04:38:07.349 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:07.346+0000 7fc4a83c8740 1 -- 172.21.15.50:0/1225843443 wait complete. 2024-08-31T04:38:07.349 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:07.347+0000 7fc4a83c8740 20 client.16758 trim_cache size 0 max 16384 2024-08-31T04:38:07.349 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout:{ 2024-08-31T04:38:07.349 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout: "message": "", 2024-08-31T04:38:07.349 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout: "return_code": 0 2024-08-31T04:38:07.349 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout:} 2024-08-31T04:38:07.350 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:07.347+0000 7fc4a0a00640 1 -- 172.21.15.50:0/1062471882 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fc4800b4c30 msgr2=0x7fc4800b7140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:38:07.350 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:07.347+0000 7fc4a0a00640 1 --2- 172.21.15.50:0/1062471882 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fc4800b4c30 0x7fc4800b7140 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fc48c0cc000 tx=0x7fc48c03b790 comp rx=0 tx=0).stop 2024-08-31T04:38:07.350 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:07.347+0000 7fc4a0a00640 1 -- 172.21.15.50:0/1062471882 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc49c103280 msgr2=0x7fc49c1a00e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:38:07.350 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:07.347+0000 7fc4a0a00640 1 --2- 172.21.15.50:0/1062471882 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc49c103280 0x7fc49c1a00e0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fc48c031440 tx=0x7fc48c003c10 comp rx=0 tx=0).stop 2024-08-31T04:38:07.350 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:07.347+0000 7fc4a0a00640 1 -- 172.21.15.50:0/1062471882 shutdown_connections 2024-08-31T04:38:07.350 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:07.347+0000 7fc4a0a00640 1 --2- 172.21.15.50:0/1062471882 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fc4800b4c30 0x7fc4800b7140 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:38:07.350 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:07.347+0000 7fc4a0a00640 1 --2- 172.21.15.50:0/1062471882 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc49c104ca0 0x7fc49c1a1300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:38:07.351 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:07.347+0000 7fc4a0a00640 1 --2- 172.21.15.50:0/1062471882 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc49c104300 0x7fc49c1a0750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:38:07.351 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:07.347+0000 7fc4a0a00640 1 --2- 172.21.15.50:0/1062471882 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc49c103280 0x7fc49c1a00e0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:38:07.351 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:07.347+0000 7fc4a0a00640 1 -- 172.21.15.50:0/1062471882 >> 172.21.15.50:0/1062471882 conn(0x7fc49c0febc0 msgr2=0x7fc49c10f710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:38:07.351 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:07.347+0000 7fc4a0a00640 1 -- 172.21.15.50:0/1062471882 shutdown_connections 2024-08-31T04:38:07.351 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:07.348+0000 7fc4a0a00640 1 -- 172.21.15.50:0/1062471882 wait complete. 2024-08-31T04:38:07.792 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:38:07 smithi133 ceph-mon[22177]: pgmap v825: 97 pgs: 97 active+clean; 768 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1017 KiB/s rd, 968 KiB/s wr, 270 op/s 2024-08-31T04:38:07.808 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:38:07 smithi050 ceph-mon[17259]: pgmap v825: 97 pgs: 97 active+clean; 768 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1017 KiB/s rd, 968 KiB/s wr, 270 op/s 2024-08-31T04:38:07.996 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:38:07 smithi177 ceph-mon[22025]: pgmap v825: 97 pgs: 97 active+clean; 768 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1017 KiB/s rd, 968 KiB/s wr, 270 op/s 2024-08-31T04:38:09.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:38:09 smithi133 ceph-mon[22177]: pgmap v826: 97 pgs: 97 active+clean; 760 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 928 KiB/s rd, 843 KiB/s wr, 229 op/s 2024-08-31T04:38:09.949 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:38:09 smithi050 ceph-mon[17259]: pgmap v826: 97 pgs: 97 active+clean; 760 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 928 KiB/s rd, 843 KiB/s wr, 229 op/s 2024-08-31T04:38:09.996 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:38:09 smithi177 ceph-mon[22025]: pgmap v826: 97 pgs: 97 active+clean; 760 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 928 KiB/s rd, 843 KiB/s wr, 229 op/s 2024-08-31T04:38:11.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:38:11 smithi050 ceph-mon[17259]: pgmap v827: 97 pgs: 97 active+clean; 748 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1007 KiB/s rd, 997 KiB/s wr, 280 op/s 2024-08-31T04:38:11.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:38:11 smithi133 ceph-mon[22177]: pgmap v827: 97 pgs: 97 active+clean; 748 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1007 KiB/s rd, 997 KiB/s wr, 280 op/s 2024-08-31T04:38:11.996 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:38:11 smithi177 ceph-mon[22025]: pgmap v827: 97 pgs: 97 active+clean; 748 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1007 KiB/s rd, 997 KiB/s wr, 280 op/s 2024-08-31T04:38:13.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:38:13 smithi133 ceph-mon[22177]: pgmap v828: 97 pgs: 97 active+clean; 730 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.0 MiB/s wr, 364 op/s 2024-08-31T04:38:13.886 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:38:13 smithi050 ceph-mon[17259]: pgmap v828: 97 pgs: 97 active+clean; 730 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.0 MiB/s wr, 364 op/s 2024-08-31T04:38:13.996 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:38:13 smithi177 ceph-mon[22025]: pgmap v828: 97 pgs: 97 active+clean; 730 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.0 MiB/s wr, 364 op/s 2024-08-31T04:38:15.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:38:15 smithi133 ceph-mon[22177]: pgmap v829: 97 pgs: 97 active+clean; 724 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.1 MiB/s wr, 372 op/s 2024-08-31T04:38:15.950 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:38:15 smithi050 ceph-mon[17259]: pgmap v829: 97 pgs: 97 active+clean; 724 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.1 MiB/s wr, 372 op/s 2024-08-31T04:38:15.996 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:38:15 smithi177 ceph-mon[22025]: pgmap v829: 97 pgs: 97 active+clean; 724 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.1 MiB/s wr, 372 op/s 2024-08-31T04:38:17.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:38:17 smithi050 ceph-mon[17259]: pgmap v830: 97 pgs: 97 active+clean; 710 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.5 MiB/s wr, 453 op/s 2024-08-31T04:38:17.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:38:17 smithi133 ceph-mon[22177]: pgmap v830: 97 pgs: 97 active+clean; 710 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.5 MiB/s wr, 453 op/s 2024-08-31T04:38:17.798 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:38:17 smithi177 ceph-mon[22025]: pgmap v830: 97 pgs: 97 active+clean; 710 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.5 MiB/s wr, 453 op/s 2024-08-31T04:38:19.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:38:19 smithi133 ceph-mon[22177]: pgmap v831: 97 pgs: 97 active+clean; 701 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.1 MiB/s wr, 407 op/s 2024-08-31T04:38:19.950 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:38:19 smithi050 ceph-mon[17259]: pgmap v831: 97 pgs: 97 active+clean; 701 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.1 MiB/s wr, 407 op/s 2024-08-31T04:38:19.996 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:38:19 smithi177 ceph-mon[22025]: pgmap v831: 97 pgs: 97 active+clean; 701 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.1 MiB/s wr, 407 op/s 2024-08-31T04:38:20.540 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:20.539+0000 7f3d12800640 1 -- 172.21.15.50:0/987250670 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3d0c103470 msgr2=0x7f3d0c1038e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:38:20.541 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:20.539+0000 7f3d12800640 1 --2- 172.21.15.50:0/987250670 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3d0c103470 0x7f3d0c1038e0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f3cfc009900 tx=0x7f3cfc02a3f0 comp rx=0 tx=0).stop 2024-08-31T04:38:20.541 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:20.539+0000 7f3d12800640 1 -- 172.21.15.50:0/987250670 shutdown_connections 2024-08-31T04:38:20.541 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:20.539+0000 7f3d12800640 1 --2- 172.21.15.50:0/987250670 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3d0c104e90 0x7f3d0c10b830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:38:20.541 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:20.539+0000 7f3d12800640 1 --2- 172.21.15.50:0/987250670 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3d0c1044f0 0x7f3d0c104900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:38:20.541 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:20.539+0000 7f3d12800640 1 --2- 172.21.15.50:0/987250670 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3d0c103470 0x7f3d0c1038e0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:38:20.541 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:20.539+0000 7f3d12800640 1 -- 172.21.15.50:0/987250670 >> 172.21.15.50:0/987250670 conn(0x7f3d0c0fedd0 msgr2=0x7f3d0c101260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:38:20.541 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:20.539+0000 7f3d12800640 1 -- 172.21.15.50:0/987250670 shutdown_connections 2024-08-31T04:38:20.541 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:20.539+0000 7f3d12800640 1 -- 172.21.15.50:0/987250670 wait complete. 2024-08-31T04:38:20.543 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:20.540+0000 7f3d12800640 1 Processor -- start 2024-08-31T04:38:20.543 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:20.540+0000 7f3d12800640 1 -- start start 2024-08-31T04:38:20.543 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:20.540+0000 7f3d12800640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3d0c103470 0x7f3d0c19bf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:38:20.543 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:20.540+0000 7f3d12800640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3d0c1044f0 0x7f3d0c19c5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:38:20.544 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:20.540+0000 7f3d12800640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3d0c104e90 0x7f3d0c19d100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:38:20.544 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:20.540+0000 7f3d12800640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f3d0c10f0f0 con 0x7f3d0c103470 2024-08-31T04:38:20.544 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:20.540+0000 7f3d12800640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f3d0c10ef70 con 0x7f3d0c1044f0 2024-08-31T04:38:20.544 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:20.540+0000 7f3d12800640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f3d0c10f270 con 0x7f3d0c104e90 2024-08-31T04:38:20.544 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:20.541+0000 7f3d03e00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3d0c1044f0 0x7f3d0c19c5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:38:20.544 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:20.541+0000 7f3d03e00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3d0c1044f0 0x7f3d0c19c5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.50:38198/0 (socket says 172.21.15.50:38198) 2024-08-31T04:38:20.544 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:20.541+0000 7f3d03e00640 1 -- 172.21.15.50:0/2274143301 learned_addr learned my addr 172.21.15.50:0/2274143301 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:38:20.544 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:20.541+0000 7f3d0b400640 1 --2- 172.21.15.50:0/2274143301 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3d0c103470 0x7f3d0c19bf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:38:20.544 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:20.541+0000 7f3d0be00640 1 --2- 172.21.15.50:0/2274143301 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3d0c104e90 0x7f3d0c19d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:38:20.544 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:20.541+0000 7f3d03e00640 1 -- 172.21.15.50:0/2274143301 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3d0c104e90 msgr2=0x7f3d0c19d100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:38:20.544 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:20.541+0000 7f3d03e00640 1 --2- 172.21.15.50:0/2274143301 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3d0c104e90 0x7f3d0c19d100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:38:20.545 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:20.541+0000 7f3d03e00640 1 -- 172.21.15.50:0/2274143301 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3d0c103470 msgr2=0x7f3d0c19bf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:38:20.545 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:20.541+0000 7f3d03e00640 1 --2- 172.21.15.50:0/2274143301 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3d0c103470 0x7f3d0c19bf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:38:20.545 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:20.541+0000 7f3d03e00640 1 -- 172.21.15.50:0/2274143301 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d0c19d920 con 0x7f3d0c1044f0 2024-08-31T04:38:20.545 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:20.541+0000 7f3d03e00640 1 --2- 172.21.15.50:0/2274143301 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3d0c1044f0 0x7f3d0c19c5c0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f3cf400e9f0 tx=0x7f3cf400eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:38:20.545 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:20.542+0000 7f3d08c00640 1 -- 172.21.15.50:0/2274143301 <== mon.2 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cf400cd80 con 0x7f3d0c1044f0 2024-08-31T04:38:20.545 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:20.542+0000 7f3d08c00640 1 -- 172.21.15.50:0/2274143301 <== mon.2 v2:172.21.15.133:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3cf40108e0 con 0x7f3d0c1044f0 2024-08-31T04:38:20.545 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:20.542+0000 7f3d08c00640 1 -- 172.21.15.50:0/2274143301 <== mon.2 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cf4018980 con 0x7f3d0c1044f0 2024-08-31T04:38:20.545 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:20.542+0000 7f3d12800640 1 -- 172.21.15.50:0/2274143301 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3d0c19dc10 con 0x7f3d0c1044f0 2024-08-31T04:38:20.545 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:20.542+0000 7f3d12800640 1 -- 172.21.15.50:0/2274143301 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3d0c1a4300 con 0x7f3d0c1044f0 2024-08-31T04:38:20.547 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:20.545+0000 7f3d19a34740 1 Processor -- start 2024-08-31T04:38:20.547 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:20.545+0000 7f3d19a34740 1 -- start start 2024-08-31T04:38:20.547 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:20.545+0000 7f3d08c00640 1 -- 172.21.15.50:0/2274143301 <== mon.2 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 18) ==== 152577+0+0 (secure 0 0 0) 0x7f3cf4010430 con 0x7f3d0c1044f0 2024-08-31T04:38:20.548 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:20.546+0000 7f3d19a34740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55a7fbdad1b0 0x55a7fc152b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:38:20.548 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:20.546+0000 7f3d19a34740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55a7fbd842f0 0x55a7fc1531a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:38:20.548 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:20.546+0000 7f3d19a34740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a7fbd8c4d0 0x55a7fc153cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:38:20.548 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:20.546+0000 7f3d19a34740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55a7fc0c5f70 con 0x55a7fbd8c4d0 2024-08-31T04:38:20.548 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:20.546+0000 7f3d19a34740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x55a7fc0b5500 con 0x55a7fbd842f0 2024-08-31T04:38:20.548 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:20.546+0000 7f3d19a34740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x55a7fc0b94b0 con 0x55a7fbdad1b0 2024-08-31T04:38:20.548 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:20.546+0000 7f3d0b400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55a7fbd842f0 0x55a7fc1531a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:38:20.548 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:20.546+0000 7f3d0b400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55a7fbd842f0 0x55a7fc1531a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.50:38210/0 (socket says 172.21.15.50:38210) 2024-08-31T04:38:20.548 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:20.546+0000 7f3d0b400640 1 -- 172.21.15.50:0/1859675651 learned_addr learned my addr 172.21.15.50:0/1859675651 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:38:20.548 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:20.546+0000 7f3d03e00640 1 --2- 172.21.15.50:0/1859675651 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a7fbd8c4d0 0x55a7fc153cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:38:20.548 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:20.546+0000 7f3d0be00640 1 --2- 172.21.15.50:0/1859675651 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55a7fbdad1b0 0x55a7fc152b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:38:20.549 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:20.546+0000 7f3d0b400640 1 -- 172.21.15.50:0/1859675651 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55a7fbdad1b0 msgr2=0x55a7fc152b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:38:20.549 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:20.546+0000 7f3d0b400640 1 --2- 172.21.15.50:0/1859675651 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55a7fbdad1b0 0x55a7fc152b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:38:20.549 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:20.546+0000 7f3d0b400640 1 -- 172.21.15.50:0/1859675651 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a7fbd8c4d0 msgr2=0x55a7fc153cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:38:20.552 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:20.546+0000 7f3d0b400640 1 --2- 172.21.15.50:0/1859675651 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a7fbd8c4d0 0x55a7fc153cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:38:20.552 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:20.546+0000 7f3d0b400640 1 -- 172.21.15.50:0/1859675651 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a7fc06fc10 con 0x55a7fbd842f0 2024-08-31T04:38:20.552 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:20.547+0000 7f3d0b400640 1 --2- 172.21.15.50:0/1859675651 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55a7fbd842f0 0x55a7fc1531a0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f3cfc02a910 tx=0x7f3cfc009620 comp rx=0 tx=0).ready entity=mon.2 client_cookie=564f2b0c75eb363e server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:38:20.553 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:20.547+0000 7f3d00c00640 1 -- 172.21.15.50:0/1859675651 <== mon.2 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cfc035030 con 0x55a7fbd842f0 2024-08-31T04:38:20.553 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:20.547+0000 7f3d00c00640 1 -- 172.21.15.50:0/1859675651 <== mon.2 v2:172.21.15.133:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3cfc040070 con 0x55a7fbd842f0 2024-08-31T04:38:20.553 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:20.547+0000 7f3d00c00640 1 -- 172.21.15.50:0/1859675651 <== mon.2 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cfc003970 con 0x55a7fbd842f0 2024-08-31T04:38:20.553 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:20.547+0000 7f3d08c00640 1 --2- 172.21.15.50:0/2274143301 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f3cf00b4b30 0x7f3cf00b7040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:38:20.553 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:20.548+0000 7f3d08c00640 1 -- 172.21.15.50:0/2274143301 <== mon.2 v2:172.21.15.133:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8219+0+0 (secure 0 0 0) 0x7f3cf40e5450 con 0x7f3d0c1044f0 2024-08-31T04:38:20.553 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:20.548+0000 7f3d0be00640 1 --2- 172.21.15.50:0/2274143301 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f3cf00b4b30 0x7f3cf00b7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:38:20.553 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:20.548+0000 7f3d19a34740 1 -- 172.21.15.50:0/1859675651 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55a7fbd842f0 msgr2=0x55a7fc1531a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:38:20.553 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:20.548+0000 7f3d19a34740 1 --2- 172.21.15.50:0/1859675651 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55a7fbd842f0 0x55a7fc1531a0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f3cfc02a910 tx=0x7f3cfc009620 comp rx=0 tx=0).stop 2024-08-31T04:38:20.553 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:20.548+0000 7f3d19a34740 1 -- 172.21.15.50:0/1859675651 shutdown_connections 2024-08-31T04:38:20.553 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:20.548+0000 7f3d19a34740 1 --2- 172.21.15.50:0/1859675651 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a7fbd8c4d0 0x55a7fc153cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:38:20.553 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:20.548+0000 7f3d19a34740 1 --2- 172.21.15.50:0/1859675651 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55a7fbd842f0 0x55a7fc1531a0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:38:20.554 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:20.548+0000 7f3d19a34740 1 --2- 172.21.15.50:0/1859675651 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55a7fbdad1b0 0x55a7fc152b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:38:20.554 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:20.548+0000 7f3d19a34740 1 -- 172.21.15.50:0/1859675651 >> 172.21.15.50:0/1859675651 conn(0x55a7fbda1300 msgr2=0x55a7fc14e5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:38:20.554 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:20.548+0000 7f3d19a34740 1 -- 172.21.15.50:0/1859675651 shutdown_connections 2024-08-31T04:38:20.554 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:20.548+0000 7f3d19a34740 1 -- 172.21.15.50:0/1859675651 wait complete. 2024-08-31T04:38:20.554 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:20.549+0000 7f3d0be00640 1 --2- 172.21.15.50:0/2274143301 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f3cf00b4b30 0x7f3cf00b7040 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f3d04005fd0 tx=0x7f3d04009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:38:20.554 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:20.549+0000 7f3d19a34740 1 -- start start 2024-08-31T04:38:20.554 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:20.549+0000 7f3d19a34740 1 Processor -- start 2024-08-31T04:38:20.554 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:20.549+0000 7f3d19a34740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55a7fbd842f0 0x55a7fc15c170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:38:20.554 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:20.549+0000 7f3d19a34740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55a7fbd8c4d0 0x55a7fc15c830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:38:20.554 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:20.549+0000 7f3d19a34740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a7fbdad1b0 0x55a7fc15d3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:38:20.554 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:20.549+0000 7f3d19a34740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55a7fbfeeab0 con 0x55a7fbdad1b0 2024-08-31T04:38:20.554 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:20.549+0000 7f3d19a34740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x55a7fc05c320 con 0x55a7fbd8c4d0 2024-08-31T04:38:20.555 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:20.549+0000 7f3d19a34740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x55a7fc1547b0 con 0x55a7fbd842f0 2024-08-31T04:38:20.555 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:20.549+0000 7f3d19a34740 10 client.0 _ll_register_callbacks cb 0x55a7fc095e80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:38:20.555 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:20.549+0000 7f3d0b400640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55a7fbd842f0 0x55a7fc15c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:38:20.555 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:20.550+0000 7f3d03e00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55a7fbd8c4d0 0x55a7fc15c830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:38:20.555 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:20.550+0000 7f3d0b400640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55a7fbd842f0 0x55a7fc15c170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.50:40268/0 (socket says 172.21.15.50:40268) 2024-08-31T04:38:20.555 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:20.550+0000 7f3d0b400640 1 -- 172.21.15.50:0/349773359 learned_addr learned my addr 172.21.15.50:0/349773359 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:38:20.555 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:20.550+0000 7f3d0be00640 1 --2- 172.21.15.50:0/349773359 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a7fbdad1b0 0x55a7fc15d3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:38:20.555 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:20.550+0000 7f3d03e00640 1 -- 172.21.15.50:0/349773359 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55a7fbd842f0 msgr2=0x55a7fc15c170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:38:20.555 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:20.550+0000 7f3d03e00640 1 --2- 172.21.15.50:0/349773359 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55a7fbd842f0 0x55a7fc15c170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:38:20.555 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:20.550+0000 7f3d03e00640 1 -- 172.21.15.50:0/349773359 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a7fbdad1b0 msgr2=0x55a7fc15d3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:38:20.555 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:20.550+0000 7f3d03e00640 1 --2- 172.21.15.50:0/349773359 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a7fbdad1b0 0x55a7fc15d3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:38:20.555 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:20.550+0000 7f3d03e00640 1 -- 172.21.15.50:0/349773359 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a7fbe18790 con 0x55a7fbd8c4d0 2024-08-31T04:38:20.555 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:20.550+0000 7f3d03e00640 1 --2- 172.21.15.50:0/349773359 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55a7fbd8c4d0 0x55a7fc15c830 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f3cf400c6a0 tx=0x7f3cf40e8a00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a34ef2ca1b124118 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:38:20.556 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:20.550+0000 7f3cf9600640 10 client.0 ms_handle_connect on v2:172.21.15.133:3300/0 2024-08-31T04:38:20.556 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:20.550+0000 7f3cf9600640 1 -- 172.21.15.50:0/349773359 <== mon.2 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cf4010720 con 0x55a7fbd8c4d0 2024-08-31T04:38:20.556 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:20.551+0000 7f3cf9600640 1 -- 172.21.15.50:0/349773359 <== mon.2 v2:172.21.15.133:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8219+0+0 (secure 0 0 0) 0x7f3cf40e50d0 con 0x55a7fbd8c4d0 2024-08-31T04:38:20.556 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:20.551+0000 7f3d19a34740 1 -- 172.21.15.50:0/349773359 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3cfc040070 con 0x55a7fbd8c4d0 2024-08-31T04:38:20.556 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:20.551+0000 7f3cf9600640 1 -- 172.21.15.50:0/349773359 <== mon.2 v2:172.21.15.133:3300/0 3 ==== mon_get_version_reply(handle=1 version=71) ==== 24+0+0 (secure 0 0 0) 0x7f3cf40aba30 con 0x55a7fbd8c4d0 2024-08-31T04:38:20.556 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:20.551+0000 7f3d19a34740 10 client.26729 fetch_fsmap learned FSMap version 71 2024-08-31T04:38:20.556 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:20.551+0000 7f3d19a34740 1 -- 172.21.15.50:0/349773359 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,fsmap=71,monmap=4+}) -- 0x55a7fbe91620 con 0x55a7fbd8c4d0 2024-08-31T04:38:20.556 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:20.551+0000 7f3cf9600640 1 -- 172.21.15.50:0/349773359 <== mon.2 v2:172.21.15.133:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3cfc040070 con 0x55a7fbd8c4d0 2024-08-31T04:38:20.558 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:20.551+0000 7f3cf9600640 1 -- 172.21.15.50:0/349773359 <== mon.2 v2:172.21.15.133:3300/0 5 ==== fsmap(e 71) ==== 8442+0+0 (secure 0 0 0) 0x7f3cf40b02b0 con 0x55a7fbd8c4d0 2024-08-31T04:38:20.558 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:20.552+0000 7f3d19a34740 10 client.26729 fetch_fsmap finished waiting for FSMap version 71 2024-08-31T04:38:20.558 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:20.552+0000 7f3d19a34740 10 client.26729 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T04:38:20.558 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:20.552+0000 7f3d19a34740 20 client.26729 populate_metadata read hostname 'smithi050' 2024-08-31T04:38:20.558 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:20.552+0000 7f3d19a34740 1 --2- 172.21.15.50:0/349773359 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x55a7fbd6bd80 0x55a7fc169960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:38:20.559 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:20.552+0000 7f3d19a34740 4 client.26729 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T04:38:20.559 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:20.552+0000 7f3d19a34740 1 -- 172.21.15.50:0/349773359 --> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a7fc0c7ec0 con 0x55a7fbd6bd80 2024-08-31T04:38:20.559 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:20.552+0000 7f3d0b400640 1 --2- 172.21.15.50:0/349773359 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x55a7fbd6bd80 0x55a7fc169960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:38:20.559 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:20.553+0000 7f3d0b400640 1 --2- 172.21.15.50:0/349773359 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x55a7fbd6bd80 0x55a7fc169960 crc :-1 s=READY pgs=183 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c3c0ecf4cf08f575 server_cookie=28a0cff608e82f7 in_seq=0 out_seq=0 2024-08-31T04:38:20.559 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:20.553+0000 7f3cf9600640 10 client.26729 ms_handle_connect on v2:172.21.15.133:6838/2526402262 2024-08-31T04:38:20.559 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:20.554+0000 7f3cf9600640 1 -- 172.21.15.50:0/349773359 <== mds.0 v2:172.21.15.133:6838/2526402262 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55a7fc0c7ec0 con 0x55a7fbd6bd80 2024-08-31T04:38:20.559 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:20.554+0000 7f3cf9600640 10 client.26729 handle_command_reply: tid=0 2024-08-31T04:38:20.559 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:20.554+0000 7f3d19a34740 1 client.26729 shutdown 2024-08-31T04:38:20.559 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:20.554+0000 7f3d19a34740 1 -- 172.21.15.50:0/349773359 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55a7fbd8c4d0 msgr2=0x55a7fc15c830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:38:20.559 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:20.554+0000 7f3d19a34740 1 --2- 172.21.15.50:0/349773359 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55a7fbd8c4d0 0x55a7fc15c830 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f3cf400c6a0 tx=0x7f3cf40e8a00 comp rx=0 tx=0).stop 2024-08-31T04:38:20.559 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:20.554+0000 7f3d19a34740 1 -- 172.21.15.50:0/349773359 shutdown_connections 2024-08-31T04:38:20.559 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:20.555+0000 7f3d19a34740 1 --2- 172.21.15.50:0/349773359 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x55a7fbd6bd80 0x55a7fc169960 crc :-1 s=READY pgs=183 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:38:20.559 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:20.555+0000 7f3d19a34740 1 --2- 172.21.15.50:0/349773359 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a7fbdad1b0 0x55a7fc15d3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:38:20.560 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:20.555+0000 7f3d19a34740 1 --2- 172.21.15.50:0/349773359 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55a7fbd8c4d0 0x55a7fc15c830 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:38:20.560 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:20.555+0000 7f3d19a34740 1 --2- 172.21.15.50:0/349773359 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55a7fbd842f0 0x55a7fc15c170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:38:20.560 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:20.555+0000 7f3cf9600640 0 client.26729 ms_handle_reset on v2:172.21.15.133:6838/2526402262 2024-08-31T04:38:20.560 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:20.555+0000 7f3d19a34740 1 -- 172.21.15.50:0/349773359 >> 172.21.15.50:0/349773359 conn(0x55a7fbda1300 msgr2=0x55a7fc14cb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:38:20.560 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:20.555+0000 7f3d19a34740 1 -- 172.21.15.50:0/349773359 shutdown_connections 2024-08-31T04:38:20.560 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:20.555+0000 7f3d19a34740 1 -- 172.21.15.50:0/349773359 wait complete. 2024-08-31T04:38:20.560 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:20.555+0000 7f3d19a34740 20 client.26729 trim_cache size 0 max 16384 2024-08-31T04:38:20.578 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:20.576+0000 7f3d19a34740 1 Processor -- start 2024-08-31T04:38:20.578 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:20.576+0000 7f3d19a34740 1 -- start start 2024-08-31T04:38:20.578 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:20.576+0000 7f3d19a34740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55a7fbd842f0 0x55a7fc15a700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:38:20.578 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:20.576+0000 7f3d19a34740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a7fbd8c4d0 0x55a7fc15ac40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:38:20.578 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:20.576+0000 7f3d19a34740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55a7fbdad1b0 0x55a7fc15b180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:38:20.578 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:20.576+0000 7f3d19a34740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f3d0c1aced0 con 0x55a7fbd8c4d0 2024-08-31T04:38:20.578 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:20.576+0000 7f3d19a34740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f3d0c1aec50 con 0x55a7fbd842f0 2024-08-31T04:38:20.578 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:20.576+0000 7f3d19a34740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f3d0c1ad660 con 0x55a7fbdad1b0 2024-08-31T04:38:20.579 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:20.577+0000 7f3d0b400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55a7fbd842f0 0x55a7fc15a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:38:20.579 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:20.577+0000 7f3d03e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a7fbd8c4d0 0x55a7fc15ac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:38:20.579 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:20.577+0000 7f3d0b400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55a7fbd842f0 0x55a7fc15a700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.50:38216/0 (socket says 172.21.15.50:38216) 2024-08-31T04:38:20.579 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:20.577+0000 7f3d03e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a7fbd8c4d0 0x55a7fc15ac40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53948/0 (socket says 172.21.15.50:53948) 2024-08-31T04:38:20.579 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:20.577+0000 7f3d0b400640 1 -- 172.21.15.50:0/1813351116 learned_addr learned my addr 172.21.15.50:0/1813351116 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:38:20.579 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:20.577+0000 7f3d0be00640 1 --2- 172.21.15.50:0/1813351116 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55a7fbdad1b0 0x55a7fc15b180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:38:20.582 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:20.577+0000 7f3d0b400640 1 -- 172.21.15.50:0/1813351116 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55a7fbdad1b0 msgr2=0x55a7fc15b180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:38:20.582 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:20.577+0000 7f3d0b400640 1 --2- 172.21.15.50:0/1813351116 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55a7fbdad1b0 0x55a7fc15b180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:38:20.582 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:20.577+0000 7f3d0b400640 1 -- 172.21.15.50:0/1813351116 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a7fbd8c4d0 msgr2=0x55a7fc15ac40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:38:20.582 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:20.577+0000 7f3d0b400640 1 --2- 172.21.15.50:0/1813351116 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a7fbd8c4d0 0x55a7fc15ac40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:38:20.582 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:20.577+0000 7f3d0b400640 1 -- 172.21.15.50:0/1813351116 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a7fc15d710 con 0x55a7fbd842f0 2024-08-31T04:38:20.582 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:20.577+0000 7f3d0b400640 1 --2- 172.21.15.50:0/1813351116 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55a7fbd842f0 0x55a7fc15a700 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f3cfc009900 tx=0x7f3cfc000bc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bb3b495ef5b19fb4 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:38:20.582 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:20.578+0000 7f3cfbe00640 1 -- 172.21.15.50:0/1813351116 <== mon.2 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cfc035040 con 0x55a7fbd842f0 2024-08-31T04:38:20.583 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:20.578+0000 7f3cfbe00640 1 -- 172.21.15.50:0/1813351116 <== mon.2 v2:172.21.15.133:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3cfc040040 con 0x55a7fbd842f0 2024-08-31T04:38:20.583 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:20.578+0000 7f3cfbe00640 1 -- 172.21.15.50:0/1813351116 <== mon.2 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cfc052450 con 0x55a7fbd842f0 2024-08-31T04:38:20.583 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:20.579+0000 7f3d19a34740 1 -- 172.21.15.50:0/1813351116 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55a7fbd842f0 msgr2=0x55a7fc15a700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:38:20.583 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:20.579+0000 7f3d19a34740 1 --2- 172.21.15.50:0/1813351116 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55a7fbd842f0 0x55a7fc15a700 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f3cfc009900 tx=0x7f3cfc000bc0 comp rx=0 tx=0).stop 2024-08-31T04:38:20.583 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:20.579+0000 7f3d19a34740 1 -- 172.21.15.50:0/1813351116 shutdown_connections 2024-08-31T04:38:20.583 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:20.579+0000 7f3d19a34740 1 --2- 172.21.15.50:0/1813351116 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55a7fbdad1b0 0x55a7fc15b180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:38:20.583 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:20.579+0000 7f3d19a34740 1 --2- 172.21.15.50:0/1813351116 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a7fbd8c4d0 0x55a7fc15ac40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:38:20.583 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:20.579+0000 7f3d19a34740 1 --2- 172.21.15.50:0/1813351116 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55a7fbd842f0 0x55a7fc15a700 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:38:20.583 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:20.579+0000 7f3d19a34740 1 -- 172.21.15.50:0/1813351116 >> 172.21.15.50:0/1813351116 conn(0x55a7fbda1300 msgr2=0x55a7fc153970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:38:20.583 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:20.579+0000 7f3d19a34740 1 -- 172.21.15.50:0/1813351116 shutdown_connections 2024-08-31T04:38:20.583 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:20.579+0000 7f3d19a34740 1 -- 172.21.15.50:0/1813351116 wait complete. 2024-08-31T04:38:20.583 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:20.579+0000 7f3d19a34740 1 -- start start 2024-08-31T04:38:20.584 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:20.580+0000 7f3d19a34740 1 Processor -- start 2024-08-31T04:38:20.584 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:20.580+0000 7f3d19a34740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a7fbd842f0 0x55a7fc162fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:38:20.584 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:20.580+0000 7f3d19a34740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55a7fbd8c4d0 0x55a7fc163500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:38:20.584 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:20.580+0000 7f3d19a34740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55a7fbdad1b0 0x55a7fc163a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:38:20.584 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:20.580+0000 7f3d19a34740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f3d0c1ae580 con 0x55a7fbd842f0 2024-08-31T04:38:20.584 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:20.580+0000 7f3d19a34740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f3d0c1addf0 con 0x55a7fbdad1b0 2024-08-31T04:38:20.584 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:20.580+0000 7f3d19a34740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f3d0c1aaeb0 con 0x55a7fbd8c4d0 2024-08-31T04:38:20.584 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:20.580+0000 7f3d19a34740 10 client.0 _ll_register_callbacks cb 0x7f3cf40e8bc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:38:20.584 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:20.580+0000 7f3d0b400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a7fbd842f0 0x55a7fc162fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:38:20.584 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:20.580+0000 7f3d0b400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a7fbd842f0 0x55a7fc162fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53958/0 (socket says 172.21.15.50:53958) 2024-08-31T04:38:20.584 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:20.580+0000 7f3d0b400640 1 -- 172.21.15.50:0/2128343355 learned_addr learned my addr 172.21.15.50:0/2128343355 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:38:20.584 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:20.580+0000 7f3d0be00640 1 --2- 172.21.15.50:0/2128343355 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55a7fbdad1b0 0x55a7fc163a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:38:20.585 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:20.580+0000 7f3d03e00640 1 --2- 172.21.15.50:0/2128343355 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55a7fbd8c4d0 0x55a7fc163500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:38:20.585 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:20.581+0000 7f3d0b400640 1 -- 172.21.15.50:0/2128343355 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55a7fbd8c4d0 msgr2=0x55a7fc163500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:38:20.585 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:20.581+0000 7f3d0b400640 1 --2- 172.21.15.50:0/2128343355 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55a7fbd8c4d0 0x55a7fc163500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:38:20.585 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:20.581+0000 7f3d0b400640 1 -- 172.21.15.50:0/2128343355 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55a7fbdad1b0 msgr2=0x55a7fc163a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:38:20.585 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:20.581+0000 7f3d0b400640 1 --2- 172.21.15.50:0/2128343355 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55a7fbdad1b0 0x55a7fc163a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:38:20.585 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:20.581+0000 7f3d0b400640 1 -- 172.21.15.50:0/2128343355 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a7fc161c00 con 0x55a7fbd842f0 2024-08-31T04:38:20.585 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:20.581+0000 7f3d0b400640 1 --2- 172.21.15.50:0/2128343355 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a7fbd842f0 0x55a7fc162fc0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f3cfc0092a0 tx=0x7f3cfc02aaf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f820a22b6c6ef3ba server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:38:20.585 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:20.581+0000 7f3cf9600640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-08-31T04:38:20.587 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:20.581+0000 7f3cf9600640 1 -- 172.21.15.50:0/2128343355 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cfc035070 con 0x55a7fbd842f0 2024-08-31T04:38:20.587 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:20.581+0000 7f3cf9600640 1 -- 172.21.15.50:0/2128343355 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8219+0+0 (secure 0 0 0) 0x7f3cfc004040 con 0x55a7fbd842f0 2024-08-31T04:38:20.587 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:20.581+0000 7f3d19a34740 1 -- 172.21.15.50:0/2128343355 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3cfc040040 con 0x55a7fbd842f0 2024-08-31T04:38:20.587 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:20.582+0000 7f3cf9600640 1 -- 172.21.15.50:0/2128343355 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=71) ==== 24+0+0 (secure 0 0 0) 0x7f3cfc004240 con 0x55a7fbd842f0 2024-08-31T04:38:20.587 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:20.582+0000 7f3d19a34740 10 client.16776 fetch_fsmap learned FSMap version 71 2024-08-31T04:38:20.587 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:20.582+0000 7f3d19a34740 1 -- 172.21.15.50:0/2128343355 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=71,monmap=4+}) -- 0x55a7fc1d4620 con 0x55a7fbd842f0 2024-08-31T04:38:20.588 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:20.582+0000 7f3cf9600640 1 -- 172.21.15.50:0/2128343355 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3cfc040040 con 0x55a7fbd842f0 2024-08-31T04:38:20.588 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:20.582+0000 7f3cf9600640 1 -- 172.21.15.50:0/2128343355 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 71) ==== 8442+0+0 (secure 0 0 0) 0x7f3cfc003a70 con 0x55a7fbd842f0 2024-08-31T04:38:20.588 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:20.582+0000 7f3d19a34740 10 client.16776 fetch_fsmap finished waiting for FSMap version 71 2024-08-31T04:38:20.588 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:20.582+0000 7f3d19a34740 10 client.16776 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T04:38:20.588 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:20.582+0000 7f3d19a34740 20 client.16776 populate_metadata read hostname 'smithi050' 2024-08-31T04:38:20.588 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:20.582+0000 7f3d19a34740 1 --2- 172.21.15.50:0/2128343355 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x55a7fbd411c0 0x55a7fc1d6c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:38:20.588 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:20.582+0000 7f3d19a34740 4 client.16776 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-31T04:38:20.588 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:20.582+0000 7f3d19a34740 1 -- 172.21.15.50:0/2128343355 --> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55a7fc0c3960 con 0x55a7fbd411c0 2024-08-31T04:38:20.588 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:20.582+0000 7f3d03e00640 1 --2- 172.21.15.50:0/2128343355 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x55a7fbd411c0 0x55a7fc1d6c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:38:20.589 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:20.583+0000 7f3d03e00640 1 --2- 172.21.15.50:0/2128343355 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x55a7fbd411c0 0x55a7fc1d6c30 crc :-1 s=READY pgs=184 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=98b6ad359f731bcd server_cookie=4505d1f5ee20e09 in_seq=0 out_seq=0 2024-08-31T04:38:20.589 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:20.583+0000 7f3cf9600640 10 client.16776 ms_handle_connect on v2:172.21.15.133:6838/2526402262 2024-08-31T04:38:20.894 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:20.892+0000 7f3cf9600640 1 -- 172.21.15.50:0/2128343355 <== mds.0 v2:172.21.15.133:6838/2526402262 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55a7fc0c3960 con 0x55a7fbd411c0 2024-08-31T04:38:20.894 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:20.892+0000 7f3cf9600640 10 client.16776 handle_command_reply: tid=0 2024-08-31T04:38:20.895 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:20.892+0000 7f3d19a34740 1 client.16776 shutdown 2024-08-31T04:38:20.895 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:20.893+0000 7f3d19a34740 1 -- 172.21.15.50:0/2128343355 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a7fbd842f0 msgr2=0x55a7fc162fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:38:20.895 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:20.893+0000 7f3d19a34740 1 --2- 172.21.15.50:0/2128343355 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a7fbd842f0 0x55a7fc162fc0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f3cfc0092a0 tx=0x7f3cfc02aaf0 comp rx=0 tx=0).stop 2024-08-31T04:38:20.895 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:20.893+0000 7f3d19a34740 1 -- 172.21.15.50:0/2128343355 shutdown_connections 2024-08-31T04:38:20.896 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:20.893+0000 7f3d19a34740 1 --2- 172.21.15.50:0/2128343355 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x55a7fbd411c0 0x55a7fc1d6c30 crc :-1 s=READY pgs=184 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:38:20.896 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:20.893+0000 7f3d19a34740 1 --2- 172.21.15.50:0/2128343355 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55a7fbd8c4d0 0x55a7fc163500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:38:20.896 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:20.893+0000 7f3d19a34740 1 --2- 172.21.15.50:0/2128343355 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55a7fbdad1b0 0x55a7fc163a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:38:20.896 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:20.893+0000 7f3d19a34740 1 --2- 172.21.15.50:0/2128343355 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a7fbd842f0 0x55a7fc162fc0 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:38:20.896 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:20.893+0000 7f3d19a34740 1 -- 172.21.15.50:0/2128343355 >> 172.21.15.50:0/2128343355 conn(0x55a7fbda1300 msgr2=0x55a7fc156b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:38:20.896 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:20.893+0000 7f3cf9600640 0 client.16776 ms_handle_reset on v2:172.21.15.133:6838/2526402262 2024-08-31T04:38:20.896 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:20.894+0000 7f3d19a34740 1 -- 172.21.15.50:0/2128343355 shutdown_connections 2024-08-31T04:38:20.896 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:20.894+0000 7f3d19a34740 1 -- 172.21.15.50:0/2128343355 wait complete. 2024-08-31T04:38:20.896 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:20.894+0000 7f3d19a34740 20 client.16776 trim_cache size 0 max 16384 2024-08-31T04:38:20.896 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout:{ 2024-08-31T04:38:20.897 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout: "message": "", 2024-08-31T04:38:20.897 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout: "return_code": 0 2024-08-31T04:38:20.897 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout:} 2024-08-31T04:38:20.898 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:20.897+0000 7f3d12800640 1 -- 172.21.15.50:0/2274143301 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f3cf00b4b30 msgr2=0x7f3cf00b7040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:38:20.898 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:20.897+0000 7f3d12800640 1 --2- 172.21.15.50:0/2274143301 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f3cf00b4b30 0x7f3cf00b7040 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f3d04005fd0 tx=0x7f3d04009500 comp rx=0 tx=0).stop 2024-08-31T04:38:20.898 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:20.897+0000 7f3d12800640 1 -- 172.21.15.50:0/2274143301 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3d0c1044f0 msgr2=0x7f3d0c19c5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:38:20.899 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:20.897+0000 7f3d12800640 1 --2- 172.21.15.50:0/2274143301 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3d0c1044f0 0x7f3d0c19c5c0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f3cf400e9f0 tx=0x7f3cf400eeb0 comp rx=0 tx=0).stop 2024-08-31T04:38:20.899 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:20.897+0000 7f3d12800640 1 -- 172.21.15.50:0/2274143301 shutdown_connections 2024-08-31T04:38:20.899 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:20.897+0000 7f3d12800640 1 --2- 172.21.15.50:0/2274143301 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f3cf00b4b30 0x7f3cf00b7040 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:38:20.899 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:20.897+0000 7f3d12800640 1 --2- 172.21.15.50:0/2274143301 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3d0c104e90 0x7f3d0c19d100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:38:20.899 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:20.897+0000 7f3d12800640 1 --2- 172.21.15.50:0/2274143301 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3d0c1044f0 0x7f3d0c19c5c0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:38:20.899 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:20.897+0000 7f3d12800640 1 --2- 172.21.15.50:0/2274143301 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3d0c103470 0x7f3d0c19bf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:38:20.899 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:20.897+0000 7f3d12800640 1 -- 172.21.15.50:0/2274143301 >> 172.21.15.50:0/2274143301 conn(0x7f3d0c0fedd0 msgr2=0x7f3d0c075390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:38:20.899 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:20.897+0000 7f3d12800640 1 -- 172.21.15.50:0/2274143301 shutdown_connections 2024-08-31T04:38:20.899 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:20.898+0000 7f3d12800640 1 -- 172.21.15.50:0/2274143301 wait complete. 2024-08-31T04:38:21.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:38:21 smithi133 ceph-mon[22177]: pgmap v832: 97 pgs: 97 active+clean; 691 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.2 MiB/s wr, 423 op/s 2024-08-31T04:38:21.950 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:38:21 smithi050 ceph-mon[17259]: pgmap v832: 97 pgs: 97 active+clean; 691 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.2 MiB/s wr, 423 op/s 2024-08-31T04:38:21.996 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:38:21 smithi177 ceph-mon[22025]: pgmap v832: 97 pgs: 97 active+clean; 691 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.2 MiB/s wr, 423 op/s 2024-08-31T04:38:23.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:38:23 smithi133 ceph-mon[22177]: pgmap v833: 97 pgs: 97 active+clean; 682 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.1 MiB/s wr, 436 op/s 2024-08-31T04:38:23.950 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:38:23 smithi050 ceph-mon[17259]: pgmap v833: 97 pgs: 97 active+clean; 682 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.1 MiB/s wr, 436 op/s 2024-08-31T04:38:23.996 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:38:23 smithi177 ceph-mon[22025]: pgmap v833: 97 pgs: 97 active+clean; 682 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.1 MiB/s wr, 436 op/s 2024-08-31T04:38:25.799 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:38:25 smithi133 ceph-mon[22177]: pgmap v834: 97 pgs: 97 active+clean; 664 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.1 MiB/s wr, 382 op/s 2024-08-31T04:38:25.950 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:38:25 smithi050 ceph-mon[17259]: pgmap v834: 97 pgs: 97 active+clean; 664 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.1 MiB/s wr, 382 op/s 2024-08-31T04:38:25.996 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:38:25 smithi177 ceph-mon[22025]: pgmap v834: 97 pgs: 97 active+clean; 664 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.1 MiB/s wr, 382 op/s 2024-08-31T04:38:27.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:38:27 smithi133 ceph-mon[22177]: pgmap v835: 97 pgs: 97 active+clean; 644 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.3 MiB/s wr, 460 op/s 2024-08-31T04:38:27.950 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:38:27 smithi050 ceph-mon[17259]: pgmap v835: 97 pgs: 97 active+clean; 644 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.3 MiB/s wr, 460 op/s 2024-08-31T04:38:27.996 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:38:27 smithi177 ceph-mon[22025]: pgmap v835: 97 pgs: 97 active+clean; 644 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.3 MiB/s wr, 460 op/s 2024-08-31T04:38:29.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:38:29 smithi133 ceph-mon[22177]: pgmap v836: 97 pgs: 97 active+clean; 635 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1023 KiB/s wr, 395 op/s 2024-08-31T04:38:29.804 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:38:29 smithi050 ceph-mon[17259]: pgmap v836: 97 pgs: 97 active+clean; 635 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1023 KiB/s wr, 395 op/s 2024-08-31T04:38:29.996 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:38:29 smithi177 ceph-mon[22025]: pgmap v836: 97 pgs: 97 active+clean; 635 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1023 KiB/s wr, 395 op/s 2024-08-31T04:38:30.025 INFO:tasks.workunit:Stopping ['suites/blogbench.sh'] on client.0... 2024-08-31T04:38:30.025 DEBUG:teuthology.orchestra.run.smithi050:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-08-31T04:38:31.215 DEBUG:teuthology.parallel:result is None 2024-08-31T04:38:31.215 DEBUG:teuthology.orchestra.run.smithi050:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-08-31T04:38:31.282 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-08-31T04:38:31.282 DEBUG:teuthology.run_tasks:Unwinding manager quiescer 2024-08-31T04:38:31.293 INFO:tasks.quiescer:joining Quiescers 2024-08-31T04:38:31.293 WARNING:tasks.quiescer:The quiescer is requested to stop, running cancel all 2024-08-31T04:38:31.293 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 058d9fc6-674f-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-31T04:38:31.675 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:38:31.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:38:31 smithi133 ceph-mon[22177]: pgmap v837: 97 pgs: 97 active+clean; 625 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.1 MiB/s wr, 409 op/s 2024-08-31T04:38:31.814 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:38:31 smithi050 ceph-mon[17259]: pgmap v837: 97 pgs: 97 active+clean; 625 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.1 MiB/s wr, 409 op/s 2024-08-31T04:38:31.996 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:38:31 smithi177 ceph-mon[22025]: pgmap v837: 97 pgs: 97 active+clean; 625 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.1 MiB/s wr, 409 op/s 2024-08-31T04:38:32.384 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:32.381+0000 7f6781800640 1 -- 172.21.15.50:0/2088528288 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f677c075550 msgr2=0x7f677c075960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:38:32.384 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:32.381+0000 7f6781800640 1 --2- 172.21.15.50:0/2088528288 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f677c075550 0x7f677c075960 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f676c009900 tx=0x7f676c02a410 comp rx=0 tx=0).stop 2024-08-31T04:38:32.384 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:32.382+0000 7f6781800640 1 -- 172.21.15.50:0/2088528288 shutdown_connections 2024-08-31T04:38:32.384 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:32.382+0000 7f6781800640 1 --2- 172.21.15.50:0/2088528288 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f677c075ea0 0x7f677c10f770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:38:32.384 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:32.382+0000 7f6781800640 1 --2- 172.21.15.50:0/2088528288 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f677c10fcb0 0x7f677c1120f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:38:32.384 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:32.382+0000 7f6781800640 1 --2- 172.21.15.50:0/2088528288 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f677c075550 0x7f677c075960 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:38:32.384 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:32.382+0000 7f6781800640 1 -- 172.21.15.50:0/2088528288 >> 172.21.15.50:0/2088528288 conn(0x7f677c0ff1e0 msgr2=0x7f677c101630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:38:32.384 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:32.382+0000 7f6781800640 1 -- 172.21.15.50:0/2088528288 shutdown_connections 2024-08-31T04:38:32.385 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:32.382+0000 7f6781800640 1 -- 172.21.15.50:0/2088528288 wait complete. 2024-08-31T04:38:32.385 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:32.383+0000 7f6781800640 1 Processor -- start 2024-08-31T04:38:32.385 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:32.383+0000 7f6781800640 1 -- start start 2024-08-31T04:38:32.386 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:32.383+0000 7f6781800640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f677c075550 0x7f677c19c260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:38:32.386 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:32.383+0000 7f6781800640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f677c075ea0 0x7f677c19c800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:38:32.386 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:32.383+0000 7f6781800640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f677c10fcb0 0x7f677c1a1aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:38:32.386 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:32.383+0000 7f6781800640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f677c1158b0 con 0x7f677c075550 2024-08-31T04:38:32.386 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:32.383+0000 7f6781800640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f677c115730 con 0x7f677c10fcb0 2024-08-31T04:38:32.386 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:32.383+0000 7f6781800640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f677c115a30 con 0x7f677c075ea0 2024-08-31T04:38:32.386 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:32.384+0000 7f677be00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f677c075550 0x7f677c19c260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:38:32.387 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:32.384+0000 7f677be00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f677c075550 0x7f677c19c260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:47362/0 (socket says 172.21.15.50:47362) 2024-08-31T04:38:32.387 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:32.384+0000 7f677be00640 1 -- 172.21.15.50:0/835814895 learned_addr learned my addr 172.21.15.50:0/835814895 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:38:32.387 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:32.384+0000 7f677b400640 1 --2- 172.21.15.50:0/835814895 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f677c075ea0 0x7f677c19c800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:38:32.387 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:32.384+0000 7f6780e00640 1 --2- 172.21.15.50:0/835814895 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f677c10fcb0 0x7f677c1a1aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:38:32.387 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:32.384+0000 7f677be00640 1 -- 172.21.15.50:0/835814895 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f677c075ea0 msgr2=0x7f677c19c800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:38:32.387 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:32.384+0000 7f677be00640 1 --2- 172.21.15.50:0/835814895 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f677c075ea0 0x7f677c19c800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:38:32.387 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:32.384+0000 7f677be00640 1 -- 172.21.15.50:0/835814895 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f677c10fcb0 msgr2=0x7f677c1a1aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:38:32.387 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:32.384+0000 7f677be00640 1 --2- 172.21.15.50:0/835814895 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f677c10fcb0 0x7f677c1a1aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:38:32.387 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:32.384+0000 7f677be00640 1 -- 172.21.15.50:0/835814895 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f677c1a21d0 con 0x7f677c075550 2024-08-31T04:38:32.387 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:32.384+0000 7f677b400640 1 --2- 172.21.15.50:0/835814895 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f677c075ea0 0x7f677c19c800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:38:32.387 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:32.384+0000 7f677be00640 1 --2- 172.21.15.50:0/835814895 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f677c075550 0x7f677c19c260 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f676c005ab0 tx=0x7f676c003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:38:32.387 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:32.385+0000 7f6778c00640 1 -- 172.21.15.50:0/835814895 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f676c03f070 con 0x7f677c075550 2024-08-31T04:38:32.387 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:32.385+0000 7f6781800640 1 -- 172.21.15.50:0/835814895 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f677c1a2460 con 0x7f677c075550 2024-08-31T04:38:32.388 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:32.385+0000 7f6778c00640 1 -- 172.21.15.50:0/835814895 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f676c031b60 con 0x7f677c075550 2024-08-31T04:38:32.388 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:32.385+0000 7f6778c00640 1 -- 172.21.15.50:0/835814895 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f676c035030 con 0x7f677c075550 2024-08-31T04:38:32.388 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:32.385+0000 7f6781800640 1 -- 172.21.15.50:0/835814895 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f677c1a8c20 con 0x7f677c075550 2024-08-31T04:38:32.388 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:32.386+0000 7f6781800640 1 -- 172.21.15.50:0/835814895 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f677c075960 con 0x7f677c075550 2024-08-31T04:38:32.389 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:32.388+0000 7f6778c00640 1 -- 172.21.15.50:0/835814895 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 18) ==== 152577+0+0 (secure 0 0 0) 0x7f676c042070 con 0x7f677c075550 2024-08-31T04:38:32.391 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:32.390+0000 7f6778c00640 1 --2- 172.21.15.50:0/835814895 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f67600b4bb0 0x7f67600b70c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:38:32.391 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:32.390+0000 7f6778c00640 1 -- 172.21.15.50:0/835814895 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8219+0+0 (secure 0 0 0) 0x7f676c105f80 con 0x7f677c075550 2024-08-31T04:38:32.391 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:32.390+0000 7f677b400640 1 --2- 172.21.15.50:0/835814895 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f67600b4bb0 0x7f67600b70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:38:32.392 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:32.391+0000 7f677b400640 1 --2- 172.21.15.50:0/835814895 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f67600b4bb0 0x7f67600b70c0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f677c1002f0 tx=0x7f6768005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:38:32.393 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:32.392+0000 7f6778c00640 1 -- 172.21.15.50:0/835814895 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f676c0cca10 con 0x7f677c075550 2024-08-31T04:38:32.625 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:32.624+0000 7f6781800640 1 -- 172.21.15.50:0/835814895 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f677c19d390 con 0x7f677c075550 2024-08-31T04:38:32.626 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:32.625+0000 7f6778c00640 1 -- 172.21.15.50:0/835814895 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 71 v71) ==== 94+0+12028 (secure 0 0 0) 0x7f676c0d11d0 con 0x7f677c075550 2024-08-31T04:38:32.627 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-08-31T04:38:32.627 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":71,"btime":"2024-08-31T04:35:08:748083+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14622,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/1565557530","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":1565557530},{"type":"v1","addr":"172.21.15.50:6835","nonce":1565557530}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":25924,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6835/4060379633","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6834","nonce":4060379633},{"type":"v1","addr":"172.21.15.177:6835","nonce":4060379633}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":39}],"filesystems":[{"mdsmap":{"epoch":71,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-31T04:20:44.140709+0000","modified":"2024-08-31T04:35:08.648800+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24695,"mds_1":24691,"mds_2":24667,"mds_3":24656,"mds_4":24652},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14676":{"gid":14676,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.50:6839/2105228685","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6838","nonce":2105228685},{"type":"v1","addr":"172.21.15.50:6839","nonce":2105228685}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24590":{"gid":24590,"name":"k","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.133:6833/4283603962","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6832","nonce":4283603962},{"type":"v1","addr":"172.21.15.133:6833","nonce":4283603962}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24601":{"gid":24601,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.177:6833/1237129793","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":1237129793},{"type":"v1","addr":"172.21.15.177:6833","nonce":1237129793}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24626":{"gid":24626,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.133:6835/3637799701","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":3637799701},{"type":"v1","addr":"172.21.15.133:6835","nonce":3637799701}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24652":{"gid":24652,"name":"c","rank":4,"incarnation":26,"state":"up:active","state_seq":215,"addr":"172.21.15.177:6837/2159859285","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6836","nonce":2159859285},{"type":"v1","addr":"172.21.15.177:6837","nonce":2159859285}]},"join_fscid":-1,"export_targets":[0,1,2,3],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24656":{"gid":24656,"name":"h","rank":3,"incarnation":22,"state":"up:active","state_seq":213,"addr":"172.21.15.133:6837/4014853202","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6836","nonce":4014853202},{"type":"v1","addr":"172.21.15.133:6837","nonce":4014853202}]},"join_fscid":-1,"export_targets":[0,1,2,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24667":{"gid":24667,"name":"i","rank":2,"incarnation":20,"state":"up:active","state_seq":10,"addr":"172.21.15.177:6839/3600081752","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6838","nonce":3600081752},{"type":"v1","addr":"172.21.15.177:6839","nonce":3600081752}]},"join_fscid":-1,"export_targets":[0,1,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24691":{"gid":24691,"name":"a","rank":1,"incarnation":18,"state":"up:active","state_seq":210,"addr":"172.21.15.50:6841/575209862","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6840","nonce":575209862},{"type":"v1","addr":"172.21.15.50:6841","nonce":575209862}]},"join_fscid":-1,"export_targets":[0,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24695":{"gid":24695,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":208,"addr":"172.21.15.133:6839/2526402262","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6838","nonce":2526402262},{"type":"v1","addr":"172.21.15.133:6839","nonce":2526402262}]},"join_fscid":-1,"export_targets":[1,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_26036":{"gid":26036,"name":"d","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.50:6837/2788697263","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6836","nonce":2788697263},{"type":"v1","addr":"172.21.15.50:6837","nonce":2788697263}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24695,"qdb_cluster":[24652,24691,24656,24695,24667]},"id":1}]} 2024-08-31T04:38:32.628 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 71 2024-08-31T04:38:32.630 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:32.628+0000 7f6781800640 1 -- 172.21.15.50:0/835814895 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f67600b4bb0 msgr2=0x7f67600b70c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:38:32.631 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:32.628+0000 7f6781800640 1 --2- 172.21.15.50:0/835814895 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f67600b4bb0 0x7f67600b70c0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f677c1002f0 tx=0x7f6768005f90 comp rx=0 tx=0).stop 2024-08-31T04:38:32.631 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:32.628+0000 7f6781800640 1 -- 172.21.15.50:0/835814895 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f677c075550 msgr2=0x7f677c19c260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:38:32.631 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:32.628+0000 7f6781800640 1 --2- 172.21.15.50:0/835814895 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f677c075550 0x7f677c19c260 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f676c005ab0 tx=0x7f676c003c10 comp rx=0 tx=0).stop 2024-08-31T04:38:32.631 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:32.628+0000 7f6781800640 1 -- 172.21.15.50:0/835814895 shutdown_connections 2024-08-31T04:38:32.631 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:32.628+0000 7f6781800640 1 --2- 172.21.15.50:0/835814895 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f67600b4bb0 0x7f67600b70c0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:38:32.631 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:32.628+0000 7f6781800640 1 --2- 172.21.15.50:0/835814895 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f677c075ea0 0x7f677c19c800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:38:32.631 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:32.628+0000 7f6781800640 1 --2- 172.21.15.50:0/835814895 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f677c10fcb0 0x7f677c1a1aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:38:32.631 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:32.628+0000 7f6781800640 1 --2- 172.21.15.50:0/835814895 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f677c075550 0x7f677c19c260 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:38:32.631 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:32.628+0000 7f6781800640 1 -- 172.21.15.50:0/835814895 >> 172.21.15.50:0/835814895 conn(0x7f677c0ff1e0 msgr2=0x7f677c100d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:38:32.631 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:32.628+0000 7f6781800640 1 -- 172.21.15.50:0/835814895 shutdown_connections 2024-08-31T04:38:32.631 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:32.628+0000 7f6781800640 1 -- 172.21.15.50:0/835814895 wait complete. 2024-08-31T04:38:33.462 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24695 quiesce db --cancel --all' 2024-08-31T04:38:33.462 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 058d9fc6-674f-11ef-bcd4-c7b262605968 -- timeout 105 ceph tell mds.24695 quiesce db --cancel --all 2024-08-31T04:38:33.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:38:33 smithi050 ceph-mon[17259]: pgmap v838: 97 pgs: 97 active+clean; 613 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.4 MiB/s wr, 431 op/s 2024-08-31T04:38:33.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:38:33 smithi050 ceph-mon[17259]: from='client.? 172.21.15.50:0/835814895' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T04:38:33.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:38:33 smithi133 ceph-mon[22177]: pgmap v838: 97 pgs: 97 active+clean; 613 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.4 MiB/s wr, 431 op/s 2024-08-31T04:38:33.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:38:33 smithi133 ceph-mon[22177]: from='client.? 172.21.15.50:0/835814895' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T04:38:33.844 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:38:33.996 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:38:33 smithi177 ceph-mon[22025]: pgmap v838: 97 pgs: 97 active+clean; 613 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.4 MiB/s wr, 431 op/s 2024-08-31T04:38:33.996 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:38:33 smithi177 ceph-mon[22025]: from='client.? 172.21.15.50:0/835814895' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T04:38:34.087 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:34.085+0000 7fb499800640 1 -- 172.21.15.50:0/2030158609 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb494104ca0 msgr2=0x7fb49410b640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:38:34.087 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:34.085+0000 7fb499800640 1 --2- 172.21.15.50:0/2030158609 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb494104ca0 0x7fb49410b640 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7fb48c009ca0 tx=0x7fb48c02a8c0 comp rx=0 tx=0).stop 2024-08-31T04:38:34.087 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:34.085+0000 7fb499800640 1 -- 172.21.15.50:0/2030158609 shutdown_connections 2024-08-31T04:38:34.087 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:34.085+0000 7fb499800640 1 --2- 172.21.15.50:0/2030158609 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb494104300 0x7fb494104710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:38:34.087 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:34.085+0000 7fb499800640 1 --2- 172.21.15.50:0/2030158609 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb494104ca0 0x7fb49410b640 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:38:34.087 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:34.085+0000 7fb499800640 1 --2- 172.21.15.50:0/2030158609 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb494103280 0x7fb4941036f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:38:34.087 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:34.085+0000 7fb499800640 1 -- 172.21.15.50:0/2030158609 >> 172.21.15.50:0/2030158609 conn(0x7fb4940febc0 msgr2=0x7fb494101070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:38:34.087 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:34.086+0000 7fb499800640 1 -- 172.21.15.50:0/2030158609 shutdown_connections 2024-08-31T04:38:34.088 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:34.086+0000 7fb499800640 1 -- 172.21.15.50:0/2030158609 wait complete. 2024-08-31T04:38:34.089 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:34.087+0000 7fb499800640 1 Processor -- start 2024-08-31T04:38:34.089 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:34.087+0000 7fb499800640 1 -- start start 2024-08-31T04:38:34.089 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:34.087+0000 7fb499800640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb494103280 0x7fb49419bce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:38:34.089 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:34.087+0000 7fb499800640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb494104300 0x7fb49419c350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:38:34.090 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:34.087+0000 7fb499800640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb494104ca0 0x7fb49419cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:38:34.090 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:34.087+0000 7fb499800640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fb49410ef50 con 0x7fb494104300 2024-08-31T04:38:34.090 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:34.087+0000 7fb499800640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7fb49410edd0 con 0x7fb494103280 2024-08-31T04:38:34.090 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:34.087+0000 7fb499800640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fb49410f0d0 con 0x7fb494104ca0 2024-08-31T04:38:34.090 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:34.087+0000 7fb48be00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb494104300 0x7fb49419c350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:38:34.090 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:34.087+0000 7fb48be00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb494104300 0x7fb49419c350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:43638/0 (socket says 172.21.15.50:43638) 2024-08-31T04:38:34.090 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:34.087+0000 7fb48be00640 1 -- 172.21.15.50:0/2897502708 learned_addr learned my addr 172.21.15.50:0/2897502708 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:38:34.090 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:34.087+0000 7fb493e00640 1 --2- 172.21.15.50:0/2897502708 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb494103280 0x7fb49419bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:38:34.090 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:34.088+0000 7fb498e00640 1 --2- 172.21.15.50:0/2897502708 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb494104ca0 0x7fb49419cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:38:34.090 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:34.088+0000 7fb48be00640 1 -- 172.21.15.50:0/2897502708 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb494104ca0 msgr2=0x7fb49419cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:38:34.090 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:34.088+0000 7fb48be00640 1 --2- 172.21.15.50:0/2897502708 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb494104ca0 0x7fb49419cf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:38:34.090 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:34.088+0000 7fb48be00640 1 -- 172.21.15.50:0/2897502708 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb494103280 msgr2=0x7fb49419bce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:38:34.091 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:34.088+0000 7fb48be00640 1 --2- 172.21.15.50:0/2897502708 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb494103280 0x7fb49419bce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:38:34.091 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:34.088+0000 7fb48be00640 1 -- 172.21.15.50:0/2897502708 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb49419d720 con 0x7fb494104300 2024-08-31T04:38:34.091 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:34.088+0000 7fb48be00640 1 --2- 172.21.15.50:0/2897502708 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb494104300 0x7fb49419c350 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7fb47c00d950 tx=0x7fb47c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:38:34.091 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:34.088+0000 7fb491600640 1 -- 172.21.15.50:0/2897502708 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb47c017030 con 0x7fb494104300 2024-08-31T04:38:34.091 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:34.088+0000 7fb491600640 1 -- 172.21.15.50:0/2897502708 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb47c004020 con 0x7fb494104300 2024-08-31T04:38:34.092 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:34.088+0000 7fb491600640 1 -- 172.21.15.50:0/2897502708 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb47c0047a0 con 0x7fb494104300 2024-08-31T04:38:34.092 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:34.088+0000 7fb499800640 1 -- 172.21.15.50:0/2897502708 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb49419da10 con 0x7fb494104300 2024-08-31T04:38:34.092 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:34.089+0000 7fb499800640 1 -- 172.21.15.50:0/2897502708 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb4941a4100 con 0x7fb494104300 2024-08-31T04:38:34.094 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:34.093+0000 7fb4a1e5f740 1 Processor -- start 2024-08-31T04:38:34.094 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:34.093+0000 7fb4a1e5f740 1 -- start start 2024-08-31T04:38:34.095 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:34.093+0000 7fb4a1e5f740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56000d2021b0 0x56000d5a7d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:38:34.095 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:34.093+0000 7fb4a1e5f740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56000d1d92f0 0x56000d5a83b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:38:34.096 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:34.093+0000 7fb4a1e5f740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56000d1e14d0 0x56000d5a8f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:38:34.096 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:34.093+0000 7fb4a1e5f740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x56000d51af70 con 0x56000d2021b0 2024-08-31T04:38:34.096 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:34.093+0000 7fb4a1e5f740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x56000d50a500 con 0x56000d1e14d0 2024-08-31T04:38:34.096 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:34.093+0000 7fb4a1e5f740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x56000d50e4b0 con 0x56000d1d92f0 2024-08-31T04:38:34.096 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:34.093+0000 7fb498e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56000d2021b0 0x56000d5a7d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:38:34.096 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:34.093+0000 7fb498e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56000d2021b0 0x56000d5a7d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:43644/0 (socket says 172.21.15.50:43644) 2024-08-31T04:38:34.096 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:34.093+0000 7fb498e00640 1 -- 172.21.15.50:0/3916356622 learned_addr learned my addr 172.21.15.50:0/3916356622 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:38:34.096 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:34.094+0000 7fb493e00640 1 --2- 172.21.15.50:0/3916356622 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56000d1d92f0 0x56000d5a83b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:38:34.096 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:34.094+0000 7fb498e00640 1 -- 172.21.15.50:0/3916356622 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56000d1d92f0 msgr2=0x56000d5a83b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:38:34.096 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:34.094+0000 7fb498e00640 1 --2- 172.21.15.50:0/3916356622 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56000d1d92f0 0x56000d5a83b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:38:34.096 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:34.094+0000 7fb498e00640 1 -- 172.21.15.50:0/3916356622 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56000d1e14d0 msgr2=0x56000d5a8f00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-31T04:38:34.096 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:34.094+0000 7fb498e00640 1 --2- 172.21.15.50:0/3916356622 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56000d1e14d0 0x56000d5a8f00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:38:34.097 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:34.094+0000 7fb498e00640 1 -- 172.21.15.50:0/3916356622 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56000d4c4c10 con 0x56000d2021b0 2024-08-31T04:38:34.097 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:34.094+0000 7fb491600640 1 -- 172.21.15.50:0/2897502708 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 18) ==== 152577+0+0 (secure 0 0 0) 0x7fb47c009a30 con 0x7fb494104300 2024-08-31T04:38:34.097 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:34.094+0000 7fb498e00640 1 --2- 172.21.15.50:0/3916356622 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56000d2021b0 0x56000d5a7d40 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7fb48c035000 tx=0x7fb48c02f450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1dc56fc1a342f445 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:38:34.097 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:34.094+0000 7fb489600640 1 -- 172.21.15.50:0/3916356622 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb48c031650 con 0x56000d2021b0 2024-08-31T04:38:34.097 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:34.094+0000 7fb489600640 1 -- 172.21.15.50:0/3916356622 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb48c036030 con 0x56000d2021b0 2024-08-31T04:38:34.097 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:34.094+0000 7fb489600640 1 -- 172.21.15.50:0/3916356622 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb48c004790 con 0x56000d2021b0 2024-08-31T04:38:34.100 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:34.095+0000 7fb4a1e5f740 1 -- 172.21.15.50:0/3916356622 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56000d2021b0 msgr2=0x56000d5a7d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:38:34.100 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:34.095+0000 7fb4a1e5f740 1 --2- 172.21.15.50:0/3916356622 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56000d2021b0 0x56000d5a7d40 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7fb48c035000 tx=0x7fb48c02f450 comp rx=0 tx=0).stop 2024-08-31T04:38:34.101 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:34.095+0000 7fb4a1e5f740 1 -- 172.21.15.50:0/3916356622 shutdown_connections 2024-08-31T04:38:34.101 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:34.095+0000 7fb4a1e5f740 1 --2- 172.21.15.50:0/3916356622 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56000d1d92f0 0x56000d5a83b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:38:34.101 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:34.095+0000 7fb4a1e5f740 1 --2- 172.21.15.50:0/3916356622 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56000d1e14d0 0x56000d5a8f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:38:34.101 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:34.095+0000 7fb4a1e5f740 1 --2- 172.21.15.50:0/3916356622 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56000d2021b0 0x56000d5a7d40 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:38:34.101 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:34.095+0000 7fb4a1e5f740 1 -- 172.21.15.50:0/3916356622 >> 172.21.15.50:0/3916356622 conn(0x56000d1f6300 msgr2=0x56000d5a37d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:38:34.101 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:34.095+0000 7fb491600640 1 --2- 172.21.15.50:0/2897502708 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fb4780b4bb0 0x7fb4780b70c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:38:34.101 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:34.096+0000 7fb4a1e5f740 1 -- 172.21.15.50:0/3916356622 shutdown_connections 2024-08-31T04:38:34.101 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:34.096+0000 7fb491600640 1 -- 172.21.15.50:0/2897502708 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8219+0+0 (secure 0 0 0) 0x7fb47c0e4a60 con 0x7fb494104300 2024-08-31T04:38:34.101 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:34.096+0000 7fb4a1e5f740 1 -- 172.21.15.50:0/3916356622 wait complete. 2024-08-31T04:38:34.101 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:34.096+0000 7fb498e00640 1 --2- 172.21.15.50:0/2897502708 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fb4780b4bb0 0x7fb4780b70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:38:34.101 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:34.096+0000 7fb4a1e5f740 1 -- start start 2024-08-31T04:38:34.101 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:34.096+0000 7fb4a1e5f740 1 Processor -- start 2024-08-31T04:38:34.102 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:34.097+0000 7fb498e00640 1 --2- 172.21.15.50:0/2897502708 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fb4780b4bb0 0x7fb4780b70c0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fb48c004270 tx=0x7fb48c02a8c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:38:34.102 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:34.097+0000 7fb4a1e5f740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56000d1d92f0 0x56000d5b1220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:38:34.102 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:34.097+0000 7fb4a1e5f740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56000d1e14d0 0x56000d5b18e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:38:34.102 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:34.097+0000 7fb4a1e5f740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56000d2021b0 0x56000d5b2450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:38:34.102 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:34.097+0000 7fb4a1e5f740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x56000d443ab0 con 0x56000d1d92f0 2024-08-31T04:38:34.102 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:34.097+0000 7fb4a1e5f740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x56000d4b1320 con 0x56000d1e14d0 2024-08-31T04:38:34.102 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:34.097+0000 7fb4a1e5f740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x56000d5a9840 con 0x56000d2021b0 2024-08-31T04:38:34.102 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:34.097+0000 7fb4a1e5f740 10 client.0 _ll_register_callbacks cb 0x56000d4eae80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:38:34.102 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:34.097+0000 7fb493e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56000d1d92f0 0x56000d5b1220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:38:34.102 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:34.097+0000 7fb493e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56000d1d92f0 0x56000d5b1220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:43652/0 (socket says 172.21.15.50:43652) 2024-08-31T04:38:34.102 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:34.097+0000 7fb493e00640 1 -- 172.21.15.50:0/4096807607 learned_addr learned my addr 172.21.15.50:0/4096807607 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:38:34.102 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:34.097+0000 7fb498e00640 1 --2- 172.21.15.50:0/4096807607 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56000d2021b0 0x56000d5b2450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:38:34.102 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:34.097+0000 7fb48be00640 1 --2- 172.21.15.50:0/4096807607 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56000d1e14d0 0x56000d5b18e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:38:34.103 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:34.098+0000 7fb493e00640 1 -- 172.21.15.50:0/4096807607 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56000d2021b0 msgr2=0x56000d5b2450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:38:34.103 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:34.098+0000 7fb493e00640 1 --2- 172.21.15.50:0/4096807607 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56000d2021b0 0x56000d5b2450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:38:34.103 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:34.098+0000 7fb493e00640 1 -- 172.21.15.50:0/4096807607 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56000d1e14d0 msgr2=0x56000d5b18e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:38:34.103 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:34.098+0000 7fb493e00640 1 --2- 172.21.15.50:0/4096807607 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56000d1e14d0 0x56000d5b18e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:38:34.103 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:34.098+0000 7fb493e00640 1 -- 172.21.15.50:0/4096807607 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56000d26d790 con 0x56000d1d92f0 2024-08-31T04:38:34.103 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:34.098+0000 7fb493e00640 1 --2- 172.21.15.50:0/4096807607 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56000d1d92f0 0x56000d5b1220 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7fb484012740 tx=0x7fb484012c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5760937fad69971 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:38:34.103 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:34.098+0000 7fb482000640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-08-31T04:38:34.103 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:34.098+0000 7fb482000640 1 -- 172.21.15.50:0/4096807607 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb48400f920 con 0x56000d1d92f0 2024-08-31T04:38:34.103 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:34.098+0000 7fb482000640 1 -- 172.21.15.50:0/4096807607 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8219+0+0 (secure 0 0 0) 0x7fb48400fac0 con 0x56000d1d92f0 2024-08-31T04:38:34.103 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:34.098+0000 7fb4a1e5f740 1 -- 172.21.15.50:0/4096807607 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb48c036030 con 0x56000d1d92f0 2024-08-31T04:38:34.103 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:34.098+0000 7fb482000640 1 -- 172.21.15.50:0/4096807607 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=71) ==== 24+0+0 (secure 0 0 0) 0x7fb48400fcc0 con 0x56000d1d92f0 2024-08-31T04:38:34.103 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:34.099+0000 7fb4a1e5f740 10 client.16794 fetch_fsmap learned FSMap version 71 2024-08-31T04:38:34.103 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:34.099+0000 7fb4a1e5f740 1 -- 172.21.15.50:0/4096807607 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=71,monmap=4+}) -- 0x56000d2e6620 con 0x56000d1d92f0 2024-08-31T04:38:34.104 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:34.099+0000 7fb482000640 1 -- 172.21.15.50:0/4096807607 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb48c036030 con 0x56000d1d92f0 2024-08-31T04:38:34.104 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:34.099+0000 7fb482000640 1 -- 172.21.15.50:0/4096807607 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 71) ==== 8442+0+0 (secure 0 0 0) 0x7fb48401c420 con 0x56000d1d92f0 2024-08-31T04:38:34.104 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:34.099+0000 7fb4a1e5f740 10 client.16794 fetch_fsmap finished waiting for FSMap version 71 2024-08-31T04:38:34.104 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:34.099+0000 7fb4a1e5f740 10 client.16794 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T04:38:34.104 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:34.099+0000 7fb4a1e5f740 20 client.16794 populate_metadata read hostname 'smithi050' 2024-08-31T04:38:34.104 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:34.099+0000 7fb4a1e5f740 1 --2- 172.21.15.50:0/4096807607 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x56000d1c0d80 0x56000d5beb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:38:34.104 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:34.099+0000 7fb4a1e5f740 4 client.16794 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T04:38:34.104 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:34.099+0000 7fb4a1e5f740 1 -- 172.21.15.50:0/4096807607 --> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56000d51cec0 con 0x56000d1c0d80 2024-08-31T04:38:34.105 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:34.100+0000 7fb48be00640 1 --2- 172.21.15.50:0/4096807607 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x56000d1c0d80 0x56000d5beb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:38:34.105 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:34.100+0000 7fb48be00640 1 --2- 172.21.15.50:0/4096807607 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x56000d1c0d80 0x56000d5beb70 crc :-1 s=READY pgs=185 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8d121ac18aef1cae server_cookie=4b7710413dbd49cb in_seq=0 out_seq=0 2024-08-31T04:38:34.105 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:34.100+0000 7fb482000640 10 client.16794 ms_handle_connect on v2:172.21.15.133:6838/2526402262 2024-08-31T04:38:34.106 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:34.101+0000 7fb482000640 1 -- 172.21.15.50:0/4096807607 <== mds.0 v2:172.21.15.133:6838/2526402262 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56000d51cec0 con 0x56000d1c0d80 2024-08-31T04:38:34.106 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:34.101+0000 7fb482000640 10 client.16794 handle_command_reply: tid=0 2024-08-31T04:38:34.106 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:34.101+0000 7fb4a1e5f740 1 client.16794 shutdown 2024-08-31T04:38:34.106 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:34.101+0000 7fb4a1e5f740 1 -- 172.21.15.50:0/4096807607 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56000d1d92f0 msgr2=0x56000d5b1220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:38:34.106 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:34.101+0000 7fb4a1e5f740 1 --2- 172.21.15.50:0/4096807607 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56000d1d92f0 0x56000d5b1220 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7fb484012740 tx=0x7fb484012c00 comp rx=0 tx=0).stop 2024-08-31T04:38:34.106 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:34.101+0000 7fb4a1e5f740 1 -- 172.21.15.50:0/4096807607 shutdown_connections 2024-08-31T04:38:34.106 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:34.101+0000 7fb4a1e5f740 1 --2- 172.21.15.50:0/4096807607 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x56000d1c0d80 0x56000d5beb70 crc :-1 s=READY pgs=185 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:38:34.106 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:34.101+0000 7fb4a1e5f740 1 --2- 172.21.15.50:0/4096807607 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56000d2021b0 0x56000d5b2450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:38:34.106 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:34.101+0000 7fb4a1e5f740 1 --2- 172.21.15.50:0/4096807607 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56000d1e14d0 0x56000d5b18e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:38:34.106 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:34.101+0000 7fb4a1e5f740 1 --2- 172.21.15.50:0/4096807607 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56000d1d92f0 0x56000d5b1220 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:38:34.106 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:34.101+0000 7fb482000640 0 client.16794 ms_handle_reset on v2:172.21.15.133:6838/2526402262 2024-08-31T04:38:34.106 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:34.101+0000 7fb4a1e5f740 1 -- 172.21.15.50:0/4096807607 >> 172.21.15.50:0/4096807607 conn(0x56000d1f6300 msgr2=0x56000d5a1d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:38:34.106 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:34.102+0000 7fb4a1e5f740 1 -- 172.21.15.50:0/4096807607 shutdown_connections 2024-08-31T04:38:34.106 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:34.102+0000 7fb4a1e5f740 1 -- 172.21.15.50:0/4096807607 wait complete. 2024-08-31T04:38:34.107 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:34.102+0000 7fb4a1e5f740 20 client.16794 trim_cache size 0 max 16384 2024-08-31T04:38:34.118 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:34.117+0000 7fb4a1e5f740 1 Processor -- start 2024-08-31T04:38:34.118 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:34.117+0000 7fb4a1e5f740 1 -- start start 2024-08-31T04:38:34.118 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:34.117+0000 7fb4a1e5f740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56000d1d92f0 0x56000d5abe50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:38:34.118 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:34.117+0000 7fb4a1e5f740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56000d1e14d0 0x56000d5b9330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:38:34.119 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:34.117+0000 7fb4a1e5f740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56000d2021b0 0x56000d5ac390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:38:34.119 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:34.117+0000 7fb4a1e5f740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fb4941acc40 con 0x56000d1e14d0 2024-08-31T04:38:34.119 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:34.117+0000 7fb4a1e5f740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7fb4941ae9c0 con 0x56000d2021b0 2024-08-31T04:38:34.119 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:34.117+0000 7fb4a1e5f740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fb4941ad3d0 con 0x56000d1d92f0 2024-08-31T04:38:34.120 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:34.117+0000 7fb48be00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56000d1e14d0 0x56000d5b9330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:38:34.120 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:34.118+0000 7fb48be00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56000d1e14d0 0x56000d5b9330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:43664/0 (socket says 172.21.15.50:43664) 2024-08-31T04:38:34.121 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:34.118+0000 7fb48be00640 1 -- 172.21.15.50:0/3846216655 learned_addr learned my addr 172.21.15.50:0/3846216655 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:38:34.121 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:34.118+0000 7fb493e00640 1 --2- 172.21.15.50:0/3846216655 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56000d1d92f0 0x56000d5abe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:38:34.121 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:34.118+0000 7fb498e00640 1 --2- 172.21.15.50:0/3846216655 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56000d2021b0 0x56000d5ac390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:38:34.121 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:34.118+0000 7fb48be00640 1 -- 172.21.15.50:0/3846216655 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56000d1d92f0 msgr2=0x56000d5abe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:38:34.121 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:34.118+0000 7fb48be00640 1 --2- 172.21.15.50:0/3846216655 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56000d1d92f0 0x56000d5abe50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:38:34.121 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:34.118+0000 7fb48be00640 1 -- 172.21.15.50:0/3846216655 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56000d2021b0 msgr2=0x56000d5ac390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:38:34.121 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:34.118+0000 7fb48be00640 1 --2- 172.21.15.50:0/3846216655 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56000d2021b0 0x56000d5ac390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:38:34.121 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:34.118+0000 7fb48be00640 1 -- 172.21.15.50:0/3846216655 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56000d5a87e0 con 0x56000d1e14d0 2024-08-31T04:38:34.121 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:34.118+0000 7fb498e00640 1 --2- 172.21.15.50:0/3846216655 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56000d2021b0 0x56000d5ac390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:38:34.121 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:34.118+0000 7fb48be00640 1 --2- 172.21.15.50:0/3846216655 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56000d1e14d0 0x56000d5b9330 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7fb47c0e2570 tx=0x7fb47c0a7490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c722fb8c76eec50 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:38:34.121 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:34.118+0000 7fb488c00640 1 -- 172.21.15.50:0/3846216655 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb47c096020 con 0x56000d1e14d0 2024-08-31T04:38:34.121 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:34.118+0000 7fb488c00640 1 -- 172.21.15.50:0/3846216655 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb47c0d21c0 con 0x56000d1e14d0 2024-08-31T04:38:34.121 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:34.118+0000 7fb488c00640 1 -- 172.21.15.50:0/3846216655 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb47c0e26f0 con 0x56000d1e14d0 2024-08-31T04:38:34.122 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:34.119+0000 7fb4a1e5f740 1 -- 172.21.15.50:0/3846216655 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56000d1e14d0 msgr2=0x56000d5b9330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:38:34.122 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:34.119+0000 7fb4a1e5f740 1 --2- 172.21.15.50:0/3846216655 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56000d1e14d0 0x56000d5b9330 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7fb47c0e2570 tx=0x7fb47c0a7490 comp rx=0 tx=0).stop 2024-08-31T04:38:34.122 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:34.119+0000 7fb4a1e5f740 1 -- 172.21.15.50:0/3846216655 shutdown_connections 2024-08-31T04:38:34.122 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:34.119+0000 7fb4a1e5f740 1 --2- 172.21.15.50:0/3846216655 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56000d2021b0 0x56000d5ac390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:38:34.122 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:34.119+0000 7fb4a1e5f740 1 --2- 172.21.15.50:0/3846216655 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56000d1e14d0 0x56000d5b9330 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:38:34.122 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:34.119+0000 7fb4a1e5f740 1 --2- 172.21.15.50:0/3846216655 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56000d1d92f0 0x56000d5abe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:38:34.122 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:34.119+0000 7fb4a1e5f740 1 -- 172.21.15.50:0/3846216655 >> 172.21.15.50:0/3846216655 conn(0x56000d1f6300 msgr2=0x56000d5af7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:38:34.122 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:34.119+0000 7fb4a1e5f740 1 -- 172.21.15.50:0/3846216655 shutdown_connections 2024-08-31T04:38:34.122 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:34.119+0000 7fb4a1e5f740 1 -- 172.21.15.50:0/3846216655 wait complete. 2024-08-31T04:38:34.125 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:34.120+0000 7fb4a1e5f740 1 -- start start 2024-08-31T04:38:34.125 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:34.120+0000 7fb4a1e5f740 1 Processor -- start 2024-08-31T04:38:34.125 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:34.120+0000 7fb4a1e5f740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56000d1d92f0 0x56000d623500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:38:34.125 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:34.120+0000 7fb4a1e5f740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56000d2021b0 0x56000d625bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:38:34.125 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:34.120+0000 7fb4a1e5f740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56000d1961c0 0x56000d6282d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:38:34.125 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:34.120+0000 7fb4a1e5f740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fb4941ae2f0 con 0x56000d2021b0 2024-08-31T04:38:34.125 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:34.120+0000 7fb4a1e5f740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7fb4941adb60 con 0x56000d1961c0 2024-08-31T04:38:34.125 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:34.120+0000 7fb4a1e5f740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fb4941aac20 con 0x56000d1d92f0 2024-08-31T04:38:34.125 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:34.120+0000 7fb4a1e5f740 10 client.0 _ll_register_callbacks cb 0x7fb484009930 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:38:34.125 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:34.121+0000 7fb48be00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56000d2021b0 0x56000d625bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:38:34.125 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:34.121+0000 7fb493e00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56000d1d92f0 0x56000d623500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:38:34.126 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:34.121+0000 7fb48be00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56000d2021b0 0x56000d625bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:43674/0 (socket says 172.21.15.50:43674) 2024-08-31T04:38:34.126 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:34.121+0000 7fb48be00640 1 -- 172.21.15.50:0/3315587412 learned_addr learned my addr 172.21.15.50:0/3315587412 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:38:34.126 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:34.121+0000 7fb498e00640 1 --2- 172.21.15.50:0/3315587412 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56000d1961c0 0x56000d6282d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:38:34.126 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:34.121+0000 7fb48be00640 1 -- 172.21.15.50:0/3315587412 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56000d1d92f0 msgr2=0x56000d623500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:38:34.126 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:34.121+0000 7fb48be00640 1 --2- 172.21.15.50:0/3315587412 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56000d1d92f0 0x56000d623500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:38:34.126 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:34.121+0000 7fb48be00640 1 -- 172.21.15.50:0/3315587412 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56000d1961c0 msgr2=0x56000d6282d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:38:34.126 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:34.121+0000 7fb48be00640 1 --2- 172.21.15.50:0/3315587412 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56000d1961c0 0x56000d6282d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:38:34.126 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:34.121+0000 7fb48be00640 1 -- 172.21.15.50:0/3315587412 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56000d628a60 con 0x56000d2021b0 2024-08-31T04:38:34.126 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:34.121+0000 7fb498e00640 1 --2- 172.21.15.50:0/3315587412 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56000d1961c0 0x56000d6282d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:38:34.126 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:34.121+0000 7fb48be00640 1 --2- 172.21.15.50:0/3315587412 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56000d2021b0 0x56000d625bb0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7fb47c0e25c0 tx=0x7fb47c009f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eadeb3555a285a45 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:38:34.126 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:34.121+0000 7fb482000640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-08-31T04:38:34.126 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:34.121+0000 7fb482000640 1 -- 172.21.15.50:0/3315587412 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb47c096040 con 0x56000d2021b0 2024-08-31T04:38:34.126 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:34.121+0000 7fb482000640 1 -- 172.21.15.50:0/3315587412 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8219+0+0 (secure 0 0 0) 0x7fb47c0a7730 con 0x56000d2021b0 2024-08-31T04:38:34.127 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:34.122+0000 7fb4a1e5f740 1 -- 172.21.15.50:0/3315587412 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb47c0d21c0 con 0x56000d2021b0 2024-08-31T04:38:34.127 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:34.122+0000 7fb482000640 1 -- 172.21.15.50:0/3315587412 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=71) ==== 24+0+0 (secure 0 0 0) 0x7fb47c0ab4a0 con 0x56000d2021b0 2024-08-31T04:38:34.127 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:34.122+0000 7fb4a1e5f740 10 client.16800 fetch_fsmap learned FSMap version 71 2024-08-31T04:38:34.127 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:34.122+0000 7fb4a1e5f740 1 -- 172.21.15.50:0/3315587412 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=71,monmap=4+}) -- 0x56000d629cf0 con 0x56000d2021b0 2024-08-31T04:38:34.127 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:34.122+0000 7fb482000640 1 -- 172.21.15.50:0/3315587412 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb47c0d21c0 con 0x56000d2021b0 2024-08-31T04:38:34.127 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:34.122+0000 7fb482000640 1 -- 172.21.15.50:0/3315587412 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 71) ==== 8442+0+0 (secure 0 0 0) 0x7fb47c0a5bc0 con 0x56000d2021b0 2024-08-31T04:38:34.127 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:34.122+0000 7fb4a1e5f740 10 client.16800 fetch_fsmap finished waiting for FSMap version 71 2024-08-31T04:38:34.127 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:34.122+0000 7fb4a1e5f740 10 client.16800 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T04:38:34.127 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:34.122+0000 7fb4a1e5f740 20 client.16800 populate_metadata read hostname 'smithi050' 2024-08-31T04:38:34.127 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:34.122+0000 7fb4a1e5f740 1 --2- 172.21.15.50:0/3315587412 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x56000d62a680 0x56000d62caa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:38:34.127 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:34.122+0000 7fb4a1e5f740 4 client.16800 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-31T04:38:34.127 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:34.122+0000 7fb4a1e5f740 1 -- 172.21.15.50:0/3315587412 --> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] -- command(tid 0: {"prefix": "flush journal"}) -- 0x56000d518960 con 0x56000d62a680 2024-08-31T04:38:34.128 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:34.123+0000 7fb493e00640 1 --2- 172.21.15.50:0/3315587412 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x56000d62a680 0x56000d62caa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:38:34.128 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:34.123+0000 7fb493e00640 1 --2- 172.21.15.50:0/3315587412 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x56000d62a680 0x56000d62caa0 crc :-1 s=READY pgs=186 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=58ecf7927730e9a9 server_cookie=6fc4631b4d7d7357 in_seq=0 out_seq=0 2024-08-31T04:38:34.128 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:34.123+0000 7fb482000640 10 client.16800 ms_handle_connect on v2:172.21.15.133:6838/2526402262 2024-08-31T04:38:34.151 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:34.150+0000 7fb482000640 1 -- 172.21.15.50:0/3315587412 <== mds.0 v2:172.21.15.133:6838/2526402262 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x56000d518960 con 0x56000d62a680 2024-08-31T04:38:34.151 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:34.150+0000 7fb482000640 10 client.16800 handle_command_reply: tid=0 2024-08-31T04:38:34.152 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:34.150+0000 7fb4a1e5f740 1 client.16800 shutdown 2024-08-31T04:38:34.153 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:34.152+0000 7fb4a1e5f740 1 -- 172.21.15.50:0/3315587412 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56000d2021b0 msgr2=0x56000d625bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:38:34.153 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:34.152+0000 7fb4a1e5f740 1 --2- 172.21.15.50:0/3315587412 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56000d2021b0 0x56000d625bb0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7fb47c0e25c0 tx=0x7fb47c009f50 comp rx=0 tx=0).stop 2024-08-31T04:38:34.154 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:34.152+0000 7fb4a1e5f740 1 -- 172.21.15.50:0/3315587412 shutdown_connections 2024-08-31T04:38:34.154 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:34.152+0000 7fb4a1e5f740 1 --2- 172.21.15.50:0/3315587412 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x56000d62a680 0x56000d62caa0 crc :-1 s=READY pgs=186 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:38:34.154 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:34.152+0000 7fb4a1e5f740 1 --2- 172.21.15.50:0/3315587412 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56000d1961c0 0x56000d6282d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:38:34.154 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:34.152+0000 7fb4a1e5f740 1 --2- 172.21.15.50:0/3315587412 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56000d2021b0 0x56000d625bb0 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:38:34.154 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:34.152+0000 7fb4a1e5f740 1 --2- 172.21.15.50:0/3315587412 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56000d1d92f0 0x56000d623500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:38:34.154 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:34.152+0000 7fb4a1e5f740 1 -- 172.21.15.50:0/3315587412 >> 172.21.15.50:0/3315587412 conn(0x56000d1f6300 msgr2=0x56000d5abe50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:38:34.155 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:34.152+0000 7fb482000640 0 client.16800 ms_handle_reset on v2:172.21.15.133:6838/2526402262 2024-08-31T04:38:34.155 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:34.153+0000 7fb4a1e5f740 1 -- 172.21.15.50:0/3315587412 shutdown_connections 2024-08-31T04:38:34.155 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:34.153+0000 7fb4a1e5f740 1 -- 172.21.15.50:0/3315587412 wait complete. 2024-08-31T04:38:34.155 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:34.153+0000 7fb4a1e5f740 20 client.16800 trim_cache size 0 max 16384 2024-08-31T04:38:34.155 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout:{ 2024-08-31T04:38:34.155 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout: "message": "", 2024-08-31T04:38:34.155 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout: "return_code": 0 2024-08-31T04:38:34.155 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stdout:} 2024-08-31T04:38:34.156 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:34.154+0000 7fb499800640 1 -- 172.21.15.50:0/2897502708 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fb4780b4bb0 msgr2=0x7fb4780b70c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:38:34.156 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:34.154+0000 7fb499800640 1 --2- 172.21.15.50:0/2897502708 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fb4780b4bb0 0x7fb4780b70c0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fb48c004270 tx=0x7fb48c02a8c0 comp rx=0 tx=0).stop 2024-08-31T04:38:34.156 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:34.154+0000 7fb499800640 1 -- 172.21.15.50:0/2897502708 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb494104300 msgr2=0x7fb49419c350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:38:34.156 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:34.154+0000 7fb499800640 1 --2- 172.21.15.50:0/2897502708 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb494104300 0x7fb49419c350 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7fb47c00d950 tx=0x7fb47c00de10 comp rx=0 tx=0).stop 2024-08-31T04:38:34.156 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:34.154+0000 7fb499800640 1 -- 172.21.15.50:0/2897502708 shutdown_connections 2024-08-31T04:38:34.156 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:34.154+0000 7fb499800640 1 --2- 172.21.15.50:0/2897502708 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fb4780b4bb0 0x7fb4780b70c0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:38:34.157 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:34.154+0000 7fb499800640 1 --2- 172.21.15.50:0/2897502708 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb494104ca0 0x7fb49419cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:38:34.157 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:34.154+0000 7fb499800640 1 --2- 172.21.15.50:0/2897502708 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb494104300 0x7fb49419c350 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:38:34.157 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:34.154+0000 7fb499800640 1 --2- 172.21.15.50:0/2897502708 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb494103280 0x7fb49419bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:38:34.157 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:34.154+0000 7fb499800640 1 -- 172.21.15.50:0/2897502708 >> 172.21.15.50:0/2897502708 conn(0x7fb4940febc0 msgr2=0x7fb494075390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:38:34.157 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:34.154+0000 7fb499800640 1 -- 172.21.15.50:0/2897502708 shutdown_connections 2024-08-31T04:38:34.157 INFO:teuthology.task.background_exec.ubuntu@smithi050.front.sepia.ceph.com.smithi050.stderr:2024-08-31T04:38:34.154+0000 7fb499800640 1 -- 172.21.15.50:0/2897502708 wait complete. 2024-08-31T04:38:34.530 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:34.508+0000 7fbe8c800640 1 -- 172.21.15.50:0/1045715335 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbe8410fe80 msgr2=0x7fbe841122c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:38:34.530 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:34.508+0000 7fbe8c800640 1 --2- 172.21.15.50:0/1045715335 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbe8410fe80 0x7fbe841122c0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7fbe80009ca0 tx=0x7fbe8002a8c0 comp rx=0 tx=0).stop 2024-08-31T04:38:34.530 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:34.508+0000 7fbe8c800640 1 -- 172.21.15.50:0/1045715335 shutdown_connections 2024-08-31T04:38:34.530 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:34.508+0000 7fbe8c800640 1 --2- 172.21.15.50:0/1045715335 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbe84075ea0 0x7fbe8410f940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:38:34.531 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:34.508+0000 7fbe8c800640 1 --2- 172.21.15.50:0/1045715335 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbe8410fe80 0x7fbe841122c0 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:38:34.531 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:34.508+0000 7fbe8c800640 1 --2- 172.21.15.50:0/1045715335 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbe84075550 0x7fbe84075960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:38:34.531 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:34.508+0000 7fbe8c800640 1 -- 172.21.15.50:0/1045715335 >> 172.21.15.50:0/1045715335 conn(0x7fbe840ff330 msgr2=0x7fbe84101780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:38:34.531 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:34.508+0000 7fbe8c800640 1 -- 172.21.15.50:0/1045715335 shutdown_connections 2024-08-31T04:38:34.531 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:34.508+0000 7fbe8c800640 1 -- 172.21.15.50:0/1045715335 wait complete. 2024-08-31T04:38:34.531 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:34.509+0000 7fbe8c800640 1 Processor -- start 2024-08-31T04:38:34.531 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:34.510+0000 7fbe8c800640 1 -- start start 2024-08-31T04:38:34.531 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:34.510+0000 7fbe8c800640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbe84075550 0x7fbe8419c3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:38:34.531 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:34.510+0000 7fbe8c800640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbe84075ea0 0x7fbe8419c990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:38:34.531 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:34.510+0000 7fbe8c800640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbe8410fe80 0x7fbe841a1c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:38:34.531 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:34.510+0000 7fbe8c800640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fbe84115a80 con 0x7fbe84075550 2024-08-31T04:38:34.531 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:34.510+0000 7fbe8c800640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7fbe84115900 con 0x7fbe8410fe80 2024-08-31T04:38:34.531 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:34.510+0000 7fbe8c800640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fbe84115c00 con 0x7fbe84075ea0 2024-08-31T04:38:34.532 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:34.510+0000 7fbe89e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbe84075550 0x7fbe8419c3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:38:34.532 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:34.510+0000 7fbe89e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbe84075550 0x7fbe8419c3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:43702/0 (socket says 172.21.15.50:43702) 2024-08-31T04:38:34.532 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:34.510+0000 7fbe89e00640 1 -- 172.21.15.50:0/3970558757 learned_addr learned my addr 172.21.15.50:0/3970558757 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:38:34.532 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:34.510+0000 7fbe89400640 1 --2- 172.21.15.50:0/3970558757 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbe84075ea0 0x7fbe8419c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:38:34.532 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:34.510+0000 7fbe8a800640 1 --2- 172.21.15.50:0/3970558757 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbe8410fe80 0x7fbe841a1c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:38:34.532 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:34.511+0000 7fbe89e00640 1 -- 172.21.15.50:0/3970558757 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbe84075ea0 msgr2=0x7fbe8419c990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:38:34.532 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:34.511+0000 7fbe89e00640 1 --2- 172.21.15.50:0/3970558757 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbe84075ea0 0x7fbe8419c990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:38:34.532 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:34.511+0000 7fbe89e00640 1 -- 172.21.15.50:0/3970558757 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbe8410fe80 msgr2=0x7fbe841a1c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:38:34.532 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:34.511+0000 7fbe89e00640 1 --2- 172.21.15.50:0/3970558757 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbe8410fe80 0x7fbe841a1c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:38:34.532 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:34.511+0000 7fbe89e00640 1 -- 172.21.15.50:0/3970558757 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe841a2360 con 0x7fbe84075550 2024-08-31T04:38:34.532 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:34.511+0000 7fbe89400640 1 --2- 172.21.15.50:0/3970558757 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbe84075ea0 0x7fbe8419c990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:38:34.532 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:34.511+0000 7fbe89e00640 1 --2- 172.21.15.50:0/3970558757 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbe84075550 0x7fbe8419c3f0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7fbe7800e9f0 tx=0x7fbe7800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:38:34.532 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:34.512+0000 7fbe7ea00640 1 -- 172.21.15.50:0/3970558757 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe7800cd80 con 0x7fbe84075550 2024-08-31T04:38:34.532 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:34.512+0000 7fbe7ea00640 1 -- 172.21.15.50:0/3970558757 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbe780108e0 con 0x7fbe84075550 2024-08-31T04:38:34.533 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:34.512+0000 7fbe7ea00640 1 -- 172.21.15.50:0/3970558757 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe78018980 con 0x7fbe84075550 2024-08-31T04:38:34.533 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:34.512+0000 7fbe8c800640 1 -- 172.21.15.50:0/3970558757 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbe841a2650 con 0x7fbe84075550 2024-08-31T04:38:34.533 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:34.512+0000 7fbe8c800640 1 -- 172.21.15.50:0/3970558757 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbe841a8db0 con 0x7fbe84075550 2024-08-31T04:38:34.533 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:34.515+0000 7fbe9344c740 1 Processor -- start 2024-08-31T04:38:34.533 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:34.515+0000 7fbe9344c740 1 -- start start 2024-08-31T04:38:34.533 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:34.516+0000 7fbe9344c740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a0989132d0 0x55a098cba110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:38:34.533 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:34.516+0000 7fbe9344c740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55a0988ea410 0x55a098cba650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:38:34.533 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:34.516+0000 7fbe9344c740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55a0988f25f0 0x55a098cbab90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:38:34.533 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:34.516+0000 7fbe9344c740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55a098c2f790 con 0x55a0989132d0 2024-08-31T04:38:34.533 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:34.516+0000 7fbe9344c740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x55a098c1ed20 con 0x55a0988ea410 2024-08-31T04:38:34.534 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:34.516+0000 7fbe9344c740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x55a098c22cd0 con 0x55a0988f25f0 2024-08-31T04:38:34.534 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:34.516+0000 7fbe7ea00640 1 -- 172.21.15.50:0/3970558757 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 18) ==== 152577+0+0 (secure 0 0 0) 0x7fbe78010430 con 0x7fbe84075550 2024-08-31T04:38:34.534 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:34.516+0000 7fbe8a800640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a0989132d0 0x55a098cba110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:38:34.534 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:34.516+0000 7fbe8a800640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a0989132d0 0x55a098cba110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:43708/0 (socket says 172.21.15.50:43708) 2024-08-31T04:38:34.534 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:34.516+0000 7fbe8a800640 1 -- 172.21.15.50:0/3037027231 learned_addr learned my addr 172.21.15.50:0/3037027231 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:38:34.534 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:34.516+0000 7fbe89400640 1 --2- 172.21.15.50:0/3037027231 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55a0988f25f0 0x55a098cbab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:38:34.534 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:34.516+0000 7fbe89e00640 1 --2- 172.21.15.50:0/3037027231 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55a0988ea410 0x55a098cba650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:38:34.534 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:34.517+0000 7fbe8a800640 1 -- 172.21.15.50:0/3037027231 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55a0988f25f0 msgr2=0x55a098cbab90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:38:34.534 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:34.517+0000 7fbe8a800640 1 --2- 172.21.15.50:0/3037027231 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55a0988f25f0 0x55a098cbab90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:38:34.534 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:34.517+0000 7fbe8a800640 1 -- 172.21.15.50:0/3037027231 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55a0988ea410 msgr2=0x55a098cba650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:38:34.534 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:34.517+0000 7fbe8a800640 1 --2- 172.21.15.50:0/3037027231 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55a0988ea410 0x55a098cba650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:38:34.534 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:34.517+0000 7fbe8a800640 1 -- 172.21.15.50:0/3037027231 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a09897e8b0 con 0x55a0989132d0 2024-08-31T04:38:34.535 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:34.517+0000 7fbe89e00640 1 --2- 172.21.15.50:0/3037027231 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55a0988ea410 0x55a098cba650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T04:38:34.535 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:34.517+0000 7fbe8a800640 1 --2- 172.21.15.50:0/3037027231 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a0989132d0 0x55a098cba110 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7fbe80009ca0 tx=0x7fbe80009430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9a031cb01cd0775 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:38:34.535 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:34.517+0000 7fbe73000640 1 -- 172.21.15.50:0/3037027231 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe80031cf0 con 0x55a0989132d0 2024-08-31T04:38:34.535 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:34.517+0000 7fbe73000640 1 -- 172.21.15.50:0/3037027231 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbe80036030 con 0x55a0989132d0 2024-08-31T04:38:34.535 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:34.517+0000 7fbe73000640 1 -- 172.21.15.50:0/3037027231 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe800042a0 con 0x55a0989132d0 2024-08-31T04:38:34.535 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:34.518+0000 7fbe7ea00640 1 --2- 172.21.15.50:0/3970558757 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fbe6c0b4b30 0x7fbe6c0b7040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:38:34.535 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:34.518+0000 7fbe7ea00640 1 -- 172.21.15.50:0/3970558757 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8219+0+0 (secure 0 0 0) 0x7fbe780e5430 con 0x7fbe84075550 2024-08-31T04:38:34.535 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:34.518+0000 7fbe89e00640 1 --2- 172.21.15.50:0/3970558757 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fbe6c0b4b30 0x7fbe6c0b7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:38:34.535 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:34.518+0000 7fbe9344c740 1 -- 172.21.15.50:0/3037027231 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a0989132d0 msgr2=0x55a098cba110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:38:34.535 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:34.518+0000 7fbe9344c740 1 --2- 172.21.15.50:0/3037027231 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a0989132d0 0x55a098cba110 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7fbe80009ca0 tx=0x7fbe80009430 comp rx=0 tx=0).stop 2024-08-31T04:38:34.535 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:34.518+0000 7fbe9344c740 1 -- 172.21.15.50:0/3037027231 shutdown_connections 2024-08-31T04:38:34.535 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:34.518+0000 7fbe9344c740 1 --2- 172.21.15.50:0/3037027231 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55a0988f25f0 0x55a098cbab90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:38:34.535 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:34.518+0000 7fbe9344c740 1 --2- 172.21.15.50:0/3037027231 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55a0988ea410 0x55a098cba650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:38:34.535 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:34.518+0000 7fbe9344c740 1 --2- 172.21.15.50:0/3037027231 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a0989132d0 0x55a098cba110 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:38:34.535 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:34.518+0000 7fbe9344c740 1 -- 172.21.15.50:0/3037027231 >> 172.21.15.50:0/3037027231 conn(0x55a0989076c0 msgr2=0x55a098cb8000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:38:34.536 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:34.519+0000 7fbe9344c740 1 -- 172.21.15.50:0/3037027231 shutdown_connections 2024-08-31T04:38:34.536 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:34.519+0000 7fbe9344c740 1 -- 172.21.15.50:0/3037027231 wait complete. 2024-08-31T04:38:34.536 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:34.519+0000 7fbe89e00640 1 --2- 172.21.15.50:0/3970558757 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fbe6c0b4b30 0x7fbe6c0b7040 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x55a098cb8d90 tx=0x7fbe78000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:38:34.536 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:34.519+0000 7fbe9344c740 1 -- start start 2024-08-31T04:38:34.536 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:34.519+0000 7fbe9344c740 1 Processor -- start 2024-08-31T04:38:34.536 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:34.520+0000 7fbe9344c740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55a0988ea410 0x55a098cc5d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:38:34.536 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:34.520+0000 7fbe9344c740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55a0988f25f0 0x55a098cc62b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:38:34.536 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:34.520+0000 7fbe9344c740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a0989132d0 0x55a098cd1a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:38:34.536 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:34.520+0000 7fbe9344c740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55a098a81810 con 0x55a0989132d0 2024-08-31T04:38:34.536 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:34.520+0000 7fbe9344c740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x55a098bba2b0 con 0x55a0988ea410 2024-08-31T04:38:34.536 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:34.520+0000 7fbe9344c740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x55a098cc8710 con 0x55a0988f25f0 2024-08-31T04:38:34.536 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:34.520+0000 7fbe9344c740 10 client.0 _ll_register_callbacks cb 0x55a098bcb040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:38:34.536 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:34.520+0000 7fbe8a800640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a0989132d0 0x55a098cd1a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:38:34.537 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:34.520+0000 7fbe8a800640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a0989132d0 0x55a098cd1a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:43712/0 (socket says 172.21.15.50:43712) 2024-08-31T04:38:34.537 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:34.520+0000 7fbe8a800640 1 -- 172.21.15.50:0/1753141431 learned_addr learned my addr 172.21.15.50:0/1753141431 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:38:34.537 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:34.521+0000 7fbe89400640 1 --2- 172.21.15.50:0/1753141431 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55a0988f25f0 0x55a098cc62b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:38:34.537 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:34.521+0000 7fbe8a800640 1 --2- 172.21.15.50:0/1753141431 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55a0988ea410 0x55a098cc5d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:38:34.537 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:34.521+0000 7fbe8a800640 1 -- 172.21.15.50:0/1753141431 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55a0988f25f0 msgr2=0x55a098cc62b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:38:34.537 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:34.521+0000 7fbe8a800640 1 --2- 172.21.15.50:0/1753141431 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55a0988f25f0 0x55a098cc62b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:38:34.537 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:34.521+0000 7fbe8a800640 1 -- 172.21.15.50:0/1753141431 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55a0988ea410 msgr2=0x55a098cc5d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:38:34.537 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:34.521+0000 7fbe8a800640 1 --2- 172.21.15.50:0/1753141431 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55a0988ea410 0x55a098cc5d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:38:34.537 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:34.521+0000 7fbe8a800640 1 -- 172.21.15.50:0/1753141431 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a098bef1f0 con 0x55a0989132d0 2024-08-31T04:38:34.537 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:34.521+0000 7fbe8a800640 1 --2- 172.21.15.50:0/1753141431 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a0989132d0 0x55a098cd1a00 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x55a098cbc5b0 tx=0x7fbe80003e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0af4ee6680fd69e server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:38:34.537 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:34.521+0000 7fbe67400640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-08-31T04:38:34.537 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:34.521+0000 7fbe67400640 1 -- 172.21.15.50:0/1753141431 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe80059060 con 0x55a0989132d0 2024-08-31T04:38:34.538 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:34.522+0000 7fbe67400640 1 -- 172.21.15.50:0/1753141431 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8219+0+0 (secure 0 0 0) 0x7fbe80004640 con 0x55a0989132d0 2024-08-31T04:38:34.538 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:34.522+0000 7fbe9344c740 1 -- 172.21.15.50:0/1753141431 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbe80036030 con 0x55a0989132d0 2024-08-31T04:38:34.538 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:34.522+0000 7fbe67400640 1 -- 172.21.15.50:0/1753141431 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=71) ==== 24+0+0 (secure 0 0 0) 0x7fbe80004840 con 0x55a0989132d0 2024-08-31T04:38:34.538 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:34.522+0000 7fbe9344c740 10 client.16812 fetch_fsmap learned FSMap version 71 2024-08-31T04:38:34.538 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:34.522+0000 7fbe9344c740 1 -- 172.21.15.50:0/1753141431 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=71,monmap=4+}) -- 0x55a098cd46c0 con 0x55a0989132d0 2024-08-31T04:38:34.538 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:34.522+0000 7fbe67400640 1 -- 172.21.15.50:0/1753141431 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbe80036030 con 0x55a0989132d0 2024-08-31T04:38:34.538 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:34.522+0000 7fbe67400640 1 -- 172.21.15.50:0/1753141431 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 71) ==== 8442+0+0 (secure 0 0 0) 0x7fbe80043070 con 0x55a0989132d0 2024-08-31T04:38:34.538 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:34.523+0000 7fbe9344c740 10 client.16812 fetch_fsmap finished waiting for FSMap version 71 2024-08-31T04:38:34.538 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:34.523+0000 7fbe9344c740 10 client.16812 resolve_mds: validated gid 24695 aka daemon mds.b 2024-08-31T04:38:34.538 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:34.523+0000 7fbe9344c740 20 client.16812 populate_metadata read hostname 'smithi050' 2024-08-31T04:38:34.538 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:34.523+0000 7fbe9344c740 1 --2- 172.21.15.50:0/1753141431 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x55a0988d1c50 0x55a098cd7a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:38:34.538 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:34.523+0000 7fbe9344c740 4 client.16812 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T04:38:34.538 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:34.523+0000 7fbe9344c740 1 -- 172.21.15.50:0/1753141431 --> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a098c316e0 con 0x55a0988d1c50 2024-08-31T04:38:34.538 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:34.523+0000 7fbe89400640 1 --2- 172.21.15.50:0/1753141431 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x55a0988d1c50 0x55a098cd7a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:38:34.538 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:34.524+0000 7fbe89400640 1 --2- 172.21.15.50:0/1753141431 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x55a0988d1c50 0x55a098cd7a20 crc :-1 s=READY pgs=187 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f7ed7e5c3253acb0 server_cookie=1ef5d87740d61a74 in_seq=0 out_seq=0 2024-08-31T04:38:34.539 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:34.524+0000 7fbe67400640 10 client.16812 ms_handle_connect on v2:172.21.15.133:6838/2526402262 2024-08-31T04:38:34.539 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:34.524+0000 7fbe67400640 1 -- 172.21.15.50:0/1753141431 <== mds.0 v2:172.21.15.133:6838/2526402262 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55a098c316e0 con 0x55a0988d1c50 2024-08-31T04:38:34.539 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:34.524+0000 7fbe67400640 10 client.16812 handle_command_reply: tid=0 2024-08-31T04:38:34.539 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:34.525+0000 7fbe9344c740 1 client.16812 shutdown 2024-08-31T04:38:34.539 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:34.525+0000 7fbe9344c740 1 -- 172.21.15.50:0/1753141431 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a0989132d0 msgr2=0x55a098cd1a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:38:34.539 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:34.525+0000 7fbe9344c740 1 --2- 172.21.15.50:0/1753141431 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a0989132d0 0x55a098cd1a00 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x55a098cbc5b0 tx=0x7fbe80003e20 comp rx=0 tx=0).stop 2024-08-31T04:38:34.539 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:34.525+0000 7fbe9344c740 1 -- 172.21.15.50:0/1753141431 shutdown_connections 2024-08-31T04:38:34.539 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:34.525+0000 7fbe9344c740 1 --2- 172.21.15.50:0/1753141431 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x55a0988d1c50 0x55a098cd7a20 crc :-1 s=READY pgs=187 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:38:34.539 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:34.525+0000 7fbe9344c740 1 --2- 172.21.15.50:0/1753141431 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55a0988f25f0 0x55a098cc62b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:38:34.539 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:34.525+0000 7fbe9344c740 1 --2- 172.21.15.50:0/1753141431 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a0989132d0 0x55a098cd1a00 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:38:34.539 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:34.525+0000 7fbe9344c740 1 --2- 172.21.15.50:0/1753141431 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55a0988ea410 0x55a098cc5d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:38:34.539 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:34.525+0000 7fbe67400640 0 client.16812 ms_handle_reset on v2:172.21.15.133:6838/2526402262 2024-08-31T04:38:34.539 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:34.525+0000 7fbe9344c740 1 -- 172.21.15.50:0/1753141431 >> 172.21.15.50:0/1753141431 conn(0x55a0989076c0 msgr2=0x55a098cbd2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:38:34.539 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:34.525+0000 7fbe9344c740 1 -- 172.21.15.50:0/1753141431 shutdown_connections 2024-08-31T04:38:34.540 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:34.525+0000 7fbe9344c740 1 -- 172.21.15.50:0/1753141431 wait complete. 2024-08-31T04:38:34.540 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:34.525+0000 7fbe9344c740 20 client.16812 trim_cache size 0 max 16384 2024-08-31T04:38:34.545 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:34.544+0000 7fbe9344c740 1 Processor -- start 2024-08-31T04:38:34.545 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:34.544+0000 7fbe9344c740 1 -- start start 2024-08-31T04:38:34.546 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:34.544+0000 7fbe9344c740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a0988ea410 0x55a098cbf930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:38:34.546 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:34.544+0000 7fbe9344c740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55a0988f25f0 0x55a098cb75b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:38:34.546 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:34.545+0000 7fbe9344c740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55a0989132d0 0x55a098cb7af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:38:34.546 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:34.545+0000 7fbe9344c740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fbe841b12f0 con 0x55a0988ea410 2024-08-31T04:38:34.546 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:34.545+0000 7fbe9344c740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7fbe841b3070 con 0x55a0989132d0 2024-08-31T04:38:34.546 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:34.545+0000 7fbe9344c740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fbe841b1a80 con 0x55a0988f25f0 2024-08-31T04:38:34.547 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:34.545+0000 7fbe8a800640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a0988ea410 0x55a098cbf930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:38:34.547 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:34.545+0000 7fbe89400640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55a0988f25f0 0x55a098cb75b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:38:34.547 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:34.545+0000 7fbe8a800640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a0988ea410 0x55a098cbf930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:43728/0 (socket says 172.21.15.50:43728) 2024-08-31T04:38:34.547 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:34.545+0000 7fbe8a800640 1 -- 172.21.15.50:0/624025853 learned_addr learned my addr 172.21.15.50:0/624025853 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:38:34.547 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:34.545+0000 7fbe89400640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55a0988f25f0 0x55a098cb75b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.50:43500/0 (socket says 172.21.15.50:43500) 2024-08-31T04:38:34.547 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:34.545+0000 7fbe8a800640 1 --2- 172.21.15.50:0/624025853 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55a0989132d0 0x55a098cb7af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:38:34.548 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:34.545+0000 7fbe89400640 1 -- 172.21.15.50:0/624025853 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55a0989132d0 msgr2=0x55a098cb7af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:38:34.548 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:34.545+0000 7fbe89400640 1 --2- 172.21.15.50:0/624025853 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55a0989132d0 0x55a098cb7af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:38:34.548 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:34.545+0000 7fbe89400640 1 -- 172.21.15.50:0/624025853 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a0988ea410 msgr2=0x55a098cbf930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:38:34.548 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:34.545+0000 7fbe89400640 1 --2- 172.21.15.50:0/624025853 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a0988ea410 0x55a098cbf930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:38:34.548 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:34.545+0000 7fbe89400640 1 -- 172.21.15.50:0/624025853 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a098cc60c0 con 0x55a0988f25f0 2024-08-31T04:38:34.548 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:34.545+0000 7fbe8a800640 1 --2- 172.21.15.50:0/624025853 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55a0989132d0 0x55a098cb7af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:38:34.548 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:34.546+0000 7fbe89400640 1 --2- 172.21.15.50:0/624025853 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55a0988f25f0 0x55a098cb75b0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x55a098cd8040 tx=0x7fbe74005f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d3bf6b1529241cc2 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:38:34.548 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:34.546+0000 7fbe72600640 1 -- 172.21.15.50:0/624025853 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe74012e40 con 0x55a0988f25f0 2024-08-31T04:38:34.548 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:34.546+0000 7fbe72600640 1 -- 172.21.15.50:0/624025853 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbe740108e0 con 0x55a0988f25f0 2024-08-31T04:38:34.548 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:34.546+0000 7fbe72600640 1 -- 172.21.15.50:0/624025853 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe740039e0 con 0x55a0988f25f0 2024-08-31T04:38:34.550 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:34.547+0000 7fbe9344c740 1 -- 172.21.15.50:0/624025853 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55a0988f25f0 msgr2=0x55a098cb75b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:38:34.550 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:34.547+0000 7fbe9344c740 1 --2- 172.21.15.50:0/624025853 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55a0988f25f0 0x55a098cb75b0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x55a098cd8040 tx=0x7fbe74005f90 comp rx=0 tx=0).stop 2024-08-31T04:38:34.550 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:34.547+0000 7fbe9344c740 1 -- 172.21.15.50:0/624025853 shutdown_connections 2024-08-31T04:38:34.550 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:34.547+0000 7fbe9344c740 1 --2- 172.21.15.50:0/624025853 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55a0988f25f0 0x55a098cb75b0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:38:34.550 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:34.547+0000 7fbe9344c740 1 --2- 172.21.15.50:0/624025853 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55a0989132d0 0x55a098cb7af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:38:34.550 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:34.547+0000 7fbe9344c740 1 --2- 172.21.15.50:0/624025853 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a0988ea410 0x55a098cbf930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:38:34.550 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:34.547+0000 7fbe9344c740 1 -- 172.21.15.50:0/624025853 >> 172.21.15.50:0/624025853 conn(0x55a0989076c0 msgr2=0x55a098cbf220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:38:34.550 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:34.547+0000 7fbe9344c740 1 -- 172.21.15.50:0/624025853 shutdown_connections 2024-08-31T04:38:34.550 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:34.547+0000 7fbe9344c740 1 -- 172.21.15.50:0/624025853 wait complete. 2024-08-31T04:38:34.550 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:34.548+0000 7fbe9344c740 1 -- start start 2024-08-31T04:38:34.550 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:34.548+0000 7fbe9344c740 1 Processor -- start 2024-08-31T04:38:34.550 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:34.548+0000 7fbe9344c740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a0988ea410 0x55a098cca490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:38:34.551 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:34.548+0000 7fbe9344c740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55a0988f25f0 0x55a098ccaa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:38:34.551 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:34.549+0000 7fbe9344c740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55a0989132d0 0x55a098d3b430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:38:34.551 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:34.549+0000 7fbe9344c740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fbe841b29a0 con 0x55a0988ea410 2024-08-31T04:38:34.551 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:34.549+0000 7fbe9344c740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7fbe841b2210 con 0x55a0988f25f0 2024-08-31T04:38:34.551 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:34.549+0000 7fbe9344c740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fbe841af2d0 con 0x55a0989132d0 2024-08-31T04:38:34.551 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:34.549+0000 7fbe9344c740 10 client.0 _ll_register_callbacks cb 0x7fbe800099a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T04:38:34.552 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:34.549+0000 7fbe8a800640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a0988ea410 0x55a098cca490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:38:34.553 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:34.549+0000 7fbe8a800640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a0988ea410 0x55a098cca490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:43736/0 (socket says 172.21.15.50:43736) 2024-08-31T04:38:34.553 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:34.549+0000 7fbe8a800640 1 -- 172.21.15.50:0/4157676169 learned_addr learned my addr 172.21.15.50:0/4157676169 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:38:34.553 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:34.549+0000 7fbe89400640 1 --2- 172.21.15.50:0/4157676169 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55a0988f25f0 0x55a098ccaa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:38:34.553 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:34.549+0000 7fbe8a800640 1 --2- 172.21.15.50:0/4157676169 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55a0989132d0 0x55a098d3b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:38:34.553 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:34.549+0000 7fbe8a800640 1 -- 172.21.15.50:0/4157676169 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55a0989132d0 msgr2=0x55a098d3b430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:38:34.553 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:34.549+0000 7fbe8a800640 1 --2- 172.21.15.50:0/4157676169 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55a0989132d0 0x55a098d3b430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:38:34.553 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:34.549+0000 7fbe8a800640 1 -- 172.21.15.50:0/4157676169 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55a0988f25f0 msgr2=0x55a098ccaa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T04:38:34.553 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:34.549+0000 7fbe8a800640 1 --2- 172.21.15.50:0/4157676169 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55a0988f25f0 0x55a098ccaa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:38:34.553 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:34.549+0000 7fbe8a800640 1 -- 172.21.15.50:0/4157676169 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a098d3baa0 con 0x55a0988ea410 2024-08-31T04:38:34.554 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:34.550+0000 7fbe8a800640 1 --2- 172.21.15.50:0/4157676169 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a0988ea410 0x55a098cca490 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7fbe80003ef0 tx=0x7fbe80000f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb53a97775e9f062 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:38:34.554 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:34.550+0000 7fbe67400640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-08-31T04:38:34.554 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:34.550+0000 7fbe67400640 1 -- 172.21.15.50:0/4157676169 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe80059070 con 0x55a0988ea410 2024-08-31T04:38:34.554 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:34.550+0000 7fbe67400640 1 -- 172.21.15.50:0/4157676169 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8219+0+0 (secure 0 0 0) 0x7fbe80004350 con 0x55a0988ea410 2024-08-31T04:38:34.554 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:34.550+0000 7fbe9344c740 1 -- 172.21.15.50:0/4157676169 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbe740108e0 con 0x55a0988ea410 2024-08-31T04:38:34.554 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:34.550+0000 7fbe67400640 1 -- 172.21.15.50:0/4157676169 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=71) ==== 24+0+0 (secure 0 0 0) 0x7fbe80063040 con 0x55a0988ea410 2024-08-31T04:38:34.554 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:34.550+0000 7fbe9344c740 10 client.16818 fetch_fsmap learned FSMap version 71 2024-08-31T04:38:34.554 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:34.550+0000 7fbe9344c740 1 -- 172.21.15.50:0/4157676169 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=71,monmap=4+}) -- 0x55a098d42e70 con 0x55a0988ea410 2024-08-31T04:38:34.554 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:34.551+0000 7fbe67400640 1 -- 172.21.15.50:0/4157676169 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbe740108e0 con 0x55a0988ea410 2024-08-31T04:38:34.554 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:34.551+0000 7fbe67400640 1 -- 172.21.15.50:0/4157676169 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 71) ==== 8442+0+0 (secure 0 0 0) 0x7fbe80043040 con 0x55a0988ea410 2024-08-31T04:38:34.554 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:34.551+0000 7fbe9344c740 10 client.16818 fetch_fsmap finished waiting for FSMap version 71 2024-08-31T04:38:34.555 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:34.551+0000 7fbe9344c740 10 client.16818 resolve_mds: validated gid 24695 aka daemon mds.b 2024-08-31T04:38:34.555 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:34.551+0000 7fbe9344c740 20 client.16818 populate_metadata read hostname 'smithi050' 2024-08-31T04:38:34.555 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:34.551+0000 7fbe9344c740 1 --2- 172.21.15.50:0/4157676169 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x55a0988a7000 0x55a098d455a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:38:34.555 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:34.551+0000 7fbe9344c740 4 client.16818 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "quiesce db", "cancel": true, "all": true}] 2024-08-31T04:38:34.555 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:34.551+0000 7fbe9344c740 1 -- 172.21.15.50:0/4157676169 --> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] -- command(tid 0: {"prefix": "quiesce db", "cancel": true, "all": true}) -- 0x55a098c2d180 con 0x55a0988a7000 2024-08-31T04:38:34.555 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:34.551+0000 7fbe89400640 1 --2- 172.21.15.50:0/4157676169 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x55a0988a7000 0x55a098d455a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:38:34.556 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:34.552+0000 7fbe89400640 1 --2- 172.21.15.50:0/4157676169 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x55a0988a7000 0x55a098d455a0 crc :-1 s=READY pgs=188 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ae3ce015044644fc server_cookie=4101ed5a4704f34b in_seq=0 out_seq=0 2024-08-31T04:38:34.556 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:34.552+0000 7fbe67400640 10 client.16818 ms_handle_connect on v2:172.21.15.133:6838/2526402262 2024-08-31T04:38:34.556 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:34.553+0000 7fbe67400640 1 -- 172.21.15.50:0/4157676169 <== mds.0 v2:172.21.15.133:6838/2526402262 1 ==== command_reply(tid 0: 0 ) ==== 8+0+80 (crc 0 0 0) 0x55a098c2d180 con 0x55a0988a7000 2024-08-31T04:38:34.556 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:34.553+0000 7fbe67400640 10 client.16818 handle_command_reply: tid=0 2024-08-31T04:38:34.556 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:34.553+0000 7fbe9344c740 1 client.16818 shutdown 2024-08-31T04:38:34.556 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:34.553+0000 7fbe9344c740 1 -- 172.21.15.50:0/4157676169 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a0988ea410 msgr2=0x55a098cca490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:38:34.556 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:34.553+0000 7fbe9344c740 1 --2- 172.21.15.50:0/4157676169 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a0988ea410 0x55a098cca490 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7fbe80003ef0 tx=0x7fbe80000f40 comp rx=0 tx=0).stop 2024-08-31T04:38:34.557 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:34.553+0000 7fbe9344c740 1 -- 172.21.15.50:0/4157676169 shutdown_connections 2024-08-31T04:38:34.557 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:34.553+0000 7fbe9344c740 1 --2- 172.21.15.50:0/4157676169 >> [v2:172.21.15.133:6838/2526402262,v1:172.21.15.133:6839/2526402262] conn(0x55a0988a7000 0x55a098d455a0 crc :-1 s=READY pgs=188 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:38:34.557 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:34.553+0000 7fbe9344c740 1 --2- 172.21.15.50:0/4157676169 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55a0989132d0 0x55a098d3b430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:38:34.557 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:34.553+0000 7fbe9344c740 1 --2- 172.21.15.50:0/4157676169 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55a0988f25f0 0x55a098ccaa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:38:34.557 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:34.553+0000 7fbe9344c740 1 --2- 172.21.15.50:0/4157676169 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a0988ea410 0x55a098cca490 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:38:34.557 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:34.553+0000 7fbe9344c740 1 -- 172.21.15.50:0/4157676169 >> 172.21.15.50:0/4157676169 conn(0x55a0989076c0 msgr2=0x55a098cbb140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:38:34.557 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:34.553+0000 7fbe67400640 0 client.16818 ms_handle_reset on v2:172.21.15.133:6838/2526402262 2024-08-31T04:38:34.557 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:34.553+0000 7fbe9344c740 1 -- 172.21.15.50:0/4157676169 shutdown_connections 2024-08-31T04:38:34.557 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:34.553+0000 7fbe9344c740 1 -- 172.21.15.50:0/4157676169 wait complete. 2024-08-31T04:38:34.557 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:34.553+0000 7fbe9344c740 20 client.16818 trim_cache size 0 max 16384 2024-08-31T04:38:34.557 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-08-31T04:38:34.558 INFO:teuthology.orchestra.run.smithi050.stdout: "epoch": 71, 2024-08-31T04:38:34.558 INFO:teuthology.orchestra.run.smithi050.stdout: "leader": 24695, 2024-08-31T04:38:34.558 INFO:teuthology.orchestra.run.smithi050.stdout: "set_version": 18, 2024-08-31T04:38:34.558 INFO:teuthology.orchestra.run.smithi050.stdout: "sets": {} 2024-08-31T04:38:34.558 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-08-31T04:38:34.558 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:34.554+0000 7fbe8c800640 1 -- 172.21.15.50:0/3970558757 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fbe6c0b4b30 msgr2=0x7fbe6c0b7040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:38:34.558 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:34.554+0000 7fbe8c800640 1 --2- 172.21.15.50:0/3970558757 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fbe6c0b4b30 0x7fbe6c0b7040 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x55a098cb8d90 tx=0x7fbe78000bc0 comp rx=0 tx=0).stop 2024-08-31T04:38:34.558 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:34.554+0000 7fbe8c800640 1 -- 172.21.15.50:0/3970558757 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbe84075550 msgr2=0x7fbe8419c3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:38:34.559 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:34.554+0000 7fbe8c800640 1 --2- 172.21.15.50:0/3970558757 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbe84075550 0x7fbe8419c3f0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7fbe7800e9f0 tx=0x7fbe7800eeb0 comp rx=0 tx=0).stop 2024-08-31T04:38:34.559 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:34.554+0000 7fbe8c800640 1 -- 172.21.15.50:0/3970558757 shutdown_connections 2024-08-31T04:38:34.559 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:34.554+0000 7fbe8c800640 1 --2- 172.21.15.50:0/3970558757 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fbe6c0b4b30 0x7fbe6c0b7040 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:38:34.559 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:34.554+0000 7fbe8c800640 1 --2- 172.21.15.50:0/3970558757 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbe84075ea0 0x7fbe8419c990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:38:34.559 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:34.554+0000 7fbe8c800640 1 --2- 172.21.15.50:0/3970558757 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbe8410fe80 0x7fbe841a1c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:38:34.559 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:34.554+0000 7fbe8c800640 1 --2- 172.21.15.50:0/3970558757 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbe84075550 0x7fbe8419c3f0 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:38:34.559 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:34.554+0000 7fbe8c800640 1 -- 172.21.15.50:0/3970558757 >> 172.21.15.50:0/3970558757 conn(0x7fbe840ff330 msgr2=0x7fbe84107940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:38:34.559 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:34.554+0000 7fbe8c800640 1 -- 172.21.15.50:0/3970558757 shutdown_connections 2024-08-31T04:38:34.559 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:34.554+0000 7fbe8c800640 1 -- 172.21.15.50:0/3970558757 wait complete. 2024-08-31T04:38:35.334 ERROR:teuthology.run_tasks:Manager failed: quiescer Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/run_tasks.py", line 160, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.10/contextlib.py", line 142, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_d19e6118f7015f0047264006cb0c873528eb3ae6/qa/tasks/quiescer.py", line 422, in task stop_all_quiescers(ctx.ceph[cluster_name].thrashers) File "/home/teuthworker/src/git.ceph.com_ceph-c_d19e6118f7015f0047264006cb0c873528eb3ae6/qa/tasks/quiescer.py", line 381, in stop_all_quiescers raise RuntimeError(f"error during quiesce thrashing: {thrasher.exception}") RuntimeError: error during quiesce thrashing: Error quiescing set '9d491f02': 1 (EPERM) 2024-08-31T04:38:35.335 DEBUG:teuthology.run_tasks:Unwinding manager background_exec 2024-08-31T04:38:35.345 INFO:teuthology.task.background_exec:Stopping background command on ubuntu@smithi050.front.sepia.ceph.com 2024-08-31T04:38:35.358 DEBUG:teuthology.run_tasks:Unwinding manager check-counter 2024-08-31T04:38:35.370 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-31T04:38:35.627 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:35.625+0000 7f6553200640 1 -- 172.21.15.50:0/3946267023 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6554076e90 msgr2=0x7f6554075550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:38:35.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:35.625+0000 7f6553200640 1 --2- 172.21.15.50:0/3946267023 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6554076e90 0x7f6554075550 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f6544009900 tx=0x7f654402a410 comp rx=0 tx=0).stop 2024-08-31T04:38:35.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:35.625+0000 7f6553200640 1 -- 172.21.15.50:0/3946267023 shutdown_connections 2024-08-31T04:38:35.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:35.625+0000 7f6553200640 1 --2- 172.21.15.50:0/3946267023 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6554075a90 0x7f6554075ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:38:35.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:35.625+0000 7f6553200640 1 --2- 172.21.15.50:0/3946267023 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f655410b1f0 0x7f655410d6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:38:35.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:35.625+0000 7f6553200640 1 --2- 172.21.15.50:0/3946267023 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6554076e90 0x7f6554075550 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:38:35.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:35.625+0000 7f6553200640 1 -- 172.21.15.50:0/3946267023 >> 172.21.15.50:0/3946267023 conn(0x7f65540feba0 msgr2=0x7f6554101050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:38:35.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:35.625+0000 7f6553200640 1 -- 172.21.15.50:0/3946267023 shutdown_connections 2024-08-31T04:38:35.628 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:35.625+0000 7f6553200640 1 -- 172.21.15.50:0/3946267023 wait complete. 2024-08-31T04:38:35.630 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:35.626+0000 7f6553200640 1 Processor -- start 2024-08-31T04:38:35.630 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:35.626+0000 7f6553200640 1 -- start start 2024-08-31T04:38:35.630 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:35.626+0000 7f6553200640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6554075a90 0x7f655419bd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:38:35.631 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:35.626+0000 7f6553200640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6554076e90 0x7f655419c3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:38:35.631 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:35.626+0000 7f6553200640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f655410b1f0 0x7f655419cf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:38:35.631 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:35.626+0000 7f6553200640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f65541110b0 con 0x7f6554076e90 2024-08-31T04:38:35.631 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:35.626+0000 7f6553200640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f6554110f30 con 0x7f6554075a90 2024-08-31T04:38:35.631 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:35.626+0000 7f6553200640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f6554111230 con 0x7f655410b1f0 2024-08-31T04:38:35.631 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:35.627+0000 7f6551400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6554076e90 0x7f655419c3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:38:35.631 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:35.627+0000 7f6552800640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f655410b1f0 0x7f655419cf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:38:35.631 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:35.627+0000 7f6551400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6554076e90 0x7f655419c3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:43744/0 (socket says 172.21.15.50:43744) 2024-08-31T04:38:35.631 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:35.627+0000 7f6551400640 1 -- 172.21.15.50:0/2249424199 learned_addr learned my addr 172.21.15.50:0/2249424199 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:38:35.631 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:35.627+0000 7f6551e00640 1 --2- 172.21.15.50:0/2249424199 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6554075a90 0x7f655419bd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:38:35.631 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:35.627+0000 7f6552800640 1 -- 172.21.15.50:0/2249424199 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6554075a90 msgr2=0x7f655419bd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:38:35.631 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:35.627+0000 7f6552800640 1 --2- 172.21.15.50:0/2249424199 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6554075a90 0x7f655419bd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:38:35.632 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:35.627+0000 7f6552800640 1 -- 172.21.15.50:0/2249424199 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6554076e90 msgr2=0x7f655419c3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:38:35.632 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:35.627+0000 7f6552800640 1 --2- 172.21.15.50:0/2249424199 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6554076e90 0x7f655419c3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:38:35.632 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:35.627+0000 7f6552800640 1 -- 172.21.15.50:0/2249424199 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f655419d790 con 0x7f655410b1f0 2024-08-31T04:38:35.632 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:35.627+0000 7f6551e00640 1 --2- 172.21.15.50:0/2249424199 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6554075a90 0x7f655419bd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:38:35.632 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:35.627+0000 7f6551400640 1 --2- 172.21.15.50:0/2249424199 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6554076e90 0x7f655419c3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:38:35.632 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:35.628+0000 7f6552800640 1 --2- 172.21.15.50:0/2249424199 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f655410b1f0 0x7f655419cf70 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f654c009fd0 tx=0x7f654c00ef10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:38:35.632 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:35.628+0000 7f654aa00640 1 -- 172.21.15.50:0/2249424199 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f654c00ce20 con 0x7f655410b1f0 2024-08-31T04:38:35.632 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:35.628+0000 7f654aa00640 1 -- 172.21.15.50:0/2249424199 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f654c005020 con 0x7f655410b1f0 2024-08-31T04:38:35.632 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:35.628+0000 7f6553200640 1 -- 172.21.15.50:0/2249424199 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f655419da80 con 0x7f655410b1f0 2024-08-31T04:38:35.632 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:35.628+0000 7f654aa00640 1 -- 172.21.15.50:0/2249424199 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f654c010690 con 0x7f655410b1f0 2024-08-31T04:38:35.632 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:35.628+0000 7f6553200640 1 -- 172.21.15.50:0/2249424199 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f65541a4170 con 0x7f655410b1f0 2024-08-31T04:38:35.633 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:35.629+0000 7f6553200640 1 -- 172.21.15.50:0/2249424199 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f655419dce0 con 0x7f655410b1f0 2024-08-31T04:38:35.634 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:35.631+0000 7f654aa00640 1 -- 172.21.15.50:0/2249424199 <== mon.1 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 18) ==== 152577+0+0 (secure 0 0 0) 0x7f654c0054d0 con 0x7f655410b1f0 2024-08-31T04:38:35.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:35.633+0000 7f654aa00640 1 --2- 172.21.15.50:0/2249424199 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f65380b4b30 0x7f65380b7040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:38:35.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:35.633+0000 7f654aa00640 1 -- 172.21.15.50:0/2249424199 <== mon.1 v2:172.21.15.177:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8219+0+0 (secure 0 0 0) 0x7f654c0e5880 con 0x7f655410b1f0 2024-08-31T04:38:35.635 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:35.633+0000 7f6551e00640 1 --2- 172.21.15.50:0/2249424199 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f65380b4b30 0x7f65380b7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:38:35.636 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:35.634+0000 7f6551e00640 1 --2- 172.21.15.50:0/2249424199 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f65380b4b30 0x7f65380b7040 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f6544000c00 tx=0x7f6544031400 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:38:35.639 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:35.637+0000 7f654aa00640 1 -- 172.21.15.50:0/2249424199 <== mon.1 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f654c0ac960 con 0x7f655410b1f0 2024-08-31T04:38:35.811 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:38:35 smithi050 ceph-mon[17259]: pgmap v839: 97 pgs: 97 active+clean; 607 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.0 MiB/s wr, 359 op/s 2024-08-31T04:38:35.859 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:35.857+0000 7f6553200640 1 -- 172.21.15.50:0/2249424199 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f65541a43e0 con 0x7f655410b1f0 2024-08-31T04:38:35.861 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:35.858+0000 7f654aa00640 1 -- 172.21.15.50:0/2249424199 <== mon.1 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v80) ==== 74+0+22733 (secure 0 0 0) 0x7f654c0ac260 con 0x7f655410b1f0 2024-08-31T04:38:35.861 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-08-31T04:38:35.862 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":80,"fsid":"058d9fc6-674f-11ef-bcd4-c7b262605968","created":"2024-08-31T04:11:59.576131+0000","modified":"2024-08-31T04:30:03.186525+0000","last_up_change":"2024-08-31T04:19:44.619590+0000","last_in_change":"2024-08-31T04:19:21.022096+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-31T04:15:46.229142+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-31T04:20:38.249458+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"76","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-31T04:20:40.929092+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"76","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"416ecbde-4a7b-4bd1-b377-490925a33ce1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":3831273843},{"type":"v1","addr":"172.21.15.50:6803","nonce":3831273843}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":3831273843},{"type":"v1","addr":"172.21.15.50:6805","nonce":3831273843}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":3831273843},{"type":"v1","addr":"172.21.15.50:6809","nonce":3831273843}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":3831273843},{"type":"v1","addr":"172.21.15.50:6807","nonce":3831273843}]},"public_addr":"172.21.15.50:6803/3831273843","cluster_addr":"172.21.15.50:6805/3831273843","heartbeat_back_addr":"172.21.15.50:6809/3831273843","heartbeat_front_addr":"172.21.15.50:6807/3831273843","state":["exists","up"]},{"osd":1,"uuid":"5e008006-004d-4842-9885-93a2d27be1cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":475308203},{"type":"v1","addr":"172.21.15.133:6801","nonce":475308203}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":475308203},{"type":"v1","addr":"172.21.15.133:6803","nonce":475308203}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":475308203},{"type":"v1","addr":"172.21.15.133:6807","nonce":475308203}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":475308203},{"type":"v1","addr":"172.21.15.133:6805","nonce":475308203}]},"public_addr":"172.21.15.133:6801/475308203","cluster_addr":"172.21.15.133:6803/475308203","heartbeat_back_addr":"172.21.15.133:6807/475308203","heartbeat_front_addr":"172.21.15.133:6805/475308203","state":["exists","up"]},{"osd":2,"uuid":"7e6f1a26-f30d-4822-af69-8a08cb89fbce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":3091173426},{"type":"v1","addr":"172.21.15.177:6801","nonce":3091173426}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":3091173426},{"type":"v1","addr":"172.21.15.177:6803","nonce":3091173426}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":3091173426},{"type":"v1","addr":"172.21.15.177:6807","nonce":3091173426}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":3091173426},{"type":"v1","addr":"172.21.15.177:6805","nonce":3091173426}]},"public_addr":"172.21.15.177:6801/3091173426","cluster_addr":"172.21.15.177:6803/3091173426","heartbeat_back_addr":"172.21.15.177:6807/3091173426","heartbeat_front_addr":"172.21.15.177:6805/3091173426","state":["exists","up"]},{"osd":3,"uuid":"8193c2a2-18a1-4684-9a16-cbeae25530ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":3792992620},{"type":"v1","addr":"172.21.15.50:6811","nonce":3792992620}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":3792992620},{"type":"v1","addr":"172.21.15.50:6813","nonce":3792992620}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":3792992620},{"type":"v1","addr":"172.21.15.50:6817","nonce":3792992620}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":3792992620},{"type":"v1","addr":"172.21.15.50:6815","nonce":3792992620}]},"public_addr":"172.21.15.50:6811/3792992620","cluster_addr":"172.21.15.50:6813/3792992620","heartbeat_back_addr":"172.21.15.50:6817/3792992620","heartbeat_front_addr":"172.21.15.50:6815/3792992620","state":["exists","up"]},{"osd":4,"uuid":"2a2b4e64-0f8e-40ec-926c-84dbf691aefe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":2855333596},{"type":"v1","addr":"172.21.15.133:6809","nonce":2855333596}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":2855333596},{"type":"v1","addr":"172.21.15.133:6811","nonce":2855333596}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":2855333596},{"type":"v1","addr":"172.21.15.133:6815","nonce":2855333596}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":2855333596},{"type":"v1","addr":"172.21.15.133:6813","nonce":2855333596}]},"public_addr":"172.21.15.133:6809/2855333596","cluster_addr":"172.21.15.133:6811/2855333596","heartbeat_back_addr":"172.21.15.133:6815/2855333596","heartbeat_front_addr":"172.21.15.133:6813/2855333596","state":["exists","up"]},{"osd":5,"uuid":"83429ff0-ea7d-4fcc-9611-39d9001aa216","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":1166415084},{"type":"v1","addr":"172.21.15.177:6809","nonce":1166415084}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":1166415084},{"type":"v1","addr":"172.21.15.177:6811","nonce":1166415084}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":1166415084},{"type":"v1","addr":"172.21.15.177:6815","nonce":1166415084}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":1166415084},{"type":"v1","addr":"172.21.15.177:6813","nonce":1166415084}]},"public_addr":"172.21.15.177:6809/1166415084","cluster_addr":"172.21.15.177:6811/1166415084","heartbeat_back_addr":"172.21.15.177:6815/1166415084","heartbeat_front_addr":"172.21.15.177:6813/1166415084","state":["exists","up"]},{"osd":6,"uuid":"eeb571ef-5e43-4816-95dd-d01d83aeca83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":1429341184},{"type":"v1","addr":"172.21.15.50:6819","nonce":1429341184}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":1429341184},{"type":"v1","addr":"172.21.15.50:6821","nonce":1429341184}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":1429341184},{"type":"v1","addr":"172.21.15.50:6825","nonce":1429341184}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":1429341184},{"type":"v1","addr":"172.21.15.50:6823","nonce":1429341184}]},"public_addr":"172.21.15.50:6819/1429341184","cluster_addr":"172.21.15.50:6821/1429341184","heartbeat_back_addr":"172.21.15.50:6825/1429341184","heartbeat_front_addr":"172.21.15.50:6823/1429341184","state":["exists","up"]},{"osd":7,"uuid":"512ee507-0d50-4fed-b692-dbdf23a93e8e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":3643454923},{"type":"v1","addr":"172.21.15.133:6817","nonce":3643454923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":3643454923},{"type":"v1","addr":"172.21.15.133:6819","nonce":3643454923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":3643454923},{"type":"v1","addr":"172.21.15.133:6823","nonce":3643454923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":3643454923},{"type":"v1","addr":"172.21.15.133:6821","nonce":3643454923}]},"public_addr":"172.21.15.133:6817/3643454923","cluster_addr":"172.21.15.133:6819/3643454923","heartbeat_back_addr":"172.21.15.133:6823/3643454923","heartbeat_front_addr":"172.21.15.133:6821/3643454923","state":["exists","up"]},{"osd":8,"uuid":"ae99526e-41da-4cb5-857f-2e66f18f2d94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6816","nonce":101973300},{"type":"v1","addr":"172.21.15.177:6817","nonce":101973300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":101973300},{"type":"v1","addr":"172.21.15.177:6819","nonce":101973300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":101973300},{"type":"v1","addr":"172.21.15.177:6823","nonce":101973300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":101973300},{"type":"v1","addr":"172.21.15.177:6821","nonce":101973300}]},"public_addr":"172.21.15.177:6817/101973300","cluster_addr":"172.21.15.177:6819/101973300","heartbeat_back_addr":"172.21.15.177:6823/101973300","heartbeat_front_addr":"172.21.15.177:6821/101973300","state":["exists","up"]},{"osd":9,"uuid":"fcedbe16-b910-407f-b9d7-1dd03f3e62a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":53019860},{"type":"v1","addr":"172.21.15.50:6827","nonce":53019860}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":53019860},{"type":"v1","addr":"172.21.15.50:6829","nonce":53019860}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":53019860},{"type":"v1","addr":"172.21.15.50:6833","nonce":53019860}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":53019860},{"type":"v1","addr":"172.21.15.50:6831","nonce":53019860}]},"public_addr":"172.21.15.50:6827/53019860","cluster_addr":"172.21.15.50:6829/53019860","heartbeat_back_addr":"172.21.15.50:6833/53019860","heartbeat_front_addr":"172.21.15.50:6831/53019860","state":["exists","up"]},{"osd":10,"uuid":"3852756e-62f1-4e71-a070-8cff76df99b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":4175566493},{"type":"v1","addr":"172.21.15.133:6825","nonce":4175566493}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":4175566493},{"type":"v1","addr":"172.21.15.133:6827","nonce":4175566493}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":4175566493},{"type":"v1","addr":"172.21.15.133:6831","nonce":4175566493}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":4175566493},{"type":"v1","addr":"172.21.15.133:6829","nonce":4175566493}]},"public_addr":"172.21.15.133:6825/4175566493","cluster_addr":"172.21.15.133:6827/4175566493","heartbeat_back_addr":"172.21.15.133:6831/4175566493","heartbeat_front_addr":"172.21.15.133:6829/4175566493","state":["exists","up"]},{"osd":11,"uuid":"a154180a-5f2a-4b33-ad3d-fea7317597ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":2103454982},{"type":"v1","addr":"172.21.15.177:6825","nonce":2103454982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":2103454982},{"type":"v1","addr":"172.21.15.177:6827","nonce":2103454982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":2103454982},{"type":"v1","addr":"172.21.15.177:6831","nonce":2103454982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":2103454982},{"type":"v1","addr":"172.21.15.177:6829","nonce":2103454982}]},"public_addr":"172.21.15.177:6825/2103454982","cluster_addr":"172.21.15.177:6827/2103454982","heartbeat_back_addr":"172.21.15.177:6831/2103454982","heartbeat_front_addr":"172.21.15.177:6829/2103454982","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:14:54.683660+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:15:20.007319+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:15:43.613426+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:16:12.387010+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:16:38.079210+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:17:02.750375+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:17:31.735810+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:17:57.600985+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:18:22.503347+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:18:52.316657+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:19:18.444623+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:19:42.331006+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.b","mappings":[{"from":2,"to":4},{"from":8,"to":11}]},{"pgid":"2.1b","mappings":[{"from":2,"to":1}]},{"pgid":"2.1d","mappings":[{"from":8,"to":11}]},{"pgid":"3.e","mappings":[{"from":4,"to":6}]},{"pgid":"3.17","mappings":[{"from":4,"to":8}]},{"pgid":"3.25","mappings":[{"from":5,"to":9}]},{"pgid":"3.29","mappings":[{"from":3,"to":9}]},{"pgid":"3.36","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.50:6801/1319056820":"2024-09-01T04:12:55.742020+0000","172.21.15.50:0/1755103674":"2024-09-01T04:12:55.742020+0000","172.21.15.50:6800/1319056820":"2024-09-01T04:12:55.742020+0000","172.21.15.50:0/3701412233":"2024-09-01T04:12:55.742020+0000","172.21.15.50:0/1829556336":"2024-09-01T04:12:55.742020+0000","172.21.15.50:0/1698995126":"2024-09-01T04:12:25.753831+0000","172.21.15.50:0/1554317941":"2024-09-01T04:12:25.753831+0000","172.21.15.50:0/2998110380":"2024-09-01T04:12:25.753831+0000","172.21.15.50:6801/4197277793":"2024-09-01T04:12:25.753831+0000","172.21.15.50:6800/4197277793":"2024-09-01T04:12:25.753831+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-31T04:38:35.863 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:35.861+0000 7f6553200640 1 -- 172.21.15.50:0/2249424199 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f65380b4b30 msgr2=0x7f65380b7040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:38:35.863 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:35.861+0000 7f6553200640 1 --2- 172.21.15.50:0/2249424199 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f65380b4b30 0x7f65380b7040 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f6544000c00 tx=0x7f6544031400 comp rx=0 tx=0).stop 2024-08-31T04:38:35.863 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:35.861+0000 7f6553200640 1 -- 172.21.15.50:0/2249424199 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f655410b1f0 msgr2=0x7f655419cf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:38:35.864 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:35.861+0000 7f6553200640 1 --2- 172.21.15.50:0/2249424199 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f655410b1f0 0x7f655419cf70 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f654c009fd0 tx=0x7f654c00ef10 comp rx=0 tx=0).stop 2024-08-31T04:38:35.864 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:35.861+0000 7f6553200640 1 -- 172.21.15.50:0/2249424199 shutdown_connections 2024-08-31T04:38:35.864 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:35.861+0000 7f6553200640 1 --2- 172.21.15.50:0/2249424199 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f65380b4b30 0x7f65380b7040 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:38:35.864 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:35.861+0000 7f6553200640 1 --2- 172.21.15.50:0/2249424199 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f655410b1f0 0x7f655419cf70 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:38:35.864 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:35.861+0000 7f6553200640 1 --2- 172.21.15.50:0/2249424199 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6554076e90 0x7f655419c3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:38:35.864 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:35.861+0000 7f6553200640 1 --2- 172.21.15.50:0/2249424199 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6554075a90 0x7f655419bd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:38:35.864 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:35.861+0000 7f6553200640 1 -- 172.21.15.50:0/2249424199 >> 172.21.15.50:0/2249424199 conn(0x7f65540feba0 msgr2=0x7f65540ff020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:38:35.864 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:35.861+0000 7f6553200640 1 -- 172.21.15.50:0/2249424199 shutdown_connections 2024-08-31T04:38:35.864 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:35.861+0000 7f6553200640 1 -- 172.21.15.50:0/2249424199 wait complete. 2024-08-31T04:38:35.886 INFO:tasks.check_counter.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-08-31T04:15:46.229142+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-08-31T04:20:38.249458+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '76', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-08-31T04:20:40.929092+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '76', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-08-31T04:38:35.887 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-08-31T04:38:35.996 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:38:35 smithi177 ceph-mon[22025]: pgmap v839: 97 pgs: 97 active+clean; 607 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.0 MiB/s wr, 359 op/s 2024-08-31T04:38:36.043 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:38:35 smithi133 ceph-mon[22177]: pgmap v839: 97 pgs: 97 active+clean; 607 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.0 MiB/s wr, 359 op/s 2024-08-31T04:38:36.113 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:36.111+0000 7ff417200640 1 -- 172.21.15.50:0/3300201977 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff4101042d0 msgr2=0x7ff4101046e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:38:36.114 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:36.111+0000 7ff417200640 1 --2- 172.21.15.50:0/3300201977 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff4101042d0 0x7ff4101046e0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7ff400009900 tx=0x7ff40002a410 comp rx=0 tx=0).stop 2024-08-31T04:38:36.114 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:36.111+0000 7ff417200640 1 -- 172.21.15.50:0/3300201977 shutdown_connections 2024-08-31T04:38:36.114 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:36.111+0000 7ff417200640 1 --2- 172.21.15.50:0/3300201977 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff410104c70 0x7ff41010b610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:38:36.114 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:36.111+0000 7ff417200640 1 --2- 172.21.15.50:0/3300201977 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff4101042d0 0x7ff4101046e0 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:38:36.114 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:36.111+0000 7ff417200640 1 --2- 172.21.15.50:0/3300201977 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff410103250 0x7ff4101036c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:38:36.114 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:36.111+0000 7ff417200640 1 -- 172.21.15.50:0/3300201977 >> 172.21.15.50:0/3300201977 conn(0x7ff4100feb90 msgr2=0x7ff410101040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:38:36.114 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:36.111+0000 7ff417200640 1 -- 172.21.15.50:0/3300201977 shutdown_connections 2024-08-31T04:38:36.114 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:36.111+0000 7ff417200640 1 -- 172.21.15.50:0/3300201977 wait complete. 2024-08-31T04:38:36.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:36.112+0000 7ff417200640 1 Processor -- start 2024-08-31T04:38:36.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:36.112+0000 7ff417200640 1 -- start start 2024-08-31T04:38:36.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:36.112+0000 7ff417200640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff410103250 0x7ff410076bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:38:36.116 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:36.112+0000 7ff417200640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff4101042d0 0x7ff4100754b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:38:36.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:36.113+0000 7ff417200640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff410104c70 0x7ff4100759f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:38:36.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:36.113+0000 7ff417200640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7ff41010ef20 con 0x7ff410104c70 2024-08-31T04:38:36.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:36.113+0000 7ff417200640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7ff41010eda0 con 0x7ff4101042d0 2024-08-31T04:38:36.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:36.113+0000 7ff417200640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7ff41010f0a0 con 0x7ff410103250 2024-08-31T04:38:36.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:36.113+0000 7ff415e00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff410103250 0x7ff410076bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:38:36.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:36.113+0000 7ff416800640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff410104c70 0x7ff4100759f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:38:36.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:36.113+0000 7ff415e00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff410103250 0x7ff410076bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.50:43552/0 (socket says 172.21.15.50:43552) 2024-08-31T04:38:36.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:36.113+0000 7ff415e00640 1 -- 172.21.15.50:0/2255041404 learned_addr learned my addr 172.21.15.50:0/2255041404 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:38:36.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:36.113+0000 7ff415400640 1 --2- 172.21.15.50:0/2255041404 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff4101042d0 0x7ff4100754b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:38:36.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:36.113+0000 7ff415e00640 1 -- 172.21.15.50:0/2255041404 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff4101042d0 msgr2=0x7ff4100754b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:38:36.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:36.113+0000 7ff415e00640 1 --2- 172.21.15.50:0/2255041404 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff4101042d0 0x7ff4100754b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:38:36.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:36.113+0000 7ff415e00640 1 -- 172.21.15.50:0/2255041404 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff410104c70 msgr2=0x7ff4100759f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:38:36.117 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:36.113+0000 7ff415e00640 1 --2- 172.21.15.50:0/2255041404 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff410104c70 0x7ff4100759f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:38:36.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:36.113+0000 7ff415e00640 1 -- 172.21.15.50:0/2255041404 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff410076120 con 0x7ff410103250 2024-08-31T04:38:36.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:36.113+0000 7ff416800640 1 --2- 172.21.15.50:0/2255041404 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff410104c70 0x7ff4100759f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:38:36.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:36.114+0000 7ff415e00640 1 --2- 172.21.15.50:0/2255041404 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff410103250 0x7ff410076bf0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7ff40400e9f0 tx=0x7ff40400eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:38:36.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:36.114+0000 7ff40aa00640 1 -- 172.21.15.50:0/2255041404 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff40400cd80 con 0x7ff410103250 2024-08-31T04:38:36.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:36.114+0000 7ff417200640 1 -- 172.21.15.50:0/2255041404 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff4101a3b10 con 0x7ff410103250 2024-08-31T04:38:36.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:36.114+0000 7ff40aa00640 1 -- 172.21.15.50:0/2255041404 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff4040108e0 con 0x7ff410103250 2024-08-31T04:38:36.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:36.114+0000 7ff40aa00640 1 -- 172.21.15.50:0/2255041404 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff404018980 con 0x7ff410103250 2024-08-31T04:38:36.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:36.114+0000 7ff417200640 1 -- 172.21.15.50:0/2255041404 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff4101a4000 con 0x7ff410103250 2024-08-31T04:38:36.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:36.115+0000 7ff417200640 1 -- 172.21.15.50:0/2255041404 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff41010a420 con 0x7ff410103250 2024-08-31T04:38:36.120 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:36.118+0000 7ff40aa00640 1 -- 172.21.15.50:0/2255041404 <== mon.1 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 18) ==== 152577+0+0 (secure 0 0 0) 0x7ff404010430 con 0x7ff410103250 2024-08-31T04:38:36.122 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:36.119+0000 7ff40aa00640 1 --2- 172.21.15.50:0/2255041404 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7ff3f80b4bb0 0x7ff3f80b70c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:38:36.122 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:36.120+0000 7ff40aa00640 1 -- 172.21.15.50:0/2255041404 <== mon.1 v2:172.21.15.177:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8219+0+0 (secure 0 0 0) 0x7ff4040e58d0 con 0x7ff410103250 2024-08-31T04:38:36.122 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:36.120+0000 7ff415400640 1 --2- 172.21.15.50:0/2255041404 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7ff3f80b4bb0 0x7ff3f80b70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:38:36.122 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:36.120+0000 7ff415400640 1 --2- 172.21.15.50:0/2255041404 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7ff3f80b4bb0 0x7ff3f80b70c0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7ff400004770 tx=0x7ff4000314a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:38:36.123 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:36.121+0000 7ff40aa00640 1 -- 172.21.15.50:0/2255041404 <== mon.1 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7ff4040ac360 con 0x7ff410103250 2024-08-31T04:38:36.321 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:36.319+0000 7ff417200640 1 -- 172.21.15.50:0/2255041404 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7ff41002e680 con 0x7ff410103250 2024-08-31T04:38:36.322 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:36.320+0000 7ff40aa00640 1 -- 172.21.15.50:0/2255041404 <== mon.1 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v80) ==== 93+0+10 (secure 0 0 0) 0x7ff4040b0b20 con 0x7ff410103250 2024-08-31T04:38:36.322 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 1 2024-08-31T04:38:36.325 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:36.322+0000 7ff417200640 1 -- 172.21.15.50:0/2255041404 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7ff3f80b4bb0 msgr2=0x7ff3f80b70c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:38:36.325 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:36.322+0000 7ff417200640 1 --2- 172.21.15.50:0/2255041404 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7ff3f80b4bb0 0x7ff3f80b70c0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7ff400004770 tx=0x7ff4000314a0 comp rx=0 tx=0).stop 2024-08-31T04:38:36.325 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:36.322+0000 7ff417200640 1 -- 172.21.15.50:0/2255041404 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff410103250 msgr2=0x7ff410076bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:38:36.325 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:36.322+0000 7ff417200640 1 --2- 172.21.15.50:0/2255041404 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff410103250 0x7ff410076bf0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7ff40400e9f0 tx=0x7ff40400eeb0 comp rx=0 tx=0).stop 2024-08-31T04:38:36.325 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:36.322+0000 7ff417200640 1 -- 172.21.15.50:0/2255041404 shutdown_connections 2024-08-31T04:38:36.325 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:36.322+0000 7ff417200640 1 --2- 172.21.15.50:0/2255041404 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7ff3f80b4bb0 0x7ff3f80b70c0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:38:36.325 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:36.322+0000 7ff417200640 1 --2- 172.21.15.50:0/2255041404 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff410104c70 0x7ff4100759f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:38:36.325 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:36.322+0000 7ff417200640 1 --2- 172.21.15.50:0/2255041404 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff4101042d0 0x7ff4100754b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:38:36.325 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:36.322+0000 7ff417200640 1 --2- 172.21.15.50:0/2255041404 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff410103250 0x7ff410076bf0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:38:36.326 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:36.323+0000 7ff417200640 1 -- 172.21.15.50:0/2255041404 >> 172.21.15.50:0/2255041404 conn(0x7ff4100feb90 msgr2=0x7ff4101075f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:38:36.326 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:36.323+0000 7ff417200640 1 -- 172.21.15.50:0/2255041404 shutdown_connections 2024-08-31T04:38:36.326 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:36.323+0000 7ff417200640 1 -- 172.21.15.50:0/2255041404 wait complete. 2024-08-31T04:38:36.350 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-08-31T04:38:36.580 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:36.577+0000 7fbf87200640 1 -- 172.21.15.50:0/1476934857 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbf88106e90 msgr2=0x7fbf8810d830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:38:36.580 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:36.577+0000 7fbf87200640 1 --2- 172.21.15.50:0/1476934857 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbf88106e90 0x7fbf8810d830 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7fbf80009ca0 tx=0x7fbf8002a8c0 comp rx=0 tx=0).stop 2024-08-31T04:38:36.580 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:36.578+0000 7fbf87200640 1 -- 172.21.15.50:0/1476934857 shutdown_connections 2024-08-31T04:38:36.581 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:36.578+0000 7fbf87200640 1 --2- 172.21.15.50:0/1476934857 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbf881064f0 0x7fbf88106900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:38:36.581 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:36.578+0000 7fbf87200640 1 --2- 172.21.15.50:0/1476934857 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbf88106e90 0x7fbf8810d830 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:38:36.581 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:36.578+0000 7fbf87200640 1 --2- 172.21.15.50:0/1476934857 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbf88105470 0x7fbf881058e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:38:36.581 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:36.578+0000 7fbf87200640 1 -- 172.21.15.50:0/1476934857 >> 172.21.15.50:0/1476934857 conn(0x7fbf88100df0 msgr2=0x7fbf88103260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:38:36.581 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:36.578+0000 7fbf87200640 1 -- 172.21.15.50:0/1476934857 shutdown_connections 2024-08-31T04:38:36.581 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:36.578+0000 7fbf87200640 1 -- 172.21.15.50:0/1476934857 wait complete. 2024-08-31T04:38:36.583 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:36.579+0000 7fbf87200640 1 Processor -- start 2024-08-31T04:38:36.583 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:36.579+0000 7fbf87200640 1 -- start start 2024-08-31T04:38:36.583 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:36.579+0000 7fbf87200640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbf88105470 0x7fbf8819bc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:38:36.583 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:36.579+0000 7fbf87200640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbf881064f0 0x7fbf8819c290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:38:36.583 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:36.579+0000 7fbf87200640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbf88106e90 0x7fbf8819ce40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:38:36.583 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:36.579+0000 7fbf87200640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fbf881110e0 con 0x7fbf88106e90 2024-08-31T04:38:36.583 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:36.579+0000 7fbf87200640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7fbf88110f60 con 0x7fbf88105470 2024-08-31T04:38:36.583 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:36.579+0000 7fbf87200640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fbf88111260 con 0x7fbf881064f0 2024-08-31T04:38:36.584 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:36.579+0000 7fbf86800640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbf88106e90 0x7fbf8819ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:38:36.584 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:36.579+0000 7fbf86800640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbf88106e90 0x7fbf8819ce40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:43788/0 (socket says 172.21.15.50:43788) 2024-08-31T04:38:36.584 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:36.579+0000 7fbf86800640 1 -- 172.21.15.50:0/2090252530 learned_addr learned my addr 172.21.15.50:0/2090252530 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:38:36.584 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:36.579+0000 7fbf85400640 1 --2- 172.21.15.50:0/2090252530 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbf881064f0 0x7fbf8819c290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:38:36.584 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:36.579+0000 7fbf85e00640 1 --2- 172.21.15.50:0/2090252530 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbf88105470 0x7fbf8819bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:38:36.584 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:36.580+0000 7fbf86800640 1 -- 172.21.15.50:0/2090252530 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbf881064f0 msgr2=0x7fbf8819c290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:38:36.584 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:36.580+0000 7fbf86800640 1 --2- 172.21.15.50:0/2090252530 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbf881064f0 0x7fbf8819c290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:38:36.584 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:36.580+0000 7fbf86800640 1 -- 172.21.15.50:0/2090252530 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbf88105470 msgr2=0x7fbf8819bc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:38:36.584 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:36.580+0000 7fbf86800640 1 --2- 172.21.15.50:0/2090252530 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbf88105470 0x7fbf8819bc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:38:36.584 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:36.580+0000 7fbf86800640 1 -- 172.21.15.50:0/2090252530 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf8819d660 con 0x7fbf88106e90 2024-08-31T04:38:36.585 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:36.580+0000 7fbf85400640 1 --2- 172.21.15.50:0/2090252530 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbf881064f0 0x7fbf8819c290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:38:36.585 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:36.580+0000 7fbf85e00640 1 --2- 172.21.15.50:0/2090252530 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbf88105470 0x7fbf8819bc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T04:38:36.585 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:36.580+0000 7fbf86800640 1 --2- 172.21.15.50:0/2090252530 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbf88106e90 0x7fbf8819ce40 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7fbf80009430 tx=0x7fbf800316f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:38:36.585 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:36.580+0000 7fbf7ea00640 1 -- 172.21.15.50:0/2090252530 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf80003b70 con 0x7fbf88106e90 2024-08-31T04:38:36.585 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:36.580+0000 7fbf87200640 1 -- 172.21.15.50:0/2090252530 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbf8819d8f0 con 0x7fbf88106e90 2024-08-31T04:38:36.585 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:36.580+0000 7fbf7ea00640 1 -- 172.21.15.50:0/2090252530 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbf80003d10 con 0x7fbf88106e90 2024-08-31T04:38:36.585 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:36.581+0000 7fbf87200640 1 -- 172.21.15.50:0/2090252530 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbf881a4040 con 0x7fbf88106e90 2024-08-31T04:38:36.585 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:36.581+0000 7fbf7ea00640 1 -- 172.21.15.50:0/2090252530 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf8002fae0 con 0x7fbf88106e90 2024-08-31T04:38:36.586 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:36.582+0000 7fbf87200640 1 -- 172.21.15.50:0/2090252530 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbf881058e0 con 0x7fbf88106e90 2024-08-31T04:38:36.586 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:36.584+0000 7fbf7ea00640 1 -- 172.21.15.50:0/2090252530 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 18) ==== 152577+0+0 (secure 0 0 0) 0x7fbf80004610 con 0x7fbf88106e90 2024-08-31T04:38:36.588 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:36.586+0000 7fbf7ea00640 1 --2- 172.21.15.50:0/2090252530 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fbf6c0b4b30 0x7fbf6c0b7040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:38:36.588 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:36.586+0000 7fbf7ea00640 1 -- 172.21.15.50:0/2090252530 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8219+0+0 (secure 0 0 0) 0x7fbf80106880 con 0x7fbf88106e90 2024-08-31T04:38:36.588 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:36.586+0000 7fbf85e00640 1 --2- 172.21.15.50:0/2090252530 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fbf6c0b4b30 0x7fbf6c0b7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:38:36.589 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:36.587+0000 7fbf85e00640 1 --2- 172.21.15.50:0/2090252530 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fbf6c0b4b30 0x7fbf6c0b7040 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fbf78009c30 tx=0x7fbf78005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:38:36.589 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:36.587+0000 7fbf7ea00640 1 -- 172.21.15.50:0/2090252530 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fbf80083130 con 0x7fbf88106e90 2024-08-31T04:38:36.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:38:36 smithi050 ceph-mon[17259]: from='client.? 172.21.15.50:0/2249424199' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-31T04:38:36.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:38:36 smithi050 ceph-mon[17259]: from='client.? 172.21.15.50:0/2255041404' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-08-31T04:38:36.790 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:36.788+0000 7fbf87200640 1 -- 172.21.15.50:0/2090252530 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fbf8802e430 con 0x7fbf88106e90 2024-08-31T04:38:36.790 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:36.788+0000 7fbf7ea00640 1 -- 172.21.15.50:0/2090252530 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v80) ==== 104+0+11 (secure 0 0 0) 0x7fbf800cd960 con 0x7fbf88106e90 2024-08-31T04:38:36.790 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 32 2024-08-31T04:38:36.793 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:36.791+0000 7fbf87200640 1 -- 172.21.15.50:0/2090252530 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fbf6c0b4b30 msgr2=0x7fbf6c0b7040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:38:36.793 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:36.791+0000 7fbf87200640 1 --2- 172.21.15.50:0/2090252530 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fbf6c0b4b30 0x7fbf6c0b7040 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fbf78009c30 tx=0x7fbf78005f90 comp rx=0 tx=0).stop 2024-08-31T04:38:36.793 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:36.791+0000 7fbf87200640 1 -- 172.21.15.50:0/2090252530 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbf88106e90 msgr2=0x7fbf8819ce40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:38:36.794 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:36.791+0000 7fbf87200640 1 --2- 172.21.15.50:0/2090252530 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbf88106e90 0x7fbf8819ce40 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7fbf80009430 tx=0x7fbf800316f0 comp rx=0 tx=0).stop 2024-08-31T04:38:36.794 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:36.791+0000 7fbf87200640 1 -- 172.21.15.50:0/2090252530 shutdown_connections 2024-08-31T04:38:36.794 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:36.791+0000 7fbf87200640 1 --2- 172.21.15.50:0/2090252530 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fbf6c0b4b30 0x7fbf6c0b7040 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:38:36.794 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:36.791+0000 7fbf87200640 1 --2- 172.21.15.50:0/2090252530 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbf881064f0 0x7fbf8819c290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:38:36.794 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:36.791+0000 7fbf87200640 1 --2- 172.21.15.50:0/2090252530 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbf88106e90 0x7fbf8819ce40 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:38:36.794 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:36.791+0000 7fbf87200640 1 --2- 172.21.15.50:0/2090252530 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbf88105470 0x7fbf8819bc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:38:36.794 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:36.791+0000 7fbf87200640 1 -- 172.21.15.50:0/2090252530 >> 172.21.15.50:0/2090252530 conn(0x7fbf88100df0 msgr2=0x7fbf88109810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:38:36.794 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:36.791+0000 7fbf87200640 1 -- 172.21.15.50:0/2090252530 shutdown_connections 2024-08-31T04:38:36.794 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:36.791+0000 7fbf87200640 1 -- 172.21.15.50:0/2090252530 wait complete. 2024-08-31T04:38:36.819 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-08-31T04:38:36.996 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:38:36 smithi177 ceph-mon[22025]: from='client.? 172.21.15.50:0/2249424199' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-31T04:38:36.996 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:38:36 smithi177 ceph-mon[22025]: from='client.? 172.21.15.50:0/2255041404' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-08-31T04:38:37.043 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:38:36 smithi133 ceph-mon[22177]: from='client.? 172.21.15.50:0/2249424199' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-31T04:38:37.043 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:38:36 smithi133 ceph-mon[22177]: from='client.? 172.21.15.50:0/2255041404' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-08-31T04:38:37.046 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:37.043+0000 7fe2c2800640 1 -- 172.21.15.50:0/474234398 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe2bc075a30 msgr2=0x7fe2bc075e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:38:37.046 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:37.043+0000 7fe2c2800640 1 --2- 172.21.15.50:0/474234398 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe2bc075a30 0x7fe2bc075e40 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7fe2a8009900 tx=0x7fe2a802a3f0 comp rx=0 tx=0).stop 2024-08-31T04:38:37.046 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:37.044+0000 7fe2c2800640 1 -- 172.21.15.50:0/474234398 shutdown_connections 2024-08-31T04:38:37.046 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:37.044+0000 7fe2c2800640 1 --2- 172.21.15.50:0/474234398 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe2bc10b280 0x7fe2bc10d6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:38:37.046 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:37.044+0000 7fe2c2800640 1 --2- 172.21.15.50:0/474234398 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe2bc075a30 0x7fe2bc075e40 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:38:37.046 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:37.044+0000 7fe2c2800640 1 --2- 172.21.15.50:0/474234398 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe2bc076e30 0x7fe2bc0754f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:38:37.046 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:37.044+0000 7fe2c2800640 1 -- 172.21.15.50:0/474234398 >> 172.21.15.50:0/474234398 conn(0x7fe2bc0febd0 msgr2=0x7fe2bc101080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:38:37.047 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:37.044+0000 7fe2c2800640 1 -- 172.21.15.50:0/474234398 shutdown_connections 2024-08-31T04:38:37.047 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:37.044+0000 7fe2c2800640 1 -- 172.21.15.50:0/474234398 wait complete. 2024-08-31T04:38:37.048 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:37.045+0000 7fe2c2800640 1 Processor -- start 2024-08-31T04:38:37.048 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:37.045+0000 7fe2c2800640 1 -- start start 2024-08-31T04:38:37.048 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:37.045+0000 7fe2c2800640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe2bc075a30 0x7fe2bc19bcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:38:37.048 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:37.045+0000 7fe2c2800640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe2bc076e30 0x7fe2bc19c360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:38:37.048 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:37.045+0000 7fe2c2800640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe2bc10b280 0x7fe2bc19cf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:38:37.048 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:37.045+0000 7fe2c2800640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fe2bc111120 con 0x7fe2bc076e30 2024-08-31T04:38:37.048 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:37.045+0000 7fe2c2800640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7fe2bc110fa0 con 0x7fe2bc075a30 2024-08-31T04:38:37.048 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:37.045+0000 7fe2c2800640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fe2bc1112a0 con 0x7fe2bc10b280 2024-08-31T04:38:37.048 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:37.045+0000 7fe2c0a00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe2bc076e30 0x7fe2bc19c360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:38:37.048 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:37.045+0000 7fe2c0a00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe2bc076e30 0x7fe2bc19c360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:43806/0 (socket says 172.21.15.50:43806) 2024-08-31T04:38:37.048 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:37.045+0000 7fe2c1400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe2bc075a30 0x7fe2bc19bcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:38:37.049 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:37.045+0000 7fe2c0a00640 1 -- 172.21.15.50:0/1161153870 learned_addr learned my addr 172.21.15.50:0/1161153870 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:38:37.049 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:37.046+0000 7fe2c1e00640 1 --2- 172.21.15.50:0/1161153870 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe2bc10b280 0x7fe2bc19cf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:38:37.049 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:37.046+0000 7fe2c0a00640 1 -- 172.21.15.50:0/1161153870 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe2bc10b280 msgr2=0x7fe2bc19cf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:38:37.050 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:37.046+0000 7fe2c0a00640 1 --2- 172.21.15.50:0/1161153870 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe2bc10b280 0x7fe2bc19cf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:38:37.050 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:37.046+0000 7fe2c0a00640 1 -- 172.21.15.50:0/1161153870 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe2bc075a30 msgr2=0x7fe2bc19bcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:38:37.050 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:37.046+0000 7fe2c0a00640 1 --2- 172.21.15.50:0/1161153870 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe2bc075a30 0x7fe2bc19bcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:38:37.050 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:37.046+0000 7fe2c0a00640 1 -- 172.21.15.50:0/1161153870 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2bc19d730 con 0x7fe2bc076e30 2024-08-31T04:38:37.050 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:37.046+0000 7fe2c0a00640 1 --2- 172.21.15.50:0/1161153870 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe2bc076e30 0x7fe2bc19c360 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7fe2a8031440 tx=0x7fe2a8003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:38:37.050 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:37.047+0000 7fe2ba000640 1 -- 172.21.15.50:0/1161153870 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2a803f070 con 0x7fe2bc076e30 2024-08-31T04:38:37.050 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:37.047+0000 7fe2ba000640 1 -- 172.21.15.50:0/1161153870 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe2a8031c50 con 0x7fe2bc076e30 2024-08-31T04:38:37.050 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:37.047+0000 7fe2c2800640 1 -- 172.21.15.50:0/1161153870 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe2bc19d9c0 con 0x7fe2bc076e30 2024-08-31T04:38:37.050 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:37.047+0000 7fe2ba000640 1 -- 172.21.15.50:0/1161153870 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2a8035030 con 0x7fe2bc076e30 2024-08-31T04:38:37.050 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:37.047+0000 7fe2c2800640 1 -- 172.21.15.50:0/1161153870 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe2bc1a4110 con 0x7fe2bc076e30 2024-08-31T04:38:37.051 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:37.048+0000 7fe2c2800640 1 -- 172.21.15.50:0/1161153870 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe2bc10a090 con 0x7fe2bc076e30 2024-08-31T04:38:37.052 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:37.050+0000 7fe2ba000640 1 -- 172.21.15.50:0/1161153870 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 18) ==== 152577+0+0 (secure 0 0 0) 0x7fe2a8042070 con 0x7fe2bc076e30 2024-08-31T04:38:37.054 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:37.052+0000 7fe2ba000640 1 --2- 172.21.15.50:0/1161153870 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fe2a40b4bb0 0x7fe2a40b70c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:38:37.055 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:37.053+0000 7fe2ba000640 1 -- 172.21.15.50:0/1161153870 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8219+0+0 (secure 0 0 0) 0x7fe2a8106060 con 0x7fe2bc076e30 2024-08-31T04:38:37.055 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:37.053+0000 7fe2c1400640 1 --2- 172.21.15.50:0/1161153870 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fe2a40b4bb0 0x7fe2a40b70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:38:37.056 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:37.054+0000 7fe2c1400640 1 --2- 172.21.15.50:0/1161153870 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fe2a40b4bb0 0x7fe2a40b70c0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fe2b0005d00 tx=0x7fe2b000b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:38:37.056 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:37.054+0000 7fe2ba000640 1 -- 172.21.15.50:0/1161153870 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fe2a80ccaf0 con 0x7fe2bc076e30 2024-08-31T04:38:37.254 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:37.252+0000 7fe2c2800640 1 -- 172.21.15.50:0/1161153870 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fe2bc02e680 con 0x7fe2bc076e30 2024-08-31T04:38:37.254 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:37.252+0000 7fe2ba000640 1 -- 172.21.15.50:0/1161153870 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v80) ==== 100+0+11 (secure 0 0 0) 0x7fe2a80ef0a0 con 0x7fe2bc076e30 2024-08-31T04:38:37.255 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 64 2024-08-31T04:38:37.257 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:37.255+0000 7fe2c2800640 1 -- 172.21.15.50:0/1161153870 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fe2a40b4bb0 msgr2=0x7fe2a40b70c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:38:37.257 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:37.255+0000 7fe2c2800640 1 --2- 172.21.15.50:0/1161153870 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fe2a40b4bb0 0x7fe2a40b70c0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fe2b0005d00 tx=0x7fe2b000b410 comp rx=0 tx=0).stop 2024-08-31T04:38:37.257 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:37.255+0000 7fe2c2800640 1 -- 172.21.15.50:0/1161153870 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe2bc076e30 msgr2=0x7fe2bc19c360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:38:37.257 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:37.255+0000 7fe2c2800640 1 --2- 172.21.15.50:0/1161153870 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe2bc076e30 0x7fe2bc19c360 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7fe2a8031440 tx=0x7fe2a8003c10 comp rx=0 tx=0).stop 2024-08-31T04:38:37.257 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:37.255+0000 7fe2c2800640 1 -- 172.21.15.50:0/1161153870 shutdown_connections 2024-08-31T04:38:37.257 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:37.255+0000 7fe2c2800640 1 --2- 172.21.15.50:0/1161153870 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fe2a40b4bb0 0x7fe2a40b70c0 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:38:37.257 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:37.255+0000 7fe2c2800640 1 --2- 172.21.15.50:0/1161153870 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe2bc10b280 0x7fe2bc19cf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:38:37.258 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:37.255+0000 7fe2c2800640 1 --2- 172.21.15.50:0/1161153870 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe2bc076e30 0x7fe2bc19c360 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:38:37.258 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:37.255+0000 7fe2c2800640 1 --2- 172.21.15.50:0/1161153870 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe2bc075a30 0x7fe2bc19bcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:38:37.258 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:37.255+0000 7fe2c2800640 1 -- 172.21.15.50:0/1161153870 >> 172.21.15.50:0/1161153870 conn(0x7fe2bc0febd0 msgr2=0x7fe2bc107260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:38:37.258 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:37.255+0000 7fe2c2800640 1 -- 172.21.15.50:0/1161153870 shutdown_connections 2024-08-31T04:38:37.258 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:37.255+0000 7fe2c2800640 1 -- 172.21.15.50:0/1161153870 wait complete. 2024-08-31T04:38:37.281 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json-pretty 2024-08-31T04:38:37.504 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:37.502+0000 7ff379600640 1 -- 172.21.15.50:0/495789395 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff374076e30 msgr2=0x7ff3740754f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:38:37.504 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:37.502+0000 7ff379600640 1 --2- 172.21.15.50:0/495789395 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff374076e30 0x7ff3740754f0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7ff364009900 tx=0x7ff36402a410 comp rx=0 tx=0).stop 2024-08-31T04:38:37.505 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:37.502+0000 7ff379600640 1 -- 172.21.15.50:0/495789395 shutdown_connections 2024-08-31T04:38:37.505 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:37.502+0000 7ff379600640 1 --2- 172.21.15.50:0/495789395 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff374075a30 0x7ff374075e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:38:37.505 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:37.502+0000 7ff379600640 1 --2- 172.21.15.50:0/495789395 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff37410b240 0x7ff37410d6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:38:37.505 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:37.502+0000 7ff379600640 1 --2- 172.21.15.50:0/495789395 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff374076e30 0x7ff3740754f0 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:38:37.505 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:37.502+0000 7ff379600640 1 -- 172.21.15.50:0/495789395 >> 172.21.15.50:0/495789395 conn(0x7ff3740feb90 msgr2=0x7ff374101040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:38:37.505 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:37.502+0000 7ff379600640 1 -- 172.21.15.50:0/495789395 shutdown_connections 2024-08-31T04:38:37.505 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:37.502+0000 7ff379600640 1 -- 172.21.15.50:0/495789395 wait complete. 2024-08-31T04:38:37.507 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:37.503+0000 7ff379600640 1 Processor -- start 2024-08-31T04:38:37.507 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:37.503+0000 7ff379600640 1 -- start start 2024-08-31T04:38:37.507 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:37.503+0000 7ff379600640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff374075a30 0x7ff37419bcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:38:37.507 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:37.503+0000 7ff379600640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff374076e30 0x7ff37419c360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:38:37.507 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:37.503+0000 7ff379600640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff37410b240 0x7ff37419cf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:38:37.507 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:37.503+0000 7ff379600640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7ff374111100 con 0x7ff374075a30 2024-08-31T04:38:37.508 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:37.503+0000 7ff379600640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7ff374110f80 con 0x7ff374076e30 2024-08-31T04:38:37.508 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:37.503+0000 7ff379600640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7ff374111280 con 0x7ff37410b240 2024-08-31T04:38:37.508 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:37.504+0000 7ff373e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff374075a30 0x7ff37419bcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:38:37.508 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:37.504+0000 7ff373e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff374075a30 0x7ff37419bcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:43816/0 (socket says 172.21.15.50:43816) 2024-08-31T04:38:37.508 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:37.504+0000 7ff373e00640 1 -- 172.21.15.50:0/1705639489 learned_addr learned my addr 172.21.15.50:0/1705639489 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:38:37.508 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:37.504+0000 7ff36b400640 1 --2- 172.21.15.50:0/1705639489 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff374076e30 0x7ff37419c360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:38:37.508 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:37.504+0000 7ff378c00640 1 --2- 172.21.15.50:0/1705639489 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff37410b240 0x7ff37419cf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:38:37.508 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:37.504+0000 7ff373e00640 1 -- 172.21.15.50:0/1705639489 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff37410b240 msgr2=0x7ff37419cf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:38:37.508 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:37.504+0000 7ff373e00640 1 --2- 172.21.15.50:0/1705639489 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff37410b240 0x7ff37419cf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:38:37.508 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:37.504+0000 7ff373e00640 1 -- 172.21.15.50:0/1705639489 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff374076e30 msgr2=0x7ff37419c360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:38:37.508 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:37.504+0000 7ff373e00640 1 --2- 172.21.15.50:0/1705639489 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff374076e30 0x7ff37419c360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:38:37.508 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:37.504+0000 7ff373e00640 1 -- 172.21.15.50:0/1705639489 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff37419d730 con 0x7ff374075a30 2024-08-31T04:38:37.508 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:37.504+0000 7ff373e00640 1 --2- 172.21.15.50:0/1705639489 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff374075a30 0x7ff37419bcf0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7ff364031440 tx=0x7ff364003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:38:37.509 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:37.505+0000 7ff371600640 1 -- 172.21.15.50:0/1705639489 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff36403f070 con 0x7ff374075a30 2024-08-31T04:38:37.509 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:37.505+0000 7ff371600640 1 -- 172.21.15.50:0/1705639489 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff364031c50 con 0x7ff374075a30 2024-08-31T04:38:37.509 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:37.505+0000 7ff379600640 1 -- 172.21.15.50:0/1705639489 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff37419d9c0 con 0x7ff374075a30 2024-08-31T04:38:37.509 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:37.505+0000 7ff371600640 1 -- 172.21.15.50:0/1705639489 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff364035030 con 0x7ff374075a30 2024-08-31T04:38:37.509 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:37.505+0000 7ff379600640 1 -- 172.21.15.50:0/1705639489 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff3741a4110 con 0x7ff374075a30 2024-08-31T04:38:37.509 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:37.506+0000 7ff379600640 1 -- 172.21.15.50:0/1705639489 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff374075e40 con 0x7ff374075a30 2024-08-31T04:38:37.511 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:37.509+0000 7ff371600640 1 -- 172.21.15.50:0/1705639489 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 18) ==== 152577+0+0 (secure 0 0 0) 0x7ff364042070 con 0x7ff374075a30 2024-08-31T04:38:37.512 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:37.510+0000 7ff371600640 1 --2- 172.21.15.50:0/1705639489 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7ff3580b4bb0 0x7ff3580b70c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:38:37.512 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:37.510+0000 7ff371600640 1 -- 172.21.15.50:0/1705639489 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8219+0+0 (secure 0 0 0) 0x7ff364105fe0 con 0x7ff374075a30 2024-08-31T04:38:37.512 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:37.510+0000 7ff36b400640 1 --2- 172.21.15.50:0/1705639489 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7ff3580b4bb0 0x7ff3580b70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:38:37.513 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:37.511+0000 7ff36b400640 1 --2- 172.21.15.50:0/1705639489 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7ff3580b4bb0 0x7ff3580b70c0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7ff35c009bd0 tx=0x7ff35c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:38:37.514 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:37.512+0000 7ff371600640 1 -- 172.21.15.50:0/1705639489 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7ff3640cca70 con 0x7ff374075a30 2024-08-31T04:38:37.763 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:37.760+0000 7ff379600640 1 -- 172.21.15.50:0/1705639489 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json-pretty"} v 0) -- 0x7ff374109940 con 0x7ff374075a30 2024-08-31T04:38:37.773 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:37.771+0000 7ff371600640 1 -- 172.21.15.50:0/1705639489 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json-pretty"}]=0 v18) ==== 81+0+825793 (secure 0 0 0) 0x7ff374109940 con 0x7ff374075a30 2024-08-31T04:38:37.787 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-08-31T04:38:37.787 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-08-31T04:38:37.787 INFO:teuthology.orchestra.run.smithi050.stdout: "epoch": 18, 2024-08-31T04:38:37.787 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:37.787 INFO:teuthology.orchestra.run.smithi050.stdout: "active_gid": 14150, 2024-08-31T04:38:37.788 INFO:teuthology.orchestra.run.smithi050.stdout: "active_name": "x", 2024-08-31T04:38:37.788 INFO:teuthology.orchestra.run.smithi050.stdout: "active_addrs": { 2024-08-31T04:38:37.788 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2024-08-31T04:38:37.788 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-08-31T04:38:37.788 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2024-08-31T04:38:37.788 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6800", 2024-08-31T04:38:37.788 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 2146686622 2024-08-31T04:38:37.788 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:37.788 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-08-31T04:38:37.788 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2024-08-31T04:38:37.788 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6801", 2024-08-31T04:38:37.788 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 2146686622 2024-08-31T04:38:37.789 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T04:38:37.789 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-08-31T04:38:37.789 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:37.789 INFO:teuthology.orchestra.run.smithi050.stdout: "active_addr": "172.21.15.50:6801/2146686622", 2024-08-31T04:38:37.789 INFO:teuthology.orchestra.run.smithi050.stdout: "active_change": "2024-08-31T04:12:55.742153+0000", 2024-08-31T04:38:37.789 INFO:teuthology.orchestra.run.smithi050.stdout: "active_mgr_features": 4540701547738038271, 2024-08-31T04:38:37.789 INFO:teuthology.orchestra.run.smithi050.stdout: "available": true, 2024-08-31T04:38:37.789 INFO:teuthology.orchestra.run.smithi050.stdout: "standbys": [ 2024-08-31T04:38:37.789 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-08-31T04:38:37.789 INFO:teuthology.orchestra.run.smithi050.stdout: "gid": 24145, 2024-08-31T04:38:37.789 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "z", 2024-08-31T04:38:37.789 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr_features": 4540701547738038271, 2024-08-31T04:38:37.789 INFO:teuthology.orchestra.run.smithi050.stdout: "available_modules": [ 2024-08-31T04:38:37.790 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-08-31T04:38:37.790 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "alerts", 2024-08-31T04:38:37.790 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2024-08-31T04:38:37.790 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2024-08-31T04:38:37.790 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2024-08-31T04:38:37.790 INFO:teuthology.orchestra.run.smithi050.stdout: "interval": { 2024-08-31T04:38:37.790 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "interval", 2024-08-31T04:38:37.790 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "secs", 2024-08-31T04:38:37.790 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:37.790 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:37.790 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "60", 2024-08-31T04:38:37.790 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:37.790 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:37.791 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:37.791 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "How frequently to reexamine health status", 2024-08-31T04:38:37.791 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:37.791 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:37.791 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:37.791 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:37.791 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2024-08-31T04:38:37.791 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2024-08-31T04:38:37.791 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:37.791 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:37.791 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:37.791 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-08-31T04:38:37.791 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:37.792 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:37.792 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-08-31T04:38:37.792 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-08-31T04:38:37.792 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-08-31T04:38:37.792 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-08-31T04:38:37.792 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-08-31T04:38:37.792 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-08-31T04:38:37.792 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-08-31T04:38:37.792 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-08-31T04:38:37.792 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:37.792 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:37.792 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:37.793 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:37.793 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:37.793 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2024-08-31T04:38:37.793 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2024-08-31T04:38:37.793 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:37.793 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:37.793 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:37.793 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-08-31T04:38:37.793 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:37.793 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:37.793 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:37.793 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:37.793 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:37.794 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:37.794 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:37.794 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:37.794 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2024-08-31T04:38:37.794 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2024-08-31T04:38:37.794 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:37.794 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:37.794 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:37.794 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2024-08-31T04:38:37.794 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:37.794 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:37.794 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-08-31T04:38:37.794 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-08-31T04:38:37.795 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-08-31T04:38:37.795 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-08-31T04:38:37.795 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-08-31T04:38:37.795 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-08-31T04:38:37.795 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-08-31T04:38:37.795 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-08-31T04:38:37.795 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:37.795 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:37.795 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:37.795 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:37.795 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:37.795 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2024-08-31T04:38:37.795 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2024-08-31T04:38:37.796 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:37.796 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:37.796 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:37.796 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-08-31T04:38:37.796 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:37.796 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:37.796 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:37.796 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:37.796 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:37.796 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:37.796 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:37.796 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:37.796 INFO:teuthology.orchestra.run.smithi050.stdout: "smtp_destination": { 2024-08-31T04:38:37.797 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "smtp_destination", 2024-08-31T04:38:37.797 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:37.797 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:37.797 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:37.797 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-08-31T04:38:37.797 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:37.797 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:37.797 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:37.797 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Email address to send alerts to", 2024-08-31T04:38:37.797 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:37.797 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:37.797 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:37.797 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:37.798 INFO:teuthology.orchestra.run.smithi050.stdout: "smtp_from_name": { 2024-08-31T04:38:37.798 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "smtp_from_name", 2024-08-31T04:38:37.798 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:37.798 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:37.798 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:37.798 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "Ceph", 2024-08-31T04:38:37.798 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:37.798 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:37.798 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:37.798 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Email From: name", 2024-08-31T04:38:37.798 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:37.798 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:37.798 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:37.799 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:37.799 INFO:teuthology.orchestra.run.smithi050.stdout: "smtp_host": { 2024-08-31T04:38:37.799 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "smtp_host", 2024-08-31T04:38:37.799 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:37.799 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:37.799 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:37.799 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-08-31T04:38:37.799 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:37.799 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:37.799 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:37.799 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "SMTP server", 2024-08-31T04:38:37.799 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:37.799 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:37.800 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:37.800 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:37.800 INFO:teuthology.orchestra.run.smithi050.stdout: "smtp_password": { 2024-08-31T04:38:37.800 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "smtp_password", 2024-08-31T04:38:37.800 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:37.800 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:37.800 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:37.800 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-08-31T04:38:37.800 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:37.800 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:37.800 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:37.800 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Password to authenticate with", 2024-08-31T04:38:37.800 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:37.801 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:37.801 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:37.801 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:37.801 INFO:teuthology.orchestra.run.smithi050.stdout: "smtp_port": { 2024-08-31T04:38:37.801 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "smtp_port", 2024-08-31T04:38:37.801 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-08-31T04:38:37.801 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:37.801 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:37.801 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "465", 2024-08-31T04:38:37.801 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:37.801 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:37.801 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:37.801 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "SMTP port", 2024-08-31T04:38:37.801 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:37.802 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:37.802 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:37.802 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:37.802 INFO:teuthology.orchestra.run.smithi050.stdout: "smtp_sender": { 2024-08-31T04:38:37.802 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "smtp_sender", 2024-08-31T04:38:37.802 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:37.802 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:37.802 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:37.802 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-08-31T04:38:37.802 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:37.802 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:37.802 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:37.802 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "SMTP envelope sender", 2024-08-31T04:38:37.803 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:37.803 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:37.803 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:37.803 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:37.803 INFO:teuthology.orchestra.run.smithi050.stdout: "smtp_ssl": { 2024-08-31T04:38:37.803 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "smtp_ssl", 2024-08-31T04:38:37.803 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:37.803 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:37.803 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:37.803 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2024-08-31T04:38:37.803 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:37.804 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:37.804 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:37.804 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Use SSL to connect to SMTP server", 2024-08-31T04:38:37.804 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:37.804 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:37.804 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:37.804 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:37.804 INFO:teuthology.orchestra.run.smithi050.stdout: "smtp_user": { 2024-08-31T04:38:37.804 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "smtp_user", 2024-08-31T04:38:37.804 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:37.804 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:37.804 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:37.804 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-08-31T04:38:37.804 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:37.805 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:37.805 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:37.805 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "User to authenticate as", 2024-08-31T04:38:37.805 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:37.805 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:37.805 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:37.805 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:37.805 INFO:teuthology.orchestra.run.smithi050.stdout: "sqlite3_killpoint": { 2024-08-31T04:38:37.805 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "sqlite3_killpoint", 2024-08-31T04:38:37.805 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-08-31T04:38:37.805 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "dev", 2024-08-31T04:38:37.805 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:37.805 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "0", 2024-08-31T04:38:37.806 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:37.806 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:37.806 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:37.806 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:37.806 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:37.806 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:37.806 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:37.806 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T04:38:37.806 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T04:38:37.806 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:37.806 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-08-31T04:38:37.806 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "balancer", 2024-08-31T04:38:37.807 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2024-08-31T04:38:37.807 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2024-08-31T04:38:37.807 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2024-08-31T04:38:37.807 INFO:teuthology.orchestra.run.smithi050.stdout: "active": { 2024-08-31T04:38:37.807 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "active", 2024-08-31T04:38:37.807 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:37.807 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:37.807 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:37.807 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2024-08-31T04:38:37.807 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:37.807 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:37.807 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:37.808 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "automatically balance PGs across cluster", 2024-08-31T04:38:37.808 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:37.808 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:37.808 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:37.808 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:37.808 INFO:teuthology.orchestra.run.smithi050.stdout: "begin_time": { 2024-08-31T04:38:37.808 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "begin_time", 2024-08-31T04:38:37.808 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:37.808 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:37.808 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:37.808 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "0000", 2024-08-31T04:38:37.808 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:37.809 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:37.809 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:37.809 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "beginning time of day to automatically balance", 2024-08-31T04:38:37.809 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-08-31T04:38:37.809 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:37.809 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:37.809 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:37.809 INFO:teuthology.orchestra.run.smithi050.stdout: "begin_weekday": { 2024-08-31T04:38:37.809 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "begin_weekday", 2024-08-31T04:38:37.809 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "uint", 2024-08-31T04:38:37.809 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:37.809 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:37.809 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "0", 2024-08-31T04:38:37.809 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "0", 2024-08-31T04:38:37.810 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "6", 2024-08-31T04:38:37.810 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:37.810 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-08-31T04:38:37.810 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-08-31T04:38:37.810 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:37.810 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:37.810 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:37.810 INFO:teuthology.orchestra.run.smithi050.stdout: "crush_compat_max_iterations": { 2024-08-31T04:38:37.810 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "crush_compat_max_iterations", 2024-08-31T04:38:37.810 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "uint", 2024-08-31T04:38:37.810 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:37.810 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:37.810 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "25", 2024-08-31T04:38:37.811 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "1", 2024-08-31T04:38:37.811 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "250", 2024-08-31T04:38:37.811 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:37.811 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-08-31T04:38:37.811 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:37.811 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:37.811 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:37.811 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:37.811 INFO:teuthology.orchestra.run.smithi050.stdout: "crush_compat_metrics": { 2024-08-31T04:38:37.811 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "crush_compat_metrics", 2024-08-31T04:38:37.811 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:37.811 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:37.811 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:37.812 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "pgs,objects,bytes", 2024-08-31T04:38:37.812 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:37.812 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:37.812 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:37.812 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-08-31T04:38:37.812 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-08-31T04:38:37.812 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:37.812 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:37.812 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:37.812 INFO:teuthology.orchestra.run.smithi050.stdout: "crush_compat_step": { 2024-08-31T04:38:37.812 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "crush_compat_step", 2024-08-31T04:38:37.812 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "float", 2024-08-31T04:38:37.812 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:37.813 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:37.813 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "0.5", 2024-08-31T04:38:37.813 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "0.001", 2024-08-31T04:38:37.813 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "0.999", 2024-08-31T04:38:37.813 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:37.813 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "aggressiveness of optimization", 2024-08-31T04:38:37.813 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-08-31T04:38:37.813 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:37.813 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:37.813 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:37.813 INFO:teuthology.orchestra.run.smithi050.stdout: "end_time": { 2024-08-31T04:38:37.813 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "end_time", 2024-08-31T04:38:37.813 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:37.814 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:37.814 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:37.814 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "2359", 2024-08-31T04:38:37.814 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:37.814 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:37.814 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:37.814 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "ending time of day to automatically balance", 2024-08-31T04:38:37.814 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-08-31T04:38:37.814 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:37.814 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:37.814 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:37.814 INFO:teuthology.orchestra.run.smithi050.stdout: "end_weekday": { 2024-08-31T04:38:37.814 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "end_weekday", 2024-08-31T04:38:37.814 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "uint", 2024-08-31T04:38:37.815 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:37.815 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:37.815 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "0", 2024-08-31T04:38:37.815 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "0", 2024-08-31T04:38:37.815 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "6", 2024-08-31T04:38:37.815 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:37.815 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-08-31T04:38:37.815 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-08-31T04:38:37.815 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:37.815 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:37.815 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:37.815 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2024-08-31T04:38:37.815 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2024-08-31T04:38:37.816 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:37.816 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:37.816 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:37.816 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-08-31T04:38:37.816 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:37.816 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:37.816 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-08-31T04:38:37.816 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-08-31T04:38:37.816 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-08-31T04:38:37.816 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-08-31T04:38:37.816 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-08-31T04:38:37.816 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-08-31T04:38:37.817 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-08-31T04:38:37.817 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-08-31T04:38:37.817 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:37.817 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:37.817 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:37.817 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:37.817 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:37.817 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2024-08-31T04:38:37.817 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2024-08-31T04:38:37.817 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:37.817 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:37.817 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:37.817 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-08-31T04:38:37.818 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:37.818 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:37.818 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:37.818 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:37.818 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:37.818 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:37.818 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:37.818 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:37.818 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2024-08-31T04:38:37.818 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2024-08-31T04:38:37.818 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:37.818 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:37.818 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:37.818 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2024-08-31T04:38:37.819 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:37.819 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:37.819 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-08-31T04:38:37.819 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-08-31T04:38:37.819 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-08-31T04:38:37.819 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-08-31T04:38:37.819 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-08-31T04:38:37.819 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-08-31T04:38:37.819 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-08-31T04:38:37.819 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-08-31T04:38:37.819 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:37.819 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:37.819 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:37.820 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:37.820 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:37.820 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2024-08-31T04:38:37.820 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2024-08-31T04:38:37.820 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:37.820 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:37.820 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:37.820 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-08-31T04:38:37.820 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:37.820 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:37.820 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:37.820 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:37.820 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:37.820 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:37.821 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:37.821 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:37.821 INFO:teuthology.orchestra.run.smithi050.stdout: "min_score": { 2024-08-31T04:38:37.821 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "min_score", 2024-08-31T04:38:37.821 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "float", 2024-08-31T04:38:37.821 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:37.821 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:37.821 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "0", 2024-08-31T04:38:37.821 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:37.821 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:37.821 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:37.821 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-08-31T04:38:37.821 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:37.822 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:37.822 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:37.822 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:37.822 INFO:teuthology.orchestra.run.smithi050.stdout: "mode": { 2024-08-31T04:38:37.822 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "mode", 2024-08-31T04:38:37.822 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:37.822 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:37.822 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:37.822 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "upmap", 2024-08-31T04:38:37.822 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:37.822 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:37.822 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-08-31T04:38:37.822 INFO:teuthology.orchestra.run.smithi050.stdout: "crush-compat", 2024-08-31T04:38:37.823 INFO:teuthology.orchestra.run.smithi050.stdout: "none", 2024-08-31T04:38:37.823 INFO:teuthology.orchestra.run.smithi050.stdout: "read", 2024-08-31T04:38:37.823 INFO:teuthology.orchestra.run.smithi050.stdout: "upmap", 2024-08-31T04:38:37.823 INFO:teuthology.orchestra.run.smithi050.stdout: "upmap-read" 2024-08-31T04:38:37.823 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-08-31T04:38:37.823 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Balancer mode", 2024-08-31T04:38:37.823 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:37.823 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:37.823 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:37.823 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:37.823 INFO:teuthology.orchestra.run.smithi050.stdout: "pool_ids": { 2024-08-31T04:38:37.823 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "pool_ids", 2024-08-31T04:38:37.823 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:37.823 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:37.824 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:37.824 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-08-31T04:38:37.824 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:37.824 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:37.824 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:37.824 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-08-31T04:38:37.824 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:37.824 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:37.824 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:37.824 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:37.824 INFO:teuthology.orchestra.run.smithi050.stdout: "sleep_interval": { 2024-08-31T04:38:37.824 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "sleep_interval", 2024-08-31T04:38:37.824 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "secs", 2024-08-31T04:38:37.825 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:37.825 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:37.825 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "60", 2024-08-31T04:38:37.825 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:37.825 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:37.825 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:37.825 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-08-31T04:38:37.825 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:37.825 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:37.825 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:37.825 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:37.825 INFO:teuthology.orchestra.run.smithi050.stdout: "sqlite3_killpoint": { 2024-08-31T04:38:37.825 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "sqlite3_killpoint", 2024-08-31T04:38:37.826 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-08-31T04:38:37.826 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "dev", 2024-08-31T04:38:37.826 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:37.826 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "0", 2024-08-31T04:38:37.826 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:37.826 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:37.826 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:37.826 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:37.826 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:37.826 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:37.826 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:37.826 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:37.826 INFO:teuthology.orchestra.run.smithi050.stdout: "upmap_max_deviation": { 2024-08-31T04:38:37.826 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "upmap_max_deviation", 2024-08-31T04:38:37.827 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-08-31T04:38:37.827 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:37.827 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:37.827 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "5", 2024-08-31T04:38:37.827 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "1", 2024-08-31T04:38:37.827 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:37.827 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:37.827 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "deviation below which no optimization is attempted", 2024-08-31T04:38:37.827 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-08-31T04:38:37.827 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:37.827 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:37.827 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:37.827 INFO:teuthology.orchestra.run.smithi050.stdout: "upmap_max_optimizations": { 2024-08-31T04:38:37.828 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "upmap_max_optimizations", 2024-08-31T04:38:37.828 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "uint", 2024-08-31T04:38:37.828 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:37.828 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:37.828 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "10", 2024-08-31T04:38:37.828 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:37.828 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:37.828 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:37.828 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-08-31T04:38:37.828 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:37.828 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:37.828 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:37.828 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T04:38:37.829 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T04:38:37.829 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:37.829 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-08-31T04:38:37.829 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "cephadm", 2024-08-31T04:38:37.829 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2024-08-31T04:38:37.829 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2024-08-31T04:38:37.829 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2024-08-31T04:38:37.829 INFO:teuthology.orchestra.run.smithi050.stdout: "agent_down_multiplier": { 2024-08-31T04:38:37.829 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "agent_down_multiplier", 2024-08-31T04:38:37.829 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "float", 2024-08-31T04:38:37.829 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:37.829 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:37.829 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "3.0", 2024-08-31T04:38:37.829 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:37.830 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:37.830 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:37.830 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-08-31T04:38:37.830 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:37.830 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:37.830 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:37.830 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:37.830 INFO:teuthology.orchestra.run.smithi050.stdout: "agent_refresh_rate": { 2024-08-31T04:38:37.830 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "agent_refresh_rate", 2024-08-31T04:38:37.830 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "secs", 2024-08-31T04:38:37.830 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:37.831 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:37.831 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "20", 2024-08-31T04:38:37.831 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:37.831 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:37.831 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:37.831 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-08-31T04:38:37.831 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:37.831 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:37.831 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:37.831 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:37.831 INFO:teuthology.orchestra.run.smithi050.stdout: "agent_starting_port": { 2024-08-31T04:38:37.831 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "agent_starting_port", 2024-08-31T04:38:37.831 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-08-31T04:38:37.832 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:37.832 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:37.832 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "4721", 2024-08-31T04:38:37.832 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:37.832 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:37.832 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:37.832 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-08-31T04:38:37.832 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:37.832 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:37.832 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:37.832 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:37.832 INFO:teuthology.orchestra.run.smithi050.stdout: "allow_ptrace": { 2024-08-31T04:38:37.832 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "allow_ptrace", 2024-08-31T04:38:37.833 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:37.833 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:37.833 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:37.833 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-08-31T04:38:37.833 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:37.833 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:37.833 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:37.833 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-08-31T04:38:37.833 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-08-31T04:38:37.833 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:37.833 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:37.833 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:37.833 INFO:teuthology.orchestra.run.smithi050.stdout: "autotune_interval": { 2024-08-31T04:38:37.834 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "autotune_interval", 2024-08-31T04:38:37.834 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "secs", 2024-08-31T04:38:37.834 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:37.834 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:37.834 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "600", 2024-08-31T04:38:37.834 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:37.834 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:37.834 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:37.834 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "how frequently to autotune daemon memory", 2024-08-31T04:38:37.834 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:37.834 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:37.834 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:37.834 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:37.835 INFO:teuthology.orchestra.run.smithi050.stdout: "autotune_memory_target_ratio": { 2024-08-31T04:38:37.835 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "autotune_memory_target_ratio", 2024-08-31T04:38:37.835 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "float", 2024-08-31T04:38:37.835 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:37.835 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:37.835 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "0.7", 2024-08-31T04:38:37.835 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:37.835 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:37.835 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:37.835 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-08-31T04:38:37.835 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:37.835 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:37.835 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:37.836 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:37.836 INFO:teuthology.orchestra.run.smithi050.stdout: "cephadm_log_destination": { 2024-08-31T04:38:37.836 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "cephadm_log_destination", 2024-08-31T04:38:37.836 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:37.836 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:37.836 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:37.836 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-08-31T04:38:37.836 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:37.836 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:37.836 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-08-31T04:38:37.836 INFO:teuthology.orchestra.run.smithi050.stdout: "file", 2024-08-31T04:38:37.836 INFO:teuthology.orchestra.run.smithi050.stdout: "file,syslog", 2024-08-31T04:38:37.836 INFO:teuthology.orchestra.run.smithi050.stdout: "syslog" 2024-08-31T04:38:37.837 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-08-31T04:38:37.837 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-08-31T04:38:37.837 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:37.837 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:37.837 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:37.837 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:37.837 INFO:teuthology.orchestra.run.smithi050.stdout: "cgroups_split": { 2024-08-31T04:38:37.837 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "cgroups_split", 2024-08-31T04:38:37.837 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:37.837 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:37.837 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:37.837 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2024-08-31T04:38:37.838 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:37.838 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:37.838 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:37.838 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-08-31T04:38:37.838 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:37.838 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:37.838 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:37.838 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:37.838 INFO:teuthology.orchestra.run.smithi050.stdout: "config_checks_enabled": { 2024-08-31T04:38:37.838 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "config_checks_enabled", 2024-08-31T04:38:37.838 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:37.838 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:37.838 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:37.839 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-08-31T04:38:37.839 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:37.839 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:37.839 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:37.839 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-08-31T04:38:37.839 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:37.839 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:37.839 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:37.839 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:37.839 INFO:teuthology.orchestra.run.smithi050.stdout: "config_dashboard": { 2024-08-31T04:38:37.839 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "config_dashboard", 2024-08-31T04:38:37.839 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:37.839 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:37.840 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:37.840 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2024-08-31T04:38:37.840 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:37.840 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:37.840 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:37.840 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-08-31T04:38:37.840 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:37.840 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:37.840 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:37.840 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:37.840 INFO:teuthology.orchestra.run.smithi050.stdout: "container_image_alertmanager": { 2024-08-31T04:38:37.840 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "container_image_alertmanager", 2024-08-31T04:38:37.840 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:37.840 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:37.841 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:37.841 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.27.0", 2024-08-31T04:38:37.841 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:37.841 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:37.841 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:37.841 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Prometheus container image", 2024-08-31T04:38:37.841 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:37.841 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:37.841 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:37.841 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:37.841 INFO:teuthology.orchestra.run.smithi050.stdout: "container_image_base": { 2024-08-31T04:38:37.841 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "container_image_base", 2024-08-31T04:38:37.841 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:37.842 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:37.842 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:37.842 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "quay.io/ceph/ceph", 2024-08-31T04:38:37.842 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:37.842 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:37.842 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:37.842 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Container image name, without the tag", 2024-08-31T04:38:37.842 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:37.842 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:37.842 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:37.842 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:37.842 INFO:teuthology.orchestra.run.smithi050.stdout: "container_image_elasticsearch": { 2024-08-31T04:38:37.842 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "container_image_elasticsearch", 2024-08-31T04:38:37.842 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:37.843 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:37.843 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:37.843 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-08-31T04:38:37.843 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:37.843 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:37.843 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:37.843 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "elasticsearch container image", 2024-08-31T04:38:37.843 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:37.843 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:37.843 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:37.843 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:37.843 INFO:teuthology.orchestra.run.smithi050.stdout: "container_image_grafana": { 2024-08-31T04:38:37.844 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "container_image_grafana", 2024-08-31T04:38:37.844 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:37.844 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:37.844 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:37.844 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "quay.io/ceph/grafana:10.4.0", 2024-08-31T04:38:37.844 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:37.844 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:37.844 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:37.844 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Prometheus container image", 2024-08-31T04:38:37.844 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:37.844 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:37.844 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:37.844 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:37.845 INFO:teuthology.orchestra.run.smithi050.stdout: "container_image_haproxy": { 2024-08-31T04:38:37.845 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "container_image_haproxy", 2024-08-31T04:38:37.845 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:37.845 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:37.845 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:37.845 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-08-31T04:38:37.845 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:37.845 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:37.845 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:37.845 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "HAproxy container image", 2024-08-31T04:38:37.845 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:37.845 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:37.846 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:37.846 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:37.846 INFO:teuthology.orchestra.run.smithi050.stdout: "container_image_jaeger_agent": { 2024-08-31T04:38:37.846 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "container_image_jaeger_agent", 2024-08-31T04:38:37.846 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:37.846 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:37.846 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:37.846 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-08-31T04:38:37.846 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:37.846 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:37.846 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:37.846 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Jaeger agent container image", 2024-08-31T04:38:37.846 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:37.846 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:37.847 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:37.847 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:37.847 INFO:teuthology.orchestra.run.smithi050.stdout: "container_image_jaeger_collector": { 2024-08-31T04:38:37.847 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "container_image_jaeger_collector", 2024-08-31T04:38:37.847 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:37.847 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:37.847 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:37.847 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-08-31T04:38:37.847 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:37.847 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:37.847 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:37.847 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Jaeger collector container image", 2024-08-31T04:38:37.847 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:37.848 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:37.848 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:37.848 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:37.848 INFO:teuthology.orchestra.run.smithi050.stdout: "container_image_jaeger_query": { 2024-08-31T04:38:37.848 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "container_image_jaeger_query", 2024-08-31T04:38:37.848 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:37.848 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:37.848 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:37.848 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-08-31T04:38:37.848 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:37.848 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:37.848 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:37.848 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Jaeger query container image", 2024-08-31T04:38:37.849 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:37.849 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:37.849 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:37.849 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:37.849 INFO:teuthology.orchestra.run.smithi050.stdout: "container_image_keepalived": { 2024-08-31T04:38:37.849 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "container_image_keepalived", 2024-08-31T04:38:37.849 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:37.849 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:37.849 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:37.849 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-08-31T04:38:37.849 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:37.849 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:37.849 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:37.850 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Keepalived container image", 2024-08-31T04:38:37.850 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:37.850 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:37.850 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:37.850 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:37.850 INFO:teuthology.orchestra.run.smithi050.stdout: "container_image_loki": { 2024-08-31T04:38:37.850 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "container_image_loki", 2024-08-31T04:38:37.850 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:37.850 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:37.850 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:37.850 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-08-31T04:38:37.850 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:37.851 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:37.851 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:37.851 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Loki container image", 2024-08-31T04:38:37.851 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:37.851 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:37.851 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:37.851 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:37.851 INFO:teuthology.orchestra.run.smithi050.stdout: "container_image_nginx": { 2024-08-31T04:38:37.851 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "container_image_nginx", 2024-08-31T04:38:37.851 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:37.851 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:37.851 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:37.851 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "quay.io/ceph/nginx:1.26.1", 2024-08-31T04:38:37.851 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:37.852 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:37.852 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:37.852 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Nginx container image", 2024-08-31T04:38:37.852 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:37.852 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:37.852 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:37.852 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:37.852 INFO:teuthology.orchestra.run.smithi050.stdout: "container_image_node_exporter": { 2024-08-31T04:38:37.852 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "container_image_node_exporter", 2024-08-31T04:38:37.852 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:37.852 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:37.852 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:37.852 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.7.0", 2024-08-31T04:38:37.853 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:37.853 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:37.853 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:37.853 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Prometheus container image", 2024-08-31T04:38:37.853 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:37.853 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:37.853 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:37.853 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:37.853 INFO:teuthology.orchestra.run.smithi050.stdout: "container_image_nvmeof": { 2024-08-31T04:38:37.853 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "container_image_nvmeof", 2024-08-31T04:38:37.853 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:37.853 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:37.853 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:37.854 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.17", 2024-08-31T04:38:37.854 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:37.854 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:37.854 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:37.854 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Nvme-of container image", 2024-08-31T04:38:37.854 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:37.854 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:37.854 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:37.854 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:37.854 INFO:teuthology.orchestra.run.smithi050.stdout: "container_image_oauth2_proxy": { 2024-08-31T04:38:37.854 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "container_image_oauth2_proxy", 2024-08-31T04:38:37.854 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:37.854 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:37.855 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:37.855 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "quay.io/oauth2-proxy/oauth2-proxy:v7.6.0", 2024-08-31T04:38:37.855 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:37.855 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:37.855 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:37.855 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "oauth2-proxy container image", 2024-08-31T04:38:37.855 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:37.855 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:37.855 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:37.855 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:37.855 INFO:teuthology.orchestra.run.smithi050.stdout: "container_image_prometheus": { 2024-08-31T04:38:37.855 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "container_image_prometheus", 2024-08-31T04:38:37.855 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:37.855 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:37.856 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:37.856 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "quay.io/prometheus/prometheus:v2.51.0", 2024-08-31T04:38:37.856 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:37.856 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:37.856 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:37.856 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Prometheus container image", 2024-08-31T04:38:37.856 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:37.856 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:37.856 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:37.856 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:37.856 INFO:teuthology.orchestra.run.smithi050.stdout: "container_image_promtail": { 2024-08-31T04:38:37.857 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "container_image_promtail", 2024-08-31T04:38:37.857 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:37.857 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:37.857 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:37.857 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-08-31T04:38:37.857 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:37.857 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:37.857 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:37.857 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Promtail container image", 2024-08-31T04:38:37.857 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:37.857 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:37.857 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:37.857 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:37.858 INFO:teuthology.orchestra.run.smithi050.stdout: "container_image_samba": { 2024-08-31T04:38:37.858 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "container_image_samba", 2024-08-31T04:38:37.858 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:37.858 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:37.858 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:37.858 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-08-31T04:38:37.858 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:37.858 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:37.858 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:37.858 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Samba/SMB container image", 2024-08-31T04:38:37.858 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:37.858 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:37.858 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:37.858 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:37.859 INFO:teuthology.orchestra.run.smithi050.stdout: "container_image_snmp_gateway": { 2024-08-31T04:38:37.859 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "container_image_snmp_gateway", 2024-08-31T04:38:37.859 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:37.859 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:37.859 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:37.859 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-08-31T04:38:37.859 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:37.859 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:37.859 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:37.859 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "SNMP Gateway container image", 2024-08-31T04:38:37.859 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:37.859 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:37.860 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:37.860 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:37.860 INFO:teuthology.orchestra.run.smithi050.stdout: "container_init": { 2024-08-31T04:38:37.860 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "container_init", 2024-08-31T04:38:37.860 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:37.860 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:37.860 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:37.860 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2024-08-31T04:38:37.860 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:37.860 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:37.860 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:37.860 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Run podman/docker with `--init`", 2024-08-31T04:38:37.860 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:37.861 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:37.861 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:37.861 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:37.861 INFO:teuthology.orchestra.run.smithi050.stdout: "daemon_cache_timeout": { 2024-08-31T04:38:37.861 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "daemon_cache_timeout", 2024-08-31T04:38:37.861 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "secs", 2024-08-31T04:38:37.861 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:37.861 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:37.861 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "600", 2024-08-31T04:38:37.861 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:37.861 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:37.861 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:37.861 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-08-31T04:38:37.862 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:37.862 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:37.862 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:37.862 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:37.862 INFO:teuthology.orchestra.run.smithi050.stdout: "default_cephadm_command_timeout": { 2024-08-31T04:38:37.862 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "default_cephadm_command_timeout", 2024-08-31T04:38:37.862 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-08-31T04:38:37.862 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:37.862 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:37.862 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "900", 2024-08-31T04:38:37.862 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:37.862 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:37.862 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:37.863 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-08-31T04:38:37.863 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:37.863 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:37.863 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:37.863 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:37.863 INFO:teuthology.orchestra.run.smithi050.stdout: "default_registry": { 2024-08-31T04:38:37.863 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "default_registry", 2024-08-31T04:38:37.863 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:37.863 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:37.863 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:37.863 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "docker.io", 2024-08-31T04:38:37.863 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:37.863 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:37.864 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:37.864 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-08-31T04:38:37.864 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:37.864 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:37.864 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:37.864 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:37.864 INFO:teuthology.orchestra.run.smithi050.stdout: "device_cache_timeout": { 2024-08-31T04:38:37.864 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "device_cache_timeout", 2024-08-31T04:38:37.864 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "secs", 2024-08-31T04:38:37.864 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:37.864 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:37.864 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "1800", 2024-08-31T04:38:37.864 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:37.865 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:37.865 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:37.865 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "seconds to cache device inventory", 2024-08-31T04:38:37.865 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:37.865 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:37.865 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:37.865 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:37.865 INFO:teuthology.orchestra.run.smithi050.stdout: "device_enhanced_scan": { 2024-08-31T04:38:37.865 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "device_enhanced_scan", 2024-08-31T04:38:37.865 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:37.865 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:37.865 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:37.865 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-08-31T04:38:37.866 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:37.866 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:37.866 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:37.866 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Use libstoragemgmt during device scans", 2024-08-31T04:38:37.866 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:37.866 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:37.866 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:37.866 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:37.866 INFO:teuthology.orchestra.run.smithi050.stdout: "facts_cache_timeout": { 2024-08-31T04:38:37.866 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "facts_cache_timeout", 2024-08-31T04:38:37.866 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "secs", 2024-08-31T04:38:37.866 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:37.866 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:37.867 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "60", 2024-08-31T04:38:37.867 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:37.867 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:37.867 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:37.867 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "seconds to cache host facts data", 2024-08-31T04:38:37.867 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:37.867 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:37.867 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:37.867 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:37.867 INFO:teuthology.orchestra.run.smithi050.stdout: "grafana_dashboards_path": { 2024-08-31T04:38:37.867 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "grafana_dashboards_path", 2024-08-31T04:38:37.867 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:37.867 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:37.868 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:37.868 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-08-31T04:38:37.868 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:37.868 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:37.868 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:37.868 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-08-31T04:38:37.868 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:37.868 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:37.868 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:37.868 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:37.868 INFO:teuthology.orchestra.run.smithi050.stdout: "host_check_interval": { 2024-08-31T04:38:37.868 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "host_check_interval", 2024-08-31T04:38:37.868 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "secs", 2024-08-31T04:38:37.869 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:37.869 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:37.869 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "600", 2024-08-31T04:38:37.869 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:37.869 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:37.869 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:37.869 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "how frequently to perform a host check", 2024-08-31T04:38:37.869 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:37.869 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:37.869 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:37.869 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:37.870 INFO:teuthology.orchestra.run.smithi050.stdout: "hw_monitoring": { 2024-08-31T04:38:37.870 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "hw_monitoring", 2024-08-31T04:38:37.870 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:37.870 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:37.870 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:37.870 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-08-31T04:38:37.870 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:37.870 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:37.870 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:37.870 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-08-31T04:38:37.870 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:37.870 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:37.870 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:37.870 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:37.871 INFO:teuthology.orchestra.run.smithi050.stdout: "inventory_list_all": { 2024-08-31T04:38:37.871 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "inventory_list_all", 2024-08-31T04:38:37.871 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:37.871 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:37.871 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:37.871 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-08-31T04:38:37.871 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:37.871 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:37.871 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:37.871 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-08-31T04:38:37.871 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:37.871 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:37.871 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:37.872 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:37.872 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2024-08-31T04:38:37.872 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2024-08-31T04:38:37.872 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:37.872 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:37.872 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:37.872 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-08-31T04:38:37.872 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:37.872 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:37.872 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-08-31T04:38:37.872 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-08-31T04:38:37.872 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-08-31T04:38:37.873 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-08-31T04:38:37.873 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-08-31T04:38:37.873 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-08-31T04:38:37.873 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-08-31T04:38:37.873 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-08-31T04:38:37.873 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:37.873 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:37.873 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:37.873 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:37.873 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:37.873 INFO:teuthology.orchestra.run.smithi050.stdout: "log_refresh_metadata": { 2024-08-31T04:38:37.873 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_refresh_metadata", 2024-08-31T04:38:37.873 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:37.874 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:37.874 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:37.874 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-08-31T04:38:37.874 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:37.874 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:37.874 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:37.874 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-08-31T04:38:37.874 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:37.874 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:37.874 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:37.874 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:37.874 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2024-08-31T04:38:37.874 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2024-08-31T04:38:37.875 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:37.875 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:37.875 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:37.875 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2024-08-31T04:38:37.875 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:37.875 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:37.875 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:37.875 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-08-31T04:38:37.875 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:37.875 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:37.875 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:37.875 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:37.876 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2024-08-31T04:38:37.876 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2024-08-31T04:38:37.876 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:37.876 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:37.876 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:37.876 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2024-08-31T04:38:37.876 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:37.876 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:37.876 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-08-31T04:38:37.876 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-08-31T04:38:37.876 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-08-31T04:38:37.876 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-08-31T04:38:37.876 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-08-31T04:38:37.877 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-08-31T04:38:37.877 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-08-31T04:38:37.877 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-08-31T04:38:37.877 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:37.877 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:37.877 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:37.877 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:37.877 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:37.877 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2024-08-31T04:38:37.877 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2024-08-31T04:38:37.877 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:37.877 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:37.878 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:37.878 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-08-31T04:38:37.878 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:37.878 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:37.878 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:37.878 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:37.878 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:37.878 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:37.878 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:37.878 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:37.878 INFO:teuthology.orchestra.run.smithi050.stdout: "manage_etc_ceph_ceph_conf": { 2024-08-31T04:38:37.878 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-08-31T04:38:37.878 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:37.878 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:37.879 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:37.879 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-08-31T04:38:37.879 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:37.879 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:37.879 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:37.879 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-08-31T04:38:37.879 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:37.879 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:37.879 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:37.879 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:37.879 INFO:teuthology.orchestra.run.smithi050.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-08-31T04:38:37.879 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-08-31T04:38:37.879 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:37.880 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:37.880 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:37.880 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "*", 2024-08-31T04:38:37.880 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:37.880 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:37.880 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:37.880 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-08-31T04:38:37.880 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:37.880 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:37.880 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:37.880 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:37.880 INFO:teuthology.orchestra.run.smithi050.stdout: "max_count_per_host": { 2024-08-31T04:38:37.880 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "max_count_per_host", 2024-08-31T04:38:37.881 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-08-31T04:38:37.881 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:37.881 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:37.881 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "10", 2024-08-31T04:38:37.881 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:37.881 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:37.881 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:37.881 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "max number of daemons per service per host", 2024-08-31T04:38:37.881 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:37.881 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:37.881 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:37.881 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:37.881 INFO:teuthology.orchestra.run.smithi050.stdout: "max_osd_draining_count": { 2024-08-31T04:38:37.882 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "max_osd_draining_count", 2024-08-31T04:38:37.882 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-08-31T04:38:37.882 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:37.882 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:37.882 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "10", 2024-08-31T04:38:37.882 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:37.882 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:37.882 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:37.882 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-08-31T04:38:37.882 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:37.882 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:37.882 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:37.882 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:37.883 INFO:teuthology.orchestra.run.smithi050.stdout: "migration_current": { 2024-08-31T04:38:37.883 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "migration_current", 2024-08-31T04:38:37.883 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-08-31T04:38:37.883 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:37.883 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:37.883 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-08-31T04:38:37.883 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:37.883 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:37.883 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:37.883 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "internal - do not modify", 2024-08-31T04:38:37.883 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:37.883 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:37.884 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:37.884 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:37.884 INFO:teuthology.orchestra.run.smithi050.stdout: "mode": { 2024-08-31T04:38:37.884 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "mode", 2024-08-31T04:38:37.884 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:37.884 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:37.884 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:37.884 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "root", 2024-08-31T04:38:37.884 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:37.884 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:37.885 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-08-31T04:38:37.885 INFO:teuthology.orchestra.run.smithi050.stdout: "cephadm-package", 2024-08-31T04:38:37.885 INFO:teuthology.orchestra.run.smithi050.stdout: "root" 2024-08-31T04:38:37.885 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-08-31T04:38:37.885 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "mode for remote execution of cephadm", 2024-08-31T04:38:37.885 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:37.885 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:37.885 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:37.885 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:37.885 INFO:teuthology.orchestra.run.smithi050.stdout: "oob_default_addr": { 2024-08-31T04:38:37.885 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "oob_default_addr", 2024-08-31T04:38:37.885 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:37.886 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:37.886 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:37.886 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "169.254.1.1", 2024-08-31T04:38:37.886 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:37.886 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:37.886 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:37.886 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Default address for RedFish API (oob management).", 2024-08-31T04:38:37.886 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:37.886 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:37.886 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:37.886 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:37.886 INFO:teuthology.orchestra.run.smithi050.stdout: "prometheus_alerts_path": { 2024-08-31T04:38:37.887 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "prometheus_alerts_path", 2024-08-31T04:38:37.887 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:37.887 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:37.887 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:37.887 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-08-31T04:38:37.887 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:37.887 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:37.887 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:37.887 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-08-31T04:38:37.887 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:37.887 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:37.887 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:37.887 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:37.887 INFO:teuthology.orchestra.run.smithi050.stdout: "registry_insecure": { 2024-08-31T04:38:37.888 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "registry_insecure", 2024-08-31T04:38:37.888 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:37.888 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:37.888 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:37.888 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-08-31T04:38:37.888 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:37.888 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:37.888 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:37.888 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-08-31T04:38:37.888 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:37.888 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:37.888 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:37.888 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:37.889 INFO:teuthology.orchestra.run.smithi050.stdout: "registry_password": { 2024-08-31T04:38:37.889 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "registry_password", 2024-08-31T04:38:37.889 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:37.889 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:37.889 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:37.889 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-08-31T04:38:37.889 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:37.889 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:37.889 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:37.889 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-08-31T04:38:37.889 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:37.889 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:37.890 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:37.890 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:37.890 INFO:teuthology.orchestra.run.smithi050.stdout: "registry_url": { 2024-08-31T04:38:37.890 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "registry_url", 2024-08-31T04:38:37.890 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:37.890 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:37.890 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:37.890 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-08-31T04:38:37.890 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:37.890 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:37.890 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:37.890 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-08-31T04:38:37.890 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:37.891 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:37.891 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:37.891 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:37.891 INFO:teuthology.orchestra.run.smithi050.stdout: "registry_username": { 2024-08-31T04:38:37.891 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "registry_username", 2024-08-31T04:38:37.891 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:37.891 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:37.891 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:37.891 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-08-31T04:38:37.891 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:37.891 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:37.891 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:37.891 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-08-31T04:38:37.891 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:37.892 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:37.892 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:37.892 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:37.892 INFO:teuthology.orchestra.run.smithi050.stdout: "secure_monitoring_stack": { 2024-08-31T04:38:37.892 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "secure_monitoring_stack", 2024-08-31T04:38:37.892 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:37.892 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:37.892 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:37.892 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-08-31T04:38:37.892 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:37.892 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:37.892 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:37.892 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-08-31T04:38:37.893 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:37.893 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:37.893 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:37.893 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:37.893 INFO:teuthology.orchestra.run.smithi050.stdout: "service_discovery_port": { 2024-08-31T04:38:37.893 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "service_discovery_port", 2024-08-31T04:38:37.893 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-08-31T04:38:37.893 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:37.893 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:37.893 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "8765", 2024-08-31T04:38:37.893 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:37.893 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:37.893 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:37.893 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "cephadm service discovery port", 2024-08-31T04:38:37.894 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:37.894 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:37.894 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:37.894 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:37.894 INFO:teuthology.orchestra.run.smithi050.stdout: "sqlite3_killpoint": { 2024-08-31T04:38:37.894 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "sqlite3_killpoint", 2024-08-31T04:38:37.894 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-08-31T04:38:37.894 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "dev", 2024-08-31T04:38:37.894 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:37.894 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "0", 2024-08-31T04:38:37.894 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:37.894 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:37.894 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:37.894 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:37.895 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:37.895 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:37.895 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:37.895 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:37.895 INFO:teuthology.orchestra.run.smithi050.stdout: "ssh_config_file": { 2024-08-31T04:38:37.895 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "ssh_config_file", 2024-08-31T04:38:37.895 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:37.895 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:37.895 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:37.895 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-08-31T04:38:37.895 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:37.895 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:37.895 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:37.895 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-08-31T04:38:37.896 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:37.896 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:37.896 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:37.896 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:37.896 INFO:teuthology.orchestra.run.smithi050.stdout: "use_agent": { 2024-08-31T04:38:37.896 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "use_agent", 2024-08-31T04:38:37.896 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:37.896 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:37.896 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:37.896 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-08-31T04:38:37.896 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:37.896 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:37.896 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:37.897 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-08-31T04:38:37.897 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:37.897 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:37.897 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:37.897 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:37.897 INFO:teuthology.orchestra.run.smithi050.stdout: "use_repo_digest": { 2024-08-31T04:38:37.897 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "use_repo_digest", 2024-08-31T04:38:37.897 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:37.897 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:37.897 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:37.897 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2024-08-31T04:38:37.897 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:37.898 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:37.898 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:37.898 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-08-31T04:38:37.898 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:37.898 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:37.898 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:37.898 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:37.898 INFO:teuthology.orchestra.run.smithi050.stdout: "warn_on_failed_host_check": { 2024-08-31T04:38:37.898 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "warn_on_failed_host_check", 2024-08-31T04:38:37.898 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:37.898 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:37.898 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:37.899 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2024-08-31T04:38:37.899 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:37.899 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:37.899 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:37.899 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "raise a health warning if the host check fails", 2024-08-31T04:38:37.899 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:37.899 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:37.899 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:37.899 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:37.899 INFO:teuthology.orchestra.run.smithi050.stdout: "warn_on_stray_daemons": { 2024-08-31T04:38:37.899 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "warn_on_stray_daemons", 2024-08-31T04:38:37.899 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:37.899 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:37.899 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:37.900 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2024-08-31T04:38:37.900 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:37.900 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:37.900 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:37.900 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-08-31T04:38:37.900 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:37.900 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:37.900 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:37.900 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:37.900 INFO:teuthology.orchestra.run.smithi050.stdout: "warn_on_stray_hosts": { 2024-08-31T04:38:37.900 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "warn_on_stray_hosts", 2024-08-31T04:38:37.900 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:37.901 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:37.901 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:37.901 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2024-08-31T04:38:37.901 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:37.901 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:37.901 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:37.901 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-08-31T04:38:37.901 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:37.901 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:37.901 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:37.901 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T04:38:37.901 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T04:38:37.901 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:37.902 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-08-31T04:38:37.902 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "crash", 2024-08-31T04:38:37.902 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2024-08-31T04:38:37.902 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2024-08-31T04:38:37.902 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2024-08-31T04:38:37.902 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2024-08-31T04:38:37.902 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2024-08-31T04:38:37.902 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:37.902 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:37.902 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:37.902 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-08-31T04:38:37.902 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:37.902 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:37.903 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-08-31T04:38:37.903 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-08-31T04:38:37.903 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-08-31T04:38:37.903 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-08-31T04:38:37.903 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-08-31T04:38:37.903 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-08-31T04:38:37.903 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-08-31T04:38:37.903 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-08-31T04:38:37.903 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:37.903 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:37.903 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:37.903 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:37.903 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:37.903 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2024-08-31T04:38:37.904 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2024-08-31T04:38:37.904 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:37.904 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:37.904 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:37.904 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-08-31T04:38:37.904 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:37.904 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:37.904 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:37.904 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:37.904 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:37.904 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:37.904 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:37.905 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:37.905 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2024-08-31T04:38:37.905 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2024-08-31T04:38:37.905 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:37.905 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:37.905 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:37.905 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2024-08-31T04:38:37.905 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:37.905 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:37.905 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-08-31T04:38:37.905 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-08-31T04:38:37.905 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-08-31T04:38:37.905 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-08-31T04:38:37.905 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-08-31T04:38:37.906 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-08-31T04:38:37.906 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-08-31T04:38:37.906 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-08-31T04:38:37.906 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:37.906 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:37.906 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:37.906 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:37.906 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:37.906 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2024-08-31T04:38:37.906 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2024-08-31T04:38:37.906 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:37.906 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:37.906 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:37.907 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-08-31T04:38:37.907 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:37.907 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:37.907 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:37.907 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:37.907 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:37.907 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:37.907 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:37.907 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:37.907 INFO:teuthology.orchestra.run.smithi050.stdout: "retain_interval": { 2024-08-31T04:38:37.907 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "retain_interval", 2024-08-31T04:38:37.907 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "secs", 2024-08-31T04:38:37.907 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:37.908 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:37.908 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "31536000", 2024-08-31T04:38:37.908 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:37.908 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:37.908 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:37.908 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "how long to retain crashes before pruning them", 2024-08-31T04:38:37.908 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:37.908 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:37.908 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:37.908 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:37.908 INFO:teuthology.orchestra.run.smithi050.stdout: "sqlite3_killpoint": { 2024-08-31T04:38:37.908 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "sqlite3_killpoint", 2024-08-31T04:38:37.908 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-08-31T04:38:37.909 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "dev", 2024-08-31T04:38:37.909 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:37.909 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "0", 2024-08-31T04:38:37.909 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:37.909 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:37.909 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:37.909 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:37.909 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:37.909 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:37.909 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:37.909 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:37.909 INFO:teuthology.orchestra.run.smithi050.stdout: "warn_recent_interval": { 2024-08-31T04:38:37.909 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "warn_recent_interval", 2024-08-31T04:38:37.910 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "secs", 2024-08-31T04:38:37.910 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:37.910 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:37.910 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "1209600", 2024-08-31T04:38:37.910 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:37.910 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:37.910 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:37.910 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "time interval in which to warn about recent crashes", 2024-08-31T04:38:37.910 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:37.910 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:37.910 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:37.910 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T04:38:37.910 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T04:38:37.911 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:37.911 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-08-31T04:38:37.911 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "dashboard", 2024-08-31T04:38:37.911 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2024-08-31T04:38:37.911 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2024-08-31T04:38:37.911 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2024-08-31T04:38:37.911 INFO:teuthology.orchestra.run.smithi050.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-08-31T04:38:37.911 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-08-31T04:38:37.911 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-08-31T04:38:37.911 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:37.911 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:37.911 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "10", 2024-08-31T04:38:37.912 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:37.912 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:37.912 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:37.912 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:37.912 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:37.912 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:37.912 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:37.912 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:37.912 INFO:teuthology.orchestra.run.smithi050.stdout: "ALERTMANAGER_API_HOST": { 2024-08-31T04:38:37.912 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "ALERTMANAGER_API_HOST", 2024-08-31T04:38:37.912 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:37.912 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:37.912 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:37.913 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-08-31T04:38:37.913 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:37.913 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:37.913 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:37.913 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:37.913 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:37.913 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:37.913 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:37.913 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:37.913 INFO:teuthology.orchestra.run.smithi050.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-08-31T04:38:37.913 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-08-31T04:38:37.913 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:37.913 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:37.914 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:37.914 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2024-08-31T04:38:37.914 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:37.914 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:37.914 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:37.914 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:37.914 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:37.914 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:37.914 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:37.914 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:37.914 INFO:teuthology.orchestra.run.smithi050.stdout: "AUDIT_API_ENABLED": { 2024-08-31T04:38:37.914 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "AUDIT_API_ENABLED", 2024-08-31T04:38:37.914 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:37.914 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:37.915 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:37.915 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-08-31T04:38:37.915 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:37.915 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:37.915 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:37.915 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:37.915 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:37.915 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:37.915 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:37.915 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:37.915 INFO:teuthology.orchestra.run.smithi050.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-08-31T04:38:37.915 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-08-31T04:38:37.916 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:37.916 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:37.916 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:37.916 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2024-08-31T04:38:37.916 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:37.916 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:37.916 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:37.916 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:37.916 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:37.916 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:37.916 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:37.916 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:37.916 INFO:teuthology.orchestra.run.smithi050.stdout: "ENABLE_BROWSABLE_API": { 2024-08-31T04:38:37.917 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "ENABLE_BROWSABLE_API", 2024-08-31T04:38:37.917 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:37.917 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:37.917 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:37.917 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2024-08-31T04:38:37.917 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:37.917 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:37.917 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:37.917 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:37.917 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:37.917 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:37.917 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:37.917 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:37.917 INFO:teuthology.orchestra.run.smithi050.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-08-31T04:38:37.918 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-08-31T04:38:37.918 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:37.918 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:37.918 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:37.918 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2024-08-31T04:38:37.918 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:37.918 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:37.918 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:37.918 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:37.918 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:37.918 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:37.918 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:37.918 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:37.919 INFO:teuthology.orchestra.run.smithi050.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-08-31T04:38:37.919 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-08-31T04:38:37.919 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:37.919 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:37.919 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:37.919 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2024-08-31T04:38:37.919 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:37.919 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:37.919 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:37.919 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:37.919 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:37.919 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:37.919 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:37.919 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:37.920 INFO:teuthology.orchestra.run.smithi050.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-08-31T04:38:37.920 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-08-31T04:38:37.920 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:37.920 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:37.920 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:37.920 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2024-08-31T04:38:37.920 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:37.920 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:37.920 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:37.920 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:37.920 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:37.920 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:37.920 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:37.921 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:37.921 INFO:teuthology.orchestra.run.smithi050.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-08-31T04:38:37.921 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-08-31T04:38:37.921 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:37.921 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:37.921 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:37.921 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2024-08-31T04:38:37.921 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:37.921 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:37.921 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:37.921 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:37.921 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:37.921 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:37.922 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:37.922 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:37.922 INFO:teuthology.orchestra.run.smithi050.stdout: "FEATURE_TOGGLE_NFS": { 2024-08-31T04:38:37.922 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-08-31T04:38:37.922 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:37.922 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:37.922 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:37.922 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2024-08-31T04:38:37.922 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:37.922 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:37.922 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:37.922 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:37.922 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:37.922 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:37.923 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:37.923 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:37.923 INFO:teuthology.orchestra.run.smithi050.stdout: "FEATURE_TOGGLE_RBD": { 2024-08-31T04:38:37.923 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-08-31T04:38:37.923 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:37.923 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:37.923 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:37.923 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2024-08-31T04:38:37.923 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:37.923 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:37.923 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:37.923 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:37.923 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:37.923 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:37.924 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:37.924 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:37.924 INFO:teuthology.orchestra.run.smithi050.stdout: "FEATURE_TOGGLE_RGW": { 2024-08-31T04:38:37.924 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-08-31T04:38:37.924 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:37.924 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:37.924 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:37.924 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2024-08-31T04:38:37.924 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:37.924 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:37.924 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:37.924 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:37.924 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:37.925 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:37.925 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:37.925 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:37.925 INFO:teuthology.orchestra.run.smithi050.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-08-31T04:38:37.925 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-08-31T04:38:37.925 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:37.925 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:37.925 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:37.925 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-08-31T04:38:37.925 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:37.925 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:37.926 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:37.926 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:37.926 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:37.926 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:37.926 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:37.926 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:37.926 INFO:teuthology.orchestra.run.smithi050.stdout: "GRAFANA_API_PASSWORD": { 2024-08-31T04:38:37.926 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "GRAFANA_API_PASSWORD", 2024-08-31T04:38:37.926 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:37.926 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:37.926 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:37.926 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "admin", 2024-08-31T04:38:37.926 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:37.927 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:37.927 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:37.927 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:37.927 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:37.927 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:37.927 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:37.927 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:37.927 INFO:teuthology.orchestra.run.smithi050.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-08-31T04:38:37.927 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-08-31T04:38:37.927 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:37.927 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:37.927 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:37.927 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2024-08-31T04:38:37.927 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:37.928 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:37.928 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:37.928 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:37.928 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:37.928 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:37.928 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:37.928 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:37.928 INFO:teuthology.orchestra.run.smithi050.stdout: "GRAFANA_API_URL": { 2024-08-31T04:38:37.928 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "GRAFANA_API_URL", 2024-08-31T04:38:37.928 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:37.928 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:37.928 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:37.929 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-08-31T04:38:37.929 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:37.929 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:37.929 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:37.929 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:37.929 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:37.929 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:37.929 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:37.929 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:37.929 INFO:teuthology.orchestra.run.smithi050.stdout: "GRAFANA_API_USERNAME": { 2024-08-31T04:38:37.929 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "GRAFANA_API_USERNAME", 2024-08-31T04:38:37.929 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:37.929 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:37.930 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:37.930 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "admin", 2024-08-31T04:38:37.930 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:37.930 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:37.930 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:37.930 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:37.930 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:37.930 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:37.930 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:37.930 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:37.930 INFO:teuthology.orchestra.run.smithi050.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-08-31T04:38:37.930 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-08-31T04:38:37.930 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:37.931 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:37.931 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:37.931 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-08-31T04:38:37.931 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:37.931 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:37.931 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:37.931 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:37.931 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:37.931 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:37.931 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:37.931 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:37.931 INFO:teuthology.orchestra.run.smithi050.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-08-31T04:38:37.931 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-08-31T04:38:37.931 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:37.932 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:37.932 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:37.932 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-08-31T04:38:37.932 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:37.932 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:37.932 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:37.932 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:37.932 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:37.932 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:37.932 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:37.932 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:37.932 INFO:teuthology.orchestra.run.smithi050.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-08-31T04:38:37.932 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-08-31T04:38:37.933 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:37.933 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:37.933 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:37.933 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2024-08-31T04:38:37.933 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:37.933 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:37.933 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:37.933 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:37.933 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:37.933 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:37.933 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:37.933 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:37.933 INFO:teuthology.orchestra.run.smithi050.stdout: "ISSUE_TRACKER_API_KEY": { 2024-08-31T04:38:37.933 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-08-31T04:38:37.934 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:37.934 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:37.934 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:37.934 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-08-31T04:38:37.934 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:37.934 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:37.934 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:37.934 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:37.934 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:37.934 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:37.934 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:37.934 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:37.934 INFO:teuthology.orchestra.run.smithi050.stdout: "MANAGED_BY_CLUSTERS": { 2024-08-31T04:38:37.935 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "MANAGED_BY_CLUSTERS", 2024-08-31T04:38:37.935 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:37.935 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:37.935 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:37.935 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "[]", 2024-08-31T04:38:37.935 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:37.935 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:37.935 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:37.935 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:37.935 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:37.935 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:37.935 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:37.935 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:37.935 INFO:teuthology.orchestra.run.smithi050.stdout: "MULTICLUSTER_CONFIG": { 2024-08-31T04:38:37.935 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "MULTICLUSTER_CONFIG", 2024-08-31T04:38:37.936 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:37.936 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:37.936 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:37.936 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "{}", 2024-08-31T04:38:37.936 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:37.936 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:37.936 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:37.936 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:37.936 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:37.936 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:37.936 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:37.936 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:37.937 INFO:teuthology.orchestra.run.smithi050.stdout: "PROMETHEUS_API_HOST": { 2024-08-31T04:38:37.937 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "PROMETHEUS_API_HOST", 2024-08-31T04:38:37.937 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:37.937 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:37.937 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:37.937 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-08-31T04:38:37.937 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:37.937 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:37.937 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:37.937 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:37.937 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:37.937 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:37.937 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:37.937 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:37.938 INFO:teuthology.orchestra.run.smithi050.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-08-31T04:38:37.938 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-08-31T04:38:37.938 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:37.938 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:37.938 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:37.938 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2024-08-31T04:38:37.938 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:37.938 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:37.938 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:37.938 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:37.938 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:37.938 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:37.938 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:37.939 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:37.939 INFO:teuthology.orchestra.run.smithi050.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-08-31T04:38:37.939 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-08-31T04:38:37.939 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:37.939 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:37.939 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:37.939 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-08-31T04:38:37.939 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:37.939 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:37.939 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:37.939 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:37.940 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:37.940 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:37.940 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:37.940 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:37.940 INFO:teuthology.orchestra.run.smithi050.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-08-31T04:38:37.940 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-08-31T04:38:37.940 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:37.940 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:37.940 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:37.940 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-08-31T04:38:37.940 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:37.940 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:37.940 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:37.940 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:37.941 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:37.941 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:37.941 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:37.941 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:37.941 INFO:teuthology.orchestra.run.smithi050.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-08-31T04:38:37.941 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-08-31T04:38:37.941 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:37.941 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:37.941 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:37.941 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2024-08-31T04:38:37.941 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:37.941 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:37.941 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:37.942 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:37.942 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:37.942 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:37.942 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:37.942 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:37.942 INFO:teuthology.orchestra.run.smithi050.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-08-31T04:38:37.942 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-08-31T04:38:37.942 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:37.942 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:37.942 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:37.942 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2024-08-31T04:38:37.942 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:37.943 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:37.943 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:37.943 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:37.943 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:37.943 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:37.943 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:37.943 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:37.943 INFO:teuthology.orchestra.run.smithi050.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-08-31T04:38:37.943 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-08-31T04:38:37.943 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:37.943 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:37.943 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:37.943 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-08-31T04:38:37.943 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:37.944 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:37.944 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:37.944 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:37.944 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:37.944 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:37.944 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:37.944 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:37.944 INFO:teuthology.orchestra.run.smithi050.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-08-31T04:38:37.944 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-08-31T04:38:37.944 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:37.944 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:37.944 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:37.944 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-08-31T04:38:37.945 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:37.945 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:37.945 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:37.945 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:37.945 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:37.945 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:37.945 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:37.945 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:37.945 INFO:teuthology.orchestra.run.smithi050.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-08-31T04:38:37.945 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-08-31T04:38:37.945 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:37.945 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:37.945 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:37.946 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-08-31T04:38:37.946 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:37.946 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:37.946 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:37.946 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:37.946 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:37.946 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:37.946 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:37.946 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:37.946 INFO:teuthology.orchestra.run.smithi050.stdout: "PWD_POLICY_ENABLED": { 2024-08-31T04:38:37.946 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "PWD_POLICY_ENABLED", 2024-08-31T04:38:37.946 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:37.946 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:37.946 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:37.947 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2024-08-31T04:38:37.947 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:37.947 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:37.947 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:37.947 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:37.947 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:37.947 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:37.947 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:37.947 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:37.947 INFO:teuthology.orchestra.run.smithi050.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-08-31T04:38:37.947 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-08-31T04:38:37.947 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:37.947 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:37.947 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:37.948 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-08-31T04:38:37.948 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:37.948 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:37.948 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:37.948 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:37.948 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:37.948 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:37.948 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:37.948 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:37.948 INFO:teuthology.orchestra.run.smithi050.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-08-31T04:38:37.948 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-08-31T04:38:37.948 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-08-31T04:38:37.948 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:37.949 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:37.949 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "10", 2024-08-31T04:38:37.949 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:37.949 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:37.949 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:37.949 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:37.949 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:37.949 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:37.949 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:37.949 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:37.949 INFO:teuthology.orchestra.run.smithi050.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-08-31T04:38:37.949 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-08-31T04:38:37.949 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-08-31T04:38:37.949 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:37.950 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:37.950 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "8", 2024-08-31T04:38:37.950 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:37.950 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:37.950 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:37.950 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:37.950 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:37.950 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:37.950 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:37.950 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:37.950 INFO:teuthology.orchestra.run.smithi050.stdout: "REST_REQUESTS_TIMEOUT": { 2024-08-31T04:38:37.950 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-08-31T04:38:37.950 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-08-31T04:38:37.951 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:37.951 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:37.951 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "45", 2024-08-31T04:38:37.951 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:37.951 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:37.951 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:37.951 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:37.951 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:37.951 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:37.951 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:37.951 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:37.951 INFO:teuthology.orchestra.run.smithi050.stdout: "RGW_API_ACCESS_KEY": { 2024-08-31T04:38:37.951 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "RGW_API_ACCESS_KEY", 2024-08-31T04:38:37.951 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:37.952 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:37.952 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:37.952 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-08-31T04:38:37.952 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:37.952 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:37.952 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:37.952 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:37.952 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:37.952 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:37.952 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:37.952 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:37.952 INFO:teuthology.orchestra.run.smithi050.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-08-31T04:38:37.953 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-08-31T04:38:37.953 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:37.953 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:37.953 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:37.953 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "admin", 2024-08-31T04:38:37.953 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:37.953 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:37.953 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:37.953 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:37.953 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:37.953 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:37.953 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:37.954 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:37.954 INFO:teuthology.orchestra.run.smithi050.stdout: "RGW_API_SECRET_KEY": { 2024-08-31T04:38:37.954 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "RGW_API_SECRET_KEY", 2024-08-31T04:38:37.954 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:37.954 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:37.954 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:37.954 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-08-31T04:38:37.954 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:37.954 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:37.954 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:37.954 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:37.954 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:37.954 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:37.955 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:37.955 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:37.955 INFO:teuthology.orchestra.run.smithi050.stdout: "RGW_API_SSL_VERIFY": { 2024-08-31T04:38:37.955 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "RGW_API_SSL_VERIFY", 2024-08-31T04:38:37.955 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:37.955 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:37.955 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:37.955 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2024-08-31T04:38:37.955 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:37.955 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:37.955 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:37.955 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:37.955 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:37.955 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:37.956 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:37.956 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:37.956 INFO:teuthology.orchestra.run.smithi050.stdout: "UNSAFE_TLS_v1_2": { 2024-08-31T04:38:37.956 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "UNSAFE_TLS_v1_2", 2024-08-31T04:38:37.956 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:37.956 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:37.956 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:37.956 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-08-31T04:38:37.956 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:37.956 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:37.956 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:37.956 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:37.956 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:37.956 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:37.957 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:37.957 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:37.957 INFO:teuthology.orchestra.run.smithi050.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-08-31T04:38:37.957 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-08-31T04:38:37.957 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-08-31T04:38:37.957 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:37.957 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:37.957 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "0", 2024-08-31T04:38:37.957 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:37.957 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:37.957 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:37.957 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:37.957 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:37.958 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:37.958 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:37.958 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:37.958 INFO:teuthology.orchestra.run.smithi050.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-08-31T04:38:37.958 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-08-31T04:38:37.958 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-08-31T04:38:37.958 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:37.958 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:37.958 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "10", 2024-08-31T04:38:37.958 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:37.958 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:37.958 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:37.958 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:37.958 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:37.959 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:37.959 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:37.959 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:37.959 INFO:teuthology.orchestra.run.smithi050.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-08-31T04:38:37.959 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-08-31T04:38:37.959 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-08-31T04:38:37.959 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:37.959 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:37.959 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "5", 2024-08-31T04:38:37.959 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:37.959 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:37.959 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:37.959 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:37.960 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:37.960 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:37.960 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:37.960 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:37.960 INFO:teuthology.orchestra.run.smithi050.stdout: "cross_origin_url": { 2024-08-31T04:38:37.960 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "cross_origin_url", 2024-08-31T04:38:37.960 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:37.960 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:37.960 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:37.960 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-08-31T04:38:37.960 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:37.960 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:37.960 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:37.961 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:37.961 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:37.961 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:37.961 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:37.961 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:37.961 INFO:teuthology.orchestra.run.smithi050.stdout: "crt_file": { 2024-08-31T04:38:37.961 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "crt_file", 2024-08-31T04:38:37.961 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:37.961 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:37.961 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:37.961 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-08-31T04:38:37.961 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:37.961 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:37.961 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:37.962 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:37.962 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:37.962 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:37.962 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:37.962 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:37.962 INFO:teuthology.orchestra.run.smithi050.stdout: "debug": { 2024-08-31T04:38:37.962 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "debug", 2024-08-31T04:38:37.962 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:37.962 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:37.962 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:37.962 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-08-31T04:38:37.962 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:37.962 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:37.962 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:37.963 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Enable/disable debug options", 2024-08-31T04:38:37.963 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:37.963 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:37.963 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:37.963 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:37.963 INFO:teuthology.orchestra.run.smithi050.stdout: "jwt_token_ttl": { 2024-08-31T04:38:37.963 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "jwt_token_ttl", 2024-08-31T04:38:37.963 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-08-31T04:38:37.963 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:37.963 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:37.963 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "28800", 2024-08-31T04:38:37.963 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:37.963 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:37.964 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:37.964 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:37.964 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:37.964 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:37.964 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:37.964 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:37.964 INFO:teuthology.orchestra.run.smithi050.stdout: "key_file": { 2024-08-31T04:38:37.964 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "key_file", 2024-08-31T04:38:37.964 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:37.964 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:37.964 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:37.964 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-08-31T04:38:37.964 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:37.965 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:37.965 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:37.965 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:37.965 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:37.965 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:37.965 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:37.965 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:37.965 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2024-08-31T04:38:37.965 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2024-08-31T04:38:37.965 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:37.965 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:37.965 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:37.965 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-08-31T04:38:37.966 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:37.966 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:37.966 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-08-31T04:38:37.966 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-08-31T04:38:37.966 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-08-31T04:38:37.966 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-08-31T04:38:37.966 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-08-31T04:38:37.966 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-08-31T04:38:37.966 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-08-31T04:38:37.966 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-08-31T04:38:37.966 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:37.966 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:37.966 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:37.966 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:37.967 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:37.967 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2024-08-31T04:38:37.967 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2024-08-31T04:38:37.967 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:37.967 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:37.967 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:37.967 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-08-31T04:38:37.967 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:37.967 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:37.967 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:37.967 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:37.967 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:37.967 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:37.968 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:37.968 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:37.968 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2024-08-31T04:38:37.968 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2024-08-31T04:38:37.968 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:37.968 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:37.968 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:37.968 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2024-08-31T04:38:37.968 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:37.968 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:37.968 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-08-31T04:38:37.968 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-08-31T04:38:37.969 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-08-31T04:38:37.969 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-08-31T04:38:37.969 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-08-31T04:38:37.969 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-08-31T04:38:37.969 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-08-31T04:38:37.969 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-08-31T04:38:37.969 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:37.969 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:37.969 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:37.969 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:37.969 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:37.969 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2024-08-31T04:38:37.969 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2024-08-31T04:38:37.969 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:37.970 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:37.970 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:37.970 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-08-31T04:38:37.970 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:37.970 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:37.970 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:37.970 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:37.970 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:37.970 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:37.970 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:37.970 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:37.970 INFO:teuthology.orchestra.run.smithi050.stdout: "motd": { 2024-08-31T04:38:37.971 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "motd", 2024-08-31T04:38:37.971 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:37.971 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:37.971 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:37.971 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-08-31T04:38:37.971 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:37.971 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:37.971 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:37.971 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "The message of the day", 2024-08-31T04:38:37.971 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:37.971 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:37.971 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:37.971 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:37.972 INFO:teuthology.orchestra.run.smithi050.stdout: "redirect_resolve_ip_addr": { 2024-08-31T04:38:37.972 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "redirect_resolve_ip_addr", 2024-08-31T04:38:37.972 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:37.972 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:37.972 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:37.972 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-08-31T04:38:37.972 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:37.972 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:37.972 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:37.972 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:37.972 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:37.972 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:37.972 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:37.973 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:37.973 INFO:teuthology.orchestra.run.smithi050.stdout: "server_addr": { 2024-08-31T04:38:37.973 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "server_addr", 2024-08-31T04:38:37.973 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:37.973 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:37.973 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:37.973 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "::", 2024-08-31T04:38:37.973 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:37.973 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:37.973 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:37.973 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:37.973 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:37.973 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:37.974 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:37.974 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:37.974 INFO:teuthology.orchestra.run.smithi050.stdout: "server_port": { 2024-08-31T04:38:37.974 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "server_port", 2024-08-31T04:38:37.974 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-08-31T04:38:37.974 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:37.974 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:37.974 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "8080", 2024-08-31T04:38:37.974 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:37.974 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:37.974 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:37.974 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:37.974 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:37.975 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:37.975 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:37.975 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:37.975 INFO:teuthology.orchestra.run.smithi050.stdout: "sqlite3_killpoint": { 2024-08-31T04:38:37.975 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "sqlite3_killpoint", 2024-08-31T04:38:37.975 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-08-31T04:38:37.975 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "dev", 2024-08-31T04:38:37.975 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:37.975 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "0", 2024-08-31T04:38:37.975 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:37.975 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:37.975 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:37.975 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:37.975 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:37.976 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:37.976 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:37.976 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:37.976 INFO:teuthology.orchestra.run.smithi050.stdout: "ssl": { 2024-08-31T04:38:37.976 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "ssl", 2024-08-31T04:38:37.976 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:37.976 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:37.976 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:37.976 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2024-08-31T04:38:37.976 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:37.976 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:37.976 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:37.976 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:37.977 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:37.977 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:37.977 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:37.977 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:37.977 INFO:teuthology.orchestra.run.smithi050.stdout: "ssl_server_port": { 2024-08-31T04:38:37.977 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "ssl_server_port", 2024-08-31T04:38:37.977 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-08-31T04:38:37.977 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:37.977 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:37.977 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "8443", 2024-08-31T04:38:37.977 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:37.977 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:37.977 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:37.978 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:37.978 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:37.978 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:37.978 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:37.978 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:37.978 INFO:teuthology.orchestra.run.smithi050.stdout: "standby_behaviour": { 2024-08-31T04:38:37.978 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "standby_behaviour", 2024-08-31T04:38:37.978 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:37.978 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:37.978 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:37.978 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "redirect", 2024-08-31T04:38:37.978 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:37.978 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:37.978 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-08-31T04:38:37.979 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-08-31T04:38:37.979 INFO:teuthology.orchestra.run.smithi050.stdout: "redirect" 2024-08-31T04:38:37.979 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-08-31T04:38:37.979 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:37.979 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:37.979 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:37.979 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:37.979 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:37.979 INFO:teuthology.orchestra.run.smithi050.stdout: "standby_error_status_code": { 2024-08-31T04:38:37.979 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "standby_error_status_code", 2024-08-31T04:38:37.979 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-08-31T04:38:37.979 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:37.979 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:37.980 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "500", 2024-08-31T04:38:37.980 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "400", 2024-08-31T04:38:37.980 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "599", 2024-08-31T04:38:37.980 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:37.980 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:37.980 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:37.980 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:37.980 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:37.980 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:37.980 INFO:teuthology.orchestra.run.smithi050.stdout: "url_prefix": { 2024-08-31T04:38:37.980 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "url_prefix", 2024-08-31T04:38:37.980 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:37.980 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:37.981 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:37.981 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-08-31T04:38:37.981 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:37.981 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:37.981 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:37.981 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:37.981 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:37.981 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:37.981 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:37.981 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T04:38:37.981 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T04:38:37.981 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:37.982 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-08-31T04:38:37.982 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "devicehealth", 2024-08-31T04:38:37.982 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2024-08-31T04:38:37.982 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2024-08-31T04:38:37.982 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2024-08-31T04:38:37.982 INFO:teuthology.orchestra.run.smithi050.stdout: "enable_monitoring": { 2024-08-31T04:38:37.982 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "enable_monitoring", 2024-08-31T04:38:37.982 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:37.982 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:37.982 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:37.982 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2024-08-31T04:38:37.982 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:37.982 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:37.983 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:37.983 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "monitor device health metrics", 2024-08-31T04:38:37.983 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:37.983 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:37.983 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:37.983 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:37.983 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2024-08-31T04:38:37.983 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2024-08-31T04:38:37.983 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:37.983 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:37.983 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:37.983 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-08-31T04:38:37.983 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:37.984 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:37.984 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-08-31T04:38:37.984 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-08-31T04:38:37.984 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-08-31T04:38:37.984 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-08-31T04:38:37.984 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-08-31T04:38:37.984 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-08-31T04:38:37.984 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-08-31T04:38:37.984 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-08-31T04:38:37.984 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:37.984 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:37.984 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:37.984 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:37.985 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:37.985 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2024-08-31T04:38:37.985 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2024-08-31T04:38:37.985 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:37.985 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:37.985 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:37.985 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-08-31T04:38:37.985 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:37.985 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:37.985 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:37.985 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:37.985 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:37.985 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:37.986 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:37.986 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:37.986 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2024-08-31T04:38:37.986 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2024-08-31T04:38:37.986 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:37.986 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:37.986 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:37.986 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2024-08-31T04:38:37.986 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:37.986 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:37.986 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-08-31T04:38:37.986 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-08-31T04:38:37.986 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-08-31T04:38:37.987 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-08-31T04:38:37.987 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-08-31T04:38:37.987 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-08-31T04:38:37.987 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-08-31T04:38:37.987 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-08-31T04:38:37.987 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:37.987 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:37.987 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:37.987 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:37.987 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:37.987 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2024-08-31T04:38:37.987 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2024-08-31T04:38:37.987 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:37.987 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:37.988 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:37.988 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-08-31T04:38:37.988 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:37.988 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:37.988 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:37.988 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:37.988 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:37.988 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:37.988 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:37.988 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:37.988 INFO:teuthology.orchestra.run.smithi050.stdout: "mark_out_threshold": { 2024-08-31T04:38:37.988 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "mark_out_threshold", 2024-08-31T04:38:37.989 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "secs", 2024-08-31T04:38:37.989 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:37.989 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:37.989 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "2419200", 2024-08-31T04:38:37.989 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:37.989 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:37.989 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:37.989 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-08-31T04:38:37.989 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:37.989 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:37.989 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:37.989 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:37.989 INFO:teuthology.orchestra.run.smithi050.stdout: "pool_name": { 2024-08-31T04:38:37.990 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "pool_name", 2024-08-31T04:38:37.990 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:37.990 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:37.990 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:37.990 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "device_health_metrics", 2024-08-31T04:38:37.990 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:37.990 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:37.990 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:37.990 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "name of pool in which to store device health metrics", 2024-08-31T04:38:37.990 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:37.990 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:37.990 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:37.990 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:37.991 INFO:teuthology.orchestra.run.smithi050.stdout: "retention_period": { 2024-08-31T04:38:37.991 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "retention_period", 2024-08-31T04:38:37.991 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "secs", 2024-08-31T04:38:37.991 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:37.991 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:37.991 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "15552000", 2024-08-31T04:38:37.991 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:37.991 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:37.991 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:37.991 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "how long to retain device health metrics", 2024-08-31T04:38:37.991 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:37.991 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:37.992 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:37.992 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:37.992 INFO:teuthology.orchestra.run.smithi050.stdout: "scrape_frequency": { 2024-08-31T04:38:37.992 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "scrape_frequency", 2024-08-31T04:38:37.992 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "secs", 2024-08-31T04:38:37.992 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:37.992 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:37.992 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "86400", 2024-08-31T04:38:37.992 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:37.992 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:37.992 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:37.992 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "how frequently to scrape device health metrics", 2024-08-31T04:38:37.992 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:37.993 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:37.993 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:37.993 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:37.993 INFO:teuthology.orchestra.run.smithi050.stdout: "self_heal": { 2024-08-31T04:38:37.993 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "self_heal", 2024-08-31T04:38:37.993 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:37.993 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:37.993 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:37.993 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2024-08-31T04:38:37.993 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:37.993 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:37.993 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:37.993 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-08-31T04:38:37.994 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:37.994 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:37.994 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:37.994 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:37.994 INFO:teuthology.orchestra.run.smithi050.stdout: "sleep_interval": { 2024-08-31T04:38:37.994 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "sleep_interval", 2024-08-31T04:38:37.994 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "secs", 2024-08-31T04:38:37.994 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:37.994 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:37.994 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "600", 2024-08-31T04:38:37.994 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:37.994 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:37.994 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:37.994 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "how frequently to wake up and check device health", 2024-08-31T04:38:37.995 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:37.995 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:37.995 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:37.995 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:37.995 INFO:teuthology.orchestra.run.smithi050.stdout: "sqlite3_killpoint": { 2024-08-31T04:38:37.995 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "sqlite3_killpoint", 2024-08-31T04:38:37.995 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-08-31T04:38:37.995 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "dev", 2024-08-31T04:38:37.995 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:37.995 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "0", 2024-08-31T04:38:37.995 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:37.995 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:37.995 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:37.995 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:37.996 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:37.996 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:37.996 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:37.996 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:37.996 INFO:teuthology.orchestra.run.smithi050.stdout: "warn_threshold": { 2024-08-31T04:38:37.996 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "warn_threshold", 2024-08-31T04:38:37.996 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "secs", 2024-08-31T04:38:37.996 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:37.996 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:37.996 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "7257600", 2024-08-31T04:38:37.996 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:37.996 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:37.996 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:37.997 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-08-31T04:38:37.997 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:37.997 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:37.997 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:37.997 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T04:38:37.997 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T04:38:37.997 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:37.997 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-08-31T04:38:37.997 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "diskprediction_local", 2024-08-31T04:38:37.997 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2024-08-31T04:38:37.997 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2024-08-31T04:38:37.997 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2024-08-31T04:38:37.997 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2024-08-31T04:38:37.998 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2024-08-31T04:38:37.998 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:37.998 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:37.998 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:37.998 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-08-31T04:38:37.998 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:37.998 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:37.998 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-08-31T04:38:37.998 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-08-31T04:38:37.998 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-08-31T04:38:37.998 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-08-31T04:38:37.998 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-08-31T04:38:37.998 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-08-31T04:38:37.999 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-08-31T04:38:37.999 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-08-31T04:38:37.999 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:37.999 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:37.999 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:37.999 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:37.999 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:37.999 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2024-08-31T04:38:37.999 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2024-08-31T04:38:37.999 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:37.999 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:37.999 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:37.999 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-08-31T04:38:37.999 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.000 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.000 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.000 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.000 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.000 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.000 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.000 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.000 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2024-08-31T04:38:38.000 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2024-08-31T04:38:38.000 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.000 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.000 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.000 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2024-08-31T04:38:38.001 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.001 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.001 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-08-31T04:38:38.001 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-08-31T04:38:38.001 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-08-31T04:38:38.001 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-08-31T04:38:38.001 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-08-31T04:38:38.001 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-08-31T04:38:38.001 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-08-31T04:38:38.001 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-08-31T04:38:38.001 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.001 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.001 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.002 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.002 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.002 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2024-08-31T04:38:38.002 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2024-08-31T04:38:38.002 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:38.002 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.002 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.002 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-08-31T04:38:38.002 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.002 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.002 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.002 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.002 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.002 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.003 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.003 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.003 INFO:teuthology.orchestra.run.smithi050.stdout: "predict_interval": { 2024-08-31T04:38:38.003 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "predict_interval", 2024-08-31T04:38:38.003 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.003 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.003 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.003 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "86400", 2024-08-31T04:38:38.003 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.003 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.003 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.003 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.003 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.004 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.004 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.004 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.004 INFO:teuthology.orchestra.run.smithi050.stdout: "predictor_model": { 2024-08-31T04:38:38.004 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "predictor_model", 2024-08-31T04:38:38.004 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.004 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.004 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.004 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "prophetstor", 2024-08-31T04:38:38.004 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.004 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.004 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.004 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.004 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.005 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.005 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.005 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.005 INFO:teuthology.orchestra.run.smithi050.stdout: "sleep_interval": { 2024-08-31T04:38:38.005 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "sleep_interval", 2024-08-31T04:38:38.005 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.005 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.005 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.005 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "600", 2024-08-31T04:38:38.005 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.005 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.005 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.005 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.005 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.006 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.006 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.006 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.006 INFO:teuthology.orchestra.run.smithi050.stdout: "sqlite3_killpoint": { 2024-08-31T04:38:38.006 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "sqlite3_killpoint", 2024-08-31T04:38:38.006 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-08-31T04:38:38.006 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "dev", 2024-08-31T04:38:38.006 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.006 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "0", 2024-08-31T04:38:38.006 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.006 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.006 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.006 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.007 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.007 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.007 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.007 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T04:38:38.007 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T04:38:38.007 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.007 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-08-31T04:38:38.007 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "influx", 2024-08-31T04:38:38.007 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": false, 2024-08-31T04:38:38.007 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "influxdb python module not found", 2024-08-31T04:38:38.007 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2024-08-31T04:38:38.007 INFO:teuthology.orchestra.run.smithi050.stdout: "batch_size": { 2024-08-31T04:38:38.007 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "batch_size", 2024-08-31T04:38:38.007 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-08-31T04:38:38.008 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.008 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.008 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "5000", 2024-08-31T04:38:38.008 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.008 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.008 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.008 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-08-31T04:38:38.008 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.008 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.008 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.008 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.008 INFO:teuthology.orchestra.run.smithi050.stdout: "database": { 2024-08-31T04:38:38.008 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "database", 2024-08-31T04:38:38.009 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.009 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.009 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.009 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "ceph", 2024-08-31T04:38:38.009 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.009 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.009 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.009 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-08-31T04:38:38.009 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.009 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.009 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.009 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.009 INFO:teuthology.orchestra.run.smithi050.stdout: "hostname": { 2024-08-31T04:38:38.010 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "hostname", 2024-08-31T04:38:38.010 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.010 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.010 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.010 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-08-31T04:38:38.010 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.010 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.010 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.010 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "InfluxDB server hostname", 2024-08-31T04:38:38.010 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.010 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.010 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.011 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.011 INFO:teuthology.orchestra.run.smithi050.stdout: "interval": { 2024-08-31T04:38:38.011 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "interval", 2024-08-31T04:38:38.011 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "secs", 2024-08-31T04:38:38.011 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.011 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.011 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "30", 2024-08-31T04:38:38.011 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "5", 2024-08-31T04:38:38.011 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.011 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.011 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-08-31T04:38:38.011 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.011 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.011 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.012 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.012 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2024-08-31T04:38:38.012 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2024-08-31T04:38:38.012 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.012 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.012 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.012 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-08-31T04:38:38.012 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.012 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.012 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-08-31T04:38:38.012 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-08-31T04:38:38.012 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-08-31T04:38:38.013 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-08-31T04:38:38.013 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-08-31T04:38:38.013 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-08-31T04:38:38.013 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-08-31T04:38:38.013 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-08-31T04:38:38.013 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.013 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.013 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.013 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.013 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.013 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2024-08-31T04:38:38.013 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2024-08-31T04:38:38.013 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:38.014 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.014 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.014 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-08-31T04:38:38.014 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.014 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.014 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.014 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.014 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.014 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.014 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.014 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.014 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2024-08-31T04:38:38.014 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2024-08-31T04:38:38.014 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.015 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.015 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.015 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2024-08-31T04:38:38.015 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.015 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.015 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-08-31T04:38:38.015 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-08-31T04:38:38.015 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-08-31T04:38:38.015 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-08-31T04:38:38.015 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-08-31T04:38:38.015 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-08-31T04:38:38.015 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-08-31T04:38:38.016 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-08-31T04:38:38.016 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.016 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.016 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.016 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.016 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.016 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2024-08-31T04:38:38.016 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2024-08-31T04:38:38.016 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:38.016 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.016 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.016 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-08-31T04:38:38.016 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.017 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.017 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.017 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.017 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.017 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.017 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.017 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.017 INFO:teuthology.orchestra.run.smithi050.stdout: "password": { 2024-08-31T04:38:38.017 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "password", 2024-08-31T04:38:38.017 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.017 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.017 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.017 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-08-31T04:38:38.017 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.018 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.018 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.018 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "password of InfluxDB server user", 2024-08-31T04:38:38.018 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.018 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.018 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.018 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.018 INFO:teuthology.orchestra.run.smithi050.stdout: "port": { 2024-08-31T04:38:38.018 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "port", 2024-08-31T04:38:38.018 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-08-31T04:38:38.018 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.018 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.018 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "8086", 2024-08-31T04:38:38.019 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.019 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.019 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.019 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "InfluxDB server port", 2024-08-31T04:38:38.019 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.019 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.019 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.019 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.019 INFO:teuthology.orchestra.run.smithi050.stdout: "sqlite3_killpoint": { 2024-08-31T04:38:38.019 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "sqlite3_killpoint", 2024-08-31T04:38:38.019 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-08-31T04:38:38.019 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "dev", 2024-08-31T04:38:38.019 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.020 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "0", 2024-08-31T04:38:38.020 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.020 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.020 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.020 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.020 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.020 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.020 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.020 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.020 INFO:teuthology.orchestra.run.smithi050.stdout: "ssl": { 2024-08-31T04:38:38.020 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "ssl", 2024-08-31T04:38:38.020 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.020 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.021 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.021 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "false", 2024-08-31T04:38:38.021 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.021 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.021 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.021 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-08-31T04:38:38.021 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.021 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.021 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.021 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.021 INFO:teuthology.orchestra.run.smithi050.stdout: "threads": { 2024-08-31T04:38:38.021 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "threads", 2024-08-31T04:38:38.021 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-08-31T04:38:38.022 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.022 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.022 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "5", 2024-08-31T04:38:38.022 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "1", 2024-08-31T04:38:38.022 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "32", 2024-08-31T04:38:38.022 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.022 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-08-31T04:38:38.022 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.022 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.022 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.022 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.022 INFO:teuthology.orchestra.run.smithi050.stdout: "username": { 2024-08-31T04:38:38.022 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "username", 2024-08-31T04:38:38.023 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.023 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.023 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.023 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-08-31T04:38:38.023 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.023 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.023 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.023 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "username of InfluxDB server user", 2024-08-31T04:38:38.023 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.023 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.023 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.023 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.023 INFO:teuthology.orchestra.run.smithi050.stdout: "verify_ssl": { 2024-08-31T04:38:38.023 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "verify_ssl", 2024-08-31T04:38:38.024 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.024 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.024 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.024 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "true", 2024-08-31T04:38:38.024 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.024 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.024 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.024 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-08-31T04:38:38.024 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.024 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.024 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.024 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T04:38:38.025 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T04:38:38.025 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.025 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-08-31T04:38:38.025 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "insights", 2024-08-31T04:38:38.025 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2024-08-31T04:38:38.025 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2024-08-31T04:38:38.025 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2024-08-31T04:38:38.025 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2024-08-31T04:38:38.025 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2024-08-31T04:38:38.025 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.025 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.025 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.025 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-08-31T04:38:38.026 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.026 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.026 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-08-31T04:38:38.026 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-08-31T04:38:38.026 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-08-31T04:38:38.026 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-08-31T04:38:38.026 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-08-31T04:38:38.026 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-08-31T04:38:38.026 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-08-31T04:38:38.026 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-08-31T04:38:38.026 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.026 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.026 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.027 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.027 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.027 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2024-08-31T04:38:38.027 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2024-08-31T04:38:38.027 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:38.027 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.027 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.027 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-08-31T04:38:38.027 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.027 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.027 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.027 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.027 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.028 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.028 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.028 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.028 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2024-08-31T04:38:38.028 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2024-08-31T04:38:38.028 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.028 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.028 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.028 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2024-08-31T04:38:38.028 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.028 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.028 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-08-31T04:38:38.028 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-08-31T04:38:38.029 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-08-31T04:38:38.029 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-08-31T04:38:38.029 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-08-31T04:38:38.029 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-08-31T04:38:38.029 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-08-31T04:38:38.029 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-08-31T04:38:38.029 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.029 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.029 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.029 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.029 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.029 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2024-08-31T04:38:38.029 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2024-08-31T04:38:38.030 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:38.030 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.030 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.030 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-08-31T04:38:38.030 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.030 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.030 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.030 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.030 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.030 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.030 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.030 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.030 INFO:teuthology.orchestra.run.smithi050.stdout: "sqlite3_killpoint": { 2024-08-31T04:38:38.030 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "sqlite3_killpoint", 2024-08-31T04:38:38.031 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-08-31T04:38:38.031 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "dev", 2024-08-31T04:38:38.031 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.031 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "0", 2024-08-31T04:38:38.031 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.031 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.031 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.031 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.031 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.031 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.031 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.031 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T04:38:38.031 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T04:38:38.032 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.032 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-08-31T04:38:38.032 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "iostat", 2024-08-31T04:38:38.032 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2024-08-31T04:38:38.032 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2024-08-31T04:38:38.032 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2024-08-31T04:38:38.032 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2024-08-31T04:38:38.032 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2024-08-31T04:38:38.032 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.032 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.032 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.032 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-08-31T04:38:38.032 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.033 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.033 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-08-31T04:38:38.033 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-08-31T04:38:38.033 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-08-31T04:38:38.033 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-08-31T04:38:38.033 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-08-31T04:38:38.033 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-08-31T04:38:38.033 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-08-31T04:38:38.033 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-08-31T04:38:38.033 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.033 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.033 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.033 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.033 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.034 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2024-08-31T04:38:38.034 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2024-08-31T04:38:38.034 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:38.034 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.034 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.034 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-08-31T04:38:38.034 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.034 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.034 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.034 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.034 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.034 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.034 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.035 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.035 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2024-08-31T04:38:38.035 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2024-08-31T04:38:38.035 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.035 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.035 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.035 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2024-08-31T04:38:38.035 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.035 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.035 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-08-31T04:38:38.035 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-08-31T04:38:38.035 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-08-31T04:38:38.035 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-08-31T04:38:38.035 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-08-31T04:38:38.036 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-08-31T04:38:38.036 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-08-31T04:38:38.036 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-08-31T04:38:38.036 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.036 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.036 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.036 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.036 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.036 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2024-08-31T04:38:38.036 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2024-08-31T04:38:38.036 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:38.036 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.036 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.037 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-08-31T04:38:38.037 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.037 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.037 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.037 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.037 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.037 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.037 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.037 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.037 INFO:teuthology.orchestra.run.smithi050.stdout: "sqlite3_killpoint": { 2024-08-31T04:38:38.037 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "sqlite3_killpoint", 2024-08-31T04:38:38.037 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-08-31T04:38:38.037 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "dev", 2024-08-31T04:38:38.037 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.038 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "0", 2024-08-31T04:38:38.038 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.038 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.038 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.038 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.038 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.038 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.038 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.038 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T04:38:38.038 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T04:38:38.038 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.038 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-08-31T04:38:38.038 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "k8sevents", 2024-08-31T04:38:38.039 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2024-08-31T04:38:38.039 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2024-08-31T04:38:38.039 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2024-08-31T04:38:38.039 INFO:teuthology.orchestra.run.smithi050.stdout: "ceph_event_retention_days": { 2024-08-31T04:38:38.039 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "ceph_event_retention_days", 2024-08-31T04:38:38.039 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-08-31T04:38:38.039 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.039 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.039 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "7", 2024-08-31T04:38:38.039 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.039 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.039 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.040 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Days to hold ceph event information within local cache", 2024-08-31T04:38:38.040 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.040 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.040 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.040 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.040 INFO:teuthology.orchestra.run.smithi050.stdout: "config_check_secs": { 2024-08-31T04:38:38.040 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "config_check_secs", 2024-08-31T04:38:38.040 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-08-31T04:38:38.040 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.040 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.040 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "10", 2024-08-31T04:38:38.040 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "10", 2024-08-31T04:38:38.040 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.041 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.041 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-08-31T04:38:38.041 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.041 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.041 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.041 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.041 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2024-08-31T04:38:38.041 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2024-08-31T04:38:38.041 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.041 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.041 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.041 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-08-31T04:38:38.041 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.042 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.042 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-08-31T04:38:38.042 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-08-31T04:38:38.042 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-08-31T04:38:38.042 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-08-31T04:38:38.042 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-08-31T04:38:38.042 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-08-31T04:38:38.042 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-08-31T04:38:38.042 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-08-31T04:38:38.042 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.042 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.042 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.042 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.042 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.043 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2024-08-31T04:38:38.043 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2024-08-31T04:38:38.043 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:38.043 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.043 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.043 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-08-31T04:38:38.043 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.043 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.043 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.043 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.043 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.043 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.043 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.044 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.044 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2024-08-31T04:38:38.044 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2024-08-31T04:38:38.044 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.044 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.044 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.044 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2024-08-31T04:38:38.044 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.044 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.044 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-08-31T04:38:38.044 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-08-31T04:38:38.044 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-08-31T04:38:38.044 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-08-31T04:38:38.045 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-08-31T04:38:38.045 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-08-31T04:38:38.045 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-08-31T04:38:38.045 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-08-31T04:38:38.045 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.045 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.045 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.045 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.045 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.045 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2024-08-31T04:38:38.045 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2024-08-31T04:38:38.045 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:38.045 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.046 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.046 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-08-31T04:38:38.046 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.046 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.046 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.046 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.046 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.046 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.046 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.046 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.046 INFO:teuthology.orchestra.run.smithi050.stdout: "sqlite3_killpoint": { 2024-08-31T04:38:38.046 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "sqlite3_killpoint", 2024-08-31T04:38:38.046 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-08-31T04:38:38.047 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "dev", 2024-08-31T04:38:38.047 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.047 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "0", 2024-08-31T04:38:38.047 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.047 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.047 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.047 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.047 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.047 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.047 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.047 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T04:38:38.047 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T04:38:38.047 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.048 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-08-31T04:38:38.048 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "localpool", 2024-08-31T04:38:38.048 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2024-08-31T04:38:38.048 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2024-08-31T04:38:38.048 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2024-08-31T04:38:38.048 INFO:teuthology.orchestra.run.smithi050.stdout: "failure_domain": { 2024-08-31T04:38:38.048 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "failure_domain", 2024-08-31T04:38:38.048 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.048 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.048 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.048 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "host", 2024-08-31T04:38:38.048 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.048 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.049 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.049 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "failure domain for any created local pool", 2024-08-31T04:38:38.049 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-08-31T04:38:38.049 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.049 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.049 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.049 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2024-08-31T04:38:38.049 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2024-08-31T04:38:38.049 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.049 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.049 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.049 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-08-31T04:38:38.049 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.050 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.050 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-08-31T04:38:38.050 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-08-31T04:38:38.050 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-08-31T04:38:38.050 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-08-31T04:38:38.050 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-08-31T04:38:38.050 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-08-31T04:38:38.050 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-08-31T04:38:38.050 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-08-31T04:38:38.050 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.050 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.052 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.052 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.052 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.052 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2024-08-31T04:38:38.052 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2024-08-31T04:38:38.052 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:38.052 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.052 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.052 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-08-31T04:38:38.052 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.052 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.052 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.053 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.053 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.053 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.053 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.053 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.053 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2024-08-31T04:38:38.053 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2024-08-31T04:38:38.053 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.053 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.053 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.053 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2024-08-31T04:38:38.053 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.053 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.054 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-08-31T04:38:38.054 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-08-31T04:38:38.054 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-08-31T04:38:38.054 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-08-31T04:38:38.054 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-08-31T04:38:38.054 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-08-31T04:38:38.054 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-08-31T04:38:38.054 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-08-31T04:38:38.054 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.054 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.054 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.054 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.054 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.055 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2024-08-31T04:38:38.055 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2024-08-31T04:38:38.055 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:38.055 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.055 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.055 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-08-31T04:38:38.055 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.055 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.055 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.055 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.055 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.055 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.055 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.056 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.056 INFO:teuthology.orchestra.run.smithi050.stdout: "min_size": { 2024-08-31T04:38:38.056 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "min_size", 2024-08-31T04:38:38.056 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-08-31T04:38:38.056 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.056 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.056 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-08-31T04:38:38.056 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.056 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.056 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.056 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "default min_size for any created local pool", 2024-08-31T04:38:38.056 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-08-31T04:38:38.056 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.057 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.057 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.057 INFO:teuthology.orchestra.run.smithi050.stdout: "num_rep": { 2024-08-31T04:38:38.057 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "num_rep", 2024-08-31T04:38:38.057 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-08-31T04:38:38.057 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.057 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.057 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "3", 2024-08-31T04:38:38.057 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.057 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.057 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.057 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "default replica count for any created local pool", 2024-08-31T04:38:38.057 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.058 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.058 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.058 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.058 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num": { 2024-08-31T04:38:38.058 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "pg_num", 2024-08-31T04:38:38.058 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-08-31T04:38:38.058 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.058 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.058 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "128", 2024-08-31T04:38:38.058 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.058 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.058 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.058 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "default pg_num for any created local pool", 2024-08-31T04:38:38.059 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.059 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.059 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.059 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.059 INFO:teuthology.orchestra.run.smithi050.stdout: "prefix": { 2024-08-31T04:38:38.059 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "prefix", 2024-08-31T04:38:38.059 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.059 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.059 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.059 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-08-31T04:38:38.059 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.059 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.059 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.060 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "name prefix for any created local pool", 2024-08-31T04:38:38.060 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.060 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.060 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.060 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.060 INFO:teuthology.orchestra.run.smithi050.stdout: "sqlite3_killpoint": { 2024-08-31T04:38:38.060 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "sqlite3_killpoint", 2024-08-31T04:38:38.060 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-08-31T04:38:38.060 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "dev", 2024-08-31T04:38:38.060 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.060 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "0", 2024-08-31T04:38:38.060 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.060 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.061 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.061 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.061 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.061 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.061 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.061 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.061 INFO:teuthology.orchestra.run.smithi050.stdout: "subtree": { 2024-08-31T04:38:38.061 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "subtree", 2024-08-31T04:38:38.061 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.061 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.061 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.061 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "rack", 2024-08-31T04:38:38.061 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.062 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.062 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.062 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "CRUSH level for which to create a local pool", 2024-08-31T04:38:38.062 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-08-31T04:38:38.062 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.062 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.062 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T04:38:38.062 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T04:38:38.062 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.062 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-08-31T04:38:38.063 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "mds_autoscaler", 2024-08-31T04:38:38.063 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2024-08-31T04:38:38.063 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2024-08-31T04:38:38.063 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2024-08-31T04:38:38.063 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2024-08-31T04:38:38.063 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2024-08-31T04:38:38.063 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.063 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.063 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.063 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-08-31T04:38:38.063 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.063 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.063 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-08-31T04:38:38.064 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-08-31T04:38:38.064 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-08-31T04:38:38.064 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-08-31T04:38:38.064 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-08-31T04:38:38.064 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-08-31T04:38:38.064 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-08-31T04:38:38.064 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-08-31T04:38:38.064 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.064 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.064 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.064 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.064 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.064 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2024-08-31T04:38:38.065 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2024-08-31T04:38:38.065 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:38.065 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.065 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.065 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-08-31T04:38:38.065 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.065 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.065 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.065 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.065 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.065 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.065 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.065 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.065 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2024-08-31T04:38:38.066 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2024-08-31T04:38:38.066 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.066 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.066 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.066 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2024-08-31T04:38:38.066 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.066 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.066 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-08-31T04:38:38.066 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-08-31T04:38:38.066 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-08-31T04:38:38.066 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-08-31T04:38:38.066 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-08-31T04:38:38.066 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-08-31T04:38:38.066 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-08-31T04:38:38.067 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-08-31T04:38:38.067 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.067 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.067 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.067 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.067 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.067 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2024-08-31T04:38:38.067 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2024-08-31T04:38:38.067 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:38.067 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.067 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.067 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-08-31T04:38:38.067 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.068 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.068 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.068 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.068 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.068 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.068 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.068 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.068 INFO:teuthology.orchestra.run.smithi050.stdout: "sqlite3_killpoint": { 2024-08-31T04:38:38.068 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "sqlite3_killpoint", 2024-08-31T04:38:38.068 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-08-31T04:38:38.068 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "dev", 2024-08-31T04:38:38.068 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.068 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "0", 2024-08-31T04:38:38.069 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.069 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.069 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.069 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.069 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.069 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.069 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.069 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T04:38:38.069 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T04:38:38.069 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.069 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-08-31T04:38:38.070 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "mirroring", 2024-08-31T04:38:38.070 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2024-08-31T04:38:38.070 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2024-08-31T04:38:38.070 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2024-08-31T04:38:38.070 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2024-08-31T04:38:38.070 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2024-08-31T04:38:38.070 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.070 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.070 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.070 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-08-31T04:38:38.070 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.070 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.071 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-08-31T04:38:38.071 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-08-31T04:38:38.071 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-08-31T04:38:38.071 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-08-31T04:38:38.071 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-08-31T04:38:38.071 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-08-31T04:38:38.071 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-08-31T04:38:38.071 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-08-31T04:38:38.071 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.071 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.071 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.071 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.071 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.072 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2024-08-31T04:38:38.072 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2024-08-31T04:38:38.072 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:38.072 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.072 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.072 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-08-31T04:38:38.072 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.072 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.072 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.072 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.072 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.072 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.072 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.073 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.073 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2024-08-31T04:38:38.073 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2024-08-31T04:38:38.073 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.073 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.073 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.073 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2024-08-31T04:38:38.073 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.073 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.073 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-08-31T04:38:38.073 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-08-31T04:38:38.073 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-08-31T04:38:38.073 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-08-31T04:38:38.073 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-08-31T04:38:38.074 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-08-31T04:38:38.074 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-08-31T04:38:38.074 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-08-31T04:38:38.074 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.074 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.074 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.074 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.074 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.074 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2024-08-31T04:38:38.074 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2024-08-31T04:38:38.074 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:38.074 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.074 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.075 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-08-31T04:38:38.075 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.075 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.075 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.075 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.075 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.075 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.075 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.075 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.075 INFO:teuthology.orchestra.run.smithi050.stdout: "sqlite3_killpoint": { 2024-08-31T04:38:38.075 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "sqlite3_killpoint", 2024-08-31T04:38:38.075 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-08-31T04:38:38.075 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "dev", 2024-08-31T04:38:38.075 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.076 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "0", 2024-08-31T04:38:38.076 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.076 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.076 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.076 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.076 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.076 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.076 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.076 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T04:38:38.076 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T04:38:38.076 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.076 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-08-31T04:38:38.076 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "nfs", 2024-08-31T04:38:38.077 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2024-08-31T04:38:38.077 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2024-08-31T04:38:38.077 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2024-08-31T04:38:38.077 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2024-08-31T04:38:38.077 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2024-08-31T04:38:38.077 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.077 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.077 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.077 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-08-31T04:38:38.077 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.077 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.077 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-08-31T04:38:38.077 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-08-31T04:38:38.078 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-08-31T04:38:38.078 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-08-31T04:38:38.078 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-08-31T04:38:38.078 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-08-31T04:38:38.078 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-08-31T04:38:38.078 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-08-31T04:38:38.078 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.078 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.078 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.078 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.078 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.078 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2024-08-31T04:38:38.078 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2024-08-31T04:38:38.078 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:38.079 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.079 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.079 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-08-31T04:38:38.079 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.079 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.079 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.079 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.079 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.079 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.079 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.079 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.079 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2024-08-31T04:38:38.079 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2024-08-31T04:38:38.080 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.080 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.080 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.080 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2024-08-31T04:38:38.080 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.080 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.080 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-08-31T04:38:38.080 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-08-31T04:38:38.080 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-08-31T04:38:38.080 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-08-31T04:38:38.080 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-08-31T04:38:38.080 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-08-31T04:38:38.080 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-08-31T04:38:38.080 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-08-31T04:38:38.081 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.081 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.081 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.081 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.081 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.081 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2024-08-31T04:38:38.081 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2024-08-31T04:38:38.081 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:38.081 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.081 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.081 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-08-31T04:38:38.081 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.081 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.082 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.082 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.082 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.082 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.082 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.082 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.082 INFO:teuthology.orchestra.run.smithi050.stdout: "sqlite3_killpoint": { 2024-08-31T04:38:38.082 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "sqlite3_killpoint", 2024-08-31T04:38:38.082 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-08-31T04:38:38.082 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "dev", 2024-08-31T04:38:38.082 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.082 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "0", 2024-08-31T04:38:38.082 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.082 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.083 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.083 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.083 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.083 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.083 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.083 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T04:38:38.083 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T04:38:38.083 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.083 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-08-31T04:38:38.083 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "orchestrator", 2024-08-31T04:38:38.083 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2024-08-31T04:38:38.083 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2024-08-31T04:38:38.083 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2024-08-31T04:38:38.083 INFO:teuthology.orchestra.run.smithi050.stdout: "fail_fs": { 2024-08-31T04:38:38.083 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "fail_fs", 2024-08-31T04:38:38.084 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:38.084 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.084 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.084 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-08-31T04:38:38.084 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.084 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.084 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.084 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-08-31T04:38:38.084 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.084 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.084 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.084 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.085 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2024-08-31T04:38:38.085 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2024-08-31T04:38:38.085 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.085 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.085 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.085 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-08-31T04:38:38.085 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.085 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.085 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-08-31T04:38:38.085 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-08-31T04:38:38.085 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-08-31T04:38:38.085 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-08-31T04:38:38.085 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-08-31T04:38:38.085 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-08-31T04:38:38.086 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-08-31T04:38:38.086 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-08-31T04:38:38.086 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.086 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.086 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.086 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.086 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.086 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2024-08-31T04:38:38.086 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2024-08-31T04:38:38.086 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:38.086 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.086 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.086 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-08-31T04:38:38.087 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.087 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.087 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.087 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.087 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.087 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.087 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.087 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.087 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2024-08-31T04:38:38.087 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2024-08-31T04:38:38.087 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.087 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.087 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.087 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2024-08-31T04:38:38.088 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.088 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.088 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-08-31T04:38:38.088 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-08-31T04:38:38.088 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-08-31T04:38:38.088 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-08-31T04:38:38.088 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-08-31T04:38:38.088 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-08-31T04:38:38.088 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-08-31T04:38:38.088 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-08-31T04:38:38.088 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.088 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.088 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.088 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.089 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.089 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2024-08-31T04:38:38.089 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2024-08-31T04:38:38.089 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:38.089 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.089 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.089 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-08-31T04:38:38.089 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.089 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.089 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.089 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.089 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.089 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.090 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.090 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.090 INFO:teuthology.orchestra.run.smithi050.stdout: "orchestrator": { 2024-08-31T04:38:38.090 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "orchestrator", 2024-08-31T04:38:38.090 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.090 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.090 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.090 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-08-31T04:38:38.090 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.090 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.090 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-08-31T04:38:38.090 INFO:teuthology.orchestra.run.smithi050.stdout: "cephadm", 2024-08-31T04:38:38.090 INFO:teuthology.orchestra.run.smithi050.stdout: "rook", 2024-08-31T04:38:38.091 INFO:teuthology.orchestra.run.smithi050.stdout: "test_orchestrator" 2024-08-31T04:38:38.091 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-08-31T04:38:38.091 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Orchestrator backend", 2024-08-31T04:38:38.091 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.091 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.091 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.091 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.091 INFO:teuthology.orchestra.run.smithi050.stdout: "sqlite3_killpoint": { 2024-08-31T04:38:38.091 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "sqlite3_killpoint", 2024-08-31T04:38:38.091 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-08-31T04:38:38.091 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "dev", 2024-08-31T04:38:38.091 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.091 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "0", 2024-08-31T04:38:38.091 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.092 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.092 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.092 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.092 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.092 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.092 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.092 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T04:38:38.092 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T04:38:38.092 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.092 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-08-31T04:38:38.092 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "osd_perf_query", 2024-08-31T04:38:38.092 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2024-08-31T04:38:38.092 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2024-08-31T04:38:38.092 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2024-08-31T04:38:38.093 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2024-08-31T04:38:38.093 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2024-08-31T04:38:38.093 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.093 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.093 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.093 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-08-31T04:38:38.093 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.093 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.093 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-08-31T04:38:38.093 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-08-31T04:38:38.093 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-08-31T04:38:38.093 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-08-31T04:38:38.094 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-08-31T04:38:38.094 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-08-31T04:38:38.094 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-08-31T04:38:38.094 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-08-31T04:38:38.094 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.094 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.094 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.094 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.094 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.094 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2024-08-31T04:38:38.094 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2024-08-31T04:38:38.094 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:38.094 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.095 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.095 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-08-31T04:38:38.095 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.095 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.095 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.095 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.095 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.095 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.095 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.095 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.095 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2024-08-31T04:38:38.095 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2024-08-31T04:38:38.095 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.095 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.095 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.096 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2024-08-31T04:38:38.096 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.096 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.096 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-08-31T04:38:38.096 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-08-31T04:38:38.096 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-08-31T04:38:38.096 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-08-31T04:38:38.096 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-08-31T04:38:38.096 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-08-31T04:38:38.096 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-08-31T04:38:38.096 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-08-31T04:38:38.096 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.096 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.096 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.097 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.097 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.097 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2024-08-31T04:38:38.097 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2024-08-31T04:38:38.097 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:38.097 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.097 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.097 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-08-31T04:38:38.097 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.097 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.097 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.097 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.097 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.098 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.098 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.098 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.098 INFO:teuthology.orchestra.run.smithi050.stdout: "sqlite3_killpoint": { 2024-08-31T04:38:38.098 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "sqlite3_killpoint", 2024-08-31T04:38:38.098 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-08-31T04:38:38.098 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "dev", 2024-08-31T04:38:38.098 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.098 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "0", 2024-08-31T04:38:38.098 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.098 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.098 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.098 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.098 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.099 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.099 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.099 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T04:38:38.099 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T04:38:38.099 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.099 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-08-31T04:38:38.099 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "osd_support", 2024-08-31T04:38:38.099 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2024-08-31T04:38:38.099 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2024-08-31T04:38:38.099 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2024-08-31T04:38:38.099 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2024-08-31T04:38:38.099 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2024-08-31T04:38:38.099 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.100 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.100 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.100 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-08-31T04:38:38.100 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.100 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.100 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-08-31T04:38:38.100 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-08-31T04:38:38.100 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-08-31T04:38:38.100 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-08-31T04:38:38.100 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-08-31T04:38:38.100 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-08-31T04:38:38.100 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-08-31T04:38:38.100 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-08-31T04:38:38.100 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.101 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.101 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.101 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.101 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.101 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2024-08-31T04:38:38.101 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2024-08-31T04:38:38.101 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:38.101 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.101 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.101 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-08-31T04:38:38.101 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.101 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.101 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.102 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.102 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.102 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.102 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.102 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.102 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2024-08-31T04:38:38.102 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2024-08-31T04:38:38.102 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.102 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.102 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.102 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2024-08-31T04:38:38.102 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.102 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.102 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-08-31T04:38:38.103 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-08-31T04:38:38.103 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-08-31T04:38:38.103 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-08-31T04:38:38.103 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-08-31T04:38:38.103 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-08-31T04:38:38.103 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-08-31T04:38:38.103 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-08-31T04:38:38.103 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.103 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.103 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.103 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.103 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.103 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2024-08-31T04:38:38.103 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2024-08-31T04:38:38.104 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:38.104 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.104 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.104 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-08-31T04:38:38.104 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.104 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.104 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.104 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.104 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.104 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.104 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.104 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.104 INFO:teuthology.orchestra.run.smithi050.stdout: "sqlite3_killpoint": { 2024-08-31T04:38:38.104 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "sqlite3_killpoint", 2024-08-31T04:38:38.105 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-08-31T04:38:38.105 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "dev", 2024-08-31T04:38:38.105 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.105 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "0", 2024-08-31T04:38:38.105 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.105 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.105 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.105 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.105 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.105 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.105 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.105 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T04:38:38.105 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T04:38:38.105 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.105 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-08-31T04:38:38.106 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "pg_autoscaler", 2024-08-31T04:38:38.106 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2024-08-31T04:38:38.106 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2024-08-31T04:38:38.106 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2024-08-31T04:38:38.106 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2024-08-31T04:38:38.106 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2024-08-31T04:38:38.106 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.106 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.106 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.106 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-08-31T04:38:38.106 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.106 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.106 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-08-31T04:38:38.106 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-08-31T04:38:38.106 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-08-31T04:38:38.107 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-08-31T04:38:38.107 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-08-31T04:38:38.107 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-08-31T04:38:38.107 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-08-31T04:38:38.107 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-08-31T04:38:38.107 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.107 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.107 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.107 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.107 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.107 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2024-08-31T04:38:38.107 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2024-08-31T04:38:38.107 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:38.107 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.107 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.108 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-08-31T04:38:38.108 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.108 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.108 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.108 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.108 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.108 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.108 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.108 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.108 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2024-08-31T04:38:38.108 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2024-08-31T04:38:38.108 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.108 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.108 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.108 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2024-08-31T04:38:38.109 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.109 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.109 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-08-31T04:38:38.109 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-08-31T04:38:38.109 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-08-31T04:38:38.109 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-08-31T04:38:38.109 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-08-31T04:38:38.109 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-08-31T04:38:38.109 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-08-31T04:38:38.109 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-08-31T04:38:38.109 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.109 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.109 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.109 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.110 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.110 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2024-08-31T04:38:38.110 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2024-08-31T04:38:38.110 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:38.110 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.110 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.110 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-08-31T04:38:38.110 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.110 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.110 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.110 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.110 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.110 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.111 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.111 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.111 INFO:teuthology.orchestra.run.smithi050.stdout: "sleep_interval": { 2024-08-31T04:38:38.111 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "sleep_interval", 2024-08-31T04:38:38.111 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "secs", 2024-08-31T04:38:38.111 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.111 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.111 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "60", 2024-08-31T04:38:38.111 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.111 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.111 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.111 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.111 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.111 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.111 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.112 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.112 INFO:teuthology.orchestra.run.smithi050.stdout: "sqlite3_killpoint": { 2024-08-31T04:38:38.112 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "sqlite3_killpoint", 2024-08-31T04:38:38.112 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-08-31T04:38:38.112 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "dev", 2024-08-31T04:38:38.112 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.112 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "0", 2024-08-31T04:38:38.112 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.112 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.112 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.112 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.112 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.112 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.112 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.113 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.113 INFO:teuthology.orchestra.run.smithi050.stdout: "threshold": { 2024-08-31T04:38:38.113 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "threshold", 2024-08-31T04:38:38.113 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "float", 2024-08-31T04:38:38.113 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.113 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.113 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "3.0", 2024-08-31T04:38:38.113 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "1.0", 2024-08-31T04:38:38.113 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.113 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.113 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "scaling threshold", 2024-08-31T04:38:38.113 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-08-31T04:38:38.113 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.113 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.114 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T04:38:38.114 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T04:38:38.114 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.114 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-08-31T04:38:38.114 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "progress", 2024-08-31T04:38:38.114 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2024-08-31T04:38:38.114 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2024-08-31T04:38:38.114 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2024-08-31T04:38:38.114 INFO:teuthology.orchestra.run.smithi050.stdout: "allow_pg_recovery_event": { 2024-08-31T04:38:38.114 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "allow_pg_recovery_event", 2024-08-31T04:38:38.114 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:38.114 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.114 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.114 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-08-31T04:38:38.115 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.115 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.115 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.115 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "allow the module to show pg recovery progress", 2024-08-31T04:38:38.115 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.115 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.115 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.115 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.115 INFO:teuthology.orchestra.run.smithi050.stdout: "enabled": { 2024-08-31T04:38:38.115 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "enabled", 2024-08-31T04:38:38.115 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:38.115 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.115 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.115 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2024-08-31T04:38:38.116 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.116 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.116 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.116 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.116 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.116 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.116 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.116 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.116 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2024-08-31T04:38:38.116 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2024-08-31T04:38:38.116 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.116 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.116 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.116 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-08-31T04:38:38.116 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.117 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.117 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-08-31T04:38:38.117 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-08-31T04:38:38.117 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-08-31T04:38:38.117 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-08-31T04:38:38.117 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-08-31T04:38:38.117 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-08-31T04:38:38.117 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-08-31T04:38:38.117 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-08-31T04:38:38.117 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.117 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.117 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.117 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.118 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.118 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2024-08-31T04:38:38.118 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2024-08-31T04:38:38.118 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:38.118 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.118 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.118 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-08-31T04:38:38.118 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.118 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.118 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.118 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.118 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.118 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.118 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.119 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.119 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2024-08-31T04:38:38.119 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2024-08-31T04:38:38.119 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.119 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.119 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.119 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2024-08-31T04:38:38.119 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.119 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.119 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-08-31T04:38:38.119 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-08-31T04:38:38.119 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-08-31T04:38:38.119 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-08-31T04:38:38.120 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-08-31T04:38:38.120 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-08-31T04:38:38.120 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-08-31T04:38:38.120 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-08-31T04:38:38.120 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.120 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.120 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.120 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.120 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.120 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2024-08-31T04:38:38.120 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2024-08-31T04:38:38.120 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:38.120 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.121 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.121 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-08-31T04:38:38.121 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.121 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.121 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.121 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.121 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.121 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.121 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.121 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.121 INFO:teuthology.orchestra.run.smithi050.stdout: "max_completed_events": { 2024-08-31T04:38:38.121 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "max_completed_events", 2024-08-31T04:38:38.121 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-08-31T04:38:38.121 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.122 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.122 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "50", 2024-08-31T04:38:38.122 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.122 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.122 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.122 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "number of past completed events to remember", 2024-08-31T04:38:38.122 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.122 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.122 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.122 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.122 INFO:teuthology.orchestra.run.smithi050.stdout: "sleep_interval": { 2024-08-31T04:38:38.122 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "sleep_interval", 2024-08-31T04:38:38.122 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "secs", 2024-08-31T04:38:38.122 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.123 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.123 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "5", 2024-08-31T04:38:38.123 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.123 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.123 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.123 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "how long the module is going to sleep", 2024-08-31T04:38:38.123 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.123 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.123 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.123 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.123 INFO:teuthology.orchestra.run.smithi050.stdout: "sqlite3_killpoint": { 2024-08-31T04:38:38.123 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "sqlite3_killpoint", 2024-08-31T04:38:38.123 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-08-31T04:38:38.123 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "dev", 2024-08-31T04:38:38.124 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.124 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "0", 2024-08-31T04:38:38.124 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.124 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.124 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.124 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.124 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.124 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.124 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.124 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T04:38:38.124 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T04:38:38.124 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.124 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-08-31T04:38:38.124 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "prometheus", 2024-08-31T04:38:38.125 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2024-08-31T04:38:38.125 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2024-08-31T04:38:38.125 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2024-08-31T04:38:38.125 INFO:teuthology.orchestra.run.smithi050.stdout: "cache": { 2024-08-31T04:38:38.125 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "cache", 2024-08-31T04:38:38.125 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:38.125 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.125 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.125 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2024-08-31T04:38:38.125 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.125 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.125 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.125 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.125 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.126 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.126 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.126 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.126 INFO:teuthology.orchestra.run.smithi050.stdout: "exclude_perf_counters": { 2024-08-31T04:38:38.126 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "exclude_perf_counters", 2024-08-31T04:38:38.126 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:38.126 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.126 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.126 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2024-08-31T04:38:38.126 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.127 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.127 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.127 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-08-31T04:38:38.127 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-08-31T04:38:38.127 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.127 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.127 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.127 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2024-08-31T04:38:38.127 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2024-08-31T04:38:38.127 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.127 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.127 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.127 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-08-31T04:38:38.127 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.127 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.128 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-08-31T04:38:38.128 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-08-31T04:38:38.128 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-08-31T04:38:38.128 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-08-31T04:38:38.128 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-08-31T04:38:38.128 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-08-31T04:38:38.128 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-08-31T04:38:38.128 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-08-31T04:38:38.128 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.128 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.128 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.128 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.128 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.128 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2024-08-31T04:38:38.129 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2024-08-31T04:38:38.129 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:38.129 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.129 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.129 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-08-31T04:38:38.129 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.129 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.129 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.129 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.129 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.129 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.129 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.130 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.130 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2024-08-31T04:38:38.130 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2024-08-31T04:38:38.130 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.130 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.130 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.130 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2024-08-31T04:38:38.130 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.130 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.130 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-08-31T04:38:38.130 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-08-31T04:38:38.130 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-08-31T04:38:38.130 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-08-31T04:38:38.131 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-08-31T04:38:38.131 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-08-31T04:38:38.131 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-08-31T04:38:38.131 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-08-31T04:38:38.131 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.131 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.131 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.131 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.131 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.131 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2024-08-31T04:38:38.131 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2024-08-31T04:38:38.131 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:38.131 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.131 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.132 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-08-31T04:38:38.132 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.132 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.132 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.132 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.132 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.132 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.132 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.132 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.132 INFO:teuthology.orchestra.run.smithi050.stdout: "rbd_stats_pools": { 2024-08-31T04:38:38.132 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "rbd_stats_pools", 2024-08-31T04:38:38.132 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.132 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.133 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.133 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-08-31T04:38:38.133 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.133 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.133 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.133 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.133 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.133 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.133 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.133 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.133 INFO:teuthology.orchestra.run.smithi050.stdout: "rbd_stats_pools_refresh_interval": { 2024-08-31T04:38:38.133 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-08-31T04:38:38.133 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-08-31T04:38:38.133 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.133 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.134 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "300", 2024-08-31T04:38:38.134 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.134 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.134 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.134 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.134 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.134 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.134 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.134 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.134 INFO:teuthology.orchestra.run.smithi050.stdout: "scrape_interval": { 2024-08-31T04:38:38.134 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "scrape_interval", 2024-08-31T04:38:38.134 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "float", 2024-08-31T04:38:38.134 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.134 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.135 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "15.0", 2024-08-31T04:38:38.135 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.135 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.135 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.135 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.135 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.135 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.135 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.135 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.135 INFO:teuthology.orchestra.run.smithi050.stdout: "server_addr": { 2024-08-31T04:38:38.135 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "server_addr", 2024-08-31T04:38:38.135 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.135 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.135 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.135 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "::", 2024-08-31T04:38:38.136 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.136 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.136 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.136 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-08-31T04:38:38.136 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.136 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.136 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.136 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.136 INFO:teuthology.orchestra.run.smithi050.stdout: "server_port": { 2024-08-31T04:38:38.136 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "server_port", 2024-08-31T04:38:38.136 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-08-31T04:38:38.136 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.136 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.136 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "9283", 2024-08-31T04:38:38.137 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.137 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.137 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.137 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-08-31T04:38:38.137 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.137 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.137 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.137 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.137 INFO:teuthology.orchestra.run.smithi050.stdout: "sqlite3_killpoint": { 2024-08-31T04:38:38.137 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "sqlite3_killpoint", 2024-08-31T04:38:38.137 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-08-31T04:38:38.137 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "dev", 2024-08-31T04:38:38.137 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.137 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "0", 2024-08-31T04:38:38.138 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.138 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.138 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.138 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.138 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.138 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.138 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.138 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.138 INFO:teuthology.orchestra.run.smithi050.stdout: "stale_cache_strategy": { 2024-08-31T04:38:38.138 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "stale_cache_strategy", 2024-08-31T04:38:38.138 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.138 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.138 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.138 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "log", 2024-08-31T04:38:38.139 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.139 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.139 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.139 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.139 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.139 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.139 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.139 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.139 INFO:teuthology.orchestra.run.smithi050.stdout: "standby_behaviour": { 2024-08-31T04:38:38.139 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "standby_behaviour", 2024-08-31T04:38:38.139 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.139 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.140 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.140 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "default", 2024-08-31T04:38:38.140 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.140 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.140 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-08-31T04:38:38.140 INFO:teuthology.orchestra.run.smithi050.stdout: "default", 2024-08-31T04:38:38.140 INFO:teuthology.orchestra.run.smithi050.stdout: "error" 2024-08-31T04:38:38.140 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-08-31T04:38:38.140 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.140 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.140 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.140 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.140 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.140 INFO:teuthology.orchestra.run.smithi050.stdout: "standby_error_status_code": { 2024-08-31T04:38:38.141 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "standby_error_status_code", 2024-08-31T04:38:38.141 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-08-31T04:38:38.141 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.141 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.141 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "500", 2024-08-31T04:38:38.141 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "400", 2024-08-31T04:38:38.141 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "599", 2024-08-31T04:38:38.141 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.141 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.141 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.141 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.141 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.141 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T04:38:38.141 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T04:38:38.142 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.142 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-08-31T04:38:38.142 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "rbd_support", 2024-08-31T04:38:38.142 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2024-08-31T04:38:38.142 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2024-08-31T04:38:38.142 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2024-08-31T04:38:38.142 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2024-08-31T04:38:38.142 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2024-08-31T04:38:38.142 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.142 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.142 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.142 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-08-31T04:38:38.142 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.142 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.142 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-08-31T04:38:38.143 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-08-31T04:38:38.143 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-08-31T04:38:38.143 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-08-31T04:38:38.143 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-08-31T04:38:38.143 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-08-31T04:38:38.143 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-08-31T04:38:38.143 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-08-31T04:38:38.143 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.143 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.143 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.143 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.143 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.143 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2024-08-31T04:38:38.143 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2024-08-31T04:38:38.144 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:38.144 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.144 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.144 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-08-31T04:38:38.144 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.144 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.144 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.144 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.144 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.144 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.144 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.144 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.144 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2024-08-31T04:38:38.145 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2024-08-31T04:38:38.145 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.145 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.145 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.145 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2024-08-31T04:38:38.145 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.145 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.145 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-08-31T04:38:38.145 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-08-31T04:38:38.145 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-08-31T04:38:38.145 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-08-31T04:38:38.145 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-08-31T04:38:38.145 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-08-31T04:38:38.145 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-08-31T04:38:38.146 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-08-31T04:38:38.146 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.146 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.146 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.146 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.146 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.146 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2024-08-31T04:38:38.146 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2024-08-31T04:38:38.146 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:38.146 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.146 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.146 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-08-31T04:38:38.146 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.146 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.147 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.147 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.147 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.147 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.147 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.147 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.147 INFO:teuthology.orchestra.run.smithi050.stdout: "max_concurrent_snap_create": { 2024-08-31T04:38:38.147 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "max_concurrent_snap_create", 2024-08-31T04:38:38.147 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-08-31T04:38:38.147 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.147 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.147 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "10", 2024-08-31T04:38:38.147 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.147 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.148 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.148 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.148 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.148 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.148 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.148 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.148 INFO:teuthology.orchestra.run.smithi050.stdout: "mirror_snapshot_schedule": { 2024-08-31T04:38:38.148 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "mirror_snapshot_schedule", 2024-08-31T04:38:38.148 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.148 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.148 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.148 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-08-31T04:38:38.148 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.148 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.149 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.149 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.149 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.149 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.149 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.149 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.149 INFO:teuthology.orchestra.run.smithi050.stdout: "sqlite3_killpoint": { 2024-08-31T04:38:38.149 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "sqlite3_killpoint", 2024-08-31T04:38:38.149 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-08-31T04:38:38.149 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "dev", 2024-08-31T04:38:38.149 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.149 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "0", 2024-08-31T04:38:38.149 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.150 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.150 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.150 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.150 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.150 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.150 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.150 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.150 INFO:teuthology.orchestra.run.smithi050.stdout: "trash_purge_schedule": { 2024-08-31T04:38:38.150 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "trash_purge_schedule", 2024-08-31T04:38:38.150 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.150 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.150 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.150 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-08-31T04:38:38.150 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.151 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.151 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.151 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.151 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.151 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.151 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.151 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T04:38:38.151 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T04:38:38.151 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.151 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-08-31T04:38:38.151 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "restful", 2024-08-31T04:38:38.151 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2024-08-31T04:38:38.151 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2024-08-31T04:38:38.151 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2024-08-31T04:38:38.151 INFO:teuthology.orchestra.run.smithi050.stdout: "enable_auth": { 2024-08-31T04:38:38.152 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "enable_auth", 2024-08-31T04:38:38.152 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:38.152 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.152 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.152 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2024-08-31T04:38:38.152 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.152 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.152 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.152 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.152 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.152 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.152 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.152 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.153 INFO:teuthology.orchestra.run.smithi050.stdout: "key_file": { 2024-08-31T04:38:38.153 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "key_file", 2024-08-31T04:38:38.153 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.153 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.153 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.153 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-08-31T04:38:38.153 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.153 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.153 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.153 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.153 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.153 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.153 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.154 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.154 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2024-08-31T04:38:38.154 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2024-08-31T04:38:38.154 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.154 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.154 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.154 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-08-31T04:38:38.154 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.154 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.154 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-08-31T04:38:38.154 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-08-31T04:38:38.154 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-08-31T04:38:38.154 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-08-31T04:38:38.155 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-08-31T04:38:38.155 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-08-31T04:38:38.155 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-08-31T04:38:38.155 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-08-31T04:38:38.155 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.155 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.155 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.155 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.155 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.155 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2024-08-31T04:38:38.155 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2024-08-31T04:38:38.155 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:38.155 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.155 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.156 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-08-31T04:38:38.156 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.156 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.156 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.156 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.156 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.156 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.156 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.156 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.156 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2024-08-31T04:38:38.156 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2024-08-31T04:38:38.156 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.156 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.157 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.157 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2024-08-31T04:38:38.157 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.157 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.157 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-08-31T04:38:38.157 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-08-31T04:38:38.157 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-08-31T04:38:38.157 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-08-31T04:38:38.157 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-08-31T04:38:38.157 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-08-31T04:38:38.157 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-08-31T04:38:38.157 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-08-31T04:38:38.157 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.157 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.158 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.158 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.158 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.158 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2024-08-31T04:38:38.158 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2024-08-31T04:38:38.158 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:38.158 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.158 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.158 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-08-31T04:38:38.158 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.158 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.158 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.158 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.159 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.159 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.159 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.159 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.159 INFO:teuthology.orchestra.run.smithi050.stdout: "max_requests": { 2024-08-31T04:38:38.159 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "max_requests", 2024-08-31T04:38:38.159 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-08-31T04:38:38.159 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.159 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.159 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "500", 2024-08-31T04:38:38.159 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.159 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.159 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.159 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.", 2024-08-31T04:38:38.160 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.160 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.160 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.160 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.160 INFO:teuthology.orchestra.run.smithi050.stdout: "server_addr": { 2024-08-31T04:38:38.160 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "server_addr", 2024-08-31T04:38:38.160 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.160 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.160 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.160 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-08-31T04:38:38.160 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.160 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.160 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.161 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.161 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.161 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.161 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.161 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.161 INFO:teuthology.orchestra.run.smithi050.stdout: "server_port": { 2024-08-31T04:38:38.161 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "server_port", 2024-08-31T04:38:38.161 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.161 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.161 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.161 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-08-31T04:38:38.161 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.161 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.161 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.162 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.162 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.162 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.162 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.162 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.162 INFO:teuthology.orchestra.run.smithi050.stdout: "sqlite3_killpoint": { 2024-08-31T04:38:38.162 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "sqlite3_killpoint", 2024-08-31T04:38:38.162 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-08-31T04:38:38.162 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "dev", 2024-08-31T04:38:38.162 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.162 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "0", 2024-08-31T04:38:38.162 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.162 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.162 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.162 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.162 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.163 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.163 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.163 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T04:38:38.163 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T04:38:38.163 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.163 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-08-31T04:38:38.163 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "rgw", 2024-08-31T04:38:38.163 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2024-08-31T04:38:38.163 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2024-08-31T04:38:38.163 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2024-08-31T04:38:38.163 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2024-08-31T04:38:38.163 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2024-08-31T04:38:38.163 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.163 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.164 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.164 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-08-31T04:38:38.164 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.164 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.164 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-08-31T04:38:38.164 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-08-31T04:38:38.164 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-08-31T04:38:38.164 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-08-31T04:38:38.164 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-08-31T04:38:38.164 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-08-31T04:38:38.164 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-08-31T04:38:38.164 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-08-31T04:38:38.164 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.164 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.165 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.165 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.165 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.165 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2024-08-31T04:38:38.165 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2024-08-31T04:38:38.165 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:38.165 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.165 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.165 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-08-31T04:38:38.165 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.165 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.165 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.165 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.165 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.166 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.166 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.166 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.166 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2024-08-31T04:38:38.166 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2024-08-31T04:38:38.166 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.166 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.166 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.166 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2024-08-31T04:38:38.166 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.166 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.166 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-08-31T04:38:38.166 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-08-31T04:38:38.166 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-08-31T04:38:38.166 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-08-31T04:38:38.167 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-08-31T04:38:38.167 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-08-31T04:38:38.167 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-08-31T04:38:38.167 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-08-31T04:38:38.167 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.167 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.167 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.167 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.167 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.167 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2024-08-31T04:38:38.167 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2024-08-31T04:38:38.167 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:38.167 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.168 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.168 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-08-31T04:38:38.168 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.168 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.168 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.168 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.168 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.168 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.168 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.168 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.168 INFO:teuthology.orchestra.run.smithi050.stdout: "secondary_zone_period_retry_limit": { 2024-08-31T04:38:38.168 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "secondary_zone_period_retry_limit", 2024-08-31T04:38:38.168 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-08-31T04:38:38.168 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.169 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.169 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "5", 2024-08-31T04:38:38.169 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.169 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.169 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.169 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "RGW module period update retry limit for secondary site", 2024-08-31T04:38:38.169 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.169 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.169 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.169 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.169 INFO:teuthology.orchestra.run.smithi050.stdout: "sqlite3_killpoint": { 2024-08-31T04:38:38.169 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "sqlite3_killpoint", 2024-08-31T04:38:38.169 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-08-31T04:38:38.169 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "dev", 2024-08-31T04:38:38.170 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.170 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "0", 2024-08-31T04:38:38.170 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.170 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.170 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.170 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.170 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.170 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.170 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.170 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T04:38:38.170 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T04:38:38.170 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.170 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-08-31T04:38:38.170 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "rook", 2024-08-31T04:38:38.171 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2024-08-31T04:38:38.171 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2024-08-31T04:38:38.171 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2024-08-31T04:38:38.171 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2024-08-31T04:38:38.171 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2024-08-31T04:38:38.171 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.171 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.171 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.171 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-08-31T04:38:38.171 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.171 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.171 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-08-31T04:38:38.171 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-08-31T04:38:38.171 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-08-31T04:38:38.171 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-08-31T04:38:38.172 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-08-31T04:38:38.172 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-08-31T04:38:38.172 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-08-31T04:38:38.172 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-08-31T04:38:38.172 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.172 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.172 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.172 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.172 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.172 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2024-08-31T04:38:38.172 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2024-08-31T04:38:38.172 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:38.172 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.172 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.173 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-08-31T04:38:38.173 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.173 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.173 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.173 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.173 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.173 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.173 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.173 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.173 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2024-08-31T04:38:38.173 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2024-08-31T04:38:38.173 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.173 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.173 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.174 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2024-08-31T04:38:38.174 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.174 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.174 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-08-31T04:38:38.174 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-08-31T04:38:38.174 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-08-31T04:38:38.174 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-08-31T04:38:38.174 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-08-31T04:38:38.174 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-08-31T04:38:38.174 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-08-31T04:38:38.174 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-08-31T04:38:38.174 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.174 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.174 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.175 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.175 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.175 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2024-08-31T04:38:38.175 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2024-08-31T04:38:38.175 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:38.175 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.175 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.175 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-08-31T04:38:38.175 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.175 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.175 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.175 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.175 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.176 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.176 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.176 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.176 INFO:teuthology.orchestra.run.smithi050.stdout: "sqlite3_killpoint": { 2024-08-31T04:38:38.176 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "sqlite3_killpoint", 2024-08-31T04:38:38.176 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-08-31T04:38:38.176 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "dev", 2024-08-31T04:38:38.176 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.176 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "0", 2024-08-31T04:38:38.176 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.176 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.176 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.176 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.176 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.176 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.177 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.177 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.177 INFO:teuthology.orchestra.run.smithi050.stdout: "storage_class": { 2024-08-31T04:38:38.177 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "storage_class", 2024-08-31T04:38:38.177 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.177 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.177 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.177 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "local", 2024-08-31T04:38:38.177 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.177 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.177 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.177 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-08-31T04:38:38.177 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.177 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.177 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.178 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T04:38:38.178 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T04:38:38.178 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.178 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-08-31T04:38:38.178 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "selftest", 2024-08-31T04:38:38.178 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2024-08-31T04:38:38.178 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2024-08-31T04:38:38.178 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2024-08-31T04:38:38.178 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2024-08-31T04:38:38.178 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2024-08-31T04:38:38.178 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.178 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.178 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.178 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-08-31T04:38:38.179 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.179 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.179 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-08-31T04:38:38.179 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-08-31T04:38:38.179 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-08-31T04:38:38.179 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-08-31T04:38:38.179 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-08-31T04:38:38.179 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-08-31T04:38:38.179 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-08-31T04:38:38.179 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-08-31T04:38:38.179 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.179 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.179 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.179 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.179 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.180 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2024-08-31T04:38:38.180 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2024-08-31T04:38:38.180 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:38.180 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.180 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.180 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-08-31T04:38:38.180 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.180 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.180 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.180 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.180 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.180 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.180 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.181 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.181 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2024-08-31T04:38:38.181 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2024-08-31T04:38:38.181 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.181 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.181 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.181 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2024-08-31T04:38:38.181 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.181 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.181 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-08-31T04:38:38.181 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-08-31T04:38:38.181 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-08-31T04:38:38.182 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-08-31T04:38:38.182 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-08-31T04:38:38.182 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-08-31T04:38:38.182 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-08-31T04:38:38.182 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-08-31T04:38:38.182 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.182 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.182 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.182 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.182 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.182 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2024-08-31T04:38:38.182 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2024-08-31T04:38:38.182 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:38.182 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.183 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.183 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-08-31T04:38:38.183 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.183 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.183 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.183 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.183 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.183 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.183 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.183 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.183 INFO:teuthology.orchestra.run.smithi050.stdout: "roption1": { 2024-08-31T04:38:38.183 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "roption1", 2024-08-31T04:38:38.184 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.184 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.184 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.184 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-08-31T04:38:38.184 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.184 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.184 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.184 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.184 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.184 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.184 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.184 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.184 INFO:teuthology.orchestra.run.smithi050.stdout: "roption2": { 2024-08-31T04:38:38.184 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "roption2", 2024-08-31T04:38:38.185 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.185 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.185 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.185 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "xyz", 2024-08-31T04:38:38.185 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.185 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.185 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.185 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.185 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.185 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.185 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.185 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.185 INFO:teuthology.orchestra.run.smithi050.stdout: "rwoption1": { 2024-08-31T04:38:38.185 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "rwoption1", 2024-08-31T04:38:38.186 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.186 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.186 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.186 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-08-31T04:38:38.186 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.186 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.186 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.186 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.186 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.186 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.186 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.186 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.186 INFO:teuthology.orchestra.run.smithi050.stdout: "rwoption2": { 2024-08-31T04:38:38.186 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "rwoption2", 2024-08-31T04:38:38.187 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-08-31T04:38:38.187 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.187 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.187 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-08-31T04:38:38.187 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.187 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.187 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.187 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.187 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.187 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.187 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.187 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.187 INFO:teuthology.orchestra.run.smithi050.stdout: "rwoption3": { 2024-08-31T04:38:38.187 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "rwoption3", 2024-08-31T04:38:38.188 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "float", 2024-08-31T04:38:38.188 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.188 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.188 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-08-31T04:38:38.188 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.188 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.188 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.188 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.188 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.188 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.188 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.188 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.188 INFO:teuthology.orchestra.run.smithi050.stdout: "rwoption4": { 2024-08-31T04:38:38.189 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "rwoption4", 2024-08-31T04:38:38.189 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.189 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.189 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.189 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-08-31T04:38:38.189 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.189 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.189 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.189 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.189 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.189 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.189 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.189 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.190 INFO:teuthology.orchestra.run.smithi050.stdout: "rwoption5": { 2024-08-31T04:38:38.190 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "rwoption5", 2024-08-31T04:38:38.190 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:38.190 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.190 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.190 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-08-31T04:38:38.190 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.190 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.190 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.190 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.190 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.190 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.190 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.191 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.191 INFO:teuthology.orchestra.run.smithi050.stdout: "rwoption6": { 2024-08-31T04:38:38.191 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "rwoption6", 2024-08-31T04:38:38.191 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:38.191 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.191 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.191 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2024-08-31T04:38:38.191 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.191 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.191 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.191 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.191 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.191 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.191 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.192 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.192 INFO:teuthology.orchestra.run.smithi050.stdout: "rwoption7": { 2024-08-31T04:38:38.192 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "rwoption7", 2024-08-31T04:38:38.192 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-08-31T04:38:38.192 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.192 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.192 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-08-31T04:38:38.192 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "1", 2024-08-31T04:38:38.192 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "42", 2024-08-31T04:38:38.192 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.192 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.192 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.192 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.192 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.193 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.193 INFO:teuthology.orchestra.run.smithi050.stdout: "sqlite3_killpoint": { 2024-08-31T04:38:38.193 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "sqlite3_killpoint", 2024-08-31T04:38:38.193 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-08-31T04:38:38.193 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "dev", 2024-08-31T04:38:38.193 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.193 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "0", 2024-08-31T04:38:38.193 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.193 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.193 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.193 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.193 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.193 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.193 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.194 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.194 INFO:teuthology.orchestra.run.smithi050.stdout: "testkey": { 2024-08-31T04:38:38.194 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "testkey", 2024-08-31T04:38:38.194 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.194 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.194 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.194 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-08-31T04:38:38.194 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.194 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.194 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.194 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.194 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.194 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.195 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.195 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.195 INFO:teuthology.orchestra.run.smithi050.stdout: "testlkey": { 2024-08-31T04:38:38.195 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "testlkey", 2024-08-31T04:38:38.195 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.195 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.195 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.195 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-08-31T04:38:38.195 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.195 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.195 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.195 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.195 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.196 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.196 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.196 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.196 INFO:teuthology.orchestra.run.smithi050.stdout: "testnewline": { 2024-08-31T04:38:38.196 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "testnewline", 2024-08-31T04:38:38.196 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.196 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.196 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.196 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-08-31T04:38:38.196 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.196 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.196 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.196 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.196 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.197 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.197 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.197 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T04:38:38.197 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T04:38:38.197 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.197 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-08-31T04:38:38.197 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "smb", 2024-08-31T04:38:38.197 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2024-08-31T04:38:38.197 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2024-08-31T04:38:38.197 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2024-08-31T04:38:38.197 INFO:teuthology.orchestra.run.smithi050.stdout: "internal_store_backend": { 2024-08-31T04:38:38.197 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "internal_store_backend", 2024-08-31T04:38:38.197 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.198 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "dev", 2024-08-31T04:38:38.198 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.198 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-08-31T04:38:38.198 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.198 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.198 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.198 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "set internal store backend. for develoment and testing only", 2024-08-31T04:38:38.198 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.198 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.198 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.198 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.198 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2024-08-31T04:38:38.198 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2024-08-31T04:38:38.199 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.199 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.199 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.199 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-08-31T04:38:38.199 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.199 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.199 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-08-31T04:38:38.199 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-08-31T04:38:38.199 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-08-31T04:38:38.199 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-08-31T04:38:38.199 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-08-31T04:38:38.199 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-08-31T04:38:38.199 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-08-31T04:38:38.199 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-08-31T04:38:38.200 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.200 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.200 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.200 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.200 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.200 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2024-08-31T04:38:38.200 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2024-08-31T04:38:38.200 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:38.200 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.200 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.200 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-08-31T04:38:38.200 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.201 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.201 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.201 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.201 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.201 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.201 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.201 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.201 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2024-08-31T04:38:38.201 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2024-08-31T04:38:38.201 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.201 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.201 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.201 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2024-08-31T04:38:38.201 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.202 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.202 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-08-31T04:38:38.202 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-08-31T04:38:38.202 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-08-31T04:38:38.202 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-08-31T04:38:38.202 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-08-31T04:38:38.202 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-08-31T04:38:38.202 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-08-31T04:38:38.202 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-08-31T04:38:38.202 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.202 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.202 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.202 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.202 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.202 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2024-08-31T04:38:38.203 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2024-08-31T04:38:38.203 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:38.203 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.203 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.203 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-08-31T04:38:38.203 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.203 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.203 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.203 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.203 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.203 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.203 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.203 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.203 INFO:teuthology.orchestra.run.smithi050.stdout: "sqlite3_killpoint": { 2024-08-31T04:38:38.204 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "sqlite3_killpoint", 2024-08-31T04:38:38.204 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-08-31T04:38:38.204 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "dev", 2024-08-31T04:38:38.204 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.204 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "0", 2024-08-31T04:38:38.204 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.204 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.204 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.204 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.204 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.204 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.204 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.204 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.204 INFO:teuthology.orchestra.run.smithi050.stdout: "update_orchestration": { 2024-08-31T04:38:38.204 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "update_orchestration", 2024-08-31T04:38:38.205 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:38.205 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.205 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.205 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2024-08-31T04:38:38.205 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.205 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.205 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.205 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "automatically update orchestration when smb resources are changed", 2024-08-31T04:38:38.205 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.205 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.205 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.205 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T04:38:38.205 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T04:38:38.205 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.206 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-08-31T04:38:38.206 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "snap_schedule", 2024-08-31T04:38:38.206 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2024-08-31T04:38:38.206 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2024-08-31T04:38:38.206 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2024-08-31T04:38:38.206 INFO:teuthology.orchestra.run.smithi050.stdout: "allow_m_granularity": { 2024-08-31T04:38:38.206 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "allow_m_granularity", 2024-08-31T04:38:38.206 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:38.206 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.206 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.206 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-08-31T04:38:38.206 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.206 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.206 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.206 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "allow minute scheduled snapshots", 2024-08-31T04:38:38.206 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.207 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.207 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.207 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.207 INFO:teuthology.orchestra.run.smithi050.stdout: "dump_on_update": { 2024-08-31T04:38:38.207 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "dump_on_update", 2024-08-31T04:38:38.207 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:38.207 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.207 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.207 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-08-31T04:38:38.207 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.207 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.207 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.207 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "dump database to debug log on update", 2024-08-31T04:38:38.207 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.207 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.208 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.208 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.208 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2024-08-31T04:38:38.208 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2024-08-31T04:38:38.208 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.208 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.208 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.208 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-08-31T04:38:38.208 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.208 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.208 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-08-31T04:38:38.208 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-08-31T04:38:38.208 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-08-31T04:38:38.208 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-08-31T04:38:38.208 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-08-31T04:38:38.209 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-08-31T04:38:38.209 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-08-31T04:38:38.209 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-08-31T04:38:38.209 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.209 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.209 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.209 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.209 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.209 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2024-08-31T04:38:38.209 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2024-08-31T04:38:38.209 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:38.209 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.209 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.210 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-08-31T04:38:38.210 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.210 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.210 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.210 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.210 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.210 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.210 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.210 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.210 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2024-08-31T04:38:38.210 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2024-08-31T04:38:38.210 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.210 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.211 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.211 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2024-08-31T04:38:38.211 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.211 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.211 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-08-31T04:38:38.211 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-08-31T04:38:38.211 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-08-31T04:38:38.211 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-08-31T04:38:38.211 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-08-31T04:38:38.211 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-08-31T04:38:38.211 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-08-31T04:38:38.211 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-08-31T04:38:38.211 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.212 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.212 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.212 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.212 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.212 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2024-08-31T04:38:38.212 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2024-08-31T04:38:38.212 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:38.212 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.212 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.212 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-08-31T04:38:38.212 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.212 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.212 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.213 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.213 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.213 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.213 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.213 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.213 INFO:teuthology.orchestra.run.smithi050.stdout: "sqlite3_killpoint": { 2024-08-31T04:38:38.213 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "sqlite3_killpoint", 2024-08-31T04:38:38.213 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-08-31T04:38:38.213 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "dev", 2024-08-31T04:38:38.213 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.213 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "0", 2024-08-31T04:38:38.213 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.213 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.213 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.214 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.214 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.214 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.214 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.214 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T04:38:38.214 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T04:38:38.214 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.214 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-08-31T04:38:38.214 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "stats", 2024-08-31T04:38:38.214 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2024-08-31T04:38:38.214 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2024-08-31T04:38:38.214 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2024-08-31T04:38:38.214 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2024-08-31T04:38:38.215 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2024-08-31T04:38:38.215 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.215 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.215 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.215 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-08-31T04:38:38.215 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.215 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.215 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-08-31T04:38:38.215 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-08-31T04:38:38.215 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-08-31T04:38:38.215 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-08-31T04:38:38.215 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-08-31T04:38:38.215 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-08-31T04:38:38.215 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-08-31T04:38:38.216 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-08-31T04:38:38.216 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.216 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.216 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.216 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.216 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.216 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2024-08-31T04:38:38.216 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2024-08-31T04:38:38.216 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:38.216 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.216 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.216 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-08-31T04:38:38.216 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.217 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.217 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.217 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.217 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.217 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.217 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.217 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.217 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2024-08-31T04:38:38.217 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2024-08-31T04:38:38.217 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.217 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.217 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.217 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2024-08-31T04:38:38.217 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.218 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.218 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-08-31T04:38:38.218 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-08-31T04:38:38.218 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-08-31T04:38:38.218 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-08-31T04:38:38.218 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-08-31T04:38:38.218 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-08-31T04:38:38.218 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-08-31T04:38:38.218 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-08-31T04:38:38.218 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.218 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.218 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.218 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.219 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.219 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2024-08-31T04:38:38.219 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2024-08-31T04:38:38.219 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:38.219 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.219 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.219 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-08-31T04:38:38.219 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.219 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.219 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.219 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.219 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.219 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.219 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.220 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.220 INFO:teuthology.orchestra.run.smithi050.stdout: "sqlite3_killpoint": { 2024-08-31T04:38:38.220 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "sqlite3_killpoint", 2024-08-31T04:38:38.220 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-08-31T04:38:38.220 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "dev", 2024-08-31T04:38:38.220 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.220 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "0", 2024-08-31T04:38:38.220 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.220 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.220 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.220 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.220 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.220 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.221 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.221 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T04:38:38.221 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T04:38:38.221 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.221 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-08-31T04:38:38.221 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "status", 2024-08-31T04:38:38.221 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2024-08-31T04:38:38.221 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2024-08-31T04:38:38.221 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2024-08-31T04:38:38.221 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2024-08-31T04:38:38.221 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2024-08-31T04:38:38.221 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.221 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.221 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.222 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-08-31T04:38:38.222 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.222 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.222 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-08-31T04:38:38.222 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-08-31T04:38:38.222 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-08-31T04:38:38.222 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-08-31T04:38:38.222 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-08-31T04:38:38.222 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-08-31T04:38:38.222 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-08-31T04:38:38.222 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-08-31T04:38:38.222 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.222 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.222 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.222 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.223 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.223 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2024-08-31T04:38:38.223 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2024-08-31T04:38:38.223 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:38.223 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.223 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.223 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-08-31T04:38:38.223 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.223 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.223 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.223 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.223 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.223 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.224 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.224 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.224 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2024-08-31T04:38:38.224 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2024-08-31T04:38:38.224 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.224 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.224 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.224 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2024-08-31T04:38:38.224 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.224 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.224 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-08-31T04:38:38.224 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-08-31T04:38:38.224 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-08-31T04:38:38.225 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-08-31T04:38:38.225 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-08-31T04:38:38.225 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-08-31T04:38:38.225 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-08-31T04:38:38.225 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-08-31T04:38:38.225 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.225 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.225 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.225 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.225 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.225 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2024-08-31T04:38:38.225 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2024-08-31T04:38:38.225 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:38.226 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.226 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.226 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-08-31T04:38:38.226 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.226 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.226 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.226 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.226 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.226 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.226 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.226 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.226 INFO:teuthology.orchestra.run.smithi050.stdout: "sqlite3_killpoint": { 2024-08-31T04:38:38.226 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "sqlite3_killpoint", 2024-08-31T04:38:38.226 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-08-31T04:38:38.227 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "dev", 2024-08-31T04:38:38.227 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.227 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "0", 2024-08-31T04:38:38.227 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.227 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.227 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.227 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.227 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.227 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.227 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.227 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T04:38:38.227 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T04:38:38.227 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.228 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-08-31T04:38:38.228 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "telegraf", 2024-08-31T04:38:38.228 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2024-08-31T04:38:38.228 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2024-08-31T04:38:38.228 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2024-08-31T04:38:38.228 INFO:teuthology.orchestra.run.smithi050.stdout: "address": { 2024-08-31T04:38:38.228 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "address", 2024-08-31T04:38:38.228 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.228 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.228 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.228 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-08-31T04:38:38.228 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.228 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.228 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.229 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.229 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.229 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.229 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.229 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.229 INFO:teuthology.orchestra.run.smithi050.stdout: "interval": { 2024-08-31T04:38:38.229 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "interval", 2024-08-31T04:38:38.229 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "secs", 2024-08-31T04:38:38.229 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.229 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.229 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "15", 2024-08-31T04:38:38.229 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.229 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.229 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.230 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.230 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.230 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.230 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.230 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.230 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2024-08-31T04:38:38.230 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2024-08-31T04:38:38.230 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.230 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.230 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.230 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-08-31T04:38:38.230 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.230 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.230 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-08-31T04:38:38.231 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-08-31T04:38:38.231 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-08-31T04:38:38.231 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-08-31T04:38:38.231 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-08-31T04:38:38.231 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-08-31T04:38:38.231 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-08-31T04:38:38.231 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-08-31T04:38:38.231 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.231 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.231 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.231 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.231 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.231 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2024-08-31T04:38:38.231 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2024-08-31T04:38:38.232 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:38.232 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.232 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.232 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-08-31T04:38:38.232 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.232 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.232 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.232 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.232 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.232 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.232 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.232 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.232 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2024-08-31T04:38:38.232 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2024-08-31T04:38:38.232 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.233 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.233 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.233 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2024-08-31T04:38:38.233 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.233 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.233 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-08-31T04:38:38.233 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-08-31T04:38:38.233 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-08-31T04:38:38.233 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-08-31T04:38:38.233 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-08-31T04:38:38.233 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-08-31T04:38:38.233 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-08-31T04:38:38.233 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-08-31T04:38:38.234 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.234 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.234 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.234 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.234 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.234 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2024-08-31T04:38:38.234 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2024-08-31T04:38:38.234 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:38.234 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.234 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.234 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-08-31T04:38:38.234 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.234 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.234 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.234 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.235 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.235 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.235 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.235 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.235 INFO:teuthology.orchestra.run.smithi050.stdout: "sqlite3_killpoint": { 2024-08-31T04:38:38.235 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "sqlite3_killpoint", 2024-08-31T04:38:38.235 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-08-31T04:38:38.235 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "dev", 2024-08-31T04:38:38.235 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.235 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "0", 2024-08-31T04:38:38.235 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.235 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.235 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.235 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.235 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.236 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.236 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.236 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T04:38:38.236 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T04:38:38.236 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.236 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-08-31T04:38:38.236 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "telemetry", 2024-08-31T04:38:38.236 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2024-08-31T04:38:38.236 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2024-08-31T04:38:38.236 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2024-08-31T04:38:38.236 INFO:teuthology.orchestra.run.smithi050.stdout: "channel_basic": { 2024-08-31T04:38:38.236 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "channel_basic", 2024-08-31T04:38:38.236 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:38.236 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.237 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.237 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2024-08-31T04:38:38.237 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.237 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.237 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.237 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Share basic cluster information (size, version)", 2024-08-31T04:38:38.237 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.237 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.237 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.237 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.237 INFO:teuthology.orchestra.run.smithi050.stdout: "channel_crash": { 2024-08-31T04:38:38.237 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "channel_crash", 2024-08-31T04:38:38.237 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:38.238 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.238 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.238 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2024-08-31T04:38:38.238 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.238 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.238 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.238 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-08-31T04:38:38.238 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.238 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.238 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.238 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.238 INFO:teuthology.orchestra.run.smithi050.stdout: "channel_device": { 2024-08-31T04:38:38.238 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "channel_device", 2024-08-31T04:38:38.238 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:38.238 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.239 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.239 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2024-08-31T04:38:38.239 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.239 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.239 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.239 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-08-31T04:38:38.239 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.239 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.239 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.239 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.239 INFO:teuthology.orchestra.run.smithi050.stdout: "channel_ident": { 2024-08-31T04:38:38.239 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "channel_ident", 2024-08-31T04:38:38.239 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:38.239 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.240 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.240 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-08-31T04:38:38.240 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.240 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.240 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.240 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-08-31T04:38:38.240 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.240 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.240 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.240 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.240 INFO:teuthology.orchestra.run.smithi050.stdout: "channel_perf": { 2024-08-31T04:38:38.240 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "channel_perf", 2024-08-31T04:38:38.240 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:38.241 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.241 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.241 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-08-31T04:38:38.241 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.241 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.241 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.241 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Share various performance metrics of a cluster", 2024-08-31T04:38:38.241 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.241 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.241 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.241 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.241 INFO:teuthology.orchestra.run.smithi050.stdout: "contact": { 2024-08-31T04:38:38.241 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "contact", 2024-08-31T04:38:38.242 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.242 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.242 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.242 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-08-31T04:38:38.242 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.242 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.242 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.242 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.242 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.242 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.242 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.242 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.242 INFO:teuthology.orchestra.run.smithi050.stdout: "description": { 2024-08-31T04:38:38.242 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "description", 2024-08-31T04:38:38.243 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.243 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.243 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.243 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-08-31T04:38:38.243 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.243 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.243 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.243 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.243 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.243 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.243 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.243 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.243 INFO:teuthology.orchestra.run.smithi050.stdout: "device_url": { 2024-08-31T04:38:38.244 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "device_url", 2024-08-31T04:38:38.244 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.244 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.244 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.244 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-08-31T04:38:38.244 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.244 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.244 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.244 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.244 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.244 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.244 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.244 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.244 INFO:teuthology.orchestra.run.smithi050.stdout: "enabled": { 2024-08-31T04:38:38.245 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "enabled", 2024-08-31T04:38:38.245 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:38.245 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.245 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.245 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-08-31T04:38:38.245 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.245 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.245 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.245 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.245 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.245 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.245 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.245 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.246 INFO:teuthology.orchestra.run.smithi050.stdout: "interval": { 2024-08-31T04:38:38.246 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "interval", 2024-08-31T04:38:38.246 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-08-31T04:38:38.246 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.246 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.246 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "24", 2024-08-31T04:38:38.246 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "8", 2024-08-31T04:38:38.246 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.246 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.246 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.246 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.246 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.246 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.246 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.246 INFO:teuthology.orchestra.run.smithi050.stdout: "last_opt_revision": { 2024-08-31T04:38:38.247 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "last_opt_revision", 2024-08-31T04:38:38.247 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-08-31T04:38:38.247 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.247 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.247 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "1", 2024-08-31T04:38:38.247 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.247 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.247 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.247 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.247 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.247 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.247 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.247 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.248 INFO:teuthology.orchestra.run.smithi050.stdout: "leaderboard": { 2024-08-31T04:38:38.248 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "leaderboard", 2024-08-31T04:38:38.248 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:38.248 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.248 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.248 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-08-31T04:38:38.248 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.248 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.248 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.248 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.248 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.248 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.248 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.248 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.249 INFO:teuthology.orchestra.run.smithi050.stdout: "leaderboard_description": { 2024-08-31T04:38:38.249 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "leaderboard_description", 2024-08-31T04:38:38.249 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.249 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.249 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.249 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-08-31T04:38:38.249 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.249 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.249 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.249 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.249 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.249 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.249 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.250 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.250 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2024-08-31T04:38:38.250 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2024-08-31T04:38:38.250 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.250 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.250 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.250 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-08-31T04:38:38.250 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.250 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.250 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-08-31T04:38:38.250 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-08-31T04:38:38.250 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-08-31T04:38:38.250 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-08-31T04:38:38.250 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-08-31T04:38:38.251 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-08-31T04:38:38.251 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-08-31T04:38:38.251 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-08-31T04:38:38.251 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.251 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.251 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.251 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.251 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.251 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2024-08-31T04:38:38.251 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2024-08-31T04:38:38.251 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:38.251 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.251 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.251 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-08-31T04:38:38.252 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.252 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.252 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.252 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.252 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.252 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.252 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.252 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.252 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2024-08-31T04:38:38.252 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2024-08-31T04:38:38.252 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.252 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.252 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.253 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2024-08-31T04:38:38.253 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.253 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.253 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-08-31T04:38:38.253 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-08-31T04:38:38.253 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-08-31T04:38:38.253 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-08-31T04:38:38.253 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-08-31T04:38:38.253 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-08-31T04:38:38.253 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-08-31T04:38:38.253 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-08-31T04:38:38.253 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.253 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.253 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.254 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.254 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.254 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2024-08-31T04:38:38.254 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2024-08-31T04:38:38.254 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:38.254 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.254 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.254 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-08-31T04:38:38.254 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.254 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.254 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.254 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.254 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.254 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.255 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.255 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.255 INFO:teuthology.orchestra.run.smithi050.stdout: "organization": { 2024-08-31T04:38:38.255 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "organization", 2024-08-31T04:38:38.255 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.255 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.255 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.255 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-08-31T04:38:38.255 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.255 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.255 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.255 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.255 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.255 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.256 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.256 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.256 INFO:teuthology.orchestra.run.smithi050.stdout: "proxy": { 2024-08-31T04:38:38.256 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "proxy", 2024-08-31T04:38:38.256 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.256 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.256 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.256 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-08-31T04:38:38.256 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.256 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.256 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.256 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.256 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.257 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.257 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.257 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.257 INFO:teuthology.orchestra.run.smithi050.stdout: "sqlite3_killpoint": { 2024-08-31T04:38:38.257 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "sqlite3_killpoint", 2024-08-31T04:38:38.257 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-08-31T04:38:38.257 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "dev", 2024-08-31T04:38:38.257 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.257 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "0", 2024-08-31T04:38:38.257 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.257 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.257 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.257 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.258 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.258 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.258 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.258 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.258 INFO:teuthology.orchestra.run.smithi050.stdout: "url": { 2024-08-31T04:38:38.258 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "url", 2024-08-31T04:38:38.258 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.258 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.258 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.258 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-08-31T04:38:38.258 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.258 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.258 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.259 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.259 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.259 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.259 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.259 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T04:38:38.259 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T04:38:38.259 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.259 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-08-31T04:38:38.259 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "test_orchestrator", 2024-08-31T04:38:38.259 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2024-08-31T04:38:38.259 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2024-08-31T04:38:38.259 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2024-08-31T04:38:38.259 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2024-08-31T04:38:38.259 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2024-08-31T04:38:38.260 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.260 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.260 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.260 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-08-31T04:38:38.260 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.260 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.260 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-08-31T04:38:38.260 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-08-31T04:38:38.260 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-08-31T04:38:38.260 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-08-31T04:38:38.260 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-08-31T04:38:38.260 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-08-31T04:38:38.260 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-08-31T04:38:38.261 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-08-31T04:38:38.261 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.261 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.261 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.261 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.261 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.261 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2024-08-31T04:38:38.261 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2024-08-31T04:38:38.261 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:38.261 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.261 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.261 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-08-31T04:38:38.261 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.261 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.262 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.262 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.262 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.262 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.262 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.262 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.262 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2024-08-31T04:38:38.262 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2024-08-31T04:38:38.262 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.262 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.262 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.262 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2024-08-31T04:38:38.262 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.262 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.263 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-08-31T04:38:38.263 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-08-31T04:38:38.263 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-08-31T04:38:38.263 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-08-31T04:38:38.263 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-08-31T04:38:38.263 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-08-31T04:38:38.263 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-08-31T04:38:38.263 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-08-31T04:38:38.263 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.263 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.263 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.263 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.263 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.264 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2024-08-31T04:38:38.264 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2024-08-31T04:38:38.264 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:38.264 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.264 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.264 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-08-31T04:38:38.264 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.264 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.264 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.264 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.264 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.264 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.264 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.264 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.265 INFO:teuthology.orchestra.run.smithi050.stdout: "sqlite3_killpoint": { 2024-08-31T04:38:38.265 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "sqlite3_killpoint", 2024-08-31T04:38:38.265 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-08-31T04:38:38.265 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "dev", 2024-08-31T04:38:38.265 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.265 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "0", 2024-08-31T04:38:38.265 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.265 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.265 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.265 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.265 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.265 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.265 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.266 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T04:38:38.266 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T04:38:38.266 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.266 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-08-31T04:38:38.266 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "volumes", 2024-08-31T04:38:38.266 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2024-08-31T04:38:38.266 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2024-08-31T04:38:38.266 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2024-08-31T04:38:38.266 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2024-08-31T04:38:38.266 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2024-08-31T04:38:38.266 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.266 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.266 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.267 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-08-31T04:38:38.267 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.267 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.267 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-08-31T04:38:38.267 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-08-31T04:38:38.267 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-08-31T04:38:38.267 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-08-31T04:38:38.267 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-08-31T04:38:38.267 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-08-31T04:38:38.267 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-08-31T04:38:38.267 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-08-31T04:38:38.267 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.267 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.267 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.268 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.268 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.268 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2024-08-31T04:38:38.268 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2024-08-31T04:38:38.268 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:38.268 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.268 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.268 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-08-31T04:38:38.268 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.268 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.268 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.268 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.268 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.269 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.269 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.269 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.269 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2024-08-31T04:38:38.269 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2024-08-31T04:38:38.269 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.269 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.269 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.269 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2024-08-31T04:38:38.269 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.269 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.269 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-08-31T04:38:38.269 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-08-31T04:38:38.270 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-08-31T04:38:38.270 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-08-31T04:38:38.270 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-08-31T04:38:38.270 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-08-31T04:38:38.270 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-08-31T04:38:38.270 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-08-31T04:38:38.270 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.270 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.270 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.270 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.270 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.270 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2024-08-31T04:38:38.270 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2024-08-31T04:38:38.270 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:38.271 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.271 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.271 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-08-31T04:38:38.271 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.271 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.271 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.271 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.271 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.271 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.271 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.271 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.271 INFO:teuthology.orchestra.run.smithi050.stdout: "max_concurrent_clones": { 2024-08-31T04:38:38.271 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "max_concurrent_clones", 2024-08-31T04:38:38.272 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-08-31T04:38:38.272 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.272 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.272 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "4", 2024-08-31T04:38:38.272 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.272 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.272 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.272 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Number of asynchronous cloner threads", 2024-08-31T04:38:38.272 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.272 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.272 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.272 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.272 INFO:teuthology.orchestra.run.smithi050.stdout: "periodic_async_work": { 2024-08-31T04:38:38.272 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "periodic_async_work", 2024-08-31T04:38:38.273 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:38.273 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.273 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.273 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-08-31T04:38:38.273 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.273 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.273 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.273 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Periodically check for async work", 2024-08-31T04:38:38.273 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.273 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.273 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.273 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.273 INFO:teuthology.orchestra.run.smithi050.stdout: "snapshot_clone_delay": { 2024-08-31T04:38:38.274 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "snapshot_clone_delay", 2024-08-31T04:38:38.274 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-08-31T04:38:38.274 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.274 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.274 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "0", 2024-08-31T04:38:38.274 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.274 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.274 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.274 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-08-31T04:38:38.274 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.274 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.274 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.274 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.274 INFO:teuthology.orchestra.run.smithi050.stdout: "snapshot_clone_no_wait": { 2024-08-31T04:38:38.275 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "snapshot_clone_no_wait", 2024-08-31T04:38:38.275 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:38.275 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.275 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.275 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2024-08-31T04:38:38.275 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.275 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.275 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.275 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-08-31T04:38:38.275 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.275 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.275 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.275 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.275 INFO:teuthology.orchestra.run.smithi050.stdout: "sqlite3_killpoint": { 2024-08-31T04:38:38.276 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "sqlite3_killpoint", 2024-08-31T04:38:38.276 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-08-31T04:38:38.276 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "dev", 2024-08-31T04:38:38.276 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.276 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "0", 2024-08-31T04:38:38.276 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.276 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.276 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.276 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.276 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.276 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.276 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.276 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T04:38:38.277 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T04:38:38.277 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.277 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-08-31T04:38:38.277 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "zabbix", 2024-08-31T04:38:38.277 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2024-08-31T04:38:38.277 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2024-08-31T04:38:38.277 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2024-08-31T04:38:38.277 INFO:teuthology.orchestra.run.smithi050.stdout: "discovery_interval": { 2024-08-31T04:38:38.277 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "discovery_interval", 2024-08-31T04:38:38.277 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "uint", 2024-08-31T04:38:38.277 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.277 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.277 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "100", 2024-08-31T04:38:38.278 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.278 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.278 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.278 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.278 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.278 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.278 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.278 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.278 INFO:teuthology.orchestra.run.smithi050.stdout: "identifier": { 2024-08-31T04:38:38.278 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "identifier", 2024-08-31T04:38:38.278 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.278 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.278 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.278 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-08-31T04:38:38.279 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.279 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.279 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.279 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.279 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.279 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.279 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.279 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.279 INFO:teuthology.orchestra.run.smithi050.stdout: "interval": { 2024-08-31T04:38:38.279 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "interval", 2024-08-31T04:38:38.279 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "secs", 2024-08-31T04:38:38.279 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.279 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.280 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "60", 2024-08-31T04:38:38.280 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.280 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.280 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.280 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.280 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.280 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.280 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.280 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.280 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2024-08-31T04:38:38.280 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2024-08-31T04:38:38.280 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.280 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.281 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.281 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-08-31T04:38:38.281 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.281 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.281 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-08-31T04:38:38.281 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-08-31T04:38:38.281 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-08-31T04:38:38.281 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-08-31T04:38:38.281 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-08-31T04:38:38.281 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-08-31T04:38:38.281 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-08-31T04:38:38.281 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-08-31T04:38:38.281 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.281 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.282 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.282 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.282 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.282 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2024-08-31T04:38:38.282 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2024-08-31T04:38:38.282 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:38.282 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.282 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.282 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-08-31T04:38:38.282 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.282 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.282 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.282 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.282 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.283 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.283 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.283 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.283 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2024-08-31T04:38:38.283 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2024-08-31T04:38:38.283 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.283 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.283 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.283 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2024-08-31T04:38:38.283 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.283 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.283 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-08-31T04:38:38.283 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-08-31T04:38:38.283 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-08-31T04:38:38.284 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-08-31T04:38:38.284 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-08-31T04:38:38.284 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-08-31T04:38:38.284 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-08-31T04:38:38.284 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-08-31T04:38:38.284 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.284 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.284 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.284 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.284 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.284 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2024-08-31T04:38:38.284 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2024-08-31T04:38:38.284 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:38.285 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.285 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.285 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-08-31T04:38:38.285 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.285 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.285 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.285 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.285 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.285 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.285 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.285 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.285 INFO:teuthology.orchestra.run.smithi050.stdout: "sqlite3_killpoint": { 2024-08-31T04:38:38.285 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "sqlite3_killpoint", 2024-08-31T04:38:38.286 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-08-31T04:38:38.286 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "dev", 2024-08-31T04:38:38.286 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.286 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "0", 2024-08-31T04:38:38.286 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.286 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.286 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.286 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.286 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.286 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.286 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.286 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.286 INFO:teuthology.orchestra.run.smithi050.stdout: "zabbix_host": { 2024-08-31T04:38:38.287 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "zabbix_host", 2024-08-31T04:38:38.287 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.287 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.287 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.287 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-08-31T04:38:38.287 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.287 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.287 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.287 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.287 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.287 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.287 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.287 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.287 INFO:teuthology.orchestra.run.smithi050.stdout: "zabbix_port": { 2024-08-31T04:38:38.288 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "zabbix_port", 2024-08-31T04:38:38.288 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-08-31T04:38:38.288 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.288 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.288 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "10051", 2024-08-31T04:38:38.288 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.288 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.288 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.288 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.288 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.288 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.288 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.288 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.289 INFO:teuthology.orchestra.run.smithi050.stdout: "zabbix_sender": { 2024-08-31T04:38:38.289 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "zabbix_sender", 2024-08-31T04:38:38.289 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.289 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.289 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.289 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-08-31T04:38:38.289 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.289 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.289 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.289 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.289 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.289 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.289 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.289 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T04:38:38.290 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T04:38:38.290 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T04:38:38.290 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-08-31T04:38:38.290 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.290 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-08-31T04:38:38.290 INFO:teuthology.orchestra.run.smithi050.stdout: "gid": 24167, 2024-08-31T04:38:38.290 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "y", 2024-08-31T04:38:38.290 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr_features": 4540701547738038271, 2024-08-31T04:38:38.290 INFO:teuthology.orchestra.run.smithi050.stdout: "available_modules": [ 2024-08-31T04:38:38.290 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-08-31T04:38:38.290 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "alerts", 2024-08-31T04:38:38.290 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2024-08-31T04:38:38.290 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2024-08-31T04:38:38.291 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2024-08-31T04:38:38.291 INFO:teuthology.orchestra.run.smithi050.stdout: "interval": { 2024-08-31T04:38:38.291 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "interval", 2024-08-31T04:38:38.291 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "secs", 2024-08-31T04:38:38.291 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.291 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.291 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "60", 2024-08-31T04:38:38.291 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.291 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.291 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.291 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "How frequently to reexamine health status", 2024-08-31T04:38:38.291 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.291 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.291 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.292 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.292 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2024-08-31T04:38:38.292 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2024-08-31T04:38:38.292 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.292 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.292 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.292 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-08-31T04:38:38.292 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.292 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.292 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-08-31T04:38:38.292 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-08-31T04:38:38.292 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-08-31T04:38:38.293 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-08-31T04:38:38.293 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-08-31T04:38:38.293 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-08-31T04:38:38.293 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-08-31T04:38:38.293 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-08-31T04:38:38.293 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.293 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.293 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.293 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.293 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.293 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2024-08-31T04:38:38.293 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2024-08-31T04:38:38.293 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:38.293 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.294 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.294 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-08-31T04:38:38.294 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.294 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.294 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.294 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.294 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.294 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.294 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.294 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.294 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2024-08-31T04:38:38.294 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2024-08-31T04:38:38.294 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.295 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.295 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.295 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2024-08-31T04:38:38.295 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.295 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.295 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-08-31T04:38:38.295 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-08-31T04:38:38.295 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-08-31T04:38:38.295 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-08-31T04:38:38.295 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-08-31T04:38:38.295 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-08-31T04:38:38.295 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-08-31T04:38:38.295 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-08-31T04:38:38.295 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.296 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.296 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.296 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.296 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.296 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2024-08-31T04:38:38.296 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2024-08-31T04:38:38.296 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:38.296 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.296 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.296 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-08-31T04:38:38.296 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.296 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.296 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.296 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.296 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.297 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.297 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.297 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.297 INFO:teuthology.orchestra.run.smithi050.stdout: "smtp_destination": { 2024-08-31T04:38:38.297 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "smtp_destination", 2024-08-31T04:38:38.297 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.297 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.297 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.297 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-08-31T04:38:38.297 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.297 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.297 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.297 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Email address to send alerts to", 2024-08-31T04:38:38.298 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.298 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.298 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.298 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.298 INFO:teuthology.orchestra.run.smithi050.stdout: "smtp_from_name": { 2024-08-31T04:38:38.298 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "smtp_from_name", 2024-08-31T04:38:38.298 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.298 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.298 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.298 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "Ceph", 2024-08-31T04:38:38.298 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.298 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.298 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.298 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Email From: name", 2024-08-31T04:38:38.299 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.299 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.299 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.299 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.299 INFO:teuthology.orchestra.run.smithi050.stdout: "smtp_host": { 2024-08-31T04:38:38.299 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "smtp_host", 2024-08-31T04:38:38.299 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.299 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.299 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.299 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-08-31T04:38:38.299 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.299 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.299 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.299 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "SMTP server", 2024-08-31T04:38:38.300 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.300 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.300 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.300 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.300 INFO:teuthology.orchestra.run.smithi050.stdout: "smtp_password": { 2024-08-31T04:38:38.300 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "smtp_password", 2024-08-31T04:38:38.300 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.300 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.300 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.300 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-08-31T04:38:38.300 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.300 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.300 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.301 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Password to authenticate with", 2024-08-31T04:38:38.301 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.301 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.301 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.301 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.301 INFO:teuthology.orchestra.run.smithi050.stdout: "smtp_port": { 2024-08-31T04:38:38.301 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "smtp_port", 2024-08-31T04:38:38.301 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-08-31T04:38:38.301 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.301 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.301 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "465", 2024-08-31T04:38:38.301 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.301 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.301 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.302 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "SMTP port", 2024-08-31T04:38:38.302 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.302 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.302 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.302 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.302 INFO:teuthology.orchestra.run.smithi050.stdout: "smtp_sender": { 2024-08-31T04:38:38.302 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "smtp_sender", 2024-08-31T04:38:38.302 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.302 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.302 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.302 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-08-31T04:38:38.302 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.302 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.302 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.302 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "SMTP envelope sender", 2024-08-31T04:38:38.303 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.303 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.303 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.303 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.303 INFO:teuthology.orchestra.run.smithi050.stdout: "smtp_ssl": { 2024-08-31T04:38:38.303 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "smtp_ssl", 2024-08-31T04:38:38.303 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:38.303 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.303 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.303 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2024-08-31T04:38:38.303 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.303 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.303 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.303 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Use SSL to connect to SMTP server", 2024-08-31T04:38:38.304 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.304 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.304 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.304 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.304 INFO:teuthology.orchestra.run.smithi050.stdout: "smtp_user": { 2024-08-31T04:38:38.304 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "smtp_user", 2024-08-31T04:38:38.304 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.304 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.304 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.304 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-08-31T04:38:38.304 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.304 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.304 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.305 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "User to authenticate as", 2024-08-31T04:38:38.305 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.305 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.305 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.305 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.305 INFO:teuthology.orchestra.run.smithi050.stdout: "sqlite3_killpoint": { 2024-08-31T04:38:38.305 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "sqlite3_killpoint", 2024-08-31T04:38:38.305 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-08-31T04:38:38.305 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "dev", 2024-08-31T04:38:38.305 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.305 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "0", 2024-08-31T04:38:38.305 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.305 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.305 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.306 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.306 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.306 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.306 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.306 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T04:38:38.306 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T04:38:38.306 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.306 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-08-31T04:38:38.306 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "balancer", 2024-08-31T04:38:38.306 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2024-08-31T04:38:38.306 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2024-08-31T04:38:38.306 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2024-08-31T04:38:38.306 INFO:teuthology.orchestra.run.smithi050.stdout: "active": { 2024-08-31T04:38:38.306 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "active", 2024-08-31T04:38:38.306 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:38.306 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.307 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.307 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2024-08-31T04:38:38.307 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.307 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.307 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.307 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "automatically balance PGs across cluster", 2024-08-31T04:38:38.307 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.307 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.307 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.307 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.307 INFO:teuthology.orchestra.run.smithi050.stdout: "begin_time": { 2024-08-31T04:38:38.307 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "begin_time", 2024-08-31T04:38:38.307 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.307 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.307 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.308 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "0000", 2024-08-31T04:38:38.308 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.308 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.308 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.308 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "beginning time of day to automatically balance", 2024-08-31T04:38:38.308 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-08-31T04:38:38.308 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.308 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.308 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.308 INFO:teuthology.orchestra.run.smithi050.stdout: "begin_weekday": { 2024-08-31T04:38:38.308 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "begin_weekday", 2024-08-31T04:38:38.308 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "uint", 2024-08-31T04:38:38.308 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.309 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.309 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "0", 2024-08-31T04:38:38.309 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "0", 2024-08-31T04:38:38.309 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "6", 2024-08-31T04:38:38.309 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.309 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-08-31T04:38:38.309 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-08-31T04:38:38.309 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.309 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.309 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.309 INFO:teuthology.orchestra.run.smithi050.stdout: "crush_compat_max_iterations": { 2024-08-31T04:38:38.309 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "crush_compat_max_iterations", 2024-08-31T04:38:38.309 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "uint", 2024-08-31T04:38:38.310 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.310 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.310 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "25", 2024-08-31T04:38:38.310 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "1", 2024-08-31T04:38:38.310 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "250", 2024-08-31T04:38:38.310 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.310 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-08-31T04:38:38.310 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.310 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.310 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.310 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.310 INFO:teuthology.orchestra.run.smithi050.stdout: "crush_compat_metrics": { 2024-08-31T04:38:38.310 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "crush_compat_metrics", 2024-08-31T04:38:38.311 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.311 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.311 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.311 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "pgs,objects,bytes", 2024-08-31T04:38:38.311 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.311 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.311 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.311 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-08-31T04:38:38.311 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-08-31T04:38:38.311 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.311 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.311 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.311 INFO:teuthology.orchestra.run.smithi050.stdout: "crush_compat_step": { 2024-08-31T04:38:38.311 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "crush_compat_step", 2024-08-31T04:38:38.312 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "float", 2024-08-31T04:38:38.312 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.312 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.312 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "0.5", 2024-08-31T04:38:38.312 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "0.001", 2024-08-31T04:38:38.312 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "0.999", 2024-08-31T04:38:38.312 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.312 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "aggressiveness of optimization", 2024-08-31T04:38:38.312 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-08-31T04:38:38.312 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.312 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.312 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.312 INFO:teuthology.orchestra.run.smithi050.stdout: "end_time": { 2024-08-31T04:38:38.313 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "end_time", 2024-08-31T04:38:38.313 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.313 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.313 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.313 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "2359", 2024-08-31T04:38:38.313 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.313 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.313 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.313 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "ending time of day to automatically balance", 2024-08-31T04:38:38.313 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-08-31T04:38:38.313 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.313 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.313 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.314 INFO:teuthology.orchestra.run.smithi050.stdout: "end_weekday": { 2024-08-31T04:38:38.314 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "end_weekday", 2024-08-31T04:38:38.314 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "uint", 2024-08-31T04:38:38.314 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.314 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.314 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "0", 2024-08-31T04:38:38.314 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "0", 2024-08-31T04:38:38.314 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "6", 2024-08-31T04:38:38.314 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.314 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-08-31T04:38:38.314 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-08-31T04:38:38.314 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.314 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.314 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.315 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2024-08-31T04:38:38.315 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2024-08-31T04:38:38.315 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.315 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.315 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.315 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-08-31T04:38:38.315 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.315 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.315 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-08-31T04:38:38.315 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-08-31T04:38:38.315 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-08-31T04:38:38.315 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-08-31T04:38:38.315 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-08-31T04:38:38.315 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-08-31T04:38:38.316 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-08-31T04:38:38.316 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-08-31T04:38:38.316 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.316 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.316 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.316 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.316 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.316 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2024-08-31T04:38:38.316 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2024-08-31T04:38:38.316 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:38.316 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.316 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.316 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-08-31T04:38:38.317 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.317 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.317 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.317 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.317 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.317 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.317 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.317 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.317 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2024-08-31T04:38:38.317 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2024-08-31T04:38:38.317 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.317 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.317 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.317 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2024-08-31T04:38:38.318 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.318 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.318 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-08-31T04:38:38.318 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-08-31T04:38:38.318 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-08-31T04:38:38.318 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-08-31T04:38:38.318 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-08-31T04:38:38.318 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-08-31T04:38:38.318 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-08-31T04:38:38.318 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-08-31T04:38:38.318 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.318 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.318 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.318 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.319 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.319 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2024-08-31T04:38:38.319 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2024-08-31T04:38:38.319 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:38.319 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.319 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.319 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-08-31T04:38:38.319 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.319 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.319 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.319 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.319 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.319 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.319 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.320 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.320 INFO:teuthology.orchestra.run.smithi050.stdout: "min_score": { 2024-08-31T04:38:38.320 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "min_score", 2024-08-31T04:38:38.320 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "float", 2024-08-31T04:38:38.320 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.320 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.320 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "0", 2024-08-31T04:38:38.320 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.320 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.320 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.320 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-08-31T04:38:38.320 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.320 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.321 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.321 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.321 INFO:teuthology.orchestra.run.smithi050.stdout: "mode": { 2024-08-31T04:38:38.321 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "mode", 2024-08-31T04:38:38.321 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.321 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.321 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.321 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "upmap", 2024-08-31T04:38:38.321 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.321 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.321 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-08-31T04:38:38.321 INFO:teuthology.orchestra.run.smithi050.stdout: "crush-compat", 2024-08-31T04:38:38.321 INFO:teuthology.orchestra.run.smithi050.stdout: "none", 2024-08-31T04:38:38.322 INFO:teuthology.orchestra.run.smithi050.stdout: "read", 2024-08-31T04:38:38.322 INFO:teuthology.orchestra.run.smithi050.stdout: "upmap", 2024-08-31T04:38:38.322 INFO:teuthology.orchestra.run.smithi050.stdout: "upmap-read" 2024-08-31T04:38:38.322 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-08-31T04:38:38.322 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Balancer mode", 2024-08-31T04:38:38.322 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.322 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.322 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.322 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.322 INFO:teuthology.orchestra.run.smithi050.stdout: "pool_ids": { 2024-08-31T04:38:38.322 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "pool_ids", 2024-08-31T04:38:38.322 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.322 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.322 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.323 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-08-31T04:38:38.323 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.323 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.323 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.323 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-08-31T04:38:38.323 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.323 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.323 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.323 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.323 INFO:teuthology.orchestra.run.smithi050.stdout: "sleep_interval": { 2024-08-31T04:38:38.323 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "sleep_interval", 2024-08-31T04:38:38.323 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "secs", 2024-08-31T04:38:38.323 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.323 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.324 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "60", 2024-08-31T04:38:38.324 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.324 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.324 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.324 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-08-31T04:38:38.324 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.324 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.324 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.324 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.324 INFO:teuthology.orchestra.run.smithi050.stdout: "sqlite3_killpoint": { 2024-08-31T04:38:38.324 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "sqlite3_killpoint", 2024-08-31T04:38:38.324 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-08-31T04:38:38.324 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "dev", 2024-08-31T04:38:38.324 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.325 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "0", 2024-08-31T04:38:38.325 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.325 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.325 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.325 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.325 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.325 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.325 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.325 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.325 INFO:teuthology.orchestra.run.smithi050.stdout: "upmap_max_deviation": { 2024-08-31T04:38:38.325 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "upmap_max_deviation", 2024-08-31T04:38:38.325 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-08-31T04:38:38.325 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.325 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.326 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "5", 2024-08-31T04:38:38.326 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "1", 2024-08-31T04:38:38.326 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.326 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.326 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "deviation below which no optimization is attempted", 2024-08-31T04:38:38.326 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-08-31T04:38:38.326 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.326 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.326 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.326 INFO:teuthology.orchestra.run.smithi050.stdout: "upmap_max_optimizations": { 2024-08-31T04:38:38.326 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "upmap_max_optimizations", 2024-08-31T04:38:38.326 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "uint", 2024-08-31T04:38:38.326 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.326 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.327 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "10", 2024-08-31T04:38:38.327 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.327 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.327 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.327 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-08-31T04:38:38.327 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.327 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.327 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.327 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T04:38:38.327 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T04:38:38.327 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.327 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-08-31T04:38:38.327 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "cephadm", 2024-08-31T04:38:38.327 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2024-08-31T04:38:38.328 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2024-08-31T04:38:38.328 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2024-08-31T04:38:38.328 INFO:teuthology.orchestra.run.smithi050.stdout: "agent_down_multiplier": { 2024-08-31T04:38:38.328 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "agent_down_multiplier", 2024-08-31T04:38:38.328 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "float", 2024-08-31T04:38:38.328 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.328 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.328 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "3.0", 2024-08-31T04:38:38.328 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.328 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.328 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.328 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-08-31T04:38:38.328 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.329 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.329 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.329 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.329 INFO:teuthology.orchestra.run.smithi050.stdout: "agent_refresh_rate": { 2024-08-31T04:38:38.329 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "agent_refresh_rate", 2024-08-31T04:38:38.329 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "secs", 2024-08-31T04:38:38.329 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.329 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.329 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "20", 2024-08-31T04:38:38.329 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.329 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.329 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.329 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-08-31T04:38:38.329 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.329 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.330 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.330 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.330 INFO:teuthology.orchestra.run.smithi050.stdout: "agent_starting_port": { 2024-08-31T04:38:38.330 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "agent_starting_port", 2024-08-31T04:38:38.330 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-08-31T04:38:38.330 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.330 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.330 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "4721", 2024-08-31T04:38:38.330 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.330 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.330 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.330 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-08-31T04:38:38.330 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.330 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.331 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.331 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.331 INFO:teuthology.orchestra.run.smithi050.stdout: "allow_ptrace": { 2024-08-31T04:38:38.331 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "allow_ptrace", 2024-08-31T04:38:38.331 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:38.331 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.331 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.331 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-08-31T04:38:38.331 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.331 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.331 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.331 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-08-31T04:38:38.331 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-08-31T04:38:38.331 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.332 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.332 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.332 INFO:teuthology.orchestra.run.smithi050.stdout: "autotune_interval": { 2024-08-31T04:38:38.332 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "autotune_interval", 2024-08-31T04:38:38.332 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "secs", 2024-08-31T04:38:38.332 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.332 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.332 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "600", 2024-08-31T04:38:38.332 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.332 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.332 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.332 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "how frequently to autotune daemon memory", 2024-08-31T04:38:38.332 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.332 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.333 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.333 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.333 INFO:teuthology.orchestra.run.smithi050.stdout: "autotune_memory_target_ratio": { 2024-08-31T04:38:38.333 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "autotune_memory_target_ratio", 2024-08-31T04:38:38.333 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "float", 2024-08-31T04:38:38.333 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.333 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.333 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "0.7", 2024-08-31T04:38:38.333 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.333 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.333 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.333 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-08-31T04:38:38.333 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.334 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.334 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.334 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.334 INFO:teuthology.orchestra.run.smithi050.stdout: "cephadm_log_destination": { 2024-08-31T04:38:38.334 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "cephadm_log_destination", 2024-08-31T04:38:38.334 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.334 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.334 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.334 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-08-31T04:38:38.334 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.334 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.334 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-08-31T04:38:38.334 INFO:teuthology.orchestra.run.smithi050.stdout: "file", 2024-08-31T04:38:38.334 INFO:teuthology.orchestra.run.smithi050.stdout: "file,syslog", 2024-08-31T04:38:38.335 INFO:teuthology.orchestra.run.smithi050.stdout: "syslog" 2024-08-31T04:38:38.335 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-08-31T04:38:38.335 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-08-31T04:38:38.335 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.335 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.335 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.335 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.335 INFO:teuthology.orchestra.run.smithi050.stdout: "cgroups_split": { 2024-08-31T04:38:38.335 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "cgroups_split", 2024-08-31T04:38:38.335 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:38.335 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.335 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.335 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2024-08-31T04:38:38.336 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.336 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.336 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.336 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-08-31T04:38:38.336 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.336 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.336 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.336 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.336 INFO:teuthology.orchestra.run.smithi050.stdout: "config_checks_enabled": { 2024-08-31T04:38:38.336 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "config_checks_enabled", 2024-08-31T04:38:38.336 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:38.336 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.336 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.337 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-08-31T04:38:38.337 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.337 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.337 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.337 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-08-31T04:38:38.337 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.337 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.337 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.337 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.337 INFO:teuthology.orchestra.run.smithi050.stdout: "config_dashboard": { 2024-08-31T04:38:38.337 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "config_dashboard", 2024-08-31T04:38:38.337 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:38.337 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.338 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.338 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2024-08-31T04:38:38.338 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.338 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.338 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.338 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-08-31T04:38:38.338 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.338 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.338 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.338 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.338 INFO:teuthology.orchestra.run.smithi050.stdout: "container_image_alertmanager": { 2024-08-31T04:38:38.338 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "container_image_alertmanager", 2024-08-31T04:38:38.338 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.338 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.339 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.339 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.27.0", 2024-08-31T04:38:38.339 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.339 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.339 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.339 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Prometheus container image", 2024-08-31T04:38:38.339 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.339 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.339 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.339 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.339 INFO:teuthology.orchestra.run.smithi050.stdout: "container_image_base": { 2024-08-31T04:38:38.339 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "container_image_base", 2024-08-31T04:38:38.339 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.339 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.340 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.340 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "quay.io/ceph/ceph", 2024-08-31T04:38:38.340 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.340 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.340 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.340 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Container image name, without the tag", 2024-08-31T04:38:38.340 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.340 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.340 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.340 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.340 INFO:teuthology.orchestra.run.smithi050.stdout: "container_image_elasticsearch": { 2024-08-31T04:38:38.340 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "container_image_elasticsearch", 2024-08-31T04:38:38.340 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.341 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.341 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.341 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-08-31T04:38:38.341 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.341 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.341 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.341 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "elasticsearch container image", 2024-08-31T04:38:38.341 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.341 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.341 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.341 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.341 INFO:teuthology.orchestra.run.smithi050.stdout: "container_image_grafana": { 2024-08-31T04:38:38.341 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "container_image_grafana", 2024-08-31T04:38:38.342 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.342 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.342 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.342 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "quay.io/ceph/grafana:10.4.0", 2024-08-31T04:38:38.342 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.342 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.342 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.342 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Prometheus container image", 2024-08-31T04:38:38.342 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.342 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.342 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.342 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.342 INFO:teuthology.orchestra.run.smithi050.stdout: "container_image_haproxy": { 2024-08-31T04:38:38.343 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "container_image_haproxy", 2024-08-31T04:38:38.343 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.343 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.343 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.343 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-08-31T04:38:38.343 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.343 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.343 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.343 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "HAproxy container image", 2024-08-31T04:38:38.343 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.343 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.343 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.343 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.343 INFO:teuthology.orchestra.run.smithi050.stdout: "container_image_jaeger_agent": { 2024-08-31T04:38:38.344 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "container_image_jaeger_agent", 2024-08-31T04:38:38.344 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.344 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.344 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.344 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-08-31T04:38:38.344 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.344 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.344 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.344 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Jaeger agent container image", 2024-08-31T04:38:38.344 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.344 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.344 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.344 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.345 INFO:teuthology.orchestra.run.smithi050.stdout: "container_image_jaeger_collector": { 2024-08-31T04:38:38.345 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "container_image_jaeger_collector", 2024-08-31T04:38:38.345 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.345 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.345 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.345 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-08-31T04:38:38.345 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.345 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.345 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.345 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Jaeger collector container image", 2024-08-31T04:38:38.345 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.345 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.345 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.345 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.346 INFO:teuthology.orchestra.run.smithi050.stdout: "container_image_jaeger_query": { 2024-08-31T04:38:38.346 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "container_image_jaeger_query", 2024-08-31T04:38:38.346 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.346 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.346 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.346 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-08-31T04:38:38.346 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.346 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.346 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.346 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Jaeger query container image", 2024-08-31T04:38:38.346 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.346 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.346 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.347 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.347 INFO:teuthology.orchestra.run.smithi050.stdout: "container_image_keepalived": { 2024-08-31T04:38:38.347 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "container_image_keepalived", 2024-08-31T04:38:38.347 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.347 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.347 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.347 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-08-31T04:38:38.347 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.347 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.347 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.347 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Keepalived container image", 2024-08-31T04:38:38.347 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.347 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.347 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.348 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.348 INFO:teuthology.orchestra.run.smithi050.stdout: "container_image_loki": { 2024-08-31T04:38:38.348 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "container_image_loki", 2024-08-31T04:38:38.348 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.348 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.348 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.348 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-08-31T04:38:38.348 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.348 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.348 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.348 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Loki container image", 2024-08-31T04:38:38.348 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.348 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.348 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.349 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.349 INFO:teuthology.orchestra.run.smithi050.stdout: "container_image_nginx": { 2024-08-31T04:38:38.349 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "container_image_nginx", 2024-08-31T04:38:38.349 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.349 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.349 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.349 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "quay.io/ceph/nginx:1.26.1", 2024-08-31T04:38:38.349 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.349 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.349 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.349 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Nginx container image", 2024-08-31T04:38:38.349 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.349 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.350 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.350 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.350 INFO:teuthology.orchestra.run.smithi050.stdout: "container_image_node_exporter": { 2024-08-31T04:38:38.350 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "container_image_node_exporter", 2024-08-31T04:38:38.350 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.350 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.350 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.350 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.7.0", 2024-08-31T04:38:38.350 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.350 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.350 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.350 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Prometheus container image", 2024-08-31T04:38:38.350 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.351 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.351 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.351 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.351 INFO:teuthology.orchestra.run.smithi050.stdout: "container_image_nvmeof": { 2024-08-31T04:38:38.351 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "container_image_nvmeof", 2024-08-31T04:38:38.351 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.351 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.351 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.351 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.17", 2024-08-31T04:38:38.351 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.351 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.351 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.351 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Nvme-of container image", 2024-08-31T04:38:38.351 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.351 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.352 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.352 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.352 INFO:teuthology.orchestra.run.smithi050.stdout: "container_image_oauth2_proxy": { 2024-08-31T04:38:38.352 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "container_image_oauth2_proxy", 2024-08-31T04:38:38.352 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.352 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.352 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.352 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "quay.io/oauth2-proxy/oauth2-proxy:v7.6.0", 2024-08-31T04:38:38.352 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.352 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.352 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.352 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "oauth2-proxy container image", 2024-08-31T04:38:38.352 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.352 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.353 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.353 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.353 INFO:teuthology.orchestra.run.smithi050.stdout: "container_image_prometheus": { 2024-08-31T04:38:38.353 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "container_image_prometheus", 2024-08-31T04:38:38.353 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.353 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.353 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.353 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "quay.io/prometheus/prometheus:v2.51.0", 2024-08-31T04:38:38.353 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.353 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.353 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.353 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Prometheus container image", 2024-08-31T04:38:38.353 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.354 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.354 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.354 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.354 INFO:teuthology.orchestra.run.smithi050.stdout: "container_image_promtail": { 2024-08-31T04:38:38.354 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "container_image_promtail", 2024-08-31T04:38:38.354 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.354 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.354 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.354 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-08-31T04:38:38.354 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.354 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.354 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.354 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Promtail container image", 2024-08-31T04:38:38.354 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.355 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.355 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.355 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.355 INFO:teuthology.orchestra.run.smithi050.stdout: "container_image_samba": { 2024-08-31T04:38:38.355 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "container_image_samba", 2024-08-31T04:38:38.355 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.355 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.355 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.355 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-08-31T04:38:38.355 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.355 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.355 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.355 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Samba/SMB container image", 2024-08-31T04:38:38.355 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.356 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.356 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.356 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.356 INFO:teuthology.orchestra.run.smithi050.stdout: "container_image_snmp_gateway": { 2024-08-31T04:38:38.356 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "container_image_snmp_gateway", 2024-08-31T04:38:38.356 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.356 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.356 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.356 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-08-31T04:38:38.356 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.356 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.356 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.356 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "SNMP Gateway container image", 2024-08-31T04:38:38.357 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.357 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.357 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.357 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.357 INFO:teuthology.orchestra.run.smithi050.stdout: "container_init": { 2024-08-31T04:38:38.357 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "container_init", 2024-08-31T04:38:38.357 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:38.357 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.357 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.357 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2024-08-31T04:38:38.357 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.357 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.357 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.358 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Run podman/docker with `--init`", 2024-08-31T04:38:38.358 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.358 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.358 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.358 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.358 INFO:teuthology.orchestra.run.smithi050.stdout: "daemon_cache_timeout": { 2024-08-31T04:38:38.358 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "daemon_cache_timeout", 2024-08-31T04:38:38.358 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "secs", 2024-08-31T04:38:38.358 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.358 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.358 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "600", 2024-08-31T04:38:38.358 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.358 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.359 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.359 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-08-31T04:38:38.359 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.359 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.359 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.359 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.359 INFO:teuthology.orchestra.run.smithi050.stdout: "default_cephadm_command_timeout": { 2024-08-31T04:38:38.359 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "default_cephadm_command_timeout", 2024-08-31T04:38:38.359 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-08-31T04:38:38.359 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.359 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.359 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "900", 2024-08-31T04:38:38.359 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.360 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.360 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.360 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-08-31T04:38:38.360 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.360 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.360 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.360 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.360 INFO:teuthology.orchestra.run.smithi050.stdout: "default_registry": { 2024-08-31T04:38:38.360 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "default_registry", 2024-08-31T04:38:38.360 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.360 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.360 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.360 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "docker.io", 2024-08-31T04:38:38.360 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.361 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.361 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.361 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-08-31T04:38:38.361 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.361 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.361 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.361 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.361 INFO:teuthology.orchestra.run.smithi050.stdout: "device_cache_timeout": { 2024-08-31T04:38:38.361 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "device_cache_timeout", 2024-08-31T04:38:38.361 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "secs", 2024-08-31T04:38:38.361 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.361 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.361 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "1800", 2024-08-31T04:38:38.362 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.362 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.362 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.362 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "seconds to cache device inventory", 2024-08-31T04:38:38.362 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.362 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.362 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.362 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.362 INFO:teuthology.orchestra.run.smithi050.stdout: "device_enhanced_scan": { 2024-08-31T04:38:38.362 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "device_enhanced_scan", 2024-08-31T04:38:38.362 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:38.362 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.362 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.362 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-08-31T04:38:38.363 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.363 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.363 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.363 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Use libstoragemgmt during device scans", 2024-08-31T04:38:38.363 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.363 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.363 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.363 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.363 INFO:teuthology.orchestra.run.smithi050.stdout: "facts_cache_timeout": { 2024-08-31T04:38:38.363 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "facts_cache_timeout", 2024-08-31T04:38:38.363 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "secs", 2024-08-31T04:38:38.363 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.363 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.363 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "60", 2024-08-31T04:38:38.364 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.364 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.364 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.364 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "seconds to cache host facts data", 2024-08-31T04:38:38.364 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.364 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.364 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.364 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.364 INFO:teuthology.orchestra.run.smithi050.stdout: "grafana_dashboards_path": { 2024-08-31T04:38:38.364 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "grafana_dashboards_path", 2024-08-31T04:38:38.364 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.364 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.365 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.365 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-08-31T04:38:38.365 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.365 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.365 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.365 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-08-31T04:38:38.365 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.365 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.365 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.365 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.365 INFO:teuthology.orchestra.run.smithi050.stdout: "host_check_interval": { 2024-08-31T04:38:38.365 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "host_check_interval", 2024-08-31T04:38:38.365 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "secs", 2024-08-31T04:38:38.365 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.366 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.366 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "600", 2024-08-31T04:38:38.366 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.366 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.366 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.366 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "how frequently to perform a host check", 2024-08-31T04:38:38.366 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.366 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.366 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.366 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.366 INFO:teuthology.orchestra.run.smithi050.stdout: "hw_monitoring": { 2024-08-31T04:38:38.366 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "hw_monitoring", 2024-08-31T04:38:38.366 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:38.366 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.367 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.367 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-08-31T04:38:38.367 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.367 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.367 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.367 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-08-31T04:38:38.367 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.367 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.367 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.367 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.367 INFO:teuthology.orchestra.run.smithi050.stdout: "inventory_list_all": { 2024-08-31T04:38:38.367 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "inventory_list_all", 2024-08-31T04:38:38.367 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:38.367 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.368 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.368 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-08-31T04:38:38.368 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.368 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.368 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.368 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-08-31T04:38:38.368 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.368 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.368 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.368 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.368 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2024-08-31T04:38:38.368 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2024-08-31T04:38:38.368 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.368 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.369 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.369 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-08-31T04:38:38.369 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.369 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.369 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-08-31T04:38:38.369 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-08-31T04:38:38.369 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-08-31T04:38:38.369 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-08-31T04:38:38.369 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-08-31T04:38:38.369 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-08-31T04:38:38.369 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-08-31T04:38:38.369 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-08-31T04:38:38.369 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.369 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.370 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.370 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.370 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.370 INFO:teuthology.orchestra.run.smithi050.stdout: "log_refresh_metadata": { 2024-08-31T04:38:38.370 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_refresh_metadata", 2024-08-31T04:38:38.370 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:38.370 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.370 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.370 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-08-31T04:38:38.370 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.370 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.370 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.370 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-08-31T04:38:38.371 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.371 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.371 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.371 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.371 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2024-08-31T04:38:38.371 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2024-08-31T04:38:38.371 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:38.371 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.371 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.371 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2024-08-31T04:38:38.371 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.371 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.371 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.372 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-08-31T04:38:38.372 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.372 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.372 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.372 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.372 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2024-08-31T04:38:38.372 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2024-08-31T04:38:38.372 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.372 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.372 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.372 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2024-08-31T04:38:38.372 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.372 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.372 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-08-31T04:38:38.373 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-08-31T04:38:38.373 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-08-31T04:38:38.373 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-08-31T04:38:38.373 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-08-31T04:38:38.373 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-08-31T04:38:38.373 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-08-31T04:38:38.373 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-08-31T04:38:38.373 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.373 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.373 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.373 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.373 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.373 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2024-08-31T04:38:38.373 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2024-08-31T04:38:38.373 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:38.374 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.374 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.374 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-08-31T04:38:38.374 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.374 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.374 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.374 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.374 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.374 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.374 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.374 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.374 INFO:teuthology.orchestra.run.smithi050.stdout: "manage_etc_ceph_ceph_conf": { 2024-08-31T04:38:38.374 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-08-31T04:38:38.374 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:38.375 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.375 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.375 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-08-31T04:38:38.375 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.375 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.375 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.375 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-08-31T04:38:38.375 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.375 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.375 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.375 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.375 INFO:teuthology.orchestra.run.smithi050.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-08-31T04:38:38.375 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-08-31T04:38:38.375 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.376 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.376 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.376 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "*", 2024-08-31T04:38:38.376 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.376 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.376 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.376 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-08-31T04:38:38.376 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.376 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.376 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.376 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.376 INFO:teuthology.orchestra.run.smithi050.stdout: "max_count_per_host": { 2024-08-31T04:38:38.376 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "max_count_per_host", 2024-08-31T04:38:38.377 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-08-31T04:38:38.377 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.377 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.377 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "10", 2024-08-31T04:38:38.377 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.377 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.377 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.377 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "max number of daemons per service per host", 2024-08-31T04:38:38.377 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.377 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.377 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.377 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.377 INFO:teuthology.orchestra.run.smithi050.stdout: "max_osd_draining_count": { 2024-08-31T04:38:38.377 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "max_osd_draining_count", 2024-08-31T04:38:38.377 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-08-31T04:38:38.378 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.378 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.378 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "10", 2024-08-31T04:38:38.378 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.378 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.378 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.378 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-08-31T04:38:38.378 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.378 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.378 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.378 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.378 INFO:teuthology.orchestra.run.smithi050.stdout: "migration_current": { 2024-08-31T04:38:38.378 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "migration_current", 2024-08-31T04:38:38.379 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-08-31T04:38:38.379 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.379 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.379 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-08-31T04:38:38.379 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.379 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.379 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.379 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "internal - do not modify", 2024-08-31T04:38:38.379 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.379 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.379 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.379 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.379 INFO:teuthology.orchestra.run.smithi050.stdout: "mode": { 2024-08-31T04:38:38.379 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "mode", 2024-08-31T04:38:38.380 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.380 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.380 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.380 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "root", 2024-08-31T04:38:38.380 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.380 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.380 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-08-31T04:38:38.380 INFO:teuthology.orchestra.run.smithi050.stdout: "cephadm-package", 2024-08-31T04:38:38.380 INFO:teuthology.orchestra.run.smithi050.stdout: "root" 2024-08-31T04:38:38.380 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-08-31T04:38:38.380 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "mode for remote execution of cephadm", 2024-08-31T04:38:38.380 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.380 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.380 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.381 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.381 INFO:teuthology.orchestra.run.smithi050.stdout: "oob_default_addr": { 2024-08-31T04:38:38.381 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "oob_default_addr", 2024-08-31T04:38:38.381 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.381 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.381 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.381 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "169.254.1.1", 2024-08-31T04:38:38.381 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.381 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.381 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.381 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Default address for RedFish API (oob management).", 2024-08-31T04:38:38.381 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.381 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.381 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.381 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.382 INFO:teuthology.orchestra.run.smithi050.stdout: "prometheus_alerts_path": { 2024-08-31T04:38:38.382 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "prometheus_alerts_path", 2024-08-31T04:38:38.382 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.382 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.382 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.382 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-08-31T04:38:38.382 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.382 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.382 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.382 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-08-31T04:38:38.382 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.382 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.382 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.382 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.383 INFO:teuthology.orchestra.run.smithi050.stdout: "registry_insecure": { 2024-08-31T04:38:38.383 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "registry_insecure", 2024-08-31T04:38:38.383 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:38.383 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.383 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.383 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-08-31T04:38:38.383 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.383 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.383 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.383 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-08-31T04:38:38.383 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.383 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.383 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.383 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.384 INFO:teuthology.orchestra.run.smithi050.stdout: "registry_password": { 2024-08-31T04:38:38.384 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "registry_password", 2024-08-31T04:38:38.384 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.384 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.384 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.384 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-08-31T04:38:38.384 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.384 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.384 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.384 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-08-31T04:38:38.384 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.384 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.384 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.385 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.385 INFO:teuthology.orchestra.run.smithi050.stdout: "registry_url": { 2024-08-31T04:38:38.385 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "registry_url", 2024-08-31T04:38:38.385 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.385 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.385 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.385 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-08-31T04:38:38.385 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.385 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.385 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.385 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-08-31T04:38:38.385 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.385 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.385 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.386 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.386 INFO:teuthology.orchestra.run.smithi050.stdout: "registry_username": { 2024-08-31T04:38:38.386 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "registry_username", 2024-08-31T04:38:38.386 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.386 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.386 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.386 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-08-31T04:38:38.386 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.386 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.386 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.386 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-08-31T04:38:38.386 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.386 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.386 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.387 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.387 INFO:teuthology.orchestra.run.smithi050.stdout: "secure_monitoring_stack": { 2024-08-31T04:38:38.387 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "secure_monitoring_stack", 2024-08-31T04:38:38.387 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:38.387 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.387 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.387 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-08-31T04:38:38.387 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.387 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.387 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.387 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-08-31T04:38:38.387 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.387 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.388 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.388 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.388 INFO:teuthology.orchestra.run.smithi050.stdout: "service_discovery_port": { 2024-08-31T04:38:38.388 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "service_discovery_port", 2024-08-31T04:38:38.388 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-08-31T04:38:38.388 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.388 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.388 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "8765", 2024-08-31T04:38:38.388 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.388 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.388 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.388 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "cephadm service discovery port", 2024-08-31T04:38:38.388 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.388 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.389 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.389 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.389 INFO:teuthology.orchestra.run.smithi050.stdout: "sqlite3_killpoint": { 2024-08-31T04:38:38.389 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "sqlite3_killpoint", 2024-08-31T04:38:38.389 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-08-31T04:38:38.389 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "dev", 2024-08-31T04:38:38.389 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.389 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "0", 2024-08-31T04:38:38.389 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.389 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.389 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.389 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.389 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.390 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.390 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.390 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.390 INFO:teuthology.orchestra.run.smithi050.stdout: "ssh_config_file": { 2024-08-31T04:38:38.390 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "ssh_config_file", 2024-08-31T04:38:38.390 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.390 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.390 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.390 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-08-31T04:38:38.390 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.390 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.390 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.390 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-08-31T04:38:38.390 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.391 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.391 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.391 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.391 INFO:teuthology.orchestra.run.smithi050.stdout: "use_agent": { 2024-08-31T04:38:38.391 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "use_agent", 2024-08-31T04:38:38.391 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:38.391 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.391 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.391 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-08-31T04:38:38.391 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.391 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.391 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.391 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-08-31T04:38:38.392 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.392 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.392 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.392 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.392 INFO:teuthology.orchestra.run.smithi050.stdout: "use_repo_digest": { 2024-08-31T04:38:38.392 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "use_repo_digest", 2024-08-31T04:38:38.392 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:38.392 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.392 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.392 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2024-08-31T04:38:38.392 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.392 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.392 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.392 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-08-31T04:38:38.393 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.393 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.393 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.393 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.393 INFO:teuthology.orchestra.run.smithi050.stdout: "warn_on_failed_host_check": { 2024-08-31T04:38:38.393 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "warn_on_failed_host_check", 2024-08-31T04:38:38.393 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:38.393 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.393 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.393 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2024-08-31T04:38:38.393 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.393 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.393 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.393 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "raise a health warning if the host check fails", 2024-08-31T04:38:38.394 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.394 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.394 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.394 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.394 INFO:teuthology.orchestra.run.smithi050.stdout: "warn_on_stray_daemons": { 2024-08-31T04:38:38.394 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "warn_on_stray_daemons", 2024-08-31T04:38:38.394 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:38.394 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.394 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.394 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2024-08-31T04:38:38.394 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.394 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.394 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.394 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-08-31T04:38:38.394 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.395 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.395 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.395 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.395 INFO:teuthology.orchestra.run.smithi050.stdout: "warn_on_stray_hosts": { 2024-08-31T04:38:38.395 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "warn_on_stray_hosts", 2024-08-31T04:38:38.395 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:38.395 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.395 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.395 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2024-08-31T04:38:38.395 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.395 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.395 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.395 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-08-31T04:38:38.395 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.396 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.396 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.396 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T04:38:38.396 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T04:38:38.396 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.396 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-08-31T04:38:38.396 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "crash", 2024-08-31T04:38:38.396 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2024-08-31T04:38:38.396 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2024-08-31T04:38:38.396 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2024-08-31T04:38:38.396 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2024-08-31T04:38:38.396 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2024-08-31T04:38:38.396 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.397 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.397 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.397 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-08-31T04:38:38.397 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.397 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.397 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-08-31T04:38:38.397 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-08-31T04:38:38.397 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-08-31T04:38:38.397 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-08-31T04:38:38.397 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-08-31T04:38:38.397 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-08-31T04:38:38.397 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-08-31T04:38:38.397 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-08-31T04:38:38.398 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.398 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.398 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.398 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.398 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.398 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2024-08-31T04:38:38.398 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2024-08-31T04:38:38.398 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:38.398 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.398 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.398 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-08-31T04:38:38.398 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.399 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.399 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.399 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.399 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.399 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.399 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.399 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.399 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2024-08-31T04:38:38.399 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2024-08-31T04:38:38.399 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.399 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.399 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.399 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2024-08-31T04:38:38.399 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.400 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.400 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-08-31T04:38:38.400 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-08-31T04:38:38.400 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-08-31T04:38:38.400 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-08-31T04:38:38.400 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-08-31T04:38:38.400 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-08-31T04:38:38.400 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-08-31T04:38:38.400 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-08-31T04:38:38.400 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.400 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.400 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.400 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.400 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.401 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2024-08-31T04:38:38.401 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2024-08-31T04:38:38.401 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:38.401 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.401 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.401 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-08-31T04:38:38.401 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.401 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.401 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.401 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.401 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.401 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.401 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.401 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.402 INFO:teuthology.orchestra.run.smithi050.stdout: "retain_interval": { 2024-08-31T04:38:38.402 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "retain_interval", 2024-08-31T04:38:38.402 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "secs", 2024-08-31T04:38:38.402 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.402 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.402 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "31536000", 2024-08-31T04:38:38.402 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.402 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.402 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.402 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "how long to retain crashes before pruning them", 2024-08-31T04:38:38.402 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.402 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.402 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.402 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.403 INFO:teuthology.orchestra.run.smithi050.stdout: "sqlite3_killpoint": { 2024-08-31T04:38:38.403 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "sqlite3_killpoint", 2024-08-31T04:38:38.403 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-08-31T04:38:38.403 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "dev", 2024-08-31T04:38:38.403 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.403 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "0", 2024-08-31T04:38:38.403 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.403 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.403 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.403 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.403 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.403 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.403 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.403 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.403 INFO:teuthology.orchestra.run.smithi050.stdout: "warn_recent_interval": { 2024-08-31T04:38:38.403 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "warn_recent_interval", 2024-08-31T04:38:38.404 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "secs", 2024-08-31T04:38:38.404 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.404 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.404 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "1209600", 2024-08-31T04:38:38.404 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.404 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.404 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.404 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "time interval in which to warn about recent crashes", 2024-08-31T04:38:38.404 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.404 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.404 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.404 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T04:38:38.404 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T04:38:38.404 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.405 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-08-31T04:38:38.405 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "dashboard", 2024-08-31T04:38:38.405 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2024-08-31T04:38:38.405 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2024-08-31T04:38:38.405 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2024-08-31T04:38:38.405 INFO:teuthology.orchestra.run.smithi050.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-08-31T04:38:38.405 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-08-31T04:38:38.405 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-08-31T04:38:38.405 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.405 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.405 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "10", 2024-08-31T04:38:38.405 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.405 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.405 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.406 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.406 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.406 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.406 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.406 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.406 INFO:teuthology.orchestra.run.smithi050.stdout: "ALERTMANAGER_API_HOST": { 2024-08-31T04:38:38.406 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "ALERTMANAGER_API_HOST", 2024-08-31T04:38:38.406 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.406 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.406 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.406 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-08-31T04:38:38.406 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.406 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.406 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.406 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.407 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.407 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.407 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.407 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.407 INFO:teuthology.orchestra.run.smithi050.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-08-31T04:38:38.407 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-08-31T04:38:38.407 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:38.407 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.407 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.407 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2024-08-31T04:38:38.407 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.407 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.407 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.407 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.408 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.408 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.408 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.408 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.408 INFO:teuthology.orchestra.run.smithi050.stdout: "AUDIT_API_ENABLED": { 2024-08-31T04:38:38.408 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "AUDIT_API_ENABLED", 2024-08-31T04:38:38.408 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:38.408 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.408 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.408 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-08-31T04:38:38.408 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.408 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.408 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.408 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.409 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.409 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.409 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.409 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.409 INFO:teuthology.orchestra.run.smithi050.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-08-31T04:38:38.409 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-08-31T04:38:38.409 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:38.409 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.409 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.409 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2024-08-31T04:38:38.409 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.409 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.409 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.410 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.410 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.410 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.410 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.410 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.410 INFO:teuthology.orchestra.run.smithi050.stdout: "ENABLE_BROWSABLE_API": { 2024-08-31T04:38:38.410 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "ENABLE_BROWSABLE_API", 2024-08-31T04:38:38.410 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:38.410 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.410 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.410 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2024-08-31T04:38:38.410 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.410 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.410 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.411 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.411 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.411 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.411 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.411 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.411 INFO:teuthology.orchestra.run.smithi050.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-08-31T04:38:38.411 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-08-31T04:38:38.411 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:38.411 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.411 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.411 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2024-08-31T04:38:38.411 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.411 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.412 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.412 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.412 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.412 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.412 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.412 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.412 INFO:teuthology.orchestra.run.smithi050.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-08-31T04:38:38.412 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-08-31T04:38:38.412 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:38.412 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.412 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.412 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2024-08-31T04:38:38.412 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.412 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.413 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.413 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.413 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.413 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.413 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.413 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.413 INFO:teuthology.orchestra.run.smithi050.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-08-31T04:38:38.413 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-08-31T04:38:38.413 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:38.413 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.413 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.413 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2024-08-31T04:38:38.413 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.413 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.414 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.414 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.414 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.414 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.414 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.414 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.414 INFO:teuthology.orchestra.run.smithi050.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-08-31T04:38:38.414 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-08-31T04:38:38.414 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:38.414 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.414 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.414 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2024-08-31T04:38:38.414 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.414 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.415 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.415 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.415 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.415 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.415 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.415 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.415 INFO:teuthology.orchestra.run.smithi050.stdout: "FEATURE_TOGGLE_NFS": { 2024-08-31T04:38:38.415 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-08-31T04:38:38.415 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:38.415 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.415 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.415 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2024-08-31T04:38:38.415 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.416 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.416 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.416 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.416 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.416 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.416 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.416 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.416 INFO:teuthology.orchestra.run.smithi050.stdout: "FEATURE_TOGGLE_RBD": { 2024-08-31T04:38:38.416 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-08-31T04:38:38.416 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:38.416 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.416 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.416 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2024-08-31T04:38:38.416 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.417 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.417 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.417 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.417 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.417 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.417 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.417 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.417 INFO:teuthology.orchestra.run.smithi050.stdout: "FEATURE_TOGGLE_RGW": { 2024-08-31T04:38:38.417 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-08-31T04:38:38.417 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:38.417 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.417 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.417 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2024-08-31T04:38:38.418 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.418 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.418 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.418 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.418 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.418 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.418 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.418 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.418 INFO:teuthology.orchestra.run.smithi050.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-08-31T04:38:38.418 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-08-31T04:38:38.418 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.418 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.418 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.418 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-08-31T04:38:38.419 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.419 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.419 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.419 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.419 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.419 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.419 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.419 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.419 INFO:teuthology.orchestra.run.smithi050.stdout: "GRAFANA_API_PASSWORD": { 2024-08-31T04:38:38.419 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "GRAFANA_API_PASSWORD", 2024-08-31T04:38:38.419 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.419 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.419 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.419 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "admin", 2024-08-31T04:38:38.420 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.420 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.420 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.420 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.420 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.420 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.420 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.420 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.420 INFO:teuthology.orchestra.run.smithi050.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-08-31T04:38:38.420 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-08-31T04:38:38.420 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:38.420 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.420 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.420 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2024-08-31T04:38:38.421 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.421 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.421 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.421 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.421 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.421 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.421 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.421 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.421 INFO:teuthology.orchestra.run.smithi050.stdout: "GRAFANA_API_URL": { 2024-08-31T04:38:38.421 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "GRAFANA_API_URL", 2024-08-31T04:38:38.421 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.421 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.421 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.422 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-08-31T04:38:38.422 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.422 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.422 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.422 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.422 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.422 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.422 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.422 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.422 INFO:teuthology.orchestra.run.smithi050.stdout: "GRAFANA_API_USERNAME": { 2024-08-31T04:38:38.422 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "GRAFANA_API_USERNAME", 2024-08-31T04:38:38.422 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.422 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.422 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.422 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "admin", 2024-08-31T04:38:38.423 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.423 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.423 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.423 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.423 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.423 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.423 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.423 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.423 INFO:teuthology.orchestra.run.smithi050.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-08-31T04:38:38.423 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-08-31T04:38:38.423 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.423 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.423 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.424 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-08-31T04:38:38.424 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.424 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.424 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.424 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.424 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.424 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.424 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.424 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.424 INFO:teuthology.orchestra.run.smithi050.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-08-31T04:38:38.424 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-08-31T04:38:38.424 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:38.424 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.424 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.425 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-08-31T04:38:38.425 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.425 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.425 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.425 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.425 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.425 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.425 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.425 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.425 INFO:teuthology.orchestra.run.smithi050.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-08-31T04:38:38.425 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-08-31T04:38:38.425 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:38.425 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.426 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.426 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2024-08-31T04:38:38.426 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.426 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.426 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.426 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.426 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.426 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.426 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.426 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.426 INFO:teuthology.orchestra.run.smithi050.stdout: "ISSUE_TRACKER_API_KEY": { 2024-08-31T04:38:38.426 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-08-31T04:38:38.426 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.426 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.427 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.427 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-08-31T04:38:38.427 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.427 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.427 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.427 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.427 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.427 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.427 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.427 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.427 INFO:teuthology.orchestra.run.smithi050.stdout: "MANAGED_BY_CLUSTERS": { 2024-08-31T04:38:38.427 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "MANAGED_BY_CLUSTERS", 2024-08-31T04:38:38.427 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.427 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.427 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.428 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "[]", 2024-08-31T04:38:38.428 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.428 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.428 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.428 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.428 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.428 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.428 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.428 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.428 INFO:teuthology.orchestra.run.smithi050.stdout: "MULTICLUSTER_CONFIG": { 2024-08-31T04:38:38.428 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "MULTICLUSTER_CONFIG", 2024-08-31T04:38:38.428 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.428 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.428 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.429 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "{}", 2024-08-31T04:38:38.429 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.429 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.429 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.429 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.429 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.429 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.429 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.429 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.429 INFO:teuthology.orchestra.run.smithi050.stdout: "PROMETHEUS_API_HOST": { 2024-08-31T04:38:38.429 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "PROMETHEUS_API_HOST", 2024-08-31T04:38:38.429 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.430 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.430 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.430 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-08-31T04:38:38.430 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.430 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.430 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.430 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.430 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.430 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.430 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.430 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.430 INFO:teuthology.orchestra.run.smithi050.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-08-31T04:38:38.430 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-08-31T04:38:38.431 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:38.431 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.431 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.431 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2024-08-31T04:38:38.431 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.431 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.431 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.431 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.431 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.431 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.431 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.431 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.431 INFO:teuthology.orchestra.run.smithi050.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-08-31T04:38:38.431 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-08-31T04:38:38.432 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:38.432 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.432 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.432 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-08-31T04:38:38.432 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.432 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.432 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.432 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.432 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.432 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.432 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.432 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.432 INFO:teuthology.orchestra.run.smithi050.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-08-31T04:38:38.432 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-08-31T04:38:38.433 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:38.433 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.433 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.433 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-08-31T04:38:38.433 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.433 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.433 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.433 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.433 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.433 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.433 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.433 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.433 INFO:teuthology.orchestra.run.smithi050.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-08-31T04:38:38.434 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-08-31T04:38:38.434 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:38.434 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.434 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.434 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2024-08-31T04:38:38.434 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.434 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.434 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.434 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.434 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.434 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.434 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.434 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.434 INFO:teuthology.orchestra.run.smithi050.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-08-31T04:38:38.434 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-08-31T04:38:38.435 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:38.435 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.435 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.435 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2024-08-31T04:38:38.435 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.435 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.435 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.435 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.435 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.435 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.435 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.435 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.435 INFO:teuthology.orchestra.run.smithi050.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-08-31T04:38:38.435 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-08-31T04:38:38.436 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:38.436 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.436 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.436 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-08-31T04:38:38.436 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.436 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.436 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.436 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.436 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.436 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.436 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.436 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.436 INFO:teuthology.orchestra.run.smithi050.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-08-31T04:38:38.437 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-08-31T04:38:38.437 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:38.437 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.437 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.437 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-08-31T04:38:38.437 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.437 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.437 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.437 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.437 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.437 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.437 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.437 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.438 INFO:teuthology.orchestra.run.smithi050.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-08-31T04:38:38.438 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-08-31T04:38:38.438 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:38.438 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.438 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.438 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-08-31T04:38:38.438 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.438 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.438 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.438 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.438 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.438 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.438 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.438 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.439 INFO:teuthology.orchestra.run.smithi050.stdout: "PWD_POLICY_ENABLED": { 2024-08-31T04:38:38.439 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "PWD_POLICY_ENABLED", 2024-08-31T04:38:38.439 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:38.439 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.439 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.439 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2024-08-31T04:38:38.439 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.439 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.439 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.439 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.439 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.439 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.439 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.439 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.440 INFO:teuthology.orchestra.run.smithi050.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-08-31T04:38:38.440 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-08-31T04:38:38.440 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.440 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.440 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.440 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-08-31T04:38:38.440 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.440 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.440 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.440 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.440 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.440 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.440 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.440 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.441 INFO:teuthology.orchestra.run.smithi050.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-08-31T04:38:38.441 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-08-31T04:38:38.441 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-08-31T04:38:38.441 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.441 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.441 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "10", 2024-08-31T04:38:38.441 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.441 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.441 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.441 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.441 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.441 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.441 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.441 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.442 INFO:teuthology.orchestra.run.smithi050.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-08-31T04:38:38.442 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-08-31T04:38:38.442 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-08-31T04:38:38.442 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.442 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.442 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "8", 2024-08-31T04:38:38.442 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.442 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.442 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.442 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.442 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.442 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.442 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.442 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.443 INFO:teuthology.orchestra.run.smithi050.stdout: "REST_REQUESTS_TIMEOUT": { 2024-08-31T04:38:38.443 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-08-31T04:38:38.443 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-08-31T04:38:38.443 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.443 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.443 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "45", 2024-08-31T04:38:38.443 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.443 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.443 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.443 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.443 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.443 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.443 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.443 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.443 INFO:teuthology.orchestra.run.smithi050.stdout: "RGW_API_ACCESS_KEY": { 2024-08-31T04:38:38.443 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "RGW_API_ACCESS_KEY", 2024-08-31T04:38:38.444 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.444 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.444 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.444 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-08-31T04:38:38.444 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.444 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.444 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.444 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.444 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.444 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.444 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.444 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.444 INFO:teuthology.orchestra.run.smithi050.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-08-31T04:38:38.444 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-08-31T04:38:38.445 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.445 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.445 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.445 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "admin", 2024-08-31T04:38:38.445 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.445 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.445 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.445 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.445 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.445 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.445 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.445 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.445 INFO:teuthology.orchestra.run.smithi050.stdout: "RGW_API_SECRET_KEY": { 2024-08-31T04:38:38.446 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "RGW_API_SECRET_KEY", 2024-08-31T04:38:38.446 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.446 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.446 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.446 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-08-31T04:38:38.446 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.446 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.446 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.446 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.446 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.446 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.446 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.446 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.446 INFO:teuthology.orchestra.run.smithi050.stdout: "RGW_API_SSL_VERIFY": { 2024-08-31T04:38:38.447 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "RGW_API_SSL_VERIFY", 2024-08-31T04:38:38.447 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:38.447 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.447 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.447 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2024-08-31T04:38:38.447 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.447 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.447 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.447 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.447 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.447 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.447 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.447 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.447 INFO:teuthology.orchestra.run.smithi050.stdout: "UNSAFE_TLS_v1_2": { 2024-08-31T04:38:38.447 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "UNSAFE_TLS_v1_2", 2024-08-31T04:38:38.448 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:38.448 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.448 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.448 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-08-31T04:38:38.448 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.448 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.448 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.448 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.448 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.448 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.448 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.448 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.448 INFO:teuthology.orchestra.run.smithi050.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-08-31T04:38:38.448 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-08-31T04:38:38.448 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-08-31T04:38:38.449 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.449 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.449 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "0", 2024-08-31T04:38:38.449 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.449 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.449 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.449 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.449 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.449 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.449 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.449 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.449 INFO:teuthology.orchestra.run.smithi050.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-08-31T04:38:38.449 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-08-31T04:38:38.450 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-08-31T04:38:38.450 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.450 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.450 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "10", 2024-08-31T04:38:38.450 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.450 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.450 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.450 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.450 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.450 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.450 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.450 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.450 INFO:teuthology.orchestra.run.smithi050.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-08-31T04:38:38.450 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-08-31T04:38:38.451 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-08-31T04:38:38.451 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.451 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.451 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "5", 2024-08-31T04:38:38.451 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.451 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.451 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.451 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.451 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.451 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.451 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.451 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.451 INFO:teuthology.orchestra.run.smithi050.stdout: "cross_origin_url": { 2024-08-31T04:38:38.451 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "cross_origin_url", 2024-08-31T04:38:38.451 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.452 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.452 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.452 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-08-31T04:38:38.452 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.452 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.452 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.452 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.452 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.452 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.452 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.452 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.452 INFO:teuthology.orchestra.run.smithi050.stdout: "crt_file": { 2024-08-31T04:38:38.452 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "crt_file", 2024-08-31T04:38:38.452 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.453 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.453 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.453 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-08-31T04:38:38.453 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.453 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.453 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.453 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.453 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.453 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.453 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.453 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.453 INFO:teuthology.orchestra.run.smithi050.stdout: "debug": { 2024-08-31T04:38:38.453 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "debug", 2024-08-31T04:38:38.454 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:38.454 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.454 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.454 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-08-31T04:38:38.454 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.454 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.454 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.454 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Enable/disable debug options", 2024-08-31T04:38:38.454 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.454 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.454 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.454 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.454 INFO:teuthology.orchestra.run.smithi050.stdout: "jwt_token_ttl": { 2024-08-31T04:38:38.455 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "jwt_token_ttl", 2024-08-31T04:38:38.455 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-08-31T04:38:38.455 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.455 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.455 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "28800", 2024-08-31T04:38:38.455 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.455 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.455 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.455 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.455 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.455 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.455 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.455 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.455 INFO:teuthology.orchestra.run.smithi050.stdout: "key_file": { 2024-08-31T04:38:38.456 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "key_file", 2024-08-31T04:38:38.456 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.456 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.456 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.456 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-08-31T04:38:38.456 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.456 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.456 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.456 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.456 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.456 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.456 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.456 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.456 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2024-08-31T04:38:38.456 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2024-08-31T04:38:38.457 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.457 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.457 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.457 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-08-31T04:38:38.457 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.457 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.457 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-08-31T04:38:38.457 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-08-31T04:38:38.457 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-08-31T04:38:38.457 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-08-31T04:38:38.457 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-08-31T04:38:38.457 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-08-31T04:38:38.457 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-08-31T04:38:38.458 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-08-31T04:38:38.458 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.458 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.458 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.458 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.458 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.458 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2024-08-31T04:38:38.458 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2024-08-31T04:38:38.458 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:38.458 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.458 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.458 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-08-31T04:38:38.458 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.458 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.459 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.459 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.459 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.459 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.459 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.459 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.459 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2024-08-31T04:38:38.459 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2024-08-31T04:38:38.459 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.459 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.459 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.459 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2024-08-31T04:38:38.459 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.459 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.460 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-08-31T04:38:38.460 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-08-31T04:38:38.460 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-08-31T04:38:38.460 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-08-31T04:38:38.460 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-08-31T04:38:38.460 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-08-31T04:38:38.460 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-08-31T04:38:38.460 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-08-31T04:38:38.460 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.460 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.460 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.460 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.460 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.461 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2024-08-31T04:38:38.461 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2024-08-31T04:38:38.461 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:38.461 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.461 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.461 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-08-31T04:38:38.461 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.461 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.461 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.461 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.461 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.461 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.461 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.462 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.462 INFO:teuthology.orchestra.run.smithi050.stdout: "motd": { 2024-08-31T04:38:38.462 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "motd", 2024-08-31T04:38:38.462 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.462 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.462 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.462 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-08-31T04:38:38.462 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.462 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.462 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.462 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "The message of the day", 2024-08-31T04:38:38.462 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.462 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.462 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.462 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.463 INFO:teuthology.orchestra.run.smithi050.stdout: "redirect_resolve_ip_addr": { 2024-08-31T04:38:38.463 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "redirect_resolve_ip_addr", 2024-08-31T04:38:38.463 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:38.463 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.463 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.463 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-08-31T04:38:38.463 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.463 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.463 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.463 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.463 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.463 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.464 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.464 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.464 INFO:teuthology.orchestra.run.smithi050.stdout: "server_addr": { 2024-08-31T04:38:38.464 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "server_addr", 2024-08-31T04:38:38.464 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.464 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.464 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.464 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "::", 2024-08-31T04:38:38.464 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.464 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.464 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.464 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.464 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.464 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.465 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.465 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.465 INFO:teuthology.orchestra.run.smithi050.stdout: "server_port": { 2024-08-31T04:38:38.465 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "server_port", 2024-08-31T04:38:38.465 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-08-31T04:38:38.465 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.465 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.465 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "8080", 2024-08-31T04:38:38.465 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.465 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.465 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.465 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.465 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.465 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.466 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.466 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.466 INFO:teuthology.orchestra.run.smithi050.stdout: "sqlite3_killpoint": { 2024-08-31T04:38:38.466 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "sqlite3_killpoint", 2024-08-31T04:38:38.466 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-08-31T04:38:38.466 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "dev", 2024-08-31T04:38:38.466 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.466 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "0", 2024-08-31T04:38:38.466 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.466 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.466 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.466 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.466 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.466 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.467 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.467 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.467 INFO:teuthology.orchestra.run.smithi050.stdout: "ssl": { 2024-08-31T04:38:38.467 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "ssl", 2024-08-31T04:38:38.467 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:38.467 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.467 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.467 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2024-08-31T04:38:38.467 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.467 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.467 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.467 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.467 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.467 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.468 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.468 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.468 INFO:teuthology.orchestra.run.smithi050.stdout: "ssl_server_port": { 2024-08-31T04:38:38.468 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "ssl_server_port", 2024-08-31T04:38:38.468 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-08-31T04:38:38.468 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.468 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.468 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "8443", 2024-08-31T04:38:38.468 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.468 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.468 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.468 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.468 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.468 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.469 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.469 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.469 INFO:teuthology.orchestra.run.smithi050.stdout: "standby_behaviour": { 2024-08-31T04:38:38.469 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "standby_behaviour", 2024-08-31T04:38:38.469 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.469 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.469 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.469 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "redirect", 2024-08-31T04:38:38.469 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.469 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.469 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-08-31T04:38:38.469 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-08-31T04:38:38.469 INFO:teuthology.orchestra.run.smithi050.stdout: "redirect" 2024-08-31T04:38:38.469 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-08-31T04:38:38.470 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.470 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.470 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.470 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.470 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.470 INFO:teuthology.orchestra.run.smithi050.stdout: "standby_error_status_code": { 2024-08-31T04:38:38.470 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "standby_error_status_code", 2024-08-31T04:38:38.470 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-08-31T04:38:38.470 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.470 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.470 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "500", 2024-08-31T04:38:38.470 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "400", 2024-08-31T04:38:38.470 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "599", 2024-08-31T04:38:38.470 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.471 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.471 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.471 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.471 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.471 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.471 INFO:teuthology.orchestra.run.smithi050.stdout: "url_prefix": { 2024-08-31T04:38:38.471 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "url_prefix", 2024-08-31T04:38:38.471 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.471 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.471 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.471 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-08-31T04:38:38.471 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.471 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.472 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.472 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.472 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.472 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.472 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.472 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T04:38:38.472 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T04:38:38.472 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.472 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-08-31T04:38:38.472 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "devicehealth", 2024-08-31T04:38:38.472 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2024-08-31T04:38:38.472 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2024-08-31T04:38:38.472 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2024-08-31T04:38:38.472 INFO:teuthology.orchestra.run.smithi050.stdout: "enable_monitoring": { 2024-08-31T04:38:38.473 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "enable_monitoring", 2024-08-31T04:38:38.473 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:38.473 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.473 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.473 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2024-08-31T04:38:38.473 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.473 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.473 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.473 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "monitor device health metrics", 2024-08-31T04:38:38.473 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.473 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.473 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.473 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.473 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2024-08-31T04:38:38.474 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2024-08-31T04:38:38.474 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.474 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.474 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.474 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-08-31T04:38:38.474 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.474 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.474 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-08-31T04:38:38.474 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-08-31T04:38:38.474 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-08-31T04:38:38.474 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-08-31T04:38:38.474 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-08-31T04:38:38.474 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-08-31T04:38:38.474 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-08-31T04:38:38.475 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-08-31T04:38:38.475 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.475 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.475 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.475 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.475 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.475 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2024-08-31T04:38:38.475 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2024-08-31T04:38:38.475 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:38.475 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.475 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.475 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-08-31T04:38:38.475 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.475 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.475 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.476 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.476 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.476 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.476 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.476 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.476 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2024-08-31T04:38:38.476 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2024-08-31T04:38:38.476 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.476 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.476 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.476 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2024-08-31T04:38:38.476 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.476 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.477 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-08-31T04:38:38.477 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-08-31T04:38:38.477 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-08-31T04:38:38.477 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-08-31T04:38:38.477 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-08-31T04:38:38.477 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-08-31T04:38:38.477 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-08-31T04:38:38.477 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-08-31T04:38:38.477 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.477 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.478 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.478 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.478 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.478 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2024-08-31T04:38:38.478 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2024-08-31T04:38:38.478 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:38.478 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.478 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.478 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-08-31T04:38:38.478 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.478 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.478 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.478 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.478 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.479 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.479 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.479 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.479 INFO:teuthology.orchestra.run.smithi050.stdout: "mark_out_threshold": { 2024-08-31T04:38:38.479 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "mark_out_threshold", 2024-08-31T04:38:38.479 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "secs", 2024-08-31T04:38:38.479 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.479 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.479 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "2419200", 2024-08-31T04:38:38.479 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.479 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.479 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.479 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-08-31T04:38:38.480 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.480 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.480 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.480 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.480 INFO:teuthology.orchestra.run.smithi050.stdout: "pool_name": { 2024-08-31T04:38:38.480 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "pool_name", 2024-08-31T04:38:38.480 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.480 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.480 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.480 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "device_health_metrics", 2024-08-31T04:38:38.480 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.480 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.480 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.480 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "name of pool in which to store device health metrics", 2024-08-31T04:38:38.481 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.481 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.481 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.481 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.481 INFO:teuthology.orchestra.run.smithi050.stdout: "retention_period": { 2024-08-31T04:38:38.481 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "retention_period", 2024-08-31T04:38:38.481 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "secs", 2024-08-31T04:38:38.481 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.481 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.481 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "15552000", 2024-08-31T04:38:38.481 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.481 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.481 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.481 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "how long to retain device health metrics", 2024-08-31T04:38:38.482 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.482 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.482 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.482 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.482 INFO:teuthology.orchestra.run.smithi050.stdout: "scrape_frequency": { 2024-08-31T04:38:38.482 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "scrape_frequency", 2024-08-31T04:38:38.482 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "secs", 2024-08-31T04:38:38.482 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.482 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.482 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "86400", 2024-08-31T04:38:38.482 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.482 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.482 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.482 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "how frequently to scrape device health metrics", 2024-08-31T04:38:38.483 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.483 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.483 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.483 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.483 INFO:teuthology.orchestra.run.smithi050.stdout: "self_heal": { 2024-08-31T04:38:38.483 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "self_heal", 2024-08-31T04:38:38.483 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:38.483 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.483 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.483 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2024-08-31T04:38:38.483 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.483 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.483 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.483 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-08-31T04:38:38.483 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.484 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.484 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.484 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.484 INFO:teuthology.orchestra.run.smithi050.stdout: "sleep_interval": { 2024-08-31T04:38:38.484 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "sleep_interval", 2024-08-31T04:38:38.484 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "secs", 2024-08-31T04:38:38.484 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.484 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.484 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "600", 2024-08-31T04:38:38.484 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.484 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.484 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.484 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "how frequently to wake up and check device health", 2024-08-31T04:38:38.484 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.485 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.485 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.485 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.485 INFO:teuthology.orchestra.run.smithi050.stdout: "sqlite3_killpoint": { 2024-08-31T04:38:38.485 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "sqlite3_killpoint", 2024-08-31T04:38:38.485 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-08-31T04:38:38.485 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "dev", 2024-08-31T04:38:38.485 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.485 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "0", 2024-08-31T04:38:38.485 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.485 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.485 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.485 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.485 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.485 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.485 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.486 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.486 INFO:teuthology.orchestra.run.smithi050.stdout: "warn_threshold": { 2024-08-31T04:38:38.486 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "warn_threshold", 2024-08-31T04:38:38.486 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "secs", 2024-08-31T04:38:38.486 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.486 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.486 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "7257600", 2024-08-31T04:38:38.486 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.486 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.486 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.486 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-08-31T04:38:38.486 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.486 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.486 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.486 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T04:38:38.487 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T04:38:38.487 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.487 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-08-31T04:38:38.487 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "diskprediction_local", 2024-08-31T04:38:38.487 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2024-08-31T04:38:38.487 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2024-08-31T04:38:38.487 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2024-08-31T04:38:38.487 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2024-08-31T04:38:38.487 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2024-08-31T04:38:38.487 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.487 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.487 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.487 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-08-31T04:38:38.488 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.488 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.488 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-08-31T04:38:38.488 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-08-31T04:38:38.488 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-08-31T04:38:38.488 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-08-31T04:38:38.488 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-08-31T04:38:38.488 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-08-31T04:38:38.488 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-08-31T04:38:38.488 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-08-31T04:38:38.488 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.488 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.488 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.488 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.488 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.489 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2024-08-31T04:38:38.489 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2024-08-31T04:38:38.489 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:38.489 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.489 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.489 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-08-31T04:38:38.489 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.489 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.489 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.489 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.489 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.489 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.489 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.490 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.490 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2024-08-31T04:38:38.490 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2024-08-31T04:38:38.490 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.490 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.490 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.490 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2024-08-31T04:38:38.490 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.490 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.490 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-08-31T04:38:38.490 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-08-31T04:38:38.490 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-08-31T04:38:38.491 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-08-31T04:38:38.491 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-08-31T04:38:38.491 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-08-31T04:38:38.491 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-08-31T04:38:38.491 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-08-31T04:38:38.491 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.491 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.491 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.491 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.491 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.491 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2024-08-31T04:38:38.491 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2024-08-31T04:38:38.491 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:38.491 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.492 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.492 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-08-31T04:38:38.492 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.492 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.492 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.492 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.492 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.492 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.492 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.492 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.492 INFO:teuthology.orchestra.run.smithi050.stdout: "predict_interval": { 2024-08-31T04:38:38.492 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "predict_interval", 2024-08-31T04:38:38.492 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.492 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.493 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.493 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "86400", 2024-08-31T04:38:38.493 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.493 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.493 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.493 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.493 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.493 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.493 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.493 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.493 INFO:teuthology.orchestra.run.smithi050.stdout: "predictor_model": { 2024-08-31T04:38:38.493 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "predictor_model", 2024-08-31T04:38:38.493 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.493 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.494 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.494 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "prophetstor", 2024-08-31T04:38:38.494 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.494 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.494 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.494 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.494 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.494 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.494 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.494 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.494 INFO:teuthology.orchestra.run.smithi050.stdout: "sleep_interval": { 2024-08-31T04:38:38.494 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "sleep_interval", 2024-08-31T04:38:38.494 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.495 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.495 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.495 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "600", 2024-08-31T04:38:38.495 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.495 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.495 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.495 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.495 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.495 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.495 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.495 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.495 INFO:teuthology.orchestra.run.smithi050.stdout: "sqlite3_killpoint": { 2024-08-31T04:38:38.495 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "sqlite3_killpoint", 2024-08-31T04:38:38.495 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-08-31T04:38:38.496 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "dev", 2024-08-31T04:38:38.496 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.496 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "0", 2024-08-31T04:38:38.496 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.496 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.496 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.496 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.496 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.496 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.496 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.496 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T04:38:38.496 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T04:38:38.496 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.497 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-08-31T04:38:38.497 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "influx", 2024-08-31T04:38:38.497 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": false, 2024-08-31T04:38:38.497 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "influxdb python module not found", 2024-08-31T04:38:38.497 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2024-08-31T04:38:38.497 INFO:teuthology.orchestra.run.smithi050.stdout: "batch_size": { 2024-08-31T04:38:38.497 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "batch_size", 2024-08-31T04:38:38.497 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-08-31T04:38:38.497 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.497 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.497 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "5000", 2024-08-31T04:38:38.497 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.497 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.498 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.498 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-08-31T04:38:38.498 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.498 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.498 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.498 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.498 INFO:teuthology.orchestra.run.smithi050.stdout: "database": { 2024-08-31T04:38:38.498 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "database", 2024-08-31T04:38:38.498 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.498 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.498 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.498 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "ceph", 2024-08-31T04:38:38.498 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.498 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.499 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.499 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-08-31T04:38:38.499 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.499 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.499 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.499 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.499 INFO:teuthology.orchestra.run.smithi050.stdout: "hostname": { 2024-08-31T04:38:38.499 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "hostname", 2024-08-31T04:38:38.499 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.499 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.499 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.499 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-08-31T04:38:38.499 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.499 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.499 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.500 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "InfluxDB server hostname", 2024-08-31T04:38:38.500 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.500 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.500 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.500 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.500 INFO:teuthology.orchestra.run.smithi050.stdout: "interval": { 2024-08-31T04:38:38.500 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "interval", 2024-08-31T04:38:38.500 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "secs", 2024-08-31T04:38:38.500 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.500 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.500 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "30", 2024-08-31T04:38:38.500 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "5", 2024-08-31T04:38:38.500 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.501 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.501 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-08-31T04:38:38.501 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.501 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.501 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.501 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.501 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2024-08-31T04:38:38.501 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2024-08-31T04:38:38.501 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.501 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.501 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.501 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-08-31T04:38:38.501 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.501 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.502 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-08-31T04:38:38.502 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-08-31T04:38:38.502 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-08-31T04:38:38.502 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-08-31T04:38:38.502 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-08-31T04:38:38.502 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-08-31T04:38:38.502 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-08-31T04:38:38.502 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-08-31T04:38:38.502 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.502 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.502 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.502 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.502 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.502 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2024-08-31T04:38:38.502 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2024-08-31T04:38:38.503 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:38.503 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.503 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.503 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-08-31T04:38:38.503 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.503 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.503 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.503 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.503 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.503 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.503 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.503 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.503 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2024-08-31T04:38:38.503 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2024-08-31T04:38:38.504 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.504 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.504 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.504 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2024-08-31T04:38:38.504 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.504 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.504 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-08-31T04:38:38.504 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-08-31T04:38:38.504 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-08-31T04:38:38.504 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-08-31T04:38:38.504 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-08-31T04:38:38.504 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-08-31T04:38:38.504 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-08-31T04:38:38.504 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-08-31T04:38:38.505 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.505 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.505 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.505 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.505 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.505 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2024-08-31T04:38:38.505 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2024-08-31T04:38:38.505 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:38.505 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.505 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.505 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-08-31T04:38:38.505 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.505 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.506 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.506 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.506 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.506 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.506 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.506 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.506 INFO:teuthology.orchestra.run.smithi050.stdout: "password": { 2024-08-31T04:38:38.506 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "password", 2024-08-31T04:38:38.506 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.506 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.506 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.506 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-08-31T04:38:38.506 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.506 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.506 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.507 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "password of InfluxDB server user", 2024-08-31T04:38:38.507 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.507 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.507 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.507 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.507 INFO:teuthology.orchestra.run.smithi050.stdout: "port": { 2024-08-31T04:38:38.507 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "port", 2024-08-31T04:38:38.507 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-08-31T04:38:38.507 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.507 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.507 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "8086", 2024-08-31T04:38:38.507 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.507 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.507 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.507 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "InfluxDB server port", 2024-08-31T04:38:38.507 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.508 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.508 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.508 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.508 INFO:teuthology.orchestra.run.smithi050.stdout: "sqlite3_killpoint": { 2024-08-31T04:38:38.508 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "sqlite3_killpoint", 2024-08-31T04:38:38.508 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-08-31T04:38:38.508 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "dev", 2024-08-31T04:38:38.508 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.508 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "0", 2024-08-31T04:38:38.508 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.508 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.508 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.508 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.508 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.509 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.509 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.509 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.509 INFO:teuthology.orchestra.run.smithi050.stdout: "ssl": { 2024-08-31T04:38:38.509 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "ssl", 2024-08-31T04:38:38.509 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.509 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.509 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.509 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "false", 2024-08-31T04:38:38.509 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.509 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.509 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.509 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-08-31T04:38:38.510 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.510 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.510 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.510 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.510 INFO:teuthology.orchestra.run.smithi050.stdout: "threads": { 2024-08-31T04:38:38.510 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "threads", 2024-08-31T04:38:38.510 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-08-31T04:38:38.510 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.510 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.510 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "5", 2024-08-31T04:38:38.510 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "1", 2024-08-31T04:38:38.510 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "32", 2024-08-31T04:38:38.510 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.510 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-08-31T04:38:38.510 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.511 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.511 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.511 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.511 INFO:teuthology.orchestra.run.smithi050.stdout: "username": { 2024-08-31T04:38:38.511 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "username", 2024-08-31T04:38:38.511 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.511 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.511 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.511 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-08-31T04:38:38.511 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.511 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.511 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.511 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "username of InfluxDB server user", 2024-08-31T04:38:38.511 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.511 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.512 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.512 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.512 INFO:teuthology.orchestra.run.smithi050.stdout: "verify_ssl": { 2024-08-31T04:38:38.512 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "verify_ssl", 2024-08-31T04:38:38.512 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.512 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.512 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.512 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "true", 2024-08-31T04:38:38.512 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.512 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.512 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.512 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-08-31T04:38:38.512 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.513 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.513 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.513 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T04:38:38.513 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T04:38:38.513 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.513 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-08-31T04:38:38.513 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "insights", 2024-08-31T04:38:38.513 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2024-08-31T04:38:38.513 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2024-08-31T04:38:38.513 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2024-08-31T04:38:38.513 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2024-08-31T04:38:38.513 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2024-08-31T04:38:38.513 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.513 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.514 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.514 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-08-31T04:38:38.514 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.514 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.514 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-08-31T04:38:38.514 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-08-31T04:38:38.514 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-08-31T04:38:38.514 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-08-31T04:38:38.514 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-08-31T04:38:38.514 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-08-31T04:38:38.514 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-08-31T04:38:38.514 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-08-31T04:38:38.514 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.514 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.514 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.515 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.515 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.515 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2024-08-31T04:38:38.515 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2024-08-31T04:38:38.515 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:38.515 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.515 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.515 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-08-31T04:38:38.515 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.515 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.515 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.515 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.515 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.515 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.515 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.516 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.516 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2024-08-31T04:38:38.516 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2024-08-31T04:38:38.516 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.516 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.516 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.516 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2024-08-31T04:38:38.516 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.516 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.516 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-08-31T04:38:38.516 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-08-31T04:38:38.516 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-08-31T04:38:38.516 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-08-31T04:38:38.516 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-08-31T04:38:38.516 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-08-31T04:38:38.517 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-08-31T04:38:38.517 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-08-31T04:38:38.517 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.517 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.517 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.517 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.517 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.517 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2024-08-31T04:38:38.517 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2024-08-31T04:38:38.517 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:38.517 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.517 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.517 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-08-31T04:38:38.517 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.518 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.518 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.518 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.518 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.518 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.518 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.518 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.518 INFO:teuthology.orchestra.run.smithi050.stdout: "sqlite3_killpoint": { 2024-08-31T04:38:38.518 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "sqlite3_killpoint", 2024-08-31T04:38:38.518 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-08-31T04:38:38.518 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "dev", 2024-08-31T04:38:38.518 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.518 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "0", 2024-08-31T04:38:38.519 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.519 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.519 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.519 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.519 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.519 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.519 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.519 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T04:38:38.519 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T04:38:38.519 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.519 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-08-31T04:38:38.519 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "iostat", 2024-08-31T04:38:38.520 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2024-08-31T04:38:38.520 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2024-08-31T04:38:38.520 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2024-08-31T04:38:38.520 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2024-08-31T04:38:38.520 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2024-08-31T04:38:38.520 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.520 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.520 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.520 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-08-31T04:38:38.520 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.520 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.520 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-08-31T04:38:38.521 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-08-31T04:38:38.521 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-08-31T04:38:38.521 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-08-31T04:38:38.521 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-08-31T04:38:38.521 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-08-31T04:38:38.521 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-08-31T04:38:38.521 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-08-31T04:38:38.521 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.521 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.521 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.521 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.521 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.521 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2024-08-31T04:38:38.522 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2024-08-31T04:38:38.522 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:38.522 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.522 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.522 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-08-31T04:38:38.522 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.522 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.522 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.522 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.522 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.522 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.522 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.522 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.522 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2024-08-31T04:38:38.523 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2024-08-31T04:38:38.523 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.523 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.523 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.523 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2024-08-31T04:38:38.523 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.523 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.523 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-08-31T04:38:38.523 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-08-31T04:38:38.523 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-08-31T04:38:38.523 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-08-31T04:38:38.523 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-08-31T04:38:38.523 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-08-31T04:38:38.523 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-08-31T04:38:38.524 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-08-31T04:38:38.524 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.524 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.524 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.524 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.524 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.524 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2024-08-31T04:38:38.524 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2024-08-31T04:38:38.524 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:38.524 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.524 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.524 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-08-31T04:38:38.524 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.525 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.525 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.525 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.525 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.525 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.525 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.525 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.525 INFO:teuthology.orchestra.run.smithi050.stdout: "sqlite3_killpoint": { 2024-08-31T04:38:38.525 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "sqlite3_killpoint", 2024-08-31T04:38:38.525 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-08-31T04:38:38.525 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "dev", 2024-08-31T04:38:38.525 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.525 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "0", 2024-08-31T04:38:38.525 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.526 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.526 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.526 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.526 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.526 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.526 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.526 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T04:38:38.526 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T04:38:38.526 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.526 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-08-31T04:38:38.526 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "k8sevents", 2024-08-31T04:38:38.526 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2024-08-31T04:38:38.526 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2024-08-31T04:38:38.526 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2024-08-31T04:38:38.527 INFO:teuthology.orchestra.run.smithi050.stdout: "ceph_event_retention_days": { 2024-08-31T04:38:38.527 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "ceph_event_retention_days", 2024-08-31T04:38:38.527 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-08-31T04:38:38.527 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.527 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.527 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "7", 2024-08-31T04:38:38.527 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.527 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.527 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.527 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Days to hold ceph event information within local cache", 2024-08-31T04:38:38.527 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.527 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.527 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.527 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.528 INFO:teuthology.orchestra.run.smithi050.stdout: "config_check_secs": { 2024-08-31T04:38:38.528 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "config_check_secs", 2024-08-31T04:38:38.528 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-08-31T04:38:38.528 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.528 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.528 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "10", 2024-08-31T04:38:38.528 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "10", 2024-08-31T04:38:38.528 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.528 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.528 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-08-31T04:38:38.528 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.528 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.528 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.528 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.529 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2024-08-31T04:38:38.529 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2024-08-31T04:38:38.529 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.529 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.529 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.529 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-08-31T04:38:38.529 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.529 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.529 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-08-31T04:38:38.529 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-08-31T04:38:38.529 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-08-31T04:38:38.529 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-08-31T04:38:38.529 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-08-31T04:38:38.530 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-08-31T04:38:38.530 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-08-31T04:38:38.530 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-08-31T04:38:38.530 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.530 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.530 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.530 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.530 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.530 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2024-08-31T04:38:38.530 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2024-08-31T04:38:38.530 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:38.530 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.531 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.531 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-08-31T04:38:38.531 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.531 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.531 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.531 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.531 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.531 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.531 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.531 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.531 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2024-08-31T04:38:38.531 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2024-08-31T04:38:38.531 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.531 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.532 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.532 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2024-08-31T04:38:38.532 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.532 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.532 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-08-31T04:38:38.532 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-08-31T04:38:38.532 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-08-31T04:38:38.532 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-08-31T04:38:38.532 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-08-31T04:38:38.532 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-08-31T04:38:38.532 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-08-31T04:38:38.532 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-08-31T04:38:38.532 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.533 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.533 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.533 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.533 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.533 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2024-08-31T04:38:38.533 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2024-08-31T04:38:38.533 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:38.533 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.533 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.533 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-08-31T04:38:38.533 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.533 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.533 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.533 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.533 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.534 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.534 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.534 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.534 INFO:teuthology.orchestra.run.smithi050.stdout: "sqlite3_killpoint": { 2024-08-31T04:38:38.534 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "sqlite3_killpoint", 2024-08-31T04:38:38.534 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-08-31T04:38:38.534 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "dev", 2024-08-31T04:38:38.534 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.534 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "0", 2024-08-31T04:38:38.534 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.534 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.534 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.534 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.534 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.535 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.535 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.535 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T04:38:38.535 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T04:38:38.535 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.535 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-08-31T04:38:38.535 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "localpool", 2024-08-31T04:38:38.535 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2024-08-31T04:38:38.535 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2024-08-31T04:38:38.535 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2024-08-31T04:38:38.535 INFO:teuthology.orchestra.run.smithi050.stdout: "failure_domain": { 2024-08-31T04:38:38.535 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "failure_domain", 2024-08-31T04:38:38.535 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.535 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.536 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.536 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "host", 2024-08-31T04:38:38.536 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.536 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.536 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.536 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "failure domain for any created local pool", 2024-08-31T04:38:38.536 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-08-31T04:38:38.536 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.536 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.536 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.536 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2024-08-31T04:38:38.536 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2024-08-31T04:38:38.536 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.536 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.537 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.537 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-08-31T04:38:38.537 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.537 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.537 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-08-31T04:38:38.537 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-08-31T04:38:38.537 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-08-31T04:38:38.537 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-08-31T04:38:38.537 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-08-31T04:38:38.537 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-08-31T04:38:38.537 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-08-31T04:38:38.537 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-08-31T04:38:38.537 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.538 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.538 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.538 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.538 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.538 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2024-08-31T04:38:38.538 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2024-08-31T04:38:38.538 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:38.538 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.538 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.538 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-08-31T04:38:38.538 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.538 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.538 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.538 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.539 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.539 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.539 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.539 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.539 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2024-08-31T04:38:38.539 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2024-08-31T04:38:38.539 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.539 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.539 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.539 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2024-08-31T04:38:38.539 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.539 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.539 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-08-31T04:38:38.540 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-08-31T04:38:38.540 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-08-31T04:38:38.540 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-08-31T04:38:38.540 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-08-31T04:38:38.540 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-08-31T04:38:38.540 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-08-31T04:38:38.540 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-08-31T04:38:38.540 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.540 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.540 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.540 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.540 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.540 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2024-08-31T04:38:38.541 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2024-08-31T04:38:38.541 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:38.541 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.541 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.541 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-08-31T04:38:38.541 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.541 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.541 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.541 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.541 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.541 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.541 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.541 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.542 INFO:teuthology.orchestra.run.smithi050.stdout: "min_size": { 2024-08-31T04:38:38.542 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "min_size", 2024-08-31T04:38:38.542 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-08-31T04:38:38.542 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.542 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.542 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-08-31T04:38:38.542 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.542 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.542 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.542 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "default min_size for any created local pool", 2024-08-31T04:38:38.542 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-08-31T04:38:38.542 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.542 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.542 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.543 INFO:teuthology.orchestra.run.smithi050.stdout: "num_rep": { 2024-08-31T04:38:38.543 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "num_rep", 2024-08-31T04:38:38.543 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-08-31T04:38:38.543 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.543 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.543 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "3", 2024-08-31T04:38:38.543 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.543 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.543 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.543 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "default replica count for any created local pool", 2024-08-31T04:38:38.543 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.543 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.543 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.543 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.543 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num": { 2024-08-31T04:38:38.544 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "pg_num", 2024-08-31T04:38:38.544 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-08-31T04:38:38.544 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.544 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.544 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "128", 2024-08-31T04:38:38.544 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.544 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.544 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.544 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "default pg_num for any created local pool", 2024-08-31T04:38:38.544 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.544 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.544 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.544 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.544 INFO:teuthology.orchestra.run.smithi050.stdout: "prefix": { 2024-08-31T04:38:38.544 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "prefix", 2024-08-31T04:38:38.545 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.545 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.545 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.545 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-08-31T04:38:38.545 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.545 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.545 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.545 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "name prefix for any created local pool", 2024-08-31T04:38:38.545 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.545 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.545 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.545 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.545 INFO:teuthology.orchestra.run.smithi050.stdout: "sqlite3_killpoint": { 2024-08-31T04:38:38.545 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "sqlite3_killpoint", 2024-08-31T04:38:38.546 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-08-31T04:38:38.546 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "dev", 2024-08-31T04:38:38.546 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.546 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "0", 2024-08-31T04:38:38.546 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.546 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.546 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.546 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.546 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.546 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.546 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.546 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.546 INFO:teuthology.orchestra.run.smithi050.stdout: "subtree": { 2024-08-31T04:38:38.546 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "subtree", 2024-08-31T04:38:38.547 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.547 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.547 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.547 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "rack", 2024-08-31T04:38:38.547 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.547 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.547 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.547 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "CRUSH level for which to create a local pool", 2024-08-31T04:38:38.547 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-08-31T04:38:38.547 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.547 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.547 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T04:38:38.547 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T04:38:38.547 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.547 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-08-31T04:38:38.548 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "mds_autoscaler", 2024-08-31T04:38:38.548 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2024-08-31T04:38:38.548 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2024-08-31T04:38:38.548 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2024-08-31T04:38:38.548 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2024-08-31T04:38:38.548 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2024-08-31T04:38:38.548 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.548 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.548 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.548 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-08-31T04:38:38.548 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.548 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.548 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-08-31T04:38:38.549 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-08-31T04:38:38.549 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-08-31T04:38:38.549 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-08-31T04:38:38.549 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-08-31T04:38:38.549 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-08-31T04:38:38.549 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-08-31T04:38:38.549 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-08-31T04:38:38.549 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.549 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.549 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.549 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.549 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.549 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2024-08-31T04:38:38.550 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2024-08-31T04:38:38.550 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:38.550 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.550 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.550 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-08-31T04:38:38.550 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.550 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.550 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.550 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.550 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.550 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.550 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.550 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.551 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2024-08-31T04:38:38.551 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2024-08-31T04:38:38.551 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.551 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.551 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.551 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2024-08-31T04:38:38.551 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.551 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.551 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-08-31T04:38:38.551 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-08-31T04:38:38.551 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-08-31T04:38:38.551 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-08-31T04:38:38.551 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-08-31T04:38:38.551 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-08-31T04:38:38.552 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-08-31T04:38:38.552 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-08-31T04:38:38.552 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.552 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.552 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.552 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.552 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.552 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2024-08-31T04:38:38.552 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2024-08-31T04:38:38.552 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:38.552 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.552 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.552 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-08-31T04:38:38.553 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.553 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.553 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.553 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.553 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.553 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.553 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.553 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.553 INFO:teuthology.orchestra.run.smithi050.stdout: "sqlite3_killpoint": { 2024-08-31T04:38:38.553 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "sqlite3_killpoint", 2024-08-31T04:38:38.553 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-08-31T04:38:38.553 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "dev", 2024-08-31T04:38:38.553 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.554 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "0", 2024-08-31T04:38:38.554 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.554 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.554 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.554 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.554 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.554 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.554 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.554 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T04:38:38.554 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T04:38:38.554 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.554 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-08-31T04:38:38.554 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "mirroring", 2024-08-31T04:38:38.554 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2024-08-31T04:38:38.555 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2024-08-31T04:38:38.555 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2024-08-31T04:38:38.555 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2024-08-31T04:38:38.555 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2024-08-31T04:38:38.555 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.555 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.555 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.555 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-08-31T04:38:38.555 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.555 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.555 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-08-31T04:38:38.555 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-08-31T04:38:38.555 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-08-31T04:38:38.555 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-08-31T04:38:38.556 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-08-31T04:38:38.556 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-08-31T04:38:38.556 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-08-31T04:38:38.556 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-08-31T04:38:38.556 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.556 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.556 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.556 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.556 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.556 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2024-08-31T04:38:38.556 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2024-08-31T04:38:38.556 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:38.556 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.557 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.557 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-08-31T04:38:38.557 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.557 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.557 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.557 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.557 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.557 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.557 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.557 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.557 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2024-08-31T04:38:38.557 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2024-08-31T04:38:38.557 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.557 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.557 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.558 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2024-08-31T04:38:38.558 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.558 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.558 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-08-31T04:38:38.558 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-08-31T04:38:38.558 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-08-31T04:38:38.558 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-08-31T04:38:38.558 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-08-31T04:38:38.558 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-08-31T04:38:38.558 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-08-31T04:38:38.558 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-08-31T04:38:38.558 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.558 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.558 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.559 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.559 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.559 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2024-08-31T04:38:38.559 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2024-08-31T04:38:38.559 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:38.559 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.559 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.559 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-08-31T04:38:38.559 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.559 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.559 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.559 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.559 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.560 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.560 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.560 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.560 INFO:teuthology.orchestra.run.smithi050.stdout: "sqlite3_killpoint": { 2024-08-31T04:38:38.560 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "sqlite3_killpoint", 2024-08-31T04:38:38.560 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-08-31T04:38:38.560 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "dev", 2024-08-31T04:38:38.560 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.560 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "0", 2024-08-31T04:38:38.560 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.560 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.560 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.561 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.561 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.561 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.561 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.561 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T04:38:38.561 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T04:38:38.561 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.561 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-08-31T04:38:38.561 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "nfs", 2024-08-31T04:38:38.561 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2024-08-31T04:38:38.561 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2024-08-31T04:38:38.561 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2024-08-31T04:38:38.561 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2024-08-31T04:38:38.561 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2024-08-31T04:38:38.562 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.562 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.562 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.562 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-08-31T04:38:38.562 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.562 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.562 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-08-31T04:38:38.562 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-08-31T04:38:38.562 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-08-31T04:38:38.562 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-08-31T04:38:38.562 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-08-31T04:38:38.562 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-08-31T04:38:38.562 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-08-31T04:38:38.562 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-08-31T04:38:38.563 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.563 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.563 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.563 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.563 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.563 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2024-08-31T04:38:38.563 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2024-08-31T04:38:38.563 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:38.563 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.563 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.563 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-08-31T04:38:38.563 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.563 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.563 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.563 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.563 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.564 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.564 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.564 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.564 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2024-08-31T04:38:38.564 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2024-08-31T04:38:38.564 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.564 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.564 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.564 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2024-08-31T04:38:38.564 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.564 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.564 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-08-31T04:38:38.564 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-08-31T04:38:38.565 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-08-31T04:38:38.565 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-08-31T04:38:38.565 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-08-31T04:38:38.565 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-08-31T04:38:38.565 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-08-31T04:38:38.565 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-08-31T04:38:38.565 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.565 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.565 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.565 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.565 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.565 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2024-08-31T04:38:38.565 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2024-08-31T04:38:38.565 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:38.566 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.566 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.566 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-08-31T04:38:38.566 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.566 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.566 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.566 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.566 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.566 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.566 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.566 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.566 INFO:teuthology.orchestra.run.smithi050.stdout: "sqlite3_killpoint": { 2024-08-31T04:38:38.566 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "sqlite3_killpoint", 2024-08-31T04:38:38.566 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-08-31T04:38:38.566 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "dev", 2024-08-31T04:38:38.567 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.567 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "0", 2024-08-31T04:38:38.567 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.567 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.567 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.567 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.567 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.567 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.567 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.567 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T04:38:38.567 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T04:38:38.567 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.567 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-08-31T04:38:38.567 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "orchestrator", 2024-08-31T04:38:38.568 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2024-08-31T04:38:38.568 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2024-08-31T04:38:38.568 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2024-08-31T04:38:38.568 INFO:teuthology.orchestra.run.smithi050.stdout: "fail_fs": { 2024-08-31T04:38:38.568 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "fail_fs", 2024-08-31T04:38:38.568 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:38.568 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.568 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.568 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-08-31T04:38:38.568 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.568 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.568 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.568 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-08-31T04:38:38.569 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.569 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.569 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.569 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.569 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2024-08-31T04:38:38.569 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2024-08-31T04:38:38.569 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.569 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.569 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.569 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-08-31T04:38:38.569 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.569 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.569 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-08-31T04:38:38.569 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-08-31T04:38:38.570 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-08-31T04:38:38.570 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-08-31T04:38:38.570 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-08-31T04:38:38.570 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-08-31T04:38:38.570 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-08-31T04:38:38.570 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-08-31T04:38:38.570 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.570 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.570 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.570 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.570 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.570 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2024-08-31T04:38:38.570 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2024-08-31T04:38:38.570 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:38.571 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.571 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.571 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-08-31T04:38:38.571 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.571 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.571 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.571 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.571 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.571 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.571 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.571 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.571 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2024-08-31T04:38:38.571 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2024-08-31T04:38:38.571 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.571 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.572 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.572 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2024-08-31T04:38:38.572 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.572 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.572 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-08-31T04:38:38.572 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-08-31T04:38:38.572 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-08-31T04:38:38.572 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-08-31T04:38:38.572 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-08-31T04:38:38.572 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-08-31T04:38:38.572 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-08-31T04:38:38.572 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-08-31T04:38:38.572 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.573 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.573 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.573 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.573 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.573 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2024-08-31T04:38:38.573 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2024-08-31T04:38:38.573 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:38.573 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.573 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.573 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-08-31T04:38:38.573 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.573 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.573 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.573 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.574 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.574 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.574 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.574 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.574 INFO:teuthology.orchestra.run.smithi050.stdout: "orchestrator": { 2024-08-31T04:38:38.574 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "orchestrator", 2024-08-31T04:38:38.574 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.574 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.574 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.574 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-08-31T04:38:38.574 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.574 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.574 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-08-31T04:38:38.574 INFO:teuthology.orchestra.run.smithi050.stdout: "cephadm", 2024-08-31T04:38:38.575 INFO:teuthology.orchestra.run.smithi050.stdout: "rook", 2024-08-31T04:38:38.575 INFO:teuthology.orchestra.run.smithi050.stdout: "test_orchestrator" 2024-08-31T04:38:38.575 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-08-31T04:38:38.575 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Orchestrator backend", 2024-08-31T04:38:38.575 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.575 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.575 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.575 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.575 INFO:teuthology.orchestra.run.smithi050.stdout: "sqlite3_killpoint": { 2024-08-31T04:38:38.575 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "sqlite3_killpoint", 2024-08-31T04:38:38.575 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-08-31T04:38:38.575 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "dev", 2024-08-31T04:38:38.575 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.575 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "0", 2024-08-31T04:38:38.576 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.576 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.576 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.576 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.576 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.576 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.576 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.576 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T04:38:38.576 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T04:38:38.576 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.576 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-08-31T04:38:38.576 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "osd_perf_query", 2024-08-31T04:38:38.576 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2024-08-31T04:38:38.577 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2024-08-31T04:38:38.577 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2024-08-31T04:38:38.577 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2024-08-31T04:38:38.577 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2024-08-31T04:38:38.577 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.577 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.577 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.577 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-08-31T04:38:38.577 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.577 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.577 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-08-31T04:38:38.577 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-08-31T04:38:38.577 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-08-31T04:38:38.577 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-08-31T04:38:38.578 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-08-31T04:38:38.578 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-08-31T04:38:38.578 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-08-31T04:38:38.578 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-08-31T04:38:38.578 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.578 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.578 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.578 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.578 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.578 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2024-08-31T04:38:38.578 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2024-08-31T04:38:38.578 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:38.578 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.578 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.579 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-08-31T04:38:38.579 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.579 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.579 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.579 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.579 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.579 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.579 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.579 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.579 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2024-08-31T04:38:38.579 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2024-08-31T04:38:38.579 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.579 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.580 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.580 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2024-08-31T04:38:38.580 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.580 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.580 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-08-31T04:38:38.580 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-08-31T04:38:38.580 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-08-31T04:38:38.580 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-08-31T04:38:38.580 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-08-31T04:38:38.580 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-08-31T04:38:38.580 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-08-31T04:38:38.580 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-08-31T04:38:38.580 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.580 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.581 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.581 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.581 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.581 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2024-08-31T04:38:38.581 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2024-08-31T04:38:38.581 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:38.581 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.581 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.581 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-08-31T04:38:38.581 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.581 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.581 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.581 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.581 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.582 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.582 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.582 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.582 INFO:teuthology.orchestra.run.smithi050.stdout: "sqlite3_killpoint": { 2024-08-31T04:38:38.582 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "sqlite3_killpoint", 2024-08-31T04:38:38.582 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-08-31T04:38:38.582 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "dev", 2024-08-31T04:38:38.582 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.582 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "0", 2024-08-31T04:38:38.582 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.582 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.582 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.582 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.582 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.583 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.583 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.583 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T04:38:38.583 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T04:38:38.583 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.583 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-08-31T04:38:38.583 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "osd_support", 2024-08-31T04:38:38.583 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2024-08-31T04:38:38.583 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2024-08-31T04:38:38.583 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2024-08-31T04:38:38.583 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2024-08-31T04:38:38.583 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2024-08-31T04:38:38.583 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.583 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.584 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.584 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-08-31T04:38:38.584 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.584 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.584 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-08-31T04:38:38.584 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-08-31T04:38:38.584 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-08-31T04:38:38.584 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-08-31T04:38:38.584 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-08-31T04:38:38.584 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-08-31T04:38:38.584 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-08-31T04:38:38.584 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-08-31T04:38:38.584 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.584 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.585 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.585 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.585 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.585 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2024-08-31T04:38:38.585 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2024-08-31T04:38:38.585 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:38.585 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.585 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.585 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-08-31T04:38:38.585 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.585 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.585 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.585 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.585 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.586 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.586 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.586 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.586 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2024-08-31T04:38:38.586 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2024-08-31T04:38:38.586 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.586 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.586 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.586 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2024-08-31T04:38:38.586 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.586 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.586 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-08-31T04:38:38.586 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-08-31T04:38:38.586 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-08-31T04:38:38.587 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-08-31T04:38:38.587 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-08-31T04:38:38.587 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-08-31T04:38:38.587 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-08-31T04:38:38.587 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-08-31T04:38:38.587 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.587 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.587 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.587 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.587 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.587 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2024-08-31T04:38:38.587 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2024-08-31T04:38:38.587 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:38.587 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.588 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.588 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-08-31T04:38:38.588 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.588 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.588 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.588 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.588 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.588 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.588 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.588 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.588 INFO:teuthology.orchestra.run.smithi050.stdout: "sqlite3_killpoint": { 2024-08-31T04:38:38.588 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "sqlite3_killpoint", 2024-08-31T04:38:38.589 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-08-31T04:38:38.589 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "dev", 2024-08-31T04:38:38.589 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.589 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "0", 2024-08-31T04:38:38.589 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.589 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.589 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.589 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.589 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.589 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.589 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.589 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T04:38:38.589 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T04:38:38.590 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.590 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-08-31T04:38:38.590 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "pg_autoscaler", 2024-08-31T04:38:38.590 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2024-08-31T04:38:38.590 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2024-08-31T04:38:38.590 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2024-08-31T04:38:38.590 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2024-08-31T04:38:38.590 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2024-08-31T04:38:38.590 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.590 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.590 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.590 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-08-31T04:38:38.591 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.591 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.591 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-08-31T04:38:38.591 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-08-31T04:38:38.591 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-08-31T04:38:38.591 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-08-31T04:38:38.591 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-08-31T04:38:38.591 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-08-31T04:38:38.591 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-08-31T04:38:38.591 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-08-31T04:38:38.591 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.591 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.591 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.591 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.592 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.592 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2024-08-31T04:38:38.592 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2024-08-31T04:38:38.592 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:38.592 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.592 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.592 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-08-31T04:38:38.592 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.592 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.592 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.592 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.592 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.592 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.593 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.593 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.593 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2024-08-31T04:38:38.593 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2024-08-31T04:38:38.593 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.593 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.593 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.593 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2024-08-31T04:38:38.593 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.593 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.593 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-08-31T04:38:38.593 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-08-31T04:38:38.593 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-08-31T04:38:38.593 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-08-31T04:38:38.594 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-08-31T04:38:38.594 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-08-31T04:38:38.594 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-08-31T04:38:38.594 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-08-31T04:38:38.594 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.594 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.594 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.594 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.594 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.594 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2024-08-31T04:38:38.594 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2024-08-31T04:38:38.594 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:38.594 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.595 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.595 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-08-31T04:38:38.595 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.595 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.595 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.595 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.595 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.595 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.595 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.595 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.595 INFO:teuthology.orchestra.run.smithi050.stdout: "sleep_interval": { 2024-08-31T04:38:38.595 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "sleep_interval", 2024-08-31T04:38:38.595 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "secs", 2024-08-31T04:38:38.595 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.596 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.596 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "60", 2024-08-31T04:38:38.596 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.596 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.596 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.596 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.596 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.596 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.596 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.596 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.596 INFO:teuthology.orchestra.run.smithi050.stdout: "sqlite3_killpoint": { 2024-08-31T04:38:38.596 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "sqlite3_killpoint", 2024-08-31T04:38:38.596 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-08-31T04:38:38.597 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "dev", 2024-08-31T04:38:38.597 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.597 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "0", 2024-08-31T04:38:38.597 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.597 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.597 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.597 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.597 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.597 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.597 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.597 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.597 INFO:teuthology.orchestra.run.smithi050.stdout: "threshold": { 2024-08-31T04:38:38.597 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "threshold", 2024-08-31T04:38:38.597 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "float", 2024-08-31T04:38:38.597 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.598 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.598 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "3.0", 2024-08-31T04:38:38.598 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "1.0", 2024-08-31T04:38:38.598 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.598 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.598 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "scaling threshold", 2024-08-31T04:38:38.598 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-08-31T04:38:38.598 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.598 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.598 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T04:38:38.598 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T04:38:38.598 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.598 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-08-31T04:38:38.599 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "progress", 2024-08-31T04:38:38.599 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2024-08-31T04:38:38.599 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2024-08-31T04:38:38.599 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2024-08-31T04:38:38.599 INFO:teuthology.orchestra.run.smithi050.stdout: "allow_pg_recovery_event": { 2024-08-31T04:38:38.599 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "allow_pg_recovery_event", 2024-08-31T04:38:38.599 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:38.599 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.599 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.599 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-08-31T04:38:38.599 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.599 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.599 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.599 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "allow the module to show pg recovery progress", 2024-08-31T04:38:38.600 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.600 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.600 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.600 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.600 INFO:teuthology.orchestra.run.smithi050.stdout: "enabled": { 2024-08-31T04:38:38.600 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "enabled", 2024-08-31T04:38:38.600 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:38.600 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.600 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.600 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2024-08-31T04:38:38.600 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.600 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.600 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.601 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.601 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.601 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.601 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.601 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.601 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2024-08-31T04:38:38.601 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2024-08-31T04:38:38.601 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.601 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.601 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.601 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-08-31T04:38:38.601 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.601 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.601 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-08-31T04:38:38.602 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-08-31T04:38:38.602 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-08-31T04:38:38.602 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-08-31T04:38:38.602 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-08-31T04:38:38.602 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-08-31T04:38:38.602 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-08-31T04:38:38.602 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-08-31T04:38:38.602 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.602 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.602 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.602 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.602 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.602 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2024-08-31T04:38:38.602 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2024-08-31T04:38:38.603 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:38.603 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.603 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.603 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-08-31T04:38:38.603 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.603 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.603 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.603 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.603 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.603 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.603 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.603 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.603 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2024-08-31T04:38:38.603 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2024-08-31T04:38:38.604 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.604 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.604 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.604 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2024-08-31T04:38:38.604 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.604 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.604 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-08-31T04:38:38.604 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-08-31T04:38:38.604 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-08-31T04:38:38.604 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-08-31T04:38:38.604 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-08-31T04:38:38.604 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-08-31T04:38:38.604 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-08-31T04:38:38.604 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-08-31T04:38:38.604 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.605 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.605 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.605 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.605 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.605 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2024-08-31T04:38:38.605 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2024-08-31T04:38:38.605 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:38.605 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.605 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.605 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-08-31T04:38:38.605 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.605 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.605 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.605 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.606 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.606 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.606 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.606 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.606 INFO:teuthology.orchestra.run.smithi050.stdout: "max_completed_events": { 2024-08-31T04:38:38.606 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "max_completed_events", 2024-08-31T04:38:38.606 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-08-31T04:38:38.606 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.606 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.606 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "50", 2024-08-31T04:38:38.606 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.606 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.606 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.607 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "number of past completed events to remember", 2024-08-31T04:38:38.607 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.607 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.607 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.607 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.607 INFO:teuthology.orchestra.run.smithi050.stdout: "sleep_interval": { 2024-08-31T04:38:38.607 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "sleep_interval", 2024-08-31T04:38:38.607 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "secs", 2024-08-31T04:38:38.607 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.607 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.607 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "5", 2024-08-31T04:38:38.607 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.607 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.607 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.607 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "how long the module is going to sleep", 2024-08-31T04:38:38.607 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.608 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.608 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.608 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.608 INFO:teuthology.orchestra.run.smithi050.stdout: "sqlite3_killpoint": { 2024-08-31T04:38:38.608 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "sqlite3_killpoint", 2024-08-31T04:38:38.608 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-08-31T04:38:38.608 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "dev", 2024-08-31T04:38:38.608 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.608 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "0", 2024-08-31T04:38:38.608 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.608 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.608 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.608 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.608 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.608 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.609 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.609 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T04:38:38.609 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T04:38:38.609 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.609 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-08-31T04:38:38.609 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "prometheus", 2024-08-31T04:38:38.609 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2024-08-31T04:38:38.609 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2024-08-31T04:38:38.609 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2024-08-31T04:38:38.609 INFO:teuthology.orchestra.run.smithi050.stdout: "cache": { 2024-08-31T04:38:38.609 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "cache", 2024-08-31T04:38:38.609 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:38.609 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.610 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.610 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2024-08-31T04:38:38.610 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.610 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.610 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.610 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.610 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.610 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.610 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.610 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.610 INFO:teuthology.orchestra.run.smithi050.stdout: "exclude_perf_counters": { 2024-08-31T04:38:38.610 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "exclude_perf_counters", 2024-08-31T04:38:38.610 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:38.610 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.611 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.611 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2024-08-31T04:38:38.611 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.611 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.611 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.611 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-08-31T04:38:38.611 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-08-31T04:38:38.611 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.611 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.611 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.611 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2024-08-31T04:38:38.611 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2024-08-31T04:38:38.611 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.611 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.612 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.612 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-08-31T04:38:38.612 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.612 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.612 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-08-31T04:38:38.612 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-08-31T04:38:38.612 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-08-31T04:38:38.612 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-08-31T04:38:38.612 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-08-31T04:38:38.612 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-08-31T04:38:38.612 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-08-31T04:38:38.612 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-08-31T04:38:38.612 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.613 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.613 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.613 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.613 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.613 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2024-08-31T04:38:38.613 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2024-08-31T04:38:38.613 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:38.613 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.613 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.613 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-08-31T04:38:38.613 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.613 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.613 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.613 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.613 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.614 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.614 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.614 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.614 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2024-08-31T04:38:38.614 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2024-08-31T04:38:38.614 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.614 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.614 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.614 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2024-08-31T04:38:38.614 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.614 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.614 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-08-31T04:38:38.614 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-08-31T04:38:38.615 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-08-31T04:38:38.615 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-08-31T04:38:38.615 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-08-31T04:38:38.615 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-08-31T04:38:38.615 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-08-31T04:38:38.615 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-08-31T04:38:38.615 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.615 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.615 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.615 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.615 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.615 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2024-08-31T04:38:38.615 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2024-08-31T04:38:38.616 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:38.616 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.616 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.616 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-08-31T04:38:38.616 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.616 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.616 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.616 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.616 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.616 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.616 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.616 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.616 INFO:teuthology.orchestra.run.smithi050.stdout: "rbd_stats_pools": { 2024-08-31T04:38:38.616 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "rbd_stats_pools", 2024-08-31T04:38:38.617 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.617 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.617 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.617 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-08-31T04:38:38.617 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.617 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.617 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.617 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.617 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.617 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.617 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.617 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.617 INFO:teuthology.orchestra.run.smithi050.stdout: "rbd_stats_pools_refresh_interval": { 2024-08-31T04:38:38.617 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-08-31T04:38:38.618 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-08-31T04:38:38.618 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.618 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.618 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "300", 2024-08-31T04:38:38.618 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.618 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.618 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.618 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.618 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.618 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.618 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.618 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.618 INFO:teuthology.orchestra.run.smithi050.stdout: "scrape_interval": { 2024-08-31T04:38:38.619 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "scrape_interval", 2024-08-31T04:38:38.619 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "float", 2024-08-31T04:38:38.619 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.619 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.619 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "15.0", 2024-08-31T04:38:38.619 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.619 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.619 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.619 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.619 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.619 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.619 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.619 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.620 INFO:teuthology.orchestra.run.smithi050.stdout: "server_addr": { 2024-08-31T04:38:38.620 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "server_addr", 2024-08-31T04:38:38.620 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.620 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.620 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.620 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "::", 2024-08-31T04:38:38.620 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.620 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.620 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.620 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-08-31T04:38:38.620 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.620 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.620 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.620 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.621 INFO:teuthology.orchestra.run.smithi050.stdout: "server_port": { 2024-08-31T04:38:38.621 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "server_port", 2024-08-31T04:38:38.621 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-08-31T04:38:38.621 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.621 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.621 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "9283", 2024-08-31T04:38:38.621 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.621 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.621 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.621 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-08-31T04:38:38.621 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.621 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.621 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.621 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.621 INFO:teuthology.orchestra.run.smithi050.stdout: "sqlite3_killpoint": { 2024-08-31T04:38:38.622 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "sqlite3_killpoint", 2024-08-31T04:38:38.622 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-08-31T04:38:38.622 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "dev", 2024-08-31T04:38:38.622 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.622 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "0", 2024-08-31T04:38:38.622 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.622 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.622 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.622 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.622 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.622 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.622 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.622 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.623 INFO:teuthology.orchestra.run.smithi050.stdout: "stale_cache_strategy": { 2024-08-31T04:38:38.623 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "stale_cache_strategy", 2024-08-31T04:38:38.623 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.623 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.623 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.623 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "log", 2024-08-31T04:38:38.623 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.623 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.623 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.623 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.623 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.623 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.623 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.623 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.623 INFO:teuthology.orchestra.run.smithi050.stdout: "standby_behaviour": { 2024-08-31T04:38:38.624 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "standby_behaviour", 2024-08-31T04:38:38.624 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.624 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.624 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.624 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "default", 2024-08-31T04:38:38.624 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.624 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.624 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-08-31T04:38:38.624 INFO:teuthology.orchestra.run.smithi050.stdout: "default", 2024-08-31T04:38:38.624 INFO:teuthology.orchestra.run.smithi050.stdout: "error" 2024-08-31T04:38:38.624 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-08-31T04:38:38.624 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.624 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.625 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.625 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.625 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.625 INFO:teuthology.orchestra.run.smithi050.stdout: "standby_error_status_code": { 2024-08-31T04:38:38.625 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "standby_error_status_code", 2024-08-31T04:38:38.625 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-08-31T04:38:38.625 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.625 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.625 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "500", 2024-08-31T04:38:38.625 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "400", 2024-08-31T04:38:38.625 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "599", 2024-08-31T04:38:38.625 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.625 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.625 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.626 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.626 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.626 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T04:38:38.626 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T04:38:38.626 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.626 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-08-31T04:38:38.626 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "rbd_support", 2024-08-31T04:38:38.626 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2024-08-31T04:38:38.626 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2024-08-31T04:38:38.626 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2024-08-31T04:38:38.626 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2024-08-31T04:38:38.626 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2024-08-31T04:38:38.626 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.626 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.627 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.627 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-08-31T04:38:38.627 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.627 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.627 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-08-31T04:38:38.627 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-08-31T04:38:38.627 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-08-31T04:38:38.627 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-08-31T04:38:38.627 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-08-31T04:38:38.627 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-08-31T04:38:38.627 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-08-31T04:38:38.627 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-08-31T04:38:38.627 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.627 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.628 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.628 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.628 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.628 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2024-08-31T04:38:38.628 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2024-08-31T04:38:38.628 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:38.628 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.628 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.628 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-08-31T04:38:38.628 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.628 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.628 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.628 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.629 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.629 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.629 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.629 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.629 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2024-08-31T04:38:38.629 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2024-08-31T04:38:38.629 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.629 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.629 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.629 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2024-08-31T04:38:38.629 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.629 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.629 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-08-31T04:38:38.630 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-08-31T04:38:38.630 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-08-31T04:38:38.630 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-08-31T04:38:38.630 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-08-31T04:38:38.630 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-08-31T04:38:38.630 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-08-31T04:38:38.630 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-08-31T04:38:38.630 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.630 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.630 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.630 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.630 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.630 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2024-08-31T04:38:38.630 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2024-08-31T04:38:38.631 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:38.631 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.631 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.631 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-08-31T04:38:38.631 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.631 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.631 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.631 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.631 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.631 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.631 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.631 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.631 INFO:teuthology.orchestra.run.smithi050.stdout: "max_concurrent_snap_create": { 2024-08-31T04:38:38.632 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "max_concurrent_snap_create", 2024-08-31T04:38:38.632 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-08-31T04:38:38.632 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.632 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.632 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "10", 2024-08-31T04:38:38.632 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.632 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.632 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.632 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.632 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.632 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.632 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.632 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.633 INFO:teuthology.orchestra.run.smithi050.stdout: "mirror_snapshot_schedule": { 2024-08-31T04:38:38.633 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "mirror_snapshot_schedule", 2024-08-31T04:38:38.633 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.633 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.633 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.633 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-08-31T04:38:38.633 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.633 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.633 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.633 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.633 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.633 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.633 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.633 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.634 INFO:teuthology.orchestra.run.smithi050.stdout: "sqlite3_killpoint": { 2024-08-31T04:38:38.634 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "sqlite3_killpoint", 2024-08-31T04:38:38.634 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-08-31T04:38:38.634 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "dev", 2024-08-31T04:38:38.634 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.634 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "0", 2024-08-31T04:38:38.634 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.634 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.634 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.634 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.634 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.634 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.634 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.634 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.635 INFO:teuthology.orchestra.run.smithi050.stdout: "trash_purge_schedule": { 2024-08-31T04:38:38.635 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "trash_purge_schedule", 2024-08-31T04:38:38.635 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.635 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.635 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.635 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-08-31T04:38:38.635 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.635 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.635 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.635 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.635 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.635 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.635 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.636 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T04:38:38.636 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T04:38:38.636 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.636 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-08-31T04:38:38.636 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "restful", 2024-08-31T04:38:38.636 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2024-08-31T04:38:38.636 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2024-08-31T04:38:38.636 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2024-08-31T04:38:38.636 INFO:teuthology.orchestra.run.smithi050.stdout: "enable_auth": { 2024-08-31T04:38:38.636 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "enable_auth", 2024-08-31T04:38:38.636 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:38.636 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.636 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.636 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2024-08-31T04:38:38.637 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.637 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.637 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.637 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.637 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.637 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.637 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.637 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.637 INFO:teuthology.orchestra.run.smithi050.stdout: "key_file": { 2024-08-31T04:38:38.637 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "key_file", 2024-08-31T04:38:38.637 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.637 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.637 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.637 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-08-31T04:38:38.638 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.638 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.638 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.638 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.638 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.638 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.638 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.638 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.638 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2024-08-31T04:38:38.638 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2024-08-31T04:38:38.638 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.638 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.638 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.638 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-08-31T04:38:38.639 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.639 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.639 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-08-31T04:38:38.639 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-08-31T04:38:38.639 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-08-31T04:38:38.639 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-08-31T04:38:38.639 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-08-31T04:38:38.639 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-08-31T04:38:38.639 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-08-31T04:38:38.639 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-08-31T04:38:38.639 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.639 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.639 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.640 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.640 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.640 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2024-08-31T04:38:38.640 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2024-08-31T04:38:38.640 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:38.640 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.640 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.640 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-08-31T04:38:38.640 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.640 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.640 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.640 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.640 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.641 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.641 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.641 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.641 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2024-08-31T04:38:38.641 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2024-08-31T04:38:38.641 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.641 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.641 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.641 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2024-08-31T04:38:38.641 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.641 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.641 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-08-31T04:38:38.641 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-08-31T04:38:38.641 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-08-31T04:38:38.642 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-08-31T04:38:38.642 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-08-31T04:38:38.642 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-08-31T04:38:38.642 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-08-31T04:38:38.642 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-08-31T04:38:38.642 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.642 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.642 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.642 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.642 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.642 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2024-08-31T04:38:38.642 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2024-08-31T04:38:38.642 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:38.642 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.643 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.643 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-08-31T04:38:38.643 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.643 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.643 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.643 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.643 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.643 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.643 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.643 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.643 INFO:teuthology.orchestra.run.smithi050.stdout: "max_requests": { 2024-08-31T04:38:38.643 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "max_requests", 2024-08-31T04:38:38.643 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-08-31T04:38:38.643 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.644 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.644 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "500", 2024-08-31T04:38:38.644 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.644 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.644 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.644 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.", 2024-08-31T04:38:38.644 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.644 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.644 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.644 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.644 INFO:teuthology.orchestra.run.smithi050.stdout: "server_addr": { 2024-08-31T04:38:38.644 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "server_addr", 2024-08-31T04:38:38.644 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.645 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.645 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.645 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-08-31T04:38:38.645 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.645 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.645 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.645 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.645 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.645 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.645 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.645 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.645 INFO:teuthology.orchestra.run.smithi050.stdout: "server_port": { 2024-08-31T04:38:38.645 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "server_port", 2024-08-31T04:38:38.645 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.646 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.646 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.646 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-08-31T04:38:38.646 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.646 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.646 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.646 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.646 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.646 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.646 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.646 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.646 INFO:teuthology.orchestra.run.smithi050.stdout: "sqlite3_killpoint": { 2024-08-31T04:38:38.646 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "sqlite3_killpoint", 2024-08-31T04:38:38.647 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-08-31T04:38:38.647 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "dev", 2024-08-31T04:38:38.647 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.647 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "0", 2024-08-31T04:38:38.647 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.647 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.647 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.647 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.647 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.647 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.647 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.647 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T04:38:38.647 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T04:38:38.647 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.647 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-08-31T04:38:38.648 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "rgw", 2024-08-31T04:38:38.648 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2024-08-31T04:38:38.648 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2024-08-31T04:38:38.648 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2024-08-31T04:38:38.648 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2024-08-31T04:38:38.648 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2024-08-31T04:38:38.648 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.648 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.648 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.648 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-08-31T04:38:38.648 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.648 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.648 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-08-31T04:38:38.648 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-08-31T04:38:38.649 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-08-31T04:38:38.649 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-08-31T04:38:38.649 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-08-31T04:38:38.649 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-08-31T04:38:38.649 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-08-31T04:38:38.649 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-08-31T04:38:38.649 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.649 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.649 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.649 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.649 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.649 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2024-08-31T04:38:38.649 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2024-08-31T04:38:38.649 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:38.650 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.650 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.650 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-08-31T04:38:38.650 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.650 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.650 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.650 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.650 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.650 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.650 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.650 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.650 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2024-08-31T04:38:38.651 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2024-08-31T04:38:38.651 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.651 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.651 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.651 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2024-08-31T04:38:38.651 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.651 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.651 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-08-31T04:38:38.651 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-08-31T04:38:38.651 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-08-31T04:38:38.651 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-08-31T04:38:38.651 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-08-31T04:38:38.651 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-08-31T04:38:38.651 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-08-31T04:38:38.652 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-08-31T04:38:38.652 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.652 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.652 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.652 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.652 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.652 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2024-08-31T04:38:38.652 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2024-08-31T04:38:38.652 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:38.652 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.652 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.652 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-08-31T04:38:38.652 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.652 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.652 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.653 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.653 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.653 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.653 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.653 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.653 INFO:teuthology.orchestra.run.smithi050.stdout: "secondary_zone_period_retry_limit": { 2024-08-31T04:38:38.653 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "secondary_zone_period_retry_limit", 2024-08-31T04:38:38.653 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-08-31T04:38:38.653 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.653 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.653 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "5", 2024-08-31T04:38:38.653 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.653 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.653 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.654 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "RGW module period update retry limit for secondary site", 2024-08-31T04:38:38.654 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.654 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.654 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.654 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.654 INFO:teuthology.orchestra.run.smithi050.stdout: "sqlite3_killpoint": { 2024-08-31T04:38:38.654 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "sqlite3_killpoint", 2024-08-31T04:38:38.654 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-08-31T04:38:38.654 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "dev", 2024-08-31T04:38:38.654 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.654 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "0", 2024-08-31T04:38:38.654 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.654 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.654 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.655 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.655 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.655 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.655 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.655 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T04:38:38.655 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T04:38:38.655 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.655 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-08-31T04:38:38.655 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "rook", 2024-08-31T04:38:38.655 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2024-08-31T04:38:38.655 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2024-08-31T04:38:38.655 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2024-08-31T04:38:38.655 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2024-08-31T04:38:38.656 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2024-08-31T04:38:38.656 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.656 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.656 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.656 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-08-31T04:38:38.656 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.656 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.656 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-08-31T04:38:38.656 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-08-31T04:38:38.656 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-08-31T04:38:38.656 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-08-31T04:38:38.656 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-08-31T04:38:38.656 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-08-31T04:38:38.656 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-08-31T04:38:38.657 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-08-31T04:38:38.657 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.657 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.657 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.657 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.657 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.657 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2024-08-31T04:38:38.657 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2024-08-31T04:38:38.657 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:38.657 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.657 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.657 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-08-31T04:38:38.657 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.657 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.658 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.658 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.658 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.658 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.658 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.658 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.658 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2024-08-31T04:38:38.658 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2024-08-31T04:38:38.658 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.658 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.658 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.658 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2024-08-31T04:38:38.658 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.658 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.658 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-08-31T04:38:38.659 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-08-31T04:38:38.659 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-08-31T04:38:38.659 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-08-31T04:38:38.659 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-08-31T04:38:38.659 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-08-31T04:38:38.659 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-08-31T04:38:38.659 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-08-31T04:38:38.659 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.659 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.659 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.659 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.659 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.659 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2024-08-31T04:38:38.660 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2024-08-31T04:38:38.660 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:38.660 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.660 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.660 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-08-31T04:38:38.660 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.660 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.660 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.660 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.660 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.660 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.660 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.660 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.660 INFO:teuthology.orchestra.run.smithi050.stdout: "sqlite3_killpoint": { 2024-08-31T04:38:38.661 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "sqlite3_killpoint", 2024-08-31T04:38:38.661 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-08-31T04:38:38.661 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "dev", 2024-08-31T04:38:38.661 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.661 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "0", 2024-08-31T04:38:38.661 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.661 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.661 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.661 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.661 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.661 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.661 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.661 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.662 INFO:teuthology.orchestra.run.smithi050.stdout: "storage_class": { 2024-08-31T04:38:38.662 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "storage_class", 2024-08-31T04:38:38.662 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.662 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.662 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.662 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "local", 2024-08-31T04:38:38.662 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.662 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.662 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.662 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-08-31T04:38:38.662 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.662 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.662 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.662 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T04:38:38.663 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T04:38:38.663 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.663 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-08-31T04:38:38.663 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "selftest", 2024-08-31T04:38:38.663 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2024-08-31T04:38:38.663 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2024-08-31T04:38:38.663 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2024-08-31T04:38:38.663 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2024-08-31T04:38:38.663 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2024-08-31T04:38:38.663 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.663 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.663 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.663 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-08-31T04:38:38.663 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.664 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.664 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-08-31T04:38:38.664 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-08-31T04:38:38.664 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-08-31T04:38:38.664 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-08-31T04:38:38.664 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-08-31T04:38:38.664 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-08-31T04:38:38.664 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-08-31T04:38:38.664 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-08-31T04:38:38.664 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.664 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.664 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.664 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.665 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.665 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2024-08-31T04:38:38.665 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2024-08-31T04:38:38.665 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:38.665 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.665 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.665 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-08-31T04:38:38.665 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.665 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.665 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.665 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.665 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.665 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.665 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.666 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.666 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2024-08-31T04:38:38.666 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2024-08-31T04:38:38.666 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.666 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.666 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.666 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2024-08-31T04:38:38.666 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.666 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.666 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-08-31T04:38:38.666 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-08-31T04:38:38.666 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-08-31T04:38:38.666 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-08-31T04:38:38.666 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-08-31T04:38:38.667 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-08-31T04:38:38.667 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-08-31T04:38:38.667 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-08-31T04:38:38.667 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.667 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.667 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.667 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.667 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.667 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2024-08-31T04:38:38.667 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2024-08-31T04:38:38.667 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:38.667 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.667 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.668 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-08-31T04:38:38.668 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.668 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.668 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.668 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.668 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.668 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.668 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.668 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.668 INFO:teuthology.orchestra.run.smithi050.stdout: "roption1": { 2024-08-31T04:38:38.668 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "roption1", 2024-08-31T04:38:38.668 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.668 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.668 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.669 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-08-31T04:38:38.669 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.669 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.669 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.669 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.669 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.669 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.669 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.669 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.669 INFO:teuthology.orchestra.run.smithi050.stdout: "roption2": { 2024-08-31T04:38:38.669 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "roption2", 2024-08-31T04:38:38.669 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.669 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.670 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.670 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "xyz", 2024-08-31T04:38:38.670 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.670 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.670 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.670 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.670 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.670 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.670 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.670 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.670 INFO:teuthology.orchestra.run.smithi050.stdout: "rwoption1": { 2024-08-31T04:38:38.670 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "rwoption1", 2024-08-31T04:38:38.670 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.670 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.671 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.671 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-08-31T04:38:38.671 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.671 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.671 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.671 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.671 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.671 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.671 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.671 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.671 INFO:teuthology.orchestra.run.smithi050.stdout: "rwoption2": { 2024-08-31T04:38:38.671 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "rwoption2", 2024-08-31T04:38:38.671 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-08-31T04:38:38.671 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.672 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.672 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-08-31T04:38:38.672 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.672 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.672 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.672 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.672 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.672 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.672 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.672 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.672 INFO:teuthology.orchestra.run.smithi050.stdout: "rwoption3": { 2024-08-31T04:38:38.672 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "rwoption3", 2024-08-31T04:38:38.672 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "float", 2024-08-31T04:38:38.673 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.673 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.673 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-08-31T04:38:38.673 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.673 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.673 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.673 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.673 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.673 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.673 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.673 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.673 INFO:teuthology.orchestra.run.smithi050.stdout: "rwoption4": { 2024-08-31T04:38:38.673 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "rwoption4", 2024-08-31T04:38:38.673 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.674 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.674 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.674 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-08-31T04:38:38.674 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.674 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.674 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.674 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.674 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.674 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.674 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.674 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.674 INFO:teuthology.orchestra.run.smithi050.stdout: "rwoption5": { 2024-08-31T04:38:38.674 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "rwoption5", 2024-08-31T04:38:38.674 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:38.675 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.675 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.675 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-08-31T04:38:38.675 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.675 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.675 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.675 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.675 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.675 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.675 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.675 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.675 INFO:teuthology.orchestra.run.smithi050.stdout: "rwoption6": { 2024-08-31T04:38:38.675 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "rwoption6", 2024-08-31T04:38:38.675 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:38.676 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.676 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.676 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2024-08-31T04:38:38.676 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.676 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.676 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.676 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.676 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.676 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.676 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.676 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.676 INFO:teuthology.orchestra.run.smithi050.stdout: "rwoption7": { 2024-08-31T04:38:38.676 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "rwoption7", 2024-08-31T04:38:38.677 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-08-31T04:38:38.677 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.677 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.677 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-08-31T04:38:38.677 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "1", 2024-08-31T04:38:38.677 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "42", 2024-08-31T04:38:38.677 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.677 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.677 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.677 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.677 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.677 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.677 INFO:teuthology.orchestra.run.smithi050.stdout: "sqlite3_killpoint": { 2024-08-31T04:38:38.678 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "sqlite3_killpoint", 2024-08-31T04:38:38.678 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-08-31T04:38:38.678 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "dev", 2024-08-31T04:38:38.678 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.678 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "0", 2024-08-31T04:38:38.678 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.678 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.678 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.678 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.678 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.678 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.678 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.678 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.678 INFO:teuthology.orchestra.run.smithi050.stdout: "testkey": { 2024-08-31T04:38:38.679 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "testkey", 2024-08-31T04:38:38.679 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.679 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.679 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.679 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-08-31T04:38:38.679 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.679 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.679 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.679 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.679 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.679 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.679 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.679 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.679 INFO:teuthology.orchestra.run.smithi050.stdout: "testlkey": { 2024-08-31T04:38:38.680 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "testlkey", 2024-08-31T04:38:38.680 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.680 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.680 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.680 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-08-31T04:38:38.680 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.680 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.680 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.680 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.680 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.680 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.680 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.680 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.681 INFO:teuthology.orchestra.run.smithi050.stdout: "testnewline": { 2024-08-31T04:38:38.681 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "testnewline", 2024-08-31T04:38:38.681 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.681 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.681 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.681 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-08-31T04:38:38.681 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.681 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.681 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.681 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.681 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.681 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.681 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.681 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T04:38:38.682 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T04:38:38.682 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.682 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-08-31T04:38:38.682 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "smb", 2024-08-31T04:38:38.682 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2024-08-31T04:38:38.682 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2024-08-31T04:38:38.682 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2024-08-31T04:38:38.682 INFO:teuthology.orchestra.run.smithi050.stdout: "internal_store_backend": { 2024-08-31T04:38:38.682 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "internal_store_backend", 2024-08-31T04:38:38.682 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.682 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "dev", 2024-08-31T04:38:38.682 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.682 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-08-31T04:38:38.682 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.683 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.683 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.683 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "set internal store backend. for develoment and testing only", 2024-08-31T04:38:38.683 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.683 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.683 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.683 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.683 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2024-08-31T04:38:38.683 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2024-08-31T04:38:38.683 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.683 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.683 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.683 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-08-31T04:38:38.683 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.683 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.684 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-08-31T04:38:38.684 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-08-31T04:38:38.684 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-08-31T04:38:38.684 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-08-31T04:38:38.684 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-08-31T04:38:38.684 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-08-31T04:38:38.684 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-08-31T04:38:38.684 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-08-31T04:38:38.684 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.684 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.684 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.684 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.684 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.685 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2024-08-31T04:38:38.685 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2024-08-31T04:38:38.685 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:38.685 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.685 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.685 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-08-31T04:38:38.685 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.685 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.685 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.685 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.685 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.685 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.685 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.686 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.686 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2024-08-31T04:38:38.686 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2024-08-31T04:38:38.686 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.686 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.686 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.686 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2024-08-31T04:38:38.686 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.686 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.686 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-08-31T04:38:38.686 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-08-31T04:38:38.686 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-08-31T04:38:38.686 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-08-31T04:38:38.686 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-08-31T04:38:38.686 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-08-31T04:38:38.687 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-08-31T04:38:38.687 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-08-31T04:38:38.687 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.687 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.687 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.687 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.687 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.687 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2024-08-31T04:38:38.687 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2024-08-31T04:38:38.687 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:38.687 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.687 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.687 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-08-31T04:38:38.687 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.688 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.688 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.688 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.688 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.688 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.688 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.688 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.688 INFO:teuthology.orchestra.run.smithi050.stdout: "sqlite3_killpoint": { 2024-08-31T04:38:38.688 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "sqlite3_killpoint", 2024-08-31T04:38:38.688 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-08-31T04:38:38.688 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "dev", 2024-08-31T04:38:38.688 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.689 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "0", 2024-08-31T04:38:38.689 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.689 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.689 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.689 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.689 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.689 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.689 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.689 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.689 INFO:teuthology.orchestra.run.smithi050.stdout: "update_orchestration": { 2024-08-31T04:38:38.689 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "update_orchestration", 2024-08-31T04:38:38.689 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:38.689 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.689 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.690 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2024-08-31T04:38:38.690 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.690 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.690 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.690 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "automatically update orchestration when smb resources are changed", 2024-08-31T04:38:38.690 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.690 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.690 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.690 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T04:38:38.690 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T04:38:38.690 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.690 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-08-31T04:38:38.690 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "snap_schedule", 2024-08-31T04:38:38.690 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2024-08-31T04:38:38.691 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2024-08-31T04:38:38.691 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2024-08-31T04:38:38.691 INFO:teuthology.orchestra.run.smithi050.stdout: "allow_m_granularity": { 2024-08-31T04:38:38.691 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "allow_m_granularity", 2024-08-31T04:38:38.691 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:38.691 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.691 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.691 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-08-31T04:38:38.691 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.691 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.691 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.691 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "allow minute scheduled snapshots", 2024-08-31T04:38:38.691 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.692 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.692 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.692 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.692 INFO:teuthology.orchestra.run.smithi050.stdout: "dump_on_update": { 2024-08-31T04:38:38.692 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "dump_on_update", 2024-08-31T04:38:38.692 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:38.692 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.692 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.692 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-08-31T04:38:38.692 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.692 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.692 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.692 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "dump database to debug log on update", 2024-08-31T04:38:38.693 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.693 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.693 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.693 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.693 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2024-08-31T04:38:38.693 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2024-08-31T04:38:38.693 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.693 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.693 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.693 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-08-31T04:38:38.693 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.693 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.693 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-08-31T04:38:38.693 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-08-31T04:38:38.694 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-08-31T04:38:38.694 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-08-31T04:38:38.694 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-08-31T04:38:38.694 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-08-31T04:38:38.694 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-08-31T04:38:38.694 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-08-31T04:38:38.694 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.694 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.694 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.694 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.694 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.694 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2024-08-31T04:38:38.694 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2024-08-31T04:38:38.694 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:38.694 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.695 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.695 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-08-31T04:38:38.695 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.695 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.695 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.695 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.695 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.695 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.695 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.695 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.695 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2024-08-31T04:38:38.695 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2024-08-31T04:38:38.695 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.695 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.696 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.696 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2024-08-31T04:38:38.696 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.696 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.696 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-08-31T04:38:38.696 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-08-31T04:38:38.696 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-08-31T04:38:38.696 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-08-31T04:38:38.696 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-08-31T04:38:38.696 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-08-31T04:38:38.696 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-08-31T04:38:38.696 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-08-31T04:38:38.696 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.697 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.697 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.697 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.697 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.697 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2024-08-31T04:38:38.697 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2024-08-31T04:38:38.697 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:38.697 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.697 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.697 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-08-31T04:38:38.697 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.697 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.697 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.697 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.698 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.698 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.698 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.698 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.698 INFO:teuthology.orchestra.run.smithi050.stdout: "sqlite3_killpoint": { 2024-08-31T04:38:38.698 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "sqlite3_killpoint", 2024-08-31T04:38:38.698 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-08-31T04:38:38.698 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "dev", 2024-08-31T04:38:38.698 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.698 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "0", 2024-08-31T04:38:38.698 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.698 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.698 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.698 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.698 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.699 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.699 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.699 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T04:38:38.699 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T04:38:38.699 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.699 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-08-31T04:38:38.699 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "stats", 2024-08-31T04:38:38.699 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2024-08-31T04:38:38.699 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2024-08-31T04:38:38.699 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2024-08-31T04:38:38.699 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2024-08-31T04:38:38.699 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2024-08-31T04:38:38.699 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.700 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.700 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.700 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-08-31T04:38:38.700 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.700 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.700 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-08-31T04:38:38.700 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-08-31T04:38:38.700 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-08-31T04:38:38.700 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-08-31T04:38:38.700 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-08-31T04:38:38.700 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-08-31T04:38:38.700 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-08-31T04:38:38.700 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-08-31T04:38:38.700 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.701 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.701 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.701 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.701 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.701 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2024-08-31T04:38:38.701 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2024-08-31T04:38:38.701 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:38.701 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.701 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.701 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-08-31T04:38:38.701 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.701 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.701 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.702 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.702 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.702 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.702 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.702 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.702 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2024-08-31T04:38:38.702 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2024-08-31T04:38:38.702 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.702 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.702 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.702 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2024-08-31T04:38:38.702 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.702 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.702 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-08-31T04:38:38.703 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-08-31T04:38:38.703 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-08-31T04:38:38.703 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-08-31T04:38:38.703 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-08-31T04:38:38.703 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-08-31T04:38:38.703 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-08-31T04:38:38.703 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-08-31T04:38:38.703 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.703 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.703 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.703 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.703 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.703 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2024-08-31T04:38:38.704 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2024-08-31T04:38:38.704 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:38.704 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.704 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.704 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-08-31T04:38:38.704 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.704 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.704 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.704 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.704 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.704 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.704 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.704 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.705 INFO:teuthology.orchestra.run.smithi050.stdout: "sqlite3_killpoint": { 2024-08-31T04:38:38.705 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "sqlite3_killpoint", 2024-08-31T04:38:38.705 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-08-31T04:38:38.705 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "dev", 2024-08-31T04:38:38.705 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.705 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "0", 2024-08-31T04:38:38.705 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.705 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.705 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.705 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.705 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.705 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.705 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.705 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T04:38:38.706 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T04:38:38.706 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.706 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-08-31T04:38:38.706 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "status", 2024-08-31T04:38:38.706 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2024-08-31T04:38:38.706 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2024-08-31T04:38:38.706 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2024-08-31T04:38:38.706 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2024-08-31T04:38:38.706 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2024-08-31T04:38:38.706 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.706 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.706 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.706 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-08-31T04:38:38.707 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.707 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.707 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-08-31T04:38:38.707 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-08-31T04:38:38.707 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-08-31T04:38:38.707 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-08-31T04:38:38.707 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-08-31T04:38:38.707 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-08-31T04:38:38.707 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-08-31T04:38:38.707 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-08-31T04:38:38.707 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.707 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.707 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.707 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.708 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.708 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2024-08-31T04:38:38.708 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2024-08-31T04:38:38.708 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:38.708 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.708 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.708 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-08-31T04:38:38.708 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.708 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.708 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.708 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.708 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.708 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.708 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.709 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.709 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2024-08-31T04:38:38.709 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2024-08-31T04:38:38.709 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.709 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.709 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.709 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2024-08-31T04:38:38.709 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.709 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.709 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-08-31T04:38:38.709 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-08-31T04:38:38.709 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-08-31T04:38:38.709 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-08-31T04:38:38.710 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-08-31T04:38:38.710 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-08-31T04:38:38.710 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-08-31T04:38:38.710 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-08-31T04:38:38.710 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.710 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.710 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.710 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.710 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.710 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2024-08-31T04:38:38.710 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2024-08-31T04:38:38.710 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:38.710 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.710 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.711 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-08-31T04:38:38.711 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.711 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.711 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.711 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.711 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.711 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.711 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.711 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.711 INFO:teuthology.orchestra.run.smithi050.stdout: "sqlite3_killpoint": { 2024-08-31T04:38:38.711 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "sqlite3_killpoint", 2024-08-31T04:38:38.711 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-08-31T04:38:38.711 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "dev", 2024-08-31T04:38:38.711 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.712 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "0", 2024-08-31T04:38:38.712 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.712 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.712 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.712 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.712 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.712 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.712 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.712 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T04:38:38.712 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T04:38:38.712 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.712 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-08-31T04:38:38.712 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "telegraf", 2024-08-31T04:38:38.712 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2024-08-31T04:38:38.713 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2024-08-31T04:38:38.713 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2024-08-31T04:38:38.713 INFO:teuthology.orchestra.run.smithi050.stdout: "address": { 2024-08-31T04:38:38.713 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "address", 2024-08-31T04:38:38.713 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.713 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.713 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.713 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-08-31T04:38:38.713 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.713 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.713 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.713 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.713 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.714 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.714 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.714 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.714 INFO:teuthology.orchestra.run.smithi050.stdout: "interval": { 2024-08-31T04:38:38.714 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "interval", 2024-08-31T04:38:38.714 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "secs", 2024-08-31T04:38:38.714 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.714 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.714 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "15", 2024-08-31T04:38:38.714 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.714 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.714 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.714 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.714 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.715 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.715 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.715 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.715 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2024-08-31T04:38:38.715 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2024-08-31T04:38:38.715 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.715 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.715 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.715 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-08-31T04:38:38.715 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.715 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.715 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-08-31T04:38:38.715 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-08-31T04:38:38.716 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-08-31T04:38:38.716 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-08-31T04:38:38.716 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-08-31T04:38:38.716 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-08-31T04:38:38.716 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-08-31T04:38:38.716 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-08-31T04:38:38.716 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.716 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.716 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.716 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.716 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.716 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2024-08-31T04:38:38.716 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2024-08-31T04:38:38.716 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:38.717 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.717 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.717 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-08-31T04:38:38.717 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.717 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.717 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.717 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.717 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.717 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.717 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.717 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.717 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2024-08-31T04:38:38.717 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2024-08-31T04:38:38.717 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.718 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.718 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.718 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2024-08-31T04:38:38.718 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.718 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.718 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-08-31T04:38:38.718 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-08-31T04:38:38.718 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-08-31T04:38:38.718 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-08-31T04:38:38.718 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-08-31T04:38:38.718 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-08-31T04:38:38.718 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-08-31T04:38:38.718 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-08-31T04:38:38.718 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.719 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.719 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.719 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.719 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.719 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2024-08-31T04:38:38.719 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2024-08-31T04:38:38.719 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:38.719 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.719 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.719 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-08-31T04:38:38.719 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.719 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.719 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.720 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.720 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.720 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.720 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.720 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.720 INFO:teuthology.orchestra.run.smithi050.stdout: "sqlite3_killpoint": { 2024-08-31T04:38:38.720 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "sqlite3_killpoint", 2024-08-31T04:38:38.720 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-08-31T04:38:38.720 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "dev", 2024-08-31T04:38:38.720 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.720 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "0", 2024-08-31T04:38:38.720 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.720 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.720 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.721 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.721 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.721 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.721 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.721 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T04:38:38.721 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T04:38:38.721 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.721 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-08-31T04:38:38.721 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "telemetry", 2024-08-31T04:38:38.721 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2024-08-31T04:38:38.721 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2024-08-31T04:38:38.721 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2024-08-31T04:38:38.721 INFO:teuthology.orchestra.run.smithi050.stdout: "channel_basic": { 2024-08-31T04:38:38.721 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "channel_basic", 2024-08-31T04:38:38.722 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:38.722 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.722 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.722 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2024-08-31T04:38:38.722 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.722 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.722 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.722 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Share basic cluster information (size, version)", 2024-08-31T04:38:38.722 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.722 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.722 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.722 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.722 INFO:teuthology.orchestra.run.smithi050.stdout: "channel_crash": { 2024-08-31T04:38:38.722 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "channel_crash", 2024-08-31T04:38:38.723 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:38.723 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.723 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.723 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2024-08-31T04:38:38.723 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.723 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.723 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.723 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-08-31T04:38:38.723 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.723 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.723 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.723 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.723 INFO:teuthology.orchestra.run.smithi050.stdout: "channel_device": { 2024-08-31T04:38:38.723 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "channel_device", 2024-08-31T04:38:38.723 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:38.724 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.724 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.724 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2024-08-31T04:38:38.724 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.724 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.724 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.724 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-08-31T04:38:38.724 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.724 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.724 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.724 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.724 INFO:teuthology.orchestra.run.smithi050.stdout: "channel_ident": { 2024-08-31T04:38:38.724 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "channel_ident", 2024-08-31T04:38:38.724 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:38.725 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.725 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.725 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-08-31T04:38:38.725 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.725 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.725 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.725 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-08-31T04:38:38.725 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.725 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.725 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.725 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.725 INFO:teuthology.orchestra.run.smithi050.stdout: "channel_perf": { 2024-08-31T04:38:38.725 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "channel_perf", 2024-08-31T04:38:38.725 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:38.726 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.726 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.726 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-08-31T04:38:38.726 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.726 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.726 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.726 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Share various performance metrics of a cluster", 2024-08-31T04:38:38.726 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.726 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.726 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.726 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.726 INFO:teuthology.orchestra.run.smithi050.stdout: "contact": { 2024-08-31T04:38:38.726 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "contact", 2024-08-31T04:38:38.726 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.726 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.727 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.727 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-08-31T04:38:38.727 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.727 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.727 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.727 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.727 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.727 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.727 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.727 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.727 INFO:teuthology.orchestra.run.smithi050.stdout: "description": { 2024-08-31T04:38:38.727 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "description", 2024-08-31T04:38:38.727 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.727 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.728 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.728 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-08-31T04:38:38.728 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.728 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.728 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.728 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.728 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.728 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.728 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.728 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.728 INFO:teuthology.orchestra.run.smithi050.stdout: "device_url": { 2024-08-31T04:38:38.728 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "device_url", 2024-08-31T04:38:38.729 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.729 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.729 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.729 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-08-31T04:38:38.729 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.729 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.729 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.729 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.729 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.729 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.729 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.729 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.729 INFO:teuthology.orchestra.run.smithi050.stdout: "enabled": { 2024-08-31T04:38:38.729 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "enabled", 2024-08-31T04:38:38.730 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:38.730 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.730 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.730 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-08-31T04:38:38.730 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.730 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.730 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.730 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.730 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.730 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.730 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.730 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.730 INFO:teuthology.orchestra.run.smithi050.stdout: "interval": { 2024-08-31T04:38:38.731 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "interval", 2024-08-31T04:38:38.731 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-08-31T04:38:38.731 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.731 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.731 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "24", 2024-08-31T04:38:38.731 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "8", 2024-08-31T04:38:38.731 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.731 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.731 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.731 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.731 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.731 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.732 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.732 INFO:teuthology.orchestra.run.smithi050.stdout: "last_opt_revision": { 2024-08-31T04:38:38.732 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "last_opt_revision", 2024-08-31T04:38:38.732 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-08-31T04:38:38.732 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.732 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.732 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "1", 2024-08-31T04:38:38.732 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.732 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.732 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.732 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.732 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.732 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.733 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.733 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.733 INFO:teuthology.orchestra.run.smithi050.stdout: "leaderboard": { 2024-08-31T04:38:38.733 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "leaderboard", 2024-08-31T04:38:38.733 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:38.733 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.733 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.733 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-08-31T04:38:38.733 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.733 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.733 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.733 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.733 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.733 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.734 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.734 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.734 INFO:teuthology.orchestra.run.smithi050.stdout: "leaderboard_description": { 2024-08-31T04:38:38.734 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "leaderboard_description", 2024-08-31T04:38:38.734 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.734 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.734 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.734 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-08-31T04:38:38.734 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.734 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.734 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.734 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.734 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.735 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.735 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.735 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.735 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2024-08-31T04:38:38.735 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2024-08-31T04:38:38.735 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.735 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.735 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.735 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-08-31T04:38:38.735 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.735 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.735 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-08-31T04:38:38.735 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-08-31T04:38:38.736 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-08-31T04:38:38.736 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-08-31T04:38:38.736 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-08-31T04:38:38.736 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-08-31T04:38:38.736 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-08-31T04:38:38.736 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-08-31T04:38:38.736 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.736 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.736 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.736 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.736 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.736 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2024-08-31T04:38:38.736 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2024-08-31T04:38:38.736 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:38.737 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.737 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.737 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-08-31T04:38:38.737 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.737 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.737 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.737 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.737 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.737 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.737 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.737 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.737 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2024-08-31T04:38:38.737 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2024-08-31T04:38:38.737 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.738 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.738 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.738 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2024-08-31T04:38:38.738 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.738 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.738 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-08-31T04:38:38.738 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-08-31T04:38:38.738 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-08-31T04:38:38.738 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-08-31T04:38:38.738 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-08-31T04:38:38.738 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-08-31T04:38:38.738 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-08-31T04:38:38.738 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-08-31T04:38:38.738 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.739 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.739 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.739 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.739 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.739 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2024-08-31T04:38:38.739 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2024-08-31T04:38:38.739 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:38.739 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.739 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.739 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-08-31T04:38:38.739 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.739 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.739 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.739 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.740 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.740 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.740 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.740 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.740 INFO:teuthology.orchestra.run.smithi050.stdout: "organization": { 2024-08-31T04:38:38.740 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "organization", 2024-08-31T04:38:38.740 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.740 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.740 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.740 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-08-31T04:38:38.740 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.740 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.740 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.740 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.741 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.741 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.741 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.741 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.741 INFO:teuthology.orchestra.run.smithi050.stdout: "proxy": { 2024-08-31T04:38:38.741 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "proxy", 2024-08-31T04:38:38.741 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.741 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.741 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.741 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-08-31T04:38:38.741 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.741 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.741 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.742 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.742 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.742 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.742 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.742 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.742 INFO:teuthology.orchestra.run.smithi050.stdout: "sqlite3_killpoint": { 2024-08-31T04:38:38.742 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "sqlite3_killpoint", 2024-08-31T04:38:38.742 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-08-31T04:38:38.742 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "dev", 2024-08-31T04:38:38.742 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.742 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "0", 2024-08-31T04:38:38.742 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.742 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.742 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.743 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.743 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.743 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.743 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.743 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.743 INFO:teuthology.orchestra.run.smithi050.stdout: "url": { 2024-08-31T04:38:38.743 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "url", 2024-08-31T04:38:38.743 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.743 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.743 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.743 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-08-31T04:38:38.743 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.743 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.744 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.744 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.744 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.744 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.744 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.744 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T04:38:38.744 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T04:38:38.744 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.744 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-08-31T04:38:38.744 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "test_orchestrator", 2024-08-31T04:38:38.744 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2024-08-31T04:38:38.744 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2024-08-31T04:38:38.744 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2024-08-31T04:38:38.745 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2024-08-31T04:38:38.745 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2024-08-31T04:38:38.745 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.745 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.745 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.745 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-08-31T04:38:38.745 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.745 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.745 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-08-31T04:38:38.745 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-08-31T04:38:38.745 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-08-31T04:38:38.745 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-08-31T04:38:38.745 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-08-31T04:38:38.745 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-08-31T04:38:38.746 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-08-31T04:38:38.746 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-08-31T04:38:38.746 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.746 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.746 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.746 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.746 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.746 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2024-08-31T04:38:38.746 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2024-08-31T04:38:38.746 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:38.746 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.746 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.746 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-08-31T04:38:38.746 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.747 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.747 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.747 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.747 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.747 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.747 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.747 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.747 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2024-08-31T04:38:38.747 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2024-08-31T04:38:38.747 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.747 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.747 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.747 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2024-08-31T04:38:38.747 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.748 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.748 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-08-31T04:38:38.748 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-08-31T04:38:38.748 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-08-31T04:38:38.748 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-08-31T04:38:38.748 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-08-31T04:38:38.748 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-08-31T04:38:38.748 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-08-31T04:38:38.748 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-08-31T04:38:38.748 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.748 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.748 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.748 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.749 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.749 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2024-08-31T04:38:38.749 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2024-08-31T04:38:38.749 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:38.749 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.749 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.749 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-08-31T04:38:38.749 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.749 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.749 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.749 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.749 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.749 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.749 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.750 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.750 INFO:teuthology.orchestra.run.smithi050.stdout: "sqlite3_killpoint": { 2024-08-31T04:38:38.750 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "sqlite3_killpoint", 2024-08-31T04:38:38.750 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-08-31T04:38:38.750 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "dev", 2024-08-31T04:38:38.750 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.750 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "0", 2024-08-31T04:38:38.750 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.750 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.750 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.750 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.750 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.750 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.751 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.751 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T04:38:38.751 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T04:38:38.751 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.751 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-08-31T04:38:38.751 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "volumes", 2024-08-31T04:38:38.751 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2024-08-31T04:38:38.751 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2024-08-31T04:38:38.751 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2024-08-31T04:38:38.751 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2024-08-31T04:38:38.751 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2024-08-31T04:38:38.751 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.751 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.751 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.752 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-08-31T04:38:38.752 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.752 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.752 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-08-31T04:38:38.752 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-08-31T04:38:38.752 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-08-31T04:38:38.752 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-08-31T04:38:38.752 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-08-31T04:38:38.752 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-08-31T04:38:38.752 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-08-31T04:38:38.752 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-08-31T04:38:38.752 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.752 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.752 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.753 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.753 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.753 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2024-08-31T04:38:38.753 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2024-08-31T04:38:38.753 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:38.753 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.753 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.753 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-08-31T04:38:38.753 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.753 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.753 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.753 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.753 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.753 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.754 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.754 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.754 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2024-08-31T04:38:38.754 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2024-08-31T04:38:38.754 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.754 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.754 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.754 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2024-08-31T04:38:38.754 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.754 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.754 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-08-31T04:38:38.754 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-08-31T04:38:38.754 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-08-31T04:38:38.754 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-08-31T04:38:38.754 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-08-31T04:38:38.755 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-08-31T04:38:38.755 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-08-31T04:38:38.755 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-08-31T04:38:38.755 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.755 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.755 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.755 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.755 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.755 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2024-08-31T04:38:38.755 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2024-08-31T04:38:38.755 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:38.755 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.755 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.755 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-08-31T04:38:38.756 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.756 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.756 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.756 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.756 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.756 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.756 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.756 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.756 INFO:teuthology.orchestra.run.smithi050.stdout: "max_concurrent_clones": { 2024-08-31T04:38:38.756 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "max_concurrent_clones", 2024-08-31T04:38:38.756 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-08-31T04:38:38.756 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.756 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.757 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "4", 2024-08-31T04:38:38.757 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.757 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.757 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.757 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Number of asynchronous cloner threads", 2024-08-31T04:38:38.757 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.757 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.757 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.757 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.757 INFO:teuthology.orchestra.run.smithi050.stdout: "periodic_async_work": { 2024-08-31T04:38:38.757 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "periodic_async_work", 2024-08-31T04:38:38.757 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:38.757 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.757 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.758 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-08-31T04:38:38.758 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.758 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.758 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.758 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Periodically check for async work", 2024-08-31T04:38:38.758 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.758 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.758 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.758 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.758 INFO:teuthology.orchestra.run.smithi050.stdout: "snapshot_clone_delay": { 2024-08-31T04:38:38.758 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "snapshot_clone_delay", 2024-08-31T04:38:38.758 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-08-31T04:38:38.758 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.758 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.759 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "0", 2024-08-31T04:38:38.759 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.759 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.759 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.759 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-08-31T04:38:38.759 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.759 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.759 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.759 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.759 INFO:teuthology.orchestra.run.smithi050.stdout: "snapshot_clone_no_wait": { 2024-08-31T04:38:38.759 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "snapshot_clone_no_wait", 2024-08-31T04:38:38.759 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:38.759 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.759 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.760 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2024-08-31T04:38:38.760 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.760 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.760 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.760 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-08-31T04:38:38.760 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.760 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.760 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.760 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.760 INFO:teuthology.orchestra.run.smithi050.stdout: "sqlite3_killpoint": { 2024-08-31T04:38:38.760 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "sqlite3_killpoint", 2024-08-31T04:38:38.760 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-08-31T04:38:38.760 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "dev", 2024-08-31T04:38:38.761 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.761 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "0", 2024-08-31T04:38:38.761 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.761 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.761 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.761 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.761 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.761 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.761 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.761 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T04:38:38.761 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T04:38:38.761 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.761 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-08-31T04:38:38.761 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "zabbix", 2024-08-31T04:38:38.762 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2024-08-31T04:38:38.762 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2024-08-31T04:38:38.762 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2024-08-31T04:38:38.762 INFO:teuthology.orchestra.run.smithi050.stdout: "discovery_interval": { 2024-08-31T04:38:38.762 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "discovery_interval", 2024-08-31T04:38:38.762 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "uint", 2024-08-31T04:38:38.762 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.762 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.762 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "100", 2024-08-31T04:38:38.762 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.762 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.762 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.762 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.763 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.763 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.763 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.763 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.763 INFO:teuthology.orchestra.run.smithi050.stdout: "identifier": { 2024-08-31T04:38:38.763 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "identifier", 2024-08-31T04:38:38.763 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.763 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.763 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.763 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-08-31T04:38:38.763 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.763 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.763 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.763 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.763 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.764 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.764 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.764 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.764 INFO:teuthology.orchestra.run.smithi050.stdout: "interval": { 2024-08-31T04:38:38.764 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "interval", 2024-08-31T04:38:38.764 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "secs", 2024-08-31T04:38:38.764 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.764 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.764 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "60", 2024-08-31T04:38:38.764 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.764 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.764 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.764 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.764 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.765 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.765 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.765 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.765 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2024-08-31T04:38:38.765 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2024-08-31T04:38:38.765 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.765 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.765 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.765 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-08-31T04:38:38.765 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.765 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.765 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-08-31T04:38:38.765 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-08-31T04:38:38.766 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-08-31T04:38:38.766 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-08-31T04:38:38.766 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-08-31T04:38:38.766 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-08-31T04:38:38.766 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-08-31T04:38:38.766 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-08-31T04:38:38.766 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.766 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.766 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.766 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.766 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.766 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2024-08-31T04:38:38.766 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2024-08-31T04:38:38.766 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:38.767 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.767 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.767 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-08-31T04:38:38.767 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.767 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.767 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.767 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.767 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.767 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.767 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.767 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.767 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2024-08-31T04:38:38.767 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2024-08-31T04:38:38.767 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.768 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.768 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.768 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2024-08-31T04:38:38.768 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.768 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.768 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-08-31T04:38:38.768 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-08-31T04:38:38.768 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-08-31T04:38:38.768 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-08-31T04:38:38.768 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-08-31T04:38:38.768 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-08-31T04:38:38.768 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-08-31T04:38:38.768 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-08-31T04:38:38.768 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.769 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.769 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.769 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.769 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.769 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2024-08-31T04:38:38.769 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2024-08-31T04:38:38.769 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:38.769 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.769 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.769 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-08-31T04:38:38.769 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.769 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.770 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.770 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.770 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.770 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.770 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.770 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.770 INFO:teuthology.orchestra.run.smithi050.stdout: "sqlite3_killpoint": { 2024-08-31T04:38:38.770 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "sqlite3_killpoint", 2024-08-31T04:38:38.770 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-08-31T04:38:38.770 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "dev", 2024-08-31T04:38:38.770 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.770 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "0", 2024-08-31T04:38:38.770 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.771 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.771 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.771 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.771 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.771 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.771 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.771 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.771 INFO:teuthology.orchestra.run.smithi050.stdout: "zabbix_host": { 2024-08-31T04:38:38.771 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "zabbix_host", 2024-08-31T04:38:38.771 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.771 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.771 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.771 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-08-31T04:38:38.771 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.772 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.772 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.772 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.772 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.772 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.772 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.772 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.772 INFO:teuthology.orchestra.run.smithi050.stdout: "zabbix_port": { 2024-08-31T04:38:38.772 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "zabbix_port", 2024-08-31T04:38:38.772 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-08-31T04:38:38.772 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.772 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.773 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "10051", 2024-08-31T04:38:38.773 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.773 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.773 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.773 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.773 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.773 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.773 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.773 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.773 INFO:teuthology.orchestra.run.smithi050.stdout: "zabbix_sender": { 2024-08-31T04:38:38.773 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "zabbix_sender", 2024-08-31T04:38:38.773 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.773 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.773 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.773 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-08-31T04:38:38.774 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.774 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.774 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.774 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.774 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.774 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.774 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.774 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T04:38:38.774 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T04:38:38.774 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T04:38:38.774 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-08-31T04:38:38.774 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T04:38:38.774 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-08-31T04:38:38.774 INFO:teuthology.orchestra.run.smithi050.stdout: "modules": [ 2024-08-31T04:38:38.775 INFO:teuthology.orchestra.run.smithi050.stdout: "cephadm", 2024-08-31T04:38:38.775 INFO:teuthology.orchestra.run.smithi050.stdout: "dashboard", 2024-08-31T04:38:38.775 INFO:teuthology.orchestra.run.smithi050.stdout: "iostat", 2024-08-31T04:38:38.775 INFO:teuthology.orchestra.run.smithi050.stdout: "nfs", 2024-08-31T04:38:38.775 INFO:teuthology.orchestra.run.smithi050.stdout: "restful" 2024-08-31T04:38:38.775 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-08-31T04:38:38.775 INFO:teuthology.orchestra.run.smithi050.stdout: "available_modules": [ 2024-08-31T04:38:38.775 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-08-31T04:38:38.775 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "alerts", 2024-08-31T04:38:38.775 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2024-08-31T04:38:38.775 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2024-08-31T04:38:38.775 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2024-08-31T04:38:38.775 INFO:teuthology.orchestra.run.smithi050.stdout: "interval": { 2024-08-31T04:38:38.776 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "interval", 2024-08-31T04:38:38.776 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "secs", 2024-08-31T04:38:38.776 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.776 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.776 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "60", 2024-08-31T04:38:38.776 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.776 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.776 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.776 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "How frequently to reexamine health status", 2024-08-31T04:38:38.776 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.776 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.776 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.776 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.776 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2024-08-31T04:38:38.777 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2024-08-31T04:38:38.777 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.777 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.777 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.777 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-08-31T04:38:38.777 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.777 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.777 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-08-31T04:38:38.777 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-08-31T04:38:38.777 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-08-31T04:38:38.777 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-08-31T04:38:38.777 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-08-31T04:38:38.777 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-08-31T04:38:38.777 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-08-31T04:38:38.778 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-08-31T04:38:38.778 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.778 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.778 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.778 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.778 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.778 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2024-08-31T04:38:38.778 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2024-08-31T04:38:38.778 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:38.778 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.778 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.778 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-08-31T04:38:38.778 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.778 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.779 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.779 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.779 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.779 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.779 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.779 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.779 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2024-08-31T04:38:38.779 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2024-08-31T04:38:38.779 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.779 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.779 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.779 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2024-08-31T04:38:38.779 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.779 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.780 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-08-31T04:38:38.780 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-08-31T04:38:38.780 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-08-31T04:38:38.780 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-08-31T04:38:38.780 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-08-31T04:38:38.780 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-08-31T04:38:38.780 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-08-31T04:38:38.780 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-08-31T04:38:38.780 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.780 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.780 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.780 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.780 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.780 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2024-08-31T04:38:38.781 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2024-08-31T04:38:38.781 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:38.781 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.781 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.781 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-08-31T04:38:38.781 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.781 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.781 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.781 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.781 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.781 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.781 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.782 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.782 INFO:teuthology.orchestra.run.smithi050.stdout: "smtp_destination": { 2024-08-31T04:38:38.782 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "smtp_destination", 2024-08-31T04:38:38.782 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.782 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.782 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.782 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-08-31T04:38:38.782 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.782 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.782 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.782 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Email address to send alerts to", 2024-08-31T04:38:38.782 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.782 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.782 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.782 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.783 INFO:teuthology.orchestra.run.smithi050.stdout: "smtp_from_name": { 2024-08-31T04:38:38.783 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "smtp_from_name", 2024-08-31T04:38:38.783 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.783 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.783 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.783 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "Ceph", 2024-08-31T04:38:38.783 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.783 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.783 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.783 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Email From: name", 2024-08-31T04:38:38.783 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.783 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.783 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.783 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.784 INFO:teuthology.orchestra.run.smithi050.stdout: "smtp_host": { 2024-08-31T04:38:38.784 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "smtp_host", 2024-08-31T04:38:38.784 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.784 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.784 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.784 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-08-31T04:38:38.784 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.784 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.784 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.784 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "SMTP server", 2024-08-31T04:38:38.784 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.784 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.784 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.785 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.785 INFO:teuthology.orchestra.run.smithi050.stdout: "smtp_password": { 2024-08-31T04:38:38.785 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "smtp_password", 2024-08-31T04:38:38.785 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.785 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.785 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.785 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-08-31T04:38:38.785 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.785 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.785 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.785 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Password to authenticate with", 2024-08-31T04:38:38.785 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.785 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.785 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.786 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.786 INFO:teuthology.orchestra.run.smithi050.stdout: "smtp_port": { 2024-08-31T04:38:38.786 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "smtp_port", 2024-08-31T04:38:38.786 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-08-31T04:38:38.786 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.786 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.786 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "465", 2024-08-31T04:38:38.786 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.786 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.786 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.786 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "SMTP port", 2024-08-31T04:38:38.786 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.786 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.786 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.787 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.787 INFO:teuthology.orchestra.run.smithi050.stdout: "smtp_sender": { 2024-08-31T04:38:38.787 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "smtp_sender", 2024-08-31T04:38:38.787 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.787 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.787 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.787 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-08-31T04:38:38.787 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.787 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.787 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.787 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "SMTP envelope sender", 2024-08-31T04:38:38.787 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.787 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.787 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.788 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.788 INFO:teuthology.orchestra.run.smithi050.stdout: "smtp_ssl": { 2024-08-31T04:38:38.788 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "smtp_ssl", 2024-08-31T04:38:38.788 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:38.788 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.788 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.788 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2024-08-31T04:38:38.788 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.788 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.788 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.788 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Use SSL to connect to SMTP server", 2024-08-31T04:38:38.788 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.788 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.789 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.789 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.789 INFO:teuthology.orchestra.run.smithi050.stdout: "smtp_user": { 2024-08-31T04:38:38.789 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "smtp_user", 2024-08-31T04:38:38.789 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.789 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.789 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.789 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-08-31T04:38:38.789 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.789 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.789 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.789 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "User to authenticate as", 2024-08-31T04:38:38.790 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.790 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.790 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.790 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.790 INFO:teuthology.orchestra.run.smithi050.stdout: "sqlite3_killpoint": { 2024-08-31T04:38:38.790 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "sqlite3_killpoint", 2024-08-31T04:38:38.790 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-08-31T04:38:38.790 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "dev", 2024-08-31T04:38:38.790 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.790 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "0", 2024-08-31T04:38:38.790 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.790 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.790 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.791 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.791 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.791 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.791 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.791 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T04:38:38.791 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T04:38:38.791 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.791 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-08-31T04:38:38.791 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "balancer", 2024-08-31T04:38:38.791 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2024-08-31T04:38:38.791 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2024-08-31T04:38:38.791 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2024-08-31T04:38:38.791 INFO:teuthology.orchestra.run.smithi050.stdout: "active": { 2024-08-31T04:38:38.792 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "active", 2024-08-31T04:38:38.792 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:38.792 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.792 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.792 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2024-08-31T04:38:38.792 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.792 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.792 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.792 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "automatically balance PGs across cluster", 2024-08-31T04:38:38.792 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.792 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.792 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.792 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.792 INFO:teuthology.orchestra.run.smithi050.stdout: "begin_time": { 2024-08-31T04:38:38.793 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "begin_time", 2024-08-31T04:38:38.793 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.793 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.793 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.793 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "0000", 2024-08-31T04:38:38.793 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.793 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.793 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.793 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "beginning time of day to automatically balance", 2024-08-31T04:38:38.793 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-08-31T04:38:38.793 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.793 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.793 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.794 INFO:teuthology.orchestra.run.smithi050.stdout: "begin_weekday": { 2024-08-31T04:38:38.794 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "begin_weekday", 2024-08-31T04:38:38.794 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "uint", 2024-08-31T04:38:38.794 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.794 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.794 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "0", 2024-08-31T04:38:38.794 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "0", 2024-08-31T04:38:38.794 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "6", 2024-08-31T04:38:38.794 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.794 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-08-31T04:38:38.794 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-08-31T04:38:38.794 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.794 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.794 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.794 INFO:teuthology.orchestra.run.smithi050.stdout: "crush_compat_max_iterations": { 2024-08-31T04:38:38.794 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "crush_compat_max_iterations", 2024-08-31T04:38:38.795 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "uint", 2024-08-31T04:38:38.795 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.795 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.795 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "25", 2024-08-31T04:38:38.795 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "1", 2024-08-31T04:38:38.795 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "250", 2024-08-31T04:38:38.795 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.795 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-08-31T04:38:38.795 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.795 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.795 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.795 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.795 INFO:teuthology.orchestra.run.smithi050.stdout: "crush_compat_metrics": { 2024-08-31T04:38:38.795 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "crush_compat_metrics", 2024-08-31T04:38:38.796 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.796 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.796 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.796 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "pgs,objects,bytes", 2024-08-31T04:38:38.796 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.796 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.796 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.796 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-08-31T04:38:38.796 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-08-31T04:38:38.796 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.796 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.796 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.796 INFO:teuthology.orchestra.run.smithi050.stdout: "crush_compat_step": { 2024-08-31T04:38:38.796 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "crush_compat_step", 2024-08-31T04:38:38.796 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "float", 2024-08-31T04:38:38.797 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.797 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.797 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "0.5", 2024-08-31T04:38:38.797 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "0.001", 2024-08-31T04:38:38.797 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "0.999", 2024-08-31T04:38:38.797 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.797 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "aggressiveness of optimization", 2024-08-31T04:38:38.797 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-08-31T04:38:38.797 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.797 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.797 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.797 INFO:teuthology.orchestra.run.smithi050.stdout: "end_time": { 2024-08-31T04:38:38.797 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "end_time", 2024-08-31T04:38:38.797 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.798 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.798 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.798 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "2359", 2024-08-31T04:38:38.798 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.798 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.798 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.798 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "ending time of day to automatically balance", 2024-08-31T04:38:38.798 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-08-31T04:38:38.798 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.798 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.798 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.798 INFO:teuthology.orchestra.run.smithi050.stdout: "end_weekday": { 2024-08-31T04:38:38.798 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "end_weekday", 2024-08-31T04:38:38.798 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "uint", 2024-08-31T04:38:38.799 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.799 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.799 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "0", 2024-08-31T04:38:38.799 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "0", 2024-08-31T04:38:38.799 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "6", 2024-08-31T04:38:38.799 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.799 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-08-31T04:38:38.799 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-08-31T04:38:38.799 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.799 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.799 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.799 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2024-08-31T04:38:38.799 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2024-08-31T04:38:38.799 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.800 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.800 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.800 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-08-31T04:38:38.800 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.800 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.800 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-08-31T04:38:38.800 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-08-31T04:38:38.800 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-08-31T04:38:38.800 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-08-31T04:38:38.800 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-08-31T04:38:38.800 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-08-31T04:38:38.800 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-08-31T04:38:38.800 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-08-31T04:38:38.800 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.801 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.801 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.801 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.801 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.801 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2024-08-31T04:38:38.801 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2024-08-31T04:38:38.801 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:38.801 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.801 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.801 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-08-31T04:38:38.801 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.801 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.801 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.801 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.802 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.802 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.802 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.802 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.802 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2024-08-31T04:38:38.802 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2024-08-31T04:38:38.802 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.802 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.802 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.802 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2024-08-31T04:38:38.802 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.802 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.802 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-08-31T04:38:38.802 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-08-31T04:38:38.803 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-08-31T04:38:38.803 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-08-31T04:38:38.803 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-08-31T04:38:38.803 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-08-31T04:38:38.803 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-08-31T04:38:38.803 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-08-31T04:38:38.803 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.803 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.803 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.803 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.803 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.803 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2024-08-31T04:38:38.803 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2024-08-31T04:38:38.803 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:38.803 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.804 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.804 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-08-31T04:38:38.804 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.804 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.804 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.804 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.804 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.804 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.804 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.804 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.804 INFO:teuthology.orchestra.run.smithi050.stdout: "min_score": { 2024-08-31T04:38:38.804 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "min_score", 2024-08-31T04:38:38.804 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "float", 2024-08-31T04:38:38.804 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.805 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.805 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "0", 2024-08-31T04:38:38.805 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.805 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.805 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.805 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-08-31T04:38:38.805 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.805 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.805 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.805 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.805 INFO:teuthology.orchestra.run.smithi050.stdout: "mode": { 2024-08-31T04:38:38.805 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "mode", 2024-08-31T04:38:38.805 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.805 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.806 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.806 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "upmap", 2024-08-31T04:38:38.806 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.806 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.806 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-08-31T04:38:38.806 INFO:teuthology.orchestra.run.smithi050.stdout: "crush-compat", 2024-08-31T04:38:38.806 INFO:teuthology.orchestra.run.smithi050.stdout: "none", 2024-08-31T04:38:38.806 INFO:teuthology.orchestra.run.smithi050.stdout: "read", 2024-08-31T04:38:38.806 INFO:teuthology.orchestra.run.smithi050.stdout: "upmap", 2024-08-31T04:38:38.806 INFO:teuthology.orchestra.run.smithi050.stdout: "upmap-read" 2024-08-31T04:38:38.806 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-08-31T04:38:38.806 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Balancer mode", 2024-08-31T04:38:38.806 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.806 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.806 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.807 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.807 INFO:teuthology.orchestra.run.smithi050.stdout: "pool_ids": { 2024-08-31T04:38:38.807 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "pool_ids", 2024-08-31T04:38:38.807 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.807 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.807 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.807 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-08-31T04:38:38.807 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.807 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.807 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.807 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-08-31T04:38:38.807 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.807 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.807 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.808 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.808 INFO:teuthology.orchestra.run.smithi050.stdout: "sleep_interval": { 2024-08-31T04:38:38.808 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "sleep_interval", 2024-08-31T04:38:38.808 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "secs", 2024-08-31T04:38:38.808 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.808 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.808 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "60", 2024-08-31T04:38:38.808 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.808 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.808 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.808 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-08-31T04:38:38.808 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.808 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.809 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.809 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.809 INFO:teuthology.orchestra.run.smithi050.stdout: "sqlite3_killpoint": { 2024-08-31T04:38:38.809 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "sqlite3_killpoint", 2024-08-31T04:38:38.809 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-08-31T04:38:38.809 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "dev", 2024-08-31T04:38:38.809 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.809 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "0", 2024-08-31T04:38:38.809 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.809 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.809 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.809 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.809 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.809 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.810 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.810 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.810 INFO:teuthology.orchestra.run.smithi050.stdout: "upmap_max_deviation": { 2024-08-31T04:38:38.810 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "upmap_max_deviation", 2024-08-31T04:38:38.810 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-08-31T04:38:38.810 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.810 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.810 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "5", 2024-08-31T04:38:38.810 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "1", 2024-08-31T04:38:38.810 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.810 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.810 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "deviation below which no optimization is attempted", 2024-08-31T04:38:38.810 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-08-31T04:38:38.810 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.811 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.811 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.811 INFO:teuthology.orchestra.run.smithi050.stdout: "upmap_max_optimizations": { 2024-08-31T04:38:38.811 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "upmap_max_optimizations", 2024-08-31T04:38:38.811 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "uint", 2024-08-31T04:38:38.811 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.811 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.811 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "10", 2024-08-31T04:38:38.811 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.811 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.811 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.811 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-08-31T04:38:38.811 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.811 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.812 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.812 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T04:38:38.812 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T04:38:38.812 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.812 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-08-31T04:38:38.812 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "cephadm", 2024-08-31T04:38:38.812 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2024-08-31T04:38:38.812 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2024-08-31T04:38:38.812 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2024-08-31T04:38:38.812 INFO:teuthology.orchestra.run.smithi050.stdout: "agent_down_multiplier": { 2024-08-31T04:38:38.812 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "agent_down_multiplier", 2024-08-31T04:38:38.812 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "float", 2024-08-31T04:38:38.812 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.812 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.813 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "3.0", 2024-08-31T04:38:38.813 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.813 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.813 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.813 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-08-31T04:38:38.813 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.813 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.813 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.813 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.813 INFO:teuthology.orchestra.run.smithi050.stdout: "agent_refresh_rate": { 2024-08-31T04:38:38.813 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "agent_refresh_rate", 2024-08-31T04:38:38.813 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "secs", 2024-08-31T04:38:38.813 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.814 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.814 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "20", 2024-08-31T04:38:38.814 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.814 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.814 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.814 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-08-31T04:38:38.814 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.814 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.814 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.814 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.814 INFO:teuthology.orchestra.run.smithi050.stdout: "agent_starting_port": { 2024-08-31T04:38:38.814 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "agent_starting_port", 2024-08-31T04:38:38.814 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-08-31T04:38:38.815 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.815 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.815 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "4721", 2024-08-31T04:38:38.815 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.815 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.815 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.815 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-08-31T04:38:38.815 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.815 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.815 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.815 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.815 INFO:teuthology.orchestra.run.smithi050.stdout: "allow_ptrace": { 2024-08-31T04:38:38.815 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "allow_ptrace", 2024-08-31T04:38:38.816 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:38.816 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.816 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.816 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-08-31T04:38:38.816 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.816 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.816 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.816 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-08-31T04:38:38.816 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-08-31T04:38:38.816 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.816 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.816 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.816 INFO:teuthology.orchestra.run.smithi050.stdout: "autotune_interval": { 2024-08-31T04:38:38.817 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "autotune_interval", 2024-08-31T04:38:38.817 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "secs", 2024-08-31T04:38:38.817 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.817 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.817 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "600", 2024-08-31T04:38:38.817 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.817 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.817 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.817 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "how frequently to autotune daemon memory", 2024-08-31T04:38:38.817 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.817 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.817 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.817 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.818 INFO:teuthology.orchestra.run.smithi050.stdout: "autotune_memory_target_ratio": { 2024-08-31T04:38:38.818 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "autotune_memory_target_ratio", 2024-08-31T04:38:38.818 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "float", 2024-08-31T04:38:38.818 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.818 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.818 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "0.7", 2024-08-31T04:38:38.818 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.818 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.818 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.818 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-08-31T04:38:38.818 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.818 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.818 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.819 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.819 INFO:teuthology.orchestra.run.smithi050.stdout: "cephadm_log_destination": { 2024-08-31T04:38:38.819 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "cephadm_log_destination", 2024-08-31T04:38:38.819 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.819 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.819 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.819 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-08-31T04:38:38.819 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.819 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.819 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-08-31T04:38:38.819 INFO:teuthology.orchestra.run.smithi050.stdout: "file", 2024-08-31T04:38:38.819 INFO:teuthology.orchestra.run.smithi050.stdout: "file,syslog", 2024-08-31T04:38:38.819 INFO:teuthology.orchestra.run.smithi050.stdout: "syslog" 2024-08-31T04:38:38.820 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-08-31T04:38:38.820 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-08-31T04:38:38.820 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.820 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.820 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.820 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.820 INFO:teuthology.orchestra.run.smithi050.stdout: "cgroups_split": { 2024-08-31T04:38:38.820 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "cgroups_split", 2024-08-31T04:38:38.820 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:38.820 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.820 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.820 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2024-08-31T04:38:38.820 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.821 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.821 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.821 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-08-31T04:38:38.821 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.821 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.821 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.821 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.821 INFO:teuthology.orchestra.run.smithi050.stdout: "config_checks_enabled": { 2024-08-31T04:38:38.821 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "config_checks_enabled", 2024-08-31T04:38:38.821 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:38.821 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.821 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.821 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-08-31T04:38:38.822 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.822 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.822 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.822 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-08-31T04:38:38.822 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.822 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.822 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.822 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.822 INFO:teuthology.orchestra.run.smithi050.stdout: "config_dashboard": { 2024-08-31T04:38:38.822 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "config_dashboard", 2024-08-31T04:38:38.822 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:38.822 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.822 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.823 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2024-08-31T04:38:38.823 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.823 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.823 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.823 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-08-31T04:38:38.823 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.823 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.823 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.823 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.823 INFO:teuthology.orchestra.run.smithi050.stdout: "container_image_alertmanager": { 2024-08-31T04:38:38.823 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "container_image_alertmanager", 2024-08-31T04:38:38.823 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.823 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.823 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.824 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.27.0", 2024-08-31T04:38:38.824 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.824 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.824 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.824 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Prometheus container image", 2024-08-31T04:38:38.824 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.824 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.824 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.824 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.824 INFO:teuthology.orchestra.run.smithi050.stdout: "container_image_base": { 2024-08-31T04:38:38.824 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "container_image_base", 2024-08-31T04:38:38.824 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.824 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.825 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.825 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "quay.io/ceph/ceph", 2024-08-31T04:38:38.825 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.825 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.825 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.825 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Container image name, without the tag", 2024-08-31T04:38:38.825 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.825 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.825 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.825 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.825 INFO:teuthology.orchestra.run.smithi050.stdout: "container_image_elasticsearch": { 2024-08-31T04:38:38.825 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "container_image_elasticsearch", 2024-08-31T04:38:38.825 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.825 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.826 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.826 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-08-31T04:38:38.826 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.826 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.826 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.826 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "elasticsearch container image", 2024-08-31T04:38:38.826 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.826 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.826 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.826 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.826 INFO:teuthology.orchestra.run.smithi050.stdout: "container_image_grafana": { 2024-08-31T04:38:38.826 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "container_image_grafana", 2024-08-31T04:38:38.826 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.826 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.827 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.827 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "quay.io/ceph/grafana:10.4.0", 2024-08-31T04:38:38.827 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.827 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.827 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.827 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Prometheus container image", 2024-08-31T04:38:38.827 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.827 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.827 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.827 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.827 INFO:teuthology.orchestra.run.smithi050.stdout: "container_image_haproxy": { 2024-08-31T04:38:38.827 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "container_image_haproxy", 2024-08-31T04:38:38.827 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.827 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.827 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.828 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-08-31T04:38:38.828 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.828 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.828 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.828 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "HAproxy container image", 2024-08-31T04:38:38.828 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.828 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.828 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.828 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.828 INFO:teuthology.orchestra.run.smithi050.stdout: "container_image_jaeger_agent": { 2024-08-31T04:38:38.828 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "container_image_jaeger_agent", 2024-08-31T04:38:38.828 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.828 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.828 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.829 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-08-31T04:38:38.829 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.829 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.829 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.829 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Jaeger agent container image", 2024-08-31T04:38:38.829 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.829 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.829 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.829 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.829 INFO:teuthology.orchestra.run.smithi050.stdout: "container_image_jaeger_collector": { 2024-08-31T04:38:38.829 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "container_image_jaeger_collector", 2024-08-31T04:38:38.829 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.829 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.829 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.830 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-08-31T04:38:38.830 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.830 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.830 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.830 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Jaeger collector container image", 2024-08-31T04:38:38.830 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.830 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.830 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.830 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.830 INFO:teuthology.orchestra.run.smithi050.stdout: "container_image_jaeger_query": { 2024-08-31T04:38:38.830 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "container_image_jaeger_query", 2024-08-31T04:38:38.830 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.830 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.830 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.830 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-08-31T04:38:38.831 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.831 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.831 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.831 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Jaeger query container image", 2024-08-31T04:38:38.831 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.831 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.831 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.831 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.831 INFO:teuthology.orchestra.run.smithi050.stdout: "container_image_keepalived": { 2024-08-31T04:38:38.831 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "container_image_keepalived", 2024-08-31T04:38:38.831 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.831 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.831 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.832 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-08-31T04:38:38.832 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.832 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.832 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.832 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Keepalived container image", 2024-08-31T04:38:38.832 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.832 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.832 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.832 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.832 INFO:teuthology.orchestra.run.smithi050.stdout: "container_image_loki": { 2024-08-31T04:38:38.832 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "container_image_loki", 2024-08-31T04:38:38.832 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.832 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.832 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.833 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-08-31T04:38:38.833 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.833 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.833 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.833 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Loki container image", 2024-08-31T04:38:38.833 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.833 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.833 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.833 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.833 INFO:teuthology.orchestra.run.smithi050.stdout: "container_image_nginx": { 2024-08-31T04:38:38.833 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "container_image_nginx", 2024-08-31T04:38:38.833 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.833 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.834 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.834 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "quay.io/ceph/nginx:1.26.1", 2024-08-31T04:38:38.834 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.834 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.834 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.834 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Nginx container image", 2024-08-31T04:38:38.834 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.834 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.834 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.834 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.834 INFO:teuthology.orchestra.run.smithi050.stdout: "container_image_node_exporter": { 2024-08-31T04:38:38.834 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "container_image_node_exporter", 2024-08-31T04:38:38.834 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.834 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.834 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.835 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.7.0", 2024-08-31T04:38:38.835 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.835 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.835 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.835 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Prometheus container image", 2024-08-31T04:38:38.835 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.835 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.835 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.835 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.835 INFO:teuthology.orchestra.run.smithi050.stdout: "container_image_nvmeof": { 2024-08-31T04:38:38.835 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "container_image_nvmeof", 2024-08-31T04:38:38.835 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.835 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.835 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.836 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.17", 2024-08-31T04:38:38.836 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.836 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.836 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.836 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Nvme-of container image", 2024-08-31T04:38:38.836 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.836 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.836 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.836 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.836 INFO:teuthology.orchestra.run.smithi050.stdout: "container_image_oauth2_proxy": { 2024-08-31T04:38:38.836 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "container_image_oauth2_proxy", 2024-08-31T04:38:38.836 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.836 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.837 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.837 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "quay.io/oauth2-proxy/oauth2-proxy:v7.6.0", 2024-08-31T04:38:38.837 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.837 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.837 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.837 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "oauth2-proxy container image", 2024-08-31T04:38:38.837 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.837 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.837 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.837 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.837 INFO:teuthology.orchestra.run.smithi050.stdout: "container_image_prometheus": { 2024-08-31T04:38:38.837 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "container_image_prometheus", 2024-08-31T04:38:38.837 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.838 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.838 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.838 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "quay.io/prometheus/prometheus:v2.51.0", 2024-08-31T04:38:38.838 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.838 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.838 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.838 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Prometheus container image", 2024-08-31T04:38:38.838 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.838 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.838 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.838 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.838 INFO:teuthology.orchestra.run.smithi050.stdout: "container_image_promtail": { 2024-08-31T04:38:38.838 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "container_image_promtail", 2024-08-31T04:38:38.838 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.839 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.839 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.839 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-08-31T04:38:38.839 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.839 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.839 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.839 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Promtail container image", 2024-08-31T04:38:38.839 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.839 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.839 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.839 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.839 INFO:teuthology.orchestra.run.smithi050.stdout: "container_image_samba": { 2024-08-31T04:38:38.839 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "container_image_samba", 2024-08-31T04:38:38.839 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.840 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.840 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.840 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-08-31T04:38:38.840 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.840 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.840 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.840 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Samba/SMB container image", 2024-08-31T04:38:38.840 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.840 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.840 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.840 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.840 INFO:teuthology.orchestra.run.smithi050.stdout: "container_image_snmp_gateway": { 2024-08-31T04:38:38.840 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "container_image_snmp_gateway", 2024-08-31T04:38:38.841 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.841 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.841 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.841 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-08-31T04:38:38.841 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.841 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.841 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.841 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "SNMP Gateway container image", 2024-08-31T04:38:38.841 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.841 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.841 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.841 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.841 INFO:teuthology.orchestra.run.smithi050.stdout: "container_init": { 2024-08-31T04:38:38.841 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "container_init", 2024-08-31T04:38:38.842 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:38.842 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.842 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.842 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2024-08-31T04:38:38.842 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.842 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.842 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.842 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Run podman/docker with `--init`", 2024-08-31T04:38:38.842 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.842 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.842 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.842 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.842 INFO:teuthology.orchestra.run.smithi050.stdout: "daemon_cache_timeout": { 2024-08-31T04:38:38.842 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "daemon_cache_timeout", 2024-08-31T04:38:38.843 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "secs", 2024-08-31T04:38:38.843 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.843 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.843 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "600", 2024-08-31T04:38:38.843 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.843 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.843 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.843 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-08-31T04:38:38.843 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.843 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.843 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.843 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.843 INFO:teuthology.orchestra.run.smithi050.stdout: "default_cephadm_command_timeout": { 2024-08-31T04:38:38.843 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "default_cephadm_command_timeout", 2024-08-31T04:38:38.844 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-08-31T04:38:38.844 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.844 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.844 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "900", 2024-08-31T04:38:38.844 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.844 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.844 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.844 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-08-31T04:38:38.844 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.844 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.844 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.844 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.844 INFO:teuthology.orchestra.run.smithi050.stdout: "default_registry": { 2024-08-31T04:38:38.844 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "default_registry", 2024-08-31T04:38:38.845 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.845 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.845 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.845 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "docker.io", 2024-08-31T04:38:38.845 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.845 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.845 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.845 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-08-31T04:38:38.845 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.845 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.845 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.845 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.845 INFO:teuthology.orchestra.run.smithi050.stdout: "device_cache_timeout": { 2024-08-31T04:38:38.845 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "device_cache_timeout", 2024-08-31T04:38:38.845 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "secs", 2024-08-31T04:38:38.846 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.846 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.846 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "1800", 2024-08-31T04:38:38.846 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.846 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.846 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.846 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "seconds to cache device inventory", 2024-08-31T04:38:38.846 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.846 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.846 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.847 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.847 INFO:teuthology.orchestra.run.smithi050.stdout: "device_enhanced_scan": { 2024-08-31T04:38:38.847 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "device_enhanced_scan", 2024-08-31T04:38:38.847 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:38.847 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.847 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.847 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-08-31T04:38:38.847 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.847 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.847 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.847 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Use libstoragemgmt during device scans", 2024-08-31T04:38:38.847 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.847 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.847 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.848 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.848 INFO:teuthology.orchestra.run.smithi050.stdout: "facts_cache_timeout": { 2024-08-31T04:38:38.848 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "facts_cache_timeout", 2024-08-31T04:38:38.848 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "secs", 2024-08-31T04:38:38.848 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.848 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.848 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "60", 2024-08-31T04:38:38.848 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.848 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.848 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.848 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "seconds to cache host facts data", 2024-08-31T04:38:38.848 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.848 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.848 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.849 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.849 INFO:teuthology.orchestra.run.smithi050.stdout: "grafana_dashboards_path": { 2024-08-31T04:38:38.849 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "grafana_dashboards_path", 2024-08-31T04:38:38.849 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.849 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.849 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.849 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-08-31T04:38:38.849 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.849 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.849 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.849 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-08-31T04:38:38.849 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.849 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.850 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.850 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.850 INFO:teuthology.orchestra.run.smithi050.stdout: "host_check_interval": { 2024-08-31T04:38:38.850 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "host_check_interval", 2024-08-31T04:38:38.850 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "secs", 2024-08-31T04:38:38.850 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.850 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.850 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "600", 2024-08-31T04:38:38.850 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.850 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.850 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.850 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "how frequently to perform a host check", 2024-08-31T04:38:38.850 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.851 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.851 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.851 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.851 INFO:teuthology.orchestra.run.smithi050.stdout: "hw_monitoring": { 2024-08-31T04:38:38.851 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "hw_monitoring", 2024-08-31T04:38:38.851 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:38.851 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.851 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.851 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-08-31T04:38:38.851 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.851 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.851 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.851 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-08-31T04:38:38.851 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.852 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.852 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.852 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.852 INFO:teuthology.orchestra.run.smithi050.stdout: "inventory_list_all": { 2024-08-31T04:38:38.852 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "inventory_list_all", 2024-08-31T04:38:38.852 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:38.852 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.852 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.852 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-08-31T04:38:38.852 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.852 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.852 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.852 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-08-31T04:38:38.852 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.853 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.853 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.853 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.853 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2024-08-31T04:38:38.853 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2024-08-31T04:38:38.853 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.853 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.853 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.853 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-08-31T04:38:38.853 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.853 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.853 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-08-31T04:38:38.853 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-08-31T04:38:38.853 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-08-31T04:38:38.854 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-08-31T04:38:38.854 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-08-31T04:38:38.854 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-08-31T04:38:38.854 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-08-31T04:38:38.854 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-08-31T04:38:38.854 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.854 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.854 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.854 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.854 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.854 INFO:teuthology.orchestra.run.smithi050.stdout: "log_refresh_metadata": { 2024-08-31T04:38:38.854 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_refresh_metadata", 2024-08-31T04:38:38.854 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:38.855 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.855 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.855 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-08-31T04:38:38.855 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.855 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.855 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.855 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-08-31T04:38:38.855 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.855 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.855 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.855 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.855 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2024-08-31T04:38:38.855 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2024-08-31T04:38:38.855 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:38.856 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.856 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.856 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2024-08-31T04:38:38.856 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.856 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.856 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.856 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-08-31T04:38:38.856 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.856 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.856 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.856 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.856 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2024-08-31T04:38:38.856 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2024-08-31T04:38:38.857 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.857 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.857 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.857 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2024-08-31T04:38:38.857 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.857 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.857 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-08-31T04:38:38.857 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-08-31T04:38:38.857 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-08-31T04:38:38.857 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-08-31T04:38:38.857 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-08-31T04:38:38.857 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-08-31T04:38:38.857 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-08-31T04:38:38.857 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-08-31T04:38:38.858 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.858 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.858 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.858 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.858 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.858 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2024-08-31T04:38:38.858 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2024-08-31T04:38:38.858 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:38.858 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.858 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.858 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-08-31T04:38:38.858 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.858 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.858 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.859 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.859 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.859 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.859 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.859 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.859 INFO:teuthology.orchestra.run.smithi050.stdout: "manage_etc_ceph_ceph_conf": { 2024-08-31T04:38:38.859 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-08-31T04:38:38.859 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:38.859 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.859 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.859 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-08-31T04:38:38.859 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.859 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.859 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.860 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-08-31T04:38:38.860 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.860 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.860 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.860 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.860 INFO:teuthology.orchestra.run.smithi050.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-08-31T04:38:38.860 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-08-31T04:38:38.860 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.860 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.860 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.860 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "*", 2024-08-31T04:38:38.860 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.860 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.860 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.861 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-08-31T04:38:38.861 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.861 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.861 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.861 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.861 INFO:teuthology.orchestra.run.smithi050.stdout: "max_count_per_host": { 2024-08-31T04:38:38.861 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "max_count_per_host", 2024-08-31T04:38:38.861 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-08-31T04:38:38.861 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.861 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.861 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "10", 2024-08-31T04:38:38.861 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.861 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.861 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.861 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "max number of daemons per service per host", 2024-08-31T04:38:38.862 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.862 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.862 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.862 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.862 INFO:teuthology.orchestra.run.smithi050.stdout: "max_osd_draining_count": { 2024-08-31T04:38:38.862 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "max_osd_draining_count", 2024-08-31T04:38:38.862 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-08-31T04:38:38.862 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.862 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.862 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "10", 2024-08-31T04:38:38.862 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.862 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.862 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.862 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-08-31T04:38:38.862 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.863 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.863 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.863 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.863 INFO:teuthology.orchestra.run.smithi050.stdout: "migration_current": { 2024-08-31T04:38:38.863 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "migration_current", 2024-08-31T04:38:38.863 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-08-31T04:38:38.863 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.863 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.863 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-08-31T04:38:38.863 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.863 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.863 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.863 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "internal - do not modify", 2024-08-31T04:38:38.863 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.864 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.864 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.864 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.864 INFO:teuthology.orchestra.run.smithi050.stdout: "mode": { 2024-08-31T04:38:38.864 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "mode", 2024-08-31T04:38:38.864 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.864 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.864 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.864 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "root", 2024-08-31T04:38:38.864 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.864 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.864 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-08-31T04:38:38.864 INFO:teuthology.orchestra.run.smithi050.stdout: "cephadm-package", 2024-08-31T04:38:38.864 INFO:teuthology.orchestra.run.smithi050.stdout: "root" 2024-08-31T04:38:38.864 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-08-31T04:38:38.865 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "mode for remote execution of cephadm", 2024-08-31T04:38:38.865 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.865 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.865 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.865 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.865 INFO:teuthology.orchestra.run.smithi050.stdout: "oob_default_addr": { 2024-08-31T04:38:38.865 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "oob_default_addr", 2024-08-31T04:38:38.865 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.865 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.865 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.865 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "169.254.1.1", 2024-08-31T04:38:38.865 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.865 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.865 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.866 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Default address for RedFish API (oob management).", 2024-08-31T04:38:38.866 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.866 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.866 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.866 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.866 INFO:teuthology.orchestra.run.smithi050.stdout: "prometheus_alerts_path": { 2024-08-31T04:38:38.866 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "prometheus_alerts_path", 2024-08-31T04:38:38.866 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.866 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.866 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.866 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-08-31T04:38:38.866 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.866 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.866 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.867 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-08-31T04:38:38.867 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.867 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.867 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.867 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.867 INFO:teuthology.orchestra.run.smithi050.stdout: "registry_insecure": { 2024-08-31T04:38:38.867 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "registry_insecure", 2024-08-31T04:38:38.867 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:38.867 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.867 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.867 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-08-31T04:38:38.867 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.867 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.867 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.867 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-08-31T04:38:38.868 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.868 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.868 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.868 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.868 INFO:teuthology.orchestra.run.smithi050.stdout: "registry_password": { 2024-08-31T04:38:38.868 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "registry_password", 2024-08-31T04:38:38.868 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.868 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.868 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.868 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-08-31T04:38:38.868 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.868 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.868 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.868 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-08-31T04:38:38.869 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.869 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.869 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.869 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.869 INFO:teuthology.orchestra.run.smithi050.stdout: "registry_url": { 2024-08-31T04:38:38.869 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "registry_url", 2024-08-31T04:38:38.869 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.869 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.869 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.869 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-08-31T04:38:38.869 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.869 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.869 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.870 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-08-31T04:38:38.870 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.870 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.870 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.870 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.870 INFO:teuthology.orchestra.run.smithi050.stdout: "registry_username": { 2024-08-31T04:38:38.870 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "registry_username", 2024-08-31T04:38:38.870 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.870 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.870 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.870 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-08-31T04:38:38.870 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.870 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.870 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.870 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-08-31T04:38:38.871 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.871 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.871 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.871 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.871 INFO:teuthology.orchestra.run.smithi050.stdout: "secure_monitoring_stack": { 2024-08-31T04:38:38.871 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "secure_monitoring_stack", 2024-08-31T04:38:38.871 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:38.871 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.871 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.871 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-08-31T04:38:38.871 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.871 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.871 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.871 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-08-31T04:38:38.872 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.872 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.872 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.872 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.872 INFO:teuthology.orchestra.run.smithi050.stdout: "service_discovery_port": { 2024-08-31T04:38:38.872 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "service_discovery_port", 2024-08-31T04:38:38.872 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-08-31T04:38:38.872 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.872 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.872 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "8765", 2024-08-31T04:38:38.872 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.872 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.872 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.872 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "cephadm service discovery port", 2024-08-31T04:38:38.873 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.873 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.873 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.873 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.873 INFO:teuthology.orchestra.run.smithi050.stdout: "sqlite3_killpoint": { 2024-08-31T04:38:38.873 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "sqlite3_killpoint", 2024-08-31T04:38:38.873 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-08-31T04:38:38.873 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "dev", 2024-08-31T04:38:38.873 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.873 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "0", 2024-08-31T04:38:38.873 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.873 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.873 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.873 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.873 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.874 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.874 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.874 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.874 INFO:teuthology.orchestra.run.smithi050.stdout: "ssh_config_file": { 2024-08-31T04:38:38.874 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "ssh_config_file", 2024-08-31T04:38:38.874 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.874 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.874 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.874 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-08-31T04:38:38.874 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.874 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.874 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.874 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-08-31T04:38:38.874 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.874 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.874 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.875 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.875 INFO:teuthology.orchestra.run.smithi050.stdout: "use_agent": { 2024-08-31T04:38:38.875 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "use_agent", 2024-08-31T04:38:38.875 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:38.875 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.875 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.875 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-08-31T04:38:38.875 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.875 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.875 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.875 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-08-31T04:38:38.875 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.875 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.875 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.875 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.876 INFO:teuthology.orchestra.run.smithi050.stdout: "use_repo_digest": { 2024-08-31T04:38:38.876 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "use_repo_digest", 2024-08-31T04:38:38.876 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:38.876 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.876 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.876 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2024-08-31T04:38:38.876 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.876 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.876 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.876 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-08-31T04:38:38.876 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.876 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.876 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.876 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.876 INFO:teuthology.orchestra.run.smithi050.stdout: "warn_on_failed_host_check": { 2024-08-31T04:38:38.877 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "warn_on_failed_host_check", 2024-08-31T04:38:38.877 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:38.877 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.877 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.877 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2024-08-31T04:38:38.877 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.877 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.877 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.877 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "raise a health warning if the host check fails", 2024-08-31T04:38:38.877 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.877 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.877 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.877 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.877 INFO:teuthology.orchestra.run.smithi050.stdout: "warn_on_stray_daemons": { 2024-08-31T04:38:38.878 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "warn_on_stray_daemons", 2024-08-31T04:38:38.878 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:38.878 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.878 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.878 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2024-08-31T04:38:38.878 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.878 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.878 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.878 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-08-31T04:38:38.878 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.878 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.878 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.878 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.878 INFO:teuthology.orchestra.run.smithi050.stdout: "warn_on_stray_hosts": { 2024-08-31T04:38:38.878 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "warn_on_stray_hosts", 2024-08-31T04:38:38.878 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:38.879 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.879 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.879 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2024-08-31T04:38:38.879 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.879 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.879 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.879 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-08-31T04:38:38.879 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.879 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.879 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.879 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T04:38:38.879 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T04:38:38.879 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.879 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-08-31T04:38:38.879 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "crash", 2024-08-31T04:38:38.880 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2024-08-31T04:38:38.880 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2024-08-31T04:38:38.880 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2024-08-31T04:38:38.880 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2024-08-31T04:38:38.880 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2024-08-31T04:38:38.880 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.880 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.880 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.880 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-08-31T04:38:38.880 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.880 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.880 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-08-31T04:38:38.880 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-08-31T04:38:38.880 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-08-31T04:38:38.881 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-08-31T04:38:38.881 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-08-31T04:38:38.881 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-08-31T04:38:38.881 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-08-31T04:38:38.881 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-08-31T04:38:38.881 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.881 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.881 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.881 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.881 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.881 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2024-08-31T04:38:38.881 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2024-08-31T04:38:38.881 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:38.881 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.882 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.882 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-08-31T04:38:38.882 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.882 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.882 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.882 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.882 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.882 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.882 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.882 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.882 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2024-08-31T04:38:38.882 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2024-08-31T04:38:38.882 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.882 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.883 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.883 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2024-08-31T04:38:38.883 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.883 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.883 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-08-31T04:38:38.883 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-08-31T04:38:38.883 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-08-31T04:38:38.883 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-08-31T04:38:38.883 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-08-31T04:38:38.883 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-08-31T04:38:38.883 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-08-31T04:38:38.883 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-08-31T04:38:38.883 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.883 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.883 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.884 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.884 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.884 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2024-08-31T04:38:38.884 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2024-08-31T04:38:38.884 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:38.884 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.884 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.884 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-08-31T04:38:38.884 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.884 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.884 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.884 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.884 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.884 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.884 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.885 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.885 INFO:teuthology.orchestra.run.smithi050.stdout: "retain_interval": { 2024-08-31T04:38:38.885 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "retain_interval", 2024-08-31T04:38:38.885 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "secs", 2024-08-31T04:38:38.885 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.885 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.885 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "31536000", 2024-08-31T04:38:38.885 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.885 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.885 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.885 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "how long to retain crashes before pruning them", 2024-08-31T04:38:38.885 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.885 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.885 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.885 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.886 INFO:teuthology.orchestra.run.smithi050.stdout: "sqlite3_killpoint": { 2024-08-31T04:38:38.886 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "sqlite3_killpoint", 2024-08-31T04:38:38.886 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-08-31T04:38:38.886 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "dev", 2024-08-31T04:38:38.886 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.886 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "0", 2024-08-31T04:38:38.886 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.886 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.886 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.886 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.886 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.886 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.886 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.886 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.886 INFO:teuthology.orchestra.run.smithi050.stdout: "warn_recent_interval": { 2024-08-31T04:38:38.887 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "warn_recent_interval", 2024-08-31T04:38:38.887 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "secs", 2024-08-31T04:38:38.887 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.887 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.887 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "1209600", 2024-08-31T04:38:38.887 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.887 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.887 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.887 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "time interval in which to warn about recent crashes", 2024-08-31T04:38:38.887 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.887 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.887 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.887 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T04:38:38.887 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T04:38:38.888 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.888 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-08-31T04:38:38.888 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "dashboard", 2024-08-31T04:38:38.888 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2024-08-31T04:38:38.888 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2024-08-31T04:38:38.888 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2024-08-31T04:38:38.888 INFO:teuthology.orchestra.run.smithi050.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-08-31T04:38:38.888 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-08-31T04:38:38.888 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-08-31T04:38:38.888 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.888 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.888 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "10", 2024-08-31T04:38:38.888 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.888 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.889 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.889 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.889 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.889 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.889 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.889 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.889 INFO:teuthology.orchestra.run.smithi050.stdout: "ALERTMANAGER_API_HOST": { 2024-08-31T04:38:38.889 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "ALERTMANAGER_API_HOST", 2024-08-31T04:38:38.889 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.889 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.889 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.889 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-08-31T04:38:38.889 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.890 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.890 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.890 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.890 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.890 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.890 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.890 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.890 INFO:teuthology.orchestra.run.smithi050.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-08-31T04:38:38.890 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-08-31T04:38:38.890 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:38.890 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.890 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.890 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2024-08-31T04:38:38.890 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.891 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.891 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.891 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.891 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.891 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.891 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.891 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.891 INFO:teuthology.orchestra.run.smithi050.stdout: "AUDIT_API_ENABLED": { 2024-08-31T04:38:38.891 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "AUDIT_API_ENABLED", 2024-08-31T04:38:38.891 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:38.891 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.891 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.891 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-08-31T04:38:38.891 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.891 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.892 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.892 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.892 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.892 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.892 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.892 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.892 INFO:teuthology.orchestra.run.smithi050.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-08-31T04:38:38.892 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-08-31T04:38:38.892 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:38.892 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.892 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.892 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2024-08-31T04:38:38.892 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.893 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.893 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.893 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.893 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.893 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.893 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.893 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.893 INFO:teuthology.orchestra.run.smithi050.stdout: "ENABLE_BROWSABLE_API": { 2024-08-31T04:38:38.893 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "ENABLE_BROWSABLE_API", 2024-08-31T04:38:38.893 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:38.893 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.893 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.893 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2024-08-31T04:38:38.894 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.894 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.894 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.894 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.894 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.894 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.894 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.894 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.894 INFO:teuthology.orchestra.run.smithi050.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-08-31T04:38:38.894 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-08-31T04:38:38.894 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:38.894 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.894 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.894 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2024-08-31T04:38:38.895 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.895 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.895 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.895 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.895 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.895 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.895 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.895 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.895 INFO:teuthology.orchestra.run.smithi050.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-08-31T04:38:38.895 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-08-31T04:38:38.895 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:38.895 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.895 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.895 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2024-08-31T04:38:38.896 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.896 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.896 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.896 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.896 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.896 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.896 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.896 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.896 INFO:teuthology.orchestra.run.smithi050.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-08-31T04:38:38.896 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-08-31T04:38:38.896 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:38.896 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.896 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.897 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2024-08-31T04:38:38.897 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.897 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.897 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.897 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.897 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.897 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.897 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.897 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.897 INFO:teuthology.orchestra.run.smithi050.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-08-31T04:38:38.897 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-08-31T04:38:38.897 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:38.897 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.897 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.898 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2024-08-31T04:38:38.898 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.898 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.898 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.898 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.898 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.898 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.898 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.898 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.898 INFO:teuthology.orchestra.run.smithi050.stdout: "FEATURE_TOGGLE_NFS": { 2024-08-31T04:38:38.898 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-08-31T04:38:38.898 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:38.898 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.898 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.899 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2024-08-31T04:38:38.899 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.899 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.899 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.899 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.899 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.899 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.899 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.899 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.899 INFO:teuthology.orchestra.run.smithi050.stdout: "FEATURE_TOGGLE_RBD": { 2024-08-31T04:38:38.899 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-08-31T04:38:38.899 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:38.899 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.900 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.900 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2024-08-31T04:38:38.900 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.900 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.900 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.900 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.900 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.900 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.900 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.900 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.900 INFO:teuthology.orchestra.run.smithi050.stdout: "FEATURE_TOGGLE_RGW": { 2024-08-31T04:38:38.900 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-08-31T04:38:38.900 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:38.901 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.901 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.901 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2024-08-31T04:38:38.901 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.901 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.901 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.901 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.901 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.901 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.901 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.901 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.901 INFO:teuthology.orchestra.run.smithi050.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-08-31T04:38:38.901 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-08-31T04:38:38.901 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.902 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.902 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.902 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-08-31T04:38:38.902 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.902 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.902 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.902 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.902 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.902 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.902 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.902 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.902 INFO:teuthology.orchestra.run.smithi050.stdout: "GRAFANA_API_PASSWORD": { 2024-08-31T04:38:38.902 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "GRAFANA_API_PASSWORD", 2024-08-31T04:38:38.903 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.903 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.903 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.903 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "admin", 2024-08-31T04:38:38.903 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.903 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.903 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.903 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.903 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.903 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.903 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.903 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.903 INFO:teuthology.orchestra.run.smithi050.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-08-31T04:38:38.903 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-08-31T04:38:38.904 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:38.904 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.904 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.904 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2024-08-31T04:38:38.904 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.904 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.904 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.904 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.904 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.904 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.904 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.904 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.904 INFO:teuthology.orchestra.run.smithi050.stdout: "GRAFANA_API_URL": { 2024-08-31T04:38:38.904 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "GRAFANA_API_URL", 2024-08-31T04:38:38.905 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.905 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.905 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.905 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-08-31T04:38:38.905 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.905 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.905 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.905 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.905 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.905 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.905 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.905 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.905 INFO:teuthology.orchestra.run.smithi050.stdout: "GRAFANA_API_USERNAME": { 2024-08-31T04:38:38.906 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "GRAFANA_API_USERNAME", 2024-08-31T04:38:38.906 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.906 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.906 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.906 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "admin", 2024-08-31T04:38:38.906 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.906 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.906 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.906 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.906 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.906 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.906 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.906 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.906 INFO:teuthology.orchestra.run.smithi050.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-08-31T04:38:38.907 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-08-31T04:38:38.907 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.907 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.907 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.907 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-08-31T04:38:38.907 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.907 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.907 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.907 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.907 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.907 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.907 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.907 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.907 INFO:teuthology.orchestra.run.smithi050.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-08-31T04:38:38.907 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-08-31T04:38:38.908 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:38.908 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.908 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.908 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-08-31T04:38:38.908 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.908 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.908 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.908 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.908 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.908 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.908 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.908 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.908 INFO:teuthology.orchestra.run.smithi050.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-08-31T04:38:38.909 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-08-31T04:38:38.909 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:38.909 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.909 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.909 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2024-08-31T04:38:38.909 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.909 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.909 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.909 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.909 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.909 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.909 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.909 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.910 INFO:teuthology.orchestra.run.smithi050.stdout: "ISSUE_TRACKER_API_KEY": { 2024-08-31T04:38:38.910 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-08-31T04:38:38.910 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.910 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.910 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.910 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-08-31T04:38:38.910 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.910 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.910 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.910 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.910 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.910 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.910 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.910 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.911 INFO:teuthology.orchestra.run.smithi050.stdout: "MANAGED_BY_CLUSTERS": { 2024-08-31T04:38:38.911 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "MANAGED_BY_CLUSTERS", 2024-08-31T04:38:38.911 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.911 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.911 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.911 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "[]", 2024-08-31T04:38:38.911 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.911 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.911 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.911 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.911 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.911 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.911 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.911 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.912 INFO:teuthology.orchestra.run.smithi050.stdout: "MULTICLUSTER_CONFIG": { 2024-08-31T04:38:38.912 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "MULTICLUSTER_CONFIG", 2024-08-31T04:38:38.912 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.912 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.912 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.912 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "{}", 2024-08-31T04:38:38.912 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.912 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.912 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.912 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.912 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.912 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.912 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.912 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.913 INFO:teuthology.orchestra.run.smithi050.stdout: "PROMETHEUS_API_HOST": { 2024-08-31T04:38:38.913 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "PROMETHEUS_API_HOST", 2024-08-31T04:38:38.913 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.913 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.913 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.913 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-08-31T04:38:38.913 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.913 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.913 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.913 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.913 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.913 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.913 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.913 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.914 INFO:teuthology.orchestra.run.smithi050.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-08-31T04:38:38.914 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-08-31T04:38:38.914 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:38.914 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.914 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.914 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2024-08-31T04:38:38.914 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.914 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.914 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.914 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.914 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.914 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.914 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.915 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.915 INFO:teuthology.orchestra.run.smithi050.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-08-31T04:38:38.915 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-08-31T04:38:38.915 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:38.915 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.915 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.915 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-08-31T04:38:38.915 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.915 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.915 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.915 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.915 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.915 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.915 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.916 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.916 INFO:teuthology.orchestra.run.smithi050.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-08-31T04:38:38.916 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-08-31T04:38:38.916 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:38.916 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.916 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.916 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-08-31T04:38:38.916 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.916 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.916 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.916 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.916 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.916 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.917 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.917 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.917 INFO:teuthology.orchestra.run.smithi050.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-08-31T04:38:38.917 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-08-31T04:38:38.917 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:38.917 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.917 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.917 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2024-08-31T04:38:38.917 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.917 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.917 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.917 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.917 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.918 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.918 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.918 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.918 INFO:teuthology.orchestra.run.smithi050.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-08-31T04:38:38.918 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-08-31T04:38:38.918 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:38.918 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.918 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.918 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2024-08-31T04:38:38.918 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.918 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.918 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.918 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.918 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.919 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.919 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.919 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.919 INFO:teuthology.orchestra.run.smithi050.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-08-31T04:38:38.919 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-08-31T04:38:38.919 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:38.919 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.919 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.919 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-08-31T04:38:38.919 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.919 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.919 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.919 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.919 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.920 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.920 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.920 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.920 INFO:teuthology.orchestra.run.smithi050.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-08-31T04:38:38.920 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-08-31T04:38:38.920 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:38.920 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.920 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.920 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-08-31T04:38:38.920 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.920 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.920 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.920 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.920 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.921 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.921 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.921 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.921 INFO:teuthology.orchestra.run.smithi050.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-08-31T04:38:38.921 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-08-31T04:38:38.921 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:38.921 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.921 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.921 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-08-31T04:38:38.921 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.921 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.921 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.921 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.921 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.922 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.922 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.922 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.922 INFO:teuthology.orchestra.run.smithi050.stdout: "PWD_POLICY_ENABLED": { 2024-08-31T04:38:38.922 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "PWD_POLICY_ENABLED", 2024-08-31T04:38:38.922 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:38.922 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.922 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.922 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2024-08-31T04:38:38.922 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.922 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.922 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.922 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.922 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.922 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.923 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.923 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.923 INFO:teuthology.orchestra.run.smithi050.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-08-31T04:38:38.923 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-08-31T04:38:38.923 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.923 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.923 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.923 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-08-31T04:38:38.923 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.923 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.923 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.923 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.923 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.923 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.924 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.924 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.924 INFO:teuthology.orchestra.run.smithi050.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-08-31T04:38:38.924 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-08-31T04:38:38.924 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-08-31T04:38:38.924 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.924 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.924 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "10", 2024-08-31T04:38:38.924 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.924 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.924 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.924 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.924 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.925 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.925 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.925 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.925 INFO:teuthology.orchestra.run.smithi050.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-08-31T04:38:38.925 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-08-31T04:38:38.925 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-08-31T04:38:38.925 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.925 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.925 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "8", 2024-08-31T04:38:38.925 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.925 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.925 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.925 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.925 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.926 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.926 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.926 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.926 INFO:teuthology.orchestra.run.smithi050.stdout: "REST_REQUESTS_TIMEOUT": { 2024-08-31T04:38:38.926 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-08-31T04:38:38.926 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-08-31T04:38:38.926 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.926 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.926 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "45", 2024-08-31T04:38:38.926 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.926 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.926 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.926 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.926 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.927 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.927 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.927 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.927 INFO:teuthology.orchestra.run.smithi050.stdout: "RGW_API_ACCESS_KEY": { 2024-08-31T04:38:38.927 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "RGW_API_ACCESS_KEY", 2024-08-31T04:38:38.927 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.927 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.927 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.927 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-08-31T04:38:38.927 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.927 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.927 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.928 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.928 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.928 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.928 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.928 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.928 INFO:teuthology.orchestra.run.smithi050.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-08-31T04:38:38.928 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-08-31T04:38:38.928 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.928 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.928 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.928 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "admin", 2024-08-31T04:38:38.928 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.928 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.929 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.929 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.929 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.929 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.929 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.929 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.929 INFO:teuthology.orchestra.run.smithi050.stdout: "RGW_API_SECRET_KEY": { 2024-08-31T04:38:38.929 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "RGW_API_SECRET_KEY", 2024-08-31T04:38:38.929 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.929 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.929 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.929 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-08-31T04:38:38.929 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.930 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.930 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.930 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.930 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.930 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.930 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.930 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.930 INFO:teuthology.orchestra.run.smithi050.stdout: "RGW_API_SSL_VERIFY": { 2024-08-31T04:38:38.930 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "RGW_API_SSL_VERIFY", 2024-08-31T04:38:38.930 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:38.930 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.930 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.931 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2024-08-31T04:38:38.931 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.931 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.931 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.931 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.931 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.931 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.931 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.931 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.931 INFO:teuthology.orchestra.run.smithi050.stdout: "UNSAFE_TLS_v1_2": { 2024-08-31T04:38:38.931 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "UNSAFE_TLS_v1_2", 2024-08-31T04:38:38.931 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:38.931 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.932 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.932 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-08-31T04:38:38.932 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.932 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.932 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.932 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.932 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.932 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.932 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.932 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.932 INFO:teuthology.orchestra.run.smithi050.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-08-31T04:38:38.932 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-08-31T04:38:38.932 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-08-31T04:38:38.933 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.933 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.933 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "0", 2024-08-31T04:38:38.933 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.933 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.933 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.933 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.933 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.933 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.933 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.933 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.933 INFO:teuthology.orchestra.run.smithi050.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-08-31T04:38:38.934 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-08-31T04:38:38.934 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-08-31T04:38:38.934 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.934 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.934 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "10", 2024-08-31T04:38:38.934 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.934 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.934 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.934 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.934 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.934 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.934 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.934 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.934 INFO:teuthology.orchestra.run.smithi050.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-08-31T04:38:38.935 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-08-31T04:38:38.935 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-08-31T04:38:38.935 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.935 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.935 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "5", 2024-08-31T04:38:38.935 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.935 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.935 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.935 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.935 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.935 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.935 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.935 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.936 INFO:teuthology.orchestra.run.smithi050.stdout: "cross_origin_url": { 2024-08-31T04:38:38.936 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "cross_origin_url", 2024-08-31T04:38:38.936 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.936 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.936 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.936 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-08-31T04:38:38.936 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.936 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.936 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.936 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.936 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.936 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.937 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.937 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.937 INFO:teuthology.orchestra.run.smithi050.stdout: "crt_file": { 2024-08-31T04:38:38.937 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "crt_file", 2024-08-31T04:38:38.937 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.937 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.937 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.937 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-08-31T04:38:38.937 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.937 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.937 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.937 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.937 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.937 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.938 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.938 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.938 INFO:teuthology.orchestra.run.smithi050.stdout: "debug": { 2024-08-31T04:38:38.938 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "debug", 2024-08-31T04:38:38.938 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:38.938 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.938 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.938 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-08-31T04:38:38.938 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.938 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.938 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.938 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Enable/disable debug options", 2024-08-31T04:38:38.938 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.938 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.939 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.939 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.939 INFO:teuthology.orchestra.run.smithi050.stdout: "jwt_token_ttl": { 2024-08-31T04:38:38.939 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "jwt_token_ttl", 2024-08-31T04:38:38.939 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-08-31T04:38:38.939 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.939 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.939 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "28800", 2024-08-31T04:38:38.939 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.939 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.939 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.939 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.939 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.939 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.940 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.940 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.940 INFO:teuthology.orchestra.run.smithi050.stdout: "key_file": { 2024-08-31T04:38:38.940 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "key_file", 2024-08-31T04:38:38.940 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.940 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.940 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.940 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-08-31T04:38:38.940 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.940 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.940 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.940 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.940 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.940 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.941 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.941 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.941 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2024-08-31T04:38:38.941 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2024-08-31T04:38:38.941 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.941 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.941 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.941 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-08-31T04:38:38.941 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.941 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.941 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-08-31T04:38:38.941 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-08-31T04:38:38.941 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-08-31T04:38:38.941 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-08-31T04:38:38.942 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-08-31T04:38:38.942 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-08-31T04:38:38.942 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-08-31T04:38:38.942 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-08-31T04:38:38.942 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.942 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.942 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.942 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.942 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.942 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2024-08-31T04:38:38.942 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2024-08-31T04:38:38.942 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:38.942 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.942 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.943 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-08-31T04:38:38.943 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.943 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.943 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.943 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.943 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.943 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.943 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.943 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.943 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2024-08-31T04:38:38.943 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2024-08-31T04:38:38.943 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.943 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.943 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.943 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2024-08-31T04:38:38.944 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.944 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.944 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-08-31T04:38:38.944 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-08-31T04:38:38.944 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-08-31T04:38:38.944 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-08-31T04:38:38.944 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-08-31T04:38:38.944 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-08-31T04:38:38.944 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-08-31T04:38:38.944 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-08-31T04:38:38.944 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.944 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.944 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.945 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.945 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.945 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2024-08-31T04:38:38.945 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2024-08-31T04:38:38.945 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:38.945 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.945 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.945 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-08-31T04:38:38.945 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.945 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.945 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.945 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.945 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.945 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.945 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.946 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.946 INFO:teuthology.orchestra.run.smithi050.stdout: "motd": { 2024-08-31T04:38:38.946 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "motd", 2024-08-31T04:38:38.946 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.946 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.946 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.946 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-08-31T04:38:38.946 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.946 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.946 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.946 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "The message of the day", 2024-08-31T04:38:38.946 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.946 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.946 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.947 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.947 INFO:teuthology.orchestra.run.smithi050.stdout: "redirect_resolve_ip_addr": { 2024-08-31T04:38:38.947 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "redirect_resolve_ip_addr", 2024-08-31T04:38:38.947 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:38.947 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.947 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.947 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-08-31T04:38:38.947 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.947 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.947 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.947 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.947 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.947 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.947 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.947 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.948 INFO:teuthology.orchestra.run.smithi050.stdout: "server_addr": { 2024-08-31T04:38:38.948 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "server_addr", 2024-08-31T04:38:38.948 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.948 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.948 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.948 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "::", 2024-08-31T04:38:38.948 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.948 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.948 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.948 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.948 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.948 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.948 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.948 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.949 INFO:teuthology.orchestra.run.smithi050.stdout: "server_port": { 2024-08-31T04:38:38.949 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "server_port", 2024-08-31T04:38:38.949 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-08-31T04:38:38.949 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.949 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.949 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "8080", 2024-08-31T04:38:38.949 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.949 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.949 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.949 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.949 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.949 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.949 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.949 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.950 INFO:teuthology.orchestra.run.smithi050.stdout: "sqlite3_killpoint": { 2024-08-31T04:38:38.950 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "sqlite3_killpoint", 2024-08-31T04:38:38.950 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-08-31T04:38:38.950 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "dev", 2024-08-31T04:38:38.950 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.950 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "0", 2024-08-31T04:38:38.950 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.950 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.950 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.950 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.950 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.950 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.950 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.950 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.951 INFO:teuthology.orchestra.run.smithi050.stdout: "ssl": { 2024-08-31T04:38:38.951 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "ssl", 2024-08-31T04:38:38.951 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:38.951 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.951 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.951 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2024-08-31T04:38:38.951 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.951 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.951 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.951 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.951 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.951 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.951 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.951 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.951 INFO:teuthology.orchestra.run.smithi050.stdout: "ssl_server_port": { 2024-08-31T04:38:38.952 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "ssl_server_port", 2024-08-31T04:38:38.952 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-08-31T04:38:38.952 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.952 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.952 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "8443", 2024-08-31T04:38:38.952 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.952 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.952 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.952 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.952 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.952 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.952 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.952 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.952 INFO:teuthology.orchestra.run.smithi050.stdout: "standby_behaviour": { 2024-08-31T04:38:38.953 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "standby_behaviour", 2024-08-31T04:38:38.953 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.953 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.953 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.953 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "redirect", 2024-08-31T04:38:38.953 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.953 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.953 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-08-31T04:38:38.953 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-08-31T04:38:38.953 INFO:teuthology.orchestra.run.smithi050.stdout: "redirect" 2024-08-31T04:38:38.953 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-08-31T04:38:38.953 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.953 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.953 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.953 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.954 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.954 INFO:teuthology.orchestra.run.smithi050.stdout: "standby_error_status_code": { 2024-08-31T04:38:38.954 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "standby_error_status_code", 2024-08-31T04:38:38.954 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-08-31T04:38:38.954 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.954 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.954 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "500", 2024-08-31T04:38:38.954 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "400", 2024-08-31T04:38:38.954 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "599", 2024-08-31T04:38:38.954 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.954 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.954 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.954 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.954 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.954 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.954 INFO:teuthology.orchestra.run.smithi050.stdout: "url_prefix": { 2024-08-31T04:38:38.955 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "url_prefix", 2024-08-31T04:38:38.955 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.955 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.955 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.955 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-08-31T04:38:38.955 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.955 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.955 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.955 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.955 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.955 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.955 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.955 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T04:38:38.955 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T04:38:38.956 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.956 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-08-31T04:38:38.956 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "devicehealth", 2024-08-31T04:38:38.956 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2024-08-31T04:38:38.956 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2024-08-31T04:38:38.956 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2024-08-31T04:38:38.956 INFO:teuthology.orchestra.run.smithi050.stdout: "enable_monitoring": { 2024-08-31T04:38:38.956 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "enable_monitoring", 2024-08-31T04:38:38.956 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:38.956 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.956 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.956 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2024-08-31T04:38:38.956 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.956 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.957 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.957 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "monitor device health metrics", 2024-08-31T04:38:38.957 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.957 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.957 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.957 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.957 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2024-08-31T04:38:38.957 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2024-08-31T04:38:38.957 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.957 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.957 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.957 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-08-31T04:38:38.957 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.957 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.958 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-08-31T04:38:38.958 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-08-31T04:38:38.958 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-08-31T04:38:38.958 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-08-31T04:38:38.958 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-08-31T04:38:38.958 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-08-31T04:38:38.958 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-08-31T04:38:38.958 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-08-31T04:38:38.958 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.958 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.958 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.958 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.958 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.958 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2024-08-31T04:38:38.959 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2024-08-31T04:38:38.959 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:38.959 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.959 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.959 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-08-31T04:38:38.959 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.959 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.959 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.959 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.959 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.959 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.959 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.959 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.959 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2024-08-31T04:38:38.960 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2024-08-31T04:38:38.960 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.960 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.960 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.960 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2024-08-31T04:38:38.960 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.960 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.960 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-08-31T04:38:38.960 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-08-31T04:38:38.960 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-08-31T04:38:38.960 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-08-31T04:38:38.960 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-08-31T04:38:38.960 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-08-31T04:38:38.960 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-08-31T04:38:38.961 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-08-31T04:38:38.961 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.961 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.961 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.961 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.961 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.961 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2024-08-31T04:38:38.961 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2024-08-31T04:38:38.961 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:38.961 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.961 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.961 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-08-31T04:38:38.961 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.961 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.961 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.962 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.962 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.962 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.962 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.962 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.962 INFO:teuthology.orchestra.run.smithi050.stdout: "mark_out_threshold": { 2024-08-31T04:38:38.962 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "mark_out_threshold", 2024-08-31T04:38:38.962 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "secs", 2024-08-31T04:38:38.962 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.962 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.962 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "2419200", 2024-08-31T04:38:38.962 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.962 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.962 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.962 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-08-31T04:38:38.963 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.963 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.963 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.963 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.963 INFO:teuthology.orchestra.run.smithi050.stdout: "pool_name": { 2024-08-31T04:38:38.963 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "pool_name", 2024-08-31T04:38:38.963 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.963 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.963 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.963 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "device_health_metrics", 2024-08-31T04:38:38.963 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.963 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.963 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.963 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "name of pool in which to store device health metrics", 2024-08-31T04:38:38.964 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.964 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.964 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.964 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.964 INFO:teuthology.orchestra.run.smithi050.stdout: "retention_period": { 2024-08-31T04:38:38.964 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "retention_period", 2024-08-31T04:38:38.964 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "secs", 2024-08-31T04:38:38.964 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.964 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.964 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "15552000", 2024-08-31T04:38:38.964 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.964 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.964 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.964 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "how long to retain device health metrics", 2024-08-31T04:38:38.965 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.965 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.965 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.965 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.965 INFO:teuthology.orchestra.run.smithi050.stdout: "scrape_frequency": { 2024-08-31T04:38:38.965 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "scrape_frequency", 2024-08-31T04:38:38.965 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "secs", 2024-08-31T04:38:38.965 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.965 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.965 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "86400", 2024-08-31T04:38:38.965 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.965 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.965 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.965 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "how frequently to scrape device health metrics", 2024-08-31T04:38:38.965 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.966 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.966 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.966 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.966 INFO:teuthology.orchestra.run.smithi050.stdout: "self_heal": { 2024-08-31T04:38:38.966 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "self_heal", 2024-08-31T04:38:38.966 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:38.966 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.966 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.966 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2024-08-31T04:38:38.966 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.966 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.966 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.966 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-08-31T04:38:38.966 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.966 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.967 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.967 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.967 INFO:teuthology.orchestra.run.smithi050.stdout: "sleep_interval": { 2024-08-31T04:38:38.967 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "sleep_interval", 2024-08-31T04:38:38.967 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "secs", 2024-08-31T04:38:38.967 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.967 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.967 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "600", 2024-08-31T04:38:38.967 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.967 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.967 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.967 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "how frequently to wake up and check device health", 2024-08-31T04:38:38.967 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.967 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.968 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.968 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.968 INFO:teuthology.orchestra.run.smithi050.stdout: "sqlite3_killpoint": { 2024-08-31T04:38:38.968 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "sqlite3_killpoint", 2024-08-31T04:38:38.968 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-08-31T04:38:38.968 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "dev", 2024-08-31T04:38:38.968 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.968 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "0", 2024-08-31T04:38:38.968 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.968 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.968 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.968 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.968 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.968 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.968 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.969 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.969 INFO:teuthology.orchestra.run.smithi050.stdout: "warn_threshold": { 2024-08-31T04:38:38.969 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "warn_threshold", 2024-08-31T04:38:38.969 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "secs", 2024-08-31T04:38:38.969 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.969 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.969 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "7257600", 2024-08-31T04:38:38.969 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.969 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.969 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.969 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-08-31T04:38:38.969 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.969 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.969 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.970 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T04:38:38.970 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T04:38:38.970 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.970 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-08-31T04:38:38.970 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "diskprediction_local", 2024-08-31T04:38:38.970 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2024-08-31T04:38:38.970 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2024-08-31T04:38:38.970 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2024-08-31T04:38:38.970 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2024-08-31T04:38:38.970 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2024-08-31T04:38:38.970 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.970 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.970 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.970 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-08-31T04:38:38.971 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.971 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.971 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-08-31T04:38:38.971 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-08-31T04:38:38.971 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-08-31T04:38:38.971 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-08-31T04:38:38.971 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-08-31T04:38:38.971 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-08-31T04:38:38.971 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-08-31T04:38:38.971 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-08-31T04:38:38.971 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.971 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.971 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.971 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.972 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.972 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2024-08-31T04:38:38.972 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2024-08-31T04:38:38.972 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:38.972 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.972 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.972 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-08-31T04:38:38.972 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.972 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.972 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.972 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.972 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.972 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.973 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.973 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.973 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2024-08-31T04:38:38.973 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2024-08-31T04:38:38.973 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.973 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.973 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.973 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2024-08-31T04:38:38.973 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.973 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.973 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-08-31T04:38:38.973 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-08-31T04:38:38.973 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-08-31T04:38:38.973 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-08-31T04:38:38.973 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-08-31T04:38:38.974 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-08-31T04:38:38.974 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-08-31T04:38:38.974 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-08-31T04:38:38.974 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.974 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.974 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.974 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.974 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.974 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2024-08-31T04:38:38.974 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2024-08-31T04:38:38.974 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:38.974 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.974 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.974 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-08-31T04:38:38.974 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.975 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.975 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.975 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.975 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.975 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.975 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.975 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.975 INFO:teuthology.orchestra.run.smithi050.stdout: "predict_interval": { 2024-08-31T04:38:38.975 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "predict_interval", 2024-08-31T04:38:38.975 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.975 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.975 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.975 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "86400", 2024-08-31T04:38:38.975 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.975 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.976 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.976 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.976 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.976 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.976 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.976 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.976 INFO:teuthology.orchestra.run.smithi050.stdout: "predictor_model": { 2024-08-31T04:38:38.976 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "predictor_model", 2024-08-31T04:38:38.976 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.976 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.976 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.976 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "prophetstor", 2024-08-31T04:38:38.976 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.976 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.977 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.977 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.977 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.977 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.977 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.977 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.977 INFO:teuthology.orchestra.run.smithi050.stdout: "sleep_interval": { 2024-08-31T04:38:38.977 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "sleep_interval", 2024-08-31T04:38:38.977 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.977 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.977 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.977 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "600", 2024-08-31T04:38:38.977 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.977 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.978 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.978 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.978 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.978 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.978 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.978 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.978 INFO:teuthology.orchestra.run.smithi050.stdout: "sqlite3_killpoint": { 2024-08-31T04:38:38.978 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "sqlite3_killpoint", 2024-08-31T04:38:38.978 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-08-31T04:38:38.978 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "dev", 2024-08-31T04:38:38.978 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.978 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "0", 2024-08-31T04:38:38.978 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.978 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.979 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.979 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.979 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.979 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.979 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.979 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T04:38:38.979 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T04:38:38.979 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.979 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-08-31T04:38:38.979 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "influx", 2024-08-31T04:38:38.979 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": false, 2024-08-31T04:38:38.979 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "influxdb python module not found", 2024-08-31T04:38:38.979 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2024-08-31T04:38:38.979 INFO:teuthology.orchestra.run.smithi050.stdout: "batch_size": { 2024-08-31T04:38:38.979 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "batch_size", 2024-08-31T04:38:38.979 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-08-31T04:38:38.980 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.980 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.980 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "5000", 2024-08-31T04:38:38.980 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.980 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.980 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.980 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-08-31T04:38:38.980 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.980 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.980 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.980 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.980 INFO:teuthology.orchestra.run.smithi050.stdout: "database": { 2024-08-31T04:38:38.980 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "database", 2024-08-31T04:38:38.980 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.981 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.981 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.981 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "ceph", 2024-08-31T04:38:38.981 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.981 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.981 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.981 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-08-31T04:38:38.981 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.981 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.981 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.981 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.981 INFO:teuthology.orchestra.run.smithi050.stdout: "hostname": { 2024-08-31T04:38:38.981 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "hostname", 2024-08-31T04:38:38.981 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.982 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.982 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.982 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-08-31T04:38:38.982 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.982 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.982 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.982 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "InfluxDB server hostname", 2024-08-31T04:38:38.982 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.982 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.982 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.982 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.982 INFO:teuthology.orchestra.run.smithi050.stdout: "interval": { 2024-08-31T04:38:38.982 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "interval", 2024-08-31T04:38:38.982 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "secs", 2024-08-31T04:38:38.983 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.983 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.983 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "30", 2024-08-31T04:38:38.983 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "5", 2024-08-31T04:38:38.983 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.983 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.983 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-08-31T04:38:38.983 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.983 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.983 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.983 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.983 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2024-08-31T04:38:38.983 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2024-08-31T04:38:38.983 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.984 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.984 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.984 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-08-31T04:38:38.984 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.984 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.984 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-08-31T04:38:38.984 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-08-31T04:38:38.984 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-08-31T04:38:38.984 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-08-31T04:38:38.984 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-08-31T04:38:38.984 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-08-31T04:38:38.984 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-08-31T04:38:38.984 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-08-31T04:38:38.984 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.985 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.985 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.985 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.985 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.985 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2024-08-31T04:38:38.985 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2024-08-31T04:38:38.985 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:38.985 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.985 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.985 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-08-31T04:38:38.985 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.985 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.985 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.985 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.985 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.986 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.986 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.986 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.986 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2024-08-31T04:38:38.986 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2024-08-31T04:38:38.986 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.986 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.986 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.986 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2024-08-31T04:38:38.986 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.986 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.986 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-08-31T04:38:38.986 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-08-31T04:38:38.986 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-08-31T04:38:38.987 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-08-31T04:38:38.987 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-08-31T04:38:38.987 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-08-31T04:38:38.987 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-08-31T04:38:38.987 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-08-31T04:38:38.987 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.987 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.987 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.987 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.987 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.987 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2024-08-31T04:38:38.987 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2024-08-31T04:38:38.987 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:38.988 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.988 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.988 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-08-31T04:38:38.988 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.988 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.988 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.988 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.988 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.988 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.988 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.988 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.988 INFO:teuthology.orchestra.run.smithi050.stdout: "password": { 2024-08-31T04:38:38.988 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "password", 2024-08-31T04:38:38.988 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.988 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.989 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.989 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-08-31T04:38:38.989 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.989 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.989 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.989 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "password of InfluxDB server user", 2024-08-31T04:38:38.989 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.989 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.989 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.989 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.989 INFO:teuthology.orchestra.run.smithi050.stdout: "port": { 2024-08-31T04:38:38.989 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "port", 2024-08-31T04:38:38.989 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-08-31T04:38:38.990 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.990 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.990 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "8086", 2024-08-31T04:38:38.990 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.990 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.990 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.990 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "InfluxDB server port", 2024-08-31T04:38:38.990 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.990 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.990 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.990 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.990 INFO:teuthology.orchestra.run.smithi050.stdout: "sqlite3_killpoint": { 2024-08-31T04:38:38.990 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "sqlite3_killpoint", 2024-08-31T04:38:38.991 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-08-31T04:38:38.991 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "dev", 2024-08-31T04:38:38.991 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.991 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "0", 2024-08-31T04:38:38.991 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.991 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.991 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.991 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.991 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.991 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.991 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.991 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.991 INFO:teuthology.orchestra.run.smithi050.stdout: "ssl": { 2024-08-31T04:38:38.991 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "ssl", 2024-08-31T04:38:38.991 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.992 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.992 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.992 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "false", 2024-08-31T04:38:38.992 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.992 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.992 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.992 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-08-31T04:38:38.992 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.992 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.992 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.992 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.992 INFO:teuthology.orchestra.run.smithi050.stdout: "threads": { 2024-08-31T04:38:38.992 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "threads", 2024-08-31T04:38:38.993 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-08-31T04:38:38.993 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.993 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.993 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "5", 2024-08-31T04:38:38.993 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "1", 2024-08-31T04:38:38.993 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "32", 2024-08-31T04:38:38.993 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.993 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-08-31T04:38:38.993 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.993 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.993 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.993 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.993 INFO:teuthology.orchestra.run.smithi050.stdout: "username": { 2024-08-31T04:38:38.994 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "username", 2024-08-31T04:38:38.994 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.994 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.994 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.994 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-08-31T04:38:38.994 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.994 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.994 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.994 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "username of InfluxDB server user", 2024-08-31T04:38:38.994 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.994 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.994 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.994 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.994 INFO:teuthology.orchestra.run.smithi050.stdout: "verify_ssl": { 2024-08-31T04:38:38.995 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "verify_ssl", 2024-08-31T04:38:38.995 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.995 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.995 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:38.995 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "true", 2024-08-31T04:38:38.995 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.995 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.995 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.995 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-08-31T04:38:38.995 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.995 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.995 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.995 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T04:38:38.996 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T04:38:38.996 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.996 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-08-31T04:38:38.996 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "insights", 2024-08-31T04:38:38.996 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2024-08-31T04:38:38.996 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2024-08-31T04:38:38.996 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2024-08-31T04:38:38.996 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2024-08-31T04:38:38.996 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2024-08-31T04:38:38.996 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.996 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.996 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.996 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-08-31T04:38:38.996 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.996 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.997 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-08-31T04:38:38.997 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-08-31T04:38:38.997 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-08-31T04:38:38.997 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-08-31T04:38:38.997 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-08-31T04:38:38.997 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-08-31T04:38:38.997 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-08-31T04:38:38.997 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-08-31T04:38:38.997 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.997 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.997 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.997 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.997 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.997 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2024-08-31T04:38:38.998 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2024-08-31T04:38:38.998 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:38.998 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.998 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.998 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-08-31T04:38:38.998 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.998 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.998 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:38.998 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:38.998 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:38.998 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:38.998 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:38.998 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:38.998 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2024-08-31T04:38:38.999 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2024-08-31T04:38:38.999 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:38.999 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:38.999 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:38.999 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2024-08-31T04:38:38.999 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:38.999 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:38.999 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-08-31T04:38:38.999 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-08-31T04:38:38.999 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-08-31T04:38:38.999 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-08-31T04:38:38.999 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-08-31T04:38:38.999 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-08-31T04:38:38.999 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-08-31T04:38:38.999 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-08-31T04:38:39.000 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:39.000 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:39.000 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:39.000 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:39.000 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:39.000 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2024-08-31T04:38:39.000 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2024-08-31T04:38:39.000 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:39.000 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:39.000 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:39.000 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-08-31T04:38:39.000 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:39.000 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:39.000 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:39.001 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:39.001 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:39.001 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:39.001 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:39.001 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:39.001 INFO:teuthology.orchestra.run.smithi050.stdout: "sqlite3_killpoint": { 2024-08-31T04:38:39.001 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "sqlite3_killpoint", 2024-08-31T04:38:39.001 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-08-31T04:38:39.001 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "dev", 2024-08-31T04:38:39.001 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:39.001 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "0", 2024-08-31T04:38:39.001 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:39.001 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:39.002 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:39.002 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:39.002 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:39.002 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:39.002 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:39.002 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T04:38:39.002 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T04:38:39.002 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:39.002 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-08-31T04:38:39.002 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "iostat", 2024-08-31T04:38:39.002 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2024-08-31T04:38:39.002 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2024-08-31T04:38:39.002 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2024-08-31T04:38:39.002 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2024-08-31T04:38:39.003 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2024-08-31T04:38:39.003 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:39.003 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:39.003 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:39.003 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-08-31T04:38:39.003 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:39.003 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:39.003 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-08-31T04:38:39.003 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-08-31T04:38:39.003 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-08-31T04:38:39.003 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-08-31T04:38:39.003 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-08-31T04:38:39.003 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-08-31T04:38:39.004 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-08-31T04:38:39.004 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-08-31T04:38:39.004 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:39.004 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:39.004 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:39.004 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:39.004 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:39.004 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2024-08-31T04:38:39.004 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2024-08-31T04:38:39.004 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:39.004 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:39.004 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:39.004 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-08-31T04:38:39.004 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:39.005 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:39.005 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:39.005 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:39.005 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:39.005 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:39.005 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:39.005 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:39.005 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2024-08-31T04:38:39.005 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2024-08-31T04:38:39.005 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:39.005 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:39.005 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:39.005 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2024-08-31T04:38:39.005 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:39.006 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:39.006 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-08-31T04:38:39.006 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-08-31T04:38:39.006 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-08-31T04:38:39.006 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-08-31T04:38:39.006 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-08-31T04:38:39.006 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-08-31T04:38:39.006 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-08-31T04:38:39.006 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-08-31T04:38:39.006 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:39.006 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:39.006 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:39.006 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:39.006 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:39.006 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2024-08-31T04:38:39.007 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2024-08-31T04:38:39.007 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:39.007 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:39.007 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:39.007 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-08-31T04:38:39.007 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:39.007 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:39.007 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:39.007 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:39.007 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:39.007 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:39.007 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:39.007 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:39.007 INFO:teuthology.orchestra.run.smithi050.stdout: "sqlite3_killpoint": { 2024-08-31T04:38:39.007 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "sqlite3_killpoint", 2024-08-31T04:38:39.008 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-08-31T04:38:39.008 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "dev", 2024-08-31T04:38:39.008 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:39.008 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "0", 2024-08-31T04:38:39.008 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:39.008 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:39.008 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:39.008 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:39.008 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:39.008 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:39.008 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:39.008 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T04:38:39.008 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T04:38:39.008 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:39.009 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-08-31T04:38:39.009 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "k8sevents", 2024-08-31T04:38:39.009 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2024-08-31T04:38:39.009 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2024-08-31T04:38:39.009 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2024-08-31T04:38:39.009 INFO:teuthology.orchestra.run.smithi050.stdout: "ceph_event_retention_days": { 2024-08-31T04:38:39.009 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "ceph_event_retention_days", 2024-08-31T04:38:39.009 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-08-31T04:38:39.009 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:39.009 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:39.009 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "7", 2024-08-31T04:38:39.009 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:39.009 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:39.009 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:39.010 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Days to hold ceph event information within local cache", 2024-08-31T04:38:39.010 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:39.010 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:39.010 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:39.010 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:39.010 INFO:teuthology.orchestra.run.smithi050.stdout: "config_check_secs": { 2024-08-31T04:38:39.010 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "config_check_secs", 2024-08-31T04:38:39.010 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-08-31T04:38:39.010 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:39.010 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:39.010 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "10", 2024-08-31T04:38:39.010 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "10", 2024-08-31T04:38:39.010 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:39.010 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:39.010 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-08-31T04:38:39.011 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:39.011 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:39.011 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:39.011 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:39.011 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2024-08-31T04:38:39.011 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2024-08-31T04:38:39.011 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:39.011 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:39.011 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:39.011 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-08-31T04:38:39.011 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:39.011 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:39.011 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-08-31T04:38:39.012 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-08-31T04:38:39.012 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-08-31T04:38:39.012 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-08-31T04:38:39.012 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-08-31T04:38:39.012 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-08-31T04:38:39.012 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-08-31T04:38:39.012 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-08-31T04:38:39.012 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:39.012 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:39.012 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:39.012 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:39.012 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:39.012 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2024-08-31T04:38:39.013 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2024-08-31T04:38:39.013 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:39.013 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:39.013 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:39.013 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-08-31T04:38:39.013 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:39.013 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:39.013 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:39.013 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:39.013 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:39.013 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:39.013 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:39.013 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:39.013 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2024-08-31T04:38:39.014 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2024-08-31T04:38:39.014 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:39.014 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:39.014 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:39.014 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2024-08-31T04:38:39.014 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:39.014 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:39.014 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-08-31T04:38:39.014 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-08-31T04:38:39.014 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-08-31T04:38:39.014 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-08-31T04:38:39.014 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-08-31T04:38:39.014 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-08-31T04:38:39.014 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-08-31T04:38:39.015 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-08-31T04:38:39.015 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:39.015 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:39.015 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:39.015 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:39.015 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:39.015 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2024-08-31T04:38:39.015 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2024-08-31T04:38:39.015 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:39.015 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:39.015 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:39.015 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-08-31T04:38:39.015 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:39.015 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:39.015 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:39.016 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:39.016 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:39.016 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:39.016 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:39.016 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:39.016 INFO:teuthology.orchestra.run.smithi050.stdout: "sqlite3_killpoint": { 2024-08-31T04:38:39.016 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "sqlite3_killpoint", 2024-08-31T04:38:39.016 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-08-31T04:38:39.016 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "dev", 2024-08-31T04:38:39.016 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:39.016 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "0", 2024-08-31T04:38:39.016 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:39.017 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:39.017 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:39.017 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:39.017 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:39.017 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:39.017 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:39.017 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T04:38:39.017 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T04:38:39.017 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:39.017 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-08-31T04:38:39.017 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "localpool", 2024-08-31T04:38:39.017 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2024-08-31T04:38:39.017 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2024-08-31T04:38:39.018 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2024-08-31T04:38:39.018 INFO:teuthology.orchestra.run.smithi050.stdout: "failure_domain": { 2024-08-31T04:38:39.018 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "failure_domain", 2024-08-31T04:38:39.018 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:39.018 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:39.018 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:39.018 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "host", 2024-08-31T04:38:39.018 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:39.018 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:39.018 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:39.018 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "failure domain for any created local pool", 2024-08-31T04:38:39.018 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-08-31T04:38:39.018 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:39.018 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:39.019 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:39.019 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2024-08-31T04:38:39.019 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2024-08-31T04:38:39.019 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:39.019 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:39.019 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:39.019 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-08-31T04:38:39.019 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:39.019 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:39.019 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-08-31T04:38:39.019 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-08-31T04:38:39.019 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-08-31T04:38:39.019 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-08-31T04:38:39.019 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-08-31T04:38:39.019 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-08-31T04:38:39.020 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-08-31T04:38:39.020 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-08-31T04:38:39.020 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:39.020 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:39.020 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:39.020 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:39.020 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:39.020 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2024-08-31T04:38:39.020 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2024-08-31T04:38:39.020 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:39.020 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:39.020 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:39.020 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-08-31T04:38:39.021 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:39.021 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:39.021 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:39.021 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:39.021 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:39.021 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:39.021 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:39.021 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:39.021 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2024-08-31T04:38:39.021 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2024-08-31T04:38:39.021 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:39.021 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:39.021 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:39.021 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2024-08-31T04:38:39.021 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:39.022 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:39.022 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-08-31T04:38:39.022 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-08-31T04:38:39.022 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-08-31T04:38:39.022 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-08-31T04:38:39.022 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-08-31T04:38:39.022 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-08-31T04:38:39.022 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-08-31T04:38:39.022 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-08-31T04:38:39.022 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:39.022 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:39.022 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:39.022 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:39.023 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:39.023 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2024-08-31T04:38:39.023 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2024-08-31T04:38:39.023 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:39.023 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:39.023 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:39.023 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-08-31T04:38:39.023 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:39.023 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:39.023 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:39.023 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:39.023 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:39.023 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:39.023 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:39.023 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:39.024 INFO:teuthology.orchestra.run.smithi050.stdout: "min_size": { 2024-08-31T04:38:39.024 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "min_size", 2024-08-31T04:38:39.024 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-08-31T04:38:39.024 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:39.024 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:39.024 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-08-31T04:38:39.024 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:39.024 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:39.024 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:39.024 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "default min_size for any created local pool", 2024-08-31T04:38:39.024 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-08-31T04:38:39.024 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:39.024 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:39.024 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:39.025 INFO:teuthology.orchestra.run.smithi050.stdout: "num_rep": { 2024-08-31T04:38:39.025 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "num_rep", 2024-08-31T04:38:39.025 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-08-31T04:38:39.025 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:39.025 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:39.025 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "3", 2024-08-31T04:38:39.025 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:39.025 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:39.025 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:39.025 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "default replica count for any created local pool", 2024-08-31T04:38:39.025 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:39.025 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:39.025 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:39.025 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:39.025 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num": { 2024-08-31T04:38:39.026 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "pg_num", 2024-08-31T04:38:39.026 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-08-31T04:38:39.026 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:39.026 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:39.026 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "128", 2024-08-31T04:38:39.026 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:39.026 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:39.026 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:39.026 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "default pg_num for any created local pool", 2024-08-31T04:38:39.026 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:39.026 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:39.026 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:39.026 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:39.027 INFO:teuthology.orchestra.run.smithi050.stdout: "prefix": { 2024-08-31T04:38:39.027 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "prefix", 2024-08-31T04:38:39.027 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:39.027 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:39.027 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:39.027 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-08-31T04:38:39.027 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:39.027 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:39.027 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:39.027 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "name prefix for any created local pool", 2024-08-31T04:38:39.027 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:39.027 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:39.027 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:39.027 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:39.028 INFO:teuthology.orchestra.run.smithi050.stdout: "sqlite3_killpoint": { 2024-08-31T04:38:39.028 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "sqlite3_killpoint", 2024-08-31T04:38:39.028 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-08-31T04:38:39.028 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "dev", 2024-08-31T04:38:39.028 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:39.028 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "0", 2024-08-31T04:38:39.028 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:39.028 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:39.028 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:39.028 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:39.028 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:39.028 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:39.028 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:39.028 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:39.029 INFO:teuthology.orchestra.run.smithi050.stdout: "subtree": { 2024-08-31T04:38:39.029 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "subtree", 2024-08-31T04:38:39.029 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:39.029 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:39.029 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:39.029 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "rack", 2024-08-31T04:38:39.029 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:39.029 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:39.029 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:39.029 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "CRUSH level for which to create a local pool", 2024-08-31T04:38:39.029 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-08-31T04:38:39.029 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:39.030 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:39.030 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T04:38:39.030 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T04:38:39.030 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:39.030 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-08-31T04:38:39.030 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "mds_autoscaler", 2024-08-31T04:38:39.030 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2024-08-31T04:38:39.030 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2024-08-31T04:38:39.030 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2024-08-31T04:38:39.030 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2024-08-31T04:38:39.030 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2024-08-31T04:38:39.030 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:39.030 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:39.030 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:39.031 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-08-31T04:38:39.031 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:39.031 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:39.031 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-08-31T04:38:39.031 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-08-31T04:38:39.031 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-08-31T04:38:39.031 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-08-31T04:38:39.031 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-08-31T04:38:39.031 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-08-31T04:38:39.031 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-08-31T04:38:39.031 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-08-31T04:38:39.031 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:39.031 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:39.031 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:39.031 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:39.032 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:39.032 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2024-08-31T04:38:39.032 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2024-08-31T04:38:39.032 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:39.032 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:39.032 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:39.032 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-08-31T04:38:39.032 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:39.032 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:39.032 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:39.032 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:39.032 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:39.032 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:39.032 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:39.032 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:39.033 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2024-08-31T04:38:39.033 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2024-08-31T04:38:39.033 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:39.033 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:39.033 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:39.033 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2024-08-31T04:38:39.033 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:39.033 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:39.033 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-08-31T04:38:39.033 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-08-31T04:38:39.033 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-08-31T04:38:39.033 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-08-31T04:38:39.033 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-08-31T04:38:39.033 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-08-31T04:38:39.034 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-08-31T04:38:39.034 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-08-31T04:38:39.034 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:39.034 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:39.034 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:39.034 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:39.034 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:39.034 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2024-08-31T04:38:39.034 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2024-08-31T04:38:39.034 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:39.034 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:39.034 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:39.034 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-08-31T04:38:39.034 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:39.034 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:39.034 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:39.035 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:39.035 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:39.035 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:39.035 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:39.035 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:39.035 INFO:teuthology.orchestra.run.smithi050.stdout: "sqlite3_killpoint": { 2024-08-31T04:38:39.035 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "sqlite3_killpoint", 2024-08-31T04:38:39.035 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-08-31T04:38:39.035 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "dev", 2024-08-31T04:38:39.035 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:39.035 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "0", 2024-08-31T04:38:39.035 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:39.035 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:39.035 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:39.035 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:39.035 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:39.036 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:39.036 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:39.036 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T04:38:39.036 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T04:38:39.036 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:39.036 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-08-31T04:38:39.036 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "mirroring", 2024-08-31T04:38:39.036 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2024-08-31T04:38:39.036 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2024-08-31T04:38:39.036 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2024-08-31T04:38:39.036 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2024-08-31T04:38:39.036 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2024-08-31T04:38:39.036 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:39.036 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:39.036 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:39.037 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-08-31T04:38:39.037 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:39.037 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:39.037 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-08-31T04:38:39.037 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-08-31T04:38:39.037 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-08-31T04:38:39.037 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-08-31T04:38:39.037 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-08-31T04:38:39.037 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-08-31T04:38:39.037 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-08-31T04:38:39.037 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-08-31T04:38:39.037 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:39.037 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:39.037 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:39.037 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:39.038 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:39.038 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2024-08-31T04:38:39.038 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2024-08-31T04:38:39.038 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:39.038 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:39.038 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:39.038 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-08-31T04:38:39.038 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:39.038 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:39.038 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:39.038 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:39.038 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:39.038 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:39.038 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:39.038 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:39.039 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2024-08-31T04:38:39.039 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2024-08-31T04:38:39.039 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:39.039 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:39.039 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:39.039 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2024-08-31T04:38:39.039 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:39.039 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:39.039 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-08-31T04:38:39.039 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-08-31T04:38:39.039 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-08-31T04:38:39.039 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-08-31T04:38:39.039 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-08-31T04:38:39.039 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-08-31T04:38:39.039 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-08-31T04:38:39.039 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-08-31T04:38:39.040 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:39.040 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:39.040 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:39.040 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:39.040 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:39.040 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2024-08-31T04:38:39.040 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2024-08-31T04:38:39.040 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:39.040 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:39.040 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:39.040 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-08-31T04:38:39.040 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:39.040 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:39.040 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:39.041 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:39.041 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:39.041 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:39.041 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:39.041 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:39.041 INFO:teuthology.orchestra.run.smithi050.stdout: "sqlite3_killpoint": { 2024-08-31T04:38:39.041 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "sqlite3_killpoint", 2024-08-31T04:38:39.041 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-08-31T04:38:39.041 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "dev", 2024-08-31T04:38:39.041 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:39.041 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "0", 2024-08-31T04:38:39.041 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:39.041 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:39.041 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:39.042 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:39.042 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:39.042 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:39.042 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:39.042 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T04:38:39.042 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T04:38:39.042 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:39.042 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-08-31T04:38:39.042 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "nfs", 2024-08-31T04:38:39.042 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2024-08-31T04:38:39.042 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2024-08-31T04:38:39.042 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2024-08-31T04:38:39.043 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2024-08-31T04:38:39.043 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2024-08-31T04:38:39.043 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:39.043 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:39.043 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:39.043 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-08-31T04:38:39.043 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:39.043 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:39.043 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-08-31T04:38:39.043 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-08-31T04:38:39.043 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-08-31T04:38:39.043 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-08-31T04:38:39.043 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-08-31T04:38:39.043 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-08-31T04:38:39.043 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-08-31T04:38:39.044 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-08-31T04:38:39.044 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:39.044 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:39.044 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:39.044 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:39.044 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:39.044 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2024-08-31T04:38:39.044 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2024-08-31T04:38:39.044 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:39.044 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:39.044 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:39.044 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-08-31T04:38:39.044 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:39.044 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:39.045 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:39.045 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:39.045 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:39.045 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:39.045 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:39.045 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:39.045 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2024-08-31T04:38:39.045 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2024-08-31T04:38:39.045 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:39.045 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:39.045 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:39.045 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2024-08-31T04:38:39.045 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:39.046 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:39.046 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-08-31T04:38:39.046 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-08-31T04:38:39.046 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-08-31T04:38:39.046 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-08-31T04:38:39.046 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-08-31T04:38:39.046 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-08-31T04:38:39.046 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-08-31T04:38:39.046 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-08-31T04:38:39.046 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:39.046 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:39.046 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:39.046 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:39.046 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:39.047 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2024-08-31T04:38:39.047 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2024-08-31T04:38:39.047 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:39.047 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:39.047 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:39.047 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-08-31T04:38:39.047 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:39.047 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:39.047 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:39.047 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:39.047 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:39.047 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:39.047 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:39.047 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:39.048 INFO:teuthology.orchestra.run.smithi050.stdout: "sqlite3_killpoint": { 2024-08-31T04:38:39.048 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "sqlite3_killpoint", 2024-08-31T04:38:39.048 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-08-31T04:38:39.048 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "dev", 2024-08-31T04:38:39.048 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:39.048 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "0", 2024-08-31T04:38:39.048 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:39.048 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:39.048 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:39.048 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:39.048 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:39.048 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:39.048 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:39.048 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T04:38:39.048 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T04:38:39.049 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:39.049 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-08-31T04:38:39.049 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "orchestrator", 2024-08-31T04:38:39.049 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2024-08-31T04:38:39.049 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2024-08-31T04:38:39.049 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2024-08-31T04:38:39.049 INFO:teuthology.orchestra.run.smithi050.stdout: "fail_fs": { 2024-08-31T04:38:39.049 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "fail_fs", 2024-08-31T04:38:39.049 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:39.049 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:39.049 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:39.049 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-08-31T04:38:39.049 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:39.049 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:39.049 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:39.050 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-08-31T04:38:39.050 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:39.050 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:39.050 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:39.050 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:39.050 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2024-08-31T04:38:39.050 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2024-08-31T04:38:39.050 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:39.050 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:39.050 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:39.050 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-08-31T04:38:39.050 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:39.050 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:39.050 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-08-31T04:38:39.051 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-08-31T04:38:39.051 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-08-31T04:38:39.051 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-08-31T04:38:39.051 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-08-31T04:38:39.051 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-08-31T04:38:39.051 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-08-31T04:38:39.051 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-08-31T04:38:39.051 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:39.051 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:39.051 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:39.051 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:39.051 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:39.051 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2024-08-31T04:38:39.051 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2024-08-31T04:38:39.051 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:39.051 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:39.052 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:39.052 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-08-31T04:38:39.052 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:39.052 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:39.052 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:39.052 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:39.052 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:39.052 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:39.052 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:39.052 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:39.052 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2024-08-31T04:38:39.052 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2024-08-31T04:38:39.052 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:39.052 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:39.052 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:39.053 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2024-08-31T04:38:39.053 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:39.053 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:39.053 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-08-31T04:38:39.053 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-08-31T04:38:39.053 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-08-31T04:38:39.053 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-08-31T04:38:39.053 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-08-31T04:38:39.053 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-08-31T04:38:39.053 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-08-31T04:38:39.053 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-08-31T04:38:39.053 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:39.053 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:39.053 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:39.053 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:39.054 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:39.054 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2024-08-31T04:38:39.054 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2024-08-31T04:38:39.054 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:39.054 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:39.054 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:39.054 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-08-31T04:38:39.054 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:39.054 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:39.054 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:39.054 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:39.054 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:39.054 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:39.054 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:39.054 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:39.055 INFO:teuthology.orchestra.run.smithi050.stdout: "orchestrator": { 2024-08-31T04:38:39.055 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "orchestrator", 2024-08-31T04:38:39.055 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:39.055 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:39.055 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:39.055 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-08-31T04:38:39.055 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:39.055 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:39.055 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-08-31T04:38:39.055 INFO:teuthology.orchestra.run.smithi050.stdout: "cephadm", 2024-08-31T04:38:39.055 INFO:teuthology.orchestra.run.smithi050.stdout: "rook", 2024-08-31T04:38:39.055 INFO:teuthology.orchestra.run.smithi050.stdout: "test_orchestrator" 2024-08-31T04:38:39.055 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-08-31T04:38:39.055 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Orchestrator backend", 2024-08-31T04:38:39.055 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:39.056 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:39.056 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:39.056 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:39.056 INFO:teuthology.orchestra.run.smithi050.stdout: "sqlite3_killpoint": { 2024-08-31T04:38:39.056 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "sqlite3_killpoint", 2024-08-31T04:38:39.056 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-08-31T04:38:39.056 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "dev", 2024-08-31T04:38:39.056 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:39.056 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "0", 2024-08-31T04:38:39.056 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:39.056 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:39.056 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:39.056 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:39.056 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:39.056 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:39.057 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:39.057 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T04:38:39.057 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T04:38:39.057 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:39.057 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-08-31T04:38:39.057 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "osd_perf_query", 2024-08-31T04:38:39.057 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2024-08-31T04:38:39.057 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2024-08-31T04:38:39.057 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2024-08-31T04:38:39.057 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2024-08-31T04:38:39.057 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2024-08-31T04:38:39.057 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:39.057 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:39.057 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:39.058 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-08-31T04:38:39.058 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:39.058 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:39.058 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-08-31T04:38:39.058 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-08-31T04:38:39.058 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-08-31T04:38:39.058 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-08-31T04:38:39.058 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-08-31T04:38:39.058 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-08-31T04:38:39.058 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-08-31T04:38:39.058 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-08-31T04:38:39.058 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:39.058 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:39.058 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:39.059 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:39.059 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:39.059 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2024-08-31T04:38:39.059 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2024-08-31T04:38:39.059 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:39.059 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:39.059 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:39.059 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-08-31T04:38:39.059 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:39.059 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:39.059 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:39.059 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:39.059 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:39.059 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:39.059 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:39.060 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:39.060 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2024-08-31T04:38:39.060 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2024-08-31T04:38:39.060 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:39.060 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:39.060 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:39.060 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2024-08-31T04:38:39.060 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:39.060 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:39.060 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-08-31T04:38:39.060 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-08-31T04:38:39.060 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-08-31T04:38:39.060 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-08-31T04:38:39.060 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-08-31T04:38:39.060 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-08-31T04:38:39.061 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-08-31T04:38:39.061 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-08-31T04:38:39.061 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:39.061 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:39.061 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:39.061 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:39.061 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:39.061 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2024-08-31T04:38:39.061 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2024-08-31T04:38:39.061 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:39.061 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:39.061 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:39.061 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-08-31T04:38:39.061 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:39.061 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:39.062 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:39.062 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:39.062 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:39.062 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:39.062 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:39.062 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:39.062 INFO:teuthology.orchestra.run.smithi050.stdout: "sqlite3_killpoint": { 2024-08-31T04:38:39.062 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "sqlite3_killpoint", 2024-08-31T04:38:39.062 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-08-31T04:38:39.062 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "dev", 2024-08-31T04:38:39.062 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:39.062 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "0", 2024-08-31T04:38:39.062 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:39.062 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:39.063 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:39.063 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:39.063 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:39.063 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:39.063 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:39.063 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T04:38:39.063 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T04:38:39.063 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:39.063 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-08-31T04:38:39.063 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "osd_support", 2024-08-31T04:38:39.063 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2024-08-31T04:38:39.063 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2024-08-31T04:38:39.063 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2024-08-31T04:38:39.063 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2024-08-31T04:38:39.063 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2024-08-31T04:38:39.064 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:39.064 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:39.064 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:39.064 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-08-31T04:38:39.064 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:39.064 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:39.064 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-08-31T04:38:39.064 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-08-31T04:38:39.064 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-08-31T04:38:39.064 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-08-31T04:38:39.064 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-08-31T04:38:39.064 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-08-31T04:38:39.064 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-08-31T04:38:39.064 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-08-31T04:38:39.064 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:39.065 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:39.065 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:39.065 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:39.065 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:39.065 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2024-08-31T04:38:39.065 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2024-08-31T04:38:39.065 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:39.065 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:39.065 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:39.065 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-08-31T04:38:39.065 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:39.065 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:39.065 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:39.065 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:39.066 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:39.066 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:39.066 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:39.066 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:39.066 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2024-08-31T04:38:39.066 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2024-08-31T04:38:39.066 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:39.066 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:39.066 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:39.066 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2024-08-31T04:38:39.066 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:39.066 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:39.066 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-08-31T04:38:39.066 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-08-31T04:38:39.066 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-08-31T04:38:39.066 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-08-31T04:38:39.067 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-08-31T04:38:39.067 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-08-31T04:38:39.067 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-08-31T04:38:39.067 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-08-31T04:38:39.067 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:39.067 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:39.067 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:39.067 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:39.067 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:39.067 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2024-08-31T04:38:39.067 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2024-08-31T04:38:39.067 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:39.067 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:39.067 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:39.068 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-08-31T04:38:39.068 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:39.068 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:39.068 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:39.068 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:39.068 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:39.068 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:39.068 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:39.068 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:39.068 INFO:teuthology.orchestra.run.smithi050.stdout: "sqlite3_killpoint": { 2024-08-31T04:38:39.068 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "sqlite3_killpoint", 2024-08-31T04:38:39.068 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-08-31T04:38:39.068 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "dev", 2024-08-31T04:38:39.068 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:39.068 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "0", 2024-08-31T04:38:39.069 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:39.069 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:39.069 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:39.069 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:39.069 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:39.069 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:39.069 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:39.069 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T04:38:39.069 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T04:38:39.069 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:39.069 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-08-31T04:38:39.069 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "pg_autoscaler", 2024-08-31T04:38:39.069 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2024-08-31T04:38:39.070 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2024-08-31T04:38:39.070 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2024-08-31T04:38:39.070 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2024-08-31T04:38:39.070 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2024-08-31T04:38:39.070 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:39.070 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:39.070 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:39.070 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-08-31T04:38:39.070 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:39.070 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:39.070 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-08-31T04:38:39.070 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-08-31T04:38:39.070 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-08-31T04:38:39.070 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-08-31T04:38:39.071 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-08-31T04:38:39.071 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-08-31T04:38:39.071 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-08-31T04:38:39.071 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-08-31T04:38:39.071 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:39.071 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:39.071 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:39.071 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:39.071 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:39.071 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2024-08-31T04:38:39.071 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2024-08-31T04:38:39.071 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:39.071 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:39.072 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:39.072 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-08-31T04:38:39.072 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:39.072 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:39.072 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:39.072 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:39.072 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:39.072 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:39.072 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:39.072 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:39.072 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2024-08-31T04:38:39.072 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2024-08-31T04:38:39.072 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:39.072 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:39.073 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:39.073 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2024-08-31T04:38:39.073 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:39.073 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:39.073 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-08-31T04:38:39.073 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-08-31T04:38:39.073 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-08-31T04:38:39.073 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-08-31T04:38:39.073 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-08-31T04:38:39.073 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-08-31T04:38:39.073 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-08-31T04:38:39.073 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-08-31T04:38:39.073 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:39.073 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:39.074 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:39.074 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:39.074 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:39.074 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2024-08-31T04:38:39.074 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2024-08-31T04:38:39.074 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:39.074 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:39.074 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:39.074 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-08-31T04:38:39.074 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:39.074 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:39.074 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:39.074 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:39.074 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:39.075 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:39.075 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:39.075 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:39.075 INFO:teuthology.orchestra.run.smithi050.stdout: "sleep_interval": { 2024-08-31T04:38:39.075 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "sleep_interval", 2024-08-31T04:38:39.075 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "secs", 2024-08-31T04:38:39.075 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:39.075 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:39.075 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "60", 2024-08-31T04:38:39.075 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:39.075 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:39.075 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:39.075 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:39.075 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:39.075 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:39.076 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:39.076 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:39.076 INFO:teuthology.orchestra.run.smithi050.stdout: "sqlite3_killpoint": { 2024-08-31T04:38:39.076 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "sqlite3_killpoint", 2024-08-31T04:38:39.076 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-08-31T04:38:39.076 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "dev", 2024-08-31T04:38:39.076 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:39.076 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "0", 2024-08-31T04:38:39.076 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:39.076 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:39.076 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:39.076 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:39.076 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:39.076 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:39.076 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:39.077 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:39.077 INFO:teuthology.orchestra.run.smithi050.stdout: "threshold": { 2024-08-31T04:38:39.077 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "threshold", 2024-08-31T04:38:39.077 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "float", 2024-08-31T04:38:39.077 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:39.077 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:39.077 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "3.0", 2024-08-31T04:38:39.077 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "1.0", 2024-08-31T04:38:39.077 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:39.077 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:39.077 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "scaling threshold", 2024-08-31T04:38:39.077 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-08-31T04:38:39.077 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:39.077 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:39.078 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T04:38:39.078 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T04:38:39.078 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:39.078 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-08-31T04:38:39.078 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "progress", 2024-08-31T04:38:39.078 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2024-08-31T04:38:39.078 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2024-08-31T04:38:39.078 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2024-08-31T04:38:39.078 INFO:teuthology.orchestra.run.smithi050.stdout: "allow_pg_recovery_event": { 2024-08-31T04:38:39.078 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "allow_pg_recovery_event", 2024-08-31T04:38:39.078 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:39.078 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:39.078 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:39.078 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-08-31T04:38:39.079 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:39.079 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:39.079 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:39.079 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "allow the module to show pg recovery progress", 2024-08-31T04:38:39.079 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:39.079 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:39.079 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:39.079 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:39.079 INFO:teuthology.orchestra.run.smithi050.stdout: "enabled": { 2024-08-31T04:38:39.079 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "enabled", 2024-08-31T04:38:39.079 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:39.079 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:39.079 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:39.079 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2024-08-31T04:38:39.080 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:39.080 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:39.080 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:39.080 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:39.080 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:39.080 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:39.080 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:39.080 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:39.080 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2024-08-31T04:38:39.080 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2024-08-31T04:38:39.080 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:39.080 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:39.080 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:39.080 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-08-31T04:38:39.081 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:39.081 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:39.081 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-08-31T04:38:39.081 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-08-31T04:38:39.081 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-08-31T04:38:39.081 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-08-31T04:38:39.081 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-08-31T04:38:39.081 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-08-31T04:38:39.081 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-08-31T04:38:39.081 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-08-31T04:38:39.081 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:39.081 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:39.081 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:39.081 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:39.081 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:39.082 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2024-08-31T04:38:39.082 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2024-08-31T04:38:39.082 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:39.082 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:39.082 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:39.082 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-08-31T04:38:39.082 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:39.082 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:39.082 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:39.082 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:39.082 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:39.082 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:39.082 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:39.082 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:39.083 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2024-08-31T04:38:39.083 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2024-08-31T04:38:39.083 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:39.083 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:39.083 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:39.083 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2024-08-31T04:38:39.083 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:39.083 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:39.083 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-08-31T04:38:39.083 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-08-31T04:38:39.083 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-08-31T04:38:39.083 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-08-31T04:38:39.083 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-08-31T04:38:39.083 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-08-31T04:38:39.083 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-08-31T04:38:39.084 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-08-31T04:38:39.084 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:39.084 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:39.084 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:39.084 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:39.084 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:39.084 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2024-08-31T04:38:39.084 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2024-08-31T04:38:39.084 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:39.084 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:39.084 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:39.084 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-08-31T04:38:39.084 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:39.084 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:39.085 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:39.085 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:39.085 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:39.085 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:39.085 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:39.085 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:39.085 INFO:teuthology.orchestra.run.smithi050.stdout: "max_completed_events": { 2024-08-31T04:38:39.085 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "max_completed_events", 2024-08-31T04:38:39.085 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-08-31T04:38:39.085 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:39.085 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:39.085 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "50", 2024-08-31T04:38:39.085 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:39.085 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:39.086 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:39.086 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "number of past completed events to remember", 2024-08-31T04:38:39.086 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:39.086 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:39.086 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:39.086 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:39.086 INFO:teuthology.orchestra.run.smithi050.stdout: "sleep_interval": { 2024-08-31T04:38:39.086 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "sleep_interval", 2024-08-31T04:38:39.086 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "secs", 2024-08-31T04:38:39.086 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:39.086 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:39.086 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "5", 2024-08-31T04:38:39.086 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:39.086 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:39.086 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:39.087 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "how long the module is going to sleep", 2024-08-31T04:38:39.087 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:39.087 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:39.087 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:39.087 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:39.087 INFO:teuthology.orchestra.run.smithi050.stdout: "sqlite3_killpoint": { 2024-08-31T04:38:39.087 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "sqlite3_killpoint", 2024-08-31T04:38:39.087 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-08-31T04:38:39.087 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "dev", 2024-08-31T04:38:39.087 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:39.087 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "0", 2024-08-31T04:38:39.087 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:39.087 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:39.088 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:39.088 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:39.088 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:39.088 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:39.088 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:39.088 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T04:38:39.088 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T04:38:39.088 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:39.088 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-08-31T04:38:39.088 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "prometheus", 2024-08-31T04:38:39.088 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2024-08-31T04:38:39.088 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2024-08-31T04:38:39.088 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2024-08-31T04:38:39.088 INFO:teuthology.orchestra.run.smithi050.stdout: "cache": { 2024-08-31T04:38:39.089 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "cache", 2024-08-31T04:38:39.089 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:39.089 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:39.089 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:39.089 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2024-08-31T04:38:39.089 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:39.089 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:39.089 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:39.089 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:39.089 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:39.089 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:39.089 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:39.089 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:39.090 INFO:teuthology.orchestra.run.smithi050.stdout: "exclude_perf_counters": { 2024-08-31T04:38:39.090 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "exclude_perf_counters", 2024-08-31T04:38:39.090 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:39.090 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:39.090 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:39.090 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2024-08-31T04:38:39.090 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:39.090 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:39.090 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:39.090 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-08-31T04:38:39.090 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-08-31T04:38:39.090 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:39.090 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:39.091 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:39.091 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2024-08-31T04:38:39.091 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2024-08-31T04:38:39.091 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:39.091 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:39.091 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:39.091 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-08-31T04:38:39.091 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:39.091 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:39.091 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-08-31T04:38:39.091 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-08-31T04:38:39.091 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-08-31T04:38:39.091 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-08-31T04:38:39.092 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-08-31T04:38:39.092 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-08-31T04:38:39.092 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-08-31T04:38:39.092 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-08-31T04:38:39.092 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:39.092 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:39.092 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:39.092 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:39.092 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:39.092 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2024-08-31T04:38:39.092 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2024-08-31T04:38:39.092 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:39.092 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:39.092 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:39.093 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-08-31T04:38:39.093 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:39.093 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:39.093 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:39.093 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:39.093 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:39.093 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:39.093 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:39.093 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:39.093 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2024-08-31T04:38:39.093 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2024-08-31T04:38:39.093 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:39.093 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:39.094 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:39.094 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2024-08-31T04:38:39.094 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:39.094 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:39.094 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-08-31T04:38:39.094 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-08-31T04:38:39.094 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-08-31T04:38:39.094 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-08-31T04:38:39.094 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-08-31T04:38:39.094 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-08-31T04:38:39.094 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-08-31T04:38:39.094 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-08-31T04:38:39.094 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:39.095 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:39.095 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:39.095 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:39.095 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:39.095 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2024-08-31T04:38:39.095 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2024-08-31T04:38:39.095 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:39.095 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:39.095 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:39.095 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-08-31T04:38:39.095 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:39.095 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:39.095 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:39.096 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:39.096 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:39.096 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:39.096 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:39.096 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:39.096 INFO:teuthology.orchestra.run.smithi050.stdout: "rbd_stats_pools": { 2024-08-31T04:38:39.096 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "rbd_stats_pools", 2024-08-31T04:38:39.096 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:39.096 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:39.096 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:39.096 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-08-31T04:38:39.096 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:39.096 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:39.097 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:39.097 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:39.097 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:39.097 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:39.097 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:39.097 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:39.097 INFO:teuthology.orchestra.run.smithi050.stdout: "rbd_stats_pools_refresh_interval": { 2024-08-31T04:38:39.097 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-08-31T04:38:39.097 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-08-31T04:38:39.097 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:39.097 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:39.097 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "300", 2024-08-31T04:38:39.097 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:39.098 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:39.098 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:39.098 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:39.098 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:39.098 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:39.098 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:39.098 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:39.098 INFO:teuthology.orchestra.run.smithi050.stdout: "scrape_interval": { 2024-08-31T04:38:39.098 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "scrape_interval", 2024-08-31T04:38:39.098 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "float", 2024-08-31T04:38:39.098 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:39.098 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:39.098 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "15.0", 2024-08-31T04:38:39.098 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:39.099 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:39.099 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:39.099 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:39.099 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:39.099 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:39.099 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:39.099 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:39.099 INFO:teuthology.orchestra.run.smithi050.stdout: "server_addr": { 2024-08-31T04:38:39.099 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "server_addr", 2024-08-31T04:38:39.099 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:39.099 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:39.099 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:39.100 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "::", 2024-08-31T04:38:39.100 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:39.100 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:39.100 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:39.100 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-08-31T04:38:39.100 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:39.100 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:39.100 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:39.100 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:39.100 INFO:teuthology.orchestra.run.smithi050.stdout: "server_port": { 2024-08-31T04:38:39.100 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "server_port", 2024-08-31T04:38:39.100 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-08-31T04:38:39.100 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:39.101 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:39.101 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "9283", 2024-08-31T04:38:39.101 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:39.101 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:39.101 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:39.101 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-08-31T04:38:39.101 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:39.101 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:39.101 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:39.101 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:39.101 INFO:teuthology.orchestra.run.smithi050.stdout: "sqlite3_killpoint": { 2024-08-31T04:38:39.101 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "sqlite3_killpoint", 2024-08-31T04:38:39.101 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-08-31T04:38:39.101 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "dev", 2024-08-31T04:38:39.101 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:39.102 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "0", 2024-08-31T04:38:39.102 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:39.102 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:39.102 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:39.102 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:39.102 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:39.102 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:39.102 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:39.102 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:39.102 INFO:teuthology.orchestra.run.smithi050.stdout: "stale_cache_strategy": { 2024-08-31T04:38:39.102 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "stale_cache_strategy", 2024-08-31T04:38:39.102 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:39.102 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:39.102 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:39.103 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "log", 2024-08-31T04:38:39.103 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:39.103 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:39.103 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:39.103 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:39.103 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:39.103 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:39.103 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:39.103 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:39.103 INFO:teuthology.orchestra.run.smithi050.stdout: "standby_behaviour": { 2024-08-31T04:38:39.103 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "standby_behaviour", 2024-08-31T04:38:39.103 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:39.103 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:39.103 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:39.104 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "default", 2024-08-31T04:38:39.104 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:39.104 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:39.104 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-08-31T04:38:39.104 INFO:teuthology.orchestra.run.smithi050.stdout: "default", 2024-08-31T04:38:39.104 INFO:teuthology.orchestra.run.smithi050.stdout: "error" 2024-08-31T04:38:39.104 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-08-31T04:38:39.104 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:39.104 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:39.104 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:39.104 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:39.104 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:39.104 INFO:teuthology.orchestra.run.smithi050.stdout: "standby_error_status_code": { 2024-08-31T04:38:39.104 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "standby_error_status_code", 2024-08-31T04:38:39.104 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-08-31T04:38:39.105 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:39.105 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:39.105 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "500", 2024-08-31T04:38:39.105 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "400", 2024-08-31T04:38:39.105 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "599", 2024-08-31T04:38:39.105 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:39.105 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:39.105 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:39.105 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:39.105 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:39.105 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T04:38:39.105 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T04:38:39.105 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:39.105 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-08-31T04:38:39.106 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "rbd_support", 2024-08-31T04:38:39.106 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2024-08-31T04:38:39.106 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2024-08-31T04:38:39.106 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2024-08-31T04:38:39.106 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2024-08-31T04:38:39.106 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2024-08-31T04:38:39.106 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:39.106 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:39.106 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:39.106 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-08-31T04:38:39.106 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:39.106 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:39.106 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-08-31T04:38:39.106 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-08-31T04:38:39.107 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-08-31T04:38:39.107 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-08-31T04:38:39.107 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-08-31T04:38:39.107 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-08-31T04:38:39.107 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-08-31T04:38:39.107 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-08-31T04:38:39.107 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:39.107 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:39.107 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:39.107 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:39.107 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:39.107 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2024-08-31T04:38:39.107 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2024-08-31T04:38:39.108 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:39.108 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:39.108 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:39.108 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-08-31T04:38:39.108 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:39.108 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:39.108 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:39.108 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:39.108 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:39.108 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:39.108 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:39.108 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:39.108 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2024-08-31T04:38:39.108 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2024-08-31T04:38:39.109 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:39.109 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:39.109 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:39.109 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2024-08-31T04:38:39.109 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:39.109 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:39.109 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-08-31T04:38:39.109 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-08-31T04:38:39.109 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-08-31T04:38:39.109 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-08-31T04:38:39.109 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-08-31T04:38:39.109 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-08-31T04:38:39.109 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-08-31T04:38:39.109 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-08-31T04:38:39.110 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:39.110 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:39.110 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:39.110 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:39.110 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:39.110 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2024-08-31T04:38:39.110 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2024-08-31T04:38:39.110 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:39.110 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:39.110 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:39.110 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-08-31T04:38:39.110 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:39.110 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:39.110 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:39.110 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:39.111 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:39.111 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:39.111 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:39.111 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:39.111 INFO:teuthology.orchestra.run.smithi050.stdout: "max_concurrent_snap_create": { 2024-08-31T04:38:39.111 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "max_concurrent_snap_create", 2024-08-31T04:38:39.111 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-08-31T04:38:39.111 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:39.111 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:39.111 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "10", 2024-08-31T04:38:39.111 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:39.111 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:39.111 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:39.111 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:39.111 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:39.112 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:39.112 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:39.112 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:39.112 INFO:teuthology.orchestra.run.smithi050.stdout: "mirror_snapshot_schedule": { 2024-08-31T04:38:39.112 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "mirror_snapshot_schedule", 2024-08-31T04:38:39.112 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:39.112 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:39.112 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:39.112 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-08-31T04:38:39.112 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:39.112 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:39.112 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:39.112 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:39.112 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:39.113 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:39.113 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:39.113 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:39.113 INFO:teuthology.orchestra.run.smithi050.stdout: "sqlite3_killpoint": { 2024-08-31T04:38:39.113 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "sqlite3_killpoint", 2024-08-31T04:38:39.113 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-08-31T04:38:39.113 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "dev", 2024-08-31T04:38:39.113 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:39.113 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "0", 2024-08-31T04:38:39.113 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:39.113 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:39.113 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:39.113 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:39.113 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:39.114 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:39.114 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:39.114 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:39.114 INFO:teuthology.orchestra.run.smithi050.stdout: "trash_purge_schedule": { 2024-08-31T04:38:39.114 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "trash_purge_schedule", 2024-08-31T04:38:39.114 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:39.114 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:39.114 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:39.114 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-08-31T04:38:39.114 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:39.114 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:39.114 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:39.114 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:39.114 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:39.115 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:39.115 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:39.115 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T04:38:39.115 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T04:38:39.115 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:39.115 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-08-31T04:38:39.115 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "restful", 2024-08-31T04:38:39.115 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2024-08-31T04:38:39.115 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2024-08-31T04:38:39.115 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2024-08-31T04:38:39.115 INFO:teuthology.orchestra.run.smithi050.stdout: "enable_auth": { 2024-08-31T04:38:39.115 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "enable_auth", 2024-08-31T04:38:39.115 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:39.116 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:39.116 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:39.116 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2024-08-31T04:38:39.116 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:39.116 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:39.116 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:39.116 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:39.116 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:39.116 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:39.116 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:39.116 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:39.116 INFO:teuthology.orchestra.run.smithi050.stdout: "key_file": { 2024-08-31T04:38:39.116 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "key_file", 2024-08-31T04:38:39.116 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:39.117 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:39.117 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:39.117 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-08-31T04:38:39.117 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:39.117 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:39.117 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:39.117 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:39.117 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:39.117 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:39.117 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:39.117 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:39.117 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2024-08-31T04:38:39.117 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2024-08-31T04:38:39.118 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:39.118 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:39.118 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:39.118 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-08-31T04:38:39.118 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:39.118 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:39.118 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-08-31T04:38:39.118 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-08-31T04:38:39.118 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-08-31T04:38:39.118 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-08-31T04:38:39.118 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-08-31T04:38:39.118 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-08-31T04:38:39.118 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-08-31T04:38:39.118 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-08-31T04:38:39.118 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:39.119 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:39.119 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:39.119 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:39.119 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:39.119 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2024-08-31T04:38:39.119 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2024-08-31T04:38:39.119 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:39.119 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:39.119 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:39.119 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-08-31T04:38:39.119 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:39.119 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:39.119 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:39.119 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:39.120 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:39.120 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:39.120 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:39.120 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:39.120 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2024-08-31T04:38:39.120 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2024-08-31T04:38:39.120 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:39.120 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:39.120 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:39.120 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2024-08-31T04:38:39.120 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:39.120 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:39.121 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-08-31T04:38:39.121 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-08-31T04:38:39.121 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-08-31T04:38:39.121 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-08-31T04:38:39.121 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-08-31T04:38:39.121 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-08-31T04:38:39.121 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-08-31T04:38:39.121 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-08-31T04:38:39.121 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:39.121 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:39.121 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:39.121 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:39.121 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:39.121 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2024-08-31T04:38:39.122 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2024-08-31T04:38:39.122 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:39.122 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:39.122 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:39.122 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-08-31T04:38:39.122 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:39.122 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:39.122 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:39.122 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:39.122 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:39.122 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:39.122 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:39.122 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:39.122 INFO:teuthology.orchestra.run.smithi050.stdout: "max_requests": { 2024-08-31T04:38:39.122 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "max_requests", 2024-08-31T04:38:39.123 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-08-31T04:38:39.123 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:39.123 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:39.123 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "500", 2024-08-31T04:38:39.123 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:39.123 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:39.123 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:39.123 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.", 2024-08-31T04:38:39.123 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:39.123 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:39.123 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:39.123 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:39.123 INFO:teuthology.orchestra.run.smithi050.stdout: "server_addr": { 2024-08-31T04:38:39.124 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "server_addr", 2024-08-31T04:38:39.124 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:39.124 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:39.124 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:39.124 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-08-31T04:38:39.124 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:39.124 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:39.124 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:39.124 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:39.124 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:39.124 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:39.124 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:39.124 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:39.124 INFO:teuthology.orchestra.run.smithi050.stdout: "server_port": { 2024-08-31T04:38:39.125 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "server_port", 2024-08-31T04:38:39.125 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:39.125 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:39.125 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:39.125 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-08-31T04:38:39.125 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:39.125 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:39.125 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:39.125 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:39.125 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:39.125 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:39.125 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:39.125 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:39.125 INFO:teuthology.orchestra.run.smithi050.stdout: "sqlite3_killpoint": { 2024-08-31T04:38:39.125 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "sqlite3_killpoint", 2024-08-31T04:38:39.126 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-08-31T04:38:39.126 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "dev", 2024-08-31T04:38:39.126 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:39.126 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "0", 2024-08-31T04:38:39.126 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:39.126 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:39.126 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:39.126 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:39.126 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:39.126 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:39.126 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:39.126 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T04:38:39.126 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T04:38:39.126 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:39.126 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-08-31T04:38:39.127 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "rgw", 2024-08-31T04:38:39.127 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2024-08-31T04:38:39.127 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2024-08-31T04:38:39.127 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2024-08-31T04:38:39.127 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2024-08-31T04:38:39.127 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2024-08-31T04:38:39.127 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:39.127 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:39.127 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:39.127 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-08-31T04:38:39.127 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:39.127 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:39.127 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-08-31T04:38:39.128 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-08-31T04:38:39.128 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-08-31T04:38:39.128 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-08-31T04:38:39.128 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-08-31T04:38:39.128 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-08-31T04:38:39.128 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-08-31T04:38:39.128 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-08-31T04:38:39.128 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:39.128 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:39.128 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:39.128 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:39.128 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:39.128 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2024-08-31T04:38:39.128 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2024-08-31T04:38:39.128 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:39.129 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:39.129 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:39.129 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-08-31T04:38:39.129 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:39.129 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:39.129 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:39.129 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:39.129 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:39.129 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:39.129 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:39.129 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:39.129 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2024-08-31T04:38:39.129 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2024-08-31T04:38:39.130 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:39.130 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:39.130 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:39.130 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2024-08-31T04:38:39.130 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:39.130 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:39.130 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-08-31T04:38:39.130 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-08-31T04:38:39.130 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-08-31T04:38:39.130 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-08-31T04:38:39.130 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-08-31T04:38:39.130 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-08-31T04:38:39.130 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-08-31T04:38:39.131 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-08-31T04:38:39.131 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:39.131 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:39.131 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:39.131 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:39.131 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:39.131 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2024-08-31T04:38:39.131 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2024-08-31T04:38:39.131 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:39.131 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:39.131 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:39.131 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-08-31T04:38:39.131 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:39.131 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:39.132 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:39.132 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:39.132 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:39.132 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:39.132 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:39.132 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:39.132 INFO:teuthology.orchestra.run.smithi050.stdout: "secondary_zone_period_retry_limit": { 2024-08-31T04:38:39.132 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "secondary_zone_period_retry_limit", 2024-08-31T04:38:39.132 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-08-31T04:38:39.132 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:39.132 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:39.132 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "5", 2024-08-31T04:38:39.132 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:39.133 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:39.133 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:39.133 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "RGW module period update retry limit for secondary site", 2024-08-31T04:38:39.133 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:39.133 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:39.133 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:39.133 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:39.133 INFO:teuthology.orchestra.run.smithi050.stdout: "sqlite3_killpoint": { 2024-08-31T04:38:39.133 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "sqlite3_killpoint", 2024-08-31T04:38:39.133 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-08-31T04:38:39.133 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "dev", 2024-08-31T04:38:39.133 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:39.133 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "0", 2024-08-31T04:38:39.133 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:39.134 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:39.134 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:39.134 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:39.134 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:39.134 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:39.134 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:39.134 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T04:38:39.134 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T04:38:39.134 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:39.134 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-08-31T04:38:39.134 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "rook", 2024-08-31T04:38:39.134 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2024-08-31T04:38:39.134 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2024-08-31T04:38:39.134 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2024-08-31T04:38:39.135 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2024-08-31T04:38:39.135 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2024-08-31T04:38:39.135 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:39.135 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:39.135 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:39.135 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-08-31T04:38:39.135 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:39.135 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:39.135 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-08-31T04:38:39.135 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-08-31T04:38:39.135 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-08-31T04:38:39.135 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-08-31T04:38:39.135 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-08-31T04:38:39.135 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-08-31T04:38:39.135 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-08-31T04:38:39.136 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-08-31T04:38:39.136 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:39.136 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:39.136 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:39.136 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:39.136 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:39.136 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2024-08-31T04:38:39.136 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2024-08-31T04:38:39.136 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:39.136 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:39.136 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:39.136 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-08-31T04:38:39.136 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:39.136 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:39.137 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:39.137 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:39.137 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:39.137 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:39.137 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:39.137 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:39.137 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2024-08-31T04:38:39.137 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2024-08-31T04:38:39.137 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:39.137 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:39.137 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:39.137 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2024-08-31T04:38:39.137 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:39.137 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:39.138 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-08-31T04:38:39.138 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-08-31T04:38:39.138 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-08-31T04:38:39.138 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-08-31T04:38:39.138 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-08-31T04:38:39.138 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-08-31T04:38:39.138 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-08-31T04:38:39.138 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-08-31T04:38:39.138 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:39.138 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:39.138 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:39.138 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:39.138 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:39.138 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2024-08-31T04:38:39.139 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2024-08-31T04:38:39.139 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:39.139 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:39.139 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:39.139 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-08-31T04:38:39.139 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:39.139 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:39.139 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:39.139 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:39.139 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:39.139 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:39.139 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:39.139 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:39.140 INFO:teuthology.orchestra.run.smithi050.stdout: "sqlite3_killpoint": { 2024-08-31T04:38:39.140 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "sqlite3_killpoint", 2024-08-31T04:38:39.140 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-08-31T04:38:39.140 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "dev", 2024-08-31T04:38:39.140 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:39.140 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "0", 2024-08-31T04:38:39.140 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:39.140 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:39.140 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:39.140 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:39.140 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:39.140 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:39.140 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:39.140 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:39.141 INFO:teuthology.orchestra.run.smithi050.stdout: "storage_class": { 2024-08-31T04:38:39.141 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "storage_class", 2024-08-31T04:38:39.141 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:39.141 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:39.141 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:39.141 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "local", 2024-08-31T04:38:39.141 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:39.141 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:39.141 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:39.141 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-08-31T04:38:39.141 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:39.141 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:39.141 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:39.142 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T04:38:39.142 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T04:38:39.142 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:39.142 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-08-31T04:38:39.142 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "selftest", 2024-08-31T04:38:39.142 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2024-08-31T04:38:39.142 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2024-08-31T04:38:39.142 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2024-08-31T04:38:39.142 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2024-08-31T04:38:39.142 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2024-08-31T04:38:39.142 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:39.142 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:39.142 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:39.143 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-08-31T04:38:39.143 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:39.143 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:39.143 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-08-31T04:38:39.143 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-08-31T04:38:39.143 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-08-31T04:38:39.143 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-08-31T04:38:39.143 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-08-31T04:38:39.143 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-08-31T04:38:39.143 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-08-31T04:38:39.143 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-08-31T04:38:39.143 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:39.143 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:39.143 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:39.143 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:39.144 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:39.144 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2024-08-31T04:38:39.144 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2024-08-31T04:38:39.144 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:39.144 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:39.144 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:39.144 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-08-31T04:38:39.144 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:39.144 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:39.144 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:39.144 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:39.144 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:39.144 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:39.145 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:39.145 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:39.145 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2024-08-31T04:38:39.145 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2024-08-31T04:38:39.145 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:39.145 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:39.145 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:39.145 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2024-08-31T04:38:39.145 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:39.145 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:39.145 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-08-31T04:38:39.145 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-08-31T04:38:39.145 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-08-31T04:38:39.145 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-08-31T04:38:39.146 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-08-31T04:38:39.146 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-08-31T04:38:39.146 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-08-31T04:38:39.146 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-08-31T04:38:39.146 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:39.146 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:39.146 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:39.146 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:39.146 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:39.146 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2024-08-31T04:38:39.146 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2024-08-31T04:38:39.146 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:39.146 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:39.146 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:39.147 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-08-31T04:38:39.147 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:39.147 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:39.147 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:39.147 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:39.147 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:39.147 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:39.147 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:39.147 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:39.147 INFO:teuthology.orchestra.run.smithi050.stdout: "roption1": { 2024-08-31T04:38:39.147 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "roption1", 2024-08-31T04:38:39.147 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:39.147 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:39.147 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:39.148 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-08-31T04:38:39.148 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:39.148 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:39.148 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:39.148 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:39.148 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:39.148 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:39.148 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:39.148 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:39.148 INFO:teuthology.orchestra.run.smithi050.stdout: "roption2": { 2024-08-31T04:38:39.148 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "roption2", 2024-08-31T04:38:39.148 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:39.148 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:39.148 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:39.149 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "xyz", 2024-08-31T04:38:39.149 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:39.149 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:39.149 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:39.149 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:39.149 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:39.149 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:39.149 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:39.149 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:39.149 INFO:teuthology.orchestra.run.smithi050.stdout: "rwoption1": { 2024-08-31T04:38:39.149 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "rwoption1", 2024-08-31T04:38:39.149 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:39.149 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:39.149 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:39.150 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-08-31T04:38:39.150 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:39.150 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:39.150 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:39.150 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:39.150 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:39.150 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:39.150 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:39.150 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:39.150 INFO:teuthology.orchestra.run.smithi050.stdout: "rwoption2": { 2024-08-31T04:38:39.150 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "rwoption2", 2024-08-31T04:38:39.150 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-08-31T04:38:39.150 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:39.151 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:39.151 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-08-31T04:38:39.151 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:39.151 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:39.151 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:39.151 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:39.151 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:39.151 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:39.151 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:39.151 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:39.151 INFO:teuthology.orchestra.run.smithi050.stdout: "rwoption3": { 2024-08-31T04:38:39.151 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "rwoption3", 2024-08-31T04:38:39.151 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "float", 2024-08-31T04:38:39.151 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:39.151 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:39.152 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-08-31T04:38:39.152 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:39.152 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:39.152 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:39.152 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:39.152 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:39.152 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:39.152 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:39.152 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:39.152 INFO:teuthology.orchestra.run.smithi050.stdout: "rwoption4": { 2024-08-31T04:38:39.152 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "rwoption4", 2024-08-31T04:38:39.152 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:39.152 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:39.152 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:39.153 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-08-31T04:38:39.153 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:39.153 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:39.153 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:39.153 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:39.153 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:39.153 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:39.153 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:39.153 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:39.153 INFO:teuthology.orchestra.run.smithi050.stdout: "rwoption5": { 2024-08-31T04:38:39.153 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "rwoption5", 2024-08-31T04:38:39.153 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:39.153 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:39.153 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:39.153 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-08-31T04:38:39.154 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:39.154 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:39.154 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:39.154 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:39.154 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:39.154 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:39.154 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:39.154 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:39.154 INFO:teuthology.orchestra.run.smithi050.stdout: "rwoption6": { 2024-08-31T04:38:39.154 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "rwoption6", 2024-08-31T04:38:39.154 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:39.154 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:39.154 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:39.155 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2024-08-31T04:38:39.155 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:39.155 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:39.155 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:39.155 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:39.155 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:39.155 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:39.155 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:39.155 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:39.155 INFO:teuthology.orchestra.run.smithi050.stdout: "rwoption7": { 2024-08-31T04:38:39.155 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "rwoption7", 2024-08-31T04:38:39.155 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-08-31T04:38:39.155 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:39.155 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:39.156 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-08-31T04:38:39.156 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "1", 2024-08-31T04:38:39.156 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "42", 2024-08-31T04:38:39.156 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:39.156 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:39.156 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:39.156 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:39.156 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:39.156 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:39.156 INFO:teuthology.orchestra.run.smithi050.stdout: "sqlite3_killpoint": { 2024-08-31T04:38:39.156 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "sqlite3_killpoint", 2024-08-31T04:38:39.156 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-08-31T04:38:39.156 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "dev", 2024-08-31T04:38:39.156 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:39.157 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "0", 2024-08-31T04:38:39.157 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:39.157 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:39.157 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:39.157 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:39.157 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:39.157 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:39.157 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:39.157 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:39.157 INFO:teuthology.orchestra.run.smithi050.stdout: "testkey": { 2024-08-31T04:38:39.157 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "testkey", 2024-08-31T04:38:39.157 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:39.157 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:39.157 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:39.158 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-08-31T04:38:39.158 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:39.158 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:39.158 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:39.158 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:39.158 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:39.158 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:39.158 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:39.158 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:39.158 INFO:teuthology.orchestra.run.smithi050.stdout: "testlkey": { 2024-08-31T04:38:39.158 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "testlkey", 2024-08-31T04:38:39.158 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:39.158 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:39.159 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:39.159 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-08-31T04:38:39.159 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:39.159 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:39.159 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:39.159 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:39.159 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:39.159 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:39.159 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:39.159 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:39.159 INFO:teuthology.orchestra.run.smithi050.stdout: "testnewline": { 2024-08-31T04:38:39.159 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "testnewline", 2024-08-31T04:38:39.159 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:39.159 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:39.160 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:39.160 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-08-31T04:38:39.160 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:39.160 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:39.160 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:39.160 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:39.160 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:39.160 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:39.160 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:39.160 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T04:38:39.160 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T04:38:39.160 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:39.160 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-08-31T04:38:39.160 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "smb", 2024-08-31T04:38:39.161 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2024-08-31T04:38:39.161 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2024-08-31T04:38:39.161 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2024-08-31T04:38:39.161 INFO:teuthology.orchestra.run.smithi050.stdout: "internal_store_backend": { 2024-08-31T04:38:39.161 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "internal_store_backend", 2024-08-31T04:38:39.161 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:39.161 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "dev", 2024-08-31T04:38:39.161 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:39.161 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-08-31T04:38:39.161 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:39.161 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:39.161 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:39.161 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "set internal store backend. for develoment and testing only", 2024-08-31T04:38:39.161 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:39.162 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:39.162 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:39.162 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:39.162 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2024-08-31T04:38:39.162 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2024-08-31T04:38:39.162 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:39.162 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:39.162 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:39.162 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-08-31T04:38:39.162 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:39.162 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:39.162 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-08-31T04:38:39.162 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-08-31T04:38:39.163 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-08-31T04:38:39.163 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-08-31T04:38:39.163 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-08-31T04:38:39.163 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-08-31T04:38:39.163 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-08-31T04:38:39.163 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-08-31T04:38:39.163 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:39.163 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:39.163 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:39.163 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:39.163 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:39.163 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2024-08-31T04:38:39.163 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2024-08-31T04:38:39.163 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:39.164 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:39.164 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:39.164 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-08-31T04:38:39.164 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:39.164 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:39.164 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:39.164 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:39.164 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:39.164 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:39.164 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:39.164 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:39.164 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2024-08-31T04:38:39.164 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2024-08-31T04:38:39.165 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:39.165 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:39.165 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:39.165 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2024-08-31T04:38:39.165 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:39.165 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:39.165 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-08-31T04:38:39.165 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-08-31T04:38:39.165 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-08-31T04:38:39.165 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-08-31T04:38:39.165 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-08-31T04:38:39.165 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-08-31T04:38:39.165 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-08-31T04:38:39.166 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-08-31T04:38:39.166 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:39.166 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:39.166 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:39.166 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:39.166 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:39.166 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2024-08-31T04:38:39.166 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2024-08-31T04:38:39.166 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:39.166 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:39.166 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:39.166 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-08-31T04:38:39.166 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:39.166 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:39.167 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:39.167 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:39.167 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:39.167 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:39.167 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:39.167 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:39.167 INFO:teuthology.orchestra.run.smithi050.stdout: "sqlite3_killpoint": { 2024-08-31T04:38:39.167 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "sqlite3_killpoint", 2024-08-31T04:38:39.167 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-08-31T04:38:39.167 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "dev", 2024-08-31T04:38:39.167 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:39.167 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "0", 2024-08-31T04:38:39.167 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:39.167 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:39.168 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:39.168 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:39.168 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:39.168 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:39.168 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:39.168 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:39.168 INFO:teuthology.orchestra.run.smithi050.stdout: "update_orchestration": { 2024-08-31T04:38:39.168 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "update_orchestration", 2024-08-31T04:38:39.168 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:39.168 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:39.168 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:39.168 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2024-08-31T04:38:39.168 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:39.168 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:39.169 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:39.169 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "automatically update orchestration when smb resources are changed", 2024-08-31T04:38:39.169 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:39.169 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:39.169 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:39.169 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T04:38:39.169 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T04:38:39.169 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:39.169 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-08-31T04:38:39.169 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "snap_schedule", 2024-08-31T04:38:39.169 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2024-08-31T04:38:39.169 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2024-08-31T04:38:39.169 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2024-08-31T04:38:39.169 INFO:teuthology.orchestra.run.smithi050.stdout: "allow_m_granularity": { 2024-08-31T04:38:39.170 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "allow_m_granularity", 2024-08-31T04:38:39.170 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:39.170 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:39.170 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:39.170 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-08-31T04:38:39.170 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:39.170 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:39.170 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:39.170 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "allow minute scheduled snapshots", 2024-08-31T04:38:39.170 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:39.170 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:39.170 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:39.170 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:39.170 INFO:teuthology.orchestra.run.smithi050.stdout: "dump_on_update": { 2024-08-31T04:38:39.171 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "dump_on_update", 2024-08-31T04:38:39.171 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:39.171 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:39.171 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:39.171 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-08-31T04:38:39.171 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:39.171 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:39.171 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:39.171 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "dump database to debug log on update", 2024-08-31T04:38:39.171 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:39.171 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:39.171 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:39.171 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:39.171 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2024-08-31T04:38:39.171 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2024-08-31T04:38:39.172 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:39.172 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:39.172 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:39.172 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-08-31T04:38:39.172 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:39.172 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:39.172 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-08-31T04:38:39.172 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-08-31T04:38:39.172 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-08-31T04:38:39.172 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-08-31T04:38:39.172 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-08-31T04:38:39.172 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-08-31T04:38:39.172 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-08-31T04:38:39.172 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-08-31T04:38:39.173 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:39.173 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:39.173 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:39.173 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:39.173 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:39.173 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2024-08-31T04:38:39.173 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2024-08-31T04:38:39.173 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:39.173 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:39.173 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:39.173 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-08-31T04:38:39.173 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:39.173 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:39.173 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:39.173 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:39.174 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:39.174 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:39.174 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:39.174 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:39.174 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2024-08-31T04:38:39.174 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2024-08-31T04:38:39.174 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:39.174 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:39.174 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:39.174 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2024-08-31T04:38:39.174 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:39.174 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:39.174 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-08-31T04:38:39.174 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-08-31T04:38:39.175 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-08-31T04:38:39.175 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-08-31T04:38:39.175 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-08-31T04:38:39.175 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-08-31T04:38:39.175 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-08-31T04:38:39.175 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-08-31T04:38:39.175 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:39.175 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:39.175 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:39.175 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:39.175 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:39.175 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2024-08-31T04:38:39.175 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2024-08-31T04:38:39.176 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:39.176 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:39.176 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:39.176 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-08-31T04:38:39.176 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:39.176 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:39.176 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:39.176 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:39.176 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:39.176 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:39.176 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:39.176 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:39.176 INFO:teuthology.orchestra.run.smithi050.stdout: "sqlite3_killpoint": { 2024-08-31T04:38:39.176 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "sqlite3_killpoint", 2024-08-31T04:38:39.176 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-08-31T04:38:39.177 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "dev", 2024-08-31T04:38:39.177 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:39.177 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "0", 2024-08-31T04:38:39.177 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:39.177 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:39.177 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:39.177 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:39.177 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:39.177 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:39.177 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:39.177 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T04:38:39.177 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T04:38:39.177 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:39.178 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-08-31T04:38:39.178 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "stats", 2024-08-31T04:38:39.178 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2024-08-31T04:38:39.178 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2024-08-31T04:38:39.178 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2024-08-31T04:38:39.178 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2024-08-31T04:38:39.178 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2024-08-31T04:38:39.178 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:39.178 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:39.178 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:39.178 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-08-31T04:38:39.178 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:39.178 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:39.178 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-08-31T04:38:39.179 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-08-31T04:38:39.179 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-08-31T04:38:39.179 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-08-31T04:38:39.179 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-08-31T04:38:39.179 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-08-31T04:38:39.179 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-08-31T04:38:39.179 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-08-31T04:38:39.179 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:39.179 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:39.179 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:39.179 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:39.179 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:39.179 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2024-08-31T04:38:39.179 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2024-08-31T04:38:39.180 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:39.180 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:39.180 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:39.180 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-08-31T04:38:39.180 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:39.180 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:39.180 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:39.180 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:39.180 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:39.180 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:39.180 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:39.180 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:39.180 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2024-08-31T04:38:39.181 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2024-08-31T04:38:39.181 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:39.181 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:39.181 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:39.181 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2024-08-31T04:38:39.181 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:39.181 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:39.181 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-08-31T04:38:39.181 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-08-31T04:38:39.181 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-08-31T04:38:39.181 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-08-31T04:38:39.181 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-08-31T04:38:39.181 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-08-31T04:38:39.181 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-08-31T04:38:39.182 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-08-31T04:38:39.182 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:39.182 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:39.182 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:39.182 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:39.182 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:39.182 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2024-08-31T04:38:39.182 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2024-08-31T04:38:39.182 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:39.182 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:39.182 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:39.182 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-08-31T04:38:39.182 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:39.182 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:39.183 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:39.183 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:39.183 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:39.183 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:39.183 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:39.183 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:39.183 INFO:teuthology.orchestra.run.smithi050.stdout: "sqlite3_killpoint": { 2024-08-31T04:38:39.183 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "sqlite3_killpoint", 2024-08-31T04:38:39.183 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-08-31T04:38:39.183 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "dev", 2024-08-31T04:38:39.183 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:39.183 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "0", 2024-08-31T04:38:39.184 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:39.184 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:39.184 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:39.184 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:39.184 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:39.184 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:39.184 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:39.184 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T04:38:39.184 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T04:38:39.184 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:39.184 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-08-31T04:38:39.184 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "status", 2024-08-31T04:38:39.184 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2024-08-31T04:38:39.184 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2024-08-31T04:38:39.185 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2024-08-31T04:38:39.185 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2024-08-31T04:38:39.185 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2024-08-31T04:38:39.185 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:39.185 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:39.185 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:39.185 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-08-31T04:38:39.185 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:39.185 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:39.185 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-08-31T04:38:39.185 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-08-31T04:38:39.185 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-08-31T04:38:39.185 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-08-31T04:38:39.185 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-08-31T04:38:39.186 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-08-31T04:38:39.186 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-08-31T04:38:39.186 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-08-31T04:38:39.186 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:39.186 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:39.186 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:39.186 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:39.186 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:39.186 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2024-08-31T04:38:39.186 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2024-08-31T04:38:39.186 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:39.186 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:39.186 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:39.186 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-08-31T04:38:39.186 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:39.187 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:39.187 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:39.187 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:39.187 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:39.187 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:39.187 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:39.187 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:39.187 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2024-08-31T04:38:39.187 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2024-08-31T04:38:39.187 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:39.187 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:39.187 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:39.187 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2024-08-31T04:38:39.187 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:39.188 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:39.188 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-08-31T04:38:39.188 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-08-31T04:38:39.188 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-08-31T04:38:39.188 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-08-31T04:38:39.188 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-08-31T04:38:39.188 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-08-31T04:38:39.188 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-08-31T04:38:39.188 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-08-31T04:38:39.188 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:39.188 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:39.188 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:39.188 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:39.189 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:39.189 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2024-08-31T04:38:39.189 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2024-08-31T04:38:39.189 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:39.189 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:39.189 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:39.189 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-08-31T04:38:39.189 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:39.189 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:39.189 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:39.189 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:39.189 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:39.189 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:39.190 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:39.190 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:39.190 INFO:teuthology.orchestra.run.smithi050.stdout: "sqlite3_killpoint": { 2024-08-31T04:38:39.190 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "sqlite3_killpoint", 2024-08-31T04:38:39.190 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-08-31T04:38:39.190 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "dev", 2024-08-31T04:38:39.190 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:39.190 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "0", 2024-08-31T04:38:39.190 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:39.190 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:39.190 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:39.190 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:39.190 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:39.190 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:39.191 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:39.191 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T04:38:39.191 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T04:38:39.191 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:39.191 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-08-31T04:38:39.191 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "telegraf", 2024-08-31T04:38:39.191 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2024-08-31T04:38:39.191 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2024-08-31T04:38:39.191 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2024-08-31T04:38:39.191 INFO:teuthology.orchestra.run.smithi050.stdout: "address": { 2024-08-31T04:38:39.191 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "address", 2024-08-31T04:38:39.191 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:39.191 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:39.191 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:39.192 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-08-31T04:38:39.192 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:39.192 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:39.192 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:39.192 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:39.192 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:39.192 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:39.192 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:39.192 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:39.192 INFO:teuthology.orchestra.run.smithi050.stdout: "interval": { 2024-08-31T04:38:39.192 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "interval", 2024-08-31T04:38:39.192 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "secs", 2024-08-31T04:38:39.192 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:39.192 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:39.193 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "15", 2024-08-31T04:38:39.193 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:39.193 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:39.193 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:39.193 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:39.193 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:39.193 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:39.193 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:39.193 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:39.193 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2024-08-31T04:38:39.193 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2024-08-31T04:38:39.193 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:39.194 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:39.194 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:39.194 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-08-31T04:38:39.194 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:39.194 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:39.194 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-08-31T04:38:39.194 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-08-31T04:38:39.194 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-08-31T04:38:39.194 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-08-31T04:38:39.194 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-08-31T04:38:39.194 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-08-31T04:38:39.194 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-08-31T04:38:39.194 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-08-31T04:38:39.194 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:39.195 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:39.195 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:39.195 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:39.195 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:39.195 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2024-08-31T04:38:39.195 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2024-08-31T04:38:39.195 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:39.195 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:39.195 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:39.195 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-08-31T04:38:39.195 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:39.195 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:39.195 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:39.195 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:39.196 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:39.196 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:39.196 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:39.196 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:39.196 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2024-08-31T04:38:39.196 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2024-08-31T04:38:39.196 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:39.196 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:39.196 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:39.196 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2024-08-31T04:38:39.196 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:39.196 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:39.196 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-08-31T04:38:39.196 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-08-31T04:38:39.197 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-08-31T04:38:39.197 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-08-31T04:38:39.197 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-08-31T04:38:39.197 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-08-31T04:38:39.197 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-08-31T04:38:39.197 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-08-31T04:38:39.197 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:39.197 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:39.197 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:39.197 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:39.197 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:39.197 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2024-08-31T04:38:39.197 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2024-08-31T04:38:39.197 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:39.198 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:39.198 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:39.198 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-08-31T04:38:39.198 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:39.198 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:39.198 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:39.198 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:39.198 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:39.198 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:39.198 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:39.198 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:39.198 INFO:teuthology.orchestra.run.smithi050.stdout: "sqlite3_killpoint": { 2024-08-31T04:38:39.198 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "sqlite3_killpoint", 2024-08-31T04:38:39.199 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-08-31T04:38:39.199 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "dev", 2024-08-31T04:38:39.199 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:39.199 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "0", 2024-08-31T04:38:39.199 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:39.199 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:39.199 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:39.199 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:39.199 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:39.199 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:39.199 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:39.199 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T04:38:39.199 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T04:38:39.199 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:39.199 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-08-31T04:38:39.200 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "telemetry", 2024-08-31T04:38:39.200 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2024-08-31T04:38:39.200 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2024-08-31T04:38:39.200 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2024-08-31T04:38:39.200 INFO:teuthology.orchestra.run.smithi050.stdout: "channel_basic": { 2024-08-31T04:38:39.200 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "channel_basic", 2024-08-31T04:38:39.200 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:39.200 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:39.200 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:39.200 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2024-08-31T04:38:39.200 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:39.200 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:39.200 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:39.201 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Share basic cluster information (size, version)", 2024-08-31T04:38:39.201 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:39.201 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:39.201 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:39.201 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:39.201 INFO:teuthology.orchestra.run.smithi050.stdout: "channel_crash": { 2024-08-31T04:38:39.201 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "channel_crash", 2024-08-31T04:38:39.201 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:39.201 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:39.201 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:39.201 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2024-08-31T04:38:39.201 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:39.201 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:39.201 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:39.202 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-08-31T04:38:39.202 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:39.202 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:39.202 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:39.202 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:39.202 INFO:teuthology.orchestra.run.smithi050.stdout: "channel_device": { 2024-08-31T04:38:39.202 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "channel_device", 2024-08-31T04:38:39.202 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:39.202 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:39.202 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:39.202 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2024-08-31T04:38:39.202 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:39.202 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:39.202 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:39.203 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-08-31T04:38:39.203 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:39.203 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:39.203 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:39.203 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:39.203 INFO:teuthology.orchestra.run.smithi050.stdout: "channel_ident": { 2024-08-31T04:38:39.203 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "channel_ident", 2024-08-31T04:38:39.203 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:39.203 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:39.203 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:39.203 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-08-31T04:38:39.203 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:39.203 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:39.203 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:39.204 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-08-31T04:38:39.204 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:39.204 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:39.204 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:39.204 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:39.204 INFO:teuthology.orchestra.run.smithi050.stdout: "channel_perf": { 2024-08-31T04:38:39.204 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "channel_perf", 2024-08-31T04:38:39.204 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:39.204 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:39.204 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:39.204 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-08-31T04:38:39.204 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:39.204 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:39.204 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:39.205 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Share various performance metrics of a cluster", 2024-08-31T04:38:39.205 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:39.205 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:39.205 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:39.205 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:39.205 INFO:teuthology.orchestra.run.smithi050.stdout: "contact": { 2024-08-31T04:38:39.205 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "contact", 2024-08-31T04:38:39.205 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:39.205 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:39.205 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:39.205 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-08-31T04:38:39.205 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:39.205 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:39.205 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:39.206 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:39.206 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:39.206 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:39.206 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:39.206 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:39.206 INFO:teuthology.orchestra.run.smithi050.stdout: "description": { 2024-08-31T04:38:39.206 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "description", 2024-08-31T04:38:39.206 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:39.206 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:39.206 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:39.206 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-08-31T04:38:39.206 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:39.206 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:39.206 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:39.207 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:39.207 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:39.207 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:39.207 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:39.207 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:39.207 INFO:teuthology.orchestra.run.smithi050.stdout: "device_url": { 2024-08-31T04:38:39.207 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "device_url", 2024-08-31T04:38:39.207 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:39.207 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:39.207 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:39.207 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-08-31T04:38:39.207 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:39.207 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:39.207 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:39.208 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:39.208 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:39.208 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:39.208 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:39.208 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:39.208 INFO:teuthology.orchestra.run.smithi050.stdout: "enabled": { 2024-08-31T04:38:39.208 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "enabled", 2024-08-31T04:38:39.208 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:39.208 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:39.208 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:39.208 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-08-31T04:38:39.208 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:39.209 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:39.209 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:39.209 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:39.209 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:39.209 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:39.209 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:39.209 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:39.209 INFO:teuthology.orchestra.run.smithi050.stdout: "interval": { 2024-08-31T04:38:39.209 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "interval", 2024-08-31T04:38:39.209 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-08-31T04:38:39.209 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:39.209 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:39.209 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "24", 2024-08-31T04:38:39.210 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "8", 2024-08-31T04:38:39.210 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:39.210 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:39.210 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:39.210 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:39.210 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:39.210 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:39.210 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:39.210 INFO:teuthology.orchestra.run.smithi050.stdout: "last_opt_revision": { 2024-08-31T04:38:39.210 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "last_opt_revision", 2024-08-31T04:38:39.210 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-08-31T04:38:39.210 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:39.210 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:39.211 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "1", 2024-08-31T04:38:39.211 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:39.211 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:39.211 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:39.211 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:39.211 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:39.211 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:39.211 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:39.211 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:39.211 INFO:teuthology.orchestra.run.smithi050.stdout: "leaderboard": { 2024-08-31T04:38:39.211 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "leaderboard", 2024-08-31T04:38:39.211 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:39.212 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:39.212 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:39.212 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-08-31T04:38:39.212 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:39.212 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:39.212 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:39.212 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:39.212 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:39.212 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:39.212 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:39.212 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:39.212 INFO:teuthology.orchestra.run.smithi050.stdout: "leaderboard_description": { 2024-08-31T04:38:39.212 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "leaderboard_description", 2024-08-31T04:38:39.213 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:39.213 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:39.213 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:39.213 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-08-31T04:38:39.213 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:39.213 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:39.213 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:39.213 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:39.213 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:39.213 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:39.213 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:39.213 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:39.213 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2024-08-31T04:38:39.214 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2024-08-31T04:38:39.214 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:39.214 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:39.214 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:39.214 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-08-31T04:38:39.214 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:39.214 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:39.214 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-08-31T04:38:39.214 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-08-31T04:38:39.214 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-08-31T04:38:39.214 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-08-31T04:38:39.214 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-08-31T04:38:39.214 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-08-31T04:38:39.215 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-08-31T04:38:39.215 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-08-31T04:38:39.215 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:39.215 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:39.215 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:39.215 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:39.215 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:39.215 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2024-08-31T04:38:39.215 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2024-08-31T04:38:39.215 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:39.215 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:39.215 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:39.216 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-08-31T04:38:39.216 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:39.216 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:39.216 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:39.216 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:39.216 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:39.216 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:39.216 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:39.216 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:39.216 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2024-08-31T04:38:39.216 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2024-08-31T04:38:39.216 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:39.216 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:39.217 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:39.217 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2024-08-31T04:38:39.217 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:39.217 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:39.217 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-08-31T04:38:39.217 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-08-31T04:38:39.217 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-08-31T04:38:39.217 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-08-31T04:38:39.217 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-08-31T04:38:39.217 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-08-31T04:38:39.217 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-08-31T04:38:39.217 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-08-31T04:38:39.217 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:39.217 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:39.218 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:39.218 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:39.218 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:39.218 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2024-08-31T04:38:39.218 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2024-08-31T04:38:39.218 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:39.218 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:39.218 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:39.218 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-08-31T04:38:39.218 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:39.218 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:39.218 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:39.218 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:39.218 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:39.219 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:39.219 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:39.219 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:39.219 INFO:teuthology.orchestra.run.smithi050.stdout: "organization": { 2024-08-31T04:38:39.219 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "organization", 2024-08-31T04:38:39.219 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:39.219 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:39.219 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:39.219 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-08-31T04:38:39.219 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:39.219 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:39.219 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:39.219 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:39.220 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:39.220 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:39.220 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:39.220 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:39.220 INFO:teuthology.orchestra.run.smithi050.stdout: "proxy": { 2024-08-31T04:38:39.220 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "proxy", 2024-08-31T04:38:39.220 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:39.220 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:39.220 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:39.220 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-08-31T04:38:39.220 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:39.220 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:39.221 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:39.221 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:39.221 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:39.221 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:39.221 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:39.221 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:39.221 INFO:teuthology.orchestra.run.smithi050.stdout: "sqlite3_killpoint": { 2024-08-31T04:38:39.221 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "sqlite3_killpoint", 2024-08-31T04:38:39.221 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-08-31T04:38:39.221 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "dev", 2024-08-31T04:38:39.221 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:39.221 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "0", 2024-08-31T04:38:39.221 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:39.221 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:39.221 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:39.222 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:39.222 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:39.222 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:39.222 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:39.222 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:39.222 INFO:teuthology.orchestra.run.smithi050.stdout: "url": { 2024-08-31T04:38:39.222 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "url", 2024-08-31T04:38:39.222 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:39.222 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:39.222 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:39.222 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-08-31T04:38:39.222 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:39.222 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:39.222 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:39.222 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:39.222 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:39.223 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:39.223 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:39.223 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T04:38:39.223 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T04:38:39.223 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:39.223 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-08-31T04:38:39.223 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "test_orchestrator", 2024-08-31T04:38:39.223 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2024-08-31T04:38:39.223 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2024-08-31T04:38:39.223 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2024-08-31T04:38:39.223 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2024-08-31T04:38:39.223 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2024-08-31T04:38:39.223 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:39.223 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:39.223 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:39.224 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-08-31T04:38:39.224 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:39.224 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:39.224 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-08-31T04:38:39.224 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-08-31T04:38:39.224 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-08-31T04:38:39.224 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-08-31T04:38:39.224 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-08-31T04:38:39.224 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-08-31T04:38:39.224 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-08-31T04:38:39.224 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-08-31T04:38:39.224 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:39.224 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:39.224 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:39.224 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:39.225 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:39.225 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2024-08-31T04:38:39.225 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2024-08-31T04:38:39.225 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:39.225 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:39.225 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:39.225 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-08-31T04:38:39.225 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:39.225 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:39.225 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:39.225 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:39.225 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:39.225 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:39.225 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:39.225 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:39.226 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2024-08-31T04:38:39.226 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2024-08-31T04:38:39.226 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:39.226 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:39.226 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:39.226 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2024-08-31T04:38:39.226 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:39.226 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:39.226 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-08-31T04:38:39.226 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-08-31T04:38:39.226 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-08-31T04:38:39.226 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-08-31T04:38:39.226 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-08-31T04:38:39.226 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-08-31T04:38:39.227 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-08-31T04:38:39.227 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-08-31T04:38:39.227 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:39.227 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:39.227 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:39.227 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:39.227 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:39.227 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2024-08-31T04:38:39.227 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2024-08-31T04:38:39.227 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:39.227 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:39.227 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:39.227 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-08-31T04:38:39.227 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:39.228 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:39.228 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:39.228 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:39.228 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:39.228 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:39.228 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:39.228 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:39.228 INFO:teuthology.orchestra.run.smithi050.stdout: "sqlite3_killpoint": { 2024-08-31T04:38:39.228 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "sqlite3_killpoint", 2024-08-31T04:38:39.228 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-08-31T04:38:39.228 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "dev", 2024-08-31T04:38:39.228 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:39.228 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "0", 2024-08-31T04:38:39.229 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:39.229 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:39.229 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:39.229 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:39.229 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:39.229 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:39.229 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:39.229 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T04:38:39.229 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T04:38:39.229 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:39.229 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-08-31T04:38:39.229 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "volumes", 2024-08-31T04:38:39.229 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2024-08-31T04:38:39.229 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2024-08-31T04:38:39.230 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2024-08-31T04:38:39.230 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2024-08-31T04:38:39.230 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2024-08-31T04:38:39.230 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:39.230 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:39.230 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:39.230 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-08-31T04:38:39.230 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:39.230 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:39.230 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-08-31T04:38:39.230 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-08-31T04:38:39.230 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-08-31T04:38:39.230 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-08-31T04:38:39.231 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-08-31T04:38:39.231 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-08-31T04:38:39.231 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-08-31T04:38:39.231 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-08-31T04:38:39.231 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:39.231 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:39.231 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:39.231 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:39.231 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:39.231 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2024-08-31T04:38:39.231 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2024-08-31T04:38:39.231 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:39.232 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:39.232 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:39.232 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-08-31T04:38:39.232 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:39.232 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:39.232 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:39.232 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:39.232 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:39.232 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:39.232 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:39.232 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:39.232 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2024-08-31T04:38:39.232 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2024-08-31T04:38:39.233 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:39.233 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:39.233 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:39.233 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2024-08-31T04:38:39.233 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:39.233 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:39.233 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-08-31T04:38:39.233 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-08-31T04:38:39.233 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-08-31T04:38:39.233 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-08-31T04:38:39.233 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-08-31T04:38:39.233 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-08-31T04:38:39.233 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-08-31T04:38:39.233 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-08-31T04:38:39.234 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:39.234 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:39.234 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:39.234 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:39.234 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:39.234 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2024-08-31T04:38:39.234 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2024-08-31T04:38:39.234 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:39.234 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:39.234 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:39.234 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-08-31T04:38:39.234 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:39.234 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:39.234 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:39.235 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:39.235 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:39.235 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:39.235 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:39.235 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:39.235 INFO:teuthology.orchestra.run.smithi050.stdout: "max_concurrent_clones": { 2024-08-31T04:38:39.235 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "max_concurrent_clones", 2024-08-31T04:38:39.235 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-08-31T04:38:39.235 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:39.235 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:39.235 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "4", 2024-08-31T04:38:39.235 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:39.235 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:39.235 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:39.236 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Number of asynchronous cloner threads", 2024-08-31T04:38:39.236 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:39.236 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:39.236 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:39.236 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:39.236 INFO:teuthology.orchestra.run.smithi050.stdout: "periodic_async_work": { 2024-08-31T04:38:39.236 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "periodic_async_work", 2024-08-31T04:38:39.236 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:39.236 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:39.236 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:39.236 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-08-31T04:38:39.236 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:39.236 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:39.237 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:39.237 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Periodically check for async work", 2024-08-31T04:38:39.237 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:39.237 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:39.237 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:39.237 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:39.237 INFO:teuthology.orchestra.run.smithi050.stdout: "snapshot_clone_delay": { 2024-08-31T04:38:39.237 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "snapshot_clone_delay", 2024-08-31T04:38:39.237 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-08-31T04:38:39.237 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:39.237 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:39.237 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "0", 2024-08-31T04:38:39.237 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:39.237 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:39.238 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:39.238 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-08-31T04:38:39.238 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:39.238 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:39.238 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:39.238 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:39.238 INFO:teuthology.orchestra.run.smithi050.stdout: "snapshot_clone_no_wait": { 2024-08-31T04:38:39.238 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "snapshot_clone_no_wait", 2024-08-31T04:38:39.238 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:39.238 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:39.238 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:39.238 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "True", 2024-08-31T04:38:39.238 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:39.238 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:39.239 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:39.239 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-08-31T04:38:39.239 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:39.239 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:39.239 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:39.239 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:39.239 INFO:teuthology.orchestra.run.smithi050.stdout: "sqlite3_killpoint": { 2024-08-31T04:38:39.239 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "sqlite3_killpoint", 2024-08-31T04:38:39.239 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-08-31T04:38:39.239 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "dev", 2024-08-31T04:38:39.239 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:39.239 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "0", 2024-08-31T04:38:39.239 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:39.239 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:39.240 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:39.240 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:39.240 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:39.240 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:39.240 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:39.240 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T04:38:39.240 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T04:38:39.240 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:39.240 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-08-31T04:38:39.240 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "zabbix", 2024-08-31T04:38:39.240 INFO:teuthology.orchestra.run.smithi050.stdout: "can_run": true, 2024-08-31T04:38:39.240 INFO:teuthology.orchestra.run.smithi050.stdout: "error_string": "", 2024-08-31T04:38:39.240 INFO:teuthology.orchestra.run.smithi050.stdout: "module_options": { 2024-08-31T04:38:39.241 INFO:teuthology.orchestra.run.smithi050.stdout: "discovery_interval": { 2024-08-31T04:38:39.241 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "discovery_interval", 2024-08-31T04:38:39.241 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "uint", 2024-08-31T04:38:39.241 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:39.241 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:39.241 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "100", 2024-08-31T04:38:39.241 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:39.241 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:39.241 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:39.241 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:39.241 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:39.241 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:39.241 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:39.241 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:39.242 INFO:teuthology.orchestra.run.smithi050.stdout: "identifier": { 2024-08-31T04:38:39.242 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "identifier", 2024-08-31T04:38:39.242 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:39.242 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:39.242 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:39.242 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-08-31T04:38:39.242 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:39.242 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:39.242 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:39.242 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:39.242 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:39.242 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:39.242 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:39.242 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:39.242 INFO:teuthology.orchestra.run.smithi050.stdout: "interval": { 2024-08-31T04:38:39.243 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "interval", 2024-08-31T04:38:39.243 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "secs", 2024-08-31T04:38:39.243 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:39.243 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:39.243 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "60", 2024-08-31T04:38:39.243 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:39.243 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:39.243 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:39.243 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:39.243 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:39.243 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:39.243 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:39.243 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:39.244 INFO:teuthology.orchestra.run.smithi050.stdout: "log_level": { 2024-08-31T04:38:39.244 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_level", 2024-08-31T04:38:39.244 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:39.244 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:39.244 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:39.244 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-08-31T04:38:39.244 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:39.244 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:39.244 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-08-31T04:38:39.244 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-08-31T04:38:39.244 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-08-31T04:38:39.244 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-08-31T04:38:39.244 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-08-31T04:38:39.244 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-08-31T04:38:39.245 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-08-31T04:38:39.245 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-08-31T04:38:39.245 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:39.245 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:39.245 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:39.245 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:39.245 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:39.245 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster": { 2024-08-31T04:38:39.245 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster", 2024-08-31T04:38:39.245 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:39.245 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:39.245 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:39.245 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-08-31T04:38:39.246 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:39.246 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:39.246 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:39.246 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:39.246 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:39.246 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:39.246 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:39.246 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:39.246 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_cluster_level": { 2024-08-31T04:38:39.246 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_cluster_level", 2024-08-31T04:38:39.246 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:39.246 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:39.246 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:39.246 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "info", 2024-08-31T04:38:39.247 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:39.247 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:39.247 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [ 2024-08-31T04:38:39.247 INFO:teuthology.orchestra.run.smithi050.stdout: "", 2024-08-31T04:38:39.247 INFO:teuthology.orchestra.run.smithi050.stdout: "critical", 2024-08-31T04:38:39.247 INFO:teuthology.orchestra.run.smithi050.stdout: "debug", 2024-08-31T04:38:39.247 INFO:teuthology.orchestra.run.smithi050.stdout: "error", 2024-08-31T04:38:39.247 INFO:teuthology.orchestra.run.smithi050.stdout: "info", 2024-08-31T04:38:39.247 INFO:teuthology.orchestra.run.smithi050.stdout: "warning" 2024-08-31T04:38:39.247 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-08-31T04:38:39.247 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:39.247 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:39.247 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:39.247 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:39.248 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:39.248 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": { 2024-08-31T04:38:39.248 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "log_to_file", 2024-08-31T04:38:39.248 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "bool", 2024-08-31T04:38:39.248 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:39.248 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:39.248 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "False", 2024-08-31T04:38:39.248 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:39.248 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:39.248 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:39.248 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:39.248 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:39.248 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:39.248 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:39.249 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:39.249 INFO:teuthology.orchestra.run.smithi050.stdout: "sqlite3_killpoint": { 2024-08-31T04:38:39.249 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "sqlite3_killpoint", 2024-08-31T04:38:39.249 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-08-31T04:38:39.249 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "dev", 2024-08-31T04:38:39.249 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-08-31T04:38:39.249 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "0", 2024-08-31T04:38:39.249 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:39.249 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:39.249 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:39.249 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:39.249 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:39.249 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:39.249 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:39.250 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:39.250 INFO:teuthology.orchestra.run.smithi050.stdout: "zabbix_host": { 2024-08-31T04:38:39.250 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "zabbix_host", 2024-08-31T04:38:39.250 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:39.250 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:39.250 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:39.250 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "", 2024-08-31T04:38:39.250 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:39.250 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:39.250 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:39.250 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:39.250 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:39.250 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:39.251 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:39.251 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:39.251 INFO:teuthology.orchestra.run.smithi050.stdout: "zabbix_port": { 2024-08-31T04:38:39.251 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "zabbix_port", 2024-08-31T04:38:39.251 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "int", 2024-08-31T04:38:39.251 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:39.251 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:39.251 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "10051", 2024-08-31T04:38:39.251 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:39.251 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:39.251 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:39.251 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:39.251 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:39.252 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:39.252 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:39.252 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:39.252 INFO:teuthology.orchestra.run.smithi050.stdout: "zabbix_sender": { 2024-08-31T04:38:39.252 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "zabbix_sender", 2024-08-31T04:38:39.252 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "str", 2024-08-31T04:38:39.252 INFO:teuthology.orchestra.run.smithi050.stdout: "level": "advanced", 2024-08-31T04:38:39.252 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 0, 2024-08-31T04:38:39.252 INFO:teuthology.orchestra.run.smithi050.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-08-31T04:38:39.252 INFO:teuthology.orchestra.run.smithi050.stdout: "min": "", 2024-08-31T04:38:39.252 INFO:teuthology.orchestra.run.smithi050.stdout: "max": "", 2024-08-31T04:38:39.252 INFO:teuthology.orchestra.run.smithi050.stdout: "enum_allowed": [], 2024-08-31T04:38:39.252 INFO:teuthology.orchestra.run.smithi050.stdout: "desc": "", 2024-08-31T04:38:39.252 INFO:teuthology.orchestra.run.smithi050.stdout: "long_desc": "", 2024-08-31T04:38:39.252 INFO:teuthology.orchestra.run.smithi050.stdout: "tags": [], 2024-08-31T04:38:39.253 INFO:teuthology.orchestra.run.smithi050.stdout: "see_also": [] 2024-08-31T04:38:39.253 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T04:38:39.253 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T04:38:39.253 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T04:38:39.253 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-08-31T04:38:39.253 INFO:teuthology.orchestra.run.smithi050.stdout: "services": { 2024-08-31T04:38:39.253 INFO:teuthology.orchestra.run.smithi050.stdout: "dashboard": "https://172.21.15.50:8443/" 2024-08-31T04:38:39.253 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:39.253 INFO:teuthology.orchestra.run.smithi050.stdout: "always_on_modules": { 2024-08-31T04:38:39.253 INFO:teuthology.orchestra.run.smithi050.stdout: "octopus": [ 2024-08-31T04:38:39.253 INFO:teuthology.orchestra.run.smithi050.stdout: "balancer", 2024-08-31T04:38:39.253 INFO:teuthology.orchestra.run.smithi050.stdout: "crash", 2024-08-31T04:38:39.253 INFO:teuthology.orchestra.run.smithi050.stdout: "devicehealth", 2024-08-31T04:38:39.253 INFO:teuthology.orchestra.run.smithi050.stdout: "orchestrator", 2024-08-31T04:38:39.254 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_autoscaler", 2024-08-31T04:38:39.254 INFO:teuthology.orchestra.run.smithi050.stdout: "progress", 2024-08-31T04:38:39.254 INFO:teuthology.orchestra.run.smithi050.stdout: "rbd_support", 2024-08-31T04:38:39.254 INFO:teuthology.orchestra.run.smithi050.stdout: "status", 2024-08-31T04:38:39.254 INFO:teuthology.orchestra.run.smithi050.stdout: "telemetry", 2024-08-31T04:38:39.254 INFO:teuthology.orchestra.run.smithi050.stdout: "volumes" 2024-08-31T04:38:39.254 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-08-31T04:38:39.254 INFO:teuthology.orchestra.run.smithi050.stdout: "pacific": [ 2024-08-31T04:38:39.254 INFO:teuthology.orchestra.run.smithi050.stdout: "balancer", 2024-08-31T04:38:39.254 INFO:teuthology.orchestra.run.smithi050.stdout: "crash", 2024-08-31T04:38:39.254 INFO:teuthology.orchestra.run.smithi050.stdout: "devicehealth", 2024-08-31T04:38:39.254 INFO:teuthology.orchestra.run.smithi050.stdout: "orchestrator", 2024-08-31T04:38:39.254 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_autoscaler", 2024-08-31T04:38:39.254 INFO:teuthology.orchestra.run.smithi050.stdout: "progress", 2024-08-31T04:38:39.254 INFO:teuthology.orchestra.run.smithi050.stdout: "rbd_support", 2024-08-31T04:38:39.255 INFO:teuthology.orchestra.run.smithi050.stdout: "status", 2024-08-31T04:38:39.255 INFO:teuthology.orchestra.run.smithi050.stdout: "telemetry", 2024-08-31T04:38:39.255 INFO:teuthology.orchestra.run.smithi050.stdout: "volumes" 2024-08-31T04:38:39.255 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-08-31T04:38:39.255 INFO:teuthology.orchestra.run.smithi050.stdout: "quincy": [ 2024-08-31T04:38:39.255 INFO:teuthology.orchestra.run.smithi050.stdout: "balancer", 2024-08-31T04:38:39.255 INFO:teuthology.orchestra.run.smithi050.stdout: "crash", 2024-08-31T04:38:39.255 INFO:teuthology.orchestra.run.smithi050.stdout: "devicehealth", 2024-08-31T04:38:39.255 INFO:teuthology.orchestra.run.smithi050.stdout: "orchestrator", 2024-08-31T04:38:39.255 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_autoscaler", 2024-08-31T04:38:39.255 INFO:teuthology.orchestra.run.smithi050.stdout: "progress", 2024-08-31T04:38:39.255 INFO:teuthology.orchestra.run.smithi050.stdout: "rbd_support", 2024-08-31T04:38:39.255 INFO:teuthology.orchestra.run.smithi050.stdout: "status", 2024-08-31T04:38:39.255 INFO:teuthology.orchestra.run.smithi050.stdout: "telemetry", 2024-08-31T04:38:39.255 INFO:teuthology.orchestra.run.smithi050.stdout: "volumes" 2024-08-31T04:38:39.255 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-08-31T04:38:39.256 INFO:teuthology.orchestra.run.smithi050.stdout: "reef": [ 2024-08-31T04:38:39.256 INFO:teuthology.orchestra.run.smithi050.stdout: "balancer", 2024-08-31T04:38:39.256 INFO:teuthology.orchestra.run.smithi050.stdout: "crash", 2024-08-31T04:38:39.256 INFO:teuthology.orchestra.run.smithi050.stdout: "devicehealth", 2024-08-31T04:38:39.256 INFO:teuthology.orchestra.run.smithi050.stdout: "orchestrator", 2024-08-31T04:38:39.256 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_autoscaler", 2024-08-31T04:38:39.256 INFO:teuthology.orchestra.run.smithi050.stdout: "progress", 2024-08-31T04:38:39.256 INFO:teuthology.orchestra.run.smithi050.stdout: "rbd_support", 2024-08-31T04:38:39.256 INFO:teuthology.orchestra.run.smithi050.stdout: "status", 2024-08-31T04:38:39.256 INFO:teuthology.orchestra.run.smithi050.stdout: "telemetry", 2024-08-31T04:38:39.256 INFO:teuthology.orchestra.run.smithi050.stdout: "volumes" 2024-08-31T04:38:39.256 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-08-31T04:38:39.256 INFO:teuthology.orchestra.run.smithi050.stdout: "squid": [ 2024-08-31T04:38:39.256 INFO:teuthology.orchestra.run.smithi050.stdout: "balancer", 2024-08-31T04:38:39.257 INFO:teuthology.orchestra.run.smithi050.stdout: "crash", 2024-08-31T04:38:39.257 INFO:teuthology.orchestra.run.smithi050.stdout: "devicehealth", 2024-08-31T04:38:39.257 INFO:teuthology.orchestra.run.smithi050.stdout: "orchestrator", 2024-08-31T04:38:39.257 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_autoscaler", 2024-08-31T04:38:39.257 INFO:teuthology.orchestra.run.smithi050.stdout: "progress", 2024-08-31T04:38:39.257 INFO:teuthology.orchestra.run.smithi050.stdout: "rbd_support", 2024-08-31T04:38:39.257 INFO:teuthology.orchestra.run.smithi050.stdout: "status", 2024-08-31T04:38:39.257 INFO:teuthology.orchestra.run.smithi050.stdout: "telemetry", 2024-08-31T04:38:39.257 INFO:teuthology.orchestra.run.smithi050.stdout: "volumes" 2024-08-31T04:38:39.257 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-08-31T04:38:39.257 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:39.257 INFO:teuthology.orchestra.run.smithi050.stdout: "last_failure_osd_epoch": 3, 2024-08-31T04:38:39.257 INFO:teuthology.orchestra.run.smithi050.stdout: "active_clients": [ 2024-08-31T04:38:39.258 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-08-31T04:38:39.258 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "devicehealth", 2024-08-31T04:38:39.258 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2024-08-31T04:38:39.258 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-08-31T04:38:39.258 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2024-08-31T04:38:39.258 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:0", 2024-08-31T04:38:39.258 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1805013631 2024-08-31T04:38:39.258 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T04:38:39.258 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-08-31T04:38:39.258 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:39.258 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-08-31T04:38:39.258 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "libcephsqlite", 2024-08-31T04:38:39.258 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2024-08-31T04:38:39.259 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-08-31T04:38:39.259 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2024-08-31T04:38:39.259 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:0", 2024-08-31T04:38:39.259 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3813608256 2024-08-31T04:38:39.259 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T04:38:39.259 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-08-31T04:38:39.259 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:39.259 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-08-31T04:38:39.259 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "rbd_support", 2024-08-31T04:38:39.259 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2024-08-31T04:38:39.259 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-08-31T04:38:39.259 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2024-08-31T04:38:39.259 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:0", 2024-08-31T04:38:39.259 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 2053368437 2024-08-31T04:38:39.260 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T04:38:39.260 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-08-31T04:38:39.260 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:39.260 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-08-31T04:38:39.260 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "volumes", 2024-08-31T04:38:39.260 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2024-08-31T04:38:39.260 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-08-31T04:38:39.260 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2024-08-31T04:38:39.260 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:0", 2024-08-31T04:38:39.260 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1427192603 2024-08-31T04:38:39.260 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T04:38:39.260 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-08-31T04:38:39.260 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T04:38:39.260 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-08-31T04:38:39.261 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-08-31T04:38:39.261 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:37.780+0000 7ff379600640 1 -- 172.21.15.50:0/1705639489 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7ff3580b4bb0 msgr2=0x7ff3580b70c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:38:39.262 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:37.780+0000 7ff379600640 1 --2- 172.21.15.50:0/1705639489 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7ff3580b4bb0 0x7ff3580b70c0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7ff35c009bd0 tx=0x7ff35c005f90 comp rx=0 tx=0).stop 2024-08-31T04:38:39.262 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:37.780+0000 7ff379600640 1 -- 172.21.15.50:0/1705639489 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff374075a30 msgr2=0x7ff37419bcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:38:39.262 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:37.780+0000 7ff379600640 1 --2- 172.21.15.50:0/1705639489 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff374075a30 0x7ff37419bcf0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7ff364031440 tx=0x7ff364003c10 comp rx=0 tx=0).stop 2024-08-31T04:38:39.262 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:37.780+0000 7ff379600640 1 -- 172.21.15.50:0/1705639489 shutdown_connections 2024-08-31T04:38:39.262 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:37.780+0000 7ff379600640 1 --2- 172.21.15.50:0/1705639489 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7ff3580b4bb0 0x7ff3580b70c0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:38:39.262 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:37.780+0000 7ff379600640 1 --2- 172.21.15.50:0/1705639489 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff37410b240 0x7ff37419cf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:38:39.262 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:37.780+0000 7ff379600640 1 --2- 172.21.15.50:0/1705639489 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff374076e30 0x7ff37419c360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:38:39.262 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:37.780+0000 7ff379600640 1 --2- 172.21.15.50:0/1705639489 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff374075a30 0x7ff37419bcf0 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:38:39.262 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:37.780+0000 7ff379600640 1 -- 172.21.15.50:0/1705639489 >> 172.21.15.50:0/1705639489 conn(0x7ff3740feb90 msgr2=0x7ff374101020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:38:39.262 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:37.780+0000 7ff379600640 1 -- 172.21.15.50:0/1705639489 shutdown_connections 2024-08-31T04:38:39.262 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:38:37.781+0000 7ff379600640 1 -- 172.21.15.50:0/1705639489 wait complete. 2024-08-31T04:38:39.263 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:38:37 smithi050 ceph-mon[17259]: pgmap v840: 97 pgs: 97 active+clean; 596 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.0 MiB/s wr, 325 op/s 2024-08-31T04:38:39.263 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:38:37 smithi050 ceph-mon[17259]: from='client.? 172.21.15.50:0/2090252530' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} : dispatch 2024-08-31T04:38:39.263 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:38:37 smithi050 ceph-mon[17259]: from='client.? 172.21.15.50:0/1161153870' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} : dispatch 2024-08-31T04:38:39.271 DEBUG:tasks.check_counter:Getting stats from a 2024-08-31T04:38:39.271 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 058d9fc6-674f-11ef-bcd4-c7b262605968 -- ceph daemon mds.a perf dump 2024-08-31T04:38:39.272 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:38:38 smithi050 ceph-mon[17259]: from='client.? 172.21.15.50:0/1705639489' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json-pretty"} : dispatch 2024-08-31T04:38:39.272 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:38:37 smithi133 ceph-mon[22177]: pgmap v840: 97 pgs: 97 active+clean; 596 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.0 MiB/s wr, 325 op/s 2024-08-31T04:38:39.272 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:38:37 smithi133 ceph-mon[22177]: from='client.? 172.21.15.50:0/2090252530' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} : dispatch 2024-08-31T04:38:39.273 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:38:37 smithi133 ceph-mon[22177]: from='client.? 172.21.15.50:0/1161153870' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} : dispatch 2024-08-31T04:38:39.273 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:38:38 smithi133 ceph-mon[22177]: from='client.? 172.21.15.50:0/1705639489' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json-pretty"} : dispatch 2024-08-31T04:38:39.273 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:38:37 smithi177 ceph-mon[22025]: pgmap v840: 97 pgs: 97 active+clean; 596 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.0 MiB/s wr, 325 op/s 2024-08-31T04:38:39.273 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:38:37 smithi177 ceph-mon[22025]: from='client.? 172.21.15.50:0/2090252530' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} : dispatch 2024-08-31T04:38:39.273 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:38:37 smithi177 ceph-mon[22025]: from='client.? 172.21.15.50:0/1161153870' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} : dispatch 2024-08-31T04:38:39.273 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:38:38 smithi177 ceph-mon[22025]: from='client.? 172.21.15.50:0/1705639489' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json-pretty"} : dispatch 2024-08-31T04:38:39.665 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:38:39.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:38:39 smithi050 ceph-mon[17259]: pgmap v841: 97 pgs: 97 active+clean; 592 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 628 KiB/s rd, 592 KiB/s wr, 211 op/s 2024-08-31T04:38:39.996 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:38:39 smithi177 ceph-mon[22025]: pgmap v841: 97 pgs: 97 active+clean; 592 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 628 KiB/s rd, 592 KiB/s wr, 211 op/s 2024-08-31T04:38:40.043 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:38:39 smithi133 ceph-mon[22177]: pgmap v841: 97 pgs: 97 active+clean; 592 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 628 KiB/s rd, 592 KiB/s wr, 211 op/s 2024-08-31T04:38:40.396 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-08-31T04:38:40.396 INFO:teuthology.orchestra.run.smithi050.stdout: "AsyncMessenger::Worker-0": { 2024-08-31T04:38:40.397 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_recv_messages": 39087, 2024-08-31T04:38:40.397 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_send_messages": 46735, 2024-08-31T04:38:40.397 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_recv_bytes": 29882850, 2024-08-31T04:38:40.397 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_send_bytes": 92882370, 2024-08-31T04:38:40.397 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_created_connections": 12, 2024-08-31T04:38:40.397 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_active_connections": 6, 2024-08-31T04:38:40.397 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_running_total_time": 5.624961068, 2024-08-31T04:38:40.397 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_running_send_time": 2.924275477, 2024-08-31T04:38:40.397 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_running_recv_time": 2.642620040, 2024-08-31T04:38:40.397 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_running_fast_dispatch_time": 0.449533403, 2024-08-31T04:38:40.397 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_send_messages_queue_lat": { 2024-08-31T04:38:40.397 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 46732, 2024-08-31T04:38:40.398 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 7.568475426, 2024-08-31T04:38:40.398 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000161954 2024-08-31T04:38:40.398 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:40.398 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_handle_ack_lat": { 2024-08-31T04:38:40.398 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 66952, 2024-08-31T04:38:40.398 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.027174107, 2024-08-31T04:38:40.398 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000405 2024-08-31T04:38:40.398 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:40.398 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_recv_encrypted_bytes": 0, 2024-08-31T04:38:40.398 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_send_encrypted_bytes": 0 2024-08-31T04:38:40.398 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:40.398 INFO:teuthology.orchestra.run.smithi050.stdout: "AsyncMessenger::Worker-1": { 2024-08-31T04:38:40.398 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_recv_messages": 172893, 2024-08-31T04:38:40.398 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_send_messages": 260116, 2024-08-31T04:38:40.399 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_recv_bytes": 56105405, 2024-08-31T04:38:40.399 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_send_bytes": 163165919, 2024-08-31T04:38:40.399 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_created_connections": 16, 2024-08-31T04:38:40.399 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_active_connections": 7, 2024-08-31T04:38:40.399 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_running_total_time": 45.132686306, 2024-08-31T04:38:40.399 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_running_send_time": 36.801355239, 2024-08-31T04:38:40.399 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_running_recv_time": 56.688421482, 2024-08-31T04:38:40.399 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_running_fast_dispatch_time": 0.359681167, 2024-08-31T04:38:40.399 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_send_messages_queue_lat": { 2024-08-31T04:38:40.399 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 260116, 2024-08-31T04:38:40.399 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 30580.142378326, 2024-08-31T04:38:40.399 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.117563480 2024-08-31T04:38:40.400 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:40.400 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_handle_ack_lat": { 2024-08-31T04:38:40.400 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 190997, 2024-08-31T04:38:40.400 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.105825777, 2024-08-31T04:38:40.400 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000554 2024-08-31T04:38:40.400 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:40.400 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_recv_encrypted_bytes": 1038832, 2024-08-31T04:38:40.400 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_send_encrypted_bytes": 197072 2024-08-31T04:38:40.400 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:40.400 INFO:teuthology.orchestra.run.smithi050.stdout: "AsyncMessenger::Worker-2": { 2024-08-31T04:38:40.400 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_recv_messages": 20505, 2024-08-31T04:38:40.400 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_send_messages": 22219, 2024-08-31T04:38:40.400 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_recv_bytes": 8715588, 2024-08-31T04:38:40.401 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_send_bytes": 79692114, 2024-08-31T04:38:40.401 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_created_connections": 15, 2024-08-31T04:38:40.401 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_active_connections": 7, 2024-08-31T04:38:40.401 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_running_total_time": 3.325838017, 2024-08-31T04:38:40.401 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_running_send_time": 1.663009962, 2024-08-31T04:38:40.401 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_running_recv_time": 1.236432763, 2024-08-31T04:38:40.401 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_running_fast_dispatch_time": 0.525358437, 2024-08-31T04:38:40.401 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_send_messages_queue_lat": { 2024-08-31T04:38:40.401 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 22216, 2024-08-31T04:38:40.401 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 3.389793771, 2024-08-31T04:38:40.401 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000152583 2024-08-31T04:38:40.401 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:40.401 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_handle_ack_lat": { 2024-08-31T04:38:40.402 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 25542, 2024-08-31T04:38:40.402 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.008712399, 2024-08-31T04:38:40.402 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000341 2024-08-31T04:38:40.402 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:40.402 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_recv_encrypted_bytes": 320, 2024-08-31T04:38:40.402 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_send_encrypted_bytes": 573584 2024-08-31T04:38:40.402 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:40.402 INFO:teuthology.orchestra.run.smithi050.stdout: "cct": { 2024-08-31T04:38:40.402 INFO:teuthology.orchestra.run.smithi050.stdout: "total_workers": 1, 2024-08-31T04:38:40.402 INFO:teuthology.orchestra.run.smithi050.stdout: "unhealthy_workers": 0 2024-08-31T04:38:40.402 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:40.402 INFO:teuthology.orchestra.run.smithi050.stdout: "finisher-MDSRank": { 2024-08-31T04:38:40.402 INFO:teuthology.orchestra.run.smithi050.stdout: "queue_len": 0, 2024-08-31T04:38:40.403 INFO:teuthology.orchestra.run.smithi050.stdout: "complete_latency": { 2024-08-31T04:38:40.403 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 3892, 2024-08-31T04:38:40.403 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 77.356692268, 2024-08-31T04:38:40.403 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.019875820 2024-08-31T04:38:40.403 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T04:38:40.403 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:40.403 INFO:teuthology.orchestra.run.smithi050.stdout: "finisher-PurgeQueue": { 2024-08-31T04:38:40.403 INFO:teuthology.orchestra.run.smithi050.stdout: "queue_len": 0, 2024-08-31T04:38:40.403 INFO:teuthology.orchestra.run.smithi050.stdout: "complete_latency": { 2024-08-31T04:38:40.403 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 31847, 2024-08-31T04:38:40.403 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 7.264611062, 2024-08-31T04:38:40.403 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000228109 2024-08-31T04:38:40.403 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T04:38:40.404 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:40.404 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": { 2024-08-31T04:38:40.404 INFO:teuthology.orchestra.run.smithi050.stdout: "request": 94259, 2024-08-31T04:38:40.404 INFO:teuthology.orchestra.run.smithi050.stdout: "reply": 85603, 2024-08-31T04:38:40.404 INFO:teuthology.orchestra.run.smithi050.stdout: "reply_latency": { 2024-08-31T04:38:40.404 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 85603, 2024-08-31T04:38:40.404 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 2325.079020098, 2024-08-31T04:38:40.404 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.027161186 2024-08-31T04:38:40.404 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:40.404 INFO:teuthology.orchestra.run.smithi050.stdout: "slow_reply": 4, 2024-08-31T04:38:40.404 INFO:teuthology.orchestra.run.smithi050.stdout: "forward": 8648, 2024-08-31T04:38:40.404 INFO:teuthology.orchestra.run.smithi050.stdout: "dir_fetch_complete": 74, 2024-08-31T04:38:40.404 INFO:teuthology.orchestra.run.smithi050.stdout: "dir_fetch_keys": 0, 2024-08-31T04:38:40.405 INFO:teuthology.orchestra.run.smithi050.stdout: "dir_commit": 466, 2024-08-31T04:38:40.405 INFO:teuthology.orchestra.run.smithi050.stdout: "dir_split": 51, 2024-08-31T04:38:40.405 INFO:teuthology.orchestra.run.smithi050.stdout: "dir_merge": 1, 2024-08-31T04:38:40.405 INFO:teuthology.orchestra.run.smithi050.stdout: "inodes": 17, 2024-08-31T04:38:40.405 INFO:teuthology.orchestra.run.smithi050.stdout: "inodes_top": 1, 2024-08-31T04:38:40.405 INFO:teuthology.orchestra.run.smithi050.stdout: "inodes_bottom": 6, 2024-08-31T04:38:40.405 INFO:teuthology.orchestra.run.smithi050.stdout: "inodes_pin_tail": 10, 2024-08-31T04:38:40.405 INFO:teuthology.orchestra.run.smithi050.stdout: "inodes_pinned": 13, 2024-08-31T04:38:40.405 INFO:teuthology.orchestra.run.smithi050.stdout: "inodes_expired": 21710, 2024-08-31T04:38:40.405 INFO:teuthology.orchestra.run.smithi050.stdout: "inodes_with_caps": 0, 2024-08-31T04:38:40.405 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": 0, 2024-08-31T04:38:40.405 INFO:teuthology.orchestra.run.smithi050.stdout: "subtrees": 3, 2024-08-31T04:38:40.405 INFO:teuthology.orchestra.run.smithi050.stdout: "traverse": 154498, 2024-08-31T04:38:40.406 INFO:teuthology.orchestra.run.smithi050.stdout: "traverse_hit": 130246, 2024-08-31T04:38:40.406 INFO:teuthology.orchestra.run.smithi050.stdout: "traverse_forward": 8508, 2024-08-31T04:38:40.406 INFO:teuthology.orchestra.run.smithi050.stdout: "traverse_discover": 741, 2024-08-31T04:38:40.406 INFO:teuthology.orchestra.run.smithi050.stdout: "traverse_dir_fetch": 2, 2024-08-31T04:38:40.406 INFO:teuthology.orchestra.run.smithi050.stdout: "traverse_remote_ino": 0, 2024-08-31T04:38:40.406 INFO:teuthology.orchestra.run.smithi050.stdout: "traverse_lock": 173, 2024-08-31T04:38:40.406 INFO:teuthology.orchestra.run.smithi050.stdout: "load_cent": 969, 2024-08-31T04:38:40.406 INFO:teuthology.orchestra.run.smithi050.stdout: "q": 0, 2024-08-31T04:38:40.406 INFO:teuthology.orchestra.run.smithi050.stdout: "exported": 191, 2024-08-31T04:38:40.406 INFO:teuthology.orchestra.run.smithi050.stdout: "exported_inodes": 15334, 2024-08-31T04:38:40.406 INFO:teuthology.orchestra.run.smithi050.stdout: "imported": 259, 2024-08-31T04:38:40.406 INFO:teuthology.orchestra.run.smithi050.stdout: "imported_inodes": 32589, 2024-08-31T04:38:40.406 INFO:teuthology.orchestra.run.smithi050.stdout: "openino_dir_fetch": 0, 2024-08-31T04:38:40.406 INFO:teuthology.orchestra.run.smithi050.stdout: "openino_backtrace_fetch": 0, 2024-08-31T04:38:40.407 INFO:teuthology.orchestra.run.smithi050.stdout: "openino_peer_discover": 0, 2024-08-31T04:38:40.407 INFO:teuthology.orchestra.run.smithi050.stdout: "root_rfiles": 21361, 2024-08-31T04:38:40.407 INFO:teuthology.orchestra.run.smithi050.stdout: "root_rbytes": 475116081, 2024-08-31T04:38:40.407 INFO:teuthology.orchestra.run.smithi050.stdout: "root_rsnaps": 0, 2024-08-31T04:38:40.407 INFO:teuthology.orchestra.run.smithi050.stdout: "scrub_backtrace_fetch": 0, 2024-08-31T04:38:40.407 INFO:teuthology.orchestra.run.smithi050.stdout: "scrub_set_tag": 0, 2024-08-31T04:38:40.407 INFO:teuthology.orchestra.run.smithi050.stdout: "scrub_backtrace_repaired": 0, 2024-08-31T04:38:40.407 INFO:teuthology.orchestra.run.smithi050.stdout: "scrub_inotable_repaired": 0, 2024-08-31T04:38:40.407 INFO:teuthology.orchestra.run.smithi050.stdout: "scrub_dir_inodes": 0, 2024-08-31T04:38:40.407 INFO:teuthology.orchestra.run.smithi050.stdout: "scrub_dir_base_inodes": 0, 2024-08-31T04:38:40.407 INFO:teuthology.orchestra.run.smithi050.stdout: "scrub_dirfrag_rstats": 0, 2024-08-31T04:38:40.407 INFO:teuthology.orchestra.run.smithi050.stdout: "scrub_file_inodes": 0, 2024-08-31T04:38:40.407 INFO:teuthology.orchestra.run.smithi050.stdout: "handle_inode_file_caps": 271, 2024-08-31T04:38:40.408 INFO:teuthology.orchestra.run.smithi050.stdout: "ceph_cap_op_revoke": 31791, 2024-08-31T04:38:40.408 INFO:teuthology.orchestra.run.smithi050.stdout: "ceph_cap_op_grant": 35798, 2024-08-31T04:38:40.408 INFO:teuthology.orchestra.run.smithi050.stdout: "ceph_cap_op_trunc": 0, 2024-08-31T04:38:40.408 INFO:teuthology.orchestra.run.smithi050.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-08-31T04:38:40.408 INFO:teuthology.orchestra.run.smithi050.stdout: "ceph_cap_op_flush_ack": 0, 2024-08-31T04:38:40.408 INFO:teuthology.orchestra.run.smithi050.stdout: "handle_client_caps": 36118, 2024-08-31T04:38:40.408 INFO:teuthology.orchestra.run.smithi050.stdout: "handle_client_caps_dirty": 10860, 2024-08-31T04:38:40.408 INFO:teuthology.orchestra.run.smithi050.stdout: "handle_client_cap_release": 3554, 2024-08-31T04:38:40.408 INFO:teuthology.orchestra.run.smithi050.stdout: "process_request_cap_release": 32126 2024-08-31T04:38:40.408 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:40.408 INFO:teuthology.orchestra.run.smithi050.stdout: "mds_cache": { 2024-08-31T04:38:40.408 INFO:teuthology.orchestra.run.smithi050.stdout: "dir_update": 4384, 2024-08-31T04:38:40.408 INFO:teuthology.orchestra.run.smithi050.stdout: "dir_update_receipt": 9671, 2024-08-31T04:38:40.409 INFO:teuthology.orchestra.run.smithi050.stdout: "dir_try_discover": 5728, 2024-08-31T04:38:40.409 INFO:teuthology.orchestra.run.smithi050.stdout: "dir_send_discover": 7588, 2024-08-31T04:38:40.409 INFO:teuthology.orchestra.run.smithi050.stdout: "dir_handle_discover": 6044, 2024-08-31T04:38:40.409 INFO:teuthology.orchestra.run.smithi050.stdout: "num_strays": 0, 2024-08-31T04:38:40.409 INFO:teuthology.orchestra.run.smithi050.stdout: "num_strays_delayed": 0, 2024-08-31T04:38:40.409 INFO:teuthology.orchestra.run.smithi050.stdout: "num_strays_enqueuing": 0, 2024-08-31T04:38:40.409 INFO:teuthology.orchestra.run.smithi050.stdout: "strays_created": 17521, 2024-08-31T04:38:40.409 INFO:teuthology.orchestra.run.smithi050.stdout: "strays_enqueued": 17521, 2024-08-31T04:38:40.409 INFO:teuthology.orchestra.run.smithi050.stdout: "strays_reintegrated": 0, 2024-08-31T04:38:40.409 INFO:teuthology.orchestra.run.smithi050.stdout: "strays_migrated": 0, 2024-08-31T04:38:40.409 INFO:teuthology.orchestra.run.smithi050.stdout: "num_recovering_processing": 0, 2024-08-31T04:38:40.409 INFO:teuthology.orchestra.run.smithi050.stdout: "num_recovering_enqueued": 0, 2024-08-31T04:38:40.409 INFO:teuthology.orchestra.run.smithi050.stdout: "num_recovering_prioritized": 0, 2024-08-31T04:38:40.410 INFO:teuthology.orchestra.run.smithi050.stdout: "recovery_started": 0, 2024-08-31T04:38:40.410 INFO:teuthology.orchestra.run.smithi050.stdout: "recovery_completed": 0, 2024-08-31T04:38:40.410 INFO:teuthology.orchestra.run.smithi050.stdout: "ireq_quiesce_path": 5, 2024-08-31T04:38:40.410 INFO:teuthology.orchestra.run.smithi050.stdout: "ireq_quiesce_inode": 18480, 2024-08-31T04:38:40.410 INFO:teuthology.orchestra.run.smithi050.stdout: "ireq_enqueue_scrub": 0, 2024-08-31T04:38:40.410 INFO:teuthology.orchestra.run.smithi050.stdout: "ireq_exportdir": 192, 2024-08-31T04:38:40.410 INFO:teuthology.orchestra.run.smithi050.stdout: "ireq_flush": 0, 2024-08-31T04:38:40.410 INFO:teuthology.orchestra.run.smithi050.stdout: "ireq_fragmentdir": 52, 2024-08-31T04:38:40.410 INFO:teuthology.orchestra.run.smithi050.stdout: "ireq_fragstats": 0, 2024-08-31T04:38:40.410 INFO:teuthology.orchestra.run.smithi050.stdout: "ireq_inodestats": 0, 2024-08-31T04:38:40.410 INFO:teuthology.orchestra.run.smithi050.stdout: "uninline_started": 0, 2024-08-31T04:38:40.410 INFO:teuthology.orchestra.run.smithi050.stdout: "uninline_succeeded": 0, 2024-08-31T04:38:40.410 INFO:teuthology.orchestra.run.smithi050.stdout: "uninline_write_failed": 0 2024-08-31T04:38:40.411 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:40.411 INFO:teuthology.orchestra.run.smithi050.stdout: "mds_log": { 2024-08-31T04:38:40.411 INFO:teuthology.orchestra.run.smithi050.stdout: "evlrg": 4, 2024-08-31T04:38:40.411 INFO:teuthology.orchestra.run.smithi050.stdout: "evadd": 85342, 2024-08-31T04:38:40.411 INFO:teuthology.orchestra.run.smithi050.stdout: "evex": 0, 2024-08-31T04:38:40.411 INFO:teuthology.orchestra.run.smithi050.stdout: "evtrm": 0, 2024-08-31T04:38:40.411 INFO:teuthology.orchestra.run.smithi050.stdout: "ev": 85342, 2024-08-31T04:38:40.411 INFO:teuthology.orchestra.run.smithi050.stdout: "evexg": 0, 2024-08-31T04:38:40.411 INFO:teuthology.orchestra.run.smithi050.stdout: "evexd": 0, 2024-08-31T04:38:40.411 INFO:teuthology.orchestra.run.smithi050.stdout: "segadd": 108, 2024-08-31T04:38:40.411 INFO:teuthology.orchestra.run.smithi050.stdout: "segex": 0, 2024-08-31T04:38:40.411 INFO:teuthology.orchestra.run.smithi050.stdout: "segtrm": 0, 2024-08-31T04:38:40.411 INFO:teuthology.orchestra.run.smithi050.stdout: "seg": 108, 2024-08-31T04:38:40.412 INFO:teuthology.orchestra.run.smithi050.stdout: "segmjr": 8, 2024-08-31T04:38:40.412 INFO:teuthology.orchestra.run.smithi050.stdout: "segexg": 0, 2024-08-31T04:38:40.412 INFO:teuthology.orchestra.run.smithi050.stdout: "segexd": 0, 2024-08-31T04:38:40.412 INFO:teuthology.orchestra.run.smithi050.stdout: "expos": 4194304, 2024-08-31T04:38:40.412 INFO:teuthology.orchestra.run.smithi050.stdout: "wrpos": 184137191, 2024-08-31T04:38:40.412 INFO:teuthology.orchestra.run.smithi050.stdout: "rdpos": 0, 2024-08-31T04:38:40.412 INFO:teuthology.orchestra.run.smithi050.stdout: "jlat": { 2024-08-31T04:38:40.412 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 2542, 2024-08-31T04:38:40.412 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 544.229539636, 2024-08-31T04:38:40.412 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.214095019 2024-08-31T04:38:40.412 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:40.412 INFO:teuthology.orchestra.run.smithi050.stdout: "replayed": 0 2024-08-31T04:38:40.412 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:40.413 INFO:teuthology.orchestra.run.smithi050.stdout: "mds_mem": { 2024-08-31T04:38:40.413 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 24, 2024-08-31T04:38:40.413 INFO:teuthology.orchestra.run.smithi050.stdout: "ino+": 26336, 2024-08-31T04:38:40.413 INFO:teuthology.orchestra.run.smithi050.stdout: "ino-": 26312, 2024-08-31T04:38:40.413 INFO:teuthology.orchestra.run.smithi050.stdout: "dir": 20, 2024-08-31T04:38:40.413 INFO:teuthology.orchestra.run.smithi050.stdout: "dir+": 5235, 2024-08-31T04:38:40.413 INFO:teuthology.orchestra.run.smithi050.stdout: "dir-": 5215, 2024-08-31T04:38:40.413 INFO:teuthology.orchestra.run.smithi050.stdout: "dn": 17, 2024-08-31T04:38:40.413 INFO:teuthology.orchestra.run.smithi050.stdout: "dn+": 67792, 2024-08-31T04:38:40.413 INFO:teuthology.orchestra.run.smithi050.stdout: "dn-": 67775, 2024-08-31T04:38:40.413 INFO:teuthology.orchestra.run.smithi050.stdout: "cap": 0, 2024-08-31T04:38:40.413 INFO:teuthology.orchestra.run.smithi050.stdout: "cap+": 32734, 2024-08-31T04:38:40.413 INFO:teuthology.orchestra.run.smithi050.stdout: "cap-": 32734, 2024-08-31T04:38:40.413 INFO:teuthology.orchestra.run.smithi050.stdout: "rss": 191956, 2024-08-31T04:38:40.414 INFO:teuthology.orchestra.run.smithi050.stdout: "heap": 521662464 2024-08-31T04:38:40.414 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:40.414 INFO:teuthology.orchestra.run.smithi050.stdout: "mds_server": { 2024-08-31T04:38:40.414 INFO:teuthology.orchestra.run.smithi050.stdout: "dispatch_client_request": 97838, 2024-08-31T04:38:40.414 INFO:teuthology.orchestra.run.smithi050.stdout: "dispatch_server_request": 969, 2024-08-31T04:38:40.414 INFO:teuthology.orchestra.run.smithi050.stdout: "handle_client_request": 94259, 2024-08-31T04:38:40.414 INFO:teuthology.orchestra.run.smithi050.stdout: "handle_client_session": 165, 2024-08-31T04:38:40.414 INFO:teuthology.orchestra.run.smithi050.stdout: "handle_peer_request": 2259, 2024-08-31T04:38:40.414 INFO:teuthology.orchestra.run.smithi050.stdout: "req_create_latency": { 2024-08-31T04:38:40.414 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 8603, 2024-08-31T04:38:40.414 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 551.120289458, 2024-08-31T04:38:40.414 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.064061407 2024-08-31T04:38:40.414 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:40.415 INFO:teuthology.orchestra.run.smithi050.stdout: "req_getattr_latency": { 2024-08-31T04:38:40.415 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 157, 2024-08-31T04:38:40.415 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 4.752654473, 2024-08-31T04:38:40.415 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.030271684 2024-08-31T04:38:40.415 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:40.415 INFO:teuthology.orchestra.run.smithi050.stdout: "req_getfilelock_latency": { 2024-08-31T04:38:40.415 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-08-31T04:38:40.415 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-08-31T04:38:40.415 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-08-31T04:38:40.415 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:40.415 INFO:teuthology.orchestra.run.smithi050.stdout: "req_link_latency": { 2024-08-31T04:38:40.415 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-08-31T04:38:40.416 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-08-31T04:38:40.416 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-08-31T04:38:40.416 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:40.416 INFO:teuthology.orchestra.run.smithi050.stdout: "req_lookup_latency": { 2024-08-31T04:38:40.416 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 44128, 2024-08-31T04:38:40.416 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 913.787322451, 2024-08-31T04:38:40.416 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.020707653 2024-08-31T04:38:40.416 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:40.416 INFO:teuthology.orchestra.run.smithi050.stdout: "req_lookuphash_latency": { 2024-08-31T04:38:40.416 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-08-31T04:38:40.416 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-08-31T04:38:40.416 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-08-31T04:38:40.416 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:40.416 INFO:teuthology.orchestra.run.smithi050.stdout: "req_lookupino_latency": { 2024-08-31T04:38:40.417 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-08-31T04:38:40.417 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-08-31T04:38:40.417 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-08-31T04:38:40.417 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:40.417 INFO:teuthology.orchestra.run.smithi050.stdout: "req_lookupname_latency": { 2024-08-31T04:38:40.417 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-08-31T04:38:40.417 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-08-31T04:38:40.417 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-08-31T04:38:40.417 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:40.417 INFO:teuthology.orchestra.run.smithi050.stdout: "req_lookupparent_latency": { 2024-08-31T04:38:40.417 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-08-31T04:38:40.417 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-08-31T04:38:40.417 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-08-31T04:38:40.418 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:40.418 INFO:teuthology.orchestra.run.smithi050.stdout: "req_lookupsnap_latency": { 2024-08-31T04:38:40.418 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-08-31T04:38:40.418 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-08-31T04:38:40.418 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-08-31T04:38:40.419 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:40.419 INFO:teuthology.orchestra.run.smithi050.stdout: "req_lssnap_latency": { 2024-08-31T04:38:40.419 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-08-31T04:38:40.419 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-08-31T04:38:40.419 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-08-31T04:38:40.419 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:40.419 INFO:teuthology.orchestra.run.smithi050.stdout: "req_mkdir_latency": { 2024-08-31T04:38:40.419 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 50, 2024-08-31T04:38:40.419 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 270.946066694, 2024-08-31T04:38:40.419 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 5.418921333 2024-08-31T04:38:40.419 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:40.419 INFO:teuthology.orchestra.run.smithi050.stdout: "req_mknod_latency": { 2024-08-31T04:38:40.419 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-08-31T04:38:40.420 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-08-31T04:38:40.420 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-08-31T04:38:40.420 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:40.420 INFO:teuthology.orchestra.run.smithi050.stdout: "req_mksnap_latency": { 2024-08-31T04:38:40.420 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-08-31T04:38:40.420 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-08-31T04:38:40.420 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-08-31T04:38:40.420 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:40.420 INFO:teuthology.orchestra.run.smithi050.stdout: "req_open_latency": { 2024-08-31T04:38:40.420 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 6934, 2024-08-31T04:38:40.420 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 84.524326528, 2024-08-31T04:38:40.420 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.012189836 2024-08-31T04:38:40.420 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:40.421 INFO:teuthology.orchestra.run.smithi050.stdout: "req_readdir_latency": { 2024-08-31T04:38:40.421 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 774, 2024-08-31T04:38:40.421 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 2.087592895, 2024-08-31T04:38:40.421 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.002697148 2024-08-31T04:38:40.421 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:40.421 INFO:teuthology.orchestra.run.smithi050.stdout: "req_rename_latency": { 2024-08-31T04:38:40.421 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 8614, 2024-08-31T04:38:40.421 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 452.039598812, 2024-08-31T04:38:40.421 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.052477315 2024-08-31T04:38:40.421 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:40.421 INFO:teuthology.orchestra.run.smithi050.stdout: "req_renamesnap_latency": { 2024-08-31T04:38:40.421 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-08-31T04:38:40.421 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-08-31T04:38:40.422 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-08-31T04:38:40.422 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:40.422 INFO:teuthology.orchestra.run.smithi050.stdout: "req_snapdiff_latency": { 2024-08-31T04:38:40.422 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-08-31T04:38:40.422 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-08-31T04:38:40.422 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-08-31T04:38:40.422 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:40.422 INFO:teuthology.orchestra.run.smithi050.stdout: "req_rmdir_latency": { 2024-08-31T04:38:40.422 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 155, 2024-08-31T04:38:40.422 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 23.174913282, 2024-08-31T04:38:40.422 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.149515569 2024-08-31T04:38:40.422 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:40.422 INFO:teuthology.orchestra.run.smithi050.stdout: "req_rmsnap_latency": { 2024-08-31T04:38:40.423 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-08-31T04:38:40.423 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-08-31T04:38:40.423 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-08-31T04:38:40.423 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:40.423 INFO:teuthology.orchestra.run.smithi050.stdout: "req_rmxattr_latency": { 2024-08-31T04:38:40.423 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-08-31T04:38:40.423 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-08-31T04:38:40.423 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-08-31T04:38:40.423 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:40.423 INFO:teuthology.orchestra.run.smithi050.stdout: "req_setattr_latency": { 2024-08-31T04:38:40.423 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-08-31T04:38:40.423 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-08-31T04:38:40.423 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-08-31T04:38:40.424 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:40.424 INFO:teuthology.orchestra.run.smithi050.stdout: "req_setdirlayout_latency": { 2024-08-31T04:38:40.424 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-08-31T04:38:40.424 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-08-31T04:38:40.424 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-08-31T04:38:40.424 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:40.424 INFO:teuthology.orchestra.run.smithi050.stdout: "req_setfilelock_latency": { 2024-08-31T04:38:40.424 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-08-31T04:38:40.424 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-08-31T04:38:40.424 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-08-31T04:38:40.424 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:40.424 INFO:teuthology.orchestra.run.smithi050.stdout: "req_setlayout_latency": { 2024-08-31T04:38:40.424 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-08-31T04:38:40.425 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-08-31T04:38:40.425 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-08-31T04:38:40.425 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:40.425 INFO:teuthology.orchestra.run.smithi050.stdout: "req_setxattr_latency": { 2024-08-31T04:38:40.425 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-08-31T04:38:40.425 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-08-31T04:38:40.425 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-08-31T04:38:40.425 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:40.425 INFO:teuthology.orchestra.run.smithi050.stdout: "req_symlink_latency": { 2024-08-31T04:38:40.425 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-08-31T04:38:40.425 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-08-31T04:38:40.425 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-08-31T04:38:40.425 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:40.425 INFO:teuthology.orchestra.run.smithi050.stdout: "req_unlink_latency": { 2024-08-31T04:38:40.426 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 16188, 2024-08-31T04:38:40.426 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 22.646255505, 2024-08-31T04:38:40.426 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.001398953 2024-08-31T04:38:40.426 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:40.426 INFO:teuthology.orchestra.run.smithi050.stdout: "cap_revoke_eviction": 0, 2024-08-31T04:38:40.426 INFO:teuthology.orchestra.run.smithi050.stdout: "cap_acquisition_throttle": 0, 2024-08-31T04:38:40.426 INFO:teuthology.orchestra.run.smithi050.stdout: "req_getvxattr_latency": { 2024-08-31T04:38:40.426 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-08-31T04:38:40.426 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-08-31T04:38:40.426 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-08-31T04:38:40.426 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T04:38:40.426 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:40.426 INFO:teuthology.orchestra.run.smithi050.stdout: "mds_sessions": { 2024-08-31T04:38:40.427 INFO:teuthology.orchestra.run.smithi050.stdout: "session_count": 1, 2024-08-31T04:38:40.427 INFO:teuthology.orchestra.run.smithi050.stdout: "session_add": 2, 2024-08-31T04:38:40.427 INFO:teuthology.orchestra.run.smithi050.stdout: "session_remove": 1, 2024-08-31T04:38:40.427 INFO:teuthology.orchestra.run.smithi050.stdout: "sessions_open": 1, 2024-08-31T04:38:40.427 INFO:teuthology.orchestra.run.smithi050.stdout: "sessions_stale": 0, 2024-08-31T04:38:40.427 INFO:teuthology.orchestra.run.smithi050.stdout: "total_load": 7181, 2024-08-31T04:38:40.427 INFO:teuthology.orchestra.run.smithi050.stdout: "average_load": 7181, 2024-08-31T04:38:40.427 INFO:teuthology.orchestra.run.smithi050.stdout: "avg_session_uptime": 829, 2024-08-31T04:38:40.427 INFO:teuthology.orchestra.run.smithi050.stdout: "mdthresh_evicted": 0 2024-08-31T04:38:40.427 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:40.427 INFO:teuthology.orchestra.run.smithi050.stdout: "mempool": { 2024-08-31T04:38:40.427 INFO:teuthology.orchestra.run.smithi050.stdout: "bloom_filter_bytes": 0, 2024-08-31T04:38:40.427 INFO:teuthology.orchestra.run.smithi050.stdout: "bloom_filter_items": 0, 2024-08-31T04:38:40.428 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_alloc_bytes": 0, 2024-08-31T04:38:40.428 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_alloc_items": 0, 2024-08-31T04:38:40.428 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_cache_data_bytes": 0, 2024-08-31T04:38:40.428 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_cache_data_items": 0, 2024-08-31T04:38:40.428 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_cache_onode_bytes": 0, 2024-08-31T04:38:40.428 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_cache_onode_items": 0, 2024-08-31T04:38:40.428 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_cache_meta_bytes": 0, 2024-08-31T04:38:40.428 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_cache_meta_items": 0, 2024-08-31T04:38:40.428 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_cache_other_bytes": 0, 2024-08-31T04:38:40.428 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_cache_other_items": 0, 2024-08-31T04:38:40.428 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_cache_buffer_bytes": 0, 2024-08-31T04:38:40.428 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_cache_buffer_items": 0, 2024-08-31T04:38:40.428 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_extent_bytes": 0, 2024-08-31T04:38:40.428 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_extent_items": 0, 2024-08-31T04:38:40.429 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_blob_bytes": 0, 2024-08-31T04:38:40.429 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_blob_items": 0, 2024-08-31T04:38:40.429 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_shared_blob_bytes": 0, 2024-08-31T04:38:40.429 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_shared_blob_items": 0, 2024-08-31T04:38:40.429 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_inline_bl_bytes": 0, 2024-08-31T04:38:40.429 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_inline_bl_items": 0, 2024-08-31T04:38:40.429 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_fsck_bytes": 0, 2024-08-31T04:38:40.429 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_fsck_items": 0, 2024-08-31T04:38:40.429 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_txc_bytes": 0, 2024-08-31T04:38:40.429 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_txc_items": 0, 2024-08-31T04:38:40.429 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_writing_deferred_bytes": 0, 2024-08-31T04:38:40.429 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_writing_deferred_items": 0, 2024-08-31T04:38:40.429 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_writing_bytes": 0, 2024-08-31T04:38:40.430 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_writing_items": 0, 2024-08-31T04:38:40.430 INFO:teuthology.orchestra.run.smithi050.stdout: "bluefs_bytes": 0, 2024-08-31T04:38:40.430 INFO:teuthology.orchestra.run.smithi050.stdout: "bluefs_items": 0, 2024-08-31T04:38:40.430 INFO:teuthology.orchestra.run.smithi050.stdout: "bluefs_file_reader_bytes": 0, 2024-08-31T04:38:40.430 INFO:teuthology.orchestra.run.smithi050.stdout: "bluefs_file_reader_items": 0, 2024-08-31T04:38:40.430 INFO:teuthology.orchestra.run.smithi050.stdout: "bluefs_file_writer_bytes": 0, 2024-08-31T04:38:40.430 INFO:teuthology.orchestra.run.smithi050.stdout: "bluefs_file_writer_items": 0, 2024-08-31T04:38:40.430 INFO:teuthology.orchestra.run.smithi050.stdout: "buffer_anon_bytes": 289276, 2024-08-31T04:38:40.430 INFO:teuthology.orchestra.run.smithi050.stdout: "buffer_anon_items": 108, 2024-08-31T04:38:40.430 INFO:teuthology.orchestra.run.smithi050.stdout: "buffer_meta_bytes": 264, 2024-08-31T04:38:40.430 INFO:teuthology.orchestra.run.smithi050.stdout: "buffer_meta_items": 3, 2024-08-31T04:38:40.430 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_bytes": 0, 2024-08-31T04:38:40.430 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_items": 0, 2024-08-31T04:38:40.430 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_mapbl_bytes": 0, 2024-08-31T04:38:40.431 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_mapbl_items": 0, 2024-08-31T04:38:40.431 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_pglog_bytes": 0, 2024-08-31T04:38:40.431 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_pglog_items": 0, 2024-08-31T04:38:40.431 INFO:teuthology.orchestra.run.smithi050.stdout: "osdmap_bytes": 7504, 2024-08-31T04:38:40.431 INFO:teuthology.orchestra.run.smithi050.stdout: "osdmap_items": 155, 2024-08-31T04:38:40.431 INFO:teuthology.orchestra.run.smithi050.stdout: "osdmap_mapping_bytes": 0, 2024-08-31T04:38:40.431 INFO:teuthology.orchestra.run.smithi050.stdout: "osdmap_mapping_items": 0, 2024-08-31T04:38:40.431 INFO:teuthology.orchestra.run.smithi050.stdout: "pgmap_bytes": 0, 2024-08-31T04:38:40.431 INFO:teuthology.orchestra.run.smithi050.stdout: "pgmap_items": 0, 2024-08-31T04:38:40.431 INFO:teuthology.orchestra.run.smithi050.stdout: "mds_co_bytes": 92477, 2024-08-31T04:38:40.431 INFO:teuthology.orchestra.run.smithi050.stdout: "mds_co_items": 473, 2024-08-31T04:38:40.431 INFO:teuthology.orchestra.run.smithi050.stdout: "unittest_1_bytes": 0, 2024-08-31T04:38:40.432 INFO:teuthology.orchestra.run.smithi050.stdout: "unittest_1_items": 0, 2024-08-31T04:38:40.432 INFO:teuthology.orchestra.run.smithi050.stdout: "unittest_2_bytes": 0, 2024-08-31T04:38:40.432 INFO:teuthology.orchestra.run.smithi050.stdout: "unittest_2_items": 0 2024-08-31T04:38:40.432 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:40.432 INFO:teuthology.orchestra.run.smithi050.stdout: "objecter": { 2024-08-31T04:38:40.432 INFO:teuthology.orchestra.run.smithi050.stdout: "op_active": 0, 2024-08-31T04:38:40.432 INFO:teuthology.orchestra.run.smithi050.stdout: "op_laggy": 0, 2024-08-31T04:38:40.432 INFO:teuthology.orchestra.run.smithi050.stdout: "op_send": 23311, 2024-08-31T04:38:40.432 INFO:teuthology.orchestra.run.smithi050.stdout: "op_send_bytes": 191209392, 2024-08-31T04:38:40.432 INFO:teuthology.orchestra.run.smithi050.stdout: "op_resend": 27, 2024-08-31T04:38:40.432 INFO:teuthology.orchestra.run.smithi050.stdout: "op_reply": 23311, 2024-08-31T04:38:40.432 INFO:teuthology.orchestra.run.smithi050.stdout: "op_latency": { 2024-08-31T04:38:40.432 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 23311, 2024-08-31T04:38:40.433 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 402.470897898, 2024-08-31T04:38:40.433 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.017265278 2024-08-31T04:38:40.433 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:40.433 INFO:teuthology.orchestra.run.smithi050.stdout: "op_inflight": 0, 2024-08-31T04:38:40.433 INFO:teuthology.orchestra.run.smithi050.stdout: "oplen_avg": { 2024-08-31T04:38:40.433 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 23311, 2024-08-31T04:38:40.433 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 24424 2024-08-31T04:38:40.433 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:40.433 INFO:teuthology.orchestra.run.smithi050.stdout: "op": 23311, 2024-08-31T04:38:40.433 INFO:teuthology.orchestra.run.smithi050.stdout: "op_r": 657, 2024-08-31T04:38:40.433 INFO:teuthology.orchestra.run.smithi050.stdout: "op_w": 22654, 2024-08-31T04:38:40.433 INFO:teuthology.orchestra.run.smithi050.stdout: "op_rmw": 0, 2024-08-31T04:38:40.434 INFO:teuthology.orchestra.run.smithi050.stdout: "op_pg": 0, 2024-08-31T04:38:40.434 INFO:teuthology.orchestra.run.smithi050.stdout: "osdop_stat": 0, 2024-08-31T04:38:40.434 INFO:teuthology.orchestra.run.smithi050.stdout: "osdop_create": 10, 2024-08-31T04:38:40.434 INFO:teuthology.orchestra.run.smithi050.stdout: "osdop_read": 471, 2024-08-31T04:38:40.434 INFO:teuthology.orchestra.run.smithi050.stdout: "osdop_write": 3014, 2024-08-31T04:38:40.434 INFO:teuthology.orchestra.run.smithi050.stdout: "osdop_writefull": 281, 2024-08-31T04:38:40.434 INFO:teuthology.orchestra.run.smithi050.stdout: "osdop_writesame": 0, 2024-08-31T04:38:40.434 INFO:teuthology.orchestra.run.smithi050.stdout: "osdop_append": 0, 2024-08-31T04:38:40.434 INFO:teuthology.orchestra.run.smithi050.stdout: "osdop_zero": 0, 2024-08-31T04:38:40.434 INFO:teuthology.orchestra.run.smithi050.stdout: "osdop_truncate": 51, 2024-08-31T04:38:40.434 INFO:teuthology.orchestra.run.smithi050.stdout: "osdop_delete": 18487, 2024-08-31T04:38:40.434 INFO:teuthology.orchestra.run.smithi050.stdout: "osdop_mapext": 0, 2024-08-31T04:38:40.434 INFO:teuthology.orchestra.run.smithi050.stdout: "osdop_sparse_read": 0, 2024-08-31T04:38:40.435 INFO:teuthology.orchestra.run.smithi050.stdout: "osdop_clonerange": 0, 2024-08-31T04:38:40.435 INFO:teuthology.orchestra.run.smithi050.stdout: "osdop_getxattr": 1, 2024-08-31T04:38:40.435 INFO:teuthology.orchestra.run.smithi050.stdout: "osdop_setxattr": 20, 2024-08-31T04:38:40.435 INFO:teuthology.orchestra.run.smithi050.stdout: "osdop_cmpxattr": 0, 2024-08-31T04:38:40.435 INFO:teuthology.orchestra.run.smithi050.stdout: "osdop_rmxattr": 0, 2024-08-31T04:38:40.435 INFO:teuthology.orchestra.run.smithi050.stdout: "osdop_resetxattrs": 0, 2024-08-31T04:38:40.435 INFO:teuthology.orchestra.run.smithi050.stdout: "osdop_call": 0, 2024-08-31T04:38:40.435 INFO:teuthology.orchestra.run.smithi050.stdout: "osdop_watch": 0, 2024-08-31T04:38:40.435 INFO:teuthology.orchestra.run.smithi050.stdout: "osdop_notify": 0, 2024-08-31T04:38:40.435 INFO:teuthology.orchestra.run.smithi050.stdout: "osdop_src_cmpxattr": 0, 2024-08-31T04:38:40.435 INFO:teuthology.orchestra.run.smithi050.stdout: "osdop_pgls": 0, 2024-08-31T04:38:40.435 INFO:teuthology.orchestra.run.smithi050.stdout: "osdop_pgls_filter": 0, 2024-08-31T04:38:40.435 INFO:teuthology.orchestra.run.smithi050.stdout: "osdop_other": 0, 2024-08-31T04:38:40.436 INFO:teuthology.orchestra.run.smithi050.stdout: "linger_active": 0, 2024-08-31T04:38:40.436 INFO:teuthology.orchestra.run.smithi050.stdout: "linger_send": 0, 2024-08-31T04:38:40.436 INFO:teuthology.orchestra.run.smithi050.stdout: "linger_resend": 0, 2024-08-31T04:38:40.436 INFO:teuthology.orchestra.run.smithi050.stdout: "linger_ping": 0, 2024-08-31T04:38:40.436 INFO:teuthology.orchestra.run.smithi050.stdout: "poolop_active": 0, 2024-08-31T04:38:40.436 INFO:teuthology.orchestra.run.smithi050.stdout: "poolop_send": 0, 2024-08-31T04:38:40.436 INFO:teuthology.orchestra.run.smithi050.stdout: "poolop_resend": 0, 2024-08-31T04:38:40.436 INFO:teuthology.orchestra.run.smithi050.stdout: "poolstat_active": 0, 2024-08-31T04:38:40.436 INFO:teuthology.orchestra.run.smithi050.stdout: "poolstat_send": 0, 2024-08-31T04:38:40.436 INFO:teuthology.orchestra.run.smithi050.stdout: "poolstat_resend": 0, 2024-08-31T04:38:40.436 INFO:teuthology.orchestra.run.smithi050.stdout: "statfs_active": 0, 2024-08-31T04:38:40.436 INFO:teuthology.orchestra.run.smithi050.stdout: "statfs_send": 0, 2024-08-31T04:38:40.436 INFO:teuthology.orchestra.run.smithi050.stdout: "statfs_resend": 0, 2024-08-31T04:38:40.437 INFO:teuthology.orchestra.run.smithi050.stdout: "command_active": 0, 2024-08-31T04:38:40.437 INFO:teuthology.orchestra.run.smithi050.stdout: "command_send": 0, 2024-08-31T04:38:40.437 INFO:teuthology.orchestra.run.smithi050.stdout: "command_resend": 0, 2024-08-31T04:38:40.437 INFO:teuthology.orchestra.run.smithi050.stdout: "map_epoch": 80, 2024-08-31T04:38:40.437 INFO:teuthology.orchestra.run.smithi050.stdout: "map_full": 0, 2024-08-31T04:38:40.437 INFO:teuthology.orchestra.run.smithi050.stdout: "map_inc": 4, 2024-08-31T04:38:40.437 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_sessions": 12, 2024-08-31T04:38:40.437 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_session_open": 12, 2024-08-31T04:38:40.437 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_session_close": 0, 2024-08-31T04:38:40.437 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_laggy": 0, 2024-08-31T04:38:40.437 INFO:teuthology.orchestra.run.smithi050.stdout: "omap_wr": 1569, 2024-08-31T04:38:40.437 INFO:teuthology.orchestra.run.smithi050.stdout: "omap_rd": 260, 2024-08-31T04:38:40.437 INFO:teuthology.orchestra.run.smithi050.stdout: "omap_del": 260 2024-08-31T04:38:40.437 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:40.438 INFO:teuthology.orchestra.run.smithi050.stdout: "oft": { 2024-08-31T04:38:40.438 INFO:teuthology.orchestra.run.smithi050.stdout: "omap_total_objs": 1, 2024-08-31T04:38:40.438 INFO:teuthology.orchestra.run.smithi050.stdout: "omap_total_kv_pairs": 0, 2024-08-31T04:38:40.438 INFO:teuthology.orchestra.run.smithi050.stdout: "omap_total_updates": 0, 2024-08-31T04:38:40.438 INFO:teuthology.orchestra.run.smithi050.stdout: "omap_total_removes": 0 2024-08-31T04:38:40.438 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:40.438 INFO:teuthology.orchestra.run.smithi050.stdout: "purge_queue": { 2024-08-31T04:38:40.438 INFO:teuthology.orchestra.run.smithi050.stdout: "pq_executing_ops": 0, 2024-08-31T04:38:40.438 INFO:teuthology.orchestra.run.smithi050.stdout: "pq_executing_ops_high_water": 14, 2024-08-31T04:38:40.438 INFO:teuthology.orchestra.run.smithi050.stdout: "pq_executing": 0, 2024-08-31T04:38:40.438 INFO:teuthology.orchestra.run.smithi050.stdout: "pq_executing_high_water": 6, 2024-08-31T04:38:40.438 INFO:teuthology.orchestra.run.smithi050.stdout: "pq_executed_ops": 18425, 2024-08-31T04:38:40.438 INFO:teuthology.orchestra.run.smithi050.stdout: "pq_executed": 17521, 2024-08-31T04:38:40.439 INFO:teuthology.orchestra.run.smithi050.stdout: "pq_item_in_journal": 0 2024-08-31T04:38:40.439 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:40.439 INFO:teuthology.orchestra.run.smithi050.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-08-31T04:38:40.439 INFO:teuthology.orchestra.run.smithi050.stdout: "val": 0, 2024-08-31T04:38:40.439 INFO:teuthology.orchestra.run.smithi050.stdout: "max": 104857600, 2024-08-31T04:38:40.439 INFO:teuthology.orchestra.run.smithi050.stdout: "get_started": 0, 2024-08-31T04:38:40.439 INFO:teuthology.orchestra.run.smithi050.stdout: "get": 232481, 2024-08-31T04:38:40.439 INFO:teuthology.orchestra.run.smithi050.stdout: "get_sum": 76170565, 2024-08-31T04:38:40.439 INFO:teuthology.orchestra.run.smithi050.stdout: "get_or_fail_fail": 0, 2024-08-31T04:38:40.439 INFO:teuthology.orchestra.run.smithi050.stdout: "get_or_fail_success": 232481, 2024-08-31T04:38:40.439 INFO:teuthology.orchestra.run.smithi050.stdout: "take": 0, 2024-08-31T04:38:40.439 INFO:teuthology.orchestra.run.smithi050.stdout: "take_sum": 0, 2024-08-31T04:38:40.439 INFO:teuthology.orchestra.run.smithi050.stdout: "put": 232481, 2024-08-31T04:38:40.440 INFO:teuthology.orchestra.run.smithi050.stdout: "put_sum": 76170565, 2024-08-31T04:38:40.440 INFO:teuthology.orchestra.run.smithi050.stdout: "wait": { 2024-08-31T04:38:40.440 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-08-31T04:38:40.440 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-08-31T04:38:40.440 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-08-31T04:38:40.440 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T04:38:40.440 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:40.440 INFO:teuthology.orchestra.run.smithi050.stdout: "throttle-objecter_bytes": { 2024-08-31T04:38:40.440 INFO:teuthology.orchestra.run.smithi050.stdout: "val": 0, 2024-08-31T04:38:40.440 INFO:teuthology.orchestra.run.smithi050.stdout: "max": 104857600, 2024-08-31T04:38:40.440 INFO:teuthology.orchestra.run.smithi050.stdout: "get_started": 0, 2024-08-31T04:38:40.440 INFO:teuthology.orchestra.run.smithi050.stdout: "get": 0, 2024-08-31T04:38:40.440 INFO:teuthology.orchestra.run.smithi050.stdout: "get_sum": 0, 2024-08-31T04:38:40.440 INFO:teuthology.orchestra.run.smithi050.stdout: "get_or_fail_fail": 0, 2024-08-31T04:38:40.441 INFO:teuthology.orchestra.run.smithi050.stdout: "get_or_fail_success": 0, 2024-08-31T04:38:40.441 INFO:teuthology.orchestra.run.smithi050.stdout: "take": 23311, 2024-08-31T04:38:40.441 INFO:teuthology.orchestra.run.smithi050.stdout: "take_sum": 192974825, 2024-08-31T04:38:40.441 INFO:teuthology.orchestra.run.smithi050.stdout: "put": 23311, 2024-08-31T04:38:40.441 INFO:teuthology.orchestra.run.smithi050.stdout: "put_sum": 192974825, 2024-08-31T04:38:40.441 INFO:teuthology.orchestra.run.smithi050.stdout: "wait": { 2024-08-31T04:38:40.441 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-08-31T04:38:40.441 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-08-31T04:38:40.441 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-08-31T04:38:40.441 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T04:38:40.441 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:40.441 INFO:teuthology.orchestra.run.smithi050.stdout: "throttle-objecter_ops": { 2024-08-31T04:38:40.441 INFO:teuthology.orchestra.run.smithi050.stdout: "val": 0, 2024-08-31T04:38:40.442 INFO:teuthology.orchestra.run.smithi050.stdout: "max": 1024, 2024-08-31T04:38:40.442 INFO:teuthology.orchestra.run.smithi050.stdout: "get_started": 0, 2024-08-31T04:38:40.442 INFO:teuthology.orchestra.run.smithi050.stdout: "get": 0, 2024-08-31T04:38:40.442 INFO:teuthology.orchestra.run.smithi050.stdout: "get_sum": 0, 2024-08-31T04:38:40.442 INFO:teuthology.orchestra.run.smithi050.stdout: "get_or_fail_fail": 0, 2024-08-31T04:38:40.442 INFO:teuthology.orchestra.run.smithi050.stdout: "get_or_fail_success": 0, 2024-08-31T04:38:40.442 INFO:teuthology.orchestra.run.smithi050.stdout: "take": 23311, 2024-08-31T04:38:40.442 INFO:teuthology.orchestra.run.smithi050.stdout: "take_sum": 23311, 2024-08-31T04:38:40.442 INFO:teuthology.orchestra.run.smithi050.stdout: "put": 23311, 2024-08-31T04:38:40.442 INFO:teuthology.orchestra.run.smithi050.stdout: "put_sum": 23311, 2024-08-31T04:38:40.442 INFO:teuthology.orchestra.run.smithi050.stdout: "wait": { 2024-08-31T04:38:40.442 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-08-31T04:38:40.442 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-08-31T04:38:40.443 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-08-31T04:38:40.443 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T04:38:40.443 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:40.443 INFO:teuthology.orchestra.run.smithi050.stdout: "throttle-write_buf_throttle": { 2024-08-31T04:38:40.443 INFO:teuthology.orchestra.run.smithi050.stdout: "val": 0, 2024-08-31T04:38:40.443 INFO:teuthology.orchestra.run.smithi050.stdout: "max": 3758096384, 2024-08-31T04:38:40.443 INFO:teuthology.orchestra.run.smithi050.stdout: "get_started": 0, 2024-08-31T04:38:40.443 INFO:teuthology.orchestra.run.smithi050.stdout: "get": 17521, 2024-08-31T04:38:40.443 INFO:teuthology.orchestra.run.smithi050.stdout: "get_sum": 1770525, 2024-08-31T04:38:40.443 INFO:teuthology.orchestra.run.smithi050.stdout: "get_or_fail_fail": 0, 2024-08-31T04:38:40.443 INFO:teuthology.orchestra.run.smithi050.stdout: "get_or_fail_success": 17521, 2024-08-31T04:38:40.443 INFO:teuthology.orchestra.run.smithi050.stdout: "take": 0, 2024-08-31T04:38:40.443 INFO:teuthology.orchestra.run.smithi050.stdout: "take_sum": 0, 2024-08-31T04:38:40.443 INFO:teuthology.orchestra.run.smithi050.stdout: "put": 472, 2024-08-31T04:38:40.444 INFO:teuthology.orchestra.run.smithi050.stdout: "put_sum": 1770525, 2024-08-31T04:38:40.444 INFO:teuthology.orchestra.run.smithi050.stdout: "wait": { 2024-08-31T04:38:40.444 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-08-31T04:38:40.444 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-08-31T04:38:40.444 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-08-31T04:38:40.444 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T04:38:40.444 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:40.444 INFO:teuthology.orchestra.run.smithi050.stdout: "throttle-write_buf_throttle-0x55c23db4a5b0": { 2024-08-31T04:38:40.444 INFO:teuthology.orchestra.run.smithi050.stdout: "val": 0, 2024-08-31T04:38:40.444 INFO:teuthology.orchestra.run.smithi050.stdout: "max": 3758096384, 2024-08-31T04:38:40.444 INFO:teuthology.orchestra.run.smithi050.stdout: "get_started": 0, 2024-08-31T04:38:40.444 INFO:teuthology.orchestra.run.smithi050.stdout: "get": 85342, 2024-08-31T04:38:40.444 INFO:teuthology.orchestra.run.smithi050.stdout: "get_sum": 179942887, 2024-08-31T04:38:40.445 INFO:teuthology.orchestra.run.smithi050.stdout: "get_or_fail_fail": 0, 2024-08-31T04:38:40.445 INFO:teuthology.orchestra.run.smithi050.stdout: "get_or_fail_success": 85342, 2024-08-31T04:38:40.445 INFO:teuthology.orchestra.run.smithi050.stdout: "take": 0, 2024-08-31T04:38:40.445 INFO:teuthology.orchestra.run.smithi050.stdout: "take_sum": 0, 2024-08-31T04:38:40.445 INFO:teuthology.orchestra.run.smithi050.stdout: "put": 2542, 2024-08-31T04:38:40.445 INFO:teuthology.orchestra.run.smithi050.stdout: "put_sum": 179942887, 2024-08-31T04:38:40.445 INFO:teuthology.orchestra.run.smithi050.stdout: "wait": { 2024-08-31T04:38:40.445 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-08-31T04:38:40.445 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-08-31T04:38:40.445 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-08-31T04:38:40.445 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T04:38:40.445 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:40.445 INFO:teuthology.orchestra.run.smithi050.stdout: "trackedop": { 2024-08-31T04:38:40.446 INFO:teuthology.orchestra.run.smithi050.stdout: "slow_ops_count": 18493 2024-08-31T04:38:40.446 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T04:38:40.446 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-08-31T04:38:41.277 INFO:tasks.check_counter:Daemon mds.a mds.exported=191 2024-08-31T04:38:41.277 INFO:tasks.check_counter:Daemon mds.a mds.imported=259 2024-08-31T04:38:41.277 INFO:tasks.check_counter:Daemon mds.a mds_cache.dir_update=4384 2024-08-31T04:38:41.277 INFO:tasks.check_counter:Daemon mds.a mds_cache.dir_update_receipt=9671 2024-08-31T04:38:41.278 INFO:tasks.check_counter:Daemon mds.a mds.dir_split=51 2024-08-31T04:38:41.278 DEBUG:tasks.check_counter:Getting stats from d 2024-08-31T04:38:41.278 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 058d9fc6-674f-11ef-bcd4-c7b262605968 -- ceph daemon mds.d perf dump 2024-08-31T04:38:41.660 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:38:41.840 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:38:41 smithi050 ceph-mon[17259]: pgmap v842: 97 pgs: 97 active+clean; 592 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 546 KiB/s rd, 514 KiB/s wr, 176 op/s 2024-08-31T04:38:41.996 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:38:41 smithi177 ceph-mon[22025]: pgmap v842: 97 pgs: 97 active+clean; 592 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 546 KiB/s rd, 514 KiB/s wr, 176 op/s 2024-08-31T04:38:42.043 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:38:41 smithi133 ceph-mon[22177]: pgmap v842: 97 pgs: 97 active+clean; 592 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 546 KiB/s rd, 514 KiB/s wr, 176 op/s 2024-08-31T04:38:42.405 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-08-31T04:38:42.405 INFO:teuthology.orchestra.run.smithi050.stdout: "AsyncMessenger::Worker-0": { 2024-08-31T04:38:42.405 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_recv_messages": 727, 2024-08-31T04:38:42.405 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_send_messages": 729, 2024-08-31T04:38:42.406 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_recv_bytes": 49191205, 2024-08-31T04:38:42.406 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_send_bytes": 231193, 2024-08-31T04:38:42.406 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_created_connections": 7, 2024-08-31T04:38:42.406 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_active_connections": 3, 2024-08-31T04:38:42.406 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_running_total_time": 0.149227419, 2024-08-31T04:38:42.406 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_running_send_time": 0.036778218, 2024-08-31T04:38:42.406 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_running_recv_time": 0.084278873, 2024-08-31T04:38:42.406 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_running_fast_dispatch_time": 0.019604296, 2024-08-31T04:38:42.406 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_send_messages_queue_lat": { 2024-08-31T04:38:42.406 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 727, 2024-08-31T04:38:42.406 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.039589122, 2024-08-31T04:38:42.406 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000054455 2024-08-31T04:38:42.406 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:42.407 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_handle_ack_lat": { 2024-08-31T04:38:42.407 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-08-31T04:38:42.407 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-08-31T04:38:42.407 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-08-31T04:38:42.407 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:42.407 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_recv_encrypted_bytes": 0, 2024-08-31T04:38:42.407 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_send_encrypted_bytes": 0 2024-08-31T04:38:42.407 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:42.407 INFO:teuthology.orchestra.run.smithi050.stdout: "AsyncMessenger::Worker-1": { 2024-08-31T04:38:42.407 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_recv_messages": 903, 2024-08-31T04:38:42.407 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_send_messages": 1009, 2024-08-31T04:38:42.407 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_recv_bytes": 29641542, 2024-08-31T04:38:42.407 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_send_bytes": 566705, 2024-08-31T04:38:42.408 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_created_connections": 6, 2024-08-31T04:38:42.408 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_active_connections": 5, 2024-08-31T04:38:42.408 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_running_total_time": 0.165027338, 2024-08-31T04:38:42.408 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_running_send_time": 0.057143575, 2024-08-31T04:38:42.408 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_running_recv_time": 0.069988594, 2024-08-31T04:38:42.408 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_running_fast_dispatch_time": 0.027925653, 2024-08-31T04:38:42.408 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_send_messages_queue_lat": { 2024-08-31T04:38:42.408 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 1007, 2024-08-31T04:38:42.408 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.050863517, 2024-08-31T04:38:42.408 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000050509 2024-08-31T04:38:42.408 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:42.408 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_handle_ack_lat": { 2024-08-31T04:38:42.408 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-08-31T04:38:42.409 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-08-31T04:38:42.409 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-08-31T04:38:42.409 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:42.409 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_recv_encrypted_bytes": 160, 2024-08-31T04:38:42.409 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_send_encrypted_bytes": 279808 2024-08-31T04:38:42.409 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:42.409 INFO:teuthology.orchestra.run.smithi050.stdout: "AsyncMessenger::Worker-2": { 2024-08-31T04:38:42.409 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_recv_messages": 363, 2024-08-31T04:38:42.409 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_send_messages": 330, 2024-08-31T04:38:42.409 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_recv_bytes": 17241526, 2024-08-31T04:38:42.409 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_send_bytes": 145119, 2024-08-31T04:38:42.409 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_created_connections": 5, 2024-08-31T04:38:42.409 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_active_connections": 4, 2024-08-31T04:38:42.410 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_running_total_time": 0.072632565, 2024-08-31T04:38:42.410 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_running_send_time": 0.019537947, 2024-08-31T04:38:42.410 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_running_recv_time": 0.049076937, 2024-08-31T04:38:42.410 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_running_fast_dispatch_time": 0.005869576, 2024-08-31T04:38:42.410 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_send_messages_queue_lat": { 2024-08-31T04:38:42.410 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 330, 2024-08-31T04:38:42.410 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.028781391, 2024-08-31T04:38:42.410 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000087216 2024-08-31T04:38:42.410 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:42.410 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_handle_ack_lat": { 2024-08-31T04:38:42.410 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-08-31T04:38:42.410 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-08-31T04:38:42.410 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-08-31T04:38:42.411 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:42.411 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_recv_encrypted_bytes": 416672, 2024-08-31T04:38:42.411 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_send_encrypted_bytes": 87552 2024-08-31T04:38:42.411 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:42.411 INFO:teuthology.orchestra.run.smithi050.stdout: "cct": { 2024-08-31T04:38:42.411 INFO:teuthology.orchestra.run.smithi050.stdout: "total_workers": 1, 2024-08-31T04:38:42.411 INFO:teuthology.orchestra.run.smithi050.stdout: "unhealthy_workers": 0 2024-08-31T04:38:42.411 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:42.411 INFO:teuthology.orchestra.run.smithi050.stdout: "finisher-MDSRank": { 2024-08-31T04:38:42.411 INFO:teuthology.orchestra.run.smithi050.stdout: "queue_len": 0, 2024-08-31T04:38:42.411 INFO:teuthology.orchestra.run.smithi050.stdout: "complete_latency": { 2024-08-31T04:38:42.411 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 2972, 2024-08-31T04:38:42.411 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.249866343, 2024-08-31T04:38:42.411 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000084073 2024-08-31T04:38:42.412 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T04:38:42.412 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:42.412 INFO:teuthology.orchestra.run.smithi050.stdout: "finisher-PurgeQueue": { 2024-08-31T04:38:42.412 INFO:teuthology.orchestra.run.smithi050.stdout: "queue_len": 0, 2024-08-31T04:38:42.412 INFO:teuthology.orchestra.run.smithi050.stdout: "complete_latency": { 2024-08-31T04:38:42.412 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-08-31T04:38:42.412 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-08-31T04:38:42.412 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-08-31T04:38:42.412 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T04:38:42.412 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:42.412 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": { 2024-08-31T04:38:42.412 INFO:teuthology.orchestra.run.smithi050.stdout: "request": 0, 2024-08-31T04:38:42.412 INFO:teuthology.orchestra.run.smithi050.stdout: "reply": 0, 2024-08-31T04:38:42.412 INFO:teuthology.orchestra.run.smithi050.stdout: "reply_latency": { 2024-08-31T04:38:42.413 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-08-31T04:38:42.413 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-08-31T04:38:42.413 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-08-31T04:38:42.413 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:42.413 INFO:teuthology.orchestra.run.smithi050.stdout: "slow_reply": 0, 2024-08-31T04:38:42.413 INFO:teuthology.orchestra.run.smithi050.stdout: "forward": 0, 2024-08-31T04:38:42.413 INFO:teuthology.orchestra.run.smithi050.stdout: "dir_fetch_complete": 0, 2024-08-31T04:38:42.413 INFO:teuthology.orchestra.run.smithi050.stdout: "dir_fetch_keys": 0, 2024-08-31T04:38:42.413 INFO:teuthology.orchestra.run.smithi050.stdout: "dir_commit": 0, 2024-08-31T04:38:42.413 INFO:teuthology.orchestra.run.smithi050.stdout: "dir_split": 0, 2024-08-31T04:38:42.413 INFO:teuthology.orchestra.run.smithi050.stdout: "dir_merge": 0, 2024-08-31T04:38:42.413 INFO:teuthology.orchestra.run.smithi050.stdout: "inodes": 14786, 2024-08-31T04:38:42.413 INFO:teuthology.orchestra.run.smithi050.stdout: "inodes_top": 10338, 2024-08-31T04:38:42.413 INFO:teuthology.orchestra.run.smithi050.stdout: "inodes_bottom": 4448, 2024-08-31T04:38:42.414 INFO:teuthology.orchestra.run.smithi050.stdout: "inodes_pin_tail": 0, 2024-08-31T04:38:42.414 INFO:teuthology.orchestra.run.smithi050.stdout: "inodes_pinned": 17, 2024-08-31T04:38:42.414 INFO:teuthology.orchestra.run.smithi050.stdout: "inodes_expired": 0, 2024-08-31T04:38:42.414 INFO:teuthology.orchestra.run.smithi050.stdout: "inodes_with_caps": 0, 2024-08-31T04:38:42.414 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": 0, 2024-08-31T04:38:42.414 INFO:teuthology.orchestra.run.smithi050.stdout: "subtrees": 2, 2024-08-31T04:38:42.414 INFO:teuthology.orchestra.run.smithi050.stdout: "traverse": 0, 2024-08-31T04:38:42.414 INFO:teuthology.orchestra.run.smithi050.stdout: "traverse_hit": 0, 2024-08-31T04:38:42.414 INFO:teuthology.orchestra.run.smithi050.stdout: "traverse_forward": 0, 2024-08-31T04:38:42.414 INFO:teuthology.orchestra.run.smithi050.stdout: "traverse_discover": 0, 2024-08-31T04:38:42.414 INFO:teuthology.orchestra.run.smithi050.stdout: "traverse_dir_fetch": 0, 2024-08-31T04:38:42.414 INFO:teuthology.orchestra.run.smithi050.stdout: "traverse_remote_ino": 0, 2024-08-31T04:38:42.414 INFO:teuthology.orchestra.run.smithi050.stdout: "traverse_lock": 0, 2024-08-31T04:38:42.414 INFO:teuthology.orchestra.run.smithi050.stdout: "load_cent": 0, 2024-08-31T04:38:42.415 INFO:teuthology.orchestra.run.smithi050.stdout: "q": 0, 2024-08-31T04:38:42.415 INFO:teuthology.orchestra.run.smithi050.stdout: "exported": 0, 2024-08-31T04:38:42.415 INFO:teuthology.orchestra.run.smithi050.stdout: "exported_inodes": 0, 2024-08-31T04:38:42.415 INFO:teuthology.orchestra.run.smithi050.stdout: "imported": 0, 2024-08-31T04:38:42.415 INFO:teuthology.orchestra.run.smithi050.stdout: "imported_inodes": 0, 2024-08-31T04:38:42.415 INFO:teuthology.orchestra.run.smithi050.stdout: "openino_dir_fetch": 0, 2024-08-31T04:38:42.415 INFO:teuthology.orchestra.run.smithi050.stdout: "openino_backtrace_fetch": 0, 2024-08-31T04:38:42.415 INFO:teuthology.orchestra.run.smithi050.stdout: "openino_peer_discover": 0, 2024-08-31T04:38:42.415 INFO:teuthology.orchestra.run.smithi050.stdout: "root_rfiles": 4, 2024-08-31T04:38:42.415 INFO:teuthology.orchestra.run.smithi050.stdout: "root_rbytes": 234, 2024-08-31T04:38:42.415 INFO:teuthology.orchestra.run.smithi050.stdout: "root_rsnaps": 0, 2024-08-31T04:38:42.415 INFO:teuthology.orchestra.run.smithi050.stdout: "scrub_backtrace_fetch": 0, 2024-08-31T04:38:42.415 INFO:teuthology.orchestra.run.smithi050.stdout: "scrub_set_tag": 0, 2024-08-31T04:38:42.415 INFO:teuthology.orchestra.run.smithi050.stdout: "scrub_backtrace_repaired": 0, 2024-08-31T04:38:42.416 INFO:teuthology.orchestra.run.smithi050.stdout: "scrub_inotable_repaired": 0, 2024-08-31T04:38:42.416 INFO:teuthology.orchestra.run.smithi050.stdout: "scrub_dir_inodes": 0, 2024-08-31T04:38:42.416 INFO:teuthology.orchestra.run.smithi050.stdout: "scrub_dir_base_inodes": 0, 2024-08-31T04:38:42.416 INFO:teuthology.orchestra.run.smithi050.stdout: "scrub_dirfrag_rstats": 0, 2024-08-31T04:38:42.416 INFO:teuthology.orchestra.run.smithi050.stdout: "scrub_file_inodes": 0, 2024-08-31T04:38:42.416 INFO:teuthology.orchestra.run.smithi050.stdout: "handle_inode_file_caps": 0, 2024-08-31T04:38:42.416 INFO:teuthology.orchestra.run.smithi050.stdout: "ceph_cap_op_revoke": 0, 2024-08-31T04:38:42.416 INFO:teuthology.orchestra.run.smithi050.stdout: "ceph_cap_op_grant": 0, 2024-08-31T04:38:42.416 INFO:teuthology.orchestra.run.smithi050.stdout: "ceph_cap_op_trunc": 0, 2024-08-31T04:38:42.416 INFO:teuthology.orchestra.run.smithi050.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-08-31T04:38:42.416 INFO:teuthology.orchestra.run.smithi050.stdout: "ceph_cap_op_flush_ack": 0, 2024-08-31T04:38:42.416 INFO:teuthology.orchestra.run.smithi050.stdout: "handle_client_caps": 0, 2024-08-31T04:38:42.416 INFO:teuthology.orchestra.run.smithi050.stdout: "handle_client_caps_dirty": 0, 2024-08-31T04:38:42.416 INFO:teuthology.orchestra.run.smithi050.stdout: "handle_client_cap_release": 0, 2024-08-31T04:38:42.416 INFO:teuthology.orchestra.run.smithi050.stdout: "process_request_cap_release": 0 2024-08-31T04:38:42.417 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:42.417 INFO:teuthology.orchestra.run.smithi050.stdout: "mds_cache": { 2024-08-31T04:38:42.417 INFO:teuthology.orchestra.run.smithi050.stdout: "dir_update": 0, 2024-08-31T04:38:42.417 INFO:teuthology.orchestra.run.smithi050.stdout: "dir_update_receipt": 0, 2024-08-31T04:38:42.417 INFO:teuthology.orchestra.run.smithi050.stdout: "dir_try_discover": 0, 2024-08-31T04:38:42.417 INFO:teuthology.orchestra.run.smithi050.stdout: "dir_send_discover": 0, 2024-08-31T04:38:42.417 INFO:teuthology.orchestra.run.smithi050.stdout: "dir_handle_discover": 0, 2024-08-31T04:38:42.417 INFO:teuthology.orchestra.run.smithi050.stdout: "num_strays": 0, 2024-08-31T04:38:42.417 INFO:teuthology.orchestra.run.smithi050.stdout: "num_strays_delayed": 0, 2024-08-31T04:38:42.417 INFO:teuthology.orchestra.run.smithi050.stdout: "num_strays_enqueuing": 0, 2024-08-31T04:38:42.417 INFO:teuthology.orchestra.run.smithi050.stdout: "strays_created": 0, 2024-08-31T04:38:42.417 INFO:teuthology.orchestra.run.smithi050.stdout: "strays_enqueued": 0, 2024-08-31T04:38:42.417 INFO:teuthology.orchestra.run.smithi050.stdout: "strays_reintegrated": 0, 2024-08-31T04:38:42.417 INFO:teuthology.orchestra.run.smithi050.stdout: "strays_migrated": 0, 2024-08-31T04:38:42.417 INFO:teuthology.orchestra.run.smithi050.stdout: "num_recovering_processing": 0, 2024-08-31T04:38:42.418 INFO:teuthology.orchestra.run.smithi050.stdout: "num_recovering_enqueued": 0, 2024-08-31T04:38:42.418 INFO:teuthology.orchestra.run.smithi050.stdout: "num_recovering_prioritized": 0, 2024-08-31T04:38:42.418 INFO:teuthology.orchestra.run.smithi050.stdout: "recovery_started": 0, 2024-08-31T04:38:42.418 INFO:teuthology.orchestra.run.smithi050.stdout: "recovery_completed": 0, 2024-08-31T04:38:42.418 INFO:teuthology.orchestra.run.smithi050.stdout: "ireq_quiesce_path": 0, 2024-08-31T04:38:42.418 INFO:teuthology.orchestra.run.smithi050.stdout: "ireq_quiesce_inode": 0, 2024-08-31T04:38:42.418 INFO:teuthology.orchestra.run.smithi050.stdout: "ireq_enqueue_scrub": 0, 2024-08-31T04:38:42.418 INFO:teuthology.orchestra.run.smithi050.stdout: "ireq_exportdir": 0, 2024-08-31T04:38:42.418 INFO:teuthology.orchestra.run.smithi050.stdout: "ireq_flush": 0, 2024-08-31T04:38:42.418 INFO:teuthology.orchestra.run.smithi050.stdout: "ireq_fragmentdir": 0, 2024-08-31T04:38:42.418 INFO:teuthology.orchestra.run.smithi050.stdout: "ireq_fragstats": 0, 2024-08-31T04:38:42.418 INFO:teuthology.orchestra.run.smithi050.stdout: "ireq_inodestats": 0, 2024-08-31T04:38:42.418 INFO:teuthology.orchestra.run.smithi050.stdout: "uninline_started": 0, 2024-08-31T04:38:42.418 INFO:teuthology.orchestra.run.smithi050.stdout: "uninline_succeeded": 0, 2024-08-31T04:38:42.418 INFO:teuthology.orchestra.run.smithi050.stdout: "uninline_write_failed": 0 2024-08-31T04:38:42.419 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:42.419 INFO:teuthology.orchestra.run.smithi050.stdout: "mds_log": { 2024-08-31T04:38:42.419 INFO:teuthology.orchestra.run.smithi050.stdout: "evlrg": 0, 2024-08-31T04:38:42.419 INFO:teuthology.orchestra.run.smithi050.stdout: "evadd": 0, 2024-08-31T04:38:42.419 INFO:teuthology.orchestra.run.smithi050.stdout: "evex": 0, 2024-08-31T04:38:42.419 INFO:teuthology.orchestra.run.smithi050.stdout: "evtrm": 0, 2024-08-31T04:38:42.419 INFO:teuthology.orchestra.run.smithi050.stdout: "ev": 43940, 2024-08-31T04:38:42.419 INFO:teuthology.orchestra.run.smithi050.stdout: "evexg": 0, 2024-08-31T04:38:42.419 INFO:teuthology.orchestra.run.smithi050.stdout: "evexd": 0, 2024-08-31T04:38:42.419 INFO:teuthology.orchestra.run.smithi050.stdout: "segadd": 0, 2024-08-31T04:38:42.419 INFO:teuthology.orchestra.run.smithi050.stdout: "segex": 0, 2024-08-31T04:38:42.419 INFO:teuthology.orchestra.run.smithi050.stdout: "segtrm": 0, 2024-08-31T04:38:42.419 INFO:teuthology.orchestra.run.smithi050.stdout: "seg": 2, 2024-08-31T04:38:42.419 INFO:teuthology.orchestra.run.smithi050.stdout: "segmjr": 39, 2024-08-31T04:38:42.419 INFO:teuthology.orchestra.run.smithi050.stdout: "segexg": 0, 2024-08-31T04:38:42.420 INFO:teuthology.orchestra.run.smithi050.stdout: "segexd": 0, 2024-08-31T04:38:42.420 INFO:teuthology.orchestra.run.smithi050.stdout: "expos": 324157440, 2024-08-31T04:38:42.420 INFO:teuthology.orchestra.run.smithi050.stdout: "wrpos": 324172669, 2024-08-31T04:38:42.420 INFO:teuthology.orchestra.run.smithi050.stdout: "rdpos": 324170172, 2024-08-31T04:38:42.420 INFO:teuthology.orchestra.run.smithi050.stdout: "jlat": { 2024-08-31T04:38:42.420 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-08-31T04:38:42.420 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-08-31T04:38:42.420 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-08-31T04:38:42.420 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:42.420 INFO:teuthology.orchestra.run.smithi050.stdout: "replayed": 43940 2024-08-31T04:38:42.420 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:42.420 INFO:teuthology.orchestra.run.smithi050.stdout: "mds_mem": { 2024-08-31T04:38:42.420 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 17, 2024-08-31T04:38:42.420 INFO:teuthology.orchestra.run.smithi050.stdout: "ino+": 24161, 2024-08-31T04:38:42.420 INFO:teuthology.orchestra.run.smithi050.stdout: "ino-": 24144, 2024-08-31T04:38:42.421 INFO:teuthology.orchestra.run.smithi050.stdout: "dir": 16, 2024-08-31T04:38:42.421 INFO:teuthology.orchestra.run.smithi050.stdout: "dir+": 1313, 2024-08-31T04:38:42.421 INFO:teuthology.orchestra.run.smithi050.stdout: "dir-": 1297, 2024-08-31T04:38:42.421 INFO:teuthology.orchestra.run.smithi050.stdout: "dn": 14785, 2024-08-31T04:38:42.421 INFO:teuthology.orchestra.run.smithi050.stdout: "dn+": 51662, 2024-08-31T04:38:42.421 INFO:teuthology.orchestra.run.smithi050.stdout: "dn-": 36877, 2024-08-31T04:38:42.421 INFO:teuthology.orchestra.run.smithi050.stdout: "cap": 0, 2024-08-31T04:38:42.421 INFO:teuthology.orchestra.run.smithi050.stdout: "cap+": 0, 2024-08-31T04:38:42.421 INFO:teuthology.orchestra.run.smithi050.stdout: "cap-": 0, 2024-08-31T04:38:42.421 INFO:teuthology.orchestra.run.smithi050.stdout: "rss": 139140, 2024-08-31T04:38:42.421 INFO:teuthology.orchestra.run.smithi050.stdout: "heap": 407150592 2024-08-31T04:38:42.421 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:42.421 INFO:teuthology.orchestra.run.smithi050.stdout: "mds_server": { 2024-08-31T04:38:42.421 INFO:teuthology.orchestra.run.smithi050.stdout: "dispatch_client_request": 0, 2024-08-31T04:38:42.421 INFO:teuthology.orchestra.run.smithi050.stdout: "dispatch_server_request": 0, 2024-08-31T04:38:42.421 INFO:teuthology.orchestra.run.smithi050.stdout: "handle_client_request": 0, 2024-08-31T04:38:42.422 INFO:teuthology.orchestra.run.smithi050.stdout: "handle_client_session": 0, 2024-08-31T04:38:42.422 INFO:teuthology.orchestra.run.smithi050.stdout: "handle_peer_request": 0, 2024-08-31T04:38:42.422 INFO:teuthology.orchestra.run.smithi050.stdout: "req_create_latency": { 2024-08-31T04:38:42.422 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-08-31T04:38:42.422 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-08-31T04:38:42.422 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-08-31T04:38:42.422 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:42.422 INFO:teuthology.orchestra.run.smithi050.stdout: "req_getattr_latency": { 2024-08-31T04:38:42.422 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-08-31T04:38:42.422 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-08-31T04:38:42.422 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-08-31T04:38:42.422 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:42.422 INFO:teuthology.orchestra.run.smithi050.stdout: "req_getfilelock_latency": { 2024-08-31T04:38:42.422 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-08-31T04:38:42.422 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-08-31T04:38:42.422 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-08-31T04:38:42.423 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:42.423 INFO:teuthology.orchestra.run.smithi050.stdout: "req_link_latency": { 2024-08-31T04:38:42.423 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-08-31T04:38:42.423 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-08-31T04:38:42.423 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-08-31T04:38:42.423 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:42.423 INFO:teuthology.orchestra.run.smithi050.stdout: "req_lookup_latency": { 2024-08-31T04:38:42.423 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-08-31T04:38:42.423 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-08-31T04:38:42.423 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-08-31T04:38:42.423 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:42.423 INFO:teuthology.orchestra.run.smithi050.stdout: "req_lookuphash_latency": { 2024-08-31T04:38:42.423 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-08-31T04:38:42.423 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-08-31T04:38:42.423 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-08-31T04:38:42.424 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:42.424 INFO:teuthology.orchestra.run.smithi050.stdout: "req_lookupino_latency": { 2024-08-31T04:38:42.424 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-08-31T04:38:42.424 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-08-31T04:38:42.424 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-08-31T04:38:42.424 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:42.424 INFO:teuthology.orchestra.run.smithi050.stdout: "req_lookupname_latency": { 2024-08-31T04:38:42.424 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-08-31T04:38:42.424 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-08-31T04:38:42.424 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-08-31T04:38:42.424 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:42.424 INFO:teuthology.orchestra.run.smithi050.stdout: "req_lookupparent_latency": { 2024-08-31T04:38:42.424 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-08-31T04:38:42.424 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-08-31T04:38:42.425 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-08-31T04:38:42.425 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:42.425 INFO:teuthology.orchestra.run.smithi050.stdout: "req_lookupsnap_latency": { 2024-08-31T04:38:42.425 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-08-31T04:38:42.425 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-08-31T04:38:42.425 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-08-31T04:38:42.425 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:42.425 INFO:teuthology.orchestra.run.smithi050.stdout: "req_lssnap_latency": { 2024-08-31T04:38:42.425 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-08-31T04:38:42.426 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-08-31T04:38:42.426 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-08-31T04:38:42.426 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:42.426 INFO:teuthology.orchestra.run.smithi050.stdout: "req_mkdir_latency": { 2024-08-31T04:38:42.426 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-08-31T04:38:42.426 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-08-31T04:38:42.426 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-08-31T04:38:42.426 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:42.426 INFO:teuthology.orchestra.run.smithi050.stdout: "req_mknod_latency": { 2024-08-31T04:38:42.426 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-08-31T04:38:42.426 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-08-31T04:38:42.426 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-08-31T04:38:42.426 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:42.426 INFO:teuthology.orchestra.run.smithi050.stdout: "req_mksnap_latency": { 2024-08-31T04:38:42.426 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-08-31T04:38:42.427 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-08-31T04:38:42.427 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-08-31T04:38:42.427 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:42.427 INFO:teuthology.orchestra.run.smithi050.stdout: "req_open_latency": { 2024-08-31T04:38:42.427 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-08-31T04:38:42.427 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-08-31T04:38:42.427 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-08-31T04:38:42.427 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:42.427 INFO:teuthology.orchestra.run.smithi050.stdout: "req_readdir_latency": { 2024-08-31T04:38:42.427 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-08-31T04:38:42.427 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-08-31T04:38:42.427 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-08-31T04:38:42.427 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:42.427 INFO:teuthology.orchestra.run.smithi050.stdout: "req_rename_latency": { 2024-08-31T04:38:42.427 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-08-31T04:38:42.428 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-08-31T04:38:42.428 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-08-31T04:38:42.428 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:42.428 INFO:teuthology.orchestra.run.smithi050.stdout: "req_renamesnap_latency": { 2024-08-31T04:38:42.428 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-08-31T04:38:42.428 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-08-31T04:38:42.428 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-08-31T04:38:42.428 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:42.428 INFO:teuthology.orchestra.run.smithi050.stdout: "req_snapdiff_latency": { 2024-08-31T04:38:42.428 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-08-31T04:38:42.428 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-08-31T04:38:42.428 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-08-31T04:38:42.428 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:42.428 INFO:teuthology.orchestra.run.smithi050.stdout: "req_rmdir_latency": { 2024-08-31T04:38:42.429 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-08-31T04:38:42.429 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-08-31T04:38:42.429 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-08-31T04:38:42.429 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:42.429 INFO:teuthology.orchestra.run.smithi050.stdout: "req_rmsnap_latency": { 2024-08-31T04:38:42.429 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-08-31T04:38:42.429 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-08-31T04:38:42.429 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-08-31T04:38:42.429 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:42.429 INFO:teuthology.orchestra.run.smithi050.stdout: "req_rmxattr_latency": { 2024-08-31T04:38:42.429 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-08-31T04:38:42.429 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-08-31T04:38:42.429 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-08-31T04:38:42.429 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:42.430 INFO:teuthology.orchestra.run.smithi050.stdout: "req_setattr_latency": { 2024-08-31T04:38:42.430 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-08-31T04:38:42.430 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-08-31T04:38:42.430 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-08-31T04:38:42.430 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:42.430 INFO:teuthology.orchestra.run.smithi050.stdout: "req_setdirlayout_latency": { 2024-08-31T04:38:42.430 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-08-31T04:38:42.430 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-08-31T04:38:42.430 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-08-31T04:38:42.430 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:42.430 INFO:teuthology.orchestra.run.smithi050.stdout: "req_setfilelock_latency": { 2024-08-31T04:38:42.430 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-08-31T04:38:42.430 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-08-31T04:38:42.430 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-08-31T04:38:42.430 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:42.431 INFO:teuthology.orchestra.run.smithi050.stdout: "req_setlayout_latency": { 2024-08-31T04:38:42.431 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-08-31T04:38:42.431 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-08-31T04:38:42.431 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-08-31T04:38:42.431 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:42.431 INFO:teuthology.orchestra.run.smithi050.stdout: "req_setxattr_latency": { 2024-08-31T04:38:42.431 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-08-31T04:38:42.431 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-08-31T04:38:42.431 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-08-31T04:38:42.431 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:42.431 INFO:teuthology.orchestra.run.smithi050.stdout: "req_symlink_latency": { 2024-08-31T04:38:42.431 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-08-31T04:38:42.431 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-08-31T04:38:42.431 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-08-31T04:38:42.431 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:42.431 INFO:teuthology.orchestra.run.smithi050.stdout: "req_unlink_latency": { 2024-08-31T04:38:42.432 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-08-31T04:38:42.432 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-08-31T04:38:42.432 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-08-31T04:38:42.432 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:42.432 INFO:teuthology.orchestra.run.smithi050.stdout: "cap_revoke_eviction": 0, 2024-08-31T04:38:42.432 INFO:teuthology.orchestra.run.smithi050.stdout: "cap_acquisition_throttle": 0, 2024-08-31T04:38:42.432 INFO:teuthology.orchestra.run.smithi050.stdout: "req_getvxattr_latency": { 2024-08-31T04:38:42.432 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-08-31T04:38:42.432 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-08-31T04:38:42.432 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-08-31T04:38:42.432 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T04:38:42.432 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:42.432 INFO:teuthology.orchestra.run.smithi050.stdout: "mds_sessions": { 2024-08-31T04:38:42.432 INFO:teuthology.orchestra.run.smithi050.stdout: "session_count": 1, 2024-08-31T04:38:42.433 INFO:teuthology.orchestra.run.smithi050.stdout: "session_add": 1, 2024-08-31T04:38:42.433 INFO:teuthology.orchestra.run.smithi050.stdout: "session_remove": 0, 2024-08-31T04:38:42.433 INFO:teuthology.orchestra.run.smithi050.stdout: "sessions_open": 0, 2024-08-31T04:38:42.433 INFO:teuthology.orchestra.run.smithi050.stdout: "sessions_stale": 0, 2024-08-31T04:38:42.433 INFO:teuthology.orchestra.run.smithi050.stdout: "total_load": 0, 2024-08-31T04:38:42.433 INFO:teuthology.orchestra.run.smithi050.stdout: "average_load": 0, 2024-08-31T04:38:42.433 INFO:teuthology.orchestra.run.smithi050.stdout: "avg_session_uptime": 1968, 2024-08-31T04:38:42.433 INFO:teuthology.orchestra.run.smithi050.stdout: "mdthresh_evicted": 0 2024-08-31T04:38:42.433 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:42.433 INFO:teuthology.orchestra.run.smithi050.stdout: "mempool": { 2024-08-31T04:38:42.433 INFO:teuthology.orchestra.run.smithi050.stdout: "bloom_filter_bytes": 0, 2024-08-31T04:38:42.433 INFO:teuthology.orchestra.run.smithi050.stdout: "bloom_filter_items": 0, 2024-08-31T04:38:42.433 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_alloc_bytes": 0, 2024-08-31T04:38:42.433 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_alloc_items": 0, 2024-08-31T04:38:42.433 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_cache_data_bytes": 0, 2024-08-31T04:38:42.434 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_cache_data_items": 0, 2024-08-31T04:38:42.434 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_cache_onode_bytes": 0, 2024-08-31T04:38:42.434 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_cache_onode_items": 0, 2024-08-31T04:38:42.434 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_cache_meta_bytes": 0, 2024-08-31T04:38:42.434 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_cache_meta_items": 0, 2024-08-31T04:38:42.434 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_cache_other_bytes": 0, 2024-08-31T04:38:42.434 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_cache_other_items": 0, 2024-08-31T04:38:42.434 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_cache_buffer_bytes": 0, 2024-08-31T04:38:42.434 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_cache_buffer_items": 0, 2024-08-31T04:38:42.434 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_extent_bytes": 0, 2024-08-31T04:38:42.434 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_extent_items": 0, 2024-08-31T04:38:42.434 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_blob_bytes": 0, 2024-08-31T04:38:42.434 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_blob_items": 0, 2024-08-31T04:38:42.434 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_shared_blob_bytes": 0, 2024-08-31T04:38:42.435 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_shared_blob_items": 0, 2024-08-31T04:38:42.435 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_inline_bl_bytes": 0, 2024-08-31T04:38:42.435 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_inline_bl_items": 0, 2024-08-31T04:38:42.435 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_fsck_bytes": 0, 2024-08-31T04:38:42.435 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_fsck_items": 0, 2024-08-31T04:38:42.435 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_txc_bytes": 0, 2024-08-31T04:38:42.435 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_txc_items": 0, 2024-08-31T04:38:42.435 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_writing_deferred_bytes": 0, 2024-08-31T04:38:42.435 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_writing_deferred_items": 0, 2024-08-31T04:38:42.435 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_writing_bytes": 0, 2024-08-31T04:38:42.435 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_writing_items": 0, 2024-08-31T04:38:42.435 INFO:teuthology.orchestra.run.smithi050.stdout: "bluefs_bytes": 0, 2024-08-31T04:38:42.435 INFO:teuthology.orchestra.run.smithi050.stdout: "bluefs_items": 0, 2024-08-31T04:38:42.435 INFO:teuthology.orchestra.run.smithi050.stdout: "bluefs_file_reader_bytes": 0, 2024-08-31T04:38:42.436 INFO:teuthology.orchestra.run.smithi050.stdout: "bluefs_file_reader_items": 0, 2024-08-31T04:38:42.436 INFO:teuthology.orchestra.run.smithi050.stdout: "bluefs_file_writer_bytes": 0, 2024-08-31T04:38:42.436 INFO:teuthology.orchestra.run.smithi050.stdout: "bluefs_file_writer_items": 0, 2024-08-31T04:38:42.436 INFO:teuthology.orchestra.run.smithi050.stdout: "buffer_anon_bytes": 221740, 2024-08-31T04:38:42.436 INFO:teuthology.orchestra.run.smithi050.stdout: "buffer_anon_items": 67, 2024-08-31T04:38:42.436 INFO:teuthology.orchestra.run.smithi050.stdout: "buffer_meta_bytes": 0, 2024-08-31T04:38:42.436 INFO:teuthology.orchestra.run.smithi050.stdout: "buffer_meta_items": 0, 2024-08-31T04:38:42.436 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_bytes": 0, 2024-08-31T04:38:42.436 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_items": 0, 2024-08-31T04:38:42.436 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_mapbl_bytes": 0, 2024-08-31T04:38:42.436 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_mapbl_items": 0, 2024-08-31T04:38:42.436 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_pglog_bytes": 0, 2024-08-31T04:38:42.436 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_pglog_items": 0, 2024-08-31T04:38:42.436 INFO:teuthology.orchestra.run.smithi050.stdout: "osdmap_bytes": 7504, 2024-08-31T04:38:42.437 INFO:teuthology.orchestra.run.smithi050.stdout: "osdmap_items": 155, 2024-08-31T04:38:42.437 INFO:teuthology.orchestra.run.smithi050.stdout: "osdmap_mapping_bytes": 0, 2024-08-31T04:38:42.437 INFO:teuthology.orchestra.run.smithi050.stdout: "osdmap_mapping_items": 0, 2024-08-31T04:38:42.437 INFO:teuthology.orchestra.run.smithi050.stdout: "pgmap_bytes": 0, 2024-08-31T04:38:42.437 INFO:teuthology.orchestra.run.smithi050.stdout: "pgmap_items": 0, 2024-08-31T04:38:42.437 INFO:teuthology.orchestra.run.smithi050.stdout: "mds_co_bytes": 10117229, 2024-08-31T04:38:42.437 INFO:teuthology.orchestra.run.smithi050.stdout: "mds_co_items": 59440, 2024-08-31T04:38:42.437 INFO:teuthology.orchestra.run.smithi050.stdout: "unittest_1_bytes": 0, 2024-08-31T04:38:42.437 INFO:teuthology.orchestra.run.smithi050.stdout: "unittest_1_items": 0, 2024-08-31T04:38:42.437 INFO:teuthology.orchestra.run.smithi050.stdout: "unittest_2_bytes": 0, 2024-08-31T04:38:42.437 INFO:teuthology.orchestra.run.smithi050.stdout: "unittest_2_items": 0 2024-08-31T04:38:42.437 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:42.437 INFO:teuthology.orchestra.run.smithi050.stdout: "objecter": { 2024-08-31T04:38:42.437 INFO:teuthology.orchestra.run.smithi050.stdout: "op_active": 0, 2024-08-31T04:38:42.437 INFO:teuthology.orchestra.run.smithi050.stdout: "op_laggy": 0, 2024-08-31T04:38:42.438 INFO:teuthology.orchestra.run.smithi050.stdout: "op_send": 1810, 2024-08-31T04:38:42.438 INFO:teuthology.orchestra.run.smithi050.stdout: "op_send_bytes": 26, 2024-08-31T04:38:42.438 INFO:teuthology.orchestra.run.smithi050.stdout: "op_resend": 4, 2024-08-31T04:38:42.438 INFO:teuthology.orchestra.run.smithi050.stdout: "op_reply": 1810, 2024-08-31T04:38:42.438 INFO:teuthology.orchestra.run.smithi050.stdout: "op_latency": { 2024-08-31T04:38:42.438 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 1810, 2024-08-31T04:38:42.438 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 3.742908312, 2024-08-31T04:38:42.438 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.002067905 2024-08-31T04:38:42.438 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:42.438 INFO:teuthology.orchestra.run.smithi050.stdout: "op_inflight": 0, 2024-08-31T04:38:42.438 INFO:teuthology.orchestra.run.smithi050.stdout: "oplen_avg": { 2024-08-31T04:38:42.438 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 1810, 2024-08-31T04:38:42.438 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 1811 2024-08-31T04:38:42.439 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:42.439 INFO:teuthology.orchestra.run.smithi050.stdout: "op": 1810, 2024-08-31T04:38:42.439 INFO:teuthology.orchestra.run.smithi050.stdout: "op_r": 1810, 2024-08-31T04:38:42.439 INFO:teuthology.orchestra.run.smithi050.stdout: "op_w": 0, 2024-08-31T04:38:42.439 INFO:teuthology.orchestra.run.smithi050.stdout: "op_rmw": 0, 2024-08-31T04:38:42.439 INFO:teuthology.orchestra.run.smithi050.stdout: "op_pg": 0, 2024-08-31T04:38:42.439 INFO:teuthology.orchestra.run.smithi050.stdout: "osdop_stat": 1083, 2024-08-31T04:38:42.439 INFO:teuthology.orchestra.run.smithi050.stdout: "osdop_create": 0, 2024-08-31T04:38:42.439 INFO:teuthology.orchestra.run.smithi050.stdout: "osdop_read": 724, 2024-08-31T04:38:42.439 INFO:teuthology.orchestra.run.smithi050.stdout: "osdop_write": 0, 2024-08-31T04:38:42.439 INFO:teuthology.orchestra.run.smithi050.stdout: "osdop_writefull": 0, 2024-08-31T04:38:42.439 INFO:teuthology.orchestra.run.smithi050.stdout: "osdop_writesame": 0, 2024-08-31T04:38:42.439 INFO:teuthology.orchestra.run.smithi050.stdout: "osdop_append": 0, 2024-08-31T04:38:42.440 INFO:teuthology.orchestra.run.smithi050.stdout: "osdop_zero": 0, 2024-08-31T04:38:42.440 INFO:teuthology.orchestra.run.smithi050.stdout: "osdop_truncate": 0, 2024-08-31T04:38:42.440 INFO:teuthology.orchestra.run.smithi050.stdout: "osdop_delete": 0, 2024-08-31T04:38:42.440 INFO:teuthology.orchestra.run.smithi050.stdout: "osdop_mapext": 0, 2024-08-31T04:38:42.440 INFO:teuthology.orchestra.run.smithi050.stdout: "osdop_sparse_read": 0, 2024-08-31T04:38:42.440 INFO:teuthology.orchestra.run.smithi050.stdout: "osdop_clonerange": 0, 2024-08-31T04:38:42.440 INFO:teuthology.orchestra.run.smithi050.stdout: "osdop_getxattr": 2, 2024-08-31T04:38:42.440 INFO:teuthology.orchestra.run.smithi050.stdout: "osdop_setxattr": 0, 2024-08-31T04:38:42.440 INFO:teuthology.orchestra.run.smithi050.stdout: "osdop_cmpxattr": 0, 2024-08-31T04:38:42.440 INFO:teuthology.orchestra.run.smithi050.stdout: "osdop_rmxattr": 0, 2024-08-31T04:38:42.440 INFO:teuthology.orchestra.run.smithi050.stdout: "osdop_resetxattrs": 0, 2024-08-31T04:38:42.440 INFO:teuthology.orchestra.run.smithi050.stdout: "osdop_call": 0, 2024-08-31T04:38:42.440 INFO:teuthology.orchestra.run.smithi050.stdout: "osdop_watch": 0, 2024-08-31T04:38:42.441 INFO:teuthology.orchestra.run.smithi050.stdout: "osdop_notify": 0, 2024-08-31T04:38:42.441 INFO:teuthology.orchestra.run.smithi050.stdout: "osdop_src_cmpxattr": 0, 2024-08-31T04:38:42.441 INFO:teuthology.orchestra.run.smithi050.stdout: "osdop_pgls": 0, 2024-08-31T04:38:42.441 INFO:teuthology.orchestra.run.smithi050.stdout: "osdop_pgls_filter": 0, 2024-08-31T04:38:42.441 INFO:teuthology.orchestra.run.smithi050.stdout: "osdop_other": 0, 2024-08-31T04:38:42.441 INFO:teuthology.orchestra.run.smithi050.stdout: "linger_active": 0, 2024-08-31T04:38:42.441 INFO:teuthology.orchestra.run.smithi050.stdout: "linger_send": 0, 2024-08-31T04:38:42.441 INFO:teuthology.orchestra.run.smithi050.stdout: "linger_resend": 0, 2024-08-31T04:38:42.441 INFO:teuthology.orchestra.run.smithi050.stdout: "linger_ping": 0, 2024-08-31T04:38:42.441 INFO:teuthology.orchestra.run.smithi050.stdout: "poolop_active": 0, 2024-08-31T04:38:42.441 INFO:teuthology.orchestra.run.smithi050.stdout: "poolop_send": 0, 2024-08-31T04:38:42.441 INFO:teuthology.orchestra.run.smithi050.stdout: "poolop_resend": 0, 2024-08-31T04:38:42.441 INFO:teuthology.orchestra.run.smithi050.stdout: "poolstat_active": 0, 2024-08-31T04:38:42.441 INFO:teuthology.orchestra.run.smithi050.stdout: "poolstat_send": 0, 2024-08-31T04:38:42.442 INFO:teuthology.orchestra.run.smithi050.stdout: "poolstat_resend": 0, 2024-08-31T04:38:42.442 INFO:teuthology.orchestra.run.smithi050.stdout: "statfs_active": 0, 2024-08-31T04:38:42.442 INFO:teuthology.orchestra.run.smithi050.stdout: "statfs_send": 0, 2024-08-31T04:38:42.442 INFO:teuthology.orchestra.run.smithi050.stdout: "statfs_resend": 0, 2024-08-31T04:38:42.442 INFO:teuthology.orchestra.run.smithi050.stdout: "command_active": 0, 2024-08-31T04:38:42.442 INFO:teuthology.orchestra.run.smithi050.stdout: "command_send": 0, 2024-08-31T04:38:42.442 INFO:teuthology.orchestra.run.smithi050.stdout: "command_resend": 0, 2024-08-31T04:38:42.442 INFO:teuthology.orchestra.run.smithi050.stdout: "map_epoch": 0, 2024-08-31T04:38:42.442 INFO:teuthology.orchestra.run.smithi050.stdout: "map_full": 0, 2024-08-31T04:38:42.442 INFO:teuthology.orchestra.run.smithi050.stdout: "map_inc": 0, 2024-08-31T04:38:42.442 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_sessions": 9, 2024-08-31T04:38:42.442 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_session_open": 9, 2024-08-31T04:38:42.442 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_session_close": 0, 2024-08-31T04:38:42.442 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_laggy": 0, 2024-08-31T04:38:42.443 INFO:teuthology.orchestra.run.smithi050.stdout: "omap_wr": 0, 2024-08-31T04:38:42.443 INFO:teuthology.orchestra.run.smithi050.stdout: "omap_rd": 2, 2024-08-31T04:38:42.443 INFO:teuthology.orchestra.run.smithi050.stdout: "omap_del": 0 2024-08-31T04:38:42.443 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:42.443 INFO:teuthology.orchestra.run.smithi050.stdout: "oft": { 2024-08-31T04:38:42.443 INFO:teuthology.orchestra.run.smithi050.stdout: "omap_total_objs": 0, 2024-08-31T04:38:42.443 INFO:teuthology.orchestra.run.smithi050.stdout: "omap_total_kv_pairs": 0, 2024-08-31T04:38:42.443 INFO:teuthology.orchestra.run.smithi050.stdout: "omap_total_updates": 0, 2024-08-31T04:38:42.443 INFO:teuthology.orchestra.run.smithi050.stdout: "omap_total_removes": 0 2024-08-31T04:38:42.443 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:42.443 INFO:teuthology.orchestra.run.smithi050.stdout: "purge_queue": { 2024-08-31T04:38:42.443 INFO:teuthology.orchestra.run.smithi050.stdout: "pq_executing_ops": 0, 2024-08-31T04:38:42.443 INFO:teuthology.orchestra.run.smithi050.stdout: "pq_executing_ops_high_water": 0, 2024-08-31T04:38:42.443 INFO:teuthology.orchestra.run.smithi050.stdout: "pq_executing": 0, 2024-08-31T04:38:42.443 INFO:teuthology.orchestra.run.smithi050.stdout: "pq_executing_high_water": 0, 2024-08-31T04:38:42.444 INFO:teuthology.orchestra.run.smithi050.stdout: "pq_executed_ops": 0, 2024-08-31T04:38:42.444 INFO:teuthology.orchestra.run.smithi050.stdout: "pq_executed": 0, 2024-08-31T04:38:42.444 INFO:teuthology.orchestra.run.smithi050.stdout: "pq_item_in_journal": 0 2024-08-31T04:38:42.444 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:42.444 INFO:teuthology.orchestra.run.smithi050.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-08-31T04:38:42.444 INFO:teuthology.orchestra.run.smithi050.stdout: "val": 0, 2024-08-31T04:38:42.444 INFO:teuthology.orchestra.run.smithi050.stdout: "max": 104857600, 2024-08-31T04:38:42.444 INFO:teuthology.orchestra.run.smithi050.stdout: "get_started": 0, 2024-08-31T04:38:42.444 INFO:teuthology.orchestra.run.smithi050.stdout: "get": 1989, 2024-08-31T04:38:42.444 INFO:teuthology.orchestra.run.smithi050.stdout: "get_sum": 95883230, 2024-08-31T04:38:42.444 INFO:teuthology.orchestra.run.smithi050.stdout: "get_or_fail_fail": 0, 2024-08-31T04:38:42.444 INFO:teuthology.orchestra.run.smithi050.stdout: "get_or_fail_success": 1989, 2024-08-31T04:38:42.444 INFO:teuthology.orchestra.run.smithi050.stdout: "take": 0, 2024-08-31T04:38:42.444 INFO:teuthology.orchestra.run.smithi050.stdout: "take_sum": 0, 2024-08-31T04:38:42.445 INFO:teuthology.orchestra.run.smithi050.stdout: "put": 1989, 2024-08-31T04:38:42.445 INFO:teuthology.orchestra.run.smithi050.stdout: "put_sum": 95883230, 2024-08-31T04:38:42.445 INFO:teuthology.orchestra.run.smithi050.stdout: "wait": { 2024-08-31T04:38:42.445 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-08-31T04:38:42.445 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-08-31T04:38:42.445 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-08-31T04:38:42.445 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T04:38:42.445 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:42.445 INFO:teuthology.orchestra.run.smithi050.stdout: "throttle-objecter_bytes": { 2024-08-31T04:38:42.445 INFO:teuthology.orchestra.run.smithi050.stdout: "val": 0, 2024-08-31T04:38:42.445 INFO:teuthology.orchestra.run.smithi050.stdout: "max": 104857600, 2024-08-31T04:38:42.445 INFO:teuthology.orchestra.run.smithi050.stdout: "get_started": 0, 2024-08-31T04:38:42.445 INFO:teuthology.orchestra.run.smithi050.stdout: "get": 0, 2024-08-31T04:38:42.445 INFO:teuthology.orchestra.run.smithi050.stdout: "get_sum": 0, 2024-08-31T04:38:42.446 INFO:teuthology.orchestra.run.smithi050.stdout: "get_or_fail_fail": 0, 2024-08-31T04:38:42.446 INFO:teuthology.orchestra.run.smithi050.stdout: "get_or_fail_success": 0, 2024-08-31T04:38:42.446 INFO:teuthology.orchestra.run.smithi050.stdout: "take": 1810, 2024-08-31T04:38:42.446 INFO:teuthology.orchestra.run.smithi050.stdout: "take_sum": 95147620, 2024-08-31T04:38:42.446 INFO:teuthology.orchestra.run.smithi050.stdout: "put": 1810, 2024-08-31T04:38:42.446 INFO:teuthology.orchestra.run.smithi050.stdout: "put_sum": 95147620, 2024-08-31T04:38:42.446 INFO:teuthology.orchestra.run.smithi050.stdout: "wait": { 2024-08-31T04:38:42.446 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-08-31T04:38:42.446 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-08-31T04:38:42.446 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-08-31T04:38:42.446 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T04:38:42.446 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:42.446 INFO:teuthology.orchestra.run.smithi050.stdout: "throttle-objecter_ops": { 2024-08-31T04:38:42.446 INFO:teuthology.orchestra.run.smithi050.stdout: "val": 0, 2024-08-31T04:38:42.447 INFO:teuthology.orchestra.run.smithi050.stdout: "max": 1024, 2024-08-31T04:38:42.447 INFO:teuthology.orchestra.run.smithi050.stdout: "get_started": 0, 2024-08-31T04:38:42.447 INFO:teuthology.orchestra.run.smithi050.stdout: "get": 0, 2024-08-31T04:38:42.447 INFO:teuthology.orchestra.run.smithi050.stdout: "get_sum": 0, 2024-08-31T04:38:42.447 INFO:teuthology.orchestra.run.smithi050.stdout: "get_or_fail_fail": 0, 2024-08-31T04:38:42.447 INFO:teuthology.orchestra.run.smithi050.stdout: "get_or_fail_success": 0, 2024-08-31T04:38:42.447 INFO:teuthology.orchestra.run.smithi050.stdout: "take": 1810, 2024-08-31T04:38:42.447 INFO:teuthology.orchestra.run.smithi050.stdout: "take_sum": 1810, 2024-08-31T04:38:42.447 INFO:teuthology.orchestra.run.smithi050.stdout: "put": 1810, 2024-08-31T04:38:42.447 INFO:teuthology.orchestra.run.smithi050.stdout: "put_sum": 1810, 2024-08-31T04:38:42.447 INFO:teuthology.orchestra.run.smithi050.stdout: "wait": { 2024-08-31T04:38:42.447 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-08-31T04:38:42.447 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-08-31T04:38:42.447 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-08-31T04:38:42.448 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T04:38:42.448 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:42.448 INFO:teuthology.orchestra.run.smithi050.stdout: "throttle-write_buf_throttle": { 2024-08-31T04:38:42.448 INFO:teuthology.orchestra.run.smithi050.stdout: "val": 0, 2024-08-31T04:38:42.448 INFO:teuthology.orchestra.run.smithi050.stdout: "max": 3758096384, 2024-08-31T04:38:42.448 INFO:teuthology.orchestra.run.smithi050.stdout: "get_started": 0, 2024-08-31T04:38:42.448 INFO:teuthology.orchestra.run.smithi050.stdout: "get": 0, 2024-08-31T04:38:42.448 INFO:teuthology.orchestra.run.smithi050.stdout: "get_sum": 0, 2024-08-31T04:38:42.448 INFO:teuthology.orchestra.run.smithi050.stdout: "get_or_fail_fail": 0, 2024-08-31T04:38:42.448 INFO:teuthology.orchestra.run.smithi050.stdout: "get_or_fail_success": 0, 2024-08-31T04:38:42.448 INFO:teuthology.orchestra.run.smithi050.stdout: "take": 0, 2024-08-31T04:38:42.448 INFO:teuthology.orchestra.run.smithi050.stdout: "take_sum": 0, 2024-08-31T04:38:42.448 INFO:teuthology.orchestra.run.smithi050.stdout: "put": 0, 2024-08-31T04:38:42.448 INFO:teuthology.orchestra.run.smithi050.stdout: "put_sum": 0, 2024-08-31T04:38:42.448 INFO:teuthology.orchestra.run.smithi050.stdout: "wait": { 2024-08-31T04:38:42.448 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-08-31T04:38:42.449 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-08-31T04:38:42.449 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-08-31T04:38:42.449 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T04:38:42.449 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:42.449 INFO:teuthology.orchestra.run.smithi050.stdout: "throttle-write_buf_throttle-0x5641f9e96c30": { 2024-08-31T04:38:42.449 INFO:teuthology.orchestra.run.smithi050.stdout: "val": 0, 2024-08-31T04:38:42.449 INFO:teuthology.orchestra.run.smithi050.stdout: "max": 3758096384, 2024-08-31T04:38:42.449 INFO:teuthology.orchestra.run.smithi050.stdout: "get_started": 0, 2024-08-31T04:38:42.449 INFO:teuthology.orchestra.run.smithi050.stdout: "get": 0, 2024-08-31T04:38:42.449 INFO:teuthology.orchestra.run.smithi050.stdout: "get_sum": 0, 2024-08-31T04:38:42.449 INFO:teuthology.orchestra.run.smithi050.stdout: "get_or_fail_fail": 0, 2024-08-31T04:38:42.449 INFO:teuthology.orchestra.run.smithi050.stdout: "get_or_fail_success": 0, 2024-08-31T04:38:42.449 INFO:teuthology.orchestra.run.smithi050.stdout: "take": 0, 2024-08-31T04:38:42.449 INFO:teuthology.orchestra.run.smithi050.stdout: "take_sum": 0, 2024-08-31T04:38:42.449 INFO:teuthology.orchestra.run.smithi050.stdout: "put": 0, 2024-08-31T04:38:42.450 INFO:teuthology.orchestra.run.smithi050.stdout: "put_sum": 0, 2024-08-31T04:38:42.450 INFO:teuthology.orchestra.run.smithi050.stdout: "wait": { 2024-08-31T04:38:42.450 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-08-31T04:38:42.450 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-08-31T04:38:42.450 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-08-31T04:38:42.450 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T04:38:42.450 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:42.450 INFO:teuthology.orchestra.run.smithi050.stdout: "trackedop": { 2024-08-31T04:38:42.450 INFO:teuthology.orchestra.run.smithi050.stdout: "slow_ops_count": 0 2024-08-31T04:38:42.450 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T04:38:42.450 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-08-31T04:38:43.245 INFO:tasks.check_counter:Daemon mds.d mds.exported=0 2024-08-31T04:38:43.245 INFO:tasks.check_counter:Daemon mds.d mds.imported=0 2024-08-31T04:38:43.246 INFO:tasks.check_counter:Daemon mds.d mds_cache.dir_update=0 2024-08-31T04:38:43.246 INFO:tasks.check_counter:Daemon mds.d mds_cache.dir_update_receipt=0 2024-08-31T04:38:43.246 INFO:tasks.check_counter:Daemon mds.d mds.dir_split=0 2024-08-31T04:38:43.246 DEBUG:tasks.check_counter:Getting stats from g 2024-08-31T04:38:43.246 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 058d9fc6-674f-11ef-bcd4-c7b262605968 -- ceph daemon mds.g perf dump 2024-08-31T04:38:43.627 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:38:43.845 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:38:43 smithi133 ceph-mon[22177]: pgmap v843: 97 pgs: 97 active+clean; 592 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 382 KiB/s rd, 382 KiB/s wr, 128 op/s 2024-08-31T04:38:43.915 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:38:43 smithi050 ceph-mon[17259]: pgmap v843: 97 pgs: 97 active+clean; 592 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 382 KiB/s rd, 382 KiB/s wr, 128 op/s 2024-08-31T04:38:43.996 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:38:43 smithi177 ceph-mon[22025]: pgmap v843: 97 pgs: 97 active+clean; 592 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 382 KiB/s rd, 382 KiB/s wr, 128 op/s 2024-08-31T04:38:44.357 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-08-31T04:38:44.357 INFO:teuthology.orchestra.run.smithi050.stdout: "AsyncMessenger::Worker-0": { 2024-08-31T04:38:44.357 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_recv_messages": 1489, 2024-08-31T04:38:44.358 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_send_messages": 1491, 2024-08-31T04:38:44.358 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_recv_bytes": 42411867, 2024-08-31T04:38:44.358 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_send_bytes": 473503, 2024-08-31T04:38:44.358 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_created_connections": 8, 2024-08-31T04:38:44.358 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_active_connections": 4, 2024-08-31T04:38:44.358 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_running_total_time": 0.339522015, 2024-08-31T04:38:44.358 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_running_send_time": 0.122823183, 2024-08-31T04:38:44.358 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_running_recv_time": 0.127796526, 2024-08-31T04:38:44.358 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_running_fast_dispatch_time": 0.064860264, 2024-08-31T04:38:44.358 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_send_messages_queue_lat": { 2024-08-31T04:38:44.358 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 1489, 2024-08-31T04:38:44.358 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.162681294, 2024-08-31T04:38:44.358 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000109255 2024-08-31T04:38:44.359 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:44.359 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_handle_ack_lat": { 2024-08-31T04:38:44.359 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-08-31T04:38:44.359 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-08-31T04:38:44.359 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-08-31T04:38:44.359 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:44.359 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_recv_encrypted_bytes": 0, 2024-08-31T04:38:44.359 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_send_encrypted_bytes": 0 2024-08-31T04:38:44.359 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:44.359 INFO:teuthology.orchestra.run.smithi050.stdout: "AsyncMessenger::Worker-1": { 2024-08-31T04:38:44.359 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_recv_messages": 1575, 2024-08-31T04:38:44.359 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_send_messages": 1530, 2024-08-31T04:38:44.359 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_recv_bytes": 46400657, 2024-08-31T04:38:44.360 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_send_bytes": 573261, 2024-08-31T04:38:44.360 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_created_connections": 6, 2024-08-31T04:38:44.360 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_active_connections": 5, 2024-08-31T04:38:44.360 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_running_total_time": 0.330722117, 2024-08-31T04:38:44.360 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_running_send_time": 0.100685663, 2024-08-31T04:38:44.360 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_running_recv_time": 0.185484173, 2024-08-31T04:38:44.360 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_running_fast_dispatch_time": 0.043411526, 2024-08-31T04:38:44.360 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_send_messages_queue_lat": { 2024-08-31T04:38:44.360 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 1529, 2024-08-31T04:38:44.360 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.119924914, 2024-08-31T04:38:44.360 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000078433 2024-08-31T04:38:44.360 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:44.360 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_handle_ack_lat": { 2024-08-31T04:38:44.360 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-08-31T04:38:44.361 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-08-31T04:38:44.361 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-08-31T04:38:44.361 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:44.361 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_recv_encrypted_bytes": 843808, 2024-08-31T04:38:44.361 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_send_encrypted_bytes": 182064 2024-08-31T04:38:44.361 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:44.361 INFO:teuthology.orchestra.run.smithi050.stdout: "AsyncMessenger::Worker-2": { 2024-08-31T04:38:44.361 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_recv_messages": 674, 2024-08-31T04:38:44.361 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_send_messages": 894, 2024-08-31T04:38:44.361 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_recv_bytes": 42117222, 2024-08-31T04:38:44.361 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_send_bytes": 691409, 2024-08-31T04:38:44.361 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_created_connections": 6, 2024-08-31T04:38:44.362 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_active_connections": 5, 2024-08-31T04:38:44.362 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_running_total_time": 0.226920783, 2024-08-31T04:38:44.362 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_running_send_time": 0.067903314, 2024-08-31T04:38:44.362 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_running_recv_time": 0.115329362, 2024-08-31T04:38:44.362 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_running_fast_dispatch_time": 0.032308213, 2024-08-31T04:38:44.362 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_send_messages_queue_lat": { 2024-08-31T04:38:44.362 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 893, 2024-08-31T04:38:44.362 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.082555684, 2024-08-31T04:38:44.362 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000092447 2024-08-31T04:38:44.362 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:44.362 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_handle_ack_lat": { 2024-08-31T04:38:44.362 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-08-31T04:38:44.362 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-08-31T04:38:44.362 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-08-31T04:38:44.363 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:44.363 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_recv_encrypted_bytes": 3152, 2024-08-31T04:38:44.363 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_send_encrypted_bytes": 478656 2024-08-31T04:38:44.363 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:44.363 INFO:teuthology.orchestra.run.smithi050.stdout: "cct": { 2024-08-31T04:38:44.363 INFO:teuthology.orchestra.run.smithi050.stdout: "total_workers": 1, 2024-08-31T04:38:44.363 INFO:teuthology.orchestra.run.smithi050.stdout: "unhealthy_workers": 0 2024-08-31T04:38:44.363 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:44.363 INFO:teuthology.orchestra.run.smithi050.stdout: "finisher-MDSRank": { 2024-08-31T04:38:44.363 INFO:teuthology.orchestra.run.smithi050.stdout: "queue_len": 0, 2024-08-31T04:38:44.363 INFO:teuthology.orchestra.run.smithi050.stdout: "complete_latency": { 2024-08-31T04:38:44.363 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 5636, 2024-08-31T04:38:44.363 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.189982373, 2024-08-31T04:38:44.364 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000033708 2024-08-31T04:38:44.364 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T04:38:44.364 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:44.364 INFO:teuthology.orchestra.run.smithi050.stdout: "finisher-PurgeQueue": { 2024-08-31T04:38:44.364 INFO:teuthology.orchestra.run.smithi050.stdout: "queue_len": 0, 2024-08-31T04:38:44.364 INFO:teuthology.orchestra.run.smithi050.stdout: "complete_latency": { 2024-08-31T04:38:44.364 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-08-31T04:38:44.364 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-08-31T04:38:44.364 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-08-31T04:38:44.364 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T04:38:44.364 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:44.364 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": { 2024-08-31T04:38:44.364 INFO:teuthology.orchestra.run.smithi050.stdout: "request": 0, 2024-08-31T04:38:44.365 INFO:teuthology.orchestra.run.smithi050.stdout: "reply": 0, 2024-08-31T04:38:44.365 INFO:teuthology.orchestra.run.smithi050.stdout: "reply_latency": { 2024-08-31T04:38:44.365 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-08-31T04:38:44.365 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-08-31T04:38:44.365 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-08-31T04:38:44.365 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:44.365 INFO:teuthology.orchestra.run.smithi050.stdout: "slow_reply": 0, 2024-08-31T04:38:44.365 INFO:teuthology.orchestra.run.smithi050.stdout: "forward": 0, 2024-08-31T04:38:44.365 INFO:teuthology.orchestra.run.smithi050.stdout: "dir_fetch_complete": 0, 2024-08-31T04:38:44.365 INFO:teuthology.orchestra.run.smithi050.stdout: "dir_fetch_keys": 0, 2024-08-31T04:38:44.365 INFO:teuthology.orchestra.run.smithi050.stdout: "dir_commit": 0, 2024-08-31T04:38:44.365 INFO:teuthology.orchestra.run.smithi050.stdout: "dir_split": 0, 2024-08-31T04:38:44.365 INFO:teuthology.orchestra.run.smithi050.stdout: "dir_merge": 0, 2024-08-31T04:38:44.365 INFO:teuthology.orchestra.run.smithi050.stdout: "inodes": 10758, 2024-08-31T04:38:44.366 INFO:teuthology.orchestra.run.smithi050.stdout: "inodes_top": 0, 2024-08-31T04:38:44.366 INFO:teuthology.orchestra.run.smithi050.stdout: "inodes_bottom": 10758, 2024-08-31T04:38:44.366 INFO:teuthology.orchestra.run.smithi050.stdout: "inodes_pin_tail": 0, 2024-08-31T04:38:44.366 INFO:teuthology.orchestra.run.smithi050.stdout: "inodes_pinned": 10758, 2024-08-31T04:38:44.366 INFO:teuthology.orchestra.run.smithi050.stdout: "inodes_expired": 0, 2024-08-31T04:38:44.366 INFO:teuthology.orchestra.run.smithi050.stdout: "inodes_with_caps": 0, 2024-08-31T04:38:44.366 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": 0, 2024-08-31T04:38:44.366 INFO:teuthology.orchestra.run.smithi050.stdout: "subtrees": 1, 2024-08-31T04:38:44.366 INFO:teuthology.orchestra.run.smithi050.stdout: "traverse": 0, 2024-08-31T04:38:44.366 INFO:teuthology.orchestra.run.smithi050.stdout: "traverse_hit": 0, 2024-08-31T04:38:44.366 INFO:teuthology.orchestra.run.smithi050.stdout: "traverse_forward": 0, 2024-08-31T04:38:44.366 INFO:teuthology.orchestra.run.smithi050.stdout: "traverse_discover": 0, 2024-08-31T04:38:44.366 INFO:teuthology.orchestra.run.smithi050.stdout: "traverse_dir_fetch": 0, 2024-08-31T04:38:44.367 INFO:teuthology.orchestra.run.smithi050.stdout: "traverse_remote_ino": 0, 2024-08-31T04:38:44.367 INFO:teuthology.orchestra.run.smithi050.stdout: "traverse_lock": 0, 2024-08-31T04:38:44.367 INFO:teuthology.orchestra.run.smithi050.stdout: "load_cent": 0, 2024-08-31T04:38:44.367 INFO:teuthology.orchestra.run.smithi050.stdout: "q": 0, 2024-08-31T04:38:44.367 INFO:teuthology.orchestra.run.smithi050.stdout: "exported": 0, 2024-08-31T04:38:44.367 INFO:teuthology.orchestra.run.smithi050.stdout: "exported_inodes": 0, 2024-08-31T04:38:44.367 INFO:teuthology.orchestra.run.smithi050.stdout: "imported": 0, 2024-08-31T04:38:44.367 INFO:teuthology.orchestra.run.smithi050.stdout: "imported_inodes": 0, 2024-08-31T04:38:44.367 INFO:teuthology.orchestra.run.smithi050.stdout: "openino_dir_fetch": 0, 2024-08-31T04:38:44.367 INFO:teuthology.orchestra.run.smithi050.stdout: "openino_backtrace_fetch": 0, 2024-08-31T04:38:44.367 INFO:teuthology.orchestra.run.smithi050.stdout: "openino_peer_discover": 0, 2024-08-31T04:38:44.367 INFO:teuthology.orchestra.run.smithi050.stdout: "root_rfiles": 0, 2024-08-31T04:38:44.368 INFO:teuthology.orchestra.run.smithi050.stdout: "root_rbytes": 0, 2024-08-31T04:38:44.368 INFO:teuthology.orchestra.run.smithi050.stdout: "root_rsnaps": 0, 2024-08-31T04:38:44.368 INFO:teuthology.orchestra.run.smithi050.stdout: "scrub_backtrace_fetch": 0, 2024-08-31T04:38:44.368 INFO:teuthology.orchestra.run.smithi050.stdout: "scrub_set_tag": 0, 2024-08-31T04:38:44.368 INFO:teuthology.orchestra.run.smithi050.stdout: "scrub_backtrace_repaired": 0, 2024-08-31T04:38:44.368 INFO:teuthology.orchestra.run.smithi050.stdout: "scrub_inotable_repaired": 0, 2024-08-31T04:38:44.368 INFO:teuthology.orchestra.run.smithi050.stdout: "scrub_dir_inodes": 0, 2024-08-31T04:38:44.368 INFO:teuthology.orchestra.run.smithi050.stdout: "scrub_dir_base_inodes": 0, 2024-08-31T04:38:44.368 INFO:teuthology.orchestra.run.smithi050.stdout: "scrub_dirfrag_rstats": 0, 2024-08-31T04:38:44.368 INFO:teuthology.orchestra.run.smithi050.stdout: "scrub_file_inodes": 0, 2024-08-31T04:38:44.368 INFO:teuthology.orchestra.run.smithi050.stdout: "handle_inode_file_caps": 0, 2024-08-31T04:38:44.368 INFO:teuthology.orchestra.run.smithi050.stdout: "ceph_cap_op_revoke": 0, 2024-08-31T04:38:44.368 INFO:teuthology.orchestra.run.smithi050.stdout: "ceph_cap_op_grant": 0, 2024-08-31T04:38:44.368 INFO:teuthology.orchestra.run.smithi050.stdout: "ceph_cap_op_trunc": 0, 2024-08-31T04:38:44.369 INFO:teuthology.orchestra.run.smithi050.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-08-31T04:38:44.369 INFO:teuthology.orchestra.run.smithi050.stdout: "ceph_cap_op_flush_ack": 0, 2024-08-31T04:38:44.369 INFO:teuthology.orchestra.run.smithi050.stdout: "handle_client_caps": 0, 2024-08-31T04:38:44.369 INFO:teuthology.orchestra.run.smithi050.stdout: "handle_client_caps_dirty": 0, 2024-08-31T04:38:44.369 INFO:teuthology.orchestra.run.smithi050.stdout: "handle_client_cap_release": 0, 2024-08-31T04:38:44.369 INFO:teuthology.orchestra.run.smithi050.stdout: "process_request_cap_release": 0 2024-08-31T04:38:44.369 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:44.369 INFO:teuthology.orchestra.run.smithi050.stdout: "mds_cache": { 2024-08-31T04:38:44.369 INFO:teuthology.orchestra.run.smithi050.stdout: "dir_update": 0, 2024-08-31T04:38:44.369 INFO:teuthology.orchestra.run.smithi050.stdout: "dir_update_receipt": 0, 2024-08-31T04:38:44.369 INFO:teuthology.orchestra.run.smithi050.stdout: "dir_try_discover": 0, 2024-08-31T04:38:44.369 INFO:teuthology.orchestra.run.smithi050.stdout: "dir_send_discover": 0, 2024-08-31T04:38:44.369 INFO:teuthology.orchestra.run.smithi050.stdout: "dir_handle_discover": 0, 2024-08-31T04:38:44.370 INFO:teuthology.orchestra.run.smithi050.stdout: "num_strays": 0, 2024-08-31T04:38:44.370 INFO:teuthology.orchestra.run.smithi050.stdout: "num_strays_delayed": 0, 2024-08-31T04:38:44.370 INFO:teuthology.orchestra.run.smithi050.stdout: "num_strays_enqueuing": 0, 2024-08-31T04:38:44.370 INFO:teuthology.orchestra.run.smithi050.stdout: "strays_created": 0, 2024-08-31T04:38:44.370 INFO:teuthology.orchestra.run.smithi050.stdout: "strays_enqueued": 0, 2024-08-31T04:38:44.370 INFO:teuthology.orchestra.run.smithi050.stdout: "strays_reintegrated": 0, 2024-08-31T04:38:44.370 INFO:teuthology.orchestra.run.smithi050.stdout: "strays_migrated": 0, 2024-08-31T04:38:44.370 INFO:teuthology.orchestra.run.smithi050.stdout: "num_recovering_processing": 0, 2024-08-31T04:38:44.370 INFO:teuthology.orchestra.run.smithi050.stdout: "num_recovering_enqueued": 0, 2024-08-31T04:38:44.370 INFO:teuthology.orchestra.run.smithi050.stdout: "num_recovering_prioritized": 0, 2024-08-31T04:38:44.370 INFO:teuthology.orchestra.run.smithi050.stdout: "recovery_started": 0, 2024-08-31T04:38:44.370 INFO:teuthology.orchestra.run.smithi050.stdout: "recovery_completed": 0, 2024-08-31T04:38:44.370 INFO:teuthology.orchestra.run.smithi050.stdout: "ireq_quiesce_path": 0, 2024-08-31T04:38:44.371 INFO:teuthology.orchestra.run.smithi050.stdout: "ireq_quiesce_inode": 0, 2024-08-31T04:38:44.371 INFO:teuthology.orchestra.run.smithi050.stdout: "ireq_enqueue_scrub": 0, 2024-08-31T04:38:44.371 INFO:teuthology.orchestra.run.smithi050.stdout: "ireq_exportdir": 0, 2024-08-31T04:38:44.371 INFO:teuthology.orchestra.run.smithi050.stdout: "ireq_flush": 0, 2024-08-31T04:38:44.371 INFO:teuthology.orchestra.run.smithi050.stdout: "ireq_fragmentdir": 0, 2024-08-31T04:38:44.371 INFO:teuthology.orchestra.run.smithi050.stdout: "ireq_fragstats": 0, 2024-08-31T04:38:44.371 INFO:teuthology.orchestra.run.smithi050.stdout: "ireq_inodestats": 0, 2024-08-31T04:38:44.371 INFO:teuthology.orchestra.run.smithi050.stdout: "uninline_started": 0, 2024-08-31T04:38:44.371 INFO:teuthology.orchestra.run.smithi050.stdout: "uninline_succeeded": 0, 2024-08-31T04:38:44.371 INFO:teuthology.orchestra.run.smithi050.stdout: "uninline_write_failed": 0 2024-08-31T04:38:44.371 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:44.371 INFO:teuthology.orchestra.run.smithi050.stdout: "mds_log": { 2024-08-31T04:38:44.371 INFO:teuthology.orchestra.run.smithi050.stdout: "evlrg": 0, 2024-08-31T04:38:44.371 INFO:teuthology.orchestra.run.smithi050.stdout: "evadd": 0, 2024-08-31T04:38:44.371 INFO:teuthology.orchestra.run.smithi050.stdout: "evex": 0, 2024-08-31T04:38:44.372 INFO:teuthology.orchestra.run.smithi050.stdout: "evtrm": 0, 2024-08-31T04:38:44.372 INFO:teuthology.orchestra.run.smithi050.stdout: "ev": 63009, 2024-08-31T04:38:44.372 INFO:teuthology.orchestra.run.smithi050.stdout: "evexg": 0, 2024-08-31T04:38:44.372 INFO:teuthology.orchestra.run.smithi050.stdout: "evexd": 0, 2024-08-31T04:38:44.372 INFO:teuthology.orchestra.run.smithi050.stdout: "segadd": 0, 2024-08-31T04:38:44.372 INFO:teuthology.orchestra.run.smithi050.stdout: "segex": 0, 2024-08-31T04:38:44.372 INFO:teuthology.orchestra.run.smithi050.stdout: "segtrm": 0, 2024-08-31T04:38:44.372 INFO:teuthology.orchestra.run.smithi050.stdout: "seg": 81, 2024-08-31T04:38:44.372 INFO:teuthology.orchestra.run.smithi050.stdout: "segmjr": 7, 2024-08-31T04:38:44.372 INFO:teuthology.orchestra.run.smithi050.stdout: "segexg": 0, 2024-08-31T04:38:44.372 INFO:teuthology.orchestra.run.smithi050.stdout: "segexd": 0, 2024-08-31T04:38:44.372 INFO:teuthology.orchestra.run.smithi050.stdout: "expos": 4194304, 2024-08-31T04:38:44.372 INFO:teuthology.orchestra.run.smithi050.stdout: "wrpos": 133320346, 2024-08-31T04:38:44.372 INFO:teuthology.orchestra.run.smithi050.stdout: "rdpos": 133311729, 2024-08-31T04:38:44.373 INFO:teuthology.orchestra.run.smithi050.stdout: "jlat": { 2024-08-31T04:38:44.373 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-08-31T04:38:44.373 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-08-31T04:38:44.373 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-08-31T04:38:44.373 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:44.373 INFO:teuthology.orchestra.run.smithi050.stdout: "replayed": 63009 2024-08-31T04:38:44.373 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:44.373 INFO:teuthology.orchestra.run.smithi050.stdout: "mds_mem": { 2024-08-31T04:38:44.373 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 13, 2024-08-31T04:38:44.373 INFO:teuthology.orchestra.run.smithi050.stdout: "ino+": 15350, 2024-08-31T04:38:44.373 INFO:teuthology.orchestra.run.smithi050.stdout: "ino-": 15337, 2024-08-31T04:38:44.373 INFO:teuthology.orchestra.run.smithi050.stdout: "dir": 11, 2024-08-31T04:38:44.373 INFO:teuthology.orchestra.run.smithi050.stdout: "dir+": 654, 2024-08-31T04:38:44.373 INFO:teuthology.orchestra.run.smithi050.stdout: "dir-": 643, 2024-08-31T04:38:44.374 INFO:teuthology.orchestra.run.smithi050.stdout: "dn": 10758, 2024-08-31T04:38:44.374 INFO:teuthology.orchestra.run.smithi050.stdout: "dn+": 35787, 2024-08-31T04:38:44.374 INFO:teuthology.orchestra.run.smithi050.stdout: "dn-": 25029, 2024-08-31T04:38:44.374 INFO:teuthology.orchestra.run.smithi050.stdout: "cap": 0, 2024-08-31T04:38:44.374 INFO:teuthology.orchestra.run.smithi050.stdout: "cap+": 0, 2024-08-31T04:38:44.374 INFO:teuthology.orchestra.run.smithi050.stdout: "cap-": 0, 2024-08-31T04:38:44.374 INFO:teuthology.orchestra.run.smithi050.stdout: "rss": 144532, 2024-08-31T04:38:44.374 INFO:teuthology.orchestra.run.smithi050.stdout: "heap": 379936768 2024-08-31T04:38:44.374 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:44.374 INFO:teuthology.orchestra.run.smithi050.stdout: "mds_server": { 2024-08-31T04:38:44.374 INFO:teuthology.orchestra.run.smithi050.stdout: "dispatch_client_request": 0, 2024-08-31T04:38:44.374 INFO:teuthology.orchestra.run.smithi050.stdout: "dispatch_server_request": 0, 2024-08-31T04:38:44.374 INFO:teuthology.orchestra.run.smithi050.stdout: "handle_client_request": 0, 2024-08-31T04:38:44.374 INFO:teuthology.orchestra.run.smithi050.stdout: "handle_client_session": 0, 2024-08-31T04:38:44.374 INFO:teuthology.orchestra.run.smithi050.stdout: "handle_peer_request": 0, 2024-08-31T04:38:44.375 INFO:teuthology.orchestra.run.smithi050.stdout: "req_create_latency": { 2024-08-31T04:38:44.375 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-08-31T04:38:44.375 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-08-31T04:38:44.375 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-08-31T04:38:44.375 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:44.375 INFO:teuthology.orchestra.run.smithi050.stdout: "req_getattr_latency": { 2024-08-31T04:38:44.375 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-08-31T04:38:44.375 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-08-31T04:38:44.375 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-08-31T04:38:44.375 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:44.375 INFO:teuthology.orchestra.run.smithi050.stdout: "req_getfilelock_latency": { 2024-08-31T04:38:44.375 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-08-31T04:38:44.375 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-08-31T04:38:44.375 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-08-31T04:38:44.375 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:44.375 INFO:teuthology.orchestra.run.smithi050.stdout: "req_link_latency": { 2024-08-31T04:38:44.376 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-08-31T04:38:44.376 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-08-31T04:38:44.376 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-08-31T04:38:44.376 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:44.376 INFO:teuthology.orchestra.run.smithi050.stdout: "req_lookup_latency": { 2024-08-31T04:38:44.376 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-08-31T04:38:44.376 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-08-31T04:38:44.376 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-08-31T04:38:44.376 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:44.376 INFO:teuthology.orchestra.run.smithi050.stdout: "req_lookuphash_latency": { 2024-08-31T04:38:44.376 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-08-31T04:38:44.376 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-08-31T04:38:44.376 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-08-31T04:38:44.376 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:44.376 INFO:teuthology.orchestra.run.smithi050.stdout: "req_lookupino_latency": { 2024-08-31T04:38:44.377 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-08-31T04:38:44.377 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-08-31T04:38:44.377 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-08-31T04:38:44.377 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:44.377 INFO:teuthology.orchestra.run.smithi050.stdout: "req_lookupname_latency": { 2024-08-31T04:38:44.377 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-08-31T04:38:44.377 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-08-31T04:38:44.377 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-08-31T04:38:44.377 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:44.377 INFO:teuthology.orchestra.run.smithi050.stdout: "req_lookupparent_latency": { 2024-08-31T04:38:44.377 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-08-31T04:38:44.377 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-08-31T04:38:44.377 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-08-31T04:38:44.377 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:44.377 INFO:teuthology.orchestra.run.smithi050.stdout: "req_lookupsnap_latency": { 2024-08-31T04:38:44.378 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-08-31T04:38:44.378 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-08-31T04:38:44.378 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-08-31T04:38:44.378 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:44.378 INFO:teuthology.orchestra.run.smithi050.stdout: "req_lssnap_latency": { 2024-08-31T04:38:44.378 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-08-31T04:38:44.378 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-08-31T04:38:44.378 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-08-31T04:38:44.378 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:44.379 INFO:teuthology.orchestra.run.smithi050.stdout: "req_mkdir_latency": { 2024-08-31T04:38:44.379 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-08-31T04:38:44.379 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-08-31T04:38:44.379 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-08-31T04:38:44.379 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:44.379 INFO:teuthology.orchestra.run.smithi050.stdout: "req_mknod_latency": { 2024-08-31T04:38:44.379 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-08-31T04:38:44.379 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-08-31T04:38:44.379 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-08-31T04:38:44.379 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:44.379 INFO:teuthology.orchestra.run.smithi050.stdout: "req_mksnap_latency": { 2024-08-31T04:38:44.379 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-08-31T04:38:44.379 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-08-31T04:38:44.379 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-08-31T04:38:44.380 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:44.380 INFO:teuthology.orchestra.run.smithi050.stdout: "req_open_latency": { 2024-08-31T04:38:44.380 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-08-31T04:38:44.380 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-08-31T04:38:44.380 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-08-31T04:38:44.380 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:44.380 INFO:teuthology.orchestra.run.smithi050.stdout: "req_readdir_latency": { 2024-08-31T04:38:44.380 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-08-31T04:38:44.380 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-08-31T04:38:44.380 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-08-31T04:38:44.380 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:44.380 INFO:teuthology.orchestra.run.smithi050.stdout: "req_rename_latency": { 2024-08-31T04:38:44.380 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-08-31T04:38:44.380 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-08-31T04:38:44.381 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-08-31T04:38:44.381 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:44.381 INFO:teuthology.orchestra.run.smithi050.stdout: "req_renamesnap_latency": { 2024-08-31T04:38:44.381 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-08-31T04:38:44.381 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-08-31T04:38:44.381 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-08-31T04:38:44.381 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:44.381 INFO:teuthology.orchestra.run.smithi050.stdout: "req_snapdiff_latency": { 2024-08-31T04:38:44.381 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-08-31T04:38:44.381 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-08-31T04:38:44.381 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-08-31T04:38:44.381 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:44.381 INFO:teuthology.orchestra.run.smithi050.stdout: "req_rmdir_latency": { 2024-08-31T04:38:44.381 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-08-31T04:38:44.382 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-08-31T04:38:44.382 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-08-31T04:38:44.382 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:44.382 INFO:teuthology.orchestra.run.smithi050.stdout: "req_rmsnap_latency": { 2024-08-31T04:38:44.382 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-08-31T04:38:44.382 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-08-31T04:38:44.382 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-08-31T04:38:44.382 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:44.382 INFO:teuthology.orchestra.run.smithi050.stdout: "req_rmxattr_latency": { 2024-08-31T04:38:44.382 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-08-31T04:38:44.382 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-08-31T04:38:44.382 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-08-31T04:38:44.382 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:44.382 INFO:teuthology.orchestra.run.smithi050.stdout: "req_setattr_latency": { 2024-08-31T04:38:44.382 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-08-31T04:38:44.383 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-08-31T04:38:44.383 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-08-31T04:38:44.383 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:44.383 INFO:teuthology.orchestra.run.smithi050.stdout: "req_setdirlayout_latency": { 2024-08-31T04:38:44.383 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-08-31T04:38:44.383 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-08-31T04:38:44.383 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-08-31T04:38:44.383 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:44.383 INFO:teuthology.orchestra.run.smithi050.stdout: "req_setfilelock_latency": { 2024-08-31T04:38:44.383 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-08-31T04:38:44.383 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-08-31T04:38:44.383 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-08-31T04:38:44.383 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:44.383 INFO:teuthology.orchestra.run.smithi050.stdout: "req_setlayout_latency": { 2024-08-31T04:38:44.384 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-08-31T04:38:44.384 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-08-31T04:38:44.384 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-08-31T04:38:44.384 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:44.384 INFO:teuthology.orchestra.run.smithi050.stdout: "req_setxattr_latency": { 2024-08-31T04:38:44.384 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-08-31T04:38:44.384 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-08-31T04:38:44.384 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-08-31T04:38:44.384 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:44.384 INFO:teuthology.orchestra.run.smithi050.stdout: "req_symlink_latency": { 2024-08-31T04:38:44.384 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-08-31T04:38:44.384 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-08-31T04:38:44.384 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-08-31T04:38:44.384 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:44.385 INFO:teuthology.orchestra.run.smithi050.stdout: "req_unlink_latency": { 2024-08-31T04:38:44.385 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-08-31T04:38:44.385 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-08-31T04:38:44.385 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-08-31T04:38:44.385 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:44.385 INFO:teuthology.orchestra.run.smithi050.stdout: "cap_revoke_eviction": 0, 2024-08-31T04:38:44.385 INFO:teuthology.orchestra.run.smithi050.stdout: "cap_acquisition_throttle": 0, 2024-08-31T04:38:44.385 INFO:teuthology.orchestra.run.smithi050.stdout: "req_getvxattr_latency": { 2024-08-31T04:38:44.385 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-08-31T04:38:44.385 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-08-31T04:38:44.385 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-08-31T04:38:44.385 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T04:38:44.385 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:44.386 INFO:teuthology.orchestra.run.smithi050.stdout: "mds_sessions": { 2024-08-31T04:38:44.386 INFO:teuthology.orchestra.run.smithi050.stdout: "session_count": 1, 2024-08-31T04:38:44.386 INFO:teuthology.orchestra.run.smithi050.stdout: "session_add": 1, 2024-08-31T04:38:44.386 INFO:teuthology.orchestra.run.smithi050.stdout: "session_remove": 0, 2024-08-31T04:38:44.386 INFO:teuthology.orchestra.run.smithi050.stdout: "sessions_open": 1, 2024-08-31T04:38:44.386 INFO:teuthology.orchestra.run.smithi050.stdout: "sessions_stale": 0, 2024-08-31T04:38:44.386 INFO:teuthology.orchestra.run.smithi050.stdout: "total_load": 0, 2024-08-31T04:38:44.386 INFO:teuthology.orchestra.run.smithi050.stdout: "average_load": 0, 2024-08-31T04:38:44.386 INFO:teuthology.orchestra.run.smithi050.stdout: "avg_session_uptime": 1969, 2024-08-31T04:38:44.386 INFO:teuthology.orchestra.run.smithi050.stdout: "mdthresh_evicted": 0 2024-08-31T04:38:44.386 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:44.386 INFO:teuthology.orchestra.run.smithi050.stdout: "mempool": { 2024-08-31T04:38:44.386 INFO:teuthology.orchestra.run.smithi050.stdout: "bloom_filter_bytes": 0, 2024-08-31T04:38:44.386 INFO:teuthology.orchestra.run.smithi050.stdout: "bloom_filter_items": 0, 2024-08-31T04:38:44.386 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_alloc_bytes": 0, 2024-08-31T04:38:44.387 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_alloc_items": 0, 2024-08-31T04:38:44.387 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_cache_data_bytes": 0, 2024-08-31T04:38:44.387 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_cache_data_items": 0, 2024-08-31T04:38:44.387 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_cache_onode_bytes": 0, 2024-08-31T04:38:44.387 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_cache_onode_items": 0, 2024-08-31T04:38:44.387 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_cache_meta_bytes": 0, 2024-08-31T04:38:44.387 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_cache_meta_items": 0, 2024-08-31T04:38:44.387 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_cache_other_bytes": 0, 2024-08-31T04:38:44.387 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_cache_other_items": 0, 2024-08-31T04:38:44.387 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_cache_buffer_bytes": 0, 2024-08-31T04:38:44.387 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_cache_buffer_items": 0, 2024-08-31T04:38:44.387 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_extent_bytes": 0, 2024-08-31T04:38:44.387 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_extent_items": 0, 2024-08-31T04:38:44.387 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_blob_bytes": 0, 2024-08-31T04:38:44.388 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_blob_items": 0, 2024-08-31T04:38:44.388 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_shared_blob_bytes": 0, 2024-08-31T04:38:44.388 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_shared_blob_items": 0, 2024-08-31T04:38:44.388 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_inline_bl_bytes": 0, 2024-08-31T04:38:44.388 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_inline_bl_items": 0, 2024-08-31T04:38:44.388 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_fsck_bytes": 0, 2024-08-31T04:38:44.388 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_fsck_items": 0, 2024-08-31T04:38:44.389 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_txc_bytes": 0, 2024-08-31T04:38:44.389 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_txc_items": 0, 2024-08-31T04:38:44.389 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_writing_deferred_bytes": 0, 2024-08-31T04:38:44.389 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_writing_deferred_items": 0, 2024-08-31T04:38:44.389 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_writing_bytes": 0, 2024-08-31T04:38:44.389 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_writing_items": 0, 2024-08-31T04:38:44.389 INFO:teuthology.orchestra.run.smithi050.stdout: "bluefs_bytes": 0, 2024-08-31T04:38:44.389 INFO:teuthology.orchestra.run.smithi050.stdout: "bluefs_items": 0, 2024-08-31T04:38:44.389 INFO:teuthology.orchestra.run.smithi050.stdout: "bluefs_file_reader_bytes": 0, 2024-08-31T04:38:44.389 INFO:teuthology.orchestra.run.smithi050.stdout: "bluefs_file_reader_items": 0, 2024-08-31T04:38:44.389 INFO:teuthology.orchestra.run.smithi050.stdout: "bluefs_file_writer_bytes": 0, 2024-08-31T04:38:44.389 INFO:teuthology.orchestra.run.smithi050.stdout: "bluefs_file_writer_items": 0, 2024-08-31T04:38:44.389 INFO:teuthology.orchestra.run.smithi050.stdout: "buffer_anon_bytes": 239431, 2024-08-31T04:38:44.390 INFO:teuthology.orchestra.run.smithi050.stdout: "buffer_anon_items": 78, 2024-08-31T04:38:44.390 INFO:teuthology.orchestra.run.smithi050.stdout: "buffer_meta_bytes": 0, 2024-08-31T04:38:44.390 INFO:teuthology.orchestra.run.smithi050.stdout: "buffer_meta_items": 0, 2024-08-31T04:38:44.390 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_bytes": 0, 2024-08-31T04:38:44.390 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_items": 0, 2024-08-31T04:38:44.390 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_mapbl_bytes": 0, 2024-08-31T04:38:44.390 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_mapbl_items": 0, 2024-08-31T04:38:44.390 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_pglog_bytes": 0, 2024-08-31T04:38:44.390 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_pglog_items": 0, 2024-08-31T04:38:44.390 INFO:teuthology.orchestra.run.smithi050.stdout: "osdmap_bytes": 7504, 2024-08-31T04:38:44.390 INFO:teuthology.orchestra.run.smithi050.stdout: "osdmap_items": 155, 2024-08-31T04:38:44.390 INFO:teuthology.orchestra.run.smithi050.stdout: "osdmap_mapping_bytes": 0, 2024-08-31T04:38:44.390 INFO:teuthology.orchestra.run.smithi050.stdout: "osdmap_mapping_items": 0, 2024-08-31T04:38:44.391 INFO:teuthology.orchestra.run.smithi050.stdout: "pgmap_bytes": 0, 2024-08-31T04:38:44.391 INFO:teuthology.orchestra.run.smithi050.stdout: "pgmap_items": 0, 2024-08-31T04:38:44.391 INFO:teuthology.orchestra.run.smithi050.stdout: "mds_co_bytes": 7359032, 2024-08-31T04:38:44.391 INFO:teuthology.orchestra.run.smithi050.stdout: "mds_co_items": 43160, 2024-08-31T04:38:44.391 INFO:teuthology.orchestra.run.smithi050.stdout: "unittest_1_bytes": 0, 2024-08-31T04:38:44.391 INFO:teuthology.orchestra.run.smithi050.stdout: "unittest_1_items": 0, 2024-08-31T04:38:44.391 INFO:teuthology.orchestra.run.smithi050.stdout: "unittest_2_bytes": 0, 2024-08-31T04:38:44.391 INFO:teuthology.orchestra.run.smithi050.stdout: "unittest_2_items": 0 2024-08-31T04:38:44.391 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:44.391 INFO:teuthology.orchestra.run.smithi050.stdout: "objecter": { 2024-08-31T04:38:44.391 INFO:teuthology.orchestra.run.smithi050.stdout: "op_active": 0, 2024-08-31T04:38:44.391 INFO:teuthology.orchestra.run.smithi050.stdout: "op_laggy": 0, 2024-08-31T04:38:44.391 INFO:teuthology.orchestra.run.smithi050.stdout: "op_send": 3388, 2024-08-31T04:38:44.392 INFO:teuthology.orchestra.run.smithi050.stdout: "op_send_bytes": 21, 2024-08-31T04:38:44.392 INFO:teuthology.orchestra.run.smithi050.stdout: "op_resend": 3, 2024-08-31T04:38:44.392 INFO:teuthology.orchestra.run.smithi050.stdout: "op_reply": 3388, 2024-08-31T04:38:44.392 INFO:teuthology.orchestra.run.smithi050.stdout: "op_latency": { 2024-08-31T04:38:44.392 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 3388, 2024-08-31T04:38:44.392 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 11.132721664, 2024-08-31T04:38:44.392 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.003285927 2024-08-31T04:38:44.392 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:44.392 INFO:teuthology.orchestra.run.smithi050.stdout: "op_inflight": 0, 2024-08-31T04:38:44.392 INFO:teuthology.orchestra.run.smithi050.stdout: "oplen_avg": { 2024-08-31T04:38:44.392 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 3388, 2024-08-31T04:38:44.392 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 3389 2024-08-31T04:38:44.392 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:44.393 INFO:teuthology.orchestra.run.smithi050.stdout: "op": 3388, 2024-08-31T04:38:44.393 INFO:teuthology.orchestra.run.smithi050.stdout: "op_r": 3388, 2024-08-31T04:38:44.393 INFO:teuthology.orchestra.run.smithi050.stdout: "op_w": 0, 2024-08-31T04:38:44.393 INFO:teuthology.orchestra.run.smithi050.stdout: "op_rmw": 0, 2024-08-31T04:38:44.393 INFO:teuthology.orchestra.run.smithi050.stdout: "op_pg": 0, 2024-08-31T04:38:44.393 INFO:teuthology.orchestra.run.smithi050.stdout: "osdop_stat": 2005, 2024-08-31T04:38:44.393 INFO:teuthology.orchestra.run.smithi050.stdout: "osdop_create": 0, 2024-08-31T04:38:44.393 INFO:teuthology.orchestra.run.smithi050.stdout: "osdop_read": 1381, 2024-08-31T04:38:44.393 INFO:teuthology.orchestra.run.smithi050.stdout: "osdop_write": 0, 2024-08-31T04:38:44.393 INFO:teuthology.orchestra.run.smithi050.stdout: "osdop_writefull": 0, 2024-08-31T04:38:44.393 INFO:teuthology.orchestra.run.smithi050.stdout: "osdop_writesame": 0, 2024-08-31T04:38:44.393 INFO:teuthology.orchestra.run.smithi050.stdout: "osdop_append": 0, 2024-08-31T04:38:44.393 INFO:teuthology.orchestra.run.smithi050.stdout: "osdop_zero": 0, 2024-08-31T04:38:44.393 INFO:teuthology.orchestra.run.smithi050.stdout: "osdop_truncate": 0, 2024-08-31T04:38:44.394 INFO:teuthology.orchestra.run.smithi050.stdout: "osdop_delete": 0, 2024-08-31T04:38:44.394 INFO:teuthology.orchestra.run.smithi050.stdout: "osdop_mapext": 0, 2024-08-31T04:38:44.394 INFO:teuthology.orchestra.run.smithi050.stdout: "osdop_sparse_read": 0, 2024-08-31T04:38:44.394 INFO:teuthology.orchestra.run.smithi050.stdout: "osdop_clonerange": 0, 2024-08-31T04:38:44.394 INFO:teuthology.orchestra.run.smithi050.stdout: "osdop_getxattr": 1, 2024-08-31T04:38:44.394 INFO:teuthology.orchestra.run.smithi050.stdout: "osdop_setxattr": 0, 2024-08-31T04:38:44.394 INFO:teuthology.orchestra.run.smithi050.stdout: "osdop_cmpxattr": 0, 2024-08-31T04:38:44.394 INFO:teuthology.orchestra.run.smithi050.stdout: "osdop_rmxattr": 0, 2024-08-31T04:38:44.394 INFO:teuthology.orchestra.run.smithi050.stdout: "osdop_resetxattrs": 0, 2024-08-31T04:38:44.395 INFO:teuthology.orchestra.run.smithi050.stdout: "osdop_call": 0, 2024-08-31T04:38:44.396 INFO:teuthology.orchestra.run.smithi050.stdout: "osdop_watch": 0, 2024-08-31T04:38:44.396 INFO:teuthology.orchestra.run.smithi050.stdout: "osdop_notify": 0, 2024-08-31T04:38:44.396 INFO:teuthology.orchestra.run.smithi050.stdout: "osdop_src_cmpxattr": 0, 2024-08-31T04:38:44.396 INFO:teuthology.orchestra.run.smithi050.stdout: "osdop_pgls": 0, 2024-08-31T04:38:44.396 INFO:teuthology.orchestra.run.smithi050.stdout: "osdop_pgls_filter": 0, 2024-08-31T04:38:44.396 INFO:teuthology.orchestra.run.smithi050.stdout: "osdop_other": 0, 2024-08-31T04:38:44.396 INFO:teuthology.orchestra.run.smithi050.stdout: "linger_active": 0, 2024-08-31T04:38:44.396 INFO:teuthology.orchestra.run.smithi050.stdout: "linger_send": 0, 2024-08-31T04:38:44.396 INFO:teuthology.orchestra.run.smithi050.stdout: "linger_resend": 0, 2024-08-31T04:38:44.396 INFO:teuthology.orchestra.run.smithi050.stdout: "linger_ping": 0, 2024-08-31T04:38:44.396 INFO:teuthology.orchestra.run.smithi050.stdout: "poolop_active": 0, 2024-08-31T04:38:44.396 INFO:teuthology.orchestra.run.smithi050.stdout: "poolop_send": 0, 2024-08-31T04:38:44.396 INFO:teuthology.orchestra.run.smithi050.stdout: "poolop_resend": 0, 2024-08-31T04:38:44.396 INFO:teuthology.orchestra.run.smithi050.stdout: "poolstat_active": 0, 2024-08-31T04:38:44.397 INFO:teuthology.orchestra.run.smithi050.stdout: "poolstat_send": 0, 2024-08-31T04:38:44.397 INFO:teuthology.orchestra.run.smithi050.stdout: "poolstat_resend": 0, 2024-08-31T04:38:44.397 INFO:teuthology.orchestra.run.smithi050.stdout: "statfs_active": 0, 2024-08-31T04:38:44.397 INFO:teuthology.orchestra.run.smithi050.stdout: "statfs_send": 0, 2024-08-31T04:38:44.397 INFO:teuthology.orchestra.run.smithi050.stdout: "statfs_resend": 0, 2024-08-31T04:38:44.397 INFO:teuthology.orchestra.run.smithi050.stdout: "command_active": 0, 2024-08-31T04:38:44.397 INFO:teuthology.orchestra.run.smithi050.stdout: "command_send": 0, 2024-08-31T04:38:44.397 INFO:teuthology.orchestra.run.smithi050.stdout: "command_resend": 0, 2024-08-31T04:38:44.397 INFO:teuthology.orchestra.run.smithi050.stdout: "map_epoch": 80, 2024-08-31T04:38:44.397 INFO:teuthology.orchestra.run.smithi050.stdout: "map_full": 0, 2024-08-31T04:38:44.397 INFO:teuthology.orchestra.run.smithi050.stdout: "map_inc": 2, 2024-08-31T04:38:44.397 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_sessions": 11, 2024-08-31T04:38:44.397 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_session_open": 11, 2024-08-31T04:38:44.397 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_session_close": 0, 2024-08-31T04:38:44.398 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_laggy": 0, 2024-08-31T04:38:44.398 INFO:teuthology.orchestra.run.smithi050.stdout: "omap_wr": 0, 2024-08-31T04:38:44.398 INFO:teuthology.orchestra.run.smithi050.stdout: "omap_rd": 2, 2024-08-31T04:38:44.398 INFO:teuthology.orchestra.run.smithi050.stdout: "omap_del": 0 2024-08-31T04:38:44.398 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:44.398 INFO:teuthology.orchestra.run.smithi050.stdout: "oft": { 2024-08-31T04:38:44.398 INFO:teuthology.orchestra.run.smithi050.stdout: "omap_total_objs": 0, 2024-08-31T04:38:44.398 INFO:teuthology.orchestra.run.smithi050.stdout: "omap_total_kv_pairs": 0, 2024-08-31T04:38:44.398 INFO:teuthology.orchestra.run.smithi050.stdout: "omap_total_updates": 0, 2024-08-31T04:38:44.398 INFO:teuthology.orchestra.run.smithi050.stdout: "omap_total_removes": 0 2024-08-31T04:38:44.398 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:44.398 INFO:teuthology.orchestra.run.smithi050.stdout: "purge_queue": { 2024-08-31T04:38:44.398 INFO:teuthology.orchestra.run.smithi050.stdout: "pq_executing_ops": 0, 2024-08-31T04:38:44.398 INFO:teuthology.orchestra.run.smithi050.stdout: "pq_executing_ops_high_water": 0, 2024-08-31T04:38:44.398 INFO:teuthology.orchestra.run.smithi050.stdout: "pq_executing": 0, 2024-08-31T04:38:44.399 INFO:teuthology.orchestra.run.smithi050.stdout: "pq_executing_high_water": 0, 2024-08-31T04:38:44.399 INFO:teuthology.orchestra.run.smithi050.stdout: "pq_executed_ops": 0, 2024-08-31T04:38:44.399 INFO:teuthology.orchestra.run.smithi050.stdout: "pq_executed": 0, 2024-08-31T04:38:44.399 INFO:teuthology.orchestra.run.smithi050.stdout: "pq_item_in_journal": 0 2024-08-31T04:38:44.399 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:44.399 INFO:teuthology.orchestra.run.smithi050.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-08-31T04:38:44.399 INFO:teuthology.orchestra.run.smithi050.stdout: "val": 0, 2024-08-31T04:38:44.399 INFO:teuthology.orchestra.run.smithi050.stdout: "max": 104857600, 2024-08-31T04:38:44.399 INFO:teuthology.orchestra.run.smithi050.stdout: "get_started": 0, 2024-08-31T04:38:44.399 INFO:teuthology.orchestra.run.smithi050.stdout: "get": 3734, 2024-08-31T04:38:44.399 INFO:teuthology.orchestra.run.smithi050.stdout: "get_sum": 130573125, 2024-08-31T04:38:44.399 INFO:teuthology.orchestra.run.smithi050.stdout: "get_or_fail_fail": 0, 2024-08-31T04:38:44.399 INFO:teuthology.orchestra.run.smithi050.stdout: "get_or_fail_success": 3734, 2024-08-31T04:38:44.400 INFO:teuthology.orchestra.run.smithi050.stdout: "take": 0, 2024-08-31T04:38:44.400 INFO:teuthology.orchestra.run.smithi050.stdout: "take_sum": 0, 2024-08-31T04:38:44.400 INFO:teuthology.orchestra.run.smithi050.stdout: "put": 3734, 2024-08-31T04:38:44.400 INFO:teuthology.orchestra.run.smithi050.stdout: "put_sum": 130573125, 2024-08-31T04:38:44.400 INFO:teuthology.orchestra.run.smithi050.stdout: "wait": { 2024-08-31T04:38:44.400 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-08-31T04:38:44.400 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-08-31T04:38:44.400 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-08-31T04:38:44.400 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T04:38:44.400 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:44.400 INFO:teuthology.orchestra.run.smithi050.stdout: "throttle-objecter_bytes": { 2024-08-31T04:38:44.400 INFO:teuthology.orchestra.run.smithi050.stdout: "val": 0, 2024-08-31T04:38:44.400 INFO:teuthology.orchestra.run.smithi050.stdout: "max": 104857600, 2024-08-31T04:38:44.401 INFO:teuthology.orchestra.run.smithi050.stdout: "get_started": 0, 2024-08-31T04:38:44.401 INFO:teuthology.orchestra.run.smithi050.stdout: "get": 0, 2024-08-31T04:38:44.401 INFO:teuthology.orchestra.run.smithi050.stdout: "get_sum": 0, 2024-08-31T04:38:44.401 INFO:teuthology.orchestra.run.smithi050.stdout: "get_or_fail_fail": 0, 2024-08-31T04:38:44.401 INFO:teuthology.orchestra.run.smithi050.stdout: "get_or_fail_success": 0, 2024-08-31T04:38:44.401 INFO:teuthology.orchestra.run.smithi050.stdout: "take": 3388, 2024-08-31T04:38:44.401 INFO:teuthology.orchestra.run.smithi050.stdout: "take_sum": 129134618, 2024-08-31T04:38:44.401 INFO:teuthology.orchestra.run.smithi050.stdout: "put": 3388, 2024-08-31T04:38:44.401 INFO:teuthology.orchestra.run.smithi050.stdout: "put_sum": 129134618, 2024-08-31T04:38:44.401 INFO:teuthology.orchestra.run.smithi050.stdout: "wait": { 2024-08-31T04:38:44.401 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-08-31T04:38:44.401 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-08-31T04:38:44.401 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-08-31T04:38:44.401 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T04:38:44.401 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:44.401 INFO:teuthology.orchestra.run.smithi050.stdout: "throttle-objecter_ops": { 2024-08-31T04:38:44.402 INFO:teuthology.orchestra.run.smithi050.stdout: "val": 0, 2024-08-31T04:38:44.402 INFO:teuthology.orchestra.run.smithi050.stdout: "max": 1024, 2024-08-31T04:38:44.402 INFO:teuthology.orchestra.run.smithi050.stdout: "get_started": 0, 2024-08-31T04:38:44.402 INFO:teuthology.orchestra.run.smithi050.stdout: "get": 0, 2024-08-31T04:38:44.402 INFO:teuthology.orchestra.run.smithi050.stdout: "get_sum": 0, 2024-08-31T04:38:44.402 INFO:teuthology.orchestra.run.smithi050.stdout: "get_or_fail_fail": 0, 2024-08-31T04:38:44.402 INFO:teuthology.orchestra.run.smithi050.stdout: "get_or_fail_success": 0, 2024-08-31T04:38:44.402 INFO:teuthology.orchestra.run.smithi050.stdout: "take": 3388, 2024-08-31T04:38:44.402 INFO:teuthology.orchestra.run.smithi050.stdout: "take_sum": 3388, 2024-08-31T04:38:44.402 INFO:teuthology.orchestra.run.smithi050.stdout: "put": 3388, 2024-08-31T04:38:44.402 INFO:teuthology.orchestra.run.smithi050.stdout: "put_sum": 3388, 2024-08-31T04:38:44.402 INFO:teuthology.orchestra.run.smithi050.stdout: "wait": { 2024-08-31T04:38:44.402 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-08-31T04:38:44.402 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-08-31T04:38:44.402 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-08-31T04:38:44.403 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T04:38:44.403 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:44.403 INFO:teuthology.orchestra.run.smithi050.stdout: "throttle-write_buf_throttle": { 2024-08-31T04:38:44.403 INFO:teuthology.orchestra.run.smithi050.stdout: "val": 0, 2024-08-31T04:38:44.403 INFO:teuthology.orchestra.run.smithi050.stdout: "max": 3758096384, 2024-08-31T04:38:44.403 INFO:teuthology.orchestra.run.smithi050.stdout: "get_started": 0, 2024-08-31T04:38:44.403 INFO:teuthology.orchestra.run.smithi050.stdout: "get": 0, 2024-08-31T04:38:44.403 INFO:teuthology.orchestra.run.smithi050.stdout: "get_sum": 0, 2024-08-31T04:38:44.403 INFO:teuthology.orchestra.run.smithi050.stdout: "get_or_fail_fail": 0, 2024-08-31T04:38:44.403 INFO:teuthology.orchestra.run.smithi050.stdout: "get_or_fail_success": 0, 2024-08-31T04:38:44.403 INFO:teuthology.orchestra.run.smithi050.stdout: "take": 0, 2024-08-31T04:38:44.403 INFO:teuthology.orchestra.run.smithi050.stdout: "take_sum": 0, 2024-08-31T04:38:44.403 INFO:teuthology.orchestra.run.smithi050.stdout: "put": 0, 2024-08-31T04:38:44.404 INFO:teuthology.orchestra.run.smithi050.stdout: "put_sum": 0, 2024-08-31T04:38:44.404 INFO:teuthology.orchestra.run.smithi050.stdout: "wait": { 2024-08-31T04:38:44.404 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-08-31T04:38:44.404 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-08-31T04:38:44.404 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-08-31T04:38:44.404 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T04:38:44.404 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:44.404 INFO:teuthology.orchestra.run.smithi050.stdout: "throttle-write_buf_throttle-0x55e212ad89c0": { 2024-08-31T04:38:44.404 INFO:teuthology.orchestra.run.smithi050.stdout: "val": 0, 2024-08-31T04:38:44.404 INFO:teuthology.orchestra.run.smithi050.stdout: "max": 3758096384, 2024-08-31T04:38:44.404 INFO:teuthology.orchestra.run.smithi050.stdout: "get_started": 0, 2024-08-31T04:38:44.404 INFO:teuthology.orchestra.run.smithi050.stdout: "get": 0, 2024-08-31T04:38:44.404 INFO:teuthology.orchestra.run.smithi050.stdout: "get_sum": 0, 2024-08-31T04:38:44.405 INFO:teuthology.orchestra.run.smithi050.stdout: "get_or_fail_fail": 0, 2024-08-31T04:38:44.405 INFO:teuthology.orchestra.run.smithi050.stdout: "get_or_fail_success": 0, 2024-08-31T04:38:44.405 INFO:teuthology.orchestra.run.smithi050.stdout: "take": 0, 2024-08-31T04:38:44.405 INFO:teuthology.orchestra.run.smithi050.stdout: "take_sum": 0, 2024-08-31T04:38:44.405 INFO:teuthology.orchestra.run.smithi050.stdout: "put": 0, 2024-08-31T04:38:44.405 INFO:teuthology.orchestra.run.smithi050.stdout: "put_sum": 0, 2024-08-31T04:38:44.405 INFO:teuthology.orchestra.run.smithi050.stdout: "wait": { 2024-08-31T04:38:44.405 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-08-31T04:38:44.405 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-08-31T04:38:44.405 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-08-31T04:38:44.405 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T04:38:44.405 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:44.405 INFO:teuthology.orchestra.run.smithi050.stdout: "trackedop": { 2024-08-31T04:38:44.405 INFO:teuthology.orchestra.run.smithi050.stdout: "slow_ops_count": 0 2024-08-31T04:38:44.405 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T04:38:44.406 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-08-31T04:38:45.249 INFO:tasks.check_counter:Daemon mds.g mds.exported=0 2024-08-31T04:38:45.249 INFO:tasks.check_counter:Daemon mds.g mds.imported=0 2024-08-31T04:38:45.249 INFO:tasks.check_counter:Daemon mds.g mds_cache.dir_update=0 2024-08-31T04:38:45.249 INFO:tasks.check_counter:Daemon mds.g mds_cache.dir_update_receipt=0 2024-08-31T04:38:45.249 INFO:tasks.check_counter:Daemon mds.g mds.dir_split=0 2024-08-31T04:38:45.250 DEBUG:tasks.check_counter:Getting stats from j 2024-08-31T04:38:45.250 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 058d9fc6-674f-11ef-bcd4-c7b262605968 -- ceph daemon mds.j perf dump 2024-08-31T04:38:45.627 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:38:45.878 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:38:45 smithi050 ceph-mon[17259]: pgmap v844: 97 pgs: 97 active+clean; 592 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 9.2 KiB/s wr, 50 op/s 2024-08-31T04:38:45.996 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:38:45 smithi177 ceph-mon[22025]: pgmap v844: 97 pgs: 97 active+clean; 592 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 9.2 KiB/s wr, 50 op/s 2024-08-31T04:38:46.043 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:38:45 smithi133 ceph-mon[22177]: pgmap v844: 97 pgs: 97 active+clean; 592 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 9.2 KiB/s wr, 50 op/s 2024-08-31T04:38:46.331 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-08-31T04:38:46.331 INFO:teuthology.orchestra.run.smithi050.stdout: "AsyncMessenger::Worker-0": { 2024-08-31T04:38:46.332 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_recv_messages": 0, 2024-08-31T04:38:46.332 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_send_messages": 2, 2024-08-31T04:38:46.332 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_recv_bytes": 0, 2024-08-31T04:38:46.332 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_send_bytes": 0, 2024-08-31T04:38:46.332 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_created_connections": 4, 2024-08-31T04:38:46.332 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_active_connections": 0, 2024-08-31T04:38:46.332 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_running_total_time": 0.003445090, 2024-08-31T04:38:46.332 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_running_send_time": 0.000000000, 2024-08-31T04:38:46.332 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_running_recv_time": 0.000866549, 2024-08-31T04:38:46.332 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-08-31T04:38:46.332 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_send_messages_queue_lat": { 2024-08-31T04:38:46.332 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-08-31T04:38:46.332 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-08-31T04:38:46.333 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-08-31T04:38:46.333 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:46.333 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_handle_ack_lat": { 2024-08-31T04:38:46.333 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-08-31T04:38:46.333 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-08-31T04:38:46.333 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-08-31T04:38:46.333 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:46.333 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_recv_encrypted_bytes": 0, 2024-08-31T04:38:46.333 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_send_encrypted_bytes": 0 2024-08-31T04:38:46.333 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:46.333 INFO:teuthology.orchestra.run.smithi050.stdout: "AsyncMessenger::Worker-1": { 2024-08-31T04:38:46.333 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_recv_messages": 2, 2024-08-31T04:38:46.333 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_send_messages": 229, 2024-08-31T04:38:46.333 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_recv_bytes": 320, 2024-08-31T04:38:46.334 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_send_bytes": 200528, 2024-08-31T04:38:46.334 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_created_connections": 4, 2024-08-31T04:38:46.334 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_active_connections": 2, 2024-08-31T04:38:46.334 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_running_total_time": 0.028950098, 2024-08-31T04:38:46.334 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_running_send_time": 0.023606650, 2024-08-31T04:38:46.334 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_running_recv_time": 0.002637199, 2024-08-31T04:38:46.334 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-08-31T04:38:46.334 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_send_messages_queue_lat": { 2024-08-31T04:38:46.334 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 227, 2024-08-31T04:38:46.334 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.029618551, 2024-08-31T04:38:46.334 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000130478 2024-08-31T04:38:46.334 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:46.335 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_handle_ack_lat": { 2024-08-31T04:38:46.335 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-08-31T04:38:46.335 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-08-31T04:38:46.335 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-08-31T04:38:46.335 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:46.335 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_recv_encrypted_bytes": 320, 2024-08-31T04:38:46.335 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_send_encrypted_bytes": 200528 2024-08-31T04:38:46.335 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:46.335 INFO:teuthology.orchestra.run.smithi050.stdout: "AsyncMessenger::Worker-2": { 2024-08-31T04:38:46.335 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_recv_messages": 306, 2024-08-31T04:38:46.335 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_send_messages": 301, 2024-08-31T04:38:46.335 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_recv_bytes": 549408, 2024-08-31T04:38:46.335 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_send_bytes": 185168, 2024-08-31T04:38:46.335 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_created_connections": 2, 2024-08-31T04:38:46.335 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_active_connections": 1, 2024-08-31T04:38:46.336 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_running_total_time": 0.073472322, 2024-08-31T04:38:46.336 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_running_send_time": 0.039867140, 2024-08-31T04:38:46.336 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_running_recv_time": 0.040806748, 2024-08-31T04:38:46.336 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-08-31T04:38:46.336 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_send_messages_queue_lat": { 2024-08-31T04:38:46.336 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 301, 2024-08-31T04:38:46.336 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.031544197, 2024-08-31T04:38:46.336 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000104797 2024-08-31T04:38:46.336 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:46.336 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_handle_ack_lat": { 2024-08-31T04:38:46.336 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-08-31T04:38:46.336 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-08-31T04:38:46.336 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-08-31T04:38:46.337 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:46.337 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_recv_encrypted_bytes": 549408, 2024-08-31T04:38:46.337 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_send_encrypted_bytes": 185168 2024-08-31T04:38:46.337 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:46.337 INFO:teuthology.orchestra.run.smithi050.stdout: "cct": { 2024-08-31T04:38:46.337 INFO:teuthology.orchestra.run.smithi050.stdout: "total_workers": 0, 2024-08-31T04:38:46.337 INFO:teuthology.orchestra.run.smithi050.stdout: "unhealthy_workers": 0 2024-08-31T04:38:46.337 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:46.337 INFO:teuthology.orchestra.run.smithi050.stdout: "mempool": { 2024-08-31T04:38:46.337 INFO:teuthology.orchestra.run.smithi050.stdout: "bloom_filter_bytes": 0, 2024-08-31T04:38:46.337 INFO:teuthology.orchestra.run.smithi050.stdout: "bloom_filter_items": 0, 2024-08-31T04:38:46.337 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_alloc_bytes": 0, 2024-08-31T04:38:46.337 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_alloc_items": 0, 2024-08-31T04:38:46.337 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_cache_data_bytes": 0, 2024-08-31T04:38:46.338 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_cache_data_items": 0, 2024-08-31T04:38:46.338 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_cache_onode_bytes": 0, 2024-08-31T04:38:46.338 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_cache_onode_items": 0, 2024-08-31T04:38:46.338 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_cache_meta_bytes": 0, 2024-08-31T04:38:46.338 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_cache_meta_items": 0, 2024-08-31T04:38:46.338 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_cache_other_bytes": 0, 2024-08-31T04:38:46.338 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_cache_other_items": 0, 2024-08-31T04:38:46.338 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_cache_buffer_bytes": 0, 2024-08-31T04:38:46.338 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_cache_buffer_items": 0, 2024-08-31T04:38:46.338 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_extent_bytes": 0, 2024-08-31T04:38:46.338 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_extent_items": 0, 2024-08-31T04:38:46.338 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_blob_bytes": 0, 2024-08-31T04:38:46.338 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_blob_items": 0, 2024-08-31T04:38:46.338 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_shared_blob_bytes": 0, 2024-08-31T04:38:46.339 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_shared_blob_items": 0, 2024-08-31T04:38:46.339 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_inline_bl_bytes": 0, 2024-08-31T04:38:46.339 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_inline_bl_items": 0, 2024-08-31T04:38:46.339 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_fsck_bytes": 0, 2024-08-31T04:38:46.339 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_fsck_items": 0, 2024-08-31T04:38:46.339 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_txc_bytes": 0, 2024-08-31T04:38:46.339 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_txc_items": 0, 2024-08-31T04:38:46.339 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_writing_deferred_bytes": 0, 2024-08-31T04:38:46.339 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_writing_deferred_items": 0, 2024-08-31T04:38:46.339 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_writing_bytes": 0, 2024-08-31T04:38:46.339 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_writing_items": 0, 2024-08-31T04:38:46.339 INFO:teuthology.orchestra.run.smithi050.stdout: "bluefs_bytes": 0, 2024-08-31T04:38:46.339 INFO:teuthology.orchestra.run.smithi050.stdout: "bluefs_items": 0, 2024-08-31T04:38:46.340 INFO:teuthology.orchestra.run.smithi050.stdout: "bluefs_file_reader_bytes": 0, 2024-08-31T04:38:46.340 INFO:teuthology.orchestra.run.smithi050.stdout: "bluefs_file_reader_items": 0, 2024-08-31T04:38:46.340 INFO:teuthology.orchestra.run.smithi050.stdout: "bluefs_file_writer_bytes": 0, 2024-08-31T04:38:46.340 INFO:teuthology.orchestra.run.smithi050.stdout: "bluefs_file_writer_items": 0, 2024-08-31T04:38:46.340 INFO:teuthology.orchestra.run.smithi050.stdout: "buffer_anon_bytes": 148704, 2024-08-31T04:38:46.340 INFO:teuthology.orchestra.run.smithi050.stdout: "buffer_anon_items": 29, 2024-08-31T04:38:46.340 INFO:teuthology.orchestra.run.smithi050.stdout: "buffer_meta_bytes": 0, 2024-08-31T04:38:46.340 INFO:teuthology.orchestra.run.smithi050.stdout: "buffer_meta_items": 0, 2024-08-31T04:38:46.340 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_bytes": 0, 2024-08-31T04:38:46.340 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_items": 0, 2024-08-31T04:38:46.340 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_mapbl_bytes": 0, 2024-08-31T04:38:46.340 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_mapbl_items": 0, 2024-08-31T04:38:46.340 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_pglog_bytes": 0, 2024-08-31T04:38:46.340 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_pglog_items": 0, 2024-08-31T04:38:46.341 INFO:teuthology.orchestra.run.smithi050.stdout: "osdmap_bytes": 0, 2024-08-31T04:38:46.341 INFO:teuthology.orchestra.run.smithi050.stdout: "osdmap_items": 0, 2024-08-31T04:38:46.341 INFO:teuthology.orchestra.run.smithi050.stdout: "osdmap_mapping_bytes": 0, 2024-08-31T04:38:46.341 INFO:teuthology.orchestra.run.smithi050.stdout: "osdmap_mapping_items": 0, 2024-08-31T04:38:46.341 INFO:teuthology.orchestra.run.smithi050.stdout: "pgmap_bytes": 0, 2024-08-31T04:38:46.341 INFO:teuthology.orchestra.run.smithi050.stdout: "pgmap_items": 0, 2024-08-31T04:38:46.341 INFO:teuthology.orchestra.run.smithi050.stdout: "mds_co_bytes": 928, 2024-08-31T04:38:46.341 INFO:teuthology.orchestra.run.smithi050.stdout: "mds_co_items": 2, 2024-08-31T04:38:46.341 INFO:teuthology.orchestra.run.smithi050.stdout: "unittest_1_bytes": 0, 2024-08-31T04:38:46.341 INFO:teuthology.orchestra.run.smithi050.stdout: "unittest_1_items": 0, 2024-08-31T04:38:46.341 INFO:teuthology.orchestra.run.smithi050.stdout: "unittest_2_bytes": 0, 2024-08-31T04:38:46.341 INFO:teuthology.orchestra.run.smithi050.stdout: "unittest_2_items": 0 2024-08-31T04:38:46.341 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T04:38:46.341 INFO:teuthology.orchestra.run.smithi050.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-08-31T04:38:46.342 INFO:teuthology.orchestra.run.smithi050.stdout: "val": 0, 2024-08-31T04:38:46.342 INFO:teuthology.orchestra.run.smithi050.stdout: "max": 104857600, 2024-08-31T04:38:46.342 INFO:teuthology.orchestra.run.smithi050.stdout: "get_started": 0, 2024-08-31T04:38:46.342 INFO:teuthology.orchestra.run.smithi050.stdout: "get": 304, 2024-08-31T04:38:46.342 INFO:teuthology.orchestra.run.smithi050.stdout: "get_sum": 503718, 2024-08-31T04:38:46.342 INFO:teuthology.orchestra.run.smithi050.stdout: "get_or_fail_fail": 0, 2024-08-31T04:38:46.342 INFO:teuthology.orchestra.run.smithi050.stdout: "get_or_fail_success": 304, 2024-08-31T04:38:46.342 INFO:teuthology.orchestra.run.smithi050.stdout: "take": 0, 2024-08-31T04:38:46.342 INFO:teuthology.orchestra.run.smithi050.stdout: "take_sum": 0, 2024-08-31T04:38:46.342 INFO:teuthology.orchestra.run.smithi050.stdout: "put": 304, 2024-08-31T04:38:46.342 INFO:teuthology.orchestra.run.smithi050.stdout: "put_sum": 503718, 2024-08-31T04:38:46.342 INFO:teuthology.orchestra.run.smithi050.stdout: "wait": { 2024-08-31T04:38:46.342 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-08-31T04:38:46.342 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-08-31T04:38:46.342 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-08-31T04:38:46.343 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T04:38:46.343 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T04:38:46.343 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-08-31T04:38:47.068 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.j 2024-08-31T04:38:47.069 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.j 2024-08-31T04:38:47.069 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.j 2024-08-31T04:38:47.069 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.j 2024-08-31T04:38:47.069 WARNING:tasks.check_counter:Counter 'mds.dir_split' not found on daemon mds.j 2024-08-31T04:38:47.069 DEBUG:tasks.check_counter:Getting stats from b 2024-08-31T04:38:47.069 DEBUG:teuthology.orchestra.run.smithi133:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 058d9fc6-674f-11ef-bcd4-c7b262605968 -- ceph daemon mds.b perf dump 2024-08-31T04:38:47.434 INFO:teuthology.orchestra.run.smithi133.stderr:Inferring config /var/lib/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/mon.b/config 2024-08-31T04:38:47.915 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:38:47 smithi133 ceph-mon[22177]: pgmap v845: 97 pgs: 97 active+clean; 592 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 9.2 KiB/s wr, 30 op/s 2024-08-31T04:38:47.950 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:38:47 smithi050 ceph-mon[17259]: pgmap v845: 97 pgs: 97 active+clean; 592 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 9.2 KiB/s wr, 30 op/s 2024-08-31T04:38:47.996 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:38:47 smithi177 ceph-mon[22025]: pgmap v845: 97 pgs: 97 active+clean; 592 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 9.2 KiB/s wr, 30 op/s 2024-08-31T04:38:48.061 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2024-08-31T04:38:48.061 INFO:teuthology.orchestra.run.smithi133.stdout: "AsyncMessenger::Worker-0": { 2024-08-31T04:38:48.061 INFO:teuthology.orchestra.run.smithi133.stdout: "msgr_recv_messages": 72560, 2024-08-31T04:38:48.061 INFO:teuthology.orchestra.run.smithi133.stdout: "msgr_send_messages": 66641, 2024-08-31T04:38:48.062 INFO:teuthology.orchestra.run.smithi133.stdout: "msgr_recv_bytes": 30220777, 2024-08-31T04:38:48.062 INFO:teuthology.orchestra.run.smithi133.stdout: "msgr_send_bytes": 127355083, 2024-08-31T04:38:48.062 INFO:teuthology.orchestra.run.smithi133.stdout: "msgr_created_connections": 21, 2024-08-31T04:38:48.062 INFO:teuthology.orchestra.run.smithi133.stdout: "msgr_active_connections": 3, 2024-08-31T04:38:48.062 INFO:teuthology.orchestra.run.smithi133.stdout: "msgr_running_total_time": 4.865226813, 2024-08-31T04:38:48.062 INFO:teuthology.orchestra.run.smithi133.stdout: "msgr_running_send_time": 2.438863804, 2024-08-31T04:38:48.062 INFO:teuthology.orchestra.run.smithi133.stdout: "msgr_running_recv_time": 2.596915728, 2024-08-31T04:38:48.062 INFO:teuthology.orchestra.run.smithi133.stdout: "msgr_running_fast_dispatch_time": 0.558159773, 2024-08-31T04:38:48.062 INFO:teuthology.orchestra.run.smithi133.stdout: "msgr_send_messages_queue_lat": { 2024-08-31T04:38:48.062 INFO:teuthology.orchestra.run.smithi133.stdout: "avgcount": 66647, 2024-08-31T04:38:48.062 INFO:teuthology.orchestra.run.smithi133.stdout: "sum": 33.621134828, 2024-08-31T04:38:48.062 INFO:teuthology.orchestra.run.smithi133.stdout: "avgtime": 0.000504465 2024-08-31T04:38:48.062 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-08-31T04:38:48.063 INFO:teuthology.orchestra.run.smithi133.stdout: "msgr_handle_ack_lat": { 2024-08-31T04:38:48.063 INFO:teuthology.orchestra.run.smithi133.stdout: "avgcount": 99614, 2024-08-31T04:38:48.063 INFO:teuthology.orchestra.run.smithi133.stdout: "sum": 0.016075281, 2024-08-31T04:38:48.063 INFO:teuthology.orchestra.run.smithi133.stdout: "avgtime": 0.000000161 2024-08-31T04:38:48.063 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-08-31T04:38:48.063 INFO:teuthology.orchestra.run.smithi133.stdout: "msgr_recv_encrypted_bytes": 888560, 2024-08-31T04:38:48.063 INFO:teuthology.orchestra.run.smithi133.stdout: "msgr_send_encrypted_bytes": 192480 2024-08-31T04:38:48.063 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-08-31T04:38:48.063 INFO:teuthology.orchestra.run.smithi133.stdout: "AsyncMessenger::Worker-1": { 2024-08-31T04:38:48.063 INFO:teuthology.orchestra.run.smithi133.stdout: "msgr_recv_messages": 47639, 2024-08-31T04:38:48.063 INFO:teuthology.orchestra.run.smithi133.stdout: "msgr_send_messages": 51005, 2024-08-31T04:38:48.063 INFO:teuthology.orchestra.run.smithi133.stdout: "msgr_recv_bytes": 26696091, 2024-08-31T04:38:48.063 INFO:teuthology.orchestra.run.smithi133.stdout: "msgr_send_bytes": 178410711, 2024-08-31T04:38:48.063 INFO:teuthology.orchestra.run.smithi133.stdout: "msgr_created_connections": 12, 2024-08-31T04:38:48.064 INFO:teuthology.orchestra.run.smithi133.stdout: "msgr_active_connections": 6, 2024-08-31T04:38:48.064 INFO:teuthology.orchestra.run.smithi133.stdout: "msgr_running_total_time": 4.435655556, 2024-08-31T04:38:48.064 INFO:teuthology.orchestra.run.smithi133.stdout: "msgr_running_send_time": 2.245028616, 2024-08-31T04:38:48.064 INFO:teuthology.orchestra.run.smithi133.stdout: "msgr_running_recv_time": 1.192763453, 2024-08-31T04:38:48.064 INFO:teuthology.orchestra.run.smithi133.stdout: "msgr_running_fast_dispatch_time": 1.047472645, 2024-08-31T04:38:48.064 INFO:teuthology.orchestra.run.smithi133.stdout: "msgr_send_messages_queue_lat": { 2024-08-31T04:38:48.064 INFO:teuthology.orchestra.run.smithi133.stdout: "avgcount": 51006, 2024-08-31T04:38:48.064 INFO:teuthology.orchestra.run.smithi133.stdout: "sum": 55.773709986, 2024-08-31T04:38:48.064 INFO:teuthology.orchestra.run.smithi133.stdout: "avgtime": 0.001093473 2024-08-31T04:38:48.064 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-08-31T04:38:48.064 INFO:teuthology.orchestra.run.smithi133.stdout: "msgr_handle_ack_lat": { 2024-08-31T04:38:48.064 INFO:teuthology.orchestra.run.smithi133.stdout: "avgcount": 33220, 2024-08-31T04:38:48.064 INFO:teuthology.orchestra.run.smithi133.stdout: "sum": 0.006361606, 2024-08-31T04:38:48.065 INFO:teuthology.orchestra.run.smithi133.stdout: "avgtime": 0.000000191 2024-08-31T04:38:48.065 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-08-31T04:38:48.065 INFO:teuthology.orchestra.run.smithi133.stdout: "msgr_recv_encrypted_bytes": 320, 2024-08-31T04:38:48.065 INFO:teuthology.orchestra.run.smithi133.stdout: "msgr_send_encrypted_bytes": 580032 2024-08-31T04:38:48.065 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-08-31T04:38:48.065 INFO:teuthology.orchestra.run.smithi133.stdout: "AsyncMessenger::Worker-2": { 2024-08-31T04:38:48.065 INFO:teuthology.orchestra.run.smithi133.stdout: "msgr_recv_messages": 270732, 2024-08-31T04:38:48.065 INFO:teuthology.orchestra.run.smithi133.stdout: "msgr_send_messages": 413540, 2024-08-31T04:38:48.065 INFO:teuthology.orchestra.run.smithi133.stdout: "msgr_recv_bytes": 89821179, 2024-08-31T04:38:48.065 INFO:teuthology.orchestra.run.smithi133.stdout: "msgr_send_bytes": 333775105, 2024-08-31T04:38:48.065 INFO:teuthology.orchestra.run.smithi133.stdout: "msgr_created_connections": 159, 2024-08-31T04:38:48.065 INFO:teuthology.orchestra.run.smithi133.stdout: "msgr_active_connections": 11, 2024-08-31T04:38:48.065 INFO:teuthology.orchestra.run.smithi133.stdout: "msgr_running_total_time": 18.750091765, 2024-08-31T04:38:48.066 INFO:teuthology.orchestra.run.smithi133.stdout: "msgr_running_send_time": 11.749918930, 2024-08-31T04:38:48.066 INFO:teuthology.orchestra.run.smithi133.stdout: "msgr_running_recv_time": 10.039975353, 2024-08-31T04:38:48.066 INFO:teuthology.orchestra.run.smithi133.stdout: "msgr_running_fast_dispatch_time": 0.822344623, 2024-08-31T04:38:48.066 INFO:teuthology.orchestra.run.smithi133.stdout: "msgr_send_messages_queue_lat": { 2024-08-31T04:38:48.066 INFO:teuthology.orchestra.run.smithi133.stdout: "avgcount": 413529, 2024-08-31T04:38:48.066 INFO:teuthology.orchestra.run.smithi133.stdout: "sum": 41.427130285, 2024-08-31T04:38:48.066 INFO:teuthology.orchestra.run.smithi133.stdout: "avgtime": 0.000100179 2024-08-31T04:38:48.066 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-08-31T04:38:48.066 INFO:teuthology.orchestra.run.smithi133.stdout: "msgr_handle_ack_lat": { 2024-08-31T04:38:48.066 INFO:teuthology.orchestra.run.smithi133.stdout: "avgcount": 322233, 2024-08-31T04:38:48.066 INFO:teuthology.orchestra.run.smithi133.stdout: "sum": 0.077399305, 2024-08-31T04:38:48.066 INFO:teuthology.orchestra.run.smithi133.stdout: "avgtime": 0.000000240 2024-08-31T04:38:48.066 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-08-31T04:38:48.066 INFO:teuthology.orchestra.run.smithi133.stdout: "msgr_recv_encrypted_bytes": 55376, 2024-08-31T04:38:48.067 INFO:teuthology.orchestra.run.smithi133.stdout: "msgr_send_encrypted_bytes": 29856 2024-08-31T04:38:48.067 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-08-31T04:38:48.067 INFO:teuthology.orchestra.run.smithi133.stdout: "cct": { 2024-08-31T04:38:48.067 INFO:teuthology.orchestra.run.smithi133.stdout: "total_workers": 1, 2024-08-31T04:38:48.067 INFO:teuthology.orchestra.run.smithi133.stdout: "unhealthy_workers": 0 2024-08-31T04:38:48.067 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-08-31T04:38:48.067 INFO:teuthology.orchestra.run.smithi133.stdout: "finisher-MDSRank": { 2024-08-31T04:38:48.067 INFO:teuthology.orchestra.run.smithi133.stdout: "queue_len": 0, 2024-08-31T04:38:48.067 INFO:teuthology.orchestra.run.smithi133.stdout: "complete_latency": { 2024-08-31T04:38:48.067 INFO:teuthology.orchestra.run.smithi133.stdout: "avgcount": 10222, 2024-08-31T04:38:48.067 INFO:teuthology.orchestra.run.smithi133.stdout: "sum": 101.938239295, 2024-08-31T04:38:48.067 INFO:teuthology.orchestra.run.smithi133.stdout: "avgtime": 0.009972435 2024-08-31T04:38:48.067 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-08-31T04:38:48.068 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-08-31T04:38:48.068 INFO:teuthology.orchestra.run.smithi133.stdout: "finisher-PurgeQueue": { 2024-08-31T04:38:48.068 INFO:teuthology.orchestra.run.smithi133.stdout: "queue_len": 0, 2024-08-31T04:38:48.068 INFO:teuthology.orchestra.run.smithi133.stdout: "complete_latency": { 2024-08-31T04:38:48.068 INFO:teuthology.orchestra.run.smithi133.stdout: "avgcount": 34097, 2024-08-31T04:38:48.068 INFO:teuthology.orchestra.run.smithi133.stdout: "sum": 6.105051127, 2024-08-31T04:38:48.068 INFO:teuthology.orchestra.run.smithi133.stdout: "avgtime": 0.000179049 2024-08-31T04:38:48.068 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-08-31T04:38:48.068 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-08-31T04:38:48.068 INFO:teuthology.orchestra.run.smithi133.stdout: "mds": { 2024-08-31T04:38:48.068 INFO:teuthology.orchestra.run.smithi133.stdout: "request": 147043, 2024-08-31T04:38:48.068 INFO:teuthology.orchestra.run.smithi133.stdout: "reply": 132428, 2024-08-31T04:38:48.068 INFO:teuthology.orchestra.run.smithi133.stdout: "reply_latency": { 2024-08-31T04:38:48.069 INFO:teuthology.orchestra.run.smithi133.stdout: "avgcount": 132428, 2024-08-31T04:38:48.069 INFO:teuthology.orchestra.run.smithi133.stdout: "sum": 2031.531276911, 2024-08-31T04:38:48.069 INFO:teuthology.orchestra.run.smithi133.stdout: "avgtime": 0.015340647 2024-08-31T04:38:48.069 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-08-31T04:38:48.069 INFO:teuthology.orchestra.run.smithi133.stdout: "slow_reply": 0, 2024-08-31T04:38:48.069 INFO:teuthology.orchestra.run.smithi133.stdout: "forward": 14614, 2024-08-31T04:38:48.069 INFO:teuthology.orchestra.run.smithi133.stdout: "dir_fetch_complete": 336, 2024-08-31T04:38:48.069 INFO:teuthology.orchestra.run.smithi133.stdout: "dir_fetch_keys": 0, 2024-08-31T04:38:48.069 INFO:teuthology.orchestra.run.smithi133.stdout: "dir_commit": 5429, 2024-08-31T04:38:48.069 INFO:teuthology.orchestra.run.smithi133.stdout: "dir_split": 118, 2024-08-31T04:38:48.069 INFO:teuthology.orchestra.run.smithi133.stdout: "dir_merge": 5, 2024-08-31T04:38:48.069 INFO:teuthology.orchestra.run.smithi133.stdout: "inodes": 33, 2024-08-31T04:38:48.069 INFO:teuthology.orchestra.run.smithi133.stdout: "inodes_top": 11, 2024-08-31T04:38:48.069 INFO:teuthology.orchestra.run.smithi133.stdout: "inodes_bottom": 12, 2024-08-31T04:38:48.070 INFO:teuthology.orchestra.run.smithi133.stdout: "inodes_pin_tail": 10, 2024-08-31T04:38:48.070 INFO:teuthology.orchestra.run.smithi133.stdout: "inodes_pinned": 17, 2024-08-31T04:38:48.070 INFO:teuthology.orchestra.run.smithi133.stdout: "inodes_expired": 71795, 2024-08-31T04:38:48.070 INFO:teuthology.orchestra.run.smithi133.stdout: "inodes_with_caps": 2, 2024-08-31T04:38:48.070 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": 2, 2024-08-31T04:38:48.070 INFO:teuthology.orchestra.run.smithi133.stdout: "subtrees": 6, 2024-08-31T04:38:48.070 INFO:teuthology.orchestra.run.smithi133.stdout: "traverse": 229832, 2024-08-31T04:38:48.070 INFO:teuthology.orchestra.run.smithi133.stdout: "traverse_hit": 196107, 2024-08-31T04:38:48.070 INFO:teuthology.orchestra.run.smithi133.stdout: "traverse_forward": 14439, 2024-08-31T04:38:48.070 INFO:teuthology.orchestra.run.smithi133.stdout: "traverse_discover": 867, 2024-08-31T04:38:48.070 INFO:teuthology.orchestra.run.smithi133.stdout: "traverse_dir_fetch": 14, 2024-08-31T04:38:48.070 INFO:teuthology.orchestra.run.smithi133.stdout: "traverse_remote_ino": 0, 2024-08-31T04:38:48.070 INFO:teuthology.orchestra.run.smithi133.stdout: "traverse_lock": 198, 2024-08-31T04:38:48.070 INFO:teuthology.orchestra.run.smithi133.stdout: "load_cent": 15714, 2024-08-31T04:38:48.071 INFO:teuthology.orchestra.run.smithi133.stdout: "q": 0, 2024-08-31T04:38:48.071 INFO:teuthology.orchestra.run.smithi133.stdout: "exported": 237, 2024-08-31T04:38:48.071 INFO:teuthology.orchestra.run.smithi133.stdout: "exported_inodes": 48909, 2024-08-31T04:38:48.071 INFO:teuthology.orchestra.run.smithi133.stdout: "imported": 198, 2024-08-31T04:38:48.071 INFO:teuthology.orchestra.run.smithi133.stdout: "imported_inodes": 27899, 2024-08-31T04:38:48.071 INFO:teuthology.orchestra.run.smithi133.stdout: "openino_dir_fetch": 0, 2024-08-31T04:38:48.071 INFO:teuthology.orchestra.run.smithi133.stdout: "openino_backtrace_fetch": 0, 2024-08-31T04:38:48.071 INFO:teuthology.orchestra.run.smithi133.stdout: "openino_peer_discover": 0, 2024-08-31T04:38:48.071 INFO:teuthology.orchestra.run.smithi133.stdout: "root_rfiles": 4, 2024-08-31T04:38:48.071 INFO:teuthology.orchestra.run.smithi133.stdout: "root_rbytes": 234, 2024-08-31T04:38:48.071 INFO:teuthology.orchestra.run.smithi133.stdout: "root_rsnaps": 0, 2024-08-31T04:38:48.071 INFO:teuthology.orchestra.run.smithi133.stdout: "scrub_backtrace_fetch": 0, 2024-08-31T04:38:48.071 INFO:teuthology.orchestra.run.smithi133.stdout: "scrub_set_tag": 0, 2024-08-31T04:38:48.072 INFO:teuthology.orchestra.run.smithi133.stdout: "scrub_backtrace_repaired": 0, 2024-08-31T04:38:48.072 INFO:teuthology.orchestra.run.smithi133.stdout: "scrub_inotable_repaired": 0, 2024-08-31T04:38:48.072 INFO:teuthology.orchestra.run.smithi133.stdout: "scrub_dir_inodes": 0, 2024-08-31T04:38:48.072 INFO:teuthology.orchestra.run.smithi133.stdout: "scrub_dir_base_inodes": 0, 2024-08-31T04:38:48.072 INFO:teuthology.orchestra.run.smithi133.stdout: "scrub_dirfrag_rstats": 0, 2024-08-31T04:38:48.072 INFO:teuthology.orchestra.run.smithi133.stdout: "scrub_file_inodes": 0, 2024-08-31T04:38:48.072 INFO:teuthology.orchestra.run.smithi133.stdout: "handle_inode_file_caps": 131, 2024-08-31T04:38:48.072 INFO:teuthology.orchestra.run.smithi133.stdout: "ceph_cap_op_revoke": 29306, 2024-08-31T04:38:48.072 INFO:teuthology.orchestra.run.smithi133.stdout: "ceph_cap_op_grant": 57782, 2024-08-31T04:38:48.072 INFO:teuthology.orchestra.run.smithi133.stdout: "ceph_cap_op_trunc": 6, 2024-08-31T04:38:48.072 INFO:teuthology.orchestra.run.smithi133.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-08-31T04:38:48.072 INFO:teuthology.orchestra.run.smithi133.stdout: "ceph_cap_op_flush_ack": 0, 2024-08-31T04:38:48.072 INFO:teuthology.orchestra.run.smithi133.stdout: "handle_client_caps": 59874, 2024-08-31T04:38:48.073 INFO:teuthology.orchestra.run.smithi133.stdout: "handle_client_caps_dirty": 22186, 2024-08-31T04:38:48.073 INFO:teuthology.orchestra.run.smithi133.stdout: "handle_client_cap_release": 1100, 2024-08-31T04:38:48.073 INFO:teuthology.orchestra.run.smithi133.stdout: "process_request_cap_release": 50896 2024-08-31T04:38:48.073 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-08-31T04:38:48.073 INFO:teuthology.orchestra.run.smithi133.stdout: "mds_cache": { 2024-08-31T04:38:48.073 INFO:teuthology.orchestra.run.smithi133.stdout: "dir_update": 3616, 2024-08-31T04:38:48.073 INFO:teuthology.orchestra.run.smithi133.stdout: "dir_update_receipt": 5200, 2024-08-31T04:38:48.073 INFO:teuthology.orchestra.run.smithi133.stdout: "dir_try_discover": 2853, 2024-08-31T04:38:48.073 INFO:teuthology.orchestra.run.smithi133.stdout: "dir_send_discover": 4141, 2024-08-31T04:38:48.073 INFO:teuthology.orchestra.run.smithi133.stdout: "dir_handle_discover": 14047, 2024-08-31T04:38:48.073 INFO:teuthology.orchestra.run.smithi133.stdout: "num_strays": 0, 2024-08-31T04:38:48.073 INFO:teuthology.orchestra.run.smithi133.stdout: "num_strays_delayed": 0, 2024-08-31T04:38:48.073 INFO:teuthology.orchestra.run.smithi133.stdout: "num_strays_enqueuing": 0, 2024-08-31T04:38:48.073 INFO:teuthology.orchestra.run.smithi133.stdout: "strays_created": 17941, 2024-08-31T04:38:48.074 INFO:teuthology.orchestra.run.smithi133.stdout: "strays_enqueued": 17941, 2024-08-31T04:38:48.074 INFO:teuthology.orchestra.run.smithi133.stdout: "strays_reintegrated": 0, 2024-08-31T04:38:48.074 INFO:teuthology.orchestra.run.smithi133.stdout: "strays_migrated": 0, 2024-08-31T04:38:48.074 INFO:teuthology.orchestra.run.smithi133.stdout: "num_recovering_processing": 0, 2024-08-31T04:38:48.074 INFO:teuthology.orchestra.run.smithi133.stdout: "num_recovering_enqueued": 0, 2024-08-31T04:38:48.074 INFO:teuthology.orchestra.run.smithi133.stdout: "num_recovering_prioritized": 0, 2024-08-31T04:38:48.074 INFO:teuthology.orchestra.run.smithi133.stdout: "recovery_started": 0, 2024-08-31T04:38:48.074 INFO:teuthology.orchestra.run.smithi133.stdout: "recovery_completed": 0, 2024-08-31T04:38:48.074 INFO:teuthology.orchestra.run.smithi133.stdout: "ireq_quiesce_path": 5, 2024-08-31T04:38:48.074 INFO:teuthology.orchestra.run.smithi133.stdout: "ireq_quiesce_inode": 11192, 2024-08-31T04:38:48.074 INFO:teuthology.orchestra.run.smithi133.stdout: "ireq_enqueue_scrub": 0, 2024-08-31T04:38:48.074 INFO:teuthology.orchestra.run.smithi133.stdout: "ireq_exportdir": 237, 2024-08-31T04:38:48.074 INFO:teuthology.orchestra.run.smithi133.stdout: "ireq_flush": 0, 2024-08-31T04:38:48.075 INFO:teuthology.orchestra.run.smithi133.stdout: "ireq_fragmentdir": 125, 2024-08-31T04:38:48.075 INFO:teuthology.orchestra.run.smithi133.stdout: "ireq_fragstats": 0, 2024-08-31T04:38:48.075 INFO:teuthology.orchestra.run.smithi133.stdout: "ireq_inodestats": 0, 2024-08-31T04:38:48.075 INFO:teuthology.orchestra.run.smithi133.stdout: "uninline_started": 0, 2024-08-31T04:38:48.075 INFO:teuthology.orchestra.run.smithi133.stdout: "uninline_succeeded": 0, 2024-08-31T04:38:48.075 INFO:teuthology.orchestra.run.smithi133.stdout: "uninline_write_failed": 0 2024-08-31T04:38:48.075 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-08-31T04:38:48.075 INFO:teuthology.orchestra.run.smithi133.stdout: "mds_log": { 2024-08-31T04:38:48.075 INFO:teuthology.orchestra.run.smithi133.stdout: "evlrg": 2, 2024-08-31T04:38:48.075 INFO:teuthology.orchestra.run.smithi133.stdout: "evadd": 138451, 2024-08-31T04:38:48.075 INFO:teuthology.orchestra.run.smithi133.stdout: "evex": 138442, 2024-08-31T04:38:48.075 INFO:teuthology.orchestra.run.smithi133.stdout: "evtrm": 138442, 2024-08-31T04:38:48.075 INFO:teuthology.orchestra.run.smithi133.stdout: "ev": 9, 2024-08-31T04:38:48.075 INFO:teuthology.orchestra.run.smithi133.stdout: "evexg": 0, 2024-08-31T04:38:48.076 INFO:teuthology.orchestra.run.smithi133.stdout: "evexd": 5791, 2024-08-31T04:38:48.076 INFO:teuthology.orchestra.run.smithi133.stdout: "segadd": 219, 2024-08-31T04:38:48.076 INFO:teuthology.orchestra.run.smithi133.stdout: "segex": 218, 2024-08-31T04:38:48.076 INFO:teuthology.orchestra.run.smithi133.stdout: "segtrm": 218, 2024-08-31T04:38:48.076 INFO:teuthology.orchestra.run.smithi133.stdout: "seg": 1, 2024-08-31T04:38:48.076 INFO:teuthology.orchestra.run.smithi133.stdout: "segmjr": 1, 2024-08-31T04:38:48.076 INFO:teuthology.orchestra.run.smithi133.stdout: "segexg": 0, 2024-08-31T04:38:48.076 INFO:teuthology.orchestra.run.smithi133.stdout: "segexd": 7, 2024-08-31T04:38:48.076 INFO:teuthology.orchestra.run.smithi133.stdout: "expos": 324157440, 2024-08-31T04:38:48.076 INFO:teuthology.orchestra.run.smithi133.stdout: "wrpos": 324172669, 2024-08-31T04:38:48.076 INFO:teuthology.orchestra.run.smithi133.stdout: "rdpos": 0, 2024-08-31T04:38:48.076 INFO:teuthology.orchestra.run.smithi133.stdout: "jlat": { 2024-08-31T04:38:48.076 INFO:teuthology.orchestra.run.smithi133.stdout: "avgcount": 5623, 2024-08-31T04:38:48.076 INFO:teuthology.orchestra.run.smithi133.stdout: "sum": 922.500348694, 2024-08-31T04:38:48.077 INFO:teuthology.orchestra.run.smithi133.stdout: "avgtime": 0.164058393 2024-08-31T04:38:48.077 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-08-31T04:38:48.077 INFO:teuthology.orchestra.run.smithi133.stdout: "replayed": 0 2024-08-31T04:38:48.077 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-08-31T04:38:48.077 INFO:teuthology.orchestra.run.smithi133.stdout: "mds_mem": { 2024-08-31T04:38:48.077 INFO:teuthology.orchestra.run.smithi133.stdout: "ino": 36, 2024-08-31T04:38:48.077 INFO:teuthology.orchestra.run.smithi133.stdout: "ino+": 51181, 2024-08-31T04:38:48.077 INFO:teuthology.orchestra.run.smithi133.stdout: "ino-": 51145, 2024-08-31T04:38:48.077 INFO:teuthology.orchestra.run.smithi133.stdout: "dir": 35, 2024-08-31T04:38:48.077 INFO:teuthology.orchestra.run.smithi133.stdout: "dir+": 4571, 2024-08-31T04:38:48.077 INFO:teuthology.orchestra.run.smithi133.stdout: "dir-": 4536, 2024-08-31T04:38:48.077 INFO:teuthology.orchestra.run.smithi133.stdout: "dn": 33, 2024-08-31T04:38:48.077 INFO:teuthology.orchestra.run.smithi133.stdout: "dn+": 111660, 2024-08-31T04:38:48.077 INFO:teuthology.orchestra.run.smithi133.stdout: "dn-": 111627, 2024-08-31T04:38:48.078 INFO:teuthology.orchestra.run.smithi133.stdout: "cap": 2, 2024-08-31T04:38:48.078 INFO:teuthology.orchestra.run.smithi133.stdout: "cap+": 44919, 2024-08-31T04:38:48.078 INFO:teuthology.orchestra.run.smithi133.stdout: "cap-": 44917, 2024-08-31T04:38:48.078 INFO:teuthology.orchestra.run.smithi133.stdout: "rss": 203492, 2024-08-31T04:38:48.078 INFO:teuthology.orchestra.run.smithi133.stdout: "heap": 596295680 2024-08-31T04:38:48.078 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-08-31T04:38:48.078 INFO:teuthology.orchestra.run.smithi133.stdout: "mds_server": { 2024-08-31T04:38:48.078 INFO:teuthology.orchestra.run.smithi133.stdout: "dispatch_client_request": 156049, 2024-08-31T04:38:48.078 INFO:teuthology.orchestra.run.smithi133.stdout: "dispatch_server_request": 2578, 2024-08-31T04:38:48.078 INFO:teuthology.orchestra.run.smithi133.stdout: "handle_client_request": 147043, 2024-08-31T04:38:48.078 INFO:teuthology.orchestra.run.smithi133.stdout: "handle_client_session": 310, 2024-08-31T04:38:48.078 INFO:teuthology.orchestra.run.smithi133.stdout: "handle_peer_request": 5288, 2024-08-31T04:38:48.078 INFO:teuthology.orchestra.run.smithi133.stdout: "req_create_latency": { 2024-08-31T04:38:48.079 INFO:teuthology.orchestra.run.smithi133.stdout: "avgcount": 30058, 2024-08-31T04:38:48.079 INFO:teuthology.orchestra.run.smithi133.stdout: "sum": 133.322392404, 2024-08-31T04:38:48.079 INFO:teuthology.orchestra.run.smithi133.stdout: "avgtime": 0.004435504 2024-08-31T04:38:48.079 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-08-31T04:38:48.079 INFO:teuthology.orchestra.run.smithi133.stdout: "req_getattr_latency": { 2024-08-31T04:38:48.079 INFO:teuthology.orchestra.run.smithi133.stdout: "avgcount": 2360, 2024-08-31T04:38:48.079 INFO:teuthology.orchestra.run.smithi133.stdout: "sum": 136.557376191, 2024-08-31T04:38:48.079 INFO:teuthology.orchestra.run.smithi133.stdout: "avgtime": 0.057863294 2024-08-31T04:38:48.079 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-08-31T04:38:48.079 INFO:teuthology.orchestra.run.smithi133.stdout: "req_getfilelock_latency": { 2024-08-31T04:38:48.079 INFO:teuthology.orchestra.run.smithi133.stdout: "avgcount": 0, 2024-08-31T04:38:48.079 INFO:teuthology.orchestra.run.smithi133.stdout: "sum": 0.000000000, 2024-08-31T04:38:48.079 INFO:teuthology.orchestra.run.smithi133.stdout: "avgtime": 0.000000000 2024-08-31T04:38:48.080 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-08-31T04:38:48.080 INFO:teuthology.orchestra.run.smithi133.stdout: "req_link_latency": { 2024-08-31T04:38:48.080 INFO:teuthology.orchestra.run.smithi133.stdout: "avgcount": 0, 2024-08-31T04:38:48.080 INFO:teuthology.orchestra.run.smithi133.stdout: "sum": 0.000000000, 2024-08-31T04:38:48.080 INFO:teuthology.orchestra.run.smithi133.stdout: "avgtime": 0.000000000 2024-08-31T04:38:48.080 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-08-31T04:38:48.080 INFO:teuthology.orchestra.run.smithi133.stdout: "req_lookup_latency": { 2024-08-31T04:38:48.080 INFO:teuthology.orchestra.run.smithi133.stdout: "avgcount": 44254, 2024-08-31T04:38:48.080 INFO:teuthology.orchestra.run.smithi133.stdout: "sum": 1202.631254436, 2024-08-31T04:38:48.080 INFO:teuthology.orchestra.run.smithi133.stdout: "avgtime": 0.027175650 2024-08-31T04:38:48.080 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-08-31T04:38:48.080 INFO:teuthology.orchestra.run.smithi133.stdout: "req_lookuphash_latency": { 2024-08-31T04:38:48.080 INFO:teuthology.orchestra.run.smithi133.stdout: "avgcount": 0, 2024-08-31T04:38:48.081 INFO:teuthology.orchestra.run.smithi133.stdout: "sum": 0.000000000, 2024-08-31T04:38:48.081 INFO:teuthology.orchestra.run.smithi133.stdout: "avgtime": 0.000000000 2024-08-31T04:38:48.081 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-08-31T04:38:48.081 INFO:teuthology.orchestra.run.smithi133.stdout: "req_lookupino_latency": { 2024-08-31T04:38:48.081 INFO:teuthology.orchestra.run.smithi133.stdout: "avgcount": 1, 2024-08-31T04:38:48.081 INFO:teuthology.orchestra.run.smithi133.stdout: "sum": 0.000190286, 2024-08-31T04:38:48.081 INFO:teuthology.orchestra.run.smithi133.stdout: "avgtime": 0.000190286 2024-08-31T04:38:48.081 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-08-31T04:38:48.081 INFO:teuthology.orchestra.run.smithi133.stdout: "req_lookupname_latency": { 2024-08-31T04:38:48.081 INFO:teuthology.orchestra.run.smithi133.stdout: "avgcount": 0, 2024-08-31T04:38:48.081 INFO:teuthology.orchestra.run.smithi133.stdout: "sum": 0.000000000, 2024-08-31T04:38:48.081 INFO:teuthology.orchestra.run.smithi133.stdout: "avgtime": 0.000000000 2024-08-31T04:38:48.081 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-08-31T04:38:48.081 INFO:teuthology.orchestra.run.smithi133.stdout: "req_lookupparent_latency": { 2024-08-31T04:38:48.082 INFO:teuthology.orchestra.run.smithi133.stdout: "avgcount": 0, 2024-08-31T04:38:48.082 INFO:teuthology.orchestra.run.smithi133.stdout: "sum": 0.000000000, 2024-08-31T04:38:48.082 INFO:teuthology.orchestra.run.smithi133.stdout: "avgtime": 0.000000000 2024-08-31T04:38:48.082 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-08-31T04:38:48.082 INFO:teuthology.orchestra.run.smithi133.stdout: "req_lookupsnap_latency": { 2024-08-31T04:38:48.082 INFO:teuthology.orchestra.run.smithi133.stdout: "avgcount": 0, 2024-08-31T04:38:48.083 INFO:teuthology.orchestra.run.smithi133.stdout: "sum": 0.000000000, 2024-08-31T04:38:48.083 INFO:teuthology.orchestra.run.smithi133.stdout: "avgtime": 0.000000000 2024-08-31T04:38:48.083 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-08-31T04:38:48.083 INFO:teuthology.orchestra.run.smithi133.stdout: "req_lssnap_latency": { 2024-08-31T04:38:48.083 INFO:teuthology.orchestra.run.smithi133.stdout: "avgcount": 0, 2024-08-31T04:38:48.083 INFO:teuthology.orchestra.run.smithi133.stdout: "sum": 0.000000000, 2024-08-31T04:38:48.083 INFO:teuthology.orchestra.run.smithi133.stdout: "avgtime": 0.000000000 2024-08-31T04:38:48.083 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-08-31T04:38:48.083 INFO:teuthology.orchestra.run.smithi133.stdout: "req_mkdir_latency": { 2024-08-31T04:38:48.083 INFO:teuthology.orchestra.run.smithi133.stdout: "avgcount": 238, 2024-08-31T04:38:48.083 INFO:teuthology.orchestra.run.smithi133.stdout: "sum": 42.544912139, 2024-08-31T04:38:48.083 INFO:teuthology.orchestra.run.smithi133.stdout: "avgtime": 0.178760135 2024-08-31T04:38:48.083 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-08-31T04:38:48.084 INFO:teuthology.orchestra.run.smithi133.stdout: "req_mknod_latency": { 2024-08-31T04:38:48.084 INFO:teuthology.orchestra.run.smithi133.stdout: "avgcount": 0, 2024-08-31T04:38:48.084 INFO:teuthology.orchestra.run.smithi133.stdout: "sum": 0.000000000, 2024-08-31T04:38:48.084 INFO:teuthology.orchestra.run.smithi133.stdout: "avgtime": 0.000000000 2024-08-31T04:38:48.084 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-08-31T04:38:48.084 INFO:teuthology.orchestra.run.smithi133.stdout: "req_mksnap_latency": { 2024-08-31T04:38:48.084 INFO:teuthology.orchestra.run.smithi133.stdout: "avgcount": 0, 2024-08-31T04:38:48.084 INFO:teuthology.orchestra.run.smithi133.stdout: "sum": 0.000000000, 2024-08-31T04:38:48.084 INFO:teuthology.orchestra.run.smithi133.stdout: "avgtime": 0.000000000 2024-08-31T04:38:48.084 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-08-31T04:38:48.084 INFO:teuthology.orchestra.run.smithi133.stdout: "req_open_latency": { 2024-08-31T04:38:48.084 INFO:teuthology.orchestra.run.smithi133.stdout: "avgcount": 10016, 2024-08-31T04:38:48.084 INFO:teuthology.orchestra.run.smithi133.stdout: "sum": 74.303399025, 2024-08-31T04:38:48.084 INFO:teuthology.orchestra.run.smithi133.stdout: "avgtime": 0.007418470 2024-08-31T04:38:48.085 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-08-31T04:38:48.085 INFO:teuthology.orchestra.run.smithi133.stdout: "req_readdir_latency": { 2024-08-31T04:38:48.085 INFO:teuthology.orchestra.run.smithi133.stdout: "avgcount": 748, 2024-08-31T04:38:48.085 INFO:teuthology.orchestra.run.smithi133.stdout: "sum": 2.009248295, 2024-08-31T04:38:48.085 INFO:teuthology.orchestra.run.smithi133.stdout: "avgtime": 0.002686160 2024-08-31T04:38:48.085 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-08-31T04:38:48.085 INFO:teuthology.orchestra.run.smithi133.stdout: "req_rename_latency": { 2024-08-31T04:38:48.085 INFO:teuthology.orchestra.run.smithi133.stdout: "avgcount": 29704, 2024-08-31T04:38:48.085 INFO:teuthology.orchestra.run.smithi133.stdout: "sum": 406.776417840, 2024-08-31T04:38:48.085 INFO:teuthology.orchestra.run.smithi133.stdout: "avgtime": 0.013694331 2024-08-31T04:38:48.085 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-08-31T04:38:48.085 INFO:teuthology.orchestra.run.smithi133.stdout: "req_renamesnap_latency": { 2024-08-31T04:38:48.085 INFO:teuthology.orchestra.run.smithi133.stdout: "avgcount": 0, 2024-08-31T04:38:48.086 INFO:teuthology.orchestra.run.smithi133.stdout: "sum": 0.000000000, 2024-08-31T04:38:48.086 INFO:teuthology.orchestra.run.smithi133.stdout: "avgtime": 0.000000000 2024-08-31T04:38:48.086 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-08-31T04:38:48.086 INFO:teuthology.orchestra.run.smithi133.stdout: "req_snapdiff_latency": { 2024-08-31T04:38:48.086 INFO:teuthology.orchestra.run.smithi133.stdout: "avgcount": 0, 2024-08-31T04:38:48.086 INFO:teuthology.orchestra.run.smithi133.stdout: "sum": 0.000000000, 2024-08-31T04:38:48.086 INFO:teuthology.orchestra.run.smithi133.stdout: "avgtime": 0.000000000 2024-08-31T04:38:48.086 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-08-31T04:38:48.086 INFO:teuthology.orchestra.run.smithi133.stdout: "req_rmdir_latency": { 2024-08-31T04:38:48.086 INFO:teuthology.orchestra.run.smithi133.stdout: "avgcount": 125, 2024-08-31T04:38:48.086 INFO:teuthology.orchestra.run.smithi133.stdout: "sum": 12.858704608, 2024-08-31T04:38:48.086 INFO:teuthology.orchestra.run.smithi133.stdout: "avgtime": 0.102869636 2024-08-31T04:38:48.086 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-08-31T04:38:48.087 INFO:teuthology.orchestra.run.smithi133.stdout: "req_rmsnap_latency": { 2024-08-31T04:38:48.087 INFO:teuthology.orchestra.run.smithi133.stdout: "avgcount": 0, 2024-08-31T04:38:48.087 INFO:teuthology.orchestra.run.smithi133.stdout: "sum": 0.000000000, 2024-08-31T04:38:48.087 INFO:teuthology.orchestra.run.smithi133.stdout: "avgtime": 0.000000000 2024-08-31T04:38:48.087 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-08-31T04:38:48.087 INFO:teuthology.orchestra.run.smithi133.stdout: "req_rmxattr_latency": { 2024-08-31T04:38:48.087 INFO:teuthology.orchestra.run.smithi133.stdout: "avgcount": 0, 2024-08-31T04:38:48.087 INFO:teuthology.orchestra.run.smithi133.stdout: "sum": 0.000000000, 2024-08-31T04:38:48.087 INFO:teuthology.orchestra.run.smithi133.stdout: "avgtime": 0.000000000 2024-08-31T04:38:48.087 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-08-31T04:38:48.087 INFO:teuthology.orchestra.run.smithi133.stdout: "req_setattr_latency": { 2024-08-31T04:38:48.087 INFO:teuthology.orchestra.run.smithi133.stdout: "avgcount": 7, 2024-08-31T04:38:48.087 INFO:teuthology.orchestra.run.smithi133.stdout: "sum": 0.171990165, 2024-08-31T04:38:48.087 INFO:teuthology.orchestra.run.smithi133.stdout: "avgtime": 0.024570023 2024-08-31T04:38:48.088 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-08-31T04:38:48.088 INFO:teuthology.orchestra.run.smithi133.stdout: "req_setdirlayout_latency": { 2024-08-31T04:38:48.088 INFO:teuthology.orchestra.run.smithi133.stdout: "avgcount": 0, 2024-08-31T04:38:48.088 INFO:teuthology.orchestra.run.smithi133.stdout: "sum": 0.000000000, 2024-08-31T04:38:48.088 INFO:teuthology.orchestra.run.smithi133.stdout: "avgtime": 0.000000000 2024-08-31T04:38:48.088 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-08-31T04:38:48.088 INFO:teuthology.orchestra.run.smithi133.stdout: "req_setfilelock_latency": { 2024-08-31T04:38:48.088 INFO:teuthology.orchestra.run.smithi133.stdout: "avgcount": 0, 2024-08-31T04:38:48.088 INFO:teuthology.orchestra.run.smithi133.stdout: "sum": 0.000000000, 2024-08-31T04:38:48.088 INFO:teuthology.orchestra.run.smithi133.stdout: "avgtime": 0.000000000 2024-08-31T04:38:48.088 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-08-31T04:38:48.088 INFO:teuthology.orchestra.run.smithi133.stdout: "req_setlayout_latency": { 2024-08-31T04:38:48.088 INFO:teuthology.orchestra.run.smithi133.stdout: "avgcount": 0, 2024-08-31T04:38:48.089 INFO:teuthology.orchestra.run.smithi133.stdout: "sum": 0.000000000, 2024-08-31T04:38:48.089 INFO:teuthology.orchestra.run.smithi133.stdout: "avgtime": 0.000000000 2024-08-31T04:38:48.089 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-08-31T04:38:48.089 INFO:teuthology.orchestra.run.smithi133.stdout: "req_setxattr_latency": { 2024-08-31T04:38:48.089 INFO:teuthology.orchestra.run.smithi133.stdout: "avgcount": 7, 2024-08-31T04:38:48.089 INFO:teuthology.orchestra.run.smithi133.stdout: "sum": 0.019766752, 2024-08-31T04:38:48.089 INFO:teuthology.orchestra.run.smithi133.stdout: "avgtime": 0.002823821 2024-08-31T04:38:48.089 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-08-31T04:38:48.089 INFO:teuthology.orchestra.run.smithi133.stdout: "req_symlink_latency": { 2024-08-31T04:38:48.089 INFO:teuthology.orchestra.run.smithi133.stdout: "avgcount": 3, 2024-08-31T04:38:48.089 INFO:teuthology.orchestra.run.smithi133.stdout: "sum": 0.002003431, 2024-08-31T04:38:48.089 INFO:teuthology.orchestra.run.smithi133.stdout: "avgtime": 0.000667810 2024-08-31T04:38:48.090 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-08-31T04:38:48.090 INFO:teuthology.orchestra.run.smithi133.stdout: "req_unlink_latency": { 2024-08-31T04:38:48.090 INFO:teuthology.orchestra.run.smithi133.stdout: "avgcount": 14907, 2024-08-31T04:38:48.090 INFO:teuthology.orchestra.run.smithi133.stdout: "sum": 20.333621339, 2024-08-31T04:38:48.090 INFO:teuthology.orchestra.run.smithi133.stdout: "avgtime": 0.001364031 2024-08-31T04:38:48.090 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-08-31T04:38:48.090 INFO:teuthology.orchestra.run.smithi133.stdout: "cap_revoke_eviction": 0, 2024-08-31T04:38:48.090 INFO:teuthology.orchestra.run.smithi133.stdout: "cap_acquisition_throttle": 0, 2024-08-31T04:38:48.090 INFO:teuthology.orchestra.run.smithi133.stdout: "req_getvxattr_latency": { 2024-08-31T04:38:48.090 INFO:teuthology.orchestra.run.smithi133.stdout: "avgcount": 0, 2024-08-31T04:38:48.090 INFO:teuthology.orchestra.run.smithi133.stdout: "sum": 0.000000000, 2024-08-31T04:38:48.090 INFO:teuthology.orchestra.run.smithi133.stdout: "avgtime": 0.000000000 2024-08-31T04:38:48.090 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-08-31T04:38:48.090 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-08-31T04:38:48.091 INFO:teuthology.orchestra.run.smithi133.stdout: "mds_sessions": { 2024-08-31T04:38:48.091 INFO:teuthology.orchestra.run.smithi133.stdout: "session_count": 1, 2024-08-31T04:38:48.091 INFO:teuthology.orchestra.run.smithi133.stdout: "session_add": 2, 2024-08-31T04:38:48.091 INFO:teuthology.orchestra.run.smithi133.stdout: "session_remove": 1, 2024-08-31T04:38:48.091 INFO:teuthology.orchestra.run.smithi133.stdout: "sessions_open": 1, 2024-08-31T04:38:48.091 INFO:teuthology.orchestra.run.smithi133.stdout: "sessions_stale": 0, 2024-08-31T04:38:48.091 INFO:teuthology.orchestra.run.smithi133.stdout: "total_load": 15737, 2024-08-31T04:38:48.091 INFO:teuthology.orchestra.run.smithi133.stdout: "average_load": 15737, 2024-08-31T04:38:48.091 INFO:teuthology.orchestra.run.smithi133.stdout: "avg_session_uptime": 947, 2024-08-31T04:38:48.091 INFO:teuthology.orchestra.run.smithi133.stdout: "mdthresh_evicted": 0 2024-08-31T04:38:48.091 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-08-31T04:38:48.091 INFO:teuthology.orchestra.run.smithi133.stdout: "mempool": { 2024-08-31T04:38:48.091 INFO:teuthology.orchestra.run.smithi133.stdout: "bloom_filter_bytes": 360, 2024-08-31T04:38:48.091 INFO:teuthology.orchestra.run.smithi133.stdout: "bloom_filter_items": 360, 2024-08-31T04:38:48.092 INFO:teuthology.orchestra.run.smithi133.stdout: "bluestore_alloc_bytes": 0, 2024-08-31T04:38:48.092 INFO:teuthology.orchestra.run.smithi133.stdout: "bluestore_alloc_items": 0, 2024-08-31T04:38:48.092 INFO:teuthology.orchestra.run.smithi133.stdout: "bluestore_cache_data_bytes": 0, 2024-08-31T04:38:48.092 INFO:teuthology.orchestra.run.smithi133.stdout: "bluestore_cache_data_items": 0, 2024-08-31T04:38:48.092 INFO:teuthology.orchestra.run.smithi133.stdout: "bluestore_cache_onode_bytes": 0, 2024-08-31T04:38:48.092 INFO:teuthology.orchestra.run.smithi133.stdout: "bluestore_cache_onode_items": 0, 2024-08-31T04:38:48.092 INFO:teuthology.orchestra.run.smithi133.stdout: "bluestore_cache_meta_bytes": 0, 2024-08-31T04:38:48.092 INFO:teuthology.orchestra.run.smithi133.stdout: "bluestore_cache_meta_items": 0, 2024-08-31T04:38:48.092 INFO:teuthology.orchestra.run.smithi133.stdout: "bluestore_cache_other_bytes": 0, 2024-08-31T04:38:48.092 INFO:teuthology.orchestra.run.smithi133.stdout: "bluestore_cache_other_items": 0, 2024-08-31T04:38:48.092 INFO:teuthology.orchestra.run.smithi133.stdout: "bluestore_cache_buffer_bytes": 0, 2024-08-31T04:38:48.092 INFO:teuthology.orchestra.run.smithi133.stdout: "bluestore_cache_buffer_items": 0, 2024-08-31T04:38:48.093 INFO:teuthology.orchestra.run.smithi133.stdout: "bluestore_extent_bytes": 0, 2024-08-31T04:38:48.093 INFO:teuthology.orchestra.run.smithi133.stdout: "bluestore_extent_items": 0, 2024-08-31T04:38:48.093 INFO:teuthology.orchestra.run.smithi133.stdout: "bluestore_blob_bytes": 0, 2024-08-31T04:38:48.093 INFO:teuthology.orchestra.run.smithi133.stdout: "bluestore_blob_items": 0, 2024-08-31T04:38:48.093 INFO:teuthology.orchestra.run.smithi133.stdout: "bluestore_shared_blob_bytes": 0, 2024-08-31T04:38:48.093 INFO:teuthology.orchestra.run.smithi133.stdout: "bluestore_shared_blob_items": 0, 2024-08-31T04:38:48.093 INFO:teuthology.orchestra.run.smithi133.stdout: "bluestore_inline_bl_bytes": 0, 2024-08-31T04:38:48.093 INFO:teuthology.orchestra.run.smithi133.stdout: "bluestore_inline_bl_items": 0, 2024-08-31T04:38:48.093 INFO:teuthology.orchestra.run.smithi133.stdout: "bluestore_fsck_bytes": 0, 2024-08-31T04:38:48.093 INFO:teuthology.orchestra.run.smithi133.stdout: "bluestore_fsck_items": 0, 2024-08-31T04:38:48.093 INFO:teuthology.orchestra.run.smithi133.stdout: "bluestore_txc_bytes": 0, 2024-08-31T04:38:48.093 INFO:teuthology.orchestra.run.smithi133.stdout: "bluestore_txc_items": 0, 2024-08-31T04:38:48.093 INFO:teuthology.orchestra.run.smithi133.stdout: "bluestore_writing_deferred_bytes": 0, 2024-08-31T04:38:48.094 INFO:teuthology.orchestra.run.smithi133.stdout: "bluestore_writing_deferred_items": 0, 2024-08-31T04:38:48.094 INFO:teuthology.orchestra.run.smithi133.stdout: "bluestore_writing_bytes": 0, 2024-08-31T04:38:48.094 INFO:teuthology.orchestra.run.smithi133.stdout: "bluestore_writing_items": 0, 2024-08-31T04:38:48.094 INFO:teuthology.orchestra.run.smithi133.stdout: "bluefs_bytes": 0, 2024-08-31T04:38:48.094 INFO:teuthology.orchestra.run.smithi133.stdout: "bluefs_items": 0, 2024-08-31T04:38:48.094 INFO:teuthology.orchestra.run.smithi133.stdout: "bluefs_file_reader_bytes": 0, 2024-08-31T04:38:48.094 INFO:teuthology.orchestra.run.smithi133.stdout: "bluefs_file_reader_items": 0, 2024-08-31T04:38:48.094 INFO:teuthology.orchestra.run.smithi133.stdout: "bluefs_file_writer_bytes": 0, 2024-08-31T04:38:48.094 INFO:teuthology.orchestra.run.smithi133.stdout: "bluefs_file_writer_items": 0, 2024-08-31T04:38:48.094 INFO:teuthology.orchestra.run.smithi133.stdout: "buffer_anon_bytes": 279445, 2024-08-31T04:38:48.094 INFO:teuthology.orchestra.run.smithi133.stdout: "buffer_anon_items": 97, 2024-08-31T04:38:48.094 INFO:teuthology.orchestra.run.smithi133.stdout: "buffer_meta_bytes": 0, 2024-08-31T04:38:48.094 INFO:teuthology.orchestra.run.smithi133.stdout: "buffer_meta_items": 0, 2024-08-31T04:38:48.094 INFO:teuthology.orchestra.run.smithi133.stdout: "osd_bytes": 0, 2024-08-31T04:38:48.094 INFO:teuthology.orchestra.run.smithi133.stdout: "osd_items": 0, 2024-08-31T04:38:48.094 INFO:teuthology.orchestra.run.smithi133.stdout: "osd_mapbl_bytes": 0, 2024-08-31T04:38:48.095 INFO:teuthology.orchestra.run.smithi133.stdout: "osd_mapbl_items": 0, 2024-08-31T04:38:48.095 INFO:teuthology.orchestra.run.smithi133.stdout: "osd_pglog_bytes": 0, 2024-08-31T04:38:48.095 INFO:teuthology.orchestra.run.smithi133.stdout: "osd_pglog_items": 0, 2024-08-31T04:38:48.095 INFO:teuthology.orchestra.run.smithi133.stdout: "osdmap_bytes": 7504, 2024-08-31T04:38:48.095 INFO:teuthology.orchestra.run.smithi133.stdout: "osdmap_items": 155, 2024-08-31T04:38:48.095 INFO:teuthology.orchestra.run.smithi133.stdout: "osdmap_mapping_bytes": 0, 2024-08-31T04:38:48.095 INFO:teuthology.orchestra.run.smithi133.stdout: "osdmap_mapping_items": 0, 2024-08-31T04:38:48.095 INFO:teuthology.orchestra.run.smithi133.stdout: "pgmap_bytes": 0, 2024-08-31T04:38:48.095 INFO:teuthology.orchestra.run.smithi133.stdout: "pgmap_items": 0, 2024-08-31T04:38:48.095 INFO:teuthology.orchestra.run.smithi133.stdout: "mds_co_bytes": 156077, 2024-08-31T04:38:48.095 INFO:teuthology.orchestra.run.smithi133.stdout: "mds_co_items": 899, 2024-08-31T04:38:48.095 INFO:teuthology.orchestra.run.smithi133.stdout: "unittest_1_bytes": 0, 2024-08-31T04:38:48.095 INFO:teuthology.orchestra.run.smithi133.stdout: "unittest_1_items": 0, 2024-08-31T04:38:48.095 INFO:teuthology.orchestra.run.smithi133.stdout: "unittest_2_bytes": 0, 2024-08-31T04:38:48.096 INFO:teuthology.orchestra.run.smithi133.stdout: "unittest_2_items": 0 2024-08-31T04:38:48.096 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-08-31T04:38:48.096 INFO:teuthology.orchestra.run.smithi133.stdout: "objecter": { 2024-08-31T04:38:48.096 INFO:teuthology.orchestra.run.smithi133.stdout: "op_active": 0, 2024-08-31T04:38:48.096 INFO:teuthology.orchestra.run.smithi133.stdout: "op_laggy": 0, 2024-08-31T04:38:48.096 INFO:teuthology.orchestra.run.smithi133.stdout: "op_send": 70119, 2024-08-31T04:38:48.096 INFO:teuthology.orchestra.run.smithi133.stdout: "op_send_bytes": 392785502, 2024-08-31T04:38:48.096 INFO:teuthology.orchestra.run.smithi133.stdout: "op_resend": 32, 2024-08-31T04:38:48.096 INFO:teuthology.orchestra.run.smithi133.stdout: "op_reply": 70119, 2024-08-31T04:38:48.096 INFO:teuthology.orchestra.run.smithi133.stdout: "op_latency": { 2024-08-31T04:38:48.096 INFO:teuthology.orchestra.run.smithi133.stdout: "avgcount": 70119, 2024-08-31T04:38:48.096 INFO:teuthology.orchestra.run.smithi133.stdout: "sum": 15366.026087995, 2024-08-31T04:38:48.096 INFO:teuthology.orchestra.run.smithi133.stdout: "avgtime": 0.219142116 2024-08-31T04:38:48.097 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-08-31T04:38:48.097 INFO:teuthology.orchestra.run.smithi133.stdout: "op_inflight": 0, 2024-08-31T04:38:48.097 INFO:teuthology.orchestra.run.smithi133.stdout: "oplen_avg": { 2024-08-31T04:38:48.097 INFO:teuthology.orchestra.run.smithi133.stdout: "avgcount": 70119, 2024-08-31T04:38:48.097 INFO:teuthology.orchestra.run.smithi133.stdout: "sum": 155508 2024-08-31T04:38:48.097 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-08-31T04:38:48.097 INFO:teuthology.orchestra.run.smithi133.stdout: "op": 70119, 2024-08-31T04:38:48.097 INFO:teuthology.orchestra.run.smithi133.stdout: "op_r": 1373, 2024-08-31T04:38:48.097 INFO:teuthology.orchestra.run.smithi133.stdout: "op_w": 68746, 2024-08-31T04:38:48.097 INFO:teuthology.orchestra.run.smithi133.stdout: "op_rmw": 0, 2024-08-31T04:38:48.097 INFO:teuthology.orchestra.run.smithi133.stdout: "op_pg": 0, 2024-08-31T04:38:48.097 INFO:teuthology.orchestra.run.smithi133.stdout: "osdop_stat": 4252, 2024-08-31T04:38:48.097 INFO:teuthology.orchestra.run.smithi133.stdout: "osdop_create": 36766, 2024-08-31T04:38:48.097 INFO:teuthology.orchestra.run.smithi133.stdout: "osdop_read": 510, 2024-08-31T04:38:48.098 INFO:teuthology.orchestra.run.smithi133.stdout: "osdop_write": 6136, 2024-08-31T04:38:48.098 INFO:teuthology.orchestra.run.smithi133.stdout: "osdop_writefull": 489, 2024-08-31T04:38:48.098 INFO:teuthology.orchestra.run.smithi133.stdout: "osdop_writesame": 0, 2024-08-31T04:38:48.098 INFO:teuthology.orchestra.run.smithi133.stdout: "osdop_append": 0, 2024-08-31T04:38:48.098 INFO:teuthology.orchestra.run.smithi133.stdout: "osdop_zero": 0, 2024-08-31T04:38:48.098 INFO:teuthology.orchestra.run.smithi133.stdout: "osdop_truncate": 118, 2024-08-31T04:38:48.098 INFO:teuthology.orchestra.run.smithi133.stdout: "osdop_delete": 19272, 2024-08-31T04:38:48.098 INFO:teuthology.orchestra.run.smithi133.stdout: "osdop_mapext": 0, 2024-08-31T04:38:48.098 INFO:teuthology.orchestra.run.smithi133.stdout: "osdop_sparse_read": 0, 2024-08-31T04:38:48.098 INFO:teuthology.orchestra.run.smithi133.stdout: "osdop_clonerange": 0, 2024-08-31T04:38:48.098 INFO:teuthology.orchestra.run.smithi133.stdout: "osdop_getxattr": 15, 2024-08-31T04:38:48.098 INFO:teuthology.orchestra.run.smithi133.stdout: "osdop_setxattr": 73533, 2024-08-31T04:38:48.098 INFO:teuthology.orchestra.run.smithi133.stdout: "osdop_cmpxattr": 0, 2024-08-31T04:38:48.099 INFO:teuthology.orchestra.run.smithi133.stdout: "osdop_rmxattr": 0, 2024-08-31T04:38:48.099 INFO:teuthology.orchestra.run.smithi133.stdout: "osdop_resetxattrs": 0, 2024-08-31T04:38:48.099 INFO:teuthology.orchestra.run.smithi133.stdout: "osdop_call": 0, 2024-08-31T04:38:48.099 INFO:teuthology.orchestra.run.smithi133.stdout: "osdop_watch": 0, 2024-08-31T04:38:48.099 INFO:teuthology.orchestra.run.smithi133.stdout: "osdop_notify": 0, 2024-08-31T04:38:48.099 INFO:teuthology.orchestra.run.smithi133.stdout: "osdop_src_cmpxattr": 0, 2024-08-31T04:38:48.099 INFO:teuthology.orchestra.run.smithi133.stdout: "osdop_pgls": 0, 2024-08-31T04:38:48.099 INFO:teuthology.orchestra.run.smithi133.stdout: "osdop_pgls_filter": 0, 2024-08-31T04:38:48.099 INFO:teuthology.orchestra.run.smithi133.stdout: "osdop_other": 6, 2024-08-31T04:38:48.099 INFO:teuthology.orchestra.run.smithi133.stdout: "linger_active": 0, 2024-08-31T04:38:48.099 INFO:teuthology.orchestra.run.smithi133.stdout: "linger_send": 0, 2024-08-31T04:38:48.099 INFO:teuthology.orchestra.run.smithi133.stdout: "linger_resend": 0, 2024-08-31T04:38:48.100 INFO:teuthology.orchestra.run.smithi133.stdout: "linger_ping": 0, 2024-08-31T04:38:48.100 INFO:teuthology.orchestra.run.smithi133.stdout: "poolop_active": 0, 2024-08-31T04:38:48.100 INFO:teuthology.orchestra.run.smithi133.stdout: "poolop_send": 0, 2024-08-31T04:38:48.100 INFO:teuthology.orchestra.run.smithi133.stdout: "poolop_resend": 0, 2024-08-31T04:38:48.100 INFO:teuthology.orchestra.run.smithi133.stdout: "poolstat_active": 0, 2024-08-31T04:38:48.100 INFO:teuthology.orchestra.run.smithi133.stdout: "poolstat_send": 0, 2024-08-31T04:38:48.100 INFO:teuthology.orchestra.run.smithi133.stdout: "poolstat_resend": 0, 2024-08-31T04:38:48.100 INFO:teuthology.orchestra.run.smithi133.stdout: "statfs_active": 0, 2024-08-31T04:38:48.100 INFO:teuthology.orchestra.run.smithi133.stdout: "statfs_send": 0, 2024-08-31T04:38:48.100 INFO:teuthology.orchestra.run.smithi133.stdout: "statfs_resend": 0, 2024-08-31T04:38:48.100 INFO:teuthology.orchestra.run.smithi133.stdout: "command_active": 0, 2024-08-31T04:38:48.100 INFO:teuthology.orchestra.run.smithi133.stdout: "command_send": 0, 2024-08-31T04:38:48.100 INFO:teuthology.orchestra.run.smithi133.stdout: "command_resend": 0, 2024-08-31T04:38:48.100 INFO:teuthology.orchestra.run.smithi133.stdout: "map_epoch": 80, 2024-08-31T04:38:48.101 INFO:teuthology.orchestra.run.smithi133.stdout: "map_full": 0, 2024-08-31T04:38:48.101 INFO:teuthology.orchestra.run.smithi133.stdout: "map_inc": 4, 2024-08-31T04:38:48.101 INFO:teuthology.orchestra.run.smithi133.stdout: "osd_sessions": 12, 2024-08-31T04:38:48.101 INFO:teuthology.orchestra.run.smithi133.stdout: "osd_session_open": 12, 2024-08-31T04:38:48.101 INFO:teuthology.orchestra.run.smithi133.stdout: "osd_session_close": 0, 2024-08-31T04:38:48.101 INFO:teuthology.orchestra.run.smithi133.stdout: "osd_laggy": 0, 2024-08-31T04:38:48.101 INFO:teuthology.orchestra.run.smithi133.stdout: "omap_wr": 11134, 2024-08-31T04:38:48.101 INFO:teuthology.orchestra.run.smithi133.stdout: "omap_rd": 1199, 2024-08-31T04:38:48.101 INFO:teuthology.orchestra.run.smithi133.stdout: "omap_del": 2078 2024-08-31T04:38:48.102 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-08-31T04:38:48.102 INFO:teuthology.orchestra.run.smithi133.stdout: "oft": { 2024-08-31T04:38:48.102 INFO:teuthology.orchestra.run.smithi133.stdout: "omap_total_objs": 1, 2024-08-31T04:38:48.102 INFO:teuthology.orchestra.run.smithi133.stdout: "omap_total_kv_pairs": 0, 2024-08-31T04:38:48.102 INFO:teuthology.orchestra.run.smithi133.stdout: "omap_total_updates": 0, 2024-08-31T04:38:48.102 INFO:teuthology.orchestra.run.smithi133.stdout: "omap_total_removes": 0 2024-08-31T04:38:48.102 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-08-31T04:38:48.102 INFO:teuthology.orchestra.run.smithi133.stdout: "purge_queue": { 2024-08-31T04:38:48.102 INFO:teuthology.orchestra.run.smithi133.stdout: "pq_executing_ops": 0, 2024-08-31T04:38:48.102 INFO:teuthology.orchestra.run.smithi133.stdout: "pq_executing_ops_high_water": 14, 2024-08-31T04:38:48.102 INFO:teuthology.orchestra.run.smithi133.stdout: "pq_executing": 0, 2024-08-31T04:38:48.102 INFO:teuthology.orchestra.run.smithi133.stdout: "pq_executing_high_water": 6, 2024-08-31T04:38:48.102 INFO:teuthology.orchestra.run.smithi133.stdout: "pq_executed_ops": 18585, 2024-08-31T04:38:48.102 INFO:teuthology.orchestra.run.smithi133.stdout: "pq_executed": 17941, 2024-08-31T04:38:48.102 INFO:teuthology.orchestra.run.smithi133.stdout: "pq_item_in_journal": 0 2024-08-31T04:38:48.103 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-08-31T04:38:48.103 INFO:teuthology.orchestra.run.smithi133.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-08-31T04:38:48.103 INFO:teuthology.orchestra.run.smithi133.stdout: "val": 0, 2024-08-31T04:38:48.103 INFO:teuthology.orchestra.run.smithi133.stdout: "max": 104857600, 2024-08-31T04:38:48.103 INFO:teuthology.orchestra.run.smithi133.stdout: "get_started": 0, 2024-08-31T04:38:48.103 INFO:teuthology.orchestra.run.smithi133.stdout: "get": 390927, 2024-08-31T04:38:48.103 INFO:teuthology.orchestra.run.smithi133.stdout: "get_sum": 115051733, 2024-08-31T04:38:48.103 INFO:teuthology.orchestra.run.smithi133.stdout: "get_or_fail_fail": 0, 2024-08-31T04:38:48.103 INFO:teuthology.orchestra.run.smithi133.stdout: "get_or_fail_success": 390927, 2024-08-31T04:38:48.103 INFO:teuthology.orchestra.run.smithi133.stdout: "take": 0, 2024-08-31T04:38:48.103 INFO:teuthology.orchestra.run.smithi133.stdout: "take_sum": 0, 2024-08-31T04:38:48.103 INFO:teuthology.orchestra.run.smithi133.stdout: "put": 390927, 2024-08-31T04:38:48.103 INFO:teuthology.orchestra.run.smithi133.stdout: "put_sum": 115051733, 2024-08-31T04:38:48.103 INFO:teuthology.orchestra.run.smithi133.stdout: "wait": { 2024-08-31T04:38:48.104 INFO:teuthology.orchestra.run.smithi133.stdout: "avgcount": 0, 2024-08-31T04:38:48.104 INFO:teuthology.orchestra.run.smithi133.stdout: "sum": 0.000000000, 2024-08-31T04:38:48.104 INFO:teuthology.orchestra.run.smithi133.stdout: "avgtime": 0.000000000 2024-08-31T04:38:48.104 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-08-31T04:38:48.104 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-08-31T04:38:48.104 INFO:teuthology.orchestra.run.smithi133.stdout: "throttle-objecter_bytes": { 2024-08-31T04:38:48.104 INFO:teuthology.orchestra.run.smithi133.stdout: "val": 0, 2024-08-31T04:38:48.104 INFO:teuthology.orchestra.run.smithi133.stdout: "max": 104857600, 2024-08-31T04:38:48.104 INFO:teuthology.orchestra.run.smithi133.stdout: "get_started": 0, 2024-08-31T04:38:48.104 INFO:teuthology.orchestra.run.smithi133.stdout: "get": 0, 2024-08-31T04:38:48.104 INFO:teuthology.orchestra.run.smithi133.stdout: "get_sum": 0, 2024-08-31T04:38:48.104 INFO:teuthology.orchestra.run.smithi133.stdout: "get_or_fail_fail": 0, 2024-08-31T04:38:48.104 INFO:teuthology.orchestra.run.smithi133.stdout: "get_or_fail_success": 0, 2024-08-31T04:38:48.105 INFO:teuthology.orchestra.run.smithi133.stdout: "take": 70119, 2024-08-31T04:38:48.105 INFO:teuthology.orchestra.run.smithi133.stdout: "take_sum": 394574454, 2024-08-31T04:38:48.105 INFO:teuthology.orchestra.run.smithi133.stdout: "put": 70119, 2024-08-31T04:38:48.105 INFO:teuthology.orchestra.run.smithi133.stdout: "put_sum": 394574454, 2024-08-31T04:38:48.105 INFO:teuthology.orchestra.run.smithi133.stdout: "wait": { 2024-08-31T04:38:48.105 INFO:teuthology.orchestra.run.smithi133.stdout: "avgcount": 0, 2024-08-31T04:38:48.105 INFO:teuthology.orchestra.run.smithi133.stdout: "sum": 0.000000000, 2024-08-31T04:38:48.105 INFO:teuthology.orchestra.run.smithi133.stdout: "avgtime": 0.000000000 2024-08-31T04:38:48.105 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-08-31T04:38:48.105 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-08-31T04:38:48.105 INFO:teuthology.orchestra.run.smithi133.stdout: "throttle-objecter_ops": { 2024-08-31T04:38:48.105 INFO:teuthology.orchestra.run.smithi133.stdout: "val": 0, 2024-08-31T04:38:48.105 INFO:teuthology.orchestra.run.smithi133.stdout: "max": 1024, 2024-08-31T04:38:48.105 INFO:teuthology.orchestra.run.smithi133.stdout: "get_started": 0, 2024-08-31T04:38:48.106 INFO:teuthology.orchestra.run.smithi133.stdout: "get": 0, 2024-08-31T04:38:48.106 INFO:teuthology.orchestra.run.smithi133.stdout: "get_sum": 0, 2024-08-31T04:38:48.106 INFO:teuthology.orchestra.run.smithi133.stdout: "get_or_fail_fail": 0, 2024-08-31T04:38:48.106 INFO:teuthology.orchestra.run.smithi133.stdout: "get_or_fail_success": 0, 2024-08-31T04:38:48.106 INFO:teuthology.orchestra.run.smithi133.stdout: "take": 70119, 2024-08-31T04:38:48.106 INFO:teuthology.orchestra.run.smithi133.stdout: "take_sum": 70119, 2024-08-31T04:38:48.106 INFO:teuthology.orchestra.run.smithi133.stdout: "put": 70119, 2024-08-31T04:38:48.106 INFO:teuthology.orchestra.run.smithi133.stdout: "put_sum": 70119, 2024-08-31T04:38:48.106 INFO:teuthology.orchestra.run.smithi133.stdout: "wait": { 2024-08-31T04:38:48.106 INFO:teuthology.orchestra.run.smithi133.stdout: "avgcount": 0, 2024-08-31T04:38:48.106 INFO:teuthology.orchestra.run.smithi133.stdout: "sum": 0.000000000, 2024-08-31T04:38:48.106 INFO:teuthology.orchestra.run.smithi133.stdout: "avgtime": 0.000000000 2024-08-31T04:38:48.106 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-08-31T04:38:48.106 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-08-31T04:38:48.106 INFO:teuthology.orchestra.run.smithi133.stdout: "throttle-write_buf_throttle": { 2024-08-31T04:38:48.107 INFO:teuthology.orchestra.run.smithi133.stdout: "val": 0, 2024-08-31T04:38:48.107 INFO:teuthology.orchestra.run.smithi133.stdout: "max": 3758096384, 2024-08-31T04:38:48.107 INFO:teuthology.orchestra.run.smithi133.stdout: "get_started": 0, 2024-08-31T04:38:48.107 INFO:teuthology.orchestra.run.smithi133.stdout: "get": 17941, 2024-08-31T04:38:48.107 INFO:teuthology.orchestra.run.smithi133.stdout: "get_sum": 1812705, 2024-08-31T04:38:48.107 INFO:teuthology.orchestra.run.smithi133.stdout: "get_or_fail_fail": 0, 2024-08-31T04:38:48.107 INFO:teuthology.orchestra.run.smithi133.stdout: "get_or_fail_success": 17941, 2024-08-31T04:38:48.107 INFO:teuthology.orchestra.run.smithi133.stdout: "take": 0, 2024-08-31T04:38:48.107 INFO:teuthology.orchestra.run.smithi133.stdout: "take_sum": 0, 2024-08-31T04:38:48.107 INFO:teuthology.orchestra.run.smithi133.stdout: "put": 512, 2024-08-31T04:38:48.107 INFO:teuthology.orchestra.run.smithi133.stdout: "put_sum": 1812705, 2024-08-31T04:38:48.107 INFO:teuthology.orchestra.run.smithi133.stdout: "wait": { 2024-08-31T04:38:48.107 INFO:teuthology.orchestra.run.smithi133.stdout: "avgcount": 0, 2024-08-31T04:38:48.107 INFO:teuthology.orchestra.run.smithi133.stdout: "sum": 0.000000000, 2024-08-31T04:38:48.108 INFO:teuthology.orchestra.run.smithi133.stdout: "avgtime": 0.000000000 2024-08-31T04:38:48.108 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-08-31T04:38:48.108 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-08-31T04:38:48.108 INFO:teuthology.orchestra.run.smithi133.stdout: "throttle-write_buf_throttle-0x5630fa5665b0": { 2024-08-31T04:38:48.108 INFO:teuthology.orchestra.run.smithi133.stdout: "val": 0, 2024-08-31T04:38:48.108 INFO:teuthology.orchestra.run.smithi133.stdout: "max": 3758096384, 2024-08-31T04:38:48.108 INFO:teuthology.orchestra.run.smithi133.stdout: "get_started": 0, 2024-08-31T04:38:48.108 INFO:teuthology.orchestra.run.smithi133.stdout: "get": 138451, 2024-08-31T04:38:48.108 INFO:teuthology.orchestra.run.smithi133.stdout: "get_sum": 319978365, 2024-08-31T04:38:48.108 INFO:teuthology.orchestra.run.smithi133.stdout: "get_or_fail_fail": 0, 2024-08-31T04:38:48.108 INFO:teuthology.orchestra.run.smithi133.stdout: "get_or_fail_success": 138451, 2024-08-31T04:38:48.108 INFO:teuthology.orchestra.run.smithi133.stdout: "take": 0, 2024-08-31T04:38:48.108 INFO:teuthology.orchestra.run.smithi133.stdout: "take_sum": 0, 2024-08-31T04:38:48.108 INFO:teuthology.orchestra.run.smithi133.stdout: "put": 5623, 2024-08-31T04:38:48.108 INFO:teuthology.orchestra.run.smithi133.stdout: "put_sum": 319978365, 2024-08-31T04:38:48.109 INFO:teuthology.orchestra.run.smithi133.stdout: "wait": { 2024-08-31T04:38:48.109 INFO:teuthology.orchestra.run.smithi133.stdout: "avgcount": 0, 2024-08-31T04:38:48.109 INFO:teuthology.orchestra.run.smithi133.stdout: "sum": 0.000000000, 2024-08-31T04:38:48.109 INFO:teuthology.orchestra.run.smithi133.stdout: "avgtime": 0.000000000 2024-08-31T04:38:48.109 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-08-31T04:38:48.109 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-08-31T04:38:48.109 INFO:teuthology.orchestra.run.smithi133.stdout: "trackedop": { 2024-08-31T04:38:48.109 INFO:teuthology.orchestra.run.smithi133.stdout: "slow_ops_count": 10893 2024-08-31T04:38:48.109 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-08-31T04:38:48.109 INFO:teuthology.orchestra.run.smithi133.stdout:} 2024-08-31T04:38:48.908 INFO:tasks.check_counter:Daemon mds.b mds.exported=237 2024-08-31T04:38:48.908 INFO:tasks.check_counter:Daemon mds.b mds.imported=198 2024-08-31T04:38:48.909 INFO:tasks.check_counter:Daemon mds.b mds_cache.dir_update=3616 2024-08-31T04:38:48.909 INFO:tasks.check_counter:Daemon mds.b mds_cache.dir_update_receipt=5200 2024-08-31T04:38:48.909 INFO:tasks.check_counter:Daemon mds.b mds.dir_split=118 2024-08-31T04:38:48.909 DEBUG:tasks.check_counter:Getting stats from e 2024-08-31T04:38:48.909 DEBUG:teuthology.orchestra.run.smithi133:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 058d9fc6-674f-11ef-bcd4-c7b262605968 -- ceph daemon mds.e perf dump 2024-08-31T04:38:49.157 INFO:teuthology.orchestra.run.smithi133.stderr:Inferring config /var/lib/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/mon.b/config 2024-08-31T04:38:49.687 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2024-08-31T04:38:49.687 INFO:teuthology.orchestra.run.smithi133.stdout: "AsyncMessenger::Worker-0": { 2024-08-31T04:38:49.687 INFO:teuthology.orchestra.run.smithi133.stdout: "msgr_recv_messages": 2044, 2024-08-31T04:38:49.687 INFO:teuthology.orchestra.run.smithi133.stdout: "msgr_send_messages": 1997, 2024-08-31T04:38:49.687 INFO:teuthology.orchestra.run.smithi133.stdout: "msgr_recv_bytes": 47088449, 2024-08-31T04:38:49.687 INFO:teuthology.orchestra.run.smithi133.stdout: "msgr_send_bytes": 723132, 2024-08-31T04:38:49.687 INFO:teuthology.orchestra.run.smithi133.stdout: "msgr_created_connections": 7, 2024-08-31T04:38:49.687 INFO:teuthology.orchestra.run.smithi133.stdout: "msgr_active_connections": 3, 2024-08-31T04:38:49.687 INFO:teuthology.orchestra.run.smithi133.stdout: "msgr_running_total_time": 0.256233675, 2024-08-31T04:38:49.688 INFO:teuthology.orchestra.run.smithi133.stdout: "msgr_running_send_time": 0.109658150, 2024-08-31T04:38:49.688 INFO:teuthology.orchestra.run.smithi133.stdout: "msgr_running_recv_time": 0.095902698, 2024-08-31T04:38:49.688 INFO:teuthology.orchestra.run.smithi133.stdout: "msgr_running_fast_dispatch_time": 0.046511876, 2024-08-31T04:38:49.688 INFO:teuthology.orchestra.run.smithi133.stdout: "msgr_send_messages_queue_lat": { 2024-08-31T04:38:49.688 INFO:teuthology.orchestra.run.smithi133.stdout: "avgcount": 1997, 2024-08-31T04:38:49.688 INFO:teuthology.orchestra.run.smithi133.stdout: "sum": 0.260621019, 2024-08-31T04:38:49.688 INFO:teuthology.orchestra.run.smithi133.stdout: "avgtime": 0.000130506 2024-08-31T04:38:49.688 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-08-31T04:38:49.688 INFO:teuthology.orchestra.run.smithi133.stdout: "msgr_handle_ack_lat": { 2024-08-31T04:38:49.688 INFO:teuthology.orchestra.run.smithi133.stdout: "avgcount": 0, 2024-08-31T04:38:49.688 INFO:teuthology.orchestra.run.smithi133.stdout: "sum": 0.000000000, 2024-08-31T04:38:49.688 INFO:teuthology.orchestra.run.smithi133.stdout: "avgtime": 0.000000000 2024-08-31T04:38:49.688 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-08-31T04:38:49.689 INFO:teuthology.orchestra.run.smithi133.stdout: "msgr_recv_encrypted_bytes": 848160, 2024-08-31T04:38:49.689 INFO:teuthology.orchestra.run.smithi133.stdout: "msgr_send_encrypted_bytes": 185712 2024-08-31T04:38:49.689 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-08-31T04:38:49.689 INFO:teuthology.orchestra.run.smithi133.stdout: "AsyncMessenger::Worker-1": { 2024-08-31T04:38:49.689 INFO:teuthology.orchestra.run.smithi133.stdout: "msgr_recv_messages": 432, 2024-08-31T04:38:49.689 INFO:teuthology.orchestra.run.smithi133.stdout: "msgr_send_messages": 658, 2024-08-31T04:38:49.689 INFO:teuthology.orchestra.run.smithi133.stdout: "msgr_recv_bytes": 58844455, 2024-08-31T04:38:49.689 INFO:teuthology.orchestra.run.smithi133.stdout: "msgr_send_bytes": 617680, 2024-08-31T04:38:49.689 INFO:teuthology.orchestra.run.smithi133.stdout: "msgr_created_connections": 7, 2024-08-31T04:38:49.689 INFO:teuthology.orchestra.run.smithi133.stdout: "msgr_active_connections": 6, 2024-08-31T04:38:49.689 INFO:teuthology.orchestra.run.smithi133.stdout: "msgr_running_total_time": 0.078371455, 2024-08-31T04:38:49.689 INFO:teuthology.orchestra.run.smithi133.stdout: "msgr_running_send_time": 0.026975863, 2024-08-31T04:38:49.690 INFO:teuthology.orchestra.run.smithi133.stdout: "msgr_running_recv_time": 0.036507458, 2024-08-31T04:38:49.690 INFO:teuthology.orchestra.run.smithi133.stdout: "msgr_running_fast_dispatch_time": 0.010463870, 2024-08-31T04:38:49.690 INFO:teuthology.orchestra.run.smithi133.stdout: "msgr_send_messages_queue_lat": { 2024-08-31T04:38:49.690 INFO:teuthology.orchestra.run.smithi133.stdout: "avgcount": 656, 2024-08-31T04:38:49.690 INFO:teuthology.orchestra.run.smithi133.stdout: "sum": 0.028437825, 2024-08-31T04:38:49.690 INFO:teuthology.orchestra.run.smithi133.stdout: "avgtime": 0.000043350 2024-08-31T04:38:49.690 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-08-31T04:38:49.690 INFO:teuthology.orchestra.run.smithi133.stdout: "msgr_handle_ack_lat": { 2024-08-31T04:38:49.690 INFO:teuthology.orchestra.run.smithi133.stdout: "avgcount": 0, 2024-08-31T04:38:49.690 INFO:teuthology.orchestra.run.smithi133.stdout: "sum": 0.000000000, 2024-08-31T04:38:49.690 INFO:teuthology.orchestra.run.smithi133.stdout: "avgtime": 0.000000000 2024-08-31T04:38:49.690 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-08-31T04:38:49.690 INFO:teuthology.orchestra.run.smithi133.stdout: "msgr_recv_encrypted_bytes": 160, 2024-08-31T04:38:49.691 INFO:teuthology.orchestra.run.smithi133.stdout: "msgr_send_encrypted_bytes": 480560 2024-08-31T04:38:49.691 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-08-31T04:38:49.691 INFO:teuthology.orchestra.run.smithi133.stdout: "AsyncMessenger::Worker-2": { 2024-08-31T04:38:49.691 INFO:teuthology.orchestra.run.smithi133.stdout: "msgr_recv_messages": 1438, 2024-08-31T04:38:49.691 INFO:teuthology.orchestra.run.smithi133.stdout: "msgr_send_messages": 1440, 2024-08-31T04:38:49.691 INFO:teuthology.orchestra.run.smithi133.stdout: "msgr_recv_bytes": 75876805, 2024-08-31T04:38:49.691 INFO:teuthology.orchestra.run.smithi133.stdout: "msgr_send_bytes": 457291, 2024-08-31T04:38:49.691 INFO:teuthology.orchestra.run.smithi133.stdout: "msgr_created_connections": 7, 2024-08-31T04:38:49.691 INFO:teuthology.orchestra.run.smithi133.stdout: "msgr_active_connections": 5, 2024-08-31T04:38:49.691 INFO:teuthology.orchestra.run.smithi133.stdout: "msgr_running_total_time": 0.165023967, 2024-08-31T04:38:49.691 INFO:teuthology.orchestra.run.smithi133.stdout: "msgr_running_send_time": 0.051356747, 2024-08-31T04:38:49.691 INFO:teuthology.orchestra.run.smithi133.stdout: "msgr_running_recv_time": 0.070536164, 2024-08-31T04:38:49.692 INFO:teuthology.orchestra.run.smithi133.stdout: "msgr_running_fast_dispatch_time": 0.035095805, 2024-08-31T04:38:49.692 INFO:teuthology.orchestra.run.smithi133.stdout: "msgr_send_messages_queue_lat": { 2024-08-31T04:38:49.692 INFO:teuthology.orchestra.run.smithi133.stdout: "avgcount": 1438, 2024-08-31T04:38:49.692 INFO:teuthology.orchestra.run.smithi133.stdout: "sum": 0.061850890, 2024-08-31T04:38:49.692 INFO:teuthology.orchestra.run.smithi133.stdout: "avgtime": 0.000043011 2024-08-31T04:38:49.692 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-08-31T04:38:49.692 INFO:teuthology.orchestra.run.smithi133.stdout: "msgr_handle_ack_lat": { 2024-08-31T04:38:49.692 INFO:teuthology.orchestra.run.smithi133.stdout: "avgcount": 0, 2024-08-31T04:38:49.692 INFO:teuthology.orchestra.run.smithi133.stdout: "sum": 0.000000000, 2024-08-31T04:38:49.692 INFO:teuthology.orchestra.run.smithi133.stdout: "avgtime": 0.000000000 2024-08-31T04:38:49.692 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-08-31T04:38:49.692 INFO:teuthology.orchestra.run.smithi133.stdout: "msgr_recv_encrypted_bytes": 0, 2024-08-31T04:38:49.692 INFO:teuthology.orchestra.run.smithi133.stdout: "msgr_send_encrypted_bytes": 0 2024-08-31T04:38:49.693 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-08-31T04:38:49.693 INFO:teuthology.orchestra.run.smithi133.stdout: "cct": { 2024-08-31T04:38:49.693 INFO:teuthology.orchestra.run.smithi133.stdout: "total_workers": 1, 2024-08-31T04:38:49.693 INFO:teuthology.orchestra.run.smithi133.stdout: "unhealthy_workers": 0 2024-08-31T04:38:49.693 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-08-31T04:38:49.693 INFO:teuthology.orchestra.run.smithi133.stdout: "finisher-MDSRank": { 2024-08-31T04:38:49.693 INFO:teuthology.orchestra.run.smithi133.stdout: "queue_len": 0, 2024-08-31T04:38:49.693 INFO:teuthology.orchestra.run.smithi133.stdout: "complete_latency": { 2024-08-31T04:38:49.693 INFO:teuthology.orchestra.run.smithi133.stdout: "avgcount": 5928, 2024-08-31T04:38:49.693 INFO:teuthology.orchestra.run.smithi133.stdout: "sum": 0.145856844, 2024-08-31T04:38:49.693 INFO:teuthology.orchestra.run.smithi133.stdout: "avgtime": 0.000024604 2024-08-31T04:38:49.693 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-08-31T04:38:49.693 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-08-31T04:38:49.694 INFO:teuthology.orchestra.run.smithi133.stdout: "finisher-PurgeQueue": { 2024-08-31T04:38:49.694 INFO:teuthology.orchestra.run.smithi133.stdout: "queue_len": 0, 2024-08-31T04:38:49.694 INFO:teuthology.orchestra.run.smithi133.stdout: "complete_latency": { 2024-08-31T04:38:49.694 INFO:teuthology.orchestra.run.smithi133.stdout: "avgcount": 0, 2024-08-31T04:38:49.694 INFO:teuthology.orchestra.run.smithi133.stdout: "sum": 0.000000000, 2024-08-31T04:38:49.694 INFO:teuthology.orchestra.run.smithi133.stdout: "avgtime": 0.000000000 2024-08-31T04:38:49.694 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-08-31T04:38:49.694 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-08-31T04:38:49.694 INFO:teuthology.orchestra.run.smithi133.stdout: "mds": { 2024-08-31T04:38:49.694 INFO:teuthology.orchestra.run.smithi133.stdout: "request": 0, 2024-08-31T04:38:49.694 INFO:teuthology.orchestra.run.smithi133.stdout: "reply": 0, 2024-08-31T04:38:49.694 INFO:teuthology.orchestra.run.smithi133.stdout: "reply_latency": { 2024-08-31T04:38:49.695 INFO:teuthology.orchestra.run.smithi133.stdout: "avgcount": 0, 2024-08-31T04:38:49.695 INFO:teuthology.orchestra.run.smithi133.stdout: "sum": 0.000000000, 2024-08-31T04:38:49.695 INFO:teuthology.orchestra.run.smithi133.stdout: "avgtime": 0.000000000 2024-08-31T04:38:49.695 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-08-31T04:38:49.695 INFO:teuthology.orchestra.run.smithi133.stdout: "slow_reply": 0, 2024-08-31T04:38:49.695 INFO:teuthology.orchestra.run.smithi133.stdout: "forward": 0, 2024-08-31T04:38:49.695 INFO:teuthology.orchestra.run.smithi133.stdout: "dir_fetch_complete": 0, 2024-08-31T04:38:49.695 INFO:teuthology.orchestra.run.smithi133.stdout: "dir_fetch_keys": 0, 2024-08-31T04:38:49.695 INFO:teuthology.orchestra.run.smithi133.stdout: "dir_commit": 0, 2024-08-31T04:38:49.695 INFO:teuthology.orchestra.run.smithi133.stdout: "dir_split": 0, 2024-08-31T04:38:49.696 INFO:teuthology.orchestra.run.smithi133.stdout: "dir_merge": 0, 2024-08-31T04:38:49.696 INFO:teuthology.orchestra.run.smithi133.stdout: "inodes": 17531, 2024-08-31T04:38:49.696 INFO:teuthology.orchestra.run.smithi133.stdout: "inodes_top": 0, 2024-08-31T04:38:49.696 INFO:teuthology.orchestra.run.smithi133.stdout: "inodes_bottom": 17531, 2024-08-31T04:38:49.696 INFO:teuthology.orchestra.run.smithi133.stdout: "inodes_pin_tail": 0, 2024-08-31T04:38:49.696 INFO:teuthology.orchestra.run.smithi133.stdout: "inodes_pinned": 17531, 2024-08-31T04:38:49.696 INFO:teuthology.orchestra.run.smithi133.stdout: "inodes_expired": 0, 2024-08-31T04:38:49.696 INFO:teuthology.orchestra.run.smithi133.stdout: "inodes_with_caps": 0, 2024-08-31T04:38:49.696 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": 0, 2024-08-31T04:38:49.696 INFO:teuthology.orchestra.run.smithi133.stdout: "subtrees": 1, 2024-08-31T04:38:49.696 INFO:teuthology.orchestra.run.smithi133.stdout: "traverse": 0, 2024-08-31T04:38:49.696 INFO:teuthology.orchestra.run.smithi133.stdout: "traverse_hit": 0, 2024-08-31T04:38:49.697 INFO:teuthology.orchestra.run.smithi133.stdout: "traverse_forward": 0, 2024-08-31T04:38:49.697 INFO:teuthology.orchestra.run.smithi133.stdout: "traverse_discover": 0, 2024-08-31T04:38:49.697 INFO:teuthology.orchestra.run.smithi133.stdout: "traverse_dir_fetch": 0, 2024-08-31T04:38:49.697 INFO:teuthology.orchestra.run.smithi133.stdout: "traverse_remote_ino": 0, 2024-08-31T04:38:49.697 INFO:teuthology.orchestra.run.smithi133.stdout: "traverse_lock": 0, 2024-08-31T04:38:49.697 INFO:teuthology.orchestra.run.smithi133.stdout: "load_cent": 0, 2024-08-31T04:38:49.697 INFO:teuthology.orchestra.run.smithi133.stdout: "q": 0, 2024-08-31T04:38:49.697 INFO:teuthology.orchestra.run.smithi133.stdout: "exported": 0, 2024-08-31T04:38:49.697 INFO:teuthology.orchestra.run.smithi133.stdout: "exported_inodes": 0, 2024-08-31T04:38:49.697 INFO:teuthology.orchestra.run.smithi133.stdout: "imported": 0, 2024-08-31T04:38:49.697 INFO:teuthology.orchestra.run.smithi133.stdout: "imported_inodes": 0, 2024-08-31T04:38:49.697 INFO:teuthology.orchestra.run.smithi133.stdout: "openino_dir_fetch": 0, 2024-08-31T04:38:49.697 INFO:teuthology.orchestra.run.smithi133.stdout: "openino_backtrace_fetch": 0, 2024-08-31T04:38:49.698 INFO:teuthology.orchestra.run.smithi133.stdout: "openino_peer_discover": 0, 2024-08-31T04:38:49.698 INFO:teuthology.orchestra.run.smithi133.stdout: "root_rfiles": 0, 2024-08-31T04:38:49.698 INFO:teuthology.orchestra.run.smithi133.stdout: "root_rbytes": 0, 2024-08-31T04:38:49.698 INFO:teuthology.orchestra.run.smithi133.stdout: "root_rsnaps": 0, 2024-08-31T04:38:49.698 INFO:teuthology.orchestra.run.smithi133.stdout: "scrub_backtrace_fetch": 0, 2024-08-31T04:38:49.698 INFO:teuthology.orchestra.run.smithi133.stdout: "scrub_set_tag": 0, 2024-08-31T04:38:49.698 INFO:teuthology.orchestra.run.smithi133.stdout: "scrub_backtrace_repaired": 0, 2024-08-31T04:38:49.698 INFO:teuthology.orchestra.run.smithi133.stdout: "scrub_inotable_repaired": 0, 2024-08-31T04:38:49.698 INFO:teuthology.orchestra.run.smithi133.stdout: "scrub_dir_inodes": 0, 2024-08-31T04:38:49.698 INFO:teuthology.orchestra.run.smithi133.stdout: "scrub_dir_base_inodes": 0, 2024-08-31T04:38:49.698 INFO:teuthology.orchestra.run.smithi133.stdout: "scrub_dirfrag_rstats": 0, 2024-08-31T04:38:49.698 INFO:teuthology.orchestra.run.smithi133.stdout: "scrub_file_inodes": 0, 2024-08-31T04:38:49.698 INFO:teuthology.orchestra.run.smithi133.stdout: "handle_inode_file_caps": 0, 2024-08-31T04:38:49.699 INFO:teuthology.orchestra.run.smithi133.stdout: "ceph_cap_op_revoke": 0, 2024-08-31T04:38:49.699 INFO:teuthology.orchestra.run.smithi133.stdout: "ceph_cap_op_grant": 0, 2024-08-31T04:38:49.699 INFO:teuthology.orchestra.run.smithi133.stdout: "ceph_cap_op_trunc": 0, 2024-08-31T04:38:49.699 INFO:teuthology.orchestra.run.smithi133.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-08-31T04:38:49.699 INFO:teuthology.orchestra.run.smithi133.stdout: "ceph_cap_op_flush_ack": 0, 2024-08-31T04:38:49.699 INFO:teuthology.orchestra.run.smithi133.stdout: "handle_client_caps": 0, 2024-08-31T04:38:49.699 INFO:teuthology.orchestra.run.smithi133.stdout: "handle_client_caps_dirty": 0, 2024-08-31T04:38:49.699 INFO:teuthology.orchestra.run.smithi133.stdout: "handle_client_cap_release": 0, 2024-08-31T04:38:49.699 INFO:teuthology.orchestra.run.smithi133.stdout: "process_request_cap_release": 0 2024-08-31T04:38:49.699 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-08-31T04:38:49.699 INFO:teuthology.orchestra.run.smithi133.stdout: "mds_cache": { 2024-08-31T04:38:49.699 INFO:teuthology.orchestra.run.smithi133.stdout: "dir_update": 0, 2024-08-31T04:38:49.699 INFO:teuthology.orchestra.run.smithi133.stdout: "dir_update_receipt": 0, 2024-08-31T04:38:49.700 INFO:teuthology.orchestra.run.smithi133.stdout: "dir_try_discover": 0, 2024-08-31T04:38:49.700 INFO:teuthology.orchestra.run.smithi133.stdout: "dir_send_discover": 0, 2024-08-31T04:38:49.700 INFO:teuthology.orchestra.run.smithi133.stdout: "dir_handle_discover": 0, 2024-08-31T04:38:49.700 INFO:teuthology.orchestra.run.smithi133.stdout: "num_strays": 0, 2024-08-31T04:38:49.700 INFO:teuthology.orchestra.run.smithi133.stdout: "num_strays_delayed": 0, 2024-08-31T04:38:49.700 INFO:teuthology.orchestra.run.smithi133.stdout: "num_strays_enqueuing": 0, 2024-08-31T04:38:49.700 INFO:teuthology.orchestra.run.smithi133.stdout: "strays_created": 0, 2024-08-31T04:38:49.700 INFO:teuthology.orchestra.run.smithi133.stdout: "strays_enqueued": 0, 2024-08-31T04:38:49.700 INFO:teuthology.orchestra.run.smithi133.stdout: "strays_reintegrated": 0, 2024-08-31T04:38:49.700 INFO:teuthology.orchestra.run.smithi133.stdout: "strays_migrated": 0, 2024-08-31T04:38:49.700 INFO:teuthology.orchestra.run.smithi133.stdout: "num_recovering_processing": 0, 2024-08-31T04:38:49.700 INFO:teuthology.orchestra.run.smithi133.stdout: "num_recovering_enqueued": 0, 2024-08-31T04:38:49.701 INFO:teuthology.orchestra.run.smithi133.stdout: "num_recovering_prioritized": 0, 2024-08-31T04:38:49.701 INFO:teuthology.orchestra.run.smithi133.stdout: "recovery_started": 0, 2024-08-31T04:38:49.701 INFO:teuthology.orchestra.run.smithi133.stdout: "recovery_completed": 0, 2024-08-31T04:38:49.701 INFO:teuthology.orchestra.run.smithi133.stdout: "ireq_quiesce_path": 0, 2024-08-31T04:38:49.701 INFO:teuthology.orchestra.run.smithi133.stdout: "ireq_quiesce_inode": 0, 2024-08-31T04:38:49.701 INFO:teuthology.orchestra.run.smithi133.stdout: "ireq_enqueue_scrub": 0, 2024-08-31T04:38:49.701 INFO:teuthology.orchestra.run.smithi133.stdout: "ireq_exportdir": 0, 2024-08-31T04:38:49.701 INFO:teuthology.orchestra.run.smithi133.stdout: "ireq_flush": 0, 2024-08-31T04:38:49.701 INFO:teuthology.orchestra.run.smithi133.stdout: "ireq_fragmentdir": 0, 2024-08-31T04:38:49.701 INFO:teuthology.orchestra.run.smithi133.stdout: "ireq_fragstats": 0, 2024-08-31T04:38:49.701 INFO:teuthology.orchestra.run.smithi133.stdout: "ireq_inodestats": 0, 2024-08-31T04:38:49.701 INFO:teuthology.orchestra.run.smithi133.stdout: "uninline_started": 0, 2024-08-31T04:38:49.701 INFO:teuthology.orchestra.run.smithi133.stdout: "uninline_succeeded": 0, 2024-08-31T04:38:49.702 INFO:teuthology.orchestra.run.smithi133.stdout: "uninline_write_failed": 0 2024-08-31T04:38:49.702 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-08-31T04:38:49.702 INFO:teuthology.orchestra.run.smithi133.stdout: "mds_log": { 2024-08-31T04:38:49.702 INFO:teuthology.orchestra.run.smithi133.stdout: "evlrg": 0, 2024-08-31T04:38:49.702 INFO:teuthology.orchestra.run.smithi133.stdout: "evadd": 0, 2024-08-31T04:38:49.702 INFO:teuthology.orchestra.run.smithi133.stdout: "evex": 0, 2024-08-31T04:38:49.702 INFO:teuthology.orchestra.run.smithi133.stdout: "evtrm": 0, 2024-08-31T04:38:49.702 INFO:teuthology.orchestra.run.smithi133.stdout: "ev": 85342, 2024-08-31T04:38:49.702 INFO:teuthology.orchestra.run.smithi133.stdout: "evexg": 0, 2024-08-31T04:38:49.702 INFO:teuthology.orchestra.run.smithi133.stdout: "evexd": 0, 2024-08-31T04:38:49.702 INFO:teuthology.orchestra.run.smithi133.stdout: "segadd": 0, 2024-08-31T04:38:49.702 INFO:teuthology.orchestra.run.smithi133.stdout: "segex": 0, 2024-08-31T04:38:49.702 INFO:teuthology.orchestra.run.smithi133.stdout: "segtrm": 0, 2024-08-31T04:38:49.703 INFO:teuthology.orchestra.run.smithi133.stdout: "seg": 108, 2024-08-31T04:38:49.703 INFO:teuthology.orchestra.run.smithi133.stdout: "segmjr": 8, 2024-08-31T04:38:49.703 INFO:teuthology.orchestra.run.smithi133.stdout: "segexg": 0, 2024-08-31T04:38:49.703 INFO:teuthology.orchestra.run.smithi133.stdout: "segexd": 0, 2024-08-31T04:38:49.703 INFO:teuthology.orchestra.run.smithi133.stdout: "expos": 4194304, 2024-08-31T04:38:49.703 INFO:teuthology.orchestra.run.smithi133.stdout: "wrpos": 184137191, 2024-08-31T04:38:49.703 INFO:teuthology.orchestra.run.smithi133.stdout: "rdpos": 184127654, 2024-08-31T04:38:49.703 INFO:teuthology.orchestra.run.smithi133.stdout: "jlat": { 2024-08-31T04:38:49.703 INFO:teuthology.orchestra.run.smithi133.stdout: "avgcount": 0, 2024-08-31T04:38:49.703 INFO:teuthology.orchestra.run.smithi133.stdout: "sum": 0.000000000, 2024-08-31T04:38:49.703 INFO:teuthology.orchestra.run.smithi133.stdout: "avgtime": 0.000000000 2024-08-31T04:38:49.703 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-08-31T04:38:49.703 INFO:teuthology.orchestra.run.smithi133.stdout: "replayed": 85342 2024-08-31T04:38:49.704 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-08-31T04:38:49.704 INFO:teuthology.orchestra.run.smithi133.stdout: "mds_mem": { 2024-08-31T04:38:49.704 INFO:teuthology.orchestra.run.smithi133.stdout: "ino": 13, 2024-08-31T04:38:49.704 INFO:teuthology.orchestra.run.smithi133.stdout: "ino+": 25611, 2024-08-31T04:38:49.704 INFO:teuthology.orchestra.run.smithi133.stdout: "ino-": 25598, 2024-08-31T04:38:49.704 INFO:teuthology.orchestra.run.smithi133.stdout: "dir": 11, 2024-08-31T04:38:49.704 INFO:teuthology.orchestra.run.smithi133.stdout: "dir+": 1381, 2024-08-31T04:38:49.704 INFO:teuthology.orchestra.run.smithi133.stdout: "dir-": 1370, 2024-08-31T04:38:49.704 INFO:teuthology.orchestra.run.smithi133.stdout: "dn": 17531, 2024-08-31T04:38:49.704 INFO:teuthology.orchestra.run.smithi133.stdout: "dn+": 65424, 2024-08-31T04:38:49.704 INFO:teuthology.orchestra.run.smithi133.stdout: "dn-": 47893, 2024-08-31T04:38:49.704 INFO:teuthology.orchestra.run.smithi133.stdout: "cap": 0, 2024-08-31T04:38:49.704 INFO:teuthology.orchestra.run.smithi133.stdout: "cap+": 0, 2024-08-31T04:38:49.705 INFO:teuthology.orchestra.run.smithi133.stdout: "cap-": 0, 2024-08-31T04:38:49.705 INFO:teuthology.orchestra.run.smithi133.stdout: "rss": 146492, 2024-08-31T04:38:49.705 INFO:teuthology.orchestra.run.smithi133.stdout: "heap": 382672896 2024-08-31T04:38:49.705 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-08-31T04:38:49.705 INFO:teuthology.orchestra.run.smithi133.stdout: "mds_server": { 2024-08-31T04:38:49.705 INFO:teuthology.orchestra.run.smithi133.stdout: "dispatch_client_request": 0, 2024-08-31T04:38:49.705 INFO:teuthology.orchestra.run.smithi133.stdout: "dispatch_server_request": 0, 2024-08-31T04:38:49.705 INFO:teuthology.orchestra.run.smithi133.stdout: "handle_client_request": 0, 2024-08-31T04:38:49.705 INFO:teuthology.orchestra.run.smithi133.stdout: "handle_client_session": 0, 2024-08-31T04:38:49.706 INFO:teuthology.orchestra.run.smithi133.stdout: "handle_peer_request": 0, 2024-08-31T04:38:49.706 INFO:teuthology.orchestra.run.smithi133.stdout: "req_create_latency": { 2024-08-31T04:38:49.706 INFO:teuthology.orchestra.run.smithi133.stdout: "avgcount": 0, 2024-08-31T04:38:49.706 INFO:teuthology.orchestra.run.smithi133.stdout: "sum": 0.000000000, 2024-08-31T04:38:49.706 INFO:teuthology.orchestra.run.smithi133.stdout: "avgtime": 0.000000000 2024-08-31T04:38:49.706 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-08-31T04:38:49.706 INFO:teuthology.orchestra.run.smithi133.stdout: "req_getattr_latency": { 2024-08-31T04:38:49.706 INFO:teuthology.orchestra.run.smithi133.stdout: "avgcount": 0, 2024-08-31T04:38:49.706 INFO:teuthology.orchestra.run.smithi133.stdout: "sum": 0.000000000, 2024-08-31T04:38:49.706 INFO:teuthology.orchestra.run.smithi133.stdout: "avgtime": 0.000000000 2024-08-31T04:38:49.706 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-08-31T04:38:49.706 INFO:teuthology.orchestra.run.smithi133.stdout: "req_getfilelock_latency": { 2024-08-31T04:38:49.706 INFO:teuthology.orchestra.run.smithi133.stdout: "avgcount": 0, 2024-08-31T04:38:49.707 INFO:teuthology.orchestra.run.smithi133.stdout: "sum": 0.000000000, 2024-08-31T04:38:49.707 INFO:teuthology.orchestra.run.smithi133.stdout: "avgtime": 0.000000000 2024-08-31T04:38:49.707 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-08-31T04:38:49.707 INFO:teuthology.orchestra.run.smithi133.stdout: "req_link_latency": { 2024-08-31T04:38:49.707 INFO:teuthology.orchestra.run.smithi133.stdout: "avgcount": 0, 2024-08-31T04:38:49.707 INFO:teuthology.orchestra.run.smithi133.stdout: "sum": 0.000000000, 2024-08-31T04:38:49.707 INFO:teuthology.orchestra.run.smithi133.stdout: "avgtime": 0.000000000 2024-08-31T04:38:49.707 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-08-31T04:38:49.707 INFO:teuthology.orchestra.run.smithi133.stdout: "req_lookup_latency": { 2024-08-31T04:38:49.707 INFO:teuthology.orchestra.run.smithi133.stdout: "avgcount": 0, 2024-08-31T04:38:49.707 INFO:teuthology.orchestra.run.smithi133.stdout: "sum": 0.000000000, 2024-08-31T04:38:49.707 INFO:teuthology.orchestra.run.smithi133.stdout: "avgtime": 0.000000000 2024-08-31T04:38:49.708 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-08-31T04:38:49.708 INFO:teuthology.orchestra.run.smithi133.stdout: "req_lookuphash_latency": { 2024-08-31T04:38:49.708 INFO:teuthology.orchestra.run.smithi133.stdout: "avgcount": 0, 2024-08-31T04:38:49.708 INFO:teuthology.orchestra.run.smithi133.stdout: "sum": 0.000000000, 2024-08-31T04:38:49.708 INFO:teuthology.orchestra.run.smithi133.stdout: "avgtime": 0.000000000 2024-08-31T04:38:49.708 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-08-31T04:38:49.708 INFO:teuthology.orchestra.run.smithi133.stdout: "req_lookupino_latency": { 2024-08-31T04:38:49.708 INFO:teuthology.orchestra.run.smithi133.stdout: "avgcount": 0, 2024-08-31T04:38:49.708 INFO:teuthology.orchestra.run.smithi133.stdout: "sum": 0.000000000, 2024-08-31T04:38:49.708 INFO:teuthology.orchestra.run.smithi133.stdout: "avgtime": 0.000000000 2024-08-31T04:38:49.708 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-08-31T04:38:49.708 INFO:teuthology.orchestra.run.smithi133.stdout: "req_lookupname_latency": { 2024-08-31T04:38:49.709 INFO:teuthology.orchestra.run.smithi133.stdout: "avgcount": 0, 2024-08-31T04:38:49.709 INFO:teuthology.orchestra.run.smithi133.stdout: "sum": 0.000000000, 2024-08-31T04:38:49.709 INFO:teuthology.orchestra.run.smithi133.stdout: "avgtime": 0.000000000 2024-08-31T04:38:49.709 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-08-31T04:38:49.709 INFO:teuthology.orchestra.run.smithi133.stdout: "req_lookupparent_latency": { 2024-08-31T04:38:49.709 INFO:teuthology.orchestra.run.smithi133.stdout: "avgcount": 0, 2024-08-31T04:38:49.709 INFO:teuthology.orchestra.run.smithi133.stdout: "sum": 0.000000000, 2024-08-31T04:38:49.709 INFO:teuthology.orchestra.run.smithi133.stdout: "avgtime": 0.000000000 2024-08-31T04:38:49.709 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-08-31T04:38:49.709 INFO:teuthology.orchestra.run.smithi133.stdout: "req_lookupsnap_latency": { 2024-08-31T04:38:49.709 INFO:teuthology.orchestra.run.smithi133.stdout: "avgcount": 0, 2024-08-31T04:38:49.709 INFO:teuthology.orchestra.run.smithi133.stdout: "sum": 0.000000000, 2024-08-31T04:38:49.709 INFO:teuthology.orchestra.run.smithi133.stdout: "avgtime": 0.000000000 2024-08-31T04:38:49.709 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-08-31T04:38:49.710 INFO:teuthology.orchestra.run.smithi133.stdout: "req_lssnap_latency": { 2024-08-31T04:38:49.710 INFO:teuthology.orchestra.run.smithi133.stdout: "avgcount": 0, 2024-08-31T04:38:49.710 INFO:teuthology.orchestra.run.smithi133.stdout: "sum": 0.000000000, 2024-08-31T04:38:49.710 INFO:teuthology.orchestra.run.smithi133.stdout: "avgtime": 0.000000000 2024-08-31T04:38:49.710 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-08-31T04:38:49.710 INFO:teuthology.orchestra.run.smithi133.stdout: "req_mkdir_latency": { 2024-08-31T04:38:49.711 INFO:teuthology.orchestra.run.smithi133.stdout: "avgcount": 0, 2024-08-31T04:38:49.711 INFO:teuthology.orchestra.run.smithi133.stdout: "sum": 0.000000000, 2024-08-31T04:38:49.711 INFO:teuthology.orchestra.run.smithi133.stdout: "avgtime": 0.000000000 2024-08-31T04:38:49.711 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-08-31T04:38:49.711 INFO:teuthology.orchestra.run.smithi133.stdout: "req_mknod_latency": { 2024-08-31T04:38:49.711 INFO:teuthology.orchestra.run.smithi133.stdout: "avgcount": 0, 2024-08-31T04:38:49.711 INFO:teuthology.orchestra.run.smithi133.stdout: "sum": 0.000000000, 2024-08-31T04:38:49.711 INFO:teuthology.orchestra.run.smithi133.stdout: "avgtime": 0.000000000 2024-08-31T04:38:49.711 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-08-31T04:38:49.711 INFO:teuthology.orchestra.run.smithi133.stdout: "req_mksnap_latency": { 2024-08-31T04:38:49.711 INFO:teuthology.orchestra.run.smithi133.stdout: "avgcount": 0, 2024-08-31T04:38:49.711 INFO:teuthology.orchestra.run.smithi133.stdout: "sum": 0.000000000, 2024-08-31T04:38:49.711 INFO:teuthology.orchestra.run.smithi133.stdout: "avgtime": 0.000000000 2024-08-31T04:38:49.712 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-08-31T04:38:49.712 INFO:teuthology.orchestra.run.smithi133.stdout: "req_open_latency": { 2024-08-31T04:38:49.712 INFO:teuthology.orchestra.run.smithi133.stdout: "avgcount": 0, 2024-08-31T04:38:49.712 INFO:teuthology.orchestra.run.smithi133.stdout: "sum": 0.000000000, 2024-08-31T04:38:49.712 INFO:teuthology.orchestra.run.smithi133.stdout: "avgtime": 0.000000000 2024-08-31T04:38:49.712 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-08-31T04:38:49.712 INFO:teuthology.orchestra.run.smithi133.stdout: "req_readdir_latency": { 2024-08-31T04:38:49.712 INFO:teuthology.orchestra.run.smithi133.stdout: "avgcount": 0, 2024-08-31T04:38:49.712 INFO:teuthology.orchestra.run.smithi133.stdout: "sum": 0.000000000, 2024-08-31T04:38:49.712 INFO:teuthology.orchestra.run.smithi133.stdout: "avgtime": 0.000000000 2024-08-31T04:38:49.712 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-08-31T04:38:49.712 INFO:teuthology.orchestra.run.smithi133.stdout: "req_rename_latency": { 2024-08-31T04:38:49.713 INFO:teuthology.orchestra.run.smithi133.stdout: "avgcount": 0, 2024-08-31T04:38:49.713 INFO:teuthology.orchestra.run.smithi133.stdout: "sum": 0.000000000, 2024-08-31T04:38:49.713 INFO:teuthology.orchestra.run.smithi133.stdout: "avgtime": 0.000000000 2024-08-31T04:38:49.713 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-08-31T04:38:49.713 INFO:teuthology.orchestra.run.smithi133.stdout: "req_renamesnap_latency": { 2024-08-31T04:38:49.713 INFO:teuthology.orchestra.run.smithi133.stdout: "avgcount": 0, 2024-08-31T04:38:49.713 INFO:teuthology.orchestra.run.smithi133.stdout: "sum": 0.000000000, 2024-08-31T04:38:49.713 INFO:teuthology.orchestra.run.smithi133.stdout: "avgtime": 0.000000000 2024-08-31T04:38:49.713 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-08-31T04:38:49.713 INFO:teuthology.orchestra.run.smithi133.stdout: "req_snapdiff_latency": { 2024-08-31T04:38:49.713 INFO:teuthology.orchestra.run.smithi133.stdout: "avgcount": 0, 2024-08-31T04:38:49.713 INFO:teuthology.orchestra.run.smithi133.stdout: "sum": 0.000000000, 2024-08-31T04:38:49.713 INFO:teuthology.orchestra.run.smithi133.stdout: "avgtime": 0.000000000 2024-08-31T04:38:49.714 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-08-31T04:38:49.714 INFO:teuthology.orchestra.run.smithi133.stdout: "req_rmdir_latency": { 2024-08-31T04:38:49.714 INFO:teuthology.orchestra.run.smithi133.stdout: "avgcount": 0, 2024-08-31T04:38:49.714 INFO:teuthology.orchestra.run.smithi133.stdout: "sum": 0.000000000, 2024-08-31T04:38:49.714 INFO:teuthology.orchestra.run.smithi133.stdout: "avgtime": 0.000000000 2024-08-31T04:38:49.714 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-08-31T04:38:49.714 INFO:teuthology.orchestra.run.smithi133.stdout: "req_rmsnap_latency": { 2024-08-31T04:38:49.714 INFO:teuthology.orchestra.run.smithi133.stdout: "avgcount": 0, 2024-08-31T04:38:49.714 INFO:teuthology.orchestra.run.smithi133.stdout: "sum": 0.000000000, 2024-08-31T04:38:49.714 INFO:teuthology.orchestra.run.smithi133.stdout: "avgtime": 0.000000000 2024-08-31T04:38:49.714 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-08-31T04:38:49.714 INFO:teuthology.orchestra.run.smithi133.stdout: "req_rmxattr_latency": { 2024-08-31T04:38:49.714 INFO:teuthology.orchestra.run.smithi133.stdout: "avgcount": 0, 2024-08-31T04:38:49.714 INFO:teuthology.orchestra.run.smithi133.stdout: "sum": 0.000000000, 2024-08-31T04:38:49.715 INFO:teuthology.orchestra.run.smithi133.stdout: "avgtime": 0.000000000 2024-08-31T04:38:49.715 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-08-31T04:38:49.715 INFO:teuthology.orchestra.run.smithi133.stdout: "req_setattr_latency": { 2024-08-31T04:38:49.715 INFO:teuthology.orchestra.run.smithi133.stdout: "avgcount": 0, 2024-08-31T04:38:49.715 INFO:teuthology.orchestra.run.smithi133.stdout: "sum": 0.000000000, 2024-08-31T04:38:49.715 INFO:teuthology.orchestra.run.smithi133.stdout: "avgtime": 0.000000000 2024-08-31T04:38:49.715 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-08-31T04:38:49.715 INFO:teuthology.orchestra.run.smithi133.stdout: "req_setdirlayout_latency": { 2024-08-31T04:38:49.715 INFO:teuthology.orchestra.run.smithi133.stdout: "avgcount": 0, 2024-08-31T04:38:49.715 INFO:teuthology.orchestra.run.smithi133.stdout: "sum": 0.000000000, 2024-08-31T04:38:49.715 INFO:teuthology.orchestra.run.smithi133.stdout: "avgtime": 0.000000000 2024-08-31T04:38:49.715 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-08-31T04:38:49.715 INFO:teuthology.orchestra.run.smithi133.stdout: "req_setfilelock_latency": { 2024-08-31T04:38:49.716 INFO:teuthology.orchestra.run.smithi133.stdout: "avgcount": 0, 2024-08-31T04:38:49.716 INFO:teuthology.orchestra.run.smithi133.stdout: "sum": 0.000000000, 2024-08-31T04:38:49.716 INFO:teuthology.orchestra.run.smithi133.stdout: "avgtime": 0.000000000 2024-08-31T04:38:49.716 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-08-31T04:38:49.716 INFO:teuthology.orchestra.run.smithi133.stdout: "req_setlayout_latency": { 2024-08-31T04:38:49.716 INFO:teuthology.orchestra.run.smithi133.stdout: "avgcount": 0, 2024-08-31T04:38:49.716 INFO:teuthology.orchestra.run.smithi133.stdout: "sum": 0.000000000, 2024-08-31T04:38:49.716 INFO:teuthology.orchestra.run.smithi133.stdout: "avgtime": 0.000000000 2024-08-31T04:38:49.716 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-08-31T04:38:49.716 INFO:teuthology.orchestra.run.smithi133.stdout: "req_setxattr_latency": { 2024-08-31T04:38:49.716 INFO:teuthology.orchestra.run.smithi133.stdout: "avgcount": 0, 2024-08-31T04:38:49.716 INFO:teuthology.orchestra.run.smithi133.stdout: "sum": 0.000000000, 2024-08-31T04:38:49.716 INFO:teuthology.orchestra.run.smithi133.stdout: "avgtime": 0.000000000 2024-08-31T04:38:49.717 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-08-31T04:38:49.717 INFO:teuthology.orchestra.run.smithi133.stdout: "req_symlink_latency": { 2024-08-31T04:38:49.717 INFO:teuthology.orchestra.run.smithi133.stdout: "avgcount": 0, 2024-08-31T04:38:49.717 INFO:teuthology.orchestra.run.smithi133.stdout: "sum": 0.000000000, 2024-08-31T04:38:49.717 INFO:teuthology.orchestra.run.smithi133.stdout: "avgtime": 0.000000000 2024-08-31T04:38:49.717 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-08-31T04:38:49.717 INFO:teuthology.orchestra.run.smithi133.stdout: "req_unlink_latency": { 2024-08-31T04:38:49.717 INFO:teuthology.orchestra.run.smithi133.stdout: "avgcount": 0, 2024-08-31T04:38:49.717 INFO:teuthology.orchestra.run.smithi133.stdout: "sum": 0.000000000, 2024-08-31T04:38:49.717 INFO:teuthology.orchestra.run.smithi133.stdout: "avgtime": 0.000000000 2024-08-31T04:38:49.717 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-08-31T04:38:49.717 INFO:teuthology.orchestra.run.smithi133.stdout: "cap_revoke_eviction": 0, 2024-08-31T04:38:49.717 INFO:teuthology.orchestra.run.smithi133.stdout: "cap_acquisition_throttle": 0, 2024-08-31T04:38:49.718 INFO:teuthology.orchestra.run.smithi133.stdout: "req_getvxattr_latency": { 2024-08-31T04:38:49.718 INFO:teuthology.orchestra.run.smithi133.stdout: "avgcount": 0, 2024-08-31T04:38:49.718 INFO:teuthology.orchestra.run.smithi133.stdout: "sum": 0.000000000, 2024-08-31T04:38:49.718 INFO:teuthology.orchestra.run.smithi133.stdout: "avgtime": 0.000000000 2024-08-31T04:38:49.718 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-08-31T04:38:49.718 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-08-31T04:38:49.718 INFO:teuthology.orchestra.run.smithi133.stdout: "mds_sessions": { 2024-08-31T04:38:49.718 INFO:teuthology.orchestra.run.smithi133.stdout: "session_count": 1, 2024-08-31T04:38:49.718 INFO:teuthology.orchestra.run.smithi133.stdout: "session_add": 2, 2024-08-31T04:38:49.718 INFO:teuthology.orchestra.run.smithi133.stdout: "session_remove": 1, 2024-08-31T04:38:49.718 INFO:teuthology.orchestra.run.smithi133.stdout: "sessions_open": 1, 2024-08-31T04:38:49.718 INFO:teuthology.orchestra.run.smithi133.stdout: "sessions_stale": 0, 2024-08-31T04:38:49.718 INFO:teuthology.orchestra.run.smithi133.stdout: "total_load": 0, 2024-08-31T04:38:49.719 INFO:teuthology.orchestra.run.smithi133.stdout: "average_load": 0, 2024-08-31T04:38:49.719 INFO:teuthology.orchestra.run.smithi133.stdout: "avg_session_uptime": 2187, 2024-08-31T04:38:49.719 INFO:teuthology.orchestra.run.smithi133.stdout: "mdthresh_evicted": 0 2024-08-31T04:38:49.719 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-08-31T04:38:49.719 INFO:teuthology.orchestra.run.smithi133.stdout: "mempool": { 2024-08-31T04:38:49.719 INFO:teuthology.orchestra.run.smithi133.stdout: "bloom_filter_bytes": 0, 2024-08-31T04:38:49.719 INFO:teuthology.orchestra.run.smithi133.stdout: "bloom_filter_items": 0, 2024-08-31T04:38:49.719 INFO:teuthology.orchestra.run.smithi133.stdout: "bluestore_alloc_bytes": 0, 2024-08-31T04:38:49.719 INFO:teuthology.orchestra.run.smithi133.stdout: "bluestore_alloc_items": 0, 2024-08-31T04:38:49.719 INFO:teuthology.orchestra.run.smithi133.stdout: "bluestore_cache_data_bytes": 0, 2024-08-31T04:38:49.719 INFO:teuthology.orchestra.run.smithi133.stdout: "bluestore_cache_data_items": 0, 2024-08-31T04:38:49.719 INFO:teuthology.orchestra.run.smithi133.stdout: "bluestore_cache_onode_bytes": 0, 2024-08-31T04:38:49.719 INFO:teuthology.orchestra.run.smithi133.stdout: "bluestore_cache_onode_items": 0, 2024-08-31T04:38:49.720 INFO:teuthology.orchestra.run.smithi133.stdout: "bluestore_cache_meta_bytes": 0, 2024-08-31T04:38:49.720 INFO:teuthology.orchestra.run.smithi133.stdout: "bluestore_cache_meta_items": 0, 2024-08-31T04:38:49.720 INFO:teuthology.orchestra.run.smithi133.stdout: "bluestore_cache_other_bytes": 0, 2024-08-31T04:38:49.720 INFO:teuthology.orchestra.run.smithi133.stdout: "bluestore_cache_other_items": 0, 2024-08-31T04:38:49.720 INFO:teuthology.orchestra.run.smithi133.stdout: "bluestore_cache_buffer_bytes": 0, 2024-08-31T04:38:49.720 INFO:teuthology.orchestra.run.smithi133.stdout: "bluestore_cache_buffer_items": 0, 2024-08-31T04:38:49.720 INFO:teuthology.orchestra.run.smithi133.stdout: "bluestore_extent_bytes": 0, 2024-08-31T04:38:49.720 INFO:teuthology.orchestra.run.smithi133.stdout: "bluestore_extent_items": 0, 2024-08-31T04:38:49.720 INFO:teuthology.orchestra.run.smithi133.stdout: "bluestore_blob_bytes": 0, 2024-08-31T04:38:49.720 INFO:teuthology.orchestra.run.smithi133.stdout: "bluestore_blob_items": 0, 2024-08-31T04:38:49.720 INFO:teuthology.orchestra.run.smithi133.stdout: "bluestore_shared_blob_bytes": 0, 2024-08-31T04:38:49.720 INFO:teuthology.orchestra.run.smithi133.stdout: "bluestore_shared_blob_items": 0, 2024-08-31T04:38:49.721 INFO:teuthology.orchestra.run.smithi133.stdout: "bluestore_inline_bl_bytes": 0, 2024-08-31T04:38:49.721 INFO:teuthology.orchestra.run.smithi133.stdout: "bluestore_inline_bl_items": 0, 2024-08-31T04:38:49.721 INFO:teuthology.orchestra.run.smithi133.stdout: "bluestore_fsck_bytes": 0, 2024-08-31T04:38:49.721 INFO:teuthology.orchestra.run.smithi133.stdout: "bluestore_fsck_items": 0, 2024-08-31T04:38:49.721 INFO:teuthology.orchestra.run.smithi133.stdout: "bluestore_txc_bytes": 0, 2024-08-31T04:38:49.721 INFO:teuthology.orchestra.run.smithi133.stdout: "bluestore_txc_items": 0, 2024-08-31T04:38:49.721 INFO:teuthology.orchestra.run.smithi133.stdout: "bluestore_writing_deferred_bytes": 0, 2024-08-31T04:38:49.721 INFO:teuthology.orchestra.run.smithi133.stdout: "bluestore_writing_deferred_items": 0, 2024-08-31T04:38:49.721 INFO:teuthology.orchestra.run.smithi133.stdout: "bluestore_writing_bytes": 0, 2024-08-31T04:38:49.721 INFO:teuthology.orchestra.run.smithi133.stdout: "bluestore_writing_items": 0, 2024-08-31T04:38:49.721 INFO:teuthology.orchestra.run.smithi133.stdout: "bluefs_bytes": 0, 2024-08-31T04:38:49.721 INFO:teuthology.orchestra.run.smithi133.stdout: "bluefs_items": 0, 2024-08-31T04:38:49.721 INFO:teuthology.orchestra.run.smithi133.stdout: "bluefs_file_reader_bytes": 0, 2024-08-31T04:38:49.722 INFO:teuthology.orchestra.run.smithi133.stdout: "bluefs_file_reader_items": 0, 2024-08-31T04:38:49.722 INFO:teuthology.orchestra.run.smithi133.stdout: "bluefs_file_writer_bytes": 0, 2024-08-31T04:38:49.722 INFO:teuthology.orchestra.run.smithi133.stdout: "bluefs_file_writer_items": 0, 2024-08-31T04:38:49.722 INFO:teuthology.orchestra.run.smithi133.stdout: "buffer_anon_bytes": 241017, 2024-08-31T04:38:49.722 INFO:teuthology.orchestra.run.smithi133.stdout: "buffer_anon_items": 83, 2024-08-31T04:38:49.722 INFO:teuthology.orchestra.run.smithi133.stdout: "buffer_meta_bytes": 0, 2024-08-31T04:38:49.722 INFO:teuthology.orchestra.run.smithi133.stdout: "buffer_meta_items": 0, 2024-08-31T04:38:49.722 INFO:teuthology.orchestra.run.smithi133.stdout: "osd_bytes": 0, 2024-08-31T04:38:49.722 INFO:teuthology.orchestra.run.smithi133.stdout: "osd_items": 0, 2024-08-31T04:38:49.722 INFO:teuthology.orchestra.run.smithi133.stdout: "osd_mapbl_bytes": 0, 2024-08-31T04:38:49.722 INFO:teuthology.orchestra.run.smithi133.stdout: "osd_mapbl_items": 0, 2024-08-31T04:38:49.722 INFO:teuthology.orchestra.run.smithi133.stdout: "osd_pglog_bytes": 0, 2024-08-31T04:38:49.722 INFO:teuthology.orchestra.run.smithi133.stdout: "osd_pglog_items": 0, 2024-08-31T04:38:49.723 INFO:teuthology.orchestra.run.smithi133.stdout: "osdmap_bytes": 7504, 2024-08-31T04:38:49.723 INFO:teuthology.orchestra.run.smithi133.stdout: "osdmap_items": 155, 2024-08-31T04:38:49.723 INFO:teuthology.orchestra.run.smithi133.stdout: "osdmap_mapping_bytes": 0, 2024-08-31T04:38:49.723 INFO:teuthology.orchestra.run.smithi133.stdout: "osdmap_mapping_items": 0, 2024-08-31T04:38:49.723 INFO:teuthology.orchestra.run.smithi133.stdout: "pgmap_bytes": 0, 2024-08-31T04:38:49.723 INFO:teuthology.orchestra.run.smithi133.stdout: "pgmap_items": 0, 2024-08-31T04:38:49.723 INFO:teuthology.orchestra.run.smithi133.stdout: "mds_co_bytes": 11964672, 2024-08-31T04:38:49.723 INFO:teuthology.orchestra.run.smithi133.stdout: "mds_co_items": 70252, 2024-08-31T04:38:49.723 INFO:teuthology.orchestra.run.smithi133.stdout: "unittest_1_bytes": 0, 2024-08-31T04:38:49.723 INFO:teuthology.orchestra.run.smithi133.stdout: "unittest_1_items": 0, 2024-08-31T04:38:49.723 INFO:teuthology.orchestra.run.smithi133.stdout: "unittest_2_bytes": 0, 2024-08-31T04:38:49.723 INFO:teuthology.orchestra.run.smithi133.stdout: "unittest_2_items": 0 2024-08-31T04:38:49.723 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-08-31T04:38:49.724 INFO:teuthology.orchestra.run.smithi133.stdout: "objecter": { 2024-08-31T04:38:49.724 INFO:teuthology.orchestra.run.smithi133.stdout: "op_active": 0, 2024-08-31T04:38:49.724 INFO:teuthology.orchestra.run.smithi133.stdout: "op_laggy": 0, 2024-08-31T04:38:49.724 INFO:teuthology.orchestra.run.smithi133.stdout: "op_send": 3559, 2024-08-31T04:38:49.724 INFO:teuthology.orchestra.run.smithi133.stdout: "op_send_bytes": 21, 2024-08-31T04:38:49.724 INFO:teuthology.orchestra.run.smithi133.stdout: "op_resend": 3, 2024-08-31T04:38:49.724 INFO:teuthology.orchestra.run.smithi133.stdout: "op_reply": 3559, 2024-08-31T04:38:49.724 INFO:teuthology.orchestra.run.smithi133.stdout: "op_latency": { 2024-08-31T04:38:49.724 INFO:teuthology.orchestra.run.smithi133.stdout: "avgcount": 3559, 2024-08-31T04:38:49.724 INFO:teuthology.orchestra.run.smithi133.stdout: "sum": 9.065826399, 2024-08-31T04:38:49.724 INFO:teuthology.orchestra.run.smithi133.stdout: "avgtime": 0.002547295 2024-08-31T04:38:49.724 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-08-31T04:38:49.725 INFO:teuthology.orchestra.run.smithi133.stdout: "op_inflight": 0, 2024-08-31T04:38:49.725 INFO:teuthology.orchestra.run.smithi133.stdout: "oplen_avg": { 2024-08-31T04:38:49.725 INFO:teuthology.orchestra.run.smithi133.stdout: "avgcount": 3559, 2024-08-31T04:38:49.725 INFO:teuthology.orchestra.run.smithi133.stdout: "sum": 3560 2024-08-31T04:38:49.725 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-08-31T04:38:49.725 INFO:teuthology.orchestra.run.smithi133.stdout: "op": 3559, 2024-08-31T04:38:49.725 INFO:teuthology.orchestra.run.smithi133.stdout: "op_r": 3559, 2024-08-31T04:38:49.725 INFO:teuthology.orchestra.run.smithi133.stdout: "op_w": 0, 2024-08-31T04:38:49.725 INFO:teuthology.orchestra.run.smithi133.stdout: "op_rmw": 0, 2024-08-31T04:38:49.725 INFO:teuthology.orchestra.run.smithi133.stdout: "op_pg": 0, 2024-08-31T04:38:49.725 INFO:teuthology.orchestra.run.smithi133.stdout: "osdop_stat": 2149, 2024-08-31T04:38:49.725 INFO:teuthology.orchestra.run.smithi133.stdout: "osdop_create": 0, 2024-08-31T04:38:49.725 INFO:teuthology.orchestra.run.smithi133.stdout: "osdop_read": 1408, 2024-08-31T04:38:49.726 INFO:teuthology.orchestra.run.smithi133.stdout: "osdop_write": 0, 2024-08-31T04:38:49.726 INFO:teuthology.orchestra.run.smithi133.stdout: "osdop_writefull": 0, 2024-08-31T04:38:49.726 INFO:teuthology.orchestra.run.smithi133.stdout: "osdop_writesame": 0, 2024-08-31T04:38:49.726 INFO:teuthology.orchestra.run.smithi133.stdout: "osdop_append": 0, 2024-08-31T04:38:49.726 INFO:teuthology.orchestra.run.smithi133.stdout: "osdop_zero": 0, 2024-08-31T04:38:49.726 INFO:teuthology.orchestra.run.smithi133.stdout: "osdop_truncate": 0, 2024-08-31T04:38:49.726 INFO:teuthology.orchestra.run.smithi133.stdout: "osdop_delete": 0, 2024-08-31T04:38:49.726 INFO:teuthology.orchestra.run.smithi133.stdout: "osdop_mapext": 0, 2024-08-31T04:38:49.726 INFO:teuthology.orchestra.run.smithi133.stdout: "osdop_sparse_read": 0, 2024-08-31T04:38:49.726 INFO:teuthology.orchestra.run.smithi133.stdout: "osdop_clonerange": 0, 2024-08-31T04:38:49.726 INFO:teuthology.orchestra.run.smithi133.stdout: "osdop_getxattr": 1, 2024-08-31T04:38:49.726 INFO:teuthology.orchestra.run.smithi133.stdout: "osdop_setxattr": 0, 2024-08-31T04:38:49.727 INFO:teuthology.orchestra.run.smithi133.stdout: "osdop_cmpxattr": 0, 2024-08-31T04:38:49.727 INFO:teuthology.orchestra.run.smithi133.stdout: "osdop_rmxattr": 0, 2024-08-31T04:38:49.727 INFO:teuthology.orchestra.run.smithi133.stdout: "osdop_resetxattrs": 0, 2024-08-31T04:38:49.727 INFO:teuthology.orchestra.run.smithi133.stdout: "osdop_call": 0, 2024-08-31T04:38:49.727 INFO:teuthology.orchestra.run.smithi133.stdout: "osdop_watch": 0, 2024-08-31T04:38:49.727 INFO:teuthology.orchestra.run.smithi133.stdout: "osdop_notify": 0, 2024-08-31T04:38:49.727 INFO:teuthology.orchestra.run.smithi133.stdout: "osdop_src_cmpxattr": 0, 2024-08-31T04:38:49.727 INFO:teuthology.orchestra.run.smithi133.stdout: "osdop_pgls": 0, 2024-08-31T04:38:49.727 INFO:teuthology.orchestra.run.smithi133.stdout: "osdop_pgls_filter": 0, 2024-08-31T04:38:49.727 INFO:teuthology.orchestra.run.smithi133.stdout: "osdop_other": 0, 2024-08-31T04:38:49.727 INFO:teuthology.orchestra.run.smithi133.stdout: "linger_active": 0, 2024-08-31T04:38:49.727 INFO:teuthology.orchestra.run.smithi133.stdout: "linger_send": 0, 2024-08-31T04:38:49.727 INFO:teuthology.orchestra.run.smithi133.stdout: "linger_resend": 0, 2024-08-31T04:38:49.728 INFO:teuthology.orchestra.run.smithi133.stdout: "linger_ping": 0, 2024-08-31T04:38:49.728 INFO:teuthology.orchestra.run.smithi133.stdout: "poolop_active": 0, 2024-08-31T04:38:49.728 INFO:teuthology.orchestra.run.smithi133.stdout: "poolop_send": 0, 2024-08-31T04:38:49.728 INFO:teuthology.orchestra.run.smithi133.stdout: "poolop_resend": 0, 2024-08-31T04:38:49.728 INFO:teuthology.orchestra.run.smithi133.stdout: "poolstat_active": 0, 2024-08-31T04:38:49.728 INFO:teuthology.orchestra.run.smithi133.stdout: "poolstat_send": 0, 2024-08-31T04:38:49.728 INFO:teuthology.orchestra.run.smithi133.stdout: "poolstat_resend": 0, 2024-08-31T04:38:49.728 INFO:teuthology.orchestra.run.smithi133.stdout: "statfs_active": 0, 2024-08-31T04:38:49.728 INFO:teuthology.orchestra.run.smithi133.stdout: "statfs_send": 0, 2024-08-31T04:38:49.728 INFO:teuthology.orchestra.run.smithi133.stdout: "statfs_resend": 0, 2024-08-31T04:38:49.728 INFO:teuthology.orchestra.run.smithi133.stdout: "command_active": 0, 2024-08-31T04:38:49.728 INFO:teuthology.orchestra.run.smithi133.stdout: "command_send": 0, 2024-08-31T04:38:49.728 INFO:teuthology.orchestra.run.smithi133.stdout: "command_resend": 0, 2024-08-31T04:38:49.729 INFO:teuthology.orchestra.run.smithi133.stdout: "map_epoch": 80, 2024-08-31T04:38:49.729 INFO:teuthology.orchestra.run.smithi133.stdout: "map_full": 0, 2024-08-31T04:38:49.729 INFO:teuthology.orchestra.run.smithi133.stdout: "map_inc": 2, 2024-08-31T04:38:49.729 INFO:teuthology.orchestra.run.smithi133.stdout: "osd_sessions": 11, 2024-08-31T04:38:49.729 INFO:teuthology.orchestra.run.smithi133.stdout: "osd_session_open": 12, 2024-08-31T04:38:49.729 INFO:teuthology.orchestra.run.smithi133.stdout: "osd_session_close": 1, 2024-08-31T04:38:49.729 INFO:teuthology.orchestra.run.smithi133.stdout: "osd_laggy": 0, 2024-08-31T04:38:49.729 INFO:teuthology.orchestra.run.smithi133.stdout: "omap_wr": 0, 2024-08-31T04:38:49.729 INFO:teuthology.orchestra.run.smithi133.stdout: "omap_rd": 2, 2024-08-31T04:38:49.729 INFO:teuthology.orchestra.run.smithi133.stdout: "omap_del": 0 2024-08-31T04:38:49.729 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-08-31T04:38:49.729 INFO:teuthology.orchestra.run.smithi133.stdout: "oft": { 2024-08-31T04:38:49.729 INFO:teuthology.orchestra.run.smithi133.stdout: "omap_total_objs": 0, 2024-08-31T04:38:49.730 INFO:teuthology.orchestra.run.smithi133.stdout: "omap_total_kv_pairs": 0, 2024-08-31T04:38:49.730 INFO:teuthology.orchestra.run.smithi133.stdout: "omap_total_updates": 0, 2024-08-31T04:38:49.730 INFO:teuthology.orchestra.run.smithi133.stdout: "omap_total_removes": 0 2024-08-31T04:38:49.730 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-08-31T04:38:49.730 INFO:teuthology.orchestra.run.smithi133.stdout: "purge_queue": { 2024-08-31T04:38:49.730 INFO:teuthology.orchestra.run.smithi133.stdout: "pq_executing_ops": 0, 2024-08-31T04:38:49.730 INFO:teuthology.orchestra.run.smithi133.stdout: "pq_executing_ops_high_water": 0, 2024-08-31T04:38:49.730 INFO:teuthology.orchestra.run.smithi133.stdout: "pq_executing": 0, 2024-08-31T04:38:49.730 INFO:teuthology.orchestra.run.smithi133.stdout: "pq_executing_high_water": 0, 2024-08-31T04:38:49.730 INFO:teuthology.orchestra.run.smithi133.stdout: "pq_executed_ops": 0, 2024-08-31T04:38:49.730 INFO:teuthology.orchestra.run.smithi133.stdout: "pq_executed": 0, 2024-08-31T04:38:49.730 INFO:teuthology.orchestra.run.smithi133.stdout: "pq_item_in_journal": 0 2024-08-31T04:38:49.730 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-08-31T04:38:49.731 INFO:teuthology.orchestra.run.smithi133.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-08-31T04:38:49.731 INFO:teuthology.orchestra.run.smithi133.stdout: "val": 0, 2024-08-31T04:38:49.731 INFO:teuthology.orchestra.run.smithi133.stdout: "max": 104857600, 2024-08-31T04:38:49.731 INFO:teuthology.orchestra.run.smithi133.stdout: "get_started": 0, 2024-08-31T04:38:49.731 INFO:teuthology.orchestra.run.smithi133.stdout: "get": 3910, 2024-08-31T04:38:49.731 INFO:teuthology.orchestra.run.smithi133.stdout: "get_sum": 181436988, 2024-08-31T04:38:49.731 INFO:teuthology.orchestra.run.smithi133.stdout: "get_or_fail_fail": 0, 2024-08-31T04:38:49.731 INFO:teuthology.orchestra.run.smithi133.stdout: "get_or_fail_success": 3910, 2024-08-31T04:38:49.731 INFO:teuthology.orchestra.run.smithi133.stdout: "take": 0, 2024-08-31T04:38:49.731 INFO:teuthology.orchestra.run.smithi133.stdout: "take_sum": 0, 2024-08-31T04:38:49.731 INFO:teuthology.orchestra.run.smithi133.stdout: "put": 3910, 2024-08-31T04:38:49.731 INFO:teuthology.orchestra.run.smithi133.stdout: "put_sum": 181436988, 2024-08-31T04:38:49.731 INFO:teuthology.orchestra.run.smithi133.stdout: "wait": { 2024-08-31T04:38:49.731 INFO:teuthology.orchestra.run.smithi133.stdout: "avgcount": 0, 2024-08-31T04:38:49.732 INFO:teuthology.orchestra.run.smithi133.stdout: "sum": 0.000000000, 2024-08-31T04:38:49.732 INFO:teuthology.orchestra.run.smithi133.stdout: "avgtime": 0.000000000 2024-08-31T04:38:49.732 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-08-31T04:38:49.732 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-08-31T04:38:49.732 INFO:teuthology.orchestra.run.smithi133.stdout: "throttle-objecter_bytes": { 2024-08-31T04:38:49.732 INFO:teuthology.orchestra.run.smithi133.stdout: "val": 0, 2024-08-31T04:38:49.732 INFO:teuthology.orchestra.run.smithi133.stdout: "max": 104857600, 2024-08-31T04:38:49.732 INFO:teuthology.orchestra.run.smithi133.stdout: "get_started": 0, 2024-08-31T04:38:49.732 INFO:teuthology.orchestra.run.smithi133.stdout: "get": 0, 2024-08-31T04:38:49.732 INFO:teuthology.orchestra.run.smithi133.stdout: "get_sum": 0, 2024-08-31T04:38:49.732 INFO:teuthology.orchestra.run.smithi133.stdout: "get_or_fail_fail": 0, 2024-08-31T04:38:49.732 INFO:teuthology.orchestra.run.smithi133.stdout: "get_or_fail_success": 0, 2024-08-31T04:38:49.732 INFO:teuthology.orchestra.run.smithi133.stdout: "take": 3559, 2024-08-31T04:38:49.733 INFO:teuthology.orchestra.run.smithi133.stdout: "take_sum": 179967557, 2024-08-31T04:38:49.733 INFO:teuthology.orchestra.run.smithi133.stdout: "put": 3559, 2024-08-31T04:38:49.733 INFO:teuthology.orchestra.run.smithi133.stdout: "put_sum": 179967557, 2024-08-31T04:38:49.733 INFO:teuthology.orchestra.run.smithi133.stdout: "wait": { 2024-08-31T04:38:49.733 INFO:teuthology.orchestra.run.smithi133.stdout: "avgcount": 0, 2024-08-31T04:38:49.733 INFO:teuthology.orchestra.run.smithi133.stdout: "sum": 0.000000000, 2024-08-31T04:38:49.733 INFO:teuthology.orchestra.run.smithi133.stdout: "avgtime": 0.000000000 2024-08-31T04:38:49.733 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-08-31T04:38:49.733 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-08-31T04:38:49.733 INFO:teuthology.orchestra.run.smithi133.stdout: "throttle-objecter_ops": { 2024-08-31T04:38:49.733 INFO:teuthology.orchestra.run.smithi133.stdout: "val": 0, 2024-08-31T04:38:49.733 INFO:teuthology.orchestra.run.smithi133.stdout: "max": 1024, 2024-08-31T04:38:49.734 INFO:teuthology.orchestra.run.smithi133.stdout: "get_started": 0, 2024-08-31T04:38:49.734 INFO:teuthology.orchestra.run.smithi133.stdout: "get": 0, 2024-08-31T04:38:49.734 INFO:teuthology.orchestra.run.smithi133.stdout: "get_sum": 0, 2024-08-31T04:38:49.734 INFO:teuthology.orchestra.run.smithi133.stdout: "get_or_fail_fail": 0, 2024-08-31T04:38:49.734 INFO:teuthology.orchestra.run.smithi133.stdout: "get_or_fail_success": 0, 2024-08-31T04:38:49.734 INFO:teuthology.orchestra.run.smithi133.stdout: "take": 3559, 2024-08-31T04:38:49.734 INFO:teuthology.orchestra.run.smithi133.stdout: "take_sum": 3559, 2024-08-31T04:38:49.734 INFO:teuthology.orchestra.run.smithi133.stdout: "put": 3559, 2024-08-31T04:38:49.734 INFO:teuthology.orchestra.run.smithi133.stdout: "put_sum": 3559, 2024-08-31T04:38:49.734 INFO:teuthology.orchestra.run.smithi133.stdout: "wait": { 2024-08-31T04:38:49.734 INFO:teuthology.orchestra.run.smithi133.stdout: "avgcount": 0, 2024-08-31T04:38:49.734 INFO:teuthology.orchestra.run.smithi133.stdout: "sum": 0.000000000, 2024-08-31T04:38:49.734 INFO:teuthology.orchestra.run.smithi133.stdout: "avgtime": 0.000000000 2024-08-31T04:38:49.735 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-08-31T04:38:49.735 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-08-31T04:38:49.735 INFO:teuthology.orchestra.run.smithi133.stdout: "throttle-write_buf_throttle": { 2024-08-31T04:38:49.735 INFO:teuthology.orchestra.run.smithi133.stdout: "val": 0, 2024-08-31T04:38:49.735 INFO:teuthology.orchestra.run.smithi133.stdout: "max": 3758096384, 2024-08-31T04:38:49.735 INFO:teuthology.orchestra.run.smithi133.stdout: "get_started": 0, 2024-08-31T04:38:49.735 INFO:teuthology.orchestra.run.smithi133.stdout: "get": 0, 2024-08-31T04:38:49.735 INFO:teuthology.orchestra.run.smithi133.stdout: "get_sum": 0, 2024-08-31T04:38:49.735 INFO:teuthology.orchestra.run.smithi133.stdout: "get_or_fail_fail": 0, 2024-08-31T04:38:49.735 INFO:teuthology.orchestra.run.smithi133.stdout: "get_or_fail_success": 0, 2024-08-31T04:38:49.735 INFO:teuthology.orchestra.run.smithi133.stdout: "take": 0, 2024-08-31T04:38:49.735 INFO:teuthology.orchestra.run.smithi133.stdout: "take_sum": 0, 2024-08-31T04:38:49.735 INFO:teuthology.orchestra.run.smithi133.stdout: "put": 0, 2024-08-31T04:38:49.736 INFO:teuthology.orchestra.run.smithi133.stdout: "put_sum": 0, 2024-08-31T04:38:49.736 INFO:teuthology.orchestra.run.smithi133.stdout: "wait": { 2024-08-31T04:38:49.736 INFO:teuthology.orchestra.run.smithi133.stdout: "avgcount": 0, 2024-08-31T04:38:49.736 INFO:teuthology.orchestra.run.smithi133.stdout: "sum": 0.000000000, 2024-08-31T04:38:49.736 INFO:teuthology.orchestra.run.smithi133.stdout: "avgtime": 0.000000000 2024-08-31T04:38:49.736 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-08-31T04:38:49.736 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-08-31T04:38:49.736 INFO:teuthology.orchestra.run.smithi133.stdout: "throttle-write_buf_throttle-0x55f5d7d328f0": { 2024-08-31T04:38:49.736 INFO:teuthology.orchestra.run.smithi133.stdout: "val": 0, 2024-08-31T04:38:49.736 INFO:teuthology.orchestra.run.smithi133.stdout: "max": 3758096384, 2024-08-31T04:38:49.736 INFO:teuthology.orchestra.run.smithi133.stdout: "get_started": 0, 2024-08-31T04:38:49.736 INFO:teuthology.orchestra.run.smithi133.stdout: "get": 0, 2024-08-31T04:38:49.736 INFO:teuthology.orchestra.run.smithi133.stdout: "get_sum": 0, 2024-08-31T04:38:49.737 INFO:teuthology.orchestra.run.smithi133.stdout: "get_or_fail_fail": 0, 2024-08-31T04:38:49.737 INFO:teuthology.orchestra.run.smithi133.stdout: "get_or_fail_success": 0, 2024-08-31T04:38:49.737 INFO:teuthology.orchestra.run.smithi133.stdout: "take": 0, 2024-08-31T04:38:49.737 INFO:teuthology.orchestra.run.smithi133.stdout: "take_sum": 0, 2024-08-31T04:38:49.737 INFO:teuthology.orchestra.run.smithi133.stdout: "put": 0, 2024-08-31T04:38:49.737 INFO:teuthology.orchestra.run.smithi133.stdout: "put_sum": 0, 2024-08-31T04:38:49.737 INFO:teuthology.orchestra.run.smithi133.stdout: "wait": { 2024-08-31T04:38:49.737 INFO:teuthology.orchestra.run.smithi133.stdout: "avgcount": 0, 2024-08-31T04:38:49.737 INFO:teuthology.orchestra.run.smithi133.stdout: "sum": 0.000000000, 2024-08-31T04:38:49.737 INFO:teuthology.orchestra.run.smithi133.stdout: "avgtime": 0.000000000 2024-08-31T04:38:49.737 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-08-31T04:38:49.737 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-08-31T04:38:49.737 INFO:teuthology.orchestra.run.smithi133.stdout: "trackedop": { 2024-08-31T04:38:49.738 INFO:teuthology.orchestra.run.smithi133.stdout: "slow_ops_count": 0 2024-08-31T04:38:49.738 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-08-31T04:38:49.738 INFO:teuthology.orchestra.run.smithi133.stdout:} 2024-08-31T04:38:49.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:38:49 smithi133 ceph-mon[22177]: pgmap v846: 97 pgs: 97 active+clean; 592 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 9.0 KiB/s rd, 4.4 KiB/s wr, 14 op/s 2024-08-31T04:38:49.950 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:38:49 smithi050 ceph-mon[17259]: pgmap v846: 97 pgs: 97 active+clean; 592 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 9.0 KiB/s rd, 4.4 KiB/s wr, 14 op/s 2024-08-31T04:38:49.996 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:38:49 smithi177 ceph-mon[22025]: pgmap v846: 97 pgs: 97 active+clean; 592 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 9.0 KiB/s rd, 4.4 KiB/s wr, 14 op/s 2024-08-31T04:38:50.518 INFO:tasks.check_counter:Daemon mds.e mds.exported=0 2024-08-31T04:38:50.519 INFO:tasks.check_counter:Daemon mds.e mds.imported=0 2024-08-31T04:38:50.519 INFO:tasks.check_counter:Daemon mds.e mds_cache.dir_update=0 2024-08-31T04:38:50.519 INFO:tasks.check_counter:Daemon mds.e mds_cache.dir_update_receipt=0 2024-08-31T04:38:50.519 INFO:tasks.check_counter:Daemon mds.e mds.dir_split=0 2024-08-31T04:38:50.519 DEBUG:tasks.check_counter:Getting stats from h 2024-08-31T04:38:50.519 DEBUG:teuthology.orchestra.run.smithi133:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 058d9fc6-674f-11ef-bcd4-c7b262605968 -- ceph daemon mds.h perf dump 2024-08-31T04:38:50.768 INFO:teuthology.orchestra.run.smithi133.stderr:Inferring config /var/lib/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/mon.b/config 2024-08-31T04:38:51.319 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2024-08-31T04:38:51.319 INFO:teuthology.orchestra.run.smithi133.stdout: "AsyncMessenger::Worker-0": { 2024-08-31T04:38:51.319 INFO:teuthology.orchestra.run.smithi133.stdout: "msgr_recv_messages": 52509, 2024-08-31T04:38:51.319 INFO:teuthology.orchestra.run.smithi133.stdout: "msgr_send_messages": 56461, 2024-08-31T04:38:51.320 INFO:teuthology.orchestra.run.smithi133.stdout: "msgr_recv_bytes": 21744319, 2024-08-31T04:38:51.320 INFO:teuthology.orchestra.run.smithi133.stdout: "msgr_send_bytes": 67684959, 2024-08-31T04:38:51.320 INFO:teuthology.orchestra.run.smithi133.stdout: "msgr_created_connections": 10, 2024-08-31T04:38:51.320 INFO:teuthology.orchestra.run.smithi133.stdout: "msgr_active_connections": 5, 2024-08-31T04:38:51.320 INFO:teuthology.orchestra.run.smithi133.stdout: "msgr_running_total_time": 4.010919746, 2024-08-31T04:38:51.320 INFO:teuthology.orchestra.run.smithi133.stdout: "msgr_running_send_time": 2.081434405, 2024-08-31T04:38:51.320 INFO:teuthology.orchestra.run.smithi133.stdout: "msgr_running_recv_time": 1.970362381, 2024-08-31T04:38:51.320 INFO:teuthology.orchestra.run.smithi133.stdout: "msgr_running_fast_dispatch_time": 0.285206129, 2024-08-31T04:38:51.320 INFO:teuthology.orchestra.run.smithi133.stdout: "msgr_send_messages_queue_lat": { 2024-08-31T04:38:51.320 INFO:teuthology.orchestra.run.smithi133.stdout: "avgcount": 56459, 2024-08-31T04:38:51.320 INFO:teuthology.orchestra.run.smithi133.stdout: "sum": 2.739718259, 2024-08-31T04:38:51.320 INFO:teuthology.orchestra.run.smithi133.stdout: "avgtime": 0.000048525 2024-08-31T04:38:51.321 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-08-31T04:38:51.321 INFO:teuthology.orchestra.run.smithi133.stdout: "msgr_handle_ack_lat": { 2024-08-31T04:38:51.321 INFO:teuthology.orchestra.run.smithi133.stdout: "avgcount": 93737, 2024-08-31T04:38:51.321 INFO:teuthology.orchestra.run.smithi133.stdout: "sum": 0.015935341, 2024-08-31T04:38:51.321 INFO:teuthology.orchestra.run.smithi133.stdout: "avgtime": 0.000000170 2024-08-31T04:38:51.321 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-08-31T04:38:51.321 INFO:teuthology.orchestra.run.smithi133.stdout: "msgr_recv_encrypted_bytes": 0, 2024-08-31T04:38:51.321 INFO:teuthology.orchestra.run.smithi133.stdout: "msgr_send_encrypted_bytes": 0 2024-08-31T04:38:51.321 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-08-31T04:38:51.321 INFO:teuthology.orchestra.run.smithi133.stdout: "AsyncMessenger::Worker-1": { 2024-08-31T04:38:51.321 INFO:teuthology.orchestra.run.smithi133.stdout: "msgr_recv_messages": 180328, 2024-08-31T04:38:51.321 INFO:teuthology.orchestra.run.smithi133.stdout: "msgr_send_messages": 254030, 2024-08-31T04:38:51.321 INFO:teuthology.orchestra.run.smithi133.stdout: "msgr_recv_bytes": 62555299, 2024-08-31T04:38:51.322 INFO:teuthology.orchestra.run.smithi133.stdout: "msgr_send_bytes": 182339214, 2024-08-31T04:38:51.322 INFO:teuthology.orchestra.run.smithi133.stdout: "msgr_created_connections": 16, 2024-08-31T04:38:51.322 INFO:teuthology.orchestra.run.smithi133.stdout: "msgr_active_connections": 7, 2024-08-31T04:38:51.322 INFO:teuthology.orchestra.run.smithi133.stdout: "msgr_running_total_time": 10.890688111, 2024-08-31T04:38:51.322 INFO:teuthology.orchestra.run.smithi133.stdout: "msgr_running_send_time": 6.655567530, 2024-08-31T04:38:51.322 INFO:teuthology.orchestra.run.smithi133.stdout: "msgr_running_recv_time": 5.831732655, 2024-08-31T04:38:51.322 INFO:teuthology.orchestra.run.smithi133.stdout: "msgr_running_fast_dispatch_time": 0.329459898, 2024-08-31T04:38:51.322 INFO:teuthology.orchestra.run.smithi133.stdout: "msgr_send_messages_queue_lat": { 2024-08-31T04:38:51.322 INFO:teuthology.orchestra.run.smithi133.stdout: "avgcount": 254029, 2024-08-31T04:38:51.322 INFO:teuthology.orchestra.run.smithi133.stdout: "sum": 26.865803085, 2024-08-31T04:38:51.322 INFO:teuthology.orchestra.run.smithi133.stdout: "avgtime": 0.000105758 2024-08-31T04:38:51.322 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-08-31T04:38:51.322 INFO:teuthology.orchestra.run.smithi133.stdout: "msgr_handle_ack_lat": { 2024-08-31T04:38:51.323 INFO:teuthology.orchestra.run.smithi133.stdout: "avgcount": 173883, 2024-08-31T04:38:51.323 INFO:teuthology.orchestra.run.smithi133.stdout: "sum": 0.045689230, 2024-08-31T04:38:51.323 INFO:teuthology.orchestra.run.smithi133.stdout: "avgtime": 0.000000262 2024-08-31T04:38:51.323 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-08-31T04:38:51.323 INFO:teuthology.orchestra.run.smithi133.stdout: "msgr_recv_encrypted_bytes": 4080, 2024-08-31T04:38:51.323 INFO:teuthology.orchestra.run.smithi133.stdout: "msgr_send_encrypted_bytes": 484864 2024-08-31T04:38:51.323 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-08-31T04:38:51.323 INFO:teuthology.orchestra.run.smithi133.stdout: "AsyncMessenger::Worker-2": { 2024-08-31T04:38:51.323 INFO:teuthology.orchestra.run.smithi133.stdout: "msgr_recv_messages": 18467, 2024-08-31T04:38:51.323 INFO:teuthology.orchestra.run.smithi133.stdout: "msgr_send_messages": 20303, 2024-08-31T04:38:51.323 INFO:teuthology.orchestra.run.smithi133.stdout: "msgr_recv_bytes": 8100446, 2024-08-31T04:38:51.323 INFO:teuthology.orchestra.run.smithi133.stdout: "msgr_send_bytes": 36601581, 2024-08-31T04:38:51.323 INFO:teuthology.orchestra.run.smithi133.stdout: "msgr_created_connections": 13, 2024-08-31T04:38:51.324 INFO:teuthology.orchestra.run.smithi133.stdout: "msgr_active_connections": 6, 2024-08-31T04:38:51.324 INFO:teuthology.orchestra.run.smithi133.stdout: "msgr_running_total_time": 1.643735868, 2024-08-31T04:38:51.324 INFO:teuthology.orchestra.run.smithi133.stdout: "msgr_running_send_time": 0.780328451, 2024-08-31T04:38:51.324 INFO:teuthology.orchestra.run.smithi133.stdout: "msgr_running_recv_time": 0.638477477, 2024-08-31T04:38:51.324 INFO:teuthology.orchestra.run.smithi133.stdout: "msgr_running_fast_dispatch_time": 0.277581755, 2024-08-31T04:38:51.324 INFO:teuthology.orchestra.run.smithi133.stdout: "msgr_send_messages_queue_lat": { 2024-08-31T04:38:51.324 INFO:teuthology.orchestra.run.smithi133.stdout: "avgcount": 20302, 2024-08-31T04:38:51.324 INFO:teuthology.orchestra.run.smithi133.stdout: "sum": 0.796731008, 2024-08-31T04:38:51.324 INFO:teuthology.orchestra.run.smithi133.stdout: "avgtime": 0.000039243 2024-08-31T04:38:51.324 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-08-31T04:38:51.324 INFO:teuthology.orchestra.run.smithi133.stdout: "msgr_handle_ack_lat": { 2024-08-31T04:38:51.324 INFO:teuthology.orchestra.run.smithi133.stdout: "avgcount": 22768, 2024-08-31T04:38:51.325 INFO:teuthology.orchestra.run.smithi133.stdout: "sum": 0.004389958, 2024-08-31T04:38:51.325 INFO:teuthology.orchestra.run.smithi133.stdout: "avgtime": 0.000000192 2024-08-31T04:38:51.325 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-08-31T04:38:51.325 INFO:teuthology.orchestra.run.smithi133.stdout: "msgr_recv_encrypted_bytes": 873504, 2024-08-31T04:38:51.325 INFO:teuthology.orchestra.run.smithi133.stdout: "msgr_send_encrypted_bytes": 198560 2024-08-31T04:38:51.325 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-08-31T04:38:51.325 INFO:teuthology.orchestra.run.smithi133.stdout: "cct": { 2024-08-31T04:38:51.325 INFO:teuthology.orchestra.run.smithi133.stdout: "total_workers": 1, 2024-08-31T04:38:51.325 INFO:teuthology.orchestra.run.smithi133.stdout: "unhealthy_workers": 0 2024-08-31T04:38:51.325 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-08-31T04:38:51.325 INFO:teuthology.orchestra.run.smithi133.stdout: "finisher-MDSRank": { 2024-08-31T04:38:51.325 INFO:teuthology.orchestra.run.smithi133.stdout: "queue_len": 0, 2024-08-31T04:38:51.325 INFO:teuthology.orchestra.run.smithi133.stdout: "complete_latency": { 2024-08-31T04:38:51.326 INFO:teuthology.orchestra.run.smithi133.stdout: "avgcount": 7447, 2024-08-31T04:38:51.326 INFO:teuthology.orchestra.run.smithi133.stdout: "sum": 35.085311505, 2024-08-31T04:38:51.326 INFO:teuthology.orchestra.run.smithi133.stdout: "avgtime": 0.004711334 2024-08-31T04:38:51.326 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-08-31T04:38:51.326 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-08-31T04:38:51.326 INFO:teuthology.orchestra.run.smithi133.stdout: "finisher-PurgeQueue": { 2024-08-31T04:38:51.326 INFO:teuthology.orchestra.run.smithi133.stdout: "queue_len": 0, 2024-08-31T04:38:51.326 INFO:teuthology.orchestra.run.smithi133.stdout: "complete_latency": { 2024-08-31T04:38:51.326 INFO:teuthology.orchestra.run.smithi133.stdout: "avgcount": 26675, 2024-08-31T04:38:51.326 INFO:teuthology.orchestra.run.smithi133.stdout: "sum": 3.783998952, 2024-08-31T04:38:51.326 INFO:teuthology.orchestra.run.smithi133.stdout: "avgtime": 0.000141855 2024-08-31T04:38:51.326 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-08-31T04:38:51.326 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-08-31T04:38:51.326 INFO:teuthology.orchestra.run.smithi133.stdout: "mds": { 2024-08-31T04:38:51.327 INFO:teuthology.orchestra.run.smithi133.stdout: "request": 78195, 2024-08-31T04:38:51.327 INFO:teuthology.orchestra.run.smithi133.stdout: "reply": 70043, 2024-08-31T04:38:51.327 INFO:teuthology.orchestra.run.smithi133.stdout: "reply_latency": { 2024-08-31T04:38:51.327 INFO:teuthology.orchestra.run.smithi133.stdout: "avgcount": 70043, 2024-08-31T04:38:51.327 INFO:teuthology.orchestra.run.smithi133.stdout: "sum": 1013.878000955, 2024-08-31T04:38:51.327 INFO:teuthology.orchestra.run.smithi133.stdout: "avgtime": 0.014475079 2024-08-31T04:38:51.327 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-08-31T04:38:51.327 INFO:teuthology.orchestra.run.smithi133.stdout: "slow_reply": 0, 2024-08-31T04:38:51.327 INFO:teuthology.orchestra.run.smithi133.stdout: "forward": 8152, 2024-08-31T04:38:51.327 INFO:teuthology.orchestra.run.smithi133.stdout: "dir_fetch_complete": 59, 2024-08-31T04:38:51.327 INFO:teuthology.orchestra.run.smithi133.stdout: "dir_fetch_keys": 0, 2024-08-31T04:38:51.327 INFO:teuthology.orchestra.run.smithi133.stdout: "dir_commit": 411, 2024-08-31T04:38:51.327 INFO:teuthology.orchestra.run.smithi133.stdout: "dir_split": 45, 2024-08-31T04:38:51.327 INFO:teuthology.orchestra.run.smithi133.stdout: "dir_merge": 1, 2024-08-31T04:38:51.328 INFO:teuthology.orchestra.run.smithi133.stdout: "inodes": 32, 2024-08-31T04:38:51.328 INFO:teuthology.orchestra.run.smithi133.stdout: "inodes_top": 11, 2024-08-31T04:38:51.328 INFO:teuthology.orchestra.run.smithi133.stdout: "inodes_bottom": 11, 2024-08-31T04:38:51.328 INFO:teuthology.orchestra.run.smithi133.stdout: "inodes_pin_tail": 10, 2024-08-31T04:38:51.328 INFO:teuthology.orchestra.run.smithi133.stdout: "inodes_pinned": 13, 2024-08-31T04:38:51.328 INFO:teuthology.orchestra.run.smithi133.stdout: "inodes_expired": 6501, 2024-08-31T04:38:51.328 INFO:teuthology.orchestra.run.smithi133.stdout: "inodes_with_caps": 0, 2024-08-31T04:38:51.328 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": 0, 2024-08-31T04:38:51.328 INFO:teuthology.orchestra.run.smithi133.stdout: "subtrees": 4, 2024-08-31T04:38:51.328 INFO:teuthology.orchestra.run.smithi133.stdout: "traverse": 135393, 2024-08-31T04:38:51.328 INFO:teuthology.orchestra.run.smithi133.stdout: "traverse_hit": 110504, 2024-08-31T04:38:51.328 INFO:teuthology.orchestra.run.smithi133.stdout: "traverse_forward": 8117, 2024-08-31T04:38:51.328 INFO:teuthology.orchestra.run.smithi133.stdout: "traverse_discover": 1043, 2024-08-31T04:38:51.328 INFO:teuthology.orchestra.run.smithi133.stdout: "traverse_dir_fetch": 8, 2024-08-31T04:38:51.329 INFO:teuthology.orchestra.run.smithi133.stdout: "traverse_remote_ino": 0, 2024-08-31T04:38:51.329 INFO:teuthology.orchestra.run.smithi133.stdout: "traverse_lock": 358, 2024-08-31T04:38:51.329 INFO:teuthology.orchestra.run.smithi133.stdout: "load_cent": 53, 2024-08-31T04:38:51.329 INFO:teuthology.orchestra.run.smithi133.stdout: "q": 0, 2024-08-31T04:38:51.329 INFO:teuthology.orchestra.run.smithi133.stdout: "exported": 248, 2024-08-31T04:38:51.329 INFO:teuthology.orchestra.run.smithi133.stdout: "exported_inodes": 3355, 2024-08-31T04:38:51.329 INFO:teuthology.orchestra.run.smithi133.stdout: "imported": 186, 2024-08-31T04:38:51.329 INFO:teuthology.orchestra.run.smithi133.stdout: "imported_inodes": 12667, 2024-08-31T04:38:51.329 INFO:teuthology.orchestra.run.smithi133.stdout: "openino_dir_fetch": 0, 2024-08-31T04:38:51.329 INFO:teuthology.orchestra.run.smithi133.stdout: "openino_backtrace_fetch": 0, 2024-08-31T04:38:51.329 INFO:teuthology.orchestra.run.smithi133.stdout: "openino_peer_discover": 0, 2024-08-31T04:38:51.329 INFO:teuthology.orchestra.run.smithi133.stdout: "root_rfiles": 21361, 2024-08-31T04:38:51.329 INFO:teuthology.orchestra.run.smithi133.stdout: "root_rbytes": 475116081, 2024-08-31T04:38:51.329 INFO:teuthology.orchestra.run.smithi133.stdout: "root_rsnaps": 0, 2024-08-31T04:38:51.330 INFO:teuthology.orchestra.run.smithi133.stdout: "scrub_backtrace_fetch": 0, 2024-08-31T04:38:51.330 INFO:teuthology.orchestra.run.smithi133.stdout: "scrub_set_tag": 0, 2024-08-31T04:38:51.330 INFO:teuthology.orchestra.run.smithi133.stdout: "scrub_backtrace_repaired": 0, 2024-08-31T04:38:51.330 INFO:teuthology.orchestra.run.smithi133.stdout: "scrub_inotable_repaired": 0, 2024-08-31T04:38:51.330 INFO:teuthology.orchestra.run.smithi133.stdout: "scrub_dir_inodes": 0, 2024-08-31T04:38:51.330 INFO:teuthology.orchestra.run.smithi133.stdout: "scrub_dir_base_inodes": 0, 2024-08-31T04:38:51.330 INFO:teuthology.orchestra.run.smithi133.stdout: "scrub_dirfrag_rstats": 0, 2024-08-31T04:38:51.330 INFO:teuthology.orchestra.run.smithi133.stdout: "scrub_file_inodes": 0, 2024-08-31T04:38:51.330 INFO:teuthology.orchestra.run.smithi133.stdout: "handle_inode_file_caps": 591, 2024-08-31T04:38:51.330 INFO:teuthology.orchestra.run.smithi133.stdout: "ceph_cap_op_revoke": 42597, 2024-08-31T04:38:51.330 INFO:teuthology.orchestra.run.smithi133.stdout: "ceph_cap_op_grant": 39732, 2024-08-31T04:38:51.330 INFO:teuthology.orchestra.run.smithi133.stdout: "ceph_cap_op_trunc": 1, 2024-08-31T04:38:51.330 INFO:teuthology.orchestra.run.smithi133.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-08-31T04:38:51.331 INFO:teuthology.orchestra.run.smithi133.stdout: "ceph_cap_op_flush_ack": 0, 2024-08-31T04:38:51.331 INFO:teuthology.orchestra.run.smithi133.stdout: "handle_client_caps": 53161, 2024-08-31T04:38:51.331 INFO:teuthology.orchestra.run.smithi133.stdout: "handle_client_caps_dirty": 10813, 2024-08-31T04:38:51.331 INFO:teuthology.orchestra.run.smithi133.stdout: "handle_client_cap_release": 671, 2024-08-31T04:38:51.331 INFO:teuthology.orchestra.run.smithi133.stdout: "process_request_cap_release": 32712 2024-08-31T04:38:51.331 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-08-31T04:38:51.331 INFO:teuthology.orchestra.run.smithi133.stdout: "mds_cache": { 2024-08-31T04:38:51.331 INFO:teuthology.orchestra.run.smithi133.stdout: "dir_update": 3583, 2024-08-31T04:38:51.331 INFO:teuthology.orchestra.run.smithi133.stdout: "dir_update_receipt": 9070, 2024-08-31T04:38:51.331 INFO:teuthology.orchestra.run.smithi133.stdout: "dir_try_discover": 5607, 2024-08-31T04:38:51.331 INFO:teuthology.orchestra.run.smithi133.stdout: "dir_send_discover": 7230, 2024-08-31T04:38:51.331 INFO:teuthology.orchestra.run.smithi133.stdout: "dir_handle_discover": 5388, 2024-08-31T04:38:51.331 INFO:teuthology.orchestra.run.smithi133.stdout: "num_strays": 0, 2024-08-31T04:38:51.331 INFO:teuthology.orchestra.run.smithi133.stdout: "num_strays_delayed": 0, 2024-08-31T04:38:51.332 INFO:teuthology.orchestra.run.smithi133.stdout: "num_strays_enqueuing": 0, 2024-08-31T04:38:51.332 INFO:teuthology.orchestra.run.smithi133.stdout: "strays_created": 13650, 2024-08-31T04:38:51.332 INFO:teuthology.orchestra.run.smithi133.stdout: "strays_enqueued": 13650, 2024-08-31T04:38:51.332 INFO:teuthology.orchestra.run.smithi133.stdout: "strays_reintegrated": 0, 2024-08-31T04:38:51.332 INFO:teuthology.orchestra.run.smithi133.stdout: "strays_migrated": 0, 2024-08-31T04:38:51.332 INFO:teuthology.orchestra.run.smithi133.stdout: "num_recovering_processing": 0, 2024-08-31T04:38:51.332 INFO:teuthology.orchestra.run.smithi133.stdout: "num_recovering_enqueued": 0, 2024-08-31T04:38:51.332 INFO:teuthology.orchestra.run.smithi133.stdout: "num_recovering_prioritized": 0, 2024-08-31T04:38:51.332 INFO:teuthology.orchestra.run.smithi133.stdout: "recovery_started": 0, 2024-08-31T04:38:51.332 INFO:teuthology.orchestra.run.smithi133.stdout: "recovery_completed": 0, 2024-08-31T04:38:51.332 INFO:teuthology.orchestra.run.smithi133.stdout: "ireq_quiesce_path": 5, 2024-08-31T04:38:51.332 INFO:teuthology.orchestra.run.smithi133.stdout: "ireq_quiesce_inode": 23069, 2024-08-31T04:38:51.332 INFO:teuthology.orchestra.run.smithi133.stdout: "ireq_enqueue_scrub": 0, 2024-08-31T04:38:51.332 INFO:teuthology.orchestra.run.smithi133.stdout: "ireq_exportdir": 248, 2024-08-31T04:38:51.333 INFO:teuthology.orchestra.run.smithi133.stdout: "ireq_flush": 0, 2024-08-31T04:38:51.333 INFO:teuthology.orchestra.run.smithi133.stdout: "ireq_fragmentdir": 47, 2024-08-31T04:38:51.333 INFO:teuthology.orchestra.run.smithi133.stdout: "ireq_fragstats": 0, 2024-08-31T04:38:51.333 INFO:teuthology.orchestra.run.smithi133.stdout: "ireq_inodestats": 0, 2024-08-31T04:38:51.333 INFO:teuthology.orchestra.run.smithi133.stdout: "uninline_started": 0, 2024-08-31T04:38:51.333 INFO:teuthology.orchestra.run.smithi133.stdout: "uninline_succeeded": 0, 2024-08-31T04:38:51.333 INFO:teuthology.orchestra.run.smithi133.stdout: "uninline_write_failed": 0 2024-08-31T04:38:51.333 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-08-31T04:38:51.333 INFO:teuthology.orchestra.run.smithi133.stdout: "mds_log": { 2024-08-31T04:38:51.333 INFO:teuthology.orchestra.run.smithi133.stdout: "evlrg": 1, 2024-08-31T04:38:51.333 INFO:teuthology.orchestra.run.smithi133.stdout: "evadd": 69697, 2024-08-31T04:38:51.333 INFO:teuthology.orchestra.run.smithi133.stdout: "evex": 0, 2024-08-31T04:38:51.333 INFO:teuthology.orchestra.run.smithi133.stdout: "evtrm": 0, 2024-08-31T04:38:51.334 INFO:teuthology.orchestra.run.smithi133.stdout: "ev": 69697, 2024-08-31T04:38:51.334 INFO:teuthology.orchestra.run.smithi133.stdout: "evexg": 0, 2024-08-31T04:38:51.334 INFO:teuthology.orchestra.run.smithi133.stdout: "evexd": 0, 2024-08-31T04:38:51.334 INFO:teuthology.orchestra.run.smithi133.stdout: "segadd": 86, 2024-08-31T04:38:51.334 INFO:teuthology.orchestra.run.smithi133.stdout: "segex": 0, 2024-08-31T04:38:51.334 INFO:teuthology.orchestra.run.smithi133.stdout: "segtrm": 0, 2024-08-31T04:38:51.334 INFO:teuthology.orchestra.run.smithi133.stdout: "seg": 86, 2024-08-31T04:38:51.334 INFO:teuthology.orchestra.run.smithi133.stdout: "segmjr": 7, 2024-08-31T04:38:51.334 INFO:teuthology.orchestra.run.smithi133.stdout: "segexg": 0, 2024-08-31T04:38:51.334 INFO:teuthology.orchestra.run.smithi133.stdout: "segexd": 0, 2024-08-31T04:38:51.334 INFO:teuthology.orchestra.run.smithi133.stdout: "expos": 4194304, 2024-08-31T04:38:51.334 INFO:teuthology.orchestra.run.smithi133.stdout: "wrpos": 142050204, 2024-08-31T04:38:51.334 INFO:teuthology.orchestra.run.smithi133.stdout: "rdpos": 0, 2024-08-31T04:38:51.334 INFO:teuthology.orchestra.run.smithi133.stdout: "jlat": { 2024-08-31T04:38:51.334 INFO:teuthology.orchestra.run.smithi133.stdout: "avgcount": 4148, 2024-08-31T04:38:51.335 INFO:teuthology.orchestra.run.smithi133.stdout: "sum": 453.763437197, 2024-08-31T04:38:51.335 INFO:teuthology.orchestra.run.smithi133.stdout: "avgtime": 0.109393306 2024-08-31T04:38:51.335 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-08-31T04:38:51.335 INFO:teuthology.orchestra.run.smithi133.stdout: "replayed": 0 2024-08-31T04:38:51.335 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-08-31T04:38:51.335 INFO:teuthology.orchestra.run.smithi133.stdout: "mds_mem": { 2024-08-31T04:38:51.335 INFO:teuthology.orchestra.run.smithi133.stdout: "ino": 39, 2024-08-31T04:38:51.335 INFO:teuthology.orchestra.run.smithi133.stdout: "ino+": 16224, 2024-08-31T04:38:51.335 INFO:teuthology.orchestra.run.smithi133.stdout: "ino-": 16185, 2024-08-31T04:38:51.335 INFO:teuthology.orchestra.run.smithi133.stdout: "dir": 36, 2024-08-31T04:38:51.335 INFO:teuthology.orchestra.run.smithi133.stdout: "dir+": 4018, 2024-08-31T04:38:51.335 INFO:teuthology.orchestra.run.smithi133.stdout: "dir-": 3982, 2024-08-31T04:38:51.335 INFO:teuthology.orchestra.run.smithi133.stdout: "dn": 32, 2024-08-31T04:38:51.335 INFO:teuthology.orchestra.run.smithi133.stdout: "dn+": 41488, 2024-08-31T04:38:51.336 INFO:teuthology.orchestra.run.smithi133.stdout: "dn-": 41456, 2024-08-31T04:38:51.336 INFO:teuthology.orchestra.run.smithi133.stdout: "cap": 0, 2024-08-31T04:38:51.336 INFO:teuthology.orchestra.run.smithi133.stdout: "cap+": 28259, 2024-08-31T04:38:51.336 INFO:teuthology.orchestra.run.smithi133.stdout: "cap-": 28259, 2024-08-31T04:38:51.336 INFO:teuthology.orchestra.run.smithi133.stdout: "rss": 197312, 2024-08-31T04:38:51.336 INFO:teuthology.orchestra.run.smithi133.stdout: "heap": 504782848 2024-08-31T04:38:51.336 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-08-31T04:38:51.336 INFO:teuthology.orchestra.run.smithi133.stdout: "mds_server": { 2024-08-31T04:38:51.336 INFO:teuthology.orchestra.run.smithi133.stdout: "dispatch_client_request": 84036, 2024-08-31T04:38:51.336 INFO:teuthology.orchestra.run.smithi133.stdout: "dispatch_server_request": 4869, 2024-08-31T04:38:51.336 INFO:teuthology.orchestra.run.smithi133.stdout: "handle_client_request": 78195, 2024-08-31T04:38:51.336 INFO:teuthology.orchestra.run.smithi133.stdout: "handle_client_session": 326, 2024-08-31T04:38:51.336 INFO:teuthology.orchestra.run.smithi133.stdout: "handle_peer_request": 6978, 2024-08-31T04:38:51.336 INFO:teuthology.orchestra.run.smithi133.stdout: "req_create_latency": { 2024-08-31T04:38:51.337 INFO:teuthology.orchestra.run.smithi133.stdout: "avgcount": 7575, 2024-08-31T04:38:51.337 INFO:teuthology.orchestra.run.smithi133.stdout: "sum": 125.789453643, 2024-08-31T04:38:51.337 INFO:teuthology.orchestra.run.smithi133.stdout: "avgtime": 0.016605868 2024-08-31T04:38:51.337 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-08-31T04:38:51.337 INFO:teuthology.orchestra.run.smithi133.stdout: "req_getattr_latency": { 2024-08-31T04:38:51.337 INFO:teuthology.orchestra.run.smithi133.stdout: "avgcount": 16, 2024-08-31T04:38:51.337 INFO:teuthology.orchestra.run.smithi133.stdout: "sum": 0.167831851, 2024-08-31T04:38:51.337 INFO:teuthology.orchestra.run.smithi133.stdout: "avgtime": 0.010489490 2024-08-31T04:38:51.337 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-08-31T04:38:51.337 INFO:teuthology.orchestra.run.smithi133.stdout: "req_getfilelock_latency": { 2024-08-31T04:38:51.337 INFO:teuthology.orchestra.run.smithi133.stdout: "avgcount": 0, 2024-08-31T04:38:51.337 INFO:teuthology.orchestra.run.smithi133.stdout: "sum": 0.000000000, 2024-08-31T04:38:51.337 INFO:teuthology.orchestra.run.smithi133.stdout: "avgtime": 0.000000000 2024-08-31T04:38:51.337 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-08-31T04:38:51.338 INFO:teuthology.orchestra.run.smithi133.stdout: "req_link_latency": { 2024-08-31T04:38:51.338 INFO:teuthology.orchestra.run.smithi133.stdout: "avgcount": 0, 2024-08-31T04:38:51.338 INFO:teuthology.orchestra.run.smithi133.stdout: "sum": 0.000000000, 2024-08-31T04:38:51.338 INFO:teuthology.orchestra.run.smithi133.stdout: "avgtime": 0.000000000 2024-08-31T04:38:51.338 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-08-31T04:38:51.338 INFO:teuthology.orchestra.run.smithi133.stdout: "req_lookup_latency": { 2024-08-31T04:38:51.338 INFO:teuthology.orchestra.run.smithi133.stdout: "avgcount": 37414, 2024-08-31T04:38:51.338 INFO:teuthology.orchestra.run.smithi133.stdout: "sum": 337.402343408, 2024-08-31T04:38:51.338 INFO:teuthology.orchestra.run.smithi133.stdout: "avgtime": 0.009018077 2024-08-31T04:38:51.338 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-08-31T04:38:51.338 INFO:teuthology.orchestra.run.smithi133.stdout: "req_lookuphash_latency": { 2024-08-31T04:38:51.338 INFO:teuthology.orchestra.run.smithi133.stdout: "avgcount": 0, 2024-08-31T04:38:51.339 INFO:teuthology.orchestra.run.smithi133.stdout: "sum": 0.000000000, 2024-08-31T04:38:51.339 INFO:teuthology.orchestra.run.smithi133.stdout: "avgtime": 0.000000000 2024-08-31T04:38:51.339 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-08-31T04:38:51.339 INFO:teuthology.orchestra.run.smithi133.stdout: "req_lookupino_latency": { 2024-08-31T04:38:51.339 INFO:teuthology.orchestra.run.smithi133.stdout: "avgcount": 0, 2024-08-31T04:38:51.339 INFO:teuthology.orchestra.run.smithi133.stdout: "sum": 0.000000000, 2024-08-31T04:38:51.339 INFO:teuthology.orchestra.run.smithi133.stdout: "avgtime": 0.000000000 2024-08-31T04:38:51.339 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-08-31T04:38:51.339 INFO:teuthology.orchestra.run.smithi133.stdout: "req_lookupname_latency": { 2024-08-31T04:38:51.339 INFO:teuthology.orchestra.run.smithi133.stdout: "avgcount": 0, 2024-08-31T04:38:51.339 INFO:teuthology.orchestra.run.smithi133.stdout: "sum": 0.000000000, 2024-08-31T04:38:51.339 INFO:teuthology.orchestra.run.smithi133.stdout: "avgtime": 0.000000000 2024-08-31T04:38:51.339 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-08-31T04:38:51.339 INFO:teuthology.orchestra.run.smithi133.stdout: "req_lookupparent_latency": { 2024-08-31T04:38:51.340 INFO:teuthology.orchestra.run.smithi133.stdout: "avgcount": 0, 2024-08-31T04:38:51.340 INFO:teuthology.orchestra.run.smithi133.stdout: "sum": 0.000000000, 2024-08-31T04:38:51.340 INFO:teuthology.orchestra.run.smithi133.stdout: "avgtime": 0.000000000 2024-08-31T04:38:51.340 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-08-31T04:38:51.340 INFO:teuthology.orchestra.run.smithi133.stdout: "req_lookupsnap_latency": { 2024-08-31T04:38:51.340 INFO:teuthology.orchestra.run.smithi133.stdout: "avgcount": 0, 2024-08-31T04:38:51.341 INFO:teuthology.orchestra.run.smithi133.stdout: "sum": 0.000000000, 2024-08-31T04:38:51.341 INFO:teuthology.orchestra.run.smithi133.stdout: "avgtime": 0.000000000 2024-08-31T04:38:51.341 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-08-31T04:38:51.341 INFO:teuthology.orchestra.run.smithi133.stdout: "req_lssnap_latency": { 2024-08-31T04:38:51.341 INFO:teuthology.orchestra.run.smithi133.stdout: "avgcount": 0, 2024-08-31T04:38:51.341 INFO:teuthology.orchestra.run.smithi133.stdout: "sum": 0.000000000, 2024-08-31T04:38:51.341 INFO:teuthology.orchestra.run.smithi133.stdout: "avgtime": 0.000000000 2024-08-31T04:38:51.341 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-08-31T04:38:51.341 INFO:teuthology.orchestra.run.smithi133.stdout: "req_mkdir_latency": { 2024-08-31T04:38:51.341 INFO:teuthology.orchestra.run.smithi133.stdout: "avgcount": 36, 2024-08-31T04:38:51.341 INFO:teuthology.orchestra.run.smithi133.stdout: "sum": 0.575147407, 2024-08-31T04:38:51.341 INFO:teuthology.orchestra.run.smithi133.stdout: "avgtime": 0.015976316 2024-08-31T04:38:51.341 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-08-31T04:38:51.342 INFO:teuthology.orchestra.run.smithi133.stdout: "req_mknod_latency": { 2024-08-31T04:38:51.342 INFO:teuthology.orchestra.run.smithi133.stdout: "avgcount": 0, 2024-08-31T04:38:51.342 INFO:teuthology.orchestra.run.smithi133.stdout: "sum": 0.000000000, 2024-08-31T04:38:51.342 INFO:teuthology.orchestra.run.smithi133.stdout: "avgtime": 0.000000000 2024-08-31T04:38:51.342 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-08-31T04:38:51.342 INFO:teuthology.orchestra.run.smithi133.stdout: "req_mksnap_latency": { 2024-08-31T04:38:51.342 INFO:teuthology.orchestra.run.smithi133.stdout: "avgcount": 0, 2024-08-31T04:38:51.342 INFO:teuthology.orchestra.run.smithi133.stdout: "sum": 0.000000000, 2024-08-31T04:38:51.342 INFO:teuthology.orchestra.run.smithi133.stdout: "avgtime": 0.000000000 2024-08-31T04:38:51.342 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-08-31T04:38:51.342 INFO:teuthology.orchestra.run.smithi133.stdout: "req_open_latency": { 2024-08-31T04:38:51.342 INFO:teuthology.orchestra.run.smithi133.stdout: "avgcount": 4747, 2024-08-31T04:38:51.342 INFO:teuthology.orchestra.run.smithi133.stdout: "sum": 19.682331104, 2024-08-31T04:38:51.343 INFO:teuthology.orchestra.run.smithi133.stdout: "avgtime": 0.004146267 2024-08-31T04:38:51.343 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-08-31T04:38:51.343 INFO:teuthology.orchestra.run.smithi133.stdout: "req_readdir_latency": { 2024-08-31T04:38:51.343 INFO:teuthology.orchestra.run.smithi133.stdout: "avgcount": 559, 2024-08-31T04:38:51.343 INFO:teuthology.orchestra.run.smithi133.stdout: "sum": 0.821567501, 2024-08-31T04:38:51.343 INFO:teuthology.orchestra.run.smithi133.stdout: "avgtime": 0.001469709 2024-08-31T04:38:51.343 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-08-31T04:38:51.343 INFO:teuthology.orchestra.run.smithi133.stdout: "req_rename_latency": { 2024-08-31T04:38:51.343 INFO:teuthology.orchestra.run.smithi133.stdout: "avgcount": 7537, 2024-08-31T04:38:51.343 INFO:teuthology.orchestra.run.smithi133.stdout: "sum": 502.704080881, 2024-08-31T04:38:51.343 INFO:teuthology.orchestra.run.smithi133.stdout: "avgtime": 0.066698166 2024-08-31T04:38:51.343 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-08-31T04:38:51.343 INFO:teuthology.orchestra.run.smithi133.stdout: "req_renamesnap_latency": { 2024-08-31T04:38:51.344 INFO:teuthology.orchestra.run.smithi133.stdout: "avgcount": 0, 2024-08-31T04:38:51.344 INFO:teuthology.orchestra.run.smithi133.stdout: "sum": 0.000000000, 2024-08-31T04:38:51.344 INFO:teuthology.orchestra.run.smithi133.stdout: "avgtime": 0.000000000 2024-08-31T04:38:51.344 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-08-31T04:38:51.344 INFO:teuthology.orchestra.run.smithi133.stdout: "req_snapdiff_latency": { 2024-08-31T04:38:51.344 INFO:teuthology.orchestra.run.smithi133.stdout: "avgcount": 0, 2024-08-31T04:38:51.344 INFO:teuthology.orchestra.run.smithi133.stdout: "sum": 0.000000000, 2024-08-31T04:38:51.344 INFO:teuthology.orchestra.run.smithi133.stdout: "avgtime": 0.000000000 2024-08-31T04:38:51.344 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-08-31T04:38:51.344 INFO:teuthology.orchestra.run.smithi133.stdout: "req_rmdir_latency": { 2024-08-31T04:38:51.344 INFO:teuthology.orchestra.run.smithi133.stdout: "avgcount": 58, 2024-08-31T04:38:51.344 INFO:teuthology.orchestra.run.smithi133.stdout: "sum": 11.042778001, 2024-08-31T04:38:51.344 INFO:teuthology.orchestra.run.smithi133.stdout: "avgtime": 0.190392724 2024-08-31T04:38:51.345 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-08-31T04:38:51.345 INFO:teuthology.orchestra.run.smithi133.stdout: "req_rmsnap_latency": { 2024-08-31T04:38:51.345 INFO:teuthology.orchestra.run.smithi133.stdout: "avgcount": 0, 2024-08-31T04:38:51.345 INFO:teuthology.orchestra.run.smithi133.stdout: "sum": 0.000000000, 2024-08-31T04:38:51.345 INFO:teuthology.orchestra.run.smithi133.stdout: "avgtime": 0.000000000 2024-08-31T04:38:51.345 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-08-31T04:38:51.345 INFO:teuthology.orchestra.run.smithi133.stdout: "req_rmxattr_latency": { 2024-08-31T04:38:51.345 INFO:teuthology.orchestra.run.smithi133.stdout: "avgcount": 0, 2024-08-31T04:38:51.345 INFO:teuthology.orchestra.run.smithi133.stdout: "sum": 0.000000000, 2024-08-31T04:38:51.345 INFO:teuthology.orchestra.run.smithi133.stdout: "avgtime": 0.000000000 2024-08-31T04:38:51.345 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-08-31T04:38:51.345 INFO:teuthology.orchestra.run.smithi133.stdout: "req_setattr_latency": { 2024-08-31T04:38:51.345 INFO:teuthology.orchestra.run.smithi133.stdout: "avgcount": 1, 2024-08-31T04:38:51.346 INFO:teuthology.orchestra.run.smithi133.stdout: "sum": 0.004410500, 2024-08-31T04:38:51.346 INFO:teuthology.orchestra.run.smithi133.stdout: "avgtime": 0.004410500 2024-08-31T04:38:51.346 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-08-31T04:38:51.346 INFO:teuthology.orchestra.run.smithi133.stdout: "req_setdirlayout_latency": { 2024-08-31T04:38:51.346 INFO:teuthology.orchestra.run.smithi133.stdout: "avgcount": 0, 2024-08-31T04:38:51.346 INFO:teuthology.orchestra.run.smithi133.stdout: "sum": 0.000000000, 2024-08-31T04:38:51.346 INFO:teuthology.orchestra.run.smithi133.stdout: "avgtime": 0.000000000 2024-08-31T04:38:51.346 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-08-31T04:38:51.346 INFO:teuthology.orchestra.run.smithi133.stdout: "req_setfilelock_latency": { 2024-08-31T04:38:51.348 INFO:teuthology.orchestra.run.smithi133.stdout: "avgcount": 0, 2024-08-31T04:38:51.348 INFO:teuthology.orchestra.run.smithi133.stdout: "sum": 0.000000000, 2024-08-31T04:38:51.348 INFO:teuthology.orchestra.run.smithi133.stdout: "avgtime": 0.000000000 2024-08-31T04:38:51.348 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-08-31T04:38:51.348 INFO:teuthology.orchestra.run.smithi133.stdout: "req_setlayout_latency": { 2024-08-31T04:38:51.348 INFO:teuthology.orchestra.run.smithi133.stdout: "avgcount": 0, 2024-08-31T04:38:51.348 INFO:teuthology.orchestra.run.smithi133.stdout: "sum": 0.000000000, 2024-08-31T04:38:51.348 INFO:teuthology.orchestra.run.smithi133.stdout: "avgtime": 0.000000000 2024-08-31T04:38:51.348 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-08-31T04:38:51.348 INFO:teuthology.orchestra.run.smithi133.stdout: "req_setxattr_latency": { 2024-08-31T04:38:51.348 INFO:teuthology.orchestra.run.smithi133.stdout: "avgcount": 0, 2024-08-31T04:38:51.348 INFO:teuthology.orchestra.run.smithi133.stdout: "sum": 0.000000000, 2024-08-31T04:38:51.348 INFO:teuthology.orchestra.run.smithi133.stdout: "avgtime": 0.000000000 2024-08-31T04:38:51.349 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-08-31T04:38:51.349 INFO:teuthology.orchestra.run.smithi133.stdout: "req_symlink_latency": { 2024-08-31T04:38:51.349 INFO:teuthology.orchestra.run.smithi133.stdout: "avgcount": 0, 2024-08-31T04:38:51.349 INFO:teuthology.orchestra.run.smithi133.stdout: "sum": 0.000000000, 2024-08-31T04:38:51.349 INFO:teuthology.orchestra.run.smithi133.stdout: "avgtime": 0.000000000 2024-08-31T04:38:51.349 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-08-31T04:38:51.349 INFO:teuthology.orchestra.run.smithi133.stdout: "req_unlink_latency": { 2024-08-31T04:38:51.349 INFO:teuthology.orchestra.run.smithi133.stdout: "avgcount": 12100, 2024-08-31T04:38:51.349 INFO:teuthology.orchestra.run.smithi133.stdout: "sum": 15.688056659, 2024-08-31T04:38:51.349 INFO:teuthology.orchestra.run.smithi133.stdout: "avgtime": 0.001296533 2024-08-31T04:38:51.349 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-08-31T04:38:51.349 INFO:teuthology.orchestra.run.smithi133.stdout: "cap_revoke_eviction": 0, 2024-08-31T04:38:51.349 INFO:teuthology.orchestra.run.smithi133.stdout: "cap_acquisition_throttle": 0, 2024-08-31T04:38:51.350 INFO:teuthology.orchestra.run.smithi133.stdout: "req_getvxattr_latency": { 2024-08-31T04:38:51.350 INFO:teuthology.orchestra.run.smithi133.stdout: "avgcount": 0, 2024-08-31T04:38:51.350 INFO:teuthology.orchestra.run.smithi133.stdout: "sum": 0.000000000, 2024-08-31T04:38:51.350 INFO:teuthology.orchestra.run.smithi133.stdout: "avgtime": 0.000000000 2024-08-31T04:38:51.350 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-08-31T04:38:51.350 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-08-31T04:38:51.350 INFO:teuthology.orchestra.run.smithi133.stdout: "mds_sessions": { 2024-08-31T04:38:51.350 INFO:teuthology.orchestra.run.smithi133.stdout: "session_count": 1, 2024-08-31T04:38:51.350 INFO:teuthology.orchestra.run.smithi133.stdout: "session_add": 2, 2024-08-31T04:38:51.350 INFO:teuthology.orchestra.run.smithi133.stdout: "session_remove": 1, 2024-08-31T04:38:51.350 INFO:teuthology.orchestra.run.smithi133.stdout: "sessions_open": 1, 2024-08-31T04:38:51.350 INFO:teuthology.orchestra.run.smithi133.stdout: "sessions_stale": 0, 2024-08-31T04:38:51.350 INFO:teuthology.orchestra.run.smithi133.stdout: "total_load": 12659, 2024-08-31T04:38:51.351 INFO:teuthology.orchestra.run.smithi133.stdout: "average_load": 12659, 2024-08-31T04:38:51.351 INFO:teuthology.orchestra.run.smithi133.stdout: "avg_session_uptime": 839, 2024-08-31T04:38:51.351 INFO:teuthology.orchestra.run.smithi133.stdout: "mdthresh_evicted": 0 2024-08-31T04:38:51.351 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-08-31T04:38:51.351 INFO:teuthology.orchestra.run.smithi133.stdout: "mempool": { 2024-08-31T04:38:51.351 INFO:teuthology.orchestra.run.smithi133.stdout: "bloom_filter_bytes": 0, 2024-08-31T04:38:51.351 INFO:teuthology.orchestra.run.smithi133.stdout: "bloom_filter_items": 0, 2024-08-31T04:38:51.351 INFO:teuthology.orchestra.run.smithi133.stdout: "bluestore_alloc_bytes": 0, 2024-08-31T04:38:51.351 INFO:teuthology.orchestra.run.smithi133.stdout: "bluestore_alloc_items": 0, 2024-08-31T04:38:51.351 INFO:teuthology.orchestra.run.smithi133.stdout: "bluestore_cache_data_bytes": 0, 2024-08-31T04:38:51.351 INFO:teuthology.orchestra.run.smithi133.stdout: "bluestore_cache_data_items": 0, 2024-08-31T04:38:51.351 INFO:teuthology.orchestra.run.smithi133.stdout: "bluestore_cache_onode_bytes": 0, 2024-08-31T04:38:51.351 INFO:teuthology.orchestra.run.smithi133.stdout: "bluestore_cache_onode_items": 0, 2024-08-31T04:38:51.351 INFO:teuthology.orchestra.run.smithi133.stdout: "bluestore_cache_meta_bytes": 0, 2024-08-31T04:38:51.352 INFO:teuthology.orchestra.run.smithi133.stdout: "bluestore_cache_meta_items": 0, 2024-08-31T04:38:51.352 INFO:teuthology.orchestra.run.smithi133.stdout: "bluestore_cache_other_bytes": 0, 2024-08-31T04:38:51.352 INFO:teuthology.orchestra.run.smithi133.stdout: "bluestore_cache_other_items": 0, 2024-08-31T04:38:51.352 INFO:teuthology.orchestra.run.smithi133.stdout: "bluestore_cache_buffer_bytes": 0, 2024-08-31T04:38:51.352 INFO:teuthology.orchestra.run.smithi133.stdout: "bluestore_cache_buffer_items": 0, 2024-08-31T04:38:51.352 INFO:teuthology.orchestra.run.smithi133.stdout: "bluestore_extent_bytes": 0, 2024-08-31T04:38:51.352 INFO:teuthology.orchestra.run.smithi133.stdout: "bluestore_extent_items": 0, 2024-08-31T04:38:51.352 INFO:teuthology.orchestra.run.smithi133.stdout: "bluestore_blob_bytes": 0, 2024-08-31T04:38:51.352 INFO:teuthology.orchestra.run.smithi133.stdout: "bluestore_blob_items": 0, 2024-08-31T04:38:51.352 INFO:teuthology.orchestra.run.smithi133.stdout: "bluestore_shared_blob_bytes": 0, 2024-08-31T04:38:51.352 INFO:teuthology.orchestra.run.smithi133.stdout: "bluestore_shared_blob_items": 0, 2024-08-31T04:38:51.352 INFO:teuthology.orchestra.run.smithi133.stdout: "bluestore_inline_bl_bytes": 0, 2024-08-31T04:38:51.352 INFO:teuthology.orchestra.run.smithi133.stdout: "bluestore_inline_bl_items": 0, 2024-08-31T04:38:51.352 INFO:teuthology.orchestra.run.smithi133.stdout: "bluestore_fsck_bytes": 0, 2024-08-31T04:38:51.353 INFO:teuthology.orchestra.run.smithi133.stdout: "bluestore_fsck_items": 0, 2024-08-31T04:38:51.353 INFO:teuthology.orchestra.run.smithi133.stdout: "bluestore_txc_bytes": 0, 2024-08-31T04:38:51.353 INFO:teuthology.orchestra.run.smithi133.stdout: "bluestore_txc_items": 0, 2024-08-31T04:38:51.353 INFO:teuthology.orchestra.run.smithi133.stdout: "bluestore_writing_deferred_bytes": 0, 2024-08-31T04:38:51.353 INFO:teuthology.orchestra.run.smithi133.stdout: "bluestore_writing_deferred_items": 0, 2024-08-31T04:38:51.353 INFO:teuthology.orchestra.run.smithi133.stdout: "bluestore_writing_bytes": 0, 2024-08-31T04:38:51.353 INFO:teuthology.orchestra.run.smithi133.stdout: "bluestore_writing_items": 0, 2024-08-31T04:38:51.353 INFO:teuthology.orchestra.run.smithi133.stdout: "bluefs_bytes": 0, 2024-08-31T04:38:51.353 INFO:teuthology.orchestra.run.smithi133.stdout: "bluefs_items": 0, 2024-08-31T04:38:51.353 INFO:teuthology.orchestra.run.smithi133.stdout: "bluefs_file_reader_bytes": 0, 2024-08-31T04:38:51.353 INFO:teuthology.orchestra.run.smithi133.stdout: "bluefs_file_reader_items": 0, 2024-08-31T04:38:51.353 INFO:teuthology.orchestra.run.smithi133.stdout: "bluefs_file_writer_bytes": 0, 2024-08-31T04:38:51.353 INFO:teuthology.orchestra.run.smithi133.stdout: "bluefs_file_writer_items": 0, 2024-08-31T04:38:51.353 INFO:teuthology.orchestra.run.smithi133.stdout: "buffer_anon_bytes": 315822, 2024-08-31T04:38:51.354 INFO:teuthology.orchestra.run.smithi133.stdout: "buffer_anon_items": 109, 2024-08-31T04:38:51.354 INFO:teuthology.orchestra.run.smithi133.stdout: "buffer_meta_bytes": 0, 2024-08-31T04:38:51.354 INFO:teuthology.orchestra.run.smithi133.stdout: "buffer_meta_items": 0, 2024-08-31T04:38:51.354 INFO:teuthology.orchestra.run.smithi133.stdout: "osd_bytes": 0, 2024-08-31T04:38:51.354 INFO:teuthology.orchestra.run.smithi133.stdout: "osd_items": 0, 2024-08-31T04:38:51.354 INFO:teuthology.orchestra.run.smithi133.stdout: "osd_mapbl_bytes": 0, 2024-08-31T04:38:51.354 INFO:teuthology.orchestra.run.smithi133.stdout: "osd_mapbl_items": 0, 2024-08-31T04:38:51.354 INFO:teuthology.orchestra.run.smithi133.stdout: "osd_pglog_bytes": 0, 2024-08-31T04:38:51.354 INFO:teuthology.orchestra.run.smithi133.stdout: "osd_pglog_items": 0, 2024-08-31T04:38:51.354 INFO:teuthology.orchestra.run.smithi133.stdout: "osdmap_bytes": 7504, 2024-08-31T04:38:51.354 INFO:teuthology.orchestra.run.smithi133.stdout: "osdmap_items": 155, 2024-08-31T04:38:51.354 INFO:teuthology.orchestra.run.smithi133.stdout: "osdmap_mapping_bytes": 0, 2024-08-31T04:38:51.354 INFO:teuthology.orchestra.run.smithi133.stdout: "osdmap_mapping_items": 0, 2024-08-31T04:38:51.354 INFO:teuthology.orchestra.run.smithi133.stdout: "pgmap_bytes": 0, 2024-08-31T04:38:51.355 INFO:teuthology.orchestra.run.smithi133.stdout: "pgmap_items": 0, 2024-08-31T04:38:51.355 INFO:teuthology.orchestra.run.smithi133.stdout: "mds_co_bytes": 156789, 2024-08-31T04:38:51.355 INFO:teuthology.orchestra.run.smithi133.stdout: "mds_co_items": 656, 2024-08-31T04:38:51.355 INFO:teuthology.orchestra.run.smithi133.stdout: "unittest_1_bytes": 0, 2024-08-31T04:38:51.355 INFO:teuthology.orchestra.run.smithi133.stdout: "unittest_1_items": 0, 2024-08-31T04:38:51.355 INFO:teuthology.orchestra.run.smithi133.stdout: "unittest_2_bytes": 0, 2024-08-31T04:38:51.355 INFO:teuthology.orchestra.run.smithi133.stdout: "unittest_2_items": 0 2024-08-31T04:38:51.355 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-08-31T04:38:51.355 INFO:teuthology.orchestra.run.smithi133.stdout: "objecter": { 2024-08-31T04:38:51.355 INFO:teuthology.orchestra.run.smithi133.stdout: "op_active": 0, 2024-08-31T04:38:51.355 INFO:teuthology.orchestra.run.smithi133.stdout: "op_laggy": 0, 2024-08-31T04:38:51.355 INFO:teuthology.orchestra.run.smithi133.stdout: "op_send": 20841, 2024-08-31T04:38:51.355 INFO:teuthology.orchestra.run.smithi133.stdout: "op_send_bytes": 147297197, 2024-08-31T04:38:51.355 INFO:teuthology.orchestra.run.smithi133.stdout: "op_resend": 33, 2024-08-31T04:38:51.356 INFO:teuthology.orchestra.run.smithi133.stdout: "op_reply": 20841, 2024-08-31T04:38:51.356 INFO:teuthology.orchestra.run.smithi133.stdout: "op_latency": { 2024-08-31T04:38:51.356 INFO:teuthology.orchestra.run.smithi133.stdout: "avgcount": 20841, 2024-08-31T04:38:51.356 INFO:teuthology.orchestra.run.smithi133.stdout: "sum": 591.871644205, 2024-08-31T04:38:51.356 INFO:teuthology.orchestra.run.smithi133.stdout: "avgtime": 0.028399387 2024-08-31T04:38:51.356 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-08-31T04:38:51.356 INFO:teuthology.orchestra.run.smithi133.stdout: "op_inflight": 0, 2024-08-31T04:38:51.356 INFO:teuthology.orchestra.run.smithi133.stdout: "oplen_avg": { 2024-08-31T04:38:51.356 INFO:teuthology.orchestra.run.smithi133.stdout: "avgcount": 20841, 2024-08-31T04:38:51.356 INFO:teuthology.orchestra.run.smithi133.stdout: "sum": 21956 2024-08-31T04:38:51.356 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-08-31T04:38:51.356 INFO:teuthology.orchestra.run.smithi133.stdout: "op": 20841, 2024-08-31T04:38:51.356 INFO:teuthology.orchestra.run.smithi133.stdout: "op_r": 787, 2024-08-31T04:38:51.356 INFO:teuthology.orchestra.run.smithi133.stdout: "op_w": 20054, 2024-08-31T04:38:51.357 INFO:teuthology.orchestra.run.smithi133.stdout: "op_rmw": 0, 2024-08-31T04:38:51.357 INFO:teuthology.orchestra.run.smithi133.stdout: "op_pg": 0, 2024-08-31T04:38:51.357 INFO:teuthology.orchestra.run.smithi133.stdout: "osdop_stat": 0, 2024-08-31T04:38:51.357 INFO:teuthology.orchestra.run.smithi133.stdout: "osdop_create": 10, 2024-08-31T04:38:51.357 INFO:teuthology.orchestra.run.smithi133.stdout: "osdop_read": 628, 2024-08-31T04:38:51.357 INFO:teuthology.orchestra.run.smithi133.stdout: "osdop_write": 4777, 2024-08-31T04:38:51.357 INFO:teuthology.orchestra.run.smithi133.stdout: "osdop_writefull": 376, 2024-08-31T04:38:51.357 INFO:teuthology.orchestra.run.smithi133.stdout: "osdop_writesame": 0, 2024-08-31T04:38:51.357 INFO:teuthology.orchestra.run.smithi133.stdout: "osdop_append": 0, 2024-08-31T04:38:51.357 INFO:teuthology.orchestra.run.smithi133.stdout: "osdop_zero": 0, 2024-08-31T04:38:51.357 INFO:teuthology.orchestra.run.smithi133.stdout: "osdop_truncate": 45, 2024-08-31T04:38:51.357 INFO:teuthology.orchestra.run.smithi133.stdout: "osdop_delete": 14062, 2024-08-31T04:38:51.357 INFO:teuthology.orchestra.run.smithi133.stdout: "osdop_mapext": 0, 2024-08-31T04:38:51.357 INFO:teuthology.orchestra.run.smithi133.stdout: "osdop_sparse_read": 0, 2024-08-31T04:38:51.358 INFO:teuthology.orchestra.run.smithi133.stdout: "osdop_clonerange": 0, 2024-08-31T04:38:51.358 INFO:teuthology.orchestra.run.smithi133.stdout: "osdop_getxattr": 0, 2024-08-31T04:38:51.358 INFO:teuthology.orchestra.run.smithi133.stdout: "osdop_setxattr": 20, 2024-08-31T04:38:51.358 INFO:teuthology.orchestra.run.smithi133.stdout: "osdop_cmpxattr": 0, 2024-08-31T04:38:51.358 INFO:teuthology.orchestra.run.smithi133.stdout: "osdop_rmxattr": 0, 2024-08-31T04:38:51.358 INFO:teuthology.orchestra.run.smithi133.stdout: "osdop_resetxattrs": 0, 2024-08-31T04:38:51.358 INFO:teuthology.orchestra.run.smithi133.stdout: "osdop_call": 0, 2024-08-31T04:38:51.358 INFO:teuthology.orchestra.run.smithi133.stdout: "osdop_watch": 0, 2024-08-31T04:38:51.358 INFO:teuthology.orchestra.run.smithi133.stdout: "osdop_notify": 0, 2024-08-31T04:38:51.358 INFO:teuthology.orchestra.run.smithi133.stdout: "osdop_src_cmpxattr": 0, 2024-08-31T04:38:51.358 INFO:teuthology.orchestra.run.smithi133.stdout: "osdop_pgls": 0, 2024-08-31T04:38:51.358 INFO:teuthology.orchestra.run.smithi133.stdout: "osdop_pgls_filter": 0, 2024-08-31T04:38:51.358 INFO:teuthology.orchestra.run.smithi133.stdout: "osdop_other": 1, 2024-08-31T04:38:51.359 INFO:teuthology.orchestra.run.smithi133.stdout: "linger_active": 0, 2024-08-31T04:38:51.359 INFO:teuthology.orchestra.run.smithi133.stdout: "linger_send": 0, 2024-08-31T04:38:51.359 INFO:teuthology.orchestra.run.smithi133.stdout: "linger_resend": 0, 2024-08-31T04:38:51.359 INFO:teuthology.orchestra.run.smithi133.stdout: "linger_ping": 0, 2024-08-31T04:38:51.359 INFO:teuthology.orchestra.run.smithi133.stdout: "poolop_active": 0, 2024-08-31T04:38:51.359 INFO:teuthology.orchestra.run.smithi133.stdout: "poolop_send": 0, 2024-08-31T04:38:51.359 INFO:teuthology.orchestra.run.smithi133.stdout: "poolop_resend": 0, 2024-08-31T04:38:51.359 INFO:teuthology.orchestra.run.smithi133.stdout: "poolstat_active": 0, 2024-08-31T04:38:51.359 INFO:teuthology.orchestra.run.smithi133.stdout: "poolstat_send": 0, 2024-08-31T04:38:51.359 INFO:teuthology.orchestra.run.smithi133.stdout: "poolstat_resend": 0, 2024-08-31T04:38:51.359 INFO:teuthology.orchestra.run.smithi133.stdout: "statfs_active": 0, 2024-08-31T04:38:51.359 INFO:teuthology.orchestra.run.smithi133.stdout: "statfs_send": 0, 2024-08-31T04:38:51.359 INFO:teuthology.orchestra.run.smithi133.stdout: "statfs_resend": 0, 2024-08-31T04:38:51.359 INFO:teuthology.orchestra.run.smithi133.stdout: "command_active": 0, 2024-08-31T04:38:51.360 INFO:teuthology.orchestra.run.smithi133.stdout: "command_send": 0, 2024-08-31T04:38:51.360 INFO:teuthology.orchestra.run.smithi133.stdout: "command_resend": 0, 2024-08-31T04:38:51.360 INFO:teuthology.orchestra.run.smithi133.stdout: "map_epoch": 80, 2024-08-31T04:38:51.360 INFO:teuthology.orchestra.run.smithi133.stdout: "map_full": 0, 2024-08-31T04:38:51.360 INFO:teuthology.orchestra.run.smithi133.stdout: "map_inc": 3, 2024-08-31T04:38:51.360 INFO:teuthology.orchestra.run.smithi133.stdout: "osd_sessions": 12, 2024-08-31T04:38:51.360 INFO:teuthology.orchestra.run.smithi133.stdout: "osd_session_open": 12, 2024-08-31T04:38:51.360 INFO:teuthology.orchestra.run.smithi133.stdout: "osd_session_close": 0, 2024-08-31T04:38:51.360 INFO:teuthology.orchestra.run.smithi133.stdout: "osd_laggy": 0, 2024-08-31T04:38:51.360 INFO:teuthology.orchestra.run.smithi133.stdout: "omap_wr": 1487, 2024-08-31T04:38:51.360 INFO:teuthology.orchestra.run.smithi133.stdout: "omap_rd": 218, 2024-08-31T04:38:51.360 INFO:teuthology.orchestra.run.smithi133.stdout: "omap_del": 332 2024-08-31T04:38:51.360 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-08-31T04:38:51.360 INFO:teuthology.orchestra.run.smithi133.stdout: "oft": { 2024-08-31T04:38:51.361 INFO:teuthology.orchestra.run.smithi133.stdout: "omap_total_objs": 1, 2024-08-31T04:38:51.361 INFO:teuthology.orchestra.run.smithi133.stdout: "omap_total_kv_pairs": 0, 2024-08-31T04:38:51.361 INFO:teuthology.orchestra.run.smithi133.stdout: "omap_total_updates": 0, 2024-08-31T04:38:51.361 INFO:teuthology.orchestra.run.smithi133.stdout: "omap_total_removes": 0 2024-08-31T04:38:51.361 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-08-31T04:38:51.361 INFO:teuthology.orchestra.run.smithi133.stdout: "purge_queue": { 2024-08-31T04:38:51.361 INFO:teuthology.orchestra.run.smithi133.stdout: "pq_executing_ops": 0, 2024-08-31T04:38:51.361 INFO:teuthology.orchestra.run.smithi133.stdout: "pq_executing_ops_high_water": 14, 2024-08-31T04:38:51.361 INFO:teuthology.orchestra.run.smithi133.stdout: "pq_executing": 0, 2024-08-31T04:38:51.361 INFO:teuthology.orchestra.run.smithi133.stdout: "pq_executing_high_water": 6, 2024-08-31T04:38:51.361 INFO:teuthology.orchestra.run.smithi133.stdout: "pq_executed_ops": 14010, 2024-08-31T04:38:51.361 INFO:teuthology.orchestra.run.smithi133.stdout: "pq_executed": 13650, 2024-08-31T04:38:51.361 INFO:teuthology.orchestra.run.smithi133.stdout: "pq_item_in_journal": 0 2024-08-31T04:38:51.361 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-08-31T04:38:51.361 INFO:teuthology.orchestra.run.smithi133.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-08-31T04:38:51.362 INFO:teuthology.orchestra.run.smithi133.stdout: "val": 0, 2024-08-31T04:38:51.362 INFO:teuthology.orchestra.run.smithi133.stdout: "max": 104857600, 2024-08-31T04:38:51.362 INFO:teuthology.orchestra.run.smithi133.stdout: "get_started": 0, 2024-08-31T04:38:51.362 INFO:teuthology.orchestra.run.smithi133.stdout: "get": 251300, 2024-08-31T04:38:51.362 INFO:teuthology.orchestra.run.smithi133.stdout: "get_sum": 72304341, 2024-08-31T04:38:51.362 INFO:teuthology.orchestra.run.smithi133.stdout: "get_or_fail_fail": 0, 2024-08-31T04:38:51.362 INFO:teuthology.orchestra.run.smithi133.stdout: "get_or_fail_success": 251300, 2024-08-31T04:38:51.362 INFO:teuthology.orchestra.run.smithi133.stdout: "take": 0, 2024-08-31T04:38:51.362 INFO:teuthology.orchestra.run.smithi133.stdout: "take_sum": 0, 2024-08-31T04:38:51.362 INFO:teuthology.orchestra.run.smithi133.stdout: "put": 251300, 2024-08-31T04:38:51.362 INFO:teuthology.orchestra.run.smithi133.stdout: "put_sum": 72304341, 2024-08-31T04:38:51.362 INFO:teuthology.orchestra.run.smithi133.stdout: "wait": { 2024-08-31T04:38:51.362 INFO:teuthology.orchestra.run.smithi133.stdout: "avgcount": 0, 2024-08-31T04:38:51.362 INFO:teuthology.orchestra.run.smithi133.stdout: "sum": 0.000000000, 2024-08-31T04:38:51.363 INFO:teuthology.orchestra.run.smithi133.stdout: "avgtime": 0.000000000 2024-08-31T04:38:51.363 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-08-31T04:38:51.363 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-08-31T04:38:51.363 INFO:teuthology.orchestra.run.smithi133.stdout: "throttle-objecter_bytes": { 2024-08-31T04:38:51.363 INFO:teuthology.orchestra.run.smithi133.stdout: "val": 0, 2024-08-31T04:38:51.363 INFO:teuthology.orchestra.run.smithi133.stdout: "max": 104857600, 2024-08-31T04:38:51.363 INFO:teuthology.orchestra.run.smithi133.stdout: "get_started": 0, 2024-08-31T04:38:51.363 INFO:teuthology.orchestra.run.smithi133.stdout: "get": 0, 2024-08-31T04:38:51.363 INFO:teuthology.orchestra.run.smithi133.stdout: "get_sum": 0, 2024-08-31T04:38:51.363 INFO:teuthology.orchestra.run.smithi133.stdout: "get_or_fail_fail": 0, 2024-08-31T04:38:51.363 INFO:teuthology.orchestra.run.smithi133.stdout: "get_or_fail_success": 0, 2024-08-31T04:38:51.363 INFO:teuthology.orchestra.run.smithi133.stdout: "take": 20841, 2024-08-31T04:38:51.363 INFO:teuthology.orchestra.run.smithi133.stdout: "take_sum": 148671777, 2024-08-31T04:38:51.363 INFO:teuthology.orchestra.run.smithi133.stdout: "put": 20841, 2024-08-31T04:38:51.364 INFO:teuthology.orchestra.run.smithi133.stdout: "put_sum": 148671777, 2024-08-31T04:38:51.364 INFO:teuthology.orchestra.run.smithi133.stdout: "wait": { 2024-08-31T04:38:51.364 INFO:teuthology.orchestra.run.smithi133.stdout: "avgcount": 0, 2024-08-31T04:38:51.364 INFO:teuthology.orchestra.run.smithi133.stdout: "sum": 0.000000000, 2024-08-31T04:38:51.364 INFO:teuthology.orchestra.run.smithi133.stdout: "avgtime": 0.000000000 2024-08-31T04:38:51.364 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-08-31T04:38:51.364 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-08-31T04:38:51.364 INFO:teuthology.orchestra.run.smithi133.stdout: "throttle-objecter_ops": { 2024-08-31T04:38:51.364 INFO:teuthology.orchestra.run.smithi133.stdout: "val": 0, 2024-08-31T04:38:51.364 INFO:teuthology.orchestra.run.smithi133.stdout: "max": 1024, 2024-08-31T04:38:51.364 INFO:teuthology.orchestra.run.smithi133.stdout: "get_started": 0, 2024-08-31T04:38:51.364 INFO:teuthology.orchestra.run.smithi133.stdout: "get": 0, 2024-08-31T04:38:51.364 INFO:teuthology.orchestra.run.smithi133.stdout: "get_sum": 0, 2024-08-31T04:38:51.364 INFO:teuthology.orchestra.run.smithi133.stdout: "get_or_fail_fail": 0, 2024-08-31T04:38:51.365 INFO:teuthology.orchestra.run.smithi133.stdout: "get_or_fail_success": 0, 2024-08-31T04:38:51.365 INFO:teuthology.orchestra.run.smithi133.stdout: "take": 20841, 2024-08-31T04:38:51.365 INFO:teuthology.orchestra.run.smithi133.stdout: "take_sum": 20841, 2024-08-31T04:38:51.365 INFO:teuthology.orchestra.run.smithi133.stdout: "put": 20841, 2024-08-31T04:38:51.365 INFO:teuthology.orchestra.run.smithi133.stdout: "put_sum": 20841, 2024-08-31T04:38:51.365 INFO:teuthology.orchestra.run.smithi133.stdout: "wait": { 2024-08-31T04:38:51.365 INFO:teuthology.orchestra.run.smithi133.stdout: "avgcount": 0, 2024-08-31T04:38:51.365 INFO:teuthology.orchestra.run.smithi133.stdout: "sum": 0.000000000, 2024-08-31T04:38:51.365 INFO:teuthology.orchestra.run.smithi133.stdout: "avgtime": 0.000000000 2024-08-31T04:38:51.365 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-08-31T04:38:51.365 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-08-31T04:38:51.365 INFO:teuthology.orchestra.run.smithi133.stdout: "throttle-write_buf_throttle": { 2024-08-31T04:38:51.365 INFO:teuthology.orchestra.run.smithi133.stdout: "val": 0, 2024-08-31T04:38:51.365 INFO:teuthology.orchestra.run.smithi133.stdout: "max": 3758096384, 2024-08-31T04:38:51.366 INFO:teuthology.orchestra.run.smithi133.stdout: "get_started": 0, 2024-08-31T04:38:51.366 INFO:teuthology.orchestra.run.smithi133.stdout: "get": 13650, 2024-08-31T04:38:51.366 INFO:teuthology.orchestra.run.smithi133.stdout: "get_sum": 1379010, 2024-08-31T04:38:51.366 INFO:teuthology.orchestra.run.smithi133.stdout: "get_or_fail_fail": 0, 2024-08-31T04:38:51.366 INFO:teuthology.orchestra.run.smithi133.stdout: "get_or_fail_success": 13650, 2024-08-31T04:38:51.366 INFO:teuthology.orchestra.run.smithi133.stdout: "take": 0, 2024-08-31T04:38:51.366 INFO:teuthology.orchestra.run.smithi133.stdout: "take_sum": 0, 2024-08-31T04:38:51.366 INFO:teuthology.orchestra.run.smithi133.stdout: "put": 629, 2024-08-31T04:38:51.366 INFO:teuthology.orchestra.run.smithi133.stdout: "put_sum": 1379010, 2024-08-31T04:38:51.366 INFO:teuthology.orchestra.run.smithi133.stdout: "wait": { 2024-08-31T04:38:51.366 INFO:teuthology.orchestra.run.smithi133.stdout: "avgcount": 0, 2024-08-31T04:38:51.366 INFO:teuthology.orchestra.run.smithi133.stdout: "sum": 0.000000000, 2024-08-31T04:38:51.366 INFO:teuthology.orchestra.run.smithi133.stdout: "avgtime": 0.000000000 2024-08-31T04:38:51.366 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-08-31T04:38:51.366 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-08-31T04:38:51.367 INFO:teuthology.orchestra.run.smithi133.stdout: "throttle-write_buf_throttle-0x55f7c5e8a5b0": { 2024-08-31T04:38:51.367 INFO:teuthology.orchestra.run.smithi133.stdout: "val": 0, 2024-08-31T04:38:51.367 INFO:teuthology.orchestra.run.smithi133.stdout: "max": 3758096384, 2024-08-31T04:38:51.367 INFO:teuthology.orchestra.run.smithi133.stdout: "get_started": 0, 2024-08-31T04:38:51.367 INFO:teuthology.orchestra.run.smithi133.stdout: "get": 69697, 2024-08-31T04:38:51.367 INFO:teuthology.orchestra.run.smithi133.stdout: "get_sum": 137855900, 2024-08-31T04:38:51.367 INFO:teuthology.orchestra.run.smithi133.stdout: "get_or_fail_fail": 0, 2024-08-31T04:38:51.367 INFO:teuthology.orchestra.run.smithi133.stdout: "get_or_fail_success": 69697, 2024-08-31T04:38:51.367 INFO:teuthology.orchestra.run.smithi133.stdout: "take": 0, 2024-08-31T04:38:51.367 INFO:teuthology.orchestra.run.smithi133.stdout: "take_sum": 0, 2024-08-31T04:38:51.367 INFO:teuthology.orchestra.run.smithi133.stdout: "put": 4148, 2024-08-31T04:38:51.367 INFO:teuthology.orchestra.run.smithi133.stdout: "put_sum": 137855900, 2024-08-31T04:38:51.367 INFO:teuthology.orchestra.run.smithi133.stdout: "wait": { 2024-08-31T04:38:51.367 INFO:teuthology.orchestra.run.smithi133.stdout: "avgcount": 0, 2024-08-31T04:38:51.368 INFO:teuthology.orchestra.run.smithi133.stdout: "sum": 0.000000000, 2024-08-31T04:38:51.368 INFO:teuthology.orchestra.run.smithi133.stdout: "avgtime": 0.000000000 2024-08-31T04:38:51.368 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-08-31T04:38:51.368 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-08-31T04:38:51.368 INFO:teuthology.orchestra.run.smithi133.stdout: "trackedop": { 2024-08-31T04:38:51.368 INFO:teuthology.orchestra.run.smithi133.stdout: "slow_ops_count": 23077 2024-08-31T04:38:51.368 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-08-31T04:38:51.368 INFO:teuthology.orchestra.run.smithi133.stdout:} 2024-08-31T04:38:51.950 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:38:51 smithi050 ceph-mon[17259]: pgmap v847: 97 pgs: 97 active+clean; 592 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 682 B/s wr, 10 op/s 2024-08-31T04:38:51.996 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:38:51 smithi177 ceph-mon[22025]: pgmap v847: 97 pgs: 97 active+clean; 592 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 682 B/s wr, 10 op/s 2024-08-31T04:38:52.043 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:38:51 smithi133 ceph-mon[22177]: pgmap v847: 97 pgs: 97 active+clean; 592 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 682 B/s wr, 10 op/s 2024-08-31T04:38:52.084 INFO:tasks.check_counter:Daemon mds.h mds.exported=248 2024-08-31T04:38:52.084 INFO:tasks.check_counter:Daemon mds.h mds.imported=186 2024-08-31T04:38:52.084 INFO:tasks.check_counter:Daemon mds.h mds_cache.dir_update=3583 2024-08-31T04:38:52.084 INFO:tasks.check_counter:Daemon mds.h mds_cache.dir_update_receipt=9070 2024-08-31T04:38:52.084 INFO:tasks.check_counter:Daemon mds.h mds.dir_split=45 2024-08-31T04:38:52.084 DEBUG:tasks.check_counter:Getting stats from k 2024-08-31T04:38:52.084 DEBUG:teuthology.orchestra.run.smithi133:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 058d9fc6-674f-11ef-bcd4-c7b262605968 -- ceph daemon mds.k perf dump 2024-08-31T04:38:52.331 INFO:teuthology.orchestra.run.smithi133.stderr:Inferring config /var/lib/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/mon.b/config 2024-08-31T04:38:52.823 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2024-08-31T04:38:52.823 INFO:teuthology.orchestra.run.smithi133.stdout: "AsyncMessenger::Worker-0": { 2024-08-31T04:38:52.823 INFO:teuthology.orchestra.run.smithi133.stdout: "msgr_recv_messages": 2444, 2024-08-31T04:38:52.823 INFO:teuthology.orchestra.run.smithi133.stdout: "msgr_send_messages": 2446, 2024-08-31T04:38:52.823 INFO:teuthology.orchestra.run.smithi133.stdout: "msgr_recv_bytes": 55236788, 2024-08-31T04:38:52.823 INFO:teuthology.orchestra.run.smithi133.stdout: "msgr_send_bytes": 777193, 2024-08-31T04:38:52.823 INFO:teuthology.orchestra.run.smithi133.stdout: "msgr_created_connections": 8, 2024-08-31T04:38:52.823 INFO:teuthology.orchestra.run.smithi133.stdout: "msgr_active_connections": 4, 2024-08-31T04:38:52.824 INFO:teuthology.orchestra.run.smithi133.stdout: "msgr_running_total_time": 0.273862747, 2024-08-31T04:38:52.824 INFO:teuthology.orchestra.run.smithi133.stdout: "msgr_running_send_time": 0.112549569, 2024-08-31T04:38:52.824 INFO:teuthology.orchestra.run.smithi133.stdout: "msgr_running_recv_time": 0.081254100, 2024-08-31T04:38:52.824 INFO:teuthology.orchestra.run.smithi133.stdout: "msgr_running_fast_dispatch_time": 0.062924943, 2024-08-31T04:38:52.824 INFO:teuthology.orchestra.run.smithi133.stdout: "msgr_send_messages_queue_lat": { 2024-08-31T04:38:52.824 INFO:teuthology.orchestra.run.smithi133.stdout: "avgcount": 2444, 2024-08-31T04:38:52.824 INFO:teuthology.orchestra.run.smithi133.stdout: "sum": 0.094088199, 2024-08-31T04:38:52.824 INFO:teuthology.orchestra.run.smithi133.stdout: "avgtime": 0.000038497 2024-08-31T04:38:52.824 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-08-31T04:38:52.824 INFO:teuthology.orchestra.run.smithi133.stdout: "msgr_handle_ack_lat": { 2024-08-31T04:38:52.825 INFO:teuthology.orchestra.run.smithi133.stdout: "avgcount": 0, 2024-08-31T04:38:52.825 INFO:teuthology.orchestra.run.smithi133.stdout: "sum": 0.000000000, 2024-08-31T04:38:52.825 INFO:teuthology.orchestra.run.smithi133.stdout: "avgtime": 0.000000000 2024-08-31T04:38:52.825 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-08-31T04:38:52.825 INFO:teuthology.orchestra.run.smithi133.stdout: "msgr_recv_encrypted_bytes": 0, 2024-08-31T04:38:52.825 INFO:teuthology.orchestra.run.smithi133.stdout: "msgr_send_encrypted_bytes": 0 2024-08-31T04:38:52.825 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-08-31T04:38:52.825 INFO:teuthology.orchestra.run.smithi133.stdout: "AsyncMessenger::Worker-1": { 2024-08-31T04:38:52.825 INFO:teuthology.orchestra.run.smithi133.stdout: "msgr_recv_messages": 312, 2024-08-31T04:38:52.825 INFO:teuthology.orchestra.run.smithi133.stdout: "msgr_send_messages": 539, 2024-08-31T04:38:52.825 INFO:teuthology.orchestra.run.smithi133.stdout: "msgr_recv_bytes": 37837694, 2024-08-31T04:38:52.826 INFO:teuthology.orchestra.run.smithi133.stdout: "msgr_send_bytes": 670672, 2024-08-31T04:38:52.826 INFO:teuthology.orchestra.run.smithi133.stdout: "msgr_created_connections": 7, 2024-08-31T04:38:52.826 INFO:teuthology.orchestra.run.smithi133.stdout: "msgr_active_connections": 5, 2024-08-31T04:38:52.826 INFO:teuthology.orchestra.run.smithi133.stdout: "msgr_running_total_time": 0.070017405, 2024-08-31T04:38:52.826 INFO:teuthology.orchestra.run.smithi133.stdout: "msgr_running_send_time": 0.022694892, 2024-08-31T04:38:52.826 INFO:teuthology.orchestra.run.smithi133.stdout: "msgr_running_recv_time": 0.035731248, 2024-08-31T04:38:52.826 INFO:teuthology.orchestra.run.smithi133.stdout: "msgr_running_fast_dispatch_time": 0.007602669, 2024-08-31T04:38:52.826 INFO:teuthology.orchestra.run.smithi133.stdout: "msgr_send_messages_queue_lat": { 2024-08-31T04:38:52.826 INFO:teuthology.orchestra.run.smithi133.stdout: "avgcount": 538, 2024-08-31T04:38:52.826 INFO:teuthology.orchestra.run.smithi133.stdout: "sum": 0.109531055, 2024-08-31T04:38:52.826 INFO:teuthology.orchestra.run.smithi133.stdout: "avgtime": 0.000203589 2024-08-31T04:38:52.826 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-08-31T04:38:52.826 INFO:teuthology.orchestra.run.smithi133.stdout: "msgr_handle_ack_lat": { 2024-08-31T04:38:52.827 INFO:teuthology.orchestra.run.smithi133.stdout: "avgcount": 0, 2024-08-31T04:38:52.827 INFO:teuthology.orchestra.run.smithi133.stdout: "sum": 0.000000000, 2024-08-31T04:38:52.827 INFO:teuthology.orchestra.run.smithi133.stdout: "avgtime": 0.000000000 2024-08-31T04:38:52.827 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-08-31T04:38:52.827 INFO:teuthology.orchestra.run.smithi133.stdout: "msgr_recv_encrypted_bytes": 3312, 2024-08-31T04:38:52.827 INFO:teuthology.orchestra.run.smithi133.stdout: "msgr_send_encrypted_bytes": 573296 2024-08-31T04:38:52.827 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-08-31T04:38:52.827 INFO:teuthology.orchestra.run.smithi133.stdout: "AsyncMessenger::Worker-2": { 2024-08-31T04:38:52.827 INFO:teuthology.orchestra.run.smithi133.stdout: "msgr_recv_messages": 1112, 2024-08-31T04:38:52.827 INFO:teuthology.orchestra.run.smithi133.stdout: "msgr_send_messages": 1067, 2024-08-31T04:38:52.827 INFO:teuthology.orchestra.run.smithi133.stdout: "msgr_recv_bytes": 46623288, 2024-08-31T04:38:52.828 INFO:teuthology.orchestra.run.smithi133.stdout: "msgr_send_bytes": 428710, 2024-08-31T04:38:52.828 INFO:teuthology.orchestra.run.smithi133.stdout: "msgr_created_connections": 5, 2024-08-31T04:38:52.828 INFO:teuthology.orchestra.run.smithi133.stdout: "msgr_active_connections": 4, 2024-08-31T04:38:52.828 INFO:teuthology.orchestra.run.smithi133.stdout: "msgr_running_total_time": 0.142144860, 2024-08-31T04:38:52.828 INFO:teuthology.orchestra.run.smithi133.stdout: "msgr_running_send_time": 0.051319351, 2024-08-31T04:38:52.828 INFO:teuthology.orchestra.run.smithi133.stdout: "msgr_running_recv_time": 0.075572504, 2024-08-31T04:38:52.828 INFO:teuthology.orchestra.run.smithi133.stdout: "msgr_running_fast_dispatch_time": 0.019771952, 2024-08-31T04:38:52.828 INFO:teuthology.orchestra.run.smithi133.stdout: "msgr_send_messages_queue_lat": { 2024-08-31T04:38:52.828 INFO:teuthology.orchestra.run.smithi133.stdout: "avgcount": 1066, 2024-08-31T04:38:52.829 INFO:teuthology.orchestra.run.smithi133.stdout: "sum": 0.039837754, 2024-08-31T04:38:52.829 INFO:teuthology.orchestra.run.smithi133.stdout: "avgtime": 0.000037371 2024-08-31T04:38:52.829 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-08-31T04:38:52.829 INFO:teuthology.orchestra.run.smithi133.stdout: "msgr_handle_ack_lat": { 2024-08-31T04:38:52.829 INFO:teuthology.orchestra.run.smithi133.stdout: "avgcount": 0, 2024-08-31T04:38:52.829 INFO:teuthology.orchestra.run.smithi133.stdout: "sum": 0.000000000, 2024-08-31T04:38:52.829 INFO:teuthology.orchestra.run.smithi133.stdout: "avgtime": 0.000000000 2024-08-31T04:38:52.829 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-08-31T04:38:52.829 INFO:teuthology.orchestra.run.smithi133.stdout: "msgr_recv_encrypted_bytes": 846592, 2024-08-31T04:38:52.829 INFO:teuthology.orchestra.run.smithi133.stdout: "msgr_send_encrypted_bytes": 187984 2024-08-31T04:38:52.829 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-08-31T04:38:52.829 INFO:teuthology.orchestra.run.smithi133.stdout: "cct": { 2024-08-31T04:38:52.830 INFO:teuthology.orchestra.run.smithi133.stdout: "total_workers": 1, 2024-08-31T04:38:52.830 INFO:teuthology.orchestra.run.smithi133.stdout: "unhealthy_workers": 0 2024-08-31T04:38:52.830 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-08-31T04:38:52.830 INFO:teuthology.orchestra.run.smithi133.stdout: "finisher-MDSRank": { 2024-08-31T04:38:52.830 INFO:teuthology.orchestra.run.smithi133.stdout: "queue_len": 0, 2024-08-31T04:38:52.830 INFO:teuthology.orchestra.run.smithi133.stdout: "complete_latency": { 2024-08-31T04:38:52.830 INFO:teuthology.orchestra.run.smithi133.stdout: "avgcount": 5896, 2024-08-31T04:38:52.830 INFO:teuthology.orchestra.run.smithi133.stdout: "sum": 0.154414805, 2024-08-31T04:38:52.830 INFO:teuthology.orchestra.run.smithi133.stdout: "avgtime": 0.000026189 2024-08-31T04:38:52.830 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-08-31T04:38:52.830 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-08-31T04:38:52.830 INFO:teuthology.orchestra.run.smithi133.stdout: "finisher-PurgeQueue": { 2024-08-31T04:38:52.830 INFO:teuthology.orchestra.run.smithi133.stdout: "queue_len": 0, 2024-08-31T04:38:52.831 INFO:teuthology.orchestra.run.smithi133.stdout: "complete_latency": { 2024-08-31T04:38:52.831 INFO:teuthology.orchestra.run.smithi133.stdout: "avgcount": 0, 2024-08-31T04:38:52.831 INFO:teuthology.orchestra.run.smithi133.stdout: "sum": 0.000000000, 2024-08-31T04:38:52.831 INFO:teuthology.orchestra.run.smithi133.stdout: "avgtime": 0.000000000 2024-08-31T04:38:52.831 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-08-31T04:38:52.831 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-08-31T04:38:52.831 INFO:teuthology.orchestra.run.smithi133.stdout: "mds": { 2024-08-31T04:38:52.832 INFO:teuthology.orchestra.run.smithi133.stdout: "request": 0, 2024-08-31T04:38:52.832 INFO:teuthology.orchestra.run.smithi133.stdout: "reply": 0, 2024-08-31T04:38:52.832 INFO:teuthology.orchestra.run.smithi133.stdout: "reply_latency": { 2024-08-31T04:38:52.832 INFO:teuthology.orchestra.run.smithi133.stdout: "avgcount": 0, 2024-08-31T04:38:52.832 INFO:teuthology.orchestra.run.smithi133.stdout: "sum": 0.000000000, 2024-08-31T04:38:52.832 INFO:teuthology.orchestra.run.smithi133.stdout: "avgtime": 0.000000000 2024-08-31T04:38:52.832 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-08-31T04:38:52.832 INFO:teuthology.orchestra.run.smithi133.stdout: "slow_reply": 0, 2024-08-31T04:38:52.832 INFO:teuthology.orchestra.run.smithi133.stdout: "forward": 0, 2024-08-31T04:38:52.833 INFO:teuthology.orchestra.run.smithi133.stdout: "dir_fetch_complete": 0, 2024-08-31T04:38:52.833 INFO:teuthology.orchestra.run.smithi133.stdout: "dir_fetch_keys": 0, 2024-08-31T04:38:52.833 INFO:teuthology.orchestra.run.smithi133.stdout: "dir_commit": 0, 2024-08-31T04:38:52.833 INFO:teuthology.orchestra.run.smithi133.stdout: "dir_split": 0, 2024-08-31T04:38:52.833 INFO:teuthology.orchestra.run.smithi133.stdout: "dir_merge": 0, 2024-08-31T04:38:52.833 INFO:teuthology.orchestra.run.smithi133.stdout: "inodes": 13660, 2024-08-31T04:38:52.833 INFO:teuthology.orchestra.run.smithi133.stdout: "inodes_top": 0, 2024-08-31T04:38:52.833 INFO:teuthology.orchestra.run.smithi133.stdout: "inodes_bottom": 13660, 2024-08-31T04:38:52.833 INFO:teuthology.orchestra.run.smithi133.stdout: "inodes_pin_tail": 0, 2024-08-31T04:38:52.833 INFO:teuthology.orchestra.run.smithi133.stdout: "inodes_pinned": 13660, 2024-08-31T04:38:52.833 INFO:teuthology.orchestra.run.smithi133.stdout: "inodes_expired": 0, 2024-08-31T04:38:52.833 INFO:teuthology.orchestra.run.smithi133.stdout: "inodes_with_caps": 0, 2024-08-31T04:38:52.833 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": 0, 2024-08-31T04:38:52.833 INFO:teuthology.orchestra.run.smithi133.stdout: "subtrees": 1, 2024-08-31T04:38:52.834 INFO:teuthology.orchestra.run.smithi133.stdout: "traverse": 0, 2024-08-31T04:38:52.834 INFO:teuthology.orchestra.run.smithi133.stdout: "traverse_hit": 0, 2024-08-31T04:38:52.834 INFO:teuthology.orchestra.run.smithi133.stdout: "traverse_forward": 0, 2024-08-31T04:38:52.834 INFO:teuthology.orchestra.run.smithi133.stdout: "traverse_discover": 0, 2024-08-31T04:38:52.834 INFO:teuthology.orchestra.run.smithi133.stdout: "traverse_dir_fetch": 0, 2024-08-31T04:38:52.834 INFO:teuthology.orchestra.run.smithi133.stdout: "traverse_remote_ino": 0, 2024-08-31T04:38:52.834 INFO:teuthology.orchestra.run.smithi133.stdout: "traverse_lock": 0, 2024-08-31T04:38:52.834 INFO:teuthology.orchestra.run.smithi133.stdout: "load_cent": 0, 2024-08-31T04:38:52.834 INFO:teuthology.orchestra.run.smithi133.stdout: "q": 0, 2024-08-31T04:38:52.834 INFO:teuthology.orchestra.run.smithi133.stdout: "exported": 0, 2024-08-31T04:38:52.834 INFO:teuthology.orchestra.run.smithi133.stdout: "exported_inodes": 0, 2024-08-31T04:38:52.834 INFO:teuthology.orchestra.run.smithi133.stdout: "imported": 0, 2024-08-31T04:38:52.834 INFO:teuthology.orchestra.run.smithi133.stdout: "imported_inodes": 0, 2024-08-31T04:38:52.835 INFO:teuthology.orchestra.run.smithi133.stdout: "openino_dir_fetch": 0, 2024-08-31T04:38:52.835 INFO:teuthology.orchestra.run.smithi133.stdout: "openino_backtrace_fetch": 0, 2024-08-31T04:38:52.835 INFO:teuthology.orchestra.run.smithi133.stdout: "openino_peer_discover": 0, 2024-08-31T04:38:52.835 INFO:teuthology.orchestra.run.smithi133.stdout: "root_rfiles": 0, 2024-08-31T04:38:52.835 INFO:teuthology.orchestra.run.smithi133.stdout: "root_rbytes": 0, 2024-08-31T04:38:52.835 INFO:teuthology.orchestra.run.smithi133.stdout: "root_rsnaps": 0, 2024-08-31T04:38:52.835 INFO:teuthology.orchestra.run.smithi133.stdout: "scrub_backtrace_fetch": 0, 2024-08-31T04:38:52.835 INFO:teuthology.orchestra.run.smithi133.stdout: "scrub_set_tag": 0, 2024-08-31T04:38:52.835 INFO:teuthology.orchestra.run.smithi133.stdout: "scrub_backtrace_repaired": 0, 2024-08-31T04:38:52.835 INFO:teuthology.orchestra.run.smithi133.stdout: "scrub_inotable_repaired": 0, 2024-08-31T04:38:52.836 INFO:teuthology.orchestra.run.smithi133.stdout: "scrub_dir_inodes": 0, 2024-08-31T04:38:52.836 INFO:teuthology.orchestra.run.smithi133.stdout: "scrub_dir_base_inodes": 0, 2024-08-31T04:38:52.836 INFO:teuthology.orchestra.run.smithi133.stdout: "scrub_dirfrag_rstats": 0, 2024-08-31T04:38:52.836 INFO:teuthology.orchestra.run.smithi133.stdout: "scrub_file_inodes": 0, 2024-08-31T04:38:52.836 INFO:teuthology.orchestra.run.smithi133.stdout: "handle_inode_file_caps": 0, 2024-08-31T04:38:52.836 INFO:teuthology.orchestra.run.smithi133.stdout: "ceph_cap_op_revoke": 0, 2024-08-31T04:38:52.836 INFO:teuthology.orchestra.run.smithi133.stdout: "ceph_cap_op_grant": 0, 2024-08-31T04:38:52.836 INFO:teuthology.orchestra.run.smithi133.stdout: "ceph_cap_op_trunc": 0, 2024-08-31T04:38:52.836 INFO:teuthology.orchestra.run.smithi133.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-08-31T04:38:52.836 INFO:teuthology.orchestra.run.smithi133.stdout: "ceph_cap_op_flush_ack": 0, 2024-08-31T04:38:52.836 INFO:teuthology.orchestra.run.smithi133.stdout: "handle_client_caps": 0, 2024-08-31T04:38:52.836 INFO:teuthology.orchestra.run.smithi133.stdout: "handle_client_caps_dirty": 0, 2024-08-31T04:38:52.836 INFO:teuthology.orchestra.run.smithi133.stdout: "handle_client_cap_release": 0, 2024-08-31T04:38:52.837 INFO:teuthology.orchestra.run.smithi133.stdout: "process_request_cap_release": 0 2024-08-31T04:38:52.837 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-08-31T04:38:52.837 INFO:teuthology.orchestra.run.smithi133.stdout: "mds_cache": { 2024-08-31T04:38:52.837 INFO:teuthology.orchestra.run.smithi133.stdout: "dir_update": 0, 2024-08-31T04:38:52.837 INFO:teuthology.orchestra.run.smithi133.stdout: "dir_update_receipt": 0, 2024-08-31T04:38:52.837 INFO:teuthology.orchestra.run.smithi133.stdout: "dir_try_discover": 0, 2024-08-31T04:38:52.837 INFO:teuthology.orchestra.run.smithi133.stdout: "dir_send_discover": 0, 2024-08-31T04:38:52.837 INFO:teuthology.orchestra.run.smithi133.stdout: "dir_handle_discover": 0, 2024-08-31T04:38:52.838 INFO:teuthology.orchestra.run.smithi133.stdout: "num_strays": 0, 2024-08-31T04:38:52.838 INFO:teuthology.orchestra.run.smithi133.stdout: "num_strays_delayed": 0, 2024-08-31T04:38:52.838 INFO:teuthology.orchestra.run.smithi133.stdout: "num_strays_enqueuing": 0, 2024-08-31T04:38:52.838 INFO:teuthology.orchestra.run.smithi133.stdout: "strays_created": 0, 2024-08-31T04:38:52.838 INFO:teuthology.orchestra.run.smithi133.stdout: "strays_enqueued": 0, 2024-08-31T04:38:52.838 INFO:teuthology.orchestra.run.smithi133.stdout: "strays_reintegrated": 0, 2024-08-31T04:38:52.838 INFO:teuthology.orchestra.run.smithi133.stdout: "strays_migrated": 0, 2024-08-31T04:38:52.838 INFO:teuthology.orchestra.run.smithi133.stdout: "num_recovering_processing": 0, 2024-08-31T04:38:52.838 INFO:teuthology.orchestra.run.smithi133.stdout: "num_recovering_enqueued": 0, 2024-08-31T04:38:52.838 INFO:teuthology.orchestra.run.smithi133.stdout: "num_recovering_prioritized": 0, 2024-08-31T04:38:52.838 INFO:teuthology.orchestra.run.smithi133.stdout: "recovery_started": 0, 2024-08-31T04:38:52.838 INFO:teuthology.orchestra.run.smithi133.stdout: "recovery_completed": 0, 2024-08-31T04:38:52.838 INFO:teuthology.orchestra.run.smithi133.stdout: "ireq_quiesce_path": 0, 2024-08-31T04:38:52.839 INFO:teuthology.orchestra.run.smithi133.stdout: "ireq_quiesce_inode": 0, 2024-08-31T04:38:52.839 INFO:teuthology.orchestra.run.smithi133.stdout: "ireq_enqueue_scrub": 0, 2024-08-31T04:38:52.839 INFO:teuthology.orchestra.run.smithi133.stdout: "ireq_exportdir": 0, 2024-08-31T04:38:52.839 INFO:teuthology.orchestra.run.smithi133.stdout: "ireq_flush": 0, 2024-08-31T04:38:52.839 INFO:teuthology.orchestra.run.smithi133.stdout: "ireq_fragmentdir": 0, 2024-08-31T04:38:52.839 INFO:teuthology.orchestra.run.smithi133.stdout: "ireq_fragstats": 0, 2024-08-31T04:38:52.839 INFO:teuthology.orchestra.run.smithi133.stdout: "ireq_inodestats": 0, 2024-08-31T04:38:52.839 INFO:teuthology.orchestra.run.smithi133.stdout: "uninline_started": 0, 2024-08-31T04:38:52.839 INFO:teuthology.orchestra.run.smithi133.stdout: "uninline_succeeded": 0, 2024-08-31T04:38:52.839 INFO:teuthology.orchestra.run.smithi133.stdout: "uninline_write_failed": 0 2024-08-31T04:38:52.839 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-08-31T04:38:52.839 INFO:teuthology.orchestra.run.smithi133.stdout: "mds_log": { 2024-08-31T04:38:52.839 INFO:teuthology.orchestra.run.smithi133.stdout: "evlrg": 0, 2024-08-31T04:38:52.839 INFO:teuthology.orchestra.run.smithi133.stdout: "evadd": 0, 2024-08-31T04:38:52.840 INFO:teuthology.orchestra.run.smithi133.stdout: "evex": 0, 2024-08-31T04:38:52.840 INFO:teuthology.orchestra.run.smithi133.stdout: "evtrm": 0, 2024-08-31T04:38:52.840 INFO:teuthology.orchestra.run.smithi133.stdout: "ev": 69697, 2024-08-31T04:38:52.840 INFO:teuthology.orchestra.run.smithi133.stdout: "evexg": 0, 2024-08-31T04:38:52.840 INFO:teuthology.orchestra.run.smithi133.stdout: "evexd": 0, 2024-08-31T04:38:52.840 INFO:teuthology.orchestra.run.smithi133.stdout: "segadd": 0, 2024-08-31T04:38:52.840 INFO:teuthology.orchestra.run.smithi133.stdout: "segex": 0, 2024-08-31T04:38:52.840 INFO:teuthology.orchestra.run.smithi133.stdout: "segtrm": 0, 2024-08-31T04:38:52.840 INFO:teuthology.orchestra.run.smithi133.stdout: "seg": 86, 2024-08-31T04:38:52.840 INFO:teuthology.orchestra.run.smithi133.stdout: "segmjr": 7, 2024-08-31T04:38:52.840 INFO:teuthology.orchestra.run.smithi133.stdout: "segexg": 0, 2024-08-31T04:38:52.840 INFO:teuthology.orchestra.run.smithi133.stdout: "segexd": 0, 2024-08-31T04:38:52.840 INFO:teuthology.orchestra.run.smithi133.stdout: "expos": 4194304, 2024-08-31T04:38:52.841 INFO:teuthology.orchestra.run.smithi133.stdout: "wrpos": 142050204, 2024-08-31T04:38:52.841 INFO:teuthology.orchestra.run.smithi133.stdout: "rdpos": 142049066, 2024-08-31T04:38:52.841 INFO:teuthology.orchestra.run.smithi133.stdout: "jlat": { 2024-08-31T04:38:52.841 INFO:teuthology.orchestra.run.smithi133.stdout: "avgcount": 0, 2024-08-31T04:38:52.841 INFO:teuthology.orchestra.run.smithi133.stdout: "sum": 0.000000000, 2024-08-31T04:38:52.841 INFO:teuthology.orchestra.run.smithi133.stdout: "avgtime": 0.000000000 2024-08-31T04:38:52.841 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-08-31T04:38:52.841 INFO:teuthology.orchestra.run.smithi133.stdout: "replayed": 69697 2024-08-31T04:38:52.841 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-08-31T04:38:52.841 INFO:teuthology.orchestra.run.smithi133.stdout: "mds_mem": { 2024-08-31T04:38:52.841 INFO:teuthology.orchestra.run.smithi133.stdout: "ino": 13, 2024-08-31T04:38:52.841 INFO:teuthology.orchestra.run.smithi133.stdout: "ino+": 15629, 2024-08-31T04:38:52.841 INFO:teuthology.orchestra.run.smithi133.stdout: "ino-": 15616, 2024-08-31T04:38:52.841 INFO:teuthology.orchestra.run.smithi133.stdout: "dir": 11, 2024-08-31T04:38:52.842 INFO:teuthology.orchestra.run.smithi133.stdout: "dir+": 775, 2024-08-31T04:38:52.842 INFO:teuthology.orchestra.run.smithi133.stdout: "dir-": 764, 2024-08-31T04:38:52.842 INFO:teuthology.orchestra.run.smithi133.stdout: "dn": 13660, 2024-08-31T04:38:52.842 INFO:teuthology.orchestra.run.smithi133.stdout: "dn+": 38914, 2024-08-31T04:38:52.842 INFO:teuthology.orchestra.run.smithi133.stdout: "dn-": 25254, 2024-08-31T04:38:52.842 INFO:teuthology.orchestra.run.smithi133.stdout: "cap": 0, 2024-08-31T04:38:52.842 INFO:teuthology.orchestra.run.smithi133.stdout: "cap+": 0, 2024-08-31T04:38:52.842 INFO:teuthology.orchestra.run.smithi133.stdout: "cap-": 0, 2024-08-31T04:38:52.842 INFO:teuthology.orchestra.run.smithi133.stdout: "rss": 148284, 2024-08-31T04:38:52.843 INFO:teuthology.orchestra.run.smithi133.stdout: "heap": 381743104 2024-08-31T04:38:52.843 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-08-31T04:38:52.843 INFO:teuthology.orchestra.run.smithi133.stdout: "mds_server": { 2024-08-31T04:38:52.843 INFO:teuthology.orchestra.run.smithi133.stdout: "dispatch_client_request": 0, 2024-08-31T04:38:52.843 INFO:teuthology.orchestra.run.smithi133.stdout: "dispatch_server_request": 0, 2024-08-31T04:38:52.843 INFO:teuthology.orchestra.run.smithi133.stdout: "handle_client_request": 0, 2024-08-31T04:38:52.843 INFO:teuthology.orchestra.run.smithi133.stdout: "handle_client_session": 0, 2024-08-31T04:38:52.843 INFO:teuthology.orchestra.run.smithi133.stdout: "handle_peer_request": 0, 2024-08-31T04:38:52.843 INFO:teuthology.orchestra.run.smithi133.stdout: "req_create_latency": { 2024-08-31T04:38:52.843 INFO:teuthology.orchestra.run.smithi133.stdout: "avgcount": 0, 2024-08-31T04:38:52.843 INFO:teuthology.orchestra.run.smithi133.stdout: "sum": 0.000000000, 2024-08-31T04:38:52.843 INFO:teuthology.orchestra.run.smithi133.stdout: "avgtime": 0.000000000 2024-08-31T04:38:52.843 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-08-31T04:38:52.843 INFO:teuthology.orchestra.run.smithi133.stdout: "req_getattr_latency": { 2024-08-31T04:38:52.844 INFO:teuthology.orchestra.run.smithi133.stdout: "avgcount": 0, 2024-08-31T04:38:52.844 INFO:teuthology.orchestra.run.smithi133.stdout: "sum": 0.000000000, 2024-08-31T04:38:52.844 INFO:teuthology.orchestra.run.smithi133.stdout: "avgtime": 0.000000000 2024-08-31T04:38:52.844 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-08-31T04:38:52.844 INFO:teuthology.orchestra.run.smithi133.stdout: "req_getfilelock_latency": { 2024-08-31T04:38:52.844 INFO:teuthology.orchestra.run.smithi133.stdout: "avgcount": 0, 2024-08-31T04:38:52.844 INFO:teuthology.orchestra.run.smithi133.stdout: "sum": 0.000000000, 2024-08-31T04:38:52.844 INFO:teuthology.orchestra.run.smithi133.stdout: "avgtime": 0.000000000 2024-08-31T04:38:52.844 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-08-31T04:38:52.844 INFO:teuthology.orchestra.run.smithi133.stdout: "req_link_latency": { 2024-08-31T04:38:52.844 INFO:teuthology.orchestra.run.smithi133.stdout: "avgcount": 0, 2024-08-31T04:38:52.844 INFO:teuthology.orchestra.run.smithi133.stdout: "sum": 0.000000000, 2024-08-31T04:38:52.845 INFO:teuthology.orchestra.run.smithi133.stdout: "avgtime": 0.000000000 2024-08-31T04:38:52.845 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-08-31T04:38:52.845 INFO:teuthology.orchestra.run.smithi133.stdout: "req_lookup_latency": { 2024-08-31T04:38:52.845 INFO:teuthology.orchestra.run.smithi133.stdout: "avgcount": 0, 2024-08-31T04:38:52.845 INFO:teuthology.orchestra.run.smithi133.stdout: "sum": 0.000000000, 2024-08-31T04:38:52.845 INFO:teuthology.orchestra.run.smithi133.stdout: "avgtime": 0.000000000 2024-08-31T04:38:52.845 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-08-31T04:38:52.845 INFO:teuthology.orchestra.run.smithi133.stdout: "req_lookuphash_latency": { 2024-08-31T04:38:52.845 INFO:teuthology.orchestra.run.smithi133.stdout: "avgcount": 0, 2024-08-31T04:38:52.845 INFO:teuthology.orchestra.run.smithi133.stdout: "sum": 0.000000000, 2024-08-31T04:38:52.845 INFO:teuthology.orchestra.run.smithi133.stdout: "avgtime": 0.000000000 2024-08-31T04:38:52.845 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-08-31T04:38:52.845 INFO:teuthology.orchestra.run.smithi133.stdout: "req_lookupino_latency": { 2024-08-31T04:38:52.845 INFO:teuthology.orchestra.run.smithi133.stdout: "avgcount": 0, 2024-08-31T04:38:52.846 INFO:teuthology.orchestra.run.smithi133.stdout: "sum": 0.000000000, 2024-08-31T04:38:52.846 INFO:teuthology.orchestra.run.smithi133.stdout: "avgtime": 0.000000000 2024-08-31T04:38:52.846 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-08-31T04:38:52.846 INFO:teuthology.orchestra.run.smithi133.stdout: "req_lookupname_latency": { 2024-08-31T04:38:52.846 INFO:teuthology.orchestra.run.smithi133.stdout: "avgcount": 0, 2024-08-31T04:38:52.846 INFO:teuthology.orchestra.run.smithi133.stdout: "sum": 0.000000000, 2024-08-31T04:38:52.846 INFO:teuthology.orchestra.run.smithi133.stdout: "avgtime": 0.000000000 2024-08-31T04:38:52.846 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-08-31T04:38:52.846 INFO:teuthology.orchestra.run.smithi133.stdout: "req_lookupparent_latency": { 2024-08-31T04:38:52.846 INFO:teuthology.orchestra.run.smithi133.stdout: "avgcount": 0, 2024-08-31T04:38:52.846 INFO:teuthology.orchestra.run.smithi133.stdout: "sum": 0.000000000, 2024-08-31T04:38:52.846 INFO:teuthology.orchestra.run.smithi133.stdout: "avgtime": 0.000000000 2024-08-31T04:38:52.846 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-08-31T04:38:52.847 INFO:teuthology.orchestra.run.smithi133.stdout: "req_lookupsnap_latency": { 2024-08-31T04:38:52.847 INFO:teuthology.orchestra.run.smithi133.stdout: "avgcount": 0, 2024-08-31T04:38:52.847 INFO:teuthology.orchestra.run.smithi133.stdout: "sum": 0.000000000, 2024-08-31T04:38:52.847 INFO:teuthology.orchestra.run.smithi133.stdout: "avgtime": 0.000000000 2024-08-31T04:38:52.847 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-08-31T04:38:52.847 INFO:teuthology.orchestra.run.smithi133.stdout: "req_lssnap_latency": { 2024-08-31T04:38:52.848 INFO:teuthology.orchestra.run.smithi133.stdout: "avgcount": 0, 2024-08-31T04:38:52.848 INFO:teuthology.orchestra.run.smithi133.stdout: "sum": 0.000000000, 2024-08-31T04:38:52.848 INFO:teuthology.orchestra.run.smithi133.stdout: "avgtime": 0.000000000 2024-08-31T04:38:52.848 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-08-31T04:38:52.848 INFO:teuthology.orchestra.run.smithi133.stdout: "req_mkdir_latency": { 2024-08-31T04:38:52.848 INFO:teuthology.orchestra.run.smithi133.stdout: "avgcount": 0, 2024-08-31T04:38:52.848 INFO:teuthology.orchestra.run.smithi133.stdout: "sum": 0.000000000, 2024-08-31T04:38:52.848 INFO:teuthology.orchestra.run.smithi133.stdout: "avgtime": 0.000000000 2024-08-31T04:38:52.848 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-08-31T04:38:52.848 INFO:teuthology.orchestra.run.smithi133.stdout: "req_mknod_latency": { 2024-08-31T04:38:52.848 INFO:teuthology.orchestra.run.smithi133.stdout: "avgcount": 0, 2024-08-31T04:38:52.849 INFO:teuthology.orchestra.run.smithi133.stdout: "sum": 0.000000000, 2024-08-31T04:38:52.849 INFO:teuthology.orchestra.run.smithi133.stdout: "avgtime": 0.000000000 2024-08-31T04:38:52.849 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-08-31T04:38:52.849 INFO:teuthology.orchestra.run.smithi133.stdout: "req_mksnap_latency": { 2024-08-31T04:38:52.849 INFO:teuthology.orchestra.run.smithi133.stdout: "avgcount": 0, 2024-08-31T04:38:52.849 INFO:teuthology.orchestra.run.smithi133.stdout: "sum": 0.000000000, 2024-08-31T04:38:52.849 INFO:teuthology.orchestra.run.smithi133.stdout: "avgtime": 0.000000000 2024-08-31T04:38:52.849 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-08-31T04:38:52.849 INFO:teuthology.orchestra.run.smithi133.stdout: "req_open_latency": { 2024-08-31T04:38:52.849 INFO:teuthology.orchestra.run.smithi133.stdout: "avgcount": 0, 2024-08-31T04:38:52.849 INFO:teuthology.orchestra.run.smithi133.stdout: "sum": 0.000000000, 2024-08-31T04:38:52.849 INFO:teuthology.orchestra.run.smithi133.stdout: "avgtime": 0.000000000 2024-08-31T04:38:52.849 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-08-31T04:38:52.850 INFO:teuthology.orchestra.run.smithi133.stdout: "req_readdir_latency": { 2024-08-31T04:38:52.850 INFO:teuthology.orchestra.run.smithi133.stdout: "avgcount": 0, 2024-08-31T04:38:52.850 INFO:teuthology.orchestra.run.smithi133.stdout: "sum": 0.000000000, 2024-08-31T04:38:52.850 INFO:teuthology.orchestra.run.smithi133.stdout: "avgtime": 0.000000000 2024-08-31T04:38:52.850 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-08-31T04:38:52.850 INFO:teuthology.orchestra.run.smithi133.stdout: "req_rename_latency": { 2024-08-31T04:38:52.850 INFO:teuthology.orchestra.run.smithi133.stdout: "avgcount": 0, 2024-08-31T04:38:52.850 INFO:teuthology.orchestra.run.smithi133.stdout: "sum": 0.000000000, 2024-08-31T04:38:52.850 INFO:teuthology.orchestra.run.smithi133.stdout: "avgtime": 0.000000000 2024-08-31T04:38:52.850 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-08-31T04:38:52.850 INFO:teuthology.orchestra.run.smithi133.stdout: "req_renamesnap_latency": { 2024-08-31T04:38:52.850 INFO:teuthology.orchestra.run.smithi133.stdout: "avgcount": 0, 2024-08-31T04:38:52.851 INFO:teuthology.orchestra.run.smithi133.stdout: "sum": 0.000000000, 2024-08-31T04:38:52.851 INFO:teuthology.orchestra.run.smithi133.stdout: "avgtime": 0.000000000 2024-08-31T04:38:52.851 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-08-31T04:38:52.851 INFO:teuthology.orchestra.run.smithi133.stdout: "req_snapdiff_latency": { 2024-08-31T04:38:52.851 INFO:teuthology.orchestra.run.smithi133.stdout: "avgcount": 0, 2024-08-31T04:38:52.851 INFO:teuthology.orchestra.run.smithi133.stdout: "sum": 0.000000000, 2024-08-31T04:38:52.851 INFO:teuthology.orchestra.run.smithi133.stdout: "avgtime": 0.000000000 2024-08-31T04:38:52.851 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-08-31T04:38:52.851 INFO:teuthology.orchestra.run.smithi133.stdout: "req_rmdir_latency": { 2024-08-31T04:38:52.851 INFO:teuthology.orchestra.run.smithi133.stdout: "avgcount": 0, 2024-08-31T04:38:52.851 INFO:teuthology.orchestra.run.smithi133.stdout: "sum": 0.000000000, 2024-08-31T04:38:52.851 INFO:teuthology.orchestra.run.smithi133.stdout: "avgtime": 0.000000000 2024-08-31T04:38:52.852 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-08-31T04:38:52.852 INFO:teuthology.orchestra.run.smithi133.stdout: "req_rmsnap_latency": { 2024-08-31T04:38:52.852 INFO:teuthology.orchestra.run.smithi133.stdout: "avgcount": 0, 2024-08-31T04:38:52.852 INFO:teuthology.orchestra.run.smithi133.stdout: "sum": 0.000000000, 2024-08-31T04:38:52.852 INFO:teuthology.orchestra.run.smithi133.stdout: "avgtime": 0.000000000 2024-08-31T04:38:52.852 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-08-31T04:38:52.852 INFO:teuthology.orchestra.run.smithi133.stdout: "req_rmxattr_latency": { 2024-08-31T04:38:52.852 INFO:teuthology.orchestra.run.smithi133.stdout: "avgcount": 0, 2024-08-31T04:38:52.852 INFO:teuthology.orchestra.run.smithi133.stdout: "sum": 0.000000000, 2024-08-31T04:38:52.853 INFO:teuthology.orchestra.run.smithi133.stdout: "avgtime": 0.000000000 2024-08-31T04:38:52.853 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-08-31T04:38:52.853 INFO:teuthology.orchestra.run.smithi133.stdout: "req_setattr_latency": { 2024-08-31T04:38:52.853 INFO:teuthology.orchestra.run.smithi133.stdout: "avgcount": 0, 2024-08-31T04:38:52.853 INFO:teuthology.orchestra.run.smithi133.stdout: "sum": 0.000000000, 2024-08-31T04:38:52.853 INFO:teuthology.orchestra.run.smithi133.stdout: "avgtime": 0.000000000 2024-08-31T04:38:52.853 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-08-31T04:38:52.853 INFO:teuthology.orchestra.run.smithi133.stdout: "req_setdirlayout_latency": { 2024-08-31T04:38:52.853 INFO:teuthology.orchestra.run.smithi133.stdout: "avgcount": 0, 2024-08-31T04:38:52.853 INFO:teuthology.orchestra.run.smithi133.stdout: "sum": 0.000000000, 2024-08-31T04:38:52.853 INFO:teuthology.orchestra.run.smithi133.stdout: "avgtime": 0.000000000 2024-08-31T04:38:52.853 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-08-31T04:38:52.853 INFO:teuthology.orchestra.run.smithi133.stdout: "req_setfilelock_latency": { 2024-08-31T04:38:52.854 INFO:teuthology.orchestra.run.smithi133.stdout: "avgcount": 0, 2024-08-31T04:38:52.854 INFO:teuthology.orchestra.run.smithi133.stdout: "sum": 0.000000000, 2024-08-31T04:38:52.854 INFO:teuthology.orchestra.run.smithi133.stdout: "avgtime": 0.000000000 2024-08-31T04:38:52.854 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-08-31T04:38:52.854 INFO:teuthology.orchestra.run.smithi133.stdout: "req_setlayout_latency": { 2024-08-31T04:38:52.854 INFO:teuthology.orchestra.run.smithi133.stdout: "avgcount": 0, 2024-08-31T04:38:52.854 INFO:teuthology.orchestra.run.smithi133.stdout: "sum": 0.000000000, 2024-08-31T04:38:52.854 INFO:teuthology.orchestra.run.smithi133.stdout: "avgtime": 0.000000000 2024-08-31T04:38:52.854 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-08-31T04:38:52.855 INFO:teuthology.orchestra.run.smithi133.stdout: "req_setxattr_latency": { 2024-08-31T04:38:52.855 INFO:teuthology.orchestra.run.smithi133.stdout: "avgcount": 0, 2024-08-31T04:38:52.855 INFO:teuthology.orchestra.run.smithi133.stdout: "sum": 0.000000000, 2024-08-31T04:38:52.855 INFO:teuthology.orchestra.run.smithi133.stdout: "avgtime": 0.000000000 2024-08-31T04:38:52.855 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-08-31T04:38:52.855 INFO:teuthology.orchestra.run.smithi133.stdout: "req_symlink_latency": { 2024-08-31T04:38:52.855 INFO:teuthology.orchestra.run.smithi133.stdout: "avgcount": 0, 2024-08-31T04:38:52.855 INFO:teuthology.orchestra.run.smithi133.stdout: "sum": 0.000000000, 2024-08-31T04:38:52.855 INFO:teuthology.orchestra.run.smithi133.stdout: "avgtime": 0.000000000 2024-08-31T04:38:52.855 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-08-31T04:38:52.855 INFO:teuthology.orchestra.run.smithi133.stdout: "req_unlink_latency": { 2024-08-31T04:38:52.855 INFO:teuthology.orchestra.run.smithi133.stdout: "avgcount": 0, 2024-08-31T04:38:52.856 INFO:teuthology.orchestra.run.smithi133.stdout: "sum": 0.000000000, 2024-08-31T04:38:52.856 INFO:teuthology.orchestra.run.smithi133.stdout: "avgtime": 0.000000000 2024-08-31T04:38:52.856 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-08-31T04:38:52.856 INFO:teuthology.orchestra.run.smithi133.stdout: "cap_revoke_eviction": 0, 2024-08-31T04:38:52.856 INFO:teuthology.orchestra.run.smithi133.stdout: "cap_acquisition_throttle": 0, 2024-08-31T04:38:52.856 INFO:teuthology.orchestra.run.smithi133.stdout: "req_getvxattr_latency": { 2024-08-31T04:38:52.856 INFO:teuthology.orchestra.run.smithi133.stdout: "avgcount": 0, 2024-08-31T04:38:52.856 INFO:teuthology.orchestra.run.smithi133.stdout: "sum": 0.000000000, 2024-08-31T04:38:52.856 INFO:teuthology.orchestra.run.smithi133.stdout: "avgtime": 0.000000000 2024-08-31T04:38:52.856 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-08-31T04:38:52.856 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-08-31T04:38:52.856 INFO:teuthology.orchestra.run.smithi133.stdout: "mds_sessions": { 2024-08-31T04:38:52.857 INFO:teuthology.orchestra.run.smithi133.stdout: "session_count": 1, 2024-08-31T04:38:52.857 INFO:teuthology.orchestra.run.smithi133.stdout: "session_add": 2, 2024-08-31T04:38:52.857 INFO:teuthology.orchestra.run.smithi133.stdout: "session_remove": 1, 2024-08-31T04:38:52.857 INFO:teuthology.orchestra.run.smithi133.stdout: "sessions_open": 1, 2024-08-31T04:38:52.857 INFO:teuthology.orchestra.run.smithi133.stdout: "sessions_stale": 0, 2024-08-31T04:38:52.857 INFO:teuthology.orchestra.run.smithi133.stdout: "total_load": 0, 2024-08-31T04:38:52.857 INFO:teuthology.orchestra.run.smithi133.stdout: "average_load": 0, 2024-08-31T04:38:52.857 INFO:teuthology.orchestra.run.smithi133.stdout: "avg_session_uptime": 2191, 2024-08-31T04:38:52.857 INFO:teuthology.orchestra.run.smithi133.stdout: "mdthresh_evicted": 0 2024-08-31T04:38:52.857 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-08-31T04:38:52.857 INFO:teuthology.orchestra.run.smithi133.stdout: "mempool": { 2024-08-31T04:38:52.857 INFO:teuthology.orchestra.run.smithi133.stdout: "bloom_filter_bytes": 0, 2024-08-31T04:38:52.857 INFO:teuthology.orchestra.run.smithi133.stdout: "bloom_filter_items": 0, 2024-08-31T04:38:52.858 INFO:teuthology.orchestra.run.smithi133.stdout: "bluestore_alloc_bytes": 0, 2024-08-31T04:38:52.858 INFO:teuthology.orchestra.run.smithi133.stdout: "bluestore_alloc_items": 0, 2024-08-31T04:38:52.858 INFO:teuthology.orchestra.run.smithi133.stdout: "bluestore_cache_data_bytes": 0, 2024-08-31T04:38:52.858 INFO:teuthology.orchestra.run.smithi133.stdout: "bluestore_cache_data_items": 0, 2024-08-31T04:38:52.858 INFO:teuthology.orchestra.run.smithi133.stdout: "bluestore_cache_onode_bytes": 0, 2024-08-31T04:38:52.858 INFO:teuthology.orchestra.run.smithi133.stdout: "bluestore_cache_onode_items": 0, 2024-08-31T04:38:52.858 INFO:teuthology.orchestra.run.smithi133.stdout: "bluestore_cache_meta_bytes": 0, 2024-08-31T04:38:52.858 INFO:teuthology.orchestra.run.smithi133.stdout: "bluestore_cache_meta_items": 0, 2024-08-31T04:38:52.858 INFO:teuthology.orchestra.run.smithi133.stdout: "bluestore_cache_other_bytes": 0, 2024-08-31T04:38:52.858 INFO:teuthology.orchestra.run.smithi133.stdout: "bluestore_cache_other_items": 0, 2024-08-31T04:38:52.858 INFO:teuthology.orchestra.run.smithi133.stdout: "bluestore_cache_buffer_bytes": 0, 2024-08-31T04:38:52.858 INFO:teuthology.orchestra.run.smithi133.stdout: "bluestore_cache_buffer_items": 0, 2024-08-31T04:38:52.858 INFO:teuthology.orchestra.run.smithi133.stdout: "bluestore_extent_bytes": 0, 2024-08-31T04:38:52.859 INFO:teuthology.orchestra.run.smithi133.stdout: "bluestore_extent_items": 0, 2024-08-31T04:38:52.859 INFO:teuthology.orchestra.run.smithi133.stdout: "bluestore_blob_bytes": 0, 2024-08-31T04:38:52.859 INFO:teuthology.orchestra.run.smithi133.stdout: "bluestore_blob_items": 0, 2024-08-31T04:38:52.859 INFO:teuthology.orchestra.run.smithi133.stdout: "bluestore_shared_blob_bytes": 0, 2024-08-31T04:38:52.859 INFO:teuthology.orchestra.run.smithi133.stdout: "bluestore_shared_blob_items": 0, 2024-08-31T04:38:52.859 INFO:teuthology.orchestra.run.smithi133.stdout: "bluestore_inline_bl_bytes": 0, 2024-08-31T04:38:52.859 INFO:teuthology.orchestra.run.smithi133.stdout: "bluestore_inline_bl_items": 0, 2024-08-31T04:38:52.859 INFO:teuthology.orchestra.run.smithi133.stdout: "bluestore_fsck_bytes": 0, 2024-08-31T04:38:52.859 INFO:teuthology.orchestra.run.smithi133.stdout: "bluestore_fsck_items": 0, 2024-08-31T04:38:52.859 INFO:teuthology.orchestra.run.smithi133.stdout: "bluestore_txc_bytes": 0, 2024-08-31T04:38:52.859 INFO:teuthology.orchestra.run.smithi133.stdout: "bluestore_txc_items": 0, 2024-08-31T04:38:52.859 INFO:teuthology.orchestra.run.smithi133.stdout: "bluestore_writing_deferred_bytes": 0, 2024-08-31T04:38:52.859 INFO:teuthology.orchestra.run.smithi133.stdout: "bluestore_writing_deferred_items": 0, 2024-08-31T04:38:52.860 INFO:teuthology.orchestra.run.smithi133.stdout: "bluestore_writing_bytes": 0, 2024-08-31T04:38:52.860 INFO:teuthology.orchestra.run.smithi133.stdout: "bluestore_writing_items": 0, 2024-08-31T04:38:52.860 INFO:teuthology.orchestra.run.smithi133.stdout: "bluefs_bytes": 0, 2024-08-31T04:38:52.860 INFO:teuthology.orchestra.run.smithi133.stdout: "bluefs_items": 0, 2024-08-31T04:38:52.860 INFO:teuthology.orchestra.run.smithi133.stdout: "bluefs_file_reader_bytes": 0, 2024-08-31T04:38:52.860 INFO:teuthology.orchestra.run.smithi133.stdout: "bluefs_file_reader_items": 0, 2024-08-31T04:38:52.860 INFO:teuthology.orchestra.run.smithi133.stdout: "bluefs_file_writer_bytes": 0, 2024-08-31T04:38:52.860 INFO:teuthology.orchestra.run.smithi133.stdout: "bluefs_file_writer_items": 0, 2024-08-31T04:38:52.860 INFO:teuthology.orchestra.run.smithi133.stdout: "buffer_anon_bytes": 232136, 2024-08-31T04:38:52.860 INFO:teuthology.orchestra.run.smithi133.stdout: "buffer_anon_items": 76, 2024-08-31T04:38:52.860 INFO:teuthology.orchestra.run.smithi133.stdout: "buffer_meta_bytes": 0, 2024-08-31T04:38:52.860 INFO:teuthology.orchestra.run.smithi133.stdout: "buffer_meta_items": 0, 2024-08-31T04:38:52.861 INFO:teuthology.orchestra.run.smithi133.stdout: "osd_bytes": 0, 2024-08-31T04:38:52.861 INFO:teuthology.orchestra.run.smithi133.stdout: "osd_items": 0, 2024-08-31T04:38:52.861 INFO:teuthology.orchestra.run.smithi133.stdout: "osd_mapbl_bytes": 0, 2024-08-31T04:38:52.861 INFO:teuthology.orchestra.run.smithi133.stdout: "osd_mapbl_items": 0, 2024-08-31T04:38:52.861 INFO:teuthology.orchestra.run.smithi133.stdout: "osd_pglog_bytes": 0, 2024-08-31T04:38:52.861 INFO:teuthology.orchestra.run.smithi133.stdout: "osd_pglog_items": 0, 2024-08-31T04:38:52.861 INFO:teuthology.orchestra.run.smithi133.stdout: "osdmap_bytes": 7504, 2024-08-31T04:38:52.861 INFO:teuthology.orchestra.run.smithi133.stdout: "osdmap_items": 155, 2024-08-31T04:38:52.861 INFO:teuthology.orchestra.run.smithi133.stdout: "osdmap_mapping_bytes": 0, 2024-08-31T04:38:52.861 INFO:teuthology.orchestra.run.smithi133.stdout: "osdmap_mapping_items": 0, 2024-08-31T04:38:52.861 INFO:teuthology.orchestra.run.smithi133.stdout: "pgmap_bytes": 0, 2024-08-31T04:38:52.861 INFO:teuthology.orchestra.run.smithi133.stdout: "pgmap_items": 0, 2024-08-31T04:38:52.861 INFO:teuthology.orchestra.run.smithi133.stdout: "mds_co_bytes": 9332392, 2024-08-31T04:38:52.862 INFO:teuthology.orchestra.run.smithi133.stdout: "mds_co_items": 54768, 2024-08-31T04:38:52.862 INFO:teuthology.orchestra.run.smithi133.stdout: "unittest_1_bytes": 0, 2024-08-31T04:38:52.862 INFO:teuthology.orchestra.run.smithi133.stdout: "unittest_1_items": 0, 2024-08-31T04:38:52.862 INFO:teuthology.orchestra.run.smithi133.stdout: "unittest_2_bytes": 0, 2024-08-31T04:38:52.862 INFO:teuthology.orchestra.run.smithi133.stdout: "unittest_2_items": 0 2024-08-31T04:38:52.862 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-08-31T04:38:52.862 INFO:teuthology.orchestra.run.smithi133.stdout: "objecter": { 2024-08-31T04:38:52.862 INFO:teuthology.orchestra.run.smithi133.stdout: "op_active": 0, 2024-08-31T04:38:52.862 INFO:teuthology.orchestra.run.smithi133.stdout: "op_laggy": 0, 2024-08-31T04:38:52.862 INFO:teuthology.orchestra.run.smithi133.stdout: "op_send": 3507, 2024-08-31T04:38:52.862 INFO:teuthology.orchestra.run.smithi133.stdout: "op_send_bytes": 21, 2024-08-31T04:38:52.862 INFO:teuthology.orchestra.run.smithi133.stdout: "op_resend": 3, 2024-08-31T04:38:52.862 INFO:teuthology.orchestra.run.smithi133.stdout: "op_reply": 3507, 2024-08-31T04:38:52.862 INFO:teuthology.orchestra.run.smithi133.stdout: "op_latency": { 2024-08-31T04:38:52.863 INFO:teuthology.orchestra.run.smithi133.stdout: "avgcount": 3507, 2024-08-31T04:38:52.863 INFO:teuthology.orchestra.run.smithi133.stdout: "sum": 15.916694554, 2024-08-31T04:38:52.863 INFO:teuthology.orchestra.run.smithi133.stdout: "avgtime": 0.004538549 2024-08-31T04:38:52.863 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-08-31T04:38:52.863 INFO:teuthology.orchestra.run.smithi133.stdout: "op_inflight": 0, 2024-08-31T04:38:52.863 INFO:teuthology.orchestra.run.smithi133.stdout: "oplen_avg": { 2024-08-31T04:38:52.863 INFO:teuthology.orchestra.run.smithi133.stdout: "avgcount": 3507, 2024-08-31T04:38:52.863 INFO:teuthology.orchestra.run.smithi133.stdout: "sum": 3508 2024-08-31T04:38:52.863 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-08-31T04:38:52.863 INFO:teuthology.orchestra.run.smithi133.stdout: "op": 3507, 2024-08-31T04:38:52.863 INFO:teuthology.orchestra.run.smithi133.stdout: "op_r": 3507, 2024-08-31T04:38:52.863 INFO:teuthology.orchestra.run.smithi133.stdout: "op_w": 0, 2024-08-31T04:38:52.863 INFO:teuthology.orchestra.run.smithi133.stdout: "op_rmw": 0, 2024-08-31T04:38:52.864 INFO:teuthology.orchestra.run.smithi133.stdout: "op_pg": 0, 2024-08-31T04:38:52.864 INFO:teuthology.orchestra.run.smithi133.stdout: "osdop_stat": 2083, 2024-08-31T04:38:52.864 INFO:teuthology.orchestra.run.smithi133.stdout: "osdop_create": 0, 2024-08-31T04:38:52.864 INFO:teuthology.orchestra.run.smithi133.stdout: "osdop_read": 1422, 2024-08-31T04:38:52.864 INFO:teuthology.orchestra.run.smithi133.stdout: "osdop_write": 0, 2024-08-31T04:38:52.864 INFO:teuthology.orchestra.run.smithi133.stdout: "osdop_writefull": 0, 2024-08-31T04:38:52.864 INFO:teuthology.orchestra.run.smithi133.stdout: "osdop_writesame": 0, 2024-08-31T04:38:52.864 INFO:teuthology.orchestra.run.smithi133.stdout: "osdop_append": 0, 2024-08-31T04:38:52.864 INFO:teuthology.orchestra.run.smithi133.stdout: "osdop_zero": 0, 2024-08-31T04:38:52.864 INFO:teuthology.orchestra.run.smithi133.stdout: "osdop_truncate": 0, 2024-08-31T04:38:52.864 INFO:teuthology.orchestra.run.smithi133.stdout: "osdop_delete": 0, 2024-08-31T04:38:52.864 INFO:teuthology.orchestra.run.smithi133.stdout: "osdop_mapext": 0, 2024-08-31T04:38:52.864 INFO:teuthology.orchestra.run.smithi133.stdout: "osdop_sparse_read": 0, 2024-08-31T04:38:52.864 INFO:teuthology.orchestra.run.smithi133.stdout: "osdop_clonerange": 0, 2024-08-31T04:38:52.865 INFO:teuthology.orchestra.run.smithi133.stdout: "osdop_getxattr": 1, 2024-08-31T04:38:52.865 INFO:teuthology.orchestra.run.smithi133.stdout: "osdop_setxattr": 0, 2024-08-31T04:38:52.865 INFO:teuthology.orchestra.run.smithi133.stdout: "osdop_cmpxattr": 0, 2024-08-31T04:38:52.865 INFO:teuthology.orchestra.run.smithi133.stdout: "osdop_rmxattr": 0, 2024-08-31T04:38:52.865 INFO:teuthology.orchestra.run.smithi133.stdout: "osdop_resetxattrs": 0, 2024-08-31T04:38:52.865 INFO:teuthology.orchestra.run.smithi133.stdout: "osdop_call": 0, 2024-08-31T04:38:52.865 INFO:teuthology.orchestra.run.smithi133.stdout: "osdop_watch": 0, 2024-08-31T04:38:52.865 INFO:teuthology.orchestra.run.smithi133.stdout: "osdop_notify": 0, 2024-08-31T04:38:52.865 INFO:teuthology.orchestra.run.smithi133.stdout: "osdop_src_cmpxattr": 0, 2024-08-31T04:38:52.865 INFO:teuthology.orchestra.run.smithi133.stdout: "osdop_pgls": 0, 2024-08-31T04:38:52.865 INFO:teuthology.orchestra.run.smithi133.stdout: "osdop_pgls_filter": 0, 2024-08-31T04:38:52.865 INFO:teuthology.orchestra.run.smithi133.stdout: "osdop_other": 0, 2024-08-31T04:38:52.865 INFO:teuthology.orchestra.run.smithi133.stdout: "linger_active": 0, 2024-08-31T04:38:52.866 INFO:teuthology.orchestra.run.smithi133.stdout: "linger_send": 0, 2024-08-31T04:38:52.866 INFO:teuthology.orchestra.run.smithi133.stdout: "linger_resend": 0, 2024-08-31T04:38:52.866 INFO:teuthology.orchestra.run.smithi133.stdout: "linger_ping": 0, 2024-08-31T04:38:52.866 INFO:teuthology.orchestra.run.smithi133.stdout: "poolop_active": 0, 2024-08-31T04:38:52.866 INFO:teuthology.orchestra.run.smithi133.stdout: "poolop_send": 0, 2024-08-31T04:38:52.866 INFO:teuthology.orchestra.run.smithi133.stdout: "poolop_resend": 0, 2024-08-31T04:38:52.866 INFO:teuthology.orchestra.run.smithi133.stdout: "poolstat_active": 0, 2024-08-31T04:38:52.866 INFO:teuthology.orchestra.run.smithi133.stdout: "poolstat_send": 0, 2024-08-31T04:38:52.866 INFO:teuthology.orchestra.run.smithi133.stdout: "poolstat_resend": 0, 2024-08-31T04:38:52.866 INFO:teuthology.orchestra.run.smithi133.stdout: "statfs_active": 0, 2024-08-31T04:38:52.866 INFO:teuthology.orchestra.run.smithi133.stdout: "statfs_send": 0, 2024-08-31T04:38:52.866 INFO:teuthology.orchestra.run.smithi133.stdout: "statfs_resend": 0, 2024-08-31T04:38:52.866 INFO:teuthology.orchestra.run.smithi133.stdout: "command_active": 0, 2024-08-31T04:38:52.866 INFO:teuthology.orchestra.run.smithi133.stdout: "command_send": 0, 2024-08-31T04:38:52.867 INFO:teuthology.orchestra.run.smithi133.stdout: "command_resend": 0, 2024-08-31T04:38:52.867 INFO:teuthology.orchestra.run.smithi133.stdout: "map_epoch": 80, 2024-08-31T04:38:52.867 INFO:teuthology.orchestra.run.smithi133.stdout: "map_full": 0, 2024-08-31T04:38:52.867 INFO:teuthology.orchestra.run.smithi133.stdout: "map_inc": 2, 2024-08-31T04:38:52.867 INFO:teuthology.orchestra.run.smithi133.stdout: "osd_sessions": 10, 2024-08-31T04:38:52.867 INFO:teuthology.orchestra.run.smithi133.stdout: "osd_session_open": 10, 2024-08-31T04:38:52.867 INFO:teuthology.orchestra.run.smithi133.stdout: "osd_session_close": 0, 2024-08-31T04:38:52.867 INFO:teuthology.orchestra.run.smithi133.stdout: "osd_laggy": 0, 2024-08-31T04:38:52.867 INFO:teuthology.orchestra.run.smithi133.stdout: "omap_wr": 0, 2024-08-31T04:38:52.867 INFO:teuthology.orchestra.run.smithi133.stdout: "omap_rd": 2, 2024-08-31T04:38:52.867 INFO:teuthology.orchestra.run.smithi133.stdout: "omap_del": 0 2024-08-31T04:38:52.867 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-08-31T04:38:52.867 INFO:teuthology.orchestra.run.smithi133.stdout: "oft": { 2024-08-31T04:38:52.867 INFO:teuthology.orchestra.run.smithi133.stdout: "omap_total_objs": 0, 2024-08-31T04:38:52.868 INFO:teuthology.orchestra.run.smithi133.stdout: "omap_total_kv_pairs": 0, 2024-08-31T04:38:52.868 INFO:teuthology.orchestra.run.smithi133.stdout: "omap_total_updates": 0, 2024-08-31T04:38:52.868 INFO:teuthology.orchestra.run.smithi133.stdout: "omap_total_removes": 0 2024-08-31T04:38:52.868 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-08-31T04:38:52.868 INFO:teuthology.orchestra.run.smithi133.stdout: "purge_queue": { 2024-08-31T04:38:52.868 INFO:teuthology.orchestra.run.smithi133.stdout: "pq_executing_ops": 0, 2024-08-31T04:38:52.868 INFO:teuthology.orchestra.run.smithi133.stdout: "pq_executing_ops_high_water": 0, 2024-08-31T04:38:52.868 INFO:teuthology.orchestra.run.smithi133.stdout: "pq_executing": 0, 2024-08-31T04:38:52.868 INFO:teuthology.orchestra.run.smithi133.stdout: "pq_executing_high_water": 0, 2024-08-31T04:38:52.868 INFO:teuthology.orchestra.run.smithi133.stdout: "pq_executed_ops": 0, 2024-08-31T04:38:52.868 INFO:teuthology.orchestra.run.smithi133.stdout: "pq_executed": 0, 2024-08-31T04:38:52.868 INFO:teuthology.orchestra.run.smithi133.stdout: "pq_item_in_journal": 0 2024-08-31T04:38:52.868 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-08-31T04:38:52.869 INFO:teuthology.orchestra.run.smithi133.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-08-31T04:38:52.869 INFO:teuthology.orchestra.run.smithi133.stdout: "val": 0, 2024-08-31T04:38:52.869 INFO:teuthology.orchestra.run.smithi133.stdout: "max": 104857600, 2024-08-31T04:38:52.869 INFO:teuthology.orchestra.run.smithi133.stdout: "get_started": 0, 2024-08-31T04:38:52.869 INFO:teuthology.orchestra.run.smithi133.stdout: "get": 3864, 2024-08-31T04:38:52.869 INFO:teuthology.orchestra.run.smithi133.stdout: "get_sum": 139328886, 2024-08-31T04:38:52.869 INFO:teuthology.orchestra.run.smithi133.stdout: "get_or_fail_fail": 0, 2024-08-31T04:38:52.869 INFO:teuthology.orchestra.run.smithi133.stdout: "get_or_fail_success": 3864, 2024-08-31T04:38:52.869 INFO:teuthology.orchestra.run.smithi133.stdout: "take": 0, 2024-08-31T04:38:52.869 INFO:teuthology.orchestra.run.smithi133.stdout: "take_sum": 0, 2024-08-31T04:38:52.869 INFO:teuthology.orchestra.run.smithi133.stdout: "put": 3864, 2024-08-31T04:38:52.869 INFO:teuthology.orchestra.run.smithi133.stdout: "put_sum": 139328886, 2024-08-31T04:38:52.869 INFO:teuthology.orchestra.run.smithi133.stdout: "wait": { 2024-08-31T04:38:52.870 INFO:teuthology.orchestra.run.smithi133.stdout: "avgcount": 0, 2024-08-31T04:38:52.870 INFO:teuthology.orchestra.run.smithi133.stdout: "sum": 0.000000000, 2024-08-31T04:38:52.870 INFO:teuthology.orchestra.run.smithi133.stdout: "avgtime": 0.000000000 2024-08-31T04:38:52.870 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-08-31T04:38:52.870 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-08-31T04:38:52.870 INFO:teuthology.orchestra.run.smithi133.stdout: "throttle-objecter_bytes": { 2024-08-31T04:38:52.870 INFO:teuthology.orchestra.run.smithi133.stdout: "val": 0, 2024-08-31T04:38:52.870 INFO:teuthology.orchestra.run.smithi133.stdout: "max": 104857600, 2024-08-31T04:38:52.870 INFO:teuthology.orchestra.run.smithi133.stdout: "get_started": 0, 2024-08-31T04:38:52.870 INFO:teuthology.orchestra.run.smithi133.stdout: "get": 0, 2024-08-31T04:38:52.870 INFO:teuthology.orchestra.run.smithi133.stdout: "get_sum": 0, 2024-08-31T04:38:52.870 INFO:teuthology.orchestra.run.smithi133.stdout: "get_or_fail_fail": 0, 2024-08-31T04:38:52.870 INFO:teuthology.orchestra.run.smithi133.stdout: "get_or_fail_success": 0, 2024-08-31T04:38:52.870 INFO:teuthology.orchestra.run.smithi133.stdout: "take": 3507, 2024-08-31T04:38:52.871 INFO:teuthology.orchestra.run.smithi133.stdout: "take_sum": 137869134, 2024-08-31T04:38:52.871 INFO:teuthology.orchestra.run.smithi133.stdout: "put": 3507, 2024-08-31T04:38:52.871 INFO:teuthology.orchestra.run.smithi133.stdout: "put_sum": 137869134, 2024-08-31T04:38:52.871 INFO:teuthology.orchestra.run.smithi133.stdout: "wait": { 2024-08-31T04:38:52.871 INFO:teuthology.orchestra.run.smithi133.stdout: "avgcount": 0, 2024-08-31T04:38:52.871 INFO:teuthology.orchestra.run.smithi133.stdout: "sum": 0.000000000, 2024-08-31T04:38:52.871 INFO:teuthology.orchestra.run.smithi133.stdout: "avgtime": 0.000000000 2024-08-31T04:38:52.871 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-08-31T04:38:52.871 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-08-31T04:38:52.871 INFO:teuthology.orchestra.run.smithi133.stdout: "throttle-objecter_ops": { 2024-08-31T04:38:52.871 INFO:teuthology.orchestra.run.smithi133.stdout: "val": 0, 2024-08-31T04:38:52.871 INFO:teuthology.orchestra.run.smithi133.stdout: "max": 1024, 2024-08-31T04:38:52.872 INFO:teuthology.orchestra.run.smithi133.stdout: "get_started": 0, 2024-08-31T04:38:52.872 INFO:teuthology.orchestra.run.smithi133.stdout: "get": 0, 2024-08-31T04:38:52.872 INFO:teuthology.orchestra.run.smithi133.stdout: "get_sum": 0, 2024-08-31T04:38:52.872 INFO:teuthology.orchestra.run.smithi133.stdout: "get_or_fail_fail": 0, 2024-08-31T04:38:52.872 INFO:teuthology.orchestra.run.smithi133.stdout: "get_or_fail_success": 0, 2024-08-31T04:38:52.872 INFO:teuthology.orchestra.run.smithi133.stdout: "take": 3507, 2024-08-31T04:38:52.872 INFO:teuthology.orchestra.run.smithi133.stdout: "take_sum": 3507, 2024-08-31T04:38:52.872 INFO:teuthology.orchestra.run.smithi133.stdout: "put": 3507, 2024-08-31T04:38:52.872 INFO:teuthology.orchestra.run.smithi133.stdout: "put_sum": 3507, 2024-08-31T04:38:52.872 INFO:teuthology.orchestra.run.smithi133.stdout: "wait": { 2024-08-31T04:38:52.872 INFO:teuthology.orchestra.run.smithi133.stdout: "avgcount": 0, 2024-08-31T04:38:52.872 INFO:teuthology.orchestra.run.smithi133.stdout: "sum": 0.000000000, 2024-08-31T04:38:52.872 INFO:teuthology.orchestra.run.smithi133.stdout: "avgtime": 0.000000000 2024-08-31T04:38:52.873 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-08-31T04:38:52.873 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-08-31T04:38:52.873 INFO:teuthology.orchestra.run.smithi133.stdout: "throttle-write_buf_throttle": { 2024-08-31T04:38:52.873 INFO:teuthology.orchestra.run.smithi133.stdout: "val": 0, 2024-08-31T04:38:52.873 INFO:teuthology.orchestra.run.smithi133.stdout: "max": 3758096384, 2024-08-31T04:38:52.873 INFO:teuthology.orchestra.run.smithi133.stdout: "get_started": 0, 2024-08-31T04:38:52.873 INFO:teuthology.orchestra.run.smithi133.stdout: "get": 0, 2024-08-31T04:38:52.873 INFO:teuthology.orchestra.run.smithi133.stdout: "get_sum": 0, 2024-08-31T04:38:52.873 INFO:teuthology.orchestra.run.smithi133.stdout: "get_or_fail_fail": 0, 2024-08-31T04:38:52.873 INFO:teuthology.orchestra.run.smithi133.stdout: "get_or_fail_success": 0, 2024-08-31T04:38:52.873 INFO:teuthology.orchestra.run.smithi133.stdout: "take": 0, 2024-08-31T04:38:52.873 INFO:teuthology.orchestra.run.smithi133.stdout: "take_sum": 0, 2024-08-31T04:38:52.873 INFO:teuthology.orchestra.run.smithi133.stdout: "put": 0, 2024-08-31T04:38:52.873 INFO:teuthology.orchestra.run.smithi133.stdout: "put_sum": 0, 2024-08-31T04:38:52.874 INFO:teuthology.orchestra.run.smithi133.stdout: "wait": { 2024-08-31T04:38:52.874 INFO:teuthology.orchestra.run.smithi133.stdout: "avgcount": 0, 2024-08-31T04:38:52.874 INFO:teuthology.orchestra.run.smithi133.stdout: "sum": 0.000000000, 2024-08-31T04:38:52.874 INFO:teuthology.orchestra.run.smithi133.stdout: "avgtime": 0.000000000 2024-08-31T04:38:52.874 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-08-31T04:38:52.874 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-08-31T04:38:52.874 INFO:teuthology.orchestra.run.smithi133.stdout: "throttle-write_buf_throttle-0x5639ac422c30": { 2024-08-31T04:38:52.874 INFO:teuthology.orchestra.run.smithi133.stdout: "val": 0, 2024-08-31T04:38:52.874 INFO:teuthology.orchestra.run.smithi133.stdout: "max": 3758096384, 2024-08-31T04:38:52.874 INFO:teuthology.orchestra.run.smithi133.stdout: "get_started": 0, 2024-08-31T04:38:52.874 INFO:teuthology.orchestra.run.smithi133.stdout: "get": 0, 2024-08-31T04:38:52.874 INFO:teuthology.orchestra.run.smithi133.stdout: "get_sum": 0, 2024-08-31T04:38:52.874 INFO:teuthology.orchestra.run.smithi133.stdout: "get_or_fail_fail": 0, 2024-08-31T04:38:52.875 INFO:teuthology.orchestra.run.smithi133.stdout: "get_or_fail_success": 0, 2024-08-31T04:38:52.875 INFO:teuthology.orchestra.run.smithi133.stdout: "take": 0, 2024-08-31T04:38:52.875 INFO:teuthology.orchestra.run.smithi133.stdout: "take_sum": 0, 2024-08-31T04:38:52.875 INFO:teuthology.orchestra.run.smithi133.stdout: "put": 0, 2024-08-31T04:38:52.875 INFO:teuthology.orchestra.run.smithi133.stdout: "put_sum": 0, 2024-08-31T04:38:52.875 INFO:teuthology.orchestra.run.smithi133.stdout: "wait": { 2024-08-31T04:38:52.875 INFO:teuthology.orchestra.run.smithi133.stdout: "avgcount": 0, 2024-08-31T04:38:52.875 INFO:teuthology.orchestra.run.smithi133.stdout: "sum": 0.000000000, 2024-08-31T04:38:52.875 INFO:teuthology.orchestra.run.smithi133.stdout: "avgtime": 0.000000000 2024-08-31T04:38:52.875 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-08-31T04:38:52.875 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-08-31T04:38:52.875 INFO:teuthology.orchestra.run.smithi133.stdout: "trackedop": { 2024-08-31T04:38:52.875 INFO:teuthology.orchestra.run.smithi133.stdout: "slow_ops_count": 0 2024-08-31T04:38:52.875 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-08-31T04:38:52.876 INFO:teuthology.orchestra.run.smithi133.stdout:} 2024-08-31T04:38:53.652 INFO:tasks.check_counter:Daemon mds.k mds.exported=0 2024-08-31T04:38:53.652 INFO:tasks.check_counter:Daemon mds.k mds.imported=0 2024-08-31T04:38:53.652 INFO:tasks.check_counter:Daemon mds.k mds_cache.dir_update=0 2024-08-31T04:38:53.652 INFO:tasks.check_counter:Daemon mds.k mds_cache.dir_update_receipt=0 2024-08-31T04:38:53.652 INFO:tasks.check_counter:Daemon mds.k mds.dir_split=0 2024-08-31T04:38:53.652 DEBUG:tasks.check_counter:Getting stats from c 2024-08-31T04:38:53.653 DEBUG:teuthology.orchestra.run.smithi177:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 058d9fc6-674f-11ef-bcd4-c7b262605968 -- ceph daemon mds.c perf dump 2024-08-31T04:38:53.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:38:53 smithi133 ceph-mon[22177]: pgmap v848: 97 pgs: 97 active+clean; 592 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 426 B/s wr, 12 op/s 2024-08-31T04:38:53.950 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:38:53 smithi050 ceph-mon[17259]: pgmap v848: 97 pgs: 97 active+clean; 592 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 426 B/s wr, 12 op/s 2024-08-31T04:38:53.996 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:38:53 smithi177 ceph-mon[22025]: pgmap v848: 97 pgs: 97 active+clean; 592 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 426 B/s wr, 12 op/s 2024-08-31T04:38:54.018 INFO:teuthology.orchestra.run.smithi177.stderr:Inferring config /var/lib/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/mon.c/config 2024-08-31T04:38:54.830 INFO:teuthology.orchestra.run.smithi177.stdout:{ 2024-08-31T04:38:54.830 INFO:teuthology.orchestra.run.smithi177.stdout: "AsyncMessenger::Worker-0": { 2024-08-31T04:38:54.831 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_recv_messages": 20005, 2024-08-31T04:38:54.831 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_send_messages": 21272, 2024-08-31T04:38:54.831 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_recv_bytes": 8408690, 2024-08-31T04:38:54.831 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_send_bytes": 70472579, 2024-08-31T04:38:54.831 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_created_connections": 13, 2024-08-31T04:38:54.831 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_active_connections": 7, 2024-08-31T04:38:54.831 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_running_total_time": 1.897719147, 2024-08-31T04:38:54.831 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_running_send_time": 0.999926073, 2024-08-31T04:38:54.831 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_running_recv_time": 0.646581691, 2024-08-31T04:38:54.831 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_running_fast_dispatch_time": 0.282684519, 2024-08-31T04:38:54.831 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_send_messages_queue_lat": { 2024-08-31T04:38:54.831 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 21270, 2024-08-31T04:38:54.831 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.851595175, 2024-08-31T04:38:54.832 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000040037 2024-08-31T04:38:54.832 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-08-31T04:38:54.832 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_handle_ack_lat": { 2024-08-31T04:38:54.832 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 22309, 2024-08-31T04:38:54.832 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.004316684, 2024-08-31T04:38:54.832 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000000193 2024-08-31T04:38:54.832 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-08-31T04:38:54.832 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_recv_encrypted_bytes": 0, 2024-08-31T04:38:54.832 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_send_encrypted_bytes": 0 2024-08-31T04:38:54.832 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-08-31T04:38:54.832 INFO:teuthology.orchestra.run.smithi177.stdout: "AsyncMessenger::Worker-1": { 2024-08-31T04:38:54.832 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_recv_messages": 52938, 2024-08-31T04:38:54.832 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_send_messages": 53138, 2024-08-31T04:38:54.833 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_recv_bytes": 21248500, 2024-08-31T04:38:54.833 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_send_bytes": 42096629, 2024-08-31T04:38:54.833 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_created_connections": 9, 2024-08-31T04:38:54.833 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_active_connections": 6, 2024-08-31T04:38:54.833 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_running_total_time": 3.467050847, 2024-08-31T04:38:54.833 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_running_send_time": 1.692984952, 2024-08-31T04:38:54.833 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_running_recv_time": 1.965298674, 2024-08-31T04:38:54.833 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_running_fast_dispatch_time": 0.159037684, 2024-08-31T04:38:54.833 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_send_messages_queue_lat": { 2024-08-31T04:38:54.833 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 53139, 2024-08-31T04:38:54.834 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 2.212692232, 2024-08-31T04:38:54.834 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000041639 2024-08-31T04:38:54.834 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-08-31T04:38:54.834 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_handle_ack_lat": { 2024-08-31T04:38:54.834 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 92893, 2024-08-31T04:38:54.834 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.015042376, 2024-08-31T04:38:54.834 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000000161 2024-08-31T04:38:54.834 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-08-31T04:38:54.834 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_recv_encrypted_bytes": 3152, 2024-08-31T04:38:54.834 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_send_encrypted_bytes": 484288 2024-08-31T04:38:54.834 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-08-31T04:38:54.834 INFO:teuthology.orchestra.run.smithi177.stdout: "AsyncMessenger::Worker-2": { 2024-08-31T04:38:54.835 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_recv_messages": 153452, 2024-08-31T04:38:54.835 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_send_messages": 215361, 2024-08-31T04:38:54.835 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_recv_bytes": 53221960, 2024-08-31T04:38:54.835 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_send_bytes": 153989634, 2024-08-31T04:38:54.835 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_created_connections": 16, 2024-08-31T04:38:54.835 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_active_connections": 9, 2024-08-31T04:38:54.835 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_running_total_time": 9.327379480, 2024-08-31T04:38:54.835 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_running_send_time": 5.819505770, 2024-08-31T04:38:54.835 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_running_recv_time": 5.228975819, 2024-08-31T04:38:54.835 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_running_fast_dispatch_time": 0.149170381, 2024-08-31T04:38:54.835 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_send_messages_queue_lat": { 2024-08-31T04:38:54.835 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 215358, 2024-08-31T04:38:54.835 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 143277.850608464, 2024-08-31T04:38:54.836 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.665300804 2024-08-31T04:38:54.836 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-08-31T04:38:54.836 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_handle_ack_lat": { 2024-08-31T04:38:54.836 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 154402, 2024-08-31T04:38:54.836 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.040795955, 2024-08-31T04:38:54.836 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000000264 2024-08-31T04:38:54.836 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-08-31T04:38:54.836 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_recv_encrypted_bytes": 860768, 2024-08-31T04:38:54.836 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_send_encrypted_bytes": 199888 2024-08-31T04:38:54.837 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-08-31T04:38:54.837 INFO:teuthology.orchestra.run.smithi177.stdout: "cct": { 2024-08-31T04:38:54.837 INFO:teuthology.orchestra.run.smithi177.stdout: "total_workers": 1, 2024-08-31T04:38:54.837 INFO:teuthology.orchestra.run.smithi177.stdout: "unhealthy_workers": 0 2024-08-31T04:38:54.837 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-08-31T04:38:54.837 INFO:teuthology.orchestra.run.smithi177.stdout: "finisher-MDSRank": { 2024-08-31T04:38:54.837 INFO:teuthology.orchestra.run.smithi177.stdout: "queue_len": 0, 2024-08-31T04:38:54.837 INFO:teuthology.orchestra.run.smithi177.stdout: "complete_latency": { 2024-08-31T04:38:54.837 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 6500, 2024-08-31T04:38:54.837 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 30.842599884, 2024-08-31T04:38:54.837 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.004745015 2024-08-31T04:38:54.837 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-08-31T04:38:54.837 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-08-31T04:38:54.838 INFO:teuthology.orchestra.run.smithi177.stdout: "finisher-PurgeQueue": { 2024-08-31T04:38:54.838 INFO:teuthology.orchestra.run.smithi177.stdout: "queue_len": 0, 2024-08-31T04:38:54.838 INFO:teuthology.orchestra.run.smithi177.stdout: "complete_latency": { 2024-08-31T04:38:54.838 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 21417, 2024-08-31T04:38:54.838 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 2.841464429, 2024-08-31T04:38:54.838 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000132673 2024-08-31T04:38:54.838 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-08-31T04:38:54.838 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-08-31T04:38:54.838 INFO:teuthology.orchestra.run.smithi177.stdout: "mds": { 2024-08-31T04:38:54.838 INFO:teuthology.orchestra.run.smithi177.stdout: "request": 70589, 2024-08-31T04:38:54.838 INFO:teuthology.orchestra.run.smithi177.stdout: "reply": 69488, 2024-08-31T04:38:54.838 INFO:teuthology.orchestra.run.smithi177.stdout: "reply_latency": { 2024-08-31T04:38:54.838 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 69488, 2024-08-31T04:38:54.839 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 1369.168125149, 2024-08-31T04:38:54.839 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.019703662 2024-08-31T04:38:54.839 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-08-31T04:38:54.839 INFO:teuthology.orchestra.run.smithi177.stdout: "slow_reply": 1, 2024-08-31T04:38:54.839 INFO:teuthology.orchestra.run.smithi177.stdout: "forward": 1101, 2024-08-31T04:38:54.839 INFO:teuthology.orchestra.run.smithi177.stdout: "dir_fetch_complete": 34, 2024-08-31T04:38:54.839 INFO:teuthology.orchestra.run.smithi177.stdout: "dir_fetch_keys": 0, 2024-08-31T04:38:54.839 INFO:teuthology.orchestra.run.smithi177.stdout: "dir_commit": 327, 2024-08-31T04:38:54.839 INFO:teuthology.orchestra.run.smithi177.stdout: "dir_split": 35, 2024-08-31T04:38:54.839 INFO:teuthology.orchestra.run.smithi177.stdout: "dir_merge": 5, 2024-08-31T04:38:54.840 INFO:teuthology.orchestra.run.smithi177.stdout: "inodes": 31, 2024-08-31T04:38:54.840 INFO:teuthology.orchestra.run.smithi177.stdout: "inodes_top": 11, 2024-08-31T04:38:54.840 INFO:teuthology.orchestra.run.smithi177.stdout: "inodes_bottom": 10, 2024-08-31T04:38:54.840 INFO:teuthology.orchestra.run.smithi177.stdout: "inodes_pin_tail": 10, 2024-08-31T04:38:54.840 INFO:teuthology.orchestra.run.smithi177.stdout: "inodes_pinned": 13, 2024-08-31T04:38:54.840 INFO:teuthology.orchestra.run.smithi177.stdout: "inodes_expired": 13014, 2024-08-31T04:38:54.840 INFO:teuthology.orchestra.run.smithi177.stdout: "inodes_with_caps": 1, 2024-08-31T04:38:54.840 INFO:teuthology.orchestra.run.smithi177.stdout: "caps": 1, 2024-08-31T04:38:54.840 INFO:teuthology.orchestra.run.smithi177.stdout: "subtrees": 4, 2024-08-31T04:38:54.841 INFO:teuthology.orchestra.run.smithi177.stdout: "traverse": 131881, 2024-08-31T04:38:54.841 INFO:teuthology.orchestra.run.smithi177.stdout: "traverse_hit": 110281, 2024-08-31T04:38:54.841 INFO:teuthology.orchestra.run.smithi177.stdout: "traverse_forward": 983, 2024-08-31T04:38:54.841 INFO:teuthology.orchestra.run.smithi177.stdout: "traverse_discover": 1154, 2024-08-31T04:38:54.841 INFO:teuthology.orchestra.run.smithi177.stdout: "traverse_dir_fetch": 0, 2024-08-31T04:38:54.841 INFO:teuthology.orchestra.run.smithi177.stdout: "traverse_remote_ino": 0, 2024-08-31T04:38:54.841 INFO:teuthology.orchestra.run.smithi177.stdout: "traverse_lock": 485, 2024-08-31T04:38:54.841 INFO:teuthology.orchestra.run.smithi177.stdout: "load_cent": 0, 2024-08-31T04:38:54.841 INFO:teuthology.orchestra.run.smithi177.stdout: "q": 0, 2024-08-31T04:38:54.841 INFO:teuthology.orchestra.run.smithi177.stdout: "exported": 236, 2024-08-31T04:38:54.841 INFO:teuthology.orchestra.run.smithi177.stdout: "exported_inodes": 7796, 2024-08-31T04:38:54.841 INFO:teuthology.orchestra.run.smithi177.stdout: "imported": 243, 2024-08-31T04:38:54.841 INFO:teuthology.orchestra.run.smithi177.stdout: "imported_inodes": 13799, 2024-08-31T04:38:54.841 INFO:teuthology.orchestra.run.smithi177.stdout: "openino_dir_fetch": 0, 2024-08-31T04:38:54.842 INFO:teuthology.orchestra.run.smithi177.stdout: "openino_backtrace_fetch": 0, 2024-08-31T04:38:54.842 INFO:teuthology.orchestra.run.smithi177.stdout: "openino_peer_discover": 0, 2024-08-31T04:38:54.842 INFO:teuthology.orchestra.run.smithi177.stdout: "root_rfiles": 21361, 2024-08-31T04:38:54.842 INFO:teuthology.orchestra.run.smithi177.stdout: "root_rbytes": 475116081, 2024-08-31T04:38:54.842 INFO:teuthology.orchestra.run.smithi177.stdout: "root_rsnaps": 0, 2024-08-31T04:38:54.842 INFO:teuthology.orchestra.run.smithi177.stdout: "scrub_backtrace_fetch": 0, 2024-08-31T04:38:54.843 INFO:teuthology.orchestra.run.smithi177.stdout: "scrub_set_tag": 0, 2024-08-31T04:38:54.843 INFO:teuthology.orchestra.run.smithi177.stdout: "scrub_backtrace_repaired": 0, 2024-08-31T04:38:54.843 INFO:teuthology.orchestra.run.smithi177.stdout: "scrub_inotable_repaired": 0, 2024-08-31T04:38:54.843 INFO:teuthology.orchestra.run.smithi177.stdout: "scrub_dir_inodes": 0, 2024-08-31T04:38:54.843 INFO:teuthology.orchestra.run.smithi177.stdout: "scrub_dir_base_inodes": 0, 2024-08-31T04:38:54.843 INFO:teuthology.orchestra.run.smithi177.stdout: "scrub_dirfrag_rstats": 0, 2024-08-31T04:38:54.843 INFO:teuthology.orchestra.run.smithi177.stdout: "scrub_file_inodes": 0, 2024-08-31T04:38:54.843 INFO:teuthology.orchestra.run.smithi177.stdout: "handle_inode_file_caps": 568, 2024-08-31T04:38:54.843 INFO:teuthology.orchestra.run.smithi177.stdout: "ceph_cap_op_revoke": 36699, 2024-08-31T04:38:54.843 INFO:teuthology.orchestra.run.smithi177.stdout: "ceph_cap_op_grant": 30660, 2024-08-31T04:38:54.843 INFO:teuthology.orchestra.run.smithi177.stdout: "ceph_cap_op_trunc": 0, 2024-08-31T04:38:54.843 INFO:teuthology.orchestra.run.smithi177.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-08-31T04:38:54.843 INFO:teuthology.orchestra.run.smithi177.stdout: "ceph_cap_op_flush_ack": 0, 2024-08-31T04:38:54.843 INFO:teuthology.orchestra.run.smithi177.stdout: "handle_client_caps": 38882, 2024-08-31T04:38:54.844 INFO:teuthology.orchestra.run.smithi177.stdout: "handle_client_caps_dirty": 9721, 2024-08-31T04:38:54.844 INFO:teuthology.orchestra.run.smithi177.stdout: "handle_client_cap_release": 5576, 2024-08-31T04:38:54.844 INFO:teuthology.orchestra.run.smithi177.stdout: "process_request_cap_release": 24496 2024-08-31T04:38:54.844 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-08-31T04:38:54.844 INFO:teuthology.orchestra.run.smithi177.stdout: "mds_cache": { 2024-08-31T04:38:54.844 INFO:teuthology.orchestra.run.smithi177.stdout: "dir_update": 3463, 2024-08-31T04:38:54.844 INFO:teuthology.orchestra.run.smithi177.stdout: "dir_update_receipt": 10240, 2024-08-31T04:38:54.844 INFO:teuthology.orchestra.run.smithi177.stdout: "dir_try_discover": 6375, 2024-08-31T04:38:54.844 INFO:teuthology.orchestra.run.smithi177.stdout: "dir_send_discover": 8047, 2024-08-31T04:38:54.844 INFO:teuthology.orchestra.run.smithi177.stdout: "dir_handle_discover": 5347, 2024-08-31T04:38:54.844 INFO:teuthology.orchestra.run.smithi177.stdout: "num_strays": 0, 2024-08-31T04:38:54.844 INFO:teuthology.orchestra.run.smithi177.stdout: "num_strays_delayed": 0, 2024-08-31T04:38:54.844 INFO:teuthology.orchestra.run.smithi177.stdout: "num_strays_enqueuing": 0, 2024-08-31T04:38:54.845 INFO:teuthology.orchestra.run.smithi177.stdout: "strays_created": 10748, 2024-08-31T04:38:54.845 INFO:teuthology.orchestra.run.smithi177.stdout: "strays_enqueued": 10748, 2024-08-31T04:38:54.845 INFO:teuthology.orchestra.run.smithi177.stdout: "strays_reintegrated": 0, 2024-08-31T04:38:54.845 INFO:teuthology.orchestra.run.smithi177.stdout: "strays_migrated": 0, 2024-08-31T04:38:54.845 INFO:teuthology.orchestra.run.smithi177.stdout: "num_recovering_processing": 0, 2024-08-31T04:38:54.845 INFO:teuthology.orchestra.run.smithi177.stdout: "num_recovering_enqueued": 0, 2024-08-31T04:38:54.845 INFO:teuthology.orchestra.run.smithi177.stdout: "num_recovering_prioritized": 0, 2024-08-31T04:38:54.845 INFO:teuthology.orchestra.run.smithi177.stdout: "recovery_started": 0, 2024-08-31T04:38:54.845 INFO:teuthology.orchestra.run.smithi177.stdout: "recovery_completed": 0, 2024-08-31T04:38:54.845 INFO:teuthology.orchestra.run.smithi177.stdout: "ireq_quiesce_path": 5, 2024-08-31T04:38:54.845 INFO:teuthology.orchestra.run.smithi177.stdout: "ireq_quiesce_inode": 21280, 2024-08-31T04:38:54.845 INFO:teuthology.orchestra.run.smithi177.stdout: "ireq_enqueue_scrub": 0, 2024-08-31T04:38:54.845 INFO:teuthology.orchestra.run.smithi177.stdout: "ireq_exportdir": 237, 2024-08-31T04:38:54.845 INFO:teuthology.orchestra.run.smithi177.stdout: "ireq_flush": 0, 2024-08-31T04:38:54.846 INFO:teuthology.orchestra.run.smithi177.stdout: "ireq_fragmentdir": 40, 2024-08-31T04:38:54.846 INFO:teuthology.orchestra.run.smithi177.stdout: "ireq_fragstats": 0, 2024-08-31T04:38:54.846 INFO:teuthology.orchestra.run.smithi177.stdout: "ireq_inodestats": 0, 2024-08-31T04:38:54.846 INFO:teuthology.orchestra.run.smithi177.stdout: "uninline_started": 0, 2024-08-31T04:38:54.846 INFO:teuthology.orchestra.run.smithi177.stdout: "uninline_succeeded": 0, 2024-08-31T04:38:54.846 INFO:teuthology.orchestra.run.smithi177.stdout: "uninline_write_failed": 0 2024-08-31T04:38:54.846 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-08-31T04:38:54.846 INFO:teuthology.orchestra.run.smithi177.stdout: "mds_log": { 2024-08-31T04:38:54.846 INFO:teuthology.orchestra.run.smithi177.stdout: "evlrg": 1, 2024-08-31T04:38:54.846 INFO:teuthology.orchestra.run.smithi177.stdout: "evadd": 63009, 2024-08-31T04:38:54.846 INFO:teuthology.orchestra.run.smithi177.stdout: "evex": 0, 2024-08-31T04:38:54.846 INFO:teuthology.orchestra.run.smithi177.stdout: "evtrm": 0, 2024-08-31T04:38:54.847 INFO:teuthology.orchestra.run.smithi177.stdout: "ev": 63009, 2024-08-31T04:38:54.847 INFO:teuthology.orchestra.run.smithi177.stdout: "evexg": 0, 2024-08-31T04:38:54.847 INFO:teuthology.orchestra.run.smithi177.stdout: "evexd": 0, 2024-08-31T04:38:54.847 INFO:teuthology.orchestra.run.smithi177.stdout: "segadd": 81, 2024-08-31T04:38:54.847 INFO:teuthology.orchestra.run.smithi177.stdout: "segex": 0, 2024-08-31T04:38:54.847 INFO:teuthology.orchestra.run.smithi177.stdout: "segtrm": 0, 2024-08-31T04:38:54.847 INFO:teuthology.orchestra.run.smithi177.stdout: "seg": 81, 2024-08-31T04:38:54.847 INFO:teuthology.orchestra.run.smithi177.stdout: "segmjr": 7, 2024-08-31T04:38:54.848 INFO:teuthology.orchestra.run.smithi177.stdout: "segexg": 0, 2024-08-31T04:38:54.848 INFO:teuthology.orchestra.run.smithi177.stdout: "segexd": 0, 2024-08-31T04:38:54.848 INFO:teuthology.orchestra.run.smithi177.stdout: "expos": 4194304, 2024-08-31T04:38:54.848 INFO:teuthology.orchestra.run.smithi177.stdout: "wrpos": 133320346, 2024-08-31T04:38:54.848 INFO:teuthology.orchestra.run.smithi177.stdout: "rdpos": 0, 2024-08-31T04:38:54.848 INFO:teuthology.orchestra.run.smithi177.stdout: "jlat": { 2024-08-31T04:38:54.848 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 4219, 2024-08-31T04:38:54.848 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 711.428284397, 2024-08-31T04:38:54.848 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.168624860 2024-08-31T04:38:54.848 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-08-31T04:38:54.848 INFO:teuthology.orchestra.run.smithi177.stdout: "replayed": 0 2024-08-31T04:38:54.848 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-08-31T04:38:54.848 INFO:teuthology.orchestra.run.smithi177.stdout: "mds_mem": { 2024-08-31T04:38:54.849 INFO:teuthology.orchestra.run.smithi177.stdout: "ino": 38, 2024-08-31T04:38:54.849 INFO:teuthology.orchestra.run.smithi177.stdout: "ino+": 16079, 2024-08-31T04:38:54.849 INFO:teuthology.orchestra.run.smithi177.stdout: "ino-": 16041, 2024-08-31T04:38:54.849 INFO:teuthology.orchestra.run.smithi177.stdout: "dir": 35, 2024-08-31T04:38:54.849 INFO:teuthology.orchestra.run.smithi177.stdout: "dir+": 4142, 2024-08-31T04:38:54.849 INFO:teuthology.orchestra.run.smithi177.stdout: "dir-": 4107, 2024-08-31T04:38:54.850 INFO:teuthology.orchestra.run.smithi177.stdout: "dn": 31, 2024-08-31T04:38:54.850 INFO:teuthology.orchestra.run.smithi177.stdout: "dn+": 38537, 2024-08-31T04:38:54.850 INFO:teuthology.orchestra.run.smithi177.stdout: "dn-": 38506, 2024-08-31T04:38:54.850 INFO:teuthology.orchestra.run.smithi177.stdout: "cap": 1, 2024-08-31T04:38:54.850 INFO:teuthology.orchestra.run.smithi177.stdout: "cap+": 25508, 2024-08-31T04:38:54.850 INFO:teuthology.orchestra.run.smithi177.stdout: "cap-": 25507, 2024-08-31T04:38:54.851 INFO:teuthology.orchestra.run.smithi177.stdout: "rss": 193744, 2024-08-31T04:38:54.851 INFO:teuthology.orchestra.run.smithi177.stdout: "heap": 516206592 2024-08-31T04:38:54.851 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-08-31T04:38:54.851 INFO:teuthology.orchestra.run.smithi177.stdout: "mds_server": { 2024-08-31T04:38:54.851 INFO:teuthology.orchestra.run.smithi177.stdout: "dispatch_client_request": 77114, 2024-08-31T04:38:54.851 INFO:teuthology.orchestra.run.smithi177.stdout: "dispatch_server_request": 5486, 2024-08-31T04:38:54.851 INFO:teuthology.orchestra.run.smithi177.stdout: "handle_client_request": 70589, 2024-08-31T04:38:54.851 INFO:teuthology.orchestra.run.smithi177.stdout: "handle_client_session": 418, 2024-08-31T04:38:54.851 INFO:teuthology.orchestra.run.smithi177.stdout: "handle_peer_request": 8316, 2024-08-31T04:38:54.851 INFO:teuthology.orchestra.run.smithi177.stdout: "req_create_latency": { 2024-08-31T04:38:54.851 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 7044, 2024-08-31T04:38:54.851 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 108.162662650, 2024-08-31T04:38:54.851 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.015355289 2024-08-31T04:38:54.851 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-08-31T04:38:54.852 INFO:teuthology.orchestra.run.smithi177.stdout: "req_getattr_latency": { 2024-08-31T04:38:54.852 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 18, 2024-08-31T04:38:54.852 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.039076249, 2024-08-31T04:38:54.852 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.002170902 2024-08-31T04:38:54.852 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-08-31T04:38:54.852 INFO:teuthology.orchestra.run.smithi177.stdout: "req_getfilelock_latency": { 2024-08-31T04:38:54.852 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 0, 2024-08-31T04:38:54.852 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.000000000, 2024-08-31T04:38:54.852 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000000000 2024-08-31T04:38:54.852 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-08-31T04:38:54.853 INFO:teuthology.orchestra.run.smithi177.stdout: "req_link_latency": { 2024-08-31T04:38:54.853 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 0, 2024-08-31T04:38:54.853 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.000000000, 2024-08-31T04:38:54.853 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000000000 2024-08-31T04:38:54.853 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-08-31T04:38:54.853 INFO:teuthology.orchestra.run.smithi177.stdout: "req_lookup_latency": { 2024-08-31T04:38:54.853 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 40043, 2024-08-31T04:38:54.853 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 602.039020949, 2024-08-31T04:38:54.853 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.015034813 2024-08-31T04:38:54.853 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-08-31T04:38:54.853 INFO:teuthology.orchestra.run.smithi177.stdout: "req_lookuphash_latency": { 2024-08-31T04:38:54.854 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 0, 2024-08-31T04:38:54.854 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.000000000, 2024-08-31T04:38:54.854 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000000000 2024-08-31T04:38:54.854 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-08-31T04:38:54.854 INFO:teuthology.orchestra.run.smithi177.stdout: "req_lookupino_latency": { 2024-08-31T04:38:54.854 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 1, 2024-08-31T04:38:54.854 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.000136695, 2024-08-31T04:38:54.854 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000136695 2024-08-31T04:38:54.855 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-08-31T04:38:54.855 INFO:teuthology.orchestra.run.smithi177.stdout: "req_lookupname_latency": { 2024-08-31T04:38:54.855 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 0, 2024-08-31T04:38:54.855 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.000000000, 2024-08-31T04:38:54.855 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000000000 2024-08-31T04:38:54.855 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-08-31T04:38:54.855 INFO:teuthology.orchestra.run.smithi177.stdout: "req_lookupparent_latency": { 2024-08-31T04:38:54.855 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 0, 2024-08-31T04:38:54.855 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.000000000, 2024-08-31T04:38:54.855 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000000000 2024-08-31T04:38:54.855 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-08-31T04:38:54.856 INFO:teuthology.orchestra.run.smithi177.stdout: "req_lookupsnap_latency": { 2024-08-31T04:38:54.856 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 0, 2024-08-31T04:38:54.856 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.000000000, 2024-08-31T04:38:54.856 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000000000 2024-08-31T04:38:54.856 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-08-31T04:38:54.856 INFO:teuthology.orchestra.run.smithi177.stdout: "req_lssnap_latency": { 2024-08-31T04:38:54.856 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 0, 2024-08-31T04:38:54.856 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.000000000, 2024-08-31T04:38:54.856 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000000000 2024-08-31T04:38:54.856 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-08-31T04:38:54.857 INFO:teuthology.orchestra.run.smithi177.stdout: "req_mkdir_latency": { 2024-08-31T04:38:54.857 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 35, 2024-08-31T04:38:54.857 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.350448716, 2024-08-31T04:38:54.857 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.010012820 2024-08-31T04:38:54.857 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-08-31T04:38:54.857 INFO:teuthology.orchestra.run.smithi177.stdout: "req_mknod_latency": { 2024-08-31T04:38:54.857 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 0, 2024-08-31T04:38:54.857 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.000000000, 2024-08-31T04:38:54.857 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000000000 2024-08-31T04:38:54.857 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-08-31T04:38:54.857 INFO:teuthology.orchestra.run.smithi177.stdout: "req_mksnap_latency": { 2024-08-31T04:38:54.857 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 0, 2024-08-31T04:38:54.857 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.000000000, 2024-08-31T04:38:54.858 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000000000 2024-08-31T04:38:54.858 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-08-31T04:38:54.858 INFO:teuthology.orchestra.run.smithi177.stdout: "req_open_latency": { 2024-08-31T04:38:54.858 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 5699, 2024-08-31T04:38:54.858 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 57.489244664, 2024-08-31T04:38:54.858 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.010087602 2024-08-31T04:38:54.858 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-08-31T04:38:54.858 INFO:teuthology.orchestra.run.smithi177.stdout: "req_readdir_latency": { 2024-08-31T04:38:54.858 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 423, 2024-08-31T04:38:54.858 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.581891063, 2024-08-31T04:38:54.858 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.001375628 2024-08-31T04:38:54.858 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-08-31T04:38:54.858 INFO:teuthology.orchestra.run.smithi177.stdout: "req_rename_latency": { 2024-08-31T04:38:54.859 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 7066, 2024-08-31T04:38:54.859 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 574.500346831, 2024-08-31T04:38:54.859 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.081304889 2024-08-31T04:38:54.859 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-08-31T04:38:54.859 INFO:teuthology.orchestra.run.smithi177.stdout: "req_renamesnap_latency": { 2024-08-31T04:38:54.859 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 0, 2024-08-31T04:38:54.859 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.000000000, 2024-08-31T04:38:54.859 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000000000 2024-08-31T04:38:54.859 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-08-31T04:38:54.859 INFO:teuthology.orchestra.run.smithi177.stdout: "req_snapdiff_latency": { 2024-08-31T04:38:54.859 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 0, 2024-08-31T04:38:54.859 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.000000000, 2024-08-31T04:38:54.860 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000000000 2024-08-31T04:38:54.860 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-08-31T04:38:54.860 INFO:teuthology.orchestra.run.smithi177.stdout: "req_rmdir_latency": { 2024-08-31T04:38:54.860 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 53, 2024-08-31T04:38:54.860 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 13.998990242, 2024-08-31T04:38:54.860 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.264131891 2024-08-31T04:38:54.860 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-08-31T04:38:54.860 INFO:teuthology.orchestra.run.smithi177.stdout: "req_rmsnap_latency": { 2024-08-31T04:38:54.860 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 0, 2024-08-31T04:38:54.860 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.000000000, 2024-08-31T04:38:54.860 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000000000 2024-08-31T04:38:54.861 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-08-31T04:38:54.861 INFO:teuthology.orchestra.run.smithi177.stdout: "req_rmxattr_latency": { 2024-08-31T04:38:54.861 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 0, 2024-08-31T04:38:54.861 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.000000000, 2024-08-31T04:38:54.861 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000000000 2024-08-31T04:38:54.861 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-08-31T04:38:54.861 INFO:teuthology.orchestra.run.smithi177.stdout: "req_setattr_latency": { 2024-08-31T04:38:54.861 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 0, 2024-08-31T04:38:54.861 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.000000000, 2024-08-31T04:38:54.861 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000000000 2024-08-31T04:38:54.862 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-08-31T04:38:54.862 INFO:teuthology.orchestra.run.smithi177.stdout: "req_setdirlayout_latency": { 2024-08-31T04:38:54.862 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 0, 2024-08-31T04:38:54.862 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.000000000, 2024-08-31T04:38:54.862 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000000000 2024-08-31T04:38:54.862 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-08-31T04:38:54.862 INFO:teuthology.orchestra.run.smithi177.stdout: "req_setfilelock_latency": { 2024-08-31T04:38:54.862 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 0, 2024-08-31T04:38:54.862 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.000000000, 2024-08-31T04:38:54.862 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000000000 2024-08-31T04:38:54.862 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-08-31T04:38:54.862 INFO:teuthology.orchestra.run.smithi177.stdout: "req_setlayout_latency": { 2024-08-31T04:38:54.862 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 0, 2024-08-31T04:38:54.863 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.000000000, 2024-08-31T04:38:54.863 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000000000 2024-08-31T04:38:54.863 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-08-31T04:38:54.863 INFO:teuthology.orchestra.run.smithi177.stdout: "req_setxattr_latency": { 2024-08-31T04:38:54.863 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 0, 2024-08-31T04:38:54.863 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.000000000, 2024-08-31T04:38:54.863 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000000000 2024-08-31T04:38:54.863 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-08-31T04:38:54.863 INFO:teuthology.orchestra.run.smithi177.stdout: "req_symlink_latency": { 2024-08-31T04:38:54.863 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 0, 2024-08-31T04:38:54.863 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.000000000, 2024-08-31T04:38:54.863 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000000000 2024-08-31T04:38:54.863 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-08-31T04:38:54.864 INFO:teuthology.orchestra.run.smithi177.stdout: "req_unlink_latency": { 2024-08-31T04:38:54.864 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 9106, 2024-08-31T04:38:54.864 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 12.006307090, 2024-08-31T04:38:54.864 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.001318505 2024-08-31T04:38:54.864 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-08-31T04:38:54.864 INFO:teuthology.orchestra.run.smithi177.stdout: "cap_revoke_eviction": 0, 2024-08-31T04:38:54.864 INFO:teuthology.orchestra.run.smithi177.stdout: "cap_acquisition_throttle": 0, 2024-08-31T04:38:54.864 INFO:teuthology.orchestra.run.smithi177.stdout: "req_getvxattr_latency": { 2024-08-31T04:38:54.864 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 0, 2024-08-31T04:38:54.864 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.000000000, 2024-08-31T04:38:54.864 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000000000 2024-08-31T04:38:54.864 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-08-31T04:38:54.865 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-08-31T04:38:54.865 INFO:teuthology.orchestra.run.smithi177.stdout: "mds_sessions": { 2024-08-31T04:38:54.865 INFO:teuthology.orchestra.run.smithi177.stdout: "session_count": 1, 2024-08-31T04:38:54.865 INFO:teuthology.orchestra.run.smithi177.stdout: "session_add": 1, 2024-08-31T04:38:54.865 INFO:teuthology.orchestra.run.smithi177.stdout: "session_remove": 0, 2024-08-31T04:38:54.865 INFO:teuthology.orchestra.run.smithi177.stdout: "sessions_open": 1, 2024-08-31T04:38:54.865 INFO:teuthology.orchestra.run.smithi177.stdout: "sessions_stale": 0, 2024-08-31T04:38:54.865 INFO:teuthology.orchestra.run.smithi177.stdout: "total_load": 12766, 2024-08-31T04:38:54.865 INFO:teuthology.orchestra.run.smithi177.stdout: "average_load": 12766, 2024-08-31T04:38:54.865 INFO:teuthology.orchestra.run.smithi177.stdout: "avg_session_uptime": 934, 2024-08-31T04:38:54.865 INFO:teuthology.orchestra.run.smithi177.stdout: "mdthresh_evicted": 0 2024-08-31T04:38:54.865 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-08-31T04:38:54.865 INFO:teuthology.orchestra.run.smithi177.stdout: "mempool": { 2024-08-31T04:38:54.865 INFO:teuthology.orchestra.run.smithi177.stdout: "bloom_filter_bytes": 0, 2024-08-31T04:38:54.866 INFO:teuthology.orchestra.run.smithi177.stdout: "bloom_filter_items": 0, 2024-08-31T04:38:54.866 INFO:teuthology.orchestra.run.smithi177.stdout: "bluestore_alloc_bytes": 0, 2024-08-31T04:38:54.866 INFO:teuthology.orchestra.run.smithi177.stdout: "bluestore_alloc_items": 0, 2024-08-31T04:38:54.866 INFO:teuthology.orchestra.run.smithi177.stdout: "bluestore_cache_data_bytes": 0, 2024-08-31T04:38:54.866 INFO:teuthology.orchestra.run.smithi177.stdout: "bluestore_cache_data_items": 0, 2024-08-31T04:38:54.866 INFO:teuthology.orchestra.run.smithi177.stdout: "bluestore_cache_onode_bytes": 0, 2024-08-31T04:38:54.866 INFO:teuthology.orchestra.run.smithi177.stdout: "bluestore_cache_onode_items": 0, 2024-08-31T04:38:54.866 INFO:teuthology.orchestra.run.smithi177.stdout: "bluestore_cache_meta_bytes": 0, 2024-08-31T04:38:54.866 INFO:teuthology.orchestra.run.smithi177.stdout: "bluestore_cache_meta_items": 0, 2024-08-31T04:38:54.866 INFO:teuthology.orchestra.run.smithi177.stdout: "bluestore_cache_other_bytes": 0, 2024-08-31T04:38:54.867 INFO:teuthology.orchestra.run.smithi177.stdout: "bluestore_cache_other_items": 0, 2024-08-31T04:38:54.867 INFO:teuthology.orchestra.run.smithi177.stdout: "bluestore_cache_buffer_bytes": 0, 2024-08-31T04:38:54.867 INFO:teuthology.orchestra.run.smithi177.stdout: "bluestore_cache_buffer_items": 0, 2024-08-31T04:38:54.867 INFO:teuthology.orchestra.run.smithi177.stdout: "bluestore_extent_bytes": 0, 2024-08-31T04:38:54.867 INFO:teuthology.orchestra.run.smithi177.stdout: "bluestore_extent_items": 0, 2024-08-31T04:38:54.867 INFO:teuthology.orchestra.run.smithi177.stdout: "bluestore_blob_bytes": 0, 2024-08-31T04:38:54.867 INFO:teuthology.orchestra.run.smithi177.stdout: "bluestore_blob_items": 0, 2024-08-31T04:38:54.867 INFO:teuthology.orchestra.run.smithi177.stdout: "bluestore_shared_blob_bytes": 0, 2024-08-31T04:38:54.867 INFO:teuthology.orchestra.run.smithi177.stdout: "bluestore_shared_blob_items": 0, 2024-08-31T04:38:54.867 INFO:teuthology.orchestra.run.smithi177.stdout: "bluestore_inline_bl_bytes": 0, 2024-08-31T04:38:54.868 INFO:teuthology.orchestra.run.smithi177.stdout: "bluestore_inline_bl_items": 0, 2024-08-31T04:38:54.868 INFO:teuthology.orchestra.run.smithi177.stdout: "bluestore_fsck_bytes": 0, 2024-08-31T04:38:54.868 INFO:teuthology.orchestra.run.smithi177.stdout: "bluestore_fsck_items": 0, 2024-08-31T04:38:54.868 INFO:teuthology.orchestra.run.smithi177.stdout: "bluestore_txc_bytes": 0, 2024-08-31T04:38:54.868 INFO:teuthology.orchestra.run.smithi177.stdout: "bluestore_txc_items": 0, 2024-08-31T04:38:54.869 INFO:teuthology.orchestra.run.smithi177.stdout: "bluestore_writing_deferred_bytes": 0, 2024-08-31T04:38:54.869 INFO:teuthology.orchestra.run.smithi177.stdout: "bluestore_writing_deferred_items": 0, 2024-08-31T04:38:54.869 INFO:teuthology.orchestra.run.smithi177.stdout: "bluestore_writing_bytes": 0, 2024-08-31T04:38:54.869 INFO:teuthology.orchestra.run.smithi177.stdout: "bluestore_writing_items": 0, 2024-08-31T04:38:54.869 INFO:teuthology.orchestra.run.smithi177.stdout: "bluefs_bytes": 0, 2024-08-31T04:38:54.869 INFO:teuthology.orchestra.run.smithi177.stdout: "bluefs_items": 0, 2024-08-31T04:38:54.869 INFO:teuthology.orchestra.run.smithi177.stdout: "bluefs_file_reader_bytes": 0, 2024-08-31T04:38:54.869 INFO:teuthology.orchestra.run.smithi177.stdout: "bluefs_file_reader_items": 0, 2024-08-31T04:38:54.869 INFO:teuthology.orchestra.run.smithi177.stdout: "bluefs_file_writer_bytes": 0, 2024-08-31T04:38:54.870 INFO:teuthology.orchestra.run.smithi177.stdout: "bluefs_file_writer_items": 0, 2024-08-31T04:38:54.870 INFO:teuthology.orchestra.run.smithi177.stdout: "buffer_anon_bytes": 304167, 2024-08-31T04:38:54.870 INFO:teuthology.orchestra.run.smithi177.stdout: "buffer_anon_items": 112, 2024-08-31T04:38:54.870 INFO:teuthology.orchestra.run.smithi177.stdout: "buffer_meta_bytes": 0, 2024-08-31T04:38:54.870 INFO:teuthology.orchestra.run.smithi177.stdout: "buffer_meta_items": 0, 2024-08-31T04:38:54.870 INFO:teuthology.orchestra.run.smithi177.stdout: "osd_bytes": 0, 2024-08-31T04:38:54.870 INFO:teuthology.orchestra.run.smithi177.stdout: "osd_items": 0, 2024-08-31T04:38:54.870 INFO:teuthology.orchestra.run.smithi177.stdout: "osd_mapbl_bytes": 0, 2024-08-31T04:38:54.870 INFO:teuthology.orchestra.run.smithi177.stdout: "osd_mapbl_items": 0, 2024-08-31T04:38:54.870 INFO:teuthology.orchestra.run.smithi177.stdout: "osd_pglog_bytes": 0, 2024-08-31T04:38:54.870 INFO:teuthology.orchestra.run.smithi177.stdout: "osd_pglog_items": 0, 2024-08-31T04:38:54.870 INFO:teuthology.orchestra.run.smithi177.stdout: "osdmap_bytes": 7504, 2024-08-31T04:38:54.870 INFO:teuthology.orchestra.run.smithi177.stdout: "osdmap_items": 155, 2024-08-31T04:38:54.871 INFO:teuthology.orchestra.run.smithi177.stdout: "osdmap_mapping_bytes": 0, 2024-08-31T04:38:54.871 INFO:teuthology.orchestra.run.smithi177.stdout: "osdmap_mapping_items": 0, 2024-08-31T04:38:54.871 INFO:teuthology.orchestra.run.smithi177.stdout: "pgmap_bytes": 0, 2024-08-31T04:38:54.871 INFO:teuthology.orchestra.run.smithi177.stdout: "pgmap_items": 0, 2024-08-31T04:38:54.871 INFO:teuthology.orchestra.run.smithi177.stdout: "mds_co_bytes": 153381, 2024-08-31T04:38:54.871 INFO:teuthology.orchestra.run.smithi177.stdout: "mds_co_items": 664, 2024-08-31T04:38:54.871 INFO:teuthology.orchestra.run.smithi177.stdout: "unittest_1_bytes": 0, 2024-08-31T04:38:54.871 INFO:teuthology.orchestra.run.smithi177.stdout: "unittest_1_items": 0, 2024-08-31T04:38:54.871 INFO:teuthology.orchestra.run.smithi177.stdout: "unittest_2_bytes": 0, 2024-08-31T04:38:54.871 INFO:teuthology.orchestra.run.smithi177.stdout: "unittest_2_items": 0 2024-08-31T04:38:54.871 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-08-31T04:38:54.871 INFO:teuthology.orchestra.run.smithi177.stdout: "objecter": { 2024-08-31T04:38:54.871 INFO:teuthology.orchestra.run.smithi177.stdout: "op_active": 0, 2024-08-31T04:38:54.872 INFO:teuthology.orchestra.run.smithi177.stdout: "op_laggy": 0, 2024-08-31T04:38:54.872 INFO:teuthology.orchestra.run.smithi177.stdout: "op_send": 17651, 2024-08-31T04:38:54.872 INFO:teuthology.orchestra.run.smithi177.stdout: "op_send_bytes": 137318085, 2024-08-31T04:38:54.872 INFO:teuthology.orchestra.run.smithi177.stdout: "op_resend": 33, 2024-08-31T04:38:54.872 INFO:teuthology.orchestra.run.smithi177.stdout: "op_reply": 17651, 2024-08-31T04:38:54.872 INFO:teuthology.orchestra.run.smithi177.stdout: "op_latency": { 2024-08-31T04:38:54.872 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 17651, 2024-08-31T04:38:54.872 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 667.770696020, 2024-08-31T04:38:54.872 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.037831890 2024-08-31T04:38:54.872 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-08-31T04:38:54.872 INFO:teuthology.orchestra.run.smithi177.stdout: "op_inflight": 0, 2024-08-31T04:38:54.873 INFO:teuthology.orchestra.run.smithi177.stdout: "oplen_avg": { 2024-08-31T04:38:54.873 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 17651, 2024-08-31T04:38:54.873 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 18635 2024-08-31T04:38:54.873 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-08-31T04:38:54.873 INFO:teuthology.orchestra.run.smithi177.stdout: "op": 17651, 2024-08-31T04:38:54.873 INFO:teuthology.orchestra.run.smithi177.stdout: "op_r": 655, 2024-08-31T04:38:54.873 INFO:teuthology.orchestra.run.smithi177.stdout: "op_w": 16996, 2024-08-31T04:38:54.873 INFO:teuthology.orchestra.run.smithi177.stdout: "op_rmw": 0, 2024-08-31T04:38:54.873 INFO:teuthology.orchestra.run.smithi177.stdout: "op_pg": 0, 2024-08-31T04:38:54.873 INFO:teuthology.orchestra.run.smithi177.stdout: "osdop_stat": 0, 2024-08-31T04:38:54.873 INFO:teuthology.orchestra.run.smithi177.stdout: "osdop_create": 10, 2024-08-31T04:38:54.873 INFO:teuthology.orchestra.run.smithi177.stdout: "osdop_read": 576, 2024-08-31T04:38:54.873 INFO:teuthology.orchestra.run.smithi177.stdout: "osdop_write": 4795, 2024-08-31T04:38:54.874 INFO:teuthology.orchestra.run.smithi177.stdout: "osdop_writefull": 347, 2024-08-31T04:38:54.874 INFO:teuthology.orchestra.run.smithi177.stdout: "osdop_writesame": 0, 2024-08-31T04:38:54.874 INFO:teuthology.orchestra.run.smithi177.stdout: "osdop_append": 0, 2024-08-31T04:38:54.874 INFO:teuthology.orchestra.run.smithi177.stdout: "osdop_zero": 0, 2024-08-31T04:38:54.874 INFO:teuthology.orchestra.run.smithi177.stdout: "osdop_truncate": 35, 2024-08-31T04:38:54.874 INFO:teuthology.orchestra.run.smithi177.stdout: "osdop_delete": 11127, 2024-08-31T04:38:54.874 INFO:teuthology.orchestra.run.smithi177.stdout: "osdop_mapext": 0, 2024-08-31T04:38:54.874 INFO:teuthology.orchestra.run.smithi177.stdout: "osdop_sparse_read": 0, 2024-08-31T04:38:54.874 INFO:teuthology.orchestra.run.smithi177.stdout: "osdop_clonerange": 0, 2024-08-31T04:38:54.874 INFO:teuthology.orchestra.run.smithi177.stdout: "osdop_getxattr": 0, 2024-08-31T04:38:54.874 INFO:teuthology.orchestra.run.smithi177.stdout: "osdop_setxattr": 20, 2024-08-31T04:38:54.874 INFO:teuthology.orchestra.run.smithi177.stdout: "osdop_cmpxattr": 0, 2024-08-31T04:38:54.874 INFO:teuthology.orchestra.run.smithi177.stdout: "osdop_rmxattr": 0, 2024-08-31T04:38:54.874 INFO:teuthology.orchestra.run.smithi177.stdout: "osdop_resetxattrs": 0, 2024-08-31T04:38:54.875 INFO:teuthology.orchestra.run.smithi177.stdout: "osdop_call": 0, 2024-08-31T04:38:54.875 INFO:teuthology.orchestra.run.smithi177.stdout: "osdop_watch": 0, 2024-08-31T04:38:54.875 INFO:teuthology.orchestra.run.smithi177.stdout: "osdop_notify": 0, 2024-08-31T04:38:54.875 INFO:teuthology.orchestra.run.smithi177.stdout: "osdop_src_cmpxattr": 0, 2024-08-31T04:38:54.875 INFO:teuthology.orchestra.run.smithi177.stdout: "osdop_pgls": 0, 2024-08-31T04:38:54.875 INFO:teuthology.orchestra.run.smithi177.stdout: "osdop_pgls_filter": 0, 2024-08-31T04:38:54.875 INFO:teuthology.orchestra.run.smithi177.stdout: "osdop_other": 0, 2024-08-31T04:38:54.875 INFO:teuthology.orchestra.run.smithi177.stdout: "linger_active": 0, 2024-08-31T04:38:54.875 INFO:teuthology.orchestra.run.smithi177.stdout: "linger_send": 0, 2024-08-31T04:38:54.875 INFO:teuthology.orchestra.run.smithi177.stdout: "linger_resend": 0, 2024-08-31T04:38:54.875 INFO:teuthology.orchestra.run.smithi177.stdout: "linger_ping": 0, 2024-08-31T04:38:54.875 INFO:teuthology.orchestra.run.smithi177.stdout: "poolop_active": 0, 2024-08-31T04:38:54.875 INFO:teuthology.orchestra.run.smithi177.stdout: "poolop_send": 0, 2024-08-31T04:38:54.876 INFO:teuthology.orchestra.run.smithi177.stdout: "poolop_resend": 0, 2024-08-31T04:38:54.876 INFO:teuthology.orchestra.run.smithi177.stdout: "poolstat_active": 0, 2024-08-31T04:38:54.876 INFO:teuthology.orchestra.run.smithi177.stdout: "poolstat_send": 0, 2024-08-31T04:38:54.876 INFO:teuthology.orchestra.run.smithi177.stdout: "poolstat_resend": 0, 2024-08-31T04:38:54.876 INFO:teuthology.orchestra.run.smithi177.stdout: "statfs_active": 0, 2024-08-31T04:38:54.876 INFO:teuthology.orchestra.run.smithi177.stdout: "statfs_send": 0, 2024-08-31T04:38:54.876 INFO:teuthology.orchestra.run.smithi177.stdout: "statfs_resend": 0, 2024-08-31T04:38:54.876 INFO:teuthology.orchestra.run.smithi177.stdout: "command_active": 0, 2024-08-31T04:38:54.876 INFO:teuthology.orchestra.run.smithi177.stdout: "command_send": 0, 2024-08-31T04:38:54.876 INFO:teuthology.orchestra.run.smithi177.stdout: "command_resend": 0, 2024-08-31T04:38:54.876 INFO:teuthology.orchestra.run.smithi177.stdout: "map_epoch": 80, 2024-08-31T04:38:54.877 INFO:teuthology.orchestra.run.smithi177.stdout: "map_full": 0, 2024-08-31T04:38:54.877 INFO:teuthology.orchestra.run.smithi177.stdout: "map_inc": 2, 2024-08-31T04:38:54.877 INFO:teuthology.orchestra.run.smithi177.stdout: "osd_sessions": 12, 2024-08-31T04:38:54.877 INFO:teuthology.orchestra.run.smithi177.stdout: "osd_session_open": 12, 2024-08-31T04:38:54.877 INFO:teuthology.orchestra.run.smithi177.stdout: "osd_session_close": 0, 2024-08-31T04:38:54.877 INFO:teuthology.orchestra.run.smithi177.stdout: "osd_laggy": 0, 2024-08-31T04:38:54.877 INFO:teuthology.orchestra.run.smithi177.stdout: "omap_wr": 1303, 2024-08-31T04:38:54.877 INFO:teuthology.orchestra.run.smithi177.stdout: "omap_rd": 113, 2024-08-31T04:38:54.877 INFO:teuthology.orchestra.run.smithi177.stdout: "omap_del": 309 2024-08-31T04:38:54.877 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-08-31T04:38:54.877 INFO:teuthology.orchestra.run.smithi177.stdout: "oft": { 2024-08-31T04:38:54.877 INFO:teuthology.orchestra.run.smithi177.stdout: "omap_total_objs": 1, 2024-08-31T04:38:54.877 INFO:teuthology.orchestra.run.smithi177.stdout: "omap_total_kv_pairs": 0, 2024-08-31T04:38:54.878 INFO:teuthology.orchestra.run.smithi177.stdout: "omap_total_updates": 0, 2024-08-31T04:38:54.878 INFO:teuthology.orchestra.run.smithi177.stdout: "omap_total_removes": 0 2024-08-31T04:38:54.878 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-08-31T04:38:54.878 INFO:teuthology.orchestra.run.smithi177.stdout: "purge_queue": { 2024-08-31T04:38:54.878 INFO:teuthology.orchestra.run.smithi177.stdout: "pq_executing_ops": 0, 2024-08-31T04:38:54.878 INFO:teuthology.orchestra.run.smithi177.stdout: "pq_executing_ops_high_water": 13, 2024-08-31T04:38:54.878 INFO:teuthology.orchestra.run.smithi177.stdout: "pq_executing": 0, 2024-08-31T04:38:54.878 INFO:teuthology.orchestra.run.smithi177.stdout: "pq_executing_high_water": 6, 2024-08-31T04:38:54.878 INFO:teuthology.orchestra.run.smithi177.stdout: "pq_executed_ops": 11051, 2024-08-31T04:38:54.878 INFO:teuthology.orchestra.run.smithi177.stdout: "pq_executed": 10748, 2024-08-31T04:38:54.878 INFO:teuthology.orchestra.run.smithi177.stdout: "pq_item_in_journal": 0 2024-08-31T04:38:54.878 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-08-31T04:38:54.878 INFO:teuthology.orchestra.run.smithi177.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-08-31T04:38:54.878 INFO:teuthology.orchestra.run.smithi177.stdout: "val": 0, 2024-08-31T04:38:54.879 INFO:teuthology.orchestra.run.smithi177.stdout: "max": 104857600, 2024-08-31T04:38:54.879 INFO:teuthology.orchestra.run.smithi177.stdout: "get_started": 0, 2024-08-31T04:38:54.879 INFO:teuthology.orchestra.run.smithi177.stdout: "get": 226391, 2024-08-31T04:38:54.879 INFO:teuthology.orchestra.run.smithi177.stdout: "get_sum": 64653723, 2024-08-31T04:38:54.879 INFO:teuthology.orchestra.run.smithi177.stdout: "get_or_fail_fail": 0, 2024-08-31T04:38:54.879 INFO:teuthology.orchestra.run.smithi177.stdout: "get_or_fail_success": 226391, 2024-08-31T04:38:54.879 INFO:teuthology.orchestra.run.smithi177.stdout: "take": 0, 2024-08-31T04:38:54.879 INFO:teuthology.orchestra.run.smithi177.stdout: "take_sum": 0, 2024-08-31T04:38:54.879 INFO:teuthology.orchestra.run.smithi177.stdout: "put": 226391, 2024-08-31T04:38:54.879 INFO:teuthology.orchestra.run.smithi177.stdout: "put_sum": 64653723, 2024-08-31T04:38:54.879 INFO:teuthology.orchestra.run.smithi177.stdout: "wait": { 2024-08-31T04:38:54.879 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 0, 2024-08-31T04:38:54.879 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.000000000, 2024-08-31T04:38:54.879 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000000000 2024-08-31T04:38:54.880 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-08-31T04:38:54.880 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-08-31T04:38:54.880 INFO:teuthology.orchestra.run.smithi177.stdout: "throttle-objecter_bytes": { 2024-08-31T04:38:54.880 INFO:teuthology.orchestra.run.smithi177.stdout: "val": 0, 2024-08-31T04:38:54.880 INFO:teuthology.orchestra.run.smithi177.stdout: "max": 104857600, 2024-08-31T04:38:54.880 INFO:teuthology.orchestra.run.smithi177.stdout: "get_started": 0, 2024-08-31T04:38:54.880 INFO:teuthology.orchestra.run.smithi177.stdout: "get": 0, 2024-08-31T04:38:54.880 INFO:teuthology.orchestra.run.smithi177.stdout: "get_sum": 0, 2024-08-31T04:38:54.880 INFO:teuthology.orchestra.run.smithi177.stdout: "get_or_fail_fail": 0, 2024-08-31T04:38:54.880 INFO:teuthology.orchestra.run.smithi177.stdout: "get_or_fail_success": 0, 2024-08-31T04:38:54.880 INFO:teuthology.orchestra.run.smithi177.stdout: "take": 17651, 2024-08-31T04:38:54.880 INFO:teuthology.orchestra.run.smithi177.stdout: "take_sum": 138401848, 2024-08-31T04:38:54.880 INFO:teuthology.orchestra.run.smithi177.stdout: "put": 17651, 2024-08-31T04:38:54.881 INFO:teuthology.orchestra.run.smithi177.stdout: "put_sum": 138401848, 2024-08-31T04:38:54.881 INFO:teuthology.orchestra.run.smithi177.stdout: "wait": { 2024-08-31T04:38:54.881 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 0, 2024-08-31T04:38:54.881 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.000000000, 2024-08-31T04:38:54.881 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000000000 2024-08-31T04:38:54.881 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-08-31T04:38:54.881 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-08-31T04:38:54.881 INFO:teuthology.orchestra.run.smithi177.stdout: "throttle-objecter_ops": { 2024-08-31T04:38:54.881 INFO:teuthology.orchestra.run.smithi177.stdout: "val": 0, 2024-08-31T04:38:54.881 INFO:teuthology.orchestra.run.smithi177.stdout: "max": 1024, 2024-08-31T04:38:54.881 INFO:teuthology.orchestra.run.smithi177.stdout: "get_started": 0, 2024-08-31T04:38:54.881 INFO:teuthology.orchestra.run.smithi177.stdout: "get": 0, 2024-08-31T04:38:54.881 INFO:teuthology.orchestra.run.smithi177.stdout: "get_sum": 0, 2024-08-31T04:38:54.881 INFO:teuthology.orchestra.run.smithi177.stdout: "get_or_fail_fail": 0, 2024-08-31T04:38:54.881 INFO:teuthology.orchestra.run.smithi177.stdout: "get_or_fail_success": 0, 2024-08-31T04:38:54.882 INFO:teuthology.orchestra.run.smithi177.stdout: "take": 17651, 2024-08-31T04:38:54.882 INFO:teuthology.orchestra.run.smithi177.stdout: "take_sum": 17651, 2024-08-31T04:38:54.882 INFO:teuthology.orchestra.run.smithi177.stdout: "put": 17651, 2024-08-31T04:38:54.882 INFO:teuthology.orchestra.run.smithi177.stdout: "put_sum": 17651, 2024-08-31T04:38:54.882 INFO:teuthology.orchestra.run.smithi177.stdout: "wait": { 2024-08-31T04:38:54.882 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 0, 2024-08-31T04:38:54.882 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.000000000, 2024-08-31T04:38:54.882 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000000000 2024-08-31T04:38:54.882 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-08-31T04:38:54.882 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-08-31T04:38:54.882 INFO:teuthology.orchestra.run.smithi177.stdout: "throttle-write_buf_throttle": { 2024-08-31T04:38:54.882 INFO:teuthology.orchestra.run.smithi177.stdout: "val": 0, 2024-08-31T04:38:54.882 INFO:teuthology.orchestra.run.smithi177.stdout: "max": 3758096384, 2024-08-31T04:38:54.882 INFO:teuthology.orchestra.run.smithi177.stdout: "get_started": 0, 2024-08-31T04:38:54.883 INFO:teuthology.orchestra.run.smithi177.stdout: "get": 10748, 2024-08-31T04:38:54.883 INFO:teuthology.orchestra.run.smithi177.stdout: "get_sum": 1085876, 2024-08-31T04:38:54.883 INFO:teuthology.orchestra.run.smithi177.stdout: "get_or_fail_fail": 0, 2024-08-31T04:38:54.883 INFO:teuthology.orchestra.run.smithi177.stdout: "get_or_fail_success": 10748, 2024-08-31T04:38:54.883 INFO:teuthology.orchestra.run.smithi177.stdout: "take": 0, 2024-08-31T04:38:54.883 INFO:teuthology.orchestra.run.smithi177.stdout: "take_sum": 0, 2024-08-31T04:38:54.883 INFO:teuthology.orchestra.run.smithi177.stdout: "put": 576, 2024-08-31T04:38:54.883 INFO:teuthology.orchestra.run.smithi177.stdout: "put_sum": 1085876, 2024-08-31T04:38:54.883 INFO:teuthology.orchestra.run.smithi177.stdout: "wait": { 2024-08-31T04:38:54.883 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 0, 2024-08-31T04:38:54.883 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.000000000, 2024-08-31T04:38:54.883 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000000000 2024-08-31T04:38:54.883 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-08-31T04:38:54.883 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-08-31T04:38:54.883 INFO:teuthology.orchestra.run.smithi177.stdout: "throttle-write_buf_throttle-0x559a27588820": { 2024-08-31T04:38:54.884 INFO:teuthology.orchestra.run.smithi177.stdout: "val": 0, 2024-08-31T04:38:54.884 INFO:teuthology.orchestra.run.smithi177.stdout: "max": 3758096384, 2024-08-31T04:38:54.884 INFO:teuthology.orchestra.run.smithi177.stdout: "get_started": 0, 2024-08-31T04:38:54.884 INFO:teuthology.orchestra.run.smithi177.stdout: "get": 63009, 2024-08-31T04:38:54.884 INFO:teuthology.orchestra.run.smithi177.stdout: "get_sum": 129126042, 2024-08-31T04:38:54.884 INFO:teuthology.orchestra.run.smithi177.stdout: "get_or_fail_fail": 0, 2024-08-31T04:38:54.884 INFO:teuthology.orchestra.run.smithi177.stdout: "get_or_fail_success": 63009, 2024-08-31T04:38:54.884 INFO:teuthology.orchestra.run.smithi177.stdout: "take": 0, 2024-08-31T04:38:54.884 INFO:teuthology.orchestra.run.smithi177.stdout: "take_sum": 0, 2024-08-31T04:38:54.884 INFO:teuthology.orchestra.run.smithi177.stdout: "put": 4219, 2024-08-31T04:38:54.884 INFO:teuthology.orchestra.run.smithi177.stdout: "put_sum": 129126042, 2024-08-31T04:38:54.884 INFO:teuthology.orchestra.run.smithi177.stdout: "wait": { 2024-08-31T04:38:54.884 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 0, 2024-08-31T04:38:54.884 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.000000000, 2024-08-31T04:38:54.885 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000000000 2024-08-31T04:38:54.885 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-08-31T04:38:54.885 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-08-31T04:38:54.885 INFO:teuthology.orchestra.run.smithi177.stdout: "trackedop": { 2024-08-31T04:38:54.885 INFO:teuthology.orchestra.run.smithi177.stdout: "slow_ops_count": 21286 2024-08-31T04:38:54.885 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-08-31T04:38:54.885 INFO:teuthology.orchestra.run.smithi177.stdout:} 2024-08-31T04:38:55.749 INFO:tasks.check_counter:Daemon mds.c mds.exported=236 2024-08-31T04:38:55.749 INFO:tasks.check_counter:Daemon mds.c mds.imported=243 2024-08-31T04:38:55.749 INFO:tasks.check_counter:Daemon mds.c mds_cache.dir_update=3463 2024-08-31T04:38:55.749 INFO:tasks.check_counter:Daemon mds.c mds_cache.dir_update_receipt=10240 2024-08-31T04:38:55.749 INFO:tasks.check_counter:Daemon mds.c mds.dir_split=35 2024-08-31T04:38:55.749 DEBUG:tasks.check_counter:Getting stats from f 2024-08-31T04:38:55.750 DEBUG:teuthology.orchestra.run.smithi177:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 058d9fc6-674f-11ef-bcd4-c7b262605968 -- ceph daemon mds.f perf dump 2024-08-31T04:38:55.932 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:38:55 smithi177 ceph-mon[22025]: pgmap v849: 97 pgs: 97 active+clean; 592 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 8 op/s 2024-08-31T04:38:55.950 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:38:55 smithi050 ceph-mon[17259]: pgmap v849: 97 pgs: 97 active+clean; 592 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 8 op/s 2024-08-31T04:38:56.012 INFO:teuthology.orchestra.run.smithi177.stderr:Inferring config /var/lib/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/mon.c/config 2024-08-31T04:38:56.043 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:38:55 smithi133 ceph-mon[22177]: pgmap v849: 97 pgs: 97 active+clean; 592 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 8 op/s 2024-08-31T04:38:56.574 INFO:teuthology.orchestra.run.smithi177.stdout:{ 2024-08-31T04:38:56.574 INFO:teuthology.orchestra.run.smithi177.stdout: "AsyncMessenger::Worker-0": { 2024-08-31T04:38:56.574 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_recv_messages": 4, 2024-08-31T04:38:56.574 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_send_messages": 4, 2024-08-31T04:38:56.574 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_recv_bytes": 2992, 2024-08-31T04:38:56.574 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_send_bytes": 448, 2024-08-31T04:38:56.575 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_created_connections": 4, 2024-08-31T04:38:56.575 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_active_connections": 0, 2024-08-31T04:38:56.575 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_running_total_time": 0.002878382, 2024-08-31T04:38:56.575 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_running_send_time": 0.000033758, 2024-08-31T04:38:56.575 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_running_recv_time": 0.002109605, 2024-08-31T04:38:56.575 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-08-31T04:38:56.575 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_send_messages_queue_lat": { 2024-08-31T04:38:56.575 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 3, 2024-08-31T04:38:56.575 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.004211715, 2024-08-31T04:38:56.575 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.001403905 2024-08-31T04:38:56.575 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-08-31T04:38:56.575 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_handle_ack_lat": { 2024-08-31T04:38:56.576 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 0, 2024-08-31T04:38:56.576 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.000000000, 2024-08-31T04:38:56.576 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000000000 2024-08-31T04:38:56.576 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-08-31T04:38:56.576 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_recv_encrypted_bytes": 2992, 2024-08-31T04:38:56.577 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_send_encrypted_bytes": 448 2024-08-31T04:38:56.577 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-08-31T04:38:56.577 INFO:teuthology.orchestra.run.smithi177.stdout: "AsyncMessenger::Worker-1": { 2024-08-31T04:38:56.577 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_recv_messages": 1, 2024-08-31T04:38:56.577 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_send_messages": 126, 2024-08-31T04:38:56.577 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_recv_bytes": 160, 2024-08-31T04:38:56.577 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_send_bytes": 102112, 2024-08-31T04:38:56.577 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_created_connections": 3, 2024-08-31T04:38:56.577 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_active_connections": 2, 2024-08-31T04:38:56.577 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_running_total_time": 0.009793971, 2024-08-31T04:38:56.578 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_running_send_time": 0.007621636, 2024-08-31T04:38:56.578 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_running_recv_time": 0.000858211, 2024-08-31T04:38:56.578 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-08-31T04:38:56.578 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_send_messages_queue_lat": { 2024-08-31T04:38:56.578 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 124, 2024-08-31T04:38:56.578 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.009705399, 2024-08-31T04:38:56.578 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000078269 2024-08-31T04:38:56.578 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-08-31T04:38:56.578 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_handle_ack_lat": { 2024-08-31T04:38:56.579 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 0, 2024-08-31T04:38:56.579 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.000000000, 2024-08-31T04:38:56.579 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000000000 2024-08-31T04:38:56.579 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-08-31T04:38:56.579 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_recv_encrypted_bytes": 160, 2024-08-31T04:38:56.579 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_send_encrypted_bytes": 102112 2024-08-31T04:38:56.579 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-08-31T04:38:56.580 INFO:teuthology.orchestra.run.smithi177.stdout: "AsyncMessenger::Worker-2": { 2024-08-31T04:38:56.580 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_recv_messages": 167, 2024-08-31T04:38:56.580 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_send_messages": 166, 2024-08-31T04:38:56.580 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_recv_bytes": 202656, 2024-08-31T04:38:56.580 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_send_bytes": 101808, 2024-08-31T04:38:56.580 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_created_connections": 2, 2024-08-31T04:38:56.580 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_active_connections": 1, 2024-08-31T04:38:56.580 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_running_total_time": 0.025018338, 2024-08-31T04:38:56.580 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_running_send_time": 0.013572465, 2024-08-31T04:38:56.580 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_running_recv_time": 0.013131646, 2024-08-31T04:38:56.580 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-08-31T04:38:56.580 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_send_messages_queue_lat": { 2024-08-31T04:38:56.581 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 165, 2024-08-31T04:38:56.581 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.008838401, 2024-08-31T04:38:56.581 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000053566 2024-08-31T04:38:56.581 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-08-31T04:38:56.581 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_handle_ack_lat": { 2024-08-31T04:38:56.581 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 0, 2024-08-31T04:38:56.581 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.000000000, 2024-08-31T04:38:56.581 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000000000 2024-08-31T04:38:56.581 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-08-31T04:38:56.581 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_recv_encrypted_bytes": 202656, 2024-08-31T04:38:56.582 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_send_encrypted_bytes": 101808 2024-08-31T04:38:56.582 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-08-31T04:38:56.582 INFO:teuthology.orchestra.run.smithi177.stdout: "cct": { 2024-08-31T04:38:56.582 INFO:teuthology.orchestra.run.smithi177.stdout: "total_workers": 0, 2024-08-31T04:38:56.582 INFO:teuthology.orchestra.run.smithi177.stdout: "unhealthy_workers": 0 2024-08-31T04:38:56.582 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-08-31T04:38:56.582 INFO:teuthology.orchestra.run.smithi177.stdout: "mempool": { 2024-08-31T04:38:56.582 INFO:teuthology.orchestra.run.smithi177.stdout: "bloom_filter_bytes": 0, 2024-08-31T04:38:56.582 INFO:teuthology.orchestra.run.smithi177.stdout: "bloom_filter_items": 0, 2024-08-31T04:38:56.582 INFO:teuthology.orchestra.run.smithi177.stdout: "bluestore_alloc_bytes": 0, 2024-08-31T04:38:56.582 INFO:teuthology.orchestra.run.smithi177.stdout: "bluestore_alloc_items": 0, 2024-08-31T04:38:56.583 INFO:teuthology.orchestra.run.smithi177.stdout: "bluestore_cache_data_bytes": 0, 2024-08-31T04:38:56.583 INFO:teuthology.orchestra.run.smithi177.stdout: "bluestore_cache_data_items": 0, 2024-08-31T04:38:56.583 INFO:teuthology.orchestra.run.smithi177.stdout: "bluestore_cache_onode_bytes": 0, 2024-08-31T04:38:56.583 INFO:teuthology.orchestra.run.smithi177.stdout: "bluestore_cache_onode_items": 0, 2024-08-31T04:38:56.583 INFO:teuthology.orchestra.run.smithi177.stdout: "bluestore_cache_meta_bytes": 0, 2024-08-31T04:38:56.583 INFO:teuthology.orchestra.run.smithi177.stdout: "bluestore_cache_meta_items": 0, 2024-08-31T04:38:56.583 INFO:teuthology.orchestra.run.smithi177.stdout: "bluestore_cache_other_bytes": 0, 2024-08-31T04:38:56.583 INFO:teuthology.orchestra.run.smithi177.stdout: "bluestore_cache_other_items": 0, 2024-08-31T04:38:56.583 INFO:teuthology.orchestra.run.smithi177.stdout: "bluestore_cache_buffer_bytes": 0, 2024-08-31T04:38:56.583 INFO:teuthology.orchestra.run.smithi177.stdout: "bluestore_cache_buffer_items": 0, 2024-08-31T04:38:56.584 INFO:teuthology.orchestra.run.smithi177.stdout: "bluestore_extent_bytes": 0, 2024-08-31T04:38:56.584 INFO:teuthology.orchestra.run.smithi177.stdout: "bluestore_extent_items": 0, 2024-08-31T04:38:56.584 INFO:teuthology.orchestra.run.smithi177.stdout: "bluestore_blob_bytes": 0, 2024-08-31T04:38:56.584 INFO:teuthology.orchestra.run.smithi177.stdout: "bluestore_blob_items": 0, 2024-08-31T04:38:56.584 INFO:teuthology.orchestra.run.smithi177.stdout: "bluestore_shared_blob_bytes": 0, 2024-08-31T04:38:56.584 INFO:teuthology.orchestra.run.smithi177.stdout: "bluestore_shared_blob_items": 0, 2024-08-31T04:38:56.584 INFO:teuthology.orchestra.run.smithi177.stdout: "bluestore_inline_bl_bytes": 0, 2024-08-31T04:38:56.585 INFO:teuthology.orchestra.run.smithi177.stdout: "bluestore_inline_bl_items": 0, 2024-08-31T04:38:56.585 INFO:teuthology.orchestra.run.smithi177.stdout: "bluestore_fsck_bytes": 0, 2024-08-31T04:38:56.585 INFO:teuthology.orchestra.run.smithi177.stdout: "bluestore_fsck_items": 0, 2024-08-31T04:38:56.585 INFO:teuthology.orchestra.run.smithi177.stdout: "bluestore_txc_bytes": 0, 2024-08-31T04:38:56.585 INFO:teuthology.orchestra.run.smithi177.stdout: "bluestore_txc_items": 0, 2024-08-31T04:38:56.585 INFO:teuthology.orchestra.run.smithi177.stdout: "bluestore_writing_deferred_bytes": 0, 2024-08-31T04:38:56.586 INFO:teuthology.orchestra.run.smithi177.stdout: "bluestore_writing_deferred_items": 0, 2024-08-31T04:38:56.586 INFO:teuthology.orchestra.run.smithi177.stdout: "bluestore_writing_bytes": 0, 2024-08-31T04:38:56.586 INFO:teuthology.orchestra.run.smithi177.stdout: "bluestore_writing_items": 0, 2024-08-31T04:38:56.586 INFO:teuthology.orchestra.run.smithi177.stdout: "bluefs_bytes": 0, 2024-08-31T04:38:56.586 INFO:teuthology.orchestra.run.smithi177.stdout: "bluefs_items": 0, 2024-08-31T04:38:56.586 INFO:teuthology.orchestra.run.smithi177.stdout: "bluefs_file_reader_bytes": 0, 2024-08-31T04:38:56.586 INFO:teuthology.orchestra.run.smithi177.stdout: "bluefs_file_reader_items": 0, 2024-08-31T04:38:56.586 INFO:teuthology.orchestra.run.smithi177.stdout: "bluefs_file_writer_bytes": 0, 2024-08-31T04:38:56.586 INFO:teuthology.orchestra.run.smithi177.stdout: "bluefs_file_writer_items": 0, 2024-08-31T04:38:56.586 INFO:teuthology.orchestra.run.smithi177.stdout: "buffer_anon_bytes": 149998, 2024-08-31T04:38:56.587 INFO:teuthology.orchestra.run.smithi177.stdout: "buffer_anon_items": 30, 2024-08-31T04:38:56.587 INFO:teuthology.orchestra.run.smithi177.stdout: "buffer_meta_bytes": 0, 2024-08-31T04:38:56.587 INFO:teuthology.orchestra.run.smithi177.stdout: "buffer_meta_items": 0, 2024-08-31T04:38:56.587 INFO:teuthology.orchestra.run.smithi177.stdout: "osd_bytes": 0, 2024-08-31T04:38:56.587 INFO:teuthology.orchestra.run.smithi177.stdout: "osd_items": 0, 2024-08-31T04:38:56.587 INFO:teuthology.orchestra.run.smithi177.stdout: "osd_mapbl_bytes": 0, 2024-08-31T04:38:56.587 INFO:teuthology.orchestra.run.smithi177.stdout: "osd_mapbl_items": 0, 2024-08-31T04:38:56.587 INFO:teuthology.orchestra.run.smithi177.stdout: "osd_pglog_bytes": 0, 2024-08-31T04:38:56.587 INFO:teuthology.orchestra.run.smithi177.stdout: "osd_pglog_items": 0, 2024-08-31T04:38:56.588 INFO:teuthology.orchestra.run.smithi177.stdout: "osdmap_bytes": 0, 2024-08-31T04:38:56.588 INFO:teuthology.orchestra.run.smithi177.stdout: "osdmap_items": 0, 2024-08-31T04:38:56.588 INFO:teuthology.orchestra.run.smithi177.stdout: "osdmap_mapping_bytes": 0, 2024-08-31T04:38:56.588 INFO:teuthology.orchestra.run.smithi177.stdout: "osdmap_mapping_items": 0, 2024-08-31T04:38:56.588 INFO:teuthology.orchestra.run.smithi177.stdout: "pgmap_bytes": 0, 2024-08-31T04:38:56.588 INFO:teuthology.orchestra.run.smithi177.stdout: "pgmap_items": 0, 2024-08-31T04:38:56.588 INFO:teuthology.orchestra.run.smithi177.stdout: "mds_co_bytes": 928, 2024-08-31T04:38:56.588 INFO:teuthology.orchestra.run.smithi177.stdout: "mds_co_items": 2, 2024-08-31T04:38:56.588 INFO:teuthology.orchestra.run.smithi177.stdout: "unittest_1_bytes": 0, 2024-08-31T04:38:56.589 INFO:teuthology.orchestra.run.smithi177.stdout: "unittest_1_items": 0, 2024-08-31T04:38:56.589 INFO:teuthology.orchestra.run.smithi177.stdout: "unittest_2_bytes": 0, 2024-08-31T04:38:56.589 INFO:teuthology.orchestra.run.smithi177.stdout: "unittest_2_items": 0 2024-08-31T04:38:56.589 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-08-31T04:38:56.589 INFO:teuthology.orchestra.run.smithi177.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-08-31T04:38:56.589 INFO:teuthology.orchestra.run.smithi177.stdout: "val": 0, 2024-08-31T04:38:56.589 INFO:teuthology.orchestra.run.smithi177.stdout: "max": 104857600, 2024-08-31T04:38:56.589 INFO:teuthology.orchestra.run.smithi177.stdout: "get_started": 0, 2024-08-31T04:38:56.589 INFO:teuthology.orchestra.run.smithi177.stdout: "get": 168, 2024-08-31T04:38:56.590 INFO:teuthology.orchestra.run.smithi177.stdout: "get_sum": 179054, 2024-08-31T04:38:56.590 INFO:teuthology.orchestra.run.smithi177.stdout: "get_or_fail_fail": 0, 2024-08-31T04:38:56.590 INFO:teuthology.orchestra.run.smithi177.stdout: "get_or_fail_success": 168, 2024-08-31T04:38:56.590 INFO:teuthology.orchestra.run.smithi177.stdout: "take": 0, 2024-08-31T04:38:56.590 INFO:teuthology.orchestra.run.smithi177.stdout: "take_sum": 0, 2024-08-31T04:38:56.591 INFO:teuthology.orchestra.run.smithi177.stdout: "put": 168, 2024-08-31T04:38:56.591 INFO:teuthology.orchestra.run.smithi177.stdout: "put_sum": 179054, 2024-08-31T04:38:56.591 INFO:teuthology.orchestra.run.smithi177.stdout: "wait": { 2024-08-31T04:38:56.591 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 0, 2024-08-31T04:38:56.591 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.000000000, 2024-08-31T04:38:56.591 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000000000 2024-08-31T04:38:56.591 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-08-31T04:38:56.592 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-08-31T04:38:56.592 INFO:teuthology.orchestra.run.smithi177.stdout:} 2024-08-31T04:38:57.506 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.f 2024-08-31T04:38:57.506 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.f 2024-08-31T04:38:57.507 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.f 2024-08-31T04:38:57.507 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.f 2024-08-31T04:38:57.507 WARNING:tasks.check_counter:Counter 'mds.dir_split' not found on daemon mds.f 2024-08-31T04:38:57.507 DEBUG:tasks.check_counter:Getting stats from i 2024-08-31T04:38:57.507 DEBUG:teuthology.orchestra.run.smithi177:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 058d9fc6-674f-11ef-bcd4-c7b262605968 -- ceph daemon mds.i perf dump 2024-08-31T04:38:57.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:38:57 smithi050 ceph-mon[17259]: pgmap v850: 97 pgs: 97 active+clean; 592 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 9 op/s 2024-08-31T04:38:57.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:38:57 smithi177 ceph-mon[22025]: pgmap v850: 97 pgs: 97 active+clean; 592 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 9 op/s 2024-08-31T04:38:57.764 INFO:teuthology.orchestra.run.smithi177.stderr:Inferring config /var/lib/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/mon.c/config 2024-08-31T04:38:58.043 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:38:57 smithi133 ceph-mon[22177]: pgmap v850: 97 pgs: 97 active+clean; 592 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 9 op/s 2024-08-31T04:38:58.301 INFO:teuthology.orchestra.run.smithi177.stdout:{ 2024-08-31T04:38:58.301 INFO:teuthology.orchestra.run.smithi177.stdout: "AsyncMessenger::Worker-0": { 2024-08-31T04:38:58.301 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_recv_messages": 166178, 2024-08-31T04:38:58.301 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_send_messages": 244665, 2024-08-31T04:38:58.301 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_recv_bytes": 54457410, 2024-08-31T04:38:58.301 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_send_bytes": 212274719, 2024-08-31T04:38:58.301 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_created_connections": 18, 2024-08-31T04:38:58.301 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_active_connections": 6, 2024-08-31T04:38:58.302 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_running_total_time": 10.587639998, 2024-08-31T04:38:58.302 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_running_send_time": 6.722468184, 2024-08-31T04:38:58.302 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_running_recv_time": 6.152065105, 2024-08-31T04:38:58.302 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_running_fast_dispatch_time": 0.297050827, 2024-08-31T04:38:58.302 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_send_messages_queue_lat": { 2024-08-31T04:38:58.302 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 244661, 2024-08-31T04:38:58.302 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 3335.401048667, 2024-08-31T04:38:58.302 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.013632745 2024-08-31T04:38:58.302 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-08-31T04:38:58.302 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_handle_ack_lat": { 2024-08-31T04:38:58.302 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 155038, 2024-08-31T04:38:58.302 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.042830345, 2024-08-31T04:38:58.302 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000000276 2024-08-31T04:38:58.303 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-08-31T04:38:58.303 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_recv_encrypted_bytes": 1584, 2024-08-31T04:38:58.303 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_send_encrypted_bytes": 1440 2024-08-31T04:38:58.303 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-08-31T04:38:58.303 INFO:teuthology.orchestra.run.smithi177.stdout: "AsyncMessenger::Worker-1": { 2024-08-31T04:38:58.303 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_recv_messages": 31614, 2024-08-31T04:38:58.303 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_send_messages": 28029, 2024-08-31T04:38:58.303 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_recv_bytes": 12143090, 2024-08-31T04:38:58.303 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_send_bytes": 64590045, 2024-08-31T04:38:58.303 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_created_connections": 10, 2024-08-31T04:38:58.303 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_active_connections": 6, 2024-08-31T04:38:58.303 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_running_total_time": 2.374735969, 2024-08-31T04:38:58.303 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_running_send_time": 1.176295630, 2024-08-31T04:38:58.304 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_running_recv_time": 1.116324436, 2024-08-31T04:38:58.304 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_running_fast_dispatch_time": 0.279895888, 2024-08-31T04:38:58.304 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_send_messages_queue_lat": { 2024-08-31T04:38:58.304 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 28030, 2024-08-31T04:38:58.304 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 2.349354457, 2024-08-31T04:38:58.304 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000083815 2024-08-31T04:38:58.304 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-08-31T04:38:58.304 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_handle_ack_lat": { 2024-08-31T04:38:58.304 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 43845, 2024-08-31T04:38:58.304 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.007568767, 2024-08-31T04:38:58.304 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000000172 2024-08-31T04:38:58.304 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-08-31T04:38:58.305 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_recv_encrypted_bytes": 876512, 2024-08-31T04:38:58.305 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_send_encrypted_bytes": 191808 2024-08-31T04:38:58.305 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-08-31T04:38:58.305 INFO:teuthology.orchestra.run.smithi177.stdout: "AsyncMessenger::Worker-2": { 2024-08-31T04:38:58.305 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_recv_messages": 34501, 2024-08-31T04:38:58.305 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_send_messages": 30317, 2024-08-31T04:38:58.305 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_recv_bytes": 17326871, 2024-08-31T04:38:58.305 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_send_bytes": 30825037, 2024-08-31T04:38:58.305 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_created_connections": 11, 2024-08-31T04:38:58.305 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_active_connections": 6, 2024-08-31T04:38:58.305 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_running_total_time": 2.369157180, 2024-08-31T04:38:58.305 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_running_send_time": 1.202903408, 2024-08-31T04:38:58.305 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_running_recv_time": 1.315653271, 2024-08-31T04:38:58.306 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_running_fast_dispatch_time": 0.108853342, 2024-08-31T04:38:58.306 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_send_messages_queue_lat": { 2024-08-31T04:38:58.306 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 30316, 2024-08-31T04:38:58.306 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 1.061986394, 2024-08-31T04:38:58.306 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000035030 2024-08-31T04:38:58.306 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-08-31T04:38:58.306 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_handle_ack_lat": { 2024-08-31T04:38:58.306 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 55610, 2024-08-31T04:38:58.306 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.009508180, 2024-08-31T04:38:58.306 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000000170 2024-08-31T04:38:58.306 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-08-31T04:38:58.306 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_recv_encrypted_bytes": 3152, 2024-08-31T04:38:58.306 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_send_encrypted_bytes": 487584 2024-08-31T04:38:58.307 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-08-31T04:38:58.307 INFO:teuthology.orchestra.run.smithi177.stdout: "cct": { 2024-08-31T04:38:58.307 INFO:teuthology.orchestra.run.smithi177.stdout: "total_workers": 1, 2024-08-31T04:38:58.307 INFO:teuthology.orchestra.run.smithi177.stdout: "unhealthy_workers": 0 2024-08-31T04:38:58.307 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-08-31T04:38:58.307 INFO:teuthology.orchestra.run.smithi177.stdout: "finisher-MDSRank": { 2024-08-31T04:38:58.307 INFO:teuthology.orchestra.run.smithi177.stdout: "queue_len": 0, 2024-08-31T04:38:58.307 INFO:teuthology.orchestra.run.smithi177.stdout: "complete_latency": { 2024-08-31T04:38:58.307 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 5216, 2024-08-31T04:38:58.307 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 48.190622439, 2024-08-31T04:38:58.307 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.009238999 2024-08-31T04:38:58.307 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-08-31T04:38:58.307 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-08-31T04:38:58.307 INFO:teuthology.orchestra.run.smithi177.stdout: "finisher-PurgeQueue": { 2024-08-31T04:38:58.308 INFO:teuthology.orchestra.run.smithi177.stdout: "queue_len": 0, 2024-08-31T04:38:58.308 INFO:teuthology.orchestra.run.smithi177.stdout: "complete_latency": { 2024-08-31T04:38:58.308 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 14666, 2024-08-31T04:38:58.308 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 3.099400227, 2024-08-31T04:38:58.308 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000211332 2024-08-31T04:38:58.308 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-08-31T04:38:58.308 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-08-31T04:38:58.308 INFO:teuthology.orchestra.run.smithi177.stdout: "mds": { 2024-08-31T04:38:58.308 INFO:teuthology.orchestra.run.smithi177.stdout: "request": 83021, 2024-08-31T04:38:58.308 INFO:teuthology.orchestra.run.smithi177.stdout: "reply": 74436, 2024-08-31T04:38:58.308 INFO:teuthology.orchestra.run.smithi177.stdout: "reply_latency": { 2024-08-31T04:38:58.308 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 74436, 2024-08-31T04:38:58.308 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 675.906489925, 2024-08-31T04:38:58.309 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.009080370 2024-08-31T04:38:58.309 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-08-31T04:38:58.309 INFO:teuthology.orchestra.run.smithi177.stdout: "slow_reply": 0, 2024-08-31T04:38:58.309 INFO:teuthology.orchestra.run.smithi177.stdout: "forward": 8585, 2024-08-31T04:38:58.309 INFO:teuthology.orchestra.run.smithi177.stdout: "dir_fetch_complete": 6, 2024-08-31T04:38:58.309 INFO:teuthology.orchestra.run.smithi177.stdout: "dir_fetch_keys": 0, 2024-08-31T04:38:58.309 INFO:teuthology.orchestra.run.smithi177.stdout: "dir_commit": 671, 2024-08-31T04:38:58.309 INFO:teuthology.orchestra.run.smithi177.stdout: "dir_split": 74, 2024-08-31T04:38:58.309 INFO:teuthology.orchestra.run.smithi177.stdout: "dir_merge": 0, 2024-08-31T04:38:58.309 INFO:teuthology.orchestra.run.smithi177.stdout: "inodes": 47, 2024-08-31T04:38:58.309 INFO:teuthology.orchestra.run.smithi177.stdout: "inodes_top": 21, 2024-08-31T04:38:58.309 INFO:teuthology.orchestra.run.smithi177.stdout: "inodes_bottom": 15, 2024-08-31T04:38:58.309 INFO:teuthology.orchestra.run.smithi177.stdout: "inodes_pin_tail": 11, 2024-08-31T04:38:58.310 INFO:teuthology.orchestra.run.smithi177.stdout: "inodes_pinned": 14, 2024-08-31T04:38:58.310 INFO:teuthology.orchestra.run.smithi177.stdout: "inodes_expired": 27124, 2024-08-31T04:38:58.310 INFO:teuthology.orchestra.run.smithi177.stdout: "inodes_with_caps": 0, 2024-08-31T04:38:58.310 INFO:teuthology.orchestra.run.smithi177.stdout: "caps": 0, 2024-08-31T04:38:58.310 INFO:teuthology.orchestra.run.smithi177.stdout: "subtrees": 3, 2024-08-31T04:38:58.310 INFO:teuthology.orchestra.run.smithi177.stdout: "traverse": 136686, 2024-08-31T04:38:58.310 INFO:teuthology.orchestra.run.smithi177.stdout: "traverse_hit": 106883, 2024-08-31T04:38:58.310 INFO:teuthology.orchestra.run.smithi177.stdout: "traverse_forward": 8405, 2024-08-31T04:38:58.310 INFO:teuthology.orchestra.run.smithi177.stdout: "traverse_discover": 865, 2024-08-31T04:38:58.310 INFO:teuthology.orchestra.run.smithi177.stdout: "traverse_dir_fetch": 2, 2024-08-31T04:38:58.310 INFO:teuthology.orchestra.run.smithi177.stdout: "traverse_remote_ino": 0, 2024-08-31T04:38:58.310 INFO:teuthology.orchestra.run.smithi177.stdout: "traverse_lock": 100, 2024-08-31T04:38:58.310 INFO:teuthology.orchestra.run.smithi177.stdout: "load_cent": 1000, 2024-08-31T04:38:58.310 INFO:teuthology.orchestra.run.smithi177.stdout: "q": 1, 2024-08-31T04:38:58.311 INFO:teuthology.orchestra.run.smithi177.stdout: "exported": 139, 2024-08-31T04:38:58.311 INFO:teuthology.orchestra.run.smithi177.stdout: "exported_inodes": 20733, 2024-08-31T04:38:58.311 INFO:teuthology.orchestra.run.smithi177.stdout: "imported": 165, 2024-08-31T04:38:58.311 INFO:teuthology.orchestra.run.smithi177.stdout: "imported_inodes": 9173, 2024-08-31T04:38:58.311 INFO:teuthology.orchestra.run.smithi177.stdout: "openino_dir_fetch": 0, 2024-08-31T04:38:58.311 INFO:teuthology.orchestra.run.smithi177.stdout: "openino_backtrace_fetch": 0, 2024-08-31T04:38:58.311 INFO:teuthology.orchestra.run.smithi177.stdout: "openino_peer_discover": 0, 2024-08-31T04:38:58.311 INFO:teuthology.orchestra.run.smithi177.stdout: "root_rfiles": 21361, 2024-08-31T04:38:58.311 INFO:teuthology.orchestra.run.smithi177.stdout: "root_rbytes": 475116081, 2024-08-31T04:38:58.311 INFO:teuthology.orchestra.run.smithi177.stdout: "root_rsnaps": 0, 2024-08-31T04:38:58.311 INFO:teuthology.orchestra.run.smithi177.stdout: "scrub_backtrace_fetch": 0, 2024-08-31T04:38:58.311 INFO:teuthology.orchestra.run.smithi177.stdout: "scrub_set_tag": 0, 2024-08-31T04:38:58.311 INFO:teuthology.orchestra.run.smithi177.stdout: "scrub_backtrace_repaired": 0, 2024-08-31T04:38:58.312 INFO:teuthology.orchestra.run.smithi177.stdout: "scrub_inotable_repaired": 0, 2024-08-31T04:38:58.312 INFO:teuthology.orchestra.run.smithi177.stdout: "scrub_dir_inodes": 0, 2024-08-31T04:38:58.312 INFO:teuthology.orchestra.run.smithi177.stdout: "scrub_dir_base_inodes": 0, 2024-08-31T04:38:58.312 INFO:teuthology.orchestra.run.smithi177.stdout: "scrub_dirfrag_rstats": 0, 2024-08-31T04:38:58.312 INFO:teuthology.orchestra.run.smithi177.stdout: "scrub_file_inodes": 0, 2024-08-31T04:38:58.312 INFO:teuthology.orchestra.run.smithi177.stdout: "handle_inode_file_caps": 180, 2024-08-31T04:38:58.312 INFO:teuthology.orchestra.run.smithi177.stdout: "ceph_cap_op_revoke": 42387, 2024-08-31T04:38:58.312 INFO:teuthology.orchestra.run.smithi177.stdout: "ceph_cap_op_grant": 34009, 2024-08-31T04:38:58.312 INFO:teuthology.orchestra.run.smithi177.stdout: "ceph_cap_op_trunc": 0, 2024-08-31T04:38:58.312 INFO:teuthology.orchestra.run.smithi177.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-08-31T04:38:58.312 INFO:teuthology.orchestra.run.smithi177.stdout: "ceph_cap_op_flush_ack": 0, 2024-08-31T04:38:58.312 INFO:teuthology.orchestra.run.smithi177.stdout: "handle_client_caps": 50787, 2024-08-31T04:38:58.312 INFO:teuthology.orchestra.run.smithi177.stdout: "handle_client_caps_dirty": 14619, 2024-08-31T04:38:58.313 INFO:teuthology.orchestra.run.smithi177.stdout: "handle_client_cap_release": 3145, 2024-08-31T04:38:58.313 INFO:teuthology.orchestra.run.smithi177.stdout: "process_request_cap_release": 25672 2024-08-31T04:38:58.313 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-08-31T04:38:58.313 INFO:teuthology.orchestra.run.smithi177.stdout: "mds_cache": { 2024-08-31T04:38:58.313 INFO:teuthology.orchestra.run.smithi177.stdout: "dir_update": 2705, 2024-08-31T04:38:58.313 INFO:teuthology.orchestra.run.smithi177.stdout: "dir_update_receipt": 10047, 2024-08-31T04:38:58.313 INFO:teuthology.orchestra.run.smithi177.stdout: "dir_try_discover": 5914, 2024-08-31T04:38:58.313 INFO:teuthology.orchestra.run.smithi177.stdout: "dir_send_discover": 7602, 2024-08-31T04:38:58.313 INFO:teuthology.orchestra.run.smithi177.stdout: "dir_handle_discover": 4506, 2024-08-31T04:38:58.313 INFO:teuthology.orchestra.run.smithi177.stdout: "num_strays": 1, 2024-08-31T04:38:58.313 INFO:teuthology.orchestra.run.smithi177.stdout: "num_strays_delayed": 0, 2024-08-31T04:38:58.313 INFO:teuthology.orchestra.run.smithi177.stdout: "num_strays_enqueuing": 0, 2024-08-31T04:38:58.313 INFO:teuthology.orchestra.run.smithi177.stdout: "strays_created": 7587, 2024-08-31T04:38:58.314 INFO:teuthology.orchestra.run.smithi177.stdout: "strays_enqueued": 7586, 2024-08-31T04:38:58.314 INFO:teuthology.orchestra.run.smithi177.stdout: "strays_reintegrated": 0, 2024-08-31T04:38:58.314 INFO:teuthology.orchestra.run.smithi177.stdout: "strays_migrated": 0, 2024-08-31T04:38:58.314 INFO:teuthology.orchestra.run.smithi177.stdout: "num_recovering_processing": 0, 2024-08-31T04:38:58.314 INFO:teuthology.orchestra.run.smithi177.stdout: "num_recovering_enqueued": 0, 2024-08-31T04:38:58.314 INFO:teuthology.orchestra.run.smithi177.stdout: "num_recovering_prioritized": 0, 2024-08-31T04:38:58.314 INFO:teuthology.orchestra.run.smithi177.stdout: "recovery_started": 0, 2024-08-31T04:38:58.314 INFO:teuthology.orchestra.run.smithi177.stdout: "recovery_completed": 0, 2024-08-31T04:38:58.314 INFO:teuthology.orchestra.run.smithi177.stdout: "ireq_quiesce_path": 5, 2024-08-31T04:38:58.314 INFO:teuthology.orchestra.run.smithi177.stdout: "ireq_quiesce_inode": 23254, 2024-08-31T04:38:58.314 INFO:teuthology.orchestra.run.smithi177.stdout: "ireq_enqueue_scrub": 0, 2024-08-31T04:38:58.314 INFO:teuthology.orchestra.run.smithi177.stdout: "ireq_exportdir": 139, 2024-08-31T04:38:58.314 INFO:teuthology.orchestra.run.smithi177.stdout: "ireq_flush": 0, 2024-08-31T04:38:58.314 INFO:teuthology.orchestra.run.smithi177.stdout: "ireq_fragmentdir": 74, 2024-08-31T04:38:58.315 INFO:teuthology.orchestra.run.smithi177.stdout: "ireq_fragstats": 0, 2024-08-31T04:38:58.315 INFO:teuthology.orchestra.run.smithi177.stdout: "ireq_inodestats": 0, 2024-08-31T04:38:58.315 INFO:teuthology.orchestra.run.smithi177.stdout: "uninline_started": 0, 2024-08-31T04:38:58.315 INFO:teuthology.orchestra.run.smithi177.stdout: "uninline_succeeded": 0, 2024-08-31T04:38:58.315 INFO:teuthology.orchestra.run.smithi177.stdout: "uninline_write_failed": 0 2024-08-31T04:38:58.315 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-08-31T04:38:58.315 INFO:teuthology.orchestra.run.smithi177.stdout: "mds_log": { 2024-08-31T04:38:58.315 INFO:teuthology.orchestra.run.smithi177.stdout: "evlrg": 0, 2024-08-31T04:38:58.315 INFO:teuthology.orchestra.run.smithi177.stdout: "evadd": 77296, 2024-08-31T04:38:58.315 INFO:teuthology.orchestra.run.smithi177.stdout: "evex": 0, 2024-08-31T04:38:58.315 INFO:teuthology.orchestra.run.smithi177.stdout: "evtrm": 0, 2024-08-31T04:38:58.315 INFO:teuthology.orchestra.run.smithi177.stdout: "ev": 77296, 2024-08-31T04:38:58.315 INFO:teuthology.orchestra.run.smithi177.stdout: "evexg": 0, 2024-08-31T04:38:58.315 INFO:teuthology.orchestra.run.smithi177.stdout: "evexd": 0, 2024-08-31T04:38:58.316 INFO:teuthology.orchestra.run.smithi177.stdout: "segadd": 96, 2024-08-31T04:38:58.316 INFO:teuthology.orchestra.run.smithi177.stdout: "segex": 0, 2024-08-31T04:38:58.316 INFO:teuthology.orchestra.run.smithi177.stdout: "segtrm": 0, 2024-08-31T04:38:58.316 INFO:teuthology.orchestra.run.smithi177.stdout: "seg": 96, 2024-08-31T04:38:58.316 INFO:teuthology.orchestra.run.smithi177.stdout: "segmjr": 8, 2024-08-31T04:38:58.316 INFO:teuthology.orchestra.run.smithi177.stdout: "segexg": 0, 2024-08-31T04:38:58.316 INFO:teuthology.orchestra.run.smithi177.stdout: "segexd": 0, 2024-08-31T04:38:58.316 INFO:teuthology.orchestra.run.smithi177.stdout: "expos": 4194304, 2024-08-31T04:38:58.316 INFO:teuthology.orchestra.run.smithi177.stdout: "wrpos": 169696307, 2024-08-31T04:38:58.316 INFO:teuthology.orchestra.run.smithi177.stdout: "rdpos": 0, 2024-08-31T04:38:58.316 INFO:teuthology.orchestra.run.smithi177.stdout: "jlat": { 2024-08-31T04:38:58.316 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 6250, 2024-08-31T04:38:58.316 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 2559.965735656, 2024-08-31T04:38:58.317 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.409594517 2024-08-31T04:38:58.317 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-08-31T04:38:58.317 INFO:teuthology.orchestra.run.smithi177.stdout: "replayed": 0 2024-08-31T04:38:58.317 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-08-31T04:38:58.317 INFO:teuthology.orchestra.run.smithi177.stdout: "mds_mem": { 2024-08-31T04:38:58.317 INFO:teuthology.orchestra.run.smithi177.stdout: "ino": 26, 2024-08-31T04:38:58.317 INFO:teuthology.orchestra.run.smithi177.stdout: "ino+": 19514, 2024-08-31T04:38:58.317 INFO:teuthology.orchestra.run.smithi177.stdout: "ino-": 19488, 2024-08-31T04:38:58.317 INFO:teuthology.orchestra.run.smithi177.stdout: "dir": 29, 2024-08-31T04:38:58.317 INFO:teuthology.orchestra.run.smithi177.stdout: "dir+": 5091, 2024-08-31T04:38:58.317 INFO:teuthology.orchestra.run.smithi177.stdout: "dir-": 5062, 2024-08-31T04:38:58.317 INFO:teuthology.orchestra.run.smithi177.stdout: "dn": 47, 2024-08-31T04:38:58.317 INFO:teuthology.orchestra.run.smithi177.stdout: "dn+": 45763, 2024-08-31T04:38:58.318 INFO:teuthology.orchestra.run.smithi177.stdout: "dn-": 45716, 2024-08-31T04:38:58.318 INFO:teuthology.orchestra.run.smithi177.stdout: "cap": 0, 2024-08-31T04:38:58.318 INFO:teuthology.orchestra.run.smithi177.stdout: "cap+": 26777, 2024-08-31T04:38:58.318 INFO:teuthology.orchestra.run.smithi177.stdout: "cap-": 26777, 2024-08-31T04:38:58.318 INFO:teuthology.orchestra.run.smithi177.stdout: "rss": 208412, 2024-08-31T04:38:58.318 INFO:teuthology.orchestra.run.smithi177.stdout: "heap": 574496768 2024-08-31T04:38:58.318 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-08-31T04:38:58.318 INFO:teuthology.orchestra.run.smithi177.stdout: "mds_server": { 2024-08-31T04:38:58.318 INFO:teuthology.orchestra.run.smithi177.stdout: "dispatch_client_request": 85419, 2024-08-31T04:38:58.318 INFO:teuthology.orchestra.run.smithi177.stdout: "dispatch_server_request": 1579, 2024-08-31T04:38:58.318 INFO:teuthology.orchestra.run.smithi177.stdout: "handle_client_request": 83021, 2024-08-31T04:38:58.318 INFO:teuthology.orchestra.run.smithi177.stdout: "handle_client_session": 178, 2024-08-31T04:38:58.318 INFO:teuthology.orchestra.run.smithi177.stdout: "handle_peer_request": 2598, 2024-08-31T04:38:58.318 INFO:teuthology.orchestra.run.smithi177.stdout: "req_create_latency": { 2024-08-31T04:38:58.319 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 13723, 2024-08-31T04:38:58.319 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 25.656760214, 2024-08-31T04:38:58.319 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.001869617 2024-08-31T04:38:58.319 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-08-31T04:38:58.319 INFO:teuthology.orchestra.run.smithi177.stdout: "req_getattr_latency": { 2024-08-31T04:38:58.319 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 212, 2024-08-31T04:38:58.319 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 26.381429158, 2024-08-31T04:38:58.319 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.124440703 2024-08-31T04:38:58.319 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-08-31T04:38:58.319 INFO:teuthology.orchestra.run.smithi177.stdout: "req_getfilelock_latency": { 2024-08-31T04:38:58.319 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 0, 2024-08-31T04:38:58.319 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.000000000, 2024-08-31T04:38:58.319 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000000000 2024-08-31T04:38:58.320 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-08-31T04:38:58.320 INFO:teuthology.orchestra.run.smithi177.stdout: "req_link_latency": { 2024-08-31T04:38:58.320 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 0, 2024-08-31T04:38:58.320 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.000000000, 2024-08-31T04:38:58.320 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000000000 2024-08-31T04:38:58.320 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-08-31T04:38:58.320 INFO:teuthology.orchestra.run.smithi177.stdout: "req_lookup_latency": { 2024-08-31T04:38:58.320 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 31749, 2024-08-31T04:38:58.320 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 355.159082654, 2024-08-31T04:38:58.320 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.011186465 2024-08-31T04:38:58.320 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-08-31T04:38:58.320 INFO:teuthology.orchestra.run.smithi177.stdout: "req_lookuphash_latency": { 2024-08-31T04:38:58.320 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 0, 2024-08-31T04:38:58.320 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.000000000, 2024-08-31T04:38:58.321 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000000000 2024-08-31T04:38:58.321 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-08-31T04:38:58.321 INFO:teuthology.orchestra.run.smithi177.stdout: "req_lookupino_latency": { 2024-08-31T04:38:58.321 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 0, 2024-08-31T04:38:58.321 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.000000000, 2024-08-31T04:38:58.321 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000000000 2024-08-31T04:38:58.321 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-08-31T04:38:58.321 INFO:teuthology.orchestra.run.smithi177.stdout: "req_lookupname_latency": { 2024-08-31T04:38:58.321 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 0, 2024-08-31T04:38:58.321 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.000000000, 2024-08-31T04:38:58.321 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000000000 2024-08-31T04:38:58.321 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-08-31T04:38:58.321 INFO:teuthology.orchestra.run.smithi177.stdout: "req_lookupparent_latency": { 2024-08-31T04:38:58.322 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 0, 2024-08-31T04:38:58.322 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.000000000, 2024-08-31T04:38:58.322 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000000000 2024-08-31T04:38:58.322 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-08-31T04:38:58.322 INFO:teuthology.orchestra.run.smithi177.stdout: "req_lookupsnap_latency": { 2024-08-31T04:38:58.322 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 0, 2024-08-31T04:38:58.322 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.000000000, 2024-08-31T04:38:58.322 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000000000 2024-08-31T04:38:58.323 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-08-31T04:38:58.323 INFO:teuthology.orchestra.run.smithi177.stdout: "req_lssnap_latency": { 2024-08-31T04:38:58.323 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 0, 2024-08-31T04:38:58.323 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.000000000, 2024-08-31T04:38:58.323 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000000000 2024-08-31T04:38:58.323 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-08-31T04:38:58.323 INFO:teuthology.orchestra.run.smithi177.stdout: "req_mkdir_latency": { 2024-08-31T04:38:58.323 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 92, 2024-08-31T04:38:58.323 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 1.644976211, 2024-08-31T04:38:58.323 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.017880176 2024-08-31T04:38:58.323 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-08-31T04:38:58.323 INFO:teuthology.orchestra.run.smithi177.stdout: "req_mknod_latency": { 2024-08-31T04:38:58.323 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 0, 2024-08-31T04:38:58.324 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.000000000, 2024-08-31T04:38:58.324 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000000000 2024-08-31T04:38:58.324 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-08-31T04:38:58.324 INFO:teuthology.orchestra.run.smithi177.stdout: "req_mksnap_latency": { 2024-08-31T04:38:58.324 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 0, 2024-08-31T04:38:58.324 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.000000000, 2024-08-31T04:38:58.324 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000000000 2024-08-31T04:38:58.324 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-08-31T04:38:58.324 INFO:teuthology.orchestra.run.smithi177.stdout: "req_open_latency": { 2024-08-31T04:38:58.324 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 8272, 2024-08-31T04:38:58.324 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 23.275133925, 2024-08-31T04:38:58.324 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.002813725 2024-08-31T04:38:58.324 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-08-31T04:38:58.325 INFO:teuthology.orchestra.run.smithi177.stdout: "req_readdir_latency": { 2024-08-31T04:38:58.325 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 262, 2024-08-31T04:38:58.325 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.425702887, 2024-08-31T04:38:58.325 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.001624820 2024-08-31T04:38:58.325 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-08-31T04:38:58.325 INFO:teuthology.orchestra.run.smithi177.stdout: "req_rename_latency": { 2024-08-31T04:38:58.325 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 13704, 2024-08-31T04:38:58.325 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 227.960261818, 2024-08-31T04:38:58.325 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.016634578 2024-08-31T04:38:58.325 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-08-31T04:38:58.325 INFO:teuthology.orchestra.run.smithi177.stdout: "req_renamesnap_latency": { 2024-08-31T04:38:58.325 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 0, 2024-08-31T04:38:58.325 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.000000000, 2024-08-31T04:38:58.326 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000000000 2024-08-31T04:38:58.326 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-08-31T04:38:58.326 INFO:teuthology.orchestra.run.smithi177.stdout: "req_snapdiff_latency": { 2024-08-31T04:38:58.326 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 0, 2024-08-31T04:38:58.326 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.000000000, 2024-08-31T04:38:58.326 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000000000 2024-08-31T04:38:58.326 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-08-31T04:38:58.326 INFO:teuthology.orchestra.run.smithi177.stdout: "req_rmdir_latency": { 2024-08-31T04:38:58.326 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 54, 2024-08-31T04:38:58.326 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 6.295376694, 2024-08-31T04:38:58.326 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.116581049 2024-08-31T04:38:58.326 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-08-31T04:38:58.326 INFO:teuthology.orchestra.run.smithi177.stdout: "req_rmsnap_latency": { 2024-08-31T04:38:58.327 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 0, 2024-08-31T04:38:58.327 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.000000000, 2024-08-31T04:38:58.327 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000000000 2024-08-31T04:38:58.327 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-08-31T04:38:58.327 INFO:teuthology.orchestra.run.smithi177.stdout: "req_rmxattr_latency": { 2024-08-31T04:38:58.327 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 0, 2024-08-31T04:38:58.327 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.000000000, 2024-08-31T04:38:58.327 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000000000 2024-08-31T04:38:58.327 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-08-31T04:38:58.327 INFO:teuthology.orchestra.run.smithi177.stdout: "req_setattr_latency": { 2024-08-31T04:38:58.327 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 0, 2024-08-31T04:38:58.327 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.000000000, 2024-08-31T04:38:58.327 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000000000 2024-08-31T04:38:58.327 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-08-31T04:38:58.328 INFO:teuthology.orchestra.run.smithi177.stdout: "req_setdirlayout_latency": { 2024-08-31T04:38:58.328 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 0, 2024-08-31T04:38:58.328 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.000000000, 2024-08-31T04:38:58.328 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000000000 2024-08-31T04:38:58.328 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-08-31T04:38:58.328 INFO:teuthology.orchestra.run.smithi177.stdout: "req_setfilelock_latency": { 2024-08-31T04:38:58.328 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 0, 2024-08-31T04:38:58.328 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.000000000, 2024-08-31T04:38:58.328 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000000000 2024-08-31T04:38:58.328 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-08-31T04:38:58.328 INFO:teuthology.orchestra.run.smithi177.stdout: "req_setlayout_latency": { 2024-08-31T04:38:58.328 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 0, 2024-08-31T04:38:58.328 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.000000000, 2024-08-31T04:38:58.329 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000000000 2024-08-31T04:38:58.329 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-08-31T04:38:58.329 INFO:teuthology.orchestra.run.smithi177.stdout: "req_setxattr_latency": { 2024-08-31T04:38:58.329 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 0, 2024-08-31T04:38:58.329 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.000000000, 2024-08-31T04:38:58.329 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000000000 2024-08-31T04:38:58.329 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-08-31T04:38:58.329 INFO:teuthology.orchestra.run.smithi177.stdout: "req_symlink_latency": { 2024-08-31T04:38:58.329 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 0, 2024-08-31T04:38:58.329 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.000000000, 2024-08-31T04:38:58.329 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000000000 2024-08-31T04:38:58.329 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-08-31T04:38:58.329 INFO:teuthology.orchestra.run.smithi177.stdout: "req_unlink_latency": { 2024-08-31T04:38:58.330 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 6368, 2024-08-31T04:38:58.330 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 9.107766364, 2024-08-31T04:38:58.330 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.001430239 2024-08-31T04:38:58.330 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-08-31T04:38:58.330 INFO:teuthology.orchestra.run.smithi177.stdout: "cap_revoke_eviction": 0, 2024-08-31T04:38:58.330 INFO:teuthology.orchestra.run.smithi177.stdout: "cap_acquisition_throttle": 0, 2024-08-31T04:38:58.330 INFO:teuthology.orchestra.run.smithi177.stdout: "req_getvxattr_latency": { 2024-08-31T04:38:58.330 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 0, 2024-08-31T04:38:58.330 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.000000000, 2024-08-31T04:38:58.330 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000000000 2024-08-31T04:38:58.330 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-08-31T04:38:58.330 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-08-31T04:38:58.330 INFO:teuthology.orchestra.run.smithi177.stdout: "mds_sessions": { 2024-08-31T04:38:58.331 INFO:teuthology.orchestra.run.smithi177.stdout: "session_count": 1, 2024-08-31T04:38:58.331 INFO:teuthology.orchestra.run.smithi177.stdout: "session_add": 2, 2024-08-31T04:38:58.331 INFO:teuthology.orchestra.run.smithi177.stdout: "session_remove": 1, 2024-08-31T04:38:58.331 INFO:teuthology.orchestra.run.smithi177.stdout: "sessions_open": 1, 2024-08-31T04:38:58.331 INFO:teuthology.orchestra.run.smithi177.stdout: "sessions_stale": 0, 2024-08-31T04:38:58.331 INFO:teuthology.orchestra.run.smithi177.stdout: "total_load": 1612, 2024-08-31T04:38:58.331 INFO:teuthology.orchestra.run.smithi177.stdout: "average_load": 1612, 2024-08-31T04:38:58.331 INFO:teuthology.orchestra.run.smithi177.stdout: "avg_session_uptime": 956, 2024-08-31T04:38:58.331 INFO:teuthology.orchestra.run.smithi177.stdout: "mdthresh_evicted": 0 2024-08-31T04:38:58.331 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-08-31T04:38:58.331 INFO:teuthology.orchestra.run.smithi177.stdout: "mempool": { 2024-08-31T04:38:58.331 INFO:teuthology.orchestra.run.smithi177.stdout: "bloom_filter_bytes": 0, 2024-08-31T04:38:58.331 INFO:teuthology.orchestra.run.smithi177.stdout: "bloom_filter_items": 0, 2024-08-31T04:38:58.331 INFO:teuthology.orchestra.run.smithi177.stdout: "bluestore_alloc_bytes": 0, 2024-08-31T04:38:58.332 INFO:teuthology.orchestra.run.smithi177.stdout: "bluestore_alloc_items": 0, 2024-08-31T04:38:58.332 INFO:teuthology.orchestra.run.smithi177.stdout: "bluestore_cache_data_bytes": 0, 2024-08-31T04:38:58.332 INFO:teuthology.orchestra.run.smithi177.stdout: "bluestore_cache_data_items": 0, 2024-08-31T04:38:58.332 INFO:teuthology.orchestra.run.smithi177.stdout: "bluestore_cache_onode_bytes": 0, 2024-08-31T04:38:58.332 INFO:teuthology.orchestra.run.smithi177.stdout: "bluestore_cache_onode_items": 0, 2024-08-31T04:38:58.332 INFO:teuthology.orchestra.run.smithi177.stdout: "bluestore_cache_meta_bytes": 0, 2024-08-31T04:38:58.332 INFO:teuthology.orchestra.run.smithi177.stdout: "bluestore_cache_meta_items": 0, 2024-08-31T04:38:58.332 INFO:teuthology.orchestra.run.smithi177.stdout: "bluestore_cache_other_bytes": 0, 2024-08-31T04:38:58.332 INFO:teuthology.orchestra.run.smithi177.stdout: "bluestore_cache_other_items": 0, 2024-08-31T04:38:58.332 INFO:teuthology.orchestra.run.smithi177.stdout: "bluestore_cache_buffer_bytes": 0, 2024-08-31T04:38:58.332 INFO:teuthology.orchestra.run.smithi177.stdout: "bluestore_cache_buffer_items": 0, 2024-08-31T04:38:58.332 INFO:teuthology.orchestra.run.smithi177.stdout: "bluestore_extent_bytes": 0, 2024-08-31T04:38:58.332 INFO:teuthology.orchestra.run.smithi177.stdout: "bluestore_extent_items": 0, 2024-08-31T04:38:58.333 INFO:teuthology.orchestra.run.smithi177.stdout: "bluestore_blob_bytes": 0, 2024-08-31T04:38:58.333 INFO:teuthology.orchestra.run.smithi177.stdout: "bluestore_blob_items": 0, 2024-08-31T04:38:58.333 INFO:teuthology.orchestra.run.smithi177.stdout: "bluestore_shared_blob_bytes": 0, 2024-08-31T04:38:58.333 INFO:teuthology.orchestra.run.smithi177.stdout: "bluestore_shared_blob_items": 0, 2024-08-31T04:38:58.333 INFO:teuthology.orchestra.run.smithi177.stdout: "bluestore_inline_bl_bytes": 0, 2024-08-31T04:38:58.333 INFO:teuthology.orchestra.run.smithi177.stdout: "bluestore_inline_bl_items": 0, 2024-08-31T04:38:58.333 INFO:teuthology.orchestra.run.smithi177.stdout: "bluestore_fsck_bytes": 0, 2024-08-31T04:38:58.333 INFO:teuthology.orchestra.run.smithi177.stdout: "bluestore_fsck_items": 0, 2024-08-31T04:38:58.333 INFO:teuthology.orchestra.run.smithi177.stdout: "bluestore_txc_bytes": 0, 2024-08-31T04:38:58.333 INFO:teuthology.orchestra.run.smithi177.stdout: "bluestore_txc_items": 0, 2024-08-31T04:38:58.333 INFO:teuthology.orchestra.run.smithi177.stdout: "bluestore_writing_deferred_bytes": 0, 2024-08-31T04:38:58.334 INFO:teuthology.orchestra.run.smithi177.stdout: "bluestore_writing_deferred_items": 0, 2024-08-31T04:38:58.334 INFO:teuthology.orchestra.run.smithi177.stdout: "bluestore_writing_bytes": 0, 2024-08-31T04:38:58.334 INFO:teuthology.orchestra.run.smithi177.stdout: "bluestore_writing_items": 0, 2024-08-31T04:38:58.334 INFO:teuthology.orchestra.run.smithi177.stdout: "bluefs_bytes": 0, 2024-08-31T04:38:58.334 INFO:teuthology.orchestra.run.smithi177.stdout: "bluefs_items": 0, 2024-08-31T04:38:58.334 INFO:teuthology.orchestra.run.smithi177.stdout: "bluefs_file_reader_bytes": 0, 2024-08-31T04:38:58.334 INFO:teuthology.orchestra.run.smithi177.stdout: "bluefs_file_reader_items": 0, 2024-08-31T04:38:58.334 INFO:teuthology.orchestra.run.smithi177.stdout: "bluefs_file_writer_bytes": 0, 2024-08-31T04:38:58.334 INFO:teuthology.orchestra.run.smithi177.stdout: "bluefs_file_writer_items": 0, 2024-08-31T04:38:58.334 INFO:teuthology.orchestra.run.smithi177.stdout: "buffer_anon_bytes": 295732, 2024-08-31T04:38:58.334 INFO:teuthology.orchestra.run.smithi177.stdout: "buffer_anon_items": 102, 2024-08-31T04:38:58.334 INFO:teuthology.orchestra.run.smithi177.stdout: "buffer_meta_bytes": 0, 2024-08-31T04:38:58.334 INFO:teuthology.orchestra.run.smithi177.stdout: "buffer_meta_items": 0, 2024-08-31T04:38:58.334 INFO:teuthology.orchestra.run.smithi177.stdout: "osd_bytes": 0, 2024-08-31T04:38:58.335 INFO:teuthology.orchestra.run.smithi177.stdout: "osd_items": 0, 2024-08-31T04:38:58.335 INFO:teuthology.orchestra.run.smithi177.stdout: "osd_mapbl_bytes": 0, 2024-08-31T04:38:58.335 INFO:teuthology.orchestra.run.smithi177.stdout: "osd_mapbl_items": 0, 2024-08-31T04:38:58.335 INFO:teuthology.orchestra.run.smithi177.stdout: "osd_pglog_bytes": 0, 2024-08-31T04:38:58.335 INFO:teuthology.orchestra.run.smithi177.stdout: "osd_pglog_items": 0, 2024-08-31T04:38:58.335 INFO:teuthology.orchestra.run.smithi177.stdout: "osdmap_bytes": 7504, 2024-08-31T04:38:58.335 INFO:teuthology.orchestra.run.smithi177.stdout: "osdmap_items": 155, 2024-08-31T04:38:58.335 INFO:teuthology.orchestra.run.smithi177.stdout: "osdmap_mapping_bytes": 0, 2024-08-31T04:38:58.335 INFO:teuthology.orchestra.run.smithi177.stdout: "osdmap_mapping_items": 0, 2024-08-31T04:38:58.335 INFO:teuthology.orchestra.run.smithi177.stdout: "pgmap_bytes": 0, 2024-08-31T04:38:58.335 INFO:teuthology.orchestra.run.smithi177.stdout: "pgmap_items": 0, 2024-08-31T04:38:58.335 INFO:teuthology.orchestra.run.smithi177.stdout: "mds_co_bytes": 130792, 2024-08-31T04:38:58.335 INFO:teuthology.orchestra.run.smithi177.stdout: "mds_co_items": 848, 2024-08-31T04:38:58.335 INFO:teuthology.orchestra.run.smithi177.stdout: "unittest_1_bytes": 0, 2024-08-31T04:38:58.336 INFO:teuthology.orchestra.run.smithi177.stdout: "unittest_1_items": 0, 2024-08-31T04:38:58.336 INFO:teuthology.orchestra.run.smithi177.stdout: "unittest_2_bytes": 0, 2024-08-31T04:38:58.336 INFO:teuthology.orchestra.run.smithi177.stdout: "unittest_2_items": 0 2024-08-31T04:38:58.336 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-08-31T04:38:58.336 INFO:teuthology.orchestra.run.smithi177.stdout: "objecter": { 2024-08-31T04:38:58.336 INFO:teuthology.orchestra.run.smithi177.stdout: "op_active": 0, 2024-08-31T04:38:58.336 INFO:teuthology.orchestra.run.smithi177.stdout: "op_laggy": 0, 2024-08-31T04:38:58.336 INFO:teuthology.orchestra.run.smithi177.stdout: "op_send": 16079, 2024-08-31T04:38:58.336 INFO:teuthology.orchestra.run.smithi177.stdout: "op_send_bytes": 179455453, 2024-08-31T04:38:58.336 INFO:teuthology.orchestra.run.smithi177.stdout: "op_resend": 33, 2024-08-31T04:38:58.336 INFO:teuthology.orchestra.run.smithi177.stdout: "op_reply": 16079, 2024-08-31T04:38:58.336 INFO:teuthology.orchestra.run.smithi177.stdout: "op_latency": { 2024-08-31T04:38:58.336 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 16079, 2024-08-31T04:38:58.337 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 387.598826311, 2024-08-31T04:38:58.337 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.024105903 2024-08-31T04:38:58.337 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-08-31T04:38:58.337 INFO:teuthology.orchestra.run.smithi177.stdout: "op_inflight": 0, 2024-08-31T04:38:58.337 INFO:teuthology.orchestra.run.smithi177.stdout: "oplen_avg": { 2024-08-31T04:38:58.337 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 16079, 2024-08-31T04:38:58.337 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 17335 2024-08-31T04:38:58.337 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-08-31T04:38:58.337 INFO:teuthology.orchestra.run.smithi177.stdout: "op": 16079, 2024-08-31T04:38:58.337 INFO:teuthology.orchestra.run.smithi177.stdout: "op_r": 313, 2024-08-31T04:38:58.337 INFO:teuthology.orchestra.run.smithi177.stdout: "op_w": 15766, 2024-08-31T04:38:58.337 INFO:teuthology.orchestra.run.smithi177.stdout: "op_rmw": 0, 2024-08-31T04:38:58.337 INFO:teuthology.orchestra.run.smithi177.stdout: "op_pg": 0, 2024-08-31T04:38:58.338 INFO:teuthology.orchestra.run.smithi177.stdout: "osdop_stat": 0, 2024-08-31T04:38:58.338 INFO:teuthology.orchestra.run.smithi177.stdout: "osdop_create": 10, 2024-08-31T04:38:58.338 INFO:teuthology.orchestra.run.smithi177.stdout: "osdop_read": 291, 2024-08-31T04:38:58.338 INFO:teuthology.orchestra.run.smithi177.stdout: "osdop_write": 6541, 2024-08-31T04:38:58.338 INFO:teuthology.orchestra.run.smithi177.stdout: "osdop_writefull": 201, 2024-08-31T04:38:58.338 INFO:teuthology.orchestra.run.smithi177.stdout: "osdop_writesame": 0, 2024-08-31T04:38:58.338 INFO:teuthology.orchestra.run.smithi177.stdout: "osdop_append": 0, 2024-08-31T04:38:58.338 INFO:teuthology.orchestra.run.smithi177.stdout: "osdop_zero": 0, 2024-08-31T04:38:58.338 INFO:teuthology.orchestra.run.smithi177.stdout: "osdop_truncate": 74, 2024-08-31T04:38:58.338 INFO:teuthology.orchestra.run.smithi177.stdout: "osdop_delete": 7933, 2024-08-31T04:38:58.338 INFO:teuthology.orchestra.run.smithi177.stdout: "osdop_mapext": 0, 2024-08-31T04:38:58.338 INFO:teuthology.orchestra.run.smithi177.stdout: "osdop_sparse_read": 0, 2024-08-31T04:38:58.338 INFO:teuthology.orchestra.run.smithi177.stdout: "osdop_clonerange": 0, 2024-08-31T04:38:58.338 INFO:teuthology.orchestra.run.smithi177.stdout: "osdop_getxattr": 0, 2024-08-31T04:38:58.339 INFO:teuthology.orchestra.run.smithi177.stdout: "osdop_setxattr": 20, 2024-08-31T04:38:58.339 INFO:teuthology.orchestra.run.smithi177.stdout: "osdop_cmpxattr": 0, 2024-08-31T04:38:58.339 INFO:teuthology.orchestra.run.smithi177.stdout: "osdop_rmxattr": 0, 2024-08-31T04:38:58.339 INFO:teuthology.orchestra.run.smithi177.stdout: "osdop_resetxattrs": 0, 2024-08-31T04:38:58.339 INFO:teuthology.orchestra.run.smithi177.stdout: "osdop_call": 0, 2024-08-31T04:38:58.339 INFO:teuthology.orchestra.run.smithi177.stdout: "osdop_watch": 0, 2024-08-31T04:38:58.339 INFO:teuthology.orchestra.run.smithi177.stdout: "osdop_notify": 0, 2024-08-31T04:38:58.339 INFO:teuthology.orchestra.run.smithi177.stdout: "osdop_src_cmpxattr": 0, 2024-08-31T04:38:58.339 INFO:teuthology.orchestra.run.smithi177.stdout: "osdop_pgls": 0, 2024-08-31T04:38:58.339 INFO:teuthology.orchestra.run.smithi177.stdout: "osdop_pgls_filter": 0, 2024-08-31T04:38:58.339 INFO:teuthology.orchestra.run.smithi177.stdout: "osdop_other": 0, 2024-08-31T04:38:58.339 INFO:teuthology.orchestra.run.smithi177.stdout: "linger_active": 0, 2024-08-31T04:38:58.339 INFO:teuthology.orchestra.run.smithi177.stdout: "linger_send": 0, 2024-08-31T04:38:58.340 INFO:teuthology.orchestra.run.smithi177.stdout: "linger_resend": 0, 2024-08-31T04:38:58.340 INFO:teuthology.orchestra.run.smithi177.stdout: "linger_ping": 0, 2024-08-31T04:38:58.340 INFO:teuthology.orchestra.run.smithi177.stdout: "poolop_active": 0, 2024-08-31T04:38:58.340 INFO:teuthology.orchestra.run.smithi177.stdout: "poolop_send": 0, 2024-08-31T04:38:58.340 INFO:teuthology.orchestra.run.smithi177.stdout: "poolop_resend": 0, 2024-08-31T04:38:58.340 INFO:teuthology.orchestra.run.smithi177.stdout: "poolstat_active": 0, 2024-08-31T04:38:58.340 INFO:teuthology.orchestra.run.smithi177.stdout: "poolstat_send": 0, 2024-08-31T04:38:58.340 INFO:teuthology.orchestra.run.smithi177.stdout: "poolstat_resend": 0, 2024-08-31T04:38:58.340 INFO:teuthology.orchestra.run.smithi177.stdout: "statfs_active": 0, 2024-08-31T04:38:58.340 INFO:teuthology.orchestra.run.smithi177.stdout: "statfs_send": 0, 2024-08-31T04:38:58.340 INFO:teuthology.orchestra.run.smithi177.stdout: "statfs_resend": 0, 2024-08-31T04:38:58.340 INFO:teuthology.orchestra.run.smithi177.stdout: "command_active": 0, 2024-08-31T04:38:58.340 INFO:teuthology.orchestra.run.smithi177.stdout: "command_send": 0, 2024-08-31T04:38:58.341 INFO:teuthology.orchestra.run.smithi177.stdout: "command_resend": 0, 2024-08-31T04:38:58.341 INFO:teuthology.orchestra.run.smithi177.stdout: "map_epoch": 80, 2024-08-31T04:38:58.341 INFO:teuthology.orchestra.run.smithi177.stdout: "map_full": 0, 2024-08-31T04:38:58.341 INFO:teuthology.orchestra.run.smithi177.stdout: "map_inc": 4, 2024-08-31T04:38:58.341 INFO:teuthology.orchestra.run.smithi177.stdout: "osd_sessions": 12, 2024-08-31T04:38:58.341 INFO:teuthology.orchestra.run.smithi177.stdout: "osd_session_open": 12, 2024-08-31T04:38:58.341 INFO:teuthology.orchestra.run.smithi177.stdout: "osd_session_close": 0, 2024-08-31T04:38:58.341 INFO:teuthology.orchestra.run.smithi177.stdout: "osd_laggy": 0, 2024-08-31T04:38:58.341 INFO:teuthology.orchestra.run.smithi177.stdout: "omap_wr": 1942, 2024-08-31T04:38:58.341 INFO:teuthology.orchestra.run.smithi177.stdout: "omap_rd": 28, 2024-08-31T04:38:58.341 INFO:teuthology.orchestra.run.smithi177.stdout: "omap_del": 295 2024-08-31T04:38:58.341 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-08-31T04:38:58.341 INFO:teuthology.orchestra.run.smithi177.stdout: "oft": { 2024-08-31T04:38:58.341 INFO:teuthology.orchestra.run.smithi177.stdout: "omap_total_objs": 1, 2024-08-31T04:38:58.342 INFO:teuthology.orchestra.run.smithi177.stdout: "omap_total_kv_pairs": 0, 2024-08-31T04:38:58.342 INFO:teuthology.orchestra.run.smithi177.stdout: "omap_total_updates": 0, 2024-08-31T04:38:58.342 INFO:teuthology.orchestra.run.smithi177.stdout: "omap_total_removes": 0 2024-08-31T04:38:58.342 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-08-31T04:38:58.342 INFO:teuthology.orchestra.run.smithi177.stdout: "purge_queue": { 2024-08-31T04:38:58.342 INFO:teuthology.orchestra.run.smithi177.stdout: "pq_executing_ops": 0, 2024-08-31T04:38:58.342 INFO:teuthology.orchestra.run.smithi177.stdout: "pq_executing_ops_high_water": 14, 2024-08-31T04:38:58.342 INFO:teuthology.orchestra.run.smithi177.stdout: "pq_executing": 0, 2024-08-31T04:38:58.342 INFO:teuthology.orchestra.run.smithi177.stdout: "pq_executing_high_water": 6, 2024-08-31T04:38:58.342 INFO:teuthology.orchestra.run.smithi177.stdout: "pq_executed_ops": 7882, 2024-08-31T04:38:58.342 INFO:teuthology.orchestra.run.smithi177.stdout: "pq_executed": 7586, 2024-08-31T04:38:58.342 INFO:teuthology.orchestra.run.smithi177.stdout: "pq_item_in_journal": 0 2024-08-31T04:38:58.342 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-08-31T04:38:58.342 INFO:teuthology.orchestra.run.smithi177.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-08-31T04:38:58.343 INFO:teuthology.orchestra.run.smithi177.stdout: "val": 0, 2024-08-31T04:38:58.343 INFO:teuthology.orchestra.run.smithi177.stdout: "max": 104857600, 2024-08-31T04:38:58.343 INFO:teuthology.orchestra.run.smithi177.stdout: "get_started": 0, 2024-08-31T04:38:58.343 INFO:teuthology.orchestra.run.smithi177.stdout: "get": 232289, 2024-08-31T04:38:58.343 INFO:teuthology.orchestra.run.smithi177.stdout: "get_sum": 65568255, 2024-08-31T04:38:58.343 INFO:teuthology.orchestra.run.smithi177.stdout: "get_or_fail_fail": 0, 2024-08-31T04:38:58.343 INFO:teuthology.orchestra.run.smithi177.stdout: "get_or_fail_success": 232289, 2024-08-31T04:38:58.343 INFO:teuthology.orchestra.run.smithi177.stdout: "take": 0, 2024-08-31T04:38:58.343 INFO:teuthology.orchestra.run.smithi177.stdout: "take_sum": 0, 2024-08-31T04:38:58.343 INFO:teuthology.orchestra.run.smithi177.stdout: "put": 232289, 2024-08-31T04:38:58.343 INFO:teuthology.orchestra.run.smithi177.stdout: "put_sum": 65568255, 2024-08-31T04:38:58.343 INFO:teuthology.orchestra.run.smithi177.stdout: "wait": { 2024-08-31T04:38:58.343 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 0, 2024-08-31T04:38:58.343 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.000000000, 2024-08-31T04:38:58.344 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000000000 2024-08-31T04:38:58.344 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-08-31T04:38:58.344 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-08-31T04:38:58.344 INFO:teuthology.orchestra.run.smithi177.stdout: "throttle-objecter_bytes": { 2024-08-31T04:38:58.344 INFO:teuthology.orchestra.run.smithi177.stdout: "val": 0, 2024-08-31T04:38:58.344 INFO:teuthology.orchestra.run.smithi177.stdout: "max": 104857600, 2024-08-31T04:38:58.344 INFO:teuthology.orchestra.run.smithi177.stdout: "get_started": 0, 2024-08-31T04:38:58.344 INFO:teuthology.orchestra.run.smithi177.stdout: "get": 0, 2024-08-31T04:38:58.344 INFO:teuthology.orchestra.run.smithi177.stdout: "get_sum": 0, 2024-08-31T04:38:58.344 INFO:teuthology.orchestra.run.smithi177.stdout: "get_or_fail_fail": 0, 2024-08-31T04:38:58.344 INFO:teuthology.orchestra.run.smithi177.stdout: "get_or_fail_success": 0, 2024-08-31T04:38:58.344 INFO:teuthology.orchestra.run.smithi177.stdout: "take": 16079, 2024-08-31T04:38:58.344 INFO:teuthology.orchestra.run.smithi177.stdout: "take_sum": 180221280, 2024-08-31T04:38:58.345 INFO:teuthology.orchestra.run.smithi177.stdout: "put": 16079, 2024-08-31T04:38:58.345 INFO:teuthology.orchestra.run.smithi177.stdout: "put_sum": 180221280, 2024-08-31T04:38:58.345 INFO:teuthology.orchestra.run.smithi177.stdout: "wait": { 2024-08-31T04:38:58.345 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 0, 2024-08-31T04:38:58.345 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.000000000, 2024-08-31T04:38:58.345 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000000000 2024-08-31T04:38:58.345 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-08-31T04:38:58.345 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-08-31T04:38:58.345 INFO:teuthology.orchestra.run.smithi177.stdout: "throttle-objecter_ops": { 2024-08-31T04:38:58.345 INFO:teuthology.orchestra.run.smithi177.stdout: "val": 0, 2024-08-31T04:38:58.345 INFO:teuthology.orchestra.run.smithi177.stdout: "max": 1024, 2024-08-31T04:38:58.345 INFO:teuthology.orchestra.run.smithi177.stdout: "get_started": 0, 2024-08-31T04:38:58.345 INFO:teuthology.orchestra.run.smithi177.stdout: "get": 0, 2024-08-31T04:38:58.345 INFO:teuthology.orchestra.run.smithi177.stdout: "get_sum": 0, 2024-08-31T04:38:58.346 INFO:teuthology.orchestra.run.smithi177.stdout: "get_or_fail_fail": 0, 2024-08-31T04:38:58.346 INFO:teuthology.orchestra.run.smithi177.stdout: "get_or_fail_success": 0, 2024-08-31T04:38:58.346 INFO:teuthology.orchestra.run.smithi177.stdout: "take": 16079, 2024-08-31T04:38:58.346 INFO:teuthology.orchestra.run.smithi177.stdout: "take_sum": 16079, 2024-08-31T04:38:58.346 INFO:teuthology.orchestra.run.smithi177.stdout: "put": 16079, 2024-08-31T04:38:58.346 INFO:teuthology.orchestra.run.smithi177.stdout: "put_sum": 16079, 2024-08-31T04:38:58.346 INFO:teuthology.orchestra.run.smithi177.stdout: "wait": { 2024-08-31T04:38:58.346 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 0, 2024-08-31T04:38:58.346 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.000000000, 2024-08-31T04:38:58.346 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000000000 2024-08-31T04:38:58.346 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-08-31T04:38:58.346 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-08-31T04:38:58.346 INFO:teuthology.orchestra.run.smithi177.stdout: "throttle-write_buf_throttle": { 2024-08-31T04:38:58.346 INFO:teuthology.orchestra.run.smithi177.stdout: "val": 0, 2024-08-31T04:38:58.347 INFO:teuthology.orchestra.run.smithi177.stdout: "max": 3758096384, 2024-08-31T04:38:58.347 INFO:teuthology.orchestra.run.smithi177.stdout: "get_started": 0, 2024-08-31T04:38:58.347 INFO:teuthology.orchestra.run.smithi177.stdout: "get": 7586, 2024-08-31T04:38:58.347 INFO:teuthology.orchestra.run.smithi177.stdout: "get_sum": 766482, 2024-08-31T04:38:58.347 INFO:teuthology.orchestra.run.smithi177.stdout: "get_or_fail_fail": 0, 2024-08-31T04:38:58.347 INFO:teuthology.orchestra.run.smithi177.stdout: "get_or_fail_success": 7586, 2024-08-31T04:38:58.347 INFO:teuthology.orchestra.run.smithi177.stdout: "take": 0, 2024-08-31T04:38:58.347 INFO:teuthology.orchestra.run.smithi177.stdout: "take_sum": 0, 2024-08-31T04:38:58.347 INFO:teuthology.orchestra.run.smithi177.stdout: "put": 291, 2024-08-31T04:38:58.347 INFO:teuthology.orchestra.run.smithi177.stdout: "put_sum": 766482, 2024-08-31T04:38:58.347 INFO:teuthology.orchestra.run.smithi177.stdout: "wait": { 2024-08-31T04:38:58.347 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 0, 2024-08-31T04:38:58.347 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.000000000, 2024-08-31T04:38:58.348 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000000000 2024-08-31T04:38:58.348 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-08-31T04:38:58.348 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-08-31T04:38:58.348 INFO:teuthology.orchestra.run.smithi177.stdout: "throttle-write_buf_throttle-0x5611cec6a680": { 2024-08-31T04:38:58.348 INFO:teuthology.orchestra.run.smithi177.stdout: "val": 0, 2024-08-31T04:38:58.348 INFO:teuthology.orchestra.run.smithi177.stdout: "max": 3758096384, 2024-08-31T04:38:58.348 INFO:teuthology.orchestra.run.smithi177.stdout: "get_started": 0, 2024-08-31T04:38:58.348 INFO:teuthology.orchestra.run.smithi177.stdout: "get": 77296, 2024-08-31T04:38:58.348 INFO:teuthology.orchestra.run.smithi177.stdout: "get_sum": 165502003, 2024-08-31T04:38:58.348 INFO:teuthology.orchestra.run.smithi177.stdout: "get_or_fail_fail": 0, 2024-08-31T04:38:58.348 INFO:teuthology.orchestra.run.smithi177.stdout: "get_or_fail_success": 77296, 2024-08-31T04:38:58.348 INFO:teuthology.orchestra.run.smithi177.stdout: "take": 0, 2024-08-31T04:38:58.348 INFO:teuthology.orchestra.run.smithi177.stdout: "take_sum": 0, 2024-08-31T04:38:58.348 INFO:teuthology.orchestra.run.smithi177.stdout: "put": 6250, 2024-08-31T04:38:58.349 INFO:teuthology.orchestra.run.smithi177.stdout: "put_sum": 165502003, 2024-08-31T04:38:58.349 INFO:teuthology.orchestra.run.smithi177.stdout: "wait": { 2024-08-31T04:38:58.349 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 0, 2024-08-31T04:38:58.349 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.000000000, 2024-08-31T04:38:58.349 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000000000 2024-08-31T04:38:58.349 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-08-31T04:38:58.349 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-08-31T04:38:58.349 INFO:teuthology.orchestra.run.smithi177.stdout: "trackedop": { 2024-08-31T04:38:58.349 INFO:teuthology.orchestra.run.smithi177.stdout: "slow_ops_count": 23260 2024-08-31T04:38:58.349 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-08-31T04:38:58.349 INFO:teuthology.orchestra.run.smithi177.stdout:} 2024-08-31T04:38:58.984 INFO:tasks.check_counter:Daemon mds.i mds.exported=139 2024-08-31T04:38:58.984 INFO:tasks.check_counter:Daemon mds.i mds.imported=165 2024-08-31T04:38:58.984 INFO:tasks.check_counter:Daemon mds.i mds_cache.dir_update=2705 2024-08-31T04:38:58.984 INFO:tasks.check_counter:Daemon mds.i mds_cache.dir_update_receipt=10047 2024-08-31T04:38:58.984 INFO:tasks.check_counter:Daemon mds.i mds.dir_split=74 2024-08-31T04:38:58.984 DEBUG:tasks.check_counter:Getting stats from l 2024-08-31T04:38:58.985 DEBUG:teuthology.orchestra.run.smithi177:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 058d9fc6-674f-11ef-bcd4-c7b262605968 -- ceph daemon mds.l perf dump 2024-08-31T04:38:59.233 INFO:teuthology.orchestra.run.smithi177.stderr:Inferring config /var/lib/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/mon.c/config 2024-08-31T04:38:59.658 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:38:59 smithi177 ceph-mon[22025]: pgmap v851: 97 pgs: 97 active+clean; 592 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 10 op/s 2024-08-31T04:38:59.658 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:38:59 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T04:38:59.792 INFO:teuthology.orchestra.run.smithi177.stdout:{ 2024-08-31T04:38:59.793 INFO:teuthology.orchestra.run.smithi177.stdout: "AsyncMessenger::Worker-0": { 2024-08-31T04:38:59.793 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_recv_messages": 1055, 2024-08-31T04:38:59.793 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_send_messages": 1055, 2024-08-31T04:38:59.793 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_recv_bytes": 35753698, 2024-08-31T04:38:59.793 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_send_bytes": 334729, 2024-08-31T04:38:59.793 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_created_connections": 8, 2024-08-31T04:38:59.793 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_active_connections": 4, 2024-08-31T04:38:59.793 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_running_total_time": 0.117036329, 2024-08-31T04:38:59.793 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_running_send_time": 0.040962790, 2024-08-31T04:38:59.793 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_running_recv_time": 0.042235115, 2024-08-31T04:38:59.793 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_running_fast_dispatch_time": 0.025753050, 2024-08-31T04:38:59.794 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_send_messages_queue_lat": { 2024-08-31T04:38:59.794 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 1054, 2024-08-31T04:38:59.794 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.048710871, 2024-08-31T04:38:59.794 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000046215 2024-08-31T04:38:59.794 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-08-31T04:38:59.794 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_handle_ack_lat": { 2024-08-31T04:38:59.794 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 0, 2024-08-31T04:38:59.794 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.000000000, 2024-08-31T04:38:59.794 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000000000 2024-08-31T04:38:59.794 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-08-31T04:38:59.794 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_recv_encrypted_bytes": 2992, 2024-08-31T04:38:59.794 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_send_encrypted_bytes": 448 2024-08-31T04:38:59.794 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-08-31T04:38:59.795 INFO:teuthology.orchestra.run.smithi177.stdout: "AsyncMessenger::Worker-1": { 2024-08-31T04:38:59.795 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_recv_messages": 544, 2024-08-31T04:38:59.795 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_send_messages": 775, 2024-08-31T04:38:59.795 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_recv_bytes": 63055091, 2024-08-31T04:38:59.795 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_send_bytes": 747210, 2024-08-31T04:38:59.795 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_created_connections": 7, 2024-08-31T04:38:59.795 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_active_connections": 5, 2024-08-31T04:38:59.795 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_running_total_time": 0.103658073, 2024-08-31T04:38:59.795 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_running_send_time": 0.035441518, 2024-08-31T04:38:59.795 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_running_recv_time": 0.047773277, 2024-08-31T04:38:59.795 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_running_fast_dispatch_time": 0.014483554, 2024-08-31T04:38:59.795 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_send_messages_queue_lat": { 2024-08-31T04:38:59.795 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 773, 2024-08-31T04:38:59.796 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.056076609, 2024-08-31T04:38:59.796 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000072544 2024-08-31T04:38:59.796 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-08-31T04:38:59.796 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_handle_ack_lat": { 2024-08-31T04:38:59.796 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 0, 2024-08-31T04:38:59.796 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.000000000, 2024-08-31T04:38:59.796 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000000000 2024-08-31T04:38:59.796 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-08-31T04:38:59.796 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_recv_encrypted_bytes": 320, 2024-08-31T04:38:59.796 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_send_encrypted_bytes": 574848 2024-08-31T04:38:59.796 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-08-31T04:38:59.796 INFO:teuthology.orchestra.run.smithi177.stdout: "AsyncMessenger::Worker-2": { 2024-08-31T04:38:59.797 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_recv_messages": 2209, 2024-08-31T04:38:59.797 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_send_messages": 2164, 2024-08-31T04:38:59.797 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_recv_bytes": 68516648, 2024-08-31T04:38:59.797 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_send_bytes": 778200, 2024-08-31T04:38:59.797 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_created_connections": 5, 2024-08-31T04:38:59.797 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_active_connections": 4, 2024-08-31T04:38:59.797 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_running_total_time": 0.304727948, 2024-08-31T04:38:59.797 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_running_send_time": 0.119434508, 2024-08-31T04:38:59.797 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_running_recv_time": 0.116991751, 2024-08-31T04:38:59.797 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_running_fast_dispatch_time": 0.061627106, 2024-08-31T04:38:59.797 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_send_messages_queue_lat": { 2024-08-31T04:38:59.797 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 2163, 2024-08-31T04:38:59.797 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.091898294, 2024-08-31T04:38:59.798 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000042486 2024-08-31T04:38:59.798 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-08-31T04:38:59.798 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_handle_ack_lat": { 2024-08-31T04:38:59.798 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 0, 2024-08-31T04:38:59.798 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.000000000, 2024-08-31T04:38:59.798 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000000000 2024-08-31T04:38:59.798 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-08-31T04:38:59.798 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_recv_encrypted_bytes": 847136, 2024-08-31T04:38:59.798 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_send_encrypted_bytes": 189264 2024-08-31T04:38:59.798 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-08-31T04:38:59.798 INFO:teuthology.orchestra.run.smithi177.stdout: "cct": { 2024-08-31T04:38:59.798 INFO:teuthology.orchestra.run.smithi177.stdout: "total_workers": 1, 2024-08-31T04:38:59.798 INFO:teuthology.orchestra.run.smithi177.stdout: "unhealthy_workers": 0 2024-08-31T04:38:59.799 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-08-31T04:38:59.799 INFO:teuthology.orchestra.run.smithi177.stdout: "finisher-MDSRank": { 2024-08-31T04:38:59.799 INFO:teuthology.orchestra.run.smithi177.stdout: "queue_len": 0, 2024-08-31T04:38:59.799 INFO:teuthology.orchestra.run.smithi177.stdout: "complete_latency": { 2024-08-31T04:38:59.799 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 5720, 2024-08-31T04:38:59.799 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.162934790, 2024-08-31T04:38:59.799 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000028485 2024-08-31T04:38:59.799 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-08-31T04:38:59.799 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-08-31T04:38:59.799 INFO:teuthology.orchestra.run.smithi177.stdout: "finisher-PurgeQueue": { 2024-08-31T04:38:59.799 INFO:teuthology.orchestra.run.smithi177.stdout: "queue_len": 0, 2024-08-31T04:38:59.799 INFO:teuthology.orchestra.run.smithi177.stdout: "complete_latency": { 2024-08-31T04:38:59.799 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 0, 2024-08-31T04:38:59.800 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.000000000, 2024-08-31T04:38:59.800 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000000000 2024-08-31T04:38:59.800 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-08-31T04:38:59.800 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-08-31T04:38:59.800 INFO:teuthology.orchestra.run.smithi177.stdout: "mds": { 2024-08-31T04:38:59.800 INFO:teuthology.orchestra.run.smithi177.stdout: "request": 0, 2024-08-31T04:38:59.800 INFO:teuthology.orchestra.run.smithi177.stdout: "reply": 0, 2024-08-31T04:38:59.800 INFO:teuthology.orchestra.run.smithi177.stdout: "reply_latency": { 2024-08-31T04:38:59.800 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 0, 2024-08-31T04:38:59.800 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.000000000, 2024-08-31T04:38:59.800 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000000000 2024-08-31T04:38:59.800 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-08-31T04:38:59.800 INFO:teuthology.orchestra.run.smithi177.stdout: "slow_reply": 0, 2024-08-31T04:38:59.801 INFO:teuthology.orchestra.run.smithi177.stdout: "forward": 0, 2024-08-31T04:38:59.801 INFO:teuthology.orchestra.run.smithi177.stdout: "dir_fetch_complete": 0, 2024-08-31T04:38:59.801 INFO:teuthology.orchestra.run.smithi177.stdout: "dir_fetch_keys": 0, 2024-08-31T04:38:59.801 INFO:teuthology.orchestra.run.smithi177.stdout: "dir_commit": 0, 2024-08-31T04:38:59.801 INFO:teuthology.orchestra.run.smithi177.stdout: "dir_split": 0, 2024-08-31T04:38:59.801 INFO:teuthology.orchestra.run.smithi177.stdout: "dir_merge": 0, 2024-08-31T04:38:59.801 INFO:teuthology.orchestra.run.smithi177.stdout: "inodes": 7746, 2024-08-31T04:38:59.801 INFO:teuthology.orchestra.run.smithi177.stdout: "inodes_top": 0, 2024-08-31T04:38:59.801 INFO:teuthology.orchestra.run.smithi177.stdout: "inodes_bottom": 7746, 2024-08-31T04:38:59.801 INFO:teuthology.orchestra.run.smithi177.stdout: "inodes_pin_tail": 0, 2024-08-31T04:38:59.801 INFO:teuthology.orchestra.run.smithi177.stdout: "inodes_pinned": 7746, 2024-08-31T04:38:59.801 INFO:teuthology.orchestra.run.smithi177.stdout: "inodes_expired": 0, 2024-08-31T04:38:59.801 INFO:teuthology.orchestra.run.smithi177.stdout: "inodes_with_caps": 0, 2024-08-31T04:38:59.802 INFO:teuthology.orchestra.run.smithi177.stdout: "caps": 0, 2024-08-31T04:38:59.802 INFO:teuthology.orchestra.run.smithi177.stdout: "subtrees": 1, 2024-08-31T04:38:59.802 INFO:teuthology.orchestra.run.smithi177.stdout: "traverse": 0, 2024-08-31T04:38:59.802 INFO:teuthology.orchestra.run.smithi177.stdout: "traverse_hit": 0, 2024-08-31T04:38:59.802 INFO:teuthology.orchestra.run.smithi177.stdout: "traverse_forward": 0, 2024-08-31T04:38:59.802 INFO:teuthology.orchestra.run.smithi177.stdout: "traverse_discover": 0, 2024-08-31T04:38:59.802 INFO:teuthology.orchestra.run.smithi177.stdout: "traverse_dir_fetch": 0, 2024-08-31T04:38:59.802 INFO:teuthology.orchestra.run.smithi177.stdout: "traverse_remote_ino": 0, 2024-08-31T04:38:59.802 INFO:teuthology.orchestra.run.smithi177.stdout: "traverse_lock": 0, 2024-08-31T04:38:59.802 INFO:teuthology.orchestra.run.smithi177.stdout: "load_cent": 0, 2024-08-31T04:38:59.802 INFO:teuthology.orchestra.run.smithi177.stdout: "q": 0, 2024-08-31T04:38:59.802 INFO:teuthology.orchestra.run.smithi177.stdout: "exported": 0, 2024-08-31T04:38:59.802 INFO:teuthology.orchestra.run.smithi177.stdout: "exported_inodes": 0, 2024-08-31T04:38:59.803 INFO:teuthology.orchestra.run.smithi177.stdout: "imported": 0, 2024-08-31T04:38:59.803 INFO:teuthology.orchestra.run.smithi177.stdout: "imported_inodes": 0, 2024-08-31T04:38:59.803 INFO:teuthology.orchestra.run.smithi177.stdout: "openino_dir_fetch": 0, 2024-08-31T04:38:59.803 INFO:teuthology.orchestra.run.smithi177.stdout: "openino_backtrace_fetch": 0, 2024-08-31T04:38:59.803 INFO:teuthology.orchestra.run.smithi177.stdout: "openino_peer_discover": 0, 2024-08-31T04:38:59.803 INFO:teuthology.orchestra.run.smithi177.stdout: "root_rfiles": 0, 2024-08-31T04:38:59.803 INFO:teuthology.orchestra.run.smithi177.stdout: "root_rbytes": 0, 2024-08-31T04:38:59.803 INFO:teuthology.orchestra.run.smithi177.stdout: "root_rsnaps": 0, 2024-08-31T04:38:59.803 INFO:teuthology.orchestra.run.smithi177.stdout: "scrub_backtrace_fetch": 0, 2024-08-31T04:38:59.803 INFO:teuthology.orchestra.run.smithi177.stdout: "scrub_set_tag": 0, 2024-08-31T04:38:59.803 INFO:teuthology.orchestra.run.smithi177.stdout: "scrub_backtrace_repaired": 0, 2024-08-31T04:38:59.803 INFO:teuthology.orchestra.run.smithi177.stdout: "scrub_inotable_repaired": 0, 2024-08-31T04:38:59.803 INFO:teuthology.orchestra.run.smithi177.stdout: "scrub_dir_inodes": 0, 2024-08-31T04:38:59.803 INFO:teuthology.orchestra.run.smithi177.stdout: "scrub_dir_base_inodes": 0, 2024-08-31T04:38:59.804 INFO:teuthology.orchestra.run.smithi177.stdout: "scrub_dirfrag_rstats": 0, 2024-08-31T04:38:59.804 INFO:teuthology.orchestra.run.smithi177.stdout: "scrub_file_inodes": 0, 2024-08-31T04:38:59.804 INFO:teuthology.orchestra.run.smithi177.stdout: "handle_inode_file_caps": 0, 2024-08-31T04:38:59.804 INFO:teuthology.orchestra.run.smithi177.stdout: "ceph_cap_op_revoke": 0, 2024-08-31T04:38:59.804 INFO:teuthology.orchestra.run.smithi177.stdout: "ceph_cap_op_grant": 0, 2024-08-31T04:38:59.804 INFO:teuthology.orchestra.run.smithi177.stdout: "ceph_cap_op_trunc": 0, 2024-08-31T04:38:59.804 INFO:teuthology.orchestra.run.smithi177.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-08-31T04:38:59.804 INFO:teuthology.orchestra.run.smithi177.stdout: "ceph_cap_op_flush_ack": 0, 2024-08-31T04:38:59.804 INFO:teuthology.orchestra.run.smithi177.stdout: "handle_client_caps": 0, 2024-08-31T04:38:59.804 INFO:teuthology.orchestra.run.smithi177.stdout: "handle_client_caps_dirty": 0, 2024-08-31T04:38:59.804 INFO:teuthology.orchestra.run.smithi177.stdout: "handle_client_cap_release": 0, 2024-08-31T04:38:59.804 INFO:teuthology.orchestra.run.smithi177.stdout: "process_request_cap_release": 0 2024-08-31T04:38:59.805 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-08-31T04:38:59.805 INFO:teuthology.orchestra.run.smithi177.stdout: "mds_cache": { 2024-08-31T04:38:59.805 INFO:teuthology.orchestra.run.smithi177.stdout: "dir_update": 0, 2024-08-31T04:38:59.805 INFO:teuthology.orchestra.run.smithi177.stdout: "dir_update_receipt": 0, 2024-08-31T04:38:59.805 INFO:teuthology.orchestra.run.smithi177.stdout: "dir_try_discover": 0, 2024-08-31T04:38:59.805 INFO:teuthology.orchestra.run.smithi177.stdout: "dir_send_discover": 0, 2024-08-31T04:38:59.805 INFO:teuthology.orchestra.run.smithi177.stdout: "dir_handle_discover": 0, 2024-08-31T04:38:59.805 INFO:teuthology.orchestra.run.smithi177.stdout: "num_strays": 0, 2024-08-31T04:38:59.805 INFO:teuthology.orchestra.run.smithi177.stdout: "num_strays_delayed": 0, 2024-08-31T04:38:59.805 INFO:teuthology.orchestra.run.smithi177.stdout: "num_strays_enqueuing": 0, 2024-08-31T04:38:59.805 INFO:teuthology.orchestra.run.smithi177.stdout: "strays_created": 0, 2024-08-31T04:38:59.805 INFO:teuthology.orchestra.run.smithi177.stdout: "strays_enqueued": 0, 2024-08-31T04:38:59.805 INFO:teuthology.orchestra.run.smithi177.stdout: "strays_reintegrated": 0, 2024-08-31T04:38:59.805 INFO:teuthology.orchestra.run.smithi177.stdout: "strays_migrated": 0, 2024-08-31T04:38:59.806 INFO:teuthology.orchestra.run.smithi177.stdout: "num_recovering_processing": 0, 2024-08-31T04:38:59.806 INFO:teuthology.orchestra.run.smithi177.stdout: "num_recovering_enqueued": 0, 2024-08-31T04:38:59.806 INFO:teuthology.orchestra.run.smithi177.stdout: "num_recovering_prioritized": 0, 2024-08-31T04:38:59.806 INFO:teuthology.orchestra.run.smithi177.stdout: "recovery_started": 0, 2024-08-31T04:38:59.806 INFO:teuthology.orchestra.run.smithi177.stdout: "recovery_completed": 0, 2024-08-31T04:38:59.806 INFO:teuthology.orchestra.run.smithi177.stdout: "ireq_quiesce_path": 0, 2024-08-31T04:38:59.806 INFO:teuthology.orchestra.run.smithi177.stdout: "ireq_quiesce_inode": 0, 2024-08-31T04:38:59.806 INFO:teuthology.orchestra.run.smithi177.stdout: "ireq_enqueue_scrub": 0, 2024-08-31T04:38:59.806 INFO:teuthology.orchestra.run.smithi177.stdout: "ireq_exportdir": 0, 2024-08-31T04:38:59.806 INFO:teuthology.orchestra.run.smithi177.stdout: "ireq_flush": 0, 2024-08-31T04:38:59.806 INFO:teuthology.orchestra.run.smithi177.stdout: "ireq_fragmentdir": 0, 2024-08-31T04:38:59.806 INFO:teuthology.orchestra.run.smithi177.stdout: "ireq_fragstats": 0, 2024-08-31T04:38:59.806 INFO:teuthology.orchestra.run.smithi177.stdout: "ireq_inodestats": 0, 2024-08-31T04:38:59.806 INFO:teuthology.orchestra.run.smithi177.stdout: "uninline_started": 0, 2024-08-31T04:38:59.807 INFO:teuthology.orchestra.run.smithi177.stdout: "uninline_succeeded": 0, 2024-08-31T04:38:59.807 INFO:teuthology.orchestra.run.smithi177.stdout: "uninline_write_failed": 0 2024-08-31T04:38:59.807 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-08-31T04:38:59.807 INFO:teuthology.orchestra.run.smithi177.stdout: "mds_log": { 2024-08-31T04:38:59.807 INFO:teuthology.orchestra.run.smithi177.stdout: "evlrg": 0, 2024-08-31T04:38:59.807 INFO:teuthology.orchestra.run.smithi177.stdout: "evadd": 0, 2024-08-31T04:38:59.807 INFO:teuthology.orchestra.run.smithi177.stdout: "evex": 0, 2024-08-31T04:38:59.807 INFO:teuthology.orchestra.run.smithi177.stdout: "evtrm": 0, 2024-08-31T04:38:59.807 INFO:teuthology.orchestra.run.smithi177.stdout: "ev": 77296, 2024-08-31T04:38:59.807 INFO:teuthology.orchestra.run.smithi177.stdout: "evexg": 0, 2024-08-31T04:38:59.807 INFO:teuthology.orchestra.run.smithi177.stdout: "evexd": 0, 2024-08-31T04:38:59.807 INFO:teuthology.orchestra.run.smithi177.stdout: "segadd": 0, 2024-08-31T04:38:59.807 INFO:teuthology.orchestra.run.smithi177.stdout: "segex": 0, 2024-08-31T04:38:59.808 INFO:teuthology.orchestra.run.smithi177.stdout: "segtrm": 0, 2024-08-31T04:38:59.808 INFO:teuthology.orchestra.run.smithi177.stdout: "seg": 96, 2024-08-31T04:38:59.808 INFO:teuthology.orchestra.run.smithi177.stdout: "segmjr": 8, 2024-08-31T04:38:59.808 INFO:teuthology.orchestra.run.smithi177.stdout: "segexg": 0, 2024-08-31T04:38:59.808 INFO:teuthology.orchestra.run.smithi177.stdout: "segexd": 0, 2024-08-31T04:38:59.808 INFO:teuthology.orchestra.run.smithi177.stdout: "expos": 4194304, 2024-08-31T04:38:59.808 INFO:teuthology.orchestra.run.smithi177.stdout: "wrpos": 169696307, 2024-08-31T04:38:59.808 INFO:teuthology.orchestra.run.smithi177.stdout: "rdpos": 169695169, 2024-08-31T04:38:59.808 INFO:teuthology.orchestra.run.smithi177.stdout: "jlat": { 2024-08-31T04:38:59.808 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 0, 2024-08-31T04:38:59.808 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.000000000, 2024-08-31T04:38:59.808 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000000000 2024-08-31T04:38:59.808 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-08-31T04:38:59.809 INFO:teuthology.orchestra.run.smithi177.stdout: "replayed": 77296 2024-08-31T04:38:59.809 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-08-31T04:38:59.809 INFO:teuthology.orchestra.run.smithi177.stdout: "mds_mem": { 2024-08-31T04:38:59.809 INFO:teuthology.orchestra.run.smithi177.stdout: "ino": 14, 2024-08-31T04:38:59.809 INFO:teuthology.orchestra.run.smithi177.stdout: "ino+": 18679, 2024-08-31T04:38:59.809 INFO:teuthology.orchestra.run.smithi177.stdout: "ino-": 18665, 2024-08-31T04:38:59.809 INFO:teuthology.orchestra.run.smithi177.stdout: "dir": 19, 2024-08-31T04:38:59.809 INFO:teuthology.orchestra.run.smithi177.stdout: "dir+": 976, 2024-08-31T04:38:59.809 INFO:teuthology.orchestra.run.smithi177.stdout: "dir-": 957, 2024-08-31T04:38:59.809 INFO:teuthology.orchestra.run.smithi177.stdout: "dn": 7746, 2024-08-31T04:38:59.809 INFO:teuthology.orchestra.run.smithi177.stdout: "dn+": 42090, 2024-08-31T04:38:59.809 INFO:teuthology.orchestra.run.smithi177.stdout: "dn-": 34344, 2024-08-31T04:38:59.809 INFO:teuthology.orchestra.run.smithi177.stdout: "cap": 0, 2024-08-31T04:38:59.809 INFO:teuthology.orchestra.run.smithi177.stdout: "cap+": 0, 2024-08-31T04:38:59.810 INFO:teuthology.orchestra.run.smithi177.stdout: "cap-": 0, 2024-08-31T04:38:59.810 INFO:teuthology.orchestra.run.smithi177.stdout: "rss": 149484, 2024-08-31T04:38:59.810 INFO:teuthology.orchestra.run.smithi177.stdout: "heap": 384147456 2024-08-31T04:38:59.810 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-08-31T04:38:59.810 INFO:teuthology.orchestra.run.smithi177.stdout: "mds_server": { 2024-08-31T04:38:59.810 INFO:teuthology.orchestra.run.smithi177.stdout: "dispatch_client_request": 0, 2024-08-31T04:38:59.810 INFO:teuthology.orchestra.run.smithi177.stdout: "dispatch_server_request": 0, 2024-08-31T04:38:59.810 INFO:teuthology.orchestra.run.smithi177.stdout: "handle_client_request": 0, 2024-08-31T04:38:59.810 INFO:teuthology.orchestra.run.smithi177.stdout: "handle_client_session": 0, 2024-08-31T04:38:59.810 INFO:teuthology.orchestra.run.smithi177.stdout: "handle_peer_request": 0, 2024-08-31T04:38:59.810 INFO:teuthology.orchestra.run.smithi177.stdout: "req_create_latency": { 2024-08-31T04:38:59.810 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 0, 2024-08-31T04:38:59.810 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.000000000, 2024-08-31T04:38:59.811 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000000000 2024-08-31T04:38:59.811 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-08-31T04:38:59.811 INFO:teuthology.orchestra.run.smithi177.stdout: "req_getattr_latency": { 2024-08-31T04:38:59.811 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 0, 2024-08-31T04:38:59.811 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.000000000, 2024-08-31T04:38:59.811 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000000000 2024-08-31T04:38:59.811 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-08-31T04:38:59.811 INFO:teuthology.orchestra.run.smithi177.stdout: "req_getfilelock_latency": { 2024-08-31T04:38:59.811 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 0, 2024-08-31T04:38:59.811 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.000000000, 2024-08-31T04:38:59.811 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000000000 2024-08-31T04:38:59.811 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-08-31T04:38:59.811 INFO:teuthology.orchestra.run.smithi177.stdout: "req_link_latency": { 2024-08-31T04:38:59.812 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 0, 2024-08-31T04:38:59.812 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.000000000, 2024-08-31T04:38:59.812 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000000000 2024-08-31T04:38:59.812 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-08-31T04:38:59.812 INFO:teuthology.orchestra.run.smithi177.stdout: "req_lookup_latency": { 2024-08-31T04:38:59.812 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 0, 2024-08-31T04:38:59.812 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.000000000, 2024-08-31T04:38:59.812 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000000000 2024-08-31T04:38:59.812 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-08-31T04:38:59.812 INFO:teuthology.orchestra.run.smithi177.stdout: "req_lookuphash_latency": { 2024-08-31T04:38:59.812 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 0, 2024-08-31T04:38:59.812 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.000000000, 2024-08-31T04:38:59.812 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000000000 2024-08-31T04:38:59.813 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-08-31T04:38:59.813 INFO:teuthology.orchestra.run.smithi177.stdout: "req_lookupino_latency": { 2024-08-31T04:38:59.813 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 0, 2024-08-31T04:38:59.813 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.000000000, 2024-08-31T04:38:59.813 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000000000 2024-08-31T04:38:59.813 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-08-31T04:38:59.813 INFO:teuthology.orchestra.run.smithi177.stdout: "req_lookupname_latency": { 2024-08-31T04:38:59.813 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 0, 2024-08-31T04:38:59.813 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.000000000, 2024-08-31T04:38:59.813 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000000000 2024-08-31T04:38:59.813 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-08-31T04:38:59.813 INFO:teuthology.orchestra.run.smithi177.stdout: "req_lookupparent_latency": { 2024-08-31T04:38:59.813 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 0, 2024-08-31T04:38:59.814 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.000000000, 2024-08-31T04:38:59.814 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000000000 2024-08-31T04:38:59.814 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-08-31T04:38:59.814 INFO:teuthology.orchestra.run.smithi177.stdout: "req_lookupsnap_latency": { 2024-08-31T04:38:59.814 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 0, 2024-08-31T04:38:59.814 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.000000000, 2024-08-31T04:38:59.814 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000000000 2024-08-31T04:38:59.814 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-08-31T04:38:59.814 INFO:teuthology.orchestra.run.smithi177.stdout: "req_lssnap_latency": { 2024-08-31T04:38:59.815 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 0, 2024-08-31T04:38:59.815 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.000000000, 2024-08-31T04:38:59.815 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000000000 2024-08-31T04:38:59.815 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-08-31T04:38:59.815 INFO:teuthology.orchestra.run.smithi177.stdout: "req_mkdir_latency": { 2024-08-31T04:38:59.815 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 0, 2024-08-31T04:38:59.815 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.000000000, 2024-08-31T04:38:59.815 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000000000 2024-08-31T04:38:59.815 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-08-31T04:38:59.815 INFO:teuthology.orchestra.run.smithi177.stdout: "req_mknod_latency": { 2024-08-31T04:38:59.816 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 0, 2024-08-31T04:38:59.816 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.000000000, 2024-08-31T04:38:59.816 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000000000 2024-08-31T04:38:59.816 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-08-31T04:38:59.816 INFO:teuthology.orchestra.run.smithi177.stdout: "req_mksnap_latency": { 2024-08-31T04:38:59.816 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 0, 2024-08-31T04:38:59.816 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.000000000, 2024-08-31T04:38:59.816 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000000000 2024-08-31T04:38:59.816 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-08-31T04:38:59.816 INFO:teuthology.orchestra.run.smithi177.stdout: "req_open_latency": { 2024-08-31T04:38:59.816 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 0, 2024-08-31T04:38:59.816 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.000000000, 2024-08-31T04:38:59.816 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000000000 2024-08-31T04:38:59.817 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-08-31T04:38:59.817 INFO:teuthology.orchestra.run.smithi177.stdout: "req_readdir_latency": { 2024-08-31T04:38:59.817 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 0, 2024-08-31T04:38:59.817 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.000000000, 2024-08-31T04:38:59.817 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000000000 2024-08-31T04:38:59.817 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-08-31T04:38:59.817 INFO:teuthology.orchestra.run.smithi177.stdout: "req_rename_latency": { 2024-08-31T04:38:59.817 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 0, 2024-08-31T04:38:59.817 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.000000000, 2024-08-31T04:38:59.817 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000000000 2024-08-31T04:38:59.817 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-08-31T04:38:59.817 INFO:teuthology.orchestra.run.smithi177.stdout: "req_renamesnap_latency": { 2024-08-31T04:38:59.818 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 0, 2024-08-31T04:38:59.818 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.000000000, 2024-08-31T04:38:59.818 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000000000 2024-08-31T04:38:59.818 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-08-31T04:38:59.818 INFO:teuthology.orchestra.run.smithi177.stdout: "req_snapdiff_latency": { 2024-08-31T04:38:59.818 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 0, 2024-08-31T04:38:59.818 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.000000000, 2024-08-31T04:38:59.818 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000000000 2024-08-31T04:38:59.818 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-08-31T04:38:59.818 INFO:teuthology.orchestra.run.smithi177.stdout: "req_rmdir_latency": { 2024-08-31T04:38:59.818 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 0, 2024-08-31T04:38:59.818 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.000000000, 2024-08-31T04:38:59.818 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000000000 2024-08-31T04:38:59.819 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-08-31T04:38:59.819 INFO:teuthology.orchestra.run.smithi177.stdout: "req_rmsnap_latency": { 2024-08-31T04:38:59.819 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 0, 2024-08-31T04:38:59.819 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.000000000, 2024-08-31T04:38:59.819 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000000000 2024-08-31T04:38:59.819 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-08-31T04:38:59.819 INFO:teuthology.orchestra.run.smithi177.stdout: "req_rmxattr_latency": { 2024-08-31T04:38:59.819 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 0, 2024-08-31T04:38:59.819 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.000000000, 2024-08-31T04:38:59.819 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000000000 2024-08-31T04:38:59.819 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-08-31T04:38:59.819 INFO:teuthology.orchestra.run.smithi177.stdout: "req_setattr_latency": { 2024-08-31T04:38:59.819 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 0, 2024-08-31T04:38:59.820 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.000000000, 2024-08-31T04:38:59.820 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000000000 2024-08-31T04:38:59.820 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-08-31T04:38:59.820 INFO:teuthology.orchestra.run.smithi177.stdout: "req_setdirlayout_latency": { 2024-08-31T04:38:59.820 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 0, 2024-08-31T04:38:59.820 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.000000000, 2024-08-31T04:38:59.820 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000000000 2024-08-31T04:38:59.820 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-08-31T04:38:59.820 INFO:teuthology.orchestra.run.smithi177.stdout: "req_setfilelock_latency": { 2024-08-31T04:38:59.820 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 0, 2024-08-31T04:38:59.820 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.000000000, 2024-08-31T04:38:59.820 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000000000 2024-08-31T04:38:59.820 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-08-31T04:38:59.821 INFO:teuthology.orchestra.run.smithi177.stdout: "req_setlayout_latency": { 2024-08-31T04:38:59.821 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 0, 2024-08-31T04:38:59.821 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.000000000, 2024-08-31T04:38:59.821 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000000000 2024-08-31T04:38:59.821 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-08-31T04:38:59.821 INFO:teuthology.orchestra.run.smithi177.stdout: "req_setxattr_latency": { 2024-08-31T04:38:59.821 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 0, 2024-08-31T04:38:59.821 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.000000000, 2024-08-31T04:38:59.821 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000000000 2024-08-31T04:38:59.821 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-08-31T04:38:59.821 INFO:teuthology.orchestra.run.smithi177.stdout: "req_symlink_latency": { 2024-08-31T04:38:59.821 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 0, 2024-08-31T04:38:59.821 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.000000000, 2024-08-31T04:38:59.822 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000000000 2024-08-31T04:38:59.822 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-08-31T04:38:59.822 INFO:teuthology.orchestra.run.smithi177.stdout: "req_unlink_latency": { 2024-08-31T04:38:59.822 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 0, 2024-08-31T04:38:59.822 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.000000000, 2024-08-31T04:38:59.822 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000000000 2024-08-31T04:38:59.822 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-08-31T04:38:59.822 INFO:teuthology.orchestra.run.smithi177.stdout: "cap_revoke_eviction": 0, 2024-08-31T04:38:59.822 INFO:teuthology.orchestra.run.smithi177.stdout: "cap_acquisition_throttle": 0, 2024-08-31T04:38:59.822 INFO:teuthology.orchestra.run.smithi177.stdout: "req_getvxattr_latency": { 2024-08-31T04:38:59.822 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 0, 2024-08-31T04:38:59.822 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.000000000, 2024-08-31T04:38:59.822 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000000000 2024-08-31T04:38:59.823 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-08-31T04:38:59.823 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-08-31T04:38:59.823 INFO:teuthology.orchestra.run.smithi177.stdout: "mds_sessions": { 2024-08-31T04:38:59.823 INFO:teuthology.orchestra.run.smithi177.stdout: "session_count": 1, 2024-08-31T04:38:59.823 INFO:teuthology.orchestra.run.smithi177.stdout: "session_add": 2, 2024-08-31T04:38:59.823 INFO:teuthology.orchestra.run.smithi177.stdout: "session_remove": 1, 2024-08-31T04:38:59.823 INFO:teuthology.orchestra.run.smithi177.stdout: "sessions_open": 1, 2024-08-31T04:38:59.823 INFO:teuthology.orchestra.run.smithi177.stdout: "sessions_stale": 0, 2024-08-31T04:38:59.823 INFO:teuthology.orchestra.run.smithi177.stdout: "total_load": 0, 2024-08-31T04:38:59.823 INFO:teuthology.orchestra.run.smithi177.stdout: "average_load": 0, 2024-08-31T04:38:59.823 INFO:teuthology.orchestra.run.smithi177.stdout: "avg_session_uptime": 2201, 2024-08-31T04:38:59.823 INFO:teuthology.orchestra.run.smithi177.stdout: "mdthresh_evicted": 0 2024-08-31T04:38:59.823 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-08-31T04:38:59.824 INFO:teuthology.orchestra.run.smithi177.stdout: "mempool": { 2024-08-31T04:38:59.824 INFO:teuthology.orchestra.run.smithi177.stdout: "bloom_filter_bytes": 0, 2024-08-31T04:38:59.824 INFO:teuthology.orchestra.run.smithi177.stdout: "bloom_filter_items": 0, 2024-08-31T04:38:59.824 INFO:teuthology.orchestra.run.smithi177.stdout: "bluestore_alloc_bytes": 0, 2024-08-31T04:38:59.824 INFO:teuthology.orchestra.run.smithi177.stdout: "bluestore_alloc_items": 0, 2024-08-31T04:38:59.824 INFO:teuthology.orchestra.run.smithi177.stdout: "bluestore_cache_data_bytes": 0, 2024-08-31T04:38:59.824 INFO:teuthology.orchestra.run.smithi177.stdout: "bluestore_cache_data_items": 0, 2024-08-31T04:38:59.824 INFO:teuthology.orchestra.run.smithi177.stdout: "bluestore_cache_onode_bytes": 0, 2024-08-31T04:38:59.824 INFO:teuthology.orchestra.run.smithi177.stdout: "bluestore_cache_onode_items": 0, 2024-08-31T04:38:59.824 INFO:teuthology.orchestra.run.smithi177.stdout: "bluestore_cache_meta_bytes": 0, 2024-08-31T04:38:59.824 INFO:teuthology.orchestra.run.smithi177.stdout: "bluestore_cache_meta_items": 0, 2024-08-31T04:38:59.824 INFO:teuthology.orchestra.run.smithi177.stdout: "bluestore_cache_other_bytes": 0, 2024-08-31T04:38:59.825 INFO:teuthology.orchestra.run.smithi177.stdout: "bluestore_cache_other_items": 0, 2024-08-31T04:38:59.825 INFO:teuthology.orchestra.run.smithi177.stdout: "bluestore_cache_buffer_bytes": 0, 2024-08-31T04:38:59.825 INFO:teuthology.orchestra.run.smithi177.stdout: "bluestore_cache_buffer_items": 0, 2024-08-31T04:38:59.825 INFO:teuthology.orchestra.run.smithi177.stdout: "bluestore_extent_bytes": 0, 2024-08-31T04:38:59.825 INFO:teuthology.orchestra.run.smithi177.stdout: "bluestore_extent_items": 0, 2024-08-31T04:38:59.825 INFO:teuthology.orchestra.run.smithi177.stdout: "bluestore_blob_bytes": 0, 2024-08-31T04:38:59.825 INFO:teuthology.orchestra.run.smithi177.stdout: "bluestore_blob_items": 0, 2024-08-31T04:38:59.825 INFO:teuthology.orchestra.run.smithi177.stdout: "bluestore_shared_blob_bytes": 0, 2024-08-31T04:38:59.825 INFO:teuthology.orchestra.run.smithi177.stdout: "bluestore_shared_blob_items": 0, 2024-08-31T04:38:59.825 INFO:teuthology.orchestra.run.smithi177.stdout: "bluestore_inline_bl_bytes": 0, 2024-08-31T04:38:59.825 INFO:teuthology.orchestra.run.smithi177.stdout: "bluestore_inline_bl_items": 0, 2024-08-31T04:38:59.825 INFO:teuthology.orchestra.run.smithi177.stdout: "bluestore_fsck_bytes": 0, 2024-08-31T04:38:59.825 INFO:teuthology.orchestra.run.smithi177.stdout: "bluestore_fsck_items": 0, 2024-08-31T04:38:59.825 INFO:teuthology.orchestra.run.smithi177.stdout: "bluestore_txc_bytes": 0, 2024-08-31T04:38:59.826 INFO:teuthology.orchestra.run.smithi177.stdout: "bluestore_txc_items": 0, 2024-08-31T04:38:59.826 INFO:teuthology.orchestra.run.smithi177.stdout: "bluestore_writing_deferred_bytes": 0, 2024-08-31T04:38:59.826 INFO:teuthology.orchestra.run.smithi177.stdout: "bluestore_writing_deferred_items": 0, 2024-08-31T04:38:59.826 INFO:teuthology.orchestra.run.smithi177.stdout: "bluestore_writing_bytes": 0, 2024-08-31T04:38:59.826 INFO:teuthology.orchestra.run.smithi177.stdout: "bluestore_writing_items": 0, 2024-08-31T04:38:59.826 INFO:teuthology.orchestra.run.smithi177.stdout: "bluefs_bytes": 0, 2024-08-31T04:38:59.826 INFO:teuthology.orchestra.run.smithi177.stdout: "bluefs_items": 0, 2024-08-31T04:38:59.826 INFO:teuthology.orchestra.run.smithi177.stdout: "bluefs_file_reader_bytes": 0, 2024-08-31T04:38:59.826 INFO:teuthology.orchestra.run.smithi177.stdout: "bluefs_file_reader_items": 0, 2024-08-31T04:38:59.826 INFO:teuthology.orchestra.run.smithi177.stdout: "bluefs_file_writer_bytes": 0, 2024-08-31T04:38:59.826 INFO:teuthology.orchestra.run.smithi177.stdout: "bluefs_file_writer_items": 0, 2024-08-31T04:38:59.826 INFO:teuthology.orchestra.run.smithi177.stdout: "buffer_anon_bytes": 232173, 2024-08-31T04:38:59.826 INFO:teuthology.orchestra.run.smithi177.stdout: "buffer_anon_items": 77, 2024-08-31T04:38:59.827 INFO:teuthology.orchestra.run.smithi177.stdout: "buffer_meta_bytes": 0, 2024-08-31T04:38:59.827 INFO:teuthology.orchestra.run.smithi177.stdout: "buffer_meta_items": 0, 2024-08-31T04:38:59.827 INFO:teuthology.orchestra.run.smithi177.stdout: "osd_bytes": 0, 2024-08-31T04:38:59.827 INFO:teuthology.orchestra.run.smithi177.stdout: "osd_items": 0, 2024-08-31T04:38:59.827 INFO:teuthology.orchestra.run.smithi177.stdout: "osd_mapbl_bytes": 0, 2024-08-31T04:38:59.827 INFO:teuthology.orchestra.run.smithi177.stdout: "osd_mapbl_items": 0, 2024-08-31T04:38:59.827 INFO:teuthology.orchestra.run.smithi177.stdout: "osd_pglog_bytes": 0, 2024-08-31T04:38:59.827 INFO:teuthology.orchestra.run.smithi177.stdout: "osd_pglog_items": 0, 2024-08-31T04:38:59.827 INFO:teuthology.orchestra.run.smithi177.stdout: "osdmap_bytes": 7504, 2024-08-31T04:38:59.827 INFO:teuthology.orchestra.run.smithi177.stdout: "osdmap_items": 155, 2024-08-31T04:38:59.827 INFO:teuthology.orchestra.run.smithi177.stdout: "osdmap_mapping_bytes": 0, 2024-08-31T04:38:59.827 INFO:teuthology.orchestra.run.smithi177.stdout: "osdmap_mapping_items": 0, 2024-08-31T04:38:59.827 INFO:teuthology.orchestra.run.smithi177.stdout: "pgmap_bytes": 0, 2024-08-31T04:38:59.828 INFO:teuthology.orchestra.run.smithi177.stdout: "pgmap_items": 0, 2024-08-31T04:38:59.828 INFO:teuthology.orchestra.run.smithi177.stdout: "mds_co_bytes": 5323630, 2024-08-31T04:38:59.828 INFO:teuthology.orchestra.run.smithi177.stdout: "mds_co_items": 31304, 2024-08-31T04:38:59.828 INFO:teuthology.orchestra.run.smithi177.stdout: "unittest_1_bytes": 0, 2024-08-31T04:38:59.828 INFO:teuthology.orchestra.run.smithi177.stdout: "unittest_1_items": 0, 2024-08-31T04:38:59.828 INFO:teuthology.orchestra.run.smithi177.stdout: "unittest_2_bytes": 0, 2024-08-31T04:38:59.828 INFO:teuthology.orchestra.run.smithi177.stdout: "unittest_2_items": 0 2024-08-31T04:38:59.828 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-08-31T04:38:59.828 INFO:teuthology.orchestra.run.smithi177.stdout: "objecter": { 2024-08-31T04:38:59.828 INFO:teuthology.orchestra.run.smithi177.stdout: "op_active": 0, 2024-08-31T04:38:59.828 INFO:teuthology.orchestra.run.smithi177.stdout: "op_laggy": 0, 2024-08-31T04:38:59.828 INFO:teuthology.orchestra.run.smithi177.stdout: "op_send": 3445, 2024-08-31T04:38:59.829 INFO:teuthology.orchestra.run.smithi177.stdout: "op_send_bytes": 21, 2024-08-31T04:38:59.829 INFO:teuthology.orchestra.run.smithi177.stdout: "op_resend": 3, 2024-08-31T04:38:59.829 INFO:teuthology.orchestra.run.smithi177.stdout: "op_reply": 3445, 2024-08-31T04:38:59.829 INFO:teuthology.orchestra.run.smithi177.stdout: "op_latency": { 2024-08-31T04:38:59.829 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 3445, 2024-08-31T04:38:59.829 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 25.663260491, 2024-08-31T04:38:59.829 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.007449422 2024-08-31T04:38:59.829 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-08-31T04:38:59.829 INFO:teuthology.orchestra.run.smithi177.stdout: "op_inflight": 0, 2024-08-31T04:38:59.829 INFO:teuthology.orchestra.run.smithi177.stdout: "oplen_avg": { 2024-08-31T04:38:59.829 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 3445, 2024-08-31T04:38:59.829 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 3446 2024-08-31T04:38:59.829 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-08-31T04:38:59.830 INFO:teuthology.orchestra.run.smithi177.stdout: "op": 3445, 2024-08-31T04:38:59.830 INFO:teuthology.orchestra.run.smithi177.stdout: "op_r": 3445, 2024-08-31T04:38:59.830 INFO:teuthology.orchestra.run.smithi177.stdout: "op_w": 0, 2024-08-31T04:38:59.830 INFO:teuthology.orchestra.run.smithi177.stdout: "op_rmw": 0, 2024-08-31T04:38:59.830 INFO:teuthology.orchestra.run.smithi177.stdout: "op_pg": 0, 2024-08-31T04:38:59.830 INFO:teuthology.orchestra.run.smithi177.stdout: "osdop_stat": 2093, 2024-08-31T04:38:59.830 INFO:teuthology.orchestra.run.smithi177.stdout: "osdop_create": 0, 2024-08-31T04:38:59.830 INFO:teuthology.orchestra.run.smithi177.stdout: "osdop_read": 1350, 2024-08-31T04:38:59.830 INFO:teuthology.orchestra.run.smithi177.stdout: "osdop_write": 0, 2024-08-31T04:38:59.830 INFO:teuthology.orchestra.run.smithi177.stdout: "osdop_writefull": 0, 2024-08-31T04:38:59.830 INFO:teuthology.orchestra.run.smithi177.stdout: "osdop_writesame": 0, 2024-08-31T04:38:59.830 INFO:teuthology.orchestra.run.smithi177.stdout: "osdop_append": 0, 2024-08-31T04:38:59.830 INFO:teuthology.orchestra.run.smithi177.stdout: "osdop_zero": 0, 2024-08-31T04:38:59.831 INFO:teuthology.orchestra.run.smithi177.stdout: "osdop_truncate": 0, 2024-08-31T04:38:59.831 INFO:teuthology.orchestra.run.smithi177.stdout: "osdop_delete": 0, 2024-08-31T04:38:59.831 INFO:teuthology.orchestra.run.smithi177.stdout: "osdop_mapext": 0, 2024-08-31T04:38:59.831 INFO:teuthology.orchestra.run.smithi177.stdout: "osdop_sparse_read": 0, 2024-08-31T04:38:59.831 INFO:teuthology.orchestra.run.smithi177.stdout: "osdop_clonerange": 0, 2024-08-31T04:38:59.831 INFO:teuthology.orchestra.run.smithi177.stdout: "osdop_getxattr": 1, 2024-08-31T04:38:59.831 INFO:teuthology.orchestra.run.smithi177.stdout: "osdop_setxattr": 0, 2024-08-31T04:38:59.831 INFO:teuthology.orchestra.run.smithi177.stdout: "osdop_cmpxattr": 0, 2024-08-31T04:38:59.831 INFO:teuthology.orchestra.run.smithi177.stdout: "osdop_rmxattr": 0, 2024-08-31T04:38:59.831 INFO:teuthology.orchestra.run.smithi177.stdout: "osdop_resetxattrs": 0, 2024-08-31T04:38:59.831 INFO:teuthology.orchestra.run.smithi177.stdout: "osdop_call": 0, 2024-08-31T04:38:59.831 INFO:teuthology.orchestra.run.smithi177.stdout: "osdop_watch": 0, 2024-08-31T04:38:59.832 INFO:teuthology.orchestra.run.smithi177.stdout: "osdop_notify": 0, 2024-08-31T04:38:59.832 INFO:teuthology.orchestra.run.smithi177.stdout: "osdop_src_cmpxattr": 0, 2024-08-31T04:38:59.832 INFO:teuthology.orchestra.run.smithi177.stdout: "osdop_pgls": 0, 2024-08-31T04:38:59.832 INFO:teuthology.orchestra.run.smithi177.stdout: "osdop_pgls_filter": 0, 2024-08-31T04:38:59.832 INFO:teuthology.orchestra.run.smithi177.stdout: "osdop_other": 0, 2024-08-31T04:38:59.832 INFO:teuthology.orchestra.run.smithi177.stdout: "linger_active": 0, 2024-08-31T04:38:59.832 INFO:teuthology.orchestra.run.smithi177.stdout: "linger_send": 0, 2024-08-31T04:38:59.832 INFO:teuthology.orchestra.run.smithi177.stdout: "linger_resend": 0, 2024-08-31T04:38:59.832 INFO:teuthology.orchestra.run.smithi177.stdout: "linger_ping": 0, 2024-08-31T04:38:59.832 INFO:teuthology.orchestra.run.smithi177.stdout: "poolop_active": 0, 2024-08-31T04:38:59.832 INFO:teuthology.orchestra.run.smithi177.stdout: "poolop_send": 0, 2024-08-31T04:38:59.832 INFO:teuthology.orchestra.run.smithi177.stdout: "poolop_resend": 0, 2024-08-31T04:38:59.832 INFO:teuthology.orchestra.run.smithi177.stdout: "poolstat_active": 0, 2024-08-31T04:38:59.833 INFO:teuthology.orchestra.run.smithi177.stdout: "poolstat_send": 0, 2024-08-31T04:38:59.833 INFO:teuthology.orchestra.run.smithi177.stdout: "poolstat_resend": 0, 2024-08-31T04:38:59.833 INFO:teuthology.orchestra.run.smithi177.stdout: "statfs_active": 0, 2024-08-31T04:38:59.833 INFO:teuthology.orchestra.run.smithi177.stdout: "statfs_send": 0, 2024-08-31T04:38:59.833 INFO:teuthology.orchestra.run.smithi177.stdout: "statfs_resend": 0, 2024-08-31T04:38:59.833 INFO:teuthology.orchestra.run.smithi177.stdout: "command_active": 0, 2024-08-31T04:38:59.833 INFO:teuthology.orchestra.run.smithi177.stdout: "command_send": 0, 2024-08-31T04:38:59.833 INFO:teuthology.orchestra.run.smithi177.stdout: "command_resend": 0, 2024-08-31T04:38:59.833 INFO:teuthology.orchestra.run.smithi177.stdout: "map_epoch": 80, 2024-08-31T04:38:59.833 INFO:teuthology.orchestra.run.smithi177.stdout: "map_full": 0, 2024-08-31T04:38:59.833 INFO:teuthology.orchestra.run.smithi177.stdout: "map_inc": 2, 2024-08-31T04:38:59.833 INFO:teuthology.orchestra.run.smithi177.stdout: "osd_sessions": 10, 2024-08-31T04:38:59.833 INFO:teuthology.orchestra.run.smithi177.stdout: "osd_session_open": 10, 2024-08-31T04:38:59.834 INFO:teuthology.orchestra.run.smithi177.stdout: "osd_session_close": 0, 2024-08-31T04:38:59.834 INFO:teuthology.orchestra.run.smithi177.stdout: "osd_laggy": 0, 2024-08-31T04:38:59.834 INFO:teuthology.orchestra.run.smithi177.stdout: "omap_wr": 0, 2024-08-31T04:38:59.834 INFO:teuthology.orchestra.run.smithi177.stdout: "omap_rd": 2, 2024-08-31T04:38:59.834 INFO:teuthology.orchestra.run.smithi177.stdout: "omap_del": 0 2024-08-31T04:38:59.834 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-08-31T04:38:59.834 INFO:teuthology.orchestra.run.smithi177.stdout: "oft": { 2024-08-31T04:38:59.834 INFO:teuthology.orchestra.run.smithi177.stdout: "omap_total_objs": 0, 2024-08-31T04:38:59.834 INFO:teuthology.orchestra.run.smithi177.stdout: "omap_total_kv_pairs": 0, 2024-08-31T04:38:59.834 INFO:teuthology.orchestra.run.smithi177.stdout: "omap_total_updates": 0, 2024-08-31T04:38:59.834 INFO:teuthology.orchestra.run.smithi177.stdout: "omap_total_removes": 0 2024-08-31T04:38:59.834 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-08-31T04:38:59.834 INFO:teuthology.orchestra.run.smithi177.stdout: "purge_queue": { 2024-08-31T04:38:59.834 INFO:teuthology.orchestra.run.smithi177.stdout: "pq_executing_ops": 0, 2024-08-31T04:38:59.835 INFO:teuthology.orchestra.run.smithi177.stdout: "pq_executing_ops_high_water": 0, 2024-08-31T04:38:59.835 INFO:teuthology.orchestra.run.smithi177.stdout: "pq_executing": 0, 2024-08-31T04:38:59.835 INFO:teuthology.orchestra.run.smithi177.stdout: "pq_executing_high_water": 0, 2024-08-31T04:38:59.835 INFO:teuthology.orchestra.run.smithi177.stdout: "pq_executed_ops": 0, 2024-08-31T04:38:59.835 INFO:teuthology.orchestra.run.smithi177.stdout: "pq_executed": 0, 2024-08-31T04:38:59.835 INFO:teuthology.orchestra.run.smithi177.stdout: "pq_item_in_journal": 0 2024-08-31T04:38:59.835 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-08-31T04:38:59.835 INFO:teuthology.orchestra.run.smithi177.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-08-31T04:38:59.835 INFO:teuthology.orchestra.run.smithi177.stdout: "val": 0, 2024-08-31T04:38:59.835 INFO:teuthology.orchestra.run.smithi177.stdout: "max": 104857600, 2024-08-31T04:38:59.835 INFO:teuthology.orchestra.run.smithi177.stdout: "get_started": 0, 2024-08-31T04:38:59.835 INFO:teuthology.orchestra.run.smithi177.stdout: "get": 3804, 2024-08-31T04:38:59.835 INFO:teuthology.orchestra.run.smithi177.stdout: "get_sum": 166961849, 2024-08-31T04:38:59.835 INFO:teuthology.orchestra.run.smithi177.stdout: "get_or_fail_fail": 0, 2024-08-31T04:38:59.836 INFO:teuthology.orchestra.run.smithi177.stdout: "get_or_fail_success": 3804, 2024-08-31T04:38:59.836 INFO:teuthology.orchestra.run.smithi177.stdout: "take": 0, 2024-08-31T04:38:59.836 INFO:teuthology.orchestra.run.smithi177.stdout: "take_sum": 0, 2024-08-31T04:38:59.836 INFO:teuthology.orchestra.run.smithi177.stdout: "put": 3804, 2024-08-31T04:38:59.836 INFO:teuthology.orchestra.run.smithi177.stdout: "put_sum": 166961849, 2024-08-31T04:38:59.836 INFO:teuthology.orchestra.run.smithi177.stdout: "wait": { 2024-08-31T04:38:59.836 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 0, 2024-08-31T04:38:59.836 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.000000000, 2024-08-31T04:38:59.836 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000000000 2024-08-31T04:38:59.836 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-08-31T04:38:59.836 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-08-31T04:38:59.836 INFO:teuthology.orchestra.run.smithi177.stdout: "throttle-objecter_bytes": { 2024-08-31T04:38:59.836 INFO:teuthology.orchestra.run.smithi177.stdout: "val": 0, 2024-08-31T04:38:59.836 INFO:teuthology.orchestra.run.smithi177.stdout: "max": 104857600, 2024-08-31T04:38:59.837 INFO:teuthology.orchestra.run.smithi177.stdout: "get_started": 0, 2024-08-31T04:38:59.837 INFO:teuthology.orchestra.run.smithi177.stdout: "get": 0, 2024-08-31T04:38:59.837 INFO:teuthology.orchestra.run.smithi177.stdout: "get_sum": 0, 2024-08-31T04:38:59.837 INFO:teuthology.orchestra.run.smithi177.stdout: "get_or_fail_fail": 0, 2024-08-31T04:38:59.837 INFO:teuthology.orchestra.run.smithi177.stdout: "get_or_fail_success": 0, 2024-08-31T04:38:59.837 INFO:teuthology.orchestra.run.smithi177.stdout: "take": 3445, 2024-08-31T04:38:59.837 INFO:teuthology.orchestra.run.smithi177.stdout: "take_sum": 165511799, 2024-08-31T04:38:59.837 INFO:teuthology.orchestra.run.smithi177.stdout: "put": 3445, 2024-08-31T04:38:59.837 INFO:teuthology.orchestra.run.smithi177.stdout: "put_sum": 165511799, 2024-08-31T04:38:59.837 INFO:teuthology.orchestra.run.smithi177.stdout: "wait": { 2024-08-31T04:38:59.837 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 0, 2024-08-31T04:38:59.837 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.000000000, 2024-08-31T04:38:59.837 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000000000 2024-08-31T04:38:59.838 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-08-31T04:38:59.838 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-08-31T04:38:59.838 INFO:teuthology.orchestra.run.smithi177.stdout: "throttle-objecter_ops": { 2024-08-31T04:38:59.838 INFO:teuthology.orchestra.run.smithi177.stdout: "val": 0, 2024-08-31T04:38:59.838 INFO:teuthology.orchestra.run.smithi177.stdout: "max": 1024, 2024-08-31T04:38:59.838 INFO:teuthology.orchestra.run.smithi177.stdout: "get_started": 0, 2024-08-31T04:38:59.838 INFO:teuthology.orchestra.run.smithi177.stdout: "get": 0, 2024-08-31T04:38:59.838 INFO:teuthology.orchestra.run.smithi177.stdout: "get_sum": 0, 2024-08-31T04:38:59.838 INFO:teuthology.orchestra.run.smithi177.stdout: "get_or_fail_fail": 0, 2024-08-31T04:38:59.838 INFO:teuthology.orchestra.run.smithi177.stdout: "get_or_fail_success": 0, 2024-08-31T04:38:59.838 INFO:teuthology.orchestra.run.smithi177.stdout: "take": 3445, 2024-08-31T04:38:59.838 INFO:teuthology.orchestra.run.smithi177.stdout: "take_sum": 3445, 2024-08-31T04:38:59.838 INFO:teuthology.orchestra.run.smithi177.stdout: "put": 3445, 2024-08-31T04:38:59.838 INFO:teuthology.orchestra.run.smithi177.stdout: "put_sum": 3445, 2024-08-31T04:38:59.839 INFO:teuthology.orchestra.run.smithi177.stdout: "wait": { 2024-08-31T04:38:59.839 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 0, 2024-08-31T04:38:59.839 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.000000000, 2024-08-31T04:38:59.839 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000000000 2024-08-31T04:38:59.839 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-08-31T04:38:59.839 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-08-31T04:38:59.839 INFO:teuthology.orchestra.run.smithi177.stdout: "throttle-write_buf_throttle": { 2024-08-31T04:38:59.839 INFO:teuthology.orchestra.run.smithi177.stdout: "val": 0, 2024-08-31T04:38:59.839 INFO:teuthology.orchestra.run.smithi177.stdout: "max": 3758096384, 2024-08-31T04:38:59.839 INFO:teuthology.orchestra.run.smithi177.stdout: "get_started": 0, 2024-08-31T04:38:59.839 INFO:teuthology.orchestra.run.smithi177.stdout: "get": 0, 2024-08-31T04:38:59.839 INFO:teuthology.orchestra.run.smithi177.stdout: "get_sum": 0, 2024-08-31T04:38:59.840 INFO:teuthology.orchestra.run.smithi177.stdout: "get_or_fail_fail": 0, 2024-08-31T04:38:59.840 INFO:teuthology.orchestra.run.smithi177.stdout: "get_or_fail_success": 0, 2024-08-31T04:38:59.840 INFO:teuthology.orchestra.run.smithi177.stdout: "take": 0, 2024-08-31T04:38:59.840 INFO:teuthology.orchestra.run.smithi177.stdout: "take_sum": 0, 2024-08-31T04:38:59.840 INFO:teuthology.orchestra.run.smithi177.stdout: "put": 0, 2024-08-31T04:38:59.840 INFO:teuthology.orchestra.run.smithi177.stdout: "put_sum": 0, 2024-08-31T04:38:59.840 INFO:teuthology.orchestra.run.smithi177.stdout: "wait": { 2024-08-31T04:38:59.840 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 0, 2024-08-31T04:38:59.840 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.000000000, 2024-08-31T04:38:59.840 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000000000 2024-08-31T04:38:59.840 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-08-31T04:38:59.840 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-08-31T04:38:59.840 INFO:teuthology.orchestra.run.smithi177.stdout: "throttle-write_buf_throttle-0x562d45870c30": { 2024-08-31T04:38:59.841 INFO:teuthology.orchestra.run.smithi177.stdout: "val": 0, 2024-08-31T04:38:59.841 INFO:teuthology.orchestra.run.smithi177.stdout: "max": 3758096384, 2024-08-31T04:38:59.841 INFO:teuthology.orchestra.run.smithi177.stdout: "get_started": 0, 2024-08-31T04:38:59.841 INFO:teuthology.orchestra.run.smithi177.stdout: "get": 0, 2024-08-31T04:38:59.841 INFO:teuthology.orchestra.run.smithi177.stdout: "get_sum": 0, 2024-08-31T04:38:59.841 INFO:teuthology.orchestra.run.smithi177.stdout: "get_or_fail_fail": 0, 2024-08-31T04:38:59.841 INFO:teuthology.orchestra.run.smithi177.stdout: "get_or_fail_success": 0, 2024-08-31T04:38:59.841 INFO:teuthology.orchestra.run.smithi177.stdout: "take": 0, 2024-08-31T04:38:59.841 INFO:teuthology.orchestra.run.smithi177.stdout: "take_sum": 0, 2024-08-31T04:38:59.841 INFO:teuthology.orchestra.run.smithi177.stdout: "put": 0, 2024-08-31T04:38:59.841 INFO:teuthology.orchestra.run.smithi177.stdout: "put_sum": 0, 2024-08-31T04:38:59.841 INFO:teuthology.orchestra.run.smithi177.stdout: "wait": { 2024-08-31T04:38:59.841 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 0, 2024-08-31T04:38:59.841 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.000000000, 2024-08-31T04:38:59.842 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000000000 2024-08-31T04:38:59.842 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-08-31T04:38:59.842 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-08-31T04:38:59.842 INFO:teuthology.orchestra.run.smithi177.stdout: "trackedop": { 2024-08-31T04:38:59.842 INFO:teuthology.orchestra.run.smithi177.stdout: "slow_ops_count": 0 2024-08-31T04:38:59.842 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-08-31T04:38:59.842 INFO:teuthology.orchestra.run.smithi177.stdout:} 2024-08-31T04:38:59.950 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:38:59 smithi050 ceph-mon[17259]: pgmap v851: 97 pgs: 97 active+clean; 592 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 10 op/s 2024-08-31T04:38:59.950 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:38:59 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T04:39:00.043 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:38:59 smithi133 ceph-mon[22177]: pgmap v851: 97 pgs: 97 active+clean; 592 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 10 op/s 2024-08-31T04:39:00.043 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:38:59 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T04:39:00.567 INFO:tasks.check_counter:Daemon mds.l mds.exported=0 2024-08-31T04:39:00.567 INFO:tasks.check_counter:Daemon mds.l mds.imported=0 2024-08-31T04:39:00.567 INFO:tasks.check_counter:Daemon mds.l mds_cache.dir_update=0 2024-08-31T04:39:00.567 INFO:tasks.check_counter:Daemon mds.l mds_cache.dir_update_receipt=0 2024-08-31T04:39:00.567 INFO:tasks.check_counter:Daemon mds.l mds.dir_split=0 2024-08-31T04:39:00.567 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2024-08-31T04:39:00.577 INFO:tasks.kclient:Unmounting kernel clients... 2024-08-31T04:39:00.577 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-08-31T04:39:00.577 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-31T04:39:00.616 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-08-31T04:39:00.616 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-31T04:39:00.693 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 058d9fc6-674f-11ef-bcd4-c7b262605968 -- ceph osd blocklist ls 2024-08-31T04:39:00.745 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:39:00 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:39:00.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:39:00 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T04:39:00.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:39:00 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:39:00.950 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:39:00 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:39:00.950 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:39:00 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T04:39:00.950 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:39:00 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:39:01.043 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:39:00 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T04:39:01.043 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:39:00 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T04:39:01.043 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:39:00 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' 2024-08-31T04:39:01.118 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:39:01.774 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:01.772+0000 7f9ab6400640 1 -- 172.21.15.50:0/2675111983 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9ab0075550 msgr2=0x7f9ab0075960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:39:01.774 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:01.772+0000 7f9ab6400640 1 --2- 172.21.15.50:0/2675111983 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9ab0075550 0x7f9ab0075960 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f9aa0009900 tx=0x7f9aa002a410 comp rx=0 tx=0).stop 2024-08-31T04:39:01.774 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:01.772+0000 7f9ab6400640 1 -- 172.21.15.50:0/2675111983 shutdown_connections 2024-08-31T04:39:01.774 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:01.772+0000 7f9ab6400640 1 --2- 172.21.15.50:0/2675111983 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9ab0075ea0 0x7f9ab010f940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:39:01.774 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:01.772+0000 7f9ab6400640 1 --2- 172.21.15.50:0/2675111983 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9ab010fe80 0x7f9ab01122c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:39:01.775 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:01.772+0000 7f9ab6400640 1 --2- 172.21.15.50:0/2675111983 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9ab0075550 0x7f9ab0075960 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:39:01.775 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:01.772+0000 7f9ab6400640 1 -- 172.21.15.50:0/2675111983 >> 172.21.15.50:0/2675111983 conn(0x7f9ab00ff370 msgr2=0x7f9ab01017c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:39:01.775 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:01.772+0000 7f9ab6400640 1 -- 172.21.15.50:0/2675111983 shutdown_connections 2024-08-31T04:39:01.775 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:01.772+0000 7f9ab6400640 1 -- 172.21.15.50:0/2675111983 wait complete. 2024-08-31T04:39:01.775 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:01.774+0000 7f9ab6400640 1 Processor -- start 2024-08-31T04:39:01.776 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:01.774+0000 7f9ab6400640 1 -- start start 2024-08-31T04:39:01.776 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:01.774+0000 7f9ab6400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9ab0075550 0x7f9ab019c490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:39:01.776 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:01.774+0000 7f9ab6400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9ab0075ea0 0x7f9ab019ca30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:39:01.776 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:01.774+0000 7f9ab6400640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9ab010fe80 0x7f9ab01a1cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:39:01.776 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:01.774+0000 7f9ab6400640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f9ab0115a80 con 0x7f9ab0075550 2024-08-31T04:39:01.776 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:01.774+0000 7f9ab6400640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f9ab0115900 con 0x7f9ab0075ea0 2024-08-31T04:39:01.776 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:01.774+0000 7f9ab6400640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f9ab0115c00 con 0x7f9ab010fe80 2024-08-31T04:39:01.777 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:01.775+0000 7f9aaf400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9ab0075550 0x7f9ab019c490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:39:01.777 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:01.775+0000 7f9aaf400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9ab0075550 0x7f9ab019c490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:57846/0 (socket says 172.21.15.50:57846) 2024-08-31T04:39:01.777 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:01.775+0000 7f9aaf400640 1 -- 172.21.15.50:0/668508673 learned_addr learned my addr 172.21.15.50:0/668508673 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:39:01.777 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:01.775+0000 7f9aaea00640 1 --2- 172.21.15.50:0/668508673 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9ab0075ea0 0x7f9ab019ca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:39:01.778 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:01.775+0000 7f9aafe00640 1 --2- 172.21.15.50:0/668508673 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9ab010fe80 0x7f9ab01a1cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:39:01.778 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:01.775+0000 7f9aaf400640 1 -- 172.21.15.50:0/668508673 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9ab010fe80 msgr2=0x7f9ab01a1cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:39:01.778 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:01.775+0000 7f9aaf400640 1 --2- 172.21.15.50:0/668508673 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9ab010fe80 0x7f9ab01a1cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:39:01.778 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:01.775+0000 7f9aaf400640 1 -- 172.21.15.50:0/668508673 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9ab0075ea0 msgr2=0x7f9ab019ca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:39:01.778 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:01.775+0000 7f9aaf400640 1 --2- 172.21.15.50:0/668508673 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9ab0075ea0 0x7f9ab019ca30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:39:01.778 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:01.775+0000 7f9aaf400640 1 -- 172.21.15.50:0/668508673 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ab01a2400 con 0x7f9ab0075550 2024-08-31T04:39:01.778 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:01.775+0000 7f9aaea00640 1 --2- 172.21.15.50:0/668508673 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9ab0075ea0 0x7f9ab019ca30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:39:01.778 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:01.776+0000 7f9aaf400640 1 --2- 172.21.15.50:0/668508673 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9ab0075550 0x7f9ab019c490 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f9aa0005ab0 tx=0x7f9aa0003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:39:01.778 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:01.776+0000 7f9aa7e00640 1 -- 172.21.15.50:0/668508673 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9aa003f070 con 0x7f9ab0075550 2024-08-31T04:39:01.778 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:01.776+0000 7f9aa7e00640 1 -- 172.21.15.50:0/668508673 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9aa0031b60 con 0x7f9ab0075550 2024-08-31T04:39:01.778 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:01.776+0000 7f9ab6400640 1 -- 172.21.15.50:0/668508673 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ab01a2690 con 0x7f9ab0075550 2024-08-31T04:39:01.778 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:01.776+0000 7f9aa7e00640 1 -- 172.21.15.50:0/668508673 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9aa0035030 con 0x7f9ab0075550 2024-08-31T04:39:01.778 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:01.776+0000 7f9ab6400640 1 -- 172.21.15.50:0/668508673 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ab01a8e50 con 0x7f9ab0075550 2024-08-31T04:39:01.779 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:01.777+0000 7f9ab6400640 1 -- 172.21.15.50:0/668508673 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9ab0076a60 con 0x7f9ab0075550 2024-08-31T04:39:01.784 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:01.780+0000 7f9aa7e00640 1 -- 172.21.15.50:0/668508673 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 18) ==== 152577+0+0 (secure 0 0 0) 0x7f9aa0042070 con 0x7f9ab0075550 2024-08-31T04:39:01.785 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:01.782+0000 7f9aa7e00640 1 --2- 172.21.15.50:0/668508673 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f9a940b4b30 0x7f9a940b7040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:39:01.785 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:01.783+0000 7f9aa7e00640 1 -- 172.21.15.50:0/668508673 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8219+0+0 (secure 0 0 0) 0x7f9aa0105ec0 con 0x7f9ab0075550 2024-08-31T04:39:01.785 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:01.783+0000 7f9aaea00640 1 --2- 172.21.15.50:0/668508673 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f9a940b4b30 0x7f9a940b7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:39:01.785 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:01.783+0000 7f9aaea00640 1 --2- 172.21.15.50:0/668508673 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f9a940b4b30 0x7f9a940b7040 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f9ab01121f0 tx=0x7f9a9c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:39:01.786 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:01.785+0000 7f9aa7e00640 1 -- 172.21.15.50:0/668508673 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f9aa00cc950 con 0x7f9ab0075550 2024-08-31T04:39:01.950 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:39:01 smithi050 ceph-mon[17259]: pgmap v852: 97 pgs: 97 active+clean; 592 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-08-31T04:39:01.995 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:01.993+0000 7f9ab6400640 1 -- 172.21.15.50:0/668508673 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f9ab0075960 con 0x7f9ab0075550 2024-08-31T04:39:01.995 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:01.994+0000 7f9aa7e00640 1 -- 172.21.15.50:0/668508673 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 10 entries v80) ==== 81+0+592 (secure 0 0 0) 0x7f9aa00d1110 con 0x7f9ab0075550 2024-08-31T04:39:01.995 INFO:teuthology.orchestra.run.smithi050.stdout:172.21.15.50:6801/1319056820 2024-09-01T04:12:55.742020+0000 2024-08-31T04:39:01.996 INFO:teuthology.orchestra.run.smithi050.stdout:172.21.15.50:0/1755103674 2024-09-01T04:12:55.742020+0000 2024-08-31T04:39:01.996 INFO:teuthology.orchestra.run.smithi050.stdout:172.21.15.50:6800/1319056820 2024-09-01T04:12:55.742020+0000 2024-08-31T04:39:01.996 INFO:teuthology.orchestra.run.smithi050.stdout:172.21.15.50:0/3701412233 2024-09-01T04:12:55.742020+0000 2024-08-31T04:39:01.996 INFO:teuthology.orchestra.run.smithi050.stdout:172.21.15.50:0/1829556336 2024-09-01T04:12:55.742020+0000 2024-08-31T04:39:01.996 INFO:teuthology.orchestra.run.smithi050.stdout:172.21.15.50:0/1698995126 2024-09-01T04:12:25.753831+0000 2024-08-31T04:39:01.996 INFO:teuthology.orchestra.run.smithi050.stdout:172.21.15.50:0/1554317941 2024-09-01T04:12:25.753831+0000 2024-08-31T04:39:01.996 INFO:teuthology.orchestra.run.smithi050.stdout:172.21.15.50:0/2998110380 2024-09-01T04:12:25.753831+0000 2024-08-31T04:39:01.996 INFO:teuthology.orchestra.run.smithi050.stdout:172.21.15.50:6801/4197277793 2024-09-01T04:12:25.753831+0000 2024-08-31T04:39:01.996 INFO:teuthology.orchestra.run.smithi050.stdout:172.21.15.50:6800/4197277793 2024-09-01T04:12:25.753831+0000 2024-08-31T04:39:01.997 INFO:teuthology.orchestra.run.smithi050.stderr:listed 10 entries 2024-08-31T04:39:01.997 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:39:01 smithi177 ceph-mon[22025]: pgmap v852: 97 pgs: 97 active+clean; 592 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-08-31T04:39:01.999 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:01.996+0000 7f9ab6400640 1 -- 172.21.15.50:0/668508673 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f9a940b4b30 msgr2=0x7f9a940b7040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:39:01.999 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:01.996+0000 7f9ab6400640 1 --2- 172.21.15.50:0/668508673 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f9a940b4b30 0x7f9a940b7040 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f9ab01121f0 tx=0x7f9a9c005f90 comp rx=0 tx=0).stop 2024-08-31T04:39:01.999 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:01.996+0000 7f9ab6400640 1 -- 172.21.15.50:0/668508673 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9ab0075550 msgr2=0x7f9ab019c490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:39:01.999 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:01.996+0000 7f9ab6400640 1 --2- 172.21.15.50:0/668508673 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9ab0075550 0x7f9ab019c490 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f9aa0005ab0 tx=0x7f9aa0003c10 comp rx=0 tx=0).stop 2024-08-31T04:39:01.999 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:01.996+0000 7f9ab6400640 1 -- 172.21.15.50:0/668508673 shutdown_connections 2024-08-31T04:39:01.999 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:01.996+0000 7f9ab6400640 1 --2- 172.21.15.50:0/668508673 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f9a940b4b30 0x7f9a940b7040 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:39:01.999 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:01.996+0000 7f9ab6400640 1 --2- 172.21.15.50:0/668508673 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9ab010fe80 0x7f9ab01a1cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:39:01.999 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:01.996+0000 7f9ab6400640 1 --2- 172.21.15.50:0/668508673 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9ab0075ea0 0x7f9ab019ca30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:39:01.999 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:01.996+0000 7f9ab6400640 1 --2- 172.21.15.50:0/668508673 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9ab0075550 0x7f9ab019c490 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:39:02.000 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:01.996+0000 7f9ab6400640 1 -- 172.21.15.50:0/668508673 >> 172.21.15.50:0/668508673 conn(0x7f9ab00ff370 msgr2=0x7f9ab01099b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:39:02.000 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:01.997+0000 7f9ab6400640 1 -- 172.21.15.50:0/668508673 shutdown_connections 2024-08-31T04:39:02.000 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:01.997+0000 7f9ab6400640 1 -- 172.21.15.50:0/668508673 wait complete. 2024-08-31T04:39:02.043 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:39:01 smithi133 ceph-mon[22177]: pgmap v852: 97 pgs: 97 active+clean; 592 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-08-31T04:39:02.751 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-08-31T04:39:02.751 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-31T04:39:02.751 DEBUG:teuthology.orchestra.run.smithi050:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-08-31T04:39:02.946 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:39:02 smithi050 ceph-mon[17259]: from='client.? 172.21.15.50:0/668508673' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-08-31T04:39:02.947 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi050.front.sepia.ceph.com 2024-08-31T04:39:02.947 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-31T04:39:02.947 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-08-31T04:39:02.995 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:39:02 smithi177 ceph-mon[22025]: from='client.? 172.21.15.50:0/668508673' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-08-31T04:39:03.029 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-31T04:39:03.029 DEBUG:teuthology.orchestra.run.smithi050:> ip netns list 2024-08-31T04:39:03.042 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:39:02 smithi133 ceph-mon[22177]: from='client.? 172.21.15.50:0/668508673' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-08-31T04:39:03.110 INFO:teuthology.orchestra.run.smithi050.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-08-31T04:39:03.111 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-31T04:39:03.111 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-08-31T04:39:03.251 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-31T04:39:03.251 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip link delete ceph-brx 2024-08-31T04:39:03.557 INFO:tasks.kclient:Unmounting kernel clients... 2024-08-31T04:39:03.557 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-08-31T04:39:03.557 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-31T04:39:03.614 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053403,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249604k,nr_inodes=812401,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/sda1 /var/lib/containers/storage/overlay ext4 rw,seclabel,relatime 0 0 overlay /var/lib/containers/storage/overlay/27e4ac019cea16ca313136a4e861dc7806797b91879807d4c37fe2f7ef900216/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",relatime,lowerdir=/var/lib/containers/storage/overlay/l/NCLKGXYKPRT7TXMARDC4QCJ6G5:/var/lib/containers/storage/overlay/l/3JZS77P7TT4NKN5UVPHYY3N7VT,upperdir=/var/lib/containers/storage/overlay/27e4ac019cea16ca313136a4e861dc7806797b91879807d4c37fe2f7ef900216/diff,workdir=/var/lib/containers/storage/overlay/27e4ac019cea16ca313136a4e861dc7806797b91879807d4c37fe2f7ef900216/work,redirect_dir=on,uuid=on,metacopy=on,volatile 0 0 overlay /var/lib/containers/storage/overlay/9cba422095daaad7148ce15a6778cd87d7cf1992d157bc4b4b355c34664fc140/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",nodev,relatime,lowerdir=/var/lib/containers/storage/overlay/l/NCLKGXYKPRT7TXMARDC4QCJ6G5:/var/lib/containers/storage/overlay/l/3JZS77P7TT4NKN5UVPHYY3N7VT,upperdir=/var/lib/containers/storage/overlay/9cba422095daaad7148ce15a6778cd87d7cf1992d157bc4b4b355c34664fc140/diff,workdir=/var/lib/containers/storage/overlay/9cba422095daaad7148ce15a6778cd87d7cf1992d157bc4b4b355c34664fc140/work,redirect_dir=on,uuid=on,metacopy=on,volatile 0 0 tmpfs /run/user/0 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249604k,nr_inodes=812401,mode=700 0 0 binfmt_misc /proc/sys/fs/binfmt_misc binfmt_misc rw,nosuid,nodev,noexec,relatime 0 0 overlay /var/lib/containers/storage/overlay/07dca5f690b4fa1ed07bd5354dbe11bbdc907086bab6e0f833de7aa247834dcb/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",relatime,lowerdir=/var/lib/containers/storage/overlay/l/NCLKGXYKPRT7TXMARDC4QCJ6G5:/var/lib/containers/storage/overlay/l/3JZS77P7TT4NKN5UVPHYY3N7VT,upperdir=/var/lib/containers/storage/overlay/07dca5f690b4fa1ed07bd5354dbe11bbdc907086bab6e0f833de7aa247834dcb/diff,workdir=/var/lib/containers/storage/overlay/07dca5f690b4fa1ed07bd5354dbe11bbdc907086bab6e0f833de7aa247834dcb/work,redirect_dir=on,uuid=on,metacopy=on,volatile 0 0 overlay /var/lib/containers/storage/overlay/be7d6ea7de3d737d42a064dd1a74081ec0cb8d7d2528ba7e5448ec85f0d52594/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",relatime,lowerdir=/var/lib/containers/storage/overlay/l/NCLKGXYKPRT7TXMARDC4QCJ6G5:/var/lib/containers/storage/overlay/l/3JZS77P7TT4NKN5UVPHYY3N7VT,upperdir=/var/lib/containers/storage/overlay/be7d6ea7de3d737d42a064dd1a74081ec0cb8d7d2528ba7e5448ec85f0d52594/diff,workdir=/var/lib/containers/storage/overlay/be7d6ea7de3d737d42a064dd1a74081ec0cb8d7d2528ba7e5448ec85f0d52594/work,redirect_dir=on,uuid=on,metacopy=on,volatile 0 0 overlay /var/lib/containers/storage/overlay/c590903f69f520f074230965d988e8a1871a722fe7433e6be130dd588a9a5264/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",relatime,lowerdir=/var/lib/containers/storage/overlay/l/NCLKGXYKPRT7TXMARDC4QCJ6G5:/var/lib/containers/storage/overlay/l/3JZS77P7TT4NKN5UVPHYY3N7VT,upperdir=/var/lib/containers/storage/overlay/c590903f69f520f074230965d988e8a1871a722fe7433e6be130dd588a9a5264/diff,workdir=/var/lib/containers/storage/overlay/c590903f69f520f074230965d988e8a1871a722fe7433e6be130dd588a9a5264/work,redirect_dir=on,uuid=on,metacopy=on,volatile 0 0 overlay /var/lib/containers/storage/overlay/88ed2962fe2a622b7262487f4861536bcace53b91e1e3bf06d12188b4b48a353/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",relatime,lowerdir=/var/lib/containers/storage/overlay/l/NCLKGXYKPRT7TXMARDC4QCJ6G5:/var/lib/containers/storage/overlay/l/3JZS77P7TT4NKN5UVPHYY3N7VT,upperdir=/var/lib/containers/storage/overlay/88ed2962fe2a622b7262487f4861536bcace53b91e1e3bf06d12188b4b48a353/diff,workdir=/var/lib/containers/storage/overlay/88ed2962fe2a622b7262487f4861536bcace53b91e1e3bf06d12188b4b48a353/work,redirect_dir=on,uuid=on,metacopy=on,volatile 0 0 overlay /var/lib/containers/storage/overlay/510a15348abd0e8b6b1e2e4560396ce40d3b0b82a6a058f27d223451cfa0c364/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",nodev,relatime,lowerdir=/var/lib/containers/storage/overlay/l/NCLKGXYKPRT7TXMARDC4QCJ6G5:/var/lib/containers/storage/overlay/l/3JZS77P7TT4NKN5UVPHYY3N7VT,upperdir=/var/lib/containers/storage/overlay/510a15348abd0e8b6b1e2e4560396ce40d3b0b82a6a058f27d223451cfa0c364/diff,workdir=/var/lib/containers/storage/overlay/510a15348abd0e8b6b1e2e4560396ce40d3b0b82a6a058f27d223451cfa0c364/work,redirect_dir=on,uuid=on,metacopy=on,volatile 0 0 overlay /var/lib/containers/storage/overlay/f890566058e6563dd58e7b605c97c4bb929468f8e41b13f1fe282319cee35db1/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",nodev,relatime,lowerdir=/var/lib/containers/storage/overlay/l/NCLKGXYKPRT7TXMARDC4QCJ6G5:/var/lib/containers/storage/overlay/l/3JZS77P7TT4NKN5UVPHYY3N7VT,upperdir=/var/lib/containers/storage/overlay/f890566058e6563dd58e7b605c97c4bb929468f8e41b13f1fe282319cee35db1/diff,workdir=/var/lib/containers/storage/overlay/f890566058e6563dd58e7b605c97c4bb929468f8e41b13f1fe282319cee35db1/work,redirect_dir=on,uuid=on,metacopy=on,volatile 0 0 overlay /var/lib/containers/storage/overlay/037f8665e2d1a3fe3df076eb3cfb349c4223d3c9536e91e08cf16e788bf4f21d/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",nodev,relatime,lowerdir=/var/lib/containers/storage/overlay/l/NCLKGXYKPRT7TXMARDC4QCJ6G5:/var/lib/containers/storage/overlay/l/3JZS77P7TT4NKN5UVPHYY3N7VT,upperdir=/var/lib/containers/storage/overlay/037f8665e2d1a3fe3df076eb3cfb349c4223d3c9536e91e08cf16e788bf4f21d/diff,workdir=/var/lib/containers/storage/overlay/037f8665e2d1a3fe3df076eb3cfb349c4223d3c9536e91e08cf16e788bf4f21d/work,redirect_dir=on,uuid=on,metacopy=on,volatile 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 overlay /var/lib/containers/storage/overlay/6149508ad94393ac944a20dfbcc4a6a5886cc2d9b49f2ecfa7b02b522a69d7a4/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",nodev,relatime,lowerdir=/var/lib/containers/storage/overlay/l/NCLKGXYKPRT7TXMARDC4QCJ6G5:/var/lib/containers/storage/overlay/l/3JZS77P7TT4NKN5UVPHYY3N7VT,upperdir=/var/lib/containers/storage/overlay/6149508ad94393ac944a20dfbcc4a6a5886cc2d9b49f2ecfa7b02b522a69d7a4/diff,workdir=/var/lib/containers/storage/overlay/6149508ad94393ac944a20dfbcc4a6a5886cc2d9b49f2ecfa7b02b522a69d7a4/work,redirect_dir=on,uuid=on,metacopy=on,volatile 0 0 2024-08-31T04:39:03.614 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-31T04:39:03.614 DEBUG:teuthology.orchestra.run.smithi050:> ip netns list 2024-08-31T04:39:03.650 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-31T04:39:03.650 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip link delete ceph-brx 2024-08-31T04:39:03.753 INFO:teuthology.orchestra.run.smithi050.stderr:Cannot find device "ceph-brx" 2024-08-31T04:39:03.755 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-31T04:39:03.756 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2024-08-31T04:39:03.766 INFO:tasks.cephadm:Teardown begin 2024-08-31T04:39:03.766 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-08-31T04:39:03.766 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 058d9fc6-674f-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-31T04:39:03.814 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:39:03 smithi050 ceph-mon[17259]: pgmap v853: 97 pgs: 97 active+clean; 592 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-08-31T04:39:03.996 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:39:03 smithi177 ceph-mon[22025]: pgmap v853: 97 pgs: 97 active+clean; 592 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-08-31T04:39:04.042 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:39:03 smithi133 ceph-mon[22177]: pgmap v853: 97 pgs: 97 active+clean; 592 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-08-31T04:39:04.147 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:39:04.811 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:04.808+0000 7f6589e00640 1 -- 172.21.15.50:0/3115999707 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6584103750 msgr2=0x7f6584103b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:39:04.811 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:04.808+0000 7f6589e00640 1 --2- 172.21.15.50:0/3115999707 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6584103750 0x7f6584103b60 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f6578009900 tx=0x7f657802a410 comp rx=0 tx=0).stop 2024-08-31T04:39:04.811 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:04.809+0000 7f6589e00640 1 -- 172.21.15.50:0/3115999707 shutdown_connections 2024-08-31T04:39:04.811 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:04.809+0000 7f6589e00640 1 --2- 172.21.15.50:0/3115999707 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f65841099e0 0x7f6584110210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:39:04.812 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:04.809+0000 7f6589e00640 1 --2- 172.21.15.50:0/3115999707 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6584109090 0x7f65841094a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:39:04.812 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:04.809+0000 7f6589e00640 1 --2- 172.21.15.50:0/3115999707 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6584103750 0x7f6584103b60 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:39:04.812 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:04.809+0000 7f6589e00640 1 -- 172.21.15.50:0/3115999707 >> 172.21.15.50:0/3115999707 conn(0x7f65840ff1e0 msgr2=0x7f6584101630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:39:04.812 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:04.809+0000 7f6589e00640 1 -- 172.21.15.50:0/3115999707 shutdown_connections 2024-08-31T04:39:04.812 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:04.809+0000 7f6589e00640 1 -- 172.21.15.50:0/3115999707 wait complete. 2024-08-31T04:39:04.812 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:04.810+0000 7f6589e00640 1 Processor -- start 2024-08-31T04:39:04.812 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:04.810+0000 7f6589e00640 1 -- start start 2024-08-31T04:39:04.814 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:04.810+0000 7f6589e00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6584103750 0x7f65840754b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:39:04.814 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:04.810+0000 7f6589e00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6584109090 0x7f65840759f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:39:04.814 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:04.810+0000 7f6589e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f65841099e0 0x7f6584075f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:39:04.814 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:04.810+0000 7f6589e00640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f6584113720 con 0x7f65841099e0 2024-08-31T04:39:04.814 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:04.810+0000 7f6589e00640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f65841135a0 con 0x7f6584103750 2024-08-31T04:39:04.814 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:04.810+0000 7f6589e00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f65841138a0 con 0x7f6584109090 2024-08-31T04:39:04.815 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:04.811+0000 7f6589400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f65841099e0 0x7f6584075f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:39:04.815 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:04.811+0000 7f6588a00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6584103750 0x7f65840754b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:39:04.815 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:04.811+0000 7f6583e00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6584109090 0x7f65840759f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:39:04.815 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:04.811+0000 7f6589400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f65841099e0 0x7f6584075f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:38960/0 (socket says 172.21.15.50:38960) 2024-08-31T04:39:04.815 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:04.811+0000 7f6589400640 1 -- 172.21.15.50:0/3173291455 learned_addr learned my addr 172.21.15.50:0/3173291455 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:39:04.815 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:04.811+0000 7f6588a00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6584103750 0x7f65840754b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.50:38712/0 (socket says 172.21.15.50:38712) 2024-08-31T04:39:04.815 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:04.811+0000 7f6588a00640 1 -- 172.21.15.50:0/3173291455 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6584109090 msgr2=0x7f65840759f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:39:04.815 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:04.811+0000 7f6588a00640 1 --2- 172.21.15.50:0/3173291455 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6584109090 0x7f65840759f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:39:04.815 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:04.811+0000 7f6588a00640 1 -- 172.21.15.50:0/3173291455 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f65841099e0 msgr2=0x7f6584075f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:39:04.815 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:04.811+0000 7f6588a00640 1 --2- 172.21.15.50:0/3173291455 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f65841099e0 0x7f6584075f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:39:04.815 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:04.811+0000 7f6588a00640 1 -- 172.21.15.50:0/3173291455 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65841a83d0 con 0x7f6584103750 2024-08-31T04:39:04.815 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:04.811+0000 7f6589400640 1 --2- 172.21.15.50:0/3173291455 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f65841099e0 0x7f6584075f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:39:04.816 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:04.812+0000 7f6588a00640 1 --2- 172.21.15.50:0/3173291455 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6584103750 0x7f65840754b0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f657802aa00 tx=0x7f6578003b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:39:04.816 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:04.812+0000 7f6581600640 1 -- 172.21.15.50:0/3173291455 <== mon.2 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f657803f070 con 0x7f6584103750 2024-08-31T04:39:04.816 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:04.812+0000 7f6589e00640 1 -- 172.21.15.50:0/3173291455 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f65841a8660 con 0x7f6584103750 2024-08-31T04:39:04.816 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:04.812+0000 7f6581600640 1 -- 172.21.15.50:0/3173291455 <== mon.2 v2:172.21.15.133:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6578031b50 con 0x7f6584103750 2024-08-31T04:39:04.816 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:04.812+0000 7f6581600640 1 -- 172.21.15.50:0/3173291455 <== mon.2 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6578035030 con 0x7f6584103750 2024-08-31T04:39:04.816 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:04.812+0000 7f6589e00640 1 -- 172.21.15.50:0/3173291455 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f65841a8b60 con 0x7f6584103750 2024-08-31T04:39:04.816 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:04.813+0000 7f6589e00640 1 -- 172.21.15.50:0/3173291455 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6584103b60 con 0x7f6584103750 2024-08-31T04:39:04.817 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:04.816+0000 7f6581600640 1 -- 172.21.15.50:0/3173291455 <== mon.2 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 18) ==== 152577+0+0 (secure 0 0 0) 0x7f6578042070 con 0x7f6584103750 2024-08-31T04:39:04.819 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:04.818+0000 7f6581600640 1 --2- 172.21.15.50:0/3173291455 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f656c0b4bb0 0x7f656c0b70c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:39:04.819 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:04.818+0000 7f6581600640 1 -- 172.21.15.50:0/3173291455 <== mon.2 v2:172.21.15.133:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8219+0+0 (secure 0 0 0) 0x7f65781058e0 con 0x7f6584103750 2024-08-31T04:39:04.819 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:04.818+0000 7f6583e00640 1 --2- 172.21.15.50:0/3173291455 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f656c0b4bb0 0x7f656c0b70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:39:04.819 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:04.819+0000 7f6583e00640 1 --2- 172.21.15.50:0/3173291455 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f656c0b4bb0 0x7f656c0b70c0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f6584108a80 tx=0x7f6570005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:39:04.821 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:04.820+0000 7f6581600640 1 -- 172.21.15.50:0/3173291455 <== mon.2 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f6578031d00 con 0x7f6584103750 2024-08-31T04:39:05.057 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:05.054+0000 7f6589e00640 1 -- 172.21.15.50:0/3173291455 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f658402e430 con 0x7f6584103750 2024-08-31T04:39:05.057 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:05.055+0000 7f6581600640 1 -- 172.21.15.50:0/3173291455 <== mon.2 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 71 v71) ==== 94+0+12028 (secure 0 0 0) 0x7f65780cc370 con 0x7f6584103750 2024-08-31T04:39:05.057 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-08-31T04:39:05.058 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":71,"btime":"2024-08-31T04:35:08:748083+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14622,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/1565557530","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":1565557530},{"type":"v1","addr":"172.21.15.50:6835","nonce":1565557530}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":25924,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6835/4060379633","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6834","nonce":4060379633},{"type":"v1","addr":"172.21.15.177:6835","nonce":4060379633}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":39}],"filesystems":[{"mdsmap":{"epoch":71,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-31T04:20:44.140709+0000","modified":"2024-08-31T04:35:08.648800+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24695,"mds_1":24691,"mds_2":24667,"mds_3":24656,"mds_4":24652},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14676":{"gid":14676,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.50:6839/2105228685","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6838","nonce":2105228685},{"type":"v1","addr":"172.21.15.50:6839","nonce":2105228685}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24590":{"gid":24590,"name":"k","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.133:6833/4283603962","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6832","nonce":4283603962},{"type":"v1","addr":"172.21.15.133:6833","nonce":4283603962}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24601":{"gid":24601,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.177:6833/1237129793","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":1237129793},{"type":"v1","addr":"172.21.15.177:6833","nonce":1237129793}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24626":{"gid":24626,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.133:6835/3637799701","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":3637799701},{"type":"v1","addr":"172.21.15.133:6835","nonce":3637799701}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24652":{"gid":24652,"name":"c","rank":4,"incarnation":26,"state":"up:active","state_seq":215,"addr":"172.21.15.177:6837/2159859285","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6836","nonce":2159859285},{"type":"v1","addr":"172.21.15.177:6837","nonce":2159859285}]},"join_fscid":-1,"export_targets":[0,1,2,3],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24656":{"gid":24656,"name":"h","rank":3,"incarnation":22,"state":"up:active","state_seq":213,"addr":"172.21.15.133:6837/4014853202","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6836","nonce":4014853202},{"type":"v1","addr":"172.21.15.133:6837","nonce":4014853202}]},"join_fscid":-1,"export_targets":[0,1,2,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24667":{"gid":24667,"name":"i","rank":2,"incarnation":20,"state":"up:active","state_seq":10,"addr":"172.21.15.177:6839/3600081752","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6838","nonce":3600081752},{"type":"v1","addr":"172.21.15.177:6839","nonce":3600081752}]},"join_fscid":-1,"export_targets":[0,1,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24691":{"gid":24691,"name":"a","rank":1,"incarnation":18,"state":"up:active","state_seq":210,"addr":"172.21.15.50:6841/575209862","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6840","nonce":575209862},{"type":"v1","addr":"172.21.15.50:6841","nonce":575209862}]},"join_fscid":-1,"export_targets":[0,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24695":{"gid":24695,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":208,"addr":"172.21.15.133:6839/2526402262","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6838","nonce":2526402262},{"type":"v1","addr":"172.21.15.133:6839","nonce":2526402262}]},"join_fscid":-1,"export_targets":[1,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_26036":{"gid":26036,"name":"d","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.50:6837/2788697263","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6836","nonce":2788697263},{"type":"v1","addr":"172.21.15.50:6837","nonce":2788697263}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24695,"qdb_cluster":[24652,24691,24656,24695,24667]},"id":1}]} 2024-08-31T04:39:05.058 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 71 2024-08-31T04:39:05.059 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:05.057+0000 7f6589e00640 1 -- 172.21.15.50:0/3173291455 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f656c0b4bb0 msgr2=0x7f656c0b70c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:39:05.060 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:05.057+0000 7f6589e00640 1 --2- 172.21.15.50:0/3173291455 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f656c0b4bb0 0x7f656c0b70c0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f6584108a80 tx=0x7f6570005f90 comp rx=0 tx=0).stop 2024-08-31T04:39:05.060 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:05.057+0000 7f6589e00640 1 -- 172.21.15.50:0/3173291455 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6584103750 msgr2=0x7f65840754b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:39:05.060 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:05.057+0000 7f6589e00640 1 --2- 172.21.15.50:0/3173291455 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6584103750 0x7f65840754b0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f657802aa00 tx=0x7f6578003b90 comp rx=0 tx=0).stop 2024-08-31T04:39:05.060 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:05.058+0000 7f6589e00640 1 -- 172.21.15.50:0/3173291455 shutdown_connections 2024-08-31T04:39:05.060 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:05.058+0000 7f6589e00640 1 --2- 172.21.15.50:0/3173291455 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f656c0b4bb0 0x7f656c0b70c0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:39:05.060 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:05.058+0000 7f6589e00640 1 --2- 172.21.15.50:0/3173291455 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6584109090 0x7f65840759f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:39:05.060 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:05.058+0000 7f6589e00640 1 --2- 172.21.15.50:0/3173291455 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f65841099e0 0x7f6584075f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:39:05.060 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:05.058+0000 7f6589e00640 1 --2- 172.21.15.50:0/3173291455 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6584103750 0x7f65840754b0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:39:05.060 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:05.058+0000 7f6589e00640 1 -- 172.21.15.50:0/3173291455 >> 172.21.15.50:0/3173291455 conn(0x7f65840ff1e0 msgr2=0x7f6584101600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:39:05.060 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:05.058+0000 7f6589e00640 1 -- 172.21.15.50:0/3173291455 shutdown_connections 2024-08-31T04:39:05.060 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:05.058+0000 7f6589e00640 1 -- 172.21.15.50:0/3173291455 wait complete. 2024-08-31T04:39:05.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:39:05 smithi050 ceph-mon[17259]: pgmap v854: 97 pgs: 97 active+clean; 592 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 170 B/s wr, 8 op/s 2024-08-31T04:39:05.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:39:05 smithi050 ceph-mon[17259]: from='client.? 172.21.15.50:0/3173291455' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T04:39:05.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:39:05 smithi177 ceph-mon[22025]: pgmap v854: 97 pgs: 97 active+clean; 592 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 170 B/s wr, 8 op/s 2024-08-31T04:39:05.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:39:05 smithi177 ceph-mon[22025]: from='client.? 172.21.15.50:0/3173291455' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T04:39:05.781 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 058d9fc6-674f-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-31T04:39:06.043 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:39:05 smithi133 ceph-mon[22177]: pgmap v854: 97 pgs: 97 active+clean; 592 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 170 B/s wr, 8 op/s 2024-08-31T04:39:06.043 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:39:05 smithi133 ceph-mon[22177]: from='client.? 172.21.15.50:0/3173291455' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T04:39:06.164 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:39:06.768 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:06.767+0000 7f815f400640 1 -- 172.21.15.50:0/2179229249 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8158103920 msgr2=0x7f8158103d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:39:06.769 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:06.767+0000 7f815f400640 1 --2- 172.21.15.50:0/2179229249 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8158103920 0x7f8158103d30 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f814c009900 tx=0x7f814c02a3f0 comp rx=0 tx=0).stop 2024-08-31T04:39:06.769 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:06.767+0000 7f815f400640 1 -- 172.21.15.50:0/2179229249 shutdown_connections 2024-08-31T04:39:06.769 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:06.767+0000 7f815f400640 1 --2- 172.21.15.50:0/2179229249 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8158109bb0 0x7f81581103e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:39:06.769 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:06.767+0000 7f815f400640 1 --2- 172.21.15.50:0/2179229249 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8158109260 0x7f8158109670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:39:06.769 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:06.767+0000 7f815f400640 1 --2- 172.21.15.50:0/2179229249 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8158103920 0x7f8158103d30 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:39:06.769 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:06.767+0000 7f815f400640 1 -- 172.21.15.50:0/2179229249 >> 172.21.15.50:0/2179229249 conn(0x7f81580ff370 msgr2=0x7f81581017c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:39:06.769 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:06.767+0000 7f815f400640 1 -- 172.21.15.50:0/2179229249 shutdown_connections 2024-08-31T04:39:06.770 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:06.767+0000 7f815f400640 1 -- 172.21.15.50:0/2179229249 wait complete. 2024-08-31T04:39:06.772 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:06.768+0000 7f815f400640 1 Processor -- start 2024-08-31T04:39:06.772 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:06.768+0000 7f815f400640 1 -- start start 2024-08-31T04:39:06.772 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:06.768+0000 7f815f400640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8158103920 0x7f81580754b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:39:06.772 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:06.768+0000 7f815f400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8158109260 0x7f81580759f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:39:06.772 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:06.768+0000 7f815f400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8158109bb0 0x7f8158075f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:39:06.773 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:06.768+0000 7f815f400640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f8158113870 con 0x7f8158109260 2024-08-31T04:39:06.773 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:06.768+0000 7f815f400640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f81581136f0 con 0x7f8158109bb0 2024-08-31T04:39:06.773 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:06.768+0000 7f815f400640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f81581139f0 con 0x7f8158103920 2024-08-31T04:39:06.773 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:06.769+0000 7f8157e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8158109260 0x7f81580759f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:39:06.773 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:06.769+0000 7f8157e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8158109260 0x7f81580759f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:38982/0 (socket says 172.21.15.50:38982) 2024-08-31T04:39:06.773 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:06.769+0000 7f8157e00640 1 -- 172.21.15.50:0/3255213153 learned_addr learned my addr 172.21.15.50:0/3255213153 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:39:06.773 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:06.769+0000 7f815ca00640 1 --2- 172.21.15.50:0/3255213153 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8158103920 0x7f81580754b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:39:06.773 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:06.769+0000 7f815d400640 1 --2- 172.21.15.50:0/3255213153 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8158109bb0 0x7f8158075f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:39:06.773 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:06.769+0000 7f8157e00640 1 -- 172.21.15.50:0/3255213153 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8158103920 msgr2=0x7f81580754b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:39:06.774 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:06.769+0000 7f8157e00640 1 --2- 172.21.15.50:0/3255213153 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8158103920 0x7f81580754b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:39:06.774 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:06.769+0000 7f8157e00640 1 -- 172.21.15.50:0/3255213153 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8158109bb0 msgr2=0x7f8158075f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:39:06.774 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:06.769+0000 7f8157e00640 1 --2- 172.21.15.50:0/3255213153 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8158109bb0 0x7f8158075f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:39:06.774 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:06.769+0000 7f8157e00640 1 -- 172.21.15.50:0/3255213153 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81581a8540 con 0x7f8158109260 2024-08-31T04:39:06.774 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:06.770+0000 7f8157e00640 1 --2- 172.21.15.50:0/3255213153 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8158109260 0x7f81580759f0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f814400e970 tx=0x7f814400ee30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:39:06.774 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:06.770+0000 7f8155600640 1 -- 172.21.15.50:0/3255213153 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f814400cd80 con 0x7f8158109260 2024-08-31T04:39:06.774 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:06.770+0000 7f8155600640 1 -- 172.21.15.50:0/3255213153 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f81440035f0 con 0x7f8158109260 2024-08-31T04:39:06.774 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:06.770+0000 7f815f400640 1 -- 172.21.15.50:0/3255213153 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f81581a8830 con 0x7f8158109260 2024-08-31T04:39:06.774 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:06.770+0000 7f8155600640 1 -- 172.21.15.50:0/3255213153 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8144010690 con 0x7f8158109260 2024-08-31T04:39:06.774 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:06.770+0000 7f815f400640 1 -- 172.21.15.50:0/3255213153 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f81581a8d70 con 0x7f8158109260 2024-08-31T04:39:06.775 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:06.771+0000 7f815f400640 1 -- 172.21.15.50:0/3255213153 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8158103d30 con 0x7f8158109260 2024-08-31T04:39:06.775 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:06.774+0000 7f8155600640 1 -- 172.21.15.50:0/3255213153 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 18) ==== 152577+0+0 (secure 0 0 0) 0x7f8144003aa0 con 0x7f8158109260 2024-08-31T04:39:06.777 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:06.775+0000 7f8155600640 1 --2- 172.21.15.50:0/3255213153 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f81400b4b30 0x7f81400b7040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:39:06.777 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:06.775+0000 7f8155600640 1 -- 172.21.15.50:0/3255213153 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8219+0+0 (secure 0 0 0) 0x7f81440e5440 con 0x7f8158109260 2024-08-31T04:39:06.777 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:06.776+0000 7f815ca00640 1 --2- 172.21.15.50:0/3255213153 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f81400b4b30 0x7f81400b7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:39:06.777 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:06.776+0000 7f815ca00640 1 --2- 172.21.15.50:0/3255213153 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f81400b4b30 0x7f81400b7040 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f814c000c00 tx=0x7f814c031400 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:39:06.780 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:06.779+0000 7f8155600640 1 -- 172.21.15.50:0/3255213153 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f81440ac520 con 0x7f8158109260 2024-08-31T04:39:07.015 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:07.014+0000 7f815f400640 1 -- 172.21.15.50:0/3255213153 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f815802e430 con 0x7f8158109260 2024-08-31T04:39:07.016 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:07.015+0000 7f8155600640 1 -- 172.21.15.50:0/3255213153 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 71 v71) ==== 94+0+12028 (secure 0 0 0) 0x7f81440abe20 con 0x7f8158109260 2024-08-31T04:39:07.016 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-08-31T04:39:07.017 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":71,"btime":"2024-08-31T04:35:08:748083+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14622,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/1565557530","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":1565557530},{"type":"v1","addr":"172.21.15.50:6835","nonce":1565557530}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":25924,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6835/4060379633","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6834","nonce":4060379633},{"type":"v1","addr":"172.21.15.177:6835","nonce":4060379633}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":39}],"filesystems":[{"mdsmap":{"epoch":71,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-31T04:20:44.140709+0000","modified":"2024-08-31T04:35:08.648800+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24695,"mds_1":24691,"mds_2":24667,"mds_3":24656,"mds_4":24652},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14676":{"gid":14676,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.50:6839/2105228685","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6838","nonce":2105228685},{"type":"v1","addr":"172.21.15.50:6839","nonce":2105228685}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24590":{"gid":24590,"name":"k","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.133:6833/4283603962","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6832","nonce":4283603962},{"type":"v1","addr":"172.21.15.133:6833","nonce":4283603962}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24601":{"gid":24601,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.177:6833/1237129793","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":1237129793},{"type":"v1","addr":"172.21.15.177:6833","nonce":1237129793}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24626":{"gid":24626,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.133:6835/3637799701","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":3637799701},{"type":"v1","addr":"172.21.15.133:6835","nonce":3637799701}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24652":{"gid":24652,"name":"c","rank":4,"incarnation":26,"state":"up:active","state_seq":215,"addr":"172.21.15.177:6837/2159859285","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6836","nonce":2159859285},{"type":"v1","addr":"172.21.15.177:6837","nonce":2159859285}]},"join_fscid":-1,"export_targets":[0,1,2,3],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24656":{"gid":24656,"name":"h","rank":3,"incarnation":22,"state":"up:active","state_seq":213,"addr":"172.21.15.133:6837/4014853202","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6836","nonce":4014853202},{"type":"v1","addr":"172.21.15.133:6837","nonce":4014853202}]},"join_fscid":-1,"export_targets":[0,1,2,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24667":{"gid":24667,"name":"i","rank":2,"incarnation":20,"state":"up:active","state_seq":10,"addr":"172.21.15.177:6839/3600081752","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6838","nonce":3600081752},{"type":"v1","addr":"172.21.15.177:6839","nonce":3600081752}]},"join_fscid":-1,"export_targets":[0,1,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24691":{"gid":24691,"name":"a","rank":1,"incarnation":18,"state":"up:active","state_seq":210,"addr":"172.21.15.50:6841/575209862","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6840","nonce":575209862},{"type":"v1","addr":"172.21.15.50:6841","nonce":575209862}]},"join_fscid":-1,"export_targets":[0,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24695":{"gid":24695,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":208,"addr":"172.21.15.133:6839/2526402262","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6838","nonce":2526402262},{"type":"v1","addr":"172.21.15.133:6839","nonce":2526402262}]},"join_fscid":-1,"export_targets":[1,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_26036":{"gid":26036,"name":"d","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.50:6837/2788697263","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6836","nonce":2788697263},{"type":"v1","addr":"172.21.15.50:6837","nonce":2788697263}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24695,"qdb_cluster":[24652,24691,24656,24695,24667]},"id":1}]} 2024-08-31T04:39:07.017 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 71 2024-08-31T04:39:07.019 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:07.017+0000 7f815f400640 1 -- 172.21.15.50:0/3255213153 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f81400b4b30 msgr2=0x7f81400b7040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:39:07.019 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:07.017+0000 7f815f400640 1 --2- 172.21.15.50:0/3255213153 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f81400b4b30 0x7f81400b7040 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f814c000c00 tx=0x7f814c031400 comp rx=0 tx=0).stop 2024-08-31T04:39:07.019 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:07.017+0000 7f815f400640 1 -- 172.21.15.50:0/3255213153 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8158109260 msgr2=0x7f81580759f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:39:07.019 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:07.017+0000 7f815f400640 1 --2- 172.21.15.50:0/3255213153 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8158109260 0x7f81580759f0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f814400e970 tx=0x7f814400ee30 comp rx=0 tx=0).stop 2024-08-31T04:39:07.019 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:07.017+0000 7f815f400640 1 -- 172.21.15.50:0/3255213153 shutdown_connections 2024-08-31T04:39:07.019 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:07.017+0000 7f815f400640 1 --2- 172.21.15.50:0/3255213153 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f81400b4b30 0x7f81400b7040 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:39:07.019 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:07.017+0000 7f815f400640 1 --2- 172.21.15.50:0/3255213153 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8158109bb0 0x7f8158075f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:39:07.019 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:07.017+0000 7f815f400640 1 --2- 172.21.15.50:0/3255213153 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8158109260 0x7f81580759f0 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:39:07.020 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:07.017+0000 7f815f400640 1 --2- 172.21.15.50:0/3255213153 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8158103920 0x7f81580754b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:39:07.020 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:07.017+0000 7f815f400640 1 -- 172.21.15.50:0/3255213153 >> 172.21.15.50:0/3255213153 conn(0x7f81580ff370 msgr2=0x7f8158101790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:39:07.020 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:07.017+0000 7f815f400640 1 -- 172.21.15.50:0/3255213153 shutdown_connections 2024-08-31T04:39:07.020 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:07.017+0000 7f815f400640 1 -- 172.21.15.50:0/3255213153 wait complete. 2024-08-31T04:39:07.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:39:07 smithi050 ceph-mon[17259]: pgmap v855: 97 pgs: 97 active+clean; 592 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 682 B/s wr, 11 op/s 2024-08-31T04:39:07.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:39:07 smithi050 ceph-mon[17259]: from='client.? 172.21.15.50:0/3255213153' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T04:39:07.830 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 058d9fc6-674f-11ef-bcd4-c7b262605968 -- ceph osd dump --format=json 2024-08-31T04:39:07.996 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:39:07 smithi177 ceph-mon[22025]: pgmap v855: 97 pgs: 97 active+clean; 592 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 682 B/s wr, 11 op/s 2024-08-31T04:39:07.996 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:39:07 smithi177 ceph-mon[22025]: from='client.? 172.21.15.50:0/3255213153' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T04:39:08.043 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:39:07 smithi133 ceph-mon[22177]: pgmap v855: 97 pgs: 97 active+clean; 592 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 682 B/s wr, 11 op/s 2024-08-31T04:39:08.043 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:39:07 smithi133 ceph-mon[22177]: from='client.? 172.21.15.50:0/3255213153' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T04:39:08.208 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:39:08.792 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:08.790+0000 7f5556e00640 1 -- 172.21.15.50:0/394109206 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5550103730 msgr2=0x7f5550103b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:39:08.792 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:08.790+0000 7f5556e00640 1 --2- 172.21.15.50:0/394109206 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5550103730 0x7f5550103b40 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f5544009900 tx=0x7f554402a3f0 comp rx=0 tx=0).stop 2024-08-31T04:39:08.792 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:08.790+0000 7f5556e00640 1 -- 172.21.15.50:0/394109206 shutdown_connections 2024-08-31T04:39:08.792 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:08.790+0000 7f5556e00640 1 --2- 172.21.15.50:0/394109206 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5550109070 0x7f5550109480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:39:08.792 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:08.790+0000 7f5556e00640 1 --2- 172.21.15.50:0/394109206 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f55501099c0 0x7f55501101f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:39:08.793 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:08.790+0000 7f5556e00640 1 --2- 172.21.15.50:0/394109206 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5550103730 0x7f5550103b40 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:39:08.793 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:08.790+0000 7f5556e00640 1 -- 172.21.15.50:0/394109206 >> 172.21.15.50:0/394109206 conn(0x7f55500ff180 msgr2=0x7f55501015d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:39:08.793 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:08.790+0000 7f5556e00640 1 -- 172.21.15.50:0/394109206 shutdown_connections 2024-08-31T04:39:08.793 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:08.791+0000 7f5556e00640 1 -- 172.21.15.50:0/394109206 wait complete. 2024-08-31T04:39:08.794 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:08.792+0000 7f5556e00640 1 Processor -- start 2024-08-31T04:39:08.794 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:08.792+0000 7f5556e00640 1 -- start start 2024-08-31T04:39:08.794 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:08.792+0000 7f5556e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5550103730 0x7f555019c2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:39:08.794 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:08.792+0000 7f5556e00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5550109070 0x7f555019c850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:39:08.794 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:08.792+0000 7f5556e00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f55501099c0 0x7f55501a1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:39:08.795 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:08.792+0000 7f5556e00640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f55501136e0 con 0x7f5550103730 2024-08-31T04:39:08.795 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:08.792+0000 7f5556e00640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f5550113560 con 0x7f5550109070 2024-08-31T04:39:08.795 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:08.792+0000 7f5556e00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f5550113860 con 0x7f55501099c0 2024-08-31T04:39:08.795 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:08.792+0000 7f5555a00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5550103730 0x7f555019c2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:39:08.795 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:08.793+0000 7f5555a00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5550103730 0x7f555019c2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:39004/0 (socket says 172.21.15.50:39004) 2024-08-31T04:39:08.795 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:08.793+0000 7f5555a00640 1 -- 172.21.15.50:0/575526014 learned_addr learned my addr 172.21.15.50:0/575526014 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:39:08.795 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:08.793+0000 7f5556400640 1 --2- 172.21.15.50:0/575526014 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f55501099c0 0x7f55501a1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:39:08.795 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:08.793+0000 7f5555000640 1 --2- 172.21.15.50:0/575526014 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5550109070 0x7f555019c850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:39:08.795 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:08.793+0000 7f5555a00640 1 -- 172.21.15.50:0/575526014 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f55501099c0 msgr2=0x7f55501a1af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:39:08.795 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:08.793+0000 7f5555a00640 1 --2- 172.21.15.50:0/575526014 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f55501099c0 0x7f55501a1af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:39:08.795 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:08.793+0000 7f5555a00640 1 -- 172.21.15.50:0/575526014 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5550109070 msgr2=0x7f555019c850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:39:08.795 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:08.793+0000 7f5555a00640 1 --2- 172.21.15.50:0/575526014 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5550109070 0x7f555019c850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:39:08.795 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:08.793+0000 7f5555a00640 1 -- 172.21.15.50:0/575526014 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55501a2220 con 0x7f5550103730 2024-08-31T04:39:08.796 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:08.793+0000 7f5555a00640 1 --2- 172.21.15.50:0/575526014 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5550103730 0x7f555019c2b0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f5544005ab0 tx=0x7f5544003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:39:08.797 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:08.794+0000 7f554e000640 1 -- 172.21.15.50:0/575526014 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f554403f070 con 0x7f5550103730 2024-08-31T04:39:08.797 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:08.794+0000 7f554e000640 1 -- 172.21.15.50:0/575526014 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5544031b60 con 0x7f5550103730 2024-08-31T04:39:08.797 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:08.794+0000 7f5556e00640 1 -- 172.21.15.50:0/575526014 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f55501a24b0 con 0x7f5550103730 2024-08-31T04:39:08.797 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:08.794+0000 7f554e000640 1 -- 172.21.15.50:0/575526014 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5544035030 con 0x7f5550103730 2024-08-31T04:39:08.797 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:08.794+0000 7f5556e00640 1 -- 172.21.15.50:0/575526014 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f55501a8c70 con 0x7f5550103730 2024-08-31T04:39:08.797 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:08.795+0000 7f5556e00640 1 -- 172.21.15.50:0/575526014 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5550103b40 con 0x7f5550103730 2024-08-31T04:39:08.799 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:08.797+0000 7f554e000640 1 -- 172.21.15.50:0/575526014 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 18) ==== 152577+0+0 (secure 0 0 0) 0x7f5544042070 con 0x7f5550103730 2024-08-31T04:39:08.800 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:08.799+0000 7f554e000640 1 --2- 172.21.15.50:0/575526014 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f55380b4b30 0x7f55380b7040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:39:08.800 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:08.799+0000 7f554e000640 1 -- 172.21.15.50:0/575526014 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8219+0+0 (secure 0 0 0) 0x7f5544105ac0 con 0x7f5550103730 2024-08-31T04:39:08.801 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:08.799+0000 7f5555000640 1 --2- 172.21.15.50:0/575526014 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f55380b4b30 0x7f55380b7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:39:08.801 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:08.800+0000 7f5555000640 1 --2- 172.21.15.50:0/575526014 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f55380b4b30 0x7f55380b7040 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f5550109910 tx=0x7f553c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:39:08.802 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:08.801+0000 7f554e000640 1 -- 172.21.15.50:0/575526014 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f55440cc550 con 0x7f5550103730 2024-08-31T04:39:09.002 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:09.000+0000 7f5556e00640 1 -- 172.21.15.50:0/575526014 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f55501a8ed0 con 0x7f5550103730 2024-08-31T04:39:09.003 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:09.002+0000 7f554e000640 1 -- 172.21.15.50:0/575526014 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v80) ==== 74+0+22733 (secure 0 0 0) 0x7f55440d0d10 con 0x7f5550103730 2024-08-31T04:39:09.004 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-08-31T04:39:09.004 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":80,"fsid":"058d9fc6-674f-11ef-bcd4-c7b262605968","created":"2024-08-31T04:11:59.576131+0000","modified":"2024-08-31T04:30:03.186525+0000","last_up_change":"2024-08-31T04:19:44.619590+0000","last_in_change":"2024-08-31T04:19:21.022096+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-31T04:15:46.229142+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-31T04:20:38.249458+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"76","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-31T04:20:40.929092+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"76","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"416ecbde-4a7b-4bd1-b377-490925a33ce1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":3831273843},{"type":"v1","addr":"172.21.15.50:6803","nonce":3831273843}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":3831273843},{"type":"v1","addr":"172.21.15.50:6805","nonce":3831273843}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":3831273843},{"type":"v1","addr":"172.21.15.50:6809","nonce":3831273843}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":3831273843},{"type":"v1","addr":"172.21.15.50:6807","nonce":3831273843}]},"public_addr":"172.21.15.50:6803/3831273843","cluster_addr":"172.21.15.50:6805/3831273843","heartbeat_back_addr":"172.21.15.50:6809/3831273843","heartbeat_front_addr":"172.21.15.50:6807/3831273843","state":["exists","up"]},{"osd":1,"uuid":"5e008006-004d-4842-9885-93a2d27be1cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":475308203},{"type":"v1","addr":"172.21.15.133:6801","nonce":475308203}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":475308203},{"type":"v1","addr":"172.21.15.133:6803","nonce":475308203}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":475308203},{"type":"v1","addr":"172.21.15.133:6807","nonce":475308203}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":475308203},{"type":"v1","addr":"172.21.15.133:6805","nonce":475308203}]},"public_addr":"172.21.15.133:6801/475308203","cluster_addr":"172.21.15.133:6803/475308203","heartbeat_back_addr":"172.21.15.133:6807/475308203","heartbeat_front_addr":"172.21.15.133:6805/475308203","state":["exists","up"]},{"osd":2,"uuid":"7e6f1a26-f30d-4822-af69-8a08cb89fbce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":3091173426},{"type":"v1","addr":"172.21.15.177:6801","nonce":3091173426}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":3091173426},{"type":"v1","addr":"172.21.15.177:6803","nonce":3091173426}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":3091173426},{"type":"v1","addr":"172.21.15.177:6807","nonce":3091173426}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":3091173426},{"type":"v1","addr":"172.21.15.177:6805","nonce":3091173426}]},"public_addr":"172.21.15.177:6801/3091173426","cluster_addr":"172.21.15.177:6803/3091173426","heartbeat_back_addr":"172.21.15.177:6807/3091173426","heartbeat_front_addr":"172.21.15.177:6805/3091173426","state":["exists","up"]},{"osd":3,"uuid":"8193c2a2-18a1-4684-9a16-cbeae25530ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":3792992620},{"type":"v1","addr":"172.21.15.50:6811","nonce":3792992620}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":3792992620},{"type":"v1","addr":"172.21.15.50:6813","nonce":3792992620}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":3792992620},{"type":"v1","addr":"172.21.15.50:6817","nonce":3792992620}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":3792992620},{"type":"v1","addr":"172.21.15.50:6815","nonce":3792992620}]},"public_addr":"172.21.15.50:6811/3792992620","cluster_addr":"172.21.15.50:6813/3792992620","heartbeat_back_addr":"172.21.15.50:6817/3792992620","heartbeat_front_addr":"172.21.15.50:6815/3792992620","state":["exists","up"]},{"osd":4,"uuid":"2a2b4e64-0f8e-40ec-926c-84dbf691aefe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":2855333596},{"type":"v1","addr":"172.21.15.133:6809","nonce":2855333596}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":2855333596},{"type":"v1","addr":"172.21.15.133:6811","nonce":2855333596}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":2855333596},{"type":"v1","addr":"172.21.15.133:6815","nonce":2855333596}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":2855333596},{"type":"v1","addr":"172.21.15.133:6813","nonce":2855333596}]},"public_addr":"172.21.15.133:6809/2855333596","cluster_addr":"172.21.15.133:6811/2855333596","heartbeat_back_addr":"172.21.15.133:6815/2855333596","heartbeat_front_addr":"172.21.15.133:6813/2855333596","state":["exists","up"]},{"osd":5,"uuid":"83429ff0-ea7d-4fcc-9611-39d9001aa216","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":1166415084},{"type":"v1","addr":"172.21.15.177:6809","nonce":1166415084}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":1166415084},{"type":"v1","addr":"172.21.15.177:6811","nonce":1166415084}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":1166415084},{"type":"v1","addr":"172.21.15.177:6815","nonce":1166415084}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":1166415084},{"type":"v1","addr":"172.21.15.177:6813","nonce":1166415084}]},"public_addr":"172.21.15.177:6809/1166415084","cluster_addr":"172.21.15.177:6811/1166415084","heartbeat_back_addr":"172.21.15.177:6815/1166415084","heartbeat_front_addr":"172.21.15.177:6813/1166415084","state":["exists","up"]},{"osd":6,"uuid":"eeb571ef-5e43-4816-95dd-d01d83aeca83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":1429341184},{"type":"v1","addr":"172.21.15.50:6819","nonce":1429341184}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":1429341184},{"type":"v1","addr":"172.21.15.50:6821","nonce":1429341184}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":1429341184},{"type":"v1","addr":"172.21.15.50:6825","nonce":1429341184}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":1429341184},{"type":"v1","addr":"172.21.15.50:6823","nonce":1429341184}]},"public_addr":"172.21.15.50:6819/1429341184","cluster_addr":"172.21.15.50:6821/1429341184","heartbeat_back_addr":"172.21.15.50:6825/1429341184","heartbeat_front_addr":"172.21.15.50:6823/1429341184","state":["exists","up"]},{"osd":7,"uuid":"512ee507-0d50-4fed-b692-dbdf23a93e8e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":3643454923},{"type":"v1","addr":"172.21.15.133:6817","nonce":3643454923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":3643454923},{"type":"v1","addr":"172.21.15.133:6819","nonce":3643454923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":3643454923},{"type":"v1","addr":"172.21.15.133:6823","nonce":3643454923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":3643454923},{"type":"v1","addr":"172.21.15.133:6821","nonce":3643454923}]},"public_addr":"172.21.15.133:6817/3643454923","cluster_addr":"172.21.15.133:6819/3643454923","heartbeat_back_addr":"172.21.15.133:6823/3643454923","heartbeat_front_addr":"172.21.15.133:6821/3643454923","state":["exists","up"]},{"osd":8,"uuid":"ae99526e-41da-4cb5-857f-2e66f18f2d94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6816","nonce":101973300},{"type":"v1","addr":"172.21.15.177:6817","nonce":101973300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":101973300},{"type":"v1","addr":"172.21.15.177:6819","nonce":101973300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":101973300},{"type":"v1","addr":"172.21.15.177:6823","nonce":101973300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":101973300},{"type":"v1","addr":"172.21.15.177:6821","nonce":101973300}]},"public_addr":"172.21.15.177:6817/101973300","cluster_addr":"172.21.15.177:6819/101973300","heartbeat_back_addr":"172.21.15.177:6823/101973300","heartbeat_front_addr":"172.21.15.177:6821/101973300","state":["exists","up"]},{"osd":9,"uuid":"fcedbe16-b910-407f-b9d7-1dd03f3e62a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":53019860},{"type":"v1","addr":"172.21.15.50:6827","nonce":53019860}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":53019860},{"type":"v1","addr":"172.21.15.50:6829","nonce":53019860}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":53019860},{"type":"v1","addr":"172.21.15.50:6833","nonce":53019860}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":53019860},{"type":"v1","addr":"172.21.15.50:6831","nonce":53019860}]},"public_addr":"172.21.15.50:6827/53019860","cluster_addr":"172.21.15.50:6829/53019860","heartbeat_back_addr":"172.21.15.50:6833/53019860","heartbeat_front_addr":"172.21.15.50:6831/53019860","state":["exists","up"]},{"osd":10,"uuid":"3852756e-62f1-4e71-a070-8cff76df99b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":4175566493},{"type":"v1","addr":"172.21.15.133:6825","nonce":4175566493}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":4175566493},{"type":"v1","addr":"172.21.15.133:6827","nonce":4175566493}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":4175566493},{"type":"v1","addr":"172.21.15.133:6831","nonce":4175566493}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":4175566493},{"type":"v1","addr":"172.21.15.133:6829","nonce":4175566493}]},"public_addr":"172.21.15.133:6825/4175566493","cluster_addr":"172.21.15.133:6827/4175566493","heartbeat_back_addr":"172.21.15.133:6831/4175566493","heartbeat_front_addr":"172.21.15.133:6829/4175566493","state":["exists","up"]},{"osd":11,"uuid":"a154180a-5f2a-4b33-ad3d-fea7317597ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":2103454982},{"type":"v1","addr":"172.21.15.177:6825","nonce":2103454982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":2103454982},{"type":"v1","addr":"172.21.15.177:6827","nonce":2103454982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":2103454982},{"type":"v1","addr":"172.21.15.177:6831","nonce":2103454982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":2103454982},{"type":"v1","addr":"172.21.15.177:6829","nonce":2103454982}]},"public_addr":"172.21.15.177:6825/2103454982","cluster_addr":"172.21.15.177:6827/2103454982","heartbeat_back_addr":"172.21.15.177:6831/2103454982","heartbeat_front_addr":"172.21.15.177:6829/2103454982","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:14:54.683660+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:15:20.007319+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:15:43.613426+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:16:12.387010+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:16:38.079210+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:17:02.750375+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:17:31.735810+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:17:57.600985+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:18:22.503347+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:18:52.316657+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:19:18.444623+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T04:19:42.331006+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.b","mappings":[{"from":2,"to":4},{"from":8,"to":11}]},{"pgid":"2.1b","mappings":[{"from":2,"to":1}]},{"pgid":"2.1d","mappings":[{"from":8,"to":11}]},{"pgid":"3.e","mappings":[{"from":4,"to":6}]},{"pgid":"3.17","mappings":[{"from":4,"to":8}]},{"pgid":"3.25","mappings":[{"from":5,"to":9}]},{"pgid":"3.29","mappings":[{"from":3,"to":9}]},{"pgid":"3.36","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.50:6801/1319056820":"2024-09-01T04:12:55.742020+0000","172.21.15.50:0/1755103674":"2024-09-01T04:12:55.742020+0000","172.21.15.50:6800/1319056820":"2024-09-01T04:12:55.742020+0000","172.21.15.50:0/3701412233":"2024-09-01T04:12:55.742020+0000","172.21.15.50:0/1829556336":"2024-09-01T04:12:55.742020+0000","172.21.15.50:0/1698995126":"2024-09-01T04:12:25.753831+0000","172.21.15.50:0/1554317941":"2024-09-01T04:12:25.753831+0000","172.21.15.50:0/2998110380":"2024-09-01T04:12:25.753831+0000","172.21.15.50:6801/4197277793":"2024-09-01T04:12:25.753831+0000","172.21.15.50:6800/4197277793":"2024-09-01T04:12:25.753831+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-31T04:39:09.007 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:09.005+0000 7f5556e00640 1 -- 172.21.15.50:0/575526014 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f55380b4b30 msgr2=0x7f55380b7040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:39:09.007 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:09.005+0000 7f5556e00640 1 --2- 172.21.15.50:0/575526014 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f55380b4b30 0x7f55380b7040 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f5550109910 tx=0x7f553c005f90 comp rx=0 tx=0).stop 2024-08-31T04:39:09.007 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:09.005+0000 7f5556e00640 1 -- 172.21.15.50:0/575526014 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5550103730 msgr2=0x7f555019c2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:39:09.007 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:09.005+0000 7f5556e00640 1 --2- 172.21.15.50:0/575526014 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5550103730 0x7f555019c2b0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f5544005ab0 tx=0x7f5544003c10 comp rx=0 tx=0).stop 2024-08-31T04:39:09.007 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:09.005+0000 7f5556e00640 1 -- 172.21.15.50:0/575526014 shutdown_connections 2024-08-31T04:39:09.007 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:09.005+0000 7f5556e00640 1 --2- 172.21.15.50:0/575526014 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f55380b4b30 0x7f55380b7040 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:39:09.007 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:09.005+0000 7f5556e00640 1 --2- 172.21.15.50:0/575526014 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f55501099c0 0x7f55501a1af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:39:09.007 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:09.005+0000 7f5556e00640 1 --2- 172.21.15.50:0/575526014 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5550109070 0x7f555019c850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:39:09.007 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:09.005+0000 7f5556e00640 1 --2- 172.21.15.50:0/575526014 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5550103730 0x7f555019c2b0 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:39:09.007 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:09.005+0000 7f5556e00640 1 -- 172.21.15.50:0/575526014 >> 172.21.15.50:0/575526014 conn(0x7f55500ff180 msgr2=0x7f5550108760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:39:09.007 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:09.005+0000 7f5556e00640 1 -- 172.21.15.50:0/575526014 shutdown_connections 2024-08-31T04:39:09.007 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:09.005+0000 7f5556e00640 1 -- 172.21.15.50:0/575526014 wait complete. 2024-08-31T04:39:09.802 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:39:09 smithi050 ceph-mon[17259]: pgmap v856: 97 pgs: 97 active+clean; 592 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 1.2 KiB/s wr, 12 op/s 2024-08-31T04:39:09.803 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:39:09 smithi050 ceph-mon[17259]: from='client.? 172.21.15.50:0/575526014' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-31T04:39:09.845 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 058d9fc6-674f-11ef-bcd4-c7b262605968 -- ceph fs fail cephfs 2024-08-31T04:39:09.996 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:39:09 smithi177 ceph-mon[22025]: pgmap v856: 97 pgs: 97 active+clean; 592 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 1.2 KiB/s wr, 12 op/s 2024-08-31T04:39:09.996 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:39:09 smithi177 ceph-mon[22025]: from='client.? 172.21.15.50:0/575526014' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-31T04:39:10.043 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:39:09 smithi133 ceph-mon[22177]: pgmap v856: 97 pgs: 97 active+clean; 592 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 1.2 KiB/s wr, 12 op/s 2024-08-31T04:39:10.043 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:39:09 smithi133 ceph-mon[22177]: from='client.? 172.21.15.50:0/575526014' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-31T04:39:10.228 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:39:10.869 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:10.868+0000 7f41fc800640 1 -- 172.21.15.50:0/25212731 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f41f40776e0 msgr2=0x7f41f4077af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:39:10.870 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:10.868+0000 7f41fc800640 1 --2- 172.21.15.50:0/25212731 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f41f40776e0 0x7f41f4077af0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f41e8009900 tx=0x7f41e802a410 comp rx=0 tx=0).stop 2024-08-31T04:39:10.870 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:10.868+0000 7f41fc800640 1 -- 172.21.15.50:0/25212731 shutdown_connections 2024-08-31T04:39:10.870 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:10.868+0000 7f41fc800640 1 --2- 172.21.15.50:0/25212731 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f41f41144e0 0x7f41f4116900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:39:10.870 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:10.868+0000 7f41fc800640 1 --2- 172.21.15.50:0/25212731 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f41f4078030 0x7f41f4113fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:39:10.870 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:10.868+0000 7f41fc800640 1 --2- 172.21.15.50:0/25212731 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f41f40776e0 0x7f41f4077af0 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:39:10.870 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:10.868+0000 7f41fc800640 1 -- 172.21.15.50:0/25212731 >> 172.21.15.50:0/25212731 conn(0x7f41f41015b0 msgr2=0x7f41f4103a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:39:10.870 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:10.868+0000 7f41fc800640 1 -- 172.21.15.50:0/25212731 shutdown_connections 2024-08-31T04:39:10.871 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:10.868+0000 7f41fc800640 1 -- 172.21.15.50:0/25212731 wait complete. 2024-08-31T04:39:10.873 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:10.869+0000 7f41fc800640 1 Processor -- start 2024-08-31T04:39:10.873 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:10.869+0000 7f41fc800640 1 -- start start 2024-08-31T04:39:10.873 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:10.869+0000 7f41fc800640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f41f40776e0 0x7f41f41a0860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:39:10.873 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:10.869+0000 7f41fc800640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f41f4078030 0x7f41f41a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:39:10.873 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:10.870+0000 7f41fc800640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f41f41144e0 0x7f41f41a60a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:39:10.873 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:10.870+0000 7f41fc800640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f41f4119eb0 con 0x7f41f4078030 2024-08-31T04:39:10.873 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:10.870+0000 7f41fc800640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f41f4119d30 con 0x7f41f40776e0 2024-08-31T04:39:10.873 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:10.870+0000 7f41fc800640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f41f411a030 con 0x7f41f41144e0 2024-08-31T04:39:10.873 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:10.870+0000 7f41f9400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f41f4078030 0x7f41f41a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:39:10.873 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:10.870+0000 7f41f9e00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f41f40776e0 0x7f41f41a0860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:39:10.873 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:10.870+0000 7f41f9400640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f41f4078030 0x7f41f41a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:39022/0 (socket says 172.21.15.50:39022) 2024-08-31T04:39:10.874 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:10.870+0000 7f41f9400640 1 -- 172.21.15.50:0/326840989 learned_addr learned my addr 172.21.15.50:0/326840989 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:39:10.874 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:10.870+0000 7f41fa800640 1 --2- 172.21.15.50:0/326840989 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f41f41144e0 0x7f41f41a60a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:39:10.874 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:10.870+0000 7f41f9400640 1 -- 172.21.15.50:0/326840989 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f41f41144e0 msgr2=0x7f41f41a60a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:39:10.874 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:10.870+0000 7f41f9400640 1 --2- 172.21.15.50:0/326840989 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f41f41144e0 0x7f41f41a60a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:39:10.874 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:10.870+0000 7f41f9400640 1 -- 172.21.15.50:0/326840989 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f41f40776e0 msgr2=0x7f41f41a0860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:39:10.874 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:10.870+0000 7f41f9400640 1 --2- 172.21.15.50:0/326840989 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f41f40776e0 0x7f41f41a0860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:39:10.874 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:10.870+0000 7f41f9400640 1 -- 172.21.15.50:0/326840989 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41f41a67d0 con 0x7f41f4078030 2024-08-31T04:39:10.874 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:10.871+0000 7f41f9400640 1 --2- 172.21.15.50:0/326840989 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f41f4078030 0x7f41f41a0e00 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f41e400e9f0 tx=0x7f41e400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:39:10.874 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:10.871+0000 7f41eea00640 1 -- 172.21.15.50:0/326840989 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41e400ccc0 con 0x7f41f4078030 2024-08-31T04:39:10.874 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:10.871+0000 7f41fc800640 1 -- 172.21.15.50:0/326840989 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f41f41a6ac0 con 0x7f41f4078030 2024-08-31T04:39:10.874 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:10.871+0000 7f41eea00640 1 -- 172.21.15.50:0/326840989 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f41e40108e0 con 0x7f41f4078030 2024-08-31T04:39:10.874 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:10.871+0000 7f41eea00640 1 -- 172.21.15.50:0/326840989 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41e4018860 con 0x7f41f4078030 2024-08-31T04:39:10.875 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:10.871+0000 7f41fc800640 1 -- 172.21.15.50:0/326840989 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f41f41ad220 con 0x7f41f4078030 2024-08-31T04:39:10.875 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:10.872+0000 7f41fc800640 1 -- 172.21.15.50:0/326840989 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f41f4077af0 con 0x7f41f4078030 2024-08-31T04:39:10.876 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:10.875+0000 7f41eea00640 1 -- 172.21.15.50:0/326840989 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 18) ==== 152577+0+0 (secure 0 0 0) 0x7f41e4010430 con 0x7f41f4078030 2024-08-31T04:39:10.880 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:10.879+0000 7f41eea00640 1 --2- 172.21.15.50:0/326840989 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f41dc0b4b30 0x7f41dc0b7040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:39:10.880 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:10.879+0000 7f41eea00640 1 -- 172.21.15.50:0/326840989 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8219+0+0 (secure 0 0 0) 0x7f41e40e5ab0 con 0x7f41f4078030 2024-08-31T04:39:10.880 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:10.879+0000 7f41f9e00640 1 --2- 172.21.15.50:0/326840989 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f41dc0b4b30 0x7f41dc0b7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:39:10.881 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:10.880+0000 7f41f9e00640 1 --2- 172.21.15.50:0/326840989 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f41dc0b4b30 0x7f41dc0b7040 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f41e8005ab0 tx=0x7f41e8005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:39:10.881 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:10.880+0000 7f41eea00640 1 -- 172.21.15.50:0/326840989 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f41e40ac540 con 0x7f41f4078030 2024-08-31T04:39:11.115 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:11.114+0000 7f41fc800640 1 -- 172.21.15.50:0/326840989 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f41f41a1990 con 0x7f41f4078030 2024-08-31T04:39:11.118 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:11.117+0000 7f41eea00640 1 -- 172.21.15.50:0/326840989 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v72) ==== 161+0+0 (secure 0 0 0) 0x7f41e40b0d00 con 0x7f41f4078030 2024-08-31T04:39:11.118 INFO:teuthology.orchestra.run.smithi050.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-08-31T04:39:11.124 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:11.122+0000 7f41fc800640 1 -- 172.21.15.50:0/326840989 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f41dc0b4b30 msgr2=0x7f41dc0b7040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:39:11.124 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:11.122+0000 7f41fc800640 1 --2- 172.21.15.50:0/326840989 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f41dc0b4b30 0x7f41dc0b7040 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f41e8005ab0 tx=0x7f41e8005a20 comp rx=0 tx=0).stop 2024-08-31T04:39:11.124 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:11.123+0000 7f41fc800640 1 -- 172.21.15.50:0/326840989 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f41f4078030 msgr2=0x7f41f41a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:39:11.124 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:11.123+0000 7f41fc800640 1 --2- 172.21.15.50:0/326840989 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f41f4078030 0x7f41f41a0e00 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f41e400e9f0 tx=0x7f41e400eeb0 comp rx=0 tx=0).stop 2024-08-31T04:39:11.125 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:11.123+0000 7f41fc800640 1 -- 172.21.15.50:0/326840989 shutdown_connections 2024-08-31T04:39:11.125 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:11.123+0000 7f41fc800640 1 --2- 172.21.15.50:0/326840989 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f41dc0b4b30 0x7f41dc0b7040 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:39:11.125 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:11.123+0000 7f41fc800640 1 --2- 172.21.15.50:0/326840989 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f41f41144e0 0x7f41f41a60a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:39:11.125 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:11.123+0000 7f41fc800640 1 --2- 172.21.15.50:0/326840989 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f41f4078030 0x7f41f41a0e00 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:39:11.125 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:11.123+0000 7f41fc800640 1 --2- 172.21.15.50:0/326840989 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f41f40776e0 0x7f41f41a0860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:39:11.125 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:11.123+0000 7f41fc800640 1 -- 172.21.15.50:0/326840989 >> 172.21.15.50:0/326840989 conn(0x7f41f41015b0 msgr2=0x7f41f41164f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:39:11.125 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:11.124+0000 7f41fc800640 1 -- 172.21.15.50:0/326840989 shutdown_connections 2024-08-31T04:39:11.125 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:11.124+0000 7f41fc800640 1 -- 172.21.15.50:0/326840989 wait complete. 2024-08-31T04:39:11.450 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:39:11 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-mon-a[17255]: 2024-08-31T04:39:11.115+0000 7faa82e00640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-08-31T04:39:11.450 INFO:journalctl@ceph.mds.g.smithi050.stdout:Aug 31 04:39:11 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-mds-g[59136]: ignoring --setuser ceph since I am not root 2024-08-31T04:39:11.450 INFO:journalctl@ceph.mds.g.smithi050.stdout:Aug 31 04:39:11 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-mds-g[59136]: ignoring --setgroup ceph since I am not root 2024-08-31T04:39:11.451 INFO:journalctl@ceph.mds.g.smithi050.stdout:Aug 31 04:39:11 smithi050 ceph-mds[59155]: -- 172.21.15.50:0/3168015957 <== mon.0 v2:172.21.15.50:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55c2db67fc20 con 0x55c2df825180 2024-08-31T04:39:11.451 INFO:journalctl@ceph.mds.g.smithi050.stdout:Aug 31 04:39:11 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-mds-g[59136]: starting mds.g at 2024-08-31T04:39:11.451 INFO:journalctl@ceph.mds.d.smithi050.stdout:Aug 31 04:39:11 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-mds-d[80219]: ignoring --setuser ceph since I am not root 2024-08-31T04:39:11.451 INFO:journalctl@ceph.mds.d.smithi050.stdout:Aug 31 04:39:11 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-mds-d[80219]: ignoring --setgroup ceph since I am not root 2024-08-31T04:39:11.451 INFO:journalctl@ceph.mds.d.smithi050.stdout:Aug 31 04:39:11 smithi050 ceph-mds[80223]: -- 172.21.15.50:0/2906675485 <== mon.1 v2:172.21.15.177:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55b2bbfbb860 con 0x55b2c0161180 2024-08-31T04:39:11.451 INFO:journalctl@ceph.mds.d.smithi050.stdout:Aug 31 04:39:11 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-mds-d[80219]: starting mds.d at 2024-08-31T04:39:11.451 INFO:journalctl@ceph.mds.a.smithi050.stdout:Aug 31 04:39:11 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-mds-a[59517]: ignoring --setuser ceph since I am not root 2024-08-31T04:39:11.451 INFO:journalctl@ceph.mds.a.smithi050.stdout:Aug 31 04:39:11 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-mds-a[59517]: ignoring --setgroup ceph since I am not root 2024-08-31T04:39:11.452 INFO:journalctl@ceph.mds.a.smithi050.stdout:Aug 31 04:39:11 smithi050 ceph-mds[59521]: -- 172.21.15.50:0/3130910596 <== mon.1 v2:172.21.15.177:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x56491eee5860 con 0x56492308ba80 2024-08-31T04:39:11.452 INFO:journalctl@ceph.mds.a.smithi050.stdout:Aug 31 04:39:11 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-mds-a[59517]: starting mds.a at 2024-08-31T04:39:11.496 INFO:journalctl@ceph.mds.i.smithi177.stdout:Aug 31 04:39:11 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-mds-i[52527]: ignoring --setuser ceph since I am not root 2024-08-31T04:39:11.496 INFO:journalctl@ceph.mds.i.smithi177.stdout:Aug 31 04:39:11 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-mds-i[52527]: ignoring --setgroup ceph since I am not root 2024-08-31T04:39:11.496 INFO:journalctl@ceph.mds.i.smithi177.stdout:Aug 31 04:39:11 smithi177 ceph-mds[52531]: -- 172.21.15.177:0/3307768181 <== mon.1 v2:172.21.15.177:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x556b06a9f860 con 0x556b0ac45a80 2024-08-31T04:39:11.496 INFO:journalctl@ceph.mds.i.smithi177.stdout:Aug 31 04:39:11 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-mds-i[52527]: starting mds.i at 2024-08-31T04:39:11.497 INFO:journalctl@ceph.mds.l.smithi177.stdout:Aug 31 04:39:11 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-mds-l[51608]: ignoring --setuser ceph since I am not root 2024-08-31T04:39:11.497 INFO:journalctl@ceph.mds.l.smithi177.stdout:Aug 31 04:39:11 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-mds-l[51608]: ignoring --setgroup ceph since I am not root 2024-08-31T04:39:11.497 INFO:journalctl@ceph.mds.l.smithi177.stdout:Aug 31 04:39:11 smithi177 ceph-mds[51612]: -- 172.21.15.177:0/3090860767 <== mon.1 v2:172.21.15.177:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55fc3704b860 con 0x55fc3b1f1a80 2024-08-31T04:39:11.497 INFO:journalctl@ceph.mds.l.smithi177.stdout:Aug 31 04:39:11 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-mds-l[51608]: starting mds.l at 2024-08-31T04:39:11.497 INFO:journalctl@ceph.mds.c.smithi177.stdout:Aug 31 04:39:11 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-mds-c[52224]: ignoring --setuser ceph since I am not root 2024-08-31T04:39:11.497 INFO:journalctl@ceph.mds.c.smithi177.stdout:Aug 31 04:39:11 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-mds-c[52224]: ignoring --setgroup ceph since I am not root 2024-08-31T04:39:11.497 INFO:journalctl@ceph.mds.c.smithi177.stdout:Aug 31 04:39:11 smithi177 ceph-mds[52230]: -- 172.21.15.177:0/1291453444 <== mon.1 v2:172.21.15.177:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55b78b967860 con 0x55b78fb0d180 2024-08-31T04:39:11.497 INFO:journalctl@ceph.mds.c.smithi177.stdout:Aug 31 04:39:11 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-mds-c[52224]: starting mds.c at 2024-08-31T04:39:11.543 INFO:journalctl@ceph.mds.k.smithi133.stdout:Aug 31 04:39:11 smithi133 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-mds-k[51181]: ignoring --setuser ceph since I am not root 2024-08-31T04:39:11.543 INFO:journalctl@ceph.mds.k.smithi133.stdout:Aug 31 04:39:11 smithi133 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-mds-k[51181]: ignoring --setgroup ceph since I am not root 2024-08-31T04:39:11.543 INFO:journalctl@ceph.mds.k.smithi133.stdout:Aug 31 04:39:11 smithi133 ceph-mds[51185]: -- 172.21.15.133:0/3913290340 <== mon.1 v2:172.21.15.177:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55e5ec895860 con 0x55e5f0a3b180 2024-08-31T04:39:11.543 INFO:journalctl@ceph.mds.k.smithi133.stdout:Aug 31 04:39:11 smithi133 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-mds-k[51181]: starting mds.k at 2024-08-31T04:39:11.544 INFO:journalctl@ceph.mds.e.smithi133.stdout:Aug 31 04:39:11 smithi133 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-mds-e[51497]: ignoring --setuser ceph since I am not root 2024-08-31T04:39:11.544 INFO:journalctl@ceph.mds.e.smithi133.stdout:Aug 31 04:39:11 smithi133 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-mds-e[51497]: ignoring --setgroup ceph since I am not root 2024-08-31T04:39:11.544 INFO:journalctl@ceph.mds.e.smithi133.stdout:Aug 31 04:39:11 smithi133 ceph-mds[51501]: -- 172.21.15.133:0/1748048149 <== mon.1 v2:172.21.15.177:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55742ba4b860 con 0x55742fbf1600 2024-08-31T04:39:11.544 INFO:journalctl@ceph.mds.e.smithi133.stdout:Aug 31 04:39:11 smithi133 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-mds-e[51497]: starting mds.e at 2024-08-31T04:39:11.544 INFO:journalctl@ceph.mds.b.smithi133.stdout:Aug 31 04:39:11 smithi133 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-mds-b[52113]: ignoring --setuser ceph since I am not root 2024-08-31T04:39:11.544 INFO:journalctl@ceph.mds.b.smithi133.stdout:Aug 31 04:39:11 smithi133 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-mds-b[52113]: ignoring --setgroup ceph since I am not root 2024-08-31T04:39:11.545 INFO:journalctl@ceph.mds.b.smithi133.stdout:Aug 31 04:39:11 smithi133 ceph-mds[52117]: -- 172.21.15.133:0/3720104641 <== mon.2 v2:172.21.15.133:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x555f82af3860 con 0x555f86c99a80 2024-08-31T04:39:11.545 INFO:journalctl@ceph.mds.b.smithi133.stdout:Aug 31 04:39:11 smithi133 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-mds-b[52113]: starting mds.b at 2024-08-31T04:39:11.545 INFO:journalctl@ceph.mds.h.smithi133.stdout:Aug 31 04:39:11 smithi133 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-mds-h[51811]: ignoring --setuser ceph since I am not root 2024-08-31T04:39:11.545 INFO:journalctl@ceph.mds.h.smithi133.stdout:Aug 31 04:39:11 smithi133 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-mds-h[51811]: ignoring --setgroup ceph since I am not root 2024-08-31T04:39:11.545 INFO:journalctl@ceph.mds.h.smithi133.stdout:Aug 31 04:39:11 smithi133 ceph-mds[51815]: -- 172.21.15.133:0/2663577646 <== mon.1 v2:172.21.15.177:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5649510b1c20 con 0x564955257180 2024-08-31T04:39:11.545 INFO:journalctl@ceph.mds.h.smithi133.stdout:Aug 31 04:39:11 smithi133 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-mds-h[51811]: starting mds.h at 2024-08-31T04:39:11.837 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:39:11 smithi050 ceph-mon[17259]: pgmap v857: 97 pgs: 97 active+clean; 592 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 1.2 KiB/s wr, 11 op/s 2024-08-31T04:39:11.837 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:39:11 smithi050 ceph-mon[17259]: from='client.? 172.21.15.50:0/326840989' entity='client.admin' cmd={"prefix": "fs fail", "fs_name": "cephfs"} : dispatch 2024-08-31T04:39:11.837 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:39:11 smithi050 ceph-mon[17259]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-08-31T04:39:11.837 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:39:11 smithi050 ceph-mon[17259]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-08-31T04:39:11.837 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:39:11 smithi050 ceph-mon[17259]: from='client.? 172.21.15.50:0/326840989' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-08-31T04:39:11.837 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:39:11 smithi050 ceph-mon[17259]: osdmap e81: 12 total, 12 up, 12 in 2024-08-31T04:39:11.837 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:39:11 smithi050 ceph-mon[17259]: fsmap cephfs:0/5 2 up:standby, 5 failed 2024-08-31T04:39:11.874 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 058d9fc6-674f-11ef-bcd4-c7b262605968 -- ceph fs rm cephfs --yes-i-really-mean-it 2024-08-31T04:39:11.996 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:39:11 smithi177 ceph-mon[22025]: pgmap v857: 97 pgs: 97 active+clean; 592 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 1.2 KiB/s wr, 11 op/s 2024-08-31T04:39:11.996 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:39:11 smithi177 ceph-mon[22025]: from='client.? 172.21.15.50:0/326840989' entity='client.admin' cmd={"prefix": "fs fail", "fs_name": "cephfs"} : dispatch 2024-08-31T04:39:11.996 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:39:11 smithi177 ceph-mon[22025]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-08-31T04:39:11.996 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:39:11 smithi177 ceph-mon[22025]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-08-31T04:39:11.996 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:39:11 smithi177 ceph-mon[22025]: from='client.? 172.21.15.50:0/326840989' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-08-31T04:39:11.996 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:39:11 smithi177 ceph-mon[22025]: osdmap e81: 12 total, 12 up, 12 in 2024-08-31T04:39:11.996 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:39:11 smithi177 ceph-mon[22025]: fsmap cephfs:0/5 2 up:standby, 5 failed 2024-08-31T04:39:12.043 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:39:11 smithi133 ceph-mon[22177]: pgmap v857: 97 pgs: 97 active+clean; 592 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 1.2 KiB/s wr, 11 op/s 2024-08-31T04:39:12.043 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:39:11 smithi133 ceph-mon[22177]: from='client.? 172.21.15.50:0/326840989' entity='client.admin' cmd={"prefix": "fs fail", "fs_name": "cephfs"} : dispatch 2024-08-31T04:39:12.043 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:39:11 smithi133 ceph-mon[22177]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-08-31T04:39:12.043 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:39:11 smithi133 ceph-mon[22177]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-08-31T04:39:12.043 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:39:11 smithi133 ceph-mon[22177]: from='client.? 172.21.15.50:0/326840989' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-08-31T04:39:12.043 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:39:11 smithi133 ceph-mon[22177]: osdmap e81: 12 total, 12 up, 12 in 2024-08-31T04:39:12.043 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:39:11 smithi133 ceph-mon[22177]: fsmap cephfs:0/5 2 up:standby, 5 failed 2024-08-31T04:39:12.263 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:39:12.915 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:12.913+0000 7f4e2f000640 1 -- 172.21.15.50:0/2120547055 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4e28105960 msgr2=0x7f4e28105d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:39:12.915 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:12.913+0000 7f4e2f000640 1 --2- 172.21.15.50:0/2120547055 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4e28105960 0x7f4e28105d70 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f4e1c009900 tx=0x7f4e1c02a3f0 comp rx=0 tx=0).stop 2024-08-31T04:39:12.915 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:12.913+0000 7f4e2f000640 1 -- 172.21.15.50:0/2120547055 shutdown_connections 2024-08-31T04:39:12.915 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:12.913+0000 7f4e2f000640 1 --2- 172.21.15.50:0/2120547055 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4e2810bbf0 0x7f4e28112420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:39:12.915 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:12.913+0000 7f4e2f000640 1 --2- 172.21.15.50:0/2120547055 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4e2810b2a0 0x7f4e2810b6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:39:12.915 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:12.913+0000 7f4e2f000640 1 --2- 172.21.15.50:0/2120547055 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4e28105960 0x7f4e28105d70 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:39:12.915 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:12.913+0000 7f4e2f000640 1 -- 172.21.15.50:0/2120547055 >> 172.21.15.50:0/2120547055 conn(0x7f4e28101410 msgr2=0x7f4e28103860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:39:12.915 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:12.913+0000 7f4e2f000640 1 -- 172.21.15.50:0/2120547055 shutdown_connections 2024-08-31T04:39:12.915 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:12.913+0000 7f4e2f000640 1 -- 172.21.15.50:0/2120547055 wait complete. 2024-08-31T04:39:12.916 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:12.914+0000 7f4e2f000640 1 Processor -- start 2024-08-31T04:39:12.917 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:12.914+0000 7f4e2f000640 1 -- start start 2024-08-31T04:39:12.917 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:12.915+0000 7f4e2f000640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4e28105960 0x7f4e2819c2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:39:12.917 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:12.915+0000 7f4e2f000640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4e2810b2a0 0x7f4e2819c840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:39:12.917 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:12.915+0000 7f4e2f000640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4e2810bbf0 0x7f4e281a1ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:39:12.917 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:12.915+0000 7f4e2f000640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f4e281158b0 con 0x7f4e28105960 2024-08-31T04:39:12.917 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:12.915+0000 7f4e2f000640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f4e28115730 con 0x7f4e2810b2a0 2024-08-31T04:39:12.917 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:12.915+0000 7f4e2f000640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f4e28115a30 con 0x7f4e2810bbf0 2024-08-31T04:39:12.917 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:12.915+0000 7f4e2dc00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4e28105960 0x7f4e2819c2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:39:12.917 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:12.915+0000 7f4e2d200640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4e2810b2a0 0x7f4e2819c840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:39:12.917 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:12.915+0000 7f4e2d200640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4e2810b2a0 0x7f4e2819c840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.50:33410/0 (socket says 172.21.15.50:33410) 2024-08-31T04:39:12.917 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:12.915+0000 7f4e2d200640 1 -- 172.21.15.50:0/406673092 learned_addr learned my addr 172.21.15.50:0/406673092 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:39:12.917 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:12.915+0000 7f4e2e600640 1 --2- 172.21.15.50:0/406673092 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4e2810bbf0 0x7f4e281a1ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:39:12.918 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:12.916+0000 7f4e2dc00640 1 -- 172.21.15.50:0/406673092 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4e2810bbf0 msgr2=0x7f4e281a1ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:39:12.918 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:12.916+0000 7f4e2dc00640 1 --2- 172.21.15.50:0/406673092 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4e2810bbf0 0x7f4e281a1ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:39:12.918 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:12.916+0000 7f4e2dc00640 1 -- 172.21.15.50:0/406673092 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4e2810b2a0 msgr2=0x7f4e2819c840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:39:12.918 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:12.916+0000 7f4e2dc00640 1 --2- 172.21.15.50:0/406673092 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4e2810b2a0 0x7f4e2819c840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:39:12.919 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:12.916+0000 7f4e2dc00640 1 -- 172.21.15.50:0/406673092 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e281a2210 con 0x7f4e28105960 2024-08-31T04:39:12.919 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:12.916+0000 7f4e2d200640 1 --2- 172.21.15.50:0/406673092 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4e2810b2a0 0x7f4e2819c840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T04:39:12.919 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:12.916+0000 7f4e2dc00640 1 --2- 172.21.15.50:0/406673092 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4e28105960 0x7f4e2819c2a0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f4e1c02a910 tx=0x7f4e1c031a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:39:12.919 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:12.916+0000 7f4e26000640 1 -- 172.21.15.50:0/406673092 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e1c03f030 con 0x7f4e28105960 2024-08-31T04:39:12.919 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:12.916+0000 7f4e2f000640 1 -- 172.21.15.50:0/406673092 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4e281a24a0 con 0x7f4e28105960 2024-08-31T04:39:12.919 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:12.916+0000 7f4e26000640 1 -- 172.21.15.50:0/406673092 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4e1c004490 con 0x7f4e28105960 2024-08-31T04:39:12.919 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:12.917+0000 7f4e26000640 1 -- 172.21.15.50:0/406673092 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e1c035070 con 0x7f4e28105960 2024-08-31T04:39:12.919 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:12.917+0000 7f4e2f000640 1 -- 172.21.15.50:0/406673092 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4e281a8c60 con 0x7f4e28105960 2024-08-31T04:39:12.919 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:12.918+0000 7f4e2f000640 1 -- 172.21.15.50:0/406673092 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4e28105d70 con 0x7f4e28105960 2024-08-31T04:39:12.921 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:12.920+0000 7f4e26000640 1 -- 172.21.15.50:0/406673092 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 18) ==== 152577+0+0 (secure 0 0 0) 0x7f4e1c042030 con 0x7f4e28105960 2024-08-31T04:39:12.922 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:12.921+0000 7f4e26000640 1 --2- 172.21.15.50:0/406673092 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f4e100b4b30 0x7f4e100b7040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:39:12.923 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:12.922+0000 7f4e26000640 1 -- 172.21.15.50:0/406673092 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8649+0+0 (secure 0 0 0) 0x7f4e1c1057c0 con 0x7f4e28105960 2024-08-31T04:39:12.923 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:12.922+0000 7f4e2d200640 1 --2- 172.21.15.50:0/406673092 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f4e100b4b30 0x7f4e100b7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:39:12.924 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:12.923+0000 7f4e2d200640 1 --2- 172.21.15.50:0/406673092 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f4e100b4b30 0x7f4e100b7040 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f4e28104c60 tx=0x7f4e14005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:39:12.925 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:12.924+0000 7f4e26000640 1 -- 172.21.15.50:0/406673092 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f4e1c0cc100 con 0x7f4e28105960 2024-08-31T04:39:13.161 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:13.160+0000 7f4e2f000640 1 -- 172.21.15.50:0/406673092 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f4e2802e430 con 0x7f4e28105960 2024-08-31T04:39:13.450 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:39:13 smithi050 ceph-mon[17259]: mds.? [v2:172.21.15.177:6832/710554654,v1:172.21.15.177:6833/710554654] up:boot 2024-08-31T04:39:13.450 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:39:13 smithi050 ceph-mon[17259]: mds.? [v2:172.21.15.177:6836/1229454741,v1:172.21.15.177:6838/1229454741] up:boot 2024-08-31T04:39:13.450 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:39:13 smithi050 ceph-mon[17259]: mds.? [v2:172.21.15.177:6837/2356760395,v1:172.21.15.177:6839/2356760395] up:boot 2024-08-31T04:39:13.450 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:39:13 smithi050 ceph-mon[17259]: mds.? [v2:172.21.15.133:6832/2204809328,v1:172.21.15.133:6833/2204809328] up:boot 2024-08-31T04:39:13.450 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:39:13 smithi050 ceph-mon[17259]: mds.? [v2:172.21.15.133:6834/3329426165,v1:172.21.15.133:6836/3329426165] up:boot 2024-08-31T04:39:13.451 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:39:13 smithi050 ceph-mon[17259]: mds.? [v2:172.21.15.133:6835/3526936748,v1:172.21.15.133:6837/3526936748] up:boot 2024-08-31T04:39:13.451 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:39:13 smithi050 ceph-mon[17259]: mds.? [v2:172.21.15.133:6838/2800199529,v1:172.21.15.133:6839/2800199529] up:boot 2024-08-31T04:39:13.451 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:39:13 smithi050 ceph-mon[17259]: mds.? [v2:172.21.15.50:6836/1805448916,v1:172.21.15.50:6837/1805448916] up:boot 2024-08-31T04:39:13.451 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:39:13 smithi050 ceph-mon[17259]: mds.? [v2:172.21.15.50:6838/1285967765,v1:172.21.15.50:6839/1285967765] up:boot 2024-08-31T04:39:13.451 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:39:13 smithi050 ceph-mon[17259]: mds.? [v2:172.21.15.50:6840/736082164,v1:172.21.15.50:6841/736082164] up:boot 2024-08-31T04:39:13.451 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:39:13 smithi050 ceph-mon[17259]: fsmap cephfs:0/5 12 up:standby, 5 failed 2024-08-31T04:39:13.451 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:39:13 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "a"} : dispatch 2024-08-31T04:39:13.451 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:39:13 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "l"} : dispatch 2024-08-31T04:39:13.451 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:39:13 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "i"} : dispatch 2024-08-31T04:39:13.451 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:39:13 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "c"} : dispatch 2024-08-31T04:39:13.451 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:39:13 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "h"} : dispatch 2024-08-31T04:39:13.451 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:39:13 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "k"} : dispatch 2024-08-31T04:39:13.451 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:39:13 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "b"} : dispatch 2024-08-31T04:39:13.451 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:39:13 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "e"} : dispatch 2024-08-31T04:39:13.452 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:39:13 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "g"} : dispatch 2024-08-31T04:39:13.452 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:39:13 smithi050 ceph-mon[17259]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "d"} : dispatch 2024-08-31T04:39:13.452 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:39:13 smithi050 ceph-mon[17259]: pgmap v859: 97 pgs: 97 active+clean; 592 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1.5 KiB/s wr, 12 op/s 2024-08-31T04:39:13.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:39:13 smithi177 ceph-mon[22025]: mds.? [v2:172.21.15.177:6832/710554654,v1:172.21.15.177:6833/710554654] up:boot 2024-08-31T04:39:13.497 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:39:13 smithi177 ceph-mon[22025]: mds.? [v2:172.21.15.177:6836/1229454741,v1:172.21.15.177:6838/1229454741] up:boot 2024-08-31T04:39:13.497 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:39:13 smithi177 ceph-mon[22025]: mds.? [v2:172.21.15.177:6837/2356760395,v1:172.21.15.177:6839/2356760395] up:boot 2024-08-31T04:39:13.497 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:39:13 smithi177 ceph-mon[22025]: mds.? [v2:172.21.15.133:6832/2204809328,v1:172.21.15.133:6833/2204809328] up:boot 2024-08-31T04:39:13.497 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:39:13 smithi177 ceph-mon[22025]: mds.? [v2:172.21.15.133:6834/3329426165,v1:172.21.15.133:6836/3329426165] up:boot 2024-08-31T04:39:13.497 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:39:13 smithi177 ceph-mon[22025]: mds.? [v2:172.21.15.133:6835/3526936748,v1:172.21.15.133:6837/3526936748] up:boot 2024-08-31T04:39:13.497 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:39:13 smithi177 ceph-mon[22025]: mds.? [v2:172.21.15.133:6838/2800199529,v1:172.21.15.133:6839/2800199529] up:boot 2024-08-31T04:39:13.497 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:39:13 smithi177 ceph-mon[22025]: mds.? [v2:172.21.15.50:6836/1805448916,v1:172.21.15.50:6837/1805448916] up:boot 2024-08-31T04:39:13.497 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:39:13 smithi177 ceph-mon[22025]: mds.? [v2:172.21.15.50:6838/1285967765,v1:172.21.15.50:6839/1285967765] up:boot 2024-08-31T04:39:13.497 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:39:13 smithi177 ceph-mon[22025]: mds.? [v2:172.21.15.50:6840/736082164,v1:172.21.15.50:6841/736082164] up:boot 2024-08-31T04:39:13.497 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:39:13 smithi177 ceph-mon[22025]: fsmap cephfs:0/5 12 up:standby, 5 failed 2024-08-31T04:39:13.497 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:39:13 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "a"} : dispatch 2024-08-31T04:39:13.497 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:39:13 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "l"} : dispatch 2024-08-31T04:39:13.498 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:39:13 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "i"} : dispatch 2024-08-31T04:39:13.498 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:39:13 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "c"} : dispatch 2024-08-31T04:39:13.498 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:39:13 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "h"} : dispatch 2024-08-31T04:39:13.498 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:39:13 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "k"} : dispatch 2024-08-31T04:39:13.498 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:39:13 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "b"} : dispatch 2024-08-31T04:39:13.498 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:39:13 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "e"} : dispatch 2024-08-31T04:39:13.498 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:39:13 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "g"} : dispatch 2024-08-31T04:39:13.498 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:39:13 smithi177 ceph-mon[22025]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "d"} : dispatch 2024-08-31T04:39:13.498 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:39:13 smithi177 ceph-mon[22025]: pgmap v859: 97 pgs: 97 active+clean; 592 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1.5 KiB/s wr, 12 op/s 2024-08-31T04:39:13.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:39:13 smithi133 ceph-mon[22177]: mds.? [v2:172.21.15.177:6832/710554654,v1:172.21.15.177:6833/710554654] up:boot 2024-08-31T04:39:13.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:39:13 smithi133 ceph-mon[22177]: mds.? [v2:172.21.15.177:6836/1229454741,v1:172.21.15.177:6838/1229454741] up:boot 2024-08-31T04:39:13.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:39:13 smithi133 ceph-mon[22177]: mds.? [v2:172.21.15.177:6837/2356760395,v1:172.21.15.177:6839/2356760395] up:boot 2024-08-31T04:39:13.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:39:13 smithi133 ceph-mon[22177]: mds.? [v2:172.21.15.133:6832/2204809328,v1:172.21.15.133:6833/2204809328] up:boot 2024-08-31T04:39:13.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:39:13 smithi133 ceph-mon[22177]: mds.? [v2:172.21.15.133:6834/3329426165,v1:172.21.15.133:6836/3329426165] up:boot 2024-08-31T04:39:13.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:39:13 smithi133 ceph-mon[22177]: mds.? [v2:172.21.15.133:6835/3526936748,v1:172.21.15.133:6837/3526936748] up:boot 2024-08-31T04:39:13.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:39:13 smithi133 ceph-mon[22177]: mds.? [v2:172.21.15.133:6838/2800199529,v1:172.21.15.133:6839/2800199529] up:boot 2024-08-31T04:39:13.544 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:39:13 smithi133 ceph-mon[22177]: mds.? [v2:172.21.15.50:6836/1805448916,v1:172.21.15.50:6837/1805448916] up:boot 2024-08-31T04:39:13.544 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:39:13 smithi133 ceph-mon[22177]: mds.? [v2:172.21.15.50:6838/1285967765,v1:172.21.15.50:6839/1285967765] up:boot 2024-08-31T04:39:13.544 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:39:13 smithi133 ceph-mon[22177]: mds.? [v2:172.21.15.50:6840/736082164,v1:172.21.15.50:6841/736082164] up:boot 2024-08-31T04:39:13.544 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:39:13 smithi133 ceph-mon[22177]: fsmap cephfs:0/5 12 up:standby, 5 failed 2024-08-31T04:39:13.544 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:39:13 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "a"} : dispatch 2024-08-31T04:39:13.544 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:39:13 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "l"} : dispatch 2024-08-31T04:39:13.544 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:39:13 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "i"} : dispatch 2024-08-31T04:39:13.544 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:39:13 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "c"} : dispatch 2024-08-31T04:39:13.544 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:39:13 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "h"} : dispatch 2024-08-31T04:39:13.544 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:39:13 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "k"} : dispatch 2024-08-31T04:39:13.544 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:39:13 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "b"} : dispatch 2024-08-31T04:39:13.544 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:39:13 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "e"} : dispatch 2024-08-31T04:39:13.544 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:39:13 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "g"} : dispatch 2024-08-31T04:39:13.544 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:39:13 smithi133 ceph-mon[22177]: from='mgr.14150 172.21.15.50:0/1286988237' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "d"} : dispatch 2024-08-31T04:39:13.545 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:39:13 smithi133 ceph-mon[22177]: pgmap v859: 97 pgs: 97 active+clean; 592 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1.5 KiB/s wr, 12 op/s 2024-08-31T04:39:14.134 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:14.133+0000 7f4e26000640 1 -- 172.21.15.50:0/406673092 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v74) ==== 104+0+0 (secure 0 0 0) 0x7f4e1c0d08c0 con 0x7f4e28105960 2024-08-31T04:39:14.139 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:14.137+0000 7f4e2f000640 1 -- 172.21.15.50:0/406673092 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f4e100b4b30 msgr2=0x7f4e100b7040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:39:14.139 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:14.137+0000 7f4e2f000640 1 --2- 172.21.15.50:0/406673092 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f4e100b4b30 0x7f4e100b7040 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f4e28104c60 tx=0x7f4e14005f90 comp rx=0 tx=0).stop 2024-08-31T04:39:14.139 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:14.137+0000 7f4e2f000640 1 -- 172.21.15.50:0/406673092 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4e28105960 msgr2=0x7f4e2819c2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:39:14.139 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:14.137+0000 7f4e2f000640 1 --2- 172.21.15.50:0/406673092 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4e28105960 0x7f4e2819c2a0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f4e1c02a910 tx=0x7f4e1c031a20 comp rx=0 tx=0).stop 2024-08-31T04:39:14.139 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:14.138+0000 7f4e2f000640 1 -- 172.21.15.50:0/406673092 shutdown_connections 2024-08-31T04:39:14.139 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:14.138+0000 7f4e2f000640 1 --2- 172.21.15.50:0/406673092 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f4e100b4b30 0x7f4e100b7040 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:39:14.140 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:14.138+0000 7f4e2f000640 1 --2- 172.21.15.50:0/406673092 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4e2810bbf0 0x7f4e281a1ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:39:14.140 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:14.138+0000 7f4e2f000640 1 --2- 172.21.15.50:0/406673092 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4e2810b2a0 0x7f4e2819c840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:39:14.140 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:14.138+0000 7f4e2f000640 1 --2- 172.21.15.50:0/406673092 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4e28105960 0x7f4e2819c2a0 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:39:14.140 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:14.138+0000 7f4e2f000640 1 -- 172.21.15.50:0/406673092 >> 172.21.15.50:0/406673092 conn(0x7f4e28101410 msgr2=0x7f4e2810a930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:39:14.140 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:14.138+0000 7f4e2f000640 1 -- 172.21.15.50:0/406673092 shutdown_connections 2024-08-31T04:39:14.140 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:14.138+0000 7f4e2f000640 1 -- 172.21.15.50:0/406673092 wait complete. 2024-08-31T04:39:14.293 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:39:14 smithi133 ceph-mon[22177]: from='client.? 172.21.15.50:0/406673092' entity='client.admin' cmd={"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} : dispatch 2024-08-31T04:39:14.450 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:39:14 smithi050 ceph-mon[17259]: from='client.? 172.21.15.50:0/406673092' entity='client.admin' cmd={"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} : dispatch 2024-08-31T04:39:14.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:39:14 smithi177 ceph-mon[22025]: from='client.? 172.21.15.50:0/406673092' entity='client.admin' cmd={"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} : dispatch 2024-08-31T04:39:15.024 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 058d9fc6-674f-11ef-bcd4-c7b262605968 -- ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-08-31T04:39:15.421 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:39:15.450 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:39:15 smithi050 ceph-mon[17259]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-08-31T04:39:15.450 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:39:15 smithi050 ceph-mon[17259]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-08-31T04:39:15.450 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:39:15 smithi050 ceph-mon[17259]: Cluster is now healthy 2024-08-31T04:39:15.450 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:39:15 smithi050 ceph-mon[17259]: from='client.? 172.21.15.50:0/406673092' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-08-31T04:39:15.450 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:39:15 smithi050 ceph-mon[17259]: fsmap 12 up:standby 2024-08-31T04:39:15.450 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:39:15 smithi050 ceph-mon[17259]: pgmap v860: 97 pgs: 97 active+clean; 592 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 1.3 KiB/s wr, 11 op/s 2024-08-31T04:39:15.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:39:15 smithi177 ceph-mon[22025]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-08-31T04:39:15.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:39:15 smithi177 ceph-mon[22025]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-08-31T04:39:15.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:39:15 smithi177 ceph-mon[22025]: Cluster is now healthy 2024-08-31T04:39:15.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:39:15 smithi177 ceph-mon[22025]: from='client.? 172.21.15.50:0/406673092' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-08-31T04:39:15.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:39:15 smithi177 ceph-mon[22025]: fsmap 12 up:standby 2024-08-31T04:39:15.496 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:39:15 smithi177 ceph-mon[22025]: pgmap v860: 97 pgs: 97 active+clean; 592 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 1.3 KiB/s wr, 11 op/s 2024-08-31T04:39:15.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:39:15 smithi133 ceph-mon[22177]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-08-31T04:39:15.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:39:15 smithi133 ceph-mon[22177]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-08-31T04:39:15.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:39:15 smithi133 ceph-mon[22177]: Cluster is now healthy 2024-08-31T04:39:15.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:39:15 smithi133 ceph-mon[22177]: from='client.? 172.21.15.50:0/406673092' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-08-31T04:39:15.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:39:15 smithi133 ceph-mon[22177]: fsmap 12 up:standby 2024-08-31T04:39:15.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:39:15 smithi133 ceph-mon[22177]: pgmap v860: 97 pgs: 97 active+clean; 592 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 1.3 KiB/s wr, 11 op/s 2024-08-31T04:39:16.098 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:16.095+0000 7f7141e00640 1 -- 172.21.15.50:0/2981117636 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f713c10bdb0 msgr2=0x7f713c1125e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:39:16.098 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:16.095+0000 7f7141e00640 1 --2- 172.21.15.50:0/2981117636 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f713c10bdb0 0x7f713c1125e0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f7134009ca0 tx=0x7f713402a8c0 comp rx=0 tx=0).stop 2024-08-31T04:39:16.098 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:16.095+0000 7f7141e00640 1 -- 172.21.15.50:0/2981117636 shutdown_connections 2024-08-31T04:39:16.098 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:16.095+0000 7f7141e00640 1 --2- 172.21.15.50:0/2981117636 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f713c10bdb0 0x7f713c1125e0 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:39:16.098 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:16.095+0000 7f7141e00640 1 --2- 172.21.15.50:0/2981117636 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f713c10b460 0x7f713c10b870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:39:16.098 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:16.095+0000 7f7141e00640 1 --2- 172.21.15.50:0/2981117636 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f713c105b20 0x7f713c105f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:39:16.098 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:16.095+0000 7f7141e00640 1 -- 172.21.15.50:0/2981117636 >> 172.21.15.50:0/2981117636 conn(0x7f713c1015b0 msgr2=0x7f713c103a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:39:16.099 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:16.095+0000 7f7141e00640 1 -- 172.21.15.50:0/2981117636 shutdown_connections 2024-08-31T04:39:16.099 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:16.095+0000 7f7141e00640 1 -- 172.21.15.50:0/2981117636 wait complete. 2024-08-31T04:39:16.100 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:16.096+0000 7f7141e00640 1 Processor -- start 2024-08-31T04:39:16.100 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:16.096+0000 7f7141e00640 1 -- start start 2024-08-31T04:39:16.100 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:16.097+0000 7f7141e00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f713c105b20 0x7f713c19c3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:39:16.100 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:16.097+0000 7f7141e00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f713c10b460 0x7f713c19c980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:39:16.100 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:16.097+0000 7f7141e00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f713c10bdb0 0x7f713c1a1c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:39:16.100 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:16.097+0000 7f7141e00640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f713c115a70 con 0x7f713c105b20 2024-08-31T04:39:16.100 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:16.097+0000 7f7141e00640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f713c1158f0 con 0x7f713c10bdb0 2024-08-31T04:39:16.100 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:16.097+0000 7f7141e00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f713c115bf0 con 0x7f713c10b460 2024-08-31T04:39:16.100 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:16.097+0000 7f713aa00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f713c105b20 0x7f713c19c3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:39:16.100 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:16.097+0000 7f713aa00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f713c105b20 0x7f713c19c3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:58010/0 (socket says 172.21.15.50:58010) 2024-08-31T04:39:16.101 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:16.097+0000 7f713b400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f713c10bdb0 0x7f713c1a1c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:39:16.101 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:16.097+0000 7f713aa00640 1 -- 172.21.15.50:0/3257724010 learned_addr learned my addr 172.21.15.50:0/3257724010 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:39:16.101 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:16.097+0000 7f7132000640 1 --2- 172.21.15.50:0/3257724010 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f713c10b460 0x7f713c19c980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:39:16.101 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:16.098+0000 7f713aa00640 1 -- 172.21.15.50:0/3257724010 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f713c10b460 msgr2=0x7f713c19c980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:39:16.101 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:16.098+0000 7f713aa00640 1 --2- 172.21.15.50:0/3257724010 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f713c10b460 0x7f713c19c980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:39:16.101 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:16.098+0000 7f713aa00640 1 -- 172.21.15.50:0/3257724010 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f713c10bdb0 msgr2=0x7f713c1a1c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:39:16.101 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:16.098+0000 7f713aa00640 1 --2- 172.21.15.50:0/3257724010 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f713c10bdb0 0x7f713c1a1c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:39:16.101 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:16.098+0000 7f713aa00640 1 -- 172.21.15.50:0/3257724010 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f713c1a2350 con 0x7f713c105b20 2024-08-31T04:39:16.102 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:16.098+0000 7f713aa00640 1 --2- 172.21.15.50:0/3257724010 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f713c105b20 0x7f713c19c3e0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f712c00e9f0 tx=0x7f712c00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:39:16.102 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:16.098+0000 7f7140a00640 1 -- 172.21.15.50:0/3257724010 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f712c00cd80 con 0x7f713c105b20 2024-08-31T04:39:16.102 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:16.098+0000 7f7140a00640 1 -- 172.21.15.50:0/3257724010 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f712c0108e0 con 0x7f713c105b20 2024-08-31T04:39:16.102 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:16.098+0000 7f7140a00640 1 -- 172.21.15.50:0/3257724010 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f712c018980 con 0x7f713c105b20 2024-08-31T04:39:16.102 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:16.098+0000 7f7141e00640 1 -- 172.21.15.50:0/3257724010 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f713c1a2640 con 0x7f713c105b20 2024-08-31T04:39:16.102 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:16.099+0000 7f7141e00640 1 -- 172.21.15.50:0/3257724010 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f713c1a8da0 con 0x7f713c105b20 2024-08-31T04:39:16.102 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:16.100+0000 7f7141e00640 1 -- 172.21.15.50:0/3257724010 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f713c105f30 con 0x7f713c105b20 2024-08-31T04:39:16.104 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:16.102+0000 7f7140a00640 1 -- 172.21.15.50:0/3257724010 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 18) ==== 152577+0+0 (secure 0 0 0) 0x7f712c010430 con 0x7f713c105b20 2024-08-31T04:39:16.106 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:16.104+0000 7f7140a00640 1 --2- 172.21.15.50:0/3257724010 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f71200b4b30 0x7f71200b7040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:39:16.106 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:16.104+0000 7f7140a00640 1 -- 172.21.15.50:0/3257724010 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8649+0+0 (secure 0 0 0) 0x7f712c0e5640 con 0x7f713c105b20 2024-08-31T04:39:16.106 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:16.104+0000 7f7132000640 1 --2- 172.21.15.50:0/3257724010 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f71200b4b30 0x7f71200b7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:39:16.107 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:16.105+0000 7f7132000640 1 --2- 172.21.15.50:0/3257724010 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f71200b4b30 0x7f71200b7040 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f713c104e00 tx=0x7f7124005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:39:16.110 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:16.108+0000 7f7140a00640 1 -- 172.21.15.50:0/3257724010 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f712c0abf20 con 0x7f713c105b20 2024-08-31T04:39:16.320 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:16.317+0000 7f7141e00640 1 -- 172.21.15.50:0/3257724010 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f713c10d610 con 0x7f713c105b20 2024-08-31T04:39:17.303 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:17.301+0000 7f7140a00640 1 -- 172.21.15.50:0/3257724010 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v82) ==== 181+0+0 (secure 0 0 0) 0x7f712c0b06e0 con 0x7f713c105b20 2024-08-31T04:39:17.303 INFO:teuthology.orchestra.run.smithi050.stderr:pool 'cephfs_metadata' removed 2024-08-31T04:39:17.309 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:17.307+0000 7f7141e00640 1 -- 172.21.15.50:0/3257724010 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f71200b4b30 msgr2=0x7f71200b7040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:39:17.309 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:17.307+0000 7f7141e00640 1 --2- 172.21.15.50:0/3257724010 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f71200b4b30 0x7f71200b7040 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f713c104e00 tx=0x7f7124005f90 comp rx=0 tx=0).stop 2024-08-31T04:39:17.309 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:17.307+0000 7f7141e00640 1 -- 172.21.15.50:0/3257724010 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f713c105b20 msgr2=0x7f713c19c3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:39:17.310 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:17.307+0000 7f7141e00640 1 --2- 172.21.15.50:0/3257724010 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f713c105b20 0x7f713c19c3e0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f712c00e9f0 tx=0x7f712c00eeb0 comp rx=0 tx=0).stop 2024-08-31T04:39:17.310 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:17.307+0000 7f7141e00640 1 -- 172.21.15.50:0/3257724010 shutdown_connections 2024-08-31T04:39:17.310 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:17.307+0000 7f7141e00640 1 --2- 172.21.15.50:0/3257724010 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7f71200b4b30 0x7f71200b7040 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:39:17.310 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:17.307+0000 7f7141e00640 1 --2- 172.21.15.50:0/3257724010 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f713c10b460 0x7f713c19c980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:39:17.310 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:17.307+0000 7f7141e00640 1 --2- 172.21.15.50:0/3257724010 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f713c10bdb0 0x7f713c1a1c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:39:17.310 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:17.307+0000 7f7141e00640 1 --2- 172.21.15.50:0/3257724010 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f713c105b20 0x7f713c19c3e0 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:39:17.311 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:17.307+0000 7f7141e00640 1 -- 172.21.15.50:0/3257724010 >> 172.21.15.50:0/3257724010 conn(0x7f713c1015b0 msgr2=0x7f713c108a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:39:17.311 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:17.308+0000 7f7141e00640 1 -- 172.21.15.50:0/3257724010 shutdown_connections 2024-08-31T04:39:17.312 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:17.309+0000 7f7141e00640 1 -- 172.21.15.50:0/3257724010 wait complete. 2024-08-31T04:39:17.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:39:17 smithi050 ceph-mon[17259]: pgmap v861: 97 pgs: 97 active+clean; 592 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 716 B/s wr, 8 op/s 2024-08-31T04:39:17.700 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:39:17 smithi050 ceph-mon[17259]: from='client.? 172.21.15.50:0/3257724010' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} : dispatch 2024-08-31T04:39:17.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:39:17 smithi177 ceph-mon[22025]: pgmap v861: 97 pgs: 97 active+clean; 592 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 716 B/s wr, 8 op/s 2024-08-31T04:39:17.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:39:17 smithi177 ceph-mon[22025]: from='client.? 172.21.15.50:0/3257724010' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} : dispatch 2024-08-31T04:39:17.792 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:39:17 smithi133 ceph-mon[22177]: pgmap v861: 97 pgs: 97 active+clean; 592 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 716 B/s wr, 8 op/s 2024-08-31T04:39:17.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:39:17 smithi133 ceph-mon[22177]: from='client.? 172.21.15.50:0/3257724010' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} : dispatch 2024-08-31T04:39:18.087 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 058d9fc6-674f-11ef-bcd4-c7b262605968 -- ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-08-31T04:39:18.483 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T04:39:18.622 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:39:18 smithi050 ceph-mon[17259]: from='client.? 172.21.15.50:0/3257724010' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-08-31T04:39:18.622 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:39:18 smithi050 ceph-mon[17259]: osdmap e82: 12 total, 12 up, 12 in 2024-08-31T04:39:18.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:39:18 smithi177 ceph-mon[22025]: from='client.? 172.21.15.50:0/3257724010' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-08-31T04:39:18.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:39:18 smithi177 ceph-mon[22025]: osdmap e82: 12 total, 12 up, 12 in 2024-08-31T04:39:18.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:39:18 smithi133 ceph-mon[22177]: from='client.? 172.21.15.50:0/3257724010' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-08-31T04:39:18.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:39:18 smithi133 ceph-mon[22177]: osdmap e82: 12 total, 12 up, 12 in 2024-08-31T04:39:19.068 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:19.065+0000 7fc0ff200640 1 -- 172.21.15.50:0/2497854551 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc100109070 msgr2=0x7fc100109480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:39:19.068 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:19.065+0000 7fc0ff200640 1 --2- 172.21.15.50:0/2497854551 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc100109070 0x7fc100109480 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fc0e8009860 tx=0x7fc0e802a340 comp rx=0 tx=0).stop 2024-08-31T04:39:19.068 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:19.065+0000 7fc0ff200640 1 -- 172.21.15.50:0/2497854551 shutdown_connections 2024-08-31T04:39:19.068 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:19.065+0000 7fc0ff200640 1 --2- 172.21.15.50:0/2497854551 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc1001099c0 0x7fc1001101f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:39:19.068 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:19.065+0000 7fc0ff200640 1 --2- 172.21.15.50:0/2497854551 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc100109070 0x7fc100109480 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:39:19.068 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:19.065+0000 7fc0ff200640 1 --2- 172.21.15.50:0/2497854551 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc100103730 0x7fc100103b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:39:19.068 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:19.065+0000 7fc0ff200640 1 -- 172.21.15.50:0/2497854551 >> 172.21.15.50:0/2497854551 conn(0x7fc1000ff180 msgr2=0x7fc1001015d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:39:19.068 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:19.065+0000 7fc0ff200640 1 -- 172.21.15.50:0/2497854551 shutdown_connections 2024-08-31T04:39:19.068 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:19.065+0000 7fc0ff200640 1 -- 172.21.15.50:0/2497854551 wait complete. 2024-08-31T04:39:19.069 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:19.066+0000 7fc0ff200640 1 Processor -- start 2024-08-31T04:39:19.069 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:19.066+0000 7fc0ff200640 1 -- start start 2024-08-31T04:39:19.069 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:19.067+0000 7fc0ff200640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc100103730 0x7fc10019c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:39:19.069 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:19.067+0000 7fc0ff200640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc100109070 0x7fc10019c860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:39:19.070 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:19.067+0000 7fc0ff200640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc1001099c0 0x7fc1001a1b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:39:19.070 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:19.067+0000 7fc0ff200640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fc100113630 con 0x7fc1001099c0 2024-08-31T04:39:19.070 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:19.067+0000 7fc0ff200640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7fc1001134b0 con 0x7fc100109070 2024-08-31T04:39:19.070 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:19.067+0000 7fc0ff200640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fc1001137b0 con 0x7fc100103730 2024-08-31T04:39:19.070 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:19.067+0000 7fc0fde00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc100103730 0x7fc10019c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:39:19.071 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:19.067+0000 7fc0fde00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc100103730 0x7fc10019c2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.50:40762/0 (socket says 172.21.15.50:40762) 2024-08-31T04:39:19.071 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:19.067+0000 7fc0fde00640 1 -- 172.21.15.50:0/630231510 learned_addr learned my addr 172.21.15.50:0/630231510 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T04:39:19.071 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:19.067+0000 7fc0fe800640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc1001099c0 0x7fc1001a1b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:39:19.071 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:19.067+0000 7fc0f7e00640 1 --2- 172.21.15.50:0/630231510 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc100109070 0x7fc10019c860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:39:19.071 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:19.068+0000 7fc0fde00640 1 -- 172.21.15.50:0/630231510 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc100109070 msgr2=0x7fc10019c860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:39:19.071 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:19.068+0000 7fc0fde00640 1 --2- 172.21.15.50:0/630231510 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc100109070 0x7fc10019c860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:39:19.071 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:19.068+0000 7fc0fde00640 1 -- 172.21.15.50:0/630231510 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc1001099c0 msgr2=0x7fc1001a1b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:39:19.071 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:19.068+0000 7fc0fde00640 1 --2- 172.21.15.50:0/630231510 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc1001099c0 0x7fc1001a1b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:39:19.072 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:19.068+0000 7fc0fde00640 1 -- 172.21.15.50:0/630231510 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1001a2230 con 0x7fc100103730 2024-08-31T04:39:19.072 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:19.068+0000 7fc0fde00640 1 --2- 172.21.15.50:0/630231510 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc100103730 0x7fc10019c2c0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fc0f000e9c0 tx=0x7fc0f000ee80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:39:19.072 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:19.068+0000 7fc0f6a00640 1 -- 172.21.15.50:0/630231510 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0f000cde0 con 0x7fc100103730 2024-08-31T04:39:19.072 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:19.068+0000 7fc0f6a00640 1 -- 172.21.15.50:0/630231510 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc0f00035f0 con 0x7fc100103730 2024-08-31T04:39:19.072 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:19.068+0000 7fc0f6a00640 1 -- 172.21.15.50:0/630231510 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0f0010690 con 0x7fc100103730 2024-08-31T04:39:19.072 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:19.068+0000 7fc0ff200640 1 -- 172.21.15.50:0/630231510 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc1001a2520 con 0x7fc100103730 2024-08-31T04:39:19.072 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:19.068+0000 7fc0ff200640 1 -- 172.21.15.50:0/630231510 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc1001a8c80 con 0x7fc100103730 2024-08-31T04:39:19.072 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:19.069+0000 7fc0ff200640 1 -- 172.21.15.50:0/630231510 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc100103b40 con 0x7fc100103730 2024-08-31T04:39:19.074 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:19.072+0000 7fc0f6a00640 1 -- 172.21.15.50:0/630231510 <== mon.1 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 18) ==== 152577+0+0 (secure 0 0 0) 0x7fc0f0004000 con 0x7fc100103730 2024-08-31T04:39:19.076 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:19.073+0000 7fc0f6a00640 1 --2- 172.21.15.50:0/630231510 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fc0e40b4b30 0x7fc0e40b7040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T04:39:19.076 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:19.073+0000 7fc0f6a00640 1 -- 172.21.15.50:0/630231510 <== mon.1 v2:172.21.15.177:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8116+0+0 (secure 0 0 0) 0x7fc0f00e5420 con 0x7fc100103730 2024-08-31T04:39:19.076 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:19.074+0000 7fc0f7e00640 1 --2- 172.21.15.50:0/630231510 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fc0e40b4b30 0x7fc0e40b7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T04:39:19.076 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:19.074+0000 7fc0f7e00640 1 --2- 172.21.15.50:0/630231510 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fc0e40b4b30 0x7fc0e40b7040 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fc0e8005940 tx=0x7fc0e80058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T04:39:19.079 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:19.077+0000 7fc0f6a00640 1 -- 172.21.15.50:0/630231510 <== mon.1 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fc0f0009510 con 0x7fc100103730 2024-08-31T04:39:19.282 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:19.279+0000 7fc0ff200640 1 -- 172.21.15.50:0/630231510 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7fc10019d3f0 con 0x7fc100103730 2024-08-31T04:39:19.317 INFO:teuthology.orchestra.run.smithi050.stderr:pool 'cephfs_data' removed 2024-08-31T04:39:19.318 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:19.313+0000 7fc0f6a00640 1 -- 172.21.15.50:0/630231510 <== mon.1 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v83) ==== 169+0+0 (secure 0 0 0) 0x7fc0f00ac570 con 0x7fc100103730 2024-08-31T04:39:19.321 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:19.317+0000 7fc0ff200640 1 -- 172.21.15.50:0/630231510 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fc0e40b4b30 msgr2=0x7fc0e40b7040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:39:19.321 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:19.317+0000 7fc0ff200640 1 --2- 172.21.15.50:0/630231510 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fc0e40b4b30 0x7fc0e40b7040 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fc0e8005940 tx=0x7fc0e80058d0 comp rx=0 tx=0).stop 2024-08-31T04:39:19.322 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:19.317+0000 7fc0ff200640 1 -- 172.21.15.50:0/630231510 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc100103730 msgr2=0x7fc10019c2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T04:39:19.322 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:19.317+0000 7fc0ff200640 1 --2- 172.21.15.50:0/630231510 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc100103730 0x7fc10019c2c0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fc0f000e9c0 tx=0x7fc0f000ee80 comp rx=0 tx=0).stop 2024-08-31T04:39:19.323 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:19.319+0000 7fc0ff200640 1 -- 172.21.15.50:0/630231510 shutdown_connections 2024-08-31T04:39:19.323 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:19.319+0000 7fc0ff200640 1 --2- 172.21.15.50:0/630231510 >> [v2:172.21.15.50:6800/2146686622,v1:172.21.15.50:6801/2146686622] conn(0x7fc0e40b4b30 0x7fc0e40b7040 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:39:19.324 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:19.319+0000 7fc0ff200640 1 --2- 172.21.15.50:0/630231510 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc1001099c0 0x7fc1001a1b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:39:19.324 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:19.319+0000 7fc0ff200640 1 --2- 172.21.15.50:0/630231510 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc100109070 0x7fc10019c860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:39:19.324 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:19.319+0000 7fc0ff200640 1 --2- 172.21.15.50:0/630231510 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc100103730 0x7fc10019c2c0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T04:39:19.324 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:19.319+0000 7fc0ff200640 1 -- 172.21.15.50:0/630231510 >> 172.21.15.50:0/630231510 conn(0x7fc1000ff180 msgr2=0x7fc100108790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T04:39:19.325 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:19.319+0000 7fc0ff200640 1 -- 172.21.15.50:0/630231510 shutdown_connections 2024-08-31T04:39:19.325 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T04:39:19.320+0000 7fc0ff200640 1 -- 172.21.15.50:0/630231510 wait complete. 2024-08-31T04:39:19.685 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:39:19 smithi050 ceph-mon[17259]: pgmap v863: 65 pgs: 65 active+clean; 577 KiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T04:39:19.685 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:39:19 smithi050 ceph-mon[17259]: from='client.? 172.21.15.50:0/630231510' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} : dispatch 2024-08-31T04:39:19.686 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:39:19 smithi050 ceph-mon[17259]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} : dispatch 2024-08-31T04:39:19.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:39:19 smithi177 ceph-mon[22025]: pgmap v863: 65 pgs: 65 active+clean; 577 KiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T04:39:19.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:39:19 smithi177 ceph-mon[22025]: from='client.? 172.21.15.50:0/630231510' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} : dispatch 2024-08-31T04:39:19.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:39:19 smithi177 ceph-mon[22025]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} : dispatch 2024-08-31T04:39:19.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:39:19 smithi133 ceph-mon[22177]: pgmap v863: 65 pgs: 65 active+clean; 577 KiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T04:39:19.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:39:19 smithi133 ceph-mon[22177]: from='client.? 172.21.15.50:0/630231510' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} : dispatch 2024-08-31T04:39:19.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:39:19 smithi133 ceph-mon[22177]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} : dispatch 2024-08-31T04:39:20.203 DEBUG:teuthology.orchestra.run.smithi050:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-08-31T04:39:20.261 DEBUG:teuthology.orchestra.run.smithi133:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-08-31T04:39:20.306 DEBUG:teuthology.orchestra.run.smithi177:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-08-31T04:39:20.339 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2024-08-31T04:39:20.339 DEBUG:teuthology.orchestra.run.smithi050:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-08-31T04:39:20.375 DEBUG:teuthology.orchestra.run.smithi133:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-08-31T04:39:20.392 DEBUG:teuthology.orchestra.run.smithi177:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-08-31T04:39:20.409 INFO:tasks.cephadm:Stopping all daemons... 2024-08-31T04:39:20.409 INFO:tasks.cephadm.mon.a:Stopping mon.a... 2024-08-31T04:39:20.410 DEBUG:teuthology.orchestra.run.smithi050:> sudo systemctl stop ceph-058d9fc6-674f-11ef-bcd4-c7b262605968@mon.a 2024-08-31T04:39:20.450 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:39:20 smithi050 ceph-mon[17259]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-08-31T04:39:20.450 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:39:20 smithi050 ceph-mon[17259]: osdmap e83: 12 total, 12 up, 12 in 2024-08-31T04:39:20.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:39:20 smithi133 ceph-mon[22177]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-08-31T04:39:20.543 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:39:20 smithi133 ceph-mon[22177]: osdmap e83: 12 total, 12 up, 12 in 2024-08-31T04:39:20.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:39:20 smithi177 ceph-mon[22025]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-08-31T04:39:20.746 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:39:20 smithi177 ceph-mon[22025]: osdmap e83: 12 total, 12 up, 12 in 2024-08-31T04:39:20.825 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:39:20 smithi050 systemd[1]: Stopping Ceph mon.a for 058d9fc6-674f-11ef-bcd4-c7b262605968... 2024-08-31T04:39:21.196 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:39:20 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-mon-a[17255]: 2024-08-31T04:39:20.822+0000 7faa89c00640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-08-31T04:39:21.196 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:39:20 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-mon-a[17255]: 2024-08-31T04:39:20.822+0000 7faa89c00640 -1 mon.a@0(leader) e3 *** Got Signal Terminated *** 2024-08-31T04:39:21.197 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:39:20 smithi050 podman[87240]: 2024-08-31 04:39:20.895097131 +0000 UTC m=+0.206121340 container died 266f494c7418b6d9c3c25a4a943c65e643524930229ac5faaf53b67724b04a62 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6, name=ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-mon-a, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.license=GPLv2, io.buildah.version=1.37.1, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731) 2024-08-31T04:39:21.450 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:39:21 smithi050 podman[87240]: 2024-08-31 04:39:21.418709468 +0000 UTC m=+0.729733677 container cleanup 266f494c7418b6d9c3c25a4a943c65e643524930229ac5faaf53b67724b04a62 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6, name=ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-mon-a, org.label-schema.schema-version=1.0, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True, io.buildah.version=1.37.1, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-08-31T04:39:21.450 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:39:21 smithi050 bash[87240]: ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-mon-a 2024-08-31T04:39:21.949 INFO:journalctl@ceph.mon.a.smithi050.stdout:Aug 31 04:39:21 smithi050 podman[87252]: 2024-08-31 04:39:21.670481209 +0000 UTC m=+0.764965213 container remove 266f494c7418b6d9c3c25a4a943c65e643524930229ac5faaf53b67724b04a62 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6, name=ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-mon-a, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, ceph=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, io.buildah.version=1.37.1, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=) 2024-08-31T04:39:21.973 DEBUG:teuthology.orchestra.run.smithi050:> sudo pkill -f 'journalctl -f -n 0 -u ceph-058d9fc6-674f-11ef-bcd4-c7b262605968@mon.a.service' 2024-08-31T04:39:22.109 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-31T04:39:22.109 INFO:tasks.cephadm.mon.a:Stopped mon.a 2024-08-31T04:39:22.109 INFO:tasks.cephadm.mon.c:Stopping mon.b... 2024-08-31T04:39:22.109 DEBUG:teuthology.orchestra.run.smithi133:> sudo systemctl stop ceph-058d9fc6-674f-11ef-bcd4-c7b262605968@mon.b 2024-08-31T04:39:22.471 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:39:22 smithi133 systemd[1]: Stopping Ceph mon.b for 058d9fc6-674f-11ef-bcd4-c7b262605968... 2024-08-31T04:39:22.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:39:22 smithi133 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-mon-b[22173]: 2024-08-31T04:39:22.469+0000 7fe6d8c86640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-08-31T04:39:22.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:39:22 smithi133 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-mon-b[22173]: 2024-08-31T04:39:22.469+0000 7fe6d8c86640 -1 mon.b@2(peon) e3 *** Got Signal Terminated *** 2024-08-31T04:39:22.793 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:39:22 smithi133 podman[57835]: 2024-08-31 04:39:22.684014921 +0000 UTC m=+0.355756780 container died 8bce5eda9d5e83a72b4548676a583321fb7434d3018158e22b74a828a366f768 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-mon-b, io.buildah.version=1.37.1, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.vendor=CentOS, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-08-31T04:39:23.293 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:39:23 smithi133 podman[57835]: 2024-08-31 04:39:23.070118865 +0000 UTC m=+0.741860720 container cleanup 8bce5eda9d5e83a72b4548676a583321fb7434d3018158e22b74a828a366f768 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-mon-b, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, io.buildah.version=1.37.1, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_CLEAN=True) 2024-08-31T04:39:23.293 INFO:journalctl@ceph.mon.b.smithi133.stdout:Aug 31 04:39:23 smithi133 bash[57835]: ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-mon-b 2024-08-31T04:39:23.478 DEBUG:teuthology.orchestra.run.smithi133:> sudo pkill -f 'journalctl -f -n 0 -u ceph-058d9fc6-674f-11ef-bcd4-c7b262605968@mon.b.service' 2024-08-31T04:39:23.528 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-31T04:39:23.529 INFO:tasks.cephadm.mon.c:Stopped mon.b 2024-08-31T04:39:23.529 INFO:tasks.cephadm.mon.c:Stopping mon.c... 2024-08-31T04:39:23.529 DEBUG:teuthology.orchestra.run.smithi177:> sudo systemctl stop ceph-058d9fc6-674f-11ef-bcd4-c7b262605968@mon.c 2024-08-31T04:39:23.850 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:39:23 smithi177 systemd[1]: Stopping Ceph mon.c for 058d9fc6-674f-11ef-bcd4-c7b262605968... 2024-08-31T04:39:24.246 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:39:23 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-mon-c[22021]: 2024-08-31T04:39:23.848+0000 7f79c3517640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-08-31T04:39:24.246 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:39:23 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-mon-c[22021]: 2024-08-31T04:39:23.848+0000 7f79c3517640 -1 mon.c@1(peon) e3 *** Got Signal Terminated *** 2024-08-31T04:39:24.246 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:39:23 smithi177 podman[58198]: 2024-08-31 04:39:23.981802439 +0000 UTC m=+0.256339970 container died 30c7409d7a61c5fc8bfff2a8575f9333017ec765756e4acab6ad62bb1721ae69 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-mon-c, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.1, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, ceph=True, GIT_CLEAN=True, org.label-schema.vendor=CentOS) 2024-08-31T04:39:24.635 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:39:24 smithi177 podman[58198]: 2024-08-31 04:39:24.391422234 +0000 UTC m=+0.665959761 container cleanup 30c7409d7a61c5fc8bfff2a8575f9333017ec765756e4acab6ad62bb1721ae69 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-mon-c, org.label-schema.vendor=CentOS, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, io.buildah.version=1.37.1, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-08-31T04:39:24.635 INFO:journalctl@ceph.mon.c.smithi177.stdout:Aug 31 04:39:24 smithi177 bash[58198]: ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-mon-c 2024-08-31T04:39:24.769 DEBUG:teuthology.orchestra.run.smithi177:> sudo pkill -f 'journalctl -f -n 0 -u ceph-058d9fc6-674f-11ef-bcd4-c7b262605968@mon.c.service' 2024-08-31T04:39:24.814 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-31T04:39:24.814 INFO:tasks.cephadm.mon.c:Stopped mon.c 2024-08-31T04:39:24.815 INFO:tasks.cephadm.mgr.x:Stopping mgr.x... 2024-08-31T04:39:24.815 DEBUG:teuthology.orchestra.run.smithi050:> sudo systemctl stop ceph-058d9fc6-674f-11ef-bcd4-c7b262605968@mgr.x 2024-08-31T04:39:25.154 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Aug 31 04:39:24 smithi050 systemd[1]: Stopping Ceph mgr.x for 058d9fc6-674f-11ef-bcd4-c7b262605968... 2024-08-31T04:39:25.450 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Aug 31 04:39:25 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-mgr-x[17482]: 2024-08-31T04:39:25.245+0000 7f1358c00640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mgr -n mgr.x -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-31T04:39:25.450 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Aug 31 04:39:25 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-mgr-x[17482]: 2024-08-31T04:39:25.245+0000 7f1358c00640 -1 mgr handle_mgr_signal *** Got signal Terminated *** 2024-08-31T04:39:25.450 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Aug 31 04:39:25 smithi050 podman[87359]: 2024-08-31 04:39:25.338586405 +0000 UTC m=+0.231627173 container died 01e9fffe42683e36fbf8ce8a750cc1440074e761a1455f57f8f2dd5bb547a4e8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6, name=ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-mgr-x, org.label-schema.vendor=CentOS, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.schema-version=1.0, io.buildah.version=1.37.1, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-08-31T04:39:26.153 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Aug 31 04:39:25 smithi050 podman[87359]: 2024-08-31 04:39:25.941935052 +0000 UTC m=+0.834975807 container cleanup 01e9fffe42683e36fbf8ce8a750cc1440074e761a1455f57f8f2dd5bb547a4e8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6, name=ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-mgr-x, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, ceph=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, CEPH_POINT_RELEASE=, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, io.buildah.version=1.37.1) 2024-08-31T04:39:26.153 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Aug 31 04:39:25 smithi050 bash[87359]: ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-mgr-x 2024-08-31T04:39:26.430 INFO:journalctl@ceph.mgr.x.smithi050.stdout:Aug 31 04:39:26 smithi050 podman[87372]: 2024-08-31 04:39:26.152143844 +0000 UTC m=+0.799870812 container remove 01e9fffe42683e36fbf8ce8a750cc1440074e761a1455f57f8f2dd5bb547a4e8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6, name=ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-mgr-x, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.1, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, ceph=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731) 2024-08-31T04:39:26.454 DEBUG:teuthology.orchestra.run.smithi050:> sudo pkill -f 'journalctl -f -n 0 -u ceph-058d9fc6-674f-11ef-bcd4-c7b262605968@mgr.x.service' 2024-08-31T04:39:26.532 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-31T04:39:26.532 INFO:tasks.cephadm.mgr.x:Stopped mgr.x 2024-08-31T04:39:26.532 INFO:tasks.cephadm.mgr.y:Stopping mgr.y... 2024-08-31T04:39:26.533 DEBUG:teuthology.orchestra.run.smithi133:> sudo systemctl stop ceph-058d9fc6-674f-11ef-bcd4-c7b262605968@mgr.y 2024-08-31T04:39:26.871 INFO:journalctl@ceph.mgr.y.smithi133.stdout:Aug 31 04:39:26 smithi133 systemd[1]: Stopping Ceph mgr.y for 058d9fc6-674f-11ef-bcd4-c7b262605968... 2024-08-31T04:39:27.161 INFO:journalctl@ceph.mgr.y.smithi133.stdout:Aug 31 04:39:26 smithi133 podman[57957]: 2024-08-31 04:39:26.871059187 +0000 UTC m=+0.142753062 container died 2f9584956e14ad03d24fcac0d62bba60809c4742b7c2dd4cefde39e319de68bb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-mgr-y, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240731, io.buildah.version=1.37.1, maintainer=Guillaume Abrioux , RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS) 2024-08-31T04:39:27.503 INFO:journalctl@ceph.mgr.y.smithi133.stdout:Aug 31 04:39:27 smithi133 podman[57957]: 2024-08-31 04:39:27.259339201 +0000 UTC m=+0.531033063 container cleanup 2f9584956e14ad03d24fcac0d62bba60809c4742b7c2dd4cefde39e319de68bb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-mgr-y, org.label-schema.vendor=CentOS, io.buildah.version=1.37.1, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True) 2024-08-31T04:39:27.503 INFO:journalctl@ceph.mgr.y.smithi133.stdout:Aug 31 04:39:27 smithi133 bash[57957]: ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-mgr-y 2024-08-31T04:39:27.638 DEBUG:teuthology.orchestra.run.smithi133:> sudo pkill -f 'journalctl -f -n 0 -u ceph-058d9fc6-674f-11ef-bcd4-c7b262605968@mgr.y.service' 2024-08-31T04:39:27.671 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-31T04:39:27.672 INFO:tasks.cephadm.mgr.y:Stopped mgr.y 2024-08-31T04:39:27.672 INFO:tasks.cephadm.mgr.z:Stopping mgr.z... 2024-08-31T04:39:27.672 DEBUG:teuthology.orchestra.run.smithi177:> sudo systemctl stop ceph-058d9fc6-674f-11ef-bcd4-c7b262605968@mgr.z 2024-08-31T04:39:27.996 INFO:journalctl@ceph.mgr.z.smithi177.stdout:Aug 31 04:39:27 smithi177 systemd[1]: Stopping Ceph mgr.z for 058d9fc6-674f-11ef-bcd4-c7b262605968... 2024-08-31T04:39:28.496 INFO:journalctl@ceph.mgr.z.smithi177.stdout:Aug 31 04:39:28 smithi177 podman[58320]: 2024-08-31 04:39:28.093061273 +0000 UTC m=+0.229812190 container stop c614be5564d8223444a452cfa4e3374a145147de5c22c4d785b6993bc1709d8e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-mgr-z, ceph=True, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, io.buildah.version=1.37.1) 2024-08-31T04:39:28.496 INFO:journalctl@ceph.mgr.z.smithi177.stdout:Aug 31 04:39:28 smithi177 podman[58320]: 2024-08-31 04:39:28.119127424 +0000 UTC m=+0.255878345 container died c614be5564d8223444a452cfa4e3374a145147de5c22c4d785b6993bc1709d8e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-mgr-z, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_CLEAN=True, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, io.buildah.version=1.37.1, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS) 2024-08-31T04:39:28.892 INFO:journalctl@ceph.mgr.z.smithi177.stdout:Aug 31 04:39:28 smithi177 podman[58320]: 2024-08-31 04:39:28.689292803 +0000 UTC m=+0.826043714 container cleanup c614be5564d8223444a452cfa4e3374a145147de5c22c4d785b6993bc1709d8e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-mgr-z, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.1, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, ceph=True, GIT_CLEAN=True) 2024-08-31T04:39:28.892 INFO:journalctl@ceph.mgr.z.smithi177.stdout:Aug 31 04:39:28 smithi177 bash[58320]: ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-mgr-z 2024-08-31T04:39:29.126 DEBUG:teuthology.orchestra.run.smithi177:> sudo pkill -f 'journalctl -f -n 0 -u ceph-058d9fc6-674f-11ef-bcd4-c7b262605968@mgr.z.service' 2024-08-31T04:39:29.147 INFO:journalctl@ceph.mgr.z.smithi177.stdout:Aug 31 04:39:28 smithi177 podman[58332]: 2024-08-31 04:39:28.891240667 +0000 UTC m=+0.792233544 container remove c614be5564d8223444a452cfa4e3374a145147de5c22c4d785b6993bc1709d8e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-mgr-z, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.1, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_BRANCH=HEAD, ceph=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-08-31T04:39:29.148 INFO:journalctl@ceph.mgr.z.smithi177.stdout:Aug 31 04:39:28 smithi177 systemd[1]: ceph-058d9fc6-674f-11ef-bcd4-c7b262605968@mgr.z.service: Main process exited, code=exited, status=143/n/a 2024-08-31T04:39:29.148 INFO:journalctl@ceph.mgr.z.smithi177.stdout:Aug 31 04:39:29 smithi177 systemd[1]: ceph-058d9fc6-674f-11ef-bcd4-c7b262605968@mgr.z.service: Failed with result 'exit-code'. 2024-08-31T04:39:29.148 INFO:journalctl@ceph.mgr.z.smithi177.stdout:Aug 31 04:39:29 smithi177 systemd[1]: Stopped Ceph mgr.z for 058d9fc6-674f-11ef-bcd4-c7b262605968. 2024-08-31T04:39:29.148 INFO:journalctl@ceph.mgr.z.smithi177.stdout:Aug 31 04:39:29 smithi177 systemd[1]: ceph-058d9fc6-674f-11ef-bcd4-c7b262605968@mgr.z.service: Consumed 7.386s CPU time. 2024-08-31T04:39:29.160 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-31T04:39:29.160 INFO:tasks.cephadm.mgr.z:Stopped mgr.z 2024-08-31T04:39:29.161 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2024-08-31T04:39:29.161 DEBUG:teuthology.orchestra.run.smithi050:> sudo systemctl stop ceph-058d9fc6-674f-11ef-bcd4-c7b262605968@osd.0 2024-08-31T04:39:29.593 INFO:journalctl@ceph.osd.0.smithi050.stdout:Aug 31 04:39:29 smithi050 systemd[1]: Stopping Ceph osd.0 for 058d9fc6-674f-11ef-bcd4-c7b262605968... 2024-08-31T04:39:29.950 INFO:journalctl@ceph.osd.0.smithi050.stdout:Aug 31 04:39:29 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-0[33357]: 2024-08-31T04:39:29.591+0000 7fd526600640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-31T04:39:29.950 INFO:journalctl@ceph.osd.0.smithi050.stdout:Aug 31 04:39:29 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-0[33357]: 2024-08-31T04:39:29.591+0000 7fd526600640 -1 osd.0 83 *** Got signal Terminated *** 2024-08-31T04:39:29.950 INFO:journalctl@ceph.osd.0.smithi050.stdout:Aug 31 04:39:29 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-0[33357]: 2024-08-31T04:39:29.591+0000 7fd526600640 -1 osd.0 83 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-08-31T04:39:35.395 INFO:journalctl@ceph.osd.0.smithi050.stdout:Aug 31 04:39:35 smithi050 podman[87491]: 2024-08-31 04:39:35.106843931 +0000 UTC m=+5.660294264 container died b6b360e08ce4454170a136639471bb1a8dc9d0ed5b6c79d86495abcc3f51af86 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-0, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, io.buildah.version=1.37.1, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, ceph=True, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731) 2024-08-31T04:39:35.700 INFO:journalctl@ceph.osd.0.smithi050.stdout:Aug 31 04:39:35 smithi050 podman[87491]: 2024-08-31 04:39:35.525136302 +0000 UTC m=+6.078586635 container cleanup b6b360e08ce4454170a136639471bb1a8dc9d0ed5b6c79d86495abcc3f51af86 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, io.buildah.version=1.37.1, GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, ceph=True) 2024-08-31T04:39:35.700 INFO:journalctl@ceph.osd.0.smithi050.stdout:Aug 31 04:39:35 smithi050 bash[87491]: ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-0 2024-08-31T04:39:36.200 INFO:journalctl@ceph.osd.0.smithi050.stdout:Aug 31 04:39:35 smithi050 podman[87507]: 2024-08-31 04:39:35.7942639 +0000 UTC m=+0.680698951 container remove b6b360e08ce4454170a136639471bb1a8dc9d0ed5b6c79d86495abcc3f51af86 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-0, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, ceph=True, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, io.buildah.version=1.37.1) 2024-08-31T04:39:36.508 INFO:journalctl@ceph.osd.0.smithi050.stdout:Aug 31 04:39:36 smithi050 podman[87596]: 2024-08-31 04:39:36.258612184 +0000 UTC m=+0.027042916 image pull 79f4cde5e36911a5dca995eeb98098c2c8aae81dd52a088ef2c867bc3363bad0 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61 2024-08-31T04:39:36.509 INFO:journalctl@ceph.osd.0.smithi050.stdout:Aug 31 04:39:36 smithi050 podman[87596]: 2024-08-31 04:39:36.370182205 +0000 UTC m=+0.138612925 container create e2753dfd347ace2ebca07cffb44ed7e2807278dcc0d12719aa612ed26179bd1e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-0-deactivate, GIT_CLEAN=True, ceph=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, io.buildah.version=1.37.1, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-08-31T04:39:36.839 INFO:journalctl@ceph.osd.0.smithi050.stdout:Aug 31 04:39:36 smithi050 podman[87596]: 2024-08-31 04:39:36.614644733 +0000 UTC m=+0.383075463 container init e2753dfd347ace2ebca07cffb44ed7e2807278dcc0d12719aa612ed26179bd1e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-0-deactivate, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.build-date=20240731, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, io.buildah.version=1.37.1, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-08-31T04:39:36.839 INFO:journalctl@ceph.osd.0.smithi050.stdout:Aug 31 04:39:36 smithi050 podman[87596]: 2024-08-31 04:39:36.621462691 +0000 UTC m=+0.389893422 container start e2753dfd347ace2ebca07cffb44ed7e2807278dcc0d12719aa612ed26179bd1e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-0-deactivate, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, ceph=True, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, io.buildah.version=1.37.1, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2) 2024-08-31T04:39:36.839 INFO:journalctl@ceph.osd.0.smithi050.stdout:Aug 31 04:39:36 smithi050 podman[87596]: 2024-08-31 04:39:36.71454121 +0000 UTC m=+0.482971930 container attach e2753dfd347ace2ebca07cffb44ed7e2807278dcc0d12719aa612ed26179bd1e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-0-deactivate, io.buildah.version=1.37.1, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.schema-version=1.0, GIT_CLEAN=True, ceph=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image) 2024-08-31T04:39:37.200 INFO:journalctl@ceph.osd.0.smithi050.stdout:Aug 31 04:39:36 smithi050 podman[87620]: 2024-08-31 04:39:36.93569884 +0000 UTC m=+0.026975937 container died e2753dfd347ace2ebca07cffb44ed7e2807278dcc0d12719aa612ed26179bd1e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-0-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, io.buildah.version=1.37.1, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=) 2024-08-31T04:39:37.578 DEBUG:teuthology.orchestra.run.smithi050:> sudo pkill -f 'journalctl -f -n 0 -u ceph-058d9fc6-674f-11ef-bcd4-c7b262605968@osd.0.service' 2024-08-31T04:39:37.659 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-31T04:39:37.660 INFO:tasks.cephadm.osd.0:Stopped osd.0 2024-08-31T04:39:37.660 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2024-08-31T04:39:37.660 DEBUG:teuthology.orchestra.run.smithi133:> sudo systemctl stop ceph-058d9fc6-674f-11ef-bcd4-c7b262605968@osd.1 2024-08-31T04:39:37.965 INFO:journalctl@ceph.osd.1.smithi133.stdout:Aug 31 04:39:37 smithi133 systemd[1]: Stopping Ceph osd.1 for 058d9fc6-674f-11ef-bcd4-c7b262605968... 2024-08-31T04:39:38.293 INFO:journalctl@ceph.osd.1.smithi133.stdout:Aug 31 04:39:37 smithi133 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-1[26623]: 2024-08-31T04:39:37.963+0000 7fa204fcd640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-31T04:39:38.293 INFO:journalctl@ceph.osd.1.smithi133.stdout:Aug 31 04:39:37 smithi133 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-1[26623]: 2024-08-31T04:39:37.963+0000 7fa204fcd640 -1 osd.1 83 *** Got signal Terminated *** 2024-08-31T04:39:38.293 INFO:journalctl@ceph.osd.1.smithi133.stdout:Aug 31 04:39:37 smithi133 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-1[26623]: 2024-08-31T04:39:37.963+0000 7fa204fcd640 -1 osd.1 83 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-08-31T04:39:43.658 INFO:journalctl@ceph.osd.1.smithi133.stdout:Aug 31 04:39:43 smithi133 podman[58081]: 2024-08-31 04:39:43.367573464 +0000 UTC m=+5.518241193 container died 31739fc2dfd843bd7a41c08def57a0f4d9c1347fe8ebc44ecc4ff35aec51f34c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-1, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, io.buildah.version=1.37.1, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS) 2024-08-31T04:39:44.041 INFO:journalctl@ceph.osd.1.smithi133.stdout:Aug 31 04:39:43 smithi133 podman[58081]: 2024-08-31 04:39:43.780712689 +0000 UTC m=+5.931380418 container cleanup 31739fc2dfd843bd7a41c08def57a0f4d9c1347fe8ebc44ecc4ff35aec51f34c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-1, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, io.buildah.version=1.37.1) 2024-08-31T04:39:44.041 INFO:journalctl@ceph.osd.1.smithi133.stdout:Aug 31 04:39:43 smithi133 bash[58081]: ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-1 2024-08-31T04:39:44.293 INFO:journalctl@ceph.osd.1.smithi133.stdout:Aug 31 04:39:44 smithi133 podman[58098]: 2024-08-31 04:39:44.040528715 +0000 UTC m=+0.633446604 container remove 31739fc2dfd843bd7a41c08def57a0f4d9c1347fe8ebc44ecc4ff35aec51f34c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-1, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.1, org.label-schema.license=GPLv2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-08-31T04:39:44.603 INFO:journalctl@ceph.osd.1.smithi133.stdout:Aug 31 04:39:44 smithi133 podman[58185]: 2024-08-31 04:39:44.253349649 +0000 UTC m=+0.015797523 image pull 79f4cde5e36911a5dca995eeb98098c2c8aae81dd52a088ef2c867bc3363bad0 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61 2024-08-31T04:39:44.603 INFO:journalctl@ceph.osd.1.smithi133.stdout:Aug 31 04:39:44 smithi133 podman[58185]: 2024-08-31 04:39:44.366603036 +0000 UTC m=+0.129050945 container create 1ac16aa66974a7244f960fedf2bd58a350b10adc3040855c9d82b2dbf456002b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-1-deactivate, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, io.buildah.version=1.37.1, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD) 2024-08-31T04:39:45.043 INFO:journalctl@ceph.osd.1.smithi133.stdout:Aug 31 04:39:44 smithi133 podman[58185]: 2024-08-31 04:39:44.602392713 +0000 UTC m=+0.364840580 container init 1ac16aa66974a7244f960fedf2bd58a350b10adc3040855c9d82b2dbf456002b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-1-deactivate, ceph=True, org.label-schema.vendor=CentOS, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , io.buildah.version=1.37.1, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0) 2024-08-31T04:39:45.043 INFO:journalctl@ceph.osd.1.smithi133.stdout:Aug 31 04:39:44 smithi133 podman[58185]: 2024-08-31 04:39:44.605944039 +0000 UTC m=+0.368391907 container start 1ac16aa66974a7244f960fedf2bd58a350b10adc3040855c9d82b2dbf456002b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-1-deactivate, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, io.buildah.version=1.37.1, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_CLEAN=True, ceph=True, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD) 2024-08-31T04:39:45.043 INFO:journalctl@ceph.osd.1.smithi133.stdout:Aug 31 04:39:44 smithi133 podman[58185]: 2024-08-31 04:39:44.717005372 +0000 UTC m=+0.479453254 container attach 1ac16aa66974a7244f960fedf2bd58a350b10adc3040855c9d82b2dbf456002b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-1-deactivate, ceph=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, io.buildah.version=1.37.1, GIT_CLEAN=True, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-08-31T04:39:45.043 INFO:journalctl@ceph.osd.1.smithi133.stdout:Aug 31 04:39:44 smithi133 podman[58185]: 2024-08-31 04:39:44.845885944 +0000 UTC m=+0.608333818 container died 1ac16aa66974a7244f960fedf2bd58a350b10adc3040855c9d82b2dbf456002b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-1-deactivate, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, io.buildah.version=1.37.1, org.label-schema.vendor=CentOS, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True) 2024-08-31T04:39:45.626 DEBUG:teuthology.orchestra.run.smithi133:> sudo pkill -f 'journalctl -f -n 0 -u ceph-058d9fc6-674f-11ef-bcd4-c7b262605968@osd.1.service' 2024-08-31T04:39:45.672 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-31T04:39:45.672 INFO:tasks.cephadm.osd.1:Stopped osd.1 2024-08-31T04:39:45.672 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2024-08-31T04:39:45.672 DEBUG:teuthology.orchestra.run.smithi177:> sudo systemctl stop ceph-058d9fc6-674f-11ef-bcd4-c7b262605968@osd.2 2024-08-31T04:39:45.994 INFO:journalctl@ceph.osd.2.smithi177.stdout:Aug 31 04:39:45 smithi177 systemd[1]: Stopping Ceph osd.2 for 058d9fc6-674f-11ef-bcd4-c7b262605968... 2024-08-31T04:39:46.246 INFO:journalctl@ceph.osd.2.smithi177.stdout:Aug 31 04:39:45 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-2[26964]: 2024-08-31T04:39:45.992+0000 7f00146d6640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-31T04:39:46.246 INFO:journalctl@ceph.osd.2.smithi177.stdout:Aug 31 04:39:45 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-2[26964]: 2024-08-31T04:39:45.992+0000 7f00146d6640 -1 osd.2 83 *** Got signal Terminated *** 2024-08-31T04:39:46.246 INFO:journalctl@ceph.osd.2.smithi177.stdout:Aug 31 04:39:45 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-2[26964]: 2024-08-31T04:39:45.992+0000 7f00146d6640 -1 osd.2 83 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-08-31T04:39:51.652 INFO:journalctl@ceph.osd.2.smithi177.stdout:Aug 31 04:39:51 smithi177 podman[58446]: 2024-08-31 04:39:51.38658424 +0000 UTC m=+5.517063250 container died 171d35c471dd2e59f832f0c381ec5fadcf8bfbcc6afaade8bd3a17a68ca6c670 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, io.buildah.version=1.37.1, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, ceph=True, org.label-schema.vendor=CentOS) 2024-08-31T04:39:51.996 INFO:journalctl@ceph.osd.2.smithi177.stdout:Aug 31 04:39:51 smithi177 podman[58446]: 2024-08-31 04:39:51.743078233 +0000 UTC m=+5.873557241 container cleanup 171d35c471dd2e59f832f0c381ec5fadcf8bfbcc6afaade8bd3a17a68ca6c670 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, io.buildah.version=1.37.1, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD) 2024-08-31T04:39:51.996 INFO:journalctl@ceph.osd.2.smithi177.stdout:Aug 31 04:39:51 smithi177 bash[58446]: ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-2 2024-08-31T04:39:52.404 INFO:journalctl@ceph.osd.2.smithi177.stdout:Aug 31 04:39:52 smithi177 podman[58461]: 2024-08-31 04:39:52.045011682 +0000 UTC m=+0.653960330 container remove 171d35c471dd2e59f832f0c381ec5fadcf8bfbcc6afaade8bd3a17a68ca6c670 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-2, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, ceph=True, CEPH_POINT_RELEASE=, io.buildah.version=1.37.1, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True) 2024-08-31T04:39:52.741 INFO:journalctl@ceph.osd.2.smithi177.stdout:Aug 31 04:39:52 smithi177 podman[58548]: 2024-08-31 04:39:52.40423579 +0000 UTC m=+0.111831492 container create b416dac90589c563d36a780d2bab82a3384f79e286d3b22544ed232b507d2440 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-2-deactivate, CEPH_POINT_RELEASE=, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.1, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True) 2024-08-31T04:39:52.741 INFO:journalctl@ceph.osd.2.smithi177.stdout:Aug 31 04:39:52 smithi177 podman[58548]: 2024-08-31 04:39:52.308518356 +0000 UTC m=+0.016114066 image pull 79f4cde5e36911a5dca995eeb98098c2c8aae81dd52a088ef2c867bc3363bad0 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61 2024-08-31T04:39:52.741 INFO:journalctl@ceph.osd.2.smithi177.stdout:Aug 31 04:39:52 smithi177 podman[58548]: 2024-08-31 04:39:52.640098189 +0000 UTC m=+0.347693901 container init b416dac90589c563d36a780d2bab82a3384f79e286d3b22544ed232b507d2440 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-2-deactivate, org.label-schema.vendor=CentOS, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, io.buildah.version=1.37.1, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD) 2024-08-31T04:39:52.741 INFO:journalctl@ceph.osd.2.smithi177.stdout:Aug 31 04:39:52 smithi177 podman[58548]: 2024-08-31 04:39:52.643601026 +0000 UTC m=+0.351196735 container start b416dac90589c563d36a780d2bab82a3384f79e286d3b22544ed232b507d2440 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-2-deactivate, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_CLEAN=True, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.schema-version=1.0, io.buildah.version=1.37.1, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD) 2024-08-31T04:39:52.741 INFO:journalctl@ceph.osd.2.smithi177.stdout:Aug 31 04:39:52 smithi177 podman[58548]: 2024-08-31 04:39:52.740088133 +0000 UTC m=+0.447683836 container attach b416dac90589c563d36a780d2bab82a3384f79e286d3b22544ed232b507d2440 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-2-deactivate, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, io.buildah.version=1.37.1) 2024-08-31T04:39:52.996 INFO:journalctl@ceph.osd.2.smithi177.stdout:Aug 31 04:39:52 smithi177 podman[58548]: 2024-08-31 04:39:52.843697353 +0000 UTC m=+0.551293056 container died b416dac90589c563d36a780d2bab82a3384f79e286d3b22544ed232b507d2440 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-2-deactivate, io.buildah.version=1.37.1, ceph=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2) 2024-08-31T04:39:53.467 DEBUG:teuthology.orchestra.run.smithi177:> sudo pkill -f 'journalctl -f -n 0 -u ceph-058d9fc6-674f-11ef-bcd4-c7b262605968@osd.2.service' 2024-08-31T04:39:53.506 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-31T04:39:53.507 INFO:tasks.cephadm.osd.2:Stopped osd.2 2024-08-31T04:39:53.507 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2024-08-31T04:39:53.507 DEBUG:teuthology.orchestra.run.smithi050:> sudo systemctl stop ceph-058d9fc6-674f-11ef-bcd4-c7b262605968@osd.3 2024-08-31T04:39:53.926 INFO:journalctl@ceph.osd.3.smithi050.stdout:Aug 31 04:39:53 smithi050 systemd[1]: Stopping Ceph osd.3 for 058d9fc6-674f-11ef-bcd4-c7b262605968... 2024-08-31T04:39:54.200 INFO:journalctl@ceph.osd.3.smithi050.stdout:Aug 31 04:39:53 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-3[39768]: 2024-08-31T04:39:53.924+0000 7f4511c00640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-31T04:39:54.200 INFO:journalctl@ceph.osd.3.smithi050.stdout:Aug 31 04:39:53 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-3[39768]: 2024-08-31T04:39:53.924+0000 7f4511c00640 -1 osd.3 83 *** Got signal Terminated *** 2024-08-31T04:39:54.200 INFO:journalctl@ceph.osd.3.smithi050.stdout:Aug 31 04:39:53 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-3[39768]: 2024-08-31T04:39:53.924+0000 7f4511c00640 -1 osd.3 83 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-08-31T04:39:55.700 INFO:journalctl@ceph.osd.9.smithi050.stdout:Aug 31 04:39:55 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-9[52806]: 2024-08-31T04:39:55.430+0000 7f30c0800640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-08-31T04:39:33.661151+0000 front 2024-08-31T04:39:33.661082+0000 (oldest deadline 2024-08-31T04:39:55.361248+0000) 2024-08-31T04:39:56.293 INFO:journalctl@ceph.osd.10.smithi133.stdout:Aug 31 04:39:55 smithi133 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-10[46762]: 2024-08-31T04:39:55.961+0000 7f873f3e9640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-08-31T04:39:32.936397+0000 front 2024-08-31T04:39:32.936196+0000 (oldest deadline 2024-08-31T04:39:55.836336+0000) 2024-08-31T04:39:56.700 INFO:journalctl@ceph.osd.9.smithi050.stdout:Aug 31 04:39:56 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-9[52806]: 2024-08-31T04:39:56.437+0000 7f30c0800640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-08-31T04:39:33.661151+0000 front 2024-08-31T04:39:33.661082+0000 (oldest deadline 2024-08-31T04:39:55.361248+0000) 2024-08-31T04:39:56.700 INFO:journalctl@ceph.osd.6.smithi050.stdout:Aug 31 04:39:56 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-6[46267]: 2024-08-31T04:39:56.270+0000 7efc67a00640 -1 osd.6 83 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-08-31T04:39:30.285999+0000 front 2024-08-31T04:39:30.286080+0000 (oldest deadline 2024-08-31T04:39:56.186016+0000) 2024-08-31T04:39:56.746 INFO:journalctl@ceph.osd.11.smithi177.stdout:Aug 31 04:39:56 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-11[46864]: 2024-08-31T04:39:56.289+0000 7fd602bf1640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-08-31T04:39:30.036711+0000 front 2024-08-31T04:39:30.036747+0000 (oldest deadline 2024-08-31T04:39:55.936674+0000) 2024-08-31T04:39:57.293 INFO:journalctl@ceph.osd.10.smithi133.stdout:Aug 31 04:39:56 smithi133 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-10[46762]: 2024-08-31T04:39:56.982+0000 7f873f3e9640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-08-31T04:39:32.936397+0000 front 2024-08-31T04:39:32.936196+0000 (oldest deadline 2024-08-31T04:39:55.836336+0000) 2024-08-31T04:39:57.377 INFO:journalctl@ceph.osd.6.smithi050.stdout:Aug 31 04:39:57 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-6[46267]: 2024-08-31T04:39:57.291+0000 7efc67a00640 -1 osd.6 83 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-08-31T04:39:30.285999+0000 front 2024-08-31T04:39:30.286080+0000 (oldest deadline 2024-08-31T04:39:56.186016+0000) 2024-08-31T04:39:57.496 INFO:journalctl@ceph.osd.11.smithi177.stdout:Aug 31 04:39:57 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-11[46864]: 2024-08-31T04:39:57.308+0000 7fd602bf1640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-08-31T04:39:30.036711+0000 front 2024-08-31T04:39:30.036747+0000 (oldest deadline 2024-08-31T04:39:55.936674+0000) 2024-08-31T04:39:57.496 INFO:journalctl@ceph.osd.5.smithi177.stdout:Aug 31 04:39:57 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-5[33549]: 2024-08-31T04:39:57.068+0000 7f7b7e125640 -1 osd.5 83 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-08-31T04:39:32.463230+0000 front 2024-08-31T04:39:32.463262+0000 (oldest deadline 2024-08-31T04:39:57.063913+0000) 2024-08-31T04:39:57.700 INFO:journalctl@ceph.osd.9.smithi050.stdout:Aug 31 04:39:57 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-9[52806]: 2024-08-31T04:39:57.453+0000 7f30c0800640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-08-31T04:39:33.661151+0000 front 2024-08-31T04:39:33.661082+0000 (oldest deadline 2024-08-31T04:39:55.361248+0000) 2024-08-31T04:39:58.199 INFO:journalctl@ceph.osd.3.smithi050.stdout:Aug 31 04:39:57 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-3[39768]: 2024-08-31T04:39:57.942+0000 7f4508600640 -1 osd.3 83 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-08-31T04:39:32.929737+0000 front 2024-08-31T04:39:32.929880+0000 (oldest deadline 2024-08-31T04:39:57.029850+0000) 2024-08-31T04:39:58.293 INFO:journalctl@ceph.osd.10.smithi133.stdout:Aug 31 04:39:57 smithi133 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-10[46762]: 2024-08-31T04:39:57.980+0000 7f873f3e9640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-08-31T04:39:32.936397+0000 front 2024-08-31T04:39:32.936196+0000 (oldest deadline 2024-08-31T04:39:55.836336+0000) 2024-08-31T04:39:58.315 INFO:journalctl@ceph.osd.5.smithi177.stdout:Aug 31 04:39:58 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-5[33549]: 2024-08-31T04:39:58.035+0000 7f7b7e125640 -1 osd.5 83 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-08-31T04:39:32.463230+0000 front 2024-08-31T04:39:32.463262+0000 (oldest deadline 2024-08-31T04:39:57.063913+0000) 2024-08-31T04:39:58.700 INFO:journalctl@ceph.osd.6.smithi050.stdout:Aug 31 04:39:58 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-6[46267]: 2024-08-31T04:39:58.295+0000 7efc67a00640 -1 osd.6 83 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-08-31T04:39:30.285999+0000 front 2024-08-31T04:39:30.286080+0000 (oldest deadline 2024-08-31T04:39:56.186016+0000) 2024-08-31T04:39:58.700 INFO:journalctl@ceph.osd.9.smithi050.stdout:Aug 31 04:39:58 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-9[52806]: 2024-08-31T04:39:58.411+0000 7f30c0800640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-08-31T04:39:33.661151+0000 front 2024-08-31T04:39:33.661082+0000 (oldest deadline 2024-08-31T04:39:55.361248+0000) 2024-08-31T04:39:58.746 INFO:journalctl@ceph.osd.11.smithi177.stdout:Aug 31 04:39:58 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-11[46864]: 2024-08-31T04:39:58.313+0000 7fd602bf1640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-08-31T04:39:30.036711+0000 front 2024-08-31T04:39:30.036747+0000 (oldest deadline 2024-08-31T04:39:55.936674+0000) 2024-08-31T04:39:59.293 INFO:journalctl@ceph.osd.10.smithi133.stdout:Aug 31 04:39:58 smithi133 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-10[46762]: 2024-08-31T04:39:58.952+0000 7f873f3e9640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-08-31T04:39:32.936397+0000 front 2024-08-31T04:39:32.936196+0000 (oldest deadline 2024-08-31T04:39:55.836336+0000) 2024-08-31T04:39:59.310 INFO:journalctl@ceph.osd.5.smithi177.stdout:Aug 31 04:39:59 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-5[33549]: 2024-08-31T04:39:59.031+0000 7f7b7e125640 -1 osd.5 83 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-08-31T04:39:32.463230+0000 front 2024-08-31T04:39:32.463262+0000 (oldest deadline 2024-08-31T04:39:57.063913+0000) 2024-08-31T04:39:59.700 INFO:journalctl@ceph.osd.3.smithi050.stdout:Aug 31 04:39:59 smithi050 podman[87710]: 2024-08-31 04:39:59.402282049 +0000 UTC m=+5.599256341 container died 4e7e47e9dd12a34bd6ef9f2d56220d273d5adb92584bbf53d5e54d9c09c18800 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-3, ceph=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.1, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image) 2024-08-31T04:39:59.700 INFO:journalctl@ceph.osd.6.smithi050.stdout:Aug 31 04:39:59 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-6[46267]: 2024-08-31T04:39:59.303+0000 7efc67a00640 -1 osd.6 83 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-08-31T04:39:30.285999+0000 front 2024-08-31T04:39:30.286080+0000 (oldest deadline 2024-08-31T04:39:56.186016+0000) 2024-08-31T04:39:59.701 INFO:journalctl@ceph.osd.9.smithi050.stdout:Aug 31 04:39:59 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-9[52806]: 2024-08-31T04:39:59.432+0000 7f30c0800640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-08-31T04:39:33.661151+0000 front 2024-08-31T04:39:33.661082+0000 (oldest deadline 2024-08-31T04:39:55.361248+0000) 2024-08-31T04:39:59.745 INFO:journalctl@ceph.osd.11.smithi177.stdout:Aug 31 04:39:59 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-11[46864]: 2024-08-31T04:39:59.309+0000 7fd602bf1640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-08-31T04:39:30.036711+0000 front 2024-08-31T04:39:30.036747+0000 (oldest deadline 2024-08-31T04:39:55.936674+0000) 2024-08-31T04:40:00.105 INFO:journalctl@ceph.osd.3.smithi050.stdout:Aug 31 04:39:59 smithi050 podman[87710]: 2024-08-31 04:39:59.848261955 +0000 UTC m=+6.045236246 container cleanup 4e7e47e9dd12a34bd6ef9f2d56220d273d5adb92584bbf53d5e54d9c09c18800 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-3, org.label-schema.schema-version=1.0, ceph=True, io.buildah.version=1.37.1, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731) 2024-08-31T04:40:00.105 INFO:journalctl@ceph.osd.3.smithi050.stdout:Aug 31 04:39:59 smithi050 bash[87710]: ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-3 2024-08-31T04:40:00.246 INFO:journalctl@ceph.osd.5.smithi177.stdout:Aug 31 04:39:59 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-5[33549]: 2024-08-31T04:39:59.986+0000 7f7b7e125640 -1 osd.5 83 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-08-31T04:39:32.463230+0000 front 2024-08-31T04:39:32.463262+0000 (oldest deadline 2024-08-31T04:39:57.063913+0000) 2024-08-31T04:40:00.293 INFO:journalctl@ceph.osd.10.smithi133.stdout:Aug 31 04:39:59 smithi133 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-10[46762]: 2024-08-31T04:39:59.942+0000 7f873f3e9640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-08-31T04:39:32.936397+0000 front 2024-08-31T04:39:32.936196+0000 (oldest deadline 2024-08-31T04:39:55.836336+0000) 2024-08-31T04:40:00.450 INFO:journalctl@ceph.osd.3.smithi050.stdout:Aug 31 04:40:00 smithi050 podman[87743]: 2024-08-31 04:40:00.104712946 +0000 UTC m=+0.690208791 container remove 4e7e47e9dd12a34bd6ef9f2d56220d273d5adb92584bbf53d5e54d9c09c18800 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-3, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, io.buildah.version=1.37.1, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731) 2024-08-31T04:40:00.450 INFO:journalctl@ceph.osd.6.smithi050.stdout:Aug 31 04:40:00 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-6[46267]: 2024-08-31T04:40:00.338+0000 7efc67a00640 -1 osd.6 83 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-08-31T04:39:30.285999+0000 front 2024-08-31T04:39:30.286080+0000 (oldest deadline 2024-08-31T04:39:56.186016+0000) 2024-08-31T04:40:00.746 INFO:journalctl@ceph.osd.11.smithi177.stdout:Aug 31 04:40:00 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-11[46864]: 2024-08-31T04:40:00.336+0000 7fd602bf1640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-08-31T04:39:30.036711+0000 front 2024-08-31T04:39:30.036747+0000 (oldest deadline 2024-08-31T04:39:55.936674+0000) 2024-08-31T04:40:00.850 INFO:journalctl@ceph.osd.3.smithi050.stdout:Aug 31 04:40:00 smithi050 podman[87832]: 2024-08-31 04:40:00.574761566 +0000 UTC m=+0.027177806 image pull 79f4cde5e36911a5dca995eeb98098c2c8aae81dd52a088ef2c867bc3363bad0 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61 2024-08-31T04:40:00.850 INFO:journalctl@ceph.osd.3.smithi050.stdout:Aug 31 04:40:00 smithi050 podman[87832]: 2024-08-31 04:40:00.700890276 +0000 UTC m=+0.153306514 container create 9313bcd2452b022473c786f105ef4a16154868074a953940b7a9ce60b7ada5c3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-3-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, io.buildah.version=1.37.1, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, ceph=True, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611) 2024-08-31T04:40:00.850 INFO:journalctl@ceph.osd.9.smithi050.stdout:Aug 31 04:40:00 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-9[52806]: 2024-08-31T04:40:00.476+0000 7f30c0800640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-08-31T04:39:33.661151+0000 front 2024-08-31T04:39:33.661082+0000 (oldest deadline 2024-08-31T04:39:55.361248+0000) 2024-08-31T04:40:01.200 INFO:journalctl@ceph.osd.3.smithi050.stdout:Aug 31 04:40:00 smithi050 podman[87832]: 2024-08-31 04:40:00.953728359 +0000 UTC m=+0.406144598 container init 9313bcd2452b022473c786f105ef4a16154868074a953940b7a9ce60b7ada5c3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-3-deactivate, ceph=True, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, io.buildah.version=1.37.1, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611) 2024-08-31T04:40:01.200 INFO:journalctl@ceph.osd.3.smithi050.stdout:Aug 31 04:40:00 smithi050 podman[87832]: 2024-08-31 04:40:00.960558567 +0000 UTC m=+0.412974818 container start 9313bcd2452b022473c786f105ef4a16154868074a953940b7a9ce60b7ada5c3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-3-deactivate, io.buildah.version=1.37.1, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, maintainer=Guillaume Abrioux , RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0) 2024-08-31T04:40:01.200 INFO:journalctl@ceph.osd.3.smithi050.stdout:Aug 31 04:40:01 smithi050 podman[87832]: 2024-08-31 04:40:01.053646643 +0000 UTC m=+0.506062906 container attach 9313bcd2452b022473c786f105ef4a16154868074a953940b7a9ce60b7ada5c3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-3-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, ceph=True, io.buildah.version=1.37.1, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731) 2024-08-31T04:40:01.293 INFO:journalctl@ceph.osd.10.smithi133.stdout:Aug 31 04:40:00 smithi133 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-10[46762]: 2024-08-31T04:40:00.949+0000 7f873f3e9640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-08-31T04:39:32.936397+0000 front 2024-08-31T04:39:32.936196+0000 (oldest deadline 2024-08-31T04:39:55.836336+0000) 2024-08-31T04:40:01.302 INFO:journalctl@ceph.osd.5.smithi177.stdout:Aug 31 04:40:00 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-5[33549]: 2024-08-31T04:40:00.997+0000 7f7b7e125640 -1 osd.5 83 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-08-31T04:39:32.463230+0000 front 2024-08-31T04:39:32.463262+0000 (oldest deadline 2024-08-31T04:39:57.063913+0000) 2024-08-31T04:40:01.527 INFO:journalctl@ceph.osd.3.smithi050.stdout:Aug 31 04:40:01 smithi050 podman[87832]: 2024-08-31 04:40:01.226089433 +0000 UTC m=+0.678505672 container died 9313bcd2452b022473c786f105ef4a16154868074a953940b7a9ce60b7ada5c3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-3-deactivate, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, ceph=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, io.buildah.version=1.37.1, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD) 2024-08-31T04:40:01.527 INFO:journalctl@ceph.osd.6.smithi050.stdout:Aug 31 04:40:01 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-6[46267]: 2024-08-31T04:40:01.386+0000 7efc67a00640 -1 osd.6 83 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-08-31T04:39:30.285999+0000 front 2024-08-31T04:39:30.286080+0000 (oldest deadline 2024-08-31T04:39:56.186016+0000) 2024-08-31T04:40:01.746 INFO:journalctl@ceph.osd.11.smithi177.stdout:Aug 31 04:40:01 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-11[46864]: 2024-08-31T04:40:01.301+0000 7fd602bf1640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-08-31T04:39:30.036711+0000 front 2024-08-31T04:39:30.036747+0000 (oldest deadline 2024-08-31T04:39:55.936674+0000) 2024-08-31T04:40:01.817 INFO:journalctl@ceph.osd.9.smithi050.stdout:Aug 31 04:40:01 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-9[52806]: 2024-08-31T04:40:01.525+0000 7f30c0800640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-08-31T04:39:33.661151+0000 front 2024-08-31T04:39:33.661082+0000 (oldest deadline 2024-08-31T04:39:55.361248+0000) 2024-08-31T04:40:01.842 DEBUG:teuthology.orchestra.run.smithi050:> sudo pkill -f 'journalctl -f -n 0 -u ceph-058d9fc6-674f-11ef-bcd4-c7b262605968@osd.3.service' 2024-08-31T04:40:01.916 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-31T04:40:01.917 INFO:tasks.cephadm.osd.3:Stopped osd.3 2024-08-31T04:40:01.917 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2024-08-31T04:40:01.917 DEBUG:teuthology.orchestra.run.smithi133:> sudo systemctl stop ceph-058d9fc6-674f-11ef-bcd4-c7b262605968@osd.4 2024-08-31T04:40:02.229 INFO:journalctl@ceph.osd.4.smithi133.stdout:Aug 31 04:40:01 smithi133 systemd[1]: Stopping Ceph osd.4 for 058d9fc6-674f-11ef-bcd4-c7b262605968... 2024-08-31T04:40:02.229 INFO:journalctl@ceph.osd.10.smithi133.stdout:Aug 31 04:40:01 smithi133 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-10[46762]: 2024-08-31T04:40:01.967+0000 7f873f3e9640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-08-31T04:39:32.936397+0000 front 2024-08-31T04:39:32.936196+0000 (oldest deadline 2024-08-31T04:39:55.836336+0000) 2024-08-31T04:40:02.496 INFO:journalctl@ceph.osd.5.smithi177.stdout:Aug 31 04:40:02 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-5[33549]: 2024-08-31T04:40:02.037+0000 7f7b7e125640 -1 osd.5 83 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-08-31T04:39:32.463230+0000 front 2024-08-31T04:39:32.463262+0000 (oldest deadline 2024-08-31T04:39:57.063913+0000) 2024-08-31T04:40:02.496 INFO:journalctl@ceph.osd.11.smithi177.stdout:Aug 31 04:40:02 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-11[46864]: 2024-08-31T04:40:02.275+0000 7fd602bf1640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-08-31T04:39:30.036711+0000 front 2024-08-31T04:39:30.036747+0000 (oldest deadline 2024-08-31T04:39:55.936674+0000) 2024-08-31T04:40:02.542 INFO:journalctl@ceph.osd.4.smithi133.stdout:Aug 31 04:40:02 smithi133 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-4[33352]: 2024-08-31T04:40:02.227+0000 7fa26dfb5640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-31T04:40:02.543 INFO:journalctl@ceph.osd.4.smithi133.stdout:Aug 31 04:40:02 smithi133 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-4[33352]: 2024-08-31T04:40:02.227+0000 7fa26dfb5640 -1 osd.4 83 *** Got signal Terminated *** 2024-08-31T04:40:02.543 INFO:journalctl@ceph.osd.4.smithi133.stdout:Aug 31 04:40:02 smithi133 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-4[33352]: 2024-08-31T04:40:02.227+0000 7fa26dfb5640 -1 osd.4 83 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-08-31T04:40:02.700 INFO:journalctl@ceph.osd.6.smithi050.stdout:Aug 31 04:40:02 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-6[46267]: 2024-08-31T04:40:02.354+0000 7efc67a00640 -1 osd.6 83 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-08-31T04:39:30.285999+0000 front 2024-08-31T04:39:30.286080+0000 (oldest deadline 2024-08-31T04:39:56.186016+0000) 2024-08-31T04:40:02.700 INFO:journalctl@ceph.osd.9.smithi050.stdout:Aug 31 04:40:02 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-9[52806]: 2024-08-31T04:40:02.479+0000 7f30c0800640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-08-31T04:39:33.661151+0000 front 2024-08-31T04:39:33.661082+0000 (oldest deadline 2024-08-31T04:39:55.361248+0000) 2024-08-31T04:40:03.293 INFO:journalctl@ceph.osd.10.smithi133.stdout:Aug 31 04:40:03 smithi133 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-10[46762]: 2024-08-31T04:40:03.009+0000 7f873f3e9640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-08-31T04:39:32.936397+0000 front 2024-08-31T04:39:32.936196+0000 (oldest deadline 2024-08-31T04:39:55.836336+0000) 2024-08-31T04:40:03.496 INFO:journalctl@ceph.osd.5.smithi177.stdout:Aug 31 04:40:03 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-5[33549]: 2024-08-31T04:40:03.070+0000 7f7b7e125640 -1 osd.5 83 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-08-31T04:39:32.463230+0000 front 2024-08-31T04:39:32.463262+0000 (oldest deadline 2024-08-31T04:39:57.063913+0000) 2024-08-31T04:40:03.496 INFO:journalctl@ceph.osd.11.smithi177.stdout:Aug 31 04:40:03 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-11[46864]: 2024-08-31T04:40:03.250+0000 7fd602bf1640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-08-31T04:39:30.036711+0000 front 2024-08-31T04:39:30.036747+0000 (oldest deadline 2024-08-31T04:39:55.936674+0000) 2024-08-31T04:40:03.700 INFO:journalctl@ceph.osd.6.smithi050.stdout:Aug 31 04:40:03 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-6[46267]: 2024-08-31T04:40:03.305+0000 7efc67a00640 -1 osd.6 83 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-08-31T04:39:30.285999+0000 front 2024-08-31T04:39:30.286080+0000 (oldest deadline 2024-08-31T04:39:56.186016+0000) 2024-08-31T04:40:03.700 INFO:journalctl@ceph.osd.9.smithi050.stdout:Aug 31 04:40:03 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-9[52806]: 2024-08-31T04:40:03.455+0000 7f30c0800640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-08-31T04:39:33.661151+0000 front 2024-08-31T04:39:33.661082+0000 (oldest deadline 2024-08-31T04:39:55.361248+0000) 2024-08-31T04:40:03.996 INFO:journalctl@ceph.osd.8.smithi177.stdout:Aug 31 04:40:03 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-8[40333]: 2024-08-31T04:40:03.700+0000 7f244221a640 -1 osd.8 83 heartbeat_check: no reply from 172.21.15.133:6804 osd.1 since back 2024-08-31T04:39:41.888896+0000 front 2024-08-31T04:39:41.888953+0000 (oldest deadline 2024-08-31T04:40:03.588900+0000) 2024-08-31T04:40:04.293 INFO:journalctl@ceph.osd.10.smithi133.stdout:Aug 31 04:40:04 smithi133 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-10[46762]: 2024-08-31T04:40:04.021+0000 7f873f3e9640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-08-31T04:39:32.936397+0000 front 2024-08-31T04:39:32.936196+0000 (oldest deadline 2024-08-31T04:39:55.836336+0000) 2024-08-31T04:40:04.496 INFO:journalctl@ceph.osd.5.smithi177.stdout:Aug 31 04:40:04 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-5[33549]: 2024-08-31T04:40:04.098+0000 7f7b7e125640 -1 osd.5 83 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-08-31T04:39:32.463230+0000 front 2024-08-31T04:39:32.463262+0000 (oldest deadline 2024-08-31T04:39:57.063913+0000) 2024-08-31T04:40:04.496 INFO:journalctl@ceph.osd.5.smithi177.stdout:Aug 31 04:40:04 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-5[33549]: 2024-08-31T04:40:04.098+0000 7f7b7e125640 -1 osd.5 83 heartbeat_check: no reply from 172.21.15.133:6804 osd.1 since back 2024-08-31T04:39:40.564951+0000 front 2024-08-31T04:39:40.565089+0000 (oldest deadline 2024-08-31T04:40:04.065065+0000) 2024-08-31T04:40:04.497 INFO:journalctl@ceph.osd.11.smithi177.stdout:Aug 31 04:40:04 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-11[46864]: 2024-08-31T04:40:04.270+0000 7fd602bf1640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-08-31T04:39:30.036711+0000 front 2024-08-31T04:39:30.036747+0000 (oldest deadline 2024-08-31T04:39:55.936674+0000) 2024-08-31T04:40:04.497 INFO:journalctl@ceph.osd.11.smithi177.stdout:Aug 31 04:40:04 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-11[46864]: 2024-08-31T04:40:04.270+0000 7fd602bf1640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.133:6804 osd.1 since back 2024-08-31T04:39:41.138475+0000 front 2024-08-31T04:39:41.138491+0000 (oldest deadline 2024-08-31T04:40:04.038356+0000) 2024-08-31T04:40:04.700 INFO:journalctl@ceph.osd.6.smithi050.stdout:Aug 31 04:40:04 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-6[46267]: 2024-08-31T04:40:04.289+0000 7efc67a00640 -1 osd.6 83 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-08-31T04:39:30.285999+0000 front 2024-08-31T04:39:30.286080+0000 (oldest deadline 2024-08-31T04:39:56.186016+0000) 2024-08-31T04:40:04.700 INFO:journalctl@ceph.osd.9.smithi050.stdout:Aug 31 04:40:04 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-9[52806]: 2024-08-31T04:40:04.428+0000 7f30c0800640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-08-31T04:39:33.661151+0000 front 2024-08-31T04:39:33.661082+0000 (oldest deadline 2024-08-31T04:39:55.361248+0000) 2024-08-31T04:40:04.793 INFO:journalctl@ceph.osd.4.smithi133.stdout:Aug 31 04:40:04 smithi133 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-4[33352]: 2024-08-31T04:40:04.530+0000 7fa26a5a0640 -1 osd.4 83 heartbeat_check: no reply from 172.21.15.133:6804 osd.1 since back 2024-08-31T04:39:40.610318+0000 front 2024-08-31T04:39:40.610345+0000 (oldest deadline 2024-08-31T04:40:04.110441+0000) 2024-08-31T04:40:04.797 INFO:journalctl@ceph.osd.7.smithi133.stdout:Aug 31 04:40:04 smithi133 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-7[40256]: 2024-08-31T04:40:04.624+0000 7fd8eda41640 -1 osd.7 83 heartbeat_check: no reply from 172.21.15.133:6804 osd.1 since back 2024-08-31T04:39:39.987526+0000 front 2024-08-31T04:39:39.987404+0000 (oldest deadline 2024-08-31T04:40:04.087555+0000) 2024-08-31T04:40:04.996 INFO:journalctl@ceph.osd.8.smithi177.stdout:Aug 31 04:40:04 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-8[40333]: 2024-08-31T04:40:04.711+0000 7f244221a640 -1 osd.8 83 heartbeat_check: no reply from 172.21.15.133:6804 osd.1 since back 2024-08-31T04:39:41.888896+0000 front 2024-08-31T04:39:41.888953+0000 (oldest deadline 2024-08-31T04:40:03.588900+0000) 2024-08-31T04:40:05.496 INFO:journalctl@ceph.osd.5.smithi177.stdout:Aug 31 04:40:05 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-5[33549]: 2024-08-31T04:40:05.061+0000 7f7b7e125640 -1 osd.5 83 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-08-31T04:39:32.463230+0000 front 2024-08-31T04:39:32.463262+0000 (oldest deadline 2024-08-31T04:39:57.063913+0000) 2024-08-31T04:40:05.496 INFO:journalctl@ceph.osd.5.smithi177.stdout:Aug 31 04:40:05 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-5[33549]: 2024-08-31T04:40:05.061+0000 7f7b7e125640 -1 osd.5 83 heartbeat_check: no reply from 172.21.15.133:6804 osd.1 since back 2024-08-31T04:39:40.564951+0000 front 2024-08-31T04:39:40.565089+0000 (oldest deadline 2024-08-31T04:40:04.065065+0000) 2024-08-31T04:40:05.497 INFO:journalctl@ceph.osd.11.smithi177.stdout:Aug 31 04:40:05 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-11[46864]: 2024-08-31T04:40:05.256+0000 7fd602bf1640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-08-31T04:39:30.036711+0000 front 2024-08-31T04:39:30.036747+0000 (oldest deadline 2024-08-31T04:39:55.936674+0000) 2024-08-31T04:40:05.497 INFO:journalctl@ceph.osd.11.smithi177.stdout:Aug 31 04:40:05 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-11[46864]: 2024-08-31T04:40:05.256+0000 7fd602bf1640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.133:6804 osd.1 since back 2024-08-31T04:39:41.138475+0000 front 2024-08-31T04:39:41.138491+0000 (oldest deadline 2024-08-31T04:40:04.038356+0000) 2024-08-31T04:40:05.543 INFO:journalctl@ceph.osd.10.smithi133.stdout:Aug 31 04:40:05 smithi133 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-10[46762]: 2024-08-31T04:40:05.061+0000 7f873f3e9640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-08-31T04:39:32.936397+0000 front 2024-08-31T04:39:32.936196+0000 (oldest deadline 2024-08-31T04:39:55.836336+0000) 2024-08-31T04:40:05.700 INFO:journalctl@ceph.osd.6.smithi050.stdout:Aug 31 04:40:05 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-6[46267]: 2024-08-31T04:40:05.275+0000 7efc67a00640 -1 osd.6 83 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-08-31T04:39:30.285999+0000 front 2024-08-31T04:39:30.286080+0000 (oldest deadline 2024-08-31T04:39:56.186016+0000) 2024-08-31T04:40:05.700 INFO:journalctl@ceph.osd.6.smithi050.stdout:Aug 31 04:40:05 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-6[46267]: 2024-08-31T04:40:05.276+0000 7efc67a00640 -1 osd.6 83 heartbeat_check: no reply from 172.21.15.133:6804 osd.1 since back 2024-08-31T04:39:41.487497+0000 front 2024-08-31T04:39:41.487305+0000 (oldest deadline 2024-08-31T04:40:04.387393+0000) 2024-08-31T04:40:05.701 INFO:journalctl@ceph.osd.9.smithi050.stdout:Aug 31 04:40:05 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-9[52806]: 2024-08-31T04:40:05.430+0000 7f30c0800640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-08-31T04:39:33.661151+0000 front 2024-08-31T04:39:33.661082+0000 (oldest deadline 2024-08-31T04:39:55.361248+0000) 2024-08-31T04:40:05.701 INFO:journalctl@ceph.osd.9.smithi050.stdout:Aug 31 04:40:05 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-9[52806]: 2024-08-31T04:40:05.430+0000 7f30c0800640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.133:6804 osd.1 since back 2024-08-31T04:39:41.262725+0000 front 2024-08-31T04:39:41.262699+0000 (oldest deadline 2024-08-31T04:40:05.362593+0000) 2024-08-31T04:40:05.996 INFO:journalctl@ceph.osd.8.smithi177.stdout:Aug 31 04:40:05 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-8[40333]: 2024-08-31T04:40:05.701+0000 7f244221a640 -1 osd.8 83 heartbeat_check: no reply from 172.21.15.133:6804 osd.1 since back 2024-08-31T04:39:41.888896+0000 front 2024-08-31T04:39:41.888953+0000 (oldest deadline 2024-08-31T04:40:03.588900+0000) 2024-08-31T04:40:06.043 INFO:journalctl@ceph.osd.7.smithi133.stdout:Aug 31 04:40:05 smithi133 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-7[40256]: 2024-08-31T04:40:05.595+0000 7fd8eda41640 -1 osd.7 83 heartbeat_check: no reply from 172.21.15.133:6804 osd.1 since back 2024-08-31T04:39:39.987526+0000 front 2024-08-31T04:39:39.987404+0000 (oldest deadline 2024-08-31T04:40:04.087555+0000) 2024-08-31T04:40:06.043 INFO:journalctl@ceph.osd.4.smithi133.stdout:Aug 31 04:40:05 smithi133 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-4[33352]: 2024-08-31T04:40:05.554+0000 7fa26a5a0640 -1 osd.4 83 heartbeat_check: no reply from 172.21.15.133:6804 osd.1 since back 2024-08-31T04:39:40.610318+0000 front 2024-08-31T04:39:40.610345+0000 (oldest deadline 2024-08-31T04:40:04.110441+0000) 2024-08-31T04:40:06.496 INFO:journalctl@ceph.osd.5.smithi177.stdout:Aug 31 04:40:06 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-5[33549]: 2024-08-31T04:40:06.020+0000 7f7b7e125640 -1 osd.5 83 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-08-31T04:39:32.463230+0000 front 2024-08-31T04:39:32.463262+0000 (oldest deadline 2024-08-31T04:39:57.063913+0000) 2024-08-31T04:40:06.496 INFO:journalctl@ceph.osd.5.smithi177.stdout:Aug 31 04:40:06 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-5[33549]: 2024-08-31T04:40:06.020+0000 7f7b7e125640 -1 osd.5 83 heartbeat_check: no reply from 172.21.15.133:6804 osd.1 since back 2024-08-31T04:39:40.564951+0000 front 2024-08-31T04:39:40.565089+0000 (oldest deadline 2024-08-31T04:40:04.065065+0000) 2024-08-31T04:40:06.496 INFO:journalctl@ceph.osd.11.smithi177.stdout:Aug 31 04:40:06 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-11[46864]: 2024-08-31T04:40:06.260+0000 7fd602bf1640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-08-31T04:39:30.036711+0000 front 2024-08-31T04:39:30.036747+0000 (oldest deadline 2024-08-31T04:39:55.936674+0000) 2024-08-31T04:40:06.497 INFO:journalctl@ceph.osd.11.smithi177.stdout:Aug 31 04:40:06 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-11[46864]: 2024-08-31T04:40:06.260+0000 7fd602bf1640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.133:6804 osd.1 since back 2024-08-31T04:39:41.138475+0000 front 2024-08-31T04:39:41.138491+0000 (oldest deadline 2024-08-31T04:40:04.038356+0000) 2024-08-31T04:40:06.543 INFO:journalctl@ceph.osd.10.smithi133.stdout:Aug 31 04:40:06 smithi133 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-10[46762]: 2024-08-31T04:40:06.072+0000 7f873f3e9640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-08-31T04:39:32.936397+0000 front 2024-08-31T04:39:32.936196+0000 (oldest deadline 2024-08-31T04:39:55.836336+0000) 2024-08-31T04:40:06.700 INFO:journalctl@ceph.osd.6.smithi050.stdout:Aug 31 04:40:06 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-6[46267]: 2024-08-31T04:40:06.238+0000 7efc67a00640 -1 osd.6 83 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-08-31T04:39:30.285999+0000 front 2024-08-31T04:39:30.286080+0000 (oldest deadline 2024-08-31T04:39:56.186016+0000) 2024-08-31T04:40:06.700 INFO:journalctl@ceph.osd.6.smithi050.stdout:Aug 31 04:40:06 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-6[46267]: 2024-08-31T04:40:06.238+0000 7efc67a00640 -1 osd.6 83 heartbeat_check: no reply from 172.21.15.133:6804 osd.1 since back 2024-08-31T04:39:41.487497+0000 front 2024-08-31T04:39:41.487305+0000 (oldest deadline 2024-08-31T04:40:04.387393+0000) 2024-08-31T04:40:06.700 INFO:journalctl@ceph.osd.9.smithi050.stdout:Aug 31 04:40:06 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-9[52806]: 2024-08-31T04:40:06.454+0000 7f30c0800640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-08-31T04:39:33.661151+0000 front 2024-08-31T04:39:33.661082+0000 (oldest deadline 2024-08-31T04:39:55.361248+0000) 2024-08-31T04:40:06.700 INFO:journalctl@ceph.osd.9.smithi050.stdout:Aug 31 04:40:06 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-9[52806]: 2024-08-31T04:40:06.454+0000 7f30c0800640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.133:6804 osd.1 since back 2024-08-31T04:39:41.262725+0000 front 2024-08-31T04:39:41.262699+0000 (oldest deadline 2024-08-31T04:40:05.362593+0000) 2024-08-31T04:40:06.996 INFO:journalctl@ceph.osd.8.smithi177.stdout:Aug 31 04:40:06 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-8[40333]: 2024-08-31T04:40:06.717+0000 7f244221a640 -1 osd.8 83 heartbeat_check: no reply from 172.21.15.133:6804 osd.1 since back 2024-08-31T04:39:41.888896+0000 front 2024-08-31T04:39:41.888953+0000 (oldest deadline 2024-08-31T04:40:03.588900+0000) 2024-08-31T04:40:07.046 INFO:journalctl@ceph.osd.4.smithi133.stdout:Aug 31 04:40:06 smithi133 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-4[33352]: 2024-08-31T04:40:06.562+0000 7fa26a5a0640 -1 osd.4 83 heartbeat_check: no reply from 172.21.15.133:6804 osd.1 since back 2024-08-31T04:39:40.610318+0000 front 2024-08-31T04:39:40.610345+0000 (oldest deadline 2024-08-31T04:40:04.110441+0000) 2024-08-31T04:40:07.046 INFO:journalctl@ceph.osd.7.smithi133.stdout:Aug 31 04:40:06 smithi133 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-7[40256]: 2024-08-31T04:40:06.586+0000 7fd8eda41640 -1 osd.7 83 heartbeat_check: no reply from 172.21.15.133:6804 osd.1 since back 2024-08-31T04:39:39.987526+0000 front 2024-08-31T04:39:39.987404+0000 (oldest deadline 2024-08-31T04:40:04.087555+0000) 2024-08-31T04:40:07.496 INFO:journalctl@ceph.osd.5.smithi177.stdout:Aug 31 04:40:07 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-5[33549]: 2024-08-31T04:40:07.017+0000 7f7b7e125640 -1 osd.5 83 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-08-31T04:39:32.463230+0000 front 2024-08-31T04:39:32.463262+0000 (oldest deadline 2024-08-31T04:39:57.063913+0000) 2024-08-31T04:40:07.496 INFO:journalctl@ceph.osd.5.smithi177.stdout:Aug 31 04:40:07 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-5[33549]: 2024-08-31T04:40:07.017+0000 7f7b7e125640 -1 osd.5 83 heartbeat_check: no reply from 172.21.15.133:6804 osd.1 since back 2024-08-31T04:39:40.564951+0000 front 2024-08-31T04:39:40.565089+0000 (oldest deadline 2024-08-31T04:40:04.065065+0000) 2024-08-31T04:40:07.496 INFO:journalctl@ceph.osd.11.smithi177.stdout:Aug 31 04:40:07 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-11[46864]: 2024-08-31T04:40:07.236+0000 7fd602bf1640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-08-31T04:39:30.036711+0000 front 2024-08-31T04:39:30.036747+0000 (oldest deadline 2024-08-31T04:39:55.936674+0000) 2024-08-31T04:40:07.497 INFO:journalctl@ceph.osd.11.smithi177.stdout:Aug 31 04:40:07 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-11[46864]: 2024-08-31T04:40:07.236+0000 7fd602bf1640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.133:6804 osd.1 since back 2024-08-31T04:39:41.138475+0000 front 2024-08-31T04:39:41.138491+0000 (oldest deadline 2024-08-31T04:40:04.038356+0000) 2024-08-31T04:40:07.543 INFO:journalctl@ceph.osd.10.smithi133.stdout:Aug 31 04:40:07 smithi133 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-10[46762]: 2024-08-31T04:40:07.101+0000 7f873f3e9640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-08-31T04:39:32.936397+0000 front 2024-08-31T04:39:32.936196+0000 (oldest deadline 2024-08-31T04:39:55.836336+0000) 2024-08-31T04:40:07.543 INFO:journalctl@ceph.osd.10.smithi133.stdout:Aug 31 04:40:07 smithi133 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-10[46762]: 2024-08-31T04:40:07.101+0000 7f873f3e9640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.133:6804 osd.1 since back 2024-08-31T04:39:40.537248+0000 front 2024-08-31T04:39:40.537370+0000 (oldest deadline 2024-08-31T04:40:06.437470+0000) 2024-08-31T04:40:07.700 INFO:journalctl@ceph.osd.9.smithi050.stdout:Aug 31 04:40:07 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-9[52806]: 2024-08-31T04:40:07.491+0000 7f30c0800640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-08-31T04:39:33.661151+0000 front 2024-08-31T04:39:33.661082+0000 (oldest deadline 2024-08-31T04:39:55.361248+0000) 2024-08-31T04:40:07.700 INFO:journalctl@ceph.osd.9.smithi050.stdout:Aug 31 04:40:07 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-9[52806]: 2024-08-31T04:40:07.491+0000 7f30c0800640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.133:6804 osd.1 since back 2024-08-31T04:39:41.262725+0000 front 2024-08-31T04:39:41.262699+0000 (oldest deadline 2024-08-31T04:40:05.362593+0000) 2024-08-31T04:40:07.700 INFO:journalctl@ceph.osd.6.smithi050.stdout:Aug 31 04:40:07 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-6[46267]: 2024-08-31T04:40:07.277+0000 7efc67a00640 -1 osd.6 83 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-08-31T04:39:30.285999+0000 front 2024-08-31T04:39:30.286080+0000 (oldest deadline 2024-08-31T04:39:56.186016+0000) 2024-08-31T04:40:07.701 INFO:journalctl@ceph.osd.6.smithi050.stdout:Aug 31 04:40:07 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-6[46267]: 2024-08-31T04:40:07.277+0000 7efc67a00640 -1 osd.6 83 heartbeat_check: no reply from 172.21.15.133:6804 osd.1 since back 2024-08-31T04:39:41.487497+0000 front 2024-08-31T04:39:41.487305+0000 (oldest deadline 2024-08-31T04:40:04.387393+0000) 2024-08-31T04:40:07.793 INFO:journalctl@ceph.osd.7.smithi133.stdout:Aug 31 04:40:07 smithi133 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-7[40256]: 2024-08-31T04:40:07.541+0000 7fd8eda41640 -1 osd.7 83 heartbeat_check: no reply from 172.21.15.133:6804 osd.1 since back 2024-08-31T04:39:39.987526+0000 front 2024-08-31T04:39:39.987404+0000 (oldest deadline 2024-08-31T04:40:04.087555+0000) 2024-08-31T04:40:07.793 INFO:journalctl@ceph.osd.4.smithi133.stdout:Aug 31 04:40:07 smithi133 podman[58303]: 2024-08-31 04:40:07.564272696 +0000 UTC m=+5.457691929 container died c0451ab107cf34191bf777ec9969768ec46b25ed046f4c6c3796ad56033f3a31 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-4, GIT_BRANCH=HEAD, io.buildah.version=1.37.1, org.label-schema.schema-version=1.0, ceph=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-08-31T04:40:07.996 INFO:journalctl@ceph.osd.8.smithi177.stdout:Aug 31 04:40:07 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-8[40333]: 2024-08-31T04:40:07.698+0000 7f244221a640 -1 osd.8 83 heartbeat_check: no reply from 172.21.15.133:6804 osd.1 since back 2024-08-31T04:39:41.888896+0000 front 2024-08-31T04:39:41.888953+0000 (oldest deadline 2024-08-31T04:40:03.588900+0000) 2024-08-31T04:40:08.220 INFO:journalctl@ceph.osd.4.smithi133.stdout:Aug 31 04:40:07 smithi133 podman[58303]: 2024-08-31 04:40:07.992744917 +0000 UTC m=+5.886164136 container cleanup c0451ab107cf34191bf777ec9969768ec46b25ed046f4c6c3796ad56033f3a31 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-4, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.license=GPLv2, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.1, maintainer=Guillaume Abrioux ) 2024-08-31T04:40:08.220 INFO:journalctl@ceph.osd.4.smithi133.stdout:Aug 31 04:40:07 smithi133 bash[58303]: ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-4 2024-08-31T04:40:08.220 INFO:journalctl@ceph.osd.10.smithi133.stdout:Aug 31 04:40:08 smithi133 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-10[46762]: 2024-08-31T04:40:08.106+0000 7f873f3e9640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-08-31T04:39:32.936397+0000 front 2024-08-31T04:39:32.936196+0000 (oldest deadline 2024-08-31T04:39:55.836336+0000) 2024-08-31T04:40:08.220 INFO:journalctl@ceph.osd.10.smithi133.stdout:Aug 31 04:40:08 smithi133 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-10[46762]: 2024-08-31T04:40:08.106+0000 7f873f3e9640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.133:6804 osd.1 since back 2024-08-31T04:39:40.537248+0000 front 2024-08-31T04:39:40.537370+0000 (oldest deadline 2024-08-31T04:40:06.437470+0000) 2024-08-31T04:40:08.261 INFO:journalctl@ceph.osd.5.smithi177.stdout:Aug 31 04:40:08 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-5[33549]: 2024-08-31T04:40:08.003+0000 7f7b7e125640 -1 osd.5 83 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-08-31T04:39:32.463230+0000 front 2024-08-31T04:39:32.463262+0000 (oldest deadline 2024-08-31T04:39:57.063913+0000) 2024-08-31T04:40:08.261 INFO:journalctl@ceph.osd.5.smithi177.stdout:Aug 31 04:40:08 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-5[33549]: 2024-08-31T04:40:08.003+0000 7f7b7e125640 -1 osd.5 83 heartbeat_check: no reply from 172.21.15.133:6804 osd.1 since back 2024-08-31T04:39:40.564951+0000 front 2024-08-31T04:39:40.565089+0000 (oldest deadline 2024-08-31T04:40:04.065065+0000) 2024-08-31T04:40:08.525 INFO:journalctl@ceph.osd.4.smithi133.stdout:Aug 31 04:40:08 smithi133 podman[58320]: 2024-08-31 04:40:08.219234956 +0000 UTC m=+0.650412628 container remove c0451ab107cf34191bf777ec9969768ec46b25ed046f4c6c3796ad56033f3a31 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-4, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, io.buildah.version=1.37.1, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2) 2024-08-31T04:40:08.700 INFO:journalctl@ceph.osd.6.smithi050.stdout:Aug 31 04:40:08 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-6[46267]: 2024-08-31T04:40:08.305+0000 7efc67a00640 -1 osd.6 83 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-08-31T04:39:30.285999+0000 front 2024-08-31T04:39:30.286080+0000 (oldest deadline 2024-08-31T04:39:56.186016+0000) 2024-08-31T04:40:08.700 INFO:journalctl@ceph.osd.6.smithi050.stdout:Aug 31 04:40:08 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-6[46267]: 2024-08-31T04:40:08.305+0000 7efc67a00640 -1 osd.6 83 heartbeat_check: no reply from 172.21.15.133:6804 osd.1 since back 2024-08-31T04:39:41.487497+0000 front 2024-08-31T04:39:41.487305+0000 (oldest deadline 2024-08-31T04:40:04.387393+0000) 2024-08-31T04:40:08.700 INFO:journalctl@ceph.osd.9.smithi050.stdout:Aug 31 04:40:08 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-9[52806]: 2024-08-31T04:40:08.492+0000 7f30c0800640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-08-31T04:39:33.661151+0000 front 2024-08-31T04:39:33.661082+0000 (oldest deadline 2024-08-31T04:39:55.361248+0000) 2024-08-31T04:40:08.700 INFO:journalctl@ceph.osd.9.smithi050.stdout:Aug 31 04:40:08 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-9[52806]: 2024-08-31T04:40:08.492+0000 7f30c0800640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.133:6804 osd.1 since back 2024-08-31T04:39:41.262725+0000 front 2024-08-31T04:39:41.262699+0000 (oldest deadline 2024-08-31T04:40:05.362593+0000) 2024-08-31T04:40:08.703 INFO:journalctl@ceph.osd.11.smithi177.stdout:Aug 31 04:40:08 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-11[46864]: 2024-08-31T04:40:08.259+0000 7fd602bf1640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-08-31T04:39:30.036711+0000 front 2024-08-31T04:39:30.036747+0000 (oldest deadline 2024-08-31T04:39:55.936674+0000) 2024-08-31T04:40:08.703 INFO:journalctl@ceph.osd.11.smithi177.stdout:Aug 31 04:40:08 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-11[46864]: 2024-08-31T04:40:08.259+0000 7fd602bf1640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.133:6804 osd.1 since back 2024-08-31T04:39:41.138475+0000 front 2024-08-31T04:39:41.138491+0000 (oldest deadline 2024-08-31T04:40:04.038356+0000) 2024-08-31T04:40:08.793 INFO:journalctl@ceph.osd.4.smithi133.stdout:Aug 31 04:40:08 smithi133 podman[58411]: 2024-08-31 04:40:08.653282586 +0000 UTC m=+0.112631298 container create 4558e267e93b8fec9c2c34c08c3a9f14beed2ca5cdbd483e6d4b90515d209730 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-4-deactivate, GIT_CLEAN=True, org.label-schema.license=GPLv2, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.1, maintainer=Guillaume Abrioux , ceph=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731) 2024-08-31T04:40:08.793 INFO:journalctl@ceph.osd.4.smithi133.stdout:Aug 31 04:40:08 smithi133 podman[58411]: 2024-08-31 04:40:08.556345336 +0000 UTC m=+0.015694059 image pull 79f4cde5e36911a5dca995eeb98098c2c8aae81dd52a088ef2c867bc3363bad0 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61 2024-08-31T04:40:08.793 INFO:journalctl@ceph.osd.7.smithi133.stdout:Aug 31 04:40:08 smithi133 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-7[40256]: 2024-08-31T04:40:08.523+0000 7fd8eda41640 -1 osd.7 83 heartbeat_check: no reply from 172.21.15.133:6804 osd.1 since back 2024-08-31T04:39:39.987526+0000 front 2024-08-31T04:39:39.987404+0000 (oldest deadline 2024-08-31T04:40:04.087555+0000) 2024-08-31T04:40:08.982 INFO:journalctl@ceph.osd.8.smithi177.stdout:Aug 31 04:40:08 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-8[40333]: 2024-08-31T04:40:08.702+0000 7f244221a640 -1 osd.8 83 heartbeat_check: no reply from 172.21.15.133:6804 osd.1 since back 2024-08-31T04:39:41.888896+0000 front 2024-08-31T04:39:41.888953+0000 (oldest deadline 2024-08-31T04:40:03.588900+0000) 2024-08-31T04:40:09.246 INFO:journalctl@ceph.osd.5.smithi177.stdout:Aug 31 04:40:08 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-5[33549]: 2024-08-31T04:40:08.981+0000 7f7b7e125640 -1 osd.5 83 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-08-31T04:39:32.463230+0000 front 2024-08-31T04:39:32.463262+0000 (oldest deadline 2024-08-31T04:39:57.063913+0000) 2024-08-31T04:40:09.246 INFO:journalctl@ceph.osd.5.smithi177.stdout:Aug 31 04:40:08 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-5[33549]: 2024-08-31T04:40:08.981+0000 7f7b7e125640 -1 osd.5 83 heartbeat_check: no reply from 172.21.15.133:6804 osd.1 since back 2024-08-31T04:39:40.564951+0000 front 2024-08-31T04:39:40.565089+0000 (oldest deadline 2024-08-31T04:40:04.065065+0000) 2024-08-31T04:40:09.293 INFO:journalctl@ceph.osd.10.smithi133.stdout:Aug 31 04:40:09 smithi133 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-10[46762]: 2024-08-31T04:40:09.090+0000 7f873f3e9640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-08-31T04:39:32.936397+0000 front 2024-08-31T04:39:32.936196+0000 (oldest deadline 2024-08-31T04:39:55.836336+0000) 2024-08-31T04:40:09.293 INFO:journalctl@ceph.osd.10.smithi133.stdout:Aug 31 04:40:09 smithi133 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-10[46762]: 2024-08-31T04:40:09.090+0000 7f873f3e9640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.133:6804 osd.1 since back 2024-08-31T04:39:40.537248+0000 front 2024-08-31T04:39:40.537370+0000 (oldest deadline 2024-08-31T04:40:06.437470+0000) 2024-08-31T04:40:09.293 INFO:journalctl@ceph.osd.4.smithi133.stdout:Aug 31 04:40:08 smithi133 podman[58411]: 2024-08-31 04:40:08.897638721 +0000 UTC m=+0.356987433 container init 4558e267e93b8fec9c2c34c08c3a9f14beed2ca5cdbd483e6d4b90515d209730 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-4-deactivate, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, io.buildah.version=1.37.1, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD) 2024-08-31T04:40:09.293 INFO:journalctl@ceph.osd.4.smithi133.stdout:Aug 31 04:40:08 smithi133 podman[58411]: 2024-08-31 04:40:08.901158754 +0000 UTC m=+0.360507469 container start 4558e267e93b8fec9c2c34c08c3a9f14beed2ca5cdbd483e6d4b90515d209730 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-4-deactivate, io.buildah.version=1.37.1, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, ceph=True, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611) 2024-08-31T04:40:09.294 INFO:journalctl@ceph.osd.4.smithi133.stdout:Aug 31 04:40:08 smithi133 podman[58411]: 2024-08-31 04:40:08.981045928 +0000 UTC m=+0.440394651 container attach 4558e267e93b8fec9c2c34c08c3a9f14beed2ca5cdbd483e6d4b90515d209730 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-4-deactivate, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, io.buildah.version=1.37.1, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.vendor=CentOS) 2024-08-31T04:40:09.294 INFO:journalctl@ceph.osd.4.smithi133.stdout:Aug 31 04:40:09 smithi133 podman[58411]: 2024-08-31 04:40:09.093648718 +0000 UTC m=+0.552997431 container died 4558e267e93b8fec9c2c34c08c3a9f14beed2ca5cdbd483e6d4b90515d209730 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-4-deactivate, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, ceph=True, io.buildah.version=1.37.1, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=) 2024-08-31T04:40:09.694 INFO:journalctl@ceph.osd.7.smithi133.stdout:Aug 31 04:40:09 smithi133 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-7[40256]: 2024-08-31T04:40:09.513+0000 7fd8eda41640 -1 osd.7 83 heartbeat_check: no reply from 172.21.15.133:6804 osd.1 since back 2024-08-31T04:39:39.987526+0000 front 2024-08-31T04:39:39.987404+0000 (oldest deadline 2024-08-31T04:40:04.087555+0000) 2024-08-31T04:40:09.700 INFO:journalctl@ceph.osd.6.smithi050.stdout:Aug 31 04:40:09 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-6[46267]: 2024-08-31T04:40:09.315+0000 7efc67a00640 -1 osd.6 83 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-08-31T04:39:30.285999+0000 front 2024-08-31T04:39:30.286080+0000 (oldest deadline 2024-08-31T04:39:56.186016+0000) 2024-08-31T04:40:09.700 INFO:journalctl@ceph.osd.6.smithi050.stdout:Aug 31 04:40:09 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-6[46267]: 2024-08-31T04:40:09.315+0000 7efc67a00640 -1 osd.6 83 heartbeat_check: no reply from 172.21.15.133:6804 osd.1 since back 2024-08-31T04:39:41.487497+0000 front 2024-08-31T04:39:41.487305+0000 (oldest deadline 2024-08-31T04:40:04.387393+0000) 2024-08-31T04:40:09.700 INFO:journalctl@ceph.osd.9.smithi050.stdout:Aug 31 04:40:09 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-9[52806]: 2024-08-31T04:40:09.504+0000 7f30c0800640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-08-31T04:39:33.661151+0000 front 2024-08-31T04:39:33.661082+0000 (oldest deadline 2024-08-31T04:39:55.361248+0000) 2024-08-31T04:40:09.700 INFO:journalctl@ceph.osd.9.smithi050.stdout:Aug 31 04:40:09 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-9[52806]: 2024-08-31T04:40:09.504+0000 7f30c0800640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.133:6804 osd.1 since back 2024-08-31T04:39:41.262725+0000 front 2024-08-31T04:39:41.262699+0000 (oldest deadline 2024-08-31T04:40:05.362593+0000) 2024-08-31T04:40:09.711 DEBUG:teuthology.orchestra.run.smithi133:> sudo pkill -f 'journalctl -f -n 0 -u ceph-058d9fc6-674f-11ef-bcd4-c7b262605968@osd.4.service' 2024-08-31T04:40:09.746 INFO:journalctl@ceph.osd.11.smithi177.stdout:Aug 31 04:40:09 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-11[46864]: 2024-08-31T04:40:09.302+0000 7fd602bf1640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-08-31T04:39:30.036711+0000 front 2024-08-31T04:39:30.036747+0000 (oldest deadline 2024-08-31T04:39:55.936674+0000) 2024-08-31T04:40:09.746 INFO:journalctl@ceph.osd.11.smithi177.stdout:Aug 31 04:40:09 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-11[46864]: 2024-08-31T04:40:09.302+0000 7fd602bf1640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.133:6804 osd.1 since back 2024-08-31T04:39:41.138475+0000 front 2024-08-31T04:39:41.138491+0000 (oldest deadline 2024-08-31T04:40:04.038356+0000) 2024-08-31T04:40:09.751 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-31T04:40:09.751 INFO:tasks.cephadm.osd.4:Stopped osd.4 2024-08-31T04:40:09.752 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2024-08-31T04:40:09.752 DEBUG:teuthology.orchestra.run.smithi177:> sudo systemctl stop ceph-058d9fc6-674f-11ef-bcd4-c7b262605968@osd.5 2024-08-31T04:40:10.065 INFO:journalctl@ceph.osd.8.smithi177.stdout:Aug 31 04:40:09 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-8[40333]: 2024-08-31T04:40:09.745+0000 7f244221a640 -1 osd.8 83 heartbeat_check: no reply from 172.21.15.133:6804 osd.1 since back 2024-08-31T04:39:41.888896+0000 front 2024-08-31T04:39:41.888953+0000 (oldest deadline 2024-08-31T04:40:03.588900+0000) 2024-08-31T04:40:10.065 INFO:journalctl@ceph.osd.5.smithi177.stdout:Aug 31 04:40:09 smithi177 systemd[1]: Stopping Ceph osd.5 for 058d9fc6-674f-11ef-bcd4-c7b262605968... 2024-08-31T04:40:10.065 INFO:journalctl@ceph.osd.5.smithi177.stdout:Aug 31 04:40:09 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-5[33549]: 2024-08-31T04:40:09.942+0000 7f7b7e125640 -1 osd.5 83 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-08-31T04:39:32.463230+0000 front 2024-08-31T04:39:32.463262+0000 (oldest deadline 2024-08-31T04:39:57.063913+0000) 2024-08-31T04:40:10.065 INFO:journalctl@ceph.osd.5.smithi177.stdout:Aug 31 04:40:09 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-5[33549]: 2024-08-31T04:40:09.942+0000 7f7b7e125640 -1 osd.5 83 heartbeat_check: no reply from 172.21.15.133:6804 osd.1 since back 2024-08-31T04:39:40.564951+0000 front 2024-08-31T04:39:40.565089+0000 (oldest deadline 2024-08-31T04:40:04.065065+0000) 2024-08-31T04:40:10.065 INFO:journalctl@ceph.osd.5.smithi177.stdout:Aug 31 04:40:10 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-5[33549]: 2024-08-31T04:40:10.063+0000 7f7b81b3a640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-31T04:40:10.345 INFO:journalctl@ceph.osd.5.smithi177.stdout:Aug 31 04:40:10 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-5[33549]: 2024-08-31T04:40:10.063+0000 7f7b81b3a640 -1 osd.5 83 *** Got signal Terminated *** 2024-08-31T04:40:10.345 INFO:journalctl@ceph.osd.5.smithi177.stdout:Aug 31 04:40:10 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-5[33549]: 2024-08-31T04:40:10.063+0000 7f7b81b3a640 -1 osd.5 83 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-08-31T04:40:10.543 INFO:journalctl@ceph.osd.10.smithi133.stdout:Aug 31 04:40:10 smithi133 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-10[46762]: 2024-08-31T04:40:10.083+0000 7f873f3e9640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-08-31T04:39:32.936397+0000 front 2024-08-31T04:39:32.936196+0000 (oldest deadline 2024-08-31T04:39:55.836336+0000) 2024-08-31T04:40:10.543 INFO:journalctl@ceph.osd.10.smithi133.stdout:Aug 31 04:40:10 smithi133 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-10[46762]: 2024-08-31T04:40:10.083+0000 7f873f3e9640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.133:6804 osd.1 since back 2024-08-31T04:39:40.537248+0000 front 2024-08-31T04:39:40.537370+0000 (oldest deadline 2024-08-31T04:40:06.437470+0000) 2024-08-31T04:40:10.700 INFO:journalctl@ceph.osd.6.smithi050.stdout:Aug 31 04:40:10 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-6[46267]: 2024-08-31T04:40:10.294+0000 7efc67a00640 -1 osd.6 83 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-08-31T04:39:30.285999+0000 front 2024-08-31T04:39:30.286080+0000 (oldest deadline 2024-08-31T04:39:56.186016+0000) 2024-08-31T04:40:10.700 INFO:journalctl@ceph.osd.6.smithi050.stdout:Aug 31 04:40:10 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-6[46267]: 2024-08-31T04:40:10.294+0000 7efc67a00640 -1 osd.6 83 heartbeat_check: no reply from 172.21.15.133:6804 osd.1 since back 2024-08-31T04:39:41.487497+0000 front 2024-08-31T04:39:41.487305+0000 (oldest deadline 2024-08-31T04:40:04.387393+0000) 2024-08-31T04:40:10.701 INFO:journalctl@ceph.osd.9.smithi050.stdout:Aug 31 04:40:10 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-9[52806]: 2024-08-31T04:40:10.489+0000 7f30c0800640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-08-31T04:39:33.661151+0000 front 2024-08-31T04:39:33.661082+0000 (oldest deadline 2024-08-31T04:39:55.361248+0000) 2024-08-31T04:40:10.701 INFO:journalctl@ceph.osd.9.smithi050.stdout:Aug 31 04:40:10 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-9[52806]: 2024-08-31T04:40:10.489+0000 7f30c0800640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.133:6804 osd.1 since back 2024-08-31T04:39:41.262725+0000 front 2024-08-31T04:39:41.262699+0000 (oldest deadline 2024-08-31T04:40:05.362593+0000) 2024-08-31T04:40:10.704 INFO:journalctl@ceph.osd.11.smithi177.stdout:Aug 31 04:40:10 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-11[46864]: 2024-08-31T04:40:10.344+0000 7fd602bf1640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-08-31T04:39:30.036711+0000 front 2024-08-31T04:39:30.036747+0000 (oldest deadline 2024-08-31T04:39:55.936674+0000) 2024-08-31T04:40:10.704 INFO:journalctl@ceph.osd.11.smithi177.stdout:Aug 31 04:40:10 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-11[46864]: 2024-08-31T04:40:10.344+0000 7fd602bf1640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.133:6804 osd.1 since back 2024-08-31T04:39:41.138475+0000 front 2024-08-31T04:39:41.138491+0000 (oldest deadline 2024-08-31T04:40:04.038356+0000) 2024-08-31T04:40:10.979 INFO:journalctl@ceph.osd.8.smithi177.stdout:Aug 31 04:40:10 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-8[40333]: 2024-08-31T04:40:10.702+0000 7f244221a640 -1 osd.8 83 heartbeat_check: no reply from 172.21.15.133:6804 osd.1 since back 2024-08-31T04:39:41.888896+0000 front 2024-08-31T04:39:41.888953+0000 (oldest deadline 2024-08-31T04:40:03.588900+0000) 2024-08-31T04:40:11.043 INFO:journalctl@ceph.osd.7.smithi133.stdout:Aug 31 04:40:10 smithi133 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-7[40256]: 2024-08-31T04:40:10.560+0000 7fd8eda41640 -1 osd.7 83 heartbeat_check: no reply from 172.21.15.133:6804 osd.1 since back 2024-08-31T04:39:39.987526+0000 front 2024-08-31T04:39:39.987404+0000 (oldest deadline 2024-08-31T04:40:04.087555+0000) 2024-08-31T04:40:11.246 INFO:journalctl@ceph.osd.5.smithi177.stdout:Aug 31 04:40:10 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-5[33549]: 2024-08-31T04:40:10.978+0000 7f7b7e125640 -1 osd.5 83 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-08-31T04:39:32.463230+0000 front 2024-08-31T04:39:32.463262+0000 (oldest deadline 2024-08-31T04:39:57.063913+0000) 2024-08-31T04:40:11.246 INFO:journalctl@ceph.osd.5.smithi177.stdout:Aug 31 04:40:10 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-5[33549]: 2024-08-31T04:40:10.978+0000 7f7b7e125640 -1 osd.5 83 heartbeat_check: no reply from 172.21.15.133:6804 osd.1 since back 2024-08-31T04:39:40.564951+0000 front 2024-08-31T04:39:40.565089+0000 (oldest deadline 2024-08-31T04:40:04.065065+0000) 2024-08-31T04:40:11.543 INFO:journalctl@ceph.osd.10.smithi133.stdout:Aug 31 04:40:11 smithi133 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-10[46762]: 2024-08-31T04:40:11.110+0000 7f873f3e9640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-08-31T04:39:32.936397+0000 front 2024-08-31T04:39:32.936196+0000 (oldest deadline 2024-08-31T04:39:55.836336+0000) 2024-08-31T04:40:11.543 INFO:journalctl@ceph.osd.10.smithi133.stdout:Aug 31 04:40:11 smithi133 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-10[46762]: 2024-08-31T04:40:11.110+0000 7f873f3e9640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.133:6804 osd.1 since back 2024-08-31T04:39:40.537248+0000 front 2024-08-31T04:39:40.537370+0000 (oldest deadline 2024-08-31T04:40:06.437470+0000) 2024-08-31T04:40:11.697 INFO:journalctl@ceph.osd.11.smithi177.stdout:Aug 31 04:40:11 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-11[46864]: 2024-08-31T04:40:11.300+0000 7fd602bf1640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-08-31T04:39:30.036711+0000 front 2024-08-31T04:39:30.036747+0000 (oldest deadline 2024-08-31T04:39:55.936674+0000) 2024-08-31T04:40:11.697 INFO:journalctl@ceph.osd.11.smithi177.stdout:Aug 31 04:40:11 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-11[46864]: 2024-08-31T04:40:11.300+0000 7fd602bf1640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.133:6804 osd.1 since back 2024-08-31T04:39:41.138475+0000 front 2024-08-31T04:39:41.138491+0000 (oldest deadline 2024-08-31T04:40:04.038356+0000) 2024-08-31T04:40:11.700 INFO:journalctl@ceph.osd.6.smithi050.stdout:Aug 31 04:40:11 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-6[46267]: 2024-08-31T04:40:11.281+0000 7efc67a00640 -1 osd.6 83 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-08-31T04:39:30.285999+0000 front 2024-08-31T04:39:30.286080+0000 (oldest deadline 2024-08-31T04:39:56.186016+0000) 2024-08-31T04:40:11.700 INFO:journalctl@ceph.osd.6.smithi050.stdout:Aug 31 04:40:11 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-6[46267]: 2024-08-31T04:40:11.281+0000 7efc67a00640 -1 osd.6 83 heartbeat_check: no reply from 172.21.15.133:6804 osd.1 since back 2024-08-31T04:39:41.487497+0000 front 2024-08-31T04:39:41.487305+0000 (oldest deadline 2024-08-31T04:40:04.387393+0000) 2024-08-31T04:40:11.700 INFO:journalctl@ceph.osd.9.smithi050.stdout:Aug 31 04:40:11 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-9[52806]: 2024-08-31T04:40:11.454+0000 7f30c0800640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-08-31T04:39:33.661151+0000 front 2024-08-31T04:39:33.661082+0000 (oldest deadline 2024-08-31T04:39:55.361248+0000) 2024-08-31T04:40:11.700 INFO:journalctl@ceph.osd.9.smithi050.stdout:Aug 31 04:40:11 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-9[52806]: 2024-08-31T04:40:11.454+0000 7f30c0800640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.133:6804 osd.1 since back 2024-08-31T04:39:41.262725+0000 front 2024-08-31T04:39:41.262699+0000 (oldest deadline 2024-08-31T04:40:05.362593+0000) 2024-08-31T04:40:11.996 INFO:journalctl@ceph.osd.8.smithi177.stdout:Aug 31 04:40:11 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-8[40333]: 2024-08-31T04:40:11.695+0000 7f244221a640 -1 osd.8 83 heartbeat_check: no reply from 172.21.15.133:6804 osd.1 since back 2024-08-31T04:39:41.888896+0000 front 2024-08-31T04:39:41.888953+0000 (oldest deadline 2024-08-31T04:40:03.588900+0000) 2024-08-31T04:40:11.996 INFO:journalctl@ceph.osd.5.smithi177.stdout:Aug 31 04:40:11 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-5[33549]: 2024-08-31T04:40:11.945+0000 7f7b7e125640 -1 osd.5 83 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-08-31T04:39:32.463230+0000 front 2024-08-31T04:39:32.463262+0000 (oldest deadline 2024-08-31T04:39:57.063913+0000) 2024-08-31T04:40:11.996 INFO:journalctl@ceph.osd.5.smithi177.stdout:Aug 31 04:40:11 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-5[33549]: 2024-08-31T04:40:11.945+0000 7f7b7e125640 -1 osd.5 83 heartbeat_check: no reply from 172.21.15.133:6804 osd.1 since back 2024-08-31T04:39:40.564951+0000 front 2024-08-31T04:39:40.565089+0000 (oldest deadline 2024-08-31T04:40:04.065065+0000) 2024-08-31T04:40:12.042 INFO:journalctl@ceph.osd.7.smithi133.stdout:Aug 31 04:40:11 smithi133 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-7[40256]: 2024-08-31T04:40:11.566+0000 7fd8eda41640 -1 osd.7 83 heartbeat_check: no reply from 172.21.15.133:6804 osd.1 since back 2024-08-31T04:39:39.987526+0000 front 2024-08-31T04:39:39.987404+0000 (oldest deadline 2024-08-31T04:40:04.087555+0000) 2024-08-31T04:40:12.491 INFO:journalctl@ceph.osd.6.smithi050.stdout:Aug 31 04:40:12 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-6[46267]: 2024-08-31T04:40:12.236+0000 7efc67a00640 -1 osd.6 83 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-08-31T04:39:30.285999+0000 front 2024-08-31T04:39:30.286080+0000 (oldest deadline 2024-08-31T04:39:56.186016+0000) 2024-08-31T04:40:12.491 INFO:journalctl@ceph.osd.6.smithi050.stdout:Aug 31 04:40:12 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-6[46267]: 2024-08-31T04:40:12.236+0000 7efc67a00640 -1 osd.6 83 heartbeat_check: no reply from 172.21.15.133:6804 osd.1 since back 2024-08-31T04:39:41.487497+0000 front 2024-08-31T04:39:41.487305+0000 (oldest deadline 2024-08-31T04:40:04.387393+0000) 2024-08-31T04:40:12.543 INFO:journalctl@ceph.osd.10.smithi133.stdout:Aug 31 04:40:12 smithi133 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-10[46762]: 2024-08-31T04:40:12.071+0000 7f873f3e9640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-08-31T04:39:32.936397+0000 front 2024-08-31T04:39:32.936196+0000 (oldest deadline 2024-08-31T04:39:55.836336+0000) 2024-08-31T04:40:12.543 INFO:journalctl@ceph.osd.10.smithi133.stdout:Aug 31 04:40:12 smithi133 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-10[46762]: 2024-08-31T04:40:12.071+0000 7f873f3e9640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.133:6804 osd.1 since back 2024-08-31T04:39:40.537248+0000 front 2024-08-31T04:39:40.537370+0000 (oldest deadline 2024-08-31T04:40:06.437470+0000) 2024-08-31T04:40:12.543 INFO:journalctl@ceph.osd.10.smithi133.stdout:Aug 31 04:40:12 smithi133 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-10[46762]: 2024-08-31T04:40:12.071+0000 7f873f3e9640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-08-31T04:39:50.438807+0000 front 2024-08-31T04:39:50.438655+0000 (oldest deadline 2024-08-31T04:40:11.538621+0000) 2024-08-31T04:40:12.716 INFO:journalctl@ceph.osd.11.smithi177.stdout:Aug 31 04:40:12 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-11[46864]: 2024-08-31T04:40:12.296+0000 7fd602bf1640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-08-31T04:39:30.036711+0000 front 2024-08-31T04:39:30.036747+0000 (oldest deadline 2024-08-31T04:39:55.936674+0000) 2024-08-31T04:40:12.716 INFO:journalctl@ceph.osd.11.smithi177.stdout:Aug 31 04:40:12 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-11[46864]: 2024-08-31T04:40:12.296+0000 7fd602bf1640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.133:6804 osd.1 since back 2024-08-31T04:39:41.138475+0000 front 2024-08-31T04:39:41.138491+0000 (oldest deadline 2024-08-31T04:40:04.038356+0000) 2024-08-31T04:40:12.716 INFO:journalctl@ceph.osd.11.smithi177.stdout:Aug 31 04:40:12 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-11[46864]: 2024-08-31T04:40:12.296+0000 7fd602bf1640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-08-31T04:39:46.939525+0000 front 2024-08-31T04:39:46.939251+0000 (oldest deadline 2024-08-31T04:40:12.239391+0000) 2024-08-31T04:40:12.950 INFO:journalctl@ceph.osd.9.smithi050.stdout:Aug 31 04:40:12 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-9[52806]: 2024-08-31T04:40:12.489+0000 7f30c0800640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-08-31T04:39:33.661151+0000 front 2024-08-31T04:39:33.661082+0000 (oldest deadline 2024-08-31T04:39:55.361248+0000) 2024-08-31T04:40:12.950 INFO:journalctl@ceph.osd.9.smithi050.stdout:Aug 31 04:40:12 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-9[52806]: 2024-08-31T04:40:12.489+0000 7f30c0800640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.133:6804 osd.1 since back 2024-08-31T04:39:41.262725+0000 front 2024-08-31T04:39:41.262699+0000 (oldest deadline 2024-08-31T04:40:05.362593+0000) 2024-08-31T04:40:12.996 INFO:journalctl@ceph.osd.8.smithi177.stdout:Aug 31 04:40:12 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-8[40333]: 2024-08-31T04:40:12.715+0000 7f244221a640 -1 osd.8 83 heartbeat_check: no reply from 172.21.15.133:6804 osd.1 since back 2024-08-31T04:39:41.888896+0000 front 2024-08-31T04:39:41.888953+0000 (oldest deadline 2024-08-31T04:40:03.588900+0000) 2024-08-31T04:40:12.996 INFO:journalctl@ceph.osd.5.smithi177.stdout:Aug 31 04:40:12 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-5[33549]: 2024-08-31T04:40:12.920+0000 7f7b7e125640 -1 osd.5 83 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-08-31T04:39:32.463230+0000 front 2024-08-31T04:39:32.463262+0000 (oldest deadline 2024-08-31T04:39:57.063913+0000) 2024-08-31T04:40:12.996 INFO:journalctl@ceph.osd.5.smithi177.stdout:Aug 31 04:40:12 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-5[33549]: 2024-08-31T04:40:12.920+0000 7f7b7e125640 -1 osd.5 83 heartbeat_check: no reply from 172.21.15.133:6804 osd.1 since back 2024-08-31T04:39:40.564951+0000 front 2024-08-31T04:39:40.565089+0000 (oldest deadline 2024-08-31T04:40:04.065065+0000) 2024-08-31T04:40:13.043 INFO:journalctl@ceph.osd.7.smithi133.stdout:Aug 31 04:40:12 smithi133 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-7[40256]: 2024-08-31T04:40:12.548+0000 7fd8eda41640 -1 osd.7 83 heartbeat_check: no reply from 172.21.15.133:6804 osd.1 since back 2024-08-31T04:39:39.987526+0000 front 2024-08-31T04:39:39.987404+0000 (oldest deadline 2024-08-31T04:40:04.087555+0000) 2024-08-31T04:40:13.517 INFO:journalctl@ceph.osd.6.smithi050.stdout:Aug 31 04:40:13 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-6[46267]: 2024-08-31T04:40:13.249+0000 7efc67a00640 -1 osd.6 83 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-08-31T04:39:30.285999+0000 front 2024-08-31T04:39:30.286080+0000 (oldest deadline 2024-08-31T04:39:56.186016+0000) 2024-08-31T04:40:13.517 INFO:journalctl@ceph.osd.6.smithi050.stdout:Aug 31 04:40:13 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-6[46267]: 2024-08-31T04:40:13.249+0000 7efc67a00640 -1 osd.6 83 heartbeat_check: no reply from 172.21.15.133:6804 osd.1 since back 2024-08-31T04:39:41.487497+0000 front 2024-08-31T04:39:41.487305+0000 (oldest deadline 2024-08-31T04:40:04.387393+0000) 2024-08-31T04:40:13.543 INFO:journalctl@ceph.osd.10.smithi133.stdout:Aug 31 04:40:13 smithi133 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-10[46762]: 2024-08-31T04:40:13.107+0000 7f873f3e9640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-08-31T04:39:32.936397+0000 front 2024-08-31T04:39:32.936196+0000 (oldest deadline 2024-08-31T04:39:55.836336+0000) 2024-08-31T04:40:13.543 INFO:journalctl@ceph.osd.10.smithi133.stdout:Aug 31 04:40:13 smithi133 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-10[46762]: 2024-08-31T04:40:13.107+0000 7f873f3e9640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.133:6804 osd.1 since back 2024-08-31T04:39:40.537248+0000 front 2024-08-31T04:39:40.537370+0000 (oldest deadline 2024-08-31T04:40:06.437470+0000) 2024-08-31T04:40:13.543 INFO:journalctl@ceph.osd.10.smithi133.stdout:Aug 31 04:40:13 smithi133 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-10[46762]: 2024-08-31T04:40:13.107+0000 7f873f3e9640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-08-31T04:39:50.438807+0000 front 2024-08-31T04:39:50.438655+0000 (oldest deadline 2024-08-31T04:40:11.538621+0000) 2024-08-31T04:40:13.746 INFO:journalctl@ceph.osd.11.smithi177.stdout:Aug 31 04:40:13 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-11[46864]: 2024-08-31T04:40:13.337+0000 7fd602bf1640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-08-31T04:39:30.036711+0000 front 2024-08-31T04:39:30.036747+0000 (oldest deadline 2024-08-31T04:39:55.936674+0000) 2024-08-31T04:40:13.746 INFO:journalctl@ceph.osd.11.smithi177.stdout:Aug 31 04:40:13 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-11[46864]: 2024-08-31T04:40:13.337+0000 7fd602bf1640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.133:6804 osd.1 since back 2024-08-31T04:39:41.138475+0000 front 2024-08-31T04:39:41.138491+0000 (oldest deadline 2024-08-31T04:40:04.038356+0000) 2024-08-31T04:40:13.746 INFO:journalctl@ceph.osd.11.smithi177.stdout:Aug 31 04:40:13 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-11[46864]: 2024-08-31T04:40:13.337+0000 7fd602bf1640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-08-31T04:39:46.939525+0000 front 2024-08-31T04:39:46.939251+0000 (oldest deadline 2024-08-31T04:40:12.239391+0000) 2024-08-31T04:40:13.950 INFO:journalctl@ceph.osd.9.smithi050.stdout:Aug 31 04:40:13 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-9[52806]: 2024-08-31T04:40:13.515+0000 7f30c0800640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-08-31T04:39:33.661151+0000 front 2024-08-31T04:39:33.661082+0000 (oldest deadline 2024-08-31T04:39:55.361248+0000) 2024-08-31T04:40:13.950 INFO:journalctl@ceph.osd.9.smithi050.stdout:Aug 31 04:40:13 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-9[52806]: 2024-08-31T04:40:13.515+0000 7f30c0800640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.133:6804 osd.1 since back 2024-08-31T04:39:41.262725+0000 front 2024-08-31T04:39:41.262699+0000 (oldest deadline 2024-08-31T04:40:05.362593+0000) 2024-08-31T04:40:14.043 INFO:journalctl@ceph.osd.7.smithi133.stdout:Aug 31 04:40:13 smithi133 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-7[40256]: 2024-08-31T04:40:13.586+0000 7fd8eda41640 -1 osd.7 83 heartbeat_check: no reply from 172.21.15.133:6804 osd.1 since back 2024-08-31T04:39:39.987526+0000 front 2024-08-31T04:39:39.987404+0000 (oldest deadline 2024-08-31T04:40:04.087555+0000) 2024-08-31T04:40:14.043 INFO:journalctl@ceph.osd.7.smithi133.stdout:Aug 31 04:40:13 smithi133 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-7[40256]: 2024-08-31T04:40:13.586+0000 7fd8eda41640 -1 osd.7 83 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-08-31T04:39:47.588581+0000 front 2024-08-31T04:39:47.588740+0000 (oldest deadline 2024-08-31T04:40:13.488665+0000) 2024-08-31T04:40:14.246 INFO:journalctl@ceph.osd.8.smithi177.stdout:Aug 31 04:40:13 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-8[40333]: 2024-08-31T04:40:13.747+0000 7f244221a640 -1 osd.8 83 heartbeat_check: no reply from 172.21.15.133:6804 osd.1 since back 2024-08-31T04:39:41.888896+0000 front 2024-08-31T04:39:41.888953+0000 (oldest deadline 2024-08-31T04:40:03.588900+0000) 2024-08-31T04:40:14.246 INFO:journalctl@ceph.osd.8.smithi177.stdout:Aug 31 04:40:13 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-8[40333]: 2024-08-31T04:40:13.747+0000 7f244221a640 -1 osd.8 83 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-08-31T04:39:48.790419+0000 front 2024-08-31T04:39:48.790532+0000 (oldest deadline 2024-08-31T04:40:12.890634+0000) 2024-08-31T04:40:14.246 INFO:journalctl@ceph.osd.5.smithi177.stdout:Aug 31 04:40:13 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-5[33549]: 2024-08-31T04:40:13.959+0000 7f7b7e125640 -1 osd.5 83 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-08-31T04:39:32.463230+0000 front 2024-08-31T04:39:32.463262+0000 (oldest deadline 2024-08-31T04:39:57.063913+0000) 2024-08-31T04:40:14.247 INFO:journalctl@ceph.osd.5.smithi177.stdout:Aug 31 04:40:13 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-5[33549]: 2024-08-31T04:40:13.959+0000 7f7b7e125640 -1 osd.5 83 heartbeat_check: no reply from 172.21.15.133:6804 osd.1 since back 2024-08-31T04:39:40.564951+0000 front 2024-08-31T04:39:40.565089+0000 (oldest deadline 2024-08-31T04:40:04.065065+0000) 2024-08-31T04:40:14.247 INFO:journalctl@ceph.osd.5.smithi177.stdout:Aug 31 04:40:13 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-5[33549]: 2024-08-31T04:40:13.959+0000 7f7b7e125640 -1 osd.5 83 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-08-31T04:39:49.866624+0000 front 2024-08-31T04:39:49.866604+0000 (oldest deadline 2024-08-31T04:40:13.366812+0000) 2024-08-31T04:40:14.312 INFO:journalctl@ceph.osd.10.smithi133.stdout:Aug 31 04:40:14 smithi133 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-10[46762]: 2024-08-31T04:40:14.124+0000 7f873f3e9640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-08-31T04:39:32.936397+0000 front 2024-08-31T04:39:32.936196+0000 (oldest deadline 2024-08-31T04:39:55.836336+0000) 2024-08-31T04:40:14.313 INFO:journalctl@ceph.osd.10.smithi133.stdout:Aug 31 04:40:14 smithi133 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-10[46762]: 2024-08-31T04:40:14.124+0000 7f873f3e9640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.133:6804 osd.1 since back 2024-08-31T04:39:40.537248+0000 front 2024-08-31T04:39:40.537370+0000 (oldest deadline 2024-08-31T04:40:06.437470+0000) 2024-08-31T04:40:14.313 INFO:journalctl@ceph.osd.10.smithi133.stdout:Aug 31 04:40:14 smithi133 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-10[46762]: 2024-08-31T04:40:14.124+0000 7f873f3e9640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-08-31T04:39:50.438807+0000 front 2024-08-31T04:39:50.438655+0000 (oldest deadline 2024-08-31T04:40:11.538621+0000) 2024-08-31T04:40:14.700 INFO:journalctl@ceph.osd.6.smithi050.stdout:Aug 31 04:40:14 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-6[46267]: 2024-08-31T04:40:14.296+0000 7efc67a00640 -1 osd.6 83 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-08-31T04:39:30.285999+0000 front 2024-08-31T04:39:30.286080+0000 (oldest deadline 2024-08-31T04:39:56.186016+0000) 2024-08-31T04:40:14.700 INFO:journalctl@ceph.osd.6.smithi050.stdout:Aug 31 04:40:14 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-6[46267]: 2024-08-31T04:40:14.296+0000 7efc67a00640 -1 osd.6 83 heartbeat_check: no reply from 172.21.15.133:6804 osd.1 since back 2024-08-31T04:39:41.487497+0000 front 2024-08-31T04:39:41.487305+0000 (oldest deadline 2024-08-31T04:40:04.387393+0000) 2024-08-31T04:40:14.700 INFO:journalctl@ceph.osd.9.smithi050.stdout:Aug 31 04:40:14 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-9[52806]: 2024-08-31T04:40:14.535+0000 7f30c0800640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-08-31T04:39:33.661151+0000 front 2024-08-31T04:39:33.661082+0000 (oldest deadline 2024-08-31T04:39:55.361248+0000) 2024-08-31T04:40:14.700 INFO:journalctl@ceph.osd.9.smithi050.stdout:Aug 31 04:40:14 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-9[52806]: 2024-08-31T04:40:14.535+0000 7f30c0800640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.133:6804 osd.1 since back 2024-08-31T04:39:41.262725+0000 front 2024-08-31T04:39:41.262699+0000 (oldest deadline 2024-08-31T04:40:05.362593+0000) 2024-08-31T04:40:14.700 INFO:journalctl@ceph.osd.9.smithi050.stdout:Aug 31 04:40:14 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-9[52806]: 2024-08-31T04:40:14.535+0000 7f30c0800640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-08-31T04:39:50.664217+0000 front 2024-08-31T04:39:50.663973+0000 (oldest deadline 2024-08-31T04:40:14.163759+0000) 2024-08-31T04:40:14.746 INFO:journalctl@ceph.osd.11.smithi177.stdout:Aug 31 04:40:14 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-11[46864]: 2024-08-31T04:40:14.332+0000 7fd602bf1640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-08-31T04:39:30.036711+0000 front 2024-08-31T04:39:30.036747+0000 (oldest deadline 2024-08-31T04:39:55.936674+0000) 2024-08-31T04:40:14.746 INFO:journalctl@ceph.osd.11.smithi177.stdout:Aug 31 04:40:14 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-11[46864]: 2024-08-31T04:40:14.332+0000 7fd602bf1640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.133:6804 osd.1 since back 2024-08-31T04:39:41.138475+0000 front 2024-08-31T04:39:41.138491+0000 (oldest deadline 2024-08-31T04:40:04.038356+0000) 2024-08-31T04:40:14.746 INFO:journalctl@ceph.osd.11.smithi177.stdout:Aug 31 04:40:14 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-11[46864]: 2024-08-31T04:40:14.332+0000 7fd602bf1640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-08-31T04:39:46.939525+0000 front 2024-08-31T04:39:46.939251+0000 (oldest deadline 2024-08-31T04:40:12.239391+0000) 2024-08-31T04:40:14.792 INFO:journalctl@ceph.osd.7.smithi133.stdout:Aug 31 04:40:14 smithi133 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-7[40256]: 2024-08-31T04:40:14.550+0000 7fd8eda41640 -1 osd.7 83 heartbeat_check: no reply from 172.21.15.133:6804 osd.1 since back 2024-08-31T04:39:39.987526+0000 front 2024-08-31T04:39:39.987404+0000 (oldest deadline 2024-08-31T04:40:04.087555+0000) 2024-08-31T04:40:14.793 INFO:journalctl@ceph.osd.7.smithi133.stdout:Aug 31 04:40:14 smithi133 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-7[40256]: 2024-08-31T04:40:14.550+0000 7fd8eda41640 -1 osd.7 83 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-08-31T04:39:47.588581+0000 front 2024-08-31T04:39:47.588740+0000 (oldest deadline 2024-08-31T04:40:13.488665+0000) 2024-08-31T04:40:15.246 INFO:journalctl@ceph.osd.8.smithi177.stdout:Aug 31 04:40:14 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-8[40333]: 2024-08-31T04:40:14.778+0000 7f244221a640 -1 osd.8 83 heartbeat_check: no reply from 172.21.15.133:6804 osd.1 since back 2024-08-31T04:39:41.888896+0000 front 2024-08-31T04:39:41.888953+0000 (oldest deadline 2024-08-31T04:40:03.588900+0000) 2024-08-31T04:40:15.246 INFO:journalctl@ceph.osd.8.smithi177.stdout:Aug 31 04:40:14 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-8[40333]: 2024-08-31T04:40:14.778+0000 7f244221a640 -1 osd.8 83 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-08-31T04:39:48.790419+0000 front 2024-08-31T04:39:48.790532+0000 (oldest deadline 2024-08-31T04:40:12.890634+0000) 2024-08-31T04:40:15.247 INFO:journalctl@ceph.osd.5.smithi177.stdout:Aug 31 04:40:14 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-5[33549]: 2024-08-31T04:40:14.977+0000 7f7b7e125640 -1 osd.5 83 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-08-31T04:39:32.463230+0000 front 2024-08-31T04:39:32.463262+0000 (oldest deadline 2024-08-31T04:39:57.063913+0000) 2024-08-31T04:40:15.247 INFO:journalctl@ceph.osd.5.smithi177.stdout:Aug 31 04:40:14 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-5[33549]: 2024-08-31T04:40:14.977+0000 7f7b7e125640 -1 osd.5 83 heartbeat_check: no reply from 172.21.15.133:6804 osd.1 since back 2024-08-31T04:39:40.564951+0000 front 2024-08-31T04:39:40.565089+0000 (oldest deadline 2024-08-31T04:40:04.065065+0000) 2024-08-31T04:40:15.247 INFO:journalctl@ceph.osd.5.smithi177.stdout:Aug 31 04:40:14 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-5[33549]: 2024-08-31T04:40:14.977+0000 7f7b7e125640 -1 osd.5 83 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-08-31T04:39:49.866624+0000 front 2024-08-31T04:39:49.866604+0000 (oldest deadline 2024-08-31T04:40:13.366812+0000) 2024-08-31T04:40:15.543 INFO:journalctl@ceph.osd.10.smithi133.stdout:Aug 31 04:40:15 smithi133 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-10[46762]: 2024-08-31T04:40:15.128+0000 7f873f3e9640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-08-31T04:39:32.936397+0000 front 2024-08-31T04:39:32.936196+0000 (oldest deadline 2024-08-31T04:39:55.836336+0000) 2024-08-31T04:40:15.543 INFO:journalctl@ceph.osd.10.smithi133.stdout:Aug 31 04:40:15 smithi133 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-10[46762]: 2024-08-31T04:40:15.128+0000 7f873f3e9640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.133:6804 osd.1 since back 2024-08-31T04:39:40.537248+0000 front 2024-08-31T04:39:40.537370+0000 (oldest deadline 2024-08-31T04:40:06.437470+0000) 2024-08-31T04:40:15.543 INFO:journalctl@ceph.osd.10.smithi133.stdout:Aug 31 04:40:15 smithi133 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-10[46762]: 2024-08-31T04:40:15.128+0000 7f873f3e9640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-08-31T04:39:50.438807+0000 front 2024-08-31T04:39:50.438655+0000 (oldest deadline 2024-08-31T04:40:11.538621+0000) 2024-08-31T04:40:15.700 INFO:journalctl@ceph.osd.6.smithi050.stdout:Aug 31 04:40:15 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-6[46267]: 2024-08-31T04:40:15.342+0000 7efc67a00640 -1 osd.6 83 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-08-31T04:39:30.285999+0000 front 2024-08-31T04:39:30.286080+0000 (oldest deadline 2024-08-31T04:39:56.186016+0000) 2024-08-31T04:40:15.700 INFO:journalctl@ceph.osd.6.smithi050.stdout:Aug 31 04:40:15 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-6[46267]: 2024-08-31T04:40:15.342+0000 7efc67a00640 -1 osd.6 83 heartbeat_check: no reply from 172.21.15.133:6804 osd.1 since back 2024-08-31T04:39:41.487497+0000 front 2024-08-31T04:39:41.487305+0000 (oldest deadline 2024-08-31T04:40:04.387393+0000) 2024-08-31T04:40:15.700 INFO:journalctl@ceph.osd.6.smithi050.stdout:Aug 31 04:40:15 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-6[46267]: 2024-08-31T04:40:15.342+0000 7efc67a00640 -1 osd.6 83 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-08-31T04:39:48.989169+0000 front 2024-08-31T04:39:48.989070+0000 (oldest deadline 2024-08-31T04:40:14.889176+0000) 2024-08-31T04:40:15.701 INFO:journalctl@ceph.osd.9.smithi050.stdout:Aug 31 04:40:15 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-9[52806]: 2024-08-31T04:40:15.566+0000 7f30c0800640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-08-31T04:39:33.661151+0000 front 2024-08-31T04:39:33.661082+0000 (oldest deadline 2024-08-31T04:39:55.361248+0000) 2024-08-31T04:40:15.701 INFO:journalctl@ceph.osd.9.smithi050.stdout:Aug 31 04:40:15 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-9[52806]: 2024-08-31T04:40:15.566+0000 7f30c0800640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.133:6804 osd.1 since back 2024-08-31T04:39:41.262725+0000 front 2024-08-31T04:39:41.262699+0000 (oldest deadline 2024-08-31T04:40:05.362593+0000) 2024-08-31T04:40:15.701 INFO:journalctl@ceph.osd.9.smithi050.stdout:Aug 31 04:40:15 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-9[52806]: 2024-08-31T04:40:15.566+0000 7f30c0800640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-08-31T04:39:50.664217+0000 front 2024-08-31T04:39:50.663973+0000 (oldest deadline 2024-08-31T04:40:14.163759+0000) 2024-08-31T04:40:15.746 INFO:journalctl@ceph.osd.5.smithi177.stdout:Aug 31 04:40:15 smithi177 podman[58664]: 2024-08-31 04:40:15.499746718 +0000 UTC m=+5.541809220 container died 7c76caf5d9f338d8f122c3282dede3fd96e8360af88fb808151df2f71547cb33 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-5, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , io.buildah.version=1.37.1, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, ceph=True) 2024-08-31T04:40:15.746 INFO:journalctl@ceph.osd.11.smithi177.stdout:Aug 31 04:40:15 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-11[46864]: 2024-08-31T04:40:15.311+0000 7fd602bf1640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-08-31T04:39:30.036711+0000 front 2024-08-31T04:39:30.036747+0000 (oldest deadline 2024-08-31T04:39:55.936674+0000) 2024-08-31T04:40:15.746 INFO:journalctl@ceph.osd.11.smithi177.stdout:Aug 31 04:40:15 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-11[46864]: 2024-08-31T04:40:15.311+0000 7fd602bf1640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.133:6804 osd.1 since back 2024-08-31T04:39:41.138475+0000 front 2024-08-31T04:39:41.138491+0000 (oldest deadline 2024-08-31T04:40:04.038356+0000) 2024-08-31T04:40:15.746 INFO:journalctl@ceph.osd.11.smithi177.stdout:Aug 31 04:40:15 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-11[46864]: 2024-08-31T04:40:15.311+0000 7fd602bf1640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-08-31T04:39:46.939525+0000 front 2024-08-31T04:39:46.939251+0000 (oldest deadline 2024-08-31T04:40:12.239391+0000) 2024-08-31T04:40:16.043 INFO:journalctl@ceph.osd.7.smithi133.stdout:Aug 31 04:40:15 smithi133 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-7[40256]: 2024-08-31T04:40:15.573+0000 7fd8eda41640 -1 osd.7 83 heartbeat_check: no reply from 172.21.15.133:6804 osd.1 since back 2024-08-31T04:39:39.987526+0000 front 2024-08-31T04:39:39.987404+0000 (oldest deadline 2024-08-31T04:40:04.087555+0000) 2024-08-31T04:40:16.043 INFO:journalctl@ceph.osd.7.smithi133.stdout:Aug 31 04:40:15 smithi133 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-7[40256]: 2024-08-31T04:40:15.573+0000 7fd8eda41640 -1 osd.7 83 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-08-31T04:39:47.588581+0000 front 2024-08-31T04:39:47.588740+0000 (oldest deadline 2024-08-31T04:40:13.488665+0000) 2024-08-31T04:40:16.065 INFO:journalctl@ceph.osd.5.smithi177.stdout:Aug 31 04:40:15 smithi177 podman[58664]: 2024-08-31 04:40:15.888831622 +0000 UTC m=+5.930894125 container cleanup 7c76caf5d9f338d8f122c3282dede3fd96e8360af88fb808151df2f71547cb33 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-5, ceph=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, io.buildah.version=1.37.1, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_CLEAN=True) 2024-08-31T04:40:16.066 INFO:journalctl@ceph.osd.5.smithi177.stdout:Aug 31 04:40:15 smithi177 bash[58664]: ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-5 2024-08-31T04:40:16.066 INFO:journalctl@ceph.osd.8.smithi177.stdout:Aug 31 04:40:15 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-8[40333]: 2024-08-31T04:40:15.761+0000 7f244221a640 -1 osd.8 83 heartbeat_check: no reply from 172.21.15.133:6804 osd.1 since back 2024-08-31T04:39:41.888896+0000 front 2024-08-31T04:39:41.888953+0000 (oldest deadline 2024-08-31T04:40:03.588900+0000) 2024-08-31T04:40:16.066 INFO:journalctl@ceph.osd.8.smithi177.stdout:Aug 31 04:40:15 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-8[40333]: 2024-08-31T04:40:15.761+0000 7f244221a640 -1 osd.8 83 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-08-31T04:39:48.790419+0000 front 2024-08-31T04:39:48.790532+0000 (oldest deadline 2024-08-31T04:40:12.890634+0000) 2024-08-31T04:40:16.358 INFO:journalctl@ceph.osd.5.smithi177.stdout:Aug 31 04:40:16 smithi177 podman[58679]: 2024-08-31 04:40:16.064918149 +0000 UTC m=+0.565322680 container remove 7c76caf5d9f338d8f122c3282dede3fd96e8360af88fb808151df2f71547cb33 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-5, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.1, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-08-31T04:40:16.543 INFO:journalctl@ceph.osd.10.smithi133.stdout:Aug 31 04:40:16 smithi133 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-10[46762]: 2024-08-31T04:40:16.092+0000 7f873f3e9640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-08-31T04:39:32.936397+0000 front 2024-08-31T04:39:32.936196+0000 (oldest deadline 2024-08-31T04:39:55.836336+0000) 2024-08-31T04:40:16.543 INFO:journalctl@ceph.osd.10.smithi133.stdout:Aug 31 04:40:16 smithi133 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-10[46762]: 2024-08-31T04:40:16.092+0000 7f873f3e9640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.133:6804 osd.1 since back 2024-08-31T04:39:40.537248+0000 front 2024-08-31T04:39:40.537370+0000 (oldest deadline 2024-08-31T04:40:06.437470+0000) 2024-08-31T04:40:16.543 INFO:journalctl@ceph.osd.10.smithi133.stdout:Aug 31 04:40:16 smithi133 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-10[46762]: 2024-08-31T04:40:16.092+0000 7f873f3e9640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-08-31T04:39:50.438807+0000 front 2024-08-31T04:39:50.438655+0000 (oldest deadline 2024-08-31T04:40:11.538621+0000) 2024-08-31T04:40:16.580 INFO:journalctl@ceph.osd.6.smithi050.stdout:Aug 31 04:40:16 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-6[46267]: 2024-08-31T04:40:16.309+0000 7efc67a00640 -1 osd.6 83 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-08-31T04:39:30.285999+0000 front 2024-08-31T04:39:30.286080+0000 (oldest deadline 2024-08-31T04:39:56.186016+0000) 2024-08-31T04:40:16.580 INFO:journalctl@ceph.osd.6.smithi050.stdout:Aug 31 04:40:16 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-6[46267]: 2024-08-31T04:40:16.309+0000 7efc67a00640 -1 osd.6 83 heartbeat_check: no reply from 172.21.15.133:6804 osd.1 since back 2024-08-31T04:39:41.487497+0000 front 2024-08-31T04:39:41.487305+0000 (oldest deadline 2024-08-31T04:40:04.387393+0000) 2024-08-31T04:40:16.580 INFO:journalctl@ceph.osd.6.smithi050.stdout:Aug 31 04:40:16 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-6[46267]: 2024-08-31T04:40:16.309+0000 7efc67a00640 -1 osd.6 83 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-08-31T04:39:48.989169+0000 front 2024-08-31T04:39:48.989070+0000 (oldest deadline 2024-08-31T04:40:14.889176+0000) 2024-08-31T04:40:16.620 INFO:journalctl@ceph.osd.5.smithi177.stdout:Aug 31 04:40:16 smithi177 podman[58771]: 2024-08-31 04:40:16.377811625 +0000 UTC m=+0.015600521 image pull 79f4cde5e36911a5dca995eeb98098c2c8aae81dd52a088ef2c867bc3363bad0 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61 2024-08-31T04:40:16.621 INFO:journalctl@ceph.osd.5.smithi177.stdout:Aug 31 04:40:16 smithi177 podman[58771]: 2024-08-31 04:40:16.482792829 +0000 UTC m=+0.120581709 container create 347f863e4440657f92add802a36bbf3406d49c9168e7929d35d3e272e70d1e08 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-5-deactivate, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, ceph=True, GIT_CLEAN=True, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, io.buildah.version=1.37.1, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS) 2024-08-31T04:40:16.621 INFO:journalctl@ceph.osd.11.smithi177.stdout:Aug 31 04:40:16 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-11[46864]: 2024-08-31T04:40:16.356+0000 7fd602bf1640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-08-31T04:39:30.036711+0000 front 2024-08-31T04:39:30.036747+0000 (oldest deadline 2024-08-31T04:39:55.936674+0000) 2024-08-31T04:40:16.621 INFO:journalctl@ceph.osd.11.smithi177.stdout:Aug 31 04:40:16 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-11[46864]: 2024-08-31T04:40:16.356+0000 7fd602bf1640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.133:6804 osd.1 since back 2024-08-31T04:39:41.138475+0000 front 2024-08-31T04:39:41.138491+0000 (oldest deadline 2024-08-31T04:40:04.038356+0000) 2024-08-31T04:40:16.621 INFO:journalctl@ceph.osd.11.smithi177.stdout:Aug 31 04:40:16 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-11[46864]: 2024-08-31T04:40:16.356+0000 7fd602bf1640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-08-31T04:39:46.939525+0000 front 2024-08-31T04:39:46.939251+0000 (oldest deadline 2024-08-31T04:40:12.239391+0000) 2024-08-31T04:40:16.950 INFO:journalctl@ceph.osd.9.smithi050.stdout:Aug 31 04:40:16 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-9[52806]: 2024-08-31T04:40:16.578+0000 7f30c0800640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-08-31T04:39:33.661151+0000 front 2024-08-31T04:39:33.661082+0000 (oldest deadline 2024-08-31T04:39:55.361248+0000) 2024-08-31T04:40:16.950 INFO:journalctl@ceph.osd.9.smithi050.stdout:Aug 31 04:40:16 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-9[52806]: 2024-08-31T04:40:16.578+0000 7f30c0800640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.133:6804 osd.1 since back 2024-08-31T04:39:41.262725+0000 front 2024-08-31T04:39:41.262699+0000 (oldest deadline 2024-08-31T04:40:05.362593+0000) 2024-08-31T04:40:16.950 INFO:journalctl@ceph.osd.9.smithi050.stdout:Aug 31 04:40:16 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-9[52806]: 2024-08-31T04:40:16.578+0000 7f30c0800640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-08-31T04:39:50.664217+0000 front 2024-08-31T04:39:50.663973+0000 (oldest deadline 2024-08-31T04:40:14.163759+0000) 2024-08-31T04:40:16.996 INFO:journalctl@ceph.osd.8.smithi177.stdout:Aug 31 04:40:16 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-8[40333]: 2024-08-31T04:40:16.757+0000 7f244221a640 -1 osd.8 83 heartbeat_check: no reply from 172.21.15.133:6804 osd.1 since back 2024-08-31T04:39:41.888896+0000 front 2024-08-31T04:39:41.888953+0000 (oldest deadline 2024-08-31T04:40:03.588900+0000) 2024-08-31T04:40:16.996 INFO:journalctl@ceph.osd.8.smithi177.stdout:Aug 31 04:40:16 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-8[40333]: 2024-08-31T04:40:16.757+0000 7f244221a640 -1 osd.8 83 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-08-31T04:39:48.790419+0000 front 2024-08-31T04:39:48.790532+0000 (oldest deadline 2024-08-31T04:40:12.890634+0000) 2024-08-31T04:40:16.997 INFO:journalctl@ceph.osd.5.smithi177.stdout:Aug 31 04:40:16 smithi177 podman[58771]: 2024-08-31 04:40:16.718673491 +0000 UTC m=+0.356462371 container init 347f863e4440657f92add802a36bbf3406d49c9168e7929d35d3e272e70d1e08 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-5-deactivate, io.buildah.version=1.37.1, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, ceph=True, GIT_CLEAN=True) 2024-08-31T04:40:16.997 INFO:journalctl@ceph.osd.5.smithi177.stdout:Aug 31 04:40:16 smithi177 podman[58771]: 2024-08-31 04:40:16.722401431 +0000 UTC m=+0.360190315 container start 347f863e4440657f92add802a36bbf3406d49c9168e7929d35d3e272e70d1e08 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-5-deactivate, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, io.buildah.version=1.37.1, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611) 2024-08-31T04:40:16.997 INFO:journalctl@ceph.osd.5.smithi177.stdout:Aug 31 04:40:16 smithi177 podman[58771]: 2024-08-31 04:40:16.810266075 +0000 UTC m=+0.448054972 container attach 347f863e4440657f92add802a36bbf3406d49c9168e7929d35d3e272e70d1e08 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-5-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_CLEAN=True, io.buildah.version=1.37.1, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS) 2024-08-31T04:40:16.997 INFO:journalctl@ceph.osd.5.smithi177.stdout:Aug 31 04:40:16 smithi177 podman[58771]: 2024-08-31 04:40:16.910692616 +0000 UTC m=+0.548481504 container died 347f863e4440657f92add802a36bbf3406d49c9168e7929d35d3e272e70d1e08 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-5-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, io.buildah.version=1.37.1, org.label-schema.build-date=20240731, ceph=True, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True) 2024-08-31T04:40:17.043 INFO:journalctl@ceph.osd.7.smithi133.stdout:Aug 31 04:40:16 smithi133 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-7[40256]: 2024-08-31T04:40:16.559+0000 7fd8eda41640 -1 osd.7 83 heartbeat_check: no reply from 172.21.15.133:6804 osd.1 since back 2024-08-31T04:39:39.987526+0000 front 2024-08-31T04:39:39.987404+0000 (oldest deadline 2024-08-31T04:40:04.087555+0000) 2024-08-31T04:40:17.043 INFO:journalctl@ceph.osd.7.smithi133.stdout:Aug 31 04:40:16 smithi133 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-7[40256]: 2024-08-31T04:40:16.559+0000 7fd8eda41640 -1 osd.7 83 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-08-31T04:39:47.588581+0000 front 2024-08-31T04:39:47.588740+0000 (oldest deadline 2024-08-31T04:40:13.488665+0000) 2024-08-31T04:40:17.530 INFO:journalctl@ceph.osd.10.smithi133.stdout:Aug 31 04:40:17 smithi133 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-10[46762]: 2024-08-31T04:40:17.054+0000 7f873f3e9640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-08-31T04:39:32.936397+0000 front 2024-08-31T04:39:32.936196+0000 (oldest deadline 2024-08-31T04:39:55.836336+0000) 2024-08-31T04:40:17.530 INFO:journalctl@ceph.osd.10.smithi133.stdout:Aug 31 04:40:17 smithi133 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-10[46762]: 2024-08-31T04:40:17.054+0000 7f873f3e9640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.133:6804 osd.1 since back 2024-08-31T04:39:40.537248+0000 front 2024-08-31T04:39:40.537370+0000 (oldest deadline 2024-08-31T04:40:06.437470+0000) 2024-08-31T04:40:17.530 INFO:journalctl@ceph.osd.10.smithi133.stdout:Aug 31 04:40:17 smithi133 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-10[46762]: 2024-08-31T04:40:17.054+0000 7f873f3e9640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-08-31T04:39:50.438807+0000 front 2024-08-31T04:39:50.438655+0000 (oldest deadline 2024-08-31T04:40:11.538621+0000) 2024-08-31T04:40:17.598 INFO:journalctl@ceph.osd.11.smithi177.stdout:Aug 31 04:40:17 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-11[46864]: 2024-08-31T04:40:17.318+0000 7fd602bf1640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-08-31T04:39:30.036711+0000 front 2024-08-31T04:39:30.036747+0000 (oldest deadline 2024-08-31T04:39:55.936674+0000) 2024-08-31T04:40:17.598 INFO:journalctl@ceph.osd.11.smithi177.stdout:Aug 31 04:40:17 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-11[46864]: 2024-08-31T04:40:17.318+0000 7fd602bf1640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.133:6804 osd.1 since back 2024-08-31T04:39:41.138475+0000 front 2024-08-31T04:39:41.138491+0000 (oldest deadline 2024-08-31T04:40:04.038356+0000) 2024-08-31T04:40:17.598 INFO:journalctl@ceph.osd.11.smithi177.stdout:Aug 31 04:40:17 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-11[46864]: 2024-08-31T04:40:17.318+0000 7fd602bf1640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-08-31T04:39:46.939525+0000 front 2024-08-31T04:39:46.939251+0000 (oldest deadline 2024-08-31T04:40:12.239391+0000) 2024-08-31T04:40:17.623 DEBUG:teuthology.orchestra.run.smithi177:> sudo pkill -f 'journalctl -f -n 0 -u ceph-058d9fc6-674f-11ef-bcd4-c7b262605968@osd.5.service' 2024-08-31T04:40:17.662 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-31T04:40:17.662 INFO:tasks.cephadm.osd.5:Stopped osd.5 2024-08-31T04:40:17.662 INFO:tasks.cephadm.osd.6:Stopping osd.6... 2024-08-31T04:40:17.662 DEBUG:teuthology.orchestra.run.smithi050:> sudo systemctl stop ceph-058d9fc6-674f-11ef-bcd4-c7b262605968@osd.6 2024-08-31T04:40:17.700 INFO:journalctl@ceph.osd.9.smithi050.stdout:Aug 31 04:40:17 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-9[52806]: 2024-08-31T04:40:17.539+0000 7f30c0800640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-08-31T04:39:33.661151+0000 front 2024-08-31T04:39:33.661082+0000 (oldest deadline 2024-08-31T04:39:55.361248+0000) 2024-08-31T04:40:17.700 INFO:journalctl@ceph.osd.9.smithi050.stdout:Aug 31 04:40:17 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-9[52806]: 2024-08-31T04:40:17.539+0000 7f30c0800640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.133:6804 osd.1 since back 2024-08-31T04:39:41.262725+0000 front 2024-08-31T04:39:41.262699+0000 (oldest deadline 2024-08-31T04:40:05.362593+0000) 2024-08-31T04:40:17.700 INFO:journalctl@ceph.osd.9.smithi050.stdout:Aug 31 04:40:17 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-9[52806]: 2024-08-31T04:40:17.539+0000 7f30c0800640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-08-31T04:39:50.664217+0000 front 2024-08-31T04:39:50.663973+0000 (oldest deadline 2024-08-31T04:40:14.163759+0000) 2024-08-31T04:40:17.700 INFO:journalctl@ceph.osd.6.smithi050.stdout:Aug 31 04:40:17 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-6[46267]: 2024-08-31T04:40:17.347+0000 7efc67a00640 -1 osd.6 83 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-08-31T04:39:30.285999+0000 front 2024-08-31T04:39:30.286080+0000 (oldest deadline 2024-08-31T04:39:56.186016+0000) 2024-08-31T04:40:17.700 INFO:journalctl@ceph.osd.6.smithi050.stdout:Aug 31 04:40:17 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-6[46267]: 2024-08-31T04:40:17.347+0000 7efc67a00640 -1 osd.6 83 heartbeat_check: no reply from 172.21.15.133:6804 osd.1 since back 2024-08-31T04:39:41.487497+0000 front 2024-08-31T04:39:41.487305+0000 (oldest deadline 2024-08-31T04:40:04.387393+0000) 2024-08-31T04:40:17.701 INFO:journalctl@ceph.osd.6.smithi050.stdout:Aug 31 04:40:17 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-6[46267]: 2024-08-31T04:40:17.347+0000 7efc67a00640 -1 osd.6 83 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-08-31T04:39:48.989169+0000 front 2024-08-31T04:39:48.989070+0000 (oldest deadline 2024-08-31T04:40:14.889176+0000) 2024-08-31T04:40:17.793 INFO:journalctl@ceph.osd.7.smithi133.stdout:Aug 31 04:40:17 smithi133 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-7[40256]: 2024-08-31T04:40:17.528+0000 7fd8eda41640 -1 osd.7 83 heartbeat_check: no reply from 172.21.15.133:6804 osd.1 since back 2024-08-31T04:39:39.987526+0000 front 2024-08-31T04:39:39.987404+0000 (oldest deadline 2024-08-31T04:40:04.087555+0000) 2024-08-31T04:40:17.793 INFO:journalctl@ceph.osd.7.smithi133.stdout:Aug 31 04:40:17 smithi133 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-7[40256]: 2024-08-31T04:40:17.528+0000 7fd8eda41640 -1 osd.7 83 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-08-31T04:39:47.588581+0000 front 2024-08-31T04:39:47.588740+0000 (oldest deadline 2024-08-31T04:40:13.488665+0000) 2024-08-31T04:40:17.996 INFO:journalctl@ceph.osd.8.smithi177.stdout:Aug 31 04:40:17 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-8[40333]: 2024-08-31T04:40:17.724+0000 7f244221a640 -1 osd.8 83 heartbeat_check: no reply from 172.21.15.133:6804 osd.1 since back 2024-08-31T04:39:41.888896+0000 front 2024-08-31T04:39:41.888953+0000 (oldest deadline 2024-08-31T04:40:03.588900+0000) 2024-08-31T04:40:17.996 INFO:journalctl@ceph.osd.8.smithi177.stdout:Aug 31 04:40:17 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-8[40333]: 2024-08-31T04:40:17.724+0000 7f244221a640 -1 osd.8 83 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-08-31T04:39:48.790419+0000 front 2024-08-31T04:39:48.790532+0000 (oldest deadline 2024-08-31T04:40:12.890634+0000) 2024-08-31T04:40:18.090 INFO:journalctl@ceph.osd.6.smithi050.stdout:Aug 31 04:40:17 smithi050 systemd[1]: Stopping Ceph osd.6 for 058d9fc6-674f-11ef-bcd4-c7b262605968... 2024-08-31T04:40:18.091 INFO:journalctl@ceph.osd.6.smithi050.stdout:Aug 31 04:40:18 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-6[46267]: 2024-08-31T04:40:18.089+0000 7efc71000640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.6 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-31T04:40:18.450 INFO:journalctl@ceph.osd.6.smithi050.stdout:Aug 31 04:40:18 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-6[46267]: 2024-08-31T04:40:18.089+0000 7efc71000640 -1 osd.6 83 *** Got signal Terminated *** 2024-08-31T04:40:18.450 INFO:journalctl@ceph.osd.6.smithi050.stdout:Aug 31 04:40:18 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-6[46267]: 2024-08-31T04:40:18.089+0000 7efc71000640 -1 osd.6 83 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-08-31T04:40:18.450 INFO:journalctl@ceph.osd.6.smithi050.stdout:Aug 31 04:40:18 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-6[46267]: 2024-08-31T04:40:18.306+0000 7efc67a00640 -1 osd.6 83 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-08-31T04:39:30.285999+0000 front 2024-08-31T04:39:30.286080+0000 (oldest deadline 2024-08-31T04:39:56.186016+0000) 2024-08-31T04:40:18.450 INFO:journalctl@ceph.osd.6.smithi050.stdout:Aug 31 04:40:18 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-6[46267]: 2024-08-31T04:40:18.306+0000 7efc67a00640 -1 osd.6 83 heartbeat_check: no reply from 172.21.15.133:6804 osd.1 since back 2024-08-31T04:39:41.487497+0000 front 2024-08-31T04:39:41.487305+0000 (oldest deadline 2024-08-31T04:40:04.387393+0000) 2024-08-31T04:40:18.450 INFO:journalctl@ceph.osd.6.smithi050.stdout:Aug 31 04:40:18 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-6[46267]: 2024-08-31T04:40:18.306+0000 7efc67a00640 -1 osd.6 83 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-08-31T04:39:48.989169+0000 front 2024-08-31T04:39:48.989070+0000 (oldest deadline 2024-08-31T04:40:14.889176+0000) 2024-08-31T04:40:18.543 INFO:journalctl@ceph.osd.10.smithi133.stdout:Aug 31 04:40:18 smithi133 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-10[46762]: 2024-08-31T04:40:18.092+0000 7f873f3e9640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-08-31T04:39:32.936397+0000 front 2024-08-31T04:39:32.936196+0000 (oldest deadline 2024-08-31T04:39:55.836336+0000) 2024-08-31T04:40:18.543 INFO:journalctl@ceph.osd.10.smithi133.stdout:Aug 31 04:40:18 smithi133 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-10[46762]: 2024-08-31T04:40:18.092+0000 7f873f3e9640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.133:6804 osd.1 since back 2024-08-31T04:39:40.537248+0000 front 2024-08-31T04:39:40.537370+0000 (oldest deadline 2024-08-31T04:40:06.437470+0000) 2024-08-31T04:40:18.543 INFO:journalctl@ceph.osd.10.smithi133.stdout:Aug 31 04:40:18 smithi133 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-10[46762]: 2024-08-31T04:40:18.092+0000 7f873f3e9640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-08-31T04:39:50.438807+0000 front 2024-08-31T04:39:50.438655+0000 (oldest deadline 2024-08-31T04:40:11.538621+0000) 2024-08-31T04:40:18.686 INFO:journalctl@ceph.osd.11.smithi177.stdout:Aug 31 04:40:18 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-11[46864]: 2024-08-31T04:40:18.338+0000 7fd602bf1640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-08-31T04:39:30.036711+0000 front 2024-08-31T04:39:30.036747+0000 (oldest deadline 2024-08-31T04:39:55.936674+0000) 2024-08-31T04:40:18.687 INFO:journalctl@ceph.osd.11.smithi177.stdout:Aug 31 04:40:18 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-11[46864]: 2024-08-31T04:40:18.338+0000 7fd602bf1640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.133:6804 osd.1 since back 2024-08-31T04:39:41.138475+0000 front 2024-08-31T04:39:41.138491+0000 (oldest deadline 2024-08-31T04:40:04.038356+0000) 2024-08-31T04:40:18.687 INFO:journalctl@ceph.osd.11.smithi177.stdout:Aug 31 04:40:18 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-11[46864]: 2024-08-31T04:40:18.338+0000 7fd602bf1640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-08-31T04:39:46.939525+0000 front 2024-08-31T04:39:46.939251+0000 (oldest deadline 2024-08-31T04:40:12.239391+0000) 2024-08-31T04:40:18.950 INFO:journalctl@ceph.osd.9.smithi050.stdout:Aug 31 04:40:18 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-9[52806]: 2024-08-31T04:40:18.580+0000 7f30c0800640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-08-31T04:39:33.661151+0000 front 2024-08-31T04:39:33.661082+0000 (oldest deadline 2024-08-31T04:39:55.361248+0000) 2024-08-31T04:40:18.950 INFO:journalctl@ceph.osd.9.smithi050.stdout:Aug 31 04:40:18 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-9[52806]: 2024-08-31T04:40:18.580+0000 7f30c0800640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.133:6804 osd.1 since back 2024-08-31T04:39:41.262725+0000 front 2024-08-31T04:39:41.262699+0000 (oldest deadline 2024-08-31T04:40:05.362593+0000) 2024-08-31T04:40:18.950 INFO:journalctl@ceph.osd.9.smithi050.stdout:Aug 31 04:40:18 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-9[52806]: 2024-08-31T04:40:18.580+0000 7f30c0800640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-08-31T04:39:50.664217+0000 front 2024-08-31T04:39:50.663973+0000 (oldest deadline 2024-08-31T04:40:14.163759+0000) 2024-08-31T04:40:18.996 INFO:journalctl@ceph.osd.8.smithi177.stdout:Aug 31 04:40:18 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-8[40333]: 2024-08-31T04:40:18.685+0000 7f244221a640 -1 osd.8 83 heartbeat_check: no reply from 172.21.15.133:6804 osd.1 since back 2024-08-31T04:39:41.888896+0000 front 2024-08-31T04:39:41.888953+0000 (oldest deadline 2024-08-31T04:40:03.588900+0000) 2024-08-31T04:40:18.996 INFO:journalctl@ceph.osd.8.smithi177.stdout:Aug 31 04:40:18 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-8[40333]: 2024-08-31T04:40:18.685+0000 7f244221a640 -1 osd.8 83 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-08-31T04:39:48.790419+0000 front 2024-08-31T04:39:48.790532+0000 (oldest deadline 2024-08-31T04:40:12.890634+0000) 2024-08-31T04:40:19.043 INFO:journalctl@ceph.osd.7.smithi133.stdout:Aug 31 04:40:18 smithi133 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-7[40256]: 2024-08-31T04:40:18.570+0000 7fd8eda41640 -1 osd.7 83 heartbeat_check: no reply from 172.21.15.133:6804 osd.1 since back 2024-08-31T04:39:39.987526+0000 front 2024-08-31T04:39:39.987404+0000 (oldest deadline 2024-08-31T04:40:04.087555+0000) 2024-08-31T04:40:19.043 INFO:journalctl@ceph.osd.7.smithi133.stdout:Aug 31 04:40:18 smithi133 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-7[40256]: 2024-08-31T04:40:18.570+0000 7fd8eda41640 -1 osd.7 83 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-08-31T04:39:47.588581+0000 front 2024-08-31T04:39:47.588740+0000 (oldest deadline 2024-08-31T04:40:13.488665+0000) 2024-08-31T04:40:19.539 INFO:journalctl@ceph.osd.6.smithi050.stdout:Aug 31 04:40:19 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-6[46267]: 2024-08-31T04:40:19.259+0000 7efc67a00640 -1 osd.6 83 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-08-31T04:39:30.285999+0000 front 2024-08-31T04:39:30.286080+0000 (oldest deadline 2024-08-31T04:39:56.186016+0000) 2024-08-31T04:40:19.539 INFO:journalctl@ceph.osd.6.smithi050.stdout:Aug 31 04:40:19 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-6[46267]: 2024-08-31T04:40:19.259+0000 7efc67a00640 -1 osd.6 83 heartbeat_check: no reply from 172.21.15.133:6804 osd.1 since back 2024-08-31T04:39:41.487497+0000 front 2024-08-31T04:39:41.487305+0000 (oldest deadline 2024-08-31T04:40:04.387393+0000) 2024-08-31T04:40:19.539 INFO:journalctl@ceph.osd.6.smithi050.stdout:Aug 31 04:40:19 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-6[46267]: 2024-08-31T04:40:19.259+0000 7efc67a00640 -1 osd.6 83 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-08-31T04:39:48.989169+0000 front 2024-08-31T04:39:48.989070+0000 (oldest deadline 2024-08-31T04:40:14.889176+0000) 2024-08-31T04:40:19.542 INFO:journalctl@ceph.osd.10.smithi133.stdout:Aug 31 04:40:19 smithi133 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-10[46762]: 2024-08-31T04:40:19.125+0000 7f873f3e9640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-08-31T04:39:32.936397+0000 front 2024-08-31T04:39:32.936196+0000 (oldest deadline 2024-08-31T04:39:55.836336+0000) 2024-08-31T04:40:19.543 INFO:journalctl@ceph.osd.10.smithi133.stdout:Aug 31 04:40:19 smithi133 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-10[46762]: 2024-08-31T04:40:19.125+0000 7f873f3e9640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.133:6804 osd.1 since back 2024-08-31T04:39:40.537248+0000 front 2024-08-31T04:39:40.537370+0000 (oldest deadline 2024-08-31T04:40:06.437470+0000) 2024-08-31T04:40:19.543 INFO:journalctl@ceph.osd.10.smithi133.stdout:Aug 31 04:40:19 smithi133 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-10[46762]: 2024-08-31T04:40:19.125+0000 7f873f3e9640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-08-31T04:39:50.438807+0000 front 2024-08-31T04:39:50.438655+0000 (oldest deadline 2024-08-31T04:40:11.538621+0000) 2024-08-31T04:40:19.681 INFO:journalctl@ceph.osd.11.smithi177.stdout:Aug 31 04:40:19 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-11[46864]: 2024-08-31T04:40:19.293+0000 7fd602bf1640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-08-31T04:39:30.036711+0000 front 2024-08-31T04:39:30.036747+0000 (oldest deadline 2024-08-31T04:39:55.936674+0000) 2024-08-31T04:40:19.681 INFO:journalctl@ceph.osd.11.smithi177.stdout:Aug 31 04:40:19 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-11[46864]: 2024-08-31T04:40:19.293+0000 7fd602bf1640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.133:6804 osd.1 since back 2024-08-31T04:39:41.138475+0000 front 2024-08-31T04:39:41.138491+0000 (oldest deadline 2024-08-31T04:40:04.038356+0000) 2024-08-31T04:40:19.681 INFO:journalctl@ceph.osd.11.smithi177.stdout:Aug 31 04:40:19 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-11[46864]: 2024-08-31T04:40:19.293+0000 7fd602bf1640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-08-31T04:39:46.939525+0000 front 2024-08-31T04:39:46.939251+0000 (oldest deadline 2024-08-31T04:40:12.239391+0000) 2024-08-31T04:40:19.950 INFO:journalctl@ceph.osd.9.smithi050.stdout:Aug 31 04:40:19 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-9[52806]: 2024-08-31T04:40:19.537+0000 7f30c0800640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-08-31T04:39:33.661151+0000 front 2024-08-31T04:39:33.661082+0000 (oldest deadline 2024-08-31T04:39:55.361248+0000) 2024-08-31T04:40:19.950 INFO:journalctl@ceph.osd.9.smithi050.stdout:Aug 31 04:40:19 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-9[52806]: 2024-08-31T04:40:19.537+0000 7f30c0800640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.133:6804 osd.1 since back 2024-08-31T04:39:41.262725+0000 front 2024-08-31T04:39:41.262699+0000 (oldest deadline 2024-08-31T04:40:05.362593+0000) 2024-08-31T04:40:19.950 INFO:journalctl@ceph.osd.9.smithi050.stdout:Aug 31 04:40:19 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-9[52806]: 2024-08-31T04:40:19.537+0000 7f30c0800640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-08-31T04:39:50.664217+0000 front 2024-08-31T04:39:50.663973+0000 (oldest deadline 2024-08-31T04:40:14.163759+0000) 2024-08-31T04:40:19.996 INFO:journalctl@ceph.osd.8.smithi177.stdout:Aug 31 04:40:19 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-8[40333]: 2024-08-31T04:40:19.679+0000 7f244221a640 -1 osd.8 83 heartbeat_check: no reply from 172.21.15.133:6804 osd.1 since back 2024-08-31T04:39:41.888896+0000 front 2024-08-31T04:39:41.888953+0000 (oldest deadline 2024-08-31T04:40:03.588900+0000) 2024-08-31T04:40:19.996 INFO:journalctl@ceph.osd.8.smithi177.stdout:Aug 31 04:40:19 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-8[40333]: 2024-08-31T04:40:19.679+0000 7f244221a640 -1 osd.8 83 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-08-31T04:39:48.790419+0000 front 2024-08-31T04:39:48.790532+0000 (oldest deadline 2024-08-31T04:40:12.890634+0000) 2024-08-31T04:40:20.043 INFO:journalctl@ceph.osd.7.smithi133.stdout:Aug 31 04:40:19 smithi133 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-7[40256]: 2024-08-31T04:40:19.547+0000 7fd8eda41640 -1 osd.7 83 heartbeat_check: no reply from 172.21.15.133:6804 osd.1 since back 2024-08-31T04:39:39.987526+0000 front 2024-08-31T04:39:39.987404+0000 (oldest deadline 2024-08-31T04:40:04.087555+0000) 2024-08-31T04:40:20.043 INFO:journalctl@ceph.osd.7.smithi133.stdout:Aug 31 04:40:19 smithi133 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-7[40256]: 2024-08-31T04:40:19.547+0000 7fd8eda41640 -1 osd.7 83 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-08-31T04:39:47.588581+0000 front 2024-08-31T04:39:47.588740+0000 (oldest deadline 2024-08-31T04:40:13.488665+0000) 2024-08-31T04:40:20.529 INFO:journalctl@ceph.osd.6.smithi050.stdout:Aug 31 04:40:20 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-6[46267]: 2024-08-31T04:40:20.244+0000 7efc67a00640 -1 osd.6 83 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-08-31T04:39:30.285999+0000 front 2024-08-31T04:39:30.286080+0000 (oldest deadline 2024-08-31T04:39:56.186016+0000) 2024-08-31T04:40:20.529 INFO:journalctl@ceph.osd.6.smithi050.stdout:Aug 31 04:40:20 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-6[46267]: 2024-08-31T04:40:20.244+0000 7efc67a00640 -1 osd.6 83 heartbeat_check: no reply from 172.21.15.133:6804 osd.1 since back 2024-08-31T04:39:41.487497+0000 front 2024-08-31T04:39:41.487305+0000 (oldest deadline 2024-08-31T04:40:04.387393+0000) 2024-08-31T04:40:20.529 INFO:journalctl@ceph.osd.6.smithi050.stdout:Aug 31 04:40:20 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-6[46267]: 2024-08-31T04:40:20.244+0000 7efc67a00640 -1 osd.6 83 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-08-31T04:39:48.989169+0000 front 2024-08-31T04:39:48.989070+0000 (oldest deadline 2024-08-31T04:40:14.889176+0000) 2024-08-31T04:40:20.529 INFO:journalctl@ceph.osd.6.smithi050.stdout:Aug 31 04:40:20 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-6[46267]: 2024-08-31T04:40:20.244+0000 7efc67a00640 -1 osd.6 83 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2024-08-31T04:39:58.390266+0000 front 2024-08-31T04:39:58.390201+0000 (oldest deadline 2024-08-31T04:40:19.490182+0000) 2024-08-31T04:40:20.543 INFO:journalctl@ceph.osd.10.smithi133.stdout:Aug 31 04:40:20 smithi133 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-10[46762]: 2024-08-31T04:40:20.153+0000 7f873f3e9640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-08-31T04:39:32.936397+0000 front 2024-08-31T04:39:32.936196+0000 (oldest deadline 2024-08-31T04:39:55.836336+0000) 2024-08-31T04:40:20.543 INFO:journalctl@ceph.osd.10.smithi133.stdout:Aug 31 04:40:20 smithi133 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-10[46762]: 2024-08-31T04:40:20.153+0000 7f873f3e9640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.133:6804 osd.1 since back 2024-08-31T04:39:40.537248+0000 front 2024-08-31T04:39:40.537370+0000 (oldest deadline 2024-08-31T04:40:06.437470+0000) 2024-08-31T04:40:20.543 INFO:journalctl@ceph.osd.10.smithi133.stdout:Aug 31 04:40:20 smithi133 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-10[46762]: 2024-08-31T04:40:20.153+0000 7f873f3e9640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-08-31T04:39:50.438807+0000 front 2024-08-31T04:39:50.438655+0000 (oldest deadline 2024-08-31T04:40:11.538621+0000) 2024-08-31T04:40:20.668 INFO:journalctl@ceph.osd.11.smithi177.stdout:Aug 31 04:40:20 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-11[46864]: 2024-08-31T04:40:20.306+0000 7fd602bf1640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-08-31T04:39:30.036711+0000 front 2024-08-31T04:39:30.036747+0000 (oldest deadline 2024-08-31T04:39:55.936674+0000) 2024-08-31T04:40:20.668 INFO:journalctl@ceph.osd.11.smithi177.stdout:Aug 31 04:40:20 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-11[46864]: 2024-08-31T04:40:20.306+0000 7fd602bf1640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.133:6804 osd.1 since back 2024-08-31T04:39:41.138475+0000 front 2024-08-31T04:39:41.138491+0000 (oldest deadline 2024-08-31T04:40:04.038356+0000) 2024-08-31T04:40:20.669 INFO:journalctl@ceph.osd.11.smithi177.stdout:Aug 31 04:40:20 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-11[46864]: 2024-08-31T04:40:20.306+0000 7fd602bf1640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-08-31T04:39:46.939525+0000 front 2024-08-31T04:39:46.939251+0000 (oldest deadline 2024-08-31T04:40:12.239391+0000) 2024-08-31T04:40:20.950 INFO:journalctl@ceph.osd.9.smithi050.stdout:Aug 31 04:40:20 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-9[52806]: 2024-08-31T04:40:20.527+0000 7f30c0800640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-08-31T04:39:33.661151+0000 front 2024-08-31T04:39:33.661082+0000 (oldest deadline 2024-08-31T04:39:55.361248+0000) 2024-08-31T04:40:20.950 INFO:journalctl@ceph.osd.9.smithi050.stdout:Aug 31 04:40:20 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-9[52806]: 2024-08-31T04:40:20.527+0000 7f30c0800640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.133:6804 osd.1 since back 2024-08-31T04:39:41.262725+0000 front 2024-08-31T04:39:41.262699+0000 (oldest deadline 2024-08-31T04:40:05.362593+0000) 2024-08-31T04:40:20.950 INFO:journalctl@ceph.osd.9.smithi050.stdout:Aug 31 04:40:20 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-9[52806]: 2024-08-31T04:40:20.527+0000 7f30c0800640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-08-31T04:39:50.664217+0000 front 2024-08-31T04:39:50.663973+0000 (oldest deadline 2024-08-31T04:40:14.163759+0000) 2024-08-31T04:40:20.950 INFO:journalctl@ceph.osd.9.smithi050.stdout:Aug 31 04:40:20 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-9[52806]: 2024-08-31T04:40:20.527+0000 7f30c0800640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2024-08-31T04:39:55.765151+0000 front 2024-08-31T04:39:55.765209+0000 (oldest deadline 2024-08-31T04:40:19.865200+0000) 2024-08-31T04:40:20.996 INFO:journalctl@ceph.osd.8.smithi177.stdout:Aug 31 04:40:20 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-8[40333]: 2024-08-31T04:40:20.667+0000 7f244221a640 -1 osd.8 83 heartbeat_check: no reply from 172.21.15.133:6804 osd.1 since back 2024-08-31T04:39:41.888896+0000 front 2024-08-31T04:39:41.888953+0000 (oldest deadline 2024-08-31T04:40:03.588900+0000) 2024-08-31T04:40:20.996 INFO:journalctl@ceph.osd.8.smithi177.stdout:Aug 31 04:40:20 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-8[40333]: 2024-08-31T04:40:20.667+0000 7f244221a640 -1 osd.8 83 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-08-31T04:39:48.790419+0000 front 2024-08-31T04:39:48.790532+0000 (oldest deadline 2024-08-31T04:40:12.890634+0000) 2024-08-31T04:40:21.043 INFO:journalctl@ceph.osd.7.smithi133.stdout:Aug 31 04:40:20 smithi133 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-7[40256]: 2024-08-31T04:40:20.588+0000 7fd8eda41640 -1 osd.7 83 heartbeat_check: no reply from 172.21.15.133:6804 osd.1 since back 2024-08-31T04:39:39.987526+0000 front 2024-08-31T04:39:39.987404+0000 (oldest deadline 2024-08-31T04:40:04.087555+0000) 2024-08-31T04:40:21.043 INFO:journalctl@ceph.osd.7.smithi133.stdout:Aug 31 04:40:20 smithi133 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-7[40256]: 2024-08-31T04:40:20.588+0000 7fd8eda41640 -1 osd.7 83 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-08-31T04:39:47.588581+0000 front 2024-08-31T04:39:47.588740+0000 (oldest deadline 2024-08-31T04:40:13.488665+0000) 2024-08-31T04:40:21.543 INFO:journalctl@ceph.osd.10.smithi133.stdout:Aug 31 04:40:21 smithi133 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-10[46762]: 2024-08-31T04:40:21.110+0000 7f873f3e9640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-08-31T04:39:32.936397+0000 front 2024-08-31T04:39:32.936196+0000 (oldest deadline 2024-08-31T04:39:55.836336+0000) 2024-08-31T04:40:21.543 INFO:journalctl@ceph.osd.10.smithi133.stdout:Aug 31 04:40:21 smithi133 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-10[46762]: 2024-08-31T04:40:21.110+0000 7f873f3e9640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.133:6804 osd.1 since back 2024-08-31T04:39:40.537248+0000 front 2024-08-31T04:39:40.537370+0000 (oldest deadline 2024-08-31T04:40:06.437470+0000) 2024-08-31T04:40:21.543 INFO:journalctl@ceph.osd.10.smithi133.stdout:Aug 31 04:40:21 smithi133 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-10[46762]: 2024-08-31T04:40:21.110+0000 7f873f3e9640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-08-31T04:39:50.438807+0000 front 2024-08-31T04:39:50.438655+0000 (oldest deadline 2024-08-31T04:40:11.538621+0000) 2024-08-31T04:40:21.543 INFO:journalctl@ceph.osd.10.smithi133.stdout:Aug 31 04:40:21 smithi133 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-10[46762]: 2024-08-31T04:40:21.110+0000 7f873f3e9640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2024-08-31T04:39:55.639898+0000 front 2024-08-31T04:39:55.639930+0000 (oldest deadline 2024-08-31T04:40:20.939655+0000) 2024-08-31T04:40:21.700 INFO:journalctl@ceph.osd.6.smithi050.stdout:Aug 31 04:40:21 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-6[46267]: 2024-08-31T04:40:21.292+0000 7efc67a00640 -1 osd.6 83 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-08-31T04:39:30.285999+0000 front 2024-08-31T04:39:30.286080+0000 (oldest deadline 2024-08-31T04:39:56.186016+0000) 2024-08-31T04:40:21.700 INFO:journalctl@ceph.osd.6.smithi050.stdout:Aug 31 04:40:21 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-6[46267]: 2024-08-31T04:40:21.292+0000 7efc67a00640 -1 osd.6 83 heartbeat_check: no reply from 172.21.15.133:6804 osd.1 since back 2024-08-31T04:39:41.487497+0000 front 2024-08-31T04:39:41.487305+0000 (oldest deadline 2024-08-31T04:40:04.387393+0000) 2024-08-31T04:40:21.700 INFO:journalctl@ceph.osd.6.smithi050.stdout:Aug 31 04:40:21 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-6[46267]: 2024-08-31T04:40:21.292+0000 7efc67a00640 -1 osd.6 83 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-08-31T04:39:48.989169+0000 front 2024-08-31T04:39:48.989070+0000 (oldest deadline 2024-08-31T04:40:14.889176+0000) 2024-08-31T04:40:21.700 INFO:journalctl@ceph.osd.6.smithi050.stdout:Aug 31 04:40:21 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-6[46267]: 2024-08-31T04:40:21.292+0000 7efc67a00640 -1 osd.6 83 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2024-08-31T04:39:58.390266+0000 front 2024-08-31T04:39:58.390201+0000 (oldest deadline 2024-08-31T04:40:19.490182+0000) 2024-08-31T04:40:21.701 INFO:journalctl@ceph.osd.9.smithi050.stdout:Aug 31 04:40:21 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-9[52806]: 2024-08-31T04:40:21.514+0000 7f30c0800640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-08-31T04:39:33.661151+0000 front 2024-08-31T04:39:33.661082+0000 (oldest deadline 2024-08-31T04:39:55.361248+0000) 2024-08-31T04:40:21.701 INFO:journalctl@ceph.osd.9.smithi050.stdout:Aug 31 04:40:21 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-9[52806]: 2024-08-31T04:40:21.514+0000 7f30c0800640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.133:6804 osd.1 since back 2024-08-31T04:39:41.262725+0000 front 2024-08-31T04:39:41.262699+0000 (oldest deadline 2024-08-31T04:40:05.362593+0000) 2024-08-31T04:40:21.701 INFO:journalctl@ceph.osd.9.smithi050.stdout:Aug 31 04:40:21 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-9[52806]: 2024-08-31T04:40:21.514+0000 7f30c0800640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-08-31T04:39:50.664217+0000 front 2024-08-31T04:39:50.663973+0000 (oldest deadline 2024-08-31T04:40:14.163759+0000) 2024-08-31T04:40:21.701 INFO:journalctl@ceph.osd.9.smithi050.stdout:Aug 31 04:40:21 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-9[52806]: 2024-08-31T04:40:21.514+0000 7f30c0800640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2024-08-31T04:39:55.765151+0000 front 2024-08-31T04:39:55.765209+0000 (oldest deadline 2024-08-31T04:40:19.865200+0000) 2024-08-31T04:40:21.709 INFO:journalctl@ceph.osd.11.smithi177.stdout:Aug 31 04:40:21 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-11[46864]: 2024-08-31T04:40:21.270+0000 7fd602bf1640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-08-31T04:39:30.036711+0000 front 2024-08-31T04:39:30.036747+0000 (oldest deadline 2024-08-31T04:39:55.936674+0000) 2024-08-31T04:40:21.709 INFO:journalctl@ceph.osd.11.smithi177.stdout:Aug 31 04:40:21 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-11[46864]: 2024-08-31T04:40:21.270+0000 7fd602bf1640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.133:6804 osd.1 since back 2024-08-31T04:39:41.138475+0000 front 2024-08-31T04:39:41.138491+0000 (oldest deadline 2024-08-31T04:40:04.038356+0000) 2024-08-31T04:40:21.709 INFO:journalctl@ceph.osd.11.smithi177.stdout:Aug 31 04:40:21 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-11[46864]: 2024-08-31T04:40:21.270+0000 7fd602bf1640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-08-31T04:39:46.939525+0000 front 2024-08-31T04:39:46.939251+0000 (oldest deadline 2024-08-31T04:40:12.239391+0000) 2024-08-31T04:40:21.983 INFO:journalctl@ceph.osd.8.smithi177.stdout:Aug 31 04:40:21 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-8[40333]: 2024-08-31T04:40:21.708+0000 7f244221a640 -1 osd.8 83 heartbeat_check: no reply from 172.21.15.133:6804 osd.1 since back 2024-08-31T04:39:41.888896+0000 front 2024-08-31T04:39:41.888953+0000 (oldest deadline 2024-08-31T04:40:03.588900+0000) 2024-08-31T04:40:21.983 INFO:journalctl@ceph.osd.8.smithi177.stdout:Aug 31 04:40:21 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-8[40333]: 2024-08-31T04:40:21.708+0000 7f244221a640 -1 osd.8 83 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-08-31T04:39:48.790419+0000 front 2024-08-31T04:39:48.790532+0000 (oldest deadline 2024-08-31T04:40:12.890634+0000) 2024-08-31T04:40:22.042 INFO:journalctl@ceph.osd.7.smithi133.stdout:Aug 31 04:40:21 smithi133 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-7[40256]: 2024-08-31T04:40:21.589+0000 7fd8eda41640 -1 osd.7 83 heartbeat_check: no reply from 172.21.15.133:6804 osd.1 since back 2024-08-31T04:39:39.987526+0000 front 2024-08-31T04:39:39.987404+0000 (oldest deadline 2024-08-31T04:40:04.087555+0000) 2024-08-31T04:40:22.043 INFO:journalctl@ceph.osd.7.smithi133.stdout:Aug 31 04:40:21 smithi133 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-7[40256]: 2024-08-31T04:40:21.589+0000 7fd8eda41640 -1 osd.7 83 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-08-31T04:39:47.588581+0000 front 2024-08-31T04:39:47.588740+0000 (oldest deadline 2024-08-31T04:40:13.488665+0000) 2024-08-31T04:40:22.246 INFO:journalctl@ceph.osd.11.smithi177.stdout:Aug 31 04:40:22 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-11[46864]: 2024-08-31T04:40:22.227+0000 7fd602bf1640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-08-31T04:39:30.036711+0000 front 2024-08-31T04:39:30.036747+0000 (oldest deadline 2024-08-31T04:39:55.936674+0000) 2024-08-31T04:40:22.246 INFO:journalctl@ceph.osd.11.smithi177.stdout:Aug 31 04:40:22 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-11[46864]: 2024-08-31T04:40:22.227+0000 7fd602bf1640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.133:6804 osd.1 since back 2024-08-31T04:39:41.138475+0000 front 2024-08-31T04:39:41.138491+0000 (oldest deadline 2024-08-31T04:40:04.038356+0000) 2024-08-31T04:40:22.246 INFO:journalctl@ceph.osd.11.smithi177.stdout:Aug 31 04:40:22 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-11[46864]: 2024-08-31T04:40:22.227+0000 7fd602bf1640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-08-31T04:39:46.939525+0000 front 2024-08-31T04:39:46.939251+0000 (oldest deadline 2024-08-31T04:40:12.239391+0000) 2024-08-31T04:40:22.543 INFO:journalctl@ceph.osd.10.smithi133.stdout:Aug 31 04:40:22 smithi133 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-10[46762]: 2024-08-31T04:40:22.091+0000 7f873f3e9640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-08-31T04:39:32.936397+0000 front 2024-08-31T04:39:32.936196+0000 (oldest deadline 2024-08-31T04:39:55.836336+0000) 2024-08-31T04:40:22.543 INFO:journalctl@ceph.osd.10.smithi133.stdout:Aug 31 04:40:22 smithi133 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-10[46762]: 2024-08-31T04:40:22.091+0000 7f873f3e9640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.133:6804 osd.1 since back 2024-08-31T04:39:40.537248+0000 front 2024-08-31T04:39:40.537370+0000 (oldest deadline 2024-08-31T04:40:06.437470+0000) 2024-08-31T04:40:22.543 INFO:journalctl@ceph.osd.10.smithi133.stdout:Aug 31 04:40:22 smithi133 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-10[46762]: 2024-08-31T04:40:22.091+0000 7f873f3e9640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-08-31T04:39:50.438807+0000 front 2024-08-31T04:39:50.438655+0000 (oldest deadline 2024-08-31T04:40:11.538621+0000) 2024-08-31T04:40:22.543 INFO:journalctl@ceph.osd.10.smithi133.stdout:Aug 31 04:40:22 smithi133 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-10[46762]: 2024-08-31T04:40:22.091+0000 7f873f3e9640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2024-08-31T04:39:55.639898+0000 front 2024-08-31T04:39:55.639930+0000 (oldest deadline 2024-08-31T04:40:20.939655+0000) 2024-08-31T04:40:22.700 INFO:journalctl@ceph.osd.6.smithi050.stdout:Aug 31 04:40:22 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-6[46267]: 2024-08-31T04:40:22.306+0000 7efc67a00640 -1 osd.6 83 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-08-31T04:39:30.285999+0000 front 2024-08-31T04:39:30.286080+0000 (oldest deadline 2024-08-31T04:39:56.186016+0000) 2024-08-31T04:40:22.700 INFO:journalctl@ceph.osd.6.smithi050.stdout:Aug 31 04:40:22 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-6[46267]: 2024-08-31T04:40:22.306+0000 7efc67a00640 -1 osd.6 83 heartbeat_check: no reply from 172.21.15.133:6804 osd.1 since back 2024-08-31T04:39:41.487497+0000 front 2024-08-31T04:39:41.487305+0000 (oldest deadline 2024-08-31T04:40:04.387393+0000) 2024-08-31T04:40:22.700 INFO:journalctl@ceph.osd.6.smithi050.stdout:Aug 31 04:40:22 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-6[46267]: 2024-08-31T04:40:22.306+0000 7efc67a00640 -1 osd.6 83 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-08-31T04:39:48.989169+0000 front 2024-08-31T04:39:48.989070+0000 (oldest deadline 2024-08-31T04:40:14.889176+0000) 2024-08-31T04:40:22.700 INFO:journalctl@ceph.osd.6.smithi050.stdout:Aug 31 04:40:22 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-6[46267]: 2024-08-31T04:40:22.306+0000 7efc67a00640 -1 osd.6 83 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2024-08-31T04:39:58.390266+0000 front 2024-08-31T04:39:58.390201+0000 (oldest deadline 2024-08-31T04:40:19.490182+0000) 2024-08-31T04:40:22.701 INFO:journalctl@ceph.osd.9.smithi050.stdout:Aug 31 04:40:22 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-9[52806]: 2024-08-31T04:40:22.472+0000 7f30c0800640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-08-31T04:39:33.661151+0000 front 2024-08-31T04:39:33.661082+0000 (oldest deadline 2024-08-31T04:39:55.361248+0000) 2024-08-31T04:40:22.701 INFO:journalctl@ceph.osd.9.smithi050.stdout:Aug 31 04:40:22 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-9[52806]: 2024-08-31T04:40:22.472+0000 7f30c0800640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.133:6804 osd.1 since back 2024-08-31T04:39:41.262725+0000 front 2024-08-31T04:39:41.262699+0000 (oldest deadline 2024-08-31T04:40:05.362593+0000) 2024-08-31T04:40:22.701 INFO:journalctl@ceph.osd.9.smithi050.stdout:Aug 31 04:40:22 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-9[52806]: 2024-08-31T04:40:22.472+0000 7f30c0800640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-08-31T04:39:50.664217+0000 front 2024-08-31T04:39:50.663973+0000 (oldest deadline 2024-08-31T04:40:14.163759+0000) 2024-08-31T04:40:22.701 INFO:journalctl@ceph.osd.9.smithi050.stdout:Aug 31 04:40:22 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-9[52806]: 2024-08-31T04:40:22.472+0000 7f30c0800640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2024-08-31T04:39:55.765151+0000 front 2024-08-31T04:39:55.765209+0000 (oldest deadline 2024-08-31T04:40:19.865200+0000) 2024-08-31T04:40:23.043 INFO:journalctl@ceph.osd.7.smithi133.stdout:Aug 31 04:40:22 smithi133 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-7[40256]: 2024-08-31T04:40:22.615+0000 7fd8eda41640 -1 osd.7 83 heartbeat_check: no reply from 172.21.15.133:6804 osd.1 since back 2024-08-31T04:39:39.987526+0000 front 2024-08-31T04:39:39.987404+0000 (oldest deadline 2024-08-31T04:40:04.087555+0000) 2024-08-31T04:40:23.043 INFO:journalctl@ceph.osd.7.smithi133.stdout:Aug 31 04:40:22 smithi133 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-7[40256]: 2024-08-31T04:40:22.615+0000 7fd8eda41640 -1 osd.7 83 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-08-31T04:39:47.588581+0000 front 2024-08-31T04:39:47.588740+0000 (oldest deadline 2024-08-31T04:40:13.488665+0000) 2024-08-31T04:40:23.043 INFO:journalctl@ceph.osd.7.smithi133.stdout:Aug 31 04:40:22 smithi133 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-7[40256]: 2024-08-31T04:40:22.615+0000 7fd8eda41640 -1 osd.7 83 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2024-08-31T04:39:57.490072+0000 front 2024-08-31T04:39:57.490155+0000 (oldest deadline 2024-08-31T04:40:22.190033+0000) 2024-08-31T04:40:23.235 INFO:journalctl@ceph.osd.8.smithi177.stdout:Aug 31 04:40:22 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-8[40333]: 2024-08-31T04:40:22.751+0000 7f244221a640 -1 osd.8 83 heartbeat_check: no reply from 172.21.15.133:6804 osd.1 since back 2024-08-31T04:39:41.888896+0000 front 2024-08-31T04:39:41.888953+0000 (oldest deadline 2024-08-31T04:40:03.588900+0000) 2024-08-31T04:40:23.235 INFO:journalctl@ceph.osd.8.smithi177.stdout:Aug 31 04:40:22 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-8[40333]: 2024-08-31T04:40:22.751+0000 7f244221a640 -1 osd.8 83 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-08-31T04:39:48.790419+0000 front 2024-08-31T04:39:48.790532+0000 (oldest deadline 2024-08-31T04:40:12.890634+0000) 2024-08-31T04:40:23.496 INFO:journalctl@ceph.osd.11.smithi177.stdout:Aug 31 04:40:23 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-11[46864]: 2024-08-31T04:40:23.234+0000 7fd602bf1640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-08-31T04:39:30.036711+0000 front 2024-08-31T04:39:30.036747+0000 (oldest deadline 2024-08-31T04:39:55.936674+0000) 2024-08-31T04:40:23.496 INFO:journalctl@ceph.osd.11.smithi177.stdout:Aug 31 04:40:23 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-11[46864]: 2024-08-31T04:40:23.234+0000 7fd602bf1640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.133:6804 osd.1 since back 2024-08-31T04:39:41.138475+0000 front 2024-08-31T04:39:41.138491+0000 (oldest deadline 2024-08-31T04:40:04.038356+0000) 2024-08-31T04:40:23.496 INFO:journalctl@ceph.osd.11.smithi177.stdout:Aug 31 04:40:23 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-11[46864]: 2024-08-31T04:40:23.234+0000 7fd602bf1640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-08-31T04:39:46.939525+0000 front 2024-08-31T04:39:46.939251+0000 (oldest deadline 2024-08-31T04:40:12.239391+0000) 2024-08-31T04:40:23.543 INFO:journalctl@ceph.osd.10.smithi133.stdout:Aug 31 04:40:23 smithi133 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-10[46762]: 2024-08-31T04:40:23.137+0000 7f873f3e9640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-08-31T04:39:32.936397+0000 front 2024-08-31T04:39:32.936196+0000 (oldest deadline 2024-08-31T04:39:55.836336+0000) 2024-08-31T04:40:23.543 INFO:journalctl@ceph.osd.10.smithi133.stdout:Aug 31 04:40:23 smithi133 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-10[46762]: 2024-08-31T04:40:23.137+0000 7f873f3e9640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.133:6804 osd.1 since back 2024-08-31T04:39:40.537248+0000 front 2024-08-31T04:39:40.537370+0000 (oldest deadline 2024-08-31T04:40:06.437470+0000) 2024-08-31T04:40:23.543 INFO:journalctl@ceph.osd.10.smithi133.stdout:Aug 31 04:40:23 smithi133 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-10[46762]: 2024-08-31T04:40:23.137+0000 7f873f3e9640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-08-31T04:39:50.438807+0000 front 2024-08-31T04:39:50.438655+0000 (oldest deadline 2024-08-31T04:40:11.538621+0000) 2024-08-31T04:40:23.543 INFO:journalctl@ceph.osd.10.smithi133.stdout:Aug 31 04:40:23 smithi133 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-10[46762]: 2024-08-31T04:40:23.137+0000 7f873f3e9640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2024-08-31T04:39:55.639898+0000 front 2024-08-31T04:39:55.639930+0000 (oldest deadline 2024-08-31T04:40:20.939655+0000) 2024-08-31T04:40:23.856 INFO:journalctl@ceph.osd.6.smithi050.stdout:Aug 31 04:40:23 smithi050 podman[87931]: 2024-08-31 04:40:23.537439688 +0000 UTC m=+5.573589491 container died 6858ecdc2a717741842e5e5474bde58ac6baec06fb3556aef81969f1f3e72361 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-6, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, maintainer=Guillaume Abrioux , io.buildah.version=1.37.1, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_BRANCH=HEAD) 2024-08-31T04:40:23.856 INFO:journalctl@ceph.osd.9.smithi050.stdout:Aug 31 04:40:23 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-9[52806]: 2024-08-31T04:40:23.449+0000 7f30c0800640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-08-31T04:39:33.661151+0000 front 2024-08-31T04:39:33.661082+0000 (oldest deadline 2024-08-31T04:39:55.361248+0000) 2024-08-31T04:40:23.857 INFO:journalctl@ceph.osd.9.smithi050.stdout:Aug 31 04:40:23 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-9[52806]: 2024-08-31T04:40:23.449+0000 7f30c0800640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.133:6804 osd.1 since back 2024-08-31T04:39:41.262725+0000 front 2024-08-31T04:39:41.262699+0000 (oldest deadline 2024-08-31T04:40:05.362593+0000) 2024-08-31T04:40:23.857 INFO:journalctl@ceph.osd.9.smithi050.stdout:Aug 31 04:40:23 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-9[52806]: 2024-08-31T04:40:23.449+0000 7f30c0800640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-08-31T04:39:50.664217+0000 front 2024-08-31T04:39:50.663973+0000 (oldest deadline 2024-08-31T04:40:14.163759+0000) 2024-08-31T04:40:23.857 INFO:journalctl@ceph.osd.9.smithi050.stdout:Aug 31 04:40:23 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-9[52806]: 2024-08-31T04:40:23.449+0000 7f30c0800640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2024-08-31T04:39:55.765151+0000 front 2024-08-31T04:39:55.765209+0000 (oldest deadline 2024-08-31T04:40:19.865200+0000) 2024-08-31T04:40:24.043 INFO:journalctl@ceph.osd.7.smithi133.stdout:Aug 31 04:40:23 smithi133 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-7[40256]: 2024-08-31T04:40:23.664+0000 7fd8eda41640 -1 osd.7 83 heartbeat_check: no reply from 172.21.15.133:6804 osd.1 since back 2024-08-31T04:39:39.987526+0000 front 2024-08-31T04:39:39.987404+0000 (oldest deadline 2024-08-31T04:40:04.087555+0000) 2024-08-31T04:40:24.043 INFO:journalctl@ceph.osd.7.smithi133.stdout:Aug 31 04:40:23 smithi133 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-7[40256]: 2024-08-31T04:40:23.664+0000 7fd8eda41640 -1 osd.7 83 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-08-31T04:39:47.588581+0000 front 2024-08-31T04:39:47.588740+0000 (oldest deadline 2024-08-31T04:40:13.488665+0000) 2024-08-31T04:40:24.043 INFO:journalctl@ceph.osd.7.smithi133.stdout:Aug 31 04:40:23 smithi133 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-7[40256]: 2024-08-31T04:40:23.664+0000 7fd8eda41640 -1 osd.7 83 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2024-08-31T04:39:57.490072+0000 front 2024-08-31T04:39:57.490155+0000 (oldest deadline 2024-08-31T04:40:22.190033+0000) 2024-08-31T04:40:24.200 INFO:journalctl@ceph.osd.6.smithi050.stdout:Aug 31 04:40:23 smithi050 podman[87931]: 2024-08-31 04:40:23.986480857 +0000 UTC m=+6.022630660 container cleanup 6858ecdc2a717741842e5e5474bde58ac6baec06fb3556aef81969f1f3e72361 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-6, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, io.buildah.version=1.37.1, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731) 2024-08-31T04:40:24.201 INFO:journalctl@ceph.osd.6.smithi050.stdout:Aug 31 04:40:23 smithi050 bash[87931]: ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-6 2024-08-31T04:40:24.204 INFO:journalctl@ceph.osd.8.smithi177.stdout:Aug 31 04:40:23 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-8[40333]: 2024-08-31T04:40:23.774+0000 7f244221a640 -1 osd.8 83 heartbeat_check: no reply from 172.21.15.133:6804 osd.1 since back 2024-08-31T04:39:41.888896+0000 front 2024-08-31T04:39:41.888953+0000 (oldest deadline 2024-08-31T04:40:03.588900+0000) 2024-08-31T04:40:24.204 INFO:journalctl@ceph.osd.8.smithi177.stdout:Aug 31 04:40:23 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-8[40333]: 2024-08-31T04:40:23.774+0000 7f244221a640 -1 osd.8 83 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-08-31T04:39:48.790419+0000 front 2024-08-31T04:39:48.790532+0000 (oldest deadline 2024-08-31T04:40:12.890634+0000) 2024-08-31T04:40:24.205 INFO:journalctl@ceph.osd.8.smithi177.stdout:Aug 31 04:40:23 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-8[40333]: 2024-08-31T04:40:23.774+0000 7f244221a640 -1 osd.8 83 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2024-08-31T04:39:58.792110+0000 front 2024-08-31T04:39:58.792093+0000 (oldest deadline 2024-08-31T04:40:23.491915+0000) 2024-08-31T04:40:24.496 INFO:journalctl@ceph.osd.11.smithi177.stdout:Aug 31 04:40:24 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-11[46864]: 2024-08-31T04:40:24.203+0000 7fd602bf1640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-08-31T04:39:30.036711+0000 front 2024-08-31T04:39:30.036747+0000 (oldest deadline 2024-08-31T04:39:55.936674+0000) 2024-08-31T04:40:24.496 INFO:journalctl@ceph.osd.11.smithi177.stdout:Aug 31 04:40:24 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-11[46864]: 2024-08-31T04:40:24.203+0000 7fd602bf1640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.133:6804 osd.1 since back 2024-08-31T04:39:41.138475+0000 front 2024-08-31T04:39:41.138491+0000 (oldest deadline 2024-08-31T04:40:04.038356+0000) 2024-08-31T04:40:24.496 INFO:journalctl@ceph.osd.11.smithi177.stdout:Aug 31 04:40:24 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-11[46864]: 2024-08-31T04:40:24.203+0000 7fd602bf1640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-08-31T04:39:46.939525+0000 front 2024-08-31T04:39:46.939251+0000 (oldest deadline 2024-08-31T04:40:12.239391+0000) 2024-08-31T04:40:24.543 INFO:journalctl@ceph.osd.10.smithi133.stdout:Aug 31 04:40:24 smithi133 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-10[46762]: 2024-08-31T04:40:24.102+0000 7f873f3e9640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-08-31T04:39:32.936397+0000 front 2024-08-31T04:39:32.936196+0000 (oldest deadline 2024-08-31T04:39:55.836336+0000) 2024-08-31T04:40:24.543 INFO:journalctl@ceph.osd.10.smithi133.stdout:Aug 31 04:40:24 smithi133 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-10[46762]: 2024-08-31T04:40:24.102+0000 7f873f3e9640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.133:6804 osd.1 since back 2024-08-31T04:39:40.537248+0000 front 2024-08-31T04:39:40.537370+0000 (oldest deadline 2024-08-31T04:40:06.437470+0000) 2024-08-31T04:40:24.543 INFO:journalctl@ceph.osd.10.smithi133.stdout:Aug 31 04:40:24 smithi133 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-10[46762]: 2024-08-31T04:40:24.102+0000 7f873f3e9640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-08-31T04:39:50.438807+0000 front 2024-08-31T04:39:50.438655+0000 (oldest deadline 2024-08-31T04:40:11.538621+0000) 2024-08-31T04:40:24.543 INFO:journalctl@ceph.osd.10.smithi133.stdout:Aug 31 04:40:24 smithi133 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-10[46762]: 2024-08-31T04:40:24.102+0000 7f873f3e9640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2024-08-31T04:39:55.639898+0000 front 2024-08-31T04:39:55.639930+0000 (oldest deadline 2024-08-31T04:40:20.939655+0000) 2024-08-31T04:40:24.700 INFO:journalctl@ceph.osd.6.smithi050.stdout:Aug 31 04:40:24 smithi050 podman[87947]: 2024-08-31 04:40:24.263416042 +0000 UTC m=+0.722192033 container remove 6858ecdc2a717741842e5e5474bde58ac6baec06fb3556aef81969f1f3e72361 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-6, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, io.buildah.version=1.37.1, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, ceph=True, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD) 2024-08-31T04:40:24.700 INFO:journalctl@ceph.osd.9.smithi050.stdout:Aug 31 04:40:24 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-9[52806]: 2024-08-31T04:40:24.414+0000 7f30c0800640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-08-31T04:39:33.661151+0000 front 2024-08-31T04:39:33.661082+0000 (oldest deadline 2024-08-31T04:39:55.361248+0000) 2024-08-31T04:40:24.700 INFO:journalctl@ceph.osd.9.smithi050.stdout:Aug 31 04:40:24 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-9[52806]: 2024-08-31T04:40:24.414+0000 7f30c0800640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.133:6804 osd.1 since back 2024-08-31T04:39:41.262725+0000 front 2024-08-31T04:39:41.262699+0000 (oldest deadline 2024-08-31T04:40:05.362593+0000) 2024-08-31T04:40:24.700 INFO:journalctl@ceph.osd.9.smithi050.stdout:Aug 31 04:40:24 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-9[52806]: 2024-08-31T04:40:24.414+0000 7f30c0800640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-08-31T04:39:50.664217+0000 front 2024-08-31T04:39:50.663973+0000 (oldest deadline 2024-08-31T04:40:14.163759+0000) 2024-08-31T04:40:24.700 INFO:journalctl@ceph.osd.9.smithi050.stdout:Aug 31 04:40:24 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-9[52806]: 2024-08-31T04:40:24.414+0000 7f30c0800640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2024-08-31T04:39:55.765151+0000 front 2024-08-31T04:39:55.765209+0000 (oldest deadline 2024-08-31T04:40:19.865200+0000) 2024-08-31T04:40:25.045 INFO:journalctl@ceph.osd.7.smithi133.stdout:Aug 31 04:40:24 smithi133 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-7[40256]: 2024-08-31T04:40:24.647+0000 7fd8eda41640 -1 osd.7 83 heartbeat_check: no reply from 172.21.15.133:6804 osd.1 since back 2024-08-31T04:39:39.987526+0000 front 2024-08-31T04:39:39.987404+0000 (oldest deadline 2024-08-31T04:40:04.087555+0000) 2024-08-31T04:40:25.045 INFO:journalctl@ceph.osd.7.smithi133.stdout:Aug 31 04:40:24 smithi133 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-7[40256]: 2024-08-31T04:40:24.647+0000 7fd8eda41640 -1 osd.7 83 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-08-31T04:39:47.588581+0000 front 2024-08-31T04:39:47.588740+0000 (oldest deadline 2024-08-31T04:40:13.488665+0000) 2024-08-31T04:40:25.045 INFO:journalctl@ceph.osd.7.smithi133.stdout:Aug 31 04:40:24 smithi133 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-7[40256]: 2024-08-31T04:40:24.647+0000 7fd8eda41640 -1 osd.7 83 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2024-08-31T04:39:57.490072+0000 front 2024-08-31T04:39:57.490155+0000 (oldest deadline 2024-08-31T04:40:22.190033+0000) 2024-08-31T04:40:25.159 INFO:journalctl@ceph.osd.6.smithi050.stdout:Aug 31 04:40:24 smithi050 podman[88031]: 2024-08-31 04:40:24.709689322 +0000 UTC m=+0.028173684 image pull 79f4cde5e36911a5dca995eeb98098c2c8aae81dd52a088ef2c867bc3363bad0 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61 2024-08-31T04:40:25.159 INFO:journalctl@ceph.osd.6.smithi050.stdout:Aug 31 04:40:24 smithi050 podman[88031]: 2024-08-31 04:40:24.814436213 +0000 UTC m=+0.132920535 container create b9cfc31c6729d4b98fb92b49abc2cc14d6ed559dcd90033f4fa962fc21649d89 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-6-deactivate, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, io.buildah.version=1.37.1, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.build-date=20240731) 2024-08-31T04:40:25.159 INFO:journalctl@ceph.osd.6.smithi050.stdout:Aug 31 04:40:25 smithi050 podman[88031]: 2024-08-31 04:40:25.033542745 +0000 UTC m=+0.352027093 container init b9cfc31c6729d4b98fb92b49abc2cc14d6ed559dcd90033f4fa962fc21649d89 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-6-deactivate, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , io.buildah.version=1.37.1, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.schema-version=1.0) 2024-08-31T04:40:25.159 INFO:journalctl@ceph.osd.6.smithi050.stdout:Aug 31 04:40:25 smithi050 podman[88031]: 2024-08-31 04:40:25.040234037 +0000 UTC m=+0.358718360 container start b9cfc31c6729d4b98fb92b49abc2cc14d6ed559dcd90033f4fa962fc21649d89 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-6-deactivate, maintainer=Guillaume Abrioux , io.buildah.version=1.37.1, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.license=GPLv2, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-08-31T04:40:25.159 INFO:journalctl@ceph.osd.6.smithi050.stdout:Aug 31 04:40:25 smithi050 podman[88031]: 2024-08-31 04:40:25.158392084 +0000 UTC m=+0.476876407 container attach b9cfc31c6729d4b98fb92b49abc2cc14d6ed559dcd90033f4fa962fc21649d89 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-6-deactivate, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.license=GPLv2, ceph=True, maintainer=Guillaume Abrioux , io.buildah.version=1.37.1, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0) 2024-08-31T04:40:25.181 INFO:journalctl@ceph.osd.8.smithi177.stdout:Aug 31 04:40:24 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-8[40333]: 2024-08-31T04:40:24.763+0000 7f244221a640 -1 osd.8 83 heartbeat_check: no reply from 172.21.15.133:6804 osd.1 since back 2024-08-31T04:39:41.888896+0000 front 2024-08-31T04:39:41.888953+0000 (oldest deadline 2024-08-31T04:40:03.588900+0000) 2024-08-31T04:40:25.181 INFO:journalctl@ceph.osd.8.smithi177.stdout:Aug 31 04:40:24 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-8[40333]: 2024-08-31T04:40:24.763+0000 7f244221a640 -1 osd.8 83 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-08-31T04:39:48.790419+0000 front 2024-08-31T04:39:48.790532+0000 (oldest deadline 2024-08-31T04:40:12.890634+0000) 2024-08-31T04:40:25.181 INFO:journalctl@ceph.osd.8.smithi177.stdout:Aug 31 04:40:24 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-8[40333]: 2024-08-31T04:40:24.763+0000 7f244221a640 -1 osd.8 83 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2024-08-31T04:39:58.792110+0000 front 2024-08-31T04:39:58.792093+0000 (oldest deadline 2024-08-31T04:40:23.491915+0000) 2024-08-31T04:40:25.421 INFO:journalctl@ceph.osd.6.smithi050.stdout:Aug 31 04:40:25 smithi050 podman[88031]: 2024-08-31 04:40:25.306663025 +0000 UTC m=+0.625147349 container died b9cfc31c6729d4b98fb92b49abc2cc14d6ed559dcd90033f4fa962fc21649d89 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-6-deactivate, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.license=GPLv2, io.buildah.version=1.37.1, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-08-31T04:40:25.496 INFO:journalctl@ceph.osd.11.smithi177.stdout:Aug 31 04:40:25 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-11[46864]: 2024-08-31T04:40:25.180+0000 7fd602bf1640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-08-31T04:39:30.036711+0000 front 2024-08-31T04:39:30.036747+0000 (oldest deadline 2024-08-31T04:39:55.936674+0000) 2024-08-31T04:40:25.496 INFO:journalctl@ceph.osd.11.smithi177.stdout:Aug 31 04:40:25 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-11[46864]: 2024-08-31T04:40:25.180+0000 7fd602bf1640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.133:6804 osd.1 since back 2024-08-31T04:39:41.138475+0000 front 2024-08-31T04:39:41.138491+0000 (oldest deadline 2024-08-31T04:40:04.038356+0000) 2024-08-31T04:40:25.496 INFO:journalctl@ceph.osd.11.smithi177.stdout:Aug 31 04:40:25 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-11[46864]: 2024-08-31T04:40:25.180+0000 7fd602bf1640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-08-31T04:39:46.939525+0000 front 2024-08-31T04:39:46.939251+0000 (oldest deadline 2024-08-31T04:40:12.239391+0000) 2024-08-31T04:40:25.543 INFO:journalctl@ceph.osd.10.smithi133.stdout:Aug 31 04:40:25 smithi133 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-10[46762]: 2024-08-31T04:40:25.148+0000 7f873f3e9640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-08-31T04:39:32.936397+0000 front 2024-08-31T04:39:32.936196+0000 (oldest deadline 2024-08-31T04:39:55.836336+0000) 2024-08-31T04:40:25.543 INFO:journalctl@ceph.osd.10.smithi133.stdout:Aug 31 04:40:25 smithi133 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-10[46762]: 2024-08-31T04:40:25.148+0000 7f873f3e9640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.133:6804 osd.1 since back 2024-08-31T04:39:40.537248+0000 front 2024-08-31T04:39:40.537370+0000 (oldest deadline 2024-08-31T04:40:06.437470+0000) 2024-08-31T04:40:25.543 INFO:journalctl@ceph.osd.10.smithi133.stdout:Aug 31 04:40:25 smithi133 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-10[46762]: 2024-08-31T04:40:25.148+0000 7f873f3e9640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-08-31T04:39:50.438807+0000 front 2024-08-31T04:39:50.438655+0000 (oldest deadline 2024-08-31T04:40:11.538621+0000) 2024-08-31T04:40:25.543 INFO:journalctl@ceph.osd.10.smithi133.stdout:Aug 31 04:40:25 smithi133 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-10[46762]: 2024-08-31T04:40:25.148+0000 7f873f3e9640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2024-08-31T04:39:55.639898+0000 front 2024-08-31T04:39:55.639930+0000 (oldest deadline 2024-08-31T04:40:20.939655+0000) 2024-08-31T04:40:25.686 INFO:journalctl@ceph.osd.9.smithi050.stdout:Aug 31 04:40:25 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-9[52806]: 2024-08-31T04:40:25.419+0000 7f30c0800640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-08-31T04:39:33.661151+0000 front 2024-08-31T04:39:33.661082+0000 (oldest deadline 2024-08-31T04:39:55.361248+0000) 2024-08-31T04:40:25.686 INFO:journalctl@ceph.osd.9.smithi050.stdout:Aug 31 04:40:25 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-9[52806]: 2024-08-31T04:40:25.419+0000 7f30c0800640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.133:6804 osd.1 since back 2024-08-31T04:39:41.262725+0000 front 2024-08-31T04:39:41.262699+0000 (oldest deadline 2024-08-31T04:40:05.362593+0000) 2024-08-31T04:40:25.686 INFO:journalctl@ceph.osd.9.smithi050.stdout:Aug 31 04:40:25 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-9[52806]: 2024-08-31T04:40:25.419+0000 7f30c0800640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-08-31T04:39:50.664217+0000 front 2024-08-31T04:39:50.663973+0000 (oldest deadline 2024-08-31T04:40:14.163759+0000) 2024-08-31T04:40:25.687 INFO:journalctl@ceph.osd.9.smithi050.stdout:Aug 31 04:40:25 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-9[52806]: 2024-08-31T04:40:25.419+0000 7f30c0800640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2024-08-31T04:39:55.765151+0000 front 2024-08-31T04:39:55.765209+0000 (oldest deadline 2024-08-31T04:40:19.865200+0000) 2024-08-31T04:40:25.986 DEBUG:teuthology.orchestra.run.smithi050:> sudo pkill -f 'journalctl -f -n 0 -u ceph-058d9fc6-674f-11ef-bcd4-c7b262605968@osd.6.service' 2024-08-31T04:40:26.000 INFO:journalctl@ceph.osd.6.smithi050.stdout:Aug 31 04:40:25 smithi050 podman[88054]: 2024-08-31 04:40:25.954626344 +0000 UTC m=+0.634686940 container remove b9cfc31c6729d4b98fb92b49abc2cc14d6ed559dcd90033f4fa962fc21649d89 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-6-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, io.buildah.version=1.37.1, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, ceph=True, org.label-schema.schema-version=1.0, GIT_CLEAN=True) 2024-08-31T04:40:26.000 INFO:journalctl@ceph.osd.6.smithi050.stdout:Aug 31 04:40:25 smithi050 systemd[1]: ceph-058d9fc6-674f-11ef-bcd4-c7b262605968@osd.6.service: Deactivated successfully. 2024-08-31T04:40:26.000 INFO:journalctl@ceph.osd.6.smithi050.stdout:Aug 31 04:40:25 smithi050 systemd[1]: Stopped Ceph osd.6 for 058d9fc6-674f-11ef-bcd4-c7b262605968. 2024-08-31T04:40:26.000 INFO:journalctl@ceph.osd.6.smithi050.stdout:Aug 31 04:40:25 smithi050 systemd[1]: ceph-058d9fc6-674f-11ef-bcd4-c7b262605968@osd.6.service: Consumed 2min 4.143s CPU time. 2024-08-31T04:40:26.043 INFO:journalctl@ceph.osd.7.smithi133.stdout:Aug 31 04:40:25 smithi133 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-7[40256]: 2024-08-31T04:40:25.602+0000 7fd8eda41640 -1 osd.7 83 heartbeat_check: no reply from 172.21.15.133:6804 osd.1 since back 2024-08-31T04:39:39.987526+0000 front 2024-08-31T04:39:39.987404+0000 (oldest deadline 2024-08-31T04:40:04.087555+0000) 2024-08-31T04:40:26.043 INFO:journalctl@ceph.osd.7.smithi133.stdout:Aug 31 04:40:25 smithi133 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-7[40256]: 2024-08-31T04:40:25.602+0000 7fd8eda41640 -1 osd.7 83 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-08-31T04:39:47.588581+0000 front 2024-08-31T04:39:47.588740+0000 (oldest deadline 2024-08-31T04:40:13.488665+0000) 2024-08-31T04:40:26.043 INFO:journalctl@ceph.osd.7.smithi133.stdout:Aug 31 04:40:25 smithi133 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-7[40256]: 2024-08-31T04:40:25.602+0000 7fd8eda41640 -1 osd.7 83 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2024-08-31T04:39:57.490072+0000 front 2024-08-31T04:39:57.490155+0000 (oldest deadline 2024-08-31T04:40:22.190033+0000) 2024-08-31T04:40:26.076 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-31T04:40:26.077 INFO:tasks.cephadm.osd.6:Stopped osd.6 2024-08-31T04:40:26.077 INFO:tasks.cephadm.osd.7:Stopping osd.7... 2024-08-31T04:40:26.077 DEBUG:teuthology.orchestra.run.smithi133:> sudo systemctl stop ceph-058d9fc6-674f-11ef-bcd4-c7b262605968@osd.7 2024-08-31T04:40:26.176 INFO:journalctl@ceph.osd.8.smithi177.stdout:Aug 31 04:40:25 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-8[40333]: 2024-08-31T04:40:25.767+0000 7f244221a640 -1 osd.8 83 heartbeat_check: no reply from 172.21.15.133:6804 osd.1 since back 2024-08-31T04:39:41.888896+0000 front 2024-08-31T04:39:41.888953+0000 (oldest deadline 2024-08-31T04:40:03.588900+0000) 2024-08-31T04:40:26.176 INFO:journalctl@ceph.osd.8.smithi177.stdout:Aug 31 04:40:25 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-8[40333]: 2024-08-31T04:40:25.767+0000 7f244221a640 -1 osd.8 83 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-08-31T04:39:48.790419+0000 front 2024-08-31T04:39:48.790532+0000 (oldest deadline 2024-08-31T04:40:12.890634+0000) 2024-08-31T04:40:26.176 INFO:journalctl@ceph.osd.8.smithi177.stdout:Aug 31 04:40:25 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-8[40333]: 2024-08-31T04:40:25.767+0000 7f244221a640 -1 osd.8 83 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2024-08-31T04:39:58.792110+0000 front 2024-08-31T04:39:58.792093+0000 (oldest deadline 2024-08-31T04:40:23.491915+0000) 2024-08-31T04:40:26.397 INFO:journalctl@ceph.osd.7.smithi133.stdout:Aug 31 04:40:26 smithi133 systemd[1]: Stopping Ceph osd.7 for 058d9fc6-674f-11ef-bcd4-c7b262605968... 2024-08-31T04:40:26.397 INFO:journalctl@ceph.osd.10.smithi133.stdout:Aug 31 04:40:26 smithi133 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-10[46762]: 2024-08-31T04:40:26.119+0000 7f873f3e9640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-08-31T04:39:32.936397+0000 front 2024-08-31T04:39:32.936196+0000 (oldest deadline 2024-08-31T04:39:55.836336+0000) 2024-08-31T04:40:26.397 INFO:journalctl@ceph.osd.10.smithi133.stdout:Aug 31 04:40:26 smithi133 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-10[46762]: 2024-08-31T04:40:26.119+0000 7f873f3e9640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.133:6804 osd.1 since back 2024-08-31T04:39:40.537248+0000 front 2024-08-31T04:39:40.537370+0000 (oldest deadline 2024-08-31T04:40:06.437470+0000) 2024-08-31T04:40:26.397 INFO:journalctl@ceph.osd.10.smithi133.stdout:Aug 31 04:40:26 smithi133 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-10[46762]: 2024-08-31T04:40:26.119+0000 7f873f3e9640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-08-31T04:39:50.438807+0000 front 2024-08-31T04:39:50.438655+0000 (oldest deadline 2024-08-31T04:40:11.538621+0000) 2024-08-31T04:40:26.397 INFO:journalctl@ceph.osd.10.smithi133.stdout:Aug 31 04:40:26 smithi133 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-10[46762]: 2024-08-31T04:40:26.119+0000 7f873f3e9640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2024-08-31T04:39:55.639898+0000 front 2024-08-31T04:39:55.639930+0000 (oldest deadline 2024-08-31T04:40:20.939655+0000) 2024-08-31T04:40:26.496 INFO:journalctl@ceph.osd.11.smithi177.stdout:Aug 31 04:40:26 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-11[46864]: 2024-08-31T04:40:26.175+0000 7fd602bf1640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-08-31T04:39:30.036711+0000 front 2024-08-31T04:39:30.036747+0000 (oldest deadline 2024-08-31T04:39:55.936674+0000) 2024-08-31T04:40:26.496 INFO:journalctl@ceph.osd.11.smithi177.stdout:Aug 31 04:40:26 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-11[46864]: 2024-08-31T04:40:26.175+0000 7fd602bf1640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.133:6804 osd.1 since back 2024-08-31T04:39:41.138475+0000 front 2024-08-31T04:39:41.138491+0000 (oldest deadline 2024-08-31T04:40:04.038356+0000) 2024-08-31T04:40:26.496 INFO:journalctl@ceph.osd.11.smithi177.stdout:Aug 31 04:40:26 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-11[46864]: 2024-08-31T04:40:26.175+0000 7fd602bf1640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-08-31T04:39:46.939525+0000 front 2024-08-31T04:39:46.939251+0000 (oldest deadline 2024-08-31T04:40:12.239391+0000) 2024-08-31T04:40:26.700 INFO:journalctl@ceph.osd.9.smithi050.stdout:Aug 31 04:40:26 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-9[52806]: 2024-08-31T04:40:26.423+0000 7f30c0800640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-08-31T04:39:33.661151+0000 front 2024-08-31T04:39:33.661082+0000 (oldest deadline 2024-08-31T04:39:55.361248+0000) 2024-08-31T04:40:26.700 INFO:journalctl@ceph.osd.9.smithi050.stdout:Aug 31 04:40:26 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-9[52806]: 2024-08-31T04:40:26.423+0000 7f30c0800640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.133:6804 osd.1 since back 2024-08-31T04:39:41.262725+0000 front 2024-08-31T04:39:41.262699+0000 (oldest deadline 2024-08-31T04:40:05.362593+0000) 2024-08-31T04:40:26.700 INFO:journalctl@ceph.osd.9.smithi050.stdout:Aug 31 04:40:26 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-9[52806]: 2024-08-31T04:40:26.423+0000 7f30c0800640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-08-31T04:39:50.664217+0000 front 2024-08-31T04:39:50.663973+0000 (oldest deadline 2024-08-31T04:40:14.163759+0000) 2024-08-31T04:40:26.700 INFO:journalctl@ceph.osd.9.smithi050.stdout:Aug 31 04:40:26 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-9[52806]: 2024-08-31T04:40:26.423+0000 7f30c0800640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2024-08-31T04:39:55.765151+0000 front 2024-08-31T04:39:55.765209+0000 (oldest deadline 2024-08-31T04:40:19.865200+0000) 2024-08-31T04:40:26.793 INFO:journalctl@ceph.osd.7.smithi133.stdout:Aug 31 04:40:26 smithi133 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-7[40256]: 2024-08-31T04:40:26.395+0000 7fd8f1456640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.7 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-31T04:40:26.793 INFO:journalctl@ceph.osd.7.smithi133.stdout:Aug 31 04:40:26 smithi133 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-7[40256]: 2024-08-31T04:40:26.395+0000 7fd8f1456640 -1 osd.7 83 *** Got signal Terminated *** 2024-08-31T04:40:26.793 INFO:journalctl@ceph.osd.7.smithi133.stdout:Aug 31 04:40:26 smithi133 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-7[40256]: 2024-08-31T04:40:26.395+0000 7fd8f1456640 -1 osd.7 83 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-08-31T04:40:26.793 INFO:journalctl@ceph.osd.7.smithi133.stdout:Aug 31 04:40:26 smithi133 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-7[40256]: 2024-08-31T04:40:26.565+0000 7fd8eda41640 -1 osd.7 83 heartbeat_check: no reply from 172.21.15.133:6804 osd.1 since back 2024-08-31T04:39:39.987526+0000 front 2024-08-31T04:39:39.987404+0000 (oldest deadline 2024-08-31T04:40:04.087555+0000) 2024-08-31T04:40:26.793 INFO:journalctl@ceph.osd.7.smithi133.stdout:Aug 31 04:40:26 smithi133 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-7[40256]: 2024-08-31T04:40:26.565+0000 7fd8eda41640 -1 osd.7 83 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-08-31T04:39:47.588581+0000 front 2024-08-31T04:39:47.588740+0000 (oldest deadline 2024-08-31T04:40:13.488665+0000) 2024-08-31T04:40:26.793 INFO:journalctl@ceph.osd.7.smithi133.stdout:Aug 31 04:40:26 smithi133 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-7[40256]: 2024-08-31T04:40:26.565+0000 7fd8eda41640 -1 osd.7 83 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2024-08-31T04:39:57.490072+0000 front 2024-08-31T04:39:57.490155+0000 (oldest deadline 2024-08-31T04:40:22.190033+0000) 2024-08-31T04:40:27.196 INFO:journalctl@ceph.osd.8.smithi177.stdout:Aug 31 04:40:26 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-8[40333]: 2024-08-31T04:40:26.749+0000 7f244221a640 -1 osd.8 83 heartbeat_check: no reply from 172.21.15.133:6804 osd.1 since back 2024-08-31T04:39:41.888896+0000 front 2024-08-31T04:39:41.888953+0000 (oldest deadline 2024-08-31T04:40:03.588900+0000) 2024-08-31T04:40:27.197 INFO:journalctl@ceph.osd.8.smithi177.stdout:Aug 31 04:40:26 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-8[40333]: 2024-08-31T04:40:26.749+0000 7f244221a640 -1 osd.8 83 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-08-31T04:39:48.790419+0000 front 2024-08-31T04:39:48.790532+0000 (oldest deadline 2024-08-31T04:40:12.890634+0000) 2024-08-31T04:40:27.197 INFO:journalctl@ceph.osd.8.smithi177.stdout:Aug 31 04:40:26 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-8[40333]: 2024-08-31T04:40:26.749+0000 7f244221a640 -1 osd.8 83 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2024-08-31T04:39:58.792110+0000 front 2024-08-31T04:39:58.792093+0000 (oldest deadline 2024-08-31T04:40:23.491915+0000) 2024-08-31T04:40:27.496 INFO:journalctl@ceph.osd.11.smithi177.stdout:Aug 31 04:40:27 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-11[46864]: 2024-08-31T04:40:27.195+0000 7fd602bf1640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-08-31T04:39:30.036711+0000 front 2024-08-31T04:39:30.036747+0000 (oldest deadline 2024-08-31T04:39:55.936674+0000) 2024-08-31T04:40:27.496 INFO:journalctl@ceph.osd.11.smithi177.stdout:Aug 31 04:40:27 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-11[46864]: 2024-08-31T04:40:27.195+0000 7fd602bf1640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.133:6804 osd.1 since back 2024-08-31T04:39:41.138475+0000 front 2024-08-31T04:39:41.138491+0000 (oldest deadline 2024-08-31T04:40:04.038356+0000) 2024-08-31T04:40:27.496 INFO:journalctl@ceph.osd.11.smithi177.stdout:Aug 31 04:40:27 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-11[46864]: 2024-08-31T04:40:27.195+0000 7fd602bf1640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-08-31T04:39:46.939525+0000 front 2024-08-31T04:39:46.939251+0000 (oldest deadline 2024-08-31T04:40:12.239391+0000) 2024-08-31T04:40:27.533 INFO:journalctl@ceph.osd.10.smithi133.stdout:Aug 31 04:40:27 smithi133 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-10[46762]: 2024-08-31T04:40:27.098+0000 7f873f3e9640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-08-31T04:39:32.936397+0000 front 2024-08-31T04:39:32.936196+0000 (oldest deadline 2024-08-31T04:39:55.836336+0000) 2024-08-31T04:40:27.533 INFO:journalctl@ceph.osd.10.smithi133.stdout:Aug 31 04:40:27 smithi133 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-10[46762]: 2024-08-31T04:40:27.098+0000 7f873f3e9640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.133:6804 osd.1 since back 2024-08-31T04:39:40.537248+0000 front 2024-08-31T04:39:40.537370+0000 (oldest deadline 2024-08-31T04:40:06.437470+0000) 2024-08-31T04:40:27.533 INFO:journalctl@ceph.osd.10.smithi133.stdout:Aug 31 04:40:27 smithi133 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-10[46762]: 2024-08-31T04:40:27.098+0000 7f873f3e9640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-08-31T04:39:50.438807+0000 front 2024-08-31T04:39:50.438655+0000 (oldest deadline 2024-08-31T04:40:11.538621+0000) 2024-08-31T04:40:27.533 INFO:journalctl@ceph.osd.10.smithi133.stdout:Aug 31 04:40:27 smithi133 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-10[46762]: 2024-08-31T04:40:27.098+0000 7f873f3e9640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2024-08-31T04:39:55.639898+0000 front 2024-08-31T04:39:55.639930+0000 (oldest deadline 2024-08-31T04:40:20.939655+0000) 2024-08-31T04:40:27.700 INFO:journalctl@ceph.osd.9.smithi050.stdout:Aug 31 04:40:27 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-9[52806]: 2024-08-31T04:40:27.409+0000 7f30c0800640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-08-31T04:39:33.661151+0000 front 2024-08-31T04:39:33.661082+0000 (oldest deadline 2024-08-31T04:39:55.361248+0000) 2024-08-31T04:40:27.700 INFO:journalctl@ceph.osd.9.smithi050.stdout:Aug 31 04:40:27 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-9[52806]: 2024-08-31T04:40:27.409+0000 7f30c0800640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.133:6804 osd.1 since back 2024-08-31T04:39:41.262725+0000 front 2024-08-31T04:39:41.262699+0000 (oldest deadline 2024-08-31T04:40:05.362593+0000) 2024-08-31T04:40:27.700 INFO:journalctl@ceph.osd.9.smithi050.stdout:Aug 31 04:40:27 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-9[52806]: 2024-08-31T04:40:27.409+0000 7f30c0800640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-08-31T04:39:50.664217+0000 front 2024-08-31T04:39:50.663973+0000 (oldest deadline 2024-08-31T04:40:14.163759+0000) 2024-08-31T04:40:27.700 INFO:journalctl@ceph.osd.9.smithi050.stdout:Aug 31 04:40:27 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-9[52806]: 2024-08-31T04:40:27.409+0000 7f30c0800640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2024-08-31T04:39:55.765151+0000 front 2024-08-31T04:39:55.765209+0000 (oldest deadline 2024-08-31T04:40:19.865200+0000) 2024-08-31T04:40:27.793 INFO:journalctl@ceph.osd.7.smithi133.stdout:Aug 31 04:40:27 smithi133 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-7[40256]: 2024-08-31T04:40:27.532+0000 7fd8eda41640 -1 osd.7 83 heartbeat_check: no reply from 172.21.15.133:6804 osd.1 since back 2024-08-31T04:39:39.987526+0000 front 2024-08-31T04:39:39.987404+0000 (oldest deadline 2024-08-31T04:40:04.087555+0000) 2024-08-31T04:40:27.793 INFO:journalctl@ceph.osd.7.smithi133.stdout:Aug 31 04:40:27 smithi133 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-7[40256]: 2024-08-31T04:40:27.532+0000 7fd8eda41640 -1 osd.7 83 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-08-31T04:39:47.588581+0000 front 2024-08-31T04:39:47.588740+0000 (oldest deadline 2024-08-31T04:40:13.488665+0000) 2024-08-31T04:40:27.793 INFO:journalctl@ceph.osd.7.smithi133.stdout:Aug 31 04:40:27 smithi133 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-7[40256]: 2024-08-31T04:40:27.532+0000 7fd8eda41640 -1 osd.7 83 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2024-08-31T04:39:57.490072+0000 front 2024-08-31T04:39:57.490155+0000 (oldest deadline 2024-08-31T04:40:22.190033+0000) 2024-08-31T04:40:27.996 INFO:journalctl@ceph.osd.8.smithi177.stdout:Aug 31 04:40:27 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-8[40333]: 2024-08-31T04:40:27.710+0000 7f244221a640 -1 osd.8 83 heartbeat_check: no reply from 172.21.15.133:6804 osd.1 since back 2024-08-31T04:39:41.888896+0000 front 2024-08-31T04:39:41.888953+0000 (oldest deadline 2024-08-31T04:40:03.588900+0000) 2024-08-31T04:40:27.996 INFO:journalctl@ceph.osd.8.smithi177.stdout:Aug 31 04:40:27 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-8[40333]: 2024-08-31T04:40:27.710+0000 7f244221a640 -1 osd.8 83 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-08-31T04:39:48.790419+0000 front 2024-08-31T04:39:48.790532+0000 (oldest deadline 2024-08-31T04:40:12.890634+0000) 2024-08-31T04:40:27.996 INFO:journalctl@ceph.osd.8.smithi177.stdout:Aug 31 04:40:27 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-8[40333]: 2024-08-31T04:40:27.710+0000 7f244221a640 -1 osd.8 83 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2024-08-31T04:39:58.792110+0000 front 2024-08-31T04:39:58.792093+0000 (oldest deadline 2024-08-31T04:40:23.491915+0000) 2024-08-31T04:40:28.496 INFO:journalctl@ceph.osd.11.smithi177.stdout:Aug 31 04:40:28 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-11[46864]: 2024-08-31T04:40:28.162+0000 7fd602bf1640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-08-31T04:39:30.036711+0000 front 2024-08-31T04:39:30.036747+0000 (oldest deadline 2024-08-31T04:39:55.936674+0000) 2024-08-31T04:40:28.496 INFO:journalctl@ceph.osd.11.smithi177.stdout:Aug 31 04:40:28 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-11[46864]: 2024-08-31T04:40:28.162+0000 7fd602bf1640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.133:6804 osd.1 since back 2024-08-31T04:39:41.138475+0000 front 2024-08-31T04:39:41.138491+0000 (oldest deadline 2024-08-31T04:40:04.038356+0000) 2024-08-31T04:40:28.496 INFO:journalctl@ceph.osd.11.smithi177.stdout:Aug 31 04:40:28 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-11[46864]: 2024-08-31T04:40:28.162+0000 7fd602bf1640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-08-31T04:39:46.939525+0000 front 2024-08-31T04:39:46.939251+0000 (oldest deadline 2024-08-31T04:40:12.239391+0000) 2024-08-31T04:40:28.543 INFO:journalctl@ceph.osd.10.smithi133.stdout:Aug 31 04:40:28 smithi133 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-10[46762]: 2024-08-31T04:40:28.056+0000 7f873f3e9640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-08-31T04:39:32.936397+0000 front 2024-08-31T04:39:32.936196+0000 (oldest deadline 2024-08-31T04:39:55.836336+0000) 2024-08-31T04:40:28.543 INFO:journalctl@ceph.osd.10.smithi133.stdout:Aug 31 04:40:28 smithi133 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-10[46762]: 2024-08-31T04:40:28.056+0000 7f873f3e9640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.133:6804 osd.1 since back 2024-08-31T04:39:40.537248+0000 front 2024-08-31T04:39:40.537370+0000 (oldest deadline 2024-08-31T04:40:06.437470+0000) 2024-08-31T04:40:28.543 INFO:journalctl@ceph.osd.10.smithi133.stdout:Aug 31 04:40:28 smithi133 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-10[46762]: 2024-08-31T04:40:28.056+0000 7f873f3e9640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-08-31T04:39:50.438807+0000 front 2024-08-31T04:39:50.438655+0000 (oldest deadline 2024-08-31T04:40:11.538621+0000) 2024-08-31T04:40:28.543 INFO:journalctl@ceph.osd.10.smithi133.stdout:Aug 31 04:40:28 smithi133 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-10[46762]: 2024-08-31T04:40:28.056+0000 7f873f3e9640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2024-08-31T04:39:55.639898+0000 front 2024-08-31T04:39:55.639930+0000 (oldest deadline 2024-08-31T04:40:20.939655+0000) 2024-08-31T04:40:28.700 INFO:journalctl@ceph.osd.9.smithi050.stdout:Aug 31 04:40:28 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-9[52806]: 2024-08-31T04:40:28.428+0000 7f30c0800640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-08-31T04:39:33.661151+0000 front 2024-08-31T04:39:33.661082+0000 (oldest deadline 2024-08-31T04:39:55.361248+0000) 2024-08-31T04:40:28.700 INFO:journalctl@ceph.osd.9.smithi050.stdout:Aug 31 04:40:28 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-9[52806]: 2024-08-31T04:40:28.428+0000 7f30c0800640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.133:6804 osd.1 since back 2024-08-31T04:39:41.262725+0000 front 2024-08-31T04:39:41.262699+0000 (oldest deadline 2024-08-31T04:40:05.362593+0000) 2024-08-31T04:40:28.700 INFO:journalctl@ceph.osd.9.smithi050.stdout:Aug 31 04:40:28 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-9[52806]: 2024-08-31T04:40:28.428+0000 7f30c0800640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-08-31T04:39:50.664217+0000 front 2024-08-31T04:39:50.663973+0000 (oldest deadline 2024-08-31T04:40:14.163759+0000) 2024-08-31T04:40:28.700 INFO:journalctl@ceph.osd.9.smithi050.stdout:Aug 31 04:40:28 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-9[52806]: 2024-08-31T04:40:28.428+0000 7f30c0800640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2024-08-31T04:39:55.765151+0000 front 2024-08-31T04:39:55.765209+0000 (oldest deadline 2024-08-31T04:40:19.865200+0000) 2024-08-31T04:40:28.996 INFO:journalctl@ceph.osd.8.smithi177.stdout:Aug 31 04:40:28 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-8[40333]: 2024-08-31T04:40:28.728+0000 7f244221a640 -1 osd.8 83 heartbeat_check: no reply from 172.21.15.133:6804 osd.1 since back 2024-08-31T04:39:41.888896+0000 front 2024-08-31T04:39:41.888953+0000 (oldest deadline 2024-08-31T04:40:03.588900+0000) 2024-08-31T04:40:28.996 INFO:journalctl@ceph.osd.8.smithi177.stdout:Aug 31 04:40:28 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-8[40333]: 2024-08-31T04:40:28.728+0000 7f244221a640 -1 osd.8 83 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-08-31T04:39:48.790419+0000 front 2024-08-31T04:39:48.790532+0000 (oldest deadline 2024-08-31T04:40:12.890634+0000) 2024-08-31T04:40:28.996 INFO:journalctl@ceph.osd.8.smithi177.stdout:Aug 31 04:40:28 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-8[40333]: 2024-08-31T04:40:28.728+0000 7f244221a640 -1 osd.8 83 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2024-08-31T04:39:58.792110+0000 front 2024-08-31T04:39:58.792093+0000 (oldest deadline 2024-08-31T04:40:23.491915+0000) 2024-08-31T04:40:29.043 INFO:journalctl@ceph.osd.7.smithi133.stdout:Aug 31 04:40:28 smithi133 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-7[40256]: 2024-08-31T04:40:28.553+0000 7fd8eda41640 -1 osd.7 83 heartbeat_check: no reply from 172.21.15.133:6804 osd.1 since back 2024-08-31T04:39:39.987526+0000 front 2024-08-31T04:39:39.987404+0000 (oldest deadline 2024-08-31T04:40:04.087555+0000) 2024-08-31T04:40:29.043 INFO:journalctl@ceph.osd.7.smithi133.stdout:Aug 31 04:40:28 smithi133 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-7[40256]: 2024-08-31T04:40:28.553+0000 7fd8eda41640 -1 osd.7 83 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-08-31T04:39:47.588581+0000 front 2024-08-31T04:39:47.588740+0000 (oldest deadline 2024-08-31T04:40:13.488665+0000) 2024-08-31T04:40:29.043 INFO:journalctl@ceph.osd.7.smithi133.stdout:Aug 31 04:40:28 smithi133 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-7[40256]: 2024-08-31T04:40:28.553+0000 7fd8eda41640 -1 osd.7 83 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2024-08-31T04:39:57.490072+0000 front 2024-08-31T04:39:57.490155+0000 (oldest deadline 2024-08-31T04:40:22.190033+0000) 2024-08-31T04:40:29.496 INFO:journalctl@ceph.osd.11.smithi177.stdout:Aug 31 04:40:29 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-11[46864]: 2024-08-31T04:40:29.152+0000 7fd602bf1640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-08-31T04:39:30.036711+0000 front 2024-08-31T04:39:30.036747+0000 (oldest deadline 2024-08-31T04:39:55.936674+0000) 2024-08-31T04:40:29.496 INFO:journalctl@ceph.osd.11.smithi177.stdout:Aug 31 04:40:29 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-11[46864]: 2024-08-31T04:40:29.152+0000 7fd602bf1640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.133:6804 osd.1 since back 2024-08-31T04:39:41.138475+0000 front 2024-08-31T04:39:41.138491+0000 (oldest deadline 2024-08-31T04:40:04.038356+0000) 2024-08-31T04:40:29.496 INFO:journalctl@ceph.osd.11.smithi177.stdout:Aug 31 04:40:29 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-11[46864]: 2024-08-31T04:40:29.152+0000 7fd602bf1640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-08-31T04:39:46.939525+0000 front 2024-08-31T04:39:46.939251+0000 (oldest deadline 2024-08-31T04:40:12.239391+0000) 2024-08-31T04:40:29.543 INFO:journalctl@ceph.osd.10.smithi133.stdout:Aug 31 04:40:29 smithi133 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-10[46762]: 2024-08-31T04:40:29.106+0000 7f873f3e9640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-08-31T04:39:32.936397+0000 front 2024-08-31T04:39:32.936196+0000 (oldest deadline 2024-08-31T04:39:55.836336+0000) 2024-08-31T04:40:29.543 INFO:journalctl@ceph.osd.10.smithi133.stdout:Aug 31 04:40:29 smithi133 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-10[46762]: 2024-08-31T04:40:29.106+0000 7f873f3e9640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.133:6804 osd.1 since back 2024-08-31T04:39:40.537248+0000 front 2024-08-31T04:39:40.537370+0000 (oldest deadline 2024-08-31T04:40:06.437470+0000) 2024-08-31T04:40:29.543 INFO:journalctl@ceph.osd.10.smithi133.stdout:Aug 31 04:40:29 smithi133 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-10[46762]: 2024-08-31T04:40:29.106+0000 7f873f3e9640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-08-31T04:39:50.438807+0000 front 2024-08-31T04:39:50.438655+0000 (oldest deadline 2024-08-31T04:40:11.538621+0000) 2024-08-31T04:40:29.543 INFO:journalctl@ceph.osd.10.smithi133.stdout:Aug 31 04:40:29 smithi133 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-10[46762]: 2024-08-31T04:40:29.106+0000 7f873f3e9640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2024-08-31T04:39:55.639898+0000 front 2024-08-31T04:39:55.639930+0000 (oldest deadline 2024-08-31T04:40:20.939655+0000) 2024-08-31T04:40:29.543 INFO:journalctl@ceph.osd.10.smithi133.stdout:Aug 31 04:40:29 smithi133 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-10[46762]: 2024-08-31T04:40:29.106+0000 7f873f3e9640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.133:6812 osd.4 since back 2024-08-31T04:40:05.040435+0000 front 2024-08-31T04:40:05.040466+0000 (oldest deadline 2024-08-31T04:40:28.540479+0000) 2024-08-31T04:40:29.950 INFO:journalctl@ceph.osd.9.smithi050.stdout:Aug 31 04:40:29 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-9[52806]: 2024-08-31T04:40:29.474+0000 7f30c0800640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-08-31T04:39:33.661151+0000 front 2024-08-31T04:39:33.661082+0000 (oldest deadline 2024-08-31T04:39:55.361248+0000) 2024-08-31T04:40:29.950 INFO:journalctl@ceph.osd.9.smithi050.stdout:Aug 31 04:40:29 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-9[52806]: 2024-08-31T04:40:29.474+0000 7f30c0800640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.133:6804 osd.1 since back 2024-08-31T04:39:41.262725+0000 front 2024-08-31T04:39:41.262699+0000 (oldest deadline 2024-08-31T04:40:05.362593+0000) 2024-08-31T04:40:29.950 INFO:journalctl@ceph.osd.9.smithi050.stdout:Aug 31 04:40:29 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-9[52806]: 2024-08-31T04:40:29.474+0000 7f30c0800640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-08-31T04:39:50.664217+0000 front 2024-08-31T04:39:50.663973+0000 (oldest deadline 2024-08-31T04:40:14.163759+0000) 2024-08-31T04:40:29.950 INFO:journalctl@ceph.osd.9.smithi050.stdout:Aug 31 04:40:29 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-9[52806]: 2024-08-31T04:40:29.474+0000 7f30c0800640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2024-08-31T04:39:55.765151+0000 front 2024-08-31T04:39:55.765209+0000 (oldest deadline 2024-08-31T04:40:19.865200+0000) 2024-08-31T04:40:29.996 INFO:journalctl@ceph.osd.8.smithi177.stdout:Aug 31 04:40:29 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-8[40333]: 2024-08-31T04:40:29.713+0000 7f244221a640 -1 osd.8 83 heartbeat_check: no reply from 172.21.15.133:6804 osd.1 since back 2024-08-31T04:39:41.888896+0000 front 2024-08-31T04:39:41.888953+0000 (oldest deadline 2024-08-31T04:40:03.588900+0000) 2024-08-31T04:40:29.996 INFO:journalctl@ceph.osd.8.smithi177.stdout:Aug 31 04:40:29 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-8[40333]: 2024-08-31T04:40:29.713+0000 7f244221a640 -1 osd.8 83 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-08-31T04:39:48.790419+0000 front 2024-08-31T04:39:48.790532+0000 (oldest deadline 2024-08-31T04:40:12.890634+0000) 2024-08-31T04:40:29.996 INFO:journalctl@ceph.osd.8.smithi177.stdout:Aug 31 04:40:29 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-8[40333]: 2024-08-31T04:40:29.713+0000 7f244221a640 -1 osd.8 83 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2024-08-31T04:39:58.792110+0000 front 2024-08-31T04:39:58.792093+0000 (oldest deadline 2024-08-31T04:40:23.491915+0000) 2024-08-31T04:40:30.043 INFO:journalctl@ceph.osd.7.smithi133.stdout:Aug 31 04:40:29 smithi133 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-7[40256]: 2024-08-31T04:40:29.587+0000 7fd8eda41640 -1 osd.7 83 heartbeat_check: no reply from 172.21.15.133:6804 osd.1 since back 2024-08-31T04:39:39.987526+0000 front 2024-08-31T04:39:39.987404+0000 (oldest deadline 2024-08-31T04:40:04.087555+0000) 2024-08-31T04:40:30.043 INFO:journalctl@ceph.osd.7.smithi133.stdout:Aug 31 04:40:29 smithi133 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-7[40256]: 2024-08-31T04:40:29.587+0000 7fd8eda41640 -1 osd.7 83 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-08-31T04:39:47.588581+0000 front 2024-08-31T04:39:47.588740+0000 (oldest deadline 2024-08-31T04:40:13.488665+0000) 2024-08-31T04:40:30.043 INFO:journalctl@ceph.osd.7.smithi133.stdout:Aug 31 04:40:29 smithi133 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-7[40256]: 2024-08-31T04:40:29.587+0000 7fd8eda41640 -1 osd.7 83 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2024-08-31T04:39:57.490072+0000 front 2024-08-31T04:39:57.490155+0000 (oldest deadline 2024-08-31T04:40:22.190033+0000) 2024-08-31T04:40:30.496 INFO:journalctl@ceph.osd.11.smithi177.stdout:Aug 31 04:40:30 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-11[46864]: 2024-08-31T04:40:30.179+0000 7fd602bf1640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-08-31T04:39:30.036711+0000 front 2024-08-31T04:39:30.036747+0000 (oldest deadline 2024-08-31T04:39:55.936674+0000) 2024-08-31T04:40:30.496 INFO:journalctl@ceph.osd.11.smithi177.stdout:Aug 31 04:40:30 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-11[46864]: 2024-08-31T04:40:30.179+0000 7fd602bf1640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.133:6804 osd.1 since back 2024-08-31T04:39:41.138475+0000 front 2024-08-31T04:39:41.138491+0000 (oldest deadline 2024-08-31T04:40:04.038356+0000) 2024-08-31T04:40:30.497 INFO:journalctl@ceph.osd.11.smithi177.stdout:Aug 31 04:40:30 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-11[46864]: 2024-08-31T04:40:30.179+0000 7fd602bf1640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-08-31T04:39:46.939525+0000 front 2024-08-31T04:39:46.939251+0000 (oldest deadline 2024-08-31T04:40:12.239391+0000) 2024-08-31T04:40:30.543 INFO:journalctl@ceph.osd.10.smithi133.stdout:Aug 31 04:40:30 smithi133 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-10[46762]: 2024-08-31T04:40:30.079+0000 7f873f3e9640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-08-31T04:39:32.936397+0000 front 2024-08-31T04:39:32.936196+0000 (oldest deadline 2024-08-31T04:39:55.836336+0000) 2024-08-31T04:40:30.543 INFO:journalctl@ceph.osd.10.smithi133.stdout:Aug 31 04:40:30 smithi133 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-10[46762]: 2024-08-31T04:40:30.079+0000 7f873f3e9640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.133:6804 osd.1 since back 2024-08-31T04:39:40.537248+0000 front 2024-08-31T04:39:40.537370+0000 (oldest deadline 2024-08-31T04:40:06.437470+0000) 2024-08-31T04:40:30.543 INFO:journalctl@ceph.osd.10.smithi133.stdout:Aug 31 04:40:30 smithi133 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-10[46762]: 2024-08-31T04:40:30.079+0000 7f873f3e9640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-08-31T04:39:50.438807+0000 front 2024-08-31T04:39:50.438655+0000 (oldest deadline 2024-08-31T04:40:11.538621+0000) 2024-08-31T04:40:30.543 INFO:journalctl@ceph.osd.10.smithi133.stdout:Aug 31 04:40:30 smithi133 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-10[46762]: 2024-08-31T04:40:30.079+0000 7f873f3e9640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2024-08-31T04:39:55.639898+0000 front 2024-08-31T04:39:55.639930+0000 (oldest deadline 2024-08-31T04:40:20.939655+0000) 2024-08-31T04:40:30.544 INFO:journalctl@ceph.osd.10.smithi133.stdout:Aug 31 04:40:30 smithi133 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-10[46762]: 2024-08-31T04:40:30.079+0000 7f873f3e9640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.133:6812 osd.4 since back 2024-08-31T04:40:05.040435+0000 front 2024-08-31T04:40:05.040466+0000 (oldest deadline 2024-08-31T04:40:28.540479+0000) 2024-08-31T04:40:30.950 INFO:journalctl@ceph.osd.9.smithi050.stdout:Aug 31 04:40:30 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-9[52806]: 2024-08-31T04:40:30.481+0000 7f30c0800640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-08-31T04:39:33.661151+0000 front 2024-08-31T04:39:33.661082+0000 (oldest deadline 2024-08-31T04:39:55.361248+0000) 2024-08-31T04:40:30.950 INFO:journalctl@ceph.osd.9.smithi050.stdout:Aug 31 04:40:30 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-9[52806]: 2024-08-31T04:40:30.481+0000 7f30c0800640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.133:6804 osd.1 since back 2024-08-31T04:39:41.262725+0000 front 2024-08-31T04:39:41.262699+0000 (oldest deadline 2024-08-31T04:40:05.362593+0000) 2024-08-31T04:40:30.950 INFO:journalctl@ceph.osd.9.smithi050.stdout:Aug 31 04:40:30 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-9[52806]: 2024-08-31T04:40:30.481+0000 7f30c0800640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-08-31T04:39:50.664217+0000 front 2024-08-31T04:39:50.663973+0000 (oldest deadline 2024-08-31T04:40:14.163759+0000) 2024-08-31T04:40:30.950 INFO:journalctl@ceph.osd.9.smithi050.stdout:Aug 31 04:40:30 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-9[52806]: 2024-08-31T04:40:30.481+0000 7f30c0800640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2024-08-31T04:39:55.765151+0000 front 2024-08-31T04:39:55.765209+0000 (oldest deadline 2024-08-31T04:40:19.865200+0000) 2024-08-31T04:40:30.996 INFO:journalctl@ceph.osd.8.smithi177.stdout:Aug 31 04:40:30 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-8[40333]: 2024-08-31T04:40:30.698+0000 7f244221a640 -1 osd.8 83 heartbeat_check: no reply from 172.21.15.133:6804 osd.1 since back 2024-08-31T04:39:41.888896+0000 front 2024-08-31T04:39:41.888953+0000 (oldest deadline 2024-08-31T04:40:03.588900+0000) 2024-08-31T04:40:30.996 INFO:journalctl@ceph.osd.8.smithi177.stdout:Aug 31 04:40:30 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-8[40333]: 2024-08-31T04:40:30.698+0000 7f244221a640 -1 osd.8 83 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-08-31T04:39:48.790419+0000 front 2024-08-31T04:39:48.790532+0000 (oldest deadline 2024-08-31T04:40:12.890634+0000) 2024-08-31T04:40:30.996 INFO:journalctl@ceph.osd.8.smithi177.stdout:Aug 31 04:40:30 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-8[40333]: 2024-08-31T04:40:30.698+0000 7f244221a640 -1 osd.8 83 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2024-08-31T04:39:58.792110+0000 front 2024-08-31T04:39:58.792093+0000 (oldest deadline 2024-08-31T04:40:23.491915+0000) 2024-08-31T04:40:30.997 INFO:journalctl@ceph.osd.8.smithi177.stdout:Aug 31 04:40:30 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-8[40333]: 2024-08-31T04:40:30.698+0000 7f244221a640 -1 osd.8 83 heartbeat_check: no reply from 172.21.15.133:6812 osd.4 since back 2024-08-31T04:40:06.393267+0000 front 2024-08-31T04:40:06.393388+0000 (oldest deadline 2024-08-31T04:40:29.893120+0000) 2024-08-31T04:40:31.043 INFO:journalctl@ceph.osd.7.smithi133.stdout:Aug 31 04:40:30 smithi133 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-7[40256]: 2024-08-31T04:40:30.567+0000 7fd8eda41640 -1 osd.7 83 heartbeat_check: no reply from 172.21.15.133:6804 osd.1 since back 2024-08-31T04:39:39.987526+0000 front 2024-08-31T04:39:39.987404+0000 (oldest deadline 2024-08-31T04:40:04.087555+0000) 2024-08-31T04:40:31.043 INFO:journalctl@ceph.osd.7.smithi133.stdout:Aug 31 04:40:30 smithi133 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-7[40256]: 2024-08-31T04:40:30.567+0000 7fd8eda41640 -1 osd.7 83 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-08-31T04:39:47.588581+0000 front 2024-08-31T04:39:47.588740+0000 (oldest deadline 2024-08-31T04:40:13.488665+0000) 2024-08-31T04:40:31.044 INFO:journalctl@ceph.osd.7.smithi133.stdout:Aug 31 04:40:30 smithi133 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-7[40256]: 2024-08-31T04:40:30.567+0000 7fd8eda41640 -1 osd.7 83 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2024-08-31T04:39:57.490072+0000 front 2024-08-31T04:39:57.490155+0000 (oldest deadline 2024-08-31T04:40:22.190033+0000) 2024-08-31T04:40:31.044 INFO:journalctl@ceph.osd.7.smithi133.stdout:Aug 31 04:40:30 smithi133 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-7[40256]: 2024-08-31T04:40:30.567+0000 7fd8eda41640 -1 osd.7 83 heartbeat_check: no reply from 172.21.15.133:6812 osd.4 since back 2024-08-31T04:40:05.591321+0000 front 2024-08-31T04:40:05.591360+0000 (oldest deadline 2024-08-31T04:40:29.691440+0000) 2024-08-31T04:40:31.496 INFO:journalctl@ceph.osd.11.smithi177.stdout:Aug 31 04:40:31 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-11[46864]: 2024-08-31T04:40:31.131+0000 7fd602bf1640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-08-31T04:39:30.036711+0000 front 2024-08-31T04:39:30.036747+0000 (oldest deadline 2024-08-31T04:39:55.936674+0000) 2024-08-31T04:40:31.496 INFO:journalctl@ceph.osd.11.smithi177.stdout:Aug 31 04:40:31 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-11[46864]: 2024-08-31T04:40:31.131+0000 7fd602bf1640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.133:6804 osd.1 since back 2024-08-31T04:39:41.138475+0000 front 2024-08-31T04:39:41.138491+0000 (oldest deadline 2024-08-31T04:40:04.038356+0000) 2024-08-31T04:40:31.496 INFO:journalctl@ceph.osd.11.smithi177.stdout:Aug 31 04:40:31 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-11[46864]: 2024-08-31T04:40:31.131+0000 7fd602bf1640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-08-31T04:39:46.939525+0000 front 2024-08-31T04:39:46.939251+0000 (oldest deadline 2024-08-31T04:40:12.239391+0000) 2024-08-31T04:40:31.543 INFO:journalctl@ceph.osd.10.smithi133.stdout:Aug 31 04:40:31 smithi133 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-10[46762]: 2024-08-31T04:40:31.049+0000 7f873f3e9640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-08-31T04:39:32.936397+0000 front 2024-08-31T04:39:32.936196+0000 (oldest deadline 2024-08-31T04:39:55.836336+0000) 2024-08-31T04:40:31.543 INFO:journalctl@ceph.osd.10.smithi133.stdout:Aug 31 04:40:31 smithi133 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-10[46762]: 2024-08-31T04:40:31.049+0000 7f873f3e9640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.133:6804 osd.1 since back 2024-08-31T04:39:40.537248+0000 front 2024-08-31T04:39:40.537370+0000 (oldest deadline 2024-08-31T04:40:06.437470+0000) 2024-08-31T04:40:31.543 INFO:journalctl@ceph.osd.10.smithi133.stdout:Aug 31 04:40:31 smithi133 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-10[46762]: 2024-08-31T04:40:31.049+0000 7f873f3e9640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-08-31T04:39:50.438807+0000 front 2024-08-31T04:39:50.438655+0000 (oldest deadline 2024-08-31T04:40:11.538621+0000) 2024-08-31T04:40:31.543 INFO:journalctl@ceph.osd.10.smithi133.stdout:Aug 31 04:40:31 smithi133 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-10[46762]: 2024-08-31T04:40:31.049+0000 7f873f3e9640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2024-08-31T04:39:55.639898+0000 front 2024-08-31T04:39:55.639930+0000 (oldest deadline 2024-08-31T04:40:20.939655+0000) 2024-08-31T04:40:31.543 INFO:journalctl@ceph.osd.10.smithi133.stdout:Aug 31 04:40:31 smithi133 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-10[46762]: 2024-08-31T04:40:31.049+0000 7f873f3e9640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.133:6812 osd.4 since back 2024-08-31T04:40:05.040435+0000 front 2024-08-31T04:40:05.040466+0000 (oldest deadline 2024-08-31T04:40:28.540479+0000) 2024-08-31T04:40:31.950 INFO:journalctl@ceph.osd.9.smithi050.stdout:Aug 31 04:40:31 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-9[52806]: 2024-08-31T04:40:31.459+0000 7f30c0800640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-08-31T04:39:33.661151+0000 front 2024-08-31T04:39:33.661082+0000 (oldest deadline 2024-08-31T04:39:55.361248+0000) 2024-08-31T04:40:31.950 INFO:journalctl@ceph.osd.9.smithi050.stdout:Aug 31 04:40:31 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-9[52806]: 2024-08-31T04:40:31.459+0000 7f30c0800640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.133:6804 osd.1 since back 2024-08-31T04:39:41.262725+0000 front 2024-08-31T04:39:41.262699+0000 (oldest deadline 2024-08-31T04:40:05.362593+0000) 2024-08-31T04:40:31.950 INFO:journalctl@ceph.osd.9.smithi050.stdout:Aug 31 04:40:31 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-9[52806]: 2024-08-31T04:40:31.459+0000 7f30c0800640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-08-31T04:39:50.664217+0000 front 2024-08-31T04:39:50.663973+0000 (oldest deadline 2024-08-31T04:40:14.163759+0000) 2024-08-31T04:40:31.950 INFO:journalctl@ceph.osd.9.smithi050.stdout:Aug 31 04:40:31 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-9[52806]: 2024-08-31T04:40:31.459+0000 7f30c0800640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2024-08-31T04:39:55.765151+0000 front 2024-08-31T04:39:55.765209+0000 (oldest deadline 2024-08-31T04:40:19.865200+0000) 2024-08-31T04:40:31.996 INFO:journalctl@ceph.osd.8.smithi177.stdout:Aug 31 04:40:31 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-8[40333]: 2024-08-31T04:40:31.723+0000 7f244221a640 -1 osd.8 83 heartbeat_check: no reply from 172.21.15.133:6804 osd.1 since back 2024-08-31T04:39:41.888896+0000 front 2024-08-31T04:39:41.888953+0000 (oldest deadline 2024-08-31T04:40:03.588900+0000) 2024-08-31T04:40:31.996 INFO:journalctl@ceph.osd.8.smithi177.stdout:Aug 31 04:40:31 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-8[40333]: 2024-08-31T04:40:31.723+0000 7f244221a640 -1 osd.8 83 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-08-31T04:39:48.790419+0000 front 2024-08-31T04:39:48.790532+0000 (oldest deadline 2024-08-31T04:40:12.890634+0000) 2024-08-31T04:40:31.996 INFO:journalctl@ceph.osd.8.smithi177.stdout:Aug 31 04:40:31 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-8[40333]: 2024-08-31T04:40:31.723+0000 7f244221a640 -1 osd.8 83 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2024-08-31T04:39:58.792110+0000 front 2024-08-31T04:39:58.792093+0000 (oldest deadline 2024-08-31T04:40:23.491915+0000) 2024-08-31T04:40:31.996 INFO:journalctl@ceph.osd.8.smithi177.stdout:Aug 31 04:40:31 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-8[40333]: 2024-08-31T04:40:31.723+0000 7f244221a640 -1 osd.8 83 heartbeat_check: no reply from 172.21.15.133:6812 osd.4 since back 2024-08-31T04:40:06.393267+0000 front 2024-08-31T04:40:06.393388+0000 (oldest deadline 2024-08-31T04:40:29.893120+0000) 2024-08-31T04:40:32.239 INFO:journalctl@ceph.osd.7.smithi133.stdout:Aug 31 04:40:31 smithi133 podman[58526]: 2024-08-31 04:40:31.968796553 +0000 UTC m=+5.688075948 container died e97e60099065dd72412c41b626421a79de5e968cbc0e43eccb4f4f0f9873154c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-7, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , ceph=True, io.buildah.version=1.37.1, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731) 2024-08-31T04:40:32.239 INFO:journalctl@ceph.osd.10.smithi133.stdout:Aug 31 04:40:32 smithi133 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-10[46762]: 2024-08-31T04:40:32.080+0000 7f873f3e9640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-08-31T04:39:32.936397+0000 front 2024-08-31T04:39:32.936196+0000 (oldest deadline 2024-08-31T04:39:55.836336+0000) 2024-08-31T04:40:32.239 INFO:journalctl@ceph.osd.10.smithi133.stdout:Aug 31 04:40:32 smithi133 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-10[46762]: 2024-08-31T04:40:32.080+0000 7f873f3e9640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.133:6804 osd.1 since back 2024-08-31T04:39:40.537248+0000 front 2024-08-31T04:39:40.537370+0000 (oldest deadline 2024-08-31T04:40:06.437470+0000) 2024-08-31T04:40:32.239 INFO:journalctl@ceph.osd.10.smithi133.stdout:Aug 31 04:40:32 smithi133 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-10[46762]: 2024-08-31T04:40:32.080+0000 7f873f3e9640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-08-31T04:39:50.438807+0000 front 2024-08-31T04:39:50.438655+0000 (oldest deadline 2024-08-31T04:40:11.538621+0000) 2024-08-31T04:40:32.239 INFO:journalctl@ceph.osd.10.smithi133.stdout:Aug 31 04:40:32 smithi133 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-10[46762]: 2024-08-31T04:40:32.080+0000 7f873f3e9640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2024-08-31T04:39:55.639898+0000 front 2024-08-31T04:39:55.639930+0000 (oldest deadline 2024-08-31T04:40:20.939655+0000) 2024-08-31T04:40:32.239 INFO:journalctl@ceph.osd.10.smithi133.stdout:Aug 31 04:40:32 smithi133 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-10[46762]: 2024-08-31T04:40:32.080+0000 7f873f3e9640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.133:6812 osd.4 since back 2024-08-31T04:40:05.040435+0000 front 2024-08-31T04:40:05.040466+0000 (oldest deadline 2024-08-31T04:40:28.540479+0000) 2024-08-31T04:40:32.449 INFO:journalctl@ceph.osd.11.smithi177.stdout:Aug 31 04:40:32 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-11[46864]: 2024-08-31T04:40:32.150+0000 7fd602bf1640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-08-31T04:39:30.036711+0000 front 2024-08-31T04:39:30.036747+0000 (oldest deadline 2024-08-31T04:39:55.936674+0000) 2024-08-31T04:40:32.449 INFO:journalctl@ceph.osd.11.smithi177.stdout:Aug 31 04:40:32 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-11[46864]: 2024-08-31T04:40:32.150+0000 7fd602bf1640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.133:6804 osd.1 since back 2024-08-31T04:39:41.138475+0000 front 2024-08-31T04:39:41.138491+0000 (oldest deadline 2024-08-31T04:40:04.038356+0000) 2024-08-31T04:40:32.449 INFO:journalctl@ceph.osd.11.smithi177.stdout:Aug 31 04:40:32 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-11[46864]: 2024-08-31T04:40:32.150+0000 7fd602bf1640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-08-31T04:39:46.939525+0000 front 2024-08-31T04:39:46.939251+0000 (oldest deadline 2024-08-31T04:40:12.239391+0000) 2024-08-31T04:40:32.543 INFO:journalctl@ceph.osd.7.smithi133.stdout:Aug 31 04:40:32 smithi133 podman[58526]: 2024-08-31 04:40:32.328552197 +0000 UTC m=+6.047831585 container cleanup e97e60099065dd72412c41b626421a79de5e968cbc0e43eccb4f4f0f9873154c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-7, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_CLEAN=True, io.buildah.version=1.37.1, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-08-31T04:40:32.543 INFO:journalctl@ceph.osd.7.smithi133.stdout:Aug 31 04:40:32 smithi133 bash[58526]: ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-7 2024-08-31T04:40:32.946 INFO:journalctl@ceph.osd.7.smithi133.stdout:Aug 31 04:40:32 smithi133 podman[58541]: 2024-08-31 04:40:32.596930438 +0000 UTC m=+0.621208336 container remove e97e60099065dd72412c41b626421a79de5e968cbc0e43eccb4f4f0f9873154c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-7, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_CLEAN=True, ceph=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.1, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0) 2024-08-31T04:40:32.950 INFO:journalctl@ceph.osd.9.smithi050.stdout:Aug 31 04:40:32 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-9[52806]: 2024-08-31T04:40:32.468+0000 7f30c0800640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-08-31T04:39:33.661151+0000 front 2024-08-31T04:39:33.661082+0000 (oldest deadline 2024-08-31T04:39:55.361248+0000) 2024-08-31T04:40:32.950 INFO:journalctl@ceph.osd.9.smithi050.stdout:Aug 31 04:40:32 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-9[52806]: 2024-08-31T04:40:32.468+0000 7f30c0800640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.133:6804 osd.1 since back 2024-08-31T04:39:41.262725+0000 front 2024-08-31T04:39:41.262699+0000 (oldest deadline 2024-08-31T04:40:05.362593+0000) 2024-08-31T04:40:32.950 INFO:journalctl@ceph.osd.9.smithi050.stdout:Aug 31 04:40:32 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-9[52806]: 2024-08-31T04:40:32.468+0000 7f30c0800640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-08-31T04:39:50.664217+0000 front 2024-08-31T04:39:50.663973+0000 (oldest deadline 2024-08-31T04:40:14.163759+0000) 2024-08-31T04:40:32.950 INFO:journalctl@ceph.osd.9.smithi050.stdout:Aug 31 04:40:32 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-9[52806]: 2024-08-31T04:40:32.468+0000 7f30c0800640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2024-08-31T04:39:55.765151+0000 front 2024-08-31T04:39:55.765209+0000 (oldest deadline 2024-08-31T04:40:19.865200+0000) 2024-08-31T04:40:33.127 INFO:journalctl@ceph.osd.8.smithi177.stdout:Aug 31 04:40:32 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-8[40333]: 2024-08-31T04:40:32.759+0000 7f244221a640 -1 osd.8 83 heartbeat_check: no reply from 172.21.15.133:6804 osd.1 since back 2024-08-31T04:39:41.888896+0000 front 2024-08-31T04:39:41.888953+0000 (oldest deadline 2024-08-31T04:40:03.588900+0000) 2024-08-31T04:40:33.127 INFO:journalctl@ceph.osd.8.smithi177.stdout:Aug 31 04:40:32 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-8[40333]: 2024-08-31T04:40:32.759+0000 7f244221a640 -1 osd.8 83 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-08-31T04:39:48.790419+0000 front 2024-08-31T04:39:48.790532+0000 (oldest deadline 2024-08-31T04:40:12.890634+0000) 2024-08-31T04:40:33.127 INFO:journalctl@ceph.osd.8.smithi177.stdout:Aug 31 04:40:32 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-8[40333]: 2024-08-31T04:40:32.759+0000 7f244221a640 -1 osd.8 83 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2024-08-31T04:39:58.792110+0000 front 2024-08-31T04:39:58.792093+0000 (oldest deadline 2024-08-31T04:40:23.491915+0000) 2024-08-31T04:40:33.127 INFO:journalctl@ceph.osd.8.smithi177.stdout:Aug 31 04:40:32 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-8[40333]: 2024-08-31T04:40:32.759+0000 7f244221a640 -1 osd.8 83 heartbeat_check: no reply from 172.21.15.133:6812 osd.4 since back 2024-08-31T04:40:06.393267+0000 front 2024-08-31T04:40:06.393388+0000 (oldest deadline 2024-08-31T04:40:29.893120+0000) 2024-08-31T04:40:33.251 INFO:journalctl@ceph.osd.10.smithi133.stdout:Aug 31 04:40:33 smithi133 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-10[46762]: 2024-08-31T04:40:33.035+0000 7f873f3e9640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-08-31T04:39:32.936397+0000 front 2024-08-31T04:39:32.936196+0000 (oldest deadline 2024-08-31T04:39:55.836336+0000) 2024-08-31T04:40:33.251 INFO:journalctl@ceph.osd.10.smithi133.stdout:Aug 31 04:40:33 smithi133 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-10[46762]: 2024-08-31T04:40:33.035+0000 7f873f3e9640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.133:6804 osd.1 since back 2024-08-31T04:39:40.537248+0000 front 2024-08-31T04:39:40.537370+0000 (oldest deadline 2024-08-31T04:40:06.437470+0000) 2024-08-31T04:40:33.251 INFO:journalctl@ceph.osd.10.smithi133.stdout:Aug 31 04:40:33 smithi133 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-10[46762]: 2024-08-31T04:40:33.035+0000 7f873f3e9640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-08-31T04:39:50.438807+0000 front 2024-08-31T04:39:50.438655+0000 (oldest deadline 2024-08-31T04:40:11.538621+0000) 2024-08-31T04:40:33.251 INFO:journalctl@ceph.osd.10.smithi133.stdout:Aug 31 04:40:33 smithi133 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-10[46762]: 2024-08-31T04:40:33.035+0000 7f873f3e9640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2024-08-31T04:39:55.639898+0000 front 2024-08-31T04:39:55.639930+0000 (oldest deadline 2024-08-31T04:40:20.939655+0000) 2024-08-31T04:40:33.251 INFO:journalctl@ceph.osd.10.smithi133.stdout:Aug 31 04:40:33 smithi133 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-10[46762]: 2024-08-31T04:40:33.035+0000 7f873f3e9640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.133:6812 osd.4 since back 2024-08-31T04:40:05.040435+0000 front 2024-08-31T04:40:05.040466+0000 (oldest deadline 2024-08-31T04:40:28.540479+0000) 2024-08-31T04:40:33.251 INFO:journalctl@ceph.osd.7.smithi133.stdout:Aug 31 04:40:32 smithi133 podman[58629]: 2024-08-31 04:40:32.848173774 +0000 UTC m=+0.015963564 image pull 79f4cde5e36911a5dca995eeb98098c2c8aae81dd52a088ef2c867bc3363bad0 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61 2024-08-31T04:40:33.252 INFO:journalctl@ceph.osd.7.smithi133.stdout:Aug 31 04:40:32 smithi133 podman[58629]: 2024-08-31 04:40:32.956067497 +0000 UTC m=+0.123857274 container create b8145d87541803426d2df6b532a0c9cdef2f18ae832a819db7c69799be92c040 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-7-deactivate, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.1, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, ceph=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux ) 2024-08-31T04:40:33.252 INFO:journalctl@ceph.osd.7.smithi133.stdout:Aug 31 04:40:33 smithi133 podman[58629]: 2024-08-31 04:40:33.167119354 +0000 UTC m=+0.334909150 container init b8145d87541803426d2df6b532a0c9cdef2f18ae832a819db7c69799be92c040 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-7-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, ceph=True, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.1) 2024-08-31T04:40:33.252 INFO:journalctl@ceph.osd.7.smithi133.stdout:Aug 31 04:40:33 smithi133 podman[58629]: 2024-08-31 04:40:33.170597842 +0000 UTC m=+0.338387629 container start b8145d87541803426d2df6b532a0c9cdef2f18ae832a819db7c69799be92c040 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-7-deactivate, GIT_CLEAN=True, org.label-schema.license=GPLv2, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , io.buildah.version=1.37.1) 2024-08-31T04:40:33.252 INFO:journalctl@ceph.osd.7.smithi133.stdout:Aug 31 04:40:33 smithi133 podman[58629]: 2024-08-31 04:40:33.250027662 +0000 UTC m=+0.417817448 container attach b8145d87541803426d2df6b532a0c9cdef2f18ae832a819db7c69799be92c040 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-7-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.build-date=20240731, ceph=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.1, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD) 2024-08-31T04:40:33.496 INFO:journalctl@ceph.osd.11.smithi177.stdout:Aug 31 04:40:33 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-11[46864]: 2024-08-31T04:40:33.125+0000 7fd602bf1640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-08-31T04:39:30.036711+0000 front 2024-08-31T04:39:30.036747+0000 (oldest deadline 2024-08-31T04:39:55.936674+0000) 2024-08-31T04:40:33.496 INFO:journalctl@ceph.osd.11.smithi177.stdout:Aug 31 04:40:33 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-11[46864]: 2024-08-31T04:40:33.125+0000 7fd602bf1640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.133:6804 osd.1 since back 2024-08-31T04:39:41.138475+0000 front 2024-08-31T04:39:41.138491+0000 (oldest deadline 2024-08-31T04:40:04.038356+0000) 2024-08-31T04:40:33.496 INFO:journalctl@ceph.osd.11.smithi177.stdout:Aug 31 04:40:33 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-11[46864]: 2024-08-31T04:40:33.125+0000 7fd602bf1640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-08-31T04:39:46.939525+0000 front 2024-08-31T04:39:46.939251+0000 (oldest deadline 2024-08-31T04:40:12.239391+0000) 2024-08-31T04:40:33.496 INFO:journalctl@ceph.osd.11.smithi177.stdout:Aug 31 04:40:33 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-11[46864]: 2024-08-31T04:40:33.125+0000 7fd602bf1640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.133:6812 osd.4 since back 2024-08-31T04:40:05.141613+0000 front 2024-08-31T04:40:05.141382+0000 (oldest deadline 2024-08-31T04:40:32.741898+0000) 2024-08-31T04:40:33.543 INFO:journalctl@ceph.osd.7.smithi133.stdout:Aug 31 04:40:33 smithi133 podman[58629]: 2024-08-31 04:40:33.356821022 +0000 UTC m=+0.524610800 container died b8145d87541803426d2df6b532a0c9cdef2f18ae832a819db7c69799be92c040 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-7-deactivate, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, io.buildah.version=1.37.1, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_CLEAN=True, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0) 2024-08-31T04:40:33.950 INFO:journalctl@ceph.osd.9.smithi050.stdout:Aug 31 04:40:33 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-9[52806]: 2024-08-31T04:40:33.488+0000 7f30c0800640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-08-31T04:39:33.661151+0000 front 2024-08-31T04:39:33.661082+0000 (oldest deadline 2024-08-31T04:39:55.361248+0000) 2024-08-31T04:40:33.950 INFO:journalctl@ceph.osd.9.smithi050.stdout:Aug 31 04:40:33 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-9[52806]: 2024-08-31T04:40:33.488+0000 7f30c0800640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.133:6804 osd.1 since back 2024-08-31T04:39:41.262725+0000 front 2024-08-31T04:39:41.262699+0000 (oldest deadline 2024-08-31T04:40:05.362593+0000) 2024-08-31T04:40:33.950 INFO:journalctl@ceph.osd.9.smithi050.stdout:Aug 31 04:40:33 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-9[52806]: 2024-08-31T04:40:33.488+0000 7f30c0800640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-08-31T04:39:50.664217+0000 front 2024-08-31T04:39:50.663973+0000 (oldest deadline 2024-08-31T04:40:14.163759+0000) 2024-08-31T04:40:33.950 INFO:journalctl@ceph.osd.9.smithi050.stdout:Aug 31 04:40:33 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-9[52806]: 2024-08-31T04:40:33.488+0000 7f30c0800640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2024-08-31T04:39:55.765151+0000 front 2024-08-31T04:39:55.765209+0000 (oldest deadline 2024-08-31T04:40:19.865200+0000) 2024-08-31T04:40:33.977 DEBUG:teuthology.orchestra.run.smithi133:> sudo pkill -f 'journalctl -f -n 0 -u ceph-058d9fc6-674f-11ef-bcd4-c7b262605968@osd.7.service' 2024-08-31T04:40:34.017 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-31T04:40:34.018 INFO:tasks.cephadm.osd.7:Stopped osd.7 2024-08-31T04:40:34.018 INFO:tasks.cephadm.osd.8:Stopping osd.8... 2024-08-31T04:40:34.018 DEBUG:teuthology.orchestra.run.smithi177:> sudo systemctl stop ceph-058d9fc6-674f-11ef-bcd4-c7b262605968@osd.8 2024-08-31T04:40:34.064 INFO:journalctl@ceph.osd.8.smithi177.stdout:Aug 31 04:40:33 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-8[40333]: 2024-08-31T04:40:33.804+0000 7f244221a640 -1 osd.8 83 heartbeat_check: no reply from 172.21.15.133:6804 osd.1 since back 2024-08-31T04:39:41.888896+0000 front 2024-08-31T04:39:41.888953+0000 (oldest deadline 2024-08-31T04:40:03.588900+0000) 2024-08-31T04:40:34.064 INFO:journalctl@ceph.osd.8.smithi177.stdout:Aug 31 04:40:33 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-8[40333]: 2024-08-31T04:40:33.804+0000 7f244221a640 -1 osd.8 83 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-08-31T04:39:48.790419+0000 front 2024-08-31T04:39:48.790532+0000 (oldest deadline 2024-08-31T04:40:12.890634+0000) 2024-08-31T04:40:34.065 INFO:journalctl@ceph.osd.8.smithi177.stdout:Aug 31 04:40:33 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-8[40333]: 2024-08-31T04:40:33.804+0000 7f244221a640 -1 osd.8 83 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2024-08-31T04:39:58.792110+0000 front 2024-08-31T04:39:58.792093+0000 (oldest deadline 2024-08-31T04:40:23.491915+0000) 2024-08-31T04:40:34.065 INFO:journalctl@ceph.osd.8.smithi177.stdout:Aug 31 04:40:33 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-8[40333]: 2024-08-31T04:40:33.804+0000 7f244221a640 -1 osd.8 83 heartbeat_check: no reply from 172.21.15.133:6812 osd.4 since back 2024-08-31T04:40:06.393267+0000 front 2024-08-31T04:40:06.393388+0000 (oldest deadline 2024-08-31T04:40:29.893120+0000) 2024-08-31T04:40:34.259 INFO:journalctl@ceph.osd.10.smithi133.stdout:Aug 31 04:40:34 smithi133 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-10[46762]: 2024-08-31T04:40:34.041+0000 7f873f3e9640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-08-31T04:39:32.936397+0000 front 2024-08-31T04:39:32.936196+0000 (oldest deadline 2024-08-31T04:39:55.836336+0000) 2024-08-31T04:40:34.259 INFO:journalctl@ceph.osd.10.smithi133.stdout:Aug 31 04:40:34 smithi133 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-10[46762]: 2024-08-31T04:40:34.041+0000 7f873f3e9640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.133:6804 osd.1 since back 2024-08-31T04:39:40.537248+0000 front 2024-08-31T04:39:40.537370+0000 (oldest deadline 2024-08-31T04:40:06.437470+0000) 2024-08-31T04:40:34.259 INFO:journalctl@ceph.osd.10.smithi133.stdout:Aug 31 04:40:34 smithi133 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-10[46762]: 2024-08-31T04:40:34.041+0000 7f873f3e9640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-08-31T04:39:50.438807+0000 front 2024-08-31T04:39:50.438655+0000 (oldest deadline 2024-08-31T04:40:11.538621+0000) 2024-08-31T04:40:34.259 INFO:journalctl@ceph.osd.10.smithi133.stdout:Aug 31 04:40:34 smithi133 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-10[46762]: 2024-08-31T04:40:34.041+0000 7f873f3e9640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2024-08-31T04:39:55.639898+0000 front 2024-08-31T04:39:55.639930+0000 (oldest deadline 2024-08-31T04:40:20.939655+0000) 2024-08-31T04:40:34.259 INFO:journalctl@ceph.osd.10.smithi133.stdout:Aug 31 04:40:34 smithi133 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-10[46762]: 2024-08-31T04:40:34.041+0000 7f873f3e9640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.133:6812 osd.4 since back 2024-08-31T04:40:05.040435+0000 front 2024-08-31T04:40:05.040466+0000 (oldest deadline 2024-08-31T04:40:28.540479+0000) 2024-08-31T04:40:34.496 INFO:journalctl@ceph.osd.8.smithi177.stdout:Aug 31 04:40:34 smithi177 systemd[1]: Stopping Ceph osd.8 for 058d9fc6-674f-11ef-bcd4-c7b262605968... 2024-08-31T04:40:34.496 INFO:journalctl@ceph.osd.8.smithi177.stdout:Aug 31 04:40:34 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-8[40333]: 2024-08-31T04:40:34.307+0000 7f2445c2f640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.8 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-31T04:40:34.496 INFO:journalctl@ceph.osd.8.smithi177.stdout:Aug 31 04:40:34 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-8[40333]: 2024-08-31T04:40:34.307+0000 7f2445c2f640 -1 osd.8 83 *** Got signal Terminated *** 2024-08-31T04:40:34.496 INFO:journalctl@ceph.osd.8.smithi177.stdout:Aug 31 04:40:34 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-8[40333]: 2024-08-31T04:40:34.307+0000 7f2445c2f640 -1 osd.8 83 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-08-31T04:40:34.497 INFO:journalctl@ceph.osd.11.smithi177.stdout:Aug 31 04:40:34 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-11[46864]: 2024-08-31T04:40:34.152+0000 7fd602bf1640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-08-31T04:39:30.036711+0000 front 2024-08-31T04:39:30.036747+0000 (oldest deadline 2024-08-31T04:39:55.936674+0000) 2024-08-31T04:40:34.497 INFO:journalctl@ceph.osd.11.smithi177.stdout:Aug 31 04:40:34 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-11[46864]: 2024-08-31T04:40:34.152+0000 7fd602bf1640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.133:6804 osd.1 since back 2024-08-31T04:39:41.138475+0000 front 2024-08-31T04:39:41.138491+0000 (oldest deadline 2024-08-31T04:40:04.038356+0000) 2024-08-31T04:40:34.497 INFO:journalctl@ceph.osd.11.smithi177.stdout:Aug 31 04:40:34 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-11[46864]: 2024-08-31T04:40:34.152+0000 7fd602bf1640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-08-31T04:39:46.939525+0000 front 2024-08-31T04:39:46.939251+0000 (oldest deadline 2024-08-31T04:40:12.239391+0000) 2024-08-31T04:40:34.497 INFO:journalctl@ceph.osd.11.smithi177.stdout:Aug 31 04:40:34 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-11[46864]: 2024-08-31T04:40:34.152+0000 7fd602bf1640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.133:6812 osd.4 since back 2024-08-31T04:40:05.141613+0000 front 2024-08-31T04:40:05.141382+0000 (oldest deadline 2024-08-31T04:40:32.741898+0000) 2024-08-31T04:40:34.950 INFO:journalctl@ceph.osd.9.smithi050.stdout:Aug 31 04:40:34 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-9[52806]: 2024-08-31T04:40:34.530+0000 7f30c0800640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-08-31T04:39:33.661151+0000 front 2024-08-31T04:39:33.661082+0000 (oldest deadline 2024-08-31T04:39:55.361248+0000) 2024-08-31T04:40:34.950 INFO:journalctl@ceph.osd.9.smithi050.stdout:Aug 31 04:40:34 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-9[52806]: 2024-08-31T04:40:34.530+0000 7f30c0800640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.133:6804 osd.1 since back 2024-08-31T04:39:41.262725+0000 front 2024-08-31T04:39:41.262699+0000 (oldest deadline 2024-08-31T04:40:05.362593+0000) 2024-08-31T04:40:34.950 INFO:journalctl@ceph.osd.9.smithi050.stdout:Aug 31 04:40:34 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-9[52806]: 2024-08-31T04:40:34.530+0000 7f30c0800640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-08-31T04:39:50.664217+0000 front 2024-08-31T04:39:50.663973+0000 (oldest deadline 2024-08-31T04:40:14.163759+0000) 2024-08-31T04:40:34.950 INFO:journalctl@ceph.osd.9.smithi050.stdout:Aug 31 04:40:34 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-9[52806]: 2024-08-31T04:40:34.530+0000 7f30c0800640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2024-08-31T04:39:55.765151+0000 front 2024-08-31T04:39:55.765209+0000 (oldest deadline 2024-08-31T04:40:19.865200+0000) 2024-08-31T04:40:35.195 INFO:journalctl@ceph.osd.8.smithi177.stdout:Aug 31 04:40:34 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-8[40333]: 2024-08-31T04:40:34.826+0000 7f244221a640 -1 osd.8 83 heartbeat_check: no reply from 172.21.15.133:6804 osd.1 since back 2024-08-31T04:39:41.888896+0000 front 2024-08-31T04:39:41.888953+0000 (oldest deadline 2024-08-31T04:40:03.588900+0000) 2024-08-31T04:40:35.195 INFO:journalctl@ceph.osd.8.smithi177.stdout:Aug 31 04:40:34 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-8[40333]: 2024-08-31T04:40:34.826+0000 7f244221a640 -1 osd.8 83 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-08-31T04:39:48.790419+0000 front 2024-08-31T04:39:48.790532+0000 (oldest deadline 2024-08-31T04:40:12.890634+0000) 2024-08-31T04:40:35.195 INFO:journalctl@ceph.osd.8.smithi177.stdout:Aug 31 04:40:34 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-8[40333]: 2024-08-31T04:40:34.826+0000 7f244221a640 -1 osd.8 83 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2024-08-31T04:39:58.792110+0000 front 2024-08-31T04:39:58.792093+0000 (oldest deadline 2024-08-31T04:40:23.491915+0000) 2024-08-31T04:40:35.195 INFO:journalctl@ceph.osd.8.smithi177.stdout:Aug 31 04:40:34 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-8[40333]: 2024-08-31T04:40:34.826+0000 7f244221a640 -1 osd.8 83 heartbeat_check: no reply from 172.21.15.133:6812 osd.4 since back 2024-08-31T04:40:06.393267+0000 front 2024-08-31T04:40:06.393388+0000 (oldest deadline 2024-08-31T04:40:29.893120+0000) 2024-08-31T04:40:35.293 INFO:journalctl@ceph.osd.10.smithi133.stdout:Aug 31 04:40:34 smithi133 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-10[46762]: 2024-08-31T04:40:34.993+0000 7f873f3e9640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-08-31T04:39:32.936397+0000 front 2024-08-31T04:39:32.936196+0000 (oldest deadline 2024-08-31T04:39:55.836336+0000) 2024-08-31T04:40:35.293 INFO:journalctl@ceph.osd.10.smithi133.stdout:Aug 31 04:40:34 smithi133 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-10[46762]: 2024-08-31T04:40:34.994+0000 7f873f3e9640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.133:6804 osd.1 since back 2024-08-31T04:39:40.537248+0000 front 2024-08-31T04:39:40.537370+0000 (oldest deadline 2024-08-31T04:40:06.437470+0000) 2024-08-31T04:40:35.293 INFO:journalctl@ceph.osd.10.smithi133.stdout:Aug 31 04:40:34 smithi133 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-10[46762]: 2024-08-31T04:40:34.994+0000 7f873f3e9640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-08-31T04:39:50.438807+0000 front 2024-08-31T04:39:50.438655+0000 (oldest deadline 2024-08-31T04:40:11.538621+0000) 2024-08-31T04:40:35.293 INFO:journalctl@ceph.osd.10.smithi133.stdout:Aug 31 04:40:34 smithi133 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-10[46762]: 2024-08-31T04:40:34.994+0000 7f873f3e9640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2024-08-31T04:39:55.639898+0000 front 2024-08-31T04:39:55.639930+0000 (oldest deadline 2024-08-31T04:40:20.939655+0000) 2024-08-31T04:40:35.293 INFO:journalctl@ceph.osd.10.smithi133.stdout:Aug 31 04:40:34 smithi133 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-10[46762]: 2024-08-31T04:40:34.994+0000 7f873f3e9640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.133:6812 osd.4 since back 2024-08-31T04:40:05.040435+0000 front 2024-08-31T04:40:05.040466+0000 (oldest deadline 2024-08-31T04:40:28.540479+0000) 2024-08-31T04:40:35.496 INFO:journalctl@ceph.osd.11.smithi177.stdout:Aug 31 04:40:35 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-11[46864]: 2024-08-31T04:40:35.193+0000 7fd602bf1640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-08-31T04:39:30.036711+0000 front 2024-08-31T04:39:30.036747+0000 (oldest deadline 2024-08-31T04:39:55.936674+0000) 2024-08-31T04:40:35.496 INFO:journalctl@ceph.osd.11.smithi177.stdout:Aug 31 04:40:35 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-11[46864]: 2024-08-31T04:40:35.193+0000 7fd602bf1640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.133:6804 osd.1 since back 2024-08-31T04:39:41.138475+0000 front 2024-08-31T04:39:41.138491+0000 (oldest deadline 2024-08-31T04:40:04.038356+0000) 2024-08-31T04:40:35.496 INFO:journalctl@ceph.osd.11.smithi177.stdout:Aug 31 04:40:35 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-11[46864]: 2024-08-31T04:40:35.193+0000 7fd602bf1640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-08-31T04:39:46.939525+0000 front 2024-08-31T04:39:46.939251+0000 (oldest deadline 2024-08-31T04:40:12.239391+0000) 2024-08-31T04:40:35.496 INFO:journalctl@ceph.osd.11.smithi177.stdout:Aug 31 04:40:35 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-11[46864]: 2024-08-31T04:40:35.193+0000 7fd602bf1640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.133:6812 osd.4 since back 2024-08-31T04:40:05.141613+0000 front 2024-08-31T04:40:05.141382+0000 (oldest deadline 2024-08-31T04:40:32.741898+0000) 2024-08-31T04:40:35.950 INFO:journalctl@ceph.osd.9.smithi050.stdout:Aug 31 04:40:35 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-9[52806]: 2024-08-31T04:40:35.513+0000 7f30c0800640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-08-31T04:39:33.661151+0000 front 2024-08-31T04:39:33.661082+0000 (oldest deadline 2024-08-31T04:39:55.361248+0000) 2024-08-31T04:40:35.950 INFO:journalctl@ceph.osd.9.smithi050.stdout:Aug 31 04:40:35 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-9[52806]: 2024-08-31T04:40:35.513+0000 7f30c0800640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.133:6804 osd.1 since back 2024-08-31T04:39:41.262725+0000 front 2024-08-31T04:39:41.262699+0000 (oldest deadline 2024-08-31T04:40:05.362593+0000) 2024-08-31T04:40:35.950 INFO:journalctl@ceph.osd.9.smithi050.stdout:Aug 31 04:40:35 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-9[52806]: 2024-08-31T04:40:35.513+0000 7f30c0800640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-08-31T04:39:50.664217+0000 front 2024-08-31T04:39:50.663973+0000 (oldest deadline 2024-08-31T04:40:14.163759+0000) 2024-08-31T04:40:35.950 INFO:journalctl@ceph.osd.9.smithi050.stdout:Aug 31 04:40:35 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-9[52806]: 2024-08-31T04:40:35.513+0000 7f30c0800640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2024-08-31T04:39:55.765151+0000 front 2024-08-31T04:39:55.765209+0000 (oldest deadline 2024-08-31T04:40:19.865200+0000) 2024-08-31T04:40:36.217 INFO:journalctl@ceph.osd.8.smithi177.stdout:Aug 31 04:40:35 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-8[40333]: 2024-08-31T04:40:35.789+0000 7f244221a640 -1 osd.8 83 heartbeat_check: no reply from 172.21.15.133:6804 osd.1 since back 2024-08-31T04:39:41.888896+0000 front 2024-08-31T04:39:41.888953+0000 (oldest deadline 2024-08-31T04:40:03.588900+0000) 2024-08-31T04:40:36.217 INFO:journalctl@ceph.osd.8.smithi177.stdout:Aug 31 04:40:35 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-8[40333]: 2024-08-31T04:40:35.789+0000 7f244221a640 -1 osd.8 83 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-08-31T04:39:48.790419+0000 front 2024-08-31T04:39:48.790532+0000 (oldest deadline 2024-08-31T04:40:12.890634+0000) 2024-08-31T04:40:36.217 INFO:journalctl@ceph.osd.8.smithi177.stdout:Aug 31 04:40:35 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-8[40333]: 2024-08-31T04:40:35.789+0000 7f244221a640 -1 osd.8 83 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2024-08-31T04:39:58.792110+0000 front 2024-08-31T04:39:58.792093+0000 (oldest deadline 2024-08-31T04:40:23.491915+0000) 2024-08-31T04:40:36.217 INFO:journalctl@ceph.osd.8.smithi177.stdout:Aug 31 04:40:35 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-8[40333]: 2024-08-31T04:40:35.789+0000 7f244221a640 -1 osd.8 83 heartbeat_check: no reply from 172.21.15.133:6812 osd.4 since back 2024-08-31T04:40:06.393267+0000 front 2024-08-31T04:40:06.393388+0000 (oldest deadline 2024-08-31T04:40:29.893120+0000) 2024-08-31T04:40:36.293 INFO:journalctl@ceph.osd.10.smithi133.stdout:Aug 31 04:40:36 smithi133 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-10[46762]: 2024-08-31T04:40:36.020+0000 7f873f3e9640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-08-31T04:39:32.936397+0000 front 2024-08-31T04:39:32.936196+0000 (oldest deadline 2024-08-31T04:39:55.836336+0000) 2024-08-31T04:40:36.293 INFO:journalctl@ceph.osd.10.smithi133.stdout:Aug 31 04:40:36 smithi133 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-10[46762]: 2024-08-31T04:40:36.020+0000 7f873f3e9640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.133:6804 osd.1 since back 2024-08-31T04:39:40.537248+0000 front 2024-08-31T04:39:40.537370+0000 (oldest deadline 2024-08-31T04:40:06.437470+0000) 2024-08-31T04:40:36.293 INFO:journalctl@ceph.osd.10.smithi133.stdout:Aug 31 04:40:36 smithi133 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-10[46762]: 2024-08-31T04:40:36.020+0000 7f873f3e9640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-08-31T04:39:50.438807+0000 front 2024-08-31T04:39:50.438655+0000 (oldest deadline 2024-08-31T04:40:11.538621+0000) 2024-08-31T04:40:36.293 INFO:journalctl@ceph.osd.10.smithi133.stdout:Aug 31 04:40:36 smithi133 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-10[46762]: 2024-08-31T04:40:36.020+0000 7f873f3e9640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2024-08-31T04:39:55.639898+0000 front 2024-08-31T04:39:55.639930+0000 (oldest deadline 2024-08-31T04:40:20.939655+0000) 2024-08-31T04:40:36.293 INFO:journalctl@ceph.osd.10.smithi133.stdout:Aug 31 04:40:36 smithi133 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-10[46762]: 2024-08-31T04:40:36.020+0000 7f873f3e9640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.133:6812 osd.4 since back 2024-08-31T04:40:05.040435+0000 front 2024-08-31T04:40:05.040466+0000 (oldest deadline 2024-08-31T04:40:28.540479+0000) 2024-08-31T04:40:36.496 INFO:journalctl@ceph.osd.11.smithi177.stdout:Aug 31 04:40:36 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-11[46864]: 2024-08-31T04:40:36.215+0000 7fd602bf1640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-08-31T04:39:30.036711+0000 front 2024-08-31T04:39:30.036747+0000 (oldest deadline 2024-08-31T04:39:55.936674+0000) 2024-08-31T04:40:36.496 INFO:journalctl@ceph.osd.11.smithi177.stdout:Aug 31 04:40:36 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-11[46864]: 2024-08-31T04:40:36.215+0000 7fd602bf1640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.133:6804 osd.1 since back 2024-08-31T04:39:41.138475+0000 front 2024-08-31T04:39:41.138491+0000 (oldest deadline 2024-08-31T04:40:04.038356+0000) 2024-08-31T04:40:36.496 INFO:journalctl@ceph.osd.11.smithi177.stdout:Aug 31 04:40:36 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-11[46864]: 2024-08-31T04:40:36.215+0000 7fd602bf1640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-08-31T04:39:46.939525+0000 front 2024-08-31T04:39:46.939251+0000 (oldest deadline 2024-08-31T04:40:12.239391+0000) 2024-08-31T04:40:36.496 INFO:journalctl@ceph.osd.11.smithi177.stdout:Aug 31 04:40:36 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-11[46864]: 2024-08-31T04:40:36.215+0000 7fd602bf1640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.133:6812 osd.4 since back 2024-08-31T04:40:05.141613+0000 front 2024-08-31T04:40:05.141382+0000 (oldest deadline 2024-08-31T04:40:32.741898+0000) 2024-08-31T04:40:36.700 INFO:journalctl@ceph.osd.9.smithi050.stdout:Aug 31 04:40:36 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-9[52806]: 2024-08-31T04:40:36.486+0000 7f30c0800640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-08-31T04:39:33.661151+0000 front 2024-08-31T04:39:33.661082+0000 (oldest deadline 2024-08-31T04:39:55.361248+0000) 2024-08-31T04:40:36.700 INFO:journalctl@ceph.osd.9.smithi050.stdout:Aug 31 04:40:36 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-9[52806]: 2024-08-31T04:40:36.486+0000 7f30c0800640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.133:6804 osd.1 since back 2024-08-31T04:39:41.262725+0000 front 2024-08-31T04:39:41.262699+0000 (oldest deadline 2024-08-31T04:40:05.362593+0000) 2024-08-31T04:40:36.700 INFO:journalctl@ceph.osd.9.smithi050.stdout:Aug 31 04:40:36 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-9[52806]: 2024-08-31T04:40:36.486+0000 7f30c0800640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-08-31T04:39:50.664217+0000 front 2024-08-31T04:39:50.663973+0000 (oldest deadline 2024-08-31T04:40:14.163759+0000) 2024-08-31T04:40:36.700 INFO:journalctl@ceph.osd.9.smithi050.stdout:Aug 31 04:40:36 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-9[52806]: 2024-08-31T04:40:36.486+0000 7f30c0800640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2024-08-31T04:39:55.765151+0000 front 2024-08-31T04:39:55.765209+0000 (oldest deadline 2024-08-31T04:40:19.865200+0000) 2024-08-31T04:40:36.700 INFO:journalctl@ceph.osd.9.smithi050.stdout:Aug 31 04:40:36 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-9[52806]: 2024-08-31T04:40:36.486+0000 7f30c0800640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.177:6812 osd.5 since back 2024-08-31T04:40:12.667949+0000 front 2024-08-31T04:40:12.667982+0000 (oldest deadline 2024-08-31T04:40:35.567668+0000) 2024-08-31T04:40:37.204 INFO:journalctl@ceph.osd.8.smithi177.stdout:Aug 31 04:40:36 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-8[40333]: 2024-08-31T04:40:36.837+0000 7f244221a640 -1 osd.8 83 heartbeat_check: no reply from 172.21.15.133:6804 osd.1 since back 2024-08-31T04:39:41.888896+0000 front 2024-08-31T04:39:41.888953+0000 (oldest deadline 2024-08-31T04:40:03.588900+0000) 2024-08-31T04:40:37.204 INFO:journalctl@ceph.osd.8.smithi177.stdout:Aug 31 04:40:36 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-8[40333]: 2024-08-31T04:40:36.837+0000 7f244221a640 -1 osd.8 83 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-08-31T04:39:48.790419+0000 front 2024-08-31T04:39:48.790532+0000 (oldest deadline 2024-08-31T04:40:12.890634+0000) 2024-08-31T04:40:37.205 INFO:journalctl@ceph.osd.8.smithi177.stdout:Aug 31 04:40:36 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-8[40333]: 2024-08-31T04:40:36.837+0000 7f244221a640 -1 osd.8 83 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2024-08-31T04:39:58.792110+0000 front 2024-08-31T04:39:58.792093+0000 (oldest deadline 2024-08-31T04:40:23.491915+0000) 2024-08-31T04:40:37.205 INFO:journalctl@ceph.osd.8.smithi177.stdout:Aug 31 04:40:36 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-8[40333]: 2024-08-31T04:40:36.837+0000 7f244221a640 -1 osd.8 83 heartbeat_check: no reply from 172.21.15.133:6812 osd.4 since back 2024-08-31T04:40:06.393267+0000 front 2024-08-31T04:40:06.393388+0000 (oldest deadline 2024-08-31T04:40:29.893120+0000) 2024-08-31T04:40:37.205 INFO:journalctl@ceph.osd.8.smithi177.stdout:Aug 31 04:40:36 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-8[40333]: 2024-08-31T04:40:36.837+0000 7f244221a640 -1 osd.8 83 heartbeat_check: no reply from 172.21.15.177:6812 osd.5 since back 2024-08-31T04:40:11.594139+0000 front 2024-08-31T04:40:11.593993+0000 (oldest deadline 2024-08-31T04:40:36.294025+0000) 2024-08-31T04:40:37.293 INFO:journalctl@ceph.osd.10.smithi133.stdout:Aug 31 04:40:36 smithi133 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-10[46762]: 2024-08-31T04:40:36.980+0000 7f873f3e9640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-08-31T04:39:32.936397+0000 front 2024-08-31T04:39:32.936196+0000 (oldest deadline 2024-08-31T04:39:55.836336+0000) 2024-08-31T04:40:37.293 INFO:journalctl@ceph.osd.10.smithi133.stdout:Aug 31 04:40:36 smithi133 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-10[46762]: 2024-08-31T04:40:36.980+0000 7f873f3e9640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.133:6804 osd.1 since back 2024-08-31T04:39:40.537248+0000 front 2024-08-31T04:39:40.537370+0000 (oldest deadline 2024-08-31T04:40:06.437470+0000) 2024-08-31T04:40:37.293 INFO:journalctl@ceph.osd.10.smithi133.stdout:Aug 31 04:40:36 smithi133 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-10[46762]: 2024-08-31T04:40:36.980+0000 7f873f3e9640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-08-31T04:39:50.438807+0000 front 2024-08-31T04:39:50.438655+0000 (oldest deadline 2024-08-31T04:40:11.538621+0000) 2024-08-31T04:40:37.293 INFO:journalctl@ceph.osd.10.smithi133.stdout:Aug 31 04:40:36 smithi133 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-10[46762]: 2024-08-31T04:40:36.980+0000 7f873f3e9640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2024-08-31T04:39:55.639898+0000 front 2024-08-31T04:39:55.639930+0000 (oldest deadline 2024-08-31T04:40:20.939655+0000) 2024-08-31T04:40:37.293 INFO:journalctl@ceph.osd.10.smithi133.stdout:Aug 31 04:40:36 smithi133 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-10[46762]: 2024-08-31T04:40:36.980+0000 7f873f3e9640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.133:6812 osd.4 since back 2024-08-31T04:40:05.040435+0000 front 2024-08-31T04:40:05.040466+0000 (oldest deadline 2024-08-31T04:40:28.540479+0000) 2024-08-31T04:40:37.496 INFO:journalctl@ceph.osd.11.smithi177.stdout:Aug 31 04:40:37 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-11[46864]: 2024-08-31T04:40:37.202+0000 7fd602bf1640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-08-31T04:39:30.036711+0000 front 2024-08-31T04:39:30.036747+0000 (oldest deadline 2024-08-31T04:39:55.936674+0000) 2024-08-31T04:40:37.496 INFO:journalctl@ceph.osd.11.smithi177.stdout:Aug 31 04:40:37 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-11[46864]: 2024-08-31T04:40:37.202+0000 7fd602bf1640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.133:6804 osd.1 since back 2024-08-31T04:39:41.138475+0000 front 2024-08-31T04:39:41.138491+0000 (oldest deadline 2024-08-31T04:40:04.038356+0000) 2024-08-31T04:40:37.496 INFO:journalctl@ceph.osd.11.smithi177.stdout:Aug 31 04:40:37 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-11[46864]: 2024-08-31T04:40:37.202+0000 7fd602bf1640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-08-31T04:39:46.939525+0000 front 2024-08-31T04:39:46.939251+0000 (oldest deadline 2024-08-31T04:40:12.239391+0000) 2024-08-31T04:40:37.496 INFO:journalctl@ceph.osd.11.smithi177.stdout:Aug 31 04:40:37 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-11[46864]: 2024-08-31T04:40:37.202+0000 7fd602bf1640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.133:6812 osd.4 since back 2024-08-31T04:40:05.141613+0000 front 2024-08-31T04:40:05.141382+0000 (oldest deadline 2024-08-31T04:40:32.741898+0000) 2024-08-31T04:40:37.497 INFO:journalctl@ceph.osd.11.smithi177.stdout:Aug 31 04:40:37 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-11[46864]: 2024-08-31T04:40:37.202+0000 7fd602bf1640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.177:6812 osd.5 since back 2024-08-31T04:40:12.742231+0000 front 2024-08-31T04:40:12.742332+0000 (oldest deadline 2024-08-31T04:40:36.842325+0000) 2024-08-31T04:40:37.950 INFO:journalctl@ceph.osd.9.smithi050.stdout:Aug 31 04:40:37 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-9[52806]: 2024-08-31T04:40:37.490+0000 7f30c0800640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-08-31T04:39:33.661151+0000 front 2024-08-31T04:39:33.661082+0000 (oldest deadline 2024-08-31T04:39:55.361248+0000) 2024-08-31T04:40:37.950 INFO:journalctl@ceph.osd.9.smithi050.stdout:Aug 31 04:40:37 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-9[52806]: 2024-08-31T04:40:37.490+0000 7f30c0800640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.133:6804 osd.1 since back 2024-08-31T04:39:41.262725+0000 front 2024-08-31T04:39:41.262699+0000 (oldest deadline 2024-08-31T04:40:05.362593+0000) 2024-08-31T04:40:37.950 INFO:journalctl@ceph.osd.9.smithi050.stdout:Aug 31 04:40:37 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-9[52806]: 2024-08-31T04:40:37.490+0000 7f30c0800640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-08-31T04:39:50.664217+0000 front 2024-08-31T04:39:50.663973+0000 (oldest deadline 2024-08-31T04:40:14.163759+0000) 2024-08-31T04:40:37.950 INFO:journalctl@ceph.osd.9.smithi050.stdout:Aug 31 04:40:37 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-9[52806]: 2024-08-31T04:40:37.490+0000 7f30c0800640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2024-08-31T04:39:55.765151+0000 front 2024-08-31T04:39:55.765209+0000 (oldest deadline 2024-08-31T04:40:19.865200+0000) 2024-08-31T04:40:37.951 INFO:journalctl@ceph.osd.9.smithi050.stdout:Aug 31 04:40:37 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-9[52806]: 2024-08-31T04:40:37.490+0000 7f30c0800640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.177:6812 osd.5 since back 2024-08-31T04:40:12.667949+0000 front 2024-08-31T04:40:12.667982+0000 (oldest deadline 2024-08-31T04:40:35.567668+0000) 2024-08-31T04:40:38.220 INFO:journalctl@ceph.osd.8.smithi177.stdout:Aug 31 04:40:37 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-8[40333]: 2024-08-31T04:40:37.872+0000 7f244221a640 -1 osd.8 83 heartbeat_check: no reply from 172.21.15.133:6804 osd.1 since back 2024-08-31T04:39:41.888896+0000 front 2024-08-31T04:39:41.888953+0000 (oldest deadline 2024-08-31T04:40:03.588900+0000) 2024-08-31T04:40:38.220 INFO:journalctl@ceph.osd.8.smithi177.stdout:Aug 31 04:40:37 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-8[40333]: 2024-08-31T04:40:37.872+0000 7f244221a640 -1 osd.8 83 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-08-31T04:39:48.790419+0000 front 2024-08-31T04:39:48.790532+0000 (oldest deadline 2024-08-31T04:40:12.890634+0000) 2024-08-31T04:40:38.221 INFO:journalctl@ceph.osd.8.smithi177.stdout:Aug 31 04:40:37 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-8[40333]: 2024-08-31T04:40:37.872+0000 7f244221a640 -1 osd.8 83 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2024-08-31T04:39:58.792110+0000 front 2024-08-31T04:39:58.792093+0000 (oldest deadline 2024-08-31T04:40:23.491915+0000) 2024-08-31T04:40:38.221 INFO:journalctl@ceph.osd.8.smithi177.stdout:Aug 31 04:40:37 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-8[40333]: 2024-08-31T04:40:37.872+0000 7f244221a640 -1 osd.8 83 heartbeat_check: no reply from 172.21.15.133:6812 osd.4 since back 2024-08-31T04:40:06.393267+0000 front 2024-08-31T04:40:06.393388+0000 (oldest deadline 2024-08-31T04:40:29.893120+0000) 2024-08-31T04:40:38.221 INFO:journalctl@ceph.osd.8.smithi177.stdout:Aug 31 04:40:37 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-8[40333]: 2024-08-31T04:40:37.872+0000 7f244221a640 -1 osd.8 83 heartbeat_check: no reply from 172.21.15.177:6812 osd.5 since back 2024-08-31T04:40:11.594139+0000 front 2024-08-31T04:40:11.593993+0000 (oldest deadline 2024-08-31T04:40:36.294025+0000) 2024-08-31T04:40:38.293 INFO:journalctl@ceph.osd.10.smithi133.stdout:Aug 31 04:40:37 smithi133 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-10[46762]: 2024-08-31T04:40:37.977+0000 7f873f3e9640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-08-31T04:39:32.936397+0000 front 2024-08-31T04:39:32.936196+0000 (oldest deadline 2024-08-31T04:39:55.836336+0000) 2024-08-31T04:40:38.293 INFO:journalctl@ceph.osd.10.smithi133.stdout:Aug 31 04:40:37 smithi133 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-10[46762]: 2024-08-31T04:40:37.977+0000 7f873f3e9640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.133:6804 osd.1 since back 2024-08-31T04:39:40.537248+0000 front 2024-08-31T04:39:40.537370+0000 (oldest deadline 2024-08-31T04:40:06.437470+0000) 2024-08-31T04:40:38.293 INFO:journalctl@ceph.osd.10.smithi133.stdout:Aug 31 04:40:37 smithi133 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-10[46762]: 2024-08-31T04:40:37.977+0000 7f873f3e9640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-08-31T04:39:50.438807+0000 front 2024-08-31T04:39:50.438655+0000 (oldest deadline 2024-08-31T04:40:11.538621+0000) 2024-08-31T04:40:38.293 INFO:journalctl@ceph.osd.10.smithi133.stdout:Aug 31 04:40:37 smithi133 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-10[46762]: 2024-08-31T04:40:37.977+0000 7f873f3e9640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2024-08-31T04:39:55.639898+0000 front 2024-08-31T04:39:55.639930+0000 (oldest deadline 2024-08-31T04:40:20.939655+0000) 2024-08-31T04:40:38.293 INFO:journalctl@ceph.osd.10.smithi133.stdout:Aug 31 04:40:37 smithi133 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-10[46762]: 2024-08-31T04:40:37.977+0000 7f873f3e9640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.133:6812 osd.4 since back 2024-08-31T04:40:05.040435+0000 front 2024-08-31T04:40:05.040466+0000 (oldest deadline 2024-08-31T04:40:28.540479+0000) 2024-08-31T04:40:38.293 INFO:journalctl@ceph.osd.10.smithi133.stdout:Aug 31 04:40:37 smithi133 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-10[46762]: 2024-08-31T04:40:37.977+0000 7f873f3e9640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.177:6812 osd.5 since back 2024-08-31T04:40:12.041463+0000 front 2024-08-31T04:40:12.041501+0000 (oldest deadline 2024-08-31T04:40:37.941448+0000) 2024-08-31T04:40:38.496 INFO:journalctl@ceph.osd.11.smithi177.stdout:Aug 31 04:40:38 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-11[46864]: 2024-08-31T04:40:38.218+0000 7fd602bf1640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-08-31T04:39:30.036711+0000 front 2024-08-31T04:39:30.036747+0000 (oldest deadline 2024-08-31T04:39:55.936674+0000) 2024-08-31T04:40:38.496 INFO:journalctl@ceph.osd.11.smithi177.stdout:Aug 31 04:40:38 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-11[46864]: 2024-08-31T04:40:38.218+0000 7fd602bf1640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.133:6804 osd.1 since back 2024-08-31T04:39:41.138475+0000 front 2024-08-31T04:39:41.138491+0000 (oldest deadline 2024-08-31T04:40:04.038356+0000) 2024-08-31T04:40:38.496 INFO:journalctl@ceph.osd.11.smithi177.stdout:Aug 31 04:40:38 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-11[46864]: 2024-08-31T04:40:38.218+0000 7fd602bf1640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-08-31T04:39:46.939525+0000 front 2024-08-31T04:39:46.939251+0000 (oldest deadline 2024-08-31T04:40:12.239391+0000) 2024-08-31T04:40:38.496 INFO:journalctl@ceph.osd.11.smithi177.stdout:Aug 31 04:40:38 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-11[46864]: 2024-08-31T04:40:38.218+0000 7fd602bf1640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.133:6812 osd.4 since back 2024-08-31T04:40:05.141613+0000 front 2024-08-31T04:40:05.141382+0000 (oldest deadline 2024-08-31T04:40:32.741898+0000) 2024-08-31T04:40:38.496 INFO:journalctl@ceph.osd.11.smithi177.stdout:Aug 31 04:40:38 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-11[46864]: 2024-08-31T04:40:38.218+0000 7fd602bf1640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.177:6812 osd.5 since back 2024-08-31T04:40:12.742231+0000 front 2024-08-31T04:40:12.742332+0000 (oldest deadline 2024-08-31T04:40:36.842325+0000) 2024-08-31T04:40:38.950 INFO:journalctl@ceph.osd.9.smithi050.stdout:Aug 31 04:40:38 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-9[52806]: 2024-08-31T04:40:38.474+0000 7f30c0800640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-08-31T04:39:33.661151+0000 front 2024-08-31T04:39:33.661082+0000 (oldest deadline 2024-08-31T04:39:55.361248+0000) 2024-08-31T04:40:38.950 INFO:journalctl@ceph.osd.9.smithi050.stdout:Aug 31 04:40:38 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-9[52806]: 2024-08-31T04:40:38.474+0000 7f30c0800640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.133:6804 osd.1 since back 2024-08-31T04:39:41.262725+0000 front 2024-08-31T04:39:41.262699+0000 (oldest deadline 2024-08-31T04:40:05.362593+0000) 2024-08-31T04:40:38.950 INFO:journalctl@ceph.osd.9.smithi050.stdout:Aug 31 04:40:38 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-9[52806]: 2024-08-31T04:40:38.474+0000 7f30c0800640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-08-31T04:39:50.664217+0000 front 2024-08-31T04:39:50.663973+0000 (oldest deadline 2024-08-31T04:40:14.163759+0000) 2024-08-31T04:40:38.950 INFO:journalctl@ceph.osd.9.smithi050.stdout:Aug 31 04:40:38 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-9[52806]: 2024-08-31T04:40:38.474+0000 7f30c0800640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2024-08-31T04:39:55.765151+0000 front 2024-08-31T04:39:55.765209+0000 (oldest deadline 2024-08-31T04:40:19.865200+0000) 2024-08-31T04:40:38.950 INFO:journalctl@ceph.osd.9.smithi050.stdout:Aug 31 04:40:38 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-9[52806]: 2024-08-31T04:40:38.474+0000 7f30c0800640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.177:6812 osd.5 since back 2024-08-31T04:40:12.667949+0000 front 2024-08-31T04:40:12.667982+0000 (oldest deadline 2024-08-31T04:40:35.567668+0000) 2024-08-31T04:40:39.182 INFO:journalctl@ceph.osd.8.smithi177.stdout:Aug 31 04:40:38 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-8[40333]: 2024-08-31T04:40:38.912+0000 7f244221a640 -1 osd.8 83 heartbeat_check: no reply from 172.21.15.133:6804 osd.1 since back 2024-08-31T04:39:41.888896+0000 front 2024-08-31T04:39:41.888953+0000 (oldest deadline 2024-08-31T04:40:03.588900+0000) 2024-08-31T04:40:39.182 INFO:journalctl@ceph.osd.8.smithi177.stdout:Aug 31 04:40:38 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-8[40333]: 2024-08-31T04:40:38.912+0000 7f244221a640 -1 osd.8 83 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-08-31T04:39:48.790419+0000 front 2024-08-31T04:39:48.790532+0000 (oldest deadline 2024-08-31T04:40:12.890634+0000) 2024-08-31T04:40:39.182 INFO:journalctl@ceph.osd.8.smithi177.stdout:Aug 31 04:40:38 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-8[40333]: 2024-08-31T04:40:38.912+0000 7f244221a640 -1 osd.8 83 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2024-08-31T04:39:58.792110+0000 front 2024-08-31T04:39:58.792093+0000 (oldest deadline 2024-08-31T04:40:23.491915+0000) 2024-08-31T04:40:39.183 INFO:journalctl@ceph.osd.8.smithi177.stdout:Aug 31 04:40:38 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-8[40333]: 2024-08-31T04:40:38.912+0000 7f244221a640 -1 osd.8 83 heartbeat_check: no reply from 172.21.15.133:6812 osd.4 since back 2024-08-31T04:40:06.393267+0000 front 2024-08-31T04:40:06.393388+0000 (oldest deadline 2024-08-31T04:40:29.893120+0000) 2024-08-31T04:40:39.183 INFO:journalctl@ceph.osd.8.smithi177.stdout:Aug 31 04:40:38 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-8[40333]: 2024-08-31T04:40:38.912+0000 7f244221a640 -1 osd.8 83 heartbeat_check: no reply from 172.21.15.177:6812 osd.5 since back 2024-08-31T04:40:11.594139+0000 front 2024-08-31T04:40:11.593993+0000 (oldest deadline 2024-08-31T04:40:36.294025+0000) 2024-08-31T04:40:39.293 INFO:journalctl@ceph.osd.10.smithi133.stdout:Aug 31 04:40:38 smithi133 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-10[46762]: 2024-08-31T04:40:38.967+0000 7f873f3e9640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-08-31T04:39:32.936397+0000 front 2024-08-31T04:39:32.936196+0000 (oldest deadline 2024-08-31T04:39:55.836336+0000) 2024-08-31T04:40:39.293 INFO:journalctl@ceph.osd.10.smithi133.stdout:Aug 31 04:40:38 smithi133 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-10[46762]: 2024-08-31T04:40:38.967+0000 7f873f3e9640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.133:6804 osd.1 since back 2024-08-31T04:39:40.537248+0000 front 2024-08-31T04:39:40.537370+0000 (oldest deadline 2024-08-31T04:40:06.437470+0000) 2024-08-31T04:40:39.293 INFO:journalctl@ceph.osd.10.smithi133.stdout:Aug 31 04:40:38 smithi133 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-10[46762]: 2024-08-31T04:40:38.967+0000 7f873f3e9640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-08-31T04:39:50.438807+0000 front 2024-08-31T04:39:50.438655+0000 (oldest deadline 2024-08-31T04:40:11.538621+0000) 2024-08-31T04:40:39.293 INFO:journalctl@ceph.osd.10.smithi133.stdout:Aug 31 04:40:38 smithi133 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-10[46762]: 2024-08-31T04:40:38.967+0000 7f873f3e9640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2024-08-31T04:39:55.639898+0000 front 2024-08-31T04:39:55.639930+0000 (oldest deadline 2024-08-31T04:40:20.939655+0000) 2024-08-31T04:40:39.293 INFO:journalctl@ceph.osd.10.smithi133.stdout:Aug 31 04:40:38 smithi133 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-10[46762]: 2024-08-31T04:40:38.967+0000 7f873f3e9640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.133:6812 osd.4 since back 2024-08-31T04:40:05.040435+0000 front 2024-08-31T04:40:05.040466+0000 (oldest deadline 2024-08-31T04:40:28.540479+0000) 2024-08-31T04:40:39.294 INFO:journalctl@ceph.osd.10.smithi133.stdout:Aug 31 04:40:38 smithi133 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-10[46762]: 2024-08-31T04:40:38.967+0000 7f873f3e9640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.177:6812 osd.5 since back 2024-08-31T04:40:12.041463+0000 front 2024-08-31T04:40:12.041501+0000 (oldest deadline 2024-08-31T04:40:37.941448+0000) 2024-08-31T04:40:39.496 INFO:journalctl@ceph.osd.11.smithi177.stdout:Aug 31 04:40:39 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-11[46864]: 2024-08-31T04:40:39.180+0000 7fd602bf1640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-08-31T04:39:30.036711+0000 front 2024-08-31T04:39:30.036747+0000 (oldest deadline 2024-08-31T04:39:55.936674+0000) 2024-08-31T04:40:39.496 INFO:journalctl@ceph.osd.11.smithi177.stdout:Aug 31 04:40:39 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-11[46864]: 2024-08-31T04:40:39.180+0000 7fd602bf1640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.133:6804 osd.1 since back 2024-08-31T04:39:41.138475+0000 front 2024-08-31T04:39:41.138491+0000 (oldest deadline 2024-08-31T04:40:04.038356+0000) 2024-08-31T04:40:39.496 INFO:journalctl@ceph.osd.11.smithi177.stdout:Aug 31 04:40:39 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-11[46864]: 2024-08-31T04:40:39.180+0000 7fd602bf1640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-08-31T04:39:46.939525+0000 front 2024-08-31T04:39:46.939251+0000 (oldest deadline 2024-08-31T04:40:12.239391+0000) 2024-08-31T04:40:39.496 INFO:journalctl@ceph.osd.11.smithi177.stdout:Aug 31 04:40:39 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-11[46864]: 2024-08-31T04:40:39.180+0000 7fd602bf1640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.133:6812 osd.4 since back 2024-08-31T04:40:05.141613+0000 front 2024-08-31T04:40:05.141382+0000 (oldest deadline 2024-08-31T04:40:32.741898+0000) 2024-08-31T04:40:39.496 INFO:journalctl@ceph.osd.11.smithi177.stdout:Aug 31 04:40:39 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-11[46864]: 2024-08-31T04:40:39.180+0000 7fd602bf1640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.177:6812 osd.5 since back 2024-08-31T04:40:12.742231+0000 front 2024-08-31T04:40:12.742332+0000 (oldest deadline 2024-08-31T04:40:36.842325+0000) 2024-08-31T04:40:39.950 INFO:journalctl@ceph.osd.9.smithi050.stdout:Aug 31 04:40:39 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-9[52806]: 2024-08-31T04:40:39.520+0000 7f30c0800640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-08-31T04:39:33.661151+0000 front 2024-08-31T04:39:33.661082+0000 (oldest deadline 2024-08-31T04:39:55.361248+0000) 2024-08-31T04:40:39.950 INFO:journalctl@ceph.osd.9.smithi050.stdout:Aug 31 04:40:39 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-9[52806]: 2024-08-31T04:40:39.520+0000 7f30c0800640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.133:6804 osd.1 since back 2024-08-31T04:39:41.262725+0000 front 2024-08-31T04:39:41.262699+0000 (oldest deadline 2024-08-31T04:40:05.362593+0000) 2024-08-31T04:40:39.950 INFO:journalctl@ceph.osd.9.smithi050.stdout:Aug 31 04:40:39 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-9[52806]: 2024-08-31T04:40:39.520+0000 7f30c0800640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-08-31T04:39:50.664217+0000 front 2024-08-31T04:39:50.663973+0000 (oldest deadline 2024-08-31T04:40:14.163759+0000) 2024-08-31T04:40:39.950 INFO:journalctl@ceph.osd.9.smithi050.stdout:Aug 31 04:40:39 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-9[52806]: 2024-08-31T04:40:39.520+0000 7f30c0800640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2024-08-31T04:39:55.765151+0000 front 2024-08-31T04:39:55.765209+0000 (oldest deadline 2024-08-31T04:40:19.865200+0000) 2024-08-31T04:40:39.950 INFO:journalctl@ceph.osd.9.smithi050.stdout:Aug 31 04:40:39 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-9[52806]: 2024-08-31T04:40:39.520+0000 7f30c0800640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.177:6812 osd.5 since back 2024-08-31T04:40:12.667949+0000 front 2024-08-31T04:40:12.667982+0000 (oldest deadline 2024-08-31T04:40:35.567668+0000) 2024-08-31T04:40:40.010 INFO:journalctl@ceph.osd.8.smithi177.stdout:Aug 31 04:40:39 smithi177 podman[58887]: 2024-08-31 04:40:39.752337613 +0000 UTC m=+5.542778820 container died 79a110aa309ed95955b2a3d1fc235b0c880b396e172e570ba0a98c9bbc269944 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-8, io.buildah.version=1.37.1, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_CLEAN=True, org.label-schema.build-date=20240731, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=) 2024-08-31T04:40:40.284 INFO:journalctl@ceph.osd.8.smithi177.stdout:Aug 31 04:40:40 smithi177 podman[58887]: 2024-08-31 04:40:40.082657678 +0000 UTC m=+5.873098884 container cleanup 79a110aa309ed95955b2a3d1fc235b0c880b396e172e570ba0a98c9bbc269944 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-8, maintainer=Guillaume Abrioux , io.buildah.version=1.37.1, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.license=GPLv2) 2024-08-31T04:40:40.285 INFO:journalctl@ceph.osd.8.smithi177.stdout:Aug 31 04:40:40 smithi177 bash[58887]: ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-8 2024-08-31T04:40:40.285 INFO:journalctl@ceph.osd.11.smithi177.stdout:Aug 31 04:40:40 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-11[46864]: 2024-08-31T04:40:40.225+0000 7fd602bf1640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-08-31T04:39:30.036711+0000 front 2024-08-31T04:39:30.036747+0000 (oldest deadline 2024-08-31T04:39:55.936674+0000) 2024-08-31T04:40:40.285 INFO:journalctl@ceph.osd.11.smithi177.stdout:Aug 31 04:40:40 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-11[46864]: 2024-08-31T04:40:40.225+0000 7fd602bf1640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.133:6804 osd.1 since back 2024-08-31T04:39:41.138475+0000 front 2024-08-31T04:39:41.138491+0000 (oldest deadline 2024-08-31T04:40:04.038356+0000) 2024-08-31T04:40:40.285 INFO:journalctl@ceph.osd.11.smithi177.stdout:Aug 31 04:40:40 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-11[46864]: 2024-08-31T04:40:40.225+0000 7fd602bf1640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-08-31T04:39:46.939525+0000 front 2024-08-31T04:39:46.939251+0000 (oldest deadline 2024-08-31T04:40:12.239391+0000) 2024-08-31T04:40:40.285 INFO:journalctl@ceph.osd.11.smithi177.stdout:Aug 31 04:40:40 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-11[46864]: 2024-08-31T04:40:40.225+0000 7fd602bf1640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.133:6812 osd.4 since back 2024-08-31T04:40:05.141613+0000 front 2024-08-31T04:40:05.141382+0000 (oldest deadline 2024-08-31T04:40:32.741898+0000) 2024-08-31T04:40:40.285 INFO:journalctl@ceph.osd.11.smithi177.stdout:Aug 31 04:40:40 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-11[46864]: 2024-08-31T04:40:40.225+0000 7fd602bf1640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.177:6812 osd.5 since back 2024-08-31T04:40:12.742231+0000 front 2024-08-31T04:40:12.742332+0000 (oldest deadline 2024-08-31T04:40:36.842325+0000) 2024-08-31T04:40:40.293 INFO:journalctl@ceph.osd.10.smithi133.stdout:Aug 31 04:40:39 smithi133 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-10[46762]: 2024-08-31T04:40:39.956+0000 7f873f3e9640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-08-31T04:39:32.936397+0000 front 2024-08-31T04:39:32.936196+0000 (oldest deadline 2024-08-31T04:39:55.836336+0000) 2024-08-31T04:40:40.293 INFO:journalctl@ceph.osd.10.smithi133.stdout:Aug 31 04:40:39 smithi133 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-10[46762]: 2024-08-31T04:40:39.956+0000 7f873f3e9640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.133:6804 osd.1 since back 2024-08-31T04:39:40.537248+0000 front 2024-08-31T04:39:40.537370+0000 (oldest deadline 2024-08-31T04:40:06.437470+0000) 2024-08-31T04:40:40.293 INFO:journalctl@ceph.osd.10.smithi133.stdout:Aug 31 04:40:39 smithi133 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-10[46762]: 2024-08-31T04:40:39.956+0000 7f873f3e9640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-08-31T04:39:50.438807+0000 front 2024-08-31T04:39:50.438655+0000 (oldest deadline 2024-08-31T04:40:11.538621+0000) 2024-08-31T04:40:40.293 INFO:journalctl@ceph.osd.10.smithi133.stdout:Aug 31 04:40:39 smithi133 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-10[46762]: 2024-08-31T04:40:39.956+0000 7f873f3e9640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2024-08-31T04:39:55.639898+0000 front 2024-08-31T04:39:55.639930+0000 (oldest deadline 2024-08-31T04:40:20.939655+0000) 2024-08-31T04:40:40.293 INFO:journalctl@ceph.osd.10.smithi133.stdout:Aug 31 04:40:39 smithi133 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-10[46762]: 2024-08-31T04:40:39.956+0000 7f873f3e9640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.133:6812 osd.4 since back 2024-08-31T04:40:05.040435+0000 front 2024-08-31T04:40:05.040466+0000 (oldest deadline 2024-08-31T04:40:28.540479+0000) 2024-08-31T04:40:40.294 INFO:journalctl@ceph.osd.10.smithi133.stdout:Aug 31 04:40:39 smithi133 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-10[46762]: 2024-08-31T04:40:39.956+0000 7f873f3e9640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.177:6812 osd.5 since back 2024-08-31T04:40:12.041463+0000 front 2024-08-31T04:40:12.041501+0000 (oldest deadline 2024-08-31T04:40:37.941448+0000) 2024-08-31T04:40:40.693 INFO:journalctl@ceph.osd.8.smithi177.stdout:Aug 31 04:40:40 smithi177 podman[58902]: 2024-08-31 04:40:40.283946755 +0000 UTC m=+0.519908978 container remove 79a110aa309ed95955b2a3d1fc235b0c880b396e172e570ba0a98c9bbc269944 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-8, ceph=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.1, org.label-schema.vendor=CentOS, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-08-31T04:40:40.950 INFO:journalctl@ceph.osd.9.smithi050.stdout:Aug 31 04:40:40 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-9[52806]: 2024-08-31T04:40:40.475+0000 7f30c0800640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-08-31T04:39:33.661151+0000 front 2024-08-31T04:39:33.661082+0000 (oldest deadline 2024-08-31T04:39:55.361248+0000) 2024-08-31T04:40:40.950 INFO:journalctl@ceph.osd.9.smithi050.stdout:Aug 31 04:40:40 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-9[52806]: 2024-08-31T04:40:40.475+0000 7f30c0800640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.133:6804 osd.1 since back 2024-08-31T04:39:41.262725+0000 front 2024-08-31T04:39:41.262699+0000 (oldest deadline 2024-08-31T04:40:05.362593+0000) 2024-08-31T04:40:40.950 INFO:journalctl@ceph.osd.9.smithi050.stdout:Aug 31 04:40:40 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-9[52806]: 2024-08-31T04:40:40.475+0000 7f30c0800640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-08-31T04:39:50.664217+0000 front 2024-08-31T04:39:50.663973+0000 (oldest deadline 2024-08-31T04:40:14.163759+0000) 2024-08-31T04:40:40.950 INFO:journalctl@ceph.osd.9.smithi050.stdout:Aug 31 04:40:40 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-9[52806]: 2024-08-31T04:40:40.475+0000 7f30c0800640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2024-08-31T04:39:55.765151+0000 front 2024-08-31T04:39:55.765209+0000 (oldest deadline 2024-08-31T04:40:19.865200+0000) 2024-08-31T04:40:40.951 INFO:journalctl@ceph.osd.9.smithi050.stdout:Aug 31 04:40:40 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-9[52806]: 2024-08-31T04:40:40.475+0000 7f30c0800640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.177:6812 osd.5 since back 2024-08-31T04:40:12.667949+0000 front 2024-08-31T04:40:12.667982+0000 (oldest deadline 2024-08-31T04:40:35.567668+0000) 2024-08-31T04:40:40.996 INFO:journalctl@ceph.osd.8.smithi177.stdout:Aug 31 04:40:40 smithi177 podman[58991]: 2024-08-31 04:40:40.693165599 +0000 UTC m=+0.110759335 container create 80abd88667ee66029553ad90e1b470a42fa5b3b17094737c92d1e920803f1e47 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-8-deactivate, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.license=GPLv2, ceph=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, io.buildah.version=1.37.1, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731) 2024-08-31T04:40:40.996 INFO:journalctl@ceph.osd.8.smithi177.stdout:Aug 31 04:40:40 smithi177 podman[58991]: 2024-08-31 04:40:40.598124593 +0000 UTC m=+0.015718338 image pull 79f4cde5e36911a5dca995eeb98098c2c8aae81dd52a088ef2c867bc3363bad0 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61 2024-08-31T04:40:40.996 INFO:journalctl@ceph.osd.8.smithi177.stdout:Aug 31 04:40:40 smithi177 podman[58991]: 2024-08-31 04:40:40.895815596 +0000 UTC m=+0.313409337 container init 80abd88667ee66029553ad90e1b470a42fa5b3b17094737c92d1e920803f1e47 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-8-deactivate, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_CLEAN=True, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, io.buildah.version=1.37.1, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2) 2024-08-31T04:40:40.996 INFO:journalctl@ceph.osd.8.smithi177.stdout:Aug 31 04:40:40 smithi177 podman[58991]: 2024-08-31 04:40:40.899004789 +0000 UTC m=+0.316598532 container start 80abd88667ee66029553ad90e1b470a42fa5b3b17094737c92d1e920803f1e47 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-8-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.1, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS) 2024-08-31T04:40:41.293 INFO:journalctl@ceph.osd.10.smithi133.stdout:Aug 31 04:40:40 smithi133 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-10[46762]: 2024-08-31T04:40:40.983+0000 7f873f3e9640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-08-31T04:39:32.936397+0000 front 2024-08-31T04:39:32.936196+0000 (oldest deadline 2024-08-31T04:39:55.836336+0000) 2024-08-31T04:40:41.293 INFO:journalctl@ceph.osd.10.smithi133.stdout:Aug 31 04:40:40 smithi133 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-10[46762]: 2024-08-31T04:40:40.983+0000 7f873f3e9640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.133:6804 osd.1 since back 2024-08-31T04:39:40.537248+0000 front 2024-08-31T04:39:40.537370+0000 (oldest deadline 2024-08-31T04:40:06.437470+0000) 2024-08-31T04:40:41.293 INFO:journalctl@ceph.osd.10.smithi133.stdout:Aug 31 04:40:40 smithi133 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-10[46762]: 2024-08-31T04:40:40.983+0000 7f873f3e9640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-08-31T04:39:50.438807+0000 front 2024-08-31T04:39:50.438655+0000 (oldest deadline 2024-08-31T04:40:11.538621+0000) 2024-08-31T04:40:41.293 INFO:journalctl@ceph.osd.10.smithi133.stdout:Aug 31 04:40:40 smithi133 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-10[46762]: 2024-08-31T04:40:40.983+0000 7f873f3e9640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2024-08-31T04:39:55.639898+0000 front 2024-08-31T04:39:55.639930+0000 (oldest deadline 2024-08-31T04:40:20.939655+0000) 2024-08-31T04:40:41.293 INFO:journalctl@ceph.osd.10.smithi133.stdout:Aug 31 04:40:40 smithi133 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-10[46762]: 2024-08-31T04:40:40.983+0000 7f873f3e9640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.133:6812 osd.4 since back 2024-08-31T04:40:05.040435+0000 front 2024-08-31T04:40:05.040466+0000 (oldest deadline 2024-08-31T04:40:28.540479+0000) 2024-08-31T04:40:41.293 INFO:journalctl@ceph.osd.10.smithi133.stdout:Aug 31 04:40:40 smithi133 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-10[46762]: 2024-08-31T04:40:40.983+0000 7f873f3e9640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.177:6812 osd.5 since back 2024-08-31T04:40:12.041463+0000 front 2024-08-31T04:40:12.041501+0000 (oldest deadline 2024-08-31T04:40:37.941448+0000) 2024-08-31T04:40:41.358 INFO:journalctl@ceph.osd.8.smithi177.stdout:Aug 31 04:40:41 smithi177 podman[58991]: 2024-08-31 04:40:41.037533262 +0000 UTC m=+0.455127013 container attach 80abd88667ee66029553ad90e1b470a42fa5b3b17094737c92d1e920803f1e47 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-8-deactivate, ceph=True, maintainer=Guillaume Abrioux , RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, io.buildah.version=1.37.1, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_CLEAN=True, CEPH_POINT_RELEASE=) 2024-08-31T04:40:41.358 INFO:journalctl@ceph.osd.8.smithi177.stdout:Aug 31 04:40:41 smithi177 podman[58991]: 2024-08-31 04:40:41.084576639 +0000 UTC m=+0.502170377 container died 80abd88667ee66029553ad90e1b470a42fa5b3b17094737c92d1e920803f1e47 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-8-deactivate, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, io.buildah.version=1.37.1, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD) 2024-08-31T04:40:41.358 INFO:journalctl@ceph.osd.11.smithi177.stdout:Aug 31 04:40:41 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-11[46864]: 2024-08-31T04:40:41.188+0000 7fd602bf1640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-08-31T04:39:30.036711+0000 front 2024-08-31T04:39:30.036747+0000 (oldest deadline 2024-08-31T04:39:55.936674+0000) 2024-08-31T04:40:41.359 INFO:journalctl@ceph.osd.11.smithi177.stdout:Aug 31 04:40:41 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-11[46864]: 2024-08-31T04:40:41.188+0000 7fd602bf1640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.133:6804 osd.1 since back 2024-08-31T04:39:41.138475+0000 front 2024-08-31T04:39:41.138491+0000 (oldest deadline 2024-08-31T04:40:04.038356+0000) 2024-08-31T04:40:41.359 INFO:journalctl@ceph.osd.11.smithi177.stdout:Aug 31 04:40:41 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-11[46864]: 2024-08-31T04:40:41.188+0000 7fd602bf1640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-08-31T04:39:46.939525+0000 front 2024-08-31T04:39:46.939251+0000 (oldest deadline 2024-08-31T04:40:12.239391+0000) 2024-08-31T04:40:41.359 INFO:journalctl@ceph.osd.11.smithi177.stdout:Aug 31 04:40:41 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-11[46864]: 2024-08-31T04:40:41.189+0000 7fd602bf1640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.133:6812 osd.4 since back 2024-08-31T04:40:05.141613+0000 front 2024-08-31T04:40:05.141382+0000 (oldest deadline 2024-08-31T04:40:32.741898+0000) 2024-08-31T04:40:41.359 INFO:journalctl@ceph.osd.11.smithi177.stdout:Aug 31 04:40:41 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-11[46864]: 2024-08-31T04:40:41.189+0000 7fd602bf1640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.177:6812 osd.5 since back 2024-08-31T04:40:12.742231+0000 front 2024-08-31T04:40:12.742332+0000 (oldest deadline 2024-08-31T04:40:36.842325+0000) 2024-08-31T04:40:41.706 DEBUG:teuthology.orchestra.run.smithi177:> sudo pkill -f 'journalctl -f -n 0 -u ceph-058d9fc6-674f-11ef-bcd4-c7b262605968@osd.8.service' 2024-08-31T04:40:41.746 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-31T04:40:41.746 INFO:tasks.cephadm.osd.8:Stopped osd.8 2024-08-31T04:40:41.746 INFO:tasks.cephadm.osd.9:Stopping osd.9... 2024-08-31T04:40:41.747 DEBUG:teuthology.orchestra.run.smithi050:> sudo systemctl stop ceph-058d9fc6-674f-11ef-bcd4-c7b262605968@osd.9 2024-08-31T04:40:41.803 INFO:journalctl@ceph.osd.9.smithi050.stdout:Aug 31 04:40:41 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-9[52806]: 2024-08-31T04:40:41.516+0000 7f30c0800640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-08-31T04:39:33.661151+0000 front 2024-08-31T04:39:33.661082+0000 (oldest deadline 2024-08-31T04:39:55.361248+0000) 2024-08-31T04:40:41.803 INFO:journalctl@ceph.osd.9.smithi050.stdout:Aug 31 04:40:41 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-9[52806]: 2024-08-31T04:40:41.516+0000 7f30c0800640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.133:6804 osd.1 since back 2024-08-31T04:39:41.262725+0000 front 2024-08-31T04:39:41.262699+0000 (oldest deadline 2024-08-31T04:40:05.362593+0000) 2024-08-31T04:40:41.803 INFO:journalctl@ceph.osd.9.smithi050.stdout:Aug 31 04:40:41 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-9[52806]: 2024-08-31T04:40:41.516+0000 7f30c0800640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-08-31T04:39:50.664217+0000 front 2024-08-31T04:39:50.663973+0000 (oldest deadline 2024-08-31T04:40:14.163759+0000) 2024-08-31T04:40:41.803 INFO:journalctl@ceph.osd.9.smithi050.stdout:Aug 31 04:40:41 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-9[52806]: 2024-08-31T04:40:41.516+0000 7f30c0800640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2024-08-31T04:39:55.765151+0000 front 2024-08-31T04:39:55.765209+0000 (oldest deadline 2024-08-31T04:40:19.865200+0000) 2024-08-31T04:40:41.803 INFO:journalctl@ceph.osd.9.smithi050.stdout:Aug 31 04:40:41 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-9[52806]: 2024-08-31T04:40:41.516+0000 7f30c0800640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.177:6812 osd.5 since back 2024-08-31T04:40:12.667949+0000 front 2024-08-31T04:40:12.667982+0000 (oldest deadline 2024-08-31T04:40:35.567668+0000) 2024-08-31T04:40:42.162 INFO:journalctl@ceph.osd.9.smithi050.stdout:Aug 31 04:40:41 smithi050 systemd[1]: Stopping Ceph osd.9 for 058d9fc6-674f-11ef-bcd4-c7b262605968... 2024-08-31T04:40:42.293 INFO:journalctl@ceph.osd.10.smithi133.stdout:Aug 31 04:40:42 smithi133 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-10[46762]: 2024-08-31T04:40:42.033+0000 7f873f3e9640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-08-31T04:39:32.936397+0000 front 2024-08-31T04:39:32.936196+0000 (oldest deadline 2024-08-31T04:39:55.836336+0000) 2024-08-31T04:40:42.293 INFO:journalctl@ceph.osd.10.smithi133.stdout:Aug 31 04:40:42 smithi133 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-10[46762]: 2024-08-31T04:40:42.033+0000 7f873f3e9640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.133:6804 osd.1 since back 2024-08-31T04:39:40.537248+0000 front 2024-08-31T04:39:40.537370+0000 (oldest deadline 2024-08-31T04:40:06.437470+0000) 2024-08-31T04:40:42.293 INFO:journalctl@ceph.osd.10.smithi133.stdout:Aug 31 04:40:42 smithi133 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-10[46762]: 2024-08-31T04:40:42.033+0000 7f873f3e9640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-08-31T04:39:50.438807+0000 front 2024-08-31T04:39:50.438655+0000 (oldest deadline 2024-08-31T04:40:11.538621+0000) 2024-08-31T04:40:42.293 INFO:journalctl@ceph.osd.10.smithi133.stdout:Aug 31 04:40:42 smithi133 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-10[46762]: 2024-08-31T04:40:42.033+0000 7f873f3e9640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2024-08-31T04:39:55.639898+0000 front 2024-08-31T04:39:55.639930+0000 (oldest deadline 2024-08-31T04:40:20.939655+0000) 2024-08-31T04:40:42.294 INFO:journalctl@ceph.osd.10.smithi133.stdout:Aug 31 04:40:42 smithi133 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-10[46762]: 2024-08-31T04:40:42.033+0000 7f873f3e9640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.133:6812 osd.4 since back 2024-08-31T04:40:05.040435+0000 front 2024-08-31T04:40:05.040466+0000 (oldest deadline 2024-08-31T04:40:28.540479+0000) 2024-08-31T04:40:42.294 INFO:journalctl@ceph.osd.10.smithi133.stdout:Aug 31 04:40:42 smithi133 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-10[46762]: 2024-08-31T04:40:42.033+0000 7f873f3e9640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.177:6812 osd.5 since back 2024-08-31T04:40:12.041463+0000 front 2024-08-31T04:40:12.041501+0000 (oldest deadline 2024-08-31T04:40:37.941448+0000) 2024-08-31T04:40:42.450 INFO:journalctl@ceph.osd.9.smithi050.stdout:Aug 31 04:40:42 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-9[52806]: 2024-08-31T04:40:42.159+0000 7f30c9e00640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.9 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-31T04:40:42.450 INFO:journalctl@ceph.osd.9.smithi050.stdout:Aug 31 04:40:42 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-9[52806]: 2024-08-31T04:40:42.159+0000 7f30c9e00640 -1 osd.9 83 *** Got signal Terminated *** 2024-08-31T04:40:42.450 INFO:journalctl@ceph.osd.9.smithi050.stdout:Aug 31 04:40:42 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-9[52806]: 2024-08-31T04:40:42.159+0000 7f30c9e00640 -1 osd.9 83 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-08-31T04:40:42.496 INFO:journalctl@ceph.osd.11.smithi177.stdout:Aug 31 04:40:42 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-11[46864]: 2024-08-31T04:40:42.154+0000 7fd602bf1640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-08-31T04:39:30.036711+0000 front 2024-08-31T04:39:30.036747+0000 (oldest deadline 2024-08-31T04:39:55.936674+0000) 2024-08-31T04:40:42.496 INFO:journalctl@ceph.osd.11.smithi177.stdout:Aug 31 04:40:42 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-11[46864]: 2024-08-31T04:40:42.154+0000 7fd602bf1640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.133:6804 osd.1 since back 2024-08-31T04:39:41.138475+0000 front 2024-08-31T04:39:41.138491+0000 (oldest deadline 2024-08-31T04:40:04.038356+0000) 2024-08-31T04:40:42.496 INFO:journalctl@ceph.osd.11.smithi177.stdout:Aug 31 04:40:42 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-11[46864]: 2024-08-31T04:40:42.154+0000 7fd602bf1640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-08-31T04:39:46.939525+0000 front 2024-08-31T04:39:46.939251+0000 (oldest deadline 2024-08-31T04:40:12.239391+0000) 2024-08-31T04:40:42.496 INFO:journalctl@ceph.osd.11.smithi177.stdout:Aug 31 04:40:42 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-11[46864]: 2024-08-31T04:40:42.154+0000 7fd602bf1640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.133:6812 osd.4 since back 2024-08-31T04:40:05.141613+0000 front 2024-08-31T04:40:05.141382+0000 (oldest deadline 2024-08-31T04:40:32.741898+0000) 2024-08-31T04:40:42.496 INFO:journalctl@ceph.osd.11.smithi177.stdout:Aug 31 04:40:42 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-11[46864]: 2024-08-31T04:40:42.154+0000 7fd602bf1640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.177:6812 osd.5 since back 2024-08-31T04:40:12.742231+0000 front 2024-08-31T04:40:12.742332+0000 (oldest deadline 2024-08-31T04:40:36.842325+0000) 2024-08-31T04:40:42.950 INFO:journalctl@ceph.osd.9.smithi050.stdout:Aug 31 04:40:42 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-9[52806]: 2024-08-31T04:40:42.538+0000 7f30c0800640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-08-31T04:39:33.661151+0000 front 2024-08-31T04:39:33.661082+0000 (oldest deadline 2024-08-31T04:39:55.361248+0000) 2024-08-31T04:40:42.950 INFO:journalctl@ceph.osd.9.smithi050.stdout:Aug 31 04:40:42 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-9[52806]: 2024-08-31T04:40:42.538+0000 7f30c0800640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.133:6804 osd.1 since back 2024-08-31T04:39:41.262725+0000 front 2024-08-31T04:39:41.262699+0000 (oldest deadline 2024-08-31T04:40:05.362593+0000) 2024-08-31T04:40:42.950 INFO:journalctl@ceph.osd.9.smithi050.stdout:Aug 31 04:40:42 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-9[52806]: 2024-08-31T04:40:42.538+0000 7f30c0800640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-08-31T04:39:50.664217+0000 front 2024-08-31T04:39:50.663973+0000 (oldest deadline 2024-08-31T04:40:14.163759+0000) 2024-08-31T04:40:42.950 INFO:journalctl@ceph.osd.9.smithi050.stdout:Aug 31 04:40:42 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-9[52806]: 2024-08-31T04:40:42.538+0000 7f30c0800640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2024-08-31T04:39:55.765151+0000 front 2024-08-31T04:39:55.765209+0000 (oldest deadline 2024-08-31T04:40:19.865200+0000) 2024-08-31T04:40:42.950 INFO:journalctl@ceph.osd.9.smithi050.stdout:Aug 31 04:40:42 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-9[52806]: 2024-08-31T04:40:42.538+0000 7f30c0800640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.177:6812 osd.5 since back 2024-08-31T04:40:12.667949+0000 front 2024-08-31T04:40:12.667982+0000 (oldest deadline 2024-08-31T04:40:35.567668+0000) 2024-08-31T04:40:43.496 INFO:journalctl@ceph.osd.11.smithi177.stdout:Aug 31 04:40:43 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-11[46864]: 2024-08-31T04:40:43.111+0000 7fd602bf1640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-08-31T04:39:30.036711+0000 front 2024-08-31T04:39:30.036747+0000 (oldest deadline 2024-08-31T04:39:55.936674+0000) 2024-08-31T04:40:43.496 INFO:journalctl@ceph.osd.11.smithi177.stdout:Aug 31 04:40:43 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-11[46864]: 2024-08-31T04:40:43.111+0000 7fd602bf1640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.133:6804 osd.1 since back 2024-08-31T04:39:41.138475+0000 front 2024-08-31T04:39:41.138491+0000 (oldest deadline 2024-08-31T04:40:04.038356+0000) 2024-08-31T04:40:43.496 INFO:journalctl@ceph.osd.11.smithi177.stdout:Aug 31 04:40:43 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-11[46864]: 2024-08-31T04:40:43.111+0000 7fd602bf1640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-08-31T04:39:46.939525+0000 front 2024-08-31T04:39:46.939251+0000 (oldest deadline 2024-08-31T04:40:12.239391+0000) 2024-08-31T04:40:43.496 INFO:journalctl@ceph.osd.11.smithi177.stdout:Aug 31 04:40:43 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-11[46864]: 2024-08-31T04:40:43.111+0000 7fd602bf1640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.133:6812 osd.4 since back 2024-08-31T04:40:05.141613+0000 front 2024-08-31T04:40:05.141382+0000 (oldest deadline 2024-08-31T04:40:32.741898+0000) 2024-08-31T04:40:43.496 INFO:journalctl@ceph.osd.11.smithi177.stdout:Aug 31 04:40:43 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-11[46864]: 2024-08-31T04:40:43.111+0000 7fd602bf1640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.177:6812 osd.5 since back 2024-08-31T04:40:12.742231+0000 front 2024-08-31T04:40:12.742332+0000 (oldest deadline 2024-08-31T04:40:36.842325+0000) 2024-08-31T04:40:43.543 INFO:journalctl@ceph.osd.10.smithi133.stdout:Aug 31 04:40:43 smithi133 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-10[46762]: 2024-08-31T04:40:43.066+0000 7f873f3e9640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-08-31T04:39:32.936397+0000 front 2024-08-31T04:39:32.936196+0000 (oldest deadline 2024-08-31T04:39:55.836336+0000) 2024-08-31T04:40:43.543 INFO:journalctl@ceph.osd.10.smithi133.stdout:Aug 31 04:40:43 smithi133 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-10[46762]: 2024-08-31T04:40:43.066+0000 7f873f3e9640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.133:6804 osd.1 since back 2024-08-31T04:39:40.537248+0000 front 2024-08-31T04:39:40.537370+0000 (oldest deadline 2024-08-31T04:40:06.437470+0000) 2024-08-31T04:40:43.543 INFO:journalctl@ceph.osd.10.smithi133.stdout:Aug 31 04:40:43 smithi133 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-10[46762]: 2024-08-31T04:40:43.066+0000 7f873f3e9640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-08-31T04:39:50.438807+0000 front 2024-08-31T04:39:50.438655+0000 (oldest deadline 2024-08-31T04:40:11.538621+0000) 2024-08-31T04:40:43.543 INFO:journalctl@ceph.osd.10.smithi133.stdout:Aug 31 04:40:43 smithi133 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-10[46762]: 2024-08-31T04:40:43.066+0000 7f873f3e9640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2024-08-31T04:39:55.639898+0000 front 2024-08-31T04:39:55.639930+0000 (oldest deadline 2024-08-31T04:40:20.939655+0000) 2024-08-31T04:40:43.543 INFO:journalctl@ceph.osd.10.smithi133.stdout:Aug 31 04:40:43 smithi133 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-10[46762]: 2024-08-31T04:40:43.066+0000 7f873f3e9640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.133:6812 osd.4 since back 2024-08-31T04:40:05.040435+0000 front 2024-08-31T04:40:05.040466+0000 (oldest deadline 2024-08-31T04:40:28.540479+0000) 2024-08-31T04:40:43.543 INFO:journalctl@ceph.osd.10.smithi133.stdout:Aug 31 04:40:43 smithi133 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-10[46762]: 2024-08-31T04:40:43.066+0000 7f873f3e9640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.177:6812 osd.5 since back 2024-08-31T04:40:12.041463+0000 front 2024-08-31T04:40:12.041501+0000 (oldest deadline 2024-08-31T04:40:37.941448+0000) 2024-08-31T04:40:43.950 INFO:journalctl@ceph.osd.9.smithi050.stdout:Aug 31 04:40:43 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-9[52806]: 2024-08-31T04:40:43.545+0000 7f30c0800640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-08-31T04:39:33.661151+0000 front 2024-08-31T04:39:33.661082+0000 (oldest deadline 2024-08-31T04:39:55.361248+0000) 2024-08-31T04:40:43.950 INFO:journalctl@ceph.osd.9.smithi050.stdout:Aug 31 04:40:43 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-9[52806]: 2024-08-31T04:40:43.545+0000 7f30c0800640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.133:6804 osd.1 since back 2024-08-31T04:39:41.262725+0000 front 2024-08-31T04:39:41.262699+0000 (oldest deadline 2024-08-31T04:40:05.362593+0000) 2024-08-31T04:40:43.950 INFO:journalctl@ceph.osd.9.smithi050.stdout:Aug 31 04:40:43 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-9[52806]: 2024-08-31T04:40:43.545+0000 7f30c0800640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-08-31T04:39:50.664217+0000 front 2024-08-31T04:39:50.663973+0000 (oldest deadline 2024-08-31T04:40:14.163759+0000) 2024-08-31T04:40:43.950 INFO:journalctl@ceph.osd.9.smithi050.stdout:Aug 31 04:40:43 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-9[52806]: 2024-08-31T04:40:43.545+0000 7f30c0800640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2024-08-31T04:39:55.765151+0000 front 2024-08-31T04:39:55.765209+0000 (oldest deadline 2024-08-31T04:40:19.865200+0000) 2024-08-31T04:40:43.950 INFO:journalctl@ceph.osd.9.smithi050.stdout:Aug 31 04:40:43 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-9[52806]: 2024-08-31T04:40:43.545+0000 7f30c0800640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.177:6812 osd.5 since back 2024-08-31T04:40:12.667949+0000 front 2024-08-31T04:40:12.667982+0000 (oldest deadline 2024-08-31T04:40:35.567668+0000) 2024-08-31T04:40:44.496 INFO:journalctl@ceph.osd.11.smithi177.stdout:Aug 31 04:40:44 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-11[46864]: 2024-08-31T04:40:44.158+0000 7fd602bf1640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-08-31T04:39:30.036711+0000 front 2024-08-31T04:39:30.036747+0000 (oldest deadline 2024-08-31T04:39:55.936674+0000) 2024-08-31T04:40:44.496 INFO:journalctl@ceph.osd.11.smithi177.stdout:Aug 31 04:40:44 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-11[46864]: 2024-08-31T04:40:44.158+0000 7fd602bf1640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.133:6804 osd.1 since back 2024-08-31T04:39:41.138475+0000 front 2024-08-31T04:39:41.138491+0000 (oldest deadline 2024-08-31T04:40:04.038356+0000) 2024-08-31T04:40:44.497 INFO:journalctl@ceph.osd.11.smithi177.stdout:Aug 31 04:40:44 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-11[46864]: 2024-08-31T04:40:44.158+0000 7fd602bf1640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-08-31T04:39:46.939525+0000 front 2024-08-31T04:39:46.939251+0000 (oldest deadline 2024-08-31T04:40:12.239391+0000) 2024-08-31T04:40:44.497 INFO:journalctl@ceph.osd.11.smithi177.stdout:Aug 31 04:40:44 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-11[46864]: 2024-08-31T04:40:44.158+0000 7fd602bf1640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.133:6812 osd.4 since back 2024-08-31T04:40:05.141613+0000 front 2024-08-31T04:40:05.141382+0000 (oldest deadline 2024-08-31T04:40:32.741898+0000) 2024-08-31T04:40:44.497 INFO:journalctl@ceph.osd.11.smithi177.stdout:Aug 31 04:40:44 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-11[46864]: 2024-08-31T04:40:44.158+0000 7fd602bf1640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.177:6812 osd.5 since back 2024-08-31T04:40:12.742231+0000 front 2024-08-31T04:40:12.742332+0000 (oldest deadline 2024-08-31T04:40:36.842325+0000) 2024-08-31T04:40:44.497 INFO:journalctl@ceph.osd.11.smithi177.stdout:Aug 31 04:40:44 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-11[46864]: 2024-08-31T04:40:44.158+0000 7fd602bf1640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.50:6822 osd.6 since back 2024-08-31T04:40:19.743250+0000 front 2024-08-31T04:40:19.743271+0000 (oldest deadline 2024-08-31T04:40:43.843231+0000) 2024-08-31T04:40:44.543 INFO:journalctl@ceph.osd.10.smithi133.stdout:Aug 31 04:40:44 smithi133 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-10[46762]: 2024-08-31T04:40:44.083+0000 7f873f3e9640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-08-31T04:39:32.936397+0000 front 2024-08-31T04:39:32.936196+0000 (oldest deadline 2024-08-31T04:39:55.836336+0000) 2024-08-31T04:40:44.543 INFO:journalctl@ceph.osd.10.smithi133.stdout:Aug 31 04:40:44 smithi133 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-10[46762]: 2024-08-31T04:40:44.083+0000 7f873f3e9640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.133:6804 osd.1 since back 2024-08-31T04:39:40.537248+0000 front 2024-08-31T04:39:40.537370+0000 (oldest deadline 2024-08-31T04:40:06.437470+0000) 2024-08-31T04:40:44.543 INFO:journalctl@ceph.osd.10.smithi133.stdout:Aug 31 04:40:44 smithi133 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-10[46762]: 2024-08-31T04:40:44.083+0000 7f873f3e9640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-08-31T04:39:50.438807+0000 front 2024-08-31T04:39:50.438655+0000 (oldest deadline 2024-08-31T04:40:11.538621+0000) 2024-08-31T04:40:44.543 INFO:journalctl@ceph.osd.10.smithi133.stdout:Aug 31 04:40:44 smithi133 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-10[46762]: 2024-08-31T04:40:44.083+0000 7f873f3e9640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2024-08-31T04:39:55.639898+0000 front 2024-08-31T04:39:55.639930+0000 (oldest deadline 2024-08-31T04:40:20.939655+0000) 2024-08-31T04:40:44.543 INFO:journalctl@ceph.osd.10.smithi133.stdout:Aug 31 04:40:44 smithi133 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-10[46762]: 2024-08-31T04:40:44.083+0000 7f873f3e9640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.133:6812 osd.4 since back 2024-08-31T04:40:05.040435+0000 front 2024-08-31T04:40:05.040466+0000 (oldest deadline 2024-08-31T04:40:28.540479+0000) 2024-08-31T04:40:44.543 INFO:journalctl@ceph.osd.10.smithi133.stdout:Aug 31 04:40:44 smithi133 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-10[46762]: 2024-08-31T04:40:44.083+0000 7f873f3e9640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.177:6812 osd.5 since back 2024-08-31T04:40:12.041463+0000 front 2024-08-31T04:40:12.041501+0000 (oldest deadline 2024-08-31T04:40:37.941448+0000) 2024-08-31T04:40:44.543 INFO:journalctl@ceph.osd.10.smithi133.stdout:Aug 31 04:40:44 smithi133 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-10[46762]: 2024-08-31T04:40:44.083+0000 7f873f3e9640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.50:6822 osd.6 since back 2024-08-31T04:40:20.842699+0000 front 2024-08-31T04:40:20.842593+0000 (oldest deadline 2024-08-31T04:40:43.742552+0000) 2024-08-31T04:40:44.950 INFO:journalctl@ceph.osd.9.smithi050.stdout:Aug 31 04:40:44 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-9[52806]: 2024-08-31T04:40:44.530+0000 7f30c0800640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-08-31T04:39:33.661151+0000 front 2024-08-31T04:39:33.661082+0000 (oldest deadline 2024-08-31T04:39:55.361248+0000) 2024-08-31T04:40:44.950 INFO:journalctl@ceph.osd.9.smithi050.stdout:Aug 31 04:40:44 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-9[52806]: 2024-08-31T04:40:44.530+0000 7f30c0800640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.133:6804 osd.1 since back 2024-08-31T04:39:41.262725+0000 front 2024-08-31T04:39:41.262699+0000 (oldest deadline 2024-08-31T04:40:05.362593+0000) 2024-08-31T04:40:44.950 INFO:journalctl@ceph.osd.9.smithi050.stdout:Aug 31 04:40:44 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-9[52806]: 2024-08-31T04:40:44.530+0000 7f30c0800640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-08-31T04:39:50.664217+0000 front 2024-08-31T04:39:50.663973+0000 (oldest deadline 2024-08-31T04:40:14.163759+0000) 2024-08-31T04:40:44.950 INFO:journalctl@ceph.osd.9.smithi050.stdout:Aug 31 04:40:44 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-9[52806]: 2024-08-31T04:40:44.530+0000 7f30c0800640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2024-08-31T04:39:55.765151+0000 front 2024-08-31T04:39:55.765209+0000 (oldest deadline 2024-08-31T04:40:19.865200+0000) 2024-08-31T04:40:44.950 INFO:journalctl@ceph.osd.9.smithi050.stdout:Aug 31 04:40:44 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-9[52806]: 2024-08-31T04:40:44.530+0000 7f30c0800640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.177:6812 osd.5 since back 2024-08-31T04:40:12.667949+0000 front 2024-08-31T04:40:12.667982+0000 (oldest deadline 2024-08-31T04:40:35.567668+0000) 2024-08-31T04:40:44.951 INFO:journalctl@ceph.osd.9.smithi050.stdout:Aug 31 04:40:44 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-9[52806]: 2024-08-31T04:40:44.530+0000 7f30c0800640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.50:6822 osd.6 since back 2024-08-31T04:40:21.270015+0000 front 2024-08-31T04:40:21.270075+0000 (oldest deadline 2024-08-31T04:40:44.170066+0000) 2024-08-31T04:40:45.293 INFO:journalctl@ceph.osd.10.smithi133.stdout:Aug 31 04:40:45 smithi133 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-10[46762]: 2024-08-31T04:40:45.038+0000 7f873f3e9640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-08-31T04:39:32.936397+0000 front 2024-08-31T04:39:32.936196+0000 (oldest deadline 2024-08-31T04:39:55.836336+0000) 2024-08-31T04:40:45.293 INFO:journalctl@ceph.osd.10.smithi133.stdout:Aug 31 04:40:45 smithi133 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-10[46762]: 2024-08-31T04:40:45.038+0000 7f873f3e9640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.133:6804 osd.1 since back 2024-08-31T04:39:40.537248+0000 front 2024-08-31T04:39:40.537370+0000 (oldest deadline 2024-08-31T04:40:06.437470+0000) 2024-08-31T04:40:45.293 INFO:journalctl@ceph.osd.10.smithi133.stdout:Aug 31 04:40:45 smithi133 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-10[46762]: 2024-08-31T04:40:45.038+0000 7f873f3e9640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-08-31T04:39:50.438807+0000 front 2024-08-31T04:39:50.438655+0000 (oldest deadline 2024-08-31T04:40:11.538621+0000) 2024-08-31T04:40:45.294 INFO:journalctl@ceph.osd.10.smithi133.stdout:Aug 31 04:40:45 smithi133 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-10[46762]: 2024-08-31T04:40:45.038+0000 7f873f3e9640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2024-08-31T04:39:55.639898+0000 front 2024-08-31T04:39:55.639930+0000 (oldest deadline 2024-08-31T04:40:20.939655+0000) 2024-08-31T04:40:45.294 INFO:journalctl@ceph.osd.10.smithi133.stdout:Aug 31 04:40:45 smithi133 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-10[46762]: 2024-08-31T04:40:45.038+0000 7f873f3e9640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.133:6812 osd.4 since back 2024-08-31T04:40:05.040435+0000 front 2024-08-31T04:40:05.040466+0000 (oldest deadline 2024-08-31T04:40:28.540479+0000) 2024-08-31T04:40:45.294 INFO:journalctl@ceph.osd.10.smithi133.stdout:Aug 31 04:40:45 smithi133 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-10[46762]: 2024-08-31T04:40:45.038+0000 7f873f3e9640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.177:6812 osd.5 since back 2024-08-31T04:40:12.041463+0000 front 2024-08-31T04:40:12.041501+0000 (oldest deadline 2024-08-31T04:40:37.941448+0000) 2024-08-31T04:40:45.294 INFO:journalctl@ceph.osd.10.smithi133.stdout:Aug 31 04:40:45 smithi133 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-10[46762]: 2024-08-31T04:40:45.038+0000 7f873f3e9640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.50:6822 osd.6 since back 2024-08-31T04:40:20.842699+0000 front 2024-08-31T04:40:20.842593+0000 (oldest deadline 2024-08-31T04:40:43.742552+0000) 2024-08-31T04:40:45.496 INFO:journalctl@ceph.osd.11.smithi177.stdout:Aug 31 04:40:45 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-11[46864]: 2024-08-31T04:40:45.173+0000 7fd602bf1640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-08-31T04:39:30.036711+0000 front 2024-08-31T04:39:30.036747+0000 (oldest deadline 2024-08-31T04:39:55.936674+0000) 2024-08-31T04:40:45.496 INFO:journalctl@ceph.osd.11.smithi177.stdout:Aug 31 04:40:45 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-11[46864]: 2024-08-31T04:40:45.173+0000 7fd602bf1640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.133:6804 osd.1 since back 2024-08-31T04:39:41.138475+0000 front 2024-08-31T04:39:41.138491+0000 (oldest deadline 2024-08-31T04:40:04.038356+0000) 2024-08-31T04:40:45.496 INFO:journalctl@ceph.osd.11.smithi177.stdout:Aug 31 04:40:45 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-11[46864]: 2024-08-31T04:40:45.173+0000 7fd602bf1640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-08-31T04:39:46.939525+0000 front 2024-08-31T04:39:46.939251+0000 (oldest deadline 2024-08-31T04:40:12.239391+0000) 2024-08-31T04:40:45.496 INFO:journalctl@ceph.osd.11.smithi177.stdout:Aug 31 04:40:45 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-11[46864]: 2024-08-31T04:40:45.173+0000 7fd602bf1640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.133:6812 osd.4 since back 2024-08-31T04:40:05.141613+0000 front 2024-08-31T04:40:05.141382+0000 (oldest deadline 2024-08-31T04:40:32.741898+0000) 2024-08-31T04:40:45.496 INFO:journalctl@ceph.osd.11.smithi177.stdout:Aug 31 04:40:45 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-11[46864]: 2024-08-31T04:40:45.173+0000 7fd602bf1640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.177:6812 osd.5 since back 2024-08-31T04:40:12.742231+0000 front 2024-08-31T04:40:12.742332+0000 (oldest deadline 2024-08-31T04:40:36.842325+0000) 2024-08-31T04:40:45.496 INFO:journalctl@ceph.osd.11.smithi177.stdout:Aug 31 04:40:45 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-11[46864]: 2024-08-31T04:40:45.173+0000 7fd602bf1640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.50:6822 osd.6 since back 2024-08-31T04:40:19.743250+0000 front 2024-08-31T04:40:19.743271+0000 (oldest deadline 2024-08-31T04:40:43.843231+0000) 2024-08-31T04:40:45.950 INFO:journalctl@ceph.osd.9.smithi050.stdout:Aug 31 04:40:45 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-9[52806]: 2024-08-31T04:40:45.486+0000 7f30c0800640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-08-31T04:39:33.661151+0000 front 2024-08-31T04:39:33.661082+0000 (oldest deadline 2024-08-31T04:39:55.361248+0000) 2024-08-31T04:40:45.950 INFO:journalctl@ceph.osd.9.smithi050.stdout:Aug 31 04:40:45 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-9[52806]: 2024-08-31T04:40:45.486+0000 7f30c0800640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.133:6804 osd.1 since back 2024-08-31T04:39:41.262725+0000 front 2024-08-31T04:39:41.262699+0000 (oldest deadline 2024-08-31T04:40:05.362593+0000) 2024-08-31T04:40:45.950 INFO:journalctl@ceph.osd.9.smithi050.stdout:Aug 31 04:40:45 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-9[52806]: 2024-08-31T04:40:45.486+0000 7f30c0800640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-08-31T04:39:50.664217+0000 front 2024-08-31T04:39:50.663973+0000 (oldest deadline 2024-08-31T04:40:14.163759+0000) 2024-08-31T04:40:45.950 INFO:journalctl@ceph.osd.9.smithi050.stdout:Aug 31 04:40:45 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-9[52806]: 2024-08-31T04:40:45.486+0000 7f30c0800640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2024-08-31T04:39:55.765151+0000 front 2024-08-31T04:39:55.765209+0000 (oldest deadline 2024-08-31T04:40:19.865200+0000) 2024-08-31T04:40:45.950 INFO:journalctl@ceph.osd.9.smithi050.stdout:Aug 31 04:40:45 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-9[52806]: 2024-08-31T04:40:45.486+0000 7f30c0800640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.177:6812 osd.5 since back 2024-08-31T04:40:12.667949+0000 front 2024-08-31T04:40:12.667982+0000 (oldest deadline 2024-08-31T04:40:35.567668+0000) 2024-08-31T04:40:45.950 INFO:journalctl@ceph.osd.9.smithi050.stdout:Aug 31 04:40:45 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-9[52806]: 2024-08-31T04:40:45.486+0000 7f30c0800640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.50:6822 osd.6 since back 2024-08-31T04:40:21.270015+0000 front 2024-08-31T04:40:21.270075+0000 (oldest deadline 2024-08-31T04:40:44.170066+0000) 2024-08-31T04:40:46.496 INFO:journalctl@ceph.osd.11.smithi177.stdout:Aug 31 04:40:46 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-11[46864]: 2024-08-31T04:40:46.124+0000 7fd602bf1640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-08-31T04:39:30.036711+0000 front 2024-08-31T04:39:30.036747+0000 (oldest deadline 2024-08-31T04:39:55.936674+0000) 2024-08-31T04:40:46.496 INFO:journalctl@ceph.osd.11.smithi177.stdout:Aug 31 04:40:46 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-11[46864]: 2024-08-31T04:40:46.124+0000 7fd602bf1640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.133:6804 osd.1 since back 2024-08-31T04:39:41.138475+0000 front 2024-08-31T04:39:41.138491+0000 (oldest deadline 2024-08-31T04:40:04.038356+0000) 2024-08-31T04:40:46.496 INFO:journalctl@ceph.osd.11.smithi177.stdout:Aug 31 04:40:46 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-11[46864]: 2024-08-31T04:40:46.124+0000 7fd602bf1640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-08-31T04:39:46.939525+0000 front 2024-08-31T04:39:46.939251+0000 (oldest deadline 2024-08-31T04:40:12.239391+0000) 2024-08-31T04:40:46.496 INFO:journalctl@ceph.osd.11.smithi177.stdout:Aug 31 04:40:46 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-11[46864]: 2024-08-31T04:40:46.124+0000 7fd602bf1640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.133:6812 osd.4 since back 2024-08-31T04:40:05.141613+0000 front 2024-08-31T04:40:05.141382+0000 (oldest deadline 2024-08-31T04:40:32.741898+0000) 2024-08-31T04:40:46.496 INFO:journalctl@ceph.osd.11.smithi177.stdout:Aug 31 04:40:46 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-11[46864]: 2024-08-31T04:40:46.124+0000 7fd602bf1640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.177:6812 osd.5 since back 2024-08-31T04:40:12.742231+0000 front 2024-08-31T04:40:12.742332+0000 (oldest deadline 2024-08-31T04:40:36.842325+0000) 2024-08-31T04:40:46.496 INFO:journalctl@ceph.osd.11.smithi177.stdout:Aug 31 04:40:46 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-11[46864]: 2024-08-31T04:40:46.124+0000 7fd602bf1640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.50:6822 osd.6 since back 2024-08-31T04:40:19.743250+0000 front 2024-08-31T04:40:19.743271+0000 (oldest deadline 2024-08-31T04:40:43.843231+0000) 2024-08-31T04:40:46.543 INFO:journalctl@ceph.osd.10.smithi133.stdout:Aug 31 04:40:46 smithi133 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-10[46762]: 2024-08-31T04:40:46.060+0000 7f873f3e9640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-08-31T04:39:32.936397+0000 front 2024-08-31T04:39:32.936196+0000 (oldest deadline 2024-08-31T04:39:55.836336+0000) 2024-08-31T04:40:46.543 INFO:journalctl@ceph.osd.10.smithi133.stdout:Aug 31 04:40:46 smithi133 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-10[46762]: 2024-08-31T04:40:46.060+0000 7f873f3e9640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.133:6804 osd.1 since back 2024-08-31T04:39:40.537248+0000 front 2024-08-31T04:39:40.537370+0000 (oldest deadline 2024-08-31T04:40:06.437470+0000) 2024-08-31T04:40:46.543 INFO:journalctl@ceph.osd.10.smithi133.stdout:Aug 31 04:40:46 smithi133 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-10[46762]: 2024-08-31T04:40:46.060+0000 7f873f3e9640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-08-31T04:39:50.438807+0000 front 2024-08-31T04:39:50.438655+0000 (oldest deadline 2024-08-31T04:40:11.538621+0000) 2024-08-31T04:40:46.543 INFO:journalctl@ceph.osd.10.smithi133.stdout:Aug 31 04:40:46 smithi133 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-10[46762]: 2024-08-31T04:40:46.060+0000 7f873f3e9640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2024-08-31T04:39:55.639898+0000 front 2024-08-31T04:39:55.639930+0000 (oldest deadline 2024-08-31T04:40:20.939655+0000) 2024-08-31T04:40:46.543 INFO:journalctl@ceph.osd.10.smithi133.stdout:Aug 31 04:40:46 smithi133 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-10[46762]: 2024-08-31T04:40:46.060+0000 7f873f3e9640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.133:6812 osd.4 since back 2024-08-31T04:40:05.040435+0000 front 2024-08-31T04:40:05.040466+0000 (oldest deadline 2024-08-31T04:40:28.540479+0000) 2024-08-31T04:40:46.543 INFO:journalctl@ceph.osd.10.smithi133.stdout:Aug 31 04:40:46 smithi133 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-10[46762]: 2024-08-31T04:40:46.060+0000 7f873f3e9640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.177:6812 osd.5 since back 2024-08-31T04:40:12.041463+0000 front 2024-08-31T04:40:12.041501+0000 (oldest deadline 2024-08-31T04:40:37.941448+0000) 2024-08-31T04:40:46.543 INFO:journalctl@ceph.osd.10.smithi133.stdout:Aug 31 04:40:46 smithi133 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-10[46762]: 2024-08-31T04:40:46.060+0000 7f873f3e9640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.50:6822 osd.6 since back 2024-08-31T04:40:20.842699+0000 front 2024-08-31T04:40:20.842593+0000 (oldest deadline 2024-08-31T04:40:43.742552+0000) 2024-08-31T04:40:46.950 INFO:journalctl@ceph.osd.9.smithi050.stdout:Aug 31 04:40:46 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-9[52806]: 2024-08-31T04:40:46.529+0000 7f30c0800640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-08-31T04:39:33.661151+0000 front 2024-08-31T04:39:33.661082+0000 (oldest deadline 2024-08-31T04:39:55.361248+0000) 2024-08-31T04:40:46.950 INFO:journalctl@ceph.osd.9.smithi050.stdout:Aug 31 04:40:46 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-9[52806]: 2024-08-31T04:40:46.529+0000 7f30c0800640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.133:6804 osd.1 since back 2024-08-31T04:39:41.262725+0000 front 2024-08-31T04:39:41.262699+0000 (oldest deadline 2024-08-31T04:40:05.362593+0000) 2024-08-31T04:40:46.950 INFO:journalctl@ceph.osd.9.smithi050.stdout:Aug 31 04:40:46 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-9[52806]: 2024-08-31T04:40:46.529+0000 7f30c0800640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-08-31T04:39:50.664217+0000 front 2024-08-31T04:39:50.663973+0000 (oldest deadline 2024-08-31T04:40:14.163759+0000) 2024-08-31T04:40:46.950 INFO:journalctl@ceph.osd.9.smithi050.stdout:Aug 31 04:40:46 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-9[52806]: 2024-08-31T04:40:46.529+0000 7f30c0800640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2024-08-31T04:39:55.765151+0000 front 2024-08-31T04:39:55.765209+0000 (oldest deadline 2024-08-31T04:40:19.865200+0000) 2024-08-31T04:40:46.950 INFO:journalctl@ceph.osd.9.smithi050.stdout:Aug 31 04:40:46 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-9[52806]: 2024-08-31T04:40:46.529+0000 7f30c0800640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.177:6812 osd.5 since back 2024-08-31T04:40:12.667949+0000 front 2024-08-31T04:40:12.667982+0000 (oldest deadline 2024-08-31T04:40:35.567668+0000) 2024-08-31T04:40:46.950 INFO:journalctl@ceph.osd.9.smithi050.stdout:Aug 31 04:40:46 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-9[52806]: 2024-08-31T04:40:46.529+0000 7f30c0800640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.50:6822 osd.6 since back 2024-08-31T04:40:21.270015+0000 front 2024-08-31T04:40:21.270075+0000 (oldest deadline 2024-08-31T04:40:44.170066+0000) 2024-08-31T04:40:47.293 INFO:journalctl@ceph.osd.10.smithi133.stdout:Aug 31 04:40:47 smithi133 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-10[46762]: 2024-08-31T04:40:47.022+0000 7f873f3e9640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-08-31T04:39:32.936397+0000 front 2024-08-31T04:39:32.936196+0000 (oldest deadline 2024-08-31T04:39:55.836336+0000) 2024-08-31T04:40:47.293 INFO:journalctl@ceph.osd.10.smithi133.stdout:Aug 31 04:40:47 smithi133 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-10[46762]: 2024-08-31T04:40:47.022+0000 7f873f3e9640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.133:6804 osd.1 since back 2024-08-31T04:39:40.537248+0000 front 2024-08-31T04:39:40.537370+0000 (oldest deadline 2024-08-31T04:40:06.437470+0000) 2024-08-31T04:40:47.293 INFO:journalctl@ceph.osd.10.smithi133.stdout:Aug 31 04:40:47 smithi133 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-10[46762]: 2024-08-31T04:40:47.022+0000 7f873f3e9640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-08-31T04:39:50.438807+0000 front 2024-08-31T04:39:50.438655+0000 (oldest deadline 2024-08-31T04:40:11.538621+0000) 2024-08-31T04:40:47.293 INFO:journalctl@ceph.osd.10.smithi133.stdout:Aug 31 04:40:47 smithi133 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-10[46762]: 2024-08-31T04:40:47.022+0000 7f873f3e9640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2024-08-31T04:39:55.639898+0000 front 2024-08-31T04:39:55.639930+0000 (oldest deadline 2024-08-31T04:40:20.939655+0000) 2024-08-31T04:40:47.293 INFO:journalctl@ceph.osd.10.smithi133.stdout:Aug 31 04:40:47 smithi133 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-10[46762]: 2024-08-31T04:40:47.022+0000 7f873f3e9640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.133:6812 osd.4 since back 2024-08-31T04:40:05.040435+0000 front 2024-08-31T04:40:05.040466+0000 (oldest deadline 2024-08-31T04:40:28.540479+0000) 2024-08-31T04:40:47.294 INFO:journalctl@ceph.osd.10.smithi133.stdout:Aug 31 04:40:47 smithi133 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-10[46762]: 2024-08-31T04:40:47.022+0000 7f873f3e9640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.177:6812 osd.5 since back 2024-08-31T04:40:12.041463+0000 front 2024-08-31T04:40:12.041501+0000 (oldest deadline 2024-08-31T04:40:37.941448+0000) 2024-08-31T04:40:47.294 INFO:journalctl@ceph.osd.10.smithi133.stdout:Aug 31 04:40:47 smithi133 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-10[46762]: 2024-08-31T04:40:47.022+0000 7f873f3e9640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.50:6822 osd.6 since back 2024-08-31T04:40:20.842699+0000 front 2024-08-31T04:40:20.842593+0000 (oldest deadline 2024-08-31T04:40:43.742552+0000) 2024-08-31T04:40:47.496 INFO:journalctl@ceph.osd.11.smithi177.stdout:Aug 31 04:40:47 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-11[46864]: 2024-08-31T04:40:47.140+0000 7fd602bf1640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-08-31T04:39:30.036711+0000 front 2024-08-31T04:39:30.036747+0000 (oldest deadline 2024-08-31T04:39:55.936674+0000) 2024-08-31T04:40:47.496 INFO:journalctl@ceph.osd.11.smithi177.stdout:Aug 31 04:40:47 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-11[46864]: 2024-08-31T04:40:47.140+0000 7fd602bf1640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.133:6804 osd.1 since back 2024-08-31T04:39:41.138475+0000 front 2024-08-31T04:39:41.138491+0000 (oldest deadline 2024-08-31T04:40:04.038356+0000) 2024-08-31T04:40:47.496 INFO:journalctl@ceph.osd.11.smithi177.stdout:Aug 31 04:40:47 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-11[46864]: 2024-08-31T04:40:47.140+0000 7fd602bf1640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-08-31T04:39:46.939525+0000 front 2024-08-31T04:39:46.939251+0000 (oldest deadline 2024-08-31T04:40:12.239391+0000) 2024-08-31T04:40:47.496 INFO:journalctl@ceph.osd.11.smithi177.stdout:Aug 31 04:40:47 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-11[46864]: 2024-08-31T04:40:47.140+0000 7fd602bf1640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.133:6812 osd.4 since back 2024-08-31T04:40:05.141613+0000 front 2024-08-31T04:40:05.141382+0000 (oldest deadline 2024-08-31T04:40:32.741898+0000) 2024-08-31T04:40:47.496 INFO:journalctl@ceph.osd.11.smithi177.stdout:Aug 31 04:40:47 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-11[46864]: 2024-08-31T04:40:47.140+0000 7fd602bf1640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.177:6812 osd.5 since back 2024-08-31T04:40:12.742231+0000 front 2024-08-31T04:40:12.742332+0000 (oldest deadline 2024-08-31T04:40:36.842325+0000) 2024-08-31T04:40:47.496 INFO:journalctl@ceph.osd.11.smithi177.stdout:Aug 31 04:40:47 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-11[46864]: 2024-08-31T04:40:47.140+0000 7fd602bf1640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.50:6822 osd.6 since back 2024-08-31T04:40:19.743250+0000 front 2024-08-31T04:40:19.743271+0000 (oldest deadline 2024-08-31T04:40:43.843231+0000) 2024-08-31T04:40:47.950 INFO:journalctl@ceph.osd.9.smithi050.stdout:Aug 31 04:40:47 smithi050 podman[88146]: 2024-08-31 04:40:47.692994907 +0000 UTC m=+5.643310397 container stop 9465fb723ab44c3a665cc71f7961f5b15e9624b7c71636eaeac6626a9e96f1bc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-9, ceph=True, org.label-schema.license=GPLv2, GIT_CLEAN=True, io.buildah.version=1.37.1, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-08-31T04:40:47.950 INFO:journalctl@ceph.osd.9.smithi050.stdout:Aug 31 04:40:47 smithi050 podman[88146]: 2024-08-31 04:40:47.718887727 +0000 UTC m=+5.669203227 container died 9465fb723ab44c3a665cc71f7961f5b15e9624b7c71636eaeac6626a9e96f1bc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-9, CEPH_POINT_RELEASE=, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, io.buildah.version=1.37.1, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS) 2024-08-31T04:40:48.293 INFO:journalctl@ceph.osd.10.smithi133.stdout:Aug 31 04:40:47 smithi133 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-10[46762]: 2024-08-31T04:40:47.986+0000 7f873f3e9640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-08-31T04:39:32.936397+0000 front 2024-08-31T04:39:32.936196+0000 (oldest deadline 2024-08-31T04:39:55.836336+0000) 2024-08-31T04:40:48.293 INFO:journalctl@ceph.osd.10.smithi133.stdout:Aug 31 04:40:47 smithi133 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-10[46762]: 2024-08-31T04:40:47.986+0000 7f873f3e9640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.133:6804 osd.1 since back 2024-08-31T04:39:40.537248+0000 front 2024-08-31T04:39:40.537370+0000 (oldest deadline 2024-08-31T04:40:06.437470+0000) 2024-08-31T04:40:48.293 INFO:journalctl@ceph.osd.10.smithi133.stdout:Aug 31 04:40:47 smithi133 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-10[46762]: 2024-08-31T04:40:47.986+0000 7f873f3e9640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-08-31T04:39:50.438807+0000 front 2024-08-31T04:39:50.438655+0000 (oldest deadline 2024-08-31T04:40:11.538621+0000) 2024-08-31T04:40:48.293 INFO:journalctl@ceph.osd.10.smithi133.stdout:Aug 31 04:40:47 smithi133 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-10[46762]: 2024-08-31T04:40:47.986+0000 7f873f3e9640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2024-08-31T04:39:55.639898+0000 front 2024-08-31T04:39:55.639930+0000 (oldest deadline 2024-08-31T04:40:20.939655+0000) 2024-08-31T04:40:48.293 INFO:journalctl@ceph.osd.10.smithi133.stdout:Aug 31 04:40:47 smithi133 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-10[46762]: 2024-08-31T04:40:47.986+0000 7f873f3e9640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.133:6812 osd.4 since back 2024-08-31T04:40:05.040435+0000 front 2024-08-31T04:40:05.040466+0000 (oldest deadline 2024-08-31T04:40:28.540479+0000) 2024-08-31T04:40:48.293 INFO:journalctl@ceph.osd.10.smithi133.stdout:Aug 31 04:40:47 smithi133 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-10[46762]: 2024-08-31T04:40:47.986+0000 7f873f3e9640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.177:6812 osd.5 since back 2024-08-31T04:40:12.041463+0000 front 2024-08-31T04:40:12.041501+0000 (oldest deadline 2024-08-31T04:40:37.941448+0000) 2024-08-31T04:40:48.293 INFO:journalctl@ceph.osd.10.smithi133.stdout:Aug 31 04:40:47 smithi133 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-10[46762]: 2024-08-31T04:40:47.986+0000 7f873f3e9640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.50:6822 osd.6 since back 2024-08-31T04:40:20.842699+0000 front 2024-08-31T04:40:20.842593+0000 (oldest deadline 2024-08-31T04:40:43.742552+0000) 2024-08-31T04:40:48.326 INFO:journalctl@ceph.osd.9.smithi050.stdout:Aug 31 04:40:48 smithi050 podman[88146]: 2024-08-31 04:40:48.115854034 +0000 UTC m=+6.066169524 container cleanup 9465fb723ab44c3a665cc71f7961f5b15e9624b7c71636eaeac6626a9e96f1bc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-9, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_CLEAN=True, ceph=True, CEPH_POINT_RELEASE=, io.buildah.version=1.37.1, org.label-schema.schema-version=1.0, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux ) 2024-08-31T04:40:48.326 INFO:journalctl@ceph.osd.9.smithi050.stdout:Aug 31 04:40:48 smithi050 bash[88146]: ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-9 2024-08-31T04:40:48.496 INFO:journalctl@ceph.osd.11.smithi177.stdout:Aug 31 04:40:48 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-11[46864]: 2024-08-31T04:40:48.098+0000 7fd602bf1640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-08-31T04:39:30.036711+0000 front 2024-08-31T04:39:30.036747+0000 (oldest deadline 2024-08-31T04:39:55.936674+0000) 2024-08-31T04:40:48.496 INFO:journalctl@ceph.osd.11.smithi177.stdout:Aug 31 04:40:48 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-11[46864]: 2024-08-31T04:40:48.098+0000 7fd602bf1640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.133:6804 osd.1 since back 2024-08-31T04:39:41.138475+0000 front 2024-08-31T04:39:41.138491+0000 (oldest deadline 2024-08-31T04:40:04.038356+0000) 2024-08-31T04:40:48.496 INFO:journalctl@ceph.osd.11.smithi177.stdout:Aug 31 04:40:48 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-11[46864]: 2024-08-31T04:40:48.098+0000 7fd602bf1640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-08-31T04:39:46.939525+0000 front 2024-08-31T04:39:46.939251+0000 (oldest deadline 2024-08-31T04:40:12.239391+0000) 2024-08-31T04:40:48.497 INFO:journalctl@ceph.osd.11.smithi177.stdout:Aug 31 04:40:48 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-11[46864]: 2024-08-31T04:40:48.098+0000 7fd602bf1640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.133:6812 osd.4 since back 2024-08-31T04:40:05.141613+0000 front 2024-08-31T04:40:05.141382+0000 (oldest deadline 2024-08-31T04:40:32.741898+0000) 2024-08-31T04:40:48.497 INFO:journalctl@ceph.osd.11.smithi177.stdout:Aug 31 04:40:48 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-11[46864]: 2024-08-31T04:40:48.098+0000 7fd602bf1640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.177:6812 osd.5 since back 2024-08-31T04:40:12.742231+0000 front 2024-08-31T04:40:12.742332+0000 (oldest deadline 2024-08-31T04:40:36.842325+0000) 2024-08-31T04:40:48.497 INFO:journalctl@ceph.osd.11.smithi177.stdout:Aug 31 04:40:48 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-11[46864]: 2024-08-31T04:40:48.098+0000 7fd602bf1640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.50:6822 osd.6 since back 2024-08-31T04:40:19.743250+0000 front 2024-08-31T04:40:19.743271+0000 (oldest deadline 2024-08-31T04:40:43.843231+0000) 2024-08-31T04:40:48.700 INFO:journalctl@ceph.osd.9.smithi050.stdout:Aug 31 04:40:48 smithi050 podman[88165]: 2024-08-31 04:40:48.325425019 +0000 UTC m=+0.618672629 container remove 9465fb723ab44c3a665cc71f7961f5b15e9624b7c71636eaeac6626a9e96f1bc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-9, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, io.buildah.version=1.37.1) 2024-08-31T04:40:49.146 INFO:journalctl@ceph.osd.9.smithi050.stdout:Aug 31 04:40:48 smithi050 podman[88250]: 2024-08-31 04:40:48.876399725 +0000 UTC m=+0.117832490 container create 5de70ca22288b0e93a91796ca33562fb7d9395da9f4895dcfbd101cf56d66305 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-9-deactivate, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, io.buildah.version=1.37.1, ceph=True, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611) 2024-08-31T04:40:49.147 INFO:journalctl@ceph.osd.9.smithi050.stdout:Aug 31 04:40:48 smithi050 podman[88250]: 2024-08-31 04:40:48.786337945 +0000 UTC m=+0.027770710 image pull 79f4cde5e36911a5dca995eeb98098c2c8aae81dd52a088ef2c867bc3363bad0 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61 2024-08-31T04:40:49.147 INFO:journalctl@ceph.osd.9.smithi050.stdout:Aug 31 04:40:49 smithi050 podman[88250]: 2024-08-31 04:40:49.145835371 +0000 UTC m=+0.387268136 container init 5de70ca22288b0e93a91796ca33562fb7d9395da9f4895dcfbd101cf56d66305 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-9-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_CLEAN=True, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, io.buildah.version=1.37.1, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD) 2024-08-31T04:40:49.293 INFO:journalctl@ceph.osd.10.smithi133.stdout:Aug 31 04:40:48 smithi133 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-10[46762]: 2024-08-31T04:40:48.976+0000 7f873f3e9640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-08-31T04:39:32.936397+0000 front 2024-08-31T04:39:32.936196+0000 (oldest deadline 2024-08-31T04:39:55.836336+0000) 2024-08-31T04:40:49.293 INFO:journalctl@ceph.osd.10.smithi133.stdout:Aug 31 04:40:48 smithi133 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-10[46762]: 2024-08-31T04:40:48.976+0000 7f873f3e9640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.133:6804 osd.1 since back 2024-08-31T04:39:40.537248+0000 front 2024-08-31T04:39:40.537370+0000 (oldest deadline 2024-08-31T04:40:06.437470+0000) 2024-08-31T04:40:49.293 INFO:journalctl@ceph.osd.10.smithi133.stdout:Aug 31 04:40:48 smithi133 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-10[46762]: 2024-08-31T04:40:48.976+0000 7f873f3e9640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-08-31T04:39:50.438807+0000 front 2024-08-31T04:39:50.438655+0000 (oldest deadline 2024-08-31T04:40:11.538621+0000) 2024-08-31T04:40:49.293 INFO:journalctl@ceph.osd.10.smithi133.stdout:Aug 31 04:40:48 smithi133 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-10[46762]: 2024-08-31T04:40:48.976+0000 7f873f3e9640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2024-08-31T04:39:55.639898+0000 front 2024-08-31T04:39:55.639930+0000 (oldest deadline 2024-08-31T04:40:20.939655+0000) 2024-08-31T04:40:49.293 INFO:journalctl@ceph.osd.10.smithi133.stdout:Aug 31 04:40:48 smithi133 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-10[46762]: 2024-08-31T04:40:48.976+0000 7f873f3e9640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.133:6812 osd.4 since back 2024-08-31T04:40:05.040435+0000 front 2024-08-31T04:40:05.040466+0000 (oldest deadline 2024-08-31T04:40:28.540479+0000) 2024-08-31T04:40:49.293 INFO:journalctl@ceph.osd.10.smithi133.stdout:Aug 31 04:40:48 smithi133 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-10[46762]: 2024-08-31T04:40:48.976+0000 7f873f3e9640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.177:6812 osd.5 since back 2024-08-31T04:40:12.041463+0000 front 2024-08-31T04:40:12.041501+0000 (oldest deadline 2024-08-31T04:40:37.941448+0000) 2024-08-31T04:40:49.293 INFO:journalctl@ceph.osd.10.smithi133.stdout:Aug 31 04:40:48 smithi133 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-10[46762]: 2024-08-31T04:40:48.976+0000 7f873f3e9640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.50:6822 osd.6 since back 2024-08-31T04:40:20.842699+0000 front 2024-08-31T04:40:20.842593+0000 (oldest deadline 2024-08-31T04:40:43.742552+0000) 2024-08-31T04:40:49.425 INFO:journalctl@ceph.osd.9.smithi050.stdout:Aug 31 04:40:49 smithi050 podman[88250]: 2024-08-31 04:40:49.15256787 +0000 UTC m=+0.394000636 container start 5de70ca22288b0e93a91796ca33562fb7d9395da9f4895dcfbd101cf56d66305 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-9-deactivate, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.1, GIT_BRANCH=HEAD, ceph=True) 2024-08-31T04:40:49.425 INFO:journalctl@ceph.osd.9.smithi050.stdout:Aug 31 04:40:49 smithi050 podman[88250]: 2024-08-31 04:40:49.245532128 +0000 UTC m=+0.486964900 container attach 5de70ca22288b0e93a91796ca33562fb7d9395da9f4895dcfbd101cf56d66305 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-9-deactivate, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.build-date=20240731, io.buildah.version=1.37.1, GIT_BRANCH=HEAD, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True) 2024-08-31T04:40:49.496 INFO:journalctl@ceph.osd.11.smithi177.stdout:Aug 31 04:40:49 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-11[46864]: 2024-08-31T04:40:49.130+0000 7fd602bf1640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-08-31T04:39:30.036711+0000 front 2024-08-31T04:39:30.036747+0000 (oldest deadline 2024-08-31T04:39:55.936674+0000) 2024-08-31T04:40:49.496 INFO:journalctl@ceph.osd.11.smithi177.stdout:Aug 31 04:40:49 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-11[46864]: 2024-08-31T04:40:49.130+0000 7fd602bf1640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.133:6804 osd.1 since back 2024-08-31T04:39:41.138475+0000 front 2024-08-31T04:39:41.138491+0000 (oldest deadline 2024-08-31T04:40:04.038356+0000) 2024-08-31T04:40:49.496 INFO:journalctl@ceph.osd.11.smithi177.stdout:Aug 31 04:40:49 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-11[46864]: 2024-08-31T04:40:49.130+0000 7fd602bf1640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-08-31T04:39:46.939525+0000 front 2024-08-31T04:39:46.939251+0000 (oldest deadline 2024-08-31T04:40:12.239391+0000) 2024-08-31T04:40:49.496 INFO:journalctl@ceph.osd.11.smithi177.stdout:Aug 31 04:40:49 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-11[46864]: 2024-08-31T04:40:49.130+0000 7fd602bf1640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.133:6812 osd.4 since back 2024-08-31T04:40:05.141613+0000 front 2024-08-31T04:40:05.141382+0000 (oldest deadline 2024-08-31T04:40:32.741898+0000) 2024-08-31T04:40:49.496 INFO:journalctl@ceph.osd.11.smithi177.stdout:Aug 31 04:40:49 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-11[46864]: 2024-08-31T04:40:49.130+0000 7fd602bf1640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.177:6812 osd.5 since back 2024-08-31T04:40:12.742231+0000 front 2024-08-31T04:40:12.742332+0000 (oldest deadline 2024-08-31T04:40:36.842325+0000) 2024-08-31T04:40:49.496 INFO:journalctl@ceph.osd.11.smithi177.stdout:Aug 31 04:40:49 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-11[46864]: 2024-08-31T04:40:49.130+0000 7fd602bf1640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.50:6822 osd.6 since back 2024-08-31T04:40:19.743250+0000 front 2024-08-31T04:40:19.743271+0000 (oldest deadline 2024-08-31T04:40:43.843231+0000) 2024-08-31T04:40:49.699 INFO:journalctl@ceph.osd.9.smithi050.stdout:Aug 31 04:40:49 smithi050 podman[88250]: 2024-08-31 04:40:49.424561046 +0000 UTC m=+0.665993812 container died 5de70ca22288b0e93a91796ca33562fb7d9395da9f4895dcfbd101cf56d66305 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-9-deactivate, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_CLEAN=True, CEPH_POINT_RELEASE=, io.buildah.version=1.37.1, org.label-schema.vendor=CentOS, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image) 2024-08-31T04:40:50.086 DEBUG:teuthology.orchestra.run.smithi050:> sudo pkill -f 'journalctl -f -n 0 -u ceph-058d9fc6-674f-11ef-bcd4-c7b262605968@osd.9.service' 2024-08-31T04:40:50.161 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-31T04:40:50.161 INFO:tasks.cephadm.osd.9:Stopped osd.9 2024-08-31T04:40:50.162 INFO:tasks.cephadm.osd.10:Stopping osd.10... 2024-08-31T04:40:50.162 DEBUG:teuthology.orchestra.run.smithi133:> sudo systemctl stop ceph-058d9fc6-674f-11ef-bcd4-c7b262605968@osd.10 2024-08-31T04:40:50.293 INFO:journalctl@ceph.osd.10.smithi133.stdout:Aug 31 04:40:50 smithi133 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-10[46762]: 2024-08-31T04:40:50.006+0000 7f873f3e9640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-08-31T04:39:32.936397+0000 front 2024-08-31T04:39:32.936196+0000 (oldest deadline 2024-08-31T04:39:55.836336+0000) 2024-08-31T04:40:50.293 INFO:journalctl@ceph.osd.10.smithi133.stdout:Aug 31 04:40:50 smithi133 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-10[46762]: 2024-08-31T04:40:50.006+0000 7f873f3e9640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.133:6804 osd.1 since back 2024-08-31T04:39:40.537248+0000 front 2024-08-31T04:39:40.537370+0000 (oldest deadline 2024-08-31T04:40:06.437470+0000) 2024-08-31T04:40:50.293 INFO:journalctl@ceph.osd.10.smithi133.stdout:Aug 31 04:40:50 smithi133 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-10[46762]: 2024-08-31T04:40:50.006+0000 7f873f3e9640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-08-31T04:39:50.438807+0000 front 2024-08-31T04:39:50.438655+0000 (oldest deadline 2024-08-31T04:40:11.538621+0000) 2024-08-31T04:40:50.293 INFO:journalctl@ceph.osd.10.smithi133.stdout:Aug 31 04:40:50 smithi133 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-10[46762]: 2024-08-31T04:40:50.006+0000 7f873f3e9640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2024-08-31T04:39:55.639898+0000 front 2024-08-31T04:39:55.639930+0000 (oldest deadline 2024-08-31T04:40:20.939655+0000) 2024-08-31T04:40:50.293 INFO:journalctl@ceph.osd.10.smithi133.stdout:Aug 31 04:40:50 smithi133 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-10[46762]: 2024-08-31T04:40:50.006+0000 7f873f3e9640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.133:6812 osd.4 since back 2024-08-31T04:40:05.040435+0000 front 2024-08-31T04:40:05.040466+0000 (oldest deadline 2024-08-31T04:40:28.540479+0000) 2024-08-31T04:40:50.293 INFO:journalctl@ceph.osd.10.smithi133.stdout:Aug 31 04:40:50 smithi133 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-10[46762]: 2024-08-31T04:40:50.006+0000 7f873f3e9640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.177:6812 osd.5 since back 2024-08-31T04:40:12.041463+0000 front 2024-08-31T04:40:12.041501+0000 (oldest deadline 2024-08-31T04:40:37.941448+0000) 2024-08-31T04:40:50.294 INFO:journalctl@ceph.osd.10.smithi133.stdout:Aug 31 04:40:50 smithi133 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-10[46762]: 2024-08-31T04:40:50.006+0000 7f873f3e9640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.50:6822 osd.6 since back 2024-08-31T04:40:20.842699+0000 front 2024-08-31T04:40:20.842593+0000 (oldest deadline 2024-08-31T04:40:43.742552+0000) 2024-08-31T04:40:50.294 INFO:journalctl@ceph.osd.10.smithi133.stdout:Aug 31 04:40:50 smithi133 systemd[1]: Stopping Ceph osd.10 for 058d9fc6-674f-11ef-bcd4-c7b262605968... 2024-08-31T04:40:50.496 INFO:journalctl@ceph.osd.11.smithi177.stdout:Aug 31 04:40:50 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-11[46864]: 2024-08-31T04:40:50.139+0000 7fd602bf1640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-08-31T04:39:30.036711+0000 front 2024-08-31T04:39:30.036747+0000 (oldest deadline 2024-08-31T04:39:55.936674+0000) 2024-08-31T04:40:50.496 INFO:journalctl@ceph.osd.11.smithi177.stdout:Aug 31 04:40:50 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-11[46864]: 2024-08-31T04:40:50.139+0000 7fd602bf1640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.133:6804 osd.1 since back 2024-08-31T04:39:41.138475+0000 front 2024-08-31T04:39:41.138491+0000 (oldest deadline 2024-08-31T04:40:04.038356+0000) 2024-08-31T04:40:50.496 INFO:journalctl@ceph.osd.11.smithi177.stdout:Aug 31 04:40:50 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-11[46864]: 2024-08-31T04:40:50.139+0000 7fd602bf1640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-08-31T04:39:46.939525+0000 front 2024-08-31T04:39:46.939251+0000 (oldest deadline 2024-08-31T04:40:12.239391+0000) 2024-08-31T04:40:50.496 INFO:journalctl@ceph.osd.11.smithi177.stdout:Aug 31 04:40:50 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-11[46864]: 2024-08-31T04:40:50.139+0000 7fd602bf1640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.133:6812 osd.4 since back 2024-08-31T04:40:05.141613+0000 front 2024-08-31T04:40:05.141382+0000 (oldest deadline 2024-08-31T04:40:32.741898+0000) 2024-08-31T04:40:50.496 INFO:journalctl@ceph.osd.11.smithi177.stdout:Aug 31 04:40:50 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-11[46864]: 2024-08-31T04:40:50.139+0000 7fd602bf1640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.177:6812 osd.5 since back 2024-08-31T04:40:12.742231+0000 front 2024-08-31T04:40:12.742332+0000 (oldest deadline 2024-08-31T04:40:36.842325+0000) 2024-08-31T04:40:50.497 INFO:journalctl@ceph.osd.11.smithi177.stdout:Aug 31 04:40:50 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-11[46864]: 2024-08-31T04:40:50.139+0000 7fd602bf1640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.50:6822 osd.6 since back 2024-08-31T04:40:19.743250+0000 front 2024-08-31T04:40:19.743271+0000 (oldest deadline 2024-08-31T04:40:43.843231+0000) 2024-08-31T04:40:50.793 INFO:journalctl@ceph.osd.10.smithi133.stdout:Aug 31 04:40:50 smithi133 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-10[46762]: 2024-08-31T04:40:50.446+0000 7f8742dfe640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.10 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-31T04:40:50.793 INFO:journalctl@ceph.osd.10.smithi133.stdout:Aug 31 04:40:50 smithi133 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-10[46762]: 2024-08-31T04:40:50.446+0000 7f8742dfe640 -1 osd.10 83 *** Got signal Terminated *** 2024-08-31T04:40:50.793 INFO:journalctl@ceph.osd.10.smithi133.stdout:Aug 31 04:40:50 smithi133 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-10[46762]: 2024-08-31T04:40:50.446+0000 7f8742dfe640 -1 osd.10 83 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-08-31T04:40:51.293 INFO:journalctl@ceph.osd.10.smithi133.stdout:Aug 31 04:40:50 smithi133 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-10[46762]: 2024-08-31T04:40:50.971+0000 7f873f3e9640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-08-31T04:39:32.936397+0000 front 2024-08-31T04:39:32.936196+0000 (oldest deadline 2024-08-31T04:39:55.836336+0000) 2024-08-31T04:40:51.293 INFO:journalctl@ceph.osd.10.smithi133.stdout:Aug 31 04:40:50 smithi133 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-10[46762]: 2024-08-31T04:40:50.971+0000 7f873f3e9640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.133:6804 osd.1 since back 2024-08-31T04:39:40.537248+0000 front 2024-08-31T04:39:40.537370+0000 (oldest deadline 2024-08-31T04:40:06.437470+0000) 2024-08-31T04:40:51.293 INFO:journalctl@ceph.osd.10.smithi133.stdout:Aug 31 04:40:50 smithi133 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-10[46762]: 2024-08-31T04:40:50.971+0000 7f873f3e9640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-08-31T04:39:50.438807+0000 front 2024-08-31T04:39:50.438655+0000 (oldest deadline 2024-08-31T04:40:11.538621+0000) 2024-08-31T04:40:51.293 INFO:journalctl@ceph.osd.10.smithi133.stdout:Aug 31 04:40:50 smithi133 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-10[46762]: 2024-08-31T04:40:50.971+0000 7f873f3e9640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2024-08-31T04:39:55.639898+0000 front 2024-08-31T04:39:55.639930+0000 (oldest deadline 2024-08-31T04:40:20.939655+0000) 2024-08-31T04:40:51.293 INFO:journalctl@ceph.osd.10.smithi133.stdout:Aug 31 04:40:50 smithi133 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-10[46762]: 2024-08-31T04:40:50.971+0000 7f873f3e9640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.133:6812 osd.4 since back 2024-08-31T04:40:05.040435+0000 front 2024-08-31T04:40:05.040466+0000 (oldest deadline 2024-08-31T04:40:28.540479+0000) 2024-08-31T04:40:51.293 INFO:journalctl@ceph.osd.10.smithi133.stdout:Aug 31 04:40:50 smithi133 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-10[46762]: 2024-08-31T04:40:50.971+0000 7f873f3e9640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.177:6812 osd.5 since back 2024-08-31T04:40:12.041463+0000 front 2024-08-31T04:40:12.041501+0000 (oldest deadline 2024-08-31T04:40:37.941448+0000) 2024-08-31T04:40:51.293 INFO:journalctl@ceph.osd.10.smithi133.stdout:Aug 31 04:40:50 smithi133 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-10[46762]: 2024-08-31T04:40:50.971+0000 7f873f3e9640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.50:6822 osd.6 since back 2024-08-31T04:40:20.842699+0000 front 2024-08-31T04:40:20.842593+0000 (oldest deadline 2024-08-31T04:40:43.742552+0000) 2024-08-31T04:40:51.496 INFO:journalctl@ceph.osd.11.smithi177.stdout:Aug 31 04:40:51 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-11[46864]: 2024-08-31T04:40:51.181+0000 7fd602bf1640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-08-31T04:39:30.036711+0000 front 2024-08-31T04:39:30.036747+0000 (oldest deadline 2024-08-31T04:39:55.936674+0000) 2024-08-31T04:40:51.496 INFO:journalctl@ceph.osd.11.smithi177.stdout:Aug 31 04:40:51 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-11[46864]: 2024-08-31T04:40:51.181+0000 7fd602bf1640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.133:6804 osd.1 since back 2024-08-31T04:39:41.138475+0000 front 2024-08-31T04:39:41.138491+0000 (oldest deadline 2024-08-31T04:40:04.038356+0000) 2024-08-31T04:40:51.496 INFO:journalctl@ceph.osd.11.smithi177.stdout:Aug 31 04:40:51 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-11[46864]: 2024-08-31T04:40:51.181+0000 7fd602bf1640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-08-31T04:39:46.939525+0000 front 2024-08-31T04:39:46.939251+0000 (oldest deadline 2024-08-31T04:40:12.239391+0000) 2024-08-31T04:40:51.496 INFO:journalctl@ceph.osd.11.smithi177.stdout:Aug 31 04:40:51 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-11[46864]: 2024-08-31T04:40:51.181+0000 7fd602bf1640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.133:6812 osd.4 since back 2024-08-31T04:40:05.141613+0000 front 2024-08-31T04:40:05.141382+0000 (oldest deadline 2024-08-31T04:40:32.741898+0000) 2024-08-31T04:40:51.496 INFO:journalctl@ceph.osd.11.smithi177.stdout:Aug 31 04:40:51 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-11[46864]: 2024-08-31T04:40:51.181+0000 7fd602bf1640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.177:6812 osd.5 since back 2024-08-31T04:40:12.742231+0000 front 2024-08-31T04:40:12.742332+0000 (oldest deadline 2024-08-31T04:40:36.842325+0000) 2024-08-31T04:40:51.496 INFO:journalctl@ceph.osd.11.smithi177.stdout:Aug 31 04:40:51 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-11[46864]: 2024-08-31T04:40:51.181+0000 7fd602bf1640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.50:6822 osd.6 since back 2024-08-31T04:40:19.743250+0000 front 2024-08-31T04:40:19.743271+0000 (oldest deadline 2024-08-31T04:40:43.843231+0000) 2024-08-31T04:40:52.293 INFO:journalctl@ceph.osd.10.smithi133.stdout:Aug 31 04:40:51 smithi133 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-10[46762]: 2024-08-31T04:40:51.960+0000 7f873f3e9640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-08-31T04:39:32.936397+0000 front 2024-08-31T04:39:32.936196+0000 (oldest deadline 2024-08-31T04:39:55.836336+0000) 2024-08-31T04:40:52.293 INFO:journalctl@ceph.osd.10.smithi133.stdout:Aug 31 04:40:51 smithi133 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-10[46762]: 2024-08-31T04:40:51.960+0000 7f873f3e9640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.133:6804 osd.1 since back 2024-08-31T04:39:40.537248+0000 front 2024-08-31T04:39:40.537370+0000 (oldest deadline 2024-08-31T04:40:06.437470+0000) 2024-08-31T04:40:52.293 INFO:journalctl@ceph.osd.10.smithi133.stdout:Aug 31 04:40:51 smithi133 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-10[46762]: 2024-08-31T04:40:51.960+0000 7f873f3e9640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-08-31T04:39:50.438807+0000 front 2024-08-31T04:39:50.438655+0000 (oldest deadline 2024-08-31T04:40:11.538621+0000) 2024-08-31T04:40:52.293 INFO:journalctl@ceph.osd.10.smithi133.stdout:Aug 31 04:40:51 smithi133 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-10[46762]: 2024-08-31T04:40:51.960+0000 7f873f3e9640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2024-08-31T04:39:55.639898+0000 front 2024-08-31T04:39:55.639930+0000 (oldest deadline 2024-08-31T04:40:20.939655+0000) 2024-08-31T04:40:52.293 INFO:journalctl@ceph.osd.10.smithi133.stdout:Aug 31 04:40:51 smithi133 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-10[46762]: 2024-08-31T04:40:51.960+0000 7f873f3e9640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.133:6812 osd.4 since back 2024-08-31T04:40:05.040435+0000 front 2024-08-31T04:40:05.040466+0000 (oldest deadline 2024-08-31T04:40:28.540479+0000) 2024-08-31T04:40:52.294 INFO:journalctl@ceph.osd.10.smithi133.stdout:Aug 31 04:40:51 smithi133 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-10[46762]: 2024-08-31T04:40:51.960+0000 7f873f3e9640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.177:6812 osd.5 since back 2024-08-31T04:40:12.041463+0000 front 2024-08-31T04:40:12.041501+0000 (oldest deadline 2024-08-31T04:40:37.941448+0000) 2024-08-31T04:40:52.294 INFO:journalctl@ceph.osd.10.smithi133.stdout:Aug 31 04:40:51 smithi133 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-10[46762]: 2024-08-31T04:40:51.960+0000 7f873f3e9640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.50:6822 osd.6 since back 2024-08-31T04:40:20.842699+0000 front 2024-08-31T04:40:20.842593+0000 (oldest deadline 2024-08-31T04:40:43.742552+0000) 2024-08-31T04:40:52.496 INFO:journalctl@ceph.osd.11.smithi177.stdout:Aug 31 04:40:52 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-11[46864]: 2024-08-31T04:40:52.159+0000 7fd602bf1640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-08-31T04:39:30.036711+0000 front 2024-08-31T04:39:30.036747+0000 (oldest deadline 2024-08-31T04:39:55.936674+0000) 2024-08-31T04:40:52.496 INFO:journalctl@ceph.osd.11.smithi177.stdout:Aug 31 04:40:52 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-11[46864]: 2024-08-31T04:40:52.159+0000 7fd602bf1640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.133:6804 osd.1 since back 2024-08-31T04:39:41.138475+0000 front 2024-08-31T04:39:41.138491+0000 (oldest deadline 2024-08-31T04:40:04.038356+0000) 2024-08-31T04:40:52.496 INFO:journalctl@ceph.osd.11.smithi177.stdout:Aug 31 04:40:52 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-11[46864]: 2024-08-31T04:40:52.159+0000 7fd602bf1640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-08-31T04:39:46.939525+0000 front 2024-08-31T04:39:46.939251+0000 (oldest deadline 2024-08-31T04:40:12.239391+0000) 2024-08-31T04:40:52.496 INFO:journalctl@ceph.osd.11.smithi177.stdout:Aug 31 04:40:52 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-11[46864]: 2024-08-31T04:40:52.159+0000 7fd602bf1640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.133:6812 osd.4 since back 2024-08-31T04:40:05.141613+0000 front 2024-08-31T04:40:05.141382+0000 (oldest deadline 2024-08-31T04:40:32.741898+0000) 2024-08-31T04:40:52.496 INFO:journalctl@ceph.osd.11.smithi177.stdout:Aug 31 04:40:52 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-11[46864]: 2024-08-31T04:40:52.159+0000 7fd602bf1640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.177:6812 osd.5 since back 2024-08-31T04:40:12.742231+0000 front 2024-08-31T04:40:12.742332+0000 (oldest deadline 2024-08-31T04:40:36.842325+0000) 2024-08-31T04:40:52.496 INFO:journalctl@ceph.osd.11.smithi177.stdout:Aug 31 04:40:52 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-11[46864]: 2024-08-31T04:40:52.159+0000 7fd602bf1640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.50:6822 osd.6 since back 2024-08-31T04:40:19.743250+0000 front 2024-08-31T04:40:19.743271+0000 (oldest deadline 2024-08-31T04:40:43.843231+0000) 2024-08-31T04:40:53.249 INFO:journalctl@ceph.osd.10.smithi133.stdout:Aug 31 04:40:52 smithi133 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-10[46762]: 2024-08-31T04:40:52.958+0000 7f873f3e9640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-08-31T04:39:32.936397+0000 front 2024-08-31T04:39:32.936196+0000 (oldest deadline 2024-08-31T04:39:55.836336+0000) 2024-08-31T04:40:53.249 INFO:journalctl@ceph.osd.10.smithi133.stdout:Aug 31 04:40:52 smithi133 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-10[46762]: 2024-08-31T04:40:52.958+0000 7f873f3e9640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.133:6804 osd.1 since back 2024-08-31T04:39:40.537248+0000 front 2024-08-31T04:39:40.537370+0000 (oldest deadline 2024-08-31T04:40:06.437470+0000) 2024-08-31T04:40:53.249 INFO:journalctl@ceph.osd.10.smithi133.stdout:Aug 31 04:40:52 smithi133 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-10[46762]: 2024-08-31T04:40:52.958+0000 7f873f3e9640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-08-31T04:39:50.438807+0000 front 2024-08-31T04:39:50.438655+0000 (oldest deadline 2024-08-31T04:40:11.538621+0000) 2024-08-31T04:40:53.250 INFO:journalctl@ceph.osd.10.smithi133.stdout:Aug 31 04:40:52 smithi133 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-10[46762]: 2024-08-31T04:40:52.958+0000 7f873f3e9640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2024-08-31T04:39:55.639898+0000 front 2024-08-31T04:39:55.639930+0000 (oldest deadline 2024-08-31T04:40:20.939655+0000) 2024-08-31T04:40:53.250 INFO:journalctl@ceph.osd.10.smithi133.stdout:Aug 31 04:40:52 smithi133 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-10[46762]: 2024-08-31T04:40:52.958+0000 7f873f3e9640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.133:6812 osd.4 since back 2024-08-31T04:40:05.040435+0000 front 2024-08-31T04:40:05.040466+0000 (oldest deadline 2024-08-31T04:40:28.540479+0000) 2024-08-31T04:40:53.250 INFO:journalctl@ceph.osd.10.smithi133.stdout:Aug 31 04:40:52 smithi133 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-10[46762]: 2024-08-31T04:40:52.958+0000 7f873f3e9640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.177:6812 osd.5 since back 2024-08-31T04:40:12.041463+0000 front 2024-08-31T04:40:12.041501+0000 (oldest deadline 2024-08-31T04:40:37.941448+0000) 2024-08-31T04:40:53.250 INFO:journalctl@ceph.osd.10.smithi133.stdout:Aug 31 04:40:52 smithi133 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-10[46762]: 2024-08-31T04:40:52.958+0000 7f873f3e9640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.50:6822 osd.6 since back 2024-08-31T04:40:20.842699+0000 front 2024-08-31T04:40:20.842593+0000 (oldest deadline 2024-08-31T04:40:43.742552+0000) 2024-08-31T04:40:53.496 INFO:journalctl@ceph.osd.11.smithi177.stdout:Aug 31 04:40:53 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-11[46864]: 2024-08-31T04:40:53.118+0000 7fd602bf1640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-08-31T04:39:30.036711+0000 front 2024-08-31T04:39:30.036747+0000 (oldest deadline 2024-08-31T04:39:55.936674+0000) 2024-08-31T04:40:53.496 INFO:journalctl@ceph.osd.11.smithi177.stdout:Aug 31 04:40:53 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-11[46864]: 2024-08-31T04:40:53.118+0000 7fd602bf1640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.133:6804 osd.1 since back 2024-08-31T04:39:41.138475+0000 front 2024-08-31T04:39:41.138491+0000 (oldest deadline 2024-08-31T04:40:04.038356+0000) 2024-08-31T04:40:53.496 INFO:journalctl@ceph.osd.11.smithi177.stdout:Aug 31 04:40:53 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-11[46864]: 2024-08-31T04:40:53.118+0000 7fd602bf1640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-08-31T04:39:46.939525+0000 front 2024-08-31T04:39:46.939251+0000 (oldest deadline 2024-08-31T04:40:12.239391+0000) 2024-08-31T04:40:53.496 INFO:journalctl@ceph.osd.11.smithi177.stdout:Aug 31 04:40:53 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-11[46864]: 2024-08-31T04:40:53.118+0000 7fd602bf1640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.133:6812 osd.4 since back 2024-08-31T04:40:05.141613+0000 front 2024-08-31T04:40:05.141382+0000 (oldest deadline 2024-08-31T04:40:32.741898+0000) 2024-08-31T04:40:53.497 INFO:journalctl@ceph.osd.11.smithi177.stdout:Aug 31 04:40:53 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-11[46864]: 2024-08-31T04:40:53.118+0000 7fd602bf1640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.177:6812 osd.5 since back 2024-08-31T04:40:12.742231+0000 front 2024-08-31T04:40:12.742332+0000 (oldest deadline 2024-08-31T04:40:36.842325+0000) 2024-08-31T04:40:53.497 INFO:journalctl@ceph.osd.11.smithi177.stdout:Aug 31 04:40:53 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-11[46864]: 2024-08-31T04:40:53.118+0000 7fd602bf1640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.50:6822 osd.6 since back 2024-08-31T04:40:19.743250+0000 front 2024-08-31T04:40:19.743271+0000 (oldest deadline 2024-08-31T04:40:43.843231+0000) 2024-08-31T04:40:53.497 INFO:journalctl@ceph.osd.11.smithi177.stdout:Aug 31 04:40:53 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-11[46864]: 2024-08-31T04:40:53.118+0000 7fd602bf1640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.133:6820 osd.7 since back 2024-08-31T04:40:27.344310+0000 front 2024-08-31T04:40:27.344398+0000 (oldest deadline 2024-08-31T04:40:52.644299+0000) 2024-08-31T04:40:54.293 INFO:journalctl@ceph.osd.10.smithi133.stdout:Aug 31 04:40:53 smithi133 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-10[46762]: 2024-08-31T04:40:53.941+0000 7f873f3e9640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-08-31T04:39:32.936397+0000 front 2024-08-31T04:39:32.936196+0000 (oldest deadline 2024-08-31T04:39:55.836336+0000) 2024-08-31T04:40:54.293 INFO:journalctl@ceph.osd.10.smithi133.stdout:Aug 31 04:40:53 smithi133 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-10[46762]: 2024-08-31T04:40:53.941+0000 7f873f3e9640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.133:6804 osd.1 since back 2024-08-31T04:39:40.537248+0000 front 2024-08-31T04:39:40.537370+0000 (oldest deadline 2024-08-31T04:40:06.437470+0000) 2024-08-31T04:40:54.293 INFO:journalctl@ceph.osd.10.smithi133.stdout:Aug 31 04:40:53 smithi133 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-10[46762]: 2024-08-31T04:40:53.941+0000 7f873f3e9640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-08-31T04:39:50.438807+0000 front 2024-08-31T04:39:50.438655+0000 (oldest deadline 2024-08-31T04:40:11.538621+0000) 2024-08-31T04:40:54.293 INFO:journalctl@ceph.osd.10.smithi133.stdout:Aug 31 04:40:53 smithi133 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-10[46762]: 2024-08-31T04:40:53.941+0000 7f873f3e9640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2024-08-31T04:39:55.639898+0000 front 2024-08-31T04:39:55.639930+0000 (oldest deadline 2024-08-31T04:40:20.939655+0000) 2024-08-31T04:40:54.293 INFO:journalctl@ceph.osd.10.smithi133.stdout:Aug 31 04:40:53 smithi133 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-10[46762]: 2024-08-31T04:40:53.941+0000 7f873f3e9640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.133:6812 osd.4 since back 2024-08-31T04:40:05.040435+0000 front 2024-08-31T04:40:05.040466+0000 (oldest deadline 2024-08-31T04:40:28.540479+0000) 2024-08-31T04:40:54.293 INFO:journalctl@ceph.osd.10.smithi133.stdout:Aug 31 04:40:53 smithi133 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-10[46762]: 2024-08-31T04:40:53.941+0000 7f873f3e9640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.177:6812 osd.5 since back 2024-08-31T04:40:12.041463+0000 front 2024-08-31T04:40:12.041501+0000 (oldest deadline 2024-08-31T04:40:37.941448+0000) 2024-08-31T04:40:54.293 INFO:journalctl@ceph.osd.10.smithi133.stdout:Aug 31 04:40:53 smithi133 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-10[46762]: 2024-08-31T04:40:53.941+0000 7f873f3e9640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.50:6822 osd.6 since back 2024-08-31T04:40:20.842699+0000 front 2024-08-31T04:40:20.842593+0000 (oldest deadline 2024-08-31T04:40:43.742552+0000) 2024-08-31T04:40:54.496 INFO:journalctl@ceph.osd.11.smithi177.stdout:Aug 31 04:40:54 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-11[46864]: 2024-08-31T04:40:54.166+0000 7fd602bf1640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-08-31T04:39:30.036711+0000 front 2024-08-31T04:39:30.036747+0000 (oldest deadline 2024-08-31T04:39:55.936674+0000) 2024-08-31T04:40:54.496 INFO:journalctl@ceph.osd.11.smithi177.stdout:Aug 31 04:40:54 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-11[46864]: 2024-08-31T04:40:54.166+0000 7fd602bf1640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.133:6804 osd.1 since back 2024-08-31T04:39:41.138475+0000 front 2024-08-31T04:39:41.138491+0000 (oldest deadline 2024-08-31T04:40:04.038356+0000) 2024-08-31T04:40:54.496 INFO:journalctl@ceph.osd.11.smithi177.stdout:Aug 31 04:40:54 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-11[46864]: 2024-08-31T04:40:54.166+0000 7fd602bf1640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-08-31T04:39:46.939525+0000 front 2024-08-31T04:39:46.939251+0000 (oldest deadline 2024-08-31T04:40:12.239391+0000) 2024-08-31T04:40:54.496 INFO:journalctl@ceph.osd.11.smithi177.stdout:Aug 31 04:40:54 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-11[46864]: 2024-08-31T04:40:54.166+0000 7fd602bf1640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.133:6812 osd.4 since back 2024-08-31T04:40:05.141613+0000 front 2024-08-31T04:40:05.141382+0000 (oldest deadline 2024-08-31T04:40:32.741898+0000) 2024-08-31T04:40:54.496 INFO:journalctl@ceph.osd.11.smithi177.stdout:Aug 31 04:40:54 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-11[46864]: 2024-08-31T04:40:54.166+0000 7fd602bf1640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.177:6812 osd.5 since back 2024-08-31T04:40:12.742231+0000 front 2024-08-31T04:40:12.742332+0000 (oldest deadline 2024-08-31T04:40:36.842325+0000) 2024-08-31T04:40:54.496 INFO:journalctl@ceph.osd.11.smithi177.stdout:Aug 31 04:40:54 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-11[46864]: 2024-08-31T04:40:54.166+0000 7fd602bf1640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.50:6822 osd.6 since back 2024-08-31T04:40:19.743250+0000 front 2024-08-31T04:40:19.743271+0000 (oldest deadline 2024-08-31T04:40:43.843231+0000) 2024-08-31T04:40:54.496 INFO:journalctl@ceph.osd.11.smithi177.stdout:Aug 31 04:40:54 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-11[46864]: 2024-08-31T04:40:54.166+0000 7fd602bf1640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.133:6820 osd.7 since back 2024-08-31T04:40:27.344310+0000 front 2024-08-31T04:40:27.344398+0000 (oldest deadline 2024-08-31T04:40:52.644299+0000) 2024-08-31T04:40:55.293 INFO:journalctl@ceph.osd.10.smithi133.stdout:Aug 31 04:40:54 smithi133 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-10[46762]: 2024-08-31T04:40:54.938+0000 7f873f3e9640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-08-31T04:39:32.936397+0000 front 2024-08-31T04:39:32.936196+0000 (oldest deadline 2024-08-31T04:39:55.836336+0000) 2024-08-31T04:40:55.293 INFO:journalctl@ceph.osd.10.smithi133.stdout:Aug 31 04:40:54 smithi133 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-10[46762]: 2024-08-31T04:40:54.938+0000 7f873f3e9640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.133:6804 osd.1 since back 2024-08-31T04:39:40.537248+0000 front 2024-08-31T04:39:40.537370+0000 (oldest deadline 2024-08-31T04:40:06.437470+0000) 2024-08-31T04:40:55.293 INFO:journalctl@ceph.osd.10.smithi133.stdout:Aug 31 04:40:54 smithi133 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-10[46762]: 2024-08-31T04:40:54.938+0000 7f873f3e9640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-08-31T04:39:50.438807+0000 front 2024-08-31T04:39:50.438655+0000 (oldest deadline 2024-08-31T04:40:11.538621+0000) 2024-08-31T04:40:55.293 INFO:journalctl@ceph.osd.10.smithi133.stdout:Aug 31 04:40:54 smithi133 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-10[46762]: 2024-08-31T04:40:54.938+0000 7f873f3e9640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.50:6814 osd.3 since back 2024-08-31T04:39:55.639898+0000 front 2024-08-31T04:39:55.639930+0000 (oldest deadline 2024-08-31T04:40:20.939655+0000) 2024-08-31T04:40:55.293 INFO:journalctl@ceph.osd.10.smithi133.stdout:Aug 31 04:40:54 smithi133 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-10[46762]: 2024-08-31T04:40:54.938+0000 7f873f3e9640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.133:6812 osd.4 since back 2024-08-31T04:40:05.040435+0000 front 2024-08-31T04:40:05.040466+0000 (oldest deadline 2024-08-31T04:40:28.540479+0000) 2024-08-31T04:40:55.294 INFO:journalctl@ceph.osd.10.smithi133.stdout:Aug 31 04:40:54 smithi133 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-10[46762]: 2024-08-31T04:40:54.938+0000 7f873f3e9640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.177:6812 osd.5 since back 2024-08-31T04:40:12.041463+0000 front 2024-08-31T04:40:12.041501+0000 (oldest deadline 2024-08-31T04:40:37.941448+0000) 2024-08-31T04:40:55.294 INFO:journalctl@ceph.osd.10.smithi133.stdout:Aug 31 04:40:54 smithi133 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-10[46762]: 2024-08-31T04:40:54.938+0000 7f873f3e9640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.50:6822 osd.6 since back 2024-08-31T04:40:20.842699+0000 front 2024-08-31T04:40:20.842593+0000 (oldest deadline 2024-08-31T04:40:43.742552+0000) 2024-08-31T04:40:55.496 INFO:journalctl@ceph.osd.11.smithi177.stdout:Aug 31 04:40:55 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-11[46864]: 2024-08-31T04:40:55.116+0000 7fd602bf1640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-08-31T04:39:30.036711+0000 front 2024-08-31T04:39:30.036747+0000 (oldest deadline 2024-08-31T04:39:55.936674+0000) 2024-08-31T04:40:55.496 INFO:journalctl@ceph.osd.11.smithi177.stdout:Aug 31 04:40:55 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-11[46864]: 2024-08-31T04:40:55.116+0000 7fd602bf1640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.133:6804 osd.1 since back 2024-08-31T04:39:41.138475+0000 front 2024-08-31T04:39:41.138491+0000 (oldest deadline 2024-08-31T04:40:04.038356+0000) 2024-08-31T04:40:55.496 INFO:journalctl@ceph.osd.11.smithi177.stdout:Aug 31 04:40:55 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-11[46864]: 2024-08-31T04:40:55.116+0000 7fd602bf1640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-08-31T04:39:46.939525+0000 front 2024-08-31T04:39:46.939251+0000 (oldest deadline 2024-08-31T04:40:12.239391+0000) 2024-08-31T04:40:55.496 INFO:journalctl@ceph.osd.11.smithi177.stdout:Aug 31 04:40:55 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-11[46864]: 2024-08-31T04:40:55.116+0000 7fd602bf1640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.133:6812 osd.4 since back 2024-08-31T04:40:05.141613+0000 front 2024-08-31T04:40:05.141382+0000 (oldest deadline 2024-08-31T04:40:32.741898+0000) 2024-08-31T04:40:55.496 INFO:journalctl@ceph.osd.11.smithi177.stdout:Aug 31 04:40:55 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-11[46864]: 2024-08-31T04:40:55.116+0000 7fd602bf1640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.177:6812 osd.5 since back 2024-08-31T04:40:12.742231+0000 front 2024-08-31T04:40:12.742332+0000 (oldest deadline 2024-08-31T04:40:36.842325+0000) 2024-08-31T04:40:55.497 INFO:journalctl@ceph.osd.11.smithi177.stdout:Aug 31 04:40:55 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-11[46864]: 2024-08-31T04:40:55.116+0000 7fd602bf1640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.50:6822 osd.6 since back 2024-08-31T04:40:19.743250+0000 front 2024-08-31T04:40:19.743271+0000 (oldest deadline 2024-08-31T04:40:43.843231+0000) 2024-08-31T04:40:55.497 INFO:journalctl@ceph.osd.11.smithi177.stdout:Aug 31 04:40:55 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-11[46864]: 2024-08-31T04:40:55.116+0000 7fd602bf1640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.133:6820 osd.7 since back 2024-08-31T04:40:27.344310+0000 front 2024-08-31T04:40:27.344398+0000 (oldest deadline 2024-08-31T04:40:52.644299+0000) 2024-08-31T04:40:56.115 INFO:journalctl@ceph.osd.10.smithi133.stdout:Aug 31 04:40:55 smithi133 podman[58744]: 2024-08-31 04:40:55.83349376 +0000 UTC m=+5.476490893 container died edd9536e8d45a9884c6b5f5a0216716c72bcc6ec79c8e9e3451ee6d0d6ddfc8e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-10, GIT_CLEAN=True, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , io.buildah.version=1.37.1, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-08-31T04:40:56.448 INFO:journalctl@ceph.osd.10.smithi133.stdout:Aug 31 04:40:56 smithi133 podman[58744]: 2024-08-31 04:40:56.205028189 +0000 UTC m=+5.848025321 container cleanup edd9536e8d45a9884c6b5f5a0216716c72bcc6ec79c8e9e3451ee6d0d6ddfc8e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-10, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, io.buildah.version=1.37.1, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD) 2024-08-31T04:40:56.449 INFO:journalctl@ceph.osd.10.smithi133.stdout:Aug 31 04:40:56 smithi133 bash[58744]: ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-10 2024-08-31T04:40:56.496 INFO:journalctl@ceph.osd.11.smithi177.stdout:Aug 31 04:40:56 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-11[46864]: 2024-08-31T04:40:56.073+0000 7fd602bf1640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-08-31T04:39:30.036711+0000 front 2024-08-31T04:39:30.036747+0000 (oldest deadline 2024-08-31T04:39:55.936674+0000) 2024-08-31T04:40:56.496 INFO:journalctl@ceph.osd.11.smithi177.stdout:Aug 31 04:40:56 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-11[46864]: 2024-08-31T04:40:56.073+0000 7fd602bf1640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.133:6804 osd.1 since back 2024-08-31T04:39:41.138475+0000 front 2024-08-31T04:39:41.138491+0000 (oldest deadline 2024-08-31T04:40:04.038356+0000) 2024-08-31T04:40:56.496 INFO:journalctl@ceph.osd.11.smithi177.stdout:Aug 31 04:40:56 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-11[46864]: 2024-08-31T04:40:56.073+0000 7fd602bf1640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-08-31T04:39:46.939525+0000 front 2024-08-31T04:39:46.939251+0000 (oldest deadline 2024-08-31T04:40:12.239391+0000) 2024-08-31T04:40:56.496 INFO:journalctl@ceph.osd.11.smithi177.stdout:Aug 31 04:40:56 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-11[46864]: 2024-08-31T04:40:56.073+0000 7fd602bf1640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.133:6812 osd.4 since back 2024-08-31T04:40:05.141613+0000 front 2024-08-31T04:40:05.141382+0000 (oldest deadline 2024-08-31T04:40:32.741898+0000) 2024-08-31T04:40:56.496 INFO:journalctl@ceph.osd.11.smithi177.stdout:Aug 31 04:40:56 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-11[46864]: 2024-08-31T04:40:56.073+0000 7fd602bf1640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.177:6812 osd.5 since back 2024-08-31T04:40:12.742231+0000 front 2024-08-31T04:40:12.742332+0000 (oldest deadline 2024-08-31T04:40:36.842325+0000) 2024-08-31T04:40:56.497 INFO:journalctl@ceph.osd.11.smithi177.stdout:Aug 31 04:40:56 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-11[46864]: 2024-08-31T04:40:56.073+0000 7fd602bf1640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.50:6822 osd.6 since back 2024-08-31T04:40:19.743250+0000 front 2024-08-31T04:40:19.743271+0000 (oldest deadline 2024-08-31T04:40:43.843231+0000) 2024-08-31T04:40:56.497 INFO:journalctl@ceph.osd.11.smithi177.stdout:Aug 31 04:40:56 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-11[46864]: 2024-08-31T04:40:56.073+0000 7fd602bf1640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.133:6820 osd.7 since back 2024-08-31T04:40:27.344310+0000 front 2024-08-31T04:40:27.344398+0000 (oldest deadline 2024-08-31T04:40:52.644299+0000) 2024-08-31T04:40:56.769 INFO:journalctl@ceph.osd.10.smithi133.stdout:Aug 31 04:40:56 smithi133 podman[58759]: 2024-08-31 04:40:56.448013456 +0000 UTC m=+0.613314283 container remove edd9536e8d45a9884c6b5f5a0216716c72bcc6ec79c8e9e3451ee6d0d6ddfc8e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-10, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, io.buildah.version=1.37.1, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2) 2024-08-31T04:40:57.043 INFO:journalctl@ceph.osd.10.smithi133.stdout:Aug 31 04:40:56 smithi133 podman[58849]: 2024-08-31 04:40:56.671752797 +0000 UTC m=+0.015680057 image pull 79f4cde5e36911a5dca995eeb98098c2c8aae81dd52a088ef2c867bc3363bad0 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61 2024-08-31T04:40:57.043 INFO:journalctl@ceph.osd.10.smithi133.stdout:Aug 31 04:40:56 smithi133 podman[58849]: 2024-08-31 04:40:56.77360599 +0000 UTC m=+0.117533286 container create fea4332e7d986f22ff5947806d46fd25f223a4ea1dbb2d844f75fadbc62ddac1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-10-deactivate, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_BRANCH=HEAD, io.buildah.version=1.37.1, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.license=GPLv2) 2024-08-31T04:40:57.043 INFO:journalctl@ceph.osd.10.smithi133.stdout:Aug 31 04:40:57 smithi133 podman[58849]: 2024-08-31 04:40:57.000962115 +0000 UTC m=+0.344889369 container init fea4332e7d986f22ff5947806d46fd25f223a4ea1dbb2d844f75fadbc62ddac1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-10-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, ceph=True, io.buildah.version=1.37.1, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux ) 2024-08-31T04:40:57.043 INFO:journalctl@ceph.osd.10.smithi133.stdout:Aug 31 04:40:57 smithi133 podman[58849]: 2024-08-31 04:40:57.004446903 +0000 UTC m=+0.348374154 container start fea4332e7d986f22ff5947806d46fd25f223a4ea1dbb2d844f75fadbc62ddac1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-10-deactivate, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, io.buildah.version=1.37.1, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , ceph=True, GIT_CLEAN=True, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611) 2024-08-31T04:40:57.496 INFO:journalctl@ceph.osd.11.smithi177.stdout:Aug 31 04:40:57 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-11[46864]: 2024-08-31T04:40:57.036+0000 7fd602bf1640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-08-31T04:39:30.036711+0000 front 2024-08-31T04:39:30.036747+0000 (oldest deadline 2024-08-31T04:39:55.936674+0000) 2024-08-31T04:40:57.496 INFO:journalctl@ceph.osd.11.smithi177.stdout:Aug 31 04:40:57 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-11[46864]: 2024-08-31T04:40:57.036+0000 7fd602bf1640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.133:6804 osd.1 since back 2024-08-31T04:39:41.138475+0000 front 2024-08-31T04:39:41.138491+0000 (oldest deadline 2024-08-31T04:40:04.038356+0000) 2024-08-31T04:40:57.496 INFO:journalctl@ceph.osd.11.smithi177.stdout:Aug 31 04:40:57 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-11[46864]: 2024-08-31T04:40:57.036+0000 7fd602bf1640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-08-31T04:39:46.939525+0000 front 2024-08-31T04:39:46.939251+0000 (oldest deadline 2024-08-31T04:40:12.239391+0000) 2024-08-31T04:40:57.496 INFO:journalctl@ceph.osd.11.smithi177.stdout:Aug 31 04:40:57 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-11[46864]: 2024-08-31T04:40:57.036+0000 7fd602bf1640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.133:6812 osd.4 since back 2024-08-31T04:40:05.141613+0000 front 2024-08-31T04:40:05.141382+0000 (oldest deadline 2024-08-31T04:40:32.741898+0000) 2024-08-31T04:40:57.496 INFO:journalctl@ceph.osd.11.smithi177.stdout:Aug 31 04:40:57 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-11[46864]: 2024-08-31T04:40:57.036+0000 7fd602bf1640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.177:6812 osd.5 since back 2024-08-31T04:40:12.742231+0000 front 2024-08-31T04:40:12.742332+0000 (oldest deadline 2024-08-31T04:40:36.842325+0000) 2024-08-31T04:40:57.496 INFO:journalctl@ceph.osd.11.smithi177.stdout:Aug 31 04:40:57 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-11[46864]: 2024-08-31T04:40:57.036+0000 7fd602bf1640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.50:6822 osd.6 since back 2024-08-31T04:40:19.743250+0000 front 2024-08-31T04:40:19.743271+0000 (oldest deadline 2024-08-31T04:40:43.843231+0000) 2024-08-31T04:40:57.497 INFO:journalctl@ceph.osd.11.smithi177.stdout:Aug 31 04:40:57 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-11[46864]: 2024-08-31T04:40:57.036+0000 7fd602bf1640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.133:6820 osd.7 since back 2024-08-31T04:40:27.344310+0000 front 2024-08-31T04:40:27.344398+0000 (oldest deadline 2024-08-31T04:40:52.644299+0000) 2024-08-31T04:40:57.543 INFO:journalctl@ceph.osd.10.smithi133.stdout:Aug 31 04:40:57 smithi133 podman[58849]: 2024-08-31 04:40:57.062879066 +0000 UTC m=+0.406806329 container attach fea4332e7d986f22ff5947806d46fd25f223a4ea1dbb2d844f75fadbc62ddac1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-10-deactivate, ceph=True, org.label-schema.build-date=20240731, io.buildah.version=1.37.1, org.label-schema.license=GPLv2, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_CLEAN=True) 2024-08-31T04:40:57.543 INFO:journalctl@ceph.osd.10.smithi133.stdout:Aug 31 04:40:57 smithi133 podman[58849]: 2024-08-31 04:40:57.194644109 +0000 UTC m=+0.538571364 container died fea4332e7d986f22ff5947806d46fd25f223a4ea1dbb2d844f75fadbc62ddac1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-10-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_CLEAN=True, ceph=True, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, io.buildah.version=1.37.1, org.label-schema.schema-version=1.0) 2024-08-31T04:40:57.837 INFO:journalctl@ceph.osd.10.smithi133.stdout:Aug 31 04:40:57 smithi133 podman[58872]: 2024-08-31 04:40:57.820879618 +0000 UTC m=+0.620056150 container remove fea4332e7d986f22ff5947806d46fd25f223a4ea1dbb2d844f75fadbc62ddac1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-10-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, ceph=True, GIT_BRANCH=HEAD, io.buildah.version=1.37.1, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.build-date=20240731) 2024-08-31T04:40:57.844 DEBUG:teuthology.orchestra.run.smithi133:> sudo pkill -f 'journalctl -f -n 0 -u ceph-058d9fc6-674f-11ef-bcd4-c7b262605968@osd.10.service' 2024-08-31T04:40:57.888 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-31T04:40:57.889 INFO:tasks.cephadm.osd.10:Stopped osd.10 2024-08-31T04:40:57.889 INFO:tasks.cephadm.osd.11:Stopping osd.11... 2024-08-31T04:40:57.889 DEBUG:teuthology.orchestra.run.smithi177:> sudo systemctl stop ceph-058d9fc6-674f-11ef-bcd4-c7b262605968@osd.11 2024-08-31T04:40:58.186 INFO:journalctl@ceph.osd.11.smithi177.stdout:Aug 31 04:40:57 smithi177 systemd[1]: Stopping Ceph osd.11 for 058d9fc6-674f-11ef-bcd4-c7b262605968... 2024-08-31T04:40:58.186 INFO:journalctl@ceph.osd.11.smithi177.stdout:Aug 31 04:40:58 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-11[46864]: 2024-08-31T04:40:58.078+0000 7fd602bf1640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-08-31T04:39:30.036711+0000 front 2024-08-31T04:39:30.036747+0000 (oldest deadline 2024-08-31T04:39:55.936674+0000) 2024-08-31T04:40:58.186 INFO:journalctl@ceph.osd.11.smithi177.stdout:Aug 31 04:40:58 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-11[46864]: 2024-08-31T04:40:58.078+0000 7fd602bf1640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.133:6804 osd.1 since back 2024-08-31T04:39:41.138475+0000 front 2024-08-31T04:39:41.138491+0000 (oldest deadline 2024-08-31T04:40:04.038356+0000) 2024-08-31T04:40:58.186 INFO:journalctl@ceph.osd.11.smithi177.stdout:Aug 31 04:40:58 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-11[46864]: 2024-08-31T04:40:58.078+0000 7fd602bf1640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-08-31T04:39:46.939525+0000 front 2024-08-31T04:39:46.939251+0000 (oldest deadline 2024-08-31T04:40:12.239391+0000) 2024-08-31T04:40:58.186 INFO:journalctl@ceph.osd.11.smithi177.stdout:Aug 31 04:40:58 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-11[46864]: 2024-08-31T04:40:58.078+0000 7fd602bf1640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.133:6812 osd.4 since back 2024-08-31T04:40:05.141613+0000 front 2024-08-31T04:40:05.141382+0000 (oldest deadline 2024-08-31T04:40:32.741898+0000) 2024-08-31T04:40:58.186 INFO:journalctl@ceph.osd.11.smithi177.stdout:Aug 31 04:40:58 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-11[46864]: 2024-08-31T04:40:58.078+0000 7fd602bf1640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.177:6812 osd.5 since back 2024-08-31T04:40:12.742231+0000 front 2024-08-31T04:40:12.742332+0000 (oldest deadline 2024-08-31T04:40:36.842325+0000) 2024-08-31T04:40:58.186 INFO:journalctl@ceph.osd.11.smithi177.stdout:Aug 31 04:40:58 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-11[46864]: 2024-08-31T04:40:58.078+0000 7fd602bf1640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.50:6822 osd.6 since back 2024-08-31T04:40:19.743250+0000 front 2024-08-31T04:40:19.743271+0000 (oldest deadline 2024-08-31T04:40:43.843231+0000) 2024-08-31T04:40:58.187 INFO:journalctl@ceph.osd.11.smithi177.stdout:Aug 31 04:40:58 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-11[46864]: 2024-08-31T04:40:58.078+0000 7fd602bf1640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.133:6820 osd.7 since back 2024-08-31T04:40:27.344310+0000 front 2024-08-31T04:40:27.344398+0000 (oldest deadline 2024-08-31T04:40:52.644299+0000) 2024-08-31T04:40:58.187 INFO:journalctl@ceph.osd.11.smithi177.stdout:Aug 31 04:40:58 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-11[46864]: 2024-08-31T04:40:58.184+0000 7fd60a60e640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.11 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-31T04:40:58.187 INFO:journalctl@ceph.osd.11.smithi177.stdout:Aug 31 04:40:58 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-11[46864]: 2024-08-31T04:40:58.184+0000 7fd60a60e640 -1 osd.11 83 *** Got signal Terminated *** 2024-08-31T04:40:58.187 INFO:journalctl@ceph.osd.11.smithi177.stdout:Aug 31 04:40:58 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-11[46864]: 2024-08-31T04:40:58.184+0000 7fd60a60e640 -1 osd.11 83 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-08-31T04:40:59.496 INFO:journalctl@ceph.osd.11.smithi177.stdout:Aug 31 04:40:59 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-11[46864]: 2024-08-31T04:40:59.101+0000 7fd602bf1640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-08-31T04:39:30.036711+0000 front 2024-08-31T04:39:30.036747+0000 (oldest deadline 2024-08-31T04:39:55.936674+0000) 2024-08-31T04:40:59.496 INFO:journalctl@ceph.osd.11.smithi177.stdout:Aug 31 04:40:59 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-11[46864]: 2024-08-31T04:40:59.101+0000 7fd602bf1640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.133:6804 osd.1 since back 2024-08-31T04:39:41.138475+0000 front 2024-08-31T04:39:41.138491+0000 (oldest deadline 2024-08-31T04:40:04.038356+0000) 2024-08-31T04:40:59.497 INFO:journalctl@ceph.osd.11.smithi177.stdout:Aug 31 04:40:59 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-11[46864]: 2024-08-31T04:40:59.101+0000 7fd602bf1640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-08-31T04:39:46.939525+0000 front 2024-08-31T04:39:46.939251+0000 (oldest deadline 2024-08-31T04:40:12.239391+0000) 2024-08-31T04:40:59.497 INFO:journalctl@ceph.osd.11.smithi177.stdout:Aug 31 04:40:59 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-11[46864]: 2024-08-31T04:40:59.101+0000 7fd602bf1640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.133:6812 osd.4 since back 2024-08-31T04:40:05.141613+0000 front 2024-08-31T04:40:05.141382+0000 (oldest deadline 2024-08-31T04:40:32.741898+0000) 2024-08-31T04:40:59.497 INFO:journalctl@ceph.osd.11.smithi177.stdout:Aug 31 04:40:59 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-11[46864]: 2024-08-31T04:40:59.101+0000 7fd602bf1640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.177:6812 osd.5 since back 2024-08-31T04:40:12.742231+0000 front 2024-08-31T04:40:12.742332+0000 (oldest deadline 2024-08-31T04:40:36.842325+0000) 2024-08-31T04:40:59.497 INFO:journalctl@ceph.osd.11.smithi177.stdout:Aug 31 04:40:59 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-11[46864]: 2024-08-31T04:40:59.101+0000 7fd602bf1640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.50:6822 osd.6 since back 2024-08-31T04:40:19.743250+0000 front 2024-08-31T04:40:19.743271+0000 (oldest deadline 2024-08-31T04:40:43.843231+0000) 2024-08-31T04:40:59.497 INFO:journalctl@ceph.osd.11.smithi177.stdout:Aug 31 04:40:59 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-11[46864]: 2024-08-31T04:40:59.101+0000 7fd602bf1640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.133:6820 osd.7 since back 2024-08-31T04:40:27.344310+0000 front 2024-08-31T04:40:27.344398+0000 (oldest deadline 2024-08-31T04:40:52.644299+0000) 2024-08-31T04:41:00.496 INFO:journalctl@ceph.osd.11.smithi177.stdout:Aug 31 04:41:00 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-11[46864]: 2024-08-31T04:41:00.121+0000 7fd602bf1640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-08-31T04:39:30.036711+0000 front 2024-08-31T04:39:30.036747+0000 (oldest deadline 2024-08-31T04:39:55.936674+0000) 2024-08-31T04:41:00.496 INFO:journalctl@ceph.osd.11.smithi177.stdout:Aug 31 04:41:00 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-11[46864]: 2024-08-31T04:41:00.121+0000 7fd602bf1640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.133:6804 osd.1 since back 2024-08-31T04:39:41.138475+0000 front 2024-08-31T04:39:41.138491+0000 (oldest deadline 2024-08-31T04:40:04.038356+0000) 2024-08-31T04:41:00.496 INFO:journalctl@ceph.osd.11.smithi177.stdout:Aug 31 04:41:00 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-11[46864]: 2024-08-31T04:41:00.121+0000 7fd602bf1640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-08-31T04:39:46.939525+0000 front 2024-08-31T04:39:46.939251+0000 (oldest deadline 2024-08-31T04:40:12.239391+0000) 2024-08-31T04:41:00.496 INFO:journalctl@ceph.osd.11.smithi177.stdout:Aug 31 04:41:00 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-11[46864]: 2024-08-31T04:41:00.121+0000 7fd602bf1640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.133:6812 osd.4 since back 2024-08-31T04:40:05.141613+0000 front 2024-08-31T04:40:05.141382+0000 (oldest deadline 2024-08-31T04:40:32.741898+0000) 2024-08-31T04:41:00.496 INFO:journalctl@ceph.osd.11.smithi177.stdout:Aug 31 04:41:00 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-11[46864]: 2024-08-31T04:41:00.121+0000 7fd602bf1640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.177:6812 osd.5 since back 2024-08-31T04:40:12.742231+0000 front 2024-08-31T04:40:12.742332+0000 (oldest deadline 2024-08-31T04:40:36.842325+0000) 2024-08-31T04:41:00.497 INFO:journalctl@ceph.osd.11.smithi177.stdout:Aug 31 04:41:00 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-11[46864]: 2024-08-31T04:41:00.121+0000 7fd602bf1640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.50:6822 osd.6 since back 2024-08-31T04:40:19.743250+0000 front 2024-08-31T04:40:19.743271+0000 (oldest deadline 2024-08-31T04:40:43.843231+0000) 2024-08-31T04:41:00.497 INFO:journalctl@ceph.osd.11.smithi177.stdout:Aug 31 04:41:00 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-11[46864]: 2024-08-31T04:41:00.121+0000 7fd602bf1640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.133:6820 osd.7 since back 2024-08-31T04:40:27.344310+0000 front 2024-08-31T04:40:27.344398+0000 (oldest deadline 2024-08-31T04:40:52.644299+0000) 2024-08-31T04:41:00.497 INFO:journalctl@ceph.osd.11.smithi177.stdout:Aug 31 04:41:00 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-11[46864]: 2024-08-31T04:41:00.121+0000 7fd602bf1640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.177:6820 osd.8 since back 2024-08-31T04:40:36.546323+0000 front 2024-08-31T04:40:36.546295+0000 (oldest deadline 2024-08-31T04:40:59.947228+0000) 2024-08-31T04:41:01.452 INFO:journalctl@ceph.osd.11.smithi177.stdout:Aug 31 04:41:01 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-11[46864]: 2024-08-31T04:41:01.079+0000 7fd602bf1640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-08-31T04:39:30.036711+0000 front 2024-08-31T04:39:30.036747+0000 (oldest deadline 2024-08-31T04:39:55.936674+0000) 2024-08-31T04:41:01.452 INFO:journalctl@ceph.osd.11.smithi177.stdout:Aug 31 04:41:01 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-11[46864]: 2024-08-31T04:41:01.079+0000 7fd602bf1640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.133:6804 osd.1 since back 2024-08-31T04:39:41.138475+0000 front 2024-08-31T04:39:41.138491+0000 (oldest deadline 2024-08-31T04:40:04.038356+0000) 2024-08-31T04:41:01.452 INFO:journalctl@ceph.osd.11.smithi177.stdout:Aug 31 04:41:01 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-11[46864]: 2024-08-31T04:41:01.079+0000 7fd602bf1640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-08-31T04:39:46.939525+0000 front 2024-08-31T04:39:46.939251+0000 (oldest deadline 2024-08-31T04:40:12.239391+0000) 2024-08-31T04:41:01.453 INFO:journalctl@ceph.osd.11.smithi177.stdout:Aug 31 04:41:01 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-11[46864]: 2024-08-31T04:41:01.079+0000 7fd602bf1640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.133:6812 osd.4 since back 2024-08-31T04:40:05.141613+0000 front 2024-08-31T04:40:05.141382+0000 (oldest deadline 2024-08-31T04:40:32.741898+0000) 2024-08-31T04:41:01.453 INFO:journalctl@ceph.osd.11.smithi177.stdout:Aug 31 04:41:01 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-11[46864]: 2024-08-31T04:41:01.079+0000 7fd602bf1640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.177:6812 osd.5 since back 2024-08-31T04:40:12.742231+0000 front 2024-08-31T04:40:12.742332+0000 (oldest deadline 2024-08-31T04:40:36.842325+0000) 2024-08-31T04:41:01.453 INFO:journalctl@ceph.osd.11.smithi177.stdout:Aug 31 04:41:01 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-11[46864]: 2024-08-31T04:41:01.079+0000 7fd602bf1640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.50:6822 osd.6 since back 2024-08-31T04:40:19.743250+0000 front 2024-08-31T04:40:19.743271+0000 (oldest deadline 2024-08-31T04:40:43.843231+0000) 2024-08-31T04:41:01.453 INFO:journalctl@ceph.osd.11.smithi177.stdout:Aug 31 04:41:01 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-11[46864]: 2024-08-31T04:41:01.079+0000 7fd602bf1640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.133:6820 osd.7 since back 2024-08-31T04:40:27.344310+0000 front 2024-08-31T04:40:27.344398+0000 (oldest deadline 2024-08-31T04:40:52.644299+0000) 2024-08-31T04:41:01.453 INFO:journalctl@ceph.osd.11.smithi177.stdout:Aug 31 04:41:01 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-11[46864]: 2024-08-31T04:41:01.079+0000 7fd602bf1640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.177:6820 osd.8 since back 2024-08-31T04:40:36.546323+0000 front 2024-08-31T04:40:36.546295+0000 (oldest deadline 2024-08-31T04:40:59.947228+0000) 2024-08-31T04:41:02.496 INFO:journalctl@ceph.osd.11.smithi177.stdout:Aug 31 04:41:02 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-11[46864]: 2024-08-31T04:41:02.124+0000 7fd602bf1640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-08-31T04:39:30.036711+0000 front 2024-08-31T04:39:30.036747+0000 (oldest deadline 2024-08-31T04:39:55.936674+0000) 2024-08-31T04:41:02.496 INFO:journalctl@ceph.osd.11.smithi177.stdout:Aug 31 04:41:02 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-11[46864]: 2024-08-31T04:41:02.124+0000 7fd602bf1640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.133:6804 osd.1 since back 2024-08-31T04:39:41.138475+0000 front 2024-08-31T04:39:41.138491+0000 (oldest deadline 2024-08-31T04:40:04.038356+0000) 2024-08-31T04:41:02.496 INFO:journalctl@ceph.osd.11.smithi177.stdout:Aug 31 04:41:02 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-11[46864]: 2024-08-31T04:41:02.124+0000 7fd602bf1640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-08-31T04:39:46.939525+0000 front 2024-08-31T04:39:46.939251+0000 (oldest deadline 2024-08-31T04:40:12.239391+0000) 2024-08-31T04:41:02.496 INFO:journalctl@ceph.osd.11.smithi177.stdout:Aug 31 04:41:02 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-11[46864]: 2024-08-31T04:41:02.124+0000 7fd602bf1640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.133:6812 osd.4 since back 2024-08-31T04:40:05.141613+0000 front 2024-08-31T04:40:05.141382+0000 (oldest deadline 2024-08-31T04:40:32.741898+0000) 2024-08-31T04:41:02.497 INFO:journalctl@ceph.osd.11.smithi177.stdout:Aug 31 04:41:02 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-11[46864]: 2024-08-31T04:41:02.124+0000 7fd602bf1640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.177:6812 osd.5 since back 2024-08-31T04:40:12.742231+0000 front 2024-08-31T04:40:12.742332+0000 (oldest deadline 2024-08-31T04:40:36.842325+0000) 2024-08-31T04:41:02.497 INFO:journalctl@ceph.osd.11.smithi177.stdout:Aug 31 04:41:02 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-11[46864]: 2024-08-31T04:41:02.124+0000 7fd602bf1640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.50:6822 osd.6 since back 2024-08-31T04:40:19.743250+0000 front 2024-08-31T04:40:19.743271+0000 (oldest deadline 2024-08-31T04:40:43.843231+0000) 2024-08-31T04:41:02.497 INFO:journalctl@ceph.osd.11.smithi177.stdout:Aug 31 04:41:02 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-11[46864]: 2024-08-31T04:41:02.124+0000 7fd602bf1640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.133:6820 osd.7 since back 2024-08-31T04:40:27.344310+0000 front 2024-08-31T04:40:27.344398+0000 (oldest deadline 2024-08-31T04:40:52.644299+0000) 2024-08-31T04:41:02.497 INFO:journalctl@ceph.osd.11.smithi177.stdout:Aug 31 04:41:02 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-11[46864]: 2024-08-31T04:41:02.124+0000 7fd602bf1640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.177:6820 osd.8 since back 2024-08-31T04:40:36.546323+0000 front 2024-08-31T04:40:36.546295+0000 (oldest deadline 2024-08-31T04:40:59.947228+0000) 2024-08-31T04:41:03.496 INFO:journalctl@ceph.osd.11.smithi177.stdout:Aug 31 04:41:03 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-11[46864]: 2024-08-31T04:41:03.158+0000 7fd602bf1640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.50:6806 osd.0 since back 2024-08-31T04:39:30.036711+0000 front 2024-08-31T04:39:30.036747+0000 (oldest deadline 2024-08-31T04:39:55.936674+0000) 2024-08-31T04:41:03.496 INFO:journalctl@ceph.osd.11.smithi177.stdout:Aug 31 04:41:03 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-11[46864]: 2024-08-31T04:41:03.158+0000 7fd602bf1640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.133:6804 osd.1 since back 2024-08-31T04:39:41.138475+0000 front 2024-08-31T04:39:41.138491+0000 (oldest deadline 2024-08-31T04:40:04.038356+0000) 2024-08-31T04:41:03.497 INFO:journalctl@ceph.osd.11.smithi177.stdout:Aug 31 04:41:03 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-11[46864]: 2024-08-31T04:41:03.158+0000 7fd602bf1640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-08-31T04:39:46.939525+0000 front 2024-08-31T04:39:46.939251+0000 (oldest deadline 2024-08-31T04:40:12.239391+0000) 2024-08-31T04:41:03.497 INFO:journalctl@ceph.osd.11.smithi177.stdout:Aug 31 04:41:03 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-11[46864]: 2024-08-31T04:41:03.158+0000 7fd602bf1640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.133:6812 osd.4 since back 2024-08-31T04:40:05.141613+0000 front 2024-08-31T04:40:05.141382+0000 (oldest deadline 2024-08-31T04:40:32.741898+0000) 2024-08-31T04:41:03.497 INFO:journalctl@ceph.osd.11.smithi177.stdout:Aug 31 04:41:03 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-11[46864]: 2024-08-31T04:41:03.158+0000 7fd602bf1640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.177:6812 osd.5 since back 2024-08-31T04:40:12.742231+0000 front 2024-08-31T04:40:12.742332+0000 (oldest deadline 2024-08-31T04:40:36.842325+0000) 2024-08-31T04:41:03.497 INFO:journalctl@ceph.osd.11.smithi177.stdout:Aug 31 04:41:03 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-11[46864]: 2024-08-31T04:41:03.158+0000 7fd602bf1640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.50:6822 osd.6 since back 2024-08-31T04:40:19.743250+0000 front 2024-08-31T04:40:19.743271+0000 (oldest deadline 2024-08-31T04:40:43.843231+0000) 2024-08-31T04:41:03.497 INFO:journalctl@ceph.osd.11.smithi177.stdout:Aug 31 04:41:03 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-11[46864]: 2024-08-31T04:41:03.158+0000 7fd602bf1640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.133:6820 osd.7 since back 2024-08-31T04:40:27.344310+0000 front 2024-08-31T04:40:27.344398+0000 (oldest deadline 2024-08-31T04:40:52.644299+0000) 2024-08-31T04:41:03.497 INFO:journalctl@ceph.osd.11.smithi177.stdout:Aug 31 04:41:03 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-11[46864]: 2024-08-31T04:41:03.158+0000 7fd602bf1640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.177:6820 osd.8 since back 2024-08-31T04:40:36.546323+0000 front 2024-08-31T04:40:36.546295+0000 (oldest deadline 2024-08-31T04:40:59.947228+0000) 2024-08-31T04:41:03.870 INFO:journalctl@ceph.osd.11.smithi177.stdout:Aug 31 04:41:03 smithi177 podman[59104]: 2024-08-31 04:41:03.590499029 +0000 UTC m=+5.505690649 container died b137b29927bde9b099c26c1e7cc33149af31a9824e3d87c0b0c9baf24416893e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-11, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, io.buildah.version=1.37.1, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731) 2024-08-31T04:41:04.228 INFO:journalctl@ceph.osd.11.smithi177.stdout:Aug 31 04:41:03 smithi177 podman[59104]: 2024-08-31 04:41:03.990701559 +0000 UTC m=+5.905893181 container cleanup b137b29927bde9b099c26c1e7cc33149af31a9824e3d87c0b0c9baf24416893e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-11, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.1, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611) 2024-08-31T04:41:04.228 INFO:journalctl@ceph.osd.11.smithi177.stdout:Aug 31 04:41:03 smithi177 bash[59104]: ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-11 2024-08-31T04:41:04.496 INFO:journalctl@ceph.osd.11.smithi177.stdout:Aug 31 04:41:04 smithi177 podman[59120]: 2024-08-31 04:41:04.227105831 +0000 UTC m=+0.639784916 container remove b137b29927bde9b099c26c1e7cc33149af31a9824e3d87c0b0c9baf24416893e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-11, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, io.buildah.version=1.37.1, GIT_CLEAN=True, ceph=True, maintainer=Guillaume Abrioux , RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611) 2024-08-31T04:41:04.906 INFO:journalctl@ceph.osd.11.smithi177.stdout:Aug 31 04:41:04 smithi177 podman[59207]: 2024-08-31 04:41:04.627791218 +0000 UTC m=+0.083466053 container create b42ceef6935df56a1b331a12685f18fa79d9982e7538f34d07a4a89b6711cf1e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-11-deactivate, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, CEPH_POINT_RELEASE=, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, io.buildah.version=1.37.1, org.label-schema.vendor=CentOS, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611) 2024-08-31T04:41:04.906 INFO:journalctl@ceph.osd.11.smithi177.stdout:Aug 31 04:41:04 smithi177 podman[59207]: 2024-08-31 04:41:04.560050662 +0000 UTC m=+0.015725518 image pull 79f4cde5e36911a5dca995eeb98098c2c8aae81dd52a088ef2c867bc3363bad0 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61 2024-08-31T04:41:04.906 INFO:journalctl@ceph.osd.11.smithi177.stdout:Aug 31 04:41:04 smithi177 podman[59207]: 2024-08-31 04:41:04.829885714 +0000 UTC m=+0.285560549 container init b42ceef6935df56a1b331a12685f18fa79d9982e7538f34d07a4a89b6711cf1e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-11-deactivate, GIT_CLEAN=True, ceph=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.1, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731) 2024-08-31T04:41:04.906 INFO:journalctl@ceph.osd.11.smithi177.stdout:Aug 31 04:41:04 smithi177 podman[59207]: 2024-08-31 04:41:04.833131096 +0000 UTC m=+0.288805939 container start b42ceef6935df56a1b331a12685f18fa79d9982e7538f34d07a4a89b6711cf1e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-11-deactivate, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, io.buildah.version=1.37.1, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux ) 2024-08-31T04:41:05.246 INFO:journalctl@ceph.osd.11.smithi177.stdout:Aug 31 04:41:04 smithi177 podman[59207]: 2024-08-31 04:41:04.904842362 +0000 UTC m=+0.360517211 container attach b42ceef6935df56a1b331a12685f18fa79d9982e7538f34d07a4a89b6711cf1e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-11-deactivate, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , io.buildah.version=1.37.1) 2024-08-31T04:41:05.246 INFO:journalctl@ceph.osd.11.smithi177.stdout:Aug 31 04:41:05 smithi177 podman[59207]: 2024-08-31 04:41:05.034386601 +0000 UTC m=+0.490061449 container died b42ceef6935df56a1b331a12685f18fa79d9982e7538f34d07a4a89b6711cf1e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-osd-11-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, io.buildah.version=1.37.1, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_BRANCH=HEAD, GIT_CLEAN=True) 2024-08-31T04:41:05.611 DEBUG:teuthology.orchestra.run.smithi177:> sudo pkill -f 'journalctl -f -n 0 -u ceph-058d9fc6-674f-11ef-bcd4-c7b262605968@osd.11.service' 2024-08-31T04:41:05.650 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-31T04:41:05.650 INFO:tasks.cephadm.osd.11:Stopped osd.11 2024-08-31T04:41:05.650 INFO:tasks.cephadm.mds.a:Stopping mds.a... 2024-08-31T04:41:05.650 DEBUG:teuthology.orchestra.run.smithi050:> sudo systemctl stop ceph-058d9fc6-674f-11ef-bcd4-c7b262605968@mds.a 2024-08-31T04:41:06.047 INFO:journalctl@ceph.mds.a.smithi050.stdout:Aug 31 04:41:05 smithi050 systemd[1]: Stopping Ceph mds.a for 058d9fc6-674f-11ef-bcd4-c7b262605968... 2024-08-31T04:41:06.450 INFO:journalctl@ceph.mds.a.smithi050.stdout:Aug 31 04:41:06 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-mds-a[59517]: 2024-08-31T04:41:06.046+0000 7fcee5400640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-31T04:41:06.450 INFO:journalctl@ceph.mds.a.smithi050.stdout:Aug 31 04:41:06 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-mds-a[59517]: 2024-08-31T04:41:06.046+0000 7fcee5400640 -1 mds.a *** got signal Terminated *** 2024-08-31T04:41:07.432 INFO:journalctl@ceph.mds.a.smithi050.stdout:Aug 31 04:41:07 smithi050 podman[88352]: 2024-08-31 04:41:07.336512141 +0000 UTC m=+1.395520082 container died 686fff29296fcc60aaba1579748b176321682db4f8bb0747eb6315b63a0bab7c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-mds-a, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.1, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_CLEAN=True, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611) 2024-08-31T04:41:08.013 INFO:journalctl@ceph.mds.a.smithi050.stdout:Aug 31 04:41:07 smithi050 podman[88352]: 2024-08-31 04:41:07.785034344 +0000 UTC m=+1.844042277 container cleanup 686fff29296fcc60aaba1579748b176321682db4f8bb0747eb6315b63a0bab7c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-mds-a, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, ceph=True, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, io.buildah.version=1.37.1, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image) 2024-08-31T04:41:08.013 INFO:journalctl@ceph.mds.a.smithi050.stdout:Aug 31 04:41:07 smithi050 bash[88352]: ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-mds-a 2024-08-31T04:41:08.307 INFO:journalctl@ceph.mds.a.smithi050.stdout:Aug 31 04:41:08 smithi050 podman[88368]: 2024-08-31 04:41:08.011355847 +0000 UTC m=+0.668052418 container remove 686fff29296fcc60aaba1579748b176321682db4f8bb0747eb6315b63a0bab7c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-mds-a, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, io.buildah.version=1.37.1, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, ceph=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True) 2024-08-31T04:41:08.332 DEBUG:teuthology.orchestra.run.smithi050:> sudo pkill -f 'journalctl -f -n 0 -u ceph-058d9fc6-674f-11ef-bcd4-c7b262605968@mds.a.service' 2024-08-31T04:41:08.406 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-31T04:41:08.406 INFO:tasks.cephadm.mds.a:Stopped mds.a 2024-08-31T04:41:08.406 INFO:tasks.cephadm.mds.d:Stopping mds.d... 2024-08-31T04:41:08.406 DEBUG:teuthology.orchestra.run.smithi050:> sudo systemctl stop ceph-058d9fc6-674f-11ef-bcd4-c7b262605968@mds.d 2024-08-31T04:41:08.700 INFO:journalctl@ceph.mds.d.smithi050.stdout:Aug 31 04:41:08 smithi050 systemd[1]: Stopping Ceph mds.d for 058d9fc6-674f-11ef-bcd4-c7b262605968... 2024-08-31T04:41:09.200 INFO:journalctl@ceph.mds.d.smithi050.stdout:Aug 31 04:41:08 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-mds-d[80219]: 2024-08-31T04:41:08.808+0000 7fb79fc00640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.d -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-31T04:41:09.200 INFO:journalctl@ceph.mds.d.smithi050.stdout:Aug 31 04:41:08 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-mds-d[80219]: 2024-08-31T04:41:08.808+0000 7fb79fc00640 -1 mds.d *** got signal Terminated *** 2024-08-31T04:41:11.658 INFO:journalctl@ceph.mds.d.smithi050.stdout:Aug 31 04:41:11 smithi050 podman[88486]: 2024-08-31 04:41:11.322433171 +0000 UTC m=+2.643209373 container died c22de27cfed4797d6e4954d1620c3265097a3ccd82f9776df81f4a544a58e656 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-mds-d, org.label-schema.license=GPLv2, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.1, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD) 2024-08-31T04:41:11.950 INFO:journalctl@ceph.mds.d.smithi050.stdout:Aug 31 04:41:11 smithi050 podman[88486]: 2024-08-31 04:41:11.747427584 +0000 UTC m=+3.068203785 container cleanup c22de27cfed4797d6e4954d1620c3265097a3ccd82f9776df81f4a544a58e656 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-mds-d, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.schema-version=1.0, io.buildah.version=1.37.1, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, GIT_CLEAN=True, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731) 2024-08-31T04:41:11.950 INFO:journalctl@ceph.mds.d.smithi050.stdout:Aug 31 04:41:11 smithi050 bash[88486]: ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-mds-d 2024-08-31T04:41:12.381 INFO:journalctl@ceph.mds.d.smithi050.stdout:Aug 31 04:41:12 smithi050 podman[88500]: 2024-08-31 04:41:12.124146715 +0000 UTC m=+0.782433294 container remove c22de27cfed4797d6e4954d1620c3265097a3ccd82f9776df81f4a544a58e656 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-mds-d, GIT_CLEAN=True, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , ceph=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, io.buildah.version=1.37.1, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-08-31T04:41:12.401 DEBUG:teuthology.orchestra.run.smithi050:> sudo pkill -f 'journalctl -f -n 0 -u ceph-058d9fc6-674f-11ef-bcd4-c7b262605968@mds.d.service' 2024-08-31T04:41:12.472 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-31T04:41:12.472 INFO:tasks.cephadm.mds.d:Stopped mds.d 2024-08-31T04:41:12.472 INFO:tasks.cephadm.mds.g:Stopping mds.g... 2024-08-31T04:41:12.472 DEBUG:teuthology.orchestra.run.smithi050:> sudo systemctl stop ceph-058d9fc6-674f-11ef-bcd4-c7b262605968@mds.g 2024-08-31T04:41:12.700 INFO:journalctl@ceph.mds.g.smithi050.stdout:Aug 31 04:41:12 smithi050 systemd[1]: Stopping Ceph mds.g for 058d9fc6-674f-11ef-bcd4-c7b262605968... 2024-08-31T04:41:13.200 INFO:journalctl@ceph.mds.g.smithi050.stdout:Aug 31 04:41:12 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-mds-g[59136]: 2024-08-31T04:41:12.863+0000 7fbb78000640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.g -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-31T04:41:13.200 INFO:journalctl@ceph.mds.g.smithi050.stdout:Aug 31 04:41:12 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-mds-g[59136]: 2024-08-31T04:41:12.863+0000 7fbb78000640 -1 mds.g *** got signal Terminated *** 2024-08-31T04:41:15.579 INFO:journalctl@ceph.mds.g.smithi050.stdout:Aug 31 04:41:15 smithi050 podman[88606]: 2024-08-31 04:41:15.315481571 +0000 UTC m=+2.563188189 container died 73defbf510949c872fae6cf7a881eb955c5a6bb34f403bd1a015c7334f2c5216 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-mds-g, io.buildah.version=1.37.1, org.label-schema.vendor=CentOS, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.build-date=20240731, ceph=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.license=GPLv2) 2024-08-31T04:41:15.837 INFO:journalctl@ceph.mds.g.smithi050.stdout:Aug 31 04:41:15 smithi050 podman[88606]: 2024-08-31 04:41:15.668444927 +0000 UTC m=+2.916151545 container cleanup 73defbf510949c872fae6cf7a881eb955c5a6bb34f403bd1a015c7334f2c5216 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-mds-g, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.vendor=CentOS, io.buildah.version=1.37.1, org.label-schema.schema-version=1.0, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_BRANCH=HEAD) 2024-08-31T04:41:15.837 INFO:journalctl@ceph.mds.g.smithi050.stdout:Aug 31 04:41:15 smithi050 bash[88606]: ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-mds-g 2024-08-31T04:41:16.089 INFO:journalctl@ceph.mds.g.smithi050.stdout:Aug 31 04:41:15 smithi050 podman[88620]: 2024-08-31 04:41:15.83628072 +0000 UTC m=+0.509788710 container remove 73defbf510949c872fae6cf7a881eb955c5a6bb34f403bd1a015c7334f2c5216 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-mds-g, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.1, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, ceph=True) 2024-08-31T04:41:16.109 DEBUG:teuthology.orchestra.run.smithi050:> sudo pkill -f 'journalctl -f -n 0 -u ceph-058d9fc6-674f-11ef-bcd4-c7b262605968@mds.g.service' 2024-08-31T04:41:16.178 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-31T04:41:16.178 INFO:tasks.cephadm.mds.g:Stopped mds.g 2024-08-31T04:41:16.179 INFO:tasks.cephadm.mds.j:Stopping mds.j... 2024-08-31T04:41:16.179 DEBUG:teuthology.orchestra.run.smithi050:> sudo systemctl stop ceph-058d9fc6-674f-11ef-bcd4-c7b262605968@mds.j 2024-08-31T04:41:16.450 INFO:journalctl@ceph.mds.j.smithi050.stdout:Aug 31 04:41:16 smithi050 systemd[1]: Stopping Ceph mds.j for 058d9fc6-674f-11ef-bcd4-c7b262605968... 2024-08-31T04:41:16.950 INFO:journalctl@ceph.mds.j.smithi050.stdout:Aug 31 04:41:16 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-mds-j[57934]: 2024-08-31T04:41:16.675+0000 7f1e52e00640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.j -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-31T04:41:16.950 INFO:journalctl@ceph.mds.j.smithi050.stdout:Aug 31 04:41:16 smithi050 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-mds-j[57934]: 2024-08-31T04:41:16.675+0000 7f1e52e00640 -1 mds.j *** got signal Terminated *** 2024-08-31T04:41:19.471 INFO:journalctl@ceph.mds.j.smithi050.stdout:Aug 31 04:41:19 smithi050 podman[88726]: 2024-08-31 04:41:19.213664492 +0000 UTC m=+2.761662426 container died 6b2360acad407f80e1bd405860db45f926a30f3c744c36517e310c790d4aac89 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-mds-j, io.buildah.version=1.37.1, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_CLEAN=True, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, ceph=True, org.label-schema.vendor=CentOS) 2024-08-31T04:41:19.750 INFO:journalctl@ceph.mds.j.smithi050.stdout:Aug 31 04:41:19 smithi050 podman[88726]: 2024-08-31 04:41:19.585708467 +0000 UTC m=+3.133706400 container cleanup 6b2360acad407f80e1bd405860db45f926a30f3c744c36517e310c790d4aac89 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-mds-j, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.schema-version=1.0, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, io.buildah.version=1.37.1, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-08-31T04:41:19.750 INFO:journalctl@ceph.mds.j.smithi050.stdout:Aug 31 04:41:19 smithi050 bash[88726]: ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-mds-j 2024-08-31T04:41:20.005 INFO:journalctl@ceph.mds.j.smithi050.stdout:Aug 31 04:41:19 smithi050 podman[88740]: 2024-08-31 04:41:19.749249585 +0000 UTC m=+0.529530339 container remove 6b2360acad407f80e1bd405860db45f926a30f3c744c36517e310c790d4aac89 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-mds-j, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.build-date=20240731, io.buildah.version=1.37.1, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, ceph=True, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-08-31T04:41:20.039 DEBUG:teuthology.orchestra.run.smithi050:> sudo pkill -f 'journalctl -f -n 0 -u ceph-058d9fc6-674f-11ef-bcd4-c7b262605968@mds.j.service' 2024-08-31T04:41:20.108 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-31T04:41:20.108 INFO:tasks.cephadm.mds.j:Stopped mds.j 2024-08-31T04:41:20.108 INFO:tasks.cephadm.mds.b:Stopping mds.b... 2024-08-31T04:41:20.108 DEBUG:teuthology.orchestra.run.smithi133:> sudo systemctl stop ceph-058d9fc6-674f-11ef-bcd4-c7b262605968@mds.b 2024-08-31T04:41:20.423 INFO:journalctl@ceph.mds.b.smithi133.stdout:Aug 31 04:41:20 smithi133 systemd[1]: Stopping Ceph mds.b for 058d9fc6-674f-11ef-bcd4-c7b262605968... 2024-08-31T04:41:20.680 INFO:journalctl@ceph.mds.b.smithi133.stdout:Aug 31 04:41:20 smithi133 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-mds-b[52113]: 2024-08-31T04:41:20.420+0000 7fb10d3ff640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-31T04:41:20.681 INFO:journalctl@ceph.mds.b.smithi133.stdout:Aug 31 04:41:20 smithi133 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-mds-b[52113]: 2024-08-31T04:41:20.420+0000 7fb10d3ff640 -1 mds.b *** got signal Terminated *** 2024-08-31T04:41:23.543 INFO:journalctl@ceph.mds.b.smithi133.stdout:Aug 31 04:41:23 smithi133 podman[58950]: 2024-08-31 04:41:23.230689204 +0000 UTC m=+2.926644395 container died 577c72e4bd06f347614927df37d77becb794dd74056440c4f8352a93a5d1d2ab (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-mds-b, org.label-schema.license=GPLv2, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, maintainer=Guillaume Abrioux , RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.1, CEPH_POINT_RELEASE=) 2024-08-31T04:41:23.848 INFO:journalctl@ceph.mds.b.smithi133.stdout:Aug 31 04:41:23 smithi133 podman[58950]: 2024-08-31 04:41:23.653800803 +0000 UTC m=+3.349756002 container cleanup 577c72e4bd06f347614927df37d77becb794dd74056440c4f8352a93a5d1d2ab (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-mds-b, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, io.buildah.version=1.37.1, org.label-schema.license=GPLv2, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_CLEAN=True, CEPH_POINT_RELEASE=) 2024-08-31T04:41:23.848 INFO:journalctl@ceph.mds.b.smithi133.stdout:Aug 31 04:41:23 smithi133 bash[58950]: ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-mds-b 2024-08-31T04:41:24.095 DEBUG:teuthology.orchestra.run.smithi133:> sudo pkill -f 'journalctl -f -n 0 -u ceph-058d9fc6-674f-11ef-bcd4-c7b262605968@mds.b.service' 2024-08-31T04:41:24.118 INFO:journalctl@ceph.mds.b.smithi133.stdout:Aug 31 04:41:23 smithi133 podman[58975]: 2024-08-31 04:41:23.846930747 +0000 UTC m=+0.615398223 container remove 577c72e4bd06f347614927df37d77becb794dd74056440c4f8352a93a5d1d2ab (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-mds-b, GIT_CLEAN=True, org.label-schema.license=GPLv2, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, io.buildah.version=1.37.1, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux ) 2024-08-31T04:41:24.118 INFO:journalctl@ceph.mds.b.smithi133.stdout:Aug 31 04:41:24 smithi133 systemd[1]: ceph-058d9fc6-674f-11ef-bcd4-c7b262605968@mds.b.service: Deactivated successfully. 2024-08-31T04:41:24.118 INFO:journalctl@ceph.mds.b.smithi133.stdout:Aug 31 04:41:24 smithi133 systemd[1]: Stopped Ceph mds.b for 058d9fc6-674f-11ef-bcd4-c7b262605968. 2024-08-31T04:41:24.118 INFO:journalctl@ceph.mds.b.smithi133.stdout:Aug 31 04:41:24 smithi133 systemd[1]: ceph-058d9fc6-674f-11ef-bcd4-c7b262605968@mds.b.service: Consumed 6min 32.635s CPU time. 2024-08-31T04:41:24.133 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-31T04:41:24.133 INFO:tasks.cephadm.mds.b:Stopped mds.b 2024-08-31T04:41:24.134 INFO:tasks.cephadm.mds.e:Stopping mds.e... 2024-08-31T04:41:24.134 DEBUG:teuthology.orchestra.run.smithi133:> sudo systemctl stop ceph-058d9fc6-674f-11ef-bcd4-c7b262605968@mds.e 2024-08-31T04:41:24.442 INFO:journalctl@ceph.mds.e.smithi133.stdout:Aug 31 04:41:24 smithi133 systemd[1]: Stopping Ceph mds.e for 058d9fc6-674f-11ef-bcd4-c7b262605968... 2024-08-31T04:41:24.793 INFO:journalctl@ceph.mds.e.smithi133.stdout:Aug 31 04:41:24 smithi133 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-mds-e[51497]: 2024-08-31T04:41:24.440+0000 7f9eb044f640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.e -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-31T04:41:24.793 INFO:journalctl@ceph.mds.e.smithi133.stdout:Aug 31 04:41:24 smithi133 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-mds-e[51497]: 2024-08-31T04:41:24.440+0000 7f9eb044f640 -1 mds.e *** got signal Terminated *** 2024-08-31T04:41:27.543 INFO:journalctl@ceph.mds.e.smithi133.stdout:Aug 31 04:41:27 smithi133 podman[59081]: 2024-08-31 04:41:27.267934169 +0000 UTC m=+2.919725791 container died e5f2accbe9c2990e77c7dd4caadaf9185213c81c55afab51f9ef4a40301561ca (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-mds-e, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, io.buildah.version=1.37.1, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_CLEAN=True, ceph=True) 2024-08-31T04:41:27.810 INFO:journalctl@ceph.mds.e.smithi133.stdout:Aug 31 04:41:27 smithi133 podman[59081]: 2024-08-31 04:41:27.616313401 +0000 UTC m=+3.268105066 container cleanup e5f2accbe9c2990e77c7dd4caadaf9185213c81c55afab51f9ef4a40301561ca (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-mds-e, io.buildah.version=1.37.1, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731) 2024-08-31T04:41:27.810 INFO:journalctl@ceph.mds.e.smithi133.stdout:Aug 31 04:41:27 smithi133 bash[59081]: ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-mds-e 2024-08-31T04:41:28.038 DEBUG:teuthology.orchestra.run.smithi133:> sudo pkill -f 'journalctl -f -n 0 -u ceph-058d9fc6-674f-11ef-bcd4-c7b262605968@mds.e.service' 2024-08-31T04:41:28.060 INFO:journalctl@ceph.mds.e.smithi133.stdout:Aug 31 04:41:27 smithi133 podman[59093]: 2024-08-31 04:41:27.809123962 +0000 UTC m=+0.529358342 container remove e5f2accbe9c2990e77c7dd4caadaf9185213c81c55afab51f9ef4a40301561ca (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-mds-e, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.1, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.build-date=20240731, GIT_CLEAN=True, ceph=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD) 2024-08-31T04:41:28.060 INFO:journalctl@ceph.mds.e.smithi133.stdout:Aug 31 04:41:28 smithi133 systemd[1]: ceph-058d9fc6-674f-11ef-bcd4-c7b262605968@mds.e.service: Deactivated successfully. 2024-08-31T04:41:28.060 INFO:journalctl@ceph.mds.e.smithi133.stdout:Aug 31 04:41:28 smithi133 systemd[1]: Stopped Ceph mds.e for 058d9fc6-674f-11ef-bcd4-c7b262605968. 2024-08-31T04:41:28.060 INFO:journalctl@ceph.mds.e.smithi133.stdout:Aug 31 04:41:28 smithi133 systemd[1]: ceph-058d9fc6-674f-11ef-bcd4-c7b262605968@mds.e.service: Consumed 17.876s CPU time. 2024-08-31T04:41:28.071 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-31T04:41:28.071 INFO:tasks.cephadm.mds.e:Stopped mds.e 2024-08-31T04:41:28.071 INFO:tasks.cephadm.mds.h:Stopping mds.h... 2024-08-31T04:41:28.072 DEBUG:teuthology.orchestra.run.smithi133:> sudo systemctl stop ceph-058d9fc6-674f-11ef-bcd4-c7b262605968@mds.h 2024-08-31T04:41:28.404 INFO:journalctl@ceph.mds.h.smithi133.stdout:Aug 31 04:41:28 smithi133 systemd[1]: Stopping Ceph mds.h for 058d9fc6-674f-11ef-bcd4-c7b262605968... 2024-08-31T04:41:28.793 INFO:journalctl@ceph.mds.h.smithi133.stdout:Aug 31 04:41:28 smithi133 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-mds-h[51811]: 2024-08-31T04:41:28.402+0000 7fb033bb3640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.h -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-31T04:41:28.793 INFO:journalctl@ceph.mds.h.smithi133.stdout:Aug 31 04:41:28 smithi133 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-mds-h[51811]: 2024-08-31T04:41:28.402+0000 7fb033bb3640 -1 mds.h *** got signal Terminated *** 2024-08-31T04:41:31.543 INFO:journalctl@ceph.mds.h.smithi133.stdout:Aug 31 04:41:31 smithi133 podman[59201]: 2024-08-31 04:41:31.229494248 +0000 UTC m=+2.935559911 container died 1a40854abb2619b6f8760c6fcf3e435da1f9c31f00669949ffb4ddbe0f55bd24 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-mds-h, org.label-schema.vendor=CentOS, GIT_CLEAN=True, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.1, ceph=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-08-31T04:41:32.043 INFO:journalctl@ceph.mds.h.smithi133.stdout:Aug 31 04:41:31 smithi133 podman[59201]: 2024-08-31 04:41:31.911250612 +0000 UTC m=+3.617316321 container cleanup 1a40854abb2619b6f8760c6fcf3e435da1f9c31f00669949ffb4ddbe0f55bd24 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-mds-h, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.vendor=CentOS, io.buildah.version=1.37.1, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, ceph=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.license=GPLv2) 2024-08-31T04:41:32.043 INFO:journalctl@ceph.mds.h.smithi133.stdout:Aug 31 04:41:31 smithi133 bash[59201]: ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-mds-h 2024-08-31T04:41:32.293 DEBUG:teuthology.orchestra.run.smithi133:> sudo pkill -f 'journalctl -f -n 0 -u ceph-058d9fc6-674f-11ef-bcd4-c7b262605968@mds.h.service' 2024-08-31T04:41:32.326 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-31T04:41:32.326 INFO:tasks.cephadm.mds.h:Stopped mds.h 2024-08-31T04:41:32.326 INFO:tasks.cephadm.mds.k:Stopping mds.k... 2024-08-31T04:41:32.326 DEBUG:teuthology.orchestra.run.smithi133:> sudo systemctl stop ceph-058d9fc6-674f-11ef-bcd4-c7b262605968@mds.k 2024-08-31T04:41:32.793 INFO:journalctl@ceph.mds.k.smithi133.stdout:Aug 31 04:41:32 smithi133 systemd[1]: Stopping Ceph mds.k for 058d9fc6-674f-11ef-bcd4-c7b262605968... 2024-08-31T04:41:32.793 INFO:journalctl@ceph.mds.k.smithi133.stdout:Aug 31 04:41:32 smithi133 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-mds-k[51181]: 2024-08-31T04:41:32.622+0000 7fcb73667640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.k -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-31T04:41:32.793 INFO:journalctl@ceph.mds.k.smithi133.stdout:Aug 31 04:41:32 smithi133 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-mds-k[51181]: 2024-08-31T04:41:32.622+0000 7fcb73667640 -1 mds.k *** got signal Terminated *** 2024-08-31T04:41:35.483 INFO:journalctl@ceph.mds.k.smithi133.stdout:Aug 31 04:41:35 smithi133 podman[59323]: 2024-08-31 04:41:35.225891344 +0000 UTC m=+2.688016903 container died e1b76e7537b40e6cb00fa9ae2c5bce4bdb01ed08ba15254eccc0a2600e11b1d3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-mds-k, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, io.buildah.version=1.37.1, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.license=GPLv2) 2024-08-31T04:41:35.793 INFO:journalctl@ceph.mds.k.smithi133.stdout:Aug 31 04:41:35 smithi133 podman[59323]: 2024-08-31 04:41:35.564877209 +0000 UTC m=+3.027002768 container cleanup e1b76e7537b40e6cb00fa9ae2c5bce4bdb01ed08ba15254eccc0a2600e11b1d3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-mds-k, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.license=GPLv2, io.buildah.version=1.37.1, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-08-31T04:41:35.793 INFO:journalctl@ceph.mds.k.smithi133.stdout:Aug 31 04:41:35 smithi133 bash[59323]: ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-mds-k 2024-08-31T04:41:35.794 INFO:journalctl@ceph.mds.k.smithi133.stdout:Aug 31 04:41:35 smithi133 podman[59335]: 2024-08-31 04:41:35.724104014 +0000 UTC m=+0.494834268 container remove e1b76e7537b40e6cb00fa9ae2c5bce4bdb01ed08ba15254eccc0a2600e11b1d3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-mds-k, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, io.buildah.version=1.37.1, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, ceph=True, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux ) 2024-08-31T04:41:35.972 DEBUG:teuthology.orchestra.run.smithi133:> sudo pkill -f 'journalctl -f -n 0 -u ceph-058d9fc6-674f-11ef-bcd4-c7b262605968@mds.k.service' 2024-08-31T04:41:36.004 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-31T04:41:36.004 INFO:tasks.cephadm.mds.k:Stopped mds.k 2024-08-31T04:41:36.004 INFO:tasks.cephadm.mds.c:Stopping mds.c... 2024-08-31T04:41:36.005 DEBUG:teuthology.orchestra.run.smithi177:> sudo systemctl stop ceph-058d9fc6-674f-11ef-bcd4-c7b262605968@mds.c 2024-08-31T04:41:36.325 INFO:journalctl@ceph.mds.c.smithi177.stdout:Aug 31 04:41:36 smithi177 systemd[1]: Stopping Ceph mds.c for 058d9fc6-674f-11ef-bcd4-c7b262605968... 2024-08-31T04:41:36.578 INFO:journalctl@ceph.mds.c.smithi177.stdout:Aug 31 04:41:36 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-mds-c[52224]: 2024-08-31T04:41:36.323+0000 7feb32b62640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-31T04:41:36.579 INFO:journalctl@ceph.mds.c.smithi177.stdout:Aug 31 04:41:36 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-mds-c[52224]: 2024-08-31T04:41:36.323+0000 7feb32b62640 -1 mds.c *** got signal Terminated *** 2024-08-31T04:41:39.496 INFO:journalctl@ceph.mds.c.smithi177.stdout:Aug 31 04:41:39 smithi177 podman[59310]: 2024-08-31 04:41:39.221233853 +0000 UTC m=+3.016591112 container died c26f7a754db7c286b03ee2fdbbc4a42f5dcc1ef3d95833d2898b41869cfde156 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-mds-c, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.1, org.label-schema.vendor=CentOS, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, ceph=True) 2024-08-31T04:41:39.833 INFO:journalctl@ceph.mds.c.smithi177.stdout:Aug 31 04:41:39 smithi177 podman[59310]: 2024-08-31 04:41:39.581990252 +0000 UTC m=+3.377347515 container cleanup c26f7a754db7c286b03ee2fdbbc4a42f5dcc1ef3d95833d2898b41869cfde156 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-mds-c, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, io.buildah.version=1.37.1, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_CLEAN=True) 2024-08-31T04:41:39.834 INFO:journalctl@ceph.mds.c.smithi177.stdout:Aug 31 04:41:39 smithi177 bash[59310]: ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-mds-c 2024-08-31T04:41:39.967 DEBUG:teuthology.orchestra.run.smithi177:> sudo pkill -f 'journalctl -f -n 0 -u ceph-058d9fc6-674f-11ef-bcd4-c7b262605968@mds.c.service' 2024-08-31T04:41:40.003 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-31T04:41:40.003 INFO:tasks.cephadm.mds.c:Stopped mds.c 2024-08-31T04:41:40.003 INFO:tasks.cephadm.mds.f:Stopping mds.f... 2024-08-31T04:41:40.004 DEBUG:teuthology.orchestra.run.smithi177:> sudo systemctl stop ceph-058d9fc6-674f-11ef-bcd4-c7b262605968@mds.f 2024-08-31T04:41:40.336 INFO:journalctl@ceph.mds.f.smithi177.stdout:Aug 31 04:41:40 smithi177 systemd[1]: Stopping Ceph mds.f for 058d9fc6-674f-11ef-bcd4-c7b262605968... 2024-08-31T04:41:40.746 INFO:journalctl@ceph.mds.f.smithi177.stdout:Aug 31 04:41:40 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-mds-f[55490]: 2024-08-31T04:41:40.336+0000 7f9433dd9640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.f -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-31T04:41:40.746 INFO:journalctl@ceph.mds.f.smithi177.stdout:Aug 31 04:41:40 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-mds-f[55490]: 2024-08-31T04:41:40.336+0000 7f9433dd9640 -1 mds.f *** got signal Terminated *** 2024-08-31T04:41:42.495 INFO:journalctl@ceph.mds.f.smithi177.stdout:Aug 31 04:41:42 smithi177 podman[59443]: 2024-08-31 04:41:42.218817318 +0000 UTC m=+1.996991706 container died a7ae3a81cc5d1dc958fe33ad202dd0bfac1ac15a5dc8a55b47a3c2d8984ce527 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-mds-f, io.buildah.version=1.37.1, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux ) 2024-08-31T04:41:42.746 INFO:journalctl@ceph.mds.f.smithi177.stdout:Aug 31 04:41:42 smithi177 podman[59443]: 2024-08-31 04:41:42.591275496 +0000 UTC m=+2.369449871 container cleanup a7ae3a81cc5d1dc958fe33ad202dd0bfac1ac15a5dc8a55b47a3c2d8984ce527 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-mds-f, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, io.buildah.version=1.37.1, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, ceph=True) 2024-08-31T04:41:42.746 INFO:journalctl@ceph.mds.f.smithi177.stdout:Aug 31 04:41:42 smithi177 bash[59443]: ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-mds-f 2024-08-31T04:41:42.969 DEBUG:teuthology.orchestra.run.smithi177:> sudo pkill -f 'journalctl -f -n 0 -u ceph-058d9fc6-674f-11ef-bcd4-c7b262605968@mds.f.service' 2024-08-31T04:41:43.002 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-31T04:41:43.002 INFO:tasks.cephadm.mds.f:Stopped mds.f 2024-08-31T04:41:43.002 INFO:tasks.cephadm.mds.i:Stopping mds.i... 2024-08-31T04:41:43.002 DEBUG:teuthology.orchestra.run.smithi177:> sudo systemctl stop ceph-058d9fc6-674f-11ef-bcd4-c7b262605968@mds.i 2024-08-31T04:41:43.332 INFO:journalctl@ceph.mds.i.smithi177.stdout:Aug 31 04:41:43 smithi177 systemd[1]: Stopping Ceph mds.i for 058d9fc6-674f-11ef-bcd4-c7b262605968... 2024-08-31T04:41:43.746 INFO:journalctl@ceph.mds.i.smithi177.stdout:Aug 31 04:41:43 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-mds-i[52527]: 2024-08-31T04:41:43.330+0000 7f10cbf91640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.i -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-31T04:41:43.746 INFO:journalctl@ceph.mds.i.smithi177.stdout:Aug 31 04:41:43 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-mds-i[52527]: 2024-08-31T04:41:43.330+0000 7f10cbf91640 -1 mds.i *** got signal Terminated *** 2024-08-31T04:41:47.496 INFO:journalctl@ceph.mds.i.smithi177.stdout:Aug 31 04:41:47 smithi177 podman[59565]: 2024-08-31 04:41:47.223452957 +0000 UTC m=+3.996356799 container died 68b1404a620127c35f37f80a7ec18ac9c631bc20d468e38606ddb72eb9114191 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-mds-i, org.label-schema.schema-version=1.0, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_CLEAN=True, io.buildah.version=1.37.1, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS) 2024-08-31T04:41:47.841 INFO:journalctl@ceph.mds.i.smithi177.stdout:Aug 31 04:41:47 smithi177 podman[59565]: 2024-08-31 04:41:47.664116484 +0000 UTC m=+4.437020334 container cleanup 68b1404a620127c35f37f80a7ec18ac9c631bc20d468e38606ddb72eb9114191 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-mds-i, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, io.buildah.version=1.37.1, org.label-schema.schema-version=1.0, ceph=True, maintainer=Guillaume Abrioux ) 2024-08-31T04:41:47.841 INFO:journalctl@ceph.mds.i.smithi177.stdout:Aug 31 04:41:47 smithi177 bash[59565]: ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-mds-i 2024-08-31T04:41:48.092 DEBUG:teuthology.orchestra.run.smithi177:> sudo pkill -f 'journalctl -f -n 0 -u ceph-058d9fc6-674f-11ef-bcd4-c7b262605968@mds.i.service' 2024-08-31T04:41:48.114 INFO:journalctl@ceph.mds.i.smithi177.stdout:Aug 31 04:41:47 smithi177 podman[59577]: 2024-08-31 04:41:47.840268908 +0000 UTC m=+0.610075425 container remove 68b1404a620127c35f37f80a7ec18ac9c631bc20d468e38606ddb72eb9114191 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-mds-i, GIT_BRANCH=HEAD, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.1, ceph=True, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS) 2024-08-31T04:41:48.114 INFO:journalctl@ceph.mds.i.smithi177.stdout:Aug 31 04:41:48 smithi177 systemd[1]: ceph-058d9fc6-674f-11ef-bcd4-c7b262605968@mds.i.service: Deactivated successfully. 2024-08-31T04:41:48.114 INFO:journalctl@ceph.mds.i.smithi177.stdout:Aug 31 04:41:48 smithi177 systemd[1]: Stopped Ceph mds.i for 058d9fc6-674f-11ef-bcd4-c7b262605968. 2024-08-31T04:41:48.114 INFO:journalctl@ceph.mds.i.smithi177.stdout:Aug 31 04:41:48 smithi177 systemd[1]: ceph-058d9fc6-674f-11ef-bcd4-c7b262605968@mds.i.service: Consumed 3min 48.854s CPU time. 2024-08-31T04:41:48.125 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-31T04:41:48.125 INFO:tasks.cephadm.mds.i:Stopped mds.i 2024-08-31T04:41:48.126 INFO:tasks.cephadm.mds.l:Stopping mds.l... 2024-08-31T04:41:48.126 DEBUG:teuthology.orchestra.run.smithi177:> sudo systemctl stop ceph-058d9fc6-674f-11ef-bcd4-c7b262605968@mds.l 2024-08-31T04:41:48.444 INFO:journalctl@ceph.mds.l.smithi177.stdout:Aug 31 04:41:48 smithi177 systemd[1]: Stopping Ceph mds.l for 058d9fc6-674f-11ef-bcd4-c7b262605968... 2024-08-31T04:41:48.746 INFO:journalctl@ceph.mds.l.smithi177.stdout:Aug 31 04:41:48 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-mds-l[51608]: 2024-08-31T04:41:48.442+0000 7f265771a640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.l -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-31T04:41:48.746 INFO:journalctl@ceph.mds.l.smithi177.stdout:Aug 31 04:41:48 smithi177 ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-mds-l[51608]: 2024-08-31T04:41:48.442+0000 7f265771a640 -1 mds.l *** got signal Terminated *** 2024-08-31T04:41:51.496 INFO:journalctl@ceph.mds.l.smithi177.stdout:Aug 31 04:41:51 smithi177 podman[59686]: 2024-08-31 04:41:51.218388128 +0000 UTC m=+2.873164166 container died ac04c1d014388a3bf1bc06da017735a8540c6169474aa059b3eea8de829d714a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-mds-l, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.1, org.label-schema.build-date=20240731, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD) 2024-08-31T04:41:51.936 INFO:journalctl@ceph.mds.l.smithi177.stdout:Aug 31 04:41:51 smithi177 podman[59686]: 2024-08-31 04:41:51.734232378 +0000 UTC m=+3.389008416 container cleanup ac04c1d014388a3bf1bc06da017735a8540c6169474aa059b3eea8de829d714a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-mds-l, ceph=True, GIT_CLEAN=True, org.label-schema.license=GPLv2, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.1, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS) 2024-08-31T04:41:51.936 INFO:journalctl@ceph.mds.l.smithi177.stdout:Aug 31 04:41:51 smithi177 bash[59686]: ceph-058d9fc6-674f-11ef-bcd4-c7b262605968-mds-l 2024-08-31T04:41:52.162 DEBUG:teuthology.orchestra.run.smithi177:> sudo pkill -f 'journalctl -f -n 0 -u ceph-058d9fc6-674f-11ef-bcd4-c7b262605968@mds.l.service' 2024-08-31T04:41:52.194 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-31T04:41:52.194 INFO:tasks.cephadm.mds.l:Stopped mds.l 2024-08-31T04:41:52.195 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 058d9fc6-674f-11ef-bcd4-c7b262605968 --force --keep-logs 2024-08-31T04:41:52.477 INFO:teuthology.orchestra.run.smithi050.stdout:Deleting cluster with fsid: 058d9fc6-674f-11ef-bcd4-c7b262605968 2024-08-31T04:41:56.552 DEBUG:teuthology.orchestra.run.smithi133:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 058d9fc6-674f-11ef-bcd4-c7b262605968 --force --keep-logs 2024-08-31T04:41:56.753 INFO:teuthology.orchestra.run.smithi133.stdout:Deleting cluster with fsid: 058d9fc6-674f-11ef-bcd4-c7b262605968 2024-08-31T04:41:59.287 DEBUG:teuthology.orchestra.run.smithi177:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 058d9fc6-674f-11ef-bcd4-c7b262605968 --force --keep-logs 2024-08-31T04:41:59.489 INFO:teuthology.orchestra.run.smithi177.stdout:Deleting cluster with fsid: 058d9fc6-674f-11ef-bcd4-c7b262605968 2024-08-31T04:42:01.899 DEBUG:teuthology.orchestra.run.smithi050:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-08-31T04:42:01.964 DEBUG:teuthology.orchestra.run.smithi133:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-08-31T04:42:01.996 DEBUG:teuthology.orchestra.run.smithi177:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-08-31T04:42:02.024 INFO:tasks.cephadm:Archiving crash dumps... 2024-08-31T04:42:02.027 DEBUG:teuthology.misc:Transferring archived files from smithi050:/var/lib/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/crash to /home/teuthworker/archive/mchangir-2024-08-30_08:30:37-fs-wip-mchangir-testing-20240828.085847-main-debug-distro-default-smithi/7881274/remote/smithi050/crash 2024-08-31T04:42:02.028 DEBUG:teuthology.orchestra.run.smithi050:> sudo tar c -f - -C /var/lib/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/crash -- . 2024-08-31T04:42:02.086 INFO:teuthology.orchestra.run.smithi050.stderr:tar: /var/lib/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/crash: Cannot open: No such file or directory 2024-08-31T04:42:02.086 INFO:teuthology.orchestra.run.smithi050.stderr:tar: Error is not recoverable: exiting now 2024-08-31T04:42:02.089 DEBUG:teuthology.misc:Transferring archived files from smithi133:/var/lib/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/crash to /home/teuthworker/archive/mchangir-2024-08-30_08:30:37-fs-wip-mchangir-testing-20240828.085847-main-debug-distro-default-smithi/7881274/remote/smithi133/crash 2024-08-31T04:42:02.090 DEBUG:teuthology.orchestra.run.smithi133:> sudo tar c -f - -C /var/lib/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/crash -- . 2024-08-31T04:42:02.135 INFO:teuthology.orchestra.run.smithi133.stderr:tar: /var/lib/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/crash: Cannot open: No such file or directory 2024-08-31T04:42:02.135 INFO:teuthology.orchestra.run.smithi133.stderr:tar: Error is not recoverable: exiting now 2024-08-31T04:42:02.138 DEBUG:teuthology.misc:Transferring archived files from smithi177:/var/lib/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/crash to /home/teuthworker/archive/mchangir-2024-08-30_08:30:37-fs-wip-mchangir-testing-20240828.085847-main-debug-distro-default-smithi/7881274/remote/smithi177/crash 2024-08-31T04:42:02.139 DEBUG:teuthology.orchestra.run.smithi177:> sudo tar c -f - -C /var/lib/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/crash -- . 2024-08-31T04:42:02.185 INFO:teuthology.orchestra.run.smithi177.stderr:tar: /var/lib/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/crash: Cannot open: No such file or directory 2024-08-31T04:42:02.186 INFO:teuthology.orchestra.run.smithi177.stderr:tar: Error is not recoverable: exiting now 2024-08-31T04:42:02.187 INFO:tasks.cephadm:Checking cluster log for badness... 2024-08-31T04:42:02.187 DEBUG:teuthology.orchestra.run.smithi050:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v 'fs.*is degraded' | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v 'insufficient standby MDS daemons available' | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'online, but wants' | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | head -n 1 2024-08-31T04:42:02.264 INFO:teuthology.orchestra.run.smithi050.stdout:2024-08-31T04:32:53.642823+0000 mds.h (mds.3) 1 : cluster [WRN] 1 slow requests, 1 included below; oldest blocked for > 185.003465 secs 2024-08-31T04:42:02.265 WARNING:tasks.cephadm:Found errors (ERR|WRN|SEC) in cluster log 2024-08-31T04:42:02.266 INFO:tasks.cephadm:Compressing logs... 2024-08-31T04:42:02.266 DEBUG:teuthology.orchestra.run.smithi050:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-08-31T04:42:02.270 DEBUG:teuthology.orchestra.run.smithi133:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-08-31T04:42:02.273 DEBUG:teuthology.orchestra.run.smithi177:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-08-31T04:42:02.298 INFO:teuthology.orchestra.run.smithi177.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/ceph-volume.log 2024-08-31T04:42:02.298 INFO:teuthology.orchestra.run.smithi177.stderr:: No such file or directory 2024-08-31T04:42:02.298 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/ceph.audit.log 2024-08-31T04:42:02.298 INFO:teuthology.orchestra.run.smithi177.stderr:gzip/var/log/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/ceph-volume.log: -5 --verbose -- /var/log/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/ceph-mds.i.log 2024-08-31T04:42:02.299 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/ceph-mon.c.log 2024-08-31T04:42:02.299 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/ceph-mds.i.log: gzip -5 --verbose -- /var/log/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/ceph.cephadm.log 2024-08-31T04:42:02.299 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/ceph-osd.11.log 2024-08-31T04:42:02.305 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/ceph-osd.2.log 2024-08-31T04:42:02.305 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/ceph-osd.11.log: gzip -5 --verbose -- /var/log/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/ceph-osd.5.log 2024-08-31T04:42:02.305 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/ceph.log 2024-08-31T04:42:02.305 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/ceph-mds.l.log 2024-08-31T04:42:02.305 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/ceph.log: gzip -5 --verbose -- /var/log/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/ceph-osd.8.log 2024-08-31T04:42:02.305 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/ceph-mds.l.log: gzip -5 --verbose -- /var/log/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/ceph-mgr.z.log 2024-08-31T04:42:02.305 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/ceph-osd.8.log: gzip -5 --verbose -- /var/log/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/ceph-mds.c.log 2024-08-31T04:42:02.305 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/ceph-mgr.z.log: gzip -5 --verbose -- /var/log/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/ceph-mds.f.log 2024-08-31T04:42:02.305 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-08-31T04:42:02.305 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/ceph-mds.f.log: /var/log/ceph/cephadm.log: 92.2% -- replaced with /var/log/ceph/cephadm.log.gz 2024-08-31T04:42:02.307 INFO:teuthology.orchestra.run.smithi133.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/ceph-osd.10.log 2024-08-31T04:42:02.307 INFO:teuthology.orchestra.run.smithi133.stderr:: No such file or directory 2024-08-31T04:42:02.307 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/ceph-osd.1.log 2024-08-31T04:42:02.307 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/ceph-osd.10.log: gzip -5 --verbose -- /var/log/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/ceph-osd.7.log 2024-08-31T04:42:02.307 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/ceph-volume.log 2024-08-31T04:42:02.307 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/ceph-mds.b.log 2024-08-31T04:42:02.307 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/ceph-mds.k.log 2024-08-31T04:42:02.307 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/ceph-osd.4.log 2024-08-31T04:42:02.307 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/ceph-mds.k.log: gzip -5 --verbose -- /var/log/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/ceph.audit.log 2024-08-31T04:42:02.307 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/ceph.cephadm.log 2024-08-31T04:42:02.308 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/ceph-mgr.y.log 2024-08-31T04:42:02.308 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/ceph.log 2024-08-31T04:42:02.308 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/ceph-mds.h.log 2024-08-31T04:42:02.308 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/ceph.log: gzip -5 --verbose -- /var/log/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/ceph-mon.b.log 2024-08-31T04:42:02.308 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/ceph-mds.h.log: gzip -5 --verbose -- /var/log/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/ceph-mds.e.log 2024-08-31T04:42:02.308 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-08-31T04:42:02.319 INFO:teuthology.orchestra.run.smithi050.stderr:find: ‘/var/log/rbd-target-api’: No such file or directory 2024-08-31T04:42:02.320 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/ceph-osd.0.log 2024-08-31T04:42:02.320 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/ceph-osd.9.log 2024-08-31T04:42:02.321 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/ceph-volume.log 2024-08-31T04:42:02.322 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/ceph-osd.9.log: gzip -5 --verbose -- /var/log/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/ceph.audit.log 2024-08-31T04:42:02.323 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/ceph-mds.a.log 2024-08-31T04:42:02.324 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/ceph.cephadm.log 2024-08-31T04:42:02.325 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/ceph-mon.a.log 2024-08-31T04:42:02.327 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/ceph-mds.g.log 2024-08-31T04:42:02.327 INFO:teuthology.orchestra.run.smithi050.stderr: 82.2% -- replaced with /var/log/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/ceph.cephadm.log.gz 2024-08-31T04:42:02.327 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/ceph-mon.a.log: 90.2% -- replaced with /var/log/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/ceph.audit.log.gz 2024-08-31T04:42:02.328 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/ceph-osd.6.log 2024-08-31T04:42:02.329 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/ceph-mds.g.log: gzip -5 --verbose -- /var/log/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/ceph.log 2024-08-31T04:42:02.331 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/ceph-osd.6.log: /var/log/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/ceph.log: gzip -5 --verbose -- /var/log/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/ceph-mds.d.log 2024-08-31T04:42:02.336 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/ceph-mds.d.log: gzip -5 --verbose -- /var/log/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/ceph-mgr.x.log 2024-08-31T04:42:02.337 INFO:teuthology.orchestra.run.smithi050.stderr: 90.8% -- replaced with /var/log/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/ceph-volume.log.gz 2024-08-31T04:42:02.342 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/ceph-mgr.x.log: 86.7% -- replaced with /var/log/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/ceph.log.gz 2024-08-31T04:42:02.342 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/ceph-mds.j.log 2024-08-31T04:42:02.347 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/ceph-osd.3.log 2024-08-31T04:42:02.348 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/ceph-mds.j.log: gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-08-31T04:42:02.366 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/ceph-osd.3.log: /var/log/ceph/cephadm.log: 95.0% -- replaced with /var/log/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/ceph-mds.j.log.gz 2024-08-31T04:42:02.368 INFO:teuthology.orchestra.run.smithi050.stderr: 93.1% -- replaced with /var/log/ceph/cephadm.log.gz 2024-08-31T04:42:02.488 INFO:teuthology.orchestra.run.smithi177.stderr: 91.0% -- replaced with /var/log/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/ceph-volume.log.gz 2024-08-31T04:42:02.489 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/ceph-mds.e.log: /var/log/ceph/cephadm.log: 91.8% -- replaced with /var/log/ceph/cephadm.log.gz 2024-08-31T04:42:02.490 INFO:teuthology.orchestra.run.smithi133.stderr: 82.0% -- replaced with /var/log/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/ceph.cephadm.log.gz 2024-08-31T04:42:02.513 INFO:teuthology.orchestra.run.smithi177.stderr: 82.0% -- replaced with /var/log/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/ceph.cephadm.log.gz 2024-08-31T04:42:02.515 INFO:teuthology.orchestra.run.smithi177.stderr: 86.7% -- replaced with /var/log/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/ceph.log.gz 2024-08-31T04:42:02.530 INFO:teuthology.orchestra.run.smithi177.stderr: 92.9% -- replaced with /var/log/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/ceph-mgr.z.log.gz 2024-08-31T04:42:02.559 INFO:teuthology.orchestra.run.smithi133.stderr: 90.8% -- replaced with /var/log/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/ceph-volume.log.gz 2024-08-31T04:42:02.618 INFO:teuthology.orchestra.run.smithi133.stderr: 86.7% -- replaced with /var/log/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/ceph.log.gz 2024-08-31T04:42:02.623 INFO:teuthology.orchestra.run.smithi133.stderr: 90.4% -- replaced with /var/log/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/ceph.audit.log.gz 2024-08-31T04:42:02.637 INFO:teuthology.orchestra.run.smithi177.stderr: 90.4% -- replaced with /var/log/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/ceph.audit.log.gz 2024-08-31T04:42:02.695 INFO:teuthology.orchestra.run.smithi050.stderr: 90.3% -- replaced with /var/log/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/ceph-mgr.x.log.gz 2024-08-31T04:42:02.951 INFO:teuthology.orchestra.run.smithi177.stderr: 91.6% -- replaced with /var/log/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/ceph-mon.c.log.gz 2024-08-31T04:42:03.938 INFO:teuthology.orchestra.run.smithi050.stderr: 90.1% -- replaced with /var/log/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/ceph-mon.a.log.gz 2024-08-31T04:42:03.963 INFO:teuthology.orchestra.run.smithi133.stderr: 92.9% -- replaced with /var/log/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/ceph-mgr.y.log.gz 2024-08-31T04:42:05.052 INFO:teuthology.orchestra.run.smithi133.stderr: 91.6% -- replaced with /var/log/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/ceph-mon.b.log.gz 2024-08-31T04:42:08.061 INFO:teuthology.orchestra.run.smithi050.stderr: 95.3% -- replaced with /var/log/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/ceph-mds.g.log.gz 2024-08-31T04:42:08.756 INFO:teuthology.orchestra.run.smithi050.stderr: 95.2% -- replaced with /var/log/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/ceph-mds.d.log.gz 2024-08-31T04:42:09.659 INFO:teuthology.orchestra.run.smithi177.stderr: 95.7% -- replaced with /var/log/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/ceph-mds.l.log.gz 2024-08-31T04:42:13.342 INFO:teuthology.orchestra.run.smithi177.stderr: 95.5% -- replaced with /var/log/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/ceph-mds.f.log.gz 2024-08-31T04:42:16.278 INFO:teuthology.orchestra.run.smithi050.stderr: 91.7% -- replaced with /var/log/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/ceph-osd.9.log.gz 2024-08-31T04:42:19.144 INFO:teuthology.orchestra.run.smithi177.stderr: 91.5% -- replaced with /var/log/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/ceph-osd.8.log.gz 2024-08-31T04:42:19.160 INFO:teuthology.orchestra.run.smithi050.stderr: 91.6% -- replaced with /var/log/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/ceph-osd.6.log.gz 2024-08-31T04:42:21.200 INFO:teuthology.orchestra.run.smithi050.stderr: 91.6% -- replaced with /var/log/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/ceph-osd.0.log.gz 2024-08-31T04:42:24.015 INFO:teuthology.orchestra.run.smithi050.stderr: 91.7% -- replaced with /var/log/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/ceph-osd.3.log.gz 2024-08-31T04:42:25.016 INFO:teuthology.orchestra.run.smithi133.stderr: 95.4% -- replaced with /var/log/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/ceph-mds.e.log.gz 2024-08-31T04:42:26.544 INFO:teuthology.orchestra.run.smithi177.stderr: 91.4% -- replaced with /var/log/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/ceph-osd.5.log.gz 2024-08-31T04:42:27.192 INFO:teuthology.orchestra.run.smithi177.stderr: 91.6% -- replaced with /var/log/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/ceph-osd.11.log.gz 2024-08-31T04:42:28.056 INFO:teuthology.orchestra.run.smithi177.stderr: 91.6% -- replaced with /var/log/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/ceph-osd.2.log.gz 2024-08-31T04:42:33.630 INFO:teuthology.orchestra.run.smithi133.stderr: 91.6% -- replaced with /var/log/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/ceph-osd.1.log.gz 2024-08-31T04:42:34.921 INFO:teuthology.orchestra.run.smithi133.stderr: 91.5% -- replaced with /var/log/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/ceph-osd.10.log.gz 2024-08-31T04:42:39.278 INFO:teuthology.orchestra.run.smithi133.stderr: 95.4% -- replaced with /var/log/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/ceph-mds.k.log.gz 2024-08-31T04:43:00.132 INFO:teuthology.orchestra.run.smithi133.stderr: 91.7% -- replaced with /var/log/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/ceph-osd.4.log.gz 2024-08-31T04:43:06.161 INFO:teuthology.orchestra.run.smithi133.stderr: 91.5% -- replaced with /var/log/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/ceph-osd.7.log.gz 2024-08-31T04:43:17.965 INFO:teuthology.orchestra.run.smithi177.stderr: 94.0% -- replaced with /var/log/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/ceph-mds.c.log.gz 2024-08-31T04:43:21.283 INFO:teuthology.orchestra.run.smithi177.stderr: 93.9% -- replaced with /var/log/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/ceph-mds.i.log.gz 2024-08-31T04:43:21.285 INFO:teuthology.orchestra.run.smithi177.stderr: 2024-08-31T04:43:21.285 INFO:teuthology.orchestra.run.smithi177.stderr:real 1m18.997s 2024-08-31T04:43:21.285 INFO:teuthology.orchestra.run.smithi177.stderr:user 3m47.142s 2024-08-31T04:43:21.286 INFO:teuthology.orchestra.run.smithi177.stderr:sys 0m7.202s 2024-08-31T04:43:32.815 INFO:teuthology.orchestra.run.smithi050.stderr: 93.8% -- replaced with /var/log/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/ceph-mds.a.log.gz 2024-08-31T04:43:32.818 INFO:teuthology.orchestra.run.smithi050.stderr: 2024-08-31T04:43:32.818 INFO:teuthology.orchestra.run.smithi050.stderr:real 1m30.520s 2024-08-31T04:43:32.818 INFO:teuthology.orchestra.run.smithi050.stderr:user 2m43.022s 2024-08-31T04:43:32.818 INFO:teuthology.orchestra.run.smithi050.stderr:sys 0m12.537s 2024-08-31T04:45:35.764 INFO:teuthology.orchestra.run.smithi133.stderr: 94.0% -- replaced with /var/log/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/ceph-mds.h.log.gz 2024-08-31T04:46:39.352 INFO:teuthology.orchestra.run.smithi133.stderr: 93.5% -- replaced with /var/log/ceph/058d9fc6-674f-11ef-bcd4-c7b262605968/ceph-mds.b.log.gz 2024-08-31T04:46:39.354 INFO:teuthology.orchestra.run.smithi133.stderr: 2024-08-31T04:46:39.354 INFO:teuthology.orchestra.run.smithi133.stderr:real 4m37.065s 2024-08-31T04:46:39.354 INFO:teuthology.orchestra.run.smithi133.stderr:user 4m28.755s 2024-08-31T04:46:39.354 INFO:teuthology.orchestra.run.smithi133.stderr:sys 0m10.106s 2024-08-31T04:46:39.354 INFO:tasks.cephadm:Archiving logs... 2024-08-31T04:46:39.355 DEBUG:teuthology.misc:Transferring archived files from smithi050:/var/log/ceph to /home/teuthworker/archive/mchangir-2024-08-30_08:30:37-fs-wip-mchangir-testing-20240828.085847-main-debug-distro-default-smithi/7881274/remote/smithi050/log 2024-08-31T04:46:39.356 DEBUG:teuthology.orchestra.run.smithi050:> sudo tar c -f - -C /var/log/ceph -- . 2024-08-31T04:47:01.603 DEBUG:teuthology.misc:Transferring archived files from smithi133:/var/log/ceph to /home/teuthworker/archive/mchangir-2024-08-30_08:30:37-fs-wip-mchangir-testing-20240828.085847-main-debug-distro-default-smithi/7881274/remote/smithi133/log 2024-08-31T04:47:01.604 DEBUG:teuthology.orchestra.run.smithi133:> sudo tar c -f - -C /var/log/ceph -- . 2024-08-31T04:47:43.827 DEBUG:teuthology.misc:Transferring archived files from smithi177:/var/log/ceph to /home/teuthworker/archive/mchangir-2024-08-30_08:30:37-fs-wip-mchangir-testing-20240828.085847-main-debug-distro-default-smithi/7881274/remote/smithi177/log 2024-08-31T04:47:43.828 DEBUG:teuthology.orchestra.run.smithi177:> sudo tar c -f - -C /var/log/ceph -- . 2024-08-31T04:48:16.750 INFO:tasks.cephadm:Removing cluster... 2024-08-31T04:48:16.750 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 058d9fc6-674f-11ef-bcd4-c7b262605968 --force 2024-08-31T04:48:17.035 INFO:teuthology.orchestra.run.smithi050.stdout:Deleting cluster with fsid: 058d9fc6-674f-11ef-bcd4-c7b262605968 2024-08-31T04:48:18.011 DEBUG:teuthology.orchestra.run.smithi133:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 058d9fc6-674f-11ef-bcd4-c7b262605968 --force 2024-08-31T04:48:18.213 INFO:teuthology.orchestra.run.smithi133.stdout:Deleting cluster with fsid: 058d9fc6-674f-11ef-bcd4-c7b262605968 2024-08-31T04:48:18.752 DEBUG:teuthology.orchestra.run.smithi177:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 058d9fc6-674f-11ef-bcd4-c7b262605968 --force 2024-08-31T04:48:18.955 INFO:teuthology.orchestra.run.smithi177.stdout:Deleting cluster with fsid: 058d9fc6-674f-11ef-bcd4-c7b262605968 2024-08-31T04:48:19.542 INFO:tasks.cephadm:Removing cephadm ... 2024-08-31T04:48:19.542 DEBUG:teuthology.orchestra.run.smithi050:> rm -rf /home/ubuntu/cephtest/cephadm 2024-08-31T04:48:19.582 DEBUG:teuthology.orchestra.run.smithi133:> rm -rf /home/ubuntu/cephtest/cephadm 2024-08-31T04:48:19.600 DEBUG:teuthology.orchestra.run.smithi177:> rm -rf /home/ubuntu/cephtest/cephadm 2024-08-31T04:48:19.617 INFO:tasks.cephadm:Teardown complete 2024-08-31T04:48:19.617 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-08-31T04:48:19.630 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-08-31T04:48:19.630 DEBUG:teuthology.orchestra.run.smithi050:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-08-31T04:48:19.635 DEBUG:teuthology.orchestra.run.smithi133:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-08-31T04:48:19.643 DEBUG:teuthology.orchestra.run.smithi177:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-08-31T04:48:19.771 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-08-31T04:48:19.780 INFO:teuthology.task.clock:Checking final clock skew... 2024-08-31T04:48:19.781 DEBUG:teuthology.orchestra.run.smithi050:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-08-31T04:48:19.785 DEBUG:teuthology.orchestra.run.smithi133:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-08-31T04:48:19.788 DEBUG:teuthology.orchestra.run.smithi177:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-08-31T04:48:19.801 INFO:teuthology.orchestra.run.smithi133.stderr:bash: line 1: ntpq: command not found 2024-08-31T04:48:19.802 INFO:teuthology.orchestra.run.smithi177.stderr:bash: line 1: ntpq: command not found 2024-08-31T04:48:19.815 INFO:teuthology.orchestra.run.smithi133.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-08-31T04:48:19.815 INFO:teuthology.orchestra.run.smithi133.stdout:=============================================================================== 2024-08-31T04:48:19.815 INFO:teuthology.orchestra.run.smithi133.stdout:^* hv01.front.sepia.ceph.com 3 6 377 33 +191us[ +187us] +/- 55ms 2024-08-31T04:48:19.815 INFO:teuthology.orchestra.run.smithi133.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 29 -21us[ -21us] +/- 57ms 2024-08-31T04:48:19.815 INFO:teuthology.orchestra.run.smithi133.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 27 -284us[ -284us] +/- 77ms 2024-08-31T04:48:19.815 INFO:teuthology.orchestra.run.smithi133.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-08-31T04:48:19.816 INFO:teuthology.orchestra.run.smithi177.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-08-31T04:48:19.816 INFO:teuthology.orchestra.run.smithi177.stdout:=============================================================================== 2024-08-31T04:48:19.816 INFO:teuthology.orchestra.run.smithi177.stdout:^* hv01.front.sepia.ceph.com 3 6 377 33 +206us[ +211us] +/- 55ms 2024-08-31T04:48:19.816 INFO:teuthology.orchestra.run.smithi177.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 28 -20us[ -20us] +/- 57ms 2024-08-31T04:48:19.816 INFO:teuthology.orchestra.run.smithi177.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 34 -265us[ -261us] +/- 77ms 2024-08-31T04:48:19.816 INFO:teuthology.orchestra.run.smithi177.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-08-31T04:48:19.817 INFO:teuthology.orchestra.run.smithi050.stderr:bash: line 1: ntpq: command not found 2024-08-31T04:48:19.824 INFO:teuthology.orchestra.run.smithi050.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-08-31T04:48:19.825 INFO:teuthology.orchestra.run.smithi050.stdout:=============================================================================== 2024-08-31T04:48:19.825 INFO:teuthology.orchestra.run.smithi050.stdout:^* hv01.front.sepia.ceph.com 3 6 377 27 +231us[ +238us] +/- 55ms 2024-08-31T04:48:19.825 INFO:teuthology.orchestra.run.smithi050.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 28 +3740ns[ +11us] +/- 57ms 2024-08-31T04:48:19.825 INFO:teuthology.orchestra.run.smithi050.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 26 -245us[ -245us] +/- 77ms 2024-08-31T04:48:19.825 INFO:teuthology.orchestra.run.smithi050.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-08-31T04:48:19.826 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-08-31T04:48:19.836 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-08-31T04:48:19.837 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-08-31T04:48:19.846 DEBUG:teuthology.orchestra.run.smithi050:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-08-31T04:48:19.982 DEBUG:teuthology.orchestra.run.smithi133:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-08-31T04:48:20.052 DEBUG:teuthology.orchestra.run.smithi177:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-08-31T04:48:20.112 DEBUG:teuthology.orchestra.run.smithi050:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-08-31T04:48:20.172 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-31T04:48:20.172 DEBUG:teuthology.orchestra.run.smithi133:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-08-31T04:48:20.200 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-31T04:48:20.201 DEBUG:teuthology.orchestra.run.smithi177:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-08-31T04:48:20.227 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-31T04:48:20.227 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-08-31T04:48:20.238 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-08-31T04:48:20.249 INFO:teuthology.task.internal:Duration was 2491.915853 seconds 2024-08-31T04:48:20.250 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-08-31T04:48:20.261 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-08-31T04:48:20.261 DEBUG:teuthology.orchestra.run.smithi050:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-08-31T04:48:20.265 DEBUG:teuthology.orchestra.run.smithi133:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-08-31T04:48:20.268 DEBUG:teuthology.orchestra.run.smithi177:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-08-31T04:48:20.318 INFO:teuthology.orchestra.run.smithi177.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-08-31T04:48:20.323 INFO:teuthology.orchestra.run.smithi133.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-08-31T04:48:20.349 INFO:teuthology.orchestra.run.smithi050.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-08-31T04:48:20.769 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-08-31T04:48:20.769 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi050.front.sepia.ceph.com 2024-08-31T04:48:20.770 DEBUG:teuthology.orchestra.run.smithi050:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-08-31T04:48:20.819 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi133.front.sepia.ceph.com 2024-08-31T04:48:20.819 DEBUG:teuthology.orchestra.run.smithi133:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-08-31T04:48:20.851 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi177.front.sepia.ceph.com 2024-08-31T04:48:20.852 DEBUG:teuthology.orchestra.run.smithi177:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-08-31T04:48:20.890 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-08-31T04:48:20.890 DEBUG:teuthology.orchestra.run.smithi050:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-08-31T04:48:20.894 DEBUG:teuthology.orchestra.run.smithi133:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-08-31T04:48:20.897 DEBUG:teuthology.orchestra.run.smithi177:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-08-31T04:48:20.957 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-08-31T04:48:20.957 DEBUG:teuthology.orchestra.run.smithi050:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-08-31T04:48:20.962 DEBUG:teuthology.orchestra.run.smithi133:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-08-31T04:48:20.965 DEBUG:teuthology.orchestra.run.smithi177:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-08-31T04:48:21.874 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-08-31T04:48:21.885 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-08-31T04:48:21.886 DEBUG:teuthology.orchestra.run.smithi050:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-08-31T04:48:21.942 DEBUG:teuthology.orchestra.run.smithi133:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-08-31T04:48:21.969 DEBUG:teuthology.orchestra.run.smithi177:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-08-31T04:48:21.997 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-08-31T04:48:22.008 DEBUG:teuthology.orchestra.run.smithi050:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-08-31T04:48:22.013 DEBUG:teuthology.orchestra.run.smithi133:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-08-31T04:48:22.016 DEBUG:teuthology.orchestra.run.smithi177:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-08-31T04:48:22.051 INFO:teuthology.orchestra.run.smithi133.stdout:kernel.core_pattern = core 2024-08-31T04:48:22.062 INFO:teuthology.orchestra.run.smithi177.stdout:kernel.core_pattern = core 2024-08-31T04:48:22.080 INFO:teuthology.orchestra.run.smithi050.stdout:kernel.core_pattern = core 2024-08-31T04:48:22.110 DEBUG:teuthology.orchestra.run.smithi050:> test -e /home/ubuntu/cephtest/archive/coredump 2024-08-31T04:48:22.143 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-31T04:48:22.144 DEBUG:teuthology.orchestra.run.smithi133:> test -e /home/ubuntu/cephtest/archive/coredump 2024-08-31T04:48:22.159 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-31T04:48:22.159 DEBUG:teuthology.orchestra.run.smithi177:> test -e /home/ubuntu/cephtest/archive/coredump 2024-08-31T04:48:22.174 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-31T04:48:22.175 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-08-31T04:48:22.186 INFO:teuthology.task.internal:Transferring archived files... 2024-08-31T04:48:22.188 DEBUG:teuthology.misc:Transferring archived files from smithi050:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/mchangir-2024-08-30_08:30:37-fs-wip-mchangir-testing-20240828.085847-main-debug-distro-default-smithi/7881274/remote/smithi050 2024-08-31T04:48:22.188 DEBUG:teuthology.orchestra.run.smithi050:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-08-31T04:48:22.267 DEBUG:teuthology.misc:Transferring archived files from smithi133:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/mchangir-2024-08-30_08:30:37-fs-wip-mchangir-testing-20240828.085847-main-debug-distro-default-smithi/7881274/remote/smithi133 2024-08-31T04:48:22.267 DEBUG:teuthology.orchestra.run.smithi133:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-08-31T04:48:22.301 DEBUG:teuthology.misc:Transferring archived files from smithi177:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/mchangir-2024-08-30_08:30:37-fs-wip-mchangir-testing-20240828.085847-main-debug-distro-default-smithi/7881274/remote/smithi177 2024-08-31T04:48:22.302 DEBUG:teuthology.orchestra.run.smithi177:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-08-31T04:48:22.337 INFO:teuthology.task.internal:Removing archive directory... 2024-08-31T04:48:22.337 DEBUG:teuthology.orchestra.run.smithi050:> rm -rf -- /home/ubuntu/cephtest/archive 2024-08-31T04:48:22.341 DEBUG:teuthology.orchestra.run.smithi133:> rm -rf -- /home/ubuntu/cephtest/archive 2024-08-31T04:48:22.344 DEBUG:teuthology.orchestra.run.smithi177:> rm -rf -- /home/ubuntu/cephtest/archive 2024-08-31T04:48:22.388 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-08-31T04:48:22.401 INFO:teuthology.task.internal:Not uploading archives. 2024-08-31T04:48:22.401 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-08-31T04:48:22.449 INFO:teuthology.task.internal:Tidying up after the test... 2024-08-31T04:48:22.450 DEBUG:teuthology.orchestra.run.smithi050:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-08-31T04:48:22.454 DEBUG:teuthology.orchestra.run.smithi133:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-08-31T04:48:22.456 DEBUG:teuthology.orchestra.run.smithi177:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-08-31T04:48:22.470 INFO:teuthology.orchestra.run.smithi133.stdout: 262165 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Aug 31 04:48 /home/ubuntu/cephtest 2024-08-31T04:48:22.472 INFO:teuthology.orchestra.run.smithi177.stdout: 262165 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Aug 31 04:48 /home/ubuntu/cephtest 2024-08-31T04:48:22.485 INFO:teuthology.orchestra.run.smithi050.stdout: 393233 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Aug 31 04:48 /home/ubuntu/cephtest 2024-08-31T04:48:22.487 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-08-31T04:48:22.498 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-08-31T04:48:22.525 INFO:teuthology.run:Summary data: client.0-kernel-sha1: 8ad8b8b160987a14eb199bb67cc00e23a08d43f6 description: fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/legacy wsync/yes} objectstore-ec/bluestore-comp omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/automatic export-check n/5 replication/always} standby-replay tasks/{0-subvolume/{with-namespace-isolated} 1-check-counter 2-scrub/no 3-snaps/no 4-flush/yes 5-quiesce/with-quiesce 6-workunit/suites/blogbench}} duration: 2491.9158527851105 failure_reason: 'error during quiesce thrashing: Error quiescing set ''9d491f02'': 1 (EPERM)' flavor: default owner: scheduled_mchangir@teuthology status: fail success: false 2024-08-31T04:48:22.525 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-08-31T04:48:22.603 INFO:teuthology.run:FAIL